2023-10-10T20:43:17.407 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-10T20:43:17.408 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --archive /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506 --verbose -- /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/orig.config.yaml 2023-10-10T20:43:17.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T20:43:17.565 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506 branch: wip-yuri3-testing-2023-10-10-0720-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: yweinste@redhat.com first_in_suite: false job_id: '7420506' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-10-0720-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 46d1f59b549730ba7f93d940a3d32b94c45a4cf7 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 46d1f59b549730ba7f93d940a3d32b94c45a4cf7 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-10-0720-quincy sha1: 46d1f59b549730ba7f93d940a3d32b94c45a4cf7 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2048 sha1: 46d1f59b549730ba7f93d940a3d32b94c45a4cf7 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-10-0720-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_46d1f59b549730ba7f93d940a3d32b94c45a4cf7/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 46d1f59b549730ba7f93d940a3d32b94c45a4cf7 targets: smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNAa0MyBX2SU4fh7sucJJWCW69Q9CDdzir7pJcHcQDH8NGhcNSLzbBDzXXohkDW3rbYVuMgCDjVnwTEySKowwPA= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN7S5515JYyPdNib3a3l7tnFLiIwt94OcfgmTLunS2XukTJ83ie3YP/0+lZiRm1skvf9eMKCQG33cCv81WblGTo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-10_18:16:52 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-10T20:43:17.565 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_46d1f59b549730ba7f93d940a3d32b94c45a4cf7/qa; will attempt to use it 2023-10-10T20:43:17.566 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_46d1f59b549730ba7f93d940a3d32b94c45a4cf7/qa/tasks 2023-10-10T20:43:17.566 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-10T20:43:17.568 INFO:teuthology.task.internal:Checking packages... 2023-10-10T20:43:17.591 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '46d1f59b549730ba7f93d940a3d32b94c45a4cf7' 2023-10-10T20:43:17.591 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-10T20:43:17.592 INFO:teuthology.packaging:ref: None 2023-10-10T20:43:17.592 INFO:teuthology.packaging:tag: None 2023-10-10T20:43:17.592 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-10-0720-quincy 2023-10-10T20:43:17.593 INFO:teuthology.packaging:sha1: 46d1f59b549730ba7f93d940a3d32b94c45a4cf7 2023-10-10T20:43:17.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-10-10-0720-quincy 2023-10-10T20:43:17.731 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1374.g46d1f59b 2023-10-10T20:43:17.732 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-10T20:43:17.739 INFO:teuthology.task.internal:no buildpackages task found 2023-10-10T20:43:17.739 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-10T20:43:17.802 INFO:teuthology.task.internal:Saving configuration 2023-10-10T20:43:17.818 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-10T20:43:17.824 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T20:43:17.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 20:37:50.283033', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNAa0MyBX2SU4fh7sucJJWCW69Q9CDdzir7pJcHcQDH8NGhcNSLzbBDzXXohkDW3rbYVuMgCDjVnwTEySKowwPA='} 2023-10-10T20:43:17.868 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 20:37:50.284628', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN7S5515JYyPdNib3a3l7tnFLiIwt94OcfgmTLunS2XukTJ83ie3YP/0+lZiRm1skvf9eMKCQG33cCv81WblGTo='} 2023-10-10T20:43:17.868 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-10T20:43:17.874 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-10T20:43:17.875 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-10T20:43:17.875 INFO:teuthology.run_tasks:Running task console_log... 2023-10-10T20:43:17.944 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f070504eb80>, signals=[15]) 2023-10-10T20:43:17.945 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-10T20:43:17.951 INFO:teuthology.task.internal:Opening connections... 2023-10-10T20:43:17.952 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T20:43:17.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:43:18.021 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T20:43:18.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:43:18.089 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-10T20:43:18.096 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-10-10T20:43:18.115 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-10-10T20:43:18.115 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-10-10T20:43:18.171 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T20:43:18.171 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T20:43:18.172 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2023-10-10T20:43:18.172 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2023-10-10T20:43:18.172 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.4" 2023-10-10T20:43:18.172 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-10-10T20:43:18.173 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T20:43:18.173 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-10-10T20:43:18.173 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T20:43:18.173 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T20:43:18.173 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T20:43:18.173 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T20:43:18.174 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T20:43:18.174 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T20:43:18.174 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T20:43:18.175 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T20:43:18.175 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T20:43:18.176 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-10-10T20:43:18.197 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-10-10T20:43:18.216 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-10-10T20:43:18.217 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-10T20:43:18.273 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T20:43:18.273 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T20:43:18.273 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-10-10T20:43:18.273 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-10-10T20:43:18.274 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.4" 2023-10-10T20:43:18.274 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-10-10T20:43:18.274 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T20:43:18.274 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-10-10T20:43:18.275 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T20:43:18.275 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T20:43:18.275 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T20:43:18.277 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T20:43:18.277 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T20:43:18.277 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T20:43:18.278 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T20:43:18.278 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T20:43:18.278 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T20:43:18.279 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-10T20:43:18.296 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-10T20:43:18.306 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-10T20:43:18.311 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-10T20:43:18.312 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2023-10-10T20:43:18.314 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2023-10-10T20:43:18.330 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-10T20:43:18.336 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-10T20:43:18.336 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2023-10-10T20:43:18.370 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2023-10-10T20:43:18.384 INFO:teuthology.orchestra.run.smithi154.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-10T20:43:18.386 INFO:teuthology.orchestra.run.smithi179.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-10T20:43:18.388 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-10T20:43:18.443 INFO:teuthology.run_tasks:Running task kernel... 2023-10-10T20:43:18.457 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-10T20:43:18.458 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-10T20:43:18.459 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-10T20:43:18.459 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-10T20:43:18.460 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-10T20:43:18.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T20:43:18.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-10T20:43:18.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T20:43:18.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-10T20:43:18.715 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-10T20:43:18.715 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-10T20:43:18.715 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-10-10T20:43:18.719 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-10T20:43:18.719 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-10T20:43:18.719 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-10-10T20:43:18.732 INFO:teuthology.orchestra.run.smithi154.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-10T20:43:18.732 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-10T20:43:18.733 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-10T20:43:18.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum upgrade -y linux-firmware 2023-10-10T20:43:18.736 INFO:teuthology.orchestra.run.smithi179.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-10T20:43:18.736 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-10T20:43:18.736 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-10T20:43:18.737 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum upgrade -y linux-firmware 2023-10-10T20:43:20.188 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-10-10T20:43:20.189 INFO:teuthology.orchestra.run.smithi154.stdout:Unable to read consumer identity 2023-10-10T20:43:20.212 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-10T20:43:20.212 INFO:teuthology.orchestra.run.smithi179.stdout:Unable to read consumer identity 2023-10-10T20:43:21.613 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 35 kB/s | 3.5 kB 00:00 2023-10-10T20:43:21.630 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-10T20:43:22.314 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-10-10T20:43:22.442 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-10T20:43:25.601 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2023-10-10T20:43:25.724 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-10T20:43:26.433 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-10-10T20:43:26.434 INFO:teuthology.orchestra.run.smithi179.stdout:Nothing to do. 2023-10-10T20:43:26.435 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-10-10T20:43:26.538 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-10T20:43:26.539 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-10T20:43:26.580 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-10-10T20:43:26.580 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-10-10T20:43:26.581 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-10-10T20:43:26.714 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-10T20:43:26.714 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-10T20:43:26.889 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-10T20:43:26.889 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-10T20:43:26.892 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi179.front.sepia.ceph.com to complete... 2023-10-10T20:43:27.084 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-10T20:43:27.084 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-10T20:43:27.087 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi154.front.sepia.ceph.com to complete... 2023-10-10T20:43:41.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10 20:43:41 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-10T20:43:41.057 INFO:teuthology.orchestra.run.smithi179.stderr:FINISHED --2023-10-10 20:43:41-- 2023-10-10T20:43:41.057 INFO:teuthology.orchestra.run.smithi179.stderr:Total wall clock time: 14s 2023-10-10T20:43:41.058 INFO:teuthology.orchestra.run.smithi179.stderr:Downloaded: 1 files, 363M in 14s (26.1 MB/s) 2023-10-10T20:43:41.059 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-10T20:43:41.059 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-10T20:43:42.835 INFO:teuthology.orchestra.run.smithi179.stdout:Verifying... ######################################## 2023-10-10T20:43:43.249 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing... ######################################## 2023-10-10T20:43:43.375 INFO:teuthology.orchestra.run.smithi179.stdout:Updating / installing... 2023-10-10T20:43:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10 20:43:52 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-10T20:43:52.385 INFO:teuthology.orchestra.run.smithi154.stderr:FINISHED --2023-10-10 20:43:52-- 2023-10-10T20:43:52.385 INFO:teuthology.orchestra.run.smithi154.stderr:Total wall clock time: 25s 2023-10-10T20:43:52.385 INFO:teuthology.orchestra.run.smithi154.stderr:Downloaded: 1 files, 363M in 25s (14.5 MB/s) 2023-10-10T20:43:52.386 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-10T20:43:52.387 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-10T20:43:54.125 INFO:teuthology.orchestra.run.smithi154.stdout:Verifying... ######################################## 2023-10-10T20:43:54.527 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing... ######################################## 2023-10-10T20:43:54.654 INFO:teuthology.orchestra.run.smithi154.stdout:Updating / installing... 2023-10-10T20:44:21.320 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-10T20:44:32.749 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-10T20:44:45.539 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-10T20:44:45.539 DEBUG:teuthology.orchestra.run.smithi179:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-10T20:44:45.599 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:45.600 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:45.600 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:45.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:45.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-10T20:44:45.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-10T20:44:45.600 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-10T20:44:45.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-10T20:44:45.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-10T20:44:45.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-10T20:44:45.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-10T20:44:45.601 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-10T20:44:45.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-10T20:44:45.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-10T20:44:45.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-10T20:44:45.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-10T20:44:45.602 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-10T20:44:45.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-10T20:44:45.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-10T20:44:45.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-10T20:44:45.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-10T20:44:45.603 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-10T20:44:45.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-10T20:44:45.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-10T20:44:45.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-10T20:44:45.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-10T20:44:45.604 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-10T20:44:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-10T20:44:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-10T20:44:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-10T20:44:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-10T20:44:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-10T20:44:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-10T20:44:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-10T20:44:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-10T20:44:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-10T20:44:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-10T20:44:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-10T20:44:45.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-10T20:44:45.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-10T20:44:45.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-10T20:44:45.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-10T20:44:45.607 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-10T20:44:45.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-10T20:44:45.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-10T20:44:45.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-10T20:44:45.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-10T20:44:45.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-10T20:44:45.608 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-10T20:44:45.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-10T20:44:45.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-10T20:44:45.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-10T20:44:45.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-10T20:44:45.609 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-10T20:44:45.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-10T20:44:45.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-10T20:44:45.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-10T20:44:45.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-10T20:44:45.610 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-10T20:44:45.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-10T20:44:45.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-10T20:44:45.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-10T20:44:45.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-10T20:44:45.611 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-10T20:44:45.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-10T20:44:45.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-10T20:44:45.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-10T20:44:45.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-10T20:44:45.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-10T20:44:45.612 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-10T20:44:45.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-10T20:44:45.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-10T20:44:45.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-10T20:44:45.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-10T20:44:45.613 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-10T20:44:45.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-10T20:44:45.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-10T20:44:45.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-10T20:44:45.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-10T20:44:45.614 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-10T20:44:45.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-10T20:44:45.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-10T20:44:45.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-10T20:44:45.615 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-10T20:44:45.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-10T20:44:45.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-10T20:44:45.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-10T20:44:45.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-10T20:44:45.616 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-10T20:44:45.617 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-10T20:44:45.618 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-10T20:44:45.618 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-10T20:44:45.618 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-10T20:44:45.618 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-10T20:44:45.619 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-10T20:44:45.619 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-10T20:44:45.619 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-10T20:44:45.619 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-10T20:44:45.619 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-10T20:44:45.620 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-10T20:44:45.620 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-10T20:44:45.620 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-10T20:44:45.620 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-10T20:44:45.620 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-10T20:44:45.620 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-10T20:44:45.621 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-10T20:44:45.621 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-10T20:44:45.621 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-10T20:44:45.621 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-10T20:44:45.621 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-10T20:44:45.622 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-10T20:44:45.622 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-10T20:44:45.622 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-10T20:44:45.622 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-10T20:44:45.622 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-10T20:44:45.623 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-10T20:44:45.623 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-10T20:44:45.623 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-10T20:44:45.624 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-10T20:44:45.624 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-10T20:44:45.624 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-10T20:44:45.624 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-10T20:44:45.625 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-10T20:44:45.625 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-10T20:44:45.625 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-10T20:44:45.625 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-10T20:44:45.626 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-10T20:44:45.626 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-10T20:44:45.626 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-10T20:44:45.626 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-10T20:44:45.626 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-10T20:44:45.627 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-10T20:44:45.627 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-10T20:44:45.627 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-10T20:44:45.627 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-10T20:44:45.627 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-10T20:44:45.628 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-10T20:44:45.628 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-10T20:44:45.628 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-10T20:44:45.628 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-10T20:44:45.628 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-10T20:44:45.628 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-10T20:44:45.629 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-10T20:44:45.629 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-10T20:44:45.629 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-10T20:44:45.629 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-10T20:44:45.629 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-10T20:44:45.630 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-10T20:44:45.630 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-10T20:44:45.630 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-10T20:44:45.630 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-10T20:44:45.630 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-10T20:44:45.631 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-10T20:44:45.631 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-10T20:44:45.631 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-10T20:44:45.631 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-10T20:44:45.631 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-10T20:44:45.632 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-10T20:44:45.632 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-10T20:44:45.632 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-10T20:44:45.632 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-10T20:44:45.632 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-10T20:44:45.633 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-10T20:44:45.633 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-10T20:44:45.633 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-10T20:44:45.633 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-10T20:44:45.634 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-10T20:44:45.634 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-10T20:44:45.634 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-10T20:44:45.634 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-10T20:44:45.635 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-10T20:44:45.635 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-10T20:44:45.635 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-10T20:44:45.635 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-10T20:44:45.635 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-10T20:44:45.636 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-10T20:44:45.636 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-10T20:44:45.636 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-10T20:44:45.636 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-10T20:44:45.636 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-10T20:44:45.637 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-10T20:44:45.637 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-10T20:44:45.637 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-10T20:44:45.637 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-10T20:44:45.637 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-10T20:44:45.638 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-10T20:44:45.638 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-10T20:44:45.638 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-10T20:44:45.638 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-10T20:44:45.639 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-10T20:44:45.639 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-10T20:44:45.639 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-10T20:44:45.639 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-10T20:44:45.639 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-10T20:44:45.640 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-10T20:44:45.640 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-10T20:44:45.640 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-10T20:44:45.640 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-10T20:44:45.640 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-10T20:44:45.641 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-10T20:44:45.641 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-10T20:44:45.641 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-10T20:44:45.641 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-10T20:44:45.641 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-10T20:44:45.641 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-10T20:44:45.642 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-10T20:44:45.642 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-10T20:44:45.642 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-10T20:44:45.642 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-10T20:44:45.642 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-10T20:44:45.643 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-10T20:44:45.643 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-10T20:44:45.643 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-10T20:44:45.643 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-10T20:44:45.643 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-10T20:44:45.644 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-10T20:44:45.644 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-10T20:44:45.644 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-10T20:44:45.645 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-10T20:44:45.645 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-10T20:44:45.645 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-10T20:44:45.645 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-10T20:44:45.645 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-10T20:44:45.646 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-10T20:44:45.646 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-10T20:44:45.646 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-10T20:44:45.646 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-10T20:44:45.646 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-10T20:44:45.647 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-10T20:44:45.647 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-10T20:44:45.647 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-10T20:44:45.647 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-10T20:44:45.647 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-10T20:44:45.648 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-10T20:44:45.648 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-10T20:44:45.648 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-10T20:44:45.648 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-10T20:44:45.648 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-10T20:44:45.649 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-10T20:44:45.649 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-10T20:44:45.649 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-10T20:44:45.649 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-10T20:44:45.649 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-10T20:44:45.650 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-10T20:44:45.650 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-10T20:44:45.650 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-10T20:44:45.650 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-10T20:44:45.650 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-10T20:44:45.651 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-10T20:44:45.651 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-10T20:44:45.651 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-10T20:44:45.651 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-10T20:44:45.652 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-10T20:44:45.652 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-10T20:44:45.652 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-10T20:44:45.652 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-10T20:44:45.652 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-10T20:44:45.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-10T20:44:45.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-10T20:44:45.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-10T20:44:45.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-10T20:44:45.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-10T20:44:45.654 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-10T20:44:45.654 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-10T20:44:45.654 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-10T20:44:45.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-10T20:44:45.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-10T20:44:45.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-10T20:44:45.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-10T20:44:45.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-10T20:44:45.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-10T20:44:45.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-10T20:44:45.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-10T20:44:45.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-10T20:44:45.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-10T20:44:45.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-10T20:44:45.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-10T20:44:45.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-10T20:44:45.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-10T20:44:45.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-10T20:44:45.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-10T20:44:45.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-10T20:44:45.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-10T20:44:45.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-10T20:44:45.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-10T20:44:45.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-10T20:44:45.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-10T20:44:45.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-10T20:44:45.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-10T20:44:45.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-10T20:44:45.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-10T20:44:45.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-10T20:44:45.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-10T20:44:45.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-10T20:44:45.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-10T20:44:45.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-10T20:44:45.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-10T20:44:45.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-10T20:44:45.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-10T20:44:45.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-10T20:44:45.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-10T20:44:45.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-10T20:44:45.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-10T20:44:45.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-10T20:44:45.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-10T20:44:45.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-10T20:44:45.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-10T20:44:45.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-10T20:44:45.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-10T20:44:45.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-10T20:44:45.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-10T20:44:45.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-10T20:44:45.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-10T20:44:45.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-10T20:44:45.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-10T20:44:45.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-10T20:44:45.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-10T20:44:45.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-10T20:44:45.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-10T20:44:45.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-10T20:44:45.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-10T20:44:45.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-10T20:44:45.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-10T20:44:45.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-10T20:44:45.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-10T20:44:45.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-10T20:44:45.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-10T20:44:45.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-10T20:44:45.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-10T20:44:45.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-10T20:44:45.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-10T20:44:45.669 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-10T20:44:45.669 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-10T20:44:45.669 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-10T20:44:45.669 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-10T20:44:45.669 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-10T20:44:45.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-10T20:44:45.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-10T20:44:45.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-10T20:44:45.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-10T20:44:45.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-10T20:44:45.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-10T20:44:45.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-10T20:44:45.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-10T20:44:45.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-10T20:44:45.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-10T20:44:45.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-10T20:44:45.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-10T20:44:45.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-10T20:44:45.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-10T20:44:45.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-10T20:44:45.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-10T20:44:45.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-10T20:44:45.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-10T20:44:45.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-10T20:44:45.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-10T20:44:45.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-10T20:44:45.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-10T20:44:45.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-10T20:44:45.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-10T20:44:45.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-10T20:44:45.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-10T20:44:45.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-10T20:44:45.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-10T20:44:45.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-10T20:44:45.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-10T20:44:45.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-10T20:44:45.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-10T20:44:45.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-10T20:44:45.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-10T20:44:45.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-10T20:44:45.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-10T20:44:45.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-10T20:44:45.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-10T20:44:45.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-10T20:44:45.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-10T20:44:45.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-10T20:44:45.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-10T20:44:45.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-10T20:44:45.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-10T20:44:45.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-10T20:44:45.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-10T20:44:45.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-10T20:44:45.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-10T20:44:45.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-10T20:44:45.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-10T20:44:45.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-10T20:44:45.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-10T20:44:45.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-10T20:44:45.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-10T20:44:45.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-10T20:44:45.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-10T20:44:45.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-10T20:44:45.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-10T20:44:45.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-10T20:44:45.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-10T20:44:45.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-10T20:44:45.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-10T20:44:45.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-10T20:44:45.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-10T20:44:45.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-10T20:44:45.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-10T20:44:45.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-10T20:44:45.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-10T20:44:45.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-10T20:44:45.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-10T20:44:45.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-10T20:44:45.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-10T20:44:45.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-10T20:44:45.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-10T20:44:45.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-10T20:44:45.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-10T20:44:45.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-10T20:44:45.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-10T20:44:45.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-10T20:44:45.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-10T20:44:45.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-10T20:44:45.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-10T20:44:45.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-10T20:44:45.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-10T20:44:45.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-10T20:44:45.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-10T20:44:45.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-10T20:44:45.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-10T20:44:45.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-10T20:44:45.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-10T20:44:45.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-10T20:44:45.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-10T20:44:45.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-10T20:44:45.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-10T20:44:45.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-10T20:44:45.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-10T20:44:45.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-10T20:44:45.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-10T20:44:45.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-10T20:44:45.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-10T20:44:45.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-10T20:44:45.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-10T20:44:45.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-10T20:44:45.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-10T20:44:45.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-10T20:44:45.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-10T20:44:45.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-10T20:44:45.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-10T20:44:45.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-10T20:44:45.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-10T20:44:45.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-10T20:44:45.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-10T20:44:45.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-10T20:44:45.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-10T20:44:45.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-10T20:44:45.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-10T20:44:45.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-10T20:44:45.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-10T20:44:45.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-10T20:44:45.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-10T20:44:45.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-10T20:44:45.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-10T20:44:45.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-10T20:44:45.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-10T20:44:45.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-10T20:44:45.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-10T20:44:45.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-10T20:44:45.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-10T20:44:45.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-10T20:44:45.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-10T20:44:45.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-10T20:44:45.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-10T20:44:45.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-10T20:44:45.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-10T20:44:45.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-10T20:44:45.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-10T20:44:45.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-10T20:44:45.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-10T20:44:45.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-10T20:44:45.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-10T20:44:45.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-10T20:44:45.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-10T20:44:45.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-10T20:44:45.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-10T20:44:45.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-10T20:44:45.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-10T20:44:45.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-10T20:44:45.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-10T20:44:45.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-10T20:44:45.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-10T20:44:45.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-10T20:44:45.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-10T20:44:45.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-10T20:44:45.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-10T20:44:45.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-10T20:44:45.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-10T20:44:45.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-10T20:44:45.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-10T20:44:45.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-10T20:44:45.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-10T20:44:45.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-10T20:44:45.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-10T20:44:45.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-10T20:44:45.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-10T20:44:45.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-10T20:44:45.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-10T20:44:45.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-10T20:44:45.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-10T20:44:45.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-10T20:44:45.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-10T20:44:45.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-10T20:44:45.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-10T20:44:45.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-10T20:44:45.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-10T20:44:45.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-10T20:44:45.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-10T20:44:45.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-10T20:44:45.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-10T20:44:45.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-10T20:44:45.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-10T20:44:45.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-10T20:44:45.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-10T20:44:45.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-10T20:44:45.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-10T20:44:45.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-10T20:44:45.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-10T20:44:45.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-10T20:44:45.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-10T20:44:45.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-10T20:44:45.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-10T20:44:45.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-10T20:44:45.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-10T20:44:45.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-10T20:44:45.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-10T20:44:45.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-10T20:44:45.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-10T20:44:45.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-10T20:44:45.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-10T20:44:45.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-10T20:44:45.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-10T20:44:45.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-10T20:44:45.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-10T20:44:45.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-10T20:44:45.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-10T20:44:45.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-10T20:44:45.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-10T20:44:45.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-10T20:44:45.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-10T20:44:45.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-10T20:44:45.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-10T20:44:45.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-10T20:44:45.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-10T20:44:45.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-10T20:44:45.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-10T20:44:45.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-10T20:44:45.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-10T20:44:45.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-10T20:44:45.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-10T20:44:45.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-10T20:44:45.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-10T20:44:45.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-10T20:44:45.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-10T20:44:45.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-10T20:44:45.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-10T20:44:45.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-10T20:44:45.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-10T20:44:45.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-10T20:44:45.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-10T20:44:45.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-10T20:44:45.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-10T20:44:45.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-10T20:44:45.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-10T20:44:45.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-10T20:44:45.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-10T20:44:45.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-10T20:44:45.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-10T20:44:45.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-10T20:44:45.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-10T20:44:45.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-10T20:44:45.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-10T20:44:45.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-10T20:44:45.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-10T20:44:45.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-10T20:44:45.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-10T20:44:45.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-10T20:44:45.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-10T20:44:45.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-10T20:44:45.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-10T20:44:45.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-10T20:44:45.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-10T20:44:45.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-10T20:44:45.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-10T20:44:45.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-10T20:44:45.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-10T20:44:45.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-10T20:44:45.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-10T20:44:45.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-10T20:44:45.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-10T20:44:45.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-10T20:44:45.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-10T20:44:45.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-10T20:44:45.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-10T20:44:45.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-10T20:44:45.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-10T20:44:45.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-10T20:44:45.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-10T20:44:45.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-10T20:44:45.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-10T20:44:45.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-10T20:44:45.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-10T20:44:45.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-10T20:44:45.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-10T20:44:45.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-10T20:44:45.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-10T20:44:45.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-10T20:44:45.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-10T20:44:45.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-10T20:44:45.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-10T20:44:45.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-10T20:44:45.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-10T20:44:45.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-10T20:44:45.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-10T20:44:45.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-10T20:44:45.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-10T20:44:45.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-10T20:44:45.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-10T20:44:45.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-10T20:44:45.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-10T20:44:45.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-10T20:44:45.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-10T20:44:45.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-10T20:44:45.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-10T20:44:45.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-10T20:44:45.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-10T20:44:45.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-10T20:44:45.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-10T20:44:45.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-10T20:44:45.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-10T20:44:45.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-10T20:44:45.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-10T20:44:45.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-10T20:44:45.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-10T20:44:45.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-10T20:44:45.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-10T20:44:45.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-10T20:44:45.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-10T20:44:45.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-10T20:44:45.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-10T20:44:45.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-10T20:44:45.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-10T20:44:45.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-10T20:44:45.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-10T20:44:45.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-10T20:44:45.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-10T20:44:45.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-10T20:44:45.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-10T20:44:45.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-10T20:44:45.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-10T20:44:45.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-10T20:44:45.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-10T20:44:45.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-10T20:44:45.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-10T20:44:45.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-10T20:44:45.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-10T20:44:45.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-10T20:44:45.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-10T20:44:45.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-10T20:44:45.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-10T20:44:45.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-10T20:44:45.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-10T20:44:45.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-10T20:44:45.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-10T20:44:45.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-10T20:44:45.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-10T20:44:45.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-10T20:44:45.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-10T20:44:45.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-10T20:44:45.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-10T20:44:45.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-10T20:44:45.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-10T20:44:45.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-10T20:44:45.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-10T20:44:45.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-10T20:44:45.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-10T20:44:45.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-10T20:44:45.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-10T20:44:45.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-10T20:44:45.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-10T20:44:45.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-10T20:44:45.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-10T20:44:45.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-10T20:44:45.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-10T20:44:45.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-10T20:44:45.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-10T20:44:45.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-10T20:44:45.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-10T20:44:45.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-10T20:44:45.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-10T20:44:45.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-10T20:44:45.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-10T20:44:45.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-10T20:44:45.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-10T20:44:45.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-10T20:44:45.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-10T20:44:45.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-10T20:44:45.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-10T20:44:45.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-10T20:44:45.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-10T20:44:45.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-10T20:44:45.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-10T20:44:45.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-10T20:44:45.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-10T20:44:45.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-10T20:44:45.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-10T20:44:45.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-10T20:44:45.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-10T20:44:45.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-10T20:44:45.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-10T20:44:45.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-10T20:44:45.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-10T20:44:45.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-10T20:44:45.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-10T20:44:45.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-10T20:44:45.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-10T20:44:45.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-10T20:44:45.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-10T20:44:45.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-10T20:44:45.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-10T20:44:45.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-10T20:44:45.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-10T20:44:45.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-10T20:44:45.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-10T20:44:45.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-10T20:44:45.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-10T20:44:45.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-10T20:44:45.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-10T20:44:45.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-10T20:44:45.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-10T20:44:45.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-10T20:44:45.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-10T20:44:45.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-10T20:44:45.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-10T20:44:45.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-10T20:44:45.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-10T20:44:45.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-10T20:44:45.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-10T20:44:45.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-10T20:44:45.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-10T20:44:45.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-10T20:44:45.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-10T20:44:45.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-10T20:44:45.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-10T20:44:45.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-10T20:44:45.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-10T20:44:45.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-10T20:44:45.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-10T20:44:45.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-10T20:44:45.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-10T20:44:45.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-10T20:44:45.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-10T20:44:45.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-10T20:44:45.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-10T20:44:45.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-10T20:44:45.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-10T20:44:45.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-10T20:44:45.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-10T20:44:45.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-10T20:44:45.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-10T20:44:45.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-10T20:44:45.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-10T20:44:45.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-10T20:44:45.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-10T20:44:45.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-10T20:44:45.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-10T20:44:45.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-10T20:44:45.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-10T20:44:45.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-10T20:44:45.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-10T20:44:45.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-10T20:44:45.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-10T20:44:45.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-10T20:44:45.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-10T20:44:45.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-10T20:44:45.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-10T20:44:45.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-10T20:44:45.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-10T20:44:45.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-10T20:44:45.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-10T20:44:45.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-10T20:44:45.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-10T20:44:45.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-10T20:44:45.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-10T20:44:45.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-10T20:44:45.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-10T20:44:45.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-10T20:44:45.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-10T20:44:45.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-10T20:44:45.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-10T20:44:45.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-10T20:44:45.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-10T20:44:45.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-10T20:44:45.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-10T20:44:45.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-10T20:44:45.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-10T20:44:45.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-10T20:44:45.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-10T20:44:45.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-10T20:44:45.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-10T20:44:45.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-10T20:44:45.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-10T20:44:45.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-10T20:44:45.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-10T20:44:45.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-10T20:44:45.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-10T20:44:45.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-10T20:44:45.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-10T20:44:45.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-10T20:44:45.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-10T20:44:45.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-10T20:44:45.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-10T20:44:45.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-10T20:44:45.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-10T20:44:45.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-10T20:44:45.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-10T20:44:45.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-10T20:44:45.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-10T20:44:45.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-10T20:44:45.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-10T20:44:45.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-10T20:44:45.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-10T20:44:45.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-10T20:44:45.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-10T20:44:45.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-10T20:44:45.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-10T20:44:45.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-10T20:44:45.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-10T20:44:45.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-10T20:44:45.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-10T20:44:45.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-10T20:44:45.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-10T20:44:45.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-10T20:44:45.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-10T20:44:45.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-10T20:44:45.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-10T20:44:45.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-10T20:44:45.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-10T20:44:45.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-10T20:44:45.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-10T20:44:45.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-10T20:44:45.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-10T20:44:45.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-10T20:44:45.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-10T20:44:45.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-10T20:44:45.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-10T20:44:45.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-10T20:44:45.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-10T20:44:45.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-10T20:44:45.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-10T20:44:45.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-10T20:44:45.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-10T20:44:45.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-10T20:44:45.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-10T20:44:45.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-10T20:44:45.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-10T20:44:45.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-10T20:44:45.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-10T20:44:45.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-10T20:44:45.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-10T20:44:45.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-10T20:44:45.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-10T20:44:45.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-10T20:44:45.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-10T20:44:45.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-10T20:44:45.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-10T20:44:45.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-10T20:44:45.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-10T20:44:45.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-10T20:44:45.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-10T20:44:45.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-10T20:44:45.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-10T20:44:45.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-10T20:44:45.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-10T20:44:45.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-10T20:44:45.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-10T20:44:45.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-10T20:44:45.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-10T20:44:45.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-10T20:44:45.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-10T20:44:45.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-10T20:44:45.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-10T20:44:45.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-10T20:44:45.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-10T20:44:45.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-10T20:44:45.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-10T20:44:45.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-10T20:44:45.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-10T20:44:45.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-10T20:44:45.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-10T20:44:45.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-10T20:44:45.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-10T20:44:45.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-10T20:44:45.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-10T20:44:45.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-10T20:44:45.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-10T20:44:45.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-10T20:44:45.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-10T20:44:45.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-10T20:44:45.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-10T20:44:45.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-10T20:44:45.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-10T20:44:45.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-10T20:44:45.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-10T20:44:45.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-10T20:44:45.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-10T20:44:45.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-10T20:44:45.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-10T20:44:45.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-10T20:44:45.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-10T20:44:45.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-10T20:44:45.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-10T20:44:45.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-10T20:44:45.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-10T20:44:45.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-10T20:44:45.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-10T20:44:45.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-10T20:44:45.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-10T20:44:45.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-10T20:44:45.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-10T20:44:45.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-10T20:44:45.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-10T20:44:45.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-10T20:44:45.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-10T20:44:45.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-10T20:44:45.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-10T20:44:45.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-10T20:44:45.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-10T20:44:45.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-10T20:44:45.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-10T20:44:45.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-10T20:44:45.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-10T20:44:45.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-10T20:44:45.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-10T20:44:45.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-10T20:44:45.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-10T20:44:45.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-10T20:44:45.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-10T20:44:45.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-10T20:44:45.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-10T20:44:45.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-10T20:44:45.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-10T20:44:45.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-10T20:44:45.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-10T20:44:45.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-10T20:44:45.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-10T20:44:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-10T20:44:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-10T20:44:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-10T20:44:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-10T20:44:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-10T20:44:45.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-10T20:44:45.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-10T20:44:45.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-10T20:44:45.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-10T20:44:45.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-10T20:44:45.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-10T20:44:45.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-10T20:44:45.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-10T20:44:45.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-10T20:44:45.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-10T20:44:45.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-10T20:44:45.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-10T20:44:45.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-10T20:44:45.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-10T20:44:45.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-10T20:44:45.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-10T20:44:45.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-10T20:44:45.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-10T20:44:45.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-10T20:44:45.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-10T20:44:45.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-10T20:44:45.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-10T20:44:45.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-10T20:44:45.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-10T20:44:45.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-10T20:44:45.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-10T20:44:45.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-10T20:44:45.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-10T20:44:45.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-10T20:44:45.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-10T20:44:45.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-10T20:44:45.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-10T20:44:45.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-10T20:44:45.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-10T20:44:45.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-10T20:44:45.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-10T20:44:45.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-10T20:44:45.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-10T20:44:45.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-10T20:44:45.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-10T20:44:45.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-10T20:44:45.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-10T20:44:45.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-10T20:44:45.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-10T20:44:45.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-10T20:44:45.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-10T20:44:45.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-10T20:44:45.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-10T20:44:45.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-10T20:44:45.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-10T20:44:45.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-10T20:44:45.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-10T20:44:45.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-10T20:44:45.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-10T20:44:45.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-10T20:44:45.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-10T20:44:45.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-10T20:44:45.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-10T20:44:45.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-10T20:44:45.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-10T20:44:45.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-10T20:44:45.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-10T20:44:45.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-10T20:44:45.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-10T20:44:45.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-10T20:44:45.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-10T20:44:45.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-10T20:44:45.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-10T20:44:45.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-10T20:44:45.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-10T20:44:45.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-10T20:44:45.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-10T20:44:45.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-10T20:44:45.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-10T20:44:45.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-10T20:44:45.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-10T20:44:45.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-10T20:44:45.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-10T20:44:45.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-10T20:44:45.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-10T20:44:45.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-10T20:44:45.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-10T20:44:45.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-10T20:44:45.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-10T20:44:45.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-10T20:44:45.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-10T20:44:45.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-10T20:44:45.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-10T20:44:45.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-10T20:44:45.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-10T20:44:45.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-10T20:44:45.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-10T20:44:45.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-10T20:44:45.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-10T20:44:45.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-10T20:44:45.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-10T20:44:45.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-10T20:44:45.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-10T20:44:45.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-10T20:44:45.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-10T20:44:45.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-10T20:44:45.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-10T20:44:45.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-10T20:44:45.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-10T20:44:45.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-10T20:44:45.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-10T20:44:45.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-10T20:44:45.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-10T20:44:45.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-10T20:44:45.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-10T20:44:45.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-10T20:44:45.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-10T20:44:45.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-10T20:44:45.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-10T20:44:45.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-10T20:44:45.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-10T20:44:45.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-10T20:44:45.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-10T20:44:45.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-10T20:44:45.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-10T20:44:45.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-10T20:44:45.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-10T20:44:45.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-10T20:44:45.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-10T20:44:45.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-10T20:44:45.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-10T20:44:45.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-10T20:44:45.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-10T20:44:45.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-10T20:44:45.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-10T20:44:45.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-10T20:44:45.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-10T20:44:45.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-10T20:44:45.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-10T20:44:45.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-10T20:44:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-10T20:44:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-10T20:44:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-10T20:44:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-10T20:44:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-10T20:44:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-10T20:44:45.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-10T20:44:45.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-10T20:44:45.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-10T20:44:45.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-10T20:44:45.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-10T20:44:45.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-10T20:44:45.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-10T20:44:45.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-10T20:44:45.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-10T20:44:45.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-10T20:44:45.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-10T20:44:45.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-10T20:44:45.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-10T20:44:45.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-10T20:44:45.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-10T20:44:45.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-10T20:44:45.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-10T20:44:45.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-10T20:44:45.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-10T20:44:45.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-10T20:44:45.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-10T20:44:45.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-10T20:44:45.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-10T20:44:45.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-10T20:44:45.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-10T20:44:45.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-10T20:44:45.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-10T20:44:45.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-10T20:44:45.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-10T20:44:45.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-10T20:44:45.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-10T20:44:45.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-10T20:44:45.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-10T20:44:45.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-10T20:44:45.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-10T20:44:45.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-10T20:44:45.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-10T20:44:45.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-10T20:44:45.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-10T20:44:45.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-10T20:44:45.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-10T20:44:45.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-10T20:44:45.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-10T20:44:45.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-10T20:44:45.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-10T20:44:45.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-10T20:44:45.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-10T20:44:45.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-10T20:44:45.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-10T20:44:45.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-10T20:44:45.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-10T20:44:45.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-10T20:44:45.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-10T20:44:45.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-10T20:44:45.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-10T20:44:45.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-10T20:44:45.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-10T20:44:45.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-10T20:44:45.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-10T20:44:45.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-10T20:44:45.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-10T20:44:45.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-10T20:44:45.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-10T20:44:45.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-10T20:44:45.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-10T20:44:45.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-10T20:44:45.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-10T20:44:45.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-10T20:44:45.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-10T20:44:45.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-10T20:44:45.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-10T20:44:45.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-10T20:44:45.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-10T20:44:45.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-10T20:44:45.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-10T20:44:45.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-10T20:44:45.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-10T20:44:45.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-10T20:44:45.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-10T20:44:45.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-10T20:44:45.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-10T20:44:45.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-10T20:44:45.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-10T20:44:45.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-10T20:44:45.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-10T20:44:45.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-10T20:44:45.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-10T20:44:45.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-10T20:44:45.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-10T20:44:45.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-10T20:44:45.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-10T20:44:45.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-10T20:44:45.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-10T20:44:45.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-10T20:44:45.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-10T20:44:45.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-10T20:44:45.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-10T20:44:45.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-10T20:44:45.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-10T20:44:45.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-10T20:44:45.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-10T20:44:45.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-10T20:44:45.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-10T20:44:45.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-10T20:44:45.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-10T20:44:45.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-10T20:44:45.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-10T20:44:45.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-10T20:44:45.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-10T20:44:45.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-10T20:44:45.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-10T20:44:45.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-10T20:44:45.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-10T20:44:45.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-10T20:44:45.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-10T20:44:45.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-10T20:44:45.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-10T20:44:45.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-10T20:44:45.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-10T20:44:45.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-10T20:44:45.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-10T20:44:45.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-10T20:44:45.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-10T20:44:45.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-10T20:44:45.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-10T20:44:45.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-10T20:44:45.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-10T20:44:45.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-10T20:44:45.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-10T20:44:45.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-10T20:44:45.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-10T20:44:45.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-10T20:44:45.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-10T20:44:45.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-10T20:44:45.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-10T20:44:45.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-10T20:44:45.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-10T20:44:45.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-10T20:44:45.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-10T20:44:45.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-10T20:44:45.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-10T20:44:45.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-10T20:44:45.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-10T20:44:45.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-10T20:44:45.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-10T20:44:45.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-10T20:44:45.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-10T20:44:45.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-10T20:44:45.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-10T20:44:45.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-10T20:44:45.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-10T20:44:45.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-10T20:44:45.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-10T20:44:45.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-10T20:44:45.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-10T20:44:45.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-10T20:44:45.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-10T20:44:45.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-10T20:44:45.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-10T20:44:45.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-10T20:44:45.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-10T20:44:45.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-10T20:44:45.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-10T20:44:45.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-10T20:44:45.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-10T20:44:45.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-10T20:44:45.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-10T20:44:45.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-10T20:44:45.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-10T20:44:45.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-10T20:44:45.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-10T20:44:45.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-10T20:44:45.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-10T20:44:45.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-10T20:44:45.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-10T20:44:45.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-10T20:44:45.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-10T20:44:45.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-10T20:44:45.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-10T20:44:45.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-10T20:44:45.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-10T20:44:45.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-10T20:44:45.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-10T20:44:45.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-10T20:44:45.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-10T20:44:45.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-10T20:44:45.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-10T20:44:45.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-10T20:44:45.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-10T20:44:45.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-10T20:44:45.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-10T20:44:45.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-10T20:44:45.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-10T20:44:45.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-10T20:44:45.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-10T20:44:45.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-10T20:44:45.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-10T20:44:45.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-10T20:44:45.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-10T20:44:45.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-10T20:44:45.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-10T20:44:45.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-10T20:44:45.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-10T20:44:45.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-10T20:44:45.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-10T20:44:45.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-10T20:44:45.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-10T20:44:45.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-10T20:44:45.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-10T20:44:45.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-10T20:44:45.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-10T20:44:45.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-10T20:44:45.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-10T20:44:45.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-10T20:44:45.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-10T20:44:45.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-10T20:44:45.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-10T20:44:45.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-10T20:44:45.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-10T20:44:45.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-10T20:44:45.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-10T20:44:45.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-10T20:44:45.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-10T20:44:45.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-10T20:44:45.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-10T20:44:45.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-10T20:44:45.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-10T20:44:45.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-10T20:44:45.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-10T20:44:45.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-10T20:44:45.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-10T20:44:45.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-10T20:44:45.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-10T20:44:45.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-10T20:44:45.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-10T20:44:45.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-10T20:44:45.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-10T20:44:45.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-10T20:44:45.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-10T20:44:45.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-10T20:44:45.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-10T20:44:45.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-10T20:44:45.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-10T20:44:45.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-10T20:44:45.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-10T20:44:45.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-10T20:44:45.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-10T20:44:45.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-10T20:44:45.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-10T20:44:45.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-10T20:44:45.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-10T20:44:45.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-10T20:44:45.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-10T20:44:45.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-10T20:44:45.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-10T20:44:45.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-10T20:44:45.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-10T20:44:45.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-10T20:44:45.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-10T20:44:45.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-10T20:44:45.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-10T20:44:45.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-10T20:44:45.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-10T20:44:45.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-10T20:44:45.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-10T20:44:45.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-10T20:44:45.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-10T20:44:45.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-10T20:44:45.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-10T20:44:45.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-10T20:44:45.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-10T20:44:45.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-10T20:44:45.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-10T20:44:45.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-10T20:44:45.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-10T20:44:45.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-10T20:44:45.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-10T20:44:45.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-10T20:44:45.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-10T20:44:45.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-10T20:44:45.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-10T20:44:45.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-10T20:44:45.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-10T20:44:45.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-10T20:44:45.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-10T20:44:45.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-10T20:44:45.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-10T20:44:45.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-10T20:44:45.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-10T20:44:45.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-10T20:44:45.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-10T20:44:45.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-10T20:44:45.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-10T20:44:45.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-10T20:44:45.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-10T20:44:45.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-10T20:44:45.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-10T20:44:45.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-10T20:44:45.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-10T20:44:45.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-10T20:44:45.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-10T20:44:45.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-10T20:44:45.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-10T20:44:45.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-10T20:44:45.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-10T20:44:45.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-10T20:44:45.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-10T20:44:45.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-10T20:44:45.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-10T20:44:45.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-10T20:44:45.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-10T20:44:45.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-10T20:44:45.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-10T20:44:45.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-10T20:44:45.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-10T20:44:45.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-10T20:44:45.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-10T20:44:45.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-10T20:44:45.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-10T20:44:45.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-10T20:44:45.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-10T20:44:45.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-10T20:44:45.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-10T20:44:45.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-10T20:44:45.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-10T20:44:45.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-10T20:44:45.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-10T20:44:45.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-10T20:44:45.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-10T20:44:45.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-10T20:44:45.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-10T20:44:45.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-10T20:44:45.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-10T20:44:45.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-10T20:44:45.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-10T20:44:45.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-10T20:44:45.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-10T20:44:45.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-10T20:44:45.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-10T20:44:45.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-10T20:44:45.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-10T20:44:45.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-10T20:44:45.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-10T20:44:45.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-10T20:44:45.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-10T20:44:45.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-10T20:44:45.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-10T20:44:45.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-10T20:44:45.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-10T20:44:45.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-10T20:44:45.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-10T20:44:45.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-10T20:44:45.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-10T20:44:45.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-10T20:44:45.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-10T20:44:45.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-10T20:44:45.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-10T20:44:45.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-10T20:44:45.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-10T20:44:45.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-10T20:44:45.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-10T20:44:45.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-10T20:44:45.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-10T20:44:45.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-10T20:44:45.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-10T20:44:45.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-10T20:44:45.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-10T20:44:45.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-10T20:44:45.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-10T20:44:45.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-10T20:44:45.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-10T20:44:45.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-10T20:44:45.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-10T20:44:45.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-10T20:44:45.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-10T20:44:45.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-10T20:44:45.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-10T20:44:45.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-10T20:44:45.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-10T20:44:45.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-10T20:44:45.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-10T20:44:45.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-10T20:44:45.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-10T20:44:45.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-10T20:44:45.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-10T20:44:45.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-10T20:44:45.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-10T20:44:45.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-10T20:44:45.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-10T20:44:45.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-10T20:44:45.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-10T20:44:45.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-10T20:44:45.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-10T20:44:45.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-10T20:44:45.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-10T20:44:45.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-10T20:44:45.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-10T20:44:45.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-10T20:44:45.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-10T20:44:45.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-10T20:44:45.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-10T20:44:45.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-10T20:44:45.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-10T20:44:45.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-10T20:44:45.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-10T20:44:45.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-10T20:44:45.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-10T20:44:45.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-10T20:44:45.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-10T20:44:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-10T20:44:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-10T20:44:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-10T20:44:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-10T20:44:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-10T20:44:45.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-10T20:44:45.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-10T20:44:45.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-10T20:44:45.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-10T20:44:45.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-10T20:44:45.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-10T20:44:45.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-10T20:44:45.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-10T20:44:45.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-10T20:44:45.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-10T20:44:45.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-10T20:44:45.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-10T20:44:45.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-10T20:44:45.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-10T20:44:45.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-10T20:44:45.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-10T20:44:45.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-10T20:44:45.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-10T20:44:45.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-10T20:44:45.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-10T20:44:45.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-10T20:44:45.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-10T20:44:45.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-10T20:44:45.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-10T20:44:45.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-10T20:44:45.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-10T20:44:45.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-10T20:44:45.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-10T20:44:45.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-10T20:44:45.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-10T20:44:45.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-10T20:44:45.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-10T20:44:45.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-10T20:44:45.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-10T20:44:45.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-10T20:44:45.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-10T20:44:45.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-10T20:44:45.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-10T20:44:45.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-10T20:44:45.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-10T20:44:45.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-10T20:44:45.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-10T20:44:45.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-10T20:44:45.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-10T20:44:45.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-10T20:44:45.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-10T20:44:45.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-10T20:44:45.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-10T20:44:45.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-10T20:44:45.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-10T20:44:45.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-10T20:44:45.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-10T20:44:45.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-10T20:44:45.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-10T20:44:45.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-10T20:44:45.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-10T20:44:45.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-10T20:44:45.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-10T20:44:45.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-10T20:44:45.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-10T20:44:45.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-10T20:44:45.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-10T20:44:45.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-10T20:44:45.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-10T20:44:45.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-10T20:44:45.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-10T20:44:45.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-10T20:44:45.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-10T20:44:45.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-10T20:44:45.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-10T20:44:45.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-10T20:44:45.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-10T20:44:45.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-10T20:44:45.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-10T20:44:45.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-10T20:44:45.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-10T20:44:45.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-10T20:44:45.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-10T20:44:45.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-10T20:44:45.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-10T20:44:45.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-10T20:44:45.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-10T20:44:45.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-10T20:44:45.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-10T20:44:45.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-10T20:44:45.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-10T20:44:45.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-10T20:44:45.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-10T20:44:45.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-10T20:44:45.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-10T20:44:45.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-10T20:44:45.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-10T20:44:45.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-10T20:44:45.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-10T20:44:45.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-10T20:44:45.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-10T20:44:45.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-10T20:44:45.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-10T20:44:45.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-10T20:44:45.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-10T20:44:45.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-10T20:44:45.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-10T20:44:45.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-10T20:44:45.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-10T20:44:45.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-10T20:44:45.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-10T20:44:45.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-10T20:44:45.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-10T20:44:45.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-10T20:44:45.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-10T20:44:45.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-10T20:44:45.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-10T20:44:45.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-10T20:44:45.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-10T20:44:45.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-10T20:44:45.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-10T20:44:45.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-10T20:44:45.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-10T20:44:45.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-10T20:44:45.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-10T20:44:45.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-10T20:44:45.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-10T20:44:45.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-10T20:44:45.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-10T20:44:45.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-10T20:44:45.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-10T20:44:45.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-10T20:44:45.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-10T20:44:45.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-10T20:44:45.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-10T20:44:45.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-10T20:44:45.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-10T20:44:45.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-10T20:44:45.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-10T20:44:45.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-10T20:44:45.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-10T20:44:45.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-10T20:44:45.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-10T20:44:45.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-10T20:44:45.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-10T20:44:45.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-10T20:44:45.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-10T20:44:45.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-10T20:44:45.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-10T20:44:45.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-10T20:44:45.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-10T20:44:45.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-10T20:44:45.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-10T20:44:45.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-10T20:44:45.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-10T20:44:45.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-10T20:44:45.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-10T20:44:45.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-10T20:44:45.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-10T20:44:45.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-10T20:44:45.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-10T20:44:45.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-10T20:44:45.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-10T20:44:45.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-10T20:44:45.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-10T20:44:45.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-10T20:44:45.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-10T20:44:45.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-10T20:44:45.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-10T20:44:45.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-10T20:44:45.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-10T20:44:45.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-10T20:44:45.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-10T20:44:45.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-10T20:44:45.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-10T20:44:45.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-10T20:44:45.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-10T20:44:45.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-10T20:44:45.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-10T20:44:45.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-10T20:44:45.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-10T20:44:45.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-10T20:44:45.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-10T20:44:45.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-10T20:44:45.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-10T20:44:45.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-10T20:44:45.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-10T20:44:45.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-10T20:44:45.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-10T20:44:45.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-10T20:44:45.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-10T20:44:45.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-10T20:44:45.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-10T20:44:45.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-10T20:44:45.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-10T20:44:45.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-10T20:44:45.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-10T20:44:45.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-10T20:44:45.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-10T20:44:45.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-10T20:44:45.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-10T20:44:45.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-10T20:44:45.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-10T20:44:45.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-10T20:44:45.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-10T20:44:45.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-10T20:44:45.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-10T20:44:45.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-10T20:44:45.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-10T20:44:45.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-10T20:44:45.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-10T20:44:45.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-10T20:44:45.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-10T20:44:45.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-10T20:44:45.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-10T20:44:45.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-10T20:44:45.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-10T20:44:45.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-10T20:44:45.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-10T20:44:45.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-10T20:44:45.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-10T20:44:45.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-10T20:44:45.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-10T20:44:45.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-10T20:44:45.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-10T20:44:45.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-10T20:44:45.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-10T20:44:45.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-10T20:44:45.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-10T20:44:45.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-10T20:44:45.950 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-10T20:44:45.950 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-10T20:44:45.950 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-10T20:44:45.950 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-10T20:44:45.950 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-10T20:44:45.951 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-10T20:44:45.951 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-10T20:44:45.951 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-10T20:44:45.951 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-10T20:44:45.951 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-10T20:44:45.952 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-10T20:44:45.952 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-10T20:44:45.952 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-10T20:44:45.952 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-10T20:44:45.952 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-10T20:44:45.953 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-10T20:44:45.953 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-10T20:44:45.953 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-10T20:44:45.953 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-10T20:44:45.953 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-10T20:44:45.953 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-10T20:44:45.954 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-10T20:44:45.954 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-10T20:44:45.954 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-10T20:44:45.954 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-10T20:44:45.954 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-10T20:44:45.955 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-10T20:44:45.955 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-10T20:44:45.955 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-10T20:44:45.955 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-10T20:44:45.955 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-10T20:44:45.956 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-10T20:44:45.956 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-10T20:44:45.956 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-10T20:44:45.956 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-10T20:44:45.956 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-10T20:44:45.957 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-10T20:44:45.957 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-10T20:44:45.957 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-10T20:44:45.957 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-10T20:44:45.957 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-10T20:44:45.957 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-10T20:44:45.958 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-10T20:44:45.958 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-10T20:44:45.958 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-10T20:44:45.958 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-10T20:44:45.958 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-10T20:44:45.959 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-10T20:44:45.959 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-10T20:44:45.959 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-10T20:44:45.959 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-10T20:44:45.959 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-10T20:44:45.959 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-10T20:44:45.960 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-10T20:44:45.960 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-10T20:44:45.960 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-10T20:44:45.960 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-10T20:44:45.960 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-10T20:44:45.961 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-10T20:44:45.961 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-10T20:44:45.961 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-10T20:44:45.961 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-10T20:44:45.961 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-10T20:44:45.962 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-10T20:44:45.962 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-10T20:44:45.962 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-10T20:44:45.962 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-10T20:44:45.962 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-10T20:44:45.963 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-10T20:44:45.963 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-10T20:44:45.963 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-10T20:44:45.963 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-10T20:44:45.963 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-10T20:44:45.963 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-10T20:44:45.964 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-10T20:44:45.964 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-10T20:44:45.964 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-10T20:44:45.964 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-10T20:44:45.964 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-10T20:44:45.965 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-10T20:44:45.965 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-10T20:44:45.965 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-10T20:44:45.965 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-10T20:44:45.965 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-10T20:44:45.966 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-10T20:44:45.966 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-10T20:44:45.966 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-10T20:44:45.966 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-10T20:44:45.966 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-10T20:44:45.967 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-10T20:44:45.967 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-10T20:44:45.967 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-10T20:44:45.967 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-10T20:44:45.967 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-10T20:44:45.967 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-10T20:44:45.968 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-10T20:44:45.968 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-10T20:44:45.968 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-10T20:44:45.968 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-10T20:44:45.968 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-10T20:44:45.969 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-10T20:44:45.969 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-10T20:44:45.969 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-10T20:44:45.969 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-10T20:44:45.969 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-10T20:44:45.970 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-10T20:44:45.970 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-10T20:44:45.970 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-10T20:44:45.970 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-10T20:44:45.970 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-10T20:44:45.971 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-10T20:44:45.971 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-10T20:44:45.971 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-10T20:44:45.971 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-10T20:44:45.971 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-10T20:44:45.972 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-10T20:44:45.972 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-10T20:44:45.972 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-10T20:44:45.972 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-10T20:44:45.972 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-10T20:44:45.973 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-10T20:44:45.973 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-10T20:44:45.973 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-10T20:44:45.973 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-10T20:44:45.973 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-10T20:44:45.974 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-10T20:44:45.974 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-10T20:44:45.974 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-10T20:44:45.974 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-10T20:44:45.974 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-10T20:44:45.975 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-10T20:44:45.975 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-10T20:44:45.975 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-10T20:44:45.975 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-10T20:44:45.975 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-10T20:44:45.976 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-10T20:44:45.976 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-10T20:44:45.976 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-10T20:44:45.976 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-10T20:44:45.976 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-10T20:44:45.976 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-10T20:44:45.977 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-10T20:44:45.977 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-10T20:44:45.977 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-10T20:44:45.977 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-10T20:44:45.977 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-10T20:44:45.978 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-10T20:44:45.978 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-10T20:44:45.978 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-10T20:44:45.978 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-10T20:44:45.978 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-10T20:44:45.979 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-10T20:44:45.979 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-10T20:44:45.979 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-10T20:44:45.979 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-10T20:44:45.979 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-10T20:44:45.980 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-10T20:44:45.980 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-10T20:44:45.980 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-10T20:44:45.980 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-10T20:44:45.980 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-10T20:44:45.981 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-10T20:44:45.981 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-10T20:44:45.981 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-10T20:44:45.981 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-10T20:44:45.981 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-10T20:44:45.982 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-10T20:44:45.982 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-10T20:44:45.982 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-10T20:44:45.982 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-10T20:44:45.982 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-10T20:44:45.983 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-10T20:44:45.983 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-10T20:44:45.983 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-10T20:44:45.983 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-10T20:44:45.983 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-10T20:44:45.984 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-10T20:44:45.984 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-10T20:44:45.984 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-10T20:44:45.984 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-10T20:44:45.984 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-10T20:44:45.984 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-10T20:44:45.985 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-10T20:44:45.985 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-10T20:44:45.985 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-10T20:44:45.985 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-10T20:44:45.985 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-10T20:44:45.986 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-10T20:44:45.986 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-10T20:44:45.986 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-10T20:44:45.986 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-10T20:44:45.986 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-10T20:44:45.987 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-10T20:44:45.987 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-10T20:44:45.987 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-10T20:44:45.987 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-10T20:44:45.987 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-10T20:44:45.988 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-10T20:44:45.988 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-10T20:44:45.988 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-10T20:44:45.988 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-10T20:44:45.988 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-10T20:44:45.989 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-10T20:44:45.989 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-10T20:44:45.989 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-10T20:44:45.989 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-10T20:44:45.989 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-10T20:44:45.990 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-10T20:44:45.990 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-10T20:44:45.990 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-10T20:44:45.990 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-10T20:44:45.990 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-10T20:44:45.990 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-10T20:44:45.991 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-10T20:44:45.991 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-10T20:44:45.991 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-10T20:44:45.991 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-10T20:44:45.992 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:45.992 DEBUG:teuthology.orchestra.run.smithi179:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-10T20:44:46.016 INFO:teuthology.orchestra.run.smithi179.stdout:postinstall scriptlet (using /bin/sh): 2023-10-10T20:44:46.016 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-10T20:44:46.017 INFO:teuthology.orchestra.run.smithi179.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-10T20:44:46.017 INFO:teuthology.orchestra.run.smithi179.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-10T20:44:46.017 INFO:teuthology.orchestra.run.smithi179.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:46.017 INFO:teuthology.orchestra.run.smithi179.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-10T20:44:46.017 INFO:teuthology.orchestra.run.smithi179.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-10T20:44:46.018 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2023-10-10T20:44:46.018 INFO:teuthology.orchestra.run.smithi179.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-10T20:44:46.018 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-10T20:44:46.018 INFO:teuthology.orchestra.run.smithi179.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-10T20:44:46.019 INFO:teuthology.orchestra.run.smithi179.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-10T20:44:46.019 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:46.019 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2023-10-10T20:44:46.019 INFO:teuthology.orchestra.run.smithi179.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-10T20:44:46.019 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-10T20:44:46.019 INFO:teuthology.orchestra.run.smithi179.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:46.020 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2023-10-10T20:44:46.021 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2023-10-10T20:44:46.096 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2023-10-10T20:44:46.096 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2023-10-10T20:44:46.096 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.02 2023-10-10T20:44:46.096 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 99.el8_4.1 2023-10-10T20:44:46.097 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2023-10-10T20:44:46.097 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-10T20:44:46.097 INFO:teuthology.orchestra.run.smithi179.stdout:Group : System Environment/Base 2023-10-10T20:44:46.097 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 9264631 2023-10-10T20:44:46.097 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2023-10-10T20:44:46.098 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-10T20:44:46.098 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-10T20:44:46.098 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-10T20:44:46.098 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-10T20:44:46.098 INFO:teuthology.orchestra.run.smithi179.stdout:Relocations : (not relocatable) 2023-10-10T20:44:46.099 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : Red Hat, Inc. 2023-10-10T20:44:46.099 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : Red Hat, Inc. 2023-10-10T20:44:46.099 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-10T20:44:46.099 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2023-10-10T20:44:46.099 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2023-10-10T20:44:46.100 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T20:44:46.100 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-10T20:44:46.100 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-10T20:44:46.100 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-10T20:44:46.100 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2023-10-10T20:44:46.101 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T20:44:46.101 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2023-10-10T20:44:46.105 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-10T20:44:46.105 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:46.106 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-10T20:44:49.569 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2023-10-10T20:44:51.772 INFO:teuthology.orchestra.run.smithi179.stderr:done 2023-10-10T20:44:51.774 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-10-10T20:44:51.812 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.oQktyzHyn7 2023-10-10T20:44:51.812 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oQktyzHyn7 2023-10-10T20:44:51.894 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.oQktyzHyn7 2023-10-10T20:44:52.061 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.oQktyzHyn7 is 6KB 2023-10-10T20:44:52.110 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.oQktyzHyn7 2023-10-10T20:44:52.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2023-10-10T20:44:52.185 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-10T20:44:52.185 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-10T20:44:52.185 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-10T20:44:52.186 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-10T20:44:52.186 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-10T20:44:52.187 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:52.380 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2023-10-10T20:44:55.870 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-10T20:44:55.871 DEBUG:teuthology.orchestra.run.smithi154:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-10T20:44:55.930 INFO:teuthology.orchestra.run.smithi154.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:55.930 INFO:teuthology.orchestra.run.smithi154.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:55.930 INFO:teuthology.orchestra.run.smithi154.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:55.931 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:55.931 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-10T20:44:55.931 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-10T20:44:55.931 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-10T20:44:55.931 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-10T20:44:55.932 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-10T20:44:55.932 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-10T20:44:55.932 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-10T20:44:55.932 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-10T20:44:55.932 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-10T20:44:55.933 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-10T20:44:55.933 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-10T20:44:55.933 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-10T20:44:55.933 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-10T20:44:55.933 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-10T20:44:55.933 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-10T20:44:55.934 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-10T20:44:55.934 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-10T20:44:55.934 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-10T20:44:55.934 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-10T20:44:55.934 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-10T20:44:55.935 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-10T20:44:55.935 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-10T20:44:55.935 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-10T20:44:55.935 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-10T20:44:55.935 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-10T20:44:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-10T20:44:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-10T20:44:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-10T20:44:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-10T20:44:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-10T20:44:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-10T20:44:55.937 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-10T20:44:55.937 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-10T20:44:55.937 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-10T20:44:55.937 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-10T20:44:55.937 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-10T20:44:55.938 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-10T20:44:55.938 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-10T20:44:55.938 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-10T20:44:55.938 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-10T20:44:55.938 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-10T20:44:55.938 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-10T20:44:55.939 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-10T20:44:55.939 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-10T20:44:55.939 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-10T20:44:55.939 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-10T20:44:55.939 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-10T20:44:55.940 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-10T20:44:55.940 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-10T20:44:55.940 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-10T20:44:55.940 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-10T20:44:55.940 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-10T20:44:55.941 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-10T20:44:55.941 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-10T20:44:55.941 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-10T20:44:55.941 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-10T20:44:55.941 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-10T20:44:55.941 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-10T20:44:55.942 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-10T20:44:55.942 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-10T20:44:55.942 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-10T20:44:55.942 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-10T20:44:55.942 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-10T20:44:55.943 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-10T20:44:55.943 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-10T20:44:55.943 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-10T20:44:55.943 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-10T20:44:55.943 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-10T20:44:55.944 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-10T20:44:55.944 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-10T20:44:55.944 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-10T20:44:55.944 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-10T20:44:55.944 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-10T20:44:55.945 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-10T20:44:55.945 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-10T20:44:55.945 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-10T20:44:55.945 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-10T20:44:55.945 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-10T20:44:55.945 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-10T20:44:55.946 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-10T20:44:55.946 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-10T20:44:55.946 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-10T20:44:55.946 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-10T20:44:55.946 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-10T20:44:55.947 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-10T20:44:55.947 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-10T20:44:55.947 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-10T20:44:55.947 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-10T20:44:55.947 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-10T20:44:55.948 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-10T20:44:55.948 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-10T20:44:55.948 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-10T20:44:55.948 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-10T20:44:55.948 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-10T20:44:55.948 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-10T20:44:55.949 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-10T20:44:55.949 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-10T20:44:55.949 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-10T20:44:55.949 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-10T20:44:55.949 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-10T20:44:55.950 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-10T20:44:55.950 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-10T20:44:55.950 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-10T20:44:55.950 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-10T20:44:55.950 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-10T20:44:55.951 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-10T20:44:55.951 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-10T20:44:55.951 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-10T20:44:55.951 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-10T20:44:55.951 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-10T20:44:55.951 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-10T20:44:55.952 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-10T20:44:55.952 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-10T20:44:55.952 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-10T20:44:55.952 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-10T20:44:55.952 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-10T20:44:55.953 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-10T20:44:55.953 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-10T20:44:55.953 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-10T20:44:55.953 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-10T20:44:55.953 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-10T20:44:55.954 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-10T20:44:55.954 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-10T20:44:55.954 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-10T20:44:55.954 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-10T20:44:55.954 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-10T20:44:55.954 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-10T20:44:55.955 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-10T20:44:55.955 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-10T20:44:55.955 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-10T20:44:55.955 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-10T20:44:55.955 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-10T20:44:55.956 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-10T20:44:55.956 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-10T20:44:55.956 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-10T20:44:55.956 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-10T20:44:55.956 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-10T20:44:55.956 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-10T20:44:55.957 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-10T20:44:55.957 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-10T20:44:55.957 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-10T20:44:55.957 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-10T20:44:55.957 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-10T20:44:55.958 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-10T20:44:55.958 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-10T20:44:55.958 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-10T20:44:55.958 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-10T20:44:55.958 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-10T20:44:55.958 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-10T20:44:55.959 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-10T20:44:55.959 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-10T20:44:55.959 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-10T20:44:55.959 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-10T20:44:55.959 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-10T20:44:55.960 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-10T20:44:55.960 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-10T20:44:55.960 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-10T20:44:55.960 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-10T20:44:55.960 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-10T20:44:55.960 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-10T20:44:55.961 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-10T20:44:55.961 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-10T20:44:55.961 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-10T20:44:55.961 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-10T20:44:55.961 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-10T20:44:55.962 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-10T20:44:55.962 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-10T20:44:55.962 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-10T20:44:55.962 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-10T20:44:55.962 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-10T20:44:55.962 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-10T20:44:55.963 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-10T20:44:55.963 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-10T20:44:55.963 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-10T20:44:55.963 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-10T20:44:55.963 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-10T20:44:55.964 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-10T20:44:55.964 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-10T20:44:55.964 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-10T20:44:55.964 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-10T20:44:55.964 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-10T20:44:55.964 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-10T20:44:55.965 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-10T20:44:55.965 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-10T20:44:55.965 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-10T20:44:55.965 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-10T20:44:55.965 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-10T20:44:55.965 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-10T20:44:55.966 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-10T20:44:55.966 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-10T20:44:55.966 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-10T20:44:55.966 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-10T20:44:55.966 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-10T20:44:55.967 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-10T20:44:55.967 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-10T20:44:55.967 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-10T20:44:55.967 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-10T20:44:55.967 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-10T20:44:55.968 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-10T20:44:55.968 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-10T20:44:55.968 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-10T20:44:55.968 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-10T20:44:55.968 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-10T20:44:55.968 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-10T20:44:55.969 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-10T20:44:55.969 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-10T20:44:55.969 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-10T20:44:55.969 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-10T20:44:55.969 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-10T20:44:55.970 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-10T20:44:55.970 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-10T20:44:55.970 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-10T20:44:55.970 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-10T20:44:55.970 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-10T20:44:55.971 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-10T20:44:55.971 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-10T20:44:55.971 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-10T20:44:55.971 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-10T20:44:55.971 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-10T20:44:55.971 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-10T20:44:55.972 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-10T20:44:55.972 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-10T20:44:55.972 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-10T20:44:55.972 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-10T20:44:55.972 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-10T20:44:55.973 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-10T20:44:55.973 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-10T20:44:55.973 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-10T20:44:55.973 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-10T20:44:55.973 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-10T20:44:55.973 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-10T20:44:55.974 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-10T20:44:55.974 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-10T20:44:55.974 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-10T20:44:55.974 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-10T20:44:55.974 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-10T20:44:55.975 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-10T20:44:55.975 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-10T20:44:55.975 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-10T20:44:55.975 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-10T20:44:55.975 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-10T20:44:55.976 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-10T20:44:55.976 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-10T20:44:55.976 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-10T20:44:55.976 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-10T20:44:55.976 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-10T20:44:55.976 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-10T20:44:55.977 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-10T20:44:55.977 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-10T20:44:55.977 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-10T20:44:55.977 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-10T20:44:55.977 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-10T20:44:55.978 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-10T20:44:55.978 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-10T20:44:55.978 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-10T20:44:55.978 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-10T20:44:55.978 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-10T20:44:55.978 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-10T20:44:55.979 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-10T20:44:55.979 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-10T20:44:55.979 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-10T20:44:55.979 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-10T20:44:55.979 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-10T20:44:55.980 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-10T20:44:55.980 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-10T20:44:55.980 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-10T20:44:55.980 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-10T20:44:55.980 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-10T20:44:55.981 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-10T20:44:55.981 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-10T20:44:55.981 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-10T20:44:55.981 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-10T20:44:55.981 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-10T20:44:55.981 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-10T20:44:55.982 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-10T20:44:55.982 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-10T20:44:55.982 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-10T20:44:55.982 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-10T20:44:55.982 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-10T20:44:55.983 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-10T20:44:55.983 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-10T20:44:55.983 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-10T20:44:55.983 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-10T20:44:55.983 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-10T20:44:55.983 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-10T20:44:55.984 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-10T20:44:55.984 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-10T20:44:55.984 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-10T20:44:55.984 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-10T20:44:55.984 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-10T20:44:55.985 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-10T20:44:55.985 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-10T20:44:55.985 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-10T20:44:55.985 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-10T20:44:55.985 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-10T20:44:55.985 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-10T20:44:55.986 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-10T20:44:55.986 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-10T20:44:55.986 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-10T20:44:55.986 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-10T20:44:55.986 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-10T20:44:55.987 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-10T20:44:55.987 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-10T20:44:55.987 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-10T20:44:55.987 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-10T20:44:55.987 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-10T20:44:55.988 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-10T20:44:55.988 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-10T20:44:55.988 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-10T20:44:55.988 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-10T20:44:55.988 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-10T20:44:55.988 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-10T20:44:55.989 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-10T20:44:55.989 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-10T20:44:55.989 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-10T20:44:55.989 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-10T20:44:55.989 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-10T20:44:55.990 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-10T20:44:55.990 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-10T20:44:55.990 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-10T20:44:55.990 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-10T20:44:55.990 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-10T20:44:55.991 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-10T20:44:55.991 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-10T20:44:55.991 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-10T20:44:55.991 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-10T20:44:55.991 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-10T20:44:55.991 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-10T20:44:55.992 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-10T20:44:55.992 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-10T20:44:55.992 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-10T20:44:55.992 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-10T20:44:55.992 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-10T20:44:55.993 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-10T20:44:55.994 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-10T20:44:55.994 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-10T20:44:55.994 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-10T20:44:55.994 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-10T20:44:55.995 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-10T20:44:55.995 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-10T20:44:55.995 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-10T20:44:55.995 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-10T20:44:55.995 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-10T20:44:55.996 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-10T20:44:55.996 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-10T20:44:55.996 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-10T20:44:55.996 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-10T20:44:55.996 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-10T20:44:55.996 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-10T20:44:55.997 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-10T20:44:55.997 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-10T20:44:55.997 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-10T20:44:55.997 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-10T20:44:55.997 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-10T20:44:55.998 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-10T20:44:55.998 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-10T20:44:55.998 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-10T20:44:55.998 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-10T20:44:55.998 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-10T20:44:55.999 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-10T20:44:55.999 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-10T20:44:55.999 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-10T20:44:55.999 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-10T20:44:55.999 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-10T20:44:55.999 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-10T20:44:56.000 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-10T20:44:56.000 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-10T20:44:56.000 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-10T20:44:56.000 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-10T20:44:56.000 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-10T20:44:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-10T20:44:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-10T20:44:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-10T20:44:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-10T20:44:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-10T20:44:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-10T20:44:56.002 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-10T20:44:56.002 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-10T20:44:56.002 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-10T20:44:56.002 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-10T20:44:56.002 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-10T20:44:56.003 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-10T20:44:56.003 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-10T20:44:56.003 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-10T20:44:56.003 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-10T20:44:56.003 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-10T20:44:56.003 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-10T20:44:56.004 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-10T20:44:56.004 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-10T20:44:56.004 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-10T20:44:56.004 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-10T20:44:56.004 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-10T20:44:56.005 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-10T20:44:56.005 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-10T20:44:56.005 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-10T20:44:56.005 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-10T20:44:56.005 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-10T20:44:56.005 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-10T20:44:56.006 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-10T20:44:56.006 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-10T20:44:56.006 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-10T20:44:56.006 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-10T20:44:56.006 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-10T20:44:56.007 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-10T20:44:56.007 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-10T20:44:56.007 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-10T20:44:56.007 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-10T20:44:56.007 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-10T20:44:56.007 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-10T20:44:56.008 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-10T20:44:56.008 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-10T20:44:56.008 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-10T20:44:56.008 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-10T20:44:56.008 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-10T20:44:56.009 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-10T20:44:56.009 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-10T20:44:56.009 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-10T20:44:56.009 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-10T20:44:56.009 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-10T20:44:56.009 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-10T20:44:56.010 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-10T20:44:56.010 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-10T20:44:56.010 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-10T20:44:56.010 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-10T20:44:56.010 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-10T20:44:56.011 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-10T20:44:56.011 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-10T20:44:56.011 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-10T20:44:56.011 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-10T20:44:56.011 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-10T20:44:56.011 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-10T20:44:56.012 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-10T20:44:56.012 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-10T20:44:56.012 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-10T20:44:56.012 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-10T20:44:56.012 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-10T20:44:56.013 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-10T20:44:56.013 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-10T20:44:56.013 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-10T20:44:56.013 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-10T20:44:56.013 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-10T20:44:56.013 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-10T20:44:56.014 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-10T20:44:56.014 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-10T20:44:56.014 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-10T20:44:56.015 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-10T20:44:56.015 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-10T20:44:56.015 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-10T20:44:56.015 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-10T20:44:56.015 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-10T20:44:56.016 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-10T20:44:56.016 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-10T20:44:56.016 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-10T20:44:56.016 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-10T20:44:56.016 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-10T20:44:56.016 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-10T20:44:56.017 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-10T20:44:56.017 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-10T20:44:56.017 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-10T20:44:56.017 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-10T20:44:56.017 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-10T20:44:56.018 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-10T20:44:56.018 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-10T20:44:56.018 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-10T20:44:56.018 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-10T20:44:56.018 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-10T20:44:56.018 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-10T20:44:56.019 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-10T20:44:56.019 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-10T20:44:56.019 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-10T20:44:56.019 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-10T20:44:56.019 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-10T20:44:56.020 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-10T20:44:56.020 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-10T20:44:56.020 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-10T20:44:56.020 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-10T20:44:56.020 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-10T20:44:56.021 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-10T20:44:56.021 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-10T20:44:56.021 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-10T20:44:56.021 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-10T20:44:56.021 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-10T20:44:56.021 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-10T20:44:56.022 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-10T20:44:56.022 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-10T20:44:56.022 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-10T20:44:56.022 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-10T20:44:56.022 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-10T20:44:56.023 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-10T20:44:56.023 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-10T20:44:56.023 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-10T20:44:56.023 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-10T20:44:56.023 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-10T20:44:56.023 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-10T20:44:56.024 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-10T20:44:56.024 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-10T20:44:56.024 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-10T20:44:56.024 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-10T20:44:56.024 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-10T20:44:56.024 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-10T20:44:56.025 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-10T20:44:56.025 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-10T20:44:56.025 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-10T20:44:56.025 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-10T20:44:56.025 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-10T20:44:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-10T20:44:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-10T20:44:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-10T20:44:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-10T20:44:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-10T20:44:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-10T20:44:56.027 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-10T20:44:56.027 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-10T20:44:56.027 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-10T20:44:56.027 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-10T20:44:56.027 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-10T20:44:56.028 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-10T20:44:56.028 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-10T20:44:56.028 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-10T20:44:56.028 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-10T20:44:56.028 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-10T20:44:56.028 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-10T20:44:56.029 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-10T20:44:56.029 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-10T20:44:56.029 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-10T20:44:56.029 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-10T20:44:56.029 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-10T20:44:56.030 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-10T20:44:56.030 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-10T20:44:56.030 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-10T20:44:56.030 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-10T20:44:56.030 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-10T20:44:56.030 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-10T20:44:56.031 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-10T20:44:56.031 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-10T20:44:56.031 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-10T20:44:56.031 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-10T20:44:56.031 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-10T20:44:56.032 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-10T20:44:56.032 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-10T20:44:56.032 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-10T20:44:56.032 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-10T20:44:56.032 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-10T20:44:56.032 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-10T20:44:56.033 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-10T20:44:56.033 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-10T20:44:56.033 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-10T20:44:56.033 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-10T20:44:56.033 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-10T20:44:56.033 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-10T20:44:56.034 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-10T20:44:56.034 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-10T20:44:56.034 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-10T20:44:56.034 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-10T20:44:56.034 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-10T20:44:56.035 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-10T20:44:56.035 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-10T20:44:56.035 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-10T20:44:56.035 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-10T20:44:56.035 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-10T20:44:56.035 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-10T20:44:56.036 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-10T20:44:56.036 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-10T20:44:56.036 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-10T20:44:56.036 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-10T20:44:56.036 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-10T20:44:56.037 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-10T20:44:56.037 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-10T20:44:56.037 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-10T20:44:56.037 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-10T20:44:56.037 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-10T20:44:56.037 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-10T20:44:56.038 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-10T20:44:56.038 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-10T20:44:56.038 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-10T20:44:56.038 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-10T20:44:56.038 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-10T20:44:56.039 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-10T20:44:56.039 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-10T20:44:56.039 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-10T20:44:56.039 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-10T20:44:56.039 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-10T20:44:56.040 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-10T20:44:56.040 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-10T20:44:56.040 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-10T20:44:56.040 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-10T20:44:56.040 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-10T20:44:56.040 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-10T20:44:56.041 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-10T20:44:56.041 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-10T20:44:56.041 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-10T20:44:56.041 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-10T20:44:56.041 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-10T20:44:56.042 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-10T20:44:56.042 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-10T20:44:56.042 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-10T20:44:56.042 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-10T20:44:56.042 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-10T20:44:56.042 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-10T20:44:56.043 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-10T20:44:56.043 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-10T20:44:56.043 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-10T20:44:56.043 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-10T20:44:56.043 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-10T20:44:56.043 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-10T20:44:56.044 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-10T20:44:56.044 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-10T20:44:56.044 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-10T20:44:56.044 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-10T20:44:56.044 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-10T20:44:56.045 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-10T20:44:56.045 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-10T20:44:56.045 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-10T20:44:56.045 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-10T20:44:56.045 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-10T20:44:56.045 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-10T20:44:56.046 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-10T20:44:56.046 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-10T20:44:56.046 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-10T20:44:56.046 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-10T20:44:56.046 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-10T20:44:56.047 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-10T20:44:56.047 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-10T20:44:56.047 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-10T20:44:56.047 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-10T20:44:56.047 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-10T20:44:56.047 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-10T20:44:56.048 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-10T20:44:56.048 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-10T20:44:56.048 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-10T20:44:56.048 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-10T20:44:56.048 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-10T20:44:56.049 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-10T20:44:56.049 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-10T20:44:56.049 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-10T20:44:56.049 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-10T20:44:56.049 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-10T20:44:56.049 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-10T20:44:56.050 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-10T20:44:56.050 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-10T20:44:56.050 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-10T20:44:56.050 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-10T20:44:56.050 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-10T20:44:56.051 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-10T20:44:56.051 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-10T20:44:56.051 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-10T20:44:56.051 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-10T20:44:56.051 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-10T20:44:56.052 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-10T20:44:56.052 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-10T20:44:56.052 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-10T20:44:56.052 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-10T20:44:56.052 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-10T20:44:56.053 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-10T20:44:56.053 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-10T20:44:56.053 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-10T20:44:56.053 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-10T20:44:56.053 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-10T20:44:56.053 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-10T20:44:56.054 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-10T20:44:56.054 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-10T20:44:56.054 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-10T20:44:56.054 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-10T20:44:56.054 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-10T20:44:56.055 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-10T20:44:56.055 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-10T20:44:56.055 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-10T20:44:56.055 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-10T20:44:56.055 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-10T20:44:56.055 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-10T20:44:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-10T20:44:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-10T20:44:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-10T20:44:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-10T20:44:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-10T20:44:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-10T20:44:56.057 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-10T20:44:56.057 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-10T20:44:56.057 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-10T20:44:56.057 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-10T20:44:56.057 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-10T20:44:56.058 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-10T20:44:56.058 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-10T20:44:56.058 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-10T20:44:56.058 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-10T20:44:56.058 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-10T20:44:56.058 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-10T20:44:56.059 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-10T20:44:56.059 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-10T20:44:56.059 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-10T20:44:56.059 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-10T20:44:56.059 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-10T20:44:56.060 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-10T20:44:56.060 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-10T20:44:56.060 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-10T20:44:56.060 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-10T20:44:56.060 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-10T20:44:56.060 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-10T20:44:56.061 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-10T20:44:56.061 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-10T20:44:56.061 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-10T20:44:56.061 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-10T20:44:56.061 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-10T20:44:56.062 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-10T20:44:56.062 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-10T20:44:56.062 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-10T20:44:56.062 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-10T20:44:56.062 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-10T20:44:56.063 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-10T20:44:56.063 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-10T20:44:56.063 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-10T20:44:56.063 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-10T20:44:56.063 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-10T20:44:56.063 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-10T20:44:56.064 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-10T20:44:56.064 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-10T20:44:56.064 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-10T20:44:56.064 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-10T20:44:56.064 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-10T20:44:56.064 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-10T20:44:56.065 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-10T20:44:56.065 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-10T20:44:56.065 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-10T20:44:56.065 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-10T20:44:56.065 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-10T20:44:56.066 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-10T20:44:56.066 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-10T20:44:56.066 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-10T20:44:56.066 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-10T20:44:56.066 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-10T20:44:56.066 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-10T20:44:56.067 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-10T20:44:56.067 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-10T20:44:56.067 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-10T20:44:56.067 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-10T20:44:56.067 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-10T20:44:56.068 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-10T20:44:56.068 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-10T20:44:56.068 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-10T20:44:56.068 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-10T20:44:56.068 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-10T20:44:56.068 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-10T20:44:56.069 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-10T20:44:56.069 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-10T20:44:56.069 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-10T20:44:56.069 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-10T20:44:56.069 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-10T20:44:56.070 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-10T20:44:56.070 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-10T20:44:56.070 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-10T20:44:56.070 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-10T20:44:56.070 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-10T20:44:56.070 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-10T20:44:56.071 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-10T20:44:56.071 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-10T20:44:56.071 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-10T20:44:56.071 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-10T20:44:56.071 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-10T20:44:56.072 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-10T20:44:56.072 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-10T20:44:56.072 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-10T20:44:56.072 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-10T20:44:56.072 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-10T20:44:56.072 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-10T20:44:56.073 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-10T20:44:56.073 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-10T20:44:56.073 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-10T20:44:56.073 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-10T20:44:56.073 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-10T20:44:56.073 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-10T20:44:56.074 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-10T20:44:56.074 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-10T20:44:56.074 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-10T20:44:56.074 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-10T20:44:56.074 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-10T20:44:56.075 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-10T20:44:56.075 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-10T20:44:56.075 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-10T20:44:56.075 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-10T20:44:56.075 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-10T20:44:56.075 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-10T20:44:56.076 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-10T20:44:56.076 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-10T20:44:56.076 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-10T20:44:56.076 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-10T20:44:56.076 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-10T20:44:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-10T20:44:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-10T20:44:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-10T20:44:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-10T20:44:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-10T20:44:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-10T20:44:56.078 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-10T20:44:56.078 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-10T20:44:56.078 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-10T20:44:56.078 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-10T20:44:56.078 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-10T20:44:56.079 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-10T20:44:56.079 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-10T20:44:56.079 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-10T20:44:56.079 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-10T20:44:56.079 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-10T20:44:56.079 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-10T20:44:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-10T20:44:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-10T20:44:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-10T20:44:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-10T20:44:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-10T20:44:56.081 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-10T20:44:56.081 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-10T20:44:56.081 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-10T20:44:56.081 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-10T20:44:56.081 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-10T20:44:56.081 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-10T20:44:56.082 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-10T20:44:56.082 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-10T20:44:56.082 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-10T20:44:56.082 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-10T20:44:56.082 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-10T20:44:56.083 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-10T20:44:56.083 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-10T20:44:56.083 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-10T20:44:56.083 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-10T20:44:56.083 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-10T20:44:56.083 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-10T20:44:56.084 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-10T20:44:56.084 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-10T20:44:56.084 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-10T20:44:56.084 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-10T20:44:56.084 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-10T20:44:56.085 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-10T20:44:56.085 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-10T20:44:56.085 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-10T20:44:56.085 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-10T20:44:56.085 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-10T20:44:56.085 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-10T20:44:56.086 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-10T20:44:56.086 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-10T20:44:56.086 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-10T20:44:56.086 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-10T20:44:56.086 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-10T20:44:56.087 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-10T20:44:56.087 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-10T20:44:56.087 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-10T20:44:56.087 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-10T20:44:56.087 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-10T20:44:56.087 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-10T20:44:56.088 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-10T20:44:56.088 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-10T20:44:56.088 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-10T20:44:56.088 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-10T20:44:56.088 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-10T20:44:56.089 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-10T20:44:56.089 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-10T20:44:56.089 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-10T20:44:56.089 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-10T20:44:56.089 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-10T20:44:56.089 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-10T20:44:56.090 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-10T20:44:56.090 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-10T20:44:56.090 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-10T20:44:56.090 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-10T20:44:56.090 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-10T20:44:56.091 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-10T20:44:56.091 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-10T20:44:56.091 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-10T20:44:56.091 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-10T20:44:56.091 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-10T20:44:56.091 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-10T20:44:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-10T20:44:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-10T20:44:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-10T20:44:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-10T20:44:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-10T20:44:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-10T20:44:56.093 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-10T20:44:56.093 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-10T20:44:56.093 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-10T20:44:56.093 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-10T20:44:56.093 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-10T20:44:56.094 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-10T20:44:56.094 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-10T20:44:56.094 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-10T20:44:56.094 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-10T20:44:56.094 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-10T20:44:56.094 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-10T20:44:56.095 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-10T20:44:56.095 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-10T20:44:56.095 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-10T20:44:56.095 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-10T20:44:56.095 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-10T20:44:56.096 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-10T20:44:56.096 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-10T20:44:56.096 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-10T20:44:56.096 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-10T20:44:56.096 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-10T20:44:56.096 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-10T20:44:56.097 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-10T20:44:56.097 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-10T20:44:56.097 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-10T20:44:56.097 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-10T20:44:56.097 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-10T20:44:56.097 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-10T20:44:56.098 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-10T20:44:56.098 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-10T20:44:56.098 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-10T20:44:56.098 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-10T20:44:56.098 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-10T20:44:56.099 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-10T20:44:56.099 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-10T20:44:56.099 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-10T20:44:56.099 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-10T20:44:56.099 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-10T20:44:56.100 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-10T20:44:56.100 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-10T20:44:56.100 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-10T20:44:56.100 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-10T20:44:56.100 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-10T20:44:56.100 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-10T20:44:56.101 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-10T20:44:56.101 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-10T20:44:56.101 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-10T20:44:56.101 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-10T20:44:56.101 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-10T20:44:56.102 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-10T20:44:56.102 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-10T20:44:56.102 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-10T20:44:56.102 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-10T20:44:56.102 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-10T20:44:56.102 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-10T20:44:56.103 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-10T20:44:56.103 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-10T20:44:56.103 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-10T20:44:56.103 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-10T20:44:56.103 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-10T20:44:56.104 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-10T20:44:56.104 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-10T20:44:56.104 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-10T20:44:56.104 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-10T20:44:56.104 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-10T20:44:56.104 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-10T20:44:56.105 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-10T20:44:56.105 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-10T20:44:56.105 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-10T20:44:56.105 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-10T20:44:56.105 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-10T20:44:56.105 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-10T20:44:56.106 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-10T20:44:56.106 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-10T20:44:56.106 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-10T20:44:56.106 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-10T20:44:56.106 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-10T20:44:56.107 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-10T20:44:56.107 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-10T20:44:56.107 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-10T20:44:56.107 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-10T20:44:56.107 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-10T20:44:56.107 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-10T20:44:56.108 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-10T20:44:56.108 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-10T20:44:56.108 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-10T20:44:56.108 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-10T20:44:56.108 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-10T20:44:56.109 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-10T20:44:56.109 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-10T20:44:56.109 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-10T20:44:56.109 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-10T20:44:56.109 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-10T20:44:56.109 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-10T20:44:56.110 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-10T20:44:56.110 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-10T20:44:56.110 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-10T20:44:56.110 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-10T20:44:56.110 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-10T20:44:56.111 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-10T20:44:56.111 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-10T20:44:56.111 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-10T20:44:56.111 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-10T20:44:56.111 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-10T20:44:56.111 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-10T20:44:56.112 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-10T20:44:56.112 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-10T20:44:56.112 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-10T20:44:56.112 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-10T20:44:56.112 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-10T20:44:56.112 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-10T20:44:56.113 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-10T20:44:56.113 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-10T20:44:56.113 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-10T20:44:56.113 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-10T20:44:56.113 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-10T20:44:56.114 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-10T20:44:56.114 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-10T20:44:56.114 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-10T20:44:56.114 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-10T20:44:56.114 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-10T20:44:56.114 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-10T20:44:56.115 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-10T20:44:56.115 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-10T20:44:56.115 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-10T20:44:56.115 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-10T20:44:56.115 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-10T20:44:56.116 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-10T20:44:56.116 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-10T20:44:56.116 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-10T20:44:56.116 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-10T20:44:56.116 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-10T20:44:56.116 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-10T20:44:56.117 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-10T20:44:56.117 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-10T20:44:56.117 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-10T20:44:56.117 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-10T20:44:56.117 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-10T20:44:56.117 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-10T20:44:56.118 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-10T20:44:56.118 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-10T20:44:56.118 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-10T20:44:56.118 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-10T20:44:56.118 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-10T20:44:56.119 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-10T20:44:56.119 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-10T20:44:56.119 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-10T20:44:56.119 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-10T20:44:56.119 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-10T20:44:56.120 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-10T20:44:56.120 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-10T20:44:56.120 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-10T20:44:56.120 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-10T20:44:56.120 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-10T20:44:56.121 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-10T20:44:56.121 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-10T20:44:56.121 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-10T20:44:56.121 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-10T20:44:56.121 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-10T20:44:56.121 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-10T20:44:56.122 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-10T20:44:56.122 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-10T20:44:56.122 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-10T20:44:56.122 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-10T20:44:56.122 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-10T20:44:56.122 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-10T20:44:56.123 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-10T20:44:56.123 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-10T20:44:56.123 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-10T20:44:56.123 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-10T20:44:56.123 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-10T20:44:56.124 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-10T20:44:56.124 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-10T20:44:56.124 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-10T20:44:56.124 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-10T20:44:56.124 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-10T20:44:56.124 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-10T20:44:56.125 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-10T20:44:56.125 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-10T20:44:56.125 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-10T20:44:56.125 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-10T20:44:56.125 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-10T20:44:56.126 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-10T20:44:56.126 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-10T20:44:56.126 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-10T20:44:56.126 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-10T20:44:56.126 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-10T20:44:56.126 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-10T20:44:56.127 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-10T20:44:56.127 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-10T20:44:56.127 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-10T20:44:56.127 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-10T20:44:56.127 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-10T20:44:56.128 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-10T20:44:56.128 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-10T20:44:56.128 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-10T20:44:56.128 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-10T20:44:56.128 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-10T20:44:56.128 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-10T20:44:56.129 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-10T20:44:56.129 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-10T20:44:56.129 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-10T20:44:56.129 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-10T20:44:56.129 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-10T20:44:56.130 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-10T20:44:56.130 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-10T20:44:56.130 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-10T20:44:56.130 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-10T20:44:56.130 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-10T20:44:56.130 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-10T20:44:56.131 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-10T20:44:56.131 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-10T20:44:56.131 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-10T20:44:56.131 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-10T20:44:56.131 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-10T20:44:56.132 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-10T20:44:56.132 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-10T20:44:56.132 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-10T20:44:56.132 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-10T20:44:56.132 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-10T20:44:56.132 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-10T20:44:56.133 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-10T20:44:56.133 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-10T20:44:56.133 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-10T20:44:56.133 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-10T20:44:56.133 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-10T20:44:56.133 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-10T20:44:56.134 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-10T20:44:56.134 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-10T20:44:56.134 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-10T20:44:56.134 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-10T20:44:56.134 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-10T20:44:56.135 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-10T20:44:56.135 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-10T20:44:56.135 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-10T20:44:56.135 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-10T20:44:56.135 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-10T20:44:56.135 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-10T20:44:56.136 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-10T20:44:56.136 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-10T20:44:56.136 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-10T20:44:56.136 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-10T20:44:56.136 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-10T20:44:56.137 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-10T20:44:56.137 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-10T20:44:56.137 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-10T20:44:56.137 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-10T20:44:56.137 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-10T20:44:56.137 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-10T20:44:56.138 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-10T20:44:56.138 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-10T20:44:56.138 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-10T20:44:56.138 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-10T20:44:56.138 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-10T20:44:56.139 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-10T20:44:56.139 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-10T20:44:56.139 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-10T20:44:56.139 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-10T20:44:56.139 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-10T20:44:56.139 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-10T20:44:56.140 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-10T20:44:56.140 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-10T20:44:56.140 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-10T20:44:56.140 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-10T20:44:56.140 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-10T20:44:56.141 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-10T20:44:56.141 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-10T20:44:56.141 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-10T20:44:56.141 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-10T20:44:56.141 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-10T20:44:56.141 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-10T20:44:56.142 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-10T20:44:56.142 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-10T20:44:56.142 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-10T20:44:56.142 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-10T20:44:56.142 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-10T20:44:56.143 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-10T20:44:56.143 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-10T20:44:56.143 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-10T20:44:56.143 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-10T20:44:56.143 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-10T20:44:56.144 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-10T20:44:56.144 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-10T20:44:56.144 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-10T20:44:56.144 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-10T20:44:56.144 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-10T20:44:56.144 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-10T20:44:56.145 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-10T20:44:56.145 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-10T20:44:56.145 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-10T20:44:56.145 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-10T20:44:56.145 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-10T20:44:56.146 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-10T20:44:56.146 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-10T20:44:56.146 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-10T20:44:56.146 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-10T20:44:56.146 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-10T20:44:56.146 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-10T20:44:56.147 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-10T20:44:56.147 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-10T20:44:56.147 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-10T20:44:56.147 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-10T20:44:56.147 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-10T20:44:56.148 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-10T20:44:56.148 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-10T20:44:56.148 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-10T20:44:56.148 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-10T20:44:56.148 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-10T20:44:56.148 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-10T20:44:56.149 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-10T20:44:56.149 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-10T20:44:56.149 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-10T20:44:56.149 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-10T20:44:56.149 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-10T20:44:56.150 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-10T20:44:56.150 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-10T20:44:56.150 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-10T20:44:56.150 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-10T20:44:56.150 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-10T20:44:56.151 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-10T20:44:56.151 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-10T20:44:56.151 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-10T20:44:56.151 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-10T20:44:56.151 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-10T20:44:56.151 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-10T20:44:56.152 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-10T20:44:56.152 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-10T20:44:56.152 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-10T20:44:56.152 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-10T20:44:56.152 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-10T20:44:56.152 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-10T20:44:56.153 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-10T20:44:56.153 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-10T20:44:56.153 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-10T20:44:56.153 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-10T20:44:56.153 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-10T20:44:56.154 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-10T20:44:56.154 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-10T20:44:56.154 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-10T20:44:56.154 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-10T20:44:56.154 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-10T20:44:56.154 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-10T20:44:56.155 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-10T20:44:56.155 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-10T20:44:56.155 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-10T20:44:56.155 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-10T20:44:56.155 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-10T20:44:56.156 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-10T20:44:56.156 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-10T20:44:56.156 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-10T20:44:56.156 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-10T20:44:56.156 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-10T20:44:56.156 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-10T20:44:56.157 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-10T20:44:56.157 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-10T20:44:56.157 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-10T20:44:56.157 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-10T20:44:56.157 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-10T20:44:56.157 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-10T20:44:56.158 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-10T20:44:56.158 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-10T20:44:56.158 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-10T20:44:56.158 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-10T20:44:56.158 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-10T20:44:56.159 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-10T20:44:56.159 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-10T20:44:56.159 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-10T20:44:56.159 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-10T20:44:56.160 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-10T20:44:56.160 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-10T20:44:56.160 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-10T20:44:56.160 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-10T20:44:56.160 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-10T20:44:56.160 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-10T20:44:56.161 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-10T20:44:56.161 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-10T20:44:56.161 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-10T20:44:56.161 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-10T20:44:56.161 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-10T20:44:56.162 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-10T20:44:56.162 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-10T20:44:56.162 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-10T20:44:56.162 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-10T20:44:56.162 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-10T20:44:56.162 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-10T20:44:56.163 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-10T20:44:56.163 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-10T20:44:56.163 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-10T20:44:56.163 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-10T20:44:56.163 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-10T20:44:56.163 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-10T20:44:56.164 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-10T20:44:56.164 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-10T20:44:56.164 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-10T20:44:56.164 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-10T20:44:56.164 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-10T20:44:56.165 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-10T20:44:56.165 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-10T20:44:56.165 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-10T20:44:56.165 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-10T20:44:56.165 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-10T20:44:56.165 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-10T20:44:56.166 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-10T20:44:56.166 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-10T20:44:56.166 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-10T20:44:56.166 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-10T20:44:56.166 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-10T20:44:56.167 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-10T20:44:56.167 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-10T20:44:56.167 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-10T20:44:56.167 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-10T20:44:56.167 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-10T20:44:56.167 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-10T20:44:56.168 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-10T20:44:56.168 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-10T20:44:56.168 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-10T20:44:56.168 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-10T20:44:56.168 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-10T20:44:56.169 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-10T20:44:56.169 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-10T20:44:56.169 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-10T20:44:56.169 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-10T20:44:56.169 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-10T20:44:56.169 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-10T20:44:56.170 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-10T20:44:56.170 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-10T20:44:56.170 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-10T20:44:56.170 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-10T20:44:56.170 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-10T20:44:56.171 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-10T20:44:56.171 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-10T20:44:56.171 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-10T20:44:56.171 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-10T20:44:56.171 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-10T20:44:56.171 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-10T20:44:56.172 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-10T20:44:56.172 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-10T20:44:56.172 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-10T20:44:56.172 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-10T20:44:56.172 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-10T20:44:56.173 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-10T20:44:56.173 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-10T20:44:56.173 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-10T20:44:56.173 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-10T20:44:56.173 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-10T20:44:56.173 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-10T20:44:56.174 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-10T20:44:56.174 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-10T20:44:56.174 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-10T20:44:56.174 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-10T20:44:56.174 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-10T20:44:56.174 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-10T20:44:56.175 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-10T20:44:56.175 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-10T20:44:56.175 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-10T20:44:56.175 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-10T20:44:56.175 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-10T20:44:56.176 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-10T20:44:56.176 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-10T20:44:56.176 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-10T20:44:56.176 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-10T20:44:56.176 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-10T20:44:56.177 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-10T20:44:56.177 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-10T20:44:56.177 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-10T20:44:56.177 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-10T20:44:56.177 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-10T20:44:56.177 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-10T20:44:56.178 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-10T20:44:56.178 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-10T20:44:56.178 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-10T20:44:56.178 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-10T20:44:56.178 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-10T20:44:56.179 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-10T20:44:56.179 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-10T20:44:56.179 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-10T20:44:56.179 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-10T20:44:56.179 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-10T20:44:56.179 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-10T20:44:56.180 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-10T20:44:56.180 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-10T20:44:56.180 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-10T20:44:56.180 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-10T20:44:56.180 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-10T20:44:56.181 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-10T20:44:56.181 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-10T20:44:56.181 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-10T20:44:56.181 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-10T20:44:56.181 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-10T20:44:56.181 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-10T20:44:56.182 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-10T20:44:56.182 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-10T20:44:56.182 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-10T20:44:56.182 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-10T20:44:56.182 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-10T20:44:56.183 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-10T20:44:56.183 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-10T20:44:56.183 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-10T20:44:56.183 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-10T20:44:56.183 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-10T20:44:56.183 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-10T20:44:56.184 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-10T20:44:56.184 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-10T20:44:56.184 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-10T20:44:56.184 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-10T20:44:56.184 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-10T20:44:56.184 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-10T20:44:56.185 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-10T20:44:56.185 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-10T20:44:56.185 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-10T20:44:56.185 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-10T20:44:56.185 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-10T20:44:56.186 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-10T20:44:56.186 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-10T20:44:56.186 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-10T20:44:56.186 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-10T20:44:56.186 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-10T20:44:56.187 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-10T20:44:56.187 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-10T20:44:56.187 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-10T20:44:56.187 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-10T20:44:56.187 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-10T20:44:56.187 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-10T20:44:56.188 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-10T20:44:56.188 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-10T20:44:56.188 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-10T20:44:56.188 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-10T20:44:56.188 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-10T20:44:56.188 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-10T20:44:56.189 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-10T20:44:56.189 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-10T20:44:56.189 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-10T20:44:56.189 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-10T20:44:56.189 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-10T20:44:56.190 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-10T20:44:56.190 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-10T20:44:56.190 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-10T20:44:56.190 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-10T20:44:56.190 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-10T20:44:56.190 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-10T20:44:56.191 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-10T20:44:56.191 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-10T20:44:56.191 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-10T20:44:56.191 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-10T20:44:56.191 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-10T20:44:56.192 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-10T20:44:56.192 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-10T20:44:56.192 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-10T20:44:56.192 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-10T20:44:56.192 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-10T20:44:56.192 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-10T20:44:56.193 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-10T20:44:56.193 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-10T20:44:56.193 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-10T20:44:56.193 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-10T20:44:56.193 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-10T20:44:56.194 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-10T20:44:56.194 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-10T20:44:56.194 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-10T20:44:56.194 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-10T20:44:56.194 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-10T20:44:56.194 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-10T20:44:56.195 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-10T20:44:56.195 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-10T20:44:56.195 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-10T20:44:56.195 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-10T20:44:56.195 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-10T20:44:56.196 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-10T20:44:56.196 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-10T20:44:56.196 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-10T20:44:56.196 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-10T20:44:56.196 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-10T20:44:56.196 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-10T20:44:56.197 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-10T20:44:56.197 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-10T20:44:56.197 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-10T20:44:56.197 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-10T20:44:56.197 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-10T20:44:56.198 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-10T20:44:56.198 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-10T20:44:56.198 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-10T20:44:56.198 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-10T20:44:56.198 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-10T20:44:56.199 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-10T20:44:56.199 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-10T20:44:56.199 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-10T20:44:56.199 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-10T20:44:56.199 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-10T20:44:56.199 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-10T20:44:56.200 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-10T20:44:56.200 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-10T20:44:56.200 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-10T20:44:56.200 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-10T20:44:56.200 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-10T20:44:56.201 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-10T20:44:56.201 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-10T20:44:56.201 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-10T20:44:56.201 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-10T20:44:56.201 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-10T20:44:56.201 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-10T20:44:56.202 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-10T20:44:56.202 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-10T20:44:56.202 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-10T20:44:56.202 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-10T20:44:56.202 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-10T20:44:56.203 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-10T20:44:56.203 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-10T20:44:56.203 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-10T20:44:56.203 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-10T20:44:56.203 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-10T20:44:56.203 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-10T20:44:56.204 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-10T20:44:56.204 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-10T20:44:56.204 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-10T20:44:56.204 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-10T20:44:56.204 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-10T20:44:56.205 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-10T20:44:56.205 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-10T20:44:56.205 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-10T20:44:56.205 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-10T20:44:56.205 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-10T20:44:56.206 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-10T20:44:56.206 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-10T20:44:56.206 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-10T20:44:56.206 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-10T20:44:56.206 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-10T20:44:56.207 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-10T20:44:56.207 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-10T20:44:56.207 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-10T20:44:56.207 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-10T20:44:56.207 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-10T20:44:56.207 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-10T20:44:56.208 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-10T20:44:56.208 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-10T20:44:56.208 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-10T20:44:56.208 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-10T20:44:56.208 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-10T20:44:56.208 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-10T20:44:56.209 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-10T20:44:56.209 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-10T20:44:56.209 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-10T20:44:56.209 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-10T20:44:56.209 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-10T20:44:56.210 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-10T20:44:56.210 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-10T20:44:56.210 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-10T20:44:56.210 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-10T20:44:56.210 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-10T20:44:56.210 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-10T20:44:56.211 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-10T20:44:56.211 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-10T20:44:56.211 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-10T20:44:56.211 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-10T20:44:56.211 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-10T20:44:56.212 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-10T20:44:56.212 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-10T20:44:56.212 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-10T20:44:56.212 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-10T20:44:56.212 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-10T20:44:56.212 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-10T20:44:56.213 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-10T20:44:56.213 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-10T20:44:56.213 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-10T20:44:56.213 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-10T20:44:56.213 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-10T20:44:56.214 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-10T20:44:56.214 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-10T20:44:56.214 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-10T20:44:56.214 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-10T20:44:56.214 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-10T20:44:56.215 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-10T20:44:56.215 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-10T20:44:56.215 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-10T20:44:56.215 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-10T20:44:56.215 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-10T20:44:56.215 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-10T20:44:56.216 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-10T20:44:56.216 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-10T20:44:56.216 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-10T20:44:56.216 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-10T20:44:56.216 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-10T20:44:56.217 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-10T20:44:56.217 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-10T20:44:56.217 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-10T20:44:56.217 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-10T20:44:56.217 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-10T20:44:56.218 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-10T20:44:56.218 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-10T20:44:56.218 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-10T20:44:56.218 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-10T20:44:56.218 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-10T20:44:56.219 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-10T20:44:56.219 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-10T20:44:56.219 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-10T20:44:56.219 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-10T20:44:56.219 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-10T20:44:56.220 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-10T20:44:56.220 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-10T20:44:56.220 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-10T20:44:56.220 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-10T20:44:56.220 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-10T20:44:56.220 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-10T20:44:56.221 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-10T20:44:56.221 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-10T20:44:56.221 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-10T20:44:56.221 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-10T20:44:56.221 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-10T20:44:56.222 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-10T20:44:56.222 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-10T20:44:56.222 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-10T20:44:56.222 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-10T20:44:56.222 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-10T20:44:56.222 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-10T20:44:56.223 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-10T20:44:56.223 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-10T20:44:56.223 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-10T20:44:56.223 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-10T20:44:56.223 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-10T20:44:56.224 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-10T20:44:56.224 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-10T20:44:56.224 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-10T20:44:56.224 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-10T20:44:56.224 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-10T20:44:56.224 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-10T20:44:56.225 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-10T20:44:56.225 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-10T20:44:56.225 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-10T20:44:56.225 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-10T20:44:56.225 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-10T20:44:56.225 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-10T20:44:56.226 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-10T20:44:56.226 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-10T20:44:56.226 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-10T20:44:56.226 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-10T20:44:56.226 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-10T20:44:56.227 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-10T20:44:56.227 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-10T20:44:56.227 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-10T20:44:56.227 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-10T20:44:56.227 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-10T20:44:56.227 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-10T20:44:56.228 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-10T20:44:56.228 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-10T20:44:56.228 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-10T20:44:56.228 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-10T20:44:56.228 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-10T20:44:56.229 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-10T20:44:56.229 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-10T20:44:56.229 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-10T20:44:56.229 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-10T20:44:56.229 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-10T20:44:56.229 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-10T20:44:56.230 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-10T20:44:56.230 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-10T20:44:56.230 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-10T20:44:56.230 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-10T20:44:56.230 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-10T20:44:56.231 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-10T20:44:56.231 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-10T20:44:56.231 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-10T20:44:56.231 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-10T20:44:56.231 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-10T20:44:56.231 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-10T20:44:56.232 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-10T20:44:56.232 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-10T20:44:56.232 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-10T20:44:56.232 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-10T20:44:56.232 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-10T20:44:56.233 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-10T20:44:56.233 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-10T20:44:56.233 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-10T20:44:56.233 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-10T20:44:56.233 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-10T20:44:56.233 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-10T20:44:56.234 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-10T20:44:56.234 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-10T20:44:56.234 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-10T20:44:56.234 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-10T20:44:56.234 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-10T20:44:56.235 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-10T20:44:56.235 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-10T20:44:56.235 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-10T20:44:56.235 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-10T20:44:56.235 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-10T20:44:56.236 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-10T20:44:56.236 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-10T20:44:56.236 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-10T20:44:56.236 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-10T20:44:56.236 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-10T20:44:56.236 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-10T20:44:56.237 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-10T20:44:56.237 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-10T20:44:56.237 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-10T20:44:56.237 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-10T20:44:56.237 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-10T20:44:56.238 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-10T20:44:56.238 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-10T20:44:56.238 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-10T20:44:56.238 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-10T20:44:56.238 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-10T20:44:56.238 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-10T20:44:56.239 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-10T20:44:56.239 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-10T20:44:56.239 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-10T20:44:56.239 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-10T20:44:56.239 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-10T20:44:56.240 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-10T20:44:56.240 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-10T20:44:56.240 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-10T20:44:56.240 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-10T20:44:56.240 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-10T20:44:56.240 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-10T20:44:56.241 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-10T20:44:56.241 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-10T20:44:56.241 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-10T20:44:56.241 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-10T20:44:56.241 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-10T20:44:56.242 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-10T20:44:56.242 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-10T20:44:56.242 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-10T20:44:56.242 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-10T20:44:56.242 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-10T20:44:56.243 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-10T20:44:56.243 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-10T20:44:56.243 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-10T20:44:56.243 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-10T20:44:56.243 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-10T20:44:56.243 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-10T20:44:56.244 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-10T20:44:56.244 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-10T20:44:56.244 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-10T20:44:56.244 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-10T20:44:56.244 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-10T20:44:56.245 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-10T20:44:56.245 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-10T20:44:56.245 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-10T20:44:56.245 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-10T20:44:56.245 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-10T20:44:56.245 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-10T20:44:56.246 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-10T20:44:56.246 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-10T20:44:56.246 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-10T20:44:56.246 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-10T20:44:56.246 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-10T20:44:56.246 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-10T20:44:56.247 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-10T20:44:56.247 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-10T20:44:56.247 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-10T20:44:56.247 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-10T20:44:56.247 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-10T20:44:56.248 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-10T20:44:56.248 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-10T20:44:56.248 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-10T20:44:56.248 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-10T20:44:56.248 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-10T20:44:56.248 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-10T20:44:56.249 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-10T20:44:56.249 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-10T20:44:56.249 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-10T20:44:56.249 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-10T20:44:56.249 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-10T20:44:56.250 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-10T20:44:56.250 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-10T20:44:56.250 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-10T20:44:56.250 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-10T20:44:56.250 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-10T20:44:56.251 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-10T20:44:56.251 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-10T20:44:56.251 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-10T20:44:56.251 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-10T20:44:56.251 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-10T20:44:56.251 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-10T20:44:56.252 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-10T20:44:56.252 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-10T20:44:56.252 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-10T20:44:56.252 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-10T20:44:56.252 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-10T20:44:56.253 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-10T20:44:56.253 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-10T20:44:56.253 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-10T20:44:56.253 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-10T20:44:56.253 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-10T20:44:56.254 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-10T20:44:56.254 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-10T20:44:56.254 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-10T20:44:56.254 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-10T20:44:56.254 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-10T20:44:56.254 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-10T20:44:56.255 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-10T20:44:56.255 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-10T20:44:56.255 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-10T20:44:56.255 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-10T20:44:56.255 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-10T20:44:56.256 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-10T20:44:56.256 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-10T20:44:56.256 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-10T20:44:56.256 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-10T20:44:56.256 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-10T20:44:56.256 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-10T20:44:56.257 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-10T20:44:56.257 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-10T20:44:56.257 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-10T20:44:56.257 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-10T20:44:56.257 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-10T20:44:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-10T20:44:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-10T20:44:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-10T20:44:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-10T20:44:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-10T20:44:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-10T20:44:56.259 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-10T20:44:56.259 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-10T20:44:56.259 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-10T20:44:56.259 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-10T20:44:56.259 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-10T20:44:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-10T20:44:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-10T20:44:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-10T20:44:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-10T20:44:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-10T20:44:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-10T20:44:56.261 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-10T20:44:56.261 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-10T20:44:56.261 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-10T20:44:56.261 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-10T20:44:56.261 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-10T20:44:56.262 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-10T20:44:56.262 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-10T20:44:56.262 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-10T20:44:56.262 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-10T20:44:56.262 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-10T20:44:56.262 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-10T20:44:56.263 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-10T20:44:56.263 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-10T20:44:56.263 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-10T20:44:56.263 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-10T20:44:56.263 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-10T20:44:56.264 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-10T20:44:56.264 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-10T20:44:56.264 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-10T20:44:56.264 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-10T20:44:56.264 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-10T20:44:56.264 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-10T20:44:56.265 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-10T20:44:56.265 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-10T20:44:56.265 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-10T20:44:56.265 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-10T20:44:56.265 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-10T20:44:56.265 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-10T20:44:56.266 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-10T20:44:56.266 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-10T20:44:56.266 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-10T20:44:56.266 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-10T20:44:56.266 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-10T20:44:56.267 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-10T20:44:56.267 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-10T20:44:56.267 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-10T20:44:56.267 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-10T20:44:56.267 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-10T20:44:56.268 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-10T20:44:56.268 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-10T20:44:56.268 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-10T20:44:56.268 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-10T20:44:56.268 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-10T20:44:56.268 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-10T20:44:56.269 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-10T20:44:56.269 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-10T20:44:56.269 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-10T20:44:56.269 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-10T20:44:56.269 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-10T20:44:56.270 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-10T20:44:56.270 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-10T20:44:56.270 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-10T20:44:56.270 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-10T20:44:56.270 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-10T20:44:56.271 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-10T20:44:56.271 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-10T20:44:56.271 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-10T20:44:56.271 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-10T20:44:56.271 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-10T20:44:56.272 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-10T20:44:56.272 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-10T20:44:56.272 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-10T20:44:56.272 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-10T20:44:56.272 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-10T20:44:56.273 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-10T20:44:56.273 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-10T20:44:56.273 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-10T20:44:56.273 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-10T20:44:56.273 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-10T20:44:56.274 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-10T20:44:56.274 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-10T20:44:56.274 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-10T20:44:56.274 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-10T20:44:56.274 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-10T20:44:56.274 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-10T20:44:56.275 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-10T20:44:56.275 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-10T20:44:56.275 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-10T20:44:56.275 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-10T20:44:56.275 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-10T20:44:56.276 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-10T20:44:56.276 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-10T20:44:56.276 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-10T20:44:56.276 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-10T20:44:56.276 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-10T20:44:56.276 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-10T20:44:56.277 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-10T20:44:56.277 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-10T20:44:56.277 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-10T20:44:56.277 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-10T20:44:56.277 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-10T20:44:56.278 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-10T20:44:56.278 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-10T20:44:56.278 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-10T20:44:56.278 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-10T20:44:56.278 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-10T20:44:56.278 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-10T20:44:56.279 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-10T20:44:56.279 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-10T20:44:56.279 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-10T20:44:56.279 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-10T20:44:56.279 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-10T20:44:56.280 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-10T20:44:56.280 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-10T20:44:56.280 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-10T20:44:56.280 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-10T20:44:56.280 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-10T20:44:56.280 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-10T20:44:56.281 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-10T20:44:56.281 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-10T20:44:56.281 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-10T20:44:56.281 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-10T20:44:56.281 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-10T20:44:56.282 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-10T20:44:56.282 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-10T20:44:56.282 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-10T20:44:56.282 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-10T20:44:56.282 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-10T20:44:56.282 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-10T20:44:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-10T20:44:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-10T20:44:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-10T20:44:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-10T20:44:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-10T20:44:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-10T20:44:56.284 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-10T20:44:56.284 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-10T20:44:56.284 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-10T20:44:56.284 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-10T20:44:56.284 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-10T20:44:56.285 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-10T20:44:56.285 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-10T20:44:56.285 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-10T20:44:56.285 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-10T20:44:56.285 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-10T20:44:56.285 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-10T20:44:56.286 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-10T20:44:56.286 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-10T20:44:56.286 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-10T20:44:56.286 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-10T20:44:56.286 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-10T20:44:56.287 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-10T20:44:56.287 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-10T20:44:56.287 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-10T20:44:56.287 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-10T20:44:56.287 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-10T20:44:56.287 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-10T20:44:56.288 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-10T20:44:56.288 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-10T20:44:56.288 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-10T20:44:56.288 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-10T20:44:56.288 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-10T20:44:56.289 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:56.289 DEBUG:teuthology.orchestra.run.smithi154:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-10T20:44:56.311 INFO:teuthology.orchestra.run.smithi154.stdout:postinstall scriptlet (using /bin/sh): 2023-10-10T20:44:56.312 INFO:teuthology.orchestra.run.smithi154.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-10T20:44:56.312 INFO:teuthology.orchestra.run.smithi154.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-10T20:44:56.312 INFO:teuthology.orchestra.run.smithi154.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-10T20:44:56.312 INFO:teuthology.orchestra.run.smithi154.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:56.312 INFO:teuthology.orchestra.run.smithi154.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-10T20:44:56.313 INFO:teuthology.orchestra.run.smithi154.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-10T20:44:56.313 INFO:teuthology.orchestra.run.smithi154.stdout:fi 2023-10-10T20:44:56.313 INFO:teuthology.orchestra.run.smithi154.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-10T20:44:56.313 INFO:teuthology.orchestra.run.smithi154.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-10T20:44:56.313 INFO:teuthology.orchestra.run.smithi154.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-10T20:44:56.314 INFO:teuthology.orchestra.run.smithi154.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-10T20:44:56.314 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:56.314 INFO:teuthology.orchestra.run.smithi154.stdout:fi 2023-10-10T20:44:56.314 INFO:teuthology.orchestra.run.smithi154.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-10T20:44:56.314 INFO:teuthology.orchestra.run.smithi154.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-10T20:44:56.315 INFO:teuthology.orchestra.run.smithi154.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:56.315 INFO:teuthology.orchestra.run.smithi154.stdout:fi 2023-10-10T20:44:56.316 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -qi grub2-tools 2023-10-10T20:44:56.389 INFO:teuthology.orchestra.run.smithi154.stdout:Name : grub2-tools 2023-10-10T20:44:56.389 INFO:teuthology.orchestra.run.smithi154.stdout:Epoch : 1 2023-10-10T20:44:56.389 INFO:teuthology.orchestra.run.smithi154.stdout:Version : 2.02 2023-10-10T20:44:56.390 INFO:teuthology.orchestra.run.smithi154.stdout:Release : 99.el8_4.1 2023-10-10T20:44:56.390 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: x86_64 2023-10-10T20:44:56.391 INFO:teuthology.orchestra.run.smithi154.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-10T20:44:56.391 INFO:teuthology.orchestra.run.smithi154.stdout:Group : System Environment/Base 2023-10-10T20:44:56.391 INFO:teuthology.orchestra.run.smithi154.stdout:Size : 9264631 2023-10-10T20:44:56.391 INFO:teuthology.orchestra.run.smithi154.stdout:License : GPLv3+ 2023-10-10T20:44:56.392 INFO:teuthology.orchestra.run.smithi154.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-10T20:44:56.392 INFO:teuthology.orchestra.run.smithi154.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-10T20:44:56.392 INFO:teuthology.orchestra.run.smithi154.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-10T20:44:56.392 INFO:teuthology.orchestra.run.smithi154.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-10T20:44:56.392 INFO:teuthology.orchestra.run.smithi154.stdout:Relocations : (not relocatable) 2023-10-10T20:44:56.393 INFO:teuthology.orchestra.run.smithi154.stdout:Packager : Red Hat, Inc. 2023-10-10T20:44:56.393 INFO:teuthology.orchestra.run.smithi154.stdout:Vendor : Red Hat, Inc. 2023-10-10T20:44:56.393 INFO:teuthology.orchestra.run.smithi154.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-10T20:44:56.393 INFO:teuthology.orchestra.run.smithi154.stdout:Summary : Support tools for GRUB. 2023-10-10T20:44:56.394 INFO:teuthology.orchestra.run.smithi154.stdout:Description : 2023-10-10T20:44:56.394 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T20:44:56.394 INFO:teuthology.orchestra.run.smithi154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-10T20:44:56.394 INFO:teuthology.orchestra.run.smithi154.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-10T20:44:56.395 INFO:teuthology.orchestra.run.smithi154.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-10T20:44:56.395 INFO:teuthology.orchestra.run.smithi154.stdout:hardware devices. 2023-10-10T20:44:56.395 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T20:44:56.395 INFO:teuthology.orchestra.run.smithi154.stdout:This subpackage provides tools for support of all platforms. 2023-10-10T20:44:56.396 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-10T20:44:56.397 INFO:teuthology.task.kernel:Updating grub on smithi154 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:44:56.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-10T20:45:00.930 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2023-10-10T20:45:03.147 INFO:teuthology.orchestra.run.smithi154.stderr:done 2023-10-10T20:45:03.148 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-10-10T20:45:03.162 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.lNTL5drlf7 2023-10-10T20:45:03.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lNTL5drlf7 2023-10-10T20:45:03.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.lNTL5drlf7 2023-10-10T20:45:03.402 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.lNTL5drlf7 is 6KB 2023-10-10T20:45:03.451 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.lNTL5drlf7 2023-10-10T20:45:03.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo /bin/ls /boot/loader/entries || true 2023-10-10T20:45:03.526 INFO:teuthology.orchestra.run.smithi154.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-10T20:45:03.526 INFO:teuthology.orchestra.run.smithi154.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-10T20:45:03.526 INFO:teuthology.orchestra.run.smithi154.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-10T20:45:03.526 INFO:teuthology.orchestra.run.smithi154.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-10T20:45:03.527 INFO:teuthology.orchestra.run.smithi154.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-10T20:45:03.528 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-10T20:45:03.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2023-10-10T20:45:22.398 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-10T20:45:22.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-10T20:45:22.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:45:33.718 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-10T20:45:33.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-10T20:45:33.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:45:40.858 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-10T20:45:49.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-10T20:45:49.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:45:52.922 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-10T20:46:04.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-10T20:46:04.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:46:08.250 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-10T20:46:17.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-10T20:46:17.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:46:23.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-10T20:46:38.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-10T20:46:38.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:46:38.962 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-10T20:46:39.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-10T20:46:39.403 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-10T20:46:39.403 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-10-10T20:46:39.438 INFO:teuthology.orchestra.run.smithi179.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-10T20:46:39.439 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:46:39.439 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-10T20:46:39.439 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-10T20:46:40.440 DEBUG:teuthology.parallel:result is None 2023-10-10T20:47:17.262 DEBUG:teuthology.orchestra.remote:timed out 2023-10-10T20:47:29.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-10T20:47:29.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:47:29.661 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-10-10T20:47:30.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-10T20:47:30.064 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-10T20:47:30.064 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-10-10T20:47:30.100 INFO:teuthology.orchestra.run.smithi154.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-10T20:47:30.100 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-10T20:47:30.100 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-10T20:47:30.101 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-10T20:47:31.102 DEBUG:teuthology.parallel:result is None 2023-10-10T20:47:31.103 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-10T20:47:31.113 INFO:teuthology.task.internal:Creating test directory... 2023-10-10T20:47:31.113 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-10T20:47:31.119 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-10T20:47:31.163 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-10T20:47:31.241 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-10T20:47:31.261 INFO:teuthology.task.internal:Creating archive directory... 2023-10-10T20:47:31.262 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-10T20:47:31.266 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-10T20:47:31.367 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-10T20:47:31.374 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-10T20:47:31.375 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-10T20:47:31.380 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-10T20:47:31.509 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-10T20:47:31.535 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-10T20:47:31.570 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-10T20:47:31.571 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-10T20:47:31.574 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-10T20:47:31.581 INFO:teuthology.task.internal:Configuring sudo... 2023-10-10T20:47:31.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-10T20:47:31.586 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-10T20:47:31.647 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-10T20:47:31.658 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-10T20:47:31.659 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-10T20:47:31.663 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-10T20:47:31.699 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-10T20:47:31.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-10T20:47:31.894 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-10T20:47:31.957 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-10T20:47:32.034 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T20:47:32.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-10T20:47:32.096 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-10T20:47:32.160 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-10T20:47:32.254 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-10T20:47:32.319 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-10T20:47:32.393 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T20:47:32.394 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-10T20:47:32.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2023-10-10T20:47:32.466 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2023-10-10T20:47:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-10T20:47:32.630 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-10T20:47:33.071 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-10T20:47:33.079 INFO:teuthology.task.internal:Starting timer... 2023-10-10T20:47:33.080 INFO:teuthology.run_tasks:Running task pcp... 2023-10-10T20:47:33.134 INFO:teuthology.run_tasks:Running task selinux... 2023-10-10T20:47:33.182 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-10T20:47:33.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2023-10-10T20:47:33.298 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: [ OK ] 2023-10-10T20:47:33.301 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2023-10-10T20:47:33.445 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: [ OK ] 2023-10-10T20:47:33.449 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-10T20:47:33.449 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2023-10-10T20:47:33.487 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2023-10-10T20:47:33.488 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2023-10-10T20:47:33.530 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2023-10-10T20:47:33.530 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2023-10-10T20:47:33.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-10T20:47:33.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T20:47:33.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-10T20:47:33.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T20:47:33.660 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-10T20:47:33.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2023-10-10T20:47:33.724 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2023-10-10T20:47:33.787 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-10T20:47:33.797 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-10T20:47:33.798 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-10T20:47:33.814 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-10T20:47:33.815 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi154.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-10T20:58:52.168 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2023-10-10T20:58:52.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-10T20:58:52.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:58:52.259 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-10-10T20:58:52.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-10T20:58:52.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-10T20:58:52.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T20:58:52.462 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-10T20:58:52.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-10T20:58:52.565 INFO:teuthology.run_tasks:Running task clock... 2023-10-10T20:58:52.575 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-10T20:58:52.576 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-10T20:58:52.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-10T20:58:52.581 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-10T20:58:52.581 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-10T20:58:52.644 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-10T20:58:52.671 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-10T20:58:52.678 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-10T20:58:52.705 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-10T20:58:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2023-10-10T20:58:52.764 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2023-10-10T20:58:52.764 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2023-10-10T20:58:52.790 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2023-10-10T20:58:52.797 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-10T20:58:52.823 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-10T20:58:52.831 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-10T20:58:52.857 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-10T20:58:52.918 INFO:teuthology.orchestra.run.smithi154.stderr:bash: ntpq: command not found 2023-10-10T20:58:52.923 INFO:teuthology.orchestra.run.smithi154.stdout:210 Number of sources = 4 2023-10-10T20:58:52.923 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-10T20:58:52.923 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2023-10-10T20:58:52.923 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T20:58:52.924 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T20:58:52.924 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T20:58:52.924 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T20:58:52.945 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2023-10-10T20:58:52.950 INFO:teuthology.orchestra.run.smithi179.stdout:210 Number of sources = 4 2023-10-10T20:58:52.950 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-10T20:58:52.951 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2023-10-10T20:58:52.951 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T20:58:52.951 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T20:58:52.951 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T20:58:52.951 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T20:58:52.952 INFO:teuthology.run_tasks:Running task install... 2023-10-10T20:58:52.961 DEBUG:teuthology.task.install:project ceph 2023-10-10T20:58:52.961 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7'}} 2023-10-10T20:58:52.962 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7'} 2023-10-10T20:58:52.962 INFO:teuthology.task.install:Using flavor: default 2023-10-10T20:58:52.972 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-10T20:58:52.973 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-10T20:58:52.973 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7', 'tag': None, 'wait_for_package': False} 2023-10-10T20:58:52.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=46d1f59b549730ba7f93d940a3d32b94c45a4cf7 2023-10-10T20:58:52.976 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7', 'tag': None, 'wait_for_package': False} 2023-10-10T20:58:52.976 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=46d1f59b549730ba7f93d940a3d32b94c45a4cf7 2023-10-10T20:58:53.121 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-10-0720-quincy/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/centos/8/flavors/default/ 2023-10-10T20:58:53.121 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1374.g46d1f59b 2023-10-10T20:58:53.126 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-10-0720-quincy/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/centos/8/flavors/default/ 2023-10-10T20:58:53.126 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1374.g46d1f59b 2023-10-10T20:58:53.230 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-10-0720-quincy/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-10-0720-quincy/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-10-0720-quincy/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-10T20:58:53.230 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T20:58:53.230 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-10T20:58:53.286 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-10-0720-quincy/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-10-0720-quincy/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-10-0720-quincy/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-10T20:58:53.286 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T20:58:53.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-10T20:58:53.293 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-10T20:58:53.294 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-10T20:58:53.350 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-10T20:58:53.350 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/46d1f59b549730ba7f93d940a3d32b94c45a4cf7/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-10T20:58:53.395 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-10T20:58:53.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-10T20:58:53.483 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-10T20:58:53.541 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-10T20:58:53.544 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2023-10-10T20:58:53.547 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2023-10-10T20:58:53.602 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2023-10-10T20:58:53.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2023-10-10T20:58:54.009 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-10T20:58:54.064 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-10-10T20:58:54.358 INFO:teuthology.orchestra.run.smithi179.stdout:44 files removed 2023-10-10T20:58:54.401 INFO:teuthology.orchestra.run.smithi154.stdout:44 files removed 2023-10-10T20:58:54.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-10T20:58:54.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-10T20:58:54.875 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-10T20:58:54.919 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-10-10T20:58:55.781 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 201 kB/s | 78 kB 00:00 2023-10-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 134 kB/s | 78 kB 00:00 2023-10-10T20:58:56.153 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 28 kB/s | 9.2 kB 00:00 2023-10-10T20:58:56.499 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2023-10-10T20:58:56.506 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 21 kB/s | 9.2 kB 00:00 2023-10-10T20:58:56.726 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-10T20:58:56.902 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 4.0 kB/s | 1.4 kB 00:00 2023-10-10T20:58:57.159 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-10-10T20:58:57.698 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 31 MB/s | 16 MB 00:00 2023-10-10T20:58:58.447 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 16 MB 00:01 2023-10-10T20:59:01.229 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 567 kB/s | 24 kB 00:00 2023-10-10T20:59:01.793 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 MB/s | 38 MB 00:00 2023-10-10T20:59:01.922 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-10T20:59:02.391 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 85 MB/s | 33 MB 00:00 2023-10-10T20:59:07.763 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 80 MB/s | 33 MB 00:00 2023-10-10T20:59:07.885 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 MB/s | 38 MB 00:00 2023-10-10T20:59:16.189 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-10T20:59:16.190 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-10T20:59:16.201 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-10T20:59:16.201 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-10T20:59:16.202 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-10T20:59:16.203 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-10T20:59:16.205 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-10T20:59:16.207 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-10T20:59:16.208 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-10T20:59:16.666 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-10T20:59:16.667 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-10T20:59:16.678 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-10T20:59:16.679 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-10T20:59:16.682 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-10T20:59:16.682 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-10T20:59:16.683 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-10T20:59:16.685 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-10T20:59:16.686 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-10T20:59:16.705 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-10-10T20:59:16.717 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================================================== 2023-10-10T20:59:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-10-10T20:59:16.717 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================================================== 2023-10-10T20:59:16.718 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-10-10T20:59:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-10T20:59:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 6.4 k 2023-10-10T20:59:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 5.2 M 2023-10-10T20:59:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 876 k 2023-10-10T20:59:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 161 k 2023-10-10T20:59:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 1.6 M 2023-10-10T20:59:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 121 k 2023-10-10T20:59:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 1.7 M 2023-10-10T20:59:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 7.4 M 2023-10-10T20:59:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 47 k 2023-10-10T20:59:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 17 M 2023-10-10T20:59:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 52 M 2023-10-10T20:59:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 267 k 2023-10-10T20:59:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 80 k 2023-10-10T20:59:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 255 k 2023-10-10T20:59:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 18 k 2023-10-10T20:59:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-10T20:59:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-10T20:59:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-10T20:59:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 25 k 2023-10-10T20:59:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 797 k 2023-10-10T20:59:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 130 k 2023-10-10T20:59:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-10T20:59:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-10T20:59:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-10T20:59:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 190 k 2023-10-10T20:59:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 371 k 2023-10-10T20:59:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 358 k 2023-10-10T20:59:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 107 k 2023-10-10T20:59:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 90 k 2023-10-10T20:59:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 3.5 M 2023-10-10T20:59:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 173 k 2023-10-10T20:59:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-10T20:59:16.724 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2023-10-10T20:59:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 3.5 M 2023-10-10T20:59:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 3.6 M 2023-10-10T20:59:16.725 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-10-10T20:59:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-10T20:59:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 23 M 2023-10-10T20:59:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 23 k 2023-10-10T20:59:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 2.3 M 2023-10-10T20:59:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 238 k 2023-10-10T20:59:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 3.9 M 2023-10-10T20:59:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 17 M 2023-10-10T20:59:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 14 k 2023-10-10T20:59:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 24 k 2023-10-10T20:59:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-10T20:59:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-10T20:59:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-10T20:59:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-10T20:59:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-10T20:59:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 174 k 2023-10-10T20:59:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-10T20:59:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-10T20:59:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-10T20:59:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-10T20:59:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-10T20:59:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 507 k 2023-10-10T20:59:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-10T20:59:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 5.6 M 2023-10-10T20:59:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-10T20:59:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-10T20:59:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-10T20:59:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-10T20:59:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-10T20:59:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-10T20:59:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-10T20:59:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-10T20:59:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-10T20:59:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-10T20:59:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-10T20:59:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-10T20:59:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-10T20:59:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-10T20:59:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-10T20:59:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-10T20:59:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 45 k 2023-10-10T20:59:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 115 k 2023-10-10T20:59:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-10T20:59:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-10T20:59:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-10T20:59:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-10T20:59:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-10T20:59:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-10T20:59:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-10T20:59:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-10T20:59:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-10T20:59:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-10T20:59:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-10T20:59:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-10T20:59:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-10T20:59:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-10T20:59:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-10T20:59:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-10T20:59:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-10T20:59:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-10T20:59:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-10T20:59:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-10T20:59:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-10T20:59:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-10T20:59:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-10T20:59:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-10T20:59:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-10T20:59:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-10T20:59:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-10T20:59:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-10T20:59:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-10T20:59:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-10T20:59:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-10T20:59:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-10T20:59:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-10T20:59:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-10T20:59:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-10T20:59:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-10T20:59:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-10T20:59:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-10T20:59:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-10T20:59:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-10T20:59:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-10T20:59:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-10T20:59:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-10T20:59:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-10T20:59:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T20:59:16.745 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-10-10T20:59:16.745 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================================================== 2023-10-10T20:59:16.746 INFO:teuthology.orchestra.run.smithi154.stdout:Install 118 Packages 2023-10-10T20:59:16.746 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 2 Packages 2023-10-10T20:59:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T20:59:16.748 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 202 M 2023-10-10T20:59:16.748 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-10-10T20:59:16.862 INFO:teuthology.orchestra.run.smithi154.stdout:(1/120): ceph-17.2.6-1374.g46d1f59b.el8.x86_64. 71 kB/s | 6.4 kB 00:00 2023-10-10T20:59:17.011 INFO:teuthology.orchestra.run.smithi154.stdout:(2/120): ceph-fuse-17.2.6-1374.g46d1f59b.el8.x8 5.8 MB/s | 876 kB 00:00 2023-10-10T20:59:17.033 INFO:teuthology.orchestra.run.smithi154.stdout:(3/120): ceph-immutable-object-cache-17.2.6-137 7.0 MB/s | 161 kB 00:00 2023-10-10T20:59:17.157 INFO:teuthology.orchestra.run.smithi154.stdout:(4/120): ceph-mds-17.2.6-1374.g46d1f59b.el8.x86 19 MB/s | 2.3 MB 00:00 2023-10-10T20:59:17.182 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-10-10T20:59:17.194 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================================================== 2023-10-10T20:59:17.194 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2023-10-10T20:59:17.195 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================================================== 2023-10-10T20:59:17.195 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2023-10-10T20:59:17.195 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-10T20:59:17.195 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 6.4 k 2023-10-10T20:59:17.196 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 5.2 M 2023-10-10T20:59:17.196 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 876 k 2023-10-10T20:59:17.196 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 161 k 2023-10-10T20:59:17.196 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 1.6 M 2023-10-10T20:59:17.196 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 121 k 2023-10-10T20:59:17.196 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 1.7 M 2023-10-10T20:59:17.197 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 7.4 M 2023-10-10T20:59:17.197 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 47 k 2023-10-10T20:59:17.197 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 17 M 2023-10-10T20:59:17.197 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 52 M 2023-10-10T20:59:17.197 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 267 k 2023-10-10T20:59:17.198 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 80 k 2023-10-10T20:59:17.198 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 255 k 2023-10-10T20:59:17.198 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 18 k 2023-10-10T20:59:17.198 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-10T20:59:17.198 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-10T20:59:17.199 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-10T20:59:17.199 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 25 k 2023-10-10T20:59:17.199 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 797 k 2023-10-10T20:59:17.199 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 130 k 2023-10-10T20:59:17.199 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-10T20:59:17.200 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-10T20:59:17.200 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-10T20:59:17.200 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 190 k 2023-10-10T20:59:17.200 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 371 k 2023-10-10T20:59:17.200 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 358 k 2023-10-10T20:59:17.201 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 107 k 2023-10-10T20:59:17.201 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 90 k 2023-10-10T20:59:17.201 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 3.5 M 2023-10-10T20:59:17.202 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 173 k 2023-10-10T20:59:17.202 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-10T20:59:17.202 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2023-10-10T20:59:17.202 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 3.5 M 2023-10-10T20:59:17.202 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 3.6 M 2023-10-10T20:59:17.203 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2023-10-10T20:59:17.203 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-10T20:59:17.203 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 23 M 2023-10-10T20:59:17.203 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 23 k 2023-10-10T20:59:17.203 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 2.3 M 2023-10-10T20:59:17.204 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 238 k 2023-10-10T20:59:17.204 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 3.9 M 2023-10-10T20:59:17.204 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 17 M 2023-10-10T20:59:17.204 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1374.g46d1f59b.el8 ceph-noarch 14 k 2023-10-10T20:59:17.204 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 24 k 2023-10-10T20:59:17.205 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-10T20:59:17.205 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-10T20:59:17.205 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-10T20:59:17.205 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-10T20:59:17.205 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-10T20:59:17.205 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 174 k 2023-10-10T20:59:17.206 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-10T20:59:17.206 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-10T20:59:17.206 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-10T20:59:17.206 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-10T20:59:17.206 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-10T20:59:17.207 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 507 k 2023-10-10T20:59:17.207 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-10T20:59:17.207 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 5.6 M 2023-10-10T20:59:17.207 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-10T20:59:17.207 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-10T20:59:17.208 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-10T20:59:17.208 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-10T20:59:17.208 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-10T20:59:17.208 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-10T20:59:17.208 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-10T20:59:17.209 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-10T20:59:17.209 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-10T20:59:17.209 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-10T20:59:17.209 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-10T20:59:17.209 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-10T20:59:17.210 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-10T20:59:17.210 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-10T20:59:17.210 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-10T20:59:17.210 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-10T20:59:17.210 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 45 k 2023-10-10T20:59:17.211 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:17.2.6-1374.g46d1f59b.el8 ceph 115 k 2023-10-10T20:59:17.211 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-10T20:59:17.211 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-10T20:59:17.211 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-10T20:59:17.211 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-10T20:59:17.212 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-10T20:59:17.212 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-10T20:59:17.212 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-10T20:59:17.212 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-10T20:59:17.212 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-10T20:59:17.213 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-10T20:59:17.213 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-10T20:59:17.213 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-10T20:59:17.213 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-10T20:59:17.213 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-10T20:59:17.213 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-10T20:59:17.214 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-10T20:59:17.214 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-10T20:59:17.214 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-10T20:59:17.214 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-10T20:59:17.214 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-10T20:59:17.215 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-10T20:59:17.215 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-10T20:59:17.215 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-10T20:59:17.215 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-10T20:59:17.215 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-10T20:59:17.216 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-10T20:59:17.216 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-10T20:59:17.216 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-10T20:59:17.216 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-10T20:59:17.216 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-10T20:59:17.217 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-10T20:59:17.217 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-10T20:59:17.217 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-10T20:59:17.217 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-10T20:59:17.217 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-10T20:59:17.218 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-10T20:59:17.218 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-10T20:59:17.218 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-10T20:59:17.218 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-10T20:59:17.218 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-10T20:59:17.219 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-10T20:59:17.219 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-10T20:59:17.219 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-10T20:59:17.219 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-10T20:59:17.219 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T20:59:17.219 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2023-10-10T20:59:17.220 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================================================== 2023-10-10T20:59:17.220 INFO:teuthology.orchestra.run.smithi179.stdout:Install 118 Packages 2023-10-10T20:59:17.220 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 2 Packages 2023-10-10T20:59:17.220 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T20:59:17.221 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 202 M 2023-10-10T20:59:17.221 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2023-10-10T20:59:17.249 INFO:teuthology.orchestra.run.smithi154.stdout:(5/120): ceph-mgr-17.2.6-1374.g46d1f59b.el8.x86 17 MB/s | 1.6 MB 00:00 2023-10-10T20:59:17.469 INFO:teuthology.orchestra.run.smithi154.stdout:(6/120): ceph-mon-17.2.6-1374.g46d1f59b.el8.x86 18 MB/s | 3.9 MB 00:00 2023-10-10T20:59:17.579 INFO:teuthology.orchestra.run.smithi179.stdout:(1/120): ceph-17.2.6-1374.g46d1f59b.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-10-10T20:59:17.851 INFO:teuthology.orchestra.run.smithi154.stdout:(7/120): ceph-base-17.2.6-1374.g46d1f59b.el8.x8 4.8 MB/s | 5.2 MB 00:01 2023-10-10T20:59:18.595 INFO:teuthology.orchestra.run.smithi179.stdout:(2/120): ceph-fuse-17.2.6-1374.g46d1f59b.el8.x8 863 kB/s | 876 kB 00:01 2023-10-10T20:59:18.640 INFO:teuthology.orchestra.run.smithi154.stdout:(8/120): ceph-osd-17.2.6-1374.g46d1f59b.el8.x86 14 MB/s | 17 MB 00:01 2023-10-10T20:59:18.689 INFO:teuthology.orchestra.run.smithi154.stdout:(9/120): ceph-selinux-17.2.6-1374.g46d1f59b.el8 492 kB/s | 24 kB 00:00 2023-10-10T20:59:18.717 INFO:teuthology.orchestra.run.smithi179.stdout:(3/120): ceph-immutable-object-cache-17.2.6-137 1.3 MB/s | 161 kB 00:00 2023-10-10T20:59:19.623 INFO:teuthology.orchestra.run.smithi154.stdout:(10/120): ceph-radosgw-17.2.6-1374.g46d1f59b.el 9.5 MB/s | 17 MB 00:01 2023-10-10T20:59:19.720 INFO:teuthology.orchestra.run.smithi154.stdout:(11/120): cephfs-mirror-17.2.6-1374.g46d1f59b.e 2.6 MB/s | 255 kB 00:00 2023-10-10T20:59:19.799 INFO:teuthology.orchestra.run.smithi154.stdout:(12/120): libcephfs-devel-17.2.6-1374.g46d1f59b 315 kB/s | 25 kB 00:00 2023-10-10T20:59:19.829 INFO:teuthology.orchestra.run.smithi179.stdout:(4/120): ceph-mds-17.2.6-1374.g46d1f59b.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-10-10T20:59:19.906 INFO:teuthology.orchestra.run.smithi154.stdout:(13/120): libcephfs2-17.2.6-1374.g46d1f59b.el8. 7.3 MB/s | 797 kB 00:00 2023-10-10T20:59:19.985 INFO:teuthology.orchestra.run.smithi154.stdout:(14/120): libcephsqlite-17.2.6-1374.g46d1f59b.e 2.2 MB/s | 174 kB 00:00 2023-10-10T20:59:20.004 INFO:teuthology.orchestra.run.smithi179.stdout:(5/120): ceph-base-17.2.6-1374.g46d1f59b.el8.x8 1.9 MB/s | 5.2 MB 00:02 2023-10-10T20:59:20.044 INFO:teuthology.orchestra.run.smithi154.stdout:(15/120): librados-devel-17.2.6-1374.g46d1f59b. 2.1 MB/s | 130 kB 00:00 2023-10-10T20:59:20.135 INFO:teuthology.orchestra.run.smithi154.stdout:(16/120): libradosstriper1-17.2.6-1374.g46d1f59 5.5 MB/s | 507 kB 00:00 2023-10-10T20:59:20.634 INFO:teuthology.orchestra.run.smithi179.stdout:(6/120): ceph-mgr-17.2.6-1374.g46d1f59b.el8.x86 2.0 MB/s | 1.6 MB 00:00 2023-10-10T20:59:20.786 INFO:teuthology.orchestra.run.smithi154.stdout:(17/120): librgw2-17.2.6-1374.g46d1f59b.el8.x86 8.5 MB/s | 5.6 MB 00:00 2023-10-10T20:59:20.860 INFO:teuthology.orchestra.run.smithi154.stdout:(18/120): python3-ceph-argparse-17.2.6-1374.g46 607 kB/s | 45 kB 00:00 2023-10-10T20:59:20.941 INFO:teuthology.orchestra.run.smithi154.stdout:(19/120): python3-ceph-common-17.2.6-1374.g46d1 1.4 MB/s | 115 kB 00:00 2023-10-10T20:59:21.023 INFO:teuthology.orchestra.run.smithi179.stdout:(7/120): ceph-mon-17.2.6-1374.g46d1f59b.el8.x86 3.9 MB/s | 3.9 MB 00:01 2023-10-10T20:59:21.028 INFO:teuthology.orchestra.run.smithi154.stdout:(20/120): python3-cephfs-17.2.6-1374.g46d1f59b. 2.2 MB/s | 190 kB 00:00 2023-10-10T20:59:21.126 INFO:teuthology.orchestra.run.smithi154.stdout:(21/120): python3-rados-17.2.6-1374.g46d1f59b.e 3.7 MB/s | 371 kB 00:00 2023-10-10T20:59:21.224 INFO:teuthology.orchestra.run.smithi154.stdout:(22/120): python3-rbd-17.2.6-1374.g46d1f59b.el8 3.6 MB/s | 358 kB 00:00 2023-10-10T20:59:21.315 INFO:teuthology.orchestra.run.smithi154.stdout:(23/120): python3-rgw-17.2.6-1374.g46d1f59b.el8 1.1 MB/s | 107 kB 00:00 2023-10-10T20:59:21.408 INFO:teuthology.orchestra.run.smithi154.stdout:(24/120): rbd-fuse-17.2.6-1374.g46d1f59b.el8.x8 985 kB/s | 90 kB 00:00 2023-10-10T20:59:21.856 INFO:teuthology.orchestra.run.smithi154.stdout:(25/120): rbd-mirror-17.2.6-1374.g46d1f59b.el8. 7.7 MB/s | 3.5 MB 00:00 2023-10-10T20:59:21.935 INFO:teuthology.orchestra.run.smithi154.stdout:(26/120): rbd-nbd-17.2.6-1374.g46d1f59b.el8.x86 2.1 MB/s | 173 kB 00:00 2023-10-10T20:59:22.013 INFO:teuthology.orchestra.run.smithi154.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1374.g 298 kB/s | 23 kB 00:00 2023-10-10T20:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1374.g46d1f59 1.4 MB/s | 121 kB 00:00 2023-10-10T20:59:22.348 INFO:teuthology.orchestra.run.smithi154.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1374.g46d1f 6.8 MB/s | 1.7 MB 00:00 2023-10-10T20:59:23.144 INFO:teuthology.orchestra.run.smithi154.stdout:(30/120): ceph-mgr-diskprediction-local-17.2.6- 9.3 MB/s | 7.4 MB 00:00 2023-10-10T20:59:23.222 INFO:teuthology.orchestra.run.smithi154.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1374.g46 3.0 MB/s | 238 kB 00:00 2023-10-10T20:59:23.298 INFO:teuthology.orchestra.run.smithi154.stdout:(32/120): ceph-mgr-rook-17.2.6-1374.g46d1f59b.e 630 kB/s | 47 kB 00:00 2023-10-10T20:59:23.384 INFO:teuthology.orchestra.run.smithi154.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1374.g4 169 kB/s | 14 kB 00:00 2023-10-10T20:59:23.499 INFO:teuthology.orchestra.run.smithi154.stdout:(34/120): ceph-volume-17.2.6-1374.g46d1f59b.el8 2.3 MB/s | 267 kB 00:00 2023-10-10T20:59:23.615 INFO:teuthology.orchestra.run.smithi154.stdout:(35/120): cephadm-17.2.6-1374.g46d1f59b.el8.noa 696 kB/s | 80 kB 00:00 2023-10-10T20:59:23.716 INFO:teuthology.orchestra.run.smithi154.stdout:(36/120): cephfs-top-17.2.6-1374.g46d1f59b.el8. 180 kB/s | 18 kB 00:00 2023-10-10T20:59:23.962 INFO:teuthology.orchestra.run.smithi154.stdout:(37/120): ceph-common-17.2.6-1374.g46d1f59b.el8 3.3 MB/s | 23 MB 00:07 2023-10-10T20:59:24.470 INFO:teuthology.orchestra.run.smithi154.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 116 kB/s | 59 kB 00:00 2023-10-10T20:59:24.480 INFO:teuthology.orchestra.run.smithi154.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 400 kB/s | 306 kB 00:00 2023-10-10T20:59:24.632 INFO:teuthology.orchestra.run.smithi154.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 460 kB/s | 75 kB 00:00 2023-10-10T20:59:24.695 INFO:teuthology.orchestra.run.smithi179.stdout:(8/120): ceph-radosgw-17.2.6-1374.g46d1f59b.el8 4.6 MB/s | 17 MB 00:03 2023-10-10T20:59:24.773 INFO:teuthology.orchestra.run.smithi179.stdout:(9/120): ceph-common-17.2.6-1374.g46d1f59b.el8. 3.1 MB/s | 23 MB 00:07 2023-10-10T20:59:24.774 INFO:teuthology.orchestra.run.smithi179.stdout:(10/120): ceph-selinux-17.2.6-1374.g46d1f59b.el 310 kB/s | 24 kB 00:00 2023-10-10T20:59:24.804 INFO:teuthology.orchestra.run.smithi179.stdout:(11/120): cephfs-mirror-17.2.6-1374.g46d1f59b.e 8.3 MB/s | 255 kB 00:00 2023-10-10T20:59:24.846 INFO:teuthology.orchestra.run.smithi179.stdout:(12/120): libcephfs-devel-17.2.6-1374.g46d1f59b 592 kB/s | 25 kB 00:00 2023-10-10T20:59:24.855 INFO:teuthology.orchestra.run.smithi154.stdout:(41/120): ceph-test-17.2.6-1374.g46d1f59b.el8.x 8.4 MB/s | 52 MB 00:06 2023-10-10T20:59:24.856 INFO:teuthology.orchestra.run.smithi154.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 194 kB/s | 44 kB 00:00 2023-10-10T20:59:24.859 INFO:teuthology.orchestra.run.smithi154.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2023-10-10T20:59:24.957 INFO:teuthology.orchestra.run.smithi154.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 167 kB/s | 16 kB 00:00 2023-10-10T20:59:24.979 INFO:teuthology.orchestra.run.smithi154.stdout:(45/120): python3-cachetools-3.1.1-4.el8.noarch 271 kB/s | 33 kB 00:00 2023-10-10T20:59:25.023 INFO:teuthology.orchestra.run.smithi179.stdout:(13/120): libcephfs2-17.2.6-1374.g46d1f59b.el8. 4.4 MB/s | 797 kB 00:00 2023-10-10T20:59:25.075 INFO:teuthology.orchestra.run.smithi154.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-10-10T20:59:25.080 INFO:teuthology.orchestra.run.smithi179.stdout:(14/120): libcephsqlite-17.2.6-1374.g46d1f59b.e 3.0 MB/s | 174 kB 00:00 2023-10-10T20:59:25.135 INFO:teuthology.orchestra.run.smithi179.stdout:(15/120): librados-devel-17.2.6-1374.g46d1f59b. 2.3 MB/s | 130 kB 00:00 2023-10-10T20:59:25.180 INFO:teuthology.orchestra.run.smithi154.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 778 kB/s | 81 kB 00:00 2023-10-10T20:59:25.263 INFO:teuthology.orchestra.run.smithi179.stdout:(16/120): libradosstriper1-17.2.6-1374.g46d1f59 3.9 MB/s | 507 kB 00:00 2023-10-10T20:59:25.278 INFO:teuthology.orchestra.run.smithi154.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 114 kB/s | 11 kB 00:00 2023-10-10T20:59:25.306 INFO:teuthology.orchestra.run.smithi154.stdout:(49/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.1 MB/s | 384 kB 00:00 2023-10-10T20:59:25.376 INFO:teuthology.orchestra.run.smithi154.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 179 kB/s | 18 kB 00:00 2023-10-10T20:59:25.478 INFO:teuthology.orchestra.run.smithi154.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 480 kB/s | 49 kB 00:00 2023-10-10T20:59:25.486 INFO:teuthology.orchestra.run.smithi154.stdout:(52/120): python3-beautifulsoup4-4.6.3-2.el8.1. 294 kB/s | 185 kB 00:00 2023-10-10T20:59:25.580 INFO:teuthology.orchestra.run.smithi154.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 576 kB/s | 59 kB 00:00 2023-10-10T20:59:25.601 INFO:teuthology.orchestra.run.smithi154.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 523 kB/s | 60 kB 00:00 2023-10-10T20:59:25.613 INFO:teuthology.orchestra.run.smithi154.stdout:(55/120): python3-kubernetes-11.0.0-6.el8.noarc 3.8 MB/s | 1.2 MB 00:00 2023-10-10T20:59:25.700 INFO:teuthology.orchestra.run.smithi154.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 159 kB/s | 16 kB 00:00 2023-10-10T20:59:25.706 INFO:teuthology.orchestra.run.smithi154.stdout:(57/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-10-10T20:59:25.712 INFO:teuthology.orchestra.run.smithi154.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 339 kB/s | 34 kB 00:00 2023-10-10T20:59:25.809 INFO:teuthology.orchestra.run.smithi154.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 624 kB/s | 64 kB 00:00 2023-10-10T20:59:25.811 INFO:teuthology.orchestra.run.smithi154.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 189 kB/s | 19 kB 00:00 2023-10-10T20:59:25.864 INFO:teuthology.orchestra.run.smithi154.stdout:(61/120): python3-routes-2.4.1-12.el8.noarch.rp 1.2 MB/s | 196 kB 00:00 2023-10-10T20:59:25.908 INFO:teuthology.orchestra.run.smithi154.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 244 kB/s | 24 kB 00:00 2023-10-10T20:59:25.911 INFO:teuthology.orchestra.run.smithi154.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 295 kB/s | 29 kB 00:00 2023-10-10T20:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 272 kB/s | 27 kB 00:00 2023-10-10T20:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.2 MB/s | 251 kB 00:00 2023-10-10T20:59:26.031 INFO:teuthology.orchestra.run.smithi154.stdout:(66/120): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-10-10T20:59:26.077 INFO:teuthology.orchestra.run.smithi154.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 551 kB/s | 61 kB 00:00 2023-10-10T20:59:26.125 INFO:teuthology.orchestra.run.smithi154.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 836 kB/s | 85 kB 00:00 2023-10-10T20:59:26.129 INFO:teuthology.orchestra.run.smithi154.stdout:(69/120): python3-zc-lockfile-2.0-2.el8.noarch. 234 kB/s | 23 kB 00:00 2023-10-10T20:59:26.131 INFO:teuthology.orchestra.run.smithi154.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 13 MB/s | 70 kB 00:00 2023-10-10T20:59:26.163 INFO:teuthology.orchestra.run.smithi154.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2023-10-10T20:59:26.167 INFO:teuthology.orchestra.run.smithi154.stdout:(72/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 509 kB/s | 19 kB 00:00 2023-10-10T20:59:26.184 INFO:teuthology.orchestra.run.smithi154.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 7.3 MB/s | 155 kB 00:00 2023-10-10T20:59:26.187 INFO:teuthology.orchestra.run.smithi154.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 11 MB/s | 220 kB 00:00 2023-10-10T20:59:26.201 INFO:teuthology.orchestra.run.smithi154.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.9 MB/s | 48 kB 00:00 2023-10-10T20:59:26.208 INFO:teuthology.orchestra.run.smithi154.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 11 MB/s | 229 kB 00:00 2023-10-10T20:59:26.220 INFO:teuthology.orchestra.run.smithi154.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.2 MB/s | 43 kB 00:00 2023-10-10T20:59:26.235 INFO:teuthology.orchestra.run.smithi154.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.2 MB/s | 18 kB 00:00 2023-10-10T20:59:26.267 INFO:teuthology.orchestra.run.smithi154.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 19 MB/s | 605 kB 00:00 2023-10-10T20:59:26.284 INFO:teuthology.orchestra.run.smithi154.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 31 MB/s | 2.3 MB 00:00 2023-10-10T20:59:26.286 INFO:teuthology.orchestra.run.smithi154.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 4.4 MB/s | 83 kB 00:00 2023-10-10T20:59:26.298 INFO:teuthology.orchestra.run.smithi154.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.2 MB/s | 59 kB 00:00 2023-10-10T20:59:26.306 INFO:teuthology.orchestra.run.smithi154.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 8.4 MB/s | 169 kB 00:00 2023-10-10T20:59:26.315 INFO:teuthology.orchestra.run.smithi154.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.2 MB/s | 38 kB 00:00 2023-10-10T20:59:26.324 INFO:teuthology.orchestra.run.smithi154.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.6 MB/s | 86 kB 00:00 2023-10-10T20:59:26.333 INFO:teuthology.orchestra.run.smithi154.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.2 MB/s | 58 kB 00:00 2023-10-10T20:59:26.340 INFO:teuthology.orchestra.run.smithi154.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.0 MB/s | 47 kB 00:00 2023-10-10T20:59:26.358 INFO:teuthology.orchestra.run.smithi154.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 22 MB/s | 559 kB 00:00 2023-10-10T20:59:26.368 INFO:teuthology.orchestra.run.smithi154.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 22 MB/s | 639 kB 00:00 2023-10-10T20:59:26.379 INFO:teuthology.orchestra.run.smithi154.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.4 MB/s | 70 kB 00:00 2023-10-10T20:59:26.393 INFO:teuthology.orchestra.run.smithi154.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 7.9 MB/s | 200 kB 00:00 2023-10-10T20:59:26.403 INFO:teuthology.orchestra.run.smithi154.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 4.0 MB/s | 97 kB 00:00 2023-10-10T20:59:26.418 INFO:teuthology.orchestra.run.smithi154.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 2.9 MB/s | 44 kB 00:00 2023-10-10T20:59:26.434 INFO:teuthology.orchestra.run.smithi154.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.7 MB/s | 27 kB 00:00 2023-10-10T20:59:26.451 INFO:teuthology.orchestra.run.smithi154.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 9.6 MB/s | 161 kB 00:00 2023-10-10T20:59:26.471 INFO:teuthology.orchestra.run.smithi154.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-10T20:59:26.502 INFO:teuthology.orchestra.run.smithi154.stdout:(97/120): thrift-0.13.0-2.el8.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2023-10-10T20:59:26.503 INFO:teuthology.orchestra.run.smithi154.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 16 MB/s | 457 kB 00:00 2023-10-10T20:59:26.516 INFO:teuthology.orchestra.run.smithi154.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.2 MB/s | 39 kB 00:00 2023-10-10T20:59:26.548 INFO:teuthology.orchestra.run.smithi154.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 21 MB/s | 688 kB 00:00 2023-10-10T20:59:26.568 INFO:teuthology.orchestra.run.smithi154.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2023-10-10T20:59:26.587 INFO:teuthology.orchestra.run.smithi154.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 12 MB/s | 225 kB 00:00 2023-10-10T20:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout:(103/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 7.3 MB/s | 126 kB 00:00 2023-10-10T20:59:26.606 INFO:teuthology.orchestra.run.smithi179.stdout:(17/120): librgw2-17.2.6-1374.g46d1f59b.el8.x86 4.1 MB/s | 5.6 MB 00:01 2023-10-10T20:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout:(104/120): python3-babel-2.5.1-5.el8.noarch.rpm 33 MB/s | 4.8 MB 00:00 2023-10-10T20:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 10 MB/s | 187 kB 00:00 2023-10-10T20:59:26.651 INFO:teuthology.orchestra.run.smithi179.stdout:(18/120): python3-ceph-argparse-17.2.6-1374.g46 985 kB/s | 45 kB 00:00 2023-10-10T20:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 20 MB/s | 538 kB 00:00 2023-10-10T20:59:26.690 INFO:teuthology.orchestra.run.smithi154.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-10-10T20:59:26.729 INFO:teuthology.orchestra.run.smithi179.stdout:(19/120): python3-ceph-common-17.2.6-1374.g46d1 1.4 MB/s | 115 kB 00:00 2023-10-10T20:59:26.745 INFO:teuthology.orchestra.run.smithi154.stdout:(108/120): python3-scipy-1.0.0-20.module+el8.1. 41 MB/s | 15 MB 00:00 2023-10-10T20:59:26.760 INFO:teuthology.orchestra.run.smithi154.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 24 MB/s | 3.7 MB 00:00 2023-10-10T20:59:26.761 INFO:teuthology.orchestra.run.smithi154.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 2.2 MB/s | 157 kB 00:00 2023-10-10T20:59:26.763 INFO:teuthology.orchestra.run.smithi154.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.0 MB/s | 110 kB 00:00 2023-10-10T20:59:26.778 INFO:teuthology.orchestra.run.smithi154.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.2 MB/s | 20 kB 00:00 2023-10-10T20:59:26.780 INFO:teuthology.orchestra.run.smithi179.stdout:(20/120): python3-cephfs-17.2.6-1374.g46d1f59b. 3.7 MB/s | 190 kB 00:00 2023-10-10T20:59:26.783 INFO:teuthology.orchestra.run.smithi154.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 15 MB/s | 353 kB 00:00 2023-10-10T20:59:26.796 INFO:teuthology.orchestra.run.smithi154.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 21 MB/s | 709 kB 00:00 2023-10-10T20:59:26.797 INFO:teuthology.orchestra.run.smithi154.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.8 MB/s | 54 kB 00:00 2023-10-10T20:59:26.833 INFO:teuthology.orchestra.run.smithi154.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 20 MB/s | 713 kB 00:00 2023-10-10T20:59:26.843 INFO:teuthology.orchestra.run.smithi179.stdout:(21/120): python3-rados-17.2.6-1374.g46d1f59b.e 5.8 MB/s | 371 kB 00:00 2023-10-10T20:59:26.905 INFO:teuthology.orchestra.run.smithi179.stdout:(22/120): python3-rbd-17.2.6-1374.g46d1f59b.el8 5.7 MB/s | 358 kB 00:00 2023-10-10T20:59:26.907 INFO:teuthology.orchestra.run.smithi154.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 38 MB/s | 4.7 MB 00:00 2023-10-10T20:59:26.927 INFO:teuthology.orchestra.run.smithi154.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 35 MB/s | 4.6 MB 00:00 2023-10-10T20:59:26.952 INFO:teuthology.orchestra.run.smithi179.stdout:(23/120): python3-rgw-17.2.6-1374.g46d1f59b.el8 2.2 MB/s | 107 kB 00:00 2023-10-10T20:59:27.002 INFO:teuthology.orchestra.run.smithi179.stdout:(24/120): rbd-fuse-17.2.6-1374.g46d1f59b.el8.x8 1.8 MB/s | 90 kB 00:00 2023-10-10T20:59:27.616 INFO:teuthology.orchestra.run.smithi154.stdout:(119/120): librados2-17.2.6-1374.g46d1f59b.el8. 4.4 MB/s | 3.5 MB 00:00 2023-10-10T20:59:27.665 INFO:teuthology.orchestra.run.smithi154.stdout:(120/120): librbd1-17.2.6-1374.g46d1f59b.el8.x8 4.7 MB/s | 3.6 MB 00:00 2023-10-10T20:59:27.670 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-10-10T20:59:27.671 INFO:teuthology.orchestra.run.smithi154.stdout:Total 18 MB/s | 202 MB 00:10 2023-10-10T20:59:27.739 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-10-10T20:59:27.860 INFO:teuthology.orchestra.run.smithi179.stdout:(25/120): rbd-mirror-17.2.6-1374.g46d1f59b.el8. 4.0 MB/s | 3.5 MB 00:00 2023-10-10T20:59:27.866 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-10-10T20:59:27.866 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-10-10T20:59:27.895 INFO:teuthology.orchestra.run.smithi179.stdout:(26/120): rbd-nbd-17.2.6-1374.g46d1f59b.el8.x86 4.8 MB/s | 173 kB 00:00 2023-10-10T20:59:27.932 INFO:teuthology.orchestra.run.smithi179.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1374.g 622 kB/s | 23 kB 00:00 2023-10-10T20:59:27.966 INFO:teuthology.orchestra.run.smithi179.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1374.g46d1f59 3.6 MB/s | 121 kB 00:00 2023-10-10T20:59:28.385 INFO:teuthology.orchestra.run.smithi179.stdout:(29/120): ceph-osd-17.2.6-1374.g46d1f59b.el8.x8 2.2 MB/s | 17 MB 00:07 2023-10-10T20:59:28.447 INFO:teuthology.orchestra.run.smithi179.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1374.g46d1f 3.5 MB/s | 1.7 MB 00:00 2023-10-10T20:59:28.526 INFO:teuthology.orchestra.run.smithi179.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1374.g46 3.0 MB/s | 238 kB 00:00 2023-10-10T20:59:28.592 INFO:teuthology.orchestra.run.smithi179.stdout:(32/120): ceph-mgr-rook-17.2.6-1374.g46d1f59b.e 724 kB/s | 47 kB 00:00 2023-10-10T20:59:28.649 INFO:teuthology.orchestra.run.smithi179.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1374.g4 251 kB/s | 14 kB 00:00 2023-10-10T20:59:28.734 INFO:teuthology.orchestra.run.smithi179.stdout:(34/120): ceph-volume-17.2.6-1374.g46d1f59b.el8 3.1 MB/s | 267 kB 00:00 2023-10-10T20:59:28.761 INFO:teuthology.orchestra.run.smithi179.stdout:(35/120): cephadm-17.2.6-1374.g46d1f59b.el8.noa 3.1 MB/s | 80 kB 00:00 2023-10-10T20:59:28.800 INFO:teuthology.orchestra.run.smithi179.stdout:(36/120): cephfs-top-17.2.6-1374.g46d1f59b.el8. 450 kB/s | 18 kB 00:00 2023-10-10T20:59:29.490 INFO:teuthology.orchestra.run.smithi179.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 444 kB/s | 306 kB 00:00 2023-10-10T20:59:29.592 INFO:teuthology.orchestra.run.smithi179.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 579 kB/s | 59 kB 00:00 2023-10-10T20:59:29.686 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-10-10T20:59:29.690 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-10-10T20:59:29.700 INFO:teuthology.orchestra.run.smithi179.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 701 kB/s | 75 kB 00:00 2023-10-10T20:59:29.906 INFO:teuthology.orchestra.run.smithi179.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-10-10T20:59:29.991 INFO:teuthology.orchestra.run.smithi179.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 513 kB/s | 44 kB 00:00 2023-10-10T20:59:30.091 INFO:teuthology.orchestra.run.smithi179.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-10-10T20:59:30.176 INFO:teuthology.orchestra.run.smithi179.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 392 kB/s | 33 kB 00:00 2023-10-10T20:59:30.258 INFO:teuthology.orchestra.run.smithi179.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 198 kB/s | 16 kB 00:00 2023-10-10T20:59:30.365 INFO:teuthology.orchestra.run.smithi179.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-10-10T20:59:30.488 INFO:teuthology.orchestra.run.smithi179.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.1 MB/s | 384 kB 00:00 2023-10-10T20:59:30.579 INFO:teuthology.orchestra.run.smithi179.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 896 kB/s | 81 kB 00:00 2023-10-10T20:59:30.662 INFO:teuthology.orchestra.run.smithi179.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 135 kB/s | 11 kB 00:00 2023-10-10T20:59:30.748 INFO:teuthology.orchestra.run.smithi179.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 203 kB/s | 18 kB 00:00 2023-10-10T20:59:30.979 INFO:teuthology.orchestra.run.smithi179.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 5.1 MB/s | 1.2 MB 00:00 2023-10-10T20:59:31.076 INFO:teuthology.orchestra.run.smithi179.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 505 kB/s | 49 kB 00:00 2023-10-10T20:59:31.176 INFO:teuthology.orchestra.run.smithi179.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 586 kB/s | 59 kB 00:00 2023-10-10T20:59:31.271 INFO:teuthology.orchestra.run.smithi179.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 635 kB/s | 60 kB 00:00 2023-10-10T20:59:31.378 INFO:teuthology.orchestra.run.smithi179.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2023-10-10T20:59:31.473 INFO:teuthology.orchestra.run.smithi179.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 164 kB/s | 16 kB 00:00 2023-10-10T20:59:31.570 INFO:teuthology.orchestra.run.smithi179.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 347 kB/s | 34 kB 00:00 2023-10-10T20:59:31.678 INFO:teuthology.orchestra.run.smithi179.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-10-10T20:59:31.783 INFO:teuthology.orchestra.run.smithi179.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 613 kB/s | 64 kB 00:00 2023-10-10T20:59:31.877 INFO:teuthology.orchestra.run.smithi179.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 198 kB/s | 19 kB 00:00 2023-10-10T20:59:31.970 INFO:teuthology.orchestra.run.smithi179.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 259 kB/s | 24 kB 00:00 2023-10-10T20:59:32.012 INFO:teuthology.orchestra.run.smithi179.stdout:(61/120): ceph-mgr-diskprediction-local-17.2.6- 2.0 MB/s | 7.4 MB 00:03 2023-10-10T20:59:32.063 INFO:teuthology.orchestra.run.smithi179.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 315 kB/s | 29 kB 00:00 2023-10-10T20:59:32.166 INFO:teuthology.orchestra.run.smithi179.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 2.4 MB/s | 255 kB 00:00 2023-10-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi179.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-10-10T20:59:32.382 INFO:teuthology.orchestra.run.smithi179.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 639 kB/s | 61 kB 00:00 2023-10-10T20:59:32.437 INFO:teuthology.orchestra.run.smithi179.stdout:(66/120): python3-trustme-0.6.0-4.el8.noarch.rp 65 kB/s | 27 kB 00:00 2023-10-10T20:59:32.476 INFO:teuthology.orchestra.run.smithi179.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 917 kB/s | 85 kB 00:00 2023-10-10T20:59:32.577 INFO:teuthology.orchestra.run.smithi179.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 164 kB/s | 23 kB 00:00 2023-10-10T20:59:32.582 INFO:teuthology.orchestra.run.smithi179.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-10T20:59:32.698 INFO:teuthology.orchestra.run.smithi179.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 7.8 MB/s | 1.7 MB 00:00 2023-10-10T20:59:32.728 INFO:teuthology.orchestra.run.smithi179.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.5 MB/s | 44 kB 00:00 2023-10-10T20:59:32.741 INFO:teuthology.orchestra.run.smithi179.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.0 MB/s | 27 kB 00:00 2023-10-10T20:59:32.757 INFO:teuthology.orchestra.run.smithi179.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 9.8 MB/s | 161 kB 00:00 2023-10-10T20:59:32.777 INFO:teuthology.orchestra.run.smithi179.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-10T20:59:32.801 INFO:teuthology.orchestra.run.smithi179.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 20 MB/s | 457 kB 00:00 2023-10-10T20:59:32.907 INFO:teuthology.orchestra.run.smithi179.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 45 MB/s | 15 MB 00:00 2023-10-10T20:59:32.925 INFO:teuthology.orchestra.run.smithi179.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.2 MB/s | 39 kB 00:00 2023-10-10T20:59:32.955 INFO:teuthology.orchestra.run.smithi179.stdout:(78/120): python3-babel-2.5.1-5.el8.noarch.rpm 31 MB/s | 4.8 MB 00:00 2023-10-10T20:59:32.968 INFO:teuthology.orchestra.run.smithi179.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2023-10-10T20:59:32.973 INFO:teuthology.orchestra.run.smithi179.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 15 MB/s | 259 kB 00:00 2023-10-10T20:59:32.986 INFO:teuthology.orchestra.run.smithi179.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 13 MB/s | 225 kB 00:00 2023-10-10T20:59:32.990 INFO:teuthology.orchestra.run.smithi179.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 7.2 MB/s | 126 kB 00:00 2023-10-10T20:59:33.012 INFO:teuthology.orchestra.run.smithi179.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 8.5 MB/s | 187 kB 00:00 2023-10-10T20:59:33.038 INFO:teuthology.orchestra.run.smithi179.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 21 MB/s | 538 kB 00:00 2023-10-10T20:59:33.057 INFO:teuthology.orchestra.run.smithi179.stdout:(85/120): socat-1.7.3.3-2.el8.x86_64.rpm 16 MB/s | 302 kB 00:00 2023-10-10T20:59:33.072 INFO:teuthology.orchestra.run.smithi179.stdout:(86/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 43 MB/s | 3.7 MB 00:00 2023-10-10T20:59:33.076 INFO:teuthology.orchestra.run.smithi179.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 8.1 MB/s | 157 kB 00:00 2023-10-10T20:59:33.092 INFO:teuthology.orchestra.run.smithi179.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 5.5 MB/s | 110 kB 00:00 2023-10-10T20:59:33.099 INFO:teuthology.orchestra.run.smithi179.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 15 MB/s | 353 kB 00:00 2023-10-10T20:59:33.108 INFO:teuthology.orchestra.run.smithi179.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 1.2 MB/s | 20 kB 00:00 2023-10-10T20:59:33.124 INFO:teuthology.orchestra.run.smithi179.stdout:(91/120): libtool-2.4.6-25.el8.x86_64.rpm 27 MB/s | 709 kB 00:00 2023-10-10T20:59:33.126 INFO:teuthology.orchestra.run.smithi179.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.1 MB/s | 54 kB 00:00 2023-10-10T20:59:33.240 INFO:teuthology.orchestra.run.smithi179.stdout:(93/120): openblas-0.3.12-1.el8.x86_64.rpm 40 MB/s | 4.6 MB 00:00 2023-10-10T20:59:33.257 INFO:teuthology.orchestra.run.smithi179.stdout:(94/120): openblas-threads-0.3.12-1.el8.x86_64. 36 MB/s | 4.7 MB 00:00 2023-10-10T20:59:33.269 INFO:teuthology.orchestra.run.smithi179.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 25 MB/s | 713 kB 00:00 2023-10-10T20:59:33.273 INFO:teuthology.orchestra.run.smithi179.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.3 MB/s | 19 kB 00:00 2023-10-10T20:59:33.285 INFO:teuthology.orchestra.run.smithi179.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.6 MB/s | 43 kB 00:00 2023-10-10T20:59:33.289 INFO:teuthology.orchestra.run.smithi179.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 8.7 MB/s | 155 kB 00:00 2023-10-10T20:59:33.304 INFO:teuthology.orchestra.run.smithi179.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 11 MB/s | 220 kB 00:00 2023-10-10T20:59:33.305 INFO:teuthology.orchestra.run.smithi179.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 2.9 MB/s | 48 kB 00:00 2023-10-10T20:59:33.322 INFO:teuthology.orchestra.run.smithi179.stdout:(101/120): python3-requests-oauthlib-1.0.0-1.el 2.6 MB/s | 43 kB 00:00 2023-10-10T20:59:33.324 INFO:teuthology.orchestra.run.smithi179.stdout:(102/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 11 MB/s | 229 kB 00:00 2023-10-10T20:59:33.341 INFO:teuthology.orchestra.run.smithi179.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.0 MB/s | 18 kB 00:00 2023-10-10T20:59:33.366 INFO:teuthology.orchestra.run.smithi179.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 24 MB/s | 605 kB 00:00 2023-10-10T20:59:33.377 INFO:teuthology.orchestra.run.smithi179.stdout:(105/120): openssl-devel-1.1.1g-15.el8_3.x86_64 42 MB/s | 2.3 MB 00:00 2023-10-10T20:59:33.379 INFO:teuthology.orchestra.run.smithi179.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 6.1 MB/s | 83 kB 00:00 2023-10-10T20:59:33.393 INFO:teuthology.orchestra.run.smithi179.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 3.7 MB/s | 59 kB 00:00 2023-10-10T20:59:33.398 INFO:teuthology.orchestra.run.smithi179.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.0 MB/s | 169 kB 00:00 2023-10-10T20:59:33.408 INFO:teuthology.orchestra.run.smithi179.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.6 MB/s | 38 kB 00:00 2023-10-10T20:59:33.415 INFO:teuthology.orchestra.run.smithi179.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.1 MB/s | 86 kB 00:00 2023-10-10T20:59:33.426 INFO:teuthology.orchestra.run.smithi179.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.3 MB/s | 58 kB 00:00 2023-10-10T20:59:33.430 INFO:teuthology.orchestra.run.smithi179.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.1 MB/s | 47 kB 00:00 2023-10-10T20:59:33.454 INFO:teuthology.orchestra.run.smithi179.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 20 MB/s | 559 kB 00:00 2023-10-10T20:59:33.458 INFO:teuthology.orchestra.run.smithi179.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 22 MB/s | 639 kB 00:00 2023-10-10T20:59:33.470 INFO:teuthology.orchestra.run.smithi179.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 4.2 MB/s | 70 kB 00:00 2023-10-10T20:59:33.481 INFO:teuthology.orchestra.run.smithi179.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 8.5 MB/s | 200 kB 00:00 2023-10-10T20:59:33.488 INFO:teuthology.orchestra.run.smithi179.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 5.4 MB/s | 97 kB 00:00 2023-10-10T20:59:34.408 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-10-10T20:59:34.496 INFO:teuthology.orchestra.run.smithi179.stdout:(118/120): librbd1-17.2.6-1374.g46d1f59b.el8.x8 3.6 MB/s | 3.6 MB 00:01 2023-10-10T20:59:34.647 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-10T20:59:34.896 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-10T20:59:35.046 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-10T20:59:35.117 INFO:teuthology.orchestra.run.smithi179.stdout:(119/120): librados2-17.2.6-1374.g46d1f59b.el8. 2.1 MB/s | 3.5 MB 00:01 2023-10-10T20:59:35.279 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-10T20:59:35.713 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-10T20:59:35.928 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:17.2.6-1374.g46d1f59b.el8.x86_64 4/122 2023-10-10T20:59:36.391 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:17.2.6-1374.g46d1f59b.el8.x86_64 4/122 2023-10-10T20:59:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:17.2.6-1374.g46d1f59b.el8.x86_64 5/122 2023-10-10T20:59:36.767 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:17.2.6-1374.g46d1f59b.el8.x86_64 5/122 2023-10-10T20:59:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:17.2.6-1374.g46d1f59b.el8.x86_64 6/122 2023-10-10T20:59:37.085 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:17.2.6-1374.g46d1f59b.el8.x86_64 6/122 2023-10-10T20:59:37.281 INFO:teuthology.orchestra.run.smithi179.stdout:(120/120): ceph-test-17.2.6-1374.g46d1f59b.el8. 4.1 MB/s | 52 MB 00:12 2023-10-10T20:59:37.287 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2023-10-10T20:59:37.287 INFO:teuthology.orchestra.run.smithi179.stdout:Total 10 MB/s | 202 MB 00:20 2023-10-10T20:59:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:17.2.6-1374.g46d1f59b.el8.x86_64 7/122 2023-10-10T20:59:37.355 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2023-10-10T20:59:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2023-10-10T20:59:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2023-10-10T20:59:37.686 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-10T20:59:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-10T20:59:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:17.2.6-1374.g46d1f59b.el8.x86_64 10/122 2023-10-10T20:59:38.761 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:17.2.6-1374.g46d1f59b.el8.x86_64 10/122 2023-10-10T20:59:39.010 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-10T20:59:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-10T20:59:39.250 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2023-10-10T20:59:39.255 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2023-10-10T20:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:17.2.6-1374.g46d1f59b.el8.x86_64 13/122 2023-10-10T20:59:39.556 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1374.g46d1f59b.el8.x86_64 13/122 2023-10-10T20:59:39.745 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:17.2.6-1374.g46d1f59b.el8.x86 14/122 2023-10-10T20:59:39.847 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1374.g46d1f59b.el8.x86 14/122 2023-10-10T20:59:40.069 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-10T20:59:40.353 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-10T20:59:41.261 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-10T20:59:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-10T20:59:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-10T20:59:41.802 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-10T20:59:41.994 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-10T20:59:42.620 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-10T20:59:42.753 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-10T20:59:43.392 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-10T20:59:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-10T20:59:43.865 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2023-10-10T20:59:44.088 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-10T20:59:44.293 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-10T20:59:44.476 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-10T20:59:44.499 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-10T20:59:44.648 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-10T20:59:44.787 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-10T20:59:44.890 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-10T20:59:45.052 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-10T20:59:45.292 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-10T20:59:45.319 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-10T20:59:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:17.2.6-1374.g46d1f59b.el8. 26/122 2023-10-10T20:59:45.515 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:17.2.6-1374.g46d1f59b.el8.x86_64 5/122 2023-10-10T20:59:45.633 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:17.2.6-1374.g46d1f59b.el 27/122 2023-10-10T20:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:17.2.6-1374.g46d1f59b.el8.x86_6 28/122 2023-10-10T20:59:45.980 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:17.2.6-1374.g46d1f59b.el8.x86_64 5/122 2023-10-10T20:59:46.198 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-10T20:59:46.224 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:17.2.6-1374.g46d1f59b.el8.x86_64 6/122 2023-10-10T20:59:46.383 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:17.2.6-1374.g46d1f59b.el8.x86_64 6/122 2023-10-10T20:59:46.590 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:17.2.6-1374.g46d1f59b.el8.x86_64 7/122 2023-10-10T20:59:46.709 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:17.2.6-1374.g46d1f59b.el8.x86_64 7/122 2023-10-10T20:59:46.725 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-10T20:59:46.977 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-10T20:59:47.066 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:17.2.6-1374.g46d1f59b.el8.x86_64 8/122 2023-10-10T20:59:47.770 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-10T20:59:47.957 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:17.2.6-1374.g46d1f59b.el8.x86_64 10/122 2023-10-10T20:59:48.091 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:17.2.6-1374.g46d1f59b.el8.x86_64 10/122 2023-10-10T20:59:48.363 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-10T20:59:48.551 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-10T20:59:48.765 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:17.2.6-1374.g46d1f59b.el8.x86_64 13/122 2023-10-10T20:59:48.904 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1374.g46d1f59b.el8.x86_64 13/122 2023-10-10T20:59:49.107 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:17.2.6-1374.g46d1f59b.el8.x86 14/122 2023-10-10T20:59:49.200 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1374.g46d1f59b.el8.x86 14/122 2023-10-10T20:59:49.392 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-10T20:59:49.437 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-10T20:59:49.582 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-10T20:59:49.747 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-10T20:59:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-10T20:59:49.898 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-10T20:59:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-10T20:59:50.698 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-10T20:59:50.994 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-10T20:59:51.331 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-10T20:59:51.383 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-10T20:59:51.498 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-10T20:59:51.670 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-10T20:59:51.959 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-10T20:59:52.180 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-10T20:59:52.376 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-10T20:59:52.389 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 38/122 2023-10-10T20:59:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 39/122 2023-10-10T20:59:52.682 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-10T20:59:52.858 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-10T20:59:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:17.2.6-1374.g46d1f59b.el8.x86_6 40/122 2023-10-10T20:59:53.047 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-10T20:59:53.213 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-10T20:59:53.304 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-10T20:59:53.410 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-10T20:59:53.595 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-10T20:59:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-10T20:59:53.866 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-10T20:59:53.896 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-10T20:59:54.042 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-10T20:59:54.080 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:17.2.6-1374.g46d1f59b.el8. 26/122 2023-10-10T20:59:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-10T20:59:54.257 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:17.2.6-1374.g46d1f59b.el 27/122 2023-10-10T20:59:54.354 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-10T20:59:54.528 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:17.2.6-1374.g46d1f59b.el8.x86_6 28/122 2023-10-10T20:59:54.557 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-10T20:59:54.733 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-10T20:59:54.899 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-10T20:59:55.139 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-10T20:59:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-10T20:59:55.517 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-10T20:59:55.693 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-10T20:59:55.758 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-10T20:59:55.916 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-10T20:59:56.070 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-10T20:59:56.277 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-10T20:59:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-10T20:59:56.601 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-10T20:59:56.643 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-10T20:59:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-10T20:59:56.954 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-10T20:59:57.205 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-10T20:59:57.254 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-10T20:59:57.428 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-10T20:59:57.663 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-10T20:59:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-10T20:59:58.161 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-10T20:59:58.393 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-10T20:59:58.607 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-10T20:59:58.757 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-10T20:59:59.005 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-10T20:59:59.263 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-10T20:59:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-10T20:59:59.660 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-10T20:59:59.721 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-10T20:59:59.918 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-10T20:59:59.983 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-10T21:00:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-10T21:00:00.246 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-10T21:00:00.438 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-10T21:00:00.466 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-10T21:00:00.675 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-10T21:00:00.677 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 38/122 2023-10-10T21:00:00.863 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 39/122 2023-10-10T21:00:01.029 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-10T21:00:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:17.2.6-1374.g46d1f59b.el8.x86_6 40/122 2023-10-10T21:00:01.261 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-10T21:00:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-10T21:00:01.470 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-10T21:00:01.531 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-10T21:00:01.634 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-10T21:00:01.841 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-10T21:00:01.868 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-10T21:00:01.978 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-10T21:00:02.207 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-10T21:00:02.368 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-10T21:00:02.714 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-10T21:00:03.003 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-10T21:00:03.270 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-10T21:00:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-10T21:00:03.597 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-10T21:00:03.657 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-10T21:00:03.841 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-10T21:00:03.938 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-10T21:00:04.122 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-10T21:00:04.210 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-10T21:00:04.349 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-10T21:00:04.456 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-10T21:00:04.553 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-10T21:00:04.754 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-10T21:00:04.829 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-10T21:00:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-10T21:00:05.048 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-10T21:00:05.109 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-10T21:00:05.233 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-10T21:00:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-10T21:00:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-10T21:00:05.583 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-10T21:00:05.615 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-10T21:00:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-10T21:00:06.157 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-10T21:00:06.338 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-10T21:00:06.560 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-10T21:00:06.735 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-10T21:00:06.963 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-10T21:00:07.164 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-10T21:00:07.379 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-10T21:00:07.541 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-10T21:00:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-10T21:00:07.977 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-10T21:00:08.245 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-10T21:00:08.546 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-10T21:00:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-10T21:00:09.156 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-10T21:00:09.382 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-10T21:00:09.632 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-10T21:00:11.036 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-10T21:00:11.336 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-10T21:00:11.612 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-10T21:00:11.965 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-10T21:00:12.239 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-10T21:00:12.584 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 87/122 2023-10-10T21:00:12.624 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-10T21:00:12.806 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 87/122 2023-10-10T21:00:12.885 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-10T21:00:13.076 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-10T21:00:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-10T21:00:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 87/122 2023-10-10T21:00:13.826 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:17.2.6-1374.g46d1f59b.el8.x86_64 88/122 2023-10-10T21:00:13.977 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:17.2.6-1374.g46d1f59b.el8.x86_64 88/122 2023-10-10T21:00:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:17.2.6-1374.g46d1f59b.el8.x86_64 89/122 2023-10-10T21:00:20.430 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 87/122 2023-10-10T21:00:20.719 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 87/122 2023-10-10T21:00:21.418 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 87/122 2023-10-10T21:00:21.748 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:17.2.6-1374.g46d1f59b.el8.x86_64 88/122 2023-10-10T21:00:21.895 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:17.2.6-1374.g46d1f59b.el8.x86_64 88/122 2023-10-10T21:00:22.056 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:17.2.6-1374.g46d1f59b.el8.x86_64 89/122 2023-10-10T21:00:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1374.g46d1f59b.el8.x86_64 89/122 2023-10-10T21:00:33.589 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2023-10-10T21:00:33.589 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2023-10-10T21:00:33.590 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2023-10-10T21:00:33.590 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /run 2023-10-10T21:00:33.590 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2023-10-10T21:00:33.590 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2023-10-10T21:00:33.591 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2023-10-10T21:00:33.591 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2023-10-10T21:00:33.591 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2023-10-10T21:00:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:00:34.006 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:17.2.6-1374.g46d1f59b.el8.noarch 90/122 2023-10-10T21:00:35.632 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:17.2.6-1374.g46d1f59b.el8.noarch 90/122 2023-10-10T21:00:35.839 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:17.2.6-1374.g46d1f59b.el8.x86_64 91/122 2023-10-10T21:00:36.110 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:17.2.6-1374.g46d1f59b.el8.x86_64 91/122 2023-10-10T21:00:36.285 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:17.2.6-1374.g46d1f59b.el8.x86_64 92/122 2023-10-10T21:00:36.741 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:17.2.6-1374.g46d1f59b.el8.x86_64 92/122 2023-10-10T21:00:36.902 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:17.2.6-1374.g46d1f59b.el8.x86_64 93/122 2023-10-10T21:00:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:17.2.6-1374.g46d1f59b.el8.x86_64 93/122 2023-10-10T21:00:41.377 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 94/122 2023-10-10T21:00:41.431 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1374.g46d1f59b.el8.x86_64 89/122 2023-10-10T21:00:41.431 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2023-10-10T21:00:41.431 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2023-10-10T21:00:41.432 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-10-10T21:00:41.432 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /run 2023-10-10T21:00:41.432 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2023-10-10T21:00:41.432 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2023-10-10T21:00:41.432 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2023-10-10T21:00:41.433 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2023-10-10T21:00:41.433 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-10-10T21:00:41.433 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:00:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 94/122 2023-10-10T21:00:41.801 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1374.g46d1f59b.e 95/122 2023-10-10T21:00:41.908 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:17.2.6-1374.g46d1f59b.el8.noarch 90/122 2023-10-10T21:00:41.996 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1374.g46d1f59b. 96/122 2023-10-10T21:00:42.212 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1374.g46d1f59b.el8.noa 97/122 2023-10-10T21:00:42.475 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1374.g46d1f59b.el8.noa 97/122 2023-10-10T21:00:42.662 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1374.g46d1f59b.el8.n 98/122 2023-10-10T21:00:43.548 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:17.2.6-1374.g46d1f59b.el8.noarch 90/122 2023-10-10T21:00:43.753 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:17.2.6-1374.g46d1f59b.el8.x86_64 91/122 2023-10-10T21:00:43.782 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1374.g46d1f59b.el8.n 98/122 2023-10-10T21:00:43.984 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1374.g46d 99/122 2023-10-10T21:00:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:17.2.6-1374.g46d1f59b.el8.x86_64 91/122 2023-10-10T21:00:44.123 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1374.g46d 99/122 2023-10-10T21:00:44.199 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:17.2.6-1374.g46d1f59b.el8.x86_64 92/122 2023-10-10T21:00:44.547 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1374.g46d1f59b.el 100/122 2023-10-10T21:00:44.655 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:17.2.6-1374.g46d1f59b.el8.x86_64 92/122 2023-10-10T21:00:44.771 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:17.2.6-1374.g46d1f59b.el8.x86_64 101/122 2023-10-10T21:00:44.840 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1374.g46d1f59b.el8.x86_64 101/122 2023-10-10T21:00:44.849 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:17.2.6-1374.g46d1f59b.el8.x86_64 93/122 2023-10-10T21:00:44.889 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:17.2.6-1374.g46d1f59b.el8.x86_64 93/122 2023-10-10T21:00:44.991 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:17.2.6-1374.g46d1f59b.el8.noarch 102/122 2023-10-10T21:00:45.019 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1374.g46d1f59b.el8.noarch 102/122 2023-10-10T21:00:46.725 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:17.2.6-1374.g46d1f59b.el8.x86_64 103/122 2023-10-10T21:00:47.006 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 104/122 2023-10-10T21:00:47.133 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 104/122 2023-10-10T21:00:47.317 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1374.g46d1f 105/122 2023-10-10T21:00:47.390 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1374.g46d1f 105/122 2023-10-10T21:00:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 106/122 2023-10-10T21:00:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 106/122 2023-10-10T21:00:48.242 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 107/122 2023-10-10T21:00:49.222 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 94/122 2023-10-10T21:00:49.431 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 94/122 2023-10-10T21:00:49.631 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1374.g46d1f59b.e 95/122 2023-10-10T21:00:49.844 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1374.g46d1f59b. 96/122 2023-10-10T21:00:50.031 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1374.g46d1f59b.el8.noa 97/122 2023-10-10T21:00:50.298 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1374.g46d1f59b.el8.noa 97/122 2023-10-10T21:00:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1374.g46d1f59b.el8.n 98/122 2023-10-10T21:00:51.631 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1374.g46d1f59b.el8.n 98/122 2023-10-10T21:00:51.839 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1374.g46d 99/122 2023-10-10T21:00:51.977 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1374.g46d 99/122 2023-10-10T21:00:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1374.g46d1f59b.el 100/122 2023-10-10T21:00:52.576 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:17.2.6-1374.g46d1f59b.el8.x86_64 101/122 2023-10-10T21:00:52.645 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1374.g46d1f59b.el8.x86_64 101/122 2023-10-10T21:00:52.822 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:17.2.6-1374.g46d1f59b.el8.noarch 102/122 2023-10-10T21:00:52.849 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1374.g46d1f59b.el8.noarch 102/122 2023-10-10T21:00:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 107/122 2023-10-10T21:00:54.577 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:17.2.6-1374.g46d1f59b.el8.x86_64 103/122 2023-10-10T21:00:54.851 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 104/122 2023-10-10T21:00:54.958 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:17.2.6-1374.g46d1f59b.el8.x86_64 108/122 2023-10-10T21:00:54.979 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 104/122 2023-10-10T21:00:55.131 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1374.g46d1f 105/122 2023-10-10T21:00:55.206 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1374.g46d1f 105/122 2023-10-10T21:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-10T21:00:55.398 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 106/122 2023-10-10T21:00:55.563 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 110/122 2023-10-10T21:00:55.818 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 106/122 2023-10-10T21:00:55.826 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-10T21:00:56.014 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 107/122 2023-10-10T21:00:56.042 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-10T21:00:56.070 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-10T21:00:56.221 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:17.2.6-1374.g46d1f59b.el8.x86_ 113/122 2023-10-10T21:00:56.421 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-10T21:00:56.591 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:17.2.6-1374.g46d1f59b.el8.noarch 115/122 2023-10-10T21:00:56.833 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 116/122 2023-10-10T21:00:57.163 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 117/122 2023-10-10T21:00:57.365 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-10T21:00:57.441 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-10T21:00:57.656 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-10T21:00:57.680 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-10T21:00:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-10T21:00:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-10T21:00:58.079 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-10T21:00:58.079 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-10T21:00:58.463 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-10T21:00:58.463 INFO:teuthology.orchestra.run.smithi154.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-10T21:00:58.463 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:00:59.341 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:17.2.6-1374.g46d1f59b.el8.x86_64 1/122 2023-10-10T21:00:59.341 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:17.2.6-1374.g46d1f59b.el8.x86_64 2/122 2023-10-10T21:00:59.342 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 3/122 2023-10-10T21:00:59.342 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 4/122 2023-10-10T21:00:59.342 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1374.g46d1f 5/122 2023-10-10T21:00:59.342 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:17.2.6-1374.g46d1f59b.el8.x86_64 6/122 2023-10-10T21:00:59.343 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:17.2.6-1374.g46d1f59b.el8.x86_64 7/122 2023-10-10T21:00:59.343 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:17.2.6-1374.g46d1f59b.el8.x86_64 8/122 2023-10-10T21:00:59.343 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:17.2.6-1374.g46d1f59b.el8.x86_64 9/122 2023-10-10T21:00:59.343 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 10/122 2023-10-10T21:00:59.343 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:17.2.6-1374.g46d1f59b.el8.x86_64 11/122 2023-10-10T21:00:59.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:17.2.6-1374.g46d1f59b.el8.x86_64 12/122 2023-10-10T21:00:59.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 13/122 2023-10-10T21:00:59.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:17.2.6-1374.g46d1f59b.el8.x86_ 14/122 2023-10-10T21:00:59.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:17.2.6-1374.g46d1f59b.el8.x86_64 15/122 2023-10-10T21:00:59.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:17.2.6-1374.g46d1f59b.el8.x86_64 16/122 2023-10-10T21:00:59.344 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:17.2.6-1374.g46d1f59b.el8.x86_6 17/122 2023-10-10T21:00:59.345 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:17.2.6-1374.g46d1f59b.el8.x86 18/122 2023-10-10T21:00:59.345 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:17.2.6-1374.g46d1f59b.el8.x86_64 19/122 2023-10-10T21:00:59.345 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1374.g46d1f59b.el 20/122 2023-10-10T21:00:59.345 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:17.2.6-1374.g46d1f59b.el8. 21/122 2023-10-10T21:00:59.345 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:17.2.6-1374.g46d1f59b.el8.x86_6 22/122 2023-10-10T21:00:59.346 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:17.2.6-1374.g46d1f59b.el8.x86_64 23/122 2023-10-10T21:00:59.346 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 24/122 2023-10-10T21:00:59.346 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 25/122 2023-10-10T21:00:59.355 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 26/122 2023-10-10T21:00:59.355 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 27/122 2023-10-10T21:00:59.355 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 28/122 2023-10-10T21:00:59.355 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1374.g46d1f59b. 29/122 2023-10-10T21:00:59.356 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1374.g46d1f59b.el8.noa 30/122 2023-10-10T21:00:59.356 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1374.g46d1f59b.el8.n 31/122 2023-10-10T21:00:59.356 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1374.g46d 32/122 2023-10-10T21:00:59.356 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1374.g46d1f59b.el 33/122 2023-10-10T21:00:59.356 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1374.g46d1f59b.el8.noarch 34/122 2023-10-10T21:00:59.357 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1374.g46d1f59b.e 35/122 2023-10-10T21:00:59.357 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:17.2.6-1374.g46d1f59b.el8.noarch 36/122 2023-10-10T21:00:59.357 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 37/122 2023-10-10T21:00:59.357 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:17.2.6-1374.g46d1f59b.el8.noarch 38/122 2023-10-10T21:00:59.357 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-10T21:00:59.357 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-10T21:00:59.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-10T21:00:59.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-10T21:00:59.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-10T21:00:59.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-10T21:00:59.358 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-10T21:00:59.359 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-10T21:00:59.359 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-10T21:00:59.359 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-10T21:00:59.359 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-10T21:00:59.359 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-10T21:00:59.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-10T21:00:59.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-10T21:00:59.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-10T21:00:59.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-10T21:00:59.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-10T21:00:59.360 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-10T21:00:59.361 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-10T21:00:59.361 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-10T21:00:59.361 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-10T21:00:59.361 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-10T21:00:59.361 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-10T21:00:59.362 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-10T21:00:59.362 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-10T21:00:59.362 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-10T21:00:59.362 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-10T21:00:59.362 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-10T21:00:59.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-10T21:00:59.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-10T21:00:59.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-10T21:00:59.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-10T21:00:59.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-10T21:00:59.363 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-10T21:00:59.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-10T21:00:59.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-10T21:00:59.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-10T21:00:59.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-10T21:00:59.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-10T21:00:59.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-10T21:00:59.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-10T21:00:59.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-10T21:00:59.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-10T21:00:59.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-10T21:00:59.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-10T21:00:59.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-10T21:00:59.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-10T21:00:59.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-10T21:00:59.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-10T21:00:59.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-10T21:00:59.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-10T21:00:59.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-10T21:00:59.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-10T21:00:59.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-10T21:00:59.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-10T21:00:59.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-10T21:00:59.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-10T21:00:59.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-10T21:00:59.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-10T21:00:59.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-10T21:00:59.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-10T21:00:59.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-10T21:00:59.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-10T21:00:59.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-10T21:00:59.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-10T21:00:59.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-10T21:00:59.370 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-10T21:00:59.370 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-10T21:00:59.370 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-10T21:00:59.370 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-10T21:00:59.370 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-10T21:00:59.371 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-10T21:00:59.371 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-10T21:00:59.371 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-10T21:00:59.371 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-10T21:00:59.371 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-10T21:00:59.371 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-10T21:00:59.372 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-10T21:00:59.372 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-10T21:00:59.372 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-10T21:00:59.372 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:17.2.6-1374.g46d1f59b.el8.x86_64 119/122 2023-10-10T21:00:59.372 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-10T21:00:59.372 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:17.2.6-1374.g46d1f59b.el8.x86_64 121/122 2023-10-10T21:01:01.469 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 107/122 2023-10-10T21:01:01.738 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-10T21:01:01.738 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:54 ago on Tue 10 Oct 2023 08:59:07 PM UTC. 2023-10-10T21:01:01.837 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:17.2.6-1374.g46d1f59b.el8.x86_64 108/122 2023-10-10T21:01:02.046 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-10T21:01:03.116 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-10T21:01:03.494 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-10T21:01:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 111/122 2023-10-10T21:01:03.801 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-10-10T21:01:03.900 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-10T21:01:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:03.937 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2023-10-10T21:01:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.937 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-10-10T21:01:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.1-7.el8.noarch 2023-10-10T21:01:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.0.4-10.el8.x86_64 2023-10-10T21:01:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-10T21:01:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.1-9.el8.x86_64 2023-10-10T21:01:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-10T21:01:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-10T21:01:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: jq-1.5-12.el8.x86_64 2023-10-10T21:01:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-10T21:01:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-10T21:01:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-10T21:01:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-10T21:01:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-10T21:01:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-10T21:01:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-10T21:01:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-10T21:01:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-10T21:01:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-10T21:01:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-10T21:01:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-10T21:01:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-10T21:01:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-10T21:01:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-10T21:01:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-10T21:01:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-10T21:01:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-10T21:01:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-10T21:01:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-10T21:01:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-10T21:01:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-10T21:01:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-10T21:01:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-10T21:01:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-10T21:01:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-10T21:01:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-10T21:01:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-10T21:01:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-10T21:01:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-10T21:01:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-10T21:01:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-10T21:01:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-10T21:01:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-10T21:01:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-10T21:01:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-10T21:01:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-10T21:01:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-10T21:01:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-10T21:01:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-10T21:01:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-10T21:01:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-10T21:01:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-10T21:01:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-10T21:01:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-10T21:01:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-10T21:01:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-10T21:01:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-10T21:01:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-2.6-1.el8.noarch 2023-10-10T21:01:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-10T21:01:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-10T21:01:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-10T21:01:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-10T21:01:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-10T21:01:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-10T21:01:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-10T21:01:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-10T21:01:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-10T21:01:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-10T21:01:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-10T21:01:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-10T21:01:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-10T21:01:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-10T21:01:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-10T21:01:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-10T21:01:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-10T21:01:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-10T21:01:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-10T21:01:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-10T21:01:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-10T21:01:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-10T21:01:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-10T21:01:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-10T21:01:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:03.961 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-10-10T21:01:04.094 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:17.2.6-1374.g46d1f59b.el8.x86_ 113/122 2023-10-10T21:01:04.261 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-10T21:01:04.284 DEBUG:teuthology.parallel:result is None 2023-10-10T21:01:04.464 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:17.2.6-1374.g46d1f59b.el8.noarch 115/122 2023-10-10T21:01:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 116/122 2023-10-10T21:01:04.914 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 117/122 2023-10-10T21:01:05.169 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-10T21:01:05.404 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-10T21:01:05.486 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-10T21:01:05.687 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-10T21:01:05.711 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-10T21:01:05.712 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-10T21:01:05.969 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-10T21:01:05.970 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-10T21:01:06.403 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-10T21:01:06.403 INFO:teuthology.orchestra.run.smithi179.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-10T21:01:06.403 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:07.305 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:17.2.6-1374.g46d1f59b.el8.x86_64 1/122 2023-10-10T21:01:07.306 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:17.2.6-1374.g46d1f59b.el8.x86_64 2/122 2023-10-10T21:01:07.306 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 3/122 2023-10-10T21:01:07.306 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 4/122 2023-10-10T21:01:07.306 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1374.g46d1f 5/122 2023-10-10T21:01:07.307 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:17.2.6-1374.g46d1f59b.el8.x86_64 6/122 2023-10-10T21:01:07.307 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:17.2.6-1374.g46d1f59b.el8.x86_64 7/122 2023-10-10T21:01:07.307 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:17.2.6-1374.g46d1f59b.el8.x86_64 8/122 2023-10-10T21:01:07.307 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:17.2.6-1374.g46d1f59b.el8.x86_64 9/122 2023-10-10T21:01:07.307 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 10/122 2023-10-10T21:01:07.309 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:17.2.6-1374.g46d1f59b.el8.x86_64 11/122 2023-10-10T21:01:07.309 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:17.2.6-1374.g46d1f59b.el8.x86_64 12/122 2023-10-10T21:01:07.309 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 13/122 2023-10-10T21:01:07.310 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:17.2.6-1374.g46d1f59b.el8.x86_ 14/122 2023-10-10T21:01:07.310 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:17.2.6-1374.g46d1f59b.el8.x86_64 15/122 2023-10-10T21:01:07.310 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:17.2.6-1374.g46d1f59b.el8.x86_64 16/122 2023-10-10T21:01:07.310 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:17.2.6-1374.g46d1f59b.el8.x86_6 17/122 2023-10-10T21:01:07.310 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:17.2.6-1374.g46d1f59b.el8.x86 18/122 2023-10-10T21:01:07.311 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:17.2.6-1374.g46d1f59b.el8.x86_64 19/122 2023-10-10T21:01:07.311 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1374.g46d1f59b.el 20/122 2023-10-10T21:01:07.311 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:17.2.6-1374.g46d1f59b.el8. 21/122 2023-10-10T21:01:07.311 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:17.2.6-1374.g46d1f59b.el8.x86_6 22/122 2023-10-10T21:01:07.311 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:17.2.6-1374.g46d1f59b.el8.x86_64 23/122 2023-10-10T21:01:07.312 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 24/122 2023-10-10T21:01:07.312 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 25/122 2023-10-10T21:01:07.312 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 26/122 2023-10-10T21:01:07.313 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 27/122 2023-10-10T21:01:07.313 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 28/122 2023-10-10T21:01:07.313 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1374.g46d1f59b. 29/122 2023-10-10T21:01:07.314 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1374.g46d1f59b.el8.noa 30/122 2023-10-10T21:01:07.314 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1374.g46d1f59b.el8.n 31/122 2023-10-10T21:01:07.314 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1374.g46d 32/122 2023-10-10T21:01:07.314 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1374.g46d1f59b.el 33/122 2023-10-10T21:01:07.315 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1374.g46d1f59b.el8.noarch 34/122 2023-10-10T21:01:07.315 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1374.g46d1f59b.e 35/122 2023-10-10T21:01:07.315 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:17.2.6-1374.g46d1f59b.el8.noarch 36/122 2023-10-10T21:01:07.315 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 37/122 2023-10-10T21:01:07.315 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:17.2.6-1374.g46d1f59b.el8.noarch 38/122 2023-10-10T21:01:07.315 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-10T21:01:07.316 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-10T21:01:07.316 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-10T21:01:07.316 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-10T21:01:07.316 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-10T21:01:07.316 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-10T21:01:07.317 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-10T21:01:07.317 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-10T21:01:07.317 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-10T21:01:07.317 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-10T21:01:07.318 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-10T21:01:07.318 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-10T21:01:07.318 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-10T21:01:07.318 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-10T21:01:07.319 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-10T21:01:07.319 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-10T21:01:07.319 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-10T21:01:07.319 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-10T21:01:07.320 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-10T21:01:07.320 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-10T21:01:07.320 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-10T21:01:07.320 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-10T21:01:07.321 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-10T21:01:07.321 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-10T21:01:07.321 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-10T21:01:07.321 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-10T21:01:07.322 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-10T21:01:07.322 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-10T21:01:07.322 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-10T21:01:07.322 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-10T21:01:07.323 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-10T21:01:07.323 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-10T21:01:07.323 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-10T21:01:07.324 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-10T21:01:07.324 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-10T21:01:07.324 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-10T21:01:07.325 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-10T21:01:07.325 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-10T21:01:07.325 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-10T21:01:07.325 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-10T21:01:07.326 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-10T21:01:07.326 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-10T21:01:07.327 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-10T21:01:07.327 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-10T21:01:07.327 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-10T21:01:07.327 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-10T21:01:07.328 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-10T21:01:07.328 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-10T21:01:07.328 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-10T21:01:07.328 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-10T21:01:07.329 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-10T21:01:07.329 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-10T21:01:07.329 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-10T21:01:07.329 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-10T21:01:07.329 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-10T21:01:07.330 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-10T21:01:07.330 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-10T21:01:07.330 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-10T21:01:07.330 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-10T21:01:07.330 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-10T21:01:07.331 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-10T21:01:07.331 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-10T21:01:07.331 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-10T21:01:07.331 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-10T21:01:07.331 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-10T21:01:07.332 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-10T21:01:07.332 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-10T21:01:07.332 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-10T21:01:07.332 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-10T21:01:07.332 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-10T21:01:07.333 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-10T21:01:07.333 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-10T21:01:07.333 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-10T21:01:07.333 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-10T21:01:07.333 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-10T21:01:07.334 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-10T21:01:07.334 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-10T21:01:07.334 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-10T21:01:07.334 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-10T21:01:07.335 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-10T21:01:07.335 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:17.2.6-1374.g46d1f59b.el8.x86_64 119/122 2023-10-10T21:01:07.335 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-10T21:01:07.335 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:17.2.6-1374.g46d1f59b.el8.x86_64 121/122 2023-10-10T21:01:09.713 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-10T21:01:09.714 INFO:teuthology.orchestra.run.smithi179.stdout:Last metadata expiration check: 0:02:02 ago on Tue 10 Oct 2023 08:59:07 PM UTC. 2023-10-10T21:01:11.810 INFO:teuthology.orchestra.run.smithi179.stdout:Installed products updated. 2023-10-10T21:01:11.944 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:11.945 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2023-10-10T21:01:11.945 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.945 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.945 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2023-10-10T21:01:11.945 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.1-7.el8.noarch 2023-10-10T21:01:11.946 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.0.4-10.el8.x86_64 2023-10-10T21:01:11.946 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.946 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.946 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.946 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.947 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.947 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.947 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.947 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.947 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.948 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.948 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.948 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.948 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.948 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.949 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.949 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.949 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.949 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.949 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.950 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.950 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.950 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.950 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:17.2.6-1374.g46d1f59b.el8.noarch 2023-10-10T21:01:11.950 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-10T21:01:11.951 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.1-9.el8.x86_64 2023-10-10T21:01:11.951 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-10T21:01:11.951 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-10T21:01:11.951 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.5-12.el8.x86_64 2023-10-10T21:01:11.951 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-10T21:01:11.952 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-10T21:01:11.952 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-10T21:01:11.952 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.952 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.952 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.953 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-10T21:01:11.953 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-10T21:01:11.953 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-10T21:01:11.953 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-10T21:01:11.953 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-10T21:01:11.953 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.954 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.954 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-10T21:01:11.954 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.954 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-10T21:01:11.954 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-10T21:01:11.955 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-10T21:01:11.955 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-10T21:01:11.955 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-10T21:01:11.955 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-10T21:01:11.955 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-10T21:01:11.956 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-10T21:01:11.956 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-10T21:01:11.956 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-10T21:01:11.956 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-10T21:01:11.956 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-10T21:01:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-10T21:01:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-10T21:01:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-10T21:01:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-10T21:01:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-10T21:01:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-10T21:01:11.958 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-10T21:01:11.958 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.958 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.958 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.958 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-10T21:01:11.959 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-10T21:01:11.959 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-10T21:01:11.959 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-10T21:01:11.959 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-10T21:01:11.959 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-10T21:01:11.960 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-10T21:01:11.960 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-10T21:01:11.960 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-10T21:01:11.960 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-10T21:01:11.960 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-10T21:01:11.960 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-10T21:01:11.961 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-10T21:01:11.961 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-10T21:01:11.961 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-10T21:01:11.961 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-10T21:01:11.961 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-10T21:01:11.962 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-10T21:01:11.962 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-10T21:01:11.962 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-10T21:01:11.962 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-2.6-1.el8.noarch 2023-10-10T21:01:11.962 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-10T21:01:11.963 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-10T21:01:11.963 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-10T21:01:11.963 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-10T21:01:11.963 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.963 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.964 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-10T21:01:11.964 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-10T21:01:11.964 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.964 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-10T21:01:11.964 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-10T21:01:11.965 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-10T21:01:11.965 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-10T21:01:11.965 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-10T21:01:11.965 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-10T21:01:11.965 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-10T21:01:11.965 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-10T21:01:11.966 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-10T21:01:11.966 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-10T21:01:11.966 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-10T21:01:11.966 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-10T21:01:11.966 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-10T21:01:11.967 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.967 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.967 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:17.2.6-1374.g46d1f59b.el8.x86_64 2023-10-10T21:01:11.967 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-10T21:01:11.967 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-10T21:01:11.967 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-10T21:01:11.968 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-10T21:01:11.968 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-10T21:01:11.968 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:11.969 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-10-10T21:01:12.281 DEBUG:teuthology.parallel:result is None 2023-10-10T21:01:12.282 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=46d1f59b549730ba7f93d940a3d32b94c45a4cf7 2023-10-10T21:01:12.663 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-10T21:01:12.715 INFO:teuthology.orchestra.run.smithi154.stdout:17.2.6-1374.g46d1f59b.el8 2023-10-10T21:01:12.716 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1374.g46d1f59b.el8 2023-10-10T21:01:12.716 INFO:teuthology.task.install:The correct ceph version 17.2.6-1374.g46d1f59b is installed. 2023-10-10T21:01:12.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=46d1f59b549730ba7f93d940a3d32b94c45a4cf7 2023-10-10T21:01:12.852 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-10T21:01:12.899 INFO:teuthology.orchestra.run.smithi179.stdout:17.2.6-1374.g46d1f59b.el8 2023-10-10T21:01:12.899 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1374.g46d1f59b.el8 2023-10-10T21:01:12.899 INFO:teuthology.task.install:The correct ceph version 17.2.6-1374.g46d1f59b is installed. 2023-10-10T21:01:12.900 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-10T21:01:12.900 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:12.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-10T21:01:12.990 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:12.991 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-10T21:01:13.074 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-10T21:01:13.074 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:13.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2023-10-10T21:01:13.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-10T21:01:13.240 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:13.241 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2023-10-10T21:01:13.301 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-10T21:01:13.402 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-10T21:01:13.402 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:13.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-10T21:01:13.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-10T21:01:13.563 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:13.563 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-10T21:01:13.625 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-10T21:01:13.734 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-10T21:01:13.735 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:13.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2023-10-10T21:01:13.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-10T21:01:13.896 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:13.897 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2023-10-10T21:01:13.962 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-10T21:01:14.071 INFO:teuthology.run_tasks:Running task ceph... 2023-10-10T21:01:14.146 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-10T21:01:14.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2023-10-10T21:01:14.152 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2023-10-10T21:01:14.216 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-10T21:01:14.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-10T21:01:14.223 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-10T21:01:14.289 INFO:tasks.ceph:Creating extra log directories... 2023-10-10T21:01:14.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-10T21:01:14.294 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-10T21:01:14.365 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-10T21:01:14.366 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-10T21:01:14.366 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-10T21:01:14.367 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:14.367 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-10T21:01:14.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-10T21:01:14.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-10T21:01:14.669 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:14.669 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-10T21:01:14.706 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-10T21:01:14.927 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-10T21:01:14.995 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-10T21:01:14.995 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-10T21:01:14.996 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506', 'branch': 'wip-yuri3-testing-2023-10-10-0720-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7420506', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-10-0720-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-10-0720-quincy', 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2048, 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-10-0720-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_46d1f59b549730ba7f93d940a3d32b94c45a4cf7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7', 'targets': {'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNAa0MyBX2SU4fh7sucJJWCW69Q9CDdzir7pJcHcQDH8NGhcNSLzbBDzXXohkDW3rbYVuMgCDjVnwTEySKowwPA=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN7S5515JYyPdNib3a3l7tnFLiIwt94OcfgmTLunS2XukTJ83ie3YP/0+lZiRm1skvf9eMKCQG33cCv81WblGTo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '46d1f59b549730ba7f93d940a3d32b94c45a4cf7', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-10_18:16:52', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-10T21:01:14.997 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-10T21:01:15.001 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-10T21:01:15.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2023-10-10T21:01:15.078 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2023-10-10T21:01:15.139 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:15.139 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2023-10-10T21:01:15.176 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-10T21:01:15.176 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2023-10-10T21:01:15.252 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-10T21:01:15.253 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-10T21:01:15.253 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-10T21:01:15.253 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-10T21:01:15.253 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-10-10T21:01:15.254 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-10-10 21:00:58.772002631 +0000 2023-10-10T21:01:15.254 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-10-10 20:58:12.967611027 +0000 2023-10-10T21:01:15.254 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-10-10 20:58:12.967611027 +0000 2023-10-10T21:01:15.254 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-10-10T21:01:15.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-10T21:01:15.357 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-10-10T21:01:15.357 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-10-10T21:01:15.358 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000364461 s, 1.4 MB/s 2023-10-10T21:01:15.360 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-10T21:01:15.400 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2023-10-10T21:01:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-10T21:01:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-10T21:01:15.480 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-10T21:01:15.481 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-10T21:01:15.481 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-10-10T21:01:15.481 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-10-10 21:00:58.772002631 +0000 2023-10-10T21:01:15.481 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-10-10 20:58:13.751591112 +0000 2023-10-10T21:01:15.482 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-10-10 20:58:13.751591112 +0000 2023-10-10T21:01:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-10-10T21:01:15.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-10T21:01:15.578 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-10-10T21:01:15.579 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-10-10T21:01:15.579 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000309389 s, 1.7 MB/s 2023-10-10T21:01:15.581 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-10T21:01:15.619 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2023-10-10T21:01:15.697 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-10T21:01:15.697 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-10T21:01:15.697 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-10T21:01:15.698 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-10T21:01:15.698 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-10-10T21:01:15.698 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-10-10 21:00:58.772002631 +0000 2023-10-10T21:01:15.698 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-10-10 20:58:14.526571425 +0000 2023-10-10T21:01:15.698 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-10-10 20:58:14.526571425 +0000 2023-10-10T21:01:15.698 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-10-10T21:01:15.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-10T21:01:15.794 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-10-10T21:01:15.795 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-10-10T21:01:15.795 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000328948 s, 1.6 MB/s 2023-10-10T21:01:15.797 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-10T21:01:15.835 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2023-10-10T21:01:15.913 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-10T21:01:15.913 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-10T21:01:15.913 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-10T21:01:15.913 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-10T21:01:15.914 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-10-10T21:01:15.914 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-10-10 21:00:58.772002631 +0000 2023-10-10T21:01:15.914 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-10-10 20:58:15.310551510 +0000 2023-10-10T21:01:15.914 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-10-10 20:58:15.310551510 +0000 2023-10-10T21:01:15.915 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-10-10T21:01:15.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-10T21:01:16.011 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-10-10T21:01:16.011 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-10-10T21:01:16.011 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000322781 s, 1.6 MB/s 2023-10-10T21:01:16.013 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-10T21:01:16.051 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:16.052 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:16.052 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2023-10-10T21:01:16.091 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-10T21:01:16.091 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2023-10-10T21:01:16.170 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-10T21:01:16.170 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-10T21:01:16.170 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-10T21:01:16.170 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-10T21:01:16.171 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-10T21:01:16.171 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-10 21:01:06.723711476 +0000 2023-10-10T21:01:16.171 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-10 20:58:11.223070621 +0000 2023-10-10T21:01:16.171 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-10 20:58:11.223070621 +0000 2023-10-10T21:01:16.171 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-10T21:01:16.172 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-10T21:01:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-10T21:01:16.273 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-10T21:01:16.273 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000371165 s, 1.4 MB/s 2023-10-10T21:01:16.275 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-10T21:01:16.314 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2023-10-10T21:01:16.392 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-10T21:01:16.393 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-10T21:01:16.393 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-10T21:01:16.393 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-10T21:01:16.393 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-10T21:01:16.394 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-10 21:01:06.723711476 +0000 2023-10-10T21:01:16.394 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-10 20:58:12.015053787 +0000 2023-10-10T21:01:16.394 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-10 20:58:12.015053787 +0000 2023-10-10T21:01:16.394 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-10T21:01:16.395 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-10T21:01:16.490 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-10T21:01:16.491 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-10T21:01:16.491 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000275601 s, 1.9 MB/s 2023-10-10T21:01:16.493 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-10T21:01:16.532 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2023-10-10T21:01:16.611 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-10T21:01:16.612 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-10T21:01:16.612 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-10T21:01:16.612 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-10T21:01:16.612 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-10T21:01:16.612 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-10 21:01:06.724711454 +0000 2023-10-10T21:01:16.613 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-10 20:58:12.831036438 +0000 2023-10-10T21:01:16.613 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-10 20:58:12.831036438 +0000 2023-10-10T21:01:16.613 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-10T21:01:16.613 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-10T21:01:16.709 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-10T21:01:16.709 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-10T21:01:16.710 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000306779 s, 1.7 MB/s 2023-10-10T21:01:16.712 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-10T21:01:16.749 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2023-10-10T21:01:16.826 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-10T21:01:16.826 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-10T21:01:16.826 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-10T21:01:16.827 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-10T21:01:16.827 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-10T21:01:16.827 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-10 21:01:06.724711454 +0000 2023-10-10T21:01:16.827 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-10 20:58:13.598020131 +0000 2023-10-10T21:01:16.827 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-10 20:58:13.598020131 +0000 2023-10-10T21:01:16.828 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-10T21:01:16.828 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-10T21:01:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-10T21:01:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-10T21:01:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000303626 s, 1.7 MB/s 2023-10-10T21:01:16.930 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-10T21:01:16.969 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:16.969 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-10T21:01:16.969 INFO:tasks.ceph:Generating config... 2023-10-10T21:01:16.971 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-10T21:01:16.971 INFO:tasks.ceph:[client] debug client = 20 2023-10-10T21:01:16.971 INFO:tasks.ceph:[client] debug ms = 1 2023-10-10T21:01:16.972 INFO:tasks.ceph:[client] pid file = 2023-10-10T21:01:16.972 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-10T21:01:16.972 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-10T21:01:16.973 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-10T21:01:16.973 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-10T21:01:16.973 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-10T21:01:16.973 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-10T21:01:16.974 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-10T21:01:16.974 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-10T21:01:16.974 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-10T21:01:16.974 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-10T21:01:16.975 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-10T21:01:16.975 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-10T21:01:16.975 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-10T21:01:16.975 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-10T21:01:16.976 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-10T21:01:16.976 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-10T21:01:16.976 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-10T21:01:16.976 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-10T21:01:16.977 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-10T21:01:16.977 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-10T21:01:16.977 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-10T21:01:16.977 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-10T21:01:16.978 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-10T21:01:16.978 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-10T21:01:16.978 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-10T21:01:16.979 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-10T21:01:16.979 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-10T21:01:16.979 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-10T21:01:16.979 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-10T21:01:16.980 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-10T21:01:16.980 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-10T21:01:16.980 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-10T21:01:16.981 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-10T21:01:16.981 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-10T21:01:16.981 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-10T21:01:16.982 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-10T21:01:16.982 INFO:tasks.ceph:Setting up mon.a... 2023-10-10T21:01:16.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-10T21:01:17.087 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.keyring 2023-10-10T21:01:17.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-10T21:01:17.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-10T21:01:17.241 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.154'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2023-10-10T21:01:17.242 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.154,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-10T21:01:17.243 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:17.244 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-10T21:01:17.280 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.154 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:17.392 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:17.393 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: generated fsid 8fc592ed-075f-4c05-97bb-c4c6e0f43dd7 2023-10-10T21:01:17.393 INFO:teuthology.orchestra.run.smithi154.stdout:setting min_mon_release = octopus 2023-10-10T21:01:17.393 INFO:teuthology.orchestra.run.smithi154.stdout:epoch 0 2023-10-10T21:01:17.393 INFO:teuthology.orchestra.run.smithi154.stdout:fsid 8fc592ed-075f-4c05-97bb-c4c6e0f43dd7 2023-10-10T21:01:17.394 INFO:teuthology.orchestra.run.smithi154.stdout:last_changed 2023-10-10T21:01:17.392542+0000 2023-10-10T21:01:17.394 INFO:teuthology.orchestra.run.smithi154.stdout:created 2023-10-10T21:01:17.392542+0000 2023-10-10T21:01:17.394 INFO:teuthology.orchestra.run.smithi154.stdout:min_mon_release 15 (octopus) 2023-10-10T21:01:17.394 INFO:teuthology.orchestra.run.smithi154.stdout:election_strategy: 1 2023-10-10T21:01:17.395 INFO:teuthology.orchestra.run.smithi154.stdout:0: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.a 2023-10-10T21:01:17.395 INFO:teuthology.orchestra.run.smithi154.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2023-10-10T21:01:17.395 INFO:teuthology.orchestra.run.smithi154.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2023-10-10T21:01:17.395 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-10T21:01:17.397 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-10T21:01:17.432 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8fc592ed-075f-4c05-97bb-c4c6e0f43dd7... 2023-10-10T21:01:17.434 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-10T21:01:17.477 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-10T21:01:17.583 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2023-10-10T21:01:17.584 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2023-10-10T21:01:17.584 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-10T21:01:17.584 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2023-10-10T21:01:17.584 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.585 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2023-10-10T21:01:17.585 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.585 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2023-10-10T21:01:17.585 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.585 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2023-10-10T21:01:17.586 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2023-10-10T21:01:17.586 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.586 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2023-10-10T21:01:17.586 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2023-10-10T21:01:17.586 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.587 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-10T21:01:17.587 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2023-10-10T21:01:17.587 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.587 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2023-10-10T21:01:17.587 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-10T21:01:17.588 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.588 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2023-10-10T21:01:17.588 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.588 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2023-10-10T21:01:17.589 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2023-10-10T21:01:17.589 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2023-10-10T21:01:17.589 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2023-10-10T21:01:17.589 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2023-10-10T21:01:17.589 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2023-10-10T21:01:17.590 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2023-10-10T21:01:17.590 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-10T21:01:17.590 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-10T21:01:17.590 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2023-10-10T21:01:17.590 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.591 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-10T21:01:17.591 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.591 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2023-10-10T21:01:17.591 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.592 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2023-10-10T21:01:17.592 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.592 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2023-10-10T21:01:17.592 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2023-10-10T21:01:17.592 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2023-10-10T21:01:17.593 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.154,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-10-10T21:01:17.593 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on skipped message = False 2023-10-10T21:01:17.593 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 8fc592ed-075f-4c05-97bb-c4c6e0f43dd7 2023-10-10T21:01:17.594 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.594 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2023-10-10T21:01:17.595 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2023-10-10T21:01:17.595 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.595 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2023-10-10T21:01:17.595 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2023-10-10T21:01:17.595 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2023-10-10T21:01:17.596 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.596 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2023-10-10T21:01:17.596 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2023-10-10T21:01:17.596 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.596 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2023-10-10T21:01:17.597 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2023-10-10T21:01:17.597 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2023-10-10T21:01:17.597 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.597 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2023-10-10T21:01:17.597 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2023-10-10T21:01:17.598 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.598 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2023-10-10T21:01:17.598 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.598 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2023-10-10T21:01:17.598 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.599 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2023-10-10T21:01:17.599 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.599 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2023-10-10T21:01:17.599 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2023-10-10T21:01:17.599 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.599 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2023-10-10T21:01:17.600 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2023-10-10T21:01:17.600 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2023-10-10T21:01:17.600 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2023-10-10T21:01:17.600 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2023-10-10T21:01:17.600 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2023-10-10T21:01:17.601 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2023-10-10T21:01:17.601 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2023-10-10T21:01:17.601 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2023-10-10T21:01:17.601 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-10-10T21:01:17.601 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2023-10-10T21:01:17.602 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2023-10-10T21:01:17.602 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2023-10-10T21:01:17.602 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2023-10-10T21:01:17.602 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2023-10-10T21:01:17.603 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2023-10-10T21:01:17.603 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2023-10-10T21:01:17.603 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-10-10T21:01:17.603 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.603 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2023-10-10T21:01:17.603 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-10-10T21:01:17.604 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2023-10-10T21:01:17.604 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-10-10T21:01:17.604 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-10-10T21:01:17.604 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-10-10T21:01:17.604 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-10-10T21:01:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2023-10-10T21:01:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2023-10-10T21:01:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: debug finisher = 20 2023-10-10T21:01:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.605 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2023-10-10T21:01:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-10-10T21:01:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-10-10T21:01:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2023-10-10T21:01:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-10-10T21:01:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2023-10-10T21:01:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2023-10-10T21:01:17.607 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-10-10T21:01:17.607 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2023-10-10T21:01:17.607 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2023-10-10T21:01:17.607 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-10-10T21:01:17.607 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.608 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-10T21:01:17.608 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2023-10-10T21:01:17.608 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2023-10-10T21:01:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2023-10-10T21:01:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-10T21:01:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-10T21:01:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2023-10-10T21:01:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2023-10-10T21:01:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2023-10-10T21:01:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2023-10-10T21:01:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:17.611 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2023-10-10T21:01:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2023-10-10T21:01:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2023-10-10T21:01:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2023-10-10T21:01:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-10T21:01:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-10T21:01:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2023-10-10T21:01:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2023-10-10T21:01:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-10-10T21:01:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2023-10-10T21:01:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-10-10T21:01:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-10-10T21:01:17.613 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2023-10-10T21:01:17.613 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2023-10-10T21:01:17.613 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2023-10-10T21:01:17.613 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-10-10T21:01:17.614 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-10-10T21:01:17.614 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-10-10T21:01:17.614 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-10-10T21:01:17.614 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2023-10-10T21:01:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2023-10-10T21:01:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-10-10T21:01:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2023-10-10T21:01:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2023-10-10T21:01:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2023-10-10T21:01:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2023-10-10T21:01:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-10-10T21:01:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-10-10T21:01:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-10-10T21:01:17.617 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2023-10-10T21:01:17.617 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2023-10-10T21:01:17.617 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-10T21:01:17.617 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2023-10-10T21:01:17.617 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.618 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2023-10-10T21:01:17.618 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.618 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2023-10-10T21:01:17.618 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.618 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2023-10-10T21:01:17.619 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2023-10-10T21:01:17.619 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.619 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2023-10-10T21:01:17.619 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2023-10-10T21:01:17.619 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.619 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-10T21:01:17.620 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2023-10-10T21:01:17.620 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.620 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2023-10-10T21:01:17.620 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-10T21:01:17.620 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.621 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2023-10-10T21:01:17.621 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.621 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2023-10-10T21:01:17.621 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2023-10-10T21:01:17.621 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2023-10-10T21:01:17.621 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2023-10-10T21:01:17.622 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2023-10-10T21:01:17.622 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2023-10-10T21:01:17.622 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2023-10-10T21:01:17.622 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-10T21:01:17.622 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-10T21:01:17.623 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2023-10-10T21:01:17.623 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.623 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-10T21:01:17.623 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.623 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2023-10-10T21:01:17.623 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2023-10-10T21:01:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2023-10-10T21:01:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2023-10-10T21:01:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2023-10-10T21:01:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.154,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-10-10T21:01:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2023-10-10T21:01:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 8fc592ed-075f-4c05-97bb-c4c6e0f43dd7 2023-10-10T21:01:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.625 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2023-10-10T21:01:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2023-10-10T21:01:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2023-10-10T21:01:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2023-10-10T21:01:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2023-10-10T21:01:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2023-10-10T21:01:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2023-10-10T21:01:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2023-10-10T21:01:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2023-10-10T21:01:17.628 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2023-10-10T21:01:17.628 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.628 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2023-10-10T21:01:17.628 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2023-10-10T21:01:17.628 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.628 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2023-10-10T21:01:17.629 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.629 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2023-10-10T21:01:17.629 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.629 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2023-10-10T21:01:17.629 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.630 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2023-10-10T21:01:17.630 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2023-10-10T21:01:17.630 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.630 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2023-10-10T21:01:17.630 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2023-10-10T21:01:17.630 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2023-10-10T21:01:17.631 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2023-10-10T21:01:17.631 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2023-10-10T21:01:17.631 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2023-10-10T21:01:17.631 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2023-10-10T21:01:17.631 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2023-10-10T21:01:17.632 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2023-10-10T21:01:17.632 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-10T21:01:17.632 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2023-10-10T21:01:17.632 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2023-10-10T21:01:17.632 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2023-10-10T21:01:17.633 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2023-10-10T21:01:17.633 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2023-10-10T21:01:17.633 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2023-10-10T21:01:17.633 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2023-10-10T21:01:17.633 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-10-10T21:01:17.633 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.634 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2023-10-10T21:01:17.634 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-10T21:01:17.634 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2023-10-10T21:01:17.634 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-10-10T21:01:17.634 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-10-10T21:01:17.635 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-10-10T21:01:17.635 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-10-10T21:01:17.635 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2023-10-10T21:01:17.635 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-10-10T21:01:17.635 INFO:teuthology.orchestra.run.smithi179.stdout: debug finisher = 20 2023-10-10T21:01:17.635 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.636 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2023-10-10T21:01:17.636 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-10T21:01:17.636 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-10-10T21:01:17.636 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2023-10-10T21:01:17.636 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-10-10T21:01:17.636 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2023-10-10T21:01:17.637 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2023-10-10T21:01:17.637 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-10-10T21:01:17.637 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2023-10-10T21:01:17.637 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2023-10-10T21:01:17.637 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-10-10T21:01:17.638 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.638 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-10T21:01:17.638 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2023-10-10T21:01:17.638 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2023-10-10T21:01:17.638 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.639 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2023-10-10T21:01:17.639 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-10T21:01:17.639 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-10T21:01:17.639 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.639 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2023-10-10T21:01:17.639 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2023-10-10T21:01:17.640 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.640 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2023-10-10T21:01:17.640 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2023-10-10T21:01:17.640 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-10T21:01:17.640 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2023-10-10T21:01:17.641 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2023-10-10T21:01:17.641 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2023-10-10T21:01:17.641 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2023-10-10T21:01:17.641 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-10T21:01:17.641 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-10T21:01:17.641 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2023-10-10T21:01:17.642 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-10-10T21:01:17.642 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-10T21:01:17.642 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2023-10-10T21:01:17.642 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-10-10T21:01:17.642 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-10-10T21:01:17.643 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2023-10-10T21:01:17.643 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2023-10-10T21:01:17.643 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2023-10-10T21:01:17.643 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-10-10T21:01:17.643 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-10-10T21:01:17.643 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-10-10T21:01:17.644 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-10-10T21:01:17.644 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2023-10-10T21:01:17.644 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2023-10-10T21:01:17.644 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-10T21:01:17.644 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2023-10-10T21:01:17.644 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2023-10-10T21:01:17.645 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2023-10-10T21:01:17.645 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2023-10-10T21:01:17.645 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-10-10T21:01:17.645 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-10-10T21:01:17.645 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-10-10T21:01:17.647 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-10T21:01:17.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-10T21:01:17.746 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-10T21:01:17.746 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:17.746 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-10T21:01:17.783 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:17.783 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-10T21:01:17.858 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:01:17.858 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:17.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-10T21:01:17.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-10T21:01:18.026 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:18.026 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:18.062 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T21:01:18.062 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:18.063 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-10T21:01:18.063 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-10T21:01:18.151 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:18.152 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:18.230 INFO:tasks.ceph:Setting up mon nodes... 2023-10-10T21:01:18.230 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-10T21:01:18.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-10T21:01:18.342 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-10T21:01:18.347 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-10T21:01:18.471 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-10T21:01:18.477 INFO:tasks.ceph:Setting up mds nodes... 2023-10-10T21:01:18.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-10T21:01:18.589 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-10T21:01:18.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-10T21:01:18.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-10T21:01:18.761 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-10T21:01:18.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-10T21:01:18.828 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-10T21:01:18.938 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-10T21:01:18.943 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-10T21:01:19.005 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-10T21:01:19.116 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-10T21:01:19.121 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-10T21:01:19.183 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-10T21:01:19.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-10T21:01:19.275 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-10T21:01:19.307 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-10T21:01:19.390 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-10T21:01:19.421 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-10T21:01:19.505 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-10T21:01:19.538 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-10T21:01:19.621 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-10T21:01:19.652 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-10T21:01:19.652 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-10T21:01:19.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-10T21:01:19.714 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:19.715 INFO:tasks.ceph:role: osd.0 2023-10-10T21:01:19.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:01:19.715 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-10T21:01:19.784 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-10T21:01:19.784 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-10T21:01:19.784 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-10T21:01:19.784 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 2023-10-10T21:01:19.785 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-10T21:01:19.785 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-10-10T21:01:19.785 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-10T21:01:19.785 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-10T21:01:19.785 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-10T21:01:19.785 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-10T21:01:20.217 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-10-10T21:01:20.220 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-10-10T21:01:20.221 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-10T21:01:20.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-10T21:01:20.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-10T21:01:20.552 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:20.553 INFO:tasks.ceph:role: osd.1 2023-10-10T21:01:20.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:01:20.554 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-10T21:01:20.621 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-10T21:01:20.622 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-10T21:01:20.622 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-10T21:01:20.622 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 2023-10-10T21:01:20.622 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-10T21:01:20.623 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-10-10T21:01:20.623 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-10T21:01:20.623 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-10T21:01:20.623 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-10T21:01:20.623 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-10T21:01:21.031 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-10-10T21:01:21.038 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-10-10T21:01:21.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-10T21:01:21.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-10T21:01:21.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-10T21:01:21.300 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:21.301 INFO:tasks.ceph:role: osd.2 2023-10-10T21:01:21.301 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:01:21.301 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-10T21:01:21.370 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-10T21:01:21.370 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-10T21:01:21.370 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-10T21:01:21.370 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 2023-10-10T21:01:21.371 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-10T21:01:21.371 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-10-10T21:01:21.371 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-10T21:01:21.371 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-10T21:01:21.371 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-10T21:01:21.372 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-10T21:01:21.815 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-10-10T21:01:21.819 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-10-10T21:01:21.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-10T21:01:22.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-10T21:01:22.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-10T21:01:22.140 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:22.141 INFO:tasks.ceph:role: osd.3 2023-10-10T21:01:22.141 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:01:22.141 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-10T21:01:22.209 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-10T21:01:22.209 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-10T21:01:22.209 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-10T21:01:22.210 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 2023-10-10T21:01:22.210 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-10T21:01:22.210 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-10-10T21:01:22.210 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-10T21:01:22.210 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-10T21:01:22.211 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-10T21:01:22.211 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-10T21:01:22.651 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-10-10T21:01:22.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-10-10T21:01:22.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-10T21:01:22.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-10T21:01:22.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:22.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:22.989+0000 7f0c88960540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-10T21:01:22.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:22.990+0000 7f0c88960540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-10T21:01:22.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:22.990+0000 7f0c88960540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-10T21:01:22.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:22.990+0000 7f0c88960540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-10T21:01:22.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:22.990+0000 7f0c88960540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-10T21:01:22.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:22.992+0000 7f0c88960540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-10T21:01:23.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:23.528+0000 7f0c88960540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:24.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:24.294+0000 7f0c88960540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:25.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:25.059+0000 7f0c88960540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:25.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-10T21:01:25.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:26.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:26.041+0000 7f816e490540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-10T21:01:26.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:26.042+0000 7f816e490540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-10T21:01:26.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:26.042+0000 7f816e490540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-10T21:01:26.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:26.042+0000 7f816e490540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-10T21:01:26.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:26.042+0000 7f816e490540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-10T21:01:26.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:26.043+0000 7f816e490540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-10T21:01:26.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:26.579+0000 7f816e490540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:27.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:27.341+0000 7f816e490540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:28.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:28.105+0000 7f816e490540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:28.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-10T21:01:28.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:29.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:29.073+0000 7f37e46f5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-10T21:01:29.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:29.073+0000 7f37e46f5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-10T21:01:29.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:29.073+0000 7f37e46f5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-10T21:01:29.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:29.073+0000 7f37e46f5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-10T21:01:29.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:29.073+0000 7f37e46f5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-10T21:01:29.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:29.075+0000 7f37e46f5540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-10T21:01:29.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:29.615+0000 7f37e46f5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:30.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:30.378+0000 7f37e46f5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:31.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:31.141+0000 7f37e46f5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:31.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-10T21:01:32.014 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:32.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:32.104+0000 7f9cb0752540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-10T21:01:32.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:32.104+0000 7f9cb0752540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-10T21:01:32.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:32.104+0000 7f9cb0752540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-10T21:01:32.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:32.104+0000 7f9cb0752540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-10T21:01:32.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:32.104+0000 7f9cb0752540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-10T21:01:32.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:32.106+0000 7f9cb0752540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-10T21:01:32.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:32.643+0000 7f9cb0752540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:33.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:33.403+0000 7f9cb0752540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:34.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:34.167+0000 7f9cb0752540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:34.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-10T21:01:35.046 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-10T21:01:35.115 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:35.116 INFO:tasks.ceph:role: osd.4 2023-10-10T21:01:35.116 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T21:01:35.116 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-10T21:01:35.185 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-10T21:01:35.186 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-10T21:01:35.186 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-10T21:01:35.186 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-10T21:01:35.187 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-10T21:01:35.187 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-10T21:01:35.187 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-10T21:01:35.187 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-10T21:01:35.187 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-10T21:01:35.188 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-10T21:01:35.612 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-10T21:01:35.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-10T21:01:35.616 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-10T21:01:35.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-10T21:01:35.876 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-10T21:01:35.938 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:35.938 INFO:tasks.ceph:role: osd.5 2023-10-10T21:01:35.938 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T21:01:35.939 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-10T21:01:36.006 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-10T21:01:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-10T21:01:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-10T21:01:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-10T21:01:36.030 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-10T21:01:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-10T21:01:36.030 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-10T21:01:36.031 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-10T21:01:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-10T21:01:36.031 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-10T21:01:36.419 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-10T21:01:36.423 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-10T21:01:36.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-10T21:01:36.555 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-10T21:01:36.623 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-10T21:01:36.683 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:36.684 INFO:tasks.ceph:role: osd.6 2023-10-10T21:01:36.684 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T21:01:36.684 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-10T21:01:36.753 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-10T21:01:36.753 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-10T21:01:36.753 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-10T21:01:36.753 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-10T21:01:36.754 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-10T21:01:36.754 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-10T21:01:36.754 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-10T21:01:36.754 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-10T21:01:36.754 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-10T21:01:36.755 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-10T21:01:37.197 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-10T21:01:37.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-10T21:01:37.201 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-10T21:01:37.388 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-10T21:01:37.456 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-10T21:01:37.516 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-10T21:01:37.517 INFO:tasks.ceph:role: osd.7 2023-10-10T21:01:37.517 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T21:01:37.518 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-10T21:01:37.585 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-10T21:01:37.585 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-10T21:01:37.585 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-10T21:01:37.585 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-10T21:01:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-10T21:01:37.586 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-10T21:01:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-10T21:01:37.586 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-10T21:01:37.587 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-10T21:01:37.587 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-10T21:01:38.029 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-10T21:01:38.032 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-10T21:01:38.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-10T21:01:38.175 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-10T21:01:38.242 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:38.356 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:38.355+0000 7fec4114c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-10T21:01:38.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:38.356+0000 7fec4114c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-10T21:01:38.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:38.356+0000 7fec4114c540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-10T21:01:38.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:38.356+0000 7fec4114c540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-10T21:01:38.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:38.356+0000 7fec4114c540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-10T21:01:38.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:38.358+0000 7fec4114c540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-10T21:01:38.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:38.893+0000 7fec4114c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:39.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:39.655+0000 7fec4114c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:40.421 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:40.419+0000 7fec4114c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:41.239 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-10T21:01:41.305 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:41.397 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:41.395+0000 7fa2fa9b5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-10T21:01:41.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:41.395+0000 7fa2fa9b5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-10T21:01:41.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:41.395+0000 7fa2fa9b5540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-10T21:01:41.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:41.395+0000 7fa2fa9b5540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-10T21:01:41.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:41.395+0000 7fa2fa9b5540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-10T21:01:41.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:41.397+0000 7fa2fa9b5540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-10T21:01:41.935 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:41.933+0000 7fa2fa9b5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:42.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:42.694+0000 7fa2fa9b5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:43.459 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:43.457+0000 7fa2fa9b5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:44.271 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-10T21:01:44.336 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:44.427 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:44.425+0000 7fd2b0d15540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-10T21:01:44.428 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:44.426+0000 7fd2b0d15540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-10T21:01:44.428 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:44.426+0000 7fd2b0d15540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-10T21:01:44.428 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:44.426+0000 7fd2b0d15540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-10T21:01:44.428 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:44.426+0000 7fd2b0d15540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-10T21:01:44.429 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:44.427+0000 7fd2b0d15540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-10T21:01:44.966 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:44.965+0000 7fd2b0d15540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:44.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:01:45.004 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:01:45.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:45.734+0000 7fd2b0d15540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:46.500 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:46.498+0000 7fd2b0d15540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:47.317 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-10T21:01:47.380 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:47.471 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:47.469+0000 7f0c66617540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-10T21:01:47.471 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:47.469+0000 7f0c66617540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-10T21:01:47.471 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:47.469+0000 7f0c66617540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-10T21:01:47.472 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:47.469+0000 7f0c66617540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-10T21:01:47.472 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:47.469+0000 7f0c66617540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-10T21:01:47.472 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:47.471+0000 7f0c66617540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-10T21:01:48.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:48.006+0000 7f0c66617540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:48.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:48.768+0000 7f0c66617540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:49.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:49.530+0000 7f0c66617540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-10T21:01:50.340 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-10T21:01:50.404 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-10T21:01:50.404 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:50.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-10T21:01:50.474 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:50.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-10T21:01:50.577 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:50.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-10T21:01:50.679 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:50.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-10T21:01:50.779 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:50.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-10T21:01:50.880 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:50.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-10T21:01:50.980 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:50.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-10T21:01:51.080 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:51.081 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-10T21:01:51.147 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:51.147 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-10T21:01:51.251 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:51.251 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-10T21:01:51.351 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:51.352 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-10T21:01:51.451 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:51.452 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-10T21:01:51.551 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:51.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-10T21:01:51.651 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:51.651 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-10T21:01:51.750 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:51.751 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-10T21:01:51.788 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:51.789 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-10T21:01:51.866 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:51.866 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-10T21:01:51.901 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:51.902 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-10T21:01:51.976 INFO:tasks.ceph:Adding keys to all mons... 2023-10-10T21:01:51.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-10T21:01:51.982 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-10T21:01:52.036 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2023-10-10T21:01:52.036 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA== 2023-10-10T21:01:52.036 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-10-10T21:01:52.036 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ== 2023-10-10T21:01:52.037 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-10-10T21:01:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A== 2023-10-10T21:01:52.037 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2023-10-10T21:01:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA== 2023-10-10T21:01:52.037 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2023-10-10T21:01:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw== 2023-10-10T21:01:52.038 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2023-10-10T21:01:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw== 2023-10-10T21:01:52.038 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2023-10-10T21:01:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw== 2023-10-10T21:01:52.039 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2023-10-10T21:01:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw== 2023-10-10T21:01:52.039 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-10-10T21:01:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg== 2023-10-10T21:01:52.039 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-10-10T21:01:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A== 2023-10-10T21:01:52.040 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2023-10-10T21:01:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A== 2023-10-10T21:01:52.040 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2023-10-10T21:01:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q== 2023-10-10T21:01:52.041 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2023-10-10T21:01:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g== 2023-10-10T21:01:52.041 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2023-10-10T21:01:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw== 2023-10-10T21:01:52.041 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2023-10-10T21:01:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw== 2023-10-10T21:01:52.042 INFO:teuthology.orchestra.run.smithi154.stdout:[client.2] 2023-10-10T21:01:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw== 2023-10-10T21:01:52.042 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2023-10-10T21:01:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ== 2023-10-10T21:01:52.042 INFO:teuthology.orchestra.run.smithi154.stdout:[client.3] 2023-10-10T21:01:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ== 2023-10-10T21:01:52.073 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2023-10-10T21:01:52.074 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA== 2023-10-10T21:01:52.074 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-10-10T21:01:52.074 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ== 2023-10-10T21:01:52.074 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-10-10T21:01:52.075 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A== 2023-10-10T21:01:52.075 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2023-10-10T21:01:52.075 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA== 2023-10-10T21:01:52.075 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2023-10-10T21:01:52.075 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw== 2023-10-10T21:01:52.075 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2023-10-10T21:01:52.076 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw== 2023-10-10T21:01:52.076 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2023-10-10T21:01:52.076 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw== 2023-10-10T21:01:52.076 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2023-10-10T21:01:52.076 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw== 2023-10-10T21:01:52.077 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-10-10T21:01:52.077 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg== 2023-10-10T21:01:52.077 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-10-10T21:01:52.077 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A== 2023-10-10T21:01:52.077 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2023-10-10T21:01:52.078 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A== 2023-10-10T21:01:52.078 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2023-10-10T21:01:52.078 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q== 2023-10-10T21:01:52.078 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2023-10-10T21:01:52.078 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g== 2023-10-10T21:01:52.079 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2023-10-10T21:01:52.079 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw== 2023-10-10T21:01:52.079 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2023-10-10T21:01:52.079 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw== 2023-10-10T21:01:52.079 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2023-10-10T21:01:52.080 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw== 2023-10-10T21:01:52.080 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2023-10-10T21:01:52.080 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ== 2023-10-10T21:01:52.080 INFO:teuthology.orchestra.run.smithi179.stdout:[client.3] 2023-10-10T21:01:52.080 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ== 2023-10-10T21:01:52.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-10T21:01:52.088 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-10T21:01:52.215 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-10T21:01:52.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-10T21:01:52.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-10T21:01:52.322 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-10T21:01:52.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:52.424 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:52.518 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:52.523 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:52.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:52.622 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:52.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:52.720 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:52.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-10T21:01:52.819 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-10T21:01:52.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-10T21:01:52.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-10T21:01:53.014 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-10T21:01:53.019 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-10T21:01:53.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:53.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:53.214 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:53.219 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:53.313 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:53.317 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:53.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:53.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-10T21:01:53.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-10T21:01:53.517 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-10T21:01:53.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-10T21:01:53.619 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-10T21:01:53.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-10T21:01:53.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-10T21:01:53.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-10T21:01:53.822 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-10T21:01:53.919 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-10T21:01:53.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-10T21:01:53.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-10T21:01:54.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-10T21:01:54.150 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-10T21:01:54.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-10T21:01:54.321 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-10T21:01:54.381 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-10T21:01:54.442 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-10T21:01:54.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-10T21:01:54.610 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:54.615 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-10T21:01:54.650 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-10T21:01:54.650 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-10T21:01:54.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-10T21:01:54.690 INFO:tasks.ceph.mon.a:Started 2023-10-10T21:01:54.691 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-10T21:01:54.691 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-10T21:01:54.695 INFO:tasks.ceph.mon.b:Started 2023-10-10T21:01:54.696 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-10T21:01:54.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-10T21:01:54.700 INFO:tasks.ceph.mon.c:Started 2023-10-10T21:01:54.700 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-10T21:01:54.701 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-10T21:01:54.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-10T21:01:54.705 INFO:tasks.ceph.mgr.y:Started 2023-10-10T21:01:54.706 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-10T21:01:54.706 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-10T21:01:54.711 INFO:tasks.ceph.mgr.x:Started 2023-10-10T21:01:54.712 INFO:tasks.ceph:Setting crush tunables to default 2023-10-10T21:01:54.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd crush tunables default 2023-10-10T21:01:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.895+0000 7f6eba59d700 1 Processor -- start 2023-10-10T21:01:54.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.895+0000 7f6eba59d700 1 -- start start 2023-10-10T21:01:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.896+0000 7f6eba59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 0x7f6eb40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:54.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.896+0000 7f6eba59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6eb40b16d0 0x7f6eb40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:54.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.896+0000 7f6eba59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40b2080 con 0x7f6eb415d240 2023-10-10T21:01:54.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.896+0000 7f6eba59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40cfb00 con 0x7f6eb40b16d0 2023-10-10T21:01:54.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.896+0000 7f6eba59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40b5c40 con 0x7f6eb40b4e70 2023-10-10T21:01:54.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb8d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6eb40b16d0 0x7f6eb40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb959b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 0x7f6eb40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb9d9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6eb415d240 0x7f6eb415d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:53498/0 (socket says 172.21.15.154:53498) 2023-10-10T21:01:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb8d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6eb40b16d0 0x7f6eb40b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:57276/0 (socket says 172.21.15.154:57276) 2023-10-10T21:01:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb9d9c700 1 -- 172.21.15.154:0/1881727024 learned_addr learned my addr 172.21.15.154:0/1881727024 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:01:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb8d9a700 1 -- 172.21.15.154:0/1881727024 >> v2:172.21.15.179:3300/0 conn(0x7f6eb40b16d0 msgr2=0x7f6eb40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-10T21:01:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb8d9a700 1 -- 172.21.15.154:0/1881727024 >> v2:172.21.15.179:3300/0 conn(0x7f6eb40b16d0 msgr2=0x7f6eb40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-10T21:01:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb959b700 1 -- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 msgr2=0x7f6eb40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-10T21:01:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb959b700 1 -- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 msgr2=0x7f6eb40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-10T21:01:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb8d9a700 1 --2- 172.21.15.154:0/1881727024 >> v2:172.21.15.179:3300/0 conn(0x7f6eb40b16d0 0x7f6eb40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-10T21:01:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb959b700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 0x7f6eb40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-10T21:01:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb959b700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 0x7f6eb40ccff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:01:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:54.897+0000 7f6eb8d9a700 1 --2- 172.21.15.154:0/1881727024 >> v2:172.21.15.179:3300/0 conn(0x7f6eb40b16d0 0x7f6eb40b1b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:01:55.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568747937 0 0) 0x7f6eb40b2080 con 0x7f6eb415d240 2023-10-10T21:01:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea0003570 con 0x7f6eb415d240 2023-10-10T21:01:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1024485519 0 0) 0x7f6ea0003570 con 0x7f6eb415d240 2023-10-10T21:01:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 msgr2=0x7f6eb40ccff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-10T21:01:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 0x7f6eb40ccff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 >> v2:172.21.15.179:3300/0 conn(0x7f6eb40b16d0 msgr2=0x7f6eb40b1b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-10T21:01:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 --2- 172.21.15.154:0/1881727024 >> v2:172.21.15.179:3300/0 conn(0x7f6eb40b16d0 0x7f6eb40b1b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40b5f20 con 0x7f6eb415d240 2023-10-10T21:01:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f6eac0017f0 con 0x7f6eb415d240 2023-10-10T21:01:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 >> v1:172.21.15.179:6789/0 conn(0x7f6eb415d240 legacy=0x7f6eb415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 0x7f6ea0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ea0004090 0x7f6ea0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004d50 0x7f6ea00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40cfb00 con 0x7f6ea0004090 2023-10-10T21:01:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40b5c40 con 0x7f6ea0004d50 2023-10-10T21:01:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea000bbf0 con 0x7f6eb40b4e70 2023-10-10T21:01:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.092+0000 7f6eb9d9c700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004d50 0x7f6ea00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eb959b700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 0x7f6ea0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eb8d9a700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ea0004090 0x7f6ea0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eb8d9a700 1 -- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 msgr2=0x7f6ea0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:01:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eb8d9a700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40b4e70 0x7f6ea0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eb8d9a700 1 -- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004d50 msgr2=0x7f6ea00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:01:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eb8d9a700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004d50 0x7f6ea00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eb8d9a700 1 -- 172.21.15.154:0/1881727024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea0003570 con 0x7f6ea0004090 2023-10-10T21:01:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eb8d9a700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ea0004090 0x7f6ea0004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400bb40 tx=0x7f6ea4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4664f32602de21 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4018070 con 0x7f6ea0004090 2023-10-10T21:01:55.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea400d5d0 con 0x7f6ea0004090 2023-10-10T21:01:55.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.093+0000 7f6eabfff700 1 -- 172.21.15.154:0/1881727024 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400d990 con 0x7f6ea0004090 2023-10-10T21:01:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.094+0000 7f6eba59d700 1 -- 172.21.15.154:0/1881727024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ea0004090 msgr2=0x7f6ea0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.094+0000 7f6eba59d700 1 --2- 172.21.15.154:0/1881727024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ea0004090 0x7f6ea0004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400bb40 tx=0x7f6ea4008040 comp rx=0 tx=0).stop 2023-10-10T21:01:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.094+0000 7f6eb9d9c700 1 -- 172.21.15.154:0/1881727024 reap_dead start 2023-10-10T21:01:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.095+0000 7f6eba59d700 1 -- 172.21.15.154:0/1881727024 shutdown_connections 2023-10-10T21:01:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.095+0000 7f6eba59d700 1 -- 172.21.15.154:0/1881727024 >> 172.21.15.154:0/1881727024 conn(0x7f6eb40d10c0 msgr2=0x7f6eb40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.095+0000 7f6eba59d700 1 -- 172.21.15.154:0/1881727024 shutdown_connections 2023-10-10T21:01:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.095+0000 7f6eba59d700 1 -- 172.21.15.154:0/1881727024 wait complete. 2023-10-10T21:01:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.097+0000 7f6eba59d700 1 Processor -- start 2023-10-10T21:01:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.097+0000 7f6eba59d700 1 -- start start 2023-10-10T21:01:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.098+0000 7f6eba59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004090 0x7f6eb40c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.098+0000 7f6eba59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40cb210 0x7f6eb40b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.098+0000 7f6eba59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4168ca0 0x7f6eb41690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb959b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004090 0x7f6eb40c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb959b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004090 0x7f6eb40c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:57318/0 (socket says 172.21.15.154:57318) 2023-10-10T21:01:55.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb959b700 1 -- 172.21.15.154:0/741735522 learned_addr learned my addr 172.21.15.154:0/741735522 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:01:55.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40cc650 con 0x7f6eb4168ca0 2023-10-10T21:01:55.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40c6430 con 0x7f6ea0004090 2023-10-10T21:01:55.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40cba40 con 0x7f6eb40cb210 2023-10-10T21:01:55.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb9d9c700 1 --2- 172.21.15.154:0/741735522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4168ca0 0x7f6eb41690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb8d9a700 1 --2- 172.21.15.154:0/741735522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40cb210 0x7f6eb40b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb9d9c700 1 -- 172.21.15.154:0/741735522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40cb210 msgr2=0x7f6eb40b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb9d9c700 1 --2- 172.21.15.154:0/741735522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40cb210 0x7f6eb40b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb9d9c700 1 -- 172.21.15.154:0/741735522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004090 msgr2=0x7f6eb40c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb9d9c700 1 --2- 172.21.15.154:0/741735522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004090 0x7f6eb40c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb9d9c700 1 -- 172.21.15.154:0/741735522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40cbd20 con 0x7f6eb4168ca0 2023-10-10T21:01:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.099+0000 7f6eb9d9c700 1 --2- 172.21.15.154:0/741735522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4168ca0 0x7f6eb41690f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4067e90 tx=0x7f6eac002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.100+0000 7f6ea97fa700 1 -- 172.21.15.154:0/741735522 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00acd0 con 0x7f6eb4168ca0 2023-10-10T21:01:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.100+0000 7f6ea97fa700 1 -- 172.21.15.154:0/741735522 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac00ae30 con 0x7f6eb4168ca0 2023-10-10T21:01:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.100+0000 7f6ea97fa700 1 -- 172.21.15.154:0/741735522 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac013640 con 0x7f6eb4168ca0 2023-10-10T21:01:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.100+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb40cc000 con 0x7f6eb4168ca0 2023-10-10T21:01:55.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.100+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4169630 con 0x7f6eb4168ca0 2023-10-10T21:01:55.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.100+0000 7f6ea97fa700 1 -- 172.21.15.154:0/741735522 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6eac0139f0 con 0x7f6eb4168ca0 2023-10-10T21:01:55.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.100+0000 7f6ea97fa700 1 -- 172.21.15.154:0/741735522 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6eac01d980 con 0x7f6eb4168ca0 2023-10-10T21:01:55.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.101+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb40cc800 con 0x7f6eb4168ca0 2023-10-10T21:01:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.104+0000 7f6ea97fa700 1 -- 172.21.15.154:0/741735522 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6eb40cc800 con 0x7f6eb4168ca0 2023-10-10T21:01:55.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.195+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6eb404bb80 con 0x7f6eb4168ca0 2023-10-10T21:01:55.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.203+0000 7f6ea97fa700 1 -- 172.21.15.154:0/741735522 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6eac01db40 con 0x7f6eb4168ca0 2023-10-10T21:01:55.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.204+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4168ca0 msgr2=0x7f6eb41690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:55.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.204+0000 7f6eba59d700 1 --2- 172.21.15.154:0/741735522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4168ca0 0x7f6eb41690f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4067e90 tx=0x7f6eac002210 comp rx=0 tx=0).stop 2023-10-10T21:01:55.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.204+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 shutdown_connections 2023-10-10T21:01:55.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.204+0000 7f6eba59d700 1 --2- 172.21.15.154:0/741735522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb4168ca0 0x7f6eb41690f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:55.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.204+0000 7f6eba59d700 1 --2- 172.21.15.154:0/741735522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0004090 0x7f6eb40c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:55.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.204+0000 7f6eba59d700 1 --2- 172.21.15.154:0/741735522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40cb210 0x7f6eb40b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:55.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.204+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 >> 172.21.15.154:0/741735522 conn(0x7f6eb40d10c0 msgr2=0x7f6eb415cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:55.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.204+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 shutdown_connections 2023-10-10T21:01:55.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:55.204+0000 7f6eba59d700 1 -- 172.21.15.154:0/741735522 wait complete. 2023-10-10T21:01:55.207 INFO:teuthology.orchestra.run.smithi154.stderr:adjusted tunables profile to default 2023-10-10T21:01:55.222 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-10T21:01:55.222 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:55.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-10T21:01:55.283 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:55.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-10T21:01:55.384 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:55.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-10T21:01:55.486 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-10-10T21:01:55.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-10T21:01:55.587 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:55.588 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-10T21:01:55.651 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:55.651 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-10T21:01:55.753 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:55.753 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-10T21:01:55.854 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-10T21:01:55.854 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-10T21:01:55.964 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new e2acaf55-f1fa-471d-8227-582419ad91df 0 2023-10-10T21:01:56.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.181+0000 7fec8359d700 1 Processor -- start 2023-10-10T21:01:56.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.181+0000 7fec8359d700 1 -- start start 2023-10-10T21:01:56.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.182+0000 7fec8359d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec7c0b4e70 0x7fec7c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.182+0000 7fec8359d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec7c0b1b40 0x7fec7c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.185 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.182+0000 7fec8359d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c0cfb00 con 0x7fec7c0b16d0 2023-10-10T21:01:56.185 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.182+0000 7fec8359d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c0b5c40 con 0x7fec7c0b1b40 2023-10-10T21:01:56.185 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.182+0000 7fec8359d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c0b5f20 con 0x7fec7c0b4e70 2023-10-10T21:01:56.186 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.182+0000 7fec8259b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec7c0b4e70 0x7fec7c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.186 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec8259b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec7c0b4e70 0x7fec7c0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:47666/0 (socket says 172.21.15.179:47666) 2023-10-10T21:01:56.186 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec8259b700 1 -- 172.21.15.179:0/3643556199 learned_addr learned my addr 172.21.15.179:0/3643556199 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:56.186 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec81d9a700 1 --1- 172.21.15.179:0/3643556199 >> v1:172.21.15.179:6789/0 conn(0x7fec7c0b16d0 0x7fec7c15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:54412/0 (socket says 172.21.15.179:54412) 2023-10-10T21:01:56.186 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec82d9c700 1 --2- 172.21.15.179:0/3643556199 >> v2:172.21.15.154:3300/0 conn(0x7fec7c0b1b40 0x7fec7c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec8259b700 1 -- 172.21.15.179:0/3643556199 >> v2:172.21.15.154:3300/0 conn(0x7fec7c0b1b40 msgr2=0x7fec7c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:01:56.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec8259b700 1 --2- 172.21.15.179:0/3643556199 >> v2:172.21.15.154:3300/0 conn(0x7fec7c0b1b40 0x7fec7c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec81599700 1 -- 172.21.15.179:0/3643556199 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37388726 0 0) 0x7fec7c0cfb00 con 0x7fec7c0b16d0 2023-10-10T21:01:56.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec8259b700 1 -- 172.21.15.179:0/3643556199 >> v1:172.21.15.179:6789/0 conn(0x7fec7c0b16d0 legacy=0x7fec7c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec8259b700 1 -- 172.21.15.179:0/3643556199 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0b6200 con 0x7fec7c0b4e70 2023-10-10T21:01:56.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec8259b700 1 --2- 172.21.15.179:0/3643556199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b4e70 0x7fec7c0ccff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fec7c064910 tx=0x7fec78009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec62d324e6a0bc4e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:56.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec81599700 1 -- 172.21.15.179:0/3643556199 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78009e70 con 0x7fec7c0b4e70 2023-10-10T21:01:56.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec81599700 1 -- 172.21.15.179:0/3643556199 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7800b860 con 0x7fec7c0b4e70 2023-10-10T21:01:56.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.183+0000 7fec81599700 1 -- 172.21.15.179:0/3643556199 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800bc00 con 0x7fec7c0b4e70 2023-10-10T21:01:56.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.184+0000 7fec8359d700 1 -- 172.21.15.179:0/3643556199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b4e70 msgr2=0x7fec7c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.184+0000 7fec8359d700 1 --2- 172.21.15.179:0/3643556199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b4e70 0x7fec7c0ccff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fec7c064910 tx=0x7fec78009250 comp rx=0 tx=0).stop 2023-10-10T21:01:56.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.184+0000 7fec8359d700 1 -- 172.21.15.179:0/3643556199 shutdown_connections 2023-10-10T21:01:56.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.184+0000 7fec8359d700 1 --2- 172.21.15.179:0/3643556199 >> v2:172.21.15.154:3300/0 conn(0x7fec7c0b1b40 0x7fec7c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.184+0000 7fec8359d700 1 --2- 172.21.15.179:0/3643556199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b4e70 0x7fec7c0ccff0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.184+0000 7fec8359d700 1 -- 172.21.15.179:0/3643556199 >> 172.21.15.179:0/3643556199 conn(0x7fec7c0d10c0 msgr2=0x7fec7c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:56.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.184+0000 7fec8359d700 1 -- 172.21.15.179:0/3643556199 shutdown_connections 2023-10-10T21:01:56.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.184+0000 7fec8359d700 1 -- 172.21.15.179:0/3643556199 wait complete. 2023-10-10T21:01:56.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.186+0000 7fec8359d700 1 Processor -- start 2023-10-10T21:01:56.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.187+0000 7fec8359d700 1 -- start start 2023-10-10T21:01:56.196 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec8359d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b16d0 0x7fec7c14a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.196 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec8359d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c0b1b40 0x7fec7c169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.196 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec8359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7c0b4e70 0x7fec7c16a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.196 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec8359d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c16a5f0 con 0x7fec7c0b1b40 2023-10-10T21:01:56.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec8359d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c1493a0 con 0x7fec7c0b16d0 2023-10-10T21:01:56.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec8359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c149680 con 0x7fec7c0b4e70 2023-10-10T21:01:56.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec8259b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b16d0 0x7fec7c14a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec8259b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b16d0 0x7fec7c14a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:47682/0 (socket says 172.21.15.179:47682) 2023-10-10T21:01:56.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec8259b700 1 -- 172.21.15.179:0/3037163874 learned_addr learned my addr 172.21.15.179:0/3037163874 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:56.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.188+0000 7fec82d9c700 1 --2- 172.21.15.179:0/3037163874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7c0b4e70 0x7fec7c16a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec81d9a700 1 --2- 172.21.15.179:0/3037163874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c0b1b40 0x7fec7c169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec8259b700 1 -- 172.21.15.179:0/3037163874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7c0b4e70 msgr2=0x7fec7c16a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec8259b700 1 --2- 172.21.15.179:0/3037163874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7c0b4e70 0x7fec7c16a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec8259b700 1 -- 172.21.15.179:0/3037163874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c0b1b40 msgr2=0x7fec7c169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec8259b700 1 --2- 172.21.15.179:0/3037163874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c0b1b40 0x7fec7c169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec8259b700 1 -- 172.21.15.179:0/3037163874 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec780094f0 con 0x7fec7c0b16d0 2023-10-10T21:01:56.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec8259b700 1 --2- 172.21.15.179:0/3037163874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b16d0 0x7fec7c14a440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec780094c0 tx=0x7fec78017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:56.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec727fc700 1 -- 172.21.15.179:0/3037163874 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800bbe0 con 0x7fec7c0b16d0 2023-10-10T21:01:56.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec727fc700 1 -- 172.21.15.179:0/3037163874 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec78000c90 con 0x7fec7c0b16d0 2023-10-10T21:01:56.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec8359d700 1 -- 172.21.15.179:0/3037163874 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c149960 con 0x7fec7c0b16d0 2023-10-10T21:01:56.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.189+0000 7fec727fc700 1 -- 172.21.15.179:0/3037163874 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78011650 con 0x7fec7c0b16d0 2023-10-10T21:01:56.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.190+0000 7fec8359d700 1 -- 172.21.15.179:0/3037163874 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c149f20 con 0x7fec7c0b16d0 2023-10-10T21:01:56.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.190+0000 7fec727fc700 1 -- 172.21.15.179:0/3037163874 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fec78011cc0 con 0x7fec7c0b16d0 2023-10-10T21:01:56.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.190+0000 7fec727fc700 1 -- 172.21.15.179:0/3037163874 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fec7802eb50 con 0x7fec7c0b16d0 2023-10-10T21:01:56.201 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.191+0000 7fec8359d700 1 -- 172.21.15.179:0/3037163874 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c088990 con 0x7fec7c0b16d0 2023-10-10T21:01:56.201 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.193+0000 7fec727fc700 1 -- 172.21.15.179:0/3037163874 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fec78033060 con 0x7fec7c0b16d0 2023-10-10T21:01:56.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.278+0000 7fec8359d700 1 -- 172.21.15.179:0/3037163874 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e2acaf55-f1fa-471d-8227-582419ad91df", "id": 0} v 0) v1 -- 0x7fec7c04bb80 con 0x7fec7c0b16d0 2023-10-10T21:01:56.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.284+0000 7fec727fc700 1 -- 172.21.15.179:0/3037163874 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2acaf55-f1fa-471d-8227-582419ad91df", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fec78015020 con 0x7fec7c0b16d0 2023-10-10T21:01:56.286 INFO:teuthology.orchestra.run.smithi179.stdout:0 2023-10-10T21:01:56.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.285+0000 7fec8359d700 1 -- 172.21.15.179:0/3037163874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b16d0 msgr2=0x7fec7c14a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.285+0000 7fec8359d700 1 --2- 172.21.15.179:0/3037163874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b16d0 0x7fec7c14a440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec780094c0 tx=0x7fec78017000 comp rx=0 tx=0).stop 2023-10-10T21:01:56.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.286+0000 7fec8359d700 1 -- 172.21.15.179:0/3037163874 shutdown_connections 2023-10-10T21:01:56.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.286+0000 7fec8359d700 1 --2- 172.21.15.179:0/3037163874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7c0b4e70 0x7fec7c16a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.286+0000 7fec8359d700 1 --2- 172.21.15.179:0/3037163874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7c0b16d0 0x7fec7c14a440 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.286+0000 7fec8359d700 1 --2- 172.21.15.179:0/3037163874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c0b1b40 0x7fec7c169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.286+0000 7fec8359d700 1 -- 172.21.15.179:0/3037163874 >> 172.21.15.179:0/3037163874 conn(0x7fec7c0d10c0 msgr2=0x7fec7c0b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:56.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.286+0000 7fec8359d700 1 -- 172.21.15.179:0/3037163874 shutdown_connections 2023-10-10T21:01:56.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.286+0000 7fec8359d700 1 -- 172.21.15.179:0/3037163874 wait complete. 2023-10-10T21:01:56.304 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 024f6abe-9ee6-4fd7-8213-1af957686e2c 1 2023-10-10T21:01:56.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.482+0000 7f161b59e700 1 Processor -- start 2023-10-10T21:01:56.484 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.482+0000 7f161b59e700 1 -- start start 2023-10-10T21:01:56.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.483+0000 7f161b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.483+0000 7f161b59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c0b2080 con 0x7f161c0b4e70 2023-10-10T21:01:56.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.483+0000 7f161b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c0cfb00 con 0x7f161c0b33b0 2023-10-10T21:01:56.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.483+0000 7f161b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0b5c40 con 0x7f161c0b16d0 2023-10-10T21:01:56.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.483+0000 7f1619d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.483+0000 7f1619d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:54700/0 (socket says 172.21.15.179:54700) 2023-10-10T21:01:56.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.483+0000 7f161ad9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f161c0b33b0 0x7f161c0b3830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:54414/0 (socket says 172.21.15.179:54414) 2023-10-10T21:01:56.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.483+0000 7f1619d9b700 1 -- 172.21.15.179:0/3372522935 learned_addr learned my addr 172.21.15.179:0/3372522935 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:56.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.484+0000 7f1619d9b700 1 -- 172.21.15.179:0/3372522935 >> v1:172.21.15.179:6789/0 conn(0x7f161c0b33b0 legacy=0x7f161c0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.484+0000 7f1619d9b700 1 -- 172.21.15.179:0/3372522935 >> v1:172.21.15.154:6789/0 conn(0x7f161c0b4e70 legacy=0x7f161c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.484+0000 7f161959a700 1 -- 172.21.15.179:0/3372522935 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469202421 0 0) 0x7f161c0cfb00 con 0x7f161c0b33b0 2023-10-10T21:01:56.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.484+0000 7f1619d9b700 1 -- 172.21.15.179:0/3372522935 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0b5f20 con 0x7f161c0b16d0 2023-10-10T21:01:56.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.484+0000 7f1619d9b700 1 --2- 172.21.15.179:0/3372522935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c0b1b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f16100099e0 tx=0x7f1610009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f4734c43ab3ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:56.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.484+0000 7f161959a700 1 -- 172.21.15.179:0/3372522935 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000b860 con 0x7f161c0b16d0 2023-10-10T21:01:56.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.485+0000 7f161959a700 1 -- 172.21.15.179:0/3372522935 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000b9c0 con 0x7f161c0b16d0 2023-10-10T21:01:56.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.485+0000 7f161959a700 1 -- 172.21.15.179:0/3372522935 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000bd80 con 0x7f161c0b16d0 2023-10-10T21:01:56.490 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.485+0000 7f161b59e700 1 -- 172.21.15.179:0/3372522935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 msgr2=0x7f161c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.490 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.485+0000 7f161b59e700 1 --2- 172.21.15.179:0/3372522935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c0b1b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f16100099e0 tx=0x7f1610009250 comp rx=0 tx=0).stop 2023-10-10T21:01:56.490 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.485+0000 7f161b59e700 1 -- 172.21.15.179:0/3372522935 shutdown_connections 2023-10-10T21:01:56.490 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.485+0000 7f161b59e700 1 --2- 172.21.15.179:0/3372522935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c0b1b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.485+0000 7f161b59e700 1 -- 172.21.15.179:0/3372522935 >> 172.21.15.179:0/3372522935 conn(0x7f161c0d10c0 msgr2=0x7f161c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:56.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.485+0000 7f161b59e700 1 -- 172.21.15.179:0/3372522935 shutdown_connections 2023-10-10T21:01:56.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.485+0000 7f161b59e700 1 -- 172.21.15.179:0/3372522935 wait complete. 2023-10-10T21:01:56.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.487+0000 7f161b59e700 1 Processor -- start 2023-10-10T21:01:56.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.487+0000 7f161b59e700 1 -- start start 2023-10-10T21:01:56.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161c0b33b0 0x7f161c0a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161c0b4e70 0x7f161c0a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0a7ea0 con 0x7f161c0b4e70 2023-10-10T21:01:56.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0a8f10 con 0x7f161c0b33b0 2023-10-10T21:01:56.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0a78e0 con 0x7f161c0b16d0 2023-10-10T21:01:56.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f1619d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161c0b33b0 0x7f161c0a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:54716/0 (socket says 172.21.15.179:54716) 2023-10-10T21:01:56.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161a59c700 1 -- 172.21.15.179:0/761843189 learned_addr learned my addr 172.21.15.179:0/761843189 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:56.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161ad9d700 1 --2- 172.21.15.179:0/761843189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161c0b4e70 0x7f161c0a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161a59c700 1 -- 172.21.15.179:0/761843189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161c0b33b0 msgr2=0x7f161c0a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161a59c700 1 --2- 172.21.15.179:0/761843189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161c0b33b0 0x7f161c0a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161a59c700 1 -- 172.21.15.179:0/761843189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161c0b4e70 msgr2=0x7f161c0a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161a59c700 1 --2- 172.21.15.179:0/761843189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161c0b4e70 0x7f161c0a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f161a59c700 1 -- 172.21.15.179:0/761843189 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100094f0 con 0x7f161c0b16d0 2023-10-10T21:01:56.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.488+0000 7f1619d9b700 1 --2- 172.21.15.179:0/761843189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161c0b33b0 0x7f161c0a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:01:56.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.489+0000 7f161a59c700 1 --2- 172.21.15.179:0/761843189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c158200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f160c00c4e0 tx=0x7f160c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:56.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.489+0000 7f160a7fc700 1 -- 172.21.15.179:0/761843189 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c011590 con 0x7f161c0b16d0 2023-10-10T21:01:56.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.489+0000 7f160a7fc700 1 -- 172.21.15.179:0/761843189 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c011710 con 0x7f161c0b16d0 2023-10-10T21:01:56.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.489+0000 7f160a7fc700 1 -- 172.21.15.179:0/761843189 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c011ad0 con 0x7f161c0b16d0 2023-10-10T21:01:56.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.489+0000 7f161b59e700 1 -- 172.21.15.179:0/761843189 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c0a7bc0 con 0x7f161c0b16d0 2023-10-10T21:01:56.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.489+0000 7f161b59e700 1 -- 172.21.15.179:0/761843189 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c0a8230 con 0x7f161c0b16d0 2023-10-10T21:01:56.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.489+0000 7f160a7fc700 1 -- 172.21.15.179:0/761843189 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f160c01c6c0 con 0x7f161c0b16d0 2023-10-10T21:01:56.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.489+0000 7f160a7fc700 1 -- 172.21.15.179:0/761843189 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f160c0127e0 con 0x7f161c0b16d0 2023-10-10T21:01:56.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.490+0000 7f161b59e700 1 -- 172.21.15.179:0/761843189 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c0a8420 con 0x7f161c0b16d0 2023-10-10T21:01:56.499 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:56.495+0000 7f1c55035180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:01:56.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.495+0000 7f160a7fc700 1 -- 172.21.15.179:0/761843189 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f161c0a8420 con 0x7f161c0b16d0 2023-10-10T21:01:56.513 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:56.511+0000 7f569557a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:01:56.581 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.580+0000 7f161b59e700 1 -- 172.21.15.179:0/761843189 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "024f6abe-9ee6-4fd7-8213-1af957686e2c", "id": 1} v 0) v1 -- 0x7f161c0a91f0 con 0x7f161c0b16d0 2023-10-10T21:01:56.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.584+0000 7f160a7fc700 1 -- 172.21.15.179:0/761843189 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "024f6abe-9ee6-4fd7-8213-1af957686e2c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f160c017070 con 0x7f161c0b16d0 2023-10-10T21:01:56.586 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-10T21:01:56.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.585+0000 7f161b59e700 1 -- 172.21.15.179:0/761843189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 msgr2=0x7f161c158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.585+0000 7f161b59e700 1 --2- 172.21.15.179:0/761843189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c158200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f160c00c4e0 tx=0x7f160c00c7f0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.585+0000 7f161b59e700 1 -- 172.21.15.179:0/761843189 shutdown_connections 2023-10-10T21:01:56.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.585+0000 7f161b59e700 1 --2- 172.21.15.179:0/761843189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161c0b4e70 0x7f161c0a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.585+0000 7f161b59e700 1 --2- 172.21.15.179:0/761843189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161c0b16d0 0x7f161c158200 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.585+0000 7f161b59e700 1 --2- 172.21.15.179:0/761843189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161c0b33b0 0x7f161c0a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.585+0000 7f161b59e700 1 -- 172.21.15.179:0/761843189 >> 172.21.15.179:0/761843189 conn(0x7f161c0d10c0 msgr2=0x7f161c0c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:56.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.585+0000 7f161b59e700 1 -- 172.21.15.179:0/761843189 shutdown_connections 2023-10-10T21:01:56.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.585+0000 7f161b59e700 1 -- 172.21.15.179:0/761843189 wait complete. 2023-10-10T21:01:56.603 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 2e823ec8-0f2e-4099-8c99-4d90399790b9 2 2023-10-10T21:01:56.660 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:56.659+0000 7f1c55035180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:01:56.687 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:56.685+0000 7f569557a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:01:56.753 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:56.751+0000 7f1c55035180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:01:56.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.780+0000 7f1caf39d700 1 Processor -- start 2023-10-10T21:01:56.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.780+0000 7f1caf39d700 1 -- start start 2023-10-10T21:01:56.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.781+0000 7f1caf39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca80b4e70 0x7f1ca80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.781+0000 7f1caf39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ca80b16d0 0x7f1ca80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.781+0000 7f1caf39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ca815d240 0x7f1ca815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.781+0000 7f1caf39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca80b2080 con 0x7f1ca80b16d0 2023-10-10T21:01:56.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.781+0000 7f1caf39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca80cfb00 con 0x7f1ca815d240 2023-10-10T21:01:56.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.781+0000 7f1caf39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80b5c40 con 0x7f1ca80b4e70 2023-10-10T21:01:56.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1caeb9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ca815d240 0x7f1ca815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cadb9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ca80b16d0 0x7f1ca80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cadb9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ca80b16d0 0x7f1ca80b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.179:44438/0 (socket says 172.21.15.179:44438) 2023-10-10T21:01:56.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cadb9a700 1 -- 172.21.15.179:0/3083730752 learned_addr learned my addr 172.21.15.179:0/3083730752 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:56.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1caeb9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ca815d240 0x7f1ca815d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:34776/0 (socket says 172.21.15.179:34776) 2023-10-10T21:01:56.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cae39b700 1 --2- 172.21.15.179:0/3083730752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca80b4e70 0x7f1ca80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cae39b700 1 -- 172.21.15.179:0/3083730752 >> v2:172.21.15.179:3300/0 conn(0x7f1ca815d240 msgr2=0x7f1ca815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:01:56.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cae39b700 1 --2- 172.21.15.179:0/3083730752 >> v2:172.21.15.179:3300/0 conn(0x7f1ca815d240 0x7f1ca815d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cae39b700 1 -- 172.21.15.179:0/3083730752 >> v2:172.21.15.154:3300/0 conn(0x7f1ca80b16d0 msgr2=0x7f1ca80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:01:56.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cae39b700 1 --2- 172.21.15.179:0/3083730752 >> v2:172.21.15.154:3300/0 conn(0x7f1ca80b16d0 0x7f1ca80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cae39b700 1 -- 172.21.15.179:0/3083730752 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80b5f20 con 0x7f1ca80b4e70 2023-10-10T21:01:56.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1caeb9c700 1 --2- 172.21.15.179:0/3083730752 >> v2:172.21.15.179:3300/0 conn(0x7f1ca815d240 0x7f1ca815d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:01:56.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.782+0000 7f1cae39b700 1 --2- 172.21.15.179:0/3083730752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca80b4e70 0x7f1ca80ccff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1ca815d180 tx=0x7f1ca40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91877731632929a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:56.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.783+0000 7f1cad399700 1 -- 172.21.15.179:0/3083730752 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4011630 con 0x7f1ca80b4e70 2023-10-10T21:01:56.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.783+0000 7f1cad399700 1 -- 172.21.15.179:0/3083730752 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca40117b0 con 0x7f1ca80b4e70 2023-10-10T21:01:56.789 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.783+0000 7f1cad399700 1 -- 172.21.15.179:0/3083730752 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4011b70 con 0x7f1ca80b4e70 2023-10-10T21:01:56.789 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.783+0000 7f1caf39d700 1 -- 172.21.15.179:0/3083730752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca80b4e70 msgr2=0x7f1ca80ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.789 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.783+0000 7f1caf39d700 1 --2- 172.21.15.179:0/3083730752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca80b4e70 0x7f1ca80ccff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1ca815d180 tx=0x7f1ca40091a0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.789 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.784+0000 7f1caf39d700 1 -- 172.21.15.179:0/3083730752 shutdown_connections 2023-10-10T21:01:56.789 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.784+0000 7f1caf39d700 1 --2- 172.21.15.179:0/3083730752 >> v2:172.21.15.179:3300/0 conn(0x7f1ca815d240 0x7f1ca815d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.790 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.784+0000 7f1caf39d700 1 --2- 172.21.15.179:0/3083730752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca80b4e70 0x7f1ca80ccff0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.790 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.784+0000 7f1caf39d700 1 --2- 172.21.15.179:0/3083730752 >> v2:172.21.15.154:3300/0 conn(0x7f1ca80b16d0 0x7f1ca80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.790 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.784+0000 7f1caf39d700 1 -- 172.21.15.179:0/3083730752 >> 172.21.15.179:0/3083730752 conn(0x7f1ca80d10c0 msgr2=0x7f1ca80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:56.790 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.784+0000 7f1caf39d700 1 -- 172.21.15.179:0/3083730752 shutdown_connections 2023-10-10T21:01:56.790 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.784+0000 7f1caf39d700 1 -- 172.21.15.179:0/3083730752 wait complete. 2023-10-10T21:01:56.791 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:56.784+0000 7f569557a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:01:56.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.786+0000 7f1caf39d700 1 Processor -- start 2023-10-10T21:01:56.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.786+0000 7f1caf39d700 1 -- start start 2023-10-10T21:01:56.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1caf39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca80b16d0 0x7f1ca81458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1caf39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ca80b4e70 0x7f1ca80c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1caf39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca815d240 0x7f1ca80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:56.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1caf39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80cbea0 con 0x7f1ca80b4e70 2023-10-10T21:01:56.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1caf39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80c8150 con 0x7f1ca80b16d0 2023-10-10T21:01:56.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1caf39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80c8430 con 0x7f1ca815d240 2023-10-10T21:01:56.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1cae39b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca80b16d0 0x7f1ca81458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.795 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1cae39b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca80b16d0 0x7f1ca81458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:34782/0 (socket says 172.21.15.179:34782) 2023-10-10T21:01:56.795 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1cae39b700 1 -- 172.21.15.179:0/2396663822 learned_addr learned my addr 172.21.15.179:0/2396663822 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:56.795 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1caeb9c700 1 --2- 172.21.15.179:0/2396663822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca815d240 0x7f1ca80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.795 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1cadb9a700 1 --2- 172.21.15.179:0/2396663822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ca80b4e70 0x7f1ca80c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:56.795 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1cae39b700 1 -- 172.21.15.179:0/2396663822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca815d240 msgr2=0x7f1ca80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1cae39b700 1 --2- 172.21.15.179:0/2396663822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca815d240 0x7f1ca80c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1cae39b700 1 -- 172.21.15.179:0/2396663822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ca80b4e70 msgr2=0x7f1ca80c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1cae39b700 1 --2- 172.21.15.179:0/2396663822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ca80b4e70 0x7f1ca80c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.788+0000 7f1cae39b700 1 -- 172.21.15.179:0/2396663822 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0009a20 con 0x7f1ca80b16d0 2023-10-10T21:01:56.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.789+0000 7f1cae39b700 1 --2- 172.21.15.179:0/2396663822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca80b16d0 0x7f1ca81458f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4013000 tx=0x7f1ca4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:56.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.789+0000 7f1c9e7fc700 1 -- 172.21.15.179:0/2396663822 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca401f070 con 0x7f1ca80b16d0 2023-10-10T21:01:56.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.789+0000 7f1c9e7fc700 1 -- 172.21.15.179:0/2396663822 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4000bc0 con 0x7f1ca80b16d0 2023-10-10T21:01:56.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.789+0000 7f1c9e7fc700 1 -- 172.21.15.179:0/2396663822 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4011b70 con 0x7f1ca80b16d0 2023-10-10T21:01:56.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.789+0000 7f1caf39d700 1 -- 172.21.15.179:0/2396663822 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca4009420 con 0x7f1ca80b16d0 2023-10-10T21:01:56.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.789+0000 7f1caf39d700 1 -- 172.21.15.179:0/2396663822 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca80c89f0 con 0x7f1ca80b16d0 2023-10-10T21:01:56.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.789+0000 7f1c9e7fc700 1 -- 172.21.15.179:0/2396663822 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1ca4023070 con 0x7f1ca80b16d0 2023-10-10T21:01:56.798 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.789+0000 7f1c9e7fc700 1 -- 172.21.15.179:0/2396663822 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f1ca4025ce0 con 0x7f1ca80b16d0 2023-10-10T21:01:56.798 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.790+0000 7f1caf39d700 1 -- 172.21.15.179:0/2396663822 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca8088990 con 0x7f1ca80b16d0 2023-10-10T21:01:56.800 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.794+0000 7f1c9e7fc700 1 -- 172.21.15.179:0/2396663822 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1ca402a070 con 0x7f1ca80b16d0 2023-10-10T21:01:56.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.880+0000 7f1caf39d700 1 -- 172.21.15.179:0/2396663822 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e823ec8-0f2e-4099-8c99-4d90399790b9", "id": 2} v 0) v1 -- 0x7f1ca804bb80 con 0x7f1ca80b16d0 2023-10-10T21:01:56.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.884+0000 7f1c9e7fc700 1 -- 172.21.15.179:0/2396663822 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e823ec8-0f2e-4099-8c99-4d90399790b9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ca4015020 con 0x7f1ca80b16d0 2023-10-10T21:01:56.886 INFO:teuthology.orchestra.run.smithi179.stdout:2 2023-10-10T21:01:56.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.885+0000 7f1caf39d700 1 -- 172.21.15.179:0/2396663822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca80b16d0 msgr2=0x7f1ca81458f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:56.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.885+0000 7f1caf39d700 1 --2- 172.21.15.179:0/2396663822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca80b16d0 0x7f1ca81458f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4013000 tx=0x7f1ca4017000 comp rx=0 tx=0).stop 2023-10-10T21:01:56.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.885+0000 7f1caf39d700 1 -- 172.21.15.179:0/2396663822 shutdown_connections 2023-10-10T21:01:56.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.885+0000 7f1caf39d700 1 --2- 172.21.15.179:0/2396663822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca815d240 0x7f1ca80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.885+0000 7f1caf39d700 1 --2- 172.21.15.179:0/2396663822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca80b16d0 0x7f1ca81458f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.885+0000 7f1caf39d700 1 --2- 172.21.15.179:0/2396663822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ca80b4e70 0x7f1ca80c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:56.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.885+0000 7f1caf39d700 1 -- 172.21.15.179:0/2396663822 >> 172.21.15.179:0/2396663822 conn(0x7f1ca80d10c0 msgr2=0x7f1ca8158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:56.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.885+0000 7f1caf39d700 1 -- 172.21.15.179:0/2396663822 shutdown_connections 2023-10-10T21:01:56.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:56.885+0000 7f1caf39d700 1 -- 172.21.15.179:0/2396663822 wait complete. 2023-10-10T21:01:56.903 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 58da5027-bdf3-4989-bd4d-2ab0590dd86f 3 2023-10-10T21:01:56.974 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:56.973+0000 7f1c55035180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:01:57.028 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:57.026+0000 7f569557a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:01:57.086 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.084+0000 7f9449b9d700 1 Processor -- start 2023-10-10T21:01:57.086 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.084+0000 7f9449b9d700 1 -- start start 2023-10-10T21:01:57.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9449b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f94440b16d0 0x7f94440b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9449b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94440b2080 con 0x7f94440b33b0 2023-10-10T21:01:57.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9449b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94440cfb00 con 0x7f94440b4e70 2023-10-10T21:01:57.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9449b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94440b5c40 con 0x7f94440b16d0 2023-10-10T21:01:57.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9443fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f94440b16d0 0x7f94440b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9443fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f94440b16d0 0x7f94440b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:34786/0 (socket says 172.21.15.179:34786) 2023-10-10T21:01:57.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9443fff700 1 -- 172.21.15.179:0/1390322744 learned_addr learned my addr 172.21.15.179:0/1390322744 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:57.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9443fff700 1 -- 172.21.15.179:0/1390322744 >> v1:172.21.15.179:6789/0 conn(0x7f94440b4e70 legacy=0x7f94440ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9443fff700 1 -- 172.21.15.179:0/1390322744 >> v1:172.21.15.154:6789/0 conn(0x7f94440b33b0 legacy=0x7f94440b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.086+0000 7f9443fff700 1 -- 172.21.15.179:0/1390322744 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94440b5f20 con 0x7f94440b16d0 2023-10-10T21:01:57.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.087+0000 7f9443fff700 1 --2- 172.21.15.179:0/1390322744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 0x7f94440b1b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f94300099b0 tx=0x7f9430009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2403c9a8597ebe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:57.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.088+0000 7f94437fe700 1 -- 172.21.15.179:0/1390322744 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000b860 con 0x7f94440b16d0 2023-10-10T21:01:57.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.088+0000 7f94437fe700 1 -- 172.21.15.179:0/1390322744 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943000b9c0 con 0x7f94440b16d0 2023-10-10T21:01:57.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.088+0000 7f94437fe700 1 -- 172.21.15.179:0/1390322744 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000bd80 con 0x7f94440b16d0 2023-10-10T21:01:57.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.089+0000 7f9449b9d700 1 -- 172.21.15.179:0/1390322744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 msgr2=0x7f94440b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.089+0000 7f9449b9d700 1 --2- 172.21.15.179:0/1390322744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 0x7f94440b1b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f94300099b0 tx=0x7f9430009250 comp rx=0 tx=0).stop 2023-10-10T21:01:57.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.089+0000 7f9449b9d700 1 -- 172.21.15.179:0/1390322744 shutdown_connections 2023-10-10T21:01:57.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.089+0000 7f9449b9d700 1 --2- 172.21.15.179:0/1390322744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 0x7f94440b1b40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.089+0000 7f9449b9d700 1 -- 172.21.15.179:0/1390322744 >> 172.21.15.179:0/1390322744 conn(0x7f94440d10c0 msgr2=0x7f94440affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:57.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.089+0000 7f9449b9d700 1 -- 172.21.15.179:0/1390322744 shutdown_connections 2023-10-10T21:01:57.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.089+0000 7f9449b9d700 1 -- 172.21.15.179:0/1390322744 wait complete. 2023-10-10T21:01:57.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.091+0000 7f9449b9d700 1 Processor -- start 2023-10-10T21:01:57.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.091+0000 7f9449b9d700 1 -- start start 2023-10-10T21:01:57.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9449b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 0x7f9444153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9449b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94440b33b0 0x7f94440c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9449b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94440b4e70 0x7f94440cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9449b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9444153780 con 0x7f94440b33b0 2023-10-10T21:01:57.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9449b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944416a410 con 0x7f94440b16d0 2023-10-10T21:01:57.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9449b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944416a0c0 con 0x7f94440b4e70 2023-10-10T21:01:57.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9448b9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 0x7f9444153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f944939c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94440b4e70 0x7f94440cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9448b9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 0x7f9444153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:34788/0 (socket says 172.21.15.179:34788) 2023-10-10T21:01:57.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9448b9b700 1 -- 172.21.15.179:0/3438385179 learned_addr learned my addr 172.21.15.179:0/3438385179 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:57.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.092+0000 7f9443fff700 1 --2- 172.21.15.179:0/3438385179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94440b33b0 0x7f94440c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9448b9b700 1 -- 172.21.15.179:0/3438385179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94440b4e70 msgr2=0x7f94440cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9448b9b700 1 --2- 172.21.15.179:0/3438385179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94440b4e70 0x7f94440cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9448b9b700 1 -- 172.21.15.179:0/3438385179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94440b33b0 msgr2=0x7f94440c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9448b9b700 1 --2- 172.21.15.179:0/3438385179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94440b33b0 0x7f94440c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9448b9b700 1 -- 172.21.15.179:0/3438385179 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94300094f0 con 0x7f94440b16d0 2023-10-10T21:01:57.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9443fff700 1 --2- 172.21.15.179:0/3438385179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94440b33b0 0x7f94440c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:01:57.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9448b9b700 1 --2- 172.21.15.179:0/3438385179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 0x7f9444153240 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f943800c490 tx=0x7f943800c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:57.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9440ff9700 1 -- 172.21.15.179:0/3438385179 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438011590 con 0x7f94440b16d0 2023-10-10T21:01:57.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9440ff9700 1 -- 172.21.15.179:0/3438385179 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9438011710 con 0x7f94440b16d0 2023-10-10T21:01:57.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9440ff9700 1 -- 172.21.15.179:0/3438385179 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438011ad0 con 0x7f94440b16d0 2023-10-10T21:01:57.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9449b9d700 1 -- 172.21.15.179:0/3438385179 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94440c77c0 con 0x7f94440b16d0 2023-10-10T21:01:57.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9449b9d700 1 -- 172.21.15.179:0/3438385179 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94440c7d80 con 0x7f94440b16d0 2023-10-10T21:01:57.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.093+0000 7f9440ff9700 1 -- 172.21.15.179:0/3438385179 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f943801c6c0 con 0x7f94440b16d0 2023-10-10T21:01:57.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.094+0000 7f9440ff9700 1 -- 172.21.15.179:0/3438385179 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f9438012420 con 0x7f94440b16d0 2023-10-10T21:01:57.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.095+0000 7f9449b9d700 1 -- 172.21.15.179:0/3438385179 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9444088990 con 0x7f94440b16d0 2023-10-10T21:01:57.104 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.097+0000 7f9440ff9700 1 -- 172.21.15.179:0/3438385179 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9438017070 con 0x7f94440b16d0 2023-10-10T21:01:57.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.182+0000 7f9449b9d700 1 -- 172.21.15.179:0/3438385179 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "58da5027-bdf3-4989-bd4d-2ab0590dd86f", "id": 3} v 0) v1 -- 0x7f944404bb80 con 0x7f94440b16d0 2023-10-10T21:01:57.185 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:57.184+0000 7f1c55035180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:01:57.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.188+0000 7f9440ff9700 1 -- 172.21.15.179:0/3438385179 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58da5027-bdf3-4989-bd4d-2ab0590dd86f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f943801c970 con 0x7f94440b16d0 2023-10-10T21:01:57.190 INFO:teuthology.orchestra.run.smithi179.stdout:3 2023-10-10T21:01:57.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.189+0000 7f9449b9d700 1 -- 172.21.15.179:0/3438385179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 msgr2=0x7f9444153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.189+0000 7f9449b9d700 1 --2- 172.21.15.179:0/3438385179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 0x7f9444153240 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f943800c490 tx=0x7f943800c7a0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.189+0000 7f9449b9d700 1 -- 172.21.15.179:0/3438385179 shutdown_connections 2023-10-10T21:01:57.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.189+0000 7f9449b9d700 1 --2- 172.21.15.179:0/3438385179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94440b4e70 0x7f94440cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.189+0000 7f9449b9d700 1 --2- 172.21.15.179:0/3438385179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94440b16d0 0x7f9444153240 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.189+0000 7f9449b9d700 1 --2- 172.21.15.179:0/3438385179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94440b33b0 0x7f94440c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.189+0000 7f9449b9d700 1 -- 172.21.15.179:0/3438385179 >> 172.21.15.179:0/3438385179 conn(0x7f94440d10c0 msgr2=0x7f94440c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:57.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.189+0000 7f9449b9d700 1 -- 172.21.15.179:0/3438385179 shutdown_connections 2023-10-10T21:01:57.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.189+0000 7f9449b9d700 1 -- 172.21.15.179:0/3438385179 wait complete. 2023-10-10T21:01:57.207 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 9274498e-7703-4287-96af-33e83969398b 4 2023-10-10T21:01:57.252 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:57.250+0000 7f569557a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:01:57.279 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:57.278+0000 7f1c55035180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:01:57.351 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:57.349+0000 7f569557a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:01:57.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.385+0000 7febf89fe700 1 Processor -- start 2023-10-10T21:01:57.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.385+0000 7febf89fe700 1 -- start start 2023-10-10T21:01:57.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.386+0000 7febf89fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febf40b16d0 0x7febf40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.386+0000 7febf89fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b33b0 0x7febf40b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.386+0000 7febf89fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf40b2080 con 0x7febf40b4e70 2023-10-10T21:01:57.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.386+0000 7febf89fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf40cfb00 con 0x7febf40b16d0 2023-10-10T21:01:57.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.386+0000 7febf89fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf40b5c40 con 0x7febf40b33b0 2023-10-10T21:01:57.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.386+0000 7febf359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b33b0 0x7febf40b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.386+0000 7febf259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febf40b16d0 0x7febf40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.386+0000 7febf359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b33b0 0x7febf40b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60692/0 (socket says 172.21.15.179:60692) 2023-10-10T21:01:57.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.386+0000 7febf359e700 1 -- 172.21.15.179:0/1765740432 learned_addr learned my addr 172.21.15.179:0/1765740432 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:57.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf1d9b700 1 -- 172.21.15.179:0/1765740432 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399482100 0 0) 0x7febf40b2080 con 0x7febf40b4e70 2023-10-10T21:01:57.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf1d9b700 1 -- 172.21.15.179:0/1765740432 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febdc003570 con 0x7febf40b4e70 2023-10-10T21:01:57.392 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf359e700 1 -- 172.21.15.179:0/1765740432 >> v2:172.21.15.154:3300/0 conn(0x7febf40b16d0 msgr2=0x7febf40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:01:57.392 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf359e700 1 --2- 172.21.15.179:0/1765740432 >> v2:172.21.15.154:3300/0 conn(0x7febf40b16d0 0x7febf40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.392 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf359e700 1 -- 172.21.15.179:0/1765740432 >> v1:172.21.15.154:6789/0 conn(0x7febf40b4e70 legacy=0x7febf40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.392 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf359e700 1 -- 172.21.15.179:0/1765740432 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf40b5f20 con 0x7febf40b33b0 2023-10-10T21:01:57.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf359e700 1 --2- 172.21.15.179:0/1765740432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b33b0 0x7febf40b3810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7febec009f20 tx=0x7febec009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a036258504dc98f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:57.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf1d9b700 1 -- 172.21.15.179:0/1765740432 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00e070 con 0x7febf40b33b0 2023-10-10T21:01:57.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf1d9b700 1 -- 172.21.15.179:0/1765740432 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00b970 con 0x7febf40b33b0 2023-10-10T21:01:57.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.387+0000 7febf1d9b700 1 -- 172.21.15.179:0/1765740432 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0092e0 con 0x7febf40b33b0 2023-10-10T21:01:57.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.388+0000 7febf89fe700 1 -- 172.21.15.179:0/1765740432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b33b0 msgr2=0x7febf40b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.388+0000 7febf89fe700 1 --2- 172.21.15.179:0/1765740432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b33b0 0x7febf40b3810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7febec009f20 tx=0x7febec009840 comp rx=0 tx=0).stop 2023-10-10T21:01:57.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.388+0000 7febf89fe700 1 -- 172.21.15.179:0/1765740432 shutdown_connections 2023-10-10T21:01:57.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.388+0000 7febf89fe700 1 --2- 172.21.15.179:0/1765740432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b33b0 0x7febf40b3810 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.388+0000 7febf89fe700 1 --2- 172.21.15.179:0/1765740432 >> v2:172.21.15.154:3300/0 conn(0x7febf40b16d0 0x7febf40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.388+0000 7febf89fe700 1 -- 172.21.15.179:0/1765740432 >> 172.21.15.179:0/1765740432 conn(0x7febf40d10c0 msgr2=0x7febf40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:57.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.388+0000 7febf89fe700 1 -- 172.21.15.179:0/1765740432 shutdown_connections 2023-10-10T21:01:57.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.388+0000 7febf89fe700 1 -- 172.21.15.179:0/1765740432 wait complete. 2023-10-10T21:01:57.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.390+0000 7febf89fe700 1 Processor -- start 2023-10-10T21:01:57.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.390+0000 7febf89fe700 1 -- start start 2023-10-10T21:01:57.397 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf89fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b16d0 0x7febf4149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf89fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b33b0 0x7febf40c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf89fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 0x7febf40ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf89fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf4149670 con 0x7febf40b4e70 2023-10-10T21:01:57.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf89fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40c67d0 con 0x7febf40b33b0 2023-10-10T21:01:57.398 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf89fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf40c5bc0 con 0x7febf40b16d0 2023-10-10T21:01:57.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf2d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b16d0 0x7febf4149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b33b0 0x7febf40c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf2d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b16d0 0x7febf4149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60700/0 (socket says 172.21.15.179:60700) 2023-10-10T21:01:57.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b33b0 0x7febf40c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:34798/0 (socket says 172.21.15.179:34798) 2023-10-10T21:01:57.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf2d9d700 1 -- 172.21.15.179:0/1604184931 learned_addr learned my addr 172.21.15.179:0/1604184931 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:57.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf359e700 1 --2- 172.21.15.179:0/1604184931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 0x7febf40ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf259c700 1 -- 172.21.15.179:0/1604184931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b16d0 msgr2=0x7febf4149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf259c700 1 --2- 172.21.15.179:0/1604184931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b16d0 0x7febf4149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf259c700 1 -- 172.21.15.179:0/1604184931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 msgr2=0x7febf40ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf259c700 1 --2- 172.21.15.179:0/1604184931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 0x7febf40ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf259c700 1 -- 172.21.15.179:0/1604184931 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec009ae0 con 0x7febf40b33b0 2023-10-10T21:01:57.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.391+0000 7febf2d9d700 1 --2- 172.21.15.179:0/1604184931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b16d0 0x7febf4149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:01:57.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.392+0000 7febf259c700 1 --2- 172.21.15.179:0/1604184931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b33b0 0x7febf40c5390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7febe800e930 tx=0x7febe80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:57.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.392+0000 7febdaffd700 1 -- 172.21.15.179:0/1604184931 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8013680 con 0x7febf40b33b0 2023-10-10T21:01:57.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.392+0000 7febdaffd700 1 -- 172.21.15.179:0/1604184931 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe80137e0 con 0x7febf40b33b0 2023-10-10T21:01:57.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.392+0000 7febf89fe700 1 -- 172.21.15.179:0/1604184931 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf40c5ea0 con 0x7febf40b33b0 2023-10-10T21:01:57.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.392+0000 7febdaffd700 1 -- 172.21.15.179:0/1604184931 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8013ba0 con 0x7febf40b33b0 2023-10-10T21:01:57.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.392+0000 7febf89fe700 1 -- 172.21.15.179:0/1604184931 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf40c6460 con 0x7febf40b33b0 2023-10-10T21:01:57.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.392+0000 7febdaffd700 1 -- 172.21.15.179:0/1604184931 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7febe8005c80 con 0x7febf40b33b0 2023-10-10T21:01:57.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.392+0000 7febdaffd700 1 -- 172.21.15.179:0/1604184931 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7febe8006020 con 0x7febf40b33b0 2023-10-10T21:01:57.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.393+0000 7febf89fe700 1 -- 172.21.15.179:0/1604184931 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf40c6620 con 0x7febf40b33b0 2023-10-10T21:01:57.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.395+0000 7febdaffd700 1 -- 172.21.15.179:0/1604184931 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7febe8021060 con 0x7febf40b33b0 2023-10-10T21:01:57.440 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:57.439+0000 7f1c55035180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:01:57.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.481+0000 7febf89fe700 1 -- 172.21.15.179:0/1604184931 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9274498e-7703-4287-96af-33e83969398b", "id": 4} v 0) v1 -- 0x7febf40c6940 con 0x7febf40b33b0 2023-10-10T21:01:57.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.487+0000 7febdaffd700 1 -- 172.21.15.179:0/1604184931 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9274498e-7703-4287-96af-33e83969398b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7febe8029020 con 0x7febf40b33b0 2023-10-10T21:01:57.489 INFO:teuthology.orchestra.run.smithi179.stdout:4 2023-10-10T21:01:57.490 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.488+0000 7febf89fe700 1 -- 172.21.15.179:0/1604184931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b33b0 msgr2=0x7febf40c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.488+0000 7febf89fe700 1 --2- 172.21.15.179:0/1604184931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b33b0 0x7febf40c5390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7febe800e930 tx=0x7febe80091a0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.488+0000 7febf89fe700 1 -- 172.21.15.179:0/1604184931 shutdown_connections 2023-10-10T21:01:57.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.488+0000 7febf89fe700 1 --2- 172.21.15.179:0/1604184931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 0x7febf40ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.488+0000 7febf89fe700 1 --2- 172.21.15.179:0/1604184931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b16d0 0x7febf4149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.488+0000 7febf89fe700 1 --2- 172.21.15.179:0/1604184931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b33b0 0x7febf40c5390 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.488+0000 7febf89fe700 1 -- 172.21.15.179:0/1604184931 >> 172.21.15.179:0/1604184931 conn(0x7febf40d10c0 msgr2=0x7febf4158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:57.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.488+0000 7febf89fe700 1 -- 172.21.15.179:0/1604184931 shutdown_connections 2023-10-10T21:01:57.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.488+0000 7febf89fe700 1 -- 172.21.15.179:0/1604184931 wait complete. 2023-10-10T21:01:57.506 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 25b896f8-55e6-4116-8c5b-8cc345651dc0 5 2023-10-10T21:01:57.520 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:57.519+0000 7f569557a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:01:57.557 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:57.556+0000 7f1c55035180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:01:57.645 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:57.644+0000 7f569557a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:01:57.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.695+0000 7f6e4359e700 1 Processor -- start 2023-10-10T21:01:57.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.696+0000 7f6e4359e700 1 -- start start 2023-10-10T21:01:57.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.697+0000 7f6e4359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6e440b1b40 0x7f6e440b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.697+0000 7f6e4359e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440cfb00 con 0x7f6e440b16d0 2023-10-10T21:01:57.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.697+0000 7f6e4359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440b5c40 con 0x7f6e440b4e70 2023-10-10T21:01:57.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.697+0000 7f6e4359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e440b5f20 con 0x7f6e440b1b40 2023-10-10T21:01:57.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.697+0000 7f6e42d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6e440b1b40 0x7f6e440b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.697+0000 7f6e4259c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6e440b4e70 0x7f6e440ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:33704/0 (socket says 172.21.15.179:33704) 2023-10-10T21:01:57.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.697+0000 7f6e4259c700 1 -- 172.21.15.179:0/717378226 learned_addr learned my addr 172.21.15.179:0/717378226 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-10-10T21:01:57.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e4159a700 1 -- 172.21.15.179:0/717378226 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728996729 0 0) 0x7f6e440b5c40 con 0x7f6e440b4e70 2023-10-10T21:01:57.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e4159a700 1 -- 172.21.15.179:0/717378226 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e2c003570 con 0x7f6e440b4e70 2023-10-10T21:01:57.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e42d9d700 1 -- 172.21.15.179:0/717378226 >> v1:172.21.15.179:6789/0 conn(0x7f6e440b4e70 legacy=0x7f6e440ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e42d9d700 1 -- 172.21.15.179:0/717378226 >> v1:172.21.15.154:6789/0 conn(0x7f6e440b16d0 legacy=0x7f6e440b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e4159a700 1 -- 172.21.15.179:0/717378226 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937599369 0 0) 0x7f6e440cfb00 con 0x7f6e440b16d0 2023-10-10T21:01:57.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e42d9d700 1 -- 172.21.15.179:0/717378226 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440b6200 con 0x7f6e440b1b40 2023-10-10T21:01:57.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e42d9d700 1 --2- 172.21.15.179:0/717378226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b1b40 0x7f6e440b3ac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e60 tx=0x7f6e3c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=496f8f62509fea40 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:57.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e4159a700 1 -- 172.21.15.179:0/717378226 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00e070 con 0x7f6e440b1b40 2023-10-10T21:01:57.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e4159a700 1 -- 172.21.15.179:0/717378226 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c00bb60 con 0x7f6e440b1b40 2023-10-10T21:01:57.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.698+0000 7f6e4159a700 1 -- 172.21.15.179:0/717378226 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00bee0 con 0x7f6e440b1b40 2023-10-10T21:01:57.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.699+0000 7f6e4359e700 1 -- 172.21.15.179:0/717378226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b1b40 msgr2=0x7f6e440b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.699+0000 7f6e4359e700 1 --2- 172.21.15.179:0/717378226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b1b40 0x7f6e440b3ac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e60 tx=0x7f6e3c009780 comp rx=0 tx=0).stop 2023-10-10T21:01:57.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.699+0000 7f6e4359e700 1 -- 172.21.15.179:0/717378226 shutdown_connections 2023-10-10T21:01:57.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.699+0000 7f6e4359e700 1 --2- 172.21.15.179:0/717378226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b1b40 0x7f6e440b3ac0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.699+0000 7f6e4359e700 1 -- 172.21.15.179:0/717378226 >> 172.21.15.179:0/717378226 conn(0x7f6e440d10c0 msgr2=0x7f6e440affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:57.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.699+0000 7f6e4359e700 1 -- 172.21.15.179:0/717378226 shutdown_connections 2023-10-10T21:01:57.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.699+0000 7f6e4359e700 1 -- 172.21.15.179:0/717378226 wait complete. 2023-10-10T21:01:57.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.700+0000 7f6e4359e700 1 Processor -- start 2023-10-10T21:01:57.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.701+0000 7f6e4359e700 1 -- start start 2023-10-10T21:01:57.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.701+0000 7f6e4359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b16d0 0x7f6e440c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.701+0000 7f6e4359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e440b1b40 0x7f6e44157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.701+0000 7f6e4359e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e440b4e70 0x7f6e44069a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:57.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.701+0000 7f6e4359e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440c6c70 con 0x7f6e440b4e70 2023-10-10T21:01:57.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.701+0000 7f6e4359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44158280 con 0x7f6e440b16d0 2023-10-10T21:01:57.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.701+0000 7f6e4359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440c63d0 con 0x7f6e440b1b40 2023-10-10T21:01:57.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e4259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b16d0 0x7f6e440c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e4259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b16d0 0x7f6e440c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:34816/0 (socket says 172.21.15.179:34816) 2023-10-10T21:01:57.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e4259c700 1 -- 172.21.15.179:0/3848255189 learned_addr learned my addr 172.21.15.179:0/3848255189 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:57.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e41d9b700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e440b1b40 0x7f6e44157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e42d9d700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e440b4e70 0x7f6e44069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:57.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e4259c700 1 -- 172.21.15.179:0/3848255189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e440b1b40 msgr2=0x7f6e44157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e4259c700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e440b1b40 0x7f6e44157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e4259c700 1 -- 172.21.15.179:0/3848255189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e440b4e70 msgr2=0x7f6e44069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e4259c700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e440b4e70 0x7f6e44069a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e4259c700 1 -- 172.21.15.179:0/3848255189 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c009a20 con 0x7f6e440b16d0 2023-10-10T21:01:57.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e41d9b700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e440b1b40 0x7f6e44157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:01:57.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.702+0000 7f6e4259c700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b16d0 0x7f6e440c5d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e340011e0 tx=0x7f6e34007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:57.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.703+0000 7f6e327fc700 1 -- 172.21.15.179:0/3848255189 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34005b30 con 0x7f6e440b16d0 2023-10-10T21:01:57.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.703+0000 7f6e327fc700 1 -- 172.21.15.179:0/3848255189 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34005c90 con 0x7f6e440b16d0 2023-10-10T21:01:57.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.703+0000 7f6e327fc700 1 -- 172.21.15.179:0/3848255189 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34007320 con 0x7f6e440b16d0 2023-10-10T21:01:57.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.703+0000 7f6e4359e700 1 -- 172.21.15.179:0/3848255189 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e440c66b0 con 0x7f6e440b16d0 2023-10-10T21:01:57.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.703+0000 7f6e4359e700 1 -- 172.21.15.179:0/3848255189 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4416d0c0 con 0x7f6e440b16d0 2023-10-10T21:01:57.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.703+0000 7f6e327fc700 1 -- 172.21.15.179:0/3848255189 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6e3401c440 con 0x7f6e440b16d0 2023-10-10T21:01:57.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.703+0000 7f6e327fc700 1 -- 172.21.15.179:0/3848255189 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f6e34005e00 con 0x7f6e440b16d0 2023-10-10T21:01:57.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.704+0000 7f6e4359e700 1 -- 172.21.15.179:0/3848255189 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4416d2e0 con 0x7f6e440b16d0 2023-10-10T21:01:57.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.706+0000 7f6e327fc700 1 -- 172.21.15.179:0/3848255189 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6e34017070 con 0x7f6e440b16d0 2023-10-10T21:01:57.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.792+0000 7f6e4359e700 1 -- 172.21.15.179:0/3848255189 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "25b896f8-55e6-4116-8c5b-8cc345651dc0", "id": 5} v 0) v1 -- 0x7f6e4404bb80 con 0x7f6e440b16d0 2023-10-10T21:01:57.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.801+0000 7f6e327fc700 1 -- 172.21.15.179:0/3848255189 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "25b896f8-55e6-4116-8c5b-8cc345651dc0", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6e3401c6f0 con 0x7f6e440b16d0 2023-10-10T21:01:57.803 INFO:teuthology.orchestra.run.smithi179.stdout:5 2023-10-10T21:01:57.804 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.802+0000 7f6e4359e700 1 -- 172.21.15.179:0/3848255189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b16d0 msgr2=0x7f6e440c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:57.804 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.802+0000 7f6e4359e700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b16d0 0x7f6e440c5d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e340011e0 tx=0x7f6e34007df0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.804 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.802+0000 7f6e4359e700 1 -- 172.21.15.179:0/3848255189 shutdown_connections 2023-10-10T21:01:57.804 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.802+0000 7f6e4359e700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e440b4e70 0x7f6e44069a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.804 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.802+0000 7f6e4359e700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e440b16d0 0x7f6e440c5d10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.802+0000 7f6e4359e700 1 --2- 172.21.15.179:0/3848255189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e440b1b40 0x7f6e44157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:57.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.802+0000 7f6e4359e700 1 -- 172.21.15.179:0/3848255189 >> 172.21.15.179:0/3848255189 conn(0x7f6e440d10c0 msgr2=0x7f6e44158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:57.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.802+0000 7f6e4359e700 1 -- 172.21.15.179:0/3848255189 shutdown_connections 2023-10-10T21:01:57.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.802+0000 7f6e4359e700 1 -- 172.21.15.179:0/3848255189 wait complete. 2023-10-10T21:01:57.820 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new f1d1fc4f-c437-434b-ae1b-3371a27944ba 6 2023-10-10T21:01:57.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.995+0000 7f442359e700 1 Processor -- start 2023-10-10T21:01:57.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.996+0000 7f442359e700 1 -- start start 2023-10-10T21:01:58.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f442359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b4e70 0x7f44240ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f442359e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44240cfb00 con 0x7f44240b16d0 2023-10-10T21:01:58.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f442359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442415e060 con 0x7f44240b1b40 2023-10-10T21:01:58.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f442359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44240b5c40 con 0x7f44240b4e70 2023-10-10T21:01:58.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f442259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b4e70 0x7f44240ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f4422d9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f44240b1b40 0x7f442415d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:33718/0 (socket says 172.21.15.179:33718) 2023-10-10T21:01:58.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f4422d9d700 1 -- 172.21.15.179:0/4157845901 learned_addr learned my addr 172.21.15.179:0/4157845901 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-10-10T21:01:58.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f442259c700 1 -- 172.21.15.179:0/4157845901 >> v1:172.21.15.179:6789/0 conn(0x7f44240b1b40 legacy=0x7f442415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f442259c700 1 -- 172.21.15.179:0/4157845901 >> v1:172.21.15.154:6789/0 conn(0x7f44240b16d0 legacy=0x7f442415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f442259c700 1 -- 172.21.15.179:0/4157845901 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44240b5f20 con 0x7f44240b4e70 2023-10-10T21:01:58.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.998+0000 7f442159a700 1 -- 172.21.15.179:0/4157845901 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429005182 0 0) 0x7f442415e060 con 0x7f44240b1b40 2023-10-10T21:01:58.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.999+0000 7f442259c700 1 --2- 172.21.15.179:0/4157845901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b4e70 0x7f44240ccff0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4414009910 tx=0x7f44140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1397fd5f709771db server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:58.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.999+0000 7f442159a700 1 -- 172.21.15.179:0/4157845901 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400b860 con 0x7f44240b4e70 2023-10-10T21:01:58.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.999+0000 7f442159a700 1 -- 172.21.15.179:0/4157845901 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441400b9c0 con 0x7f44240b4e70 2023-10-10T21:01:58.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.999+0000 7f442159a700 1 -- 172.21.15.179:0/4157845901 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400bd60 con 0x7f44240b4e70 2023-10-10T21:01:58.006 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.999+0000 7f442359e700 1 -- 172.21.15.179:0/4157845901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b4e70 msgr2=0x7f44240ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.006 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:57.999+0000 7f442359e700 1 --2- 172.21.15.179:0/4157845901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b4e70 0x7f44240ccff0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4414009910 tx=0x7f44140091a0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.000+0000 7f442359e700 1 -- 172.21.15.179:0/4157845901 shutdown_connections 2023-10-10T21:01:58.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.000+0000 7f442359e700 1 --2- 172.21.15.179:0/4157845901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b4e70 0x7f44240ccff0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.000+0000 7f442359e700 1 -- 172.21.15.179:0/4157845901 >> 172.21.15.179:0/4157845901 conn(0x7f44240d10c0 msgr2=0x7f44240affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:58.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.000+0000 7f442359e700 1 -- 172.21.15.179:0/4157845901 shutdown_connections 2023-10-10T21:01:58.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.000+0000 7f442359e700 1 -- 172.21.15.179:0/4157845901 wait complete. 2023-10-10T21:01:58.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.001+0000 7f442359e700 1 Processor -- start 2023-10-10T21:01:58.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.001+0000 7f442359e700 1 -- start start 2023-10-10T21:01:58.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f442359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b16d0 0x7f4424151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f442359e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44240b1b40 0x7f44240c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f442359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44240b4e70 0x7f44240c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f442359e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44240c63f0 con 0x7f44240b1b40 2023-10-10T21:01:58.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f442359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44240cb9b0 con 0x7f44240b4e70 2023-10-10T21:01:58.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f442359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4424151dd0 con 0x7f44240b16d0 2023-10-10T21:01:58.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f442259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b16d0 0x7f4424151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f442259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b16d0 0x7f4424151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60722/0 (socket says 172.21.15.179:60722) 2023-10-10T21:01:58.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f442259c700 1 -- 172.21.15.179:0/849517176 learned_addr learned my addr 172.21.15.179:0/849517176 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:58.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f4422d9d700 1 --2- 172.21.15.179:0/849517176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44240b4e70 0x7f44240c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.002+0000 7f4421d9b700 1 --2- 172.21.15.179:0/849517176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44240b1b40 0x7f44240c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f442259c700 1 -- 172.21.15.179:0/849517176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44240b4e70 msgr2=0x7f44240c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f442259c700 1 --2- 172.21.15.179:0/849517176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44240b4e70 0x7f44240c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f442259c700 1 -- 172.21.15.179:0/849517176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44240b1b40 msgr2=0x7f44240c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f442259c700 1 --2- 172.21.15.179:0/849517176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44240b1b40 0x7f44240c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f442259c700 1 -- 172.21.15.179:0/849517176 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4414009420 con 0x7f44240b16d0 2023-10-10T21:01:58.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f442259c700 1 --2- 172.21.15.179:0/849517176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b16d0 0x7f4424151890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f441400c010 tx=0x7f4414017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:58.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f44127fc700 1 -- 172.21.15.179:0/849517176 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441401f070 con 0x7f44240b16d0 2023-10-10T21:01:58.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f44127fc700 1 -- 172.21.15.179:0/849517176 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414002f70 con 0x7f44240b16d0 2023-10-10T21:01:58.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f442359e700 1 -- 172.21.15.179:0/849517176 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4424155810 con 0x7f44240b16d0 2023-10-10T21:01:58.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.003+0000 7f44127fc700 1 -- 172.21.15.179:0/849517176 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414025420 con 0x7f44240b16d0 2023-10-10T21:01:58.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.004+0000 7f442359e700 1 -- 172.21.15.179:0/849517176 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44240c6110 con 0x7f44240b16d0 2023-10-10T21:01:58.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.004+0000 7f44127fc700 1 -- 172.21.15.179:0/849517176 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4414023070 con 0x7f44240b16d0 2023-10-10T21:01:58.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.004+0000 7f44127fc700 1 -- 172.21.15.179:0/849517176 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f441401aa20 con 0x7f44240b16d0 2023-10-10T21:01:58.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.005+0000 7f442359e700 1 -- 172.21.15.179:0/849517176 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4424088990 con 0x7f44240b16d0 2023-10-10T21:01:58.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.009+0000 7f44127fc700 1 -- 172.21.15.179:0/849517176 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f441402a070 con 0x7f44240b16d0 2023-10-10T21:01:58.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.096+0000 7f442359e700 1 -- 172.21.15.179:0/849517176 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f1d1fc4f-c437-434b-ae1b-3371a27944ba", "id": 6} v 0) v1 -- 0x7f4424155ab0 con 0x7f44240b16d0 2023-10-10T21:01:58.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.100+0000 7f44127fc700 1 -- 172.21.15.179:0/849517176 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f1d1fc4f-c437-434b-ae1b-3371a27944ba", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4414015020 con 0x7f44240b16d0 2023-10-10T21:01:58.102 INFO:teuthology.orchestra.run.smithi179.stdout:6 2023-10-10T21:01:58.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.101+0000 7f442359e700 1 -- 172.21.15.179:0/849517176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b16d0 msgr2=0x7f4424151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.104 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.101+0000 7f442359e700 1 --2- 172.21.15.179:0/849517176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b16d0 0x7f4424151890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f441400c010 tx=0x7f4414017000 comp rx=0 tx=0).stop 2023-10-10T21:01:58.104 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.102+0000 7f442359e700 1 -- 172.21.15.179:0/849517176 shutdown_connections 2023-10-10T21:01:58.104 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.102+0000 7f442359e700 1 --2- 172.21.15.179:0/849517176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44240b4e70 0x7f44240c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.104 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.102+0000 7f442359e700 1 --2- 172.21.15.179:0/849517176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44240b16d0 0x7f4424151890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.104 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.102+0000 7f442359e700 1 --2- 172.21.15.179:0/849517176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44240b1b40 0x7f44240c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.105 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.102+0000 7f442359e700 1 -- 172.21.15.179:0/849517176 >> 172.21.15.179:0/849517176 conn(0x7f44240d10c0 msgr2=0x7f44240699d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:58.105 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.102+0000 7f442359e700 1 -- 172.21.15.179:0/849517176 shutdown_connections 2023-10-10T21:01:58.105 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.102+0000 7f442359e700 1 -- 172.21.15.179:0/849517176 wait complete. 2023-10-10T21:01:58.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 31f6e4cf-5d75-4e3e-9d39-401ccc6af034 7 2023-10-10T21:01:58.183 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:58.182+0000 7f1c55035180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:01:58.278 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:58.277+0000 7f1c55035180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:01:58.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.296+0000 7f8c9b59e700 1 Processor -- start 2023-10-10T21:01:58.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.296+0000 7f8c9b59e700 1 -- start start 2023-10-10T21:01:58.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c9c0b1b40 0x7f8c9c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9b59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c0cfb00 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c0b5c40 con 0x7f8c9c0b4e70 2023-10-10T21:01:58.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9b59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c0b5f20 con 0x7f8c9c0b1b40 2023-10-10T21:01:58.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9a59c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8c9c0b4e70 0x7f8c9c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:33728/0 (socket says 172.21.15.179:33728) 2023-10-10T21:01:58.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9a59c700 1 -- 172.21.15.179:0/4043699738 learned_addr learned my addr 172.21.15.179:0/4043699738 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-10-10T21:01:58.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9ad9d700 1 --2- 172.21.15.179:0/4043699738 >> v2:172.21.15.154:3300/0 conn(0x7f8c9c0b1b40 0x7f8c9c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9959a700 1 -- 172.21.15.179:0/4043699738 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467599005 0 0) 0x7f8c9c0b5c40 con 0x7f8c9c0b4e70 2023-10-10T21:01:58.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9959a700 1 -- 172.21.15.179:0/4043699738 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c84003570 con 0x7f8c9c0b4e70 2023-10-10T21:01:58.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9959a700 1 -- 172.21.15.179:0/4043699738 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314834888 0 0) 0x7f8c9c0cfb00 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.298+0000 7f8c9959a700 1 -- 172.21.15.179:0/4043699738 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c9c0b5c40 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.299+0000 7f8c9ad9d700 1 -- 172.21.15.179:0/4043699738 >> v1:172.21.15.179:6789/0 conn(0x7f8c9c0b4e70 legacy=0x7f8c9c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.299+0000 7f8c9ad9d700 1 -- 172.21.15.179:0/4043699738 >> v1:172.21.15.154:6789/0 conn(0x7f8c9c0b16d0 legacy=0x7f8c9c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.299+0000 7f8c9ad9d700 1 -- 172.21.15.179:0/4043699738 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0b6200 con 0x7f8c9c0b1b40 2023-10-10T21:01:58.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.299+0000 7f8c9ad9d700 1 --2- 172.21.15.179:0/4043699738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b1b40 0x7f8c9c0b3ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009e60 tx=0x7f8c94009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a168a2e536e08 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:58.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.299+0000 7f8c9959a700 1 -- 172.21.15.179:0/4043699738 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400e070 con 0x7f8c9c0b1b40 2023-10-10T21:01:58.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.299+0000 7f8c9959a700 1 -- 172.21.15.179:0/4043699738 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9400bab0 con 0x7f8c9c0b1b40 2023-10-10T21:01:58.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.299+0000 7f8c9959a700 1 -- 172.21.15.179:0/4043699738 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400be50 con 0x7f8c9c0b1b40 2023-10-10T21:01:58.307 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.300+0000 7f8c9b59e700 1 -- 172.21.15.179:0/4043699738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b1b40 msgr2=0x7f8c9c0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.307 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.300+0000 7f8c9b59e700 1 --2- 172.21.15.179:0/4043699738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b1b40 0x7f8c9c0b3ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009e60 tx=0x7f8c94009780 comp rx=0 tx=0).stop 2023-10-10T21:01:58.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.300+0000 7f8c9b59e700 1 -- 172.21.15.179:0/4043699738 shutdown_connections 2023-10-10T21:01:58.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.300+0000 7f8c9b59e700 1 --2- 172.21.15.179:0/4043699738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b1b40 0x7f8c9c0b3ac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.300+0000 7f8c9b59e700 1 -- 172.21.15.179:0/4043699738 >> 172.21.15.179:0/4043699738 conn(0x7f8c9c0d10c0 msgr2=0x7f8c9c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:58.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.300+0000 7f8c9b59e700 1 -- 172.21.15.179:0/4043699738 shutdown_connections 2023-10-10T21:01:58.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.300+0000 7f8c9b59e700 1 -- 172.21.15.179:0/4043699738 wait complete. 2023-10-10T21:01:58.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.301+0000 7f8c9b59e700 1 Processor -- start 2023-10-10T21:01:58.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.301+0000 7f8c9b59e700 1 -- start start 2023-10-10T21:01:58.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.302+0000 7f8c9b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b16d0 0x7f8c9c144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.302+0000 7f8c9b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9c0b1b40 0x7f8c9c15db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.302+0000 7f8c9b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c9c0b4e70 0x7f8c9c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.302+0000 7f8c9b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0c71a0 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.302+0000 7f8c9b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0c68b0 con 0x7f8c9c0b1b40 2023-10-10T21:01:58.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.302+0000 7f8c9b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0cc280 con 0x7f8c9c0b4e70 2023-10-10T21:01:58.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c99d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9c0b1b40 0x7f8c9c15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b16d0 0x7f8c9c144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b16d0 0x7f8c9c144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.179:44516/0 (socket says 172.21.15.179:44516) 2023-10-10T21:01:58.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9a59c700 1 -- 172.21.15.179:0/267674137 learned_addr learned my addr 172.21.15.179:0/267674137 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-10T21:01:58.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c99d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9c0b1b40 0x7f8c9c15db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:34836/0 (socket says 172.21.15.179:34836) 2023-10-10T21:01:58.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9ad9d700 1 --2- 172.21.15.179:0/267674137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c9c0b4e70 0x7f8c9c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9a59c700 1 -- 172.21.15.179:0/267674137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c9c0b4e70 msgr2=0x7f8c9c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9a59c700 1 --2- 172.21.15.179:0/267674137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c9c0b4e70 0x7f8c9c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9a59c700 1 -- 172.21.15.179:0/267674137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9c0b1b40 msgr2=0x7f8c9c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9a59c700 1 --2- 172.21.15.179:0/267674137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9c0b1b40 0x7f8c9c15db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9a59c700 1 -- 172.21.15.179:0/267674137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94009a20 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.303+0000 7f8c9a59c700 1 --2- 172.21.15.179:0/267674137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b16d0 0x7f8c9c144780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c790 tx=0x7f8c8c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:58.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.304+0000 7f8c8a7fc700 1 -- 172.21.15.179:0/267674137 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c005b30 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.304+0000 7f8c8a7fc700 1 -- 172.21.15.179:0/267674137 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c005cd0 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.304+0000 7f8c9b59e700 1 -- 172.21.15.179:0/267674137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c0c6b50 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.304+0000 7f8c8a7fc700 1 -- 172.21.15.179:0/267674137 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c007320 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.304+0000 7f8c9b59e700 1 -- 172.21.15.179:0/267674137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c144cc0 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.304+0000 7f8c8a7fc700 1 -- 172.21.15.179:0/267674137 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8c8c01c6c0 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.314 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.304+0000 7f8c8a7fc700 1 -- 172.21.15.179:0/267674137 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f8c8c005e40 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.314 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.305+0000 7f8c9b59e700 1 -- 172.21.15.179:0/267674137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c088990 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.314 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.307+0000 7f8c8a7fc700 1 -- 172.21.15.179:0/267674137 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8c8c021060 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.315 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:58.314+0000 7f569557a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:01:58.374 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:58.373+0000 7f1c55035180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:01:58.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.392+0000 7f8c9b59e700 1 -- 172.21.15.179:0/267674137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "31f6e4cf-5d75-4e3e-9d39-401ccc6af034", "id": 7} v 0) v1 -- 0x7f8c9c04bb80 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.397 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.396+0000 7f8c8a7fc700 1 -- 172.21.15.179:0/267674137 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "31f6e4cf-5d75-4e3e-9d39-401ccc6af034", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c8c017070 con 0x7f8c9c0b16d0 2023-10-10T21:01:58.398 INFO:teuthology.orchestra.run.smithi179.stdout:7 2023-10-10T21:01:58.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.397+0000 7f8c9b59e700 1 -- 172.21.15.179:0/267674137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b16d0 msgr2=0x7f8c9c144780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.397+0000 7f8c9b59e700 1 --2- 172.21.15.179:0/267674137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b16d0 0x7f8c9c144780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c790 tx=0x7f8c8c007e80 comp rx=0 tx=0).stop 2023-10-10T21:01:58.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.397+0000 7f8c9b59e700 1 -- 172.21.15.179:0/267674137 shutdown_connections 2023-10-10T21:01:58.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.397+0000 7f8c9b59e700 1 --2- 172.21.15.179:0/267674137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c9c0b4e70 0x7f8c9c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.397+0000 7f8c9b59e700 1 --2- 172.21.15.179:0/267674137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9c0b16d0 0x7f8c9c144780 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.397+0000 7f8c9b59e700 1 --2- 172.21.15.179:0/267674137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9c0b1b40 0x7f8c9c15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.397+0000 7f8c9b59e700 1 -- 172.21.15.179:0/267674137 >> 172.21.15.179:0/267674137 conn(0x7f8c9c0d10c0 msgr2=0x7f8c9c1590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:58.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.397+0000 7f8c9b59e700 1 -- 172.21.15.179:0/267674137 shutdown_connections 2023-10-10T21:01:58.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-10T21:01:58.397+0000 7f8c9b59e700 1 -- 172.21.15.179:0/267674137 wait complete. 2023-10-10T21:01:58.415 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:58.413+0000 7f569557a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:01:58.416 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-10T21:01:58.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-10T21:01:58.421 INFO:tasks.ceph.osd.0:Started 2023-10-10T21:01:58.422 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-10T21:01:58.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-10T21:01:58.426 INFO:tasks.ceph.osd.1:Started 2023-10-10T21:01:58.427 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-10T21:01:58.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-10T21:01:58.431 INFO:tasks.ceph.osd.2:Started 2023-10-10T21:01:58.432 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-10T21:01:58.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-10T21:01:58.438 INFO:tasks.ceph.osd.3:Started 2023-10-10T21:01:58.438 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-10T21:01:58.438 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-10T21:01:58.444 INFO:tasks.ceph.osd.4:Started 2023-10-10T21:01:58.445 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-10T21:01:58.445 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-10T21:01:58.451 INFO:tasks.ceph.osd.5:Started 2023-10-10T21:01:58.451 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-10T21:01:58.451 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-10T21:01:58.457 INFO:tasks.ceph.osd.6:Started 2023-10-10T21:01:58.457 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-10T21:01:58.458 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-10T21:01:58.464 INFO:tasks.ceph.osd.7:Started 2023-10-10T21:01:58.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:01:58.531 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:58.529+0000 7f569557a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:01:58.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.699+0000 7f971b59e700 1 Processor -- start 2023-10-10T21:01:58.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.699+0000 7f971b59e700 1 -- start start 2023-10-10T21:01:58.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f971c159420 0x7f971c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c15d230 0x7f971c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c0b2980 con 0x7f971c1597f0 2023-10-10T21:01:58.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971b59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c15dbb0 con 0x7f971c159420 2023-10-10T21:01:58.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0b11d0 con 0x7f971c15d230 2023-10-10T21:01:58.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f971c159420 0x7f971c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f971c159420 0x7f971c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46428/0 (socket says 172.21.15.154:46428) 2023-10-10T21:01:58.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971a59c700 1 -- 172.21.15.154:0/2923701912 learned_addr learned my addr 172.21.15.154:0/2923701912 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:01:58.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971ad9d700 1 --2- 172.21.15.154:0/2923701912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c15d230 0x7f971c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971a59c700 1 -- 172.21.15.154:0/2923701912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c15d230 msgr2=0x7f971c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:01:58.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971a59c700 1 --2- 172.21.15.154:0/2923701912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c15d230 0x7f971c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971a59c700 1 -- 172.21.15.154:0/2923701912 >> v1:172.21.15.179:6789/0 conn(0x7f971c1597f0 legacy=0x7f971c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971a59c700 1 -- 172.21.15.154:0/2923701912 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0b14b0 con 0x7f971c159420 2023-10-10T21:01:58.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.701+0000 7f971959a700 1 -- 172.21.15.154:0/2923701912 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457664841 0 0) 0x7f971c0b2980 con 0x7f971c1597f0 2023-10-10T21:01:58.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.702+0000 7f971a59c700 1 --2- 172.21.15.154:0/2923701912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c159420 0x7f971c0b5f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f970c0099b0 tx=0x7f970c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37ba84368dc976e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:58.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.702+0000 7f971959a700 1 -- 172.21.15.154:0/2923701912 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c009ea0 con 0x7f971c159420 2023-10-10T21:01:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.702+0000 7f971959a700 1 -- 172.21.15.154:0/2923701912 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c00b860 con 0x7f971c159420 2023-10-10T21:01:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.702+0000 7f971959a700 1 -- 172.21.15.154:0/2923701912 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c00bc00 con 0x7f971c159420 2023-10-10T21:01:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.702+0000 7f971b59e700 1 -- 172.21.15.154:0/2923701912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c159420 msgr2=0x7f971c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.702+0000 7f971b59e700 1 --2- 172.21.15.154:0/2923701912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c159420 0x7f971c0b5f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f970c0099b0 tx=0x7f970c009250 comp rx=0 tx=0).stop 2023-10-10T21:01:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.703+0000 7f971b59e700 1 -- 172.21.15.154:0/2923701912 shutdown_connections 2023-10-10T21:01:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.703+0000 7f971b59e700 1 --2- 172.21.15.154:0/2923701912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c15d230 0x7f971c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.703+0000 7f971b59e700 1 --2- 172.21.15.154:0/2923701912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c159420 0x7f971c0b5f40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.703+0000 7f971b59e700 1 -- 172.21.15.154:0/2923701912 >> 172.21.15.154:0/2923701912 conn(0x7f971c0d0660 msgr2=0x7f971c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.703+0000 7f971b59e700 1 -- 172.21.15.154:0/2923701912 shutdown_connections 2023-10-10T21:01:58.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.703+0000 7f971b59e700 1 -- 172.21.15.154:0/2923701912 wait complete. 2023-10-10T21:01:58.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.704+0000 7f971b59e700 1 Processor -- start 2023-10-10T21:01:58.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.704+0000 7f971b59e700 1 -- start start 2023-10-10T21:01:58.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.705+0000 7f971b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c159420 0x7f971c16a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c1597f0 0x7f971c14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c15d230 0x7f971c0b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c16a9e0 con 0x7f971c15d230 2023-10-10T21:01:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c152590 con 0x7f971c159420 2023-10-10T21:01:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c152870 con 0x7f971c1597f0 2023-10-10T21:01:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c15d230 0x7f971c0b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971a59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c159420 0x7f971c16a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c15d230 0x7f971c0b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46444/0 (socket says 172.21.15.154:46444) 2023-10-10T21:01:58.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971ad9d700 1 -- 172.21.15.154:0/459938953 learned_addr learned my addr 172.21.15.154:0/459938953 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:01:58.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f9719d9b700 1 --2- 172.21.15.154:0/459938953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c1597f0 0x7f971c14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:58.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971ad9d700 1 -- 172.21.15.154:0/459938953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c1597f0 msgr2=0x7f971c14cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971ad9d700 1 --2- 172.21.15.154:0/459938953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c1597f0 0x7f971c14cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971ad9d700 1 -- 172.21.15.154:0/459938953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c159420 msgr2=0x7f971c16a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971ad9d700 1 --2- 172.21.15.154:0/459938953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c159420 0x7f971c16a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.706+0000 7f971ad9d700 1 -- 172.21.15.154:0/459938953 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0094f0 con 0x7f971c15d230 2023-10-10T21:01:58.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.707+0000 7f971ad9d700 1 --2- 172.21.15.154:0/459938953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c15d230 0x7f971c0b56e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9714009df0 tx=0x7f971400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:58.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.707+0000 7f970a7fc700 1 -- 172.21.15.154:0/459938953 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971400caa0 con 0x7f971c15d230 2023-10-10T21:01:58.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.707+0000 7f970a7fc700 1 -- 172.21.15.154:0/459938953 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971400f040 con 0x7f971c15d230 2023-10-10T21:01:58.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.707+0000 7f971b59e700 1 -- 172.21.15.154:0/459938953 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c152b50 con 0x7f971c15d230 2023-10-10T21:01:58.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.707+0000 7f970a7fc700 1 -- 172.21.15.154:0/459938953 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971400ce70 con 0x7f971c15d230 2023-10-10T21:01:58.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.707+0000 7f971b59e700 1 -- 172.21.15.154:0/459938953 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c153110 con 0x7f971c15d230 2023-10-10T21:01:58.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.707+0000 7f970a7fc700 1 -- 172.21.15.154:0/459938953 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9714014690 con 0x7f971c15d230 2023-10-10T21:01:58.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.707+0000 7f970a7fc700 1 -- 172.21.15.154:0/459938953 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f9714013ac0 con 0x7f971c15d230 2023-10-10T21:01:58.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.708+0000 7f971b59e700 1 -- 172.21.15.154:0/459938953 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c153330 con 0x7f971c15d230 2023-10-10T21:01:58.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.711+0000 7f970a7fc700 1 -- 172.21.15.154:0/459938953 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9714018020 con 0x7f971c15d230 2023-10-10T21:01:58.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.782+0000 7f971b59e700 1 -- 172.21.15.154:0/459938953 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f971c04c3c0 con 0x7f971c15d230 2023-10-10T21:01:58.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.783+0000 7f970a7fc700 1 -- 172.21.15.154:0/459938953 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f9714013e20 con 0x7f971c15d230 2023-10-10T21:01:58.785 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:01:58.785 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":10,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:01:58.394649+0000","last_up_change":"0.000000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:01:58.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.784+0000 7f971b59e700 1 -- 172.21.15.154:0/459938953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c15d230 msgr2=0x7f971c0b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:58.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.784+0000 7f971b59e700 1 --2- 172.21.15.154:0/459938953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c15d230 0x7f971c0b56e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9714009df0 tx=0x7f971400b040 comp rx=0 tx=0).stop 2023-10-10T21:01:58.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.784+0000 7f971b59e700 1 -- 172.21.15.154:0/459938953 shutdown_connections 2023-10-10T21:01:58.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.784+0000 7f971b59e700 1 --2- 172.21.15.154:0/459938953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f971c15d230 0x7f971c0b56e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.784+0000 7f971b59e700 1 --2- 172.21.15.154:0/459938953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971c159420 0x7f971c16a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.784+0000 7f971b59e700 1 --2- 172.21.15.154:0/459938953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971c1597f0 0x7f971c14cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:58.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.784+0000 7f971b59e700 1 -- 172.21.15.154:0/459938953 >> 172.21.15.154:0/459938953 conn(0x7f971c0d0660 msgr2=0x7f971c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:58.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.784+0000 7f971b59e700 1 -- 172.21.15.154:0/459938953 shutdown_connections 2023-10-10T21:01:58.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:01:58.784+0000 7f971b59e700 1 -- 172.21.15.154:0/459938953 wait complete. 2023-10-10T21:01:58.803 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-10T21:01:58.803 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-10T21:01:59.130 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-10T21:01:59.122+0000 7fd18586c540 -1 Falling back to public interface 2023-10-10T21:01:59.134 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-10T21:01:59.132+0000 7f744efeb540 -1 Falling back to public interface 2023-10-10T21:01:59.134 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-10-10T21:01:59.133+0000 7f5974a93540 -1 Falling back to public interface 2023-10-10T21:01:59.135 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-10-10T21:01:59.133+0000 7fe611341540 -1 Falling back to public interface 2023-10-10T21:01:59.138 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-10-10T21:01:59.137+0000 7effda2fa540 -1 Falling back to public interface 2023-10-10T21:01:59.142 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-10-10T21:01:59.141+0000 7f4b17fcc540 -1 Falling back to public interface 2023-10-10T21:01:59.151 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:59.150+0000 7f1c55035180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:01:59.152 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-10T21:01:59.150+0000 7fd2ab620540 -1 Falling back to public interface 2023-10-10T21:01:59.159 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-10T21:01:59.157+0000 7fe65867d540 -1 Falling back to public interface 2023-10-10T21:01:59.280 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:59.279+0000 7f569557a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:01:59.322 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:59.321+0000 7f1c55035180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:01:59.440 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:59.439+0000 7f1c55035180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:01:59.452 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:59.451+0000 7f569557a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:01:59.564 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:59.562+0000 7f569557a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:01:59.609 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-10T21:01:59.747 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:59.746+0000 7f1c55035180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:01:59.770 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.769+0000 7f78a639d700 1 Processor -- start 2023-10-10T21:01:59.771 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.769+0000 7f78a639d700 1 -- start start 2023-10-10T21:01:59.772 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.770+0000 7f78a639d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 0x7f78a00b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:59.773 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.770+0000 7f78a639d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78a015b140 0x7f78a00b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:59.773 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.770+0000 7f78a639d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a0159ef0 con 0x7f78a015ce50 2023-10-10T21:01:59.773 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a639d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a00b6090 con 0x7f78a015b140 2023-10-10T21:01:59.773 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a639d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00b51b0 con 0x7f78a015dcc0 2023-10-10T21:01:59.773 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a5b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78a015b140 0x7f78a00b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:59.774 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a4b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 0x7f78a00b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:59.774 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a5b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78a015b140 0x7f78a00b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46450/0 (socket says 172.21.15.154:46450) 2023-10-10T21:01:59.774 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a5b9c700 1 -- 172.21.15.154:0/629880218 learned_addr learned my addr 172.21.15.154:0/629880218 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:01:59.774 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a539b700 1 --1- 172.21.15.154:0/629880218 >> v1:172.21.15.179:6789/0 conn(0x7f78a015ce50 0x7f78a015d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:60552/0 (socket says 172.21.15.154:60552) 2023-10-10T21:01:59.774 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a5b9c700 1 -- 172.21.15.154:0/629880218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 msgr2=0x7f78a00b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:01:59.775 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a5b9c700 1 --2- 172.21.15.154:0/629880218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 0x7f78a00b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:59.775 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a5b9c700 1 -- 172.21.15.154:0/629880218 >> v1:172.21.15.179:6789/0 conn(0x7f78a015ce50 legacy=0x7f78a015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:59.775 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f7897fff700 1 -- 172.21.15.154:0/629880218 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804215987 0 0) 0x7f78a0159ef0 con 0x7f78a015ce50 2023-10-10T21:01:59.775 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.771+0000 7f78a5b9c700 1 -- 172.21.15.154:0/629880218 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a00b5480 con 0x7f78a015b140 2023-10-10T21:01:59.775 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f78a5b9c700 1 --2- 172.21.15.154:0/629880218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 0x7f78a00b3c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7898009f20 tx=0x7f7898009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff0a0a45dc4060f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:59.779 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f7897fff700 1 -- 172.21.15.154:0/629880218 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789800e070 con 0x7f78a015b140 2023-10-10T21:01:59.779 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f7897fff700 1 -- 172.21.15.154:0/629880218 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789800ba60 con 0x7f78a015b140 2023-10-10T21:01:59.779 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f7897fff700 1 -- 172.21.15.154:0/629880218 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78980092e0 con 0x7f78a015b140 2023-10-10T21:01:59.779 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f78a639d700 1 -- 172.21.15.154:0/629880218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 msgr2=0x7f78a00b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:59.780 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f78a639d700 1 --2- 172.21.15.154:0/629880218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 0x7f78a00b3c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7898009f20 tx=0x7f7898009840 comp rx=0 tx=0).stop 2023-10-10T21:01:59.780 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f78a639d700 1 -- 172.21.15.154:0/629880218 shutdown_connections 2023-10-10T21:01:59.780 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f78a639d700 1 --2- 172.21.15.154:0/629880218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 0x7f78a00b3c60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:59.780 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f78a639d700 1 --2- 172.21.15.154:0/629880218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 0x7f78a00b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:59.780 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.772+0000 7f78a639d700 1 -- 172.21.15.154:0/629880218 >> 172.21.15.154:0/629880218 conn(0x7f78a0087ff0 msgr2=0x7f78a006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:59.781 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.773+0000 7f78a639d700 1 -- 172.21.15.154:0/629880218 shutdown_connections 2023-10-10T21:01:59.781 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.773+0000 7f78a639d700 1 -- 172.21.15.154:0/629880218 wait complete. 2023-10-10T21:01:59.781 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.774+0000 7f78a639d700 1 Processor -- start 2023-10-10T21:01:59.781 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.774+0000 7f78a639d700 1 -- start start 2023-10-10T21:01:59.781 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a639d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 0x7f78a00ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:59.782 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a639d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a015ce50 0x7f78a016a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:59.782 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a639d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 0x7f78a009ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:01:59.782 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a639d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a009e2a0 con 0x7f78a015b140 2023-10-10T21:01:59.782 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a639d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a009de10 con 0x7f78a015ce50 2023-10-10T21:01:59.782 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a639d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a016aba0 con 0x7f78a015dcc0 2023-10-10T21:01:59.783 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a539b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 0x7f78a00ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:59.783 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a539b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 0x7f78a00ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46464/0 (socket says 172.21.15.154:46464) 2023-10-10T21:01:59.783 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a539b700 1 -- 172.21.15.154:0/618778433 learned_addr learned my addr 172.21.15.154:0/618778433 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:01:59.783 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a4b9a700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a015ce50 0x7f78a016a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:59.783 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.775+0000 7f78a5b9c700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 0x7f78a009ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:01:59.784 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78a539b700 1 -- 172.21.15.154:0/618778433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 msgr2=0x7f78a009ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:59.784 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78a539b700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 0x7f78a009ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:59.784 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78a539b700 1 -- 172.21.15.154:0/618778433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a015ce50 msgr2=0x7f78a016a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:59.784 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78a539b700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a015ce50 0x7f78a016a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:59.784 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78a539b700 1 -- 172.21.15.154:0/618778433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009ae0 con 0x7f78a015b140 2023-10-10T21:01:59.785 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78a5b9c700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 0x7f78a009ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:01:59.785 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78a539b700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 0x7f78a00ae830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c840 tx=0x7f789c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:01:59.785 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78957fa700 1 -- 172.21.15.154:0/618778433 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c005b90 con 0x7f78a015b140 2023-10-10T21:01:59.785 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78957fa700 1 -- 172.21.15.154:0/618778433 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c005cf0 con 0x7f78a015b140 2023-10-10T21:01:59.785 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78957fa700 1 -- 172.21.15.154:0/618778433 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c007320 con 0x7f78a015b140 2023-10-10T21:01:59.786 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78a639d700 1 -- 172.21.15.154:0/618778433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a009a4c0 con 0x7f78a015b140 2023-10-10T21:01:59.786 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78a639d700 1 -- 172.21.15.154:0/618778433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a009d4e0 con 0x7f78a015b140 2023-10-10T21:01:59.786 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78957fa700 1 -- 172.21.15.154:0/618778433 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f789c01c6c0 con 0x7f78a015b140 2023-10-10T21:01:59.786 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.776+0000 7f78957fa700 1 -- 172.21.15.154:0/618778433 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f789c007690 con 0x7f78a015b140 2023-10-10T21:01:59.786 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.777+0000 7f78a639d700 1 -- 172.21.15.154:0/618778433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a0064b50 con 0x7f78a015b140 2023-10-10T21:01:59.787 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.779+0000 7f78957fa700 1 -- 172.21.15.154:0/618778433 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f789c017070 con 0x7f78a015b140 2023-10-10T21:01:59.849 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:01:59.848+0000 7f1c55035180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:01:59.854 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.853+0000 7f78a639d700 1 -- 172.21.15.154:0/618778433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78a00b14d0 con 0x7f78a015b140 2023-10-10T21:01:59.855 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.854+0000 7f78957fa700 1 -- 172.21.15.154:0/618778433 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f789c01cb50 con 0x7f78a015b140 2023-10-10T21:01:59.855 INFO:teuthology.misc.health.smithi154.stdout: 2023-10-10T21:01:59.855 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":10,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:01:58.394649+0000","last_up_change":"0.000000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:01:59.856 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.855+0000 7f78a639d700 1 -- 172.21.15.154:0/618778433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 msgr2=0x7f78a00ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:01:59.857 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.855+0000 7f78a639d700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 0x7f78a00ae830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c840 tx=0x7f789c007de0 comp rx=0 tx=0).stop 2023-10-10T21:01:59.857 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.855+0000 7f78a639d700 1 -- 172.21.15.154:0/618778433 shutdown_connections 2023-10-10T21:01:59.857 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.855+0000 7f78a639d700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a015dcc0 0x7f78a009ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:59.857 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.855+0000 7f78a639d700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a015b140 0x7f78a00ae830 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:59.857 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.855+0000 7f78a639d700 1 --2- 172.21.15.154:0/618778433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a015ce50 0x7f78a016a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:01:59.858 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.855+0000 7f78a639d700 1 -- 172.21.15.154:0/618778433 >> 172.21.15.154:0/618778433 conn(0x7f78a0087ff0 msgr2=0x7f78a006de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:01:59.858 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.855+0000 7f78a639d700 1 -- 172.21.15.154:0/618778433 shutdown_connections 2023-10-10T21:01:59.858 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:01:59.855+0000 7f78a639d700 1 -- 172.21.15.154:0/618778433 wait complete. 2023-10-10T21:01:59.866 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:59.864+0000 7f569557a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:01:59.871 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-10T21:01:59.961 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:01:59.959+0000 7f569557a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:02:00.868 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:00.867+0000 7f1c55035180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:02:00.961 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:00.960+0000 7f1c55035180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:02:00.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:02:00.963+0000 7f569557a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:02:01.053 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:01.052+0000 7f1c55035180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:02:01.057 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:02:01.055+0000 7f569557a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:02:01.152 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:02:01.151+0000 7f569557a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:02:01.218 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:01.217+0000 7f1c55035180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:02:01.317 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:02:01.315+0000 7f569557a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:02:01.337 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:01.336+0000 7f1c55035180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:02:01.424 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:02:01.423+0000 7f569557a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:02:01.528 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:01.527+0000 7f1c55035180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:02:01.614 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:02:01.613+0000 7f569557a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:02:01.633 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:01.632+0000 7f1c55035180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:02:01.728 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:02:01.726+0000 7f569557a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:02:01.742 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:01.741+0000 7f1c55035180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:02:01.821 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:02:01.819+0000 7f569557a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:02:01.838 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:01.837+0000 7f1c55035180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:02:01.939 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:02:01.937+0000 7f569557a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:02:02.656 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-10T21:02:02.655+0000 7fd18586c540 -1 osd.4 0 log_to_monitors true 2023-10-10T21:02:02.661 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-10-10T21:02:02.660+0000 7f5974a93540 -1 osd.1 0 log_to_monitors true 2023-10-10T21:02:02.709 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-10-10T21:02:02.708+0000 7fe611341540 -1 osd.0 0 log_to_monitors true 2023-10-10T21:02:02.710 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-10T21:02:02.709+0000 7f744efeb540 -1 osd.5 0 log_to_monitors true 2023-10-10T21:02:02.753 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-10T21:02:02.752+0000 7fe65867d540 -1 osd.7 0 log_to_monitors true 2023-10-10T21:02:02.779 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-10T21:02:02.777+0000 7fd2ab620540 -1 osd.6 0 log_to_monitors true 2023-10-10T21:02:02.856 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:02.855+0000 7f1c0d1fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-10T21:02:02.856 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:02:02.855+0000 7f1c0d1fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-10T21:02:02.946 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-10-10T21:02:02.945+0000 7effda2fa540 -1 osd.2 0 log_to_monitors true 2023-10-10T21:02:02.964 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-10-10T21:02:02.963+0000 7f4b17fcc540 -1 osd.3 0 log_to_monitors true 2023-10-10T21:02:05.511 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-10-10T21:02:05.509+0000 7fe604df6700 -1 osd.0 0 waiting for initial osdmap 2023-10-10T21:02:05.547 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-10-10T21:02:05.546+0000 7fe5fdde8700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-10T21:02:05.552 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-10-10T21:02:05.552+0000 7f5969df9700 -1 osd.1 0 waiting for initial osdmap 2023-10-10T21:02:05.578 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-10-10T21:02:05.577+0000 7f59615e8700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-10T21:02:06.158 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-10T21:02:06.157+0000 7fe64c1f6700 -1 osd.7 0 waiting for initial osdmap 2023-10-10T21:02:06.170 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-10T21:02:06.169+0000 7fe6451e8700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-10T21:02:06.170 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-10T21:02:06.169+0000 7fd17abf9700 -1 osd.4 0 waiting for initial osdmap 2023-10-10T21:02:06.181 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-10T21:02:06.179+0000 7fd1723e8700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-10T21:02:06.221 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-10T21:02:06.220+0000 7fd29f1f6700 -1 osd.6 0 waiting for initial osdmap 2023-10-10T21:02:06.229 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-10T21:02:06.228+0000 7fd2981e8700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-10T21:02:06.266 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-10T21:02:06.264+0000 7f74441f9700 -1 osd.5 0 waiting for initial osdmap 2023-10-10T21:02:06.273 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-10T21:02:06.271+0000 7f743b9e8700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-10T21:02:06.491 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-10-10T21:02:06.490+0000 7effcddf6700 -1 osd.2 0 waiting for initial osdmap 2023-10-10T21:02:06.498 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-10-10T21:02:06.497+0000 7effc6de8700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-10T21:02:06.540 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-10-10T21:02:06.539+0000 7f4b0b9f6700 -1 osd.3 0 waiting for initial osdmap 2023-10-10T21:02:06.546 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-10-10T21:02:06.545+0000 7f4b049e8700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-10T21:02:06.678 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:06.837 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.836+0000 7f9cf2dff700 1 Processor -- start 2023-10-10T21:02:06.838 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.836+0000 7f9cf2dff700 1 -- start start 2023-10-10T21:02:06.839 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.837+0000 7f9cf2dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9cec155ec0 0x7f9cec0c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:06.839 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.837+0000 7f9cf2dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cec06a1c0 0x7f9cec06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:06.839 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.837+0000 7f9cf2dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0c7e30 con 0x7f9cec155af0 2023-10-10T21:02:06.840 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.837+0000 7f9cf2dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec06b400 con 0x7f9cec06a1c0 2023-10-10T21:02:06.840 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.837+0000 7f9cf2dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0c7220 con 0x7f9cec155ec0 2023-10-10T21:02:06.840 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cf139c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cec06a1c0 0x7f9cec06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:06.840 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cf139c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cec06a1c0 0x7f9cec06e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59360/0 (socket says 172.21.15.154:59360) 2023-10-10T21:02:06.840 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cf139c700 1 -- 172.21.15.154:0/4280544849 learned_addr learned my addr 172.21.15.154:0/4280544849 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:06.841 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cebfff700 1 --2- 172.21.15.154:0/4280544849 >> v2:172.21.15.179:3300/0 conn(0x7f9cec155ec0 0x7f9cec0c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:06.844 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9ceb7fe700 1 -- 172.21.15.154:0/4280544849 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414199765 0 0) 0x7f9cec0c7e30 con 0x7f9cec155af0 2023-10-10T21:02:06.845 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cebfff700 1 -- 172.21.15.154:0/4280544849 >> v2:172.21.15.154:3300/0 conn(0x7f9cec06a1c0 msgr2=0x7f9cec06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:06.845 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cebfff700 1 --2- 172.21.15.154:0/4280544849 >> v2:172.21.15.154:3300/0 conn(0x7f9cec06a1c0 0x7f9cec06e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:06.845 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cebfff700 1 -- 172.21.15.154:0/4280544849 >> v1:172.21.15.179:6789/0 conn(0x7f9cec155af0 legacy=0x7f9cec0c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:06.845 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cebfff700 1 -- 172.21.15.154:0/4280544849 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0c7500 con 0x7f9cec155ec0 2023-10-10T21:02:06.846 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cf139c700 1 --2- 172.21.15.154:0/4280544849 >> v2:172.21.15.154:3300/0 conn(0x7f9cec06a1c0 0x7f9cec06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:06.846 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.838+0000 7f9cebfff700 1 --2- 172.21.15.154:0/4280544849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec155ec0 0x7f9cec0c82c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9cec069970 tx=0x7f9cd80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf5a1caeecbca90e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:06.846 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9ceb7fe700 1 -- 172.21.15.154:0/4280544849 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8011630 con 0x7f9cec155ec0 2023-10-10T21:02:06.846 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9ceb7fe700 1 -- 172.21.15.154:0/4280544849 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd8011790 con 0x7f9cec155ec0 2023-10-10T21:02:06.846 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9ceb7fe700 1 -- 172.21.15.154:0/4280544849 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8011b30 con 0x7f9cec155ec0 2023-10-10T21:02:06.847 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9cf2dff700 1 -- 172.21.15.154:0/4280544849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec155ec0 msgr2=0x7f9cec0c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:06.847 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9cf2dff700 1 --2- 172.21.15.154:0/4280544849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec155ec0 0x7f9cec0c82c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9cec069970 tx=0x7f9cd80091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:06.847 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9cf2dff700 1 -- 172.21.15.154:0/4280544849 shutdown_connections 2023-10-10T21:02:06.847 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9cf2dff700 1 --2- 172.21.15.154:0/4280544849 >> v2:172.21.15.154:3300/0 conn(0x7f9cec06a1c0 0x7f9cec06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:06.847 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9cf2dff700 1 --2- 172.21.15.154:0/4280544849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec155ec0 0x7f9cec0c82c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:06.848 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9cf2dff700 1 -- 172.21.15.154:0/4280544849 >> 172.21.15.154:0/4280544849 conn(0x7f9cec06d350 msgr2=0x7f9cec0cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:06.848 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9cf2dff700 1 -- 172.21.15.154:0/4280544849 shutdown_connections 2023-10-10T21:02:06.848 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.839+0000 7f9cf2dff700 1 -- 172.21.15.154:0/4280544849 wait complete. 2023-10-10T21:02:06.848 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.841+0000 7f9cf2dff700 1 Processor -- start 2023-10-10T21:02:06.849 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.841+0000 7f9cf2dff700 1 -- start start 2023-10-10T21:02:06.849 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf2dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec06a1c0 0x7f9cec145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:06.849 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf2dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cec155af0 0x7f9cec1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:06.849 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf2dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cec155ec0 0x7f9cec0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:06.849 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf2dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec146420 con 0x7f9cec155af0 2023-10-10T21:02:06.850 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf2dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec1521a0 con 0x7f9cec06a1c0 2023-10-10T21:02:06.850 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf2dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec152480 con 0x7f9cec155ec0 2023-10-10T21:02:06.850 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cec155af0 0x7f9cec1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:06.850 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cec155af0 0x7f9cec1516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59372/0 (socket says 172.21.15.154:59372) 2023-10-10T21:02:06.850 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cebfff700 1 -- 172.21.15.154:0/998268569 learned_addr learned my addr 172.21.15.154:0/998268569 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:06.851 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf0b9b700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec06a1c0 0x7f9cec145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:06.851 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf139c700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cec155ec0 0x7f9cec0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:06.851 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cebfff700 1 -- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cec155ec0 msgr2=0x7f9cec0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:06.851 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cebfff700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cec155ec0 0x7f9cec0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:06.851 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cebfff700 1 -- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec06a1c0 msgr2=0x7f9cec145ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:06.852 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cebfff700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec06a1c0 0x7f9cec145ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:06.852 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cebfff700 1 -- 172.21.15.154:0/998268569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4009ae0 con 0x7f9cec155af0 2023-10-10T21:02:06.852 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf139c700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cec155ec0 0x7f9cec0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:06.852 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.842+0000 7f9cf0b9b700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec06a1c0 0x7f9cec145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:06.853 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.843+0000 7f9cebfff700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cec155af0 0x7f9cec1516e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8013000 tx=0x7f9cd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:06.853 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.843+0000 7f9ce8ff9700 1 -- 172.21.15.154:0/998268569 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8011b10 con 0x7f9cec155af0 2023-10-10T21:02:06.853 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.843+0000 7f9ce8ff9700 1 -- 172.21.15.154:0/998268569 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd80253f0 con 0x7f9cec155af0 2023-10-10T21:02:06.853 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.843+0000 7f9ce8ff9700 1 -- 172.21.15.154:0/998268569 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8025790 con 0x7f9cec155af0 2023-10-10T21:02:06.853 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.843+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd8009420 con 0x7f9cec155af0 2023-10-10T21:02:06.854 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.843+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec152a40 con 0x7f9cec155af0 2023-10-10T21:02:06.855 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.844+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec068be0 con 0x7f9cec155af0 2023-10-10T21:02:06.855 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.845+0000 7f9ce8ff9700 1 -- 172.21.15.154:0/998268569 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f9cd8025b80 con 0x7f9cec155af0 2023-10-10T21:02:06.855 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.846+0000 7f9ce8ff9700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cd0066ea0 0x7f9cd0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:06.855 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.846+0000 7f9ce8ff9700 1 -- 172.21.15.154:0/998268569 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4187+0+0 (secure 0 0 0) 0x7f9cd80856d0 con 0x7f9cec155af0 2023-10-10T21:02:06.856 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.846+0000 7f9cf0b9b700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cd0066ea0 0x7f9cd0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:06.856 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.846+0000 7f9cf0b9b700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cd0066ea0 0x7f9cd0069350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0001860 tx=0x7f9ce0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:06.856 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:06.851+0000 7f9ce8ff9700 1 -- 172.21.15.154:0/998268569 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cd8052f70 con 0x7f9cec155af0 2023-10-10T21:02:07.055 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.054+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cec0c77e0 con 0x7f9cec155af0 2023-10-10T21:02:07.056 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.054+0000 7f9ce8ff9700 1 -- 172.21.15.154:0/998268569 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10018 (secure 0 0 0) 0x7f9cd8015090 con 0x7f9cec155af0 2023-10-10T21:02:07.056 INFO:teuthology.misc.health.smithi154.stdout: 2023-10-10T21:02:07.056 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":14,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:06.524566+0000","last_up_change":"2023-10-10T21:02:06.524566+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:07.058 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cd0066ea0 msgr2=0x7f9cd0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:07.059 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cd0066ea0 0x7f9cd0069350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0001860 tx=0x7f9ce0009040 comp rx=0 tx=0).stop 2023-10-10T21:02:07.059 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cec155af0 msgr2=0x7f9cec1516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:07.059 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cec155af0 0x7f9cec1516e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8013000 tx=0x7f9cd8017000 comp rx=0 tx=0).stop 2023-10-10T21:02:07.059 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 shutdown_connections 2023-10-10T21:02:07.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cd0066ea0 0x7f9cd0069350 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:07.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cec155ec0 0x7f9cec0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:07.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cec06a1c0 0x7f9cec145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:07.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 --2- 172.21.15.154:0/998268569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cec155af0 0x7f9cec1516e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:07.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 >> 172.21.15.154:0/998268569 conn(0x7f9cec06d350 msgr2=0x7f9cec0c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:07.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 shutdown_connections 2023-10-10T21:02:07.061 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:07.057+0000 7f9cf2dff700 1 -- 172.21.15.154:0/998268569 wait complete. 2023-10-10T21:02:07.074 DEBUG:teuthology.misc:7 of 8 OSDs are up 2023-10-10T21:02:13.880 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:14.048 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.047+0000 7f78be1ff700 1 Processor -- start 2023-10-10T21:02:14.049 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.047+0000 7f78be1ff700 1 -- start start 2023-10-10T21:02:14.050 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.048+0000 7f78be1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b806a770 0x7f78b80c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.050 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.048+0000 7f78be1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b80c8150 con 0x7f78b806a3a0 2023-10-10T21:02:14.050 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.048+0000 7f78be1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b80ccdf0 con 0x7f78b80c6f10 2023-10-10T21:02:14.050 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.048+0000 7f78be1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80c7540 con 0x7f78b806a770 2023-10-10T21:02:14.051 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f78b806a3a0 0x7f78b80c85e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38572/0 (socket says 172.21.15.154:38572) 2023-10-10T21:02:14.051 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b77fe700 1 -- 172.21.15.154:0/390723430 learned_addr learned my addr 172.21.15.154:0/390723430 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:14.051 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b6ffd700 1 --2- 172.21.15.154:0/390723430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b806a770 0x7f78b80c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.053 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b67fc700 1 -- 172.21.15.154:0/390723430 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951268924 0 0) 0x7f78b80c8150 con 0x7f78b806a3a0 2023-10-10T21:02:14.053 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b67fc700 1 -- 172.21.15.154:0/390723430 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a0003570 con 0x7f78b806a3a0 2023-10-10T21:02:14.053 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b67fc700 1 -- 172.21.15.154:0/390723430 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324950027 0 0) 0x7f78b80ccdf0 con 0x7f78b80c6f10 2023-10-10T21:02:14.054 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b67fc700 1 -- 172.21.15.154:0/390723430 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b80c8150 con 0x7f78b80c6f10 2023-10-10T21:02:14.054 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b6ffd700 1 -- 172.21.15.154:0/390723430 >> v1:172.21.15.179:6789/0 conn(0x7f78b80c6f10 legacy=0x7f78b815d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.054 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b6ffd700 1 -- 172.21.15.154:0/390723430 >> v1:172.21.15.154:6789/0 conn(0x7f78b806a3a0 legacy=0x7f78b80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.054 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.049+0000 7f78b6ffd700 1 -- 172.21.15.154:0/390723430 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b80c7820 con 0x7f78b806a770 2023-10-10T21:02:14.054 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.050+0000 7f78b6ffd700 1 --2- 172.21.15.154:0/390723430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b806a770 0x7f78b80c69d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009910 tx=0x7f78ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8b8e4db4291e8be server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:14.055 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.050+0000 7f78b67fc700 1 -- 172.21.15.154:0/390723430 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011630 con 0x7f78b806a770 2023-10-10T21:02:14.055 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.050+0000 7f78b67fc700 1 -- 172.21.15.154:0/390723430 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac011790 con 0x7f78b806a770 2023-10-10T21:02:14.055 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.050+0000 7f78b67fc700 1 -- 172.21.15.154:0/390723430 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011b30 con 0x7f78b806a770 2023-10-10T21:02:14.055 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.050+0000 7f78be1ff700 1 -- 172.21.15.154:0/390723430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b806a770 msgr2=0x7f78b80c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.055 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.050+0000 7f78be1ff700 1 --2- 172.21.15.154:0/390723430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b806a770 0x7f78b80c69d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009910 tx=0x7f78ac0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.056 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.051+0000 7f78be1ff700 1 -- 172.21.15.154:0/390723430 shutdown_connections 2023-10-10T21:02:14.056 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.051+0000 7f78be1ff700 1 --2- 172.21.15.154:0/390723430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b806a770 0x7f78b80c69d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.056 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.051+0000 7f78be1ff700 1 -- 172.21.15.154:0/390723430 >> 172.21.15.154:0/390723430 conn(0x7f78b806d350 msgr2=0x7f78b80cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:14.056 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.051+0000 7f78be1ff700 1 -- 172.21.15.154:0/390723430 shutdown_connections 2023-10-10T21:02:14.056 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.051+0000 7f78be1ff700 1 -- 172.21.15.154:0/390723430 wait complete. 2023-10-10T21:02:14.056 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.052+0000 7f78be1ff700 1 Processor -- start 2023-10-10T21:02:14.057 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.052+0000 7f78be1ff700 1 -- start start 2023-10-10T21:02:14.059 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78be1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b806a3a0 0x7f78b8151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78be1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b81538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78be1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b80c6f10 0x7f78b8153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78be1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80ad330 con 0x7f78b806a770 2023-10-10T21:02:14.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78be1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8151e70 con 0x7f78b806a3a0 2023-10-10T21:02:14.060 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78be1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80ac2d0 con 0x7f78b80c6f10 2023-10-10T21:02:14.061 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78b6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b81538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.061 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78b6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b81538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59408/0 (socket says 172.21.15.154:59408) 2023-10-10T21:02:14.061 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78b6ffd700 1 -- 172.21.15.154:0/3995478901 learned_addr learned my addr 172.21.15.154:0/3995478901 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:14.061 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78b77fe700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b806a3a0 0x7f78b8151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.062 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.053+0000 7f78b7fff700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b80c6f10 0x7f78b8153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.062 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f78b6ffd700 1 -- 172.21.15.154:0/3995478901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b80c6f10 msgr2=0x7f78b8153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.062 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f78b6ffd700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b80c6f10 0x7f78b8153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.062 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f78b6ffd700 1 -- 172.21.15.154:0/3995478901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b806a3a0 msgr2=0x7f78b8151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.063 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f78b6ffd700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b806a3a0 0x7f78b8151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.063 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f78b6ffd700 1 -- 172.21.15.154:0/3995478901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009420 con 0x7f78b806a770 2023-10-10T21:02:14.063 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f78b77fe700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b806a3a0 0x7f78b8151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:14.063 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f78b6ffd700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b81538e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009f00 tx=0x7f78ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:14.063 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f789f7fe700 1 -- 172.21.15.154:0/3995478901 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac01f070 con 0x7f78b806a770 2023-10-10T21:02:14.063 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f789f7fe700 1 -- 172.21.15.154:0/3995478901 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac002f70 con 0x7f78b806a770 2023-10-10T21:02:14.064 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f789f7fe700 1 -- 172.21.15.154:0/3995478901 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011900 con 0x7f78b806a770 2023-10-10T21:02:14.064 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b80ac570 con 0x7f78b806a770 2023-10-10T21:02:14.064 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.054+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b80acb30 con 0x7f78b806a770 2023-10-10T21:02:14.064 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.055+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b8068be0 con 0x7f78b806a770 2023-10-10T21:02:14.064 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.056+0000 7f789f7fe700 1 -- 172.21.15.154:0/3995478901 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78ac023070 con 0x7f78b806a770 2023-10-10T21:02:14.065 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.057+0000 7f789f7fe700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f78a4066f30 0x7f78a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.065 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.057+0000 7f789f7fe700 1 -- 172.21.15.154:0/3995478901 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f78ac0854d0 con 0x7f78b806a770 2023-10-10T21:02:14.065 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.057+0000 7f78b77fe700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f78a4066f30 0x7f78a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.065 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.058+0000 7f78b77fe700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f78a4066f30 0x7f78a40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f78a80079e0 tx=0x7f78a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:14.066 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.062+0000 7f789f7fe700 1 -- 172.21.15.154:0/3995478901 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78ac0529f0 con 0x7f78b806a770 2023-10-10T21:02:14.258 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.257+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78b8158cd0 con 0x7f78b806a770 2023-10-10T21:02:14.259 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.258+0000 7f789f7fe700 1 -- 172.21.15.154:0/3995478901 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f78ac015090 con 0x7f78b806a770 2023-10-10T21:02:14.259 INFO:teuthology.misc.health.smithi154.stdout: 2023-10-10T21:02:14.259 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":18,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:10.551551+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:14.261 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f78a4066f30 msgr2=0x7f78a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.262 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f78a4066f30 0x7f78a40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f78a80079e0 tx=0x7f78a8009040 comp rx=0 tx=0).stop 2023-10-10T21:02:14.262 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 msgr2=0x7f78b81538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.262 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b81538e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009f00 tx=0x7f78ac017000 comp rx=0 tx=0).stop 2023-10-10T21:02:14.262 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 shutdown_connections 2023-10-10T21:02:14.263 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f78a4066f30 0x7f78a40693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.263 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b80c6f10 0x7f78b8153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.263 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b806a3a0 0x7f78b8151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.263 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 --2- 172.21.15.154:0/3995478901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b81538e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.263 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 >> 172.21.15.154:0/3995478901 conn(0x7f78b806d350 msgr2=0x7f78b80c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:14.264 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 shutdown_connections 2023-10-10T21:02:14.264 INFO:teuthology.misc.health.smithi154.stderr:2023-10-10T21:02:14.260+0000 7f78be1ff700 1 -- 172.21.15.154:0/3995478901 wait complete. 2023-10-10T21:02:14.276 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-10T21:02:14.277 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-10T21:02:14.277 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T21:02:14.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T21:02:14.282 INFO:tasks.ceph.mds.a:Started 2023-10-10T21:02:14.282 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T21:02:14.283 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T21:02:14.287 INFO:tasks.ceph.mds.c:Started 2023-10-10T21:02:14.287 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T21:02:14.287 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T21:02:14.292 INFO:tasks.ceph.mds.b:Started 2023-10-10T21:02:14.292 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T21:02:14.293 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T21:02:14.297 INFO:tasks.ceph.mds.d:Started 2023-10-10T21:02:14.298 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-10T21:02:14.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:14.417 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:02:14.418 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:02:14.433 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:02:14.436 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T21:02:14.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.492+0000 7f31fa9ff700 1 Processor -- start 2023-10-10T21:02:14.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.492+0000 7f31fa9ff700 1 -- start start 2023-10-10T21:02:14.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31fa9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f40caa90 0x7f31f40c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31fa9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f415d7e0 con 0x7f31f406bcd0 2023-10-10T21:02:14.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31fa9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f415dac0 con 0x7f31f406c0a0 2023-10-10T21:02:14.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31fa9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40caf30 con 0x7f31f40caa90 2023-10-10T21:02:14.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f3fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f31f406bcd0 0x7f31f415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38578/0 (socket says 172.21.15.154:38578) 2023-10-10T21:02:14.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f3fff700 1 -- 172.21.15.154:0/2832109830 learned_addr learned my addr 172.21.15.154:0/2832109830 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:14.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f8f9c700 1 --2- 172.21.15.154:0/2832109830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f40caa90 0x7f31f40c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f2ffd700 1 -- 172.21.15.154:0/2832109830 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187528679 0 0) 0x7f31f415d7e0 con 0x7f31f406bcd0 2023-10-10T21:02:14.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f2ffd700 1 -- 172.21.15.154:0/2832109830 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31dc003570 con 0x7f31f406bcd0 2023-10-10T21:02:14.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f2ffd700 1 -- 172.21.15.154:0/2832109830 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809293297 0 0) 0x7f31f415dac0 con 0x7f31f406c0a0 2023-10-10T21:02:14.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f2ffd700 1 -- 172.21.15.154:0/2832109830 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f415d7e0 con 0x7f31f406c0a0 2023-10-10T21:02:14.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f8f9c700 1 -- 172.21.15.154:0/2832109830 >> v1:172.21.15.179:6789/0 conn(0x7f31f406c0a0 legacy=0x7f31f415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f8f9c700 1 -- 172.21.15.154:0/2832109830 >> v1:172.21.15.154:6789/0 conn(0x7f31f406bcd0 legacy=0x7f31f415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.494+0000 7f31f8f9c700 1 -- 172.21.15.154:0/2832109830 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f415aa30 con 0x7f31f40caa90 2023-10-10T21:02:14.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.495+0000 7f31f8f9c700 1 --2- 172.21.15.154:0/2832109830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f40caa90 0x7f31f40c8c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009e90 tx=0x7f31ec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d99e8d030a218ea server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:14.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.495+0000 7f31f2ffd700 1 -- 172.21.15.154:0/2832109830 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec00e070 con 0x7f31f40caa90 2023-10-10T21:02:14.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.495+0000 7f31f2ffd700 1 -- 172.21.15.154:0/2832109830 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec00bb80 con 0x7f31f40caa90 2023-10-10T21:02:14.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.495+0000 7f31f2ffd700 1 -- 172.21.15.154:0/2832109830 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec012430 con 0x7f31f40caa90 2023-10-10T21:02:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.495+0000 7f31fa9ff700 1 -- 172.21.15.154:0/2832109830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f40caa90 msgr2=0x7f31f40c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.495+0000 7f31fa9ff700 1 --2- 172.21.15.154:0/2832109830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f40caa90 0x7f31f40c8c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009e90 tx=0x7f31ec009780 comp rx=0 tx=0).stop 2023-10-10T21:02:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.495+0000 7f31fa9ff700 1 -- 172.21.15.154:0/2832109830 shutdown_connections 2023-10-10T21:02:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.495+0000 7f31fa9ff700 1 --2- 172.21.15.154:0/2832109830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f40caa90 0x7f31f40c8c40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.496+0000 7f31fa9ff700 1 -- 172.21.15.154:0/2832109830 >> 172.21.15.154:0/2832109830 conn(0x7f31f40ce600 msgr2=0x7f31f40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.496+0000 7f31fa9ff700 1 -- 172.21.15.154:0/2832109830 shutdown_connections 2023-10-10T21:02:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.496+0000 7f31fa9ff700 1 -- 172.21.15.154:0/2832109830 wait complete. 2023-10-10T21:02:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.497+0000 7f31fa9ff700 1 Processor -- start 2023-10-10T21:02:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.497+0000 7f31fa9ff700 1 -- start start 2023-10-10T21:02:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31fa9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f406bcd0 0x7f31f40b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31fa9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31f406c0a0 0x7f31f41549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31fa9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31f40caa90 0x7f31f4141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31fa9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40b2920 con 0x7f31f40caa90 2023-10-10T21:02:14.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31fa9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40b1d10 con 0x7f31f406c0a0 2023-10-10T21:02:14.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31fa9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40b1ff0 con 0x7f31f406bcd0 2023-10-10T21:02:14.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31f8f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31f40caa90 0x7f31f4141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31f8f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31f40caa90 0x7f31f4141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59452/0 (socket says 172.21.15.154:59452) 2023-10-10T21:02:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31f8f9c700 1 -- 172.21.15.154:0/691607452 learned_addr learned my addr 172.21.15.154:0/691607452 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31f3fff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f406bcd0 0x7f31f40b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.498+0000 7f31f37fe700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31f406c0a0 0x7f31f41549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31f8f9c700 1 -- 172.21.15.154:0/691607452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f406bcd0 msgr2=0x7f31f40b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31f8f9c700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f406bcd0 0x7f31f40b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31f8f9c700 1 -- 172.21.15.154:0/691607452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31f406c0a0 msgr2=0x7f31f41549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31f8f9c700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31f406c0a0 0x7f31f41549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31f8f9c700 1 -- 172.21.15.154:0/691607452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec009a20 con 0x7f31f40caa90 2023-10-10T21:02:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31f8f9c700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31f40caa90 0x7f31f4141e60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00b610 tx=0x7f31ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31dbfff700 1 -- 172.21.15.154:0/691607452 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec007000 con 0x7f31f40caa90 2023-10-10T21:02:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31dbfff700 1 -- 172.21.15.154:0/691607452 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec0263f0 con 0x7f31f40caa90 2023-10-10T21:02:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f40b22d0 con 0x7f31f40caa90 2023-10-10T21:02:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31dbfff700 1 -- 172.21.15.154:0/691607452 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0267d0 con 0x7f31f40caa90 2023-10-10T21:02:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.499+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f40b18e0 con 0x7f31f40caa90 2023-10-10T21:02:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.500+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f404c3c0 con 0x7f31f40caa90 2023-10-10T21:02:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.501+0000 7f31dbfff700 1 -- 172.21.15.154:0/691607452 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31ec026c00 con 0x7f31f40caa90 2023-10-10T21:02:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.502+0000 7f31dbfff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f31e0066f30 0x7f31e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.503+0000 7f31dbfff700 1 -- 172.21.15.154:0/691607452 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f31ec086200 con 0x7f31f40caa90 2023-10-10T21:02:14.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.503+0000 7f31f3fff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f31e0066f30 0x7f31e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.503+0000 7f31f3fff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f31e0066f30 0x7f31e00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31e4007fd0 tx=0x7f31e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:14.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.507+0000 7f31dbfff700 1 -- 172.21.15.154:0/691607452 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31ec053720 con 0x7f31f40caa90 2023-10-10T21:02:14.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.705+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31f40b2a60 con 0x7f31f40caa90 2023-10-10T21:02:14.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.706+0000 7f31dbfff700 1 -- 172.21.15.154:0/691607452 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f31ec056d40 con 0x7f31f40caa90 2023-10-10T21:02:14.707 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:14.708 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":18,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:10.551551+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:14.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.708+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f31e0066f30 msgr2=0x7f31e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.708+0000 7f31fa9ff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f31e0066f30 0x7f31e00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31e4007fd0 tx=0x7f31e4009040 comp rx=0 tx=0).stop 2023-10-10T21:02:14.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.708+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31f40caa90 msgr2=0x7f31f4141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.708+0000 7f31fa9ff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31f40caa90 0x7f31f4141e60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00b610 tx=0x7f31ec019000 comp rx=0 tx=0).stop 2023-10-10T21:02:14.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.709+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 shutdown_connections 2023-10-10T21:02:14.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.709+0000 7f31fa9ff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31f40caa90 0x7f31f4141e60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.709+0000 7f31fa9ff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f31e0066f30 0x7f31e00693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.709+0000 7f31fa9ff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31f406bcd0 0x7f31f40b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.709+0000 7f31fa9ff700 1 --2- 172.21.15.154:0/691607452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31f406c0a0 0x7f31f41549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.709+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 >> 172.21.15.154:0/691607452 conn(0x7f31f40ce600 msgr2=0x7f31f415c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:14.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.709+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 shutdown_connections 2023-10-10T21:02:14.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.709+0000 7f31fa9ff700 1 -- 172.21.15.154:0/691607452 wait complete. 2023-10-10T21:02:14.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T21:02:14.728 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:02:14.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.913+0000 7fb5f6bff700 1 Processor -- start 2023-10-10T21:02:14.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.913+0000 7fb5f6bff700 1 -- start start 2023-10-10T21:02:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.914+0000 7fb5f6bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5f00637d0 0x7fb5f006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.914+0000 7fb5f6bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5f006a2b0 0x7fb5f006a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.914+0000 7fb5f6bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f00ac450 con 0x7fb5f006b160 2023-10-10T21:02:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.914+0000 7fb5f6bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f00693d0 con 0x7fb5f00637d0 2023-10-10T21:02:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.914+0000 7fb5f6bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f0069d00 con 0x7fb5f006a2b0 2023-10-10T21:02:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.914+0000 7fb5f499b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb5f006b160 0x7fb5f0068cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38588/0 (socket says 172.21.15.154:38588) 2023-10-10T21:02:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.914+0000 7fb5f499b700 1 -- 172.21.15.154:0/1890469853 learned_addr learned my addr 172.21.15.154:0/1890469853 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5effff700 1 --2- 172.21.15.154:0/1890469853 >> v2:172.21.15.154:3300/0 conn(0x7fb5f00637d0 0x7fb5f006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5f519c700 1 --2- 172.21.15.154:0/1890469853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5f006a2b0 0x7fb5f006a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5ef7fe700 1 -- 172.21.15.154:0/1890469853 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650411713 0 0) 0x7fb5f00ac450 con 0x7fb5f006b160 2023-10-10T21:02:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5ef7fe700 1 -- 172.21.15.154:0/1890469853 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e0003570 con 0x7fb5f006b160 2023-10-10T21:02:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5effff700 1 -- 172.21.15.154:0/1890469853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5f006a2b0 msgr2=0x7fb5f006a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5effff700 1 --2- 172.21.15.154:0/1890469853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5f006a2b0 0x7fb5f006a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5effff700 1 -- 172.21.15.154:0/1890469853 >> v1:172.21.15.154:6789/0 conn(0x7fb5f006b160 legacy=0x7fb5f0068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5effff700 1 -- 172.21.15.154:0/1890469853 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0068830 con 0x7fb5f00637d0 2023-10-10T21:02:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5effff700 1 --2- 172.21.15.154:0/1890469853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f00637d0 0x7fb5f006b530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0098e0 tx=0x7fb5dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37651fe3c28da007 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.915+0000 7fb5ef7fe700 1 -- 172.21.15.154:0/1890469853 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc011630 con 0x7fb5f00637d0 2023-10-10T21:02:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5ef7fe700 1 -- 172.21.15.154:0/1890469853 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc011790 con 0x7fb5f00637d0 2023-10-10T21:02:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5ef7fe700 1 -- 172.21.15.154:0/1890469853 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc011b30 con 0x7fb5f00637d0 2023-10-10T21:02:14.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5f6bff700 1 -- 172.21.15.154:0/1890469853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f00637d0 msgr2=0x7fb5f006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5f6bff700 1 --2- 172.21.15.154:0/1890469853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f00637d0 0x7fb5f006b530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0098e0 tx=0x7fb5dc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5f6bff700 1 -- 172.21.15.154:0/1890469853 shutdown_connections 2023-10-10T21:02:14.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5f6bff700 1 --2- 172.21.15.154:0/1890469853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5f006a2b0 0x7fb5f006a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5f6bff700 1 --2- 172.21.15.154:0/1890469853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f00637d0 0x7fb5f006b530 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5f6bff700 1 -- 172.21.15.154:0/1890469853 >> 172.21.15.154:0/1890469853 conn(0x7fb5f006ded0 msgr2=0x7fb5f006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:14.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5f6bff700 1 -- 172.21.15.154:0/1890469853 shutdown_connections 2023-10-10T21:02:14.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.916+0000 7fb5f6bff700 1 -- 172.21.15.154:0/1890469853 wait complete. 2023-10-10T21:02:14.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.918+0000 7fb5f6bff700 1 Processor -- start 2023-10-10T21:02:14.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.918+0000 7fb5f6bff700 1 -- start start 2023-10-10T21:02:14.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f6bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5f00637d0 0x7fb5f00afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f6bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5f006a2b0 0x7fb5f014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f6bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f006b160 0x7fb5f014dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f6bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f0157e90 con 0x7fb5f006b160 2023-10-10T21:02:14.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f6bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f0157b90 con 0x7fb5f00637d0 2023-10-10T21:02:14.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f6bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f0159d80 con 0x7fb5f006a2b0 2023-10-10T21:02:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f519c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f006b160 0x7fb5f014dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f519c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f006b160 0x7fb5f014dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59472/0 (socket says 172.21.15.154:59472) 2023-10-10T21:02:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f519c700 1 -- 172.21.15.154:0/3860289965 learned_addr learned my addr 172.21.15.154:0/3860289965 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f519c700 1 -- 172.21.15.154:0/3860289965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5f006a2b0 msgr2=0x7fb5f014e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f519c700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5f006a2b0 0x7fb5f014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f519c700 1 -- 172.21.15.154:0/3860289965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5f00637d0 msgr2=0x7fb5f00afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f519c700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5f00637d0 0x7fb5f00afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f519c700 1 -- 172.21.15.154:0/3860289965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009420 con 0x7fb5f006b160 2023-10-10T21:02:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.919+0000 7fb5f519c700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f006b160 0x7fb5f014dae0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800efa0 tx=0x7fb5e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.920+0000 7fb5ecff9700 1 -- 172.21.15.154:0/3860289965 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800cbf0 con 0x7fb5f006b160 2023-10-10T21:02:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.920+0000 7fb5ecff9700 1 -- 172.21.15.154:0/3860289965 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e800f040 con 0x7fb5f006b160 2023-10-10T21:02:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.920+0000 7fb5ecff9700 1 -- 172.21.15.154:0/3860289965 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8014480 con 0x7fb5f006b160 2023-10-10T21:02:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.920+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f015a060 con 0x7fb5f006b160 2023-10-10T21:02:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.920+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f015a340 con 0x7fb5f006b160 2023-10-10T21:02:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.921+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f004c3c0 con 0x7fb5f006b160 2023-10-10T21:02:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.922+0000 7fb5ecff9700 1 -- 172.21.15.154:0/3860289965 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5e8014830 con 0x7fb5f006b160 2023-10-10T21:02:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.922+0000 7fb5ecff9700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb5d4066f30 0x7fb5d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:14.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.922+0000 7fb5ecff9700 1 -- 172.21.15.154:0/3860289965 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb5e8084be0 con 0x7fb5f006b160 2023-10-10T21:02:14.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.923+0000 7fb5f499b700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb5d4066f30 0x7fb5d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:14.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.923+0000 7fb5f499b700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb5d4066f30 0x7fb5d40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40058d0 tx=0x7fb5e40079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:14.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:14.927+0000 7fb5ecff9700 1 -- 172.21.15.154:0/3860289965 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5e8052180 con 0x7fb5f006b160 2023-10-10T21:02:15.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.119+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5f0157fd0 con 0x7fb5f006b160 2023-10-10T21:02:15.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.119+0000 7fb5ecff9700 1 -- 172.21.15.154:0/3860289965 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5e8018020 con 0x7fb5f006b160 2023-10-10T21:02:15.121 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:02:15.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.121+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb5d4066f30 msgr2=0x7fb5d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.121+0000 7fb5f6bff700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb5d4066f30 0x7fb5d40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40058d0 tx=0x7fb5e40079d0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.121+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f006b160 msgr2=0x7fb5f014dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.121+0000 7fb5f6bff700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f006b160 0x7fb5f014dae0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800efa0 tx=0x7fb5e800b040 comp rx=0 tx=0).stop 2023-10-10T21:02:15.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.122+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 shutdown_connections 2023-10-10T21:02:15.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.122+0000 7fb5f6bff700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f006b160 0x7fb5f014dae0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.122+0000 7fb5f6bff700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5f00637d0 0x7fb5f00afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.122+0000 7fb5f6bff700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb5d4066f30 0x7fb5d40693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.122+0000 7fb5f6bff700 1 --2- 172.21.15.154:0/3860289965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5f006a2b0 0x7fb5f014e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.122+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 >> 172.21.15.154:0/3860289965 conn(0x7fb5f006ded0 msgr2=0x7fb5f00ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:15.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.122+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 shutdown_connections 2023-10-10T21:02:15.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.122+0000 7fb5f6bff700 1 -- 172.21.15.154:0/3860289965 wait complete. 2023-10-10T21:02:15.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:02:15.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:02:15.190 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:02:15.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.325+0000 7fd3bb59e700 1 Processor -- start 2023-10-10T21:02:15.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.326+0000 7fd3bb59e700 1 -- start start 2023-10-10T21:02:15.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.327+0000 7fd3bb59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3bc1566e0 0x7fd3bc0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.327+0000 7fd3bb59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc0ca860 con 0x7fd3bc0cb900 2023-10-10T21:02:15.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.327+0000 7fd3bb59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc0cab40 con 0x7fd3bc156310 2023-10-10T21:02:15.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.327+0000 7fd3bb59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc0cae20 con 0x7fd3bc1566e0 2023-10-10T21:02:15.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.327+0000 7fd3b9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3bc1566e0 0x7fd3bc0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.327+0000 7fd3bad9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3bc0cb900 0x7fd3bc0c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38594/0 (socket says 172.21.15.154:38594) 2023-10-10T21:02:15.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.327+0000 7fd3bad9d700 1 -- 172.21.15.154:0/3773553433 learned_addr learned my addr 172.21.15.154:0/3773553433 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:15.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.328+0000 7fd3b959a700 1 -- 172.21.15.154:0/3773553433 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477374521 0 0) 0x7fd3bc0ca860 con 0x7fd3bc0cb900 2023-10-10T21:02:15.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.328+0000 7fd3b959a700 1 -- 172.21.15.154:0/3773553433 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a4003570 con 0x7fd3bc0cb900 2023-10-10T21:02:15.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.328+0000 7fd3b9d9b700 1 -- 172.21.15.154:0/3773553433 >> v1:172.21.15.179:6789/0 conn(0x7fd3bc156310 legacy=0x7fd3bc0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.328+0000 7fd3b9d9b700 1 -- 172.21.15.154:0/3773553433 >> v1:172.21.15.154:6789/0 conn(0x7fd3bc0cb900 legacy=0x7fd3bc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.328+0000 7fd3b9d9b700 1 -- 172.21.15.154:0/3773553433 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0cb100 con 0x7fd3bc1566e0 2023-10-10T21:02:15.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.328+0000 7fd3b9d9b700 1 --2- 172.21.15.154:0/3773553433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 0x7fd3bc0ae000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00098e0 tx=0x7fd3b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268ec37033477939 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:15.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.328+0000 7fd3b959a700 1 -- 172.21.15.154:0/3773553433 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000b640 con 0x7fd3bc1566e0 2023-10-10T21:02:15.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.328+0000 7fd3b959a700 1 -- 172.21.15.154:0/3773553433 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b000b7a0 con 0x7fd3bc1566e0 2023-10-10T21:02:15.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.328+0000 7fd3b959a700 1 -- 172.21.15.154:0/3773553433 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000bb20 con 0x7fd3bc1566e0 2023-10-10T21:02:15.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.329+0000 7fd3bb59e700 1 -- 172.21.15.154:0/3773553433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 msgr2=0x7fd3bc0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.329+0000 7fd3bb59e700 1 --2- 172.21.15.154:0/3773553433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 0x7fd3bc0ae000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00098e0 tx=0x7fd3b00091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.329+0000 7fd3bb59e700 1 -- 172.21.15.154:0/3773553433 shutdown_connections 2023-10-10T21:02:15.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.329+0000 7fd3bb59e700 1 --2- 172.21.15.154:0/3773553433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 0x7fd3bc0ae000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.329+0000 7fd3bb59e700 1 -- 172.21.15.154:0/3773553433 >> 172.21.15.154:0/3773553433 conn(0x7fd3bc0cc1f0 msgr2=0x7fd3bc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:15.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.329+0000 7fd3bb59e700 1 -- 172.21.15.154:0/3773553433 shutdown_connections 2023-10-10T21:02:15.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.329+0000 7fd3bb59e700 1 -- 172.21.15.154:0/3773553433 wait complete. 2023-10-10T21:02:15.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.330+0000 7fd3bb59e700 1 Processor -- start 2023-10-10T21:02:15.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.330+0000 7fd3bb59e700 1 -- start start 2023-10-10T21:02:15.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.331+0000 7fd3bb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3bc0cb900 0x7fd3bc0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.331+0000 7fd3bb59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3bc156310 0x7fd3bc14ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.331+0000 7fd3bb59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 0x7fd3bc16dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.331+0000 7fd3bb59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0b1e70 con 0x7fd3bc1566e0 2023-10-10T21:02:15.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.331+0000 7fd3bb59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc15da70 con 0x7fd3bc156310 2023-10-10T21:02:15.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.331+0000 7fd3bb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc14f160 con 0x7fd3bc0cb900 2023-10-10T21:02:15.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3bad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 0x7fd3bc16dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3bad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 0x7fd3bc16dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59488/0 (socket says 172.21.15.154:59488) 2023-10-10T21:02:15.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3bad9d700 1 -- 172.21.15.154:0/537902105 learned_addr learned my addr 172.21.15.154:0/537902105 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:15.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3b9d9b700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3bc156310 0x7fd3bc14ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3ba59c700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3bc0cb900 0x7fd3bc0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3bad9d700 1 -- 172.21.15.154:0/537902105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3bc0cb900 msgr2=0x7fd3bc0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3bad9d700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3bc0cb900 0x7fd3bc0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3bad9d700 1 -- 172.21.15.154:0/537902105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3bc156310 msgr2=0x7fd3bc14ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3bad9d700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3bc156310 0x7fd3bc14ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3bad9d700 1 -- 172.21.15.154:0/537902105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b0009420 con 0x7fd3bc1566e0 2023-10-10T21:02:15.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.332+0000 7fd3bad9d700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 0x7fd3bc16dae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4001460 tx=0x7fd3b4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:15.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.333+0000 7fd3aa7fc700 1 -- 172.21.15.154:0/537902105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400a870 con 0x7fd3bc1566e0 2023-10-10T21:02:15.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.333+0000 7fd3aa7fc700 1 -- 172.21.15.154:0/537902105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400a9d0 con 0x7fd3bc1566e0 2023-10-10T21:02:15.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.333+0000 7fd3aa7fc700 1 -- 172.21.15.154:0/537902105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400ad50 con 0x7fd3bc1566e0 2023-10-10T21:02:15.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.333+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc15ce60 con 0x7fd3bc1566e0 2023-10-10T21:02:15.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.333+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc15d420 con 0x7fd3bc1566e0 2023-10-10T21:02:15.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.334+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc06dc30 con 0x7fd3bc1566e0 2023-10-10T21:02:15.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.335+0000 7fd3aa7fc700 1 -- 172.21.15.154:0/537902105 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3b4007300 con 0x7fd3bc1566e0 2023-10-10T21:02:15.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.336+0000 7fd3aa7fc700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd39c066f30 0x7fd39c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.336+0000 7fd3aa7fc700 1 -- 172.21.15.154:0/537902105 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd3b40845b0 con 0x7fd3bc1566e0 2023-10-10T21:02:15.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.336+0000 7fd3ba59c700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd39c066f30 0x7fd39c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.336+0000 7fd3ba59c700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd39c066f30 0x7fd39c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac003a80 tx=0x7fd3ac007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:15.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.340+0000 7fd3aa7fc700 1 -- 172.21.15.154:0/537902105 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3b4051ac0 con 0x7fd3bc1566e0 2023-10-10T21:02:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.574+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3bc0ad910 con 0x7fd3bc1566e0 2023-10-10T21:02:15.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.575+0000 7fd3aa7fc700 1 -- 172.21.15.154:0/537902105 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3536 (secure 0 0 0) 0x7fd3b40550e0 con 0x7fd3bc1566e0 2023-10-10T21:02:15.576 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:15.577 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439513038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439513038},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439513038}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1179223321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1179223321},{"type":"v1","addr":"172.21.15.154:6836","nonce":1179223321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4116873553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4116873553},{"type":"v1","addr":"172.21.15.179:6835","nonce":4116873553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2053231138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2053231138},{"type":"v1","addr":"172.21.15.179:6833","nonce":2053231138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-10T21:02:15.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.577+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd39c066f30 msgr2=0x7fd39c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.577+0000 7fd3bb59e700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd39c066f30 0x7fd39c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac003a80 tx=0x7fd3ac007ec0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.577+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 msgr2=0x7fd3bc16dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.577+0000 7fd3bb59e700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 0x7fd3bc16dae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4001460 tx=0x7fd3b4001a40 comp rx=0 tx=0).stop 2023-10-10T21:02:15.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.578+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 shutdown_connections 2023-10-10T21:02:15.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.578+0000 7fd3bb59e700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc1566e0 0x7fd3bc16dae0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.578+0000 7fd3bb59e700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd39c066f30 0x7fd39c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.578+0000 7fd3bb59e700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3bc0cb900 0x7fd3bc0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.578+0000 7fd3bb59e700 1 --2- 172.21.15.154:0/537902105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3bc156310 0x7fd3bc14ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.578+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 >> 172.21.15.154:0/537902105 conn(0x7fd3bc0cc1f0 msgr2=0x7fd3bc150b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:15.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.578+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 shutdown_connections 2023-10-10T21:02:15.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.578+0000 7fd3bb59e700 1 -- 172.21.15.154:0/537902105 wait complete. 2023-10-10T21:02:15.582 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 3 2023-10-10T21:02:15.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:15.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.777+0000 7fbef599d700 1 Processor -- start 2023-10-10T21:02:15.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.778+0000 7fbef599d700 1 -- start start 2023-10-10T21:02:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.779+0000 7fbef599d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbef0150550 0x7fbef0157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.779+0000 7fbef599d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef006e2a0 con 0x7fbef00c7410 2023-10-10T21:02:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.779+0000 7fbef599d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef006b2e0 con 0x7fbef0150180 2023-10-10T21:02:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.779+0000 7fbef599d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef00c78e0 con 0x7fbef0150550 2023-10-10T21:02:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.779+0000 7fbeeffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbef0150550 0x7fbef0157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.779+0000 7fbef519c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbef00c7410 0x7fbef0069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38610/0 (socket says 172.21.15.154:38610) 2023-10-10T21:02:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.779+0000 7fbef519c700 1 -- 172.21.15.154:0/1074126046 learned_addr learned my addr 172.21.15.154:0/1074126046 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.780+0000 7fbeef7fe700 1 -- 172.21.15.154:0/1074126046 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351476758 0 0) 0x7fbef006e2a0 con 0x7fbef00c7410 2023-10-10T21:02:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.780+0000 7fbeeffff700 1 -- 172.21.15.154:0/1074126046 >> v1:172.21.15.179:6789/0 conn(0x7fbef0150180 legacy=0x7fbef00c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.780+0000 7fbeeffff700 1 -- 172.21.15.154:0/1074126046 >> v1:172.21.15.154:6789/0 conn(0x7fbef00c7410 legacy=0x7fbef0069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.780+0000 7fbeeffff700 1 -- 172.21.15.154:0/1074126046 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef00c7bc0 con 0x7fbef0150550 2023-10-10T21:02:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.780+0000 7fbeeffff700 1 --2- 172.21.15.154:0/1074126046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150550 0x7fbef0157770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0098e0 tx=0x7fbedc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7633d989334fffbd server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.780+0000 7fbeef7fe700 1 -- 172.21.15.154:0/1074126046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc009e80 con 0x7fbef0150550 2023-10-10T21:02:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.780+0000 7fbeef7fe700 1 -- 172.21.15.154:0/1074126046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc00b860 con 0x7fbef0150550 2023-10-10T21:02:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.780+0000 7fbeef7fe700 1 -- 172.21.15.154:0/1074126046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00bbe0 con 0x7fbef0150550 2023-10-10T21:02:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.781+0000 7fbef599d700 1 -- 172.21.15.154:0/1074126046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150550 msgr2=0x7fbef0157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.781+0000 7fbef599d700 1 --2- 172.21.15.154:0/1074126046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150550 0x7fbef0157770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0098e0 tx=0x7fbedc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.781+0000 7fbef599d700 1 -- 172.21.15.154:0/1074126046 shutdown_connections 2023-10-10T21:02:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.781+0000 7fbef599d700 1 --2- 172.21.15.154:0/1074126046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150550 0x7fbef0157770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.781+0000 7fbef599d700 1 -- 172.21.15.154:0/1074126046 >> 172.21.15.154:0/1074126046 conn(0x7fbef00cc1f0 msgr2=0x7fbef00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.781+0000 7fbef599d700 1 -- 172.21.15.154:0/1074126046 shutdown_connections 2023-10-10T21:02:15.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.781+0000 7fbef599d700 1 -- 172.21.15.154:0/1074126046 wait complete. 2023-10-10T21:02:15.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.782+0000 7fbef599d700 1 Processor -- start 2023-10-10T21:02:15.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.782+0000 7fbef599d700 1 -- start start 2023-10-10T21:02:15.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.783+0000 7fbef599d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef00c7410 0x7fbef00c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.783+0000 7fbef599d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150180 0x7fbef00c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.783+0000 7fbef599d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef0150550 0x7fbef0149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.783+0000 7fbef599d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c5dd0 con 0x7fbef0150180 2023-10-10T21:02:15.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.783+0000 7fbef599d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c6260 con 0x7fbef00c7410 2023-10-10T21:02:15.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.783+0000 7fbef599d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c4ef0 con 0x7fbef0150550 2023-10-10T21:02:15.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150180 0x7fbef00c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150180 0x7fbef00c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59498/0 (socket says 172.21.15.154:59498) 2023-10-10T21:02:15.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeeffff700 1 -- 172.21.15.154:0/3290535826 learned_addr learned my addr 172.21.15.154:0/3290535826 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:15.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbef499b700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef00c7410 0x7fbef00c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbef519c700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef0150550 0x7fbef0149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeeffff700 1 -- 172.21.15.154:0/3290535826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef0150550 msgr2=0x7fbef0149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeeffff700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef0150550 0x7fbef0149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeeffff700 1 -- 172.21.15.154:0/3290535826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef00c7410 msgr2=0x7fbef00c2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeeffff700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef00c7410 0x7fbef00c2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeeffff700 1 -- 172.21.15.154:0/3290535826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc009420 con 0x7fbef0150180 2023-10-10T21:02:15.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbef499b700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef00c7410 0x7fbef00c2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:15.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeeffff700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150180 0x7fbef00c49b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbef006b470 tx=0x7fbedc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:15.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeecff9700 1 -- 172.21.15.154:0/3290535826 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc011420 con 0x7fbef0150180 2023-10-10T21:02:15.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeecff9700 1 -- 172.21.15.154:0/3290535826 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc011580 con 0x7fbef0150180 2023-10-10T21:02:15.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.784+0000 7fbeecff9700 1 -- 172.21.15.154:0/3290535826 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc011920 con 0x7fbef0150180 2023-10-10T21:02:15.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.785+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef00c51c0 con 0x7fbef0150180 2023-10-10T21:02:15.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.785+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef00c5780 con 0x7fbef0150180 2023-10-10T21:02:15.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.786+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef00c5f40 con 0x7fbef0150180 2023-10-10T21:02:15.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.787+0000 7fbeecff9700 1 -- 172.21.15.154:0/3290535826 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbedc011c90 con 0x7fbef0150180 2023-10-10T21:02:15.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.787+0000 7fbeecff9700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbed4066f30 0x7fbed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:15.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.787+0000 7fbeecff9700 1 -- 172.21.15.154:0/3290535826 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbedc085d90 con 0x7fbef0150180 2023-10-10T21:02:15.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.788+0000 7fbef499b700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbed4066f30 0x7fbed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:15.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.788+0000 7fbef499b700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbed4066f30 0x7fbed40693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbee4007fd0 tx=0x7fbee4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:15.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.792+0000 7fbeecff9700 1 -- 172.21.15.154:0/3290535826 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbedc0532b0 con 0x7fbef0150180 2023-10-10T21:02:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.982+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbef004c3c0 con 0x7fbef0150180 2023-10-10T21:02:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.983+0000 7fbeecff9700 1 -- 172.21.15.154:0/3290535826 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7fbedc0568d0 con 0x7fbef0150180 2023-10-10T21:02:15.984 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:15.984 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":18,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:10.551551+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbed4066f30 msgr2=0x7fbed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbed4066f30 0x7fbed40693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbee4007fd0 tx=0x7fbee4009040 comp rx=0 tx=0).stop 2023-10-10T21:02:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150180 msgr2=0x7fbef00c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150180 0x7fbef00c49b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbef006b470 tx=0x7fbedc017000 comp rx=0 tx=0).stop 2023-10-10T21:02:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 shutdown_connections 2023-10-10T21:02:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbed4066f30 0x7fbed40693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef0150550 0x7fbef0149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef00c7410 0x7fbef00c2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 --2- 172.21.15.154:0/3290535826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbef0150180 0x7fbef00c49b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 >> 172.21.15.154:0/3290535826 conn(0x7fbef00cc1f0 msgr2=0x7fbef01588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 shutdown_connections 2023-10-10T21:02:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:15.985+0000 7fbef599d700 1 -- 172.21.15.154:0/3290535826 wait complete. 2023-10-10T21:02:16.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T21:02:16.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:02:16.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.188+0000 7f01fa3ff700 1 Processor -- start 2023-10-10T21:02:16.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.188+0000 7f01fa3ff700 1 -- start start 2023-10-10T21:02:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.189+0000 7f01fa3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f01f40c83f0 0x7f01f40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.189+0000 7f01fa3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f41568e0 0x7f01f40ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.189+0000 7f01fa3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f415b0d0 con 0x7f01f40ccee0 2023-10-10T21:02:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.189+0000 7f01fa3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40c7a60 con 0x7f01f40c83f0 2023-10-10T21:02:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.189+0000 7f01fa3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f415a4c0 con 0x7f01f41568e0 2023-10-10T21:02:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f37fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f01f40ccee0 0x7f01f41561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39410/0 (socket says 172.21.15.154:39410) 2023-10-10T21:02:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f37fe700 1 -- 172.21.15.154:0/1911521831 learned_addr learned my addr 172.21.15.154:0/1911521831 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f3fff700 1 --2- 172.21.15.154:0/1911521831 >> v2:172.21.15.154:3300/0 conn(0x7f01f40c83f0 0x7f01f40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f899c700 1 --2- 172.21.15.154:0/1911521831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f41568e0 0x7f01f40ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f2ffd700 1 -- 172.21.15.154:0/1911521831 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461901518 0 0) 0x7f01f415b0d0 con 0x7f01f40ccee0 2023-10-10T21:02:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f2ffd700 1 -- 172.21.15.154:0/1911521831 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01dc003570 con 0x7f01f40ccee0 2023-10-10T21:02:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f3fff700 1 -- 172.21.15.154:0/1911521831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f41568e0 msgr2=0x7f01f40ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:16.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f3fff700 1 --2- 172.21.15.154:0/1911521831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f41568e0 0x7f01f40ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f3fff700 1 -- 172.21.15.154:0/1911521831 >> v1:172.21.15.154:6789/0 conn(0x7f01f40ccee0 legacy=0x7f01f41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f3fff700 1 -- 172.21.15.154:0/1911521831 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f415a7a0 con 0x7f01f40c83f0 2023-10-10T21:02:16.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.190+0000 7f01f3fff700 1 --2- 172.21.15.154:0/1911521831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f40c83f0 0x7f01f40c7520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f01e40098e0 tx=0x7f01e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d251fe80c10a943 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01f2ffd700 1 -- 172.21.15.154:0/1911521831 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4011630 con 0x7f01f40c83f0 2023-10-10T21:02:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01f2ffd700 1 -- 172.21.15.154:0/1911521831 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4011790 con 0x7f01f40c83f0 2023-10-10T21:02:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01f2ffd700 1 -- 172.21.15.154:0/1911521831 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4011b30 con 0x7f01f40c83f0 2023-10-10T21:02:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01fa3ff700 1 -- 172.21.15.154:0/1911521831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f40c83f0 msgr2=0x7f01f40c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01fa3ff700 1 --2- 172.21.15.154:0/1911521831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f40c83f0 0x7f01f40c7520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f01e40098e0 tx=0x7f01e40091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01fa3ff700 1 -- 172.21.15.154:0/1911521831 shutdown_connections 2023-10-10T21:02:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01fa3ff700 1 --2- 172.21.15.154:0/1911521831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f41568e0 0x7f01f40ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01fa3ff700 1 --2- 172.21.15.154:0/1911521831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f40c83f0 0x7f01f40c7520 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01fa3ff700 1 -- 172.21.15.154:0/1911521831 >> 172.21.15.154:0/1911521831 conn(0x7f01f4068e10 msgr2=0x7f01f40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:16.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01fa3ff700 1 -- 172.21.15.154:0/1911521831 shutdown_connections 2023-10-10T21:02:16.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.191+0000 7f01fa3ff700 1 -- 172.21.15.154:0/1911521831 wait complete. 2023-10-10T21:02:16.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.193+0000 7f01fa3ff700 1 Processor -- start 2023-10-10T21:02:16.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.193+0000 7f01fa3ff700 1 -- start start 2023-10-10T21:02:16.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01fa3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40c83f0 0x7f01f4148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01fa3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f40ccee0 0x7f01f40b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01fa3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f41568e0 0x7f01f4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01fa3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f4148bb0 con 0x7f01f41568e0 2023-10-10T21:02:16.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01fa3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f415f7c0 con 0x7f01f40ccee0 2023-10-10T21:02:16.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01fa3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f4160620 con 0x7f01f40c83f0 2023-10-10T21:02:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f41568e0 0x7f01f4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f41568e0 0x7f01f4148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59928/0 (socket says 172.21.15.154:59928) 2023-10-10T21:02:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f899c700 1 -- 172.21.15.154:0/2779878508 learned_addr learned my addr 172.21.15.154:0/2779878508 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f3fff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40c83f0 0x7f01f4148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f37fe700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f40ccee0 0x7f01f40b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f899c700 1 -- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40c83f0 msgr2=0x7f01f4148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f899c700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40c83f0 0x7f01f4148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f899c700 1 -- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f40ccee0 msgr2=0x7f01f40b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f899c700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f40ccee0 0x7f01f40b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f899c700 1 -- 172.21.15.154:0/2779878508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009420 con 0x7f01f41568e0 2023-10-10T21:02:16.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f3fff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40c83f0 0x7f01f4148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:16.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.194+0000 7f01f37fe700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f40ccee0 0x7f01f40b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:16.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.195+0000 7f01f899c700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f41568e0 0x7f01f4148d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009e20 tx=0x7f01ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:16.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.195+0000 7f01dbfff700 1 -- 172.21.15.154:0/2779878508 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec00cc20 con 0x7f01f41568e0 2023-10-10T21:02:16.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.195+0000 7f01dbfff700 1 -- 172.21.15.154:0/2779878508 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec00f040 con 0x7f01f41568e0 2023-10-10T21:02:16.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.195+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f414cf80 con 0x7f01f41568e0 2023-10-10T21:02:16.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.195+0000 7f01dbfff700 1 -- 172.21.15.154:0/2779878508 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec014480 con 0x7f01f41568e0 2023-10-10T21:02:16.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.195+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f415fcf0 con 0x7f01f41568e0 2023-10-10T21:02:16.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.196+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f404c3c0 con 0x7f01f41568e0 2023-10-10T21:02:16.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.197+0000 7f01dbfff700 1 -- 172.21.15.154:0/2779878508 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01ec0147f0 con 0x7f01f41568e0 2023-10-10T21:02:16.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.198+0000 7f01dbfff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f01e0066f30 0x7f01e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.198+0000 7f01dbfff700 1 -- 172.21.15.154:0/2779878508 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f01ec084e70 con 0x7f01f41568e0 2023-10-10T21:02:16.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.198+0000 7f01f3fff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f01e0066f30 0x7f01e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.198+0000 7f01f3fff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f01e0066f30 0x7f01e00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f01e4003080 tx=0x7f01e4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:16.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.202+0000 7f01dbfff700 1 -- 172.21.15.154:0/2779878508 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01ec052430 con 0x7f01f41568e0 2023-10-10T21:02:16.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.408+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01f415aa80 con 0x7f01f41568e0 2023-10-10T21:02:16.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.409+0000 7f01dbfff700 1 -- 172.21.15.154:0/2779878508 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01ec018020 con 0x7f01f41568e0 2023-10-10T21:02:16.411 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:02:16.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f01e0066f30 msgr2=0x7f01e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f01e0066f30 0x7f01e00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f01e4003080 tx=0x7f01e4017000 comp rx=0 tx=0).stop 2023-10-10T21:02:16.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f41568e0 msgr2=0x7f01f4148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f41568e0 0x7f01f4148d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009e20 tx=0x7f01ec00b040 comp rx=0 tx=0).stop 2023-10-10T21:02:16.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 shutdown_connections 2023-10-10T21:02:16.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f41568e0 0x7f01f4148d60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f01e0066f30 0x7f01e00693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40c83f0 0x7f01f4148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 --2- 172.21.15.154:0/2779878508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f40ccee0 0x7f01f40b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 >> 172.21.15.154:0/2779878508 conn(0x7f01f4068e10 msgr2=0x7f01f40c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:16.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.411+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 shutdown_connections 2023-10-10T21:02:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.412+0000 7f01fa3ff700 1 -- 172.21.15.154:0/2779878508 wait complete. 2023-10-10T21:02:16.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T21:02:16.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.611+0000 7f70785ff700 1 Processor -- start 2023-10-10T21:02:16.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.611+0000 7f70785ff700 1 -- start start 2023-10-10T21:02:16.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.612+0000 7f70785ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7070159890 0x7f707015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.612+0000 7f70785ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7070159c60 0x7f707015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.612+0000 7f70785ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707015a160 con 0x7f707015db10 2023-10-10T21:02:16.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.612+0000 7f70785ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707015df50 con 0x7f7070159890 2023-10-10T21:02:16.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.612+0000 7f70785ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70700d13a0 con 0x7f7070159c60 2023-10-10T21:02:16.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f7076b9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f707015db10 0x7f7070069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39414/0 (socket says 172.21.15.154:39414) 2023-10-10T21:02:16.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f7076b9c700 1 -- 172.21.15.154:0/2478360405 learned_addr learned my addr 172.21.15.154:0/2478360405 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:16.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f707639b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7070159890 0x7f707015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f7075b9a700 1 --2- 172.21.15.154:0/2478360405 >> v2:172.21.15.179:3300/0 conn(0x7f7070159c60 0x7f707015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f7075399700 1 -- 172.21.15.154:0/2478360405 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240453171 0 0) 0x7f707015a160 con 0x7f707015db10 2023-10-10T21:02:16.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f7075399700 1 -- 172.21.15.154:0/2478360405 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f705c003570 con 0x7f707015db10 2023-10-10T21:02:16.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f707639b700 1 -- 172.21.15.154:0/2478360405 >> v2:172.21.15.179:3300/0 conn(0x7f7070159c60 msgr2=0x7f707015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:16.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f707639b700 1 --2- 172.21.15.154:0/2478360405 >> v2:172.21.15.179:3300/0 conn(0x7f7070159c60 0x7f707015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f707639b700 1 -- 172.21.15.154:0/2478360405 >> v1:172.21.15.154:6789/0 conn(0x7f707015db10 legacy=0x7f7070069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f707639b700 1 -- 172.21.15.154:0/2478360405 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707015e140 con 0x7f7070159890 2023-10-10T21:02:16.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f7075b9a700 1 --2- 172.21.15.154:0/2478360405 >> v2:172.21.15.179:3300/0 conn(0x7f7070159c60 0x7f707015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:16.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.613+0000 7f707639b700 1 --2- 172.21.15.154:0/2478360405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 0x7f707015abd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f70700b67f0 tx=0x7f706c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192e0cc1d7da23c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:16.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f7075399700 1 -- 172.21.15.154:0/2478360405 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c011630 con 0x7f7070159890 2023-10-10T21:02:16.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f7075399700 1 -- 172.21.15.154:0/2478360405 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c011790 con 0x7f7070159890 2023-10-10T21:02:16.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f7075399700 1 -- 172.21.15.154:0/2478360405 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c011b30 con 0x7f7070159890 2023-10-10T21:02:16.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f70785ff700 1 -- 172.21.15.154:0/2478360405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 msgr2=0x7f707015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f70785ff700 1 --2- 172.21.15.154:0/2478360405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 0x7f707015abd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f70700b67f0 tx=0x7f706c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f70785ff700 1 -- 172.21.15.154:0/2478360405 shutdown_connections 2023-10-10T21:02:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f70785ff700 1 --2- 172.21.15.154:0/2478360405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 0x7f707015abd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f70785ff700 1 --2- 172.21.15.154:0/2478360405 >> v2:172.21.15.179:3300/0 conn(0x7f7070159c60 0x7f707015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f70785ff700 1 -- 172.21.15.154:0/2478360405 >> 172.21.15.154:0/2478360405 conn(0x7f7070068e20 msgr2=0x7f70700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f70785ff700 1 -- 172.21.15.154:0/2478360405 shutdown_connections 2023-10-10T21:02:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.614+0000 7f70785ff700 1 -- 172.21.15.154:0/2478360405 wait complete. 2023-10-10T21:02:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.616+0000 7f70785ff700 1 Processor -- start 2023-10-10T21:02:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.616+0000 7f70785ff700 1 -- start start 2023-10-10T21:02:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f70785ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 0x7f70700cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f70785ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7070159c60 0x7f7070155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f70785ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f707015db10 0x7f707016a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f70785ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707016acc0 con 0x7f7070159890 2023-10-10T21:02:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f70785ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70700cdae0 con 0x7f7070159c60 2023-10-10T21:02:16.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f70785ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70700cddc0 con 0x7f707015db10 2023-10-10T21:02:16.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f707639b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 0x7f70700cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f707639b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 0x7f70700cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59954/0 (socket says 172.21.15.154:59954) 2023-10-10T21:02:16.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f707639b700 1 -- 172.21.15.154:0/1770014860 learned_addr learned my addr 172.21.15.154:0/1770014860 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f7075b9a700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7070159c60 0x7f7070155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f7076b9c700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f707015db10 0x7f707016a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f707639b700 1 -- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f707015db10 msgr2=0x7f707016a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f707639b700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f707015db10 0x7f707016a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f707639b700 1 -- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7070159c60 msgr2=0x7f7070155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f707639b700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7070159c60 0x7f7070155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f707639b700 1 -- 172.21.15.154:0/1770014860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c009420 con 0x7f7070159890 2023-10-10T21:02:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f7075b9a700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7070159c60 0x7f7070155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.617+0000 7f7076b9c700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f707015db10 0x7f707016a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:16.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.618+0000 7f707639b700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 0x7f70700cd500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7070070e20 tx=0x7f706c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:16.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.618+0000 7f70667fc700 1 -- 172.21.15.154:0/1770014860 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c011b10 con 0x7f7070159890 2023-10-10T21:02:16.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.618+0000 7f70667fc700 1 -- 172.21.15.154:0/1770014860 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c0233f0 con 0x7f7070159890 2023-10-10T21:02:16.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.618+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70700ce0a0 con 0x7f7070159890 2023-10-10T21:02:16.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.618+0000 7f70667fc700 1 -- 172.21.15.154:0/1770014860 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c023790 con 0x7f7070159890 2023-10-10T21:02:16.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.618+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7070156910 con 0x7f7070159890 2023-10-10T21:02:16.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.619+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707004c3c0 con 0x7f7070159890 2023-10-10T21:02:16.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.620+0000 7f70667fc700 1 -- 172.21.15.154:0/1770014860 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f706c0193b0 con 0x7f7070159890 2023-10-10T21:02:16.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.620+0000 7f70667fc700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7054066f30 0x7f70540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:16.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.621+0000 7f70667fc700 1 -- 172.21.15.154:0/1770014860 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f706c0857c0 con 0x7f7070159890 2023-10-10T21:02:16.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.621+0000 7f7075b9a700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7054066f30 0x7f70540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:16.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.621+0000 7f7075b9a700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7054066f30 0x7f70540693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7060006f00 tx=0x7f7060008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:16.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.625+0000 7f70667fc700 1 -- 172.21.15.154:0/1770014860 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f706c052ce0 con 0x7f7070159890 2023-10-10T21:02:16.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.821+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f70700b2f70 con 0x7f7070159890 2023-10-10T21:02:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.821+0000 7f70667fc700 1 -- 172.21.15.154:0/1770014860 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f706c056300 con 0x7f7070159890 2023-10-10T21:02:16.823 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:16.823 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:02:16.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:02:16.824 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T21:02:16.824 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T21:02:16.824 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:02:16.824 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:02:16.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7054066f30 msgr2=0x7f70540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7054066f30 0x7f70540693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7060006f00 tx=0x7f7060008040 comp rx=0 tx=0).stop 2023-10-10T21:02:16.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 msgr2=0x7f70700cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:16.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 0x7f70700cd500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7070070e20 tx=0x7f706c017000 comp rx=0 tx=0).stop 2023-10-10T21:02:16.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 shutdown_connections 2023-10-10T21:02:16.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7054066f30 0x7f70540693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f707015db10 0x7f707016a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7070159890 0x7f70700cd500 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 --2- 172.21.15.154:0/1770014860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7070159c60 0x7f7070155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:16.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 >> 172.21.15.154:0/1770014860 conn(0x7f7070068e20 msgr2=0x7f7070154860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:16.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 shutdown_connections 2023-10-10T21:02:16.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:16.824+0000 7f70785ff700 1 -- 172.21.15.154:0/1770014860 wait complete. 2023-10-10T21:02:16.842 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T21:02:16.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T21:02:17.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.027+0000 7f56e0d9d700 1 Processor -- start 2023-10-10T21:02:17.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.028+0000 7f56e0d9d700 1 -- start start 2023-10-10T21:02:17.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.029+0000 7f56e0d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56dc156350 0x7f56dc157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.029+0000 7f56e0d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc0b0c00 0x7f56dc15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.029+0000 7f56e0d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc0b0570 con 0x7f56dc0b0760 2023-10-10T21:02:17.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.029+0000 7f56e0d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc1578b0 con 0x7f56dc156350 2023-10-10T21:02:17.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.029+0000 7f56e0d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0af4d0 con 0x7f56dc0b0c00 2023-10-10T21:02:17.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.029+0000 7f56db7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56dc156350 0x7f56dc157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.029+0000 7f56daffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f56dc0b0760 0x7f56dc159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39430/0 (socket says 172.21.15.154:39430) 2023-10-10T21:02:17.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.029+0000 7f56daffd700 1 -- 172.21.15.154:0/4121726293 learned_addr learned my addr 172.21.15.154:0/4121726293 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:17.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56dbfff700 1 --2- 172.21.15.154:0/4121726293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc0b0c00 0x7f56dc15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56da7fc700 1 -- 172.21.15.154:0/4121726293 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074635239 0 0) 0x7f56dc0b0570 con 0x7f56dc0b0760 2023-10-10T21:02:17.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56da7fc700 1 -- 172.21.15.154:0/4121726293 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c4003570 con 0x7f56dc0b0760 2023-10-10T21:02:17.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56db7fe700 1 -- 172.21.15.154:0/4121726293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc0b0c00 msgr2=0x7f56dc15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:17.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56db7fe700 1 --2- 172.21.15.154:0/4121726293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc0b0c00 0x7f56dc15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56db7fe700 1 -- 172.21.15.154:0/4121726293 >> v1:172.21.15.154:6789/0 conn(0x7f56dc0b0760 legacy=0x7f56dc159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56db7fe700 1 -- 172.21.15.154:0/4121726293 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0af7b0 con 0x7f56dc156350 2023-10-10T21:02:17.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56db7fe700 1 --2- 172.21.15.154:0/4121726293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc156350 0x7f56dc157370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0098e0 tx=0x7f56cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2e96a292901360 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:17.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56da7fc700 1 -- 172.21.15.154:0/4121726293 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc011630 con 0x7f56dc156350 2023-10-10T21:02:17.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56da7fc700 1 -- 172.21.15.154:0/4121726293 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc011790 con 0x7f56dc156350 2023-10-10T21:02:17.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.030+0000 7f56da7fc700 1 -- 172.21.15.154:0/4121726293 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc011b30 con 0x7f56dc156350 2023-10-10T21:02:17.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.031+0000 7f56e0d9d700 1 -- 172.21.15.154:0/4121726293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc156350 msgr2=0x7f56dc157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.031+0000 7f56e0d9d700 1 --2- 172.21.15.154:0/4121726293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc156350 0x7f56dc157370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0098e0 tx=0x7f56cc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.031+0000 7f56e0d9d700 1 -- 172.21.15.154:0/4121726293 shutdown_connections 2023-10-10T21:02:17.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.031+0000 7f56e0d9d700 1 --2- 172.21.15.154:0/4121726293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc0b0c00 0x7f56dc15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.031+0000 7f56e0d9d700 1 --2- 172.21.15.154:0/4121726293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc156350 0x7f56dc157370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.031+0000 7f56e0d9d700 1 -- 172.21.15.154:0/4121726293 >> 172.21.15.154:0/4121726293 conn(0x7f56dc068e20 msgr2=0x7f56dc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:17.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.031+0000 7f56e0d9d700 1 -- 172.21.15.154:0/4121726293 shutdown_connections 2023-10-10T21:02:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.031+0000 7f56e0d9d700 1 -- 172.21.15.154:0/4121726293 wait complete. 2023-10-10T21:02:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.032+0000 7f56e0d9d700 1 Processor -- start 2023-10-10T21:02:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.033+0000 7f56e0d9d700 1 -- start start 2023-10-10T21:02:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.033+0000 7f56e0d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b0760 0x7f56dc0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56e0d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56dc0b0c00 0x7f56dc141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56e0d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc156350 0x7f56dc152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56e0d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0acc40 con 0x7f56dc0b0760 2023-10-10T21:02:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56e0d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0c9390 con 0x7f56dc0b0c00 2023-10-10T21:02:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56e0d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0abd50 con 0x7f56dc156350 2023-10-10T21:02:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56db7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b0760 0x7f56dc0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56db7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b0760 0x7f56dc0cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59980/0 (socket says 172.21.15.154:59980) 2023-10-10T21:02:17.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56db7fe700 1 -- 172.21.15.154:0/3338781008 learned_addr learned my addr 172.21.15.154:0/3338781008 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:17.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56dbfff700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc156350 0x7f56dc152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56daffd700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56dc0b0c00 0x7f56dc141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56db7fe700 1 -- 172.21.15.154:0/3338781008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc156350 msgr2=0x7f56dc152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56db7fe700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc156350 0x7f56dc152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56db7fe700 1 -- 172.21.15.154:0/3338781008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56dc0b0c00 msgr2=0x7f56dc141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56db7fe700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56dc0b0c00 0x7f56dc141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56db7fe700 1 -- 172.21.15.154:0/3338781008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc009420 con 0x7f56dc0b0760 2023-10-10T21:02:17.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.034+0000 7f56db7fe700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b0760 0x7f56dc0cb8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0714a0 tx=0x7f56cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.035+0000 7f56c37fe700 1 -- 172.21.15.154:0/3338781008 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc011b10 con 0x7f56dc0b0760 2023-10-10T21:02:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.035+0000 7f56c37fe700 1 -- 172.21.15.154:0/3338781008 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc0233f0 con 0x7f56dc0b0760 2023-10-10T21:02:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.035+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc0ac030 con 0x7f56dc0b0760 2023-10-10T21:02:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.035+0000 7f56c37fe700 1 -- 172.21.15.154:0/3338781008 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc023770 con 0x7f56dc0b0760 2023-10-10T21:02:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.035+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc0ac5f0 con 0x7f56dc0b0760 2023-10-10T21:02:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.036+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc04c3c0 con 0x7f56dc0b0760 2023-10-10T21:02:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.037+0000 7f56c37fe700 1 -- 172.21.15.154:0/3338781008 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56cc02c3b0 con 0x7f56dc0b0760 2023-10-10T21:02:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.037+0000 7f56c37fe700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f56c8066f30 0x7f56c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.038+0000 7f56c37fe700 1 -- 172.21.15.154:0/3338781008 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f56cc085730 con 0x7f56dc0b0760 2023-10-10T21:02:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.038+0000 7f56daffd700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f56c8066f30 0x7f56c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.038+0000 7f56daffd700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f56c8066f30 0x7f56c80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0aab20 tx=0x7f56d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.042+0000 7f56c37fe700 1 -- 172.21.15.154:0/3338781008 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56cc052cd0 con 0x7f56dc0b0760 2023-10-10T21:02:17.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.233+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f56dc0afa90 con 0x7f56dc0b0760 2023-10-10T21:02:17.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.679+0000 7f56c37fe700 1 -- 172.21.15.154:0/3338781008 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f56cc0562f0 con 0x7f56dc0b0760 2023-10-10T21:02:17.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f56c8066f30 msgr2=0x7f56c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f56c8066f30 0x7f56c80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0aab20 tx=0x7f56d0009040 comp rx=0 tx=0).stop 2023-10-10T21:02:17.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b0760 msgr2=0x7f56dc0cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b0760 0x7f56dc0cb8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0714a0 tx=0x7f56cc017000 comp rx=0 tx=0).stop 2023-10-10T21:02:17.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 shutdown_connections 2023-10-10T21:02:17.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f56c8066f30 0x7f56c80693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56dc156350 0x7f56dc152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b0760 0x7f56dc0cb8d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 --2- 172.21.15.154:0/3338781008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56dc0b0c00 0x7f56dc141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.683+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 >> 172.21.15.154:0/3338781008 conn(0x7f56dc068e20 msgr2=0x7f56dc0695f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:17.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.684+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 shutdown_connections 2023-10-10T21:02:17.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.687+0000 7f56e0d9d700 1 -- 172.21.15.154:0/3338781008 wait complete. 2023-10-10T21:02:17.691 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T21:02:17.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T21:02:17.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.896+0000 7f74c1d9d700 1 Processor -- start 2023-10-10T21:02:17.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.897+0000 7f74c1d9d700 1 -- start start 2023-10-10T21:02:17.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.898+0000 7f74c1d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 0x7f74bc0c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.898+0000 7f74c1d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f74bc156870 0x7f74bc15a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.898+0000 7f74c1d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc06e510 con 0x7f74bc0ccd00 2023-10-10T21:02:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.898+0000 7f74c1d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc0c7220 con 0x7f74bc156870 2023-10-10T21:02:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.898+0000 7f74c1d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc06df20 con 0x7f74bc0cc930 2023-10-10T21:02:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.898+0000 7f74bbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f74bc0ccd00 0x7f74bc159920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39438/0 (socket says 172.21.15.154:39438) 2023-10-10T21:02:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.898+0000 7f74bbfff700 1 -- 172.21.15.154:0/674351949 learned_addr learned my addr 172.21.15.154:0/674351949 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:17.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74c0d9b700 1 --2- 172.21.15.154:0/674351949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 0x7f74bc0c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74c159c700 1 --2- 172.21.15.154:0/674351949 >> v2:172.21.15.179:3300/0 conn(0x7f74bc156870 0x7f74bc15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74bb7fe700 1 -- 172.21.15.154:0/674351949 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103345787 0 0) 0x7f74bc06e510 con 0x7f74bc0ccd00 2023-10-10T21:02:17.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74bb7fe700 1 -- 172.21.15.154:0/674351949 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74ac003570 con 0x7f74bc0ccd00 2023-10-10T21:02:17.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74bb7fe700 1 -- 172.21.15.154:0/674351949 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3238105260 0 0) 0x7f74ac003570 con 0x7f74bc0ccd00 2023-10-10T21:02:17.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74c0d9b700 1 -- 172.21.15.154:0/674351949 >> v2:172.21.15.179:3300/0 conn(0x7f74bc156870 msgr2=0x7f74bc15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:17.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74c0d9b700 1 --2- 172.21.15.154:0/674351949 >> v2:172.21.15.179:3300/0 conn(0x7f74bc156870 0x7f74bc15a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74c0d9b700 1 -- 172.21.15.154:0/674351949 >> v1:172.21.15.154:6789/0 conn(0x7f74bc0ccd00 legacy=0x7f74bc159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74c0d9b700 1 -- 172.21.15.154:0/674351949 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc157040 con 0x7f74bc0cc930 2023-10-10T21:02:17.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.899+0000 7f74c159c700 1 --2- 172.21.15.154:0/674351949 >> v2:172.21.15.179:3300/0 conn(0x7f74bc156870 0x7f74bc15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:17.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74c0d9b700 1 --2- 172.21.15.154:0/674351949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 0x7f74bc0c7840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f74b00098e0 tx=0x7f74b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc99a819a572b42a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:17.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74bb7fe700 1 -- 172.21.15.154:0/674351949 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8001470 con 0x7f74bc0cc930 2023-10-10T21:02:17.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74bb7fe700 1 -- 172.21.15.154:0/674351949 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b0011420 con 0x7f74bc0cc930 2023-10-10T21:02:17.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74bb7fe700 1 -- 172.21.15.154:0/674351949 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b00117c0 con 0x7f74bc0cc930 2023-10-10T21:02:17.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74c1d9d700 1 -- 172.21.15.154:0/674351949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 msgr2=0x7f74bc0c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74c1d9d700 1 --2- 172.21.15.154:0/674351949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 0x7f74bc0c7840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f74b00098e0 tx=0x7f74b00091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74c1d9d700 1 -- 172.21.15.154:0/674351949 shutdown_connections 2023-10-10T21:02:17.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74c1d9d700 1 --2- 172.21.15.154:0/674351949 >> v2:172.21.15.179:3300/0 conn(0x7f74bc156870 0x7f74bc15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74c1d9d700 1 --2- 172.21.15.154:0/674351949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 0x7f74bc0c7840 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74c1d9d700 1 -- 172.21.15.154:0/674351949 >> 172.21.15.154:0/674351949 conn(0x7f74bc068e20 msgr2=0x7f74bc0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:17.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.900+0000 7f74c1d9d700 1 -- 172.21.15.154:0/674351949 shutdown_connections 2023-10-10T21:02:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.901+0000 7f74c1d9d700 1 -- 172.21.15.154:0/674351949 wait complete. 2023-10-10T21:02:17.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.902+0000 7f74c1d9d700 1 Processor -- start 2023-10-10T21:02:17.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.902+0000 7f74c1d9d700 1 -- start start 2023-10-10T21:02:17.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74c1d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 0x7f74bc1682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74c1d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74bc0ccd00 0x7f74bc153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74c1d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74bc156870 0x7f74bc0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74c1d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc0ab1f0 con 0x7f74bc0ccd00 2023-10-10T21:02:17.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74c1d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc0b1de0 con 0x7f74bc156870 2023-10-10T21:02:17.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74c1d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc0b20c0 con 0x7f74bc0cc930 2023-10-10T21:02:17.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74bbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74bc0ccd00 0x7f74bc153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74bbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74bc0ccd00 0x7f74bc153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59984/0 (socket says 172.21.15.154:59984) 2023-10-10T21:02:17.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74bbfff700 1 -- 172.21.15.154:0/3023133768 learned_addr learned my addr 172.21.15.154:0/3023133768 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:17.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74c159c700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74bc156870 0x7f74bc0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.903+0000 7f74c0d9b700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 0x7f74bc1682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74bbfff700 1 -- 172.21.15.154:0/3023133768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 msgr2=0x7f74bc1682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74bbfff700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 0x7f74bc1682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74bbfff700 1 -- 172.21.15.154:0/3023133768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74bc156870 msgr2=0x7f74bc0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:17.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74bbfff700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74bc156870 0x7f74bc0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:17.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74bbfff700 1 -- 172.21.15.154:0/3023133768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b4009a20 con 0x7f74bc0ccd00 2023-10-10T21:02:17.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74bbfff700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74bc0ccd00 0x7f74bc153ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74a800cb90 tx=0x7f74a8001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:17.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74b8ff9700 1 -- 172.21.15.154:0/3023133768 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8001d60 con 0x7f74bc0ccd00 2023-10-10T21:02:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74b8ff9700 1 -- 172.21.15.154:0/3023133768 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8007360 con 0x7f74bc0ccd00 2023-10-10T21:02:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b0009420 con 0x7f74bc0ccd00 2023-10-10T21:02:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74b8ff9700 1 -- 172.21.15.154:0/3023133768 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8007700 con 0x7f74bc0ccd00 2023-10-10T21:02:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.904+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc167ae0 con 0x7f74bc0ccd00 2023-10-10T21:02:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.905+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc04c3c0 con 0x7f74bc0ccd00 2023-10-10T21:02:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.907+0000 7f74b8ff9700 1 -- 172.21.15.154:0/3023133768 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74a8004a40 con 0x7f74bc0ccd00 2023-10-10T21:02:17.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.907+0000 7f74b8ff9700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f74a0066f30 0x7f74a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:17.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.907+0000 7f74b8ff9700 1 -- 172.21.15.154:0/3023133768 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f74a8083b90 con 0x7f74bc0ccd00 2023-10-10T21:02:17.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.908+0000 7f74c0d9b700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f74a0066f30 0x7f74a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:17.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.908+0000 7f74c0d9b700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f74a0066f30 0x7f74a00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74b00091e0 tx=0x7f74b0016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:17.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:17.912+0000 7f74b8ff9700 1 -- 172.21.15.154:0/3023133768 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74a8051080 con 0x7f74bc0ccd00 2023-10-10T21:02:18.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.107+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f74bc06d560 con 0x7f74bc0ccd00 2023-10-10T21:02:18.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.687+0000 7f74b8ff9700 1 -- 172.21.15.154:0/3023133768 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f74a8018020 con 0x7f74bc0ccd00 2023-10-10T21:02:18.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.695+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f74a0066f30 msgr2=0x7f74a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:18.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.695+0000 7f74c1d9d700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f74a0066f30 0x7f74a00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74b00091e0 tx=0x7f74b0016000 comp rx=0 tx=0).stop 2023-10-10T21:02:18.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.695+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74bc0ccd00 msgr2=0x7f74bc153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:18.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.695+0000 7f74c1d9d700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74bc0ccd00 0x7f74bc153ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74a800cb90 tx=0x7f74a8001ad0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.698+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 shutdown_connections 2023-10-10T21:02:18.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.698+0000 7f74c1d9d700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74bc156870 0x7f74bc0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.698+0000 7f74c1d9d700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f74a0066f30 0x7f74a00693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.698+0000 7f74c1d9d700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc0cc930 0x7f74bc1682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.698+0000 7f74c1d9d700 1 --2- 172.21.15.154:0/3023133768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74bc0ccd00 0x7f74bc153ff0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.698+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 >> 172.21.15.154:0/3023133768 conn(0x7f74bc068e20 msgr2=0x7f74bc0c1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:18.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.700+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 shutdown_connections 2023-10-10T21:02:18.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.702+0000 7f74c1d9d700 1 -- 172.21.15.154:0/3023133768 wait complete. 2023-10-10T21:02:18.713 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T21:02:18.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T21:02:18.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.911+0000 7fd9d67ff700 1 Processor -- start 2023-10-10T21:02:18.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.911+0000 7fd9d67ff700 1 -- start start 2023-10-10T21:02:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.912+0000 7fd9d67ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9d006bcd0 0x7fd9d00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.912+0000 7fd9d67ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd9d006c0a0 0x7fd9d015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.912+0000 7fd9d67ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015df50 0x7fd9d015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:18.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.912+0000 7fd9d67ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d015d7e0 con 0x7fd9d006bcd0 2023-10-10T21:02:18.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.912+0000 7fd9d67ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d015dac0 con 0x7fd9d006c0a0 2023-10-10T21:02:18.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.912+0000 7fd9d67ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d015aa30 con 0x7fd9d015df50 2023-10-10T21:02:18.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9d006bcd0 0x7fd9d00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9d006bcd0 0x7fd9d00caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59990/0 (socket says 172.21.15.154:59990) 2023-10-10T21:02:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cffff700 1 -- 172.21.15.154:0/3454122413 learned_addr learned my addr 172.21.15.154:0/3454122413 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cffff700 1 -- 172.21.15.154:0/3454122413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015df50 msgr2=0x7fd9d015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9d4d9c700 1 --2- 172.21.15.154:0/3454122413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015df50 0x7fd9d015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cf7fe700 1 --2- 172.21.15.154:0/3454122413 >> v2:172.21.15.179:3300/0 conn(0x7fd9d006c0a0 0x7fd9d015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cffff700 1 --2- 172.21.15.154:0/3454122413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015df50 0x7fd9d015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cffff700 1 -- 172.21.15.154:0/3454122413 >> v2:172.21.15.179:3300/0 conn(0x7fd9d006c0a0 msgr2=0x7fd9d015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cffff700 1 --2- 172.21.15.154:0/3454122413 >> v2:172.21.15.179:3300/0 conn(0x7fd9d006c0a0 0x7fd9d015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cffff700 1 -- 172.21.15.154:0/3454122413 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d015ad10 con 0x7fd9d006bcd0 2023-10-10T21:02:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9d4d9c700 1 --2- 172.21.15.154:0/3454122413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015df50 0x7fd9d015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cf7fe700 1 --2- 172.21.15.154:0/3454122413 >> v2:172.21.15.179:3300/0 conn(0x7fd9d006c0a0 0x7fd9d015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9cffff700 1 --2- 172.21.15.154:0/3454122413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d006bcd0 0x7fd9d00caa90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd9d006b4e0 tx=0x7fd9c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12294c5ce203fe2a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.913+0000 7fd9ceffd700 1 -- 172.21.15.154:0/3454122413 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c000b860 con 0x7fd9d006bcd0 2023-10-10T21:02:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9ceffd700 1 -- 172.21.15.154:0/3454122413 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c000b9c0 con 0x7fd9d006bcd0 2023-10-10T21:02:18.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9ceffd700 1 -- 172.21.15.154:0/3454122413 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c000bd80 con 0x7fd9d006bcd0 2023-10-10T21:02:18.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3454122413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d006bcd0 msgr2=0x7fd9d00caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:18.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3454122413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d006bcd0 0x7fd9d00caa90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd9d006b4e0 tx=0x7fd9c0009250 comp rx=0 tx=0).stop 2023-10-10T21:02:18.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3454122413 shutdown_connections 2023-10-10T21:02:18.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3454122413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015df50 0x7fd9d015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3454122413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d006bcd0 0x7fd9d00caa90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3454122413 >> v2:172.21.15.179:3300/0 conn(0x7fd9d006c0a0 0x7fd9d015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3454122413 >> 172.21.15.154:0/3454122413 conn(0x7fd9d00ce600 msgr2=0x7fd9d00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:18.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3454122413 shutdown_connections 2023-10-10T21:02:18.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.914+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3454122413 wait complete. 2023-10-10T21:02:18.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.916+0000 7fd9d67ff700 1 Processor -- start 2023-10-10T21:02:18.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.916+0000 7fd9d67ff700 1 -- start start 2023-10-10T21:02:18.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d67ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d006bcd0 0x7fd9d0141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:18.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d67ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d006c0a0 0x7fd9d00b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:18.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d67ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015df50 0x7fd9d0156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:18.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d67ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b3680 con 0x7fd9d015df50 2023-10-10T21:02:18.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d67ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b2a70 con 0x7fd9d006c0a0 2023-10-10T21:02:18.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d67ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b2d50 con 0x7fd9d006bcd0 2023-10-10T21:02:18.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d4d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015df50 0x7fd9d0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:18.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d4d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015df50 0x7fd9d0156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60000/0 (socket says 172.21.15.154:60000) 2023-10-10T21:02:18.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d4d9c700 1 -- 172.21.15.154:0/3192692664 learned_addr learned my addr 172.21.15.154:0/3192692664 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:18.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9cf7fe700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d006c0a0 0x7fd9d00b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:18.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9cffff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d006bcd0 0x7fd9d0141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:18.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d4d9c700 1 -- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d006bcd0 msgr2=0x7fd9d0141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:18.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d4d9c700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d006bcd0 0x7fd9d0141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d4d9c700 1 -- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d006c0a0 msgr2=0x7fd9d00b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:18.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d4d9c700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d006c0a0 0x7fd9d00b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:18.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d4d9c700 1 -- 172.21.15.154:0/3192692664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c00094f0 con 0x7fd9d015df50 2023-10-10T21:02:18.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9cf7fe700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d006c0a0 0x7fd9d00b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:18.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9cffff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d006bcd0 0x7fd9d0141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:18.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.917+0000 7fd9d4d9c700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015df50 0x7fd9d0156030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800cef0 tx=0x7fd9c8007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:18.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.918+0000 7fd9b7fff700 1 -- 172.21.15.154:0/3192692664 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800ae00 con 0x7fd9d015df50 2023-10-10T21:02:18.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.918+0000 7fd9b7fff700 1 -- 172.21.15.154:0/3192692664 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8016420 con 0x7fd9d015df50 2023-10-10T21:02:18.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.918+0000 7fd9b7fff700 1 -- 172.21.15.154:0/3192692664 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80167e0 con 0x7fd9d015df50 2023-10-10T21:02:18.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.918+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d00b3030 con 0x7fd9d015df50 2023-10-10T21:02:18.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.918+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d0142100 con 0x7fd9d015df50 2023-10-10T21:02:18.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.919+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d004c3c0 con 0x7fd9d015df50 2023-10-10T21:02:18.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.920+0000 7fd9b7fff700 1 -- 172.21.15.154:0/3192692664 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9c8016bd0 con 0x7fd9d015df50 2023-10-10T21:02:18.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.921+0000 7fd9b7fff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd9bc066f30 0x7fd9bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:18.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.921+0000 7fd9b7fff700 1 -- 172.21.15.154:0/3192692664 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd9c8012070 con 0x7fd9d015df50 2023-10-10T21:02:18.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.921+0000 7fd9cffff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd9bc066f30 0x7fd9bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:18.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.922+0000 7fd9cffff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd9bc066f30 0x7fd9bc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9d006b4e0 tx=0x7fd9c0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:18.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:18.926+0000 7fd9b7fff700 1 -- 172.21.15.154:0/3192692664 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9c804e5a0 con 0x7fd9d015df50 2023-10-10T21:02:19.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.157+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd9d00b37c0 con 0x7fd9d015df50 2023-10-10T21:02:19.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.692+0000 7fd9b7fff700 1 -- 172.21.15.154:0/3192692664 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd9c8052140 con 0x7fd9d015df50 2023-10-10T21:02:19.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.702+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd9bc066f30 msgr2=0x7fd9bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:19.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.702+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd9bc066f30 0x7fd9bc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9d006b4e0 tx=0x7fd9c0017000 comp rx=0 tx=0).stop 2023-10-10T21:02:19.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.702+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015df50 msgr2=0x7fd9d0156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:19.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.702+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015df50 0x7fd9d0156030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800cef0 tx=0x7fd9c8007860 comp rx=0 tx=0).stop 2023-10-10T21:02:19.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.703+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 shutdown_connections 2023-10-10T21:02:19.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.703+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015df50 0x7fd9d0156030 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.703+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd9bc066f30 0x7fd9bc0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.703+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d006bcd0 0x7fd9d0141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.703+0000 7fd9d67ff700 1 --2- 172.21.15.154:0/3192692664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d006c0a0 0x7fd9d00b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.703+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 >> 172.21.15.154:0/3192692664 conn(0x7fd9d00ce600 msgr2=0x7fd9d015b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:19.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.704+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 shutdown_connections 2023-10-10T21:02:19.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.705+0000 7fd9d67ff700 1 -- 172.21.15.154:0/3192692664 wait complete. 2023-10-10T21:02:19.711 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 2 and data pool 3 2023-10-10T21:02:19.737 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.920+0000 7ff465fff700 1 Processor -- start 2023-10-10T21:02:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.920+0000 7ff465fff700 1 -- start start 2023-10-10T21:02:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.921+0000 7ff465fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff4600cbf30 0x7ff4600ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.921+0000 7ff465fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff4600b1420 0x7ff4600c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff465fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4600cc300 con 0x7ff4600ccf90 2023-10-10T21:02:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff465fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff460156bf0 con 0x7ff4600cbf30 2023-10-10T21:02:19.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff465fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4600ae950 con 0x7ff4600b1420 2023-10-10T21:02:19.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff4600cbf30 0x7ff4600ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:19.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45effd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff4600ccf90 0x7ff4600b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39452/0 (socket says 172.21.15.154:39452) 2023-10-10T21:02:19.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45effd700 1 -- 172.21.15.154:0/2825957849 learned_addr learned my addr 172.21.15.154:0/2825957849 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:19.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45ffff700 1 --2- 172.21.15.154:0/2825957849 >> v2:172.21.15.179:3300/0 conn(0x7ff4600b1420 0x7ff4600c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:19.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45e7fc700 1 -- 172.21.15.154:0/2825957849 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281684099 0 0) 0x7ff4600cc300 con 0x7ff4600ccf90 2023-10-10T21:02:19.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45e7fc700 1 -- 172.21.15.154:0/2825957849 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff448003570 con 0x7ff4600ccf90 2023-10-10T21:02:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45f7fe700 1 -- 172.21.15.154:0/2825957849 >> v2:172.21.15.179:3300/0 conn(0x7ff4600b1420 msgr2=0x7ff4600c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45f7fe700 1 --2- 172.21.15.154:0/2825957849 >> v2:172.21.15.179:3300/0 conn(0x7ff4600b1420 0x7ff4600c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45f7fe700 1 -- 172.21.15.154:0/2825957849 >> v1:172.21.15.154:6789/0 conn(0x7ff4600ccf90 legacy=0x7ff4600b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.922+0000 7ff45f7fe700 1 -- 172.21.15.154:0/2825957849 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4600ad370 con 0x7ff4600cbf30 2023-10-10T21:02:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff45f7fe700 1 --2- 172.21.15.154:0/2825957849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600cbf30 0x7ff4600ae410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4600b19e0 tx=0x7ff4500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b9872ac3ce86ea server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff45e7fc700 1 -- 172.21.15.154:0/2825957849 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450011630 con 0x7ff4600cbf30 2023-10-10T21:02:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff45e7fc700 1 -- 172.21.15.154:0/2825957849 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450011790 con 0x7ff4600cbf30 2023-10-10T21:02:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff45e7fc700 1 -- 172.21.15.154:0/2825957849 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450011b30 con 0x7ff4600cbf30 2023-10-10T21:02:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff465fff700 1 -- 172.21.15.154:0/2825957849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600cbf30 msgr2=0x7ff4600ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff465fff700 1 --2- 172.21.15.154:0/2825957849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600cbf30 0x7ff4600ae410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4600b19e0 tx=0x7ff4500091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff465fff700 1 -- 172.21.15.154:0/2825957849 shutdown_connections 2023-10-10T21:02:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff465fff700 1 --2- 172.21.15.154:0/2825957849 >> v2:172.21.15.179:3300/0 conn(0x7ff4600b1420 0x7ff4600c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff465fff700 1 --2- 172.21.15.154:0/2825957849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600cbf30 0x7ff4600ae410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff465fff700 1 -- 172.21.15.154:0/2825957849 >> 172.21.15.154:0/2825957849 conn(0x7ff46006a320 msgr2=0x7ff4600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff465fff700 1 -- 172.21.15.154:0/2825957849 shutdown_connections 2023-10-10T21:02:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.923+0000 7ff465fff700 1 -- 172.21.15.154:0/2825957849 wait complete. 2023-10-10T21:02:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.925+0000 7ff465fff700 1 Processor -- start 2023-10-10T21:02:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.925+0000 7ff465fff700 1 -- start start 2023-10-10T21:02:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff465fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600b1420 0x7ff460150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff465fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4600cbf30 0x7ff4600c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff465fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4600ccf90 0x7ff4600ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff465fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600c12d0 con 0x7ff4600b1420 2023-10-10T21:02:19.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff465fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600c1520 con 0x7ff4600ccf90 2023-10-10T21:02:19.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff465fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600c1800 con 0x7ff4600cbf30 2023-10-10T21:02:19.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600b1420 0x7ff460150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:19.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600b1420 0x7ff460150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60020/0 (socket says 172.21.15.154:60020) 2023-10-10T21:02:19.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45f7fe700 1 -- 172.21.15.154:0/1581432937 learned_addr learned my addr 172.21.15.154:0/1581432937 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:19.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45ffff700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4600ccf90 0x7ff4600ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:19.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45effd700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4600cbf30 0x7ff4600c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:19.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45f7fe700 1 -- 172.21.15.154:0/1581432937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4600cbf30 msgr2=0x7ff4600c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:19.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45f7fe700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4600cbf30 0x7ff4600c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45f7fe700 1 -- 172.21.15.154:0/1581432937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4600ccf90 msgr2=0x7ff4600ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:19.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45f7fe700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4600ccf90 0x7ff4600ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:19.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45f7fe700 1 -- 172.21.15.154:0/1581432937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450009420 con 0x7ff4600b1420 2023-10-10T21:02:19.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.926+0000 7ff45ffff700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4600ccf90 0x7ff4600ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:19.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.927+0000 7ff45f7fe700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600b1420 0x7ff460150580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff450009ed0 tx=0x7ff450017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:19.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.927+0000 7ff4477fe700 1 -- 172.21.15.154:0/1581432937 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450011900 con 0x7ff4600b1420 2023-10-10T21:02:19.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.927+0000 7ff4477fe700 1 -- 172.21.15.154:0/1581432937 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450011a60 con 0x7ff4600b1420 2023-10-10T21:02:19.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.927+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4600c1ae0 con 0x7ff4600b1420 2023-10-10T21:02:19.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.927+0000 7ff4477fe700 1 -- 172.21.15.154:0/1581432937 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450026660 con 0x7ff4600b1420 2023-10-10T21:02:19.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.927+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4600c20a0 con 0x7ff4600b1420 2023-10-10T21:02:19.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.928+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46004c3c0 con 0x7ff4600b1420 2023-10-10T21:02:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.929+0000 7ff4477fe700 1 -- 172.21.15.154:0/1581432937 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff450023030 con 0x7ff4600b1420 2023-10-10T21:02:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.930+0000 7ff4477fe700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff44c066f30 0x7ff44c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.930+0000 7ff4477fe700 1 -- 172.21.15.154:0/1581432937 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff450085e60 con 0x7ff4600b1420 2023-10-10T21:02:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.930+0000 7ff45effd700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff44c066f30 0x7ff44c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:19.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.931+0000 7ff45effd700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff44c066f30 0x7ff44c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff460156520 tx=0x7ff454009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:19.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:19.935+0000 7ff4477fe700 1 -- 172.21.15.154:0/1581432937 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4500530b0 con 0x7ff4600b1420 2023-10-10T21:02:20.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.127+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4600ad650 con 0x7ff4600b1420 2023-10-10T21:02:20.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.128+0000 7ff4477fe700 1 -- 172.21.15.154:0/1581432937 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7ff4500566d0 con 0x7ff4600b1420 2023-10-10T21:02:20.130 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:20.131 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:19.159398+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:20.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff44c066f30 msgr2=0x7ff44c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff44c066f30 0x7ff44c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff460156520 tx=0x7ff454009040 comp rx=0 tx=0).stop 2023-10-10T21:02:20.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600b1420 msgr2=0x7ff460150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600b1420 0x7ff460150580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff450009ed0 tx=0x7ff450017000 comp rx=0 tx=0).stop 2023-10-10T21:02:20.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 shutdown_connections 2023-10-10T21:02:20.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4600ccf90 0x7ff4600ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4600b1420 0x7ff460150580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff44c066f30 0x7ff44c0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 --2- 172.21.15.154:0/1581432937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4600cbf30 0x7ff4600c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 >> 172.21.15.154:0/1581432937 conn(0x7ff46006a320 msgr2=0x7ff460150e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:20.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 shutdown_connections 2023-10-10T21:02:20.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.130+0000 7ff465fff700 1 -- 172.21.15.154:0/1581432937 wait complete. 2023-10-10T21:02:20.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:20.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.332+0000 7f64ef59e700 1 Processor -- start 2023-10-10T21:02:20.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.332+0000 7f64ef59e700 1 -- start start 2023-10-10T21:02:20.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.333+0000 7f64ef59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64f0159420 0x7f64f00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.333+0000 7f64ef59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64f01597f0 0x7f64f00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.333+0000 7f64ef59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f00b11d0 con 0x7f64f015d230 2023-10-10T21:02:20.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.333+0000 7f64ef59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f00b14b0 con 0x7f64f0159420 2023-10-10T21:02:20.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.333+0000 7f64ef59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f00b1790 con 0x7f64f01597f0 2023-10-10T21:02:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64ee59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64f0159420 0x7f64f00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64eed9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f64f015d230 0x7f64f015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39456/0 (socket says 172.21.15.154:39456) 2023-10-10T21:02:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64eed9d700 1 -- 172.21.15.154:0/2212479665 learned_addr learned my addr 172.21.15.154:0/2212479665 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64edd9b700 1 --2- 172.21.15.154:0/2212479665 >> v2:172.21.15.179:3300/0 conn(0x7f64f01597f0 0x7f64f00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64ee59c700 1 -- 172.21.15.154:0/2212479665 >> v2:172.21.15.179:3300/0 conn(0x7f64f01597f0 msgr2=0x7f64f00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:20.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64ee59c700 1 --2- 172.21.15.154:0/2212479665 >> v2:172.21.15.179:3300/0 conn(0x7f64f01597f0 0x7f64f00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64ee59c700 1 -- 172.21.15.154:0/2212479665 >> v1:172.21.15.154:6789/0 conn(0x7f64f015d230 legacy=0x7f64f015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64ed59a700 1 -- 172.21.15.154:0/2212479665 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466551631 0 0) 0x7f64f00b11d0 con 0x7f64f015d230 2023-10-10T21:02:20.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64ee59c700 1 -- 172.21.15.154:0/2212479665 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f00b1a70 con 0x7f64f0159420 2023-10-10T21:02:20.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64ee59c700 1 --2- 172.21.15.154:0/2212479665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 0x7f64f00b5f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f64f0089750 tx=0x7f64e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a18789b50ccf9f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:20.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.334+0000 7f64ed59a700 1 -- 172.21.15.154:0/2212479665 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000b6b0 con 0x7f64f0159420 2023-10-10T21:02:20.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ed59a700 1 -- 172.21.15.154:0/2212479665 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e000b810 con 0x7f64f0159420 2023-10-10T21:02:20.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ed59a700 1 -- 172.21.15.154:0/2212479665 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000bbb0 con 0x7f64f0159420 2023-10-10T21:02:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ef59e700 1 -- 172.21.15.154:0/2212479665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 msgr2=0x7f64f00b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ef59e700 1 --2- 172.21.15.154:0/2212479665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 0x7f64f00b5f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f64f0089750 tx=0x7f64e00091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ef59e700 1 -- 172.21.15.154:0/2212479665 shutdown_connections 2023-10-10T21:02:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ef59e700 1 --2- 172.21.15.154:0/2212479665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 0x7f64f00b5f40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ef59e700 1 --2- 172.21.15.154:0/2212479665 >> v2:172.21.15.179:3300/0 conn(0x7f64f01597f0 0x7f64f00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ef59e700 1 -- 172.21.15.154:0/2212479665 >> 172.21.15.154:0/2212479665 conn(0x7f64f00d0660 msgr2=0x7f64f00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ef59e700 1 -- 172.21.15.154:0/2212479665 shutdown_connections 2023-10-10T21:02:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.335+0000 7f64ef59e700 1 -- 172.21.15.154:0/2212479665 wait complete. 2023-10-10T21:02:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.337+0000 7f64ef59e700 1 Processor -- start 2023-10-10T21:02:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.337+0000 7f64ef59e700 1 -- start start 2023-10-10T21:02:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ef59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 0x7f64f013f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ef59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f01597f0 0x7f64f0158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ef59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f015d230 0x7f64f015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ef59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f015adb0 con 0x7f64f0159420 2023-10-10T21:02:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ef59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f013f5b0 con 0x7f64f015d230 2023-10-10T21:02:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ef59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f015a1a0 con 0x7f64f01597f0 2023-10-10T21:02:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ee59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 0x7f64f013f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ee59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 0x7f64f013f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60042/0 (socket says 172.21.15.154:60042) 2023-10-10T21:02:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ee59c700 1 -- 172.21.15.154:0/1060664306 learned_addr learned my addr 172.21.15.154:0/1060664306 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ee59c700 1 -- 172.21.15.154:0/1060664306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f01597f0 msgr2=0x7f64f0158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64edd9b700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f01597f0 0x7f64f0158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ee59c700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f01597f0 0x7f64f0158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ee59c700 1 -- 172.21.15.154:0/1060664306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f015d230 msgr2=0x7f64f015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ee59c700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f015d230 0x7f64f015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ee59c700 1 -- 172.21.15.154:0/1060664306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0009420 con 0x7f64f0159420 2023-10-10T21:02:20.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.338+0000 7f64ee59c700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 0x7f64f013f070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f64e00091e0 tx=0x7f64e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:20.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.339+0000 7f64de7fc700 1 -- 172.21.15.154:0/1060664306 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000bb90 con 0x7f64f0159420 2023-10-10T21:02:20.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.339+0000 7f64de7fc700 1 -- 172.21.15.154:0/1060664306 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e0011420 con 0x7f64f0159420 2023-10-10T21:02:20.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.339+0000 7f64de7fc700 1 -- 172.21.15.154:0/1060664306 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e00117c0 con 0x7f64f0159420 2023-10-10T21:02:20.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.339+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f015a480 con 0x7f64f0159420 2023-10-10T21:02:20.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.339+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f015aa40 con 0x7f64f0159420 2023-10-10T21:02:20.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.340+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f015b090 con 0x7f64f0159420 2023-10-10T21:02:20.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.341+0000 7f64de7fc700 1 -- 172.21.15.154:0/1060664306 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64e0011bf0 con 0x7f64f0159420 2023-10-10T21:02:20.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.342+0000 7f64de7fc700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f64d0066f30 0x7f64d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.342+0000 7f64de7fc700 1 -- 172.21.15.154:0/1060664306 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64e0085f80 con 0x7f64f0159420 2023-10-10T21:02:20.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.342+0000 7f64edd9b700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f64d0066f30 0x7f64d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.342+0000 7f64edd9b700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f64d0066f30 0x7f64d00693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f64f014eb30 tx=0x7f64e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:20.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.346+0000 7f64de7fc700 1 -- 172.21.15.154:0/1060664306 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64e00b75a0 con 0x7f64f0159420 2023-10-10T21:02:20.435 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-10-10T21:02:20.434+0000 7f1d663f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:02:20.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.537+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64f004c3c0 con 0x7f64f0159420 2023-10-10T21:02:20.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.538+0000 7f64de7fc700 1 -- 172.21.15.154:0/1060664306 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f64e00531f0 con 0x7f64f0159420 2023-10-10T21:02:20.540 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:20.540 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:19.159398+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:20.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f64d0066f30 msgr2=0x7f64d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f64d0066f30 0x7f64d00693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f64f014eb30 tx=0x7f64e4008040 comp rx=0 tx=0).stop 2023-10-10T21:02:20.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 msgr2=0x7f64f013f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 0x7f64f013f070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f64e00091e0 tx=0x7f64e0017000 comp rx=0 tx=0).stop 2023-10-10T21:02:20.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 shutdown_connections 2023-10-10T21:02:20.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f015d230 0x7f64f015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f0159420 0x7f64f013f070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f64d0066f30 0x7f64d00693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 --2- 172.21.15.154:0/1060664306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f01597f0 0x7f64f0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 >> 172.21.15.154:0/1060664306 conn(0x7f64f00d0660 msgr2=0x7f64f00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 shutdown_connections 2023-10-10T21:02:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.541+0000 7f64ef59e700 1 -- 172.21.15.154:0/1060664306 wait complete. 2023-10-10T21:02:20.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T21:02:20.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.744+0000 7f79d49fe700 1 Processor -- start 2023-10-10T21:02:20.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.745+0000 7f79d49fe700 1 -- start start 2023-10-10T21:02:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.746+0000 7f79d49fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f79d0159a60 0x7f79d00c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.746+0000 7f79d49fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d00ccc00 0x7f79d0069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.746+0000 7f79d49fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79d006a020 0x7f79d00cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.746+0000 7f79d49fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d006dfc0 con 0x7f79d006a020 2023-10-10T21:02:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.746+0000 7f79d49fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d00c9cb0 con 0x7f79d0159a60 2023-10-10T21:02:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.746+0000 7f79d49fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c9f30 con 0x7f79d00ccc00 2023-10-10T21:02:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.746+0000 7f79cf59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79d006a020 0x7f79d00cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.746+0000 7f79cf59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79d006a020 0x7f79d00cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60052/0 (socket says 172.21.15.154:60052) 2023-10-10T21:02:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.746+0000 7f79cf59e700 1 -- 172.21.15.154:0/1094274944 learned_addr learned my addr 172.21.15.154:0/1094274944 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79cf59e700 1 -- 172.21.15.154:0/1094274944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d00ccc00 msgr2=0x7f79d0069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79c7fff700 1 --2- 172.21.15.154:0/1094274944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d00ccc00 0x7f79d0069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79ced9d700 1 --2- 172.21.15.154:0/1094274944 >> v2:172.21.15.179:3300/0 conn(0x7f79d0159a60 0x7f79d00c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79cf59e700 1 --2- 172.21.15.154:0/1094274944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d00ccc00 0x7f79d0069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79cf59e700 1 -- 172.21.15.154:0/1094274944 >> v2:172.21.15.179:3300/0 conn(0x7f79d0159a60 msgr2=0x7f79d00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79cf59e700 1 --2- 172.21.15.154:0/1094274944 >> v2:172.21.15.179:3300/0 conn(0x7f79d0159a60 0x7f79d00c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79cf59e700 1 -- 172.21.15.154:0/1094274944 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00ca470 con 0x7f79d006a020 2023-10-10T21:02:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79c7fff700 1 --2- 172.21.15.154:0/1094274944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d00ccc00 0x7f79d0069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79ced9d700 1 --2- 172.21.15.154:0/1094274944 >> v2:172.21.15.179:3300/0 conn(0x7f79d0159a60 0x7f79d00c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79cf59e700 1 --2- 172.21.15.154:0/1094274944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d006a020 0x7f79d00cb230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79d006e510 tx=0x7f79c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e5c7e513b84d1c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79ce59c700 1 -- 172.21.15.154:0/1094274944 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c800e070 con 0x7f79d006a020 2023-10-10T21:02:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79ce59c700 1 -- 172.21.15.154:0/1094274944 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c800bae0 con 0x7f79d006a020 2023-10-10T21:02:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.747+0000 7f79ce59c700 1 -- 172.21.15.154:0/1094274944 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80092e0 con 0x7f79d006a020 2023-10-10T21:02:20.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.748+0000 7f79d49fe700 1 -- 172.21.15.154:0/1094274944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d006a020 msgr2=0x7f79d00cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.748+0000 7f79d49fe700 1 --2- 172.21.15.154:0/1094274944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d006a020 0x7f79d00cb230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79d006e510 tx=0x7f79c8009840 comp rx=0 tx=0).stop 2023-10-10T21:02:20.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.748+0000 7f79d49fe700 1 -- 172.21.15.154:0/1094274944 shutdown_connections 2023-10-10T21:02:20.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.748+0000 7f79d49fe700 1 --2- 172.21.15.154:0/1094274944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d006a020 0x7f79d00cb230 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.748+0000 7f79d49fe700 1 --2- 172.21.15.154:0/1094274944 >> v2:172.21.15.179:3300/0 conn(0x7f79d0159a60 0x7f79d00c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.748+0000 7f79d49fe700 1 --2- 172.21.15.154:0/1094274944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d00ccc00 0x7f79d0069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.748+0000 7f79d49fe700 1 -- 172.21.15.154:0/1094274944 >> 172.21.15.154:0/1094274944 conn(0x7f79d006baa0 msgr2=0x7f79d006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:20.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.748+0000 7f79d49fe700 1 -- 172.21.15.154:0/1094274944 shutdown_connections 2023-10-10T21:02:20.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.748+0000 7f79d49fe700 1 -- 172.21.15.154:0/1094274944 wait complete. 2023-10-10T21:02:20.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.749+0000 7f79d49fe700 1 Processor -- start 2023-10-10T21:02:20.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.749+0000 7f79d49fe700 1 -- start start 2023-10-10T21:02:20.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.750+0000 7f79d49fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d006a020 0x7f79d00c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.750+0000 7f79d49fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d00ccc00 0x7f79d014c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.750+0000 7f79d49fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d0159a60 0x7f79d00c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.750+0000 7f79d49fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00b1a50 con 0x7f79d0159a60 2023-10-10T21:02:20.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.750+0000 7f79d49fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c6040 con 0x7f79d00ccc00 2023-10-10T21:02:20.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.750+0000 7f79d49fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c6320 con 0x7f79d006a020 2023-10-10T21:02:20.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79cf59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d0159a60 0x7f79d00c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79cf59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d0159a60 0x7f79d00c5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60064/0 (socket says 172.21.15.154:60064) 2023-10-10T21:02:20.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79cf59e700 1 -- 172.21.15.154:0/2785269348 learned_addr learned my addr 172.21.15.154:0/2785269348 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:20.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79c7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d00ccc00 0x7f79d014c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79ced9d700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d006a020 0x7f79d00c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79cf59e700 1 -- 172.21.15.154:0/2785269348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d006a020 msgr2=0x7f79d00c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79cf59e700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d006a020 0x7f79d00c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79cf59e700 1 -- 172.21.15.154:0/2785269348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d00ccc00 msgr2=0x7f79d014c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:20.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79cf59e700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d00ccc00 0x7f79d014c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:20.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79cf59e700 1 -- 172.21.15.154:0/2785269348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8009ae0 con 0x7f79d0159a60 2023-10-10T21:02:20.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79cf59e700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d0159a60 0x7f79d00c5740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f79d006cdc0 tx=0x7f79c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:20.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.751+0000 7f79c6ffd700 1 -- 172.21.15.154:0/2785269348 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8008d20 con 0x7f79d0159a60 2023-10-10T21:02:20.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.752+0000 7f79c6ffd700 1 -- 172.21.15.154:0/2785269348 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c8008e80 con 0x7f79d0159a60 2023-10-10T21:02:20.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.752+0000 7f79c6ffd700 1 -- 172.21.15.154:0/2785269348 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80266b0 con 0x7f79d0159a60 2023-10-10T21:02:20.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.752+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d00b16e0 con 0x7f79d0159a60 2023-10-10T21:02:20.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.752+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d00c6600 con 0x7f79d0159a60 2023-10-10T21:02:20.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.753+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d00b1c00 con 0x7f79d0159a60 2023-10-10T21:02:20.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.753+0000 7f79c6ffd700 1 -- 172.21.15.154:0/2785269348 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79c8003040 con 0x7f79d0159a60 2023-10-10T21:02:20.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.754+0000 7f79c6ffd700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f79b0066f30 0x7f79b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:20.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.754+0000 7f79c6ffd700 1 -- 172.21.15.154:0/2785269348 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79c80864c0 con 0x7f79d0159a60 2023-10-10T21:02:20.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.754+0000 7f79ced9d700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f79b0066f30 0x7f79b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:20.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.755+0000 7f79ced9d700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f79b0066f30 0x7f79b00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79c0006fd0 tx=0x7f79c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:20.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.758+0000 7f79c6ffd700 1 -- 172.21.15.154:0/2785269348 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79d00b1c00 con 0x7f79d0159a60 2023-10-10T21:02:20.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:20.996+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f79d0157b50 con 0x7f79d0159a60 2023-10-10T21:02:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.851+0000 7f79c6ffd700 1 -- 172.21.15.154:0/2785269348 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f79c8053740 con 0x7f79d0159a60 2023-10-10T21:02:21.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f79b0066f30 msgr2=0x7f79b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:21.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f79b0066f30 0x7f79b00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79c0006fd0 tx=0x7f79c0008040 comp rx=0 tx=0).stop 2023-10-10T21:02:21.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d0159a60 msgr2=0x7f79d00c5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:21.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d0159a60 0x7f79d00c5740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f79d006cdc0 tx=0x7f79c8018000 comp rx=0 tx=0).stop 2023-10-10T21:02:21.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 shutdown_connections 2023-10-10T21:02:21.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d0159a60 0x7f79d00c5740 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:21.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f79b0066f30 0x7f79b00693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:21.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d006a020 0x7f79d00c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:21.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 --2- 172.21.15.154:0/2785269348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d00ccc00 0x7f79d014c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:21.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.854+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 >> 172.21.15.154:0/2785269348 conn(0x7f79d006baa0 msgr2=0x7f79d0158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:21.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.855+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 shutdown_connections 2023-10-10T21:02:21.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:21.855+0000 7f79d49fe700 1 -- 172.21.15.154:0/2785269348 wait complete. 2023-10-10T21:02:21.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T21:02:22.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.062+0000 7f13cadff700 1 Processor -- start 2023-10-10T21:02:22.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.062+0000 7f13cadff700 1 -- start start 2023-10-10T21:02:22.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.063+0000 7f13cadff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4159890 0x7f13c415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:22.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.063+0000 7f13cadff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f13c4069560 0x7f13c40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:22.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.063+0000 7f13cadff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c415a160 con 0x7f13c4159c60 2023-10-10T21:02:22.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13cadff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c4069f20 con 0x7f13c4069560 2023-10-10T21:02:22.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13cadff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40d13a0 con 0x7f13c4159890 2023-10-10T21:02:22.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c8b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4159890 0x7f13c415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:22.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c939c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f13c4069560 0x7f13c40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:22.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c8b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4159890 0x7f13c415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58968/0 (socket says 172.21.15.154:58968) 2023-10-10T21:02:22.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c8b9b700 1 -- 172.21.15.154:0/1204384134 learned_addr learned my addr 172.21.15.154:0/1204384134 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:22.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c37fe700 1 -- 172.21.15.154:0/1204384134 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903484242 0 0) 0x7f13c415a160 con 0x7f13c4159c60 2023-10-10T21:02:22.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c37fe700 1 -- 172.21.15.154:0/1204384134 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b4003570 con 0x7f13c4159c60 2023-10-10T21:02:22.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c939c700 1 -- 172.21.15.154:0/1204384134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4159890 msgr2=0x7f13c415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:22.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c939c700 1 --2- 172.21.15.154:0/1204384134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4159890 0x7f13c415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:22.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c939c700 1 -- 172.21.15.154:0/1204384134 >> v1:172.21.15.179:6789/0 conn(0x7f13c4159c60 legacy=0x7f13c415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:22.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c939c700 1 -- 172.21.15.154:0/1204384134 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c415e140 con 0x7f13c4069560 2023-10-10T21:02:22.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.064+0000 7f13c8b9b700 1 --2- 172.21.15.154:0/1204384134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4159890 0x7f13c415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:22.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.065+0000 7f13c939c700 1 --2- 172.21.15.154:0/1204384134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c4069560 0x7f13c40699e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009e60 tx=0x7f13bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de7a453be0c92c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:22.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.065+0000 7f13c37fe700 1 -- 172.21.15.154:0/1204384134 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00e070 con 0x7f13c4069560 2023-10-10T21:02:22.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.065+0000 7f13c37fe700 1 -- 172.21.15.154:0/1204384134 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00bab0 con 0x7f13c4069560 2023-10-10T21:02:22.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.065+0000 7f13c37fe700 1 -- 172.21.15.154:0/1204384134 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00be70 con 0x7f13c4069560 2023-10-10T21:02:22.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.065+0000 7f13cadff700 1 -- 172.21.15.154:0/1204384134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c4069560 msgr2=0x7f13c40699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:22.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.065+0000 7f13cadff700 1 --2- 172.21.15.154:0/1204384134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c4069560 0x7f13c40699e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009e60 tx=0x7f13bc009780 comp rx=0 tx=0).stop 2023-10-10T21:02:22.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.066+0000 7f13cadff700 1 -- 172.21.15.154:0/1204384134 shutdown_connections 2023-10-10T21:02:22.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.066+0000 7f13cadff700 1 --2- 172.21.15.154:0/1204384134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c4069560 0x7f13c40699e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:22.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.066+0000 7f13cadff700 1 --2- 172.21.15.154:0/1204384134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4159890 0x7f13c415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:22.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.066+0000 7f13cadff700 1 -- 172.21.15.154:0/1204384134 >> 172.21.15.154:0/1204384134 conn(0x7f13c4068e20 msgr2=0x7f13c40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:22.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.066+0000 7f13cadff700 1 -- 172.21.15.154:0/1204384134 shutdown_connections 2023-10-10T21:02:22.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.066+0000 7f13cadff700 1 -- 172.21.15.154:0/1204384134 wait complete. 2023-10-10T21:02:22.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.067+0000 7f13cadff700 1 Processor -- start 2023-10-10T21:02:22.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.067+0000 7f13cadff700 1 -- start start 2023-10-10T21:02:22.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.068+0000 7f13cadff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4069560 0x7f13c40c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:22.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.068+0000 7f13cadff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c4159890 0x7f13c4154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:22.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.068+0000 7f13cadff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13c4159c60 0x7f13c41553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:22.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.068+0000 7f13cadff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c415cf30 con 0x7f13c4159c60 2023-10-10T21:02:22.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.068+0000 7f13cadff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c41558e0 con 0x7f13c4159890 2023-10-10T21:02:22.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.068+0000 7f13cadff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c415cc50 con 0x7f13c4069560 2023-10-10T21:02:22.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.068+0000 7f13c939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13c4159c60 0x7f13c41553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:22.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.068+0000 7f13c939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13c4159c60 0x7f13c41553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60078/0 (socket says 172.21.15.154:60078) 2023-10-10T21:02:22.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.068+0000 7f13c939c700 1 -- 172.21.15.154:0/705274040 learned_addr learned my addr 172.21.15.154:0/705274040 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:22.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c8b9b700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4069560 0x7f13c40c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:22.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c3fff700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c4159890 0x7f13c4154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:22.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c939c700 1 -- 172.21.15.154:0/705274040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4069560 msgr2=0x7f13c40c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:22.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c939c700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4069560 0x7f13c40c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:22.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c939c700 1 -- 172.21.15.154:0/705274040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c4159890 msgr2=0x7f13c4154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:22.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c939c700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c4159890 0x7f13c4154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:22.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c939c700 1 -- 172.21.15.154:0/705274040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b80094f0 con 0x7f13c4159c60 2023-10-10T21:02:22.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c939c700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13c4159c60 0x7f13c41553a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00b610 tx=0x7f13bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:22.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c0ff9700 1 -- 172.21.15.154:0/705274040 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc012dd0 con 0x7f13c4159c60 2023-10-10T21:02:22.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c0ff9700 1 -- 172.21.15.154:0/705274040 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc027470 con 0x7f13c4159c60 2023-10-10T21:02:22.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc009a20 con 0x7f13c4159c60 2023-10-10T21:02:22.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13c0ff9700 1 -- 172.21.15.154:0/705274040 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc027830 con 0x7f13c4159c60 2023-10-10T21:02:22.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.069+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c40cdb50 con 0x7f13c4159c60 2023-10-10T21:02:22.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.070+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c40cd650 con 0x7f13c4159c60 2023-10-10T21:02:22.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.071+0000 7f13c0ff9700 1 -- 172.21.15.154:0/705274040 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13bc024070 con 0x7f13c4159c60 2023-10-10T21:02:22.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.072+0000 7f13c0ff9700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f13a8066f30 0x7f13a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:22.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.072+0000 7f13c0ff9700 1 -- 172.21.15.154:0/705274040 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13bc086f10 con 0x7f13c4159c60 2023-10-10T21:02:22.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.072+0000 7f13c8b9b700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f13a8066f30 0x7f13a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:22.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.073+0000 7f13c8b9b700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f13a8066f30 0x7f13a80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13b8006d20 tx=0x7f13b8009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:22.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.077+0000 7f13c0ff9700 1 -- 172.21.15.154:0/705274040 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13c40cd650 con 0x7f13c4159c60 2023-10-10T21:02:22.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.309+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f13c404c430 con 0x7f13c4159c60 2023-10-10T21:02:22.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.858+0000 7f13c0ff9700 1 -- 172.21.15.154:0/705274040 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f13c404c430 con 0x7f13c4159c60 2023-10-10T21:02:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f13a8066f30 msgr2=0x7f13a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f13a8066f30 0x7f13a80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13b8006d20 tx=0x7f13b8009250 comp rx=0 tx=0).stop 2023-10-10T21:02:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13c4159c60 msgr2=0x7f13c41553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13c4159c60 0x7f13c41553a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00b610 tx=0x7f13bc019000 comp rx=0 tx=0).stop 2023-10-10T21:02:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 shutdown_connections 2023-10-10T21:02:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13c4159c60 0x7f13c41553a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f13a8066f30 0x7f13a80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c4069560 0x7f13c40c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 --2- 172.21.15.154:0/705274040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c4159890 0x7f13c4154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 >> 172.21.15.154:0/705274040 conn(0x7f13c4068e20 msgr2=0x7f13c40b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 shutdown_connections 2023-10-10T21:02:22.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:22.861+0000 7f13cadff700 1 -- 172.21.15.154:0/705274040 wait complete. 2023-10-10T21:02:22.883 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:02:23.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.071+0000 7f80c759e700 1 Processor -- start 2023-10-10T21:02:23.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.071+0000 7f80c759e700 1 -- start start 2023-10-10T21:02:23.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.072+0000 7f80c759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c806d950 0x7f80c80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.072+0000 7f80c759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80c806a0a0 0x7f80c80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.072+0000 7f80c759e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c806ae70 con 0x7f80c806dd20 2023-10-10T21:02:23.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.072+0000 7f80c759e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c806a540 con 0x7f80c806a0a0 2023-10-10T21:02:23.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.072+0000 7f80c759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c806a820 con 0x7f80c806d950 2023-10-10T21:02:23.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.072+0000 7f80c6d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f80c806dd20 0x7f80c80c7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39464/0 (socket says 172.21.15.154:39464) 2023-10-10T21:02:23.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.072+0000 7f80c6d9d700 1 -- 172.21.15.154:0/2095360241 learned_addr learned my addr 172.21.15.154:0/2095360241 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:23.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.072+0000 7f80bffff700 1 --2- 172.21.15.154:0/2095360241 >> v2:172.21.15.154:3300/0 conn(0x7f80c806a0a0 0x7f80c80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80c659c700 1 --2- 172.21.15.154:0/2095360241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c806d950 0x7f80c80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80c5d9b700 1 -- 172.21.15.154:0/2095360241 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497743125 0 0) 0x7f80c806ae70 con 0x7f80c806dd20 2023-10-10T21:02:23.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80c5d9b700 1 -- 172.21.15.154:0/2095360241 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80b4003570 con 0x7f80c806dd20 2023-10-10T21:02:23.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80bffff700 1 -- 172.21.15.154:0/2095360241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c806d950 msgr2=0x7f80c80c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:23.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80bffff700 1 --2- 172.21.15.154:0/2095360241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c806d950 0x7f80c80c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80bffff700 1 -- 172.21.15.154:0/2095360241 >> v1:172.21.15.154:6789/0 conn(0x7f80c806dd20 legacy=0x7f80c80c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80bffff700 1 -- 172.21.15.154:0/2095360241 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c806ab00 con 0x7f80c806a0a0 2023-10-10T21:02:23.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80bffff700 1 --2- 172.21.15.154:0/2095360241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 0x7f80c80c6c10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80b00098e0 tx=0x7f80b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec2295f7f4d9e5f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:23.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80c5d9b700 1 -- 172.21.15.154:0/2095360241 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0011630 con 0x7f80c806a0a0 2023-10-10T21:02:23.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80c5d9b700 1 -- 172.21.15.154:0/2095360241 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b0011790 con 0x7f80c806a0a0 2023-10-10T21:02:23.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.073+0000 7f80c5d9b700 1 -- 172.21.15.154:0/2095360241 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0011b30 con 0x7f80c806a0a0 2023-10-10T21:02:23.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.074+0000 7f80c759e700 1 -- 172.21.15.154:0/2095360241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 msgr2=0x7f80c80c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.074+0000 7f80c759e700 1 --2- 172.21.15.154:0/2095360241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 0x7f80c80c6c10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80b00098e0 tx=0x7f80b00091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.074+0000 7f80c759e700 1 -- 172.21.15.154:0/2095360241 shutdown_connections 2023-10-10T21:02:23.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.074+0000 7f80c759e700 1 --2- 172.21.15.154:0/2095360241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c806d950 0x7f80c80c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.074+0000 7f80c759e700 1 --2- 172.21.15.154:0/2095360241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 0x7f80c80c6c10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.074+0000 7f80c759e700 1 -- 172.21.15.154:0/2095360241 >> 172.21.15.154:0/2095360241 conn(0x7f80c80cc1f0 msgr2=0x7f80c80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:23.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.074+0000 7f80c759e700 1 -- 172.21.15.154:0/2095360241 shutdown_connections 2023-10-10T21:02:23.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.074+0000 7f80c759e700 1 -- 172.21.15.154:0/2095360241 wait complete. 2023-10-10T21:02:23.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.075+0000 7f80c759e700 1 Processor -- start 2023-10-10T21:02:23.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.076+0000 7f80c759e700 1 -- start start 2023-10-10T21:02:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.076+0000 7f80c759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 0x7f80c8168890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.076+0000 7f80c759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c806d950 0x7f80c8146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c806dd20 0x7f80c81597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c815ce50 con 0x7f80c806a0a0 2023-10-10T21:02:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c8168dd0 con 0x7f80c806d950 2023-10-10T21:02:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c8147200 con 0x7f80c806dd20 2023-10-10T21:02:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 0x7f80c8168890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 0x7f80c8168890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60102/0 (socket says 172.21.15.154:60102) 2023-10-10T21:02:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c659c700 1 -- 172.21.15.154:0/1559567519 learned_addr learned my addr 172.21.15.154:0/1559567519 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:23.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c659c700 1 -- 172.21.15.154:0/1559567519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c806dd20 msgr2=0x7f80c81597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c659c700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c806dd20 0x7f80c81597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c659c700 1 -- 172.21.15.154:0/1559567519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c806d950 msgr2=0x7f80c8146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c659c700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c806d950 0x7f80c8146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c659c700 1 -- 172.21.15.154:0/1559567519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0009420 con 0x7f80c806a0a0 2023-10-10T21:02:23.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.077+0000 7f80c659c700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 0x7f80c8168890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80b800ec80 tx=0x7f80b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:23.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.078+0000 7f80be7fc700 1 -- 172.21.15.154:0/1559567519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800c970 con 0x7f80c806a0a0 2023-10-10T21:02:23.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.078+0000 7f80be7fc700 1 -- 172.21.15.154:0/1559567519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b800cad0 con 0x7f80c806a0a0 2023-10-10T21:02:23.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.078+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c81585f0 con 0x7f80c806a0a0 2023-10-10T21:02:23.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.078+0000 7f80be7fc700 1 -- 172.21.15.154:0/1559567519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800ce70 con 0x7f80c806a0a0 2023-10-10T21:02:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.078+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c8158d70 con 0x7f80c806a0a0 2023-10-10T21:02:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.079+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c804c3c0 con 0x7f80c806a0a0 2023-10-10T21:02:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.080+0000 7f80be7fc700 1 -- 172.21.15.154:0/1559567519 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80b8013680 con 0x7f80c806a0a0 2023-10-10T21:02:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.080+0000 7f80be7fc700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f80a8066f30 0x7f80a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.081+0000 7f80be7fc700 1 -- 172.21.15.154:0/1559567519 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80b8084960 con 0x7f80c806a0a0 2023-10-10T21:02:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.081+0000 7f80bffff700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f80a8066f30 0x7f80a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.081+0000 7f80bffff700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f80a8066f30 0x7f80a80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80c806a470 tx=0x7f80b0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.085+0000 7f80be7fc700 1 -- 172.21.15.154:0/1559567519 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80b8051b30 con 0x7f80c806a0a0 2023-10-10T21:02:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.318+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80c80c62d0 con 0x7f80c806a0a0 2023-10-10T21:02:23.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.319+0000 7f80be7fc700 1 -- 172.21.15.154:0/1559567519 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f80b8055150 con 0x7f80c806a0a0 2023-10-10T21:02:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:23.321 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439513038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439513038},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439513038}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1179223321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1179223321},{"type":"v1","addr":"172.21.15.154:6836","nonce":1179223321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4116873553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4116873553},{"type":"v1","addr":"172.21.15.179:6835","nonce":4116873553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:02:19.159716+0000","modified":"2023-10-10T21:02:22.851729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6833/2053231138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2053231138},{"type":"v1","addr":"172.21.15.179:6833","nonce":2053231138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-10T21:02:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f80a8066f30 msgr2=0x7f80a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f80a8066f30 0x7f80a80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80c806a470 tx=0x7f80b0017000 comp rx=0 tx=0).stop 2023-10-10T21:02:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 msgr2=0x7f80c8168890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 0x7f80c8168890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80b800ec80 tx=0x7f80b80091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 shutdown_connections 2023-10-10T21:02:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f80a8066f30 0x7f80a80693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c806dd20 0x7f80c81597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c806a0a0 0x7f80c8168890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 --2- 172.21.15.154:0/1559567519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c806d950 0x7f80c8146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 >> 172.21.15.154:0/1559567519 conn(0x7f80c80cc1f0 msgr2=0x7f80c80c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:23.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 shutdown_connections 2023-10-10T21:02:23.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.321+0000 7f80c759e700 1 -- 172.21.15.154:0/1559567519 wait complete. 2023-10-10T21:02:23.328 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-10-10T21:02:23.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:23.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.521+0000 7f2e3f59d700 1 Processor -- start 2023-10-10T21:02:23.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.521+0000 7f2e3f59d700 1 -- start start 2023-10-10T21:02:23.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.522+0000 7f2e3f59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e38159420 0x7f2e380b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.522+0000 7f2e3f59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e380b2980 con 0x7f2e381597f0 2023-10-10T21:02:23.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.522+0000 7f2e3f59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e380b11d0 con 0x7f2e3815d230 2023-10-10T21:02:23.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.522+0000 7f2e3f59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e380b14b0 con 0x7f2e38159420 2023-10-10T21:02:23.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.522+0000 7f2e3dd9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2e381597f0 0x7f2e380b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39474/0 (socket says 172.21.15.154:39474) 2023-10-10T21:02:23.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.522+0000 7f2e3e59b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e38159420 0x7f2e380b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.522+0000 7f2e3dd9a700 1 -- 172.21.15.154:0/888770489 learned_addr learned my addr 172.21.15.154:0/888770489 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:23.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.523+0000 7f2e3d599700 1 -- 172.21.15.154:0/888770489 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741510514 0 0) 0x7f2e380b2980 con 0x7f2e381597f0 2023-10-10T21:02:23.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.523+0000 7f2e3d599700 1 -- 172.21.15.154:0/888770489 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e24003570 con 0x7f2e381597f0 2023-10-10T21:02:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.523+0000 7f2e3e59b700 1 -- 172.21.15.154:0/888770489 >> v1:172.21.15.179:6789/0 conn(0x7f2e3815d230 legacy=0x7f2e3815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.523+0000 7f2e3e59b700 1 -- 172.21.15.154:0/888770489 >> v1:172.21.15.154:6789/0 conn(0x7f2e381597f0 legacy=0x7f2e380b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.523+0000 7f2e3e59b700 1 -- 172.21.15.154:0/888770489 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e380b1790 con 0x7f2e38159420 2023-10-10T21:02:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.523+0000 7f2e3e59b700 1 --2- 172.21.15.154:0/888770489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e38159420 0x7f2e380b5f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2e340098e0 tx=0x7f2e340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1153229a0cbd21f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.523+0000 7f2e3d599700 1 -- 172.21.15.154:0/888770489 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3400b640 con 0x7f2e38159420 2023-10-10T21:02:23.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.523+0000 7f2e3d599700 1 -- 172.21.15.154:0/888770489 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3400b7a0 con 0x7f2e38159420 2023-10-10T21:02:23.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.523+0000 7f2e3d599700 1 -- 172.21.15.154:0/888770489 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3400bb40 con 0x7f2e38159420 2023-10-10T21:02:23.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.524+0000 7f2e3f59d700 1 -- 172.21.15.154:0/888770489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e38159420 msgr2=0x7f2e380b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.524+0000 7f2e3f59d700 1 --2- 172.21.15.154:0/888770489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e38159420 0x7f2e380b5f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2e340098e0 tx=0x7f2e340091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.524+0000 7f2e3f59d700 1 -- 172.21.15.154:0/888770489 shutdown_connections 2023-10-10T21:02:23.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.524+0000 7f2e3f59d700 1 --2- 172.21.15.154:0/888770489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e38159420 0x7f2e380b5f40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.524+0000 7f2e3f59d700 1 -- 172.21.15.154:0/888770489 >> 172.21.15.154:0/888770489 conn(0x7f2e380d0660 msgr2=0x7f2e380d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:23.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.524+0000 7f2e3f59d700 1 -- 172.21.15.154:0/888770489 shutdown_connections 2023-10-10T21:02:23.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.524+0000 7f2e3f59d700 1 -- 172.21.15.154:0/888770489 wait complete. 2023-10-10T21:02:23.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.526+0000 7f2e3f59d700 1 Processor -- start 2023-10-10T21:02:23.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.526+0000 7f2e3f59d700 1 -- start start 2023-10-10T21:02:23.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3f59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e38159420 0x7f2e3815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3f59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e381597f0 0x7f2e380c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3f59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e3815d230 0x7f2e38155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3f59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e380c7940 con 0x7f2e381597f0 2023-10-10T21:02:23.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3f59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e380c6d30 con 0x7f2e38159420 2023-10-10T21:02:23.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3f59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e380c7010 con 0x7f2e3815d230 2023-10-10T21:02:23.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3dd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e381597f0 0x7f2e380c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3dd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e381597f0 0x7f2e380c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60124/0 (socket says 172.21.15.154:60124) 2023-10-10T21:02:23.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3dd9a700 1 -- 172.21.15.154:0/3074050404 learned_addr learned my addr 172.21.15.154:0/3074050404 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:23.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3e59b700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e38159420 0x7f2e3815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3ed9c700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e3815d230 0x7f2e38155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3dd9a700 1 -- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e3815d230 msgr2=0x7f2e38155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3dd9a700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e3815d230 0x7f2e38155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3dd9a700 1 -- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e38159420 msgr2=0x7f2e3815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3dd9a700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e38159420 0x7f2e3815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3dd9a700 1 -- 172.21.15.154:0/3074050404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34009420 con 0x7f2e381597f0 2023-10-10T21:02:23.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3e59b700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e38159420 0x7f2e3815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:23.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3ed9c700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e3815d230 0x7f2e38155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:23.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.527+0000 7f2e3dd9a700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e381597f0 0x7f2e380c6620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c7c0 tx=0x7f2e28007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:23.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.528+0000 7f2e2e7fc700 1 -- 172.21.15.154:0/3074050404 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28005c00 con 0x7f2e381597f0 2023-10-10T21:02:23.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.528+0000 7f2e2e7fc700 1 -- 172.21.15.154:0/3074050404 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e28005d60 con 0x7f2e381597f0 2023-10-10T21:02:23.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.528+0000 7f2e2e7fc700 1 -- 172.21.15.154:0/3074050404 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28007320 con 0x7f2e381597f0 2023-10-10T21:02:23.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.528+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e380c72f0 con 0x7f2e381597f0 2023-10-10T21:02:23.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.528+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e38155940 con 0x7f2e381597f0 2023-10-10T21:02:23.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.529+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3804c3c0 con 0x7f2e381597f0 2023-10-10T21:02:23.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.530+0000 7f2e2e7fc700 1 -- 172.21.15.154:0/3074050404 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e28007690 con 0x7f2e381597f0 2023-10-10T21:02:23.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.530+0000 7f2e2e7fc700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e1c066f30 0x7f2e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.530+0000 7f2e2e7fc700 1 -- 172.21.15.154:0/3074050404 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e28084080 con 0x7f2e381597f0 2023-10-10T21:02:23.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.531+0000 7f2e3e59b700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e1c066f30 0x7f2e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.531+0000 7f2e3e59b700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e1c066f30 0x7f2e1c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2e340093f0 tx=0x7f2e34017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:23.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.535+0000 7f2e2e7fc700 1 -- 172.21.15.154:0/3074050404 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e280512d0 con 0x7f2e381597f0 2023-10-10T21:02:23.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.725+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e380b1a70 con 0x7f2e381597f0 2023-10-10T21:02:23.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.726+0000 7f2e2e7fc700 1 -- 172.21.15.154:0/3074050404 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f2e280548f0 con 0x7f2e381597f0 2023-10-10T21:02:23.727 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:23.728 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:23.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.728+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e1c066f30 msgr2=0x7f2e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.728+0000 7f2e3f59d700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e1c066f30 0x7f2e1c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2e340093f0 tx=0x7f2e34017000 comp rx=0 tx=0).stop 2023-10-10T21:02:23.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.728+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e381597f0 msgr2=0x7f2e380c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.729+0000 7f2e3f59d700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e381597f0 0x7f2e380c6620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c7c0 tx=0x7f2e28007dd0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.729+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 shutdown_connections 2023-10-10T21:02:23.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.729+0000 7f2e3f59d700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e1c066f30 0x7f2e1c0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.729+0000 7f2e3f59d700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e3815d230 0x7f2e38155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.729+0000 7f2e3f59d700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e38159420 0x7f2e3815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.729+0000 7f2e3f59d700 1 --2- 172.21.15.154:0/3074050404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e381597f0 0x7f2e380c6620 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.729+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 >> 172.21.15.154:0/3074050404 conn(0x7f2e380d0660 msgr2=0x7f2e38069660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:23.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.729+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 shutdown_connections 2023-10-10T21:02:23.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.729+0000 7f2e3f59d700 1 -- 172.21.15.154:0/3074050404 wait complete. 2023-10-10T21:02:23.747 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T21:02:23.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:02:23.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.930+0000 7f2e75bff700 1 Processor -- start 2023-10-10T21:02:23.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.930+0000 7f2e75bff700 1 -- start start 2023-10-10T21:02:23.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e75bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e701599e0 0x7f2e70069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e75bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2e70159db0 0x7f2e70069080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e75bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e7006a2b0 0x7f2e7006a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e75bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e700c96a0 con 0x7f2e7006a2b0 2023-10-10T21:02:23.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e75bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e700cb9e0 con 0x7f2e70159db0 2023-10-10T21:02:23.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e75bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700cab60 con 0x7f2e701599e0 2023-10-10T21:02:23.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e7006a2b0 0x7f2e7006a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e7006a2b0 0x7f2e7006a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60134/0 (socket says 172.21.15.154:60134) 2023-10-10T21:02:23.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6ffff700 1 -- 172.21.15.154:0/1596641339 learned_addr learned my addr 172.21.15.154:0/1596641339 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:23.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6f7fe700 1 --2- 172.21.15.154:0/1596641339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e701599e0 0x7f2e70069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6ffff700 1 -- 172.21.15.154:0/1596641339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e701599e0 msgr2=0x7f2e70069ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:23.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6ffff700 1 --2- 172.21.15.154:0/1596641339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e701599e0 0x7f2e70069ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6effd700 1 --2- 172.21.15.154:0/1596641339 >> v2:172.21.15.179:3300/0 conn(0x7f2e70159db0 0x7f2e70069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6ffff700 1 -- 172.21.15.154:0/1596641339 >> v2:172.21.15.179:3300/0 conn(0x7f2e70159db0 msgr2=0x7f2e70069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:23.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6ffff700 1 --2- 172.21.15.154:0/1596641339 >> v2:172.21.15.179:3300/0 conn(0x7f2e70159db0 0x7f2e70069080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6ffff700 1 -- 172.21.15.154:0/1596641339 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e700cb420 con 0x7f2e7006a2b0 2023-10-10T21:02:23.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6f7fe700 1 --2- 172.21.15.154:0/1596641339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e701599e0 0x7f2e70069ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:23.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.932+0000 7f2e6effd700 1 --2- 172.21.15.154:0/1596641339 >> v2:172.21.15.179:3300/0 conn(0x7f2e70159db0 0x7f2e70069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:23.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.933+0000 7f2e6ffff700 1 --2- 172.21.15.154:0/1596641339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7006a2b0 0x7f2e7006a710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2e7006dab0 tx=0x7f2e68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5cac45b2f512d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:23.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.933+0000 7f2e6e7fc700 1 -- 172.21.15.154:0/1596641339 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800e070 con 0x7f2e7006a2b0 2023-10-10T21:02:23.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.933+0000 7f2e6e7fc700 1 -- 172.21.15.154:0/1596641339 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800ba50 con 0x7f2e7006a2b0 2023-10-10T21:02:23.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.933+0000 7f2e6e7fc700 1 -- 172.21.15.154:0/1596641339 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680092e0 con 0x7f2e7006a2b0 2023-10-10T21:02:23.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.933+0000 7f2e75bff700 1 -- 172.21.15.154:0/1596641339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7006a2b0 msgr2=0x7f2e7006a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.933+0000 7f2e75bff700 1 --2- 172.21.15.154:0/1596641339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7006a2b0 0x7f2e7006a710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2e7006dab0 tx=0x7f2e68009840 comp rx=0 tx=0).stop 2023-10-10T21:02:23.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.934+0000 7f2e75bff700 1 -- 172.21.15.154:0/1596641339 shutdown_connections 2023-10-10T21:02:23.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.934+0000 7f2e75bff700 1 --2- 172.21.15.154:0/1596641339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7006a2b0 0x7f2e7006a710 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.934+0000 7f2e75bff700 1 --2- 172.21.15.154:0/1596641339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e701599e0 0x7f2e70069ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.934+0000 7f2e75bff700 1 --2- 172.21.15.154:0/1596641339 >> v2:172.21.15.179:3300/0 conn(0x7f2e70159db0 0x7f2e70069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.934+0000 7f2e75bff700 1 -- 172.21.15.154:0/1596641339 >> 172.21.15.154:0/1596641339 conn(0x7f2e700c9860 msgr2=0x7f2e700c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:23.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.934+0000 7f2e75bff700 1 -- 172.21.15.154:0/1596641339 shutdown_connections 2023-10-10T21:02:23.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.934+0000 7f2e75bff700 1 -- 172.21.15.154:0/1596641339 wait complete. 2023-10-10T21:02:23.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.935+0000 7f2e75bff700 1 Processor -- start 2023-10-10T21:02:23.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.935+0000 7f2e75bff700 1 -- start start 2023-10-10T21:02:23.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e75bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e7006a2b0 0x7f2e7015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e75bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e701599e0 0x7f2e700b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e75bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e70159db0 0x7f2e70155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e75bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700b1a20 con 0x7f2e70159db0 2023-10-10T21:02:23.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e75bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700b1c80 con 0x7f2e701599e0 2023-10-10T21:02:23.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e75bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700b1f60 con 0x7f2e7006a2b0 2023-10-10T21:02:23.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e70159db0 0x7f2e70155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e6ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e70159db0 0x7f2e70155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60150/0 (socket says 172.21.15.154:60150) 2023-10-10T21:02:23.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e6ffff700 1 -- 172.21.15.154:0/3879493134 learned_addr learned my addr 172.21.15.154:0/3879493134 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:23.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e6f7fe700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e7006a2b0 0x7f2e7015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.936+0000 7f2e6effd700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e701599e0 0x7f2e700b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e6ffff700 1 -- 172.21.15.154:0/3879493134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e7006a2b0 msgr2=0x7f2e7015ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e6ffff700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e7006a2b0 0x7f2e7015ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e6ffff700 1 -- 172.21.15.154:0/3879493134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e701599e0 msgr2=0x7f2e700b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:23.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e6ffff700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e701599e0 0x7f2e700b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:23.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e6ffff700 1 -- 172.21.15.154:0/3879493134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68009ae0 con 0x7f2e70159db0 2023-10-10T21:02:23.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e6ffff700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e70159db0 0x7f2e70155290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e7006d6b0 tx=0x7f2e68018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:23.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e577fe700 1 -- 172.21.15.154:0/3879493134 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680032f0 con 0x7f2e70159db0 2023-10-10T21:02:23.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e577fe700 1 -- 172.21.15.154:0/3879493134 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68008d20 con 0x7f2e70159db0 2023-10-10T21:02:23.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e700b2240 con 0x7f2e70159db0 2023-10-10T21:02:23.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e577fe700 1 -- 172.21.15.154:0/3879493134 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68026690 con 0x7f2e70159db0 2023-10-10T21:02:23.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.937+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e700c4c90 con 0x7f2e70159db0 2023-10-10T21:02:23.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.938+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7004c3c0 con 0x7f2e70159db0 2023-10-10T21:02:23.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.939+0000 7f2e577fe700 1 -- 172.21.15.154:0/3879493134 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e68003040 con 0x7f2e70159db0 2023-10-10T21:02:23.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.941+0000 7f2e577fe700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e5c066f30 0x7f2e5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:23.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.941+0000 7f2e577fe700 1 -- 172.21.15.154:0/3879493134 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e68085ff0 con 0x7f2e70159db0 2023-10-10T21:02:23.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.941+0000 7f2e6f7fe700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e5c066f30 0x7f2e5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:23.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.941+0000 7f2e6f7fe700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e5c066f30 0x7f2e5c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000acc0 tx=0x7f2e60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:23.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:23.945+0000 7f2e577fe700 1 -- 172.21.15.154:0/3879493134 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e68053310 con 0x7f2e70159db0 2023-10-10T21:02:24.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.133+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e700cb700 con 0x7f2e5c066f30 2023-10-10T21:02:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.142+0000 7f2e577fe700 1 -- 172.21.15.154:0/3879493134 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264589 (secure 0 0 0) 0x7f2e700cb700 con 0x7f2e5c066f30 2023-10-10T21:02:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:24.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e5c066f30 msgr2=0x7f2e5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e5c066f30 0x7f2e5c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000acc0 tx=0x7f2e60008040 comp rx=0 tx=0).stop 2023-10-10T21:02:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e70159db0 msgr2=0x7f2e70155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e70159db0 0x7f2e70155290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e7006d6b0 tx=0x7f2e68018000 comp rx=0 tx=0).stop 2023-10-10T21:02:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 shutdown_connections 2023-10-10T21:02:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e70159db0 0x7f2e70155290 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2e5c066f30 0x7f2e5c0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e7006a2b0 0x7f2e7015ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 --2- 172.21.15.154:0/3879493134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e701599e0 0x7f2e700b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 >> 172.21.15.154:0/3879493134 conn(0x7f2e700c9860 msgr2=0x7f2e7006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 shutdown_connections 2023-10-10T21:02:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.146+0000 7f2e75bff700 1 -- 172.21.15.154:0/3879493134 wait complete. 2023-10-10T21:02:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:02:24.165 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-10T21:02:23.855327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381252,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593468,"statfs":{"total":773094113280,"available":770655711232,"internally_reserved":0,"allocated":3018752,"data_stored":1792420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001066"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727081+0000","last_change":"2023-10-10T21:02:19.727081+0000","last_active":"2023-10-10T21:02:19.727081+0000","last_peered":"2023-10-10T21:02:19.727081+0000","last_clean":"2023-10-10T21:02:19.727081+0000","last_became_active":"2023-10-10T21:02:19.726754+0000","last_became_peered":"2023-10-10T21:02:19.726754+0000","last_unstale":"2023-10-10T21:02:19.727081+0000","last_undegraded":"2023-10-10T21:02:19.727081+0000","last_fullsized":"2023-10-10T21:02:19.727081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:51.819041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.729741+0000","last_change":"2023-10-10T21:02:19.728351+0000","last_active":"2023-10-10T21:02:19.729741+0000","last_peered":"2023-10-10T21:02:19.729741+0000","last_clean":"2023-10-10T21:02:19.729741+0000","last_became_active":"2023-10-10T21:02:19.728087+0000","last_became_peered":"2023-10-10T21:02:19.728087+0000","last_unstale":"2023-10-10T21:02:19.729741+0000","last_undegraded":"2023-10-10T21:02:19.729741+0000","last_fullsized":"2023-10-10T21:02:19.729741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721483+0000","last_change":"2023-10-10T21:02:19.713674+0000","last_active":"2023-10-10T21:02:19.721483+0000","last_peered":"2023-10-10T21:02:19.721483+0000","last_clean":"2023-10-10T21:02:19.721483+0000","last_became_active":"2023-10-10T21:02:19.713276+0000","last_became_peered":"2023-10-10T21:02:19.713276+0000","last_unstale":"2023-10-10T21:02:19.721483+0000","last_undegraded":"2023-10-10T21:02:19.721483+0000","last_fullsized":"2023-10-10T21:02:19.721483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:34:22.625292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717566+0000","last_change":"2023-10-10T21:02:19.710812+0000","last_active":"2023-10-10T21:02:19.717566+0000","last_peered":"2023-10-10T21:02:19.717566+0000","last_clean":"2023-10-10T21:02:19.717566+0000","last_became_active":"2023-10-10T21:02:19.710422+0000","last_became_peered":"2023-10-10T21:02:19.710422+0000","last_unstale":"2023-10-10T21:02:19.717566+0000","last_undegraded":"2023-10-10T21:02:19.717566+0000","last_fullsized":"2023-10-10T21:02:19.717566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:11:55.480332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.714401+0000","last_change":"2023-10-10T21:02:19.714401+0000","last_active":"2023-10-10T21:02:19.714401+0000","last_peered":"2023-10-10T21:02:19.714401+0000","last_clean":"2023-10-10T21:02:19.714401+0000","last_became_active":"2023-10-10T21:02:19.714045+0000","last_became_peered":"2023-10-10T21:02:19.714045+0000","last_unstale":"2023-10-10T21:02:19.714401+0000","last_undegraded":"2023-10-10T21:02:19.714401+0000","last_fullsized":"2023-10-10T21:02:19.714401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:33:01.750601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.729464+0000","last_change":"2023-10-10T21:02:19.724680+0000","last_active":"2023-10-10T21:02:19.729464+0000","last_peered":"2023-10-10T21:02:19.729464+0000","last_clean":"2023-10-10T21:02:19.729464+0000","last_became_active":"2023-10-10T21:02:19.721313+0000","last_became_peered":"2023-10-10T21:02:19.721313+0000","last_unstale":"2023-10-10T21:02:19.729464+0000","last_undegraded":"2023-10-10T21:02:19.729464+0000","last_fullsized":"2023-10-10T21:02:19.729464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722047+0000","last_change":"2023-10-10T21:02:19.722047+0000","last_active":"2023-10-10T21:02:19.722047+0000","last_peered":"2023-10-10T21:02:19.722047+0000","last_clean":"2023-10-10T21:02:19.722047+0000","last_became_active":"2023-10-10T21:02:19.721771+0000","last_became_peered":"2023-10-10T21:02:19.721771+0000","last_unstale":"2023-10-10T21:02:19.722047+0000","last_undegraded":"2023-10-10T21:02:19.722047+0000","last_fullsized":"2023-10-10T21:02:19.722047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726576+0000","last_change":"2023-10-10T21:02:19.718311+0000","last_active":"2023-10-10T21:02:19.726576+0000","last_peered":"2023-10-10T21:02:19.726576+0000","last_clean":"2023-10-10T21:02:19.726576+0000","last_became_active":"2023-10-10T21:02:19.718055+0000","last_became_peered":"2023-10-10T21:02:19.718055+0000","last_unstale":"2023-10-10T21:02:19.726576+0000","last_undegraded":"2023-10-10T21:02:19.726576+0000","last_fullsized":"2023-10-10T21:02:19.726576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:02:29.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721906+0000","last_change":"2023-10-10T21:02:19.721906+0000","last_active":"2023-10-10T21:02:19.721906+0000","last_peered":"2023-10-10T21:02:19.721906+0000","last_clean":"2023-10-10T21:02:19.721906+0000","last_became_active":"2023-10-10T21:02:19.721669+0000","last_became_peered":"2023-10-10T21:02:19.721669+0000","last_unstale":"2023-10-10T21:02:19.721906+0000","last_undegraded":"2023-10-10T21:02:19.721906+0000","last_fullsized":"2023-10-10T21:02:19.721906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:24.203380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722093+0000","last_change":"2023-10-10T21:02:19.722093+0000","last_active":"2023-10-10T21:02:19.722093+0000","last_peered":"2023-10-10T21:02:19.722093+0000","last_clean":"2023-10-10T21:02:19.722093+0000","last_became_active":"2023-10-10T21:02:19.721844+0000","last_became_peered":"2023-10-10T21:02:19.721844+0000","last_unstale":"2023-10-10T21:02:19.722093+0000","last_undegraded":"2023-10-10T21:02:19.722093+0000","last_fullsized":"2023-10-10T21:02:19.722093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721570+0000","last_change":"2023-10-10T21:02:19.721570+0000","last_active":"2023-10-10T21:02:19.721570+0000","last_peered":"2023-10-10T21:02:19.721570+0000","last_clean":"2023-10-10T21:02:19.721570+0000","last_became_active":"2023-10-10T21:02:19.721289+0000","last_became_peered":"2023-10-10T21:02:19.721289+0000","last_unstale":"2023-10-10T21:02:19.721570+0000","last_undegraded":"2023-10-10T21:02:19.721570+0000","last_fullsized":"2023-10-10T21:02:19.721570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725875+0000","last_change":"2023-10-10T21:02:19.717746+0000","last_active":"2023-10-10T21:02:19.725875+0000","last_peered":"2023-10-10T21:02:19.725875+0000","last_clean":"2023-10-10T21:02:19.725875+0000","last_became_active":"2023-10-10T21:02:19.717435+0000","last_became_peered":"2023-10-10T21:02:19.717435+0000","last_unstale":"2023-10-10T21:02:19.725875+0000","last_undegraded":"2023-10-10T21:02:19.725875+0000","last_fullsized":"2023-10-10T21:02:19.725875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:50.911075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726896+0000","last_change":"2023-10-10T21:02:19.719831+0000","last_active":"2023-10-10T21:02:19.726896+0000","last_peered":"2023-10-10T21:02:19.726896+0000","last_clean":"2023-10-10T21:02:19.726896+0000","last_became_active":"2023-10-10T21:02:19.719580+0000","last_became_peered":"2023-10-10T21:02:19.719580+0000","last_unstale":"2023-10-10T21:02:19.726896+0000","last_undegraded":"2023-10-10T21:02:19.726896+0000","last_fullsized":"2023-10-10T21:02:19.726896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:57.187854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722504+0000","last_change":"2023-10-10T21:02:19.720031+0000","last_active":"2023-10-10T21:02:19.722504+0000","last_peered":"2023-10-10T21:02:19.722504+0000","last_clean":"2023-10-10T21:02:19.722504+0000","last_became_active":"2023-10-10T21:02:19.719689+0000","last_became_peered":"2023-10-10T21:02:19.719689+0000","last_unstale":"2023-10-10T21:02:19.722504+0000","last_undegraded":"2023-10-10T21:02:19.722504+0000","last_fullsized":"2023-10-10T21:02:19.722504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:15.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.706091+0000","last_change":"2023-10-10T21:02:19.704316+0000","last_active":"2023-10-10T21:02:19.706091+0000","last_peered":"2023-10-10T21:02:19.706091+0000","last_clean":"2023-10-10T21:02:19.706091+0000","last_became_active":"2023-10-10T21:02:19.704005+0000","last_became_peered":"2023-10-10T21:02:19.704005+0000","last_unstale":"2023-10-10T21:02:19.706091+0000","last_undegraded":"2023-10-10T21:02:19.706091+0000","last_fullsized":"2023-10-10T21:02:19.706091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:15.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724555+0000","last_change":"2023-10-10T21:02:19.721535+0000","last_active":"2023-10-10T21:02:19.724555+0000","last_peered":"2023-10-10T21:02:19.724555+0000","last_clean":"2023-10-10T21:02:19.724555+0000","last_became_active":"2023-10-10T21:02:19.721252+0000","last_became_peered":"2023-10-10T21:02:19.721252+0000","last_unstale":"2023-10-10T21:02:19.724555+0000","last_undegraded":"2023-10-10T21:02:19.724555+0000","last_fullsized":"2023-10-10T21:02:19.724555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718215+0000","last_change":"2023-10-10T21:02:19.713601+0000","last_active":"2023-10-10T21:02:19.718215+0000","last_peered":"2023-10-10T21:02:19.718215+0000","last_clean":"2023-10-10T21:02:19.718215+0000","last_became_active":"2023-10-10T21:02:19.713243+0000","last_became_peered":"2023-10-10T21:02:19.713243+0000","last_unstale":"2023-10-10T21:02:19.718215+0000","last_undegraded":"2023-10-10T21:02:19.718215+0000","last_fullsized":"2023-10-10T21:02:19.718215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:33:01.750601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724421+0000","last_change":"2023-10-10T21:02:19.724421+0000","last_active":"2023-10-10T21:02:19.724421+0000","last_peered":"2023-10-10T21:02:19.724421+0000","last_clean":"2023-10-10T21:02:19.724421+0000","last_became_active":"2023-10-10T21:02:19.724172+0000","last_became_peered":"2023-10-10T21:02:19.724172+0000","last_unstale":"2023-10-10T21:02:19.724421+0000","last_undegraded":"2023-10-10T21:02:19.724421+0000","last_fullsized":"2023-10-10T21:02:19.724421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:12:42.333132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715088+0000","last_change":"2023-10-10T21:02:19.715088+0000","last_active":"2023-10-10T21:02:19.715088+0000","last_peered":"2023-10-10T21:02:19.715088+0000","last_clean":"2023-10-10T21:02:19.715088+0000","last_became_active":"2023-10-10T21:02:19.714808+0000","last_became_peered":"2023-10-10T21:02:19.714808+0000","last_unstale":"2023-10-10T21:02:19.715088+0000","last_undegraded":"2023-10-10T21:02:19.715088+0000","last_fullsized":"2023-10-10T21:02:19.715088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723560+0000","last_change":"2023-10-10T21:02:18.705916+0000","last_active":"2023-10-10T21:02:19.723560+0000","last_peered":"2023-10-10T21:02:19.723560+0000","last_clean":"2023-10-10T21:02:19.723560+0000","last_became_active":"2023-10-10T21:02:18.705673+0000","last_became_peered":"2023-10-10T21:02:18.705673+0000","last_unstale":"2023-10-10T21:02:19.723560+0000","last_undegraded":"2023-10-10T21:02:19.723560+0000","last_fullsized":"2023-10-10T21:02:19.723560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:00:07.742782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727117+0000","last_change":"2023-10-10T21:02:19.721545+0000","last_active":"2023-10-10T21:02:19.727117+0000","last_peered":"2023-10-10T21:02:19.727117+0000","last_clean":"2023-10-10T21:02:19.727117+0000","last_became_active":"2023-10-10T21:02:19.721267+0000","last_became_peered":"2023-10-10T21:02:19.721267+0000","last_unstale":"2023-10-10T21:02:19.727117+0000","last_undegraded":"2023-10-10T21:02:19.727117+0000","last_fullsized":"2023-10-10T21:02:19.727117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:36:45.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726622+0000","last_change":"2023-10-10T21:02:18.708750+0000","last_active":"2023-10-10T21:02:19.726622+0000","last_peered":"2023-10-10T21:02:19.726622+0000","last_clean":"2023-10-10T21:02:19.726622+0000","last_became_active":"2023-10-10T21:02:18.708377+0000","last_became_peered":"2023-10-10T21:02:18.708377+0000","last_unstale":"2023-10-10T21:02:19.726622+0000","last_undegraded":"2023-10-10T21:02:19.726622+0000","last_fullsized":"2023-10-10T21:02:19.726622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:41:42.908310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727729+0000","last_change":"2023-10-10T21:02:19.723005+0000","last_active":"2023-10-10T21:02:19.727729+0000","last_peered":"2023-10-10T21:02:19.727729+0000","last_clean":"2023-10-10T21:02:19.727729+0000","last_became_active":"2023-10-10T21:02:19.722761+0000","last_became_peered":"2023-10-10T21:02:19.722761+0000","last_unstale":"2023-10-10T21:02:19.727729+0000","last_undegraded":"2023-10-10T21:02:19.727729+0000","last_fullsized":"2023-10-10T21:02:19.727729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731941+0000","last_change":"2023-10-10T21:02:18.715526+0000","last_active":"2023-10-10T21:02:19.731941+0000","last_peered":"2023-10-10T21:02:19.731941+0000","last_clean":"2023-10-10T21:02:19.731941+0000","last_became_active":"2023-10-10T21:02:18.715098+0000","last_became_peered":"2023-10-10T21:02:18.715098+0000","last_unstale":"2023-10-10T21:02:19.731941+0000","last_undegraded":"2023-10-10T21:02:19.731941+0000","last_fullsized":"2023-10-10T21:02:19.731941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718973+0000","last_change":"2023-10-10T21:02:19.714549+0000","last_active":"2023-10-10T21:02:19.718973+0000","last_peered":"2023-10-10T21:02:19.718973+0000","last_clean":"2023-10-10T21:02:19.718973+0000","last_became_active":"2023-10-10T21:02:19.714241+0000","last_became_peered":"2023-10-10T21:02:19.714241+0000","last_unstale":"2023-10-10T21:02:19.718973+0000","last_undegraded":"2023-10-10T21:02:19.718973+0000","last_fullsized":"2023-10-10T21:02:19.718973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:51.819041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731925+0000","last_change":"2023-10-10T21:02:18.721479+0000","last_active":"2023-10-10T21:02:19.731925+0000","last_peered":"2023-10-10T21:02:19.731925+0000","last_clean":"2023-10-10T21:02:19.731925+0000","last_became_active":"2023-10-10T21:02:18.721197+0000","last_became_peered":"2023-10-10T21:02:18.721197+0000","last_unstale":"2023-10-10T21:02:19.731925+0000","last_undegraded":"2023-10-10T21:02:19.731925+0000","last_fullsized":"2023-10-10T21:02:19.731925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.720290+0000","last_change":"2023-10-10T21:02:19.714941+0000","last_active":"2023-10-10T21:02:19.720290+0000","last_peered":"2023-10-10T21:02:19.720290+0000","last_clean":"2023-10-10T21:02:19.720290+0000","last_became_active":"2023-10-10T21:02:19.714068+0000","last_became_peered":"2023-10-10T21:02:19.714068+0000","last_unstale":"2023-10-10T21:02:19.720290+0000","last_undegraded":"2023-10-10T21:02:19.720290+0000","last_fullsized":"2023-10-10T21:02:19.720290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:24.203380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730306+0000","last_change":"2023-10-10T21:02:18.716842+0000","last_active":"2023-10-10T21:02:19.730306+0000","last_peered":"2023-10-10T21:02:19.730306+0000","last_clean":"2023-10-10T21:02:19.730306+0000","last_became_active":"2023-10-10T21:02:18.716540+0000","last_became_peered":"2023-10-10T21:02:18.716540+0000","last_unstale":"2023-10-10T21:02:19.730306+0000","last_undegraded":"2023-10-10T21:02:19.730306+0000","last_fullsized":"2023-10-10T21:02:19.730306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:24:11.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717957+0000","last_change":"2023-10-10T21:02:19.709639+0000","last_active":"2023-10-10T21:02:19.717957+0000","last_peered":"2023-10-10T21:02:19.717957+0000","last_clean":"2023-10-10T21:02:19.717957+0000","last_became_active":"2023-10-10T21:02:19.708657+0000","last_became_peered":"2023-10-10T21:02:19.708657+0000","last_unstale":"2023-10-10T21:02:19.717957+0000","last_undegraded":"2023-10-10T21:02:19.717957+0000","last_fullsized":"2023-10-10T21:02:19.717957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:16.338945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.704272+0000","last_change":"2023-10-10T21:02:18.714042+0000","last_active":"2023-10-10T21:02:19.704272+0000","last_peered":"2023-10-10T21:02:19.704272+0000","last_clean":"2023-10-10T21:02:19.704272+0000","last_became_active":"2023-10-10T21:02:18.713460+0000","last_became_peered":"2023-10-10T21:02:18.713460+0000","last_unstale":"2023-10-10T21:02:19.704272+0000","last_undegraded":"2023-10-10T21:02:19.704272+0000","last_fullsized":"2023-10-10T21:02:19.704272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725423+0000","last_change":"2023-10-10T21:02:19.722075+0000","last_active":"2023-10-10T21:02:19.725423+0000","last_peered":"2023-10-10T21:02:19.725423+0000","last_clean":"2023-10-10T21:02:19.725423+0000","last_became_active":"2023-10-10T21:02:19.721818+0000","last_became_peered":"2023-10-10T21:02:19.721818+0000","last_unstale":"2023-10-10T21:02:19.725423+0000","last_undegraded":"2023-10-10T21:02:19.725423+0000","last_fullsized":"2023-10-10T21:02:19.725423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:39:51.766459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.701716+0000","last_change":"2023-10-10T21:02:18.713684+0000","last_active":"2023-10-10T21:02:19.701716+0000","last_peered":"2023-10-10T21:02:19.701716+0000","last_clean":"2023-10-10T21:02:19.701716+0000","last_became_active":"2023-10-10T21:02:18.712935+0000","last_became_peered":"2023-10-10T21:02:18.712935+0000","last_unstale":"2023-10-10T21:02:19.701716+0000","last_undegraded":"2023-10-10T21:02:19.701716+0000","last_fullsized":"2023-10-10T21:02:19.701716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:14.025240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727600+0000","last_change":"2023-10-10T21:02:19.724065+0000","last_active":"2023-10-10T21:02:19.727600+0000","last_peered":"2023-10-10T21:02:19.727600+0000","last_clean":"2023-10-10T21:02:19.727600+0000","last_became_active":"2023-10-10T21:02:19.723390+0000","last_became_peered":"2023-10-10T21:02:19.723390+0000","last_unstale":"2023-10-10T21:02:19.727600+0000","last_undegraded":"2023-10-10T21:02:19.727600+0000","last_fullsized":"2023-10-10T21:02:19.727600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:37:50.246896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694142+0000","last_change":"2023-10-10T21:02:18.718570+0000","last_active":"2023-10-10T21:02:19.694142+0000","last_peered":"2023-10-10T21:02:19.694142+0000","last_clean":"2023-10-10T21:02:19.694142+0000","last_became_active":"2023-10-10T21:02:18.718251+0000","last_became_peered":"2023-10-10T21:02:18.718251+0000","last_unstale":"2023-10-10T21:02:19.694142+0000","last_undegraded":"2023-10-10T21:02:19.694142+0000","last_fullsized":"2023-10-10T21:02:19.694142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:14.026617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717960+0000","last_change":"2023-10-10T21:02:19.714750+0000","last_active":"2023-10-10T21:02:19.717960+0000","last_peered":"2023-10-10T21:02:19.717960+0000","last_clean":"2023-10-10T21:02:19.717960+0000","last_became_active":"2023-10-10T21:02:19.714443+0000","last_became_peered":"2023-10-10T21:02:19.714443+0000","last_unstale":"2023-10-10T21:02:19.717960+0000","last_undegraded":"2023-10-10T21:02:19.717960+0000","last_fullsized":"2023-10-10T21:02:19.717960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.723437+0000","last_change":"2023-10-10T21:02:18.721599+0000","last_active":"2023-10-10T21:02:18.723437+0000","last_peered":"2023-10-10T21:02:18.723437+0000","last_clean":"2023-10-10T21:02:18.723437+0000","last_became_active":"2023-10-10T21:02:18.721291+0000","last_became_peered":"2023-10-10T21:02:18.721291+0000","last_unstale":"2023-10-10T21:02:18.723437+0000","last_undegraded":"2023-10-10T21:02:18.723437+0000","last_fullsized":"2023-10-10T21:02:18.723437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718109+0000","last_change":"2023-10-10T21:02:19.712154+0000","last_active":"2023-10-10T21:02:19.718109+0000","last_peered":"2023-10-10T21:02:19.718109+0000","last_clean":"2023-10-10T21:02:19.718109+0000","last_became_active":"2023-10-10T21:02:19.711878+0000","last_became_peered":"2023-10-10T21:02:19.711878+0000","last_unstale":"2023-10-10T21:02:19.718109+0000","last_undegraded":"2023-10-10T21:02:19.718109+0000","last_fullsized":"2023-10-10T21:02:19.718109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694643+0000","last_change":"2023-10-10T21:02:18.722267+0000","last_active":"2023-10-10T21:02:19.694643+0000","last_peered":"2023-10-10T21:02:19.694643+0000","last_clean":"2023-10-10T21:02:19.694643+0000","last_became_active":"2023-10-10T21:02:18.719908+0000","last_became_peered":"2023-10-10T21:02:18.719908+0000","last_unstale":"2023-10-10T21:02:19.694643+0000","last_undegraded":"2023-10-10T21:02:19.694643+0000","last_fullsized":"2023-10-10T21:02:19.694643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726172+0000","last_change":"2023-10-10T21:02:19.722369+0000","last_active":"2023-10-10T21:02:19.726172+0000","last_peered":"2023-10-10T21:02:19.726172+0000","last_clean":"2023-10-10T21:02:19.726172+0000","last_became_active":"2023-10-10T21:02:19.722113+0000","last_became_peered":"2023-10-10T21:02:19.722113+0000","last_unstale":"2023-10-10T21:02:19.726172+0000","last_undegraded":"2023-10-10T21:02:19.726172+0000","last_fullsized":"2023-10-10T21:02:19.726172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726730+0000","last_change":"2023-10-10T21:02:18.718657+0000","last_active":"2023-10-10T21:02:19.726730+0000","last_peered":"2023-10-10T21:02:19.726730+0000","last_clean":"2023-10-10T21:02:19.726730+0000","last_became_active":"2023-10-10T21:02:18.718395+0000","last_became_peered":"2023-10-10T21:02:18.718395+0000","last_unstale":"2023-10-10T21:02:19.726730+0000","last_undegraded":"2023-10-10T21:02:19.726730+0000","last_fullsized":"2023-10-10T21:02:19.726730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.716253+0000","last_change":"2023-10-10T21:02:19.705946+0000","last_active":"2023-10-10T21:02:19.716253+0000","last_peered":"2023-10-10T21:02:19.716253+0000","last_clean":"2023-10-10T21:02:19.716253+0000","last_became_active":"2023-10-10T21:02:19.705596+0000","last_became_peered":"2023-10-10T21:02:19.705596+0000","last_unstale":"2023-10-10T21:02:19.716253+0000","last_undegraded":"2023-10-10T21:02:19.716253+0000","last_fullsized":"2023-10-10T21:02:19.716253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:45.667349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727210+0000","last_change":"2023-10-10T21:02:18.712503+0000","last_active":"2023-10-10T21:02:19.727210+0000","last_peered":"2023-10-10T21:02:19.727210+0000","last_clean":"2023-10-10T21:02:19.727210+0000","last_became_active":"2023-10-10T21:02:18.712089+0000","last_became_peered":"2023-10-10T21:02:18.712089+0000","last_unstale":"2023-10-10T21:02:19.727210+0000","last_undegraded":"2023-10-10T21:02:19.727210+0000","last_fullsized":"2023-10-10T21:02:19.727210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719227+0000","last_change":"2023-10-10T21:02:19.719227+0000","last_active":"2023-10-10T21:02:19.719227+0000","last_peered":"2023-10-10T21:02:19.719227+0000","last_clean":"2023-10-10T21:02:19.719227+0000","last_became_active":"2023-10-10T21:02:19.718847+0000","last_became_peered":"2023-10-10T21:02:19.718847+0000","last_unstale":"2023-10-10T21:02:19.719227+0000","last_undegraded":"2023-10-10T21:02:19.719227+0000","last_fullsized":"2023-10-10T21:02:19.719227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:01:48.898002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723071+0000","last_change":"2023-10-10T21:02:18.704860+0000","last_active":"2023-10-10T21:02:19.723071+0000","last_peered":"2023-10-10T21:02:19.723071+0000","last_clean":"2023-10-10T21:02:19.723071+0000","last_became_active":"2023-10-10T21:02:18.704565+0000","last_became_peered":"2023-10-10T21:02:18.704565+0000","last_unstale":"2023-10-10T21:02:19.723071+0000","last_undegraded":"2023-10-10T21:02:19.723071+0000","last_fullsized":"2023-10-10T21:02:19.723071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:44.459665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722520+0000","last_change":"2023-10-10T21:02:19.720643+0000","last_active":"2023-10-10T21:02:19.722520+0000","last_peered":"2023-10-10T21:02:19.722520+0000","last_clean":"2023-10-10T21:02:19.722520+0000","last_became_active":"2023-10-10T21:02:19.720210+0000","last_became_peered":"2023-10-10T21:02:19.720210+0000","last_unstale":"2023-10-10T21:02:19.722520+0000","last_undegraded":"2023-10-10T21:02:19.722520+0000","last_fullsized":"2023-10-10T21:02:19.722520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:00.153901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694420+0000","last_change":"2023-10-10T21:02:18.713031+0000","last_active":"2023-10-10T21:02:19.694420+0000","last_peered":"2023-10-10T21:02:19.694420+0000","last_clean":"2023-10-10T21:02:19.694420+0000","last_became_active":"2023-10-10T21:02:18.712686+0000","last_became_peered":"2023-10-10T21:02:18.712686+0000","last_unstale":"2023-10-10T21:02:19.694420+0000","last_undegraded":"2023-10-10T21:02:19.694420+0000","last_fullsized":"2023-10-10T21:02:19.694420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723948+0000","last_change":"2023-10-10T21:02:19.723948+0000","last_active":"2023-10-10T21:02:19.723948+0000","last_peered":"2023-10-10T21:02:19.723948+0000","last_clean":"2023-10-10T21:02:19.723948+0000","last_became_active":"2023-10-10T21:02:19.723676+0000","last_became_peered":"2023-10-10T21:02:19.723676+0000","last_unstale":"2023-10-10T21:02:19.723948+0000","last_undegraded":"2023-10-10T21:02:19.723948+0000","last_fullsized":"2023-10-10T21:02:19.723948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:07:28.315895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.719618+0000","last_change":"2023-10-10T21:02:18.713015+0000","last_active":"2023-10-10T21:02:18.719618+0000","last_peered":"2023-10-10T21:02:18.719618+0000","last_clean":"2023-10-10T21:02:18.719618+0000","last_became_active":"2023-10-10T21:02:18.712700+0000","last_became_peered":"2023-10-10T21:02:18.712700+0000","last_unstale":"2023-10-10T21:02:18.719618+0000","last_undegraded":"2023-10-10T21:02:18.719618+0000","last_fullsized":"2023-10-10T21:02:18.719618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724648+0000","last_change":"2023-10-10T21:02:19.724648+0000","last_active":"2023-10-10T21:02:19.724648+0000","last_peered":"2023-10-10T21:02:19.724648+0000","last_clean":"2023-10-10T21:02:19.724648+0000","last_became_active":"2023-10-10T21:02:19.723407+0000","last_became_peered":"2023-10-10T21:02:19.723407+0000","last_unstale":"2023-10-10T21:02:19.724648+0000","last_undegraded":"2023-10-10T21:02:19.724648+0000","last_fullsized":"2023-10-10T21:02:19.724648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:39:51.766459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719178+0000","last_change":"2023-10-10T21:02:18.704318+0000","last_active":"2023-10-10T21:02:19.719178+0000","last_peered":"2023-10-10T21:02:19.719178+0000","last_clean":"2023-10-10T21:02:19.719178+0000","last_became_active":"2023-10-10T21:02:18.704004+0000","last_became_peered":"2023-10-10T21:02:18.704004+0000","last_unstale":"2023-10-10T21:02:19.719178+0000","last_undegraded":"2023-10-10T21:02:19.719178+0000","last_fullsized":"2023-10-10T21:02:19.719178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:41:42.908310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726963+0000","last_change":"2023-10-10T21:02:19.726963+0000","last_active":"2023-10-10T21:02:19.726963+0000","last_peered":"2023-10-10T21:02:19.726963+0000","last_clean":"2023-10-10T21:02:19.726963+0000","last_became_active":"2023-10-10T21:02:19.726624+0000","last_became_peered":"2023-10-10T21:02:19.726624+0000","last_unstale":"2023-10-10T21:02:19.726963+0000","last_undegraded":"2023-10-10T21:02:19.726963+0000","last_fullsized":"2023-10-10T21:02:19.726963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726614+0000","last_change":"2023-10-10T21:02:18.702662+0000","last_active":"2023-10-10T21:02:19.726614+0000","last_peered":"2023-10-10T21:02:19.726614+0000","last_clean":"2023-10-10T21:02:19.726614+0000","last_became_active":"2023-10-10T21:02:18.702383+0000","last_became_peered":"2023-10-10T21:02:18.702383+0000","last_unstale":"2023-10-10T21:02:19.726614+0000","last_undegraded":"2023-10-10T21:02:19.726614+0000","last_fullsized":"2023-10-10T21:02:19.726614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:44.459665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724101+0000","last_change":"2023-10-10T21:02:19.724101+0000","last_active":"2023-10-10T21:02:19.724101+0000","last_peered":"2023-10-10T21:02:19.724101+0000","last_clean":"2023-10-10T21:02:19.724101+0000","last_became_active":"2023-10-10T21:02:19.723825+0000","last_became_peered":"2023-10-10T21:02:19.723825+0000","last_unstale":"2023-10-10T21:02:19.724101+0000","last_undegraded":"2023-10-10T21:02:19.724101+0000","last_fullsized":"2023-10-10T21:02:19.724101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693103+0000","last_change":"2023-10-10T21:02:18.707721+0000","last_active":"2023-10-10T21:02:19.693103+0000","last_peered":"2023-10-10T21:02:19.693103+0000","last_clean":"2023-10-10T21:02:19.693103+0000","last_became_active":"2023-10-10T21:02:18.707316+0000","last_became_peered":"2023-10-10T21:02:18.707316+0000","last_unstale":"2023-10-10T21:02:19.693103+0000","last_undegraded":"2023-10-10T21:02:19.693103+0000","last_fullsized":"2023-10-10T21:02:19.693103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715462+0000","last_change":"2023-10-10T21:02:19.711473+0000","last_active":"2023-10-10T21:02:19.715462+0000","last_peered":"2023-10-10T21:02:19.715462+0000","last_clean":"2023-10-10T21:02:19.715462+0000","last_became_active":"2023-10-10T21:02:19.711163+0000","last_became_peered":"2023-10-10T21:02:19.711163+0000","last_unstale":"2023-10-10T21:02:19.715462+0000","last_undegraded":"2023-10-10T21:02:19.715462+0000","last_fullsized":"2023-10-10T21:02:19.715462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694353+0000","last_change":"2023-10-10T21:02:18.714506+0000","last_active":"2023-10-10T21:02:19.694353+0000","last_peered":"2023-10-10T21:02:19.694353+0000","last_clean":"2023-10-10T21:02:19.694353+0000","last_became_active":"2023-10-10T21:02:18.714083+0000","last_became_peered":"2023-10-10T21:02:18.714083+0000","last_unstale":"2023-10-10T21:02:19.694353+0000","last_undegraded":"2023-10-10T21:02:19.694353+0000","last_fullsized":"2023-10-10T21:02:19.694353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726810+0000","last_change":"2023-10-10T21:02:19.723781+0000","last_active":"2023-10-10T21:02:19.726810+0000","last_peered":"2023-10-10T21:02:19.726810+0000","last_clean":"2023-10-10T21:02:19.726810+0000","last_became_active":"2023-10-10T21:02:19.723312+0000","last_became_peered":"2023-10-10T21:02:19.723312+0000","last_unstale":"2023-10-10T21:02:19.726810+0000","last_undegraded":"2023-10-10T21:02:19.726810+0000","last_fullsized":"2023-10-10T21:02:19.726810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:36.717475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.707776+0000","last_change":"2023-10-10T21:02:19.704121+0000","last_active":"2023-10-10T21:02:19.707776+0000","last_peered":"2023-10-10T21:02:19.707776+0000","last_clean":"2023-10-10T21:02:19.707776+0000","last_became_active":"2023-10-10T21:02:19.701763+0000","last_became_peered":"2023-10-10T21:02:19.701763+0000","last_unstale":"2023-10-10T21:02:19.707776+0000","last_undegraded":"2023-10-10T21:02:19.707776+0000","last_fullsized":"2023-10-10T21:02:19.707776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.703367+0000","last_change":"2023-10-10T21:02:18.702602+0000","last_active":"2023-10-10T21:02:18.703367+0000","last_peered":"2023-10-10T21:02:18.703367+0000","last_clean":"2023-10-10T21:02:18.703367+0000","last_became_active":"2023-10-10T21:02:18.702148+0000","last_became_peered":"2023-10-10T21:02:18.702148+0000","last_unstale":"2023-10-10T21:02:18.703367+0000","last_undegraded":"2023-10-10T21:02:18.703367+0000","last_fullsized":"2023-10-10T21:02:18.703367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:24:11.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726645+0000","last_change":"2023-10-10T21:02:19.718927+0000","last_active":"2023-10-10T21:02:19.726645+0000","last_peered":"2023-10-10T21:02:19.726645+0000","last_clean":"2023-10-10T21:02:19.726645+0000","last_became_active":"2023-10-10T21:02:19.718658+0000","last_became_peered":"2023-10-10T21:02:19.718658+0000","last_unstale":"2023-10-10T21:02:19.726645+0000","last_undegraded":"2023-10-10T21:02:19.726645+0000","last_fullsized":"2023-10-10T21:02:19.726645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:45:52.552283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694494+0000","last_change":"2023-10-10T21:02:18.716187+0000","last_active":"2023-10-10T21:02:19.694494+0000","last_peered":"2023-10-10T21:02:19.694494+0000","last_clean":"2023-10-10T21:02:19.694494+0000","last_became_active":"2023-10-10T21:02:18.715942+0000","last_became_peered":"2023-10-10T21:02:18.715942+0000","last_unstale":"2023-10-10T21:02:19.694494+0000","last_undegraded":"2023-10-10T21:02:19.694494+0000","last_fullsized":"2023-10-10T21:02:19.694494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.702354+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:02:18.702354+0000","last_peered":"2023-10-10T21:02:18.702354+0000","last_clean":"2023-10-10T21:02:18.702354+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:02:18.702354+0000","last_undegraded":"2023-10-10T21:02:18.702354+0000","last_fullsized":"2023-10-10T21:02:18.702354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727440+0000","last_change":"2023-10-10T21:02:19.722786+0000","last_active":"2023-10-10T21:02:19.727440+0000","last_peered":"2023-10-10T21:02:19.727440+0000","last_clean":"2023-10-10T21:02:19.727440+0000","last_became_active":"2023-10-10T21:02:19.722544+0000","last_became_peered":"2023-10-10T21:02:19.722544+0000","last_unstale":"2023-10-10T21:02:19.727440+0000","last_undegraded":"2023-10-10T21:02:19.727440+0000","last_fullsized":"2023-10-10T21:02:19.727440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:42:20.031126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.723139+0000","last_change":"2023-10-10T21:02:18.719142+0000","last_active":"2023-10-10T21:02:18.723139+0000","last_peered":"2023-10-10T21:02:18.723139+0000","last_clean":"2023-10-10T21:02:18.723139+0000","last_became_active":"2023-10-10T21:02:18.718861+0000","last_became_peered":"2023-10-10T21:02:18.718861+0000","last_unstale":"2023-10-10T21:02:18.723139+0000","last_undegraded":"2023-10-10T21:02:18.723139+0000","last_fullsized":"2023-10-10T21:02:18.723139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.720487+0000","last_change":"2023-10-10T21:02:18.712773+0000","last_active":"2023-10-10T21:02:18.720487+0000","last_peered":"2023-10-10T21:02:18.720487+0000","last_clean":"2023-10-10T21:02:18.720487+0000","last_became_active":"2023-10-10T21:02:18.712496+0000","last_became_peered":"2023-10-10T21:02:18.712496+0000","last_unstale":"2023-10-10T21:02:18.720487+0000","last_undegraded":"2023-10-10T21:02:18.720487+0000","last_fullsized":"2023-10-10T21:02:18.720487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:09:01.161677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.706058+0000","last_change":"2023-10-10T21:02:19.702557+0000","last_active":"2023-10-10T21:02:19.706058+0000","last_peered":"2023-10-10T21:02:19.706058+0000","last_clean":"2023-10-10T21:02:19.706058+0000","last_became_active":"2023-10-10T21:02:19.702270+0000","last_became_peered":"2023-10-10T21:02:19.702270+0000","last_unstale":"2023-10-10T21:02:19.706058+0000","last_undegraded":"2023-10-10T21:02:19.706058+0000","last_fullsized":"2023-10-10T21:02:19.706058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693692+0000","last_change":"2023-10-10T21:02:18.713198+0000","last_active":"2023-10-10T21:02:19.693692+0000","last_peered":"2023-10-10T21:02:19.693692+0000","last_clean":"2023-10-10T21:02:19.693692+0000","last_became_active":"2023-10-10T21:02:18.712906+0000","last_became_peered":"2023-10-10T21:02:18.712906+0000","last_unstale":"2023-10-10T21:02:19.693692+0000","last_undegraded":"2023-10-10T21:02:19.693692+0000","last_fullsized":"2023-10-10T21:02:19.693692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715363+0000","last_change":"2023-10-10T21:02:19.707593+0000","last_active":"2023-10-10T21:02:19.715363+0000","last_peered":"2023-10-10T21:02:19.715363+0000","last_clean":"2023-10-10T21:02:19.715363+0000","last_became_active":"2023-10-10T21:02:19.706687+0000","last_became_peered":"2023-10-10T21:02:19.706687+0000","last_unstale":"2023-10-10T21:02:19.715363+0000","last_undegraded":"2023-10-10T21:02:19.715363+0000","last_fullsized":"2023-10-10T21:02:19.715363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:59:28.606720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723689+0000","last_change":"2023-10-10T21:02:18.719905+0000","last_active":"2023-10-10T21:02:19.723689+0000","last_peered":"2023-10-10T21:02:19.723689+0000","last_clean":"2023-10-10T21:02:19.723689+0000","last_became_active":"2023-10-10T21:02:18.719606+0000","last_became_peered":"2023-10-10T21:02:18.719606+0000","last_unstale":"2023-10-10T21:02:19.723689+0000","last_undegraded":"2023-10-10T21:02:19.723689+0000","last_fullsized":"2023-10-10T21:02:19.723689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722943+0000","last_change":"2023-10-10T21:02:19.720643+0000","last_active":"2023-10-10T21:02:19.722943+0000","last_peered":"2023-10-10T21:02:19.722943+0000","last_clean":"2023-10-10T21:02:19.722943+0000","last_became_active":"2023-10-10T21:02:19.720362+0000","last_became_peered":"2023-10-10T21:02:19.720362+0000","last_unstale":"2023-10-10T21:02:19.722943+0000","last_undegraded":"2023-10-10T21:02:19.722943+0000","last_fullsized":"2023-10-10T21:02:19.722943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.722988+0000","last_change":"2023-10-10T21:02:18.716964+0000","last_active":"2023-10-10T21:02:18.722988+0000","last_peered":"2023-10-10T21:02:18.722988+0000","last_clean":"2023-10-10T21:02:18.722988+0000","last_became_active":"2023-10-10T21:02:18.716502+0000","last_became_peered":"2023-10-10T21:02:18.716502+0000","last_unstale":"2023-10-10T21:02:18.722988+0000","last_undegraded":"2023-10-10T21:02:18.722988+0000","last_fullsized":"2023-10-10T21:02:18.722988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.709106+0000","last_change":"2023-10-10T21:02:19.702718+0000","last_active":"2023-10-10T21:02:19.709106+0000","last_peered":"2023-10-10T21:02:19.709106+0000","last_clean":"2023-10-10T21:02:19.709106+0000","last_became_active":"2023-10-10T21:02:19.702438+0000","last_became_peered":"2023-10-10T21:02:19.702438+0000","last_unstale":"2023-10-10T21:02:19.709106+0000","last_undegraded":"2023-10-10T21:02:19.709106+0000","last_fullsized":"2023-10-10T21:02:19.709106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:09:02.167913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693020+0000","last_change":"2023-10-10T21:02:18.719939+0000","last_active":"2023-10-10T21:02:19.693020+0000","last_peered":"2023-10-10T21:02:19.693020+0000","last_clean":"2023-10-10T21:02:19.693020+0000","last_became_active":"2023-10-10T21:02:18.719606+0000","last_became_peered":"2023-10-10T21:02:18.719606+0000","last_unstale":"2023-10-10T21:02:19.693020+0000","last_undegraded":"2023-10-10T21:02:19.693020+0000","last_fullsized":"2023-10-10T21:02:19.693020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725258+0000","last_change":"2023-10-10T21:02:19.717095+0000","last_active":"2023-10-10T21:02:19.725258+0000","last_peered":"2023-10-10T21:02:19.725258+0000","last_clean":"2023-10-10T21:02:19.725258+0000","last_became_active":"2023-10-10T21:02:19.716805+0000","last_became_peered":"2023-10-10T21:02:19.716805+0000","last_unstale":"2023-10-10T21:02:19.725258+0000","last_undegraded":"2023-10-10T21:02:19.725258+0000","last_fullsized":"2023-10-10T21:02:19.725258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:02:18.184054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693205+0000","last_change":"2023-10-10T21:02:18.711397+0000","last_active":"2023-10-10T21:02:19.693205+0000","last_peered":"2023-10-10T21:02:19.693205+0000","last_clean":"2023-10-10T21:02:19.693205+0000","last_became_active":"2023-10-10T21:02:18.710905+0000","last_became_peered":"2023-10-10T21:02:18.710905+0000","last_unstale":"2023-10-10T21:02:19.693205+0000","last_undegraded":"2023-10-10T21:02:19.693205+0000","last_fullsized":"2023-10-10T21:02:19.693205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:14.026617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727611+0000","last_change":"2023-10-10T21:02:19.724197+0000","last_active":"2023-10-10T21:02:19.727611+0000","last_peered":"2023-10-10T21:02:19.727611+0000","last_clean":"2023-10-10T21:02:19.727611+0000","last_became_active":"2023-10-10T21:02:19.723375+0000","last_became_peered":"2023-10-10T21:02:19.723375+0000","last_unstale":"2023-10-10T21:02:19.727611+0000","last_undegraded":"2023-10-10T21:02:19.727611+0000","last_fullsized":"2023-10-10T21:02:19.727611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:06.143786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731948+0000","last_change":"2023-10-10T21:02:18.717453+0000","last_active":"2023-10-10T21:02:19.731948+0000","last_peered":"2023-10-10T21:02:19.731948+0000","last_clean":"2023-10-10T21:02:19.731948+0000","last_became_active":"2023-10-10T21:02:18.716456+0000","last_became_peered":"2023-10-10T21:02:18.716456+0000","last_unstale":"2023-10-10T21:02:19.731948+0000","last_undegraded":"2023-10-10T21:02:19.731948+0000","last_fullsized":"2023-10-10T21:02:19.731948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721762+0000","last_change":"2023-10-10T21:02:19.721762+0000","last_active":"2023-10-10T21:02:19.721762+0000","last_peered":"2023-10-10T21:02:19.721762+0000","last_clean":"2023-10-10T21:02:19.721762+0000","last_became_active":"2023-10-10T21:02:19.721459+0000","last_became_peered":"2023-10-10T21:02:19.721459+0000","last_unstale":"2023-10-10T21:02:19.721762+0000","last_undegraded":"2023-10-10T21:02:19.721762+0000","last_fullsized":"2023-10-10T21:02:19.721762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.723393+0000","last_change":"2023-10-10T21:02:18.721637+0000","last_active":"2023-10-10T21:02:18.723393+0000","last_peered":"2023-10-10T21:02:18.723393+0000","last_clean":"2023-10-10T21:02:18.723393+0000","last_became_active":"2023-10-10T21:02:18.721347+0000","last_became_peered":"2023-10-10T21:02:18.721347+0000","last_unstale":"2023-10-10T21:02:18.723393+0000","last_undegraded":"2023-10-10T21:02:18.723393+0000","last_fullsized":"2023-10-10T21:02:18.723393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:14.025240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722542+0000","last_change":"2023-10-10T21:02:19.722542+0000","last_active":"2023-10-10T21:02:19.722542+0000","last_peered":"2023-10-10T21:02:19.722542+0000","last_clean":"2023-10-10T21:02:19.722542+0000","last_became_active":"2023-10-10T21:02:19.722239+0000","last_became_peered":"2023-10-10T21:02:19.722239+0000","last_unstale":"2023-10-10T21:02:19.722542+0000","last_undegraded":"2023-10-10T21:02:19.722542+0000","last_fullsized":"2023-10-10T21:02:19.722542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:38:51.453531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721282+0000","last_change":"2023-10-10T21:02:18.706830+0000","last_active":"2023-10-10T21:02:19.721282+0000","last_peered":"2023-10-10T21:02:19.721282+0000","last_clean":"2023-10-10T21:02:19.721282+0000","last_became_active":"2023-10-10T21:02:18.706545+0000","last_became_peered":"2023-10-10T21:02:18.706545+0000","last_unstale":"2023-10-10T21:02:19.721282+0000","last_undegraded":"2023-10-10T21:02:19.721282+0000","last_fullsized":"2023-10-10T21:02:19.721282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718953+0000","last_change":"2023-10-10T21:02:19.713935+0000","last_active":"2023-10-10T21:02:19.718953+0000","last_peered":"2023-10-10T21:02:19.718953+0000","last_clean":"2023-10-10T21:02:19.718953+0000","last_became_active":"2023-10-10T21:02:19.713645+0000","last_became_peered":"2023-10-10T21:02:19.713645+0000","last_unstale":"2023-10-10T21:02:19.718953+0000","last_undegraded":"2023-10-10T21:02:19.718953+0000","last_fullsized":"2023-10-10T21:02:19.718953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:07:28.315895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.713989+0000","last_change":"2023-10-10T21:02:18.699045+0000","last_active":"2023-10-10T21:02:19.713989+0000","last_peered":"2023-10-10T21:02:19.713989+0000","last_clean":"2023-10-10T21:02:19.713989+0000","last_became_active":"2023-10-10T21:02:18.698700+0000","last_became_peered":"2023-10-10T21:02:18.698700+0000","last_unstale":"2023-10-10T21:02:19.713989+0000","last_undegraded":"2023-10-10T21:02:19.713989+0000","last_fullsized":"2023-10-10T21:02:19.713989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:59.170344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726475+0000","last_change":"2023-10-10T21:02:19.726475+0000","last_active":"2023-10-10T21:02:19.726475+0000","last_peered":"2023-10-10T21:02:19.726475+0000","last_clean":"2023-10-10T21:02:19.726475+0000","last_became_active":"2023-10-10T21:02:19.726153+0000","last_became_peered":"2023-10-10T21:02:19.726153+0000","last_unstale":"2023-10-10T21:02:19.726475+0000","last_undegraded":"2023-10-10T21:02:19.726475+0000","last_fullsized":"2023-10-10T21:02:19.726475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:11:55.480332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724879+0000","last_change":"2023-10-10T21:02:19.724879+0000","last_active":"2023-10-10T21:02:19.724879+0000","last_peered":"2023-10-10T21:02:19.724879+0000","last_clean":"2023-10-10T21:02:19.724879+0000","last_became_active":"2023-10-10T21:02:19.724304+0000","last_became_peered":"2023-10-10T21:02:19.724304+0000","last_unstale":"2023-10-10T21:02:19.724879+0000","last_undegraded":"2023-10-10T21:02:19.724879+0000","last_fullsized":"2023-10-10T21:02:19.724879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.714634+0000","last_change":"2023-10-10T21:02:19.714634+0000","last_active":"2023-10-10T21:02:19.714634+0000","last_peered":"2023-10-10T21:02:19.714634+0000","last_clean":"2023-10-10T21:02:19.714634+0000","last_became_active":"2023-10-10T21:02:19.714392+0000","last_became_peered":"2023-10-10T21:02:19.714392+0000","last_unstale":"2023-10-10T21:02:19.714634+0000","last_undegraded":"2023-10-10T21:02:19.714634+0000","last_fullsized":"2023-10-10T21:02:19.714634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:54.736869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.720937+0000","last_change":"2023-10-10T21:02:19.716446+0000","last_active":"2023-10-10T21:02:19.720937+0000","last_peered":"2023-10-10T21:02:19.720937+0000","last_clean":"2023-10-10T21:02:19.720937+0000","last_became_active":"2023-10-10T21:02:19.716149+0000","last_became_peered":"2023-10-10T21:02:19.716149+0000","last_unstale":"2023-10-10T21:02:19.720937+0000","last_undegraded":"2023-10-10T21:02:19.720937+0000","last_fullsized":"2023-10-10T21:02:19.720937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725405+0000","last_change":"2023-10-10T21:02:19.721864+0000","last_active":"2023-10-10T21:02:19.725405+0000","last_peered":"2023-10-10T21:02:19.725405+0000","last_clean":"2023-10-10T21:02:19.725405+0000","last_became_active":"2023-10-10T21:02:19.721621+0000","last_became_peered":"2023-10-10T21:02:19.721621+0000","last_unstale":"2023-10-10T21:02:19.725405+0000","last_undegraded":"2023-10-10T21:02:19.725405+0000","last_fullsized":"2023-10-10T21:02:19.725405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715529+0000","last_change":"2023-10-10T21:02:19.710748+0000","last_active":"2023-10-10T21:02:19.715529+0000","last_peered":"2023-10-10T21:02:19.715529+0000","last_clean":"2023-10-10T21:02:19.715529+0000","last_became_active":"2023-10-10T21:02:19.710448+0000","last_became_peered":"2023-10-10T21:02:19.710448+0000","last_unstale":"2023-10-10T21:02:19.715529+0000","last_undegraded":"2023-10-10T21:02:19.715529+0000","last_fullsized":"2023-10-10T21:02:19.715529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:46:22.792792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.716282+0000","last_change":"2023-10-10T21:02:19.709278+0000","last_active":"2023-10-10T21:02:19.716282+0000","last_peered":"2023-10-10T21:02:19.716282+0000","last_clean":"2023-10-10T21:02:19.716282+0000","last_became_active":"2023-10-10T21:02:19.709000+0000","last_became_peered":"2023-10-10T21:02:19.709000+0000","last_unstale":"2023-10-10T21:02:19.716282+0000","last_undegraded":"2023-10-10T21:02:19.716282+0000","last_fullsized":"2023-10-10T21:02:19.716282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718420+0000","last_change":"2023-10-10T21:02:19.718420+0000","last_active":"2023-10-10T21:02:19.718420+0000","last_peered":"2023-10-10T21:02:19.718420+0000","last_clean":"2023-10-10T21:02:19.718420+0000","last_became_active":"2023-10-10T21:02:19.718142+0000","last_became_peered":"2023-10-10T21:02:19.718142+0000","last_unstale":"2023-10-10T21:02:19.718420+0000","last_undegraded":"2023-10-10T21:02:19.718420+0000","last_fullsized":"2023-10-10T21:02:19.718420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725153+0000","last_change":"2023-10-10T21:02:19.715456+0000","last_active":"2023-10-10T21:02:19.725153+0000","last_peered":"2023-10-10T21:02:19.725153+0000","last_clean":"2023-10-10T21:02:19.725153+0000","last_became_active":"2023-10-10T21:02:19.715168+0000","last_became_peered":"2023-10-10T21:02:19.715168+0000","last_unstale":"2023-10-10T21:02:19.725153+0000","last_undegraded":"2023-10-10T21:02:19.725153+0000","last_fullsized":"2023-10-10T21:02:19.725153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:20:36.206873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721426+0000","last_change":"2023-10-10T21:02:19.715964+0000","last_active":"2023-10-10T21:02:19.721426+0000","last_peered":"2023-10-10T21:02:19.721426+0000","last_clean":"2023-10-10T21:02:19.721426+0000","last_became_active":"2023-10-10T21:02:19.715678+0000","last_became_peered":"2023-10-10T21:02:19.715678+0000","last_unstale":"2023-10-10T21:02:19.721426+0000","last_undegraded":"2023-10-10T21:02:19.721426+0000","last_fullsized":"2023-10-10T21:02:19.721426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722029+0000","last_change":"2023-10-10T21:02:19.712354+0000","last_active":"2023-10-10T21:02:19.722029+0000","last_peered":"2023-10-10T21:02:19.722029+0000","last_clean":"2023-10-10T21:02:19.722029+0000","last_became_active":"2023-10-10T21:02:19.712051+0000","last_became_peered":"2023-10-10T21:02:19.712051+0000","last_unstale":"2023-10-10T21:02:19.722029+0000","last_undegraded":"2023-10-10T21:02:19.722029+0000","last_fullsized":"2023-10-10T21:02:19.722029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:23:39.628860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718320+0000","last_change":"2023-10-10T21:02:19.713312+0000","last_active":"2023-10-10T21:02:19.718320+0000","last_peered":"2023-10-10T21:02:19.718320+0000","last_clean":"2023-10-10T21:02:19.718320+0000","last_became_active":"2023-10-10T21:02:19.712993+0000","last_became_peered":"2023-10-10T21:02:19.712993+0000","last_unstale":"2023-10-10T21:02:19.718320+0000","last_undegraded":"2023-10-10T21:02:19.718320+0000","last_fullsized":"2023-10-10T21:02:19.718320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:01:48.898002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725385+0000","last_change":"2023-10-10T21:02:19.721562+0000","last_active":"2023-10-10T21:02:19.725385+0000","last_peered":"2023-10-10T21:02:19.725385+0000","last_clean":"2023-10-10T21:02:19.725385+0000","last_became_active":"2023-10-10T21:02:19.720554+0000","last_became_peered":"2023-10-10T21:02:19.720554+0000","last_unstale":"2023-10-10T21:02:19.725385+0000","last_undegraded":"2023-10-10T21:02:19.725385+0000","last_fullsized":"2023-10-10T21:02:19.725385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718723+0000","last_change":"2023-10-10T21:02:19.718723+0000","last_active":"2023-10-10T21:02:19.718723+0000","last_peered":"2023-10-10T21:02:19.718723+0000","last_clean":"2023-10-10T21:02:19.718723+0000","last_became_active":"2023-10-10T21:02:19.718408+0000","last_became_peered":"2023-10-10T21:02:19.718408+0000","last_unstale":"2023-10-10T21:02:19.718723+0000","last_undegraded":"2023-10-10T21:02:19.718723+0000","last_fullsized":"2023-10-10T21:02:19.718723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":79778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":662876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":233472,"data_stored":78402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":831488,"data_stored":669220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":71954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":78368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":78332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.895}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.9309999999999992}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.0250000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8900000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":73490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:02:24.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:02:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.386+0000 7f03e1f9d700 1 Processor -- start 2023-10-10T21:02:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.387+0000 7f03e1f9d700 1 -- start start 2023-10-10T21:02:24.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.388+0000 7f03e1f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f03dc156310 0x7f03dc0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.388+0000 7f03e1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc1566e0 0x7f03dc0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.388+0000 7f03e1f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc0ca860 con 0x7f03dc0ca300 2023-10-10T21:02:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.388+0000 7f03e1f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc0cab40 con 0x7f03dc156310 2023-10-10T21:02:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.388+0000 7f03e1f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0cae20 con 0x7f03dc1566e0 2023-10-10T21:02:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.388+0000 7f03e179c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f03dc0ca300 0x7f03dc0c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39478/0 (socket says 172.21.15.154:39478) 2023-10-10T21:02:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.388+0000 7f03e179c700 1 -- 172.21.15.154:0/3737431503 learned_addr learned my addr 172.21.15.154:0/3737431503 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.388+0000 7f03e0f9b700 1 --2- 172.21.15.154:0/3737431503 >> v2:172.21.15.154:3300/0 conn(0x7f03dc156310 0x7f03dc0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.388+0000 7f03dbfff700 1 --2- 172.21.15.154:0/3737431503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc1566e0 0x7f03dc0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03db7fe700 1 -- 172.21.15.154:0/3737431503 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760437835 0 0) 0x7f03dc0ca860 con 0x7f03dc0ca300 2023-10-10T21:02:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03db7fe700 1 -- 172.21.15.154:0/3737431503 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03cc003570 con 0x7f03dc0ca300 2023-10-10T21:02:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03e0f9b700 1 -- 172.21.15.154:0/3737431503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc1566e0 msgr2=0x7f03dc0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03e0f9b700 1 --2- 172.21.15.154:0/3737431503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc1566e0 0x7f03dc0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03e0f9b700 1 -- 172.21.15.154:0/3737431503 >> v1:172.21.15.154:6789/0 conn(0x7f03dc0ca300 legacy=0x7f03dc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03e0f9b700 1 -- 172.21.15.154:0/3737431503 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc0cb100 con 0x7f03dc156310 2023-10-10T21:02:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03e0f9b700 1 --2- 172.21.15.154:0/3737431503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc156310 0x7f03dc0c9dc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f03d00098e0 tx=0x7f03d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8346ff1ec714ac84 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03db7fe700 1 -- 172.21.15.154:0/3737431503 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0011630 con 0x7f03dc156310 2023-10-10T21:02:24.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03db7fe700 1 -- 172.21.15.154:0/3737431503 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d0011790 con 0x7f03dc156310 2023-10-10T21:02:24.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.389+0000 7f03db7fe700 1 -- 172.21.15.154:0/3737431503 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0011b30 con 0x7f03dc156310 2023-10-10T21:02:24.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.390+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3737431503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc156310 msgr2=0x7f03dc0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.390+0000 7f03e1f9d700 1 --2- 172.21.15.154:0/3737431503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc156310 0x7f03dc0c9dc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f03d00098e0 tx=0x7f03d00091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.390+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3737431503 shutdown_connections 2023-10-10T21:02:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.390+0000 7f03e1f9d700 1 --2- 172.21.15.154:0/3737431503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc156310 0x7f03dc0c9dc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.390+0000 7f03e1f9d700 1 --2- 172.21.15.154:0/3737431503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc1566e0 0x7f03dc0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.390+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3737431503 >> 172.21.15.154:0/3737431503 conn(0x7f03dc0cc1f0 msgr2=0x7f03dc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.390+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3737431503 shutdown_connections 2023-10-10T21:02:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.390+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3737431503 wait complete. 2023-10-10T21:02:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.391+0000 7f03e1f9d700 1 Processor -- start 2023-10-10T21:02:24.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.391+0000 7f03e1f9d700 1 -- start start 2023-10-10T21:02:24.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.392+0000 7f03e1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc0ca300 0x7f03dc150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.392+0000 7f03e1f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc156310 0x7f03dc15e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.392+0000 7f03e1f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc1566e0 0x7f03dc06ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.392+0000 7f03e1f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc15dfd0 con 0x7f03dc1566e0 2023-10-10T21:02:24.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.392+0000 7f03e1f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc150550 con 0x7f03dc156310 2023-10-10T21:02:24.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.392+0000 7f03e1f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc15d400 con 0x7f03dc0ca300 2023-10-10T21:02:24.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e179c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc1566e0 0x7f03dc06ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e179c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc1566e0 0x7f03dc06ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60164/0 (socket says 172.21.15.154:60164) 2023-10-10T21:02:24.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e179c700 1 -- 172.21.15.154:0/3735445794 learned_addr learned my addr 172.21.15.154:0/3735445794 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:24.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e0f9b700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc0ca300 0x7f03dc150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03dbfff700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc156310 0x7f03dc15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e179c700 1 -- 172.21.15.154:0/3735445794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc0ca300 msgr2=0x7f03dc150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e179c700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc0ca300 0x7f03dc150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e179c700 1 -- 172.21.15.154:0/3735445794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc156310 msgr2=0x7f03dc15e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e179c700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc156310 0x7f03dc15e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e179c700 1 -- 172.21.15.154:0/3735445794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0009420 con 0x7f03dc1566e0 2023-10-10T21:02:24.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e179c700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc1566e0 0x7f03dc06ebd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03d4001460 tx=0x7f03d4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:24.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03d8ff9700 1 -- 172.21.15.154:0/3735445794 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400a890 con 0x7f03dc1566e0 2023-10-10T21:02:24.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03d8ff9700 1 -- 172.21.15.154:0/3735445794 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400a9f0 con 0x7f03dc1566e0 2023-10-10T21:02:24.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03d8ff9700 1 -- 172.21.15.154:0/3735445794 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400ad70 con 0x7f03dc1566e0 2023-10-10T21:02:24.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.393+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc15d6a0 con 0x7f03dc1566e0 2023-10-10T21:02:24.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.394+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc15dc60 con 0x7f03dc1566e0 2023-10-10T21:02:24.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.395+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc04c3c0 con 0x7f03dc1566e0 2023-10-10T21:02:24.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.395+0000 7f03d8ff9700 1 -- 172.21.15.154:0/3735445794 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03d4007300 con 0x7f03dc1566e0 2023-10-10T21:02:24.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.396+0000 7f03d8ff9700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f03c0066f30 0x7f03c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.396+0000 7f03d8ff9700 1 -- 172.21.15.154:0/3735445794 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03d4084a80 con 0x7f03dc1566e0 2023-10-10T21:02:24.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.397+0000 7f03e0f9b700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f03c0066f30 0x7f03c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.397+0000 7f03e0f9b700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f03c0066f30 0x7f03c00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f03d00091e0 tx=0x7f03d0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:24.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.400+0000 7f03d8ff9700 1 -- 172.21.15.154:0/3735445794 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03d4051bc0 con 0x7f03dc1566e0 2023-10-10T21:02:24.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.591+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03dc15e110 con 0x7f03c0066f30 2023-10-10T21:02:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.598+0000 7f03d8ff9700 1 -- 172.21.15.154:0/3735445794 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264589 (secure 0 0 0) 0x7f03dc15e110 con 0x7f03c0066f30 2023-10-10T21:02:24.603 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f03c0066f30 msgr2=0x7f03c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f03c0066f30 0x7f03c00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f03d00091e0 tx=0x7f03d0017000 comp rx=0 tx=0).stop 2023-10-10T21:02:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc1566e0 msgr2=0x7f03dc06ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc1566e0 0x7f03dc06ebd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03d4001460 tx=0x7f03d4001ae0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 shutdown_connections 2023-10-10T21:02:24.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03dc1566e0 0x7f03dc06ebd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f03c0066f30 0x7f03c00693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc0ca300 0x7f03dc150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 --2- 172.21.15.154:0/3735445794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc156310 0x7f03dc15e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.602+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 >> 172.21.15.154:0/3735445794 conn(0x7f03dc0cc1f0 msgr2=0x7f03dc0c2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:24.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.603+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 shutdown_connections 2023-10-10T21:02:24.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.603+0000 7f03e1f9d700 1 -- 172.21.15.154:0/3735445794 wait complete. 2023-10-10T21:02:24.608 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:02:24.621 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-10T21:02:23.855327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381252,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593468,"statfs":{"total":773094113280,"available":770655711232,"internally_reserved":0,"allocated":3018752,"data_stored":1792420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001066"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727081+0000","last_change":"2023-10-10T21:02:19.727081+0000","last_active":"2023-10-10T21:02:19.727081+0000","last_peered":"2023-10-10T21:02:19.727081+0000","last_clean":"2023-10-10T21:02:19.727081+0000","last_became_active":"2023-10-10T21:02:19.726754+0000","last_became_peered":"2023-10-10T21:02:19.726754+0000","last_unstale":"2023-10-10T21:02:19.727081+0000","last_undegraded":"2023-10-10T21:02:19.727081+0000","last_fullsized":"2023-10-10T21:02:19.727081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:51.819041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.729741+0000","last_change":"2023-10-10T21:02:19.728351+0000","last_active":"2023-10-10T21:02:19.729741+0000","last_peered":"2023-10-10T21:02:19.729741+0000","last_clean":"2023-10-10T21:02:19.729741+0000","last_became_active":"2023-10-10T21:02:19.728087+0000","last_became_peered":"2023-10-10T21:02:19.728087+0000","last_unstale":"2023-10-10T21:02:19.729741+0000","last_undegraded":"2023-10-10T21:02:19.729741+0000","last_fullsized":"2023-10-10T21:02:19.729741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721483+0000","last_change":"2023-10-10T21:02:19.713674+0000","last_active":"2023-10-10T21:02:19.721483+0000","last_peered":"2023-10-10T21:02:19.721483+0000","last_clean":"2023-10-10T21:02:19.721483+0000","last_became_active":"2023-10-10T21:02:19.713276+0000","last_became_peered":"2023-10-10T21:02:19.713276+0000","last_unstale":"2023-10-10T21:02:19.721483+0000","last_undegraded":"2023-10-10T21:02:19.721483+0000","last_fullsized":"2023-10-10T21:02:19.721483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:34:22.625292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717566+0000","last_change":"2023-10-10T21:02:19.710812+0000","last_active":"2023-10-10T21:02:19.717566+0000","last_peered":"2023-10-10T21:02:19.717566+0000","last_clean":"2023-10-10T21:02:19.717566+0000","last_became_active":"2023-10-10T21:02:19.710422+0000","last_became_peered":"2023-10-10T21:02:19.710422+0000","last_unstale":"2023-10-10T21:02:19.717566+0000","last_undegraded":"2023-10-10T21:02:19.717566+0000","last_fullsized":"2023-10-10T21:02:19.717566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:11:55.480332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.714401+0000","last_change":"2023-10-10T21:02:19.714401+0000","last_active":"2023-10-10T21:02:19.714401+0000","last_peered":"2023-10-10T21:02:19.714401+0000","last_clean":"2023-10-10T21:02:19.714401+0000","last_became_active":"2023-10-10T21:02:19.714045+0000","last_became_peered":"2023-10-10T21:02:19.714045+0000","last_unstale":"2023-10-10T21:02:19.714401+0000","last_undegraded":"2023-10-10T21:02:19.714401+0000","last_fullsized":"2023-10-10T21:02:19.714401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:33:01.750601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.729464+0000","last_change":"2023-10-10T21:02:19.724680+0000","last_active":"2023-10-10T21:02:19.729464+0000","last_peered":"2023-10-10T21:02:19.729464+0000","last_clean":"2023-10-10T21:02:19.729464+0000","last_became_active":"2023-10-10T21:02:19.721313+0000","last_became_peered":"2023-10-10T21:02:19.721313+0000","last_unstale":"2023-10-10T21:02:19.729464+0000","last_undegraded":"2023-10-10T21:02:19.729464+0000","last_fullsized":"2023-10-10T21:02:19.729464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722047+0000","last_change":"2023-10-10T21:02:19.722047+0000","last_active":"2023-10-10T21:02:19.722047+0000","last_peered":"2023-10-10T21:02:19.722047+0000","last_clean":"2023-10-10T21:02:19.722047+0000","last_became_active":"2023-10-10T21:02:19.721771+0000","last_became_peered":"2023-10-10T21:02:19.721771+0000","last_unstale":"2023-10-10T21:02:19.722047+0000","last_undegraded":"2023-10-10T21:02:19.722047+0000","last_fullsized":"2023-10-10T21:02:19.722047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726576+0000","last_change":"2023-10-10T21:02:19.718311+0000","last_active":"2023-10-10T21:02:19.726576+0000","last_peered":"2023-10-10T21:02:19.726576+0000","last_clean":"2023-10-10T21:02:19.726576+0000","last_became_active":"2023-10-10T21:02:19.718055+0000","last_became_peered":"2023-10-10T21:02:19.718055+0000","last_unstale":"2023-10-10T21:02:19.726576+0000","last_undegraded":"2023-10-10T21:02:19.726576+0000","last_fullsized":"2023-10-10T21:02:19.726576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:02:29.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721906+0000","last_change":"2023-10-10T21:02:19.721906+0000","last_active":"2023-10-10T21:02:19.721906+0000","last_peered":"2023-10-10T21:02:19.721906+0000","last_clean":"2023-10-10T21:02:19.721906+0000","last_became_active":"2023-10-10T21:02:19.721669+0000","last_became_peered":"2023-10-10T21:02:19.721669+0000","last_unstale":"2023-10-10T21:02:19.721906+0000","last_undegraded":"2023-10-10T21:02:19.721906+0000","last_fullsized":"2023-10-10T21:02:19.721906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:24.203380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722093+0000","last_change":"2023-10-10T21:02:19.722093+0000","last_active":"2023-10-10T21:02:19.722093+0000","last_peered":"2023-10-10T21:02:19.722093+0000","last_clean":"2023-10-10T21:02:19.722093+0000","last_became_active":"2023-10-10T21:02:19.721844+0000","last_became_peered":"2023-10-10T21:02:19.721844+0000","last_unstale":"2023-10-10T21:02:19.722093+0000","last_undegraded":"2023-10-10T21:02:19.722093+0000","last_fullsized":"2023-10-10T21:02:19.722093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721570+0000","last_change":"2023-10-10T21:02:19.721570+0000","last_active":"2023-10-10T21:02:19.721570+0000","last_peered":"2023-10-10T21:02:19.721570+0000","last_clean":"2023-10-10T21:02:19.721570+0000","last_became_active":"2023-10-10T21:02:19.721289+0000","last_became_peered":"2023-10-10T21:02:19.721289+0000","last_unstale":"2023-10-10T21:02:19.721570+0000","last_undegraded":"2023-10-10T21:02:19.721570+0000","last_fullsized":"2023-10-10T21:02:19.721570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725875+0000","last_change":"2023-10-10T21:02:19.717746+0000","last_active":"2023-10-10T21:02:19.725875+0000","last_peered":"2023-10-10T21:02:19.725875+0000","last_clean":"2023-10-10T21:02:19.725875+0000","last_became_active":"2023-10-10T21:02:19.717435+0000","last_became_peered":"2023-10-10T21:02:19.717435+0000","last_unstale":"2023-10-10T21:02:19.725875+0000","last_undegraded":"2023-10-10T21:02:19.725875+0000","last_fullsized":"2023-10-10T21:02:19.725875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:50.911075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726896+0000","last_change":"2023-10-10T21:02:19.719831+0000","last_active":"2023-10-10T21:02:19.726896+0000","last_peered":"2023-10-10T21:02:19.726896+0000","last_clean":"2023-10-10T21:02:19.726896+0000","last_became_active":"2023-10-10T21:02:19.719580+0000","last_became_peered":"2023-10-10T21:02:19.719580+0000","last_unstale":"2023-10-10T21:02:19.726896+0000","last_undegraded":"2023-10-10T21:02:19.726896+0000","last_fullsized":"2023-10-10T21:02:19.726896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:57.187854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722504+0000","last_change":"2023-10-10T21:02:19.720031+0000","last_active":"2023-10-10T21:02:19.722504+0000","last_peered":"2023-10-10T21:02:19.722504+0000","last_clean":"2023-10-10T21:02:19.722504+0000","last_became_active":"2023-10-10T21:02:19.719689+0000","last_became_peered":"2023-10-10T21:02:19.719689+0000","last_unstale":"2023-10-10T21:02:19.722504+0000","last_undegraded":"2023-10-10T21:02:19.722504+0000","last_fullsized":"2023-10-10T21:02:19.722504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:15.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.706091+0000","last_change":"2023-10-10T21:02:19.704316+0000","last_active":"2023-10-10T21:02:19.706091+0000","last_peered":"2023-10-10T21:02:19.706091+0000","last_clean":"2023-10-10T21:02:19.706091+0000","last_became_active":"2023-10-10T21:02:19.704005+0000","last_became_peered":"2023-10-10T21:02:19.704005+0000","last_unstale":"2023-10-10T21:02:19.706091+0000","last_undegraded":"2023-10-10T21:02:19.706091+0000","last_fullsized":"2023-10-10T21:02:19.706091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:15.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724555+0000","last_change":"2023-10-10T21:02:19.721535+0000","last_active":"2023-10-10T21:02:19.724555+0000","last_peered":"2023-10-10T21:02:19.724555+0000","last_clean":"2023-10-10T21:02:19.724555+0000","last_became_active":"2023-10-10T21:02:19.721252+0000","last_became_peered":"2023-10-10T21:02:19.721252+0000","last_unstale":"2023-10-10T21:02:19.724555+0000","last_undegraded":"2023-10-10T21:02:19.724555+0000","last_fullsized":"2023-10-10T21:02:19.724555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718215+0000","last_change":"2023-10-10T21:02:19.713601+0000","last_active":"2023-10-10T21:02:19.718215+0000","last_peered":"2023-10-10T21:02:19.718215+0000","last_clean":"2023-10-10T21:02:19.718215+0000","last_became_active":"2023-10-10T21:02:19.713243+0000","last_became_peered":"2023-10-10T21:02:19.713243+0000","last_unstale":"2023-10-10T21:02:19.718215+0000","last_undegraded":"2023-10-10T21:02:19.718215+0000","last_fullsized":"2023-10-10T21:02:19.718215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:33:01.750601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724421+0000","last_change":"2023-10-10T21:02:19.724421+0000","last_active":"2023-10-10T21:02:19.724421+0000","last_peered":"2023-10-10T21:02:19.724421+0000","last_clean":"2023-10-10T21:02:19.724421+0000","last_became_active":"2023-10-10T21:02:19.724172+0000","last_became_peered":"2023-10-10T21:02:19.724172+0000","last_unstale":"2023-10-10T21:02:19.724421+0000","last_undegraded":"2023-10-10T21:02:19.724421+0000","last_fullsized":"2023-10-10T21:02:19.724421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:12:42.333132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715088+0000","last_change":"2023-10-10T21:02:19.715088+0000","last_active":"2023-10-10T21:02:19.715088+0000","last_peered":"2023-10-10T21:02:19.715088+0000","last_clean":"2023-10-10T21:02:19.715088+0000","last_became_active":"2023-10-10T21:02:19.714808+0000","last_became_peered":"2023-10-10T21:02:19.714808+0000","last_unstale":"2023-10-10T21:02:19.715088+0000","last_undegraded":"2023-10-10T21:02:19.715088+0000","last_fullsized":"2023-10-10T21:02:19.715088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723560+0000","last_change":"2023-10-10T21:02:18.705916+0000","last_active":"2023-10-10T21:02:19.723560+0000","last_peered":"2023-10-10T21:02:19.723560+0000","last_clean":"2023-10-10T21:02:19.723560+0000","last_became_active":"2023-10-10T21:02:18.705673+0000","last_became_peered":"2023-10-10T21:02:18.705673+0000","last_unstale":"2023-10-10T21:02:19.723560+0000","last_undegraded":"2023-10-10T21:02:19.723560+0000","last_fullsized":"2023-10-10T21:02:19.723560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:00:07.742782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727117+0000","last_change":"2023-10-10T21:02:19.721545+0000","last_active":"2023-10-10T21:02:19.727117+0000","last_peered":"2023-10-10T21:02:19.727117+0000","last_clean":"2023-10-10T21:02:19.727117+0000","last_became_active":"2023-10-10T21:02:19.721267+0000","last_became_peered":"2023-10-10T21:02:19.721267+0000","last_unstale":"2023-10-10T21:02:19.727117+0000","last_undegraded":"2023-10-10T21:02:19.727117+0000","last_fullsized":"2023-10-10T21:02:19.727117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:36:45.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726622+0000","last_change":"2023-10-10T21:02:18.708750+0000","last_active":"2023-10-10T21:02:19.726622+0000","last_peered":"2023-10-10T21:02:19.726622+0000","last_clean":"2023-10-10T21:02:19.726622+0000","last_became_active":"2023-10-10T21:02:18.708377+0000","last_became_peered":"2023-10-10T21:02:18.708377+0000","last_unstale":"2023-10-10T21:02:19.726622+0000","last_undegraded":"2023-10-10T21:02:19.726622+0000","last_fullsized":"2023-10-10T21:02:19.726622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:41:42.908310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727729+0000","last_change":"2023-10-10T21:02:19.723005+0000","last_active":"2023-10-10T21:02:19.727729+0000","last_peered":"2023-10-10T21:02:19.727729+0000","last_clean":"2023-10-10T21:02:19.727729+0000","last_became_active":"2023-10-10T21:02:19.722761+0000","last_became_peered":"2023-10-10T21:02:19.722761+0000","last_unstale":"2023-10-10T21:02:19.727729+0000","last_undegraded":"2023-10-10T21:02:19.727729+0000","last_fullsized":"2023-10-10T21:02:19.727729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731941+0000","last_change":"2023-10-10T21:02:18.715526+0000","last_active":"2023-10-10T21:02:19.731941+0000","last_peered":"2023-10-10T21:02:19.731941+0000","last_clean":"2023-10-10T21:02:19.731941+0000","last_became_active":"2023-10-10T21:02:18.715098+0000","last_became_peered":"2023-10-10T21:02:18.715098+0000","last_unstale":"2023-10-10T21:02:19.731941+0000","last_undegraded":"2023-10-10T21:02:19.731941+0000","last_fullsized":"2023-10-10T21:02:19.731941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718973+0000","last_change":"2023-10-10T21:02:19.714549+0000","last_active":"2023-10-10T21:02:19.718973+0000","last_peered":"2023-10-10T21:02:19.718973+0000","last_clean":"2023-10-10T21:02:19.718973+0000","last_became_active":"2023-10-10T21:02:19.714241+0000","last_became_peered":"2023-10-10T21:02:19.714241+0000","last_unstale":"2023-10-10T21:02:19.718973+0000","last_undegraded":"2023-10-10T21:02:19.718973+0000","last_fullsized":"2023-10-10T21:02:19.718973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:51.819041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731925+0000","last_change":"2023-10-10T21:02:18.721479+0000","last_active":"2023-10-10T21:02:19.731925+0000","last_peered":"2023-10-10T21:02:19.731925+0000","last_clean":"2023-10-10T21:02:19.731925+0000","last_became_active":"2023-10-10T21:02:18.721197+0000","last_became_peered":"2023-10-10T21:02:18.721197+0000","last_unstale":"2023-10-10T21:02:19.731925+0000","last_undegraded":"2023-10-10T21:02:19.731925+0000","last_fullsized":"2023-10-10T21:02:19.731925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.720290+0000","last_change":"2023-10-10T21:02:19.714941+0000","last_active":"2023-10-10T21:02:19.720290+0000","last_peered":"2023-10-10T21:02:19.720290+0000","last_clean":"2023-10-10T21:02:19.720290+0000","last_became_active":"2023-10-10T21:02:19.714068+0000","last_became_peered":"2023-10-10T21:02:19.714068+0000","last_unstale":"2023-10-10T21:02:19.720290+0000","last_undegraded":"2023-10-10T21:02:19.720290+0000","last_fullsized":"2023-10-10T21:02:19.720290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:24.203380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730306+0000","last_change":"2023-10-10T21:02:18.716842+0000","last_active":"2023-10-10T21:02:19.730306+0000","last_peered":"2023-10-10T21:02:19.730306+0000","last_clean":"2023-10-10T21:02:19.730306+0000","last_became_active":"2023-10-10T21:02:18.716540+0000","last_became_peered":"2023-10-10T21:02:18.716540+0000","last_unstale":"2023-10-10T21:02:19.730306+0000","last_undegraded":"2023-10-10T21:02:19.730306+0000","last_fullsized":"2023-10-10T21:02:19.730306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:24:11.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717957+0000","last_change":"2023-10-10T21:02:19.709639+0000","last_active":"2023-10-10T21:02:19.717957+0000","last_peered":"2023-10-10T21:02:19.717957+0000","last_clean":"2023-10-10T21:02:19.717957+0000","last_became_active":"2023-10-10T21:02:19.708657+0000","last_became_peered":"2023-10-10T21:02:19.708657+0000","last_unstale":"2023-10-10T21:02:19.717957+0000","last_undegraded":"2023-10-10T21:02:19.717957+0000","last_fullsized":"2023-10-10T21:02:19.717957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:16.338945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.704272+0000","last_change":"2023-10-10T21:02:18.714042+0000","last_active":"2023-10-10T21:02:19.704272+0000","last_peered":"2023-10-10T21:02:19.704272+0000","last_clean":"2023-10-10T21:02:19.704272+0000","last_became_active":"2023-10-10T21:02:18.713460+0000","last_became_peered":"2023-10-10T21:02:18.713460+0000","last_unstale":"2023-10-10T21:02:19.704272+0000","last_undegraded":"2023-10-10T21:02:19.704272+0000","last_fullsized":"2023-10-10T21:02:19.704272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725423+0000","last_change":"2023-10-10T21:02:19.722075+0000","last_active":"2023-10-10T21:02:19.725423+0000","last_peered":"2023-10-10T21:02:19.725423+0000","last_clean":"2023-10-10T21:02:19.725423+0000","last_became_active":"2023-10-10T21:02:19.721818+0000","last_became_peered":"2023-10-10T21:02:19.721818+0000","last_unstale":"2023-10-10T21:02:19.725423+0000","last_undegraded":"2023-10-10T21:02:19.725423+0000","last_fullsized":"2023-10-10T21:02:19.725423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:39:51.766459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.701716+0000","last_change":"2023-10-10T21:02:18.713684+0000","last_active":"2023-10-10T21:02:19.701716+0000","last_peered":"2023-10-10T21:02:19.701716+0000","last_clean":"2023-10-10T21:02:19.701716+0000","last_became_active":"2023-10-10T21:02:18.712935+0000","last_became_peered":"2023-10-10T21:02:18.712935+0000","last_unstale":"2023-10-10T21:02:19.701716+0000","last_undegraded":"2023-10-10T21:02:19.701716+0000","last_fullsized":"2023-10-10T21:02:19.701716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:14.025240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727600+0000","last_change":"2023-10-10T21:02:19.724065+0000","last_active":"2023-10-10T21:02:19.727600+0000","last_peered":"2023-10-10T21:02:19.727600+0000","last_clean":"2023-10-10T21:02:19.727600+0000","last_became_active":"2023-10-10T21:02:19.723390+0000","last_became_peered":"2023-10-10T21:02:19.723390+0000","last_unstale":"2023-10-10T21:02:19.727600+0000","last_undegraded":"2023-10-10T21:02:19.727600+0000","last_fullsized":"2023-10-10T21:02:19.727600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:37:50.246896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694142+0000","last_change":"2023-10-10T21:02:18.718570+0000","last_active":"2023-10-10T21:02:19.694142+0000","last_peered":"2023-10-10T21:02:19.694142+0000","last_clean":"2023-10-10T21:02:19.694142+0000","last_became_active":"2023-10-10T21:02:18.718251+0000","last_became_peered":"2023-10-10T21:02:18.718251+0000","last_unstale":"2023-10-10T21:02:19.694142+0000","last_undegraded":"2023-10-10T21:02:19.694142+0000","last_fullsized":"2023-10-10T21:02:19.694142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:14.026617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717960+0000","last_change":"2023-10-10T21:02:19.714750+0000","last_active":"2023-10-10T21:02:19.717960+0000","last_peered":"2023-10-10T21:02:19.717960+0000","last_clean":"2023-10-10T21:02:19.717960+0000","last_became_active":"2023-10-10T21:02:19.714443+0000","last_became_peered":"2023-10-10T21:02:19.714443+0000","last_unstale":"2023-10-10T21:02:19.717960+0000","last_undegraded":"2023-10-10T21:02:19.717960+0000","last_fullsized":"2023-10-10T21:02:19.717960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.723437+0000","last_change":"2023-10-10T21:02:18.721599+0000","last_active":"2023-10-10T21:02:18.723437+0000","last_peered":"2023-10-10T21:02:18.723437+0000","last_clean":"2023-10-10T21:02:18.723437+0000","last_became_active":"2023-10-10T21:02:18.721291+0000","last_became_peered":"2023-10-10T21:02:18.721291+0000","last_unstale":"2023-10-10T21:02:18.723437+0000","last_undegraded":"2023-10-10T21:02:18.723437+0000","last_fullsized":"2023-10-10T21:02:18.723437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718109+0000","last_change":"2023-10-10T21:02:19.712154+0000","last_active":"2023-10-10T21:02:19.718109+0000","last_peered":"2023-10-10T21:02:19.718109+0000","last_clean":"2023-10-10T21:02:19.718109+0000","last_became_active":"2023-10-10T21:02:19.711878+0000","last_became_peered":"2023-10-10T21:02:19.711878+0000","last_unstale":"2023-10-10T21:02:19.718109+0000","last_undegraded":"2023-10-10T21:02:19.718109+0000","last_fullsized":"2023-10-10T21:02:19.718109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694643+0000","last_change":"2023-10-10T21:02:18.722267+0000","last_active":"2023-10-10T21:02:19.694643+0000","last_peered":"2023-10-10T21:02:19.694643+0000","last_clean":"2023-10-10T21:02:19.694643+0000","last_became_active":"2023-10-10T21:02:18.719908+0000","last_became_peered":"2023-10-10T21:02:18.719908+0000","last_unstale":"2023-10-10T21:02:19.694643+0000","last_undegraded":"2023-10-10T21:02:19.694643+0000","last_fullsized":"2023-10-10T21:02:19.694643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726172+0000","last_change":"2023-10-10T21:02:19.722369+0000","last_active":"2023-10-10T21:02:19.726172+0000","last_peered":"2023-10-10T21:02:19.726172+0000","last_clean":"2023-10-10T21:02:19.726172+0000","last_became_active":"2023-10-10T21:02:19.722113+0000","last_became_peered":"2023-10-10T21:02:19.722113+0000","last_unstale":"2023-10-10T21:02:19.726172+0000","last_undegraded":"2023-10-10T21:02:19.726172+0000","last_fullsized":"2023-10-10T21:02:19.726172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726730+0000","last_change":"2023-10-10T21:02:18.718657+0000","last_active":"2023-10-10T21:02:19.726730+0000","last_peered":"2023-10-10T21:02:19.726730+0000","last_clean":"2023-10-10T21:02:19.726730+0000","last_became_active":"2023-10-10T21:02:18.718395+0000","last_became_peered":"2023-10-10T21:02:18.718395+0000","last_unstale":"2023-10-10T21:02:19.726730+0000","last_undegraded":"2023-10-10T21:02:19.726730+0000","last_fullsized":"2023-10-10T21:02:19.726730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.716253+0000","last_change":"2023-10-10T21:02:19.705946+0000","last_active":"2023-10-10T21:02:19.716253+0000","last_peered":"2023-10-10T21:02:19.716253+0000","last_clean":"2023-10-10T21:02:19.716253+0000","last_became_active":"2023-10-10T21:02:19.705596+0000","last_became_peered":"2023-10-10T21:02:19.705596+0000","last_unstale":"2023-10-10T21:02:19.716253+0000","last_undegraded":"2023-10-10T21:02:19.716253+0000","last_fullsized":"2023-10-10T21:02:19.716253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:45.667349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727210+0000","last_change":"2023-10-10T21:02:18.712503+0000","last_active":"2023-10-10T21:02:19.727210+0000","last_peered":"2023-10-10T21:02:19.727210+0000","last_clean":"2023-10-10T21:02:19.727210+0000","last_became_active":"2023-10-10T21:02:18.712089+0000","last_became_peered":"2023-10-10T21:02:18.712089+0000","last_unstale":"2023-10-10T21:02:19.727210+0000","last_undegraded":"2023-10-10T21:02:19.727210+0000","last_fullsized":"2023-10-10T21:02:19.727210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719227+0000","last_change":"2023-10-10T21:02:19.719227+0000","last_active":"2023-10-10T21:02:19.719227+0000","last_peered":"2023-10-10T21:02:19.719227+0000","last_clean":"2023-10-10T21:02:19.719227+0000","last_became_active":"2023-10-10T21:02:19.718847+0000","last_became_peered":"2023-10-10T21:02:19.718847+0000","last_unstale":"2023-10-10T21:02:19.719227+0000","last_undegraded":"2023-10-10T21:02:19.719227+0000","last_fullsized":"2023-10-10T21:02:19.719227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:01:48.898002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723071+0000","last_change":"2023-10-10T21:02:18.704860+0000","last_active":"2023-10-10T21:02:19.723071+0000","last_peered":"2023-10-10T21:02:19.723071+0000","last_clean":"2023-10-10T21:02:19.723071+0000","last_became_active":"2023-10-10T21:02:18.704565+0000","last_became_peered":"2023-10-10T21:02:18.704565+0000","last_unstale":"2023-10-10T21:02:19.723071+0000","last_undegraded":"2023-10-10T21:02:19.723071+0000","last_fullsized":"2023-10-10T21:02:19.723071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:44.459665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722520+0000","last_change":"2023-10-10T21:02:19.720643+0000","last_active":"2023-10-10T21:02:19.722520+0000","last_peered":"2023-10-10T21:02:19.722520+0000","last_clean":"2023-10-10T21:02:19.722520+0000","last_became_active":"2023-10-10T21:02:19.720210+0000","last_became_peered":"2023-10-10T21:02:19.720210+0000","last_unstale":"2023-10-10T21:02:19.722520+0000","last_undegraded":"2023-10-10T21:02:19.722520+0000","last_fullsized":"2023-10-10T21:02:19.722520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:00.153901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694420+0000","last_change":"2023-10-10T21:02:18.713031+0000","last_active":"2023-10-10T21:02:19.694420+0000","last_peered":"2023-10-10T21:02:19.694420+0000","last_clean":"2023-10-10T21:02:19.694420+0000","last_became_active":"2023-10-10T21:02:18.712686+0000","last_became_peered":"2023-10-10T21:02:18.712686+0000","last_unstale":"2023-10-10T21:02:19.694420+0000","last_undegraded":"2023-10-10T21:02:19.694420+0000","last_fullsized":"2023-10-10T21:02:19.694420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723948+0000","last_change":"2023-10-10T21:02:19.723948+0000","last_active":"2023-10-10T21:02:19.723948+0000","last_peered":"2023-10-10T21:02:19.723948+0000","last_clean":"2023-10-10T21:02:19.723948+0000","last_became_active":"2023-10-10T21:02:19.723676+0000","last_became_peered":"2023-10-10T21:02:19.723676+0000","last_unstale":"2023-10-10T21:02:19.723948+0000","last_undegraded":"2023-10-10T21:02:19.723948+0000","last_fullsized":"2023-10-10T21:02:19.723948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:07:28.315895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.719618+0000","last_change":"2023-10-10T21:02:18.713015+0000","last_active":"2023-10-10T21:02:18.719618+0000","last_peered":"2023-10-10T21:02:18.719618+0000","last_clean":"2023-10-10T21:02:18.719618+0000","last_became_active":"2023-10-10T21:02:18.712700+0000","last_became_peered":"2023-10-10T21:02:18.712700+0000","last_unstale":"2023-10-10T21:02:18.719618+0000","last_undegraded":"2023-10-10T21:02:18.719618+0000","last_fullsized":"2023-10-10T21:02:18.719618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724648+0000","last_change":"2023-10-10T21:02:19.724648+0000","last_active":"2023-10-10T21:02:19.724648+0000","last_peered":"2023-10-10T21:02:19.724648+0000","last_clean":"2023-10-10T21:02:19.724648+0000","last_became_active":"2023-10-10T21:02:19.723407+0000","last_became_peered":"2023-10-10T21:02:19.723407+0000","last_unstale":"2023-10-10T21:02:19.724648+0000","last_undegraded":"2023-10-10T21:02:19.724648+0000","last_fullsized":"2023-10-10T21:02:19.724648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:39:51.766459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719178+0000","last_change":"2023-10-10T21:02:18.704318+0000","last_active":"2023-10-10T21:02:19.719178+0000","last_peered":"2023-10-10T21:02:19.719178+0000","last_clean":"2023-10-10T21:02:19.719178+0000","last_became_active":"2023-10-10T21:02:18.704004+0000","last_became_peered":"2023-10-10T21:02:18.704004+0000","last_unstale":"2023-10-10T21:02:19.719178+0000","last_undegraded":"2023-10-10T21:02:19.719178+0000","last_fullsized":"2023-10-10T21:02:19.719178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:41:42.908310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726963+0000","last_change":"2023-10-10T21:02:19.726963+0000","last_active":"2023-10-10T21:02:19.726963+0000","last_peered":"2023-10-10T21:02:19.726963+0000","last_clean":"2023-10-10T21:02:19.726963+0000","last_became_active":"2023-10-10T21:02:19.726624+0000","last_became_peered":"2023-10-10T21:02:19.726624+0000","last_unstale":"2023-10-10T21:02:19.726963+0000","last_undegraded":"2023-10-10T21:02:19.726963+0000","last_fullsized":"2023-10-10T21:02:19.726963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726614+0000","last_change":"2023-10-10T21:02:18.702662+0000","last_active":"2023-10-10T21:02:19.726614+0000","last_peered":"2023-10-10T21:02:19.726614+0000","last_clean":"2023-10-10T21:02:19.726614+0000","last_became_active":"2023-10-10T21:02:18.702383+0000","last_became_peered":"2023-10-10T21:02:18.702383+0000","last_unstale":"2023-10-10T21:02:19.726614+0000","last_undegraded":"2023-10-10T21:02:19.726614+0000","last_fullsized":"2023-10-10T21:02:19.726614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:44.459665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724101+0000","last_change":"2023-10-10T21:02:19.724101+0000","last_active":"2023-10-10T21:02:19.724101+0000","last_peered":"2023-10-10T21:02:19.724101+0000","last_clean":"2023-10-10T21:02:19.724101+0000","last_became_active":"2023-10-10T21:02:19.723825+0000","last_became_peered":"2023-10-10T21:02:19.723825+0000","last_unstale":"2023-10-10T21:02:19.724101+0000","last_undegraded":"2023-10-10T21:02:19.724101+0000","last_fullsized":"2023-10-10T21:02:19.724101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693103+0000","last_change":"2023-10-10T21:02:18.707721+0000","last_active":"2023-10-10T21:02:19.693103+0000","last_peered":"2023-10-10T21:02:19.693103+0000","last_clean":"2023-10-10T21:02:19.693103+0000","last_became_active":"2023-10-10T21:02:18.707316+0000","last_became_peered":"2023-10-10T21:02:18.707316+0000","last_unstale":"2023-10-10T21:02:19.693103+0000","last_undegraded":"2023-10-10T21:02:19.693103+0000","last_fullsized":"2023-10-10T21:02:19.693103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715462+0000","last_change":"2023-10-10T21:02:19.711473+0000","last_active":"2023-10-10T21:02:19.715462+0000","last_peered":"2023-10-10T21:02:19.715462+0000","last_clean":"2023-10-10T21:02:19.715462+0000","last_became_active":"2023-10-10T21:02:19.711163+0000","last_became_peered":"2023-10-10T21:02:19.711163+0000","last_unstale":"2023-10-10T21:02:19.715462+0000","last_undegraded":"2023-10-10T21:02:19.715462+0000","last_fullsized":"2023-10-10T21:02:19.715462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694353+0000","last_change":"2023-10-10T21:02:18.714506+0000","last_active":"2023-10-10T21:02:19.694353+0000","last_peered":"2023-10-10T21:02:19.694353+0000","last_clean":"2023-10-10T21:02:19.694353+0000","last_became_active":"2023-10-10T21:02:18.714083+0000","last_became_peered":"2023-10-10T21:02:18.714083+0000","last_unstale":"2023-10-10T21:02:19.694353+0000","last_undegraded":"2023-10-10T21:02:19.694353+0000","last_fullsized":"2023-10-10T21:02:19.694353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726810+0000","last_change":"2023-10-10T21:02:19.723781+0000","last_active":"2023-10-10T21:02:19.726810+0000","last_peered":"2023-10-10T21:02:19.726810+0000","last_clean":"2023-10-10T21:02:19.726810+0000","last_became_active":"2023-10-10T21:02:19.723312+0000","last_became_peered":"2023-10-10T21:02:19.723312+0000","last_unstale":"2023-10-10T21:02:19.726810+0000","last_undegraded":"2023-10-10T21:02:19.726810+0000","last_fullsized":"2023-10-10T21:02:19.726810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:36.717475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.707776+0000","last_change":"2023-10-10T21:02:19.704121+0000","last_active":"2023-10-10T21:02:19.707776+0000","last_peered":"2023-10-10T21:02:19.707776+0000","last_clean":"2023-10-10T21:02:19.707776+0000","last_became_active":"2023-10-10T21:02:19.701763+0000","last_became_peered":"2023-10-10T21:02:19.701763+0000","last_unstale":"2023-10-10T21:02:19.707776+0000","last_undegraded":"2023-10-10T21:02:19.707776+0000","last_fullsized":"2023-10-10T21:02:19.707776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.703367+0000","last_change":"2023-10-10T21:02:18.702602+0000","last_active":"2023-10-10T21:02:18.703367+0000","last_peered":"2023-10-10T21:02:18.703367+0000","last_clean":"2023-10-10T21:02:18.703367+0000","last_became_active":"2023-10-10T21:02:18.702148+0000","last_became_peered":"2023-10-10T21:02:18.702148+0000","last_unstale":"2023-10-10T21:02:18.703367+0000","last_undegraded":"2023-10-10T21:02:18.703367+0000","last_fullsized":"2023-10-10T21:02:18.703367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:24:11.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726645+0000","last_change":"2023-10-10T21:02:19.718927+0000","last_active":"2023-10-10T21:02:19.726645+0000","last_peered":"2023-10-10T21:02:19.726645+0000","last_clean":"2023-10-10T21:02:19.726645+0000","last_became_active":"2023-10-10T21:02:19.718658+0000","last_became_peered":"2023-10-10T21:02:19.718658+0000","last_unstale":"2023-10-10T21:02:19.726645+0000","last_undegraded":"2023-10-10T21:02:19.726645+0000","last_fullsized":"2023-10-10T21:02:19.726645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:45:52.552283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694494+0000","last_change":"2023-10-10T21:02:18.716187+0000","last_active":"2023-10-10T21:02:19.694494+0000","last_peered":"2023-10-10T21:02:19.694494+0000","last_clean":"2023-10-10T21:02:19.694494+0000","last_became_active":"2023-10-10T21:02:18.715942+0000","last_became_peered":"2023-10-10T21:02:18.715942+0000","last_unstale":"2023-10-10T21:02:19.694494+0000","last_undegraded":"2023-10-10T21:02:19.694494+0000","last_fullsized":"2023-10-10T21:02:19.694494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.702354+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:02:18.702354+0000","last_peered":"2023-10-10T21:02:18.702354+0000","last_clean":"2023-10-10T21:02:18.702354+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:02:18.702354+0000","last_undegraded":"2023-10-10T21:02:18.702354+0000","last_fullsized":"2023-10-10T21:02:18.702354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727440+0000","last_change":"2023-10-10T21:02:19.722786+0000","last_active":"2023-10-10T21:02:19.727440+0000","last_peered":"2023-10-10T21:02:19.727440+0000","last_clean":"2023-10-10T21:02:19.727440+0000","last_became_active":"2023-10-10T21:02:19.722544+0000","last_became_peered":"2023-10-10T21:02:19.722544+0000","last_unstale":"2023-10-10T21:02:19.727440+0000","last_undegraded":"2023-10-10T21:02:19.727440+0000","last_fullsized":"2023-10-10T21:02:19.727440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:42:20.031126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.723139+0000","last_change":"2023-10-10T21:02:18.719142+0000","last_active":"2023-10-10T21:02:18.723139+0000","last_peered":"2023-10-10T21:02:18.723139+0000","last_clean":"2023-10-10T21:02:18.723139+0000","last_became_active":"2023-10-10T21:02:18.718861+0000","last_became_peered":"2023-10-10T21:02:18.718861+0000","last_unstale":"2023-10-10T21:02:18.723139+0000","last_undegraded":"2023-10-10T21:02:18.723139+0000","last_fullsized":"2023-10-10T21:02:18.723139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.720487+0000","last_change":"2023-10-10T21:02:18.712773+0000","last_active":"2023-10-10T21:02:18.720487+0000","last_peered":"2023-10-10T21:02:18.720487+0000","last_clean":"2023-10-10T21:02:18.720487+0000","last_became_active":"2023-10-10T21:02:18.712496+0000","last_became_peered":"2023-10-10T21:02:18.712496+0000","last_unstale":"2023-10-10T21:02:18.720487+0000","last_undegraded":"2023-10-10T21:02:18.720487+0000","last_fullsized":"2023-10-10T21:02:18.720487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:09:01.161677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.706058+0000","last_change":"2023-10-10T21:02:19.702557+0000","last_active":"2023-10-10T21:02:19.706058+0000","last_peered":"2023-10-10T21:02:19.706058+0000","last_clean":"2023-10-10T21:02:19.706058+0000","last_became_active":"2023-10-10T21:02:19.702270+0000","last_became_peered":"2023-10-10T21:02:19.702270+0000","last_unstale":"2023-10-10T21:02:19.706058+0000","last_undegraded":"2023-10-10T21:02:19.706058+0000","last_fullsized":"2023-10-10T21:02:19.706058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693692+0000","last_change":"2023-10-10T21:02:18.713198+0000","last_active":"2023-10-10T21:02:19.693692+0000","last_peered":"2023-10-10T21:02:19.693692+0000","last_clean":"2023-10-10T21:02:19.693692+0000","last_became_active":"2023-10-10T21:02:18.712906+0000","last_became_peered":"2023-10-10T21:02:18.712906+0000","last_unstale":"2023-10-10T21:02:19.693692+0000","last_undegraded":"2023-10-10T21:02:19.693692+0000","last_fullsized":"2023-10-10T21:02:19.693692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715363+0000","last_change":"2023-10-10T21:02:19.707593+0000","last_active":"2023-10-10T21:02:19.715363+0000","last_peered":"2023-10-10T21:02:19.715363+0000","last_clean":"2023-10-10T21:02:19.715363+0000","last_became_active":"2023-10-10T21:02:19.706687+0000","last_became_peered":"2023-10-10T21:02:19.706687+0000","last_unstale":"2023-10-10T21:02:19.715363+0000","last_undegraded":"2023-10-10T21:02:19.715363+0000","last_fullsized":"2023-10-10T21:02:19.715363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:59:28.606720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723689+0000","last_change":"2023-10-10T21:02:18.719905+0000","last_active":"2023-10-10T21:02:19.723689+0000","last_peered":"2023-10-10T21:02:19.723689+0000","last_clean":"2023-10-10T21:02:19.723689+0000","last_became_active":"2023-10-10T21:02:18.719606+0000","last_became_peered":"2023-10-10T21:02:18.719606+0000","last_unstale":"2023-10-10T21:02:19.723689+0000","last_undegraded":"2023-10-10T21:02:19.723689+0000","last_fullsized":"2023-10-10T21:02:19.723689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722943+0000","last_change":"2023-10-10T21:02:19.720643+0000","last_active":"2023-10-10T21:02:19.722943+0000","last_peered":"2023-10-10T21:02:19.722943+0000","last_clean":"2023-10-10T21:02:19.722943+0000","last_became_active":"2023-10-10T21:02:19.720362+0000","last_became_peered":"2023-10-10T21:02:19.720362+0000","last_unstale":"2023-10-10T21:02:19.722943+0000","last_undegraded":"2023-10-10T21:02:19.722943+0000","last_fullsized":"2023-10-10T21:02:19.722943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.722988+0000","last_change":"2023-10-10T21:02:18.716964+0000","last_active":"2023-10-10T21:02:18.722988+0000","last_peered":"2023-10-10T21:02:18.722988+0000","last_clean":"2023-10-10T21:02:18.722988+0000","last_became_active":"2023-10-10T21:02:18.716502+0000","last_became_peered":"2023-10-10T21:02:18.716502+0000","last_unstale":"2023-10-10T21:02:18.722988+0000","last_undegraded":"2023-10-10T21:02:18.722988+0000","last_fullsized":"2023-10-10T21:02:18.722988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.709106+0000","last_change":"2023-10-10T21:02:19.702718+0000","last_active":"2023-10-10T21:02:19.709106+0000","last_peered":"2023-10-10T21:02:19.709106+0000","last_clean":"2023-10-10T21:02:19.709106+0000","last_became_active":"2023-10-10T21:02:19.702438+0000","last_became_peered":"2023-10-10T21:02:19.702438+0000","last_unstale":"2023-10-10T21:02:19.709106+0000","last_undegraded":"2023-10-10T21:02:19.709106+0000","last_fullsized":"2023-10-10T21:02:19.709106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:09:02.167913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693020+0000","last_change":"2023-10-10T21:02:18.719939+0000","last_active":"2023-10-10T21:02:19.693020+0000","last_peered":"2023-10-10T21:02:19.693020+0000","last_clean":"2023-10-10T21:02:19.693020+0000","last_became_active":"2023-10-10T21:02:18.719606+0000","last_became_peered":"2023-10-10T21:02:18.719606+0000","last_unstale":"2023-10-10T21:02:19.693020+0000","last_undegraded":"2023-10-10T21:02:19.693020+0000","last_fullsized":"2023-10-10T21:02:19.693020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725258+0000","last_change":"2023-10-10T21:02:19.717095+0000","last_active":"2023-10-10T21:02:19.725258+0000","last_peered":"2023-10-10T21:02:19.725258+0000","last_clean":"2023-10-10T21:02:19.725258+0000","last_became_active":"2023-10-10T21:02:19.716805+0000","last_became_peered":"2023-10-10T21:02:19.716805+0000","last_unstale":"2023-10-10T21:02:19.725258+0000","last_undegraded":"2023-10-10T21:02:19.725258+0000","last_fullsized":"2023-10-10T21:02:19.725258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:02:18.184054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693205+0000","last_change":"2023-10-10T21:02:18.711397+0000","last_active":"2023-10-10T21:02:19.693205+0000","last_peered":"2023-10-10T21:02:19.693205+0000","last_clean":"2023-10-10T21:02:19.693205+0000","last_became_active":"2023-10-10T21:02:18.710905+0000","last_became_peered":"2023-10-10T21:02:18.710905+0000","last_unstale":"2023-10-10T21:02:19.693205+0000","last_undegraded":"2023-10-10T21:02:19.693205+0000","last_fullsized":"2023-10-10T21:02:19.693205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:14.026617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727611+0000","last_change":"2023-10-10T21:02:19.724197+0000","last_active":"2023-10-10T21:02:19.727611+0000","last_peered":"2023-10-10T21:02:19.727611+0000","last_clean":"2023-10-10T21:02:19.727611+0000","last_became_active":"2023-10-10T21:02:19.723375+0000","last_became_peered":"2023-10-10T21:02:19.723375+0000","last_unstale":"2023-10-10T21:02:19.727611+0000","last_undegraded":"2023-10-10T21:02:19.727611+0000","last_fullsized":"2023-10-10T21:02:19.727611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:06.143786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731948+0000","last_change":"2023-10-10T21:02:18.717453+0000","last_active":"2023-10-10T21:02:19.731948+0000","last_peered":"2023-10-10T21:02:19.731948+0000","last_clean":"2023-10-10T21:02:19.731948+0000","last_became_active":"2023-10-10T21:02:18.716456+0000","last_became_peered":"2023-10-10T21:02:18.716456+0000","last_unstale":"2023-10-10T21:02:19.731948+0000","last_undegraded":"2023-10-10T21:02:19.731948+0000","last_fullsized":"2023-10-10T21:02:19.731948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721762+0000","last_change":"2023-10-10T21:02:19.721762+0000","last_active":"2023-10-10T21:02:19.721762+0000","last_peered":"2023-10-10T21:02:19.721762+0000","last_clean":"2023-10-10T21:02:19.721762+0000","last_became_active":"2023-10-10T21:02:19.721459+0000","last_became_peered":"2023-10-10T21:02:19.721459+0000","last_unstale":"2023-10-10T21:02:19.721762+0000","last_undegraded":"2023-10-10T21:02:19.721762+0000","last_fullsized":"2023-10-10T21:02:19.721762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-10T21:02:18.723393+0000","last_change":"2023-10-10T21:02:18.721637+0000","last_active":"2023-10-10T21:02:18.723393+0000","last_peered":"2023-10-10T21:02:18.723393+0000","last_clean":"2023-10-10T21:02:18.723393+0000","last_became_active":"2023-10-10T21:02:18.721347+0000","last_became_peered":"2023-10-10T21:02:18.721347+0000","last_unstale":"2023-10-10T21:02:18.723393+0000","last_undegraded":"2023-10-10T21:02:18.723393+0000","last_fullsized":"2023-10-10T21:02:18.723393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:14.025240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722542+0000","last_change":"2023-10-10T21:02:19.722542+0000","last_active":"2023-10-10T21:02:19.722542+0000","last_peered":"2023-10-10T21:02:19.722542+0000","last_clean":"2023-10-10T21:02:19.722542+0000","last_became_active":"2023-10-10T21:02:19.722239+0000","last_became_peered":"2023-10-10T21:02:19.722239+0000","last_unstale":"2023-10-10T21:02:19.722542+0000","last_undegraded":"2023-10-10T21:02:19.722542+0000","last_fullsized":"2023-10-10T21:02:19.722542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:38:51.453531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721282+0000","last_change":"2023-10-10T21:02:18.706830+0000","last_active":"2023-10-10T21:02:19.721282+0000","last_peered":"2023-10-10T21:02:19.721282+0000","last_clean":"2023-10-10T21:02:19.721282+0000","last_became_active":"2023-10-10T21:02:18.706545+0000","last_became_peered":"2023-10-10T21:02:18.706545+0000","last_unstale":"2023-10-10T21:02:19.721282+0000","last_undegraded":"2023-10-10T21:02:19.721282+0000","last_fullsized":"2023-10-10T21:02:19.721282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718953+0000","last_change":"2023-10-10T21:02:19.713935+0000","last_active":"2023-10-10T21:02:19.718953+0000","last_peered":"2023-10-10T21:02:19.718953+0000","last_clean":"2023-10-10T21:02:19.718953+0000","last_became_active":"2023-10-10T21:02:19.713645+0000","last_became_peered":"2023-10-10T21:02:19.713645+0000","last_unstale":"2023-10-10T21:02:19.718953+0000","last_undegraded":"2023-10-10T21:02:19.718953+0000","last_fullsized":"2023-10-10T21:02:19.718953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:07:28.315895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.713989+0000","last_change":"2023-10-10T21:02:18.699045+0000","last_active":"2023-10-10T21:02:19.713989+0000","last_peered":"2023-10-10T21:02:19.713989+0000","last_clean":"2023-10-10T21:02:19.713989+0000","last_became_active":"2023-10-10T21:02:18.698700+0000","last_became_peered":"2023-10-10T21:02:18.698700+0000","last_unstale":"2023-10-10T21:02:19.713989+0000","last_undegraded":"2023-10-10T21:02:19.713989+0000","last_fullsized":"2023-10-10T21:02:19.713989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:59.170344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726475+0000","last_change":"2023-10-10T21:02:19.726475+0000","last_active":"2023-10-10T21:02:19.726475+0000","last_peered":"2023-10-10T21:02:19.726475+0000","last_clean":"2023-10-10T21:02:19.726475+0000","last_became_active":"2023-10-10T21:02:19.726153+0000","last_became_peered":"2023-10-10T21:02:19.726153+0000","last_unstale":"2023-10-10T21:02:19.726475+0000","last_undegraded":"2023-10-10T21:02:19.726475+0000","last_fullsized":"2023-10-10T21:02:19.726475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:11:55.480332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724879+0000","last_change":"2023-10-10T21:02:19.724879+0000","last_active":"2023-10-10T21:02:19.724879+0000","last_peered":"2023-10-10T21:02:19.724879+0000","last_clean":"2023-10-10T21:02:19.724879+0000","last_became_active":"2023-10-10T21:02:19.724304+0000","last_became_peered":"2023-10-10T21:02:19.724304+0000","last_unstale":"2023-10-10T21:02:19.724879+0000","last_undegraded":"2023-10-10T21:02:19.724879+0000","last_fullsized":"2023-10-10T21:02:19.724879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.714634+0000","last_change":"2023-10-10T21:02:19.714634+0000","last_active":"2023-10-10T21:02:19.714634+0000","last_peered":"2023-10-10T21:02:19.714634+0000","last_clean":"2023-10-10T21:02:19.714634+0000","last_became_active":"2023-10-10T21:02:19.714392+0000","last_became_peered":"2023-10-10T21:02:19.714392+0000","last_unstale":"2023-10-10T21:02:19.714634+0000","last_undegraded":"2023-10-10T21:02:19.714634+0000","last_fullsized":"2023-10-10T21:02:19.714634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:54.736869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.720937+0000","last_change":"2023-10-10T21:02:19.716446+0000","last_active":"2023-10-10T21:02:19.720937+0000","last_peered":"2023-10-10T21:02:19.720937+0000","last_clean":"2023-10-10T21:02:19.720937+0000","last_became_active":"2023-10-10T21:02:19.716149+0000","last_became_peered":"2023-10-10T21:02:19.716149+0000","last_unstale":"2023-10-10T21:02:19.720937+0000","last_undegraded":"2023-10-10T21:02:19.720937+0000","last_fullsized":"2023-10-10T21:02:19.720937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725405+0000","last_change":"2023-10-10T21:02:19.721864+0000","last_active":"2023-10-10T21:02:19.725405+0000","last_peered":"2023-10-10T21:02:19.725405+0000","last_clean":"2023-10-10T21:02:19.725405+0000","last_became_active":"2023-10-10T21:02:19.721621+0000","last_became_peered":"2023-10-10T21:02:19.721621+0000","last_unstale":"2023-10-10T21:02:19.725405+0000","last_undegraded":"2023-10-10T21:02:19.725405+0000","last_fullsized":"2023-10-10T21:02:19.725405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715529+0000","last_change":"2023-10-10T21:02:19.710748+0000","last_active":"2023-10-10T21:02:19.715529+0000","last_peered":"2023-10-10T21:02:19.715529+0000","last_clean":"2023-10-10T21:02:19.715529+0000","last_became_active":"2023-10-10T21:02:19.710448+0000","last_became_peered":"2023-10-10T21:02:19.710448+0000","last_unstale":"2023-10-10T21:02:19.715529+0000","last_undegraded":"2023-10-10T21:02:19.715529+0000","last_fullsized":"2023-10-10T21:02:19.715529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:46:22.792792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.716282+0000","last_change":"2023-10-10T21:02:19.709278+0000","last_active":"2023-10-10T21:02:19.716282+0000","last_peered":"2023-10-10T21:02:19.716282+0000","last_clean":"2023-10-10T21:02:19.716282+0000","last_became_active":"2023-10-10T21:02:19.709000+0000","last_became_peered":"2023-10-10T21:02:19.709000+0000","last_unstale":"2023-10-10T21:02:19.716282+0000","last_undegraded":"2023-10-10T21:02:19.716282+0000","last_fullsized":"2023-10-10T21:02:19.716282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718420+0000","last_change":"2023-10-10T21:02:19.718420+0000","last_active":"2023-10-10T21:02:19.718420+0000","last_peered":"2023-10-10T21:02:19.718420+0000","last_clean":"2023-10-10T21:02:19.718420+0000","last_became_active":"2023-10-10T21:02:19.718142+0000","last_became_peered":"2023-10-10T21:02:19.718142+0000","last_unstale":"2023-10-10T21:02:19.718420+0000","last_undegraded":"2023-10-10T21:02:19.718420+0000","last_fullsized":"2023-10-10T21:02:19.718420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725153+0000","last_change":"2023-10-10T21:02:19.715456+0000","last_active":"2023-10-10T21:02:19.725153+0000","last_peered":"2023-10-10T21:02:19.725153+0000","last_clean":"2023-10-10T21:02:19.725153+0000","last_became_active":"2023-10-10T21:02:19.715168+0000","last_became_peered":"2023-10-10T21:02:19.715168+0000","last_unstale":"2023-10-10T21:02:19.725153+0000","last_undegraded":"2023-10-10T21:02:19.725153+0000","last_fullsized":"2023-10-10T21:02:19.725153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:20:36.206873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721426+0000","last_change":"2023-10-10T21:02:19.715964+0000","last_active":"2023-10-10T21:02:19.721426+0000","last_peered":"2023-10-10T21:02:19.721426+0000","last_clean":"2023-10-10T21:02:19.721426+0000","last_became_active":"2023-10-10T21:02:19.715678+0000","last_became_peered":"2023-10-10T21:02:19.715678+0000","last_unstale":"2023-10-10T21:02:19.721426+0000","last_undegraded":"2023-10-10T21:02:19.721426+0000","last_fullsized":"2023-10-10T21:02:19.721426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722029+0000","last_change":"2023-10-10T21:02:19.712354+0000","last_active":"2023-10-10T21:02:19.722029+0000","last_peered":"2023-10-10T21:02:19.722029+0000","last_clean":"2023-10-10T21:02:19.722029+0000","last_became_active":"2023-10-10T21:02:19.712051+0000","last_became_peered":"2023-10-10T21:02:19.712051+0000","last_unstale":"2023-10-10T21:02:19.722029+0000","last_undegraded":"2023-10-10T21:02:19.722029+0000","last_fullsized":"2023-10-10T21:02:19.722029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:23:39.628860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718320+0000","last_change":"2023-10-10T21:02:19.713312+0000","last_active":"2023-10-10T21:02:19.718320+0000","last_peered":"2023-10-10T21:02:19.718320+0000","last_clean":"2023-10-10T21:02:19.718320+0000","last_became_active":"2023-10-10T21:02:19.712993+0000","last_became_peered":"2023-10-10T21:02:19.712993+0000","last_unstale":"2023-10-10T21:02:19.718320+0000","last_undegraded":"2023-10-10T21:02:19.718320+0000","last_fullsized":"2023-10-10T21:02:19.718320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:01:48.898002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725385+0000","last_change":"2023-10-10T21:02:19.721562+0000","last_active":"2023-10-10T21:02:19.725385+0000","last_peered":"2023-10-10T21:02:19.725385+0000","last_clean":"2023-10-10T21:02:19.725385+0000","last_became_active":"2023-10-10T21:02:19.720554+0000","last_became_peered":"2023-10-10T21:02:19.720554+0000","last_unstale":"2023-10-10T21:02:19.725385+0000","last_undegraded":"2023-10-10T21:02:19.725385+0000","last_fullsized":"2023-10-10T21:02:19.725385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718723+0000","last_change":"2023-10-10T21:02:19.718723+0000","last_active":"2023-10-10T21:02:19.718723+0000","last_peered":"2023-10-10T21:02:19.718723+0000","last_clean":"2023-10-10T21:02:19.718723+0000","last_became_active":"2023-10-10T21:02:19.718408+0000","last_became_peered":"2023-10-10T21:02:19.718408+0000","last_unstale":"2023-10-10T21:02:19.718723+0000","last_undegraded":"2023-10-10T21:02:19.718723+0000","last_fullsized":"2023-10-10T21:02:19.718723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":79778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":662876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":233472,"data_stored":78402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":831488,"data_stored":669220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":71954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":78368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":78332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.895}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.9309999999999992}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.0250000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8900000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":73490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:02:24.627 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T21:02:24.628 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-10T21:02:24.628 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-10T21:02:24.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-10T21:02:24.630 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-10T21:02:24.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.841+0000 7f06e81ff700 1 Processor -- start 2023-10-10T21:02:24.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.841+0000 7f06e81ff700 1 -- start start 2023-10-10T21:02:24.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.842+0000 7f06e81ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e0155c10 0x7f06e0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.842+0000 7f06e81ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06e00ac230 0x7f06e00ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.842+0000 7f06e81ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e00ad930 con 0x7f06e00ccc40 2023-10-10T21:02:24.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.842+0000 7f06e81ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e00acd20 con 0x7f06e00ac230 2023-10-10T21:02:24.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e81ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00ad000 con 0x7f06e0155c10 2023-10-10T21:02:24.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e579a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06e00ac230 0x7f06e00ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e579a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06e00ac230 0x7f06e00ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60170/0 (socket says 172.21.15.154:60170) 2023-10-10T21:02:24.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e579a700 1 -- 172.21.15.154:0/2701168152 learned_addr learned my addr 172.21.15.154:0/2701168152 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:24.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e5f9b700 1 --2- 172.21.15.154:0/2701168152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e0155c10 0x7f06e0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e579a700 1 -- 172.21.15.154:0/2701168152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e0155c10 msgr2=0x7f06e0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:24.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e579a700 1 --2- 172.21.15.154:0/2701168152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e0155c10 0x7f06e0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e579a700 1 -- 172.21.15.154:0/2701168152 >> v1:172.21.15.179:6789/0 conn(0x7f06e00ccc40 legacy=0x7f06e00af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e579a700 1 -- 172.21.15.154:0/2701168152 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00ad2e0 con 0x7f06e00ac230 2023-10-10T21:02:24.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.843+0000 7f06e5f9b700 1 --2- 172.21.15.154:0/2701168152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e0155c10 0x7f06e0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:24.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.844+0000 7f06e579a700 1 --2- 172.21.15.154:0/2701168152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 0x7f06e00ac6a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06d00099b0 tx=0x7f06d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c171b33319943ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:24.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.844+0000 7f06e4f99700 1 -- 172.21.15.154:0/2701168152 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000b860 con 0x7f06e00ac230 2023-10-10T21:02:24.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.844+0000 7f06e4f99700 1 -- 172.21.15.154:0/2701168152 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000b9c0 con 0x7f06e00ac230 2023-10-10T21:02:24.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.844+0000 7f06e4f99700 1 -- 172.21.15.154:0/2701168152 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000bd60 con 0x7f06e00ac230 2023-10-10T21:02:24.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.844+0000 7f06e81ff700 1 -- 172.21.15.154:0/2701168152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 msgr2=0x7f06e00ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.844+0000 7f06e81ff700 1 --2- 172.21.15.154:0/2701168152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 0x7f06e00ac6a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06d00099b0 tx=0x7f06d0009250 comp rx=0 tx=0).stop 2023-10-10T21:02:24.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.845+0000 7f06e81ff700 1 -- 172.21.15.154:0/2701168152 shutdown_connections 2023-10-10T21:02:24.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.845+0000 7f06e81ff700 1 --2- 172.21.15.154:0/2701168152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e0155c10 0x7f06e0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.845+0000 7f06e81ff700 1 --2- 172.21.15.154:0/2701168152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 0x7f06e00ac6a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.845+0000 7f06e81ff700 1 -- 172.21.15.154:0/2701168152 >> 172.21.15.154:0/2701168152 conn(0x7f06e006a320 msgr2=0x7f06e00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:24.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.845+0000 7f06e81ff700 1 -- 172.21.15.154:0/2701168152 shutdown_connections 2023-10-10T21:02:24.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.845+0000 7f06e81ff700 1 -- 172.21.15.154:0/2701168152 wait complete. 2023-10-10T21:02:24.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.846+0000 7f06e81ff700 1 Processor -- start 2023-10-10T21:02:24.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.846+0000 7f06e81ff700 1 -- start start 2023-10-10T21:02:24.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.847+0000 7f06e81ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 0x7f06e00a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.847+0000 7f06e81ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e00ccc40 0x7f06e0146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.847+0000 7f06e81ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06e0155c10 0x7f06e0147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.847+0000 7f06e81ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00ab300 con 0x7f06e00ac230 2023-10-10T21:02:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.847+0000 7f06e81ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0169c20 con 0x7f06e0155c10 2023-10-10T21:02:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.847+0000 7f06e81ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00aa6f0 con 0x7f06e00ccc40 2023-10-10T21:02:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.847+0000 7f06e5f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 0x7f06e00a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.847+0000 7f06e5f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 0x7f06e00a7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60174/0 (socket says 172.21.15.154:60174) 2023-10-10T21:02:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.847+0000 7f06e5f9b700 1 -- 172.21.15.154:0/464818496 learned_addr learned my addr 172.21.15.154:0/464818496 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e579a700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e00ccc40 0x7f06e0146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e679c700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06e0155c10 0x7f06e0147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e5f9b700 1 -- 172.21.15.154:0/464818496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e00ccc40 msgr2=0x7f06e0146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e5f9b700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e00ccc40 0x7f06e0146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e5f9b700 1 -- 172.21.15.154:0/464818496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06e0155c10 msgr2=0x7f06e0147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e5f9b700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06e0155c10 0x7f06e0147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e5f9b700 1 -- 172.21.15.154:0/464818496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d00094f0 con 0x7f06e00ac230 2023-10-10T21:02:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e679c700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06e0155c10 0x7f06e0147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e5f9b700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 0x7f06e00a7c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00d860 tx=0x7f06dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06d5ffb700 1 -- 172.21.15.154:0/464818496 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0125f0 con 0x7f06e00ac230 2023-10-10T21:02:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06d5ffb700 1 -- 172.21.15.154:0/464818496 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc012750 con 0x7f06e00ac230 2023-10-10T21:02:24.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e00aa9d0 con 0x7f06e00ac230 2023-10-10T21:02:24.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06d5ffb700 1 -- 172.21.15.154:0/464818496 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc012af0 con 0x7f06e00ac230 2023-10-10T21:02:24.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.848+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e00aaf90 con 0x7f06e00ac230 2023-10-10T21:02:24.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.850+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e004c3c0 con 0x7f06e00ac230 2023-10-10T21:02:24.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.850+0000 7f06d5ffb700 1 -- 172.21.15.154:0/464818496 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06dc014430 con 0x7f06e00ac230 2023-10-10T21:02:24.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.851+0000 7f06d5ffb700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:24.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.851+0000 7f06d5ffb700 1 -- 172.21.15.154:0/464818496 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06dc084900 con 0x7f06e00ac230 2023-10-10T21:02:24.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.851+0000 7f06e579a700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:24.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.852+0000 7f06e579a700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f06c4066f30 0x7f06c40693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f06d00099b0 tx=0x7f06d0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:24.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:24.855+0000 7f06d5ffb700 1 -- 172.21.15.154:0/464818496 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06dc051b70 con 0x7f06e00ac230 2023-10-10T21:02:25.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.100+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f06e00ad5c0 con 0x7f06e00ac230 2023-10-10T21:02:25.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.104+0000 7f06d5ffb700 1 -- 172.21.15.154:0/464818496 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163705 (secure 0 0 0) 0x7f06dc055190 con 0x7f06e00ac230 2023-10-10T21:02:25.107 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:25.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f06c4066f30 msgr2=0x7f06c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f06c4066f30 0x7f06c40693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f06d00099b0 tx=0x7f06d0017000 comp rx=0 tx=0).stop 2023-10-10T21:02:25.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 msgr2=0x7f06e00a7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 0x7f06e00a7c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00d860 tx=0x7f06dc008040 comp rx=0 tx=0).stop 2023-10-10T21:02:25.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 shutdown_connections 2023-10-10T21:02:25.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06e0155c10 0x7f06e0147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e00ac230 0x7f06e00a7c40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 --2- 172.21.15.154:0/464818496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06e00ccc40 0x7f06e0146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 >> 172.21.15.154:0/464818496 conn(0x7f06e006a320 msgr2=0x7f06e00c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:25.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 shutdown_connections 2023-10-10T21:02:25.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.107+0000 7f06e81ff700 1 -- 172.21.15.154:0/464818496 wait complete. 2023-10-10T21:02:25.126 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":85496},{"type":"v1","addr":"172.21.15.154:6833","nonce":85496}]},"active_addr":"172.21.15.154:6833/85496","active_change":"2023-10-10T21:02:01.840714+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2001266548}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":885917098}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2392137030}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":1040461821}]}]} 2023-10-10T21:02:25.130 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-10T21:02:25.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-10T21:02:25.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:25.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.311+0000 7fc78e3ff700 1 Processor -- start 2023-10-10T21:02:25.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.311+0000 7fc78e3ff700 1 -- start start 2023-10-10T21:02:25.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.313+0000 7fc78e3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc7880ccf90 0x7fc7880ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.313+0000 7fc78e3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7880cc300 con 0x7fc7880b1420 2023-10-10T21:02:25.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.313+0000 7fc78e3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7880ad370 con 0x7fc7880cbf30 2023-10-10T21:02:25.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.313+0000 7fc78e3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc788156bf0 con 0x7fc7880ccf90 2023-10-10T21:02:25.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.313+0000 7fc7877fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc7880b1420 0x7fc7880c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39492/0 (socket says 172.21.15.154:39492) 2023-10-10T21:02:25.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.313+0000 7fc7877fe700 1 -- 172.21.15.154:0/1613782770 learned_addr learned my addr 172.21.15.154:0/1613782770 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:25.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.313+0000 7fc78c99c700 1 --2- 172.21.15.154:0/1613782770 >> v2:172.21.15.179:3300/0 conn(0x7fc7880ccf90 0x7fc7880ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.313+0000 7fc786ffd700 1 -- 172.21.15.154:0/1613782770 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228840847 0 0) 0x7fc7880cc300 con 0x7fc7880b1420 2023-10-10T21:02:25.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.313+0000 7fc786ffd700 1 -- 172.21.15.154:0/1613782770 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc770003570 con 0x7fc7880b1420 2023-10-10T21:02:25.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.314+0000 7fc786ffd700 1 -- 172.21.15.154:0/1613782770 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348455215 0 0) 0x7fc7880ad370 con 0x7fc7880cbf30 2023-10-10T21:02:25.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.314+0000 7fc786ffd700 1 -- 172.21.15.154:0/1613782770 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7880cc300 con 0x7fc7880cbf30 2023-10-10T21:02:25.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.314+0000 7fc78c99c700 1 -- 172.21.15.154:0/1613782770 >> v1:172.21.15.179:6789/0 conn(0x7fc7880cbf30 legacy=0x7fc7880b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.314+0000 7fc78c99c700 1 -- 172.21.15.154:0/1613782770 >> v1:172.21.15.154:6789/0 conn(0x7fc7880b1420 legacy=0x7fc7880c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.314+0000 7fc78c99c700 1 -- 172.21.15.154:0/1613782770 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880ad650 con 0x7fc7880ccf90 2023-10-10T21:02:25.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.314+0000 7fc78c99c700 1 --2- 172.21.15.154:0/1613782770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7880ccf90 0x7fc7880ae410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc780009e60 tx=0x7fc780009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=153c1ae3e52494f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:25.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.314+0000 7fc786ffd700 1 -- 172.21.15.154:0/1613782770 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000e070 con 0x7fc7880ccf90 2023-10-10T21:02:25.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.314+0000 7fc786ffd700 1 -- 172.21.15.154:0/1613782770 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78000bab0 con 0x7fc7880ccf90 2023-10-10T21:02:25.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.314+0000 7fc786ffd700 1 -- 172.21.15.154:0/1613782770 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000be70 con 0x7fc7880ccf90 2023-10-10T21:02:25.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.315+0000 7fc78e3ff700 1 -- 172.21.15.154:0/1613782770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7880ccf90 msgr2=0x7fc7880ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.315+0000 7fc78e3ff700 1 --2- 172.21.15.154:0/1613782770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7880ccf90 0x7fc7880ae410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc780009e60 tx=0x7fc780009780 comp rx=0 tx=0).stop 2023-10-10T21:02:25.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.315+0000 7fc78e3ff700 1 -- 172.21.15.154:0/1613782770 shutdown_connections 2023-10-10T21:02:25.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.315+0000 7fc78e3ff700 1 --2- 172.21.15.154:0/1613782770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7880ccf90 0x7fc7880ae410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.315+0000 7fc78e3ff700 1 -- 172.21.15.154:0/1613782770 >> 172.21.15.154:0/1613782770 conn(0x7fc78806a320 msgr2=0x7fc7880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:25.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.315+0000 7fc78e3ff700 1 -- 172.21.15.154:0/1613782770 shutdown_connections 2023-10-10T21:02:25.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.315+0000 7fc78e3ff700 1 -- 172.21.15.154:0/1613782770 wait complete. 2023-10-10T21:02:25.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.316+0000 7fc78e3ff700 1 Processor -- start 2023-10-10T21:02:25.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.316+0000 7fc78e3ff700 1 -- start start 2023-10-10T21:02:25.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.317+0000 7fc78e3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7880b1420 0x7fc78816ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.317+0000 7fc78e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7880cbf30 0x7fc788144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.317+0000 7fc78e3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7880ccf90 0x7fc7880ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.317+0000 7fc78e3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880aab00 con 0x7fc7880b1420 2023-10-10T21:02:25.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.317+0000 7fc78e3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880a9ef0 con 0x7fc7880ccf90 2023-10-10T21:02:25.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.317+0000 7fc78e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880aa1d0 con 0x7fc7880cbf30 2023-10-10T21:02:25.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc787fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7880b1420 0x7fc78816ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc787fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7880b1420 0x7fc78816ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60190/0 (socket says 172.21.15.154:60190) 2023-10-10T21:02:25.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc787fff700 1 -- 172.21.15.154:0/3413223286 learned_addr learned my addr 172.21.15.154:0/3413223286 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:25.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc7877fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7880cbf30 0x7fc788144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc78c99c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7880ccf90 0x7fc7880ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc787fff700 1 -- 172.21.15.154:0/3413223286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7880cbf30 msgr2=0x7fc788144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc787fff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7880cbf30 0x7fc788144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc787fff700 1 -- 172.21.15.154:0/3413223286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7880ccf90 msgr2=0x7fc7880ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc787fff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7880ccf90 0x7fc7880ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc787fff700 1 -- 172.21.15.154:0/3413223286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780009a20 con 0x7fc7880b1420 2023-10-10T21:02:25.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.318+0000 7fc787fff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7880b1420 0x7fc78816ba40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc77800c790 tx=0x7fc778007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:25.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.319+0000 7fc76ffff700 1 -- 172.21.15.154:0/3413223286 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778010510 con 0x7fc7880b1420 2023-10-10T21:02:25.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.319+0000 7fc76ffff700 1 -- 172.21.15.154:0/3413223286 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778010670 con 0x7fc7880b1420 2023-10-10T21:02:25.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.319+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7880aa4b0 con 0x7fc7880b1420 2023-10-10T21:02:25.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.319+0000 7fc76ffff700 1 -- 172.21.15.154:0/3413223286 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778010a10 con 0x7fc7880b1420 2023-10-10T21:02:25.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.319+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78816bf80 con 0x7fc7880b1420 2023-10-10T21:02:25.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.320+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78804c3c0 con 0x7fc7880b1420 2023-10-10T21:02:25.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.321+0000 7fc76ffff700 1 -- 172.21.15.154:0/3413223286 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc77801b3b0 con 0x7fc7880b1420 2023-10-10T21:02:25.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.322+0000 7fc76ffff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.322+0000 7fc76ffff700 1 -- 172.21.15.154:0/3413223286 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc778083dd0 con 0x7fc7880b1420 2023-10-10T21:02:25.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.322+0000 7fc7877fe700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.323+0000 7fc7877fe700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc774066f30 0x7fc7740693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc77c007fd0 tx=0x7fc77c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:25.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.326+0000 7fc76ffff700 1 -- 172.21.15.154:0/3413223286 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc778051040 con 0x7fc7880b1420 2023-10-10T21:02:25.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.519+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7880aa950 con 0x7fc7880b1420 2023-10-10T21:02:25.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.520+0000 7fc76ffff700 1 -- 172.21.15.154:0/3413223286 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fc778085090 con 0x7fc7880b1420 2023-10-10T21:02:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:25.521 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:25.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc774066f30 msgr2=0x7fc7740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc774066f30 0x7fc7740693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc77c007fd0 tx=0x7fc77c009040 comp rx=0 tx=0).stop 2023-10-10T21:02:25.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7880b1420 msgr2=0x7fc78816ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7880b1420 0x7fc78816ba40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc77800c790 tx=0x7fc778007e10 comp rx=0 tx=0).stop 2023-10-10T21:02:25.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 shutdown_connections 2023-10-10T21:02:25.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7880ccf90 0x7fc7880ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7880b1420 0x7fc78816ba40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 --2- 172.21.15.154:0/3413223286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7880cbf30 0x7fc788144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 >> 172.21.15.154:0/3413223286 conn(0x7fc78806a320 msgr2=0x7fc7880ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:25.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 shutdown_connections 2023-10-10T21:02:25.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.522+0000 7fc78e3ff700 1 -- 172.21.15.154:0/3413223286 wait complete. 2023-10-10T21:02:25.541 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-10T21:02:25.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:25.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.721+0000 7f9ce739d700 1 Processor -- start 2023-10-10T21:02:25.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.721+0000 7f9ce739d700 1 -- start start 2023-10-10T21:02:25.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.722+0000 7f9ce739d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ce0159420 0x7f9ce00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.722+0000 7f9ce739d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce015d230 0x7f9ce015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.722+0000 7f9ce739d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce00b2980 con 0x7f9ce01597f0 2023-10-10T21:02:25.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.722+0000 7f9ce739d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce015dbb0 con 0x7f9ce0159420 2023-10-10T21:02:25.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.722+0000 7f9ce739d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce00b11d0 con 0x7f9ce015d230 2023-10-10T21:02:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.723+0000 7f9ce639b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ce0159420 0x7f9ce00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.723+0000 7f9ce639b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ce0159420 0x7f9ce00b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60194/0 (socket says 172.21.15.154:60194) 2023-10-10T21:02:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.723+0000 7f9ce639b700 1 -- 172.21.15.154:0/2038315700 learned_addr learned my addr 172.21.15.154:0/2038315700 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:25.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.723+0000 7f9ce6b9c700 1 --2- 172.21.15.154:0/2038315700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce015d230 0x7f9ce015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.723+0000 7f9ce639b700 1 -- 172.21.15.154:0/2038315700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce015d230 msgr2=0x7f9ce015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:25.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.723+0000 7f9ce639b700 1 --2- 172.21.15.154:0/2038315700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce015d230 0x7f9ce015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.723+0000 7f9ce639b700 1 -- 172.21.15.154:0/2038315700 >> v1:172.21.15.179:6789/0 conn(0x7f9ce01597f0 legacy=0x7f9ce00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.723+0000 7f9ce639b700 1 -- 172.21.15.154:0/2038315700 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce00b14b0 con 0x7f9ce0159420 2023-10-10T21:02:25.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.723+0000 7f9ce639b700 1 --2- 172.21.15.154:0/2038315700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce0159420 0x7f9ce00b5f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0099b0 tx=0x7f9cdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2eb87663e6a559 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:25.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce5399700 1 -- 172.21.15.154:0/2038315700 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc00b860 con 0x7f9ce0159420 2023-10-10T21:02:25.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce5399700 1 -- 172.21.15.154:0/2038315700 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc00b9c0 con 0x7f9ce0159420 2023-10-10T21:02:25.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce5399700 1 -- 172.21.15.154:0/2038315700 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc00bd60 con 0x7f9ce0159420 2023-10-10T21:02:25.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce739d700 1 -- 172.21.15.154:0/2038315700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce0159420 msgr2=0x7f9ce00b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce739d700 1 --2- 172.21.15.154:0/2038315700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce0159420 0x7f9ce00b5f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0099b0 tx=0x7f9cdc009250 comp rx=0 tx=0).stop 2023-10-10T21:02:25.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce739d700 1 -- 172.21.15.154:0/2038315700 shutdown_connections 2023-10-10T21:02:25.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce739d700 1 --2- 172.21.15.154:0/2038315700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce015d230 0x7f9ce015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce739d700 1 --2- 172.21.15.154:0/2038315700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce0159420 0x7f9ce00b5f40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce739d700 1 -- 172.21.15.154:0/2038315700 >> 172.21.15.154:0/2038315700 conn(0x7f9ce00d0660 msgr2=0x7f9ce00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:25.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce739d700 1 -- 172.21.15.154:0/2038315700 shutdown_connections 2023-10-10T21:02:25.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.724+0000 7f9ce739d700 1 -- 172.21.15.154:0/2038315700 wait complete. 2023-10-10T21:02:25.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.726+0000 7f9ce739d700 1 Processor -- start 2023-10-10T21:02:25.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.726+0000 7f9ce739d700 1 -- start start 2023-10-10T21:02:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce739d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce0159420 0x7f9ce00c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce739d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce01597f0 0x7f9ce00cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce739d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce015d230 0x7f9ce00cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce739d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce00c9020 con 0x7f9ce01597f0 2023-10-10T21:02:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce739d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce00c8650 con 0x7f9ce015d230 2023-10-10T21:02:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce739d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce00cbd00 con 0x7f9ce0159420 2023-10-10T21:02:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce5b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce01597f0 0x7f9ce00cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce5b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce01597f0 0x7f9ce00cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60202/0 (socket says 172.21.15.154:60202) 2023-10-10T21:02:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce5b9a700 1 -- 172.21.15.154:0/3602707632 learned_addr learned my addr 172.21.15.154:0/3602707632 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:25.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce6b9c700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce015d230 0x7f9ce00cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce639b700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce0159420 0x7f9ce00c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce5b9a700 1 -- 172.21.15.154:0/3602707632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce0159420 msgr2=0x7f9ce00c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce5b9a700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce0159420 0x7f9ce00c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce5b9a700 1 -- 172.21.15.154:0/3602707632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce015d230 msgr2=0x7f9ce00cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce5b9a700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce015d230 0x7f9ce00cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce5b9a700 1 -- 172.21.15.154:0/3602707632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc0094f0 con 0x7f9ce01597f0 2023-10-10T21:02:25.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.727+0000 7f9ce6b9c700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce015d230 0x7f9ce00cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:25.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.728+0000 7f9ce5b9a700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce01597f0 0x7f9ce00cb280 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000c7f0 tx=0x7f9cd0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:25.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.728+0000 7f9cd67fc700 1 -- 172.21.15.154:0/3602707632 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0011590 con 0x7f9ce01597f0 2023-10-10T21:02:25.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.728+0000 7f9cd67fc700 1 -- 172.21.15.154:0/3602707632 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd00116f0 con 0x7f9ce01597f0 2023-10-10T21:02:25.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.728+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce00c7a40 con 0x7f9ce01597f0 2023-10-10T21:02:25.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.728+0000 7f9cd67fc700 1 -- 172.21.15.154:0/3602707632 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0011ab0 con 0x7f9ce01597f0 2023-10-10T21:02:25.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.728+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce00c8000 con 0x7f9ce01597f0 2023-10-10T21:02:25.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.729+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce00c8800 con 0x7f9ce01597f0 2023-10-10T21:02:25.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.730+0000 7f9cd67fc700 1 -- 172.21.15.154:0/3602707632 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cd001c440 con 0x7f9ce01597f0 2023-10-10T21:02:25.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.731+0000 7f9cd67fc700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cc4066f30 0x7f9cc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:25.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.731+0000 7f9cd67fc700 1 -- 172.21.15.154:0/3602707632 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9cd0083a80 con 0x7f9ce01597f0 2023-10-10T21:02:25.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.731+0000 7f9ce639b700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cc4066f30 0x7f9cc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:25.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.732+0000 7f9ce639b700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cc4066f30 0x7f9cc40693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0099b0 tx=0x7f9cdc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:25.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.735+0000 7f9cd67fc700 1 -- 172.21.15.154:0/3602707632 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ce00c8800 con 0x7f9ce01597f0 2023-10-10T21:02:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.930+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ce00c8800 con 0x7f9ce01597f0 2023-10-10T21:02:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.931+0000 7f9cd67fc700 1 -- 172.21.15.154:0/3602707632 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f9ce00c8800 con 0x7f9ce01597f0 2023-10-10T21:02:25.933 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:25.933 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cc4066f30 msgr2=0x7f9cc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cc4066f30 0x7f9cc40693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0099b0 tx=0x7f9cdc017000 comp rx=0 tx=0).stop 2023-10-10T21:02:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce01597f0 msgr2=0x7f9ce00cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce01597f0 0x7f9ce00cb280 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000c7f0 tx=0x7f9cd0007f50 comp rx=0 tx=0).stop 2023-10-10T21:02:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 shutdown_connections 2023-10-10T21:02:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce015d230 0x7f9ce00cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9cc4066f30 0x7f9cc40693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce0159420 0x7f9ce00c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 --2- 172.21.15.154:0/3602707632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce01597f0 0x7f9ce00cb280 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 >> 172.21.15.154:0/3602707632 conn(0x7f9ce00d0660 msgr2=0x7f9ce0069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 shutdown_connections 2023-10-10T21:02:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:25.934+0000 7f9ce739d700 1 -- 172.21.15.154:0/3602707632 wait complete. 2023-10-10T21:02:25.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-10T21:02:25.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-10T21:02:25.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-10T21:02:25.955 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-10T21:02:25.955 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-10T21:02:25.956 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-10T21:02:25.956 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-10T21:02:25.957 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-10T21:02:26.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.274+0000 7f1b14bff700 1 Processor -- start 2023-10-10T21:02:26.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.275+0000 7f1b14bff700 1 -- start start 2023-10-10T21:02:26.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.276+0000 7f527639d700 1 Processor -- start 2023-10-10T21:02:26.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.276+0000 7f527639d700 1 -- start start 2023-10-10T21:02:26.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.277+0000 7f1b14bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b10159470 0x7f1b100b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.277+0000 7f1b14bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b10159840 0x7f1b100cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.277+0000 7f1b14bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b100cddf0 con 0x7f1b1015b100 2023-10-10T21:02:26.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.277+0000 7f1b14bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1015ae90 con 0x7f1b10159470 2023-10-10T21:02:26.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.277+0000 7f1b14bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1015a680 con 0x7f1b10159840 2023-10-10T21:02:26.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.277+0000 7f1b0e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b10159470 0x7f1b100b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.278+0000 7f1b0e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b10159470 0x7f1b100b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55536/0 (socket says 172.21.15.154:55536) 2023-10-10T21:02:26.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.278+0000 7f1b0e59c700 1 -- 172.21.15.154:0/1187550605 learned_addr learned my addr 172.21.15.154:0/1187550605 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.278+0000 7f1b0dd9b700 1 --2- 172.21.15.154:0/1187550605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b10159840 0x7f1b100cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.278+0000 7f1b0dd9b700 1 -- 172.21.15.154:0/1187550605 >> v2:172.21.15.154:3300/0 conn(0x7f1b10159470 msgr2=0x7f1b100b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.278+0000 7f1b0dd9b700 1 --2- 172.21.15.154:0/1187550605 >> v2:172.21.15.154:3300/0 conn(0x7f1b10159470 0x7f1b100b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.278+0000 7f1b0dd9b700 1 -- 172.21.15.154:0/1187550605 >> v1:172.21.15.179:6789/0 conn(0x7f1b1015b100 legacy=0x7f1b100cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.278+0000 7f1b0dd9b700 1 -- 172.21.15.154:0/1187550605 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b100b5070 con 0x7f1b10159840 2023-10-10T21:02:26.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.278+0000 7f1b0e59c700 1 --2- 172.21.15.154:0/1187550605 >> v2:172.21.15.154:3300/0 conn(0x7f1b10159470 0x7f1b100b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:26.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.280+0000 7f1b0dd9b700 1 --2- 172.21.15.154:0/1187550605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b10159840 0x7f1b100cd8b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b040098e0 tx=0x7f1b040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e247de882fa9a58e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.281+0000 7f1b0d59a700 1 -- 172.21.15.154:0/1187550605 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400b640 con 0x7f1b10159840 2023-10-10T21:02:26.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.281+0000 7f1b0d59a700 1 -- 172.21.15.154:0/1187550605 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400b7a0 con 0x7f1b10159840 2023-10-10T21:02:26.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.282+0000 7f1b0d59a700 1 -- 172.21.15.154:0/1187550605 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400bb40 con 0x7f1b10159840 2023-10-10T21:02:26.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.282+0000 7f1b14bff700 1 -- 172.21.15.154:0/1187550605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b10159840 msgr2=0x7f1b100cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.282+0000 7f1b14bff700 1 --2- 172.21.15.154:0/1187550605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b10159840 0x7f1b100cd8b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b040098e0 tx=0x7f1b040091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f1b14bff700 1 -- 172.21.15.154:0/1187550605 shutdown_connections 2023-10-10T21:02:26.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f1b14bff700 1 --2- 172.21.15.154:0/1187550605 >> v2:172.21.15.154:3300/0 conn(0x7f1b10159470 0x7f1b100b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f1b14bff700 1 --2- 172.21.15.154:0/1187550605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b10159840 0x7f1b100cd8b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f1b14bff700 1 -- 172.21.15.154:0/1187550605 >> 172.21.15.154:0/1187550605 conn(0x7f1b100d0ff0 msgr2=0x7f1b100ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.284+0000 7f1b14bff700 1 -- 172.21.15.154:0/1187550605 shutdown_connections 2023-10-10T21:02:26.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.279+0000 7f527639d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f526804fdf0 0x7f5268101700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.279+0000 7f527639d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52680fa810 0x7f52680069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.279+0000 7f527639d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52681049f0 con 0x7f52680fa390 2023-10-10T21:02:26.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.279+0000 7f527639d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5268053930 con 0x7f52680fa810 2023-10-10T21:02:26.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.285+0000 7f1b14bff700 1 -- 172.21.15.154:0/1187550605 wait complete. 2023-10-10T21:02:26.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.287+0000 7f1b14bff700 1 Processor -- start 2023-10-10T21:02:26.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.279+0000 7f527639d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5268007650 con 0x7f526804fdf0 2023-10-10T21:02:26.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.279+0000 7f527539b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f526804fdf0 0x7f5268101700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.279+0000 7f5274b9a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f52680fa390 0x7f5268103b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:38660/0 (socket says 172.21.15.154:38660) 2023-10-10T21:02:26.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.279+0000 7f5274b9a700 1 -- 172.21.15.154:0/1006030343 learned_addr learned my addr 172.21.15.154:0/1006030343 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:26.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.279+0000 7f5275b9c700 1 --2- 172.21.15.154:0/1006030343 >> v2:172.21.15.154:3300/0 conn(0x7f52680fa810 0x7f52680069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.280+0000 7f527539b700 1 -- 172.21.15.154:0/1006030343 >> v2:172.21.15.154:3300/0 conn(0x7f52680fa810 msgr2=0x7f52680069f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.280+0000 7f527539b700 1 --2- 172.21.15.154:0/1006030343 >> v2:172.21.15.154:3300/0 conn(0x7f52680fa810 0x7f52680069f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.280+0000 7f527539b700 1 -- 172.21.15.154:0/1006030343 >> v1:172.21.15.179:6789/0 conn(0x7f52680fa390 legacy=0x7f5268103b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.280+0000 7f527539b700 1 -- 172.21.15.154:0/1006030343 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268053270 con 0x7f526804fdf0 2023-10-10T21:02:26.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.281+0000 7f527539b700 1 --2- 172.21.15.154:0/1006030343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f526804fdf0 0x7f5268101700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5268052920 tx=0x7f526c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65328cad1e9ae10e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.282+0000 7f5267fff700 1 -- 172.21.15.154:0/1006030343 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c011630 con 0x7f526804fdf0 2023-10-10T21:02:26.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.282+0000 7f5267fff700 1 -- 172.21.15.154:0/1006030343 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c011790 con 0x7f526804fdf0 2023-10-10T21:02:26.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.282+0000 7f5267fff700 1 -- 172.21.15.154:0/1006030343 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c011b10 con 0x7f526804fdf0 2023-10-10T21:02:26.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f527639d700 1 -- 172.21.15.154:0/1006030343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f526804fdf0 msgr2=0x7f5268101700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f527639d700 1 --2- 172.21.15.154:0/1006030343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f526804fdf0 0x7f5268101700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5268052920 tx=0x7f526c009120 comp rx=0 tx=0).stop 2023-10-10T21:02:26.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f527639d700 1 -- 172.21.15.154:0/1006030343 shutdown_connections 2023-10-10T21:02:26.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f527639d700 1 --2- 172.21.15.154:0/1006030343 >> v2:172.21.15.154:3300/0 conn(0x7f52680fa810 0x7f52680069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f527639d700 1 --2- 172.21.15.154:0/1006030343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f526804fdf0 0x7f5268101700 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f527639d700 1 -- 172.21.15.154:0/1006030343 >> 172.21.15.154:0/1006030343 conn(0x7f5268051810 msgr2=0x7f5268051c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f527639d700 1 -- 172.21.15.154:0/1006030343 shutdown_connections 2023-10-10T21:02:26.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.283+0000 7f527639d700 1 -- 172.21.15.154:0/1006030343 wait complete. 2023-10-10T21:02:26.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.286+0000 7f527639d700 1 Processor -- start 2023-10-10T21:02:26.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.286+0000 7f527639d700 1 -- start start 2023-10-10T21:02:26.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.287+0000 7f72013ff700 1 Processor -- start 2023-10-10T21:02:26.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.287+0000 7f72013ff700 1 -- start start 2023-10-10T21:02:26.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.288+0000 7f527639d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526804fdf0 0x7f5268037b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.288+0000 7f527639d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52680fa390 0x7f526804e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.288+0000 7f527639d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52680fa810 0x7f5268034db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.288+0000 7f527639d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5268039c50 con 0x7f526804fdf0 2023-10-10T21:02:26.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.288+0000 7f527639d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5268038720 con 0x7f52680fa390 2023-10-10T21:02:26.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.288+0000 7f527639d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526803a4d0 con 0x7f52680fa810 2023-10-10T21:02:26.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.289+0000 7f5275b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52680fa810 0x7f5268034db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.289+0000 7f5275b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52680fa810 0x7f5268034db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58612/0 (socket says 172.21.15.154:58612) 2023-10-10T21:02:26.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.289+0000 7f5275b9c700 1 -- 172.21.15.154:0/1894124141 learned_addr learned my addr 172.21.15.154:0/1894124141 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f527539b700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526804fdf0 0x7f5268037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7faeb239d700 1 Processor -- start 2023-10-10T21:02:26.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7ffad359e700 1 Processor -- start 2023-10-10T21:02:26.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f5275b9c700 1 -- 172.21.15.154:0/1894124141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52680fa390 msgr2=0x7f526804e8c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7ffad359e700 1 -- start start 2023-10-10T21:02:26.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.289+0000 7f1b14bff700 1 -- start start 2023-10-10T21:02:26.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f1b14bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b10159470 0x7f1b1006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f1b14bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b10159840 0x7f1b1014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f1b14bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b1015b100 0x7f1b1016ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f1b14bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10169890 con 0x7f1b10159840 2023-10-10T21:02:26.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f1b14bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1006f9e0 con 0x7f1b1015b100 2023-10-10T21:02:26.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f1b14bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10169ac0 con 0x7f1b10159470 2023-10-10T21:02:26.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.289+0000 7f72013ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc158c00 0x7f71fc0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.289+0000 7f72013ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71fc0c7d00 con 0x7f71fc06e290 2023-10-10T21:02:26.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.289+0000 7f72013ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71fc06f4e0 con 0x7f71fc0c7890 2023-10-10T21:02:26.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.289+0000 7f72013ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc06e6f0 con 0x7f71fc158c00 2023-10-10T21:02:26.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f71fbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f71fc06e290 0x7f71fc0ca040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38456/0 (socket says 172.21.15.154:38456) 2023-10-10T21:02:26.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f71fbfff700 1 -- 172.21.15.154:0/4207534527 learned_addr learned my addr 172.21.15.154:0/4207534527 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:26.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f1b0dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b10159840 0x7f1b1014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f5275b9c700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52680fa390 0x7f526804e8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f1b0dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b10159840 0x7f1b1014bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55550/0 (socket says 172.21.15.154:55550) 2023-10-10T21:02:26.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f1b0dd9b700 1 -- 172.21.15.154:0/2830587583 learned_addr learned my addr 172.21.15.154:0/2830587583 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f1b0dd9b700 1 -- 172.21.15.154:0/2830587583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b10159470 msgr2=0x7f1b1006f4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f1b0dd9b700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b10159470 0x7f1b1006f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f1b0dd9b700 1 -- 172.21.15.154:0/2830587583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b1015b100 msgr2=0x7f1b1016ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f1b0dd9b700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b1015b100 0x7f1b1016ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f1b0dd9b700 1 -- 172.21.15.154:0/2830587583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000094f0 con 0x7f1b10159840 2023-10-10T21:02:26.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f71faffd700 1 --2- 172.21.15.154:0/4207534527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc158c00 0x7f71fc0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f71f9ffb700 1 -- 172.21.15.154:0/4207534527 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077833263 0 0) 0x7f71fc0c7d00 con 0x7f71fc06e290 2023-10-10T21:02:26.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f71f9ffb700 1 -- 172.21.15.154:0/4207534527 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e4003550 con 0x7f71fc06e290 2023-10-10T21:02:26.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f71f9ffb700 1 -- 172.21.15.154:0/4207534527 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573883908 0 0) 0x7f71fc06f4e0 con 0x7f71fc0c7890 2023-10-10T21:02:26.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7f5275b9c700 1 -- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526804fdf0 msgr2=0x7f5268037b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f71faffd700 1 -- 172.21.15.154:0/4207534527 >> v1:172.21.15.179:6789/0 conn(0x7f71fc0c7890 legacy=0x7f71fc06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f71faffd700 1 -- 172.21.15.154:0/4207534527 >> v1:172.21.15.154:6789/0 conn(0x7f71fc06e290 legacy=0x7f71fc0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7ffad359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffacc006920 0x7ffacc0e4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f71faffd700 1 -- 172.21.15.154:0/4207534527 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc06e8d0 con 0x7f71fc158c00 2023-10-10T21:02:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7f71faffd700 1 --2- 172.21.15.154:0/4207534527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc158c00 0x7f71fc0c7350 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00dd40 tx=0x7f71ec00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef1d0eb2fcefa026 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f5275b9c700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526804fdf0 0x7f5268037b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.291+0000 7f5275b9c700 1 -- 172.21.15.154:0/1894124141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c0093c0 con 0x7f52680fa810 2023-10-10T21:02:26.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7f5275b9c700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52680fa810 0x7f5268034db0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f526000e8a0 tx=0x7f5260008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7f52657fa700 1 -- 172.21.15.154:0/1894124141 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526001c450 con 0x7f52680fa810 2023-10-10T21:02:26.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7f52657fa700 1 -- 172.21.15.154:0/1894124141 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526001c5b0 con 0x7f52680fa810 2023-10-10T21:02:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7f1b0dd9b700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b10159840 0x7f1b1014bb20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b1015a7c0 tx=0x7f1b04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7f1afe7fc700 1 -- 172.21.15.154:0/2830587583 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0401bac0 con 0x7f1b10159840 2023-10-10T21:02:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.290+0000 7faeb239d700 1 -- start start 2023-10-10T21:02:26.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7faeb239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40e3f80 0x7faea40e4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7faeb239d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faea4006a40 0x7faea404ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7faeb239d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea4006fb0 con 0x7faea40ea2b0 2023-10-10T21:02:26.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7faeb239d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea4007290 con 0x7faea4006a40 2023-10-10T21:02:26.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7faeb239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea4007570 con 0x7faea40e3f80 2023-10-10T21:02:26.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7ffad359e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffacc0ea190 0x7ffacc0ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7f527539b700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f526804fdf0 0x7f5268037b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7f1b14bff700 1 -- 172.21.15.154:0/2830587583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04009420 con 0x7f1b10159840 2023-10-10T21:02:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7f1b14bff700 1 -- 172.21.15.154:0/2830587583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1016a080 con 0x7f1b10159840 2023-10-10T21:02:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7f527639d700 1 -- 172.21.15.154:0/1894124141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5268038440 con 0x7f52680fa810 2023-10-10T21:02:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7f527639d700 1 -- 172.21.15.154:0/1894124141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526803a160 con 0x7f52680fa810 2023-10-10T21:02:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7faeb139b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40e3f80 0x7faea40e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7faeb139b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40e3f80 0x7faea40e4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58636/0 (socket says 172.21.15.154:58636) 2023-10-10T21:02:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7faeb139b700 1 -- 172.21.15.154:0/3924274313 learned_addr learned my addr 172.21.15.154:0/3924274313 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7faeb0b9a700 1 --2- 172.21.15.154:0/3924274313 >> v2:172.21.15.179:3300/0 conn(0x7faea4006a40 0x7faea404ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7ffad359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0eab10 con 0x7ffacc0e3e60 2023-10-10T21:02:26.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7ffad359e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc006e90 con 0x7ffacc0ea190 2023-10-10T21:02:26.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7f71f9ffb700 1 -- 172.21.15.154:0/4207534527 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec012070 con 0x7f71fc158c00 2023-10-10T21:02:26.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7f71f9ffb700 1 -- 172.21.15.154:0/4207534527 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00d2e0 con 0x7f71fc158c00 2023-10-10T21:02:26.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7f72013ff700 1 -- 172.21.15.154:0/4207534527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc158c00 msgr2=0x7f71fc0c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7f72013ff700 1 --2- 172.21.15.154:0/4207534527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc158c00 0x7f71fc0c7350 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00dd40 tx=0x7f71ec00d630 comp rx=0 tx=0).stop 2023-10-10T21:02:26.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.292+0000 7ffad359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc007170 con 0x7ffacc006920 2023-10-10T21:02:26.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7f52657fa700 1 -- 172.21.15.154:0/1894124141 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526001c450 con 0x7f52680fa810 2023-10-10T21:02:26.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7ffad259c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ffacc0e3e60 0x7ffacc04fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:38680/0 (socket says 172.21.15.154:38680) 2023-10-10T21:02:26.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7faeb0b9a700 1 -- 172.21.15.154:0/3924274313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40e3f80 msgr2=0x7faea40e4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.293+0000 7ffad259c700 1 -- 172.21.15.154:0/2720309042 learned_addr learned my addr 172.21.15.154:0/2720309042 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:26.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7ffad1d9b700 1 --2- 172.21.15.154:0/2720309042 >> v2:172.21.15.179:3300/0 conn(0x7ffacc006920 0x7ffacc0e4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7ffad2d9d700 1 --2- 172.21.15.154:0/2720309042 >> v2:172.21.15.154:3300/0 conn(0x7ffacc0ea190 0x7ffacc0ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7ffad1d9b700 1 -- 172.21.15.154:0/2720309042 >> v2:172.21.15.154:3300/0 conn(0x7ffacc0ea190 msgr2=0x7ffacc0ea5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7ffad1d9b700 1 --2- 172.21.15.154:0/2720309042 >> v2:172.21.15.154:3300/0 conn(0x7ffacc0ea190 0x7ffacc0ea5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7ffad1d9b700 1 -- 172.21.15.154:0/2720309042 >> v1:172.21.15.179:6789/0 conn(0x7ffacc0e3e60 legacy=0x7ffacc04fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7ffad1d9b700 1 -- 172.21.15.154:0/2720309042 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc007450 con 0x7ffacc006920 2023-10-10T21:02:26.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7f72013ff700 1 -- 172.21.15.154:0/4207534527 shutdown_connections 2023-10-10T21:02:26.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7f72013ff700 1 --2- 172.21.15.154:0/4207534527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc158c00 0x7f71fc0c7350 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7f72013ff700 1 -- 172.21.15.154:0/4207534527 >> 172.21.15.154:0/4207534527 conn(0x7f71fc068e20 msgr2=0x7f71fc0cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.294+0000 7ffad2d9d700 1 --2- 172.21.15.154:0/2720309042 >> v2:172.21.15.154:3300/0 conn(0x7ffacc0ea190 0x7ffacc0ea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:26.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7ffad1d9b700 1 --2- 172.21.15.154:0/2720309042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc006920 0x7ffacc0e4230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00dfd0 tx=0x7ffac40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6206511591531d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7f527639d700 1 -- 172.21.15.154:0/1894124141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52680054e0 con 0x7f52680fa810 2023-10-10T21:02:26.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7faeb0b9a700 1 --2- 172.21.15.154:0/3924274313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40e3f80 0x7faea40e4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7faea3fff700 1 -- 172.21.15.154:0/3924274313 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147387720 0 0) 0x7faea4006fb0 con 0x7faea40ea2b0 2023-10-10T21:02:26.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7faeb0b9a700 1 -- 172.21.15.154:0/3924274313 >> v1:172.21.15.179:6789/0 conn(0x7faea40ea2b0 legacy=0x7faea40e6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7faeb0b9a700 1 -- 172.21.15.154:0/3924274313 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea4007850 con 0x7faea4006a40 2023-10-10T21:02:26.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.295+0000 7ffad159a700 1 -- 172.21.15.154:0/2720309042 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4011630 con 0x7ffacc006920 2023-10-10T21:02:26.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.296+0000 7ffad159a700 1 -- 172.21.15.154:0/2720309042 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4011790 con 0x7ffacc006920 2023-10-10T21:02:26.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.296+0000 7faeb0b9a700 1 --2- 172.21.15.154:0/3924274313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea4006a40 0x7faea404ff40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faeac071b60 tx=0x7faeac066260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee351a4207fea1c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.296+0000 7faea3fff700 1 -- 172.21.15.154:0/3924274313 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac067610 con 0x7faea4006a40 2023-10-10T21:02:26.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.296+0000 7faea3fff700 1 -- 172.21.15.154:0/3924274313 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac067790 con 0x7faea4006a40 2023-10-10T21:02:26.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.296+0000 7f1b14bff700 1 -- 172.21.15.154:0/2830587583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b10088be0 con 0x7f1b10159840 2023-10-10T21:02:26.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.296+0000 7f1afe7fc700 1 -- 172.21.15.154:0/2830587583 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0401bc40 con 0x7f1b10159840 2023-10-10T21:02:26.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.296+0000 7f1afe7fc700 1 -- 172.21.15.154:0/2830587583 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04025420 con 0x7f1b10159840 2023-10-10T21:02:26.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7f1afe7fc700 1 -- 172.21.15.154:0/2830587583 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b04023070 con 0x7f1b10159840 2023-10-10T21:02:26.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7ffad359e700 1 -- 172.21.15.154:0/2720309042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc006920 msgr2=0x7ffacc0e4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7ffad359e700 1 --2- 172.21.15.154:0/2720309042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc006920 0x7ffacc0e4230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00dfd0 tx=0x7ffac40091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7faeb139b700 1 --2- 172.21.15.154:0/3924274313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40e3f80 0x7faea40e4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:26.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7faea3fff700 1 -- 172.21.15.154:0/3924274313 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0647a0 con 0x7faea4006a40 2023-10-10T21:02:26.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7faeb239d700 1 -- 172.21.15.154:0/3924274313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea4006a40 msgr2=0x7faea404ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7faeb239d700 1 --2- 172.21.15.154:0/3924274313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea4006a40 0x7faea404ff40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faeac071b60 tx=0x7faeac066260 comp rx=0 tx=0).stop 2023-10-10T21:02:26.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7f52657fa700 1 -- 172.21.15.154:0/1894124141 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f526001c720 con 0x7f52680fa810 2023-10-10T21:02:26.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7f72013ff700 1 -- 172.21.15.154:0/4207534527 shutdown_connections 2023-10-10T21:02:26.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.297+0000 7f72013ff700 1 -- 172.21.15.154:0/4207534527 wait complete. 2023-10-10T21:02:26.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.298+0000 7ffad359e700 1 -- 172.21.15.154:0/2720309042 shutdown_connections 2023-10-10T21:02:26.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.298+0000 7ffad359e700 1 --2- 172.21.15.154:0/2720309042 >> v2:172.21.15.154:3300/0 conn(0x7ffacc0ea190 0x7ffacc0ea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.298+0000 7ffad359e700 1 --2- 172.21.15.154:0/2720309042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc006920 0x7ffacc0e4230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.298+0000 7ffad359e700 1 -- 172.21.15.154:0/2720309042 >> 172.21.15.154:0/2720309042 conn(0x7ffacc054c80 msgr2=0x7ffacc055080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.298+0000 7ffad359e700 1 -- 172.21.15.154:0/2720309042 shutdown_connections 2023-10-10T21:02:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.299+0000 7f52657fa700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5254066ff0 0x7f52540694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.299+0000 7f1afe7fc700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1af0067080 0x7f1af0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.299+0000 7f52657fa700 1 -- 172.21.15.154:0/1894124141 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5260084230 con 0x7f52680fa810 2023-10-10T21:02:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.299+0000 7f52657fa700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7f525406f180 0x7f5254071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.299+0000 7f527539b700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5254066ff0 0x7f52540694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.299+0000 7f52657fa700 1 -- 172.21.15.154:0/1894124141 --> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5254071c40 con 0x7f525406f180 2023-10-10T21:02:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.299+0000 7f52657fa700 1 -- 172.21.15.154:0/1894124141 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f526001c450 con 0x7f52680fa810 2023-10-10T21:02:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.298+0000 7ffad359e700 1 -- 172.21.15.154:0/2720309042 wait complete. 2023-10-10T21:02:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.300+0000 7f5274b9a700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7f525406f180 0x7f5254071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.300+0000 7f1b0e59c700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1af0067080 0x7f1af0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.300+0000 7f5274b9a700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7f525406f180 0x7f5254071590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.301+0000 7f527539b700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5254066ff0 0x7f52540694a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f526c009390 tx=0x7f526c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.301+0000 7ffad359e700 1 Processor -- start 2023-10-10T21:02:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.299+0000 7f72013ff700 1 Processor -- start 2023-10-10T21:02:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.301+0000 7ffad359e700 1 -- start start 2023-10-10T21:02:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.301+0000 7f1b0e59c700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1af0067080 0x7f1af0069530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1b1006e430 tx=0x7f1b00009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.299+0000 7f72013ff700 1 -- start start 2023-10-10T21:02:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.301+0000 7f72013ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc06e290 0x7f71fc0a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.301+0000 7f1afe7fc700 1 -- 172.21.15.154:0/2830587583 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b04085900 con 0x7f1b10159840 2023-10-10T21:02:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.301+0000 7f72013ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc0c7890 0x7f71fc149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.301+0000 7f52657fa700 1 -- 172.21.15.154:0/1894124141 <== osd.0 v2:172.21.15.154:6805/85772 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5254071c40 con 0x7f525406f180 2023-10-10T21:02:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.302+0000 7f71faffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc06e290 0x7f71fc0a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.302+0000 7f71faffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc06e290 0x7f71fc0a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55564/0 (socket says 172.21.15.154:55564) 2023-10-10T21:02:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.302+0000 7f1afe7fc700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f1af006f210 0x7f1af0071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.302+0000 7f72013ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71fc158c00 0x7f71fc0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.302+0000 7f1afe7fc700 1 -- 172.21.15.154:0/2830587583 --> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1af0071cd0 con 0x7f1af006f210 2023-10-10T21:02:26.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.302+0000 7f1afe7fc700 1 -- 172.21.15.154:0/2830587583 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b0408a220 con 0x7f1b10159840 2023-10-10T21:02:26.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7faeb239d700 1 -- 172.21.15.154:0/3924274313 shutdown_connections 2023-10-10T21:02:26.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7faeb239d700 1 --2- 172.21.15.154:0/3924274313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40e3f80 0x7faea40e4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7faeb239d700 1 --2- 172.21.15.154:0/3924274313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea4006a40 0x7faea404ff40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7faeb239d700 1 -- 172.21.15.154:0/3924274313 >> 172.21.15.154:0/3924274313 conn(0x7faea4054da0 msgr2=0x7faea40551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7ffad359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc006920 0x7ffacc04bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7faeb239d700 1 -- 172.21.15.154:0/3924274313 shutdown_connections 2023-10-10T21:02:26.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7f1b0ed9d700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f1af006f210 0x7f1af0071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7ffad359e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc0e3e60 0x7ffacc0517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7ffad259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc006920 0x7ffacc04bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7ffad259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc006920 0x7ffacc04bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58640/0 (socket says 172.21.15.154:58640) 2023-10-10T21:02:26.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7ffad359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc0ea190 0x7ffacc0dce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7ffad359e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc038050 con 0x7ffacc0e3e60 2023-10-10T21:02:26.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7ffad359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0381e0 con 0x7ffacc0ea190 2023-10-10T21:02:26.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7ffad359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc04c270 con 0x7ffacc006920 2023-10-10T21:02:26.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7ffad259c700 1 -- 172.21.15.154:0/2624603084 learned_addr learned my addr 172.21.15.154:0/2624603084 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7ffad1d9b700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc0e3e60 0x7ffacc0517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7ffad259c700 1 -- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc0ea190 msgr2=0x7ffacc0dce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7ffad259c700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc0ea190 0x7ffacc0dce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7ffad259c700 1 -- 172.21.15.154:0/2624603084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc0e3e60 msgr2=0x7ffacc0517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7ffad259c700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc0e3e60 0x7ffacc0517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7ffad259c700 1 -- 172.21.15.154:0/2624603084 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad404c9a0 con 0x7ffacc006920 2023-10-10T21:02:26.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7f71fa7fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc0c7890 0x7f71fc149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7f71fa7fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc0c7890 0x7f71fc149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58638/0 (socket says 172.21.15.154:58638) 2023-10-10T21:02:26.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7f71fa7fc700 1 -- 172.21.15.154:0/3455093296 learned_addr learned my addr 172.21.15.154:0/3455093296 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7f72013ff700 1 -- 172.21.15.154:0/3455093296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc0c6d90 con 0x7f71fc06e290 2023-10-10T21:02:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7f72013ff700 1 -- 172.21.15.154:0/3455093296 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc0c6180 con 0x7f71fc158c00 2023-10-10T21:02:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7f72013ff700 1 -- 172.21.15.154:0/3455093296 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc0c6460 con 0x7f71fc0c7890 2023-10-10T21:02:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7f71faffd700 1 -- 172.21.15.154:0/3455093296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc0c7890 msgr2=0x7f71fc149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7f71faffd700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc0c7890 0x7f71fc149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7f71faffd700 1 -- 172.21.15.154:0/3455093296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71fc158c00 msgr2=0x7f71fc0c58e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7f71faffd700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71fc158c00 0x7f71fc0c58e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7f71faffd700 1 -- 172.21.15.154:0/3455093296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec00d8d0 con 0x7f71fc06e290 2023-10-10T21:02:26.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.304+0000 7f71faffd700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc06e290 0x7f71fc0a5df0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71ec019000 tx=0x7f71ec01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7ffad259c700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc006920 0x7ffacc04bd30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffac800c7c0 tx=0x7ffac8007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7fa1a31ff700 1 Processor -- start 2023-10-10T21:02:26.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7ffac27fc700 1 -- 172.21.15.154:0/2624603084 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8005b30 con 0x7ffacc006920 2023-10-10T21:02:26.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7ffac27fc700 1 -- 172.21.15.154:0/2624603084 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac8005c90 con 0x7ffacc006920 2023-10-10T21:02:26.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7f71e2ffd700 1 -- 172.21.15.154:0/3455093296 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00b070 con 0x7f71fc06e290 2023-10-10T21:02:26.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7f71e2ffd700 1 -- 172.21.15.154:0/3455093296 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec027e90 con 0x7f71fc06e290 2023-10-10T21:02:26.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7f71e2ffd700 1 -- 172.21.15.154:0/3455093296 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0167e0 con 0x7f71fc06e290 2023-10-10T21:02:26.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7f71fa7fc700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71fc0c7890 0x7f71fc149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:26.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7ffac27fc700 1 -- 172.21.15.154:0/2624603084 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8004a80 con 0x7ffacc006920 2023-10-10T21:02:26.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7f72013ff700 1 -- 172.21.15.154:0/3455093296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc0c6740 con 0x7f71fc06e290 2023-10-10T21:02:26.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7f1b0ed9d700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f1af006f210 0x7f1af0071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7ffad359e700 1 -- 172.21.15.154:0/2624603084 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac4009420 con 0x7ffacc006920 2023-10-10T21:02:26.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.303+0000 7faeb239d700 1 -- 172.21.15.154:0/3924274313 wait complete. 2023-10-10T21:02:26.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.305+0000 7fa1a31ff700 1 -- start start 2023-10-10T21:02:26.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.306+0000 7faeb239d700 1 Processor -- start 2023-10-10T21:02:26.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.306+0000 7ffad359e700 1 -- 172.21.15.154:0/2624603084 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc04cad0 con 0x7ffacc006920 2023-10-10T21:02:26.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.306+0000 7faeb239d700 1 -- start start 2023-10-10T21:02:26.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.307+0000 7f1afe7fc700 1 -- 172.21.15.154:0/2830587583 <== osd.1 v2:172.21.15.154:6800/85771 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1af0071cd0 con 0x7f1af006f210 2023-10-10T21:02:26.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.307+0000 7f72013ff700 1 -- 172.21.15.154:0/3455093296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc0c5e20 con 0x7f71fc06e290 2023-10-10T21:02:26.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.307+0000 7fa1a31ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159890 0x7fa19c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.307+0000 7fa1a31ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa19c159c60 0x7fa19c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.307+0000 7fa1a31ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c15a160 con 0x7fa19c15db10 2023-10-10T21:02:26.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.307+0000 7fa1a31ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c0d13a0 con 0x7fa19c159c60 2023-10-10T21:02:26.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.307+0000 7fa1a31ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c15e140 con 0x7fa19c159890 2023-10-10T21:02:26.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.308+0000 7fa1a0f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159890 0x7fa19c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.308+0000 7fa1a0f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159890 0x7fa19c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58644/0 (socket says 172.21.15.154:58644) 2023-10-10T21:02:26.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.308+0000 7fa1a0f9b700 1 -- 172.21.15.154:0/3308544579 learned_addr learned my addr 172.21.15.154:0/3308544579 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.309+0000 7f71e0ff9700 1 -- 172.21.15.154:0/3455093296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71fc04c3c0 con 0x7f71fc06e290 2023-10-10T21:02:26.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.311+0000 7f71e2ffd700 1 -- 172.21.15.154:0/3455093296 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71ec016bd0 con 0x7f71fc06e290 2023-10-10T21:02:26.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.309+0000 7faeb239d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea4006a40 0x7faea40cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.309+0000 7faeb239d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea40e3f80 0x7faea4051690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.310+0000 7faeb239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40ea2b0 0x7faea4051bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.310+0000 7faeb239d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea40cc4d0 con 0x7faea40e3f80 2023-10-10T21:02:26.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.310+0000 7faeb239d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea40d1540 con 0x7faea4006a40 2023-10-10T21:02:26.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.310+0000 7faeb1b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40ea2b0 0x7faea4051bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.310+0000 7faeb1b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40ea2b0 0x7faea4051bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58658/0 (socket says 172.21.15.154:58658) 2023-10-10T21:02:26.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.310+0000 7faeb1b9c700 1 -- 172.21.15.154:0/1360723779 learned_addr learned my addr 172.21.15.154:0/1360723779 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.310+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea40c2470 con 0x7faea40ea2b0 2023-10-10T21:02:26.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.310+0000 7ffac27fc700 1 -- 172.21.15.154:0/2624603084 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffac80070f0 con 0x7ffacc006920 2023-10-10T21:02:26.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.311+0000 7ffac27fc700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab4067000 0x7ffab40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.310+0000 7fa193fff700 1 --2- 172.21.15.154:0/3308544579 >> v2:172.21.15.179:3300/0 conn(0x7fa19c159c60 0x7fa19c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.311+0000 7fa1a0f9b700 1 -- 172.21.15.154:0/3308544579 >> v2:172.21.15.179:3300/0 conn(0x7fa19c159c60 msgr2=0x7fa19c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.311+0000 7fa1a0f9b700 1 --2- 172.21.15.154:0/3308544579 >> v2:172.21.15.179:3300/0 conn(0x7fa19c159c60 0x7fa19c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.311+0000 7fa1a0f9b700 1 -- 172.21.15.154:0/3308544579 >> v1:172.21.15.179:6789/0 conn(0x7fa19c15db10 legacy=0x7fa19c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.311+0000 7fa1a0f9b700 1 -- 172.21.15.154:0/3308544579 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c15a3d0 con 0x7fa19c159890 2023-10-10T21:02:26.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.311+0000 7fa1a0f9b700 1 --2- 172.21.15.154:0/3308544579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159890 0x7fa19c15abd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1980099b0 tx=0x7fa198009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62e7eb2b4462a920 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.309+0000 7f1fdd7ff700 1 Processor -- start 2023-10-10T21:02:26.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.311+0000 7faeb139b700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea4006a40 0x7faea40cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.309+0000 7f1fdd7ff700 1 -- start start 2023-10-10T21:02:26.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7fa1937fe700 1 -- 172.21.15.154:0/3308544579 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198009ea0 con 0x7fa19c159890 2023-10-10T21:02:26.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7fa1937fe700 1 -- 172.21.15.154:0/3308544579 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19800b820 con 0x7fa19c159890 2023-10-10T21:02:26.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7faeb0b9a700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea40e3f80 0x7faea4051690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7fa1937fe700 1 -- 172.21.15.154:0/3308544579 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19800bbc0 con 0x7fa19c159890 2023-10-10T21:02:26.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7f197b1ff700 1 Processor -- start 2023-10-10T21:02:26.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.311+0000 7f1fdd7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd81586e0 0x7f1fd80698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7f1fdd7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd806a630 con 0x7f1fd80c6f30 2023-10-10T21:02:26.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7f1fdd7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd806a910 con 0x7f1fd8158310 2023-10-10T21:02:26.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7f1fdd7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd806abf0 con 0x7f1fd81586e0 2023-10-10T21:02:26.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7f1fd67fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd81586e0 0x7f1fd80698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7f1fd67fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd81586e0 0x7f1fd80698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58666/0 (socket says 172.21.15.154:58666) 2023-10-10T21:02:26.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7f1fd67fc700 1 -- 172.21.15.154:0/2002675798 learned_addr learned my addr 172.21.15.154:0/2002675798 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7f71e2ffd700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f71e8067080 0x7f71e8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7f197b1ff700 1 -- start start 2023-10-10T21:02:26.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7fa1a31ff700 1 -- 172.21.15.154:0/3308544579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159890 msgr2=0x7fa19c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7fa1a31ff700 1 --2- 172.21.15.154:0/3308544579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159890 0x7fa19c15abd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1980099b0 tx=0x7fa198009250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7f1fd67fc700 1 -- 172.21.15.154:0/2002675798 >> v1:172.21.15.179:6789/0 conn(0x7f1fd8158310 legacy=0x7f1fd80c6820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-10T21:02:26.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7f1fd67fc700 1 -- 172.21.15.154:0/2002675798 >> v1:172.21.15.154:6789/0 conn(0x7f1fd80c6f30 legacy=0x7f1fd8069e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-10T21:02:26.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7f71e2ffd700 1 -- 172.21.15.154:0/3455093296 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71ec08db50 con 0x7f71fc06e290 2023-10-10T21:02:26.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7f71fa7fc700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f71e8067080 0x7f71e8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7ffabbfff700 1 -- 172.21.15.154:0/2624603084 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffab0000fd0 con 0x7ffacc006920 2023-10-10T21:02:26.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7f71e2ffd700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7f71e806f210 0x7f71e8071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.312+0000 7ffad1d9b700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab4067000 0x7ffab40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7ffac27fc700 1 -- 172.21.15.154:0/2624603084 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffac80838e0 con 0x7ffacc006920 2023-10-10T21:02:26.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7ffac27fc700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7ffab406f210 0x7ffab4071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7f1fd67fc700 1 -- 172.21.15.154:0/2002675798 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd806aed0 con 0x7f1fd81586e0 2023-10-10T21:02:26.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7fa1a31ff700 1 -- 172.21.15.154:0/3308544579 shutdown_connections 2023-10-10T21:02:26.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7fa1a31ff700 1 --2- 172.21.15.154:0/3308544579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159890 0x7fa19c15abd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7fa1a31ff700 1 --2- 172.21.15.154:0/3308544579 >> v2:172.21.15.179:3300/0 conn(0x7fa19c159c60 0x7fa19c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7fa1a31ff700 1 -- 172.21.15.154:0/3308544579 >> 172.21.15.154:0/3308544579 conn(0x7fa19c068e20 msgr2=0x7fa19c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7ffac27fc700 1 -- 172.21.15.154:0/2624603084 --> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffab4071cd0 con 0x7ffab406f210 2023-10-10T21:02:26.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.313+0000 7ffac27fc700 1 -- 172.21.15.154:0/2624603084 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffac8088220 con 0x7ffacc006920 2023-10-10T21:02:26.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7ffad2d9d700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7ffab406f210 0x7ffab4071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7f71e2ffd700 1 -- 172.21.15.154:0/3455093296 --> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71e8071cd0 con 0x7f71e806f210 2023-10-10T21:02:26.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7f1fd67fc700 1 --2- 172.21.15.154:0/2002675798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd81586e0 0x7f1fd80698c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc01a9e0 tx=0x7f1fcc01a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91a9e50e0b54c101 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7f71e2ffd700 1 -- 172.21.15.154:0/3455093296 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71ec00dea0 con 0x7f71fc06e290 2023-10-10T21:02:26.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f71fbfff700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7f71e806f210 0x7f71e8071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7fa1a31ff700 1 -- 172.21.15.154:0/3308544579 shutdown_connections 2023-10-10T21:02:26.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7faeb1b9c700 1 -- 172.21.15.154:0/1360723779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea4006a40 msgr2=0x7faea40cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7faeb1b9c700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea4006a40 0x7faea40cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.314+0000 7faeb1b9c700 1 -- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea40e3f80 msgr2=0x7faea4051690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7faeb1b9c700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea40e3f80 0x7faea4051690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7faeb1b9c700 1 -- 172.21.15.154:0/1360723779 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac04c9a0 con 0x7faea40ea2b0 2023-10-10T21:02:26.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7faeb0b9a700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea40e3f80 0x7faea4051690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:26.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f197b1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19740afc40 0x7f19740b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f71fa7fc700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f71e8067080 0x7f71e8069530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0a6330 tx=0x7f71f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7fa1a31ff700 1 -- 172.21.15.154:0/3308544579 wait complete. 2023-10-10T21:02:26.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f197b1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19740b0010 0x7f197415df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7faeb1b9c700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40ea2b0 0x7faea4051bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faea800c510 tx=0x7faea8007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f197b1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19740b0750 con 0x7f19740b2140 2023-10-10T21:02:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f197b1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19740aca70 con 0x7f19740b0010 2023-10-10T21:02:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f197b1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19740acd50 con 0x7f19740afc40 2023-10-10T21:02:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f197979c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19740b0010 0x7f197415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.316+0000 7f71fbfff700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7f71e806f210 0x7f71e8071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f197979c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19740b0010 0x7f197415df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55594/0 (socket says 172.21.15.154:55594) 2023-10-10T21:02:26.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7f197979c700 1 -- 172.21.15.154:0/773814353 learned_addr learned my addr 172.21.15.154:0/773814353 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.316+0000 7f197979c700 1 -- 172.21.15.154:0/773814353 >> v2:172.21.15.179:3300/0 conn(0x7f19740afc40 msgr2=0x7f19740b1c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-10T21:02:26.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.315+0000 7faea17fa700 1 -- 172.21.15.154:0/1360723779 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8011590 con 0x7faea40ea2b0 2023-10-10T21:02:26.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.316+0000 7faea17fa700 1 -- 172.21.15.154:0/1360723779 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea80116f0 con 0x7faea40ea2b0 2023-10-10T21:02:26.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.316+0000 7faea17fa700 1 -- 172.21.15.154:0/1360723779 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8011ab0 con 0x7faea40ea2b0 2023-10-10T21:02:26.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.316+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea40cc690 con 0x7faea40ea2b0 2023-10-10T21:02:26.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.316+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea40cbf10 con 0x7faea40ea2b0 2023-10-10T21:02:26.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.316+0000 7ffad1d9b700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab4067000 0x7ffab40694b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00dfd0 tx=0x7ffac4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.316+0000 7f197979c700 1 --2- 172.21.15.154:0/773814353 >> v2:172.21.15.179:3300/0 conn(0x7f19740afc40 0x7f19740b1c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.317+0000 7f197979c700 1 -- 172.21.15.154:0/773814353 >> v1:172.21.15.179:6789/0 conn(0x7f19740b2140 legacy=0x7f197415d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.317+0000 7f197979c700 1 -- 172.21.15.154:0/773814353 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19740ad030 con 0x7f19740b0010 2023-10-10T21:02:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.317+0000 7ffad2d9d700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7ffab406f210 0x7ffab4071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.317+0000 7f197979c700 1 --2- 172.21.15.154:0/773814353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19740b0010 0x7f197415df60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1974063d40 tx=0x7f1964009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ba14b1a26331db server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.317+0000 7f71e2ffd700 1 -- 172.21.15.154:0/3455093296 <== osd.2 v2:172.21.15.154:6815/85769 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f71e8071cd0 con 0x7f71e806f210 2023-10-10T21:02:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.317+0000 7f19737fe700 1 -- 172.21.15.154:0/773814353 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400b820 con 0x7f19740b0010 2023-10-10T21:02:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7fa1a31ff700 1 Processor -- start 2023-10-10T21:02:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7f19737fe700 1 -- 172.21.15.154:0/773814353 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196400b980 con 0x7f19740b0010 2023-10-10T21:02:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7f19737fe700 1 -- 172.21.15.154:0/773814353 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400bd20 con 0x7f19740b0010 2023-10-10T21:02:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faea40054e0 con 0x7faea40ea2b0 2023-10-10T21:02:26.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7f197b1ff700 1 -- 172.21.15.154:0/773814353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19740b0010 msgr2=0x7f197415df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7f197b1ff700 1 --2- 172.21.15.154:0/773814353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19740b0010 0x7f197415df60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1974063d40 tx=0x7f1964009250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7f197b1ff700 1 -- 172.21.15.154:0/773814353 shutdown_connections 2023-10-10T21:02:26.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7f197b1ff700 1 --2- 172.21.15.154:0/773814353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19740b0010 0x7f197415df60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7f197b1ff700 1 --2- 172.21.15.154:0/773814353 >> v2:172.21.15.179:3300/0 conn(0x7f19740afc40 0x7f19740b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7f197b1ff700 1 -- 172.21.15.154:0/773814353 >> 172.21.15.154:0/773814353 conn(0x7f197406a320 msgr2=0x7f19740cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7fa1a31ff700 1 -- start start 2023-10-10T21:02:26.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.317+0000 7f1fd5ffb700 1 -- 172.21.15.154:0/2002675798 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc01c820 con 0x7f1fd81586e0 2023-10-10T21:02:26.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7f1fd5ffb700 1 -- 172.21.15.154:0/2002675798 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc01c980 con 0x7f1fd81586e0 2023-10-10T21:02:26.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7f1fd5ffb700 1 -- 172.21.15.154:0/2002675798 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc01cd00 con 0x7f1fd81586e0 2023-10-10T21:02:26.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2002675798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd81586e0 msgr2=0x7f1fd80698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.318+0000 7f1fdd7ff700 1 --2- 172.21.15.154:0/2002675798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd81586e0 0x7f1fd80698c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc01a9e0 tx=0x7f1fcc01a250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2002675798 shutdown_connections 2023-10-10T21:02:26.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7f1fdd7ff700 1 --2- 172.21.15.154:0/2002675798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd81586e0 0x7f1fd80698c0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc01a9e0 tx=0x7f1fcc01a250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2002675798 >> 172.21.15.154:0/2002675798 conn(0x7f1fd80cc1e0 msgr2=0x7f1fd80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7fa1a31ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c159890 0x7fa19c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7fa1a31ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159c60 0x7fa19c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.319+0000 7f197b1ff700 1 -- 172.21.15.154:0/773814353 shutdown_connections 2023-10-10T21:02:26.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7fa1a31ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19c15db10 0x7fa19c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7fa1a0f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c159890 0x7fa19c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7fa1a0f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c159890 0x7fa19c15c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55602/0 (socket says 172.21.15.154:55602) 2023-10-10T21:02:26.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7fa1a0f9b700 1 -- 172.21.15.154:0/2363767302 learned_addr learned my addr 172.21.15.154:0/2363767302 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7f197b1ff700 1 -- 172.21.15.154:0/773814353 wait complete. 2023-10-10T21:02:26.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7fa193fff700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159c60 0x7fa19c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7fa1a31ff700 1 -- 172.21.15.154:0/2363767302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c145cc0 con 0x7fa19c159890 2023-10-10T21:02:26.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7fa1a179c700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19c15db10 0x7fa19c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7fa1a31ff700 1 -- 172.21.15.154:0/2363767302 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c146210 con 0x7fa19c15db10 2023-10-10T21:02:26.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7fa1a31ff700 1 -- 172.21.15.154:0/2363767302 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c145ad0 con 0x7fa19c159c60 2023-10-10T21:02:26.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2002675798 shutdown_connections 2023-10-10T21:02:26.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.320+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2002675798 wait complete. 2023-10-10T21:02:26.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.321+0000 7fa1a0f9b700 1 -- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159c60 msgr2=0x7fa19c15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.322+0000 7ffac27fc700 1 -- 172.21.15.154:0/2624603084 <== osd.4 v2:172.21.15.179:6800/88317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ffab4071cd0 con 0x7ffab406f210 2023-10-10T21:02:26.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.321+0000 7faea17fa700 1 -- 172.21.15.154:0/1360723779 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faea801b3b0 con 0x7faea40ea2b0 2023-10-10T21:02:26.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.322+0000 7f197b1ff700 1 Processor -- start 2023-10-10T21:02:26.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.321+0000 7fa1a0f9b700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa19c159c60 0x7fa19c15c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.322+0000 7f197b1ff700 1 -- start start 2023-10-10T21:02:26.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.321+0000 7fa1a0f9b700 1 -- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19c15db10 msgr2=0x7fa19c15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.321+0000 7fa1a0f9b700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19c15db10 0x7fa19c15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.321+0000 7fa1a0f9b700 1 -- 172.21.15.154:0/2363767302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980094f0 con 0x7fa19c159890 2023-10-10T21:02:26.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.321+0000 7fa1a0f9b700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c159890 0x7fa19c15c010 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa198006fd0 tx=0x7fa198016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.322+0000 7fa190ff9700 1 -- 172.21.15.154:0/2363767302 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198011b80 con 0x7fa19c159890 2023-10-10T21:02:26.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.322+0000 7fa1a31ff700 1 -- 172.21.15.154:0/2363767302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c0ce540 con 0x7fa19c159890 2023-10-10T21:02:26.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.322+0000 7fa1a31ff700 1 -- 172.21.15.154:0/2363767302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c145ea0 con 0x7fa19c159890 2023-10-10T21:02:26.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.323+0000 7f1fdd7ff700 1 Processor -- start 2023-10-10T21:02:26.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.323+0000 7faea17fa700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae90067080 0x7fae90069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.323+0000 7f1fdd7ff700 1 -- start start 2023-10-10T21:02:26.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.323+0000 7faea17fa700 1 -- 172.21.15.154:0/1360723779 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faea8083a10 con 0x7faea40ea2b0 2023-10-10T21:02:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.323+0000 7f197b1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19740afc40 0x7f1974153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.323+0000 7f197b1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19740b0010 0x7f1974163490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7f197b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19740b2140 0x7f1974150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7f197b1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19741527b0 con 0x7f19740afc40 2023-10-10T21:02:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7f197b1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19741514c0 con 0x7f19740b0010 2023-10-10T21:02:26.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7f197b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1974155bf0 con 0x7f19740b2140 2023-10-10T21:02:26.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.323+0000 7fa190ff9700 1 -- 172.21.15.154:0/2363767302 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa198020070 con 0x7fa19c159890 2023-10-10T21:02:26.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7f1978f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19740afc40 0x7f1974153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7f1978f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19740afc40 0x7f1974153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55614/0 (socket says 172.21.15.154:55614) 2023-10-10T21:02:26.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7f1978f9b700 1 -- 172.21.15.154:0/1256123077 learned_addr learned my addr 172.21.15.154:0/1256123077 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7f197979c700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19740b2140 0x7f1974150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.323+0000 7faeb139b700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae90067080 0x7fae90069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7faea17fa700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fae9006f290 0x7fae900716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7faea17fa700 1 -- 172.21.15.154:0/1360723779 --> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae90071d50 con 0x7fae9006f290 2023-10-10T21:02:26.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7faea17fa700 1 -- 172.21.15.154:0/1360723779 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faea8088220 con 0x7faea40ea2b0 2023-10-10T21:02:26.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7fa1827fc700 1 -- 172.21.15.154:0/2363767302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa17c000fd0 con 0x7fa19c159890 2023-10-10T21:02:26.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7fa190ff9700 1 -- 172.21.15.154:0/2363767302 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198011b80 con 0x7fa19c159890 2023-10-10T21:02:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.324+0000 7f197979c700 1 -- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19740b0010 msgr2=0x7f1974163490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f197979c700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19740b0010 0x7f1974163490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f197979c700 1 -- 172.21.15.154:0/1256123077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19740afc40 msgr2=0x7f1974153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f197979c700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19740afc40 0x7f1974153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f197979c700 1 -- 172.21.15.154:0/1256123077 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19640094f0 con 0x7f19740b2140 2023-10-10T21:02:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f197979c700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19740b2140 0x7f1974150420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1964002000 tx=0x7f1964016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7faeb139b700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae90067080 0x7fae90069530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faea40e1560 tx=0x7fae9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f1fdd7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd80c6f30 0x7f1fd80c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f1970ff9700 1 -- 172.21.15.154:0/1256123077 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400b820 con 0x7f19740b2140 2023-10-10T21:02:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f1fdd7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd8158310 0x7f1fd8157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f1970ff9700 1 -- 172.21.15.154:0/1256123077 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964020070 con 0x7f19740b2140 2023-10-10T21:02:26.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f1970ff9700 1 -- 172.21.15.154:0/1256123077 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196401b6a0 con 0x7f19740b2140 2023-10-10T21:02:26.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.326+0000 7f1fdd7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd80b1100 0x7f1fd80b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.325+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1974151770 con 0x7f19740b2140 2023-10-10T21:02:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.326+0000 7f1fd67fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd8158310 0x7f1fd8157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.326+0000 7f1fd67fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd8158310 0x7f1fd8157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58696/0 (socket says 172.21.15.154:58696) 2023-10-10T21:02:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.326+0000 7f1fd67fc700 1 -- 172.21.15.154:0/2766660612 learned_addr learned my addr 172.21.15.154:0/2766660612 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.326+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1974151cd0 con 0x7f19740b2140 2023-10-10T21:02:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.326+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80c5320 con 0x7f1fd80c6f30 2023-10-10T21:02:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.326+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80c4d10 con 0x7f1fd80b1100 2023-10-10T21:02:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.326+0000 7f1fd77fe700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd80b1100 0x7f1fd80b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.326+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80b0300 con 0x7f1fd8158310 2023-10-10T21:02:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.327+0000 7f1fd6ffd700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd80c6f30 0x7f1fd80c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.327+0000 7f1fd77fe700 1 -- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd8158310 msgr2=0x7f1fd8157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.327+0000 7f1fd77fe700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fd8158310 0x7f1fd8157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.327+0000 7f1fd77fe700 1 -- 172.21.15.154:0/2766660612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd80c6f30 msgr2=0x7f1fd80c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.328+0000 7f1fd77fe700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd80c6f30 0x7f1fd80c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.328+0000 7f1fd77fe700 1 -- 172.21.15.154:0/2766660612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc01a4f0 con 0x7f1fd80b1100 2023-10-10T21:02:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.328+0000 7f1fd6ffd700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd80c6f30 0x7f1fd80c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:26.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.328+0000 7f1fd77fe700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd80b1100 0x7f1fd80b15a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0001330 tx=0x7f1fd0001660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.328+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1954000fd0 con 0x7f19740b2140 2023-10-10T21:02:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.329+0000 7faeb0b9a700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fae9006f290 0x7fae900716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.330+0000 7faeb0b9a700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fae9006f290 0x7fae900716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.330+0000 7fa190ff9700 1 -- 172.21.15.154:0/2363767302 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa198022030 con 0x7fa19c159890 2023-10-10T21:02:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.331+0000 7faea17fa700 1 -- 172.21.15.154:0/1360723779 <== osd.3 v2:172.21.15.154:6820/85774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fae90071d50 con 0x7fae9006f290 2023-10-10T21:02:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.331+0000 7f1fbeffd700 1 -- 172.21.15.154:0/2766660612 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0012630 con 0x7f1fd80b1100 2023-10-10T21:02:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.332+0000 7fa190ff9700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa188066f90 0x7fa188069440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.331+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd80c4fb0 con 0x7f1fd80b1100 2023-10-10T21:02:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.331+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd80b1ae0 con 0x7f1fd80b1100 2023-10-10T21:02:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.333+0000 7f1fbeffd700 1 -- 172.21.15.154:0/2766660612 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd00127b0 con 0x7f1fd80b1100 2023-10-10T21:02:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.333+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fd804c3c0 con 0x7f1fd80b1100 2023-10-10T21:02:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.331+0000 7f1970ff9700 1 -- 172.21.15.154:0/1256123077 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1964022030 con 0x7f19740b2140 2023-10-10T21:02:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.332+0000 7f1970ff9700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1960067000 0x7f19600694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.332+0000 7f1970ff9700 1 -- 172.21.15.154:0/1256123077 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19640869b0 con 0x7f19740b2140 2023-10-10T21:02:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.333+0000 7f1978f9b700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1960067000 0x7f19600694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.333+0000 7f527639d700 1 -- 172.21.15.154:0/1894124141 --> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5268053550 con 0x7f525406f180 2023-10-10T21:02:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.333+0000 7f1970ff9700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7f196006f210 0x7f1960071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.333+0000 7f1970ff9700 1 -- 172.21.15.154:0/1256123077 --> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1960071cd0 con 0x7f196006f210 2023-10-10T21:02:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.333+0000 7f1970ff9700 1 -- 172.21.15.154:0/1256123077 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1964086ca0 con 0x7f19740b2140 2023-10-10T21:02:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.333+0000 7f52657fa700 1 -- 172.21.15.154:0/1894124141 <== osd.0 v2:172.21.15.154:6805/85772 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5268053550 con 0x7f525406f180 2023-10-10T21:02:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.333+0000 7fa193fff700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa188066f90 0x7fa188069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.334+0000 7fa193fff700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa188066f90 0x7fa188069440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa19c13cc70 tx=0x7fa18c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.334+0000 7f1978f9b700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1960067000 0x7f19600694b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f196c009f00 tx=0x7f196c009840 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.334+0000 7fa190ff9700 1 -- 172.21.15.154:0/2363767302 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa198057b90 con 0x7fa19c159890 2023-10-10T21:02:26.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.335+0000 7f1973fff700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7f196006f210 0x7f1960071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.335+0000 7fa190ff9700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fa18806fc50 0x7fa1880720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.335+0000 7fa190ff9700 1 -- 172.21.15.154:0/2363767302 --> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1880727b0 con 0x7fa18806fc50 2023-10-10T21:02:26.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.335+0000 7fa190ff9700 1 -- 172.21.15.154:0/2363767302 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa198057260 con 0x7fa19c159890 2023-10-10T21:02:26.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.335+0000 7f1fbeffd700 1 -- 172.21.15.154:0/2766660612 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0012b70 con 0x7f1fd80b1100 2023-10-10T21:02:26.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.335+0000 7f1fbeffd700 1 -- 172.21.15.154:0/2766660612 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fd0003030 con 0x7f1fd80b1100 2023-10-10T21:02:26.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.335+0000 7fa1a179c700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fa18806fc50 0x7fa1880720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.336+0000 7fa1a179c700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fa18806fc50 0x7fa1880720e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.336+0000 7f1fbeffd700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fc4067000 0x7f1fc40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.336+0000 7f1fbeffd700 1 -- 172.21.15.154:0/2766660612 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fd0084c80 con 0x7f1fd80b1100 2023-10-10T21:02:26.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.337+0000 7f1fbeffd700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7f1fc406f210 0x7f1fc4071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.337+0000 7f1fbeffd700 1 -- 172.21.15.154:0/2766660612 --> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fc4071cd0 con 0x7f1fc406f210 2023-10-10T21:02:26.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.337+0000 7f1fbeffd700 1 -- 172.21.15.154:0/2766660612 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fd0084f70 con 0x7f1fd80b1100 2023-10-10T21:02:26.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.337+0000 7f1fd6ffd700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fc4067000 0x7f1fc40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.337+0000 7fa190ff9700 1 -- 172.21.15.154:0/2363767302 <== osd.5 v2:172.21.15.179:6808/88318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa1880727b0 con 0x7fa18806fc50 2023-10-10T21:02:26.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.338+0000 7f1973fff700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7f196006f210 0x7f1960071620 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.338+0000 7f1fd6ffd700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fc4067000 0x7f1fc40694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8006fd0 tx=0x7f1fc8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.338+0000 7f1fd67fc700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7f1fc406f210 0x7f1fc4071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.338+0000 7f525affd700 1 -- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7f525406f180 msgr2=0x7f5254071590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.338+0000 7f525affd700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7f525406f180 0x7f5254071590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.338+0000 7f525affd700 1 -- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5254066ff0 msgr2=0x7f52540694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.338+0000 7f525affd700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5254066ff0 0x7f52540694a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f526c009390 tx=0x7f526c016000 comp rx=0 tx=0).stop 2023-10-10T21:02:26.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.339+0000 7f525affd700 1 -- 172.21.15.154:0/1894124141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52680fa810 msgr2=0x7f5268034db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.339+0000 7f525affd700 1 --2- 172.21.15.154:0/1894124141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52680fa810 0x7f5268034db0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f526000e8a0 tx=0x7f5260008040 comp rx=0 tx=0).stop 2023-10-10T21:02:26.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.339+0000 7f1970ff9700 1 -- 172.21.15.154:0/1256123077 <== osd.7 v2:172.21.15.179:6822/88349 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1960071cd0 con 0x7f196006f210 2023-10-10T21:02:26.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.339+0000 7f5275b9c700 1 -- 172.21.15.154:0/1894124141 reap_dead start 2023-10-10T21:02:26.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.339+0000 7f1fd67fc700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7f1fc406f210 0x7f1fc4071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.339+0000 7f525affd700 1 -- 172.21.15.154:0/1894124141 shutdown_connections 2023-10-10T21:02:26.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.339+0000 7f525affd700 1 -- 172.21.15.154:0/1894124141 >> 172.21.15.154:0/1894124141 conn(0x7f5268051810 msgr2=0x7f52680f1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.340+0000 7f525affd700 1 -- 172.21.15.154:0/1894124141 shutdown_connections 2023-10-10T21:02:26.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.340+0000 7f525affd700 1 -- 172.21.15.154:0/1894124141 wait complete. 2023-10-10T21:02:26.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.340+0000 7f1fbeffd700 1 -- 172.21.15.154:0/2766660612 <== osd.6 v2:172.21.15.179:6816/88346 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1fc4071cd0 con 0x7f1fc406f210 2023-10-10T21:02:26.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.342+0000 7f1b14bff700 1 -- 172.21.15.154:0/2830587583 --> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b10155b40 con 0x7f1af006f210 2023-10-10T21:02:26.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.342+0000 7f1afe7fc700 1 -- 172.21.15.154:0/2830587583 <== osd.1 v2:172.21.15.154:6800/85771 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b10155b40 con 0x7f1af006f210 2023-10-10T21:02:26.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.349+0000 7f1aeffff700 1 -- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f1af006f210 msgr2=0x7f1af0071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.349+0000 7f1aeffff700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f1af006f210 0x7f1af0071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.349+0000 7f1aeffff700 1 -- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1af0067080 msgr2=0x7f1af0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.349+0000 7f1aeffff700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1af0067080 0x7f1af0069530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1b1006e430 tx=0x7f1b00009250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.349+0000 7f1aeffff700 1 -- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b10159840 msgr2=0x7f1b1014bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.349+0000 7f1aeffff700 1 --2- 172.21.15.154:0/2830587583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b10159840 0x7f1b1014bb20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b1015a7c0 tx=0x7f1b04017000 comp rx=0 tx=0).stop 2023-10-10T21:02:26.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.349+0000 7f1b0ed9d700 1 -- 172.21.15.154:0/2830587583 reap_dead start 2023-10-10T21:02:26.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.350+0000 7f1aeffff700 1 -- 172.21.15.154:0/2830587583 shutdown_connections 2023-10-10T21:02:26.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.350+0000 7f1aeffff700 1 -- 172.21.15.154:0/2830587583 >> 172.21.15.154:0/2830587583 conn(0x7f1b100d0ff0 msgr2=0x7f1b100cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.350+0000 7ffabbfff700 1 -- 172.21.15.154:0/2624603084 --> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffab0002d30 con 0x7ffab406f210 2023-10-10T21:02:26.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.350+0000 7f1aeffff700 1 -- 172.21.15.154:0/2830587583 shutdown_connections 2023-10-10T21:02:26.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.351+0000 7f1aeffff700 1 -- 172.21.15.154:0/2830587583 wait complete. 2023-10-10T21:02:26.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.352+0000 7f71e0ff9700 1 -- 172.21.15.154:0/3455093296 --> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71fc06a6a0 con 0x7f71e806f210 2023-10-10T21:02:26.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.352+0000 7ffac27fc700 1 -- 172.21.15.154:0/2624603084 <== osd.4 v2:172.21.15.179:6800/88317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffab0002d30 con 0x7ffab406f210 2023-10-10T21:02:26.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.352+0000 7f71e2ffd700 1 -- 172.21.15.154:0/3455093296 <== osd.2 v2:172.21.15.154:6815/85769 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71fc06a6a0 con 0x7f71e806f210 2023-10-10T21:02:26.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.353+0000 7ffabbfff700 1 -- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7ffab406f210 msgr2=0x7ffab4071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.353+0000 7ffabbfff700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7ffab406f210 0x7ffab4071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.354+0000 7ffabbfff700 1 -- 172.21.15.154:0/2624603084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab4067000 msgr2=0x7ffab40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.354+0000 7ffabbfff700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab4067000 0x7ffab40694b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00dfd0 tx=0x7ffac4017000 comp rx=0 tx=0).stop 2023-10-10T21:02:26.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.354+0000 7ffabbfff700 1 -- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc006920 msgr2=0x7ffacc04bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.354+0000 7ffabbfff700 1 --2- 172.21.15.154:0/2624603084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc006920 0x7ffacc04bd30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffac800c7c0 tx=0x7ffac8007f70 comp rx=0 tx=0).stop 2023-10-10T21:02:26.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.354+0000 7ffad2d9d700 1 -- 172.21.15.154:0/2624603084 reap_dead start 2023-10-10T21:02:26.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.354+0000 7f71e0ff9700 1 -- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7f71e806f210 msgr2=0x7f71e8071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.354+0000 7f71e0ff9700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7f71e806f210 0x7f71e8071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.354+0000 7ffabbfff700 1 -- 172.21.15.154:0/2624603084 shutdown_connections 2023-10-10T21:02:26.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.354+0000 7ffabbfff700 1 -- 172.21.15.154:0/2624603084 >> 172.21.15.154:0/2624603084 conn(0x7ffacc054c80 msgr2=0x7ffacc0e7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.355+0000 7f71e0ff9700 1 -- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f71e8067080 msgr2=0x7f71e8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.355+0000 7f71e0ff9700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f71e8067080 0x7f71e8069530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0a6330 tx=0x7f71f0009040 comp rx=0 tx=0).stop 2023-10-10T21:02:26.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.355+0000 7f71e0ff9700 1 -- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc06e290 msgr2=0x7f71fc0a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.355+0000 7f71e0ff9700 1 --2- 172.21.15.154:0/3455093296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71fc06e290 0x7f71fc0a5df0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71ec019000 tx=0x7f71ec01c000 comp rx=0 tx=0).stop 2023-10-10T21:02:26.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.355+0000 7f71fbfff700 1 -- 172.21.15.154:0/3455093296 reap_dead start 2023-10-10T21:02:26.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.355+0000 7f71e0ff9700 1 -- 172.21.15.154:0/3455093296 shutdown_connections 2023-10-10T21:02:26.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.355+0000 7f71e0ff9700 1 -- 172.21.15.154:0/3455093296 >> 172.21.15.154:0/3455093296 conn(0x7f71fc068e20 msgr2=0x7f71fc157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.356+0000 7f71e0ff9700 1 -- 172.21.15.154:0/3455093296 shutdown_connections 2023-10-10T21:02:26.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.360+0000 7f71e0ff9700 1 -- 172.21.15.154:0/3455093296 wait complete. 2023-10-10T21:02:26.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.360+0000 7ffabbfff700 1 -- 172.21.15.154:0/2624603084 shutdown_connections 2023-10-10T21:02:26.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.360+0000 7ffabbfff700 1 -- 172.21.15.154:0/2624603084 wait complete. 2023-10-10T21:02:26.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.363+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 --> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faea40091b0 con 0x7fae9006f290 2023-10-10T21:02:26.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.364+0000 7faea17fa700 1 -- 172.21.15.154:0/1360723779 <== osd.3 v2:172.21.15.154:6820/85774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faea40091b0 con 0x7fae9006f290 2023-10-10T21:02:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.364+0000 7fa1827fc700 1 -- 172.21.15.154:0/2363767302 --> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa17c002d30 con 0x7fa18806fc50 2023-10-10T21:02:26.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.365+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fae9006f290 msgr2=0x7fae900716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.365+0000 7faeb239d700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fae9006f290 0x7fae900716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.366+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae90067080 msgr2=0x7fae90069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.366+0000 7faeb239d700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae90067080 0x7fae90069530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faea40e1560 tx=0x7fae9c008040 comp rx=0 tx=0).stop 2023-10-10T21:02:26.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.366+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40ea2b0 msgr2=0x7faea4051bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.366+0000 7faeb239d700 1 --2- 172.21.15.154:0/1360723779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea40ea2b0 0x7faea4051bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faea800c510 tx=0x7faea8007f30 comp rx=0 tx=0).stop 2023-10-10T21:02:26.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.366+0000 7faeb1b9c700 1 -- 172.21.15.154:0/1360723779 reap_dead start 2023-10-10T21:02:26.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.366+0000 7fa190ff9700 1 -- 172.21.15.154:0/2363767302 <== osd.5 v2:172.21.15.179:6808/88318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa17c002d30 con 0x7fa18806fc50 2023-10-10T21:02:26.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.367+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 shutdown_connections 2023-10-10T21:02:26.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.367+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 >> 172.21.15.154:0/1360723779 conn(0x7faea4054da0 msgr2=0x7faea40d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.367+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 shutdown_connections 2023-10-10T21:02:26.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.367+0000 7faeb239d700 1 -- 172.21.15.154:0/1360723779 wait complete. 2023-10-10T21:02:26.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.368+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 --> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1954002d30 con 0x7f196006f210 2023-10-10T21:02:26.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.368+0000 7f1970ff9700 1 -- 172.21.15.154:0/1256123077 <== osd.7 v2:172.21.15.179:6822/88349 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1954002d30 con 0x7f196006f210 2023-10-10T21:02:26.465 INFO:teuthology.orchestra.run.smithi154.stdout:60129542151 2023-10-10T21:02:26.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-10T21:02:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.369+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7f196006f210 msgr2=0x7f1960071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.369+0000 7f197b1ff700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7f196006f210 0x7f1960071620 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7fa1827fc700 1 -- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fa18806fc50 msgr2=0x7fa1880720e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7fa1827fc700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fa18806fc50 0x7fa1880720e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1960067000 msgr2=0x7f19600694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7f197b1ff700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1960067000 0x7f19600694b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f196c009f00 tx=0x7f196c009840 comp rx=0 tx=0).stop 2023-10-10T21:02:26.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19740b2140 msgr2=0x7f1974150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7f197b1ff700 1 --2- 172.21.15.154:0/1256123077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19740b2140 0x7f1974150420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1964002000 tx=0x7f1964016000 comp rx=0 tx=0).stop 2023-10-10T21:02:26.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7fa1827fc700 1 -- 172.21.15.154:0/2363767302 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa188066f90 msgr2=0x7fa188069440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7fa1827fc700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa188066f90 0x7fa188069440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa19c13cc70 tx=0x7fa18c008040 comp rx=0 tx=0).stop 2023-10-10T21:02:26.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7fa1827fc700 1 -- 172.21.15.154:0/2363767302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c159890 msgr2=0x7fa19c15c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7fa1827fc700 1 --2- 172.21.15.154:0/2363767302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c159890 0x7fa19c15c010 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa198006fd0 tx=0x7fa198016000 comp rx=0 tx=0).stop 2023-10-10T21:02:26.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.370+0000 7fa1a179c700 1 -- 172.21.15.154:0/2363767302 reap_dead start 2023-10-10T21:02:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7f197979c700 1 -- 172.21.15.154:0/1256123077 reap_dead start 2023-10-10T21:02:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 shutdown_connections 2023-10-10T21:02:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 >> 172.21.15.154:0/1256123077 conn(0x7f197406a320 msgr2=0x7f19740adb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 shutdown_connections 2023-10-10T21:02:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7f197b1ff700 1 -- 172.21.15.154:0/1256123077 wait complete. 2023-10-10T21:02:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7fa1827fc700 1 -- 172.21.15.154:0/2363767302 shutdown_connections 2023-10-10T21:02:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7fa1827fc700 1 -- 172.21.15.154:0/2363767302 >> 172.21.15.154:0/2363767302 conn(0x7fa19c068e20 msgr2=0x7fa19c0b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7fa1827fc700 1 -- 172.21.15.154:0/2363767302 shutdown_connections 2023-10-10T21:02:26.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7fa1827fc700 1 -- 172.21.15.154:0/2363767302 wait complete. 2023-10-10T21:02:26.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.371+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 --> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fd80cb180 con 0x7f1fc406f210 2023-10-10T21:02:26.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.372+0000 7f1fbeffd700 1 -- 172.21.15.154:0/2766660612 <== osd.6 v2:172.21.15.179:6816/88346 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1fd80cb180 con 0x7f1fc406f210 2023-10-10T21:02:26.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.373+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7f1fc406f210 msgr2=0x7f1fc4071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.373+0000 7f1fdd7ff700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7f1fc406f210 0x7f1fc4071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.375+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fc4067000 msgr2=0x7f1fc40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.375+0000 7f1fdd7ff700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fc4067000 0x7f1fc40694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8006fd0 tx=0x7f1fc8008040 comp rx=0 tx=0).stop 2023-10-10T21:02:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.375+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd80b1100 msgr2=0x7f1fd80b15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.375+0000 7f1fdd7ff700 1 --2- 172.21.15.154:0/2766660612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fd80b1100 0x7f1fd80b15a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0001330 tx=0x7f1fd0001660 comp rx=0 tx=0).stop 2023-10-10T21:02:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.375+0000 7f1fd77fe700 1 -- 172.21.15.154:0/2766660612 reap_dead start 2023-10-10T21:02:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.375+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 shutdown_connections 2023-10-10T21:02:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.375+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 >> 172.21.15.154:0/2766660612 conn(0x7f1fd80cc1e0 msgr2=0x7f1fd8069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.376+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 shutdown_connections 2023-10-10T21:02:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.376+0000 7f1fdd7ff700 1 -- 172.21.15.154:0/2766660612 wait complete. 2023-10-10T21:02:26.477 INFO:teuthology.orchestra.run.smithi154.stdout:60129542149 2023-10-10T21:02:26.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-10T21:02:26.479 INFO:teuthology.orchestra.run.smithi154.stdout:60129542151 2023-10-10T21:02:26.479 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-10T21:02:26.480 INFO:teuthology.orchestra.run.smithi154.stdout:60129542151 2023-10-10T21:02:26.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-10T21:02:26.481 INFO:teuthology.orchestra.run.smithi154.stdout:60129542149 2023-10-10T21:02:26.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-10T21:02:26.483 INFO:teuthology.orchestra.run.smithi154.stdout:60129542149 2023-10-10T21:02:26.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-10T21:02:26.484 INFO:teuthology.orchestra.run.smithi154.stdout:64424509446 2023-10-10T21:02:26.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-10T21:02:26.485 INFO:teuthology.orchestra.run.smithi154.stdout:60129542150 2023-10-10T21:02:26.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-10T21:02:26.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.839+0000 7fb37c3ff700 1 Processor -- start 2023-10-10T21:02:26.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.839+0000 7fb37c3ff700 1 -- start start 2023-10-10T21:02:26.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.841+0000 7f517e5ff700 1 Processor -- start 2023-10-10T21:02:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.842+0000 7fb37a19b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb36c0d5240 0x7fb36c04fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38460/0 (socket says 172.21.15.154:38460) 2023-10-10T21:02:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.842+0000 7fb37a19b700 1 -- 172.21.15.154:0/3083229294 learned_addr learned my addr 172.21.15.154:0/3083229294 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.842+0000 7fb37c3ff700 1 --2- 172.21.15.154:0/3083229294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0060c0 0x7fb36c0339d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.841+0000 7f517e5ff700 1 -- start start 2023-10-10T21:02:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.843+0000 7fb37c3ff700 1 -- 172.21.15.154:0/3083229294 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c053b20 con 0x7fb36c0d5240 2023-10-10T21:02:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.843+0000 7fb37999a700 1 --2- 172.21.15.154:0/3083229294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0060c0 0x7fb36c0339d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.843+0000 7f517e5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5170039050 0x7f517003b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.843+0000 7f517e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 0x7f51700e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.843+0000 7f517e5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5170006c20 con 0x7f51700e24c0 2023-10-10T21:02:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.843+0000 7f517e5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5170007a80 con 0x7f5170039050 2023-10-10T21:02:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.843+0000 7f517e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5170006e70 con 0x7f5170039420 2023-10-10T21:02:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.844+0000 7f517cb9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f51700e24c0 0x7f5170053e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:38718/0 (socket says 172.21.15.154:38718) 2023-10-10T21:02:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.844+0000 7f517cb9c700 1 -- 172.21.15.154:0/66956419 learned_addr learned my addr 172.21.15.154:0/66956419 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:26.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.844+0000 7f5177fff700 1 --2- 172.21.15.154:0/66956419 >> v2:172.21.15.154:3300/0 conn(0x7f5170039050 0x7f517003b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.844+0000 7fb37c3ff700 1 -- 172.21.15.154:0/3083229294 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c050b60 con 0x7fb36c033f10 2023-10-10T21:02:26.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.844+0000 7fb37c3ff700 1 -- 172.21.15.154:0/3083229294 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c034390 con 0x7fb36c0060c0 2023-10-10T21:02:26.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.844+0000 7f51777fe700 1 --2- 172.21.15.154:0/66956419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 0x7f51700e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.845+0000 7f5176ffd700 1 -- 172.21.15.154:0/66956419 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294464157 0 0) 0x7f5170006c20 con 0x7f51700e24c0 2023-10-10T21:02:26.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.845+0000 7f5176ffd700 1 -- 172.21.15.154:0/66956419 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5168003570 con 0x7f51700e24c0 2023-10-10T21:02:26.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.845+0000 7fb37999a700 1 -- 172.21.15.154:0/3083229294 >> v1:172.21.15.179:6789/0 conn(0x7fb36c033f10 legacy=0x7fb36c053fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.845+0000 7f51777fe700 1 -- 172.21.15.154:0/66956419 >> v2:172.21.15.154:3300/0 conn(0x7f5170039050 msgr2=0x7f517003b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.845+0000 7f5176ffd700 1 -- 172.21.15.154:0/66956419 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4251685227 0 0) 0x7f5168003570 con 0x7f51700e24c0 2023-10-10T21:02:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.846+0000 7fb37999a700 1 -- 172.21.15.154:0/3083229294 >> v1:172.21.15.154:6789/0 conn(0x7fb36c0d5240 legacy=0x7fb36c04fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.846+0000 7f51777fe700 1 --2- 172.21.15.154:0/66956419 >> v2:172.21.15.154:3300/0 conn(0x7f5170039050 0x7f517003b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.846+0000 7f51777fe700 1 -- 172.21.15.154:0/66956419 >> v1:172.21.15.179:6789/0 conn(0x7f51700e24c0 legacy=0x7f5170053e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.846+0000 7f51777fe700 1 -- 172.21.15.154:0/66956419 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5170007150 con 0x7f5170039420 2023-10-10T21:02:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.846+0000 7f5177fff700 1 --2- 172.21.15.154:0/66956419 >> v2:172.21.15.154:3300/0 conn(0x7f5170039050 0x7f517003b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.846+0000 7fb37999a700 1 -- 172.21.15.154:0/3083229294 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c006510 con 0x7fb36c0060c0 2023-10-10T21:02:26.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.846+0000 7f51777fe700 1 --2- 172.21.15.154:0/66956419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 0x7f51700e1f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f516c0098e0 tx=0x7f516c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb2968b8caa913b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.846+0000 7fb37999a700 1 --2- 172.21.15.154:0/3083229294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0060c0 0x7fb36c0339d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb370009910 tx=0x7fb3700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a8a8f3773592632 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.847+0000 7f5176ffd700 1 -- 172.21.15.154:0/66956419 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517804c0e0 con 0x7f5170039420 2023-10-10T21:02:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.847+0000 7f5176ffd700 1 -- 172.21.15.154:0/66956419 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c011420 con 0x7f5170039420 2023-10-10T21:02:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.847+0000 7f5176ffd700 1 -- 172.21.15.154:0/66956419 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c0117e0 con 0x7f5170039420 2023-10-10T21:02:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.847+0000 7fc3a8bff700 1 Processor -- start 2023-10-10T21:02:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.847+0000 7fb379199700 1 -- 172.21.15.154:0/3083229294 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370009eb0 con 0x7fb36c0060c0 2023-10-10T21:02:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.847+0000 7fb379199700 1 -- 172.21.15.154:0/3083229294 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37000b760 con 0x7fb36c0060c0 2023-10-10T21:02:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.848+0000 7fb379199700 1 -- 172.21.15.154:0/3083229294 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000bb00 con 0x7fb36c0060c0 2023-10-10T21:02:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.848+0000 7f517e5ff700 1 -- 172.21.15.154:0/66956419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 msgr2=0x7f51700e1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.848+0000 7f517e5ff700 1 --2- 172.21.15.154:0/66956419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 0x7f51700e1f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f516c0098e0 tx=0x7f516c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.847+0000 7fc3a8bff700 1 -- start start 2023-10-10T21:02:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.848+0000 7f517e5ff700 1 -- 172.21.15.154:0/66956419 shutdown_connections 2023-10-10T21:02:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.848+0000 7f517e5ff700 1 --2- 172.21.15.154:0/66956419 >> v2:172.21.15.154:3300/0 conn(0x7f5170039050 0x7f517003b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.849+0000 7fb37c3ff700 1 -- 172.21.15.154:0/3083229294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0060c0 msgr2=0x7fb36c0339d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.849+0000 7fb37c3ff700 1 --2- 172.21.15.154:0/3083229294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0060c0 0x7fb36c0339d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb370009910 tx=0x7fb3700091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.848+0000 7f517e5ff700 1 --2- 172.21.15.154:0/66956419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 0x7f51700e1f80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.848+0000 7f517e5ff700 1 -- 172.21.15.154:0/66956419 >> 172.21.15.154:0/66956419 conn(0x7f5170059b30 msgr2=0x7f5170055ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.849+0000 7f517e5ff700 1 -- 172.21.15.154:0/66956419 shutdown_connections 2023-10-10T21:02:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.849+0000 7f517e5ff700 1 -- 172.21.15.154:0/66956419 wait complete. 2023-10-10T21:02:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.849+0000 7fb37c3ff700 1 -- 172.21.15.154:0/3083229294 shutdown_connections 2023-10-10T21:02:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.849+0000 7fb37c3ff700 1 --2- 172.21.15.154:0/3083229294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0060c0 0x7fb36c0339d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.849+0000 7fb37c3ff700 1 -- 172.21.15.154:0/3083229294 >> 172.21.15.154:0/3083229294 conn(0x7fb36c0518a0 msgr2=0x7fb36c051ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fc3a8bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc3a40afc40 0x7fc3a40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fc3a8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40b2140 0x7fc3a415d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fb37c3ff700 1 -- 172.21.15.154:0/3083229294 shutdown_connections 2023-10-10T21:02:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fc3a8bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3a40b0010 0x7fc3a415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fc3a8bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a40b0750 con 0x7fc3a40b0010 2023-10-10T21:02:26.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fb37c3ff700 1 -- 172.21.15.154:0/3083229294 wait complete. 2023-10-10T21:02:26.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fc3a8bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a40aca70 con 0x7fc3a40afc40 2023-10-10T21:02:26.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fc3a8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40acd50 con 0x7fc3a40b2140 2023-10-10T21:02:26.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fc3a1d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40b2140 0x7fc3a415d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fc3a1d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40b2140 0x7fc3a415d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58736/0 (socket says 172.21.15.154:58736) 2023-10-10T21:02:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.850+0000 7fc3a1d9b700 1 -- 172.21.15.154:0/89151529 learned_addr learned my addr 172.21.15.154:0/89151529 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.851+0000 7fc3a2d9d700 1 --2- 172.21.15.154:0/89151529 >> v2:172.21.15.154:3300/0 conn(0x7fc3a40b0010 0x7fc3a415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.851+0000 7fc3a1d9b700 1 -- 172.21.15.154:0/89151529 >> v2:172.21.15.179:3300/0 conn(0x7fc3a40afc40 msgr2=0x7fc3a40b1c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-10T21:02:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.851+0000 7fc3a1d9b700 1 --2- 172.21.15.154:0/89151529 >> v2:172.21.15.179:3300/0 conn(0x7fc3a40afc40 0x7fc3a40b1c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.851+0000 7fc3a1d9b700 1 -- 172.21.15.154:0/89151529 >> v2:172.21.15.154:3300/0 conn(0x7fc3a40b0010 msgr2=0x7fc3a415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.851+0000 7fc3a1d9b700 1 --2- 172.21.15.154:0/89151529 >> v2:172.21.15.154:3300/0 conn(0x7fc3a40b0010 0x7fc3a415dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.851+0000 7fc3a1d9b700 1 -- 172.21.15.154:0/89151529 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40ad030 con 0x7fc3a40b2140 2023-10-10T21:02:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.851+0000 7f517e5ff700 1 Processor -- start 2023-10-10T21:02:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.851+0000 7fc3a2d9d700 1 --2- 172.21.15.154:0/89151529 >> v2:172.21.15.154:3300/0 conn(0x7fc3a40b0010 0x7fc3a415dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.851+0000 7fc3a1d9b700 1 --2- 172.21.15.154:0/89151529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40b2140 0x7fc3a415d850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4063d40 tx=0x7fc398009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37a835b5aa1c6500 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.853+0000 7fb37c3ff700 1 Processor -- start 2023-10-10T21:02:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.852+0000 7f517e5ff700 1 -- start start 2023-10-10T21:02:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.853+0000 7f517e5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5170039050 0x7f51700f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.853+0000 7f517e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 0x7f51700e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.853+0000 7f517e5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700e24c0 0x7f5170057c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.853+0000 7f517e5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51700e1b30 con 0x7f51700e24c0 2023-10-10T21:02:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.853+0000 7f517e5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5170051840 con 0x7f5170039050 2023-10-10T21:02:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.853+0000 7f517e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700e3ba0 con 0x7f5170039420 2023-10-10T21:02:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.853+0000 7fb37c3ff700 1 -- start start 2023-10-10T21:02:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.854+0000 7f517cb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700e24c0 0x7f5170057c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.854+0000 7f517cb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700e24c0 0x7f5170057c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55634/0 (socket says 172.21.15.154:55634) 2023-10-10T21:02:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.854+0000 7f517cb9c700 1 -- 172.21.15.154:0/1564767089 learned_addr learned my addr 172.21.15.154:0/1564767089 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.854+0000 7f517cb9c700 1 -- 172.21.15.154:0/1564767089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 msgr2=0x7f51700e15f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.854+0000 7f517cb9c700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 0x7f51700e15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.854+0000 7f517cb9c700 1 -- 172.21.15.154:0/1564767089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5170039050 msgr2=0x7f51700f7860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.854+0000 7f517cb9c700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5170039050 0x7f51700f7860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.854+0000 7f517cb9c700 1 -- 172.21.15.154:0/1564767089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5164009420 con 0x7f51700e24c0 2023-10-10T21:02:26.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37c3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb36c0060c0 0x7fb36c0db040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37c3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb36c033f10 0x7fb36c0d39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37c3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0d5240 0x7fb36c03a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37c3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0dbef0 con 0x7fb36c0060c0 2023-10-10T21:02:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37c3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0d3f00 con 0x7fb36c033f10 2023-10-10T21:02:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37c3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0db650 con 0x7fb36c0d5240 2023-10-10T21:02:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37a19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb36c0060c0 0x7fb36c0db040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7f517cb9c700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700e24c0 0x7f5170057c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5178066e40 tx=0x7f5178066260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37a19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb36c0060c0 0x7fb36c0db040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55648/0 (socket says 172.21.15.154:55648) 2023-10-10T21:02:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37a19b700 1 -- 172.21.15.154:0/1747861787 learned_addr learned my addr 172.21.15.154:0/1747861787 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7fb37999a700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb36c033f10 0x7fb36c0d39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.855+0000 7f5163fff700 1 -- 172.21.15.154:0/1564767089 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51780648d0 con 0x7f51700e24c0 2023-10-10T21:02:26.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7fb37a99c700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0d5240 0x7fb36c03a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7f5163fff700 1 -- 172.21.15.154:0/1564767089 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517804c0e0 con 0x7f51700e24c0 2023-10-10T21:02:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7f5163fff700 1 -- 172.21.15.154:0/1564767089 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178067f10 con 0x7f51700e24c0 2023-10-10T21:02:26.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7f3393dff700 1 Processor -- start 2023-10-10T21:02:26.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7f517e5ff700 1 -- 172.21.15.154:0/1564767089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c009420 con 0x7f51700e24c0 2023-10-10T21:02:26.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7fb37a19b700 1 -- 172.21.15.154:0/1747861787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0d5240 msgr2=0x7fb36c03a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7fb37a19b700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0d5240 0x7fb36c03a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7f3393dff700 1 -- start start 2023-10-10T21:02:26.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7fb37a19b700 1 -- 172.21.15.154:0/1747861787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb36c033f10 msgr2=0x7fb36c0d39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7fb37a19b700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb36c033f10 0x7fb36c0d39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7fb37a19b700 1 -- 172.21.15.154:0/1747861787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370009420 con 0x7fb36c0060c0 2023-10-10T21:02:26.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7f517e5ff700 1 -- 172.21.15.154:0/1564767089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51700511f0 con 0x7f51700e24c0 2023-10-10T21:02:26.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.856+0000 7fb37999a700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb36c033f10 0x7fb36c0d39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:26.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.858+0000 7fc3a159a700 1 -- 172.21.15.154:0/89151529 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39800b860 con 0x7fc3a40b2140 2023-10-10T21:02:26.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.858+0000 7fc3a159a700 1 -- 172.21.15.154:0/89151529 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39800b9c0 con 0x7fc3a40b2140 2023-10-10T21:02:26.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.858+0000 7fc3a159a700 1 -- 172.21.15.154:0/89151529 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39800bd60 con 0x7fc3a40b2140 2023-10-10T21:02:26.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7fc3a8bff700 1 -- 172.21.15.154:0/89151529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40b2140 msgr2=0x7fc3a415d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/89151529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40b2140 0x7fc3a415d850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4063d40 tx=0x7fc398009250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7f3393dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f338403b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7f3393dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33840074c0 con 0x7f33840e1e60 2023-10-10T21:02:26.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7f3393dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33840068b0 con 0x7f33840063d0 2023-10-10T21:02:26.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7f3393dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3384007db0 con 0x7f3384007950 2023-10-10T21:02:26.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7f339239c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f338403b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7f339239c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f338403b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58756/0 (socket says 172.21.15.154:58756) 2023-10-10T21:02:26.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7f339239c700 1 -- 172.21.15.154:0/3534595513 learned_addr learned my addr 172.21.15.154:0/3534595513 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.860+0000 7fc3a8bff700 1 -- 172.21.15.154:0/89151529 shutdown_connections 2023-10-10T21:02:26.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.860+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/89151529 >> v2:172.21.15.154:3300/0 conn(0x7fc3a40b0010 0x7fc3a415dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.860+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/89151529 >> v2:172.21.15.179:3300/0 conn(0x7fc3a40afc40 0x7fc3a40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.860+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/89151529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40b2140 0x7fc3a415d850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.860+0000 7fc3a8bff700 1 -- 172.21.15.154:0/89151529 >> 172.21.15.154:0/89151529 conn(0x7fc3a406a320 msgr2=0x7fc3a40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7f5163fff700 1 -- 172.21.15.154:0/1564767089 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5178090430 con 0x7f51700e24c0 2023-10-10T21:02:26.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.860+0000 7f517e5ff700 1 -- 172.21.15.154:0/1564767089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5170005390 con 0x7f51700e24c0 2023-10-10T21:02:26.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.860+0000 7fc3a8bff700 1 -- 172.21.15.154:0/89151529 shutdown_connections 2023-10-10T21:02:26.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.858+0000 7fb37a19b700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb36c0060c0 0x7fb36c0db040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb36400c840 tx=0x7fb364007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.858+0000 7fb36a7fc700 1 -- 172.21.15.154:0/1747861787 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364007360 con 0x7fb36c0060c0 2023-10-10T21:02:26.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.861+0000 7fc3a8bff700 1 -- 172.21.15.154:0/89151529 wait complete. 2023-10-10T21:02:26.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.858+0000 7fb36a7fc700 1 -- 172.21.15.154:0/1747861787 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb364007500 con 0x7fb36c0060c0 2023-10-10T21:02:26.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.859+0000 7fb36a7fc700 1 -- 172.21.15.154:0/1747861787 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364004a80 con 0x7fb36c0060c0 2023-10-10T21:02:26.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.860+0000 7fb37c3ff700 1 -- 172.21.15.154:0/1747861787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36c0db930 con 0x7fb36c0060c0 2023-10-10T21:02:26.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.860+0000 7fb37c3ff700 1 -- 172.21.15.154:0/1747861787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c037d70 con 0x7fb36c0060c0 2023-10-10T21:02:26.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.861+0000 7f5163fff700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c067080 0x7f515c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.861+0000 7f5163fff700 1 -- 172.21.15.154:0/1564767089 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51780fc010 con 0x7f51700e24c0 2023-10-10T21:02:26.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.862+0000 7f3390b99700 1 -- 172.21.15.154:0/3534595513 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531309000 0 0) 0x7f33840068b0 con 0x7f33840063d0 2023-10-10T21:02:26.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.862+0000 7f339239c700 1 -- 172.21.15.154:0/3534595513 >> v1:172.21.15.179:6789/0 conn(0x7f33840063d0 legacy=0x7f33840393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.862+0000 7f339239c700 1 -- 172.21.15.154:0/3534595513 >> v1:172.21.15.154:6789/0 conn(0x7f33840e1e60 legacy=0x7f33840e2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.862+0000 7f339239c700 1 -- 172.21.15.154:0/3534595513 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384006b90 con 0x7f3384007950 2023-10-10T21:02:26.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.862+0000 7f2fcd79d700 1 Processor -- start 2023-10-10T21:02:26.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.862+0000 7fb37c3ff700 1 -- 172.21.15.154:0/1747861787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c037bd0 con 0x7fb36c0060c0 2023-10-10T21:02:26.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.862+0000 7f5177fff700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c067080 0x7f515c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.863+0000 7f2fcd79d700 1 -- start start 2023-10-10T21:02:26.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.863+0000 7fc3a8bff700 1 Processor -- start 2023-10-10T21:02:26.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.863+0000 7f339239c700 1 --2- 172.21.15.154:0/3534595513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f338403b070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f337c0099e0 tx=0x7f337c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd84c35c785c41f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.863+0000 7fc3a8bff700 1 -- start start 2023-10-10T21:02:26.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7f3390b99700 1 -- 172.21.15.154:0/3534595513 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c00b7a0 con 0x7f3384007950 2023-10-10T21:02:26.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7f5177fff700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c067080 0x7f515c069530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51700f7810 tx=0x7f51640091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7f3390b99700 1 -- 172.21.15.154:0/3534595513 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c00b900 con 0x7f3384007950 2023-10-10T21:02:26.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7f3390b99700 1 -- 172.21.15.154:0/3534595513 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c00bca0 con 0x7f3384007950 2023-10-10T21:02:26.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7f2fcd79d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2fc815da80 0x7f2fc806e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7f2fcd79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2fc815de50 0x7f2fc80c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7f2fcd79d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80ca410 con 0x7f2fc80696c0 2023-10-10T21:02:26.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7f2fcd79d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80c6f80 con 0x7f2fc815da80 2023-10-10T21:02:26.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7f2fcd79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80c7220 con 0x7f2fc815de50 2023-10-10T21:02:26.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.864+0000 7fb36a7fc700 1 -- 172.21.15.154:0/1747861787 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3640133c0 con 0x7fb36c0060c0 2023-10-10T21:02:26.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7fc3a8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40afc40 0x7fc3a414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7fc3a8bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a40b0010 0x7fc3a4171460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7fc3a8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a40b2140 0x7fc3a41719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7f3393dff700 1 -- 172.21.15.154:0/3534595513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 msgr2=0x7f338403b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7f3393dff700 1 --2- 172.21.15.154:0/3534595513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f338403b070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f337c0099e0 tx=0x7f337c009250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7f2fc77fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2fc815de50 0x7f2fc80c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7f2fc77fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2fc815de50 0x7f2fc80c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:49976/0 (socket says 172.21.15.154:49976) 2023-10-10T21:02:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7f2fc77fe700 1 -- 172.21.15.154:0/887604419 learned_addr learned my addr 172.21.15.154:0/887604419 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7f2fc7fff700 1 --2- 172.21.15.154:0/887604419 >> v2:172.21.15.154:3300/0 conn(0x7f2fc815da80 0x7f2fc806e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7fc3a1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a40b0010 0x7fc3a4171460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7fc3a8bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41570a0 con 0x7fc3a40b0010 2023-10-10T21:02:26.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7fc3a1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a40b0010 0x7fc3a4171460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55666/0 (socket says 172.21.15.154:55666) 2023-10-10T21:02:26.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7fc3a1d9b700 1 -- 172.21.15.154:0/511469678 learned_addr learned my addr 172.21.15.154:0/511469678 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7fb36a7fc700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb358067000 0x7fb3580694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7fc3a2d9d700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a40b2140 0x7fc3a41719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41548d0 con 0x7fc3a40b2140 2023-10-10T21:02:26.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4154bb0 con 0x7fc3a40afc40 2023-10-10T21:02:26.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7f2fc77fe700 1 -- 172.21.15.154:0/887604419 >> v2:172.21.15.154:3300/0 conn(0x7f2fc815da80 msgr2=0x7f2fc806e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7f2fc77fe700 1 --2- 172.21.15.154:0/887604419 >> v2:172.21.15.154:3300/0 conn(0x7f2fc815da80 0x7f2fc806e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7fb36a7fc700 1 -- 172.21.15.154:0/1747861787 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb364004e30 con 0x7fb36c0060c0 2023-10-10T21:02:26.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7f2fc77fe700 1 -- 172.21.15.154:0/887604419 >> v1:172.21.15.179:6789/0 conn(0x7f2fc80696c0 legacy=0x7f2fc806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7f2fc77fe700 1 -- 172.21.15.154:0/887604419 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80c7500 con 0x7f2fc815de50 2023-10-10T21:02:26.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7fb37999a700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb358067000 0x7fb3580694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7f43369ff700 1 Processor -- start 2023-10-10T21:02:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.865+0000 7f43369ff700 1 -- start start 2023-10-10T21:02:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.866+0000 7f2fc7fff700 1 --2- 172.21.15.154:0/887604419 >> v2:172.21.15.154:3300/0 conn(0x7f2fc815da80 0x7f2fc806e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7f2fc77fe700 1 --2- 172.21.15.154:0/887604419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc815de50 0x7f2fc80c6a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80099b0 tx=0x7f2fb8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7fd88e0ec577df5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7f2fc6ffd700 1 -- 172.21.15.154:0/887604419 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800b7e0 con 0x7f2fc815de50 2023-10-10T21:02:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7f43369ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328007430 0x7f4328007800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7f43369ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4328055450 0x7f43280ea250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7fb37999a700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb358067000 0x7fb3580694b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3700093f0 tx=0x7fb370016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7fc3a1d9b700 1 -- 172.21.15.154:0/511469678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40afc40 msgr2=0x7fc3a414df80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7fc3a1d9b700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40afc40 0x7fc3a414df80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7fc3a1d9b700 1 -- 172.21.15.154:0/511469678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a40b2140 msgr2=0x7fc3a41719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7fc3a1d9b700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a40b2140 0x7fc3a41719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7fc3a1d9b700 1 -- 172.21.15.154:0/511469678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980094f0 con 0x7fc3a40b0010 2023-10-10T21:02:26.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7fc3a2d9d700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a40b2140 0x7fc3a41719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:26.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7fc3a1d9b700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a40b0010 0x7fc3a4171460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40ace90 tx=0x7fc398017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f3393dff700 1 -- 172.21.15.154:0/3534595513 shutdown_connections 2023-10-10T21:02:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f3393dff700 1 --2- 172.21.15.154:0/3534595513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f338403b070 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f3393dff700 1 -- 172.21.15.154:0/3534595513 >> 172.21.15.154:0/3534595513 conn(0x7f338400f2f0 msgr2=0x7f3384059210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7f2fc6ffd700 1 -- 172.21.15.154:0/887604419 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800b940 con 0x7f2fc815de50 2023-10-10T21:02:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f2fc6ffd700 1 -- 172.21.15.154:0/887604419 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800bce0 con 0x7f2fc815de50 2023-10-10T21:02:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7f43369ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4328007d40 con 0x7f4328055880 2023-10-10T21:02:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7f43369ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43280eb070 con 0x7f4328055450 2023-10-10T21:02:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.867+0000 7f43369ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432803acc0 con 0x7f4328007430 2023-10-10T21:02:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f432ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328007430 0x7f4328007800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f432ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328007430 0x7f4328007800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58762/0 (socket says 172.21.15.154:58762) 2023-10-10T21:02:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f432ffff700 1 -- 172.21.15.154:0/817100001 learned_addr learned my addr 172.21.15.154:0/817100001 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f4334f9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4328055880 0x7f43280dce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38484/0 (socket says 172.21.15.154:38484) 2023-10-10T21:02:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f432f7fe700 1 --2- 172.21.15.154:0/817100001 >> v2:172.21.15.179:3300/0 conn(0x7f4328055450 0x7f43280ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f432ffff700 1 -- 172.21.15.154:0/817100001 >> v2:172.21.15.179:3300/0 conn(0x7f4328055450 msgr2=0x7f43280ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f432ffff700 1 --2- 172.21.15.154:0/817100001 >> v2:172.21.15.179:3300/0 conn(0x7f4328055450 0x7f43280ea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f432ffff700 1 -- 172.21.15.154:0/817100001 >> v1:172.21.15.154:6789/0 conn(0x7f4328055880 legacy=0x7f43280dce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f432ffff700 1 -- 172.21.15.154:0/817100001 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432803afa0 con 0x7f4328007430 2023-10-10T21:02:26.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f2fcd79d700 1 -- 172.21.15.154:0/887604419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc815de50 msgr2=0x7f2fc80c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f2fcd79d700 1 --2- 172.21.15.154:0/887604419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc815de50 0x7f2fc80c6a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80099b0 tx=0x7f2fb8009250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.868+0000 7f432f7fe700 1 --2- 172.21.15.154:0/817100001 >> v2:172.21.15.179:3300/0 conn(0x7f4328055450 0x7f43280ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:26.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f3393dff700 1 -- 172.21.15.154:0/3534595513 shutdown_connections 2023-10-10T21:02:26.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f3393dff700 1 -- 172.21.15.154:0/3534595513 wait complete. 2023-10-10T21:02:26.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f432ffff700 1 --2- 172.21.15.154:0/817100001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328007430 0x7f4328007800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43240099b0 tx=0x7f4324009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5abecbedddba849 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f2fcd79d700 1 -- 172.21.15.154:0/887604419 shutdown_connections 2023-10-10T21:02:26.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f2fcd79d700 1 --2- 172.21.15.154:0/887604419 >> v2:172.21.15.154:3300/0 conn(0x7f2fc815da80 0x7f2fc806e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f2fcd79d700 1 --2- 172.21.15.154:0/887604419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc815de50 0x7f2fc80c6a40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f2fcd79d700 1 -- 172.21.15.154:0/887604419 >> 172.21.15.154:0/887604419 conn(0x7f2fc80cc1f0 msgr2=0x7f2fc80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f432effd700 1 -- 172.21.15.154:0/817100001 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432400b820 con 0x7f4328007430 2023-10-10T21:02:26.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f2fcd79d700 1 -- 172.21.15.154:0/887604419 shutdown_connections 2023-10-10T21:02:26.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f2fcd79d700 1 -- 172.21.15.154:0/887604419 wait complete. 2023-10-10T21:02:26.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f432effd700 1 -- 172.21.15.154:0/817100001 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432400b980 con 0x7f4328007430 2023-10-10T21:02:26.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.869+0000 7f432effd700 1 -- 172.21.15.154:0/817100001 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432400bd20 con 0x7f4328007430 2023-10-10T21:02:26.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.870+0000 7f43369ff700 1 -- 172.21.15.154:0/817100001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328007430 msgr2=0x7f4328007800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.870+0000 7f43369ff700 1 --2- 172.21.15.154:0/817100001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328007430 0x7f4328007800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43240099b0 tx=0x7f4324009250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.870+0000 7f43369ff700 1 -- 172.21.15.154:0/817100001 shutdown_connections 2023-10-10T21:02:26.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.870+0000 7f43369ff700 1 --2- 172.21.15.154:0/817100001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328007430 0x7f4328007800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.870+0000 7f43369ff700 1 --2- 172.21.15.154:0/817100001 >> v2:172.21.15.179:3300/0 conn(0x7f4328055450 0x7f43280ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.870+0000 7f43369ff700 1 -- 172.21.15.154:0/817100001 >> 172.21.15.154:0/817100001 conn(0x7f4328059cd0 msgr2=0x7f4328055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.871+0000 7facfeb9d700 1 Processor -- start 2023-10-10T21:02:26.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.871+0000 7f43369ff700 1 -- 172.21.15.154:0/817100001 shutdown_connections 2023-10-10T21:02:26.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.871+0000 7f2fcd79d700 1 Processor -- start 2023-10-10T21:02:26.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.871+0000 7f43369ff700 1 -- 172.21.15.154:0/817100001 wait complete. 2023-10-10T21:02:26.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.871+0000 7facfeb9d700 1 -- start start 2023-10-10T21:02:26.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.871+0000 7f3393dff700 1 Processor -- start 2023-10-10T21:02:26.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.871+0000 7f2fcd79d700 1 -- start start 2023-10-10T21:02:26.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.872+0000 7f3393dff700 1 -- start start 2023-10-10T21:02:26.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.872+0000 7f2fcd79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc80696c0 0x7f2fc814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.872+0000 7f2fcd79d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc815da80 0x7f2fc80b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.872+0000 7f2fcd79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc815de50 0x7f2fc80c2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.872+0000 7f5163fff700 1 -- 172.21.15.154:0/1564767089 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51780c9260 con 0x7f51700e24c0 2023-10-10T21:02:26.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7f2fcd79d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80b1170 con 0x7f2fc815da80 2023-10-10T21:02:26.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7f2fcd79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80b1450 con 0x7f2fc80696c0 2023-10-10T21:02:26.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7f2fcd79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80b1730 con 0x7f2fc815de50 2023-10-10T21:02:26.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7f2fccf9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc815de50 0x7f2fc80c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7f2fccf9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc815de50 0x7f2fc80c2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58772/0 (socket says 172.21.15.154:58772) 2023-10-10T21:02:26.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7f2fccf9c700 1 -- 172.21.15.154:0/2576513032 learned_addr learned my addr 172.21.15.154:0/2576513032 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7facfeb9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7facf8159420 0x7facf80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7facfeb9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7facf81597f0 0x7facf80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7facfeb9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf80b11d0 con 0x7facf815d230 2023-10-10T21:02:26.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7f2fc77fe700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc815da80 0x7f2fc80b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7f3393dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840063d0 0x7f338404ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7facfeb9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf80b14b0 con 0x7facf81597f0 2023-10-10T21:02:26.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7facfeb9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf80b1790 con 0x7facf8159420 2023-10-10T21:02:26.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.873+0000 7f2fc7fff700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc80696c0 0x7f2fc814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f3393dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f3384051e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f3391b9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840063d0 0x7f338404ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f43369ff700 1 Processor -- start 2023-10-10T21:02:26.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f3391b9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840063d0 0x7f338404ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:50014/0 (socket says 172.21.15.154:50014) 2023-10-10T21:02:26.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f2fc7fff700 1 -- 172.21.15.154:0/2576513032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc815de50 msgr2=0x7f2fc80c2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f2fc7fff700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc815de50 0x7f2fc80c2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f2fc7fff700 1 -- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc815da80 msgr2=0x7f2fc80b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7facfd39a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7facf81597f0 0x7facf80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f339139a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f3384051e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f339139a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f3384051e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58786/0 (socket says 172.21.15.154:58786) 2023-10-10T21:02:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7facfd39a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7facf81597f0 0x7facf80b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55688/0 (socket says 172.21.15.154:55688) 2023-10-10T21:02:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7facfd39a700 1 -- 172.21.15.154:0/3252299240 learned_addr learned my addr 172.21.15.154:0/3252299240 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f3393dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33840e1e60 0x7f33840e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f43369ff700 1 -- start start 2023-10-10T21:02:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f339239c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33840e1e60 0x7f33840e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7facfd39a700 1 -- 172.21.15.154:0/3252299240 >> v2:172.21.15.179:3300/0 conn(0x7facf8159420 msgr2=0x7facf80b5f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-10T21:02:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7facfd39a700 1 --2- 172.21.15.154:0/3252299240 >> v2:172.21.15.179:3300/0 conn(0x7facf8159420 0x7facf80b5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7facfd39a700 1 -- 172.21.15.154:0/3252299240 >> v1:172.21.15.179:6789/0 conn(0x7facf815d230 legacy=0x7facf815d630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-10T21:02:26.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7facfd39a700 1 -- 172.21.15.154:0/3252299240 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80b1a70 con 0x7facf81597f0 2023-10-10T21:02:26.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f339239c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33840e1e60 0x7f33840e4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55702/0 (socket says 172.21.15.154:55702) 2023-10-10T21:02:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f3391b9b700 1 -- 172.21.15.154:0/4119460148 learned_addr learned my addr 172.21.15.154:0/4119460148 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33840e2970 con 0x7f33840e1e60 2023-10-10T21:02:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33840e34f0 con 0x7f33840063d0 2023-10-10T21:02:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33840e2bc0 con 0x7f3384007950 2023-10-10T21:02:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f2fc7fff700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc815da80 0x7f2fc80b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.874+0000 7f2fc7fff700 1 -- 172.21.15.154:0/2576513032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80094f0 con 0x7f2fc80696c0 2023-10-10T21:02:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f2fc7fff700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc80696c0 0x7f2fc814d520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc006fd0 tx=0x7f2fbc008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f2faffff700 1 -- 172.21.15.154:0/2576513032 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc013410 con 0x7f2fc80696c0 2023-10-10T21:02:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7facfd39a700 1 --2- 172.21.15.154:0/3252299240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf81597f0 0x7facf80b2270 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7facf80b2f20 tx=0x7facf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bc3246ce23f317 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f2fcd79d700 1 -- 172.21.15.154:0/2576513032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc80b1a10 con 0x7f2fc80696c0 2023-10-10T21:02:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.875+0000 7f2fcd79d700 1 -- 172.21.15.154:0/2576513032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc814da60 con 0x7f2fc80696c0 2023-10-10T21:02:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f2faffff700 1 -- 172.21.15.154:0/2576513032 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc013570 con 0x7f2fc80696c0 2023-10-10T21:02:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f2faffff700 1 -- 172.21.15.154:0/2576513032 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc013910 con 0x7f2fc80696c0 2023-10-10T21:02:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f43369ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4328007430 0x7f432803c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f43369ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328055450 0x7f432803e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f43369ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328055880 0x7f432803e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f2fc77fe700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc815da80 0x7f2fc80b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:26.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f43369ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432804d610 con 0x7f4328055880 2023-10-10T21:02:26.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f43369ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432803ed30 con 0x7f4328007430 2023-10-10T21:02:26.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.876+0000 7f43369ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43280ec100 con 0x7f4328055450 2023-10-10T21:02:26.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.877+0000 7f339239c700 1 -- 172.21.15.154:0/4119460148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 msgr2=0x7f3384051e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.877+0000 7f4334f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328055880 0x7f432803e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.877+0000 7f339239c700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f3384051e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.877+0000 7f4334f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328055880 0x7f432803e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55708/0 (socket says 172.21.15.154:55708) 2023-10-10T21:02:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.877+0000 7f4334f9c700 1 -- 172.21.15.154:0/1595881782 learned_addr learned my addr 172.21.15.154:0/1595881782 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.877+0000 7f339239c700 1 -- 172.21.15.154:0/4119460148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840063d0 msgr2=0x7f338404ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f339239c700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840063d0 0x7f338404ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f4334f9c700 1 -- 172.21.15.154:0/1595881782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328055450 msgr2=0x7f432803e2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f339239c700 1 -- 172.21.15.154:0/4119460148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0094f0 con 0x7f33840e1e60 2023-10-10T21:02:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f4334f9c700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328055450 0x7f432803e2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f2fcd79d700 1 -- 172.21.15.154:0/2576513032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa80052b0 con 0x7f2fc80696c0 2023-10-10T21:02:26.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f4334f9c700 1 -- 172.21.15.154:0/1595881782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4328007430 msgr2=0x7f432803c6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-10T21:02:26.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f4334f9c700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4328007430 0x7f432803c6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f339239c700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33840e1e60 0x7f33840e4b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3384011d00 tx=0x7f337c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f4334f9c700 1 -- 172.21.15.154:0/1595881782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43240094f0 con 0x7f4328055880 2023-10-10T21:02:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.878+0000 7f4334f9c700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328055880 0x7f432803e7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f433004c860 tx=0x7f4330067410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.879+0000 7f2faffff700 1 -- 172.21.15.154:0/2576513032 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fbc013d00 con 0x7f2fc80696c0 2023-10-10T21:02:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.880+0000 7fb36a7fc700 1 -- 172.21.15.154:0/1747861787 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb364051d50 con 0x7fb36c0060c0 2023-10-10T21:02:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.880+0000 7fc3927fc700 1 -- 172.21.15.154:0/511469678 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39801a660 con 0x7fc3a40b0010 2023-10-10T21:02:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.880+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a4154e90 con 0x7fc3a40b0010 2023-10-10T21:02:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.880+0000 7f2faffff700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2fb4067000 0x7f2fb40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.880+0000 7f3381ffb700 1 -- 172.21.15.154:0/4119460148 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c01b680 con 0x7f33840e1e60 2023-10-10T21:02:26.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.880+0000 7f2faffff700 1 -- 172.21.15.154:0/2576513032 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2fbc084460 con 0x7f2fc80696c0 2023-10-10T21:02:26.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.880+0000 7fc3927fc700 1 -- 172.21.15.154:0/511469678 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39801a9d0 con 0x7fc3a40b0010 2023-10-10T21:02:26.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.880+0000 7fc3927fc700 1 -- 172.21.15.154:0/511469678 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39801ab40 con 0x7fc3a40b0010 2023-10-10T21:02:26.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.880+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a4155450 con 0x7fc3a40b0010 2023-10-10T21:02:26.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7f431bfff700 1 -- 172.21.15.154:0/1595881782 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433004c440 con 0x7f4328055880 2023-10-10T21:02:26.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7facfcb99700 1 -- 172.21.15.154:0/3252299240 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400b820 con 0x7facf81597f0 2023-10-10T21:02:26.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43280ec3e0 con 0x7f4328055880 2023-10-10T21:02:26.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33840e2ea0 con 0x7f33840e1e60 2023-10-10T21:02:26.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7facfcb99700 1 -- 172.21.15.154:0/3252299240 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf400b980 con 0x7facf81597f0 2023-10-10T21:02:26.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7facfcb99700 1 -- 172.21.15.154:0/3252299240 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400bd20 con 0x7facf81597f0 2023-10-10T21:02:26.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43280ec9a0 con 0x7f4328055880 2023-10-10T21:02:26.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7ff39ffff700 1 Processor -- start 2023-10-10T21:02:26.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7ff39ffff700 1 -- start start 2023-10-10T21:02:26.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.881+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338404cf40 con 0x7f33840e1e60 2023-10-10T21:02:26.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.882+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4328005530 con 0x7f4328055880 2023-10-10T21:02:26.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.882+0000 7f2fc77fe700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2fb4067000 0x7f2fb40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.883+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3384005980 con 0x7f33840e1e60 2023-10-10T21:02:26.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.883+0000 7f2fc77fe700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2fb4067000 0x7f2fb40694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80099b0 tx=0x7f2fb8016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.883+0000 7ff39ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3a0159420 0x7ff3a00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.883+0000 7ff39ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3a015d230 0x7ff3a015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.883+0000 7ff39ffff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a00b2980 con 0x7ff3a01597f0 2023-10-10T21:02:26.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.883+0000 7ff39ffff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a015db70 con 0x7ff3a0159420 2023-10-10T21:02:26.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.883+0000 7ff39ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a00b11d0 con 0x7ff3a015d230 2023-10-10T21:02:26.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.884+0000 7facfeb9d700 1 -- 172.21.15.154:0/3252299240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf81597f0 msgr2=0x7facf80b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.884+0000 7facfeb9d700 1 --2- 172.21.15.154:0/3252299240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf81597f0 0x7facf80b2270 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7facf80b2f20 tx=0x7facf4009250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.885+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3880052b0 con 0x7fc3a40b0010 2023-10-10T21:02:26.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.885+0000 7f2faffff700 1 -- 172.21.15.154:0/2576513032 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fbc0516f0 con 0x7f2fc80696c0 2023-10-10T21:02:26.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.884+0000 7facfeb9d700 1 -- 172.21.15.154:0/3252299240 shutdown_connections 2023-10-10T21:02:26.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.884+0000 7facfeb9d700 1 --2- 172.21.15.154:0/3252299240 >> v2:172.21.15.179:3300/0 conn(0x7facf8159420 0x7facf80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.884+0000 7facfeb9d700 1 --2- 172.21.15.154:0/3252299240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf81597f0 0x7facf80b2270 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.884+0000 7facfeb9d700 1 -- 172.21.15.154:0/3252299240 >> 172.21.15.154:0/3252299240 conn(0x7facf80d0660 msgr2=0x7facf80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.885+0000 7facfeb9d700 1 -- 172.21.15.154:0/3252299240 shutdown_connections 2023-10-10T21:02:26.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.885+0000 7facfeb9d700 1 -- 172.21.15.154:0/3252299240 wait complete. 2023-10-10T21:02:26.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.884+0000 7ff39f7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3a015d230 0x7ff3a015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.884+0000 7ff39f7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3a015d230 0x7ff3a015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:50046/0 (socket says 172.21.15.154:50046) 2023-10-10T21:02:26.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.884+0000 7ff39f7fe700 1 -- 172.21.15.154:0/2741125172 learned_addr learned my addr 172.21.15.154:0/2741125172 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.886+0000 7ff39f7fe700 1 -- 172.21.15.154:0/2741125172 >> v2:172.21.15.154:3300/0 conn(0x7ff3a0159420 msgr2=0x7ff3a00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.886+0000 7ff39f7fe700 1 --2- 172.21.15.154:0/2741125172 >> v2:172.21.15.154:3300/0 conn(0x7ff3a0159420 0x7ff3a00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.886+0000 7ff39f7fe700 1 -- 172.21.15.154:0/2741125172 >> v1:172.21.15.154:6789/0 conn(0x7ff3a01597f0 legacy=0x7ff3a00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:26.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.886+0000 7ff39f7fe700 1 -- 172.21.15.154:0/2741125172 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00b14b0 con 0x7ff3a015d230 2023-10-10T21:02:26.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.886+0000 7ff39f7fe700 1 --2- 172.21.15.154:0/2741125172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a015d230 0x7ff3a015d630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3a015d170 tx=0x7ff394009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77fef62227aa1ac server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.887+0000 7fc3927fc700 1 -- 172.21.15.154:0/511469678 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc39802e440 con 0x7fc3a40b0010 2023-10-10T21:02:26.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.887+0000 7facfeb9d700 1 Processor -- start 2023-10-10T21:02:26.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.888+0000 7facfeb9d700 1 -- start start 2023-10-10T21:02:26.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.888+0000 7f3381ffb700 1 -- 172.21.15.154:0/4119460148 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c006bc0 con 0x7f33840e1e60 2023-10-10T21:02:26.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.888+0000 7f3381ffb700 1 -- 172.21.15.154:0/4119460148 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c01b9f0 con 0x7f33840e1e60 2023-10-10T21:02:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.889+0000 7ff39dffb700 1 -- 172.21.15.154:0/2741125172 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400b820 con 0x7ff3a015d230 2023-10-10T21:02:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.889+0000 7ff39dffb700 1 -- 172.21.15.154:0/2741125172 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39400b980 con 0x7ff3a015d230 2023-10-10T21:02:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.889+0000 7ff39dffb700 1 -- 172.21.15.154:0/2741125172 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400bd00 con 0x7ff3a015d230 2023-10-10T21:02:26.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.889+0000 7fc3927fc700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc384066f30 0x7fc3840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.889+0000 7fc3927fc700 1 -- 172.21.15.154:0/511469678 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3980865c0 con 0x7fc3a40b0010 2023-10-10T21:02:26.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.889+0000 7f3381ffb700 1 -- 172.21.15.154:0/4119460148 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f337c01bbf0 con 0x7f33840e1e60 2023-10-10T21:02:26.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.890+0000 7f431bfff700 1 -- 172.21.15.154:0/1595881782 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43300648e0 con 0x7f4328055880 2023-10-10T21:02:26.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.890+0000 7f431bfff700 1 -- 172.21.15.154:0/1595881782 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433006a620 con 0x7f4328055880 2023-10-10T21:02:26.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.890+0000 7fc3a259c700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc384066f30 0x7fc3840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.891+0000 7f3381ffb700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3370066fb0 0x7f3370069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.891+0000 7fc3a259c700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc384066f30 0x7fc3840693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009740 tx=0x7fc39c006c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.891+0000 7f3381ffb700 1 -- 172.21.15.154:0/4119460148 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f337c086580 con 0x7f33840e1e60 2023-10-10T21:02:26.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.891+0000 7f3391b9b700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3370066fb0 0x7f3370069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.891+0000 7f431bfff700 1 -- 172.21.15.154:0/1595881782 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f433009a430 con 0x7f4328055880 2023-10-10T21:02:26.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.892+0000 7f431bfff700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4314066f30 0x7f43140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.892+0000 7f431bfff700 1 -- 172.21.15.154:0/1595881782 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43300fb960 con 0x7f4328055880 2023-10-10T21:02:26.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.890+0000 7ff39ffff700 1 -- 172.21.15.154:0/2741125172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a015d230 msgr2=0x7ff3a015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.890+0000 7ff39ffff700 1 --2- 172.21.15.154:0/2741125172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a015d230 0x7ff3a015d630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3a015d170 tx=0x7ff394009250 comp rx=0 tx=0).stop 2023-10-10T21:02:26.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.892+0000 7ff39ffff700 1 -- 172.21.15.154:0/2741125172 shutdown_connections 2023-10-10T21:02:26.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.892+0000 7ff39ffff700 1 --2- 172.21.15.154:0/2741125172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a015d230 0x7ff3a015d630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.892+0000 7ff39ffff700 1 --2- 172.21.15.154:0/2741125172 >> v2:172.21.15.154:3300/0 conn(0x7ff3a0159420 0x7ff3a00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.892+0000 7ff39ffff700 1 -- 172.21.15.154:0/2741125172 >> 172.21.15.154:0/2741125172 conn(0x7ff3a00d0660 msgr2=0x7ff3a00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:26.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.893+0000 7f3391b9b700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3370066fb0 0x7f3370069460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f338c076ea0 tx=0x7f338c067410 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.893+0000 7facfeb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf8159420 0x7facf815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.894+0000 7f432ffff700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4314066f30 0x7f43140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.893+0000 7facfeb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf81597f0 0x7facf816df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.893+0000 7facfeb9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf815d230 0x7facf80cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.893+0000 7facfeb9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf806d400 con 0x7facf815d230 2023-10-10T21:02:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.893+0000 7facfeb9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf815bcf0 con 0x7facf8159420 2023-10-10T21:02:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.893+0000 7facfeb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf815b450 con 0x7facf81597f0 2023-10-10T21:02:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.894+0000 7facfd39a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf81597f0 0x7facf816df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.894+0000 7facfd39a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf81597f0 0x7facf816df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58812/0 (socket says 172.21.15.154:58812) 2023-10-10T21:02:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.894+0000 7facfd39a700 1 -- 172.21.15.154:0/198514277 learned_addr learned my addr 172.21.15.154:0/198514277 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.895+0000 7ff39ffff700 1 -- 172.21.15.154:0/2741125172 shutdown_connections 2023-10-10T21:02:26.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.894+0000 7facfdb9b700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf8159420 0x7facf815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.894+0000 7facfe39c700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf815d230 0x7facf80cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.894+0000 7f432ffff700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4314066f30 0x7f43140693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43240099b0 tx=0x7f4324016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.895+0000 7facfd39a700 1 -- 172.21.15.154:0/198514277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf8159420 msgr2=0x7facf815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.895+0000 7facfd39a700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf8159420 0x7facf815ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.895+0000 7facfd39a700 1 -- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf815d230 msgr2=0x7facf80cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.895+0000 7facfd39a700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf815d230 0x7facf80cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.895+0000 7facfd39a700 1 -- 172.21.15.154:0/198514277 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40094f0 con 0x7facf81597f0 2023-10-10T21:02:26.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.895+0000 7ff39ffff700 1 -- 172.21.15.154:0/2741125172 wait complete. 2023-10-10T21:02:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.895+0000 7facfd39a700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf81597f0 0x7facf816df20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7facf4003080 tx=0x7facf4016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.896+0000 7facedffb700 1 -- 172.21.15.154:0/198514277 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4011d90 con 0x7facf81597f0 2023-10-10T21:02:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.896+0000 7facedffb700 1 -- 172.21.15.154:0/198514277 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf4020070 con 0x7facf81597f0 2023-10-10T21:02:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.896+0000 7facedffb700 1 -- 172.21.15.154:0/198514277 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf401b6a0 con 0x7facf81597f0 2023-10-10T21:02:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.897+0000 7fc3927fc700 1 -- 172.21.15.154:0/511469678 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc398053810 con 0x7fc3a40b0010 2023-10-10T21:02:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.897+0000 7ff39ffff700 1 Processor -- start 2023-10-10T21:02:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.900+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf815b730 con 0x7facf81597f0 2023-10-10T21:02:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.900+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf815b140 con 0x7facf81597f0 2023-10-10T21:02:26.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.898+0000 7ff39ffff700 1 -- start start 2023-10-10T21:02:26.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.899+0000 7ff39ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a0159420 0x7ff3a00cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.899+0000 7ff39ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a01597f0 0x7ff3a00c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.899+0000 7ff39ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a015d230 0x7ff3a00c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.899+0000 7ff39ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0155840 con 0x7ff3a0159420 2023-10-10T21:02:26.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.899+0000 7ff39ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00c5e80 con 0x7ff3a01597f0 2023-10-10T21:02:26.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.899+0000 7ff39ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00cb270 con 0x7ff3a015d230 2023-10-10T21:02:26.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.900+0000 7ff39e7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a01597f0 0x7ff3a00c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.903+0000 7f3381ffb700 1 -- 172.21.15.154:0/4119460148 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f337c053870 con 0x7f33840e1e60 2023-10-10T21:02:26.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.900+0000 7ff39e7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a01597f0 0x7ff3a00c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:50060/0 (socket says 172.21.15.154:50060) 2023-10-10T21:02:26.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.900+0000 7ff39e7fc700 1 -- 172.21.15.154:0/2598289110 learned_addr learned my addr 172.21.15.154:0/2598289110 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:26.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.900+0000 7ff39effd700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a0159420 0x7ff3a00cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.900+0000 7ff39f7fe700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a015d230 0x7ff3a00c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:26.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.904+0000 7facedffb700 1 -- 172.21.15.154:0/198514277 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facf4022030 con 0x7facf81597f0 2023-10-10T21:02:26.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.906+0000 7facedffb700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7facdc067080 0x7facdc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:26.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.906+0000 7facedffb700 1 -- 172.21.15.154:0/198514277 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7facf4086540 con 0x7facf81597f0 2023-10-10T21:02:26.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.901+0000 7ff39f7fe700 1 -- 172.21.15.154:0/2598289110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a01597f0 msgr2=0x7ff3a00c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.901+0000 7ff39f7fe700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a01597f0 0x7ff3a00c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.901+0000 7ff39f7fe700 1 -- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a0159420 msgr2=0x7ff3a00cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:26.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.901+0000 7ff39f7fe700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a0159420 0x7ff3a00cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:26.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.901+0000 7ff39f7fe700 1 -- 172.21.15.154:0/2598289110 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940094f0 con 0x7ff3a015d230 2023-10-10T21:02:26.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.902+0000 7ff39f7fe700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a015d230 0x7ff3a00c5940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff394002000 tx=0x7ff394016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:26.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.902+0000 7ff386ffd700 1 -- 172.21.15.154:0/2598289110 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394011ae0 con 0x7ff3a015d230 2023-10-10T21:02:26.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.902+0000 7ff386ffd700 1 -- 172.21.15.154:0/2598289110 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff394011c40 con 0x7ff3a015d230 2023-10-10T21:02:26.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.902+0000 7ff386ffd700 1 -- 172.21.15.154:0/2598289110 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940202c0 con 0x7ff3a015d230 2023-10-10T21:02:27.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.907+0000 7facfdb9b700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7facdc067080 0x7facdc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:27.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.902+0000 7ff39ffff700 1 -- 172.21.15.154:0/2598289110 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a00ca660 con 0x7ff3a015d230 2023-10-10T21:02:27.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.902+0000 7ff39ffff700 1 -- 172.21.15.154:0/2598289110 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a00cac20 con 0x7ff3a015d230 2023-10-10T21:02:27.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.907+0000 7ff386ffd700 1 -- 172.21.15.154:0/2598289110 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff394020670 con 0x7ff3a015d230 2023-10-10T21:02:27.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.908+0000 7facfdb9b700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7facdc067080 0x7facdc069530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7face8006fd0 tx=0x7face8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:27.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.908+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf806d5b0 con 0x7facf81597f0 2023-10-10T21:02:27.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.906+0000 7ff3857fa700 1 -- 172.21.15.154:0/2598289110 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a004c3c0 con 0x7ff3a015d230 2023-10-10T21:02:27.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.910+0000 7ff386ffd700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c067000 0x7ff38c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:27.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.910+0000 7ff386ffd700 1 -- 172.21.15.154:0/2598289110 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff394096500 con 0x7ff3a015d230 2023-10-10T21:02:27.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.910+0000 7ff39effd700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c067000 0x7ff38c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:27.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.910+0000 7f431bfff700 1 -- 172.21.15.154:0/1595881782 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43300c8c50 con 0x7f4328055880 2023-10-10T21:02:27.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.911+0000 7ff39effd700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c067000 0x7ff38c0694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff390009bf0 tx=0x7ff3900091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:27.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.916+0000 7facedffb700 1 -- 172.21.15.154:0/198514277 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facf806d5b0 con 0x7facf81597f0 2023-10-10T21:02:27.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:26.921+0000 7ff386ffd700 1 -- 172.21.15.154:0/2598289110 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff394063750 con 0x7ff3a015d230 2023-10-10T21:02:27.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.302+0000 7f517e5ff700 1 -- 172.21.15.154:0/1564767089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5170051980 con 0x7f51700e24c0 2023-10-10T21:02:27.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.304+0000 7f5163fff700 1 -- 172.21.15.154:0/1564767089 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5178095090 con 0x7f51700e24c0 2023-10-10T21:02:27.306 INFO:teuthology.orchestra.run.smithi154.stdout:60129542148 2023-10-10T21:02:27.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.308+0000 7f5161ffb700 1 -- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c067080 msgr2=0x7f515c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.308+0000 7f5161ffb700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c067080 0x7f515c069530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51700f7810 tx=0x7f51640091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.309+0000 7f5161ffb700 1 -- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700e24c0 msgr2=0x7f5170057c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.309+0000 7f5161ffb700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700e24c0 0x7f5170057c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5178066e40 tx=0x7f5178066260 comp rx=0 tx=0).stop 2023-10-10T21:02:27.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.309+0000 7f5161ffb700 1 -- 172.21.15.154:0/1564767089 shutdown_connections 2023-10-10T21:02:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.309+0000 7f5161ffb700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700e24c0 0x7f5170057c40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.310+0000 7f5161ffb700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5170039050 0x7f51700f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.310+0000 7f5161ffb700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c067080 0x7f515c069530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.310+0000 7f5161ffb700 1 --2- 172.21.15.154:0/1564767089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5170039420 0x7f51700e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.310+0000 7f5161ffb700 1 -- 172.21.15.154:0/1564767089 >> 172.21.15.154:0/1564767089 conn(0x7f5170059b30 msgr2=0x7f5170038130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:27.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.310+0000 7f5161ffb700 1 -- 172.21.15.154:0/1564767089 shutdown_connections 2023-10-10T21:02:27.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.311+0000 7f5161ffb700 1 -- 172.21.15.154:0/1564767089 wait complete. 2023-10-10T21:02:27.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.317+0000 7fb37c3ff700 1 -- 172.21.15.154:0/1747861787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb36c037bd0 con 0x7fb36c0060c0 2023-10-10T21:02:27.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.319+0000 7fb36a7fc700 1 -- 172.21.15.154:0/1747861787 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb364051d50 con 0x7fb36c0060c0 2023-10-10T21:02:27.320 INFO:teuthology.orchestra.run.smithi154.stdout:60129542150 2023-10-10T21:02:27.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.323+0000 7fb357fff700 1 -- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb358067000 msgr2=0x7fb3580694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.323+0000 7fb357fff700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb358067000 0x7fb3580694b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3700093f0 tx=0x7fb370016000 comp rx=0 tx=0).stop 2023-10-10T21:02:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.323+0000 7fb357fff700 1 -- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb36c0060c0 msgr2=0x7fb36c0db040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.324+0000 7fb357fff700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb36c0060c0 0x7fb36c0db040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb36400c840 tx=0x7fb364007ee0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.324+0000 7fb357fff700 1 -- 172.21.15.154:0/1747861787 shutdown_connections 2023-10-10T21:02:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.324+0000 7fb357fff700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb358067000 0x7fb3580694b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.325+0000 7fb357fff700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb36c0d5240 0x7fb36c03a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.325+0000 7fb357fff700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb36c0060c0 0x7fb36c0db040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.325+0000 7fb357fff700 1 --2- 172.21.15.154:0/1747861787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb36c033f10 0x7fb36c0d39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.325+0000 7fb357fff700 1 -- 172.21.15.154:0/1747861787 >> 172.21.15.154:0/1747861787 conn(0x7fb36c0518a0 msgr2=0x7fb36c036930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.325+0000 7fb357fff700 1 -- 172.21.15.154:0/1747861787 shutdown_connections 2023-10-10T21:02:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.325+0000 7fb357fff700 1 -- 172.21.15.154:0/1747861787 wait complete. 2023-10-10T21:02:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.329+0000 7f2fcd79d700 1 -- 172.21.15.154:0/2576513032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2fa8005560 con 0x7f2fc80696c0 2023-10-10T21:02:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.330+0000 7f2faffff700 1 -- 172.21.15.154:0/2576513032 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2fbc054d10 con 0x7f2fc80696c0 2023-10-10T21:02:27.332 INFO:teuthology.orchestra.run.smithi154.stdout:60129542148 2023-10-10T21:02:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.334+0000 7f2fadffb700 1 -- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2fb4067000 msgr2=0x7f2fb40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.334+0000 7f2fadffb700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2fb4067000 0x7f2fb40694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80099b0 tx=0x7f2fb8016000 comp rx=0 tx=0).stop 2023-10-10T21:02:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.335+0000 7f2fadffb700 1 -- 172.21.15.154:0/2576513032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc80696c0 msgr2=0x7f2fc814d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.335+0000 7f2fadffb700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc80696c0 0x7f2fc814d520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc006fd0 tx=0x7f2fbc008040 comp rx=0 tx=0).stop 2023-10-10T21:02:27.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.335+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc388005830 con 0x7fc3a40b0010 2023-10-10T21:02:27.338 INFO:teuthology.orchestra.run.smithi154.stdout:60129542150 2023-10-10T21:02:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.336+0000 7fc3927fc700 1 -- 172.21.15.154:0/511469678 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc398084e60 con 0x7fc3a40b0010 2023-10-10T21:02:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.337+0000 7f2fadffb700 1 -- 172.21.15.154:0/2576513032 shutdown_connections 2023-10-10T21:02:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.337+0000 7f2fadffb700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2fb4067000 0x7f2fb40694b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.337+0000 7f2fadffb700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc815de50 0x7f2fc80c2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.337+0000 7f2fadffb700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc80696c0 0x7f2fc814d520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.337+0000 7f2fadffb700 1 --2- 172.21.15.154:0/2576513032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc815da80 0x7f2fc80b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.337+0000 7f2fadffb700 1 -- 172.21.15.154:0/2576513032 >> 172.21.15.154:0/2576513032 conn(0x7f2fc80cc1f0 msgr2=0x7f2fc814f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.338+0000 7f2fadffb700 1 -- 172.21.15.154:0/2576513032 shutdown_connections 2023-10-10T21:02:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.338+0000 7f2fadffb700 1 -- 172.21.15.154:0/2576513032 wait complete. 2023-10-10T21:02:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.339+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f33840e3340 con 0x7f33840e1e60 2023-10-10T21:02:27.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2023-10-10T21:02:27.342 INFO:teuthology.orchestra.run.smithi154.stdout:60129542150 2023-10-10T21:02:27.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.340+0000 7f3381ffb700 1 -- 172.21.15.154:0/4119460148 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f337c057240 con 0x7f33840e1e60 2023-10-10T21:02:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.341+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc384066f30 msgr2=0x7fc3840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.341+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc384066f30 0x7fc3840693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009740 tx=0x7fc39c006c60 comp rx=0 tx=0).stop 2023-10-10T21:02:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.341+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a40b0010 msgr2=0x7fc3a4171460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.341+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a40b0010 0x7fc3a4171460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40ace90 tx=0x7fc398017000 comp rx=0 tx=0).stop 2023-10-10T21:02:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.342+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 shutdown_connections 2023-10-10T21:02:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.342+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a40b2140 0x7fc3a41719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.342+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc384066f30 0x7fc3840693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.342+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a40afc40 0x7fc3a414df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.342+0000 7fc3a8bff700 1 --2- 172.21.15.154:0/511469678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a40b0010 0x7fc3a4171460 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.342+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 >> 172.21.15.154:0/511469678 conn(0x7fc3a406a320 msgr2=0x7fc3a4157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.342+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 shutdown_connections 2023-10-10T21:02:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.342+0000 7fc3a8bff700 1 -- 172.21.15.154:0/511469678 wait complete. 2023-10-10T21:02:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.344+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3370066fb0 msgr2=0x7f3370069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.344+0000 7f3393dff700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3370066fb0 0x7f3370069460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f338c076ea0 tx=0x7f338c067410 comp rx=0 tx=0).stop 2023-10-10T21:02:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.344+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33840e1e60 msgr2=0x7f33840e4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.344+0000 7f3393dff700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33840e1e60 0x7f33840e4b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3384011d00 tx=0x7f337c016000 comp rx=0 tx=0).stop 2023-10-10T21:02:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.345+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 shutdown_connections 2023-10-10T21:02:27.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.345+0000 7f3393dff700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33840e1e60 0x7f33840e4b20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.345+0000 7f3393dff700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840063d0 0x7f338404ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.345+0000 7f3393dff700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3370066fb0 0x7f3370069460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.345+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f432803b280 con 0x7f4328055880 2023-10-10T21:02:27.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.345+0000 7f3393dff700 1 --2- 172.21.15.154:0/4119460148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3384007950 0x7f3384051e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.346+0000 7f431bfff700 1 -- 172.21.15.154:0/1595881782 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4330095020 con 0x7f4328055880 2023-10-10T21:02:27.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.345+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 >> 172.21.15.154:0/4119460148 conn(0x7f338400f2f0 msgr2=0x7f3384057f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:27.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.345+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 shutdown_connections 2023-10-10T21:02:27.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.345+0000 7f3393dff700 1 -- 172.21.15.154:0/4119460148 wait complete. 2023-10-10T21:02:27.352 INFO:teuthology.orchestra.run.smithi154.stdout:60129542148 2023-10-10T21:02:27.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.350+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4314066f30 msgr2=0x7f43140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.350+0000 7f43369ff700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4314066f30 0x7f43140693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43240099b0 tx=0x7f4324016000 comp rx=0 tx=0).stop 2023-10-10T21:02:27.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.350+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328055880 msgr2=0x7f432803e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.350+0000 7f43369ff700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328055880 0x7f432803e7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f433004c860 tx=0x7f4330067410 comp rx=0 tx=0).stop 2023-10-10T21:02:27.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.351+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 shutdown_connections 2023-10-10T21:02:27.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.351+0000 7f43369ff700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328055880 0x7f432803e7f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.351+0000 7f43369ff700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4328007430 0x7f432803c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.351+0000 7f43369ff700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4314066f30 0x7f43140693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.351+0000 7f43369ff700 1 --2- 172.21.15.154:0/1595881782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4328055450 0x7f432803e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.351+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 >> 172.21.15.154:0/1595881782 conn(0x7f4328059cd0 msgr2=0x7f43280e8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.352+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 shutdown_connections 2023-10-10T21:02:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.352+0000 7f43369ff700 1 -- 172.21.15.154:0/1595881782 wait complete. 2023-10-10T21:02:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.353+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7facf806d5b0 con 0x7facf81597f0 2023-10-10T21:02:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.354+0000 7facedffb700 1 -- 172.21.15.154:0/198514277 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7facf806d5b0 con 0x7facf81597f0 2023-10-10T21:02:27.356 INFO:teuthology.orchestra.run.smithi154.stdout:64424509445 2023-10-10T21:02:27.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2023-10-10T21:02:27.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.358+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7facdc067080 msgr2=0x7facdc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.358+0000 7facfeb9d700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7facdc067080 0x7facdc069530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7face8006fd0 tx=0x7face8008040 comp rx=0 tx=0).stop 2023-10-10T21:02:27.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.358+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf81597f0 msgr2=0x7facf816df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.358+0000 7facfeb9d700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf81597f0 0x7facf816df20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7facf4003080 tx=0x7facf4016000 comp rx=0 tx=0).stop 2023-10-10T21:02:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.359+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 shutdown_connections 2023-10-10T21:02:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.359+0000 7facfeb9d700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf815d230 0x7facf80cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.359+0000 7facfeb9d700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf8159420 0x7facf815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.359+0000 7facfeb9d700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7facdc067080 0x7facdc069530 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.359+0000 7facfeb9d700 1 --2- 172.21.15.154:0/198514277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf81597f0 0x7facf816df20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.359+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 >> 172.21.15.154:0/198514277 conn(0x7facf80d0660 msgr2=0x7facf80b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.359+0000 7ff3857fa700 1 -- 172.21.15.154:0/2598289110 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff3a00b1790 con 0x7ff3a015d230 2023-10-10T21:02:27.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.359+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 shutdown_connections 2023-10-10T21:02:27.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.359+0000 7facfeb9d700 1 -- 172.21.15.154:0/198514277 wait complete. 2023-10-10T21:02:27.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.360+0000 7ff386ffd700 1 -- 172.21.15.154:0/2598289110 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff39401e020 con 0x7ff3a015d230 2023-10-10T21:02:27.364 INFO:teuthology.orchestra.run.smithi154.stdout:60129542149 2023-10-10T21:02:27.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 -- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c067000 msgr2=0x7ff38c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c067000 0x7ff38c0694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff390009bf0 tx=0x7ff3900091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 -- 172.21.15.154:0/2598289110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a015d230 msgr2=0x7ff3a00c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:27.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a015d230 0x7ff3a00c5940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff394002000 tx=0x7ff394016000 comp rx=0 tx=0).stop 2023-10-10T21:02:27.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 -- 172.21.15.154:0/2598289110 shutdown_connections 2023-10-10T21:02:27.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c067000 0x7ff38c0694b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a015d230 0x7ff3a00c5940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a0159420 0x7ff3a00cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 --2- 172.21.15.154:0/2598289110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a01597f0 0x7ff3a00c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:27.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.364+0000 7ff3857fa700 1 -- 172.21.15.154:0/2598289110 >> 172.21.15.154:0/2598289110 conn(0x7ff3a00d0660 msgr2=0x7ff3a00b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:27.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.365+0000 7ff3857fa700 1 -- 172.21.15.154:0/2598289110 shutdown_connections 2023-10-10T21:02:27.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:27.365+0000 7ff3857fa700 1 -- 172.21.15.154:0/2598289110 wait complete. 2023-10-10T21:02:27.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2023-10-10T21:02:27.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2023-10-10T21:02:27.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.4 2023-10-10T21:02:27.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2023-10-10T21:02:27.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.3 2023-10-10T21:02:27.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2023-10-10T21:02:28.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-10T21:02:28.358 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-10T21:02:28.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-10T21:02:28.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-10T21:02:28.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-10T21:02:28.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-10T21:02:28.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-10T21:02:28.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-10T21:02:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.632+0000 7fdda259d700 1 Processor -- start 2023-10-10T21:02:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.632+0000 7fdda259d700 1 -- start start 2023-10-10T21:02:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.634+0000 7fdda259d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd9c0b33a0 0x7fdd9c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.634+0000 7fdda259d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0ced00 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.634+0000 7fdda259d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0ce710 con 0x7fdd9c0b1700 2023-10-10T21:02:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.634+0000 7fdda259d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c15eec0 con 0x7fdd9c0b33a0 2023-10-10T21:02:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.635+0000 7fdda1d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd9c0b33a0 0x7fdd9c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.635+0000 7fdda1d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd9c0b33a0 0x7fdd9c0cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55766/0 (socket says 172.21.15.154:55766) 2023-10-10T21:02:28.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.635+0000 7fdda1d9c700 1 -- 172.21.15.154:0/3401661636 learned_addr learned my addr 172.21.15.154:0/3401661636 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.636+0000 7fdda1d9c700 1 -- 172.21.15.154:0/3401661636 >> v1:172.21.15.179:6789/0 conn(0x7fdd9c0b1700 legacy=0x7fdd9c0b1ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-10T21:02:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.636+0000 7fdda1d9c700 1 -- 172.21.15.154:0/3401661636 >> v1:172.21.15.154:6789/0 conn(0x7fdd9c0b2d00 legacy=0x7fdd9c15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.636+0000 7fdda1d9c700 1 -- 172.21.15.154:0/3401661636 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c15e650 con 0x7fdd9c0b33a0 2023-10-10T21:02:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.637+0000 7fdda1d9c700 1 --2- 172.21.15.154:0/3401661636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd9c0b33a0 0x7fdd9c0cf190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009f20 tx=0x7fdd94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b72f2d4e18449b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.639+0000 7fdd93fff700 1 -- 172.21.15.154:0/3401661636 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400e070 con 0x7fdd9c0b33a0 2023-10-10T21:02:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.639+0000 7fdd93fff700 1 -- 172.21.15.154:0/3401661636 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9400b980 con 0x7fdd9c0b33a0 2023-10-10T21:02:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.640+0000 7fdda259d700 1 -- 172.21.15.154:0/3401661636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd9c0b33a0 msgr2=0x7fdd9c0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.640+0000 7fdda259d700 1 --2- 172.21.15.154:0/3401661636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd9c0b33a0 0x7fdd9c0cf190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009f20 tx=0x7fdd94009840 comp rx=0 tx=0).stop 2023-10-10T21:02:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.642+0000 7fdda259d700 1 -- 172.21.15.154:0/3401661636 shutdown_connections 2023-10-10T21:02:28.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.642+0000 7fdda259d700 1 --2- 172.21.15.154:0/3401661636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd9c0b33a0 0x7fdd9c0cf190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.642+0000 7fdda259d700 1 -- 172.21.15.154:0/3401661636 >> 172.21.15.154:0/3401661636 conn(0x7fdd9c0d1080 msgr2=0x7fdd9c0affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:28.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.642+0000 7fdda259d700 1 -- 172.21.15.154:0/3401661636 shutdown_connections 2023-10-10T21:02:28.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.642+0000 7fdda259d700 1 -- 172.21.15.154:0/3401661636 wait complete. 2023-10-10T21:02:28.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.645+0000 7fdda259d700 1 Processor -- start 2023-10-10T21:02:28.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.645+0000 7fdda259d700 1 -- start start 2023-10-10T21:02:28.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.646+0000 7fdda259d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd9c0b1700 0x7fdd9c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.646+0000 7fdda259d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd9c0b2d00 0x7fdd9c086f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.647+0000 7fdda259d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd9c0b33a0 0x7fdd9c142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda259d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0b37e0 con 0x7fdd9c0b1700 2023-10-10T21:02:28.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda259d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c06d380 con 0x7fdd9c0b33a0 2023-10-10T21:02:28.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda259d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c06c4d0 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda0d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd9c0b2d00 0x7fdd9c086f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda0d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd9c0b2d00 0x7fdd9c086f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58830/0 (socket says 172.21.15.154:58830) 2023-10-10T21:02:28.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda0d9a700 1 -- 172.21.15.154:0/812991546 learned_addr learned my addr 172.21.15.154:0/812991546 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda1d9c700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd9c0b33a0 0x7fdd9c142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda0d9a700 1 -- 172.21.15.154:0/812991546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd9c0b33a0 msgr2=0x7fdd9c142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda0d9a700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd9c0b33a0 0x7fdd9c142ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda0d9a700 1 -- 172.21.15.154:0/812991546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd9c0b1700 msgr2=0x7fdd9c154140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:02:28.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda0d9a700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd9c0b1700 0x7fdd9c154140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.648+0000 7fdda0d9a700 1 -- 172.21.15.154:0/812991546 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd94009ae0 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.649+0000 7fdda0d9a700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd9c0b2d00 0x7fdd9c086f40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c810 tx=0x7fdd98007ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.650+0000 7fdd917fa700 1 -- 172.21.15.154:0/812991546 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98012630 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.650+0000 7fdd917fa700 1 -- 172.21.15.154:0/812991546 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd980127b0 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.650+0000 7fdd917fa700 1 -- 172.21.15.154:0/812991546 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98012b70 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.650+0000 7fdda259d700 1 -- 172.21.15.154:0/812991546 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c06c770 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.651+0000 7fdda259d700 1 -- 172.21.15.154:0/812991546 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c06cd30 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.655+0000 7fdd917fa700 1 -- 172.21.15.154:0/812991546 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd9801b400 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.656+0000 7fdd86ffd700 1 -- 172.21.15.154:0/812991546 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c088c00 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.657+0000 7fdd917fa700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fdd80067080 0x7fdd80069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.657+0000 7fdd917fa700 1 -- 172.21.15.154:0/812991546 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd98084170 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.658+0000 7fdda159b700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fdd80067080 0x7fdd80069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.659+0000 7fdda159b700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fdd80067080 0x7fdd80069530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009740 tx=0x7fdd8c006c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.663+0000 7fdd917fa700 1 -- 172.21.15.154:0/812991546 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd980513c0 con 0x7fdd9c0b2d00 2023-10-10T21:02:28.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.706+0000 7fa4ac99d700 1 Processor -- start 2023-10-10T21:02:28.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.706+0000 7fa4ac99d700 1 -- start start 2023-10-10T21:02:28.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.708+0000 7f95709ff700 1 Processor -- start 2023-10-10T21:02:28.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.708+0000 7f95709ff700 1 -- start start 2023-10-10T21:02:28.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.709+0000 7fa4ac99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b1e50 0x7fa4a8168800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.709+0000 7fa4ac99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a80cee50 con 0x7fa4a815d980 2023-10-10T21:02:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.709+0000 7fa4ac99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a80b5d50 con 0x7fa4a80b3420 2023-10-10T21:02:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.709+0000 7fa4ac99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80cd3d0 con 0x7fa4a80b1e50 2023-10-10T21:02:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.710+0000 7fa4a6ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa4a80b3420 0x7fa4a80b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:38754/0 (socket says 172.21.15.154:38754) 2023-10-10T21:02:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.710+0000 7fa4a6ffd700 1 -- 172.21.15.154:0/3282232107 learned_addr learned my addr 172.21.15.154:0/3282232107 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.710+0000 7fa4a7fff700 1 --2- 172.21.15.154:0/3282232107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b1e50 0x7fa4a8168800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.710+0000 7fa4a67fc700 1 -- 172.21.15.154:0/3282232107 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662007167 0 0) 0x7fa4a80b5d50 con 0x7fa4a80b3420 2023-10-10T21:02:28.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.710+0000 7f95709ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f956c0691b0 0x7f956c0ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.710+0000 7f95709ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0afe00 0x7f956c0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.710+0000 7f95709ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c0ad400 con 0x7f956c166960 2023-10-10T21:02:28.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.711+0000 7f95709ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956c087e70 con 0x7f956c0691b0 2023-10-10T21:02:28.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.711+0000 7f95709ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0ac340 con 0x7f956c0afe00 2023-10-10T21:02:28.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.710+0000 7fa4a67fc700 1 -- 172.21.15.154:0/3282232107 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa490003570 con 0x7fa4a80b3420 2023-10-10T21:02:28.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.711+0000 7f956ad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0afe00 0x7f956c0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.711+0000 7f956a59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f956c166960 0x7f956c068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38524/0 (socket says 172.21.15.154:38524) 2023-10-10T21:02:28.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.711+0000 7f956a59c700 1 -- 172.21.15.154:0/3836701304 learned_addr learned my addr 172.21.15.154:0/3836701304 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.712+0000 7f956ad9d700 1 -- 172.21.15.154:0/3836701304 >> v2:172.21.15.179:3300/0 conn(0x7f956c0691b0 msgr2=0x7f956c0ab8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-10T21:02:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.712+0000 7f956ad9d700 1 --2- 172.21.15.154:0/3836701304 >> v2:172.21.15.179:3300/0 conn(0x7f956c0691b0 0x7f956c0ab8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.712+0000 7f956ad9d700 1 -- 172.21.15.154:0/3836701304 >> v1:172.21.15.154:6789/0 conn(0x7f956c166960 legacy=0x7f956c068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.712+0000 7f956ad9d700 1 -- 172.21.15.154:0/3836701304 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c0ac610 con 0x7f956c0afe00 2023-10-10T21:02:28.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.712+0000 7f956ad9d700 1 --2- 172.21.15.154:0/3836701304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0afe00 0x7f956c0abe00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9564009ee0 tx=0x7f9564009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df3ff25ac18414cb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.713+0000 7f956959a700 1 -- 172.21.15.154:0/3836701304 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956400fe50 con 0x7f956c0afe00 2023-10-10T21:02:28.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.711+0000 7fa4a7fff700 1 -- 172.21.15.154:0/3282232107 >> v1:172.21.15.179:6789/0 conn(0x7fa4a80b3420 legacy=0x7fa4a80b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.711+0000 7fa4a7fff700 1 -- 172.21.15.154:0/3282232107 >> v1:172.21.15.154:6789/0 conn(0x7fa4a815d980 legacy=0x7fa4a815eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:28.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.712+0000 7fa4a7fff700 1 -- 172.21.15.154:0/3282232107 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a80b6030 con 0x7fa4a80b1e50 2023-10-10T21:02:28.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.712+0000 7fa4a7fff700 1 --2- 172.21.15.154:0/3282232107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b1e50 0x7fa4a8168800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009e90 tx=0x7fa4a0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a11b49c188badba server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.712+0000 7fa4a67fc700 1 -- 172.21.15.154:0/3282232107 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000e070 con 0x7fa4a80b1e50 2023-10-10T21:02:28.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.713+0000 7fa4a67fc700 1 -- 172.21.15.154:0/3282232107 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a000bc30 con 0x7fa4a80b1e50 2023-10-10T21:02:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.713+0000 7fa4a67fc700 1 -- 172.21.15.154:0/3282232107 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0012430 con 0x7fa4a80b1e50 2023-10-10T21:02:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.713+0000 7f956959a700 1 -- 172.21.15.154:0/3836701304 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564007550 con 0x7f956c0afe00 2023-10-10T21:02:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3282232107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b1e50 msgr2=0x7fa4a8168800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7fa4ac99d700 1 --2- 172.21.15.154:0/3282232107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b1e50 0x7fa4a8168800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009e90 tx=0x7fa4a0009780 comp rx=0 tx=0).stop 2023-10-10T21:02:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3282232107 shutdown_connections 2023-10-10T21:02:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7f95709ff700 1 -- 172.21.15.154:0/3836701304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0afe00 msgr2=0x7f956c0abe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7fa4ac99d700 1 --2- 172.21.15.154:0/3282232107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b1e50 0x7fa4a8168800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3282232107 >> 172.21.15.154:0/3282232107 conn(0x7fa4a80d1130 msgr2=0x7fa4a80b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7f95709ff700 1 --2- 172.21.15.154:0/3836701304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0afe00 0x7f956c0abe00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9564009ee0 tx=0x7f9564009780 comp rx=0 tx=0).stop 2023-10-10T21:02:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7f95709ff700 1 -- 172.21.15.154:0/3836701304 shutdown_connections 2023-10-10T21:02:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7f95709ff700 1 --2- 172.21.15.154:0/3836701304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0afe00 0x7f956c0abe00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7f95709ff700 1 --2- 172.21.15.154:0/3836701304 >> v2:172.21.15.179:3300/0 conn(0x7f956c0691b0 0x7f956c0ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.714+0000 7f95709ff700 1 -- 172.21.15.154:0/3836701304 >> 172.21.15.154:0/3836701304 conn(0x7f956c0cd000 msgr2=0x7f956c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.715+0000 7f95709ff700 1 -- 172.21.15.154:0/3836701304 shutdown_connections 2023-10-10T21:02:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.715+0000 7f95709ff700 1 -- 172.21.15.154:0/3836701304 wait complete. 2023-10-10T21:02:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.716+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3282232107 shutdown_connections 2023-10-10T21:02:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.718+0000 7f95709ff700 1 Processor -- start 2023-10-10T21:02:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.716+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3282232107 wait complete. 2023-10-10T21:02:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.718+0000 7fa4ac99d700 1 Processor -- start 2023-10-10T21:02:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.718+0000 7fa4ac99d700 1 -- start start 2023-10-10T21:02:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.718+0000 7f95709ff700 1 -- start start 2023-10-10T21:02:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.719+0000 7f95709ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0691b0 0x7f956c0a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.720+0000 7f95709ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f956c0afe00 0x7f956c0aa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.721+0000 7f956a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0691b0 0x7f956c0a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.721+0000 7f956a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0691b0 0x7f956c0a6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58854/0 (socket says 172.21.15.154:58854) 2023-10-10T21:02:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.721+0000 7f9569d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f956c0afe00 0x7f956c0aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.720+0000 7fa4ac99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80b1e50 0x7fa4a8178600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.720+0000 7fa4ac99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b3420 0x7fa4a8153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.720+0000 7fa4ac99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a815d980 0x7fa4a8156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.720+0000 7fa4ac99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a81594a0 con 0x7fa4a80b1e50 2023-10-10T21:02:28.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.720+0000 7fa4ac99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a81585f0 con 0x7fa4a815d980 2023-10-10T21:02:28.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.720+0000 7fa4ac99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8159930 con 0x7fa4a80b3420 2023-10-10T21:02:28.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.720+0000 7fa4a6ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b3420 0x7fa4a8153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.721+0000 7fa4a6ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b3420 0x7fa4a8153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58864/0 (socket says 172.21.15.154:58864) 2023-10-10T21:02:28.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.721+0000 7fa4a6ffd700 1 -- 172.21.15.154:0/3042896783 learned_addr learned my addr 172.21.15.154:0/3042896783 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.721+0000 7fa4a7fff700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a815d980 0x7fa4a8156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.721+0000 7fa4a6ffd700 1 -- 172.21.15.154:0/3042896783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a815d980 msgr2=0x7fa4a8156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.721+0000 7fa4a6ffd700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a815d980 0x7fa4a8156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.721+0000 7fa4a6ffd700 1 -- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80b1e50 msgr2=0x7fa4a8178600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:02:28.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.722+0000 7f9569d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f956c0afe00 0x7f956c0aa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55776/0 (socket says 172.21.15.154:55776) 2023-10-10T21:02:28.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.722+0000 7f956a59c700 1 -- 172.21.15.154:0/1949400314 learned_addr learned my addr 172.21.15.154:0/1949400314 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.722+0000 7fa4a77fe700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80b1e50 0x7fa4a8178600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.722+0000 7fa4a6ffd700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80b1e50 0x7fa4a8178600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.722+0000 7fa4a6ffd700 1 -- 172.21.15.154:0/3042896783 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0009a20 con 0x7fa4a80b3420 2023-10-10T21:02:28.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.722+0000 7fa4a77fe700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80b1e50 0x7fa4a8178600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:28.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.722+0000 7f95709ff700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f956c166960 0x7f956c0a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.722+0000 7fa4a6ffd700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b3420 0x7fa4a8153c20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa49800c7c0 tx=0x7fa498007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.723+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0a5a00 con 0x7f956c0afe00 2023-10-10T21:02:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.723+0000 7f956ad9d700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f956c166960 0x7f956c0a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.723+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0a6820 con 0x7f956c166960 2023-10-10T21:02:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.723+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0a5c10 con 0x7f956c0691b0 2023-10-10T21:02:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.722+0000 7fa48f7fe700 1 -- 172.21.15.154:0/3042896783 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498005b30 con 0x7fa4a80b3420 2023-10-10T21:02:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.723+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a8158890 con 0x7fa4a80b3420 2023-10-10T21:02:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.723+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a8158e50 con 0x7fa4a80b3420 2023-10-10T21:02:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.723+0000 7fa48f7fe700 1 -- 172.21.15.154:0/3042896783 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498005c90 con 0x7fa4a80b3420 2023-10-10T21:02:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.723+0000 7fa48f7fe700 1 -- 172.21.15.154:0/3042896783 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498007320 con 0x7fa4a80b3420 2023-10-10T21:02:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.724+0000 7f956a59c700 1 -- 172.21.15.154:0/1949400314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f956c166960 msgr2=0x7f956c0a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.724+0000 7f956a59c700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f956c166960 0x7f956c0a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.724+0000 7f956a59c700 1 -- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f956c0afe00 msgr2=0x7f956c0aa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.724+0000 7f956a59c700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f956c0afe00 0x7f956c0aa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.724+0000 7f956a59c700 1 -- 172.21.15.154:0/1949400314 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9564009a20 con 0x7f956c0691b0 2023-10-10T21:02:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.724+0000 7f9569d9b700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f956c0afe00 0x7f956c0aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.725+0000 7f956a59c700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0691b0 0x7f956c0a6cb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f955c00c560 tx=0x7f955c001020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.726+0000 7f955a7fc700 1 -- 172.21.15.154:0/1949400314 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c005b30 con 0x7f956c0691b0 2023-10-10T21:02:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.726+0000 7f955a7fc700 1 -- 172.21.15.154:0/1949400314 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c005c90 con 0x7f956c0691b0 2023-10-10T21:02:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.726+0000 7f955a7fc700 1 -- 172.21.15.154:0/1949400314 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c007320 con 0x7f956c0691b0 2023-10-10T21:02:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.727+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956c0a5ef0 con 0x7f956c0691b0 2023-10-10T21:02:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.727+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956c0a64b0 con 0x7f956c0691b0 2023-10-10T21:02:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.726+0000 7fa48f7fe700 1 -- 172.21.15.154:0/3042896783 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa498012400 con 0x7fa4a80b3420 2023-10-10T21:02:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.727+0000 7fa48f7fe700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa494067080 0x7fa494069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.728+0000 7fa48f7fe700 1 -- 172.21.15.154:0/3042896783 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa498083a00 con 0x7fa4a80b3420 2023-10-10T21:02:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.730+0000 7f955a7fc700 1 -- 172.21.15.154:0/1949400314 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f955c01b3b0 con 0x7f956c0691b0 2023-10-10T21:02:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.730+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4880052b0 con 0x7fa4a80b3420 2023-10-10T21:02:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.731+0000 7fa4a77fe700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa494067080 0x7fa494069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.731+0000 7f955a7fc700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f954c067080 0x7f954c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.731+0000 7f955a7fc700 1 -- 172.21.15.154:0/1949400314 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f955c083950 con 0x7f956c0691b0 2023-10-10T21:02:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.729+0000 7ff76b5ff700 1 Processor -- start 2023-10-10T21:02:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.730+0000 7ff76b5ff700 1 -- start start 2023-10-10T21:02:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.732+0000 7ff76b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c039050 0x7ff75c03b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.732+0000 7ff76b5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff75c039420 0x7ff75c0e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.732+0000 7ff76b5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c006c20 con 0x7ff75c0e24c0 2023-10-10T21:02:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.732+0000 7ff76b5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75c007a80 con 0x7ff75c039420 2023-10-10T21:02:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.732+0000 7ff76b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c006e70 con 0x7ff75c039050 2023-10-10T21:02:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.732+0000 7ff76939b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c039050 0x7ff75c03b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.732+0000 7ff76939b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c039050 0x7ff75c03b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58870/0 (socket says 172.21.15.154:58870) 2023-10-10T21:02:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.732+0000 7ff76939b700 1 -- 172.21.15.154:0/1085013394 learned_addr learned my addr 172.21.15.154:0/1085013394 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.732+0000 7f9569d9b700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f954c067080 0x7f954c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.733+0000 7ff768b9a700 1 --2- 172.21.15.154:0/1085013394 >> v2:172.21.15.154:3300/0 conn(0x7ff75c039420 0x7ff75c0e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.733+0000 7ff76939b700 1 -- 172.21.15.154:0/1085013394 >> v2:172.21.15.154:3300/0 conn(0x7ff75c039420 msgr2=0x7ff75c0e1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.733+0000 7ff76939b700 1 --2- 172.21.15.154:0/1085013394 >> v2:172.21.15.154:3300/0 conn(0x7ff75c039420 0x7ff75c0e1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.733+0000 7ff76939b700 1 -- 172.21.15.154:0/1085013394 >> v1:172.21.15.154:6789/0 conn(0x7ff75c0e24c0 legacy=0x7ff75c053e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.733+0000 7ff76939b700 1 -- 172.21.15.154:0/1085013394 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c007150 con 0x7ff75c039050 2023-10-10T21:02:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.734+0000 7ff76939b700 1 --2- 172.21.15.154:0/1085013394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c039050 0x7ff75c03b240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7600099b0 tx=0x7ff760009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5964dad9f326334f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.734+0000 7f9569d9b700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f954c067080 0x7f954c069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f956c18b3b0 tx=0x7f9560009120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.734+0000 7fa4a77fe700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa494067080 0x7fa494069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8087940 tx=0x7fa49c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.734+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95500052b0 con 0x7f956c0691b0 2023-10-10T21:02:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.735+0000 7ff75bfff700 1 -- 172.21.15.154:0/1085013394 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760009ea0 con 0x7ff75c039050 2023-10-10T21:02:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.735+0000 7fa48f7fe700 1 -- 172.21.15.154:0/3042896783 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa49804b5a0 con 0x7fa4a80b3420 2023-10-10T21:02:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.737+0000 7f880edff700 1 Processor -- start 2023-10-10T21:02:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.738+0000 7f880edff700 1 -- start start 2023-10-10T21:02:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.738+0000 7f142699d700 1 Processor -- start 2023-10-10T21:02:28.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.738+0000 7f142699d700 1 -- start start 2023-10-10T21:02:28.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.738+0000 7f780cb9d700 1 Processor -- start 2023-10-10T21:02:28.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.739+0000 7f780cb9d700 1 -- start start 2023-10-10T21:02:28.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7f880edff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8808159c60 0x7f880815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7f880edff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880815a160 con 0x7f880815db10 2023-10-10T21:02:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7f880edff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080d13a0 con 0x7f8808159890 2023-10-10T21:02:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7f880d39c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f880815db10 0x7f8808069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38546/0 (socket says 172.21.15.154:38546) 2023-10-10T21:02:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7f880d39c700 1 -- 172.21.15.154:0/3808685427 learned_addr learned my addr 172.21.15.154:0/3808685427 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7f8807fff700 1 --2- 172.21.15.154:0/3808685427 >> v2:172.21.15.179:3300/0 conn(0x7f8808159c60 0x7f880815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7f880edff700 1 -- 172.21.15.154:0/3808685427 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880815df50 con 0x7f8808159c60 2023-10-10T21:02:28.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7f955a7fc700 1 -- 172.21.15.154:0/1949400314 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f955c017080 con 0x7f956c0691b0 2023-10-10T21:02:28.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f780cb9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78000e60a0 0x7f78000e6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191411576 0 0) 0x7f88080d13a0 con 0x7f8808159890 2023-10-10T21:02:28.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f8003570 con 0x7f8808159890 2023-10-10T21:02:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7ff75bfff700 1 -- 172.21.15.154:0/1085013394 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76000b860 con 0x7ff75c039050 2023-10-10T21:02:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.740+0000 7ff75bfff700 1 -- 172.21.15.154:0/1085013394 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000bc00 con 0x7ff75c039050 2023-10-10T21:02:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7ff76b5ff700 1 -- 172.21.15.154:0/1085013394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c039050 msgr2=0x7ff75c03b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7ff76b5ff700 1 --2- 172.21.15.154:0/1085013394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c039050 0x7ff75c03b240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7600099b0 tx=0x7ff760009250 comp rx=0 tx=0).stop 2023-10-10T21:02:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7ff76b5ff700 1 -- 172.21.15.154:0/1085013394 shutdown_connections 2023-10-10T21:02:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7ff76b5ff700 1 --2- 172.21.15.154:0/1085013394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c039050 0x7ff75c03b240 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7600099b0 tx=0x7ff760009250 comp rx=0 tx=0).stop 2023-10-10T21:02:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7ff76b5ff700 1 --2- 172.21.15.154:0/1085013394 >> v2:172.21.15.154:3300/0 conn(0x7ff75c039420 0x7ff75c0e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7ff76b5ff700 1 -- 172.21.15.154:0/1085013394 >> 172.21.15.154:0/1085013394 conn(0x7ff75c059b30 msgr2=0x7ff75c055ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f780cb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f7800057f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 213035383 0 0) 0x7f87f8003570 con 0x7f8808159890 2023-10-10T21:02:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 >> v2:172.21.15.179:3300/0 conn(0x7f8808159c60 msgr2=0x7f880815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f88077fe700 1 --2- 172.21.15.154:0/3808685427 >> v2:172.21.15.179:3300/0 conn(0x7f8808159c60 0x7f880815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f780cb9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78000e3ab0 con 0x7f78000dc430 2023-10-10T21:02:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f7807fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f78000dc430 0x7f78000dc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:38768/0 (socket says 172.21.15.154:38768) 2023-10-10T21:02:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f7807fff700 1 -- 172.21.15.154:0/3758821253 learned_addr learned my addr 172.21.15.154:0/3758821253 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f78077fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78000e60a0 0x7f78000e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 >> v1:172.21.15.154:6789/0 conn(0x7f880815db10 legacy=0x7f8808069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880815e140 con 0x7f8808159890 2023-10-10T21:02:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f87fc001470 con 0x7f8808159890 2023-10-10T21:02:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.741+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 >> v1:172.21.15.179:6789/0 conn(0x7f8808159890 legacy=0x7f880815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f88077fe700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8003b30 0x7f87f8003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f88077fe700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f8004810 0x7f87f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f7806ffd700 1 --2- 172.21.15.154:0/3758821253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f7800057f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f142699d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1420159420 0x7f14200b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f88077fe700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f80052e0 0x7f87f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f800c160 con 0x7f87f80052e0 2023-10-10T21:02:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f800c2d0 con 0x7f87f8004810 2023-10-10T21:02:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f800c490 con 0x7f87f8003b30 2023-10-10T21:02:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f880cb9b700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8003b30 0x7f87f8003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f780cb9d700 1 -- 172.21.15.154:0/3758821253 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7800006030 con 0x7f78000e60a0 2023-10-10T21:02:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.742+0000 7f780cb9d700 1 -- 172.21.15.154:0/3758821253 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7800058800 con 0x7f78000547c0 2023-10-10T21:02:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f8807fff700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f8004810 0x7f87f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f142519a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f14201597f0 0x7f14200b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38560/0 (socket says 172.21.15.154:38560) 2023-10-10T21:02:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f880d39c700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f80052e0 0x7f87f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f880cb9b700 1 -- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f8004810 msgr2=0x7f87f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f880cb9b700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87f8004810 0x7f87f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f880cb9b700 1 -- 172.21.15.154:0/3808685427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f80052e0 msgr2=0x7f87f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f78077fe700 1 -- 172.21.15.154:0/3758821253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 msgr2=0x7f7800057f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f78077fe700 1 --2- 172.21.15.154:0/3758821253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f7800057f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f78077fe700 1 -- 172.21.15.154:0/3758821253 >> v1:172.21.15.179:6789/0 conn(0x7f78000dc430 legacy=0x7f78000dc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f880cb9b700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f80052e0 0x7f87f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f78077fe700 1 -- 172.21.15.154:0/3758821253 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800058ae0 con 0x7f78000e60a0 2023-10-10T21:02:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f880cb9b700 1 -- 172.21.15.154:0/3808685427 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8003570 con 0x7f87f8003b30 2023-10-10T21:02:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f880d39c700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f80052e0 0x7f87f800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7ff76b5ff700 1 -- 172.21.15.154:0/1085013394 shutdown_connections 2023-10-10T21:02:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7ff76b5ff700 1 -- 172.21.15.154:0/1085013394 wait complete. 2023-10-10T21:02:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.744+0000 7f78077fe700 1 --2- 172.21.15.154:0/3758821253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78000e60a0 0x7f78000e6470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0098e0 tx=0x7f77fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2426e8775c34bfc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f880d39c700 1 -- 172.21.15.154:0/3808685427 reap_dead start 2023-10-10T21:02:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f880cb9b700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8003b30 0x7f87f8003f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00c160 tx=0x7f87fc002e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfeac63d1d519854 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00ca90 con 0x7f87f8003b30 2023-10-10T21:02:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f78067fc700 1 -- 172.21.15.154:0/3758821253 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc009e80 con 0x7f78000e60a0 2023-10-10T21:02:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f78067fc700 1 -- 172.21.15.154:0/3758821253 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc00b7a0 con 0x7f78000e60a0 2023-10-10T21:02:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f78067fc700 1 -- 172.21.15.154:0/3758821253 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00bb60 con 0x7f78000e60a0 2023-10-10T21:02:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f7806ffd700 1 --2- 172.21.15.154:0/3758821253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f7800057f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00cbf0 con 0x7f87f8003b30 2023-10-10T21:02:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f88077fe700 1 -- 172.21.15.154:0/3808685427 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc006820 con 0x7f87f8003b30 2023-10-10T21:02:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.746+0000 7f880edff700 1 -- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8003b30 msgr2=0x7f87f8003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.746+0000 7f880edff700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8003b30 0x7f87f8003f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00c160 tx=0x7f87fc002e20 comp rx=0 tx=0).stop 2023-10-10T21:02:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.743+0000 7f142619c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f142015d230 0x7f142015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:38778/0 (socket says 172.21.15.154:38778) 2023-10-10T21:02:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.744+0000 7f142519a700 1 -- 172.21.15.154:0/1424094968 learned_addr learned my addr 172.21.15.154:0/1424094968 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.744+0000 7f28ead9d700 1 Processor -- start 2023-10-10T21:02:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.744+0000 7f28ead9d700 1 -- start start 2023-10-10T21:02:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.744+0000 7f142699d700 1 -- 172.21.15.154:0/1424094968 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14200b2980 con 0x7f14201597f0 2023-10-10T21:02:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.744+0000 7f142699d700 1 -- 172.21.15.154:0/1424094968 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14200b11d0 con 0x7f142015d230 2023-10-10T21:02:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.744+0000 7f142699d700 1 -- 172.21.15.154:0/1424094968 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14200b14b0 con 0x7f1420159420 2023-10-10T21:02:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f142599b700 1 --2- 172.21.15.154:0/1424094968 >> v2:172.21.15.179:3300/0 conn(0x7f1420159420 0x7f14200b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f142599b700 1 -- 172.21.15.154:0/1424094968 >> v1:172.21.15.179:6789/0 conn(0x7f142015d230 legacy=0x7f142015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f142599b700 1 -- 172.21.15.154:0/1424094968 >> v1:172.21.15.154:6789/0 conn(0x7f14201597f0 legacy=0x7f14200b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7f142599b700 1 -- 172.21.15.154:0/1424094968 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200b1790 con 0x7f1420159420 2023-10-10T21:02:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.746+0000 7f142599b700 1 --2- 172.21.15.154:0/1424094968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 0x7f14200b5f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f141c0098e0 tx=0x7f141c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8000ca9fe7ec7f72 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7f28ead9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28e4161d40 0x7f28e40ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7f880edff700 1 -- 172.21.15.154:0/3808685427 shutdown_connections 2023-10-10T21:02:28.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7f880edff700 1 --2- 172.21.15.154:0/3808685427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87f8003b30 0x7f87f8003f20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7f880edff700 1 -- 172.21.15.154:0/3808685427 >> 172.21.15.154:0/3808685427 conn(0x7f8808068e20 msgr2=0x7f88080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:28.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f880edff700 1 -- 172.21.15.154:0/3808685427 shutdown_connections 2023-10-10T21:02:28.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f28ead9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e4162410 con 0x7f28e41471f0 2023-10-10T21:02:28.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f28ead9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e40cf140 con 0x7f28e40d01e0 2023-10-10T21:02:28.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f28e959a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28e4161d40 0x7f28e40ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f880edff700 1 -- 172.21.15.154:0/3808685427 wait complete. 2023-10-10T21:02:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f28e959a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28e4161d40 0x7f28e40ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55842/0 (socket says 172.21.15.154:55842) 2023-10-10T21:02:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f28e959a700 1 -- 172.21.15.154:0/2979545356 learned_addr learned my addr 172.21.15.154:0/2979545356 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f28ead9d700 1 -- 172.21.15.154:0/2979545356 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e40cf420 con 0x7f28e4161d40 2023-10-10T21:02:28.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.749+0000 7f780cb9d700 1 -- 172.21.15.154:0/3758821253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78000e60a0 msgr2=0x7f78000e6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.749+0000 7f780cb9d700 1 --2- 172.21.15.154:0/3758821253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78000e60a0 0x7f78000e6470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0098e0 tx=0x7f77fc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7ff76b5ff700 1 Processor -- start 2023-10-10T21:02:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.745+0000 7ff76b5ff700 1 -- start start 2023-10-10T21:02:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7ff76b5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff75c039420 0x7ff75c0df800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7ff76b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c0e24c0 0x7ff75c0fa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7ff76b5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c0e3ff0 0x7ff75c0507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7ff76b5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c04c810 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7ff76b5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c04def0 con 0x7ff75c039420 2023-10-10T21:02:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7ff76b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0faf00 con 0x7ff75c0e24c0 2023-10-10T21:02:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7ff769b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c0e3ff0 0x7ff75c0507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7ff769b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c0e3ff0 0x7ff75c0507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55838/0 (socket says 172.21.15.154:55838) 2023-10-10T21:02:28.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7ff769b9c700 1 -- 172.21.15.154:0/3442938797 learned_addr learned my addr 172.21.15.154:0/3442938797 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.749+0000 7ff76939b700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff75c039420 0x7ff75c0df800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.749+0000 7f780cb9d700 1 -- 172.21.15.154:0/3758821253 shutdown_connections 2023-10-10T21:02:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7f780cb9d700 1 --2- 172.21.15.154:0/3758821253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78000e60a0 0x7f78000e6470 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7ff769b9c700 1 -- 172.21.15.154:0/3442938797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c0e24c0 msgr2=0x7ff75c0fa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7ff769b9c700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c0e24c0 0x7ff75c0fa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7ff769b9c700 1 -- 172.21.15.154:0/3442938797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff75c039420 msgr2=0x7ff75c0df800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7ff769b9c700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff75c039420 0x7ff75c0df800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7ff769b9c700 1 -- 172.21.15.154:0/3442938797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600094f0 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7f780cb9d700 1 --2- 172.21.15.154:0/3758821253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f7800057f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7f28e959a700 1 -- 172.21.15.154:0/2979545356 >> v1:172.21.15.179:6789/0 conn(0x7f28e40d01e0 legacy=0x7f28e40b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:28.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7f28e959a700 1 -- 172.21.15.154:0/2979545356 >> v1:172.21.15.154:6789/0 conn(0x7f28e41471f0 legacy=0x7f28e4161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7f780cb9d700 1 -- 172.21.15.154:0/3758821253 >> 172.21.15.154:0/3758821253 conn(0x7f780000e7c0 msgr2=0x7f780000ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.750+0000 7f28e959a700 1 -- 172.21.15.154:0/2979545356 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40cf700 con 0x7f28e4161d40 2023-10-10T21:02:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7f1424999700 1 -- 172.21.15.154:0/1424094968 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c009e80 con 0x7f1420159420 2023-10-10T21:02:28.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7f1424999700 1 -- 172.21.15.154:0/1424094968 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c00b760 con 0x7f1420159420 2023-10-10T21:02:28.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.747+0000 7f1424999700 1 -- 172.21.15.154:0/1424094968 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c00bb00 con 0x7f1420159420 2023-10-10T21:02:28.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f142699d700 1 -- 172.21.15.154:0/1424094968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 msgr2=0x7f14200b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f142699d700 1 --2- 172.21.15.154:0/1424094968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 0x7f14200b5f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f141c0098e0 tx=0x7f141c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f142699d700 1 -- 172.21.15.154:0/1424094968 shutdown_connections 2023-10-10T21:02:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f142699d700 1 --2- 172.21.15.154:0/1424094968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 0x7f14200b5f40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.748+0000 7f142699d700 1 -- 172.21.15.154:0/1424094968 >> 172.21.15.154:0/1424094968 conn(0x7f14200d0660 msgr2=0x7f14200d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.749+0000 7f142699d700 1 -- 172.21.15.154:0/1424094968 shutdown_connections 2023-10-10T21:02:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.749+0000 7f142699d700 1 -- 172.21.15.154:0/1424094968 wait complete. 2023-10-10T21:02:28.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.751+0000 7ff769b9c700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c0e3ff0 0x7ff75c0507a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff764076f50 tx=0x7ff764066260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.751+0000 7f28e959a700 1 --2- 172.21.15.154:0/2979545356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 0x7f28e40ce4f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28e00099b0 tx=0x7f28e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c39dfa0e64ee0b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.751+0000 7f880edff700 1 Processor -- start 2023-10-10T21:02:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.751+0000 7f780cb9d700 1 -- 172.21.15.154:0/3758821253 shutdown_connections 2023-10-10T21:02:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.751+0000 7f780cb9d700 1 -- 172.21.15.154:0/3758821253 wait complete. 2023-10-10T21:02:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.751+0000 7f142699d700 1 Processor -- start 2023-10-10T21:02:28.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.751+0000 7f880edff700 1 -- start start 2023-10-10T21:02:28.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.751+0000 7f142699d700 1 -- start start 2023-10-10T21:02:28.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.752+0000 7ff7597fa700 1 -- 172.21.15.154:0/3442938797 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764067ee0 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.753+0000 7f28e8d99700 1 -- 172.21.15.154:0/2979545356 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000b7e0 con 0x7f28e4161d40 2023-10-10T21:02:28.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.753+0000 7f28e8d99700 1 -- 172.21.15.154:0/2979545356 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e000b940 con 0x7f28e4161d40 2023-10-10T21:02:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.753+0000 7f28e8d99700 1 -- 172.21.15.154:0/2979545356 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000bce0 con 0x7f28e4161d40 2023-10-10T21:02:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.753+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c050ce0 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.753+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c0e4840 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.753+0000 7ff7597fa700 1 -- 172.21.15.154:0/3442938797 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff764068040 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.753+0000 7ff7597fa700 1 -- 172.21.15.154:0/3442938797 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76406a640 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.753+0000 7f880edff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f8003b30 0x7f88080cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f880edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8808154a10 0x7f88080cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f880edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88080cf200 0x7f88080cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f8807fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8808154a10 0x7f88080cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f8807fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8808154a10 0x7f88080cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:50186/0 (socket says 172.21.15.154:50186) 2023-10-10T21:02:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f8807fff700 1 -- 172.21.15.154:0/1924583784 learned_addr learned my addr 172.21.15.154:0/1924583784 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f880d39c700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88080cf200 0x7f88080cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.755+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880814eb50 con 0x7f87f8003b30 2023-10-10T21:02:28.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.755+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808154e80 con 0x7f8808154a10 2023-10-10T21:02:28.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.755+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080cfbc0 con 0x7f88080cf200 2023-10-10T21:02:28.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.755+0000 7f880cb9b700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f8003b30 0x7f88080cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f780cb9d700 1 Processor -- start 2023-10-10T21:02:28.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f780cb9d700 1 -- start start 2023-10-10T21:02:28.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f28ead9d700 1 -- 172.21.15.154:0/2979545356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 msgr2=0x7f28e40ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f28ead9d700 1 --2- 172.21.15.154:0/2979545356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 0x7f28e40ce4f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28e00099b0 tx=0x7f28e0009250 comp rx=0 tx=0).stop 2023-10-10T21:02:28.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.753+0000 7f142699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 0x7f1420153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f142699d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14201597f0 0x7f142015c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f142599b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 0x7f1420153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f142599b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 0x7f1420153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:50172/0 (socket says 172.21.15.154:50172) 2023-10-10T21:02:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f142599b700 1 -- 172.21.15.154:0/760078053 learned_addr learned my addr 172.21.15.154:0/760078053 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f142699d700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142015d230 0x7f1420150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.754+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420152fa0 con 0x7f14201597f0 2023-10-10T21:02:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.755+0000 7f142619c700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142015d230 0x7f1420150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.755+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420152390 con 0x7f1420159420 2023-10-10T21:02:28.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.755+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1420152670 con 0x7f142015d230 2023-10-10T21:02:28.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.755+0000 7f142519a700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14201597f0 0x7f142015c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f142599b700 1 -- 172.21.15.154:0/760078053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142015d230 msgr2=0x7f1420150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f142599b700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142015d230 0x7f1420150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f142599b700 1 -- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14201597f0 msgr2=0x7f142015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f880cb9b700 1 -- 172.21.15.154:0/1924583784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88080cf200 msgr2=0x7f88080cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f880cb9b700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88080cf200 0x7f88080cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f880cb9b700 1 -- 172.21.15.154:0/1924583784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8808154a10 msgr2=0x7f88080cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f880cb9b700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8808154a10 0x7f88080cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f880cb9b700 1 -- 172.21.15.154:0/1924583784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080cd710 con 0x7f87f8003b30 2023-10-10T21:02:28.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f780cb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f78000da960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f780cb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000dc430 0x7f78000def00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f78077fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f78000da960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f78077fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f78000da960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58918/0 (socket says 172.21.15.154:58918) 2023-10-10T21:02:28.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f78077fe700 1 -- 172.21.15.154:0/1984666199 learned_addr learned my addr 172.21.15.154:0/1984666199 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f780cb9d700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78000e60a0 0x7f780003ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f142599b700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14201597f0 0x7f142015c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f142599b700 1 -- 172.21.15.154:0/760078053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c009420 con 0x7f1420159420 2023-10-10T21:02:28.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f142519a700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14201597f0 0x7f142015c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:28.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7f7806ffd700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000dc430 0x7f78000def00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000398d0 con 0x7f78000e60a0 2023-10-10T21:02:28.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000daf40 con 0x7f78000dc430 2023-10-10T21:02:28.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78000db220 con 0x7f78000547c0 2023-10-10T21:02:28.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f880cb9b700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f8003b30 0x7f88080cd0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87fc015000 tx=0x7f87fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f7807fff700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78000e60a0 0x7f780003ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f8804ff9700 1 -- 172.21.15.154:0/1924583784 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc007260 con 0x7f87f8003b30 2023-10-10T21:02:28.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f142599b700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 0x7f1420153430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1420089340 tx=0x7f141c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f8804ff9700 1 -- 172.21.15.154:0/1924583784 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc0073c0 con 0x7f87f8003b30 2023-10-10T21:02:28.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f8804ff9700 1 -- 172.21.15.154:0/1924583784 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc01d420 con 0x7f87f8003b30 2023-10-10T21:02:28.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88080c85b0 con 0x7f87f8003b30 2023-10-10T21:02:28.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f78077fe700 1 -- 172.21.15.154:0/1984666199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000dc430 msgr2=0x7f78000def00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f78077fe700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000dc430 0x7f78000def00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f78077fe700 1 -- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78000e60a0 msgr2=0x7f780003ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f78077fe700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78000e60a0 0x7f780003ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.757+0000 7f78077fe700 1 -- 172.21.15.154:0/1984666199 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc009420 con 0x7f78000547c0 2023-10-10T21:02:28.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.758+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88080c8b70 con 0x7f87f8003b30 2023-10-10T21:02:28.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.758+0000 7f78077fe700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f78000da960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77fc002000 tx=0x7f77fc016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.758+0000 7f77f37fe700 1 -- 172.21.15.154:0/1984666199 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00bb20 con 0x7f78000547c0 2023-10-10T21:02:28.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.758+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78000db500 con 0x7f78000547c0 2023-10-10T21:02:28.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.758+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780003ee80 con 0x7f78000547c0 2023-10-10T21:02:28.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.759+0000 7f8804ff9700 1 -- 172.21.15.154:0/1924583784 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87fc01d7d0 con 0x7f87f8003b30 2023-10-10T21:02:28.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.760+0000 7f77f37fe700 1 -- 172.21.15.154:0/1984666199 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc01b470 con 0x7f78000547c0 2023-10-10T21:02:28.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.760+0000 7f8804ff9700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f87ec066fb0 0x7f87ec069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.760+0000 7f8804ff9700 1 -- 172.21.15.154:0/1924583784 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87fc086590 con 0x7f87f8003b30 2023-10-10T21:02:28.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.761+0000 7f8807fff700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f87ec066fb0 0x7f87ec069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.761+0000 7f1415ffb700 1 -- 172.21.15.154:0/760078053 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c011ea0 con 0x7f1420159420 2023-10-10T21:02:28.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.761+0000 7f1415ffb700 1 -- 172.21.15.154:0/760078053 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c026470 con 0x7f1420159420 2023-10-10T21:02:28.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.762+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880804c3c0 con 0x7f87f8003b30 2023-10-10T21:02:28.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.761+0000 7f1415ffb700 1 -- 172.21.15.154:0/760078053 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c026810 con 0x7f1420159420 2023-10-10T21:02:28.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.761+0000 7f77f37fe700 1 -- 172.21.15.154:0/1984666199 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc01b830 con 0x7f78000547c0 2023-10-10T21:02:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.763+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1420152950 con 0x7f1420159420 2023-10-10T21:02:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.763+0000 7f28ead9d700 1 -- 172.21.15.154:0/2979545356 shutdown_connections 2023-10-10T21:02:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.763+0000 7f28ead9d700 1 --2- 172.21.15.154:0/2979545356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 0x7f28e40ce4f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.763+0000 7f28ead9d700 1 -- 172.21.15.154:0/2979545356 >> 172.21.15.154:0/2979545356 conn(0x7f28e40d0660 msgr2=0x7f28e40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:28.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.763+0000 7f8807fff700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f87ec066fb0 0x7f87ec069460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87f4006c80 tx=0x7f87f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.763+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142015cde0 con 0x7f1420159420 2023-10-10T21:02:28.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.763+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e80052b0 con 0x7f78000547c0 2023-10-10T21:02:28.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.764+0000 7f77f37fe700 1 -- 172.21.15.154:0/1984666199 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77fc01bba0 con 0x7f78000547c0 2023-10-10T21:02:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.756+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7440052b0 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.759+0000 7ff7597fa700 1 -- 172.21.15.154:0/3442938797 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff76406aa70 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.760+0000 7ff7597fa700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff748067000 0x7ff7480694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.761+0000 7ff7597fa700 1 -- 172.21.15.154:0/3442938797 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7640fbe70 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.761+0000 7ff76939b700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff748067000 0x7ff7480694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.762+0000 7ff76939b700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff748067000 0x7ff7480694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff7600099b0 tx=0x7ff760017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.764+0000 7f28ead9d700 1 -- 172.21.15.154:0/2979545356 shutdown_connections 2023-10-10T21:02:28.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.764+0000 7f28ead9d700 1 -- 172.21.15.154:0/2979545356 wait complete. 2023-10-10T21:02:28.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.765+0000 7f77f37fe700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f77ec067000 0x7f77ec0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.765+0000 7f7806ffd700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f77ec067000 0x7f77ec0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.765+0000 7f77f37fe700 1 -- 172.21.15.154:0/1984666199 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77fc085ff0 con 0x7f78000547c0 2023-10-10T21:02:28.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.766+0000 7f7806ffd700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f77ec067000 0x7f77ec0694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f77f400adc0 tx=0x7f77f4006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.767+0000 7f28ead9d700 1 Processor -- start 2023-10-10T21:02:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.767+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14000052b0 con 0x7f1420159420 2023-10-10T21:02:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.768+0000 7f28ead9d700 1 -- start start 2023-10-10T21:02:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.768+0000 7f1415ffb700 1 -- 172.21.15.154:0/760078053 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f141c023070 con 0x7f1420159420 2023-10-10T21:02:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.769+0000 7f77f37fe700 1 -- 172.21.15.154:0/1984666199 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77fc0b75a0 con 0x7f78000547c0 2023-10-10T21:02:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.769+0000 7f1415ffb700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1404067080 0x7f1404069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.770+0000 7f1415ffb700 1 -- 172.21.15.154:0/760078053 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f141c086c90 con 0x7f1420159420 2023-10-10T21:02:28.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.770+0000 7f28ead9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e40d01e0 0x7f28e414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.770+0000 7f142519a700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1404067080 0x7f1404069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.770+0000 7f28ead9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41471f0 0x7f28e4146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.770+0000 7f28ead9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 0x7f28e413ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.771+0000 7f142519a700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1404067080 0x7f1404069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f14200cd0e0 tx=0x7f1410007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.771+0000 7f28ea59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 0x7f28e413ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.771+0000 7f28ea59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 0x7f28e413ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55876/0 (socket says 172.21.15.154:55876) 2023-10-10T21:02:28.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.771+0000 7f28ea59c700 1 -- 172.21.15.154:0/914522502 learned_addr learned my addr 172.21.15.154:0/914522502 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:28.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.771+0000 7ff7597fa700 1 -- 172.21.15.154:0/3442938797 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7640c90c0 con 0x7ff75c0e3ff0 2023-10-10T21:02:28.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.772+0000 7f28ead9d700 1 -- 172.21.15.154:0/914522502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e413bba0 con 0x7f28e4161d40 2023-10-10T21:02:28.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.772+0000 7f28ead9d700 1 -- 172.21.15.154:0/914522502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e413be40 con 0x7f28e40d01e0 2023-10-10T21:02:28.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.772+0000 7f28ead9d700 1 -- 172.21.15.154:0/914522502 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e413c120 con 0x7f28e41471f0 2023-10-10T21:02:28.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.772+0000 7f28e9d9b700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e40d01e0 0x7f28e414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.773+0000 7f28e959a700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41471f0 0x7f28e4146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.773+0000 7f28e9d9b700 1 -- 172.21.15.154:0/914522502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41471f0 msgr2=0x7f28e4146260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.773+0000 7f28e9d9b700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41471f0 0x7f28e4146260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.773+0000 7f28e9d9b700 1 -- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 msgr2=0x7f28e413ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:28.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.773+0000 7f28e9d9b700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 0x7f28e413ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:28.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.773+0000 7f28e9d9b700 1 -- 172.21.15.154:0/914522502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e00094f0 con 0x7f28e40d01e0 2023-10-10T21:02:28.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.773+0000 7f28ea59c700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 0x7f28e413ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:28.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.774+0000 7f28e9d9b700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e40d01e0 0x7f28e414f740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c4e0 tx=0x7f28d4007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.774+0000 7f28d9ffb700 1 -- 172.21.15.154:0/914522502 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4011590 con 0x7f28e40d01e0 2023-10-10T21:02:28.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.774+0000 7f28d9ffb700 1 -- 172.21.15.154:0/914522502 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4011710 con 0x7f28e40d01e0 2023-10-10T21:02:28.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.774+0000 7f28d9ffb700 1 -- 172.21.15.154:0/914522502 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4011ad0 con 0x7f28e40d01e0 2023-10-10T21:02:28.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.774+0000 7f28ead9d700 1 -- 172.21.15.154:0/914522502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e413c400 con 0x7f28e40d01e0 2023-10-10T21:02:28.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.775+0000 7f28ead9d700 1 -- 172.21.15.154:0/914522502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e41467a0 con 0x7f28e40d01e0 2023-10-10T21:02:28.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.777+0000 7f28c77fe700 1 -- 172.21.15.154:0/914522502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c00052b0 con 0x7f28e40d01e0 2023-10-10T21:02:28.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.777+0000 7f1415ffb700 1 -- 172.21.15.154:0/760078053 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f141c053ee0 con 0x7f1420159420 2023-10-10T21:02:28.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.779+0000 7f8804ff9700 1 -- 172.21.15.154:0/1924583784 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87fc053760 con 0x7f87f8003b30 2023-10-10T21:02:28.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.779+0000 7f28d9ffb700 1 -- 172.21.15.154:0/914522502 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28d401c460 con 0x7f28e40d01e0 2023-10-10T21:02:28.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.780+0000 7f28d9ffb700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f28c8066f30 0x7f28c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:28.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.781+0000 7f28e959a700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f28c8066f30 0x7f28c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:28.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.782+0000 7f28e959a700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f28c8066f30 0x7f28c80693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28e00099b0 tx=0x7f28e0016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:28.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.782+0000 7f28d9ffb700 1 -- 172.21.15.154:0/914522502 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28d4055960 con 0x7f28e40d01e0 2023-10-10T21:02:28.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:28.788+0000 7f28d9ffb700 1 -- 172.21.15.154:0/914522502 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28d4051d30 con 0x7f28e40d01e0 2023-10-10T21:02:29.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.082+0000 7fdd86ffd700 1 -- 172.21.15.154:0/812991546 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd9c04bb80 con 0x7fdd9c0b2d00 2023-10-10T21:02:29.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.082+0000 7fdd917fa700 1 -- 172.21.15.154:0/812991546 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd980549e0 con 0x7fdd9c0b2d00 2023-10-10T21:02:29.085 INFO:teuthology.orchestra.run.smithi154.stdout:60129542150 2023-10-10T21:02:29.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.087+0000 7fdda259d700 1 -- 172.21.15.154:0/812991546 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fdd80067080 msgr2=0x7fdd80069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.088+0000 7fdda259d700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fdd80067080 0x7fdd80069530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009740 tx=0x7fdd8c006c60 comp rx=0 tx=0).stop 2023-10-10T21:02:29.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.088+0000 7fdda259d700 1 -- 172.21.15.154:0/812991546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd9c0b2d00 msgr2=0x7fdd9c086f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.088+0000 7fdda259d700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd9c0b2d00 0x7fdd9c086f40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c810 tx=0x7fdd98007ee0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.088+0000 7fdda259d700 1 -- 172.21.15.154:0/812991546 shutdown_connections 2023-10-10T21:02:29.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.088+0000 7fdda259d700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd9c0b33a0 0x7fdd9c142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.089+0000 7fdda259d700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd9c0b1700 0x7fdd9c154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.089+0000 7fdda259d700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fdd80067080 0x7fdd80069530 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.089+0000 7fdda259d700 1 --2- 172.21.15.154:0/812991546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd9c0b2d00 0x7fdd9c086f40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.089+0000 7fdda259d700 1 -- 172.21.15.154:0/812991546 >> 172.21.15.154:0/812991546 conn(0x7fdd9c0d1080 msgr2=0x7fdd9c0af630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.089+0000 7fdda259d700 1 -- 172.21.15.154:0/812991546 shutdown_connections 2023-10-10T21:02:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.089+0000 7fdda259d700 1 -- 172.21.15.154:0/812991546 wait complete. 2023-10-10T21:02:29.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.1 2023-10-10T21:02:29.121 DEBUG:teuthology.parallel:result is None 2023-10-10T21:02:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.164+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f77e8005560 con 0x7f78000547c0 2023-10-10T21:02:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.165+0000 7f77f37fe700 1 -- 172.21.15.154:0/1984666199 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77fc053240 con 0x7f78000547c0 2023-10-10T21:02:29.166 INFO:teuthology.orchestra.run.smithi154.stdout:60129542150 2023-10-10T21:02:29.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f77ec067000 msgr2=0x7f77ec0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f77ec067000 0x7f77ec0694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f77f400adc0 tx=0x7f77f4006f90 comp rx=0 tx=0).stop 2023-10-10T21:02:29.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 msgr2=0x7f78000da960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f78000da960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77fc002000 tx=0x7f77fc016000 comp rx=0 tx=0).stop 2023-10-10T21:02:29.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 shutdown_connections 2023-10-10T21:02:29.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78000e60a0 0x7f780003ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f77ec067000 0x7f77ec0694b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78000547c0 0x7f78000da960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 --2- 172.21.15.154:0/1984666199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000dc430 0x7f78000def00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 >> 172.21.15.154:0/1984666199 conn(0x7f780000e7c0 msgr2=0x7f78000e1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.168+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 shutdown_connections 2023-10-10T21:02:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.169+0000 7f780cb9d700 1 -- 172.21.15.154:0/1984666199 wait complete. 2023-10-10T21:02:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.176+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9550005560 con 0x7f956c0691b0 2023-10-10T21:02:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.177+0000 7f955a7fc700 1 -- 172.21.15.154:0/1949400314 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f955c050be0 con 0x7f956c0691b0 2023-10-10T21:02:29.178 INFO:teuthology.orchestra.run.smithi154.stdout:60129542152 2023-10-10T21:02:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.179+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa488005560 con 0x7fa4a80b3420 2023-10-10T21:02:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.179+0000 7fa48f7fe700 1 -- 172.21.15.154:0/3042896783 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa498017030 con 0x7fa4a80b3420 2023-10-10T21:02:29.181 INFO:teuthology.orchestra.run.smithi154.stdout:60129542150 2023-10-10T21:02:29.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.181+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f954c067080 msgr2=0x7f954c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.181+0000 7f95709ff700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f954c067080 0x7f954c069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f956c18b3b0 tx=0x7f9560009120 comp rx=0 tx=0).stop 2023-10-10T21:02:29.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.181+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0691b0 msgr2=0x7f956c0a6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.181+0000 7f95709ff700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0691b0 0x7f956c0a6cb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f955c00c560 tx=0x7f955c001020 comp rx=0 tx=0).stop 2023-10-10T21:02:29.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.182+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 shutdown_connections 2023-10-10T21:02:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.182+0000 7f95709ff700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f956c166960 0x7f956c0a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.182+0000 7f95709ff700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f954c067080 0x7f954c069530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.182+0000 7f95709ff700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f956c0691b0 0x7f956c0a6cb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.182+0000 7f95709ff700 1 --2- 172.21.15.154:0/1949400314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f956c0afe00 0x7f956c0aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.182+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 >> 172.21.15.154:0/1949400314 conn(0x7f956c0cd000 msgr2=0x7f956c0ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.182+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 shutdown_connections 2023-10-10T21:02:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.182+0000 7f95709ff700 1 -- 172.21.15.154:0/1949400314 wait complete. 2023-10-10T21:02:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.183+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa494067080 msgr2=0x7fa494069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.183+0000 7fa4ac99d700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa494067080 0x7fa494069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8087940 tx=0x7fa49c009040 comp rx=0 tx=0).stop 2023-10-10T21:02:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.183+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b3420 msgr2=0x7fa4a8153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.183+0000 7fa4ac99d700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b3420 0x7fa4a8153c20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa49800c7c0 tx=0x7fa498007e00 comp rx=0 tx=0).stop 2023-10-10T21:02:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.184+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 shutdown_connections 2023-10-10T21:02:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.184+0000 7fa4ac99d700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a815d980 0x7fa4a8156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.184+0000 7fa4ac99d700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80b1e50 0x7fa4a8178600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.184+0000 7fa4ac99d700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa494067080 0x7fa494069530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.184+0000 7fa4ac99d700 1 --2- 172.21.15.154:0/3042896783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a80b3420 0x7fa4a8153c20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.184+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 >> 172.21.15.154:0/3042896783 conn(0x7fa4a80d1130 msgr2=0x7fa4a815c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.184+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 shutdown_connections 2023-10-10T21:02:29.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.185+0000 7fa4ac99d700 1 -- 172.21.15.154:0/3042896783 wait complete. 2023-10-10T21:02:29.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.5 2023-10-10T21:02:29.195 DEBUG:teuthology.parallel:result is None 2023-10-10T21:02:29.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.201+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff744005560 con 0x7ff75c0e3ff0 2023-10-10T21:02:29.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.203+0000 7ff7597fa700 1 -- 172.21.15.154:0/3442938797 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff764096020 con 0x7ff75c0e3ff0 2023-10-10T21:02:29.204 INFO:teuthology.orchestra.run.smithi154.stdout:60129542152 2023-10-10T21:02:29.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.0 2023-10-10T21:02:29.207 DEBUG:teuthology.parallel:result is None 2023-10-10T21:02:29.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.205+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff748067000 msgr2=0x7ff7480694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff748067000 0x7ff7480694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff7600099b0 tx=0x7ff760017000 comp rx=0 tx=0).stop 2023-10-10T21:02:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c0e3ff0 msgr2=0x7ff75c0507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c0e3ff0 0x7ff75c0507a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff764076f50 tx=0x7ff764066260 comp rx=0 tx=0).stop 2023-10-10T21:02:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 shutdown_connections 2023-10-10T21:02:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c0e3ff0 0x7ff75c0507a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff75c039420 0x7ff75c0df800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff748067000 0x7ff7480694b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 --2- 172.21.15.154:0/3442938797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff75c0e24c0 0x7ff75c0fa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 >> 172.21.15.154:0/3442938797 conn(0x7ff75c059b30 msgr2=0x7ff75c03d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 shutdown_connections 2023-10-10T21:02:29.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.206+0000 7ff76b5ff700 1 -- 172.21.15.154:0/3442938797 wait complete. 2023-10-10T21:02:29.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.6 2023-10-10T21:02:29.217 DEBUG:teuthology.parallel:result is None 2023-10-10T21:02:29.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.218+0000 7f28c77fe700 1 -- 172.21.15.154:0/914522502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28c0005830 con 0x7f28e40d01e0 2023-10-10T21:02:29.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.219+0000 7f28d9ffb700 1 -- 172.21.15.154:0/914522502 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28d4051d30 con 0x7f28e40d01e0 2023-10-10T21:02:29.220 INFO:teuthology.orchestra.run.smithi154.stdout:64424509446 2023-10-10T21:02:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.221+0000 7f28c77fe700 1 -- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f28c8066f30 msgr2=0x7f28c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.221+0000 7f28c77fe700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f28c8066f30 0x7f28c80693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28e00099b0 tx=0x7f28e0016000 comp rx=0 tx=0).stop 2023-10-10T21:02:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.221+0000 7f28c77fe700 1 -- 172.21.15.154:0/914522502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e40d01e0 msgr2=0x7f28e414f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.221+0000 7f28c77fe700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e40d01e0 0x7f28e414f740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c4e0 tx=0x7f28d4007ea0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.222+0000 7f28c77fe700 1 -- 172.21.15.154:0/914522502 shutdown_connections 2023-10-10T21:02:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.222+0000 7f28c77fe700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28e4161d40 0x7f28e413ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.222+0000 7f28c77fe700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e40d01e0 0x7f28e414f740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.222+0000 7f28c77fe700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f28c8066f30 0x7f28c80693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.222+0000 7f28c77fe700 1 --2- 172.21.15.154:0/914522502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41471f0 0x7f28e4146260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.222+0000 7f28c77fe700 1 -- 172.21.15.154:0/914522502 >> 172.21.15.154:0/914522502 conn(0x7f28e40d0660 msgr2=0x7f28e40b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.222+0000 7f28c77fe700 1 -- 172.21.15.154:0/914522502 shutdown_connections 2023-10-10T21:02:29.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.222+0000 7f28c77fe700 1 -- 172.21.15.154:0/914522502 wait complete. 2023-10-10T21:02:29.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.224+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f880806a5b0 con 0x7f87f8003b30 2023-10-10T21:02:29.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.224+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1400005560 con 0x7f1420159420 2023-10-10T21:02:29.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.224+0000 7f8804ff9700 1 -- 172.21.15.154:0/1924583784 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87fc02a030 con 0x7f87f8003b30 2023-10-10T21:02:29.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.224+0000 7f1415ffb700 1 -- 172.21.15.154:0/760078053 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f141c009280 con 0x7f1420159420 2023-10-10T21:02:29.227 INFO:teuthology.orchestra.run.smithi154.stdout:60129542152 2023-10-10T21:02:29.228 INFO:teuthology.orchestra.run.smithi154.stdout:60129542151 2023-10-10T21:02:29.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.2 2023-10-10T21:02:29.229 DEBUG:teuthology.parallel:result is None 2023-10-10T21:02:29.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1404067080 msgr2=0x7f1404069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1404067080 0x7f1404069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f14200cd0e0 tx=0x7f1410007eb0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 msgr2=0x7f1420153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 0x7f1420153430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1420089340 tx=0x7f141c017000 comp rx=0 tx=0).stop 2023-10-10T21:02:29.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 shutdown_connections 2023-10-10T21:02:29.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1404067080 0x7f1404069530 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142015d230 0x7f1420150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1420159420 0x7f1420153430 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 --2- 172.21.15.154:0/760078053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14201597f0 0x7f142015c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.227+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 >> 172.21.15.154:0/760078053 conn(0x7f14200d0660 msgr2=0x7f1420069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.228+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 shutdown_connections 2023-10-10T21:02:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.228+0000 7f142699d700 1 -- 172.21.15.154:0/760078053 wait complete. 2023-10-10T21:02:29.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f87ec066fb0 msgr2=0x7f87ec069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f87ec066fb0 0x7f87ec069460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87f4006c80 tx=0x7f87f4008040 comp rx=0 tx=0).stop 2023-10-10T21:02:29.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f8003b30 msgr2=0x7f88080cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f8003b30 0x7f88080cd0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87fc015000 tx=0x7f87fc016000 comp rx=0 tx=0).stop 2023-10-10T21:02:29.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 shutdown_connections 2023-10-10T21:02:29.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f87ec066fb0 0x7f87ec069460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88080cf200 0x7f88080cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f8003b30 0x7f88080cd0c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 --2- 172.21.15.154:0/1924583784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8808154a10 0x7f88080cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 >> 172.21.15.154:0/1924583784 conn(0x7f8808068e20 msgr2=0x7f8808069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 shutdown_connections 2023-10-10T21:02:29.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.229+0000 7f880edff700 1 -- 172.21.15.154:0/1924583784 wait complete. 2023-10-10T21:02:29.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2023-10-10T21:02:29.246 DEBUG:teuthology.parallel:result is None 2023-10-10T21:02:29.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.7 2023-10-10T21:02:29.257 DEBUG:teuthology.parallel:result is None 2023-10-10T21:02:29.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.4 2023-10-10T21:02:29.258 DEBUG:teuthology.parallel:result is None 2023-10-10T21:02:29.258 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-10T21:02:29.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:02:29.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.477+0000 7fd1a15ff700 1 Processor -- start 2023-10-10T21:02:29.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.477+0000 7fd1a15ff700 1 -- start start 2023-10-10T21:02:29.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.478+0000 7fd1a15ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd19c155c10 0x7fd19c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd1a15ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd19c0ac6d0 0x7fd19c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd1a15ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c0acac0 con 0x7fd19c0ac230 2023-10-10T21:02:29.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd1a15ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0ad930 con 0x7fd19c155c10 2023-10-10T21:02:29.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd1a15ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0acd20 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd19affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd19c155c10 0x7fd19c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd19affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd19c155c10 0x7fd19c155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55878/0 (socket says 172.21.15.154:55878) 2023-10-10T21:02:29.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd19affd700 1 -- 172.21.15.154:0/1209188026 learned_addr learned my addr 172.21.15.154:0/1209188026 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:29.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd19affd700 1 -- 172.21.15.154:0/1209188026 >> v2:172.21.15.179:3300/0 conn(0x7fd19c0ac6d0 msgr2=0x7fd19c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:29.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd19affd700 1 --2- 172.21.15.154:0/1209188026 >> v2:172.21.15.179:3300/0 conn(0x7fd19c0ac6d0 0x7fd19c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd19affd700 1 -- 172.21.15.154:0/1209188026 >> v1:172.21.15.179:6789/0 conn(0x7fd19c0ac230 legacy=0x7fd19c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:29.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd19affd700 1 -- 172.21.15.154:0/1209188026 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0ad000 con 0x7fd19c155c10 2023-10-10T21:02:29.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.479+0000 7fd19affd700 1 --2- 172.21.15.154:0/1209188026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c155c10 0x7fd19c155fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0ae0c0 tx=0x7fd18c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f53e4a0dc4368a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:29.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1209188026 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00b820 con 0x7fd19c155c10 2023-10-10T21:02:29.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1209188026 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00b980 con 0x7fd19c155c10 2023-10-10T21:02:29.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1209188026 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00bd20 con 0x7fd19c155c10 2023-10-10T21:02:29.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1209188026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c155c10 msgr2=0x7fd19c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd1a15ff700 1 --2- 172.21.15.154:0/1209188026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c155c10 0x7fd19c155fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0ae0c0 tx=0x7fd18c009250 comp rx=0 tx=0).stop 2023-10-10T21:02:29.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1209188026 shutdown_connections 2023-10-10T21:02:29.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd1a15ff700 1 --2- 172.21.15.154:0/1209188026 >> v2:172.21.15.179:3300/0 conn(0x7fd19c0ac6d0 0x7fd19c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd1a15ff700 1 --2- 172.21.15.154:0/1209188026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c155c10 0x7fd19c155fe0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1209188026 >> 172.21.15.154:0/1209188026 conn(0x7fd19c06a320 msgr2=0x7fd19c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1209188026 shutdown_connections 2023-10-10T21:02:29.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.480+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1209188026 wait complete. 2023-10-10T21:02:29.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.482+0000 7fd1a15ff700 1 Processor -- start 2023-10-10T21:02:29.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.482+0000 7fd1a15ff700 1 -- start start 2023-10-10T21:02:29.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd1a15ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19c0ac230 0x7fd19c0aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd1a15ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c0ac6d0 0x7fd19c14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd1a15ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd19c155c10 0x7fd19c14df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd1a15ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c150930 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd1a15ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c150c10 con 0x7fd19c155c10 2023-10-10T21:02:29.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd1a15ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c150ef0 con 0x7fd19c0ac230 2023-10-10T21:02:29.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd193fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c0ac6d0 0x7fd19c14d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd193fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c0ac6d0 0x7fd19c14d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55892/0 (socket says 172.21.15.154:55892) 2023-10-10T21:02:29.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd193fff700 1 -- 172.21.15.154:0/1387331101 learned_addr learned my addr 172.21.15.154:0/1387331101 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:29.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd19affd700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19c0ac230 0x7fd19c0aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd19b7fe700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd19c155c10 0x7fd19c14df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd193fff700 1 -- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19c0ac230 msgr2=0x7fd19c0aaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd193fff700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19c0ac230 0x7fd19c0aaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd193fff700 1 -- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd19c155c10 msgr2=0x7fd19c14df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd193fff700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd19c155c10 0x7fd19c14df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd193fff700 1 -- 172.21.15.154:0/1387331101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0094f0 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd19affd700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19c0ac230 0x7fd19c0aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:29.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.483+0000 7fd19b7fe700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd19c155c10 0x7fd19c14df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:29.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.484+0000 7fd193fff700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c0ac6d0 0x7fd19c14d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd18400b600 tx=0x7fd1840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:29.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.484+0000 7fd192ffd700 1 -- 172.21.15.154:0/1387331101 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400f510 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.484+0000 7fd192ffd700 1 -- 172.21.15.154:0/1387331101 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18400f670 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.484+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c1511d0 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.484+0000 7fd192ffd700 1 -- 172.21.15.154:0/1387331101 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400fa30 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.484+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c0aafa0 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.485+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c04c3c0 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.486+0000 7fd192ffd700 1 -- 172.21.15.154:0/1387331101 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd18401a400 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.487+0000 7fd192ffd700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd17c066f30 0x7fd17c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.487+0000 7fd192ffd700 1 -- 172.21.15.154:0/1387331101 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd184084090 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.487+0000 7fd19affd700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd17c066f30 0x7fd17c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.488+0000 7fd19affd700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd17c066f30 0x7fd17c0693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0ae0c0 tx=0x7fd18c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:29.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.491+0000 7fd192ffd700 1 -- 172.21.15.154:0/1387331101 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1840512e0 con 0x7fd19c0ac6d0 2023-10-10T21:02:29.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.678+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd19c150d80 con 0x7fd17c066f30 2023-10-10T21:02:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.686+0000 7fd192ffd700 1 -- 172.21.15.154:0/1387331101 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264467 (secure 0 0 0) 0x7fd19c150d80 con 0x7fd17c066f30 2023-10-10T21:02:29.691 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd17c066f30 msgr2=0x7fd17c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd17c066f30 0x7fd17c0693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0ae0c0 tx=0x7fd18c016000 comp rx=0 tx=0).stop 2023-10-10T21:02:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c0ac6d0 msgr2=0x7fd19c14d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c0ac6d0 0x7fd19c14d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd18400b600 tx=0x7fd1840091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 shutdown_connections 2023-10-10T21:02:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd19c155c10 0x7fd19c14df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd17c066f30 0x7fd17c0693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19c0ac230 0x7fd19c0aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 --2- 172.21.15.154:0/1387331101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd19c0ac6d0 0x7fd19c14d9c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 >> 172.21.15.154:0/1387331101 conn(0x7fd19c06a320 msgr2=0x7fd19c153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.690+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 shutdown_connections 2023-10-10T21:02:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.691+0000 7fd1a15ff700 1 -- 172.21.15.154:0/1387331101 wait complete. 2023-10-10T21:02:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:02:29.709 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-10T21:02:27.856116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381288,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593432,"statfs":{"total":773094113280,"available":770655674368,"internally_reserved":0,"allocated":3055616,"data_stored":1811284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.164608"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731857+0000","last_change":"2023-10-10T21:02:19.727081+0000","last_active":"2023-10-10T21:02:19.731857+0000","last_peered":"2023-10-10T21:02:19.731857+0000","last_clean":"2023-10-10T21:02:19.731857+0000","last_became_active":"2023-10-10T21:02:19.726754+0000","last_became_peered":"2023-10-10T21:02:19.726754+0000","last_unstale":"2023-10-10T21:02:19.731857+0000","last_undegraded":"2023-10-10T21:02:19.731857+0000","last_fullsized":"2023-10-10T21:02:19.731857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:51.819041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.729741+0000","last_change":"2023-10-10T21:02:19.728351+0000","last_active":"2023-10-10T21:02:19.729741+0000","last_peered":"2023-10-10T21:02:19.729741+0000","last_clean":"2023-10-10T21:02:19.729741+0000","last_became_active":"2023-10-10T21:02:19.728087+0000","last_became_peered":"2023-10-10T21:02:19.728087+0000","last_unstale":"2023-10-10T21:02:19.729741+0000","last_undegraded":"2023-10-10T21:02:19.729741+0000","last_fullsized":"2023-10-10T21:02:19.729741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721483+0000","last_change":"2023-10-10T21:02:19.713674+0000","last_active":"2023-10-10T21:02:19.721483+0000","last_peered":"2023-10-10T21:02:19.721483+0000","last_clean":"2023-10-10T21:02:19.721483+0000","last_became_active":"2023-10-10T21:02:19.713276+0000","last_became_peered":"2023-10-10T21:02:19.713276+0000","last_unstale":"2023-10-10T21:02:19.721483+0000","last_undegraded":"2023-10-10T21:02:19.721483+0000","last_fullsized":"2023-10-10T21:02:19.721483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:34:22.625292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717566+0000","last_change":"2023-10-10T21:02:19.710812+0000","last_active":"2023-10-10T21:02:19.717566+0000","last_peered":"2023-10-10T21:02:19.717566+0000","last_clean":"2023-10-10T21:02:19.717566+0000","last_became_active":"2023-10-10T21:02:19.710422+0000","last_became_peered":"2023-10-10T21:02:19.710422+0000","last_unstale":"2023-10-10T21:02:19.717566+0000","last_undegraded":"2023-10-10T21:02:19.717566+0000","last_fullsized":"2023-10-10T21:02:19.717566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:11:55.480332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719232+0000","last_change":"2023-10-10T21:02:19.714401+0000","last_active":"2023-10-10T21:02:19.719232+0000","last_peered":"2023-10-10T21:02:19.719232+0000","last_clean":"2023-10-10T21:02:19.719232+0000","last_became_active":"2023-10-10T21:02:19.714045+0000","last_became_peered":"2023-10-10T21:02:19.714045+0000","last_unstale":"2023-10-10T21:02:19.719232+0000","last_undegraded":"2023-10-10T21:02:19.719232+0000","last_fullsized":"2023-10-10T21:02:19.719232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:33:01.750601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.729464+0000","last_change":"2023-10-10T21:02:19.724680+0000","last_active":"2023-10-10T21:02:19.729464+0000","last_peered":"2023-10-10T21:02:19.729464+0000","last_clean":"2023-10-10T21:02:19.729464+0000","last_became_active":"2023-10-10T21:02:19.721313+0000","last_became_peered":"2023-10-10T21:02:19.721313+0000","last_unstale":"2023-10-10T21:02:19.729464+0000","last_undegraded":"2023-10-10T21:02:19.729464+0000","last_fullsized":"2023-10-10T21:02:19.729464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727053+0000","last_change":"2023-10-10T21:02:19.722047+0000","last_active":"2023-10-10T21:02:19.727053+0000","last_peered":"2023-10-10T21:02:19.727053+0000","last_clean":"2023-10-10T21:02:19.727053+0000","last_became_active":"2023-10-10T21:02:19.721771+0000","last_became_peered":"2023-10-10T21:02:19.721771+0000","last_unstale":"2023-10-10T21:02:19.727053+0000","last_undegraded":"2023-10-10T21:02:19.727053+0000","last_fullsized":"2023-10-10T21:02:19.727053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726576+0000","last_change":"2023-10-10T21:02:19.718311+0000","last_active":"2023-10-10T21:02:19.726576+0000","last_peered":"2023-10-10T21:02:19.726576+0000","last_clean":"2023-10-10T21:02:19.726576+0000","last_became_active":"2023-10-10T21:02:19.718055+0000","last_became_peered":"2023-10-10T21:02:19.718055+0000","last_unstale":"2023-10-10T21:02:19.726576+0000","last_undegraded":"2023-10-10T21:02:19.726576+0000","last_fullsized":"2023-10-10T21:02:19.726576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:02:29.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727168+0000","last_change":"2023-10-10T21:02:19.721906+0000","last_active":"2023-10-10T21:02:19.727168+0000","last_peered":"2023-10-10T21:02:19.727168+0000","last_clean":"2023-10-10T21:02:19.727168+0000","last_became_active":"2023-10-10T21:02:19.721669+0000","last_became_peered":"2023-10-10T21:02:19.721669+0000","last_unstale":"2023-10-10T21:02:19.727168+0000","last_undegraded":"2023-10-10T21:02:19.727168+0000","last_fullsized":"2023-10-10T21:02:19.727168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:24.203380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725542+0000","last_change":"2023-10-10T21:02:19.722093+0000","last_active":"2023-10-10T21:02:19.725542+0000","last_peered":"2023-10-10T21:02:19.725542+0000","last_clean":"2023-10-10T21:02:19.725542+0000","last_became_active":"2023-10-10T21:02:19.721844+0000","last_became_peered":"2023-10-10T21:02:19.721844+0000","last_unstale":"2023-10-10T21:02:19.725542+0000","last_undegraded":"2023-10-10T21:02:19.725542+0000","last_fullsized":"2023-10-10T21:02:19.725542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725512+0000","last_change":"2023-10-10T21:02:19.721570+0000","last_active":"2023-10-10T21:02:19.725512+0000","last_peered":"2023-10-10T21:02:19.725512+0000","last_clean":"2023-10-10T21:02:19.725512+0000","last_became_active":"2023-10-10T21:02:19.721289+0000","last_became_peered":"2023-10-10T21:02:19.721289+0000","last_unstale":"2023-10-10T21:02:19.725512+0000","last_undegraded":"2023-10-10T21:02:19.725512+0000","last_fullsized":"2023-10-10T21:02:19.725512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725875+0000","last_change":"2023-10-10T21:02:19.717746+0000","last_active":"2023-10-10T21:02:19.725875+0000","last_peered":"2023-10-10T21:02:19.725875+0000","last_clean":"2023-10-10T21:02:19.725875+0000","last_became_active":"2023-10-10T21:02:19.717435+0000","last_became_peered":"2023-10-10T21:02:19.717435+0000","last_unstale":"2023-10-10T21:02:19.725875+0000","last_undegraded":"2023-10-10T21:02:19.725875+0000","last_fullsized":"2023-10-10T21:02:19.725875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:50.911075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726896+0000","last_change":"2023-10-10T21:02:19.719831+0000","last_active":"2023-10-10T21:02:19.726896+0000","last_peered":"2023-10-10T21:02:19.726896+0000","last_clean":"2023-10-10T21:02:19.726896+0000","last_became_active":"2023-10-10T21:02:19.719580+0000","last_became_peered":"2023-10-10T21:02:19.719580+0000","last_unstale":"2023-10-10T21:02:19.726896+0000","last_undegraded":"2023-10-10T21:02:19.726896+0000","last_fullsized":"2023-10-10T21:02:19.726896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:57.187854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722504+0000","last_change":"2023-10-10T21:02:19.720031+0000","last_active":"2023-10-10T21:02:19.722504+0000","last_peered":"2023-10-10T21:02:19.722504+0000","last_clean":"2023-10-10T21:02:19.722504+0000","last_became_active":"2023-10-10T21:02:19.719689+0000","last_became_peered":"2023-10-10T21:02:19.719689+0000","last_unstale":"2023-10-10T21:02:19.722504+0000","last_undegraded":"2023-10-10T21:02:19.722504+0000","last_fullsized":"2023-10-10T21:02:19.722504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:15.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.706091+0000","last_change":"2023-10-10T21:02:19.704316+0000","last_active":"2023-10-10T21:02:19.706091+0000","last_peered":"2023-10-10T21:02:19.706091+0000","last_clean":"2023-10-10T21:02:19.706091+0000","last_became_active":"2023-10-10T21:02:19.704005+0000","last_became_peered":"2023-10-10T21:02:19.704005+0000","last_unstale":"2023-10-10T21:02:19.706091+0000","last_undegraded":"2023-10-10T21:02:19.706091+0000","last_fullsized":"2023-10-10T21:02:19.706091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:15.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724555+0000","last_change":"2023-10-10T21:02:19.721535+0000","last_active":"2023-10-10T21:02:19.724555+0000","last_peered":"2023-10-10T21:02:19.724555+0000","last_clean":"2023-10-10T21:02:19.724555+0000","last_became_active":"2023-10-10T21:02:19.721252+0000","last_became_peered":"2023-10-10T21:02:19.721252+0000","last_unstale":"2023-10-10T21:02:19.724555+0000","last_undegraded":"2023-10-10T21:02:19.724555+0000","last_fullsized":"2023-10-10T21:02:19.724555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718215+0000","last_change":"2023-10-10T21:02:19.713601+0000","last_active":"2023-10-10T21:02:19.718215+0000","last_peered":"2023-10-10T21:02:19.718215+0000","last_clean":"2023-10-10T21:02:19.718215+0000","last_became_active":"2023-10-10T21:02:19.713243+0000","last_became_peered":"2023-10-10T21:02:19.713243+0000","last_unstale":"2023-10-10T21:02:19.718215+0000","last_undegraded":"2023-10-10T21:02:19.718215+0000","last_fullsized":"2023-10-10T21:02:19.718215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:33:01.750601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726941+0000","last_change":"2023-10-10T21:02:19.724421+0000","last_active":"2023-10-10T21:02:19.726941+0000","last_peered":"2023-10-10T21:02:19.726941+0000","last_clean":"2023-10-10T21:02:19.726941+0000","last_became_active":"2023-10-10T21:02:19.724172+0000","last_became_peered":"2023-10-10T21:02:19.724172+0000","last_unstale":"2023-10-10T21:02:19.726941+0000","last_undegraded":"2023-10-10T21:02:19.726941+0000","last_fullsized":"2023-10-10T21:02:19.726941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:12:42.333132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719861+0000","last_change":"2023-10-10T21:02:19.715088+0000","last_active":"2023-10-10T21:02:19.719861+0000","last_peered":"2023-10-10T21:02:19.719861+0000","last_clean":"2023-10-10T21:02:19.719861+0000","last_became_active":"2023-10-10T21:02:19.714808+0000","last_became_peered":"2023-10-10T21:02:19.714808+0000","last_unstale":"2023-10-10T21:02:19.719861+0000","last_undegraded":"2023-10-10T21:02:19.719861+0000","last_fullsized":"2023-10-10T21:02:19.719861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723560+0000","last_change":"2023-10-10T21:02:18.705916+0000","last_active":"2023-10-10T21:02:19.723560+0000","last_peered":"2023-10-10T21:02:19.723560+0000","last_clean":"2023-10-10T21:02:19.723560+0000","last_became_active":"2023-10-10T21:02:18.705673+0000","last_became_peered":"2023-10-10T21:02:18.705673+0000","last_unstale":"2023-10-10T21:02:19.723560+0000","last_undegraded":"2023-10-10T21:02:19.723560+0000","last_fullsized":"2023-10-10T21:02:19.723560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:00:07.742782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727117+0000","last_change":"2023-10-10T21:02:19.721545+0000","last_active":"2023-10-10T21:02:19.727117+0000","last_peered":"2023-10-10T21:02:19.727117+0000","last_clean":"2023-10-10T21:02:19.727117+0000","last_became_active":"2023-10-10T21:02:19.721267+0000","last_became_peered":"2023-10-10T21:02:19.721267+0000","last_unstale":"2023-10-10T21:02:19.727117+0000","last_undegraded":"2023-10-10T21:02:19.727117+0000","last_fullsized":"2023-10-10T21:02:19.727117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:36:45.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726622+0000","last_change":"2023-10-10T21:02:18.708750+0000","last_active":"2023-10-10T21:02:19.726622+0000","last_peered":"2023-10-10T21:02:19.726622+0000","last_clean":"2023-10-10T21:02:19.726622+0000","last_became_active":"2023-10-10T21:02:18.708377+0000","last_became_peered":"2023-10-10T21:02:18.708377+0000","last_unstale":"2023-10-10T21:02:19.726622+0000","last_undegraded":"2023-10-10T21:02:19.726622+0000","last_fullsized":"2023-10-10T21:02:19.726622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:41:42.908310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727729+0000","last_change":"2023-10-10T21:02:19.723005+0000","last_active":"2023-10-10T21:02:19.727729+0000","last_peered":"2023-10-10T21:02:19.727729+0000","last_clean":"2023-10-10T21:02:19.727729+0000","last_became_active":"2023-10-10T21:02:19.722761+0000","last_became_peered":"2023-10-10T21:02:19.722761+0000","last_unstale":"2023-10-10T21:02:19.727729+0000","last_undegraded":"2023-10-10T21:02:19.727729+0000","last_fullsized":"2023-10-10T21:02:19.727729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.732039+0000","last_change":"2023-10-10T21:02:18.715526+0000","last_active":"2023-10-10T21:02:19.732039+0000","last_peered":"2023-10-10T21:02:19.732039+0000","last_clean":"2023-10-10T21:02:19.732039+0000","last_became_active":"2023-10-10T21:02:18.715098+0000","last_became_peered":"2023-10-10T21:02:18.715098+0000","last_unstale":"2023-10-10T21:02:19.732039+0000","last_undegraded":"2023-10-10T21:02:19.732039+0000","last_fullsized":"2023-10-10T21:02:19.732039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718973+0000","last_change":"2023-10-10T21:02:19.714549+0000","last_active":"2023-10-10T21:02:19.718973+0000","last_peered":"2023-10-10T21:02:19.718973+0000","last_clean":"2023-10-10T21:02:19.718973+0000","last_became_active":"2023-10-10T21:02:19.714241+0000","last_became_peered":"2023-10-10T21:02:19.714241+0000","last_unstale":"2023-10-10T21:02:19.718973+0000","last_undegraded":"2023-10-10T21:02:19.718973+0000","last_fullsized":"2023-10-10T21:02:19.718973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:51.819041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.732761+0000","last_change":"2023-10-10T21:02:18.721479+0000","last_active":"2023-10-10T21:02:19.732761+0000","last_peered":"2023-10-10T21:02:19.732761+0000","last_clean":"2023-10-10T21:02:19.732761+0000","last_became_active":"2023-10-10T21:02:18.721197+0000","last_became_peered":"2023-10-10T21:02:18.721197+0000","last_unstale":"2023-10-10T21:02:19.732761+0000","last_undegraded":"2023-10-10T21:02:19.732761+0000","last_fullsized":"2023-10-10T21:02:19.732761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.720290+0000","last_change":"2023-10-10T21:02:19.714941+0000","last_active":"2023-10-10T21:02:19.720290+0000","last_peered":"2023-10-10T21:02:19.720290+0000","last_clean":"2023-10-10T21:02:19.720290+0000","last_became_active":"2023-10-10T21:02:19.714068+0000","last_became_peered":"2023-10-10T21:02:19.714068+0000","last_unstale":"2023-10-10T21:02:19.720290+0000","last_undegraded":"2023-10-10T21:02:19.720290+0000","last_fullsized":"2023-10-10T21:02:19.720290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:24.203380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730306+0000","last_change":"2023-10-10T21:02:18.716842+0000","last_active":"2023-10-10T21:02:19.730306+0000","last_peered":"2023-10-10T21:02:19.730306+0000","last_clean":"2023-10-10T21:02:19.730306+0000","last_became_active":"2023-10-10T21:02:18.716540+0000","last_became_peered":"2023-10-10T21:02:18.716540+0000","last_unstale":"2023-10-10T21:02:19.730306+0000","last_undegraded":"2023-10-10T21:02:19.730306+0000","last_fullsized":"2023-10-10T21:02:19.730306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:24:11.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717957+0000","last_change":"2023-10-10T21:02:19.709639+0000","last_active":"2023-10-10T21:02:19.717957+0000","last_peered":"2023-10-10T21:02:19.717957+0000","last_clean":"2023-10-10T21:02:19.717957+0000","last_became_active":"2023-10-10T21:02:19.708657+0000","last_became_peered":"2023-10-10T21:02:19.708657+0000","last_unstale":"2023-10-10T21:02:19.717957+0000","last_undegraded":"2023-10-10T21:02:19.717957+0000","last_fullsized":"2023-10-10T21:02:19.717957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:16.338945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725424+0000","last_change":"2023-10-10T21:02:18.714042+0000","last_active":"2023-10-10T21:02:19.725424+0000","last_peered":"2023-10-10T21:02:19.725424+0000","last_clean":"2023-10-10T21:02:19.725424+0000","last_became_active":"2023-10-10T21:02:18.713460+0000","last_became_peered":"2023-10-10T21:02:18.713460+0000","last_unstale":"2023-10-10T21:02:19.725424+0000","last_undegraded":"2023-10-10T21:02:19.725424+0000","last_fullsized":"2023-10-10T21:02:19.725424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725423+0000","last_change":"2023-10-10T21:02:19.722075+0000","last_active":"2023-10-10T21:02:19.725423+0000","last_peered":"2023-10-10T21:02:19.725423+0000","last_clean":"2023-10-10T21:02:19.725423+0000","last_became_active":"2023-10-10T21:02:19.721818+0000","last_became_peered":"2023-10-10T21:02:19.721818+0000","last_unstale":"2023-10-10T21:02:19.725423+0000","last_undegraded":"2023-10-10T21:02:19.725423+0000","last_fullsized":"2023-10-10T21:02:19.725423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:39:51.766459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.701716+0000","last_change":"2023-10-10T21:02:18.713684+0000","last_active":"2023-10-10T21:02:19.701716+0000","last_peered":"2023-10-10T21:02:19.701716+0000","last_clean":"2023-10-10T21:02:19.701716+0000","last_became_active":"2023-10-10T21:02:18.712935+0000","last_became_peered":"2023-10-10T21:02:18.712935+0000","last_unstale":"2023-10-10T21:02:19.701716+0000","last_undegraded":"2023-10-10T21:02:19.701716+0000","last_fullsized":"2023-10-10T21:02:19.701716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:14.025240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727600+0000","last_change":"2023-10-10T21:02:19.724065+0000","last_active":"2023-10-10T21:02:19.727600+0000","last_peered":"2023-10-10T21:02:19.727600+0000","last_clean":"2023-10-10T21:02:19.727600+0000","last_became_active":"2023-10-10T21:02:19.723390+0000","last_became_peered":"2023-10-10T21:02:19.723390+0000","last_unstale":"2023-10-10T21:02:19.727600+0000","last_undegraded":"2023-10-10T21:02:19.727600+0000","last_fullsized":"2023-10-10T21:02:19.727600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:37:50.246896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694142+0000","last_change":"2023-10-10T21:02:18.718570+0000","last_active":"2023-10-10T21:02:19.694142+0000","last_peered":"2023-10-10T21:02:19.694142+0000","last_clean":"2023-10-10T21:02:19.694142+0000","last_became_active":"2023-10-10T21:02:18.718251+0000","last_became_peered":"2023-10-10T21:02:18.718251+0000","last_unstale":"2023-10-10T21:02:19.694142+0000","last_undegraded":"2023-10-10T21:02:19.694142+0000","last_fullsized":"2023-10-10T21:02:19.694142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:14.026617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717960+0000","last_change":"2023-10-10T21:02:19.714750+0000","last_active":"2023-10-10T21:02:19.717960+0000","last_peered":"2023-10-10T21:02:19.717960+0000","last_clean":"2023-10-10T21:02:19.717960+0000","last_became_active":"2023-10-10T21:02:19.714443+0000","last_became_peered":"2023-10-10T21:02:19.714443+0000","last_unstale":"2023-10-10T21:02:19.717960+0000","last_undegraded":"2023-10-10T21:02:19.717960+0000","last_fullsized":"2023-10-10T21:02:19.717960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.703920+0000","last_change":"2023-10-10T21:02:18.721599+0000","last_active":"2023-10-10T21:02:19.703920+0000","last_peered":"2023-10-10T21:02:19.703920+0000","last_clean":"2023-10-10T21:02:19.703920+0000","last_became_active":"2023-10-10T21:02:18.721291+0000","last_became_peered":"2023-10-10T21:02:18.721291+0000","last_unstale":"2023-10-10T21:02:19.703920+0000","last_undegraded":"2023-10-10T21:02:19.703920+0000","last_fullsized":"2023-10-10T21:02:19.703920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718109+0000","last_change":"2023-10-10T21:02:19.712154+0000","last_active":"2023-10-10T21:02:19.718109+0000","last_peered":"2023-10-10T21:02:19.718109+0000","last_clean":"2023-10-10T21:02:19.718109+0000","last_became_active":"2023-10-10T21:02:19.711878+0000","last_became_peered":"2023-10-10T21:02:19.711878+0000","last_unstale":"2023-10-10T21:02:19.718109+0000","last_undegraded":"2023-10-10T21:02:19.718109+0000","last_fullsized":"2023-10-10T21:02:19.718109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694643+0000","last_change":"2023-10-10T21:02:18.722267+0000","last_active":"2023-10-10T21:02:19.694643+0000","last_peered":"2023-10-10T21:02:19.694643+0000","last_clean":"2023-10-10T21:02:19.694643+0000","last_became_active":"2023-10-10T21:02:18.719908+0000","last_became_peered":"2023-10-10T21:02:18.719908+0000","last_unstale":"2023-10-10T21:02:19.694643+0000","last_undegraded":"2023-10-10T21:02:19.694643+0000","last_fullsized":"2023-10-10T21:02:19.694643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726172+0000","last_change":"2023-10-10T21:02:19.722369+0000","last_active":"2023-10-10T21:02:19.726172+0000","last_peered":"2023-10-10T21:02:19.726172+0000","last_clean":"2023-10-10T21:02:19.726172+0000","last_became_active":"2023-10-10T21:02:19.722113+0000","last_became_peered":"2023-10-10T21:02:19.722113+0000","last_unstale":"2023-10-10T21:02:19.726172+0000","last_undegraded":"2023-10-10T21:02:19.726172+0000","last_fullsized":"2023-10-10T21:02:19.726172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726730+0000","last_change":"2023-10-10T21:02:18.718657+0000","last_active":"2023-10-10T21:02:19.726730+0000","last_peered":"2023-10-10T21:02:19.726730+0000","last_clean":"2023-10-10T21:02:19.726730+0000","last_became_active":"2023-10-10T21:02:18.718395+0000","last_became_peered":"2023-10-10T21:02:18.718395+0000","last_unstale":"2023-10-10T21:02:19.726730+0000","last_undegraded":"2023-10-10T21:02:19.726730+0000","last_fullsized":"2023-10-10T21:02:19.726730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.716253+0000","last_change":"2023-10-10T21:02:19.705946+0000","last_active":"2023-10-10T21:02:19.716253+0000","last_peered":"2023-10-10T21:02:19.716253+0000","last_clean":"2023-10-10T21:02:19.716253+0000","last_became_active":"2023-10-10T21:02:19.705596+0000","last_became_peered":"2023-10-10T21:02:19.705596+0000","last_unstale":"2023-10-10T21:02:19.716253+0000","last_undegraded":"2023-10-10T21:02:19.716253+0000","last_fullsized":"2023-10-10T21:02:19.716253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:45.667349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.732780+0000","last_change":"2023-10-10T21:02:18.712503+0000","last_active":"2023-10-10T21:02:19.732780+0000","last_peered":"2023-10-10T21:02:19.732780+0000","last_clean":"2023-10-10T21:02:19.732780+0000","last_became_active":"2023-10-10T21:02:18.712089+0000","last_became_peered":"2023-10-10T21:02:18.712089+0000","last_unstale":"2023-10-10T21:02:19.732780+0000","last_undegraded":"2023-10-10T21:02:19.732780+0000","last_fullsized":"2023-10-10T21:02:19.732780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722654+0000","last_change":"2023-10-10T21:02:19.719227+0000","last_active":"2023-10-10T21:02:19.722654+0000","last_peered":"2023-10-10T21:02:19.722654+0000","last_clean":"2023-10-10T21:02:19.722654+0000","last_became_active":"2023-10-10T21:02:19.718847+0000","last_became_peered":"2023-10-10T21:02:19.718847+0000","last_unstale":"2023-10-10T21:02:19.722654+0000","last_undegraded":"2023-10-10T21:02:19.722654+0000","last_fullsized":"2023-10-10T21:02:19.722654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:01:48.898002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723071+0000","last_change":"2023-10-10T21:02:18.704860+0000","last_active":"2023-10-10T21:02:19.723071+0000","last_peered":"2023-10-10T21:02:19.723071+0000","last_clean":"2023-10-10T21:02:19.723071+0000","last_became_active":"2023-10-10T21:02:18.704565+0000","last_became_peered":"2023-10-10T21:02:18.704565+0000","last_unstale":"2023-10-10T21:02:19.723071+0000","last_undegraded":"2023-10-10T21:02:19.723071+0000","last_fullsized":"2023-10-10T21:02:19.723071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:44.459665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722520+0000","last_change":"2023-10-10T21:02:19.720643+0000","last_active":"2023-10-10T21:02:19.722520+0000","last_peered":"2023-10-10T21:02:19.722520+0000","last_clean":"2023-10-10T21:02:19.722520+0000","last_became_active":"2023-10-10T21:02:19.720210+0000","last_became_peered":"2023-10-10T21:02:19.720210+0000","last_unstale":"2023-10-10T21:02:19.722520+0000","last_undegraded":"2023-10-10T21:02:19.722520+0000","last_fullsized":"2023-10-10T21:02:19.722520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:00.153901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694420+0000","last_change":"2023-10-10T21:02:18.713031+0000","last_active":"2023-10-10T21:02:19.694420+0000","last_peered":"2023-10-10T21:02:19.694420+0000","last_clean":"2023-10-10T21:02:19.694420+0000","last_became_active":"2023-10-10T21:02:18.712686+0000","last_became_peered":"2023-10-10T21:02:18.712686+0000","last_unstale":"2023-10-10T21:02:19.694420+0000","last_undegraded":"2023-10-10T21:02:19.694420+0000","last_fullsized":"2023-10-10T21:02:19.694420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730553+0000","last_change":"2023-10-10T21:02:19.723948+0000","last_active":"2023-10-10T21:02:19.730553+0000","last_peered":"2023-10-10T21:02:19.730553+0000","last_clean":"2023-10-10T21:02:19.730553+0000","last_became_active":"2023-10-10T21:02:19.723676+0000","last_became_peered":"2023-10-10T21:02:19.723676+0000","last_unstale":"2023-10-10T21:02:19.730553+0000","last_undegraded":"2023-10-10T21:02:19.730553+0000","last_fullsized":"2023-10-10T21:02:19.730553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:07:28.315895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.703741+0000","last_change":"2023-10-10T21:02:18.713015+0000","last_active":"2023-10-10T21:02:19.703741+0000","last_peered":"2023-10-10T21:02:19.703741+0000","last_clean":"2023-10-10T21:02:19.703741+0000","last_became_active":"2023-10-10T21:02:18.712700+0000","last_became_peered":"2023-10-10T21:02:18.712700+0000","last_unstale":"2023-10-10T21:02:19.703741+0000","last_undegraded":"2023-10-10T21:02:19.703741+0000","last_fullsized":"2023-10-10T21:02:19.703741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.728502+0000","last_change":"2023-10-10T21:02:19.724648+0000","last_active":"2023-10-10T21:02:19.728502+0000","last_peered":"2023-10-10T21:02:19.728502+0000","last_clean":"2023-10-10T21:02:19.728502+0000","last_became_active":"2023-10-10T21:02:19.723407+0000","last_became_peered":"2023-10-10T21:02:19.723407+0000","last_unstale":"2023-10-10T21:02:19.728502+0000","last_undegraded":"2023-10-10T21:02:19.728502+0000","last_fullsized":"2023-10-10T21:02:19.728502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:39:51.766459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719279+0000","last_change":"2023-10-10T21:02:18.704318+0000","last_active":"2023-10-10T21:02:19.719279+0000","last_peered":"2023-10-10T21:02:19.719279+0000","last_clean":"2023-10-10T21:02:19.719279+0000","last_became_active":"2023-10-10T21:02:18.704004+0000","last_became_peered":"2023-10-10T21:02:18.704004+0000","last_unstale":"2023-10-10T21:02:19.719279+0000","last_undegraded":"2023-10-10T21:02:19.719279+0000","last_fullsized":"2023-10-10T21:02:19.719279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:41:42.908310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731837+0000","last_change":"2023-10-10T21:02:19.726963+0000","last_active":"2023-10-10T21:02:19.731837+0000","last_peered":"2023-10-10T21:02:19.731837+0000","last_clean":"2023-10-10T21:02:19.731837+0000","last_became_active":"2023-10-10T21:02:19.726624+0000","last_became_peered":"2023-10-10T21:02:19.726624+0000","last_unstale":"2023-10-10T21:02:19.731837+0000","last_undegraded":"2023-10-10T21:02:19.731837+0000","last_fullsized":"2023-10-10T21:02:19.731837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726614+0000","last_change":"2023-10-10T21:02:18.702662+0000","last_active":"2023-10-10T21:02:19.726614+0000","last_peered":"2023-10-10T21:02:19.726614+0000","last_clean":"2023-10-10T21:02:19.726614+0000","last_became_active":"2023-10-10T21:02:18.702383+0000","last_became_peered":"2023-10-10T21:02:18.702383+0000","last_unstale":"2023-10-10T21:02:19.726614+0000","last_undegraded":"2023-10-10T21:02:19.726614+0000","last_fullsized":"2023-10-10T21:02:19.726614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:44.459665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730626+0000","last_change":"2023-10-10T21:02:19.724101+0000","last_active":"2023-10-10T21:02:19.730626+0000","last_peered":"2023-10-10T21:02:19.730626+0000","last_clean":"2023-10-10T21:02:19.730626+0000","last_became_active":"2023-10-10T21:02:19.723825+0000","last_became_peered":"2023-10-10T21:02:19.723825+0000","last_unstale":"2023-10-10T21:02:19.730626+0000","last_undegraded":"2023-10-10T21:02:19.730626+0000","last_fullsized":"2023-10-10T21:02:19.730626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693103+0000","last_change":"2023-10-10T21:02:18.707721+0000","last_active":"2023-10-10T21:02:19.693103+0000","last_peered":"2023-10-10T21:02:19.693103+0000","last_clean":"2023-10-10T21:02:19.693103+0000","last_became_active":"2023-10-10T21:02:18.707316+0000","last_became_peered":"2023-10-10T21:02:18.707316+0000","last_unstale":"2023-10-10T21:02:19.693103+0000","last_undegraded":"2023-10-10T21:02:19.693103+0000","last_fullsized":"2023-10-10T21:02:19.693103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715462+0000","last_change":"2023-10-10T21:02:19.711473+0000","last_active":"2023-10-10T21:02:19.715462+0000","last_peered":"2023-10-10T21:02:19.715462+0000","last_clean":"2023-10-10T21:02:19.715462+0000","last_became_active":"2023-10-10T21:02:19.711163+0000","last_became_peered":"2023-10-10T21:02:19.711163+0000","last_unstale":"2023-10-10T21:02:19.715462+0000","last_undegraded":"2023-10-10T21:02:19.715462+0000","last_fullsized":"2023-10-10T21:02:19.715462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694353+0000","last_change":"2023-10-10T21:02:18.714506+0000","last_active":"2023-10-10T21:02:19.694353+0000","last_peered":"2023-10-10T21:02:19.694353+0000","last_clean":"2023-10-10T21:02:19.694353+0000","last_became_active":"2023-10-10T21:02:18.714083+0000","last_became_peered":"2023-10-10T21:02:18.714083+0000","last_unstale":"2023-10-10T21:02:19.694353+0000","last_undegraded":"2023-10-10T21:02:19.694353+0000","last_fullsized":"2023-10-10T21:02:19.694353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726810+0000","last_change":"2023-10-10T21:02:19.723781+0000","last_active":"2023-10-10T21:02:19.726810+0000","last_peered":"2023-10-10T21:02:19.726810+0000","last_clean":"2023-10-10T21:02:19.726810+0000","last_became_active":"2023-10-10T21:02:19.723312+0000","last_became_peered":"2023-10-10T21:02:19.723312+0000","last_unstale":"2023-10-10T21:02:19.726810+0000","last_undegraded":"2023-10-10T21:02:19.726810+0000","last_fullsized":"2023-10-10T21:02:19.726810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:36.717475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.707776+0000","last_change":"2023-10-10T21:02:19.704121+0000","last_active":"2023-10-10T21:02:19.707776+0000","last_peered":"2023-10-10T21:02:19.707776+0000","last_clean":"2023-10-10T21:02:19.707776+0000","last_became_active":"2023-10-10T21:02:19.701763+0000","last_became_peered":"2023-10-10T21:02:19.701763+0000","last_unstale":"2023-10-10T21:02:19.707776+0000","last_undegraded":"2023-10-10T21:02:19.707776+0000","last_fullsized":"2023-10-10T21:02:19.707776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.698519+0000","last_change":"2023-10-10T21:02:18.702602+0000","last_active":"2023-10-10T21:02:19.698519+0000","last_peered":"2023-10-10T21:02:19.698519+0000","last_clean":"2023-10-10T21:02:19.698519+0000","last_became_active":"2023-10-10T21:02:18.702148+0000","last_became_peered":"2023-10-10T21:02:18.702148+0000","last_unstale":"2023-10-10T21:02:19.698519+0000","last_undegraded":"2023-10-10T21:02:19.698519+0000","last_fullsized":"2023-10-10T21:02:19.698519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:24:11.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726645+0000","last_change":"2023-10-10T21:02:19.718927+0000","last_active":"2023-10-10T21:02:19.726645+0000","last_peered":"2023-10-10T21:02:19.726645+0000","last_clean":"2023-10-10T21:02:19.726645+0000","last_became_active":"2023-10-10T21:02:19.718658+0000","last_became_peered":"2023-10-10T21:02:19.718658+0000","last_unstale":"2023-10-10T21:02:19.726645+0000","last_undegraded":"2023-10-10T21:02:19.726645+0000","last_fullsized":"2023-10-10T21:02:19.726645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:45:52.552283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694494+0000","last_change":"2023-10-10T21:02:18.716187+0000","last_active":"2023-10-10T21:02:19.694494+0000","last_peered":"2023-10-10T21:02:19.694494+0000","last_clean":"2023-10-10T21:02:19.694494+0000","last_became_active":"2023-10-10T21:02:18.715942+0000","last_became_peered":"2023-10-10T21:02:18.715942+0000","last_unstale":"2023-10-10T21:02:19.694494+0000","last_undegraded":"2023-10-10T21:02:19.694494+0000","last_fullsized":"2023-10-10T21:02:19.694494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.702720+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:02:19.702720+0000","last_peered":"2023-10-10T21:02:19.702720+0000","last_clean":"2023-10-10T21:02:19.702720+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:02:19.702720+0000","last_undegraded":"2023-10-10T21:02:19.702720+0000","last_fullsized":"2023-10-10T21:02:19.702720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727440+0000","last_change":"2023-10-10T21:02:19.722786+0000","last_active":"2023-10-10T21:02:19.727440+0000","last_peered":"2023-10-10T21:02:19.727440+0000","last_clean":"2023-10-10T21:02:19.727440+0000","last_became_active":"2023-10-10T21:02:19.722544+0000","last_became_peered":"2023-10-10T21:02:19.722544+0000","last_unstale":"2023-10-10T21:02:19.727440+0000","last_undegraded":"2023-10-10T21:02:19.727440+0000","last_fullsized":"2023-10-10T21:02:19.727440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:42:20.031126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.702832+0000","last_change":"2023-10-10T21:02:18.719142+0000","last_active":"2023-10-10T21:02:19.702832+0000","last_peered":"2023-10-10T21:02:19.702832+0000","last_clean":"2023-10-10T21:02:19.702832+0000","last_became_active":"2023-10-10T21:02:18.718861+0000","last_became_peered":"2023-10-10T21:02:18.718861+0000","last_unstale":"2023-10-10T21:02:19.702832+0000","last_undegraded":"2023-10-10T21:02:19.702832+0000","last_fullsized":"2023-10-10T21:02:19.702832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.703470+0000","last_change":"2023-10-10T21:02:18.712773+0000","last_active":"2023-10-10T21:02:19.703470+0000","last_peered":"2023-10-10T21:02:19.703470+0000","last_clean":"2023-10-10T21:02:19.703470+0000","last_became_active":"2023-10-10T21:02:18.712496+0000","last_became_peered":"2023-10-10T21:02:18.712496+0000","last_unstale":"2023-10-10T21:02:19.703470+0000","last_undegraded":"2023-10-10T21:02:19.703470+0000","last_fullsized":"2023-10-10T21:02:19.703470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:09:01.161677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.706058+0000","last_change":"2023-10-10T21:02:19.702557+0000","last_active":"2023-10-10T21:02:19.706058+0000","last_peered":"2023-10-10T21:02:19.706058+0000","last_clean":"2023-10-10T21:02:19.706058+0000","last_became_active":"2023-10-10T21:02:19.702270+0000","last_became_peered":"2023-10-10T21:02:19.702270+0000","last_unstale":"2023-10-10T21:02:19.706058+0000","last_undegraded":"2023-10-10T21:02:19.706058+0000","last_fullsized":"2023-10-10T21:02:19.706058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-10T21:02:20.707362+0000","last_change":"2023-10-10T21:02:18.713198+0000","last_active":"2023-10-10T21:02:20.707362+0000","last_peered":"2023-10-10T21:02:20.707362+0000","last_clean":"2023-10-10T21:02:20.707362+0000","last_became_active":"2023-10-10T21:02:18.712906+0000","last_became_peered":"2023-10-10T21:02:18.712906+0000","last_unstale":"2023-10-10T21:02:20.707362+0000","last_undegraded":"2023-10-10T21:02:20.707362+0000","last_fullsized":"2023-10-10T21:02:20.707362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715363+0000","last_change":"2023-10-10T21:02:19.707593+0000","last_active":"2023-10-10T21:02:19.715363+0000","last_peered":"2023-10-10T21:02:19.715363+0000","last_clean":"2023-10-10T21:02:19.715363+0000","last_became_active":"2023-10-10T21:02:19.706687+0000","last_became_peered":"2023-10-10T21:02:19.706687+0000","last_unstale":"2023-10-10T21:02:19.715363+0000","last_undegraded":"2023-10-10T21:02:19.715363+0000","last_fullsized":"2023-10-10T21:02:19.715363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:59:28.606720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723812+0000","last_change":"2023-10-10T21:02:18.719905+0000","last_active":"2023-10-10T21:02:19.723812+0000","last_peered":"2023-10-10T21:02:19.723812+0000","last_clean":"2023-10-10T21:02:19.723812+0000","last_became_active":"2023-10-10T21:02:18.719606+0000","last_became_peered":"2023-10-10T21:02:18.719606+0000","last_unstale":"2023-10-10T21:02:19.723812+0000","last_undegraded":"2023-10-10T21:02:19.723812+0000","last_fullsized":"2023-10-10T21:02:19.723812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722943+0000","last_change":"2023-10-10T21:02:19.720643+0000","last_active":"2023-10-10T21:02:19.722943+0000","last_peered":"2023-10-10T21:02:19.722943+0000","last_clean":"2023-10-10T21:02:19.722943+0000","last_became_active":"2023-10-10T21:02:19.720362+0000","last_became_peered":"2023-10-10T21:02:19.720362+0000","last_unstale":"2023-10-10T21:02:19.722943+0000","last_undegraded":"2023-10-10T21:02:19.722943+0000","last_fullsized":"2023-10-10T21:02:19.722943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.704676+0000","last_change":"2023-10-10T21:02:18.716964+0000","last_active":"2023-10-10T21:02:19.704676+0000","last_peered":"2023-10-10T21:02:19.704676+0000","last_clean":"2023-10-10T21:02:19.704676+0000","last_became_active":"2023-10-10T21:02:18.716502+0000","last_became_peered":"2023-10-10T21:02:18.716502+0000","last_unstale":"2023-10-10T21:02:19.704676+0000","last_undegraded":"2023-10-10T21:02:19.704676+0000","last_fullsized":"2023-10-10T21:02:19.704676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.709106+0000","last_change":"2023-10-10T21:02:19.702718+0000","last_active":"2023-10-10T21:02:19.709106+0000","last_peered":"2023-10-10T21:02:19.709106+0000","last_clean":"2023-10-10T21:02:19.709106+0000","last_became_active":"2023-10-10T21:02:19.702438+0000","last_became_peered":"2023-10-10T21:02:19.702438+0000","last_unstale":"2023-10-10T21:02:19.709106+0000","last_undegraded":"2023-10-10T21:02:19.709106+0000","last_fullsized":"2023-10-10T21:02:19.709106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:09:02.167913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693020+0000","last_change":"2023-10-10T21:02:18.719939+0000","last_active":"2023-10-10T21:02:19.693020+0000","last_peered":"2023-10-10T21:02:19.693020+0000","last_clean":"2023-10-10T21:02:19.693020+0000","last_became_active":"2023-10-10T21:02:18.719606+0000","last_became_peered":"2023-10-10T21:02:18.719606+0000","last_unstale":"2023-10-10T21:02:19.693020+0000","last_undegraded":"2023-10-10T21:02:19.693020+0000","last_fullsized":"2023-10-10T21:02:19.693020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725258+0000","last_change":"2023-10-10T21:02:19.717095+0000","last_active":"2023-10-10T21:02:19.725258+0000","last_peered":"2023-10-10T21:02:19.725258+0000","last_clean":"2023-10-10T21:02:19.725258+0000","last_became_active":"2023-10-10T21:02:19.716805+0000","last_became_peered":"2023-10-10T21:02:19.716805+0000","last_unstale":"2023-10-10T21:02:19.725258+0000","last_undegraded":"2023-10-10T21:02:19.725258+0000","last_fullsized":"2023-10-10T21:02:19.725258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:02:18.184054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693205+0000","last_change":"2023-10-10T21:02:18.711397+0000","last_active":"2023-10-10T21:02:19.693205+0000","last_peered":"2023-10-10T21:02:19.693205+0000","last_clean":"2023-10-10T21:02:19.693205+0000","last_became_active":"2023-10-10T21:02:18.710905+0000","last_became_peered":"2023-10-10T21:02:18.710905+0000","last_unstale":"2023-10-10T21:02:19.693205+0000","last_undegraded":"2023-10-10T21:02:19.693205+0000","last_fullsized":"2023-10-10T21:02:19.693205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:14.026617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727611+0000","last_change":"2023-10-10T21:02:19.724197+0000","last_active":"2023-10-10T21:02:19.727611+0000","last_peered":"2023-10-10T21:02:19.727611+0000","last_clean":"2023-10-10T21:02:19.727611+0000","last_became_active":"2023-10-10T21:02:19.723375+0000","last_became_peered":"2023-10-10T21:02:19.723375+0000","last_unstale":"2023-10-10T21:02:19.727611+0000","last_undegraded":"2023-10-10T21:02:19.727611+0000","last_fullsized":"2023-10-10T21:02:19.727611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:06.143786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.732311+0000","last_change":"2023-10-10T21:02:18.717453+0000","last_active":"2023-10-10T21:02:19.732311+0000","last_peered":"2023-10-10T21:02:19.732311+0000","last_clean":"2023-10-10T21:02:19.732311+0000","last_became_active":"2023-10-10T21:02:18.716456+0000","last_became_peered":"2023-10-10T21:02:18.716456+0000","last_unstale":"2023-10-10T21:02:19.732311+0000","last_undegraded":"2023-10-10T21:02:19.732311+0000","last_fullsized":"2023-10-10T21:02:19.732311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725520+0000","last_change":"2023-10-10T21:02:19.721762+0000","last_active":"2023-10-10T21:02:19.725520+0000","last_peered":"2023-10-10T21:02:19.725520+0000","last_clean":"2023-10-10T21:02:19.725520+0000","last_became_active":"2023-10-10T21:02:19.721459+0000","last_became_peered":"2023-10-10T21:02:19.721459+0000","last_unstale":"2023-10-10T21:02:19.725520+0000","last_undegraded":"2023-10-10T21:02:19.725520+0000","last_fullsized":"2023-10-10T21:02:19.725520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.700313+0000","last_change":"2023-10-10T21:02:18.721637+0000","last_active":"2023-10-10T21:02:19.700313+0000","last_peered":"2023-10-10T21:02:19.700313+0000","last_clean":"2023-10-10T21:02:19.700313+0000","last_became_active":"2023-10-10T21:02:18.721347+0000","last_became_peered":"2023-10-10T21:02:18.721347+0000","last_unstale":"2023-10-10T21:02:19.700313+0000","last_undegraded":"2023-10-10T21:02:19.700313+0000","last_fullsized":"2023-10-10T21:02:19.700313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:14.025240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730517+0000","last_change":"2023-10-10T21:02:19.722542+0000","last_active":"2023-10-10T21:02:19.730517+0000","last_peered":"2023-10-10T21:02:19.730517+0000","last_clean":"2023-10-10T21:02:19.730517+0000","last_became_active":"2023-10-10T21:02:19.722239+0000","last_became_peered":"2023-10-10T21:02:19.722239+0000","last_unstale":"2023-10-10T21:02:19.730517+0000","last_undegraded":"2023-10-10T21:02:19.730517+0000","last_fullsized":"2023-10-10T21:02:19.730517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:38:51.453531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721282+0000","last_change":"2023-10-10T21:02:18.706830+0000","last_active":"2023-10-10T21:02:19.721282+0000","last_peered":"2023-10-10T21:02:19.721282+0000","last_clean":"2023-10-10T21:02:19.721282+0000","last_became_active":"2023-10-10T21:02:18.706545+0000","last_became_peered":"2023-10-10T21:02:18.706545+0000","last_unstale":"2023-10-10T21:02:19.721282+0000","last_undegraded":"2023-10-10T21:02:19.721282+0000","last_fullsized":"2023-10-10T21:02:19.721282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718953+0000","last_change":"2023-10-10T21:02:19.713935+0000","last_active":"2023-10-10T21:02:19.718953+0000","last_peered":"2023-10-10T21:02:19.718953+0000","last_clean":"2023-10-10T21:02:19.718953+0000","last_became_active":"2023-10-10T21:02:19.713645+0000","last_became_peered":"2023-10-10T21:02:19.713645+0000","last_unstale":"2023-10-10T21:02:19.718953+0000","last_undegraded":"2023-10-10T21:02:19.718953+0000","last_fullsized":"2023-10-10T21:02:19.718953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:07:28.315895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717395+0000","last_change":"2023-10-10T21:02:18.699045+0000","last_active":"2023-10-10T21:02:19.717395+0000","last_peered":"2023-10-10T21:02:19.717395+0000","last_clean":"2023-10-10T21:02:19.717395+0000","last_became_active":"2023-10-10T21:02:18.698700+0000","last_became_peered":"2023-10-10T21:02:18.698700+0000","last_unstale":"2023-10-10T21:02:19.717395+0000","last_undegraded":"2023-10-10T21:02:19.717395+0000","last_fullsized":"2023-10-10T21:02:19.717395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:59.170344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730615+0000","last_change":"2023-10-10T21:02:19.726475+0000","last_active":"2023-10-10T21:02:19.730615+0000","last_peered":"2023-10-10T21:02:19.730615+0000","last_clean":"2023-10-10T21:02:19.730615+0000","last_became_active":"2023-10-10T21:02:19.726153+0000","last_became_peered":"2023-10-10T21:02:19.726153+0000","last_unstale":"2023-10-10T21:02:19.730615+0000","last_undegraded":"2023-10-10T21:02:19.730615+0000","last_fullsized":"2023-10-10T21:02:19.730615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:11:55.480332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.728526+0000","last_change":"2023-10-10T21:02:19.724879+0000","last_active":"2023-10-10T21:02:19.728526+0000","last_peered":"2023-10-10T21:02:19.728526+0000","last_clean":"2023-10-10T21:02:19.728526+0000","last_became_active":"2023-10-10T21:02:19.724304+0000","last_became_peered":"2023-10-10T21:02:19.724304+0000","last_unstale":"2023-10-10T21:02:19.728526+0000","last_undegraded":"2023-10-10T21:02:19.728526+0000","last_fullsized":"2023-10-10T21:02:19.728526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717089+0000","last_change":"2023-10-10T21:02:19.714634+0000","last_active":"2023-10-10T21:02:19.717089+0000","last_peered":"2023-10-10T21:02:19.717089+0000","last_clean":"2023-10-10T21:02:19.717089+0000","last_became_active":"2023-10-10T21:02:19.714392+0000","last_became_peered":"2023-10-10T21:02:19.714392+0000","last_unstale":"2023-10-10T21:02:19.717089+0000","last_undegraded":"2023-10-10T21:02:19.717089+0000","last_fullsized":"2023-10-10T21:02:19.717089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:54.736869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.720937+0000","last_change":"2023-10-10T21:02:19.716446+0000","last_active":"2023-10-10T21:02:19.720937+0000","last_peered":"2023-10-10T21:02:19.720937+0000","last_clean":"2023-10-10T21:02:19.720937+0000","last_became_active":"2023-10-10T21:02:19.716149+0000","last_became_peered":"2023-10-10T21:02:19.716149+0000","last_unstale":"2023-10-10T21:02:19.720937+0000","last_undegraded":"2023-10-10T21:02:19.720937+0000","last_fullsized":"2023-10-10T21:02:19.720937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725405+0000","last_change":"2023-10-10T21:02:19.721864+0000","last_active":"2023-10-10T21:02:19.725405+0000","last_peered":"2023-10-10T21:02:19.725405+0000","last_clean":"2023-10-10T21:02:19.725405+0000","last_became_active":"2023-10-10T21:02:19.721621+0000","last_became_peered":"2023-10-10T21:02:19.721621+0000","last_unstale":"2023-10-10T21:02:19.725405+0000","last_undegraded":"2023-10-10T21:02:19.725405+0000","last_fullsized":"2023-10-10T21:02:19.725405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715529+0000","last_change":"2023-10-10T21:02:19.710748+0000","last_active":"2023-10-10T21:02:19.715529+0000","last_peered":"2023-10-10T21:02:19.715529+0000","last_clean":"2023-10-10T21:02:19.715529+0000","last_became_active":"2023-10-10T21:02:19.710448+0000","last_became_peered":"2023-10-10T21:02:19.710448+0000","last_unstale":"2023-10-10T21:02:19.715529+0000","last_undegraded":"2023-10-10T21:02:19.715529+0000","last_fullsized":"2023-10-10T21:02:19.715529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:46:22.792792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.716282+0000","last_change":"2023-10-10T21:02:19.709278+0000","last_active":"2023-10-10T21:02:19.716282+0000","last_peered":"2023-10-10T21:02:19.716282+0000","last_clean":"2023-10-10T21:02:19.716282+0000","last_became_active":"2023-10-10T21:02:19.709000+0000","last_became_peered":"2023-10-10T21:02:19.709000+0000","last_unstale":"2023-10-10T21:02:19.716282+0000","last_undegraded":"2023-10-10T21:02:19.716282+0000","last_fullsized":"2023-10-10T21:02:19.716282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723915+0000","last_change":"2023-10-10T21:02:19.718420+0000","last_active":"2023-10-10T21:02:19.723915+0000","last_peered":"2023-10-10T21:02:19.723915+0000","last_clean":"2023-10-10T21:02:19.723915+0000","last_became_active":"2023-10-10T21:02:19.718142+0000","last_became_peered":"2023-10-10T21:02:19.718142+0000","last_unstale":"2023-10-10T21:02:19.723915+0000","last_undegraded":"2023-10-10T21:02:19.723915+0000","last_fullsized":"2023-10-10T21:02:19.723915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725153+0000","last_change":"2023-10-10T21:02:19.715456+0000","last_active":"2023-10-10T21:02:19.725153+0000","last_peered":"2023-10-10T21:02:19.725153+0000","last_clean":"2023-10-10T21:02:19.725153+0000","last_became_active":"2023-10-10T21:02:19.715168+0000","last_became_peered":"2023-10-10T21:02:19.715168+0000","last_unstale":"2023-10-10T21:02:19.725153+0000","last_undegraded":"2023-10-10T21:02:19.725153+0000","last_fullsized":"2023-10-10T21:02:19.725153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:20:36.206873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721426+0000","last_change":"2023-10-10T21:02:19.715964+0000","last_active":"2023-10-10T21:02:19.721426+0000","last_peered":"2023-10-10T21:02:19.721426+0000","last_clean":"2023-10-10T21:02:19.721426+0000","last_became_active":"2023-10-10T21:02:19.715678+0000","last_became_peered":"2023-10-10T21:02:19.715678+0000","last_unstale":"2023-10-10T21:02:19.721426+0000","last_undegraded":"2023-10-10T21:02:19.721426+0000","last_fullsized":"2023-10-10T21:02:19.721426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722029+0000","last_change":"2023-10-10T21:02:19.712354+0000","last_active":"2023-10-10T21:02:19.722029+0000","last_peered":"2023-10-10T21:02:19.722029+0000","last_clean":"2023-10-10T21:02:19.722029+0000","last_became_active":"2023-10-10T21:02:19.712051+0000","last_became_peered":"2023-10-10T21:02:19.712051+0000","last_unstale":"2023-10-10T21:02:19.722029+0000","last_undegraded":"2023-10-10T21:02:19.722029+0000","last_fullsized":"2023-10-10T21:02:19.722029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:23:39.628860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718320+0000","last_change":"2023-10-10T21:02:19.713312+0000","last_active":"2023-10-10T21:02:19.718320+0000","last_peered":"2023-10-10T21:02:19.718320+0000","last_clean":"2023-10-10T21:02:19.718320+0000","last_became_active":"2023-10-10T21:02:19.712993+0000","last_became_peered":"2023-10-10T21:02:19.712993+0000","last_unstale":"2023-10-10T21:02:19.718320+0000","last_undegraded":"2023-10-10T21:02:19.718320+0000","last_fullsized":"2023-10-10T21:02:19.718320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:01:48.898002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725385+0000","last_change":"2023-10-10T21:02:19.721562+0000","last_active":"2023-10-10T21:02:19.725385+0000","last_peered":"2023-10-10T21:02:19.725385+0000","last_clean":"2023-10-10T21:02:19.725385+0000","last_became_active":"2023-10-10T21:02:19.720554+0000","last_became_peered":"2023-10-10T21:02:19.720554+0000","last_unstale":"2023-10-10T21:02:19.725385+0000","last_undegraded":"2023-10-10T21:02:19.725385+0000","last_fullsized":"2023-10-10T21:02:19.725385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723944+0000","last_change":"2023-10-10T21:02:19.718723+0000","last_active":"2023-10-10T21:02:19.723944+0000","last_peered":"2023-10-10T21:02:19.723944+0000","last_clean":"2023-10-10T21:02:19.723944+0000","last_became_active":"2023-10-10T21:02:19.718408+0000","last_became_peered":"2023-10-10T21:02:19.718408+0000","last_unstale":"2023-10-10T21:02:19.723944+0000","last_undegraded":"2023-10-10T21:02:19.723944+0000","last_fullsized":"2023-10-10T21:02:19.723944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":79778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":669164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":233472,"data_stored":78402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8919999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.25}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.169}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":831488,"data_stored":669220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":78242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":78368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":78332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":79778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:02:29.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:02:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.932+0000 7f9f129ff700 1 Processor -- start 2023-10-10T21:02:29.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.932+0000 7f9f129ff700 1 -- start start 2023-10-10T21:02:29.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.933+0000 7f9f129ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9f0c0cbf30 0x7f9f0c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.934+0000 7f9f129ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0b1420 0x7f9f0c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.934+0000 7f9f129ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c0cc300 con 0x7f9f0c0ccf90 2023-10-10T21:02:29.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.934+0000 7f9f129ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c156bf0 con 0x7f9f0c0cbf30 2023-10-10T21:02:29.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.934+0000 7f9f129ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0ae950 con 0x7f9f0c0b1420 2023-10-10T21:02:29.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.934+0000 7f9f0bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9f0c0cbf30 0x7f9f0c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.934+0000 7f9f0bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9f0c0cbf30 0x7f9f0c0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:50224/0 (socket says 172.21.15.154:50224) 2023-10-10T21:02:29.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.934+0000 7f9f0bfff700 1 -- 172.21.15.154:0/2675010034 learned_addr learned my addr 172.21.15.154:0/2675010034 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:29.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.934+0000 7f9f10f9c700 1 --2- 172.21.15.154:0/2675010034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0b1420 0x7f9f0c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.934+0000 7f9f0b7fe700 1 --1- 172.21.15.154:0/2675010034 >> v1:172.21.15.179:6789/0 conn(0x7f9f0c0ccf90 0x7f9f0c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:38826/0 (socket says 172.21.15.154:38826) 2023-10-10T21:02:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.935+0000 7f9f0bfff700 1 -- 172.21.15.154:0/2675010034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0b1420 msgr2=0x7f9f0c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.935+0000 7f9f0bfff700 1 --2- 172.21.15.154:0/2675010034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0b1420 0x7f9f0c0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.935+0000 7f9f0bfff700 1 -- 172.21.15.154:0/2675010034 >> v1:172.21.15.179:6789/0 conn(0x7f9f0c0ccf90 legacy=0x7f9f0c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.935+0000 7f9f0bfff700 1 -- 172.21.15.154:0/2675010034 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0ad370 con 0x7f9f0c0cbf30 2023-10-10T21:02:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.935+0000 7f9f0bfff700 1 --2- 172.21.15.154:0/2675010034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c0cbf30 0x7f9f0c0ae410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0099e0 tx=0x7f9efc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f5ae1adf1c3a4e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.935+0000 7f9f0affd700 1 -- 172.21.15.154:0/2675010034 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00b820 con 0x7f9f0c0cbf30 2023-10-10T21:02:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.935+0000 7f9f0affd700 1 -- 172.21.15.154:0/2675010034 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00b980 con 0x7f9f0c0cbf30 2023-10-10T21:02:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.935+0000 7f9f0affd700 1 -- 172.21.15.154:0/2675010034 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00bd20 con 0x7f9f0c0cbf30 2023-10-10T21:02:29.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.936+0000 7f9f129ff700 1 -- 172.21.15.154:0/2675010034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c0cbf30 msgr2=0x7f9f0c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.936+0000 7f9f129ff700 1 --2- 172.21.15.154:0/2675010034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c0cbf30 0x7f9f0c0ae410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0099e0 tx=0x7f9efc009250 comp rx=0 tx=0).stop 2023-10-10T21:02:29.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.936+0000 7f9f129ff700 1 -- 172.21.15.154:0/2675010034 shutdown_connections 2023-10-10T21:02:29.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.936+0000 7f9f129ff700 1 --2- 172.21.15.154:0/2675010034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0b1420 0x7f9f0c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.936+0000 7f9f129ff700 1 --2- 172.21.15.154:0/2675010034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c0cbf30 0x7f9f0c0ae410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.936+0000 7f9f129ff700 1 -- 172.21.15.154:0/2675010034 >> 172.21.15.154:0/2675010034 conn(0x7f9f0c06a320 msgr2=0x7f9f0c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:29.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.936+0000 7f9f129ff700 1 -- 172.21.15.154:0/2675010034 shutdown_connections 2023-10-10T21:02:29.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.936+0000 7f9f129ff700 1 -- 172.21.15.154:0/2675010034 wait complete. 2023-10-10T21:02:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.937+0000 7f9f129ff700 1 Processor -- start 2023-10-10T21:02:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.938+0000 7f9f129ff700 1 -- start start 2023-10-10T21:02:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.938+0000 7f9f129ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f0c0b1420 0x7f9f0c146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.938+0000 7f9f129ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c0cbf30 0x7f9f0c0ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f129ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0ccf90 0x7f9f0c144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f129ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c147800 con 0x7f9f0c0b1420 2023-10-10T21:02:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f129ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0ac800 con 0x7f9f0c0cbf30 2023-10-10T21:02:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f129ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c146bf0 con 0x7f9f0c0ccf90 2023-10-10T21:02:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f0c0b1420 0x7f9f0c146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f0c0b1420 0x7f9f0c146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55896/0 (socket says 172.21.15.154:55896) 2023-10-10T21:02:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0bfff700 1 -- 172.21.15.154:0/2323330048 learned_addr learned my addr 172.21.15.154:0/2323330048 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f10f9c700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0ccf90 0x7f9f0c144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0b7fe700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c0cbf30 0x7f9f0c0ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0bfff700 1 -- 172.21.15.154:0/2323330048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0ccf90 msgr2=0x7f9f0c144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0bfff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0ccf90 0x7f9f0c144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0bfff700 1 -- 172.21.15.154:0/2323330048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c0cbf30 msgr2=0x7f9f0c0ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0bfff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c0cbf30 0x7f9f0c0ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0bfff700 1 -- 172.21.15.154:0/2323330048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc0094f0 con 0x7f9f0c0b1420 2023-10-10T21:02:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.939+0000 7f9f0bfff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f0c0b1420 0x7f9f0c146560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009290 tx=0x7f9efc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.940+0000 7f9ef3fff700 1 -- 172.21.15.154:0/2323330048 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc024440 con 0x7f9f0c0b1420 2023-10-10T21:02:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.940+0000 7f9ef3fff700 1 -- 172.21.15.154:0/2323330048 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc0245e0 con 0x7f9f0c0b1420 2023-10-10T21:02:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.940+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c146ed0 con 0x7f9f0c0b1420 2023-10-10T21:02:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.940+0000 7f9ef3fff700 1 -- 172.21.15.154:0/2323330048 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0249a0 con 0x7f9f0c0b1420 2023-10-10T21:02:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.940+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c147490 con 0x7f9f0c0b1420 2023-10-10T21:02:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.941+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c04c3c0 con 0x7f9f0c0b1420 2023-10-10T21:02:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.941+0000 7f9ef3fff700 1 -- 172.21.15.154:0/2323330048 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9efc01a420 con 0x7f9f0c0b1420 2023-10-10T21:02:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.942+0000 7f9ef3fff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9ef8066f30 0x7f9ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.942+0000 7f9ef3fff700 1 -- 172.21.15.154:0/2323330048 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9efc0862d0 con 0x7f9f0c0b1420 2023-10-10T21:02:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.943+0000 7f9f0b7fe700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9ef8066f30 0x7f9ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.943+0000 7f9f0b7fe700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9ef8066f30 0x7f9ef80693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9f00007fd0 tx=0x7f9f00007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:29.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:29.947+0000 7f9ef3fff700 1 -- 172.21.15.154:0/2323330048 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9efc0534a0 con 0x7f9f0c0b1420 2023-10-10T21:02:30.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.135+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f0c147940 con 0x7f9ef8066f30 2023-10-10T21:02:30.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.143+0000 7f9ef3fff700 1 -- 172.21.15.154:0/2323330048 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264468 (secure 0 0 0) 0x7f9f00005c50 con 0x7f9ef8066f30 2023-10-10T21:02:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:30.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9ef8066f30 msgr2=0x7f9ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9ef8066f30 0x7f9ef80693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9f00007fd0 tx=0x7f9f00007d70 comp rx=0 tx=0).stop 2023-10-10T21:02:30.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f0c0b1420 msgr2=0x7f9f0c146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f0c0b1420 0x7f9f0c146560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009290 tx=0x7f9efc017000 comp rx=0 tx=0).stop 2023-10-10T21:02:30.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 shutdown_connections 2023-10-10T21:02:30.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9ef8066f30 0x7f9ef80693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f0c0ccf90 0x7f9f0c144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f0c0b1420 0x7f9f0c146560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 --2- 172.21.15.154:0/2323330048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c0cbf30 0x7f9f0c0ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 >> 172.21.15.154:0/2323330048 conn(0x7f9f0c06a320 msgr2=0x7f9f0c0c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:30.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 shutdown_connections 2023-10-10T21:02:30.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.147+0000 7f9f129ff700 1 -- 172.21.15.154:0/2323330048 wait complete. 2023-10-10T21:02:30.152 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:02:30.166 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-10T21:02:29.856658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381288,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593432,"statfs":{"total":773094113280,"available":770655674368,"internally_reserved":0,"allocated":3055616,"data_stored":1811284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002110"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731857+0000","last_change":"2023-10-10T21:02:19.727081+0000","last_active":"2023-10-10T21:02:19.731857+0000","last_peered":"2023-10-10T21:02:19.731857+0000","last_clean":"2023-10-10T21:02:19.731857+0000","last_became_active":"2023-10-10T21:02:19.726754+0000","last_became_peered":"2023-10-10T21:02:19.726754+0000","last_unstale":"2023-10-10T21:02:19.731857+0000","last_undegraded":"2023-10-10T21:02:19.731857+0000","last_fullsized":"2023-10-10T21:02:19.731857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:51.819041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.729741+0000","last_change":"2023-10-10T21:02:19.728351+0000","last_active":"2023-10-10T21:02:19.729741+0000","last_peered":"2023-10-10T21:02:19.729741+0000","last_clean":"2023-10-10T21:02:19.729741+0000","last_became_active":"2023-10-10T21:02:19.728087+0000","last_became_peered":"2023-10-10T21:02:19.728087+0000","last_unstale":"2023-10-10T21:02:19.729741+0000","last_undegraded":"2023-10-10T21:02:19.729741+0000","last_fullsized":"2023-10-10T21:02:19.729741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721483+0000","last_change":"2023-10-10T21:02:19.713674+0000","last_active":"2023-10-10T21:02:19.721483+0000","last_peered":"2023-10-10T21:02:19.721483+0000","last_clean":"2023-10-10T21:02:19.721483+0000","last_became_active":"2023-10-10T21:02:19.713276+0000","last_became_peered":"2023-10-10T21:02:19.713276+0000","last_unstale":"2023-10-10T21:02:19.721483+0000","last_undegraded":"2023-10-10T21:02:19.721483+0000","last_fullsized":"2023-10-10T21:02:19.721483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:34:22.625292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717566+0000","last_change":"2023-10-10T21:02:19.710812+0000","last_active":"2023-10-10T21:02:19.717566+0000","last_peered":"2023-10-10T21:02:19.717566+0000","last_clean":"2023-10-10T21:02:19.717566+0000","last_became_active":"2023-10-10T21:02:19.710422+0000","last_became_peered":"2023-10-10T21:02:19.710422+0000","last_unstale":"2023-10-10T21:02:19.717566+0000","last_undegraded":"2023-10-10T21:02:19.717566+0000","last_fullsized":"2023-10-10T21:02:19.717566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:11:55.480332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719232+0000","last_change":"2023-10-10T21:02:19.714401+0000","last_active":"2023-10-10T21:02:19.719232+0000","last_peered":"2023-10-10T21:02:19.719232+0000","last_clean":"2023-10-10T21:02:19.719232+0000","last_became_active":"2023-10-10T21:02:19.714045+0000","last_became_peered":"2023-10-10T21:02:19.714045+0000","last_unstale":"2023-10-10T21:02:19.719232+0000","last_undegraded":"2023-10-10T21:02:19.719232+0000","last_fullsized":"2023-10-10T21:02:19.719232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:33:01.750601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.729464+0000","last_change":"2023-10-10T21:02:19.724680+0000","last_active":"2023-10-10T21:02:19.729464+0000","last_peered":"2023-10-10T21:02:19.729464+0000","last_clean":"2023-10-10T21:02:19.729464+0000","last_became_active":"2023-10-10T21:02:19.721313+0000","last_became_peered":"2023-10-10T21:02:19.721313+0000","last_unstale":"2023-10-10T21:02:19.729464+0000","last_undegraded":"2023-10-10T21:02:19.729464+0000","last_fullsized":"2023-10-10T21:02:19.729464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727053+0000","last_change":"2023-10-10T21:02:19.722047+0000","last_active":"2023-10-10T21:02:19.727053+0000","last_peered":"2023-10-10T21:02:19.727053+0000","last_clean":"2023-10-10T21:02:19.727053+0000","last_became_active":"2023-10-10T21:02:19.721771+0000","last_became_peered":"2023-10-10T21:02:19.721771+0000","last_unstale":"2023-10-10T21:02:19.727053+0000","last_undegraded":"2023-10-10T21:02:19.727053+0000","last_fullsized":"2023-10-10T21:02:19.727053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726576+0000","last_change":"2023-10-10T21:02:19.718311+0000","last_active":"2023-10-10T21:02:19.726576+0000","last_peered":"2023-10-10T21:02:19.726576+0000","last_clean":"2023-10-10T21:02:19.726576+0000","last_became_active":"2023-10-10T21:02:19.718055+0000","last_became_peered":"2023-10-10T21:02:19.718055+0000","last_unstale":"2023-10-10T21:02:19.726576+0000","last_undegraded":"2023-10-10T21:02:19.726576+0000","last_fullsized":"2023-10-10T21:02:19.726576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:02:29.594836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727168+0000","last_change":"2023-10-10T21:02:19.721906+0000","last_active":"2023-10-10T21:02:19.727168+0000","last_peered":"2023-10-10T21:02:19.727168+0000","last_clean":"2023-10-10T21:02:19.727168+0000","last_became_active":"2023-10-10T21:02:19.721669+0000","last_became_peered":"2023-10-10T21:02:19.721669+0000","last_unstale":"2023-10-10T21:02:19.727168+0000","last_undegraded":"2023-10-10T21:02:19.727168+0000","last_fullsized":"2023-10-10T21:02:19.727168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:24.203380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725542+0000","last_change":"2023-10-10T21:02:19.722093+0000","last_active":"2023-10-10T21:02:19.725542+0000","last_peered":"2023-10-10T21:02:19.725542+0000","last_clean":"2023-10-10T21:02:19.725542+0000","last_became_active":"2023-10-10T21:02:19.721844+0000","last_became_peered":"2023-10-10T21:02:19.721844+0000","last_unstale":"2023-10-10T21:02:19.725542+0000","last_undegraded":"2023-10-10T21:02:19.725542+0000","last_fullsized":"2023-10-10T21:02:19.725542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725512+0000","last_change":"2023-10-10T21:02:19.721570+0000","last_active":"2023-10-10T21:02:19.725512+0000","last_peered":"2023-10-10T21:02:19.725512+0000","last_clean":"2023-10-10T21:02:19.725512+0000","last_became_active":"2023-10-10T21:02:19.721289+0000","last_became_peered":"2023-10-10T21:02:19.721289+0000","last_unstale":"2023-10-10T21:02:19.725512+0000","last_undegraded":"2023-10-10T21:02:19.725512+0000","last_fullsized":"2023-10-10T21:02:19.725512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725875+0000","last_change":"2023-10-10T21:02:19.717746+0000","last_active":"2023-10-10T21:02:19.725875+0000","last_peered":"2023-10-10T21:02:19.725875+0000","last_clean":"2023-10-10T21:02:19.725875+0000","last_became_active":"2023-10-10T21:02:19.717435+0000","last_became_peered":"2023-10-10T21:02:19.717435+0000","last_unstale":"2023-10-10T21:02:19.725875+0000","last_undegraded":"2023-10-10T21:02:19.725875+0000","last_fullsized":"2023-10-10T21:02:19.725875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:50.911075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726896+0000","last_change":"2023-10-10T21:02:19.719831+0000","last_active":"2023-10-10T21:02:19.726896+0000","last_peered":"2023-10-10T21:02:19.726896+0000","last_clean":"2023-10-10T21:02:19.726896+0000","last_became_active":"2023-10-10T21:02:19.719580+0000","last_became_peered":"2023-10-10T21:02:19.719580+0000","last_unstale":"2023-10-10T21:02:19.726896+0000","last_undegraded":"2023-10-10T21:02:19.726896+0000","last_fullsized":"2023-10-10T21:02:19.726896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:57.187854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722504+0000","last_change":"2023-10-10T21:02:19.720031+0000","last_active":"2023-10-10T21:02:19.722504+0000","last_peered":"2023-10-10T21:02:19.722504+0000","last_clean":"2023-10-10T21:02:19.722504+0000","last_became_active":"2023-10-10T21:02:19.719689+0000","last_became_peered":"2023-10-10T21:02:19.719689+0000","last_unstale":"2023-10-10T21:02:19.722504+0000","last_undegraded":"2023-10-10T21:02:19.722504+0000","last_fullsized":"2023-10-10T21:02:19.722504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:15.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.706091+0000","last_change":"2023-10-10T21:02:19.704316+0000","last_active":"2023-10-10T21:02:19.706091+0000","last_peered":"2023-10-10T21:02:19.706091+0000","last_clean":"2023-10-10T21:02:19.706091+0000","last_became_active":"2023-10-10T21:02:19.704005+0000","last_became_peered":"2023-10-10T21:02:19.704005+0000","last_unstale":"2023-10-10T21:02:19.706091+0000","last_undegraded":"2023-10-10T21:02:19.706091+0000","last_fullsized":"2023-10-10T21:02:19.706091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:15.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.724555+0000","last_change":"2023-10-10T21:02:19.721535+0000","last_active":"2023-10-10T21:02:19.724555+0000","last_peered":"2023-10-10T21:02:19.724555+0000","last_clean":"2023-10-10T21:02:19.724555+0000","last_became_active":"2023-10-10T21:02:19.721252+0000","last_became_peered":"2023-10-10T21:02:19.721252+0000","last_unstale":"2023-10-10T21:02:19.724555+0000","last_undegraded":"2023-10-10T21:02:19.724555+0000","last_fullsized":"2023-10-10T21:02:19.724555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718215+0000","last_change":"2023-10-10T21:02:19.713601+0000","last_active":"2023-10-10T21:02:19.718215+0000","last_peered":"2023-10-10T21:02:19.718215+0000","last_clean":"2023-10-10T21:02:19.718215+0000","last_became_active":"2023-10-10T21:02:19.713243+0000","last_became_peered":"2023-10-10T21:02:19.713243+0000","last_unstale":"2023-10-10T21:02:19.718215+0000","last_undegraded":"2023-10-10T21:02:19.718215+0000","last_fullsized":"2023-10-10T21:02:19.718215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:33:01.750601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726941+0000","last_change":"2023-10-10T21:02:19.724421+0000","last_active":"2023-10-10T21:02:19.726941+0000","last_peered":"2023-10-10T21:02:19.726941+0000","last_clean":"2023-10-10T21:02:19.726941+0000","last_became_active":"2023-10-10T21:02:19.724172+0000","last_became_peered":"2023-10-10T21:02:19.724172+0000","last_unstale":"2023-10-10T21:02:19.726941+0000","last_undegraded":"2023-10-10T21:02:19.726941+0000","last_fullsized":"2023-10-10T21:02:19.726941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:12:42.333132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719861+0000","last_change":"2023-10-10T21:02:19.715088+0000","last_active":"2023-10-10T21:02:19.719861+0000","last_peered":"2023-10-10T21:02:19.719861+0000","last_clean":"2023-10-10T21:02:19.719861+0000","last_became_active":"2023-10-10T21:02:19.714808+0000","last_became_peered":"2023-10-10T21:02:19.714808+0000","last_unstale":"2023-10-10T21:02:19.719861+0000","last_undegraded":"2023-10-10T21:02:19.719861+0000","last_fullsized":"2023-10-10T21:02:19.719861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723560+0000","last_change":"2023-10-10T21:02:18.705916+0000","last_active":"2023-10-10T21:02:19.723560+0000","last_peered":"2023-10-10T21:02:19.723560+0000","last_clean":"2023-10-10T21:02:19.723560+0000","last_became_active":"2023-10-10T21:02:18.705673+0000","last_became_peered":"2023-10-10T21:02:18.705673+0000","last_unstale":"2023-10-10T21:02:19.723560+0000","last_undegraded":"2023-10-10T21:02:19.723560+0000","last_fullsized":"2023-10-10T21:02:19.723560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:00:07.742782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727117+0000","last_change":"2023-10-10T21:02:19.721545+0000","last_active":"2023-10-10T21:02:19.727117+0000","last_peered":"2023-10-10T21:02:19.727117+0000","last_clean":"2023-10-10T21:02:19.727117+0000","last_became_active":"2023-10-10T21:02:19.721267+0000","last_became_peered":"2023-10-10T21:02:19.721267+0000","last_unstale":"2023-10-10T21:02:19.727117+0000","last_undegraded":"2023-10-10T21:02:19.727117+0000","last_fullsized":"2023-10-10T21:02:19.727117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:36:45.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726622+0000","last_change":"2023-10-10T21:02:18.708750+0000","last_active":"2023-10-10T21:02:19.726622+0000","last_peered":"2023-10-10T21:02:19.726622+0000","last_clean":"2023-10-10T21:02:19.726622+0000","last_became_active":"2023-10-10T21:02:18.708377+0000","last_became_peered":"2023-10-10T21:02:18.708377+0000","last_unstale":"2023-10-10T21:02:19.726622+0000","last_undegraded":"2023-10-10T21:02:19.726622+0000","last_fullsized":"2023-10-10T21:02:19.726622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:41:42.908310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727729+0000","last_change":"2023-10-10T21:02:19.723005+0000","last_active":"2023-10-10T21:02:19.727729+0000","last_peered":"2023-10-10T21:02:19.727729+0000","last_clean":"2023-10-10T21:02:19.727729+0000","last_became_active":"2023-10-10T21:02:19.722761+0000","last_became_peered":"2023-10-10T21:02:19.722761+0000","last_unstale":"2023-10-10T21:02:19.727729+0000","last_undegraded":"2023-10-10T21:02:19.727729+0000","last_fullsized":"2023-10-10T21:02:19.727729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.732039+0000","last_change":"2023-10-10T21:02:18.715526+0000","last_active":"2023-10-10T21:02:19.732039+0000","last_peered":"2023-10-10T21:02:19.732039+0000","last_clean":"2023-10-10T21:02:19.732039+0000","last_became_active":"2023-10-10T21:02:18.715098+0000","last_became_peered":"2023-10-10T21:02:18.715098+0000","last_unstale":"2023-10-10T21:02:19.732039+0000","last_undegraded":"2023-10-10T21:02:19.732039+0000","last_fullsized":"2023-10-10T21:02:19.732039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718973+0000","last_change":"2023-10-10T21:02:19.714549+0000","last_active":"2023-10-10T21:02:19.718973+0000","last_peered":"2023-10-10T21:02:19.718973+0000","last_clean":"2023-10-10T21:02:19.718973+0000","last_became_active":"2023-10-10T21:02:19.714241+0000","last_became_peered":"2023-10-10T21:02:19.714241+0000","last_unstale":"2023-10-10T21:02:19.718973+0000","last_undegraded":"2023-10-10T21:02:19.718973+0000","last_fullsized":"2023-10-10T21:02:19.718973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:51.819041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.732761+0000","last_change":"2023-10-10T21:02:18.721479+0000","last_active":"2023-10-10T21:02:19.732761+0000","last_peered":"2023-10-10T21:02:19.732761+0000","last_clean":"2023-10-10T21:02:19.732761+0000","last_became_active":"2023-10-10T21:02:18.721197+0000","last_became_peered":"2023-10-10T21:02:18.721197+0000","last_unstale":"2023-10-10T21:02:19.732761+0000","last_undegraded":"2023-10-10T21:02:19.732761+0000","last_fullsized":"2023-10-10T21:02:19.732761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.720290+0000","last_change":"2023-10-10T21:02:19.714941+0000","last_active":"2023-10-10T21:02:19.720290+0000","last_peered":"2023-10-10T21:02:19.720290+0000","last_clean":"2023-10-10T21:02:19.720290+0000","last_became_active":"2023-10-10T21:02:19.714068+0000","last_became_peered":"2023-10-10T21:02:19.714068+0000","last_unstale":"2023-10-10T21:02:19.720290+0000","last_undegraded":"2023-10-10T21:02:19.720290+0000","last_fullsized":"2023-10-10T21:02:19.720290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:24.203380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730306+0000","last_change":"2023-10-10T21:02:18.716842+0000","last_active":"2023-10-10T21:02:19.730306+0000","last_peered":"2023-10-10T21:02:19.730306+0000","last_clean":"2023-10-10T21:02:19.730306+0000","last_became_active":"2023-10-10T21:02:18.716540+0000","last_became_peered":"2023-10-10T21:02:18.716540+0000","last_unstale":"2023-10-10T21:02:19.730306+0000","last_undegraded":"2023-10-10T21:02:19.730306+0000","last_fullsized":"2023-10-10T21:02:19.730306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:24:11.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717957+0000","last_change":"2023-10-10T21:02:19.709639+0000","last_active":"2023-10-10T21:02:19.717957+0000","last_peered":"2023-10-10T21:02:19.717957+0000","last_clean":"2023-10-10T21:02:19.717957+0000","last_became_active":"2023-10-10T21:02:19.708657+0000","last_became_peered":"2023-10-10T21:02:19.708657+0000","last_unstale":"2023-10-10T21:02:19.717957+0000","last_undegraded":"2023-10-10T21:02:19.717957+0000","last_fullsized":"2023-10-10T21:02:19.717957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:16.338945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725424+0000","last_change":"2023-10-10T21:02:18.714042+0000","last_active":"2023-10-10T21:02:19.725424+0000","last_peered":"2023-10-10T21:02:19.725424+0000","last_clean":"2023-10-10T21:02:19.725424+0000","last_became_active":"2023-10-10T21:02:18.713460+0000","last_became_peered":"2023-10-10T21:02:18.713460+0000","last_unstale":"2023-10-10T21:02:19.725424+0000","last_undegraded":"2023-10-10T21:02:19.725424+0000","last_fullsized":"2023-10-10T21:02:19.725424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725423+0000","last_change":"2023-10-10T21:02:19.722075+0000","last_active":"2023-10-10T21:02:19.725423+0000","last_peered":"2023-10-10T21:02:19.725423+0000","last_clean":"2023-10-10T21:02:19.725423+0000","last_became_active":"2023-10-10T21:02:19.721818+0000","last_became_peered":"2023-10-10T21:02:19.721818+0000","last_unstale":"2023-10-10T21:02:19.725423+0000","last_undegraded":"2023-10-10T21:02:19.725423+0000","last_fullsized":"2023-10-10T21:02:19.725423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:39:51.766459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.701716+0000","last_change":"2023-10-10T21:02:18.713684+0000","last_active":"2023-10-10T21:02:19.701716+0000","last_peered":"2023-10-10T21:02:19.701716+0000","last_clean":"2023-10-10T21:02:19.701716+0000","last_became_active":"2023-10-10T21:02:18.712935+0000","last_became_peered":"2023-10-10T21:02:18.712935+0000","last_unstale":"2023-10-10T21:02:19.701716+0000","last_undegraded":"2023-10-10T21:02:19.701716+0000","last_fullsized":"2023-10-10T21:02:19.701716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:14.025240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727600+0000","last_change":"2023-10-10T21:02:19.724065+0000","last_active":"2023-10-10T21:02:19.727600+0000","last_peered":"2023-10-10T21:02:19.727600+0000","last_clean":"2023-10-10T21:02:19.727600+0000","last_became_active":"2023-10-10T21:02:19.723390+0000","last_became_peered":"2023-10-10T21:02:19.723390+0000","last_unstale":"2023-10-10T21:02:19.727600+0000","last_undegraded":"2023-10-10T21:02:19.727600+0000","last_fullsized":"2023-10-10T21:02:19.727600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:37:50.246896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694142+0000","last_change":"2023-10-10T21:02:18.718570+0000","last_active":"2023-10-10T21:02:19.694142+0000","last_peered":"2023-10-10T21:02:19.694142+0000","last_clean":"2023-10-10T21:02:19.694142+0000","last_became_active":"2023-10-10T21:02:18.718251+0000","last_became_peered":"2023-10-10T21:02:18.718251+0000","last_unstale":"2023-10-10T21:02:19.694142+0000","last_undegraded":"2023-10-10T21:02:19.694142+0000","last_fullsized":"2023-10-10T21:02:19.694142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:14.026617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717960+0000","last_change":"2023-10-10T21:02:19.714750+0000","last_active":"2023-10-10T21:02:19.717960+0000","last_peered":"2023-10-10T21:02:19.717960+0000","last_clean":"2023-10-10T21:02:19.717960+0000","last_became_active":"2023-10-10T21:02:19.714443+0000","last_became_peered":"2023-10-10T21:02:19.714443+0000","last_unstale":"2023-10-10T21:02:19.717960+0000","last_undegraded":"2023-10-10T21:02:19.717960+0000","last_fullsized":"2023-10-10T21:02:19.717960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.703920+0000","last_change":"2023-10-10T21:02:18.721599+0000","last_active":"2023-10-10T21:02:19.703920+0000","last_peered":"2023-10-10T21:02:19.703920+0000","last_clean":"2023-10-10T21:02:19.703920+0000","last_became_active":"2023-10-10T21:02:18.721291+0000","last_became_peered":"2023-10-10T21:02:18.721291+0000","last_unstale":"2023-10-10T21:02:19.703920+0000","last_undegraded":"2023-10-10T21:02:19.703920+0000","last_fullsized":"2023-10-10T21:02:19.703920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718109+0000","last_change":"2023-10-10T21:02:19.712154+0000","last_active":"2023-10-10T21:02:19.718109+0000","last_peered":"2023-10-10T21:02:19.718109+0000","last_clean":"2023-10-10T21:02:19.718109+0000","last_became_active":"2023-10-10T21:02:19.711878+0000","last_became_peered":"2023-10-10T21:02:19.711878+0000","last_unstale":"2023-10-10T21:02:19.718109+0000","last_undegraded":"2023-10-10T21:02:19.718109+0000","last_fullsized":"2023-10-10T21:02:19.718109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694643+0000","last_change":"2023-10-10T21:02:18.722267+0000","last_active":"2023-10-10T21:02:19.694643+0000","last_peered":"2023-10-10T21:02:19.694643+0000","last_clean":"2023-10-10T21:02:19.694643+0000","last_became_active":"2023-10-10T21:02:18.719908+0000","last_became_peered":"2023-10-10T21:02:18.719908+0000","last_unstale":"2023-10-10T21:02:19.694643+0000","last_undegraded":"2023-10-10T21:02:19.694643+0000","last_fullsized":"2023-10-10T21:02:19.694643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726172+0000","last_change":"2023-10-10T21:02:19.722369+0000","last_active":"2023-10-10T21:02:19.726172+0000","last_peered":"2023-10-10T21:02:19.726172+0000","last_clean":"2023-10-10T21:02:19.726172+0000","last_became_active":"2023-10-10T21:02:19.722113+0000","last_became_peered":"2023-10-10T21:02:19.722113+0000","last_unstale":"2023-10-10T21:02:19.726172+0000","last_undegraded":"2023-10-10T21:02:19.726172+0000","last_fullsized":"2023-10-10T21:02:19.726172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726730+0000","last_change":"2023-10-10T21:02:18.718657+0000","last_active":"2023-10-10T21:02:19.726730+0000","last_peered":"2023-10-10T21:02:19.726730+0000","last_clean":"2023-10-10T21:02:19.726730+0000","last_became_active":"2023-10-10T21:02:18.718395+0000","last_became_peered":"2023-10-10T21:02:18.718395+0000","last_unstale":"2023-10-10T21:02:19.726730+0000","last_undegraded":"2023-10-10T21:02:19.726730+0000","last_fullsized":"2023-10-10T21:02:19.726730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.716253+0000","last_change":"2023-10-10T21:02:19.705946+0000","last_active":"2023-10-10T21:02:19.716253+0000","last_peered":"2023-10-10T21:02:19.716253+0000","last_clean":"2023-10-10T21:02:19.716253+0000","last_became_active":"2023-10-10T21:02:19.705596+0000","last_became_peered":"2023-10-10T21:02:19.705596+0000","last_unstale":"2023-10-10T21:02:19.716253+0000","last_undegraded":"2023-10-10T21:02:19.716253+0000","last_fullsized":"2023-10-10T21:02:19.716253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:45.667349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.732780+0000","last_change":"2023-10-10T21:02:18.712503+0000","last_active":"2023-10-10T21:02:19.732780+0000","last_peered":"2023-10-10T21:02:19.732780+0000","last_clean":"2023-10-10T21:02:19.732780+0000","last_became_active":"2023-10-10T21:02:18.712089+0000","last_became_peered":"2023-10-10T21:02:18.712089+0000","last_unstale":"2023-10-10T21:02:19.732780+0000","last_undegraded":"2023-10-10T21:02:19.732780+0000","last_fullsized":"2023-10-10T21:02:19.732780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722654+0000","last_change":"2023-10-10T21:02:19.719227+0000","last_active":"2023-10-10T21:02:19.722654+0000","last_peered":"2023-10-10T21:02:19.722654+0000","last_clean":"2023-10-10T21:02:19.722654+0000","last_became_active":"2023-10-10T21:02:19.718847+0000","last_became_peered":"2023-10-10T21:02:19.718847+0000","last_unstale":"2023-10-10T21:02:19.722654+0000","last_undegraded":"2023-10-10T21:02:19.722654+0000","last_fullsized":"2023-10-10T21:02:19.722654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:01:48.898002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723071+0000","last_change":"2023-10-10T21:02:18.704860+0000","last_active":"2023-10-10T21:02:19.723071+0000","last_peered":"2023-10-10T21:02:19.723071+0000","last_clean":"2023-10-10T21:02:19.723071+0000","last_became_active":"2023-10-10T21:02:18.704565+0000","last_became_peered":"2023-10-10T21:02:18.704565+0000","last_unstale":"2023-10-10T21:02:19.723071+0000","last_undegraded":"2023-10-10T21:02:19.723071+0000","last_fullsized":"2023-10-10T21:02:19.723071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:44.459665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722520+0000","last_change":"2023-10-10T21:02:19.720643+0000","last_active":"2023-10-10T21:02:19.722520+0000","last_peered":"2023-10-10T21:02:19.722520+0000","last_clean":"2023-10-10T21:02:19.722520+0000","last_became_active":"2023-10-10T21:02:19.720210+0000","last_became_peered":"2023-10-10T21:02:19.720210+0000","last_unstale":"2023-10-10T21:02:19.722520+0000","last_undegraded":"2023-10-10T21:02:19.722520+0000","last_fullsized":"2023-10-10T21:02:19.722520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:00.153901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694420+0000","last_change":"2023-10-10T21:02:18.713031+0000","last_active":"2023-10-10T21:02:19.694420+0000","last_peered":"2023-10-10T21:02:19.694420+0000","last_clean":"2023-10-10T21:02:19.694420+0000","last_became_active":"2023-10-10T21:02:18.712686+0000","last_became_peered":"2023-10-10T21:02:18.712686+0000","last_unstale":"2023-10-10T21:02:19.694420+0000","last_undegraded":"2023-10-10T21:02:19.694420+0000","last_fullsized":"2023-10-10T21:02:19.694420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:22.891390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730553+0000","last_change":"2023-10-10T21:02:19.723948+0000","last_active":"2023-10-10T21:02:19.730553+0000","last_peered":"2023-10-10T21:02:19.730553+0000","last_clean":"2023-10-10T21:02:19.730553+0000","last_became_active":"2023-10-10T21:02:19.723676+0000","last_became_peered":"2023-10-10T21:02:19.723676+0000","last_unstale":"2023-10-10T21:02:19.730553+0000","last_undegraded":"2023-10-10T21:02:19.730553+0000","last_fullsized":"2023-10-10T21:02:19.730553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:07:28.315895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.703741+0000","last_change":"2023-10-10T21:02:18.713015+0000","last_active":"2023-10-10T21:02:19.703741+0000","last_peered":"2023-10-10T21:02:19.703741+0000","last_clean":"2023-10-10T21:02:19.703741+0000","last_became_active":"2023-10-10T21:02:18.712700+0000","last_became_peered":"2023-10-10T21:02:18.712700+0000","last_unstale":"2023-10-10T21:02:19.703741+0000","last_undegraded":"2023-10-10T21:02:19.703741+0000","last_fullsized":"2023-10-10T21:02:19.703741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.728502+0000","last_change":"2023-10-10T21:02:19.724648+0000","last_active":"2023-10-10T21:02:19.728502+0000","last_peered":"2023-10-10T21:02:19.728502+0000","last_clean":"2023-10-10T21:02:19.728502+0000","last_became_active":"2023-10-10T21:02:19.723407+0000","last_became_peered":"2023-10-10T21:02:19.723407+0000","last_unstale":"2023-10-10T21:02:19.728502+0000","last_undegraded":"2023-10-10T21:02:19.728502+0000","last_fullsized":"2023-10-10T21:02:19.728502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:39:51.766459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.719279+0000","last_change":"2023-10-10T21:02:18.704318+0000","last_active":"2023-10-10T21:02:19.719279+0000","last_peered":"2023-10-10T21:02:19.719279+0000","last_clean":"2023-10-10T21:02:19.719279+0000","last_became_active":"2023-10-10T21:02:18.704004+0000","last_became_peered":"2023-10-10T21:02:18.704004+0000","last_unstale":"2023-10-10T21:02:19.719279+0000","last_undegraded":"2023-10-10T21:02:19.719279+0000","last_fullsized":"2023-10-10T21:02:19.719279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:41:42.908310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.731837+0000","last_change":"2023-10-10T21:02:19.726963+0000","last_active":"2023-10-10T21:02:19.731837+0000","last_peered":"2023-10-10T21:02:19.731837+0000","last_clean":"2023-10-10T21:02:19.731837+0000","last_became_active":"2023-10-10T21:02:19.726624+0000","last_became_peered":"2023-10-10T21:02:19.726624+0000","last_unstale":"2023-10-10T21:02:19.731837+0000","last_undegraded":"2023-10-10T21:02:19.731837+0000","last_fullsized":"2023-10-10T21:02:19.731837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726614+0000","last_change":"2023-10-10T21:02:18.702662+0000","last_active":"2023-10-10T21:02:19.726614+0000","last_peered":"2023-10-10T21:02:19.726614+0000","last_clean":"2023-10-10T21:02:19.726614+0000","last_became_active":"2023-10-10T21:02:18.702383+0000","last_became_peered":"2023-10-10T21:02:18.702383+0000","last_unstale":"2023-10-10T21:02:19.726614+0000","last_undegraded":"2023-10-10T21:02:19.726614+0000","last_fullsized":"2023-10-10T21:02:19.726614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:44.459665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730626+0000","last_change":"2023-10-10T21:02:19.724101+0000","last_active":"2023-10-10T21:02:19.730626+0000","last_peered":"2023-10-10T21:02:19.730626+0000","last_clean":"2023-10-10T21:02:19.730626+0000","last_became_active":"2023-10-10T21:02:19.723825+0000","last_became_peered":"2023-10-10T21:02:19.723825+0000","last_unstale":"2023-10-10T21:02:19.730626+0000","last_undegraded":"2023-10-10T21:02:19.730626+0000","last_fullsized":"2023-10-10T21:02:19.730626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693103+0000","last_change":"2023-10-10T21:02:18.707721+0000","last_active":"2023-10-10T21:02:19.693103+0000","last_peered":"2023-10-10T21:02:19.693103+0000","last_clean":"2023-10-10T21:02:19.693103+0000","last_became_active":"2023-10-10T21:02:18.707316+0000","last_became_peered":"2023-10-10T21:02:18.707316+0000","last_unstale":"2023-10-10T21:02:19.693103+0000","last_undegraded":"2023-10-10T21:02:19.693103+0000","last_fullsized":"2023-10-10T21:02:19.693103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:15.332710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715462+0000","last_change":"2023-10-10T21:02:19.711473+0000","last_active":"2023-10-10T21:02:19.715462+0000","last_peered":"2023-10-10T21:02:19.715462+0000","last_clean":"2023-10-10T21:02:19.715462+0000","last_became_active":"2023-10-10T21:02:19.711163+0000","last_became_peered":"2023-10-10T21:02:19.711163+0000","last_unstale":"2023-10-10T21:02:19.715462+0000","last_undegraded":"2023-10-10T21:02:19.715462+0000","last_fullsized":"2023-10-10T21:02:19.715462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:41:59.374380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694353+0000","last_change":"2023-10-10T21:02:18.714506+0000","last_active":"2023-10-10T21:02:19.694353+0000","last_peered":"2023-10-10T21:02:19.694353+0000","last_clean":"2023-10-10T21:02:19.694353+0000","last_became_active":"2023-10-10T21:02:18.714083+0000","last_became_peered":"2023-10-10T21:02:18.714083+0000","last_unstale":"2023-10-10T21:02:19.694353+0000","last_undegraded":"2023-10-10T21:02:19.694353+0000","last_fullsized":"2023-10-10T21:02:19.694353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726810+0000","last_change":"2023-10-10T21:02:19.723781+0000","last_active":"2023-10-10T21:02:19.726810+0000","last_peered":"2023-10-10T21:02:19.726810+0000","last_clean":"2023-10-10T21:02:19.726810+0000","last_became_active":"2023-10-10T21:02:19.723312+0000","last_became_peered":"2023-10-10T21:02:19.723312+0000","last_unstale":"2023-10-10T21:02:19.726810+0000","last_undegraded":"2023-10-10T21:02:19.726810+0000","last_fullsized":"2023-10-10T21:02:19.726810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:36.717475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.707776+0000","last_change":"2023-10-10T21:02:19.704121+0000","last_active":"2023-10-10T21:02:19.707776+0000","last_peered":"2023-10-10T21:02:19.707776+0000","last_clean":"2023-10-10T21:02:19.707776+0000","last_became_active":"2023-10-10T21:02:19.701763+0000","last_became_peered":"2023-10-10T21:02:19.701763+0000","last_unstale":"2023-10-10T21:02:19.707776+0000","last_undegraded":"2023-10-10T21:02:19.707776+0000","last_fullsized":"2023-10-10T21:02:19.707776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.698519+0000","last_change":"2023-10-10T21:02:18.702602+0000","last_active":"2023-10-10T21:02:19.698519+0000","last_peered":"2023-10-10T21:02:19.698519+0000","last_clean":"2023-10-10T21:02:19.698519+0000","last_became_active":"2023-10-10T21:02:18.702148+0000","last_became_peered":"2023-10-10T21:02:18.702148+0000","last_unstale":"2023-10-10T21:02:19.698519+0000","last_undegraded":"2023-10-10T21:02:19.698519+0000","last_fullsized":"2023-10-10T21:02:19.698519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:24:11.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.726645+0000","last_change":"2023-10-10T21:02:19.718927+0000","last_active":"2023-10-10T21:02:19.726645+0000","last_peered":"2023-10-10T21:02:19.726645+0000","last_clean":"2023-10-10T21:02:19.726645+0000","last_became_active":"2023-10-10T21:02:19.718658+0000","last_became_peered":"2023-10-10T21:02:19.718658+0000","last_unstale":"2023-10-10T21:02:19.726645+0000","last_undegraded":"2023-10-10T21:02:19.726645+0000","last_fullsized":"2023-10-10T21:02:19.726645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:45:52.552283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.694494+0000","last_change":"2023-10-10T21:02:18.716187+0000","last_active":"2023-10-10T21:02:19.694494+0000","last_peered":"2023-10-10T21:02:19.694494+0000","last_clean":"2023-10-10T21:02:19.694494+0000","last_became_active":"2023-10-10T21:02:18.715942+0000","last_became_peered":"2023-10-10T21:02:18.715942+0000","last_unstale":"2023-10-10T21:02:19.694494+0000","last_undegraded":"2023-10-10T21:02:19.694494+0000","last_fullsized":"2023-10-10T21:02:19.694494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.702720+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:02:19.702720+0000","last_peered":"2023-10-10T21:02:19.702720+0000","last_clean":"2023-10-10T21:02:19.702720+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:02:19.702720+0000","last_undegraded":"2023-10-10T21:02:19.702720+0000","last_fullsized":"2023-10-10T21:02:19.702720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727440+0000","last_change":"2023-10-10T21:02:19.722786+0000","last_active":"2023-10-10T21:02:19.727440+0000","last_peered":"2023-10-10T21:02:19.727440+0000","last_clean":"2023-10-10T21:02:19.727440+0000","last_became_active":"2023-10-10T21:02:19.722544+0000","last_became_peered":"2023-10-10T21:02:19.722544+0000","last_unstale":"2023-10-10T21:02:19.727440+0000","last_undegraded":"2023-10-10T21:02:19.727440+0000","last_fullsized":"2023-10-10T21:02:19.727440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:42:20.031126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.702832+0000","last_change":"2023-10-10T21:02:18.719142+0000","last_active":"2023-10-10T21:02:19.702832+0000","last_peered":"2023-10-10T21:02:19.702832+0000","last_clean":"2023-10-10T21:02:19.702832+0000","last_became_active":"2023-10-10T21:02:18.718861+0000","last_became_peered":"2023-10-10T21:02:18.718861+0000","last_unstale":"2023-10-10T21:02:19.702832+0000","last_undegraded":"2023-10-10T21:02:19.702832+0000","last_fullsized":"2023-10-10T21:02:19.702832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.703470+0000","last_change":"2023-10-10T21:02:18.712773+0000","last_active":"2023-10-10T21:02:19.703470+0000","last_peered":"2023-10-10T21:02:19.703470+0000","last_clean":"2023-10-10T21:02:19.703470+0000","last_became_active":"2023-10-10T21:02:18.712496+0000","last_became_peered":"2023-10-10T21:02:18.712496+0000","last_unstale":"2023-10-10T21:02:19.703470+0000","last_undegraded":"2023-10-10T21:02:19.703470+0000","last_fullsized":"2023-10-10T21:02:19.703470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:09:01.161677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.706058+0000","last_change":"2023-10-10T21:02:19.702557+0000","last_active":"2023-10-10T21:02:19.706058+0000","last_peered":"2023-10-10T21:02:19.706058+0000","last_clean":"2023-10-10T21:02:19.706058+0000","last_became_active":"2023-10-10T21:02:19.702270+0000","last_became_peered":"2023-10-10T21:02:19.702270+0000","last_unstale":"2023-10-10T21:02:19.706058+0000","last_undegraded":"2023-10-10T21:02:19.706058+0000","last_fullsized":"2023-10-10T21:02:19.706058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-10T21:02:20.707362+0000","last_change":"2023-10-10T21:02:18.713198+0000","last_active":"2023-10-10T21:02:20.707362+0000","last_peered":"2023-10-10T21:02:20.707362+0000","last_clean":"2023-10-10T21:02:20.707362+0000","last_became_active":"2023-10-10T21:02:18.712906+0000","last_became_peered":"2023-10-10T21:02:18.712906+0000","last_unstale":"2023-10-10T21:02:20.707362+0000","last_undegraded":"2023-10-10T21:02:20.707362+0000","last_fullsized":"2023-10-10T21:02:20.707362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:43:07.592272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715363+0000","last_change":"2023-10-10T21:02:19.707593+0000","last_active":"2023-10-10T21:02:19.715363+0000","last_peered":"2023-10-10T21:02:19.715363+0000","last_clean":"2023-10-10T21:02:19.715363+0000","last_became_active":"2023-10-10T21:02:19.706687+0000","last_became_peered":"2023-10-10T21:02:19.706687+0000","last_unstale":"2023-10-10T21:02:19.715363+0000","last_undegraded":"2023-10-10T21:02:19.715363+0000","last_fullsized":"2023-10-10T21:02:19.715363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:59:28.606720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723812+0000","last_change":"2023-10-10T21:02:18.719905+0000","last_active":"2023-10-10T21:02:19.723812+0000","last_peered":"2023-10-10T21:02:19.723812+0000","last_clean":"2023-10-10T21:02:19.723812+0000","last_became_active":"2023-10-10T21:02:18.719606+0000","last_became_peered":"2023-10-10T21:02:18.719606+0000","last_unstale":"2023-10-10T21:02:19.723812+0000","last_undegraded":"2023-10-10T21:02:19.723812+0000","last_fullsized":"2023-10-10T21:02:19.723812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722943+0000","last_change":"2023-10-10T21:02:19.720643+0000","last_active":"2023-10-10T21:02:19.722943+0000","last_peered":"2023-10-10T21:02:19.722943+0000","last_clean":"2023-10-10T21:02:19.722943+0000","last_became_active":"2023-10-10T21:02:19.720362+0000","last_became_peered":"2023-10-10T21:02:19.720362+0000","last_unstale":"2023-10-10T21:02:19.722943+0000","last_undegraded":"2023-10-10T21:02:19.722943+0000","last_fullsized":"2023-10-10T21:02:19.722943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.704676+0000","last_change":"2023-10-10T21:02:18.716964+0000","last_active":"2023-10-10T21:02:19.704676+0000","last_peered":"2023-10-10T21:02:19.704676+0000","last_clean":"2023-10-10T21:02:19.704676+0000","last_became_active":"2023-10-10T21:02:18.716502+0000","last_became_peered":"2023-10-10T21:02:18.716502+0000","last_unstale":"2023-10-10T21:02:19.704676+0000","last_undegraded":"2023-10-10T21:02:19.704676+0000","last_fullsized":"2023-10-10T21:02:19.704676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.709106+0000","last_change":"2023-10-10T21:02:19.702718+0000","last_active":"2023-10-10T21:02:19.709106+0000","last_peered":"2023-10-10T21:02:19.709106+0000","last_clean":"2023-10-10T21:02:19.709106+0000","last_became_active":"2023-10-10T21:02:19.702438+0000","last_became_peered":"2023-10-10T21:02:19.702438+0000","last_unstale":"2023-10-10T21:02:19.709106+0000","last_undegraded":"2023-10-10T21:02:19.709106+0000","last_fullsized":"2023-10-10T21:02:19.709106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:09:02.167913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693020+0000","last_change":"2023-10-10T21:02:18.719939+0000","last_active":"2023-10-10T21:02:19.693020+0000","last_peered":"2023-10-10T21:02:19.693020+0000","last_clean":"2023-10-10T21:02:19.693020+0000","last_became_active":"2023-10-10T21:02:18.719606+0000","last_became_peered":"2023-10-10T21:02:18.719606+0000","last_unstale":"2023-10-10T21:02:19.693020+0000","last_undegraded":"2023-10-10T21:02:19.693020+0000","last_fullsized":"2023-10-10T21:02:19.693020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:35.711239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725258+0000","last_change":"2023-10-10T21:02:19.717095+0000","last_active":"2023-10-10T21:02:19.725258+0000","last_peered":"2023-10-10T21:02:19.725258+0000","last_clean":"2023-10-10T21:02:19.725258+0000","last_became_active":"2023-10-10T21:02:19.716805+0000","last_became_peered":"2023-10-10T21:02:19.716805+0000","last_unstale":"2023-10-10T21:02:19.725258+0000","last_undegraded":"2023-10-10T21:02:19.725258+0000","last_fullsized":"2023-10-10T21:02:19.725258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:02:18.184054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.693205+0000","last_change":"2023-10-10T21:02:18.711397+0000","last_active":"2023-10-10T21:02:19.693205+0000","last_peered":"2023-10-10T21:02:19.693205+0000","last_clean":"2023-10-10T21:02:19.693205+0000","last_became_active":"2023-10-10T21:02:18.710905+0000","last_became_peered":"2023-10-10T21:02:18.710905+0000","last_unstale":"2023-10-10T21:02:19.693205+0000","last_undegraded":"2023-10-10T21:02:19.693205+0000","last_fullsized":"2023-10-10T21:02:19.693205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:14.026617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.727611+0000","last_change":"2023-10-10T21:02:19.724197+0000","last_active":"2023-10-10T21:02:19.727611+0000","last_peered":"2023-10-10T21:02:19.727611+0000","last_clean":"2023-10-10T21:02:19.727611+0000","last_became_active":"2023-10-10T21:02:19.723375+0000","last_became_peered":"2023-10-10T21:02:19.723375+0000","last_unstale":"2023-10-10T21:02:19.727611+0000","last_undegraded":"2023-10-10T21:02:19.727611+0000","last_fullsized":"2023-10-10T21:02:19.727611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:06.143786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.732311+0000","last_change":"2023-10-10T21:02:18.717453+0000","last_active":"2023-10-10T21:02:19.732311+0000","last_peered":"2023-10-10T21:02:19.732311+0000","last_clean":"2023-10-10T21:02:19.732311+0000","last_became_active":"2023-10-10T21:02:18.716456+0000","last_became_peered":"2023-10-10T21:02:18.716456+0000","last_unstale":"2023-10-10T21:02:19.732311+0000","last_undegraded":"2023-10-10T21:02:19.732311+0000","last_fullsized":"2023-10-10T21:02:19.732311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725520+0000","last_change":"2023-10-10T21:02:19.721762+0000","last_active":"2023-10-10T21:02:19.725520+0000","last_peered":"2023-10-10T21:02:19.725520+0000","last_clean":"2023-10-10T21:02:19.725520+0000","last_became_active":"2023-10-10T21:02:19.721459+0000","last_became_peered":"2023-10-10T21:02:19.721459+0000","last_unstale":"2023-10-10T21:02:19.725520+0000","last_undegraded":"2023-10-10T21:02:19.725520+0000","last_fullsized":"2023-10-10T21:02:19.725520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:06.766965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.700313+0000","last_change":"2023-10-10T21:02:18.721637+0000","last_active":"2023-10-10T21:02:19.700313+0000","last_peered":"2023-10-10T21:02:19.700313+0000","last_clean":"2023-10-10T21:02:19.700313+0000","last_became_active":"2023-10-10T21:02:18.721347+0000","last_became_peered":"2023-10-10T21:02:18.721347+0000","last_unstale":"2023-10-10T21:02:19.700313+0000","last_undegraded":"2023-10-10T21:02:19.700313+0000","last_fullsized":"2023-10-10T21:02:19.700313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:14.025240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730517+0000","last_change":"2023-10-10T21:02:19.722542+0000","last_active":"2023-10-10T21:02:19.730517+0000","last_peered":"2023-10-10T21:02:19.730517+0000","last_clean":"2023-10-10T21:02:19.730517+0000","last_became_active":"2023-10-10T21:02:19.722239+0000","last_became_peered":"2023-10-10T21:02:19.722239+0000","last_unstale":"2023-10-10T21:02:19.730517+0000","last_undegraded":"2023-10-10T21:02:19.730517+0000","last_fullsized":"2023-10-10T21:02:19.730517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:38:51.453531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721282+0000","last_change":"2023-10-10T21:02:18.706830+0000","last_active":"2023-10-10T21:02:19.721282+0000","last_peered":"2023-10-10T21:02:19.721282+0000","last_clean":"2023-10-10T21:02:19.721282+0000","last_became_active":"2023-10-10T21:02:18.706545+0000","last_became_peered":"2023-10-10T21:02:18.706545+0000","last_unstale":"2023-10-10T21:02:19.721282+0000","last_undegraded":"2023-10-10T21:02:19.721282+0000","last_fullsized":"2023-10-10T21:02:19.721282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:16:16.003133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718953+0000","last_change":"2023-10-10T21:02:19.713935+0000","last_active":"2023-10-10T21:02:19.718953+0000","last_peered":"2023-10-10T21:02:19.718953+0000","last_clean":"2023-10-10T21:02:19.718953+0000","last_became_active":"2023-10-10T21:02:19.713645+0000","last_became_peered":"2023-10-10T21:02:19.713645+0000","last_unstale":"2023-10-10T21:02:19.718953+0000","last_undegraded":"2023-10-10T21:02:19.718953+0000","last_fullsized":"2023-10-10T21:02:19.718953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:07:28.315895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717395+0000","last_change":"2023-10-10T21:02:18.699045+0000","last_active":"2023-10-10T21:02:19.717395+0000","last_peered":"2023-10-10T21:02:19.717395+0000","last_clean":"2023-10-10T21:02:19.717395+0000","last_became_active":"2023-10-10T21:02:18.698700+0000","last_became_peered":"2023-10-10T21:02:18.698700+0000","last_unstale":"2023-10-10T21:02:19.717395+0000","last_undegraded":"2023-10-10T21:02:19.717395+0000","last_fullsized":"2023-10-10T21:02:19.717395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:17.674323+0000","last_clean_scrub_stamp":"2023-10-10T21:02:17.674323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:59.170344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.730615+0000","last_change":"2023-10-10T21:02:19.726475+0000","last_active":"2023-10-10T21:02:19.730615+0000","last_peered":"2023-10-10T21:02:19.730615+0000","last_clean":"2023-10-10T21:02:19.730615+0000","last_became_active":"2023-10-10T21:02:19.726153+0000","last_became_peered":"2023-10-10T21:02:19.726153+0000","last_unstale":"2023-10-10T21:02:19.730615+0000","last_undegraded":"2023-10-10T21:02:19.730615+0000","last_fullsized":"2023-10-10T21:02:19.730615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:11:55.480332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.728526+0000","last_change":"2023-10-10T21:02:19.724879+0000","last_active":"2023-10-10T21:02:19.728526+0000","last_peered":"2023-10-10T21:02:19.728526+0000","last_clean":"2023-10-10T21:02:19.728526+0000","last_became_active":"2023-10-10T21:02:19.724304+0000","last_became_peered":"2023-10-10T21:02:19.724304+0000","last_unstale":"2023-10-10T21:02:19.728526+0000","last_undegraded":"2023-10-10T21:02:19.728526+0000","last_fullsized":"2023-10-10T21:02:19.728526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.717089+0000","last_change":"2023-10-10T21:02:19.714634+0000","last_active":"2023-10-10T21:02:19.717089+0000","last_peered":"2023-10-10T21:02:19.717089+0000","last_clean":"2023-10-10T21:02:19.717089+0000","last_became_active":"2023-10-10T21:02:19.714392+0000","last_became_peered":"2023-10-10T21:02:19.714392+0000","last_unstale":"2023-10-10T21:02:19.717089+0000","last_undegraded":"2023-10-10T21:02:19.717089+0000","last_fullsized":"2023-10-10T21:02:19.717089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:54.736869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.720937+0000","last_change":"2023-10-10T21:02:19.716446+0000","last_active":"2023-10-10T21:02:19.720937+0000","last_peered":"2023-10-10T21:02:19.720937+0000","last_clean":"2023-10-10T21:02:19.720937+0000","last_became_active":"2023-10-10T21:02:19.716149+0000","last_became_peered":"2023-10-10T21:02:19.716149+0000","last_unstale":"2023-10-10T21:02:19.720937+0000","last_undegraded":"2023-10-10T21:02:19.720937+0000","last_fullsized":"2023-10-10T21:02:19.720937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725405+0000","last_change":"2023-10-10T21:02:19.721864+0000","last_active":"2023-10-10T21:02:19.725405+0000","last_peered":"2023-10-10T21:02:19.725405+0000","last_clean":"2023-10-10T21:02:19.725405+0000","last_became_active":"2023-10-10T21:02:19.721621+0000","last_became_peered":"2023-10-10T21:02:19.721621+0000","last_unstale":"2023-10-10T21:02:19.725405+0000","last_undegraded":"2023-10-10T21:02:19.725405+0000","last_fullsized":"2023-10-10T21:02:19.725405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:42.758628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.715529+0000","last_change":"2023-10-10T21:02:19.710748+0000","last_active":"2023-10-10T21:02:19.715529+0000","last_peered":"2023-10-10T21:02:19.715529+0000","last_clean":"2023-10-10T21:02:19.715529+0000","last_became_active":"2023-10-10T21:02:19.710448+0000","last_became_peered":"2023-10-10T21:02:19.710448+0000","last_unstale":"2023-10-10T21:02:19.715529+0000","last_undegraded":"2023-10-10T21:02:19.715529+0000","last_fullsized":"2023-10-10T21:02:19.715529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:46:22.792792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.716282+0000","last_change":"2023-10-10T21:02:19.709278+0000","last_active":"2023-10-10T21:02:19.716282+0000","last_peered":"2023-10-10T21:02:19.716282+0000","last_clean":"2023-10-10T21:02:19.716282+0000","last_became_active":"2023-10-10T21:02:19.709000+0000","last_became_peered":"2023-10-10T21:02:19.709000+0000","last_unstale":"2023-10-10T21:02:19.716282+0000","last_undegraded":"2023-10-10T21:02:19.716282+0000","last_fullsized":"2023-10-10T21:02:19.716282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723915+0000","last_change":"2023-10-10T21:02:19.718420+0000","last_active":"2023-10-10T21:02:19.723915+0000","last_peered":"2023-10-10T21:02:19.723915+0000","last_clean":"2023-10-10T21:02:19.723915+0000","last_became_active":"2023-10-10T21:02:19.718142+0000","last_became_peered":"2023-10-10T21:02:19.718142+0000","last_unstale":"2023-10-10T21:02:19.723915+0000","last_undegraded":"2023-10-10T21:02:19.723915+0000","last_fullsized":"2023-10-10T21:02:19.723915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:13.815214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725153+0000","last_change":"2023-10-10T21:02:19.715456+0000","last_active":"2023-10-10T21:02:19.725153+0000","last_peered":"2023-10-10T21:02:19.725153+0000","last_clean":"2023-10-10T21:02:19.725153+0000","last_became_active":"2023-10-10T21:02:19.715168+0000","last_became_peered":"2023-10-10T21:02:19.715168+0000","last_unstale":"2023-10-10T21:02:19.725153+0000","last_undegraded":"2023-10-10T21:02:19.725153+0000","last_fullsized":"2023-10-10T21:02:19.725153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:20:36.206873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.721426+0000","last_change":"2023-10-10T21:02:19.715964+0000","last_active":"2023-10-10T21:02:19.721426+0000","last_peered":"2023-10-10T21:02:19.721426+0000","last_clean":"2023-10-10T21:02:19.721426+0000","last_became_active":"2023-10-10T21:02:19.715678+0000","last_became_peered":"2023-10-10T21:02:19.715678+0000","last_unstale":"2023-10-10T21:02:19.721426+0000","last_undegraded":"2023-10-10T21:02:19.721426+0000","last_fullsized":"2023-10-10T21:02:19.721426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:46.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.722029+0000","last_change":"2023-10-10T21:02:19.712354+0000","last_active":"2023-10-10T21:02:19.722029+0000","last_peered":"2023-10-10T21:02:19.722029+0000","last_clean":"2023-10-10T21:02:19.722029+0000","last_became_active":"2023-10-10T21:02:19.712051+0000","last_became_peered":"2023-10-10T21:02:19.712051+0000","last_unstale":"2023-10-10T21:02:19.722029+0000","last_undegraded":"2023-10-10T21:02:19.722029+0000","last_fullsized":"2023-10-10T21:02:19.722029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:23:39.628860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.718320+0000","last_change":"2023-10-10T21:02:19.713312+0000","last_active":"2023-10-10T21:02:19.718320+0000","last_peered":"2023-10-10T21:02:19.718320+0000","last_clean":"2023-10-10T21:02:19.718320+0000","last_became_active":"2023-10-10T21:02:19.712993+0000","last_became_peered":"2023-10-10T21:02:19.712993+0000","last_unstale":"2023-10-10T21:02:19.718320+0000","last_undegraded":"2023-10-10T21:02:19.718320+0000","last_fullsized":"2023-10-10T21:02:19.718320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:01:48.898002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.725385+0000","last_change":"2023-10-10T21:02:19.721562+0000","last_active":"2023-10-10T21:02:19.725385+0000","last_peered":"2023-10-10T21:02:19.725385+0000","last_clean":"2023-10-10T21:02:19.725385+0000","last_became_active":"2023-10-10T21:02:19.720554+0000","last_became_peered":"2023-10-10T21:02:19.720554+0000","last_unstale":"2023-10-10T21:02:19.725385+0000","last_undegraded":"2023-10-10T21:02:19.725385+0000","last_fullsized":"2023-10-10T21:02:19.725385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:32.484787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-10T21:02:19.723944+0000","last_change":"2023-10-10T21:02:19.718723+0000","last_active":"2023-10-10T21:02:19.723944+0000","last_peered":"2023-10-10T21:02:19.723944+0000","last_clean":"2023-10-10T21:02:19.723944+0000","last_became_active":"2023-10-10T21:02:19.718408+0000","last_became_peered":"2023-10-10T21:02:19.718408+0000","last_unstale":"2023-10-10T21:02:19.723944+0000","last_undegraded":"2023-10-10T21:02:19.723944+0000","last_fullsized":"2023-10-10T21:02:19.723944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:18.680558+0000","last_clean_scrub_stamp":"2023-10-10T21:02:18.680558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:56.791025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":79778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":669164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":233472,"data_stored":78402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8919999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.25}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.169}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":831488,"data_stored":669220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":78242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":78368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":78332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":79778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:02:30.171 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-10T21:02:30.172 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-10T21:02:30.172 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-10T21:02:30.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-10T21:02:30.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.383+0000 7f63963ff700 1 Processor -- start 2023-10-10T21:02:30.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.384+0000 7f63963ff700 1 -- start start 2023-10-10T21:02:30.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.385+0000 7f63963ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6390156770 0x7f63900b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.385+0000 7f63963ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63900b0300 0x7f63900b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.385+0000 7f63963ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63900c9810 con 0x7f63900ad9b0 2023-10-10T21:02:30.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.385+0000 7f63963ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63900c9680 con 0x7f63900b0300 2023-10-10T21:02:30.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.385+0000 7f63963ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63900adf80 con 0x7f6390156770 2023-10-10T21:02:30.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.385+0000 7f639499c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63900b0300 0x7f63900b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.385+0000 7f639499c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63900b0300 0x7f63900b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55906/0 (socket says 172.21.15.154:55906) 2023-10-10T21:02:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.385+0000 7f639499c700 1 -- 172.21.15.154:0/1023790327 learned_addr learned my addr 172.21.15.154:0/1023790327 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.385+0000 7f638ffff700 1 --2- 172.21.15.154:0/1023790327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6390156770 0x7f63900b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.386+0000 7f639499c700 1 -- 172.21.15.154:0/1023790327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6390156770 msgr2=0x7f63900b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.386+0000 7f639499c700 1 --2- 172.21.15.154:0/1023790327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6390156770 0x7f63900b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.386+0000 7f639499c700 1 -- 172.21.15.154:0/1023790327 >> v1:172.21.15.179:6789/0 conn(0x7f63900ad9b0 legacy=0x7f63900c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.386+0000 7f639499c700 1 -- 172.21.15.154:0/1023790327 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63900ae260 con 0x7f63900b0300 2023-10-10T21:02:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.386+0000 7f639499c700 1 --2- 172.21.15.154:0/1023790327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 0x7f63900b1110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f638800d1a0 tx=0x7f638800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308a5a9ed45e440d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.386+0000 7f638f7fe700 1 -- 172.21.15.154:0/1023790327 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388010070 con 0x7f63900b0300 2023-10-10T21:02:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.386+0000 7f638f7fe700 1 -- 172.21.15.154:0/1023790327 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638800de10 con 0x7f63900b0300 2023-10-10T21:02:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.386+0000 7f638f7fe700 1 -- 172.21.15.154:0/1023790327 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638800b320 con 0x7f63900b0300 2023-10-10T21:02:30.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.387+0000 7f63963ff700 1 -- 172.21.15.154:0/1023790327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 msgr2=0x7f63900b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.387+0000 7f63963ff700 1 --2- 172.21.15.154:0/1023790327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 0x7f63900b1110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f638800d1a0 tx=0x7f638800ba50 comp rx=0 tx=0).stop 2023-10-10T21:02:30.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.387+0000 7f63963ff700 1 -- 172.21.15.154:0/1023790327 shutdown_connections 2023-10-10T21:02:30.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.387+0000 7f63963ff700 1 --2- 172.21.15.154:0/1023790327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 0x7f63900b1110 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.387+0000 7f63963ff700 1 --2- 172.21.15.154:0/1023790327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6390156770 0x7f63900b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.387+0000 7f63963ff700 1 -- 172.21.15.154:0/1023790327 >> 172.21.15.154:0/1023790327 conn(0x7f639006a310 msgr2=0x7f63900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:30.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.387+0000 7f63963ff700 1 -- 172.21.15.154:0/1023790327 shutdown_connections 2023-10-10T21:02:30.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.387+0000 7f63963ff700 1 -- 172.21.15.154:0/1023790327 wait complete. 2023-10-10T21:02:30.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.388+0000 7f63963ff700 1 Processor -- start 2023-10-10T21:02:30.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.389+0000 7f63963ff700 1 -- start start 2023-10-10T21:02:30.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.389+0000 7f63963ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63900ad9b0 0x7f63900c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.389+0000 7f63963ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 0x7f63900c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f63963ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390156770 0x7f63900c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f63963ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63900c3db0 con 0x7f63900b0300 2023-10-10T21:02:30.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f63963ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63900c4bd0 con 0x7f6390156770 2023-10-10T21:02:30.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f63963ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63900c5060 con 0x7f63900ad9b0 2023-10-10T21:02:30.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f6387fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 0x7f63900c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f6387fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 0x7f63900c24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55920/0 (socket says 172.21.15.154:55920) 2023-10-10T21:02:30.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f6387fff700 1 -- 172.21.15.154:0/2967355928 learned_addr learned my addr 172.21.15.154:0/2967355928 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:30.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f638ffff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63900ad9b0 0x7f63900c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f639499c700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390156770 0x7f63900c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f6387fff700 1 -- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63900ad9b0 msgr2=0x7f63900c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f6387fff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63900ad9b0 0x7f63900c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f6387fff700 1 -- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390156770 msgr2=0x7f63900c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f6387fff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390156770 0x7f63900c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f6387fff700 1 -- 172.21.15.154:0/2967355928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638800bcf0 con 0x7f63900b0300 2023-10-10T21:02:30.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f638ffff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63900ad9b0 0x7f63900c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:30.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f639499c700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390156770 0x7f63900c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:30.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.390+0000 7f6387fff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 0x7f63900c24c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f637800c5c0 tx=0x7f637800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:30.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.391+0000 7f638cff9700 1 -- 172.21.15.154:0/2967355928 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378011590 con 0x7f63900b0300 2023-10-10T21:02:30.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.391+0000 7f638cff9700 1 -- 172.21.15.154:0/2967355928 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6378011710 con 0x7f63900b0300 2023-10-10T21:02:30.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.391+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63900c3fc0 con 0x7f63900b0300 2023-10-10T21:02:30.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.391+0000 7f638cff9700 1 -- 172.21.15.154:0/2967355928 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378011ad0 con 0x7f63900b0300 2023-10-10T21:02:30.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.391+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63900c4580 con 0x7f63900b0300 2023-10-10T21:02:30.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.392+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63900b0140 con 0x7f63900b0300 2023-10-10T21:02:30.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.393+0000 7f638cff9700 1 -- 172.21.15.154:0/2967355928 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f637801b3b0 con 0x7f63900b0300 2023-10-10T21:02:30.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.394+0000 7f638cff9700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6370066f30 0x7f63700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.394+0000 7f638cff9700 1 -- 172.21.15.154:0/2967355928 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6378083b70 con 0x7f63900b0300 2023-10-10T21:02:30.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.394+0000 7f638ffff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6370066f30 0x7f63700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.394+0000 7f638ffff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6370066f30 0x7f63700693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6380006f00 tx=0x7f6380008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:30.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.397+0000 7f638cff9700 1 -- 172.21.15.154:0/2967355928 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6378050d40 con 0x7f63900b0300 2023-10-10T21:02:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.628+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f63900c4d60 con 0x7f63900b0300 2023-10-10T21:02:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.629+0000 7f638cff9700 1 -- 172.21.15.154:0/2967355928 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6378017020 con 0x7f63900b0300 2023-10-10T21:02:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:30.630 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-10T21:02:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6370066f30 msgr2=0x7f63700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6370066f30 0x7f63700693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6380006f00 tx=0x7f6380008040 comp rx=0 tx=0).stop 2023-10-10T21:02:30.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 msgr2=0x7f63900c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 0x7f63900c24c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f637800c5c0 tx=0x7f637800c980 comp rx=0 tx=0).stop 2023-10-10T21:02:30.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 shutdown_connections 2023-10-10T21:02:30.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6390156770 0x7f63900c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6370066f30 0x7f63700693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63900ad9b0 0x7f63900c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 --2- 172.21.15.154:0/2967355928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900b0300 0x7f63900c24c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 >> 172.21.15.154:0/2967355928 conn(0x7f639006a310 msgr2=0x7f6390153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:30.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 shutdown_connections 2023-10-10T21:02:30.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.631+0000 7f63963ff700 1 -- 172.21.15.154:0/2967355928 wait complete. 2023-10-10T21:02:30.649 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-10T21:02:30.650 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.831+0000 7f3f91bff700 1 Processor -- start 2023-10-10T21:02:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.831+0000 7f3f91bff700 1 -- start start 2023-10-10T21:02:30.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.832+0000 7f3f91bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069560 0x7f3f8c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.832+0000 7f3f91bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c069ee0 con 0x7f3f8c159890 2023-10-10T21:02:30.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f91bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c15a160 con 0x7f3f8c159c60 2023-10-10T21:02:30.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f91bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0d13a0 con 0x7f3f8c069560 2023-10-10T21:02:30.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3f8c159890 0x7f3f8c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38590/0 (socket says 172.21.15.154:38590) 2023-10-10T21:02:30.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8b7fe700 1 -- 172.21.15.154:0/2451878306 learned_addr learned my addr 172.21.15.154:0/2451878306 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:30.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8bfff700 1 --2- 172.21.15.154:0/2451878306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069560 0x7f3f8c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8a7fc700 1 -- 172.21.15.154:0/2451878306 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548108536 0 0) 0x7f3f8c069ee0 con 0x7f3f8c159890 2023-10-10T21:02:30.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8a7fc700 1 -- 172.21.15.154:0/2451878306 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f74003570 con 0x7f3f8c159890 2023-10-10T21:02:30.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8a7fc700 1 -- 172.21.15.154:0/2451878306 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328936711 0 0) 0x7f3f8c15a160 con 0x7f3f8c159c60 2023-10-10T21:02:30.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8a7fc700 1 -- 172.21.15.154:0/2451878306 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f8c069ee0 con 0x7f3f8c159c60 2023-10-10T21:02:30.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8a7fc700 1 -- 172.21.15.154:0/2451878306 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2573030967 0 0) 0x7f3f74003570 con 0x7f3f8c159890 2023-10-10T21:02:30.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8bfff700 1 -- 172.21.15.154:0/2451878306 >> v1:172.21.15.179:6789/0 conn(0x7f3f8c159c60 legacy=0x7f3f8c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8bfff700 1 -- 172.21.15.154:0/2451878306 >> v1:172.21.15.154:6789/0 conn(0x7f3f8c159890 legacy=0x7f3f8c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.833+0000 7f3f8bfff700 1 -- 172.21.15.154:0/2451878306 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c15e140 con 0x7f3f8c069560 2023-10-10T21:02:30.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.834+0000 7f3f8bfff700 1 --2- 172.21.15.154:0/2451878306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069560 0x7f3f8c0699a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009e90 tx=0x7f3f84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db9051f451ab3fe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:30.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.834+0000 7f3f8a7fc700 1 -- 172.21.15.154:0/2451878306 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400e070 con 0x7f3f8c069560 2023-10-10T21:02:30.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.834+0000 7f3f8a7fc700 1 -- 172.21.15.154:0/2451878306 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400b870 con 0x7f3f8c069560 2023-10-10T21:02:30.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.834+0000 7f3f8a7fc700 1 -- 172.21.15.154:0/2451878306 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c001470 con 0x7f3f8c069560 2023-10-10T21:02:30.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.834+0000 7f3f91bff700 1 -- 172.21.15.154:0/2451878306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069560 msgr2=0x7f3f8c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.834+0000 7f3f91bff700 1 --2- 172.21.15.154:0/2451878306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069560 0x7f3f8c0699a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009e90 tx=0x7f3f84009780 comp rx=0 tx=0).stop 2023-10-10T21:02:30.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.835+0000 7f3f91bff700 1 -- 172.21.15.154:0/2451878306 shutdown_connections 2023-10-10T21:02:30.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.835+0000 7f3f91bff700 1 --2- 172.21.15.154:0/2451878306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069560 0x7f3f8c0699a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.835+0000 7f3f91bff700 1 -- 172.21.15.154:0/2451878306 >> 172.21.15.154:0/2451878306 conn(0x7f3f8c068e20 msgr2=0x7f3f8c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:30.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.835+0000 7f3f91bff700 1 -- 172.21.15.154:0/2451878306 shutdown_connections 2023-10-10T21:02:30.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.835+0000 7f3f91bff700 1 -- 172.21.15.154:0/2451878306 wait complete. 2023-10-10T21:02:30.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.836+0000 7f3f91bff700 1 Processor -- start 2023-10-10T21:02:30.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.836+0000 7f3f91bff700 1 -- start start 2023-10-10T21:02:30.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f91bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c069560 0x7f3f8c0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f91bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c159890 0x7f3f8c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f91bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c159c60 0x7f3f8c154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f91bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0b3ab0 con 0x7f3f8c069560 2023-10-10T21:02:30.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f91bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0cd600 con 0x7f3f8c159c60 2023-10-10T21:02:30.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f91bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c1549d0 con 0x7f3f8c159890 2023-10-10T21:02:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f8b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c069560 0x7f3f8c0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f8b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c069560 0x7f3f8c0c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55936/0 (socket says 172.21.15.154:55936) 2023-10-10T21:02:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f8b7fe700 1 -- 172.21.15.154:0/260546260 learned_addr learned my addr 172.21.15.154:0/260546260 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f8bfff700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c159c60 0x7f3f8c154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.837+0000 7f3f8affd700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c159890 0x7f3f8c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f8b7fe700 1 -- 172.21.15.154:0/260546260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c159890 msgr2=0x7f3f8c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f8b7fe700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c159890 0x7f3f8c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f8b7fe700 1 -- 172.21.15.154:0/260546260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c159c60 msgr2=0x7f3f8c154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f8b7fe700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c159c60 0x7f3f8c154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f8b7fe700 1 -- 172.21.15.154:0/260546260 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84009a20 con 0x7f3f8c069560 2023-10-10T21:02:30.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f8affd700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c159890 0x7f3f8c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:30.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f8b7fe700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c069560 0x7f3f8c0c91f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00cb70 tx=0x7f3f7c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:30.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f737fe700 1 -- 172.21.15.154:0/260546260 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c007e90 con 0x7f3f8c069560 2023-10-10T21:02:30.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f737fe700 1 -- 172.21.15.154:0/260546260 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c007360 con 0x7f3f8c069560 2023-10-10T21:02:30.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f737fe700 1 -- 172.21.15.154:0/260546260 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c004830 con 0x7f3f8c069560 2023-10-10T21:02:30.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c0cd8a0 con 0x7f3f8c069560 2023-10-10T21:02:30.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.838+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c0cde60 con 0x7f3f8c069560 2023-10-10T21:02:30.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.839+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8c04c3c0 con 0x7f3f8c069560 2023-10-10T21:02:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.840+0000 7f3f737fe700 1 -- 172.21.15.154:0/260546260 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f7c004be0 con 0x7f3f8c069560 2023-10-10T21:02:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.841+0000 7f3f737fe700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3f78066f30 0x7f3f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.842+0000 7f3f737fe700 1 -- 172.21.15.154:0/260546260 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f7c0838f0 con 0x7f3f8c069560 2023-10-10T21:02:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.842+0000 7f3f8affd700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3f78066f30 0x7f3f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.842+0000 7f3f8affd700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3f78066f30 0x7f3f780693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c16cb90 tx=0x7f3f80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:30.846+0000 7f3f737fe700 1 -- 172.21.15.154:0/260546260 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f7c050b40 con 0x7f3f8c069560 2023-10-10T21:02:31.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.040+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f8c06a5b0 con 0x7f3f8c069560 2023-10-10T21:02:31.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.041+0000 7f3f737fe700 1 -- 172.21.15.154:0/260546260 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f3f7c018020 con 0x7f3f8c069560 2023-10-10T21:02:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:31.043 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3f78066f30 msgr2=0x7f3f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3f78066f30 0x7f3f780693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c16cb90 tx=0x7f3f80009040 comp rx=0 tx=0).stop 2023-10-10T21:02:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c069560 msgr2=0x7f3f8c0c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c069560 0x7f3f8c0c91f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00cb70 tx=0x7f3f7c001b50 comp rx=0 tx=0).stop 2023-10-10T21:02:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 shutdown_connections 2023-10-10T21:02:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c159c60 0x7f3f8c154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c069560 0x7f3f8c0c91f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3f78066f30 0x7f3f780693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 --2- 172.21.15.154:0/260546260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c159890 0x7f3f8c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 >> 172.21.15.154:0/260546260 conn(0x7f3f8c068e20 msgr2=0x7f3f8c157cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:31.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 shutdown_connections 2023-10-10T21:02:31.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.044+0000 7f3f91bff700 1 -- 172.21.15.154:0/260546260 wait complete. 2023-10-10T21:02:31.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:02:17.271178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:02:18.145561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:02:31.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:02:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.248+0000 7fd0cb1ff700 1 Processor -- start 2023-10-10T21:02:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.248+0000 7fd0cb1ff700 1 -- start start 2023-10-10T21:02:31.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.249+0000 7fd0cb1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd0c4069e80 0x7fd0c4160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.249+0000 7fd0cb1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c406e950 con 0x7fd0c40c70b0 2023-10-10T21:02:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.249+0000 7fd0cb1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c406eb90 con 0x7fd0c4155eb0 2023-10-10T21:02:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.249+0000 7fd0cb1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c406ee70 con 0x7fd0c4069e80 2023-10-10T21:02:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.249+0000 7fd0c3fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd0c40c70b0 0x7fd0c4069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38592/0 (socket says 172.21.15.154:38592) 2023-10-10T21:02:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.249+0000 7fd0c3fff700 1 -- 172.21.15.154:0/120975553 learned_addr learned my addr 172.21.15.154:0/120975553 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.250+0000 7fd0c979c700 1 --2- 172.21.15.154:0/120975553 >> v2:172.21.15.179:3300/0 conn(0x7fd0c4069e80 0x7fd0c4160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.250+0000 7fd0c37fe700 1 -- 172.21.15.154:0/120975553 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128421590 0 0) 0x7fd0b0001110 con 0x7fd0c40c70b0 2023-10-10T21:02:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.250+0000 7fd0c37fe700 1 -- 172.21.15.154:0/120975553 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b4003570 con 0x7fd0c40c70b0 2023-10-10T21:02:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.250+0000 7fd0c37fe700 1 -- 172.21.15.154:0/120975553 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707903567 0 0) 0x7fd0c406eb90 con 0x7fd0c4155eb0 2023-10-10T21:02:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.250+0000 7fd0c37fe700 1 -- 172.21.15.154:0/120975553 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b0001110 con 0x7fd0c4155eb0 2023-10-10T21:02:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.250+0000 7fd0c979c700 1 -- 172.21.15.154:0/120975553 >> v1:172.21.15.179:6789/0 conn(0x7fd0c4155eb0 legacy=0x7fd0c406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.250+0000 7fd0c979c700 1 -- 172.21.15.154:0/120975553 >> v1:172.21.15.154:6789/0 conn(0x7fd0c40c70b0 legacy=0x7fd0c4069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.250+0000 7fd0c37fe700 1 -- 172.21.15.154:0/120975553 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3917251083 0 0) 0x7fd0b4003570 con 0x7fd0c40c70b0 2023-10-10T21:02:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.250+0000 7fd0c979c700 1 -- 172.21.15.154:0/120975553 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c406f150 con 0x7fd0c4069e80 2023-10-10T21:02:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0c979c700 1 --2- 172.21.15.154:0/120975553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0c4069e80 0x7fd0c4160bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00af70 tx=0x7fd0bc00a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e34a010a11f0262b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:31.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0c37fe700 1 -- 172.21.15.154:0/120975553 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc00f070 con 0x7fd0c4069e80 2023-10-10T21:02:31.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0c37fe700 1 -- 172.21.15.154:0/120975553 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc00a0d0 con 0x7fd0c4069e80 2023-10-10T21:02:31.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0c37fe700 1 -- 172.21.15.154:0/120975553 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0001600 con 0x7fd0c4069e80 2023-10-10T21:02:31.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/120975553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0c4069e80 msgr2=0x7fd0c4160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0cb1ff700 1 --2- 172.21.15.154:0/120975553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0c4069e80 0x7fd0c4160bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00af70 tx=0x7fd0bc00a890 comp rx=0 tx=0).stop 2023-10-10T21:02:31.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/120975553 shutdown_connections 2023-10-10T21:02:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0cb1ff700 1 --2- 172.21.15.154:0/120975553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0c4069e80 0x7fd0c4160bf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/120975553 >> 172.21.15.154:0/120975553 conn(0x7fd0c4068e10 msgr2=0x7fd0c40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/120975553 shutdown_connections 2023-10-10T21:02:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.251+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/120975553 wait complete. 2023-10-10T21:02:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.253+0000 7fd0cb1ff700 1 Processor -- start 2023-10-10T21:02:31.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.253+0000 7fd0cb1ff700 1 -- start start 2023-10-10T21:02:31.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0cb1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0c4069e80 0x7fd0c40c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0cb1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0c40c70b0 0x7fd0c40cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0cb1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0c4155eb0 0x7fd0c40abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0cb1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40cbe70 con 0x7fd0c4155eb0 2023-10-10T21:02:31.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0cb1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40cb8b0 con 0x7fd0c40c70b0 2023-10-10T21:02:31.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0cb1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40cbb90 con 0x7fd0c4069e80 2023-10-10T21:02:31.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c979c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0c4155eb0 0x7fd0c40abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c979c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0c4155eb0 0x7fd0c40abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55940/0 (socket says 172.21.15.154:55940) 2023-10-10T21:02:31.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c979c700 1 -- 172.21.15.154:0/2032984117 learned_addr learned my addr 172.21.15.154:0/2032984117 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:31.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c3fff700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0c40c70b0 0x7fd0c40cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c8f9b700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0c4069e80 0x7fd0c40c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c979c700 1 -- 172.21.15.154:0/2032984117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0c4069e80 msgr2=0x7fd0c40c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c979c700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0c4069e80 0x7fd0c40c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c979c700 1 -- 172.21.15.154:0/2032984117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0c40c70b0 msgr2=0x7fd0c40cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c979c700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0c40c70b0 0x7fd0c40cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.254+0000 7fd0c979c700 1 -- 172.21.15.154:0/2032984117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc00ab30 con 0x7fd0c4155eb0 2023-10-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.255+0000 7fd0c979c700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0c4155eb0 0x7fd0c40abbc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00a5e0 tx=0x7fd0bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.255+0000 7fd0c0ff9700 1 -- 172.21.15.154:0/2032984117 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc009840 con 0x7fd0c4155eb0 2023-10-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.255+0000 7fd0c0ff9700 1 -- 172.21.15.154:0/2032984117 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc0099a0 con 0x7fd0c4155eb0 2023-10-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.255+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c40c4050 con 0x7fd0c4155eb0 2023-10-10T21:02:31.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.255+0000 7fd0c0ff9700 1 -- 172.21.15.154:0/2032984117 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc009d20 con 0x7fd0c4155eb0 2023-10-10T21:02:31.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.255+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c40c66e0 con 0x7fd0c4155eb0 2023-10-10T21:02:31.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.256+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c40c4570 con 0x7fd0c4155eb0 2023-10-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.257+0000 7fd0c0ff9700 1 -- 172.21.15.154:0/2032984117 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0bc01e640 con 0x7fd0c4155eb0 2023-10-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.258+0000 7fd0c0ff9700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd0a8066f30 0x7fd0a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.258+0000 7fd0c0ff9700 1 -- 172.21.15.154:0/2032984117 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd0bc085e00 con 0x7fd0c4155eb0 2023-10-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.258+0000 7fd0c8f9b700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd0a8066f30 0x7fd0a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.259+0000 7fd0c8f9b700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd0a8066f30 0x7fd0a80693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8007fd0 tx=0x7fd0b8007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.262+0000 7fd0c0ff9700 1 -- 172.21.15.154:0/2032984117 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0c40c4570 con 0x7fd0c4155eb0 2023-10-10T21:02:31.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.456+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0c40c4570 con 0x7fd0c4155eb0 2023-10-10T21:02:31.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.457+0000 7fd0c0ff9700 1 -- 172.21.15.154:0/2032984117 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0c40c4570 con 0x7fd0c4155eb0 2023-10-10T21:02:31.458 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:02:31.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd0a8066f30 msgr2=0x7fd0a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd0a8066f30 0x7fd0a80693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8007fd0 tx=0x7fd0b8007d50 comp rx=0 tx=0).stop 2023-10-10T21:02:31.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0c4155eb0 msgr2=0x7fd0c40abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0c4155eb0 0x7fd0c40abbc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00a5e0 tx=0x7fd0bc017000 comp rx=0 tx=0).stop 2023-10-10T21:02:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 shutdown_connections 2023-10-10T21:02:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0c4155eb0 0x7fd0c40abbc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd0a8066f30 0x7fd0a80693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0c4069e80 0x7fd0c40c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 --2- 172.21.15.154:0/2032984117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0c40c70b0 0x7fd0c40cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.459+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 >> 172.21.15.154:0/2032984117 conn(0x7fd0c4068e10 msgr2=0x7fd0c40aaa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.460+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 shutdown_connections 2023-10-10T21:02:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.460+0000 7fd0cb1ff700 1 -- 172.21.15.154:0/2032984117 wait complete. 2023-10-10T21:02:31.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:02:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.662+0000 7f20a1b9d700 1 Processor -- start 2023-10-10T21:02:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.662+0000 7f20a1b9d700 1 -- start start 2023-10-10T21:02:31.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.663+0000 7f20a1b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f209c0c9db0 0x7f209c06a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.663+0000 7f20a1b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209c06e150 con 0x7f209c157130 2023-10-10T21:02:31.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.663+0000 7f20a1b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209c0c7800 con 0x7f209c153900 2023-10-10T21:02:31.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.663+0000 7f20a1b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209c0c7610 con 0x7f209c0c9db0 2023-10-10T21:02:31.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.663+0000 7f209bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f209c0c9db0 0x7f209c06a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.663+0000 7f20a139c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f209c157130 0x7f209c06e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38598/0 (socket says 172.21.15.154:38598) 2023-10-10T21:02:31.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.663+0000 7f20a139c700 1 -- 172.21.15.154:0/2802034268 learned_addr learned my addr 172.21.15.154:0/2802034268 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:31.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209b7fe700 1 -- 172.21.15.154:0/2802034268 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285895972 0 0) 0x7f209c0c7800 con 0x7f209c153900 2023-10-10T21:02:31.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209b7fe700 1 -- 172.21.15.154:0/2802034268 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f208c003570 con 0x7f209c153900 2023-10-10T21:02:31.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209bfff700 1 -- 172.21.15.154:0/2802034268 >> v1:172.21.15.179:6789/0 conn(0x7f209c153900 legacy=0x7f209c0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209bfff700 1 -- 172.21.15.154:0/2802034268 >> v1:172.21.15.154:6789/0 conn(0x7f209c157130 legacy=0x7f209c06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209b7fe700 1 -- 172.21.15.154:0/2802034268 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755113668 0 0) 0x7f209c06e150 con 0x7f209c157130 2023-10-10T21:02:31.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209bfff700 1 -- 172.21.15.154:0/2802034268 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0c7ae0 con 0x7f209c0c9db0 2023-10-10T21:02:31.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209bfff700 1 --2- 172.21.15.154:0/2802034268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c0c9db0 0x7f209c06a000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f20880098e0 tx=0x7f20880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2e3738c19ee17b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:31.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209b7fe700 1 -- 172.21.15.154:0/2802034268 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208800b640 con 0x7f209c0c9db0 2023-10-10T21:02:31.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209b7fe700 1 -- 172.21.15.154:0/2802034268 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208800b7a0 con 0x7f209c0c9db0 2023-10-10T21:02:31.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.664+0000 7f209b7fe700 1 -- 172.21.15.154:0/2802034268 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208800bb40 con 0x7f209c0c9db0 2023-10-10T21:02:31.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.665+0000 7f20a1b9d700 1 -- 172.21.15.154:0/2802034268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c0c9db0 msgr2=0x7f209c06a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.665+0000 7f20a1b9d700 1 --2- 172.21.15.154:0/2802034268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c0c9db0 0x7f209c06a000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f20880098e0 tx=0x7f20880091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.665+0000 7f20a1b9d700 1 -- 172.21.15.154:0/2802034268 shutdown_connections 2023-10-10T21:02:31.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.665+0000 7f20a1b9d700 1 --2- 172.21.15.154:0/2802034268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c0c9db0 0x7f209c06a000 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.665+0000 7f20a1b9d700 1 -- 172.21.15.154:0/2802034268 >> 172.21.15.154:0/2802034268 conn(0x7f209c0cc1e0 msgr2=0x7f209c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:31.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.665+0000 7f20a1b9d700 1 -- 172.21.15.154:0/2802034268 shutdown_connections 2023-10-10T21:02:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.665+0000 7f20a1b9d700 1 -- 172.21.15.154:0/2802034268 wait complete. 2023-10-10T21:02:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.666+0000 7f20a1b9d700 1 Processor -- start 2023-10-10T21:02:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.666+0000 7f20a1b9d700 1 -- start start 2023-10-10T21:02:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.667+0000 7f20a1b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c0c9db0 0x7f209c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.667+0000 7f20a1b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c153900 0x7f209c14b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.667+0000 7f20a1b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c157130 0x7f209c0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.667+0000 7f20a1b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0c1ec0 con 0x7f209c157130 2023-10-10T21:02:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.667+0000 7f20a1b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0c12b0 con 0x7f209c0c9db0 2023-10-10T21:02:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.667+0000 7f20a1b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0c1590 con 0x7f209c153900 2023-10-10T21:02:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c157130 0x7f209c0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c157130 0x7f209c0afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55968/0 (socket says 172.21.15.154:55968) 2023-10-10T21:02:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a139c700 1 -- 172.21.15.154:0/507128673 learned_addr learned my addr 172.21.15.154:0/507128673 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f209bfff700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c153900 0x7f209c14b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a0b9b700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c0c9db0 0x7f209c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a139c700 1 -- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c153900 msgr2=0x7f209c14b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a139c700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c153900 0x7f209c14b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a139c700 1 -- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c0c9db0 msgr2=0x7f209c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a139c700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c0c9db0 0x7f209c0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a139c700 1 -- 172.21.15.154:0/507128673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088009420 con 0x7f209c157130 2023-10-10T21:02:31.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a0b9b700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c0c9db0 0x7f209c0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:31.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f209bfff700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c153900 0x7f209c14b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:31.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a139c700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c157130 0x7f209c0afa40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f209400bc30 tx=0x7f2094009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:31.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f2098ff9700 1 -- 172.21.15.154:0/507128673 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209400c9b0 con 0x7f209c157130 2023-10-10T21:02:31.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f2098ff9700 1 -- 172.21.15.154:0/507128673 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209400cb50 con 0x7f209c157130 2023-10-10T21:02:31.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f2098ff9700 1 -- 172.21.15.154:0/507128673 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094014440 con 0x7f209c157130 2023-10-10T21:02:31.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.668+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209c0c1870 con 0x7f209c157130 2023-10-10T21:02:31.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.669+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209c14b670 con 0x7f209c157130 2023-10-10T21:02:31.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.669+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209c06c450 con 0x7f209c157130 2023-10-10T21:02:31.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.670+0000 7f2098ff9700 1 -- 172.21.15.154:0/507128673 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2094014830 con 0x7f209c157130 2023-10-10T21:02:31.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.671+0000 7f2098ff9700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2080066f30 0x7f20800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:31.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.671+0000 7f2098ff9700 1 -- 172.21.15.154:0/507128673 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20940843e0 con 0x7f209c157130 2023-10-10T21:02:31.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.671+0000 7f20a0b9b700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2080066f30 0x7f20800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:31.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.672+0000 7f20a0b9b700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2080066f30 0x7f20800693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2090007fd0 tx=0x7f2090009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:31.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.675+0000 7f2098ff9700 1 -- 172.21.15.154:0/507128673 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f209404d5a0 con 0x7f209c157130 2023-10-10T21:02:31.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.865+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f209c0c7dc0 con 0x7f209c157130 2023-10-10T21:02:31.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.865+0000 7f2098ff9700 1 -- 172.21.15.154:0/507128673 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2094051660 con 0x7f209c157130 2023-10-10T21:02:31.867 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:02:31.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.867+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2080066f30 msgr2=0x7f20800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.867+0000 7f20a1b9d700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2080066f30 0x7f20800693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2090007fd0 tx=0x7f2090009040 comp rx=0 tx=0).stop 2023-10-10T21:02:31.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.867+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c157130 msgr2=0x7f209c0afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:31.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.867+0000 7f20a1b9d700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c157130 0x7f209c0afa40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f209400bc30 tx=0x7f2094009800 comp rx=0 tx=0).stop 2023-10-10T21:02:31.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.868+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 shutdown_connections 2023-10-10T21:02:31.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.868+0000 7f20a1b9d700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f209c157130 0x7f209c0afa40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.868+0000 7f20a1b9d700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f209c0c9db0 0x7f209c0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.868+0000 7f20a1b9d700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2080066f30 0x7f20800693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.868+0000 7f20a1b9d700 1 --2- 172.21.15.154:0/507128673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f209c153900 0x7f209c14b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:31.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.868+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 >> 172.21.15.154:0/507128673 conn(0x7f209c0cc1e0 msgr2=0x7f209c069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:31.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.868+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 shutdown_connections 2023-10-10T21:02:31.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:31.868+0000 7f20a1b9d700 1 -- 172.21.15.154:0/507128673 wait complete. 2023-10-10T21:02:31.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:02:32.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.074+0000 7fc1f03ff700 1 Processor -- start 2023-10-10T21:02:32.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.074+0000 7fc1f03ff700 1 -- start start 2023-10-10T21:02:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.075+0000 7fc1f03ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1e8159890 0x7fc1e815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.075+0000 7fc1f03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159c60 0x7fc1e815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.075+0000 7fc1f03ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc1e815db10 0x7fc1e8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.075+0000 7fc1f03ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e815a160 con 0x7fc1e8159890 2023-10-10T21:02:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.075+0000 7fc1f03ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e80d13a0 con 0x7fc1e815db10 2023-10-10T21:02:32.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.075+0000 7fc1f03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e815e140 con 0x7fc1e8159c60 2023-10-10T21:02:32.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1e8159890 0x7fc1e815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1e8159890 0x7fc1e815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55980/0 (socket says 172.21.15.154:55980) 2023-10-10T21:02:32.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee19b700 1 -- 172.21.15.154:0/3741286047 learned_addr learned my addr 172.21.15.154:0/3741286047 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:32.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ed99a700 1 --2- 172.21.15.154:0/3741286047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159c60 0x7fc1e815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee99c700 1 --2- 172.21.15.154:0/3741286047 >> v2:172.21.15.179:3300/0 conn(0x7fc1e815db10 0x7fc1e8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee19b700 1 -- 172.21.15.154:0/3741286047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159c60 msgr2=0x7fc1e815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:32.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee19b700 1 --2- 172.21.15.154:0/3741286047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159c60 0x7fc1e815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee19b700 1 -- 172.21.15.154:0/3741286047 >> v2:172.21.15.179:3300/0 conn(0x7fc1e815db10 msgr2=0x7fc1e8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:32.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee19b700 1 --2- 172.21.15.154:0/3741286047 >> v2:172.21.15.179:3300/0 conn(0x7fc1e815db10 0x7fc1e8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee19b700 1 -- 172.21.15.154:0/3741286047 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e815a3d0 con 0x7fc1e8159890 2023-10-10T21:02:32.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.076+0000 7fc1ee19b700 1 --2- 172.21.15.154:0/3741286047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159890 0x7fc1e815abd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8089b50 tx=0x7fc1e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a2aaf46a83f1c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:32.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1ed199700 1 -- 172.21.15.154:0/3741286047 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e400b860 con 0x7fc1e8159890 2023-10-10T21:02:32.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1ed199700 1 -- 172.21.15.154:0/3741286047 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e400b9c0 con 0x7fc1e8159890 2023-10-10T21:02:32.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1ed199700 1 -- 172.21.15.154:0/3741286047 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e400bd60 con 0x7fc1e8159890 2023-10-10T21:02:32.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1f03ff700 1 -- 172.21.15.154:0/3741286047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159890 msgr2=0x7fc1e815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/3741286047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159890 0x7fc1e815abd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8089b50 tx=0x7fc1e4009250 comp rx=0 tx=0).stop 2023-10-10T21:02:32.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1f03ff700 1 -- 172.21.15.154:0/3741286047 shutdown_connections 2023-10-10T21:02:32.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/3741286047 >> v2:172.21.15.179:3300/0 conn(0x7fc1e815db10 0x7fc1e8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/3741286047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159890 0x7fc1e815abd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/3741286047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159c60 0x7fc1e815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1f03ff700 1 -- 172.21.15.154:0/3741286047 >> 172.21.15.154:0/3741286047 conn(0x7fc1e8068e20 msgr2=0x7fc1e80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:32.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1f03ff700 1 -- 172.21.15.154:0/3741286047 shutdown_connections 2023-10-10T21:02:32.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.077+0000 7fc1f03ff700 1 -- 172.21.15.154:0/3741286047 wait complete. 2023-10-10T21:02:32.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.079+0000 7fc1f03ff700 1 Processor -- start 2023-10-10T21:02:32.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.079+0000 7fc1f03ff700 1 -- start start 2023-10-10T21:02:32.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1f03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159890 0x7fc1e8152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1f03ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159c60 0x7fc1e8169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1f03ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e815db10 0x7fc1e80b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1f03ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8152d40 con 0x7fc1e8159c60 2023-10-10T21:02:32.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1f03ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e816b220 con 0x7fc1e815db10 2023-10-10T21:02:32.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1f03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e816ab50 con 0x7fc1e8159890 2023-10-10T21:02:32.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ed99a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159c60 0x7fc1e8169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ed99a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159c60 0x7fc1e8169bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55996/0 (socket says 172.21.15.154:55996) 2023-10-10T21:02:32.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ed99a700 1 -- 172.21.15.154:0/1884485786 learned_addr learned my addr 172.21.15.154:0/1884485786 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:32.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ee19b700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159890 0x7fc1e8152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ed99a700 1 -- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159890 msgr2=0x7fc1e8152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ee99c700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e815db10 0x7fc1e80b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ed99a700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159890 0x7fc1e8152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ed99a700 1 -- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e815db10 msgr2=0x7fc1e80b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ed99a700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e815db10 0x7fc1e80b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ed99a700 1 -- 172.21.15.154:0/1884485786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e40094f0 con 0x7fc1e8159c60 2023-10-10T21:02:32.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ee19b700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159890 0x7fc1e8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:32.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.080+0000 7fc1ee99c700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e815db10 0x7fc1e80b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:32.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.081+0000 7fc1ed99a700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159c60 0x7fc1e8169bb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800d890 tx=0x7fc1d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:32.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.081+0000 7fc1de7fc700 1 -- 172.21.15.154:0/1884485786 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800b600 con 0x7fc1e8159c60 2023-10-10T21:02:32.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.081+0000 7fc1de7fc700 1 -- 172.21.15.154:0/1884485786 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d800b760 con 0x7fc1e8159c60 2023-10-10T21:02:32.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.081+0000 7fc1de7fc700 1 -- 172.21.15.154:0/1884485786 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800bb00 con 0x7fc1e8159c60 2023-10-10T21:02:32.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.081+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e816a590 con 0x7fc1e8159c60 2023-10-10T21:02:32.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.081+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e816aeb0 con 0x7fc1e8159c60 2023-10-10T21:02:32.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.082+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e816b3b0 con 0x7fc1e8159c60 2023-10-10T21:02:32.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.083+0000 7fc1de7fc700 1 -- 172.21.15.154:0/1884485786 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1d801e460 con 0x7fc1e8159c60 2023-10-10T21:02:32.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.084+0000 7fc1de7fc700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc1cc066f30 0x7fc1cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.084+0000 7fc1de7fc700 1 -- 172.21.15.154:0/1884485786 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc1d8084bb0 con 0x7fc1e8159c60 2023-10-10T21:02:32.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.084+0000 7fc1ee19b700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc1cc066f30 0x7fc1cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.085+0000 7fc1ee19b700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc1cc066f30 0x7fc1cc0693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8089b50 tx=0x7fc1e4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:32.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.088+0000 7fc1de7fc700 1 -- 172.21.15.154:0/1884485786 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1d8051e20 con 0x7fc1e8159c60 2023-10-10T21:02:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.279+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1e804c3c0 con 0x7fc1e8159c60 2023-10-10T21:02:32.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.279+0000 7fc1de7fc700 1 -- 172.21.15.154:0/1884485786 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1d8055440 con 0x7fc1e8159c60 2023-10-10T21:02:32.281 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:02:32.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc1cc066f30 msgr2=0x7fc1cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc1cc066f30 0x7fc1cc0693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8089b50 tx=0x7fc1e4017000 comp rx=0 tx=0).stop 2023-10-10T21:02:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159c60 msgr2=0x7fc1e8169bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159c60 0x7fc1e8169bb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800d890 tx=0x7fc1d8008040 comp rx=0 tx=0).stop 2023-10-10T21:02:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 shutdown_connections 2023-10-10T21:02:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e815db10 0x7fc1e80b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc1cc066f30 0x7fc1cc0693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e8159890 0x7fc1e8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 --2- 172.21.15.154:0/1884485786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1e8159c60 0x7fc1e8169bb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 >> 172.21.15.154:0/1884485786 conn(0x7fc1e8068e20 msgr2=0x7fc1e8153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:32.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 shutdown_connections 2023-10-10T21:02:32.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.282+0000 7fc1f03ff700 1 -- 172.21.15.154:0/1884485786 wait complete. 2023-10-10T21:02:32.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:02:32.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.481+0000 7f85d6b9d700 1 Processor -- start 2023-10-10T21:02:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.482+0000 7f85d6b9d700 1 -- start start 2023-10-10T21:02:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.483+0000 7f85d6b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d00ad870 0x7f85d006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.483+0000 7f85d6b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85d006bf20 0x7f85d006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.483+0000 7f85d6b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d006c350 con 0x7f85d0142ea0 2023-10-10T21:02:32.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.483+0000 7f85d6b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d00b40f0 con 0x7f85d006bf20 2023-10-10T21:02:32.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.483+0000 7f85d6b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0069640 con 0x7f85d00ad870 2023-10-10T21:02:32.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.483+0000 7f85d639c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85d006bf20 0x7f85d006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.483+0000 7f85d639c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85d006bf20 0x7f85d006a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56010/0 (socket says 172.21.15.154:56010) 2023-10-10T21:02:32.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.483+0000 7f85d639c700 1 -- 172.21.15.154:0/1908271686 learned_addr learned my addr 172.21.15.154:0/1908271686 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:32.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.483+0000 7f85d539a700 1 --2- 172.21.15.154:0/1908271686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d00ad870 0x7f85d006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.484+0000 7f85d639c700 1 -- 172.21.15.154:0/1908271686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d00ad870 msgr2=0x7f85d006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:32.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.484+0000 7f85d639c700 1 --2- 172.21.15.154:0/1908271686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d00ad870 0x7f85d006b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.484+0000 7f85d639c700 1 -- 172.21.15.154:0/1908271686 >> v1:172.21.15.179:6789/0 conn(0x7f85d0142ea0 legacy=0x7f85d00b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.484+0000 7f85d639c700 1 -- 172.21.15.154:0/1908271686 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0069920 con 0x7f85d006bf20 2023-10-10T21:02:32.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.484+0000 7f85d639c700 1 --2- 172.21.15.154:0/1908271686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d006bf20 0x7f85d006a120 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009f20 tx=0x7f85c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b68aad9bbb0b7d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:32.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.484+0000 7f85d4b99700 1 -- 172.21.15.154:0/1908271686 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c800e070 con 0x7f85d006bf20 2023-10-10T21:02:32.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.484+0000 7f85d4b99700 1 -- 172.21.15.154:0/1908271686 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c800ba80 con 0x7f85d006bf20 2023-10-10T21:02:32.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.484+0000 7f85d4b99700 1 -- 172.21.15.154:0/1908271686 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80092e0 con 0x7f85d006bf20 2023-10-10T21:02:32.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.485+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1908271686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d006bf20 msgr2=0x7f85d006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.485+0000 7f85d6b9d700 1 --2- 172.21.15.154:0/1908271686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d006bf20 0x7f85d006a120 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009f20 tx=0x7f85c8009840 comp rx=0 tx=0).stop 2023-10-10T21:02:32.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.485+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1908271686 shutdown_connections 2023-10-10T21:02:32.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.485+0000 7f85d6b9d700 1 --2- 172.21.15.154:0/1908271686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d006bf20 0x7f85d006a120 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.485+0000 7f85d6b9d700 1 --2- 172.21.15.154:0/1908271686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d00ad870 0x7f85d006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.485+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1908271686 >> 172.21.15.154:0/1908271686 conn(0x7f85d00ce430 msgr2=0x7f85d00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:32.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.485+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1908271686 shutdown_connections 2023-10-10T21:02:32.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.485+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1908271686 wait complete. 2023-10-10T21:02:32.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.486+0000 7f85d6b9d700 1 Processor -- start 2023-10-10T21:02:32.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.486+0000 7f85d6b9d700 1 -- start start 2023-10-10T21:02:32.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.487+0000 7f85d6b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d006bf20 0x7f85d01585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.487+0000 7f85d6b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d0142ea0 0x7f85d016abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.487+0000 7f85d6b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d013a3b0 0x7f85d013a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.487+0000 7f85d6b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00affc0 con 0x7f85d013a3b0 2023-10-10T21:02:32.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.487+0000 7f85d6b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d013ad60 con 0x7f85d006bf20 2023-10-10T21:02:32.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.487+0000 7f85d6b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0169a60 con 0x7f85d0142ea0 2023-10-10T21:02:32.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d639c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d013a3b0 0x7f85d013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d639c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d013a3b0 0x7f85d013a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56020/0 (socket says 172.21.15.154:56020) 2023-10-10T21:02:32.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d639c700 1 -- 172.21.15.154:0/1769592526 learned_addr learned my addr 172.21.15.154:0/1769592526 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:32.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d539a700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d0142ea0 0x7f85d016abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d5b9b700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d006bf20 0x7f85d01585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d639c700 1 -- 172.21.15.154:0/1769592526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d0142ea0 msgr2=0x7f85d016abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d639c700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d0142ea0 0x7f85d016abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d639c700 1 -- 172.21.15.154:0/1769592526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d006bf20 msgr2=0x7f85d01585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d639c700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d006bf20 0x7f85d01585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d639c700 1 -- 172.21.15.154:0/1769592526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8009ae0 con 0x7f85d013a3b0 2023-10-10T21:02:32.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d639c700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d013a3b0 0x7f85d013a820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009430 tx=0x7f85c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:32.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85c5ffb700 1 -- 172.21.15.154:0/1769592526 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80032f0 con 0x7f85d013a3b0 2023-10-10T21:02:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85c5ffb700 1 -- 172.21.15.154:0/1769592526 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c8008e70 con 0x7f85d013a3b0 2023-10-10T21:02:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d00af440 con 0x7f85d013a3b0 2023-10-10T21:02:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.488+0000 7f85c5ffb700 1 -- 172.21.15.154:0/1769592526 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8026670 con 0x7f85d013a3b0 2023-10-10T21:02:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.489+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d00afa00 con 0x7f85d013a3b0 2023-10-10T21:02:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.490+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d015f010 con 0x7f85d013a3b0 2023-10-10T21:02:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.490+0000 7f85c5ffb700 1 -- 172.21.15.154:0/1769592526 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85c8003040 con 0x7f85d013a3b0 2023-10-10T21:02:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.491+0000 7f85c5ffb700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f85b4066f30 0x7f85b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.491+0000 7f85c5ffb700 1 -- 172.21.15.154:0/1769592526 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f85c80865e0 con 0x7f85d013a3b0 2023-10-10T21:02:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.491+0000 7f85d5b9b700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f85b4066f30 0x7f85b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.492+0000 7f85d5b9b700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f85b4066f30 0x7f85b40693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85d013e540 tx=0x7f85cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:32.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.495+0000 7f85c5ffb700 1 -- 172.21.15.154:0/1769592526 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85c80537b0 con 0x7f85d013a3b0 2023-10-10T21:02:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.728+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85d004bb80 con 0x7f85d013a3b0 2023-10-10T21:02:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.729+0000 7f85c5ffb700 1 -- 172.21.15.154:0/1769592526 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f85c8056dd0 con 0x7f85d013a3b0 2023-10-10T21:02:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:32.731 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439513038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439513038},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439513038}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1179223321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1179223321},{"type":"v1","addr":"172.21.15.154:6836","nonce":1179223321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4116873553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4116873553},{"type":"v1","addr":"172.21.15.179:6835","nonce":4116873553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:02:19.159716+0000","modified":"2023-10-10T21:02:22.851729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6833/2053231138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2053231138},{"type":"v1","addr":"172.21.15.179:6833","nonce":2053231138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-10T21:02:32.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.731+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f85b4066f30 msgr2=0x7f85b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f85b4066f30 0x7f85b40693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85d013e540 tx=0x7f85cc009040 comp rx=0 tx=0).stop 2023-10-10T21:02:32.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d013a3b0 msgr2=0x7f85d013a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d013a3b0 0x7f85d013a820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009430 tx=0x7f85c8018000 comp rx=0 tx=0).stop 2023-10-10T21:02:32.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 shutdown_connections 2023-10-10T21:02:32.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85d013a3b0 0x7f85d013a820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d006bf20 0x7f85d01585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f85b4066f30 0x7f85b40693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 --2- 172.21.15.154:0/1769592526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d0142ea0 0x7f85d016abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 >> 172.21.15.154:0/1769592526 conn(0x7f85d00ce430 msgr2=0x7f85d0142080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:32.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 shutdown_connections 2023-10-10T21:02:32.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.732+0000 7f85d6b9d700 1 -- 172.21.15.154:0/1769592526 wait complete. 2023-10-10T21:02:32.736 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-10-10T21:02:32.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:32.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.932+0000 7feb91dff700 1 Processor -- start 2023-10-10T21:02:32.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.932+0000 7feb91dff700 1 -- start start 2023-10-10T21:02:32.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.933+0000 7feb91dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c0ccf90 0x7feb8c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.933+0000 7feb91dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0cc300 con 0x7feb8c0cbf30 2023-10-10T21:02:32.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.933+0000 7feb91dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0ad370 con 0x7feb8c0b1420 2023-10-10T21:02:32.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.933+0000 7feb91dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c156bf0 con 0x7feb8c0ccf90 2023-10-10T21:02:32.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7feb8c0cbf30 0x7feb8c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38602/0 (socket says 172.21.15.154:38602) 2023-10-10T21:02:32.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8b7fe700 1 -- 172.21.15.154:0/2700359768 learned_addr learned my addr 172.21.15.154:0/2700359768 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:32.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488567754 0 0) 0x7feb8c0cc300 con 0x7feb8c0cbf30 2023-10-10T21:02:32.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb74003570 con 0x7feb8c0cbf30 2023-10-10T21:02:32.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8bfff700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c0ccf90 0x7feb8c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 277925451 0 0) 0x7feb74003570 con 0x7feb8c0cbf30 2023-10-10T21:02:32.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c0ccf90 msgr2=0x7feb8c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:32.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c0ccf90 0x7feb8c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 >> v1:172.21.15.179:6789/0 conn(0x7feb8c0b1420 legacy=0x7feb8c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0ad650 con 0x7feb8c0cbf30 2023-10-10T21:02:32.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7feb7c001470 con 0x7feb8c0cbf30 2023-10-10T21:02:32.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 >> v1:172.21.15.154:6789/0 conn(0x7feb8c0cbf30 legacy=0x7feb8c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74003a90 0x7feb74003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c0ccf90 0x7feb74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb74004d50 0x7feb740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c156bf0 con 0x7feb74004d50 2023-10-10T21:02:32.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7400bb70 con 0x7feb74003a90 2023-10-10T21:02:32.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.934+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7400df40 con 0x7feb8c0ccf90 2023-10-10T21:02:32.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8bfff700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb74004d50 0x7feb740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8b7fe700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74003a90 0x7feb74003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8affd700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c0ccf90 0x7feb74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8bfff700 1 -- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c0ccf90 msgr2=0x7feb74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:32.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8bfff700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c0ccf90 0x7feb74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8bfff700 1 -- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74003a90 msgr2=0x7feb74003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:32.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8bfff700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74003a90 0x7feb74003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8bfff700 1 -- 172.21.15.154:0/2700359768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74003570 con 0x7feb74004d50 2023-10-10T21:02:32.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8bfff700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb74004d50 0x7feb740051c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb8400e210 tx=0x7feb8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9baa5147270a540 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:32.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8400eac0 con 0x7feb74004d50 2023-10-10T21:02:32.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.935+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8400f040 con 0x7feb74004d50 2023-10-10T21:02:32.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.936+0000 7feb8a7fc700 1 -- 172.21.15.154:0/2700359768 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8400ee70 con 0x7feb74004d50 2023-10-10T21:02:32.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.936+0000 7feb91dff700 1 -- 172.21.15.154:0/2700359768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb74004d50 msgr2=0x7feb740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.936+0000 7feb91dff700 1 --2- 172.21.15.154:0/2700359768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb74004d50 0x7feb740051c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb8400e210 tx=0x7feb8400b040 comp rx=0 tx=0).stop 2023-10-10T21:02:32.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.936+0000 7feb8bfff700 1 -- 172.21.15.154:0/2700359768 reap_dead start 2023-10-10T21:02:32.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.936+0000 7feb91dff700 1 -- 172.21.15.154:0/2700359768 shutdown_connections 2023-10-10T21:02:32.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.936+0000 7feb91dff700 1 -- 172.21.15.154:0/2700359768 >> 172.21.15.154:0/2700359768 conn(0x7feb8c06a320 msgr2=0x7feb8c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:32.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.936+0000 7feb91dff700 1 -- 172.21.15.154:0/2700359768 shutdown_connections 2023-10-10T21:02:32.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.936+0000 7feb91dff700 1 -- 172.21.15.154:0/2700359768 wait complete. 2023-10-10T21:02:32.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.938+0000 7feb91dff700 1 Processor -- start 2023-10-10T21:02:32.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.938+0000 7feb91dff700 1 -- start start 2023-10-10T21:02:32.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb91dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74004d50 0x7feb8c0a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb91dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c154a50 0x7feb8c16a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb91dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb8c159b60 0x7feb8c159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb91dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c15a520 con 0x7feb8c159b60 2023-10-10T21:02:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb91dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c16aa60 con 0x7feb74004d50 2023-10-10T21:02:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb91dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0c1400 con 0x7feb8c154a50 2023-10-10T21:02:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb8c159b60 0x7feb8c159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb8c159b60 0x7feb8c159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56042/0 (socket says 172.21.15.154:56042) 2023-10-10T21:02:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8bfff700 1 -- 172.21.15.154:0/2642449931 learned_addr learned my addr 172.21.15.154:0/2642449931 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8b7fe700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74004d50 0x7feb8c0a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8affd700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c154a50 0x7feb8c16a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8bfff700 1 -- 172.21.15.154:0/2642449931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c154a50 msgr2=0x7feb8c16a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8bfff700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c154a50 0x7feb8c16a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8bfff700 1 -- 172.21.15.154:0/2642449931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74004d50 msgr2=0x7feb8c0a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8bfff700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74004d50 0x7feb8c0a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8bfff700 1 -- 172.21.15.154:0/2642449931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0a9eb0 con 0x7feb8c159b60 2023-10-10T21:02:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8affd700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c154a50 0x7feb8c16a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.939+0000 7feb8bfff700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb8c159b60 0x7feb8c159fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb84002230 tx=0x7feb8401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.940+0000 7feb737fe700 1 -- 172.21.15.154:0/2642449931 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8401d630 con 0x7feb8c159b60 2023-10-10T21:02:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.940+0000 7feb737fe700 1 -- 172.21.15.154:0/2642449931 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8401d7b0 con 0x7feb8c159b60 2023-10-10T21:02:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.940+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c0aa190 con 0x7feb8c159b60 2023-10-10T21:02:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.940+0000 7feb737fe700 1 -- 172.21.15.154:0/2642449931 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8401db70 con 0x7feb8c159b60 2023-10-10T21:02:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.940+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c0aa750 con 0x7feb8c159b60 2023-10-10T21:02:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.941+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c0c15b0 con 0x7feb8c159b60 2023-10-10T21:02:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.942+0000 7feb737fe700 1 -- 172.21.15.154:0/2642449931 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb84003040 con 0x7feb8c159b60 2023-10-10T21:02:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.943+0000 7feb737fe700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7feb78066f30 0x7feb780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.943+0000 7feb737fe700 1 -- 172.21.15.154:0/2642449931 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb84085b50 con 0x7feb8c159b60 2023-10-10T21:02:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.943+0000 7feb8b7fe700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7feb78066f30 0x7feb780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.944+0000 7feb8b7fe700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7feb78066f30 0x7feb780693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb7c000c00 tx=0x7feb7c001e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:32.947+0000 7feb737fe700 1 -- 172.21.15.154:0/2642449931 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb8c0c15b0 con 0x7feb8c159b60 2023-10-10T21:02:33.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.141+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb8c0c15b0 con 0x7feb8c159b60 2023-10-10T21:02:33.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.142+0000 7feb737fe700 1 -- 172.21.15.154:0/2642449931 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7feb8c0c15b0 con 0x7feb8c159b60 2023-10-10T21:02:33.143 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:33.144 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:33.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7feb78066f30 msgr2=0x7feb780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7feb78066f30 0x7feb780693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb7c000c00 tx=0x7feb7c001e50 comp rx=0 tx=0).stop 2023-10-10T21:02:33.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb8c159b60 msgr2=0x7feb8c159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb8c159b60 0x7feb8c159fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb84002230 tx=0x7feb8401a000 comp rx=0 tx=0).stop 2023-10-10T21:02:33.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 shutdown_connections 2023-10-10T21:02:33.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb8c159b60 0x7feb8c159fe0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74004d50 0x7feb8c0a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7feb78066f30 0x7feb780693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 --2- 172.21.15.154:0/2642449931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb8c154a50 0x7feb8c16a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 >> 172.21.15.154:0/2642449931 conn(0x7feb8c06a320 msgr2=0x7feb8c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:33.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.144+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 shutdown_connections 2023-10-10T21:02:33.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.145+0000 7feb91dff700 1 -- 172.21.15.154:0/2642449931 wait complete. 2023-10-10T21:02:33.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:02:17.271178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:02:18.145561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:02:33.164 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:02:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.348+0000 7fe1f85ff700 1 Processor -- start 2023-10-10T21:02:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.348+0000 7fe1f85ff700 1 -- start start 2023-10-10T21:02:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.349+0000 7fe1f85ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1f0159890 0x7fe1f015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.349+0000 7fe1f85ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe1f0159c60 0x7fe1f015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.349+0000 7fe1f85ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f015a160 con 0x7fe1f015db10 2023-10-10T21:02:33.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.349+0000 7fe1f85ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f015df50 con 0x7fe1f0159890 2023-10-10T21:02:33.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.349+0000 7fe1f85ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f00d13a0 con 0x7fe1f0159c60 2023-10-10T21:02:33.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.349+0000 7fe1f639b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1f0159890 0x7fe1f015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f639b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1f0159890 0x7fe1f015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56056/0 (socket says 172.21.15.154:56056) 2023-10-10T21:02:33.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f639b700 1 -- 172.21.15.154:0/2582316452 learned_addr learned my addr 172.21.15.154:0/2582316452 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:33.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f5b9a700 1 --2- 172.21.15.154:0/2582316452 >> v2:172.21.15.179:3300/0 conn(0x7fe1f0159c60 0x7fe1f015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f639b700 1 -- 172.21.15.154:0/2582316452 >> v2:172.21.15.179:3300/0 conn(0x7fe1f0159c60 msgr2=0x7fe1f015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:33.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f639b700 1 --2- 172.21.15.154:0/2582316452 >> v2:172.21.15.179:3300/0 conn(0x7fe1f0159c60 0x7fe1f015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f639b700 1 -- 172.21.15.154:0/2582316452 >> v1:172.21.15.179:6789/0 conn(0x7fe1f015db10 legacy=0x7fe1f0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f639b700 1 -- 172.21.15.154:0/2582316452 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f015e140 con 0x7fe1f0159890 2023-10-10T21:02:33.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f639b700 1 --2- 172.21.15.154:0/2582316452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 0x7fe1f015abd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00b67f0 tx=0x7fe1ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594de10c2aadd551 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:33.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f5399700 1 -- 172.21.15.154:0/2582316452 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec009e70 con 0x7fe1f0159890 2023-10-10T21:02:33.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f5399700 1 -- 172.21.15.154:0/2582316452 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec00b860 con 0x7fe1f0159890 2023-10-10T21:02:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.350+0000 7fe1f5399700 1 -- 172.21.15.154:0/2582316452 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec00bc00 con 0x7fe1f0159890 2023-10-10T21:02:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.351+0000 7fe1f85ff700 1 -- 172.21.15.154:0/2582316452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 msgr2=0x7fe1f015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.351+0000 7fe1f85ff700 1 --2- 172.21.15.154:0/2582316452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 0x7fe1f015abd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00b67f0 tx=0x7fe1ec009250 comp rx=0 tx=0).stop 2023-10-10T21:02:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.351+0000 7fe1f85ff700 1 -- 172.21.15.154:0/2582316452 shutdown_connections 2023-10-10T21:02:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.351+0000 7fe1f85ff700 1 --2- 172.21.15.154:0/2582316452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 0x7fe1f015abd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.351+0000 7fe1f85ff700 1 --2- 172.21.15.154:0/2582316452 >> v2:172.21.15.179:3300/0 conn(0x7fe1f0159c60 0x7fe1f015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.351+0000 7fe1f85ff700 1 -- 172.21.15.154:0/2582316452 >> 172.21.15.154:0/2582316452 conn(0x7fe1f0068e20 msgr2=0x7fe1f00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.351+0000 7fe1f85ff700 1 -- 172.21.15.154:0/2582316452 shutdown_connections 2023-10-10T21:02:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.351+0000 7fe1f85ff700 1 -- 172.21.15.154:0/2582316452 wait complete. 2023-10-10T21:02:33.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.352+0000 7fe1f85ff700 1 Processor -- start 2023-10-10T21:02:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.353+0000 7fe1f85ff700 1 -- start start 2023-10-10T21:02:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.353+0000 7fe1f85ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 0x7fe1f0144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.353+0000 7fe1f85ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f0159c60 0x7fe1f016d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f85ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015db10 0x7fe1f00b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f85ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00c7c70 con 0x7fe1f0159890 2023-10-10T21:02:33.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f85ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00c7940 con 0x7fe1f0159c60 2023-10-10T21:02:33.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f85ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f016db70 con 0x7fe1f015db10 2023-10-10T21:02:33.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f639b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 0x7fe1f0144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f639b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 0x7fe1f0144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56072/0 (socket says 172.21.15.154:56072) 2023-10-10T21:02:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f639b700 1 -- 172.21.15.154:0/3127120787 learned_addr learned my addr 172.21.15.154:0/3127120787 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f5b9a700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f0159c60 0x7fe1f016d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f6b9c700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015db10 0x7fe1f00b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f639b700 1 -- 172.21.15.154:0/3127120787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015db10 msgr2=0x7fe1f00b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f639b700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015db10 0x7fe1f00b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f639b700 1 -- 172.21.15.154:0/3127120787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f0159c60 msgr2=0x7fe1f016d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f639b700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f0159c60 0x7fe1f016d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f639b700 1 -- 172.21.15.154:0/3127120787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec0094f0 con 0x7fe1f0159890 2023-10-10T21:02:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f5b9a700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f0159c60 0x7fe1f016d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.354+0000 7fe1f639b700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 0x7fe1f0144130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0070e20 tx=0x7fe1ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.355+0000 7fe1e67fc700 1 -- 172.21.15.154:0/3127120787 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec011420 con 0x7fe1f0159890 2023-10-10T21:02:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.355+0000 7fe1e67fc700 1 -- 172.21.15.154:0/3127120787 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec011580 con 0x7fe1f0159890 2023-10-10T21:02:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.355+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f016de50 con 0x7fe1f0159890 2023-10-10T21:02:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.355+0000 7fe1e67fc700 1 -- 172.21.15.154:0/3127120787 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec011940 con 0x7fe1f0159890 2023-10-10T21:02:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.355+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f0144670 con 0x7fe1f0159890 2023-10-10T21:02:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.356+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f004c3c0 con 0x7fe1f0159890 2023-10-10T21:02:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.357+0000 7fe1e67fc700 1 -- 172.21.15.154:0/3127120787 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1ec02c3b0 con 0x7fe1f0159890 2023-10-10T21:02:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.358+0000 7fe1e67fc700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe1d4066f30 0x7fe1d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.358+0000 7fe1e67fc700 1 -- 172.21.15.154:0/3127120787 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1ec085c80 con 0x7fe1f0159890 2023-10-10T21:02:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.358+0000 7fe1f5b9a700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe1d4066f30 0x7fe1d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.359+0000 7fe1f5b9a700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe1d4066f30 0x7fe1d40693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00cacd0 tx=0x7fe1e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:33.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.362+0000 7fe1e67fc700 1 -- 172.21.15.154:0/3127120787 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1ec052e50 con 0x7fe1f0159890 2023-10-10T21:02:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.554+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1f006a5b0 con 0x7fe1f0159890 2023-10-10T21:02:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.554+0000 7fe1e67fc700 1 -- 172.21.15.154:0/3127120787 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1ec056470 con 0x7fe1f0159890 2023-10-10T21:02:33.556 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:02:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe1d4066f30 msgr2=0x7fe1d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe1d4066f30 0x7fe1d40693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00cacd0 tx=0x7fe1e0008040 comp rx=0 tx=0).stop 2023-10-10T21:02:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 msgr2=0x7fe1f0144130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 0x7fe1f0144130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0070e20 tx=0x7fe1ec017000 comp rx=0 tx=0).stop 2023-10-10T21:02:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 shutdown_connections 2023-10-10T21:02:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe1d4066f30 0x7fe1d40693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015db10 0x7fe1f00b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1f0159890 0x7fe1f0144130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 --2- 172.21.15.154:0/3127120787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f0159c60 0x7fe1f016d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 >> 172.21.15.154:0/3127120787 conn(0x7fe1f0068e20 msgr2=0x7fe1f0152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 shutdown_connections 2023-10-10T21:02:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.557+0000 7fe1f85ff700 1 -- 172.21.15.154:0/3127120787 wait complete. 2023-10-10T21:02:33.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.758+0000 7f388a7ff700 1 Processor -- start 2023-10-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.758+0000 7f388a7ff700 1 -- start start 2023-10-10T21:02:33.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.759+0000 7f388a7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3884159c60 0x7f388415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.759+0000 7f388a7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f388415db10 0x7f3884069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.759+0000 7f388a7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388415a160 con 0x7f3884159890 2023-10-10T21:02:33.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.759+0000 7f388a7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388415df50 con 0x7f3884159c60 2023-10-10T21:02:33.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.759+0000 7f388a7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38840d13a0 con 0x7f388415db10 2023-10-10T21:02:33.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.759+0000 7f38837fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3884159c60 0x7f388415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.759+0000 7f3883fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3884159890 0x7f388415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38612/0 (socket says 172.21.15.154:38612) 2023-10-10T21:02:33.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.759+0000 7f3883fff700 1 -- 172.21.15.154:0/4249130697 learned_addr learned my addr 172.21.15.154:0/4249130697 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:33.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f3888d9c700 1 --2- 172.21.15.154:0/4249130697 >> v2:172.21.15.179:3300/0 conn(0x7f388415db10 0x7f3884069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f38837fe700 1 -- 172.21.15.154:0/4249130697 >> v2:172.21.15.179:3300/0 conn(0x7f388415db10 msgr2=0x7f3884069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:33.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f3882ffd700 1 -- 172.21.15.154:0/4249130697 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317064113 0 0) 0x7f388415a160 con 0x7f3884159890 2023-10-10T21:02:33.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f38837fe700 1 --2- 172.21.15.154:0/4249130697 >> v2:172.21.15.179:3300/0 conn(0x7f388415db10 0x7f3884069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f38837fe700 1 -- 172.21.15.154:0/4249130697 >> v1:172.21.15.154:6789/0 conn(0x7f3884159890 legacy=0x7f388415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f38837fe700 1 -- 172.21.15.154:0/4249130697 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388415e140 con 0x7f3884159c60 2023-10-10T21:02:33.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f38837fe700 1 --2- 172.21.15.154:0/4249130697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159c60 0x7f388415d5d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f388406a890 tx=0x7f38780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923bfe6c788b7268 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:33.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f3882ffd700 1 -- 172.21.15.154:0/4249130697 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387800b6b0 con 0x7f3884159c60 2023-10-10T21:02:33.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f3882ffd700 1 -- 172.21.15.154:0/4249130697 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387800b810 con 0x7f3884159c60 2023-10-10T21:02:33.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.760+0000 7f3882ffd700 1 -- 172.21.15.154:0/4249130697 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387800bbb0 con 0x7f3884159c60 2023-10-10T21:02:33.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.761+0000 7f388a7ff700 1 -- 172.21.15.154:0/4249130697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159c60 msgr2=0x7f388415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.761+0000 7f388a7ff700 1 --2- 172.21.15.154:0/4249130697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159c60 0x7f388415d5d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f388406a890 tx=0x7f38780091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.761+0000 7f388a7ff700 1 -- 172.21.15.154:0/4249130697 shutdown_connections 2023-10-10T21:02:33.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.761+0000 7f388a7ff700 1 --2- 172.21.15.154:0/4249130697 >> v2:172.21.15.179:3300/0 conn(0x7f388415db10 0x7f3884069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.761+0000 7f388a7ff700 1 --2- 172.21.15.154:0/4249130697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159c60 0x7f388415d5d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.761+0000 7f388a7ff700 1 -- 172.21.15.154:0/4249130697 >> 172.21.15.154:0/4249130697 conn(0x7f3884068e20 msgr2=0x7f38840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:33.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.761+0000 7f388a7ff700 1 -- 172.21.15.154:0/4249130697 shutdown_connections 2023-10-10T21:02:33.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.761+0000 7f388a7ff700 1 -- 172.21.15.154:0/4249130697 wait complete. 2023-10-10T21:02:33.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.762+0000 7f388a7ff700 1 Processor -- start 2023-10-10T21:02:33.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.763+0000 7f388a7ff700 1 -- start start 2023-10-10T21:02:33.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.763+0000 7f388a7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159890 0x7f38840cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.763+0000 7f388a7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3884159c60 0x7f38840b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f388a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f388415db10 0x7f38840b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f388a7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38840b12f0 con 0x7f3884159890 2023-10-10T21:02:33.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f388a7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38840b06e0 con 0x7f3884159c60 2023-10-10T21:02:33.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f388a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38840b09c0 con 0x7f388415db10 2023-10-10T21:02:33.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3883fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159890 0x7f38840cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3883fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159890 0x7f38840cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56090/0 (socket says 172.21.15.154:56090) 2023-10-10T21:02:33.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3883fff700 1 -- 172.21.15.154:0/667112643 learned_addr learned my addr 172.21.15.154:0/667112643 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:33.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f38837fe700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3884159c60 0x7f38840b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3888d9c700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f388415db10 0x7f38840b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3883fff700 1 -- 172.21.15.154:0/667112643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f388415db10 msgr2=0x7f38840b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3883fff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f388415db10 0x7f38840b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3883fff700 1 -- 172.21.15.154:0/667112643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3884159c60 msgr2=0x7f38840b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3883fff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3884159c60 0x7f38840b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3883fff700 1 -- 172.21.15.154:0/667112643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878009420 con 0x7f3884159890 2023-10-10T21:02:33.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f3883fff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159890 0x7f38840cafd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f387400c7e0 tx=0x7f3874007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:33.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.764+0000 7f386bfff700 1 -- 172.21.15.154:0/667112643 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874005b30 con 0x7f3884159890 2023-10-10T21:02:33.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.765+0000 7f386bfff700 1 -- 172.21.15.154:0/667112643 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3874005c90 con 0x7f3884159890 2023-10-10T21:02:33.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.765+0000 7f386bfff700 1 -- 172.21.15.154:0/667112643 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874007300 con 0x7f3884159890 2023-10-10T21:02:33.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.765+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38840b0ca0 con 0x7f3884159890 2023-10-10T21:02:33.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.765+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38840b1780 con 0x7f3884159890 2023-10-10T21:02:33.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.766+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388404c3c0 con 0x7f3884159890 2023-10-10T21:02:33.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.766+0000 7f386bfff700 1 -- 172.21.15.154:0/667112643 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38740076b0 con 0x7f3884159890 2023-10-10T21:02:33.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.767+0000 7f386bfff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3870066f30 0x7f38700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:33.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.767+0000 7f386bfff700 1 -- 172.21.15.154:0/667112643 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3874083b40 con 0x7f3884159890 2023-10-10T21:02:33.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.767+0000 7f38837fe700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3870066f30 0x7f38700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.768+0000 7f38837fe700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3870066f30 0x7f38700693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38780093f0 tx=0x7f3878017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.771+0000 7f386bfff700 1 -- 172.21.15.154:0/667112643 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3874050d10 con 0x7f3884159890 2023-10-10T21:02:33.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.966+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f388406a5b0 con 0x7f3884159890 2023-10-10T21:02:33.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.967+0000 7f386bfff700 1 -- 172.21.15.154:0/667112643 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3874017020 con 0x7f3884159890 2023-10-10T21:02:33.968 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:02:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3870066f30 msgr2=0x7f38700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3870066f30 0x7f38700693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38780093f0 tx=0x7f3878017000 comp rx=0 tx=0).stop 2023-10-10T21:02:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159890 msgr2=0x7f38840cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159890 0x7f38840cafd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f387400c7e0 tx=0x7f3874007df0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 shutdown_connections 2023-10-10T21:02:33.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3870066f30 0x7f38700693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f388415db10 0x7f38840b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3884159890 0x7f38840cafd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 --2- 172.21.15.154:0/667112643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3884159c60 0x7f38840b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:33.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 >> 172.21.15.154:0/667112643 conn(0x7f3884068e20 msgr2=0x7f38840b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:33.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 shutdown_connections 2023-10-10T21:02:33.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:33.969+0000 7f388a7ff700 1 -- 172.21.15.154:0/667112643 wait complete. 2023-10-10T21:02:33.990 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:02:34.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.172+0000 7f7ead99d700 1 Processor -- start 2023-10-10T21:02:34.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.172+0000 7f7ead99d700 1 -- start start 2023-10-10T21:02:34.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ead99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea80c9db0 0x7f7ea8153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ead99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ea8157130 0x7f7ea80c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ead99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea806e150 con 0x7f7ea8159ad0 2023-10-10T21:02:34.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ead99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea8153e40 con 0x7f7ea8157130 2023-10-10T21:02:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ead99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80c7800 con 0x7f7ea80c9db0 2023-10-10T21:02:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ead19c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7ea8159ad0 0x7f7ea8159f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38616/0 (socket says 172.21.15.154:38616) 2023-10-10T21:02:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ead19c700 1 -- 172.21.15.154:0/75718204 learned_addr learned my addr 172.21.15.154:0/75718204 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7eac99b700 1 --2- 172.21.15.154:0/75718204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea80c9db0 0x7f7ea8153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ea7fff700 1 --2- 172.21.15.154:0/75718204 >> v2:172.21.15.179:3300/0 conn(0x7f7ea8157130 0x7f7ea80c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ea77fe700 1 -- 172.21.15.154:0/75718204 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242829840 0 0) 0x7f7ea806e150 con 0x7f7ea8159ad0 2023-10-10T21:02:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.174+0000 7f7ea77fe700 1 -- 172.21.15.154:0/75718204 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e98003570 con 0x7f7ea8159ad0 2023-10-10T21:02:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.175+0000 7f7eac99b700 1 -- 172.21.15.154:0/75718204 >> v2:172.21.15.179:3300/0 conn(0x7f7ea8157130 msgr2=0x7f7ea80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.175+0000 7f7eac99b700 1 --2- 172.21.15.154:0/75718204 >> v2:172.21.15.179:3300/0 conn(0x7f7ea8157130 0x7f7ea80c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.175+0000 7f7eac99b700 1 -- 172.21.15.154:0/75718204 >> v1:172.21.15.154:6789/0 conn(0x7f7ea8159ad0 legacy=0x7f7ea8159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.175+0000 7f7eac99b700 1 -- 172.21.15.154:0/75718204 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea80c7ae0 con 0x7f7ea80c9db0 2023-10-10T21:02:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.175+0000 7f7ea7fff700 1 --2- 172.21.15.154:0/75718204 >> v2:172.21.15.179:3300/0 conn(0x7f7ea8157130 0x7f7ea80c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.175+0000 7f7eac99b700 1 --2- 172.21.15.154:0/75718204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea80c9db0 0x7f7ea8153900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0098e0 tx=0x7f7e9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dee1d423fcf4624 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.175+0000 7f7ea77fe700 1 -- 172.21.15.154:0/75718204 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011630 con 0x7f7ea80c9db0 2023-10-10T21:02:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.175+0000 7f7ea77fe700 1 -- 172.21.15.154:0/75718204 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c011790 con 0x7f7ea80c9db0 2023-10-10T21:02:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.175+0000 7f7ea77fe700 1 -- 172.21.15.154:0/75718204 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011b30 con 0x7f7ea80c9db0 2023-10-10T21:02:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.176+0000 7f7ead99d700 1 -- 172.21.15.154:0/75718204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea80c9db0 msgr2=0x7f7ea8153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.176+0000 7f7ead99d700 1 --2- 172.21.15.154:0/75718204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea80c9db0 0x7f7ea8153900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0098e0 tx=0x7f7e9c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.176+0000 7f7ead99d700 1 -- 172.21.15.154:0/75718204 shutdown_connections 2023-10-10T21:02:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.176+0000 7f7ead99d700 1 --2- 172.21.15.154:0/75718204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea80c9db0 0x7f7ea8153900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.176+0000 7f7ead99d700 1 --2- 172.21.15.154:0/75718204 >> v2:172.21.15.179:3300/0 conn(0x7f7ea8157130 0x7f7ea80c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.176+0000 7f7ead99d700 1 -- 172.21.15.154:0/75718204 >> 172.21.15.154:0/75718204 conn(0x7f7ea80cc1e0 msgr2=0x7f7ea80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.176+0000 7f7ead99d700 1 -- 172.21.15.154:0/75718204 shutdown_connections 2023-10-10T21:02:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.176+0000 7f7ead99d700 1 -- 172.21.15.154:0/75718204 wait complete. 2023-10-10T21:02:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.177+0000 7f7ead99d700 1 Processor -- start 2023-10-10T21:02:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.177+0000 7f7ead99d700 1 -- start start 2023-10-10T21:02:34.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.178+0000 7f7ead99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ea80c9db0 0x7f7ea814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.178+0000 7f7ead99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ea8157130 0x7f7ea8146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.178+0000 7f7ead99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea8159ad0 0x7f7ea8158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.178+0000 7f7ead99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea8146fa0 con 0x7f7ea80c9db0 2023-10-10T21:02:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.178+0000 7f7ead99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea8157e70 con 0x7f7ea8157130 2023-10-10T21:02:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.178+0000 7f7ead99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80ac9f0 con 0x7f7ea8159ad0 2023-10-10T21:02:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7eac99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ea80c9db0 0x7f7ea814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7eac99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ea80c9db0 0x7f7ea814e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56098/0 (socket says 172.21.15.154:56098) 2023-10-10T21:02:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7eac99b700 1 -- 172.21.15.154:0/2949345525 learned_addr learned my addr 172.21.15.154:0/2949345525 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7ead19c700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea8159ad0 0x7f7ea8158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7ea7fff700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ea8157130 0x7f7ea8146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7eac99b700 1 -- 172.21.15.154:0/2949345525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea8159ad0 msgr2=0x7f7ea8158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7eac99b700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea8159ad0 0x7f7ea8158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7eac99b700 1 -- 172.21.15.154:0/2949345525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ea8157130 msgr2=0x7f7ea8146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7eac99b700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ea8157130 0x7f7ea8146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7eac99b700 1 -- 172.21.15.154:0/2949345525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e94009420 con 0x7f7ea80c9db0 2023-10-10T21:02:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7ea7fff700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ea8157130 0x7f7ea8146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7eac99b700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ea80c9db0 0x7f7ea814e2d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009ed0 tx=0x7f7e9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7ea4ff9700 1 -- 172.21.15.154:0/2949345525 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011b10 con 0x7f7ea80c9db0 2023-10-10T21:02:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7ea4ff9700 1 -- 172.21.15.154:0/2949345525 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0253f0 con 0x7f7ea80c9db0 2023-10-10T21:02:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.179+0000 7f7ea4ff9700 1 -- 172.21.15.154:0/2949345525 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0257d0 con 0x7f7ea80c9db0 2023-10-10T21:02:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.180+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c009420 con 0x7f7ea80c9db0 2023-10-10T21:02:34.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.180+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea8157b00 con 0x7f7ea80c9db0 2023-10-10T21:02:34.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.180+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea8157960 con 0x7f7ea80c9db0 2023-10-10T21:02:34.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.181+0000 7f7ea4ff9700 1 -- 172.21.15.154:0/2949345525 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e9c025c00 con 0x7f7ea80c9db0 2023-10-10T21:02:34.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.182+0000 7f7ea4ff9700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7e8c066f30 0x7f7e8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.182+0000 7f7ea4ff9700 1 -- 172.21.15.154:0/2949345525 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e9c085e60 con 0x7f7ea80c9db0 2023-10-10T21:02:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.182+0000 7f7ea7fff700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7e8c066f30 0x7f7e8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.183+0000 7f7ea7fff700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7e8c066f30 0x7f7e8c0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e940093f0 tx=0x7f7e94008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.186+0000 7f7ea4ff9700 1 -- 172.21.15.154:0/2949345525 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ea8157960 con 0x7f7ea80c9db0 2023-10-10T21:02:34.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.377+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ea8157960 con 0x7f7ea80c9db0 2023-10-10T21:02:34.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.377+0000 7f7ea4ff9700 1 -- 172.21.15.154:0/2949345525 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ea8157960 con 0x7f7ea80c9db0 2023-10-10T21:02:34.379 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:02:34.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7e8c066f30 msgr2=0x7f7e8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7e8c066f30 0x7f7e8c0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e940093f0 tx=0x7f7e94008040 comp rx=0 tx=0).stop 2023-10-10T21:02:34.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ea80c9db0 msgr2=0x7f7ea814e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ea80c9db0 0x7f7ea814e2d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009ed0 tx=0x7f7e9c017000 comp rx=0 tx=0).stop 2023-10-10T21:02:34.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 shutdown_connections 2023-10-10T21:02:34.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7e8c066f30 0x7f7e8c0693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ea8159ad0 0x7f7ea8158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ea80c9db0 0x7f7ea814e2d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 --2- 172.21.15.154:0/2949345525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ea8157130 0x7f7ea8146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 >> 172.21.15.154:0/2949345525 conn(0x7f7ea80cc1e0 msgr2=0x7f7ea8150ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:34.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 shutdown_connections 2023-10-10T21:02:34.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.380+0000 7f7ead99d700 1 -- 172.21.15.154:0/2949345525 wait complete. 2023-10-10T21:02:34.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:02:34.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.583+0000 7f8132bff700 1 Processor -- start 2023-10-10T21:02:34.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.583+0000 7f8132bff700 1 -- start start 2023-10-10T21:02:34.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.584+0000 7f8132bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 0x7f812c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.584+0000 7f8132bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f812c06c0a0 0x7f812c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.584+0000 7f8132bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f812c15df50 0x7f812c15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.584+0000 7f8132bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c15d7e0 con 0x7f812c06c0a0 2023-10-10T21:02:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.584+0000 7f8132bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c15dac0 con 0x7f812c15df50 2023-10-10T21:02:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.584+0000 7f8132bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c15aa30 con 0x7f812c06bcd0 2023-10-10T21:02:34.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f812bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f812c06c0a0 0x7f812c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f812bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f812c06c0a0 0x7f812c15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56108/0 (socket says 172.21.15.154:56108) 2023-10-10T21:02:34.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f812bfff700 1 -- 172.21.15.154:0/4209118314 learned_addr learned my addr 172.21.15.154:0/4209118314 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:34.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f813099b700 1 --2- 172.21.15.154:0/4209118314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 0x7f812c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f813119c700 1 --2- 172.21.15.154:0/4209118314 >> v2:172.21.15.179:3300/0 conn(0x7f812c15df50 0x7f812c15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f812bfff700 1 -- 172.21.15.154:0/4209118314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 msgr2=0x7f812c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f812bfff700 1 --2- 172.21.15.154:0/4209118314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 0x7f812c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f812bfff700 1 -- 172.21.15.154:0/4209118314 >> v2:172.21.15.179:3300/0 conn(0x7f812c15df50 msgr2=0x7f812c15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f812bfff700 1 --2- 172.21.15.154:0/4209118314 >> v2:172.21.15.179:3300/0 conn(0x7f812c15df50 0x7f812c15e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f812bfff700 1 -- 172.21.15.154:0/4209118314 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c15ad10 con 0x7f812c06c0a0 2023-10-10T21:02:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f813119c700 1 --2- 172.21.15.154:0/4209118314 >> v2:172.21.15.179:3300/0 conn(0x7f812c15df50 0x7f812c15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.585+0000 7f812bfff700 1 --2- 172.21.15.154:0/4209118314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c06c0a0 0x7f812c15a1e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f812c06b620 tx=0x7f8118009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fbd4da2cb96c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f812b7fe700 1 -- 172.21.15.154:0/4209118314 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118009e70 con 0x7f812c06c0a0 2023-10-10T21:02:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f812b7fe700 1 -- 172.21.15.154:0/4209118314 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811800b860 con 0x7f812c06c0a0 2023-10-10T21:02:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f812b7fe700 1 -- 172.21.15.154:0/4209118314 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811800bc20 con 0x7f812c06c0a0 2023-10-10T21:02:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f8132bff700 1 -- 172.21.15.154:0/4209118314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c06c0a0 msgr2=0x7f812c15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f8132bff700 1 --2- 172.21.15.154:0/4209118314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c06c0a0 0x7f812c15a1e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f812c06b620 tx=0x7f8118009250 comp rx=0 tx=0).stop 2023-10-10T21:02:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f8132bff700 1 -- 172.21.15.154:0/4209118314 shutdown_connections 2023-10-10T21:02:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f8132bff700 1 --2- 172.21.15.154:0/4209118314 >> v2:172.21.15.179:3300/0 conn(0x7f812c15df50 0x7f812c15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f8132bff700 1 --2- 172.21.15.154:0/4209118314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 0x7f812c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f8132bff700 1 --2- 172.21.15.154:0/4209118314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c06c0a0 0x7f812c15a1e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f8132bff700 1 -- 172.21.15.154:0/4209118314 >> 172.21.15.154:0/4209118314 conn(0x7f812c0ce600 msgr2=0x7f812c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f8132bff700 1 -- 172.21.15.154:0/4209118314 shutdown_connections 2023-10-10T21:02:34.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.586+0000 7f8132bff700 1 -- 172.21.15.154:0/4209118314 wait complete. 2023-10-10T21:02:34.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.588+0000 7f8132bff700 1 Processor -- start 2023-10-10T21:02:34.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.588+0000 7f8132bff700 1 -- start start 2023-10-10T21:02:34.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f8132bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 0x7f812c0c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f8132bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06c0a0 0x7f812c0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f8132bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c15df50 0x7f812c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f8132bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0b14d0 con 0x7f812c15df50 2023-10-10T21:02:34.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f8132bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c16a660 con 0x7f812c06c0a0 2023-10-10T21:02:34.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f8132bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c16a940 con 0x7f812c06bcd0 2023-10-10T21:02:34.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f813119c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c15df50 0x7f812c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f813119c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c15df50 0x7f812c0c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56114/0 (socket says 172.21.15.154:56114) 2023-10-10T21:02:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f813119c700 1 -- 172.21.15.154:0/1684837833 learned_addr learned my addr 172.21.15.154:0/1684837833 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f813099b700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 0x7f812c0c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f812bfff700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06c0a0 0x7f812c0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.589+0000 7f813119c700 1 -- 172.21.15.154:0/1684837833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 msgr2=0x7f812c0c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f813119c700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 0x7f812c0c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f813119c700 1 -- 172.21.15.154:0/1684837833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06c0a0 msgr2=0x7f812c0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f813119c700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06c0a0 0x7f812c0c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f813119c700 1 -- 172.21.15.154:0/1684837833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81180094f0 con 0x7f812c15df50 2023-10-10T21:02:34.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f812bfff700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06c0a0 0x7f812c0c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:34.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f813119c700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c15df50 0x7f812c0c80f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f812400d180 tx=0x7f8124009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:34.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f8128ff9700 1 -- 172.21.15.154:0/1684837833 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812400dd70 con 0x7f812c15df50 2023-10-10T21:02:34.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f8128ff9700 1 -- 172.21.15.154:0/1684837833 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812400f040 con 0x7f812c15df50 2023-10-10T21:02:34.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f8128ff9700 1 -- 172.21.15.154:0/1684837833 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124015690 con 0x7f812c15df50 2023-10-10T21:02:34.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c16ac20 con 0x7f812c15df50 2023-10-10T21:02:34.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.590+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c16af00 con 0x7f812c15df50 2023-10-10T21:02:34.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.591+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c0b1680 con 0x7f812c15df50 2023-10-10T21:02:34.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.592+0000 7f8128ff9700 1 -- 172.21.15.154:0/1684837833 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f812401e3b0 con 0x7f812c15df50 2023-10-10T21:02:34.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.593+0000 7f8128ff9700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8110066f30 0x7f81100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:34.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.593+0000 7f8128ff9700 1 -- 172.21.15.154:0/1684837833 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8124084b10 con 0x7f812c15df50 2023-10-10T21:02:34.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.593+0000 7f813099b700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8110066f30 0x7f81100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:34.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.594+0000 7f813099b700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8110066f30 0x7f81100693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f812c15c550 tx=0x7f81200091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:34.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.597+0000 7f8128ff9700 1 -- 172.21.15.154:0/1684837833 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f812c0b1680 con 0x7f812c15df50 2023-10-10T21:02:34.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.836+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f812c04c3c0 con 0x7f812c15df50 2023-10-10T21:02:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.836+0000 7f8128ff9700 1 -- 172.21.15.154:0/1684837833 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f812401a090 con 0x7f812c15df50 2023-10-10T21:02:34.838 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:34.838 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439513038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439513038},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439513038}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1179223321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1179223321},{"type":"v1","addr":"172.21.15.154:6836","nonce":1179223321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4116873553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4116873553},{"type":"v1","addr":"172.21.15.179:6835","nonce":4116873553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:02:19.159716+0000","modified":"2023-10-10T21:02:22.851729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6833/2053231138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2053231138},{"type":"v1","addr":"172.21.15.179:6833","nonce":2053231138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-10T21:02:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8110066f30 msgr2=0x7f81100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8110066f30 0x7f81100693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f812c15c550 tx=0x7f81200091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c15df50 msgr2=0x7f812c0c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c15df50 0x7f812c0c80f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f812400d180 tx=0x7f8124009a50 comp rx=0 tx=0).stop 2023-10-10T21:02:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 shutdown_connections 2023-10-10T21:02:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812c15df50 0x7f812c0c80f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8110066f30 0x7f81100693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c06bcd0 0x7f812c0c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 --2- 172.21.15.154:0/1684837833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06c0a0 0x7f812c0c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:34.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 >> 172.21.15.154:0/1684837833 conn(0x7f812c0ce600 msgr2=0x7f812c0c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:34.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 shutdown_connections 2023-10-10T21:02:34.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:34.839+0000 7f8132bff700 1 -- 172.21.15.154:0/1684837833 wait complete. 2023-10-10T21:02:34.843 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-10-10T21:02:34.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.040+0000 7f0813fff700 1 Processor -- start 2023-10-10T21:02:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.040+0000 7f0813fff700 1 -- start start 2023-10-10T21:02:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.041+0000 7f0813fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f081406a660 0x7f0814157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.041+0000 7f0813fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081406e2a0 con 0x7f0814150550 2023-10-10T21:02:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.041+0000 7f0813fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081406b2e0 con 0x7f0814150180 2023-10-10T21:02:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.041+0000 7f0813fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08140c78e0 con 0x7f081406a660 2023-10-10T21:02:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.041+0000 7f08137fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f081406a660 0x7f0814157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.041+0000 7f08127fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0814150550 0x7f0814069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38618/0 (socket says 172.21.15.154:38618) 2023-10-10T21:02:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.041+0000 7f08127fc700 1 -- 172.21.15.154:0/1329603438 learned_addr learned my addr 172.21.15.154:0/1329603438 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.042+0000 7f08137fe700 1 -- 172.21.15.154:0/1329603438 >> v1:172.21.15.179:6789/0 conn(0x7f0814150180 legacy=0x7f08140c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.042+0000 7f08137fe700 1 -- 172.21.15.154:0/1329603438 >> v1:172.21.15.154:6789/0 conn(0x7f0814150550 legacy=0x7f0814069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.042+0000 7f08137fe700 1 -- 172.21.15.154:0/1329603438 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140c7bc0 con 0x7f081406a660 2023-10-10T21:02:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.042+0000 7f0811ffb700 1 -- 172.21.15.154:0/1329603438 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335825218 0 0) 0x7f081406e2a0 con 0x7f0814150550 2023-10-10T21:02:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.042+0000 7f08137fe700 1 --2- 172.21.15.154:0/1329603438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 0x7f0814157770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e90 tx=0x7f080c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50aa96449c35d6a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.042+0000 7f0811ffb700 1 -- 172.21.15.154:0/1329603438 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c00e070 con 0x7f081406a660 2023-10-10T21:02:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.042+0000 7f0811ffb700 1 -- 172.21.15.154:0/1329603438 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c00bbf0 con 0x7f081406a660 2023-10-10T21:02:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.042+0000 7f0811ffb700 1 -- 172.21.15.154:0/1329603438 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c012430 con 0x7f081406a660 2023-10-10T21:02:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.043+0000 7f0813fff700 1 -- 172.21.15.154:0/1329603438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 msgr2=0x7f0814157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.043+0000 7f0813fff700 1 --2- 172.21.15.154:0/1329603438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 0x7f0814157770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e90 tx=0x7f080c009780 comp rx=0 tx=0).stop 2023-10-10T21:02:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.043+0000 7f0813fff700 1 -- 172.21.15.154:0/1329603438 shutdown_connections 2023-10-10T21:02:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.043+0000 7f0813fff700 1 --2- 172.21.15.154:0/1329603438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 0x7f0814157770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.043+0000 7f0813fff700 1 -- 172.21.15.154:0/1329603438 >> 172.21.15.154:0/1329603438 conn(0x7f08140cc1f0 msgr2=0x7f08140cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.043+0000 7f0813fff700 1 -- 172.21.15.154:0/1329603438 shutdown_connections 2023-10-10T21:02:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.043+0000 7f0813fff700 1 -- 172.21.15.154:0/1329603438 wait complete. 2023-10-10T21:02:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.044+0000 7f0813fff700 1 Processor -- start 2023-10-10T21:02:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.045+0000 7f0813fff700 1 -- start start 2023-10-10T21:02:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.045+0000 7f0813fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 0x7f081414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.045+0000 7f0813fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0814150180 0x7f0814167f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.045+0000 7f0813fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0814150550 0x7f08140cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.045+0000 7f0813fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081414bb40 con 0x7f081406a660 2023-10-10T21:02:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.045+0000 7f0813fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0814168980 con 0x7f0814150550 2023-10-10T21:02:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.045+0000 7f0813fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0814168c60 con 0x7f0814150180 2023-10-10T21:02:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0812ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 0x7f081414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0812ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 0x7f081414b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56124/0 (socket says 172.21.15.154:56124) 2023-10-10T21:02:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0812ffd700 1 -- 172.21.15.154:0/1396730331 learned_addr learned my addr 172.21.15.154:0/1396730331 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f08127fc700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0814150180 0x7f0814167f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f08137fe700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0814150550 0x7f08140cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0812ffd700 1 -- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0814150180 msgr2=0x7f0814167f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0812ffd700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0814150180 0x7f0814167f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0812ffd700 1 -- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0814150550 msgr2=0x7f08140cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0812ffd700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0814150550 0x7f08140cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0812ffd700 1 -- 172.21.15.154:0/1396730331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c009a20 con 0x7f081406a660 2023-10-10T21:02:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f08127fc700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0814150180 0x7f0814167f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f08137fe700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0814150550 0x7f08140cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0812ffd700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 0x7f081414b600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f080400c590 tx=0x7f080400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f07faffd700 1 -- 172.21.15.154:0/1396730331 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804011590 con 0x7f081406a660 2023-10-10T21:02:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f07faffd700 1 -- 172.21.15.154:0/1396730331 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08040116f0 con 0x7f081406a660 2023-10-10T21:02:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f07faffd700 1 -- 172.21.15.154:0/1396730331 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804011ab0 con 0x7f081406a660 2023-10-10T21:02:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.046+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08140c3420 con 0x7f081406a660 2023-10-10T21:02:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.047+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081414be80 con 0x7f081406a660 2023-10-10T21:02:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.047+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08140c3280 con 0x7f081406a660 2023-10-10T21:02:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.048+0000 7f07faffd700 1 -- 172.21.15.154:0/1396730331 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f080401b3b0 con 0x7f081406a660 2023-10-10T21:02:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.049+0000 7f07faffd700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0800066f30 0x7f08000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.050+0000 7f07faffd700 1 -- 172.21.15.154:0/1396730331 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0804083b80 con 0x7f081406a660 2023-10-10T21:02:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.050+0000 7f08127fc700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0800066f30 0x7f08000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.050+0000 7f08127fc700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0800066f30 0x7f08000693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0808000c00 tx=0x7f0808009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.054+0000 7f07faffd700 1 -- 172.21.15.154:0/1396730331 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08140c3280 con 0x7f081406a660 2023-10-10T21:02:35.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.248+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08140c3280 con 0x7f081406a660 2023-10-10T21:02:35.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.249+0000 7f07faffd700 1 -- 172.21.15.154:0/1396730331 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f08140c3280 con 0x7f081406a660 2023-10-10T21:02:35.251 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:35.251 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.251+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0800066f30 msgr2=0x7f08000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.251+0000 7f0813fff700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0800066f30 0x7f08000693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0808000c00 tx=0x7f0808009040 comp rx=0 tx=0).stop 2023-10-10T21:02:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.251+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 msgr2=0x7f081414b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.251+0000 7f0813fff700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 0x7f081414b600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f080400c590 tx=0x7f080400c950 comp rx=0 tx=0).stop 2023-10-10T21:02:35.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.252+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 shutdown_connections 2023-10-10T21:02:35.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.252+0000 7f0813fff700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0814150550 0x7f08140cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.252+0000 7f0813fff700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f081406a660 0x7f081414b600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.252+0000 7f0813fff700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0800066f30 0x7f08000693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.252+0000 7f0813fff700 1 --2- 172.21.15.154:0/1396730331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0814150180 0x7f0814167f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.252+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 >> 172.21.15.154:0/1396730331 conn(0x7f08140cc1f0 msgr2=0x7f08140c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:35.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.252+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 shutdown_connections 2023-10-10T21:02:35.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.252+0000 7f0813fff700 1 -- 172.21.15.154:0/1396730331 wait complete. 2023-10-10T21:02:35.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:02:35.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.452+0000 7f768d59d700 1 Processor -- start 2023-10-10T21:02:35.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.452+0000 7f768d59d700 1 -- start start 2023-10-10T21:02:35.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.453+0000 7f768d59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7688159420 0x7f76880b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.453+0000 7f768d59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76880b2980 con 0x7f76881597f0 2023-10-10T21:02:35.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.453+0000 7f768d59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76880b11d0 con 0x7f768815d230 2023-10-10T21:02:35.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.453+0000 7f768d59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76880b14b0 con 0x7f7688159420 2023-10-10T21:02:35.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.454+0000 7f76877fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f76881597f0 0x7f76880b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38626/0 (socket says 172.21.15.154:38626) 2023-10-10T21:02:35.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.454+0000 7f7687fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7688159420 0x7f76880b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.454+0000 7f76877fe700 1 -- 172.21.15.154:0/2628858530 learned_addr learned my addr 172.21.15.154:0/2628858530 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:35.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.454+0000 7f7686ffd700 1 -- 172.21.15.154:0/2628858530 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087853400 0 0) 0x7f76880b11d0 con 0x7f768815d230 2023-10-10T21:02:35.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.454+0000 7f7686ffd700 1 -- 172.21.15.154:0/2628858530 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7670003570 con 0x7f768815d230 2023-10-10T21:02:35.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.454+0000 7f7687fff700 1 -- 172.21.15.154:0/2628858530 >> v1:172.21.15.179:6789/0 conn(0x7f768815d230 legacy=0x7f768815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.454+0000 7f7687fff700 1 -- 172.21.15.154:0/2628858530 >> v1:172.21.15.154:6789/0 conn(0x7f76881597f0 legacy=0x7f76880b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.454+0000 7f7686ffd700 1 -- 172.21.15.154:0/2628858530 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638215107 0 0) 0x7f76880b2980 con 0x7f76881597f0 2023-10-10T21:02:35.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.454+0000 7f7687fff700 1 -- 172.21.15.154:0/2628858530 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880b1790 con 0x7f7688159420 2023-10-10T21:02:35.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.455+0000 7f7687fff700 1 --2- 172.21.15.154:0/2628858530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688159420 0x7f76880b5f40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76780098e0 tx=0x7f76780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52145c0ba4fdd89d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:35.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.455+0000 7f7686ffd700 1 -- 172.21.15.154:0/2628858530 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800b640 con 0x7f7688159420 2023-10-10T21:02:35.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.455+0000 7f7686ffd700 1 -- 172.21.15.154:0/2628858530 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767800b7a0 con 0x7f7688159420 2023-10-10T21:02:35.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.455+0000 7f7686ffd700 1 -- 172.21.15.154:0/2628858530 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800bb40 con 0x7f7688159420 2023-10-10T21:02:35.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.455+0000 7f768d59d700 1 -- 172.21.15.154:0/2628858530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688159420 msgr2=0x7f76880b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.455+0000 7f768d59d700 1 --2- 172.21.15.154:0/2628858530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688159420 0x7f76880b5f40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76780098e0 tx=0x7f76780091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.455+0000 7f768d59d700 1 -- 172.21.15.154:0/2628858530 shutdown_connections 2023-10-10T21:02:35.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.455+0000 7f768d59d700 1 --2- 172.21.15.154:0/2628858530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688159420 0x7f76880b5f40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.455+0000 7f768d59d700 1 -- 172.21.15.154:0/2628858530 >> 172.21.15.154:0/2628858530 conn(0x7f76880d0660 msgr2=0x7f76880d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:35.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.456+0000 7f768d59d700 1 -- 172.21.15.154:0/2628858530 shutdown_connections 2023-10-10T21:02:35.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.456+0000 7f768d59d700 1 -- 172.21.15.154:0/2628858530 wait complete. 2023-10-10T21:02:35.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.457+0000 7f768d59d700 1 Processor -- start 2023-10-10T21:02:35.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.457+0000 7f768d59d700 1 -- start start 2023-10-10T21:02:35.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768d59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688159420 0x7f7688169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768d59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76881597f0 0x7f76880cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768d59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f768815d230 0x7f76880c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768d59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880c7ce0 con 0x7f768815d230 2023-10-10T21:02:35.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768d59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768816a440 con 0x7f7688159420 2023-10-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768d59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76880c7850 con 0x7f76881597f0 2023-10-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f768815d230 0x7f76880c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f768815d230 0x7f76880c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56130/0 (socket says 172.21.15.154:56130) 2023-10-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768cd9c700 1 -- 172.21.15.154:0/2789571507 learned_addr learned my addr 172.21.15.154:0/2789571507 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f76877fe700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76881597f0 0x7f76880cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f7687fff700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688159420 0x7f7688169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.458+0000 7f768cd9c700 1 -- 172.21.15.154:0/2789571507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76881597f0 msgr2=0x7f76880cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f768cd9c700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76881597f0 0x7f76880cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f768cd9c700 1 -- 172.21.15.154:0/2789571507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688159420 msgr2=0x7f7688169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f768cd9c700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688159420 0x7f7688169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f768cd9c700 1 -- 172.21.15.154:0/2789571507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678009420 con 0x7f768815d230 2023-10-10T21:02:35.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f768cd9c700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f768815d230 0x7f76880c5400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f768000c830 tx=0x7f7680007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:35.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f766ffff700 1 -- 172.21.15.154:0/2789571507 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680012630 con 0x7f768815d230 2023-10-10T21:02:35.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f766ffff700 1 -- 172.21.15.154:0/2789571507 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680012790 con 0x7f768815d230 2023-10-10T21:02:35.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76880cc0a0 con 0x7f768815d230 2023-10-10T21:02:35.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f766ffff700 1 -- 172.21.15.154:0/2789571507 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680012b50 con 0x7f768815d230 2023-10-10T21:02:35.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.459+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76880c6f20 con 0x7f768815d230 2023-10-10T21:02:35.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.460+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76880c79e0 con 0x7f768815d230 2023-10-10T21:02:35.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.461+0000 7f766ffff700 1 -- 172.21.15.154:0/2789571507 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f768001b400 con 0x7f768815d230 2023-10-10T21:02:35.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.462+0000 7f766ffff700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7674066f30 0x7f76740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:35.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.462+0000 7f766ffff700 1 -- 172.21.15.154:0/2789571507 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7680084990 con 0x7f768815d230 2023-10-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.462+0000 7f7687fff700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7674066f30 0x7f76740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.463+0000 7f7687fff700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7674066f30 0x7f76740693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f76780093f0 tx=0x7f7678017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.466+0000 7f766ffff700 1 -- 172.21.15.154:0/2789571507 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7680051b60 con 0x7f768815d230 2023-10-10T21:02:35.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.698+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f768804c3c0 con 0x7f768815d230 2023-10-10T21:02:35.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.698+0000 7f766ffff700 1 -- 172.21.15.154:0/2789571507 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f7680055180 con 0x7f768815d230 2023-10-10T21:02:35.700 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:35.700 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439513038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439513038},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439513038}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1179223321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1179223321},{"type":"v1","addr":"172.21.15.154:6836","nonce":1179223321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4116873553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4116873553},{"type":"v1","addr":"172.21.15.179:6835","nonce":4116873553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:02:19.159716+0000","modified":"2023-10-10T21:02:22.851729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6833/2053231138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2053231138},{"type":"v1","addr":"172.21.15.179:6833","nonce":2053231138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-10T21:02:35.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.700+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7674066f30 msgr2=0x7f76740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7674066f30 0x7f76740693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f76780093f0 tx=0x7f7678017000 comp rx=0 tx=0).stop 2023-10-10T21:02:35.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f768815d230 msgr2=0x7f76880c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:35.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f768815d230 0x7f76880c5400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f768000c830 tx=0x7f7680007f90 comp rx=0 tx=0).stop 2023-10-10T21:02:35.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 shutdown_connections 2023-10-10T21:02:35.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f768815d230 0x7f76880c5400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688159420 0x7f7688169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7674066f30 0x7f76740693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 --2- 172.21.15.154:0/2789571507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76881597f0 0x7f76880cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:35.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 >> 172.21.15.154:0/2789571507 conn(0x7f76880d0660 msgr2=0x7f76880af200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:35.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 shutdown_connections 2023-10-10T21:02:35.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:35.701+0000 7f768d59d700 1 -- 172.21.15.154:0/2789571507 wait complete. 2023-10-10T21:02:35.705 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-10-10T21:02:36.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T21:02:19.159716+0000', 'modified': '2023-10-10T21:02:22.851729+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6833/2053231138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 2053231138}, {'type': 'v1', 'addr': '172.21.15.179:6833', 'nonce': 2053231138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T21:02:36.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T21:02:36.125 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-10T21:02:36.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.308+0000 7f569b5ff700 1 Processor -- start 2023-10-10T21:02:36.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.308+0000 7f569b5ff700 1 -- start start 2023-10-10T21:02:36.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.309+0000 7f569b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940cbf30 0x7f56940ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.309+0000 7f569b5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56940ccf90 0x7f56940b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.309+0000 7f569b5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56940cc300 con 0x7f569415a270 2023-10-10T21:02:36.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f569b5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5694156bf0 con 0x7f56940ccf90 2023-10-10T21:02:36.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f569b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56940ae950 con 0x7f56940cbf30 2023-10-10T21:02:36.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f5698b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56940ccf90 0x7f56940b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f5699b9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f569415a270 0x7f56940c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47428/0 (socket says 172.21.15.154:47428) 2023-10-10T21:02:36.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f5699b9c700 1 -- 172.21.15.154:0/255548688 learned_addr learned my addr 172.21.15.154:0/255548688 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:36.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f569939b700 1 --2- 172.21.15.154:0/255548688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940cbf30 0x7f56940ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f568bfff700 1 -- 172.21.15.154:0/255548688 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351321120 0 0) 0x7f56940cc300 con 0x7f569415a270 2023-10-10T21:02:36.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f5698b9a700 1 -- 172.21.15.154:0/255548688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940cbf30 msgr2=0x7f56940ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:36.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f5698b9a700 1 --2- 172.21.15.154:0/255548688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940cbf30 0x7f56940ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f5698b9a700 1 -- 172.21.15.154:0/255548688 >> v1:172.21.15.154:6789/0 conn(0x7f569415a270 legacy=0x7f56940c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.310+0000 7f5698b9a700 1 -- 172.21.15.154:0/255548688 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940ad370 con 0x7f56940ccf90 2023-10-10T21:02:36.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f5698b9a700 1 --2- 172.21.15.154:0/255548688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56940ccf90 0x7f56940b0d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5684009910 tx=0x7f56840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37679552055adbd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:36.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f568bfff700 1 -- 172.21.15.154:0/255548688 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400b640 con 0x7f56940ccf90 2023-10-10T21:02:36.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f568bfff700 1 -- 172.21.15.154:0/255548688 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568400b7a0 con 0x7f56940ccf90 2023-10-10T21:02:36.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f568bfff700 1 -- 172.21.15.154:0/255548688 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400bb60 con 0x7f56940ccf90 2023-10-10T21:02:36.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f569b5ff700 1 -- 172.21.15.154:0/255548688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56940ccf90 msgr2=0x7f56940b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f569b5ff700 1 --2- 172.21.15.154:0/255548688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56940ccf90 0x7f56940b0d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5684009910 tx=0x7f56840091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f569b5ff700 1 -- 172.21.15.154:0/255548688 shutdown_connections 2023-10-10T21:02:36.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f569b5ff700 1 --2- 172.21.15.154:0/255548688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940cbf30 0x7f56940ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f569b5ff700 1 --2- 172.21.15.154:0/255548688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56940ccf90 0x7f56940b0d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f569b5ff700 1 -- 172.21.15.154:0/255548688 >> 172.21.15.154:0/255548688 conn(0x7f569406a320 msgr2=0x7f56940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:36.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f569b5ff700 1 -- 172.21.15.154:0/255548688 shutdown_connections 2023-10-10T21:02:36.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.311+0000 7f569b5ff700 1 -- 172.21.15.154:0/255548688 wait complete. 2023-10-10T21:02:36.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.313+0000 7f569b5ff700 1 Processor -- start 2023-10-10T21:02:36.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.313+0000 7f569b5ff700 1 -- start start 2023-10-10T21:02:36.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f569b5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56940cbf30 0x7f56940c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f569b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940ccf90 0x7f5694148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f569b5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569415a270 0x7f56941490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f569b5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56940a5f50 con 0x7f569415a270 2023-10-10T21:02:36.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f569b5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56940a5640 con 0x7f56940cbf30 2023-10-10T21:02:36.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f569b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56940a5900 con 0x7f56940ccf90 2023-10-10T21:02:36.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f5699b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569415a270 0x7f56941490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f5699b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569415a270 0x7f56941490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36628/0 (socket says 172.21.15.154:36628) 2023-10-10T21:02:36.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f5699b9c700 1 -- 172.21.15.154:0/3099937242 learned_addr learned my addr 172.21.15.154:0/3099937242 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:36.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f5698b9a700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940ccf90 0x7f5694148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.314+0000 7f569939b700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56940cbf30 0x7f56940c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f5699b9c700 1 -- 172.21.15.154:0/3099937242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940ccf90 msgr2=0x7f5694148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f5699b9c700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940ccf90 0x7f5694148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f5699b9c700 1 -- 172.21.15.154:0/3099937242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56940cbf30 msgr2=0x7f56940c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f5699b9c700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56940cbf30 0x7f56940c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f5699b9c700 1 -- 172.21.15.154:0/3099937242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5684009420 con 0x7f569415a270 2023-10-10T21:02:36.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f5698b9a700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940ccf90 0x7f5694148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:36.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f5699b9c700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569415a270 0x7f56941490e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f568c00cbf0 tx=0x7f568c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:36.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f56897fa700 1 -- 172.21.15.154:0/3099937242 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00a910 con 0x7f569415a270 2023-10-10T21:02:36.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f56897fa700 1 -- 172.21.15.154:0/3099937242 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c00aa70 con 0x7f569415a270 2023-10-10T21:02:36.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f56897fa700 1 -- 172.21.15.154:0/3099937242 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00ae30 con 0x7f569415a270 2023-10-10T21:02:36.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f569b5ff700 1 -- 172.21.15.154:0/3099937242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56940a5be0 con 0x7f569415a270 2023-10-10T21:02:36.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.315+0000 7f569b5ff700 1 -- 172.21.15.154:0/3099937242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5694157cc0 con 0x7f569415a270 2023-10-10T21:02:36.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.317+0000 7f56897fa700 1 -- 172.21.15.154:0/3099937242 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f568c007300 con 0x7f569415a270 2023-10-10T21:02:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.318+0000 7f56897fa700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5678066f30 0x7f56780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.318+0000 7f56897fa700 1 -- 172.21.15.154:0/3099937242 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f568c084910 con 0x7f569415a270 2023-10-10T21:02:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.318+0000 7f569939b700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5678066f30 0x7f56780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.319+0000 7f569939b700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5678066f30 0x7f56780693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5690009db0 tx=0x7f56900091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.320+0000 7f56a9d7cb80 1 Processor -- start 2023-10-10T21:02:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.320+0000 7f56a9d7cb80 1 -- start start 2023-10-10T21:02:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1363e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 0x557cd138ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 0x557cd135fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd12baa70 con 0x557cd1363a50 2023-10-10T21:02:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd12b8270 con 0x557cd13add00 2023-10-10T21:02:36.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd12b4060 con 0x557cd138cf60 2023-10-10T21:02:36.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f569939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1363e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f569939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1363e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36630/0 (socket says 172.21.15.154:36630) 2023-10-10T21:02:36.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f569939b700 1 -- 172.21.15.154:0/190958821 learned_addr learned my addr 172.21.15.154:0/190958821 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:36.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f5698b9a700 1 --2- 172.21.15.154:0/190958821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 0x557cd138ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f5699b9c700 1 --2- 172.21.15.154:0/190958821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 0x557cd135fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f569939b700 1 -- 172.21.15.154:0/190958821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 msgr2=0x557cd135fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:36.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f569939b700 1 --2- 172.21.15.154:0/190958821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 0x557cd135fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f569939b700 1 -- 172.21.15.154:0/190958821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 msgr2=0x557cd138ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:36.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f569939b700 1 --2- 172.21.15.154:0/190958821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 0x557cd138ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.321+0000 7f569939b700 1 -- 172.21.15.154:0/190958821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cd114e270 con 0x557cd1363a50 2023-10-10T21:02:36.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.322+0000 7f569939b700 1 --2- 172.21.15.154:0/190958821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1363e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5690011f80 tx=0x7f5690019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e6c439a31f6f51 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:36.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.322+0000 7f567e7fc700 1 -- 172.21.15.154:0/190958821 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690021450 con 0x557cd1363a50 2023-10-10T21:02:36.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.322+0000 7f567e7fc700 1 -- 172.21.15.154:0/190958821 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56900215b0 con 0x557cd1363a50 2023-10-10T21:02:36.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.322+0000 7f567e7fc700 1 -- 172.21.15.154:0/190958821 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690021930 con 0x557cd1363a50 2023-10-10T21:02:36.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.322+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/190958821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 msgr2=0x557cd1363e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.322+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/190958821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1363e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5690011f80 tx=0x7f5690019000 comp rx=0 tx=0).stop 2023-10-10T21:02:36.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.323+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/190958821 shutdown_connections 2023-10-10T21:02:36.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.323+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/190958821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 0x557cd135fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.323+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/190958821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1363e20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.323+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/190958821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 0x557cd138ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.323+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/190958821 >> 172.21.15.154:0/190958821 conn(0x557cd1365370 msgr2=0x557cd1365740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:36.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.323+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/190958821 shutdown_connections 2023-10-10T21:02:36.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.323+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/190958821 wait complete. 2023-10-10T21:02:36.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.323+0000 7f56a9d7cb80 1 -- start start 2023-10-10T21:02:36.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.324+0000 7f56a9d7cb80 1 Processor -- start 2023-10-10T21:02:36.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.324+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd13a6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.324+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 0x557cd135f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.324+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 0x557cd13ba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.324+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd125f890 con 0x557cd1363a50 2023-10-10T21:02:36.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.324+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd127aea0 con 0x557cd13add00 2023-10-10T21:02:36.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.324+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd1136e30 con 0x557cd138cf60 2023-10-10T21:02:36.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f56a9d7cb80 10 client.0 _ll_register_callbacks cb 0x557cd1327110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:02:36.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f569939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd13a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f569939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd13a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36642/0 (socket says 172.21.15.154:36642) 2023-10-10T21:02:36.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f569939b700 1 -- 172.21.15.154:0/1529187374 learned_addr learned my addr 172.21.15.154:0/1529187374 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:36.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f5698b9a700 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 0x557cd135f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f5699b9c700 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 0x557cd13ba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f569939b700 1 -- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 msgr2=0x557cd135f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f569939b700 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 0x557cd135f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f569939b700 1 -- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 msgr2=0x557cd13ba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f569939b700 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 0x557cd13ba0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f569939b700 1 -- 172.21.15.154:0/1529187374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5690011b90 con 0x557cd1363a50 2023-10-10T21:02:36.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f569939b700 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd13a6290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5690011930 tx=0x7f5690022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e936fbd70cc79281 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:36.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.325+0000 7f56737fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:02:36.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56737fe700 1 -- 172.21.15.154:0/1529187374 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569002a700 con 0x557cd1363a50 2023-10-10T21:02:36.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56737fe700 1 -- 172.21.15.154:0/1529187374 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f569001a030 con 0x557cd1363a50 2023-10-10T21:02:36.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/1529187374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cd1358b70 con 0x557cd1363a50 2023-10-10T21:02:36.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56737fe700 1 -- 172.21.15.154:0/1529187374 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f569002aa70 con 0x557cd1363a50 2023-10-10T21:02:36.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56a9d7cb80 10 client.4650 fetch_fsmap learned FSMap version 7 2023-10-10T21:02:36.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/1529187374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557cd10f0fe0 con 0x557cd1363a50 2023-10-10T21:02:36.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56737fe700 1 -- 172.21.15.154:0/1529187374 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557cd1358b70 con 0x557cd1363a50 2023-10-10T21:02:36.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56737fe700 1 -- 172.21.15.154:0/1529187374 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f569002abd0 con 0x557cd1363a50 2023-10-10T21:02:36.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56a9d7cb80 10 client.4650 fetch_fsmap finished waiting for FSMap version 7 2023-10-10T21:02:36.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56a9d7cb80 10 client.4650 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-10T21:02:36.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56a9d7cb80 20 client.4650 populate_metadata read hostname 'smithi154' 2023-10-10T21:02:36.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] conn(0x557cd13a7b80 0x557cd13a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56a9d7cb80 4 client.4650 mds_command: new command op to 4279 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T21:02:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.326+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/1529187374 --> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557cd1335aa0 con 0x557cd13a7b80 2023-10-10T21:02:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.327+0000 7f5698b9a700 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] conn(0x557cd13a7b80 0x557cd13a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.327+0000 7f5698b9a700 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] conn(0x557cd13a7b80 0x557cd13a7f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d753883b7cdf410f server_cookie=4cf25e85446eb6f8 in_seq=0 out_seq=0 2023-10-10T21:02:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.327+0000 7f56737fe700 10 client.4650 ms_handle_connect on v2:172.21.15.179:6832/2053231138 2023-10-10T21:02:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56737fe700 1 -- 172.21.15.154:0/1529187374 <== mds.0 v2:172.21.15.179:6832/2053231138 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557cd1335aa0 con 0x557cd13a7b80 2023-10-10T21:02:36.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56737fe700 10 client.4650 handle_command_reply: tid=0 2023-10-10T21:02:36.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56a9d7cb80 1 client.4650 shutdown 2023-10-10T21:02:36.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/1529187374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 msgr2=0x557cd13a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd13a6290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5690011930 tx=0x7f5690022000 comp rx=0 tx=0).stop 2023-10-10T21:02:36.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/1529187374 shutdown_connections 2023-10-10T21:02:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd13add00 0x557cd13ba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd13a6290 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] conn(0x557cd13a7b80 0x557cd13a7f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/1529187374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd138cf60 0x557cd135f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/1529187374 >> 172.21.15.154:0/1529187374 conn(0x557cd1365370 msgr2=0x557cd13643e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:36.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.328+0000 7f56737fe700 0 client.4650 ms_handle_reset on v2:172.21.15.179:6832/2053231138 2023-10-10T21:02:36.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.329+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/1529187374 shutdown_connections 2023-10-10T21:02:36.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.329+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/1529187374 wait complete. 2023-10-10T21:02:36.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.329+0000 7f56a9d7cb80 20 client.4650 trim_cache size 0 max 16384 2023-10-10T21:02:36.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.346+0000 7f56a9d7cb80 1 Processor -- start 2023-10-10T21:02:36.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.346+0000 7f56a9d7cb80 1 -- start start 2023-10-10T21:02:36.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd1363a50 0x557cd135c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 0x557cd13642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd13add00 0x557cd13b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd13a1610 con 0x557cd13add00 2023-10-10T21:02:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd135e830 con 0x557cd138cf60 2023-10-10T21:02:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd1363370 con 0x557cd1363a50 2023-10-10T21:02:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5699b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd13add00 0x557cd13b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5699b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd13add00 0x557cd13b9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36658/0 (socket says 172.21.15.154:36658) 2023-10-10T21:02:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5699b9c700 1 -- 172.21.15.154:0/585851340 learned_addr learned my addr 172.21.15.154:0/585851340 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5699b9c700 1 -- 172.21.15.154:0/585851340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd1363a50 msgr2=0x557cd135c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5699b9c700 1 --2- 172.21.15.154:0/585851340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd1363a50 0x557cd135c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5698b9a700 1 --2- 172.21.15.154:0/585851340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 0x557cd13642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5699b9c700 1 -- 172.21.15.154:0/585851340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 msgr2=0x557cd13642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5699b9c700 1 --2- 172.21.15.154:0/585851340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 0x557cd13642d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5699b9c700 1 -- 172.21.15.154:0/585851340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cd1282780 con 0x557cd13add00 2023-10-10T21:02:36.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.347+0000 7f5699b9c700 1 --2- 172.21.15.154:0/585851340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd13add00 0x557cd13b9400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f568c00a340 tx=0x7f568c058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360574cf685aad31 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:36.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f567effd700 1 -- 172.21.15.154:0/585851340 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c055820 con 0x557cd13add00 2023-10-10T21:02:36.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f567effd700 1 -- 172.21.15.154:0/585851340 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c058a70 con 0x557cd13add00 2023-10-10T21:02:36.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f567effd700 1 -- 172.21.15.154:0/585851340 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c05c7c0 con 0x557cd13add00 2023-10-10T21:02:36.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/585851340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd13add00 msgr2=0x557cd13b9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/585851340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd13add00 0x557cd13b9400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f568c00a340 tx=0x7f568c058040 comp rx=0 tx=0).stop 2023-10-10T21:02:36.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/585851340 shutdown_connections 2023-10-10T21:02:36.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/585851340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd13add00 0x557cd13b9400 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/585851340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd1363a50 0x557cd135c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/585851340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 0x557cd13642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/585851340 >> 172.21.15.154:0/585851340 conn(0x557cd1365370 msgr2=0x557cd1365740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:36.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/585851340 shutdown_connections 2023-10-10T21:02:36.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.348+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/585851340 wait complete. 2023-10-10T21:02:36.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.349+0000 7f56a9d7cb80 1 -- start start 2023-10-10T21:02:36.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.349+0000 7f56a9d7cb80 1 Processor -- start 2023-10-10T21:02:36.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1417e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 0x557cd13bf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f56a9d7cb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd13add00 0x557cd13936a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd13b8e80 con 0x557cd1363a50 2023-10-10T21:02:36.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd13c2720 con 0x557cd138cf60 2023-10-10T21:02:36.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f56a9d7cb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd13a6800 con 0x557cd13add00 2023-10-10T21:02:36.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f56a9d7cb80 10 client.0 _ll_register_callbacks cb 0x557cd1327110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:02:36.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f569939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1417e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f569939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1417e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36668/0 (socket says 172.21.15.154:36668) 2023-10-10T21:02:36.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f569939b700 1 -- 172.21.15.154:0/2544794170 learned_addr learned my addr 172.21.15.154:0/2544794170 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:36.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f5698b9a700 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 0x557cd13bf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.350+0000 7f5699b9c700 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd13add00 0x557cd13936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f569939b700 1 -- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd13add00 msgr2=0x557cd13936a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:36.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f569939b700 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd13add00 0x557cd13936a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f569939b700 1 -- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 msgr2=0x557cd13bf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:36.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f569939b700 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 0x557cd13bf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f569939b700 1 -- 172.21.15.154:0/2544794170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5694157cc0 con 0x557cd1363a50 2023-10-10T21:02:36.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f569939b700 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1417e50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5690021580 tx=0x7f569002d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f9650d06d0439a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:36.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f56737fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:02:36.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f56737fe700 1 -- 172.21.15.154:0/2544794170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690006c90 con 0x557cd1363a50 2023-10-10T21:02:36.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f56737fe700 1 -- 172.21.15.154:0/2544794170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f569001a040 con 0x557cd1363a50 2023-10-10T21:02:36.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/2544794170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f56900215b0 con 0x557cd1363a50 2023-10-10T21:02:36.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f56737fe700 1 -- 172.21.15.154:0/2544794170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5690006df0 con 0x557cd1363a50 2023-10-10T21:02:36.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f56a9d7cb80 10 client.4656 fetch_fsmap learned FSMap version 7 2023-10-10T21:02:36.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/2544794170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557cd1269470 con 0x557cd1363a50 2023-10-10T21:02:36.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f56737fe700 1 -- 172.21.15.154:0/2544794170 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56900215b0 con 0x557cd1363a50 2023-10-10T21:02:36.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.351+0000 7f56737fe700 1 -- 172.21.15.154:0/2544794170 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5690035990 con 0x557cd1363a50 2023-10-10T21:02:36.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.352+0000 7f56a9d7cb80 10 client.4656 fetch_fsmap finished waiting for FSMap version 7 2023-10-10T21:02:36.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.352+0000 7f56a9d7cb80 10 client.4656 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-10T21:02:36.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.352+0000 7f56a9d7cb80 20 client.4656 populate_metadata read hostname 'smithi154' 2023-10-10T21:02:36.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.352+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] conn(0x557cd138bb30 0x557cd138bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:36.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.352+0000 7f56a9d7cb80 4 client.4656 mds_command: new command op to 4279 tid=0[{"prefix": "status"}] 2023-10-10T21:02:36.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.352+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/2544794170 --> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557cd1256e00 con 0x557cd138bb30 2023-10-10T21:02:36.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.352+0000 7f5698b9a700 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] conn(0x557cd138bb30 0x557cd138bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:36.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.352+0000 7f5698b9a700 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] conn(0x557cd138bb30 0x557cd138bf00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20569055a4e21daf server_cookie=7d9a05bc1f76e712 in_seq=0 out_seq=0 2023-10-10T21:02:36.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.352+0000 7f56737fe700 10 client.4656 ms_handle_connect on v2:172.21.15.179:6832/2053231138 2023-10-10T21:02:36.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56737fe700 1 -- 172.21.15.154:0/2544794170 <== mds.0 v2:172.21.15.179:6832/2053231138 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x557cd1256e00 con 0x557cd138bb30 2023-10-10T21:02:36.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56737fe700 10 client.4656 handle_command_reply: tid=0 2023-10-10T21:02:36.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 client.4656 shutdown 2023-10-10T21:02:36.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/2544794170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 msgr2=0x557cd1417e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1417e50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5690021580 tx=0x7f569002d040 comp rx=0 tx=0).stop 2023-10-10T21:02:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/2544794170 shutdown_connections 2023-10-10T21:02:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:6832/2053231138,v1:172.21.15.179:6833/2053231138] conn(0x557cd138bb30 0x557cd138bf00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557cd13add00 0x557cd13936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cd1363a50 0x557cd1417e50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56737fe700 0 client.4656 ms_handle_reset on v2:172.21.15.179:6832/2053231138 2023-10-10T21:02:36.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 --2- 172.21.15.154:0/2544794170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557cd138cf60 0x557cd13bf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/2544794170 >> 172.21.15.154:0/2544794170 conn(0x557cd1365370 msgr2=0x557cd135c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:36.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/2544794170 shutdown_connections 2023-10-10T21:02:36.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 1 -- 172.21.15.154:0/2544794170 wait complete. 2023-10-10T21:02:36.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.353+0000 7f56a9d7cb80 20 client.4656 trim_cache size 0 max 16384 2023-10-10T21:02:36.370 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:02:36.370 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T21:02:36.370 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T21:02:36.370 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4279, 2023-10-10T21:02:36.371 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T21:02:36.371 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T21:02:36.371 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T21:02:36.371 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 16.663664085000001, 2023-10-10T21:02:36.371 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 7, 2023-10-10T21:02:36.371 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 22, 2023-10-10T21:02:36.372 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 22, 2023-10-10T21:02:36.372 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 21.916564682000001 2023-10-10T21:02:36.372 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:02:36.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 -- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5678066f30 msgr2=0x7f56780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5678066f30 0x7f56780693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5690009db0 tx=0x7f56900091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 -- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569415a270 msgr2=0x7f56941490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:36.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569415a270 0x7f56941490e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f568c00cbf0 tx=0x7f568c0019b0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 -- 172.21.15.154:0/3099937242 shutdown_connections 2023-10-10T21:02:36.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569415a270 0x7f56941490e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56940cbf30 0x7f56940c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5678066f30 0x7f56780693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 --2- 172.21.15.154:0/3099937242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56940ccf90 0x7f5694148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:36.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 -- 172.21.15.154:0/3099937242 >> 172.21.15.154:0/3099937242 conn(0x7f569406a320 msgr2=0x7f5694068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:36.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 -- 172.21.15.154:0/3099937242 shutdown_connections 2023-10-10T21:02:36.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:36.354+0000 7f569b5ff700 1 -- 172.21.15.154:0/3099937242 wait complete. 2023-10-10T21:02:36.376 INFO:teuthology.run_tasks:Running task kclient... 2023-10-10T21:02:36.398 INFO:tasks.kclient:Mounting kernel clients... 2023-10-10T21:02:36.399 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-10T21:02:36.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:36.400 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:02:36.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:36.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-10-10T21:02:36.541 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2023-10-10T21:02:36.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T21:02:36.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:36.544 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:02:36.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:36.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-10-10T21:02:36.683 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2023-10-10T21:02:36.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T21:02:36.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:36.687 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-10T21:02:36.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:36.729 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-10T21:02:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-10-10T21:02:36.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T21:02:36.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:36.841 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-10T21:02:36.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:36.878 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-10T21:02:36.981 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-10-10T21:02:36.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T21:02:36.984 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-10T21:02:36.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:02:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.165+0000 7f9a487ff700 1 Processor -- start 2023-10-10T21:02:37.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.165+0000 7f9a487ff700 1 -- start start 2023-10-10T21:02:37.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.166+0000 7f9a487ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a40155c10 0x7f9a40155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:37.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a487ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a400ac6a0 0x7f9a400b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:37.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a487ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a400acac0 con 0x7f9a400ac230 2023-10-10T21:02:37.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a487ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a400ad930 con 0x7f9a400ac6a0 2023-10-10T21:02:37.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a487ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400acd20 con 0x7f9a40155c10 2023-10-10T21:02:37.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a46d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a400ac6a0 0x7f9a400b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:37.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a45d9a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9a400ac230 0x7f9a401568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:49300/0 (socket says 172.21.15.154:49300) 2023-10-10T21:02:37.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a46d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a400ac6a0 0x7f9a400b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36684/0 (socket says 172.21.15.154:36684) 2023-10-10T21:02:37.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a4659b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a40155c10 0x7f9a40155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:37.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a45d9a700 1 -- 172.21.15.154:0/343045347 learned_addr learned my addr 172.21.15.154:0/343045347 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:37.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a46d9c700 1 -- 172.21.15.154:0/343045347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a40155c10 msgr2=0x7f9a40155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:37.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a46d9c700 1 --2- 172.21.15.154:0/343045347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a40155c10 0x7f9a40155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a46d9c700 1 -- 172.21.15.154:0/343045347 >> v1:172.21.15.179:6789/0 conn(0x7f9a400ac230 legacy=0x7f9a401568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:37.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.167+0000 7f9a46d9c700 1 -- 172.21.15.154:0/343045347 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400ad000 con 0x7f9a400ac6a0 2023-10-10T21:02:37.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a46d9c700 1 --2- 172.21.15.154:0/343045347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac6a0 0x7f9a400b0300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009e60 tx=0x7f9a38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8834d4686bd712 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a45599700 1 -- 172.21.15.154:0/343045347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800e070 con 0x7f9a400ac6a0 2023-10-10T21:02:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a45599700 1 -- 172.21.15.154:0/343045347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3800bb60 con 0x7f9a400ac6a0 2023-10-10T21:02:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a45599700 1 -- 172.21.15.154:0/343045347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38012430 con 0x7f9a400ac6a0 2023-10-10T21:02:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a487ff700 1 -- 172.21.15.154:0/343045347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac6a0 msgr2=0x7f9a400b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a487ff700 1 --2- 172.21.15.154:0/343045347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac6a0 0x7f9a400b0300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009e60 tx=0x7f9a38009780 comp rx=0 tx=0).stop 2023-10-10T21:02:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a487ff700 1 -- 172.21.15.154:0/343045347 shutdown_connections 2023-10-10T21:02:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a487ff700 1 --2- 172.21.15.154:0/343045347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac6a0 0x7f9a400b0300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a487ff700 1 --2- 172.21.15.154:0/343045347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a40155c10 0x7f9a40155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a487ff700 1 -- 172.21.15.154:0/343045347 >> 172.21.15.154:0/343045347 conn(0x7f9a4006a320 msgr2=0x7f9a400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a487ff700 1 -- 172.21.15.154:0/343045347 shutdown_connections 2023-10-10T21:02:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.168+0000 7f9a487ff700 1 -- 172.21.15.154:0/343045347 wait complete. 2023-10-10T21:02:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.170+0000 7f9a487ff700 1 Processor -- start 2023-10-10T21:02:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.170+0000 7f9a487ff700 1 -- start start 2023-10-10T21:02:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a487ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac230 0x7f9a4006de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a487ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a400ac6a0 0x7f9a4015c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a487ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a40155c10 0x7f9a400c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a487ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4006e710 con 0x7f9a400ac230 2023-10-10T21:02:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a487ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4006e9f0 con 0x7f9a400ac6a0 2023-10-10T21:02:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a487ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4006ecd0 con 0x7f9a40155c10 2023-10-10T21:02:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a4659b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac230 0x7f9a4006de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a4659b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac230 0x7f9a4006de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36696/0 (socket says 172.21.15.154:36696) 2023-10-10T21:02:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a4659b700 1 -- 172.21.15.154:0/3334282694 learned_addr learned my addr 172.21.15.154:0/3334282694 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a4659b700 1 -- 172.21.15.154:0/3334282694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a40155c10 msgr2=0x7f9a400c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a4659b700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a40155c10 0x7f9a400c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a4659b700 1 -- 172.21.15.154:0/3334282694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a400ac6a0 msgr2=0x7f9a4015c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a4659b700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a400ac6a0 0x7f9a4015c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.171+0000 7f9a4659b700 1 -- 172.21.15.154:0/3334282694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38009a20 con 0x7f9a400ac230 2023-10-10T21:02:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.172+0000 7f9a4659b700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac230 0x7f9a4006de10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00e930 tx=0x7f9a3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.172+0000 7f9a367fc700 1 -- 172.21.15.154:0/3334282694 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00eed0 con 0x7f9a400ac230 2023-10-10T21:02:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.172+0000 7f9a367fc700 1 -- 172.21.15.154:0/3334282694 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c00c850 con 0x7f9a400ac230 2023-10-10T21:02:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.172+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4006efb0 con 0x7f9a400ac230 2023-10-10T21:02:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.172+0000 7f9a367fc700 1 -- 172.21.15.154:0/3334282694 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00cbf0 con 0x7f9a400ac230 2023-10-10T21:02:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.172+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4015cdb0 con 0x7f9a400ac230 2023-10-10T21:02:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.173+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4006f320 con 0x7f9a400ac230 2023-10-10T21:02:37.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.174+0000 7f9a367fc700 1 -- 172.21.15.154:0/3334282694 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a3c013470 con 0x7f9a400ac230 2023-10-10T21:02:37.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.175+0000 7f9a367fc700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9a24066f30 0x7f9a240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:37.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.175+0000 7f9a367fc700 1 -- 172.21.15.154:0/3334282694 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a3c084800 con 0x7f9a400ac230 2023-10-10T21:02:37.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.175+0000 7f9a45d9a700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9a24066f30 0x7f9a240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:37.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.176+0000 7f9a45d9a700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9a24066f30 0x7f9a240693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a4016d380 tx=0x7f9a30007b30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:37.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.179+0000 7f9a367fc700 1 -- 172.21.15.154:0/3334282694 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a3c0519d0 con 0x7f9a400ac230 2023-10-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.416+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9a4004c3c0 con 0x7f9a400ac230 2023-10-10T21:02:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.417+0000 7f9a367fc700 1 -- 172.21.15.154:0/3334282694 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9a3c054ff0 con 0x7f9a400ac230 2023-10-10T21:02:37.419 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:02:37.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9a24066f30 msgr2=0x7f9a240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:37.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9a24066f30 0x7f9a240693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a4016d380 tx=0x7f9a30007b30 comp rx=0 tx=0).stop 2023-10-10T21:02:37.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac230 msgr2=0x7f9a4006de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:37.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac230 0x7f9a4006de10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00e930 tx=0x7f9a3c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 shutdown_connections 2023-10-10T21:02:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9a24066f30 0x7f9a240693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a40155c10 0x7f9a400c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a400ac230 0x7f9a4006de10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 --2- 172.21.15.154:0/3334282694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a400ac6a0 0x7f9a4015c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.419+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 >> 172.21.15.154:0/3334282694 conn(0x7f9a4006a320 msgr2=0x7f9a400c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.420+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 shutdown_connections 2023-10-10T21:02:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:37.420+0000 7f9a487ff700 1 -- 172.21.15.154:0/3334282694 wait complete. 2023-10-10T21:02:37.439 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-10T21:02:37.488 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:02:37.488 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T21:02:37.489 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T21:02:37.489 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T21:02:37.489 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-10T21:02:37.489 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-10T21:02:37.490 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:02:37.490 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:02:37.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:37.491 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T21:02:37.528 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:02:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:02:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:02:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:02:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:37.529 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T21:02:37.530 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T21:02:37.530 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:37.531 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:02:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:02:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42256sec preferred_lft 42256sec 2023-10-10T21:02:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T21:02:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:37.532 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-10T21:02:37.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:37.533 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:02:37.533 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:02:37.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add name ceph-brx type bridge 2023-10-10T21:02:37.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr flush dev ceph-brx 2023-10-10T21:02:37.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set ceph-brx up 2023-10-10T21:02:37.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-10T21:02:37.535 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:02:37.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:37.976 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:02:38.040 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T21:02:38.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:38.043 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T21:02:38.102 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T21:02:38.103 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:02:38.103 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:02:38.103 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:02:38.103 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:02:38.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:38.105 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:02:38.105 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:02:38.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:02:38.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:02:38.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:02:38.107 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:02:38.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:38.773 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:02:38.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:38.810 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-10-10T21:02:38.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:38.887 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:02:38.887 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:02:38.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T21:02:38.888 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-10T21:02:38.888 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:02:39.054 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-10T21:02:39.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:39.055 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:02:39.055 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:02:39.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-10T21:02:39.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-10T21:02:39.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-10T21:02:39.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-10T21:02:39.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-10T21:02:39.057 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:02:39.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:39.305 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:02:39.305 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:02:39.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T21:02:39.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.0 master ceph-brx 2023-10-10T21:02:39.306 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:02:39.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:02:39.463 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T21:02:39.500 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:02:39.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:02:39.501 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:02:39.576 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:02:39.576 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:02:39.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:02:39.719 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:02:39.721 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:02:39.721 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:02:40.167 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:02:40.167 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:02:40.168 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:02:40.168 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:02:40.168 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:02:40.191 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:02:40.192 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:02:40.192 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:02:40.192 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:02:40.192 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:02:40.192 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:02:40.193 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:02:40.193 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:02:40.198 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:02:40.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:40.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:02:40.263 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-10T21:02:40.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:02:40.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.444+0000 7fcd7999d700 1 Processor -- start 2023-10-10T21:02:40.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.445+0000 7fcd7999d700 1 -- start start 2023-10-10T21:02:40.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd74150180 0x7fcd74157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:40.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7999d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcd74150550 0x7fcd740c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7999d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd740c7240 0x7fcd74069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7999d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd740c76e0 con 0x7fcd740c7240 2023-10-10T21:02:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7999d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7406e2a0 con 0x7fcd74150550 2023-10-10T21:02:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7406b2e0 con 0x7fcd74150180 2023-10-10T21:02:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7919c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd740c7240 0x7fcd74069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7919c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd740c7240 0x7fcd74069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36712/0 (socket says 172.21.15.154:36712) 2023-10-10T21:02:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7919c700 1 -- 172.21.15.154:0/1413523854 learned_addr learned my addr 172.21.15.154:0/1413523854 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd7899b700 1 --2- 172.21.15.154:0/1413523854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd74150180 0x7fcd74157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.446+0000 7fcd73fff700 1 --2- 172.21.15.154:0/1413523854 >> v2:172.21.15.179:3300/0 conn(0x7fcd74150550 0x7fcd740c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd7919c700 1 -- 172.21.15.154:0/1413523854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd74150180 msgr2=0x7fcd74157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd7919c700 1 --2- 172.21.15.154:0/1413523854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd74150180 0x7fcd74157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd7919c700 1 -- 172.21.15.154:0/1413523854 >> v2:172.21.15.179:3300/0 conn(0x7fcd74150550 msgr2=0x7fcd740c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd7919c700 1 --2- 172.21.15.154:0/1413523854 >> v2:172.21.15.179:3300/0 conn(0x7fcd74150550 0x7fcd740c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd7919c700 1 -- 172.21.15.154:0/1413523854 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd740c78e0 con 0x7fcd740c7240 2023-10-10T21:02:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd7899b700 1 --2- 172.21.15.154:0/1413523854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd74150180 0x7fcd74157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:40.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd7919c700 1 --2- 172.21.15.154:0/1413523854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740c7240 0x7fcd74069f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcd7406c030 tx=0x7fcd6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313448d6fa63c8eb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:40.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd737fe700 1 -- 172.21.15.154:0/1413523854 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0092e0 con 0x7fcd740c7240 2023-10-10T21:02:40.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd737fe700 1 -- 172.21.15.154:0/1413523854 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00b990 con 0x7fcd740c7240 2023-10-10T21:02:40.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.447+0000 7fcd737fe700 1 -- 172.21.15.154:0/1413523854 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00bd50 con 0x7fcd740c7240 2023-10-10T21:02:40.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.448+0000 7fcd7999d700 1 -- 172.21.15.154:0/1413523854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740c7240 msgr2=0x7fcd74069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:40.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.448+0000 7fcd7999d700 1 --2- 172.21.15.154:0/1413523854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740c7240 0x7fcd74069f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcd7406c030 tx=0x7fcd6c009840 comp rx=0 tx=0).stop 2023-10-10T21:02:40.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.448+0000 7fcd7999d700 1 -- 172.21.15.154:0/1413523854 shutdown_connections 2023-10-10T21:02:40.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.448+0000 7fcd7999d700 1 --2- 172.21.15.154:0/1413523854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740c7240 0x7fcd74069f50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.448+0000 7fcd7999d700 1 --2- 172.21.15.154:0/1413523854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd74150180 0x7fcd74157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.448+0000 7fcd7999d700 1 --2- 172.21.15.154:0/1413523854 >> v2:172.21.15.179:3300/0 conn(0x7fcd74150550 0x7fcd740c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.448+0000 7fcd7999d700 1 -- 172.21.15.154:0/1413523854 >> 172.21.15.154:0/1413523854 conn(0x7fcd740cc1f0 msgr2=0x7fcd740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:40.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.448+0000 7fcd7999d700 1 -- 172.21.15.154:0/1413523854 shutdown_connections 2023-10-10T21:02:40.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.448+0000 7fcd7999d700 1 -- 172.21.15.154:0/1413523854 wait complete. 2023-10-10T21:02:40.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.449+0000 7fcd7999d700 1 Processor -- start 2023-10-10T21:02:40.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.450+0000 7fcd7999d700 1 -- start start 2023-10-10T21:02:40.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.450+0000 7fcd7999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd740c7240 0x7fcd7416ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:40.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.450+0000 7fcd7999d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd74150180 0x7fcd740aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:40.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.450+0000 7fcd7999d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd74150550 0x7fcd74159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:40.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.450+0000 7fcd7999d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74159290 con 0x7fcd74150550 2023-10-10T21:02:40.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.450+0000 7fcd7999d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74159af0 con 0x7fcd74150180 2023-10-10T21:02:40.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.450+0000 7fcd7999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7416e440 con 0x7fcd740c7240 2023-10-10T21:02:40.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd74150550 0x7fcd74159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:40.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd74150550 0x7fcd74159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36720/0 (socket says 172.21.15.154:36720) 2023-10-10T21:02:40.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7919c700 1 -- 172.21.15.154:0/3535290564 learned_addr learned my addr 172.21.15.154:0/3535290564 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:40.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd73fff700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd74150180 0x7fcd740aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:40.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7899b700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd740c7240 0x7fcd7416ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:40.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7919c700 1 -- 172.21.15.154:0/3535290564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd740c7240 msgr2=0x7fcd7416ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:40.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7919c700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd740c7240 0x7fcd7416ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7919c700 1 -- 172.21.15.154:0/3535290564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd74150180 msgr2=0x7fcd740aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:40.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7919c700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd74150180 0x7fcd740aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7919c700 1 -- 172.21.15.154:0/3535290564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c009ae0 con 0x7fcd74150550 2023-10-10T21:02:40.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd7919c700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd74150550 0x7fcd74159f80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009880 tx=0x7fcd6c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:40.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd70ff9700 1 -- 172.21.15.154:0/3535290564 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0032f0 con 0x7fcd74150550 2023-10-10T21:02:40.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.452+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd741594a0 con 0x7fcd74150550 2023-10-10T21:02:40.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.451+0000 7fcd70ff9700 1 -- 172.21.15.154:0/3535290564 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c01a660 con 0x7fcd74150550 2023-10-10T21:02:40.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.452+0000 7fcd70ff9700 1 -- 172.21.15.154:0/3535290564 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c01aa00 con 0x7fcd74150550 2023-10-10T21:02:40.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.452+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd740af4d0 con 0x7fcd74150550 2023-10-10T21:02:40.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.453+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7404bbe0 con 0x7fcd74150550 2023-10-10T21:02:40.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.453+0000 7fcd70ff9700 1 -- 172.21.15.154:0/3535290564 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd6c003040 con 0x7fcd74150550 2023-10-10T21:02:40.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.454+0000 7fcd70ff9700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fcd58066f30 0x7fcd580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:40.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.454+0000 7fcd70ff9700 1 -- 172.21.15.154:0/3535290564 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd6c086110 con 0x7fcd74150550 2023-10-10T21:02:40.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.455+0000 7fcd7899b700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fcd58066f30 0x7fcd580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:40.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.455+0000 7fcd7899b700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fcd58066f30 0x7fcd580693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcd68006f00 tx=0x7fcd68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:40.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.459+0000 7fcd70ff9700 1 -- 172.21.15.154:0/3535290564 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd6c053380 con 0x7fcd74150550 2023-10-10T21:02:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.697+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcd7404c3c0 con 0x7fcd74150550 2023-10-10T21:02:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.697+0000 7fcd70ff9700 1 -- 172.21.15.154:0/3535290564 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcd6c0569a0 con 0x7fcd74150550 2023-10-10T21:02:40.699 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:02:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fcd58066f30 msgr2=0x7fcd580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fcd58066f30 0x7fcd580693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcd68006f00 tx=0x7fcd68008040 comp rx=0 tx=0).stop 2023-10-10T21:02:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd74150550 msgr2=0x7fcd74159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd74150550 0x7fcd74159f80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009880 tx=0x7fcd6c01a000 comp rx=0 tx=0).stop 2023-10-10T21:02:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 shutdown_connections 2023-10-10T21:02:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd74150550 0x7fcd74159f80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fcd58066f30 0x7fcd580693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd740c7240 0x7fcd7416ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 --2- 172.21.15.154:0/3535290564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd74150180 0x7fcd740aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 >> 172.21.15.154:0/3535290564 conn(0x7fcd740cc1f0 msgr2=0x7fcd740cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 shutdown_connections 2023-10-10T21:02:40.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:40.700+0000 7fcd7999d700 1 -- 172.21.15.154:0/3535290564 wait complete. 2023-10-10T21:02:40.719 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-10T21:02:40.719 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:02:40.719 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T21:02:40.720 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-10T21:02:40.720 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-10T21:02:40.720 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-10T21:02:40.720 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-10T21:02:40.721 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:02:40.721 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-10T21:02:40.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:40.722 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T21:02:40.759 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:02:40.759 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:02:40.759 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:02:40.759 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:40.760 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:02:40.760 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:40.760 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:40.760 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:40.760 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T21:02:40.761 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:40.761 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:40.761 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T21:02:40.761 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:40.761 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:40.761 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:02:40.762 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:40.762 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:02:40.762 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42253sec preferred_lft 42253sec 2023-10-10T21:02:40.762 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T21:02:40.762 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:40.763 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:02:40.763 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:40.763 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T21:02:40.763 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:40.763 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T21:02:40.764 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:40.764 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:02:40.764 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T21:02:40.764 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link tentative 2023-10-10T21:02:40.764 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:40.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:40.765 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:02:40.858 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T21:02:40.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:40.862 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T21:02:40.902 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T21:02:40.902 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:02:40.903 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:02:40.903 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:02:40.903 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:02:40.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:40.904 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:02:40.904 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:02:40.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:02:40.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:02:40.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:02:40.905 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:02:41.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:41.099 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:02:41.135 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T21:02:41.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:41.137 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-10-10T21:02:41.213 INFO:teuthology.orchestra.run.smithi154.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-10T21:02:41.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:41.214 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:02:41.214 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:02:41.215 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T21:02:41.215 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-10T21:02:41.215 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:02:41.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:41.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-10T21:02:41.441 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:02:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:02:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:02:41.441 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:02:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:41.442 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:02:41.442 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 62:0b:23:0a:5c:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-10T21:02:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-10T21:02:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::600b:23ff:fe0a:5c70/64 scope link 2023-10-10T21:02:41.443 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:41.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:41.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-10T21:02:41.506 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:02:41.506 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:02:41.507 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:02:41.507 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:41.507 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:02:41.507 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:41.507 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:02:41.508 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 62:0b:23:0a:5c:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-10T21:02:41.508 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-10T21:02:41.508 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:41.508 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::600b:23ff:fe0a:5c70/64 scope link 2023-10-10T21:02:41.508 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:41.510 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-10T21:02:41.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:41.510 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:02:41.511 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:02:41.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-10T21:02:41.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-10T21:02:41.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-10T21:02:41.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-10T21:02:41.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-10T21:02:41.513 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:02:41.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:41.744 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:02:41.744 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:02:41.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.1 up 2023-10-10T21:02:41.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.1 master ceph-brx 2023-10-10T21:02:41.745 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:02:41.902 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:02:41.903 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-10T21:02:41.940 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-10T21:02:41.940 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:02:41.941 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-10T21:02:42.016 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:02:42.016 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:02:42.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-10T21:02:42.146 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-10T21:02:42.147 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-10T21:02:42.147 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:02:42.163 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-10T21:02:42.163 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-10T21:02:42.163 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:02:42.163 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:02:42.163 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:02:42.184 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-10T21:02:42.184 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-10T21:02:42.185 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:02:42.185 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:02:42.185 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:02:42.185 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:02:42.185 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:02:42.185 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:02:42.188 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:02:42.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:42.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-10T21:02:42.250 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-10T21:02:42.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:02:42.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.430+0000 7fd07d99d700 1 Processor -- start 2023-10-10T21:02:42.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.430+0000 7fd07d99d700 1 -- start start 2023-10-10T21:02:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.431+0000 7fd07d99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd078150550 0x7fd078157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.431+0000 7fd07d99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07806e2a0 con 0x7fd0780c7410 2023-10-10T21:02:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.431+0000 7fd07d99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07806b2e0 con 0x7fd078150180 2023-10-10T21:02:42.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.431+0000 7fd07d99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0780c78e0 con 0x7fd078150550 2023-10-10T21:02:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.431+0000 7fd07d19c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd0780c7410 0x7fd078069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47432/0 (socket says 172.21.15.154:47432) 2023-10-10T21:02:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.431+0000 7fd07d19c700 1 -- 172.21.15.154:0/1891120268 learned_addr learned my addr 172.21.15.154:0/1891120268 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.431+0000 7fd077fff700 1 --2- 172.21.15.154:0/1891120268 >> v2:172.21.15.179:3300/0 conn(0x7fd078150550 0x7fd078157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd0777fe700 1 -- 172.21.15.154:0/1891120268 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925031344 0 0) 0x7fd07806e2a0 con 0x7fd0780c7410 2023-10-10T21:02:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd0777fe700 1 -- 172.21.15.154:0/1891120268 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd068003570 con 0x7fd0780c7410 2023-10-10T21:02:42.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd0777fe700 1 -- 172.21.15.154:0/1891120268 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919207146 0 0) 0x7fd07806b2e0 con 0x7fd078150180 2023-10-10T21:02:42.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd0777fe700 1 -- 172.21.15.154:0/1891120268 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd07806e2a0 con 0x7fd078150180 2023-10-10T21:02:42.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd077fff700 1 -- 172.21.15.154:0/1891120268 >> v1:172.21.15.179:6789/0 conn(0x7fd078150180 legacy=0x7fd0780c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:42.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd077fff700 1 -- 172.21.15.154:0/1891120268 >> v1:172.21.15.154:6789/0 conn(0x7fd0780c7410 legacy=0x7fd078069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd077fff700 1 -- 172.21.15.154:0/1891120268 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0780c7bc0 con 0x7fd078150550 2023-10-10T21:02:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd077fff700 1 --2- 172.21.15.154:0/1891120268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd078150550 0x7fd078157770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd06400a9f0 tx=0x7fd06400a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbddf7c883f89b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd0777fe700 1 -- 172.21.15.154:0/1891120268 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06400c6b0 con 0x7fd078150550 2023-10-10T21:02:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd0777fe700 1 -- 172.21.15.154:0/1891120268 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06400c810 con 0x7fd078150550 2023-10-10T21:02:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.432+0000 7fd0777fe700 1 -- 172.21.15.154:0/1891120268 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06400cbd0 con 0x7fd078150550 2023-10-10T21:02:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.433+0000 7fd07d99d700 1 -- 172.21.15.154:0/1891120268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd078150550 msgr2=0x7fd078157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.433+0000 7fd07d99d700 1 --2- 172.21.15.154:0/1891120268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd078150550 0x7fd078157770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd06400a9f0 tx=0x7fd06400a290 comp rx=0 tx=0).stop 2023-10-10T21:02:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.433+0000 7fd07d99d700 1 -- 172.21.15.154:0/1891120268 shutdown_connections 2023-10-10T21:02:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.433+0000 7fd07d99d700 1 --2- 172.21.15.154:0/1891120268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd078150550 0x7fd078157770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.433+0000 7fd07d99d700 1 -- 172.21.15.154:0/1891120268 >> 172.21.15.154:0/1891120268 conn(0x7fd0780cc1f0 msgr2=0x7fd0780cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:42.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.433+0000 7fd07d99d700 1 -- 172.21.15.154:0/1891120268 shutdown_connections 2023-10-10T21:02:42.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.433+0000 7fd07d99d700 1 -- 172.21.15.154:0/1891120268 wait complete. 2023-10-10T21:02:42.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.434+0000 7fd07d99d700 1 Processor -- start 2023-10-10T21:02:42.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.435+0000 7fd07d99d700 1 -- start start 2023-10-10T21:02:42.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.435+0000 7fd07d99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0780c7410 0x7fd0780addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.435+0000 7fd07d99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd078150180 0x7fd07814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078150550 0x7fd07814a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07814b530 con 0x7fd078150550 2023-10-10T21:02:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780ac540 con 0x7fd078150180 2023-10-10T21:02:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780abc30 con 0x7fd0780c7410 2023-10-10T21:02:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078150550 0x7fd07814a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078150550 0x7fd07814a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36722/0 (socket says 172.21.15.154:36722) 2023-10-10T21:02:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d19c700 1 -- 172.21.15.154:0/262981569 learned_addr learned my addr 172.21.15.154:0/262981569 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d19c700 1 -- 172.21.15.154:0/262981569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0780c7410 msgr2=0x7fd0780addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d19c700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0780c7410 0x7fd0780addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:42.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d19c700 1 -- 172.21.15.154:0/262981569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd078150180 msgr2=0x7fd07814aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:42.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d19c700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd078150180 0x7fd07814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:42.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d19c700 1 -- 172.21.15.154:0/262981569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06400a530 con 0x7fd078150550 2023-10-10T21:02:42.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.436+0000 7fd07d19c700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078150550 0x7fd07814a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd070001460 tx=0x7fd070001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:42.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.437+0000 7fd074ff9700 1 -- 172.21.15.154:0/262981569 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000cea0 con 0x7fd078150550 2023-10-10T21:02:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.437+0000 7fd074ff9700 1 -- 172.21.15.154:0/262981569 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07000ac00 con 0x7fd078150550 2023-10-10T21:02:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.437+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0780abef0 con 0x7fd078150550 2023-10-10T21:02:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.437+0000 7fd074ff9700 1 -- 172.21.15.154:0/262981569 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0700070f0 con 0x7fd078150550 2023-10-10T21:02:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.437+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07814ad80 con 0x7fd078150550 2023-10-10T21:02:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.438+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0780ac8d0 con 0x7fd078150550 2023-10-10T21:02:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.439+0000 7fd074ff9700 1 -- 172.21.15.154:0/262981569 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd070007460 con 0x7fd078150550 2023-10-10T21:02:42.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.439+0000 7fd074ff9700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd05c066f30 0x7fd05c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:42.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.440+0000 7fd074ff9700 1 -- 172.21.15.154:0/262981569 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd070084a10 con 0x7fd078150550 2023-10-10T21:02:42.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.440+0000 7fd07c99b700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd05c066f30 0x7fd05c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:42.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.440+0000 7fd07c99b700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd05c066f30 0x7fd05c0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0026f0 tx=0x7fd06c0079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:42.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.444+0000 7fd074ff9700 1 -- 172.21.15.154:0/262981569 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0780ac8d0 con 0x7fd078150550 2023-10-10T21:02:42.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.679+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0780ac8d0 con 0x7fd078150550 2023-10-10T21:02:42.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.679+0000 7fd074ff9700 1 -- 172.21.15.154:0/262981569 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd0780ac8d0 con 0x7fd078150550 2023-10-10T21:02:42.681 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:02:42.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd05c066f30 msgr2=0x7fd05c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:42.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd05c066f30 0x7fd05c0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0026f0 tx=0x7fd06c0079d0 comp rx=0 tx=0).stop 2023-10-10T21:02:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078150550 msgr2=0x7fd07814a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078150550 0x7fd07814a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd070001460 tx=0x7fd070001ac0 comp rx=0 tx=0).stop 2023-10-10T21:02:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 shutdown_connections 2023-10-10T21:02:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd078150550 0x7fd07814a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd05c066f30 0x7fd05c0693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:42.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0780c7410 0x7fd0780addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:42.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 --2- 172.21.15.154:0/262981569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd078150180 0x7fd07814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:42.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 >> 172.21.15.154:0/262981569 conn(0x7fd0780cc1f0 msgr2=0x7fd0780cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:42.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 shutdown_connections 2023-10-10T21:02:42.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:42.682+0000 7fd07d99d700 1 -- 172.21.15.154:0/262981569 wait complete. 2023-10-10T21:02:42.701 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-10T21:02:42.701 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:02:42.702 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-10-10T21:02:42.702 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-10T21:02:42.702 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-10T21:02:42.702 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-10T21:02:42.703 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-10T21:02:42.703 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:02:42.703 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-10T21:02:42.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:42.704 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-10-10T21:02:42.745 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:02:42.745 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:02:42.746 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:02:42.746 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:42.746 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-10T21:02:42.746 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:42.746 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:42.747 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:42.747 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-10-10T21:02:42.747 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:42.747 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:42.747 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-10-10T21:02:42.748 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:42.748 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:42.748 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:02:42.748 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:42.748 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:02:42.748 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42236sec preferred_lft 42236sec 2023-10-10T21:02:42.749 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-10-10T21:02:42.749 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:42.749 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-10T21:02:42.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:42.750 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-10T21:02:42.750 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-10T21:02:42.750 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2023-10-10T21:02:42.751 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2023-10-10T21:02:42.751 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2023-10-10T21:02:42.751 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-10T21:02:42.752 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-10T21:02:43.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:43.204 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-10T21:02:43.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:43.353 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-10-10T21:02:43.402 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-10-10T21:02:43.402 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:02:43.402 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:02:43.403 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:02:43.403 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:02:43.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:43.404 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-10T21:02:43.405 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-10T21:02:43.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:02:43.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:02:43.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:02:43.406 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-10T21:02:44.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:44.137 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-10T21:02:44.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:44.174 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-10-10T21:02:44.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:44.250 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-10T21:02:44.251 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-10T21:02:44.251 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-10T21:02:44.251 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-10T21:02:44.252 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-10T21:02:44.415 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-10T21:02:44.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:44.416 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-10T21:02:44.416 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-10T21:02:44.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-10T21:02:44.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-10T21:02:44.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-10T21:02:44.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-10T21:02:44.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-10T21:02:44.418 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-10T21:02:44.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:44.686 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-10T21:02:44.687 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-10T21:02:44.687 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-10-10T21:02:44.687 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2023-10-10T21:02:44.687 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-10T21:02:44.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:02:44.845 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-10T21:02:44.881 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-10T21:02:44.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:02:44.882 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-10T21:02:44.957 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:02:44.958 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:02:44.958 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-10T21:02:45.104 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-10T21:02:45.105 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-10T21:02:45.105 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-10T21:02:45.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:02:45.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:02:45.578 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-10T21:02:45.578 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-10T21:02:45.578 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-10T21:02:45.579 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:02:45.579 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:02:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-10T21:02:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-10T21:02:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-10T21:02:45.605 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:02:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:02:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:02:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:02:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:02:45.609 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:02:45.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:45.610 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-10T21:02:45.672 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-10T21:02:45.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:02:45.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.865+0000 7f1ffbfff700 1 Processor -- start 2023-10-10T21:02:45.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.865+0000 7f1ffbfff700 1 -- start start 2023-10-10T21:02:45.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.866+0000 7f1ffbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ffc1597f0 0x7f1ffc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:45.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.866+0000 7f1ffbfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc0b11d0 con 0x7f1ffc15d230 2023-10-10T21:02:45.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.866+0000 7f1ffbfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc0b14b0 con 0x7f1ffc159420 2023-10-10T21:02:45.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.866+0000 7f1ffbfff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0b1790 con 0x7f1ffc1597f0 2023-10-10T21:02:45.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.866+0000 7f1ffa7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ffc1597f0 0x7f1ffc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:45.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.867+0000 7f1ffa7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ffc1597f0 0x7f1ffc0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54996/0 (socket says 172.21.15.154:54996) 2023-10-10T21:02:45.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.867+0000 7f1ffb7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1ffc15d230 0x7f1ffc15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51438/0 (socket says 172.21.15.154:51438) 2023-10-10T21:02:45.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.867+0000 7f1ffa7fc700 1 -- 172.21.15.154:0/2008750986 learned_addr learned my addr 172.21.15.154:0/2008750986 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:45.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.867+0000 7f1ffa7fc700 1 -- 172.21.15.154:0/2008750986 >> v1:172.21.15.179:6789/0 conn(0x7f1ffc159420 legacy=0x7f1ffc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:45.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.867+0000 7f1ffa7fc700 1 -- 172.21.15.154:0/2008750986 >> v1:172.21.15.154:6789/0 conn(0x7f1ffc15d230 legacy=0x7f1ffc15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:45.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.867+0000 7f1ffa7fc700 1 -- 172.21.15.154:0/2008750986 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0b1a70 con 0x7f1ffc1597f0 2023-10-10T21:02:45.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.867+0000 7f1ff9ffb700 1 -- 172.21.15.154:0/2008750986 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305903375 0 0) 0x7f1ffc0b11d0 con 0x7f1ffc15d230 2023-10-10T21:02:45.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.867+0000 7f1ffa7fc700 1 --2- 172.21.15.154:0/2008750986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 0x7f1ffc0b2270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00099b0 tx=0x7f1ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bb457730b1a8d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:45.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.867+0000 7f1ff9ffb700 1 -- 172.21.15.154:0/2008750986 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000b860 con 0x7f1ffc1597f0 2023-10-10T21:02:45.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.868+0000 7f1ff9ffb700 1 -- 172.21.15.154:0/2008750986 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000b9c0 con 0x7f1ffc1597f0 2023-10-10T21:02:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.868+0000 7f1ff9ffb700 1 -- 172.21.15.154:0/2008750986 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000bd60 con 0x7f1ffc1597f0 2023-10-10T21:02:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.868+0000 7f1ffbfff700 1 -- 172.21.15.154:0/2008750986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 msgr2=0x7f1ffc0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.868+0000 7f1ffbfff700 1 --2- 172.21.15.154:0/2008750986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 0x7f1ffc0b2270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00099b0 tx=0x7f1ff0009250 comp rx=0 tx=0).stop 2023-10-10T21:02:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.868+0000 7f1ffbfff700 1 -- 172.21.15.154:0/2008750986 shutdown_connections 2023-10-10T21:02:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.868+0000 7f1ffbfff700 1 --2- 172.21.15.154:0/2008750986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 0x7f1ffc0b2270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.868+0000 7f1ffbfff700 1 -- 172.21.15.154:0/2008750986 >> 172.21.15.154:0/2008750986 conn(0x7f1ffc0d0660 msgr2=0x7f1ffc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.868+0000 7f1ffbfff700 1 -- 172.21.15.154:0/2008750986 shutdown_connections 2023-10-10T21:02:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.868+0000 7f1ffbfff700 1 -- 172.21.15.154:0/2008750986 wait complete. 2023-10-10T21:02:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.870+0000 7f1ffbfff700 1 Processor -- start 2023-10-10T21:02:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.870+0000 7f1ffbfff700 1 -- start start 2023-10-10T21:02:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.871+0000 7f1ffbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc159420 0x7f1ffc0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.871+0000 7f1ffbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 0x7f1ffc15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.871+0000 7f1ffbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ffc15d230 0x7f1ffc0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.871+0000 7f1ffbfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc15b140 con 0x7f1ffc1597f0 2023-10-10T21:02:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.871+0000 7f1ffbfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc15bf40 con 0x7f1ffc159420 2023-10-10T21:02:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.871+0000 7f1ffbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc15b330 con 0x7f1ffc15d230 2023-10-10T21:02:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.871+0000 7f1ffa7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 0x7f1ffc15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.871+0000 7f1ffa7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 0x7f1ffc15ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55000/0 (socket says 172.21.15.154:55000) 2023-10-10T21:02:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.871+0000 7f1ffa7fc700 1 -- 172.21.15.154:0/1496545763 learned_addr learned my addr 172.21.15.154:0/1496545763 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffb7fe700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ffc15d230 0x7f1ffc0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffaffd700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc159420 0x7f1ffc0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffa7fc700 1 -- 172.21.15.154:0/1496545763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ffc15d230 msgr2=0x7f1ffc0cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffa7fc700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ffc15d230 0x7f1ffc0cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffa7fc700 1 -- 172.21.15.154:0/1496545763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc159420 msgr2=0x7f1ffc0c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffa7fc700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc159420 0x7f1ffc0c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffa7fc700 1 -- 172.21.15.154:0/1496545763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00094f0 con 0x7f1ffc1597f0 2023-10-10T21:02:45.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffaffd700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc159420 0x7f1ffc0c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:45.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffa7fc700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 0x7f1ffc15ac00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006f50 tx=0x7f1ff0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:45.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1fe2ffd700 1 -- 172.21.15.154:0/1496545763 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff001f070 con 0x7f1ffc1597f0 2023-10-10T21:02:45.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1fe2ffd700 1 -- 172.21.15.154:0/1496545763 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff0011c60 con 0x7f1ffc1597f0 2023-10-10T21:02:45.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1fe2ffd700 1 -- 172.21.15.154:0/1496545763 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0025420 con 0x7f1ffc1597f0 2023-10-10T21:02:45.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.872+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc15b610 con 0x7f1ffc1597f0 2023-10-10T21:02:45.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.873+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc15bbd0 con 0x7f1ffc1597f0 2023-10-10T21:02:45.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.873+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc04c3c0 con 0x7f1ffc1597f0 2023-10-10T21:02:45.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.874+0000 7f1fe2ffd700 1 -- 172.21.15.154:0/1496545763 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ff0023070 con 0x7f1ffc1597f0 2023-10-10T21:02:45.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.875+0000 7f1fe2ffd700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fe8066f30 0x7f1fe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:45.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.875+0000 7f1fe2ffd700 1 -- 172.21.15.154:0/1496545763 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ff0085810 con 0x7f1ffc1597f0 2023-10-10T21:02:45.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.875+0000 7f1ffaffd700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fe8066f30 0x7f1fe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:45.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.876+0000 7f1ffaffd700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fe8066f30 0x7f1fe80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fec007fd0 tx=0x7f1fec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:45.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:45.880+0000 7f1fe2ffd700 1 -- 172.21.15.154:0/1496545763 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ff00529e0 con 0x7f1ffc1597f0 2023-10-10T21:02:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.114+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ffc0b1d50 con 0x7f1ffc1597f0 2023-10-10T21:02:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.115+0000 7f1fe2ffd700 1 -- 172.21.15.154:0/1496545763 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ff0015070 con 0x7f1ffc1597f0 2023-10-10T21:02:46.117 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:02:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fe8066f30 msgr2=0x7f1fe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fe8066f30 0x7f1fe80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fec007fd0 tx=0x7f1fec009040 comp rx=0 tx=0).stop 2023-10-10T21:02:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 msgr2=0x7f1ffc15ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 0x7f1ffc15ac00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006f50 tx=0x7f1ff0017000 comp rx=0 tx=0).stop 2023-10-10T21:02:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 shutdown_connections 2023-10-10T21:02:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1fe8066f30 0x7f1fe80693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ffc15d230 0x7f1ffc0cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ffc159420 0x7f1ffc0c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 --2- 172.21.15.154:0/1496545763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc1597f0 0x7f1ffc15ac00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.117+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 >> 172.21.15.154:0/1496545763 conn(0x7f1ffc0d0660 msgr2=0x7f1ffc156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.118+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 shutdown_connections 2023-10-10T21:02:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:46.118+0000 7f1ffbfff700 1 -- 172.21.15.154:0/1496545763 wait complete. 2023-10-10T21:02:46.136 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-10T21:02:46.137 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:02:46.137 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-10-10T21:02:46.138 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-10T21:02:46.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-10T21:02:46.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-10T21:02:46.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-10T21:02:46.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:02:46.139 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-10T21:02:46.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.140 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-10-10T21:02:46.179 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:02:46.179 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:02:46.180 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:02:46.180 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.180 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-10T21:02:46.181 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.181 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:46.181 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:46.181 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-10-10T21:02:46.182 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:46.182 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:46.182 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-10-10T21:02:46.183 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:02:46.183 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:46.183 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:02:46.183 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:46.184 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:02:46.184 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42233sec preferred_lft 42233sec 2023-10-10T21:02:46.184 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-10-10T21:02:46.184 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.185 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:02:46.185 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 4a:c2:fd:74:a5:bb brd ff:ff:ff:ff:ff:ff 2023-10-10T21:02:46.185 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T21:02:46.185 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.185 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::1821:81ff:fef2:c488/64 scope link 2023-10-10T21:02:46.186 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.186 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:02:46.186 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 4a:c2:fd:74:a5:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-10T21:02:46.186 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::48c2:fdff:fe74:a5bb/64 scope link tentative 2023-10-10T21:02:46.186 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.187 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:02:46.277 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-10T21:02:46.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.281 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-10-10T21:02:46.320 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-10-10T21:02:46.321 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:02:46.321 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:02:46.321 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:02:46.322 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:02:46.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.323 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-10T21:02:46.323 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-10T21:02:46.323 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:02:46.323 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:02:46.324 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:02:46.324 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-10T21:02:46.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.515 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-10T21:02:46.552 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-10T21:02:46.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.553 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-10-10T21:02:46.629 INFO:teuthology.orchestra.run.smithi179.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-10T21:02:46.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.630 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-10T21:02:46.630 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-10T21:02:46.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-10T21:02:46.631 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-10T21:02:46.631 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-10T21:02:46.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.794 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-10T21:02:46.854 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:02:46.855 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:02:46.855 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:02:46.855 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.855 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-10T21:02:46.856 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.856 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:02:46.856 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 32:df:5b:fa:c4:dc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-10T21:02:46.856 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-10T21:02:46.856 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.857 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::30df:5bff:fefa:c4dc/64 scope link 2023-10-10T21:02:46.857 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.858 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-10T21:02:46.919 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:02:46.919 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:02:46.920 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:02:46.920 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.920 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-10T21:02:46.920 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.920 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:02:46.921 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 32:df:5b:fa:c4:dc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-10T21:02:46.921 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-10T21:02:46.921 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.921 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::30df:5bff:fefa:c4dc/64 scope link 2023-10-10T21:02:46.921 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:02:46.923 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-10T21:02:46.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:46.923 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-10T21:02:46.924 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-10T21:02:46.924 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-10T21:02:46.924 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-10T21:02:46.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-10T21:02:46.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-10T21:02:46.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-10T21:02:46.925 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-10T21:02:47.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:47.156 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-10T21:02:47.156 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-10T21:02:47.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.1 up 2023-10-10T21:02:47.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.1 master ceph-brx 2023-10-10T21:02:47.157 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-10T21:02:47.313 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:02:47.313 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-10T21:02:47.349 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-10T21:02:47.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:02:47.350 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-10T21:02:47.424 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:02:47.425 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:02:47.425 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-10T21:02:47.554 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-10T21:02:47.554 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-10T21:02:47.554 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-10T21:02:47.570 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-10T21:02:47.571 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-10T21:02:47.571 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-10T21:02:47.571 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:02:47.571 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:02:47.591 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-10T21:02:47.591 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-10T21:02:47.592 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2023-10-10T21:02:47.592 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:02:47.592 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:02:47.592 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:02:47.593 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:02:47.593 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:02:47.596 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:02:47.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:47.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-10T21:02:47.657 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-10T21:02:47.675 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.866+0000 7fce727ff700 1 Processor -- start 2023-10-10T21:02:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.866+0000 7fce727ff700 1 -- start start 2023-10-10T21:02:47.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.868+0000 7fce727ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce6c0ccf90 0x7fce6c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:47.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.868+0000 7fce727ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c0cc300 con 0x7fce6c0cbf30 2023-10-10T21:02:47.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.868+0000 7fce727ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c0ad370 con 0x7fce6c0b1420 2023-10-10T21:02:47.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.868+0000 7fce727ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c156bf0 con 0x7fce6c0ccf90 2023-10-10T21:02:47.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.868+0000 7fce6bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fce6c0cbf30 0x7fce6c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51452/0 (socket says 172.21.15.154:51452) 2023-10-10T21:02:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.868+0000 7fce6bfff700 1 -- 172.21.15.154:0/4123669034 learned_addr learned my addr 172.21.15.154:0/4123669034 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.868+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625492781 0 0) 0x7fce6c0cc300 con 0x7fce6c0cbf30 2023-10-10T21:02:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.868+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce54003570 con 0x7fce6c0cbf30 2023-10-10T21:02:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.868+0000 7fce70d9c700 1 --2- 172.21.15.154:0/4123669034 >> v2:172.21.15.179:3300/0 conn(0x7fce6c0ccf90 0x7fce6c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:47.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469064720 0 0) 0x7fce54003570 con 0x7fce6c0cbf30 2023-10-10T21:02:47.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 >> v2:172.21.15.179:3300/0 conn(0x7fce6c0ccf90 msgr2=0x7fce6c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:47.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 --2- 172.21.15.154:0/4123669034 >> v2:172.21.15.179:3300/0 conn(0x7fce6c0ccf90 0x7fce6c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:47.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 >> v1:172.21.15.179:6789/0 conn(0x7fce6c0b1420 legacy=0x7fce6c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:47.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0ad650 con 0x7fce6c0cbf30 2023-10-10T21:02:47.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fce5c001470 con 0x7fce6c0cbf30 2023-10-10T21:02:47.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 >> v1:172.21.15.154:6789/0 conn(0x7fce6c0cbf30 legacy=0x7fce6c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:47.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54003a60 0x7fce54003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:47.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54004810 0x7fce54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:47.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce540051c0 0x7fce5400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:47.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c156bf0 con 0x7fce54004810 2023-10-10T21:02:47.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5400e2c0 con 0x7fce540051c0 2023-10-10T21:02:47.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5400e480 con 0x7fce54003a60 2023-10-10T21:02:47.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6b7fe700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54004810 0x7fce54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:47.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6bfff700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54003a60 0x7fce54003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:47.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce70d9c700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce540051c0 0x7fce5400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:47.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6b7fe700 1 -- 172.21.15.154:0/4123669034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54003a60 msgr2=0x7fce54003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:47.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.869+0000 7fce6b7fe700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54003a60 0x7fce54003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:47.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce6b7fe700 1 -- 172.21.15.154:0/4123669034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce540051c0 msgr2=0x7fce5400dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:47.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce6b7fe700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce540051c0 0x7fce5400dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:47.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce6b7fe700 1 -- 172.21.15.154:0/4123669034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce54003570 con 0x7fce54004810 2023-10-10T21:02:47.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce70d9c700 1 -- 172.21.15.154:0/4123669034 reap_dead start 2023-10-10T21:02:47.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce6b7fe700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54004810 0x7fce54004c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0b1820 tx=0x7fce60007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4450648462ade6d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:47.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000c5d0 con 0x7fce54004810 2023-10-10T21:02:47.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6000c730 con 0x7fce54004810 2023-10-10T21:02:47.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce6affd700 1 -- 172.21.15.154:0/4123669034 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000cad0 con 0x7fce54004810 2023-10-10T21:02:47.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce727ff700 1 -- 172.21.15.154:0/4123669034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54004810 msgr2=0x7fce54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:47.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.870+0000 7fce727ff700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54004810 0x7fce54004c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0b1820 tx=0x7fce60007d10 comp rx=0 tx=0).stop 2023-10-10T21:02:47.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.871+0000 7fce727ff700 1 -- 172.21.15.154:0/4123669034 shutdown_connections 2023-10-10T21:02:47.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.871+0000 7fce727ff700 1 --2- 172.21.15.154:0/4123669034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54004810 0x7fce54004c80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:47.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.871+0000 7fce727ff700 1 -- 172.21.15.154:0/4123669034 >> 172.21.15.154:0/4123669034 conn(0x7fce6c06a320 msgr2=0x7fce6c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:47.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.871+0000 7fce727ff700 1 -- 172.21.15.154:0/4123669034 shutdown_connections 2023-10-10T21:02:47.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.871+0000 7fce727ff700 1 -- 172.21.15.154:0/4123669034 wait complete. 2023-10-10T21:02:47.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.872+0000 7fce727ff700 1 Processor -- start 2023-10-10T21:02:47.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.872+0000 7fce727ff700 1 -- start start 2023-10-10T21:02:47.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce727ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54004810 0x7fce6c0a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:47.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce727ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6c1666f0 0x7fce6c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:47.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce727ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c15a250 0x7fce6c168f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:47.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce727ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c15a6f0 con 0x7fce6c1666f0 2023-10-10T21:02:47.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce727ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c142b40 con 0x7fce6c15a250 2023-10-10T21:02:47.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce727ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c166260 con 0x7fce54004810 2023-10-10T21:02:47.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce6b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6c1666f0 0x7fce6c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:47.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce6bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54004810 0x7fce6c0a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:47.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce6bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54004810 0x7fce6c0a9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:46156/0 (socket says 172.21.15.154:46156) 2023-10-10T21:02:47.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce6bfff700 1 -- 172.21.15.154:0/2230870745 learned_addr learned my addr 172.21.15.154:0/2230870745 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:47.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce6b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6c1666f0 0x7fce6c159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55010/0 (socket says 172.21.15.154:55010) 2023-10-10T21:02:47.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.873+0000 7fce70d9c700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c15a250 0x7fce6c168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:47.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce6bfff700 1 -- 172.21.15.154:0/2230870745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c15a250 msgr2=0x7fce6c168f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:47.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce6bfff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c15a250 0x7fce6c168f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:47.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce6bfff700 1 -- 172.21.15.154:0/2230870745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6c1666f0 msgr2=0x7fce6c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:47.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce6bfff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6c1666f0 0x7fce6c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:47.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce6bfff700 1 -- 172.21.15.154:0/2230870745 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0aa460 con 0x7fce54004810 2023-10-10T21:02:47.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce6bfff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54004810 0x7fce6c0a9f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fce5c007390 tx=0x7fce5c001da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:47.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce53fff700 1 -- 172.21.15.154:0/2230870745 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c018030 con 0x7fce54004810 2023-10-10T21:02:47.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce53fff700 1 -- 172.21.15.154:0/2230870745 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c00f640 con 0x7fce54004810 2023-10-10T21:02:47.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c165960 con 0x7fce54004810 2023-10-10T21:02:47.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce53fff700 1 -- 172.21.15.154:0/2230870745 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00f9e0 con 0x7fce54004810 2023-10-10T21:02:47.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.874+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c165c10 con 0x7fce54004810 2023-10-10T21:02:47.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.875+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6c04c3c0 con 0x7fce54004810 2023-10-10T21:02:47.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.876+0000 7fce53fff700 1 -- 172.21.15.154:0/2230870745 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce5c01b070 con 0x7fce54004810 2023-10-10T21:02:47.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.877+0000 7fce53fff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fce58066f30 0x7fce580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:47.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.877+0000 7fce53fff700 1 -- 172.21.15.154:0/2230870745 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce5c019070 con 0x7fce54004810 2023-10-10T21:02:47.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.877+0000 7fce6b7fe700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fce58066f30 0x7fce580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:47.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.878+0000 7fce6b7fe700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fce58066f30 0x7fce580693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce6c166ae0 tx=0x7fce60015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:47.881+0000 7fce53fff700 1 -- 172.21.15.154:0/2230870745 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce5c051410 con 0x7fce54004810 2023-10-10T21:02:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.078+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce6c0ad930 con 0x7fce54004810 2023-10-10T21:02:48.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.079+0000 7fce53fff700 1 -- 172.21.15.154:0/2230870745 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fce5c054a30 con 0x7fce54004810 2023-10-10T21:02:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:48.080 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:48.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fce58066f30 msgr2=0x7fce580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fce58066f30 0x7fce580693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce6c166ae0 tx=0x7fce60015000 comp rx=0 tx=0).stop 2023-10-10T21:02:48.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54004810 msgr2=0x7fce6c0a9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54004810 0x7fce6c0a9f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fce5c007390 tx=0x7fce5c001da0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 shutdown_connections 2023-10-10T21:02:48.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6c15a250 0x7fce6c168f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fce58066f30 0x7fce580693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce54004810 0x7fce6c0a9f20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 --2- 172.21.15.154:0/2230870745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6c1666f0 0x7fce6c159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 >> 172.21.15.154:0/2230870745 conn(0x7fce6c06a320 msgr2=0x7fce6c0ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 shutdown_connections 2023-10-10T21:02:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.081+0000 7fce727ff700 1 -- 172.21.15.154:0/2230870745 wait complete. 2023-10-10T21:02:48.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:02:17.271178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:02:18.145561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:02:48.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:02:48.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.288+0000 7fe8bdf9d700 1 Processor -- start 2023-10-10T21:02:48.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.288+0000 7fe8bdf9d700 1 -- start start 2023-10-10T21:02:48.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.289+0000 7fe8bdf9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8b80c9db0 0x7fe8b8153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.289+0000 7fe8bdf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b806e5e0 0x7fe8b806ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.289+0000 7fe8bdf9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b806e150 con 0x7fe8b8157130 2023-10-10T21:02:48.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.289+0000 7fe8bdf9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b80c7610 con 0x7fe8b80c9db0 2023-10-10T21:02:48.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.289+0000 7fe8bdf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8153e40 con 0x7fe8b806e5e0 2023-10-10T21:02:48.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8bd79c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b806e5e0 0x7fe8b806ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8bd79c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b806e5e0 0x7fe8b806ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:46166/0 (socket says 172.21.15.154:46166) 2023-10-10T21:02:48.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8b7fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe8b8157130 0x7fe8b80c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:35632/0 (socket says 172.21.15.154:35632) 2023-10-10T21:02:48.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8bd79c700 1 -- 172.21.15.154:0/1764768980 learned_addr learned my addr 172.21.15.154:0/1764768980 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:48.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8bcf9b700 1 --2- 172.21.15.154:0/1764768980 >> v2:172.21.15.179:3300/0 conn(0x7fe8b80c9db0 0x7fe8b8153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8b77fe700 1 -- 172.21.15.154:0/1764768980 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918658411 0 0) 0x7fe8b806e150 con 0x7fe8b8157130 2023-10-10T21:02:48.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8b77fe700 1 -- 172.21.15.154:0/1764768980 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a8003570 con 0x7fe8b8157130 2023-10-10T21:02:48.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8bcf9b700 1 -- 172.21.15.154:0/1764768980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b806e5e0 msgr2=0x7fe8b806ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:48.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8bcf9b700 1 --2- 172.21.15.154:0/1764768980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b806e5e0 0x7fe8b806ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8bcf9b700 1 -- 172.21.15.154:0/1764768980 >> v1:172.21.15.179:6789/0 conn(0x7fe8b8157130 legacy=0x7fe8b80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8bcf9b700 1 -- 172.21.15.154:0/1764768980 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80c7800 con 0x7fe8b80c9db0 2023-10-10T21:02:48.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.290+0000 7fe8bd79c700 1 --2- 172.21.15.154:0/1764768980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b806e5e0 0x7fe8b806ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:48.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8bcf9b700 1 --2- 172.21.15.154:0/1764768980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b80c9db0 0x7fe8b8153900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0098e0 tx=0x7fe8ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=542e9d1aafdf97c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:48.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8b77fe700 1 -- 172.21.15.154:0/1764768980 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac011630 con 0x7fe8b80c9db0 2023-10-10T21:02:48.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8b77fe700 1 -- 172.21.15.154:0/1764768980 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac011790 con 0x7fe8b80c9db0 2023-10-10T21:02:48.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8b77fe700 1 -- 172.21.15.154:0/1764768980 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac011b30 con 0x7fe8b80c9db0 2023-10-10T21:02:48.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1764768980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b80c9db0 msgr2=0x7fe8b8153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8bdf9d700 1 --2- 172.21.15.154:0/1764768980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b80c9db0 0x7fe8b8153900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0098e0 tx=0x7fe8ac0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1764768980 shutdown_connections 2023-10-10T21:02:48.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8bdf9d700 1 --2- 172.21.15.154:0/1764768980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b806e5e0 0x7fe8b806ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8bdf9d700 1 --2- 172.21.15.154:0/1764768980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b80c9db0 0x7fe8b8153900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.291+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1764768980 >> 172.21.15.154:0/1764768980 conn(0x7fe8b80cc1e0 msgr2=0x7fe8b80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:48.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.292+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1764768980 shutdown_connections 2023-10-10T21:02:48.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.292+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1764768980 wait complete. 2023-10-10T21:02:48.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.293+0000 7fe8bdf9d700 1 Processor -- start 2023-10-10T21:02:48.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.293+0000 7fe8bdf9d700 1 -- start start 2023-10-10T21:02:48.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bdf9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8b806e5e0 0x7fe8b80c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bdf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c9db0 0x7fe8b8168d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bdf9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b8157130 0x7fe8b80c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bdf9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80c3a70 con 0x7fe8b806e5e0 2023-10-10T21:02:48.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bdf9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8151250 con 0x7fe8b8157130 2023-10-10T21:02:48.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bdf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80c37d0 con 0x7fe8b80c9db0 2023-10-10T21:02:48.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bcf9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8b806e5e0 0x7fe8b80c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8b7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c9db0 0x7fe8b8168d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bcf9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8b806e5e0 0x7fe8b80c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55016/0 (socket says 172.21.15.154:55016) 2023-10-10T21:02:48.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bcf9b700 1 -- 172.21.15.154:0/1474355752 learned_addr learned my addr 172.21.15.154:0/1474355752 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:48.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.294+0000 7fe8bd79c700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b8157130 0x7fe8b80c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8bd79c700 1 -- 172.21.15.154:0/1474355752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c9db0 msgr2=0x7fe8b8168d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8bd79c700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c9db0 0x7fe8b8168d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8bd79c700 1 -- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8b806e5e0 msgr2=0x7fe8b80c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8bd79c700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8b806e5e0 0x7fe8b80c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8bd79c700 1 -- 172.21.15.154:0/1474355752 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0009ae0 con 0x7fe8b8157130 2023-10-10T21:02:48.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8bcf9b700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8b806e5e0 0x7fe8b80c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:48.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8bd79c700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b8157130 0x7fe8b80c3290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009e70 tx=0x7fe8b000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:48.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8b4ff9700 1 -- 172.21.15.154:0/1474355752 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0018070 con 0x7fe8b8157130 2023-10-10T21:02:48.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8b4ff9700 1 -- 172.21.15.154:0/1474355752 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b000f040 con 0x7fe8b8157130 2023-10-10T21:02:48.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8b4ff9700 1 -- 172.21.15.154:0/1474355752 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000cb00 con 0x7fe8b8157130 2023-10-10T21:02:48.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac009420 con 0x7fe8b8157130 2023-10-10T21:02:48.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.295+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b8150c00 con 0x7fe8b8157130 2023-10-10T21:02:48.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.297+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b8151400 con 0x7fe8b8157130 2023-10-10T21:02:48.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.297+0000 7fe8b4ff9700 1 -- 172.21.15.154:0/1474355752 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8b0003020 con 0x7fe8b8157130 2023-10-10T21:02:48.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.298+0000 7fe8b4ff9700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe89c066f30 0x7fe89c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.298+0000 7fe8b4ff9700 1 -- 172.21.15.154:0/1474355752 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe8b0084390 con 0x7fe8b8157130 2023-10-10T21:02:48.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.298+0000 7fe8bcf9b700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe89c066f30 0x7fe89c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.299+0000 7fe8bcf9b700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe89c066f30 0x7fe89c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0093a0 tx=0x7fe8ac017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:48.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.303+0000 7fe8b4ff9700 1 -- 172.21.15.154:0/1474355752 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8b004d5a0 con 0x7fe8b8157130 2023-10-10T21:02:48.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.491+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8b80c7ae0 con 0x7fe8b8157130 2023-10-10T21:02:48.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.492+0000 7fe8b4ff9700 1 -- 172.21.15.154:0/1474355752 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8b8151400 con 0x7fe8b8157130 2023-10-10T21:02:48.494 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:02:48.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe89c066f30 msgr2=0x7fe89c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe89c066f30 0x7fe89c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0093a0 tx=0x7fe8ac017000 comp rx=0 tx=0).stop 2023-10-10T21:02:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b8157130 msgr2=0x7fe8b80c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b8157130 0x7fe8b80c3290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009e70 tx=0x7fe8b000b040 comp rx=0 tx=0).stop 2023-10-10T21:02:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 shutdown_connections 2023-10-10T21:02:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8b8157130 0x7fe8b80c3290 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8b806e5e0 0x7fe8b80c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe89c066f30 0x7fe89c0693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 --2- 172.21.15.154:0/1474355752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8b80c9db0 0x7fe8b8168d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 >> 172.21.15.154:0/1474355752 conn(0x7fe8b80cc1e0 msgr2=0x7fe8b8152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 shutdown_connections 2023-10-10T21:02:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.495+0000 7fe8bdf9d700 1 -- 172.21.15.154:0/1474355752 wait complete. 2023-10-10T21:02:48.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:02:48.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.696+0000 7f56a27ff700 1 Processor -- start 2023-10-10T21:02:48.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.696+0000 7f56a27ff700 1 -- start start 2023-10-10T21:02:48.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.698+0000 7f56a27ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f569c0c70b0 0x7f569c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.698+0000 7f56a27ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c06e950 con 0x7f569c155eb0 2023-10-10T21:02:48.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.698+0000 7f56a27ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c06eb90 con 0x7f569c069cb0 2023-10-10T21:02:48.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.698+0000 7f56a27ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c06a130 con 0x7f569c0c70b0 2023-10-10T21:02:48.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.698+0000 7f569b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f569c0c70b0 0x7f569c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.698+0000 7f569bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f569c155eb0 0x7f569c06e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51462/0 (socket says 172.21.15.154:51462) 2023-10-10T21:02:48.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.698+0000 7f569bfff700 1 -- 172.21.15.154:0/1047173799 learned_addr learned my addr 172.21.15.154:0/1047173799 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:48.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.699+0000 7f569b7fe700 1 -- 172.21.15.154:0/1047173799 >> v1:172.21.15.179:6789/0 conn(0x7f569c069cb0 legacy=0x7f569c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.698+0000 7f569affd700 1 -- 172.21.15.154:0/1047173799 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131413296 0 0) 0x7f568c001110 con 0x7f569c155eb0 2023-10-10T21:02:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.699+0000 7f569b7fe700 1 -- 172.21.15.154:0/1047173799 >> v1:172.21.15.154:6789/0 conn(0x7f569c155eb0 legacy=0x7f569c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.699+0000 7f569b7fe700 1 -- 172.21.15.154:0/1047173799 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c06ee70 con 0x7f569c0c70b0 2023-10-10T21:02:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.699+0000 7f569b7fe700 1 --2- 172.21.15.154:0/1047173799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c0c70b0 0x7f569c069770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f569000bb90 tx=0x7f569000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bf1f2f623769dc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.699+0000 7f569affd700 1 -- 172.21.15.154:0/1047173799 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000dba0 con 0x7f569c0c70b0 2023-10-10T21:02:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.699+0000 7f569affd700 1 -- 172.21.15.154:0/1047173799 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569000dd00 con 0x7f569c0c70b0 2023-10-10T21:02:48.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.699+0000 7f569affd700 1 -- 172.21.15.154:0/1047173799 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900196b0 con 0x7f569c0c70b0 2023-10-10T21:02:48.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.699+0000 7f56a27ff700 1 -- 172.21.15.154:0/1047173799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c0c70b0 msgr2=0x7f569c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.699+0000 7f56a27ff700 1 --2- 172.21.15.154:0/1047173799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c0c70b0 0x7f569c069770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f569000bb90 tx=0x7f569000b430 comp rx=0 tx=0).stop 2023-10-10T21:02:48.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.700+0000 7f56a27ff700 1 -- 172.21.15.154:0/1047173799 shutdown_connections 2023-10-10T21:02:48.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.700+0000 7f56a27ff700 1 --2- 172.21.15.154:0/1047173799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c0c70b0 0x7f569c069770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.700+0000 7f56a27ff700 1 -- 172.21.15.154:0/1047173799 >> 172.21.15.154:0/1047173799 conn(0x7f569c068e10 msgr2=0x7f569c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:48.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.700+0000 7f56a27ff700 1 -- 172.21.15.154:0/1047173799 shutdown_connections 2023-10-10T21:02:48.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.700+0000 7f56a27ff700 1 -- 172.21.15.154:0/1047173799 wait complete. 2023-10-10T21:02:48.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.701+0000 7f56a27ff700 1 Processor -- start 2023-10-10T21:02:48.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.701+0000 7f56a27ff700 1 -- start start 2023-10-10T21:02:48.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.702+0000 7f56a27ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569c069cb0 0x7f569c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.702+0000 7f56a27ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569c0c70b0 0x7f569c15a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.702+0000 7f56a27ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c155eb0 0x7f569c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.702+0000 7f56a27ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c169d70 con 0x7f569c155eb0 2023-10-10T21:02:48.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.702+0000 7f56a27ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0ae420 con 0x7f569c069cb0 2023-10-10T21:02:48.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.702+0000 7f56a27ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0ad810 con 0x7f569c0c70b0 2023-10-10T21:02:48.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.702+0000 7f56a0d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c155eb0 0x7f569c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f56a0d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c155eb0 0x7f569c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55036/0 (socket says 172.21.15.154:55036) 2023-10-10T21:02:48.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f56a0d9c700 1 -- 172.21.15.154:0/2741008012 learned_addr learned my addr 172.21.15.154:0/2741008012 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:48.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f569b7fe700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569c0c70b0 0x7f569c15a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f569bfff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569c069cb0 0x7f569c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f56a0d9c700 1 -- 172.21.15.154:0/2741008012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569c0c70b0 msgr2=0x7f569c15a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f56a0d9c700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569c0c70b0 0x7f569c15a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f56a0d9c700 1 -- 172.21.15.154:0/2741008012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569c069cb0 msgr2=0x7f569c1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f56a0d9c700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569c069cb0 0x7f569c1530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f56a0d9c700 1 -- 172.21.15.154:0/2741008012 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569000b6d0 con 0x7f569c155eb0 2023-10-10T21:02:48.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f569bfff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569c069cb0 0x7f569c1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:48.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f56a0d9c700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c155eb0 0x7f569c15abd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f569400c8e0 tx=0x7f5694001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:48.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f5683fff700 1 -- 172.21.15.154:0/2741008012 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400a650 con 0x7f569c155eb0 2023-10-10T21:02:48.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f5683fff700 1 -- 172.21.15.154:0/2741008012 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400a7b0 con 0x7f569c155eb0 2023-10-10T21:02:48.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c0adaf0 con 0x7f569c155eb0 2023-10-10T21:02:48.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.703+0000 7f5683fff700 1 -- 172.21.15.154:0/2741008012 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400ab70 con 0x7f569c155eb0 2023-10-10T21:02:48.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.704+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c0ae0b0 con 0x7f569c155eb0 2023-10-10T21:02:48.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.705+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c04c3c0 con 0x7f569c155eb0 2023-10-10T21:02:48.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.705+0000 7f5683fff700 1 -- 172.21.15.154:0/2741008012 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5694012420 con 0x7f569c155eb0 2023-10-10T21:02:48.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.706+0000 7f5683fff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5688066f30 0x7f56880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:48.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.706+0000 7f5683fff700 1 -- 172.21.15.154:0/2741008012 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f56940848d0 con 0x7f569c155eb0 2023-10-10T21:02:48.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.706+0000 7f569bfff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5688066f30 0x7f56880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:48.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.707+0000 7f569bfff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5688066f30 0x7f56880693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f568c000c00 tx=0x7f568c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:48.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.710+0000 7f5683fff700 1 -- 172.21.15.154:0/2741008012 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5694051aa0 con 0x7f569c155eb0 2023-10-10T21:02:48.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.900+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f569c0ae560 con 0x7f569c155eb0 2023-10-10T21:02:48.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.901+0000 7f5683fff700 1 -- 172.21.15.154:0/2741008012 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5694084070 con 0x7f569c155eb0 2023-10-10T21:02:48.902 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:02:48.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5688066f30 msgr2=0x7f56880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5688066f30 0x7f56880693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f568c000c00 tx=0x7f568c009040 comp rx=0 tx=0).stop 2023-10-10T21:02:48.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c155eb0 msgr2=0x7f569c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:48.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c155eb0 0x7f569c15abd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f569400c8e0 tx=0x7f5694001710 comp rx=0 tx=0).stop 2023-10-10T21:02:48.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 shutdown_connections 2023-10-10T21:02:48.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f569c155eb0 0x7f569c15abd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569c069cb0 0x7f569c1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5688066f30 0x7f56880693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 --2- 172.21.15.154:0/2741008012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569c0c70b0 0x7f569c15a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:48.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 >> 172.21.15.154:0/2741008012 conn(0x7f569c068e10 msgr2=0x7f569c0b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:48.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.903+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 shutdown_connections 2023-10-10T21:02:48.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:48.904+0000 7f56a27ff700 1 -- 172.21.15.154:0/2741008012 wait complete. 2023-10-10T21:02:48.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:02:49.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.106+0000 7f2b3ebff700 1 Processor -- start 2023-10-10T21:02:49.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.106+0000 7f2b3ebff700 1 -- start start 2023-10-10T21:02:49.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.107+0000 7f2b3ebff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b38069560 0x7f2b380699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.107+0000 7f2b3ebff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b38069ee0 con 0x7f2b38159c60 2023-10-10T21:02:49.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.107+0000 7f2b3ebff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3815a160 con 0x7f2b38159890 2023-10-10T21:02:49.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.107+0000 7f2b3ebff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b380d13a0 con 0x7f2b38069560 2023-10-10T21:02:49.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b37fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2b38159c60 0x7f2b3815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51474/0 (socket says 172.21.15.154:51474) 2023-10-10T21:02:49.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b37fff700 1 -- 172.21.15.154:0/2736030937 learned_addr learned my addr 172.21.15.154:0/2736030937 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:49.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b3d19c700 1 --2- 172.21.15.154:0/2736030937 >> v2:172.21.15.179:3300/0 conn(0x7f2b38069560 0x7f2b380699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839869794 0 0) 0x7f2b38069ee0 con 0x7f2b38159c60 2023-10-10T21:02:49.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b28003570 con 0x7f2b38159c60 2023-10-10T21:02:49.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328908873 0 0) 0x7f2b3815a160 con 0x7f2b38159890 2023-10-10T21:02:49.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b38069ee0 con 0x7f2b38159890 2023-10-10T21:02:49.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4056339983 0 0) 0x7f2b28003570 con 0x7f2b38159c60 2023-10-10T21:02:49.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 >> v2:172.21.15.179:3300/0 conn(0x7f2b38069560 msgr2=0x7f2b380699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:49.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 --2- 172.21.15.154:0/2736030937 >> v2:172.21.15.179:3300/0 conn(0x7f2b38069560 0x7f2b380699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 >> v1:172.21.15.179:6789/0 conn(0x7f2b38159890 legacy=0x7f2b3815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3815e140 con 0x7f2b38159c60 2023-10-10T21:02:49.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f2b24001470 con 0x7f2b38159c60 2023-10-10T21:02:49.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b3d19c700 1 --2- 172.21.15.154:0/2736030937 >> v2:172.21.15.179:3300/0 conn(0x7f2b38069560 0x7f2b380699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:49.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.108+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 >> v1:172.21.15.154:6789/0 conn(0x7f2b38159c60 legacy=0x7f2b3815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b377fe700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b28003bf0 0x7f2b28003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b377fe700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b28004810 0x7f2b28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b377fe700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b2800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380d13a0 con 0x7f2b280051c0 2023-10-10T21:02:49.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2800c0b0 con 0x7f2b28003bf0 2023-10-10T21:02:49.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2800c270 con 0x7f2b28004810 2023-10-10T21:02:49.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b3d19c700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b2800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b37fff700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b28004810 0x7f2b28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b3c99b700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b28003bf0 0x7f2b28003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b3d19c700 1 -- 172.21.15.154:0/2736030937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b28004810 msgr2=0x7f2b28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:49.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b3d19c700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b28004810 0x7f2b28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b3d19c700 1 -- 172.21.15.154:0/2736030937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b28003bf0 msgr2=0x7f2b28003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b3d19c700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b28003bf0 0x7f2b28003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b3d19c700 1 -- 172.21.15.154:0/2736030937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b28003570 con 0x7f2b280051c0 2023-10-10T21:02:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.109+0000 7f2b3d19c700 1 -- 172.21.15.154:0/2736030937 reap_dead start 2023-10-10T21:02:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b3d19c700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b2800ba60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e3c0 tx=0x7f2b3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512e37791dc04dd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30009c50 con 0x7f2b280051c0 2023-10-10T21:02:49.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3000f040 con 0x7f2b280051c0 2023-10-10T21:02:49.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b377fe700 1 -- 172.21.15.154:0/2736030937 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000eec0 con 0x7f2b280051c0 2023-10-10T21:02:49.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b3ebff700 1 -- 172.21.15.154:0/2736030937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 msgr2=0x7f2b2800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b3ebff700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b2800ba60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e3c0 tx=0x7f2b3000b040 comp rx=0 tx=0).stop 2023-10-10T21:02:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b3ebff700 1 -- 172.21.15.154:0/2736030937 shutdown_connections 2023-10-10T21:02:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b3ebff700 1 --2- 172.21.15.154:0/2736030937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b2800ba60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b3ebff700 1 -- 172.21.15.154:0/2736030937 >> 172.21.15.154:0/2736030937 conn(0x7f2b38068e20 msgr2=0x7f2b380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b3ebff700 1 -- 172.21.15.154:0/2736030937 shutdown_connections 2023-10-10T21:02:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.110+0000 7f2b3ebff700 1 -- 172.21.15.154:0/2736030937 wait complete. 2023-10-10T21:02:49.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.112+0000 7f2b3ebff700 1 Processor -- start 2023-10-10T21:02:49.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.112+0000 7f2b3ebff700 1 -- start start 2023-10-10T21:02:49.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3ebff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b380b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3ebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b380ce550 0x7f2b38149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3ebff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b380b4330 0x7f2b380b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3ebff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380b3ea0 con 0x7f2b280051c0 2023-10-10T21:02:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3ebff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38149980 con 0x7f2b380b4330 2023-10-10T21:02:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3ebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380b3590 con 0x7f2b380ce550 2023-10-10T21:02:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3c99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b380b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3c99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b380b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55054/0 (socket says 172.21.15.154:55054) 2023-10-10T21:02:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3c99b700 1 -- 172.21.15.154:0/3050817687 learned_addr learned my addr 172.21.15.154:0/3050817687 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3c99b700 1 -- 172.21.15.154:0/3050817687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b380ce550 msgr2=0x7f2b38149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3c99b700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b380ce550 0x7f2b38149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3c99b700 1 -- 172.21.15.154:0/3050817687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b380b4330 msgr2=0x7f2b380b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3c99b700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b380b4330 0x7f2b380b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.113+0000 7f2b3c99b700 1 -- 172.21.15.154:0/3050817687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380cdeb0 con 0x7f2b280051c0 2023-10-10T21:02:49.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.114+0000 7f2b3c99b700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b380b5f50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c002b50 tx=0x7f2b2c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:49.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.114+0000 7f2b34ff9700 1 -- 172.21.15.154:0/3050817687 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00fa00 con 0x7f2b280051c0 2023-10-10T21:02:49.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.114+0000 7f2b34ff9700 1 -- 172.21.15.154:0/3050817687 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c00fb60 con 0x7f2b280051c0 2023-10-10T21:02:49.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.114+0000 7f2b34ff9700 1 -- 172.21.15.154:0/3050817687 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0133f0 con 0x7f2b280051c0 2023-10-10T21:02:49.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.114+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b380b3850 con 0x7f2b280051c0 2023-10-10T21:02:49.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.114+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b380cdad0 con 0x7f2b280051c0 2023-10-10T21:02:49.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.115+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3804c3c0 con 0x7f2b280051c0 2023-10-10T21:02:49.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.116+0000 7f2b34ff9700 1 -- 172.21.15.154:0/3050817687 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b2c0137a0 con 0x7f2b280051c0 2023-10-10T21:02:49.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.117+0000 7f2b34ff9700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2b1c066f60 0x7f2b1c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.117+0000 7f2b34ff9700 1 -- 172.21.15.154:0/3050817687 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b2c084c70 con 0x7f2b280051c0 2023-10-10T21:02:49.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.117+0000 7f2b37fff700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2b1c066f60 0x7f2b1c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.118+0000 7f2b37fff700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2b1c066f60 0x7f2b1c069410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b380b2cb0 tx=0x7f2b24001df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.121+0000 7f2b34ff9700 1 -- 172.21.15.154:0/3050817687 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b2c051ee0 con 0x7f2b280051c0 2023-10-10T21:02:49.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.313+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b3806a5b0 con 0x7f2b280051c0 2023-10-10T21:02:49.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.314+0000 7f2b34ff9700 1 -- 172.21.15.154:0/3050817687 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b2c017020 con 0x7f2b280051c0 2023-10-10T21:02:49.315 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:02:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2b1c066f60 msgr2=0x7f2b1c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2b1c066f60 0x7f2b1c069410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b380b2cb0 tx=0x7f2b24001df0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 msgr2=0x7f2b380b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b380b5f50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c002b50 tx=0x7f2b2c007d30 comp rx=0 tx=0).stop 2023-10-10T21:02:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 shutdown_connections 2023-10-10T21:02:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b380b4330 0x7f2b380b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b280051c0 0x7f2b380b5f50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2b1c066f60 0x7f2b1c069410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 --2- 172.21.15.154:0/3050817687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b380ce550 0x7f2b38149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 >> 172.21.15.154:0/3050817687 conn(0x7f2b38068e20 msgr2=0x7f2b38153fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:49.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 shutdown_connections 2023-10-10T21:02:49.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.316+0000 7f2b3ebff700 1 -- 172.21.15.154:0/3050817687 wait complete. 2023-10-10T21:02:49.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:49.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.516+0000 7f1f7f59e700 1 Processor -- start 2023-10-10T21:02:49.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.517+0000 7f1f7f59e700 1 -- start start 2023-10-10T21:02:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.518+0000 7f1f7f59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f800c6c60 0x7f1f800c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.518+0000 7f1f7f59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800b1410 con 0x7f1f8006e8c0 2023-10-10T21:02:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.518+0000 7f1f7f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f80063230 con 0x7f1f801595a0 2023-10-10T21:02:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.518+0000 7f1f7f59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f800b2b90 con 0x7f1f800c6c60 2023-10-10T21:02:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.518+0000 7f1f7dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f800c6c60 0x7f1f800c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.518+0000 7f1f7ed9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1f8006e8c0 0x7f1f80159970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51488/0 (socket says 172.21.15.154:51488) 2023-10-10T21:02:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.518+0000 7f1f7ed9d700 1 -- 172.21.15.154:0/3966260128 learned_addr learned my addr 172.21.15.154:0/3966260128 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.519+0000 7f1f7dd9b700 1 -- 172.21.15.154:0/3966260128 >> v1:172.21.15.179:6789/0 conn(0x7f1f801595a0 legacy=0x7f1f800b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.519+0000 7f1f7dd9b700 1 -- 172.21.15.154:0/3966260128 >> v1:172.21.15.154:6789/0 conn(0x7f1f8006e8c0 legacy=0x7f1f80159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.519+0000 7f1f7dd9b700 1 -- 172.21.15.154:0/3966260128 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800634f0 con 0x7f1f800c6c60 2023-10-10T21:02:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.519+0000 7f1f7d59a700 1 -- 172.21.15.154:0/3966260128 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071959638 0 0) 0x7f1f800b1410 con 0x7f1f8006e8c0 2023-10-10T21:02:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.519+0000 7f1f7dd9b700 1 --2- 172.21.15.154:0/3966260128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f800c6c60 0x7f1f800c8120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f740098e0 tx=0x7f1f740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76afc8044268e92 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.519+0000 7f1f7d59a700 1 -- 172.21.15.154:0/3966260128 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74009e80 con 0x7f1f800c6c60 2023-10-10T21:02:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.519+0000 7f1f7d59a700 1 -- 172.21.15.154:0/3966260128 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7400b860 con 0x7f1f800c6c60 2023-10-10T21:02:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.519+0000 7f1f7d59a700 1 -- 172.21.15.154:0/3966260128 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400bbe0 con 0x7f1f800c6c60 2023-10-10T21:02:49.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.520+0000 7f1f7f59e700 1 -- 172.21.15.154:0/3966260128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f800c6c60 msgr2=0x7f1f800c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.520+0000 7f1f7f59e700 1 --2- 172.21.15.154:0/3966260128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f800c6c60 0x7f1f800c8120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f740098e0 tx=0x7f1f740091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.520+0000 7f1f7f59e700 1 -- 172.21.15.154:0/3966260128 shutdown_connections 2023-10-10T21:02:49.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.520+0000 7f1f7f59e700 1 --2- 172.21.15.154:0/3966260128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f800c6c60 0x7f1f800c8120 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.520+0000 7f1f7f59e700 1 -- 172.21.15.154:0/3966260128 >> 172.21.15.154:0/3966260128 conn(0x7f1f8006ddb0 msgr2=0x7f1f8006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:49.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.520+0000 7f1f7f59e700 1 -- 172.21.15.154:0/3966260128 shutdown_connections 2023-10-10T21:02:49.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.520+0000 7f1f7f59e700 1 -- 172.21.15.154:0/3966260128 wait complete. 2023-10-10T21:02:49.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.521+0000 7f1f7f59e700 1 Processor -- start 2023-10-10T21:02:49.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.521+0000 7f1f7f59e700 1 -- start start 2023-10-10T21:02:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.522+0000 7f1f7f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8006e8c0 0x7f1f8016de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.522+0000 7f1f7f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f800c6c60 0x7f1f80151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.522+0000 7f1f7f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f801595a0 0x7f1f800c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.522+0000 7f1f7f59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800c42d0 con 0x7f1f801595a0 2023-10-10T21:02:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.522+0000 7f1f7f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800c36c0 con 0x7f1f8006e8c0 2023-10-10T21:02:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.522+0000 7f1f7f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800c39a0 con 0x7f1f800c6c60 2023-10-10T21:02:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.522+0000 7f1f7ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f801595a0 0x7f1f800c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f801595a0 0x7f1f800c1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55066/0 (socket says 172.21.15.154:55066) 2023-10-10T21:02:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7ed9d700 1 -- 172.21.15.154:0/1320906856 learned_addr learned my addr 172.21.15.154:0/1320906856 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7dd9b700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f800c6c60 0x7f1f80151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7e59c700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8006e8c0 0x7f1f8016de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7ed9d700 1 -- 172.21.15.154:0/1320906856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f800c6c60 msgr2=0x7f1f80151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7ed9d700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f800c6c60 0x7f1f80151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7ed9d700 1 -- 172.21.15.154:0/1320906856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8006e8c0 msgr2=0x7f1f8016de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7ed9d700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8006e8c0 0x7f1f8016de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7ed9d700 1 -- 172.21.15.154:0/1320906856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f74009420 con 0x7f1f801595a0 2023-10-10T21:02:49.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7e59c700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8006e8c0 0x7f1f8016de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:49.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7ed9d700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f801595a0 0x7f1f800c1950 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800cc90 tx=0x7f1f78001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:49.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f6e7fc700 1 -- 172.21.15.154:0/1320906856 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800a920 con 0x7f1f801595a0 2023-10-10T21:02:49.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f6e7fc700 1 -- 172.21.15.154:0/1320906856 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7800aa80 con 0x7f1f801595a0 2023-10-10T21:02:49.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f800c3c80 con 0x7f1f801595a0 2023-10-10T21:02:49.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.523+0000 7f1f6e7fc700 1 -- 172.21.15.154:0/1320906856 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800ae40 con 0x7f1f801595a0 2023-10-10T21:02:49.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.524+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8016e370 con 0x7f1f801595a0 2023-10-10T21:02:49.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.524+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8004c3c0 con 0x7f1f801595a0 2023-10-10T21:02:49.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.525+0000 7f1f6e7fc700 1 -- 172.21.15.154:0/1320906856 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f78007300 con 0x7f1f801595a0 2023-10-10T21:02:49.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.527+0000 7f1f6e7fc700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1f60066f30 0x7f1f600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.527+0000 7f1f6e7fc700 1 -- 172.21.15.154:0/1320906856 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f78084ad0 con 0x7f1f801595a0 2023-10-10T21:02:49.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.527+0000 7f1f7e59c700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1f60066f30 0x7f1f600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.527+0000 7f1f7e59c700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1f60066f30 0x7f1f600693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f70007fd0 tx=0x7f1f70009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:49.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.530+0000 7f1f6e7fc700 1 -- 172.21.15.154:0/1320906856 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f78051c10 con 0x7f1f801595a0 2023-10-10T21:02:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.721+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f800637d0 con 0x7f1f801595a0 2023-10-10T21:02:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.722+0000 7f1f6e7fc700 1 -- 172.21.15.154:0/1320906856 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f1f78055230 con 0x7f1f801595a0 2023-10-10T21:02:49.723 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:49.724 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:49.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.724+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1f60066f30 msgr2=0x7f1f600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.724+0000 7f1f7f59e700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1f60066f30 0x7f1f600693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f70007fd0 tx=0x7f1f70009040 comp rx=0 tx=0).stop 2023-10-10T21:02:49.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.724+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f801595a0 msgr2=0x7f1f800c1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.724+0000 7f1f7f59e700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f801595a0 0x7f1f800c1950 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800cc90 tx=0x7f1f78001a20 comp rx=0 tx=0).stop 2023-10-10T21:02:49.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.725+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 shutdown_connections 2023-10-10T21:02:49.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.725+0000 7f1f7f59e700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f801595a0 0x7f1f800c1950 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.725+0000 7f1f7f59e700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8006e8c0 0x7f1f8016de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.725+0000 7f1f7f59e700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1f60066f30 0x7f1f600693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.725+0000 7f1f7f59e700 1 --2- 172.21.15.154:0/1320906856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f800c6c60 0x7f1f80151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.725+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 >> 172.21.15.154:0/1320906856 conn(0x7f1f8006ddb0 msgr2=0x7f1f80153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:49.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.725+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 shutdown_connections 2023-10-10T21:02:49.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.725+0000 7f1f7f59e700 1 -- 172.21.15.154:0/1320906856 wait complete. 2023-10-10T21:02:49.743 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:02:17.271178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:02:18.145561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:02:49.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:02:49.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.929+0000 7f5beadff700 1 Processor -- start 2023-10-10T21:02:49.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.929+0000 7f5beadff700 1 -- start start 2023-10-10T21:02:49.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.931+0000 7f5beadff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159c60 0x7f5be415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.931+0000 7f5beadff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be415a160 con 0x7f5be4159890 2023-10-10T21:02:49.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.931+0000 7f5beadff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be40d13a0 con 0x7f5be415db10 2023-10-10T21:02:49.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.931+0000 7f5beadff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be415e140 con 0x7f5be4159c60 2023-10-10T21:02:49.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.931+0000 7f5be8b9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5be4159890 0x7f5be415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51504/0 (socket says 172.21.15.154:51504) 2023-10-10T21:02:49.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.931+0000 7f5be8b9b700 1 -- 172.21.15.154:0/525741849 learned_addr learned my addr 172.21.15.154:0/525741849 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:49.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.931+0000 7f5be3fff700 1 --2- 172.21.15.154:0/525741849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159c60 0x7f5be415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.931+0000 7f5be37fe700 1 -- 172.21.15.154:0/525741849 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050319633 0 0) 0x7f5be415a160 con 0x7f5be4159890 2023-10-10T21:02:49.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.931+0000 7f5be37fe700 1 -- 172.21.15.154:0/525741849 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd4003570 con 0x7f5be4159890 2023-10-10T21:02:49.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.932+0000 7f5be37fe700 1 -- 172.21.15.154:0/525741849 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291516518 0 0) 0x7f5be40d13a0 con 0x7f5be415db10 2023-10-10T21:02:49.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.932+0000 7f5be37fe700 1 -- 172.21.15.154:0/525741849 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be415a160 con 0x7f5be415db10 2023-10-10T21:02:49.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.932+0000 7f5be3fff700 1 -- 172.21.15.154:0/525741849 >> v1:172.21.15.179:6789/0 conn(0x7f5be415db10 legacy=0x7f5be4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.932+0000 7f5be3fff700 1 -- 172.21.15.154:0/525741849 >> v1:172.21.15.154:6789/0 conn(0x7f5be4159890 legacy=0x7f5be415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.932+0000 7f5be3fff700 1 -- 172.21.15.154:0/525741849 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be415a3d0 con 0x7f5be4159c60 2023-10-10T21:02:49.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.932+0000 7f5be3fff700 1 --2- 172.21.15.154:0/525741849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159c60 0x7f5be415d5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009910 tx=0x7f5bd00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20fa35399190743f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:49.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.932+0000 7f5be37fe700 1 -- 172.21.15.154:0/525741849 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0011630 con 0x7f5be4159c60 2023-10-10T21:02:49.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.932+0000 7f5be37fe700 1 -- 172.21.15.154:0/525741849 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd0011790 con 0x7f5be4159c60 2023-10-10T21:02:49.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.932+0000 7f5be37fe700 1 -- 172.21.15.154:0/525741849 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0011b30 con 0x7f5be4159c60 2023-10-10T21:02:49.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.933+0000 7f5beadff700 1 -- 172.21.15.154:0/525741849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159c60 msgr2=0x7f5be415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.933+0000 7f5beadff700 1 --2- 172.21.15.154:0/525741849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159c60 0x7f5be415d5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009910 tx=0x7f5bd00091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.933+0000 7f5beadff700 1 -- 172.21.15.154:0/525741849 shutdown_connections 2023-10-10T21:02:49.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.933+0000 7f5beadff700 1 --2- 172.21.15.154:0/525741849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159c60 0x7f5be415d5d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.933+0000 7f5beadff700 1 -- 172.21.15.154:0/525741849 >> 172.21.15.154:0/525741849 conn(0x7f5be4068e20 msgr2=0x7f5be40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:49.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.933+0000 7f5beadff700 1 -- 172.21.15.154:0/525741849 shutdown_connections 2023-10-10T21:02:49.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.933+0000 7f5beadff700 1 -- 172.21.15.154:0/525741849 wait complete. 2023-10-10T21:02:49.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.934+0000 7f5beadff700 1 Processor -- start 2023-10-10T21:02:49.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.935+0000 7f5beadff700 1 -- start start 2023-10-10T21:02:49.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.935+0000 7f5beadff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159890 0x7f5be40cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.935+0000 7f5beadff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be4159c60 0x7f5be40b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.935+0000 7f5beadff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be415db10 0x7f5be4151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.935+0000 7f5beadff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be415cc80 con 0x7f5be415db10 2023-10-10T21:02:49.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.935+0000 7f5beadff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40cf4d0 con 0x7f5be4159c60 2023-10-10T21:02:49.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.935+0000 7f5beadff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40cdf90 con 0x7f5be4159890 2023-10-10T21:02:49.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be415db10 0x7f5be4151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be415db10 0x7f5be4151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55082/0 (socket says 172.21.15.154:55082) 2023-10-10T21:02:49.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be939c700 1 -- 172.21.15.154:0/3064525530 learned_addr learned my addr 172.21.15.154:0/3064525530 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:49.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be3fff700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be4159c60 0x7f5be40b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be8b9b700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159890 0x7f5be40cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be939c700 1 -- 172.21.15.154:0/3064525530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159890 msgr2=0x7f5be40cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be939c700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159890 0x7f5be40cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be939c700 1 -- 172.21.15.154:0/3064525530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be4159c60 msgr2=0x7f5be40b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:49.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be939c700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be4159c60 0x7f5be40b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:49.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be939c700 1 -- 172.21.15.154:0/3064525530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0009420 con 0x7f5be415db10 2023-10-10T21:02:49.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be3fff700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be4159c60 0x7f5be40b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:49.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.936+0000 7f5be939c700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be415db10 0x7f5be4151990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c4e0 tx=0x7f5bdc007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:49.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.937+0000 7f5be0ff9700 1 -- 172.21.15.154:0/3064525530 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc011660 con 0x7f5be415db10 2023-10-10T21:02:49.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.937+0000 7f5be0ff9700 1 -- 172.21.15.154:0/3064525530 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0117e0 con 0x7f5be415db10 2023-10-10T21:02:49.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.937+0000 7f5be0ff9700 1 -- 172.21.15.154:0/3064525530 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc011ba0 con 0x7f5be415db10 2023-10-10T21:02:49.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.937+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be40ce8c0 con 0x7f5be415db10 2023-10-10T21:02:49.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.937+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be40cee80 con 0x7f5be415db10 2023-10-10T21:02:49.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.938+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be404c3c0 con 0x7f5be415db10 2023-10-10T21:02:49.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.939+0000 7f5be0ff9700 1 -- 172.21.15.154:0/3064525530 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bdc012420 con 0x7f5be415db10 2023-10-10T21:02:49.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.939+0000 7f5be0ff9700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5bc8066f30 0x7f5bc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:49.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.939+0000 7f5be0ff9700 1 -- 172.21.15.154:0/3064525530 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5bdc002030 con 0x7f5be415db10 2023-10-10T21:02:49.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.940+0000 7f5be8b9b700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5bc8066f30 0x7f5bc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:49.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.940+0000 7f5be8b9b700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5bc8066f30 0x7f5bc80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8005c50 tx=0x7f5bd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:49.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:49.944+0000 7f5be0ff9700 1 -- 172.21.15.154:0/3064525530 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bdc051530 con 0x7f5be415db10 2023-10-10T21:02:50.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.134+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5be40cbec0 con 0x7f5be415db10 2023-10-10T21:02:50.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.135+0000 7f5be0ff9700 1 -- 172.21.15.154:0/3064525530 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bdc054b50 con 0x7f5be415db10 2023-10-10T21:02:50.136 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:02:50.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5bc8066f30 msgr2=0x7f5bc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5bc8066f30 0x7f5bc80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8005c50 tx=0x7f5bd8009040 comp rx=0 tx=0).stop 2023-10-10T21:02:50.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be415db10 msgr2=0x7f5be4151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be415db10 0x7f5be4151990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c4e0 tx=0x7f5bdc007d80 comp rx=0 tx=0).stop 2023-10-10T21:02:50.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 shutdown_connections 2023-10-10T21:02:50.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be415db10 0x7f5be4151990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5bc8066f30 0x7f5bc80693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be4159890 0x7f5be40cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 --2- 172.21.15.154:0/3064525530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be4159c60 0x7f5be40b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 >> 172.21.15.154:0/3064525530 conn(0x7f5be4068e20 msgr2=0x7f5be41571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:50.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 shutdown_connections 2023-10-10T21:02:50.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.137+0000 7f5beadff700 1 -- 172.21.15.154:0/3064525530 wait complete. 2023-10-10T21:02:50.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:02:50.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.340+0000 7fb183bff700 1 Processor -- start 2023-10-10T21:02:50.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.340+0000 7fb183bff700 1 -- start start 2023-10-10T21:02:50.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.341+0000 7fb183bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c159890 0x7fb17c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.341+0000 7fb183bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb17c159c60 0x7fb17c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.341+0000 7fb183bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c15a160 con 0x7fb17c15db10 2023-10-10T21:02:50.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.341+0000 7fb183bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0d13a0 con 0x7fb17c159c60 2023-10-10T21:02:50.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.341+0000 7fb183bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15e140 con 0x7fb17c159890 2023-10-10T21:02:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.342+0000 7fb18199b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c159890 0x7fb17c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.342+0000 7fb18199b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c159890 0x7fb17c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:46268/0 (socket says 172.21.15.154:46268) 2023-10-10T21:02:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.342+0000 7fb18219c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb17c15db10 0x7fb17c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:35666/0 (socket says 172.21.15.154:35666) 2023-10-10T21:02:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.342+0000 7fb18199b700 1 -- 172.21.15.154:0/1873739481 learned_addr learned my addr 172.21.15.154:0/1873739481 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.342+0000 7fb18119a700 1 --2- 172.21.15.154:0/1873739481 >> v2:172.21.15.179:3300/0 conn(0x7fb17c159c60 0x7fb17c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.343+0000 7fb180999700 1 -- 172.21.15.154:0/1873739481 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167418838 0 0) 0x7fb17c15a160 con 0x7fb17c15db10 2023-10-10T21:02:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.343+0000 7fb18199b700 1 -- 172.21.15.154:0/1873739481 >> v2:172.21.15.179:3300/0 conn(0x7fb17c159c60 msgr2=0x7fb17c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.343+0000 7fb18199b700 1 --2- 172.21.15.154:0/1873739481 >> v2:172.21.15.179:3300/0 conn(0x7fb17c159c60 0x7fb17c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.343+0000 7fb18199b700 1 -- 172.21.15.154:0/1873739481 >> v1:172.21.15.179:6789/0 conn(0x7fb17c15db10 legacy=0x7fb17c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.343+0000 7fb18199b700 1 -- 172.21.15.154:0/1873739481 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c15a3d0 con 0x7fb17c159890 2023-10-10T21:02:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.343+0000 7fb18199b700 1 --2- 172.21.15.154:0/1873739481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c159890 0x7fb17c15abd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb1780099b0 tx=0x7fb178009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f22d3abd262954f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.343+0000 7fb180999700 1 -- 172.21.15.154:0/1873739481 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178009ea0 con 0x7fb17c159890 2023-10-10T21:02:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.343+0000 7fb180999700 1 -- 172.21.15.154:0/1873739481 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17800b860 con 0x7fb17c159890 2023-10-10T21:02:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.343+0000 7fb180999700 1 -- 172.21.15.154:0/1873739481 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17800bc00 con 0x7fb17c159890 2023-10-10T21:02:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.344+0000 7fb183bff700 1 -- 172.21.15.154:0/1873739481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c159890 msgr2=0x7fb17c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.344+0000 7fb183bff700 1 --2- 172.21.15.154:0/1873739481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c159890 0x7fb17c15abd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb1780099b0 tx=0x7fb178009250 comp rx=0 tx=0).stop 2023-10-10T21:02:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.344+0000 7fb183bff700 1 -- 172.21.15.154:0/1873739481 shutdown_connections 2023-10-10T21:02:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.344+0000 7fb183bff700 1 --2- 172.21.15.154:0/1873739481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c159890 0x7fb17c15abd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.344+0000 7fb183bff700 1 --2- 172.21.15.154:0/1873739481 >> v2:172.21.15.179:3300/0 conn(0x7fb17c159c60 0x7fb17c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.344+0000 7fb183bff700 1 -- 172.21.15.154:0/1873739481 >> 172.21.15.154:0/1873739481 conn(0x7fb17c068e20 msgr2=0x7fb17c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:50.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.344+0000 7fb183bff700 1 -- 172.21.15.154:0/1873739481 shutdown_connections 2023-10-10T21:02:50.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.344+0000 7fb183bff700 1 -- 172.21.15.154:0/1873739481 wait complete. 2023-10-10T21:02:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.345+0000 7fb183bff700 1 Processor -- start 2023-10-10T21:02:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.346+0000 7fb183bff700 1 -- start start 2023-10-10T21:02:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.346+0000 7fb183bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb17c159890 0x7fb17c157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.346+0000 7fb183bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb17c159c60 0x7fb17c155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.346+0000 7fb183bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c15db10 0x7fb17c14d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.346+0000 7fb183bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c14ce60 con 0x7fb17c159c60 2023-10-10T21:02:50.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.346+0000 7fb183bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c157680 con 0x7fb17c159890 2023-10-10T21:02:50.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.346+0000 7fb183bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c155760 con 0x7fb17c15db10 2023-10-10T21:02:50.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18119a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb17c159c60 0x7fb17c155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18119a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb17c159c60 0x7fb17c155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55094/0 (socket says 172.21.15.154:55094) 2023-10-10T21:02:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18119a700 1 -- 172.21.15.154:0/1968124768 learned_addr learned my addr 172.21.15.154:0/1968124768 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18199b700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb17c159890 0x7fb17c157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18219c700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c15db10 0x7fb17c14d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18119a700 1 -- 172.21.15.154:0/1968124768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c15db10 msgr2=0x7fb17c14d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18119a700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c15db10 0x7fb17c14d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18119a700 1 -- 172.21.15.154:0/1968124768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb17c159890 msgr2=0x7fb17c157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18119a700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb17c159890 0x7fb17c157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18119a700 1 -- 172.21.15.154:0/1968124768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780094f0 con 0x7fb17c159c60 2023-10-10T21:02:50.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18219c700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c15db10 0x7fb17c14d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:50.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.347+0000 7fb18119a700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb17c159c60 0x7fb17c155220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00ec80 tx=0x7fb16c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:50.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.348+0000 7fb171ffb700 1 -- 172.21.15.154:0/1968124768 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00c850 con 0x7fb17c159c60 2023-10-10T21:02:50.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.348+0000 7fb171ffb700 1 -- 172.21.15.154:0/1968124768 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c00c9b0 con 0x7fb17c159c60 2023-10-10T21:02:50.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.348+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c0cedc0 con 0x7fb17c159c60 2023-10-10T21:02:50.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.348+0000 7fb171ffb700 1 -- 172.21.15.154:0/1968124768 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00cd70 con 0x7fb17c159c60 2023-10-10T21:02:50.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.348+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c0b3c40 con 0x7fb17c159c60 2023-10-10T21:02:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.349+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c04c3c0 con 0x7fb17c159c60 2023-10-10T21:02:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.350+0000 7fb171ffb700 1 -- 172.21.15.154:0/1968124768 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb16c013680 con 0x7fb17c159c60 2023-10-10T21:02:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.350+0000 7fb171ffb700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb160066f30 0x7fb1600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.350+0000 7fb171ffb700 1 -- 172.21.15.154:0/1968124768 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb16c084800 con 0x7fb17c159c60 2023-10-10T21:02:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.351+0000 7fb18199b700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb160066f30 0x7fb1600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.351+0000 7fb18199b700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb160066f30 0x7fb1600693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb1780099b0 tx=0x7fb178017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.355+0000 7fb171ffb700 1 -- 172.21.15.154:0/1968124768 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb16c0519d0 con 0x7fb17c159c60 2023-10-10T21:02:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.547+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb17c06a5b0 con 0x7fb17c159c60 2023-10-10T21:02:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.548+0000 7fb171ffb700 1 -- 172.21.15.154:0/1968124768 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb16c054ff0 con 0x7fb17c159c60 2023-10-10T21:02:50.549 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:02:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb160066f30 msgr2=0x7fb1600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb160066f30 0x7fb1600693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb1780099b0 tx=0x7fb178017000 comp rx=0 tx=0).stop 2023-10-10T21:02:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb17c159c60 msgr2=0x7fb17c155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb17c159c60 0x7fb17c155220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00ec80 tx=0x7fb16c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 shutdown_connections 2023-10-10T21:02:50.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb160066f30 0x7fb1600693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb17c15db10 0x7fb17c14d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb17c159890 0x7fb17c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 --2- 172.21.15.154:0/1968124768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb17c159c60 0x7fb17c155220 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 >> 172.21.15.154:0/1968124768 conn(0x7fb17c068e20 msgr2=0x7fb17c158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 shutdown_connections 2023-10-10T21:02:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.550+0000 7fb183bff700 1 -- 172.21.15.154:0/1968124768 wait complete. 2023-10-10T21:02:50.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:02:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.755+0000 7f159f19d700 1 Processor -- start 2023-10-10T21:02:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.755+0000 7f159f19d700 1 -- start start 2023-10-10T21:02:50.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.756+0000 7f159f19d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15980ae7e0 0x7f15980c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.756+0000 7f159f19d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159806ebd0 con 0x7f159806f060 2023-10-10T21:02:50.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.756+0000 7f159f19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159815aa70 con 0x7f15980cb1a0 2023-10-10T21:02:50.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.756+0000 7f159f19d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159815b2e0 con 0x7f15980ae7e0 2023-10-10T21:02:50.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.756+0000 7f159e99c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15980ae7e0 0x7f15980c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.756+0000 7f159e99c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15980ae7e0 0x7f15980c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55100/0 (socket says 172.21.15.154:55100) 2023-10-10T21:02:50.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.756+0000 7f159e99c700 1 -- 172.21.15.154:0/67085004 learned_addr learned my addr 172.21.15.154:0/67085004 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:50.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.756+0000 7f159d99a700 1 --1- 172.21.15.154:0/67085004 >> v1:172.21.15.154:6789/0 conn(0x7f159806f060 0x7f15980ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51518/0 (socket says 172.21.15.154:51518) 2023-10-10T21:02:50.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.757+0000 7f159e99c700 1 -- 172.21.15.154:0/67085004 >> v1:172.21.15.179:6789/0 conn(0x7f15980cb1a0 legacy=0x7f159815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.757+0000 7f159e99c700 1 -- 172.21.15.154:0/67085004 >> v1:172.21.15.154:6789/0 conn(0x7f159806f060 legacy=0x7f15980ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.757+0000 7f159e99c700 1 -- 172.21.15.154:0/67085004 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159815ad20 con 0x7f15980ae7e0 2023-10-10T21:02:50.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.757+0000 7f159e99c700 1 --2- 172.21.15.154:0/67085004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980ae7e0 0x7f15980c9db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1590009f20 tx=0x7f1590009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ef6eb924e3339 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:50.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.757+0000 7f159d199700 1 -- 172.21.15.154:0/67085004 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000e070 con 0x7f15980ae7e0 2023-10-10T21:02:50.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.757+0000 7f159d199700 1 -- 172.21.15.154:0/67085004 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159000bb10 con 0x7f15980ae7e0 2023-10-10T21:02:50.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.757+0000 7f159d199700 1 -- 172.21.15.154:0/67085004 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15900092e0 con 0x7f15980ae7e0 2023-10-10T21:02:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.758+0000 7f159f19d700 1 -- 172.21.15.154:0/67085004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980ae7e0 msgr2=0x7f15980c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.758+0000 7f159f19d700 1 --2- 172.21.15.154:0/67085004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980ae7e0 0x7f15980c9db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1590009f20 tx=0x7f1590009840 comp rx=0 tx=0).stop 2023-10-10T21:02:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.758+0000 7f159f19d700 1 -- 172.21.15.154:0/67085004 shutdown_connections 2023-10-10T21:02:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.758+0000 7f159f19d700 1 --2- 172.21.15.154:0/67085004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980ae7e0 0x7f15980c9db0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.758+0000 7f159f19d700 1 -- 172.21.15.154:0/67085004 >> 172.21.15.154:0/67085004 conn(0x7f15980cc1e0 msgr2=0x7f15980cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.758+0000 7f159f19d700 1 -- 172.21.15.154:0/67085004 shutdown_connections 2023-10-10T21:02:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.758+0000 7f159f19d700 1 -- 172.21.15.154:0/67085004 wait complete. 2023-10-10T21:02:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.760+0000 7f159f19d700 1 Processor -- start 2023-10-10T21:02:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.760+0000 7f159f19d700 1 -- start start 2023-10-10T21:02:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159f19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159806f060 0x7f1598151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159f19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15980ae7e0 0x7f1598151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159f19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980cb1a0 0x7f15980b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159f19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15980c8030 con 0x7f15980cb1a0 2023-10-10T21:02:50.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159f19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598151fb0 con 0x7f159806f060 2023-10-10T21:02:50.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159f19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1598152290 con 0x7f15980ae7e0 2023-10-10T21:02:50.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980cb1a0 0x7f15980b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980cb1a0 0x7f15980b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55114/0 (socket says 172.21.15.154:55114) 2023-10-10T21:02:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e99c700 1 -- 172.21.15.154:0/2708894276 learned_addr learned my addr 172.21.15.154:0/2708894276 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e19b700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159806f060 0x7f1598151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159d99a700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15980ae7e0 0x7f1598151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e99c700 1 -- 172.21.15.154:0/2708894276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15980ae7e0 msgr2=0x7f1598151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e99c700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15980ae7e0 0x7f1598151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e99c700 1 -- 172.21.15.154:0/2708894276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159806f060 msgr2=0x7f1598151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e99c700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159806f060 0x7f1598151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e99c700 1 -- 172.21.15.154:0/2708894276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590009ae0 con 0x7f15980cb1a0 2023-10-10T21:02:50.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159d99a700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15980ae7e0 0x7f1598151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:50.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.761+0000 7f159e99c700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980cb1a0 0x7f15980b0920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1590012000 tx=0x7f1590018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:50.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.762+0000 7f158e7fc700 1 -- 172.21.15.154:0/2708894276 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159001d420 con 0x7f15980cb1a0 2023-10-10T21:02:50.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.762+0000 7f158e7fc700 1 -- 172.21.15.154:0/2708894276 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159001d580 con 0x7f15980cb1a0 2023-10-10T21:02:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.762+0000 7f158e7fc700 1 -- 172.21.15.154:0/2708894276 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159001d940 con 0x7f15980cb1a0 2023-10-10T21:02:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.762+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15980c4a20 con 0x7f15980cb1a0 2023-10-10T21:02:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.762+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15980c4640 con 0x7f15980cb1a0 2023-10-10T21:02:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.763+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15980c4f40 con 0x7f15980cb1a0 2023-10-10T21:02:50.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.764+0000 7f158e7fc700 1 -- 172.21.15.154:0/2708894276 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1590003040 con 0x7f15980cb1a0 2023-10-10T21:02:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.765+0000 7f158e7fc700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f157c066f30 0x7f157c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.765+0000 7f158e7fc700 1 -- 172.21.15.154:0/2708894276 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1590086420 con 0x7f15980cb1a0 2023-10-10T21:02:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.765+0000 7f159e19b700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f157c066f30 0x7f157c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.765+0000 7f159e19b700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f157c066f30 0x7f157c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f15940037c0 tx=0x7f1594009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:50.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.769+0000 7f158e7fc700 1 -- 172.21.15.154:0/2708894276 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15980c4f40 con 0x7f15980cb1a0 2023-10-10T21:02:50.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.961+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15980c4f40 con 0x7f15980cb1a0 2023-10-10T21:02:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.962+0000 7f158e7fc700 1 -- 172.21.15.154:0/2708894276 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15900535f0 con 0x7f15980cb1a0 2023-10-10T21:02:50.964 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:02:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f157c066f30 msgr2=0x7f157c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f157c066f30 0x7f157c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f15940037c0 tx=0x7f1594009040 comp rx=0 tx=0).stop 2023-10-10T21:02:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980cb1a0 msgr2=0x7f15980b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980cb1a0 0x7f15980b0920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1590012000 tx=0x7f1590018000 comp rx=0 tx=0).stop 2023-10-10T21:02:50.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 shutdown_connections 2023-10-10T21:02:50.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980cb1a0 0x7f15980b0920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159806f060 0x7f1598151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f157c066f30 0x7f157c0693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 --2- 172.21.15.154:0/2708894276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15980ae7e0 0x7f1598151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:50.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 >> 172.21.15.154:0/2708894276 conn(0x7f15980cc1e0 msgr2=0x7f1598150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:50.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 shutdown_connections 2023-10-10T21:02:50.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:50.964+0000 7f159f19d700 1 -- 172.21.15.154:0/2708894276 wait complete. 2023-10-10T21:02:50.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:51.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.164+0000 7f52cc1ff700 1 Processor -- start 2023-10-10T21:02:51.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.164+0000 7f52cc1ff700 1 -- start start 2023-10-10T21:02:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.166+0000 7f52cc1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c4155c10 0x7f52c4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.166+0000 7f52cc1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c40acac0 con 0x7f52c40ac6a0 2023-10-10T21:02:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.166+0000 7f52cc1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c40ad930 con 0x7f52c40ac230 2023-10-10T21:02:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.166+0000 7f52cc1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40acd20 con 0x7f52c4155c10 2023-10-10T21:02:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.166+0000 7f52ca79c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f52c40ac6a0 0x7f52c40b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51526/0 (socket says 172.21.15.154:51526) 2023-10-10T21:02:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.166+0000 7f52ca79c700 1 -- 172.21.15.154:0/4291204563 learned_addr learned my addr 172.21.15.154:0/4291204563 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:51.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.166+0000 7f52c9f9b700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c4155c10 0x7f52c4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.166+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662793113 0 0) 0x7f52c40acac0 con 0x7f52c40ac6a0 2023-10-10T21:02:51.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.166+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b0003570 con 0x7f52c40ac6a0 2023-10-10T21:02:51.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1295144328 0 0) 0x7f52b0003570 con 0x7f52c40ac6a0 2023-10-10T21:02:51.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c4155c10 msgr2=0x7f52c4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:51.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c4155c10 0x7f52c4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 >> v1:172.21.15.179:6789/0 conn(0x7f52c40ac230 legacy=0x7f52c41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40ad000 con 0x7f52c40ac6a0 2023-10-10T21:02:51.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f52bc0017f0 con 0x7f52c40ac6a0 2023-10-10T21:02:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 >> v1:172.21.15.154:6789/0 conn(0x7f52c40ac6a0 legacy=0x7f52c40b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c4155c10 0x7f52b0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b0004d50 0x7f52b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40acd20 con 0x7f52b0003fd0 2023-10-10T21:02:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b000ddb0 con 0x7f52b0004d50 2023-10-10T21:02:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b000df70 con 0x7f52c4155c10 2023-10-10T21:02:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c979a700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52c9f9b700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c4155c10 0x7f52b0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.167+0000 7f52ca79c700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b0004d50 0x7f52b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52c979a700 1 -- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c4155c10 msgr2=0x7f52b0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:51.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52c979a700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c4155c10 0x7f52b0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52c979a700 1 -- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b0004d50 msgr2=0x7f52b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:51.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52c979a700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b0004d50 0x7f52b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52c979a700 1 -- 172.21.15.154:0/4291204563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b0003570 con 0x7f52b0003fd0 2023-10-10T21:02:51.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52c979a700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52b0004810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f52b40019a0 tx=0x7f52b4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d69f16197270748 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:51.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400c5d0 con 0x7f52b0003fd0 2023-10-10T21:02:51.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b400c750 con 0x7f52b0003fd0 2023-10-10T21:02:51.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52c8f99700 1 -- 172.21.15.154:0/4291204563 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400cb10 con 0x7f52b0003fd0 2023-10-10T21:02:51.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52cc1ff700 1 -- 172.21.15.154:0/4291204563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 msgr2=0x7f52b0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52cc1ff700 1 --2- 172.21.15.154:0/4291204563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52b0004810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f52b40019a0 tx=0x7f52b4007d10 comp rx=0 tx=0).stop 2023-10-10T21:02:51.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.168+0000 7f52ca79c700 1 -- 172.21.15.154:0/4291204563 reap_dead start 2023-10-10T21:02:51.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.169+0000 7f52cc1ff700 1 -- 172.21.15.154:0/4291204563 shutdown_connections 2023-10-10T21:02:51.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.169+0000 7f52cc1ff700 1 -- 172.21.15.154:0/4291204563 >> 172.21.15.154:0/4291204563 conn(0x7f52c406a320 msgr2=0x7f52c40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:51.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.169+0000 7f52cc1ff700 1 -- 172.21.15.154:0/4291204563 shutdown_connections 2023-10-10T21:02:51.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.169+0000 7f52cc1ff700 1 -- 172.21.15.154:0/4291204563 wait complete. 2023-10-10T21:02:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.170+0000 7f52cc1ff700 1 Processor -- start 2023-10-10T21:02:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.170+0000 7f52cc1ff700 1 -- start start 2023-10-10T21:02:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52cc1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52c4150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52cc1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c40aae30 0x7f52c4165620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52cc1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c4158170 0x7f52c40b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52cc1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4156e50 con 0x7f52b0003fd0 2023-10-10T21:02:51.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52cc1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4156840 con 0x7f52c4158170 2023-10-10T21:02:51.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52cc1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4158a50 con 0x7f52c40aae30 2023-10-10T21:02:51.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52c9f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52c4150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52c9f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52c4150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55126/0 (socket says 172.21.15.154:55126) 2023-10-10T21:02:51.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52c9f9b700 1 -- 172.21.15.154:0/2450653594 learned_addr learned my addr 172.21.15.154:0/2450653594 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:51.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52c979a700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c40aae30 0x7f52c4165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.171+0000 7f52ca79c700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c4158170 0x7f52c40b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52c9f9b700 1 -- 172.21.15.154:0/2450653594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c40aae30 msgr2=0x7f52c4165620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52c9f9b700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c40aae30 0x7f52c4165620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52c9f9b700 1 -- 172.21.15.154:0/2450653594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c4158170 msgr2=0x7f52c40b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52c9f9b700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c4158170 0x7f52c40b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52c9f9b700 1 -- 172.21.15.154:0/2450653594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4156ae0 con 0x7f52b0003fd0 2023-10-10T21:02:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52c9f9b700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52c4150790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52c0011d40 tx=0x7f52c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52b9ffb700 1 -- 172.21.15.154:0/2450653594 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000fa10 con 0x7f52b0003fd0 2023-10-10T21:02:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52b9ffb700 1 -- 172.21.15.154:0/2450653594 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c000fb70 con 0x7f52b0003fd0 2023-10-10T21:02:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52b9ffb700 1 -- 172.21.15.154:0/2450653594 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0014440 con 0x7f52b0003fd0 2023-10-10T21:02:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c4150cd0 con 0x7f52b0003fd0 2023-10-10T21:02:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.172+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c4158d30 con 0x7f52b0003fd0 2023-10-10T21:02:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.173+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c4064de0 con 0x7f52b0003fd0 2023-10-10T21:02:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.174+0000 7f52b9ffb700 1 -- 172.21.15.154:0/2450653594 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52c0014870 con 0x7f52b0003fd0 2023-10-10T21:02:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.175+0000 7f52b9ffb700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52a8066f30 0x7f52a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.175+0000 7f52b9ffb700 1 -- 172.21.15.154:0/2450653594 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52c0018030 con 0x7f52b0003fd0 2023-10-10T21:02:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.175+0000 7f52c979a700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52a8066f30 0x7f52a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.176+0000 7f52c979a700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52a8066f30 0x7f52a80693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52b4008fd0 tx=0x7f52b4015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:51.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.179+0000 7f52b9ffb700 1 -- 172.21.15.154:0/2450653594 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52c00521d0 con 0x7f52b0003fd0 2023-10-10T21:02:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.369+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52c4156c70 con 0x7f52b0003fd0 2023-10-10T21:02:51.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.370+0000 7f52b9ffb700 1 -- 172.21.15.154:0/2450653594 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f52c0022090 con 0x7f52b0003fd0 2023-10-10T21:02:51.371 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:51.372 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:51.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.372+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52a8066f30 msgr2=0x7f52a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.372+0000 7f52cc1ff700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52a8066f30 0x7f52a80693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52b4008fd0 tx=0x7f52b4015000 comp rx=0 tx=0).stop 2023-10-10T21:02:51.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.372+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 msgr2=0x7f52c4150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.372+0000 7f52cc1ff700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52c4150790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52c0011d40 tx=0x7f52c00091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.372+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 shutdown_connections 2023-10-10T21:02:51.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.372+0000 7f52cc1ff700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c4158170 0x7f52c40b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.372+0000 7f52cc1ff700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52b0003fd0 0x7f52c4150790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.372+0000 7f52cc1ff700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52a8066f30 0x7f52a80693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.372+0000 7f52cc1ff700 1 --2- 172.21.15.154:0/2450653594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c40aae30 0x7f52c4165620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.373+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 >> 172.21.15.154:0/2450653594 conn(0x7f52c406a320 msgr2=0x7f52c406e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:51.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.373+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 shutdown_connections 2023-10-10T21:02:51.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.373+0000 7f52cc1ff700 1 -- 172.21.15.154:0/2450653594 wait complete. 2023-10-10T21:02:51.391 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:02:17.271178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:02:18.145561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:02:51.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:02:51.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.575+0000 7fe4b759e700 1 Processor -- start 2023-10-10T21:02:51.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.575+0000 7fe4b759e700 1 -- start start 2023-10-10T21:02:51.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b759e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe4b80c9db0 0x7fe4b806a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4b8157130 0x7fe4b806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b759e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b806e150 con 0x7fe4b8153900 2023-10-10T21:02:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b759e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b80c7610 con 0x7fe4b80c9db0 2023-10-10T21:02:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80c7800 con 0x7fe4b8157130 2023-10-10T21:02:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe4b8153900 0x7fe4b80c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51536/0 (socket says 172.21.15.154:51536) 2023-10-10T21:02:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b659c700 1 -- 172.21.15.154:0/3538854664 learned_addr learned my addr 172.21.15.154:0/3538854664 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b5d9b700 1 --2- 172.21.15.154:0/3538854664 >> v2:172.21.15.179:3300/0 conn(0x7fe4b80c9db0 0x7fe4b806a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b6d9d700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4b8157130 0x7fe4b806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010621917 0 0) 0x7fe4b806e150 con 0x7fe4b8153900 2023-10-10T21:02:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.577+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4a0003570 con 0x7fe4b8153900 2023-10-10T21:02:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2151455262 0 0) 0x7fe4a0003570 con 0x7fe4b8153900 2023-10-10T21:02:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4b8157130 msgr2=0x7fe4b806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4b8157130 0x7fe4b806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 >> v2:172.21.15.179:3300/0 conn(0x7fe4b80c9db0 msgr2=0x7fe4b806a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 --2- 172.21.15.154:0/3538854664 >> v2:172.21.15.179:3300/0 conn(0x7fe4b80c9db0 0x7fe4b806a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80c7ae0 con 0x7fe4b8153900 2023-10-10T21:02:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fe4a8001470 con 0x7fe4b8153900 2023-10-10T21:02:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b5d9b700 1 --2- 172.21.15.154:0/3538854664 >> v2:172.21.15.179:3300/0 conn(0x7fe4b80c9db0 0x7fe4b806a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 >> v1:172.21.15.154:6789/0 conn(0x7fe4b8153900 legacy=0x7fe4b80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4b8157130 0x7fe4a0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4a0003fe0 0x7fe4a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4a0004d50 0x7fe4a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80c7800 con 0x7fe4a0003fe0 2023-10-10T21:02:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a000dc70 con 0x7fe4a0004d50 2023-10-10T21:02:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a000dde0 con 0x7fe4b8157130 2023-10-10T21:02:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b5d9b700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4a0003fe0 0x7fe4a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b6d9d700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4a0004d50 0x7fe4a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.578+0000 7fe4b659c700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4b8157130 0x7fe4a0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b5d9b700 1 -- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4b8157130 msgr2=0x7fe4a0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b5d9b700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4b8157130 0x7fe4a0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b5d9b700 1 -- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4a0004d50 msgr2=0x7fe4a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b5d9b700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4a0004d50 0x7fe4a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b5d9b700 1 -- 172.21.15.154:0/3538854664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a0003570 con 0x7fe4a0003fe0 2023-10-10T21:02:51.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b659c700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4b8157130 0x7fe4a0003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:51.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b5d9b700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4a0003fe0 0x7fe4a0004810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80ca1d0 tx=0x7fe4ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b31ef2389e6921 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:51.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac009740 con 0x7fe4a0003fe0 2023-10-10T21:02:51.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac00e8c0 con 0x7fe4a0003fe0 2023-10-10T21:02:51.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b559a700 1 -- 172.21.15.154:0/3538854664 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00ec60 con 0x7fe4a0003fe0 2023-10-10T21:02:51.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b759e700 1 -- 172.21.15.154:0/3538854664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4a0003fe0 msgr2=0x7fe4a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.579+0000 7fe4b759e700 1 --2- 172.21.15.154:0/3538854664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4a0003fe0 0x7fe4a0004810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80ca1d0 tx=0x7fe4ac0091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.580+0000 7fe4b6d9d700 1 -- 172.21.15.154:0/3538854664 reap_dead start 2023-10-10T21:02:51.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.580+0000 7fe4b759e700 1 -- 172.21.15.154:0/3538854664 shutdown_connections 2023-10-10T21:02:51.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.580+0000 7fe4b759e700 1 -- 172.21.15.154:0/3538854664 >> 172.21.15.154:0/3538854664 conn(0x7fe4b80cc1e0 msgr2=0x7fe4b80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:51.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.580+0000 7fe4b759e700 1 -- 172.21.15.154:0/3538854664 shutdown_connections 2023-10-10T21:02:51.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.580+0000 7fe4b759e700 1 -- 172.21.15.154:0/3538854664 wait complete. 2023-10-10T21:02:51.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.581+0000 7fe4b759e700 1 Processor -- start 2023-10-10T21:02:51.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.581+0000 7fe4b759e700 1 -- start start 2023-10-10T21:02:51.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.582+0000 7fe4b759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4a0003fe0 0x7fe4b80aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.582+0000 7fe4b759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b8169200 0x7fe4b816d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.582+0000 7fe4b759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8169670 0x7fe4b80a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.582+0000 7fe4b759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80aef80 con 0x7fe4b8169670 2023-10-10T21:02:51.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.582+0000 7fe4b759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b816d020 con 0x7fe4b8169200 2023-10-10T21:02:51.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.582+0000 7fe4b759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b816d300 con 0x7fe4a0003fe0 2023-10-10T21:02:51.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.582+0000 7fe4b6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8169670 0x7fe4b80a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8169670 0x7fe4b80a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55140/0 (socket says 172.21.15.154:55140) 2023-10-10T21:02:51.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b659c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4a0003fe0 0x7fe4b80aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b6d9d700 1 -- 172.21.15.154:0/652574751 learned_addr learned my addr 172.21.15.154:0/652574751 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:51.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b5d9b700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b8169200 0x7fe4b816d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b6d9d700 1 -- 172.21.15.154:0/652574751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4a0003fe0 msgr2=0x7fe4b80aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b6d9d700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4a0003fe0 0x7fe4b80aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b6d9d700 1 -- 172.21.15.154:0/652574751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b8169200 msgr2=0x7fe4b816d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b6d9d700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b8169200 0x7fe4b816d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b6d9d700 1 -- 172.21.15.154:0/652574751 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8150e10 con 0x7fe4b8169670 2023-10-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b6d9d700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8169670 0x7fe4b80a98d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe4b806d1e0 tx=0x7fe4b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4a67fc700 1 -- 172.21.15.154:0/652574751 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b000e040 con 0x7fe4b8169670 2023-10-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4a67fc700 1 -- 172.21.15.154:0/652574751 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b000f040 con 0x7fe4b8169670 2023-10-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b80acf50 con 0x7fe4b8169670 2023-10-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.583+0000 7fe4a67fc700 1 -- 172.21.15.154:0/652574751 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b000fd70 con 0x7fe4b8169670 2023-10-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.584+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b80ad510 con 0x7fe4b8169670 2023-10-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.584+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b80ad730 con 0x7fe4b8169670 2023-10-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.585+0000 7fe4a67fc700 1 -- 172.21.15.154:0/652574751 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4b0015640 con 0x7fe4b8169670 2023-10-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.586+0000 7fe4a67fc700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe498066f30 0x7fe4980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.586+0000 7fe4a67fc700 1 -- 172.21.15.154:0/652574751 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4b0084d20 con 0x7fe4b8169670 2023-10-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.587+0000 7fe4b659c700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe498066f30 0x7fe4980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.587+0000 7fe4b659c700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe498066f30 0x7fe4980693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8000e10 tx=0x7fe4a8007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.590+0000 7fe4a67fc700 1 -- 172.21.15.154:0/652574751 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4b0051ef0 con 0x7fe4b8169670 2023-10-10T21:02:51.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.785+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4b816d470 con 0x7fe4b8169670 2023-10-10T21:02:51.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.786+0000 7fe4a67fc700 1 -- 172.21.15.154:0/652574751 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4b0055510 con 0x7fe4b8169670 2023-10-10T21:02:51.787 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:02:51.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe498066f30 msgr2=0x7fe4980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe498066f30 0x7fe4980693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8000e10 tx=0x7fe4a8007040 comp rx=0 tx=0).stop 2023-10-10T21:02:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8169670 msgr2=0x7fe4b80a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8169670 0x7fe4b80a98d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe4b806d1e0 tx=0x7fe4b000b040 comp rx=0 tx=0).stop 2023-10-10T21:02:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 shutdown_connections 2023-10-10T21:02:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8169670 0x7fe4b80a98d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe498066f30 0x7fe4980693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4a0003fe0 0x7fe4b80aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 --2- 172.21.15.154:0/652574751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4b8169200 0x7fe4b816d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 >> 172.21.15.154:0/652574751 conn(0x7fe4b80cc1e0 msgr2=0x7fe4b80c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 shutdown_connections 2023-10-10T21:02:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.788+0000 7fe4b759e700 1 -- 172.21.15.154:0/652574751 wait complete. 2023-10-10T21:02:51.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:02:51.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.991+0000 7f182e7ff700 1 Processor -- start 2023-10-10T21:02:51.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.991+0000 7f182e7ff700 1 -- start start 2023-10-10T21:02:51.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.993+0000 7f182e7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18280c70b0 0x7f1828069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:51.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.993+0000 7f182e7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182806e950 con 0x7f1828069cb0 2023-10-10T21:02:51.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.993+0000 7f182e7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182806eb90 con 0x7f1828155eb0 2023-10-10T21:02:51.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.993+0000 7f182e7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182806a130 con 0x7f18280c70b0 2023-10-10T21:02:51.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.993+0000 7f182cd9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1828069cb0 0x7f18280ca4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51550/0 (socket says 172.21.15.154:51550) 2023-10-10T21:02:51.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.993+0000 7f182cd9c700 1 -- 172.21.15.154:0/4197624365 learned_addr learned my addr 172.21.15.154:0/4197624365 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:51.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.993+0000 7f181f7fe700 1 --2- 172.21.15.154:0/4197624365 >> v2:172.21.15.179:3300/0 conn(0x7f18280c70b0 0x7f1828069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:51.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.993+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641499049 0 0) 0x7f1820001490 con 0x7f1828069cb0 2023-10-10T21:02:51.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.993+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1814003570 con 0x7f1828069cb0 2023-10-10T21:02:51.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521377882 0 0) 0x7f182806eb90 con 0x7f1828155eb0 2023-10-10T21:02:51.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1820001490 con 0x7f1828155eb0 2023-10-10T21:02:51.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1945303270 0 0) 0x7f1814003570 con 0x7f1828069cb0 2023-10-10T21:02:51.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 >> v2:172.21.15.179:3300/0 conn(0x7f18280c70b0 msgr2=0x7f1828069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:51.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 --2- 172.21.15.154:0/4197624365 >> v2:172.21.15.179:3300/0 conn(0x7f18280c70b0 0x7f1828069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:51.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 >> v1:172.21.15.179:6789/0 conn(0x7f1828155eb0 legacy=0x7f182806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:51.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182806ee70 con 0x7f1828069cb0 2023-10-10T21:02:52.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f1820001980 con 0x7f1828069cb0 2023-10-10T21:02:52.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f181f7fe700 1 --2- 172.21.15.154:0/4197624365 >> v2:172.21.15.179:3300/0 conn(0x7f18280c70b0 0x7f1828069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:52.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 >> v1:172.21.15.154:6789/0 conn(0x7f1828069cb0 legacy=0x7f18280ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1814004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1814004810 0x7f1814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1814005210 0x7f181400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182806a130 con 0x7f1814003c40 2023-10-10T21:02:52.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181400c130 con 0x7f1814004810 2023-10-10T21:02:52.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181400c2c0 con 0x7f1814005210 2023-10-10T21:02:52.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f1827fff700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1814004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f182cd9c700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1814005210 0x7f181400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.994+0000 7f181f7fe700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1814004810 0x7f1814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f1827fff700 1 -- 172.21.15.154:0/4197624365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1814005210 msgr2=0x7f181400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:52.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f1827fff700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1814005210 0x7f181400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f1827fff700 1 -- 172.21.15.154:0/4197624365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1814004810 msgr2=0x7f1814004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:52.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f1827fff700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1814004810 0x7f1814004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f1827fff700 1 -- 172.21.15.154:0/4197624365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814003570 con 0x7f1814003c40 2023-10-10T21:02:52.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f182cd9c700 1 -- 172.21.15.154:0/4197624365 reap_dead start 2023-10-10T21:02:52.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f1827fff700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1814004030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1818001a40 tx=0x7f1818007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c29a58ad3c9c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:52.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800c590 con 0x7f1814003c40 2023-10-10T21:02:52.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800c6f0 con 0x7f1814003c40 2023-10-10T21:02:52.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.995+0000 7f18277fe700 1 -- 172.21.15.154:0/4197624365 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800cab0 con 0x7f1814003c40 2023-10-10T21:02:52.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.996+0000 7f182e7ff700 1 -- 172.21.15.154:0/4197624365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 msgr2=0x7f1814004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.996+0000 7f182e7ff700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1814004030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1818001a40 tx=0x7f1818007d30 comp rx=0 tx=0).stop 2023-10-10T21:02:52.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.996+0000 7f182e7ff700 1 -- 172.21.15.154:0/4197624365 shutdown_connections 2023-10-10T21:02:52.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.996+0000 7f182e7ff700 1 --2- 172.21.15.154:0/4197624365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1814004030 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.996+0000 7f182e7ff700 1 -- 172.21.15.154:0/4197624365 >> 172.21.15.154:0/4197624365 conn(0x7f1828068e10 msgr2=0x7f18280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:52.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.996+0000 7f182e7ff700 1 -- 172.21.15.154:0/4197624365 shutdown_connections 2023-10-10T21:02:52.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.996+0000 7f182e7ff700 1 -- 172.21.15.154:0/4197624365 wait complete. 2023-10-10T21:02:52.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.997+0000 7f182e7ff700 1 Processor -- start 2023-10-10T21:02:52.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.997+0000 7f182e7ff700 1 -- start start 2023-10-10T21:02:52.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.998+0000 7f182e7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1828148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.998+0000 7f182e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f182816ac60 0x7f18280a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.998+0000 7f182e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f182816b0d0 0x7f18280a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.998+0000 7f182e7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18280ab070 con 0x7f1814003c40 2023-10-10T21:02:52.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.998+0000 7f182e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18280ab6b0 con 0x7f182816b0d0 2023-10-10T21:02:52.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.998+0000 7f182e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280abc70 con 0x7f182816ac60 2023-10-10T21:02:52.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.998+0000 7f1827fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1828148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.998+0000 7f1827fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1828148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55148/0 (socket says 172.21.15.154:55148) 2023-10-10T21:02:52.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.998+0000 7f1827fff700 1 -- 172.21.15.154:0/3703774028 learned_addr learned my addr 172.21.15.154:0/3703774028 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:52.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f181f7fe700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f182816ac60 0x7f18280a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f182cd9c700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f182816b0d0 0x7f18280a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f1827fff700 1 -- 172.21.15.154:0/3703774028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f182816ac60 msgr2=0x7f18280a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f1827fff700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f182816ac60 0x7f18280a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f1827fff700 1 -- 172.21.15.154:0/3703774028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f182816b0d0 msgr2=0x7f18280a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f1827fff700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f182816b0d0 0x7f18280a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f1827fff700 1 -- 172.21.15.154:0/3703774028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280aa490 con 0x7f1814003c40 2023-10-10T21:02:52.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f1827fff700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1828148110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f181800c3c0 tx=0x7f1818015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:52.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f1824ff9700 1 -- 172.21.15.154:0/3703774028 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800c590 con 0x7f1814003c40 2023-10-10T21:02:52.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f1824ff9700 1 -- 172.21.15.154:0/3703774028 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1818001360 con 0x7f1814003c40 2023-10-10T21:02:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f1824ff9700 1 -- 172.21.15.154:0/3703774028 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800ca90 con 0x7f1814003c40 2023-10-10T21:02:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:51.999+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18280aa770 con 0x7f1814003c40 2023-10-10T21:02:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.000+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18280c5730 con 0x7f1814003c40 2023-10-10T21:02:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.001+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182804c3c0 con 0x7f1814003c40 2023-10-10T21:02:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.001+0000 7f1824ff9700 1 -- 172.21.15.154:0/3703774028 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1818019070 con 0x7f1814003c40 2023-10-10T21:02:52.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.002+0000 7f1824ff9700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1808066f60 0x7f1808069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.002+0000 7f1824ff9700 1 -- 172.21.15.154:0/3703774028 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1818085bc0 con 0x7f1814003c40 2023-10-10T21:02:52.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.002+0000 7f181f7fe700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1808066f60 0x7f1808069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.003+0000 7f181f7fe700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1808066f60 0x7f1808069410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18280c63e0 tx=0x7f181000a330 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:52.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.007+0000 7f1824ff9700 1 -- 172.21.15.154:0/3703774028 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1818052d90 con 0x7f1814003c40 2023-10-10T21:02:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.197+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f182806f150 con 0x7f1814003c40 2023-10-10T21:02:52.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.198+0000 7f1824ff9700 1 -- 172.21.15.154:0/3703774028 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1818022020 con 0x7f1814003c40 2023-10-10T21:02:52.199 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:02:52.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1808066f60 msgr2=0x7f1808069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1808066f60 0x7f1808069410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18280c63e0 tx=0x7f181000a330 comp rx=0 tx=0).stop 2023-10-10T21:02:52.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 msgr2=0x7f1828148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1828148110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f181800c3c0 tx=0x7f1818015000 comp rx=0 tx=0).stop 2023-10-10T21:02:52.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 shutdown_connections 2023-10-10T21:02:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f182816b0d0 0x7f18280a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1814003c40 0x7f1828148110 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1808066f60 0x7f1808069410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 --2- 172.21.15.154:0/3703774028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f182816ac60 0x7f18280a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 >> 172.21.15.154:0/3703774028 conn(0x7f1828068e10 msgr2=0x7f1828154d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:52.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 shutdown_connections 2023-10-10T21:02:52.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.200+0000 7f182e7ff700 1 -- 172.21.15.154:0/3703774028 wait complete. 2023-10-10T21:02:52.219 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:02:52.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.403+0000 7fbe86fff700 1 Processor -- start 2023-10-10T21:02:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.403+0000 7fbe86fff700 1 -- start start 2023-10-10T21:02:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.404+0000 7fbe86fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe80159890 0x7fbe8015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.404+0000 7fbe86fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbe80069560 0x7fbe800699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe86fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe80069ee0 con 0x7fbe80159c60 2023-10-10T21:02:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe86fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8015a160 con 0x7fbe80159890 2023-10-10T21:02:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe86fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe800d13a0 con 0x7fbe80069560 2023-10-10T21:02:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe84d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe80159890 0x7fbe8015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe7ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbe80159c60 0x7fbe8015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51554/0 (socket says 172.21.15.154:51554) 2023-10-10T21:02:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe7ffff700 1 -- 172.21.15.154:0/2425690123 learned_addr learned my addr 172.21.15.154:0/2425690123 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:52.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe8559c700 1 --2- 172.21.15.154:0/2425690123 >> v2:172.21.15.179:3300/0 conn(0x7fbe80069560 0x7fbe800699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe7f7fe700 1 -- 172.21.15.154:0/2425690123 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246096037 0 0) 0x7fbe80069ee0 con 0x7fbe80159c60 2023-10-10T21:02:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe7f7fe700 1 -- 172.21.15.154:0/2425690123 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe70003570 con 0x7fbe80159c60 2023-10-10T21:02:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe84d9b700 1 -- 172.21.15.154:0/2425690123 >> v2:172.21.15.179:3300/0 conn(0x7fbe80069560 msgr2=0x7fbe800699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe84d9b700 1 --2- 172.21.15.154:0/2425690123 >> v2:172.21.15.179:3300/0 conn(0x7fbe80069560 0x7fbe800699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe84d9b700 1 -- 172.21.15.154:0/2425690123 >> v1:172.21.15.154:6789/0 conn(0x7fbe80159c60 legacy=0x7fbe8015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe84d9b700 1 -- 172.21.15.154:0/2425690123 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8015e140 con 0x7fbe80159890 2023-10-10T21:02:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.405+0000 7fbe8559c700 1 --2- 172.21.15.154:0/2425690123 >> v2:172.21.15.179:3300/0 conn(0x7fbe80069560 0x7fbe800699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe84d9b700 1 --2- 172.21.15.154:0/2425690123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159890 0x7fbe8015abd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbe8006a890 tx=0x7fbe740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a22629d0689816 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe7f7fe700 1 -- 172.21.15.154:0/2425690123 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74011630 con 0x7fbe80159890 2023-10-10T21:02:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe7f7fe700 1 -- 172.21.15.154:0/2425690123 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74011790 con 0x7fbe80159890 2023-10-10T21:02:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe7f7fe700 1 -- 172.21.15.154:0/2425690123 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74011b10 con 0x7fbe80159890 2023-10-10T21:02:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe86fff700 1 -- 172.21.15.154:0/2425690123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159890 msgr2=0x7fbe8015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe86fff700 1 --2- 172.21.15.154:0/2425690123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159890 0x7fbe8015abd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbe8006a890 tx=0x7fbe740091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe86fff700 1 -- 172.21.15.154:0/2425690123 shutdown_connections 2023-10-10T21:02:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe86fff700 1 --2- 172.21.15.154:0/2425690123 >> v2:172.21.15.179:3300/0 conn(0x7fbe80069560 0x7fbe800699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe86fff700 1 --2- 172.21.15.154:0/2425690123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159890 0x7fbe8015abd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.406+0000 7fbe86fff700 1 -- 172.21.15.154:0/2425690123 >> 172.21.15.154:0/2425690123 conn(0x7fbe80068e20 msgr2=0x7fbe800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:52.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.407+0000 7fbe86fff700 1 -- 172.21.15.154:0/2425690123 shutdown_connections 2023-10-10T21:02:52.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.407+0000 7fbe86fff700 1 -- 172.21.15.154:0/2425690123 wait complete. 2023-10-10T21:02:52.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.408+0000 7fbe86fff700 1 Processor -- start 2023-10-10T21:02:52.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.408+0000 7fbe86fff700 1 -- start start 2023-10-10T21:02:52.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.409+0000 7fbe86fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe80069560 0x7fbe800c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.409+0000 7fbe86fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe80159890 0x7fbe800c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.409+0000 7fbe86fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159c60 0x7fbe80151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.409+0000 7fbe86fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800c8d20 con 0x7fbe80159c60 2023-10-10T21:02:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.409+0000 7fbe86fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800c8110 con 0x7fbe80159890 2023-10-10T21:02:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.409+0000 7fbe86fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800c83f0 con 0x7fbe80069560 2023-10-10T21:02:52.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.409+0000 7fbe8559c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159c60 0x7fbe80151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.409+0000 7fbe8559c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159c60 0x7fbe80151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55168/0 (socket says 172.21.15.154:55168) 2023-10-10T21:02:52.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.409+0000 7fbe8559c700 1 -- 172.21.15.154:0/2255702335 learned_addr learned my addr 172.21.15.154:0/2255702335 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:52.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe84d9b700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe80069560 0x7fbe800c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe7ffff700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe80159890 0x7fbe800c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe8559c700 1 -- 172.21.15.154:0/2255702335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe80069560 msgr2=0x7fbe800c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe8559c700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe80069560 0x7fbe800c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe8559c700 1 -- 172.21.15.154:0/2255702335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe80159890 msgr2=0x7fbe800c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe8559c700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe80159890 0x7fbe800c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe8559c700 1 -- 172.21.15.154:0/2255702335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74009420 con 0x7fbe80159c60 2023-10-10T21:02:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe84d9b700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe80069560 0x7fbe800c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe8559c700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159c60 0x7fbe80151ec0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800a380 tx=0x7fbe78007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe7cff9700 1 -- 172.21.15.154:0/2255702335 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800ae10 con 0x7fbe80159c60 2023-10-10T21:02:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe7cff9700 1 -- 172.21.15.154:0/2255702335 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7800d650 con 0x7fbe80159c60 2023-10-10T21:02:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe7cff9700 1 -- 172.21.15.154:0/2255702335 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800da10 con 0x7fbe80159c60 2023-10-10T21:02:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe800c86d0 con 0x7fbe80159c60 2023-10-10T21:02:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.410+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe800c96f0 con 0x7fbe80159c60 2023-10-10T21:02:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.411+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8004c3c0 con 0x7fbe80159c60 2023-10-10T21:02:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.412+0000 7fbe7cff9700 1 -- 172.21.15.154:0/2255702335 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe7801e3b0 con 0x7fbe80159c60 2023-10-10T21:02:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.413+0000 7fbe7cff9700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbe64066f30 0x7fbe640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.413+0000 7fbe7cff9700 1 -- 172.21.15.154:0/2255702335 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe78084f80 con 0x7fbe80159c60 2023-10-10T21:02:52.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.413+0000 7fbe84d9b700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbe64066f30 0x7fbe640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.414+0000 7fbe84d9b700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbe64066f30 0x7fbe640693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe740093f0 tx=0x7fbe74017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:52.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.417+0000 7fbe7cff9700 1 -- 172.21.15.154:0/2255702335 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe780521f0 con 0x7fbe80159c60 2023-10-10T21:02:52.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.608+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe800c8e60 con 0x7fbe80159c60 2023-10-10T21:02:52.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.609+0000 7fbe7cff9700 1 -- 172.21.15.154:0/2255702335 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe7801a0a0 con 0x7fbe80159c60 2023-10-10T21:02:52.611 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:02:52.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbe64066f30 msgr2=0x7fbe640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbe64066f30 0x7fbe640693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe740093f0 tx=0x7fbe74017000 comp rx=0 tx=0).stop 2023-10-10T21:02:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159c60 msgr2=0x7fbe80151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159c60 0x7fbe80151ec0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800a380 tx=0x7fbe78007900 comp rx=0 tx=0).stop 2023-10-10T21:02:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 shutdown_connections 2023-10-10T21:02:52.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80159c60 0x7fbe80151ec0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbe64066f30 0x7fbe640693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe80069560 0x7fbe800c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 --2- 172.21.15.154:0/2255702335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe80159890 0x7fbe800c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 >> 172.21.15.154:0/2255702335 conn(0x7fbe80068e20 msgr2=0x7fbe80155190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:52.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 shutdown_connections 2023-10-10T21:02:52.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.611+0000 7fbe86fff700 1 -- 172.21.15.154:0/2255702335 wait complete. 2023-10-10T21:02:52.630 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:52.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.813+0000 7f5175bff700 1 Processor -- start 2023-10-10T21:02:52.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.814+0000 7f5175bff700 1 -- start start 2023-10-10T21:02:52.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.815+0000 7f5175bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51700cbf30 0x7f51700ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.815+0000 7f5175bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51700cc300 con 0x7f51700b1420 2023-10-10T21:02:52.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.815+0000 7f5175bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51700ad370 con 0x7f51700ccf90 2023-10-10T21:02:52.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.815+0000 7f5175bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5170156bf0 con 0x7f51700cbf30 2023-10-10T21:02:52.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.815+0000 7f516f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51700cbf30 0x7f51700ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.815+0000 7f516ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f51700b1420 0x7f51700c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51566/0 (socket says 172.21.15.154:51566) 2023-10-10T21:02:52.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.815+0000 7f516ffff700 1 -- 172.21.15.154:0/3500597282 learned_addr learned my addr 172.21.15.154:0/3500597282 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:52.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516e7fc700 1 -- 172.21.15.154:0/3500597282 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819550385 0 0) 0x7f51700cc300 con 0x7f51700b1420 2023-10-10T21:02:52.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516e7fc700 1 -- 172.21.15.154:0/3500597282 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5158003570 con 0x7f51700b1420 2023-10-10T21:02:52.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516e7fc700 1 -- 172.21.15.154:0/3500597282 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923900245 0 0) 0x7f51700ad370 con 0x7f51700ccf90 2023-10-10T21:02:52.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516e7fc700 1 -- 172.21.15.154:0/3500597282 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51700cc300 con 0x7f51700ccf90 2023-10-10T21:02:52.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516f7fe700 1 -- 172.21.15.154:0/3500597282 >> v1:172.21.15.179:6789/0 conn(0x7f51700ccf90 legacy=0x7f51700b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516f7fe700 1 -- 172.21.15.154:0/3500597282 >> v1:172.21.15.154:6789/0 conn(0x7f51700b1420 legacy=0x7f51700c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516f7fe700 1 -- 172.21.15.154:0/3500597282 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700ad650 con 0x7f51700cbf30 2023-10-10T21:02:52.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516f7fe700 1 --2- 172.21.15.154:0/3500597282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 0x7f51700ae410 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51600098e0 tx=0x7f51600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24012739ff68acff server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:52.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516e7fc700 1 -- 172.21.15.154:0/3500597282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160011630 con 0x7f51700cbf30 2023-10-10T21:02:52.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516e7fc700 1 -- 172.21.15.154:0/3500597282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5160011790 con 0x7f51700cbf30 2023-10-10T21:02:52.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.816+0000 7f516e7fc700 1 -- 172.21.15.154:0/3500597282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160011b30 con 0x7f51700cbf30 2023-10-10T21:02:52.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.817+0000 7f5175bff700 1 -- 172.21.15.154:0/3500597282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 msgr2=0x7f51700ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.817+0000 7f5175bff700 1 --2- 172.21.15.154:0/3500597282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 0x7f51700ae410 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51600098e0 tx=0x7f51600091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.817+0000 7f5175bff700 1 -- 172.21.15.154:0/3500597282 shutdown_connections 2023-10-10T21:02:52.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.817+0000 7f5175bff700 1 --2- 172.21.15.154:0/3500597282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 0x7f51700ae410 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.817+0000 7f5175bff700 1 -- 172.21.15.154:0/3500597282 >> 172.21.15.154:0/3500597282 conn(0x7f517006a320 msgr2=0x7f51700cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:52.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.817+0000 7f5175bff700 1 -- 172.21.15.154:0/3500597282 shutdown_connections 2023-10-10T21:02:52.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.817+0000 7f5175bff700 1 -- 172.21.15.154:0/3500597282 wait complete. 2023-10-10T21:02:52.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.818+0000 7f5175bff700 1 Processor -- start 2023-10-10T21:02:52.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.818+0000 7f5175bff700 1 -- start start 2023-10-10T21:02:52.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.819+0000 7f5175bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51700b1420 0x7f517016b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.819+0000 7f5175bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 0x7f517016d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.819+0000 7f5175bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51700ccf90 0x7f517015cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.819+0000 7f5175bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517016b480 con 0x7f51700cbf30 2023-10-10T21:02:52.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.819+0000 7f5175bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517016b1a0 con 0x7f51700ccf90 2023-10-10T21:02:52.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.819+0000 7f5175bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700c5810 con 0x7f51700b1420 2023-10-10T21:02:52.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 0x7f517016d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 0x7f517016d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55180/0 (socket says 172.21.15.154:55180) 2023-10-10T21:02:52.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516effd700 1 -- 172.21.15.154:0/157633304 learned_addr learned my addr 172.21.15.154:0/157633304 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:52.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516f7fe700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51700b1420 0x7f517016b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516ffff700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51700ccf90 0x7f517015cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516effd700 1 -- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51700b1420 msgr2=0x7f517016b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516effd700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51700b1420 0x7f517016b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516effd700 1 -- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51700ccf90 msgr2=0x7f517015cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:52.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516effd700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51700ccf90 0x7f517015cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:52.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516effd700 1 -- 172.21.15.154:0/157633304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5160009420 con 0x7f51700cbf30 2023-10-10T21:02:52.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516f7fe700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51700b1420 0x7f517016b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:52.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516ffff700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51700ccf90 0x7f517015cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:52.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.820+0000 7f516effd700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 0x7f517016d230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f516400c580 tx=0x7f5164007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:52.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.821+0000 7f51577fe700 1 -- 172.21.15.154:0/157633304 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164010510 con 0x7f51700cbf30 2023-10-10T21:02:52.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.821+0000 7f51577fe700 1 -- 172.21.15.154:0/157633304 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5164010670 con 0x7f51700cbf30 2023-10-10T21:02:52.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.821+0000 7f51577fe700 1 -- 172.21.15.154:0/157633304 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164010a30 con 0x7f51700cbf30 2023-10-10T21:02:52.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.821+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51700c5af0 con 0x7f51700cbf30 2023-10-10T21:02:52.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.821+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517016d770 con 0x7f51700cbf30 2023-10-10T21:02:52.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.822+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51700c6010 con 0x7f51700cbf30 2023-10-10T21:02:52.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.823+0000 7f51577fe700 1 -- 172.21.15.154:0/157633304 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f516401b400 con 0x7f51700cbf30 2023-10-10T21:02:52.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.824+0000 7f51577fe700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c066f30 0x7f515c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:52.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.824+0000 7f51577fe700 1 -- 172.21.15.154:0/157633304 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5164084300 con 0x7f51700cbf30 2023-10-10T21:02:52.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.824+0000 7f516f7fe700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c066f30 0x7f515c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:52.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.824+0000 7f516f7fe700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c066f30 0x7f515c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f51600093f0 tx=0x7f5160017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:52.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:52.828+0000 7f51577fe700 1 -- 172.21.15.154:0/157633304 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51700c6010 con 0x7f51700cbf30 2023-10-10T21:02:53.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.022+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51700c6010 con 0x7f51700cbf30 2023-10-10T21:02:53.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.023+0000 7f51577fe700 1 -- 172.21.15.154:0/157633304 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f51700c6010 con 0x7f51700cbf30 2023-10-10T21:02:53.025 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:53.025 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:53.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c066f30 msgr2=0x7f515c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c066f30 0x7f515c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f51600093f0 tx=0x7f5160017000 comp rx=0 tx=0).stop 2023-10-10T21:02:53.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 msgr2=0x7f517016d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 0x7f517016d230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f516400c580 tx=0x7f5164007e10 comp rx=0 tx=0).stop 2023-10-10T21:02:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 shutdown_connections 2023-10-10T21:02:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51700ccf90 0x7f517015cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f515c066f30 0x7f515c0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51700b1420 0x7f517016b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 --2- 172.21.15.154:0/157633304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51700cbf30 0x7f517016d230 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.025+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 >> 172.21.15.154:0/157633304 conn(0x7f517006a320 msgr2=0x7f51700ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:53.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.026+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 shutdown_connections 2023-10-10T21:02:53.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.026+0000 7f5175bff700 1 -- 172.21.15.154:0/157633304 wait complete. 2023-10-10T21:02:53.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:02:17.271178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:02:18.145561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:02:53.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:02:53.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.230+0000 7f49af39d700 1 Processor -- start 2023-10-10T21:02:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.230+0000 7f49af39d700 1 -- start start 2023-10-10T21:02:53.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.231+0000 7f49af39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49a81579c0 0x7f49a80c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49af39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49a806b300 0x7f49a8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49af39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a80c9310 con 0x7f49a806b7a0 2023-10-10T21:02:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49af39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a806bb70 con 0x7f49a806b300 2023-10-10T21:02:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49af39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a8157d90 con 0x7f49a81579c0 2023-10-10T21:02:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49adb9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49a806b300 0x7f49a8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49adb9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49a806b300 0x7f49a8068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55190/0 (socket says 172.21.15.154:55190) 2023-10-10T21:02:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49adb9a700 1 -- 172.21.15.154:0/2212976381 learned_addr learned my addr 172.21.15.154:0/2212976381 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49aeb9c700 1 --1- 172.21.15.154:0/2212976381 >> v1:172.21.15.154:6789/0 conn(0x7f49a806b7a0 0x7f49a80b00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51578/0 (socket says 172.21.15.154:51578) 2023-10-10T21:02:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49ae39b700 1 --2- 172.21.15.154:0/2212976381 >> v2:172.21.15.179:3300/0 conn(0x7f49a81579c0 0x7f49a80c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49adb9a700 1 -- 172.21.15.154:0/2212976381 >> v2:172.21.15.179:3300/0 conn(0x7f49a81579c0 msgr2=0x7f49a80c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49adb9a700 1 --2- 172.21.15.154:0/2212976381 >> v2:172.21.15.179:3300/0 conn(0x7f49a81579c0 0x7f49a80c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49adb9a700 1 -- 172.21.15.154:0/2212976381 >> v1:172.21.15.154:6789/0 conn(0x7f49a806b7a0 legacy=0x7f49a80b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.232+0000 7f49adb9a700 1 -- 172.21.15.154:0/2212976381 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80c8700 con 0x7f49a806b300 2023-10-10T21:02:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.233+0000 7f49adb9a700 1 --2- 172.21.15.154:0/2212976381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a806b300 0x7f49a8068390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f49a8064080 tx=0x7f4998009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771ee6a43ef69b7c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.233+0000 7f49ad399700 1 -- 172.21.15.154:0/2212976381 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998005c10 con 0x7f49a806b300 2023-10-10T21:02:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.233+0000 7f49ad399700 1 -- 172.21.15.154:0/2212976381 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998005d70 con 0x7f49a806b300 2023-10-10T21:02:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.233+0000 7f49ad399700 1 -- 172.21.15.154:0/2212976381 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800b880 con 0x7f49a806b300 2023-10-10T21:02:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.233+0000 7f49af39d700 1 -- 172.21.15.154:0/2212976381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a806b300 msgr2=0x7f49a8068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.233+0000 7f49af39d700 1 --2- 172.21.15.154:0/2212976381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a806b300 0x7f49a8068390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f49a8064080 tx=0x7f4998009220 comp rx=0 tx=0).stop 2023-10-10T21:02:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.234+0000 7f49af39d700 1 -- 172.21.15.154:0/2212976381 shutdown_connections 2023-10-10T21:02:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.234+0000 7f49af39d700 1 --2- 172.21.15.154:0/2212976381 >> v2:172.21.15.179:3300/0 conn(0x7f49a81579c0 0x7f49a80c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.234+0000 7f49af39d700 1 --2- 172.21.15.154:0/2212976381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a806b300 0x7f49a8068390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.234+0000 7f49af39d700 1 -- 172.21.15.154:0/2212976381 >> 172.21.15.154:0/2212976381 conn(0x7f49a80cddc0 msgr2=0x7f49a80c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.234+0000 7f49af39d700 1 -- 172.21.15.154:0/2212976381 shutdown_connections 2023-10-10T21:02:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.234+0000 7f49af39d700 1 -- 172.21.15.154:0/2212976381 wait complete. 2023-10-10T21:02:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.235+0000 7f49af39d700 1 Processor -- start 2023-10-10T21:02:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.235+0000 7f49af39d700 1 -- start start 2023-10-10T21:02:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.236+0000 7f49af39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a806b300 0x7f49a8157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.236+0000 7f49af39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a806b7a0 0x7f49a8159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.236+0000 7f49af39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a81579c0 0x7f49a8159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.236+0000 7f49af39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80c5d80 con 0x7f49a81579c0 2023-10-10T21:02:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.236+0000 7f49af39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80c5f90 con 0x7f49a806b300 2023-10-10T21:02:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.236+0000 7f49af39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80c6270 con 0x7f49a806b7a0 2023-10-10T21:02:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.236+0000 7f49aeb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a81579c0 0x7f49a8159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.236+0000 7f49aeb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a81579c0 0x7f49a8159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55200/0 (socket says 172.21.15.154:55200) 2023-10-10T21:02:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.236+0000 7f49aeb9c700 1 -- 172.21.15.154:0/2087872694 learned_addr learned my addr 172.21.15.154:0/2087872694 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49ae39b700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a806b300 0x7f49a8157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49adb9a700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a806b7a0 0x7f49a8159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49aeb9c700 1 -- 172.21.15.154:0/2087872694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a806b7a0 msgr2=0x7f49a8159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49aeb9c700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a806b7a0 0x7f49a8159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49aeb9c700 1 -- 172.21.15.154:0/2087872694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a806b300 msgr2=0x7f49a8157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49aeb9c700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a806b300 0x7f49a8157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49aeb9c700 1 -- 172.21.15.154:0/2087872694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998009480 con 0x7f49a81579c0 2023-10-10T21:02:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49adb9a700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a806b7a0 0x7f49a8159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49aeb9c700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a81579c0 0x7f49a8159fd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f49a000cd00 tx=0x7f49a0001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:53.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f499e7fc700 1 -- 172.21.15.154:0/2087872694 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a000ce60 con 0x7f49a81579c0 2023-10-10T21:02:53.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f499e7fc700 1 -- 172.21.15.154:0/2087872694 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0005df0 con 0x7f49a81579c0 2023-10-10T21:02:53.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a80c6550 con 0x7f49a81579c0 2023-10-10T21:02:53.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.237+0000 7f499e7fc700 1 -- 172.21.15.154:0/2087872694 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a000abb0 con 0x7f49a81579c0 2023-10-10T21:02:53.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.238+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a814a390 con 0x7f49a81579c0 2023-10-10T21:02:53.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.238+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a80c6740 con 0x7f49a81579c0 2023-10-10T21:02:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.239+0000 7f499e7fc700 1 -- 172.21.15.154:0/2087872694 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49a00070f0 con 0x7f49a81579c0 2023-10-10T21:02:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.240+0000 7f499e7fc700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f498c066f30 0x7f498c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.240+0000 7f499e7fc700 1 -- 172.21.15.154:0/2087872694 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49a0084670 con 0x7f49a81579c0 2023-10-10T21:02:53.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.240+0000 7f49ae39b700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f498c066f30 0x7f498c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.241+0000 7f49ae39b700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f498c066f30 0x7f498c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49a4006fd0 tx=0x7f49a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:53.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.244+0000 7f499e7fc700 1 -- 172.21.15.154:0/2087872694 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49a00518c0 con 0x7f49a81579c0 2023-10-10T21:02:53.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.433+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49a806b100 con 0x7f49a81579c0 2023-10-10T21:02:53.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.434+0000 7f499e7fc700 1 -- 172.21.15.154:0/2087872694 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49a0054ee0 con 0x7f49a81579c0 2023-10-10T21:02:53.436 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:02:53.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.436+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f498c066f30 msgr2=0x7f498c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.436+0000 7f49af39d700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f498c066f30 0x7f498c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49a4006fd0 tx=0x7f49a4008040 comp rx=0 tx=0).stop 2023-10-10T21:02:53.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a81579c0 msgr2=0x7f49a8159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a81579c0 0x7f49a8159fd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f49a000cd00 tx=0x7f49a0001b10 comp rx=0 tx=0).stop 2023-10-10T21:02:53.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 shutdown_connections 2023-10-10T21:02:53.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49a81579c0 0x7f49a8159fd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a806b300 0x7f49a8157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f498c066f30 0x7f498c0693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 --2- 172.21.15.154:0/2087872694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a806b7a0 0x7f49a8159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 >> 172.21.15.154:0/2087872694 conn(0x7f49a80cddc0 msgr2=0x7f49a80b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:53.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 shutdown_connections 2023-10-10T21:02:53.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.437+0000 7f49af39d700 1 -- 172.21.15.154:0/2087872694 wait complete. 2023-10-10T21:02:53.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:02:53.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.640+0000 7f477ab9d700 1 Processor -- start 2023-10-10T21:02:53.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.641+0000 7f477ab9d700 1 -- start start 2023-10-10T21:02:53.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477ab9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 0x7f47740c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477ab9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47740c9db0 0x7f477406a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477ab9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4774157130 0x7f477406a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477ab9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477406e150 con 0x7f47740c9db0 2023-10-10T21:02:53.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477ab9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47740c7800 con 0x7f4774157130 2023-10-10T21:02:53.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477ab9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47740c7ae0 con 0x7f4774153900 2023-10-10T21:02:53.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477939a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47740c9db0 0x7f477406a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477939a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47740c9db0 0x7f477406a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55208/0 (socket says 172.21.15.154:55208) 2023-10-10T21:02:53.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477939a700 1 -- 172.21.15.154:0/2343296351 learned_addr learned my addr 172.21.15.154:0/2343296351 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:53.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f477a39c700 1 --2- 172.21.15.154:0/2343296351 >> v2:172.21.15.179:3300/0 conn(0x7f4774157130 0x7f477406a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.642+0000 7f4779b9b700 1 --2- 172.21.15.154:0/2343296351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 0x7f47740c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f477939a700 1 -- 172.21.15.154:0/2343296351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 msgr2=0x7f47740c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:53.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f477939a700 1 --2- 172.21.15.154:0/2343296351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 0x7f47740c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f477939a700 1 -- 172.21.15.154:0/2343296351 >> v2:172.21.15.179:3300/0 conn(0x7f4774157130 msgr2=0x7f477406a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:53.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f477939a700 1 --2- 172.21.15.154:0/2343296351 >> v2:172.21.15.179:3300/0 conn(0x7f4774157130 0x7f477406a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f477939a700 1 -- 172.21.15.154:0/2343296351 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47740c7dc0 con 0x7f47740c9db0 2023-10-10T21:02:53.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f477a39c700 1 --2- 172.21.15.154:0/2343296351 >> v2:172.21.15.179:3300/0 conn(0x7f4774157130 0x7f477406a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:53.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f477939a700 1 --2- 172.21.15.154:0/2343296351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 0x7f477406a000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f477406d1e0 tx=0x7f4764009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc95be9fc3e00e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:53.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f4778b99700 1 -- 172.21.15.154:0/2343296351 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476400d850 con 0x7f47740c9db0 2023-10-10T21:02:53.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f4778b99700 1 -- 172.21.15.154:0/2343296351 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476400d9b0 con 0x7f47740c9db0 2023-10-10T21:02:53.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.643+0000 7f4778b99700 1 -- 172.21.15.154:0/2343296351 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476400dd70 con 0x7f47740c9db0 2023-10-10T21:02:53.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.644+0000 7f477ab9d700 1 -- 172.21.15.154:0/2343296351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 msgr2=0x7f477406a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.644+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2343296351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 0x7f477406a000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f477406d1e0 tx=0x7f4764009250 comp rx=0 tx=0).stop 2023-10-10T21:02:53.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.644+0000 7f477ab9d700 1 -- 172.21.15.154:0/2343296351 shutdown_connections 2023-10-10T21:02:53.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.644+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2343296351 >> v2:172.21.15.179:3300/0 conn(0x7f4774157130 0x7f477406a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.644+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2343296351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 0x7f47740c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.644+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2343296351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 0x7f477406a000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.644+0000 7f477ab9d700 1 -- 172.21.15.154:0/2343296351 >> 172.21.15.154:0/2343296351 conn(0x7f47740cc1e0 msgr2=0x7f47740cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:53.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.644+0000 7f477ab9d700 1 -- 172.21.15.154:0/2343296351 shutdown_connections 2023-10-10T21:02:53.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.644+0000 7f477ab9d700 1 -- 172.21.15.154:0/2343296351 wait complete. 2023-10-10T21:02:53.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.645+0000 7f477ab9d700 1 Processor -- start 2023-10-10T21:02:53.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.646+0000 7f477ab9d700 1 -- start start 2023-10-10T21:02:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.646+0000 7f477ab9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 0x7f4774142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f477ab9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 0x7f4774165750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f477ab9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4774157130 0x7f47740ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f477ab9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47740abef0 con 0x7f47740c9db0 2023-10-10T21:02:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f477ab9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774166070 con 0x7f4774157130 2023-10-10T21:02:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f477ab9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4774166350 con 0x7f4774153900 2023-10-10T21:02:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f4779b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 0x7f4774142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f4779b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 0x7f4774142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55212/0 (socket says 172.21.15.154:55212) 2023-10-10T21:02:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f4779b9b700 1 -- 172.21.15.154:0/2161578491 learned_addr learned my addr 172.21.15.154:0/2161578491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f477a39c700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4774157130 0x7f47740ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f477939a700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 0x7f4774165750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f4779b9b700 1 -- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 msgr2=0x7f4774165750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f4779b9b700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 0x7f4774165750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f4779b9b700 1 -- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4774157130 msgr2=0x7f47740ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f4779b9b700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4774157130 0x7f47740ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f4779b9b700 1 -- 172.21.15.154:0/2161578491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c00aa30 con 0x7f47740c9db0 2023-10-10T21:02:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f477939a700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 0x7f4774165750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f477a39c700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4774157130 0x7f47740ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.647+0000 7f4779b9b700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 0x7f4774142e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f477000e950 tx=0x7f47700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.648+0000 7f4769ffb700 1 -- 172.21.15.154:0/2161578491 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000c850 con 0x7f47740c9db0 2023-10-10T21:02:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.648+0000 7f4769ffb700 1 -- 172.21.15.154:0/2161578491 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000c9b0 con 0x7f47740c9db0 2023-10-10T21:02:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.648+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47640094f0 con 0x7f47740c9db0 2023-10-10T21:02:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.648+0000 7f4769ffb700 1 -- 172.21.15.154:0/2161578491 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000cdb0 con 0x7f47740c9db0 2023-10-10T21:02:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.648+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47740abb80 con 0x7f47740c9db0 2023-10-10T21:02:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.649+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477406c450 con 0x7f47740c9db0 2023-10-10T21:02:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.650+0000 7f4769ffb700 1 -- 172.21.15.154:0/2161578491 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4770013680 con 0x7f47740c9db0 2023-10-10T21:02:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.651+0000 7f4769ffb700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4758066f30 0x7f47580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.651+0000 7f4769ffb700 1 -- 172.21.15.154:0/2161578491 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47700847c0 con 0x7f47740c9db0 2023-10-10T21:02:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.651+0000 7f477939a700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4758066f30 0x7f47580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.651+0000 7f477939a700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4758066f30 0x7f47580693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f477406d1e0 tx=0x7f4764019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.655+0000 7f4769ffb700 1 -- 172.21.15.154:0/2161578491 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4770051a30 con 0x7f47740c9db0 2023-10-10T21:02:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.845+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47740ac1d0 con 0x7f47740c9db0 2023-10-10T21:02:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.845+0000 7f4769ffb700 1 -- 172.21.15.154:0/2161578491 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4770055050 con 0x7f47740c9db0 2023-10-10T21:02:53.847 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:02:53.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4758066f30 msgr2=0x7f47580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4758066f30 0x7f47580693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f477406d1e0 tx=0x7f4764019000 comp rx=0 tx=0).stop 2023-10-10T21:02:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 msgr2=0x7f4774142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 0x7f4774142e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f477000e950 tx=0x7f47700091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 shutdown_connections 2023-10-10T21:02:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4774157130 0x7f47740ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47740c9db0 0x7f4774142e10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4758066f30 0x7f47580693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 --2- 172.21.15.154:0/2161578491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4774153900 0x7f4774165750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 >> 172.21.15.154:0/2161578491 conn(0x7f47740cc1e0 msgr2=0x7f47740c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 shutdown_connections 2023-10-10T21:02:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:53.848+0000 7f477ab9d700 1 -- 172.21.15.154:0/2161578491 wait complete. 2023-10-10T21:02:53.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:02:54.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.052+0000 7f56a53ff700 1 Processor -- start 2023-10-10T21:02:54.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.052+0000 7f56a53ff700 1 -- start start 2023-10-10T21:02:54.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.053+0000 7f56a53ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f56a0155eb0 0x7f56a006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.053+0000 7f56a53ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56a00c70b0 0x7f56a0069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.053+0000 7f56a53ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a006eb90 con 0x7f56a0069cb0 2023-10-10T21:02:54.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.053+0000 7f56a53ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a006a130 con 0x7f56a00c70b0 2023-10-10T21:02:54.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.053+0000 7f56a53ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a00cd350 con 0x7f56a0155eb0 2023-10-10T21:02:54.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569e7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56a00c70b0 0x7f56a0069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f56a0069cb0 0x7f56a00ccc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51592/0 (socket says 172.21.15.154:51592) 2023-10-10T21:02:54.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569f7fe700 1 -- 172.21.15.154:0/1825791006 learned_addr learned my addr 172.21.15.154:0/1825791006 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569effd700 1 --2- 172.21.15.154:0/1825791006 >> v2:172.21.15.179:3300/0 conn(0x7f56a0155eb0 0x7f56a006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569e7fc700 1 -- 172.21.15.154:0/1825791006 >> v2:172.21.15.179:3300/0 conn(0x7f56a0155eb0 msgr2=0x7f56a006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569e7fc700 1 --2- 172.21.15.154:0/1825791006 >> v2:172.21.15.179:3300/0 conn(0x7f56a0155eb0 0x7f56a006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569e7fc700 1 -- 172.21.15.154:0/1825791006 >> v1:172.21.15.154:6789/0 conn(0x7f56a0069cb0 legacy=0x7f56a00ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569e7fc700 1 -- 172.21.15.154:0/1825791006 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a006ee70 con 0x7f56a00c70b0 2023-10-10T21:02:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569dffb700 1 -- 172.21.15.154:0/1825791006 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705628986 0 0) 0x7f56a006eb90 con 0x7f56a0069cb0 2023-10-10T21:02:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.054+0000 7f569e7fc700 1 --2- 172.21.15.154:0/1825791006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 0x7f56a0069770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56a0065160 tx=0x7f56940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44777cb2ef88970 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f569dffb700 1 -- 172.21.15.154:0/1825791006 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400b6b0 con 0x7f56a00c70b0 2023-10-10T21:02:54.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f569dffb700 1 -- 172.21.15.154:0/1825791006 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400b810 con 0x7f56a00c70b0 2023-10-10T21:02:54.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f569dffb700 1 -- 172.21.15.154:0/1825791006 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400bbb0 con 0x7f56a00c70b0 2023-10-10T21:02:54.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f56a53ff700 1 -- 172.21.15.154:0/1825791006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 msgr2=0x7f56a0069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f56a53ff700 1 --2- 172.21.15.154:0/1825791006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 0x7f56a0069770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56a0065160 tx=0x7f56940091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f56a53ff700 1 -- 172.21.15.154:0/1825791006 shutdown_connections 2023-10-10T21:02:54.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f56a53ff700 1 --2- 172.21.15.154:0/1825791006 >> v2:172.21.15.179:3300/0 conn(0x7f56a0155eb0 0x7f56a006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f56a53ff700 1 --2- 172.21.15.154:0/1825791006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 0x7f56a0069770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f56a53ff700 1 -- 172.21.15.154:0/1825791006 >> 172.21.15.154:0/1825791006 conn(0x7f56a0068e10 msgr2=0x7f56a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:54.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f56a53ff700 1 -- 172.21.15.154:0/1825791006 shutdown_connections 2023-10-10T21:02:54.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.055+0000 7f56a53ff700 1 -- 172.21.15.154:0/1825791006 wait complete. 2023-10-10T21:02:54.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.057+0000 7f56a53ff700 1 Processor -- start 2023-10-10T21:02:54.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.057+0000 7f56a53ff700 1 -- start start 2023-10-10T21:02:54.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f56a53ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56a0069cb0 0x7f56a00a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f56a53ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 0x7f56a00a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f56a53ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56a0155eb0 0x7f56a00c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f56a53ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00a5a00 con 0x7f56a00c70b0 2023-10-10T21:02:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f56a53ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0168e30 con 0x7f56a0069cb0 2023-10-10T21:02:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f56a53ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0168220 con 0x7f56a0155eb0 2023-10-10T21:02:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f569e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 0x7f56a00a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f569e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 0x7f56a00a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55242/0 (socket says 172.21.15.154:55242) 2023-10-10T21:02:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f569e7fc700 1 -- 172.21.15.154:0/1751899798 learned_addr learned my addr 172.21.15.154:0/1751899798 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f569effd700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56a0069cb0 0x7f56a00a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.058+0000 7f569f7fe700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56a0155eb0 0x7f56a00c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f569e7fc700 1 -- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56a0155eb0 msgr2=0x7f56a00c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f569e7fc700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56a0155eb0 0x7f56a00c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f569e7fc700 1 -- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56a0069cb0 msgr2=0x7f56a00a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f569e7fc700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56a0069cb0 0x7f56a00a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f569e7fc700 1 -- 172.21.15.154:0/1751899798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009420 con 0x7f56a00c70b0 2023-10-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f569f7fe700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56a0155eb0 0x7f56a00c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f569effd700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56a0069cb0 0x7f56a00a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f569e7fc700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 0x7f56a00a6dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f56a006fe40 tx=0x7f5694017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f5686ffd700 1 -- 172.21.15.154:0/1751899798 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011420 con 0x7f56a00c70b0 2023-10-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f5686ffd700 1 -- 172.21.15.154:0/1751899798 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694011580 con 0x7f56a00c70b0 2023-10-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a0168500 con 0x7f56a00c70b0 2023-10-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f5686ffd700 1 -- 172.21.15.154:0/1751899798 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011940 con 0x7f56a00c70b0 2023-10-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.059+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a0168ac0 con 0x7f56a00c70b0 2023-10-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.060+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a004c3c0 con 0x7f56a00c70b0 2023-10-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.061+0000 7f5686ffd700 1 -- 172.21.15.154:0/1751899798 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5694011d30 con 0x7f56a00c70b0 2023-10-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.062+0000 7f5686ffd700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f568c066f30 0x7f568c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.062+0000 7f5686ffd700 1 -- 172.21.15.154:0/1751899798 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5694085a80 con 0x7f56a00c70b0 2023-10-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.062+0000 7f569effd700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f568c066f30 0x7f568c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.063+0000 7f569effd700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f568c066f30 0x7f568c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5690006fd0 tx=0x7f5690008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.066+0000 7f5686ffd700 1 -- 172.21.15.154:0/1751899798 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5694052c50 con 0x7f56a00c70b0 2023-10-10T21:02:54.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.259+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56a006f150 con 0x7f56a00c70b0 2023-10-10T21:02:54.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.260+0000 7f5686ffd700 1 -- 172.21.15.154:0/1751899798 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56940150a0 con 0x7f56a00c70b0 2023-10-10T21:02:54.261 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:02:54.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f568c066f30 msgr2=0x7f568c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f568c066f30 0x7f568c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5690006fd0 tx=0x7f5690008040 comp rx=0 tx=0).stop 2023-10-10T21:02:54.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 msgr2=0x7f56a00a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 0x7f56a00a6dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f56a006fe40 tx=0x7f5694017000 comp rx=0 tx=0).stop 2023-10-10T21:02:54.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 shutdown_connections 2023-10-10T21:02:54.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f568c066f30 0x7f568c0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56a0155eb0 0x7f56a00c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56a0069cb0 0x7f56a00a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 --2- 172.21.15.154:0/1751899798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a00c70b0 0x7f56a00a6dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 >> 172.21.15.154:0/1751899798 conn(0x7f56a0068e10 msgr2=0x7f56a0154920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:54.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.262+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 shutdown_connections 2023-10-10T21:02:54.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.263+0000 7f56a53ff700 1 -- 172.21.15.154:0/1751899798 wait complete. 2023-10-10T21:02:54.292 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-10-10T21:02:54.293 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T21:02:54.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-10T21:02:54.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.475+0000 7f5f83fff700 1 Processor -- start 2023-10-10T21:02:54.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.475+0000 7f5f83fff700 1 -- start start 2023-10-10T21:02:54.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f83fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f7c0b1c20 0x7f5f7c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f83fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c157c60 con 0x7f5f7c157820 2023-10-10T21:02:54.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f83fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0cb300 con 0x7f5f7c0b1850 2023-10-10T21:02:54.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f83fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c06fc30 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f8159a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f7c0b1c20 0x7f5f7c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f8159a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f7c0b1c20 0x7f5f7c1572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55246/0 (socket says 172.21.15.154:55246) 2023-10-10T21:02:54.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f8159a700 1 -- 172.21.15.154:0/3475269424 learned_addr learned my addr 172.21.15.154:0/3475269424 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:54.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f8259c700 1 --1- 172.21.15.154:0/3475269424 >> v1:172.21.15.154:6789/0 conn(0x7f5f7c157820 0x7f5f7c0abf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51606/0 (socket says 172.21.15.154:51606) 2023-10-10T21:02:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f8159a700 1 -- 172.21.15.154:0/3475269424 >> v1:172.21.15.179:6789/0 conn(0x7f5f7c0b1850 legacy=0x7f5f7c0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f8159a700 1 -- 172.21.15.154:0/3475269424 >> v1:172.21.15.154:6789/0 conn(0x7f5f7c157820 legacy=0x7f5f7c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f8159a700 1 -- 172.21.15.154:0/3475269424 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0cb5e0 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.477+0000 7f5f80d99700 1 -- 172.21.15.154:0/3475269424 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205771145 0 0) 0x7f5f7c157c60 con 0x7f5f7c157820 2023-10-10T21:02:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.478+0000 7f5f8159a700 1 --2- 172.21.15.154:0/3475269424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 0x7f5f7c1572e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0099b0 tx=0x7f5f6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4985b5632c7969a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.478+0000 7f5f80d99700 1 -- 172.21.15.154:0/3475269424 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00b860 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.478+0000 7f5f80d99700 1 -- 172.21.15.154:0/3475269424 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c00b9c0 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.478+0000 7f5f80d99700 1 -- 172.21.15.154:0/3475269424 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00bd60 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.478+0000 7f5f83fff700 1 -- 172.21.15.154:0/3475269424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 msgr2=0x7f5f7c1572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.478+0000 7f5f83fff700 1 --2- 172.21.15.154:0/3475269424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 0x7f5f7c1572e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0099b0 tx=0x7f5f6c009250 comp rx=0 tx=0).stop 2023-10-10T21:02:54.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.478+0000 7f5f83fff700 1 -- 172.21.15.154:0/3475269424 shutdown_connections 2023-10-10T21:02:54.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.478+0000 7f5f83fff700 1 --2- 172.21.15.154:0/3475269424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 0x7f5f7c1572e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.478+0000 7f5f83fff700 1 -- 172.21.15.154:0/3475269424 >> 172.21.15.154:0/3475269424 conn(0x7f5f7c06a320 msgr2=0x7f5f7c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:54.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.479+0000 7f5f83fff700 1 -- 172.21.15.154:0/3475269424 shutdown_connections 2023-10-10T21:02:54.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.479+0000 7f5f83fff700 1 -- 172.21.15.154:0/3475269424 wait complete. 2023-10-10T21:02:54.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.480+0000 7f5f83fff700 1 Processor -- start 2023-10-10T21:02:54.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.480+0000 7f5f83fff700 1 -- start start 2023-10-10T21:02:54.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.481+0000 7f5f83fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f7c0b1850 0x7f5f7c156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.481+0000 7f5f83fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 0x7f5f7c13de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.481+0000 7f5f83fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f7c157820 0x7f5f7c151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.481+0000 7f5f83fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0cc260 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.481+0000 7f5f83fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c14dc40 con 0x7f5f7c0b1850 2023-10-10T21:02:54.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.481+0000 7f5f83fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1480a0 con 0x7f5f7c157820 2023-10-10T21:02:54.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.481+0000 7f5f8159a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 0x7f5f7c13de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.481+0000 7f5f8159a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 0x7f5f7c13de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55262/0 (socket says 172.21.15.154:55262) 2023-10-10T21:02:54.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.481+0000 7f5f8159a700 1 -- 172.21.15.154:0/3894775668 learned_addr learned my addr 172.21.15.154:0/3894775668 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:54.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f8259c700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f7c157820 0x7f5f7c151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f8159a700 1 -- 172.21.15.154:0/3894775668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f7c157820 msgr2=0x7f5f7c151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f8159a700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f7c157820 0x7f5f7c151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f8159a700 1 -- 172.21.15.154:0/3894775668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f7c0b1850 msgr2=0x7f5f7c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f81d9b700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f7c0b1850 0x7f5f7c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f8159a700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f7c0b1850 0x7f5f7c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f8159a700 1 -- 172.21.15.154:0/3894775668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0094f0 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f81d9b700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f7c0b1850 0x7f5f7c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:54.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f8159a700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 0x7f5f7c13de70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c064290 tx=0x7f5f6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:54.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f71ffb700 1 -- 172.21.15.154:0/3894775668 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c01f070 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f71ffb700 1 -- 172.21.15.154:0/3894775668 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c011c80 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f71ffb700 1 -- 172.21.15.154:0/3894775668 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c025420 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c16d2f0 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.482+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c16d8b0 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.483+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c14ddb0 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.484+0000 7f5f71ffb700 1 -- 172.21.15.154:0/3894775668 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f6c023070 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.485+0000 7f5f71ffb700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5f60066f30 0x7f5f600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:54.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.485+0000 7f5f71ffb700 1 -- 172.21.15.154:0/3894775668 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f6c085c50 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.485+0000 7f5f81d9b700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5f60066f30 0x7f5f600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.486+0000 7f5f81d9b700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5f60066f30 0x7f5f600693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c148790 tx=0x7f5f78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.489+0000 7f5f71ffb700 1 -- 172.21.15.154:0/3894775668 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f7c14ddb0 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.756+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f5f7c14ddb0 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.945+0000 7f5f71ffb700 1 -- 172.21.15.154:0/3894775668 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5f7c14ddb0 con 0x7f5f7c0b1c20 2023-10-10T21:02:54.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.947+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5f60066f30 msgr2=0x7f5f600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.947+0000 7f5f83fff700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5f60066f30 0x7f5f600693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c148790 tx=0x7f5f78009040 comp rx=0 tx=0).stop 2023-10-10T21:02:54.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.947+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 msgr2=0x7f5f7c13de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:54.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.947+0000 7f5f83fff700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 0x7f5f7c13de70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c064290 tx=0x7f5f6c017000 comp rx=0 tx=0).stop 2023-10-10T21:02:54.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.948+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 shutdown_connections 2023-10-10T21:02:54.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.948+0000 7f5f83fff700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5f60066f30 0x7f5f600693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.948+0000 7f5f83fff700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f7c157820 0x7f5f7c151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.948+0000 7f5f83fff700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f7c0b1850 0x7f5f7c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.948+0000 7f5f83fff700 1 --2- 172.21.15.154:0/3894775668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7c0b1c20 0x7f5f7c13de70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:54.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.948+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 >> 172.21.15.154:0/3894775668 conn(0x7f5f7c06a320 msgr2=0x7f5f7c152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:54.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.948+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 shutdown_connections 2023-10-10T21:02:54.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:54.948+0000 7f5f83fff700 1 -- 172.21.15.154:0/3894775668 wait complete. 2023-10-10T21:02:54.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T21:02:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.149+0000 7f21da3ff700 1 Processor -- start 2023-10-10T21:02:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.149+0000 7f21da3ff700 1 -- start start 2023-10-10T21:02:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.150+0000 7f21da3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 0x7f21d415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.150+0000 7f21da3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f21d4159c60 0x7f21d415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.150+0000 7f21da3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d415a160 con 0x7f21d415db10 2023-10-10T21:02:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.150+0000 7f21da3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d40d13a0 con 0x7f21d4159c60 2023-10-10T21:02:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.150+0000 7f21da3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d415e140 con 0x7f21d4159890 2023-10-10T21:02:55.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.151+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 0x7f21d415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:55.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.151+0000 7f21d37fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f21d4159c60 0x7f21d415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:55.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.151+0000 7f21d899c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f21d415db10 0x7f21d4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:35714/0 (socket says 172.21.15.154:35714) 2023-10-10T21:02:55.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.151+0000 7f21d899c700 1 -- 172.21.15.154:0/931011422 learned_addr learned my addr 172.21.15.154:0/931011422 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:55.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.151+0000 7f21d37fe700 1 -- 172.21.15.154:0/931011422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 msgr2=0x7f21d415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:55.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.151+0000 7f21d37fe700 1 --2- 172.21.15.154:0/931011422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 0x7f21d415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.151+0000 7f21d37fe700 1 -- 172.21.15.154:0/931011422 >> v1:172.21.15.179:6789/0 conn(0x7f21d415db10 legacy=0x7f21d4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:55.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.151+0000 7f21d37fe700 1 -- 172.21.15.154:0/931011422 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d415a3d0 con 0x7f21d4159c60 2023-10-10T21:02:55.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.151+0000 7f21d2ffd700 1 -- 172.21.15.154:0/931011422 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008769119 0 0) 0x7f21d415a160 con 0x7f21d415db10 2023-10-10T21:02:55.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.152+0000 7f21d37fe700 1 --2- 172.21.15.154:0/931011422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d4159c60 0x7f21d415d5d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f21c80098e0 tx=0x7f21c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd5066a75dc938e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:55.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.152+0000 7f21d2ffd700 1 -- 172.21.15.154:0/931011422 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800b640 con 0x7f21d4159c60 2023-10-10T21:02:55.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.152+0000 7f21d2ffd700 1 -- 172.21.15.154:0/931011422 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c800b7a0 con 0x7f21d4159c60 2023-10-10T21:02:55.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.152+0000 7f21d2ffd700 1 -- 172.21.15.154:0/931011422 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800bb40 con 0x7f21d4159c60 2023-10-10T21:02:55.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.152+0000 7f21da3ff700 1 -- 172.21.15.154:0/931011422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d4159c60 msgr2=0x7f21d415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:55.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.152+0000 7f21da3ff700 1 --2- 172.21.15.154:0/931011422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d4159c60 0x7f21d415d5d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f21c80098e0 tx=0x7f21c80091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.153+0000 7f21da3ff700 1 -- 172.21.15.154:0/931011422 shutdown_connections 2023-10-10T21:02:55.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.153+0000 7f21da3ff700 1 --2- 172.21.15.154:0/931011422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 0x7f21d415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.153+0000 7f21da3ff700 1 --2- 172.21.15.154:0/931011422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d4159c60 0x7f21d415d5d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.153+0000 7f21da3ff700 1 -- 172.21.15.154:0/931011422 >> 172.21.15.154:0/931011422 conn(0x7f21d4068e20 msgr2=0x7f21d40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.153+0000 7f21da3ff700 1 -- 172.21.15.154:0/931011422 shutdown_connections 2023-10-10T21:02:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.153+0000 7f21da3ff700 1 -- 172.21.15.154:0/931011422 wait complete. 2023-10-10T21:02:55.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.154+0000 7f21da3ff700 1 Processor -- start 2023-10-10T21:02:55.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.154+0000 7f21da3ff700 1 -- start start 2023-10-10T21:02:55.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21da3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 0x7f21d40b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:55.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21da3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4159c60 0x7f21d416d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:55.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21da3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415db10 0x7f21d4150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:55.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21da3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d416e5e0 con 0x7f21d4159c60 2023-10-10T21:02:55.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21da3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d415b600 con 0x7f21d415db10 2023-10-10T21:02:55.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21da3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40b2850 con 0x7f21d4159890 2023-10-10T21:02:55.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21d37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4159c60 0x7f21d416d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:55.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21d37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4159c60 0x7f21d416d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55272/0 (socket says 172.21.15.154:55272) 2023-10-10T21:02:55.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21d37fe700 1 -- 172.21.15.154:0/4147892219 learned_addr learned my addr 172.21.15.154:0/4147892219 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:55.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21d899c700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415db10 0x7f21d4150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:55.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.155+0000 7f21d3fff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 0x7f21d40b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:55.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21d37fe700 1 -- 172.21.15.154:0/4147892219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 msgr2=0x7f21d40b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:55.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21d37fe700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 0x7f21d40b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21d37fe700 1 -- 172.21.15.154:0/4147892219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415db10 msgr2=0x7f21d4150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:55.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21d37fe700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415db10 0x7f21d4150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21d37fe700 1 -- 172.21.15.154:0/4147892219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8009420 con 0x7f21d4159c60 2023-10-10T21:02:55.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21d37fe700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4159c60 0x7f21d416d930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f21c8013000 tx=0x7f21c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:55.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21bbfff700 1 -- 172.21.15.154:0/4147892219 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800bb20 con 0x7f21d4159c60 2023-10-10T21:02:55.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21bbfff700 1 -- 172.21.15.154:0/4147892219 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8000c90 con 0x7f21d4159c60 2023-10-10T21:02:55.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21bbfff700 1 -- 172.21.15.154:0/4147892219 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8011630 con 0x7f21d4159c60 2023-10-10T21:02:55.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d40b1fb0 con 0x7f21d4159c60 2023-10-10T21:02:55.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.156+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d40b2570 con 0x7f21d4159c60 2023-10-10T21:02:55.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.157+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d415b790 con 0x7f21d4159c60 2023-10-10T21:02:55.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.158+0000 7f21bbfff700 1 -- 172.21.15.154:0/4147892219 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21c80119a0 con 0x7f21d4159c60 2023-10-10T21:02:55.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.159+0000 7f21bbfff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f21c0066f30 0x7f21c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:55.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.159+0000 7f21bbfff700 1 -- 172.21.15.154:0/4147892219 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21c8085870 con 0x7f21d4159c60 2023-10-10T21:02:55.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.159+0000 7f21d3fff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f21c0066f30 0x7f21c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:55.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.160+0000 7f21d3fff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f21c0066f30 0x7f21c00693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009db0 tx=0x7f21c40091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:55.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.164+0000 7f21bbfff700 1 -- 172.21.15.154:0/4147892219 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21c8052a40 con 0x7f21d4159c60 2023-10-10T21:02:55.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.351+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f21d404c3c0 con 0x7f21d4159c60 2023-10-10T21:02:55.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.355+0000 7f21bbfff700 1 -- 172.21.15.154:0/4147892219 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f21c8056060 con 0x7f21d4159c60 2023-10-10T21:02:55.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f21c0066f30 msgr2=0x7f21c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:55.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f21c0066f30 0x7f21c00693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009db0 tx=0x7f21c40091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4159c60 msgr2=0x7f21d416d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:55.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4159c60 0x7f21d416d930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f21c8013000 tx=0x7f21c8017000 comp rx=0 tx=0).stop 2023-10-10T21:02:55.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 shutdown_connections 2023-10-10T21:02:55.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415db10 0x7f21d4150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f21c0066f30 0x7f21c00693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4159890 0x7f21d40b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 --2- 172.21.15.154:0/4147892219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4159c60 0x7f21d416d930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:55.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 >> 172.21.15.154:0/4147892219 conn(0x7f21d4068e20 msgr2=0x7f21d4152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:55.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 shutdown_connections 2023-10-10T21:02:55.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:55.358+0000 7f21da3ff700 1 -- 172.21.15.154:0/4147892219 wait complete. 2023-10-10T21:02:55.376 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:02:55.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:02:55.457 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:02:55.548 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:02:55.549 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T21:02:55.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:02:55.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-10T21:02:55.667 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:02:55.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:55.668 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T21:02:55.708 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-10T21:02:55.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:02:55.709 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-10T21:02:55.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T21:02:55.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:55.801 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-10T21:02:55.849 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-10T21:02:55.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:02:55.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-10T21:02:55.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:02:55.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:55.929 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-10T21:02:55.968 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-10T21:02:55.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:02:55.969 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-10T21:02:56.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T21:02:56.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:02:56.050 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-10T21:02:56.087 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T21:02:56.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:02:56.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.269+0000 7f883bfff700 1 Processor -- start 2023-10-10T21:02:56.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.269+0000 7f883bfff700 1 -- start start 2023-10-10T21:02:56.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.270+0000 7f883bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f88340cbf30 0x7f88340ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.270+0000 7f883bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340b1420 0x7f88340c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340cc300 con 0x7f88340ccf90 2023-10-10T21:02:56.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8834156bf0 con 0x7f88340cbf30 2023-10-10T21:02:56.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88340ae950 con 0x7f88340b1420 2023-10-10T21:02:56.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340b1420 0x7f88340c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f8839d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f88340cbf30 0x7f88340ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340b1420 0x7f88340c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:52090/0 (socket says 172.21.15.154:52090) 2023-10-10T21:02:56.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883959a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f88340ccf90 0x7f88340b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:52128/0 (socket says 172.21.15.154:52128) 2023-10-10T21:02:56.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883a59c700 1 -- 172.21.15.154:0/2731020884 learned_addr learned my addr 172.21.15.154:0/2731020884 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:56.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f8839d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f88340cbf30 0x7f88340ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:60190/0 (socket says 172.21.15.154:60190) 2023-10-10T21:02:56.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883a59c700 1 -- 172.21.15.154:0/2731020884 >> v2:172.21.15.179:3300/0 conn(0x7f88340cbf30 msgr2=0x7f88340ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:56.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883a59c700 1 --2- 172.21.15.154:0/2731020884 >> v2:172.21.15.179:3300/0 conn(0x7f88340cbf30 0x7f88340ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883a59c700 1 -- 172.21.15.154:0/2731020884 >> v1:172.21.15.179:6789/0 conn(0x7f88340ccf90 legacy=0x7f88340b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f883a59c700 1 -- 172.21.15.154:0/2731020884 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340ad370 con 0x7f88340b1420 2023-10-10T21:02:56.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.271+0000 7f8839d9b700 1 --2- 172.21.15.154:0/2731020884 >> v2:172.21.15.179:3300/0 conn(0x7f88340cbf30 0x7f88340ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.272+0000 7f883a59c700 1 --2- 172.21.15.154:0/2731020884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340b1420 0x7f88340c9740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f882c009f20 tx=0x7f882c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6759018beb86c8b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.272+0000 7f8838d99700 1 -- 172.21.15.154:0/2731020884 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c00e070 con 0x7f88340b1420 2023-10-10T21:02:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.272+0000 7f8838d99700 1 -- 172.21.15.154:0/2731020884 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c00b9d0 con 0x7f88340b1420 2023-10-10T21:02:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.272+0000 7f8838d99700 1 -- 172.21.15.154:0/2731020884 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0092e0 con 0x7f88340b1420 2023-10-10T21:02:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.272+0000 7f883bfff700 1 -- 172.21.15.154:0/2731020884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340b1420 msgr2=0x7f88340c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.272+0000 7f883bfff700 1 --2- 172.21.15.154:0/2731020884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340b1420 0x7f88340c9740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f882c009f20 tx=0x7f882c009840 comp rx=0 tx=0).stop 2023-10-10T21:02:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.272+0000 7f883bfff700 1 -- 172.21.15.154:0/2731020884 shutdown_connections 2023-10-10T21:02:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.273+0000 7f883bfff700 1 --2- 172.21.15.154:0/2731020884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340b1420 0x7f88340c9740 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.273+0000 7f883bfff700 1 --2- 172.21.15.154:0/2731020884 >> v2:172.21.15.179:3300/0 conn(0x7f88340cbf30 0x7f88340ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.273+0000 7f883bfff700 1 -- 172.21.15.154:0/2731020884 >> 172.21.15.154:0/2731020884 conn(0x7f883406a320 msgr2=0x7f88340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.273+0000 7f883bfff700 1 -- 172.21.15.154:0/2731020884 shutdown_connections 2023-10-10T21:02:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.273+0000 7f883bfff700 1 -- 172.21.15.154:0/2731020884 wait complete. 2023-10-10T21:02:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.274+0000 7f883bfff700 1 Processor -- start 2023-10-10T21:02:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.274+0000 7f883bfff700 1 -- start start 2023-10-10T21:02:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.275+0000 7f883bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88340b1420 0x7f8834147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.275+0000 7f883bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340cbf30 0x7f883406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.275+0000 7f883bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340ccf90 0x7f8834155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.275+0000 7f883bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88340c1c90 con 0x7f88340cbf30 2023-10-10T21:02:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.275+0000 7f883bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88340aa2e0 con 0x7f88340b1420 2023-10-10T21:02:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.275+0000 7f883bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88340aa8a0 con 0x7f88340ccf90 2023-10-10T21:02:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883959a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340cbf30 0x7f883406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340ccf90 0x7f8834155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f8839d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88340b1420 0x7f8834147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340ccf90 0x7f8834155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:52092/0 (socket says 172.21.15.154:52092) 2023-10-10T21:02:56.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883a59c700 1 -- 172.21.15.154:0/4051226425 learned_addr learned my addr 172.21.15.154:0/4051226425 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:56.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883a59c700 1 -- 172.21.15.154:0/4051226425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88340b1420 msgr2=0x7f8834147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883a59c700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88340b1420 0x7f8834147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883a59c700 1 -- 172.21.15.154:0/4051226425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340cbf30 msgr2=0x7f883406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883a59c700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340cbf30 0x7f883406ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883a59c700 1 -- 172.21.15.154:0/4051226425 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883000b6d0 con 0x7f88340ccf90 2023-10-10T21:02:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f8839d9b700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88340b1420 0x7f8834147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f883a59c700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340ccf90 0x7f8834155be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f882c012000 tx=0x7f882c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.276+0000 7f8829ffb700 1 -- 172.21.15.154:0/4051226425 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c008b10 con 0x7f88340ccf90 2023-10-10T21:02:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.277+0000 7f8829ffb700 1 -- 172.21.15.154:0/4051226425 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c008c90 con 0x7f88340ccf90 2023-10-10T21:02:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.277+0000 7f8829ffb700 1 -- 172.21.15.154:0/4051226425 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0266b0 con 0x7f88340ccf90 2023-10-10T21:02:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.277+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c009ae0 con 0x7f88340ccf90 2023-10-10T21:02:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.277+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88340c21c0 con 0x7f88340ccf90 2023-10-10T21:02:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.278+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88340aaa30 con 0x7f88340ccf90 2023-10-10T21:02:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.279+0000 7f8829ffb700 1 -- 172.21.15.154:0/4051226425 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f882c003040 con 0x7f88340ccf90 2023-10-10T21:02:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.279+0000 7f8829ffb700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8818066f30 0x7f88180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.279+0000 7f8829ffb700 1 -- 172.21.15.154:0/4051226425 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f882c086110 con 0x7f88340ccf90 2023-10-10T21:02:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.280+0000 7f8839d9b700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8818066f30 0x7f88180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.280+0000 7f8839d9b700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8818066f30 0x7f88180693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8834156860 tx=0x7f883000b430 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:56.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.284+0000 7f8829ffb700 1 -- 172.21.15.154:0/4051226425 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f882c0532e0 con 0x7f88340ccf90 2023-10-10T21:02:56.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.517+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88340ad650 con 0x7f88340ccf90 2023-10-10T21:02:56.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.518+0000 7f8829ffb700 1 -- 172.21.15.154:0/4051226425 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f882c056900 con 0x7f88340ccf90 2023-10-10T21:02:56.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:56.521 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439513038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439513038},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439513038}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1179223321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1179223321},{"type":"v1","addr":"172.21.15.154:6836","nonce":1179223321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4116873553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4116873553},{"type":"v1","addr":"172.21.15.179:6835","nonce":4116873553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:02:19.159716+0000","modified":"2023-10-10T21:02:22.851729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6833/2053231138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2053231138},{"type":"v1","addr":"172.21.15.179:6833","nonce":2053231138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-10T21:02:56.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8818066f30 msgr2=0x7f88180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8818066f30 0x7f88180693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8834156860 tx=0x7f883000b430 comp rx=0 tx=0).stop 2023-10-10T21:02:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340ccf90 msgr2=0x7f8834155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340ccf90 0x7f8834155be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f882c012000 tx=0x7f882c018000 comp rx=0 tx=0).stop 2023-10-10T21:02:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 shutdown_connections 2023-10-10T21:02:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8818066f30 0x7f88180693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88340ccf90 0x7f8834155be0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88340b1420 0x7f8834147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 --2- 172.21.15.154:0/4051226425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340cbf30 0x7f883406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 >> 172.21.15.154:0/4051226425 conn(0x7f883406a320 msgr2=0x7f883415a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:56.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 shutdown_connections 2023-10-10T21:02:56.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.521+0000 7f883bfff700 1 -- 172.21.15.154:0/4051226425 wait complete. 2023-10-10T21:02:56.526 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-10-10T21:02:56.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.722+0000 7f236afff700 1 Processor -- start 2023-10-10T21:02:56.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.722+0000 7f236afff700 1 -- start start 2023-10-10T21:02:56.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.723+0000 7f236afff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f23640b0a10 0x7f2364155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.723+0000 7f236afff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23640ad930 con 0x7f23641578b0 2023-10-10T21:02:56.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.723+0000 7f236afff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23640acd20 con 0x7f2364155c10 2023-10-10T21:02:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.723+0000 7f236afff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23640ad000 con 0x7f23640b0a10 2023-10-10T21:02:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f2363fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f23641578b0 0x7f23640af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59614/0 (socket says 172.21.15.154:59614) 2023-10-10T21:02:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f2363fff700 1 -- 172.21.15.154:0/2974989578 learned_addr learned my addr 172.21.15.154:0/2974989578 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f236959c700 1 --2- 172.21.15.154:0/2974989578 >> v2:172.21.15.179:3300/0 conn(0x7f23640b0a10 0x7f2364155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f23637fe700 1 -- 172.21.15.154:0/2974989578 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270454600 0 0) 0x7f23640ad930 con 0x7f23641578b0 2023-10-10T21:02:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f23637fe700 1 -- 172.21.15.154:0/2974989578 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2354004680 con 0x7f23641578b0 2023-10-10T21:02:56.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f23637fe700 1 -- 172.21.15.154:0/2974989578 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284032673 0 0) 0x7f23640acd20 con 0x7f2364155c10 2023-10-10T21:02:56.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f23637fe700 1 -- 172.21.15.154:0/2974989578 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23640ad930 con 0x7f2364155c10 2023-10-10T21:02:56.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f236959c700 1 -- 172.21.15.154:0/2974989578 >> v1:172.21.15.179:6789/0 conn(0x7f2364155c10 legacy=0x7f23640ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f236959c700 1 -- 172.21.15.154:0/2974989578 >> v1:172.21.15.154:6789/0 conn(0x7f23641578b0 legacy=0x7f23640af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.724+0000 7f236959c700 1 -- 172.21.15.154:0/2974989578 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640ad2e0 con 0x7f23640b0a10 2023-10-10T21:02:56.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f236959c700 1 --2- 172.21.15.154:0/2974989578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640b0a10 0x7f2364155fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f235c009e60 tx=0x7f235c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f61e97f4ccb77da server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:56.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f23637fe700 1 -- 172.21.15.154:0/2974989578 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00e070 con 0x7f23640b0a10 2023-10-10T21:02:56.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f23637fe700 1 -- 172.21.15.154:0/2974989578 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00bab0 con 0x7f23640b0a10 2023-10-10T21:02:56.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f23637fe700 1 -- 172.21.15.154:0/2974989578 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00be70 con 0x7f23640b0a10 2023-10-10T21:02:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f236afff700 1 -- 172.21.15.154:0/2974989578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640b0a10 msgr2=0x7f2364155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f236afff700 1 --2- 172.21.15.154:0/2974989578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640b0a10 0x7f2364155fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f235c009e60 tx=0x7f235c009780 comp rx=0 tx=0).stop 2023-10-10T21:02:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f236afff700 1 -- 172.21.15.154:0/2974989578 shutdown_connections 2023-10-10T21:02:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f236afff700 1 --2- 172.21.15.154:0/2974989578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640b0a10 0x7f2364155fe0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f236afff700 1 -- 172.21.15.154:0/2974989578 >> 172.21.15.154:0/2974989578 conn(0x7f236406a320 msgr2=0x7f23640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:56.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f236afff700 1 -- 172.21.15.154:0/2974989578 shutdown_connections 2023-10-10T21:02:56.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.725+0000 7f236afff700 1 -- 172.21.15.154:0/2974989578 wait complete. 2023-10-10T21:02:56.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.727+0000 7f236afff700 1 Processor -- start 2023-10-10T21:02:56.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.727+0000 7f236afff700 1 -- start start 2023-10-10T21:02:56.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f236afff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23640b0a10 0x7f236415b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f236afff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2364155c10 0x7f2364152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f236afff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23641578b0 0x7f23641531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f236afff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236414a990 con 0x7f2364155c10 2023-10-10T21:02:56.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f236afff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236416ac80 con 0x7f23641578b0 2023-10-10T21:02:56.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f236afff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236414f5b0 con 0x7f23640b0a10 2023-10-10T21:02:56.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f2363fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2364155c10 0x7f2364152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f2363fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2364155c10 0x7f2364152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40604/0 (socket says 172.21.15.154:40604) 2023-10-10T21:02:56.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f2363fff700 1 -- 172.21.15.154:0/1738488010 learned_addr learned my addr 172.21.15.154:0/1738488010 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:56.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f2368d9b700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23640b0a10 0x7f236415b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f236959c700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23641578b0 0x7f23641531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f2363fff700 1 -- 172.21.15.154:0/1738488010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23640b0a10 msgr2=0x7f236415b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f2363fff700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23640b0a10 0x7f236415b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f2363fff700 1 -- 172.21.15.154:0/1738488010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23641578b0 msgr2=0x7f23641531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f2363fff700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23641578b0 0x7f23641531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f2363fff700 1 -- 172.21.15.154:0/1738488010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c009a20 con 0x7f2364155c10 2023-10-10T21:02:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.728+0000 7f236959c700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23641578b0 0x7f23641531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.729+0000 7f2363fff700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2364155c10 0x7f2364152cb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f235000c790 tx=0x7f2350007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.729+0000 7f2360ff9700 1 -- 172.21.15.154:0/1738488010 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350005c00 con 0x7f2364155c10 2023-10-10T21:02:56.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.729+0000 7f2360ff9700 1 -- 172.21.15.154:0/1738488010 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2350005d60 con 0x7f2364155c10 2023-10-10T21:02:56.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.729+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236414f890 con 0x7f2364155c10 2023-10-10T21:02:56.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.729+0000 7f2360ff9700 1 -- 172.21.15.154:0/1738488010 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350007300 con 0x7f2364155c10 2023-10-10T21:02:56.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.729+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236414fe50 con 0x7f2364155c10 2023-10-10T21:02:56.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.730+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236404c3c0 con 0x7f2364155c10 2023-10-10T21:02:56.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.731+0000 7f2360ff9700 1 -- 172.21.15.154:0/1738488010 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f235001b3b0 con 0x7f2364155c10 2023-10-10T21:02:56.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.732+0000 7f2360ff9700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2348066f30 0x7f23480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:56.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.732+0000 7f2360ff9700 1 -- 172.21.15.154:0/1738488010 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2350083bd0 con 0x7f2364155c10 2023-10-10T21:02:56.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.732+0000 7f2368d9b700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2348066f30 0x7f23480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:56.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.733+0000 7f2368d9b700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2348066f30 0x7f23480693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2364153ef0 tx=0x7f2358007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:56.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.736+0000 7f2360ff9700 1 -- 172.21.15.154:0/1738488010 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2350050da0 con 0x7f2364155c10 2023-10-10T21:02:56.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.930+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23640ad5c0 con 0x7f2364155c10 2023-10-10T21:02:56.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.931+0000 7f2360ff9700 1 -- 172.21.15.154:0/1738488010 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f2350017070 con 0x7f2364155c10 2023-10-10T21:02:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:56.934 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2348066f30 msgr2=0x7f23480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2348066f30 0x7f23480693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2364153ef0 tx=0x7f2358007d50 comp rx=0 tx=0).stop 2023-10-10T21:02:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2364155c10 msgr2=0x7f2364152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2364155c10 0x7f2364152cb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f235000c790 tx=0x7f2350007ea0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 shutdown_connections 2023-10-10T21:02:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23641578b0 0x7f23641531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2348066f30 0x7f23480693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23640b0a10 0x7f236415b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 --2- 172.21.15.154:0/1738488010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2364155c10 0x7f2364152cb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 >> 172.21.15.154:0/1738488010 conn(0x7f236406a320 msgr2=0x7f236414e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 shutdown_connections 2023-10-10T21:02:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:56.934+0000 7f236afff700 1 -- 172.21.15.154:0/1738488010 wait complete. 2023-10-10T21:02:56.955 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:02:17.271178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:02:18.145561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:02:56.955 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:02:57.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.139+0000 7fa82b39d700 1 Processor -- start 2023-10-10T21:02:57.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.139+0000 7fa82b39d700 1 -- start start 2023-10-10T21:02:57.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.140+0000 7fa82b39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa82406f060 0x7fa8240ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.140+0000 7fa82b39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 0x7fa8240ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.140+0000 7fa82b39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82406ebd0 con 0x7fa8240cb1a0 2023-10-10T21:02:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.140+0000 7fa82b39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82415b2e0 con 0x7fa82406f060 2023-10-10T21:02:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.140+0000 7fa82b39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82415aa70 con 0x7fa82406f4b0 2023-10-10T21:02:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa829b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa82406f060 0x7fa8240ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa829b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa82406f060 0x7fa8240ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40612/0 (socket says 172.21.15.154:40612) 2023-10-10T21:02:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa829b9a700 1 -- 172.21.15.154:0/4216365514 learned_addr learned my addr 172.21.15.154:0/4216365514 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa82ab9c700 1 --2- 172.21.15.154:0/4216365514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 0x7fa8240ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa829b9a700 1 -- 172.21.15.154:0/4216365514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 msgr2=0x7fa8240ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa829b9a700 1 --2- 172.21.15.154:0/4216365514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 0x7fa8240ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa829b9a700 1 -- 172.21.15.154:0/4216365514 >> v1:172.21.15.179:6789/0 conn(0x7fa8240cb1a0 legacy=0x7fa82415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa829b9a700 1 -- 172.21.15.154:0/4216365514 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82415ad20 con 0x7fa82406f060 2023-10-10T21:02:57.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa82ab9c700 1 --2- 172.21.15.154:0/4216365514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 0x7fa8240ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.141+0000 7fa829b9a700 1 --2- 172.21.15.154:0/4216365514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa82406f060 0x7fa8240ae0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa8140099b0 tx=0x7fa814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df17d277adb2d59 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa829399700 1 -- 172.21.15.154:0/4216365514 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81400b8f0 con 0x7fa82406f060 2023-10-10T21:02:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa829399700 1 -- 172.21.15.154:0/4216365514 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81400ba50 con 0x7fa82406f060 2023-10-10T21:02:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa829399700 1 -- 172.21.15.154:0/4216365514 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81400bdf0 con 0x7fa82406f060 2023-10-10T21:02:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa82b39d700 1 -- 172.21.15.154:0/4216365514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa82406f060 msgr2=0x7fa8240ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa82b39d700 1 --2- 172.21.15.154:0/4216365514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa82406f060 0x7fa8240ae0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa8140099b0 tx=0x7fa814009250 comp rx=0 tx=0).stop 2023-10-10T21:02:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa82b39d700 1 -- 172.21.15.154:0/4216365514 shutdown_connections 2023-10-10T21:02:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa82b39d700 1 --2- 172.21.15.154:0/4216365514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 0x7fa8240ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa82b39d700 1 --2- 172.21.15.154:0/4216365514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa82406f060 0x7fa8240ae0d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa82b39d700 1 -- 172.21.15.154:0/4216365514 >> 172.21.15.154:0/4216365514 conn(0x7fa8240cc1e0 msgr2=0x7fa8240cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa82b39d700 1 -- 172.21.15.154:0/4216365514 shutdown_connections 2023-10-10T21:02:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.142+0000 7fa82b39d700 1 -- 172.21.15.154:0/4216365514 wait complete. 2023-10-10T21:02:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.144+0000 7fa82b39d700 1 Processor -- start 2023-10-10T21:02:57.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.144+0000 7fa82b39d700 1 -- start start 2023-10-10T21:02:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82b39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82406f060 0x7fa82413d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82b39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 0x7fa82415f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82b39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8240cb1a0 0x7fa82415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82b39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82416b070 con 0x7fa8240cb1a0 2023-10-10T21:02:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82b39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa824157840 con 0x7fa82406f060 2023-10-10T21:02:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82b39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa824157cd0 con 0x7fa82406f4b0 2023-10-10T21:02:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82ab9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8240cb1a0 0x7fa82415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82ab9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8240cb1a0 0x7fa82415fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40614/0 (socket says 172.21.15.154:40614) 2023-10-10T21:02:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82ab9c700 1 -- 172.21.15.154:0/1402638197 learned_addr learned my addr 172.21.15.154:0/1402638197 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa829b9a700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 0x7fa82415f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82a39b700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82406f060 0x7fa82413d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82ab9c700 1 -- 172.21.15.154:0/1402638197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 msgr2=0x7fa82415f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82ab9c700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 0x7fa82415f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82ab9c700 1 -- 172.21.15.154:0/1402638197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82406f060 msgr2=0x7fa82413d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82ab9c700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82406f060 0x7fa82413d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82ab9c700 1 -- 172.21.15.154:0/1402638197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140094f0 con 0x7fa8240cb1a0 2023-10-10T21:02:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.145+0000 7fa82a39b700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82406f060 0x7fa82413d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.146+0000 7fa82ab9c700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8240cb1a0 0x7fa82415fca0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00d1b0 tx=0x7fa81c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.146+0000 7fa81a7fc700 1 -- 172.21.15.154:0/1402638197 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c00dda0 con 0x7fa8240cb1a0 2023-10-10T21:02:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.146+0000 7fa81a7fc700 1 -- 172.21.15.154:0/1402638197 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c00f040 con 0x7fa8240cb1a0 2023-10-10T21:02:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.146+0000 7fa81a7fc700 1 -- 172.21.15.154:0/1402638197 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c015690 con 0x7fa8240cb1a0 2023-10-10T21:02:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.146+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa824156f10 con 0x7fa8240cb1a0 2023-10-10T21:02:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.146+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8241574d0 con 0x7fa8240cb1a0 2023-10-10T21:02:57.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.147+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82406c450 con 0x7fa8240cb1a0 2023-10-10T21:02:57.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.148+0000 7fa81a7fc700 1 -- 172.21.15.154:0/1402638197 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa81c01e3b0 con 0x7fa8240cb1a0 2023-10-10T21:02:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.149+0000 7fa81a7fc700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa808066f30 0x7fa8080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.149+0000 7fa81a7fc700 1 -- 172.21.15.154:0/1402638197 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa81c084b00 con 0x7fa8240cb1a0 2023-10-10T21:02:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.149+0000 7fa82a39b700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa808066f30 0x7fa8080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.150+0000 7fa82a39b700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa808066f30 0x7fa8080693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa820007fd0 tx=0x7fa820009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.153+0000 7fa81a7fc700 1 -- 172.21.15.154:0/1402638197 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa81c086e60 con 0x7fa8240cb1a0 2023-10-10T21:02:57.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.342+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa824157980 con 0x7fa8240cb1a0 2023-10-10T21:02:57.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.343+0000 7fa81a7fc700 1 -- 172.21.15.154:0/1402638197 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa81c01a0a0 con 0x7fa8240cb1a0 2023-10-10T21:02:57.346 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:02:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa808066f30 msgr2=0x7fa8080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa808066f30 0x7fa8080693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa820007fd0 tx=0x7fa820009040 comp rx=0 tx=0).stop 2023-10-10T21:02:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8240cb1a0 msgr2=0x7fa82415fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8240cb1a0 0x7fa82415fca0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00d1b0 tx=0x7fa81c009a50 comp rx=0 tx=0).stop 2023-10-10T21:02:57.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 shutdown_connections 2023-10-10T21:02:57.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8240cb1a0 0x7fa82415fca0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82406f060 0x7fa82413d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa808066f30 0x7fa8080693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 --2- 172.21.15.154:0/1402638197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa82406f4b0 0x7fa82415f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 >> 172.21.15.154:0/1402638197 conn(0x7fa8240cc1e0 msgr2=0x7fa8240c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 shutdown_connections 2023-10-10T21:02:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.345+0000 7fa82b39d700 1 -- 172.21.15.154:0/1402638197 wait complete. 2023-10-10T21:02:57.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:02:57.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.548+0000 7ff3ae79d700 1 Processor -- start 2023-10-10T21:02:57.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.549+0000 7ff3ae79d700 1 -- start start 2023-10-10T21:02:57.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.550+0000 7ff3ae79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a81407e0 0x7ff3a806a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.550+0000 7ff3ae79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3a806dc00 0x7ff3a806a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.550+0000 7ff3ae79d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a80c6820 con 0x7ff3a8140bb0 2023-10-10T21:02:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.550+0000 7ff3ae79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a80c6de0 con 0x7ff3a806dc00 2023-10-10T21:02:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.550+0000 7ff3ae79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a8141270 con 0x7ff3a81407e0 2023-10-10T21:02:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.550+0000 7ff3acf9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff3a8140bb0 0x7ff3a806d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59626/0 (socket says 172.21.15.154:59626) 2023-10-10T21:02:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.550+0000 7ff3acf9a700 1 -- 172.21.15.154:0/2105287962 learned_addr learned my addr 172.21.15.154:0/2105287962 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.550+0000 7ff3adf9c700 1 --2- 172.21.15.154:0/2105287962 >> v2:172.21.15.179:3300/0 conn(0x7ff3a806dc00 0x7ff3a806a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.550+0000 7ff3ad79b700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a81407e0 0x7ff3a806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602046996 0 0) 0x7ff3a80c6820 con 0x7ff3a8140bb0 2023-10-10T21:02:57.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff394003570 con 0x7ff3a8140bb0 2023-10-10T21:02:57.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3060376340 0 0) 0x7ff394003570 con 0x7ff3a8140bb0 2023-10-10T21:02:57.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a81407e0 msgr2=0x7ff3a806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:57.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a81407e0 0x7ff3a806a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 >> v2:172.21.15.179:3300/0 conn(0x7ff3a806dc00 msgr2=0x7ff3a806a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:57.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 --2- 172.21.15.154:0/2105287962 >> v2:172.21.15.179:3300/0 conn(0x7ff3a806dc00 0x7ff3a806a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a806acf0 con 0x7ff3a8140bb0 2023-10-10T21:02:57.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7ff398001470 con 0x7ff3a8140bb0 2023-10-10T21:02:57.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 >> v1:172.21.15.154:6789/0 conn(0x7ff3a8140bb0 legacy=0x7ff3a806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff394003a60 0x7ff394003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff394004810 0x7ff394004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3940051c0 0x7ff39400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80c6de0 con 0x7ff394004810 2023-10-10T21:02:57.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a8141270 con 0x7ff3940051c0 2023-10-10T21:02:57.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39400bfa0 con 0x7ff394003a60 2023-10-10T21:02:57.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff3adf9c700 1 --2- 172.21.15.154:0/2105287962 >> v2:172.21.15.179:3300/0 conn(0x7ff3a806dc00 0x7ff3a806a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:57.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff3ad79b700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a81407e0 0x7ff3a806a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:57.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.551+0000 7ff3acf9a700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff394004810 0x7ff394004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3adf9c700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3940051c0 0x7ff39400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3ad79b700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff394003a60 0x7ff394003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3acf9a700 1 -- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff394003a60 msgr2=0x7ff394003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:57.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3acf9a700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff394003a60 0x7ff394003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3acf9a700 1 -- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3940051c0 msgr2=0x7ff39400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:57.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3acf9a700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3940051c0 0x7ff39400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3acf9a700 1 -- 172.21.15.154:0/2105287962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394003570 con 0x7ff394004810 2023-10-10T21:02:57.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3adf9c700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3940051c0 0x7ff39400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:57.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3ad79b700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff394003a60 0x7ff394003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:57.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff3acf9a700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff394004810 0x7ff394004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff39800c3c0 tx=0x7ff398001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a0e1219bb790e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:57.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800cbf0 con 0x7ff394004810 2023-10-10T21:02:57.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800cd90 con 0x7ff394004810 2023-10-10T21:02:57.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.552+0000 7ff39ffff700 1 -- 172.21.15.154:0/2105287962 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398005b70 con 0x7ff394004810 2023-10-10T21:02:57.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.553+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2105287962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff394004810 msgr2=0x7ff394004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.553+0000 7ff3ae79d700 1 --2- 172.21.15.154:0/2105287962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff394004810 0x7ff394004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff39800c3c0 tx=0x7ff398001e90 comp rx=0 tx=0).stop 2023-10-10T21:02:57.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.553+0000 7ff3adf9c700 1 -- 172.21.15.154:0/2105287962 reap_dead start 2023-10-10T21:02:57.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.553+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2105287962 shutdown_connections 2023-10-10T21:02:57.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.553+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2105287962 >> 172.21.15.154:0/2105287962 conn(0x7ff3a80cc1e0 msgr2=0x7ff3a80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:57.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.553+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2105287962 shutdown_connections 2023-10-10T21:02:57.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.553+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2105287962 wait complete. 2023-10-10T21:02:57.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.554+0000 7ff3ae79d700 1 Processor -- start 2023-10-10T21:02:57.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.554+0000 7ff3ae79d700 1 -- start start 2023-10-10T21:02:57.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.555+0000 7ff3ae79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff394004810 0x7ff3a815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.555+0000 7ff3ae79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a8138070 0x7ff3a80c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.555+0000 7ff3ae79d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a80c7170 0x7ff3a80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.555+0000 7ff3ae79d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a81384e0 con 0x7ff3a80c7170 2023-10-10T21:02:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.555+0000 7ff3ae79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80c7b20 con 0x7ff394004810 2023-10-10T21:02:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.555+0000 7ff3ae79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a815cb60 con 0x7ff3a8138070 2023-10-10T21:02:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3adf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a80c7170 0x7ff3a80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3adf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a80c7170 0x7ff3a80c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40628/0 (socket says 172.21.15.154:40628) 2023-10-10T21:02:57.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3adf9c700 1 -- 172.21.15.154:0/2806123197 learned_addr learned my addr 172.21.15.154:0/2806123197 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:57.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3acf9a700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a8138070 0x7ff3a80c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3ad79b700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff394004810 0x7ff3a815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3adf9c700 1 -- 172.21.15.154:0/2806123197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a8138070 msgr2=0x7ff3a80c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3adf9c700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a8138070 0x7ff3a80c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3adf9c700 1 -- 172.21.15.154:0/2806123197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff394004810 msgr2=0x7ff3a815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3adf9c700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff394004810 0x7ff3a815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3adf9c700 1 -- 172.21.15.154:0/2806123197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a815ce40 con 0x7ff3a80c7170 2023-10-10T21:02:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff3adf9c700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a80c7170 0x7ff3a80c75e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8070d30 tx=0x7ff3a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.556+0000 7ff39d7fa700 1 -- 172.21.15.154:0/2806123197 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000e070 con 0x7ff3a80c7170 2023-10-10T21:02:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.557+0000 7ff39d7fa700 1 -- 172.21.15.154:0/2806123197 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0011d00 con 0x7ff3a80c7170 2023-10-10T21:02:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.557+0000 7ff39d7fa700 1 -- 172.21.15.154:0/2806123197 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00166c0 con 0x7ff3a80c7170 2023-10-10T21:02:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.557+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a815d120 con 0x7ff3a80c7170 2023-10-10T21:02:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.557+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a815d6e0 con 0x7ff3a80c7170 2023-10-10T21:02:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.558+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a806c450 con 0x7ff3a80c7170 2023-10-10T21:02:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.558+0000 7ff39d7fa700 1 -- 172.21.15.154:0/2806123197 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3a0016a70 con 0x7ff3a80c7170 2023-10-10T21:02:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.559+0000 7ff39d7fa700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c066f30 0x7ff38c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.559+0000 7ff39d7fa700 1 -- 172.21.15.154:0/2806123197 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3a00851c0 con 0x7ff3a80c7170 2023-10-10T21:02:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.559+0000 7ff3ad79b700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c066f30 0x7ff38c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.560+0000 7ff3ad79b700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c066f30 0x7ff38c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff3a806f9a0 tx=0x7ff3a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:57.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.563+0000 7ff39d7fa700 1 -- 172.21.15.154:0/2806123197 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3a0052450 con 0x7ff3a80c7170 2023-10-10T21:02:57.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.752+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3a806afd0 con 0x7ff3a80c7170 2023-10-10T21:02:57.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.753+0000 7ff39d7fa700 1 -- 172.21.15.154:0/2806123197 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3a0055a70 con 0x7ff3a80c7170 2023-10-10T21:02:57.756 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:02:57.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c066f30 msgr2=0x7ff38c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c066f30 0x7ff38c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff3a806f9a0 tx=0x7ff3a4008040 comp rx=0 tx=0).stop 2023-10-10T21:02:57.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a80c7170 msgr2=0x7ff3a80c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a80c7170 0x7ff3a80c75e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8070d30 tx=0x7ff3a000b040 comp rx=0 tx=0).stop 2023-10-10T21:02:57.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 shutdown_connections 2023-10-10T21:02:57.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a80c7170 0x7ff3a80c75e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff394004810 0x7ff3a815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff38c066f30 0x7ff38c0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 --2- 172.21.15.154:0/2806123197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a8138070 0x7ff3a80c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 >> 172.21.15.154:0/2806123197 conn(0x7ff3a80cc1e0 msgr2=0x7ff3a8069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 shutdown_connections 2023-10-10T21:02:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.755+0000 7ff3ae79d700 1 -- 172.21.15.154:0/2806123197 wait complete. 2023-10-10T21:02:57.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:02:57.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.959+0000 7faf2619d700 1 Processor -- start 2023-10-10T21:02:57.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.959+0000 7faf2619d700 1 -- start start 2023-10-10T21:02:57.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.960+0000 7faf2619d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf200b1b40 0x7faf200b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.960+0000 7faf2619d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf200cfb00 con 0x7faf200b16d0 2023-10-10T21:02:57.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.960+0000 7faf2619d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf200b5c40 con 0x7faf200b4e70 2023-10-10T21:02:57.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.960+0000 7faf2619d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf200b5f20 con 0x7faf200b1b40 2023-10-10T21:02:57.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.961+0000 7faf2599c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf200b1b40 0x7faf200b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.961+0000 7faf2499a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faf200b16d0 0x7faf200b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59634/0 (socket says 172.21.15.154:59634) 2023-10-10T21:02:57.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.961+0000 7faf2499a700 1 -- 172.21.15.154:0/2750568594 learned_addr learned my addr 172.21.15.154:0/2750568594 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:57.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.961+0000 7faf2599c700 1 -- 172.21.15.154:0/2750568594 >> v1:172.21.15.179:6789/0 conn(0x7faf200b4e70 legacy=0x7faf200ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.961+0000 7faf2599c700 1 -- 172.21.15.154:0/2750568594 >> v1:172.21.15.154:6789/0 conn(0x7faf200b16d0 legacy=0x7faf200b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.961+0000 7faf2599c700 1 -- 172.21.15.154:0/2750568594 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200b6200 con 0x7faf200b1b40 2023-10-10T21:02:57.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.961+0000 7faf2599c700 1 --2- 172.21.15.154:0/2750568594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b1b40 0x7faf200b3ac0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e60 tx=0x7faf18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900aea1cb8f6a108 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:57.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.961+0000 7faf17fff700 1 -- 172.21.15.154:0/2750568594 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1800e070 con 0x7faf200b1b40 2023-10-10T21:02:57.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.962+0000 7faf17fff700 1 -- 172.21.15.154:0/2750568594 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1800bc30 con 0x7faf200b1b40 2023-10-10T21:02:57.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.962+0000 7faf17fff700 1 -- 172.21.15.154:0/2750568594 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18012430 con 0x7faf200b1b40 2023-10-10T21:02:57.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.962+0000 7faf2619d700 1 -- 172.21.15.154:0/2750568594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b1b40 msgr2=0x7faf200b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.962+0000 7faf2619d700 1 --2- 172.21.15.154:0/2750568594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b1b40 0x7faf200b3ac0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e60 tx=0x7faf18009780 comp rx=0 tx=0).stop 2023-10-10T21:02:57.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.962+0000 7faf2619d700 1 -- 172.21.15.154:0/2750568594 shutdown_connections 2023-10-10T21:02:57.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.962+0000 7faf2619d700 1 --2- 172.21.15.154:0/2750568594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b1b40 0x7faf200b3ac0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.962+0000 7faf2619d700 1 -- 172.21.15.154:0/2750568594 >> 172.21.15.154:0/2750568594 conn(0x7faf200d10c0 msgr2=0x7faf200affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:57.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.962+0000 7faf2619d700 1 -- 172.21.15.154:0/2750568594 shutdown_connections 2023-10-10T21:02:57.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.962+0000 7faf2619d700 1 -- 172.21.15.154:0/2750568594 wait complete. 2023-10-10T21:02:57.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.964+0000 7faf2619d700 1 Processor -- start 2023-10-10T21:02:57.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.964+0000 7faf2619d700 1 -- start start 2023-10-10T21:02:57.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.964+0000 7faf2619d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf200b16d0 0x7faf200a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.964+0000 7faf2619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf200b1b40 0x7faf200a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2619d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b4e70 0x7faf200c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2619d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200ca800 con 0x7faf200b4e70 2023-10-10T21:02:57.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2619d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200c9910 con 0x7faf200b16d0 2023-10-10T21:02:57.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200c9bf0 con 0x7faf200b1b40 2023-10-10T21:02:57.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2599c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b4e70 0x7faf200c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2599c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b4e70 0x7faf200c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40646/0 (socket says 172.21.15.154:40646) 2023-10-10T21:02:57.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2599c700 1 -- 172.21.15.154:0/858289704 learned_addr learned my addr 172.21.15.154:0/858289704 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:57.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2499a700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf200b1b40 0x7faf200a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2519b700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf200b16d0 0x7faf200a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2599c700 1 -- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf200b1b40 msgr2=0x7faf200a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2599c700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf200b1b40 0x7faf200a7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2599c700 1 -- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf200b16d0 msgr2=0x7faf200a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:57.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2599c700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf200b16d0 0x7faf200a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:57.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2599c700 1 -- 172.21.15.154:0/858289704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18009a20 con 0x7faf200b4e70 2023-10-10T21:02:57.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2519b700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf200b16d0 0x7faf200a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:57.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.965+0000 7faf2499a700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf200b1b40 0x7faf200a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:02:57.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.966+0000 7faf2599c700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b4e70 0x7faf200c74e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b6c0 tx=0x7faf18019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:57.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.966+0000 7faf157fa700 1 -- 172.21.15.154:0/858289704 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18007000 con 0x7faf200b4e70 2023-10-10T21:02:57.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.966+0000 7faf157fa700 1 -- 172.21.15.154:0/858289704 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1801b600 con 0x7faf200b4e70 2023-10-10T21:02:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.966+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf200c9ed0 con 0x7faf200b4e70 2023-10-10T21:02:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.966+0000 7faf157fa700 1 -- 172.21.15.154:0/858289704 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1801b9c0 con 0x7faf200b4e70 2023-10-10T21:02:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.966+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf200ca490 con 0x7faf200b4e70 2023-10-10T21:02:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.967+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf200ca970 con 0x7faf200b4e70 2023-10-10T21:02:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.968+0000 7faf157fa700 1 -- 172.21.15.154:0/858289704 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf180263f0 con 0x7faf200b4e70 2023-10-10T21:02:57.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.968+0000 7faf157fa700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7faf04066f30 0x7faf040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:57.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.969+0000 7faf157fa700 1 -- 172.21.15.154:0/858289704 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf18086690 con 0x7faf200b4e70 2023-10-10T21:02:57.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.969+0000 7faf2519b700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7faf04066f30 0x7faf040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:57.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.969+0000 7faf2519b700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7faf04066f30 0x7faf040693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000c00 tx=0x7faf1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:57.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:57.973+0000 7faf157fa700 1 -- 172.21.15.154:0/858289704 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf18053900 con 0x7faf200b4e70 2023-10-10T21:02:58.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.163+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf2004bb80 con 0x7faf200b4e70 2023-10-10T21:02:58.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.163+0000 7faf157fa700 1 -- 172.21.15.154:0/858289704 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf18056f20 con 0x7faf200b4e70 2023-10-10T21:02:58.166 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:02:58.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7faf04066f30 msgr2=0x7faf040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7faf04066f30 0x7faf040693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000c00 tx=0x7faf1c009040 comp rx=0 tx=0).stop 2023-10-10T21:02:58.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b4e70 msgr2=0x7faf200c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b4e70 0x7faf200c74e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b6c0 tx=0x7faf18019000 comp rx=0 tx=0).stop 2023-10-10T21:02:58.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 shutdown_connections 2023-10-10T21:02:58.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf200b4e70 0x7faf200c74e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf200b16d0 0x7faf200a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7faf04066f30 0x7faf040693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 --2- 172.21.15.154:0/858289704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf200b1b40 0x7faf200a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 >> 172.21.15.154:0/858289704 conn(0x7faf200d10c0 msgr2=0x7faf20159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:58.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 shutdown_connections 2023-10-10T21:02:58.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.166+0000 7faf2619d700 1 -- 172.21.15.154:0/858289704 wait complete. 2023-10-10T21:02:58.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:02:58.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.366+0000 7fc8ca19d700 1 Processor -- start 2023-10-10T21:02:58.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.366+0000 7fc8ca19d700 1 -- start start 2023-10-10T21:02:58.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.367+0000 7fc8ca19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c41595a0 0x7fc8c40b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.367+0000 7fc8ca19d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8c40c6c60 0x7fc8c40c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.367+0000 7fc8ca19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc8c40b1de0 0x7fc8c40c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.367+0000 7fc8ca19d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40b2b90 con 0x7fc8c40c6c60 2023-10-10T21:02:58.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.367+0000 7fc8ca19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40b1410 con 0x7fc8c40b1de0 2023-10-10T21:02:58.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.367+0000 7fc8ca19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c4063230 con 0x7fc8c41595a0 2023-10-10T21:02:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.367+0000 7fc8c899a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8c40c6c60 0x7fc8c40c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.367+0000 7fc8c899a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8c40c6c60 0x7fc8c40c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40658/0 (socket says 172.21.15.154:40658) 2023-10-10T21:02:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.367+0000 7fc8c899a700 1 -- 172.21.15.154:0/1799413100 learned_addr learned my addr 172.21.15.154:0/1799413100 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8c999c700 1 --2- 172.21.15.154:0/1799413100 >> v2:172.21.15.179:3300/0 conn(0x7fc8c40b1de0 0x7fc8c40c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8c919b700 1 --2- 172.21.15.154:0/1799413100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c41595a0 0x7fc8c40b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8c899a700 1 -- 172.21.15.154:0/1799413100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c41595a0 msgr2=0x7fc8c40b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:58.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8c899a700 1 --2- 172.21.15.154:0/1799413100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c41595a0 0x7fc8c40b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8c899a700 1 -- 172.21.15.154:0/1799413100 >> v2:172.21.15.179:3300/0 conn(0x7fc8c40b1de0 msgr2=0x7fc8c40c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:58.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8c899a700 1 --2- 172.21.15.154:0/1799413100 >> v2:172.21.15.179:3300/0 conn(0x7fc8c40b1de0 0x7fc8c40c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8c899a700 1 -- 172.21.15.154:0/1799413100 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c40634f0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8c899a700 1 --2- 172.21.15.154:0/1799413100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 0x7fc8c40c8120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc8c415d3c0 tx=0x7fc8b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0636abcfc5ea5d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8bbfff700 1 -- 172.21.15.154:0/1799413100 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400b640 con 0x7fc8c40c6c60 2023-10-10T21:02:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.368+0000 7fc8bbfff700 1 -- 172.21.15.154:0/1799413100 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b400b7a0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8bbfff700 1 -- 172.21.15.154:0/1799413100 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400bb60 con 0x7fc8c40c6c60 2023-10-10T21:02:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8ca19d700 1 -- 172.21.15.154:0/1799413100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 msgr2=0x7fc8c40c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/1799413100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 0x7fc8c40c8120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc8c415d3c0 tx=0x7fc8b4009250 comp rx=0 tx=0).stop 2023-10-10T21:02:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8ca19d700 1 -- 172.21.15.154:0/1799413100 shutdown_connections 2023-10-10T21:02:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/1799413100 >> v2:172.21.15.179:3300/0 conn(0x7fc8c40b1de0 0x7fc8c40c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/1799413100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c41595a0 0x7fc8c40b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/1799413100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 0x7fc8c40c8120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8ca19d700 1 -- 172.21.15.154:0/1799413100 >> 172.21.15.154:0/1799413100 conn(0x7fc8c406ddb0 msgr2=0x7fc8c406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:58.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8ca19d700 1 -- 172.21.15.154:0/1799413100 shutdown_connections 2023-10-10T21:02:58.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.369+0000 7fc8ca19d700 1 -- 172.21.15.154:0/1799413100 wait complete. 2023-10-10T21:02:58.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.371+0000 7fc8ca19d700 1 Processor -- start 2023-10-10T21:02:58.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.371+0000 7fc8ca19d700 1 -- start start 2023-10-10T21:02:58.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8ca19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40b1de0 0x7fc8c414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8ca19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 0x7fc8c40c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8ca19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c41595a0 0x7fc8c4157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8ca19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c416aee0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8ca19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c414fe00 con 0x7fc8c41595a0 2023-10-10T21:02:58.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8ca19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c416a310 con 0x7fc8c40b1de0 2023-10-10T21:02:58.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c899a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 0x7fc8c40c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c899a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 0x7fc8c40c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40670/0 (socket says 172.21.15.154:40670) 2023-10-10T21:02:58.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c899a700 1 -- 172.21.15.154:0/4028260569 learned_addr learned my addr 172.21.15.154:0/4028260569 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:58.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c919b700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40b1de0 0x7fc8c414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c899a700 1 -- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40b1de0 msgr2=0x7fc8c414f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c999c700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c41595a0 0x7fc8c4157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c899a700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40b1de0 0x7fc8c414f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c899a700 1 -- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c41595a0 msgr2=0x7fc8c4157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c899a700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c41595a0 0x7fc8c4157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c899a700 1 -- 172.21.15.154:0/4028260569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b40094f0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c919b700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40b1de0 0x7fc8c414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:58.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.372+0000 7fc8c999c700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c41595a0 0x7fc8c4157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:02:58.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.373+0000 7fc8c899a700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 0x7fc8c40c6090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4064340 tx=0x7fc8b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:58.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.373+0000 7fc8b97fa700 1 -- 172.21.15.154:0/4028260569 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4000d10 con 0x7fc8c40c6c60 2023-10-10T21:02:58.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.373+0000 7fc8b97fa700 1 -- 172.21.15.154:0/4028260569 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b400bb20 con 0x7fc8c40c6c60 2023-10-10T21:02:58.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.373+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c416a5b0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.373+0000 7fc8b97fa700 1 -- 172.21.15.154:0/4028260569 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4011670 con 0x7fc8c40c6c60 2023-10-10T21:02:58.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.373+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c416ab70 con 0x7fc8c40c6c60 2023-10-10T21:02:58.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.374+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c404c3c0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.375+0000 7fc8b97fa700 1 -- 172.21.15.154:0/4028260569 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8b40119e0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.376+0000 7fc8b97fa700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc8a8066f30 0x7fc8a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.376+0000 7fc8b97fa700 1 -- 172.21.15.154:0/4028260569 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8b4085e00 con 0x7fc8c40c6c60 2023-10-10T21:02:58.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.376+0000 7fc8c919b700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc8a8066f30 0x7fc8a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.377+0000 7fc8c919b700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc8a8066f30 0x7fc8a80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0006f00 tx=0x7fc8c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:58.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.380+0000 7fc8b97fa700 1 -- 172.21.15.154:0/4028260569 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8b4052fd0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.614+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8c40637d0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.615+0000 7fc8b97fa700 1 -- 172.21.15.154:0/4028260569 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7fc8b40565f0 con 0x7fc8c40c6c60 2023-10-10T21:02:58.617 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:58.618 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439513038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439513038},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439513038}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1179223321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1179223321},{"type":"v1","addr":"172.21.15.154:6836","nonce":1179223321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4116873553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4116873553},{"type":"v1","addr":"172.21.15.179:6835","nonce":4116873553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:02:19.159716+0000","modified":"2023-10-10T21:02:22.851729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6833/2053231138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2053231138},{"type":"v1","addr":"172.21.15.179:6833","nonce":2053231138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-10T21:02:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc8a8066f30 msgr2=0x7fc8a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc8a8066f30 0x7fc8a80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0006f00 tx=0x7fc8c0008040 comp rx=0 tx=0).stop 2023-10-10T21:02:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 msgr2=0x7fc8c40c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 0x7fc8c40c6090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4064340 tx=0x7fc8b4017000 comp rx=0 tx=0).stop 2023-10-10T21:02:58.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 shutdown_connections 2023-10-10T21:02:58.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8c41595a0 0x7fc8c4157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fc8a8066f30 0x7fc8a80693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8c40b1de0 0x7fc8c414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 --2- 172.21.15.154:0/4028260569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c40c6c60 0x7fc8c40c6090 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 >> 172.21.15.154:0/4028260569 conn(0x7fc8c406ddb0 msgr2=0x7fc8c40cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:58.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 shutdown_connections 2023-10-10T21:02:58.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.618+0000 7fc8ca19d700 1 -- 172.21.15.154:0/4028260569 wait complete. 2023-10-10T21:02:58.622 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-10-10T21:02:58.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:02:58.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.818+0000 7f23fe9ff700 1 Processor -- start 2023-10-10T21:02:58.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.819+0000 7f23fe9ff700 1 -- start start 2023-10-10T21:02:58.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.820+0000 7f23fe9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8155c10 0x7f23f8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.820+0000 7f23fe9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f80acac0 con 0x7f23f80ac6a0 2023-10-10T21:02:58.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.820+0000 7f23fe9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f80ad930 con 0x7f23f80ac230 2023-10-10T21:02:58.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.820+0000 7f23fe9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80acd20 con 0x7f23f8155c10 2023-10-10T21:02:58.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.820+0000 7f23fcf9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f23f80ac6a0 0x7f23f80b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59650/0 (socket says 172.21.15.154:59650) 2023-10-10T21:02:58.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.820+0000 7f23fcf9c700 1 -- 172.21.15.154:0/2834799411 learned_addr learned my addr 172.21.15.154:0/2834799411 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:02:58.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f7fff700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8155c10 0x7f23f8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36444091 0 0) 0x7f23f80acac0 con 0x7f23f80ac6a0 2023-10-10T21:02:58.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e4004680 con 0x7f23f80ac6a0 2023-10-10T21:02:58.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 499391728 0 0) 0x7f23e4004680 con 0x7f23f80ac6a0 2023-10-10T21:02:58.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8155c10 msgr2=0x7f23f8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:58.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8155c10 0x7f23f8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 >> v1:172.21.15.179:6789/0 conn(0x7f23f80ac230 legacy=0x7f23f81568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80ad000 con 0x7f23f80ac6a0 2023-10-10T21:02:58.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f23f00017f0 con 0x7f23f80ac6a0 2023-10-10T21:02:58.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 >> v1:172.21.15.154:6789/0 conn(0x7f23f80ac6a0 legacy=0x7f23f80b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4004ba0 0x7f23e4004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8155c10 0x7f23e4005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e4005e60 0x7f23e40062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80acd20 con 0x7f23e4005e60 2023-10-10T21:02:58.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e400cc20 con 0x7f23e4004ba0 2023-10-10T21:02:58.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.821+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4003510 con 0x7f23f8155c10 2023-10-10T21:02:58.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23f7fff700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4004ba0 0x7f23e4004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23fcf9c700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e4005e60 0x7f23e40062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23effff700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8155c10 0x7f23e4005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23fcf9c700 1 -- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8155c10 msgr2=0x7f23e4005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:58.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23fcf9c700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8155c10 0x7f23e4005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23fcf9c700 1 -- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4004ba0 msgr2=0x7f23e4004f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23fcf9c700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4004ba0 0x7f23e4004f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23fcf9c700 1 -- 172.21.15.154:0/2834799411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4004680 con 0x7f23e4005e60 2023-10-10T21:02:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23f7fff700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4004ba0 0x7f23e4004f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23fcf9c700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e4005e60 0x7f23e40062d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f23f000a8d0 tx=0x7f23f0002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7ac8c2bc3da46f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.822+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00070d0 con 0x7f23e4005e60 2023-10-10T21:02:58.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.823+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f0007230 con 0x7f23e4005e60 2023-10-10T21:02:58.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.823+0000 7f23f77fe700 1 -- 172.21.15.154:0/2834799411 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00075f0 con 0x7f23e4005e60 2023-10-10T21:02:58.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.823+0000 7f23fe9ff700 1 -- 172.21.15.154:0/2834799411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e4005e60 msgr2=0x7f23e40062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.823+0000 7f23fe9ff700 1 --2- 172.21.15.154:0/2834799411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e4005e60 0x7f23e40062d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f23f000a8d0 tx=0x7f23f0002170 comp rx=0 tx=0).stop 2023-10-10T21:02:58.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.823+0000 7f23fcf9c700 1 -- 172.21.15.154:0/2834799411 reap_dead start 2023-10-10T21:02:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.823+0000 7f23fe9ff700 1 -- 172.21.15.154:0/2834799411 shutdown_connections 2023-10-10T21:02:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.823+0000 7f23fe9ff700 1 -- 172.21.15.154:0/2834799411 >> 172.21.15.154:0/2834799411 conn(0x7f23f806a320 msgr2=0x7f23f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.823+0000 7f23fe9ff700 1 -- 172.21.15.154:0/2834799411 shutdown_connections 2023-10-10T21:02:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.823+0000 7f23fe9ff700 1 -- 172.21.15.154:0/2834799411 wait complete. 2023-10-10T21:02:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.825+0000 7f23fe9ff700 1 Processor -- start 2023-10-10T21:02:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.825+0000 7f23fe9ff700 1 -- start start 2023-10-10T21:02:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23fe9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4005e60 0x7f23f80a7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23fe9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23f8151cf0 0x7f23f81588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23fe9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8158df0 0x7f23f806e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23fe9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80a7100 con 0x7f23f8151cf0 2023-10-10T21:02:58.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23fe9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f8159300 con 0x7f23e4005e60 2023-10-10T21:02:58.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23fe9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f81595e0 con 0x7f23f8158df0 2023-10-10T21:02:58.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23effff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23f8151cf0 0x7f23f81588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23effff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23f8151cf0 0x7f23f81588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40692/0 (socket says 172.21.15.154:40692) 2023-10-10T21:02:58.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23effff700 1 -- 172.21.15.154:0/3856311067 learned_addr learned my addr 172.21.15.154:0/3856311067 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:58.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23f7fff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4005e60 0x7f23f80a7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23fcf9c700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8158df0 0x7f23f806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23effff700 1 -- 172.21.15.154:0/3856311067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8158df0 msgr2=0x7f23f806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23effff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8158df0 0x7f23f806e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23effff700 1 -- 172.21.15.154:0/3856311067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4005e60 msgr2=0x7f23f80a7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23effff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4005e60 0x7f23f80a7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23effff700 1 -- 172.21.15.154:0/3856311067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80a6ab0 con 0x7f23f8151cf0 2023-10-10T21:02:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.826+0000 7f23effff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23f8151cf0 0x7f23f81588b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23e000f8d0 tx=0x7f23e0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.827+0000 7f23f4ff9700 1 -- 172.21.15.154:0/3856311067 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0013600 con 0x7f23f8151cf0 2023-10-10T21:02:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.827+0000 7f23f4ff9700 1 -- 172.21.15.154:0/3856311067 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e0013760 con 0x7f23f8151cf0 2023-10-10T21:02:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.827+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f80a6d90 con 0x7f23f8151cf0 2023-10-10T21:02:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.827+0000 7f23f4ff9700 1 -- 172.21.15.154:0/3856311067 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0013b20 con 0x7f23f8151cf0 2023-10-10T21:02:58.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.827+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f8152160 con 0x7f23f8151cf0 2023-10-10T21:02:58.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.828+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f804c3c0 con 0x7f23f8151cf0 2023-10-10T21:02:58.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.829+0000 7f23f4ff9700 1 -- 172.21.15.154:0/3856311067 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23e001c400 con 0x7f23f8151cf0 2023-10-10T21:02:58.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.830+0000 7f23f4ff9700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23d8066f30 0x7f23d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:58.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.830+0000 7f23f4ff9700 1 -- 172.21.15.154:0/3856311067 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23e0084860 con 0x7f23f8151cf0 2023-10-10T21:02:58.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.830+0000 7f23f7fff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23d8066f30 0x7f23d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:58.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.831+0000 7f23f7fff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23d8066f30 0x7f23d80693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23e8006eb0 tx=0x7f23e80091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:58.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:58.834+0000 7f23f4ff9700 1 -- 172.21.15.154:0/3856311067 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23e0051a30 con 0x7f23f8151cf0 2023-10-10T21:02:59.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.026+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23f80ad2e0 con 0x7f23f8151cf0 2023-10-10T21:02:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.027+0000 7f23f4ff9700 1 -- 172.21.15.154:0/3856311067 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f23e0055050 con 0x7f23f8151cf0 2023-10-10T21:02:59.030 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:59.030 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:02:59.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.029+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23d8066f30 msgr2=0x7f23d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.029+0000 7f23fe9ff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23d8066f30 0x7f23d80693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23e8006eb0 tx=0x7f23e80091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23f8151cf0 msgr2=0x7f23f81588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23f8151cf0 0x7f23f81588b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23e000f8d0 tx=0x7f23e0007d30 comp rx=0 tx=0).stop 2023-10-10T21:02:59.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 shutdown_connections 2023-10-10T21:02:59.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23d8066f30 0x7f23d80693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23f8158df0 0x7f23f806e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23e4005e60 0x7f23f80a7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 --2- 172.21.15.154:0/3856311067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23f8151cf0 0x7f23f81588b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 >> 172.21.15.154:0/3856311067 conn(0x7f23f806a320 msgr2=0x7f23f815f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:59.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 shutdown_connections 2023-10-10T21:02:59.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.030+0000 7f23fe9ff700 1 -- 172.21.15.154:0/3856311067 wait complete. 2023-10-10T21:02:59.049 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T21:02:59.050 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:02:59.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.231+0000 7f1cb55ff700 1 Processor -- start 2023-10-10T21:02:59.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.231+0000 7f1cb55ff700 1 -- start start 2023-10-10T21:02:59.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1cb55ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1cb0155c10 0x7f1cb0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1cb55ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1cb00ac230 0x7f1cb00ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1cb55ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb00ad930 con 0x7f1cb01568a0 2023-10-10T21:02:59.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1cb55ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb00acd20 con 0x7f1cb0155c10 2023-10-10T21:02:59.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1cb55ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb00ad000 con 0x7f1cb00ac230 2023-10-10T21:02:59.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1caeffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1cb0155c10 0x7f1cb0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1caeffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1cb0155c10 0x7f1cb0155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40706/0 (socket says 172.21.15.154:40706) 2023-10-10T21:02:59.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1caeffd700 1 -- 172.21.15.154:0/1370015305 learned_addr learned my addr 172.21.15.154:0/1370015305 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:59.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1ca7fff700 1 --2- 172.21.15.154:0/1370015305 >> v2:172.21.15.179:3300/0 conn(0x7f1cb00ac230 0x7f1cb00ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1caeffd700 1 -- 172.21.15.154:0/1370015305 >> v2:172.21.15.179:3300/0 conn(0x7f1cb00ac230 msgr2=0x7f1cb00ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:59.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1caeffd700 1 --2- 172.21.15.154:0/1370015305 >> v2:172.21.15.179:3300/0 conn(0x7f1cb00ac230 0x7f1cb00ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.233+0000 7f1caeffd700 1 -- 172.21.15.154:0/1370015305 >> v1:172.21.15.179:6789/0 conn(0x7f1cb01568a0 legacy=0x7f1cb0156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.234+0000 7f1caeffd700 1 -- 172.21.15.154:0/1370015305 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb00ad2e0 con 0x7f1cb0155c10 2023-10-10T21:02:59.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.234+0000 7f1caeffd700 1 --2- 172.21.15.154:0/1370015305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 0x7f1cb0155fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0065bb0 tx=0x7f1ca0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0782d89620cf664 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:59.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.234+0000 7f1cae7fc700 1 -- 172.21.15.154:0/1370015305 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0009e70 con 0x7f1cb0155c10 2023-10-10T21:02:59.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.234+0000 7f1cae7fc700 1 -- 172.21.15.154:0/1370015305 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca000b860 con 0x7f1cb0155c10 2023-10-10T21:02:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.234+0000 7f1cae7fc700 1 -- 172.21.15.154:0/1370015305 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca000bc00 con 0x7f1cb0155c10 2023-10-10T21:02:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.235+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1370015305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 msgr2=0x7f1cb0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.235+0000 7f1cb55ff700 1 --2- 172.21.15.154:0/1370015305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 0x7f1cb0155fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0065bb0 tx=0x7f1ca0009250 comp rx=0 tx=0).stop 2023-10-10T21:02:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.235+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1370015305 shutdown_connections 2023-10-10T21:02:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.235+0000 7f1cb55ff700 1 --2- 172.21.15.154:0/1370015305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 0x7f1cb0155fe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.235+0000 7f1cb55ff700 1 --2- 172.21.15.154:0/1370015305 >> v2:172.21.15.179:3300/0 conn(0x7f1cb00ac230 0x7f1cb00ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.235+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1370015305 >> 172.21.15.154:0/1370015305 conn(0x7f1cb006a320 msgr2=0x7f1cb00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:59.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.235+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1370015305 shutdown_connections 2023-10-10T21:02:59.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.235+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1370015305 wait complete. 2023-10-10T21:02:59.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.236+0000 7f1cb55ff700 1 Processor -- start 2023-10-10T21:02:59.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.236+0000 7f1cb55ff700 1 -- start start 2023-10-10T21:02:59.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.237+0000 7f1cb55ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb00ac230 0x7f1cb0156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.237+0000 7f1cb55ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 0x7f1cb0142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.237+0000 7f1cb55ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cb01568a0 0x7f1cb0159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.237+0000 7f1cb55ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01585b0 con 0x7f1cb0155c10 2023-10-10T21:02:59.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.237+0000 7f1cb55ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01571d0 con 0x7f1cb00ac230 2023-10-10T21:02:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.237+0000 7f1cb55ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb015ba40 con 0x7f1cb01568a0 2023-10-10T21:02:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.237+0000 7f1ca7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 0x7f1cb0142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 0x7f1cb0142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40718/0 (socket says 172.21.15.154:40718) 2023-10-10T21:02:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca7fff700 1 -- 172.21.15.154:0/1363637463 learned_addr learned my addr 172.21.15.154:0/1363637463 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1caeffd700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb00ac230 0x7f1cb0156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1caf7fe700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cb01568a0 0x7f1cb0159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca7fff700 1 -- 172.21.15.154:0/1363637463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cb01568a0 msgr2=0x7f1cb0159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca7fff700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cb01568a0 0x7f1cb0159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca7fff700 1 -- 172.21.15.154:0/1363637463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb00ac230 msgr2=0x7f1cb0156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca7fff700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb00ac230 0x7f1cb0156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca7fff700 1 -- 172.21.15.154:0/1363637463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca00094f0 con 0x7f1cb0155c10 2023-10-10T21:02:59.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca7fff700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 0x7f1cb0142f30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800ec80 tx=0x7f1c980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:59.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca6ffd700 1 -- 172.21.15.154:0/1363637463 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800c850 con 0x7f1cb0155c10 2023-10-10T21:02:59.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca6ffd700 1 -- 172.21.15.154:0/1363637463 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9800c9b0 con 0x7f1cb0155c10 2023-10-10T21:02:59.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.238+0000 7f1ca6ffd700 1 -- 172.21.15.154:0/1363637463 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800cd50 con 0x7f1cb0155c10 2023-10-10T21:02:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.239+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb015bd20 con 0x7f1cb0155c10 2023-10-10T21:02:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.239+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb0158240 con 0x7f1cb0155c10 2023-10-10T21:02:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.240+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb0158760 con 0x7f1cb0155c10 2023-10-10T21:02:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.241+0000 7f1ca6ffd700 1 -- 172.21.15.154:0/1363637463 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c98013680 con 0x7f1cb0155c10 2023-10-10T21:02:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.241+0000 7f1ca6ffd700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1c90066f30 0x7f1c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.241+0000 7f1ca6ffd700 1 -- 172.21.15.154:0/1363637463 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c98084830 con 0x7f1cb0155c10 2023-10-10T21:02:59.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.242+0000 7f1caeffd700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1c90066f30 0x7f1c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.242+0000 7f1caeffd700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1c90066f30 0x7f1c900693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0065bb0 tx=0x7f1ca0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.245+0000 7f1ca6ffd700 1 -- 172.21.15.154:0/1363637463 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cb0158760 con 0x7f1cb0155c10 2023-10-10T21:02:59.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.481+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cb004c3c0 con 0x7f1cb0155c10 2023-10-10T21:02:59.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.481+0000 7f1ca6ffd700 1 -- 172.21.15.154:0/1363637463 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f1c98051a00 con 0x7f1cb0155c10 2023-10-10T21:02:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:59.484 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439513038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439513038},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439513038}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1179223321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1179223321},{"type":"v1","addr":"172.21.15.154:6836","nonce":1179223321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4116873553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4116873553},{"type":"v1","addr":"172.21.15.179:6835","nonce":4116873553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:02:19.159716+0000","modified":"2023-10-10T21:02:22.851729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6833/2053231138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2053231138},{"type":"v1","addr":"172.21.15.179:6833","nonce":2053231138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-10T21:02:59.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1c90066f30 msgr2=0x7f1c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1c90066f30 0x7f1c900693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0065bb0 tx=0x7f1ca0017000 comp rx=0 tx=0).stop 2023-10-10T21:02:59.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 msgr2=0x7f1cb0142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 0x7f1cb0142f30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800ec80 tx=0x7f1c980091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 shutdown_connections 2023-10-10T21:02:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1c90066f30 0x7f1c900693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cb01568a0 0x7f1cb0159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb00ac230 0x7f1cb0156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 --2- 172.21.15.154:0/1363637463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cb0155c10 0x7f1cb0142f30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 >> 172.21.15.154:0/1363637463 conn(0x7f1cb006a320 msgr2=0x7f1cb0153080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 shutdown_connections 2023-10-10T21:02:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.484+0000 7f1cb55ff700 1 -- 172.21.15.154:0/1363637463 wait complete. 2023-10-10T21:02:59.489 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-10-10T21:02:59.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:02:59.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.685+0000 7fd7d5fff700 1 Processor -- start 2023-10-10T21:02:59.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.685+0000 7fd7d5fff700 1 -- start start 2023-10-10T21:02:59.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.686+0000 7fd7d5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159890 0x7fd7d015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.686+0000 7fd7d5fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd7d0159c60 0x7fd7d015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.686+0000 7fd7d5fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d015a160 con 0x7fd7d015db10 2023-10-10T21:02:59.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.686+0000 7fd7d5fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d00d13a0 con 0x7fd7d0159c60 2023-10-10T21:02:59.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.686+0000 7fd7d5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d015e140 con 0x7fd7d0159890 2023-10-10T21:02:59.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.687+0000 7fd7ceffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd7d0159c60 0x7fd7d015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.687+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159890 0x7fd7d015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.687+0000 7fd7ceffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd7d0159c60 0x7fd7d015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:60320/0 (socket says 172.21.15.154:60320) 2023-10-10T21:02:59.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.687+0000 7fd7ceffd700 1 -- 172.21.15.154:0/2694185172 learned_addr learned my addr 172.21.15.154:0/2694185172 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:59.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.687+0000 7fd7cffff700 1 --1- 172.21.15.154:0/2694185172 >> v1:172.21.15.179:6789/0 conn(0x7fd7d015db10 0x7fd7d0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:52186/0 (socket says 172.21.15.154:52186) 2023-10-10T21:02:59.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.688+0000 7fd7ceffd700 1 -- 172.21.15.154:0/2694185172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159890 msgr2=0x7fd7d015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:02:59.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.688+0000 7fd7ceffd700 1 --2- 172.21.15.154:0/2694185172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159890 0x7fd7d015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.688+0000 7fd7ceffd700 1 -- 172.21.15.154:0/2694185172 >> v1:172.21.15.179:6789/0 conn(0x7fd7d015db10 legacy=0x7fd7d0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.688+0000 7fd7ceffd700 1 -- 172.21.15.154:0/2694185172 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d015a3d0 con 0x7fd7d0159c60 2023-10-10T21:02:59.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.688+0000 7fd7ce7fc700 1 -- 172.21.15.154:0/2694185172 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165858039 0 0) 0x7fd7d015a160 con 0x7fd7d015db10 2023-10-10T21:02:59.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.688+0000 7fd7ceffd700 1 --2- 172.21.15.154:0/2694185172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159c60 0x7fd7d015d5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40099b0 tx=0x7fd7c4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3166bf29dbb0013 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:59.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.688+0000 7fd7ce7fc700 1 -- 172.21.15.154:0/2694185172 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4009ea0 con 0x7fd7d0159c60 2023-10-10T21:02:59.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.688+0000 7fd7ce7fc700 1 -- 172.21.15.154:0/2694185172 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c400b860 con 0x7fd7d0159c60 2023-10-10T21:02:59.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.688+0000 7fd7ce7fc700 1 -- 172.21.15.154:0/2694185172 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c400bc00 con 0x7fd7d0159c60 2023-10-10T21:02:59.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.689+0000 7fd7d5fff700 1 -- 172.21.15.154:0/2694185172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159c60 msgr2=0x7fd7d015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.689+0000 7fd7d5fff700 1 --2- 172.21.15.154:0/2694185172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159c60 0x7fd7d015d5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40099b0 tx=0x7fd7c4009250 comp rx=0 tx=0).stop 2023-10-10T21:02:59.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.689+0000 7fd7d5fff700 1 -- 172.21.15.154:0/2694185172 shutdown_connections 2023-10-10T21:02:59.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.689+0000 7fd7d5fff700 1 --2- 172.21.15.154:0/2694185172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159890 0x7fd7d015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.689+0000 7fd7d5fff700 1 --2- 172.21.15.154:0/2694185172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159c60 0x7fd7d015d5d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.689+0000 7fd7d5fff700 1 -- 172.21.15.154:0/2694185172 >> 172.21.15.154:0/2694185172 conn(0x7fd7d0068e20 msgr2=0x7fd7d00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:59.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.689+0000 7fd7d5fff700 1 -- 172.21.15.154:0/2694185172 shutdown_connections 2023-10-10T21:02:59.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.689+0000 7fd7d5fff700 1 -- 172.21.15.154:0/2694185172 wait complete. 2023-10-10T21:02:59.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.690+0000 7fd7d5fff700 1 Processor -- start 2023-10-10T21:02:59.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.690+0000 7fd7d5fff700 1 -- start start 2023-10-10T21:02:59.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.691+0000 7fd7d5fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159890 0x7fd7d015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.691+0000 7fd7d5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159c60 0x7fd7d014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.691+0000 7fd7d5fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d015db10 0x7fd7d01537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.691+0000 7fd7d5fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00ce4e0 con 0x7fd7d015db10 2023-10-10T21:02:59.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.691+0000 7fd7d5fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d016deb0 con 0x7fd7d0159890 2023-10-10T21:02:59.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.691+0000 7fd7d5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d016d2c0 con 0x7fd7d0159c60 2023-10-10T21:02:59.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.691+0000 7fd7cffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d015db10 0x7fd7d01537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159890 0x7fd7d015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d015db10 0x7fd7d01537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40730/0 (socket says 172.21.15.154:40730) 2023-10-10T21:02:59.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cffff700 1 -- 172.21.15.154:0/1878784379 learned_addr learned my addr 172.21.15.154:0/1878784379 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:02:59.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7ceffd700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159c60 0x7fd7d014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cffff700 1 -- 172.21.15.154:0/1878784379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159c60 msgr2=0x7fd7d014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cffff700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159c60 0x7fd7d014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cffff700 1 -- 172.21.15.154:0/1878784379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159890 msgr2=0x7fd7d015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cffff700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159890 0x7fd7d015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cffff700 1 -- 172.21.15.154:0/1878784379 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c40094f0 con 0x7fd7d015db10 2023-10-10T21:02:59.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cf7fe700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159890 0x7fd7d015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:02:59.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7cffff700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d015db10 0x7fd7d01537c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800ccc0 tx=0x7fd7c8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:59.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7b77fe700 1 -- 172.21.15.154:0/1878784379 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8005df0 con 0x7fd7d015db10 2023-10-10T21:02:59.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.692+0000 7fd7b77fe700 1 -- 172.21.15.154:0/1878784379 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c800a600 con 0x7fd7d015db10 2023-10-10T21:02:59.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.693+0000 7fd7b77fe700 1 -- 172.21.15.154:0/1878784379 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c800a9c0 con 0x7fd7d015db10 2023-10-10T21:02:59.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.693+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d016d580 con 0x7fd7d015db10 2023-10-10T21:02:59.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.693+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d016db40 con 0x7fd7d015db10 2023-10-10T21:02:59.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.694+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d016e240 con 0x7fd7d015db10 2023-10-10T21:02:59.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.695+0000 7fd7b77fe700 1 -- 172.21.15.154:0/1878784379 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7c80070f0 con 0x7fd7d015db10 2023-10-10T21:02:59.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.695+0000 7fd7b77fe700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd7bc066f30 0x7fd7bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:02:59.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.695+0000 7fd7b77fe700 1 -- 172.21.15.154:0/1878784379 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7c8084600 con 0x7fd7d015db10 2023-10-10T21:02:59.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.696+0000 7fd7cf7fe700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd7bc066f30 0x7fd7bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:02:59.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.696+0000 7fd7cf7fe700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd7bc066f30 0x7fd7bc0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0011480 tx=0x7fd7c00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:02:59.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.699+0000 7fd7b77fe700 1 -- 172.21.15.154:0/1878784379 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7c8051900 con 0x7fd7d015db10 2023-10-10T21:02:59.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.936+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7d016e020 con 0x7fd7d015db10 2023-10-10T21:02:59.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.937+0000 7fd7b77fe700 1 -- 172.21.15.154:0/1878784379 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7fd7c8054f20 con 0x7fd7d015db10 2023-10-10T21:02:59.939 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:02:59.939 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439513038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439513038},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439513038}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1179223321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1179223321},{"type":"v1","addr":"172.21.15.154:6836","nonce":1179223321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4116873553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4116873553},{"type":"v1","addr":"172.21.15.179:6835","nonce":4116873553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:02:19.159716+0000","modified":"2023-10-10T21:02:22.851729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6833/2053231138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2053231138},{"type":"v1","addr":"172.21.15.179:6833","nonce":2053231138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-10T21:02:59.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.939+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd7bc066f30 msgr2=0x7fd7bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.939+0000 7fd7d5fff700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd7bc066f30 0x7fd7bc0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0011480 tx=0x7fd7c00091a0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.939+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d015db10 msgr2=0x7fd7d01537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:02:59.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.939+0000 7fd7d5fff700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d015db10 0x7fd7d01537c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800ccc0 tx=0x7fd7c8001a70 comp rx=0 tx=0).stop 2023-10-10T21:02:59.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.940+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 shutdown_connections 2023-10-10T21:02:59.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.940+0000 7fd7d5fff700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d015db10 0x7fd7d01537c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.940+0000 7fd7d5fff700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d0159890 0x7fd7d015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.940+0000 7fd7d5fff700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd7bc066f30 0x7fd7bc0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.940+0000 7fd7d5fff700 1 --2- 172.21.15.154:0/1878784379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d0159c60 0x7fd7d014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:02:59.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.940+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 >> 172.21.15.154:0/1878784379 conn(0x7fd7d0068e20 msgr2=0x7fd7d015c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:02:59.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.940+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 shutdown_connections 2023-10-10T21:02:59.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:02:59.940+0000 7fd7d5fff700 1 -- 172.21.15.154:0/1878784379 wait complete. 2023-10-10T21:02:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-10-10T21:02:59.958 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:03:00.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.139+0000 7f479d19d700 1 Processor -- start 2023-10-10T21:03:00.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.140+0000 7f479d19d700 1 -- start start 2023-10-10T21:03:00.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.141+0000 7f479d19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4798150180 0x7f4798157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.141+0000 7f479d19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47980c7410 0x7f4798069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.141+0000 7f479d19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479806e2a0 con 0x7f4798150550 2023-10-10T21:03:00.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.141+0000 7f479d19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479806b2e0 con 0x7f4798150180 2023-10-10T21:03:00.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.141+0000 7f479d19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47980c78e0 con 0x7f47980c7410 2023-10-10T21:03:00.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.141+0000 7f479c99c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47980c7410 0x7f4798069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.141+0000 7f4797fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4798150180 0x7f4798157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f4797fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4798150180 0x7f4798157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:60346/0 (socket says 172.21.15.154:60346) 2023-10-10T21:03:00.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f4797fff700 1 -- 172.21.15.154:0/842594699 learned_addr learned my addr 172.21.15.154:0/842594699 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:00.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f479c99c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47980c7410 0x7f4798069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:52230/0 (socket says 172.21.15.154:52230) 2023-10-10T21:03:00.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f4796ffd700 1 -- 172.21.15.154:0/842594699 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911035396 0 0) 0x7f479806e2a0 con 0x7f4798150550 2023-10-10T21:03:00.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f4796ffd700 1 -- 172.21.15.154:0/842594699 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4780003570 con 0x7f4798150550 2023-10-10T21:03:00.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f4797fff700 1 -- 172.21.15.154:0/842594699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47980c7410 msgr2=0x7f4798069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:00.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f4797fff700 1 --2- 172.21.15.154:0/842594699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47980c7410 0x7f4798069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f4797fff700 1 -- 172.21.15.154:0/842594699 >> v1:172.21.15.179:6789/0 conn(0x7f4798150550 legacy=0x7f47980c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f4797fff700 1 -- 172.21.15.154:0/842594699 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980c7bc0 con 0x7f4798150180 2023-10-10T21:03:00.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f479c99c700 1 --2- 172.21.15.154:0/842594699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47980c7410 0x7f4798069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:00.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.142+0000 7f4797fff700 1 --2- 172.21.15.154:0/842594699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 0x7f4798157770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f47880099b0 tx=0x7f4788009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25287f36f6ce9450 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:00.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f4796ffd700 1 -- 172.21.15.154:0/842594699 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478800b680 con 0x7f4798150180 2023-10-10T21:03:00.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f4796ffd700 1 -- 172.21.15.154:0/842594699 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478800b7e0 con 0x7f4798150180 2023-10-10T21:03:00.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f4796ffd700 1 -- 172.21.15.154:0/842594699 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478800bb60 con 0x7f4798150180 2023-10-10T21:03:00.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f479d19d700 1 -- 172.21.15.154:0/842594699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 msgr2=0x7f4798157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f479d19d700 1 --2- 172.21.15.154:0/842594699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 0x7f4798157770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f47880099b0 tx=0x7f4788009250 comp rx=0 tx=0).stop 2023-10-10T21:03:00.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f479d19d700 1 -- 172.21.15.154:0/842594699 shutdown_connections 2023-10-10T21:03:00.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f479d19d700 1 --2- 172.21.15.154:0/842594699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47980c7410 0x7f4798069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f479d19d700 1 --2- 172.21.15.154:0/842594699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 0x7f4798157770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f479d19d700 1 -- 172.21.15.154:0/842594699 >> 172.21.15.154:0/842594699 conn(0x7f47980cc1f0 msgr2=0x7f47980cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:00.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f479d19d700 1 -- 172.21.15.154:0/842594699 shutdown_connections 2023-10-10T21:03:00.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.143+0000 7f479d19d700 1 -- 172.21.15.154:0/842594699 wait complete. 2023-10-10T21:03:00.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.145+0000 7f479d19d700 1 Processor -- start 2023-10-10T21:03:00.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.145+0000 7f479d19d700 1 -- start start 2023-10-10T21:03:00.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f479d19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47980c7410 0x7f4798154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f479d19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 0x7f47980af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f479d19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4798150550 0x7f47980afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f479d19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980c1880 con 0x7f47980c7410 2023-10-10T21:03:00.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f479d19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980ca480 con 0x7f4798150180 2023-10-10T21:03:00.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f479d19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47980b00e0 con 0x7f4798150550 2023-10-10T21:03:00.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f4797fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47980c7410 0x7f4798154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f4797fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47980c7410 0x7f4798154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40744/0 (socket says 172.21.15.154:40744) 2023-10-10T21:03:00.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f4797fff700 1 -- 172.21.15.154:0/1087724955 learned_addr learned my addr 172.21.15.154:0/1087724955 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:00.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f47977fe700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 0x7f47980af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f4797fff700 1 -- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4798150550 msgr2=0x7f47980afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f479c99c700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4798150550 0x7f47980afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f4797fff700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4798150550 0x7f47980afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f4797fff700 1 -- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 msgr2=0x7f47980af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f4797fff700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 0x7f47980af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f4797fff700 1 -- 172.21.15.154:0/1087724955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479000ab30 con 0x7f47980c7410 2023-10-10T21:03:00.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f47977fe700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 0x7f47980af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:00.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.146+0000 7f479c99c700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4798150550 0x7f47980afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:00.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.147+0000 7f4797fff700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47980c7410 0x7f4798154f80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f479806fe40 tx=0x7f4788017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:00.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.147+0000 7f477ffff700 1 -- 172.21.15.154:0/1087724955 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478800b950 con 0x7f47980c7410 2023-10-10T21:03:00.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.147+0000 7f477ffff700 1 -- 172.21.15.154:0/1087724955 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478800bad0 con 0x7f47980c7410 2023-10-10T21:03:00.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.147+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47880094f0 con 0x7f47980c7410 2023-10-10T21:03:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.147+0000 7f477ffff700 1 -- 172.21.15.154:0/1087724955 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478801a680 con 0x7f47980c7410 2023-10-10T21:03:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.147+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47980b06a0 con 0x7f47980c7410 2023-10-10T21:03:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.148+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479804c3c0 con 0x7f47980c7410 2023-10-10T21:03:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.149+0000 7f477ffff700 1 -- 172.21.15.154:0/1087724955 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f478801aa30 con 0x7f47980c7410 2023-10-10T21:03:00.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.150+0000 7f477ffff700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4784066f30 0x7f47840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.151+0000 7f477ffff700 1 -- 172.21.15.154:0/1087724955 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47880862a0 con 0x7f47980c7410 2023-10-10T21:03:00.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.151+0000 7f47977fe700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4784066f30 0x7f47840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.151+0000 7f47977fe700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4784066f30 0x7f47840693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47980ab930 tx=0x7f478c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:00.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.155+0000 7f477ffff700 1 -- 172.21.15.154:0/1087724955 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4788053510 con 0x7f47980c7410 2023-10-10T21:03:00.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.344+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f479806ada0 con 0x7f47980c7410 2023-10-10T21:03:00.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.345+0000 7f477ffff700 1 -- 172.21.15.154:0/1087724955 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f4788056b30 con 0x7f47980c7410 2023-10-10T21:03:00.348 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:00.348 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:02:20.698164+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:02:17.271178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-10T21:02:18.145561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:03:00.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4784066f30 msgr2=0x7f47840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4784066f30 0x7f47840693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47980ab930 tx=0x7f478c009040 comp rx=0 tx=0).stop 2023-10-10T21:03:00.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47980c7410 msgr2=0x7f4798154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47980c7410 0x7f4798154f80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f479806fe40 tx=0x7f4788017000 comp rx=0 tx=0).stop 2023-10-10T21:03:00.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 shutdown_connections 2023-10-10T21:03:00.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4784066f30 0x7f47840693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4798150550 0x7f47980afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47980c7410 0x7f4798154f80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 --2- 172.21.15.154:0/1087724955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4798150180 0x7f47980af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 >> 172.21.15.154:0/1087724955 conn(0x7f47980cc1f0 msgr2=0x7f4798156290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:00.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 shutdown_connections 2023-10-10T21:03:00.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.348+0000 7f479d19d700 1 -- 172.21.15.154:0/1087724955 wait complete. 2023-10-10T21:03:00.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T21:03:00.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.550+0000 7fcaabfff700 1 Processor -- start 2023-10-10T21:03:00.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.550+0000 7fcaabfff700 1 -- start start 2023-10-10T21:03:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.551+0000 7fcaabfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.551+0000 7fcaabfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa40cc300 con 0x7fcaa40cbf30 2023-10-10T21:03:00.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.551+0000 7fcaabfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa40ad370 con 0x7fcaa40b1420 2023-10-10T21:03:00.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.551+0000 7fcaabfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa4156bf0 con 0x7fcaa40ccf90 2023-10-10T21:03:00.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaa9d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcaa40cbf30 0x7fcaa40b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59656/0 (socket says 172.21.15.154:59656) 2023-10-10T21:03:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaa9d9b700 1 -- 172.21.15.154:0/69001637 learned_addr learned my addr 172.21.15.154:0/69001637 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaaa59c700 1 --2- 172.21.15.154:0/69001637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaa8d99700 1 -- 172.21.15.154:0/69001637 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653943280 0 0) 0x7fcaa40cc300 con 0x7fcaa40cbf30 2023-10-10T21:03:00.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaa8d99700 1 -- 172.21.15.154:0/69001637 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca90003570 con 0x7fcaa40cbf30 2023-10-10T21:03:00.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaa8d99700 1 -- 172.21.15.154:0/69001637 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868896174 0 0) 0x7fcaa40ad370 con 0x7fcaa40b1420 2023-10-10T21:03:00.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaa8d99700 1 -- 172.21.15.154:0/69001637 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaa40cc300 con 0x7fcaa40b1420 2023-10-10T21:03:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaaa59c700 1 -- 172.21.15.154:0/69001637 >> v1:172.21.15.179:6789/0 conn(0x7fcaa40b1420 legacy=0x7fcaa40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaaa59c700 1 -- 172.21.15.154:0/69001637 >> v1:172.21.15.154:6789/0 conn(0x7fcaa40cbf30 legacy=0x7fcaa40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.552+0000 7fcaaa59c700 1 -- 172.21.15.154:0/69001637 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40ad650 con 0x7fcaa40ccf90 2023-10-10T21:03:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.553+0000 7fcaaa59c700 1 --2- 172.21.15.154:0/69001637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa40ae410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009e90 tx=0x7fca9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=636009295e744f07 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.553+0000 7fcaa8d99700 1 -- 172.21.15.154:0/69001637 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c00e070 con 0x7fcaa40ccf90 2023-10-10T21:03:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.553+0000 7fcaa8d99700 1 -- 172.21.15.154:0/69001637 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c00bb80 con 0x7fcaa40ccf90 2023-10-10T21:03:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.553+0000 7fcaa8d99700 1 -- 172.21.15.154:0/69001637 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c012430 con 0x7fcaa40ccf90 2023-10-10T21:03:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.553+0000 7fcaabfff700 1 -- 172.21.15.154:0/69001637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 msgr2=0x7fcaa40ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.553+0000 7fcaabfff700 1 --2- 172.21.15.154:0/69001637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa40ae410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009e90 tx=0x7fca9c009780 comp rx=0 tx=0).stop 2023-10-10T21:03:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.553+0000 7fcaabfff700 1 -- 172.21.15.154:0/69001637 shutdown_connections 2023-10-10T21:03:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.553+0000 7fcaabfff700 1 --2- 172.21.15.154:0/69001637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa40ae410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.553+0000 7fcaabfff700 1 -- 172.21.15.154:0/69001637 >> 172.21.15.154:0/69001637 conn(0x7fcaa406a320 msgr2=0x7fcaa40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.554+0000 7fcaabfff700 1 -- 172.21.15.154:0/69001637 shutdown_connections 2023-10-10T21:03:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.554+0000 7fcaabfff700 1 -- 172.21.15.154:0/69001637 wait complete. 2023-10-10T21:03:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.555+0000 7fcaabfff700 1 Processor -- start 2023-10-10T21:03:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.555+0000 7fcaabfff700 1 -- start start 2023-10-10T21:03:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaabfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa40b1420 0x7fcaa4153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaabfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa40cbf30 0x7fcaa40a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaabfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa4165f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaabfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa4153b60 con 0x7fcaa40b1420 2023-10-10T21:03:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaabfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40abec0 con 0x7fcaa40cbf30 2023-10-10T21:03:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaabfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40a5ea0 con 0x7fcaa40ccf90 2023-10-10T21:03:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaa9d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa40b1420 0x7fcaa4153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaa9d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa40b1420 0x7fcaa4153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40746/0 (socket says 172.21.15.154:40746) 2023-10-10T21:03:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaa9d9b700 1 -- 172.21.15.154:0/3438801017 learned_addr learned my addr 172.21.15.154:0/3438801017 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaa9d9b700 1 -- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 msgr2=0x7fcaa4165f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.556+0000 7fcaaa59c700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa4165f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaa9d9b700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa4165f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaa9d9b700 1 -- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa40cbf30 msgr2=0x7fcaa40a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaa959a700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa40cbf30 0x7fcaa40a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaa9d9b700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa40cbf30 0x7fcaa40a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaa9d9b700 1 -- 172.21.15.154:0/3438801017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c009a20 con 0x7fcaa40b1420 2023-10-10T21:03:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaaa59c700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa4165f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaa959a700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa40cbf30 0x7fcaa40a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:00.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaa9d9b700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa40b1420 0x7fcaa4153620 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000c790 tx=0x7fcaa0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:00.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fca99ffb700 1 -- 172.21.15.154:0/3438801017 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0005b30 con 0x7fcaa40b1420 2023-10-10T21:03:00.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fca99ffb700 1 -- 172.21.15.154:0/3438801017 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa0005c90 con 0x7fcaa40b1420 2023-10-10T21:03:00.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40a6180 con 0x7fcaa40b1420 2023-10-10T21:03:00.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fca99ffb700 1 -- 172.21.15.154:0/3438801017 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0007300 con 0x7fcaa40b1420 2023-10-10T21:03:00.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.557+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa40abae0 con 0x7fcaa40b1420 2023-10-10T21:03:00.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.558+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa404c3c0 con 0x7fcaa40b1420 2023-10-10T21:03:00.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.559+0000 7fca99ffb700 1 -- 172.21.15.154:0/3438801017 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcaa001b400 con 0x7fcaa40b1420 2023-10-10T21:03:00.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.560+0000 7fca99ffb700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fca88066f30 0x7fca880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:00.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.560+0000 7fca99ffb700 1 -- 172.21.15.154:0/3438801017 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcaa0084110 con 0x7fcaa40b1420 2023-10-10T21:03:00.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.560+0000 7fcaa959a700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fca88066f30 0x7fca880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.561+0000 7fcaa959a700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fca88066f30 0x7fca880693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca94007fd0 tx=0x7fca94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.564+0000 7fca99ffb700 1 -- 172.21.15.154:0/3438801017 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaa0051410 con 0x7fcaa40b1420 2023-10-10T21:03:00.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.797+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcaa40678d0 con 0x7fcaa40b1420 2023-10-10T21:03:00.799 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T21:03:00.798+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T21:03:00.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.803+0000 7fca99ffb700 1 -- 172.21.15.154:0/3438801017 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcaa00076f0 con 0x7fcaa40b1420 2023-10-10T21:03:00.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.805+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fca88066f30 msgr2=0x7fca880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.805+0000 7fcaabfff700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fca88066f30 0x7fca880693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca94007fd0 tx=0x7fca94009040 comp rx=0 tx=0).stop 2023-10-10T21:03:00.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.805+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa40b1420 msgr2=0x7fcaa4153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:00.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.805+0000 7fcaabfff700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa40b1420 0x7fcaa4153620 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000c790 tx=0x7fcaa0007ea0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.806+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 shutdown_connections 2023-10-10T21:03:00.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.806+0000 7fcaabfff700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fca88066f30 0x7fca880693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.806+0000 7fcaabfff700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa40ccf90 0x7fcaa4165f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.806+0000 7fcaabfff700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaa40b1420 0x7fcaa4153620 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.806+0000 7fcaabfff700 1 --2- 172.21.15.154:0/3438801017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa40cbf30 0x7fcaa40a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:00.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.806+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 >> 172.21.15.154:0/3438801017 conn(0x7fcaa406a320 msgr2=0x7fcaa4155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:00.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.806+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 shutdown_connections 2023-10-10T21:03:00.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:00.806+0000 7fcaabfff700 1 -- 172.21.15.154:0/3438801017 wait complete. 2023-10-10T21:03:00.809 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T21:03:00.811 INFO:tasks.ceph.mds.b.smithi179.stderr: -2054> 2023-10-10T21:02:20.434+0000 7f1d663f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:03:00.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T21:03:00.853 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:03:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.008+0000 7fe026fff700 1 Processor -- start 2023-10-10T21:03:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.008+0000 7fe026fff700 1 -- start start 2023-10-10T21:03:01.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe026fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe020154160 0x7fe0201577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:01.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe026fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0200ca120 0x7fe0200c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:01.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe026fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe020154530 0x7fe0200c8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:01.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe026fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02015b2e0 con 0x7fe020154530 2023-10-10T21:03:01.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe026fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02015a6d0 con 0x7fe020154160 2023-10-10T21:03:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe026fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02015a9b0 con 0x7fe0200ca120 2023-10-10T21:03:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe02559c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe020154530 0x7fe0200c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe02559c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe020154530 0x7fe0200c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40758/0 (socket says 172.21.15.154:40758) 2023-10-10T21:03:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe02559c700 1 -- 172.21.15.154:0/2678405753 learned_addr learned my addr 172.21.15.154:0/2678405753 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe01ffff700 1 --2- 172.21.15.154:0/2678405753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0200ca120 0x7fe0200c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe024d9b700 1 --2- 172.21.15.154:0/2678405753 >> v2:172.21.15.179:3300/0 conn(0x7fe020154160 0x7fe0201577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe02559c700 1 -- 172.21.15.154:0/2678405753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0200ca120 msgr2=0x7fe0200c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe02559c700 1 --2- 172.21.15.154:0/2678405753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0200ca120 0x7fe0200c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe02559c700 1 -- 172.21.15.154:0/2678405753 >> v2:172.21.15.179:3300/0 conn(0x7fe020154160 msgr2=0x7fe0201577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe02559c700 1 --2- 172.21.15.154:0/2678405753 >> v2:172.21.15.179:3300/0 conn(0x7fe020154160 0x7fe0201577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.010+0000 7fe02559c700 1 -- 172.21.15.154:0/2678405753 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02015ac90 con 0x7fe020154530 2023-10-10T21:03:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.011+0000 7fe02559c700 1 --2- 172.21.15.154:0/2678405753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe020154530 0x7fe0200c8710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe020064270 tx=0x7fe018009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad82106335fe24c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.011+0000 7fe01f7fe700 1 -- 172.21.15.154:0/2678405753 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0180092e0 con 0x7fe020154530 2023-10-10T21:03:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.011+0000 7fe01f7fe700 1 -- 172.21.15.154:0/2678405753 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01800ba50 con 0x7fe020154530 2023-10-10T21:03:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.011+0000 7fe01f7fe700 1 -- 172.21.15.154:0/2678405753 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01800be10 con 0x7fe020154530 2023-10-10T21:03:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.011+0000 7fe026fff700 1 -- 172.21.15.154:0/2678405753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe020154530 msgr2=0x7fe0200c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.011+0000 7fe026fff700 1 --2- 172.21.15.154:0/2678405753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe020154530 0x7fe0200c8710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe020064270 tx=0x7fe018009840 comp rx=0 tx=0).stop 2023-10-10T21:03:01.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.012+0000 7fe026fff700 1 -- 172.21.15.154:0/2678405753 shutdown_connections 2023-10-10T21:03:01.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.012+0000 7fe026fff700 1 --2- 172.21.15.154:0/2678405753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe020154530 0x7fe0200c8710 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.012+0000 7fe026fff700 1 --2- 172.21.15.154:0/2678405753 >> v2:172.21.15.179:3300/0 conn(0x7fe020154160 0x7fe0201577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.012+0000 7fe026fff700 1 --2- 172.21.15.154:0/2678405753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0200ca120 0x7fe0200c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.012+0000 7fe026fff700 1 -- 172.21.15.154:0/2678405753 >> 172.21.15.154:0/2678405753 conn(0x7fe02006a360 msgr2=0x7fe0200cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.012+0000 7fe026fff700 1 -- 172.21.15.154:0/2678405753 shutdown_connections 2023-10-10T21:03:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.012+0000 7fe026fff700 1 -- 172.21.15.154:0/2678405753 wait complete. 2023-10-10T21:03:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.013+0000 7fe026fff700 1 Processor -- start 2023-10-10T21:03:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.013+0000 7fe026fff700 1 -- start start 2023-10-10T21:03:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe026fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0200ca120 0x7fe020153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe026fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe020154160 0x7fe02015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe026fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe020154530 0x7fe02015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe026fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201536b0 con 0x7fe0200ca120 2023-10-10T21:03:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe026fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200ab900 con 0x7fe020154530 2023-10-10T21:03:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe026fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201568b0 con 0x7fe020154160 2023-10-10T21:03:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe024d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0200ca120 0x7fe020153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe024d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0200ca120 0x7fe020153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40760/0 (socket says 172.21.15.154:40760) 2023-10-10T21:03:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe024d9b700 1 -- 172.21.15.154:0/3072971053 learned_addr learned my addr 172.21.15.154:0/3072971053 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe02559c700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe020154530 0x7fe02015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:01.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.014+0000 7fe01ffff700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe020154160 0x7fe02015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:01.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe024d9b700 1 -- 172.21.15.154:0/3072971053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe020154160 msgr2=0x7fe02015c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:01.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe024d9b700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe020154160 0x7fe02015c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe024d9b700 1 -- 172.21.15.154:0/3072971053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe020154530 msgr2=0x7fe02015ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:01.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe024d9b700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe020154530 0x7fe02015ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe024d9b700 1 -- 172.21.15.154:0/3072971053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018009ae0 con 0x7fe0200ca120 2023-10-10T21:03:01.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe024d9b700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0200ca120 0x7fe020153170 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe01400d810 tx=0x7fe014008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:01.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe01cff9700 1 -- 172.21.15.154:0/3072971053 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0140125f0 con 0x7fe0200ca120 2023-10-10T21:03:01.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe01cff9700 1 -- 172.21.15.154:0/3072971053 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014012750 con 0x7fe0200ca120 2023-10-10T21:03:01.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe020155990 con 0x7fe0200ca120 2023-10-10T21:03:01.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe01cff9700 1 -- 172.21.15.154:0/3072971053 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014012b10 con 0x7fe0200ca120 2023-10-10T21:03:01.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.015+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe020156b00 con 0x7fe0200ca120 2023-10-10T21:03:01.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.016+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02004c3c0 con 0x7fe0200ca120 2023-10-10T21:03:01.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.017+0000 7fe01cff9700 1 -- 172.21.15.154:0/3072971053 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe014013480 con 0x7fe0200ca120 2023-10-10T21:03:01.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.018+0000 7fe01cff9700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe004066f30 0x7fe0040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:01.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.018+0000 7fe01cff9700 1 -- 172.21.15.154:0/3072971053 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe0140849f0 con 0x7fe0200ca120 2023-10-10T21:03:01.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.018+0000 7fe01ffff700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe004066f30 0x7fe0040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:01.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.019+0000 7fe01ffff700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe004066f30 0x7fe0040693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe02016d4c0 tx=0x7fe00c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:01.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.022+0000 7fe01cff9700 1 -- 172.21.15.154:0/3072971053 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe014051b70 con 0x7fe0200ca120 2023-10-10T21:03:01.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.260+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe02015af70 con 0x7fe0200ca120 2023-10-10T21:03:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.858+0000 7fe01cff9700 1 -- 172.21.15.154:0/3072971053 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe014055190 con 0x7fe0200ca120 2023-10-10T21:03:01.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe004066f30 msgr2=0x7fe0040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:01.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe004066f30 0x7fe0040693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe02016d4c0 tx=0x7fe00c008040 comp rx=0 tx=0).stop 2023-10-10T21:03:01.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0200ca120 msgr2=0x7fe020153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:01.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0200ca120 0x7fe020153170 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe01400d810 tx=0x7fe014008040 comp rx=0 tx=0).stop 2023-10-10T21:03:01.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 shutdown_connections 2023-10-10T21:03:01.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe020154530 0x7fe02015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0200ca120 0x7fe020153170 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe004066f30 0x7fe0040693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 --2- 172.21.15.154:0/3072971053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe020154160 0x7fe02015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:01.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.861+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 >> 172.21.15.154:0/3072971053 conn(0x7fe02006a360 msgr2=0x7fe0200cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:01.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.862+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 shutdown_connections 2023-10-10T21:03:01.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:01.862+0000 7fe026fff700 1 -- 172.21.15.154:0/3072971053 wait complete. 2023-10-10T21:03:01.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T21:03:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.075+0000 7fe52ab9d700 1 Processor -- start 2023-10-10T21:03:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.075+0000 7fe52ab9d700 1 -- start start 2023-10-10T21:03:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.076+0000 7fe52ab9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5240b03c0 0x7fe5240cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.076+0000 7fe52ab9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5241591e0 0x7fe524159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.076+0000 7fe52ab9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5240cfa00 con 0x7fe5240b0790 2023-10-10T21:03:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.076+0000 7fe52ab9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5240cb580 con 0x7fe5240b03c0 2023-10-10T21:03:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.076+0000 7fe52ab9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240cf160 con 0x7fe5241591e0 2023-10-10T21:03:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.076+0000 7fe529b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5240b03c0 0x7fe5240cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe529b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5240b03c0 0x7fe5240cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40764/0 (socket says 172.21.15.154:40764) 2023-10-10T21:03:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe529b9b700 1 -- 172.21.15.154:0/2529840950 learned_addr learned my addr 172.21.15.154:0/2529840950 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe529b9b700 1 -- 172.21.15.154:0/2529840950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5241591e0 msgr2=0x7fe524159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe529b9b700 1 --2- 172.21.15.154:0/2529840950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5241591e0 0x7fe524159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe529b9b700 1 -- 172.21.15.154:0/2529840950 >> v1:172.21.15.179:6789/0 conn(0x7fe5240b0790 legacy=0x7fe5240b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:02.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe529b9b700 1 -- 172.21.15.154:0/2529840950 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5240cf440 con 0x7fe5240b03c0 2023-10-10T21:03:02.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe529b9b700 1 --2- 172.21.15.154:0/2529840950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b03c0 0x7fe5240cea70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe5200099e0 tx=0x7fe520009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72456abe0db1d261 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:02.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe528b99700 1 -- 172.21.15.154:0/2529840950 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52000b7e0 con 0x7fe5240b03c0 2023-10-10T21:03:02.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe528b99700 1 -- 172.21.15.154:0/2529840950 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52000b940 con 0x7fe5240b03c0 2023-10-10T21:03:02.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.077+0000 7fe528b99700 1 -- 172.21.15.154:0/2529840950 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52000bce0 con 0x7fe5240b03c0 2023-10-10T21:03:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.078+0000 7fe52ab9d700 1 -- 172.21.15.154:0/2529840950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b03c0 msgr2=0x7fe5240cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.078+0000 7fe52ab9d700 1 --2- 172.21.15.154:0/2529840950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b03c0 0x7fe5240cea70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe5200099e0 tx=0x7fe520009250 comp rx=0 tx=0).stop 2023-10-10T21:03:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.078+0000 7fe52ab9d700 1 -- 172.21.15.154:0/2529840950 shutdown_connections 2023-10-10T21:03:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.078+0000 7fe52ab9d700 1 --2- 172.21.15.154:0/2529840950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5241591e0 0x7fe524159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.078+0000 7fe52ab9d700 1 --2- 172.21.15.154:0/2529840950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b03c0 0x7fe5240cea70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.078+0000 7fe52ab9d700 1 -- 172.21.15.154:0/2529840950 >> 172.21.15.154:0/2529840950 conn(0x7fe524063230 msgr2=0x7fe524063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.078+0000 7fe52ab9d700 1 -- 172.21.15.154:0/2529840950 shutdown_connections 2023-10-10T21:03:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.078+0000 7fe52ab9d700 1 -- 172.21.15.154:0/2529840950 wait complete. 2023-10-10T21:03:02.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.079+0000 7fe52ab9d700 1 Processor -- start 2023-10-10T21:03:02.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.080+0000 7fe52ab9d700 1 -- start start 2023-10-10T21:03:02.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.080+0000 7fe52ab9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5240b03c0 0x7fe5240ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:02.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52ab9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b0790 0x7fe524169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:02.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52ab9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5241591e0 0x7fe52415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:02.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52ab9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5241595e0 con 0x7fe5240b0790 2023-10-10T21:03:02.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52ab9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240ca9a0 con 0x7fe5241591e0 2023-10-10T21:03:02.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52ab9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe524159880 con 0x7fe5240b03c0 2023-10-10T21:03:02.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52939a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b0790 0x7fe524169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:02.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52939a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b0790 0x7fe524169ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40776/0 (socket says 172.21.15.154:40776) 2023-10-10T21:03:02.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52939a700 1 -- 172.21.15.154:0/3421600754 learned_addr learned my addr 172.21.15.154:0/3421600754 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:02.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe529b9b700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5240b03c0 0x7fe5240ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:02.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52a39c700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5241591e0 0x7fe52415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:02.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52939a700 1 -- 172.21.15.154:0/3421600754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5240b03c0 msgr2=0x7fe5240ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:02.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52939a700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5240b03c0 0x7fe5240ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52939a700 1 -- 172.21.15.154:0/3421600754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5241591e0 msgr2=0x7fe52415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:02.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52939a700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5241591e0 0x7fe52415cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.081+0000 7fe52939a700 1 -- 172.21.15.154:0/3421600754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200094f0 con 0x7fe5240b0790 2023-10-10T21:03:02.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.082+0000 7fe52939a700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b0790 0x7fe524169ff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe51400b600 tx=0x7fe5140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:02.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.082+0000 7fe519ffb700 1 -- 172.21.15.154:0/3421600754 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51400f510 con 0x7fe5240b0790 2023-10-10T21:03:02.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.082+0000 7fe519ffb700 1 -- 172.21.15.154:0/3421600754 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51400f690 con 0x7fe5240b0790 2023-10-10T21:03:02.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.082+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe524159b60 con 0x7fe5240b0790 2023-10-10T21:03:02.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.082+0000 7fe519ffb700 1 -- 172.21.15.154:0/3421600754 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51400fa50 con 0x7fe5240b0790 2023-10-10T21:03:02.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.082+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52415a120 con 0x7fe5240b0790 2023-10-10T21:03:02.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.083+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52404c3c0 con 0x7fe5240b0790 2023-10-10T21:03:02.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.084+0000 7fe519ffb700 1 -- 172.21.15.154:0/3421600754 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe51401a400 con 0x7fe5240b0790 2023-10-10T21:03:02.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.084+0000 7fe519ffb700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe508066f30 0x7fe5080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:02.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.085+0000 7fe519ffb700 1 -- 172.21.15.154:0/3421600754 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe514083fb0 con 0x7fe5240b0790 2023-10-10T21:03:02.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.085+0000 7fe529b9b700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe508066f30 0x7fe5080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:02.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.085+0000 7fe529b9b700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe508066f30 0x7fe5080693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe5200099e0 tx=0x7fe520016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:02.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.089+0000 7fe519ffb700 1 -- 172.21.15.154:0/3421600754 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5140511b0 con 0x7fe5240b0790 2023-10-10T21:03:02.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.280+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe524069e00 con 0x7fe5240b0790 2023-10-10T21:03:02.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.863+0000 7fe519ffb700 1 -- 172.21.15.154:0/3421600754 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe5140547d0 con 0x7fe5240b0790 2023-10-10T21:03:02.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.869+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe508066f30 msgr2=0x7fe5080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:02.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.869+0000 7fe52ab9d700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe508066f30 0x7fe5080693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe5200099e0 tx=0x7fe520016000 comp rx=0 tx=0).stop 2023-10-10T21:03:02.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.870+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b0790 msgr2=0x7fe524169ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:02.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.870+0000 7fe52ab9d700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b0790 0x7fe524169ff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe51400b600 tx=0x7fe5140091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.870+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 shutdown_connections 2023-10-10T21:03:02.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.870+0000 7fe52ab9d700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5241591e0 0x7fe52415cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.870+0000 7fe52ab9d700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe508066f30 0x7fe5080693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.870+0000 7fe52ab9d700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5240b03c0 0x7fe5240ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.870+0000 7fe52ab9d700 1 --2- 172.21.15.154:0/3421600754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5240b0790 0x7fe524169ff0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:02.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.870+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 >> 172.21.15.154:0/3421600754 conn(0x7fe524063230 msgr2=0x7fe5240cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:02.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.870+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 shutdown_connections 2023-10-10T21:03:02.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:02.871+0000 7fe52ab9d700 1 -- 172.21.15.154:0/3421600754 wait complete. 2023-10-10T21:03:02.877 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T21:03:02.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T21:03:03.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.081+0000 7fa71539d700 1 Processor -- start 2023-10-10T21:03:03.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.081+0000 7fa71539d700 1 -- start start 2023-10-10T21:03:03.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.082+0000 7fa71539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 0x7fa7100ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:03.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.082+0000 7fa71539d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa710153850 0x7fa7101596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:03.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.082+0000 7fa71539d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71015a050 con 0x7fa710159bf0 2023-10-10T21:03:03.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.082+0000 7fa71539d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7100aec90 con 0x7fa710153850 2023-10-10T21:03:03.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.082+0000 7fa71539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71015a480 con 0x7fa710153480 2023-10-10T21:03:03.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa714b9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa710159bf0 0x7fa7101560b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:52222/0 (socket says 172.21.15.154:52222) 2023-10-10T21:03:03.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa70f7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa710153850 0x7fa7101596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:03.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa714b9c700 1 -- 172.21.15.154:0/3252613403 learned_addr learned my addr 172.21.15.154:0/3252613403 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:03.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa70ffff700 1 --2- 172.21.15.154:0/3252613403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 0x7fa7100ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:03.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa70effd700 1 -- 172.21.15.154:0/3252613403 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562304836 0 0) 0x7fa708001490 con 0x7fa710159bf0 2023-10-10T21:03:03.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa70effd700 1 -- 172.21.15.154:0/3252613403 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f8003570 con 0x7fa710159bf0 2023-10-10T21:03:03.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa70ffff700 1 -- 172.21.15.154:0/3252613403 >> v2:172.21.15.179:3300/0 conn(0x7fa710153850 msgr2=0x7fa7101596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:03.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa70ffff700 1 --2- 172.21.15.154:0/3252613403 >> v2:172.21.15.179:3300/0 conn(0x7fa710153850 0x7fa7101596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa70ffff700 1 -- 172.21.15.154:0/3252613403 >> v1:172.21.15.179:6789/0 conn(0x7fa710159bf0 legacy=0x7fa7101560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:03.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa70ffff700 1 -- 172.21.15.154:0/3252613403 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7100afb40 con 0x7fa710153480 2023-10-10T21:03:03.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.083+0000 7fa70f7fe700 1 --2- 172.21.15.154:0/3252613403 >> v2:172.21.15.179:3300/0 conn(0x7fa710153850 0x7fa7101596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:03.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.084+0000 7fa70ffff700 1 --2- 172.21.15.154:0/3252613403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 0x7fa7100ae750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7000098e0 tx=0x7fa7000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97ea4850ccbcc1c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:03.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.084+0000 7fa70effd700 1 -- 172.21.15.154:0/3252613403 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700011630 con 0x7fa710153480 2023-10-10T21:03:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.084+0000 7fa70effd700 1 -- 172.21.15.154:0/3252613403 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa700011790 con 0x7fa710153480 2023-10-10T21:03:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.084+0000 7fa70effd700 1 -- 172.21.15.154:0/3252613403 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700011b30 con 0x7fa710153480 2023-10-10T21:03:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.084+0000 7fa71539d700 1 -- 172.21.15.154:0/3252613403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 msgr2=0x7fa7100ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.084+0000 7fa71539d700 1 --2- 172.21.15.154:0/3252613403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 0x7fa7100ae750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7000098e0 tx=0x7fa7000091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.085+0000 7fa71539d700 1 -- 172.21.15.154:0/3252613403 shutdown_connections 2023-10-10T21:03:03.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.085+0000 7fa71539d700 1 --2- 172.21.15.154:0/3252613403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 0x7fa7100ae750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.085+0000 7fa71539d700 1 --2- 172.21.15.154:0/3252613403 >> v2:172.21.15.179:3300/0 conn(0x7fa710153850 0x7fa7101596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.085+0000 7fa71539d700 1 -- 172.21.15.154:0/3252613403 >> 172.21.15.154:0/3252613403 conn(0x7fa710068e20 msgr2=0x7fa7100cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:03.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.085+0000 7fa71539d700 1 -- 172.21.15.154:0/3252613403 shutdown_connections 2023-10-10T21:03:03.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.085+0000 7fa71539d700 1 -- 172.21.15.154:0/3252613403 wait complete. 2023-10-10T21:03:03.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.086+0000 7fa71539d700 1 Processor -- start 2023-10-10T21:03:03.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.086+0000 7fa71539d700 1 -- start start 2023-10-10T21:03:03.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa71539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 0x7fa710156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:03.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa71539d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa710153850 0x7fa7100c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:03.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa71539d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa710159bf0 0x7fa7101414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:03.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa71539d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100ca5a0 con 0x7fa710159bf0 2023-10-10T21:03:03.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa71539d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100c9990 con 0x7fa710153850 2023-10-10T21:03:03.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa71539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100c9c70 con 0x7fa710153480 2023-10-10T21:03:03.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa714b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa710159bf0 0x7fa7101414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:03.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa714b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa710159bf0 0x7fa7101414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40778/0 (socket says 172.21.15.154:40778) 2023-10-10T21:03:03.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa714b9c700 1 -- 172.21.15.154:0/3195032476 learned_addr learned my addr 172.21.15.154:0/3195032476 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:03.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa70f7fe700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa710153850 0x7fa7100c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:03.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.087+0000 7fa70ffff700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 0x7fa710156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:03.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa714b9c700 1 -- 172.21.15.154:0/3195032476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 msgr2=0x7fa710156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:03.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa714b9c700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 0x7fa710156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa714b9c700 1 -- 172.21.15.154:0/3195032476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa710153850 msgr2=0x7fa7100c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:03.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa714b9c700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa710153850 0x7fa7100c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa714b9c700 1 -- 172.21.15.154:0/3195032476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa704009420 con 0x7fa710159bf0 2023-10-10T21:03:03.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa714b9c700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa710159bf0 0x7fa7101414a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa70800cc40 tx=0x7fa708001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:03.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa6f7fff700 1 -- 172.21.15.154:0/3195032476 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70800a8b0 con 0x7fa710159bf0 2023-10-10T21:03:03.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa6f7fff700 1 -- 172.21.15.154:0/3195032476 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70800aa10 con 0x7fa710159bf0 2023-10-10T21:03:03.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa6f7fff700 1 -- 172.21.15.154:0/3195032476 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70800ad90 con 0x7fa710159bf0 2023-10-10T21:03:03.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa700009420 con 0x7fa710159bf0 2023-10-10T21:03:03.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.088+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7100ca230 con 0x7fa710159bf0 2023-10-10T21:03:03.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.089+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71004c3c0 con 0x7fa710159bf0 2023-10-10T21:03:03.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.090+0000 7fa6f7fff700 1 -- 172.21.15.154:0/3195032476 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa708007300 con 0x7fa710159bf0 2023-10-10T21:03:03.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.091+0000 7fa6f7fff700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa6fc066f30 0x7fa6fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:03.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.091+0000 7fa6f7fff700 1 -- 172.21.15.154:0/3195032476 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5469+0+0 (secure 0 0 0) 0x7fa7080845b0 con 0x7fa710159bf0 2023-10-10T21:03:03.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.091+0000 7fa70ffff700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa6fc066f30 0x7fa6fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:03.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.092+0000 7fa70ffff700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa6fc066f30 0x7fa6fc0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa7000091e0 tx=0x7fa700017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:03.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.096+0000 7fa6f7fff700 1 -- 172.21.15.154:0/3195032476 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7080518f0 con 0x7fa710159bf0 2023-10-10T21:03:03.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.288+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa71015a050 con 0x7fa710159bf0 2023-10-10T21:03:03.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.865+0000 7fa6f7fff700 1 -- 172.21.15.154:0/3195032476 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa71015a050 con 0x7fa710159bf0 2023-10-10T21:03:03.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.869+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa6fc066f30 msgr2=0x7fa6fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:03.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.869+0000 7fa71539d700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa6fc066f30 0x7fa6fc0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa7000091e0 tx=0x7fa700017000 comp rx=0 tx=0).stop 2023-10-10T21:03:03.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa710159bf0 msgr2=0x7fa7101414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:03.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa710159bf0 0x7fa7101414a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa70800cc40 tx=0x7fa708001a30 comp rx=0 tx=0).stop 2023-10-10T21:03:03.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 shutdown_connections 2023-10-10T21:03:03.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa710159bf0 0x7fa7101414a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa6fc066f30 0x7fa6fc0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa710153480 0x7fa710156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 --2- 172.21.15.154:0/3195032476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa710153850 0x7fa7100c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:03.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 >> 172.21.15.154:0/3195032476 conn(0x7fa710068e20 msgr2=0x7fa71014c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:03.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 shutdown_connections 2023-10-10T21:03:03.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:03.870+0000 7fa71539d700 1 -- 172.21.15.154:0/3195032476 wait complete. 2023-10-10T21:03:03.874 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T21:03:03.892 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T21:03:03.892 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T21:03:03.892 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T21:03:03.893 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:03:03.893 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T21:03:03.893 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T21:03:03.893 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T21:03:03.894 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:03:03.894 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T21:03:03.894 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T21:03:03.895 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T21:03:03.895 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:03:03.895 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T21:03:03.895 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T21:03:03.896 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T21:03:03.896 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:03:03.908 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T21:03:03.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T21:03:03.909 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T21:03:03.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T21:03:03.913 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T21:03:03.913 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T21:03:03.914 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T21:03:03.914 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T21:03:03.953 INFO:tasks.ceph.mds.a:Started 2023-10-10T21:03:03.953 DEBUG:teuthology.parallel:result is None 2023-10-10T21:03:03.956 INFO:tasks.ceph.mds.c:Started 2023-10-10T21:03:03.956 DEBUG:teuthology.parallel:result is None 2023-10-10T21:03:03.958 INFO:tasks.ceph.mds.b:Started 2023-10-10T21:03:03.959 DEBUG:teuthology.parallel:result is None 2023-10-10T21:03:03.962 INFO:tasks.ceph.mds.d:Started 2023-10-10T21:03:03.962 DEBUG:teuthology.parallel:result is None 2023-10-10T21:03:03.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T21:03:04.090 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:03:04.091 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:03:04.102 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:03:04.102 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T21:03:04.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.157+0000 7f5feafff700 1 Processor -- start 2023-10-10T21:03:04.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.158+0000 7f5feafff700 1 -- start start 2023-10-10T21:03:04.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.159+0000 7f5feafff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4159890 0x7f5fe415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:04.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.159+0000 7f5feafff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe415a160 con 0x7f5fe4069560 2023-10-10T21:03:04.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.159+0000 7f5feafff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe40d13a0 con 0x7f5fe4159c60 2023-10-10T21:03:04.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.159+0000 7f5feafff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe415e140 con 0x7f5fe4159890 2023-10-10T21:03:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.159+0000 7f5fe959c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5fe4069560 0x7f5fe40ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59678/0 (socket says 172.21.15.154:59678) 2023-10-10T21:03:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.159+0000 7f5fe959c700 1 -- 172.21.15.154:0/2376980270 learned_addr learned my addr 172.21.15.154:0/2376980270 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.159+0000 7f5fe8d9b700 1 --2- 172.21.15.154:0/2376980270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4159890 0x7f5fe415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe37fe700 1 -- 172.21.15.154:0/2376980270 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899924730 0 0) 0x7f5fe415a160 con 0x7f5fe4069560 2023-10-10T21:03:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe37fe700 1 -- 172.21.15.154:0/2376980270 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd4003570 con 0x7f5fe4069560 2023-10-10T21:03:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe37fe700 1 -- 172.21.15.154:0/2376980270 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657534291 0 0) 0x7f5fe40d13a0 con 0x7f5fe4159c60 2023-10-10T21:03:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe37fe700 1 -- 172.21.15.154:0/2376980270 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe415a160 con 0x7f5fe4159c60 2023-10-10T21:03:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe8d9b700 1 -- 172.21.15.154:0/2376980270 >> v1:172.21.15.179:6789/0 conn(0x7f5fe4159c60 legacy=0x7f5fe415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe8d9b700 1 -- 172.21.15.154:0/2376980270 >> v1:172.21.15.154:6789/0 conn(0x7f5fe4069560 legacy=0x7f5fe40ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe8d9b700 1 -- 172.21.15.154:0/2376980270 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe415a3d0 con 0x7f5fe4159890 2023-10-10T21:03:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe8d9b700 1 --2- 172.21.15.154:0/2376980270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4159890 0x7f5fe415abd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009910 tx=0x7f5fd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aa08f0cbb9f18da server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe37fe700 1 -- 172.21.15.154:0/2376980270 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8011630 con 0x7f5fe4159890 2023-10-10T21:03:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe37fe700 1 -- 172.21.15.154:0/2376980270 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd8011790 con 0x7f5fe4159890 2023-10-10T21:03:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.160+0000 7f5fe37fe700 1 -- 172.21.15.154:0/2376980270 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8011b30 con 0x7f5fe4159890 2023-10-10T21:03:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.161+0000 7f5feafff700 1 -- 172.21.15.154:0/2376980270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4159890 msgr2=0x7f5fe415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.161+0000 7f5feafff700 1 --2- 172.21.15.154:0/2376980270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4159890 0x7f5fe415abd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009910 tx=0x7f5fd80091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.161+0000 7f5feafff700 1 -- 172.21.15.154:0/2376980270 shutdown_connections 2023-10-10T21:03:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.161+0000 7f5feafff700 1 --2- 172.21.15.154:0/2376980270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4159890 0x7f5fe415abd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.161+0000 7f5feafff700 1 -- 172.21.15.154:0/2376980270 >> 172.21.15.154:0/2376980270 conn(0x7f5fe4068e20 msgr2=0x7f5fe40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.161+0000 7f5feafff700 1 -- 172.21.15.154:0/2376980270 shutdown_connections 2023-10-10T21:03:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.161+0000 7f5feafff700 1 -- 172.21.15.154:0/2376980270 wait complete. 2023-10-10T21:03:04.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.162+0000 7f5feafff700 1 Processor -- start 2023-10-10T21:03:04.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.163+0000 7f5feafff700 1 -- start start 2023-10-10T21:03:04.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.163+0000 7f5feafff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4069560 0x7f5fe414d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:04.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.163+0000 7f5feafff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe4159890 0x7f5fe40b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:04.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.163+0000 7f5feafff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe4159c60 0x7f5fe415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:04.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.163+0000 7f5feafff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40b62e0 con 0x7f5fe4159890 2023-10-10T21:03:04.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.163+0000 7f5feafff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40b56d0 con 0x7f5fe4159c60 2023-10-10T21:03:04.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.163+0000 7f5feafff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40b59b0 con 0x7f5fe4069560 2023-10-10T21:03:04.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe4159890 0x7f5fe40b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:04.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe4159890 0x7f5fe40b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40820/0 (socket says 172.21.15.154:40820) 2023-10-10T21:03:04.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe3fff700 1 -- 172.21.15.154:0/1068955314 learned_addr learned my addr 172.21.15.154:0/1068955314 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:04.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe8d9b700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4069560 0x7f5fe414d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:04.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe959c700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe4159c60 0x7f5fe415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:04.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe3fff700 1 -- 172.21.15.154:0/1068955314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4069560 msgr2=0x7f5fe414d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:04.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe3fff700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4069560 0x7f5fe414d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:04.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe3fff700 1 -- 172.21.15.154:0/1068955314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe4159c60 msgr2=0x7f5fe415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:04.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe3fff700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe4159c60 0x7f5fe415d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:04.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe3fff700 1 -- 172.21.15.154:0/1068955314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8009420 con 0x7f5fe4159890 2023-10-10T21:03:04.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.164+0000 7f5fe3fff700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe4159890 0x7f5fe40b4e80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c590 tx=0x7f5fd0007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:04.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.165+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/1068955314 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0010510 con 0x7f5fe4159890 2023-10-10T21:03:04.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.165+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/1068955314 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0010690 con 0x7f5fe4159890 2023-10-10T21:03:04.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.165+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe40b5c90 con 0x7f5fe4159890 2023-10-10T21:03:04.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.165+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/1068955314 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0010a50 con 0x7f5fe4159890 2023-10-10T21:03:04.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.165+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe40b53c0 con 0x7f5fe4159890 2023-10-10T21:03:04.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.166+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe40b6490 con 0x7f5fe4159890 2023-10-10T21:03:04.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.167+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/1068955314 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fd001b3b0 con 0x7f5fe4159890 2023-10-10T21:03:04.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.167+0000 7f5fe0ff9700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fc8066f30 0x7f5fc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:04.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.167+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/1068955314 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5fd0083940 con 0x7f5fe4159890 2023-10-10T21:03:04.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.168+0000 7f5fe8d9b700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fc8066f30 0x7f5fc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:04.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.168+0000 7f5fe8d9b700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fc8066f30 0x7f5fc80693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009860 tx=0x7f5fd8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:04.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.171+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/1068955314 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fe40b6490 con 0x7f5fe4159890 2023-10-10T21:03:04.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:04.380+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5fe404c3c0 con 0x7f5fe4159890 2023-10-10T21:03:05.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.882+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/1068955314 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5fd0017070 con 0x7f5fe4159890 2023-10-10T21:03:05.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fc8066f30 msgr2=0x7f5fc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:05.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fc8066f30 0x7f5fc80693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009860 tx=0x7f5fd8017000 comp rx=0 tx=0).stop 2023-10-10T21:03:05.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe4159890 msgr2=0x7f5fe40b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:05.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe4159890 0x7f5fe40b4e80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c590 tx=0x7f5fd0007de0 comp rx=0 tx=0).stop 2023-10-10T21:03:05.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 shutdown_connections 2023-10-10T21:03:05.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe4159c60 0x7f5fe415d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:05.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fc8066f30 0x7f5fc80693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:05.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe4069560 0x7f5fe414d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:05.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 --2- 172.21.15.154:0/1068955314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe4159890 0x7f5fe40b4e80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:05.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 >> 172.21.15.154:0/1068955314 conn(0x7f5fe4068e20 msgr2=0x7f5fe4154570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:05.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.885+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 shutdown_connections 2023-10-10T21:03:05.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:05.886+0000 7f5feafff700 1 -- 172.21.15.154:0/1068955314 wait complete. 2023-10-10T21:03:05.890 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T21:03:05.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T21:03:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.090+0000 7f08a9dff700 1 Processor -- start 2023-10-10T21:03:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.090+0000 7f08a9dff700 1 -- start start 2023-10-10T21:03:06.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.091+0000 7f08a9dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08a4155c10 0x7f08a4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.091+0000 7f08a9dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08a40ac230 0x7f08a40ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.091+0000 7f08a9dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 0x7f08a4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.091+0000 7f08a9dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40ad930 con 0x7f08a4155c10 2023-10-10T21:03:06.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.091+0000 7f08a9dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40acd20 con 0x7f08a40ac230 2023-10-10T21:03:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.091+0000 7f08a9dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40ad000 con 0x7f08a41568a0 2023-10-10T21:03:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08a4155c10 0x7f08a4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08a4155c10 0x7f08a4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33434/0 (socket says 172.21.15.154:33434) 2023-10-10T21:03:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a37fe700 1 -- 172.21.15.154:0/697041976 learned_addr learned my addr 172.21.15.154:0/697041976 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a3fff700 1 --2- 172.21.15.154:0/697041976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 0x7f08a4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a2ffd700 1 --2- 172.21.15.154:0/697041976 >> v2:172.21.15.179:3300/0 conn(0x7f08a40ac230 0x7f08a40ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a37fe700 1 -- 172.21.15.154:0/697041976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 msgr2=0x7f08a4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a37fe700 1 --2- 172.21.15.154:0/697041976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 0x7f08a4156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a37fe700 1 -- 172.21.15.154:0/697041976 >> v2:172.21.15.179:3300/0 conn(0x7f08a40ac230 msgr2=0x7f08a40ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a37fe700 1 --2- 172.21.15.154:0/697041976 >> v2:172.21.15.179:3300/0 conn(0x7f08a40ac230 0x7f08a40ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a37fe700 1 -- 172.21.15.154:0/697041976 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40ad2e0 con 0x7f08a4155c10 2023-10-10T21:03:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a2ffd700 1 --2- 172.21.15.154:0/697041976 >> v2:172.21.15.179:3300/0 conn(0x7f08a40ac230 0x7f08a40ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.092+0000 7f08a37fe700 1 --2- 172.21.15.154:0/697041976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a4155c10 0x7f08a4155fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f08a4065bb0 tx=0x7f0894009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0388407dc1c4e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a27fc700 1 -- 172.21.15.154:0/697041976 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400b860 con 0x7f08a4155c10 2023-10-10T21:03:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a27fc700 1 -- 172.21.15.154:0/697041976 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089400b9c0 con 0x7f08a4155c10 2023-10-10T21:03:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a27fc700 1 -- 172.21.15.154:0/697041976 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400bd60 con 0x7f08a4155c10 2023-10-10T21:03:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a9dff700 1 -- 172.21.15.154:0/697041976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a4155c10 msgr2=0x7f08a4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a9dff700 1 --2- 172.21.15.154:0/697041976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a4155c10 0x7f08a4155fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f08a4065bb0 tx=0x7f0894009250 comp rx=0 tx=0).stop 2023-10-10T21:03:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a9dff700 1 -- 172.21.15.154:0/697041976 shutdown_connections 2023-10-10T21:03:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a9dff700 1 --2- 172.21.15.154:0/697041976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 0x7f08a4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a9dff700 1 --2- 172.21.15.154:0/697041976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a4155c10 0x7f08a4155fe0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a9dff700 1 --2- 172.21.15.154:0/697041976 >> v2:172.21.15.179:3300/0 conn(0x7f08a40ac230 0x7f08a40ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a9dff700 1 -- 172.21.15.154:0/697041976 >> 172.21.15.154:0/697041976 conn(0x7f08a406a320 msgr2=0x7f08a40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a9dff700 1 -- 172.21.15.154:0/697041976 shutdown_connections 2023-10-10T21:03:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.093+0000 7f08a9dff700 1 -- 172.21.15.154:0/697041976 wait complete. 2023-10-10T21:03:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.095+0000 7f08a9dff700 1 Processor -- start 2023-10-10T21:03:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.095+0000 7f08a9dff700 1 -- start start 2023-10-10T21:03:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a9dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a40ac230 0x7f08a415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a9dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a4155c10 0x7f08a415e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a9dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 0x7f08a4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a9dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a415a480 con 0x7f08a40ac230 2023-10-10T21:03:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a9dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a415aa40 con 0x7f08a4155c10 2023-10-10T21:03:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a9dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41583c0 con 0x7f08a41568a0 2023-10-10T21:03:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a40ac230 0x7f08a415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a40ac230 0x7f08a415aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33450/0 (socket says 172.21.15.154:33450) 2023-10-10T21:03:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a37fe700 1 -- 172.21.15.154:0/650450030 learned_addr learned my addr 172.21.15.154:0/650450030 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a2ffd700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a4155c10 0x7f08a415e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.096+0000 7f08a3fff700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 0x7f08a4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f08a37fe700 1 -- 172.21.15.154:0/650450030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 msgr2=0x7f08a4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f08a37fe700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 0x7f08a4156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f08a37fe700 1 -- 172.21.15.154:0/650450030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a4155c10 msgr2=0x7f08a415e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f08a37fe700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a4155c10 0x7f08a415e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f08a37fe700 1 -- 172.21.15.154:0/650450030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940094f0 con 0x7f08a40ac230 2023-10-10T21:03:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f08a37fe700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a40ac230 0x7f08a415aed0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f08940090b0 tx=0x7f0894017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f088b7fe700 1 -- 172.21.15.154:0/650450030 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894026480 con 0x7f08a40ac230 2023-10-10T21:03:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f088b7fe700 1 -- 172.21.15.154:0/650450030 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089401f070 con 0x7f08a40ac230 2023-10-10T21:03:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f088b7fe700 1 -- 172.21.15.154:0/650450030 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894026830 con 0x7f08a40ac230 2023-10-10T21:03:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a4157800 con 0x7f08a40ac230 2023-10-10T21:03:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.097+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a415a6d0 con 0x7f08a40ac230 2023-10-10T21:03:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.098+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a415ad20 con 0x7f08a40ac230 2023-10-10T21:03:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.099+0000 7f088b7fe700 1 -- 172.21.15.154:0/650450030 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0894026ba0 con 0x7f08a40ac230 2023-10-10T21:03:06.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.100+0000 7f088b7fe700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0890066f30 0x7f08900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.100+0000 7f088b7fe700 1 -- 172.21.15.154:0/650450030 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0894021070 con 0x7f08a40ac230 2023-10-10T21:03:06.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.100+0000 7f08a2ffd700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0890066f30 0x7f08900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.101+0000 7f08a2ffd700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0890066f30 0x7f08900693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0898006f00 tx=0x7f0898008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:06.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.105+0000 7f088b7fe700 1 -- 172.21.15.154:0/650450030 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08940535b0 con 0x7f08a40ac230 2023-10-10T21:03:06.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.369+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f08a404c3c0 con 0x7f08a40ac230 2023-10-10T21:03:06.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.370+0000 7f088b7fe700 1 -- 172.21.15.154:0/650450030 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f089402b090 con 0x7f08a40ac230 2023-10-10T21:03:06.371 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:06.372 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:03:06.372 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T21:03:06.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.372 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T21:03:06.372 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T21:03:06.373 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.373 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:03:06.373 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:03:06.373 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:03:06.374 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.374 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T21:03:06.375 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T21:03:06.375 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.375 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:03:06.375 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:03:06.375 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:03:06.376 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.376 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T21:03:06.377 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T21:03:06.377 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.377 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:03:06.377 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:03:06.377 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:03:06.378 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.378 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T21:03:06.378 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T21:03:06.379 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.379 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:03:06.379 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:03:06.379 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:03:06.379 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.380 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T21:03:06.380 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T21:03:06.381 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.381 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:03:06.381 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:03:06.381 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.381 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.382 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T21:03:06.387 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T21:03:06.387 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.387 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:03:06.388 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:03:06.388 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.388 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.389 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T21:03:06.389 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T21:03:06.389 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.389 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:03:06.390 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:03:06.390 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.390 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T21:03:06.391 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T21:03:06.391 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.391 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:03:06.391 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:03:06.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.392 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T21:03:06.392 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T21:03:06.393 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.393 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:03:06.393 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:03:06.393 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.393 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.394 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T21:03:06.394 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T21:03:06.394 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.395 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:03:06.395 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:03:06.395 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.396 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T21:03:06.396 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T21:03:06.396 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.396 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:03:06.396 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:03:06.397 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.397 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T21:03:06.398 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T21:03:06.398 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.398 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:03:06.398 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:03:06.398 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.398 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.399 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T21:03:06.399 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T21:03:06.399 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.400 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:03:06.400 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:03:06.400 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:03:06.400 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:03:06.400 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.401 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T21:03:06.401 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T21:03:06.401 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.402 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:03:06.402 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:03:06.402 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:03:06.402 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:03:06.402 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.403 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T21:03:06.403 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T21:03:06.403 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.403 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:03:06.404 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:03:06.404 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:03:06.404 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:03:06.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.405 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T21:03:06.405 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T21:03:06.405 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.405 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:03:06.406 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:03:06.406 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:03:06.406 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:03:06.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.407 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T21:03:06.407 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T21:03:06.407 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.407 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:03:06.408 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:03:06.408 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:03:06.408 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.409 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-mds", 2023-10-10T21:03:06.409 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDDuyVlUZoiBBAAAtisNEapSsc4KYoBVnLpHA==", 2023-10-10T21:03:06.409 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.409 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-mds" 2023-10-10T21:03:06.409 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.410 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-mgr", 2023-10-10T21:03:06.410 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDDuyVl6aUiBBAAs4A1BKGxJUTQIvAyIKDvkQ==", 2023-10-10T21:03:06.410 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.411 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-10T21:03:06.411 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.411 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-osd", 2023-10-10T21:03:06.412 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDDuyVloa8iBBAAowqHWEOshiupfehCFqs0qw==", 2023-10-10T21:03:06.412 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.412 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-osd" 2023-10-10T21:03:06.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.413 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rbd", 2023-10-10T21:03:06.413 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDDuyVl7LciBBAAyPIUPUt5JSU2hhczYbZkLQ==", 2023-10-10T21:03:06.413 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.413 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-10T21:03:06.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.414 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-10T21:03:06.414 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDDuyVlZMAiBBAA23AwQVKw84pxPKNuNKEmyA==", 2023-10-10T21:03:06.414 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.415 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-10T21:03:06.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.416 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rgw", 2023-10-10T21:03:06.416 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDDuyVl5sgiBBAAwLkOMIBRH/nxxbPIwwO1bQ==", 2023-10-10T21:03:06.416 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.416 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-10T21:03:06.416 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.417 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T21:03:06.417 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T21:03:06.417 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.418 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:03:06.418 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:03:06.418 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:03:06.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:06.419 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T21:03:06.419 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T21:03:06.419 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:03:06.419 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:03:06.420 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:03:06.420 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:03:06.420 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.420 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:06.420 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T21:03:06.421 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:03:06.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0890066f30 msgr2=0x7f08900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0890066f30 0x7f08900693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0898006f00 tx=0x7f0898008040 comp rx=0 tx=0).stop 2023-10-10T21:03:06.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a40ac230 msgr2=0x7f08a415aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a40ac230 0x7f08a415aed0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f08940090b0 tx=0x7f0894017000 comp rx=0 tx=0).stop 2023-10-10T21:03:06.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 shutdown_connections 2023-10-10T21:03:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0890066f30 0x7f08900693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a41568a0 0x7f08a4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a40ac230 0x7f08a415aed0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 --2- 172.21.15.154:0/650450030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a4155c10 0x7f08a415e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 >> 172.21.15.154:0/650450030 conn(0x7f08a406a320 msgr2=0x7f08a40ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:06.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 shutdown_connections 2023-10-10T21:03:06.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.372+0000 7f08a9dff700 1 -- 172.21.15.154:0/650450030 wait complete. 2023-10-10T21:03:06.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-10T21:03:06.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.608+0000 7f227ffff700 1 Processor -- start 2023-10-10T21:03:06.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.608+0000 7f227ffff700 1 -- start start 2023-10-10T21:03:06.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.609+0000 7f227ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780cd010 0x7f22780ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227ffff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22780ad930 con 0x7f22780ccc40 2023-10-10T21:03:06.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22780acd20 con 0x7f22780ac770 2023-10-10T21:03:06.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780ad000 con 0x7f22780cd010 2023-10-10T21:03:06.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227dd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f22780ccc40 0x7f2278155c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39568/0 (socket says 172.21.15.154:39568) 2023-10-10T21:03:06.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227dd9b700 1 -- 172.21.15.154:0/767787567 learned_addr learned my addr 172.21.15.154:0/767787567 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:06.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227d59a700 1 --2- 172.21.15.154:0/767787567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780cd010 0x7f22780ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227cd99700 1 -- 172.21.15.154:0/767787567 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149149018 0 0) 0x7f22780ad930 con 0x7f22780ccc40 2023-10-10T21:03:06.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227cd99700 1 -- 172.21.15.154:0/767787567 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2264003570 con 0x7f22780ccc40 2023-10-10T21:03:06.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227cd99700 1 -- 172.21.15.154:0/767787567 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482539111 0 0) 0x7f22780acd20 con 0x7f22780ac770 2023-10-10T21:03:06.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227cd99700 1 -- 172.21.15.154:0/767787567 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22780ad930 con 0x7f22780ac770 2023-10-10T21:03:06.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227cd99700 1 -- 172.21.15.154:0/767787567 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3712187884 0 0) 0x7f2264003570 con 0x7f22780ccc40 2023-10-10T21:03:06.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227d59a700 1 -- 172.21.15.154:0/767787567 >> v1:172.21.15.179:6789/0 conn(0x7f22780ac770 legacy=0x7f22780b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227d59a700 1 -- 172.21.15.154:0/767787567 >> v1:172.21.15.154:6789/0 conn(0x7f22780ccc40 legacy=0x7f2278155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.610+0000 7f227d59a700 1 -- 172.21.15.154:0/767787567 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780ad2e0 con 0x7f22780cd010 2023-10-10T21:03:06.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.611+0000 7f227d59a700 1 --2- 172.21.15.154:0/767787567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780cd010 0x7f22780ac230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2268009910 tx=0x7f22680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c440047e7cd161dc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:06.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.611+0000 7f227cd99700 1 -- 172.21.15.154:0/767787567 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274001470 con 0x7f22780cd010 2023-10-10T21:03:06.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.611+0000 7f227cd99700 1 -- 172.21.15.154:0/767787567 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2268011420 con 0x7f22780cd010 2023-10-10T21:03:06.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.611+0000 7f227cd99700 1 -- 172.21.15.154:0/767787567 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22680117c0 con 0x7f22780cd010 2023-10-10T21:03:06.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.612+0000 7f227ffff700 1 -- 172.21.15.154:0/767787567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780cd010 msgr2=0x7f22780ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.612+0000 7f227ffff700 1 --2- 172.21.15.154:0/767787567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780cd010 0x7f22780ac230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2268009910 tx=0x7f22680091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.612+0000 7f227ffff700 1 -- 172.21.15.154:0/767787567 shutdown_connections 2023-10-10T21:03:06.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.612+0000 7f227ffff700 1 --2- 172.21.15.154:0/767787567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780cd010 0x7f22780ac230 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.612+0000 7f227ffff700 1 -- 172.21.15.154:0/767787567 >> 172.21.15.154:0/767787567 conn(0x7f227806a320 msgr2=0x7f22780cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:06.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.612+0000 7f227ffff700 1 -- 172.21.15.154:0/767787567 shutdown_connections 2023-10-10T21:03:06.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.612+0000 7f227ffff700 1 -- 172.21.15.154:0/767787567 wait complete. 2023-10-10T21:03:06.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.613+0000 7f227ffff700 1 Processor -- start 2023-10-10T21:03:06.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.613+0000 7f227ffff700 1 -- start start 2023-10-10T21:03:06.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.614+0000 7f227ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780ac770 0x7f227815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.614+0000 7f227ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22780ccc40 0x7f227814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.614+0000 7f227ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22780cd010 0x7f22780afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.614+0000 7f227ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227816a3c0 con 0x7f22780ccc40 2023-10-10T21:03:06.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.614+0000 7f227ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227816a6a0 con 0x7f22780cd010 2023-10-10T21:03:06.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.614+0000 7f227ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227816a980 con 0x7f22780ac770 2023-10-10T21:03:06.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.614+0000 7f227d59a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22780ccc40 0x7f227814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.614+0000 7f227d59a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22780ccc40 0x7f227814dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33466/0 (socket says 172.21.15.154:33466) 2023-10-10T21:03:06.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.614+0000 7f227d59a700 1 -- 172.21.15.154:0/2544274943 learned_addr learned my addr 172.21.15.154:0/2544274943 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:06.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f227dd9b700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780ac770 0x7f227815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f227e59c700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22780cd010 0x7f22780afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f227d59a700 1 -- 172.21.15.154:0/2544274943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780ac770 msgr2=0x7f227815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f227d59a700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780ac770 0x7f227815d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f227d59a700 1 -- 172.21.15.154:0/2544274943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22780cd010 msgr2=0x7f22780afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f227d59a700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22780cd010 0x7f22780afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f227d59a700 1 -- 172.21.15.154:0/2544274943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268009420 con 0x7f22780ccc40 2023-10-10T21:03:06.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f227d59a700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22780ccc40 0x7f227814dc10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f22680091e0 tx=0x7f2268016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:06.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f226dffb700 1 -- 172.21.15.154:0/2544274943 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226801cc90 con 0x7f22780ccc40 2023-10-10T21:03:06.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f226dffb700 1 -- 172.21.15.154:0/2544274943 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226801cdf0 con 0x7f22780ccc40 2023-10-10T21:03:06.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227816ac60 con 0x7f22780ccc40 2023-10-10T21:03:06.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.615+0000 7f226dffb700 1 -- 172.21.15.154:0/2544274943 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226801a6a0 con 0x7f22780ccc40 2023-10-10T21:03:06.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.616+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227815c210 con 0x7f22780ccc40 2023-10-10T21:03:06.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.616+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227804c3c0 con 0x7f22780ccc40 2023-10-10T21:03:06.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.617+0000 7f226dffb700 1 -- 172.21.15.154:0/2544274943 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f226801aa90 con 0x7f22780ccc40 2023-10-10T21:03:06.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.618+0000 7f226dffb700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f225c066f30 0x7f225c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:06.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.618+0000 7f226dffb700 1 -- 172.21.15.154:0/2544274943 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f22680860e0 con 0x7f22780ccc40 2023-10-10T21:03:06.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.618+0000 7f227dd9b700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f225c066f30 0x7f225c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:06.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.619+0000 7f227dd9b700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f225c066f30 0x7f225c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22740015a0 tx=0x7f2274000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:06.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.623+0000 7f226dffb700 1 -- 172.21.15.154:0/2544274943 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2268053600 con 0x7f22780ccc40 2023-10-10T21:03:06.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.890+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f22780ad5c0 con 0x7f22780ccc40 2023-10-10T21:03:06.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.894+0000 7f226dffb700 1 -- 172.21.15.154:0/2544274943 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2268056c20 con 0x7f22780ccc40 2023-10-10T21:03:06.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f225c066f30 msgr2=0x7f225c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f225c066f30 0x7f225c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22740015a0 tx=0x7f2274000bc0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22780ccc40 msgr2=0x7f227814dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:06.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22780ccc40 0x7f227814dc10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f22680091e0 tx=0x7f2268016000 comp rx=0 tx=0).stop 2023-10-10T21:03:06.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 shutdown_connections 2023-10-10T21:03:06.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22780cd010 0x7f22780afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f225c066f30 0x7f225c0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22780ac770 0x7f227815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 --2- 172.21.15.154:0/2544274943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22780ccc40 0x7f227814dc10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:06.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 >> 172.21.15.154:0/2544274943 conn(0x7f227806a320 msgr2=0x7f22780aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:06.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 shutdown_connections 2023-10-10T21:03:06.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:06.897+0000 7f227ffff700 1 -- 172.21.15.154:0/2544274943 wait complete. 2023-10-10T21:03:06.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-10T21:03:07.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.099+0000 7f586759d700 1 Processor -- start 2023-10-10T21:03:07.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.099+0000 7f586759d700 1 -- start start 2023-10-10T21:03:07.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.100+0000 7f586759d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5860150180 0x7f5860157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.100+0000 7f586759d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5860150550 0x7f58600c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.100+0000 7f586759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 0x7f5860069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.100+0000 7f586759d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600c76a0 con 0x7f5860150180 2023-10-10T21:03:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.100+0000 7f586759d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586006e2a0 con 0x7f5860150550 2023-10-10T21:03:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.100+0000 7f586759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586006b2e0 con 0x7f58600c7240 2023-10-10T21:03:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.100+0000 7f586659b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5860150180 0x7f5860157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.100+0000 7f586659b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5860150180 0x7f5860157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33476/0 (socket says 172.21.15.154:33476) 2023-10-10T21:03:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.100+0000 7f586659b700 1 -- 172.21.15.154:0/876989919 learned_addr learned my addr 172.21.15.154:0/876989919 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f5865d9a700 1 --2- 172.21.15.154:0/876989919 >> v2:172.21.15.179:3300/0 conn(0x7f5860150550 0x7f58600c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f5866d9c700 1 --2- 172.21.15.154:0/876989919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 0x7f5860069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f586659b700 1 -- 172.21.15.154:0/876989919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 msgr2=0x7f5860069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:07.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f586659b700 1 --2- 172.21.15.154:0/876989919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 0x7f5860069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f586659b700 1 -- 172.21.15.154:0/876989919 >> v2:172.21.15.179:3300/0 conn(0x7f5860150550 msgr2=0x7f58600c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:07.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f586659b700 1 --2- 172.21.15.154:0/876989919 >> v2:172.21.15.179:3300/0 conn(0x7f5860150550 0x7f58600c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f586659b700 1 -- 172.21.15.154:0/876989919 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58600c78e0 con 0x7f5860150180 2023-10-10T21:03:07.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f586659b700 1 --2- 172.21.15.154:0/876989919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 0x7f5860157770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f586006d1e0 tx=0x7f585c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807f40e943024db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:07.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f5865599700 1 -- 172.21.15.154:0/876989919 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00b820 con 0x7f5860150180 2023-10-10T21:03:07.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f5865599700 1 -- 172.21.15.154:0/876989919 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c00b980 con 0x7f5860150180 2023-10-10T21:03:07.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.101+0000 7f5865599700 1 -- 172.21.15.154:0/876989919 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00bd20 con 0x7f5860150180 2023-10-10T21:03:07.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.102+0000 7f586759d700 1 -- 172.21.15.154:0/876989919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 msgr2=0x7f5860157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.102+0000 7f586759d700 1 --2- 172.21.15.154:0/876989919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 0x7f5860157770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f586006d1e0 tx=0x7f585c009250 comp rx=0 tx=0).stop 2023-10-10T21:03:07.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.102+0000 7f586759d700 1 -- 172.21.15.154:0/876989919 shutdown_connections 2023-10-10T21:03:07.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.102+0000 7f586759d700 1 --2- 172.21.15.154:0/876989919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 0x7f5860069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.102+0000 7f586759d700 1 --2- 172.21.15.154:0/876989919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 0x7f5860157770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.102+0000 7f586759d700 1 --2- 172.21.15.154:0/876989919 >> v2:172.21.15.179:3300/0 conn(0x7f5860150550 0x7f58600c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.102+0000 7f586759d700 1 -- 172.21.15.154:0/876989919 >> 172.21.15.154:0/876989919 conn(0x7f58600cc1f0 msgr2=0x7f58600cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:07.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.102+0000 7f586759d700 1 -- 172.21.15.154:0/876989919 shutdown_connections 2023-10-10T21:03:07.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.102+0000 7f586759d700 1 -- 172.21.15.154:0/876989919 wait complete. 2023-10-10T21:03:07.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.103+0000 7f586759d700 1 Processor -- start 2023-10-10T21:03:07.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.104+0000 7f586759d700 1 -- start start 2023-10-10T21:03:07.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.104+0000 7f586759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 0x7f58600b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.104+0000 7f586759d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 0x7f586014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.104+0000 7f586759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5860150550 0x7f5860156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.104+0000 7f586759d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586014b4e0 con 0x7f5860150180 2023-10-10T21:03:07.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.104+0000 7f586759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58600b0090 con 0x7f5860150550 2023-10-10T21:03:07.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.104+0000 7f586759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58600b0330 con 0x7f58600c7240 2023-10-10T21:03:07.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5865d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 0x7f586014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5865d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 0x7f586014afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33480/0 (socket says 172.21.15.154:33480) 2023-10-10T21:03:07.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5865d9a700 1 -- 172.21.15.154:0/2187327715 learned_addr learned my addr 172.21.15.154:0/2187327715 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:07.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5866d9c700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5860150550 0x7f5860156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f586659b700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 0x7f58600b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5865d9a700 1 -- 172.21.15.154:0/2187327715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 msgr2=0x7f58600b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5865d9a700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 0x7f58600b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5865d9a700 1 -- 172.21.15.154:0/2187327715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5860150550 msgr2=0x7f5860156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5865d9a700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5860150550 0x7f5860156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5865d9a700 1 -- 172.21.15.154:0/2187327715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0094f0 con 0x7f5860150180 2023-10-10T21:03:07.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f5865d9a700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 0x7f586014afa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f585000d890 tx=0x7f5850008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:07.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.105+0000 7f58567fc700 1 -- 172.21.15.154:0/2187327715 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000b600 con 0x7f5860150180 2023-10-10T21:03:07.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.106+0000 7f58567fc700 1 -- 172.21.15.154:0/2187327715 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585000b760 con 0x7f5860150180 2023-10-10T21:03:07.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.106+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58600b0610 con 0x7f5860150180 2023-10-10T21:03:07.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.106+0000 7f58567fc700 1 -- 172.21.15.154:0/2187327715 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000bae0 con 0x7f5860150180 2023-10-10T21:03:07.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.106+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58600b0bd0 con 0x7f5860150180 2023-10-10T21:03:07.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.107+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586004c3c0 con 0x7f5860150180 2023-10-10T21:03:07.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.108+0000 7f58567fc700 1 -- 172.21.15.154:0/2187327715 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f585001e460 con 0x7f5860150180 2023-10-10T21:03:07.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.108+0000 7f58567fc700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5844066f30 0x7f58440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.108+0000 7f58567fc700 1 -- 172.21.15.154:0/2187327715 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5850084890 con 0x7f5860150180 2023-10-10T21:03:07.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.109+0000 7f586659b700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5844066f30 0x7f58440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.109+0000 7f586659b700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5844066f30 0x7f58440693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f586006d1e0 tx=0x7f585c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:07.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.113+0000 7f58567fc700 1 -- 172.21.15.154:0/2187327715 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5850051e50 con 0x7f5860150180 2023-10-10T21:03:07.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.377+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f586006d650 con 0x7f5860150180 2023-10-10T21:03:07.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.381+0000 7f58567fc700 1 -- 172.21.15.154:0/2187327715 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5850055470 con 0x7f5860150180 2023-10-10T21:03:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5844066f30 msgr2=0x7f58440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5844066f30 0x7f58440693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f586006d1e0 tx=0x7f585c017000 comp rx=0 tx=0).stop 2023-10-10T21:03:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 msgr2=0x7f586014afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 0x7f586014afa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f585000d890 tx=0x7f5850008040 comp rx=0 tx=0).stop 2023-10-10T21:03:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 shutdown_connections 2023-10-10T21:03:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5860150550 0x7f5860156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5844066f30 0x7f58440693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58600c7240 0x7f58600b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 --2- 172.21.15.154:0/2187327715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5860150180 0x7f586014afa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 >> 172.21.15.154:0/2187327715 conn(0x7f58600cc1f0 msgr2=0x7f58600adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:07.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 shutdown_connections 2023-10-10T21:03:07.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.383+0000 7f586759d700 1 -- 172.21.15.154:0/2187327715 wait complete. 2023-10-10T21:03:07.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-10T21:03:07.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.588+0000 7f411f3ff700 1 Processor -- start 2023-10-10T21:03:07.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.588+0000 7f411f3ff700 1 -- start start 2023-10-10T21:03:07.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.589+0000 7f411f3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f411806bcd0 0x7f41180caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.589+0000 7f411f3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f411806c0a0 0x7f411815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.589+0000 7f411f3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411815d7e0 con 0x7f411815df50 2023-10-10T21:03:07.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.589+0000 7f411f3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411815dac0 con 0x7f411806c0a0 2023-10-10T21:03:07.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.589+0000 7f411f3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411815aa30 con 0x7f411806bcd0 2023-10-10T21:03:07.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f411c99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f411806c0a0 0x7f411815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f411d99c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f411815df50 0x7f41180c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39574/0 (socket says 172.21.15.154:39574) 2023-10-10T21:03:07.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f411d99c700 1 -- 172.21.15.154:0/1740974390 learned_addr learned my addr 172.21.15.154:0/1740974390 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:07.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f411d19b700 1 --2- 172.21.15.154:0/1740974390 >> v2:172.21.15.179:3300/0 conn(0x7f411806bcd0 0x7f41180caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f411c99a700 1 -- 172.21.15.154:0/1740974390 >> v2:172.21.15.179:3300/0 conn(0x7f411806bcd0 msgr2=0x7f41180caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:07.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f411c99a700 1 --2- 172.21.15.154:0/1740974390 >> v2:172.21.15.179:3300/0 conn(0x7f411806bcd0 0x7f41180caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f411c99a700 1 -- 172.21.15.154:0/1740974390 >> v1:172.21.15.154:6789/0 conn(0x7f411815df50 legacy=0x7f41180c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f411c99a700 1 -- 172.21.15.154:0/1740974390 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411815ad10 con 0x7f411806c0a0 2023-10-10T21:03:07.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f410ffff700 1 -- 172.21.15.154:0/1740974390 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572387144 0 0) 0x7f411815d7e0 con 0x7f411815df50 2023-10-10T21:03:07.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.590+0000 7f411c99a700 1 --2- 172.21.15.154:0/1740974390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806c0a0 0x7f411815a1e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f41180691a0 tx=0x7f41080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9844aeb729789c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f410ffff700 1 -- 172.21.15.154:0/1740974390 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800b6b0 con 0x7f411806c0a0 2023-10-10T21:03:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f410ffff700 1 -- 172.21.15.154:0/1740974390 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410800b810 con 0x7f411806c0a0 2023-10-10T21:03:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f410ffff700 1 -- 172.21.15.154:0/1740974390 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800bbb0 con 0x7f411806c0a0 2023-10-10T21:03:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f411f3ff700 1 -- 172.21.15.154:0/1740974390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806c0a0 msgr2=0x7f411815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f411f3ff700 1 --2- 172.21.15.154:0/1740974390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806c0a0 0x7f411815a1e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f41180691a0 tx=0x7f41080091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f411f3ff700 1 -- 172.21.15.154:0/1740974390 shutdown_connections 2023-10-10T21:03:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f411f3ff700 1 --2- 172.21.15.154:0/1740974390 >> v2:172.21.15.179:3300/0 conn(0x7f411806bcd0 0x7f41180caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f411f3ff700 1 --2- 172.21.15.154:0/1740974390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806c0a0 0x7f411815a1e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f411f3ff700 1 -- 172.21.15.154:0/1740974390 >> 172.21.15.154:0/1740974390 conn(0x7f41180ce600 msgr2=0x7f41180cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f411f3ff700 1 -- 172.21.15.154:0/1740974390 shutdown_connections 2023-10-10T21:03:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.591+0000 7f411f3ff700 1 -- 172.21.15.154:0/1740974390 wait complete. 2023-10-10T21:03:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.593+0000 7f411f3ff700 1 Processor -- start 2023-10-10T21:03:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.593+0000 7f411f3ff700 1 -- start start 2023-10-10T21:03:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411f3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806bcd0 0x7f411814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411f3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f411806c0a0 0x7f41180c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411f3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411815df50 0x7f41180b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411f3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41181533b0 con 0x7f411806bcd0 2023-10-10T21:03:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411f3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4118153c50 con 0x7f411806c0a0 2023-10-10T21:03:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411f3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411814bf70 con 0x7f411815df50 2023-10-10T21:03:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806bcd0 0x7f411814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806bcd0 0x7f411814ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33502/0 (socket says 172.21.15.154:33502) 2023-10-10T21:03:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d19b700 1 -- 172.21.15.154:0/3084357388 learned_addr learned my addr 172.21.15.154:0/3084357388 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411c99a700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f411806c0a0 0x7f41180c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d99c700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411815df50 0x7f41180b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d19b700 1 -- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411815df50 msgr2=0x7f41180b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d19b700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411815df50 0x7f41180b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d19b700 1 -- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f411806c0a0 msgr2=0x7f41180c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d19b700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f411806c0a0 0x7f41180c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d19b700 1 -- 172.21.15.154:0/3084357388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108009420 con 0x7f411806bcd0 2023-10-10T21:03:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411c99a700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f411806c0a0 0x7f41180c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.594+0000 7f411d99c700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411815df50 0x7f41180b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.595+0000 7f411d19b700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806bcd0 0x7f411814ba30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f411400d890 tx=0x7f4114008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.595+0000 7f410d7fa700 1 -- 172.21.15.154:0/3084357388 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114009610 con 0x7f411806bcd0 2023-10-10T21:03:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.595+0000 7f410d7fa700 1 -- 172.21.15.154:0/3084357388 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114009770 con 0x7f411806bcd0 2023-10-10T21:03:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.595+0000 7f410d7fa700 1 -- 172.21.15.154:0/3084357388 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114009b30 con 0x7f411806bcd0 2023-10-10T21:03:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.595+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41180c4b50 con 0x7f411806bcd0 2023-10-10T21:03:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.595+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41181538e0 con 0x7f411806bcd0 2023-10-10T21:03:07.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.596+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4118153f30 con 0x7f411806bcd0 2023-10-10T21:03:07.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.597+0000 7f410d7fa700 1 -- 172.21.15.154:0/3084357388 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f411401e460 con 0x7f411806bcd0 2023-10-10T21:03:07.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.598+0000 7f410d7fa700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:07.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.598+0000 7f410d7fa700 1 -- 172.21.15.154:0/3084357388 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4114084850 con 0x7f411806bcd0 2023-10-10T21:03:07.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.598+0000 7f411c99a700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:07.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.598+0000 7f411c99a700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f411806acb0 tx=0x7f4108017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:07.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.602+0000 7f410d7fa700 1 -- 172.21.15.154:0/3084357388 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4114051e10 con 0x7f411806bcd0 2023-10-10T21:03:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.865+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f411804c3c0 con 0x7f411806bcd0 2023-10-10T21:03:07.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.870+0000 7f410d7fa700 1 -- 172.21.15.154:0/3084357388 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4114055430 con 0x7f411806bcd0 2023-10-10T21:03:07.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40fc066f30 msgr2=0x7f40fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f411806acb0 tx=0x7f4108017000 comp rx=0 tx=0).stop 2023-10-10T21:03:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806bcd0 msgr2=0x7f411814ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806bcd0 0x7f411814ba30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f411400d890 tx=0x7f4114008040 comp rx=0 tx=0).stop 2023-10-10T21:03:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 shutdown_connections 2023-10-10T21:03:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411815df50 0x7f41180b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411806bcd0 0x7f411814ba30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 --2- 172.21.15.154:0/3084357388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f411806c0a0 0x7f41180c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:07.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 >> 172.21.15.154:0/3084357388 conn(0x7f41180ce600 msgr2=0x7f41180cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:07.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 shutdown_connections 2023-10-10T21:03:07.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:07.872+0000 7f411f3ff700 1 -- 172.21.15.154:0/3084357388 wait complete. 2023-10-10T21:03:07.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-10T21:03:08.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.075+0000 7fabf8fff700 1 Processor -- start 2023-10-10T21:03:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.075+0000 7fabf8fff700 1 -- start start 2023-10-10T21:03:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.076+0000 7fabf8fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabf40cbf30 0x7fabf40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.076+0000 7fabf8fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 0x7fabf40b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.076+0000 7fabf8fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabf415a270 0x7fabf40b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.076+0000 7fabf8fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf4156bf0 con 0x7fabf415a270 2023-10-10T21:03:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.076+0000 7fabf8fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf40ae950 con 0x7fabf40cbf30 2023-10-10T21:03:08.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.076+0000 7fabf8fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40cc300 con 0x7fabf40ccf90 2023-10-10T21:03:08.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf2d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabf415a270 0x7fabf40b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf2d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabf415a270 0x7fabf40b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33506/0 (socket says 172.21.15.154:33506) 2023-10-10T21:03:08.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf2d9d700 1 -- 172.21.15.154:0/474202238 learned_addr learned my addr 172.21.15.154:0/474202238 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:08.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf259c700 1 --2- 172.21.15.154:0/474202238 >> v2:172.21.15.179:3300/0 conn(0x7fabf40cbf30 0x7fabf40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf1d9b700 1 --2- 172.21.15.154:0/474202238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 0x7fabf40b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf2d9d700 1 -- 172.21.15.154:0/474202238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 msgr2=0x7fabf40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:08.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf2d9d700 1 --2- 172.21.15.154:0/474202238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 0x7fabf40b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf2d9d700 1 -- 172.21.15.154:0/474202238 >> v2:172.21.15.179:3300/0 conn(0x7fabf40cbf30 msgr2=0x7fabf40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf2d9d700 1 --2- 172.21.15.154:0/474202238 >> v2:172.21.15.179:3300/0 conn(0x7fabf40cbf30 0x7fabf40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf2d9d700 1 -- 172.21.15.154:0/474202238 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf40ad370 con 0x7fabf415a270 2023-10-10T21:03:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf259c700 1 --2- 172.21.15.154:0/474202238 >> v2:172.21.15.179:3300/0 conn(0x7fabf40cbf30 0x7fabf40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.077+0000 7fabf2d9d700 1 --2- 172.21.15.154:0/474202238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 0x7fabf40b1250 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fabf4063d40 tx=0x7fabec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca58fc7506ec38de server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf159a700 1 -- 172.21.15.154:0/474202238 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00e070 con 0x7fabf415a270 2023-10-10T21:03:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf159a700 1 -- 172.21.15.154:0/474202238 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec00ba40 con 0x7fabf415a270 2023-10-10T21:03:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf159a700 1 -- 172.21.15.154:0/474202238 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0092e0 con 0x7fabf415a270 2023-10-10T21:03:08.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf8fff700 1 -- 172.21.15.154:0/474202238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 msgr2=0x7fabf40b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf8fff700 1 --2- 172.21.15.154:0/474202238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 0x7fabf40b1250 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fabf4063d40 tx=0x7fabec009840 comp rx=0 tx=0).stop 2023-10-10T21:03:08.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf8fff700 1 -- 172.21.15.154:0/474202238 shutdown_connections 2023-10-10T21:03:08.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf8fff700 1 --2- 172.21.15.154:0/474202238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 0x7fabf40b1250 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf8fff700 1 --2- 172.21.15.154:0/474202238 >> v2:172.21.15.179:3300/0 conn(0x7fabf40cbf30 0x7fabf40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf8fff700 1 --2- 172.21.15.154:0/474202238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 0x7fabf40b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf8fff700 1 -- 172.21.15.154:0/474202238 >> 172.21.15.154:0/474202238 conn(0x7fabf406a320 msgr2=0x7fabf40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:08.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf8fff700 1 -- 172.21.15.154:0/474202238 shutdown_connections 2023-10-10T21:03:08.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.078+0000 7fabf8fff700 1 -- 172.21.15.154:0/474202238 wait complete. 2023-10-10T21:03:08.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.080+0000 7fabf8fff700 1 Processor -- start 2023-10-10T21:03:08.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.080+0000 7fabf8fff700 1 -- start start 2023-10-10T21:03:08.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf8fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40cbf30 0x7fabf40a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf8fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 0x7fabf4155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf8fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 0x7fabf40a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf8fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40a9f60 con 0x7fabf415a270 2023-10-10T21:03:08.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf8fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40a5660 con 0x7fabf40cbf30 2023-10-10T21:03:08.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf8fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40a5940 con 0x7fabf40ccf90 2023-10-10T21:03:08.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 0x7fabf40a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 0x7fabf40a7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33522/0 (socket says 172.21.15.154:33522) 2023-10-10T21:03:08.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf2d9d700 1 -- 172.21.15.154:0/158893405 learned_addr learned my addr 172.21.15.154:0/158893405 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:08.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf1d9b700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 0x7fabf4155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf259c700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40cbf30 0x7fabf40a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf2d9d700 1 -- 172.21.15.154:0/158893405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 msgr2=0x7fabf4155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf2d9d700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 0x7fabf4155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf2d9d700 1 -- 172.21.15.154:0/158893405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40cbf30 msgr2=0x7fabf40a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf2d9d700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40cbf30 0x7fabf40a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.081+0000 7fabf2d9d700 1 -- 172.21.15.154:0/158893405 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec009ae0 con 0x7fabf415a270 2023-10-10T21:03:08.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.082+0000 7fabf259c700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40cbf30 0x7fabf40a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:08.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.082+0000 7fabf2d9d700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 0x7fabf40a7910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fabec009880 tx=0x7fabec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:08.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.082+0000 7fabe27fc700 1 -- 172.21.15.154:0/158893405 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0032f0 con 0x7fabf415a270 2023-10-10T21:03:08.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.082+0000 7fabe27fc700 1 -- 172.21.15.154:0/158893405 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec008e40 con 0x7fabf415a270 2023-10-10T21:03:08.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.082+0000 7fabe27fc700 1 -- 172.21.15.154:0/158893405 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec026690 con 0x7fabf415a270 2023-10-10T21:03:08.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.082+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf40a5c20 con 0x7fabf415a270 2023-10-10T21:03:08.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.082+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf41563b0 con 0x7fabf415a270 2023-10-10T21:03:08.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.083+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf404c3c0 con 0x7fabf415a270 2023-10-10T21:03:08.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.084+0000 7fabe27fc700 1 -- 172.21.15.154:0/158893405 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabec003040 con 0x7fabf415a270 2023-10-10T21:03:08.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.085+0000 7fabe27fc700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fabd4066f30 0x7fabd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.085+0000 7fabe27fc700 1 -- 172.21.15.154:0/158893405 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fabec085bd0 con 0x7fabf415a270 2023-10-10T21:03:08.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.085+0000 7fabf259c700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fabd4066f30 0x7fabd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.086+0000 7fabf259c700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fabd4066f30 0x7fabd40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fabf416cf10 tx=0x7fabe4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:08.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.089+0000 7fabe27fc700 1 -- 172.21.15.154:0/158893405 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabec0530f0 con 0x7fabf415a270 2023-10-10T21:03:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.357+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fabf406f8a0 con 0x7fabf415a270 2023-10-10T21:03:08.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.361+0000 7fabe27fc700 1 -- 172.21.15.154:0/158893405 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fabec056710 con 0x7fabf415a270 2023-10-10T21:03:08.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fabd4066f30 msgr2=0x7fabd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fabd4066f30 0x7fabd40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fabf416cf10 tx=0x7fabe4008040 comp rx=0 tx=0).stop 2023-10-10T21:03:08.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 msgr2=0x7fabf40a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 0x7fabf40a7910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fabec009880 tx=0x7fabec018000 comp rx=0 tx=0).stop 2023-10-10T21:03:08.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 shutdown_connections 2023-10-10T21:03:08.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf415a270 0x7fabf40a7910 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40cbf30 0x7fabf40a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fabd4066f30 0x7fabd40693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 --2- 172.21.15.154:0/158893405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf40ccf90 0x7fabf4155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 >> 172.21.15.154:0/158893405 conn(0x7fabf406a320 msgr2=0x7fabf40cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:08.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 shutdown_connections 2023-10-10T21:03:08.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.364+0000 7fabf8fff700 1 -- 172.21.15.154:0/158893405 wait complete. 2023-10-10T21:03:08.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-10T21:03:08.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.564+0000 7f3e42b9d700 1 Processor -- start 2023-10-10T21:03:08.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.564+0000 7f3e42b9d700 1 -- start start 2023-10-10T21:03:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.565+0000 7f3e42b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3e3c06d950 0x7f3e3c0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e42b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e3c06a0a0 0x7f3e3c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e42b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 0x7f3e3c0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e42b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c06ae70 con 0x7f3e3c06a0a0 2023-10-10T21:03:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e42b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c06a540 con 0x7f3e3c06d950 2023-10-10T21:03:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e42b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c06a820 con 0x7f3e3c06dd20 2023-10-10T21:03:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e4139a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e3c06a0a0 0x7f3e3c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e4139a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e3c06a0a0 0x7f3e3c0c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33526/0 (socket says 172.21.15.154:33526) 2023-10-10T21:03:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e4139a700 1 -- 172.21.15.154:0/501823962 learned_addr learned my addr 172.21.15.154:0/501823962 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e41b9b700 1 --2- 172.21.15.154:0/501823962 >> v2:172.21.15.179:3300/0 conn(0x7f3e3c06d950 0x7f3e3c0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e4239c700 1 --2- 172.21.15.154:0/501823962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 0x7f3e3c0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e4139a700 1 -- 172.21.15.154:0/501823962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 msgr2=0x7f3e3c0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e4139a700 1 --2- 172.21.15.154:0/501823962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 0x7f3e3c0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e4139a700 1 -- 172.21.15.154:0/501823962 >> v2:172.21.15.179:3300/0 conn(0x7f3e3c06d950 msgr2=0x7f3e3c0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e4139a700 1 --2- 172.21.15.154:0/501823962 >> v2:172.21.15.179:3300/0 conn(0x7f3e3c06d950 0x7f3e3c0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e4139a700 1 -- 172.21.15.154:0/501823962 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c06ab00 con 0x7f3e3c06a0a0 2023-10-10T21:03:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.566+0000 7f3e41b9b700 1 --2- 172.21.15.154:0/501823962 >> v2:172.21.15.179:3300/0 conn(0x7f3e3c06d950 0x7f3e3c0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e4139a700 1 --2- 172.21.15.154:0/501823962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06a0a0 0x7f3e3c0c6c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0c9c70 tx=0x7f3e2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58120fb1b3420064 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:08.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e40b99700 1 -- 172.21.15.154:0/501823962 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c00b860 con 0x7f3e3c06a0a0 2023-10-10T21:03:08.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e40b99700 1 -- 172.21.15.154:0/501823962 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c00b9c0 con 0x7f3e3c06a0a0 2023-10-10T21:03:08.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e40b99700 1 -- 172.21.15.154:0/501823962 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c00bd60 con 0x7f3e3c06a0a0 2023-10-10T21:03:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e42b9d700 1 -- 172.21.15.154:0/501823962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06a0a0 msgr2=0x7f3e3c0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/501823962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06a0a0 0x7f3e3c0c6c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0c9c70 tx=0x7f3e2c009250 comp rx=0 tx=0).stop 2023-10-10T21:03:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e42b9d700 1 -- 172.21.15.154:0/501823962 shutdown_connections 2023-10-10T21:03:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/501823962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 0x7f3e3c0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/501823962 >> v2:172.21.15.179:3300/0 conn(0x7f3e3c06d950 0x7f3e3c0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.567+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/501823962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06a0a0 0x7f3e3c0c6c10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.568+0000 7f3e42b9d700 1 -- 172.21.15.154:0/501823962 >> 172.21.15.154:0/501823962 conn(0x7f3e3c0cc1f0 msgr2=0x7f3e3c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.568+0000 7f3e42b9d700 1 -- 172.21.15.154:0/501823962 shutdown_connections 2023-10-10T21:03:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.568+0000 7f3e42b9d700 1 -- 172.21.15.154:0/501823962 wait complete. 2023-10-10T21:03:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.569+0000 7f3e42b9d700 1 Processor -- start 2023-10-10T21:03:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.569+0000 7f3e42b9d700 1 -- start start 2023-10-10T21:03:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.570+0000 7f3e42b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e3c06a0a0 0x7f3e3c157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.570+0000 7f3e42b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06d950 0x7f3e3c152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.570+0000 7f3e42b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 0x7f3e3c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.570+0000 7f3e42b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c159440 con 0x7f3e3c06d950 2023-10-10T21:03:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.570+0000 7f3e42b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0af750 con 0x7f3e3c06a0a0 2023-10-10T21:03:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.570+0000 7f3e42b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0adec0 con 0x7f3e3c06dd20 2023-10-10T21:03:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.570+0000 7f3e4139a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06d950 0x7f3e3c152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.570+0000 7f3e4139a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06d950 0x7f3e3c152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33536/0 (socket says 172.21.15.154:33536) 2023-10-10T21:03:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.570+0000 7f3e4139a700 1 -- 172.21.15.154:0/4157839490 learned_addr learned my addr 172.21.15.154:0/4157839490 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e41b9b700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e3c06a0a0 0x7f3e3c157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e4239c700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 0x7f3e3c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e4139a700 1 -- 172.21.15.154:0/4157839490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 msgr2=0x7f3e3c0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e4139a700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 0x7f3e3c0b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e4139a700 1 -- 172.21.15.154:0/4157839490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e3c06a0a0 msgr2=0x7f3e3c157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e4139a700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e3c06a0a0 0x7f3e3c157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e4139a700 1 -- 172.21.15.154:0/4157839490 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c0094f0 con 0x7f3e3c06d950 2023-10-10T21:03:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e41b9b700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e3c06a0a0 0x7f3e3c157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e4139a700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06d950 0x7f3e3c152830 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0090b0 tx=0x7f3e2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e31ffb700 1 -- 172.21.15.154:0/4157839490 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c026480 con 0x7f3e3c06d950 2023-10-10T21:03:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e31ffb700 1 -- 172.21.15.154:0/4157839490 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c01f070 con 0x7f3e3c06d950 2023-10-10T21:03:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c0b0460 con 0x7f3e3c06d950 2023-10-10T21:03:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.571+0000 7f3e31ffb700 1 -- 172.21.15.154:0/4157839490 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c026830 con 0x7f3e3c06d950 2023-10-10T21:03:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.572+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c158310 con 0x7f3e3c06d950 2023-10-10T21:03:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.573+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c0b0a70 con 0x7f3e3c06d950 2023-10-10T21:03:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.573+0000 7f3e31ffb700 1 -- 172.21.15.154:0/4157839490 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e2c026ba0 con 0x7f3e3c06d950 2023-10-10T21:03:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.575+0000 7f3e31ffb700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3e20066f30 0x7f3e200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.575+0000 7f3e31ffb700 1 -- 172.21.15.154:0/4157839490 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3e2c021070 con 0x7f3e3c06d950 2023-10-10T21:03:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.575+0000 7f3e41b9b700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3e20066f30 0x7f3e200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.576+0000 7f3e41b9b700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3e20066f30 0x7f3e200693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0ae4d0 tx=0x7f3e38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.579+0000 7f3e31ffb700 1 -- 172.21.15.154:0/4157839490 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e2c053630 con 0x7f3e3c06d950 2023-10-10T21:03:08.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.848+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f3e3c04c3c0 con 0x7f3e3c06d950 2023-10-10T21:03:08.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.853+0000 7f3e31ffb700 1 -- 172.21.15.154:0/4157839490 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3e2c056c50 con 0x7f3e3c06d950 2023-10-10T21:03:08.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3e20066f30 msgr2=0x7f3e200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3e20066f30 0x7f3e200693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0ae4d0 tx=0x7f3e38008040 comp rx=0 tx=0).stop 2023-10-10T21:03:08.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06d950 msgr2=0x7f3e3c152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:08.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06d950 0x7f3e3c152830 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0090b0 tx=0x7f3e2c017000 comp rx=0 tx=0).stop 2023-10-10T21:03:08.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 shutdown_connections 2023-10-10T21:03:08.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3e20066f30 0x7f3e200693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e3c06dd20 0x7f3e3c0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e3c06a0a0 0x7f3e3c157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 --2- 172.21.15.154:0/4157839490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e3c06d950 0x7f3e3c152830 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:08.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 >> 172.21.15.154:0/4157839490 conn(0x7f3e3c0cc1f0 msgr2=0x7f3e3c0c1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:08.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 shutdown_connections 2023-10-10T21:03:08.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:08.855+0000 7f3e42b9d700 1 -- 172.21.15.154:0/4157839490 wait complete. 2023-10-10T21:03:08.874 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-10T21:03:09.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.057+0000 7efddd9ff700 1 Processor -- start 2023-10-10T21:03:09.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.057+0000 7efddd9ff700 1 -- start start 2023-10-10T21:03:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.058+0000 7efddd9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efdd80cbf30 0x7efdd80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.058+0000 7efddd9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efdd80ccf90 0x7efdd80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.058+0000 7efddd9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd815a270 0x7efdd80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.058+0000 7efddd9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd8156bf0 con 0x7efdd80cbf30 2023-10-10T21:03:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.058+0000 7efddd9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd80ae950 con 0x7efdd80ccf90 2023-10-10T21:03:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.058+0000 7efddd9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80cc300 con 0x7efdd815a270 2023-10-10T21:03:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efdd80cbf30 0x7efdd80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efdd80cbf30 0x7efdd80ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33540/0 (socket says 172.21.15.154:33540) 2023-10-10T21:03:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd6ffd700 1 -- 172.21.15.154:0/899217881 learned_addr learned my addr 172.21.15.154:0/899217881 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd67fc700 1 --2- 172.21.15.154:0/899217881 >> v2:172.21.15.179:3300/0 conn(0x7efdd80ccf90 0x7efdd80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd77fe700 1 --2- 172.21.15.154:0/899217881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd815a270 0x7efdd80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd6ffd700 1 -- 172.21.15.154:0/899217881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd815a270 msgr2=0x7efdd80b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd6ffd700 1 --2- 172.21.15.154:0/899217881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd815a270 0x7efdd80b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd6ffd700 1 -- 172.21.15.154:0/899217881 >> v2:172.21.15.179:3300/0 conn(0x7efdd80ccf90 msgr2=0x7efdd80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd6ffd700 1 --2- 172.21.15.154:0/899217881 >> v2:172.21.15.179:3300/0 conn(0x7efdd80ccf90 0x7efdd80b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd6ffd700 1 -- 172.21.15.154:0/899217881 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd80ad370 con 0x7efdd80cbf30 2023-10-10T21:03:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.059+0000 7efdd6ffd700 1 --2- 172.21.15.154:0/899217881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80cbf30 0x7efdd80ae410 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efdd806d670 tx=0x7efdc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c654d13f3b9b1523 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efdd5ffb700 1 -- 172.21.15.154:0/899217881 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800b820 con 0x7efdd80cbf30 2023-10-10T21:03:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efdd5ffb700 1 -- 172.21.15.154:0/899217881 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800b980 con 0x7efdd80cbf30 2023-10-10T21:03:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efdd5ffb700 1 -- 172.21.15.154:0/899217881 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800bd20 con 0x7efdd80cbf30 2023-10-10T21:03:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efddd9ff700 1 -- 172.21.15.154:0/899217881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80cbf30 msgr2=0x7efdd80ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efddd9ff700 1 --2- 172.21.15.154:0/899217881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80cbf30 0x7efdd80ae410 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efdd806d670 tx=0x7efdc8009250 comp rx=0 tx=0).stop 2023-10-10T21:03:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efddd9ff700 1 -- 172.21.15.154:0/899217881 shutdown_connections 2023-10-10T21:03:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efddd9ff700 1 --2- 172.21.15.154:0/899217881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd815a270 0x7efdd80b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efddd9ff700 1 --2- 172.21.15.154:0/899217881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80cbf30 0x7efdd80ae410 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efddd9ff700 1 --2- 172.21.15.154:0/899217881 >> v2:172.21.15.179:3300/0 conn(0x7efdd80ccf90 0x7efdd80b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efddd9ff700 1 -- 172.21.15.154:0/899217881 >> 172.21.15.154:0/899217881 conn(0x7efdd806a320 msgr2=0x7efdd80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efddd9ff700 1 -- 172.21.15.154:0/899217881 shutdown_connections 2023-10-10T21:03:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.060+0000 7efddd9ff700 1 -- 172.21.15.154:0/899217881 wait complete. 2023-10-10T21:03:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.062+0000 7efddd9ff700 1 Processor -- start 2023-10-10T21:03:09.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.062+0000 7efddd9ff700 1 -- start start 2023-10-10T21:03:09.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efddd9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd80cbf30 0x7efdd80aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efddd9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80ccf90 0x7efdd80a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efddd9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd815a270 0x7efdd8154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efddd9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd816b6b0 con 0x7efdd80ccf90 2023-10-10T21:03:09.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efddd9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd816aaa0 con 0x7efdd80cbf30 2023-10-10T21:03:09.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efddd9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd816ad80 con 0x7efdd815a270 2023-10-10T21:03:09.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efdd67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80ccf90 0x7efdd80a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efdd67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80ccf90 0x7efdd80a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33542/0 (socket says 172.21.15.154:33542) 2023-10-10T21:03:09.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efdd67fc700 1 -- 172.21.15.154:0/2925861033 learned_addr learned my addr 172.21.15.154:0/2925861033 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efdd67fc700 1 -- 172.21.15.154:0/2925861033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd815a270 msgr2=0x7efdd8154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efdd67fc700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd815a270 0x7efdd8154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efdd67fc700 1 -- 172.21.15.154:0/2925861033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd80cbf30 msgr2=0x7efdd80aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efdd67fc700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd80cbf30 0x7efdd80aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.063+0000 7efdd67fc700 1 -- 172.21.15.154:0/2925861033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc80094f0 con 0x7efdd80ccf90 2023-10-10T21:03:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.064+0000 7efdd67fc700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80ccf90 0x7efdd80a9a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00d890 tx=0x7efdcc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.064+0000 7efdbeffd700 1 -- 172.21.15.154:0/2925861033 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00b600 con 0x7efdd80ccf90 2023-10-10T21:03:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.064+0000 7efdbeffd700 1 -- 172.21.15.154:0/2925861033 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc00b760 con 0x7efdd80ccf90 2023-10-10T21:03:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.064+0000 7efdbeffd700 1 -- 172.21.15.154:0/2925861033 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00bae0 con 0x7efdd80ccf90 2023-10-10T21:03:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.064+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd816b060 con 0x7efdd80ccf90 2023-10-10T21:03:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.064+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd816a690 con 0x7efdd80ccf90 2023-10-10T21:03:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.065+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd804c3c0 con 0x7efdd80ccf90 2023-10-10T21:03:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.066+0000 7efdbeffd700 1 -- 172.21.15.154:0/2925861033 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdcc01e460 con 0x7efdd80ccf90 2023-10-10T21:03:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.067+0000 7efdbeffd700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7efdc4066f30 0x7efdc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.067+0000 7efdbeffd700 1 -- 172.21.15.154:0/2925861033 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efdcc084960 con 0x7efdd80ccf90 2023-10-10T21:03:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.067+0000 7efdd6ffd700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7efdc4066f30 0x7efdc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.068+0000 7efdd6ffd700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7efdc4066f30 0x7efdc40693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdd806d670 tx=0x7efdc8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.071+0000 7efdbeffd700 1 -- 172.21.15.154:0/2925861033 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdcc051e80 con 0x7efdd80ccf90 2023-10-10T21:03:09.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.338+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7efdd816b7f0 con 0x7efdd80ccf90 2023-10-10T21:03:09.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.343+0000 7efdbeffd700 1 -- 172.21.15.154:0/2925861033 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7efdcc0554a0 con 0x7efdd80ccf90 2023-10-10T21:03:09.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7efdc4066f30 msgr2=0x7efdc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7efdc4066f30 0x7efdc40693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdd806d670 tx=0x7efdc8017000 comp rx=0 tx=0).stop 2023-10-10T21:03:09.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80ccf90 msgr2=0x7efdd80a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80ccf90 0x7efdd80a9a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00d890 tx=0x7efdcc008040 comp rx=0 tx=0).stop 2023-10-10T21:03:09.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 shutdown_connections 2023-10-10T21:03:09.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7efdc4066f30 0x7efdc40693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdd815a270 0x7efdd8154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdd80cbf30 0x7efdd80aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 --2- 172.21.15.154:0/2925861033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd80ccf90 0x7efdd80a9a70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 >> 172.21.15.154:0/2925861033 conn(0x7efdd806a320 msgr2=0x7efdd80cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 shutdown_connections 2023-10-10T21:03:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.345+0000 7efddd9ff700 1 -- 172.21.15.154:0/2925861033 wait complete. 2023-10-10T21:03:09.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:03:09.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.544+0000 7f7fe79ff700 1 Processor -- start 2023-10-10T21:03:09.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.544+0000 7f7fe79ff700 1 -- start start 2023-10-10T21:03:09.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.545+0000 7f7fe79ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7fe00ccc40 0x7f7fe0155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.545+0000 7f7fe79ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7fe0156150 0x7f7fe00ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.545+0000 7f7fe79ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe00cd010 0x7f7fe00af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.545+0000 7f7fe79ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe00ad930 con 0x7f7fe00ccc40 2023-10-10T21:03:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.545+0000 7f7fe79ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe00acd20 con 0x7f7fe0156150 2023-10-10T21:03:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.545+0000 7f7fe79ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00ad000 con 0x7f7fe00cd010 2023-10-10T21:03:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe579b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7fe00ccc40 0x7f7fe0155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe579b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7fe00ccc40 0x7f7fe0155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33552/0 (socket says 172.21.15.154:33552) 2023-10-10T21:03:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe579b700 1 -- 172.21.15.154:0/3843517025 learned_addr learned my addr 172.21.15.154:0/3843517025 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe4f9a700 1 --2- 172.21.15.154:0/3843517025 >> v2:172.21.15.179:3300/0 conn(0x7f7fe0156150 0x7f7fe00ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe5f9c700 1 --2- 172.21.15.154:0/3843517025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe00cd010 0x7f7fe00af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe579b700 1 -- 172.21.15.154:0/3843517025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe00cd010 msgr2=0x7f7fe00af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:09.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe579b700 1 --2- 172.21.15.154:0/3843517025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe00cd010 0x7f7fe00af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe579b700 1 -- 172.21.15.154:0/3843517025 >> v2:172.21.15.179:3300/0 conn(0x7f7fe0156150 msgr2=0x7f7fe00ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:09.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe579b700 1 --2- 172.21.15.154:0/3843517025 >> v2:172.21.15.179:3300/0 conn(0x7f7fe0156150 0x7f7fe00ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe579b700 1 -- 172.21.15.154:0/3843517025 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe00ad2e0 con 0x7f7fe00ccc40 2023-10-10T21:03:09.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe5f9c700 1 --2- 172.21.15.154:0/3843517025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe00cd010 0x7f7fe00af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.546+0000 7f7fe579b700 1 --2- 172.21.15.154:0/3843517025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00ccc40 0x7f7fe0155c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0065bb0 tx=0x7f7fdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65471ac62942bf5d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fd7fff700 1 -- 172.21.15.154:0/3843517025 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00b860 con 0x7f7fe00ccc40 2023-10-10T21:03:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fd7fff700 1 -- 172.21.15.154:0/3843517025 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc00b9c0 con 0x7f7fe00ccc40 2023-10-10T21:03:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fd7fff700 1 -- 172.21.15.154:0/3843517025 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00bd60 con 0x7f7fe00ccc40 2023-10-10T21:03:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fe79ff700 1 -- 172.21.15.154:0/3843517025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00ccc40 msgr2=0x7f7fe0155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/3843517025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00ccc40 0x7f7fe0155c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0065bb0 tx=0x7f7fdc009250 comp rx=0 tx=0).stop 2023-10-10T21:03:09.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fe79ff700 1 -- 172.21.15.154:0/3843517025 shutdown_connections 2023-10-10T21:03:09.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/3843517025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe00cd010 0x7f7fe00af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/3843517025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00ccc40 0x7f7fe0155c10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/3843517025 >> v2:172.21.15.179:3300/0 conn(0x7f7fe0156150 0x7f7fe00ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fe79ff700 1 -- 172.21.15.154:0/3843517025 >> 172.21.15.154:0/3843517025 conn(0x7f7fe006a320 msgr2=0x7f7fe00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:09.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fe79ff700 1 -- 172.21.15.154:0/3843517025 shutdown_connections 2023-10-10T21:03:09.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.547+0000 7f7fe79ff700 1 -- 172.21.15.154:0/3843517025 wait complete. 2023-10-10T21:03:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.549+0000 7f7fe79ff700 1 Processor -- start 2023-10-10T21:03:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.549+0000 7f7fe79ff700 1 -- start start 2023-10-10T21:03:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe79ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe00ccc40 0x7f7fe014d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe79ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00cd010 0x7f7fe015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe79ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe0156150 0x7f7fe0154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe79ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00ab1f0 con 0x7f7fe00cd010 2023-10-10T21:03:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe79ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe015adf0 con 0x7f7fe00ccc40 2023-10-10T21:03:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe79ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe015b690 con 0x7f7fe0156150 2023-10-10T21:03:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe4f9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00cd010 0x7f7fe015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe4f9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00cd010 0x7f7fe015bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33558/0 (socket says 172.21.15.154:33558) 2023-10-10T21:03:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe4f9a700 1 -- 172.21.15.154:0/1785876491 learned_addr learned my addr 172.21.15.154:0/1785876491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe579b700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe00ccc40 0x7f7fe014d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.550+0000 7f7fe5f9c700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe0156150 0x7f7fe0154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fe4f9a700 1 -- 172.21.15.154:0/1785876491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe0156150 msgr2=0x7f7fe0154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fe4f9a700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe0156150 0x7f7fe0154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fe4f9a700 1 -- 172.21.15.154:0/1785876491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe00ccc40 msgr2=0x7f7fe014d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fe4f9a700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe00ccc40 0x7f7fe014d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fe4f9a700 1 -- 172.21.15.154:0/1785876491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0094f0 con 0x7f7fe00cd010 2023-10-10T21:03:09.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fe5f9c700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe0156150 0x7f7fe0154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:09.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fe4f9a700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00cd010 0x7f7fe015bb20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000d860 tx=0x7f7fd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:09.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fd57fa700 1 -- 172.21.15.154:0/1785876491 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00125f0 con 0x7f7fe00cd010 2023-10-10T21:03:09.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fd57fa700 1 -- 172.21.15.154:0/1785876491 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0012770 con 0x7f7fe00cd010 2023-10-10T21:03:09.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe006e4a0 con 0x7f7fe00cd010 2023-10-10T21:03:09.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fd57fa700 1 -- 172.21.15.154:0/1785876491 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0012b30 con 0x7f7fe00cd010 2023-10-10T21:03:09.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.551+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe015b320 con 0x7f7fe00cd010 2023-10-10T21:03:09.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.552+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe004c3c0 con 0x7f7fe00cd010 2023-10-10T21:03:09.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.553+0000 7f7fd57fa700 1 -- 172.21.15.154:0/1785876491 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fd001e460 con 0x7f7fe00cd010 2023-10-10T21:03:09.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.554+0000 7f7fd57fa700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7fc4066f30 0x7f7fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.554+0000 7f7fd57fa700 1 -- 172.21.15.154:0/1785876491 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7fd0084700 con 0x7f7fe00cd010 2023-10-10T21:03:09.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.554+0000 7f7fe579b700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7fc4066f30 0x7f7fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.555+0000 7f7fe579b700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7fc4066f30 0x7f7fc40693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0065bb0 tx=0x7f7fdc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:09.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.558+0000 7f7fd57fa700 1 -- 172.21.15.154:0/1785876491 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fd0051cc0 con 0x7f7fe00cd010 2023-10-10T21:03:09.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.750+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fe015b7d0 con 0x7f7fe00cd010 2023-10-10T21:03:09.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.751+0000 7f7fd57fa700 1 -- 172.21.15.154:0/1785876491 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f7fd00552e0 con 0x7f7fe00cd010 2023-10-10T21:03:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:09.753 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:03:05.878379+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:03:09.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7fc4066f30 msgr2=0x7f7fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7fc4066f30 0x7f7fc40693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0065bb0 tx=0x7f7fdc017000 comp rx=0 tx=0).stop 2023-10-10T21:03:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00cd010 msgr2=0x7f7fe015bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00cd010 0x7f7fe015bb20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000d860 tx=0x7f7fd0008040 comp rx=0 tx=0).stop 2023-10-10T21:03:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 shutdown_connections 2023-10-10T21:03:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7fc4066f30 0x7f7fc40693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fe0156150 0x7f7fe0154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe00ccc40 0x7f7fe014d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 --2- 172.21.15.154:0/1785876491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe00cd010 0x7f7fe015bb20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 >> 172.21.15.154:0/1785876491 conn(0x7f7fe006a320 msgr2=0x7f7fe014dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 shutdown_connections 2023-10-10T21:03:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.753+0000 7f7fe79ff700 1 -- 172.21.15.154:0/1785876491 wait complete. 2023-10-10T21:03:09.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T21:03:09.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:03:09.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.959+0000 7ff7f3fff700 1 Processor -- start 2023-10-10T21:03:09.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.959+0000 7ff7f3fff700 1 -- start start 2023-10-10T21:03:09.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.960+0000 7ff7f3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7ec155eb0 0x7ff7ec06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.960+0000 7ff7f3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec0c70b0 0x7ff7ec069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f3fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ec06eb90 con 0x7ff7ec069cb0 2023-10-10T21:03:09.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f3fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ec06a130 con 0x7ff7ec155eb0 2023-10-10T21:03:09.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec06ee70 con 0x7ff7ec0c70b0 2023-10-10T21:03:09.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7ec155eb0 0x7ff7ec06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7ec155eb0 0x7ff7ec06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33568/0 (socket says 172.21.15.154:33568) 2023-10-10T21:03:09.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f1d9b700 1 -- 172.21.15.154:0/694969722 learned_addr learned my addr 172.21.15.154:0/694969722 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:09.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f159a700 1 --2- 172.21.15.154:0/694969722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec0c70b0 0x7ff7ec069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f1d9b700 1 -- 172.21.15.154:0/694969722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec0c70b0 msgr2=0x7ff7ec069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:09.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f1d9b700 1 --2- 172.21.15.154:0/694969722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec0c70b0 0x7ff7ec069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f1d9b700 1 -- 172.21.15.154:0/694969722 >> v1:172.21.15.179:6789/0 conn(0x7ff7ec069cb0 legacy=0x7ff7ec159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.961+0000 7ff7f1d9b700 1 -- 172.21.15.154:0/694969722 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec06f150 con 0x7ff7ec155eb0 2023-10-10T21:03:09.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.962+0000 7ff7f1d9b700 1 --2- 172.21.15.154:0/694969722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 0x7ff7ec06e240 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80099b0 tx=0x7ff7e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35f0b3adc3ae32d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:09.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.962+0000 7ff7f0d99700 1 -- 172.21.15.154:0/694969722 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800b860 con 0x7ff7ec155eb0 2023-10-10T21:03:09.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.962+0000 7ff7f0d99700 1 -- 172.21.15.154:0/694969722 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e800b9c0 con 0x7ff7ec155eb0 2023-10-10T21:03:09.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.962+0000 7ff7f0d99700 1 -- 172.21.15.154:0/694969722 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800bd60 con 0x7ff7ec155eb0 2023-10-10T21:03:09.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.962+0000 7ff7f3fff700 1 -- 172.21.15.154:0/694969722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 msgr2=0x7ff7ec06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.962+0000 7ff7f3fff700 1 --2- 172.21.15.154:0/694969722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 0x7ff7ec06e240 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80099b0 tx=0x7ff7e8009250 comp rx=0 tx=0).stop 2023-10-10T21:03:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.962+0000 7ff7f3fff700 1 -- 172.21.15.154:0/694969722 shutdown_connections 2023-10-10T21:03:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.962+0000 7ff7f3fff700 1 --2- 172.21.15.154:0/694969722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 0x7ff7ec06e240 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.963+0000 7ff7f3fff700 1 --2- 172.21.15.154:0/694969722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec0c70b0 0x7ff7ec069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.963+0000 7ff7f3fff700 1 -- 172.21.15.154:0/694969722 >> 172.21.15.154:0/694969722 conn(0x7ff7ec068e10 msgr2=0x7ff7ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.963+0000 7ff7f3fff700 1 -- 172.21.15.154:0/694969722 shutdown_connections 2023-10-10T21:03:09.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.963+0000 7ff7f3fff700 1 -- 172.21.15.154:0/694969722 wait complete. 2023-10-10T21:03:09.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.964+0000 7ff7f3fff700 1 Processor -- start 2023-10-10T21:03:09.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.964+0000 7ff7f3fff700 1 -- start start 2023-10-10T21:03:09.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.965+0000 7ff7f3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec069cb0 0x7ff7ec0af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.965+0000 7ff7f3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7ec0c70b0 0x7ff7ec0c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.965+0000 7ff7f3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 0x7ff7ec13f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.965+0000 7ff7f3fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec0afd90 con 0x7ff7ec155eb0 2023-10-10T21:03:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.965+0000 7ff7f3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec0c57a0 con 0x7ff7ec0c70b0 2023-10-10T21:03:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.965+0000 7ff7f3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec0c5a80 con 0x7ff7ec069cb0 2023-10-10T21:03:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.965+0000 7ff7f259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 0x7ff7ec13f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 0x7ff7ec13f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33570/0 (socket says 172.21.15.154:33570) 2023-10-10T21:03:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f159a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7ec0c70b0 0x7ff7ec0c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f1d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec069cb0 0x7ff7ec0af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f259c700 1 -- 172.21.15.154:0/2472933623 learned_addr learned my addr 172.21.15.154:0/2472933623 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f259c700 1 -- 172.21.15.154:0/2472933623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec069cb0 msgr2=0x7ff7ec0af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f259c700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec069cb0 0x7ff7ec0af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f259c700 1 -- 172.21.15.154:0/2472933623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7ec0c70b0 msgr2=0x7ff7ec0c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f259c700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7ec0c70b0 0x7ff7ec0c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f259c700 1 -- 172.21.15.154:0/2472933623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e80094f0 con 0x7ff7ec155eb0 2023-10-10T21:03:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f259c700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 0x7ff7ec13f5c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c8e0 tx=0x7ff7e4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:09.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7e1ffb700 1 -- 172.21.15.154:0/2472933623 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4012630 con 0x7ff7ec155eb0 2023-10-10T21:03:09.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7e1ffb700 1 -- 172.21.15.154:0/2472933623 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4012790 con 0x7ff7ec155eb0 2023-10-10T21:03:09.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.966+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ec0c5d60 con 0x7ff7ec155eb0 2023-10-10T21:03:09.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.967+0000 7ff7e1ffb700 1 -- 172.21.15.154:0/2472933623 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4012b50 con 0x7ff7ec155eb0 2023-10-10T21:03:09.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.967+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ec0c63a0 con 0x7ff7ec155eb0 2023-10-10T21:03:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.968+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ec0c6900 con 0x7ff7ec155eb0 2023-10-10T21:03:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.970+0000 7ff7e1ffb700 1 -- 172.21.15.154:0/2472933623 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7e4024420 con 0x7ff7ec155eb0 2023-10-10T21:03:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.971+0000 7ff7e1ffb700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff7d0066f30 0x7ff7d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.971+0000 7ff7e1ffb700 1 -- 172.21.15.154:0/2472933623 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff7e4084b60 con 0x7ff7ec155eb0 2023-10-10T21:03:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.971+0000 7ff7f1d9b700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff7d0066f30 0x7ff7d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.972+0000 7ff7f1d9b700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff7d0066f30 0x7ff7d00693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80099b0 tx=0x7ff7e8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:09.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:09.974+0000 7ff7e1ffb700 1 -- 172.21.15.154:0/2472933623 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7e4052100 con 0x7ff7ec155eb0 2023-10-10T21:03:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.166+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7ec04c3c0 con 0x7ff7ec155eb0 2023-10-10T21:03:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.166+0000 7ff7e1ffb700 1 -- 172.21.15.154:0/2472933623 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7e4055720 con 0x7ff7ec155eb0 2023-10-10T21:03:10.168 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:03:10.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff7d0066f30 msgr2=0x7ff7d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff7d0066f30 0x7ff7d00693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80099b0 tx=0x7ff7e8017000 comp rx=0 tx=0).stop 2023-10-10T21:03:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 msgr2=0x7ff7ec13f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 0x7ff7ec13f5c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c8e0 tx=0x7ff7e4001710 comp rx=0 tx=0).stop 2023-10-10T21:03:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 shutdown_connections 2023-10-10T21:03:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec155eb0 0x7ff7ec13f5c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff7d0066f30 0x7ff7d00693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7ec069cb0 0x7ff7ec0af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 --2- 172.21.15.154:0/2472933623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7ec0c70b0 0x7ff7ec0c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 >> 172.21.15.154:0/2472933623 conn(0x7ff7ec068e10 msgr2=0x7ff7ec154470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 shutdown_connections 2023-10-10T21:03:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.169+0000 7ff7f3fff700 1 -- 172.21.15.154:0/2472933623 wait complete. 2023-10-10T21:03:10.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T21:03:10.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.368+0000 7f5e593ff700 1 Processor -- start 2023-10-10T21:03:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.368+0000 7f5e593ff700 1 -- start start 2023-10-10T21:03:10.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e593ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5e540cbf30 0x7f5e540ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e593ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e540ccf90 0x7f5e540b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e593ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5e5415a270 0x7f5e540b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e593ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e54156bf0 con 0x7f5e540cbf30 2023-10-10T21:03:10.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e593ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e540ae950 con 0x7f5e5415a270 2023-10-10T21:03:10.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e593ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540cc300 con 0x7f5e540ccf90 2023-10-10T21:03:10.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e52ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5e540cbf30 0x7f5e540ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e52ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5e540cbf30 0x7f5e540ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33578/0 (socket says 172.21.15.154:33578) 2023-10-10T21:03:10.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e52ffd700 1 -- 172.21.15.154:0/2486725285 learned_addr learned my addr 172.21.15.154:0/2486725285 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:10.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e537fe700 1 --2- 172.21.15.154:0/2486725285 >> v2:172.21.15.179:3300/0 conn(0x7f5e5415a270 0x7f5e540b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e527fc700 1 --2- 172.21.15.154:0/2486725285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e540ccf90 0x7f5e540b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e52ffd700 1 -- 172.21.15.154:0/2486725285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e540ccf90 msgr2=0x7f5e540b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:10.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.370+0000 7f5e52ffd700 1 --2- 172.21.15.154:0/2486725285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e540ccf90 0x7f5e540b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.371+0000 7f5e52ffd700 1 -- 172.21.15.154:0/2486725285 >> v2:172.21.15.179:3300/0 conn(0x7f5e5415a270 msgr2=0x7f5e540b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:10.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.371+0000 7f5e52ffd700 1 --2- 172.21.15.154:0/2486725285 >> v2:172.21.15.179:3300/0 conn(0x7f5e5415a270 0x7f5e540b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.371+0000 7f5e52ffd700 1 -- 172.21.15.154:0/2486725285 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e540ad370 con 0x7f5e540cbf30 2023-10-10T21:03:10.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.371+0000 7f5e537fe700 1 --2- 172.21.15.154:0/2486725285 >> v2:172.21.15.179:3300/0 conn(0x7f5e5415a270 0x7f5e540b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:10.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.371+0000 7f5e52ffd700 1 --2- 172.21.15.154:0/2486725285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 0x7f5e540ae410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e540b25e0 tx=0x7f5e4400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651133b60470c486 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:10.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.371+0000 7f5e51ffb700 1 -- 172.21.15.154:0/2486725285 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44010070 con 0x7f5e540cbf30 2023-10-10T21:03:10.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.371+0000 7f5e51ffb700 1 -- 172.21.15.154:0/2486725285 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400de80 con 0x7f5e540cbf30 2023-10-10T21:03:10.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.371+0000 7f5e51ffb700 1 -- 172.21.15.154:0/2486725285 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400b320 con 0x7f5e540cbf30 2023-10-10T21:03:10.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.372+0000 7f5e593ff700 1 -- 172.21.15.154:0/2486725285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 msgr2=0x7f5e540ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.372+0000 7f5e593ff700 1 --2- 172.21.15.154:0/2486725285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 0x7f5e540ae410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e540b25e0 tx=0x7f5e4400ba50 comp rx=0 tx=0).stop 2023-10-10T21:03:10.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.372+0000 7f5e593ff700 1 -- 172.21.15.154:0/2486725285 shutdown_connections 2023-10-10T21:03:10.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.372+0000 7f5e593ff700 1 --2- 172.21.15.154:0/2486725285 >> v2:172.21.15.179:3300/0 conn(0x7f5e5415a270 0x7f5e540b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.372+0000 7f5e593ff700 1 --2- 172.21.15.154:0/2486725285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 0x7f5e540ae410 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.372+0000 7f5e593ff700 1 --2- 172.21.15.154:0/2486725285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e540ccf90 0x7f5e540b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.372+0000 7f5e593ff700 1 -- 172.21.15.154:0/2486725285 >> 172.21.15.154:0/2486725285 conn(0x7f5e5406a320 msgr2=0x7f5e540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:10.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.372+0000 7f5e593ff700 1 -- 172.21.15.154:0/2486725285 shutdown_connections 2023-10-10T21:03:10.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.372+0000 7f5e593ff700 1 -- 172.21.15.154:0/2486725285 wait complete. 2023-10-10T21:03:10.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.373+0000 7f5e593ff700 1 Processor -- start 2023-10-10T21:03:10.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.373+0000 7f5e593ff700 1 -- start start 2023-10-10T21:03:10.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.374+0000 7f5e593ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 0x7f5e54147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.374+0000 7f5e593ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e540ccf90 0x7f5e54157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.374+0000 7f5e593ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e5415a270 0x7f5e541583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.374+0000 7f5e593ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540aa970 con 0x7f5e540cbf30 2023-10-10T21:03:10.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.374+0000 7f5e593ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540a9d60 con 0x7f5e540ccf90 2023-10-10T21:03:10.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.374+0000 7f5e593ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540aa040 con 0x7f5e5415a270 2023-10-10T21:03:10.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.374+0000 7f5e52ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 0x7f5e54147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.374+0000 7f5e52ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 0x7f5e54147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33588/0 (socket says 172.21.15.154:33588) 2023-10-10T21:03:10.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.374+0000 7f5e52ffd700 1 -- 172.21.15.154:0/927711983 learned_addr learned my addr 172.21.15.154:0/927711983 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:10.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e537fe700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e5415a270 0x7f5e541583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e527fc700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e540ccf90 0x7f5e54157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e52ffd700 1 -- 172.21.15.154:0/927711983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e5415a270 msgr2=0x7f5e541583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e52ffd700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e5415a270 0x7f5e541583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e52ffd700 1 -- 172.21.15.154:0/927711983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e540ccf90 msgr2=0x7f5e54157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e52ffd700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e540ccf90 0x7f5e54157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e52ffd700 1 -- 172.21.15.154:0/927711983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4400bcf0 con 0x7f5e540cbf30 2023-10-10T21:03:10.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e537fe700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e5415a270 0x7f5e541583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:10.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e52ffd700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 0x7f5e54147f80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400ba90 tx=0x7f5e4401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e3affd700 1 -- 172.21.15.154:0/927711983 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44009b00 con 0x7f5e540cbf30 2023-10-10T21:03:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e3affd700 1 -- 172.21.15.154:0/927711983 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e44009c80 con 0x7f5e540cbf30 2023-10-10T21:03:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e3affd700 1 -- 172.21.15.154:0/927711983 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4401d430 con 0x7f5e540cbf30 2023-10-10T21:03:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e540aa320 con 0x7f5e540cbf30 2023-10-10T21:03:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.375+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e541484c0 con 0x7f5e540cbf30 2023-10-10T21:03:10.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.376+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5404c3c0 con 0x7f5e540cbf30 2023-10-10T21:03:10.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.377+0000 7f5e3affd700 1 -- 172.21.15.154:0/927711983 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e44003040 con 0x7f5e540cbf30 2023-10-10T21:03:10.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.378+0000 7f5e3affd700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e40066f30 0x7f5e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.378+0000 7f5e3affd700 1 -- 172.21.15.154:0/927711983 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5e44085580 con 0x7f5e540cbf30 2023-10-10T21:03:10.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.378+0000 7f5e527fc700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e40066f30 0x7f5e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.379+0000 7f5e527fc700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e40066f30 0x7f5e400693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e541565b0 tx=0x7f5e48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:10.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.382+0000 7f5e3affd700 1 -- 172.21.15.154:0/927711983 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e44052b40 con 0x7f5e540cbf30 2023-10-10T21:03:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.573+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5e5415a050 con 0x7f5e540cbf30 2023-10-10T21:03:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.573+0000 7f5e3affd700 1 -- 172.21.15.154:0/927711983 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5e44056160 con 0x7f5e540cbf30 2023-10-10T21:03:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:10.575 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:03:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:10.575 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T21:03:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T21:03:10.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:10.576 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:03:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e40066f30 msgr2=0x7f5e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e40066f30 0x7f5e400693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e541565b0 tx=0x7f5e48008040 comp rx=0 tx=0).stop 2023-10-10T21:03:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 msgr2=0x7f5e54147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 0x7f5e54147f80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400ba90 tx=0x7f5e4401a000 comp rx=0 tx=0).stop 2023-10-10T21:03:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 shutdown_connections 2023-10-10T21:03:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e40066f30 0x7f5e400693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e5415a270 0x7f5e541583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e540cbf30 0x7f5e54147f80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 --2- 172.21.15.154:0/927711983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e540ccf90 0x7f5e54157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.575+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 >> 172.21.15.154:0/927711983 conn(0x7f5e5406a320 msgr2=0x7f5e540cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:10.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.576+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 shutdown_connections 2023-10-10T21:03:10.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.576+0000 7f5e593ff700 1 -- 172.21.15.154:0/927711983 wait complete. 2023-10-10T21:03:10.594 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T21:03:10.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T21:03:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.778+0000 7f1294b9d700 1 Processor -- start 2023-10-10T21:03:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.779+0000 7f1294b9d700 1 -- start start 2023-10-10T21:03:10.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.780+0000 7f1294b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1290156350 0x7f1290157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.780+0000 7f1294b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12900b0c00 0x7f129015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.780+0000 7f1294b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12900b0570 con 0x7f12900b0760 2023-10-10T21:03:10.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.780+0000 7f1294b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12901578b0 con 0x7f12900b0c00 2023-10-10T21:03:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.780+0000 7f1294b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12900af4d0 con 0x7f1290156350 2023-10-10T21:03:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.780+0000 7f128ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12900b0c00 0x7f129015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.780+0000 7f128ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12900b0c00 0x7f129015a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33596/0 (socket says 172.21.15.154:33596) 2023-10-10T21:03:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.780+0000 7f128ffff700 1 -- 172.21.15.154:0/3634237786 learned_addr learned my addr 172.21.15.154:0/3634237786 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.780+0000 7f128f7fe700 1 --2- 172.21.15.154:0/3634237786 >> v2:172.21.15.179:3300/0 conn(0x7f1290156350 0x7f1290157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.781+0000 7f128ffff700 1 -- 172.21.15.154:0/3634237786 >> v2:172.21.15.179:3300/0 conn(0x7f1290156350 msgr2=0x7f1290157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:10.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.781+0000 7f128ffff700 1 --2- 172.21.15.154:0/3634237786 >> v2:172.21.15.179:3300/0 conn(0x7f1290156350 0x7f1290157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.781+0000 7f128ffff700 1 -- 172.21.15.154:0/3634237786 >> v1:172.21.15.179:6789/0 conn(0x7f12900b0760 legacy=0x7f1290159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.781+0000 7f128ffff700 1 -- 172.21.15.154:0/3634237786 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12900af7b0 con 0x7f12900b0c00 2023-10-10T21:03:10.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.781+0000 7f128ffff700 1 --2- 172.21.15.154:0/3634237786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0c00 0x7f129015a630 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1290065950 tx=0x7f1288009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13985bcc210442b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:10.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.781+0000 7f128effd700 1 -- 172.21.15.154:0/3634237786 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128800e070 con 0x7f12900b0c00 2023-10-10T21:03:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.781+0000 7f128effd700 1 -- 172.21.15.154:0/3634237786 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128800ba50 con 0x7f12900b0c00 2023-10-10T21:03:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.781+0000 7f128effd700 1 -- 172.21.15.154:0/3634237786 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12880092e0 con 0x7f12900b0c00 2023-10-10T21:03:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.782+0000 7f1294b9d700 1 -- 172.21.15.154:0/3634237786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0c00 msgr2=0x7f129015a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.782+0000 7f1294b9d700 1 --2- 172.21.15.154:0/3634237786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0c00 0x7f129015a630 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1290065950 tx=0x7f1288009840 comp rx=0 tx=0).stop 2023-10-10T21:03:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.782+0000 7f1294b9d700 1 -- 172.21.15.154:0/3634237786 shutdown_connections 2023-10-10T21:03:10.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.782+0000 7f1294b9d700 1 --2- 172.21.15.154:0/3634237786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0c00 0x7f129015a630 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.782+0000 7f1294b9d700 1 --2- 172.21.15.154:0/3634237786 >> v2:172.21.15.179:3300/0 conn(0x7f1290156350 0x7f1290157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.782+0000 7f1294b9d700 1 -- 172.21.15.154:0/3634237786 >> 172.21.15.154:0/3634237786 conn(0x7f1290068e20 msgr2=0x7f12900cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:10.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.782+0000 7f1294b9d700 1 -- 172.21.15.154:0/3634237786 shutdown_connections 2023-10-10T21:03:10.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.782+0000 7f1294b9d700 1 -- 172.21.15.154:0/3634237786 wait complete. 2023-10-10T21:03:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.783+0000 7f1294b9d700 1 Processor -- start 2023-10-10T21:03:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.783+0000 7f1294b9d700 1 -- start start 2023-10-10T21:03:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.784+0000 7f1294b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0760 0x7f1290069e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.784+0000 7f1294b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12900b0c00 0x7f1290142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.784+0000 7f1294b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1290156350 0x7f1290153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.784+0000 7f1294b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1290143450 con 0x7f12900b0760 2023-10-10T21:03:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.784+0000 7f1294b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12900acdb0 con 0x7f12900b0c00 2023-10-10T21:03:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.784+0000 7f1294b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1290167950 con 0x7f1290156350 2023-10-10T21:03:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0760 0x7f1290069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0760 0x7f1290069e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33602/0 (socket says 172.21.15.154:33602) 2023-10-10T21:03:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128f7fe700 1 -- 172.21.15.154:0/432659826 learned_addr learned my addr 172.21.15.154:0/432659826 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:10.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128ffff700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1290156350 0x7f1290153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f1287fff700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12900b0c00 0x7f1290142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128f7fe700 1 -- 172.21.15.154:0/432659826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1290156350 msgr2=0x7f1290153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128f7fe700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1290156350 0x7f1290153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128f7fe700 1 -- 172.21.15.154:0/432659826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12900b0c00 msgr2=0x7f1290142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:10.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128f7fe700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12900b0c00 0x7f1290142f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:10.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128f7fe700 1 -- 172.21.15.154:0/432659826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009ae0 con 0x7f12900b0760 2023-10-10T21:03:10.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f128f7fe700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0760 0x7f1290069e60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f128000d890 tx=0x7f1280008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:10.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.785+0000 7f12877fe700 1 -- 172.21.15.154:0/432659826 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000b600 con 0x7f12900b0760 2023-10-10T21:03:10.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.786+0000 7f12877fe700 1 -- 172.21.15.154:0/432659826 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128000b760 con 0x7f12900b0760 2023-10-10T21:03:10.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.786+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12900ac1a0 con 0x7f12900b0760 2023-10-10T21:03:10.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.786+0000 7f12877fe700 1 -- 172.21.15.154:0/432659826 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000bae0 con 0x7f12900b0760 2023-10-10T21:03:10.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.786+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12900ac760 con 0x7f12900b0760 2023-10-10T21:03:10.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.787+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12900ad090 con 0x7f12900b0760 2023-10-10T21:03:10.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.787+0000 7f12877fe700 1 -- 172.21.15.154:0/432659826 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f128001e460 con 0x7f12900b0760 2023-10-10T21:03:10.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.788+0000 7f12877fe700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1270066f30 0x7f12700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:10.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.788+0000 7f12877fe700 1 -- 172.21.15.154:0/432659826 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1280084990 con 0x7f12900b0760 2023-10-10T21:03:10.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.789+0000 7f1287fff700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1270066f30 0x7f12700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:10.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.789+0000 7f1287fff700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1270066f30 0x7f12700693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f12900b1420 tx=0x7f1278009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:10.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.792+0000 7f12877fe700 1 -- 172.21.15.154:0/432659826 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1280051eb0 con 0x7f12900b0760 2023-10-10T21:03:10.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:10.985+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f129006b7e0 con 0x7f12900b0760 2023-10-10T21:03:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.860+0000 7f12877fe700 1 -- 172.21.15.154:0/432659826 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f12800554d0 con 0x7f12900b0760 2023-10-10T21:03:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.866+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1270066f30 msgr2=0x7f12700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.866+0000 7f1294b9d700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1270066f30 0x7f12700693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f12900b1420 tx=0x7f1278009040 comp rx=0 tx=0).stop 2023-10-10T21:03:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.866+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0760 msgr2=0x7f1290069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.866+0000 7f1294b9d700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0760 0x7f1290069e60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f128000d890 tx=0x7f1280008040 comp rx=0 tx=0).stop 2023-10-10T21:03:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.868+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 shutdown_connections 2023-10-10T21:03:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.868+0000 7f1294b9d700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1270066f30 0x7f12700693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.868+0000 7f1294b9d700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1290156350 0x7f1290153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.868+0000 7f1294b9d700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12900b0760 0x7f1290069e60 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f128000d890 tx=0x7f1280008040 comp rx=0 tx=0).stop 2023-10-10T21:03:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.868+0000 7f1294b9d700 1 --2- 172.21.15.154:0/432659826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12900b0c00 0x7f1290142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.868+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 >> 172.21.15.154:0/432659826 conn(0x7f1290068e20 msgr2=0x7f129014b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:11.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.869+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 shutdown_connections 2023-10-10T21:03:11.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:11.869+0000 7f1294b9d700 1 -- 172.21.15.154:0/432659826 wait complete. 2023-10-10T21:03:11.873 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T21:03:11.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T21:03:12.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.081+0000 7f4b19bff700 1 Processor -- start 2023-10-10T21:03:12.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.081+0000 7f4b19bff700 1 -- start start 2023-10-10T21:03:12.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.082+0000 7f4b19bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157630 0x7f4b14158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:12.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.082+0000 7f4b19bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b14068390 0x7f4b14068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:12.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.082+0000 7f4b19bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b14158590 con 0x7f4b14157a00 2023-10-10T21:03:12.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.082+0000 7f4b19bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b14068d50 con 0x7f4b14068390 2023-10-10T21:03:12.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.082+0000 7f4b19bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b14157f80 con 0x7f4b14157630 2023-10-10T21:03:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b12ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4b14157a00 0x7f4b140abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39588/0 (socket says 172.21.15.154:39588) 2023-10-10T21:03:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b12ffd700 1 -- 172.21.15.154:0/411218162 learned_addr learned my addr 172.21.15.154:0/411218162 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b13fff700 1 --2- 172.21.15.154:0/411218162 >> v2:172.21.15.154:3300/0 conn(0x7f4b14068390 0x7f4b14068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b137fe700 1 --2- 172.21.15.154:0/411218162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157630 0x7f4b14158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b127fc700 1 -- 172.21.15.154:0/411218162 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453492970 0 0) 0x7f4b14158590 con 0x7f4b14157a00 2023-10-10T21:03:12.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b127fc700 1 -- 172.21.15.154:0/411218162 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4afc003570 con 0x7f4b14157a00 2023-10-10T21:03:12.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b13fff700 1 -- 172.21.15.154:0/411218162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157630 msgr2=0x7f4b14158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:12.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b13fff700 1 --2- 172.21.15.154:0/411218162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157630 0x7f4b14158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b13fff700 1 -- 172.21.15.154:0/411218162 >> v1:172.21.15.154:6789/0 conn(0x7f4b14157a00 legacy=0x7f4b140abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:12.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b13fff700 1 -- 172.21.15.154:0/411218162 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b140ac7a0 con 0x7f4b14068390 2023-10-10T21:03:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.083+0000 7f4b13fff700 1 --2- 172.21.15.154:0/411218162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14068390 0x7f4b14068810 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e60 tx=0x7f4b0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ba60733d3d0dee server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b127fc700 1 -- 172.21.15.154:0/411218162 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00e070 con 0x7f4b14068390 2023-10-10T21:03:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b127fc700 1 -- 172.21.15.154:0/411218162 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c00bab0 con 0x7f4b14068390 2023-10-10T21:03:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b127fc700 1 -- 172.21.15.154:0/411218162 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00be30 con 0x7f4b14068390 2023-10-10T21:03:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b19bff700 1 -- 172.21.15.154:0/411218162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14068390 msgr2=0x7f4b14068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b19bff700 1 --2- 172.21.15.154:0/411218162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14068390 0x7f4b14068810 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e60 tx=0x7f4b0c009780 comp rx=0 tx=0).stop 2023-10-10T21:03:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b19bff700 1 -- 172.21.15.154:0/411218162 shutdown_connections 2023-10-10T21:03:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b19bff700 1 --2- 172.21.15.154:0/411218162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14068390 0x7f4b14068810 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b19bff700 1 --2- 172.21.15.154:0/411218162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157630 0x7f4b14158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b19bff700 1 -- 172.21.15.154:0/411218162 >> 172.21.15.154:0/411218162 conn(0x7f4b140cc540 msgr2=0x7f4b140cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b19bff700 1 -- 172.21.15.154:0/411218162 shutdown_connections 2023-10-10T21:03:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.084+0000 7f4b19bff700 1 -- 172.21.15.154:0/411218162 wait complete. 2023-10-10T21:03:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.086+0000 7f4b19bff700 1 Processor -- start 2023-10-10T21:03:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.086+0000 7f4b19bff700 1 -- start start 2023-10-10T21:03:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b19bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b14068390 0x7f4b14154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b19bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14157630 0x7f4b140a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b19bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157a00 0x7f4b140aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b19bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140ca070 con 0x7f4b14157630 2023-10-10T21:03:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b19bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140ca910 con 0x7f4b14068390 2023-10-10T21:03:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b19bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140c6080 con 0x7f4b14157a00 2023-10-10T21:03:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b12ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14157630 0x7f4b140a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b12ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14157630 0x7f4b140a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33608/0 (socket says 172.21.15.154:33608) 2023-10-10T21:03:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b12ffd700 1 -- 172.21.15.154:0/2077884104 learned_addr learned my addr 172.21.15.154:0/2077884104 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b13fff700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157a00 0x7f4b140aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b137fe700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b14068390 0x7f4b14154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b12ffd700 1 -- 172.21.15.154:0/2077884104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157a00 msgr2=0x7f4b140aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.087+0000 7f4b12ffd700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157a00 0x7f4b140aa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.088+0000 7f4b12ffd700 1 -- 172.21.15.154:0/2077884104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b14068390 msgr2=0x7f4b14154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.088+0000 7f4b12ffd700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b14068390 0x7f4b14154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.088+0000 7f4b12ffd700 1 -- 172.21.15.154:0/2077884104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009a20 con 0x7f4b14157630 2023-10-10T21:03:12.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.088+0000 7f4b12ffd700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14157630 0x7f4b140a9c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b080011e0 tx=0x7f4b08007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:12.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.088+0000 7f4afb7fe700 1 -- 172.21.15.154:0/2077884104 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08005b30 con 0x7f4b14157630 2023-10-10T21:03:12.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.088+0000 7f4afb7fe700 1 -- 172.21.15.154:0/2077884104 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b08005c90 con 0x7f4b14157630 2023-10-10T21:03:12.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.088+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b140ca2c0 con 0x7f4b14157630 2023-10-10T21:03:12.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.088+0000 7f4afb7fe700 1 -- 172.21.15.154:0/2077884104 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08007320 con 0x7f4b14157630 2023-10-10T21:03:12.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.088+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b140c5320 con 0x7f4b14157630 2023-10-10T21:03:12.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.089+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b140caa80 con 0x7f4b14157630 2023-10-10T21:03:12.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.090+0000 7f4afb7fe700 1 -- 172.21.15.154:0/2077884104 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b08007690 con 0x7f4b14157630 2023-10-10T21:03:12.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.091+0000 7f4afb7fe700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4b00066f30 0x7f4b000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:12.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.091+0000 7f4afb7fe700 1 -- 172.21.15.154:0/2077884104 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f4b080838e0 con 0x7f4b14157630 2023-10-10T21:03:12.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.091+0000 7f4b137fe700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4b00066f30 0x7f4b000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:12.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.092+0000 7f4b137fe700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4b00066f30 0x7f4b000693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009d40 tx=0x7f4b04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:12.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.096+0000 7f4afb7fe700 1 -- 172.21.15.154:0/2077884104 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b08050c90 con 0x7f4b14157630 2023-10-10T21:03:12.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.285+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4b140718b0 con 0x7f4b14157630 2023-10-10T21:03:12.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.868+0000 7f4afb7fe700 1 -- 172.21.15.154:0/2077884104 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4b08017020 con 0x7f4b14157630 2023-10-10T21:03:12.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4b00066f30 msgr2=0x7f4b000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:12.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4b00066f30 0x7f4b000693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009d40 tx=0x7f4b04008040 comp rx=0 tx=0).stop 2023-10-10T21:03:12.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14157630 msgr2=0x7f4b140a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:12.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14157630 0x7f4b140a9c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b080011e0 tx=0x7f4b08007df0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 shutdown_connections 2023-10-10T21:03:12.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4b00066f30 0x7f4b000693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b14157a00 0x7f4b140aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b14068390 0x7f4b14154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 --2- 172.21.15.154:0/2077884104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b14157630 0x7f4b140a9c50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:12.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 >> 172.21.15.154:0/2077884104 conn(0x7f4b140cc540 msgr2=0x7f4b141568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:12.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 shutdown_connections 2023-10-10T21:03:12.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:12.882+0000 7f4b19bff700 1 -- 172.21.15.154:0/2077884104 wait complete. 2023-10-10T21:03:12.887 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T21:03:12.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T21:03:13.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.091+0000 7f20ebfff700 1 Processor -- start 2023-10-10T21:03:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.091+0000 7f20ebfff700 1 -- start start 2023-10-10T21:03:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.092+0000 7f20ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec153900 0x7f20ec0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.093+0000 7f20ebfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec06e150 con 0x7f20ec0c9db0 2023-10-10T21:03:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.093+0000 7f20ebfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0c7800 con 0x7f20ec06a710 2023-10-10T21:03:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.093+0000 7f20ebfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0c7ae0 con 0x7f20ec153900 2023-10-10T21:03:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.093+0000 7f20e3fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f20ec0c9db0 0x7f20ec06a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39592/0 (socket says 172.21.15.154:39592) 2023-10-10T21:03:13.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.093+0000 7f20e3fff700 1 -- 172.21.15.154:0/3499484890 learned_addr learned my addr 172.21.15.154:0/3499484890 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:13.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.093+0000 7f20eaffd700 1 --2- 172.21.15.154:0/3499484890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec153900 0x7f20ec0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:13.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.093+0000 7f20ea7fc700 1 -- 172.21.15.154:0/3499484890 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685571883 0 0) 0x7f20ec06e150 con 0x7f20ec0c9db0 2023-10-10T21:03:13.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.093+0000 7f20ea7fc700 1 -- 172.21.15.154:0/3499484890 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d8003570 con 0x7f20ec0c9db0 2023-10-10T21:03:13.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20ea7fc700 1 -- 172.21.15.154:0/3499484890 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511510030 0 0) 0x7f20ec0c7800 con 0x7f20ec06a710 2023-10-10T21:03:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20ea7fc700 1 -- 172.21.15.154:0/3499484890 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20ec06e150 con 0x7f20ec06a710 2023-10-10T21:03:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20ea7fc700 1 -- 172.21.15.154:0/3499484890 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3978039847 0 0) 0x7f20d8003570 con 0x7f20ec0c9db0 2023-10-10T21:03:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20eaffd700 1 -- 172.21.15.154:0/3499484890 >> v1:172.21.15.179:6789/0 conn(0x7f20ec06a710 legacy=0x7f20ec06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20eaffd700 1 -- 172.21.15.154:0/3499484890 >> v1:172.21.15.154:6789/0 conn(0x7f20ec0c9db0 legacy=0x7f20ec06a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20eaffd700 1 -- 172.21.15.154:0/3499484890 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0c7dc0 con 0x7f20ec153900 2023-10-10T21:03:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20eaffd700 1 --2- 172.21.15.154:0/3499484890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec153900 0x7f20ec0c6f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009910 tx=0x7f20dc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba43b55cfd63d022 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20ea7fc700 1 -- 172.21.15.154:0/3499484890 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4001470 con 0x7f20ec153900 2023-10-10T21:03:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20ea7fc700 1 -- 172.21.15.154:0/3499484890 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc011420 con 0x7f20ec153900 2023-10-10T21:03:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.094+0000 7f20ea7fc700 1 -- 172.21.15.154:0/3499484890 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0117c0 con 0x7f20ec153900 2023-10-10T21:03:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.095+0000 7f20ebfff700 1 -- 172.21.15.154:0/3499484890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec153900 msgr2=0x7f20ec0c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.095+0000 7f20ebfff700 1 --2- 172.21.15.154:0/3499484890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec153900 0x7f20ec0c6f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009910 tx=0x7f20dc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.095+0000 7f20ebfff700 1 -- 172.21.15.154:0/3499484890 shutdown_connections 2023-10-10T21:03:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.095+0000 7f20ebfff700 1 --2- 172.21.15.154:0/3499484890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec153900 0x7f20ec0c6f00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:13.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.095+0000 7f20ebfff700 1 -- 172.21.15.154:0/3499484890 >> 172.21.15.154:0/3499484890 conn(0x7f20ec0cc1e0 msgr2=0x7f20ec0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:13.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.095+0000 7f20ebfff700 1 -- 172.21.15.154:0/3499484890 shutdown_connections 2023-10-10T21:03:13.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.095+0000 7f20ebfff700 1 -- 172.21.15.154:0/3499484890 wait complete. 2023-10-10T21:03:13.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.096+0000 7f20ebfff700 1 Processor -- start 2023-10-10T21:03:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.096+0000 7f20ebfff700 1 -- start start 2023-10-10T21:03:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.097+0000 7f20ebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec06a710 0x7f20ec0abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.097+0000 7f20ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec0c9db0 0x7f20ec0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.097+0000 7f20ebfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ec153900 0x7f20ec1523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.097+0000 7f20ebfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0b1d40 con 0x7f20ec06a710 2023-10-10T21:03:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.097+0000 7f20ebfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1528e0 con 0x7f20ec153900 2023-10-10T21:03:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.097+0000 7f20ebfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0ac130 con 0x7f20ec0c9db0 2023-10-10T21:03:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec06a710 0x7f20ec0abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec06a710 0x7f20ec0abae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33622/0 (socket says 172.21.15.154:33622) 2023-10-10T21:03:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eaffd700 1 -- 172.21.15.154:0/1627441593 learned_addr learned my addr 172.21.15.154:0/1627441593 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20e3fff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec0c9db0 0x7f20ec0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eb7fe700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ec153900 0x7f20ec1523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eaffd700 1 -- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec0c9db0 msgr2=0x7f20ec0b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eaffd700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec0c9db0 0x7f20ec0b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eaffd700 1 -- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ec153900 msgr2=0x7f20ec1523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eaffd700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ec153900 0x7f20ec1523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eaffd700 1 -- 172.21.15.154:0/1627441593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc009420 con 0x7f20ec06a710 2023-10-10T21:03:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20e3fff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec0c9db0 0x7f20ec0b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eb7fe700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ec153900 0x7f20ec1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20eaffd700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec06a710 0x7f20ec0abae0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0091e0 tx=0x7f20dc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.098+0000 7f20e2ffd700 1 -- 172.21.15.154:0/1627441593 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc01cc90 con 0x7f20ec06a710 2023-10-10T21:03:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.099+0000 7f20e2ffd700 1 -- 172.21.15.154:0/1627441593 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc01cdf0 con 0x7f20ec06a710 2023-10-10T21:03:13.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.099+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec0ac410 con 0x7f20ec06a710 2023-10-10T21:03:13.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.099+0000 7f20e2ffd700 1 -- 172.21.15.154:0/1627441593 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc01a6a0 con 0x7f20ec06a710 2023-10-10T21:03:13.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.099+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec0ac9d0 con 0x7f20ec06a710 2023-10-10T21:03:13.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.100+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec06c450 con 0x7f20ec06a710 2023-10-10T21:03:13.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.101+0000 7f20e2ffd700 1 -- 172.21.15.154:0/1627441593 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20dc01aa90 con 0x7f20ec06a710 2023-10-10T21:03:13.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.102+0000 7f20e2ffd700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f20cc066f30 0x7f20cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:13.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.102+0000 7f20e2ffd700 1 -- 172.21.15.154:0/1627441593 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f20dc086850 con 0x7f20ec06a710 2023-10-10T21:03:13.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.103+0000 7f20e3fff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f20cc066f30 0x7f20cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:13.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.103+0000 7f20e3fff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f20cc066f30 0x7f20cc0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f20d4001540 tx=0x7f20d4001940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:13.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.106+0000 7f20e2ffd700 1 -- 172.21.15.154:0/1627441593 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20dc053ba0 con 0x7f20ec06a710 2023-10-10T21:03:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:13.343+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f20ec06dd20 con 0x7f20ec06a710 2023-10-10T21:03:14.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.043+0000 7f20e2ffd700 1 -- 172.21.15.154:0/1627441593 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f20dc0571c0 con 0x7f20ec06a710 2023-10-10T21:03:14.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.054+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f20cc066f30 msgr2=0x7f20cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.054+0000 7f20ebfff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f20cc066f30 0x7f20cc0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f20d4001540 tx=0x7f20d4001940 comp rx=0 tx=0).stop 2023-10-10T21:03:14.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.054+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec06a710 msgr2=0x7f20ec0abae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.054+0000 7f20ebfff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec06a710 0x7f20ec0abae0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0091e0 tx=0x7f20dc016000 comp rx=0 tx=0).stop 2023-10-10T21:03:14.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.056+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 shutdown_connections 2023-10-10T21:03:14.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.056+0000 7f20ebfff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ec153900 0x7f20ec1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.056+0000 7f20ebfff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec06a710 0x7f20ec0abae0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.056+0000 7f20ebfff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f20cc066f30 0x7f20cc0693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.056+0000 7f20ebfff700 1 --2- 172.21.15.154:0/1627441593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20ec0c9db0 0x7f20ec0b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.056+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 >> 172.21.15.154:0/1627441593 conn(0x7f20ec0cc1e0 msgr2=0x7f20ec0ab280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:14.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.056+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 shutdown_connections 2023-10-10T21:03:14.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.056+0000 7f20ebfff700 1 -- 172.21.15.154:0/1627441593 wait complete. 2023-10-10T21:03:14.061 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 4 and data pool 5 2023-10-10T21:03:14.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:03:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.265+0000 7f7a347ff700 1 Processor -- start 2023-10-10T21:03:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.265+0000 7f7a347ff700 1 -- start start 2023-10-10T21:03:14.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.266+0000 7f7a347ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a2c159890 0x7f7a2c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.266+0000 7f7a347ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a2c159c60 0x7f7a2c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.266+0000 7f7a347ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c15db10 0x7f7a2c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.266+0000 7f7a347ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c15df50 con 0x7f7a2c159c60 2023-10-10T21:03:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.266+0000 7f7a347ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c15a160 con 0x7f7a2c159890 2023-10-10T21:03:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.266+0000 7f7a347ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0d13a0 con 0x7f7a2c15db10 2023-10-10T21:03:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a31d9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a2c159c60 0x7f7a2c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a31d9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a2c159c60 0x7f7a2c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33636/0 (socket says 172.21.15.154:33636) 2023-10-10T21:03:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a31d9a700 1 -- 172.21.15.154:0/3042819480 learned_addr learned my addr 172.21.15.154:0/3042819480 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a3259b700 1 --2- 172.21.15.154:0/3042819480 >> v2:172.21.15.179:3300/0 conn(0x7f7a2c159890 0x7f7a2c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a32d9c700 1 --2- 172.21.15.154:0/3042819480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c15db10 0x7f7a2c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a31d9a700 1 -- 172.21.15.154:0/3042819480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c15db10 msgr2=0x7f7a2c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a31d9a700 1 --2- 172.21.15.154:0/3042819480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c15db10 0x7f7a2c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a31d9a700 1 -- 172.21.15.154:0/3042819480 >> v2:172.21.15.179:3300/0 conn(0x7f7a2c159890 msgr2=0x7f7a2c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a31d9a700 1 --2- 172.21.15.154:0/3042819480 >> v2:172.21.15.179:3300/0 conn(0x7f7a2c159890 0x7f7a2c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a31d9a700 1 -- 172.21.15.154:0/3042819480 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c15e140 con 0x7f7a2c159c60 2023-10-10T21:03:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a3259b700 1 --2- 172.21.15.154:0/3042819480 >> v2:172.21.15.179:3300/0 conn(0x7f7a2c159890 0x7f7a2c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.267+0000 7f7a31d9a700 1 --2- 172.21.15.154:0/3042819480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 0x7f7a2c15d5d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0d1090 tx=0x7f7a1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e628ccd168af142 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a31599700 1 -- 172.21.15.154:0/3042819480 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c009e70 con 0x7f7a2c159c60 2023-10-10T21:03:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a31599700 1 -- 172.21.15.154:0/3042819480 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00b860 con 0x7f7a2c159c60 2023-10-10T21:03:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a31599700 1 -- 172.21.15.154:0/3042819480 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00bc00 con 0x7f7a2c159c60 2023-10-10T21:03:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a347ff700 1 -- 172.21.15.154:0/3042819480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 msgr2=0x7f7a2c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a347ff700 1 --2- 172.21.15.154:0/3042819480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 0x7f7a2c15d5d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0d1090 tx=0x7f7a1c009250 comp rx=0 tx=0).stop 2023-10-10T21:03:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a347ff700 1 -- 172.21.15.154:0/3042819480 shutdown_connections 2023-10-10T21:03:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a347ff700 1 --2- 172.21.15.154:0/3042819480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c15db10 0x7f7a2c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a347ff700 1 --2- 172.21.15.154:0/3042819480 >> v2:172.21.15.179:3300/0 conn(0x7f7a2c159890 0x7f7a2c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a347ff700 1 --2- 172.21.15.154:0/3042819480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 0x7f7a2c15d5d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a347ff700 1 -- 172.21.15.154:0/3042819480 >> 172.21.15.154:0/3042819480 conn(0x7f7a2c068e20 msgr2=0x7f7a2c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a347ff700 1 -- 172.21.15.154:0/3042819480 shutdown_connections 2023-10-10T21:03:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.268+0000 7f7a347ff700 1 -- 172.21.15.154:0/3042819480 wait complete. 2023-10-10T21:03:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.270+0000 7f7a347ff700 1 Processor -- start 2023-10-10T21:03:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.270+0000 7f7a347ff700 1 -- start start 2023-10-10T21:03:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a347ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c159890 0x7f7a2c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a347ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 0x7f7a2c16d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a347ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a2c15db10 0x7f7a2c145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a347ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c15b850 con 0x7f7a2c159c60 2023-10-10T21:03:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a347ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c15bb30 con 0x7f7a2c15db10 2023-10-10T21:03:14.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a347ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c16d8b0 con 0x7f7a2c159890 2023-10-10T21:03:14.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a31d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 0x7f7a2c16d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a31d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 0x7f7a2c16d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33644/0 (socket says 172.21.15.154:33644) 2023-10-10T21:03:14.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a31d9a700 1 -- 172.21.15.154:0/1168880031 learned_addr learned my addr 172.21.15.154:0/1168880031 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:14.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a31d9a700 1 -- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c159890 msgr2=0x7f7a2c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a3259b700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c159890 0x7f7a2c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a32d9c700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a2c15db10 0x7f7a2c145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a31d9a700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c159890 0x7f7a2c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a31d9a700 1 -- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a2c15db10 msgr2=0x7f7a2c145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a31d9a700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a2c15db10 0x7f7a2c145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a31d9a700 1 -- 172.21.15.154:0/1168880031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0094f0 con 0x7f7a2c159c60 2023-10-10T21:03:14.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a3259b700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c159890 0x7f7a2c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:14.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.271+0000 7f7a32d9c700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a2c15db10 0x7f7a2c145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:14.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.272+0000 7f7a31d9a700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 0x7f7a2c16d370 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0090b0 tx=0x7f7a1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:14.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.272+0000 7f7a227fc700 1 -- 172.21.15.154:0/1168880031 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00bbe0 con 0x7f7a2c159c60 2023-10-10T21:03:14.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.272+0000 7f7a227fc700 1 -- 172.21.15.154:0/1168880031 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c01f070 con 0x7f7a2c159c60 2023-10-10T21:03:14.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.272+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c16db50 con 0x7f7a2c159c60 2023-10-10T21:03:14.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.272+0000 7f7a227fc700 1 -- 172.21.15.154:0/1168880031 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0266b0 con 0x7f7a2c159c60 2023-10-10T21:03:14.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.272+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c16e110 con 0x7f7a2c159c60 2023-10-10T21:03:14.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.273+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c16e300 con 0x7f7a2c159c60 2023-10-10T21:03:14.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.274+0000 7f7a227fc700 1 -- 172.21.15.154:0/1168880031 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a1c026a20 con 0x7f7a2c159c60 2023-10-10T21:03:14.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.275+0000 7f7a227fc700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7a10066f30 0x7f7a100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.275+0000 7f7a227fc700 1 -- 172.21.15.154:0/1168880031 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a1c021070 con 0x7f7a2c159c60 2023-10-10T21:03:14.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.275+0000 7f7a3259b700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7a10066f30 0x7f7a100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.276+0000 7f7a3259b700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7a10066f30 0x7f7a100693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a28006f00 tx=0x7f7a28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:14.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.280+0000 7f7a227fc700 1 -- 172.21.15.154:0/1168880031 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a1c053550 con 0x7f7a2c159c60 2023-10-10T21:03:14.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.470+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a2c04c3c0 con 0x7f7a2c159c60 2023-10-10T21:03:14.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.471+0000 7f7a227fc700 1 -- 172.21.15.154:0/1168880031 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f7a1c015090 con 0x7f7a2c159c60 2023-10-10T21:03:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:14.473 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":33,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:03:13.344319+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:03:11.022869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-10T21:03:12.323498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:03:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7a10066f30 msgr2=0x7f7a100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7a10066f30 0x7f7a100693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a28006f00 tx=0x7f7a28008040 comp rx=0 tx=0).stop 2023-10-10T21:03:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 msgr2=0x7f7a2c16d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 0x7f7a2c16d370 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0090b0 tx=0x7f7a1c017000 comp rx=0 tx=0).stop 2023-10-10T21:03:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 shutdown_connections 2023-10-10T21:03:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a2c15db10 0x7f7a2c145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7a10066f30 0x7f7a100693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a2c159890 0x7f7a2c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 --2- 172.21.15.154:0/1168880031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a2c159c60 0x7f7a2c16d370 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 >> 172.21.15.154:0/1168880031 conn(0x7f7a2c068e20 msgr2=0x7f7a2c152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 shutdown_connections 2023-10-10T21:03:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.474+0000 7f7a347ff700 1 -- 172.21.15.154:0/1168880031 wait complete. 2023-10-10T21:03:14.493 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:03:14.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.675+0000 7f8c887ff700 1 Processor -- start 2023-10-10T21:03:14.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.675+0000 7f8c887ff700 1 -- start start 2023-10-10T21:03:14.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.676+0000 7f8c887ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c800cbf30 0x7f8c800ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.676+0000 7f8c887ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 0x7f8c800b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.676+0000 7f8c887ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c8015a270 0x7f8c800b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.676+0000 7f8c887ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c80156bf0 con 0x7f8c800cbf30 2023-10-10T21:03:14.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.676+0000 7f8c887ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c800ae950 con 0x7f8c8015a270 2023-10-10T21:03:14.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.676+0000 7f8c887ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800cc300 con 0x7f8c800ccf90 2023-10-10T21:03:14.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c8659b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c800cbf30 0x7f8c800ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c85d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 0x7f8c800b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c8659b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c800cbf30 0x7f8c800ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33654/0 (socket says 172.21.15.154:33654) 2023-10-10T21:03:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c8659b700 1 -- 172.21.15.154:0/422196524 learned_addr learned my addr 172.21.15.154:0/422196524 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c86d9c700 1 --2- 172.21.15.154:0/422196524 >> v2:172.21.15.179:3300/0 conn(0x7f8c8015a270 0x7f8c800b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c8659b700 1 -- 172.21.15.154:0/422196524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 msgr2=0x7f8c800b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c8659b700 1 --2- 172.21.15.154:0/422196524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 0x7f8c800b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c8659b700 1 -- 172.21.15.154:0/422196524 >> v2:172.21.15.179:3300/0 conn(0x7f8c8015a270 msgr2=0x7f8c800b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c8659b700 1 --2- 172.21.15.154:0/422196524 >> v2:172.21.15.179:3300/0 conn(0x7f8c8015a270 0x7f8c800b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c8659b700 1 -- 172.21.15.154:0/422196524 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c800ad370 con 0x7f8c800cbf30 2023-10-10T21:03:14.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.677+0000 7f8c8659b700 1 --2- 172.21.15.154:0/422196524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c800cbf30 0x7f8c800ae410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b25e0 tx=0x7f8c7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873a9b35145f5293 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:14.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c85599700 1 -- 172.21.15.154:0/422196524 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00b640 con 0x7f8c800cbf30 2023-10-10T21:03:14.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c85599700 1 -- 172.21.15.154:0/422196524 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c00b7a0 con 0x7f8c800cbf30 2023-10-10T21:03:14.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c85599700 1 -- 172.21.15.154:0/422196524 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00bb40 con 0x7f8c800cbf30 2023-10-10T21:03:14.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c887ff700 1 -- 172.21.15.154:0/422196524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c800cbf30 msgr2=0x7f8c800ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c887ff700 1 --2- 172.21.15.154:0/422196524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c800cbf30 0x7f8c800ae410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b25e0 tx=0x7f8c7c009250 comp rx=0 tx=0).stop 2023-10-10T21:03:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c887ff700 1 -- 172.21.15.154:0/422196524 shutdown_connections 2023-10-10T21:03:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c887ff700 1 --2- 172.21.15.154:0/422196524 >> v2:172.21.15.179:3300/0 conn(0x7f8c8015a270 0x7f8c800b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c887ff700 1 --2- 172.21.15.154:0/422196524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c800cbf30 0x7f8c800ae410 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c887ff700 1 --2- 172.21.15.154:0/422196524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 0x7f8c800b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c887ff700 1 -- 172.21.15.154:0/422196524 >> 172.21.15.154:0/422196524 conn(0x7f8c8006a320 msgr2=0x7f8c800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c887ff700 1 -- 172.21.15.154:0/422196524 shutdown_connections 2023-10-10T21:03:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.678+0000 7f8c887ff700 1 -- 172.21.15.154:0/422196524 wait complete. 2023-10-10T21:03:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.680+0000 7f8c887ff700 1 Processor -- start 2023-10-10T21:03:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.680+0000 7f8c887ff700 1 -- start start 2023-10-10T21:03:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c887ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c800cbf30 0x7f8c800a7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c887ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 0x7f8c800c1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c887ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c8015a270 0x7f8c80169220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c887ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c801478d0 con 0x7f8c8015a270 2023-10-10T21:03:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c887ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800a8510 con 0x7f8c800cbf30 2023-10-10T21:03:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c887ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800c1880 con 0x7f8c800ccf90 2023-10-10T21:03:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c86d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c8015a270 0x7f8c80169220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c86d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c8015a270 0x7f8c80169220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33658/0 (socket says 172.21.15.154:33658) 2023-10-10T21:03:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c86d9c700 1 -- 172.21.15.154:0/4226609830 learned_addr learned my addr 172.21.15.154:0/4226609830 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c8659b700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c800cbf30 0x7f8c800a7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c85d9a700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 0x7f8c800c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c86d9c700 1 -- 172.21.15.154:0/4226609830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 msgr2=0x7f8c800c1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c86d9c700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 0x7f8c800c1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c86d9c700 1 -- 172.21.15.154:0/4226609830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c800cbf30 msgr2=0x7f8c800a7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.681+0000 7f8c86d9c700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c800cbf30 0x7f8c800a7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.682+0000 7f8c86d9c700 1 -- 172.21.15.154:0/4226609830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0094f0 con 0x7f8c8015a270 2023-10-10T21:03:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.682+0000 7f8c86d9c700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c8015a270 0x7f8c80169220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009e90 tx=0x7f8c7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.682+0000 7f8c767fc700 1 -- 172.21.15.154:0/4226609830 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800ca40 con 0x7f8c8015a270 2023-10-10T21:03:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.682+0000 7f8c767fc700 1 -- 172.21.15.154:0/4226609830 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7800f040 con 0x7f8c8015a270 2023-10-10T21:03:14.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.682+0000 7f8c767fc700 1 -- 172.21.15.154:0/4226609830 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800ce10 con 0x7f8c8015a270 2023-10-10T21:03:14.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.682+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c80166de0 con 0x7f8c8015a270 2023-10-10T21:03:14.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.682+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c800a8d10 con 0x7f8c8015a270 2023-10-10T21:03:14.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.683+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c800a87e0 con 0x7f8c8015a270 2023-10-10T21:03:14.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.684+0000 7f8c767fc700 1 -- 172.21.15.154:0/4226609830 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c78014690 con 0x7f8c8015a270 2023-10-10T21:03:14.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.685+0000 7f8c767fc700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c64066f30 0x7f8c640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:14.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.685+0000 7f8c767fc700 1 -- 172.21.15.154:0/4226609830 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c78084e20 con 0x7f8c8015a270 2023-10-10T21:03:14.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.685+0000 7f8c8659b700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c64066f30 0x7f8c640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:14.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.686+0000 7f8c8659b700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c64066f30 0x7f8c640693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b25e0 tx=0x7f8c7c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:14.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.689+0000 7f8c767fc700 1 -- 172.21.15.154:0/4226609830 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c78051ff0 con 0x7f8c8015a270 2023-10-10T21:03:14.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.884+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c800678d0 con 0x7f8c8015a270 2023-10-10T21:03:14.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.885+0000 7f8c767fc700 1 -- 172.21.15.154:0/4226609830 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f8c78055610 con 0x7f8c8015a270 2023-10-10T21:03:14.887 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:14.887 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":33,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:03:13.344319+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:03:11.022869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-10T21:03:12.323498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:03:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.887+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c64066f30 msgr2=0x7f8c640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.887+0000 7f8c887ff700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c64066f30 0x7f8c640693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b25e0 tx=0x7f8c7c017000 comp rx=0 tx=0).stop 2023-10-10T21:03:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c8015a270 msgr2=0x7f8c80169220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c8015a270 0x7f8c80169220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009e90 tx=0x7f8c7800b040 comp rx=0 tx=0).stop 2023-10-10T21:03:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 shutdown_connections 2023-10-10T21:03:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c8015a270 0x7f8c80169220 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c800cbf30 0x7f8c800a7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c64066f30 0x7f8c640693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 --2- 172.21.15.154:0/4226609830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c800ccf90 0x7f8c800c1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 >> 172.21.15.154:0/4226609830 conn(0x7f8c8006a320 msgr2=0x7f8c80159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 shutdown_connections 2023-10-10T21:03:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:14.888+0000 7f8c887ff700 1 -- 172.21.15.154:0/4226609830 wait complete. 2023-10-10T21:03:14.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T21:03:14.984 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-10-10T21:03:14.983+0000 7f08ac9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.092+0000 7f25755ff700 1 Processor -- start 2023-10-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.092+0000 7f25755ff700 1 -- start start 2023-10-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.094+0000 7f25755ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2570155eb0 0x7f257006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.094+0000 7f25755ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2570069e80 0x7f25700ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.094+0000 7f25755ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257006eb90 con 0x7f25700c70b0 2023-10-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.094+0000 7f25755ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257006ee70 con 0x7f2570155eb0 2023-10-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.094+0000 7f25755ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257006f150 con 0x7f2570069e80 2023-10-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.094+0000 7f256effd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2570155eb0 0x7f257006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.094+0000 7f256effd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2570155eb0 0x7f257006e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:40252/0 (socket says 172.21.15.154:40252) 2023-10-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.094+0000 7f256f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2570069e80 0x7f25700ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.094+0000 7f256effd700 1 -- 172.21.15.154:0/2867437724 learned_addr learned my addr 172.21.15.154:0/2867437724 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.095+0000 7f256effd700 1 -- 172.21.15.154:0/2867437724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2570069e80 msgr2=0x7f25700ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.095+0000 7f256effd700 1 --2- 172.21.15.154:0/2867437724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2570069e80 0x7f25700ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.095+0000 7f256effd700 1 -- 172.21.15.154:0/2867437724 >> v1:172.21.15.179:6789/0 conn(0x7f25700c70b0 legacy=0x7f2570069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.095+0000 7f256effd700 1 -- 172.21.15.154:0/2867437724 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257006f430 con 0x7f2570155eb0 2023-10-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.095+0000 7f256f7fe700 1 --2- 172.21.15.154:0/2867437724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2570069e80 0x7f25700ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.095+0000 7f256effd700 1 --2- 172.21.15.154:0/2867437724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 0x7f257006e240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25600099b0 tx=0x7f2560009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0a48a788291322 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.095+0000 7f256dffb700 1 -- 172.21.15.154:0/2867437724 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560009ea0 con 0x7f2570155eb0 2023-10-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.095+0000 7f256dffb700 1 -- 172.21.15.154:0/2867437724 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000b860 con 0x7f2570155eb0 2023-10-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.095+0000 7f256dffb700 1 -- 172.21.15.154:0/2867437724 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000bc00 con 0x7f2570155eb0 2023-10-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.096+0000 7f25755ff700 1 -- 172.21.15.154:0/2867437724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 msgr2=0x7f257006e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.096+0000 7f25755ff700 1 --2- 172.21.15.154:0/2867437724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 0x7f257006e240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25600099b0 tx=0x7f2560009250 comp rx=0 tx=0).stop 2023-10-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.096+0000 7f25755ff700 1 -- 172.21.15.154:0/2867437724 shutdown_connections 2023-10-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.096+0000 7f25755ff700 1 --2- 172.21.15.154:0/2867437724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2570069e80 0x7f25700ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:15.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.096+0000 7f25755ff700 1 --2- 172.21.15.154:0/2867437724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 0x7f257006e240 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:15.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.096+0000 7f25755ff700 1 -- 172.21.15.154:0/2867437724 >> 172.21.15.154:0/2867437724 conn(0x7f2570068e10 msgr2=0x7f25700cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:15.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.096+0000 7f25755ff700 1 -- 172.21.15.154:0/2867437724 shutdown_connections 2023-10-10T21:03:15.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.096+0000 7f25755ff700 1 -- 172.21.15.154:0/2867437724 wait complete. 2023-10-10T21:03:15.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.097+0000 7f25755ff700 1 Processor -- start 2023-10-10T21:03:15.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.098+0000 7f25755ff700 1 -- start start 2023-10-10T21:03:15.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.098+0000 7f25755ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2570069e80 0x7f257016aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:15.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.098+0000 7f25755ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25700c70b0 0x7f2570152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:15.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.098+0000 7f25755ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 0x7f25700cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:15.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.098+0000 7f25755ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25700ca4c0 con 0x7f2570069e80 2023-10-10T21:03:15.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.098+0000 7f25755ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257016b030 con 0x7f2570155eb0 2023-10-10T21:03:15.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.098+0000 7f25755ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700ca710 con 0x7f25700c70b0 2023-10-10T21:03:15.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2570069e80 0x7f257016aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:15.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2570069e80 0x7f257016aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33664/0 (socket says 172.21.15.154:33664) 2023-10-10T21:03:15.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256effd700 1 -- 172.21.15.154:0/2594540000 learned_addr learned my addr 172.21.15.154:0/2594540000 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:15.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256f7fe700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 0x7f25700cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:15.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256e7fc700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25700c70b0 0x7f2570152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:15.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256effd700 1 -- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25700c70b0 msgr2=0x7f2570152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:15.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256effd700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25700c70b0 0x7f2570152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:15.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256effd700 1 -- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 msgr2=0x7f25700cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:15.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256effd700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 0x7f25700cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:15.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256effd700 1 -- 172.21.15.154:0/2594540000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568009a20 con 0x7f2570069e80 2023-10-10T21:03:15.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256f7fe700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 0x7f25700cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:15.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256e7fc700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25700c70b0 0x7f2570152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:15.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.099+0000 7f256effd700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2570069e80 0x7f257016aaf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f257006fe40 tx=0x7f2560017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:15.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.100+0000 7f2556ffd700 1 -- 172.21.15.154:0/2594540000 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000bbe0 con 0x7f2570069e80 2023-10-10T21:03:15.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.100+0000 7f2556ffd700 1 -- 172.21.15.154:0/2594540000 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560011420 con 0x7f2570069e80 2023-10-10T21:03:15.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.100+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25600094f0 con 0x7f2570069e80 2023-10-10T21:03:15.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.100+0000 7f2556ffd700 1 -- 172.21.15.154:0/2594540000 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600117c0 con 0x7f2570069e80 2023-10-10T21:03:15.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.100+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25700cacd0 con 0x7f2570069e80 2023-10-10T21:03:15.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.101+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257006c110 con 0x7f2570069e80 2023-10-10T21:03:15.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.102+0000 7f2556ffd700 1 -- 172.21.15.154:0/2594540000 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2560011bf0 con 0x7f2570069e80 2023-10-10T21:03:15.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.102+0000 7f2556ffd700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f255c066f30 0x7f255c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:15.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.103+0000 7f2556ffd700 1 -- 172.21.15.154:0/2594540000 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2560085e80 con 0x7f2570069e80 2023-10-10T21:03:15.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.103+0000 7f256e7fc700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f255c066f30 0x7f255c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:15.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.103+0000 7f256e7fc700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f255c066f30 0x7f255c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f25700c13d0 tx=0x7f2564009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:15.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.107+0000 7f2556ffd700 1 -- 172.21.15.154:0/2594540000 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2560053050 con 0x7f2570069e80 2023-10-10T21:03:15.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:15.339+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2570155660 con 0x7f2570069e80 2023-10-10T21:03:15.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:03:15.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:03:16.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.048+0000 7f2556ffd700 1 -- 172.21.15.154:0/2594540000 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2560056670 con 0x7f2570069e80 2023-10-10T21:03:16.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f255c066f30 msgr2=0x7f255c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:16.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f255c066f30 0x7f255c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f25700c13d0 tx=0x7f2564009040 comp rx=0 tx=0).stop 2023-10-10T21:03:16.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2570069e80 msgr2=0x7f257016aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:16.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2570069e80 0x7f257016aaf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f257006fe40 tx=0x7f2560017000 comp rx=0 tx=0).stop 2023-10-10T21:03:16.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 shutdown_connections 2023-10-10T21:03:16.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2570155eb0 0x7f25700cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2570069e80 0x7f257016aaf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f255c066f30 0x7f255c0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 --2- 172.21.15.154:0/2594540000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25700c70b0 0x7f2570152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 >> 172.21.15.154:0/2594540000 conn(0x7f2570068e10 msgr2=0x7f2570154ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:16.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 shutdown_connections 2023-10-10T21:03:16.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.051+0000 7f25755ff700 1 -- 172.21.15.154:0/2594540000 wait complete. 2023-10-10T21:03:16.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T21:03:16.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.254+0000 7fb800fff700 1 Processor -- start 2023-10-10T21:03:16.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.254+0000 7fb800fff700 1 -- start start 2023-10-10T21:03:16.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.255+0000 7fb800fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7fc1568e0 0x7fb7fc1616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:16.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.255+0000 7fb800fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc15b0d0 con 0x7fb7fc0ccee0 2023-10-10T21:03:16.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.255+0000 7fb800fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc15a4c0 con 0x7fb7fc0c83f0 2023-10-10T21:03:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.255+0000 7fb800fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc15a7a0 con 0x7fb7fc1568e0 2023-10-10T21:03:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f9d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb7fc0ccee0 0x7fb7fc1561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36742/0 (socket says 172.21.15.154:36742) 2023-10-10T21:03:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f9d9b700 1 -- 172.21.15.154:0/275519853 learned_addr learned my addr 172.21.15.154:0/275519853 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7fad9d700 1 --2- 172.21.15.154:0/275519853 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc1568e0 0x7fb7fc1616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529682139 0 0) 0x7fb7fc15b0d0 con 0x7fb7fc0ccee0 2023-10-10T21:03:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e4003570 con 0x7fb7fc0ccee0 2023-10-10T21:03:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610292350 0 0) 0x7fb7fc15a4c0 con 0x7fb7fc0c83f0 2023-10-10T21:03:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7fc15b0d0 con 0x7fb7fc0c83f0 2023-10-10T21:03:16.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3301640815 0 0) 0x7fb7e4003570 con 0x7fb7fc0ccee0 2023-10-10T21:03:16.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc1568e0 msgr2=0x7fb7fc1616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:16.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 --2- 172.21.15.154:0/275519853 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc1568e0 0x7fb7fc1616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 >> v1:172.21.15.179:6789/0 conn(0x7fb7fc0c83f0 legacy=0x7fb7fc0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:16.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc15aa80 con 0x7fb7fc0ccee0 2023-10-10T21:03:16.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fb7f0001470 con 0x7fb7fc0ccee0 2023-10-10T21:03:16.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7fad9d700 1 --2- 172.21.15.154:0/275519853 >> v2:172.21.15.179:3300/0 conn(0x7fb7fc1568e0 0x7fb7fc1616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:16.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 >> v1:172.21.15.154:6789/0 conn(0x7fb7fc0ccee0 legacy=0x7fb7fc1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:16.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.256+0000 7fb7f959a700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7e4003c40 0x7fb7e4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:16.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7f959a700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7e4004810 0x7fb7e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:16.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7f959a700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7e400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:16.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc15a7a0 con 0x7fb7e4005210 2023-10-10T21:03:16.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e400e340 con 0x7fb7e4003c40 2023-10-10T21:03:16.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e400e4d0 con 0x7fb7e4004810 2023-10-10T21:03:16.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7fad9d700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7e400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:16.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7fa59c700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7e4003c40 0x7fb7e4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:16.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7f9d9b700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7e4004810 0x7fb7e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:16.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7fad9d700 1 -- 172.21.15.154:0/275519853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7e4004810 msgr2=0x7fb7e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:16.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7fad9d700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7e4004810 0x7fb7e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7fad9d700 1 -- 172.21.15.154:0/275519853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7e4003c40 msgr2=0x7fb7e4004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:16.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7fad9d700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7e4003c40 0x7fb7e4004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7fad9d700 1 -- 172.21.15.154:0/275519853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4003570 con 0x7fb7e4005210 2023-10-10T21:03:16.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7fad9d700 1 -- 172.21.15.154:0/275519853 reap_dead start 2023-10-10T21:03:16.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.257+0000 7fb7fad9d700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7e400dc70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400e3f0 tx=0x7fb7f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f534b4aad9c8d0f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:16.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4009c50 con 0x7fb7e4005210 2023-10-10T21:03:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f400f040 con 0x7fb7e4005210 2023-10-10T21:03:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb7f959a700 1 -- 172.21.15.154:0/275519853 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4014480 con 0x7fb7e4005210 2023-10-10T21:03:16.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb800fff700 1 -- 172.21.15.154:0/275519853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 msgr2=0x7fb7e400dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:16.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb800fff700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7e400dc70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400e3f0 tx=0x7fb7f400b040 comp rx=0 tx=0).stop 2023-10-10T21:03:16.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb800fff700 1 -- 172.21.15.154:0/275519853 shutdown_connections 2023-10-10T21:03:16.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb800fff700 1 --2- 172.21.15.154:0/275519853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7e400dc70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb800fff700 1 -- 172.21.15.154:0/275519853 >> 172.21.15.154:0/275519853 conn(0x7fb7fc068e10 msgr2=0x7fb7fc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:16.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb800fff700 1 -- 172.21.15.154:0/275519853 shutdown_connections 2023-10-10T21:03:16.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.258+0000 7fb800fff700 1 -- 172.21.15.154:0/275519853 wait complete. 2023-10-10T21:03:16.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.260+0000 7fb800fff700 1 Processor -- start 2023-10-10T21:03:16.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.260+0000 7fb800fff700 1 -- start start 2023-10-10T21:03:16.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb800fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7fc0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:16.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb800fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0b0c30 0x7fb7fc1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb800fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc0c6b30 0x7fb7fc0c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb800fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0c74e0 con 0x7fb7e4005210 2023-10-10T21:03:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb800fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0b1f90 con 0x7fb7fc0c6b30 2023-10-10T21:03:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb800fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc151a20 con 0x7fb7fc0b0c30 2023-10-10T21:03:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fa59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7fc0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fa59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7fc0b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44620/0 (socket says 172.21.15.154:44620) 2023-10-10T21:03:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fa59c700 1 -- 172.21.15.154:0/1018603046 learned_addr learned my addr 172.21.15.154:0/1018603046 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7f9d9b700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0b0c30 0x7fb7fc1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fad9d700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc0c6b30 0x7fb7fc0c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fa59c700 1 -- 172.21.15.154:0/1018603046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0b0c30 msgr2=0x7fb7fc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fa59c700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0b0c30 0x7fb7fc1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fa59c700 1 -- 172.21.15.154:0/1018603046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc0c6b30 msgr2=0x7fb7fc0c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fa59c700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc0c6b30 0x7fb7fc0c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fa59c700 1 -- 172.21.15.154:0/1018603046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0b1380 con 0x7fb7e4005210 2023-10-10T21:03:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.261+0000 7fb7fad9d700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc0c6b30 0x7fb7fc0c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.262+0000 7fb7fa59c700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7fc0b0360 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00f8b0 tx=0x7fb7ec007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.262+0000 7fb7ea7fc700 1 -- 172.21.15.154:0/1018603046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec006820 con 0x7fb7e4005210 2023-10-10T21:03:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.262+0000 7fb7ea7fc700 1 -- 172.21.15.154:0/1018603046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec006980 con 0x7fb7e4005210 2023-10-10T21:03:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.262+0000 7fb7ea7fc700 1 -- 172.21.15.154:0/1018603046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec006d20 con 0x7fb7e4005210 2023-10-10T21:03:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.262+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc0b1660 con 0x7fb7e4005210 2023-10-10T21:03:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.262+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc0b1c20 con 0x7fb7e4005210 2023-10-10T21:03:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.263+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc04c3c0 con 0x7fb7e4005210 2023-10-10T21:03:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.264+0000 7fb7ea7fc700 1 -- 172.21.15.154:0/1018603046 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7ec007230 con 0x7fb7e4005210 2023-10-10T21:03:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.265+0000 7fb7ea7fc700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7dc066f30 0x7fb7dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.265+0000 7fb7ea7fc700 1 -- 172.21.15.154:0/1018603046 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7ec084420 con 0x7fb7e4005210 2023-10-10T21:03:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.265+0000 7fb7f9d9b700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7dc066f30 0x7fb7dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.265+0000 7fb7f9d9b700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7dc066f30 0x7fb7dc0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0c65e0 tx=0x7fb7f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.269+0000 7fb7ea7fc700 1 -- 172.21.15.154:0/1018603046 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7ec0515f0 con 0x7fb7e4005210 2023-10-10T21:03:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:16.500+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb7fc15ad60 con 0x7fb7e4005210 2023-10-10T21:03:17.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.054+0000 7fb7ea7fc700 1 -- 172.21.15.154:0/1018603046 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb7ec006e80 con 0x7fb7e4005210 2023-10-10T21:03:17.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7dc066f30 msgr2=0x7fb7dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7dc066f30 0x7fb7dc0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0c65e0 tx=0x7fb7f0009040 comp rx=0 tx=0).stop 2023-10-10T21:03:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 msgr2=0x7fb7fc0b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7fc0b0360 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00f8b0 tx=0x7fb7ec007d30 comp rx=0 tx=0).stop 2023-10-10T21:03:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 shutdown_connections 2023-10-10T21:03:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7fc0c6b30 0x7fb7fc0c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e4005210 0x7fb7fc0b0360 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7dc066f30 0x7fb7dc0693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 --2- 172.21.15.154:0/1018603046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7fc0b0c30 0x7fb7fc1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.057+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 >> 172.21.15.154:0/1018603046 conn(0x7fb7fc068e10 msgr2=0x7fb7fc151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.058+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 shutdown_connections 2023-10-10T21:03:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.058+0000 7fb800fff700 1 -- 172.21.15.154:0/1018603046 wait complete. 2023-10-10T21:03:17.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:03:17.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.261+0000 7f54c6f9d700 1 Processor -- start 2023-10-10T21:03:17.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.261+0000 7f54c6f9d700 1 -- start start 2023-10-10T21:03:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.262+0000 7f54c6f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54c01597f0 0x7f54c00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.262+0000 7f54c6f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54c015d230 0x7f54c015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.262+0000 7f54c6f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c015db70 con 0x7f54c0159420 2023-10-10T21:03:17.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.262+0000 7f54c6f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c00b11d0 con 0x7f54c015d230 2023-10-10T21:03:17.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.262+0000 7f54c6f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c00b14b0 con 0x7f54c01597f0 2023-10-10T21:03:17.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.262+0000 7f54c679c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54c015d230 0x7f54c015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c679c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54c015d230 0x7f54c015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44622/0 (socket says 172.21.15.154:44622) 2023-10-10T21:03:17.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c679c700 1 -- 172.21.15.154:0/1988072155 learned_addr learned my addr 172.21.15.154:0/1988072155 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c579a700 1 --2- 172.21.15.154:0/1988072155 >> v2:172.21.15.179:3300/0 conn(0x7f54c01597f0 0x7f54c00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c679c700 1 -- 172.21.15.154:0/1988072155 >> v2:172.21.15.179:3300/0 conn(0x7f54c01597f0 msgr2=0x7f54c00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c679c700 1 --2- 172.21.15.154:0/1988072155 >> v2:172.21.15.179:3300/0 conn(0x7f54c01597f0 0x7f54c00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c679c700 1 -- 172.21.15.154:0/1988072155 >> v1:172.21.15.179:6789/0 conn(0x7f54c0159420 legacy=0x7f54c00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c679c700 1 -- 172.21.15.154:0/1988072155 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c00b1790 con 0x7f54c015d230 2023-10-10T21:03:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c579a700 1 --2- 172.21.15.154:0/1988072155 >> v2:172.21.15.179:3300/0 conn(0x7f54c01597f0 0x7f54c00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c679c700 1 --2- 172.21.15.154:0/1988072155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c015d230 0x7f54c015d630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f54c0089750 tx=0x7f54b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadb00bbb4b18944 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c4f99700 1 -- 172.21.15.154:0/1988072155 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800e070 con 0x7f54c015d230 2023-10-10T21:03:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.263+0000 7f54c4f99700 1 -- 172.21.15.154:0/1988072155 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b800ba10 con 0x7f54c015d230 2023-10-10T21:03:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.264+0000 7f54c4f99700 1 -- 172.21.15.154:0/1988072155 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80092e0 con 0x7f54c015d230 2023-10-10T21:03:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.264+0000 7f54c6f9d700 1 -- 172.21.15.154:0/1988072155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c015d230 msgr2=0x7f54c015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.264+0000 7f54c6f9d700 1 --2- 172.21.15.154:0/1988072155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c015d230 0x7f54c015d630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f54c0089750 tx=0x7f54b8009840 comp rx=0 tx=0).stop 2023-10-10T21:03:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.264+0000 7f54c6f9d700 1 -- 172.21.15.154:0/1988072155 shutdown_connections 2023-10-10T21:03:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.264+0000 7f54c6f9d700 1 --2- 172.21.15.154:0/1988072155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c015d230 0x7f54c015d630 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.264+0000 7f54c6f9d700 1 --2- 172.21.15.154:0/1988072155 >> v2:172.21.15.179:3300/0 conn(0x7f54c01597f0 0x7f54c00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.264+0000 7f54c6f9d700 1 -- 172.21.15.154:0/1988072155 >> 172.21.15.154:0/1988072155 conn(0x7f54c00d0660 msgr2=0x7f54c00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:17.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.264+0000 7f54c6f9d700 1 -- 172.21.15.154:0/1988072155 shutdown_connections 2023-10-10T21:03:17.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.264+0000 7f54c6f9d700 1 -- 172.21.15.154:0/1988072155 wait complete. 2023-10-10T21:03:17.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.265+0000 7f54c6f9d700 1 Processor -- start 2023-10-10T21:03:17.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.266+0000 7f54c6f9d700 1 -- start start 2023-10-10T21:03:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.266+0000 7f54c6f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c0159420 0x7f54c0169a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.266+0000 7f54c6f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c01597f0 0x7f54c0154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.266+0000 7f54c6f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c015d230 0x7f54c00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.266+0000 7f54c6f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c015bd50 con 0x7f54c01597f0 2023-10-10T21:03:17.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.266+0000 7f54c6f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c01552b0 con 0x7f54c015d230 2023-10-10T21:03:17.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.266+0000 7f54c6f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c015b140 con 0x7f54c0159420 2023-10-10T21:03:17.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c579a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c01597f0 0x7f54c0154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c579a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c01597f0 0x7f54c0154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44626/0 (socket says 172.21.15.154:44626) 2023-10-10T21:03:17.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c579a700 1 -- 172.21.15.154:0/4110478046 learned_addr learned my addr 172.21.15.154:0/4110478046 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:17.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c679c700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c015d230 0x7f54c00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c5f9b700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c0159420 0x7f54c0169a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c579a700 1 -- 172.21.15.154:0/4110478046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c0159420 msgr2=0x7f54c0169a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c579a700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c0159420 0x7f54c0169a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c579a700 1 -- 172.21.15.154:0/4110478046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c015d230 msgr2=0x7f54c00b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c579a700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c015d230 0x7f54c00b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c579a700 1 -- 172.21.15.154:0/4110478046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b8009ae0 con 0x7f54c01597f0 2023-10-10T21:03:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.267+0000 7f54c579a700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c01597f0 0x7f54c0154d70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f54b000c880 tx=0x7f54b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.268+0000 7f54b5ffb700 1 -- 172.21.15.154:0/4110478046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0011600 con 0x7f54c01597f0 2023-10-10T21:03:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.268+0000 7f54b5ffb700 1 -- 172.21.15.154:0/4110478046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b0011760 con 0x7f54c01597f0 2023-10-10T21:03:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.268+0000 7f54b5ffb700 1 -- 172.21.15.154:0/4110478046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0011ae0 con 0x7f54c01597f0 2023-10-10T21:03:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.268+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c015b420 con 0x7f54c01597f0 2023-10-10T21:03:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.268+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c015b9e0 con 0x7f54c01597f0 2023-10-10T21:03:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.269+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c015bf00 con 0x7f54c01597f0 2023-10-10T21:03:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.270+0000 7f54b5ffb700 1 -- 172.21.15.154:0/4110478046 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54b00073d0 con 0x7f54c01597f0 2023-10-10T21:03:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.271+0000 7f54b5ffb700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f54a4066f30 0x7f54a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.271+0000 7f54b5ffb700 1 -- 172.21.15.154:0/4110478046 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54b00845f0 con 0x7f54c01597f0 2023-10-10T21:03:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.271+0000 7f54c5f9b700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f54a4066f30 0x7f54a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.271+0000 7f54c5f9b700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f54a4066f30 0x7f54a40693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f54bc003870 tx=0x7f54bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:17.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.275+0000 7f54b5ffb700 1 -- 172.21.15.154:0/4110478046 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54c015bf00 con 0x7f54c01597f0 2023-10-10T21:03:17.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.507+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54c015bf00 con 0x7f54c01597f0 2023-10-10T21:03:17.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.507+0000 7f54b5ffb700 1 -- 172.21.15.154:0/4110478046 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f54c015bf00 con 0x7f54c01597f0 2023-10-10T21:03:17.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:17.509 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/343222653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":343222653},{"type":"v1","addr":"172.21.15.154:6837","nonce":343222653}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2558521496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2558521496},{"type":"v1","addr":"172.21.15.179:6834","nonce":2558521496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3578232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3578232941},{"type":"v1","addr":"172.21.15.179:6835","nonce":3578232941}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:03:13.344673+0000","modified":"2023-10-10T21:03:17.047547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6836/2035241338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2035241338},{"type":"v1","addr":"172.21.15.154:6836","nonce":2035241338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-10T21:03:17.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f54a4066f30 msgr2=0x7f54a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f54a4066f30 0x7f54a40693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f54bc003870 tx=0x7f54bc009040 comp rx=0 tx=0).stop 2023-10-10T21:03:17.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c01597f0 msgr2=0x7f54c0154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c01597f0 0x7f54c0154d70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f54b000c880 tx=0x7f54b0008040 comp rx=0 tx=0).stop 2023-10-10T21:03:17.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 shutdown_connections 2023-10-10T21:03:17.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54c015d230 0x7f54c00b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f54a4066f30 0x7f54a40693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54c0159420 0x7f54c0169a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 --2- 172.21.15.154:0/4110478046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c01597f0 0x7f54c0154d70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 >> 172.21.15.154:0/4110478046 conn(0x7f54c00d0660 msgr2=0x7f54c00696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:17.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 shutdown_connections 2023-10-10T21:03:17.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.510+0000 7f54c6f9d700 1 -- 172.21.15.154:0/4110478046 wait complete. 2023-10-10T21:03:17.514 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 14 2023-10-10T21:03:17.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:03:17.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.709+0000 7f5a3e7ff700 1 Processor -- start 2023-10-10T21:03:17.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.709+0000 7f5a3e7ff700 1 -- start start 2023-10-10T21:03:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.710+0000 7f5a3e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a38155c10 0x7f5a38155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3e7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a380ac6a0 0x7f5a380b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3e7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a380acac0 con 0x7f5a380ac230 2023-10-10T21:03:17.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3e7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a380ad930 con 0x7f5a380ac6a0 2023-10-10T21:03:17.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380acd20 con 0x7f5a38155c10 2023-10-10T21:03:17.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3cd9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a380ac6a0 0x7f5a380b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3cd9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a380ac6a0 0x7f5a380b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44628/0 (socket says 172.21.15.154:44628) 2023-10-10T21:03:17.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3cd9c700 1 -- 172.21.15.154:0/2603277056 learned_addr learned my addr 172.21.15.154:0/2603277056 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:17.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a377fe700 1 --1- 172.21.15.154:0/2603277056 >> v1:172.21.15.154:6789/0 conn(0x7f5a380ac230 0x7f5a381568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36744/0 (socket says 172.21.15.154:36744) 2023-10-10T21:03:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a37fff700 1 --2- 172.21.15.154:0/2603277056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a38155c10 0x7f5a38155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a36ffd700 1 -- 172.21.15.154:0/2603277056 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012269934 0 0) 0x7f5a380acac0 con 0x7f5a380ac230 2023-10-10T21:03:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3cd9c700 1 -- 172.21.15.154:0/2603277056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a38155c10 msgr2=0x7f5a38155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3cd9c700 1 --2- 172.21.15.154:0/2603277056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a38155c10 0x7f5a38155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3cd9c700 1 -- 172.21.15.154:0/2603277056 >> v1:172.21.15.154:6789/0 conn(0x7f5a380ac230 legacy=0x7f5a381568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.711+0000 7f5a3cd9c700 1 -- 172.21.15.154:0/2603277056 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380ad000 con 0x7f5a380ac6a0 2023-10-10T21:03:17.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.712+0000 7f5a3cd9c700 1 --2- 172.21.15.154:0/2603277056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a380ac6a0 0x7f5a380b0300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000d1a0 tx=0x7f5a3000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65d932d195f5a42 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:17.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.712+0000 7f5a36ffd700 1 -- 172.21.15.154:0/2603277056 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30010070 con 0x7f5a380ac6a0 2023-10-10T21:03:17.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.712+0000 7f5a36ffd700 1 -- 172.21.15.154:0/2603277056 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000dc00 con 0x7f5a380ac6a0 2023-10-10T21:03:17.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.712+0000 7f5a36ffd700 1 -- 172.21.15.154:0/2603277056 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30016400 con 0x7f5a380ac6a0 2023-10-10T21:03:17.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.712+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/2603277056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a380ac6a0 msgr2=0x7f5a380b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.712+0000 7f5a3e7ff700 1 --2- 172.21.15.154:0/2603277056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a380ac6a0 0x7f5a380b0300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000d1a0 tx=0x7f5a3000ba50 comp rx=0 tx=0).stop 2023-10-10T21:03:17.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.712+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/2603277056 shutdown_connections 2023-10-10T21:03:17.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.712+0000 7f5a3e7ff700 1 --2- 172.21.15.154:0/2603277056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a380ac6a0 0x7f5a380b0300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.712+0000 7f5a3e7ff700 1 --2- 172.21.15.154:0/2603277056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a38155c10 0x7f5a38155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.713+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/2603277056 >> 172.21.15.154:0/2603277056 conn(0x7f5a3806a320 msgr2=0x7f5a380cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:17.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.713+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/2603277056 shutdown_connections 2023-10-10T21:03:17.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.713+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/2603277056 wait complete. 2023-10-10T21:03:17.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.714+0000 7f5a3e7ff700 1 Processor -- start 2023-10-10T21:03:17.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.714+0000 7f5a3e7ff700 1 -- start start 2023-10-10T21:03:17.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.715+0000 7f5a3e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a380ac230 0x7f5a381517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.715+0000 7f5a3e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a380ac6a0 0x7f5a380c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.715+0000 7f5a3e7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a38155c10 0x7f5a3806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.715+0000 7f5a3e7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a38169db0 con 0x7f5a38155c10 2023-10-10T21:03:17.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.715+0000 7f5a3e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a38151d10 con 0x7f5a380ac6a0 2023-10-10T21:03:17.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.715+0000 7f5a3e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380cb7a0 con 0x7f5a380ac230 2023-10-10T21:03:17.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.715+0000 7f5a3cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a38155c10 0x7f5a3806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.715+0000 7f5a3cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a38155c10 0x7f5a3806dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44638/0 (socket says 172.21.15.154:44638) 2023-10-10T21:03:17.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.715+0000 7f5a3cd9c700 1 -- 172.21.15.154:0/323425893 learned_addr learned my addr 172.21.15.154:0/323425893 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:17.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a3cd9c700 1 -- 172.21.15.154:0/323425893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a380ac230 msgr2=0x7f5a381517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a3cd9c700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a380ac230 0x7f5a381517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a3cd9c700 1 -- 172.21.15.154:0/323425893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a380ac6a0 msgr2=0x7f5a380c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a3cd9c700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a380ac6a0 0x7f5a380c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a3cd9c700 1 -- 172.21.15.154:0/323425893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3000bcf0 con 0x7f5a38155c10 2023-10-10T21:03:17.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a3cd9c700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a38155c10 0x7f5a3806dc40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000d840 tx=0x7f5a3001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a1ffff700 1 -- 172.21.15.154:0/323425893 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30016400 con 0x7f5a38155c10 2023-10-10T21:03:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a1ffff700 1 -- 172.21.15.154:0/323425893 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3001f430 con 0x7f5a38155c10 2023-10-10T21:03:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a1ffff700 1 -- 172.21.15.154:0/323425893 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300032f0 con 0x7f5a38155c10 2023-10-10T21:03:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a380cba80 con 0x7f5a38155c10 2023-10-10T21:03:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.716+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a380cc040 con 0x7f5a38155c10 2023-10-10T21:03:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.717+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a38169b80 con 0x7f5a38155c10 2023-10-10T21:03:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.718+0000 7f5a1ffff700 1 -- 172.21.15.154:0/323425893 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a3001fa00 con 0x7f5a38155c10 2023-10-10T21:03:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.719+0000 7f5a1ffff700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a24066f30 0x7f5a240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.719+0000 7f5a1ffff700 1 -- 172.21.15.154:0/323425893 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a30086120 con 0x7f5a38155c10 2023-10-10T21:03:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.719+0000 7f5a37fff700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a24066f30 0x7f5a240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:17.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.720+0000 7f5a37fff700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a24066f30 0x7f5a240693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009b10 tx=0x7f5a280091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:17.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.723+0000 7f5a1ffff700 1 -- 172.21.15.154:0/323425893 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a38169b80 con 0x7f5a38155c10 2023-10-10T21:03:17.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.917+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a38169b80 con 0x7f5a38155c10 2023-10-10T21:03:17.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.918+0000 7f5a1ffff700 1 -- 172.21.15.154:0/323425893 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f5a38169b80 con 0x7f5a38155c10 2023-10-10T21:03:17.919 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:17.920 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:03:15.040002+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:03:11.022869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-10T21:03:12.323498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:03:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a24066f30 msgr2=0x7f5a240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a24066f30 0x7f5a240693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009b10 tx=0x7f5a280091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a38155c10 msgr2=0x7f5a3806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a38155c10 0x7f5a3806dc40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000d840 tx=0x7f5a3001c000 comp rx=0 tx=0).stop 2023-10-10T21:03:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 shutdown_connections 2023-10-10T21:03:17.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a38155c10 0x7f5a3806dc40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a24066f30 0x7f5a240693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a380ac230 0x7f5a381517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 --2- 172.21.15.154:0/323425893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a380ac6a0 0x7f5a380c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:17.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.920+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 >> 172.21.15.154:0/323425893 conn(0x7f5a3806a320 msgr2=0x7f5a38153560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:17.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.921+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 shutdown_connections 2023-10-10T21:03:17.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:17.921+0000 7f5a3e7ff700 1 -- 172.21.15.154:0/323425893 wait complete. 2023-10-10T21:03:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T21:03:17.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:03:18.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.126+0000 7f107619d700 1 Processor -- start 2023-10-10T21:03:18.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.126+0000 7f107619d700 1 -- start start 2023-10-10T21:03:18.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.127+0000 7f107619d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f10701597f0 0x7f10700b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.127+0000 7f107619d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700b11d0 con 0x7f1070159420 2023-10-10T21:03:18.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.127+0000 7f107619d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700b14b0 con 0x7f107015d230 2023-10-10T21:03:18.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.127+0000 7f107619d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10700b1790 con 0x7f10701597f0 2023-10-10T21:03:18.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.127+0000 7f107519b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1070159420 0x7f10700b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36750/0 (socket says 172.21.15.154:36750) 2023-10-10T21:03:18.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.127+0000 7f107519b700 1 -- 172.21.15.154:0/1135036896 learned_addr learned my addr 172.21.15.154:0/1135036896 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:18.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f107499a700 1 --2- 172.21.15.154:0/1135036896 >> v2:172.21.15.179:3300/0 conn(0x7f10701597f0 0x7f10700b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421015235 0 0) 0x7f10700b11d0 con 0x7f1070159420 2023-10-10T21:03:18.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f105c003570 con 0x7f1070159420 2023-10-10T21:03:18.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965647714 0 0) 0x7f10700b14b0 con 0x7f107015d230 2023-10-10T21:03:18.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10700b11d0 con 0x7f107015d230 2023-10-10T21:03:18.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 879217835 0 0) 0x7f105c003570 con 0x7f1070159420 2023-10-10T21:03:18.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 >> v2:172.21.15.179:3300/0 conn(0x7f10701597f0 msgr2=0x7f10700b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:18.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 --2- 172.21.15.154:0/1135036896 >> v2:172.21.15.179:3300/0 conn(0x7f10701597f0 0x7f10700b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 >> v1:172.21.15.179:6789/0 conn(0x7f107015d230 legacy=0x7f107015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700b1a70 con 0x7f1070159420 2023-10-10T21:03:18.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f106c001470 con 0x7f1070159420 2023-10-10T21:03:18.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 >> v1:172.21.15.154:6789/0 conn(0x7f1070159420 legacy=0x7f10700b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c003c40 0x7f105c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f105c004810 0x7f105c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f105c005210 0x7f105c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10700b1790 con 0x7f105c005210 2023-10-10T21:03:18.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c00c130 con 0x7f105c003c40 2023-10-10T21:03:18.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.128+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c00c2c0 con 0x7f105c004810 2023-10-10T21:03:18.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107599c700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f105c005210 0x7f105c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107519b700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c003c40 0x7f105c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107499a700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f105c004810 0x7f105c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107599c700 1 -- 172.21.15.154:0/1135036896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f105c004810 msgr2=0x7f105c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:18.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107599c700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f105c004810 0x7f105c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107599c700 1 -- 172.21.15.154:0/1135036896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c003c40 msgr2=0x7f105c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:18.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107599c700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c003c40 0x7f105c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107599c700 1 -- 172.21.15.154:0/1135036896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c003570 con 0x7f105c005210 2023-10-10T21:03:18.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107599c700 1 -- 172.21.15.154:0/1135036896 reap_dead start 2023-10-10T21:03:18.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.129+0000 7f107599c700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f105c005210 0x7f105c00ba60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1068002120 tx=0x7f10680017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6685563bddae17c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:18.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068001ab0 con 0x7f105c005210 2023-10-10T21:03:18.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800c940 con 0x7f105c005210 2023-10-10T21:03:18.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f1067fff700 1 -- 172.21.15.154:0/1135036896 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800ccc0 con 0x7f105c005210 2023-10-10T21:03:18.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f107619d700 1 -- 172.21.15.154:0/1135036896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f105c005210 msgr2=0x7f105c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f107619d700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f105c005210 0x7f105c00ba60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1068002120 tx=0x7f10680017a0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f107619d700 1 -- 172.21.15.154:0/1135036896 shutdown_connections 2023-10-10T21:03:18.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f107619d700 1 --2- 172.21.15.154:0/1135036896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f105c005210 0x7f105c00ba60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f107619d700 1 -- 172.21.15.154:0/1135036896 >> 172.21.15.154:0/1135036896 conn(0x7f10700d0660 msgr2=0x7f10700d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:18.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f107619d700 1 -- 172.21.15.154:0/1135036896 shutdown_connections 2023-10-10T21:03:18.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.130+0000 7f107619d700 1 -- 172.21.15.154:0/1135036896 wait complete. 2023-10-10T21:03:18.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.132+0000 7f107619d700 1 Processor -- start 2023-10-10T21:03:18.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.132+0000 7f107619d700 1 -- start start 2023-10-10T21:03:18.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107619d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c005210 0x7f1070152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107619d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1070150d90 0x7f1070151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107014ed90 0x7f107014f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107619d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070151740 con 0x7f1070150d90 2023-10-10T21:03:18.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107619d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10700b3e50 con 0x7f105c005210 2023-10-10T21:03:18.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107014fea0 con 0x7f107014ed90 2023-10-10T21:03:18.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107499a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1070150d90 0x7f1070151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107499a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1070150d90 0x7f1070151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44650/0 (socket says 172.21.15.154:44650) 2023-10-10T21:03:18.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107499a700 1 -- 172.21.15.154:0/415907197 learned_addr learned my addr 172.21.15.154:0/415907197 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:18.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107599c700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107014ed90 0x7f107014f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107519b700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c005210 0x7f1070152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107499a700 1 -- 172.21.15.154:0/415907197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107014ed90 msgr2=0x7f107014f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107499a700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107014ed90 0x7f107014f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107499a700 1 -- 172.21.15.154:0/415907197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c005210 msgr2=0x7f1070152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107499a700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c005210 0x7f1070152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107499a700 1 -- 172.21.15.154:0/415907197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070150110 con 0x7f1070150d90 2023-10-10T21:03:18.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.133+0000 7f107519b700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c005210 0x7f1070152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:18.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.134+0000 7f107499a700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1070150d90 0x7f1070151200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1060011a40 tx=0x7f10600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:18.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.134+0000 7f10657fa700 1 -- 172.21.15.154:0/415907197 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000f940 con 0x7f1070150d90 2023-10-10T21:03:18.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.134+0000 7f10657fa700 1 -- 172.21.15.154:0/415907197 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000faa0 con 0x7f1070150d90 2023-10-10T21:03:18.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.134+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1070155180 con 0x7f1070150d90 2023-10-10T21:03:18.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.134+0000 7f10657fa700 1 -- 172.21.15.154:0/415907197 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000fe20 con 0x7f1070150d90 2023-10-10T21:03:18.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.134+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107014f740 con 0x7f1070150d90 2023-10-10T21:03:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.135+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1070155620 con 0x7f1070150d90 2023-10-10T21:03:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.136+0000 7f10657fa700 1 -- 172.21.15.154:0/415907197 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1060014650 con 0x7f1070150d90 2023-10-10T21:03:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.137+0000 7f10657fa700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1054066f30 0x7f10540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.137+0000 7f10657fa700 1 -- 172.21.15.154:0/415907197 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1060018030 con 0x7f1070150d90 2023-10-10T21:03:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.137+0000 7f107519b700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1054066f30 0x7f10540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.138+0000 7f107519b700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1054066f30 0x7f10540693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f106c001bb0 tx=0x7f106c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.141+0000 7f10657fa700 1 -- 172.21.15.154:0/415907197 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1060052140 con 0x7f1070150d90 2023-10-10T21:03:18.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.328+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10700b3f90 con 0x7f1054066f30 2023-10-10T21:03:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.338+0000 7f10657fa700 1 -- 172.21.15.154:0/415907197 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288013 (secure 0 0 0) 0x7f106c000bc0 con 0x7f1054066f30 2023-10-10T21:03:18.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:18.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.342+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1054066f30 msgr2=0x7f10540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.342+0000 7f107619d700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1054066f30 0x7f10540693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f106c001bb0 tx=0x7f106c009040 comp rx=0 tx=0).stop 2023-10-10T21:03:18.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.342+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1070150d90 msgr2=0x7f1070151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.342+0000 7f107619d700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1070150d90 0x7f1070151200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1060011a40 tx=0x7f10600091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.343+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 shutdown_connections 2023-10-10T21:03:18.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.343+0000 7f107619d700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1054066f30 0x7f10540693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.343+0000 7f107619d700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107014ed90 0x7f107014f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.343+0000 7f107619d700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f105c005210 0x7f1070152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.343+0000 7f107619d700 1 --2- 172.21.15.154:0/415907197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1070150d90 0x7f1070151200 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.343+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 >> 172.21.15.154:0/415907197 conn(0x7f10700d0660 msgr2=0x7f10701586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:18.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.343+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 shutdown_connections 2023-10-10T21:03:18.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.343+0000 7f107619d700 1 -- 172.21.15.154:0/415907197 wait complete. 2023-10-10T21:03:18.354 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:03:18.362 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-10-10T21:03:17.865350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591138,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382428,"kb_used_data":4124,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592292,"statfs":{"total":773094113280,"available":770654507008,"internally_reserved":0,"allocated":4222976,"data_stored":2327340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001120"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058310+0000","last_change":"2023-10-10T21:03:14.056535+0000","last_active":"2023-10-10T21:03:14.058310+0000","last_peered":"2023-10-10T21:03:14.058310+0000","last_clean":"2023-10-10T21:03:14.058310+0000","last_became_active":"2023-10-10T21:03:14.056221+0000","last_became_peered":"2023-10-10T21:03:14.056221+0000","last_unstale":"2023-10-10T21:03:14.058310+0000","last_undegraded":"2023-10-10T21:03:14.058310+0000","last_fullsized":"2023-10-10T21:03:14.058310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.875966+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:24:09.519551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053297+0000","last_change":"2023-10-10T21:03:14.044532+0000","last_active":"2023-10-10T21:03:14.053297+0000","last_peered":"2023-10-10T21:03:14.053297+0000","last_clean":"2023-10-10T21:03:14.053297+0000","last_became_active":"2023-10-10T21:03:14.044238+0000","last_became_peered":"2023-10-10T21:03:14.044238+0000","last_unstale":"2023-10-10T21:03:14.053297+0000","last_undegraded":"2023-10-10T21:03:14.053297+0000","last_fullsized":"2023-10-10T21:03:14.053297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:57:09.143759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061282+0000","last_change":"2023-10-10T21:03:14.050842+0000","last_active":"2023-10-10T21:03:14.061282+0000","last_peered":"2023-10-10T21:03:14.061282+0000","last_clean":"2023-10-10T21:03:14.061282+0000","last_became_active":"2023-10-10T21:03:14.050579+0000","last_became_peered":"2023-10-10T21:03:14.050579+0000","last_unstale":"2023-10-10T21:03:14.061282+0000","last_undegraded":"2023-10-10T21:03:14.061282+0000","last_fullsized":"2023-10-10T21:03:14.061282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049131+0000","last_change":"2023-10-10T21:03:14.046823+0000","last_active":"2023-10-10T21:03:14.049131+0000","last_peered":"2023-10-10T21:03:14.049131+0000","last_clean":"2023-10-10T21:03:14.049131+0000","last_became_active":"2023-10-10T21:03:14.046566+0000","last_became_peered":"2023-10-10T21:03:14.046566+0000","last_unstale":"2023-10-10T21:03:14.049131+0000","last_undegraded":"2023-10-10T21:03:14.049131+0000","last_fullsized":"2023-10-10T21:03:14.049131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.116595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.875796+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:41.386045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049955+0000","last_change":"2023-10-10T21:03:14.047991+0000","last_active":"2023-10-10T21:03:14.049955+0000","last_peered":"2023-10-10T21:03:14.049955+0000","last_clean":"2023-10-10T21:03:14.049955+0000","last_became_active":"2023-10-10T21:03:14.047702+0000","last_became_peered":"2023-10-10T21:03:14.047702+0000","last_unstale":"2023-10-10T21:03:14.049955+0000","last_undegraded":"2023-10-10T21:03:14.049955+0000","last_fullsized":"2023-10-10T21:03:14.049955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052555+0000","last_change":"2023-10-10T21:03:14.049953+0000","last_active":"2023-10-10T21:03:14.052555+0000","last_peered":"2023-10-10T21:03:14.052555+0000","last_clean":"2023-10-10T21:03:14.052555+0000","last_became_active":"2023-10-10T21:03:14.049549+0000","last_became_peered":"2023-10-10T21:03:14.049549+0000","last_unstale":"2023-10-10T21:03:14.052555+0000","last_undegraded":"2023-10-10T21:03:14.052555+0000","last_fullsized":"2023-10-10T21:03:14.052555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066618+0000","last_change":"2023-10-10T21:03:14.062596+0000","last_active":"2023-10-10T21:03:14.066618+0000","last_peered":"2023-10-10T21:03:14.066618+0000","last_clean":"2023-10-10T21:03:14.066618+0000","last_became_active":"2023-10-10T21:03:14.062296+0000","last_became_peered":"2023-10-10T21:03:14.062296+0000","last_unstale":"2023-10-10T21:03:14.066618+0000","last_undegraded":"2023-10-10T21:03:14.066618+0000","last_fullsized":"2023-10-10T21:03:14.066618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:58:45.241585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058876+0000","last_change":"2023-10-10T21:03:14.043250+0000","last_active":"2023-10-10T21:03:14.058876+0000","last_peered":"2023-10-10T21:03:14.058876+0000","last_clean":"2023-10-10T21:03:14.058876+0000","last_became_active":"2023-10-10T21:03:14.042985+0000","last_became_peered":"2023-10-10T21:03:14.042985+0000","last_unstale":"2023-10-10T21:03:14.058876+0000","last_undegraded":"2023-10-10T21:03:14.058876+0000","last_fullsized":"2023-10-10T21:03:14.058876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066738+0000","last_change":"2023-10-10T21:03:14.060697+0000","last_active":"2023-10-10T21:03:14.066738+0000","last_peered":"2023-10-10T21:03:14.066738+0000","last_clean":"2023-10-10T21:03:14.066738+0000","last_became_active":"2023-10-10T21:03:14.060246+0000","last_became_peered":"2023-10-10T21:03:14.060246+0000","last_unstale":"2023-10-10T21:03:14.066738+0000","last_undegraded":"2023-10-10T21:03:14.066738+0000","last_fullsized":"2023-10-10T21:03:14.066738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053144+0000","last_change":"2023-10-10T21:03:14.041036+0000","last_active":"2023-10-10T21:03:14.053144+0000","last_peered":"2023-10-10T21:03:14.053144+0000","last_clean":"2023-10-10T21:03:14.053144+0000","last_became_active":"2023-10-10T21:03:14.040620+0000","last_became_peered":"2023-10-10T21:03:14.040620+0000","last_unstale":"2023-10-10T21:03:14.053144+0000","last_undegraded":"2023-10-10T21:03:14.053144+0000","last_fullsized":"2023-10-10T21:03:14.053144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049113+0000","last_change":"2023-10-10T21:03:14.046280+0000","last_active":"2023-10-10T21:03:14.049113+0000","last_peered":"2023-10-10T21:03:14.049113+0000","last_clean":"2023-10-10T21:03:14.049113+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.049113+0000","last_undegraded":"2023-10-10T21:03:14.049113+0000","last_fullsized":"2023-10-10T21:03:14.049113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:28.753153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.875255+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:10:36.558402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054431+0000","last_change":"2023-10-10T21:03:14.049328+0000","last_active":"2023-10-10T21:03:14.054431+0000","last_peered":"2023-10-10T21:03:14.054431+0000","last_clean":"2023-10-10T21:03:14.054431+0000","last_became_active":"2023-10-10T21:03:14.048765+0000","last_became_peered":"2023-10-10T21:03:14.048765+0000","last_unstale":"2023-10-10T21:03:14.054431+0000","last_undegraded":"2023-10-10T21:03:14.054431+0000","last_fullsized":"2023-10-10T21:03:14.054431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:08.144185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057612+0000","last_change":"2023-10-10T21:03:14.051301+0000","last_active":"2023-10-10T21:03:14.057612+0000","last_peered":"2023-10-10T21:03:14.057612+0000","last_clean":"2023-10-10T21:03:14.057612+0000","last_became_active":"2023-10-10T21:03:14.050919+0000","last_became_peered":"2023-10-10T21:03:14.050919+0000","last_unstale":"2023-10-10T21:03:14.057612+0000","last_undegraded":"2023-10-10T21:03:14.057612+0000","last_fullsized":"2023-10-10T21:03:14.057612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049838+0000","last_change":"2023-10-10T21:03:14.047703+0000","last_active":"2023-10-10T21:03:14.049838+0000","last_peered":"2023-10-10T21:03:14.049838+0000","last_clean":"2023-10-10T21:03:14.049838+0000","last_became_active":"2023-10-10T21:03:14.047391+0000","last_became_peered":"2023-10-10T21:03:14.047391+0000","last_unstale":"2023-10-10T21:03:14.049838+0000","last_undegraded":"2023-10-10T21:03:14.049838+0000","last_fullsized":"2023-10-10T21:03:14.049838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.874882+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:46:00.757042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.874807+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:57:10.345139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065008+0000","last_change":"2023-10-10T21:03:14.057258+0000","last_active":"2023-10-10T21:03:14.065008+0000","last_peered":"2023-10-10T21:03:14.065008+0000","last_clean":"2023-10-10T21:03:14.065008+0000","last_became_active":"2023-10-10T21:03:14.057010+0000","last_became_peered":"2023-10-10T21:03:14.057010+0000","last_unstale":"2023-10-10T21:03:14.065008+0000","last_undegraded":"2023-10-10T21:03:14.065008+0000","last_fullsized":"2023-10-10T21:03:14.065008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:40:13.267887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056825+0000","last_change":"2023-10-10T21:03:14.052191+0000","last_active":"2023-10-10T21:03:14.056825+0000","last_peered":"2023-10-10T21:03:14.056825+0000","last_clean":"2023-10-10T21:03:14.056825+0000","last_became_active":"2023-10-10T21:03:14.051717+0000","last_became_peered":"2023-10-10T21:03:14.051717+0000","last_unstale":"2023-10-10T21:03:14.056825+0000","last_undegraded":"2023-10-10T21:03:14.056825+0000","last_fullsized":"2023-10-10T21:03:14.056825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056242+0000","last_change":"2023-10-10T21:03:14.050529+0000","last_active":"2023-10-10T21:03:14.056242+0000","last_peered":"2023-10-10T21:03:14.056242+0000","last_clean":"2023-10-10T21:03:14.056242+0000","last_became_active":"2023-10-10T21:03:14.050259+0000","last_became_peered":"2023-10-10T21:03:14.050259+0000","last_unstale":"2023-10-10T21:03:14.056242+0000","last_undegraded":"2023-10-10T21:03:14.056242+0000","last_fullsized":"2023-10-10T21:03:14.056242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056916+0000","last_change":"2023-10-10T21:03:14.053134+0000","last_active":"2023-10-10T21:03:14.056916+0000","last_peered":"2023-10-10T21:03:14.056916+0000","last_clean":"2023-10-10T21:03:14.056916+0000","last_became_active":"2023-10-10T21:03:14.052832+0000","last_became_peered":"2023-10-10T21:03:14.052832+0000","last_unstale":"2023-10-10T21:03:14.056916+0000","last_undegraded":"2023-10-10T21:03:14.056916+0000","last_fullsized":"2023-10-10T21:03:14.056916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055627+0000","last_change":"2023-10-10T21:03:14.054510+0000","last_active":"2023-10-10T21:03:14.055627+0000","last_peered":"2023-10-10T21:03:14.055627+0000","last_clean":"2023-10-10T21:03:14.055627+0000","last_became_active":"2023-10-10T21:03:14.053503+0000","last_became_peered":"2023-10-10T21:03:14.053503+0000","last_unstale":"2023-10-10T21:03:14.055627+0000","last_undegraded":"2023-10-10T21:03:14.055627+0000","last_fullsized":"2023-10-10T21:03:14.055627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061435+0000","last_change":"2023-10-10T21:03:14.053313+0000","last_active":"2023-10-10T21:03:14.061435+0000","last_peered":"2023-10-10T21:03:14.061435+0000","last_clean":"2023-10-10T21:03:14.061435+0000","last_became_active":"2023-10-10T21:03:14.053079+0000","last_became_peered":"2023-10-10T21:03:14.053079+0000","last_unstale":"2023-10-10T21:03:14.061435+0000","last_undegraded":"2023-10-10T21:03:14.061435+0000","last_fullsized":"2023-10-10T21:03:14.061435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.874243+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:17:13.547773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061383+0000","last_change":"2023-10-10T21:03:14.050946+0000","last_active":"2023-10-10T21:03:14.061383+0000","last_peered":"2023-10-10T21:03:14.061383+0000","last_clean":"2023-10-10T21:03:14.061383+0000","last_became_active":"2023-10-10T21:03:14.050591+0000","last_became_peered":"2023-10-10T21:03:14.050591+0000","last_unstale":"2023-10-10T21:03:14.061383+0000","last_undegraded":"2023-10-10T21:03:14.061383+0000","last_fullsized":"2023-10-10T21:03:14.061383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:56.258834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053266+0000","last_change":"2023-10-10T21:03:14.045679+0000","last_active":"2023-10-10T21:03:14.053266+0000","last_peered":"2023-10-10T21:03:14.053266+0000","last_clean":"2023-10-10T21:03:14.053266+0000","last_became_active":"2023-10-10T21:03:14.045412+0000","last_became_peered":"2023-10-10T21:03:14.045412+0000","last_unstale":"2023-10-10T21:03:14.053266+0000","last_undegraded":"2023-10-10T21:03:14.053266+0000","last_fullsized":"2023-10-10T21:03:14.053266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056845+0000","last_change":"2023-10-10T21:03:14.054112+0000","last_active":"2023-10-10T21:03:14.056845+0000","last_peered":"2023-10-10T21:03:14.056845+0000","last_clean":"2023-10-10T21:03:14.056845+0000","last_became_active":"2023-10-10T21:03:14.052952+0000","last_became_peered":"2023-10-10T21:03:14.052952+0000","last_unstale":"2023-10-10T21:03:14.056845+0000","last_undegraded":"2023-10-10T21:03:14.056845+0000","last_fullsized":"2023-10-10T21:03:14.056845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052548+0000","last_change":"2023-10-10T21:03:14.049723+0000","last_active":"2023-10-10T21:03:14.052548+0000","last_peered":"2023-10-10T21:03:14.052548+0000","last_clean":"2023-10-10T21:03:14.052548+0000","last_became_active":"2023-10-10T21:03:14.049283+0000","last_became_peered":"2023-10-10T21:03:14.049283+0000","last_unstale":"2023-10-10T21:03:14.052548+0000","last_undegraded":"2023-10-10T21:03:14.052548+0000","last_fullsized":"2023-10-10T21:03:14.052548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054706+0000","last_change":"2023-10-10T21:03:14.051746+0000","last_active":"2023-10-10T21:03:14.054706+0000","last_peered":"2023-10-10T21:03:14.054706+0000","last_clean":"2023-10-10T21:03:14.054706+0000","last_became_active":"2023-10-10T21:03:14.051312+0000","last_became_peered":"2023-10-10T21:03:14.051312+0000","last_unstale":"2023-10-10T21:03:14.054706+0000","last_undegraded":"2023-10-10T21:03:14.054706+0000","last_fullsized":"2023-10-10T21:03:14.054706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058708+0000","last_change":"2023-10-10T21:03:14.056651+0000","last_active":"2023-10-10T21:03:14.058708+0000","last_peered":"2023-10-10T21:03:14.058708+0000","last_clean":"2023-10-10T21:03:14.058708+0000","last_became_active":"2023-10-10T21:03:14.056380+0000","last_became_peered":"2023-10-10T21:03:14.056380+0000","last_unstale":"2023-10-10T21:03:14.058708+0000","last_undegraded":"2023-10-10T21:03:14.058708+0000","last_fullsized":"2023-10-10T21:03:14.058708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056688+0000","last_change":"2023-10-10T21:03:14.052449+0000","last_active":"2023-10-10T21:03:14.056688+0000","last_peered":"2023-10-10T21:03:14.056688+0000","last_clean":"2023-10-10T21:03:14.056688+0000","last_became_active":"2023-10-10T21:03:14.052170+0000","last_became_peered":"2023-10-10T21:03:14.052170+0000","last_unstale":"2023-10-10T21:03:14.056688+0000","last_undegraded":"2023-10-10T21:03:14.056688+0000","last_fullsized":"2023-10-10T21:03:14.056688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070197+0000","last_change":"2023-10-10T21:03:12.887804+0000","last_active":"2023-10-10T21:03:14.070197+0000","last_peered":"2023-10-10T21:03:14.070197+0000","last_clean":"2023-10-10T21:03:14.070197+0000","last_became_active":"2023-10-10T21:03:12.886661+0000","last_became_peered":"2023-10-10T21:03:12.886661+0000","last_unstale":"2023-10-10T21:03:14.070197+0000","last_undegraded":"2023-10-10T21:03:14.070197+0000","last_fullsized":"2023-10-10T21:03:14.070197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:48.860387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056422+0000","last_change":"2023-10-10T21:03:14.055315+0000","last_active":"2023-10-10T21:03:14.056422+0000","last_peered":"2023-10-10T21:03:14.056422+0000","last_clean":"2023-10-10T21:03:14.056422+0000","last_became_active":"2023-10-10T21:03:14.055012+0000","last_became_peered":"2023-10-10T21:03:14.055012+0000","last_unstale":"2023-10-10T21:03:14.056422+0000","last_undegraded":"2023-10-10T21:03:14.056422+0000","last_fullsized":"2023-10-10T21:03:14.056422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067737+0000","last_change":"2023-10-10T21:03:12.891968+0000","last_active":"2023-10-10T21:03:14.067737+0000","last_peered":"2023-10-10T21:03:14.067737+0000","last_clean":"2023-10-10T21:03:14.067737+0000","last_became_active":"2023-10-10T21:03:12.891692+0000","last_became_peered":"2023-10-10T21:03:12.891692+0000","last_unstale":"2023-10-10T21:03:14.067737+0000","last_undegraded":"2023-10-10T21:03:14.067737+0000","last_fullsized":"2023-10-10T21:03:14.067737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055774+0000","last_change":"2023-10-10T21:03:14.052248+0000","last_active":"2023-10-10T21:03:14.055774+0000","last_peered":"2023-10-10T21:03:14.055774+0000","last_clean":"2023-10-10T21:03:14.055774+0000","last_became_active":"2023-10-10T21:03:14.051970+0000","last_became_peered":"2023-10-10T21:03:14.051970+0000","last_unstale":"2023-10-10T21:03:14.055774+0000","last_undegraded":"2023-10-10T21:03:14.055774+0000","last_fullsized":"2023-10-10T21:03:14.055774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.890886+0000","last_change":"2023-10-10T21:03:12.890886+0000","last_active":"2023-10-10T21:03:12.890886+0000","last_peered":"2023-10-10T21:03:12.890886+0000","last_clean":"2023-10-10T21:03:12.890886+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:12.890886+0000","last_undegraded":"2023-10-10T21:03:12.890886+0000","last_fullsized":"2023-10-10T21:03:12.890886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:22:47.067057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061401+0000","last_change":"2023-10-10T21:03:14.058547+0000","last_active":"2023-10-10T21:03:14.061401+0000","last_peered":"2023-10-10T21:03:14.061401+0000","last_clean":"2023-10-10T21:03:14.061401+0000","last_became_active":"2023-10-10T21:03:14.058172+0000","last_became_peered":"2023-10-10T21:03:14.058172+0000","last_unstale":"2023-10-10T21:03:14.061401+0000","last_undegraded":"2023-10-10T21:03:14.061401+0000","last_fullsized":"2023-10-10T21:03:14.061401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.071334+0000","last_change":"2023-10-10T21:03:12.886500+0000","last_active":"2023-10-10T21:03:14.071334+0000","last_peered":"2023-10-10T21:03:14.071334+0000","last_clean":"2023-10-10T21:03:14.071334+0000","last_became_active":"2023-10-10T21:03:12.886219+0000","last_became_peered":"2023-10-10T21:03:12.886219+0000","last_unstale":"2023-10-10T21:03:14.071334+0000","last_undegraded":"2023-10-10T21:03:14.071334+0000","last_fullsized":"2023-10-10T21:03:14.071334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:12.688030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058736+0000","last_change":"2023-10-10T21:03:14.055102+0000","last_active":"2023-10-10T21:03:14.058736+0000","last_peered":"2023-10-10T21:03:14.058736+0000","last_clean":"2023-10-10T21:03:14.058736+0000","last_became_active":"2023-10-10T21:03:14.054774+0000","last_became_peered":"2023-10-10T21:03:14.054774+0000","last_unstale":"2023-10-10T21:03:14.058736+0000","last_undegraded":"2023-10-10T21:03:14.058736+0000","last_fullsized":"2023-10-10T21:03:14.058736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069543+0000","last_change":"2023-10-10T21:03:12.890962+0000","last_active":"2023-10-10T21:03:14.069543+0000","last_peered":"2023-10-10T21:03:14.069543+0000","last_clean":"2023-10-10T21:03:14.069543+0000","last_became_active":"2023-10-10T21:03:12.890574+0000","last_became_peered":"2023-10-10T21:03:12.890574+0000","last_unstale":"2023-10-10T21:03:14.069543+0000","last_undegraded":"2023-10-10T21:03:14.069543+0000","last_fullsized":"2023-10-10T21:03:14.069543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:14.768025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053330+0000","last_change":"2023-10-10T21:03:14.046246+0000","last_active":"2023-10-10T21:03:14.053330+0000","last_peered":"2023-10-10T21:03:14.053330+0000","last_clean":"2023-10-10T21:03:14.053330+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.053330+0000","last_undegraded":"2023-10-10T21:03:14.053330+0000","last_fullsized":"2023-10-10T21:03:14.053330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069582+0000","last_change":"2023-10-10T21:03:12.890898+0000","last_active":"2023-10-10T21:03:14.069582+0000","last_peered":"2023-10-10T21:03:14.069582+0000","last_clean":"2023-10-10T21:03:14.069582+0000","last_became_active":"2023-10-10T21:03:12.890638+0000","last_became_peered":"2023-10-10T21:03:12.890638+0000","last_unstale":"2023-10-10T21:03:14.069582+0000","last_undegraded":"2023-10-10T21:03:14.069582+0000","last_fullsized":"2023-10-10T21:03:14.069582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:50:30.753850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052328+0000","last_change":"2023-10-10T21:03:14.048312+0000","last_active":"2023-10-10T21:03:14.052328+0000","last_peered":"2023-10-10T21:03:14.052328+0000","last_clean":"2023-10-10T21:03:14.052328+0000","last_became_active":"2023-10-10T21:03:14.048046+0000","last_became_peered":"2023-10-10T21:03:14.048046+0000","last_unstale":"2023-10-10T21:03:14.052328+0000","last_undegraded":"2023-10-10T21:03:14.052328+0000","last_fullsized":"2023-10-10T21:03:14.052328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.881085+0000","last_change":"2023-10-10T21:03:12.881085+0000","last_active":"2023-10-10T21:03:12.881085+0000","last_peered":"2023-10-10T21:03:12.881085+0000","last_clean":"2023-10-10T21:03:12.881085+0000","last_became_active":"2023-10-10T21:03:12.880788+0000","last_became_peered":"2023-10-10T21:03:12.880788+0000","last_unstale":"2023-10-10T21:03:12.881085+0000","last_undegraded":"2023-10-10T21:03:12.881085+0000","last_fullsized":"2023-10-10T21:03:12.881085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:41:10.360039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.062294+0000","last_change":"2023-10-10T21:03:14.057908+0000","last_active":"2023-10-10T21:03:14.062294+0000","last_peered":"2023-10-10T21:03:14.062294+0000","last_clean":"2023-10-10T21:03:14.062294+0000","last_became_active":"2023-10-10T21:03:14.057554+0000","last_became_peered":"2023-10-10T21:03:14.057554+0000","last_unstale":"2023-10-10T21:03:14.062294+0000","last_undegraded":"2023-10-10T21:03:14.062294+0000","last_fullsized":"2023-10-10T21:03:14.062294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.035024+0000","last_change":"2023-10-10T21:03:12.889571+0000","last_active":"2023-10-10T21:03:14.035024+0000","last_peered":"2023-10-10T21:03:14.035024+0000","last_clean":"2023-10-10T21:03:14.035024+0000","last_became_active":"2023-10-10T21:03:12.888606+0000","last_became_peered":"2023-10-10T21:03:12.888606+0000","last_unstale":"2023-10-10T21:03:14.035024+0000","last_undegraded":"2023-10-10T21:03:14.035024+0000","last_fullsized":"2023-10-10T21:03:14.035024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:07:21.202825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053737+0000","last_change":"2023-10-10T21:03:14.040585+0000","last_active":"2023-10-10T21:03:14.053737+0000","last_peered":"2023-10-10T21:03:14.053737+0000","last_clean":"2023-10-10T21:03:14.053737+0000","last_became_active":"2023-10-10T21:03:14.040307+0000","last_became_peered":"2023-10-10T21:03:14.040307+0000","last_unstale":"2023-10-10T21:03:14.053737+0000","last_undegraded":"2023-10-10T21:03:14.053737+0000","last_fullsized":"2023-10-10T21:03:14.053737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.892185+0000","last_change":"2023-10-10T21:03:12.892185+0000","last_active":"2023-10-10T21:03:12.892185+0000","last_peered":"2023-10-10T21:03:12.892185+0000","last_clean":"2023-10-10T21:03:12.892185+0000","last_became_active":"2023-10-10T21:03:12.891846+0000","last_became_peered":"2023-10-10T21:03:12.891846+0000","last_unstale":"2023-10-10T21:03:12.892185+0000","last_undegraded":"2023-10-10T21:03:12.892185+0000","last_fullsized":"2023-10-10T21:03:12.892185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:11.747446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.873723+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:53:22.038662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042832+0000","last_change":"2023-10-10T21:03:12.878371+0000","last_active":"2023-10-10T21:03:14.042832+0000","last_peered":"2023-10-10T21:03:14.042832+0000","last_clean":"2023-10-10T21:03:14.042832+0000","last_became_active":"2023-10-10T21:03:12.877211+0000","last_became_peered":"2023-10-10T21:03:12.877211+0000","last_unstale":"2023-10-10T21:03:14.042832+0000","last_undegraded":"2023-10-10T21:03:14.042832+0000","last_fullsized":"2023-10-10T21:03:14.042832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.873684+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:09.514016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067381+0000","last_change":"2023-10-10T21:03:12.889604+0000","last_active":"2023-10-10T21:03:14.067381+0000","last_peered":"2023-10-10T21:03:14.067381+0000","last_clean":"2023-10-10T21:03:14.067381+0000","last_became_active":"2023-10-10T21:03:12.889318+0000","last_became_peered":"2023-10-10T21:03:12.889318+0000","last_unstale":"2023-10-10T21:03:14.067381+0000","last_undegraded":"2023-10-10T21:03:14.067381+0000","last_fullsized":"2023-10-10T21:03:14.067381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:56.187027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053273+0000","last_change":"2023-10-10T21:03:14.044469+0000","last_active":"2023-10-10T21:03:14.053273+0000","last_peered":"2023-10-10T21:03:14.053273+0000","last_clean":"2023-10-10T21:03:14.053273+0000","last_became_active":"2023-10-10T21:03:14.044184+0000","last_became_peered":"2023-10-10T21:03:14.044184+0000","last_unstale":"2023-10-10T21:03:14.053273+0000","last_undegraded":"2023-10-10T21:03:14.053273+0000","last_fullsized":"2023-10-10T21:03:14.053273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.889551+0000","last_change":"2023-10-10T21:03:12.889551+0000","last_active":"2023-10-10T21:03:12.889551+0000","last_peered":"2023-10-10T21:03:12.889551+0000","last_clean":"2023-10-10T21:03:12.889551+0000","last_became_active":"2023-10-10T21:03:12.889403+0000","last_became_peered":"2023-10-10T21:03:12.889403+0000","last_unstale":"2023-10-10T21:03:12.889551+0000","last_undegraded":"2023-10-10T21:03:12.889551+0000","last_fullsized":"2023-10-10T21:03:12.889551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:51.756377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061355+0000","last_change":"2023-10-10T21:03:14.058577+0000","last_active":"2023-10-10T21:03:14.061355+0000","last_peered":"2023-10-10T21:03:14.061355+0000","last_clean":"2023-10-10T21:03:14.061355+0000","last_became_active":"2023-10-10T21:03:14.058273+0000","last_became_peered":"2023-10-10T21:03:14.058273+0000","last_unstale":"2023-10-10T21:03:14.061355+0000","last_undegraded":"2023-10-10T21:03:14.061355+0000","last_fullsized":"2023-10-10T21:03:14.061355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:24.406776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.072476+0000","last_change":"2023-10-10T21:03:12.890175+0000","last_active":"2023-10-10T21:03:14.072476+0000","last_peered":"2023-10-10T21:03:14.072476+0000","last_clean":"2023-10-10T21:03:14.072476+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:14.072476+0000","last_undegraded":"2023-10-10T21:03:14.072476+0000","last_fullsized":"2023-10-10T21:03:14.072476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:33:56.307223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.873086+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:38:53.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036503+0000","last_change":"2023-10-10T21:03:12.885659+0000","last_active":"2023-10-10T21:03:14.036503+0000","last_peered":"2023-10-10T21:03:14.036503+0000","last_clean":"2023-10-10T21:03:14.036503+0000","last_became_active":"2023-10-10T21:03:12.885443+0000","last_became_peered":"2023-10-10T21:03:12.885443+0000","last_unstale":"2023-10-10T21:03:14.036503+0000","last_undegraded":"2023-10-10T21:03:14.036503+0000","last_fullsized":"2023-10-10T21:03:14.036503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:47:05.333687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058689+0000","last_change":"2023-10-10T21:03:14.055943+0000","last_active":"2023-10-10T21:03:14.058689+0000","last_peered":"2023-10-10T21:03:14.058689+0000","last_clean":"2023-10-10T21:03:14.058689+0000","last_became_active":"2023-10-10T21:03:14.055642+0000","last_became_peered":"2023-10-10T21:03:14.055642+0000","last_unstale":"2023-10-10T21:03:14.058689+0000","last_undegraded":"2023-10-10T21:03:14.058689+0000","last_fullsized":"2023-10-10T21:03:14.058689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.887903+0000","last_change":"2023-10-10T21:03:12.887903+0000","last_active":"2023-10-10T21:03:12.887903+0000","last_peered":"2023-10-10T21:03:12.887903+0000","last_clean":"2023-10-10T21:03:12.887903+0000","last_became_active":"2023-10-10T21:03:12.887627+0000","last_became_peered":"2023-10-10T21:03:12.887627+0000","last_unstale":"2023-10-10T21:03:12.887903+0000","last_undegraded":"2023-10-10T21:03:12.887903+0000","last_fullsized":"2023-10-10T21:03:12.887903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:29:42.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064097+0000","last_change":"2023-10-10T21:03:14.060118+0000","last_active":"2023-10-10T21:03:14.064097+0000","last_peered":"2023-10-10T21:03:14.064097+0000","last_clean":"2023-10-10T21:03:14.064097+0000","last_became_active":"2023-10-10T21:03:14.059845+0000","last_became_peered":"2023-10-10T21:03:14.059845+0000","last_unstale":"2023-10-10T21:03:14.064097+0000","last_undegraded":"2023-10-10T21:03:14.064097+0000","last_fullsized":"2023-10-10T21:03:14.064097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.889578+0000","last_change":"2023-10-10T21:03:12.889578+0000","last_active":"2023-10-10T21:03:12.889578+0000","last_peered":"2023-10-10T21:03:12.889578+0000","last_clean":"2023-10-10T21:03:12.889578+0000","last_became_active":"2023-10-10T21:03:12.889368+0000","last_became_peered":"2023-10-10T21:03:12.889368+0000","last_unstale":"2023-10-10T21:03:12.889578+0000","last_undegraded":"2023-10-10T21:03:12.889578+0000","last_fullsized":"2023-10-10T21:03:12.889578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:24:05.169073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055292+0000","last_change":"2023-10-10T21:03:14.051228+0000","last_active":"2023-10-10T21:03:14.055292+0000","last_peered":"2023-10-10T21:03:14.055292+0000","last_clean":"2023-10-10T21:03:14.055292+0000","last_became_active":"2023-10-10T21:03:14.050931+0000","last_became_peered":"2023-10-10T21:03:14.050931+0000","last_unstale":"2023-10-10T21:03:14.055292+0000","last_undegraded":"2023-10-10T21:03:14.055292+0000","last_fullsized":"2023-10-10T21:03:14.055292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070819+0000","last_change":"2023-10-10T21:03:12.886478+0000","last_active":"2023-10-10T21:03:14.070819+0000","last_peered":"2023-10-10T21:03:14.070819+0000","last_clean":"2023-10-10T21:03:14.070819+0000","last_became_active":"2023-10-10T21:03:12.886128+0000","last_became_peered":"2023-10-10T21:03:12.886128+0000","last_unstale":"2023-10-10T21:03:14.070819+0000","last_undegraded":"2023-10-10T21:03:14.070819+0000","last_fullsized":"2023-10-10T21:03:14.070819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058959+0000","last_change":"2023-10-10T21:03:14.055709+0000","last_active":"2023-10-10T21:03:14.058959+0000","last_peered":"2023-10-10T21:03:14.058959+0000","last_clean":"2023-10-10T21:03:14.058959+0000","last_became_active":"2023-10-10T21:03:14.055452+0000","last_became_peered":"2023-10-10T21:03:14.055452+0000","last_unstale":"2023-10-10T21:03:14.058959+0000","last_undegraded":"2023-10-10T21:03:14.058959+0000","last_fullsized":"2023-10-10T21:03:14.058959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069997+0000","last_change":"2023-10-10T21:03:12.893952+0000","last_active":"2023-10-10T21:03:14.069997+0000","last_peered":"2023-10-10T21:03:14.069997+0000","last_clean":"2023-10-10T21:03:14.069997+0000","last_became_active":"2023-10-10T21:03:12.893610+0000","last_became_peered":"2023-10-10T21:03:12.893610+0000","last_unstale":"2023-10-10T21:03:14.069997+0000","last_undegraded":"2023-10-10T21:03:14.069997+0000","last_fullsized":"2023-10-10T21:03:14.069997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:09.534334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061304+0000","last_change":"2023-10-10T21:03:14.051290+0000","last_active":"2023-10-10T21:03:14.061304+0000","last_peered":"2023-10-10T21:03:14.061304+0000","last_clean":"2023-10-10T21:03:14.061304+0000","last_became_active":"2023-10-10T21:03:14.050996+0000","last_became_peered":"2023-10-10T21:03:14.050996+0000","last_unstale":"2023-10-10T21:03:14.061304+0000","last_undegraded":"2023-10-10T21:03:14.061304+0000","last_fullsized":"2023-10-10T21:03:14.061304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:31.597737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069611+0000","last_change":"2023-10-10T21:03:12.886527+0000","last_active":"2023-10-10T21:03:14.069611+0000","last_peered":"2023-10-10T21:03:14.069611+0000","last_clean":"2023-10-10T21:03:14.069611+0000","last_became_active":"2023-10-10T21:03:12.886243+0000","last_became_peered":"2023-10-10T21:03:12.886243+0000","last_unstale":"2023-10-10T21:03:14.069611+0000","last_undegraded":"2023-10-10T21:03:14.069611+0000","last_fullsized":"2023-10-10T21:03:14.069611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:46.323264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064868+0000","last_change":"2023-10-10T21:03:14.056497+0000","last_active":"2023-10-10T21:03:14.064868+0000","last_peered":"2023-10-10T21:03:14.064868+0000","last_clean":"2023-10-10T21:03:14.064868+0000","last_became_active":"2023-10-10T21:03:14.055367+0000","last_became_peered":"2023-10-10T21:03:14.055367+0000","last_unstale":"2023-10-10T21:03:14.064868+0000","last_undegraded":"2023-10-10T21:03:14.064868+0000","last_fullsized":"2023-10-10T21:03:14.064868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:34.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039649+0000","last_change":"2023-10-10T21:03:12.893029+0000","last_active":"2023-10-10T21:03:14.039649+0000","last_peered":"2023-10-10T21:03:14.039649+0000","last_clean":"2023-10-10T21:03:14.039649+0000","last_became_active":"2023-10-10T21:03:12.891259+0000","last_became_peered":"2023-10-10T21:03:12.891259+0000","last_unstale":"2023-10-10T21:03:14.039649+0000","last_undegraded":"2023-10-10T21:03:14.039649+0000","last_fullsized":"2023-10-10T21:03:14.039649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:44.279738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054116+0000","last_change":"2023-10-10T21:03:14.050667+0000","last_active":"2023-10-10T21:03:14.054116+0000","last_peered":"2023-10-10T21:03:14.054116+0000","last_clean":"2023-10-10T21:03:14.054116+0000","last_became_active":"2023-10-10T21:03:14.050399+0000","last_became_peered":"2023-10-10T21:03:14.050399+0000","last_unstale":"2023-10-10T21:03:14.054116+0000","last_undegraded":"2023-10-10T21:03:14.054116+0000","last_fullsized":"2023-10-10T21:03:14.054116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:24.498631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069657+0000","last_change":"2023-10-10T21:03:12.887639+0000","last_active":"2023-10-10T21:03:14.069657+0000","last_peered":"2023-10-10T21:03:14.069657+0000","last_clean":"2023-10-10T21:03:14.069657+0000","last_became_active":"2023-10-10T21:03:12.887398+0000","last_became_peered":"2023-10-10T21:03:12.887398+0000","last_unstale":"2023-10-10T21:03:14.069657+0000","last_undegraded":"2023-10-10T21:03:14.069657+0000","last_fullsized":"2023-10-10T21:03:14.069657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056449+0000","last_change":"2023-10-10T21:03:14.055555+0000","last_active":"2023-10-10T21:03:14.056449+0000","last_peered":"2023-10-10T21:03:14.056449+0000","last_clean":"2023-10-10T21:03:14.056449+0000","last_became_active":"2023-10-10T21:03:14.055241+0000","last_became_peered":"2023-10-10T21:03:14.055241+0000","last_unstale":"2023-10-10T21:03:14.056449+0000","last_undegraded":"2023-10-10T21:03:14.056449+0000","last_fullsized":"2023-10-10T21:03:14.056449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:04:04.186366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.038214+0000","last_change":"2023-10-10T21:03:12.889436+0000","last_active":"2023-10-10T21:03:14.038214+0000","last_peered":"2023-10-10T21:03:14.038214+0000","last_clean":"2023-10-10T21:03:14.038214+0000","last_became_active":"2023-10-10T21:03:12.889179+0000","last_became_peered":"2023-10-10T21:03:12.889179+0000","last_unstale":"2023-10-10T21:03:14.038214+0000","last_undegraded":"2023-10-10T21:03:14.038214+0000","last_fullsized":"2023-10-10T21:03:14.038214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.060011+0000","last_change":"2023-10-10T21:03:14.055915+0000","last_active":"2023-10-10T21:03:14.060011+0000","last_peered":"2023-10-10T21:03:14.060011+0000","last_clean":"2023-10-10T21:03:14.060011+0000","last_became_active":"2023-10-10T21:03:14.055646+0000","last_became_peered":"2023-10-10T21:03:14.055646+0000","last_unstale":"2023-10-10T21:03:14.060011+0000","last_undegraded":"2023-10-10T21:03:14.060011+0000","last_fullsized":"2023-10-10T21:03:14.060011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:42.622301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036674+0000","last_change":"2023-10-10T21:03:12.889430+0000","last_active":"2023-10-10T21:03:14.036674+0000","last_peered":"2023-10-10T21:03:14.036674+0000","last_clean":"2023-10-10T21:03:14.036674+0000","last_became_active":"2023-10-10T21:03:12.889154+0000","last_became_peered":"2023-10-10T21:03:12.889154+0000","last_unstale":"2023-10-10T21:03:14.036674+0000","last_undegraded":"2023-10-10T21:03:14.036674+0000","last_fullsized":"2023-10-10T21:03:14.036674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:14:09.052129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.051140+0000","last_change":"2023-10-10T21:03:14.048739+0000","last_active":"2023-10-10T21:03:14.051140+0000","last_peered":"2023-10-10T21:03:14.051140+0000","last_clean":"2023-10-10T21:03:14.051140+0000","last_became_active":"2023-10-10T21:03:14.048495+0000","last_became_peered":"2023-10-10T21:03:14.048495+0000","last_unstale":"2023-10-10T21:03:14.051140+0000","last_undegraded":"2023-10-10T21:03:14.051140+0000","last_fullsized":"2023-10-10T21:03:14.051140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.034542+0000","last_change":"2023-10-10T21:03:12.892718+0000","last_active":"2023-10-10T21:03:14.034542+0000","last_peered":"2023-10-10T21:03:14.034542+0000","last_clean":"2023-10-10T21:03:14.034542+0000","last_became_active":"2023-10-10T21:03:12.892352+0000","last_became_peered":"2023-10-10T21:03:12.892352+0000","last_unstale":"2023-10-10T21:03:14.034542+0000","last_undegraded":"2023-10-10T21:03:14.034542+0000","last_fullsized":"2023-10-10T21:03:14.034542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:03.334271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065829+0000","last_change":"2023-10-10T21:03:14.057428+0000","last_active":"2023-10-10T21:03:14.065829+0000","last_peered":"2023-10-10T21:03:14.065829+0000","last_clean":"2023-10-10T21:03:14.065829+0000","last_became_active":"2023-10-10T21:03:14.057133+0000","last_became_peered":"2023-10-10T21:03:14.057133+0000","last_unstale":"2023-10-10T21:03:14.065829+0000","last_undegraded":"2023-10-10T21:03:14.065829+0000","last_fullsized":"2023-10-10T21:03:14.065829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:23.301810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.073007+0000","last_change":"2023-10-10T21:03:12.886199+0000","last_active":"2023-10-10T21:03:14.073007+0000","last_peered":"2023-10-10T21:03:14.073007+0000","last_clean":"2023-10-10T21:03:14.073007+0000","last_became_active":"2023-10-10T21:03:12.885314+0000","last_became_peered":"2023-10-10T21:03:12.885314+0000","last_unstale":"2023-10-10T21:03:14.073007+0000","last_undegraded":"2023-10-10T21:03:14.073007+0000","last_fullsized":"2023-10-10T21:03:14.073007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053426+0000","last_change":"2023-10-10T21:03:14.046810+0000","last_active":"2023-10-10T21:03:14.053426+0000","last_peered":"2023-10-10T21:03:14.053426+0000","last_clean":"2023-10-10T21:03:14.053426+0000","last_became_active":"2023-10-10T21:03:14.046576+0000","last_became_peered":"2023-10-10T21:03:14.046576+0000","last_unstale":"2023-10-10T21:03:14.053426+0000","last_undegraded":"2023-10-10T21:03:14.053426+0000","last_fullsized":"2023-10-10T21:03:14.053426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:31:32.365391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042962+0000","last_change":"2023-10-10T21:03:12.886933+0000","last_active":"2023-10-10T21:03:14.042962+0000","last_peered":"2023-10-10T21:03:14.042962+0000","last_clean":"2023-10-10T21:03:14.042962+0000","last_became_active":"2023-10-10T21:03:12.886619+0000","last_became_peered":"2023-10-10T21:03:12.886619+0000","last_unstale":"2023-10-10T21:03:14.042962+0000","last_undegraded":"2023-10-10T21:03:14.042962+0000","last_fullsized":"2023-10-10T21:03:14.042962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065807+0000","last_change":"2023-10-10T21:03:14.062440+0000","last_active":"2023-10-10T21:03:14.065807+0000","last_peered":"2023-10-10T21:03:14.065807+0000","last_clean":"2023-10-10T21:03:14.065807+0000","last_became_active":"2023-10-10T21:03:14.062114+0000","last_became_peered":"2023-10-10T21:03:14.062114+0000","last_unstale":"2023-10-10T21:03:14.065807+0000","last_undegraded":"2023-10-10T21:03:14.065807+0000","last_fullsized":"2023-10-10T21:03:14.065807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036103+0000","last_change":"2023-10-10T21:03:12.885411+0000","last_active":"2023-10-10T21:03:14.036103+0000","last_peered":"2023-10-10T21:03:14.036103+0000","last_clean":"2023-10-10T21:03:14.036103+0000","last_became_active":"2023-10-10T21:03:12.885150+0000","last_became_peered":"2023-10-10T21:03:12.885150+0000","last_unstale":"2023-10-10T21:03:14.036103+0000","last_undegraded":"2023-10-10T21:03:14.036103+0000","last_fullsized":"2023-10-10T21:03:14.036103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053780+0000","last_change":"2023-10-10T21:03:14.045941+0000","last_active":"2023-10-10T21:03:14.053780+0000","last_peered":"2023-10-10T21:03:14.053780+0000","last_clean":"2023-10-10T21:03:14.053780+0000","last_became_active":"2023-10-10T21:03:14.045645+0000","last_became_peered":"2023-10-10T21:03:14.045645+0000","last_unstale":"2023-10-10T21:03:14.053780+0000","last_undegraded":"2023-10-10T21:03:14.053780+0000","last_fullsized":"2023-10-10T21:03:14.053780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042227+0000","last_change":"2023-10-10T21:03:12.883422+0000","last_active":"2023-10-10T21:03:14.042227+0000","last_peered":"2023-10-10T21:03:14.042227+0000","last_clean":"2023-10-10T21:03:14.042227+0000","last_became_active":"2023-10-10T21:03:12.883097+0000","last_became_peered":"2023-10-10T21:03:12.883097+0000","last_unstale":"2023-10-10T21:03:14.042227+0000","last_undegraded":"2023-10-10T21:03:14.042227+0000","last_fullsized":"2023-10-10T21:03:14.042227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:48:17.863125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056720+0000","last_change":"2023-10-10T21:03:14.054395+0000","last_active":"2023-10-10T21:03:14.056720+0000","last_peered":"2023-10-10T21:03:14.056720+0000","last_clean":"2023-10-10T21:03:14.056720+0000","last_became_active":"2023-10-10T21:03:14.054139+0000","last_became_peered":"2023-10-10T21:03:14.054139+0000","last_unstale":"2023-10-10T21:03:14.056720+0000","last_undegraded":"2023-10-10T21:03:14.056720+0000","last_fullsized":"2023-10-10T21:03:14.056720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036411+0000","last_change":"2023-10-10T21:03:12.888523+0000","last_active":"2023-10-10T21:03:14.036411+0000","last_peered":"2023-10-10T21:03:14.036411+0000","last_clean":"2023-10-10T21:03:14.036411+0000","last_became_active":"2023-10-10T21:03:12.888220+0000","last_became_peered":"2023-10-10T21:03:12.888220+0000","last_unstale":"2023-10-10T21:03:14.036411+0000","last_undegraded":"2023-10-10T21:03:14.036411+0000","last_fullsized":"2023-10-10T21:03:14.036411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.872046+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:40:49.674663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036675+0000","last_change":"2023-10-10T21:03:12.885959+0000","last_active":"2023-10-10T21:03:14.036675+0000","last_peered":"2023-10-10T21:03:14.036675+0000","last_clean":"2023-10-10T21:03:14.036675+0000","last_became_active":"2023-10-10T21:03:12.885624+0000","last_became_peered":"2023-10-10T21:03:12.885624+0000","last_unstale":"2023-10-10T21:03:14.036675+0000","last_undegraded":"2023-10-10T21:03:14.036675+0000","last_fullsized":"2023-10-10T21:03:14.036675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:23:43.708965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055334+0000","last_change":"2023-10-10T21:03:14.049917+0000","last_active":"2023-10-10T21:03:14.055334+0000","last_peered":"2023-10-10T21:03:14.055334+0000","last_clean":"2023-10-10T21:03:14.055334+0000","last_became_active":"2023-10-10T21:03:14.049674+0000","last_became_peered":"2023-10-10T21:03:14.049674+0000","last_unstale":"2023-10-10T21:03:14.055334+0000","last_undegraded":"2023-10-10T21:03:14.055334+0000","last_fullsized":"2023-10-10T21:03:14.055334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.892061+0000","last_change":"2023-10-10T21:03:12.892061+0000","last_active":"2023-10-10T21:03:12.892061+0000","last_peered":"2023-10-10T21:03:12.892061+0000","last_clean":"2023-10-10T21:03:12.892061+0000","last_became_active":"2023-10-10T21:03:12.891773+0000","last_became_peered":"2023-10-10T21:03:12.891773+0000","last_unstale":"2023-10-10T21:03:12.892061+0000","last_undegraded":"2023-10-10T21:03:12.892061+0000","last_fullsized":"2023-10-10T21:03:12.892061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:33.298861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057642+0000","last_change":"2023-10-10T21:03:14.052143+0000","last_active":"2023-10-10T21:03:14.057642+0000","last_peered":"2023-10-10T21:03:14.057642+0000","last_clean":"2023-10-10T21:03:14.057642+0000","last_became_active":"2023-10-10T21:03:14.051884+0000","last_became_peered":"2023-10-10T21:03:14.051884+0000","last_unstale":"2023-10-10T21:03:14.057642+0000","last_undegraded":"2023-10-10T21:03:14.057642+0000","last_fullsized":"2023-10-10T21:03:14.057642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039181+0000","last_change":"2023-10-10T21:03:12.887792+0000","last_active":"2023-10-10T21:03:14.039181+0000","last_peered":"2023-10-10T21:03:14.039181+0000","last_clean":"2023-10-10T21:03:14.039181+0000","last_became_active":"2023-10-10T21:03:12.887523+0000","last_became_peered":"2023-10-10T21:03:12.887523+0000","last_unstale":"2023-10-10T21:03:14.039181+0000","last_undegraded":"2023-10-10T21:03:14.039181+0000","last_fullsized":"2023-10-10T21:03:14.039181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.040453+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:03:14.040453+0000","last_peered":"2023-10-10T21:03:14.040453+0000","last_clean":"2023-10-10T21:03:14.040453+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:03:14.040453+0000","last_undegraded":"2023-10-10T21:03:14.040453+0000","last_fullsized":"2023-10-10T21:03:14.040453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074216,"statfs":{"total":96636764160,"available":96331997184,"internally_reserved":0,"allocated":344064,"data_stored":127623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.28799999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.752},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70999999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":731099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.622}]},{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.056}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.88}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":1.081}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.032}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":148487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.31}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.432},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.82799999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.68300000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073600,"statfs":{"total":96636764160,"available":96331366400,"internally_reserved":0,"allocated":974848,"data_stored":737297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.496},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.96099999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":140711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.627}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.71399999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.81399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.749},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82899999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.84499999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":8.9909999999999997},"last":0.82799999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.751}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":9.0250000000000004,"5min":9.0250000000000004,"15min":9.0250000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":8.8480000000000008,"5min":8.8480000000000008,"15min":8.8480000000000008},"last":0.85699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.79400000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.872}]},{"osd":1,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.94799999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.505}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.97899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.93300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:03:18.369 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:03:18.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.583+0000 7f3bcafff700 1 Processor -- start 2023-10-10T21:03:18.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.583+0000 7f3bcafff700 1 -- start start 2023-10-10T21:03:18.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bcafff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3bc40cbf30 0x7f3bc40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bcafff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3bc40b1420 0x7f3bc40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bcafff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc40cc300 con 0x7f3bc40ccf90 2023-10-10T21:03:18.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bcafff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc4156bf0 con 0x7f3bc40cbf30 2023-10-10T21:03:18.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bcafff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc40ae950 con 0x7f3bc40b1420 2023-10-10T21:03:18.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bc8d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3bc40cbf30 0x7f3bc40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bc8d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3bc40cbf30 0x7f3bc40ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44656/0 (socket says 172.21.15.154:44656) 2023-10-10T21:03:18.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bc8d9b700 1 -- 172.21.15.154:0/3150234313 learned_addr learned my addr 172.21.15.154:0/3150234313 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:18.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bc959c700 1 --2- 172.21.15.154:0/3150234313 >> v2:172.21.15.179:3300/0 conn(0x7f3bc40b1420 0x7f3bc40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bc8d9b700 1 -- 172.21.15.154:0/3150234313 >> v2:172.21.15.179:3300/0 conn(0x7f3bc40b1420 msgr2=0x7f3bc40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:18.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bc8d9b700 1 --2- 172.21.15.154:0/3150234313 >> v2:172.21.15.179:3300/0 conn(0x7f3bc40b1420 0x7f3bc40c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.585+0000 7f3bc8d9b700 1 -- 172.21.15.154:0/3150234313 >> v1:172.21.15.179:6789/0 conn(0x7f3bc40ccf90 legacy=0x7f3bc40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:18.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.586+0000 7f3bc8d9b700 1 -- 172.21.15.154:0/3150234313 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc40ad370 con 0x7f3bc40cbf30 2023-10-10T21:03:18.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.586+0000 7f3bc8d9b700 1 --2- 172.21.15.154:0/3150234313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40cbf30 0x7f3bc40ae410 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40b19e0 tx=0x7f3bb800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412d2ec876012743 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:18.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.586+0000 7f3bc37fe700 1 -- 172.21.15.154:0/3150234313 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800be60 con 0x7f3bc40cbf30 2023-10-10T21:03:18.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.586+0000 7f3bc37fe700 1 -- 172.21.15.154:0/3150234313 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb800ddc0 con 0x7f3bc40cbf30 2023-10-10T21:03:18.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.586+0000 7f3bc37fe700 1 -- 172.21.15.154:0/3150234313 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80196b0 con 0x7f3bc40cbf30 2023-10-10T21:03:18.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.586+0000 7f3bcafff700 1 -- 172.21.15.154:0/3150234313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40cbf30 msgr2=0x7f3bc40ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.586+0000 7f3bcafff700 1 --2- 172.21.15.154:0/3150234313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40cbf30 0x7f3bc40ae410 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40b19e0 tx=0x7f3bb800b4f0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.587+0000 7f3bcafff700 1 -- 172.21.15.154:0/3150234313 shutdown_connections 2023-10-10T21:03:18.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.587+0000 7f3bcafff700 1 --2- 172.21.15.154:0/3150234313 >> v2:172.21.15.179:3300/0 conn(0x7f3bc40b1420 0x7f3bc40c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.587+0000 7f3bcafff700 1 --2- 172.21.15.154:0/3150234313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40cbf30 0x7f3bc40ae410 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.587+0000 7f3bcafff700 1 -- 172.21.15.154:0/3150234313 >> 172.21.15.154:0/3150234313 conn(0x7f3bc406a320 msgr2=0x7f3bc40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:18.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.587+0000 7f3bcafff700 1 -- 172.21.15.154:0/3150234313 shutdown_connections 2023-10-10T21:03:18.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.587+0000 7f3bcafff700 1 -- 172.21.15.154:0/3150234313 wait complete. 2023-10-10T21:03:18.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.588+0000 7f3bcafff700 1 Processor -- start 2023-10-10T21:03:18.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.588+0000 7f3bcafff700 1 -- start start 2023-10-10T21:03:18.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.589+0000 7f3bcafff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc40b1420 0x7f3bc41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.589+0000 7f3bcafff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc40cbf30 0x7f3bc4147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.589+0000 7f3bcafff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40ccf90 0x7f3bc40a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.589+0000 7f3bcafff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc41475d0 con 0x7f3bc40ccf90 2023-10-10T21:03:18.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.589+0000 7f3bcafff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40a9d40 con 0x7f3bc40cbf30 2023-10-10T21:03:18.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.589+0000 7f3bcafff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40a66b0 con 0x7f3bc40b1420 2023-10-10T21:03:18.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.589+0000 7f3bc959c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40ccf90 0x7f3bc40a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.589+0000 7f3bc959c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40ccf90 0x7f3bc40a5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44662/0 (socket says 172.21.15.154:44662) 2023-10-10T21:03:18.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.589+0000 7f3bc959c700 1 -- 172.21.15.154:0/41600146 learned_addr learned my addr 172.21.15.154:0/41600146 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:18.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc8d9b700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc40b1420 0x7f3bc41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc3fff700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc40cbf30 0x7f3bc4147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc959c700 1 -- 172.21.15.154:0/41600146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc40b1420 msgr2=0x7f3bc41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc959c700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc40b1420 0x7f3bc41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc959c700 1 -- 172.21.15.154:0/41600146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc40cbf30 msgr2=0x7f3bc4147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc959c700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc40cbf30 0x7f3bc4147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc959c700 1 -- 172.21.15.154:0/41600146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb800b790 con 0x7f3bc40ccf90 2023-10-10T21:03:18.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc3fff700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc40cbf30 0x7f3bc4147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:18.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc959c700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40ccf90 0x7f3bc40a5e70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009fa0 tx=0x7f3bbc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:18.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc0ff9700 1 -- 172.21.15.154:0/41600146 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00ed20 con 0x7f3bc40ccf90 2023-10-10T21:03:18.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc0ff9700 1 -- 172.21.15.154:0/41600146 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00ee80 con 0x7f3bc40ccf90 2023-10-10T21:03:18.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bc0ff9700 1 -- 172.21.15.154:0/41600146 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc014670 con 0x7f3bc40ccf90 2023-10-10T21:03:18.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc40a6990 con 0x7f3bc40ccf90 2023-10-10T21:03:18.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.590+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc40a6f50 con 0x7f3bc40ccf90 2023-10-10T21:03:18.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.591+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc40a9f40 con 0x7f3bc40ccf90 2023-10-10T21:03:18.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.592+0000 7f3bc0ff9700 1 -- 172.21.15.154:0/41600146 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bbc0149e0 con 0x7f3bc40ccf90 2023-10-10T21:03:18.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.593+0000 7f3bc0ff9700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3ba8066f30 0x7f3ba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:18.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.594+0000 7f3bc0ff9700 1 -- 172.21.15.154:0/41600146 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3bbc084d50 con 0x7f3bc40ccf90 2023-10-10T21:03:18.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.594+0000 7f3bc8d9b700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3ba8066f30 0x7f3ba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:18.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.594+0000 7f3bc8d9b700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3ba8066f30 0x7f3ba80693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40b19e0 tx=0x7f3bb801b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:18.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.598+0000 7f3bc0ff9700 1 -- 172.21.15.154:0/41600146 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bc40a9f40 con 0x7f3bc40ccf90 2023-10-10T21:03:18.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.785+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bc40a9f10 con 0x7f3ba8066f30 2023-10-10T21:03:18.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.793+0000 7f3bc0ff9700 1 -- 172.21.15.154:0/41600146 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288013 (secure 0 0 0) 0x7f3bc40a9f10 con 0x7f3ba8066f30 2023-10-10T21:03:18.799 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:18.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3ba8066f30 msgr2=0x7f3ba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3ba8066f30 0x7f3ba80693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40b19e0 tx=0x7f3bb801b000 comp rx=0 tx=0).stop 2023-10-10T21:03:18.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40ccf90 msgr2=0x7f3bc40a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:18.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40ccf90 0x7f3bc40a5e70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009fa0 tx=0x7f3bbc009900 comp rx=0 tx=0).stop 2023-10-10T21:03:18.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 shutdown_connections 2023-10-10T21:03:18.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bc40ccf90 0x7f3bc40a5e70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3ba8066f30 0x7f3ba80693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bc40b1420 0x7f3bc41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 --2- 172.21.15.154:0/41600146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc40cbf30 0x7f3bc4147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:18.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.797+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 >> 172.21.15.154:0/41600146 conn(0x7f3bc406a320 msgr2=0x7f3bc40ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:18.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.798+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 shutdown_connections 2023-10-10T21:03:18.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:18.798+0000 7f3bcafff700 1 -- 172.21.15.154:0/41600146 wait complete. 2023-10-10T21:03:18.805 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:03:18.816 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-10-10T21:03:17.865350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591138,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382428,"kb_used_data":4124,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592292,"statfs":{"total":773094113280,"available":770654507008,"internally_reserved":0,"allocated":4222976,"data_stored":2327340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001120"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058310+0000","last_change":"2023-10-10T21:03:14.056535+0000","last_active":"2023-10-10T21:03:14.058310+0000","last_peered":"2023-10-10T21:03:14.058310+0000","last_clean":"2023-10-10T21:03:14.058310+0000","last_became_active":"2023-10-10T21:03:14.056221+0000","last_became_peered":"2023-10-10T21:03:14.056221+0000","last_unstale":"2023-10-10T21:03:14.058310+0000","last_undegraded":"2023-10-10T21:03:14.058310+0000","last_fullsized":"2023-10-10T21:03:14.058310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.875966+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:24:09.519551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053297+0000","last_change":"2023-10-10T21:03:14.044532+0000","last_active":"2023-10-10T21:03:14.053297+0000","last_peered":"2023-10-10T21:03:14.053297+0000","last_clean":"2023-10-10T21:03:14.053297+0000","last_became_active":"2023-10-10T21:03:14.044238+0000","last_became_peered":"2023-10-10T21:03:14.044238+0000","last_unstale":"2023-10-10T21:03:14.053297+0000","last_undegraded":"2023-10-10T21:03:14.053297+0000","last_fullsized":"2023-10-10T21:03:14.053297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:57:09.143759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061282+0000","last_change":"2023-10-10T21:03:14.050842+0000","last_active":"2023-10-10T21:03:14.061282+0000","last_peered":"2023-10-10T21:03:14.061282+0000","last_clean":"2023-10-10T21:03:14.061282+0000","last_became_active":"2023-10-10T21:03:14.050579+0000","last_became_peered":"2023-10-10T21:03:14.050579+0000","last_unstale":"2023-10-10T21:03:14.061282+0000","last_undegraded":"2023-10-10T21:03:14.061282+0000","last_fullsized":"2023-10-10T21:03:14.061282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049131+0000","last_change":"2023-10-10T21:03:14.046823+0000","last_active":"2023-10-10T21:03:14.049131+0000","last_peered":"2023-10-10T21:03:14.049131+0000","last_clean":"2023-10-10T21:03:14.049131+0000","last_became_active":"2023-10-10T21:03:14.046566+0000","last_became_peered":"2023-10-10T21:03:14.046566+0000","last_unstale":"2023-10-10T21:03:14.049131+0000","last_undegraded":"2023-10-10T21:03:14.049131+0000","last_fullsized":"2023-10-10T21:03:14.049131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.116595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.875796+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:41.386045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049955+0000","last_change":"2023-10-10T21:03:14.047991+0000","last_active":"2023-10-10T21:03:14.049955+0000","last_peered":"2023-10-10T21:03:14.049955+0000","last_clean":"2023-10-10T21:03:14.049955+0000","last_became_active":"2023-10-10T21:03:14.047702+0000","last_became_peered":"2023-10-10T21:03:14.047702+0000","last_unstale":"2023-10-10T21:03:14.049955+0000","last_undegraded":"2023-10-10T21:03:14.049955+0000","last_fullsized":"2023-10-10T21:03:14.049955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052555+0000","last_change":"2023-10-10T21:03:14.049953+0000","last_active":"2023-10-10T21:03:14.052555+0000","last_peered":"2023-10-10T21:03:14.052555+0000","last_clean":"2023-10-10T21:03:14.052555+0000","last_became_active":"2023-10-10T21:03:14.049549+0000","last_became_peered":"2023-10-10T21:03:14.049549+0000","last_unstale":"2023-10-10T21:03:14.052555+0000","last_undegraded":"2023-10-10T21:03:14.052555+0000","last_fullsized":"2023-10-10T21:03:14.052555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066618+0000","last_change":"2023-10-10T21:03:14.062596+0000","last_active":"2023-10-10T21:03:14.066618+0000","last_peered":"2023-10-10T21:03:14.066618+0000","last_clean":"2023-10-10T21:03:14.066618+0000","last_became_active":"2023-10-10T21:03:14.062296+0000","last_became_peered":"2023-10-10T21:03:14.062296+0000","last_unstale":"2023-10-10T21:03:14.066618+0000","last_undegraded":"2023-10-10T21:03:14.066618+0000","last_fullsized":"2023-10-10T21:03:14.066618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:58:45.241585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058876+0000","last_change":"2023-10-10T21:03:14.043250+0000","last_active":"2023-10-10T21:03:14.058876+0000","last_peered":"2023-10-10T21:03:14.058876+0000","last_clean":"2023-10-10T21:03:14.058876+0000","last_became_active":"2023-10-10T21:03:14.042985+0000","last_became_peered":"2023-10-10T21:03:14.042985+0000","last_unstale":"2023-10-10T21:03:14.058876+0000","last_undegraded":"2023-10-10T21:03:14.058876+0000","last_fullsized":"2023-10-10T21:03:14.058876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066738+0000","last_change":"2023-10-10T21:03:14.060697+0000","last_active":"2023-10-10T21:03:14.066738+0000","last_peered":"2023-10-10T21:03:14.066738+0000","last_clean":"2023-10-10T21:03:14.066738+0000","last_became_active":"2023-10-10T21:03:14.060246+0000","last_became_peered":"2023-10-10T21:03:14.060246+0000","last_unstale":"2023-10-10T21:03:14.066738+0000","last_undegraded":"2023-10-10T21:03:14.066738+0000","last_fullsized":"2023-10-10T21:03:14.066738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053144+0000","last_change":"2023-10-10T21:03:14.041036+0000","last_active":"2023-10-10T21:03:14.053144+0000","last_peered":"2023-10-10T21:03:14.053144+0000","last_clean":"2023-10-10T21:03:14.053144+0000","last_became_active":"2023-10-10T21:03:14.040620+0000","last_became_peered":"2023-10-10T21:03:14.040620+0000","last_unstale":"2023-10-10T21:03:14.053144+0000","last_undegraded":"2023-10-10T21:03:14.053144+0000","last_fullsized":"2023-10-10T21:03:14.053144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049113+0000","last_change":"2023-10-10T21:03:14.046280+0000","last_active":"2023-10-10T21:03:14.049113+0000","last_peered":"2023-10-10T21:03:14.049113+0000","last_clean":"2023-10-10T21:03:14.049113+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.049113+0000","last_undegraded":"2023-10-10T21:03:14.049113+0000","last_fullsized":"2023-10-10T21:03:14.049113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:28.753153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.875255+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:10:36.558402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054431+0000","last_change":"2023-10-10T21:03:14.049328+0000","last_active":"2023-10-10T21:03:14.054431+0000","last_peered":"2023-10-10T21:03:14.054431+0000","last_clean":"2023-10-10T21:03:14.054431+0000","last_became_active":"2023-10-10T21:03:14.048765+0000","last_became_peered":"2023-10-10T21:03:14.048765+0000","last_unstale":"2023-10-10T21:03:14.054431+0000","last_undegraded":"2023-10-10T21:03:14.054431+0000","last_fullsized":"2023-10-10T21:03:14.054431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:08.144185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057612+0000","last_change":"2023-10-10T21:03:14.051301+0000","last_active":"2023-10-10T21:03:14.057612+0000","last_peered":"2023-10-10T21:03:14.057612+0000","last_clean":"2023-10-10T21:03:14.057612+0000","last_became_active":"2023-10-10T21:03:14.050919+0000","last_became_peered":"2023-10-10T21:03:14.050919+0000","last_unstale":"2023-10-10T21:03:14.057612+0000","last_undegraded":"2023-10-10T21:03:14.057612+0000","last_fullsized":"2023-10-10T21:03:14.057612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049838+0000","last_change":"2023-10-10T21:03:14.047703+0000","last_active":"2023-10-10T21:03:14.049838+0000","last_peered":"2023-10-10T21:03:14.049838+0000","last_clean":"2023-10-10T21:03:14.049838+0000","last_became_active":"2023-10-10T21:03:14.047391+0000","last_became_peered":"2023-10-10T21:03:14.047391+0000","last_unstale":"2023-10-10T21:03:14.049838+0000","last_undegraded":"2023-10-10T21:03:14.049838+0000","last_fullsized":"2023-10-10T21:03:14.049838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.874882+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:46:00.757042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.874807+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:57:10.345139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065008+0000","last_change":"2023-10-10T21:03:14.057258+0000","last_active":"2023-10-10T21:03:14.065008+0000","last_peered":"2023-10-10T21:03:14.065008+0000","last_clean":"2023-10-10T21:03:14.065008+0000","last_became_active":"2023-10-10T21:03:14.057010+0000","last_became_peered":"2023-10-10T21:03:14.057010+0000","last_unstale":"2023-10-10T21:03:14.065008+0000","last_undegraded":"2023-10-10T21:03:14.065008+0000","last_fullsized":"2023-10-10T21:03:14.065008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:40:13.267887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056825+0000","last_change":"2023-10-10T21:03:14.052191+0000","last_active":"2023-10-10T21:03:14.056825+0000","last_peered":"2023-10-10T21:03:14.056825+0000","last_clean":"2023-10-10T21:03:14.056825+0000","last_became_active":"2023-10-10T21:03:14.051717+0000","last_became_peered":"2023-10-10T21:03:14.051717+0000","last_unstale":"2023-10-10T21:03:14.056825+0000","last_undegraded":"2023-10-10T21:03:14.056825+0000","last_fullsized":"2023-10-10T21:03:14.056825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056242+0000","last_change":"2023-10-10T21:03:14.050529+0000","last_active":"2023-10-10T21:03:14.056242+0000","last_peered":"2023-10-10T21:03:14.056242+0000","last_clean":"2023-10-10T21:03:14.056242+0000","last_became_active":"2023-10-10T21:03:14.050259+0000","last_became_peered":"2023-10-10T21:03:14.050259+0000","last_unstale":"2023-10-10T21:03:14.056242+0000","last_undegraded":"2023-10-10T21:03:14.056242+0000","last_fullsized":"2023-10-10T21:03:14.056242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056916+0000","last_change":"2023-10-10T21:03:14.053134+0000","last_active":"2023-10-10T21:03:14.056916+0000","last_peered":"2023-10-10T21:03:14.056916+0000","last_clean":"2023-10-10T21:03:14.056916+0000","last_became_active":"2023-10-10T21:03:14.052832+0000","last_became_peered":"2023-10-10T21:03:14.052832+0000","last_unstale":"2023-10-10T21:03:14.056916+0000","last_undegraded":"2023-10-10T21:03:14.056916+0000","last_fullsized":"2023-10-10T21:03:14.056916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055627+0000","last_change":"2023-10-10T21:03:14.054510+0000","last_active":"2023-10-10T21:03:14.055627+0000","last_peered":"2023-10-10T21:03:14.055627+0000","last_clean":"2023-10-10T21:03:14.055627+0000","last_became_active":"2023-10-10T21:03:14.053503+0000","last_became_peered":"2023-10-10T21:03:14.053503+0000","last_unstale":"2023-10-10T21:03:14.055627+0000","last_undegraded":"2023-10-10T21:03:14.055627+0000","last_fullsized":"2023-10-10T21:03:14.055627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061435+0000","last_change":"2023-10-10T21:03:14.053313+0000","last_active":"2023-10-10T21:03:14.061435+0000","last_peered":"2023-10-10T21:03:14.061435+0000","last_clean":"2023-10-10T21:03:14.061435+0000","last_became_active":"2023-10-10T21:03:14.053079+0000","last_became_peered":"2023-10-10T21:03:14.053079+0000","last_unstale":"2023-10-10T21:03:14.061435+0000","last_undegraded":"2023-10-10T21:03:14.061435+0000","last_fullsized":"2023-10-10T21:03:14.061435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.874243+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:17:13.547773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061383+0000","last_change":"2023-10-10T21:03:14.050946+0000","last_active":"2023-10-10T21:03:14.061383+0000","last_peered":"2023-10-10T21:03:14.061383+0000","last_clean":"2023-10-10T21:03:14.061383+0000","last_became_active":"2023-10-10T21:03:14.050591+0000","last_became_peered":"2023-10-10T21:03:14.050591+0000","last_unstale":"2023-10-10T21:03:14.061383+0000","last_undegraded":"2023-10-10T21:03:14.061383+0000","last_fullsized":"2023-10-10T21:03:14.061383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:56.258834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053266+0000","last_change":"2023-10-10T21:03:14.045679+0000","last_active":"2023-10-10T21:03:14.053266+0000","last_peered":"2023-10-10T21:03:14.053266+0000","last_clean":"2023-10-10T21:03:14.053266+0000","last_became_active":"2023-10-10T21:03:14.045412+0000","last_became_peered":"2023-10-10T21:03:14.045412+0000","last_unstale":"2023-10-10T21:03:14.053266+0000","last_undegraded":"2023-10-10T21:03:14.053266+0000","last_fullsized":"2023-10-10T21:03:14.053266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056845+0000","last_change":"2023-10-10T21:03:14.054112+0000","last_active":"2023-10-10T21:03:14.056845+0000","last_peered":"2023-10-10T21:03:14.056845+0000","last_clean":"2023-10-10T21:03:14.056845+0000","last_became_active":"2023-10-10T21:03:14.052952+0000","last_became_peered":"2023-10-10T21:03:14.052952+0000","last_unstale":"2023-10-10T21:03:14.056845+0000","last_undegraded":"2023-10-10T21:03:14.056845+0000","last_fullsized":"2023-10-10T21:03:14.056845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052548+0000","last_change":"2023-10-10T21:03:14.049723+0000","last_active":"2023-10-10T21:03:14.052548+0000","last_peered":"2023-10-10T21:03:14.052548+0000","last_clean":"2023-10-10T21:03:14.052548+0000","last_became_active":"2023-10-10T21:03:14.049283+0000","last_became_peered":"2023-10-10T21:03:14.049283+0000","last_unstale":"2023-10-10T21:03:14.052548+0000","last_undegraded":"2023-10-10T21:03:14.052548+0000","last_fullsized":"2023-10-10T21:03:14.052548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054706+0000","last_change":"2023-10-10T21:03:14.051746+0000","last_active":"2023-10-10T21:03:14.054706+0000","last_peered":"2023-10-10T21:03:14.054706+0000","last_clean":"2023-10-10T21:03:14.054706+0000","last_became_active":"2023-10-10T21:03:14.051312+0000","last_became_peered":"2023-10-10T21:03:14.051312+0000","last_unstale":"2023-10-10T21:03:14.054706+0000","last_undegraded":"2023-10-10T21:03:14.054706+0000","last_fullsized":"2023-10-10T21:03:14.054706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058708+0000","last_change":"2023-10-10T21:03:14.056651+0000","last_active":"2023-10-10T21:03:14.058708+0000","last_peered":"2023-10-10T21:03:14.058708+0000","last_clean":"2023-10-10T21:03:14.058708+0000","last_became_active":"2023-10-10T21:03:14.056380+0000","last_became_peered":"2023-10-10T21:03:14.056380+0000","last_unstale":"2023-10-10T21:03:14.058708+0000","last_undegraded":"2023-10-10T21:03:14.058708+0000","last_fullsized":"2023-10-10T21:03:14.058708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056688+0000","last_change":"2023-10-10T21:03:14.052449+0000","last_active":"2023-10-10T21:03:14.056688+0000","last_peered":"2023-10-10T21:03:14.056688+0000","last_clean":"2023-10-10T21:03:14.056688+0000","last_became_active":"2023-10-10T21:03:14.052170+0000","last_became_peered":"2023-10-10T21:03:14.052170+0000","last_unstale":"2023-10-10T21:03:14.056688+0000","last_undegraded":"2023-10-10T21:03:14.056688+0000","last_fullsized":"2023-10-10T21:03:14.056688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070197+0000","last_change":"2023-10-10T21:03:12.887804+0000","last_active":"2023-10-10T21:03:14.070197+0000","last_peered":"2023-10-10T21:03:14.070197+0000","last_clean":"2023-10-10T21:03:14.070197+0000","last_became_active":"2023-10-10T21:03:12.886661+0000","last_became_peered":"2023-10-10T21:03:12.886661+0000","last_unstale":"2023-10-10T21:03:14.070197+0000","last_undegraded":"2023-10-10T21:03:14.070197+0000","last_fullsized":"2023-10-10T21:03:14.070197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:48.860387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056422+0000","last_change":"2023-10-10T21:03:14.055315+0000","last_active":"2023-10-10T21:03:14.056422+0000","last_peered":"2023-10-10T21:03:14.056422+0000","last_clean":"2023-10-10T21:03:14.056422+0000","last_became_active":"2023-10-10T21:03:14.055012+0000","last_became_peered":"2023-10-10T21:03:14.055012+0000","last_unstale":"2023-10-10T21:03:14.056422+0000","last_undegraded":"2023-10-10T21:03:14.056422+0000","last_fullsized":"2023-10-10T21:03:14.056422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067737+0000","last_change":"2023-10-10T21:03:12.891968+0000","last_active":"2023-10-10T21:03:14.067737+0000","last_peered":"2023-10-10T21:03:14.067737+0000","last_clean":"2023-10-10T21:03:14.067737+0000","last_became_active":"2023-10-10T21:03:12.891692+0000","last_became_peered":"2023-10-10T21:03:12.891692+0000","last_unstale":"2023-10-10T21:03:14.067737+0000","last_undegraded":"2023-10-10T21:03:14.067737+0000","last_fullsized":"2023-10-10T21:03:14.067737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055774+0000","last_change":"2023-10-10T21:03:14.052248+0000","last_active":"2023-10-10T21:03:14.055774+0000","last_peered":"2023-10-10T21:03:14.055774+0000","last_clean":"2023-10-10T21:03:14.055774+0000","last_became_active":"2023-10-10T21:03:14.051970+0000","last_became_peered":"2023-10-10T21:03:14.051970+0000","last_unstale":"2023-10-10T21:03:14.055774+0000","last_undegraded":"2023-10-10T21:03:14.055774+0000","last_fullsized":"2023-10-10T21:03:14.055774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.890886+0000","last_change":"2023-10-10T21:03:12.890886+0000","last_active":"2023-10-10T21:03:12.890886+0000","last_peered":"2023-10-10T21:03:12.890886+0000","last_clean":"2023-10-10T21:03:12.890886+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:12.890886+0000","last_undegraded":"2023-10-10T21:03:12.890886+0000","last_fullsized":"2023-10-10T21:03:12.890886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:22:47.067057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061401+0000","last_change":"2023-10-10T21:03:14.058547+0000","last_active":"2023-10-10T21:03:14.061401+0000","last_peered":"2023-10-10T21:03:14.061401+0000","last_clean":"2023-10-10T21:03:14.061401+0000","last_became_active":"2023-10-10T21:03:14.058172+0000","last_became_peered":"2023-10-10T21:03:14.058172+0000","last_unstale":"2023-10-10T21:03:14.061401+0000","last_undegraded":"2023-10-10T21:03:14.061401+0000","last_fullsized":"2023-10-10T21:03:14.061401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.071334+0000","last_change":"2023-10-10T21:03:12.886500+0000","last_active":"2023-10-10T21:03:14.071334+0000","last_peered":"2023-10-10T21:03:14.071334+0000","last_clean":"2023-10-10T21:03:14.071334+0000","last_became_active":"2023-10-10T21:03:12.886219+0000","last_became_peered":"2023-10-10T21:03:12.886219+0000","last_unstale":"2023-10-10T21:03:14.071334+0000","last_undegraded":"2023-10-10T21:03:14.071334+0000","last_fullsized":"2023-10-10T21:03:14.071334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:12.688030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058736+0000","last_change":"2023-10-10T21:03:14.055102+0000","last_active":"2023-10-10T21:03:14.058736+0000","last_peered":"2023-10-10T21:03:14.058736+0000","last_clean":"2023-10-10T21:03:14.058736+0000","last_became_active":"2023-10-10T21:03:14.054774+0000","last_became_peered":"2023-10-10T21:03:14.054774+0000","last_unstale":"2023-10-10T21:03:14.058736+0000","last_undegraded":"2023-10-10T21:03:14.058736+0000","last_fullsized":"2023-10-10T21:03:14.058736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069543+0000","last_change":"2023-10-10T21:03:12.890962+0000","last_active":"2023-10-10T21:03:14.069543+0000","last_peered":"2023-10-10T21:03:14.069543+0000","last_clean":"2023-10-10T21:03:14.069543+0000","last_became_active":"2023-10-10T21:03:12.890574+0000","last_became_peered":"2023-10-10T21:03:12.890574+0000","last_unstale":"2023-10-10T21:03:14.069543+0000","last_undegraded":"2023-10-10T21:03:14.069543+0000","last_fullsized":"2023-10-10T21:03:14.069543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:14.768025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053330+0000","last_change":"2023-10-10T21:03:14.046246+0000","last_active":"2023-10-10T21:03:14.053330+0000","last_peered":"2023-10-10T21:03:14.053330+0000","last_clean":"2023-10-10T21:03:14.053330+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.053330+0000","last_undegraded":"2023-10-10T21:03:14.053330+0000","last_fullsized":"2023-10-10T21:03:14.053330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069582+0000","last_change":"2023-10-10T21:03:12.890898+0000","last_active":"2023-10-10T21:03:14.069582+0000","last_peered":"2023-10-10T21:03:14.069582+0000","last_clean":"2023-10-10T21:03:14.069582+0000","last_became_active":"2023-10-10T21:03:12.890638+0000","last_became_peered":"2023-10-10T21:03:12.890638+0000","last_unstale":"2023-10-10T21:03:14.069582+0000","last_undegraded":"2023-10-10T21:03:14.069582+0000","last_fullsized":"2023-10-10T21:03:14.069582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:50:30.753850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052328+0000","last_change":"2023-10-10T21:03:14.048312+0000","last_active":"2023-10-10T21:03:14.052328+0000","last_peered":"2023-10-10T21:03:14.052328+0000","last_clean":"2023-10-10T21:03:14.052328+0000","last_became_active":"2023-10-10T21:03:14.048046+0000","last_became_peered":"2023-10-10T21:03:14.048046+0000","last_unstale":"2023-10-10T21:03:14.052328+0000","last_undegraded":"2023-10-10T21:03:14.052328+0000","last_fullsized":"2023-10-10T21:03:14.052328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.881085+0000","last_change":"2023-10-10T21:03:12.881085+0000","last_active":"2023-10-10T21:03:12.881085+0000","last_peered":"2023-10-10T21:03:12.881085+0000","last_clean":"2023-10-10T21:03:12.881085+0000","last_became_active":"2023-10-10T21:03:12.880788+0000","last_became_peered":"2023-10-10T21:03:12.880788+0000","last_unstale":"2023-10-10T21:03:12.881085+0000","last_undegraded":"2023-10-10T21:03:12.881085+0000","last_fullsized":"2023-10-10T21:03:12.881085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:41:10.360039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.062294+0000","last_change":"2023-10-10T21:03:14.057908+0000","last_active":"2023-10-10T21:03:14.062294+0000","last_peered":"2023-10-10T21:03:14.062294+0000","last_clean":"2023-10-10T21:03:14.062294+0000","last_became_active":"2023-10-10T21:03:14.057554+0000","last_became_peered":"2023-10-10T21:03:14.057554+0000","last_unstale":"2023-10-10T21:03:14.062294+0000","last_undegraded":"2023-10-10T21:03:14.062294+0000","last_fullsized":"2023-10-10T21:03:14.062294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.035024+0000","last_change":"2023-10-10T21:03:12.889571+0000","last_active":"2023-10-10T21:03:14.035024+0000","last_peered":"2023-10-10T21:03:14.035024+0000","last_clean":"2023-10-10T21:03:14.035024+0000","last_became_active":"2023-10-10T21:03:12.888606+0000","last_became_peered":"2023-10-10T21:03:12.888606+0000","last_unstale":"2023-10-10T21:03:14.035024+0000","last_undegraded":"2023-10-10T21:03:14.035024+0000","last_fullsized":"2023-10-10T21:03:14.035024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:07:21.202825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053737+0000","last_change":"2023-10-10T21:03:14.040585+0000","last_active":"2023-10-10T21:03:14.053737+0000","last_peered":"2023-10-10T21:03:14.053737+0000","last_clean":"2023-10-10T21:03:14.053737+0000","last_became_active":"2023-10-10T21:03:14.040307+0000","last_became_peered":"2023-10-10T21:03:14.040307+0000","last_unstale":"2023-10-10T21:03:14.053737+0000","last_undegraded":"2023-10-10T21:03:14.053737+0000","last_fullsized":"2023-10-10T21:03:14.053737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.892185+0000","last_change":"2023-10-10T21:03:12.892185+0000","last_active":"2023-10-10T21:03:12.892185+0000","last_peered":"2023-10-10T21:03:12.892185+0000","last_clean":"2023-10-10T21:03:12.892185+0000","last_became_active":"2023-10-10T21:03:12.891846+0000","last_became_peered":"2023-10-10T21:03:12.891846+0000","last_unstale":"2023-10-10T21:03:12.892185+0000","last_undegraded":"2023-10-10T21:03:12.892185+0000","last_fullsized":"2023-10-10T21:03:12.892185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:11.747446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.873723+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:53:22.038662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042832+0000","last_change":"2023-10-10T21:03:12.878371+0000","last_active":"2023-10-10T21:03:14.042832+0000","last_peered":"2023-10-10T21:03:14.042832+0000","last_clean":"2023-10-10T21:03:14.042832+0000","last_became_active":"2023-10-10T21:03:12.877211+0000","last_became_peered":"2023-10-10T21:03:12.877211+0000","last_unstale":"2023-10-10T21:03:14.042832+0000","last_undegraded":"2023-10-10T21:03:14.042832+0000","last_fullsized":"2023-10-10T21:03:14.042832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.873684+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:09.514016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067381+0000","last_change":"2023-10-10T21:03:12.889604+0000","last_active":"2023-10-10T21:03:14.067381+0000","last_peered":"2023-10-10T21:03:14.067381+0000","last_clean":"2023-10-10T21:03:14.067381+0000","last_became_active":"2023-10-10T21:03:12.889318+0000","last_became_peered":"2023-10-10T21:03:12.889318+0000","last_unstale":"2023-10-10T21:03:14.067381+0000","last_undegraded":"2023-10-10T21:03:14.067381+0000","last_fullsized":"2023-10-10T21:03:14.067381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:56.187027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053273+0000","last_change":"2023-10-10T21:03:14.044469+0000","last_active":"2023-10-10T21:03:14.053273+0000","last_peered":"2023-10-10T21:03:14.053273+0000","last_clean":"2023-10-10T21:03:14.053273+0000","last_became_active":"2023-10-10T21:03:14.044184+0000","last_became_peered":"2023-10-10T21:03:14.044184+0000","last_unstale":"2023-10-10T21:03:14.053273+0000","last_undegraded":"2023-10-10T21:03:14.053273+0000","last_fullsized":"2023-10-10T21:03:14.053273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.889551+0000","last_change":"2023-10-10T21:03:12.889551+0000","last_active":"2023-10-10T21:03:12.889551+0000","last_peered":"2023-10-10T21:03:12.889551+0000","last_clean":"2023-10-10T21:03:12.889551+0000","last_became_active":"2023-10-10T21:03:12.889403+0000","last_became_peered":"2023-10-10T21:03:12.889403+0000","last_unstale":"2023-10-10T21:03:12.889551+0000","last_undegraded":"2023-10-10T21:03:12.889551+0000","last_fullsized":"2023-10-10T21:03:12.889551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:51.756377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061355+0000","last_change":"2023-10-10T21:03:14.058577+0000","last_active":"2023-10-10T21:03:14.061355+0000","last_peered":"2023-10-10T21:03:14.061355+0000","last_clean":"2023-10-10T21:03:14.061355+0000","last_became_active":"2023-10-10T21:03:14.058273+0000","last_became_peered":"2023-10-10T21:03:14.058273+0000","last_unstale":"2023-10-10T21:03:14.061355+0000","last_undegraded":"2023-10-10T21:03:14.061355+0000","last_fullsized":"2023-10-10T21:03:14.061355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:24.406776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.072476+0000","last_change":"2023-10-10T21:03:12.890175+0000","last_active":"2023-10-10T21:03:14.072476+0000","last_peered":"2023-10-10T21:03:14.072476+0000","last_clean":"2023-10-10T21:03:14.072476+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:14.072476+0000","last_undegraded":"2023-10-10T21:03:14.072476+0000","last_fullsized":"2023-10-10T21:03:14.072476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:33:56.307223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.873086+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:38:53.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036503+0000","last_change":"2023-10-10T21:03:12.885659+0000","last_active":"2023-10-10T21:03:14.036503+0000","last_peered":"2023-10-10T21:03:14.036503+0000","last_clean":"2023-10-10T21:03:14.036503+0000","last_became_active":"2023-10-10T21:03:12.885443+0000","last_became_peered":"2023-10-10T21:03:12.885443+0000","last_unstale":"2023-10-10T21:03:14.036503+0000","last_undegraded":"2023-10-10T21:03:14.036503+0000","last_fullsized":"2023-10-10T21:03:14.036503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:47:05.333687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058689+0000","last_change":"2023-10-10T21:03:14.055943+0000","last_active":"2023-10-10T21:03:14.058689+0000","last_peered":"2023-10-10T21:03:14.058689+0000","last_clean":"2023-10-10T21:03:14.058689+0000","last_became_active":"2023-10-10T21:03:14.055642+0000","last_became_peered":"2023-10-10T21:03:14.055642+0000","last_unstale":"2023-10-10T21:03:14.058689+0000","last_undegraded":"2023-10-10T21:03:14.058689+0000","last_fullsized":"2023-10-10T21:03:14.058689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.887903+0000","last_change":"2023-10-10T21:03:12.887903+0000","last_active":"2023-10-10T21:03:12.887903+0000","last_peered":"2023-10-10T21:03:12.887903+0000","last_clean":"2023-10-10T21:03:12.887903+0000","last_became_active":"2023-10-10T21:03:12.887627+0000","last_became_peered":"2023-10-10T21:03:12.887627+0000","last_unstale":"2023-10-10T21:03:12.887903+0000","last_undegraded":"2023-10-10T21:03:12.887903+0000","last_fullsized":"2023-10-10T21:03:12.887903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:29:42.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064097+0000","last_change":"2023-10-10T21:03:14.060118+0000","last_active":"2023-10-10T21:03:14.064097+0000","last_peered":"2023-10-10T21:03:14.064097+0000","last_clean":"2023-10-10T21:03:14.064097+0000","last_became_active":"2023-10-10T21:03:14.059845+0000","last_became_peered":"2023-10-10T21:03:14.059845+0000","last_unstale":"2023-10-10T21:03:14.064097+0000","last_undegraded":"2023-10-10T21:03:14.064097+0000","last_fullsized":"2023-10-10T21:03:14.064097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.889578+0000","last_change":"2023-10-10T21:03:12.889578+0000","last_active":"2023-10-10T21:03:12.889578+0000","last_peered":"2023-10-10T21:03:12.889578+0000","last_clean":"2023-10-10T21:03:12.889578+0000","last_became_active":"2023-10-10T21:03:12.889368+0000","last_became_peered":"2023-10-10T21:03:12.889368+0000","last_unstale":"2023-10-10T21:03:12.889578+0000","last_undegraded":"2023-10-10T21:03:12.889578+0000","last_fullsized":"2023-10-10T21:03:12.889578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:24:05.169073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055292+0000","last_change":"2023-10-10T21:03:14.051228+0000","last_active":"2023-10-10T21:03:14.055292+0000","last_peered":"2023-10-10T21:03:14.055292+0000","last_clean":"2023-10-10T21:03:14.055292+0000","last_became_active":"2023-10-10T21:03:14.050931+0000","last_became_peered":"2023-10-10T21:03:14.050931+0000","last_unstale":"2023-10-10T21:03:14.055292+0000","last_undegraded":"2023-10-10T21:03:14.055292+0000","last_fullsized":"2023-10-10T21:03:14.055292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070819+0000","last_change":"2023-10-10T21:03:12.886478+0000","last_active":"2023-10-10T21:03:14.070819+0000","last_peered":"2023-10-10T21:03:14.070819+0000","last_clean":"2023-10-10T21:03:14.070819+0000","last_became_active":"2023-10-10T21:03:12.886128+0000","last_became_peered":"2023-10-10T21:03:12.886128+0000","last_unstale":"2023-10-10T21:03:14.070819+0000","last_undegraded":"2023-10-10T21:03:14.070819+0000","last_fullsized":"2023-10-10T21:03:14.070819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058959+0000","last_change":"2023-10-10T21:03:14.055709+0000","last_active":"2023-10-10T21:03:14.058959+0000","last_peered":"2023-10-10T21:03:14.058959+0000","last_clean":"2023-10-10T21:03:14.058959+0000","last_became_active":"2023-10-10T21:03:14.055452+0000","last_became_peered":"2023-10-10T21:03:14.055452+0000","last_unstale":"2023-10-10T21:03:14.058959+0000","last_undegraded":"2023-10-10T21:03:14.058959+0000","last_fullsized":"2023-10-10T21:03:14.058959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069997+0000","last_change":"2023-10-10T21:03:12.893952+0000","last_active":"2023-10-10T21:03:14.069997+0000","last_peered":"2023-10-10T21:03:14.069997+0000","last_clean":"2023-10-10T21:03:14.069997+0000","last_became_active":"2023-10-10T21:03:12.893610+0000","last_became_peered":"2023-10-10T21:03:12.893610+0000","last_unstale":"2023-10-10T21:03:14.069997+0000","last_undegraded":"2023-10-10T21:03:14.069997+0000","last_fullsized":"2023-10-10T21:03:14.069997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:09.534334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061304+0000","last_change":"2023-10-10T21:03:14.051290+0000","last_active":"2023-10-10T21:03:14.061304+0000","last_peered":"2023-10-10T21:03:14.061304+0000","last_clean":"2023-10-10T21:03:14.061304+0000","last_became_active":"2023-10-10T21:03:14.050996+0000","last_became_peered":"2023-10-10T21:03:14.050996+0000","last_unstale":"2023-10-10T21:03:14.061304+0000","last_undegraded":"2023-10-10T21:03:14.061304+0000","last_fullsized":"2023-10-10T21:03:14.061304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:31.597737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069611+0000","last_change":"2023-10-10T21:03:12.886527+0000","last_active":"2023-10-10T21:03:14.069611+0000","last_peered":"2023-10-10T21:03:14.069611+0000","last_clean":"2023-10-10T21:03:14.069611+0000","last_became_active":"2023-10-10T21:03:12.886243+0000","last_became_peered":"2023-10-10T21:03:12.886243+0000","last_unstale":"2023-10-10T21:03:14.069611+0000","last_undegraded":"2023-10-10T21:03:14.069611+0000","last_fullsized":"2023-10-10T21:03:14.069611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:46.323264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064868+0000","last_change":"2023-10-10T21:03:14.056497+0000","last_active":"2023-10-10T21:03:14.064868+0000","last_peered":"2023-10-10T21:03:14.064868+0000","last_clean":"2023-10-10T21:03:14.064868+0000","last_became_active":"2023-10-10T21:03:14.055367+0000","last_became_peered":"2023-10-10T21:03:14.055367+0000","last_unstale":"2023-10-10T21:03:14.064868+0000","last_undegraded":"2023-10-10T21:03:14.064868+0000","last_fullsized":"2023-10-10T21:03:14.064868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:34.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039649+0000","last_change":"2023-10-10T21:03:12.893029+0000","last_active":"2023-10-10T21:03:14.039649+0000","last_peered":"2023-10-10T21:03:14.039649+0000","last_clean":"2023-10-10T21:03:14.039649+0000","last_became_active":"2023-10-10T21:03:12.891259+0000","last_became_peered":"2023-10-10T21:03:12.891259+0000","last_unstale":"2023-10-10T21:03:14.039649+0000","last_undegraded":"2023-10-10T21:03:14.039649+0000","last_fullsized":"2023-10-10T21:03:14.039649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:44.279738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054116+0000","last_change":"2023-10-10T21:03:14.050667+0000","last_active":"2023-10-10T21:03:14.054116+0000","last_peered":"2023-10-10T21:03:14.054116+0000","last_clean":"2023-10-10T21:03:14.054116+0000","last_became_active":"2023-10-10T21:03:14.050399+0000","last_became_peered":"2023-10-10T21:03:14.050399+0000","last_unstale":"2023-10-10T21:03:14.054116+0000","last_undegraded":"2023-10-10T21:03:14.054116+0000","last_fullsized":"2023-10-10T21:03:14.054116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:24.498631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069657+0000","last_change":"2023-10-10T21:03:12.887639+0000","last_active":"2023-10-10T21:03:14.069657+0000","last_peered":"2023-10-10T21:03:14.069657+0000","last_clean":"2023-10-10T21:03:14.069657+0000","last_became_active":"2023-10-10T21:03:12.887398+0000","last_became_peered":"2023-10-10T21:03:12.887398+0000","last_unstale":"2023-10-10T21:03:14.069657+0000","last_undegraded":"2023-10-10T21:03:14.069657+0000","last_fullsized":"2023-10-10T21:03:14.069657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056449+0000","last_change":"2023-10-10T21:03:14.055555+0000","last_active":"2023-10-10T21:03:14.056449+0000","last_peered":"2023-10-10T21:03:14.056449+0000","last_clean":"2023-10-10T21:03:14.056449+0000","last_became_active":"2023-10-10T21:03:14.055241+0000","last_became_peered":"2023-10-10T21:03:14.055241+0000","last_unstale":"2023-10-10T21:03:14.056449+0000","last_undegraded":"2023-10-10T21:03:14.056449+0000","last_fullsized":"2023-10-10T21:03:14.056449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:04:04.186366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.038214+0000","last_change":"2023-10-10T21:03:12.889436+0000","last_active":"2023-10-10T21:03:14.038214+0000","last_peered":"2023-10-10T21:03:14.038214+0000","last_clean":"2023-10-10T21:03:14.038214+0000","last_became_active":"2023-10-10T21:03:12.889179+0000","last_became_peered":"2023-10-10T21:03:12.889179+0000","last_unstale":"2023-10-10T21:03:14.038214+0000","last_undegraded":"2023-10-10T21:03:14.038214+0000","last_fullsized":"2023-10-10T21:03:14.038214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.060011+0000","last_change":"2023-10-10T21:03:14.055915+0000","last_active":"2023-10-10T21:03:14.060011+0000","last_peered":"2023-10-10T21:03:14.060011+0000","last_clean":"2023-10-10T21:03:14.060011+0000","last_became_active":"2023-10-10T21:03:14.055646+0000","last_became_peered":"2023-10-10T21:03:14.055646+0000","last_unstale":"2023-10-10T21:03:14.060011+0000","last_undegraded":"2023-10-10T21:03:14.060011+0000","last_fullsized":"2023-10-10T21:03:14.060011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:42.622301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036674+0000","last_change":"2023-10-10T21:03:12.889430+0000","last_active":"2023-10-10T21:03:14.036674+0000","last_peered":"2023-10-10T21:03:14.036674+0000","last_clean":"2023-10-10T21:03:14.036674+0000","last_became_active":"2023-10-10T21:03:12.889154+0000","last_became_peered":"2023-10-10T21:03:12.889154+0000","last_unstale":"2023-10-10T21:03:14.036674+0000","last_undegraded":"2023-10-10T21:03:14.036674+0000","last_fullsized":"2023-10-10T21:03:14.036674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:14:09.052129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.051140+0000","last_change":"2023-10-10T21:03:14.048739+0000","last_active":"2023-10-10T21:03:14.051140+0000","last_peered":"2023-10-10T21:03:14.051140+0000","last_clean":"2023-10-10T21:03:14.051140+0000","last_became_active":"2023-10-10T21:03:14.048495+0000","last_became_peered":"2023-10-10T21:03:14.048495+0000","last_unstale":"2023-10-10T21:03:14.051140+0000","last_undegraded":"2023-10-10T21:03:14.051140+0000","last_fullsized":"2023-10-10T21:03:14.051140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.034542+0000","last_change":"2023-10-10T21:03:12.892718+0000","last_active":"2023-10-10T21:03:14.034542+0000","last_peered":"2023-10-10T21:03:14.034542+0000","last_clean":"2023-10-10T21:03:14.034542+0000","last_became_active":"2023-10-10T21:03:12.892352+0000","last_became_peered":"2023-10-10T21:03:12.892352+0000","last_unstale":"2023-10-10T21:03:14.034542+0000","last_undegraded":"2023-10-10T21:03:14.034542+0000","last_fullsized":"2023-10-10T21:03:14.034542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:03.334271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065829+0000","last_change":"2023-10-10T21:03:14.057428+0000","last_active":"2023-10-10T21:03:14.065829+0000","last_peered":"2023-10-10T21:03:14.065829+0000","last_clean":"2023-10-10T21:03:14.065829+0000","last_became_active":"2023-10-10T21:03:14.057133+0000","last_became_peered":"2023-10-10T21:03:14.057133+0000","last_unstale":"2023-10-10T21:03:14.065829+0000","last_undegraded":"2023-10-10T21:03:14.065829+0000","last_fullsized":"2023-10-10T21:03:14.065829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:23.301810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.073007+0000","last_change":"2023-10-10T21:03:12.886199+0000","last_active":"2023-10-10T21:03:14.073007+0000","last_peered":"2023-10-10T21:03:14.073007+0000","last_clean":"2023-10-10T21:03:14.073007+0000","last_became_active":"2023-10-10T21:03:12.885314+0000","last_became_peered":"2023-10-10T21:03:12.885314+0000","last_unstale":"2023-10-10T21:03:14.073007+0000","last_undegraded":"2023-10-10T21:03:14.073007+0000","last_fullsized":"2023-10-10T21:03:14.073007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053426+0000","last_change":"2023-10-10T21:03:14.046810+0000","last_active":"2023-10-10T21:03:14.053426+0000","last_peered":"2023-10-10T21:03:14.053426+0000","last_clean":"2023-10-10T21:03:14.053426+0000","last_became_active":"2023-10-10T21:03:14.046576+0000","last_became_peered":"2023-10-10T21:03:14.046576+0000","last_unstale":"2023-10-10T21:03:14.053426+0000","last_undegraded":"2023-10-10T21:03:14.053426+0000","last_fullsized":"2023-10-10T21:03:14.053426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:31:32.365391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042962+0000","last_change":"2023-10-10T21:03:12.886933+0000","last_active":"2023-10-10T21:03:14.042962+0000","last_peered":"2023-10-10T21:03:14.042962+0000","last_clean":"2023-10-10T21:03:14.042962+0000","last_became_active":"2023-10-10T21:03:12.886619+0000","last_became_peered":"2023-10-10T21:03:12.886619+0000","last_unstale":"2023-10-10T21:03:14.042962+0000","last_undegraded":"2023-10-10T21:03:14.042962+0000","last_fullsized":"2023-10-10T21:03:14.042962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065807+0000","last_change":"2023-10-10T21:03:14.062440+0000","last_active":"2023-10-10T21:03:14.065807+0000","last_peered":"2023-10-10T21:03:14.065807+0000","last_clean":"2023-10-10T21:03:14.065807+0000","last_became_active":"2023-10-10T21:03:14.062114+0000","last_became_peered":"2023-10-10T21:03:14.062114+0000","last_unstale":"2023-10-10T21:03:14.065807+0000","last_undegraded":"2023-10-10T21:03:14.065807+0000","last_fullsized":"2023-10-10T21:03:14.065807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036103+0000","last_change":"2023-10-10T21:03:12.885411+0000","last_active":"2023-10-10T21:03:14.036103+0000","last_peered":"2023-10-10T21:03:14.036103+0000","last_clean":"2023-10-10T21:03:14.036103+0000","last_became_active":"2023-10-10T21:03:12.885150+0000","last_became_peered":"2023-10-10T21:03:12.885150+0000","last_unstale":"2023-10-10T21:03:14.036103+0000","last_undegraded":"2023-10-10T21:03:14.036103+0000","last_fullsized":"2023-10-10T21:03:14.036103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053780+0000","last_change":"2023-10-10T21:03:14.045941+0000","last_active":"2023-10-10T21:03:14.053780+0000","last_peered":"2023-10-10T21:03:14.053780+0000","last_clean":"2023-10-10T21:03:14.053780+0000","last_became_active":"2023-10-10T21:03:14.045645+0000","last_became_peered":"2023-10-10T21:03:14.045645+0000","last_unstale":"2023-10-10T21:03:14.053780+0000","last_undegraded":"2023-10-10T21:03:14.053780+0000","last_fullsized":"2023-10-10T21:03:14.053780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042227+0000","last_change":"2023-10-10T21:03:12.883422+0000","last_active":"2023-10-10T21:03:14.042227+0000","last_peered":"2023-10-10T21:03:14.042227+0000","last_clean":"2023-10-10T21:03:14.042227+0000","last_became_active":"2023-10-10T21:03:12.883097+0000","last_became_peered":"2023-10-10T21:03:12.883097+0000","last_unstale":"2023-10-10T21:03:14.042227+0000","last_undegraded":"2023-10-10T21:03:14.042227+0000","last_fullsized":"2023-10-10T21:03:14.042227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:48:17.863125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056720+0000","last_change":"2023-10-10T21:03:14.054395+0000","last_active":"2023-10-10T21:03:14.056720+0000","last_peered":"2023-10-10T21:03:14.056720+0000","last_clean":"2023-10-10T21:03:14.056720+0000","last_became_active":"2023-10-10T21:03:14.054139+0000","last_became_peered":"2023-10-10T21:03:14.054139+0000","last_unstale":"2023-10-10T21:03:14.056720+0000","last_undegraded":"2023-10-10T21:03:14.056720+0000","last_fullsized":"2023-10-10T21:03:14.056720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036411+0000","last_change":"2023-10-10T21:03:12.888523+0000","last_active":"2023-10-10T21:03:14.036411+0000","last_peered":"2023-10-10T21:03:14.036411+0000","last_clean":"2023-10-10T21:03:14.036411+0000","last_became_active":"2023-10-10T21:03:12.888220+0000","last_became_peered":"2023-10-10T21:03:12.888220+0000","last_unstale":"2023-10-10T21:03:14.036411+0000","last_undegraded":"2023-10-10T21:03:14.036411+0000","last_fullsized":"2023-10-10T21:03:14.036411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.872046+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:40:49.674663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036675+0000","last_change":"2023-10-10T21:03:12.885959+0000","last_active":"2023-10-10T21:03:14.036675+0000","last_peered":"2023-10-10T21:03:14.036675+0000","last_clean":"2023-10-10T21:03:14.036675+0000","last_became_active":"2023-10-10T21:03:12.885624+0000","last_became_peered":"2023-10-10T21:03:12.885624+0000","last_unstale":"2023-10-10T21:03:14.036675+0000","last_undegraded":"2023-10-10T21:03:14.036675+0000","last_fullsized":"2023-10-10T21:03:14.036675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:23:43.708965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055334+0000","last_change":"2023-10-10T21:03:14.049917+0000","last_active":"2023-10-10T21:03:14.055334+0000","last_peered":"2023-10-10T21:03:14.055334+0000","last_clean":"2023-10-10T21:03:14.055334+0000","last_became_active":"2023-10-10T21:03:14.049674+0000","last_became_peered":"2023-10-10T21:03:14.049674+0000","last_unstale":"2023-10-10T21:03:14.055334+0000","last_undegraded":"2023-10-10T21:03:14.055334+0000","last_fullsized":"2023-10-10T21:03:14.055334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.892061+0000","last_change":"2023-10-10T21:03:12.892061+0000","last_active":"2023-10-10T21:03:12.892061+0000","last_peered":"2023-10-10T21:03:12.892061+0000","last_clean":"2023-10-10T21:03:12.892061+0000","last_became_active":"2023-10-10T21:03:12.891773+0000","last_became_peered":"2023-10-10T21:03:12.891773+0000","last_unstale":"2023-10-10T21:03:12.892061+0000","last_undegraded":"2023-10-10T21:03:12.892061+0000","last_fullsized":"2023-10-10T21:03:12.892061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:33.298861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057642+0000","last_change":"2023-10-10T21:03:14.052143+0000","last_active":"2023-10-10T21:03:14.057642+0000","last_peered":"2023-10-10T21:03:14.057642+0000","last_clean":"2023-10-10T21:03:14.057642+0000","last_became_active":"2023-10-10T21:03:14.051884+0000","last_became_peered":"2023-10-10T21:03:14.051884+0000","last_unstale":"2023-10-10T21:03:14.057642+0000","last_undegraded":"2023-10-10T21:03:14.057642+0000","last_fullsized":"2023-10-10T21:03:14.057642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039181+0000","last_change":"2023-10-10T21:03:12.887792+0000","last_active":"2023-10-10T21:03:14.039181+0000","last_peered":"2023-10-10T21:03:14.039181+0000","last_clean":"2023-10-10T21:03:14.039181+0000","last_became_active":"2023-10-10T21:03:12.887523+0000","last_became_peered":"2023-10-10T21:03:12.887523+0000","last_unstale":"2023-10-10T21:03:14.039181+0000","last_undegraded":"2023-10-10T21:03:14.039181+0000","last_fullsized":"2023-10-10T21:03:14.039181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.040453+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:03:14.040453+0000","last_peered":"2023-10-10T21:03:14.040453+0000","last_clean":"2023-10-10T21:03:14.040453+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:03:14.040453+0000","last_undegraded":"2023-10-10T21:03:14.040453+0000","last_fullsized":"2023-10-10T21:03:14.040453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074216,"statfs":{"total":96636764160,"available":96331997184,"internally_reserved":0,"allocated":344064,"data_stored":127623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.28799999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.752},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70999999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":731099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.622}]},{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.056}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.88}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":1.081}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.032}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":148487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.31}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.432},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.82799999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.68300000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073600,"statfs":{"total":96636764160,"available":96331366400,"internally_reserved":0,"allocated":974848,"data_stored":737297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.496},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.96099999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":140711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.627}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.71399999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.81399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.749},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82899999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.84499999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":8.9909999999999997},"last":0.82799999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.751}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":9.0250000000000004,"5min":9.0250000000000004,"15min":9.0250000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":8.8480000000000008,"5min":8.8480000000000008,"15min":8.8480000000000008},"last":0.85699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.79400000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.872}]},{"osd":1,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.94799999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.505}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.97899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.93300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:03:18.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:03:19.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.037+0000 7f4e43dff700 1 Processor -- start 2023-10-10T21:03:19.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.037+0000 7f4e43dff700 1 -- start start 2023-10-10T21:03:19.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.038+0000 7f4e43dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c159890 0x7f4e3c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.038+0000 7f4e43dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c15a160 con 0x7f4e3c069560 2023-10-10T21:03:19.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.038+0000 7f4e43dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c0d13a0 con 0x7f4e3c159c60 2023-10-10T21:03:19.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.038+0000 7f4e43dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c15e140 con 0x7f4e3c159890 2023-10-10T21:03:19.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e4239c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4e3c069560 0x7f4e3c0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36758/0 (socket says 172.21.15.154:36758) 2023-10-10T21:03:19.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e4239c700 1 -- 172.21.15.154:0/769157448 learned_addr learned my addr 172.21.15.154:0/769157448 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:19.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e41b9b700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c159890 0x7f4e3c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423597512 0 0) 0x7f4e3c15a160 con 0x7f4e3c069560 2023-10-10T21:03:19.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e28003570 con 0x7f4e3c069560 2023-10-10T21:03:19.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143601572 0 0) 0x7f4e3c0d13a0 con 0x7f4e3c159c60 2023-10-10T21:03:19.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e3c15a160 con 0x7f4e3c159c60 2023-10-10T21:03:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 837721417 0 0) 0x7f4e28003570 con 0x7f4e3c069560 2023-10-10T21:03:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c159890 msgr2=0x7f4e3c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c159890 0x7f4e3c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 >> v1:172.21.15.179:6789/0 conn(0x7f4e3c159c60 legacy=0x7f4e3c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c15a3d0 con 0x7f4e3c069560 2023-10-10T21:03:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f4e340017f0 con 0x7f4e3c069560 2023-10-10T21:03:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.039+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 >> v1:172.21.15.154:6789/0 conn(0x7f4e3c069560 legacy=0x7f4e3c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e40b99700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e28003c20 0x7f4e28004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e40b99700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c159890 0x7f4e28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e40b99700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e28004d50 0x7f4e280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c15e140 con 0x7f4e28004d50 2023-10-10T21:03:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2800bbf0 con 0x7f4e28003c20 2023-10-10T21:03:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2800bd60 con 0x7f4e3c159890 2023-10-10T21:03:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e4239c700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e28004d50 0x7f4e280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e41b9b700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e28003c20 0x7f4e28004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e4139a700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c159890 0x7f4e28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e4239c700 1 -- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c159890 msgr2=0x7f4e28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:19.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e4239c700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c159890 0x7f4e28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e4239c700 1 -- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e28003c20 msgr2=0x7f4e28004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e4239c700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e28003c20 0x7f4e28004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e4239c700 1 -- 172.21.15.154:0/769157448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e28003570 con 0x7f4e28004d50 2023-10-10T21:03:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.040+0000 7f4e4239c700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e28004d50 0x7f4e280051c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400a7d0 tx=0x7f4e340020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11adb4327f6c41e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340070d0 con 0x7f4e28004d50 2023-10-10T21:03:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34007230 con 0x7f4e28004d50 2023-10-10T21:03:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e40b99700 1 -- 172.21.15.154:0/769157448 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340075d0 con 0x7f4e28004d50 2023-10-10T21:03:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e43dff700 1 -- 172.21.15.154:0/769157448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e28004d50 msgr2=0x7f4e280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e43dff700 1 --2- 172.21.15.154:0/769157448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e28004d50 0x7f4e280051c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400a7d0 tx=0x7f4e340020c0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e4239c700 1 -- 172.21.15.154:0/769157448 reap_dead start 2023-10-10T21:03:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e43dff700 1 -- 172.21.15.154:0/769157448 shutdown_connections 2023-10-10T21:03:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e43dff700 1 -- 172.21.15.154:0/769157448 >> 172.21.15.154:0/769157448 conn(0x7f4e3c068e20 msgr2=0x7f4e3c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e43dff700 1 -- 172.21.15.154:0/769157448 shutdown_connections 2023-10-10T21:03:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.041+0000 7f4e43dff700 1 -- 172.21.15.154:0/769157448 wait complete. 2023-10-10T21:03:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.043+0000 7f4e43dff700 1 Processor -- start 2023-10-10T21:03:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.043+0000 7f4e43dff700 1 -- start start 2023-10-10T21:03:19.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e43dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e28004d50 0x7f4e3c169f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e43dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c0b3c70 0x7f4e3c0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e43dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c0ce6c0 0x7f4e3c0ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e43dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c16af10 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e43dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c16a460 con 0x7f4e28004d50 2023-10-10T21:03:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e43dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c1510d0 con 0x7f4e3c0b3c70 2023-10-10T21:03:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e4239c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c0ce6c0 0x7f4e3c0ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e4239c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c0ce6c0 0x7f4e3c0ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44666/0 (socket says 172.21.15.154:44666) 2023-10-10T21:03:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e4239c700 1 -- 172.21.15.154:0/1200753013 learned_addr learned my addr 172.21.15.154:0/1200753013 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e41b9b700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e28004d50 0x7f4e3c169f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e4139a700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c0b3c70 0x7f4e3c0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e4239c700 1 -- 172.21.15.154:0/1200753013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c0b3c70 msgr2=0x7f4e3c0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e4239c700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c0b3c70 0x7f4e3c0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e4239c700 1 -- 172.21.15.154:0/1200753013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e28004d50 msgr2=0x7f4e3c169f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e4239c700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e28004d50 0x7f4e3c169f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.044+0000 7f4e4239c700 1 -- 172.21.15.154:0/1200753013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0cd2d0 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.045+0000 7f4e4239c700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c0ce6c0 0x7f4e3c0ceb40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4e34002100 tx=0x7f4e34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.045+0000 7f4e31ffb700 1 -- 172.21.15.154:0/1200753013 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34025070 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.045+0000 7f4e31ffb700 1 -- 172.21.15.154:0/1200753013 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34001de0 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.045+0000 7f4e31ffb700 1 -- 172.21.15.154:0/1200753013 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34007940 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.045+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c16a670 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.045+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c16ac30 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.046+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c159260 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.047+0000 7f4e31ffb700 1 -- 172.21.15.154:0/1200753013 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e34004bb0 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.048+0000 7f4e31ffb700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4e20066f30 0x7f4e200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.048+0000 7f4e31ffb700 1 -- 172.21.15.154:0/1200753013 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e34086400 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.048+0000 7f4e41b9b700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4e20066f30 0x7f4e200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.048+0000 7f4e41b9b700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4e20066f30 0x7f4e200693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4e38006f00 tx=0x7f4e38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:19.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.052+0000 7f4e31ffb700 1 -- 172.21.15.154:0/1200753013 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e340535d0 con 0x7f4e3c0ce6c0 2023-10-10T21:03:19.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.241+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e3c0cd460 con 0x7f4e20066f30 2023-10-10T21:03:19.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.250+0000 7f4e31ffb700 1 -- 172.21.15.154:0/1200753013 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288013 (secure 0 0 0) 0x7f4e3c0cd460 con 0x7f4e20066f30 2023-10-10T21:03:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4e20066f30 msgr2=0x7f4e200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4e20066f30 0x7f4e200693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4e38006f00 tx=0x7f4e38008040 comp rx=0 tx=0).stop 2023-10-10T21:03:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c0ce6c0 msgr2=0x7f4e3c0ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c0ce6c0 0x7f4e3c0ceb40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4e34002100 tx=0x7f4e34016000 comp rx=0 tx=0).stop 2023-10-10T21:03:19.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 shutdown_connections 2023-10-10T21:03:19.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c0ce6c0 0x7f4e3c0ceb40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e28004d50 0x7f4e3c169f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4e20066f30 0x7f4e200693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 --2- 172.21.15.154:0/1200753013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e3c0b3c70 0x7f4e3c0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 >> 172.21.15.154:0/1200753013 conn(0x7f4e3c068e20 msgr2=0x7f4e3c0b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 shutdown_connections 2023-10-10T21:03:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.254+0000 7f4e43dff700 1 -- 172.21.15.154:0/1200753013 wait complete. 2023-10-10T21:03:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:03:19.272 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-10-10T21:03:17.865350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591138,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382428,"kb_used_data":4124,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592292,"statfs":{"total":773094113280,"available":770654507008,"internally_reserved":0,"allocated":4222976,"data_stored":2327340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001120"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058310+0000","last_change":"2023-10-10T21:03:14.056535+0000","last_active":"2023-10-10T21:03:14.058310+0000","last_peered":"2023-10-10T21:03:14.058310+0000","last_clean":"2023-10-10T21:03:14.058310+0000","last_became_active":"2023-10-10T21:03:14.056221+0000","last_became_peered":"2023-10-10T21:03:14.056221+0000","last_unstale":"2023-10-10T21:03:14.058310+0000","last_undegraded":"2023-10-10T21:03:14.058310+0000","last_fullsized":"2023-10-10T21:03:14.058310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.875966+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:24:09.519551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053297+0000","last_change":"2023-10-10T21:03:14.044532+0000","last_active":"2023-10-10T21:03:14.053297+0000","last_peered":"2023-10-10T21:03:14.053297+0000","last_clean":"2023-10-10T21:03:14.053297+0000","last_became_active":"2023-10-10T21:03:14.044238+0000","last_became_peered":"2023-10-10T21:03:14.044238+0000","last_unstale":"2023-10-10T21:03:14.053297+0000","last_undegraded":"2023-10-10T21:03:14.053297+0000","last_fullsized":"2023-10-10T21:03:14.053297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:57:09.143759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061282+0000","last_change":"2023-10-10T21:03:14.050842+0000","last_active":"2023-10-10T21:03:14.061282+0000","last_peered":"2023-10-10T21:03:14.061282+0000","last_clean":"2023-10-10T21:03:14.061282+0000","last_became_active":"2023-10-10T21:03:14.050579+0000","last_became_peered":"2023-10-10T21:03:14.050579+0000","last_unstale":"2023-10-10T21:03:14.061282+0000","last_undegraded":"2023-10-10T21:03:14.061282+0000","last_fullsized":"2023-10-10T21:03:14.061282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049131+0000","last_change":"2023-10-10T21:03:14.046823+0000","last_active":"2023-10-10T21:03:14.049131+0000","last_peered":"2023-10-10T21:03:14.049131+0000","last_clean":"2023-10-10T21:03:14.049131+0000","last_became_active":"2023-10-10T21:03:14.046566+0000","last_became_peered":"2023-10-10T21:03:14.046566+0000","last_unstale":"2023-10-10T21:03:14.049131+0000","last_undegraded":"2023-10-10T21:03:14.049131+0000","last_fullsized":"2023-10-10T21:03:14.049131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.116595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.875796+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:41.386045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049955+0000","last_change":"2023-10-10T21:03:14.047991+0000","last_active":"2023-10-10T21:03:14.049955+0000","last_peered":"2023-10-10T21:03:14.049955+0000","last_clean":"2023-10-10T21:03:14.049955+0000","last_became_active":"2023-10-10T21:03:14.047702+0000","last_became_peered":"2023-10-10T21:03:14.047702+0000","last_unstale":"2023-10-10T21:03:14.049955+0000","last_undegraded":"2023-10-10T21:03:14.049955+0000","last_fullsized":"2023-10-10T21:03:14.049955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052555+0000","last_change":"2023-10-10T21:03:14.049953+0000","last_active":"2023-10-10T21:03:14.052555+0000","last_peered":"2023-10-10T21:03:14.052555+0000","last_clean":"2023-10-10T21:03:14.052555+0000","last_became_active":"2023-10-10T21:03:14.049549+0000","last_became_peered":"2023-10-10T21:03:14.049549+0000","last_unstale":"2023-10-10T21:03:14.052555+0000","last_undegraded":"2023-10-10T21:03:14.052555+0000","last_fullsized":"2023-10-10T21:03:14.052555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066618+0000","last_change":"2023-10-10T21:03:14.062596+0000","last_active":"2023-10-10T21:03:14.066618+0000","last_peered":"2023-10-10T21:03:14.066618+0000","last_clean":"2023-10-10T21:03:14.066618+0000","last_became_active":"2023-10-10T21:03:14.062296+0000","last_became_peered":"2023-10-10T21:03:14.062296+0000","last_unstale":"2023-10-10T21:03:14.066618+0000","last_undegraded":"2023-10-10T21:03:14.066618+0000","last_fullsized":"2023-10-10T21:03:14.066618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:58:45.241585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058876+0000","last_change":"2023-10-10T21:03:14.043250+0000","last_active":"2023-10-10T21:03:14.058876+0000","last_peered":"2023-10-10T21:03:14.058876+0000","last_clean":"2023-10-10T21:03:14.058876+0000","last_became_active":"2023-10-10T21:03:14.042985+0000","last_became_peered":"2023-10-10T21:03:14.042985+0000","last_unstale":"2023-10-10T21:03:14.058876+0000","last_undegraded":"2023-10-10T21:03:14.058876+0000","last_fullsized":"2023-10-10T21:03:14.058876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066738+0000","last_change":"2023-10-10T21:03:14.060697+0000","last_active":"2023-10-10T21:03:14.066738+0000","last_peered":"2023-10-10T21:03:14.066738+0000","last_clean":"2023-10-10T21:03:14.066738+0000","last_became_active":"2023-10-10T21:03:14.060246+0000","last_became_peered":"2023-10-10T21:03:14.060246+0000","last_unstale":"2023-10-10T21:03:14.066738+0000","last_undegraded":"2023-10-10T21:03:14.066738+0000","last_fullsized":"2023-10-10T21:03:14.066738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053144+0000","last_change":"2023-10-10T21:03:14.041036+0000","last_active":"2023-10-10T21:03:14.053144+0000","last_peered":"2023-10-10T21:03:14.053144+0000","last_clean":"2023-10-10T21:03:14.053144+0000","last_became_active":"2023-10-10T21:03:14.040620+0000","last_became_peered":"2023-10-10T21:03:14.040620+0000","last_unstale":"2023-10-10T21:03:14.053144+0000","last_undegraded":"2023-10-10T21:03:14.053144+0000","last_fullsized":"2023-10-10T21:03:14.053144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049113+0000","last_change":"2023-10-10T21:03:14.046280+0000","last_active":"2023-10-10T21:03:14.049113+0000","last_peered":"2023-10-10T21:03:14.049113+0000","last_clean":"2023-10-10T21:03:14.049113+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.049113+0000","last_undegraded":"2023-10-10T21:03:14.049113+0000","last_fullsized":"2023-10-10T21:03:14.049113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:28.753153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.875255+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:10:36.558402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054431+0000","last_change":"2023-10-10T21:03:14.049328+0000","last_active":"2023-10-10T21:03:14.054431+0000","last_peered":"2023-10-10T21:03:14.054431+0000","last_clean":"2023-10-10T21:03:14.054431+0000","last_became_active":"2023-10-10T21:03:14.048765+0000","last_became_peered":"2023-10-10T21:03:14.048765+0000","last_unstale":"2023-10-10T21:03:14.054431+0000","last_undegraded":"2023-10-10T21:03:14.054431+0000","last_fullsized":"2023-10-10T21:03:14.054431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:08.144185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057612+0000","last_change":"2023-10-10T21:03:14.051301+0000","last_active":"2023-10-10T21:03:14.057612+0000","last_peered":"2023-10-10T21:03:14.057612+0000","last_clean":"2023-10-10T21:03:14.057612+0000","last_became_active":"2023-10-10T21:03:14.050919+0000","last_became_peered":"2023-10-10T21:03:14.050919+0000","last_unstale":"2023-10-10T21:03:14.057612+0000","last_undegraded":"2023-10-10T21:03:14.057612+0000","last_fullsized":"2023-10-10T21:03:14.057612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049838+0000","last_change":"2023-10-10T21:03:14.047703+0000","last_active":"2023-10-10T21:03:14.049838+0000","last_peered":"2023-10-10T21:03:14.049838+0000","last_clean":"2023-10-10T21:03:14.049838+0000","last_became_active":"2023-10-10T21:03:14.047391+0000","last_became_peered":"2023-10-10T21:03:14.047391+0000","last_unstale":"2023-10-10T21:03:14.049838+0000","last_undegraded":"2023-10-10T21:03:14.049838+0000","last_fullsized":"2023-10-10T21:03:14.049838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.874882+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:46:00.757042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.874807+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:57:10.345139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065008+0000","last_change":"2023-10-10T21:03:14.057258+0000","last_active":"2023-10-10T21:03:14.065008+0000","last_peered":"2023-10-10T21:03:14.065008+0000","last_clean":"2023-10-10T21:03:14.065008+0000","last_became_active":"2023-10-10T21:03:14.057010+0000","last_became_peered":"2023-10-10T21:03:14.057010+0000","last_unstale":"2023-10-10T21:03:14.065008+0000","last_undegraded":"2023-10-10T21:03:14.065008+0000","last_fullsized":"2023-10-10T21:03:14.065008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:40:13.267887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056825+0000","last_change":"2023-10-10T21:03:14.052191+0000","last_active":"2023-10-10T21:03:14.056825+0000","last_peered":"2023-10-10T21:03:14.056825+0000","last_clean":"2023-10-10T21:03:14.056825+0000","last_became_active":"2023-10-10T21:03:14.051717+0000","last_became_peered":"2023-10-10T21:03:14.051717+0000","last_unstale":"2023-10-10T21:03:14.056825+0000","last_undegraded":"2023-10-10T21:03:14.056825+0000","last_fullsized":"2023-10-10T21:03:14.056825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056242+0000","last_change":"2023-10-10T21:03:14.050529+0000","last_active":"2023-10-10T21:03:14.056242+0000","last_peered":"2023-10-10T21:03:14.056242+0000","last_clean":"2023-10-10T21:03:14.056242+0000","last_became_active":"2023-10-10T21:03:14.050259+0000","last_became_peered":"2023-10-10T21:03:14.050259+0000","last_unstale":"2023-10-10T21:03:14.056242+0000","last_undegraded":"2023-10-10T21:03:14.056242+0000","last_fullsized":"2023-10-10T21:03:14.056242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056916+0000","last_change":"2023-10-10T21:03:14.053134+0000","last_active":"2023-10-10T21:03:14.056916+0000","last_peered":"2023-10-10T21:03:14.056916+0000","last_clean":"2023-10-10T21:03:14.056916+0000","last_became_active":"2023-10-10T21:03:14.052832+0000","last_became_peered":"2023-10-10T21:03:14.052832+0000","last_unstale":"2023-10-10T21:03:14.056916+0000","last_undegraded":"2023-10-10T21:03:14.056916+0000","last_fullsized":"2023-10-10T21:03:14.056916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055627+0000","last_change":"2023-10-10T21:03:14.054510+0000","last_active":"2023-10-10T21:03:14.055627+0000","last_peered":"2023-10-10T21:03:14.055627+0000","last_clean":"2023-10-10T21:03:14.055627+0000","last_became_active":"2023-10-10T21:03:14.053503+0000","last_became_peered":"2023-10-10T21:03:14.053503+0000","last_unstale":"2023-10-10T21:03:14.055627+0000","last_undegraded":"2023-10-10T21:03:14.055627+0000","last_fullsized":"2023-10-10T21:03:14.055627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061435+0000","last_change":"2023-10-10T21:03:14.053313+0000","last_active":"2023-10-10T21:03:14.061435+0000","last_peered":"2023-10-10T21:03:14.061435+0000","last_clean":"2023-10-10T21:03:14.061435+0000","last_became_active":"2023-10-10T21:03:14.053079+0000","last_became_peered":"2023-10-10T21:03:14.053079+0000","last_unstale":"2023-10-10T21:03:14.061435+0000","last_undegraded":"2023-10-10T21:03:14.061435+0000","last_fullsized":"2023-10-10T21:03:14.061435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.874243+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:17:13.547773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061383+0000","last_change":"2023-10-10T21:03:14.050946+0000","last_active":"2023-10-10T21:03:14.061383+0000","last_peered":"2023-10-10T21:03:14.061383+0000","last_clean":"2023-10-10T21:03:14.061383+0000","last_became_active":"2023-10-10T21:03:14.050591+0000","last_became_peered":"2023-10-10T21:03:14.050591+0000","last_unstale":"2023-10-10T21:03:14.061383+0000","last_undegraded":"2023-10-10T21:03:14.061383+0000","last_fullsized":"2023-10-10T21:03:14.061383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:56.258834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053266+0000","last_change":"2023-10-10T21:03:14.045679+0000","last_active":"2023-10-10T21:03:14.053266+0000","last_peered":"2023-10-10T21:03:14.053266+0000","last_clean":"2023-10-10T21:03:14.053266+0000","last_became_active":"2023-10-10T21:03:14.045412+0000","last_became_peered":"2023-10-10T21:03:14.045412+0000","last_unstale":"2023-10-10T21:03:14.053266+0000","last_undegraded":"2023-10-10T21:03:14.053266+0000","last_fullsized":"2023-10-10T21:03:14.053266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056845+0000","last_change":"2023-10-10T21:03:14.054112+0000","last_active":"2023-10-10T21:03:14.056845+0000","last_peered":"2023-10-10T21:03:14.056845+0000","last_clean":"2023-10-10T21:03:14.056845+0000","last_became_active":"2023-10-10T21:03:14.052952+0000","last_became_peered":"2023-10-10T21:03:14.052952+0000","last_unstale":"2023-10-10T21:03:14.056845+0000","last_undegraded":"2023-10-10T21:03:14.056845+0000","last_fullsized":"2023-10-10T21:03:14.056845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052548+0000","last_change":"2023-10-10T21:03:14.049723+0000","last_active":"2023-10-10T21:03:14.052548+0000","last_peered":"2023-10-10T21:03:14.052548+0000","last_clean":"2023-10-10T21:03:14.052548+0000","last_became_active":"2023-10-10T21:03:14.049283+0000","last_became_peered":"2023-10-10T21:03:14.049283+0000","last_unstale":"2023-10-10T21:03:14.052548+0000","last_undegraded":"2023-10-10T21:03:14.052548+0000","last_fullsized":"2023-10-10T21:03:14.052548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054706+0000","last_change":"2023-10-10T21:03:14.051746+0000","last_active":"2023-10-10T21:03:14.054706+0000","last_peered":"2023-10-10T21:03:14.054706+0000","last_clean":"2023-10-10T21:03:14.054706+0000","last_became_active":"2023-10-10T21:03:14.051312+0000","last_became_peered":"2023-10-10T21:03:14.051312+0000","last_unstale":"2023-10-10T21:03:14.054706+0000","last_undegraded":"2023-10-10T21:03:14.054706+0000","last_fullsized":"2023-10-10T21:03:14.054706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058708+0000","last_change":"2023-10-10T21:03:14.056651+0000","last_active":"2023-10-10T21:03:14.058708+0000","last_peered":"2023-10-10T21:03:14.058708+0000","last_clean":"2023-10-10T21:03:14.058708+0000","last_became_active":"2023-10-10T21:03:14.056380+0000","last_became_peered":"2023-10-10T21:03:14.056380+0000","last_unstale":"2023-10-10T21:03:14.058708+0000","last_undegraded":"2023-10-10T21:03:14.058708+0000","last_fullsized":"2023-10-10T21:03:14.058708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056688+0000","last_change":"2023-10-10T21:03:14.052449+0000","last_active":"2023-10-10T21:03:14.056688+0000","last_peered":"2023-10-10T21:03:14.056688+0000","last_clean":"2023-10-10T21:03:14.056688+0000","last_became_active":"2023-10-10T21:03:14.052170+0000","last_became_peered":"2023-10-10T21:03:14.052170+0000","last_unstale":"2023-10-10T21:03:14.056688+0000","last_undegraded":"2023-10-10T21:03:14.056688+0000","last_fullsized":"2023-10-10T21:03:14.056688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070197+0000","last_change":"2023-10-10T21:03:12.887804+0000","last_active":"2023-10-10T21:03:14.070197+0000","last_peered":"2023-10-10T21:03:14.070197+0000","last_clean":"2023-10-10T21:03:14.070197+0000","last_became_active":"2023-10-10T21:03:12.886661+0000","last_became_peered":"2023-10-10T21:03:12.886661+0000","last_unstale":"2023-10-10T21:03:14.070197+0000","last_undegraded":"2023-10-10T21:03:14.070197+0000","last_fullsized":"2023-10-10T21:03:14.070197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:48.860387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056422+0000","last_change":"2023-10-10T21:03:14.055315+0000","last_active":"2023-10-10T21:03:14.056422+0000","last_peered":"2023-10-10T21:03:14.056422+0000","last_clean":"2023-10-10T21:03:14.056422+0000","last_became_active":"2023-10-10T21:03:14.055012+0000","last_became_peered":"2023-10-10T21:03:14.055012+0000","last_unstale":"2023-10-10T21:03:14.056422+0000","last_undegraded":"2023-10-10T21:03:14.056422+0000","last_fullsized":"2023-10-10T21:03:14.056422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067737+0000","last_change":"2023-10-10T21:03:12.891968+0000","last_active":"2023-10-10T21:03:14.067737+0000","last_peered":"2023-10-10T21:03:14.067737+0000","last_clean":"2023-10-10T21:03:14.067737+0000","last_became_active":"2023-10-10T21:03:12.891692+0000","last_became_peered":"2023-10-10T21:03:12.891692+0000","last_unstale":"2023-10-10T21:03:14.067737+0000","last_undegraded":"2023-10-10T21:03:14.067737+0000","last_fullsized":"2023-10-10T21:03:14.067737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055774+0000","last_change":"2023-10-10T21:03:14.052248+0000","last_active":"2023-10-10T21:03:14.055774+0000","last_peered":"2023-10-10T21:03:14.055774+0000","last_clean":"2023-10-10T21:03:14.055774+0000","last_became_active":"2023-10-10T21:03:14.051970+0000","last_became_peered":"2023-10-10T21:03:14.051970+0000","last_unstale":"2023-10-10T21:03:14.055774+0000","last_undegraded":"2023-10-10T21:03:14.055774+0000","last_fullsized":"2023-10-10T21:03:14.055774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.890886+0000","last_change":"2023-10-10T21:03:12.890886+0000","last_active":"2023-10-10T21:03:12.890886+0000","last_peered":"2023-10-10T21:03:12.890886+0000","last_clean":"2023-10-10T21:03:12.890886+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:12.890886+0000","last_undegraded":"2023-10-10T21:03:12.890886+0000","last_fullsized":"2023-10-10T21:03:12.890886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:22:47.067057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061401+0000","last_change":"2023-10-10T21:03:14.058547+0000","last_active":"2023-10-10T21:03:14.061401+0000","last_peered":"2023-10-10T21:03:14.061401+0000","last_clean":"2023-10-10T21:03:14.061401+0000","last_became_active":"2023-10-10T21:03:14.058172+0000","last_became_peered":"2023-10-10T21:03:14.058172+0000","last_unstale":"2023-10-10T21:03:14.061401+0000","last_undegraded":"2023-10-10T21:03:14.061401+0000","last_fullsized":"2023-10-10T21:03:14.061401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.071334+0000","last_change":"2023-10-10T21:03:12.886500+0000","last_active":"2023-10-10T21:03:14.071334+0000","last_peered":"2023-10-10T21:03:14.071334+0000","last_clean":"2023-10-10T21:03:14.071334+0000","last_became_active":"2023-10-10T21:03:12.886219+0000","last_became_peered":"2023-10-10T21:03:12.886219+0000","last_unstale":"2023-10-10T21:03:14.071334+0000","last_undegraded":"2023-10-10T21:03:14.071334+0000","last_fullsized":"2023-10-10T21:03:14.071334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:12.688030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058736+0000","last_change":"2023-10-10T21:03:14.055102+0000","last_active":"2023-10-10T21:03:14.058736+0000","last_peered":"2023-10-10T21:03:14.058736+0000","last_clean":"2023-10-10T21:03:14.058736+0000","last_became_active":"2023-10-10T21:03:14.054774+0000","last_became_peered":"2023-10-10T21:03:14.054774+0000","last_unstale":"2023-10-10T21:03:14.058736+0000","last_undegraded":"2023-10-10T21:03:14.058736+0000","last_fullsized":"2023-10-10T21:03:14.058736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069543+0000","last_change":"2023-10-10T21:03:12.890962+0000","last_active":"2023-10-10T21:03:14.069543+0000","last_peered":"2023-10-10T21:03:14.069543+0000","last_clean":"2023-10-10T21:03:14.069543+0000","last_became_active":"2023-10-10T21:03:12.890574+0000","last_became_peered":"2023-10-10T21:03:12.890574+0000","last_unstale":"2023-10-10T21:03:14.069543+0000","last_undegraded":"2023-10-10T21:03:14.069543+0000","last_fullsized":"2023-10-10T21:03:14.069543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:14.768025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053330+0000","last_change":"2023-10-10T21:03:14.046246+0000","last_active":"2023-10-10T21:03:14.053330+0000","last_peered":"2023-10-10T21:03:14.053330+0000","last_clean":"2023-10-10T21:03:14.053330+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.053330+0000","last_undegraded":"2023-10-10T21:03:14.053330+0000","last_fullsized":"2023-10-10T21:03:14.053330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069582+0000","last_change":"2023-10-10T21:03:12.890898+0000","last_active":"2023-10-10T21:03:14.069582+0000","last_peered":"2023-10-10T21:03:14.069582+0000","last_clean":"2023-10-10T21:03:14.069582+0000","last_became_active":"2023-10-10T21:03:12.890638+0000","last_became_peered":"2023-10-10T21:03:12.890638+0000","last_unstale":"2023-10-10T21:03:14.069582+0000","last_undegraded":"2023-10-10T21:03:14.069582+0000","last_fullsized":"2023-10-10T21:03:14.069582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:50:30.753850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052328+0000","last_change":"2023-10-10T21:03:14.048312+0000","last_active":"2023-10-10T21:03:14.052328+0000","last_peered":"2023-10-10T21:03:14.052328+0000","last_clean":"2023-10-10T21:03:14.052328+0000","last_became_active":"2023-10-10T21:03:14.048046+0000","last_became_peered":"2023-10-10T21:03:14.048046+0000","last_unstale":"2023-10-10T21:03:14.052328+0000","last_undegraded":"2023-10-10T21:03:14.052328+0000","last_fullsized":"2023-10-10T21:03:14.052328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.881085+0000","last_change":"2023-10-10T21:03:12.881085+0000","last_active":"2023-10-10T21:03:12.881085+0000","last_peered":"2023-10-10T21:03:12.881085+0000","last_clean":"2023-10-10T21:03:12.881085+0000","last_became_active":"2023-10-10T21:03:12.880788+0000","last_became_peered":"2023-10-10T21:03:12.880788+0000","last_unstale":"2023-10-10T21:03:12.881085+0000","last_undegraded":"2023-10-10T21:03:12.881085+0000","last_fullsized":"2023-10-10T21:03:12.881085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:41:10.360039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.062294+0000","last_change":"2023-10-10T21:03:14.057908+0000","last_active":"2023-10-10T21:03:14.062294+0000","last_peered":"2023-10-10T21:03:14.062294+0000","last_clean":"2023-10-10T21:03:14.062294+0000","last_became_active":"2023-10-10T21:03:14.057554+0000","last_became_peered":"2023-10-10T21:03:14.057554+0000","last_unstale":"2023-10-10T21:03:14.062294+0000","last_undegraded":"2023-10-10T21:03:14.062294+0000","last_fullsized":"2023-10-10T21:03:14.062294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.035024+0000","last_change":"2023-10-10T21:03:12.889571+0000","last_active":"2023-10-10T21:03:14.035024+0000","last_peered":"2023-10-10T21:03:14.035024+0000","last_clean":"2023-10-10T21:03:14.035024+0000","last_became_active":"2023-10-10T21:03:12.888606+0000","last_became_peered":"2023-10-10T21:03:12.888606+0000","last_unstale":"2023-10-10T21:03:14.035024+0000","last_undegraded":"2023-10-10T21:03:14.035024+0000","last_fullsized":"2023-10-10T21:03:14.035024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:07:21.202825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053737+0000","last_change":"2023-10-10T21:03:14.040585+0000","last_active":"2023-10-10T21:03:14.053737+0000","last_peered":"2023-10-10T21:03:14.053737+0000","last_clean":"2023-10-10T21:03:14.053737+0000","last_became_active":"2023-10-10T21:03:14.040307+0000","last_became_peered":"2023-10-10T21:03:14.040307+0000","last_unstale":"2023-10-10T21:03:14.053737+0000","last_undegraded":"2023-10-10T21:03:14.053737+0000","last_fullsized":"2023-10-10T21:03:14.053737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.892185+0000","last_change":"2023-10-10T21:03:12.892185+0000","last_active":"2023-10-10T21:03:12.892185+0000","last_peered":"2023-10-10T21:03:12.892185+0000","last_clean":"2023-10-10T21:03:12.892185+0000","last_became_active":"2023-10-10T21:03:12.891846+0000","last_became_peered":"2023-10-10T21:03:12.891846+0000","last_unstale":"2023-10-10T21:03:12.892185+0000","last_undegraded":"2023-10-10T21:03:12.892185+0000","last_fullsized":"2023-10-10T21:03:12.892185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:11.747446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.873723+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:53:22.038662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042832+0000","last_change":"2023-10-10T21:03:12.878371+0000","last_active":"2023-10-10T21:03:14.042832+0000","last_peered":"2023-10-10T21:03:14.042832+0000","last_clean":"2023-10-10T21:03:14.042832+0000","last_became_active":"2023-10-10T21:03:12.877211+0000","last_became_peered":"2023-10-10T21:03:12.877211+0000","last_unstale":"2023-10-10T21:03:14.042832+0000","last_undegraded":"2023-10-10T21:03:14.042832+0000","last_fullsized":"2023-10-10T21:03:14.042832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.873684+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:09.514016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067381+0000","last_change":"2023-10-10T21:03:12.889604+0000","last_active":"2023-10-10T21:03:14.067381+0000","last_peered":"2023-10-10T21:03:14.067381+0000","last_clean":"2023-10-10T21:03:14.067381+0000","last_became_active":"2023-10-10T21:03:12.889318+0000","last_became_peered":"2023-10-10T21:03:12.889318+0000","last_unstale":"2023-10-10T21:03:14.067381+0000","last_undegraded":"2023-10-10T21:03:14.067381+0000","last_fullsized":"2023-10-10T21:03:14.067381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:56.187027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053273+0000","last_change":"2023-10-10T21:03:14.044469+0000","last_active":"2023-10-10T21:03:14.053273+0000","last_peered":"2023-10-10T21:03:14.053273+0000","last_clean":"2023-10-10T21:03:14.053273+0000","last_became_active":"2023-10-10T21:03:14.044184+0000","last_became_peered":"2023-10-10T21:03:14.044184+0000","last_unstale":"2023-10-10T21:03:14.053273+0000","last_undegraded":"2023-10-10T21:03:14.053273+0000","last_fullsized":"2023-10-10T21:03:14.053273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.889551+0000","last_change":"2023-10-10T21:03:12.889551+0000","last_active":"2023-10-10T21:03:12.889551+0000","last_peered":"2023-10-10T21:03:12.889551+0000","last_clean":"2023-10-10T21:03:12.889551+0000","last_became_active":"2023-10-10T21:03:12.889403+0000","last_became_peered":"2023-10-10T21:03:12.889403+0000","last_unstale":"2023-10-10T21:03:12.889551+0000","last_undegraded":"2023-10-10T21:03:12.889551+0000","last_fullsized":"2023-10-10T21:03:12.889551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:51.756377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061355+0000","last_change":"2023-10-10T21:03:14.058577+0000","last_active":"2023-10-10T21:03:14.061355+0000","last_peered":"2023-10-10T21:03:14.061355+0000","last_clean":"2023-10-10T21:03:14.061355+0000","last_became_active":"2023-10-10T21:03:14.058273+0000","last_became_peered":"2023-10-10T21:03:14.058273+0000","last_unstale":"2023-10-10T21:03:14.061355+0000","last_undegraded":"2023-10-10T21:03:14.061355+0000","last_fullsized":"2023-10-10T21:03:14.061355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:24.406776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.072476+0000","last_change":"2023-10-10T21:03:12.890175+0000","last_active":"2023-10-10T21:03:14.072476+0000","last_peered":"2023-10-10T21:03:14.072476+0000","last_clean":"2023-10-10T21:03:14.072476+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:14.072476+0000","last_undegraded":"2023-10-10T21:03:14.072476+0000","last_fullsized":"2023-10-10T21:03:14.072476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:33:56.307223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.873086+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:38:53.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036503+0000","last_change":"2023-10-10T21:03:12.885659+0000","last_active":"2023-10-10T21:03:14.036503+0000","last_peered":"2023-10-10T21:03:14.036503+0000","last_clean":"2023-10-10T21:03:14.036503+0000","last_became_active":"2023-10-10T21:03:12.885443+0000","last_became_peered":"2023-10-10T21:03:12.885443+0000","last_unstale":"2023-10-10T21:03:14.036503+0000","last_undegraded":"2023-10-10T21:03:14.036503+0000","last_fullsized":"2023-10-10T21:03:14.036503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:47:05.333687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058689+0000","last_change":"2023-10-10T21:03:14.055943+0000","last_active":"2023-10-10T21:03:14.058689+0000","last_peered":"2023-10-10T21:03:14.058689+0000","last_clean":"2023-10-10T21:03:14.058689+0000","last_became_active":"2023-10-10T21:03:14.055642+0000","last_became_peered":"2023-10-10T21:03:14.055642+0000","last_unstale":"2023-10-10T21:03:14.058689+0000","last_undegraded":"2023-10-10T21:03:14.058689+0000","last_fullsized":"2023-10-10T21:03:14.058689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.887903+0000","last_change":"2023-10-10T21:03:12.887903+0000","last_active":"2023-10-10T21:03:12.887903+0000","last_peered":"2023-10-10T21:03:12.887903+0000","last_clean":"2023-10-10T21:03:12.887903+0000","last_became_active":"2023-10-10T21:03:12.887627+0000","last_became_peered":"2023-10-10T21:03:12.887627+0000","last_unstale":"2023-10-10T21:03:12.887903+0000","last_undegraded":"2023-10-10T21:03:12.887903+0000","last_fullsized":"2023-10-10T21:03:12.887903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:29:42.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064097+0000","last_change":"2023-10-10T21:03:14.060118+0000","last_active":"2023-10-10T21:03:14.064097+0000","last_peered":"2023-10-10T21:03:14.064097+0000","last_clean":"2023-10-10T21:03:14.064097+0000","last_became_active":"2023-10-10T21:03:14.059845+0000","last_became_peered":"2023-10-10T21:03:14.059845+0000","last_unstale":"2023-10-10T21:03:14.064097+0000","last_undegraded":"2023-10-10T21:03:14.064097+0000","last_fullsized":"2023-10-10T21:03:14.064097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.889578+0000","last_change":"2023-10-10T21:03:12.889578+0000","last_active":"2023-10-10T21:03:12.889578+0000","last_peered":"2023-10-10T21:03:12.889578+0000","last_clean":"2023-10-10T21:03:12.889578+0000","last_became_active":"2023-10-10T21:03:12.889368+0000","last_became_peered":"2023-10-10T21:03:12.889368+0000","last_unstale":"2023-10-10T21:03:12.889578+0000","last_undegraded":"2023-10-10T21:03:12.889578+0000","last_fullsized":"2023-10-10T21:03:12.889578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:24:05.169073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055292+0000","last_change":"2023-10-10T21:03:14.051228+0000","last_active":"2023-10-10T21:03:14.055292+0000","last_peered":"2023-10-10T21:03:14.055292+0000","last_clean":"2023-10-10T21:03:14.055292+0000","last_became_active":"2023-10-10T21:03:14.050931+0000","last_became_peered":"2023-10-10T21:03:14.050931+0000","last_unstale":"2023-10-10T21:03:14.055292+0000","last_undegraded":"2023-10-10T21:03:14.055292+0000","last_fullsized":"2023-10-10T21:03:14.055292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070819+0000","last_change":"2023-10-10T21:03:12.886478+0000","last_active":"2023-10-10T21:03:14.070819+0000","last_peered":"2023-10-10T21:03:14.070819+0000","last_clean":"2023-10-10T21:03:14.070819+0000","last_became_active":"2023-10-10T21:03:12.886128+0000","last_became_peered":"2023-10-10T21:03:12.886128+0000","last_unstale":"2023-10-10T21:03:14.070819+0000","last_undegraded":"2023-10-10T21:03:14.070819+0000","last_fullsized":"2023-10-10T21:03:14.070819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058959+0000","last_change":"2023-10-10T21:03:14.055709+0000","last_active":"2023-10-10T21:03:14.058959+0000","last_peered":"2023-10-10T21:03:14.058959+0000","last_clean":"2023-10-10T21:03:14.058959+0000","last_became_active":"2023-10-10T21:03:14.055452+0000","last_became_peered":"2023-10-10T21:03:14.055452+0000","last_unstale":"2023-10-10T21:03:14.058959+0000","last_undegraded":"2023-10-10T21:03:14.058959+0000","last_fullsized":"2023-10-10T21:03:14.058959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069997+0000","last_change":"2023-10-10T21:03:12.893952+0000","last_active":"2023-10-10T21:03:14.069997+0000","last_peered":"2023-10-10T21:03:14.069997+0000","last_clean":"2023-10-10T21:03:14.069997+0000","last_became_active":"2023-10-10T21:03:12.893610+0000","last_became_peered":"2023-10-10T21:03:12.893610+0000","last_unstale":"2023-10-10T21:03:14.069997+0000","last_undegraded":"2023-10-10T21:03:14.069997+0000","last_fullsized":"2023-10-10T21:03:14.069997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:09.534334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061304+0000","last_change":"2023-10-10T21:03:14.051290+0000","last_active":"2023-10-10T21:03:14.061304+0000","last_peered":"2023-10-10T21:03:14.061304+0000","last_clean":"2023-10-10T21:03:14.061304+0000","last_became_active":"2023-10-10T21:03:14.050996+0000","last_became_peered":"2023-10-10T21:03:14.050996+0000","last_unstale":"2023-10-10T21:03:14.061304+0000","last_undegraded":"2023-10-10T21:03:14.061304+0000","last_fullsized":"2023-10-10T21:03:14.061304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:31.597737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069611+0000","last_change":"2023-10-10T21:03:12.886527+0000","last_active":"2023-10-10T21:03:14.069611+0000","last_peered":"2023-10-10T21:03:14.069611+0000","last_clean":"2023-10-10T21:03:14.069611+0000","last_became_active":"2023-10-10T21:03:12.886243+0000","last_became_peered":"2023-10-10T21:03:12.886243+0000","last_unstale":"2023-10-10T21:03:14.069611+0000","last_undegraded":"2023-10-10T21:03:14.069611+0000","last_fullsized":"2023-10-10T21:03:14.069611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:46.323264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064868+0000","last_change":"2023-10-10T21:03:14.056497+0000","last_active":"2023-10-10T21:03:14.064868+0000","last_peered":"2023-10-10T21:03:14.064868+0000","last_clean":"2023-10-10T21:03:14.064868+0000","last_became_active":"2023-10-10T21:03:14.055367+0000","last_became_peered":"2023-10-10T21:03:14.055367+0000","last_unstale":"2023-10-10T21:03:14.064868+0000","last_undegraded":"2023-10-10T21:03:14.064868+0000","last_fullsized":"2023-10-10T21:03:14.064868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:34.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039649+0000","last_change":"2023-10-10T21:03:12.893029+0000","last_active":"2023-10-10T21:03:14.039649+0000","last_peered":"2023-10-10T21:03:14.039649+0000","last_clean":"2023-10-10T21:03:14.039649+0000","last_became_active":"2023-10-10T21:03:12.891259+0000","last_became_peered":"2023-10-10T21:03:12.891259+0000","last_unstale":"2023-10-10T21:03:14.039649+0000","last_undegraded":"2023-10-10T21:03:14.039649+0000","last_fullsized":"2023-10-10T21:03:14.039649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:44.279738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054116+0000","last_change":"2023-10-10T21:03:14.050667+0000","last_active":"2023-10-10T21:03:14.054116+0000","last_peered":"2023-10-10T21:03:14.054116+0000","last_clean":"2023-10-10T21:03:14.054116+0000","last_became_active":"2023-10-10T21:03:14.050399+0000","last_became_peered":"2023-10-10T21:03:14.050399+0000","last_unstale":"2023-10-10T21:03:14.054116+0000","last_undegraded":"2023-10-10T21:03:14.054116+0000","last_fullsized":"2023-10-10T21:03:14.054116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:24.498631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069657+0000","last_change":"2023-10-10T21:03:12.887639+0000","last_active":"2023-10-10T21:03:14.069657+0000","last_peered":"2023-10-10T21:03:14.069657+0000","last_clean":"2023-10-10T21:03:14.069657+0000","last_became_active":"2023-10-10T21:03:12.887398+0000","last_became_peered":"2023-10-10T21:03:12.887398+0000","last_unstale":"2023-10-10T21:03:14.069657+0000","last_undegraded":"2023-10-10T21:03:14.069657+0000","last_fullsized":"2023-10-10T21:03:14.069657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056449+0000","last_change":"2023-10-10T21:03:14.055555+0000","last_active":"2023-10-10T21:03:14.056449+0000","last_peered":"2023-10-10T21:03:14.056449+0000","last_clean":"2023-10-10T21:03:14.056449+0000","last_became_active":"2023-10-10T21:03:14.055241+0000","last_became_peered":"2023-10-10T21:03:14.055241+0000","last_unstale":"2023-10-10T21:03:14.056449+0000","last_undegraded":"2023-10-10T21:03:14.056449+0000","last_fullsized":"2023-10-10T21:03:14.056449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:04:04.186366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.038214+0000","last_change":"2023-10-10T21:03:12.889436+0000","last_active":"2023-10-10T21:03:14.038214+0000","last_peered":"2023-10-10T21:03:14.038214+0000","last_clean":"2023-10-10T21:03:14.038214+0000","last_became_active":"2023-10-10T21:03:12.889179+0000","last_became_peered":"2023-10-10T21:03:12.889179+0000","last_unstale":"2023-10-10T21:03:14.038214+0000","last_undegraded":"2023-10-10T21:03:14.038214+0000","last_fullsized":"2023-10-10T21:03:14.038214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.060011+0000","last_change":"2023-10-10T21:03:14.055915+0000","last_active":"2023-10-10T21:03:14.060011+0000","last_peered":"2023-10-10T21:03:14.060011+0000","last_clean":"2023-10-10T21:03:14.060011+0000","last_became_active":"2023-10-10T21:03:14.055646+0000","last_became_peered":"2023-10-10T21:03:14.055646+0000","last_unstale":"2023-10-10T21:03:14.060011+0000","last_undegraded":"2023-10-10T21:03:14.060011+0000","last_fullsized":"2023-10-10T21:03:14.060011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:42.622301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036674+0000","last_change":"2023-10-10T21:03:12.889430+0000","last_active":"2023-10-10T21:03:14.036674+0000","last_peered":"2023-10-10T21:03:14.036674+0000","last_clean":"2023-10-10T21:03:14.036674+0000","last_became_active":"2023-10-10T21:03:12.889154+0000","last_became_peered":"2023-10-10T21:03:12.889154+0000","last_unstale":"2023-10-10T21:03:14.036674+0000","last_undegraded":"2023-10-10T21:03:14.036674+0000","last_fullsized":"2023-10-10T21:03:14.036674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:14:09.052129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.051140+0000","last_change":"2023-10-10T21:03:14.048739+0000","last_active":"2023-10-10T21:03:14.051140+0000","last_peered":"2023-10-10T21:03:14.051140+0000","last_clean":"2023-10-10T21:03:14.051140+0000","last_became_active":"2023-10-10T21:03:14.048495+0000","last_became_peered":"2023-10-10T21:03:14.048495+0000","last_unstale":"2023-10-10T21:03:14.051140+0000","last_undegraded":"2023-10-10T21:03:14.051140+0000","last_fullsized":"2023-10-10T21:03:14.051140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.034542+0000","last_change":"2023-10-10T21:03:12.892718+0000","last_active":"2023-10-10T21:03:14.034542+0000","last_peered":"2023-10-10T21:03:14.034542+0000","last_clean":"2023-10-10T21:03:14.034542+0000","last_became_active":"2023-10-10T21:03:12.892352+0000","last_became_peered":"2023-10-10T21:03:12.892352+0000","last_unstale":"2023-10-10T21:03:14.034542+0000","last_undegraded":"2023-10-10T21:03:14.034542+0000","last_fullsized":"2023-10-10T21:03:14.034542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:03.334271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065829+0000","last_change":"2023-10-10T21:03:14.057428+0000","last_active":"2023-10-10T21:03:14.065829+0000","last_peered":"2023-10-10T21:03:14.065829+0000","last_clean":"2023-10-10T21:03:14.065829+0000","last_became_active":"2023-10-10T21:03:14.057133+0000","last_became_peered":"2023-10-10T21:03:14.057133+0000","last_unstale":"2023-10-10T21:03:14.065829+0000","last_undegraded":"2023-10-10T21:03:14.065829+0000","last_fullsized":"2023-10-10T21:03:14.065829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:23.301810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.073007+0000","last_change":"2023-10-10T21:03:12.886199+0000","last_active":"2023-10-10T21:03:14.073007+0000","last_peered":"2023-10-10T21:03:14.073007+0000","last_clean":"2023-10-10T21:03:14.073007+0000","last_became_active":"2023-10-10T21:03:12.885314+0000","last_became_peered":"2023-10-10T21:03:12.885314+0000","last_unstale":"2023-10-10T21:03:14.073007+0000","last_undegraded":"2023-10-10T21:03:14.073007+0000","last_fullsized":"2023-10-10T21:03:14.073007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053426+0000","last_change":"2023-10-10T21:03:14.046810+0000","last_active":"2023-10-10T21:03:14.053426+0000","last_peered":"2023-10-10T21:03:14.053426+0000","last_clean":"2023-10-10T21:03:14.053426+0000","last_became_active":"2023-10-10T21:03:14.046576+0000","last_became_peered":"2023-10-10T21:03:14.046576+0000","last_unstale":"2023-10-10T21:03:14.053426+0000","last_undegraded":"2023-10-10T21:03:14.053426+0000","last_fullsized":"2023-10-10T21:03:14.053426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:31:32.365391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042962+0000","last_change":"2023-10-10T21:03:12.886933+0000","last_active":"2023-10-10T21:03:14.042962+0000","last_peered":"2023-10-10T21:03:14.042962+0000","last_clean":"2023-10-10T21:03:14.042962+0000","last_became_active":"2023-10-10T21:03:12.886619+0000","last_became_peered":"2023-10-10T21:03:12.886619+0000","last_unstale":"2023-10-10T21:03:14.042962+0000","last_undegraded":"2023-10-10T21:03:14.042962+0000","last_fullsized":"2023-10-10T21:03:14.042962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065807+0000","last_change":"2023-10-10T21:03:14.062440+0000","last_active":"2023-10-10T21:03:14.065807+0000","last_peered":"2023-10-10T21:03:14.065807+0000","last_clean":"2023-10-10T21:03:14.065807+0000","last_became_active":"2023-10-10T21:03:14.062114+0000","last_became_peered":"2023-10-10T21:03:14.062114+0000","last_unstale":"2023-10-10T21:03:14.065807+0000","last_undegraded":"2023-10-10T21:03:14.065807+0000","last_fullsized":"2023-10-10T21:03:14.065807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036103+0000","last_change":"2023-10-10T21:03:12.885411+0000","last_active":"2023-10-10T21:03:14.036103+0000","last_peered":"2023-10-10T21:03:14.036103+0000","last_clean":"2023-10-10T21:03:14.036103+0000","last_became_active":"2023-10-10T21:03:12.885150+0000","last_became_peered":"2023-10-10T21:03:12.885150+0000","last_unstale":"2023-10-10T21:03:14.036103+0000","last_undegraded":"2023-10-10T21:03:14.036103+0000","last_fullsized":"2023-10-10T21:03:14.036103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053780+0000","last_change":"2023-10-10T21:03:14.045941+0000","last_active":"2023-10-10T21:03:14.053780+0000","last_peered":"2023-10-10T21:03:14.053780+0000","last_clean":"2023-10-10T21:03:14.053780+0000","last_became_active":"2023-10-10T21:03:14.045645+0000","last_became_peered":"2023-10-10T21:03:14.045645+0000","last_unstale":"2023-10-10T21:03:14.053780+0000","last_undegraded":"2023-10-10T21:03:14.053780+0000","last_fullsized":"2023-10-10T21:03:14.053780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042227+0000","last_change":"2023-10-10T21:03:12.883422+0000","last_active":"2023-10-10T21:03:14.042227+0000","last_peered":"2023-10-10T21:03:14.042227+0000","last_clean":"2023-10-10T21:03:14.042227+0000","last_became_active":"2023-10-10T21:03:12.883097+0000","last_became_peered":"2023-10-10T21:03:12.883097+0000","last_unstale":"2023-10-10T21:03:14.042227+0000","last_undegraded":"2023-10-10T21:03:14.042227+0000","last_fullsized":"2023-10-10T21:03:14.042227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:48:17.863125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056720+0000","last_change":"2023-10-10T21:03:14.054395+0000","last_active":"2023-10-10T21:03:14.056720+0000","last_peered":"2023-10-10T21:03:14.056720+0000","last_clean":"2023-10-10T21:03:14.056720+0000","last_became_active":"2023-10-10T21:03:14.054139+0000","last_became_peered":"2023-10-10T21:03:14.054139+0000","last_unstale":"2023-10-10T21:03:14.056720+0000","last_undegraded":"2023-10-10T21:03:14.056720+0000","last_fullsized":"2023-10-10T21:03:14.056720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036411+0000","last_change":"2023-10-10T21:03:12.888523+0000","last_active":"2023-10-10T21:03:14.036411+0000","last_peered":"2023-10-10T21:03:14.036411+0000","last_clean":"2023-10-10T21:03:14.036411+0000","last_became_active":"2023-10-10T21:03:12.888220+0000","last_became_peered":"2023-10-10T21:03:12.888220+0000","last_unstale":"2023-10-10T21:03:14.036411+0000","last_undegraded":"2023-10-10T21:03:14.036411+0000","last_fullsized":"2023-10-10T21:03:14.036411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:03:12.860226+0000","last_change":"2023-10-10T21:03:12.872046+0000","last_active":"2023-10-10T21:03:12.860226+0000","last_peered":"2023-10-10T21:03:12.860226+0000","last_clean":"2023-10-10T21:03:12.860226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:03:12.860226+0000","last_undegraded":"2023-10-10T21:03:12.860226+0000","last_fullsized":"2023-10-10T21:03:12.860226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:40:49.674663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036675+0000","last_change":"2023-10-10T21:03:12.885959+0000","last_active":"2023-10-10T21:03:14.036675+0000","last_peered":"2023-10-10T21:03:14.036675+0000","last_clean":"2023-10-10T21:03:14.036675+0000","last_became_active":"2023-10-10T21:03:12.885624+0000","last_became_peered":"2023-10-10T21:03:12.885624+0000","last_unstale":"2023-10-10T21:03:14.036675+0000","last_undegraded":"2023-10-10T21:03:14.036675+0000","last_fullsized":"2023-10-10T21:03:14.036675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:23:43.708965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055334+0000","last_change":"2023-10-10T21:03:14.049917+0000","last_active":"2023-10-10T21:03:14.055334+0000","last_peered":"2023-10-10T21:03:14.055334+0000","last_clean":"2023-10-10T21:03:14.055334+0000","last_became_active":"2023-10-10T21:03:14.049674+0000","last_became_peered":"2023-10-10T21:03:14.049674+0000","last_unstale":"2023-10-10T21:03:14.055334+0000","last_undegraded":"2023-10-10T21:03:14.055334+0000","last_fullsized":"2023-10-10T21:03:14.055334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-10T21:03:12.892061+0000","last_change":"2023-10-10T21:03:12.892061+0000","last_active":"2023-10-10T21:03:12.892061+0000","last_peered":"2023-10-10T21:03:12.892061+0000","last_clean":"2023-10-10T21:03:12.892061+0000","last_became_active":"2023-10-10T21:03:12.891773+0000","last_became_peered":"2023-10-10T21:03:12.891773+0000","last_unstale":"2023-10-10T21:03:12.892061+0000","last_undegraded":"2023-10-10T21:03:12.892061+0000","last_fullsized":"2023-10-10T21:03:12.892061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:33.298861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057642+0000","last_change":"2023-10-10T21:03:14.052143+0000","last_active":"2023-10-10T21:03:14.057642+0000","last_peered":"2023-10-10T21:03:14.057642+0000","last_clean":"2023-10-10T21:03:14.057642+0000","last_became_active":"2023-10-10T21:03:14.051884+0000","last_became_peered":"2023-10-10T21:03:14.051884+0000","last_unstale":"2023-10-10T21:03:14.057642+0000","last_undegraded":"2023-10-10T21:03:14.057642+0000","last_fullsized":"2023-10-10T21:03:14.057642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039181+0000","last_change":"2023-10-10T21:03:12.887792+0000","last_active":"2023-10-10T21:03:14.039181+0000","last_peered":"2023-10-10T21:03:14.039181+0000","last_clean":"2023-10-10T21:03:14.039181+0000","last_became_active":"2023-10-10T21:03:12.887523+0000","last_became_peered":"2023-10-10T21:03:12.887523+0000","last_unstale":"2023-10-10T21:03:14.039181+0000","last_undegraded":"2023-10-10T21:03:14.039181+0000","last_fullsized":"2023-10-10T21:03:14.039181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.040453+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:03:14.040453+0000","last_peered":"2023-10-10T21:03:14.040453+0000","last_clean":"2023-10-10T21:03:14.040453+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:03:14.040453+0000","last_undegraded":"2023-10-10T21:03:14.040453+0000","last_fullsized":"2023-10-10T21:03:14.040453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074216,"statfs":{"total":96636764160,"available":96331997184,"internally_reserved":0,"allocated":344064,"data_stored":127623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.28799999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.752},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70999999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":731099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.622}]},{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.056}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.88}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":1.081}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.032}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":148487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.31}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.432},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.82799999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.68300000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073600,"statfs":{"total":96636764160,"available":96331366400,"internally_reserved":0,"allocated":974848,"data_stored":737297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.496},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.96099999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":140711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.627}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.71399999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.81399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.749},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82899999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.84499999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":8.9909999999999997},"last":0.82799999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.751}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":9.0250000000000004,"5min":9.0250000000000004,"15min":9.0250000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":8.8480000000000008,"5min":8.8480000000000008,"15min":8.8480000000000008},"last":0.85699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.79400000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.872}]},{"osd":1,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.94799999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.505}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.97899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.93300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:03:19.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-10-10T21:03:19.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.875966+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:24:09.519551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-10-10T21:03:19.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.875796+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:30:41.386045+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-10-10T21:03:19.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.875255+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:10:36.558402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-10-10T21:03:19.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.874882+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T21:46:00.757042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-10-10T21:03:19.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.874807+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:57:10.345139+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-10-10T21:03:19.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.874243+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:17:13.547773+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-10-10T21:03:19.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.873723+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:53:22.038662+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-10-10T21:03:19.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.873684+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:16:09.514016+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-10-10T21:03:19.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.873086+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:38:53.987354+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-10-10T21:03:19.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:03:12.860226+0000', 'last_change': '2023-10-10T21:03:12.872046+0000', 'last_active': '2023-10-10T21:03:12.860226+0000', 'last_peered': '2023-10-10T21:03:12.860226+0000', 'last_clean': '2023-10-10T21:03:12.860226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:03:12.860226+0000', 'last_undegraded': '2023-10-10T21:03:12.860226+0000', 'last_fullsized': '2023-10-10T21:03:12.860226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'last_clean_scrub_stamp': '2023-10-10T21:03:12.860226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:40:49.674663+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:03:19.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T21:03:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.492+0000 7f68ff9ff700 1 Processor -- start 2023-10-10T21:03:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.492+0000 7f68ff9ff700 1 -- start start 2023-10-10T21:03:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68ff9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68f80b12e0 0x7f68f80af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68ff9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80cacb0 0x7f68f80af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68ff9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f80c9810 con 0x7f68f8156770 2023-10-10T21:03:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68ff9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f80c9680 con 0x7f68f80b12e0 2023-10-10T21:03:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68ff9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80adf80 con 0x7f68f80cacb0 2023-10-10T21:03:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68fcf9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68f80b12e0 0x7f68f80af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68fdf9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80cacb0 0x7f68f80af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68fcf9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68f80b12e0 0x7f68f80af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:34566/0 (socket says 172.21.15.154:34566) 2023-10-10T21:03:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68fdf9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80cacb0 0x7f68f80af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:50802/0 (socket says 172.21.15.154:50802) 2023-10-10T21:03:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68fcf9a700 1 -- 172.21.15.154:0/3159171793 learned_addr learned my addr 172.21.15.154:0/3159171793 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.494+0000 7f68fd79b700 1 --1- 172.21.15.154:0/3159171793 >> v1:172.21.15.179:6789/0 conn(0x7f68f8156770 0x7f68f80b0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:49210/0 (socket says 172.21.15.154:49210) 2023-10-10T21:03:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.495+0000 7f68fdf9c700 1 -- 172.21.15.154:0/3159171793 >> v2:172.21.15.179:3300/0 conn(0x7f68f80b12e0 msgr2=0x7f68f80af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:19.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.495+0000 7f68fdf9c700 1 --2- 172.21.15.154:0/3159171793 >> v2:172.21.15.179:3300/0 conn(0x7f68f80b12e0 0x7f68f80af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.495+0000 7f68fdf9c700 1 -- 172.21.15.154:0/3159171793 >> v1:172.21.15.179:6789/0 conn(0x7f68f8156770 legacy=0x7f68f80b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.495+0000 7f68fdf9c700 1 -- 172.21.15.154:0/3159171793 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80ae260 con 0x7f68f80cacb0 2023-10-10T21:03:19.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.495+0000 7f68fcf9a700 1 --2- 172.21.15.154:0/3159171793 >> v2:172.21.15.179:3300/0 conn(0x7f68f80b12e0 0x7f68f80af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:19.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.495+0000 7f68fdf9c700 1 --2- 172.21.15.154:0/3159171793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80cacb0 0x7f68f80af830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009e60 tx=0x7f68f0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=725c73d05dfee952 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:19.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.495+0000 7f68effff700 1 -- 172.21.15.154:0/3159171793 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000e070 con 0x7f68f80cacb0 2023-10-10T21:03:19.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.495+0000 7f68effff700 1 -- 172.21.15.154:0/3159171793 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f000bb60 con 0x7f68f80cacb0 2023-10-10T21:03:19.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.495+0000 7f68effff700 1 -- 172.21.15.154:0/3159171793 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0012430 con 0x7f68f80cacb0 2023-10-10T21:03:19.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.496+0000 7f68ff9ff700 1 -- 172.21.15.154:0/3159171793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80cacb0 msgr2=0x7f68f80af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.496+0000 7f68ff9ff700 1 --2- 172.21.15.154:0/3159171793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80cacb0 0x7f68f80af830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009e60 tx=0x7f68f0009780 comp rx=0 tx=0).stop 2023-10-10T21:03:19.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.496+0000 7f68ff9ff700 1 -- 172.21.15.154:0/3159171793 shutdown_connections 2023-10-10T21:03:19.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.496+0000 7f68ff9ff700 1 --2- 172.21.15.154:0/3159171793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80cacb0 0x7f68f80af830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.496+0000 7f68ff9ff700 1 --2- 172.21.15.154:0/3159171793 >> v2:172.21.15.179:3300/0 conn(0x7f68f80b12e0 0x7f68f80af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.496+0000 7f68ff9ff700 1 -- 172.21.15.154:0/3159171793 >> 172.21.15.154:0/3159171793 conn(0x7f68f806a310 msgr2=0x7f68f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:19.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.496+0000 7f68ff9ff700 1 -- 172.21.15.154:0/3159171793 shutdown_connections 2023-10-10T21:03:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.496+0000 7f68ff9ff700 1 -- 172.21.15.154:0/3159171793 wait complete. 2023-10-10T21:03:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.497+0000 7f68ff9ff700 1 Processor -- start 2023-10-10T21:03:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.497+0000 7f68ff9ff700 1 -- start start 2023-10-10T21:03:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.498+0000 7f68ff9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80b12e0 0x7f68f80a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.498+0000 7f68ff9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f80cacb0 0x7f68f80a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.498+0000 7f68ff9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8156770 0x7f68f8159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.498+0000 7f68ff9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8158d80 con 0x7f68f8156770 2023-10-10T21:03:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.498+0000 7f68ff9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8159060 con 0x7f68f80cacb0 2023-10-10T21:03:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.498+0000 7f68ff9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8159340 con 0x7f68f80b12e0 2023-10-10T21:03:19.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fdf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8156770 0x7f68f8159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fdf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8156770 0x7f68f8159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44674/0 (socket says 172.21.15.154:44674) 2023-10-10T21:03:19.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fdf9c700 1 -- 172.21.15.154:0/4167731694 learned_addr learned my addr 172.21.15.154:0/4167731694 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:19.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fcf9a700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f80cacb0 0x7f68f80a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fd79b700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80b12e0 0x7f68f80a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fdf9c700 1 -- 172.21.15.154:0/4167731694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80b12e0 msgr2=0x7f68f80a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fdf9c700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80b12e0 0x7f68f80a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fdf9c700 1 -- 172.21.15.154:0/4167731694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f80cacb0 msgr2=0x7f68f80a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fdf9c700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f80cacb0 0x7f68f80a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.499+0000 7f68fdf9c700 1 -- 172.21.15.154:0/4167731694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e800b790 con 0x7f68f8156770 2023-10-10T21:03:19.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.500+0000 7f68fdf9c700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8156770 0x7f68f8159b40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f68f80c97c0 tx=0x7f68f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:19.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.500+0000 7f68ed7fa700 1 -- 172.21.15.154:0/4167731694 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0012ea0 con 0x7f68f8156770 2023-10-10T21:03:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.500+0000 7f68ed7fa700 1 -- 172.21.15.154:0/4167731694 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0027470 con 0x7f68f8156770 2023-10-10T21:03:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.500+0000 7f68ed7fa700 1 -- 172.21.15.154:0/4167731694 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0027850 con 0x7f68f8156770 2023-10-10T21:03:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.500+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f0009a20 con 0x7f68f8156770 2023-10-10T21:03:19.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.500+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f815a080 con 0x7f68f8156770 2023-10-10T21:03:19.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.501+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f804c3c0 con 0x7f68f8156770 2023-10-10T21:03:19.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.502+0000 7f68ed7fa700 1 -- 172.21.15.154:0/4167731694 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68f0024070 con 0x7f68f8156770 2023-10-10T21:03:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.503+0000 7f68ed7fa700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68dc066f30 0x7f68dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.503+0000 7f68ed7fa700 1 -- 172.21.15.154:0/4167731694 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68f0087090 con 0x7f68f8156770 2023-10-10T21:03:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.503+0000 7f68fd79b700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68dc066f30 0x7f68dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.504+0000 7f68fd79b700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68dc066f30 0x7f68dc0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68f4004fd0 tx=0x7f68f4007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:19.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.507+0000 7f68ed7fa700 1 -- 172.21.15.154:0/4167731694 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68f0054260 con 0x7f68f8156770 2023-10-10T21:03:19.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.773+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f68f8158ec0 con 0x7f68f8156770 2023-10-10T21:03:19.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.774+0000 7f68ed7fa700 1 -- 172.21.15.154:0/4167731694 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1648 (secure 0 0 0) 0x7f68f8158ec0 con 0x7f68f8156770 2023-10-10T21:03:19.775 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:19.775 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":84,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"creating+peering","count":10}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":591138,"bytes_used":2439606272,"bytes_avail":770654507008,"bytes_total":773094113280,"inactive_pgs_ratio":0.10309278219938278,"write_bytes_sec":1706,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4905}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-10T21:03:09.863939+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-10T21:03:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68dc066f30 msgr2=0x7f68dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68dc066f30 0x7f68dc0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68f4004fd0 tx=0x7f68f4007eb0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8156770 msgr2=0x7f68f8159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8156770 0x7f68f8159b40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f68f80c97c0 tx=0x7f68f0019000 comp rx=0 tx=0).stop 2023-10-10T21:03:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 shutdown_connections 2023-10-10T21:03:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8156770 0x7f68f8159b40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68dc066f30 0x7f68dc0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f80b12e0 0x7f68f80a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 --2- 172.21.15.154:0/4167731694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f80cacb0 0x7f68f80a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 >> 172.21.15.154:0/4167731694 conn(0x7f68f806a310 msgr2=0x7f68f8154f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 shutdown_connections 2023-10-10T21:03:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.776+0000 7f68ff9ff700 1 -- 172.21.15.154:0/4167731694 wait complete. 2023-10-10T21:03:19.794 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T21:03:19.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:03:19.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.979+0000 7f0fb2fff700 1 Processor -- start 2023-10-10T21:03:19.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.979+0000 7f0fb2fff700 1 -- start start 2023-10-10T21:03:19.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.980+0000 7f0fb2fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.980+0000 7f0fb2fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac15d7e0 con 0x7f0fac15df50 2023-10-10T21:03:19.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.980+0000 7f0fb2fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac15dac0 con 0x7f0fac06bcd0 2023-10-10T21:03:19.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.980+0000 7f0fb2fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac15aa30 con 0x7f0fac06c0a0 2023-10-10T21:03:19.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fb159c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0fac15df50 0x7f0fac0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36772/0 (socket says 172.21.15.154:36772) 2023-10-10T21:03:19.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fb159c700 1 -- 172.21.15.154:0/451932406 learned_addr learned my addr 172.21.15.154:0/451932406 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:19.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fabfff700 1 --2- 172.21.15.154:0/451932406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fab7fe700 1 -- 172.21.15.154:0/451932406 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507024401 0 0) 0x7f0fac15d7e0 con 0x7f0fac15df50 2023-10-10T21:03:19.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fab7fe700 1 -- 172.21.15.154:0/451932406 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f9c003570 con 0x7f0fac15df50 2023-10-10T21:03:19.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fab7fe700 1 -- 172.21.15.154:0/451932406 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234087889 0 0) 0x7f0fac15dac0 con 0x7f0fac06bcd0 2023-10-10T21:03:19.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fab7fe700 1 -- 172.21.15.154:0/451932406 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fac15d7e0 con 0x7f0fac06bcd0 2023-10-10T21:03:19.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fabfff700 1 -- 172.21.15.154:0/451932406 >> v1:172.21.15.179:6789/0 conn(0x7f0fac06bcd0 legacy=0x7f0fac15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fabfff700 1 -- 172.21.15.154:0/451932406 >> v1:172.21.15.154:6789/0 conn(0x7f0fac15df50 legacy=0x7f0fac0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fab7fe700 1 -- 172.21.15.154:0/451932406 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4125774628 0 0) 0x7f0f9c003570 con 0x7f0fac15df50 2023-10-10T21:03:19.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.981+0000 7f0fabfff700 1 -- 172.21.15.154:0/451932406 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac15ad10 con 0x7f0fac06c0a0 2023-10-10T21:03:19.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.982+0000 7f0fabfff700 1 --2- 172.21.15.154:0/451932406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac0caa90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009910 tx=0x7f0f980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a5867edfabe8a20 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:19.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.982+0000 7f0fab7fe700 1 -- 172.21.15.154:0/451932406 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011630 con 0x7f0fac06c0a0 2023-10-10T21:03:19.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.982+0000 7f0fab7fe700 1 -- 172.21.15.154:0/451932406 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f98011790 con 0x7f0fac06c0a0 2023-10-10T21:03:19.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.982+0000 7f0fab7fe700 1 -- 172.21.15.154:0/451932406 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011b30 con 0x7f0fac06c0a0 2023-10-10T21:03:19.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.982+0000 7f0fb2fff700 1 -- 172.21.15.154:0/451932406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 msgr2=0x7f0fac0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.982+0000 7f0fb2fff700 1 --2- 172.21.15.154:0/451932406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac0caa90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009910 tx=0x7f0f980091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.982+0000 7f0fb2fff700 1 -- 172.21.15.154:0/451932406 shutdown_connections 2023-10-10T21:03:19.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.982+0000 7f0fb2fff700 1 --2- 172.21.15.154:0/451932406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac0caa90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.982+0000 7f0fb2fff700 1 -- 172.21.15.154:0/451932406 >> 172.21.15.154:0/451932406 conn(0x7f0fac0ce600 msgr2=0x7f0fac0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:19.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.983+0000 7f0fb2fff700 1 -- 172.21.15.154:0/451932406 shutdown_connections 2023-10-10T21:03:19.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.983+0000 7f0fb2fff700 1 -- 172.21.15.154:0/451932406 wait complete. 2023-10-10T21:03:19.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.984+0000 7f0fb2fff700 1 Processor -- start 2023-10-10T21:03:19.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.984+0000 7f0fb2fff700 1 -- start start 2023-10-10T21:03:19.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.985+0000 7f0fb2fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fac06bcd0 0x7f0fac0c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.985+0000 7f0fb2fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.985+0000 7f0fb2fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fac15df50 0x7f0fac0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:19.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.985+0000 7f0fb2fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0c6590 con 0x7f0fac06bcd0 2023-10-10T21:03:19.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.985+0000 7f0fb2fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac159f40 con 0x7f0fac15df50 2023-10-10T21:03:19.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.985+0000 7f0fb2fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0c5bf0 con 0x7f0fac06c0a0 2023-10-10T21:03:19.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.985+0000 7f0fb0d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fac06bcd0 0x7f0fac0c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.985+0000 7f0fb0d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fac06bcd0 0x7f0fac0c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44682/0 (socket says 172.21.15.154:44682) 2023-10-10T21:03:19.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.985+0000 7f0fb0d9b700 1 -- 172.21.15.154:0/1951821298 learned_addr learned my addr 172.21.15.154:0/1951821298 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:19.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb159c700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fac15df50 0x7f0fac0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fabfff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:19.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb0d9b700 1 -- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 msgr2=0x7f0fac169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb0d9b700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb0d9b700 1 -- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fac15df50 msgr2=0x7f0fac0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:19.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb0d9b700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fac15df50 0x7f0fac0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:19.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb0d9b700 1 -- 172.21.15.154:0/1951821298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98009420 con 0x7f0fac06bcd0 2023-10-10T21:03:19.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb159c700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fac15df50 0x7f0fac0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:19.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fabfff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:19.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb0d9b700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fac06bcd0 0x7f0fac0c56b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c5b0 tx=0x7f0fa0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:19.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fa8ff9700 1 -- 172.21.15.154:0/1951821298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0010510 con 0x7f0fac06bcd0 2023-10-10T21:03:19.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fa8ff9700 1 -- 172.21.15.154:0/1951821298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa0010690 con 0x7f0fac06bcd0 2023-10-10T21:03:19.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac0c62b0 con 0x7f0fac06bcd0 2023-10-10T21:03:19.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fa8ff9700 1 -- 172.21.15.154:0/1951821298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0010a50 con 0x7f0fac06bcd0 2023-10-10T21:03:20.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.986+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac159bd0 con 0x7f0fac06bcd0 2023-10-10T21:03:20.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.987+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac0ca460 con 0x7f0fac06bcd0 2023-10-10T21:03:20.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.988+0000 7f0fa8ff9700 1 -- 172.21.15.154:0/1951821298 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fa001b400 con 0x7f0fac06bcd0 2023-10-10T21:03:20.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.989+0000 7f0fa8ff9700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0f90066f30 0x7f0f900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:20.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.989+0000 7f0fa8ff9700 1 -- 172.21.15.154:0/1951821298 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0fa0084250 con 0x7f0fac06bcd0 2023-10-10T21:03:20.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.989+0000 7f0fabfff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0f90066f30 0x7f0f900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:20.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.990+0000 7f0fabfff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0f90066f30 0x7f0f900693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009860 tx=0x7f0f98017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:20.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:19.994+0000 7f0fa8ff9700 1 -- 172.21.15.154:0/1951821298 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fa0051420 con 0x7f0fac06bcd0 2023-10-10T21:03:20.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.189+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fac159770 con 0x7f0f90066f30 2023-10-10T21:03:20.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.198+0000 7f0fa8ff9700 1 -- 172.21.15.154:0/1951821298 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288467 (secure 0 0 0) 0x7f0f98000bc0 con 0x7f0f90066f30 2023-10-10T21:03:20.203 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0f90066f30 msgr2=0x7f0f900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0f90066f30 0x7f0f900693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009860 tx=0x7f0f98017000 comp rx=0 tx=0).stop 2023-10-10T21:03:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fac06bcd0 msgr2=0x7f0fac0c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:20.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fac06bcd0 0x7f0fac0c56b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c5b0 tx=0x7f0fa0007e10 comp rx=0 tx=0).stop 2023-10-10T21:03:20.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 shutdown_connections 2023-10-10T21:03:20.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fac15df50 0x7f0fac0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:20.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fac06bcd0 0x7f0fac0c56b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:20.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0f90066f30 0x7f0f900693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:20.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 --2- 172.21.15.154:0/1951821298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fac06c0a0 0x7f0fac169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:20.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 >> 172.21.15.154:0/1951821298 conn(0x7f0fac0ce600 msgr2=0x7f0fac069480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:20.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 shutdown_connections 2023-10-10T21:03:20.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:20.202+0000 7f0fb2fff700 1 -- 172.21.15.154:0/1951821298 wait complete. 2023-10-10T21:03:20.207 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:03:20.221 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-10T21:03:19.865764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382480,"kb_used_data":4176,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592240,"statfs":{"total":773094113280,"available":770654453760,"internally_reserved":0,"allocated":4276224,"data_stored":2348204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.999120"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058310+0000","last_change":"2023-10-10T21:03:14.056535+0000","last_active":"2023-10-10T21:03:14.058310+0000","last_peered":"2023-10-10T21:03:14.058310+0000","last_clean":"2023-10-10T21:03:14.058310+0000","last_became_active":"2023-10-10T21:03:14.056221+0000","last_became_peered":"2023-10-10T21:03:14.056221+0000","last_unstale":"2023-10-10T21:03:14.058310+0000","last_undegraded":"2023-10-10T21:03:14.058310+0000","last_fullsized":"2023-10-10T21:03:14.058310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053219+0000","last_change":"2023-10-10T21:03:14.050826+0000","last_active":"2023-10-10T21:03:14.053219+0000","last_peered":"2023-10-10T21:03:14.053219+0000","last_clean":"2023-10-10T21:03:14.053219+0000","last_became_active":"2023-10-10T21:03:14.050576+0000","last_became_peered":"2023-10-10T21:03:14.050576+0000","last_unstale":"2023-10-10T21:03:14.053219+0000","last_undegraded":"2023-10-10T21:03:14.053219+0000","last_fullsized":"2023-10-10T21:03:14.053219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:45:13.635574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053297+0000","last_change":"2023-10-10T21:03:14.044532+0000","last_active":"2023-10-10T21:03:14.053297+0000","last_peered":"2023-10-10T21:03:14.053297+0000","last_clean":"2023-10-10T21:03:14.053297+0000","last_became_active":"2023-10-10T21:03:14.044238+0000","last_became_peered":"2023-10-10T21:03:14.044238+0000","last_unstale":"2023-10-10T21:03:14.053297+0000","last_undegraded":"2023-10-10T21:03:14.053297+0000","last_fullsized":"2023-10-10T21:03:14.053297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:57:09.143759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061282+0000","last_change":"2023-10-10T21:03:14.050842+0000","last_active":"2023-10-10T21:03:14.061282+0000","last_peered":"2023-10-10T21:03:14.061282+0000","last_clean":"2023-10-10T21:03:14.061282+0000","last_became_active":"2023-10-10T21:03:14.050579+0000","last_became_peered":"2023-10-10T21:03:14.050579+0000","last_unstale":"2023-10-10T21:03:14.061282+0000","last_undegraded":"2023-10-10T21:03:14.061282+0000","last_fullsized":"2023-10-10T21:03:14.061282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049131+0000","last_change":"2023-10-10T21:03:14.046823+0000","last_active":"2023-10-10T21:03:14.049131+0000","last_peered":"2023-10-10T21:03:14.049131+0000","last_clean":"2023-10-10T21:03:14.049131+0000","last_became_active":"2023-10-10T21:03:14.046566+0000","last_became_peered":"2023-10-10T21:03:14.046566+0000","last_unstale":"2023-10-10T21:03:14.049131+0000","last_undegraded":"2023-10-10T21:03:14.049131+0000","last_fullsized":"2023-10-10T21:03:14.049131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.116595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.043708+0000","last_change":"2023-10-10T21:03:14.040008+0000","last_active":"2023-10-10T21:03:14.043708+0000","last_peered":"2023-10-10T21:03:14.043708+0000","last_clean":"2023-10-10T21:03:14.043708+0000","last_became_active":"2023-10-10T21:03:14.039725+0000","last_became_peered":"2023-10-10T21:03:14.039725+0000","last_unstale":"2023-10-10T21:03:14.043708+0000","last_undegraded":"2023-10-10T21:03:14.043708+0000","last_fullsized":"2023-10-10T21:03:14.043708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:33:29.937840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049955+0000","last_change":"2023-10-10T21:03:14.047991+0000","last_active":"2023-10-10T21:03:14.049955+0000","last_peered":"2023-10-10T21:03:14.049955+0000","last_clean":"2023-10-10T21:03:14.049955+0000","last_became_active":"2023-10-10T21:03:14.047702+0000","last_became_peered":"2023-10-10T21:03:14.047702+0000","last_unstale":"2023-10-10T21:03:14.049955+0000","last_undegraded":"2023-10-10T21:03:14.049955+0000","last_fullsized":"2023-10-10T21:03:14.049955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052555+0000","last_change":"2023-10-10T21:03:14.049953+0000","last_active":"2023-10-10T21:03:14.052555+0000","last_peered":"2023-10-10T21:03:14.052555+0000","last_clean":"2023-10-10T21:03:14.052555+0000","last_became_active":"2023-10-10T21:03:14.049549+0000","last_became_peered":"2023-10-10T21:03:14.049549+0000","last_unstale":"2023-10-10T21:03:14.052555+0000","last_undegraded":"2023-10-10T21:03:14.052555+0000","last_fullsized":"2023-10-10T21:03:14.052555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066618+0000","last_change":"2023-10-10T21:03:14.062596+0000","last_active":"2023-10-10T21:03:14.066618+0000","last_peered":"2023-10-10T21:03:14.066618+0000","last_clean":"2023-10-10T21:03:14.066618+0000","last_became_active":"2023-10-10T21:03:14.062296+0000","last_became_peered":"2023-10-10T21:03:14.062296+0000","last_unstale":"2023-10-10T21:03:14.066618+0000","last_undegraded":"2023-10-10T21:03:14.066618+0000","last_fullsized":"2023-10-10T21:03:14.066618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:58:45.241585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058876+0000","last_change":"2023-10-10T21:03:14.043250+0000","last_active":"2023-10-10T21:03:14.058876+0000","last_peered":"2023-10-10T21:03:14.058876+0000","last_clean":"2023-10-10T21:03:14.058876+0000","last_became_active":"2023-10-10T21:03:14.042985+0000","last_became_peered":"2023-10-10T21:03:14.042985+0000","last_unstale":"2023-10-10T21:03:14.058876+0000","last_undegraded":"2023-10-10T21:03:14.058876+0000","last_fullsized":"2023-10-10T21:03:14.058876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066738+0000","last_change":"2023-10-10T21:03:14.060697+0000","last_active":"2023-10-10T21:03:14.066738+0000","last_peered":"2023-10-10T21:03:14.066738+0000","last_clean":"2023-10-10T21:03:14.066738+0000","last_became_active":"2023-10-10T21:03:14.060246+0000","last_became_peered":"2023-10-10T21:03:14.060246+0000","last_unstale":"2023-10-10T21:03:14.066738+0000","last_undegraded":"2023-10-10T21:03:14.066738+0000","last_fullsized":"2023-10-10T21:03:14.066738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053144+0000","last_change":"2023-10-10T21:03:14.041036+0000","last_active":"2023-10-10T21:03:14.053144+0000","last_peered":"2023-10-10T21:03:14.053144+0000","last_clean":"2023-10-10T21:03:14.053144+0000","last_became_active":"2023-10-10T21:03:14.040620+0000","last_became_peered":"2023-10-10T21:03:14.040620+0000","last_unstale":"2023-10-10T21:03:14.053144+0000","last_undegraded":"2023-10-10T21:03:14.053144+0000","last_fullsized":"2023-10-10T21:03:14.053144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049113+0000","last_change":"2023-10-10T21:03:14.046280+0000","last_active":"2023-10-10T21:03:14.049113+0000","last_peered":"2023-10-10T21:03:14.049113+0000","last_clean":"2023-10-10T21:03:14.049113+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.049113+0000","last_undegraded":"2023-10-10T21:03:14.049113+0000","last_fullsized":"2023-10-10T21:03:14.049113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:28.753153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052046+0000","last_change":"2023-10-10T21:03:14.048465+0000","last_active":"2023-10-10T21:03:14.052046+0000","last_peered":"2023-10-10T21:03:14.052046+0000","last_clean":"2023-10-10T21:03:14.052046+0000","last_became_active":"2023-10-10T21:03:14.048108+0000","last_became_peered":"2023-10-10T21:03:14.048108+0000","last_unstale":"2023-10-10T21:03:14.052046+0000","last_undegraded":"2023-10-10T21:03:14.052046+0000","last_fullsized":"2023-10-10T21:03:14.052046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:44.107832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054431+0000","last_change":"2023-10-10T21:03:14.049328+0000","last_active":"2023-10-10T21:03:14.054431+0000","last_peered":"2023-10-10T21:03:14.054431+0000","last_clean":"2023-10-10T21:03:14.054431+0000","last_became_active":"2023-10-10T21:03:14.048765+0000","last_became_peered":"2023-10-10T21:03:14.048765+0000","last_unstale":"2023-10-10T21:03:14.054431+0000","last_undegraded":"2023-10-10T21:03:14.054431+0000","last_fullsized":"2023-10-10T21:03:14.054431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:08.144185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057612+0000","last_change":"2023-10-10T21:03:14.051301+0000","last_active":"2023-10-10T21:03:14.057612+0000","last_peered":"2023-10-10T21:03:14.057612+0000","last_clean":"2023-10-10T21:03:14.057612+0000","last_became_active":"2023-10-10T21:03:14.050919+0000","last_became_peered":"2023-10-10T21:03:14.050919+0000","last_unstale":"2023-10-10T21:03:14.057612+0000","last_undegraded":"2023-10-10T21:03:14.057612+0000","last_fullsized":"2023-10-10T21:03:14.057612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049838+0000","last_change":"2023-10-10T21:03:14.047703+0000","last_active":"2023-10-10T21:03:14.049838+0000","last_peered":"2023-10-10T21:03:14.049838+0000","last_clean":"2023-10-10T21:03:14.049838+0000","last_became_active":"2023-10-10T21:03:14.047391+0000","last_became_peered":"2023-10-10T21:03:14.047391+0000","last_unstale":"2023-10-10T21:03:14.049838+0000","last_undegraded":"2023-10-10T21:03:14.049838+0000","last_fullsized":"2023-10-10T21:03:14.049838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049203+0000","last_change":"2023-10-10T21:03:14.041693+0000","last_active":"2023-10-10T21:03:14.049203+0000","last_peered":"2023-10-10T21:03:14.049203+0000","last_clean":"2023-10-10T21:03:14.049203+0000","last_became_active":"2023-10-10T21:03:14.041406+0000","last_became_peered":"2023-10-10T21:03:14.041406+0000","last_unstale":"2023-10-10T21:03:14.049203+0000","last_undegraded":"2023-10-10T21:03:14.049203+0000","last_fullsized":"2023-10-10T21:03:14.049203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:33:24.077138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049076+0000","last_change":"2023-10-10T21:03:14.042854+0000","last_active":"2023-10-10T21:03:14.049076+0000","last_peered":"2023-10-10T21:03:14.049076+0000","last_clean":"2023-10-10T21:03:14.049076+0000","last_became_active":"2023-10-10T21:03:14.042623+0000","last_became_peered":"2023-10-10T21:03:14.042623+0000","last_unstale":"2023-10-10T21:03:14.049076+0000","last_undegraded":"2023-10-10T21:03:14.049076+0000","last_fullsized":"2023-10-10T21:03:14.049076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:06:00.174080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065008+0000","last_change":"2023-10-10T21:03:14.057258+0000","last_active":"2023-10-10T21:03:14.065008+0000","last_peered":"2023-10-10T21:03:14.065008+0000","last_clean":"2023-10-10T21:03:14.065008+0000","last_became_active":"2023-10-10T21:03:14.057010+0000","last_became_peered":"2023-10-10T21:03:14.057010+0000","last_unstale":"2023-10-10T21:03:14.065008+0000","last_undegraded":"2023-10-10T21:03:14.065008+0000","last_fullsized":"2023-10-10T21:03:14.065008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:40:13.267887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056825+0000","last_change":"2023-10-10T21:03:14.052191+0000","last_active":"2023-10-10T21:03:14.056825+0000","last_peered":"2023-10-10T21:03:14.056825+0000","last_clean":"2023-10-10T21:03:14.056825+0000","last_became_active":"2023-10-10T21:03:14.051717+0000","last_became_peered":"2023-10-10T21:03:14.051717+0000","last_unstale":"2023-10-10T21:03:14.056825+0000","last_undegraded":"2023-10-10T21:03:14.056825+0000","last_fullsized":"2023-10-10T21:03:14.056825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056242+0000","last_change":"2023-10-10T21:03:14.050529+0000","last_active":"2023-10-10T21:03:14.056242+0000","last_peered":"2023-10-10T21:03:14.056242+0000","last_clean":"2023-10-10T21:03:14.056242+0000","last_became_active":"2023-10-10T21:03:14.050259+0000","last_became_peered":"2023-10-10T21:03:14.050259+0000","last_unstale":"2023-10-10T21:03:14.056242+0000","last_undegraded":"2023-10-10T21:03:14.056242+0000","last_fullsized":"2023-10-10T21:03:14.056242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056916+0000","last_change":"2023-10-10T21:03:14.053134+0000","last_active":"2023-10-10T21:03:14.056916+0000","last_peered":"2023-10-10T21:03:14.056916+0000","last_clean":"2023-10-10T21:03:14.056916+0000","last_became_active":"2023-10-10T21:03:14.052832+0000","last_became_peered":"2023-10-10T21:03:14.052832+0000","last_unstale":"2023-10-10T21:03:14.056916+0000","last_undegraded":"2023-10-10T21:03:14.056916+0000","last_fullsized":"2023-10-10T21:03:14.056916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055627+0000","last_change":"2023-10-10T21:03:14.054510+0000","last_active":"2023-10-10T21:03:14.055627+0000","last_peered":"2023-10-10T21:03:14.055627+0000","last_clean":"2023-10-10T21:03:14.055627+0000","last_became_active":"2023-10-10T21:03:14.053503+0000","last_became_peered":"2023-10-10T21:03:14.053503+0000","last_unstale":"2023-10-10T21:03:14.055627+0000","last_undegraded":"2023-10-10T21:03:14.055627+0000","last_fullsized":"2023-10-10T21:03:14.055627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061435+0000","last_change":"2023-10-10T21:03:14.053313+0000","last_active":"2023-10-10T21:03:14.061435+0000","last_peered":"2023-10-10T21:03:14.061435+0000","last_clean":"2023-10-10T21:03:14.061435+0000","last_became_active":"2023-10-10T21:03:14.053079+0000","last_became_peered":"2023-10-10T21:03:14.053079+0000","last_unstale":"2023-10-10T21:03:14.061435+0000","last_undegraded":"2023-10-10T21:03:14.061435+0000","last_fullsized":"2023-10-10T21:03:14.061435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056917+0000","last_change":"2023-10-10T21:03:14.052074+0000","last_active":"2023-10-10T21:03:14.056917+0000","last_peered":"2023-10-10T21:03:14.056917+0000","last_clean":"2023-10-10T21:03:14.056917+0000","last_became_active":"2023-10-10T21:03:14.051816+0000","last_became_peered":"2023-10-10T21:03:14.051816+0000","last_unstale":"2023-10-10T21:03:14.056917+0000","last_undegraded":"2023-10-10T21:03:14.056917+0000","last_fullsized":"2023-10-10T21:03:14.056917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:45.181361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061383+0000","last_change":"2023-10-10T21:03:14.050946+0000","last_active":"2023-10-10T21:03:14.061383+0000","last_peered":"2023-10-10T21:03:14.061383+0000","last_clean":"2023-10-10T21:03:14.061383+0000","last_became_active":"2023-10-10T21:03:14.050591+0000","last_became_peered":"2023-10-10T21:03:14.050591+0000","last_unstale":"2023-10-10T21:03:14.061383+0000","last_undegraded":"2023-10-10T21:03:14.061383+0000","last_fullsized":"2023-10-10T21:03:14.061383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:56.258834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053266+0000","last_change":"2023-10-10T21:03:14.045679+0000","last_active":"2023-10-10T21:03:14.053266+0000","last_peered":"2023-10-10T21:03:14.053266+0000","last_clean":"2023-10-10T21:03:14.053266+0000","last_became_active":"2023-10-10T21:03:14.045412+0000","last_became_peered":"2023-10-10T21:03:14.045412+0000","last_unstale":"2023-10-10T21:03:14.053266+0000","last_undegraded":"2023-10-10T21:03:14.053266+0000","last_fullsized":"2023-10-10T21:03:14.053266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056845+0000","last_change":"2023-10-10T21:03:14.054112+0000","last_active":"2023-10-10T21:03:14.056845+0000","last_peered":"2023-10-10T21:03:14.056845+0000","last_clean":"2023-10-10T21:03:14.056845+0000","last_became_active":"2023-10-10T21:03:14.052952+0000","last_became_peered":"2023-10-10T21:03:14.052952+0000","last_unstale":"2023-10-10T21:03:14.056845+0000","last_undegraded":"2023-10-10T21:03:14.056845+0000","last_fullsized":"2023-10-10T21:03:14.056845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052548+0000","last_change":"2023-10-10T21:03:14.049723+0000","last_active":"2023-10-10T21:03:14.052548+0000","last_peered":"2023-10-10T21:03:14.052548+0000","last_clean":"2023-10-10T21:03:14.052548+0000","last_became_active":"2023-10-10T21:03:14.049283+0000","last_became_peered":"2023-10-10T21:03:14.049283+0000","last_unstale":"2023-10-10T21:03:14.052548+0000","last_undegraded":"2023-10-10T21:03:14.052548+0000","last_fullsized":"2023-10-10T21:03:14.052548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054706+0000","last_change":"2023-10-10T21:03:14.051746+0000","last_active":"2023-10-10T21:03:14.054706+0000","last_peered":"2023-10-10T21:03:14.054706+0000","last_clean":"2023-10-10T21:03:14.054706+0000","last_became_active":"2023-10-10T21:03:14.051312+0000","last_became_peered":"2023-10-10T21:03:14.051312+0000","last_unstale":"2023-10-10T21:03:14.054706+0000","last_undegraded":"2023-10-10T21:03:14.054706+0000","last_fullsized":"2023-10-10T21:03:14.054706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058708+0000","last_change":"2023-10-10T21:03:14.056651+0000","last_active":"2023-10-10T21:03:14.058708+0000","last_peered":"2023-10-10T21:03:14.058708+0000","last_clean":"2023-10-10T21:03:14.058708+0000","last_became_active":"2023-10-10T21:03:14.056380+0000","last_became_peered":"2023-10-10T21:03:14.056380+0000","last_unstale":"2023-10-10T21:03:14.058708+0000","last_undegraded":"2023-10-10T21:03:14.058708+0000","last_fullsized":"2023-10-10T21:03:14.058708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056688+0000","last_change":"2023-10-10T21:03:14.052449+0000","last_active":"2023-10-10T21:03:14.056688+0000","last_peered":"2023-10-10T21:03:14.056688+0000","last_clean":"2023-10-10T21:03:14.056688+0000","last_became_active":"2023-10-10T21:03:14.052170+0000","last_became_peered":"2023-10-10T21:03:14.052170+0000","last_unstale":"2023-10-10T21:03:14.056688+0000","last_undegraded":"2023-10-10T21:03:14.056688+0000","last_fullsized":"2023-10-10T21:03:14.056688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070197+0000","last_change":"2023-10-10T21:03:12.887804+0000","last_active":"2023-10-10T21:03:14.070197+0000","last_peered":"2023-10-10T21:03:14.070197+0000","last_clean":"2023-10-10T21:03:14.070197+0000","last_became_active":"2023-10-10T21:03:12.886661+0000","last_became_peered":"2023-10-10T21:03:12.886661+0000","last_unstale":"2023-10-10T21:03:14.070197+0000","last_undegraded":"2023-10-10T21:03:14.070197+0000","last_fullsized":"2023-10-10T21:03:14.070197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:48.860387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056422+0000","last_change":"2023-10-10T21:03:14.055315+0000","last_active":"2023-10-10T21:03:14.056422+0000","last_peered":"2023-10-10T21:03:14.056422+0000","last_clean":"2023-10-10T21:03:14.056422+0000","last_became_active":"2023-10-10T21:03:14.055012+0000","last_became_peered":"2023-10-10T21:03:14.055012+0000","last_unstale":"2023-10-10T21:03:14.056422+0000","last_undegraded":"2023-10-10T21:03:14.056422+0000","last_fullsized":"2023-10-10T21:03:14.056422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067737+0000","last_change":"2023-10-10T21:03:12.891968+0000","last_active":"2023-10-10T21:03:14.067737+0000","last_peered":"2023-10-10T21:03:14.067737+0000","last_clean":"2023-10-10T21:03:14.067737+0000","last_became_active":"2023-10-10T21:03:12.891692+0000","last_became_peered":"2023-10-10T21:03:12.891692+0000","last_unstale":"2023-10-10T21:03:14.067737+0000","last_undegraded":"2023-10-10T21:03:14.067737+0000","last_fullsized":"2023-10-10T21:03:14.067737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055774+0000","last_change":"2023-10-10T21:03:14.052248+0000","last_active":"2023-10-10T21:03:14.055774+0000","last_peered":"2023-10-10T21:03:14.055774+0000","last_clean":"2023-10-10T21:03:14.055774+0000","last_became_active":"2023-10-10T21:03:14.051970+0000","last_became_peered":"2023-10-10T21:03:14.051970+0000","last_unstale":"2023-10-10T21:03:14.055774+0000","last_undegraded":"2023-10-10T21:03:14.055774+0000","last_fullsized":"2023-10-10T21:03:14.055774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069443+0000","last_change":"2023-10-10T21:03:12.890886+0000","last_active":"2023-10-10T21:03:14.069443+0000","last_peered":"2023-10-10T21:03:14.069443+0000","last_clean":"2023-10-10T21:03:14.069443+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:14.069443+0000","last_undegraded":"2023-10-10T21:03:14.069443+0000","last_fullsized":"2023-10-10T21:03:14.069443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:22:47.067057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061401+0000","last_change":"2023-10-10T21:03:14.058547+0000","last_active":"2023-10-10T21:03:14.061401+0000","last_peered":"2023-10-10T21:03:14.061401+0000","last_clean":"2023-10-10T21:03:14.061401+0000","last_became_active":"2023-10-10T21:03:14.058172+0000","last_became_peered":"2023-10-10T21:03:14.058172+0000","last_unstale":"2023-10-10T21:03:14.061401+0000","last_undegraded":"2023-10-10T21:03:14.061401+0000","last_fullsized":"2023-10-10T21:03:14.061401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.071334+0000","last_change":"2023-10-10T21:03:12.886500+0000","last_active":"2023-10-10T21:03:14.071334+0000","last_peered":"2023-10-10T21:03:14.071334+0000","last_clean":"2023-10-10T21:03:14.071334+0000","last_became_active":"2023-10-10T21:03:12.886219+0000","last_became_peered":"2023-10-10T21:03:12.886219+0000","last_unstale":"2023-10-10T21:03:14.071334+0000","last_undegraded":"2023-10-10T21:03:14.071334+0000","last_fullsized":"2023-10-10T21:03:14.071334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:12.688030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058736+0000","last_change":"2023-10-10T21:03:14.055102+0000","last_active":"2023-10-10T21:03:14.058736+0000","last_peered":"2023-10-10T21:03:14.058736+0000","last_clean":"2023-10-10T21:03:14.058736+0000","last_became_active":"2023-10-10T21:03:14.054774+0000","last_became_peered":"2023-10-10T21:03:14.054774+0000","last_unstale":"2023-10-10T21:03:14.058736+0000","last_undegraded":"2023-10-10T21:03:14.058736+0000","last_fullsized":"2023-10-10T21:03:14.058736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069543+0000","last_change":"2023-10-10T21:03:12.890962+0000","last_active":"2023-10-10T21:03:14.069543+0000","last_peered":"2023-10-10T21:03:14.069543+0000","last_clean":"2023-10-10T21:03:14.069543+0000","last_became_active":"2023-10-10T21:03:12.890574+0000","last_became_peered":"2023-10-10T21:03:12.890574+0000","last_unstale":"2023-10-10T21:03:14.069543+0000","last_undegraded":"2023-10-10T21:03:14.069543+0000","last_fullsized":"2023-10-10T21:03:14.069543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:14.768025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053330+0000","last_change":"2023-10-10T21:03:14.046246+0000","last_active":"2023-10-10T21:03:14.053330+0000","last_peered":"2023-10-10T21:03:14.053330+0000","last_clean":"2023-10-10T21:03:14.053330+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.053330+0000","last_undegraded":"2023-10-10T21:03:14.053330+0000","last_fullsized":"2023-10-10T21:03:14.053330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069582+0000","last_change":"2023-10-10T21:03:12.890898+0000","last_active":"2023-10-10T21:03:14.069582+0000","last_peered":"2023-10-10T21:03:14.069582+0000","last_clean":"2023-10-10T21:03:14.069582+0000","last_became_active":"2023-10-10T21:03:12.890638+0000","last_became_peered":"2023-10-10T21:03:12.890638+0000","last_unstale":"2023-10-10T21:03:14.069582+0000","last_undegraded":"2023-10-10T21:03:14.069582+0000","last_fullsized":"2023-10-10T21:03:14.069582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:50:30.753850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052328+0000","last_change":"2023-10-10T21:03:14.048312+0000","last_active":"2023-10-10T21:03:14.052328+0000","last_peered":"2023-10-10T21:03:14.052328+0000","last_clean":"2023-10-10T21:03:14.052328+0000","last_became_active":"2023-10-10T21:03:14.048046+0000","last_became_peered":"2023-10-10T21:03:14.048046+0000","last_unstale":"2023-10-10T21:03:14.052328+0000","last_undegraded":"2023-10-10T21:03:14.052328+0000","last_fullsized":"2023-10-10T21:03:14.052328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.031821+0000","last_change":"2023-10-10T21:03:12.881085+0000","last_active":"2023-10-10T21:03:14.031821+0000","last_peered":"2023-10-10T21:03:14.031821+0000","last_clean":"2023-10-10T21:03:14.031821+0000","last_became_active":"2023-10-10T21:03:12.880788+0000","last_became_peered":"2023-10-10T21:03:12.880788+0000","last_unstale":"2023-10-10T21:03:14.031821+0000","last_undegraded":"2023-10-10T21:03:14.031821+0000","last_fullsized":"2023-10-10T21:03:14.031821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:41:10.360039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.062294+0000","last_change":"2023-10-10T21:03:14.057908+0000","last_active":"2023-10-10T21:03:14.062294+0000","last_peered":"2023-10-10T21:03:14.062294+0000","last_clean":"2023-10-10T21:03:14.062294+0000","last_became_active":"2023-10-10T21:03:14.057554+0000","last_became_peered":"2023-10-10T21:03:14.057554+0000","last_unstale":"2023-10-10T21:03:14.062294+0000","last_undegraded":"2023-10-10T21:03:14.062294+0000","last_fullsized":"2023-10-10T21:03:14.062294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.035024+0000","last_change":"2023-10-10T21:03:12.889571+0000","last_active":"2023-10-10T21:03:14.035024+0000","last_peered":"2023-10-10T21:03:14.035024+0000","last_clean":"2023-10-10T21:03:14.035024+0000","last_became_active":"2023-10-10T21:03:12.888606+0000","last_became_peered":"2023-10-10T21:03:12.888606+0000","last_unstale":"2023-10-10T21:03:14.035024+0000","last_undegraded":"2023-10-10T21:03:14.035024+0000","last_fullsized":"2023-10-10T21:03:14.035024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:07:21.202825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053737+0000","last_change":"2023-10-10T21:03:14.040585+0000","last_active":"2023-10-10T21:03:14.053737+0000","last_peered":"2023-10-10T21:03:14.053737+0000","last_clean":"2023-10-10T21:03:14.053737+0000","last_became_active":"2023-10-10T21:03:14.040307+0000","last_became_peered":"2023-10-10T21:03:14.040307+0000","last_unstale":"2023-10-10T21:03:14.053737+0000","last_undegraded":"2023-10-10T21:03:14.053737+0000","last_fullsized":"2023-10-10T21:03:14.053737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.032521+0000","last_change":"2023-10-10T21:03:12.892185+0000","last_active":"2023-10-10T21:03:14.032521+0000","last_peered":"2023-10-10T21:03:14.032521+0000","last_clean":"2023-10-10T21:03:14.032521+0000","last_became_active":"2023-10-10T21:03:12.891846+0000","last_became_peered":"2023-10-10T21:03:12.891846+0000","last_unstale":"2023-10-10T21:03:14.032521+0000","last_undegraded":"2023-10-10T21:03:14.032521+0000","last_fullsized":"2023-10-10T21:03:14.032521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:11.747446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049176+0000","last_change":"2023-10-10T21:03:14.042823+0000","last_active":"2023-10-10T21:03:14.049176+0000","last_peered":"2023-10-10T21:03:14.049176+0000","last_clean":"2023-10-10T21:03:14.049176+0000","last_became_active":"2023-10-10T21:03:14.042566+0000","last_became_peered":"2023-10-10T21:03:14.042566+0000","last_unstale":"2023-10-10T21:03:14.049176+0000","last_undegraded":"2023-10-10T21:03:14.049176+0000","last_fullsized":"2023-10-10T21:03:14.049176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:52:06.924993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042832+0000","last_change":"2023-10-10T21:03:12.878371+0000","last_active":"2023-10-10T21:03:14.042832+0000","last_peered":"2023-10-10T21:03:14.042832+0000","last_clean":"2023-10-10T21:03:14.042832+0000","last_became_active":"2023-10-10T21:03:12.877211+0000","last_became_peered":"2023-10-10T21:03:12.877211+0000","last_unstale":"2023-10-10T21:03:14.042832+0000","last_undegraded":"2023-10-10T21:03:14.042832+0000","last_fullsized":"2023-10-10T21:03:14.042832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052009+0000","last_change":"2023-10-10T21:03:14.048715+0000","last_active":"2023-10-10T21:03:14.052009+0000","last_peered":"2023-10-10T21:03:14.052009+0000","last_clean":"2023-10-10T21:03:14.052009+0000","last_became_active":"2023-10-10T21:03:14.048368+0000","last_became_peered":"2023-10-10T21:03:14.048368+0000","last_unstale":"2023-10-10T21:03:14.052009+0000","last_undegraded":"2023-10-10T21:03:14.052009+0000","last_fullsized":"2023-10-10T21:03:14.052009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:24.484818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067381+0000","last_change":"2023-10-10T21:03:12.889604+0000","last_active":"2023-10-10T21:03:14.067381+0000","last_peered":"2023-10-10T21:03:14.067381+0000","last_clean":"2023-10-10T21:03:14.067381+0000","last_became_active":"2023-10-10T21:03:12.889318+0000","last_became_peered":"2023-10-10T21:03:12.889318+0000","last_unstale":"2023-10-10T21:03:14.067381+0000","last_undegraded":"2023-10-10T21:03:14.067381+0000","last_fullsized":"2023-10-10T21:03:14.067381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:56.187027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053273+0000","last_change":"2023-10-10T21:03:14.044469+0000","last_active":"2023-10-10T21:03:14.053273+0000","last_peered":"2023-10-10T21:03:14.053273+0000","last_clean":"2023-10-10T21:03:14.053273+0000","last_became_active":"2023-10-10T21:03:14.044184+0000","last_became_peered":"2023-10-10T21:03:14.044184+0000","last_unstale":"2023-10-10T21:03:14.053273+0000","last_undegraded":"2023-10-10T21:03:14.053273+0000","last_fullsized":"2023-10-10T21:03:14.053273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.071982+0000","last_change":"2023-10-10T21:03:12.889551+0000","last_active":"2023-10-10T21:03:14.071982+0000","last_peered":"2023-10-10T21:03:14.071982+0000","last_clean":"2023-10-10T21:03:14.071982+0000","last_became_active":"2023-10-10T21:03:12.889403+0000","last_became_peered":"2023-10-10T21:03:12.889403+0000","last_unstale":"2023-10-10T21:03:14.071982+0000","last_undegraded":"2023-10-10T21:03:14.071982+0000","last_fullsized":"2023-10-10T21:03:14.071982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:51.756377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061355+0000","last_change":"2023-10-10T21:03:14.058577+0000","last_active":"2023-10-10T21:03:14.061355+0000","last_peered":"2023-10-10T21:03:14.061355+0000","last_clean":"2023-10-10T21:03:14.061355+0000","last_became_active":"2023-10-10T21:03:14.058273+0000","last_became_peered":"2023-10-10T21:03:14.058273+0000","last_unstale":"2023-10-10T21:03:14.061355+0000","last_undegraded":"2023-10-10T21:03:14.061355+0000","last_fullsized":"2023-10-10T21:03:14.061355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:24.406776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.072476+0000","last_change":"2023-10-10T21:03:12.890175+0000","last_active":"2023-10-10T21:03:14.072476+0000","last_peered":"2023-10-10T21:03:14.072476+0000","last_clean":"2023-10-10T21:03:14.072476+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:14.072476+0000","last_undegraded":"2023-10-10T21:03:14.072476+0000","last_fullsized":"2023-10-10T21:03:14.072476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:33:56.307223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053204+0000","last_change":"2023-10-10T21:03:14.051416+0000","last_active":"2023-10-10T21:03:14.053204+0000","last_peered":"2023-10-10T21:03:14.053204+0000","last_clean":"2023-10-10T21:03:14.053204+0000","last_became_active":"2023-10-10T21:03:14.051158+0000","last_became_peered":"2023-10-10T21:03:14.051158+0000","last_unstale":"2023-10-10T21:03:14.053204+0000","last_undegraded":"2023-10-10T21:03:14.053204+0000","last_fullsized":"2023-10-10T21:03:14.053204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:56:07.307802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036503+0000","last_change":"2023-10-10T21:03:12.885659+0000","last_active":"2023-10-10T21:03:14.036503+0000","last_peered":"2023-10-10T21:03:14.036503+0000","last_clean":"2023-10-10T21:03:14.036503+0000","last_became_active":"2023-10-10T21:03:12.885443+0000","last_became_peered":"2023-10-10T21:03:12.885443+0000","last_unstale":"2023-10-10T21:03:14.036503+0000","last_undegraded":"2023-10-10T21:03:14.036503+0000","last_fullsized":"2023-10-10T21:03:14.036503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:47:05.333687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058689+0000","last_change":"2023-10-10T21:03:14.055943+0000","last_active":"2023-10-10T21:03:14.058689+0000","last_peered":"2023-10-10T21:03:14.058689+0000","last_clean":"2023-10-10T21:03:14.058689+0000","last_became_active":"2023-10-10T21:03:14.055642+0000","last_became_peered":"2023-10-10T21:03:14.055642+0000","last_unstale":"2023-10-10T21:03:14.058689+0000","last_undegraded":"2023-10-10T21:03:14.058689+0000","last_fullsized":"2023-10-10T21:03:14.058689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.031839+0000","last_change":"2023-10-10T21:03:12.887903+0000","last_active":"2023-10-10T21:03:14.031839+0000","last_peered":"2023-10-10T21:03:14.031839+0000","last_clean":"2023-10-10T21:03:14.031839+0000","last_became_active":"2023-10-10T21:03:12.887627+0000","last_became_peered":"2023-10-10T21:03:12.887627+0000","last_unstale":"2023-10-10T21:03:14.031839+0000","last_undegraded":"2023-10-10T21:03:14.031839+0000","last_fullsized":"2023-10-10T21:03:14.031839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:29:42.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064097+0000","last_change":"2023-10-10T21:03:14.060118+0000","last_active":"2023-10-10T21:03:14.064097+0000","last_peered":"2023-10-10T21:03:14.064097+0000","last_clean":"2023-10-10T21:03:14.064097+0000","last_became_active":"2023-10-10T21:03:14.059845+0000","last_became_peered":"2023-10-10T21:03:14.059845+0000","last_unstale":"2023-10-10T21:03:14.064097+0000","last_undegraded":"2023-10-10T21:03:14.064097+0000","last_fullsized":"2023-10-10T21:03:14.064097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070192+0000","last_change":"2023-10-10T21:03:12.889578+0000","last_active":"2023-10-10T21:03:14.070192+0000","last_peered":"2023-10-10T21:03:14.070192+0000","last_clean":"2023-10-10T21:03:14.070192+0000","last_became_active":"2023-10-10T21:03:12.889368+0000","last_became_peered":"2023-10-10T21:03:12.889368+0000","last_unstale":"2023-10-10T21:03:14.070192+0000","last_undegraded":"2023-10-10T21:03:14.070192+0000","last_fullsized":"2023-10-10T21:03:14.070192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:24:05.169073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055292+0000","last_change":"2023-10-10T21:03:14.051228+0000","last_active":"2023-10-10T21:03:14.055292+0000","last_peered":"2023-10-10T21:03:14.055292+0000","last_clean":"2023-10-10T21:03:14.055292+0000","last_became_active":"2023-10-10T21:03:14.050931+0000","last_became_peered":"2023-10-10T21:03:14.050931+0000","last_unstale":"2023-10-10T21:03:14.055292+0000","last_undegraded":"2023-10-10T21:03:14.055292+0000","last_fullsized":"2023-10-10T21:03:14.055292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070819+0000","last_change":"2023-10-10T21:03:12.886478+0000","last_active":"2023-10-10T21:03:14.070819+0000","last_peered":"2023-10-10T21:03:14.070819+0000","last_clean":"2023-10-10T21:03:14.070819+0000","last_became_active":"2023-10-10T21:03:12.886128+0000","last_became_peered":"2023-10-10T21:03:12.886128+0000","last_unstale":"2023-10-10T21:03:14.070819+0000","last_undegraded":"2023-10-10T21:03:14.070819+0000","last_fullsized":"2023-10-10T21:03:14.070819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058959+0000","last_change":"2023-10-10T21:03:14.055709+0000","last_active":"2023-10-10T21:03:14.058959+0000","last_peered":"2023-10-10T21:03:14.058959+0000","last_clean":"2023-10-10T21:03:14.058959+0000","last_became_active":"2023-10-10T21:03:14.055452+0000","last_became_peered":"2023-10-10T21:03:14.055452+0000","last_unstale":"2023-10-10T21:03:14.058959+0000","last_undegraded":"2023-10-10T21:03:14.058959+0000","last_fullsized":"2023-10-10T21:03:14.058959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069997+0000","last_change":"2023-10-10T21:03:12.893952+0000","last_active":"2023-10-10T21:03:14.069997+0000","last_peered":"2023-10-10T21:03:14.069997+0000","last_clean":"2023-10-10T21:03:14.069997+0000","last_became_active":"2023-10-10T21:03:12.893610+0000","last_became_peered":"2023-10-10T21:03:12.893610+0000","last_unstale":"2023-10-10T21:03:14.069997+0000","last_undegraded":"2023-10-10T21:03:14.069997+0000","last_fullsized":"2023-10-10T21:03:14.069997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:09.534334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061304+0000","last_change":"2023-10-10T21:03:14.051290+0000","last_active":"2023-10-10T21:03:14.061304+0000","last_peered":"2023-10-10T21:03:14.061304+0000","last_clean":"2023-10-10T21:03:14.061304+0000","last_became_active":"2023-10-10T21:03:14.050996+0000","last_became_peered":"2023-10-10T21:03:14.050996+0000","last_unstale":"2023-10-10T21:03:14.061304+0000","last_undegraded":"2023-10-10T21:03:14.061304+0000","last_fullsized":"2023-10-10T21:03:14.061304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:31.597737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069611+0000","last_change":"2023-10-10T21:03:12.886527+0000","last_active":"2023-10-10T21:03:14.069611+0000","last_peered":"2023-10-10T21:03:14.069611+0000","last_clean":"2023-10-10T21:03:14.069611+0000","last_became_active":"2023-10-10T21:03:12.886243+0000","last_became_peered":"2023-10-10T21:03:12.886243+0000","last_unstale":"2023-10-10T21:03:14.069611+0000","last_undegraded":"2023-10-10T21:03:14.069611+0000","last_fullsized":"2023-10-10T21:03:14.069611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:46.323264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064868+0000","last_change":"2023-10-10T21:03:14.056497+0000","last_active":"2023-10-10T21:03:14.064868+0000","last_peered":"2023-10-10T21:03:14.064868+0000","last_clean":"2023-10-10T21:03:14.064868+0000","last_became_active":"2023-10-10T21:03:14.055367+0000","last_became_peered":"2023-10-10T21:03:14.055367+0000","last_unstale":"2023-10-10T21:03:14.064868+0000","last_undegraded":"2023-10-10T21:03:14.064868+0000","last_fullsized":"2023-10-10T21:03:14.064868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:34.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039649+0000","last_change":"2023-10-10T21:03:12.893029+0000","last_active":"2023-10-10T21:03:14.039649+0000","last_peered":"2023-10-10T21:03:14.039649+0000","last_clean":"2023-10-10T21:03:14.039649+0000","last_became_active":"2023-10-10T21:03:12.891259+0000","last_became_peered":"2023-10-10T21:03:12.891259+0000","last_unstale":"2023-10-10T21:03:14.039649+0000","last_undegraded":"2023-10-10T21:03:14.039649+0000","last_fullsized":"2023-10-10T21:03:14.039649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:44.279738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054116+0000","last_change":"2023-10-10T21:03:14.050667+0000","last_active":"2023-10-10T21:03:14.054116+0000","last_peered":"2023-10-10T21:03:14.054116+0000","last_clean":"2023-10-10T21:03:14.054116+0000","last_became_active":"2023-10-10T21:03:14.050399+0000","last_became_peered":"2023-10-10T21:03:14.050399+0000","last_unstale":"2023-10-10T21:03:14.054116+0000","last_undegraded":"2023-10-10T21:03:14.054116+0000","last_fullsized":"2023-10-10T21:03:14.054116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:24.498631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069657+0000","last_change":"2023-10-10T21:03:12.887639+0000","last_active":"2023-10-10T21:03:14.069657+0000","last_peered":"2023-10-10T21:03:14.069657+0000","last_clean":"2023-10-10T21:03:14.069657+0000","last_became_active":"2023-10-10T21:03:12.887398+0000","last_became_peered":"2023-10-10T21:03:12.887398+0000","last_unstale":"2023-10-10T21:03:14.069657+0000","last_undegraded":"2023-10-10T21:03:14.069657+0000","last_fullsized":"2023-10-10T21:03:14.069657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056449+0000","last_change":"2023-10-10T21:03:14.055555+0000","last_active":"2023-10-10T21:03:14.056449+0000","last_peered":"2023-10-10T21:03:14.056449+0000","last_clean":"2023-10-10T21:03:14.056449+0000","last_became_active":"2023-10-10T21:03:14.055241+0000","last_became_peered":"2023-10-10T21:03:14.055241+0000","last_unstale":"2023-10-10T21:03:14.056449+0000","last_undegraded":"2023-10-10T21:03:14.056449+0000","last_fullsized":"2023-10-10T21:03:14.056449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:04:04.186366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.038214+0000","last_change":"2023-10-10T21:03:12.889436+0000","last_active":"2023-10-10T21:03:14.038214+0000","last_peered":"2023-10-10T21:03:14.038214+0000","last_clean":"2023-10-10T21:03:14.038214+0000","last_became_active":"2023-10-10T21:03:12.889179+0000","last_became_peered":"2023-10-10T21:03:12.889179+0000","last_unstale":"2023-10-10T21:03:14.038214+0000","last_undegraded":"2023-10-10T21:03:14.038214+0000","last_fullsized":"2023-10-10T21:03:14.038214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.060011+0000","last_change":"2023-10-10T21:03:14.055915+0000","last_active":"2023-10-10T21:03:14.060011+0000","last_peered":"2023-10-10T21:03:14.060011+0000","last_clean":"2023-10-10T21:03:14.060011+0000","last_became_active":"2023-10-10T21:03:14.055646+0000","last_became_peered":"2023-10-10T21:03:14.055646+0000","last_unstale":"2023-10-10T21:03:14.060011+0000","last_undegraded":"2023-10-10T21:03:14.060011+0000","last_fullsized":"2023-10-10T21:03:14.060011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:42.622301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036674+0000","last_change":"2023-10-10T21:03:12.889430+0000","last_active":"2023-10-10T21:03:14.036674+0000","last_peered":"2023-10-10T21:03:14.036674+0000","last_clean":"2023-10-10T21:03:14.036674+0000","last_became_active":"2023-10-10T21:03:12.889154+0000","last_became_peered":"2023-10-10T21:03:12.889154+0000","last_unstale":"2023-10-10T21:03:14.036674+0000","last_undegraded":"2023-10-10T21:03:14.036674+0000","last_fullsized":"2023-10-10T21:03:14.036674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:14:09.052129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.051140+0000","last_change":"2023-10-10T21:03:14.048739+0000","last_active":"2023-10-10T21:03:14.051140+0000","last_peered":"2023-10-10T21:03:14.051140+0000","last_clean":"2023-10-10T21:03:14.051140+0000","last_became_active":"2023-10-10T21:03:14.048495+0000","last_became_peered":"2023-10-10T21:03:14.048495+0000","last_unstale":"2023-10-10T21:03:14.051140+0000","last_undegraded":"2023-10-10T21:03:14.051140+0000","last_fullsized":"2023-10-10T21:03:14.051140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.034542+0000","last_change":"2023-10-10T21:03:12.892718+0000","last_active":"2023-10-10T21:03:14.034542+0000","last_peered":"2023-10-10T21:03:14.034542+0000","last_clean":"2023-10-10T21:03:14.034542+0000","last_became_active":"2023-10-10T21:03:12.892352+0000","last_became_peered":"2023-10-10T21:03:12.892352+0000","last_unstale":"2023-10-10T21:03:14.034542+0000","last_undegraded":"2023-10-10T21:03:14.034542+0000","last_fullsized":"2023-10-10T21:03:14.034542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:03.334271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065829+0000","last_change":"2023-10-10T21:03:14.057428+0000","last_active":"2023-10-10T21:03:14.065829+0000","last_peered":"2023-10-10T21:03:14.065829+0000","last_clean":"2023-10-10T21:03:14.065829+0000","last_became_active":"2023-10-10T21:03:14.057133+0000","last_became_peered":"2023-10-10T21:03:14.057133+0000","last_unstale":"2023-10-10T21:03:14.065829+0000","last_undegraded":"2023-10-10T21:03:14.065829+0000","last_fullsized":"2023-10-10T21:03:14.065829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:23.301810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.073007+0000","last_change":"2023-10-10T21:03:12.886199+0000","last_active":"2023-10-10T21:03:14.073007+0000","last_peered":"2023-10-10T21:03:14.073007+0000","last_clean":"2023-10-10T21:03:14.073007+0000","last_became_active":"2023-10-10T21:03:12.885314+0000","last_became_peered":"2023-10-10T21:03:12.885314+0000","last_unstale":"2023-10-10T21:03:14.073007+0000","last_undegraded":"2023-10-10T21:03:14.073007+0000","last_fullsized":"2023-10-10T21:03:14.073007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053426+0000","last_change":"2023-10-10T21:03:14.046810+0000","last_active":"2023-10-10T21:03:14.053426+0000","last_peered":"2023-10-10T21:03:14.053426+0000","last_clean":"2023-10-10T21:03:14.053426+0000","last_became_active":"2023-10-10T21:03:14.046576+0000","last_became_peered":"2023-10-10T21:03:14.046576+0000","last_unstale":"2023-10-10T21:03:14.053426+0000","last_undegraded":"2023-10-10T21:03:14.053426+0000","last_fullsized":"2023-10-10T21:03:14.053426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:31:32.365391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042962+0000","last_change":"2023-10-10T21:03:12.886933+0000","last_active":"2023-10-10T21:03:14.042962+0000","last_peered":"2023-10-10T21:03:14.042962+0000","last_clean":"2023-10-10T21:03:14.042962+0000","last_became_active":"2023-10-10T21:03:12.886619+0000","last_became_peered":"2023-10-10T21:03:12.886619+0000","last_unstale":"2023-10-10T21:03:14.042962+0000","last_undegraded":"2023-10-10T21:03:14.042962+0000","last_fullsized":"2023-10-10T21:03:14.042962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065807+0000","last_change":"2023-10-10T21:03:14.062440+0000","last_active":"2023-10-10T21:03:14.065807+0000","last_peered":"2023-10-10T21:03:14.065807+0000","last_clean":"2023-10-10T21:03:14.065807+0000","last_became_active":"2023-10-10T21:03:14.062114+0000","last_became_peered":"2023-10-10T21:03:14.062114+0000","last_unstale":"2023-10-10T21:03:14.065807+0000","last_undegraded":"2023-10-10T21:03:14.065807+0000","last_fullsized":"2023-10-10T21:03:14.065807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036103+0000","last_change":"2023-10-10T21:03:12.885411+0000","last_active":"2023-10-10T21:03:14.036103+0000","last_peered":"2023-10-10T21:03:14.036103+0000","last_clean":"2023-10-10T21:03:14.036103+0000","last_became_active":"2023-10-10T21:03:12.885150+0000","last_became_peered":"2023-10-10T21:03:12.885150+0000","last_unstale":"2023-10-10T21:03:14.036103+0000","last_undegraded":"2023-10-10T21:03:14.036103+0000","last_fullsized":"2023-10-10T21:03:14.036103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053780+0000","last_change":"2023-10-10T21:03:14.045941+0000","last_active":"2023-10-10T21:03:14.053780+0000","last_peered":"2023-10-10T21:03:14.053780+0000","last_clean":"2023-10-10T21:03:14.053780+0000","last_became_active":"2023-10-10T21:03:14.045645+0000","last_became_peered":"2023-10-10T21:03:14.045645+0000","last_unstale":"2023-10-10T21:03:14.053780+0000","last_undegraded":"2023-10-10T21:03:14.053780+0000","last_fullsized":"2023-10-10T21:03:14.053780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042227+0000","last_change":"2023-10-10T21:03:12.883422+0000","last_active":"2023-10-10T21:03:14.042227+0000","last_peered":"2023-10-10T21:03:14.042227+0000","last_clean":"2023-10-10T21:03:14.042227+0000","last_became_active":"2023-10-10T21:03:12.883097+0000","last_became_peered":"2023-10-10T21:03:12.883097+0000","last_unstale":"2023-10-10T21:03:14.042227+0000","last_undegraded":"2023-10-10T21:03:14.042227+0000","last_fullsized":"2023-10-10T21:03:14.042227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:48:17.863125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056720+0000","last_change":"2023-10-10T21:03:14.054395+0000","last_active":"2023-10-10T21:03:14.056720+0000","last_peered":"2023-10-10T21:03:14.056720+0000","last_clean":"2023-10-10T21:03:14.056720+0000","last_became_active":"2023-10-10T21:03:14.054139+0000","last_became_peered":"2023-10-10T21:03:14.054139+0000","last_unstale":"2023-10-10T21:03:14.056720+0000","last_undegraded":"2023-10-10T21:03:14.056720+0000","last_fullsized":"2023-10-10T21:03:14.056720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036411+0000","last_change":"2023-10-10T21:03:12.888523+0000","last_active":"2023-10-10T21:03:14.036411+0000","last_peered":"2023-10-10T21:03:14.036411+0000","last_clean":"2023-10-10T21:03:14.036411+0000","last_became_active":"2023-10-10T21:03:12.888220+0000","last_became_peered":"2023-10-10T21:03:12.888220+0000","last_unstale":"2023-10-10T21:03:14.036411+0000","last_undegraded":"2023-10-10T21:03:14.036411+0000","last_fullsized":"2023-10-10T21:03:14.036411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049138+0000","last_change":"2023-10-10T21:03:14.042177+0000","last_active":"2023-10-10T21:03:14.049138+0000","last_peered":"2023-10-10T21:03:14.049138+0000","last_clean":"2023-10-10T21:03:14.049138+0000","last_became_active":"2023-10-10T21:03:14.041934+0000","last_became_peered":"2023-10-10T21:03:14.041934+0000","last_unstale":"2023-10-10T21:03:14.049138+0000","last_undegraded":"2023-10-10T21:03:14.049138+0000","last_fullsized":"2023-10-10T21:03:14.049138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:48.535655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036675+0000","last_change":"2023-10-10T21:03:12.885959+0000","last_active":"2023-10-10T21:03:14.036675+0000","last_peered":"2023-10-10T21:03:14.036675+0000","last_clean":"2023-10-10T21:03:14.036675+0000","last_became_active":"2023-10-10T21:03:12.885624+0000","last_became_peered":"2023-10-10T21:03:12.885624+0000","last_unstale":"2023-10-10T21:03:14.036675+0000","last_undegraded":"2023-10-10T21:03:14.036675+0000","last_fullsized":"2023-10-10T21:03:14.036675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:23:43.708965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055334+0000","last_change":"2023-10-10T21:03:14.049917+0000","last_active":"2023-10-10T21:03:14.055334+0000","last_peered":"2023-10-10T21:03:14.055334+0000","last_clean":"2023-10-10T21:03:14.055334+0000","last_became_active":"2023-10-10T21:03:14.049674+0000","last_became_peered":"2023-10-10T21:03:14.049674+0000","last_unstale":"2023-10-10T21:03:14.055334+0000","last_undegraded":"2023-10-10T21:03:14.055334+0000","last_fullsized":"2023-10-10T21:03:14.055334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.032000+0000","last_change":"2023-10-10T21:03:12.892061+0000","last_active":"2023-10-10T21:03:14.032000+0000","last_peered":"2023-10-10T21:03:14.032000+0000","last_clean":"2023-10-10T21:03:14.032000+0000","last_became_active":"2023-10-10T21:03:12.891773+0000","last_became_peered":"2023-10-10T21:03:12.891773+0000","last_unstale":"2023-10-10T21:03:14.032000+0000","last_undegraded":"2023-10-10T21:03:14.032000+0000","last_fullsized":"2023-10-10T21:03:14.032000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:33.298861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057642+0000","last_change":"2023-10-10T21:03:14.052143+0000","last_active":"2023-10-10T21:03:14.057642+0000","last_peered":"2023-10-10T21:03:14.057642+0000","last_clean":"2023-10-10T21:03:14.057642+0000","last_became_active":"2023-10-10T21:03:14.051884+0000","last_became_peered":"2023-10-10T21:03:14.051884+0000","last_unstale":"2023-10-10T21:03:14.057642+0000","last_undegraded":"2023-10-10T21:03:14.057642+0000","last_fullsized":"2023-10-10T21:03:14.057642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039181+0000","last_change":"2023-10-10T21:03:12.887792+0000","last_active":"2023-10-10T21:03:14.039181+0000","last_peered":"2023-10-10T21:03:14.039181+0000","last_clean":"2023-10-10T21:03:14.039181+0000","last_became_active":"2023-10-10T21:03:12.887523+0000","last_became_peered":"2023-10-10T21:03:12.887523+0000","last_unstale":"2023-10-10T21:03:14.039181+0000","last_undegraded":"2023-10-10T21:03:14.039181+0000","last_fullsized":"2023-10-10T21:03:14.039181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.040453+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:03:14.040453+0000","last_peered":"2023-10-10T21:03:14.040453+0000","last_clean":"2023-10-10T21:03:14.040453+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:03:14.040453+0000","last_undegraded":"2023-10-10T21:03:14.040453+0000","last_fullsized":"2023-10-10T21:03:14.040453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":148487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.5},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.41099999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.88}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.85699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.85199999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":731099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.622}]},{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.056}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.88}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":1.081}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.032}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":148487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.31}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.432},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.82799999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.68300000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073600,"statfs":{"total":96636764160,"available":96331366400,"internally_reserved":0,"allocated":974848,"data_stored":737297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.496},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.96099999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":140711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.627}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.71399999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.81399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.749},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82899999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.84499999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":8.9909999999999997},"last":0.82799999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.751}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":9.0250000000000004,"5min":9.0250000000000004,"15min":9.0250000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":8.8480000000000008,"5min":8.8480000000000008,"15min":8.8480000000000008},"last":0.85699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.79400000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.872}]},{"osd":1,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.94799999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.505}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.97899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.93300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:03:23.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:03:23.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.418+0000 7fb34bdff700 1 Processor -- start 2023-10-10T21:03:23.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.419+0000 7fb34bdff700 1 -- start start 2023-10-10T21:03:23.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.420+0000 7fb34bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440b1420 0x7fb3440ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.420+0000 7fb34bdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb3440ccf90 0x7fb3440c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.420+0000 7fb34bdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3440cc300 con 0x7fb3440cbf30 2023-10-10T21:03:23.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.420+0000 7fb34bdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb344156bf0 con 0x7fb3440ccf90 2023-10-10T21:03:23.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.420+0000 7fb34bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440ae950 con 0x7fb3440b1420 2023-10-10T21:03:23.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.420+0000 7fb349b9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb3440cbf30 0x7fb3440b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36780/0 (socket says 172.21.15.154:36780) 2023-10-10T21:03:23.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.420+0000 7fb349b9b700 1 -- 172.21.15.154:0/2681400483 learned_addr learned my addr 172.21.15.154:0/2681400483 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:23.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.420+0000 7fb34a39c700 1 --2- 172.21.15.154:0/2681400483 >> v2:172.21.15.179:3300/0 conn(0x7fb3440ccf90 0x7fb3440c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.420+0000 7fb34939a700 1 --2- 172.21.15.154:0/2681400483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440b1420 0x7fb3440ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb348b99700 1 -- 172.21.15.154:0/2681400483 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011130409 0 0) 0x7fb3440cc300 con 0x7fb3440cbf30 2023-10-10T21:03:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb348b99700 1 -- 172.21.15.154:0/2681400483 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb330003570 con 0x7fb3440cbf30 2023-10-10T21:03:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb348b99700 1 -- 172.21.15.154:0/2681400483 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1717161190 0 0) 0x7fb330003570 con 0x7fb3440cbf30 2023-10-10T21:03:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb34939a700 1 -- 172.21.15.154:0/2681400483 >> v2:172.21.15.179:3300/0 conn(0x7fb3440ccf90 msgr2=0x7fb3440c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:23.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb34939a700 1 --2- 172.21.15.154:0/2681400483 >> v2:172.21.15.179:3300/0 conn(0x7fb3440ccf90 0x7fb3440c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb34939a700 1 -- 172.21.15.154:0/2681400483 >> v1:172.21.15.154:6789/0 conn(0x7fb3440cbf30 legacy=0x7fb3440b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb34939a700 1 -- 172.21.15.154:0/2681400483 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3440ad370 con 0x7fb3440b1420 2023-10-10T21:03:23.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb34a39c700 1 --2- 172.21.15.154:0/2681400483 >> v2:172.21.15.179:3300/0 conn(0x7fb3440ccf90 0x7fb3440c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:23.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb34939a700 1 --2- 172.21.15.154:0/2681400483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440b1420 0x7fb3440ae410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3340098e0 tx=0x7fb3340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=677d54240c4a70ce server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.421+0000 7fb348b99700 1 -- 172.21.15.154:0/2681400483 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340001470 con 0x7fb3440b1420 2023-10-10T21:03:23.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb348b99700 1 -- 172.21.15.154:0/2681400483 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb334011420 con 0x7fb3440b1420 2023-10-10T21:03:23.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb348b99700 1 -- 172.21.15.154:0/2681400483 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3340117c0 con 0x7fb3440b1420 2023-10-10T21:03:23.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb34bdff700 1 -- 172.21.15.154:0/2681400483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440b1420 msgr2=0x7fb3440ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb34bdff700 1 --2- 172.21.15.154:0/2681400483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440b1420 0x7fb3440ae410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3340098e0 tx=0x7fb3340091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb34bdff700 1 -- 172.21.15.154:0/2681400483 shutdown_connections 2023-10-10T21:03:23.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb34bdff700 1 --2- 172.21.15.154:0/2681400483 >> v2:172.21.15.179:3300/0 conn(0x7fb3440ccf90 0x7fb3440c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb34bdff700 1 --2- 172.21.15.154:0/2681400483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440b1420 0x7fb3440ae410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb34bdff700 1 -- 172.21.15.154:0/2681400483 >> 172.21.15.154:0/2681400483 conn(0x7fb34406a320 msgr2=0x7fb3440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:23.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb34bdff700 1 -- 172.21.15.154:0/2681400483 shutdown_connections 2023-10-10T21:03:23.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.422+0000 7fb34bdff700 1 -- 172.21.15.154:0/2681400483 wait complete. 2023-10-10T21:03:23.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.424+0000 7fb34bdff700 1 Processor -- start 2023-10-10T21:03:23.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.424+0000 7fb34bdff700 1 -- start start 2023-10-10T21:03:23.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb34bdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3440b1420 0x7fb3440a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb34bdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3440cbf30 0x7fb344153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb34bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440ccf90 0x7fb3440cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb34bdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440a5a00 con 0x7fb3440b1420 2023-10-10T21:03:23.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb34bdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb344153740 con 0x7fb3440cbf30 2023-10-10T21:03:23.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb34bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440a63b0 con 0x7fb3440ccf90 2023-10-10T21:03:23.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb349b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3440b1420 0x7fb3440a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb349b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3440b1420 0x7fb3440a54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44692/0 (socket says 172.21.15.154:44692) 2023-10-10T21:03:23.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb349b9b700 1 -- 172.21.15.154:0/2963360085 learned_addr learned my addr 172.21.15.154:0/2963360085 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:23.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb349b9b700 1 -- 172.21.15.154:0/2963360085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440ccf90 msgr2=0x7fb3440cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb349b9b700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440ccf90 0x7fb3440cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb349b9b700 1 -- 172.21.15.154:0/2963360085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3440cbf30 msgr2=0x7fb344153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb349b9b700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3440cbf30 0x7fb344153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb349b9b700 1 -- 172.21.15.154:0/2963360085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c009a20 con 0x7fb3440b1420 2023-10-10T21:03:23.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.425+0000 7fb349b9b700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3440b1420 0x7fb3440a54c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb34000cb90 tx=0x7fb340001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:23.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.426+0000 7fb339ffb700 1 -- 172.21.15.154:0/2963360085 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340007360 con 0x7fb3440b1420 2023-10-10T21:03:23.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.426+0000 7fb339ffb700 1 -- 172.21.15.154:0/2963360085 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3400074e0 con 0x7fb3440b1420 2023-10-10T21:03:23.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.426+0000 7fb339ffb700 1 -- 172.21.15.154:0/2963360085 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340004830 con 0x7fb3440b1420 2023-10-10T21:03:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.426+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb334009420 con 0x7fb3440b1420 2023-10-10T21:03:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.426+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb344156ed0 con 0x7fb3440b1420 2023-10-10T21:03:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.427+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb344156d30 con 0x7fb3440b1420 2023-10-10T21:03:23.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.428+0000 7fb339ffb700 1 -- 172.21.15.154:0/2963360085 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb340004ba0 con 0x7fb3440b1420 2023-10-10T21:03:23.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.429+0000 7fb339ffb700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb328066f30 0x7fb3280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.429+0000 7fb339ffb700 1 -- 172.21.15.154:0/2963360085 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb340083f00 con 0x7fb3440b1420 2023-10-10T21:03:23.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.429+0000 7fb34939a700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb328066f30 0x7fb3280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.429+0000 7fb34939a700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb328066f30 0x7fb3280693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb3340091e0 tx=0x7fb334016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:23.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.433+0000 7fb339ffb700 1 -- 172.21.15.154:0/2963360085 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb344156d30 con 0x7fb3440b1420 2023-10-10T21:03:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.616+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb344156d30 con 0x7fb328066f30 2023-10-10T21:03:23.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.625+0000 7fb339ffb700 1 -- 172.21.15.154:0/2963360085 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288467 (secure 0 0 0) 0x7fb344156d30 con 0x7fb328066f30 2023-10-10T21:03:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:23.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb328066f30 msgr2=0x7fb3280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb328066f30 0x7fb3280693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb3340091e0 tx=0x7fb334016000 comp rx=0 tx=0).stop 2023-10-10T21:03:23.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3440b1420 msgr2=0x7fb3440a54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3440b1420 0x7fb3440a54c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb34000cb90 tx=0x7fb340001b50 comp rx=0 tx=0).stop 2023-10-10T21:03:23.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 shutdown_connections 2023-10-10T21:03:23.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb328066f30 0x7fb3280693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3440ccf90 0x7fb3440cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3440b1420 0x7fb3440a54c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 --2- 172.21.15.154:0/2963360085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3440cbf30 0x7fb344153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 >> 172.21.15.154:0/2963360085 conn(0x7fb34406a320 msgr2=0x7fb3440afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:23.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 shutdown_connections 2023-10-10T21:03:23.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.629+0000 7fb34bdff700 1 -- 172.21.15.154:0/2963360085 wait complete. 2023-10-10T21:03:23.634 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:03:23.648 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-10-10T21:03:21.866104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382480,"kb_used_data":4176,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592240,"statfs":{"total":773094113280,"available":770654453760,"internally_reserved":0,"allocated":4276224,"data_stored":2348204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001432"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058310+0000","last_change":"2023-10-10T21:03:14.056535+0000","last_active":"2023-10-10T21:03:14.058310+0000","last_peered":"2023-10-10T21:03:14.058310+0000","last_clean":"2023-10-10T21:03:14.058310+0000","last_became_active":"2023-10-10T21:03:14.056221+0000","last_became_peered":"2023-10-10T21:03:14.056221+0000","last_unstale":"2023-10-10T21:03:14.058310+0000","last_undegraded":"2023-10-10T21:03:14.058310+0000","last_fullsized":"2023-10-10T21:03:14.058310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053219+0000","last_change":"2023-10-10T21:03:14.050826+0000","last_active":"2023-10-10T21:03:14.053219+0000","last_peered":"2023-10-10T21:03:14.053219+0000","last_clean":"2023-10-10T21:03:14.053219+0000","last_became_active":"2023-10-10T21:03:14.050576+0000","last_became_peered":"2023-10-10T21:03:14.050576+0000","last_unstale":"2023-10-10T21:03:14.053219+0000","last_undegraded":"2023-10-10T21:03:14.053219+0000","last_fullsized":"2023-10-10T21:03:14.053219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:45:13.635574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053297+0000","last_change":"2023-10-10T21:03:14.044532+0000","last_active":"2023-10-10T21:03:14.053297+0000","last_peered":"2023-10-10T21:03:14.053297+0000","last_clean":"2023-10-10T21:03:14.053297+0000","last_became_active":"2023-10-10T21:03:14.044238+0000","last_became_peered":"2023-10-10T21:03:14.044238+0000","last_unstale":"2023-10-10T21:03:14.053297+0000","last_undegraded":"2023-10-10T21:03:14.053297+0000","last_fullsized":"2023-10-10T21:03:14.053297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:57:09.143759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061282+0000","last_change":"2023-10-10T21:03:14.050842+0000","last_active":"2023-10-10T21:03:14.061282+0000","last_peered":"2023-10-10T21:03:14.061282+0000","last_clean":"2023-10-10T21:03:14.061282+0000","last_became_active":"2023-10-10T21:03:14.050579+0000","last_became_peered":"2023-10-10T21:03:14.050579+0000","last_unstale":"2023-10-10T21:03:14.061282+0000","last_undegraded":"2023-10-10T21:03:14.061282+0000","last_fullsized":"2023-10-10T21:03:14.061282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049131+0000","last_change":"2023-10-10T21:03:14.046823+0000","last_active":"2023-10-10T21:03:14.049131+0000","last_peered":"2023-10-10T21:03:14.049131+0000","last_clean":"2023-10-10T21:03:14.049131+0000","last_became_active":"2023-10-10T21:03:14.046566+0000","last_became_peered":"2023-10-10T21:03:14.046566+0000","last_unstale":"2023-10-10T21:03:14.049131+0000","last_undegraded":"2023-10-10T21:03:14.049131+0000","last_fullsized":"2023-10-10T21:03:14.049131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.116595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.043708+0000","last_change":"2023-10-10T21:03:14.040008+0000","last_active":"2023-10-10T21:03:14.043708+0000","last_peered":"2023-10-10T21:03:14.043708+0000","last_clean":"2023-10-10T21:03:14.043708+0000","last_became_active":"2023-10-10T21:03:14.039725+0000","last_became_peered":"2023-10-10T21:03:14.039725+0000","last_unstale":"2023-10-10T21:03:14.043708+0000","last_undegraded":"2023-10-10T21:03:14.043708+0000","last_fullsized":"2023-10-10T21:03:14.043708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:33:29.937840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049955+0000","last_change":"2023-10-10T21:03:14.047991+0000","last_active":"2023-10-10T21:03:14.049955+0000","last_peered":"2023-10-10T21:03:14.049955+0000","last_clean":"2023-10-10T21:03:14.049955+0000","last_became_active":"2023-10-10T21:03:14.047702+0000","last_became_peered":"2023-10-10T21:03:14.047702+0000","last_unstale":"2023-10-10T21:03:14.049955+0000","last_undegraded":"2023-10-10T21:03:14.049955+0000","last_fullsized":"2023-10-10T21:03:14.049955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052555+0000","last_change":"2023-10-10T21:03:14.049953+0000","last_active":"2023-10-10T21:03:14.052555+0000","last_peered":"2023-10-10T21:03:14.052555+0000","last_clean":"2023-10-10T21:03:14.052555+0000","last_became_active":"2023-10-10T21:03:14.049549+0000","last_became_peered":"2023-10-10T21:03:14.049549+0000","last_unstale":"2023-10-10T21:03:14.052555+0000","last_undegraded":"2023-10-10T21:03:14.052555+0000","last_fullsized":"2023-10-10T21:03:14.052555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066618+0000","last_change":"2023-10-10T21:03:14.062596+0000","last_active":"2023-10-10T21:03:14.066618+0000","last_peered":"2023-10-10T21:03:14.066618+0000","last_clean":"2023-10-10T21:03:14.066618+0000","last_became_active":"2023-10-10T21:03:14.062296+0000","last_became_peered":"2023-10-10T21:03:14.062296+0000","last_unstale":"2023-10-10T21:03:14.066618+0000","last_undegraded":"2023-10-10T21:03:14.066618+0000","last_fullsized":"2023-10-10T21:03:14.066618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:58:45.241585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058876+0000","last_change":"2023-10-10T21:03:14.043250+0000","last_active":"2023-10-10T21:03:14.058876+0000","last_peered":"2023-10-10T21:03:14.058876+0000","last_clean":"2023-10-10T21:03:14.058876+0000","last_became_active":"2023-10-10T21:03:14.042985+0000","last_became_peered":"2023-10-10T21:03:14.042985+0000","last_unstale":"2023-10-10T21:03:14.058876+0000","last_undegraded":"2023-10-10T21:03:14.058876+0000","last_fullsized":"2023-10-10T21:03:14.058876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.066738+0000","last_change":"2023-10-10T21:03:14.060697+0000","last_active":"2023-10-10T21:03:14.066738+0000","last_peered":"2023-10-10T21:03:14.066738+0000","last_clean":"2023-10-10T21:03:14.066738+0000","last_became_active":"2023-10-10T21:03:14.060246+0000","last_became_peered":"2023-10-10T21:03:14.060246+0000","last_unstale":"2023-10-10T21:03:14.066738+0000","last_undegraded":"2023-10-10T21:03:14.066738+0000","last_fullsized":"2023-10-10T21:03:14.066738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053144+0000","last_change":"2023-10-10T21:03:14.041036+0000","last_active":"2023-10-10T21:03:14.053144+0000","last_peered":"2023-10-10T21:03:14.053144+0000","last_clean":"2023-10-10T21:03:14.053144+0000","last_became_active":"2023-10-10T21:03:14.040620+0000","last_became_peered":"2023-10-10T21:03:14.040620+0000","last_unstale":"2023-10-10T21:03:14.053144+0000","last_undegraded":"2023-10-10T21:03:14.053144+0000","last_fullsized":"2023-10-10T21:03:14.053144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049113+0000","last_change":"2023-10-10T21:03:14.046280+0000","last_active":"2023-10-10T21:03:14.049113+0000","last_peered":"2023-10-10T21:03:14.049113+0000","last_clean":"2023-10-10T21:03:14.049113+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.049113+0000","last_undegraded":"2023-10-10T21:03:14.049113+0000","last_fullsized":"2023-10-10T21:03:14.049113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:28.753153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052046+0000","last_change":"2023-10-10T21:03:14.048465+0000","last_active":"2023-10-10T21:03:14.052046+0000","last_peered":"2023-10-10T21:03:14.052046+0000","last_clean":"2023-10-10T21:03:14.052046+0000","last_became_active":"2023-10-10T21:03:14.048108+0000","last_became_peered":"2023-10-10T21:03:14.048108+0000","last_unstale":"2023-10-10T21:03:14.052046+0000","last_undegraded":"2023-10-10T21:03:14.052046+0000","last_fullsized":"2023-10-10T21:03:14.052046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:44.107832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054431+0000","last_change":"2023-10-10T21:03:14.049328+0000","last_active":"2023-10-10T21:03:14.054431+0000","last_peered":"2023-10-10T21:03:14.054431+0000","last_clean":"2023-10-10T21:03:14.054431+0000","last_became_active":"2023-10-10T21:03:14.048765+0000","last_became_peered":"2023-10-10T21:03:14.048765+0000","last_unstale":"2023-10-10T21:03:14.054431+0000","last_undegraded":"2023-10-10T21:03:14.054431+0000","last_fullsized":"2023-10-10T21:03:14.054431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:08.144185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057612+0000","last_change":"2023-10-10T21:03:14.051301+0000","last_active":"2023-10-10T21:03:14.057612+0000","last_peered":"2023-10-10T21:03:14.057612+0000","last_clean":"2023-10-10T21:03:14.057612+0000","last_became_active":"2023-10-10T21:03:14.050919+0000","last_became_peered":"2023-10-10T21:03:14.050919+0000","last_unstale":"2023-10-10T21:03:14.057612+0000","last_undegraded":"2023-10-10T21:03:14.057612+0000","last_fullsized":"2023-10-10T21:03:14.057612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049838+0000","last_change":"2023-10-10T21:03:14.047703+0000","last_active":"2023-10-10T21:03:14.049838+0000","last_peered":"2023-10-10T21:03:14.049838+0000","last_clean":"2023-10-10T21:03:14.049838+0000","last_became_active":"2023-10-10T21:03:14.047391+0000","last_became_peered":"2023-10-10T21:03:14.047391+0000","last_unstale":"2023-10-10T21:03:14.049838+0000","last_undegraded":"2023-10-10T21:03:14.049838+0000","last_fullsized":"2023-10-10T21:03:14.049838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049203+0000","last_change":"2023-10-10T21:03:14.041693+0000","last_active":"2023-10-10T21:03:14.049203+0000","last_peered":"2023-10-10T21:03:14.049203+0000","last_clean":"2023-10-10T21:03:14.049203+0000","last_became_active":"2023-10-10T21:03:14.041406+0000","last_became_peered":"2023-10-10T21:03:14.041406+0000","last_unstale":"2023-10-10T21:03:14.049203+0000","last_undegraded":"2023-10-10T21:03:14.049203+0000","last_fullsized":"2023-10-10T21:03:14.049203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:33:24.077138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049076+0000","last_change":"2023-10-10T21:03:14.042854+0000","last_active":"2023-10-10T21:03:14.049076+0000","last_peered":"2023-10-10T21:03:14.049076+0000","last_clean":"2023-10-10T21:03:14.049076+0000","last_became_active":"2023-10-10T21:03:14.042623+0000","last_became_peered":"2023-10-10T21:03:14.042623+0000","last_unstale":"2023-10-10T21:03:14.049076+0000","last_undegraded":"2023-10-10T21:03:14.049076+0000","last_fullsized":"2023-10-10T21:03:14.049076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:06:00.174080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065008+0000","last_change":"2023-10-10T21:03:14.057258+0000","last_active":"2023-10-10T21:03:14.065008+0000","last_peered":"2023-10-10T21:03:14.065008+0000","last_clean":"2023-10-10T21:03:14.065008+0000","last_became_active":"2023-10-10T21:03:14.057010+0000","last_became_peered":"2023-10-10T21:03:14.057010+0000","last_unstale":"2023-10-10T21:03:14.065008+0000","last_undegraded":"2023-10-10T21:03:14.065008+0000","last_fullsized":"2023-10-10T21:03:14.065008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:40:13.267887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056825+0000","last_change":"2023-10-10T21:03:14.052191+0000","last_active":"2023-10-10T21:03:14.056825+0000","last_peered":"2023-10-10T21:03:14.056825+0000","last_clean":"2023-10-10T21:03:14.056825+0000","last_became_active":"2023-10-10T21:03:14.051717+0000","last_became_peered":"2023-10-10T21:03:14.051717+0000","last_unstale":"2023-10-10T21:03:14.056825+0000","last_undegraded":"2023-10-10T21:03:14.056825+0000","last_fullsized":"2023-10-10T21:03:14.056825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056242+0000","last_change":"2023-10-10T21:03:14.050529+0000","last_active":"2023-10-10T21:03:14.056242+0000","last_peered":"2023-10-10T21:03:14.056242+0000","last_clean":"2023-10-10T21:03:14.056242+0000","last_became_active":"2023-10-10T21:03:14.050259+0000","last_became_peered":"2023-10-10T21:03:14.050259+0000","last_unstale":"2023-10-10T21:03:14.056242+0000","last_undegraded":"2023-10-10T21:03:14.056242+0000","last_fullsized":"2023-10-10T21:03:14.056242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056916+0000","last_change":"2023-10-10T21:03:14.053134+0000","last_active":"2023-10-10T21:03:14.056916+0000","last_peered":"2023-10-10T21:03:14.056916+0000","last_clean":"2023-10-10T21:03:14.056916+0000","last_became_active":"2023-10-10T21:03:14.052832+0000","last_became_peered":"2023-10-10T21:03:14.052832+0000","last_unstale":"2023-10-10T21:03:14.056916+0000","last_undegraded":"2023-10-10T21:03:14.056916+0000","last_fullsized":"2023-10-10T21:03:14.056916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055627+0000","last_change":"2023-10-10T21:03:14.054510+0000","last_active":"2023-10-10T21:03:14.055627+0000","last_peered":"2023-10-10T21:03:14.055627+0000","last_clean":"2023-10-10T21:03:14.055627+0000","last_became_active":"2023-10-10T21:03:14.053503+0000","last_became_peered":"2023-10-10T21:03:14.053503+0000","last_unstale":"2023-10-10T21:03:14.055627+0000","last_undegraded":"2023-10-10T21:03:14.055627+0000","last_fullsized":"2023-10-10T21:03:14.055627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:46:26.359132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061435+0000","last_change":"2023-10-10T21:03:14.053313+0000","last_active":"2023-10-10T21:03:14.061435+0000","last_peered":"2023-10-10T21:03:14.061435+0000","last_clean":"2023-10-10T21:03:14.061435+0000","last_became_active":"2023-10-10T21:03:14.053079+0000","last_became_peered":"2023-10-10T21:03:14.053079+0000","last_unstale":"2023-10-10T21:03:14.061435+0000","last_undegraded":"2023-10-10T21:03:14.061435+0000","last_fullsized":"2023-10-10T21:03:14.061435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056917+0000","last_change":"2023-10-10T21:03:14.052074+0000","last_active":"2023-10-10T21:03:14.056917+0000","last_peered":"2023-10-10T21:03:14.056917+0000","last_clean":"2023-10-10T21:03:14.056917+0000","last_became_active":"2023-10-10T21:03:14.051816+0000","last_became_peered":"2023-10-10T21:03:14.051816+0000","last_unstale":"2023-10-10T21:03:14.056917+0000","last_undegraded":"2023-10-10T21:03:14.056917+0000","last_fullsized":"2023-10-10T21:03:14.056917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:45.181361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061383+0000","last_change":"2023-10-10T21:03:14.050946+0000","last_active":"2023-10-10T21:03:14.061383+0000","last_peered":"2023-10-10T21:03:14.061383+0000","last_clean":"2023-10-10T21:03:14.061383+0000","last_became_active":"2023-10-10T21:03:14.050591+0000","last_became_peered":"2023-10-10T21:03:14.050591+0000","last_unstale":"2023-10-10T21:03:14.061383+0000","last_undegraded":"2023-10-10T21:03:14.061383+0000","last_fullsized":"2023-10-10T21:03:14.061383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:56.258834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053266+0000","last_change":"2023-10-10T21:03:14.045679+0000","last_active":"2023-10-10T21:03:14.053266+0000","last_peered":"2023-10-10T21:03:14.053266+0000","last_clean":"2023-10-10T21:03:14.053266+0000","last_became_active":"2023-10-10T21:03:14.045412+0000","last_became_peered":"2023-10-10T21:03:14.045412+0000","last_unstale":"2023-10-10T21:03:14.053266+0000","last_undegraded":"2023-10-10T21:03:14.053266+0000","last_fullsized":"2023-10-10T21:03:14.053266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:32.140258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056845+0000","last_change":"2023-10-10T21:03:14.054112+0000","last_active":"2023-10-10T21:03:14.056845+0000","last_peered":"2023-10-10T21:03:14.056845+0000","last_clean":"2023-10-10T21:03:14.056845+0000","last_became_active":"2023-10-10T21:03:14.052952+0000","last_became_peered":"2023-10-10T21:03:14.052952+0000","last_unstale":"2023-10-10T21:03:14.056845+0000","last_undegraded":"2023-10-10T21:03:14.056845+0000","last_fullsized":"2023-10-10T21:03:14.056845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:26.636321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052548+0000","last_change":"2023-10-10T21:03:14.049723+0000","last_active":"2023-10-10T21:03:14.052548+0000","last_peered":"2023-10-10T21:03:14.052548+0000","last_clean":"2023-10-10T21:03:14.052548+0000","last_became_active":"2023-10-10T21:03:14.049283+0000","last_became_peered":"2023-10-10T21:03:14.049283+0000","last_unstale":"2023-10-10T21:03:14.052548+0000","last_undegraded":"2023-10-10T21:03:14.052548+0000","last_fullsized":"2023-10-10T21:03:14.052548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:28:53.936301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054706+0000","last_change":"2023-10-10T21:03:14.051746+0000","last_active":"2023-10-10T21:03:14.054706+0000","last_peered":"2023-10-10T21:03:14.054706+0000","last_clean":"2023-10-10T21:03:14.054706+0000","last_became_active":"2023-10-10T21:03:14.051312+0000","last_became_peered":"2023-10-10T21:03:14.051312+0000","last_unstale":"2023-10-10T21:03:14.054706+0000","last_undegraded":"2023-10-10T21:03:14.054706+0000","last_fullsized":"2023-10-10T21:03:14.054706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058708+0000","last_change":"2023-10-10T21:03:14.056651+0000","last_active":"2023-10-10T21:03:14.058708+0000","last_peered":"2023-10-10T21:03:14.058708+0000","last_clean":"2023-10-10T21:03:14.058708+0000","last_became_active":"2023-10-10T21:03:14.056380+0000","last_became_peered":"2023-10-10T21:03:14.056380+0000","last_unstale":"2023-10-10T21:03:14.058708+0000","last_undegraded":"2023-10-10T21:03:14.058708+0000","last_fullsized":"2023-10-10T21:03:14.058708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:39:16.048053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056688+0000","last_change":"2023-10-10T21:03:14.052449+0000","last_active":"2023-10-10T21:03:14.056688+0000","last_peered":"2023-10-10T21:03:14.056688+0000","last_clean":"2023-10-10T21:03:14.056688+0000","last_became_active":"2023-10-10T21:03:14.052170+0000","last_became_peered":"2023-10-10T21:03:14.052170+0000","last_unstale":"2023-10-10T21:03:14.056688+0000","last_undegraded":"2023-10-10T21:03:14.056688+0000","last_fullsized":"2023-10-10T21:03:14.056688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070197+0000","last_change":"2023-10-10T21:03:12.887804+0000","last_active":"2023-10-10T21:03:14.070197+0000","last_peered":"2023-10-10T21:03:14.070197+0000","last_clean":"2023-10-10T21:03:14.070197+0000","last_became_active":"2023-10-10T21:03:12.886661+0000","last_became_peered":"2023-10-10T21:03:12.886661+0000","last_unstale":"2023-10-10T21:03:14.070197+0000","last_undegraded":"2023-10-10T21:03:14.070197+0000","last_fullsized":"2023-10-10T21:03:14.070197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:48.860387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056422+0000","last_change":"2023-10-10T21:03:14.055315+0000","last_active":"2023-10-10T21:03:14.056422+0000","last_peered":"2023-10-10T21:03:14.056422+0000","last_clean":"2023-10-10T21:03:14.056422+0000","last_became_active":"2023-10-10T21:03:14.055012+0000","last_became_peered":"2023-10-10T21:03:14.055012+0000","last_unstale":"2023-10-10T21:03:14.056422+0000","last_undegraded":"2023-10-10T21:03:14.056422+0000","last_fullsized":"2023-10-10T21:03:14.056422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067737+0000","last_change":"2023-10-10T21:03:12.891968+0000","last_active":"2023-10-10T21:03:14.067737+0000","last_peered":"2023-10-10T21:03:14.067737+0000","last_clean":"2023-10-10T21:03:14.067737+0000","last_became_active":"2023-10-10T21:03:12.891692+0000","last_became_peered":"2023-10-10T21:03:12.891692+0000","last_unstale":"2023-10-10T21:03:14.067737+0000","last_undegraded":"2023-10-10T21:03:14.067737+0000","last_fullsized":"2023-10-10T21:03:14.067737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055774+0000","last_change":"2023-10-10T21:03:14.052248+0000","last_active":"2023-10-10T21:03:14.055774+0000","last_peered":"2023-10-10T21:03:14.055774+0000","last_clean":"2023-10-10T21:03:14.055774+0000","last_became_active":"2023-10-10T21:03:14.051970+0000","last_became_peered":"2023-10-10T21:03:14.051970+0000","last_unstale":"2023-10-10T21:03:14.055774+0000","last_undegraded":"2023-10-10T21:03:14.055774+0000","last_fullsized":"2023-10-10T21:03:14.055774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:17:59.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069443+0000","last_change":"2023-10-10T21:03:12.890886+0000","last_active":"2023-10-10T21:03:14.069443+0000","last_peered":"2023-10-10T21:03:14.069443+0000","last_clean":"2023-10-10T21:03:14.069443+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:14.069443+0000","last_undegraded":"2023-10-10T21:03:14.069443+0000","last_fullsized":"2023-10-10T21:03:14.069443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:22:47.067057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061401+0000","last_change":"2023-10-10T21:03:14.058547+0000","last_active":"2023-10-10T21:03:14.061401+0000","last_peered":"2023-10-10T21:03:14.061401+0000","last_clean":"2023-10-10T21:03:14.061401+0000","last_became_active":"2023-10-10T21:03:14.058172+0000","last_became_peered":"2023-10-10T21:03:14.058172+0000","last_unstale":"2023-10-10T21:03:14.061401+0000","last_undegraded":"2023-10-10T21:03:14.061401+0000","last_fullsized":"2023-10-10T21:03:14.061401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:19.372198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.071334+0000","last_change":"2023-10-10T21:03:12.886500+0000","last_active":"2023-10-10T21:03:14.071334+0000","last_peered":"2023-10-10T21:03:14.071334+0000","last_clean":"2023-10-10T21:03:14.071334+0000","last_became_active":"2023-10-10T21:03:12.886219+0000","last_became_peered":"2023-10-10T21:03:12.886219+0000","last_unstale":"2023-10-10T21:03:14.071334+0000","last_undegraded":"2023-10-10T21:03:14.071334+0000","last_fullsized":"2023-10-10T21:03:14.071334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:12.688030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058736+0000","last_change":"2023-10-10T21:03:14.055102+0000","last_active":"2023-10-10T21:03:14.058736+0000","last_peered":"2023-10-10T21:03:14.058736+0000","last_clean":"2023-10-10T21:03:14.058736+0000","last_became_active":"2023-10-10T21:03:14.054774+0000","last_became_peered":"2023-10-10T21:03:14.054774+0000","last_unstale":"2023-10-10T21:03:14.058736+0000","last_undegraded":"2023-10-10T21:03:14.058736+0000","last_fullsized":"2023-10-10T21:03:14.058736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069543+0000","last_change":"2023-10-10T21:03:12.890962+0000","last_active":"2023-10-10T21:03:14.069543+0000","last_peered":"2023-10-10T21:03:14.069543+0000","last_clean":"2023-10-10T21:03:14.069543+0000","last_became_active":"2023-10-10T21:03:12.890574+0000","last_became_peered":"2023-10-10T21:03:12.890574+0000","last_unstale":"2023-10-10T21:03:14.069543+0000","last_undegraded":"2023-10-10T21:03:14.069543+0000","last_fullsized":"2023-10-10T21:03:14.069543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:14.768025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053330+0000","last_change":"2023-10-10T21:03:14.046246+0000","last_active":"2023-10-10T21:03:14.053330+0000","last_peered":"2023-10-10T21:03:14.053330+0000","last_clean":"2023-10-10T21:03:14.053330+0000","last_became_active":"2023-10-10T21:03:14.045997+0000","last_became_peered":"2023-10-10T21:03:14.045997+0000","last_unstale":"2023-10-10T21:03:14.053330+0000","last_undegraded":"2023-10-10T21:03:14.053330+0000","last_fullsized":"2023-10-10T21:03:14.053330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069582+0000","last_change":"2023-10-10T21:03:12.890898+0000","last_active":"2023-10-10T21:03:14.069582+0000","last_peered":"2023-10-10T21:03:14.069582+0000","last_clean":"2023-10-10T21:03:14.069582+0000","last_became_active":"2023-10-10T21:03:12.890638+0000","last_became_peered":"2023-10-10T21:03:12.890638+0000","last_unstale":"2023-10-10T21:03:14.069582+0000","last_undegraded":"2023-10-10T21:03:14.069582+0000","last_fullsized":"2023-10-10T21:03:14.069582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:50:30.753850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052328+0000","last_change":"2023-10-10T21:03:14.048312+0000","last_active":"2023-10-10T21:03:14.052328+0000","last_peered":"2023-10-10T21:03:14.052328+0000","last_clean":"2023-10-10T21:03:14.052328+0000","last_became_active":"2023-10-10T21:03:14.048046+0000","last_became_peered":"2023-10-10T21:03:14.048046+0000","last_unstale":"2023-10-10T21:03:14.052328+0000","last_undegraded":"2023-10-10T21:03:14.052328+0000","last_fullsized":"2023-10-10T21:03:14.052328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:04.337611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.031821+0000","last_change":"2023-10-10T21:03:12.881085+0000","last_active":"2023-10-10T21:03:14.031821+0000","last_peered":"2023-10-10T21:03:14.031821+0000","last_clean":"2023-10-10T21:03:14.031821+0000","last_became_active":"2023-10-10T21:03:12.880788+0000","last_became_peered":"2023-10-10T21:03:12.880788+0000","last_unstale":"2023-10-10T21:03:14.031821+0000","last_undegraded":"2023-10-10T21:03:14.031821+0000","last_fullsized":"2023-10-10T21:03:14.031821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:41:10.360039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.062294+0000","last_change":"2023-10-10T21:03:14.057908+0000","last_active":"2023-10-10T21:03:14.062294+0000","last_peered":"2023-10-10T21:03:14.062294+0000","last_clean":"2023-10-10T21:03:14.062294+0000","last_became_active":"2023-10-10T21:03:14.057554+0000","last_became_peered":"2023-10-10T21:03:14.057554+0000","last_unstale":"2023-10-10T21:03:14.062294+0000","last_undegraded":"2023-10-10T21:03:14.062294+0000","last_fullsized":"2023-10-10T21:03:14.062294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:31:30.818485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.035024+0000","last_change":"2023-10-10T21:03:12.889571+0000","last_active":"2023-10-10T21:03:14.035024+0000","last_peered":"2023-10-10T21:03:14.035024+0000","last_clean":"2023-10-10T21:03:14.035024+0000","last_became_active":"2023-10-10T21:03:12.888606+0000","last_became_peered":"2023-10-10T21:03:12.888606+0000","last_unstale":"2023-10-10T21:03:14.035024+0000","last_undegraded":"2023-10-10T21:03:14.035024+0000","last_fullsized":"2023-10-10T21:03:14.035024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:07:21.202825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053737+0000","last_change":"2023-10-10T21:03:14.040585+0000","last_active":"2023-10-10T21:03:14.053737+0000","last_peered":"2023-10-10T21:03:14.053737+0000","last_clean":"2023-10-10T21:03:14.053737+0000","last_became_active":"2023-10-10T21:03:14.040307+0000","last_became_peered":"2023-10-10T21:03:14.040307+0000","last_unstale":"2023-10-10T21:03:14.053737+0000","last_undegraded":"2023-10-10T21:03:14.053737+0000","last_fullsized":"2023-10-10T21:03:14.053737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.032521+0000","last_change":"2023-10-10T21:03:12.892185+0000","last_active":"2023-10-10T21:03:14.032521+0000","last_peered":"2023-10-10T21:03:14.032521+0000","last_clean":"2023-10-10T21:03:14.032521+0000","last_became_active":"2023-10-10T21:03:12.891846+0000","last_became_peered":"2023-10-10T21:03:12.891846+0000","last_unstale":"2023-10-10T21:03:14.032521+0000","last_undegraded":"2023-10-10T21:03:14.032521+0000","last_fullsized":"2023-10-10T21:03:14.032521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:11.747446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049176+0000","last_change":"2023-10-10T21:03:14.042823+0000","last_active":"2023-10-10T21:03:14.049176+0000","last_peered":"2023-10-10T21:03:14.049176+0000","last_clean":"2023-10-10T21:03:14.049176+0000","last_became_active":"2023-10-10T21:03:14.042566+0000","last_became_peered":"2023-10-10T21:03:14.042566+0000","last_unstale":"2023-10-10T21:03:14.049176+0000","last_undegraded":"2023-10-10T21:03:14.049176+0000","last_fullsized":"2023-10-10T21:03:14.049176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:52:06.924993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042832+0000","last_change":"2023-10-10T21:03:12.878371+0000","last_active":"2023-10-10T21:03:14.042832+0000","last_peered":"2023-10-10T21:03:14.042832+0000","last_clean":"2023-10-10T21:03:14.042832+0000","last_became_active":"2023-10-10T21:03:12.877211+0000","last_became_peered":"2023-10-10T21:03:12.877211+0000","last_unstale":"2023-10-10T21:03:14.042832+0000","last_undegraded":"2023-10-10T21:03:14.042832+0000","last_fullsized":"2023-10-10T21:03:14.042832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.052009+0000","last_change":"2023-10-10T21:03:14.048715+0000","last_active":"2023-10-10T21:03:14.052009+0000","last_peered":"2023-10-10T21:03:14.052009+0000","last_clean":"2023-10-10T21:03:14.052009+0000","last_became_active":"2023-10-10T21:03:14.048368+0000","last_became_peered":"2023-10-10T21:03:14.048368+0000","last_unstale":"2023-10-10T21:03:14.052009+0000","last_undegraded":"2023-10-10T21:03:14.052009+0000","last_fullsized":"2023-10-10T21:03:14.052009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:24.484818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.067381+0000","last_change":"2023-10-10T21:03:12.889604+0000","last_active":"2023-10-10T21:03:14.067381+0000","last_peered":"2023-10-10T21:03:14.067381+0000","last_clean":"2023-10-10T21:03:14.067381+0000","last_became_active":"2023-10-10T21:03:12.889318+0000","last_became_peered":"2023-10-10T21:03:12.889318+0000","last_unstale":"2023-10-10T21:03:14.067381+0000","last_undegraded":"2023-10-10T21:03:14.067381+0000","last_fullsized":"2023-10-10T21:03:14.067381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:56.187027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053273+0000","last_change":"2023-10-10T21:03:14.044469+0000","last_active":"2023-10-10T21:03:14.053273+0000","last_peered":"2023-10-10T21:03:14.053273+0000","last_clean":"2023-10-10T21:03:14.053273+0000","last_became_active":"2023-10-10T21:03:14.044184+0000","last_became_peered":"2023-10-10T21:03:14.044184+0000","last_unstale":"2023-10-10T21:03:14.053273+0000","last_undegraded":"2023-10-10T21:03:14.053273+0000","last_fullsized":"2023-10-10T21:03:14.053273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:06.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.071982+0000","last_change":"2023-10-10T21:03:12.889551+0000","last_active":"2023-10-10T21:03:14.071982+0000","last_peered":"2023-10-10T21:03:14.071982+0000","last_clean":"2023-10-10T21:03:14.071982+0000","last_became_active":"2023-10-10T21:03:12.889403+0000","last_became_peered":"2023-10-10T21:03:12.889403+0000","last_unstale":"2023-10-10T21:03:14.071982+0000","last_undegraded":"2023-10-10T21:03:14.071982+0000","last_fullsized":"2023-10-10T21:03:14.071982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:51.756377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061355+0000","last_change":"2023-10-10T21:03:14.058577+0000","last_active":"2023-10-10T21:03:14.061355+0000","last_peered":"2023-10-10T21:03:14.061355+0000","last_clean":"2023-10-10T21:03:14.061355+0000","last_became_active":"2023-10-10T21:03:14.058273+0000","last_became_peered":"2023-10-10T21:03:14.058273+0000","last_unstale":"2023-10-10T21:03:14.061355+0000","last_undegraded":"2023-10-10T21:03:14.061355+0000","last_fullsized":"2023-10-10T21:03:14.061355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:24.406776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.072476+0000","last_change":"2023-10-10T21:03:12.890175+0000","last_active":"2023-10-10T21:03:14.072476+0000","last_peered":"2023-10-10T21:03:14.072476+0000","last_clean":"2023-10-10T21:03:14.072476+0000","last_became_active":"2023-10-10T21:03:12.889918+0000","last_became_peered":"2023-10-10T21:03:12.889918+0000","last_unstale":"2023-10-10T21:03:14.072476+0000","last_undegraded":"2023-10-10T21:03:14.072476+0000","last_fullsized":"2023-10-10T21:03:14.072476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:33:56.307223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053204+0000","last_change":"2023-10-10T21:03:14.051416+0000","last_active":"2023-10-10T21:03:14.053204+0000","last_peered":"2023-10-10T21:03:14.053204+0000","last_clean":"2023-10-10T21:03:14.053204+0000","last_became_active":"2023-10-10T21:03:14.051158+0000","last_became_peered":"2023-10-10T21:03:14.051158+0000","last_unstale":"2023-10-10T21:03:14.053204+0000","last_undegraded":"2023-10-10T21:03:14.053204+0000","last_fullsized":"2023-10-10T21:03:14.053204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:56:07.307802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036503+0000","last_change":"2023-10-10T21:03:12.885659+0000","last_active":"2023-10-10T21:03:14.036503+0000","last_peered":"2023-10-10T21:03:14.036503+0000","last_clean":"2023-10-10T21:03:14.036503+0000","last_became_active":"2023-10-10T21:03:12.885443+0000","last_became_peered":"2023-10-10T21:03:12.885443+0000","last_unstale":"2023-10-10T21:03:14.036503+0000","last_undegraded":"2023-10-10T21:03:14.036503+0000","last_fullsized":"2023-10-10T21:03:14.036503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:47:05.333687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058689+0000","last_change":"2023-10-10T21:03:14.055943+0000","last_active":"2023-10-10T21:03:14.058689+0000","last_peered":"2023-10-10T21:03:14.058689+0000","last_clean":"2023-10-10T21:03:14.058689+0000","last_became_active":"2023-10-10T21:03:14.055642+0000","last_became_peered":"2023-10-10T21:03:14.055642+0000","last_unstale":"2023-10-10T21:03:14.058689+0000","last_undegraded":"2023-10-10T21:03:14.058689+0000","last_fullsized":"2023-10-10T21:03:14.058689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:58:28.718136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.031839+0000","last_change":"2023-10-10T21:03:12.887903+0000","last_active":"2023-10-10T21:03:14.031839+0000","last_peered":"2023-10-10T21:03:14.031839+0000","last_clean":"2023-10-10T21:03:14.031839+0000","last_became_active":"2023-10-10T21:03:12.887627+0000","last_became_peered":"2023-10-10T21:03:12.887627+0000","last_unstale":"2023-10-10T21:03:14.031839+0000","last_undegraded":"2023-10-10T21:03:14.031839+0000","last_fullsized":"2023-10-10T21:03:14.031839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:29:42.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064097+0000","last_change":"2023-10-10T21:03:14.060118+0000","last_active":"2023-10-10T21:03:14.064097+0000","last_peered":"2023-10-10T21:03:14.064097+0000","last_clean":"2023-10-10T21:03:14.064097+0000","last_became_active":"2023-10-10T21:03:14.059845+0000","last_became_peered":"2023-10-10T21:03:14.059845+0000","last_unstale":"2023-10-10T21:03:14.064097+0000","last_undegraded":"2023-10-10T21:03:14.064097+0000","last_fullsized":"2023-10-10T21:03:14.064097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070192+0000","last_change":"2023-10-10T21:03:12.889578+0000","last_active":"2023-10-10T21:03:14.070192+0000","last_peered":"2023-10-10T21:03:14.070192+0000","last_clean":"2023-10-10T21:03:14.070192+0000","last_became_active":"2023-10-10T21:03:12.889368+0000","last_became_peered":"2023-10-10T21:03:12.889368+0000","last_unstale":"2023-10-10T21:03:14.070192+0000","last_undegraded":"2023-10-10T21:03:14.070192+0000","last_fullsized":"2023-10-10T21:03:14.070192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:24:05.169073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055292+0000","last_change":"2023-10-10T21:03:14.051228+0000","last_active":"2023-10-10T21:03:14.055292+0000","last_peered":"2023-10-10T21:03:14.055292+0000","last_clean":"2023-10-10T21:03:14.055292+0000","last_became_active":"2023-10-10T21:03:14.050931+0000","last_became_peered":"2023-10-10T21:03:14.050931+0000","last_unstale":"2023-10-10T21:03:14.055292+0000","last_undegraded":"2023-10-10T21:03:14.055292+0000","last_fullsized":"2023-10-10T21:03:14.055292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.070819+0000","last_change":"2023-10-10T21:03:12.886478+0000","last_active":"2023-10-10T21:03:14.070819+0000","last_peered":"2023-10-10T21:03:14.070819+0000","last_clean":"2023-10-10T21:03:14.070819+0000","last_became_active":"2023-10-10T21:03:12.886128+0000","last_became_peered":"2023-10-10T21:03:12.886128+0000","last_unstale":"2023-10-10T21:03:14.070819+0000","last_undegraded":"2023-10-10T21:03:14.070819+0000","last_fullsized":"2023-10-10T21:03:14.070819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:07:57.165436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.058959+0000","last_change":"2023-10-10T21:03:14.055709+0000","last_active":"2023-10-10T21:03:14.058959+0000","last_peered":"2023-10-10T21:03:14.058959+0000","last_clean":"2023-10-10T21:03:14.058959+0000","last_became_active":"2023-10-10T21:03:14.055452+0000","last_became_peered":"2023-10-10T21:03:14.055452+0000","last_unstale":"2023-10-10T21:03:14.058959+0000","last_undegraded":"2023-10-10T21:03:14.058959+0000","last_fullsized":"2023-10-10T21:03:14.058959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:31.629254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069997+0000","last_change":"2023-10-10T21:03:12.893952+0000","last_active":"2023-10-10T21:03:14.069997+0000","last_peered":"2023-10-10T21:03:14.069997+0000","last_clean":"2023-10-10T21:03:14.069997+0000","last_became_active":"2023-10-10T21:03:12.893610+0000","last_became_peered":"2023-10-10T21:03:12.893610+0000","last_unstale":"2023-10-10T21:03:14.069997+0000","last_undegraded":"2023-10-10T21:03:14.069997+0000","last_fullsized":"2023-10-10T21:03:14.069997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:09.534334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.061304+0000","last_change":"2023-10-10T21:03:14.051290+0000","last_active":"2023-10-10T21:03:14.061304+0000","last_peered":"2023-10-10T21:03:14.061304+0000","last_clean":"2023-10-10T21:03:14.061304+0000","last_became_active":"2023-10-10T21:03:14.050996+0000","last_became_peered":"2023-10-10T21:03:14.050996+0000","last_unstale":"2023-10-10T21:03:14.061304+0000","last_undegraded":"2023-10-10T21:03:14.061304+0000","last_fullsized":"2023-10-10T21:03:14.061304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:31.597737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069611+0000","last_change":"2023-10-10T21:03:12.886527+0000","last_active":"2023-10-10T21:03:14.069611+0000","last_peered":"2023-10-10T21:03:14.069611+0000","last_clean":"2023-10-10T21:03:14.069611+0000","last_became_active":"2023-10-10T21:03:12.886243+0000","last_became_peered":"2023-10-10T21:03:12.886243+0000","last_unstale":"2023-10-10T21:03:14.069611+0000","last_undegraded":"2023-10-10T21:03:14.069611+0000","last_fullsized":"2023-10-10T21:03:14.069611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:46.323264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.064868+0000","last_change":"2023-10-10T21:03:14.056497+0000","last_active":"2023-10-10T21:03:14.064868+0000","last_peered":"2023-10-10T21:03:14.064868+0000","last_clean":"2023-10-10T21:03:14.064868+0000","last_became_active":"2023-10-10T21:03:14.055367+0000","last_became_peered":"2023-10-10T21:03:14.055367+0000","last_unstale":"2023-10-10T21:03:14.064868+0000","last_undegraded":"2023-10-10T21:03:14.064868+0000","last_fullsized":"2023-10-10T21:03:14.064868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:34.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039649+0000","last_change":"2023-10-10T21:03:12.893029+0000","last_active":"2023-10-10T21:03:14.039649+0000","last_peered":"2023-10-10T21:03:14.039649+0000","last_clean":"2023-10-10T21:03:14.039649+0000","last_became_active":"2023-10-10T21:03:12.891259+0000","last_became_peered":"2023-10-10T21:03:12.891259+0000","last_unstale":"2023-10-10T21:03:14.039649+0000","last_undegraded":"2023-10-10T21:03:14.039649+0000","last_fullsized":"2023-10-10T21:03:14.039649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:44.279738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.054116+0000","last_change":"2023-10-10T21:03:14.050667+0000","last_active":"2023-10-10T21:03:14.054116+0000","last_peered":"2023-10-10T21:03:14.054116+0000","last_clean":"2023-10-10T21:03:14.054116+0000","last_became_active":"2023-10-10T21:03:14.050399+0000","last_became_peered":"2023-10-10T21:03:14.050399+0000","last_unstale":"2023-10-10T21:03:14.054116+0000","last_undegraded":"2023-10-10T21:03:14.054116+0000","last_fullsized":"2023-10-10T21:03:14.054116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:24.498631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.069657+0000","last_change":"2023-10-10T21:03:12.887639+0000","last_active":"2023-10-10T21:03:14.069657+0000","last_peered":"2023-10-10T21:03:14.069657+0000","last_clean":"2023-10-10T21:03:14.069657+0000","last_became_active":"2023-10-10T21:03:12.887398+0000","last_became_peered":"2023-10-10T21:03:12.887398+0000","last_unstale":"2023-10-10T21:03:14.069657+0000","last_undegraded":"2023-10-10T21:03:14.069657+0000","last_fullsized":"2023-10-10T21:03:14.069657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056449+0000","last_change":"2023-10-10T21:03:14.055555+0000","last_active":"2023-10-10T21:03:14.056449+0000","last_peered":"2023-10-10T21:03:14.056449+0000","last_clean":"2023-10-10T21:03:14.056449+0000","last_became_active":"2023-10-10T21:03:14.055241+0000","last_became_peered":"2023-10-10T21:03:14.055241+0000","last_unstale":"2023-10-10T21:03:14.056449+0000","last_undegraded":"2023-10-10T21:03:14.056449+0000","last_fullsized":"2023-10-10T21:03:14.056449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:04:04.186366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.038214+0000","last_change":"2023-10-10T21:03:12.889436+0000","last_active":"2023-10-10T21:03:14.038214+0000","last_peered":"2023-10-10T21:03:14.038214+0000","last_clean":"2023-10-10T21:03:14.038214+0000","last_became_active":"2023-10-10T21:03:12.889179+0000","last_became_peered":"2023-10-10T21:03:12.889179+0000","last_unstale":"2023-10-10T21:03:14.038214+0000","last_undegraded":"2023-10-10T21:03:14.038214+0000","last_fullsized":"2023-10-10T21:03:14.038214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.060011+0000","last_change":"2023-10-10T21:03:14.055915+0000","last_active":"2023-10-10T21:03:14.060011+0000","last_peered":"2023-10-10T21:03:14.060011+0000","last_clean":"2023-10-10T21:03:14.060011+0000","last_became_active":"2023-10-10T21:03:14.055646+0000","last_became_peered":"2023-10-10T21:03:14.055646+0000","last_unstale":"2023-10-10T21:03:14.060011+0000","last_undegraded":"2023-10-10T21:03:14.060011+0000","last_fullsized":"2023-10-10T21:03:14.060011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:42.622301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036674+0000","last_change":"2023-10-10T21:03:12.889430+0000","last_active":"2023-10-10T21:03:14.036674+0000","last_peered":"2023-10-10T21:03:14.036674+0000","last_clean":"2023-10-10T21:03:14.036674+0000","last_became_active":"2023-10-10T21:03:12.889154+0000","last_became_peered":"2023-10-10T21:03:12.889154+0000","last_unstale":"2023-10-10T21:03:14.036674+0000","last_undegraded":"2023-10-10T21:03:14.036674+0000","last_fullsized":"2023-10-10T21:03:14.036674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:14:09.052129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.051140+0000","last_change":"2023-10-10T21:03:14.048739+0000","last_active":"2023-10-10T21:03:14.051140+0000","last_peered":"2023-10-10T21:03:14.051140+0000","last_clean":"2023-10-10T21:03:14.051140+0000","last_became_active":"2023-10-10T21:03:14.048495+0000","last_became_peered":"2023-10-10T21:03:14.048495+0000","last_unstale":"2023-10-10T21:03:14.051140+0000","last_undegraded":"2023-10-10T21:03:14.051140+0000","last_fullsized":"2023-10-10T21:03:14.051140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:34.945016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.034542+0000","last_change":"2023-10-10T21:03:12.892718+0000","last_active":"2023-10-10T21:03:14.034542+0000","last_peered":"2023-10-10T21:03:14.034542+0000","last_clean":"2023-10-10T21:03:14.034542+0000","last_became_active":"2023-10-10T21:03:12.892352+0000","last_became_peered":"2023-10-10T21:03:12.892352+0000","last_unstale":"2023-10-10T21:03:14.034542+0000","last_undegraded":"2023-10-10T21:03:14.034542+0000","last_fullsized":"2023-10-10T21:03:14.034542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:03.334271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065829+0000","last_change":"2023-10-10T21:03:14.057428+0000","last_active":"2023-10-10T21:03:14.065829+0000","last_peered":"2023-10-10T21:03:14.065829+0000","last_clean":"2023-10-10T21:03:14.065829+0000","last_became_active":"2023-10-10T21:03:14.057133+0000","last_became_peered":"2023-10-10T21:03:14.057133+0000","last_unstale":"2023-10-10T21:03:14.065829+0000","last_undegraded":"2023-10-10T21:03:14.065829+0000","last_fullsized":"2023-10-10T21:03:14.065829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:23.301810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.073007+0000","last_change":"2023-10-10T21:03:12.886199+0000","last_active":"2023-10-10T21:03:14.073007+0000","last_peered":"2023-10-10T21:03:14.073007+0000","last_clean":"2023-10-10T21:03:14.073007+0000","last_became_active":"2023-10-10T21:03:12.885314+0000","last_became_peered":"2023-10-10T21:03:12.885314+0000","last_unstale":"2023-10-10T21:03:14.073007+0000","last_undegraded":"2023-10-10T21:03:14.073007+0000","last_fullsized":"2023-10-10T21:03:14.073007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053426+0000","last_change":"2023-10-10T21:03:14.046810+0000","last_active":"2023-10-10T21:03:14.053426+0000","last_peered":"2023-10-10T21:03:14.053426+0000","last_clean":"2023-10-10T21:03:14.053426+0000","last_became_active":"2023-10-10T21:03:14.046576+0000","last_became_peered":"2023-10-10T21:03:14.046576+0000","last_unstale":"2023-10-10T21:03:14.053426+0000","last_undegraded":"2023-10-10T21:03:14.053426+0000","last_fullsized":"2023-10-10T21:03:14.053426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:31:32.365391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042962+0000","last_change":"2023-10-10T21:03:12.886933+0000","last_active":"2023-10-10T21:03:14.042962+0000","last_peered":"2023-10-10T21:03:14.042962+0000","last_clean":"2023-10-10T21:03:14.042962+0000","last_became_active":"2023-10-10T21:03:12.886619+0000","last_became_peered":"2023-10-10T21:03:12.886619+0000","last_unstale":"2023-10-10T21:03:14.042962+0000","last_undegraded":"2023-10-10T21:03:14.042962+0000","last_fullsized":"2023-10-10T21:03:14.042962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.065807+0000","last_change":"2023-10-10T21:03:14.062440+0000","last_active":"2023-10-10T21:03:14.065807+0000","last_peered":"2023-10-10T21:03:14.065807+0000","last_clean":"2023-10-10T21:03:14.065807+0000","last_became_active":"2023-10-10T21:03:14.062114+0000","last_became_peered":"2023-10-10T21:03:14.062114+0000","last_unstale":"2023-10-10T21:03:14.065807+0000","last_undegraded":"2023-10-10T21:03:14.065807+0000","last_fullsized":"2023-10-10T21:03:14.065807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:57.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036103+0000","last_change":"2023-10-10T21:03:12.885411+0000","last_active":"2023-10-10T21:03:14.036103+0000","last_peered":"2023-10-10T21:03:14.036103+0000","last_clean":"2023-10-10T21:03:14.036103+0000","last_became_active":"2023-10-10T21:03:12.885150+0000","last_became_peered":"2023-10-10T21:03:12.885150+0000","last_unstale":"2023-10-10T21:03:14.036103+0000","last_undegraded":"2023-10-10T21:03:14.036103+0000","last_fullsized":"2023-10-10T21:03:14.036103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:09.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.053780+0000","last_change":"2023-10-10T21:03:14.045941+0000","last_active":"2023-10-10T21:03:14.053780+0000","last_peered":"2023-10-10T21:03:14.053780+0000","last_clean":"2023-10-10T21:03:14.053780+0000","last_became_active":"2023-10-10T21:03:14.045645+0000","last_became_peered":"2023-10-10T21:03:14.045645+0000","last_unstale":"2023-10-10T21:03:14.053780+0000","last_undegraded":"2023-10-10T21:03:14.053780+0000","last_fullsized":"2023-10-10T21:03:14.053780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:15.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.042227+0000","last_change":"2023-10-10T21:03:12.883422+0000","last_active":"2023-10-10T21:03:14.042227+0000","last_peered":"2023-10-10T21:03:14.042227+0000","last_clean":"2023-10-10T21:03:14.042227+0000","last_became_active":"2023-10-10T21:03:12.883097+0000","last_became_peered":"2023-10-10T21:03:12.883097+0000","last_unstale":"2023-10-10T21:03:14.042227+0000","last_undegraded":"2023-10-10T21:03:14.042227+0000","last_fullsized":"2023-10-10T21:03:14.042227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:48:17.863125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.056720+0000","last_change":"2023-10-10T21:03:14.054395+0000","last_active":"2023-10-10T21:03:14.056720+0000","last_peered":"2023-10-10T21:03:14.056720+0000","last_clean":"2023-10-10T21:03:14.056720+0000","last_became_active":"2023-10-10T21:03:14.054139+0000","last_became_peered":"2023-10-10T21:03:14.054139+0000","last_unstale":"2023-10-10T21:03:14.056720+0000","last_undegraded":"2023-10-10T21:03:14.056720+0000","last_fullsized":"2023-10-10T21:03:14.056720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036411+0000","last_change":"2023-10-10T21:03:12.888523+0000","last_active":"2023-10-10T21:03:14.036411+0000","last_peered":"2023-10-10T21:03:14.036411+0000","last_clean":"2023-10-10T21:03:14.036411+0000","last_became_active":"2023-10-10T21:03:12.888220+0000","last_became_peered":"2023-10-10T21:03:12.888220+0000","last_unstale":"2023-10-10T21:03:14.036411+0000","last_undegraded":"2023-10-10T21:03:14.036411+0000","last_fullsized":"2023-10-10T21:03:14.036411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:33.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.049138+0000","last_change":"2023-10-10T21:03:14.042177+0000","last_active":"2023-10-10T21:03:14.049138+0000","last_peered":"2023-10-10T21:03:14.049138+0000","last_clean":"2023-10-10T21:03:14.049138+0000","last_became_active":"2023-10-10T21:03:14.041934+0000","last_became_peered":"2023-10-10T21:03:14.041934+0000","last_unstale":"2023-10-10T21:03:14.049138+0000","last_undegraded":"2023-10-10T21:03:14.049138+0000","last_fullsized":"2023-10-10T21:03:14.049138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:48.535655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.036675+0000","last_change":"2023-10-10T21:03:12.885959+0000","last_active":"2023-10-10T21:03:14.036675+0000","last_peered":"2023-10-10T21:03:14.036675+0000","last_clean":"2023-10-10T21:03:14.036675+0000","last_became_active":"2023-10-10T21:03:12.885624+0000","last_became_peered":"2023-10-10T21:03:12.885624+0000","last_unstale":"2023-10-10T21:03:14.036675+0000","last_undegraded":"2023-10-10T21:03:14.036675+0000","last_fullsized":"2023-10-10T21:03:14.036675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:23:43.708965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.055334+0000","last_change":"2023-10-10T21:03:14.049917+0000","last_active":"2023-10-10T21:03:14.055334+0000","last_peered":"2023-10-10T21:03:14.055334+0000","last_clean":"2023-10-10T21:03:14.055334+0000","last_became_active":"2023-10-10T21:03:14.049674+0000","last_became_peered":"2023-10-10T21:03:14.049674+0000","last_unstale":"2023-10-10T21:03:14.055334+0000","last_undegraded":"2023-10-10T21:03:14.055334+0000","last_fullsized":"2023-10-10T21:03:14.055334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:15:15.693257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.032000+0000","last_change":"2023-10-10T21:03:12.892061+0000","last_active":"2023-10-10T21:03:14.032000+0000","last_peered":"2023-10-10T21:03:14.032000+0000","last_clean":"2023-10-10T21:03:14.032000+0000","last_became_active":"2023-10-10T21:03:12.891773+0000","last_became_peered":"2023-10-10T21:03:12.891773+0000","last_unstale":"2023-10-10T21:03:14.032000+0000","last_undegraded":"2023-10-10T21:03:14.032000+0000","last_fullsized":"2023-10-10T21:03:14.032000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:33.298861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.057642+0000","last_change":"2023-10-10T21:03:14.052143+0000","last_active":"2023-10-10T21:03:14.057642+0000","last_peered":"2023-10-10T21:03:14.057642+0000","last_clean":"2023-10-10T21:03:14.057642+0000","last_became_active":"2023-10-10T21:03:14.051884+0000","last_became_peered":"2023-10-10T21:03:14.051884+0000","last_unstale":"2023-10-10T21:03:14.057642+0000","last_undegraded":"2023-10-10T21:03:14.057642+0000","last_fullsized":"2023-10-10T21:03:14.057642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:12.860226+0000","last_clean_scrub_stamp":"2023-10-10T21:03:12.860226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:01:16.071225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.039181+0000","last_change":"2023-10-10T21:03:12.887792+0000","last_active":"2023-10-10T21:03:14.039181+0000","last_peered":"2023-10-10T21:03:14.039181+0000","last_clean":"2023-10-10T21:03:14.039181+0000","last_became_active":"2023-10-10T21:03:12.887523+0000","last_became_peered":"2023-10-10T21:03:12.887523+0000","last_unstale":"2023-10-10T21:03:14.039181+0000","last_undegraded":"2023-10-10T21:03:14.039181+0000","last_fullsized":"2023-10-10T21:03:14.039181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:03:11.856887+0000","last_clean_scrub_stamp":"2023-10-10T21:03:11.856887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:13.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-10T21:03:14.040453+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:03:14.040453+0000","last_peered":"2023-10-10T21:03:14.040453+0000","last_clean":"2023-10-10T21:03:14.040453+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:03:14.040453+0000","last_undegraded":"2023-10-10T21:03:14.040453+0000","last_fullsized":"2023-10-10T21:03:14.040453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":148487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.5},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.41099999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.88}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.85699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.85199999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":731099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.622}]},{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.056}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.88}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":1.081}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.032}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":397312,"data_stored":148487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.31}]},{"osd":2,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.432},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.82799999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.68300000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073600,"statfs":{"total":96636764160,"available":96331366400,"internally_reserved":0,"allocated":974848,"data_stored":737297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.496},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.96099999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":140711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.627}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.71399999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.81399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.749},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82899999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.84499999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":8.9909999999999997,"5min":8.9909999999999997,"15min":8.9909999999999997},"last":0.82799999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.751}]},{"osd":3,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":8.9309999999999992,"5min":8.9309999999999992,"15min":8.9309999999999992},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":9.0250000000000004,"5min":9.0250000000000004,"15min":9.0250000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":8.8480000000000008,"5min":8.8480000000000008,"15min":8.8480000000000008},"last":0.85699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.79400000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":147517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.872}]},{"osd":1,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.94799999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.505}]},{"osd":3,"last update":"Tue Oct 10 21:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.97899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.93300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:03:23.654 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T21:03:23.655 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T21:03:23.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.875+0000 7fe2e759e700 1 Processor -- start 2023-10-10T21:03:23.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.875+0000 7fe2e759e700 1 -- start start 2023-10-10T21:03:23.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.876+0000 7fe2e759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2e81563b0 0x7fe2e80ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.876+0000 7fe2e759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80ae9c0 0x7fe2e80cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.876+0000 7fe2e759e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e80cbe50 con 0x7fe2e8156780 2023-10-10T21:03:23.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.876+0000 7fe2e759e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e80cb370 con 0x7fe2e81563b0 2023-10-10T21:03:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.876+0000 7fe2e759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80cb650 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.876+0000 7fe2e659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2e81563b0 0x7fe2e80ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.876+0000 7fe2e5d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe2e8156780 0x7fe2e80ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36786/0 (socket says 172.21.15.154:36786) 2023-10-10T21:03:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.876+0000 7fe2e5d9b700 1 -- 172.21.15.154:0/212214482 learned_addr learned my addr 172.21.15.154:0/212214482 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e6d9d700 1 --2- 172.21.15.154:0/212214482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80ae9c0 0x7fe2e80cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e659c700 1 -- 172.21.15.154:0/212214482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80ae9c0 msgr2=0x7fe2e80cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e659c700 1 --2- 172.21.15.154:0/212214482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80ae9c0 0x7fe2e80cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e659c700 1 -- 172.21.15.154:0/212214482 >> v1:172.21.15.154:6789/0 conn(0x7fe2e8156780 legacy=0x7fe2e80ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e659c700 1 -- 172.21.15.154:0/212214482 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e80c6860 con 0x7fe2e81563b0 2023-10-10T21:03:23.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e559a700 1 -- 172.21.15.154:0/212214482 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318590470 0 0) 0x7fe2e80cbe50 con 0x7fe2e8156780 2023-10-10T21:03:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e659c700 1 --2- 172.21.15.154:0/212214482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e81563b0 0x7fe2e80ca7d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80098e0 tx=0x7fe2d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29793d8d878be13e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e559a700 1 -- 172.21.15.154:0/212214482 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8009e80 con 0x7fe2e81563b0 2023-10-10T21:03:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e559a700 1 -- 172.21.15.154:0/212214482 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d800b860 con 0x7fe2e81563b0 2023-10-10T21:03:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.877+0000 7fe2e559a700 1 -- 172.21.15.154:0/212214482 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800bbe0 con 0x7fe2e81563b0 2023-10-10T21:03:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.878+0000 7fe2e759e700 1 -- 172.21.15.154:0/212214482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e81563b0 msgr2=0x7fe2e80ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.878+0000 7fe2e759e700 1 --2- 172.21.15.154:0/212214482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e81563b0 0x7fe2e80ca7d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80098e0 tx=0x7fe2d80091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.878+0000 7fe2e759e700 1 -- 172.21.15.154:0/212214482 shutdown_connections 2023-10-10T21:03:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.878+0000 7fe2e759e700 1 --2- 172.21.15.154:0/212214482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80ae9c0 0x7fe2e80cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.878+0000 7fe2e759e700 1 --2- 172.21.15.154:0/212214482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e81563b0 0x7fe2e80ca7d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.878+0000 7fe2e759e700 1 -- 172.21.15.154:0/212214482 >> 172.21.15.154:0/212214482 conn(0x7fe2e8068e20 msgr2=0x7fe2e80cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.878+0000 7fe2e759e700 1 -- 172.21.15.154:0/212214482 shutdown_connections 2023-10-10T21:03:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.878+0000 7fe2e759e700 1 -- 172.21.15.154:0/212214482 wait complete. 2023-10-10T21:03:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.880+0000 7fe2e759e700 1 Processor -- start 2023-10-10T21:03:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.880+0000 7fe2e759e700 1 -- start start 2023-10-10T21:03:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e80ae9c0 0x7fe2e80c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e81563b0 0x7fe2e8152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2e8156780 0x7fe2e8167340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80c42f0 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80c3920 con 0x7fe2e8156780 2023-10-10T21:03:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8167e80 con 0x7fe2e81563b0 2023-10-10T21:03:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e80ae9c0 0x7fe2e80c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e80ae9c0 0x7fe2e80c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44704/0 (socket says 172.21.15.154:44704) 2023-10-10T21:03:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e659c700 1 -- 172.21.15.154:0/527452444 learned_addr learned my addr 172.21.15.154:0/527452444 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e5d9b700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e81563b0 0x7fe2e8152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e6d9d700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2e8156780 0x7fe2e8167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e659c700 1 -- 172.21.15.154:0/527452444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e81563b0 msgr2=0x7fe2e8152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e659c700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e81563b0 0x7fe2e8152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e659c700 1 -- 172.21.15.154:0/527452444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2e8156780 msgr2=0x7fe2e8167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e659c700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2e8156780 0x7fe2e8167340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e659c700 1 -- 172.21.15.154:0/527452444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8009420 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.881+0000 7fe2e5d9b700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e81563b0 0x7fe2e8152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.882+0000 7fe2e659c700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e80ae9c0 0x7fe2e80c3db0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8064f90 tx=0x7fe2d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.882+0000 7fe2d67fc700 1 -- 172.21.15.154:0/527452444 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800b9d0 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.882+0000 7fe2d67fc700 1 -- 172.21.15.154:0/527452444 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d800bb50 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.882+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e8168160 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.882+0000 7fe2d67fc700 1 -- 172.21.15.154:0/527452444 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8025670 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.882+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e80c35b0 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.883+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e804c3c0 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.884+0000 7fe2d67fc700 1 -- 172.21.15.154:0/527452444 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2d8023070 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.885+0000 7fe2d67fc700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe2c8066f30 0x7fe2c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:23.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.885+0000 7fe2d67fc700 1 -- 172.21.15.154:0/527452444 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2d8085c10 con 0x7fe2e80ae9c0 2023-10-10T21:03:23.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.885+0000 7fe2e5d9b700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe2c8066f30 0x7fe2c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:23.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.886+0000 7fe2e5d9b700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe2c8066f30 0x7fe2c80693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80ada00 tx=0x7fe2dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:23.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:23.889+0000 7fe2d67fc700 1 -- 172.21.15.154:0/527452444 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d8052e80 con 0x7fe2e80ae9c0 2023-10-10T21:03:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.156+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe2e80c6b40 con 0x7fe2e80ae9c0 2023-10-10T21:03:24.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.162+0000 7fe2d67fc700 1 -- 172.21.15.154:0/527452444 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe2d80564a0 con 0x7fe2e80ae9c0 2023-10-10T21:03:24.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.164+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe2c8066f30 msgr2=0x7fe2c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:24.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.164+0000 7fe2e759e700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe2c8066f30 0x7fe2c80693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80ada00 tx=0x7fe2dc009040 comp rx=0 tx=0).stop 2023-10-10T21:03:24.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.164+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e80ae9c0 msgr2=0x7fe2e80c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:24.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.164+0000 7fe2e759e700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e80ae9c0 0x7fe2e80c3db0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8064f90 tx=0x7fe2d8017000 comp rx=0 tx=0).stop 2023-10-10T21:03:24.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.165+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 shutdown_connections 2023-10-10T21:03:24.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.165+0000 7fe2e759e700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2e8156780 0x7fe2e8167340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.165+0000 7fe2e759e700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e80ae9c0 0x7fe2e80c3db0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.165+0000 7fe2e759e700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe2c8066f30 0x7fe2c80693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.165+0000 7fe2e759e700 1 --2- 172.21.15.154:0/527452444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e81563b0 0x7fe2e8152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.165+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 >> 172.21.15.154:0/527452444 conn(0x7fe2e8068e20 msgr2=0x7fe2e80c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:24.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.165+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 shutdown_connections 2023-10-10T21:03:24.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.165+0000 7fe2e759e700 1 -- 172.21.15.154:0/527452444 wait complete. 2023-10-10T21:03:24.169 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T21:03:24.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:03:24.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.364+0000 7f3d8e5ff700 1 Processor -- start 2023-10-10T21:03:24.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.364+0000 7f3d8e5ff700 1 -- start start 2023-10-10T21:03:24.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.366+0000 7f3d8e5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3d880b1c20 0x7f3d881572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:24.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.366+0000 7f3d8e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 0x7f3d880abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:24.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.366+0000 7f3d8e5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d88157c80 con 0x7f3d880b1850 2023-10-10T21:03:24.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.366+0000 7f3d8e5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8806fc30 con 0x7f3d880b1c20 2023-10-10T21:03:24.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.366+0000 7f3d8e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880cc260 con 0x7f3d88157820 2023-10-10T21:03:24.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.366+0000 7f3d7ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3d880b1c20 0x7f3d881572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:24.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.367+0000 7f3d8cb9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 0x7f3d880abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:24.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.367+0000 7f3d87fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3d880b1850 0x7f3d880ae680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:49228/0 (socket says 172.21.15.154:49228) 2023-10-10T21:03:24.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.367+0000 7f3d87fff700 1 -- 172.21.15.154:0/1052161090 learned_addr learned my addr 172.21.15.154:0/1052161090 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:24.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.367+0000 7f3d7ffff700 1 -- 172.21.15.154:0/1052161090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 msgr2=0x7f3d880abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:24.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.367+0000 7f3d7ffff700 1 --2- 172.21.15.154:0/1052161090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 0x7f3d880abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.367+0000 7f3d7ffff700 1 -- 172.21.15.154:0/1052161090 >> v1:172.21.15.179:6789/0 conn(0x7f3d880b1850 legacy=0x7f3d880ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:24.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.367+0000 7f3d7ffff700 1 -- 172.21.15.154:0/1052161090 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880cb300 con 0x7f3d880b1c20 2023-10-10T21:03:24.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.367+0000 7f3d877fe700 1 -- 172.21.15.154:0/1052161090 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041584876 0 0) 0x7f3d88157c80 con 0x7f3d880b1850 2023-10-10T21:03:24.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d7ffff700 1 --2- 172.21.15.154:0/1052161090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d880b1c20 0x7f3d881572e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d700098e0 tx=0x7f3d700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d507c0da8bf0f9aa server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:24.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d877fe700 1 -- 172.21.15.154:0/1052161090 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000b640 con 0x7f3d880b1c20 2023-10-10T21:03:24.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d877fe700 1 -- 172.21.15.154:0/1052161090 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7000b7a0 con 0x7f3d880b1c20 2023-10-10T21:03:24.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d877fe700 1 -- 172.21.15.154:0/1052161090 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000bb40 con 0x7f3d880b1c20 2023-10-10T21:03:24.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/1052161090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d880b1c20 msgr2=0x7f3d881572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:24.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d8e5ff700 1 --2- 172.21.15.154:0/1052161090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d880b1c20 0x7f3d881572e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d700098e0 tx=0x7f3d700091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/1052161090 shutdown_connections 2023-10-10T21:03:24.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d8e5ff700 1 --2- 172.21.15.154:0/1052161090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 0x7f3d880abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d8e5ff700 1 --2- 172.21.15.154:0/1052161090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d880b1c20 0x7f3d881572e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/1052161090 >> 172.21.15.154:0/1052161090 conn(0x7f3d8806a320 msgr2=0x7f3d880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:24.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/1052161090 shutdown_connections 2023-10-10T21:03:24.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.368+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/1052161090 wait complete. 2023-10-10T21:03:24.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.370+0000 7f3d8e5ff700 1 Processor -- start 2023-10-10T21:03:24.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.370+0000 7f3d8e5ff700 1 -- start start 2023-10-10T21:03:24.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d8e5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d880b1850 0x7f3d8816b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:24.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d8e5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d880b1c20 0x7f3d8815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:24.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d8e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 0x7f3d88150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:24.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d8e5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8816bd40 con 0x7f3d880b1c20 2023-10-10T21:03:24.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d8e5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88159f00 con 0x7f3d880b1850 2023-10-10T21:03:24.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d8e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8815a8d0 con 0x7f3d88157820 2023-10-10T21:03:24.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d880b1c20 0x7f3d8815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:24.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d880b1c20 0x7f3d8815a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44714/0 (socket says 172.21.15.154:44714) 2023-10-10T21:03:24.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d7ffff700 1 -- 172.21.15.154:0/34876787 learned_addr learned my addr 172.21.15.154:0/34876787 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:24.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d87fff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d880b1850 0x7f3d8816b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d8cb9c700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 0x7f3d88150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d7ffff700 1 -- 172.21.15.154:0/34876787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 msgr2=0x7f3d88150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d7ffff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 0x7f3d88150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d7ffff700 1 -- 172.21.15.154:0/34876787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d880b1850 msgr2=0x7f3d8816b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.371+0000 7f3d7ffff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d880b1850 0x7f3d8816b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.372+0000 7f3d7ffff700 1 -- 172.21.15.154:0/34876787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70009420 con 0x7f3d880b1c20 2023-10-10T21:03:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.372+0000 7f3d8cb9c700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 0x7f3d88150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.372+0000 7f3d7ffff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d880b1c20 0x7f3d8815a390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3d88064290 tx=0x7f3d70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.372+0000 7f3d84ff9700 1 -- 172.21.15.154:0/34876787 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70000d10 con 0x7f3d880b1c20 2023-10-10T21:03:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.372+0000 7f3d84ff9700 1 -- 172.21.15.154:0/34876787 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7000bb20 con 0x7f3d880b1c20 2023-10-10T21:03:24.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.372+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d881592f0 con 0x7f3d880b1c20 2023-10-10T21:03:24.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.372+0000 7f3d84ff9700 1 -- 172.21.15.154:0/34876787 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70011650 con 0x7f3d880b1c20 2023-10-10T21:03:24.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.372+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d881598b0 con 0x7f3d880b1c20 2023-10-10T21:03:24.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.373+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8815a090 con 0x7f3d880b1c20 2023-10-10T21:03:24.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.374+0000 7f3d84ff9700 1 -- 172.21.15.154:0/34876787 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d70011a00 con 0x7f3d880b1c20 2023-10-10T21:03:24.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.375+0000 7f3d84ff9700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3d68066f30 0x7f3d680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.375+0000 7f3d84ff9700 1 -- 172.21.15.154:0/34876787 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d70085c20 con 0x7f3d880b1c20 2023-10-10T21:03:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.375+0000 7f3d87fff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3d68066f30 0x7f3d680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.376+0000 7f3d87fff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3d68066f30 0x7f3d680693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d78007fd0 tx=0x7f3d78007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.379+0000 7f3d84ff9700 1 -- 172.21.15.154:0/34876787 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d70052df0 con 0x7f3d880b1c20 2023-10-10T21:03:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.612+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d8804c3c0 con 0x7f3d880b1c20 2023-10-10T21:03:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.613+0000 7f3d84ff9700 1 -- 172.21.15.154:0/34876787 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f3d70015090 con 0x7f3d880b1c20 2023-10-10T21:03:24.614 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:03:24.614 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/343222653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":343222653},{"type":"v1","addr":"172.21.15.154:6837","nonce":343222653}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2558521496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2558521496},{"type":"v1","addr":"172.21.15.179:6834","nonce":2558521496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3578232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3578232941},{"type":"v1","addr":"172.21.15.179:6835","nonce":3578232941}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:03:13.344673+0000","modified":"2023-10-10T21:03:17.047547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6836/2035241338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2035241338},{"type":"v1","addr":"172.21.15.154:6836","nonce":2035241338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-10T21:03:24.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3d68066f30 msgr2=0x7f3d680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:24.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3d68066f30 0x7f3d680693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d78007fd0 tx=0x7f3d78007d30 comp rx=0 tx=0).stop 2023-10-10T21:03:24.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d880b1c20 msgr2=0x7f3d8815a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:24.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d880b1c20 0x7f3d8815a390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3d88064290 tx=0x7f3d70017000 comp rx=0 tx=0).stop 2023-10-10T21:03:24.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 shutdown_connections 2023-10-10T21:03:24.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3d68066f30 0x7f3d680693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d88157820 0x7f3d88150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d880b1850 0x7f3d8816b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 --2- 172.21.15.154:0/34876787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d880b1c20 0x7f3d8815a390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 >> 172.21.15.154:0/34876787 conn(0x7f3d8806a320 msgr2=0x7f3d8806d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 shutdown_connections 2023-10-10T21:03:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:24.615+0000 7f3d8e5ff700 1 -- 172.21.15.154:0/34876787 wait complete. 2023-10-10T21:03:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 14 2023-10-10T21:03:25.036 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T21:03:13.344673+0000', 'modified': '2023-10-10T21:03:17.047547+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4905}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4905': {'gid': 4905, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6836/2035241338', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 2035241338}, {'type': 'v1', 'addr': '172.21.15.154:6836', 'nonce': 2035241338}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T21:03:25.037 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T21:03:25.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-10T21:03:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.222+0000 7f50eb19d700 1 Processor -- start 2023-10-10T21:03:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.222+0000 7f50eb19d700 1 -- start start 2023-10-10T21:03:25.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.223+0000 7f50eb19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e41597f0 0x7f50e40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.223+0000 7f50eb19d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e40b11d0 con 0x7f50e415d230 2023-10-10T21:03:25.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.223+0000 7f50eb19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e40b14b0 con 0x7f50e4159420 2023-10-10T21:03:25.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.223+0000 7f50eb19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40b1790 con 0x7f50e41597f0 2023-10-10T21:03:25.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.223+0000 7f50ea99c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f50e415d230 0x7f50e40b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36800/0 (socket says 172.21.15.154:36800) 2023-10-10T21:03:25.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.223+0000 7f50ea99c700 1 -- 172.21.15.154:0/2684077963 learned_addr learned my addr 172.21.15.154:0/2684077963 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:25.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e999a700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e41597f0 0x7f50e40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197527458 0 0) 0x7f50e40b11d0 con 0x7f50e415d230 2023-10-10T21:03:25.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d0003570 con 0x7f50e415d230 2023-10-10T21:03:25.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951133305 0 0) 0x7f50e40b14b0 con 0x7f50e4159420 2023-10-10T21:03:25.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e40b11d0 con 0x7f50e4159420 2023-10-10T21:03:25.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3606173267 0 0) 0x7f50d0003570 con 0x7f50e415d230 2023-10-10T21:03:25.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e41597f0 msgr2=0x7f50e40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e41597f0 0x7f50e40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 >> v1:172.21.15.179:6789/0 conn(0x7f50e4159420 legacy=0x7f50e40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40b1a70 con 0x7f50e415d230 2023-10-10T21:03:25.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f50dc0017f0 con 0x7f50e415d230 2023-10-10T21:03:25.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 >> v1:172.21.15.154:6789/0 conn(0x7f50e415d230 legacy=0x7f50e40b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50d0003c20 0x7f50d0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50d0004810 0x7f50d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40b1790 con 0x7f50d00051c0 2023-10-10T21:03:25.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d000c020 con 0x7f50d0004810 2023-10-10T21:03:25.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d000c1e0 con 0x7f50d0003c20 2023-10-10T21:03:25.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.224+0000 7f50e999a700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e41597f0 0x7f50e40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:25.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50ea99c700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50ea19b700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50d0003c20 0x7f50d0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50e999a700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50d0004810 0x7f50d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50ea99c700 1 -- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50d0003c20 msgr2=0x7f50d0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50ea99c700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50d0003c20 0x7f50d0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50ea99c700 1 -- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50d0004810 msgr2=0x7f50d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50ea99c700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50d0004810 0x7f50d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50ea99c700 1 -- 172.21.15.154:0/2684077963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0003570 con 0x7f50d00051c0 2023-10-10T21:03:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50e999a700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50d0004810 0x7f50d0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.225+0000 7f50ea99c700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50d000ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00a8d0 tx=0x7f50dc002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e73d4849374cc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0070d0 con 0x7f50d00051c0 2023-10-10T21:03:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc007230 con 0x7f50d00051c0 2023-10-10T21:03:25.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50e9199700 1 -- 172.21.15.154:0/2684077963 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0075f0 con 0x7f50d00051c0 2023-10-10T21:03:25.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50eb19d700 1 -- 172.21.15.154:0/2684077963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 msgr2=0x7f50d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50eb19d700 1 --2- 172.21.15.154:0/2684077963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50d000ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00a8d0 tx=0x7f50dc002190 comp rx=0 tx=0).stop 2023-10-10T21:03:25.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50ea99c700 1 -- 172.21.15.154:0/2684077963 reap_dead start 2023-10-10T21:03:25.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50eb19d700 1 -- 172.21.15.154:0/2684077963 shutdown_connections 2023-10-10T21:03:25.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50eb19d700 1 -- 172.21.15.154:0/2684077963 >> 172.21.15.154:0/2684077963 conn(0x7f50e40d0660 msgr2=0x7f50e40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:25.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50eb19d700 1 -- 172.21.15.154:0/2684077963 shutdown_connections 2023-10-10T21:03:25.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.226+0000 7f50eb19d700 1 -- 172.21.15.154:0/2684077963 wait complete. 2023-10-10T21:03:25.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.228+0000 7f50eb19d700 1 Processor -- start 2023-10-10T21:03:25.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.228+0000 7f50eb19d700 1 -- start start 2023-10-10T21:03:25.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50eb19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50e4155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50eb19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e41520c0 0x7f50e4152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50eb19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e4154750 0x7f50e4154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50eb19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4155b90 con 0x7f50d00051c0 2023-10-10T21:03:25.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50eb19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4152a70 con 0x7f50e41520c0 2023-10-10T21:03:25.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50eb19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4155dc0 con 0x7f50e4154750 2023-10-10T21:03:25.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50e4155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50e4155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44730/0 (socket says 172.21.15.154:44730) 2023-10-10T21:03:25.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea19b700 1 -- 172.21.15.154:0/3784698358 learned_addr learned my addr 172.21.15.154:0/3784698358 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:25.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50e999a700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e41520c0 0x7f50e4152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea99c700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e4154750 0x7f50e4154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea19b700 1 -- 172.21.15.154:0/3784698358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e4154750 msgr2=0x7f50e4154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea19b700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e4154750 0x7f50e4154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea19b700 1 -- 172.21.15.154:0/3784698358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e41520c0 msgr2=0x7f50e4152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea19b700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e41520c0 0x7f50e4152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea19b700 1 -- 172.21.15.154:0/3784698358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e41560a0 con 0x7f50d00051c0 2023-10-10T21:03:25.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea99c700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e4154750 0x7f50e4154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:25.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.229+0000 7f50ea19b700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50e4155650 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50e0002b50 tx=0x7f50e0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.230+0000 7f50da7fc700 1 -- 172.21.15.154:0/3784698358 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e000fa00 con 0x7f50d00051c0 2023-10-10T21:03:25.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.230+0000 7f50da7fc700 1 -- 172.21.15.154:0/3784698358 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e000fb80 con 0x7f50d00051c0 2023-10-10T21:03:25.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.230+0000 7f50eb19d700 1 -- 172.21.15.154:0/3784698358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e4156380 con 0x7f50d00051c0 2023-10-10T21:03:25.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.230+0000 7f50da7fc700 1 -- 172.21.15.154:0/3784698358 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00133f0 con 0x7f50d00051c0 2023-10-10T21:03:25.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.230+0000 7f50eb19d700 1 -- 172.21.15.154:0/3784698358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e4156940 con 0x7f50d00051c0 2023-10-10T21:03:25.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.233+0000 7f50da7fc700 1 -- 172.21.15.154:0/3784698358 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50e00137a0 con 0x7f50d00051c0 2023-10-10T21:03:25.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.234+0000 7f50da7fc700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f50c8066f30 0x7f50c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.234+0000 7f50da7fc700 1 -- 172.21.15.154:0/3784698358 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50e0084680 con 0x7f50d00051c0 2023-10-10T21:03:25.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.234+0000 7f50e999a700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f50c8066f30 0x7f50c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.234+0000 7f50e999a700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f50c8066f30 0x7f50c80693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50d40093f0 tx=0x7f50d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.235+0000 7f50fac18b80 1 Processor -- start 2023-10-10T21:03:25.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.236+0000 7f50fac18b80 1 -- start start 2023-10-10T21:03:25.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.236+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e3267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.236+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e2fa5f0 0x564e9e347850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.236+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fcb80 0x564e9e2fcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.236+0000 7f50fac18b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e253a70 con 0x564e9e347480 2023-10-10T21:03:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.236+0000 7f50fac18b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e251270 con 0x564e9e2fa5f0 2023-10-10T21:03:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.236+0000 7f50fac18b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e9e24d060 con 0x564e9e2fcb80 2023-10-10T21:03:25.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50ea19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e3267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50ea19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e3267d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44738/0 (socket says 172.21.15.154:44738) 2023-10-10T21:03:25.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50ea19b700 1 -- 172.21.15.154:0/505726172 learned_addr learned my addr 172.21.15.154:0/505726172 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:25.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50ea19b700 1 -- 172.21.15.154:0/505726172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fcb80 msgr2=0x564e9e2fcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50ea19b700 1 --2- 172.21.15.154:0/505726172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fcb80 0x564e9e2fcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50ea19b700 1 -- 172.21.15.154:0/505726172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e2fa5f0 msgr2=0x564e9e347850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50ea19b700 1 --2- 172.21.15.154:0/505726172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e2fa5f0 0x564e9e347850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50ea19b700 1 -- 172.21.15.154:0/505726172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9e0e7270 con 0x564e9e347480 2023-10-10T21:03:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50ea19b700 1 --2- 172.21.15.154:0/505726172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e3267d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50e0007fd0 tx=0x7f50e0082b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db03a82eae221bbb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50c77fe700 1 -- 172.21.15.154:0/505726172 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00555b0 con 0x564e9e347480 2023-10-10T21:03:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50c77fe700 1 -- 172.21.15.154:0/505726172 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e0058800 con 0x564e9e347480 2023-10-10T21:03:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.237+0000 7f50c77fe700 1 -- 172.21.15.154:0/505726172 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e005c550 con 0x564e9e347480 2023-10-10T21:03:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.238+0000 7f50fac18b80 1 -- 172.21.15.154:0/505726172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 msgr2=0x564e9e3267d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.238+0000 7f50fac18b80 1 --2- 172.21.15.154:0/505726172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e3267d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50e0007fd0 tx=0x7f50e0082b00 comp rx=0 tx=0).stop 2023-10-10T21:03:25.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.238+0000 7f50fac18b80 1 -- 172.21.15.154:0/505726172 shutdown_connections 2023-10-10T21:03:25.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.238+0000 7f50fac18b80 1 --2- 172.21.15.154:0/505726172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fcb80 0x564e9e2fcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.238+0000 7f50fac18b80 1 --2- 172.21.15.154:0/505726172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e3267d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.238+0000 7f50fac18b80 1 --2- 172.21.15.154:0/505726172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e2fa5f0 0x564e9e347850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.238+0000 7f50fac18b80 1 -- 172.21.15.154:0/505726172 >> 172.21.15.154:0/505726172 conn(0x564e9e2fe0c0 msgr2=0x564e9e2fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:25.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.238+0000 7f50fac18b80 1 -- 172.21.15.154:0/505726172 shutdown_connections 2023-10-10T21:03:25.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.238+0000 7f50fac18b80 1 -- 172.21.15.154:0/505726172 wait complete. 2023-10-10T21:03:25.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.239+0000 7f50fac18b80 1 -- start start 2023-10-10T21:03:25.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.239+0000 7f50fac18b80 1 Processor -- start 2023-10-10T21:03:25.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e346ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e32c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 0x564e9e32c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50fac18b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e1f8890 con 0x564e9e2fcb80 2023-10-10T21:03:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50fac18b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e213ea0 con 0x564e9e347480 2023-10-10T21:03:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50fac18b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e9e0cfe30 con 0x564e9e2fa5f0 2023-10-10T21:03:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50fac18b80 10 client.0 _ll_register_callbacks cb 0x564e9e2c02c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:03:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50e999a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e32c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50e999a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e32c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44752/0 (socket says 172.21.15.154:44752) 2023-10-10T21:03:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.240+0000 7f50e999a700 1 -- 172.21.15.154:0/2965493395 learned_addr learned my addr 172.21.15.154:0/2965493395 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50ea99c700 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 0x564e9e32c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50ea19b700 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e346ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50e999a700 1 -- 172.21.15.154:0/2965493395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 msgr2=0x564e9e346ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50e999a700 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e346ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50e999a700 1 -- 172.21.15.154:0/2965493395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 msgr2=0x564e9e32c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50e999a700 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 0x564e9e32c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50e999a700 1 -- 172.21.15.154:0/2965493395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e4156940 con 0x564e9e2fcb80 2023-10-10T21:03:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50ea99c700 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 0x564e9e32c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50e999a700 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e32c490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f50d4016510 tx=0x7f50d401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a406cc06e7110a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:03:25.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50c4ff9700 1 -- 172.21.15.154:0/2965493395 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4028070 con 0x564e9e2fcb80 2023-10-10T21:03:25.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50c4ff9700 1 -- 172.21.15.154:0/2965493395 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d4016e10 con 0x564e9e2fcb80 2023-10-10T21:03:25.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.241+0000 7f50fac18b80 1 -- 172.21.15.154:0/2965493395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e9e2f1cd0 con 0x564e9e2fcb80 2023-10-10T21:03:25.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50c4ff9700 1 -- 172.21.15.154:0/2965493395 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50d40157e0 con 0x564e9e2fcb80 2023-10-10T21:03:25.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50fac18b80 10 client.5109 fetch_fsmap learned FSMap version 14 2023-10-10T21:03:25.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50fac18b80 1 -- 172.21.15.154:0/2965493395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x564e9e089fe0 con 0x564e9e2fcb80 2023-10-10T21:03:25.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50c4ff9700 1 -- 172.21.15.154:0/2965493395 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e9e2f1cd0 con 0x564e9e2fcb80 2023-10-10T21:03:25.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50c4ff9700 1 -- 172.21.15.154:0/2965493395 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f50d402b020 con 0x564e9e2fcb80 2023-10-10T21:03:25.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50fac18b80 10 client.5109 fetch_fsmap finished waiting for FSMap version 14 2023-10-10T21:03:25.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50fac18b80 10 client.5109 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-10T21:03:25.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50fac18b80 20 client.5109 populate_metadata read hostname 'smithi154' 2023-10-10T21:03:25.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50fac18b80 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] conn(0x564e9e326d30 0x564e9e327100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50fac18b80 4 client.5109 mds_command: new command op to 4905 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T21:03:25.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50fac18b80 1 -- 172.21.15.154:0/2965493395 --> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e9e2ceaa0 con 0x564e9e326d30 2023-10-10T21:03:25.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.242+0000 7f50ea19b700 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] conn(0x564e9e326d30 0x564e9e327100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.243+0000 7f50ea19b700 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] conn(0x564e9e326d30 0x564e9e327100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db4724feca85b3f server_cookie=6507f939c8d826ff in_seq=0 out_seq=0 2023-10-10T21:03:25.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.243+0000 7f50c4ff9700 10 client.5109 ms_handle_connect on v2:172.21.15.154:6834/2035241338 2023-10-10T21:03:25.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.243+0000 7f50c4ff9700 1 -- 172.21.15.154:0/2965493395 <== mds.0 v2:172.21.15.154:6834/2035241338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564e9e2ceaa0 con 0x564e9e326d30 2023-10-10T21:03:25.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.243+0000 7f50c4ff9700 10 client.5109 handle_command_reply: tid=0 2023-10-10T21:03:25.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.243+0000 7f50fac18b80 1 client.5109 shutdown 2023-10-10T21:03:25.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 -- 172.21.15.154:0/2965493395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 msgr2=0x564e9e32c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e32c490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f50d4016510 tx=0x7f50d401a000 comp rx=0 tx=0).stop 2023-10-10T21:03:25.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 -- 172.21.15.154:0/2965493395 shutdown_connections 2023-10-10T21:03:25.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] conn(0x564e9e326d30 0x564e9e327100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 0x564e9e32c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e346ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50c4ff9700 0 client.5109 ms_handle_reset on v2:172.21.15.154:6834/2035241338 2023-10-10T21:03:25.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 --2- 172.21.15.154:0/2965493395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e32c490 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 -- 172.21.15.154:0/2965493395 >> 172.21.15.154:0/2965493395 conn(0x564e9e2fe0c0 msgr2=0x564e9e2fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:25.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 -- 172.21.15.154:0/2965493395 shutdown_connections 2023-10-10T21:03:25.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 1 -- 172.21.15.154:0/2965493395 wait complete. 2023-10-10T21:03:25.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.244+0000 7f50fac18b80 20 client.5109 trim_cache size 0 max 16384 2023-10-10T21:03:25.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.262+0000 7f50fac18b80 1 Processor -- start 2023-10-10T21:03:25.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.262+0000 7f50fac18b80 1 -- start start 2023-10-10T21:03:25.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.262+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e342cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.262+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e2fcb80 0x564e9e355ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.262+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e2f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.262+0000 7f50fac18b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e2fc9f0 con 0x564e9e347480 2023-10-10T21:03:25.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.262+0000 7f50fac18b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e327bf0 con 0x564e9e2fcb80 2023-10-10T21:03:25.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.262+0000 7f50fac18b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e9e329de0 con 0x564e9e2fa5f0 2023-10-10T21:03:25.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e2f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e2f2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44762/0 (socket says 172.21.15.154:44762) 2023-10-10T21:03:25.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea99c700 1 -- 172.21.15.154:0/1947726189 learned_addr learned my addr 172.21.15.154:0/1947726189 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:25.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea19b700 1 --2- 172.21.15.154:0/1947726189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e342cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50e999a700 1 --2- 172.21.15.154:0/1947726189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e2fcb80 0x564e9e355ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea99c700 1 -- 172.21.15.154:0/1947726189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 msgr2=0x564e9e342cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea99c700 1 --2- 172.21.15.154:0/1947726189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e342cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea99c700 1 -- 172.21.15.154:0/1947726189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e2fcb80 msgr2=0x564e9e355ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea99c700 1 --2- 172.21.15.154:0/1947726189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e2fcb80 0x564e9e355ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea99c700 1 -- 172.21.15.154:0/1947726189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9e21b780 con 0x564e9e347480 2023-10-10T21:03:25.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.263+0000 7f50ea99c700 1 --2- 172.21.15.154:0/1947726189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e2f2f40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f50dc012000 tx=0x7f50dc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6303c8be0ed2eebb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50c7fff700 1 -- 172.21.15.154:0/1947726189 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc001eb0 con 0x564e9e347480 2023-10-10T21:03:25.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50c7fff700 1 -- 172.21.15.154:0/1947726189 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc001a10 con 0x564e9e347480 2023-10-10T21:03:25.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50c7fff700 1 -- 172.21.15.154:0/1947726189 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0016f0 con 0x564e9e347480 2023-10-10T21:03:25.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50fac18b80 1 -- 172.21.15.154:0/1947726189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 msgr2=0x564e9e2f2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50fac18b80 1 --2- 172.21.15.154:0/1947726189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e2f2f40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f50dc012000 tx=0x7f50dc016000 comp rx=0 tx=0).stop 2023-10-10T21:03:25.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50fac18b80 1 -- 172.21.15.154:0/1947726189 shutdown_connections 2023-10-10T21:03:25.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50fac18b80 1 --2- 172.21.15.154:0/1947726189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e347480 0x564e9e2f2f40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50fac18b80 1 --2- 172.21.15.154:0/1947726189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e342cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50fac18b80 1 --2- 172.21.15.154:0/1947726189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e2fcb80 0x564e9e355ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50fac18b80 1 -- 172.21.15.154:0/1947726189 >> 172.21.15.154:0/1947726189 conn(0x564e9e2fe0c0 msgr2=0x564e9e2f9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:25.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50fac18b80 1 -- 172.21.15.154:0/1947726189 shutdown_connections 2023-10-10T21:03:25.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.264+0000 7f50fac18b80 1 -- 172.21.15.154:0/1947726189 wait complete. 2023-10-10T21:03:25.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.265+0000 7f50fac18b80 1 -- start start 2023-10-10T21:03:25.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.265+0000 7f50fac18b80 1 Processor -- start 2023-10-10T21:03:25.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e2f3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e3a3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50fac18b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 0x564e9e343490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50fac18b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e3aa150 con 0x564e9e2fcb80 2023-10-10T21:03:25.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50fac18b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9e324da0 con 0x564e9e347480 2023-10-10T21:03:25.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50fac18b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e9e35ca60 con 0x564e9e2fa5f0 2023-10-10T21:03:25.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50fac18b80 10 client.0 _ll_register_callbacks cb 0x564e9e2c02c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:03:25.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50e999a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e3a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50e999a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e3a3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44770/0 (socket says 172.21.15.154:44770) 2023-10-10T21:03:25.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.266+0000 7f50e999a700 1 -- 172.21.15.154:0/639546246 learned_addr learned my addr 172.21.15.154:0/639546246 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:25.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50ea19b700 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e2f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50ea99c700 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 0x564e9e343490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50e999a700 1 -- 172.21.15.154:0/639546246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 msgr2=0x564e9e2f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50e999a700 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e2f3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50e999a700 1 -- 172.21.15.154:0/639546246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 msgr2=0x564e9e343490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:25.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50e999a700 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 0x564e9e343490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50e999a700 1 -- 172.21.15.154:0/639546246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d0003570 con 0x564e9e2fcb80 2023-10-10T21:03:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50e999a700 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e3a3200 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f50d4015fd0 tx=0x7f50d401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b74f9328b55a062 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:03:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50c4ff9700 1 -- 172.21.15.154:0/639546246 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4028040 con 0x564e9e2fcb80 2023-10-10T21:03:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50c4ff9700 1 -- 172.21.15.154:0/639546246 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d4024650 con 0x564e9e2fcb80 2023-10-10T21:03:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.267+0000 7f50fac18b80 1 -- 172.21.15.154:0/639546246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50e0058800 con 0x564e9e2fcb80 2023-10-10T21:03:25.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50c4ff9700 1 -- 172.21.15.154:0/639546246 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50d4024a20 con 0x564e9e2fcb80 2023-10-10T21:03:25.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50fac18b80 10 client.5115 fetch_fsmap learned FSMap version 14 2023-10-10T21:03:25.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50fac18b80 1 -- 172.21.15.154:0/639546246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x564e9e202470 con 0x564e9e2fcb80 2023-10-10T21:03:25.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50c4ff9700 1 -- 172.21.15.154:0/639546246 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e0058800 con 0x564e9e2fcb80 2023-10-10T21:03:25.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50c4ff9700 1 -- 172.21.15.154:0/639546246 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f50d40165f0 con 0x564e9e2fcb80 2023-10-10T21:03:25.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50fac18b80 10 client.5115 fetch_fsmap finished waiting for FSMap version 14 2023-10-10T21:03:25.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50fac18b80 10 client.5115 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-10T21:03:25.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50fac18b80 20 client.5115 populate_metadata read hostname 'smithi154' 2023-10-10T21:03:25.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50fac18b80 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] conn(0x564e9e3a9560 0x564e9e3a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50fac18b80 4 client.5115 mds_command: new command op to 4905 tid=0[{"prefix": "status"}] 2023-10-10T21:03:25.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50fac18b80 1 -- 172.21.15.154:0/639546246 --> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564e9e1efe00 con 0x564e9e3a9560 2023-10-10T21:03:25.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.268+0000 7f50ea19b700 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] conn(0x564e9e3a9560 0x564e9e3a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50c4ff9700 10 client.5115 ms_handle_connect on v2:172.21.15.154:6834/2035241338 2023-10-10T21:03:25.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50ea19b700 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] conn(0x564e9e3a9560 0x564e9e3a9930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=323b2451c8af2c87 server_cookie=7571889a8bba4cdf in_seq=0 out_seq=0 2023-10-10T21:03:25.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50c4ff9700 1 -- 172.21.15.154:0/639546246 <== mds.0 v2:172.21.15.154:6834/2035241338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564e9e1efe00 con 0x564e9e3a9560 2023-10-10T21:03:25.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50c4ff9700 10 client.5115 handle_command_reply: tid=0 2023-10-10T21:03:25.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 client.5115 shutdown 2023-10-10T21:03:25.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 -- 172.21.15.154:0/639546246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 msgr2=0x564e9e3a3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e3a3200 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f50d4015fd0 tx=0x7f50d401d000 comp rx=0 tx=0).stop 2023-10-10T21:03:25.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 -- 172.21.15.154:0/639546246 shutdown_connections 2023-10-10T21:03:25.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.154:6834/2035241338,v1:172.21.15.154:6836/2035241338] conn(0x564e9e3a9560 0x564e9e3a9930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564e9e347480 0x564e9e343490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564e9e2fa5f0 0x564e9e2f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50c4ff9700 0 client.5115 ms_handle_reset on v2:172.21.15.154:6834/2035241338 2023-10-10T21:03:25.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 --2- 172.21.15.154:0/639546246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e9e2fcb80 0x564e9e3a3200 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 -- 172.21.15.154:0/639546246 >> 172.21.15.154:0/639546246 conn(0x564e9e2fe0c0 msgr2=0x564e9e346930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:25.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 -- 172.21.15.154:0/639546246 shutdown_connections 2023-10-10T21:03:25.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 1 -- 172.21.15.154:0/639546246 wait complete. 2023-10-10T21:03:25.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.269+0000 7f50fac18b80 20 client.5115 trim_cache size 0 max 16384 2023-10-10T21:03:25.292 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:03:25.292 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T21:03:25.292 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T21:03:25.292 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4905, 2023-10-10T21:03:25.293 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T21:03:25.293 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T21:03:25.293 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T21:03:25.293 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.228875657, 2023-10-10T21:03:25.293 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 14, 2023-10-10T21:03:25.294 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 34, 2023-10-10T21:03:25.294 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 34, 2023-10-10T21:03:25.294 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 21.176548544999999 2023-10-10T21:03:25.294 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:03:25.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 -- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f50c8066f30 msgr2=0x7f50c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f50c8066f30 0x7f50c80693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50d40093f0 tx=0x7f50d4008040 comp rx=0 tx=0).stop 2023-10-10T21:03:25.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 -- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 msgr2=0x7f50e4155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50e4155650 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50e0002b50 tx=0x7f50e0007d30 comp rx=0 tx=0).stop 2023-10-10T21:03:25.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 -- 172.21.15.154:0/3784698358 shutdown_connections 2023-10-10T21:03:25.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f50c8066f30 0x7f50c80693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50e4154750 0x7f50e4154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d00051c0 0x7f50e4155650 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 --2- 172.21.15.154:0/3784698358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e41520c0 0x7f50e4152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 -- 172.21.15.154:0/3784698358 >> 172.21.15.154:0/3784698358 conn(0x7f50e40d0660 msgr2=0x7f50e4068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:25.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 -- 172.21.15.154:0/3784698358 shutdown_connections 2023-10-10T21:03:25.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.270+0000 7f50eb19d700 1 -- 172.21.15.154:0/3784698358 wait complete. 2023-10-10T21:03:25.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:03:25.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.479+0000 7f0e7cdff700 1 Processor -- start 2023-10-10T21:03:25.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.480+0000 7f0e7cdff700 1 -- start start 2023-10-10T21:03:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.481+0000 7f0e7cdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e780cbf30 0x7f0e780ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.481+0000 7f0e7cdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e780cc300 con 0x7f0e780b1420 2023-10-10T21:03:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.481+0000 7f0e7cdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e780ad370 con 0x7f0e780ccf90 2023-10-10T21:03:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.481+0000 7f0e7cdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e78156bf0 con 0x7f0e780cbf30 2023-10-10T21:03:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.481+0000 7f0e7659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e780cbf30 0x7f0e780ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.481+0000 7f0e76d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0e780b1420 0x7f0e780c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36806/0 (socket says 172.21.15.154:36806) 2023-10-10T21:03:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.481+0000 7f0e76d9d700 1 -- 172.21.15.154:0/2001172636 learned_addr learned my addr 172.21.15.154:0/2001172636 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e7659c700 1 -- 172.21.15.154:0/2001172636 >> v1:172.21.15.179:6789/0 conn(0x7f0e780ccf90 legacy=0x7f0e780b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e7659c700 1 -- 172.21.15.154:0/2001172636 >> v1:172.21.15.154:6789/0 conn(0x7f0e780b1420 legacy=0x7f0e780c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e7659c700 1 -- 172.21.15.154:0/2001172636 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e780ad650 con 0x7f0e780cbf30 2023-10-10T21:03:25.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e75d9b700 1 -- 172.21.15.154:0/2001172636 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51323171 0 0) 0x7f0e780cc300 con 0x7f0e780b1420 2023-10-10T21:03:25.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e7659c700 1 --2- 172.21.15.154:0/2001172636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780cbf30 0x7f0e780ae410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0e680098e0 tx=0x7f0e680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b36731d1ab79fa server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e75d9b700 1 -- 172.21.15.154:0/2001172636 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68009e80 con 0x7f0e780cbf30 2023-10-10T21:03:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e75d9b700 1 -- 172.21.15.154:0/2001172636 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6800b860 con 0x7f0e780cbf30 2023-10-10T21:03:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e75d9b700 1 -- 172.21.15.154:0/2001172636 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800bbe0 con 0x7f0e780cbf30 2023-10-10T21:03:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e7cdff700 1 -- 172.21.15.154:0/2001172636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780cbf30 msgr2=0x7f0e780ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.482+0000 7f0e7cdff700 1 --2- 172.21.15.154:0/2001172636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780cbf30 0x7f0e780ae410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0e680098e0 tx=0x7f0e680091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.483+0000 7f0e7cdff700 1 -- 172.21.15.154:0/2001172636 shutdown_connections 2023-10-10T21:03:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.483+0000 7f0e7cdff700 1 --2- 172.21.15.154:0/2001172636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780cbf30 0x7f0e780ae410 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.483+0000 7f0e7cdff700 1 -- 172.21.15.154:0/2001172636 >> 172.21.15.154:0/2001172636 conn(0x7f0e7806a320 msgr2=0x7f0e780cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.483+0000 7f0e7cdff700 1 -- 172.21.15.154:0/2001172636 shutdown_connections 2023-10-10T21:03:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.483+0000 7f0e7cdff700 1 -- 172.21.15.154:0/2001172636 wait complete. 2023-10-10T21:03:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.484+0000 7f0e7cdff700 1 Processor -- start 2023-10-10T21:03:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.484+0000 7f0e7cdff700 1 -- start start 2023-10-10T21:03:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.485+0000 7f0e7cdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780b1420 0x7f0e78157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.485+0000 7f0e7cdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e780cbf30 0x7f0e78154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.485+0000 7f0e7cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e780ccf90 0x7f0e78154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.485+0000 7f0e7cdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78158f10 con 0x7f0e780b1420 2023-10-10T21:03:25.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.485+0000 7f0e7cdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78158300 con 0x7f0e780cbf30 2023-10-10T21:03:25.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.485+0000 7f0e7cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e781585e0 con 0x7f0e780ccf90 2023-10-10T21:03:25.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.485+0000 7f0e7659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780b1420 0x7f0e78157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.485+0000 7f0e7659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780b1420 0x7f0e78157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44790/0 (socket says 172.21.15.154:44790) 2023-10-10T21:03:25.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.485+0000 7f0e7659c700 1 -- 172.21.15.154:0/3895942156 learned_addr learned my addr 172.21.15.154:0/3895942156 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:25.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e7659c700 1 -- 172.21.15.154:0/3895942156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e780ccf90 msgr2=0x7f0e78154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e7659c700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e780ccf90 0x7f0e78154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e7659c700 1 -- 172.21.15.154:0/3895942156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e780cbf30 msgr2=0x7f0e78154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e7659c700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e780cbf30 0x7f0e78154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e7659c700 1 -- 172.21.15.154:0/3895942156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68009420 con 0x7f0e780b1420 2023-10-10T21:03:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e7659c700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780b1420 0x7f0e78157840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0e78064290 tx=0x7f0e68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e6e7fc700 1 -- 172.21.15.154:0/3895942156 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6801f070 con 0x7f0e780b1420 2023-10-10T21:03:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e6e7fc700 1 -- 172.21.15.154:0/3895942156 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6800b9d0 con 0x7f0e780b1420 2023-10-10T21:03:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e6e7fc700 1 -- 172.21.15.154:0/3895942156 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68025670 con 0x7f0e780b1420 2023-10-10T21:03:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e781588c0 con 0x7f0e780b1420 2023-10-10T21:03:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.486+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e780a56f0 con 0x7f0e780b1420 2023-10-10T21:03:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.487+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7804c3c0 con 0x7f0e780b1420 2023-10-10T21:03:25.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.488+0000 7f0e6e7fc700 1 -- 172.21.15.154:0/3895942156 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e68023070 con 0x7f0e780b1420 2023-10-10T21:03:25.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.489+0000 7f0e6e7fc700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0e58066f30 0x7f0e580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:25.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.489+0000 7f0e6e7fc700 1 -- 172.21.15.154:0/3895942156 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e68085c80 con 0x7f0e780b1420 2023-10-10T21:03:25.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.489+0000 7f0e6ffff700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0e58066f30 0x7f0e580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:25.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.490+0000 7f0e6ffff700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0e58066f30 0x7f0e580693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e78157700 tx=0x7f0e60007b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:25.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.493+0000 7f0e6e7fc700 1 -- 172.21.15.154:0/3895942156 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e68052e50 con 0x7f0e780b1420 2023-10-10T21:03:25.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.728+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e780b0af0 con 0x7f0e780b1420 2023-10-10T21:03:25.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.728+0000 7f0e6e7fc700 1 -- 172.21.15.154:0/3895942156 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0e6802a070 con 0x7f0e780b1420 2023-10-10T21:03:25.730 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:03:25.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0e58066f30 msgr2=0x7f0e580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0e58066f30 0x7f0e580693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e78157700 tx=0x7f0e60007b40 comp rx=0 tx=0).stop 2023-10-10T21:03:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780b1420 msgr2=0x7f0e78157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780b1420 0x7f0e78157840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0e78064290 tx=0x7f0e68017000 comp rx=0 tx=0).stop 2023-10-10T21:03:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 shutdown_connections 2023-10-10T21:03:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0e58066f30 0x7f0e580693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e780ccf90 0x7f0e78154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e780b1420 0x7f0e78157840 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 --2- 172.21.15.154:0/3895942156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e780cbf30 0x7f0e78154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 >> 172.21.15.154:0/3895942156 conn(0x7f0e7806a320 msgr2=0x7f0e780ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 shutdown_connections 2023-10-10T21:03:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:25.731+0000 7f0e7cdff700 1 -- 172.21.15.154:0/3895942156 wait complete. 2023-10-10T21:03:25.750 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T21:03:25.750 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:03:25.751 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T21:03:25.751 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T21:03:25.751 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T21:03:25.752 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T21:03:25.752 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T21:03:25.752 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:03:25.752 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:03:25.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:03:25.753 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T21:03:25.791 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:03:25.791 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:03:25.791 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:03:25.791 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:03:25.792 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:03:25.792 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:03:25.792 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:03:25.792 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:03:25.792 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T21:03:25.793 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:03:25.793 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:03:25.793 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T21:03:25.793 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:03:25.793 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:03:25.793 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:03:25.794 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:03:25.794 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:03:25.794 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42208sec preferred_lft 42208sec 2023-10-10T21:03:25.794 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T21:03:25.794 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:03:25.795 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:03:25.795 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:03:25.795 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T21:03:25.795 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:03:25.795 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T21:03:25.796 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:03:25.796 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:03:25.796 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T21:03:25.796 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T21:03:25.796 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:03:25.796 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:03:25.797 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T21:03:25.797 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T21:03:25.797 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:03:25.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:03:25.798 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:03:25.891 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T21:03:25.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:03:25.894 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T21:03:25.933 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T21:03:25.933 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:03:25.934 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:03:25.934 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:03:25.934 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:03:25.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:03:25.935 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:03:25.935 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:03:25.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:03:25.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:03:25.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:03:25.937 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:03:26.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:03:26.132 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:03:26.169 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T21:03:26.169 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T21:03:26.169 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:03:26.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:03:26.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T21:03:26.273 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:03:26.274 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T21:03:26.311 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:03:26.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:03:26.312 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:03:26.386 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:03:26.387 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:03:26.387 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:03:26.518 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:03:26.518 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:03:26.518 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:03:26.534 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:03:26.534 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:03:26.535 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:03:26.535 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:03:26.535 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:03:26.554 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:03:26.555 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:03:26.555 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:03:26.555 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:03:26.555 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:03:26.556 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:03:26.556 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:03:26.556 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:03:26.560 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:03:26.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:03:26.561 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:03:26.623 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T21:03:26.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.803+0000 7f49d73ff700 1 Processor -- start 2023-10-10T21:03:26.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.803+0000 7f49d73ff700 1 -- start start 2023-10-10T21:03:26.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.804+0000 7f49d73ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49d01578b0 0x7f49d0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:26.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.804+0000 7f49d73ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49d00af2f0 0x7f49d00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:26.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.804+0000 7f49d73ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d00ad930 con 0x7f49d0155c10 2023-10-10T21:03:26.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.804+0000 7f49d73ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00b0c80 con 0x7f49d00af2f0 2023-10-10T21:03:26.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.804+0000 7f49d73ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00acd20 con 0x7f49d01578b0 2023-10-10T21:03:26.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d599c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49d00af2f0 0x7f49d00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:26.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d519b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f49d0155c10 0x7f49d00ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53980/0 (socket says 172.21.15.154:53980) 2023-10-10T21:03:26.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d519b700 1 -- 172.21.15.154:0/4263787863 learned_addr learned my addr 172.21.15.154:0/4263787863 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:26.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d499a700 1 --2- 172.21.15.154:0/4263787863 >> v2:172.21.15.179:3300/0 conn(0x7f49d01578b0 0x7f49d0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:26.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49c7fff700 1 -- 172.21.15.154:0/4263787863 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525372166 0 0) 0x7f49d00ad930 con 0x7f49d0155c10 2023-10-10T21:03:26.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d599c700 1 -- 172.21.15.154:0/4263787863 >> v2:172.21.15.179:3300/0 conn(0x7f49d01578b0 msgr2=0x7f49d0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:26.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d599c700 1 --2- 172.21.15.154:0/4263787863 >> v2:172.21.15.179:3300/0 conn(0x7f49d01578b0 0x7f49d0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:26.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d599c700 1 -- 172.21.15.154:0/4263787863 >> v1:172.21.15.154:6789/0 conn(0x7f49d0155c10 legacy=0x7f49d00ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:26.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d599c700 1 -- 172.21.15.154:0/4263787863 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00ad000 con 0x7f49d00af2f0 2023-10-10T21:03:26.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d499a700 1 --2- 172.21.15.154:0/4263787863 >> v2:172.21.15.179:3300/0 conn(0x7f49d01578b0 0x7f49d0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:26.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.805+0000 7f49d599c700 1 --2- 172.21.15.154:0/4263787863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 0x7f49d00af730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f49d00c8c60 tx=0x7f49c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ceb6a5cd3ad3a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:26.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49c7fff700 1 -- 172.21.15.154:0/4263787863 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c800e070 con 0x7f49d00af2f0 2023-10-10T21:03:26.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49c7fff700 1 -- 172.21.15.154:0/4263787863 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c800bc30 con 0x7f49d00af2f0 2023-10-10T21:03:26.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49c7fff700 1 -- 172.21.15.154:0/4263787863 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8012430 con 0x7f49d00af2f0 2023-10-10T21:03:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49d73ff700 1 -- 172.21.15.154:0/4263787863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 msgr2=0x7f49d00af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49d73ff700 1 --2- 172.21.15.154:0/4263787863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 0x7f49d00af730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f49d00c8c60 tx=0x7f49c8009780 comp rx=0 tx=0).stop 2023-10-10T21:03:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49d73ff700 1 -- 172.21.15.154:0/4263787863 shutdown_connections 2023-10-10T21:03:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49d73ff700 1 --2- 172.21.15.154:0/4263787863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 0x7f49d00af730 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49d73ff700 1 --2- 172.21.15.154:0/4263787863 >> v2:172.21.15.179:3300/0 conn(0x7f49d01578b0 0x7f49d0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49d73ff700 1 -- 172.21.15.154:0/4263787863 >> 172.21.15.154:0/4263787863 conn(0x7f49d006a320 msgr2=0x7f49d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:26.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49d73ff700 1 -- 172.21.15.154:0/4263787863 shutdown_connections 2023-10-10T21:03:26.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.806+0000 7f49d73ff700 1 -- 172.21.15.154:0/4263787863 wait complete. 2023-10-10T21:03:26.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.808+0000 7f49d73ff700 1 Processor -- start 2023-10-10T21:03:26.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.808+0000 7f49d73ff700 1 -- start start 2023-10-10T21:03:26.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d73ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 0x7f49d00a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:26.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d73ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d0155c10 0x7f49d0169c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:26.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d73ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d01578b0 0x7f49d016a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:26.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d73ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d016b440 con 0x7f49d00af2f0 2023-10-10T21:03:26.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d73ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00abe30 con 0x7f49d0155c10 2023-10-10T21:03:26.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d73ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d016a800 con 0x7f49d01578b0 2023-10-10T21:03:26.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d519b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 0x7f49d00a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:26.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d519b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 0x7f49d00a8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35608/0 (socket says 172.21.15.154:35608) 2023-10-10T21:03:26.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d519b700 1 -- 172.21.15.154:0/338810331 learned_addr learned my addr 172.21.15.154:0/338810331 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:26.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d519b700 1 -- 172.21.15.154:0/338810331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d01578b0 msgr2=0x7f49d016a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:26.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d519b700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d01578b0 0x7f49d016a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:26.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d519b700 1 -- 172.21.15.154:0/338810331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d0155c10 msgr2=0x7f49d0169c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:26.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d519b700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d0155c10 0x7f49d0169c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:26.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.809+0000 7f49d519b700 1 -- 172.21.15.154:0/338810331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c8009a20 con 0x7f49d00af2f0 2023-10-10T21:03:26.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.810+0000 7f49d519b700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 0x7f49d00a8ba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c7e0 tx=0x7f49cc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:26.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.810+0000 7f49c57fa700 1 -- 172.21.15.154:0/338810331 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc005b30 con 0x7f49d00af2f0 2023-10-10T21:03:26.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.810+0000 7f49c57fa700 1 -- 172.21.15.154:0/338810331 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc005c90 con 0x7f49d00af2f0 2023-10-10T21:03:26.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.810+0000 7f49c57fa700 1 -- 172.21.15.154:0/338810331 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc007300 con 0x7f49d00af2f0 2023-10-10T21:03:26.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.810+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d016aae0 con 0x7f49d00af2f0 2023-10-10T21:03:26.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.810+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d016b0d0 con 0x7f49d00af2f0 2023-10-10T21:03:26.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.811+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d00b1b10 con 0x7f49d00af2f0 2023-10-10T21:03:26.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.812+0000 7f49c57fa700 1 -- 172.21.15.154:0/338810331 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49cc01b400 con 0x7f49d00af2f0 2023-10-10T21:03:26.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.813+0000 7f49c57fa700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f49b4066f30 0x7f49b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:26.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.813+0000 7f49c57fa700 1 -- 172.21.15.154:0/338810331 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49cc0840e0 con 0x7f49d00af2f0 2023-10-10T21:03:26.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.813+0000 7f49d499a700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f49b4066f30 0x7f49b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:26.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.814+0000 7f49d499a700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f49b4066f30 0x7f49b40693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49c0006fd0 tx=0x7f49c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:26.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:26.817+0000 7f49c57fa700 1 -- 172.21.15.154:0/338810331 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49cc051330 con 0x7f49d00af2f0 2023-10-10T21:03:27.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.034+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f49d016b580 con 0x7f49b4066f30 2023-10-10T21:03:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.035+0000 7f49c57fa700 1 -- 172.21.15.154:0/338810331 <== mgr.4103 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f49c0007dd0 con 0x7f49b4066f30 2023-10-10T21:03:27.036 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:03:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:03:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T21:03:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:03:27.037 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:03:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.037+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f49b4066f30 msgr2=0x7f49b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.037+0000 7f49d73ff700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f49b4066f30 0x7f49b40693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49c0006fd0 tx=0x7f49c0008040 comp rx=0 tx=0).stop 2023-10-10T21:03:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.037+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 msgr2=0x7f49d00a8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.037+0000 7f49d73ff700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 0x7f49d00a8ba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c7e0 tx=0x7f49cc007df0 comp rx=0 tx=0).stop 2023-10-10T21:03:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.038+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 shutdown_connections 2023-10-10T21:03:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.038+0000 7f49d73ff700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f49b4066f30 0x7f49b40693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.038+0000 7f49d73ff700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d01578b0 0x7f49d016a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.038+0000 7f49d73ff700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d00af2f0 0x7f49d00a8ba0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.038+0000 7f49d73ff700 1 --2- 172.21.15.154:0/338810331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d0155c10 0x7f49d0169c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:27.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.038+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 >> 172.21.15.154:0/338810331 conn(0x7f49d006a320 msgr2=0x7f49d0154020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:27.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.038+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 shutdown_connections 2023-10-10T21:03:27.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.038+0000 7f49d73ff700 1 -- 172.21.15.154:0/338810331 wait complete. 2023-10-10T21:03:27.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T21:03:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.240+0000 7fb5bcbff700 1 Processor -- start 2023-10-10T21:03:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.240+0000 7fb5bcbff700 1 -- start start 2023-10-10T21:03:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.241+0000 7fb5bcbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb5b80c70b0 0x7fb5b8155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.241+0000 7fb5bcbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b806e950 con 0x7fb5b80cd0b0 2023-10-10T21:03:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.241+0000 7fb5bcbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b806eb90 con 0x7fb5b80ccc40 2023-10-10T21:03:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.241+0000 7fb5bcbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b81563f0 con 0x7fb5b80c70b0 2023-10-10T21:03:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b6d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb5b80cd0b0 0x7fb5b8069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53986/0 (socket says 172.21.15.154:53986) 2023-10-10T21:03:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b6d9d700 1 -- 172.21.15.154:0/2979799754 learned_addr learned my addr 172.21.15.154:0/2979799754 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b659c700 1 --2- 172.21.15.154:0/2979799754 >> v2:172.21.15.179:3300/0 conn(0x7fb5b80c70b0 0x7fb5b8155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b559a700 1 -- 172.21.15.154:0/2979799754 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441867628 0 0) 0x7fb5b0001490 con 0x7fb5b80cd0b0 2023-10-10T21:03:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b559a700 1 -- 172.21.15.154:0/2979799754 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a0003570 con 0x7fb5b80cd0b0 2023-10-10T21:03:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b559a700 1 -- 172.21.15.154:0/2979799754 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81738962 0 0) 0x7fb5b806eb90 con 0x7fb5b80ccc40 2023-10-10T21:03:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b559a700 1 -- 172.21.15.154:0/2979799754 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b0001490 con 0x7fb5b80ccc40 2023-10-10T21:03:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b559a700 1 -- 172.21.15.154:0/2979799754 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2323187128 0 0) 0x7fb5a0003570 con 0x7fb5b80cd0b0 2023-10-10T21:03:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b659c700 1 -- 172.21.15.154:0/2979799754 >> v1:172.21.15.179:6789/0 conn(0x7fb5b80ccc40 legacy=0x7fb5b806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b659c700 1 -- 172.21.15.154:0/2979799754 >> v1:172.21.15.154:6789/0 conn(0x7fb5b80cd0b0 legacy=0x7fb5b8069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.242+0000 7fb5b659c700 1 -- 172.21.15.154:0/2979799754 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b806ee70 con 0x7fb5b80c70b0 2023-10-10T21:03:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.243+0000 7fb5b659c700 1 --2- 172.21.15.154:0/2979799754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80c70b0 0x7fb5b8155eb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80098e0 tx=0x7fb5a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d71f590f39e365 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.243+0000 7fb5b559a700 1 -- 172.21.15.154:0/2979799754 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0001980 con 0x7fb5b80c70b0 2023-10-10T21:03:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.243+0000 7fb5b559a700 1 -- 172.21.15.154:0/2979799754 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a8011420 con 0x7fb5b80c70b0 2023-10-10T21:03:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.243+0000 7fb5b559a700 1 -- 172.21.15.154:0/2979799754 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80117c0 con 0x7fb5b80c70b0 2023-10-10T21:03:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.243+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2979799754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80c70b0 msgr2=0x7fb5b8155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.243+0000 7fb5bcbff700 1 --2- 172.21.15.154:0/2979799754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80c70b0 0x7fb5b8155eb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80098e0 tx=0x7fb5a80091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.244+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2979799754 shutdown_connections 2023-10-10T21:03:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.244+0000 7fb5bcbff700 1 --2- 172.21.15.154:0/2979799754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80c70b0 0x7fb5b8155eb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.244+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2979799754 >> 172.21.15.154:0/2979799754 conn(0x7fb5b8068e10 msgr2=0x7fb5b80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.244+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2979799754 shutdown_connections 2023-10-10T21:03:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.244+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2979799754 wait complete. 2023-10-10T21:03:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.245+0000 7fb5bcbff700 1 Processor -- start 2023-10-10T21:03:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.245+0000 7fb5bcbff700 1 -- start start 2023-10-10T21:03:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5bcbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b80c70b0 0x7fb5b80ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5bcbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80ccc40 0x7fb5b8156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5bcbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5b80cd0b0 0x7fb5b81573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:27.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5bcbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b81541c0 con 0x7fb5b80c70b0 2023-10-10T21:03:27.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5bcbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b80acd30 con 0x7fb5b80ccc40 2023-10-10T21:03:27.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5bcbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b80aeca0 con 0x7fb5b80cd0b0 2023-10-10T21:03:27.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5b659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b80c70b0 0x7fb5b80ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:27.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5b659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b80c70b0 0x7fb5b80ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35610/0 (socket says 172.21.15.154:35610) 2023-10-10T21:03:27.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5b659c700 1 -- 172.21.15.154:0/2427916855 learned_addr learned my addr 172.21.15.154:0/2427916855 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5b6d9d700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5b80cd0b0 0x7fb5b81573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.246+0000 7fb5b5d9b700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80ccc40 0x7fb5b8156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5b659c700 1 -- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5b80cd0b0 msgr2=0x7fb5b81573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5b659c700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5b80cd0b0 0x7fb5b81573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5b659c700 1 -- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80ccc40 msgr2=0x7fb5b8156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5b659c700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80ccc40 0x7fb5b8156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5b659c700 1 -- 172.21.15.154:0/2427916855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8009420 con 0x7fb5b80c70b0 2023-10-10T21:03:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5b6d9d700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5b80cd0b0 0x7fb5b81573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5b5d9b700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80ccc40 0x7fb5b8156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5b659c700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b80c70b0 0x7fb5b80ae760 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5b806fe40 tx=0x7fb5a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5a67fc700 1 -- 172.21.15.154:0/2427916855 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a801cc90 con 0x7fb5b80c70b0 2023-10-10T21:03:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5a67fc700 1 -- 172.21.15.154:0/2427916855 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a801cdf0 con 0x7fb5b80c70b0 2023-10-10T21:03:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b816b7c0 con 0x7fb5b80c70b0 2023-10-10T21:03:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5a67fc700 1 -- 172.21.15.154:0/2427916855 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a801a6a0 con 0x7fb5b80c70b0 2023-10-10T21:03:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.247+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b816bb50 con 0x7fb5b80c70b0 2023-10-10T21:03:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.248+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b8069360 con 0x7fb5b80c70b0 2023-10-10T21:03:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.249+0000 7fb5a67fc700 1 -- 172.21.15.154:0/2427916855 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5a801aa90 con 0x7fb5b80c70b0 2023-10-10T21:03:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.250+0000 7fb5a67fc700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb598066f30 0x7fb5980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.250+0000 7fb5a67fc700 1 -- 172.21.15.154:0/2427916855 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5a8085c10 con 0x7fb5b80c70b0 2023-10-10T21:03:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.250+0000 7fb5b5d9b700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb598066f30 0x7fb5980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.251+0000 7fb5b5d9b700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb598066f30 0x7fb5980693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8153da0 tx=0x7fb5ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:27.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.254+0000 7fb5a67fc700 1 -- 172.21.15.154:0/2427916855 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5a8052de0 con 0x7fb5b80c70b0 2023-10-10T21:03:27.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:27.500+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb5b804c3c0 con 0x7fb5b80c70b0 2023-10-10T21:03:28.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.104+0000 7fb5a67fc700 1 -- 172.21.15.154:0/2427916855 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb5a801ad40 con 0x7fb5b80c70b0 2023-10-10T21:03:28.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.105+0000 7fb5a67fc700 1 -- 172.21.15.154:0/2427916855 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb5a8056870 con 0x7fb5b80c70b0 2023-10-10T21:03:28.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb598066f30 msgr2=0x7fb5980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb598066f30 0x7fb5980693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8153da0 tx=0x7fb5ac009040 comp rx=0 tx=0).stop 2023-10-10T21:03:28.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b80c70b0 msgr2=0x7fb5b80ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b80c70b0 0x7fb5b80ae760 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5b806fe40 tx=0x7fb5a8016000 comp rx=0 tx=0).stop 2023-10-10T21:03:28.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 shutdown_connections 2023-10-10T21:03:28.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb598066f30 0x7fb5980693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5b80cd0b0 0x7fb5b81573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b80c70b0 0x7fb5b80ae760 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 --2- 172.21.15.154:0/2427916855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5b80ccc40 0x7fb5b8156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 >> 172.21.15.154:0/2427916855 conn(0x7fb5b8068e10 msgr2=0x7fb5b80c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:28.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 shutdown_connections 2023-10-10T21:03:28.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.108+0000 7fb5bcbff700 1 -- 172.21.15.154:0/2427916855 wait complete. 2023-10-10T21:03:28.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T21:03:28.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.322+0000 7febfa59d700 1 Processor -- start 2023-10-10T21:03:28.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.322+0000 7febfa59d700 1 -- start start 2023-10-10T21:03:28.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febfa59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febf40b1b40 0x7febf40b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febfa59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf40cfb00 con 0x7febf40b16d0 2023-10-10T21:03:28.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febfa59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf40b5c40 con 0x7febf40b4e70 2023-10-10T21:03:28.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febfa59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf40b5f20 con 0x7febf40b1b40 2023-10-10T21:03:28.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febf8d9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7febf40b16d0 0x7febf40b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53992/0 (socket says 172.21.15.154:53992) 2023-10-10T21:03:28.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febf8d9a700 1 -- 172.21.15.154:0/200206956 learned_addr learned my addr 172.21.15.154:0/200206956 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:28.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febf9d9c700 1 --2- 172.21.15.154:0/200206956 >> v2:172.21.15.154:3300/0 conn(0x7febf40b1b40 0x7febf40b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:28.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febebfff700 1 -- 172.21.15.154:0/200206956 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878025894 0 0) 0x7febf40cfb00 con 0x7febf40b16d0 2023-10-10T21:03:28.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febebfff700 1 -- 172.21.15.154:0/200206956 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe0003570 con 0x7febf40b16d0 2023-10-10T21:03:28.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febebfff700 1 -- 172.21.15.154:0/200206956 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759351274 0 0) 0x7febf40b5c40 con 0x7febf40b4e70 2023-10-10T21:03:28.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.324+0000 7febebfff700 1 -- 172.21.15.154:0/200206956 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf40cfb00 con 0x7febf40b4e70 2023-10-10T21:03:28.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.325+0000 7febf9d9c700 1 -- 172.21.15.154:0/200206956 >> v1:172.21.15.179:6789/0 conn(0x7febf40b4e70 legacy=0x7febf40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.325+0000 7febf9d9c700 1 -- 172.21.15.154:0/200206956 >> v1:172.21.15.154:6789/0 conn(0x7febf40b16d0 legacy=0x7febf40b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.325+0000 7febf9d9c700 1 -- 172.21.15.154:0/200206956 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf40b6200 con 0x7febf40b1b40 2023-10-10T21:03:28.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.325+0000 7febf9d9c700 1 --2- 172.21.15.154:0/200206956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b1b40 0x7febf40b3ac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7febec009e60 tx=0x7febec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135353e2ba03be18 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:28.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.325+0000 7febebfff700 1 -- 172.21.15.154:0/200206956 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00e070 con 0x7febf40b1b40 2023-10-10T21:03:28.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.325+0000 7febebfff700 1 -- 172.21.15.154:0/200206956 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00bab0 con 0x7febf40b1b40 2023-10-10T21:03:28.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.325+0000 7febebfff700 1 -- 172.21.15.154:0/200206956 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00be50 con 0x7febf40b1b40 2023-10-10T21:03:28.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.326+0000 7febfa59d700 1 -- 172.21.15.154:0/200206956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b1b40 msgr2=0x7febf40b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.326+0000 7febfa59d700 1 --2- 172.21.15.154:0/200206956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b1b40 0x7febf40b3ac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7febec009e60 tx=0x7febec009780 comp rx=0 tx=0).stop 2023-10-10T21:03:28.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.326+0000 7febfa59d700 1 -- 172.21.15.154:0/200206956 shutdown_connections 2023-10-10T21:03:28.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.326+0000 7febfa59d700 1 --2- 172.21.15.154:0/200206956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b1b40 0x7febf40b3ac0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.326+0000 7febfa59d700 1 -- 172.21.15.154:0/200206956 >> 172.21.15.154:0/200206956 conn(0x7febf40d10c0 msgr2=0x7febf40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:28.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.326+0000 7febfa59d700 1 -- 172.21.15.154:0/200206956 shutdown_connections 2023-10-10T21:03:28.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.326+0000 7febfa59d700 1 -- 172.21.15.154:0/200206956 wait complete. 2023-10-10T21:03:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.327+0000 7febfa59d700 1 Processor -- start 2023-10-10T21:03:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.328+0000 7febfa59d700 1 -- start start 2023-10-10T21:03:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.328+0000 7febfa59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b16d0 0x7febf4169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.328+0000 7febfa59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b1b40 0x7febf40c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febfa59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 0x7febf41490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febfa59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf416ad90 con 0x7febf40b4e70 2023-10-10T21:03:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febfa59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40c8830 con 0x7febf40b16d0 2023-10-10T21:03:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febfa59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf416d640 con 0x7febf40b1b40 2023-10-10T21:03:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf959b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b16d0 0x7febf4169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf9d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 0x7febf41490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf8d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b1b40 0x7febf40c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf959b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b16d0 0x7febf4169e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:40924/0 (socket says 172.21.15.154:40924) 2023-10-10T21:03:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf959b700 1 -- 172.21.15.154:0/4113703207 learned_addr learned my addr 172.21.15.154:0/4113703207 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf959b700 1 -- 172.21.15.154:0/4113703207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b1b40 msgr2=0x7febf40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf959b700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b1b40 0x7febf40c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf959b700 1 -- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 msgr2=0x7febf41490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf959b700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 0x7febf41490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf959b700 1 -- 172.21.15.154:0/4113703207 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec009a20 con 0x7febf40b16d0 2023-10-10T21:03:28.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.329+0000 7febf9d9c700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 0x7febf41490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:28.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.330+0000 7febf959b700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b16d0 0x7febf4169e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7febf000c5b0 tx=0x7febf0007e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:28.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.330+0000 7febe97fa700 1 -- 172.21.15.154:0/4113703207 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0010510 con 0x7febf40b16d0 2023-10-10T21:03:28.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.330+0000 7febe97fa700 1 -- 172.21.15.154:0/4113703207 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf0010670 con 0x7febf40b16d0 2023-10-10T21:03:28.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.330+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf41495e0 con 0x7febf40b16d0 2023-10-10T21:03:28.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.330+0000 7febe97fa700 1 -- 172.21.15.154:0/4113703207 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0010a30 con 0x7febf40b16d0 2023-10-10T21:03:28.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.330+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf416a7d0 con 0x7febf40b16d0 2023-10-10T21:03:28.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.331+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf416d920 con 0x7febf40b16d0 2023-10-10T21:03:28.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.332+0000 7febe97fa700 1 -- 172.21.15.154:0/4113703207 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7febf001b400 con 0x7febf40b16d0 2023-10-10T21:03:28.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.333+0000 7febe97fa700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febd8066f80 0x7febd8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.333+0000 7febf8d9a700 1 -- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febd8066f80 msgr2=0x7febd8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:03:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.333+0000 7febe97fa700 1 -- 172.21.15.154:0/4113703207 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7febf00840a0 con 0x7febf40b16d0 2023-10-10T21:03:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.333+0000 7febf8d9a700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febd8066f80 0x7febd8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:03:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.338+0000 7febe97fa700 1 -- 172.21.15.154:0/4113703207 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febf0051270 con 0x7febf40b16d0 2023-10-10T21:03:28.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.534+0000 7febf8d9a700 1 -- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febd8066f80 msgr2=0x7febd8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:03:28.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.534+0000 7febf8d9a700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febd8066f80 0x7febd8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:03:28.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.541+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7febf40ccbc0 con 0x7febf40b16d0 2023-10-10T21:03:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.546+0000 7febe97fa700 1 -- 172.21.15.154:0/4113703207 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7febf0054890 con 0x7febf40b16d0 2023-10-10T21:03:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febd8066f80 msgr2=0x7febd8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:03:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febd8066f80 0x7febd8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b16d0 msgr2=0x7febf4169e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b16d0 0x7febf4169e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7febf000c5b0 tx=0x7febf0007e10 comp rx=0 tx=0).stop 2023-10-10T21:03:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 shutdown_connections 2023-10-10T21:03:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf40b4e70 0x7febf41490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf40b16d0 0x7febf4169e10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febd8066f80 0x7febd8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 --2- 172.21.15.154:0/4113703207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf40b1b40 0x7febf40c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 >> 172.21.15.154:0/4113703207 conn(0x7febf40d10c0 msgr2=0x7febf415c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 shutdown_connections 2023-10-10T21:03:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.549+0000 7febfa59d700 1 -- 172.21.15.154:0/4113703207 wait complete. 2023-10-10T21:03:28.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T21:03:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.757+0000 7fd3ce79d700 1 Processor -- start 2023-10-10T21:03:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.757+0000 7fd3ce79d700 1 -- start start 2023-10-10T21:03:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.758+0000 7fd3ce79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b4e70 0x7fd3c80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.758+0000 7fd3ce79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3c80b16d0 0x7fd3c80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.758+0000 7fd3ce79d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c80b2080 con 0x7fd3c815d240 2023-10-10T21:03:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.758+0000 7fd3ce79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c80cfb00 con 0x7fd3c80b16d0 2023-10-10T21:03:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.758+0000 7fd3ce79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c80b5c40 con 0x7fd3c80b4e70 2023-10-10T21:03:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3cdf9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3c815d240 0x7fd3c815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54004/0 (socket says 172.21.15.154:54004) 2023-10-10T21:03:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3cdf9c700 1 -- 172.21.15.154:0/503598129 learned_addr learned my addr 172.21.15.154:0/503598129 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3ccf9a700 1 --2- 172.21.15.154:0/503598129 >> v2:172.21.15.179:3300/0 conn(0x7fd3c80b16d0 0x7fd3c80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3cd79b700 1 --2- 172.21.15.154:0/503598129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b4e70 0x7fd3c80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3bffff700 1 -- 172.21.15.154:0/503598129 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702252479 0 0) 0x7fd3c80b2080 con 0x7fd3c815d240 2023-10-10T21:03:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3bffff700 1 -- 172.21.15.154:0/503598129 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b4003570 con 0x7fd3c815d240 2023-10-10T21:03:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3cd79b700 1 -- 172.21.15.154:0/503598129 >> v2:172.21.15.179:3300/0 conn(0x7fd3c80b16d0 msgr2=0x7fd3c80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3cd79b700 1 --2- 172.21.15.154:0/503598129 >> v2:172.21.15.179:3300/0 conn(0x7fd3c80b16d0 0x7fd3c80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3cd79b700 1 -- 172.21.15.154:0/503598129 >> v1:172.21.15.154:6789/0 conn(0x7fd3c815d240 legacy=0x7fd3c815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3cd79b700 1 -- 172.21.15.154:0/503598129 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c80b5f20 con 0x7fd3c80b4e70 2023-10-10T21:03:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.759+0000 7fd3cd79b700 1 --2- 172.21.15.154:0/503598129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b4e70 0x7fd3c80ccff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40098e0 tx=0x7fd3c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a04e143e4bc8b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3bffff700 1 -- 172.21.15.154:0/503598129 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4011630 con 0x7fd3c80b4e70 2023-10-10T21:03:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3bffff700 1 -- 172.21.15.154:0/503598129 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4011790 con 0x7fd3c80b4e70 2023-10-10T21:03:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3bffff700 1 -- 172.21.15.154:0/503598129 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4011b30 con 0x7fd3c80b4e70 2023-10-10T21:03:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3ce79d700 1 -- 172.21.15.154:0/503598129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b4e70 msgr2=0x7fd3c80ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3ce79d700 1 --2- 172.21.15.154:0/503598129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b4e70 0x7fd3c80ccff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40098e0 tx=0x7fd3c40091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3ce79d700 1 -- 172.21.15.154:0/503598129 shutdown_connections 2023-10-10T21:03:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3ce79d700 1 --2- 172.21.15.154:0/503598129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b4e70 0x7fd3c80ccff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3ce79d700 1 --2- 172.21.15.154:0/503598129 >> v2:172.21.15.179:3300/0 conn(0x7fd3c80b16d0 0x7fd3c80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3ce79d700 1 -- 172.21.15.154:0/503598129 >> 172.21.15.154:0/503598129 conn(0x7fd3c80d10c0 msgr2=0x7fd3c80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3ce79d700 1 -- 172.21.15.154:0/503598129 shutdown_connections 2023-10-10T21:03:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.760+0000 7fd3ce79d700 1 -- 172.21.15.154:0/503598129 wait complete. 2023-10-10T21:03:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.762+0000 7fd3ce79d700 1 Processor -- start 2023-10-10T21:03:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.762+0000 7fd3ce79d700 1 -- start start 2023-10-10T21:03:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3ce79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b16d0 0x7fd3c81527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3ce79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c80b4e70 0x7fd3c815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3ce79d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c815d240 0x7fd3c815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3ce79d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8152dd0 con 0x7fd3c815d240 2023-10-10T21:03:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3ce79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c81530b0 con 0x7fd3c80b4e70 2023-10-10T21:03:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3ce79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8153390 con 0x7fd3c80b16d0 2023-10-10T21:03:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3cdf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c815d240 0x7fd3c815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3cdf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c815d240 0x7fd3c815a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35648/0 (socket says 172.21.15.154:35648) 2023-10-10T21:03:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3cdf9c700 1 -- 172.21.15.154:0/1544927678 learned_addr learned my addr 172.21.15.154:0/1544927678 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.763+0000 7fd3cd79b700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b16d0 0x7fd3c81527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3ccf9a700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c80b4e70 0x7fd3c815b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3cdf9c700 1 -- 172.21.15.154:0/1544927678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b16d0 msgr2=0x7fd3c81527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3cdf9c700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b16d0 0x7fd3c81527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3cdf9c700 1 -- 172.21.15.154:0/1544927678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c80b4e70 msgr2=0x7fd3c815b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3cdf9c700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c80b4e70 0x7fd3c815b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3cdf9c700 1 -- 172.21.15.154:0/1544927678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4009420 con 0x7fd3c815d240 2023-10-10T21:03:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3cdf9c700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c815d240 0x7fd3c815a300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0001460 tx=0x7fd3c0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3bd7fa700 1 -- 172.21.15.154:0/1544927678 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000a8a0 con 0x7fd3c815d240 2023-10-10T21:03:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3bd7fa700 1 -- 172.21.15.154:0/1544927678 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c000aa00 con 0x7fd3c815d240 2023-10-10T21:03:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3bd7fa700 1 -- 172.21.15.154:0/1544927678 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000ad80 con 0x7fd3c815d240 2023-10-10T21:03:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c8153670 con 0x7fd3c815d240 2023-10-10T21:03:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.764+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c815bc00 con 0x7fd3c815d240 2023-10-10T21:03:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.765+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c8088990 con 0x7fd3c815d240 2023-10-10T21:03:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.767+0000 7fd3bd7fa700 1 -- 172.21.15.154:0/1544927678 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fd3c0007300 con 0x7fd3c815d240 2023-10-10T21:03:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.768+0000 7fd3bd7fa700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd3ac066f80 0x7fd3ac069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.769+0000 7fd3cd79b700 1 -- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd3ac066f80 msgr2=0x7fd3ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:03:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.769+0000 7fd3bd7fa700 1 -- 172.21.15.154:0/1544927678 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3c0084960 con 0x7fd3c815d240 2023-10-10T21:03:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.769+0000 7fd3cd79b700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd3ac066f80 0x7fd3ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:03:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.773+0000 7fd3bd7fa700 1 -- 172.21.15.154:0/1544927678 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3c0051bc0 con 0x7fd3c815d240 2023-10-10T21:03:28.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.970+0000 7fd3cd79b700 1 -- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd3ac066f80 msgr2=0x7fd3ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:03:28.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.970+0000 7fd3cd79b700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd3ac066f80 0x7fd3ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:03:28.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.975+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fd3c804bb80 con 0x7fd3c815d240 2023-10-10T21:03:28.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.980+0000 7fd3bd7fa700 1 -- 172.21.15.154:0/1544927678 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd3c00551e0 con 0x7fd3c815d240 2023-10-10T21:03:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd3ac066f80 msgr2=0x7fd3ac069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:03:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd3ac066f80 0x7fd3ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c815d240 msgr2=0x7fd3c815a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c815d240 0x7fd3c815a300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0001460 tx=0x7fd3c0001a40 comp rx=0 tx=0).stop 2023-10-10T21:03:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 shutdown_connections 2023-10-10T21:03:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c815d240 0x7fd3c815a300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd3ac066f80 0x7fd3ac069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3c80b16d0 0x7fd3c81527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 --2- 172.21.15.154:0/1544927678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3c80b4e70 0x7fd3c815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 >> 172.21.15.154:0/1544927678 conn(0x7fd3c80d10c0 msgr2=0x7fd3c80cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 shutdown_connections 2023-10-10T21:03:28.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:28.983+0000 7fd3ce79d700 1 -- 172.21.15.154:0/1544927678 wait complete. 2023-10-10T21:03:29.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:29.003 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-10T21:03:29.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:29.048 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-10-10T21:03:29.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-10-10T21:03:29.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.359+0000 7f4001f9d700 1 Processor -- start 2023-10-10T21:03:29.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.359+0000 7f4001f9d700 1 -- start start 2023-10-10T21:03:29.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.360+0000 7f4001f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ffc0b03c0 0x7f3ffc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:29.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.360+0000 7f4001f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0cfa00 con 0x7f3ffc0b0790 2023-10-10T21:03:29.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.360+0000 7f4001f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0cb580 con 0x7f3ffc1591e0 2023-10-10T21:03:29.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.360+0000 7f4001f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc0cf160 con 0x7f3ffc0b03c0 2023-10-10T21:03:29.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.361+0000 7f4000f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ffc0b03c0 0x7f3ffc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:29.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.361+0000 7f3ffbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3ffc0b0790 0x7f3ffc0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54006/0 (socket says 172.21.15.154:54006) 2023-10-10T21:03:29.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.361+0000 7f3ffbfff700 1 -- 172.21.15.154:0/318736626 learned_addr learned my addr 172.21.15.154:0/318736626 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:29.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.361+0000 7f3ffb7fe700 1 -- 172.21.15.154:0/318736626 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885520199 0 0) 0x7f3ffc0cfa00 con 0x7f3ffc0b0790 2023-10-10T21:03:29.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.361+0000 7f3ffb7fe700 1 -- 172.21.15.154:0/318736626 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fec003570 con 0x7f3ffc0b0790 2023-10-10T21:03:29.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.361+0000 7f4000f9b700 1 -- 172.21.15.154:0/318736626 >> v1:172.21.15.179:6789/0 conn(0x7f3ffc1591e0 legacy=0x7f3ffc159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:29.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.361+0000 7f4000f9b700 1 -- 172.21.15.154:0/318736626 >> v1:172.21.15.154:6789/0 conn(0x7f3ffc0b0790 legacy=0x7f3ffc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:29.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.361+0000 7f4000f9b700 1 -- 172.21.15.154:0/318736626 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0cf440 con 0x7f3ffc0b03c0 2023-10-10T21:03:29.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.361+0000 7f4000f9b700 1 --2- 172.21.15.154:0/318736626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b03c0 0x7f3ffc0cea70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009910 tx=0x7f3ff00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19403eaa2ca3b857 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:29.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.362+0000 7f3ffb7fe700 1 -- 172.21.15.154:0/318736626 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000b640 con 0x7f3ffc0b03c0 2023-10-10T21:03:29.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.362+0000 7f3ffb7fe700 1 -- 172.21.15.154:0/318736626 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff000b7a0 con 0x7f3ffc0b03c0 2023-10-10T21:03:29.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.362+0000 7f3ffb7fe700 1 -- 172.21.15.154:0/318736626 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000bb60 con 0x7f3ffc0b03c0 2023-10-10T21:03:29.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.362+0000 7f4001f9d700 1 -- 172.21.15.154:0/318736626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b03c0 msgr2=0x7f3ffc0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:29.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.362+0000 7f4001f9d700 1 --2- 172.21.15.154:0/318736626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b03c0 0x7f3ffc0cea70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009910 tx=0x7f3ff00091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:29.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.362+0000 7f4001f9d700 1 -- 172.21.15.154:0/318736626 shutdown_connections 2023-10-10T21:03:29.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.362+0000 7f4001f9d700 1 --2- 172.21.15.154:0/318736626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b03c0 0x7f3ffc0cea70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:29.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.362+0000 7f4001f9d700 1 -- 172.21.15.154:0/318736626 >> 172.21.15.154:0/318736626 conn(0x7f3ffc063230 msgr2=0x7f3ffc063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:29.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.363+0000 7f4001f9d700 1 -- 172.21.15.154:0/318736626 shutdown_connections 2023-10-10T21:03:29.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.363+0000 7f4001f9d700 1 -- 172.21.15.154:0/318736626 wait complete. 2023-10-10T21:03:29.368 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:29.362+0000 7fb3c2a37180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:03:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.364+0000 7f4001f9d700 1 Processor -- start 2023-10-10T21:03:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.364+0000 7f4001f9d700 1 -- start start 2023-10-10T21:03:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f4001f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ffc0b03c0 0x7f3ffc15ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f4001f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b0790 0x7f3ffc0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f4001f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ffc1591e0 0x7f3ffc158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f4001f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0c9980 con 0x7f3ffc0b0790 2023-10-10T21:03:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f4001f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc159000 con 0x7f3ffc0b03c0 2023-10-10T21:03:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f4001f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0c9b90 con 0x7f3ffc1591e0 2023-10-10T21:03:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f3ffbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b0790 0x7f3ffc0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f3ffbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b0790 0x7f3ffc0c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35674/0 (socket says 172.21.15.154:35674) 2023-10-10T21:03:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f3ffbfff700 1 -- 172.21.15.154:0/967346627 learned_addr learned my addr 172.21.15.154:0/967346627 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f4000f9b700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ffc0b03c0 0x7f3ffc15ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.365+0000 7f400179c700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ffc1591e0 0x7f3ffc158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f3ffbfff700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ffc1591e0 msgr2=0x7f3ffc158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f3ffbfff700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ffc1591e0 0x7f3ffc158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f3ffbfff700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ffc0b03c0 msgr2=0x7f3ffc15ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f3ffbfff700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ffc0b03c0 0x7f3ffc15ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f3ffbfff700 1 -- 172.21.15.154:0/967346627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff0009420 con 0x7f3ffc0b0790 2023-10-10T21:03:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f4000f9b700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ffc0b03c0 0x7f3ffc15ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f3ffbfff700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b0790 0x7f3ffc0c9440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800c7c0 tx=0x7f3fe8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8005cd0 con 0x7f3ffc0b0790 2023-10-10T21:03:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8005e30 con 0x7f3ffc0b0790 2023-10-10T21:03:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc0c9e70 con 0x7f3ffc0b0790 2023-10-10T21:03:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8007320 con 0x7f3ffc0b0790 2023-10-10T21:03:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.366+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc0ca430 con 0x7f3ffc0b0790 2023-10-10T21:03:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.367+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc04c3c0 con 0x7f3ffc0b0790 2023-10-10T21:03:29.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.368+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3fe801b3b0 con 0x7f3ffc0b0790 2023-10-10T21:03:29.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.369+0000 7f3ff8ff9700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.369+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fe8083c30 con 0x7f3ffc0b0790 2023-10-10T21:03:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.369+0000 7f4000f9b700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 msgr2=0x7f3fe0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:03:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.369+0000 7f4000f9b700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:03:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.373+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fe8050ea0 con 0x7f3ffc0b0790 2023-10-10T21:03:29.462 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:29.461+0000 7fea9ceb9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:03:29.524 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:29.522+0000 7fb3c2a37180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:03:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.570+0000 7f4000f9b700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 msgr2=0x7f3fe0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:03:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.570+0000 7f4000f9b700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:03:29.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.599+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ffc0cad50 con 0x7f3fe0066f80 2023-10-10T21:03:29.609 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:29.607+0000 7fb3c2a37180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:03:29.631 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:29.630+0000 7fea9ceb9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:03:29.719 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:29.718+0000 7fea9ceb9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:03:29.829 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:29.828+0000 7fb3c2a37180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:03:29.946 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:29.944+0000 7fea9ceb9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:03:29.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.971+0000 7f4000f9b700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 msgr2=0x7f3fe0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:03:29.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:29.971+0000 7f4000f9b700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:03:30.003 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:30.001+0000 7fb3c2a37180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:03:30.096 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:30.095+0000 7fb3c2a37180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:03:30.130 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:30.129+0000 7fea9ceb9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:03:30.223 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:30.222+0000 7fea9ceb9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:03:30.256 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:30.255+0000 7fb3c2a37180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:03:30.355 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:30.353+0000 7fb3c2a37180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:03:30.386 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:30.384+0000 7fea9ceb9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:03:30.487 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:30.486+0000 7fea9ceb9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:03:30.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:30.772+0000 7f4000f9b700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 msgr2=0x7f3fe0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:03:30.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:30.772+0000 7f4000f9b700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T21:03:30.831 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:30.830+0000 7fb3c2a37180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:03:30.923 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:30.922+0000 7fb3c2a37180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:03:30.974 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:30.973+0000 7fea9ceb9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:03:31.011 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:31.009+0000 7fb3c2a37180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:03:31.070 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:31.068+0000 7fea9ceb9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:03:31.161 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:31.159+0000 7fea9ceb9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:03:31.626 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:31.624+0000 7fb3c2a37180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:03:31.792 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:31.791+0000 7fea9ceb9180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:03:31.795 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:31.794+0000 7fb3c2a37180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:03:31.889 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:31.887+0000 7fb3c2a37180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:03:31.964 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:31.963+0000 7fea9ceb9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:03:32.060 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:32.059+0000 7fea9ceb9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:03:32.182 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:32.181+0000 7fb3c2a37180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:03:32.276 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:32.275+0000 7fb3c2a37180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:03:32.359 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:32.358+0000 7fea9ceb9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:03:32.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:32.374+0000 7f4000f9b700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 msgr2=0x7f3fe0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:03:32.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:32.374+0000 7f4000f9b700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T21:03:32.456 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:32.455+0000 7fea9ceb9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:03:32.970 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:32.968+0000 7fb3c2a37180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:03:33.163 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:33.162+0000 7fea9ceb9180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:03:33.259 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:33.258+0000 7fb3c2a37180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:03:33.353 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:33.351+0000 7fb3c2a37180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:03:33.451 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:33.450+0000 7fea9ceb9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:03:33.503 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:33.502+0000 7fb3c2a37180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:03:33.542 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:33.541+0000 7fea9ceb9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:03:33.606 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:33.605+0000 7fb3c2a37180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:03:33.696 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:33.695+0000 7fea9ceb9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:03:33.792 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:33.791+0000 7fb3c2a37180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:03:33.798 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:33.797+0000 7fea9ceb9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:03:33.883 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:33.881+0000 7fb3c2a37180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:03:33.972 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:33.970+0000 7fb3c2a37180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:03:33.986 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:33.985+0000 7fea9ceb9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:03:34.062 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:03:34.061+0000 7fb3c2a37180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:03:34.080 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.079+0000 7fea9ceb9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:03:34.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:34.122+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 7) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3fe8051270 con 0x7f3ffc0b0790 2023-10-10T21:03:34.179 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.178+0000 7fea9ceb9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:03:34.273 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.272+0000 7fea9ceb9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:03:34.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:34.282+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mgrmap(e 8) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f3fe8054dc0 con 0x7f3ffc0b0790 2023-10-10T21:03:34.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:34.282+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 msgr2=0x7f3fe0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:03:34.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:34.282+0000 7f3ff8ff9700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:34.422 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.420+0000 7fea121f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:34.422 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.420+0000 7fea121f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:34.423 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.420+0000 7fea121f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:34.423 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.420+0000 7fea121f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:34.423 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.420+0000 7fea121f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:34.423 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.421+0000 7fea0f1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:34.423 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.421+0000 7fea0f1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:34.424 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.421+0000 7fea0f1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:34.424 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.421+0000 7fea0f1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:34.424 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:03:34.421+0000 7fea0f1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:03:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.287+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mon.0 v2:172.21.15.154:3300/0 9 ==== mgrmap(e 9) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f3fe806ae30 con 0x7f3ffc0b0790 2023-10-10T21:03:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.287+0000 7f3ff8ff9700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.287+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ffc0cad50 con 0x7f3fe0066f80 2023-10-10T21:03:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.290+0000 7f4000f9b700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:35.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.296+0000 7f4000f9b700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe00693b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00093f0 tx=0x7f3ff0017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:35.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.388+0000 7f3ff8ff9700 1 -- 172.21.15.154:0/967346627 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3ffc0cad50 con 0x7f3fe0066f80 2023-10-10T21:03:35.390 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir0 2023-10-10T21:03:35.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 msgr2=0x7f3fe00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:35.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe00693b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00093f0 tx=0x7f3ff0017000 comp rx=0 tx=0).stop 2023-10-10T21:03:35.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b0790 msgr2=0x7f3ffc0c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:35.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b0790 0x7f3ffc0c9440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800c7c0 tx=0x7f3fe8007e00 comp rx=0 tx=0).stop 2023-10-10T21:03:35.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 shutdown_connections 2023-10-10T21:03:35.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3fe0066f80 0x7f3fe00693b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ffc1591e0 0x7f3ffc158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ffc0b03c0 0x7f3ffc15ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 --2- 172.21.15.154:0/967346627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ffc0b0790 0x7f3ffc0c9440 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 >> 172.21.15.154:0/967346627 conn(0x7f3ffc063230 msgr2=0x7f3ffc068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:35.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 shutdown_connections 2023-10-10T21:03:35.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.391+0000 7f4001f9d700 1 -- 172.21.15.154:0/967346627 wait complete. 2023-10-10T21:03:35.410 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-10-10T21:03:35.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:35.411 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-10-10T21:03:35.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-10-10T21:03:35.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.675+0000 7ff53b7ff700 1 Processor -- start 2023-10-10T21:03:35.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.675+0000 7ff53b7ff700 1 -- start start 2023-10-10T21:03:35.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.676+0000 7ff53b7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5340c8490 0x7ff5340c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:35.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.676+0000 7ff53b7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340ac030 con 0x7ff534069e20 2023-10-10T21:03:35.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff53b7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340ab820 con 0x7ff534069a50 2023-10-10T21:03:35.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff53b7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53406dbb0 con 0x7ff5340c8490 2023-10-10T21:03:35.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff538d9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5340c8490 0x7ff5340c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:35.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff539d9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff534069e20 0x7ff5341569b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54016/0 (socket says 172.21.15.154:54016) 2023-10-10T21:03:35.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff539d9c700 1 -- 172.21.15.154:0/2631764325 learned_addr learned my addr 172.21.15.154:0/2631764325 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:35.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff52bfff700 1 -- 172.21.15.154:0/2631764325 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562658838 0 0) 0x7ff52c001490 con 0x7ff534069e20 2023-10-10T21:03:35.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff52bfff700 1 -- 172.21.15.154:0/2631764325 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff520004680 con 0x7ff534069e20 2023-10-10T21:03:35.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff538d9a700 1 -- 172.21.15.154:0/2631764325 >> v1:172.21.15.179:6789/0 conn(0x7ff534069a50 legacy=0x7ff53415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:35.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff538d9a700 1 -- 172.21.15.154:0/2631764325 >> v1:172.21.15.154:6789/0 conn(0x7ff534069e20 legacy=0x7ff5341569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:35.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.677+0000 7ff538d9a700 1 -- 172.21.15.154:0/2631764325 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340aba70 con 0x7ff5340c8490 2023-10-10T21:03:35.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff538d9a700 1 --2- 172.21.15.154:0/2631764325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 0x7ff5340c6ac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff5240098e0 tx=0x7ff5240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ed165236f4bcb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:35.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff52bfff700 1 -- 172.21.15.154:0/2631764325 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400b640 con 0x7ff5340c8490 2023-10-10T21:03:35.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff52bfff700 1 -- 172.21.15.154:0/2631764325 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52400b7a0 con 0x7ff5340c8490 2023-10-10T21:03:35.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff52bfff700 1 -- 172.21.15.154:0/2631764325 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400bb40 con 0x7ff5340c8490 2023-10-10T21:03:35.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff53b7ff700 1 -- 172.21.15.154:0/2631764325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 msgr2=0x7ff5340c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:35.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff53b7ff700 1 --2- 172.21.15.154:0/2631764325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 0x7ff5340c6ac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff5240098e0 tx=0x7ff5240091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff53b7ff700 1 -- 172.21.15.154:0/2631764325 shutdown_connections 2023-10-10T21:03:35.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff53b7ff700 1 --2- 172.21.15.154:0/2631764325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 0x7ff5340c6ac0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff53b7ff700 1 -- 172.21.15.154:0/2631764325 >> 172.21.15.154:0/2631764325 conn(0x7ff5340c8f90 msgr2=0x7ff5340c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:35.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.678+0000 7ff53b7ff700 1 -- 172.21.15.154:0/2631764325 shutdown_connections 2023-10-10T21:03:35.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.679+0000 7ff53b7ff700 1 -- 172.21.15.154:0/2631764325 wait complete. 2023-10-10T21:03:35.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.680+0000 7ff53b7ff700 1 Processor -- start 2023-10-10T21:03:35.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.680+0000 7ff53b7ff700 1 -- start start 2023-10-10T21:03:35.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff53b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534069a50 0x7ff5340c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:35.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff53b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff534069e20 0x7ff5340b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:35.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff53b7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 0x7ff534154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:35.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff53b7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b1590 con 0x7ff5340c8490 2023-10-10T21:03:35.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff53b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b1f60 con 0x7ff534069e20 2023-10-10T21:03:35.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff53b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b0980 con 0x7ff534069a50 2023-10-10T21:03:35.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff539d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 0x7ff534154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:35.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff539d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 0x7ff534154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35820/0 (socket says 172.21.15.154:35820) 2023-10-10T21:03:35.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff539d9c700 1 -- 172.21.15.154:0/3052348649 learned_addr learned my addr 172.21.15.154:0/3052348649 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:35.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff538d9a700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff534069e20 0x7ff5340b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:35.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.681+0000 7ff53959b700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534069a50 0x7ff5340c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:35.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff539d9c700 1 -- 172.21.15.154:0/3052348649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534069a50 msgr2=0x7ff5340c0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:35.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff539d9c700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534069a50 0x7ff5340c0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff539d9c700 1 -- 172.21.15.154:0/3052348649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff534069e20 msgr2=0x7ff5340b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:35.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff539d9c700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff534069e20 0x7ff5340b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff539d9c700 1 -- 172.21.15.154:0/3052348649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524009420 con 0x7ff5340c8490 2023-10-10T21:03:35.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff539d9c700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 0x7ff534154690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00cc40 tx=0x7ff52c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:35.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff5297fa700 1 -- 172.21.15.154:0/3052348649 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00a8b0 con 0x7ff5340c8490 2023-10-10T21:03:35.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff5297fa700 1 -- 172.21.15.154:0/3052348649 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c00aa10 con 0x7ff5340c8490 2023-10-10T21:03:35.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5340b0c60 con 0x7ff5340c8490 2023-10-10T21:03:35.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff5297fa700 1 -- 172.21.15.154:0/3052348649 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00ad90 con 0x7ff5340c8490 2023-10-10T21:03:35.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.682+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5340b1220 con 0x7ff5340c8490 2023-10-10T21:03:35.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.683+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5340b1700 con 0x7ff5340c8490 2023-10-10T21:03:35.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.684+0000 7ff5297fa700 1 -- 172.21.15.154:0/3052348649 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 9) v1 ==== 84595+0+0 (secure 0 0 0) 0x7ff52c007300 con 0x7ff5340c8490 2023-10-10T21:03:35.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.685+0000 7ff5297fa700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff518066dd0 0x7ff518069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:35.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.685+0000 7ff5297fa700 1 -- 172.21.15.154:0/3052348649 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff52c0845d0 con 0x7ff5340c8490 2023-10-10T21:03:35.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.685+0000 7ff53959b700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff518066dd0 0x7ff518069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:35.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.686+0000 7ff53959b700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff518066dd0 0x7ff518069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff5300037c0 tx=0x7ff530009040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:35.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.689+0000 7ff5297fa700 1 -- 172.21.15.154:0/3052348649 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff52c0519a0 con 0x7ff5340c8490 2023-10-10T21:03:35.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.907+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5340ac030 con 0x7ff518066dd0 2023-10-10T21:03:35.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.976+0000 7ff5297fa700 1 -- 172.21.15.154:0/3052348649 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff5340ac030 con 0x7ff518066dd0 2023-10-10T21:03:35.979 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir1 2023-10-10T21:03:35.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff518066dd0 msgr2=0x7ff518069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:35.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff518066dd0 0x7ff518069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff5300037c0 tx=0x7ff530009040 comp rx=0 tx=0).stop 2023-10-10T21:03:35.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 msgr2=0x7ff534154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:35.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 0x7ff534154690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00cc40 tx=0x7ff52c001a30 comp rx=0 tx=0).stop 2023-10-10T21:03:35.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 shutdown_connections 2023-10-10T21:03:35.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5340c8490 0x7ff534154690 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff518066dd0 0x7ff518069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534069a50 0x7ff5340c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 --2- 172.21.15.154:0/3052348649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff534069e20 0x7ff5340b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:35.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 >> 172.21.15.154:0/3052348649 conn(0x7ff5340c8f90 msgr2=0x7ff534156e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:35.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 shutdown_connections 2023-10-10T21:03:35.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:35.979+0000 7ff53b7ff700 1 -- 172.21.15.154:0/3052348649 wait complete. 2023-10-10T21:03:35.999 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-10-10T21:03:35.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:36.000 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-10-10T21:03:36.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-10-10T21:03:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.264+0000 7ff01edff700 1 Processor -- start 2023-10-10T21:03:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.264+0000 7ff01edff700 1 -- start start 2023-10-10T21:03:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.265+0000 7ff01edff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff018154320 0x7ff01806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.265+0000 7ff01edff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff01815a190 0x7ff01806d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.265+0000 7ff01edff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0180b4570 con 0x7ff018153f50 2023-10-10T21:03:36.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.265+0000 7ff01edff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0180b2710 con 0x7ff01815a190 2023-10-10T21:03:36.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.265+0000 7ff01edff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01815a730 con 0x7ff018154320 2023-10-10T21:03:36.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.265+0000 7ff01d39c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff01815a190 0x7ff01806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.265+0000 7ff01cb9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff018153f50 0x7ff0180b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40450/0 (socket says 172.21.15.154:40450) 2023-10-10T21:03:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff01cb9b700 1 -- 172.21.15.154:0/1292245623 learned_addr learned my addr 172.21.15.154:0/1292245623 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:36.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff00ffff700 1 --2- 172.21.15.154:0/1292245623 >> v2:172.21.15.179:3300/0 conn(0x7ff018154320 0x7ff01806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff01d39c700 1 -- 172.21.15.154:0/1292245623 >> v2:172.21.15.179:3300/0 conn(0x7ff018154320 msgr2=0x7ff01806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:36.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff01d39c700 1 --2- 172.21.15.154:0/1292245623 >> v2:172.21.15.179:3300/0 conn(0x7ff018154320 0x7ff01806d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff01d39c700 1 -- 172.21.15.154:0/1292245623 >> v1:172.21.15.154:6789/0 conn(0x7ff018153f50 legacy=0x7ff0180b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff01d39c700 1 -- 172.21.15.154:0/1292245623 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01815aa10 con 0x7ff01815a190 2023-10-10T21:03:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff00f7fe700 1 -- 172.21.15.154:0/1292245623 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063073302 0 0) 0x7ff0180b4570 con 0x7ff018153f50 2023-10-10T21:03:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff00ffff700 1 --2- 172.21.15.154:0/1292245623 >> v2:172.21.15.179:3300/0 conn(0x7ff018154320 0x7ff01806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff01d39c700 1 --2- 172.21.15.154:0/1292245623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01815a190 0x7ff01806d670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff0180b36a0 tx=0x7ff010009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f40e3ca7d87ce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.266+0000 7ff00f7fe700 1 -- 172.21.15.154:0/1292245623 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000e070 con 0x7ff01815a190 2023-10-10T21:03:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff00f7fe700 1 -- 172.21.15.154:0/1292245623 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01000bc30 con 0x7ff01815a190 2023-10-10T21:03:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff00f7fe700 1 -- 172.21.15.154:0/1292245623 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff010012430 con 0x7ff01815a190 2023-10-10T21:03:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff01edff700 1 -- 172.21.15.154:0/1292245623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01815a190 msgr2=0x7ff01806d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff01edff700 1 --2- 172.21.15.154:0/1292245623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01815a190 0x7ff01806d670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff0180b36a0 tx=0x7ff010009780 comp rx=0 tx=0).stop 2023-10-10T21:03:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff01edff700 1 -- 172.21.15.154:0/1292245623 shutdown_connections 2023-10-10T21:03:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff01edff700 1 --2- 172.21.15.154:0/1292245623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01815a190 0x7ff01806d670 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff01edff700 1 --2- 172.21.15.154:0/1292245623 >> v2:172.21.15.179:3300/0 conn(0x7ff018154320 0x7ff01806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff01edff700 1 -- 172.21.15.154:0/1292245623 >> 172.21.15.154:0/1292245623 conn(0x7ff01806baf0 msgr2=0x7ff01806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff01edff700 1 -- 172.21.15.154:0/1292245623 shutdown_connections 2023-10-10T21:03:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.267+0000 7ff01edff700 1 -- 172.21.15.154:0/1292245623 wait complete. 2023-10-10T21:03:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.269+0000 7ff01edff700 1 Processor -- start 2023-10-10T21:03:36.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.269+0000 7ff01edff700 1 -- start start 2023-10-10T21:03:36.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff01edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff018153f50 0x7ff0181453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff01edff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff018154320 0x7ff0180cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff01edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01815a190 0x7ff01815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff01edff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180cd000 con 0x7ff018154320 2023-10-10T21:03:36.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff01edff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180cc6d0 con 0x7ff018153f50 2023-10-10T21:03:36.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff01edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180cc9b0 con 0x7ff01815a190 2023-10-10T21:03:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff00ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff018154320 0x7ff0180cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff00ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff018154320 0x7ff0180cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35162/0 (socket says 172.21.15.154:35162) 2023-10-10T21:03:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff00ffff700 1 -- 172.21.15.154:0/1120102864 learned_addr learned my addr 172.21.15.154:0/1120102864 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff01cb9b700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff018153f50 0x7ff0181453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff01d39c700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01815a190 0x7ff01815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff00ffff700 1 -- 172.21.15.154:0/1120102864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01815a190 msgr2=0x7ff01815cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff00ffff700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01815a190 0x7ff01815cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff00ffff700 1 -- 172.21.15.154:0/1120102864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff018153f50 msgr2=0x7ff0181453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff00ffff700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff018153f50 0x7ff0181453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff00ffff700 1 -- 172.21.15.154:0/1120102864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010009a20 con 0x7ff018154320 2023-10-10T21:03:36.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.270+0000 7ff01d39c700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01815a190 0x7ff01815cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:36.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.271+0000 7ff00ffff700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff018154320 0x7ff0180cd930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c830 tx=0x7ff008008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:36.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.271+0000 7ff00cff9700 1 -- 172.21.15.154:0/1120102864 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008011600 con 0x7ff018154320 2023-10-10T21:03:36.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.271+0000 7ff00cff9700 1 -- 172.21.15.154:0/1120102864 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008011760 con 0x7ff018154320 2023-10-10T21:03:36.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.271+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0180ccc90 con 0x7ff018154320 2023-10-10T21:03:36.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.271+0000 7ff00cff9700 1 -- 172.21.15.154:0/1120102864 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008011b20 con 0x7ff018154320 2023-10-10T21:03:36.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.271+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0180cc3a0 con 0x7ff018154320 2023-10-10T21:03:36.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.272+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01806d6c0 con 0x7ff018154320 2023-10-10T21:03:36.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.273+0000 7ff00cff9700 1 -- 172.21.15.154:0/1120102864 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 9) v1 ==== 84595+0+0 (secure 0 0 0) 0x7ff0080193b0 con 0x7ff018154320 2023-10-10T21:03:36.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.274+0000 7ff00cff9700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff004066dd0 0x7ff004069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.275+0000 7ff00cff9700 1 -- 172.21.15.154:0/1120102864 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff0080843b0 con 0x7ff018154320 2023-10-10T21:03:36.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.275+0000 7ff01cb9b700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff004066dd0 0x7ff004069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.275+0000 7ff01cb9b700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff004066dd0 0x7ff004069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff014007fd0 tx=0x7ff014007d30 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:36.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.279+0000 7ff00cff9700 1 -- 172.21.15.154:0/1120102864 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff008051700 con 0x7ff018154320 2023-10-10T21:03:36.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.291+0000 7ff00cff9700 1 -- 172.21.15.154:0/1120102864 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7ff008051ad0 con 0x7ff018154320 2023-10-10T21:03:36.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.499+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0180cc840 con 0x7ff004066dd0 2023-10-10T21:03:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.569+0000 7ff00cff9700 1 -- 172.21.15.154:0/1120102864 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff0180cc840 con 0x7ff004066dd0 2023-10-10T21:03:36.572 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir2 2023-10-10T21:03:36.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff004066dd0 msgr2=0x7ff004069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff004066dd0 0x7ff004069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff014007fd0 tx=0x7ff014007d30 comp rx=0 tx=0).stop 2023-10-10T21:03:36.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff018154320 msgr2=0x7ff0180cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff018154320 0x7ff0180cd930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c830 tx=0x7ff008008040 comp rx=0 tx=0).stop 2023-10-10T21:03:36.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 shutdown_connections 2023-10-10T21:03:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff004066dd0 0x7ff004069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01815a190 0x7ff01815cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff018153f50 0x7ff0181453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 --2- 172.21.15.154:0/1120102864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff018154320 0x7ff0180cd930 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 >> 172.21.15.154:0/1120102864 conn(0x7ff01806baf0 msgr2=0x7ff018153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:36.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 shutdown_connections 2023-10-10T21:03:36.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.572+0000 7ff01edff700 1 -- 172.21.15.154:0/1120102864 wait complete. 2023-10-10T21:03:36.592 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-10-10T21:03:36.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:36.593 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-10-10T21:03:36.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-10-10T21:03:36.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.857+0000 7fe27919d700 1 Processor -- start 2023-10-10T21:03:36.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.857+0000 7fe27919d700 1 -- start start 2023-10-10T21:03:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe27919d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe2740b03c0 0x7fe2740cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe27919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2741591e0 0x7fe274159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe27919d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2740cfa00 con 0x7fe2740b0790 2023-10-10T21:03:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe27919d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2740cb580 con 0x7fe2740b03c0 2023-10-10T21:03:36.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe27919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2740cf160 con 0x7fe2741591e0 2023-10-10T21:03:36.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe2737fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe2740b0790 0x7fe2740b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40460/0 (socket says 172.21.15.154:40460) 2023-10-10T21:03:36.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe2737fe700 1 -- 172.21.15.154:0/2231467784 learned_addr learned my addr 172.21.15.154:0/2231467784 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe273fff700 1 --2- 172.21.15.154:0/2231467784 >> v2:172.21.15.179:3300/0 conn(0x7fe2740b03c0 0x7fe2740cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe27899c700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2741591e0 0x7fe274159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764978337 0 0) 0x7fe2740cfa00 con 0x7fe2740b0790 2023-10-10T21:03:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.859+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe25c003570 con 0x7fe2740b0790 2023-10-10T21:03:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 434730363 0 0) 0x7fe25c003570 con 0x7fe2740b0790 2023-10-10T21:03:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2741591e0 msgr2=0x7fe274159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2741591e0 0x7fe274159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 >> v2:172.21.15.179:3300/0 conn(0x7fe2740b03c0 msgr2=0x7fe2740cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 --2- 172.21.15.154:0/2231467784 >> v2:172.21.15.179:3300/0 conn(0x7fe2740b03c0 0x7fe2740cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2740cf440 con 0x7fe2740b0790 2023-10-10T21:03:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fe268001470 con 0x7fe2740b0790 2023-10-10T21:03:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 >> v1:172.21.15.154:6789/0 conn(0x7fe2740b0790 legacy=0x7fe2740b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe25c003a60 0x7fe25c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2741591e0 0x7fe25c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe25c004d50 0x7fe25c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2740cb580 con 0x7fe25c004d50 2023-10-10T21:03:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2740cf160 con 0x7fe25c003a60 2023-10-10T21:03:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c00ba60 con 0x7fe2741591e0 2023-10-10T21:03:36.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe27899c700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe25c004d50 0x7fe25c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe273fff700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe25c003a60 0x7fe25c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe2737fe700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2741591e0 0x7fe25c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe27899c700 1 -- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2741591e0 msgr2=0x7fe25c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:36.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe27899c700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2741591e0 0x7fe25c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe27899c700 1 -- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe25c003a60 msgr2=0x7fe25c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:36.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.860+0000 7fe27899c700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe25c003a60 0x7fe25c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.861+0000 7fe27899c700 1 -- 172.21.15.154:0/2231467784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c003570 con 0x7fe25c004d50 2023-10-10T21:03:36.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.861+0000 7fe27899c700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe25c004d50 0x7fe25c0051c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00e210 tx=0x7fe26c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf1642aba0c77f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:36.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.861+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c00ea60 con 0x7fe25c004d50 2023-10-10T21:03:36.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.861+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c00f040 con 0x7fe25c004d50 2023-10-10T21:03:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.861+0000 7fe272ffd700 1 -- 172.21.15.154:0/2231467784 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c00ee10 con 0x7fe25c004d50 2023-10-10T21:03:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.861+0000 7fe27919d700 1 -- 172.21.15.154:0/2231467784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe25c004d50 msgr2=0x7fe25c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.861+0000 7fe27919d700 1 --2- 172.21.15.154:0/2231467784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe25c004d50 0x7fe25c0051c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00e210 tx=0x7fe26c00b040 comp rx=0 tx=0).stop 2023-10-10T21:03:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.861+0000 7fe27899c700 1 -- 172.21.15.154:0/2231467784 reap_dead start 2023-10-10T21:03:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.862+0000 7fe27919d700 1 -- 172.21.15.154:0/2231467784 shutdown_connections 2023-10-10T21:03:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.862+0000 7fe27919d700 1 -- 172.21.15.154:0/2231467784 >> 172.21.15.154:0/2231467784 conn(0x7fe274063230 msgr2=0x7fe274063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.862+0000 7fe27919d700 1 -- 172.21.15.154:0/2231467784 shutdown_connections 2023-10-10T21:03:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.862+0000 7fe27919d700 1 -- 172.21.15.154:0/2231467784 wait complete. 2023-10-10T21:03:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.863+0000 7fe27919d700 1 Processor -- start 2023-10-10T21:03:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.863+0000 7fe27919d700 1 -- start start 2023-10-10T21:03:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe27919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe25c004d50 0x7fe27414c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe27919d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2740c6d10 0x7fe27415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe27919d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2740c7180 0x7fe27415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe27919d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe274158380 con 0x7fe2740c6d10 2023-10-10T21:03:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe27919d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27415a5a0 con 0x7fe2740c7180 2023-10-10T21:03:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe27919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27415e160 con 0x7fe25c004d50 2023-10-10T21:03:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe2737fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2740c6d10 0x7fe27415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe2737fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2740c6d10 0x7fe27415d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35186/0 (socket says 172.21.15.154:35186) 2023-10-10T21:03:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe2737fe700 1 -- 172.21.15.154:0/828813084 learned_addr learned my addr 172.21.15.154:0/828813084 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe273fff700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe25c004d50 0x7fe27414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.864+0000 7fe27899c700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2740c7180 0x7fe27415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe2737fe700 1 -- 172.21.15.154:0/828813084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe25c004d50 msgr2=0x7fe27414c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe2737fe700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe25c004d50 0x7fe27414c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe2737fe700 1 -- 172.21.15.154:0/828813084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2740c7180 msgr2=0x7fe27415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:36.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe2737fe700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2740c7180 0x7fe27415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:36.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe2737fe700 1 -- 172.21.15.154:0/828813084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe274159990 con 0x7fe2740c6d10 2023-10-10T21:03:36.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe2737fe700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2740c6d10 0x7fe27415d6e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe268007390 tx=0x7fe2740cb6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:36.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe25bfff700 1 -- 172.21.15.154:0/828813084 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268018030 con 0x7fe2740c6d10 2023-10-10T21:03:36.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe25bfff700 1 -- 172.21.15.154:0/828813084 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26800f6c0 con 0x7fe2740c6d10 2023-10-10T21:03:36.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe274159c70 con 0x7fe2740c6d10 2023-10-10T21:03:36.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe25bfff700 1 -- 172.21.15.154:0/828813084 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26800fa80 con 0x7fe2740c6d10 2023-10-10T21:03:36.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.865+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27415a230 con 0x7fe2740c6d10 2023-10-10T21:03:36.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.866+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27404c3c0 con 0x7fe2740c6d10 2023-10-10T21:03:36.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.867+0000 7fe25bfff700 1 -- 172.21.15.154:0/828813084 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fe26801b070 con 0x7fe2740c6d10 2023-10-10T21:03:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.868+0000 7fe25bfff700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe260067130 0x7fe2600695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.868+0000 7fe25bfff700 1 -- 172.21.15.154:0/828813084 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe268019070 con 0x7fe2740c6d10 2023-10-10T21:03:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.868+0000 7fe273fff700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe260067130 0x7fe2600695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.869+0000 7fe273fff700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe260067130 0x7fe2600695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe274158640 tx=0x7fe2640091a0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:36.873+0000 7fe25bfff700 1 -- 172.21.15.154:0/828813084 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2680516b0 con 0x7fe2740c6d10 2023-10-10T21:03:37.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.089+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2740cad50 con 0x7fe260067130 2023-10-10T21:03:37.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.155+0000 7fe25bfff700 1 -- 172.21.15.154:0/828813084 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe2740cad50 con 0x7fe260067130 2023-10-10T21:03:37.158 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir3 2023-10-10T21:03:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe260067130 msgr2=0x7fe2600695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe260067130 0x7fe2600695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe274158640 tx=0x7fe2640091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2740c6d10 msgr2=0x7fe27415d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2740c6d10 0x7fe27415d6e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe268007390 tx=0x7fe2740cb6c0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 shutdown_connections 2023-10-10T21:03:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2740c7180 0x7fe27415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe260067130 0x7fe2600695e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe25c004d50 0x7fe27414c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 --2- 172.21.15.154:0/828813084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2740c6d10 0x7fe27415d6e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 >> 172.21.15.154:0/828813084 conn(0x7fe274063230 msgr2=0x7fe2740b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:37.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 shutdown_connections 2023-10-10T21:03:37.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.158+0000 7fe27919d700 1 -- 172.21.15.154:0/828813084 wait complete. 2023-10-10T21:03:37.178 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-10-10T21:03:37.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:37.178 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-10-10T21:03:37.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-10-10T21:03:37.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.444+0000 7ff7869ff700 1 Processor -- start 2023-10-10T21:03:37.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.445+0000 7ff7869ff700 1 -- start start 2023-10-10T21:03:37.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff7869ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7801563b0 0x7ff780156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:37.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff7869ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780068890 0x7ff7800c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:37.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff7869ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78015a9b0 con 0x7ff78015a440 2023-10-10T21:03:37.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff7869ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78015ac90 con 0x7ff7801563b0 2023-10-10T21:03:37.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff7869ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78015af70 con 0x7ff780068890 2023-10-10T21:03:37.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff77ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7801563b0 0x7ff780156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:37.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff784f9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780068890 0x7ff7800c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:37.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff77ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7801563b0 0x7ff780156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:35748/0 (socket says 172.21.15.154:35748) 2023-10-10T21:03:37.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff784f9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780068890 0x7ff7800c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:50168/0 (socket says 172.21.15.154:50168) 2023-10-10T21:03:37.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.446+0000 7ff77ffff700 1 -- 172.21.15.154:0/387107312 learned_addr learned my addr 172.21.15.154:0/387107312 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:37.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.447+0000 7ff784f9c700 1 -- 172.21.15.154:0/387107312 >> v2:172.21.15.179:3300/0 conn(0x7ff7801563b0 msgr2=0x7ff780156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:37.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.447+0000 7ff784f9c700 1 --2- 172.21.15.154:0/387107312 >> v2:172.21.15.179:3300/0 conn(0x7ff7801563b0 0x7ff780156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.447+0000 7ff784f9c700 1 -- 172.21.15.154:0/387107312 >> v1:172.21.15.179:6789/0 conn(0x7ff78015a440 legacy=0x7ff7800acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:37.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.447+0000 7ff784f9c700 1 -- 172.21.15.154:0/387107312 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78015b250 con 0x7ff780068890 2023-10-10T21:03:37.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.447+0000 7ff77ffff700 1 --2- 172.21.15.154:0/387107312 >> v2:172.21.15.179:3300/0 conn(0x7ff7801563b0 0x7ff780156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:37.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.447+0000 7ff784f9c700 1 --2- 172.21.15.154:0/387107312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780068890 0x7ff7800c8230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff778009e60 tx=0x7ff778009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bfcaa05620c61a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:37.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.447+0000 7ff77f7fe700 1 -- 172.21.15.154:0/387107312 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800e070 con 0x7ff780068890 2023-10-10T21:03:37.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff77f7fe700 1 -- 172.21.15.154:0/387107312 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77800bb60 con 0x7ff780068890 2023-10-10T21:03:37.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff77f7fe700 1 -- 172.21.15.154:0/387107312 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778012430 con 0x7ff780068890 2023-10-10T21:03:37.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff7869ff700 1 -- 172.21.15.154:0/387107312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780068890 msgr2=0x7ff7800c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:37.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff7869ff700 1 --2- 172.21.15.154:0/387107312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780068890 0x7ff7800c8230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff778009e60 tx=0x7ff778009780 comp rx=0 tx=0).stop 2023-10-10T21:03:37.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff7869ff700 1 -- 172.21.15.154:0/387107312 shutdown_connections 2023-10-10T21:03:37.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff7869ff700 1 --2- 172.21.15.154:0/387107312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780068890 0x7ff7800c8230 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff7869ff700 1 --2- 172.21.15.154:0/387107312 >> v2:172.21.15.179:3300/0 conn(0x7ff7801563b0 0x7ff780156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff7869ff700 1 -- 172.21.15.154:0/387107312 >> 172.21.15.154:0/387107312 conn(0x7ff7800c8f90 msgr2=0x7ff7800c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:37.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff7869ff700 1 -- 172.21.15.154:0/387107312 shutdown_connections 2023-10-10T21:03:37.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.448+0000 7ff7869ff700 1 -- 172.21.15.154:0/387107312 wait complete. 2023-10-10T21:03:37.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.450+0000 7ff7869ff700 1 Processor -- start 2023-10-10T21:03:37.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.450+0000 7ff7869ff700 1 -- start start 2023-10-10T21:03:37.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff7869ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff780068890 0x7ff780153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:37.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff7869ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7801563b0 0x7ff780150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:37.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff7869ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78015a440 0x7ff780151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:37.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff7869ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780155750 con 0x7ff780068890 2023-10-10T21:03:37.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff7869ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7801546b0 con 0x7ff7801563b0 2023-10-10T21:03:37.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff7869ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff780154990 con 0x7ff78015a440 2023-10-10T21:03:37.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff77ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff780068890 0x7ff780153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:37.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff77ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff780068890 0x7ff780153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35202/0 (socket says 172.21.15.154:35202) 2023-10-10T21:03:37.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff77ffff700 1 -- 172.21.15.154:0/3643426362 learned_addr learned my addr 172.21.15.154:0/3643426362 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:37.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff777fff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7801563b0 0x7ff780150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:37.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.451+0000 7ff784f9c700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78015a440 0x7ff780151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:37.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff77ffff700 1 -- 172.21.15.154:0/3643426362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78015a440 msgr2=0x7ff780151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:37.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff77ffff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78015a440 0x7ff780151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff77ffff700 1 -- 172.21.15.154:0/3643426362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7801563b0 msgr2=0x7ff780150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:37.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff77ffff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7801563b0 0x7ff780150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff77ffff700 1 -- 172.21.15.154:0/3643426362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700094f0 con 0x7ff780068890 2023-10-10T21:03:37.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff77ffff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff780068890 0x7ff780153e80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff77000ec50 tx=0x7ff770009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:37.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff77cff9700 1 -- 172.21.15.154:0/3643426362 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000c850 con 0x7ff780068890 2023-10-10T21:03:37.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff77cff9700 1 -- 172.21.15.154:0/3643426362 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77000c9b0 con 0x7ff780068890 2023-10-10T21:03:37.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff77cff9700 1 -- 172.21.15.154:0/3643426362 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000cd50 con 0x7ff780068890 2023-10-10T21:03:37.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff778009a20 con 0x7ff780068890 2023-10-10T21:03:37.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.452+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff780154f50 con 0x7ff780068890 2023-10-10T21:03:37.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.453+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7800718b0 con 0x7ff780068890 2023-10-10T21:03:37.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.454+0000 7ff77cff9700 1 -- 172.21.15.154:0/3643426362 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7ff770013680 con 0x7ff780068890 2023-10-10T21:03:37.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.455+0000 7ff77cff9700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff760067160 0x7ff760069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:37.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.455+0000 7ff77cff9700 1 -- 172.21.15.154:0/3643426362 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff770084aa0 con 0x7ff780068890 2023-10-10T21:03:37.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.455+0000 7ff777fff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff760067160 0x7ff760069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:37.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.456+0000 7ff777fff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff760067160 0x7ff760069610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff780068860 tx=0x7ff768007ec0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:37.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.459+0000 7ff77cff9700 1 -- 172.21.15.154:0/3643426362 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7700518f0 con 0x7ff780068890 2023-10-10T21:03:37.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.675+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff78006d6a0 con 0x7ff760067160 2023-10-10T21:03:37.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.751+0000 7ff77cff9700 1 -- 172.21.15.154:0/3643426362 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff78006d6a0 con 0x7ff760067160 2023-10-10T21:03:37.753 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir4 2023-10-10T21:03:37.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff760067160 msgr2=0x7ff760069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:37.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff760067160 0x7ff760069610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff780068860 tx=0x7ff768007ec0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff780068890 msgr2=0x7ff780153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:37.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff780068890 0x7ff780153e80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff77000ec50 tx=0x7ff770009250 comp rx=0 tx=0).stop 2023-10-10T21:03:37.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 shutdown_connections 2023-10-10T21:03:37.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff760067160 0x7ff760069610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78015a440 0x7ff780151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff780068890 0x7ff780153e80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 --2- 172.21.15.154:0/3643426362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7801563b0 0x7ff780150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:37.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 >> 172.21.15.154:0/3643426362 conn(0x7ff7800c8f90 msgr2=0x7ff7800cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:37.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 shutdown_connections 2023-10-10T21:03:37.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:37.754+0000 7ff7869ff700 1 -- 172.21.15.154:0/3643426362 wait complete. 2023-10-10T21:03:37.773 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-10-10T21:03:37.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:37.774 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-10-10T21:03:37.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-10-10T21:03:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.039+0000 7febd07ff700 1 Processor -- start 2023-10-10T21:03:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.040+0000 7febd07ff700 1 -- start start 2023-10-10T21:03:38.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.041+0000 7febd07ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7febc8159ec0 0x7febc80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.041+0000 7febd07ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc80b53d0 0x7febc80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.041+0000 7febd07ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febc80cce40 0x7febc80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.041+0000 7febd07ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc80b5b00 con 0x7febc80cce40 2023-10-10T21:03:38.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.041+0000 7febd07ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc80b5850 con 0x7febc8159ec0 2023-10-10T21:03:38.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.041+0000 7febd07ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc80b5da0 con 0x7febc80b53d0 2023-10-10T21:03:38.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febced9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febc80cce40 0x7febc80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febced9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febc80cce40 0x7febc80cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35210/0 (socket says 172.21.15.154:35210) 2023-10-10T21:03:38.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febced9c700 1 -- 172.21.15.154:0/2325580944 learned_addr learned my addr 172.21.15.154:0/2325580944 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:38.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febce59b700 1 --2- 172.21.15.154:0/2325580944 >> v2:172.21.15.179:3300/0 conn(0x7febc8159ec0 0x7febc80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febcdd9a700 1 --2- 172.21.15.154:0/2325580944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc80b53d0 0x7febc80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febced9c700 1 -- 172.21.15.154:0/2325580944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc80b53d0 msgr2=0x7febc80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:38.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febced9c700 1 --2- 172.21.15.154:0/2325580944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc80b53d0 0x7febc80cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febced9c700 1 -- 172.21.15.154:0/2325580944 >> v2:172.21.15.179:3300/0 conn(0x7febc8159ec0 msgr2=0x7febc80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:38.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febced9c700 1 --2- 172.21.15.154:0/2325580944 >> v2:172.21.15.179:3300/0 conn(0x7febc8159ec0 0x7febc80b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febced9c700 1 -- 172.21.15.154:0/2325580944 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc80b6080 con 0x7febc80cce40 2023-10-10T21:03:38.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.042+0000 7febced9c700 1 --2- 172.21.15.154:0/2325580944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80cce40 0x7febc80cd2a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7febc8089120 tx=0x7febc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fb0225f4aa7a79 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:38.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febcd599700 1 -- 172.21.15.154:0/2325580944 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc000e070 con 0x7febc80cce40 2023-10-10T21:03:38.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febcd599700 1 -- 172.21.15.154:0/2325580944 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc000b970 con 0x7febc80cce40 2023-10-10T21:03:38.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febcd599700 1 -- 172.21.15.154:0/2325580944 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc00092e0 con 0x7febc80cce40 2023-10-10T21:03:38.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febd07ff700 1 -- 172.21.15.154:0/2325580944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80cce40 msgr2=0x7febc80cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febd07ff700 1 --2- 172.21.15.154:0/2325580944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80cce40 0x7febc80cd2a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7febc8089120 tx=0x7febc0009840 comp rx=0 tx=0).stop 2023-10-10T21:03:38.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febd07ff700 1 -- 172.21.15.154:0/2325580944 shutdown_connections 2023-10-10T21:03:38.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febd07ff700 1 --2- 172.21.15.154:0/2325580944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80cce40 0x7febc80cd2a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febd07ff700 1 --2- 172.21.15.154:0/2325580944 >> v2:172.21.15.179:3300/0 conn(0x7febc8159ec0 0x7febc80b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febd07ff700 1 --2- 172.21.15.154:0/2325580944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc80b53d0 0x7febc80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febd07ff700 1 -- 172.21.15.154:0/2325580944 >> 172.21.15.154:0/2325580944 conn(0x7febc80999f0 msgr2=0x7febc80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:38.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febd07ff700 1 -- 172.21.15.154:0/2325580944 shutdown_connections 2023-10-10T21:03:38.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.043+0000 7febd07ff700 1 -- 172.21.15.154:0/2325580944 wait complete. 2023-10-10T21:03:38.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.045+0000 7febd07ff700 1 Processor -- start 2023-10-10T21:03:38.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.045+0000 7febd07ff700 1 -- start start 2023-10-10T21:03:38.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.046+0000 7febd07ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80b53d0 0x7febc809a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.046+0000 7febd07ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc80cce40 0x7febc80c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.046+0000 7febd07ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc8159ec0 0x7febc8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.046+0000 7febd07ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc809add0 con 0x7febc80b53d0 2023-10-10T21:03:38.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.046+0000 7febd07ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc809b0b0 con 0x7febc80cce40 2023-10-10T21:03:38.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.046+0000 7febd07ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc809b390 con 0x7febc8159ec0 2023-10-10T21:03:38.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.046+0000 7febce59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80b53d0 0x7febc809a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.046+0000 7febce59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80b53d0 0x7febc809a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35224/0 (socket says 172.21.15.154:35224) 2023-10-10T21:03:38.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.046+0000 7febce59b700 1 -- 172.21.15.154:0/4135401323 learned_addr learned my addr 172.21.15.154:0/4135401323 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:38.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febcdd9a700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc80cce40 0x7febc80c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febced9c700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc8159ec0 0x7febc8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febce59b700 1 -- 172.21.15.154:0/4135401323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc8159ec0 msgr2=0x7febc8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febce59b700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc8159ec0 0x7febc8156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febce59b700 1 -- 172.21.15.154:0/4135401323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc80cce40 msgr2=0x7febc80c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febce59b700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc80cce40 0x7febc80c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febce59b700 1 -- 172.21.15.154:0/4135401323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0009ae0 con 0x7febc80b53d0 2023-10-10T21:03:38.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febce59b700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80b53d0 0x7febc809a460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7febc400ec80 tx=0x7febc4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:38.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febbe7fc700 1 -- 172.21.15.154:0/4135401323 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400c850 con 0x7febc80b53d0 2023-10-10T21:03:38.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febbe7fc700 1 -- 172.21.15.154:0/4135401323 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc400c9b0 con 0x7febc80b53d0 2023-10-10T21:03:38.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febbe7fc700 1 -- 172.21.15.154:0/4135401323 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400cd30 con 0x7febc80b53d0 2023-10-10T21:03:38.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.047+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc809b670 con 0x7febc80b53d0 2023-10-10T21:03:38.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.048+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc809a9a0 con 0x7febc80b53d0 2023-10-10T21:03:38.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.049+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc8063c90 con 0x7febc80b53d0 2023-10-10T21:03:38.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.050+0000 7febbe7fc700 1 -- 172.21.15.154:0/4135401323 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7febc4013680 con 0x7febc80b53d0 2023-10-10T21:03:38.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.051+0000 7febbe7fc700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febac067130 0x7febac0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.052+0000 7febbe7fc700 1 -- 172.21.15.154:0/4135401323 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7febc40850d0 con 0x7febc80b53d0 2023-10-10T21:03:38.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.052+0000 7febcdd9a700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febac067130 0x7febac0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.052+0000 7febcdd9a700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febac067130 0x7febac0695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d10 tx=0x7febb80091a0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:38.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.056+0000 7febbe7fc700 1 -- 172.21.15.154:0/4135401323 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febc4051f20 con 0x7febc80b53d0 2023-10-10T21:03:38.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.272+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7febc8169c50 con 0x7febac067130 2023-10-10T21:03:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.344+0000 7febbe7fc700 1 -- 172.21.15.154:0/4135401323 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7febb8009950 con 0x7febac067130 2023-10-10T21:03:38.346 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir5 2023-10-10T21:03:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febac067130 msgr2=0x7febac0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febac067130 0x7febac0695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d10 tx=0x7febb80091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80b53d0 msgr2=0x7febc809a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80b53d0 0x7febc809a460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7febc400ec80 tx=0x7febc4009120 comp rx=0 tx=0).stop 2023-10-10T21:03:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 shutdown_connections 2023-10-10T21:03:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7febac067130 0x7febac0695e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc8159ec0 0x7febc8156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febc80b53d0 0x7febc809a460 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 --2- 172.21.15.154:0/4135401323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc80cce40 0x7febc80c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 >> 172.21.15.154:0/4135401323 conn(0x7febc80999f0 msgr2=0x7febc80c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:38.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 shutdown_connections 2023-10-10T21:03:38.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.346+0000 7febd07ff700 1 -- 172.21.15.154:0/4135401323 wait complete. 2023-10-10T21:03:38.366 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-10-10T21:03:38.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:38.367 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-10-10T21:03:38.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-10-10T21:03:38.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.631+0000 7ffad67ff700 1 Processor -- start 2023-10-10T21:03:38.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.632+0000 7ffad67ff700 1 -- start start 2023-10-10T21:03:38.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.633+0000 7ffad67ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffad0069a50 0x7ffad00c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.633+0000 7ffad67ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffad00c8490 0x7ffad015a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.633+0000 7ffad67ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad00ac030 con 0x7ffad0069e20 2023-10-10T21:03:38.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.633+0000 7ffad67ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00ab820 con 0x7ffad0069a50 2023-10-10T21:03:38.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.633+0000 7ffad67ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad006dbb0 con 0x7ffad00c8490 2023-10-10T21:03:38.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.633+0000 7ffacffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffad0069a50 0x7ffad00c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.633+0000 7ffad4d9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ffad0069e20 0x7ffad006e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40472/0 (socket says 172.21.15.154:40472) 2023-10-10T21:03:38.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.633+0000 7ffad4d9c700 1 -- 172.21.15.154:0/1338367063 learned_addr learned my addr 172.21.15.154:0/1338367063 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:38.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.633+0000 7ffac7fff700 1 --2- 172.21.15.154:0/1338367063 >> v2:172.21.15.179:3300/0 conn(0x7ffad00c8490 0x7ffad015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacf7fe700 1 -- 172.21.15.154:0/1338367063 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568912319 0 0) 0x7ffac8001490 con 0x7ffad0069e20 2023-10-10T21:03:38.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacf7fe700 1 -- 172.21.15.154:0/1338367063 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffabc004680 con 0x7ffad0069e20 2023-10-10T21:03:38.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacffff700 1 -- 172.21.15.154:0/1338367063 >> v2:172.21.15.179:3300/0 conn(0x7ffad00c8490 msgr2=0x7ffad015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:38.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacffff700 1 --2- 172.21.15.154:0/1338367063 >> v2:172.21.15.179:3300/0 conn(0x7ffad00c8490 0x7ffad015a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacffff700 1 -- 172.21.15.154:0/1338367063 >> v1:172.21.15.154:6789/0 conn(0x7ffad0069e20 legacy=0x7ffad006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacffff700 1 -- 172.21.15.154:0/1338367063 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad015a9d0 con 0x7ffad0069a50 2023-10-10T21:03:38.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffac7fff700 1 --2- 172.21.15.154:0/1338367063 >> v2:172.21.15.179:3300/0 conn(0x7ffad00c8490 0x7ffad015a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:38.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacffff700 1 --2- 172.21.15.154:0/1338367063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069a50 0x7ffad00c6ac0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffad006b920 tx=0x7ffac00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72e5aad6bd06bdd server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:38.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacf7fe700 1 -- 172.21.15.154:0/1338367063 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011630 con 0x7ffad0069a50 2023-10-10T21:03:38.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacf7fe700 1 -- 172.21.15.154:0/1338367063 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0011790 con 0x7ffad0069a50 2023-10-10T21:03:38.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.634+0000 7ffacf7fe700 1 -- 172.21.15.154:0/1338367063 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011b30 con 0x7ffad0069a50 2023-10-10T21:03:38.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.635+0000 7ffad67ff700 1 -- 172.21.15.154:0/1338367063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069a50 msgr2=0x7ffad00c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.635+0000 7ffad67ff700 1 --2- 172.21.15.154:0/1338367063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069a50 0x7ffad00c6ac0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffad006b920 tx=0x7ffac00091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.635+0000 7ffad67ff700 1 -- 172.21.15.154:0/1338367063 shutdown_connections 2023-10-10T21:03:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.635+0000 7ffad67ff700 1 --2- 172.21.15.154:0/1338367063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069a50 0x7ffad00c6ac0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.635+0000 7ffad67ff700 1 --2- 172.21.15.154:0/1338367063 >> v2:172.21.15.179:3300/0 conn(0x7ffad00c8490 0x7ffad015a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.635+0000 7ffad67ff700 1 -- 172.21.15.154:0/1338367063 >> 172.21.15.154:0/1338367063 conn(0x7ffad00c8f90 msgr2=0x7ffad00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:38.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.635+0000 7ffad67ff700 1 -- 172.21.15.154:0/1338367063 shutdown_connections 2023-10-10T21:03:38.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.635+0000 7ffad67ff700 1 -- 172.21.15.154:0/1338367063 wait complete. 2023-10-10T21:03:38.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.636+0000 7ffad67ff700 1 Processor -- start 2023-10-10T21:03:38.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.637+0000 7ffad67ff700 1 -- start start 2023-10-10T21:03:38.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.637+0000 7ffad67ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad0069a50 0x7ffad00c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.637+0000 7ffad67ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069e20 0x7ffad0150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.637+0000 7ffad67ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00c8490 0x7ffad00c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.637+0000 7ffad67ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c6770 con 0x7ffad0069e20 2023-10-10T21:03:38.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.637+0000 7ffad67ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c1530 con 0x7ffad00c8490 2023-10-10T21:03:38.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.637+0000 7ffad67ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c1140 con 0x7ffad0069a50 2023-10-10T21:03:38.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffac7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069e20 0x7ffad0150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffac7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069e20 0x7ffad0150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35256/0 (socket says 172.21.15.154:35256) 2023-10-10T21:03:38.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffac7fff700 1 -- 172.21.15.154:0/3407024403 learned_addr learned my addr 172.21.15.154:0/3407024403 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:38.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffad4d9c700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00c8490 0x7ffad00c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffacffff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad0069a50 0x7ffad00c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffac7fff700 1 -- 172.21.15.154:0/3407024403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad0069a50 msgr2=0x7ffad00c0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffac7fff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad0069a50 0x7ffad00c0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffac7fff700 1 -- 172.21.15.154:0/3407024403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00c8490 msgr2=0x7ffad00c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffac7fff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00c8490 0x7ffad00c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffac7fff700 1 -- 172.21.15.154:0/3407024403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac0009420 con 0x7ffad0069e20 2023-10-10T21:03:38.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffac7fff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069e20 0x7ffad0150750 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffab800d890 tx=0x7ffab8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:38.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.638+0000 7ffaccff9700 1 -- 172.21.15.154:0/3407024403 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab800b600 con 0x7ffad0069e20 2023-10-10T21:03:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.639+0000 7ffaccff9700 1 -- 172.21.15.154:0/3407024403 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab800b760 con 0x7ffad0069e20 2023-10-10T21:03:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.639+0000 7ffaccff9700 1 -- 172.21.15.154:0/3407024403 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab800bb00 con 0x7ffad0069e20 2023-10-10T21:03:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.639+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad0150c90 con 0x7ffad0069e20 2023-10-10T21:03:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.639+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad00c6ca0 con 0x7ffad0069e20 2023-10-10T21:03:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.640+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad00c1dd0 con 0x7ffad0069e20 2023-10-10T21:03:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.641+0000 7ffaccff9700 1 -- 172.21.15.154:0/3407024403 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7ffab8014430 con 0x7ffad0069e20 2023-10-10T21:03:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.641+0000 7ffaccff9700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab0067130 0x7ffab00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.641+0000 7ffaccff9700 1 -- 172.21.15.154:0/3407024403 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ffab8084e50 con 0x7ffad0069e20 2023-10-10T21:03:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.642+0000 7ffacffff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab0067130 0x7ffab00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.642+0000 7ffacffff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab0067130 0x7ffab00695e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffac00091e0 tx=0x7ffac0017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:38.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.645+0000 7ffaccff9700 1 -- 172.21.15.154:0/3407024403 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffab8051ca0 con 0x7ffad0069e20 2023-10-10T21:03:38.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.859+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffad00718b0 con 0x7ffab0067130 2023-10-10T21:03:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.926+0000 7ffaccff9700 1 -- 172.21.15.154:0/3407024403 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ffad00718b0 con 0x7ffab0067130 2023-10-10T21:03:38.930 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir6 2023-10-10T21:03:38.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab0067130 msgr2=0x7ffab00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab0067130 0x7ffab00695e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffac00091e0 tx=0x7ffac0017000 comp rx=0 tx=0).stop 2023-10-10T21:03:38.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069e20 msgr2=0x7ffad0150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:38.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069e20 0x7ffad0150750 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffab800d890 tx=0x7ffab8008040 comp rx=0 tx=0).stop 2023-10-10T21:03:38.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 shutdown_connections 2023-10-10T21:03:38.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00c8490 0x7ffad00c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffab0067130 0x7ffab00695e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad0069a50 0x7ffad00c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 --2- 172.21.15.154:0/3407024403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffad0069e20 0x7ffad0150750 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:38.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 >> 172.21.15.154:0/3407024403 conn(0x7ffad00c8f90 msgr2=0x7ffad00ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:38.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 shutdown_connections 2023-10-10T21:03:38.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:38.929+0000 7ffad67ff700 1 -- 172.21.15.154:0/3407024403 wait complete. 2023-10-10T21:03:38.948 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-10-10T21:03:38.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:38.949 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-10-10T21:03:38.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-10-10T21:03:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.215+0000 7f4a631ff700 1 Processor -- start 2023-10-10T21:03:39.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.215+0000 7f4a631ff700 1 -- start start 2023-10-10T21:03:39.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.216+0000 7f4a631ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a5c15a440 0x7f4a5c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.216+0000 7f4a631ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c15a9b0 con 0x7f4a5c068890 2023-10-10T21:03:39.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.216+0000 7f4a631ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c15ac90 con 0x7f4a5c1563b0 2023-10-10T21:03:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.216+0000 7f4a631ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c15af70 con 0x7f4a5c15a440 2023-10-10T21:03:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a6179c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4a5c068890 0x7f4a5c0c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40486/0 (socket says 172.21.15.154:40486) 2023-10-10T21:03:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a6179c700 1 -- 172.21.15.154:0/3147862151 learned_addr learned my addr 172.21.15.154:0/3147862151 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a5bfff700 1 --2- 172.21.15.154:0/3147862151 >> v2:172.21.15.179:3300/0 conn(0x7f4a5c15a440 0x7f4a5c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a5b7fe700 1 -- 172.21.15.154:0/3147862151 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173712684 0 0) 0x7f4a5c15a9b0 con 0x7f4a5c068890 2023-10-10T21:03:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a5b7fe700 1 -- 172.21.15.154:0/3147862151 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a4c003570 con 0x7f4a5c068890 2023-10-10T21:03:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a5b7fe700 1 -- 172.21.15.154:0/3147862151 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692827225 0 0) 0x7f4a5c15ac90 con 0x7f4a5c1563b0 2023-10-10T21:03:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a5b7fe700 1 -- 172.21.15.154:0/3147862151 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a5c15a9b0 con 0x7f4a5c1563b0 2023-10-10T21:03:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a5b7fe700 1 -- 172.21.15.154:0/3147862151 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1236752297 0 0) 0x7f4a4c003570 con 0x7f4a5c068890 2023-10-10T21:03:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a5bfff700 1 -- 172.21.15.154:0/3147862151 >> v1:172.21.15.179:6789/0 conn(0x7f4a5c1563b0 legacy=0x7f4a5c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a5bfff700 1 -- 172.21.15.154:0/3147862151 >> v1:172.21.15.154:6789/0 conn(0x7f4a5c068890 legacy=0x7f4a5c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.217+0000 7f4a5bfff700 1 -- 172.21.15.154:0/3147862151 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c15b250 con 0x7f4a5c15a440 2023-10-10T21:03:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.218+0000 7f4a5bfff700 1 --2- 172.21.15.154:0/3147862151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a5c15a440 0x7f4a5c0acf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a480098e0 tx=0x7f4a480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41d9bbb9f4017a43 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.218+0000 7f4a5b7fe700 1 -- 172.21.15.154:0/3147862151 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540017f0 con 0x7f4a5c15a440 2023-10-10T21:03:39.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.218+0000 7f4a5b7fe700 1 -- 172.21.15.154:0/3147862151 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48011420 con 0x7f4a5c15a440 2023-10-10T21:03:39.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.218+0000 7f4a5b7fe700 1 -- 172.21.15.154:0/3147862151 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480117a0 con 0x7f4a5c15a440 2023-10-10T21:03:39.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.218+0000 7f4a631ff700 1 -- 172.21.15.154:0/3147862151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a5c15a440 msgr2=0x7f4a5c0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.218+0000 7f4a631ff700 1 --2- 172.21.15.154:0/3147862151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a5c15a440 0x7f4a5c0acf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a480098e0 tx=0x7f4a480091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.219+0000 7f4a631ff700 1 -- 172.21.15.154:0/3147862151 shutdown_connections 2023-10-10T21:03:39.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.219+0000 7f4a631ff700 1 --2- 172.21.15.154:0/3147862151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a5c15a440 0x7f4a5c0acf30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.219+0000 7f4a631ff700 1 -- 172.21.15.154:0/3147862151 >> 172.21.15.154:0/3147862151 conn(0x7f4a5c0c8f90 msgr2=0x7f4a5c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:39.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.219+0000 7f4a631ff700 1 -- 172.21.15.154:0/3147862151 shutdown_connections 2023-10-10T21:03:39.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.219+0000 7f4a631ff700 1 -- 172.21.15.154:0/3147862151 wait complete. 2023-10-10T21:03:39.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.220+0000 7f4a631ff700 1 Processor -- start 2023-10-10T21:03:39.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.220+0000 7f4a631ff700 1 -- start start 2023-10-10T21:03:39.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a631ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a5c068890 0x7f4a5c0af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a631ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a5c1563b0 0x7f4a5c0af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a631ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a5c15a440 0x7f4a5c0bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a631ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c1540c0 con 0x7f4a5c1563b0 2023-10-10T21:03:39.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a631ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0b0ac0 con 0x7f4a5c068890 2023-10-10T21:03:39.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a631ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0afeb0 con 0x7f4a5c15a440 2023-10-10T21:03:39.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a5bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a5c1563b0 0x7f4a5c0af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a5bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a5c1563b0 0x7f4a5c0af810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35268/0 (socket says 172.21.15.154:35268) 2023-10-10T21:03:39.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a5bfff700 1 -- 172.21.15.154:0/1117221485 learned_addr learned my addr 172.21.15.154:0/1117221485 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:39.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a60f9b700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a5c068890 0x7f4a5c0af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.221+0000 7f4a6179c700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a5c15a440 0x7f4a5c0bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a5bfff700 1 -- 172.21.15.154:0/1117221485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a5c15a440 msgr2=0x7f4a5c0bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a5bfff700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a5c15a440 0x7f4a5c0bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a5bfff700 1 -- 172.21.15.154:0/1117221485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a5c068890 msgr2=0x7f4a5c0af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a5bfff700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a5c068890 0x7f4a5c0af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a5bfff700 1 -- 172.21.15.154:0/1117221485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48009420 con 0x7f4a5c1563b0 2023-10-10T21:03:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a5bfff700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a5c1563b0 0x7f4a5c0af810 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4a480097b0 tx=0x7f4a48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a58ff9700 1 -- 172.21.15.154:0/1117221485 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4801cab0 con 0x7f4a5c1563b0 2023-10-10T21:03:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a58ff9700 1 -- 172.21.15.154:0/1117221485 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4801cc10 con 0x7f4a5c1563b0 2023-10-10T21:03:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a58ff9700 1 -- 172.21.15.154:0/1117221485 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4801a450 con 0x7f4a5c1563b0 2023-10-10T21:03:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c0b0190 con 0x7f4a5c1563b0 2023-10-10T21:03:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.222+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c0b0750 con 0x7f4a5c1563b0 2023-10-10T21:03:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.223+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c0b0c30 con 0x7f4a5c1563b0 2023-10-10T21:03:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.224+0000 7f4a58ff9700 1 -- 172.21.15.154:0/1117221485 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f4a4801a840 con 0x7f4a5c1563b0 2023-10-10T21:03:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.225+0000 7f4a58ff9700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4a40067130 0x7f4a400695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.225+0000 7f4a58ff9700 1 -- 172.21.15.154:0/1117221485 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4a48085e70 con 0x7f4a5c1563b0 2023-10-10T21:03:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.225+0000 7f4a60f9b700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4a40067130 0x7f4a400695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.226+0000 7f4a60f9b700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4a40067130 0x7f4a400695e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0c8b70 tx=0x7f4a50007d50 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:39.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.229+0000 7f4a58ff9700 1 -- 172.21.15.154:0/1117221485 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a48052cc0 con 0x7f4a5c1563b0 2023-10-10T21:03:39.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.450+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a5c0718b0 con 0x7f4a40067130 2023-10-10T21:03:39.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.522+0000 7f4a58ff9700 1 -- 172.21.15.154:0/1117221485 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4a5c0718b0 con 0x7f4a40067130 2023-10-10T21:03:39.524 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir7 2023-10-10T21:03:39.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4a40067130 msgr2=0x7f4a400695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4a40067130 0x7f4a400695e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0c8b70 tx=0x7f4a50007d50 comp rx=0 tx=0).stop 2023-10-10T21:03:39.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a5c1563b0 msgr2=0x7f4a5c0af810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a5c1563b0 0x7f4a5c0af810 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4a480097b0 tx=0x7f4a48016000 comp rx=0 tx=0).stop 2023-10-10T21:03:39.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 shutdown_connections 2023-10-10T21:03:39.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4a40067130 0x7f4a400695e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a5c15a440 0x7f4a5c0bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a5c068890 0x7f4a5c0af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 --2- 172.21.15.154:0/1117221485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a5c1563b0 0x7f4a5c0af810 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 >> 172.21.15.154:0/1117221485 conn(0x7f4a5c0c8f90 msgr2=0x7f4a5c15b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 shutdown_connections 2023-10-10T21:03:39.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.525+0000 7f4a631ff700 1 -- 172.21.15.154:0/1117221485 wait complete. 2023-10-10T21:03:39.544 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-10-10T21:03:39.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:39.544 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-10-10T21:03:39.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-10-10T21:03:39.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.809+0000 7f1ababff700 1 Processor -- start 2023-10-10T21:03:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.809+0000 7f1ababff700 1 -- start start 2023-10-10T21:03:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.810+0000 7f1ababff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ab4159ec0 0x7f1ab40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.810+0000 7f1ababff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40b5b00 con 0x7f1ab40b53d0 2023-10-10T21:03:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.810+0000 7f1ababff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40b5850 con 0x7f1ab40cf350 2023-10-10T21:03:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.810+0000 7f1ababff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab40b5da0 con 0x7f1ab4159ec0 2023-10-10T21:03:39.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.811+0000 7f1ab3fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1ab40b53d0 0x7f1ab40cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40492/0 (socket says 172.21.15.154:40492) 2023-10-10T21:03:39.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.811+0000 7f1ab3fff700 1 -- 172.21.15.154:0/225673131 learned_addr learned my addr 172.21.15.154:0/225673131 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:39.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.811+0000 7f1ab899b700 1 --2- 172.21.15.154:0/225673131 >> v2:172.21.15.179:3300/0 conn(0x7f1ab4159ec0 0x7f1ab40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.811+0000 7f1ab37fe700 1 -- 172.21.15.154:0/225673131 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621577183 0 0) 0x7f1ab40b5b00 con 0x7f1ab40b53d0 2023-10-10T21:03:39.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.811+0000 7f1ab37fe700 1 -- 172.21.15.154:0/225673131 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa4003570 con 0x7f1ab40b53d0 2023-10-10T21:03:39.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.811+0000 7f1ab899b700 1 -- 172.21.15.154:0/225673131 >> v1:172.21.15.179:6789/0 conn(0x7f1ab40cf350 legacy=0x7f1ab40cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.811+0000 7f1ab37fe700 1 -- 172.21.15.154:0/225673131 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982395076 0 0) 0x7f1ab40b5850 con 0x7f1ab40cf350 2023-10-10T21:03:39.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.811+0000 7f1ab899b700 1 -- 172.21.15.154:0/225673131 >> v1:172.21.15.154:6789/0 conn(0x7f1ab40b53d0 legacy=0x7f1ab40cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.811+0000 7f1ab899b700 1 -- 172.21.15.154:0/225673131 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40b6080 con 0x7f1ab4159ec0 2023-10-10T21:03:39.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.812+0000 7f1ab899b700 1 --2- 172.21.15.154:0/225673131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab4159ec0 0x7f1ab40b4e90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80098d0 tx=0x7f1aa8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee2bbbb539b5a7c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:39.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.812+0000 7f1ab37fe700 1 -- 172.21.15.154:0/225673131 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8005c10 con 0x7f1ab4159ec0 2023-10-10T21:03:39.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.812+0000 7f1ab37fe700 1 -- 172.21.15.154:0/225673131 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8005d70 con 0x7f1ab4159ec0 2023-10-10T21:03:39.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.812+0000 7f1ab37fe700 1 -- 172.21.15.154:0/225673131 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8006280 con 0x7f1ab4159ec0 2023-10-10T21:03:39.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.812+0000 7f1ababff700 1 -- 172.21.15.154:0/225673131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab4159ec0 msgr2=0x7f1ab40b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.812+0000 7f1ababff700 1 --2- 172.21.15.154:0/225673131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab4159ec0 0x7f1ab40b4e90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80098d0 tx=0x7f1aa8009120 comp rx=0 tx=0).stop 2023-10-10T21:03:39.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.813+0000 7f1ababff700 1 -- 172.21.15.154:0/225673131 shutdown_connections 2023-10-10T21:03:39.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.813+0000 7f1ababff700 1 --2- 172.21.15.154:0/225673131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab4159ec0 0x7f1ab40b4e90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.813+0000 7f1ababff700 1 -- 172.21.15.154:0/225673131 >> 172.21.15.154:0/225673131 conn(0x7f1ab40999f0 msgr2=0x7f1ab40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:39.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.813+0000 7f1ababff700 1 -- 172.21.15.154:0/225673131 shutdown_connections 2023-10-10T21:03:39.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.813+0000 7f1ababff700 1 -- 172.21.15.154:0/225673131 wait complete. 2023-10-10T21:03:39.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.814+0000 7f1ababff700 1 Processor -- start 2023-10-10T21:03:39.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.814+0000 7f1ababff700 1 -- start start 2023-10-10T21:03:39.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ababff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40b53d0 0x7f1ab41569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ababff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab40cf350 0x7f1ab409b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ababff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab4159ec0 0x7f1ab41539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ababff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab409b700 con 0x7f1ab40b53d0 2023-10-10T21:03:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ababff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4068a80 con 0x7f1ab40cf350 2023-10-10T21:03:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ababff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4158e00 con 0x7f1ab4159ec0 2023-10-10T21:03:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ab899b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40b53d0 0x7f1ab41569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ab899b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40b53d0 0x7f1ab41569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35280/0 (socket says 172.21.15.154:35280) 2023-10-10T21:03:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ab899b700 1 -- 172.21.15.154:0/224222246 learned_addr learned my addr 172.21.15.154:0/224222246 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ab3fff700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab40cf350 0x7f1ab409b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.815+0000 7f1ab919c700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab4159ec0 0x7f1ab41539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ab899b700 1 -- 172.21.15.154:0/224222246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab4159ec0 msgr2=0x7f1ab41539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ab899b700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab4159ec0 0x7f1ab41539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ab899b700 1 -- 172.21.15.154:0/224222246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab40cf350 msgr2=0x7f1ab409b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ab899b700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab40cf350 0x7f1ab409b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ab899b700 1 -- 172.21.15.154:0/224222246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa80093c0 con 0x7f1ab40b53d0 2023-10-10T21:03:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ab899b700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40b53d0 0x7f1ab41569f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4089390 tx=0x7f1aa8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ab0ff9700 1 -- 172.21.15.154:0/224222246 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa801d800 con 0x7f1ab40b53d0 2023-10-10T21:03:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ab0ff9700 1 -- 172.21.15.154:0/224222246 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa801d960 con 0x7f1ab40b53d0 2023-10-10T21:03:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ab0ff9700 1 -- 172.21.15.154:0/224222246 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa801dd00 con 0x7f1ab40b53d0 2023-10-10T21:03:39.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab41572b0 con 0x7f1ab40b53d0 2023-10-10T21:03:39.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.816+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab4068430 con 0x7f1ab40b53d0 2023-10-10T21:03:39.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.817+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab4063c90 con 0x7f1ab40b53d0 2023-10-10T21:03:39.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.818+0000 7f1ab0ff9700 1 -- 172.21.15.154:0/224222246 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f1aa801b690 con 0x7f1ab40b53d0 2023-10-10T21:03:39.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.819+0000 7f1ab0ff9700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1a98067130 0x7f1a980695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:39.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.819+0000 7f1ab0ff9700 1 -- 172.21.15.154:0/224222246 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1aa8086920 con 0x7f1ab40b53d0 2023-10-10T21:03:39.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.819+0000 7f1ab3fff700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1a98067130 0x7f1a980695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:39.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.820+0000 7f1ab3fff700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1a98067130 0x7f1a980695e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1ab40cdb70 tx=0x7f1aa0009040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:39.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:39.823+0000 7f1ab0ff9700 1 -- 172.21.15.154:0/224222246 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aa8053770 con 0x7f1ab40b53d0 2023-10-10T21:03:40.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.039+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ab4068bc0 con 0x7f1a98067130 2023-10-10T21:03:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.107+0000 7f1ab0ff9700 1 -- 172.21.15.154:0/224222246 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f1aa000f620 con 0x7f1a98067130 2023-10-10T21:03:40.109 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir8 2023-10-10T21:03:40.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1a98067130 msgr2=0x7f1a980695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1a98067130 0x7f1a980695e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1ab40cdb70 tx=0x7f1aa0009040 comp rx=0 tx=0).stop 2023-10-10T21:03:40.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40b53d0 msgr2=0x7f1ab41569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40b53d0 0x7f1ab41569f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4089390 tx=0x7f1aa8016000 comp rx=0 tx=0).stop 2023-10-10T21:03:40.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 shutdown_connections 2023-10-10T21:03:40.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1a98067130 0x7f1a980695e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab4159ec0 0x7f1ab41539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40b53d0 0x7f1ab41569f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 --2- 172.21.15.154:0/224222246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab40cf350 0x7f1ab409b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 >> 172.21.15.154:0/224222246 conn(0x7f1ab40999f0 msgr2=0x7f1ab40c6390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:40.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 shutdown_connections 2023-10-10T21:03:40.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.110+0000 7f1ababff700 1 -- 172.21.15.154:0/224222246 wait complete. 2023-10-10T21:03:40.129 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-10-10T21:03:40.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:03:40.130 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-10-10T21:03:40.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-10-10T21:03:40.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.398+0000 7f883e19d700 1 Processor -- start 2023-10-10T21:03:40.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.398+0000 7f883e19d700 1 -- start start 2023-10-10T21:03:40.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.399+0000 7f883e19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8838153480 0x7f88380ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.399+0000 7f883e19d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88380aec90 con 0x7f8838153850 2023-10-10T21:03:40.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.399+0000 7f883e19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883815a480 con 0x7f8838159dc0 2023-10-10T21:03:40.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.399+0000 7f883e19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88380afb40 con 0x7f8838153480 2023-10-10T21:03:40.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.399+0000 7f883c99a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8838153850 0x7f88381596b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40498/0 (socket says 172.21.15.154:40498) 2023-10-10T21:03:40.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.399+0000 7f883c99a700 1 -- 172.21.15.154:0/3975269668 learned_addr learned my addr 172.21.15.154:0/3975269668 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:40.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f883d19b700 1 --2- 172.21.15.154:0/3975269668 >> v2:172.21.15.179:3300/0 conn(0x7f8838153480 0x7f88380ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889215260 0 0) 0x7f88380aec90 con 0x7f8838153850 2023-10-10T21:03:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8824003570 con 0x7f8838153850 2023-10-10T21:03:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394117981 0 0) 0x7f8824003570 con 0x7f8838153850 2023-10-10T21:03:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 >> v2:172.21.15.179:3300/0 conn(0x7f8838153480 msgr2=0x7f88380ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 --2- 172.21.15.154:0/3975269668 >> v2:172.21.15.179:3300/0 conn(0x7f8838153480 0x7f88380ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 >> v1:172.21.15.179:6789/0 conn(0x7f8838159dc0 legacy=0x7f8838157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88380afe20 con 0x7f8838153850 2023-10-10T21:03:40.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f8828001470 con 0x7f8838153850 2023-10-10T21:03:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 >> v1:172.21.15.154:6789/0 conn(0x7f8838153850 legacy=0x7f88381596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8824003a60 0x7f8824003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824004810 0x7f8824004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88240051c0 0x7f8824005a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88380afb40 con 0x7f8824003a60 2023-10-10T21:03:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88240060a0 con 0x7f8824004810 2023-10-10T21:03:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.400+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8824006260 con 0x7f88240051c0 2023-10-10T21:03:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883d19b700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8824003a60 0x7f8824003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883c99a700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824004810 0x7f8824004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883d99c700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88240051c0 0x7f8824005a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883d19b700 1 -- 172.21.15.154:0/3975269668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88240051c0 msgr2=0x7f8824005a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883d19b700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88240051c0 0x7f8824005a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883d19b700 1 -- 172.21.15.154:0/3975269668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824004810 msgr2=0x7f8824004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883d19b700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824004810 0x7f8824004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883d19b700 1 -- 172.21.15.154:0/3975269668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824003570 con 0x7f8824003a60 2023-10-10T21:03:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883d99c700 1 -- 172.21.15.154:0/3975269668 reap_dead start 2023-10-10T21:03:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f883d19b700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8824003a60 0x7f8824003e30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8834009c00 tx=0x7f88340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acd7fcb67ce7da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400e710 con 0x7f8824003a60 2023-10-10T21:03:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883400e870 con 0x7f8824003a60 2023-10-10T21:03:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.401+0000 7f882ffff700 1 -- 172.21.15.154:0/3975269668 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400ec30 con 0x7f8824003a60 2023-10-10T21:03:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.402+0000 7f883e19d700 1 -- 172.21.15.154:0/3975269668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8824003a60 msgr2=0x7f8824003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.402+0000 7f883e19d700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8824003a60 0x7f8824003e30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8834009c00 tx=0x7f88340091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.402+0000 7f883e19d700 1 -- 172.21.15.154:0/3975269668 shutdown_connections 2023-10-10T21:03:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.402+0000 7f883e19d700 1 --2- 172.21.15.154:0/3975269668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8824003a60 0x7f8824003e30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.402+0000 7f883e19d700 1 -- 172.21.15.154:0/3975269668 >> 172.21.15.154:0/3975269668 conn(0x7f8838068e20 msgr2=0x7f88380cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.402+0000 7f883e19d700 1 -- 172.21.15.154:0/3975269668 shutdown_connections 2023-10-10T21:03:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.402+0000 7f883e19d700 1 -- 172.21.15.154:0/3975269668 wait complete. 2023-10-10T21:03:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.403+0000 7f883e19d700 1 Processor -- start 2023-10-10T21:03:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.404+0000 7f883e19d700 1 -- start start 2023-10-10T21:03:40.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.404+0000 7f883e19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824003a60 0x7f88380abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.404+0000 7f883e19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883814fcb0 0x7f88380a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.404+0000 7f883e19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88380aa3c0 0x7f88380a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.404+0000 7f883e19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88380aab20 con 0x7f88380aa3c0 2023-10-10T21:03:40.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.404+0000 7f883e19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88380a54c0 con 0x7f8824003a60 2023-10-10T21:03:40.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883e19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88380ac430 con 0x7f883814fcb0 2023-10-10T21:03:40.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88380aa3c0 0x7f88380a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88380aa3c0 0x7f88380a7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35304/0 (socket says 172.21.15.154:35304) 2023-10-10T21:03:40.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d99c700 1 -- 172.21.15.154:0/3707873664 learned_addr learned my addr 172.21.15.154:0/3707873664 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:40.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883c99a700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883814fcb0 0x7f88380a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d19b700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824003a60 0x7f88380abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d99c700 1 -- 172.21.15.154:0/3707873664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883814fcb0 msgr2=0x7f88380a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d99c700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883814fcb0 0x7f88380a9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d99c700 1 -- 172.21.15.154:0/3707873664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824003a60 msgr2=0x7f88380abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d99c700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824003a60 0x7f88380abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d99c700 1 -- 172.21.15.154:0/3707873664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88380aa840 con 0x7f88380aa3c0 2023-10-10T21:03:40.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d19b700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824003a60 0x7f88380abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:40.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.405+0000 7f883d99c700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88380aa3c0 0x7f88380a7ee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f88300013d0 tx=0x7f8830009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.406+0000 7f882d7fa700 1 -- 172.21.15.154:0/3707873664 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830017070 con 0x7f88380aa3c0 2023-10-10T21:03:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.406+0000 7f882d7fa700 1 -- 172.21.15.154:0/3707873664 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88300032e0 con 0x7f88380aa3c0 2023-10-10T21:03:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.406+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88380a56d0 con 0x7f88380aa3c0 2023-10-10T21:03:40.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.406+0000 7f882d7fa700 1 -- 172.21.15.154:0/3707873664 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830006ba0 con 0x7f88380aa3c0 2023-10-10T21:03:40.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.406+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88380a5c90 con 0x7f88380aa3c0 2023-10-10T21:03:40.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.407+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883804c3c0 con 0x7f88380aa3c0 2023-10-10T21:03:40.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.408+0000 7f882d7fa700 1 -- 172.21.15.154:0/3707873664 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f88300016b0 con 0x7f88380aa3c0 2023-10-10T21:03:40.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.409+0000 7f882d7fa700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f881c067130 0x7f881c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.409+0000 7f882d7fa700 1 -- 172.21.15.154:0/3707873664 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f8830084420 con 0x7f88380aa3c0 2023-10-10T21:03:40.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.409+0000 7f883d19b700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f881c067130 0x7f881c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.409+0000 7f883d19b700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f881c067130 0x7f881c0695e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8834009c00 tx=0x7f883401a000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:40.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.413+0000 7f882d7fa700 1 -- 172.21.15.154:0/3707873664 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8830051310 con 0x7f88380aa3c0 2023-10-10T21:03:40.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.628+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f88380cb9c0 con 0x7f881c067130 2023-10-10T21:03:40.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.696+0000 7f882d7fa700 1 -- 172.21.15.154:0/3707873664 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f88380cb9c0 con 0x7f881c067130 2023-10-10T21:03:40.698 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/dir9 2023-10-10T21:03:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f881c067130 msgr2=0x7f881c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f881c067130 0x7f881c0695e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8834009c00 tx=0x7f883401a000 comp rx=0 tx=0).stop 2023-10-10T21:03:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88380aa3c0 msgr2=0x7f88380a7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88380aa3c0 0x7f88380a7ee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f88300013d0 tx=0x7f8830009040 comp rx=0 tx=0).stop 2023-10-10T21:03:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 shutdown_connections 2023-10-10T21:03:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88380aa3c0 0x7f88380a7ee0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8824003a60 0x7f88380abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f881c067130 0x7f881c0695e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 --2- 172.21.15.154:0/3707873664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883814fcb0 0x7f88380a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.698+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 >> 172.21.15.154:0/3707873664 conn(0x7f8838068e20 msgr2=0x7f8838152c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.699+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 shutdown_connections 2023-10-10T21:03:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.699+0000 7f883e19d700 1 -- 172.21.15.154:0/3707873664 wait complete. 2023-10-10T21:03:40.717 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-10-10T21:03:40.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-10T21:03:40.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.906+0000 7fae4b19d700 1 Processor -- start 2023-10-10T21:03:40.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.907+0000 7fae4b19d700 1 -- start start 2023-10-10T21:03:40.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.908+0000 7fae4b19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae44156350 0x7fae44157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.908+0000 7fae4b19d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae440b0760 0x7fae440b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.908+0000 7fae4b19d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae440b0570 con 0x7fae44159f20 2023-10-10T21:03:40.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.908+0000 7fae4b19d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae440b1140 con 0x7fae440b0760 2023-10-10T21:03:40.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.908+0000 7fae4b19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae441578b0 con 0x7fae44156350 2023-10-10T21:03:40.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.908+0000 7fae4a99c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fae44159f20 0x7fae4415a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40502/0 (socket says 172.21.15.154:40502) 2023-10-10T21:03:40.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.908+0000 7fae4a99c700 1 -- 172.21.15.154:0/3189897835 learned_addr learned my addr 172.21.15.154:0/3189897835 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:40.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.908+0000 7fae4999a700 1 --2- 172.21.15.154:0/3189897835 >> v2:172.21.15.154:3300/0 conn(0x7fae440b0760 0x7fae440b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.908+0000 7fae4a19b700 1 --2- 172.21.15.154:0/3189897835 >> v2:172.21.15.179:3300/0 conn(0x7fae44156350 0x7fae44157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.909+0000 7fae49199700 1 -- 172.21.15.154:0/3189897835 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502326006 0 0) 0x7fae440b0570 con 0x7fae44159f20 2023-10-10T21:03:40.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.909+0000 7fae4999a700 1 -- 172.21.15.154:0/3189897835 >> v2:172.21.15.179:3300/0 conn(0x7fae44156350 msgr2=0x7fae44157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:40.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.909+0000 7fae4999a700 1 --2- 172.21.15.154:0/3189897835 >> v2:172.21.15.179:3300/0 conn(0x7fae44156350 0x7fae44157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.909+0000 7fae4999a700 1 -- 172.21.15.154:0/3189897835 >> v1:172.21.15.154:6789/0 conn(0x7fae44159f20 legacy=0x7fae4415a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.909+0000 7fae4999a700 1 -- 172.21.15.154:0/3189897835 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae440af4d0 con 0x7fae440b0760 2023-10-10T21:03:40.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.909+0000 7fae4999a700 1 --2- 172.21.15.154:0/3189897835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 0x7fae440b0c00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fae44065950 tx=0x7fae340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb87f93729d8f2a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:40.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.909+0000 7fae49199700 1 -- 172.21.15.154:0/3189897835 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34011630 con 0x7fae440b0760 2023-10-10T21:03:40.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.909+0000 7fae49199700 1 -- 172.21.15.154:0/3189897835 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34011790 con 0x7fae440b0760 2023-10-10T21:03:40.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.909+0000 7fae49199700 1 -- 172.21.15.154:0/3189897835 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34011b30 con 0x7fae440b0760 2023-10-10T21:03:40.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.910+0000 7fae4b19d700 1 -- 172.21.15.154:0/3189897835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 msgr2=0x7fae440b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.910+0000 7fae4b19d700 1 --2- 172.21.15.154:0/3189897835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 0x7fae440b0c00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fae44065950 tx=0x7fae340091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.910+0000 7fae4b19d700 1 -- 172.21.15.154:0/3189897835 shutdown_connections 2023-10-10T21:03:40.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.910+0000 7fae4b19d700 1 --2- 172.21.15.154:0/3189897835 >> v2:172.21.15.179:3300/0 conn(0x7fae44156350 0x7fae44157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.910+0000 7fae4b19d700 1 --2- 172.21.15.154:0/3189897835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 0x7fae440b0c00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.910+0000 7fae4b19d700 1 -- 172.21.15.154:0/3189897835 >> 172.21.15.154:0/3189897835 conn(0x7fae44068e20 msgr2=0x7fae440cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:40.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.910+0000 7fae4b19d700 1 -- 172.21.15.154:0/3189897835 shutdown_connections 2023-10-10T21:03:40.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.910+0000 7fae4b19d700 1 -- 172.21.15.154:0/3189897835 wait complete. 2023-10-10T21:03:40.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.911+0000 7fae4b19d700 1 Processor -- start 2023-10-10T21:03:40.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.912+0000 7fae4b19d700 1 -- start start 2023-10-10T21:03:40.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4b19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 0x7fae440c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4b19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae44156350 0x7fae4406e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44159f20 0x7fae44151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4b19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae440ca2b0 con 0x7fae440b0760 2023-10-10T21:03:40.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4b19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4406e8a0 con 0x7fae44156350 2023-10-10T21:03:40.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae440c96a0 con 0x7fae44159f20 2023-10-10T21:03:40.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4a19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 0x7fae440c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4a19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 0x7fae440c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35318/0 (socket says 172.21.15.154:35318) 2023-10-10T21:03:40.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4a19b700 1 -- 172.21.15.154:0/1875189798 learned_addr learned my addr 172.21.15.154:0/1875189798 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:40.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4999a700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae44156350 0x7fae4406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4a99c700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44159f20 0x7fae44151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4a19b700 1 -- 172.21.15.154:0/1875189798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44159f20 msgr2=0x7fae44151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4a19b700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44159f20 0x7fae44151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4a19b700 1 -- 172.21.15.154:0/1875189798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae44156350 msgr2=0x7fae4406e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:40.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4a19b700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae44156350 0x7fae4406e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:40.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.913+0000 7fae4a19b700 1 -- 172.21.15.154:0/1875189798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34009420 con 0x7fae440b0760 2023-10-10T21:03:40.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.914+0000 7fae4a19b700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 0x7fae440c90c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fae4000e930 tx=0x7fae400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:40.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.914+0000 7fae3a7fc700 1 -- 172.21.15.154:0/1875189798 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40013680 con 0x7fae440b0760 2023-10-10T21:03:40.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.914+0000 7fae3a7fc700 1 -- 172.21.15.154:0/1875189798 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae400137e0 con 0x7fae440b0760 2023-10-10T21:03:40.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.914+0000 7fae3a7fc700 1 -- 172.21.15.154:0/1875189798 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40013b80 con 0x7fae440b0760 2023-10-10T21:03:40.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.914+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae440c9980 con 0x7fae440b0760 2023-10-10T21:03:40.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.914+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae440c9f40 con 0x7fae440b0760 2023-10-10T21:03:40.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.915+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae440ca590 con 0x7fae440b0760 2023-10-10T21:03:40.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.916+0000 7fae3a7fc700 1 -- 172.21.15.154:0/1875189798 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fae4000c460 con 0x7fae440b0760 2023-10-10T21:03:40.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.917+0000 7fae3a7fc700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae28067130 0x7fae280695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:40.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.917+0000 7fae3a7fc700 1 -- 172.21.15.154:0/1875189798 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fae40084b20 con 0x7fae440b0760 2023-10-10T21:03:40.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.917+0000 7fae4999a700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae28067130 0x7fae280695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:40.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.918+0000 7fae4999a700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae28067130 0x7fae280695e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae340093f0 tx=0x7fae34017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:40.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:40.921+0000 7fae3a7fc700 1 -- 172.21.15.154:0/1875189798 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae40051a10 con 0x7fae440b0760 2023-10-10T21:03:41.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.136+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fae440ca3f0 con 0x7fae28067130 2023-10-10T21:03:41.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.186+0000 7fae3a7fc700 1 -- 172.21.15.154:0/1875189798 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fae34011900 con 0x7fae28067130 2023-10-10T21:03:41.188 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-10-10T21:03:41.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae28067130 msgr2=0x7fae280695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae28067130 0x7fae280695e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae340093f0 tx=0x7fae34017000 comp rx=0 tx=0).stop 2023-10-10T21:03:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 msgr2=0x7fae440c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 0x7fae440c90c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fae4000e930 tx=0x7fae400091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 shutdown_connections 2023-10-10T21:03:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fae28067130 0x7fae280695e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae44159f20 0x7fae44151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b0760 0x7fae440c90c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 --2- 172.21.15.154:0/1875189798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae44156350 0x7fae4406e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 >> 172.21.15.154:0/1875189798 conn(0x7fae44068e20 msgr2=0x7fae440704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 shutdown_connections 2023-10-10T21:03:41.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.189+0000 7fae4b19d700 1 -- 172.21.15.154:0/1875189798 wait complete. 2023-10-10T21:03:41.207 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-10-10T21:03:41.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-10T21:03:41.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.393+0000 7fd34edff700 1 Processor -- start 2023-10-10T21:03:41.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.393+0000 7fd34edff700 1 -- start start 2023-10-10T21:03:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.395+0000 7fd34edff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3481563b0 0x7fd348156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.395+0000 7fd34edff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34815a9b0 con 0x7fd34815a440 2023-10-10T21:03:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.395+0000 7fd34edff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34815ac90 con 0x7fd348068890 2023-10-10T21:03:41.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.395+0000 7fd34edff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34815af70 con 0x7fd3481563b0 2023-10-10T21:03:41.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.395+0000 7fd347fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd34815a440 0x7fd3480acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40514/0 (socket says 172.21.15.154:40514) 2023-10-10T21:03:41.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.395+0000 7fd347fff700 1 -- 172.21.15.154:0/1938544271 learned_addr learned my addr 172.21.15.154:0/1938544271 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:41.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.395+0000 7fd34cb9b700 1 --2- 172.21.15.154:0/1938544271 >> v2:172.21.15.179:3300/0 conn(0x7fd3481563b0 0x7fd348156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.395+0000 7fd3477fe700 1 -- 172.21.15.154:0/1938544271 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707791958 0 0) 0x7fd34815a9b0 con 0x7fd34815a440 2023-10-10T21:03:41.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.395+0000 7fd3477fe700 1 -- 172.21.15.154:0/1938544271 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd338003570 con 0x7fd34815a440 2023-10-10T21:03:41.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.396+0000 7fd34cb9b700 1 -- 172.21.15.154:0/1938544271 >> v1:172.21.15.179:6789/0 conn(0x7fd348068890 legacy=0x7fd3480c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.396+0000 7fd34cb9b700 1 -- 172.21.15.154:0/1938544271 >> v1:172.21.15.154:6789/0 conn(0x7fd34815a440 legacy=0x7fd3480acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.396+0000 7fd34cb9b700 1 -- 172.21.15.154:0/1938544271 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34815b250 con 0x7fd3481563b0 2023-10-10T21:03:41.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.396+0000 7fd34cb9b700 1 --2- 172.21.15.154:0/1938544271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3481563b0 0x7fd348156780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0098e0 tx=0x7fd33c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7adfc97388c81c2b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:41.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.396+0000 7fd3477fe700 1 -- 172.21.15.154:0/1938544271 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00b640 con 0x7fd3481563b0 2023-10-10T21:03:41.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.396+0000 7fd3477fe700 1 -- 172.21.15.154:0/1938544271 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c00b7a0 con 0x7fd3481563b0 2023-10-10T21:03:41.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.396+0000 7fd3477fe700 1 -- 172.21.15.154:0/1938544271 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00bb20 con 0x7fd3481563b0 2023-10-10T21:03:41.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.397+0000 7fd34edff700 1 -- 172.21.15.154:0/1938544271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3481563b0 msgr2=0x7fd348156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.397+0000 7fd34edff700 1 --2- 172.21.15.154:0/1938544271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3481563b0 0x7fd348156780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0098e0 tx=0x7fd33c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.397+0000 7fd34edff700 1 -- 172.21.15.154:0/1938544271 shutdown_connections 2023-10-10T21:03:41.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.397+0000 7fd34edff700 1 --2- 172.21.15.154:0/1938544271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3481563b0 0x7fd348156780 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.397+0000 7fd34edff700 1 -- 172.21.15.154:0/1938544271 >> 172.21.15.154:0/1938544271 conn(0x7fd3480c8f90 msgr2=0x7fd3480c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:41.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.397+0000 7fd34edff700 1 -- 172.21.15.154:0/1938544271 shutdown_connections 2023-10-10T21:03:41.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.397+0000 7fd34edff700 1 -- 172.21.15.154:0/1938544271 wait complete. 2023-10-10T21:03:41.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.398+0000 7fd34edff700 1 Processor -- start 2023-10-10T21:03:41.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.399+0000 7fd34edff700 1 -- start start 2023-10-10T21:03:41.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.399+0000 7fd34edff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd348068890 0x7fd348141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.399+0000 7fd34edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3481563b0 0x7fd34816d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.399+0000 7fd34edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd34815a440 0x7fd3480aa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.399+0000 7fd34edff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34816e3e0 con 0x7fd348068890 2023-10-10T21:03:41.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.399+0000 7fd34edff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480a9cf0 con 0x7fd34815a440 2023-10-10T21:03:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.399+0000 7fd34edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34816de20 con 0x7fd3481563b0 2023-10-10T21:03:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd348068890 0x7fd348141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd348068890 0x7fd348141280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35326/0 (socket says 172.21.15.154:35326) 2023-10-10T21:03:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34cb9b700 1 -- 172.21.15.154:0/309690719 learned_addr learned my addr 172.21.15.154:0/309690719 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd347fff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3481563b0 0x7fd34816d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34d39c700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd34815a440 0x7fd3480aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34cb9b700 1 -- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3481563b0 msgr2=0x7fd34816d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34cb9b700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3481563b0 0x7fd34816d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34cb9b700 1 -- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd34815a440 msgr2=0x7fd3480aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34cb9b700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd34815a440 0x7fd3480aa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34cb9b700 1 -- 172.21.15.154:0/309690719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c009420 con 0x7fd348068890 2023-10-10T21:03:41.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34d39c700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd34815a440 0x7fd3480aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:41.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd347fff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3481563b0 0x7fd34816d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:41.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd34cb9b700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd348068890 0x7fd348141280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd3480ad6d0 tx=0x7fd33c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:41.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.400+0000 7fd344ff9700 1 -- 172.21.15.154:0/309690719 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00bb20 con 0x7fd348068890 2023-10-10T21:03:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.401+0000 7fd344ff9700 1 -- 172.21.15.154:0/309690719 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c011420 con 0x7fd348068890 2023-10-10T21:03:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.401+0000 7fd344ff9700 1 -- 172.21.15.154:0/309690719 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0117e0 con 0x7fd348068890 2023-10-10T21:03:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.401+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34816e100 con 0x7fd348068890 2023-10-10T21:03:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.401+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3481417c0 con 0x7fd348068890 2023-10-10T21:03:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.402+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3481419e0 con 0x7fd348068890 2023-10-10T21:03:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.403+0000 7fd344ff9700 1 -- 172.21.15.154:0/309690719 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fd33c011c10 con 0x7fd348068890 2023-10-10T21:03:41.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.403+0000 7fd344ff9700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd32c067130 0x7fd32c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.403+0000 7fd344ff9700 1 -- 172.21.15.154:0/309690719 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fd33c086300 con 0x7fd348068890 2023-10-10T21:03:41.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.404+0000 7fd347fff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd32c067130 0x7fd32c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.404+0000 7fd347fff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd32c067130 0x7fd32c0695e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd334007fd0 tx=0x7fd334009040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:41.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.408+0000 7fd344ff9700 1 -- 172.21.15.154:0/309690719 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3481419e0 con 0x7fd348068890 2023-10-10T21:03:41.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.627+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3481419e0 con 0x7fd32c067130 2023-10-10T21:03:41.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.677+0000 7fd344ff9700 1 -- 172.21.15.154:0/309690719 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd3481419e0 con 0x7fd32c067130 2023-10-10T21:03:41.678 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-10-10T21:03:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd32c067130 msgr2=0x7fd32c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd32c067130 0x7fd32c0695e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd334007fd0 tx=0x7fd334009040 comp rx=0 tx=0).stop 2023-10-10T21:03:41.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd348068890 msgr2=0x7fd348141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd348068890 0x7fd348141280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd3480ad6d0 tx=0x7fd33c017000 comp rx=0 tx=0).stop 2023-10-10T21:03:41.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 shutdown_connections 2023-10-10T21:03:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd34815a440 0x7fd3480aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd348068890 0x7fd348141280 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd32c067130 0x7fd32c0695e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 --2- 172.21.15.154:0/309690719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3481563b0 0x7fd34816d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 >> 172.21.15.154:0/309690719 conn(0x7fd3480c8f90 msgr2=0x7fd3480c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 shutdown_connections 2023-10-10T21:03:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.679+0000 7fd34edff700 1 -- 172.21.15.154:0/309690719 wait complete. 2023-10-10T21:03:41.698 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-10-10T21:03:41.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-10T21:03:41.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.884+0000 7fd25edff700 1 Processor -- start 2023-10-10T21:03:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.884+0000 7fd25edff700 1 -- start start 2023-10-10T21:03:41.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.885+0000 7fd25edff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd258159ec0 0x7fd2580b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.885+0000 7fd25edff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2580b53d0 0x7fd2580cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.885+0000 7fd25edff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2580b5b00 con 0x7fd2580cce40 2023-10-10T21:03:41.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.885+0000 7fd25edff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2580b5850 con 0x7fd258159ec0 2023-10-10T21:03:41.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.885+0000 7fd25edff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2580b5da0 con 0x7fd2580b53d0 2023-10-10T21:03:41.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd25cb9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd258159ec0 0x7fd2580b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd25cb9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd258159ec0 0x7fd2580b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35334/0 (socket says 172.21.15.154:35334) 2023-10-10T21:03:41.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd25cb9b700 1 -- 172.21.15.154:0/2093517805 learned_addr learned my addr 172.21.15.154:0/2093517805 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:41.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd257fff700 1 --2- 172.21.15.154:0/2093517805 >> v2:172.21.15.179:3300/0 conn(0x7fd2580b53d0 0x7fd2580cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd25cb9b700 1 -- 172.21.15.154:0/2093517805 >> v2:172.21.15.179:3300/0 conn(0x7fd2580b53d0 msgr2=0x7fd2580cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:41.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd25cb9b700 1 --2- 172.21.15.154:0/2093517805 >> v2:172.21.15.179:3300/0 conn(0x7fd2580b53d0 0x7fd2580cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd25cb9b700 1 -- 172.21.15.154:0/2093517805 >> v1:172.21.15.179:6789/0 conn(0x7fd2580cce40 legacy=0x7fd2580cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd25cb9b700 1 -- 172.21.15.154:0/2093517805 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580b6080 con 0x7fd258159ec0 2023-10-10T21:03:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd257fff700 1 --2- 172.21.15.154:0/2093517805 >> v2:172.21.15.179:3300/0 conn(0x7fd2580b53d0 0x7fd2580cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.886+0000 7fd25cb9b700 1 --2- 172.21.15.154:0/2093517805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258159ec0 0x7fd2580b4e90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd2580b64d0 tx=0x7fd24c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a9a2ab534833e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd2577fe700 1 -- 172.21.15.154:0/2093517805 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c005c10 con 0x7fd258159ec0 2023-10-10T21:03:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd2577fe700 1 -- 172.21.15.154:0/2093517805 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c005d70 con 0x7fd258159ec0 2023-10-10T21:03:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd2577fe700 1 -- 172.21.15.154:0/2093517805 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c00b840 con 0x7fd258159ec0 2023-10-10T21:03:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd25edff700 1 -- 172.21.15.154:0/2093517805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258159ec0 msgr2=0x7fd2580b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd25edff700 1 --2- 172.21.15.154:0/2093517805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258159ec0 0x7fd2580b4e90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd2580b64d0 tx=0x7fd24c009220 comp rx=0 tx=0).stop 2023-10-10T21:03:41.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd25edff700 1 -- 172.21.15.154:0/2093517805 shutdown_connections 2023-10-10T21:03:41.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd25edff700 1 --2- 172.21.15.154:0/2093517805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258159ec0 0x7fd2580b4e90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd25edff700 1 --2- 172.21.15.154:0/2093517805 >> v2:172.21.15.179:3300/0 conn(0x7fd2580b53d0 0x7fd2580cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd25edff700 1 -- 172.21.15.154:0/2093517805 >> 172.21.15.154:0/2093517805 conn(0x7fd2580999f0 msgr2=0x7fd2580b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd25edff700 1 -- 172.21.15.154:0/2093517805 shutdown_connections 2023-10-10T21:03:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.887+0000 7fd25edff700 1 -- 172.21.15.154:0/2093517805 wait complete. 2023-10-10T21:03:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.889+0000 7fd25edff700 1 Processor -- start 2023-10-10T21:03:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.889+0000 7fd25edff700 1 -- start start 2023-10-10T21:03:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25edff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2580b53d0 0x7fd25809cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2580cce40 0x7fd25809d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd258159ec0 0x7fd25816d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25edff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25809a460 con 0x7fd2580b53d0 2023-10-10T21:03:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25edff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581572f0 con 0x7fd258159ec0 2023-10-10T21:03:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25809a9e0 con 0x7fd2580cce40 2023-10-10T21:03:41.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2580b53d0 0x7fd25809cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2580b53d0 0x7fd25809cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35340/0 (socket says 172.21.15.154:35340) 2023-10-10T21:03:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25cb9b700 1 -- 172.21.15.154:0/2958167136 learned_addr learned my addr 172.21.15.154:0/2958167136 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25cb9b700 1 -- 172.21.15.154:0/2958167136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2580cce40 msgr2=0x7fd25809d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25cb9b700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2580cce40 0x7fd25809d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25cb9b700 1 -- 172.21.15.154:0/2958167136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd258159ec0 msgr2=0x7fd25816d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25d39c700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd258159ec0 0x7fd25816d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25cb9b700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd258159ec0 0x7fd25816d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25cb9b700 1 -- 172.21.15.154:0/2958167136 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c009480 con 0x7fd2580b53d0 2023-10-10T21:03:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.890+0000 7fd25d39c700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd258159ec0 0x7fd25816d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:03:41.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.891+0000 7fd25cb9b700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2580b53d0 0x7fd25809cc50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0030c0 tx=0x7fd24c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:41.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.891+0000 7fd254ff9700 1 -- 172.21.15.154:0/2958167136 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c011b70 con 0x7fd2580b53d0 2023-10-10T21:03:41.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.891+0000 7fd254ff9700 1 -- 172.21.15.154:0/2958167136 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c011cf0 con 0x7fd2580b53d0 2023-10-10T21:03:41.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.891+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd258069c20 con 0x7fd2580b53d0 2023-10-10T21:03:41.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.891+0000 7fd254ff9700 1 -- 172.21.15.154:0/2958167136 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c01d680 con 0x7fd2580b53d0 2023-10-10T21:03:41.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.891+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25809a670 con 0x7fd2580b53d0 2023-10-10T21:03:41.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.892+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd258063c90 con 0x7fd2580b53d0 2023-10-10T21:03:41.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.893+0000 7fd254ff9700 1 -- 172.21.15.154:0/2958167136 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fd24c01da70 con 0x7fd2580b53d0 2023-10-10T21:03:41.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.894+0000 7fd254ff9700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd23c067130 0x7fd23c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:41.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.894+0000 7fd254ff9700 1 -- 172.21.15.154:0/2958167136 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fd24c086cf0 con 0x7fd2580b53d0 2023-10-10T21:03:41.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.894+0000 7fd257fff700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd23c067130 0x7fd23c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:41.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.894+0000 7fd257fff700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd23c067130 0x7fd23c0695e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd244006fd0 tx=0x7fd244008040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:41.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:41.898+0000 7fd254ff9700 1 -- 172.21.15.154:0/2958167136 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd24c08b070 con 0x7fd2580b53d0 2023-10-10T21:03:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.114+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd25806a140 con 0x7fd23c067130 2023-10-10T21:03:42.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.165+0000 7fd254ff9700 1 -- 172.21.15.154:0/2958167136 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd25806a140 con 0x7fd23c067130 2023-10-10T21:03:42.166 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-10-10T21:03:42.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd23c067130 msgr2=0x7fd23c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd23c067130 0x7fd23c0695e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd244006fd0 tx=0x7fd244008040 comp rx=0 tx=0).stop 2023-10-10T21:03:42.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2580b53d0 msgr2=0x7fd25809cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2580b53d0 0x7fd25809cc50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0030c0 tx=0x7fd24c015000 comp rx=0 tx=0).stop 2023-10-10T21:03:42.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 shutdown_connections 2023-10-10T21:03:42.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd258159ec0 0x7fd25816d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2580b53d0 0x7fd25809cc50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd23c067130 0x7fd23c0695e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 --2- 172.21.15.154:0/2958167136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2580cce40 0x7fd25809d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.167+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 >> 172.21.15.154:0/2958167136 conn(0x7fd2580999f0 msgr2=0x7fd2580ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.168+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 shutdown_connections 2023-10-10T21:03:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.168+0000 7fd25edff700 1 -- 172.21.15.154:0/2958167136 wait complete. 2023-10-10T21:03:42.186 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-10-10T21:03:42.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-10T21:03:42.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.376+0000 7f5bfe1ff700 1 Processor -- start 2023-10-10T21:03:42.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.376+0000 7f5bfe1ff700 1 -- start start 2023-10-10T21:03:42.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.377+0000 7f5bfe1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf8159ec0 0x7f5bf80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.377+0000 7f5bfe1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5bf80b53d0 0x7f5bf80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.377+0000 7f5bfe1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf80b5b00 con 0x7f5bf80cce40 2023-10-10T21:03:42.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.377+0000 7f5bfe1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf80b5da0 con 0x7f5bf80b53d0 2023-10-10T21:03:42.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.377+0000 7f5bfe1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80b6080 con 0x7f5bf8159ec0 2023-10-10T21:03:42.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5bf80b53d0 0x7f5bf80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf8159ec0 0x7f5bf80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5bf80b53d0 0x7f5bf80cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35346/0 (socket says 172.21.15.154:35346) 2023-10-10T21:03:42.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf6ffd700 1 -- 172.21.15.154:0/3076572114 learned_addr learned my addr 172.21.15.154:0/3076572114 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:42.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf6ffd700 1 -- 172.21.15.154:0/3076572114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf8159ec0 msgr2=0x7f5bf80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:42.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf67fc700 1 -- 172.21.15.154:0/3076572114 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078138089 0 0) 0x7f5bf80b5b00 con 0x7f5bf80cce40 2023-10-10T21:03:42.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf6ffd700 1 --2- 172.21.15.154:0/3076572114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf8159ec0 0x7f5bf80b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf6ffd700 1 -- 172.21.15.154:0/3076572114 >> v1:172.21.15.179:6789/0 conn(0x7f5bf80cce40 legacy=0x7f5bf80cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf6ffd700 1 -- 172.21.15.154:0/3076572114 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf80cc100 con 0x7f5bf80b53d0 2023-10-10T21:03:42.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.378+0000 7f5bf6ffd700 1 --2- 172.21.15.154:0/3076572114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 0x7f5bf80cc900 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0099b0 tx=0x7f5bec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae417babe15535b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:42.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bf67fc700 1 -- 172.21.15.154:0/3076572114 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec009ea0 con 0x7f5bf80b53d0 2023-10-10T21:03:42.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bf67fc700 1 -- 172.21.15.154:0/3076572114 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec00b860 con 0x7f5bf80b53d0 2023-10-10T21:03:42.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bf67fc700 1 -- 172.21.15.154:0/3076572114 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00bc00 con 0x7f5bf80b53d0 2023-10-10T21:03:42.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/3076572114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 msgr2=0x7f5bf80cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bfe1ff700 1 --2- 172.21.15.154:0/3076572114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 0x7f5bf80cc900 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0099b0 tx=0x7f5bec009250 comp rx=0 tx=0).stop 2023-10-10T21:03:42.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/3076572114 shutdown_connections 2023-10-10T21:03:42.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bfe1ff700 1 --2- 172.21.15.154:0/3076572114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf8159ec0 0x7f5bf80b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bfe1ff700 1 --2- 172.21.15.154:0/3076572114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 0x7f5bf80cc900 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/3076572114 >> 172.21.15.154:0/3076572114 conn(0x7f5bf80999f0 msgr2=0x7f5bf80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:42.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/3076572114 shutdown_connections 2023-10-10T21:03:42.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.379+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/3076572114 wait complete. 2023-10-10T21:03:42.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.381+0000 7f5bfe1ff700 1 Processor -- start 2023-10-10T21:03:42.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.381+0000 7f5bfe1ff700 1 -- start start 2023-10-10T21:03:42.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bfe1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 0x7f5bf8144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bfe1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80cce40 0x7f5bf8146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bfe1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf8159ec0 0x7f5bf8146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bfe1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8147660 con 0x7f5bf80b53d0 2023-10-10T21:03:42.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bfe1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8147940 con 0x7f5bf8159ec0 2023-10-10T21:03:42.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bfe1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8147c20 con 0x7f5bf80cce40 2023-10-10T21:03:42.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 0x7f5bf8144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 0x7f5bf8144b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35358/0 (socket says 172.21.15.154:35358) 2023-10-10T21:03:42.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bf77fe700 1 -- 172.21.15.154:0/4078439270 learned_addr learned my addr 172.21.15.154:0/4078439270 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:42.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bf6ffd700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80cce40 0x7f5bf8146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.382+0000 7f5bf7fff700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf8159ec0 0x7f5bf8146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bf77fe700 1 -- 172.21.15.154:0/4078439270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80cce40 msgr2=0x7f5bf8146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bf77fe700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80cce40 0x7f5bf8146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bf77fe700 1 -- 172.21.15.154:0/4078439270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf8159ec0 msgr2=0x7f5bf8146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bf77fe700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf8159ec0 0x7f5bf8146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bf77fe700 1 -- 172.21.15.154:0/4078439270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0094f0 con 0x7f5bf80b53d0 2023-10-10T21:03:42.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bf77fe700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 0x7f5bf8144b40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5be800ea00 tx=0x7f5be8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:42.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bdf7fe700 1 -- 172.21.15.154:0/4078439270 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800c850 con 0x7f5bf80b53d0 2023-10-10T21:03:42.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bdf7fe700 1 -- 172.21.15.154:0/4078439270 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be800c9b0 con 0x7f5bf80b53d0 2023-10-10T21:03:42.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf8147f00 con 0x7f5bf80b53d0 2023-10-10T21:03:42.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bdf7fe700 1 -- 172.21.15.154:0/4078439270 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800cd30 con 0x7f5bf80b53d0 2023-10-10T21:03:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.383+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf8145080 con 0x7f5bf80b53d0 2023-10-10T21:03:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.384+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf8148970 con 0x7f5bf80b53d0 2023-10-10T21:03:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.385+0000 7f5bdf7fe700 1 -- 172.21.15.154:0/4078439270 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f5be8013680 con 0x7f5bf80b53d0 2023-10-10T21:03:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.386+0000 7f5bdf7fe700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5be4067130 0x7f5be40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.386+0000 7f5bdf7fe700 1 -- 172.21.15.154:0/4078439270 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f5be8085050 con 0x7f5bf80b53d0 2023-10-10T21:03:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.386+0000 7f5bf6ffd700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5be4067130 0x7f5be40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.387+0000 7f5bf6ffd700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5be4067130 0x7f5be40695e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0099b0 tx=0x7f5bec017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.390+0000 7f5bdf7fe700 1 -- 172.21.15.154:0/4078439270 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5be8051f40 con 0x7f5bf80b53d0 2023-10-10T21:03:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.606+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bf8063c90 con 0x7f5be4067130 2023-10-10T21:03:42.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.663+0000 7f5bdf7fe700 1 -- 172.21.15.154:0/4078439270 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5bf8063c90 con 0x7f5be4067130 2023-10-10T21:03:42.665 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-10-10T21:03:42.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5be4067130 msgr2=0x7f5be40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5be4067130 0x7f5be40695e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0099b0 tx=0x7f5bec017000 comp rx=0 tx=0).stop 2023-10-10T21:03:42.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 msgr2=0x7f5bf8144b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 0x7f5bf8144b40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5be800ea00 tx=0x7f5be8009120 comp rx=0 tx=0).stop 2023-10-10T21:03:42.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 shutdown_connections 2023-10-10T21:03:42.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf8159ec0 0x7f5bf8146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bf80b53d0 0x7f5bf8144b40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5be4067130 0x7f5be40695e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 --2- 172.21.15.154:0/4078439270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80cce40 0x7f5bf8146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 >> 172.21.15.154:0/4078439270 conn(0x7f5bf80999f0 msgr2=0x7f5bf80ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:42.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 shutdown_connections 2023-10-10T21:03:42.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.666+0000 7f5bfe1ff700 1 -- 172.21.15.154:0/4078439270 wait complete. 2023-10-10T21:03:42.684 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-10-10T21:03:42.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-10T21:03:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.871+0000 7f25445ff700 1 Processor -- start 2023-10-10T21:03:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.871+0000 7f25445ff700 1 -- start start 2023-10-10T21:03:42.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f25445ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f253c06d840 0x7f253c164b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f25445ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c0b4570 con 0x7f253c154320 2023-10-10T21:03:42.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f25445ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c0b2710 con 0x7f253c153f50 2023-10-10T21:03:42.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f25445ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c15a730 con 0x7f253c06d840 2023-10-10T21:03:42.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f2541b9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f253c154320 0x7f253c06d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40516/0 (socket says 172.21.15.154:40516) 2023-10-10T21:03:42.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f2541b9a700 1 -- 172.21.15.154:0/3809561404 learned_addr learned my addr 172.21.15.154:0/3809561404 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:42.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f2542b9c700 1 --2- 172.21.15.154:0/3809561404 >> v2:172.21.15.154:3300/0 conn(0x7f253c06d840 0x7f253c164b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f2541399700 1 -- 172.21.15.154:0/3809561404 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713892522 0 0) 0x7f253c0b4570 con 0x7f253c154320 2023-10-10T21:03:42.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f2541399700 1 -- 172.21.15.154:0/3809561404 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2528003570 con 0x7f253c154320 2023-10-10T21:03:42.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f2542b9c700 1 -- 172.21.15.154:0/3809561404 >> v1:172.21.15.179:6789/0 conn(0x7f253c153f50 legacy=0x7f253c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f2542b9c700 1 -- 172.21.15.154:0/3809561404 >> v1:172.21.15.154:6789/0 conn(0x7f253c154320 legacy=0x7f253c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.873+0000 7f2542b9c700 1 -- 172.21.15.154:0/3809561404 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c15aa10 con 0x7f253c06d840 2023-10-10T21:03:42.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.874+0000 7f2542b9c700 1 --2- 172.21.15.154:0/3809561404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c06d840 0x7f253c164b30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2534009e90 tx=0x7f2534009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751279434b665858 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:42.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.874+0000 7f2541399700 1 -- 172.21.15.154:0/3809561404 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253400e070 con 0x7f253c06d840 2023-10-10T21:03:42.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.874+0000 7f2541399700 1 -- 172.21.15.154:0/3809561404 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253400bc40 con 0x7f253c06d840 2023-10-10T21:03:42.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.874+0000 7f2541399700 1 -- 172.21.15.154:0/3809561404 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534012430 con 0x7f253c06d840 2023-10-10T21:03:42.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.875+0000 7f25445ff700 1 -- 172.21.15.154:0/3809561404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c06d840 msgr2=0x7f253c164b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.875+0000 7f25445ff700 1 --2- 172.21.15.154:0/3809561404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c06d840 0x7f253c164b30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2534009e90 tx=0x7f2534009780 comp rx=0 tx=0).stop 2023-10-10T21:03:42.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.875+0000 7f25445ff700 1 -- 172.21.15.154:0/3809561404 shutdown_connections 2023-10-10T21:03:42.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.875+0000 7f25445ff700 1 --2- 172.21.15.154:0/3809561404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c06d840 0x7f253c164b30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.875+0000 7f25445ff700 1 -- 172.21.15.154:0/3809561404 >> 172.21.15.154:0/3809561404 conn(0x7f253c06baf0 msgr2=0x7f253c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:42.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.875+0000 7f25445ff700 1 -- 172.21.15.154:0/3809561404 shutdown_connections 2023-10-10T21:03:42.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.875+0000 7f25445ff700 1 -- 172.21.15.154:0/3809561404 wait complete. 2023-10-10T21:03:42.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.876+0000 7f25445ff700 1 Processor -- start 2023-10-10T21:03:42.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.876+0000 7f25445ff700 1 -- start start 2023-10-10T21:03:42.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.877+0000 7f25445ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f253c06d840 0x7f253c15e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.877+0000 7f25445ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c153f50 0x7f253c16df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.877+0000 7f25445ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c154320 0x7f253c145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.877+0000 7f25445ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c16e450 con 0x7f253c154320 2023-10-10T21:03:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.877+0000 7f25445ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c15e3b0 con 0x7f253c06d840 2023-10-10T21:03:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.877+0000 7f25445ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c15d7a0 con 0x7f253c153f50 2023-10-10T21:03:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2542b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c154320 0x7f253c145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2542b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c154320 0x7f253c145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35380/0 (socket says 172.21.15.154:35380) 2023-10-10T21:03:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2542b9c700 1 -- 172.21.15.154:0/1770315040 learned_addr learned my addr 172.21.15.154:0/1770315040 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2541b9a700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c153f50 0x7f253c16df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f254239b700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f253c06d840 0x7f253c15e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2542b9c700 1 -- 172.21.15.154:0/1770315040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c153f50 msgr2=0x7f253c16df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2542b9c700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c153f50 0x7f253c16df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2542b9c700 1 -- 172.21.15.154:0/1770315040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f253c06d840 msgr2=0x7f253c15e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2542b9c700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f253c06d840 0x7f253c15e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2542b9c700 1 -- 172.21.15.154:0/1770315040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534009a20 con 0x7f253c154320 2023-10-10T21:03:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.878+0000 7f2542b9c700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c154320 0x7f253c145330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2534013000 tx=0x7f2534019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.879+0000 7f25327fc700 1 -- 172.21.15.154:0/1770315040 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253401b420 con 0x7f253c154320 2023-10-10T21:03:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.879+0000 7f25327fc700 1 -- 172.21.15.154:0/1770315040 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253401b580 con 0x7f253c154320 2023-10-10T21:03:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.879+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c15da80 con 0x7f253c154320 2023-10-10T21:03:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.879+0000 7f25327fc700 1 -- 172.21.15.154:0/1770315040 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253401b940 con 0x7f253c154320 2023-10-10T21:03:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.879+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c15e040 con 0x7f253c154320 2023-10-10T21:03:42.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.880+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c15e560 con 0x7f253c154320 2023-10-10T21:03:42.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.880+0000 7f25327fc700 1 -- 172.21.15.154:0/1770315040 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f253401bcb0 con 0x7f253c154320 2023-10-10T21:03:42.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.881+0000 7f25327fc700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2520067130 0x7f25200695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:42.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.881+0000 7f25327fc700 1 -- 172.21.15.154:0/1770315040 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f2534086710 con 0x7f253c154320 2023-10-10T21:03:42.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.882+0000 7f254239b700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2520067130 0x7f25200695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:42.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.882+0000 7f254239b700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2520067130 0x7f25200695e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2538003a80 tx=0x7f2538007ec0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:42.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:42.886+0000 7f25327fc700 1 -- 172.21.15.154:0/1770315040 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f253c15e560 con 0x7f253c154320 2023-10-10T21:03:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.102+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f253c15e520 con 0x7f2520067130 2023-10-10T21:03:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.154+0000 7f25327fc700 1 -- 172.21.15.154:0/1770315040 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f253c15e520 con 0x7f2520067130 2023-10-10T21:03:43.156 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-10-10T21:03:43.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2520067130 msgr2=0x7f25200695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2520067130 0x7f25200695e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2538003a80 tx=0x7f2538007ec0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c154320 msgr2=0x7f253c145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c154320 0x7f253c145330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2534013000 tx=0x7f2534019000 comp rx=0 tx=0).stop 2023-10-10T21:03:43.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 shutdown_connections 2023-10-10T21:03:43.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253c154320 0x7f253c145330 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f253c06d840 0x7f253c15e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2520067130 0x7f25200695e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 --2- 172.21.15.154:0/1770315040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f253c153f50 0x7f253c16df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 >> 172.21.15.154:0/1770315040 conn(0x7f253c06baf0 msgr2=0x7f253c0c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:43.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 shutdown_connections 2023-10-10T21:03:43.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.157+0000 7f25445ff700 1 -- 172.21.15.154:0/1770315040 wait complete. 2023-10-10T21:03:43.175 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-10-10T21:03:43.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-10T21:03:43.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.362+0000 7f5e9adff700 1 Processor -- start 2023-10-10T21:03:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.362+0000 7f5e9adff700 1 -- start start 2023-10-10T21:03:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.363+0000 7f5e9adff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5e941563b0 0x7f5e94156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.363+0000 7f5e9adff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9415a9b0 con 0x7f5e9415a440 2023-10-10T21:03:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.363+0000 7f5e9adff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9415ac90 con 0x7f5e94068890 2023-10-10T21:03:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.363+0000 7f5e9adff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9415af70 con 0x7f5e941563b0 2023-10-10T21:03:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.364+0000 7f5e98b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5e941563b0 0x7f5e94156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.364+0000 7f5e93fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5e9415a440 0x7f5e940acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40524/0 (socket says 172.21.15.154:40524) 2023-10-10T21:03:43.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.364+0000 7f5e93fff700 1 -- 172.21.15.154:0/1036291675 learned_addr learned my addr 172.21.15.154:0/1036291675 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:43.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.364+0000 7f5e98b9b700 1 -- 172.21.15.154:0/1036291675 >> v1:172.21.15.179:6789/0 conn(0x7f5e94068890 legacy=0x7f5e940c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:43.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.364+0000 7f5e98b9b700 1 -- 172.21.15.154:0/1036291675 >> v1:172.21.15.154:6789/0 conn(0x7f5e9415a440 legacy=0x7f5e940acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.364+0000 7f5e98b9b700 1 -- 172.21.15.154:0/1036291675 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9415b250 con 0x7f5e941563b0 2023-10-10T21:03:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.364+0000 7f5e937fe700 1 -- 172.21.15.154:0/1036291675 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386065268 0 0) 0x7f5e9415a9b0 con 0x7f5e9415a440 2023-10-10T21:03:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.364+0000 7f5e98b9b700 1 --2- 172.21.15.154:0/1036291675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e941563b0 0x7f5e94156780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e880098e0 tx=0x7f5e880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0600d6962cc02c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e937fe700 1 -- 172.21.15.154:0/1036291675 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88009e80 con 0x7f5e941563b0 2023-10-10T21:03:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e937fe700 1 -- 172.21.15.154:0/1036291675 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8800b820 con 0x7f5e941563b0 2023-10-10T21:03:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e937fe700 1 -- 172.21.15.154:0/1036291675 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800bba0 con 0x7f5e941563b0 2023-10-10T21:03:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e9adff700 1 -- 172.21.15.154:0/1036291675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e941563b0 msgr2=0x7f5e94156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e9adff700 1 --2- 172.21.15.154:0/1036291675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e941563b0 0x7f5e94156780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e880098e0 tx=0x7f5e880091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e9adff700 1 -- 172.21.15.154:0/1036291675 shutdown_connections 2023-10-10T21:03:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e9adff700 1 --2- 172.21.15.154:0/1036291675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e941563b0 0x7f5e94156780 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e9adff700 1 -- 172.21.15.154:0/1036291675 >> 172.21.15.154:0/1036291675 conn(0x7f5e940c8f90 msgr2=0x7f5e940c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e9adff700 1 -- 172.21.15.154:0/1036291675 shutdown_connections 2023-10-10T21:03:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.365+0000 7f5e9adff700 1 -- 172.21.15.154:0/1036291675 wait complete. 2023-10-10T21:03:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.367+0000 7f5e9adff700 1 Processor -- start 2023-10-10T21:03:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.367+0000 7f5e9adff700 1 -- start start 2023-10-10T21:03:43.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e94068890 0x7f5e9415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e941563b0 0x7f5e94155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9adff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e9415a440 0x7f5e940c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9adff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9415bb90 con 0x7f5e9415a440 2023-10-10T21:03:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940c70b0 con 0x7f5e941563b0 2023-10-10T21:03:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940c7390 con 0x7f5e94068890 2023-10-10T21:03:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e9415a440 0x7f5e940c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e9415a440 0x7f5e940c65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35398/0 (socket says 172.21.15.154:35398) 2023-10-10T21:03:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9939c700 1 -- 172.21.15.154:0/1427533570 learned_addr learned my addr 172.21.15.154:0/1427533570 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e93fff700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e941563b0 0x7f5e94155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e98b9b700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e94068890 0x7f5e9415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9939c700 1 -- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e94068890 msgr2=0x7f5e9415c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9939c700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e94068890 0x7f5e9415c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9939c700 1 -- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e941563b0 msgr2=0x7f5e94155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9939c700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e941563b0 0x7f5e94155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e9939c700 1 -- 172.21.15.154:0/1427533570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e88009420 con 0x7f5e9415a440 2023-10-10T21:03:43.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e98b9b700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e94068890 0x7f5e9415c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:43.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.368+0000 7f5e93fff700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e941563b0 0x7f5e94155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:43.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.369+0000 7f5e9939c700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e9415a440 0x7f5e940c65d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00bbb0 tx=0x7f5e8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:43.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.369+0000 7f5e90ff9700 1 -- 172.21.15.154:0/1427533570 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0092e0 con 0x7f5e9415a440 2023-10-10T21:03:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.369+0000 7f5e90ff9700 1 -- 172.21.15.154:0/1427533570 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c00c7a0 con 0x7f5e9415a440 2023-10-10T21:03:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.369+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9415b540 con 0x7f5e9415a440 2023-10-10T21:03:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.369+0000 7f5e90ff9700 1 -- 172.21.15.154:0/1427533570 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00cb40 con 0x7f5e9415a440 2023-10-10T21:03:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.369+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9415c560 con 0x7f5e9415a440 2023-10-10T21:03:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.370+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e940718b0 con 0x7f5e9415a440 2023-10-10T21:03:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.371+0000 7f5e90ff9700 1 -- 172.21.15.154:0/1427533570 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f5e8c012070 con 0x7f5e9415a440 2023-10-10T21:03:43.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.371+0000 7f5e90ff9700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e78067130 0x7f5e780695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.372+0000 7f5e90ff9700 1 -- 172.21.15.154:0/1427533570 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f5e8c084740 con 0x7f5e9415a440 2023-10-10T21:03:43.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.372+0000 7f5e98b9b700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e78067130 0x7f5e780695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.372+0000 7f5e98b9b700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e78067130 0x7f5e780695e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e880030c0 tx=0x7f5e88016000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.375+0000 7f5e90ff9700 1 -- 172.21.15.154:0/1427533570 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e8c051590 con 0x7f5e9415a440 2023-10-10T21:03:43.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.591+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e9406d6a0 con 0x7f5e78067130 2023-10-10T21:03:43.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.642+0000 7f5e90ff9700 1 -- 172.21.15.154:0/1427533570 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5e9406d6a0 con 0x7f5e78067130 2023-10-10T21:03:43.644 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-10-10T21:03:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e78067130 msgr2=0x7f5e780695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e78067130 0x7f5e780695e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e880030c0 tx=0x7f5e88016000 comp rx=0 tx=0).stop 2023-10-10T21:03:43.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e9415a440 msgr2=0x7f5e940c65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e9415a440 0x7f5e940c65d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00bbb0 tx=0x7f5e8c009840 comp rx=0 tx=0).stop 2023-10-10T21:03:43.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 shutdown_connections 2023-10-10T21:03:43.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e9415a440 0x7f5e940c65d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5e78067130 0x7f5e780695e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e94068890 0x7f5e9415c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 --2- 172.21.15.154:0/1427533570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e941563b0 0x7f5e94155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 >> 172.21.15.154:0/1427533570 conn(0x7f5e940c8f90 msgr2=0x7f5e940b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:43.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 shutdown_connections 2023-10-10T21:03:43.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.645+0000 7f5e9adff700 1 -- 172.21.15.154:0/1427533570 wait complete. 2023-10-10T21:03:43.664 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-10-10T21:03:43.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-10T21:03:43.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.852+0000 7fd31ffff700 1 Processor -- start 2023-10-10T21:03:43.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.852+0000 7fd31ffff700 1 -- start start 2023-10-10T21:03:43.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.853+0000 7fd31ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3200cc8d0 0x7fd3201596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.853+0000 7fd31ffff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32015a480 con 0x7fd3200ccd70 2023-10-10T21:03:43.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.853+0000 7fd31ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3200afb40 con 0x7fd3200ae750 2023-10-10T21:03:43.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.853+0000 7fd31ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd320153b90 con 0x7fd3200cc8d0 2023-10-10T21:03:43.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.854+0000 7fd31f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3200ccd70 0x7fd320160a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40540/0 (socket says 172.21.15.154:40540) 2023-10-10T21:03:43.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.854+0000 7fd31f7fe700 1 -- 172.21.15.154:0/1598743929 learned_addr learned my addr 172.21.15.154:0/1598743929 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:43.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.854+0000 7fd31e7fc700 1 --2- 172.21.15.154:0/1598743929 >> v2:172.21.15.179:3300/0 conn(0x7fd3200cc8d0 0x7fd3201596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.854+0000 7fd31dffb700 1 -- 172.21.15.154:0/1598743929 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718733615 0 0) 0x7fd32015a480 con 0x7fd3200ccd70 2023-10-10T21:03:43.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.854+0000 7fd31dffb700 1 -- 172.21.15.154:0/1598743929 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd308003570 con 0x7fd3200ccd70 2023-10-10T21:03:43.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.854+0000 7fd31e7fc700 1 -- 172.21.15.154:0/1598743929 >> v1:172.21.15.179:6789/0 conn(0x7fd3200ae750 legacy=0x7fd320153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.854+0000 7fd31dffb700 1 -- 172.21.15.154:0/1598743929 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518479029 0 0) 0x7fd3200afb40 con 0x7fd3200ae750 2023-10-10T21:03:43.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.854+0000 7fd31e7fc700 1 -- 172.21.15.154:0/1598743929 >> v1:172.21.15.154:6789/0 conn(0x7fd3200ccd70 legacy=0x7fd320160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.854+0000 7fd31e7fc700 1 -- 172.21.15.154:0/1598743929 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3200afe20 con 0x7fd3200cc8d0 2023-10-10T21:03:43.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.855+0000 7fd31e7fc700 1 --2- 172.21.15.154:0/1598743929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3200cc8d0 0x7fd3201596b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3140098e0 tx=0x7fd3140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acd17631240b859 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:43.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.855+0000 7fd31dffb700 1 -- 172.21.15.154:0/1598743929 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400b640 con 0x7fd3200cc8d0 2023-10-10T21:03:43.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.855+0000 7fd31dffb700 1 -- 172.21.15.154:0/1598743929 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31400b7a0 con 0x7fd3200cc8d0 2023-10-10T21:03:43.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.855+0000 7fd31dffb700 1 -- 172.21.15.154:0/1598743929 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400bb40 con 0x7fd3200cc8d0 2023-10-10T21:03:43.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.855+0000 7fd31ffff700 1 -- 172.21.15.154:0/1598743929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3200cc8d0 msgr2=0x7fd3201596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.855+0000 7fd31ffff700 1 --2- 172.21.15.154:0/1598743929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3200cc8d0 0x7fd3201596b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3140098e0 tx=0x7fd3140091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.856+0000 7fd31ffff700 1 -- 172.21.15.154:0/1598743929 shutdown_connections 2023-10-10T21:03:43.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.856+0000 7fd31ffff700 1 --2- 172.21.15.154:0/1598743929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3200cc8d0 0x7fd3201596b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.856+0000 7fd31ffff700 1 -- 172.21.15.154:0/1598743929 >> 172.21.15.154:0/1598743929 conn(0x7fd320068e20 msgr2=0x7fd3200cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:43.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.856+0000 7fd31ffff700 1 -- 172.21.15.154:0/1598743929 shutdown_connections 2023-10-10T21:03:43.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.856+0000 7fd31ffff700 1 -- 172.21.15.154:0/1598743929 wait complete. 2023-10-10T21:03:43.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.857+0000 7fd31ffff700 1 Processor -- start 2023-10-10T21:03:43.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.857+0000 7fd31ffff700 1 -- start start 2023-10-10T21:03:43.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3200ae750 0x7fd320169410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3200cc8d0 0x7fd320144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3200ccd70 0x7fd3200acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32015ac90 con 0x7fd3200cc8d0 2023-10-10T21:03:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32015baf0 con 0x7fd3200ccd70 2023-10-10T21:03:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32015aee0 con 0x7fd3200ae750 2023-10-10T21:03:43.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3200cc8d0 0x7fd320144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3200cc8d0 0x7fd320144b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35400/0 (socket says 172.21.15.154:35400) 2023-10-10T21:03:43.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31e7fc700 1 -- 172.21.15.154:0/671265508 learned_addr learned my addr 172.21.15.154:0/671265508 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:43.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31f7fe700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3200ccd70 0x7fd3200acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.858+0000 7fd31effd700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3200ae750 0x7fd320169410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd31e7fc700 1 -- 172.21.15.154:0/671265508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3200ae750 msgr2=0x7fd320169410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd31e7fc700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3200ae750 0x7fd320169410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd31e7fc700 1 -- 172.21.15.154:0/671265508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3200ccd70 msgr2=0x7fd3200acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:43.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd31e7fc700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3200ccd70 0x7fd3200acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:43.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd31e7fc700 1 -- 172.21.15.154:0/671265508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd314009420 con 0x7fd3200cc8d0 2023-10-10T21:03:43.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd31effd700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3200ae750 0x7fd320169410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:43.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd31e7fc700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3200cc8d0 0x7fd320144b40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd314009f80 tx=0x7fd314017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd306ffd700 1 -- 172.21.15.154:0/671265508 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31401f070 con 0x7fd3200cc8d0 2023-10-10T21:03:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd306ffd700 1 -- 172.21.15.154:0/671265508 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314000bc0 con 0x7fd3200cc8d0 2023-10-10T21:03:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32015b1c0 con 0x7fd3200cc8d0 2023-10-10T21:03:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd306ffd700 1 -- 172.21.15.154:0/671265508 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314025420 con 0x7fd3200cc8d0 2023-10-10T21:03:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.859+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32015b780 con 0x7fd3200cc8d0 2023-10-10T21:03:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.861+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32004c3c0 con 0x7fd3200cc8d0 2023-10-10T21:03:43.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.861+0000 7fd306ffd700 1 -- 172.21.15.154:0/671265508 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fd314023070 con 0x7fd3200cc8d0 2023-10-10T21:03:43.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.862+0000 7fd306ffd700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd30c067130 0x7fd30c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:43.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.862+0000 7fd306ffd700 1 -- 172.21.15.154:0/671265508 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fd314085ec0 con 0x7fd3200cc8d0 2023-10-10T21:03:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.862+0000 7fd31effd700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd30c067130 0x7fd30c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.863+0000 7fd31effd700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd30c067130 0x7fd30c0695e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd3100011e0 tx=0x7fd310009040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:43.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:43.866+0000 7fd306ffd700 1 -- 172.21.15.154:0/671265508 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd314052d50 con 0x7fd3200cc8d0 2023-10-10T21:03:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.084+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd32015bc30 con 0x7fd30c067130 2023-10-10T21:03:44.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.132+0000 7fd306ffd700 1 -- 172.21.15.154:0/671265508 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd32015bc30 con 0x7fd30c067130 2023-10-10T21:03:44.134 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-10-10T21:03:44.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd30c067130 msgr2=0x7fd30c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd30c067130 0x7fd30c0695e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd3100011e0 tx=0x7fd310009040 comp rx=0 tx=0).stop 2023-10-10T21:03:44.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3200cc8d0 msgr2=0x7fd320144b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3200cc8d0 0x7fd320144b40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd314009f80 tx=0x7fd314017000 comp rx=0 tx=0).stop 2023-10-10T21:03:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 shutdown_connections 2023-10-10T21:03:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3200ccd70 0x7fd3200acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fd30c067130 0x7fd30c0695e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3200ae750 0x7fd320169410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 --2- 172.21.15.154:0/671265508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3200cc8d0 0x7fd320144b40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.134+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 >> 172.21.15.154:0/671265508 conn(0x7fd320068e20 msgr2=0x7fd3201563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:44.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.135+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 shutdown_connections 2023-10-10T21:03:44.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.135+0000 7fd31ffff700 1 -- 172.21.15.154:0/671265508 wait complete. 2023-10-10T21:03:44.153 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-10-10T21:03:44.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-10T21:03:44.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.340+0000 7ff6c67ff700 1 Processor -- start 2023-10-10T21:03:44.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.340+0000 7ff6c67ff700 1 -- start start 2023-10-10T21:03:44.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.341+0000 7ff6c67ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff6c00c8490 0x7ff6c00c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.341+0000 7ff6c67ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c0156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.341+0000 7ff6c67ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c00ac030 con 0x7ff6c015a490 2023-10-10T21:03:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.341+0000 7ff6c67ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c0068aa0 con 0x7ff6c00c8490 2023-10-10T21:03:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.341+0000 7ff6c67ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00ab820 con 0x7ff6c0069a50 2023-10-10T21:03:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6bf7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff6c015a490 0x7ff6c0068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40546/0 (socket says 172.21.15.154:40546) 2023-10-10T21:03:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6bf7fe700 1 -- 172.21.15.154:0/3233717418 learned_addr learned my addr 172.21.15.154:0/3233717418 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:03:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6bffff700 1 --2- 172.21.15.154:0/3233717418 >> v2:172.21.15.179:3300/0 conn(0x7ff6c00c8490 0x7ff6c00c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6c4d9c700 1 --2- 172.21.15.154:0/3233717418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c0156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6beffd700 1 -- 172.21.15.154:0/3233717418 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985921374 0 0) 0x7ff6b4001110 con 0x7ff6c015a490 2023-10-10T21:03:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6beffd700 1 -- 172.21.15.154:0/3233717418 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a8003570 con 0x7ff6c015a490 2023-10-10T21:03:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6bffff700 1 -- 172.21.15.154:0/3233717418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 msgr2=0x7ff6c0156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6bffff700 1 --2- 172.21.15.154:0/3233717418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c0156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6bffff700 1 -- 172.21.15.154:0/3233717418 >> v1:172.21.15.154:6789/0 conn(0x7ff6c015a490 legacy=0x7ff6c0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6bffff700 1 -- 172.21.15.154:0/3233717418 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c006dbb0 con 0x7ff6c00c8490 2023-10-10T21:03:44.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.342+0000 7ff6c4d9c700 1 --2- 172.21.15.154:0/3233717418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c0156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:03:44.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.343+0000 7ff6bffff700 1 --2- 172.21.15.154:0/3233717418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c00c8490 0x7ff6c00c6ac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00098e0 tx=0x7ff6b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=917fd66bf9afa002 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:44.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.343+0000 7ff6beffd700 1 -- 172.21.15.154:0/3233717418 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0011630 con 0x7ff6c00c8490 2023-10-10T21:03:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.343+0000 7ff6beffd700 1 -- 172.21.15.154:0/3233717418 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b0011790 con 0x7ff6c00c8490 2023-10-10T21:03:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.343+0000 7ff6beffd700 1 -- 172.21.15.154:0/3233717418 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0011b30 con 0x7ff6c00c8490 2023-10-10T21:03:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.343+0000 7ff6c67ff700 1 -- 172.21.15.154:0/3233717418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c00c8490 msgr2=0x7ff6c00c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.343+0000 7ff6c67ff700 1 --2- 172.21.15.154:0/3233717418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c00c8490 0x7ff6c00c6ac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00098e0 tx=0x7ff6b00091a0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.344+0000 7ff6c67ff700 1 -- 172.21.15.154:0/3233717418 shutdown_connections 2023-10-10T21:03:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.344+0000 7ff6c67ff700 1 --2- 172.21.15.154:0/3233717418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c0156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.344+0000 7ff6c67ff700 1 --2- 172.21.15.154:0/3233717418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c00c8490 0x7ff6c00c6ac0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.344+0000 7ff6c67ff700 1 -- 172.21.15.154:0/3233717418 >> 172.21.15.154:0/3233717418 conn(0x7ff6c00c8f90 msgr2=0x7ff6c00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.344+0000 7ff6c67ff700 1 -- 172.21.15.154:0/3233717418 shutdown_connections 2023-10-10T21:03:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.344+0000 7ff6c67ff700 1 -- 172.21.15.154:0/3233717418 wait complete. 2023-10-10T21:03:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.345+0000 7ff6c67ff700 1 Processor -- start 2023-10-10T21:03:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.345+0000 7ff6c67ff700 1 -- start start 2023-10-10T21:03:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.346+0000 7ff6c67ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c014d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.346+0000 7ff6c67ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c00c8490 0x7ff6c0158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.346+0000 7ff6c67ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6c015a490 0x7ff6c0159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.346+0000 7ff6c67ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c016b630 con 0x7ff6c015a490 2023-10-10T21:03:44.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.346+0000 7ff6c67ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c016b840 con 0x7ff6c00c8490 2023-10-10T21:03:44.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.346+0000 7ff6c67ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c016bb20 con 0x7ff6c0069a50 2023-10-10T21:03:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c4d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6c015a490 0x7ff6c0159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c4d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6c015a490 0x7ff6c0159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35412/0 (socket says 172.21.15.154:35412) 2023-10-10T21:03:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c4d9c700 1 -- 172.21.15.154:0/914604248 learned_addr learned my addr 172.21.15.154:0/914604248 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6bffff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c014d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6bf7fe700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c00c8490 0x7ff6c0158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c4d9c700 1 -- 172.21.15.154:0/914604248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 msgr2=0x7ff6c014d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c4d9c700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c014d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c4d9c700 1 -- 172.21.15.154:0/914604248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c00c8490 msgr2=0x7ff6c0158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c4d9c700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c00c8490 0x7ff6c0158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c4d9c700 1 -- 172.21.15.154:0/914604248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b8009a20 con 0x7ff6c015a490 2023-10-10T21:03:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6bffff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c014d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c4d9c700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6c015a490 0x7ff6c0159030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009fc0 tx=0x7ff6b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6a7fff700 1 -- 172.21.15.154:0/914604248 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800cd30 con 0x7ff6c015a490 2023-10-10T21:03:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6a7fff700 1 -- 172.21.15.154:0/914604248 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b800f040 con 0x7ff6c015a490 2023-10-10T21:03:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b0009420 con 0x7ff6c015a490 2023-10-10T21:03:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.347+0000 7ff6a7fff700 1 -- 172.21.15.154:0/914604248 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80146d0 con 0x7ff6c015a490 2023-10-10T21:03:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.348+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c016c0e0 con 0x7ff6c015a490 2023-10-10T21:03:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.348+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c016b980 con 0x7ff6c015a490 2023-10-10T21:03:44.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.349+0000 7ff6a7fff700 1 -- 172.21.15.154:0/914604248 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7ff6b8003020 con 0x7ff6c015a490 2023-10-10T21:03:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.350+0000 7ff6a7fff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff6ac067130 0x7ff6ac0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.350+0000 7ff6a7fff700 1 -- 172.21.15.154:0/914604248 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff6b80855f0 con 0x7ff6c015a490 2023-10-10T21:03:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.351+0000 7ff6bffff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff6ac067130 0x7ff6ac0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.351+0000 7ff6bffff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff6ac067130 0x7ff6ac0695e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00091e0 tx=0x7ff6b0017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.355+0000 7ff6a7fff700 1 -- 172.21.15.154:0/914604248 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6c016b980 con 0x7ff6c015a490 2023-10-10T21:03:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.572+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6c016b980 con 0x7ff6ac067130 2023-10-10T21:03:44.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.621+0000 7ff6a7fff700 1 -- 172.21.15.154:0/914604248 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff6c016b980 con 0x7ff6ac067130 2023-10-10T21:03:44.623 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-10-10T21:03:44.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff6ac067130 msgr2=0x7ff6ac0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff6ac067130 0x7ff6ac0695e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00091e0 tx=0x7ff6b0017000 comp rx=0 tx=0).stop 2023-10-10T21:03:44.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6c015a490 msgr2=0x7ff6c0159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6c015a490 0x7ff6c0159030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009fc0 tx=0x7ff6b800b040 comp rx=0 tx=0).stop 2023-10-10T21:03:44.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 shutdown_connections 2023-10-10T21:03:44.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6c015a490 0x7ff6c0159030 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ff6ac067130 0x7ff6ac0695e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0069a50 0x7ff6c014d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 --2- 172.21.15.154:0/914604248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c00c8490 0x7ff6c0158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.623+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 >> 172.21.15.154:0/914604248 conn(0x7ff6c00c8f90 msgr2=0x7ff6c00aad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.624+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 shutdown_connections 2023-10-10T21:03:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.624+0000 7ff6c67ff700 1 -- 172.21.15.154:0/914604248 wait complete. 2023-10-10T21:03:44.642 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-10-10T21:03:44.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-10T21:03:44.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.828+0000 7f72999ff700 1 Processor -- start 2023-10-10T21:03:44.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.829+0000 7f72999ff700 1 -- start start 2023-10-10T21:03:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f72999ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f729415a440 0x7f72940acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f72999ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7294068890 0x7f72940c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f72999ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729415a9b0 con 0x7f72941563b0 2023-10-10T21:03:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f72999ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729415ac90 con 0x7f729415a440 2023-10-10T21:03:44.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f72999ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729415af70 con 0x7f7294068890 2023-10-10T21:03:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f72937fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7294068890 0x7f72940c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f72927fc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f729415a440 0x7f72940acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f72927fc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f729415a440 0x7f72940acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:36014/0 (socket says 172.21.15.154:36014) 2023-10-10T21:03:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f72927fc700 1 -- 172.21.15.154:0/1756680711 learned_addr learned my addr 172.21.15.154:0/1756680711 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.830+0000 7f7292ffd700 1 --1- 172.21.15.154:0/1756680711 >> v1:172.21.15.179:6789/0 conn(0x7f72941563b0 0x7f7294156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:58332/0 (socket says 172.21.15.154:58332) 2023-10-10T21:03:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.831+0000 7f72927fc700 1 -- 172.21.15.154:0/1756680711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7294068890 msgr2=0x7f72940c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.831+0000 7f72927fc700 1 --2- 172.21.15.154:0/1756680711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7294068890 0x7f72940c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.831+0000 7f72927fc700 1 -- 172.21.15.154:0/1756680711 >> v1:172.21.15.179:6789/0 conn(0x7f72941563b0 legacy=0x7f7294156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.831+0000 7f72927fc700 1 -- 172.21.15.154:0/1756680711 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729415b250 con 0x7f729415a440 2023-10-10T21:03:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.831+0000 7f72927fc700 1 --2- 172.21.15.154:0/1756680711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f729415a440 0x7f72940acf30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f72880099b0 tx=0x7f7288009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d689f10a9a524bd server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.831+0000 7f7291ffb700 1 -- 172.21.15.154:0/1756680711 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288009ea0 con 0x7f729415a440 2023-10-10T21:03:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.831+0000 7f7291ffb700 1 -- 172.21.15.154:0/1756680711 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728800b860 con 0x7f729415a440 2023-10-10T21:03:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.831+0000 7f7291ffb700 1 -- 172.21.15.154:0/1756680711 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728800bc00 con 0x7f729415a440 2023-10-10T21:03:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.832+0000 7f72999ff700 1 -- 172.21.15.154:0/1756680711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f729415a440 msgr2=0x7f72940acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.832+0000 7f72999ff700 1 --2- 172.21.15.154:0/1756680711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f729415a440 0x7f72940acf30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f72880099b0 tx=0x7f7288009250 comp rx=0 tx=0).stop 2023-10-10T21:03:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.832+0000 7f72999ff700 1 -- 172.21.15.154:0/1756680711 shutdown_connections 2023-10-10T21:03:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.832+0000 7f72999ff700 1 --2- 172.21.15.154:0/1756680711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7294068890 0x7f72940c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.832+0000 7f72999ff700 1 --2- 172.21.15.154:0/1756680711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f729415a440 0x7f72940acf30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.832+0000 7f72999ff700 1 -- 172.21.15.154:0/1756680711 >> 172.21.15.154:0/1756680711 conn(0x7f72940c8f90 msgr2=0x7f72940c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.832+0000 7f72999ff700 1 -- 172.21.15.154:0/1756680711 shutdown_connections 2023-10-10T21:03:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.832+0000 7f72999ff700 1 -- 172.21.15.154:0/1756680711 wait complete. 2023-10-10T21:03:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.833+0000 7f72999ff700 1 Processor -- start 2023-10-10T21:03:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.834+0000 7f72999ff700 1 -- start start 2023-10-10T21:03:44.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.834+0000 7f72999ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7294068890 0x7f72940c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.834+0000 7f72999ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72941563b0 0x7f72940af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.834+0000 7f72999ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f729415a440 0x7f7294147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.834+0000 7f72999ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72940af810 con 0x7f7294068890 2023-10-10T21:03:44.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.834+0000 7f72999ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72940c2790 con 0x7f72941563b0 2023-10-10T21:03:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.834+0000 7f72999ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72940c1b80 con 0x7f729415a440 2023-10-10T21:03:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f7292ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7294068890 0x7f72940c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f7292ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7294068890 0x7f72940c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35414/0 (socket says 172.21.15.154:35414) 2023-10-10T21:03:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f7292ffd700 1 -- 172.21.15.154:0/2255889795 learned_addr learned my addr 172.21.15.154:0/2255889795 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f72927fc700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72941563b0 0x7f72940af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f72937fe700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f729415a440 0x7f7294147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f7292ffd700 1 -- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f729415a440 msgr2=0x7f7294147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f7292ffd700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f729415a440 0x7f7294147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f7292ffd700 1 -- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72941563b0 msgr2=0x7f72940af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:44.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f7292ffd700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72941563b0 0x7f72940af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:44.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f7292ffd700 1 -- 172.21.15.154:0/2255889795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880094f0 con 0x7f7294068890 2023-10-10T21:03:44.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f72937fe700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f729415a440 0x7f7294147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:44.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f72927fc700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72941563b0 0x7f72940af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:44.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.835+0000 7f7292ffd700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7294068890 0x7f72940c14f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f728400c7c0 tx=0x7f7284007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:44.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.836+0000 7f727affd700 1 -- 172.21.15.154:0/2255889795 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7284005a70 con 0x7f7294068890 2023-10-10T21:03:44.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.836+0000 7f727affd700 1 -- 172.21.15.154:0/2255889795 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7284005bf0 con 0x7f7294068890 2023-10-10T21:03:44.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.836+0000 7f727affd700 1 -- 172.21.15.154:0/2255889795 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840070f0 con 0x7f7294068890 2023-10-10T21:03:44.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.836+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72940c1e60 con 0x7f7294068890 2023-10-10T21:03:44.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.836+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72940c2420 con 0x7f7294068890 2023-10-10T21:03:44.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.837+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72940718b0 con 0x7f7294068890 2023-10-10T21:03:44.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.838+0000 7f727affd700 1 -- 172.21.15.154:0/2255889795 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f7284007460 con 0x7f7294068890 2023-10-10T21:03:44.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.839+0000 7f727affd700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7280067130 0x7f72800695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:44.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.840+0000 7f727affd700 1 -- 172.21.15.154:0/2255889795 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f7284084410 con 0x7f7294068890 2023-10-10T21:03:44.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.840+0000 7f72927fc700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7280067130 0x7f72800695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:44.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.840+0000 7f72927fc700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7280067130 0x7f72800695e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72880099b0 tx=0x7f7288017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:44.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:44.843+0000 7f727affd700 1 -- 172.21.15.154:0/2255889795 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7284051380 con 0x7f7294068890 2023-10-10T21:03:45.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.066+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f72940c28d0 con 0x7f7280067130 2023-10-10T21:03:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.119+0000 7f727affd700 1 -- 172.21.15.154:0/2255889795 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f728800b9d0 con 0x7f7280067130 2023-10-10T21:03:45.121 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-10-10T21:03:45.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.121+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7280067130 msgr2=0x7f72800695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:45.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.121+0000 7f72999ff700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7280067130 0x7f72800695e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72880099b0 tx=0x7f7288017000 comp rx=0 tx=0).stop 2023-10-10T21:03:45.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.121+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7294068890 msgr2=0x7f72940c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:45.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.121+0000 7f72999ff700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7294068890 0x7f72940c14f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f728400c7c0 tx=0x7f7284007f70 comp rx=0 tx=0).stop 2023-10-10T21:03:45.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.122+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 shutdown_connections 2023-10-10T21:03:45.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.122+0000 7f72999ff700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7280067130 0x7f72800695e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.122+0000 7f72999ff700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f729415a440 0x7f7294147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.122+0000 7f72999ff700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7294068890 0x7f72940c14f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.122+0000 7f72999ff700 1 --2- 172.21.15.154:0/2255889795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72941563b0 0x7f72940af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.122+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 >> 172.21.15.154:0/2255889795 conn(0x7f72940c8f90 msgr2=0x7f7294154630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:45.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.122+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 shutdown_connections 2023-10-10T21:03:45.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.122+0000 7f72999ff700 1 -- 172.21.15.154:0/2255889795 wait complete. 2023-10-10T21:03:45.140 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-10-10T21:03:45.141 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-10T21:03:45.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.328+0000 7f5fff39d700 1 Processor -- start 2023-10-10T21:03:45.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.328+0000 7f5fff39d700 1 -- start start 2023-10-10T21:03:45.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5fff39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ff8156350 0x7f5ff8157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:45.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5fff39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 0x7f5ff80b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:45.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5fff39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80b1110 con 0x7f5ff8159f20 2023-10-10T21:03:45.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5fff39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff80b0570 con 0x7f5ff8156350 2023-10-10T21:03:45.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5fff39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff81578b0 con 0x7f5ff80b0760 2023-10-10T21:03:45.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5ffe39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ff8156350 0x7f5ff8157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:45.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5ffe39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ff8156350 0x7f5ff8157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35420/0 (socket says 172.21.15.154:35420) 2023-10-10T21:03:45.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5ffe39b700 1 -- 172.21.15.154:0/867845995 learned_addr learned my addr 172.21.15.154:0/867845995 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:45.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5ffe39b700 1 -- 172.21.15.154:0/867845995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 msgr2=0x7f5ff80b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:45.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5ffe39b700 1 --2- 172.21.15.154:0/867845995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 0x7f5ff80b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5ffe39b700 1 -- 172.21.15.154:0/867845995 >> v1:172.21.15.179:6789/0 conn(0x7f5ff8159f20 legacy=0x7f5ff815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:03:45.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.330+0000 7f5ffe39b700 1 -- 172.21.15.154:0/867845995 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80af4d0 con 0x7f5ff8156350 2023-10-10T21:03:45.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.331+0000 7f5ffe39b700 1 --2- 172.21.15.154:0/867845995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 0x7f5ff8157370 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40099b0 tx=0x7f5ff4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4379aa96c3aec14 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:45.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.331+0000 7f5ffd399700 1 -- 172.21.15.154:0/867845995 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400b820 con 0x7f5ff8156350 2023-10-10T21:03:45.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.331+0000 7f5ffd399700 1 -- 172.21.15.154:0/867845995 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff400b980 con 0x7f5ff8156350 2023-10-10T21:03:45.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.331+0000 7f5ffd399700 1 -- 172.21.15.154:0/867845995 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400bd20 con 0x7f5ff8156350 2023-10-10T21:03:45.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.331+0000 7f5fff39d700 1 -- 172.21.15.154:0/867845995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 msgr2=0x7f5ff8157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:45.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.331+0000 7f5fff39d700 1 --2- 172.21.15.154:0/867845995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 0x7f5ff8157370 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40099b0 tx=0x7f5ff4009250 comp rx=0 tx=0).stop 2023-10-10T21:03:45.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.332+0000 7f5fff39d700 1 -- 172.21.15.154:0/867845995 shutdown_connections 2023-10-10T21:03:45.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.332+0000 7f5fff39d700 1 --2- 172.21.15.154:0/867845995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 0x7f5ff8157370 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.332+0000 7f5fff39d700 1 --2- 172.21.15.154:0/867845995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 0x7f5ff80b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.332+0000 7f5fff39d700 1 -- 172.21.15.154:0/867845995 >> 172.21.15.154:0/867845995 conn(0x7f5ff8068e20 msgr2=0x7f5ff80cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:45.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.332+0000 7f5fff39d700 1 -- 172.21.15.154:0/867845995 shutdown_connections 2023-10-10T21:03:45.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.332+0000 7f5fff39d700 1 -- 172.21.15.154:0/867845995 wait complete. 2023-10-10T21:03:45.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.333+0000 7f5fff39d700 1 Processor -- start 2023-10-10T21:03:45.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.333+0000 7f5fff39d700 1 -- start start 2023-10-10T21:03:45.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5fff39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 0x7f5ff815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:45.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5fff39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 0x7f5ff8152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:45.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5fff39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff8159f20 0x7f5ff8158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:45.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5fff39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff815b210 con 0x7f5ff8156350 2023-10-10T21:03:45.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5fff39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80a6f80 con 0x7f5ff8159f20 2023-10-10T21:03:45.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5fff39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80a7260 con 0x7f5ff80b0760 2023-10-10T21:03:45.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5ffdb9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 0x7f5ff8152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:45.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5ffdb9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 0x7f5ff8152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35422/0 (socket says 172.21.15.154:35422) 2023-10-10T21:03:45.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5ffdb9a700 1 -- 172.21.15.154:0/287789146 learned_addr learned my addr 172.21.15.154:0/287789146 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:03:45.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.334+0000 7f5ffe39b700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 0x7f5ff815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:45.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5ffeb9c700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff8159f20 0x7f5ff8158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5ffdb9a700 1 -- 172.21.15.154:0/287789146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 msgr2=0x7f5ff815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5ffdb9a700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 0x7f5ff815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5ffdb9a700 1 -- 172.21.15.154:0/287789146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff8159f20 msgr2=0x7f5ff8158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5ffdb9a700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff8159f20 0x7f5ff8158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5ffdb9a700 1 -- 172.21.15.154:0/287789146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40094f0 con 0x7f5ff8156350 2023-10-10T21:03:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5ffe39b700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 0x7f5ff815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:03:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5ffdb9a700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 0x7f5ff8152440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800b810 tx=0x7f5fe80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5fee7fc700 1 -- 172.21.15.154:0/287789146 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800f570 con 0x7f5ff8156350 2023-10-10T21:03:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5fee7fc700 1 -- 172.21.15.154:0/287789146 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800f6d0 con 0x7f5ff8156350 2023-10-10T21:03:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5fee7fc700 1 -- 172.21.15.154:0/287789146 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800fa90 con 0x7f5ff8156350 2023-10-10T21:03:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff80a7540 con 0x7f5ff8156350 2023-10-10T21:03:45.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.335+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff80a7b00 con 0x7f5ff8156350 2023-10-10T21:03:45.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.336+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff80a9290 con 0x7f5ff8156350 2023-10-10T21:03:45.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.337+0000 7f5fee7fc700 1 -- 172.21.15.154:0/287789146 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f5fe801a460 con 0x7f5ff8156350 2023-10-10T21:03:45.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.338+0000 7f5fee7fc700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fdc067130 0x7f5fdc0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:03:45.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.338+0000 7f5fee7fc700 1 -- 172.21.15.154:0/287789146 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f5fe8084690 con 0x7f5ff8156350 2023-10-10T21:03:45.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.338+0000 7f5ffe39b700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fdc067130 0x7f5fdc0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:03:45.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.339+0000 7f5ffe39b700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fdc067130 0x7f5fdc0695e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40099b0 tx=0x7f5ff4016000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:03:45.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.343+0000 7f5fee7fc700 1 -- 172.21.15.154:0/287789146 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fe8051600 con 0x7f5ff8156350 2023-10-10T21:03:45.535 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:03:45.543 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:03:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.560+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ff804c3c0 con 0x7f5fdc067130 2023-10-10T21:03:45.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.609+0000 7f5fee7fc700 1 -- 172.21.15.154:0/287789146 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5ff804c3c0 con 0x7f5fdc067130 2023-10-10T21:03:45.611 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-10-10T21:03:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fdc067130 msgr2=0x7f5fdc0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fdc067130 0x7f5fdc0695e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40099b0 tx=0x7f5ff4016000 comp rx=0 tx=0).stop 2023-10-10T21:03:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 msgr2=0x7f5ff8152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:03:45.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 0x7f5ff8152440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800b810 tx=0x7f5fe80091d0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 shutdown_connections 2023-10-10T21:03:45.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff8159f20 0x7f5ff8158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5fdc067130 0x7f5fdc0695e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff80b0760 0x7f5ff815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 --2- 172.21.15.154:0/287789146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff8156350 0x7f5ff8152440 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:03:45.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 >> 172.21.15.154:0/287789146 conn(0x7f5ff8068e20 msgr2=0x7f5ff8153270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:03:45.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.611+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 shutdown_connections 2023-10-10T21:03:45.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:03:45.612+0000 7f5fff39d700 1 -- 172.21.15.154:0/287789146 wait complete. 2023-10-10T21:03:45.630 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-10-10T21:04:00.133 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:04:00.132+0000 7fe9fe1cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:04:00.134 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:04:00.132+0000 7fe9fe1cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:04:00.134 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:04:00.132+0000 7fe9fe1cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:04:00.134 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:04:00.132+0000 7fe9fe1cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:04:00.134 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:04:00.132+0000 7fe9fe1cf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:04:15.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:04:15.657 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:04:45.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:04:46.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:05:16.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:05:16.320 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:05:46.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:05:46.433 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:06:16.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:06:16.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:06:46.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:06:46.676 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:07:16.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:07:16.799 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:07:46.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:07:46.906 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:08:00.742 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:08:00.741+0000 7fe9f81c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:08:00.742 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:08:00.741+0000 7fe9f81c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:08:00.743 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:08:00.741+0000 7fe9f81c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:08:00.743 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:08:00.741+0000 7fe9f81c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:08:00.743 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:08:00.741+0000 7fe9f81c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:08:17.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:08:17.045 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:08:47.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:08:47.162 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:09:17.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:09:17.265 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:09:47.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:09:47.411 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:10:17.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:10:17.518 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:10:47.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:10:47.635 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:11:17.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:11:17.744 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:11:47.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:11:47.873 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:12:17.968 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:12:17.974 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:12:48.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:12:48.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:13:18.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:13:18.203 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:13:48.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:13:48.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:14:18.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:14:18.439 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:14:20.631 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-10T21:14:20.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.829+0000 7f7e209fe700 1 Processor -- start 2023-10-10T21:14:20.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.829+0000 7f7e209fe700 1 -- start start 2023-10-10T21:14:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.830+0000 7f7e209fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e1c156350 0x7f7e1c157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:20.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.830+0000 7f7e209fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c0b0760 0x7f7e1c0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:20.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.830+0000 7f7e209fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c0b1110 con 0x7f7e1c159f20 2023-10-10T21:14:20.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.830+0000 7f7e209fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c0b0570 con 0x7f7e1c156350 2023-10-10T21:14:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.830+0000 7f7e209fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c1578b0 con 0x7f7e1c0b0760 2023-10-10T21:14:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e1b59e700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7e1c159f20 0x7f7e1c15a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57748/0 (socket says 172.21.15.154:57748) 2023-10-10T21:14:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e1b59e700 1 -- 172.21.15.154:0/737588856 learned_addr learned my addr 172.21.15.154:0/737588856 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:20.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e1ad9d700 1 --2- 172.21.15.154:0/737588856 >> v2:172.21.15.154:3300/0 conn(0x7f7e1c156350 0x7f7e1c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:20.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e13fff700 1 --2- 172.21.15.154:0/737588856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c0b0760 0x7f7e1c0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:20.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e1a59c700 1 -- 172.21.15.154:0/737588856 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574310821 0 0) 0x7f7e1c0b1110 con 0x7f7e1c159f20 2023-10-10T21:14:20.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e1a59c700 1 -- 172.21.15.154:0/737588856 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e08003570 con 0x7f7e1c159f20 2023-10-10T21:14:20.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e1ad9d700 1 -- 172.21.15.154:0/737588856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c0b0760 msgr2=0x7f7e1c0b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:20.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e1ad9d700 1 --2- 172.21.15.154:0/737588856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c0b0760 0x7f7e1c0b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:20.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e1ad9d700 1 -- 172.21.15.154:0/737588856 >> v1:172.21.15.154:6789/0 conn(0x7f7e1c159f20 legacy=0x7f7e1c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:20.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.831+0000 7f7e1ad9d700 1 -- 172.21.15.154:0/737588856 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0af4d0 con 0x7f7e1c156350 2023-10-10T21:14:20.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.832+0000 7f7e1ad9d700 1 --2- 172.21.15.154:0/737588856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c156350 0x7f7e1c157370 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0098e0 tx=0x7f7e0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d30629bf2731728 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:20.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.832+0000 7f7e1a59c700 1 -- 172.21.15.154:0/737588856 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c011630 con 0x7f7e1c156350 2023-10-10T21:14:20.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.832+0000 7f7e1a59c700 1 -- 172.21.15.154:0/737588856 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c011790 con 0x7f7e1c156350 2023-10-10T21:14:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.832+0000 7f7e1a59c700 1 -- 172.21.15.154:0/737588856 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c011b30 con 0x7f7e1c156350 2023-10-10T21:14:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.832+0000 7f7e209fe700 1 -- 172.21.15.154:0/737588856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c156350 msgr2=0x7f7e1c157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.832+0000 7f7e209fe700 1 --2- 172.21.15.154:0/737588856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c156350 0x7f7e1c157370 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0098e0 tx=0x7f7e0c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.833+0000 7f7e209fe700 1 -- 172.21.15.154:0/737588856 shutdown_connections 2023-10-10T21:14:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.833+0000 7f7e209fe700 1 --2- 172.21.15.154:0/737588856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c156350 0x7f7e1c157370 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.833+0000 7f7e209fe700 1 --2- 172.21.15.154:0/737588856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c0b0760 0x7f7e1c0b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.833+0000 7f7e209fe700 1 -- 172.21.15.154:0/737588856 >> 172.21.15.154:0/737588856 conn(0x7f7e1c068e20 msgr2=0x7f7e1c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.833+0000 7f7e209fe700 1 -- 172.21.15.154:0/737588856 shutdown_connections 2023-10-10T21:14:20.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.833+0000 7f7e209fe700 1 -- 172.21.15.154:0/737588856 wait complete. 2023-10-10T21:14:20.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.834+0000 7f7e209fe700 1 Processor -- start 2023-10-10T21:14:20.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.834+0000 7f7e209fe700 1 -- start start 2023-10-10T21:14:20.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e209fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e1c0b0760 0x7f7e1c144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:20.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e209fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c156350 0x7f7e1c0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:20.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e209fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c159f20 0x7f7e1c16a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:20.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e209fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c16b440 con 0x7f7e1c159f20 2023-10-10T21:14:20.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e209fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c16b720 con 0x7f7e1c0b0760 2023-10-10T21:14:20.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e209fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c16ba00 con 0x7f7e1c156350 2023-10-10T21:14:20.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e1b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c159f20 0x7f7e1c16a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:20.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e1b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c159f20 0x7f7e1c16a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47704/0 (socket says 172.21.15.154:47704) 2023-10-10T21:14:20.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e1b59e700 1 -- 172.21.15.154:0/826562320 learned_addr learned my addr 172.21.15.154:0/826562320 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:20.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.835+0000 7f7e1ad9d700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e1c0b0760 0x7f7e1c144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:20.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e13fff700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c156350 0x7f7e1c0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:20.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e1b59e700 1 -- 172.21.15.154:0/826562320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c156350 msgr2=0x7f7e1c0c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:20.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e1b59e700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c156350 0x7f7e1c0c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:20.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e1b59e700 1 -- 172.21.15.154:0/826562320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e1c0b0760 msgr2=0x7f7e1c144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:20.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e1b59e700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e1c0b0760 0x7f7e1c144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:20.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e1b59e700 1 -- 172.21.15.154:0/826562320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c009420 con 0x7f7e1c159f20 2023-10-10T21:14:20.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e13fff700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c156350 0x7f7e1c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:20.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e1b59e700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c159f20 0x7f7e1c16a6d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7e14001460 tx=0x7f7e14001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:20.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e12ffd700 1 -- 172.21.15.154:0/826562320 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400a8a0 con 0x7f7e1c159f20 2023-10-10T21:14:20.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e12ffd700 1 -- 172.21.15.154:0/826562320 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1400aa00 con 0x7f7e1c159f20 2023-10-10T21:14:20.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c16bce0 con 0x7f7e1c159f20 2023-10-10T21:14:20.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e12ffd700 1 -- 172.21.15.154:0/826562320 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400ad80 con 0x7f7e1c159f20 2023-10-10T21:14:20.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.836+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c0c9600 con 0x7f7e1c159f20 2023-10-10T21:14:20.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.837+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c04c3c0 con 0x7f7e1c159f20 2023-10-10T21:14:20.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.838+0000 7f7e12ffd700 1 -- 172.21.15.154:0/826562320 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f7e14007300 con 0x7f7e1c159f20 2023-10-10T21:14:20.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.839+0000 7f7e12ffd700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7dfc067130 0x7f7dfc0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:20.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.839+0000 7f7e12ffd700 1 -- 172.21.15.154:0/826562320 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f7e14084e10 con 0x7f7e1c159f20 2023-10-10T21:14:20.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.839+0000 7f7e1ad9d700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7dfc067130 0x7f7dfc0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:20.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.840+0000 7f7e1ad9d700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7dfc067130 0x7f7dfc0695e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0091e0 tx=0x7f7e0c017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:20.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:20.844+0000 7f7e12ffd700 1 -- 172.21.15.154:0/826562320 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e14088030 con 0x7f7e1c159f20 2023-10-10T21:14:21.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.059+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e1c0af7b0 con 0x7f7dfc067130 2023-10-10T21:14:21.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.126+0000 7f7e12ffd700 1 -- 172.21.15.154:0/826562320 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7e1c0af7b0 con 0x7f7dfc067130 2023-10-10T21:14:21.128 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-10-10T21:14:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7dfc067130 msgr2=0x7f7dfc0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7dfc067130 0x7f7dfc0695e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0091e0 tx=0x7f7e0c017000 comp rx=0 tx=0).stop 2023-10-10T21:14:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c159f20 msgr2=0x7f7e1c16a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c159f20 0x7f7e1c16a6d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7e14001460 tx=0x7f7e14001a40 comp rx=0 tx=0).stop 2023-10-10T21:14:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 shutdown_connections 2023-10-10T21:14:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1c159f20 0x7f7e1c16a6d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e1c0b0760 0x7f7e1c144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7dfc067130 0x7f7dfc0695e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 --2- 172.21.15.154:0/826562320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e1c156350 0x7f7e1c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 >> 172.21.15.154:0/826562320 conn(0x7f7e1c068e20 msgr2=0x7f7e1c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:21.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 shutdown_connections 2023-10-10T21:14:21.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.129+0000 7f7e209fe700 1 -- 172.21.15.154:0/826562320 wait complete. 2023-10-10T21:14:21.148 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-10-10T21:14:21.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-10T21:14:21.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.333+0000 7f6b96fff700 1 Processor -- start 2023-10-10T21:14:21.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.333+0000 7f6b96fff700 1 -- start start 2023-10-10T21:14:21.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.334+0000 7f6b96fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b96fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b90069e20 0x7f6b901569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b96fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b900ac030 con 0x7f6b900c8490 2023-10-10T21:14:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b96fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b900ab820 con 0x7f6b90069e20 2023-10-10T21:14:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b96fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9006dbb0 con 0x7f6b90069a50 2023-10-10T21:14:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b9559c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b90069e20 0x7f6b901569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b9559c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b90069e20 0x7f6b901569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47706/0 (socket says 172.21.15.154:47706) 2023-10-10T21:14:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b9559c700 1 -- 172.21.15.154:0/891491146 learned_addr learned my addr 172.21.15.154:0/891491146 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:21.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b9559c700 1 -- 172.21.15.154:0/891491146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 msgr2=0x7f6b900c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:21.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b94d9b700 1 --2- 172.21.15.154:0/891491146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b9559c700 1 --2- 172.21.15.154:0/891491146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b9559c700 1 -- 172.21.15.154:0/891491146 >> v1:172.21.15.179:6789/0 conn(0x7f6b900c8490 legacy=0x7f6b9015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b9559c700 1 -- 172.21.15.154:0/891491146 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900aba70 con 0x7f6b90069e20 2023-10-10T21:14:21.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.335+0000 7f6b94d9b700 1 --2- 172.21.15.154:0/891491146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:21.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b9559c700 1 --2- 172.21.15.154:0/891491146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 0x7f6b901569b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009f50 tx=0x7f6b88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fe3eba5397ecb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:21.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b8f7fe700 1 -- 172.21.15.154:0/891491146 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800e070 con 0x7f6b90069e20 2023-10-10T21:14:21.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b8f7fe700 1 -- 172.21.15.154:0/891491146 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8800ba70 con 0x7f6b90069e20 2023-10-10T21:14:21.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b8f7fe700 1 -- 172.21.15.154:0/891491146 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b880092e0 con 0x7f6b90069e20 2023-10-10T21:14:21.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b96fff700 1 -- 172.21.15.154:0/891491146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 msgr2=0x7f6b901569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b96fff700 1 --2- 172.21.15.154:0/891491146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 0x7f6b901569b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009f50 tx=0x7f6b88009840 comp rx=0 tx=0).stop 2023-10-10T21:14:21.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b96fff700 1 -- 172.21.15.154:0/891491146 shutdown_connections 2023-10-10T21:14:21.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b96fff700 1 --2- 172.21.15.154:0/891491146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 0x7f6b901569b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b96fff700 1 --2- 172.21.15.154:0/891491146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.336+0000 7f6b96fff700 1 -- 172.21.15.154:0/891491146 >> 172.21.15.154:0/891491146 conn(0x7f6b900c8f90 msgr2=0x7f6b900c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:21.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.337+0000 7f6b96fff700 1 -- 172.21.15.154:0/891491146 shutdown_connections 2023-10-10T21:14:21.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.337+0000 7f6b96fff700 1 -- 172.21.15.154:0/891491146 wait complete. 2023-10-10T21:14:21.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.338+0000 7f6b96fff700 1 Processor -- start 2023-10-10T21:14:21.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.338+0000 7f6b96fff700 1 -- start start 2023-10-10T21:14:21.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.339+0000 7f6b96fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.339+0000 7f6b96fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 0x7f6b900cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.339+0000 7f6b96fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 0x7f6b900a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.339+0000 7f6b96fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900c14b0 con 0x7f6b90069e20 2023-10-10T21:14:21.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.339+0000 7f6b96fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900c1750 con 0x7f6b900c8490 2023-10-10T21:14:21.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.339+0000 7f6b96fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900adbb0 con 0x7f6b90069a50 2023-10-10T21:14:21.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.339+0000 7f6b8ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 0x7f6b900cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.339+0000 7f6b8ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 0x7f6b900cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47716/0 (socket says 172.21.15.154:47716) 2023-10-10T21:14:21.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.339+0000 7f6b8ffff700 1 -- 172.21.15.154:0/110157721 learned_addr learned my addr 172.21.15.154:0/110157721 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:21.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b94d9b700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b9559c700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 0x7f6b900a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b8ffff700 1 -- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 msgr2=0x7f6b900cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b8ffff700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b8ffff700 1 -- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 msgr2=0x7f6b900a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b8ffff700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 0x7f6b900a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b8ffff700 1 -- 172.21.15.154:0/110157721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b88009ae0 con 0x7f6b90069e20 2023-10-10T21:14:21.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b94d9b700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:21.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b9559c700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 0x7f6b900a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:21.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b8ffff700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 0x7f6b900cb740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00c4e0 tx=0x7f6b7c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b8cff9700 1 -- 172.21.15.154:0/110157721 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c011590 con 0x7f6b90069e20 2023-10-10T21:14:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b8cff9700 1 -- 172.21.15.154:0/110157721 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c011710 con 0x7f6b90069e20 2023-10-10T21:14:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b8cff9700 1 -- 172.21.15.154:0/110157721 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c011ad0 con 0x7f6b90069e20 2023-10-10T21:14:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b900c2490 con 0x7f6b90069e20 2023-10-10T21:14:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.340+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b900c1be0 con 0x7f6b90069e20 2023-10-10T21:14:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.341+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b900718b0 con 0x7f6b90069e20 2023-10-10T21:14:21.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.342+0000 7f6b8cff9700 1 -- 172.21.15.154:0/110157721 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f6b7c01b3b0 con 0x7f6b90069e20 2023-10-10T21:14:21.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.343+0000 7f6b8cff9700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6b74067130 0x7f6b740695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.343+0000 7f6b8cff9700 1 -- 172.21.15.154:0/110157721 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6b7c083d60 con 0x7f6b90069e20 2023-10-10T21:14:21.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.343+0000 7f6b94d9b700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6b74067130 0x7f6b740695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.344+0000 7f6b94d9b700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6b74067130 0x7f6b740695e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b84008b20 tx=0x7f6b84008040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:21.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.347+0000 7f6b8cff9700 1 -- 172.21.15.154:0/110157721 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b7c050bb0 con 0x7f6b90069e20 2023-10-10T21:14:21.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.562+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b900cbc80 con 0x7f6b74067130 2023-10-10T21:14:21.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.631+0000 7f6b8cff9700 1 -- 172.21.15.154:0/110157721 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6b8400c040 con 0x7f6b74067130 2023-10-10T21:14:21.633 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-10-10T21:14:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6b74067130 msgr2=0x7f6b740695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6b74067130 0x7f6b740695e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b84008b20 tx=0x7f6b84008040 comp rx=0 tx=0).stop 2023-10-10T21:14:21.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 msgr2=0x7f6b900cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 0x7f6b900cb740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00c4e0 tx=0x7f6b7c00c8a0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 shutdown_connections 2023-10-10T21:14:21.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 0x7f6b900a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6b74067130 0x7f6b740695e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069a50 0x7f6b900cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 --2- 172.21.15.154:0/110157721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b90069e20 0x7f6b900cb740 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 >> 172.21.15.154:0/110157721 conn(0x7f6b900c8f90 msgr2=0x7f6b900ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:21.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 shutdown_connections 2023-10-10T21:14:21.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.634+0000 7f6b96fff700 1 -- 172.21.15.154:0/110157721 wait complete. 2023-10-10T21:14:21.652 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-10-10T21:14:21.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-10T21:14:21.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.838+0000 7f629ddff700 1 Processor -- start 2023-10-10T21:14:21.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.838+0000 7f629ddff700 1 -- start start 2023-10-10T21:14:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f629ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298068aa0 0x7f6298162460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f629ddff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62980ae6d0 con 0x7f62980b2100 2023-10-10T21:14:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f629ddff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629806dc20 con 0x7f6298157740 2023-10-10T21:14:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f629ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62980acc00 con 0x7f6298068aa0 2023-10-10T21:14:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f6296ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f62980b2100 0x7f6298068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57754/0 (socket says 172.21.15.154:57754) 2023-10-10T21:14:21.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f6296ffd700 1 -- 172.21.15.154:0/3840851752 learned_addr learned my addr 172.21.15.154:0/3840851752 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:21.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f6297fff700 1 --2- 172.21.15.154:0/3840851752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298068aa0 0x7f6298162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f62967fc700 1 -- 172.21.15.154:0/3840851752 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174838490 0 0) 0x7f628c001110 con 0x7f62980b2100 2023-10-10T21:14:21.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f62967fc700 1 -- 172.21.15.154:0/3840851752 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6280003570 con 0x7f62980b2100 2023-10-10T21:14:21.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.840+0000 7f62967fc700 1 -- 172.21.15.154:0/3840851752 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513544754 0 0) 0x7f629806dc20 con 0x7f6298157740 2023-10-10T21:14:21.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.841+0000 7f62967fc700 1 -- 172.21.15.154:0/3840851752 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f628c001110 con 0x7f6298157740 2023-10-10T21:14:21.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.841+0000 7f6297fff700 1 -- 172.21.15.154:0/3840851752 >> v1:172.21.15.179:6789/0 conn(0x7f6298157740 legacy=0x7f62980adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.841+0000 7f6297fff700 1 -- 172.21.15.154:0/3840851752 >> v1:172.21.15.154:6789/0 conn(0x7f62980b2100 legacy=0x7f6298068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.841+0000 7f62967fc700 1 -- 172.21.15.154:0/3840851752 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4121191634 0 0) 0x7f6280003570 con 0x7f62980b2100 2023-10-10T21:14:21.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.841+0000 7f6297fff700 1 -- 172.21.15.154:0/3840851752 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62980ae910 con 0x7f6298068aa0 2023-10-10T21:14:21.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.841+0000 7f6297fff700 1 --2- 172.21.15.154:0/3840851752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298068aa0 0x7f6298162460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6290009e90 tx=0x7f6290009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d58d665496403d77 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:21.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.841+0000 7f62967fc700 1 -- 172.21.15.154:0/3840851752 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000e070 con 0x7f6298068aa0 2023-10-10T21:14:21.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.841+0000 7f62967fc700 1 -- 172.21.15.154:0/3840851752 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629000b870 con 0x7f6298068aa0 2023-10-10T21:14:21.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.841+0000 7f62967fc700 1 -- 172.21.15.154:0/3840851752 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c001600 con 0x7f6298068aa0 2023-10-10T21:14:21.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.842+0000 7f629ddff700 1 -- 172.21.15.154:0/3840851752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298068aa0 msgr2=0x7f6298162460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.842+0000 7f629ddff700 1 --2- 172.21.15.154:0/3840851752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298068aa0 0x7f6298162460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6290009e90 tx=0x7f6290009780 comp rx=0 tx=0).stop 2023-10-10T21:14:21.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.842+0000 7f629ddff700 1 -- 172.21.15.154:0/3840851752 shutdown_connections 2023-10-10T21:14:21.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.842+0000 7f629ddff700 1 --2- 172.21.15.154:0/3840851752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298068aa0 0x7f6298162460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.842+0000 7f629ddff700 1 -- 172.21.15.154:0/3840851752 >> 172.21.15.154:0/3840851752 conn(0x7f62980c8f90 msgr2=0x7f62980c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:21.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.842+0000 7f629ddff700 1 -- 172.21.15.154:0/3840851752 shutdown_connections 2023-10-10T21:14:21.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.842+0000 7f629ddff700 1 -- 172.21.15.154:0/3840851752 wait complete. 2023-10-10T21:14:21.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.843+0000 7f629ddff700 1 Processor -- start 2023-10-10T21:14:21.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.844+0000 7f629ddff700 1 -- start start 2023-10-10T21:14:21.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f629ddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6298068aa0 0x7f62980c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f629ddff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62980b2100 0x7f62980c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f629ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298157740 0x7f62980aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f629ddff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629816a720 con 0x7f62980b2100 2023-10-10T21:14:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f629ddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629816a290 con 0x7f6298068aa0 2023-10-10T21:14:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f629ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6298154ca0 con 0x7f6298157740 2023-10-10T21:14:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f62977fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6298068aa0 0x7f62980c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f6297fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298157740 0x7f62980aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f62977fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6298068aa0 0x7f62980c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:45848/0 (socket says 172.21.15.154:45848) 2023-10-10T21:14:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f62977fe700 1 -- 172.21.15.154:0/2661243397 learned_addr learned my addr 172.21.15.154:0/2661243397 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.845+0000 7f6296ffd700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62980b2100 0x7f62980c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f62977fe700 1 -- 172.21.15.154:0/2661243397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298157740 msgr2=0x7f62980aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f62977fe700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298157740 0x7f62980aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f62977fe700 1 -- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62980b2100 msgr2=0x7f62980c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f62977fe700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62980b2100 0x7f62980c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f62977fe700 1 -- 172.21.15.154:0/2661243397 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290009a20 con 0x7f6298068aa0 2023-10-10T21:14:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f6297fff700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298157740 0x7f62980aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:21.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f62977fe700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6298068aa0 0x7f62980c3530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f628800c5b0 tx=0x7f6288007e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:21.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f627f7fe700 1 -- 172.21.15.154:0/2661243397 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288010510 con 0x7f6298068aa0 2023-10-10T21:14:21.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f627f7fe700 1 -- 172.21.15.154:0/2661243397 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288010670 con 0x7f6298068aa0 2023-10-10T21:14:21.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6298169960 con 0x7f6298068aa0 2023-10-10T21:14:21.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f627f7fe700 1 -- 172.21.15.154:0/2661243397 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288010a30 con 0x7f6298068aa0 2023-10-10T21:14:21.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.846+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6298169f20 con 0x7f6298068aa0 2023-10-10T21:14:21.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.847+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62980718b0 con 0x7f6298068aa0 2023-10-10T21:14:21.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.848+0000 7f627f7fe700 1 -- 172.21.15.154:0/2661243397 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f628801b400 con 0x7f6298068aa0 2023-10-10T21:14:21.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.849+0000 7f627f7fe700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6284067130 0x7f62840695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:21.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.849+0000 7f627f7fe700 1 -- 172.21.15.154:0/2661243397 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f62880848d0 con 0x7f6298068aa0 2023-10-10T21:14:21.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.850+0000 7f6296ffd700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6284067130 0x7f62840695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:21.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.850+0000 7f6296ffd700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6284067130 0x7f62840695e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f628c001370 tx=0x7f628c000bc0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:21.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:21.854+0000 7f627f7fe700 1 -- 172.21.15.154:0/2661243397 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62880517a0 con 0x7f6298068aa0 2023-10-10T21:14:22.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.071+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f629816a3d0 con 0x7f6284067130 2023-10-10T21:14:22.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.137+0000 7f627f7fe700 1 -- 172.21.15.154:0/2661243397 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f628c00fbb0 con 0x7f6284067130 2023-10-10T21:14:22.138 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-10-10T21:14:22.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6284067130 msgr2=0x7f62840695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6284067130 0x7f62840695e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f628c001370 tx=0x7f628c000bc0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6298068aa0 msgr2=0x7f62980c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6298068aa0 0x7f62980c3530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f628800c5b0 tx=0x7f6288007e10 comp rx=0 tx=0).stop 2023-10-10T21:14:22.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 shutdown_connections 2023-10-10T21:14:22.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f6284067130 0x7f62840695e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6298157740 0x7f62980aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6298068aa0 0x7f62980c3530 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 --2- 172.21.15.154:0/2661243397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62980b2100 0x7f62980c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 >> 172.21.15.154:0/2661243397 conn(0x7f62980c8f90 msgr2=0x7f6298068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:22.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 shutdown_connections 2023-10-10T21:14:22.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.139+0000 7f629ddff700 1 -- 172.21.15.154:0/2661243397 wait complete. 2023-10-10T21:14:22.158 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-10-10T21:14:22.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-10T21:14:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.344+0000 7f0ce699d700 1 Processor -- start 2023-10-10T21:14:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.344+0000 7f0ce699d700 1 -- start start 2023-10-10T21:14:22.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.345+0000 7f0ce699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00b0790 0x7f0ce00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.345+0000 7f0ce699d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ce01591e0 0x7f0ce0159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.345+0000 7f0ce699d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce00cfa00 con 0x7f0ce00b03c0 2023-10-10T21:14:22.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.345+0000 7f0ce699d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce00cb580 con 0x7f0ce01591e0 2023-10-10T21:14:22.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.345+0000 7f0ce699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00cf160 con 0x7f0ce00b0790 2023-10-10T21:14:22.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.345+0000 7f0ce599b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0ce00b03c0 0x7f0ce00b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57758/0 (socket says 172.21.15.154:57758) 2023-10-10T21:14:22.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.345+0000 7f0ce599b700 1 -- 172.21.15.154:0/1404001857 learned_addr learned my addr 172.21.15.154:0/1404001857 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:22.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce519a700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00b0790 0x7f0ce00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce619c700 1 --2- 172.21.15.154:0/1404001857 >> v2:172.21.15.179:3300/0 conn(0x7f0ce01591e0 0x7f0ce0159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911805230 0 0) 0x7f0ce00cfa00 con 0x7f0ce00b03c0 2023-10-10T21:14:22.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ccc003570 con 0x7f0ce00b03c0 2023-10-10T21:14:22.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1282992632 0 0) 0x7f0ccc003570 con 0x7f0ce00b03c0 2023-10-10T21:14:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00b0790 msgr2=0x7f0ce00cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00b0790 0x7f0ce00cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 >> v2:172.21.15.179:3300/0 conn(0x7f0ce01591e0 msgr2=0x7f0ce0159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 --2- 172.21.15.154:0/1404001857 >> v2:172.21.15.179:3300/0 conn(0x7f0ce01591e0 0x7f0ce0159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00cf440 con 0x7f0ce00b03c0 2023-10-10T21:14:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f0cdc001470 con 0x7f0ce00b03c0 2023-10-10T21:14:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 >> v1:172.21.15.154:6789/0 conn(0x7f0ce00b03c0 legacy=0x7f0ce00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ccc003ae0 0x7f0ccc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00b0790 0x7f0ccc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ccc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00cb580 con 0x7f0ccc004d50 2023-10-10T21:14:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00cf160 con 0x7f0ccc003ae0 2023-10-10T21:14:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc00bb40 con 0x7f0ce00b0790 2023-10-10T21:14:22.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.346+0000 7f0ce619c700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ccc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce599b700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ccc003ae0 0x7f0ccc003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce519a700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00b0790 0x7f0ccc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce619c700 1 -- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00b0790 msgr2=0x7f0ccc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:22.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce619c700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00b0790 0x7f0ccc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce619c700 1 -- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ccc003ae0 msgr2=0x7f0ccc003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:22.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce619c700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ccc003ae0 0x7f0ccc003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce619c700 1 -- 172.21.15.154:0/1404001857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc003570 con 0x7f0ccc004d50 2023-10-10T21:14:22.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce619c700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ccc0051c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800e210 tx=0x7f0cd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c3f0799cb40fa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:22.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800ea60 con 0x7f0ccc004d50 2023-10-10T21:14:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd800f040 con 0x7f0ccc004d50 2023-10-10T21:14:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.347+0000 7f0ce4999700 1 -- 172.21.15.154:0/1404001857 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800ee10 con 0x7f0ccc004d50 2023-10-10T21:14:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.348+0000 7f0ce699d700 1 -- 172.21.15.154:0/1404001857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 msgr2=0x7f0ccc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.348+0000 7f0ce699d700 1 --2- 172.21.15.154:0/1404001857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ccc0051c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800e210 tx=0x7f0cd800b040 comp rx=0 tx=0).stop 2023-10-10T21:14:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.348+0000 7f0ce619c700 1 -- 172.21.15.154:0/1404001857 reap_dead start 2023-10-10T21:14:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.348+0000 7f0ce699d700 1 -- 172.21.15.154:0/1404001857 shutdown_connections 2023-10-10T21:14:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.348+0000 7f0ce699d700 1 -- 172.21.15.154:0/1404001857 >> 172.21.15.154:0/1404001857 conn(0x7f0ce0063230 msgr2=0x7f0ce0063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.348+0000 7f0ce699d700 1 -- 172.21.15.154:0/1404001857 shutdown_connections 2023-10-10T21:14:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.348+0000 7f0ce699d700 1 -- 172.21.15.154:0/1404001857 wait complete. 2023-10-10T21:14:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.349+0000 7f0ce699d700 1 Processor -- start 2023-10-10T21:14:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.349+0000 7f0ce699d700 1 -- start start 2023-10-10T21:14:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.350+0000 7f0ce699d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ce0158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.350+0000 7f0ce699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ce00c5f30 0x7f0ce00c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.350+0000 7f0ce699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00c8ac0 0x7f0ce00c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.350+0000 7f0ce699d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce015bf40 con 0x7f0ccc004d50 2023-10-10T21:14:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.350+0000 7f0ce699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00c9470 con 0x7f0ce00c5f30 2023-10-10T21:14:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.350+0000 7f0ce699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce015c0d0 con 0x7f0ce00c8ac0 2023-10-10T21:14:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce599b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ce0158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce599b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ce0158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47744/0 (socket says 172.21.15.154:47744) 2023-10-10T21:14:22.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce599b700 1 -- 172.21.15.154:0/2596847659 learned_addr learned my addr 172.21.15.154:0/2596847659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:22.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce619c700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00c8ac0 0x7f0ce00c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce519a700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ce00c5f30 0x7f0ce00c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce599b700 1 -- 172.21.15.154:0/2596847659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00c8ac0 msgr2=0x7f0ce00c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce599b700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00c8ac0 0x7f0ce00c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce599b700 1 -- 172.21.15.154:0/2596847659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ce00c5f30 msgr2=0x7f0ce00c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce599b700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ce00c5f30 0x7f0ce00c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce599b700 1 -- 172.21.15.154:0/2596847659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00c69b0 con 0x7f0ccc004d50 2023-10-10T21:14:22.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce599b700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ce0158900 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0015a0 tx=0x7f0ce00cb6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:22.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0cd5ffb700 1 -- 172.21.15.154:0/2596847659 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc018030 con 0x7f0ccc004d50 2023-10-10T21:14:22.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0cd5ffb700 1 -- 172.21.15.154:0/2596847659 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc000fe0 con 0x7f0ccc004d50 2023-10-10T21:14:22.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce00c6c90 con 0x7f0ccc004d50 2023-10-10T21:14:22.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.351+0000 7f0cd5ffb700 1 -- 172.21.15.154:0/2596847659 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00fb00 con 0x7f0ccc004d50 2023-10-10T21:14:22.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.352+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce00c7250 con 0x7f0ccc004d50 2023-10-10T21:14:22.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.352+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce004c3c0 con 0x7f0ccc004d50 2023-10-10T21:14:22.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.353+0000 7f0cd5ffb700 1 -- 172.21.15.154:0/2596847659 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f0cdc01b070 con 0x7f0ccc004d50 2023-10-10T21:14:22.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.354+0000 7f0cd5ffb700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0cc4067130 0x7f0cc40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.354+0000 7f0cd5ffb700 1 -- 172.21.15.154:0/2596847659 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0cdc019070 con 0x7f0ccc004d50 2023-10-10T21:14:22.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.354+0000 7f0ce519a700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0cc4067130 0x7f0cc40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.355+0000 7f0ce519a700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0cc4067130 0x7f0cc40695e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ce015bd30 tx=0x7f0cd0008040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:22.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.358+0000 7f0cd5ffb700 1 -- 172.21.15.154:0/2596847659 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cdc051830 con 0x7f0ccc004d50 2023-10-10T21:14:22.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.575+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ce015c210 con 0x7f0cc4067130 2023-10-10T21:14:22.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.645+0000 7f0cd5ffb700 1 -- 172.21.15.154:0/2596847659 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0cd0009a80 con 0x7f0cc4067130 2023-10-10T21:14:22.647 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-10-10T21:14:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0cc4067130 msgr2=0x7f0cc40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0cc4067130 0x7f0cc40695e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ce015bd30 tx=0x7f0cd0008040 comp rx=0 tx=0).stop 2023-10-10T21:14:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 msgr2=0x7f0ce0158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ce0158900 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0015a0 tx=0x7f0ce00cb6c0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 shutdown_connections 2023-10-10T21:14:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f0cc4067130 0x7f0cc40695e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ce00c8ac0 0x7f0ce00c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc004d50 0x7f0ce0158900 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 --2- 172.21.15.154:0/2596847659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ce00c5f30 0x7f0ce00c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 >> 172.21.15.154:0/2596847659 conn(0x7f0ce0063230 msgr2=0x7f0ce00692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 shutdown_connections 2023-10-10T21:14:22.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.648+0000 7f0ce699d700 1 -- 172.21.15.154:0/2596847659 wait complete. 2023-10-10T21:14:22.666 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-10-10T21:14:22.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-10T21:14:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.853+0000 7fa4549fe700 1 Processor -- start 2023-10-10T21:14:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.853+0000 7fa4549fe700 1 -- start start 2023-10-10T21:14:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.854+0000 7fa4549fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa4500b03c0 0x7fa4500cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.854+0000 7fa4549fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4501591e0 0x7fa450159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.854+0000 7fa4549fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4500cfa00 con 0x7fa4500b0790 2023-10-10T21:14:22.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.854+0000 7fa4549fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4500cb580 con 0x7fa4500b03c0 2023-10-10T21:14:22.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.854+0000 7fa4549fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500cf160 con 0x7fa4501591e0 2023-10-10T21:14:22.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.854+0000 7fa44e59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa4500b0790 0x7fa4500b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57764/0 (socket says 172.21.15.154:57764) 2023-10-10T21:14:22.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.854+0000 7fa44e59c700 1 -- 172.21.15.154:0/4243724543 learned_addr learned my addr 172.21.15.154:0/4243724543 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:22.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44ed9d700 1 --2- 172.21.15.154:0/4243724543 >> v2:172.21.15.179:3300/0 conn(0x7fa4500b03c0 0x7fa4500cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44f59e700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4501591e0 0x7fa450159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046236626 0 0) 0x7fa4500cfa00 con 0x7fa4500b0790 2023-10-10T21:14:22.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa438003570 con 0x7fa4500b0790 2023-10-10T21:14:22.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4119970220 0 0) 0x7fa438003570 con 0x7fa4500b0790 2023-10-10T21:14:22.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4501591e0 msgr2=0x7fa450159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:22.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4501591e0 0x7fa450159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 >> v2:172.21.15.179:3300/0 conn(0x7fa4500b03c0 msgr2=0x7fa4500cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:22.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 --2- 172.21.15.154:0/4243724543 >> v2:172.21.15.179:3300/0 conn(0x7fa4500b03c0 0x7fa4500cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4500cf440 con 0x7fa4500b0790 2023-10-10T21:14:22.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fa444001470 con 0x7fa4500b0790 2023-10-10T21:14:22.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44ed9d700 1 --2- 172.21.15.154:0/4243724543 >> v2:172.21.15.179:3300/0 conn(0x7fa4500b03c0 0x7fa4500cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:22.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 >> v1:172.21.15.154:6789/0 conn(0x7fa4500b0790 legacy=0x7fa4500b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438003a60 0x7fa438003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4501591e0 0x7fa438004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa438004d50 0x7fa4380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500cb580 con 0x7fa438004d50 2023-10-10T21:14:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500cf160 con 0x7fa438003a60 2023-10-10T21:14:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.855+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43800ba60 con 0x7fa4501591e0 2023-10-10T21:14:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44f59e700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa438004d50 0x7fa4380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44ed9d700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438003a60 0x7fa438003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44e59c700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4501591e0 0x7fa438004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44f59e700 1 -- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4501591e0 msgr2=0x7fa438004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44f59e700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4501591e0 0x7fa438004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44f59e700 1 -- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438003a60 msgr2=0x7fa438003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44f59e700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438003a60 0x7fa438003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44f59e700 1 -- 172.21.15.154:0/4243724543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa438003570 con 0x7fa438004d50 2023-10-10T21:14:22.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44f59e700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa438004d50 0x7fa4380051c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa44800e210 tx=0x7fa44800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676c2d6540818086 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:22.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.856+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800ea60 con 0x7fa438004d50 2023-10-10T21:14:22.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.857+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44800f040 con 0x7fa438004d50 2023-10-10T21:14:22.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.857+0000 7fa44dd9b700 1 -- 172.21.15.154:0/4243724543 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800ee10 con 0x7fa438004d50 2023-10-10T21:14:22.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.857+0000 7fa4549fe700 1 -- 172.21.15.154:0/4243724543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa438004d50 msgr2=0x7fa4380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.857+0000 7fa4549fe700 1 --2- 172.21.15.154:0/4243724543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa438004d50 0x7fa4380051c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa44800e210 tx=0x7fa44800b040 comp rx=0 tx=0).stop 2023-10-10T21:14:22.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.857+0000 7fa44f59e700 1 -- 172.21.15.154:0/4243724543 reap_dead start 2023-10-10T21:14:22.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.857+0000 7fa4549fe700 1 -- 172.21.15.154:0/4243724543 shutdown_connections 2023-10-10T21:14:22.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.857+0000 7fa4549fe700 1 -- 172.21.15.154:0/4243724543 >> 172.21.15.154:0/4243724543 conn(0x7fa450063230 msgr2=0x7fa450063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:22.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.857+0000 7fa4549fe700 1 -- 172.21.15.154:0/4243724543 shutdown_connections 2023-10-10T21:14:22.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.857+0000 7fa4549fe700 1 -- 172.21.15.154:0/4243724543 wait complete. 2023-10-10T21:14:22.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.859+0000 7fa4549fe700 1 Processor -- start 2023-10-10T21:14:22.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.859+0000 7fa4549fe700 1 -- start start 2023-10-10T21:14:22.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa4549fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438004d50 0x7fa45014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa4549fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4501595b0 0x7fa45015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa4549fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4500c9700 0x7fa4500c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa4549fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500ca0b0 con 0x7fa4501595b0 2023-10-10T21:14:22.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa4549fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45014bf20 con 0x7fa438004d50 2023-10-10T21:14:22.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa4549fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa450159ab0 con 0x7fa4500c9700 2023-10-10T21:14:22.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4501595b0 0x7fa45015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4501595b0 0x7fa45015ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47766/0 (socket says 172.21.15.154:47766) 2023-10-10T21:14:22.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44e59c700 1 -- 172.21.15.154:0/1487597721 learned_addr learned my addr 172.21.15.154:0/1487597721 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:22.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44f59e700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4500c9700 0x7fa4500c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44e59c700 1 -- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4500c9700 msgr2=0x7fa4500c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44ed9d700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438004d50 0x7fa45014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44e59c700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4500c9700 0x7fa4500c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44e59c700 1 -- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438004d50 msgr2=0x7fa45014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:22.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44e59c700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438004d50 0x7fa45014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:22.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44e59c700 1 -- 172.21.15.154:0/1487597721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa450159d90 con 0x7fa4501595b0 2023-10-10T21:14:22.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44f59e700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4500c9700 0x7fa4500c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:22.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.860+0000 7fa44ed9d700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438004d50 0x7fa45014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:22.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.861+0000 7fa44e59c700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4501595b0 0x7fa45015ae00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa444007390 tx=0x7fa4500cb6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:22.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.861+0000 7fa436ffd700 1 -- 172.21.15.154:0/1487597721 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444018030 con 0x7fa4501595b0 2023-10-10T21:14:22.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.861+0000 7fa436ffd700 1 -- 172.21.15.154:0/1487597721 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44400f8d0 con 0x7fa4501595b0 2023-10-10T21:14:22.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.861+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45015a070 con 0x7fa4501595b0 2023-10-10T21:14:22.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.861+0000 7fa436ffd700 1 -- 172.21.15.154:0/1487597721 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44400fc90 con 0x7fa4501595b0 2023-10-10T21:14:22.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.861+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45015b340 con 0x7fa4501595b0 2023-10-10T21:14:22.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.862+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45015a680 con 0x7fa4501595b0 2023-10-10T21:14:22.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.863+0000 7fa436ffd700 1 -- 172.21.15.154:0/1487597721 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fa44401b070 con 0x7fa4501595b0 2023-10-10T21:14:22.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.864+0000 7fa436ffd700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa43c067130 0x7fa43c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:22.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.864+0000 7fa436ffd700 1 -- 172.21.15.154:0/1487597721 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa444019070 con 0x7fa4501595b0 2023-10-10T21:14:22.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.864+0000 7fa44ed9d700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa43c067130 0x7fa43c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:22.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.864+0000 7fa44ed9d700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa43c067130 0x7fa43c0695e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa440006f00 tx=0x7fa440008040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:22.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:22.868+0000 7fa436ffd700 1 -- 172.21.15.154:0/1487597721 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa444051750 con 0x7fa4501595b0 2023-10-10T21:14:23.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.084+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa45015c9a0 con 0x7fa43c067130 2023-10-10T21:14:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.154+0000 7fa436ffd700 1 -- 172.21.15.154:0/1487597721 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa45015c9a0 con 0x7fa43c067130 2023-10-10T21:14:23.155 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-10-10T21:14:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa43c067130 msgr2=0x7fa43c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa43c067130 0x7fa43c0695e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa440006f00 tx=0x7fa440008040 comp rx=0 tx=0).stop 2023-10-10T21:14:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4501595b0 msgr2=0x7fa45015ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4501595b0 0x7fa45015ae00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa444007390 tx=0x7fa4500cb6c0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 shutdown_connections 2023-10-10T21:14:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa43c067130 0x7fa43c0695e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4500c9700 0x7fa4500c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa438004d50 0x7fa45014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 --2- 172.21.15.154:0/1487597721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4501595b0 0x7fa45015ae00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 >> 172.21.15.154:0/1487597721 conn(0x7fa450063230 msgr2=0x7fa4500b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 shutdown_connections 2023-10-10T21:14:23.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.156+0000 7fa4549fe700 1 -- 172.21.15.154:0/1487597721 wait complete. 2023-10-10T21:14:23.174 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-10-10T21:14:23.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-10T21:14:23.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.361+0000 7f9539bff700 1 Processor -- start 2023-10-10T21:14:23.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.361+0000 7f9539bff700 1 -- start start 2023-10-10T21:14:23.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.362+0000 7f9539bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9534068aa0 0x7f9534162460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.362+0000 7f9539bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95340ae6d0 con 0x7f95340b2100 2023-10-10T21:14:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.362+0000 7f9539bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953406dc20 con 0x7f9534157740 2023-10-10T21:14:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.363+0000 7f9539bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95340acc00 con 0x7f9534068aa0 2023-10-10T21:14:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.363+0000 7f9532ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f95340b2100 0x7f9534068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57768/0 (socket says 172.21.15.154:57768) 2023-10-10T21:14:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.363+0000 7f9532ffd700 1 -- 172.21.15.154:0/602699554 learned_addr learned my addr 172.21.15.154:0/602699554 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:23.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.363+0000 7f9533fff700 1 --2- 172.21.15.154:0/602699554 >> v2:172.21.15.179:3300/0 conn(0x7f9534068aa0 0x7f9534162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.363+0000 7f95327fc700 1 -- 172.21.15.154:0/602699554 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612671564 0 0) 0x7f9528001110 con 0x7f95340b2100 2023-10-10T21:14:23.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.363+0000 7f95327fc700 1 -- 172.21.15.154:0/602699554 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f951c003570 con 0x7f95340b2100 2023-10-10T21:14:23.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.363+0000 7f9533fff700 1 -- 172.21.15.154:0/602699554 >> v1:172.21.15.179:6789/0 conn(0x7f9534157740 legacy=0x7f95340adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.363+0000 7f9533fff700 1 -- 172.21.15.154:0/602699554 >> v1:172.21.15.154:6789/0 conn(0x7f95340b2100 legacy=0x7f9534068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.363+0000 7f9533fff700 1 -- 172.21.15.154:0/602699554 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95340ae910 con 0x7f9534068aa0 2023-10-10T21:14:23.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.364+0000 7f9533fff700 1 --2- 172.21.15.154:0/602699554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9534068aa0 0x7f9534162460 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f952c009e60 tx=0x7f952c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c4ac4f590674032 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.364+0000 7f95327fc700 1 -- 172.21.15.154:0/602699554 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c00e070 con 0x7f9534068aa0 2023-10-10T21:14:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.364+0000 7f95327fc700 1 -- 172.21.15.154:0/602699554 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c00bb60 con 0x7f9534068aa0 2023-10-10T21:14:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.364+0000 7f95327fc700 1 -- 172.21.15.154:0/602699554 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c012430 con 0x7f9534068aa0 2023-10-10T21:14:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.364+0000 7f9539bff700 1 -- 172.21.15.154:0/602699554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9534068aa0 msgr2=0x7f9534162460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.364+0000 7f9539bff700 1 --2- 172.21.15.154:0/602699554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9534068aa0 0x7f9534162460 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f952c009e60 tx=0x7f952c009780 comp rx=0 tx=0).stop 2023-10-10T21:14:23.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.365+0000 7f9539bff700 1 -- 172.21.15.154:0/602699554 shutdown_connections 2023-10-10T21:14:23.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.365+0000 7f9539bff700 1 --2- 172.21.15.154:0/602699554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9534068aa0 0x7f9534162460 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.365+0000 7f9539bff700 1 -- 172.21.15.154:0/602699554 >> 172.21.15.154:0/602699554 conn(0x7f95340c8f90 msgr2=0x7f95340c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:23.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.365+0000 7f9539bff700 1 -- 172.21.15.154:0/602699554 shutdown_connections 2023-10-10T21:14:23.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.365+0000 7f9539bff700 1 -- 172.21.15.154:0/602699554 wait complete. 2023-10-10T21:14:23.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.366+0000 7f9539bff700 1 Processor -- start 2023-10-10T21:14:23.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.366+0000 7f9539bff700 1 -- start start 2023-10-10T21:14:23.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.367+0000 7f9539bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9534068aa0 0x7f9534151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.367+0000 7f9539bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95340b2100 0x7f9534154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.367+0000 7f9539bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9534157740 0x7f95340ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.367+0000 7f9539bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9534151670 con 0x7f9534068aa0 2023-10-10T21:14:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.367+0000 7f9539bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95340aff50 con 0x7f95340b2100 2023-10-10T21:14:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.367+0000 7f9539bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95340b0230 con 0x7f9534157740 2023-10-10T21:14:23.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.367+0000 7f95337fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9534068aa0 0x7f9534151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.367+0000 7f95337fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9534068aa0 0x7f9534151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47772/0 (socket says 172.21.15.154:47772) 2023-10-10T21:14:23.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.367+0000 7f95337fe700 1 -- 172.21.15.154:0/854130641 learned_addr learned my addr 172.21.15.154:0/854130641 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:23.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f95337fe700 1 -- 172.21.15.154:0/854130641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9534157740 msgr2=0x7f95340ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f95337fe700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9534157740 0x7f95340ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f95337fe700 1 -- 172.21.15.154:0/854130641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95340b2100 msgr2=0x7f9534154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f9532ffd700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95340b2100 0x7f9534154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f95337fe700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95340b2100 0x7f9534154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f95337fe700 1 -- 172.21.15.154:0/854130641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c009a20 con 0x7f9534068aa0 2023-10-10T21:14:23.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f9532ffd700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95340b2100 0x7f9534154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:23.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f95337fe700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9534068aa0 0x7f9534151130 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f952400c4e0 tx=0x7f952400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:23.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f951b7fe700 1 -- 172.21.15.154:0/854130641 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524011590 con 0x7f9534068aa0 2023-10-10T21:14:23.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f951b7fe700 1 -- 172.21.15.154:0/854130641 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9524011710 con 0x7f9534068aa0 2023-10-10T21:14:23.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f951b7fe700 1 -- 172.21.15.154:0/854130641 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524011ad0 con 0x7f9534068aa0 2023-10-10T21:14:23.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9534154390 con 0x7f9534068aa0 2023-10-10T21:14:23.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.368+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9534154950 con 0x7f9534068aa0 2023-10-10T21:14:23.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.369+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9534154b70 con 0x7f9534068aa0 2023-10-10T21:14:23.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.370+0000 7f951b7fe700 1 -- 172.21.15.154:0/854130641 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f952401b3b0 con 0x7f9534068aa0 2023-10-10T21:14:23.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.371+0000 7f951b7fe700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9520067130 0x7f95200695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.371+0000 7f951b7fe700 1 -- 172.21.15.154:0/854130641 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9524083f00 con 0x7f9534068aa0 2023-10-10T21:14:23.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.371+0000 7f9532ffd700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9520067130 0x7f95200695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.372+0000 7f9532ffd700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9520067130 0x7f95200695e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f95280058d0 tx=0x7f9528009040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:23.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.375+0000 7f951b7fe700 1 -- 172.21.15.154:0/854130641 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9524050d50 con 0x7f9534068aa0 2023-10-10T21:14:23.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.588+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f95340718b0 con 0x7f9520067130 2023-10-10T21:14:23.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.658+0000 7f951b7fe700 1 -- 172.21.15.154:0/854130641 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f95340718b0 con 0x7f9520067130 2023-10-10T21:14:23.660 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-10-10T21:14:23.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.660+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9520067130 msgr2=0x7f95200695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.660+0000 7f9539bff700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9520067130 0x7f95200695e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f95280058d0 tx=0x7f9528009040 comp rx=0 tx=0).stop 2023-10-10T21:14:23.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.660+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9534068aa0 msgr2=0x7f9534151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.660+0000 7f9539bff700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9534068aa0 0x7f9534151130 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f952400c4e0 tx=0x7f952400c8a0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.661+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 shutdown_connections 2023-10-10T21:14:23.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.661+0000 7f9539bff700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9520067130 0x7f95200695e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.661+0000 7f9539bff700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9534157740 0x7f95340ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.661+0000 7f9539bff700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9534068aa0 0x7f9534151130 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.661+0000 7f9539bff700 1 --2- 172.21.15.154:0/854130641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95340b2100 0x7f9534154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.661+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 >> 172.21.15.154:0/854130641 conn(0x7f95340c8f90 msgr2=0x7f9534156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:23.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.661+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 shutdown_connections 2023-10-10T21:14:23.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.661+0000 7f9539bff700 1 -- 172.21.15.154:0/854130641 wait complete. 2023-10-10T21:14:23.680 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-10-10T21:14:23.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-10T21:14:23.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.866+0000 7f096f7ff700 1 Processor -- start 2023-10-10T21:14:23.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.866+0000 7f096f7ff700 1 -- start start 2023-10-10T21:14:23.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.867+0000 7f096f7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0968154320 0x7f096806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.867+0000 7f096f7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f096815a190 0x7f096806d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.867+0000 7f096f7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09680b4570 con 0x7f0968153f50 2023-10-10T21:14:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.867+0000 7f096f7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09680b2710 con 0x7f0968154320 2023-10-10T21:14:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.867+0000 7f096f7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096815a730 con 0x7f096815a190 2023-10-10T21:14:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.868+0000 7f096cd9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0968154320 0x7f096806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.868+0000 7f096cd9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0968154320 0x7f096806d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47788/0 (socket says 172.21.15.154:47788) 2023-10-10T21:14:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.868+0000 7f096cd9a700 1 -- 172.21.15.154:0/662938430 learned_addr learned my addr 172.21.15.154:0/662938430 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.868+0000 7f096dd9c700 1 --2- 172.21.15.154:0/662938430 >> v2:172.21.15.179:3300/0 conn(0x7f096815a190 0x7f096806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.868+0000 7f096cd9a700 1 -- 172.21.15.154:0/662938430 >> v2:172.21.15.179:3300/0 conn(0x7f096815a190 msgr2=0x7f096806d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:23.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.868+0000 7f096cd9a700 1 --2- 172.21.15.154:0/662938430 >> v2:172.21.15.179:3300/0 conn(0x7f096815a190 0x7f096806d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.868+0000 7f096cd9a700 1 -- 172.21.15.154:0/662938430 >> v1:172.21.15.179:6789/0 conn(0x7f0968153f50 legacy=0x7f09680b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.868+0000 7f096cd9a700 1 -- 172.21.15.154:0/662938430 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096815aa10 con 0x7f0968154320 2023-10-10T21:14:23.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.868+0000 7f096cd9a700 1 --2- 172.21.15.154:0/662938430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0968154320 0x7f096806d130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f09680b2e30 tx=0x7f0958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901030fd6dc24118 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:23.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f095ffff700 1 -- 172.21.15.154:0/662938430 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958009e70 con 0x7f0968154320 2023-10-10T21:14:23.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f095ffff700 1 -- 172.21.15.154:0/662938430 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095800b860 con 0x7f0968154320 2023-10-10T21:14:23.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f095ffff700 1 -- 172.21.15.154:0/662938430 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800bc00 con 0x7f0968154320 2023-10-10T21:14:23.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f096f7ff700 1 -- 172.21.15.154:0/662938430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0968154320 msgr2=0x7f096806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f096f7ff700 1 --2- 172.21.15.154:0/662938430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0968154320 0x7f096806d130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f09680b2e30 tx=0x7f0958009250 comp rx=0 tx=0).stop 2023-10-10T21:14:23.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f096f7ff700 1 -- 172.21.15.154:0/662938430 shutdown_connections 2023-10-10T21:14:23.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f096f7ff700 1 --2- 172.21.15.154:0/662938430 >> v2:172.21.15.179:3300/0 conn(0x7f096815a190 0x7f096806d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f096f7ff700 1 --2- 172.21.15.154:0/662938430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0968154320 0x7f096806d130 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f096f7ff700 1 -- 172.21.15.154:0/662938430 >> 172.21.15.154:0/662938430 conn(0x7f096806baf0 msgr2=0x7f096806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:23.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f096f7ff700 1 -- 172.21.15.154:0/662938430 shutdown_connections 2023-10-10T21:14:23.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.869+0000 7f096f7ff700 1 -- 172.21.15.154:0/662938430 wait complete. 2023-10-10T21:14:23.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.871+0000 7f096f7ff700 1 Processor -- start 2023-10-10T21:14:23.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.871+0000 7f096f7ff700 1 -- start start 2023-10-10T21:14:23.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096f7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0968153f50 0x7f09680ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096f7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0968154320 0x7f096816d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096f7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f096815a190 0x7f096814a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096f7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0968154e00 con 0x7f096815a190 2023-10-10T21:14:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096f7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0968154990 con 0x7f0968153f50 2023-10-10T21:14:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096f7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096814a850 con 0x7f0968154320 2023-10-10T21:14:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096dd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f096815a190 0x7f096814a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096dd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f096815a190 0x7f096814a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47792/0 (socket says 172.21.15.154:47792) 2023-10-10T21:14:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096dd9c700 1 -- 172.21.15.154:0/3043295657 learned_addr learned my addr 172.21.15.154:0/3043295657 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096d59b700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0968153f50 0x7f09680ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096cd9a700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0968154320 0x7f096816d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096dd9c700 1 -- 172.21.15.154:0/3043295657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0968154320 msgr2=0x7f096816d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096dd9c700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0968154320 0x7f096816d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096dd9c700 1 -- 172.21.15.154:0/3043295657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0968153f50 msgr2=0x7f09680ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:23.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096dd9c700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0968153f50 0x7f09680ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.872+0000 7f096dd9c700 1 -- 172.21.15.154:0/3043295657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580094f0 con 0x7f096815a190 2023-10-10T21:14:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.873+0000 7f096dd9c700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f096815a190 0x7f096814a310 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0960009df0 tx=0x7f096000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.873+0000 7f095d7fa700 1 -- 172.21.15.154:0/3043295657 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096000caa0 con 0x7f096815a190 2023-10-10T21:14:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.873+0000 7f095d7fa700 1 -- 172.21.15.154:0/3043295657 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096000f040 con 0x7f096815a190 2023-10-10T21:14:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.873+0000 7f095d7fa700 1 -- 172.21.15.154:0/3043295657 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096000ce70 con 0x7f096815a190 2023-10-10T21:14:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.873+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096816e020 con 0x7f096815a190 2023-10-10T21:14:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.873+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096816e5e0 con 0x7f096815a190 2023-10-10T21:14:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.874+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0968154f70 con 0x7f096815a190 2023-10-10T21:14:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.875+0000 7f095d7fa700 1 -- 172.21.15.154:0/3043295657 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f0960014690 con 0x7f096815a190 2023-10-10T21:14:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.876+0000 7f095d7fa700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f094c067130 0x7f094c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.876+0000 7f095d7fa700 1 -- 172.21.15.154:0/3043295657 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0960085240 con 0x7f096815a190 2023-10-10T21:14:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.876+0000 7f096d59b700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f094c067130 0x7f094c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.877+0000 7f096d59b700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f094c067130 0x7f094c0695e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0964003a80 tx=0x7f0964007ec0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:23.880+0000 7f095d7fa700 1 -- 172.21.15.154:0/3043295657 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0960055ab0 con 0x7f096815a190 2023-10-10T21:14:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.097+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f09680718b0 con 0x7f094c067130 2023-10-10T21:14:24.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.167+0000 7f095d7fa700 1 -- 172.21.15.154:0/3043295657 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f09680718b0 con 0x7f094c067130 2023-10-10T21:14:24.170 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-10-10T21:14:24.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.169+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f094c067130 msgr2=0x7f094c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.169+0000 7f096f7ff700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f094c067130 0x7f094c0695e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0964003a80 tx=0x7f0964007ec0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.169+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f096815a190 msgr2=0x7f096814a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.169+0000 7f096f7ff700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f096815a190 0x7f096814a310 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0960009df0 tx=0x7f096000b040 comp rx=0 tx=0).stop 2023-10-10T21:14:24.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.170+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 shutdown_connections 2023-10-10T21:14:24.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.170+0000 7f096f7ff700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f096815a190 0x7f096814a310 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.170+0000 7f096f7ff700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0968153f50 0x7f09680ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.170+0000 7f096f7ff700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f094c067130 0x7f094c0695e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.170+0000 7f096f7ff700 1 --2- 172.21.15.154:0/3043295657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0968154320 0x7f096816d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.170+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 >> 172.21.15.154:0/3043295657 conn(0x7f096806baf0 msgr2=0x7f09680ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:24.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.170+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 shutdown_connections 2023-10-10T21:14:24.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.170+0000 7f096f7ff700 1 -- 172.21.15.154:0/3043295657 wait complete. 2023-10-10T21:14:24.189 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-10-10T21:14:24.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-10T21:14:24.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.375+0000 7f287099d700 1 Processor -- start 2023-10-10T21:14:24.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.375+0000 7f287099d700 1 -- start start 2023-10-10T21:14:24.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.376+0000 7f287099d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f286c156350 0x7f286c157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.376+0000 7f287099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c0b0c00 0x7f286c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.376+0000 7f287099d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286c0b0570 con 0x7f286c0b0760 2023-10-10T21:14:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.376+0000 7f287099d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c1578b0 con 0x7f286c156350 2023-10-10T21:14:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.376+0000 7f287099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0af4d0 con 0x7f286c0b0c00 2023-10-10T21:14:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286b7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f286c156350 0x7f286c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c0b0c00 0x7f286c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286b7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f286c156350 0x7f286c157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:45954/0 (socket says 172.21.15.154:45954) 2023-10-10T21:14:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c0b0c00 0x7f286c15a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:42344/0 (socket says 172.21.15.154:42344) 2023-10-10T21:14:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286b7fe700 1 -- 172.21.15.154:0/1108076546 learned_addr learned my addr 172.21.15.154:0/1108076546 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286bfff700 1 -- 172.21.15.154:0/1108076546 >> v2:172.21.15.179:3300/0 conn(0x7f286c156350 msgr2=0x7f286c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286bfff700 1 --2- 172.21.15.154:0/1108076546 >> v2:172.21.15.179:3300/0 conn(0x7f286c156350 0x7f286c157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286bfff700 1 -- 172.21.15.154:0/1108076546 >> v1:172.21.15.179:6789/0 conn(0x7f286c0b0760 legacy=0x7f286c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286bfff700 1 -- 172.21.15.154:0/1108076546 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c0af7b0 con 0x7f286c0b0c00 2023-10-10T21:14:24.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.377+0000 7f286b7fe700 1 --2- 172.21.15.154:0/1108076546 >> v2:172.21.15.179:3300/0 conn(0x7f286c156350 0x7f286c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:24.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.378+0000 7f286bfff700 1 --2- 172.21.15.154:0/1108076546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c0b0c00 0x7f286c15a630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f286400bb90 tx=0x7f286400b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3fc588d8845bd65 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:24.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.378+0000 7f286a7fc700 1 -- 172.21.15.154:0/1108076546 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400db40 con 0x7f286c0b0c00 2023-10-10T21:14:24.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.378+0000 7f286a7fc700 1 -- 172.21.15.154:0/1108076546 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286400dca0 con 0x7f286c0b0c00 2023-10-10T21:14:24.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.378+0000 7f286a7fc700 1 -- 172.21.15.154:0/1108076546 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640196b0 con 0x7f286c0b0c00 2023-10-10T21:14:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.379+0000 7f287099d700 1 -- 172.21.15.154:0/1108076546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c0b0c00 msgr2=0x7f286c15a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.379+0000 7f287099d700 1 --2- 172.21.15.154:0/1108076546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c0b0c00 0x7f286c15a630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f286400bb90 tx=0x7f286400b430 comp rx=0 tx=0).stop 2023-10-10T21:14:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.379+0000 7f287099d700 1 -- 172.21.15.154:0/1108076546 shutdown_connections 2023-10-10T21:14:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.379+0000 7f287099d700 1 --2- 172.21.15.154:0/1108076546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c0b0c00 0x7f286c15a630 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.379+0000 7f287099d700 1 --2- 172.21.15.154:0/1108076546 >> v2:172.21.15.179:3300/0 conn(0x7f286c156350 0x7f286c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.379+0000 7f287099d700 1 -- 172.21.15.154:0/1108076546 >> 172.21.15.154:0/1108076546 conn(0x7f286c068e20 msgr2=0x7f286c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.379+0000 7f287099d700 1 -- 172.21.15.154:0/1108076546 shutdown_connections 2023-10-10T21:14:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.379+0000 7f287099d700 1 -- 172.21.15.154:0/1108076546 wait complete. 2023-10-10T21:14:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.380+0000 7f287099d700 1 Processor -- start 2023-10-10T21:14:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.380+0000 7f287099d700 1 -- start start 2023-10-10T21:14:24.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.381+0000 7f287099d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286c0b0760 0x7f286c0c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.381+0000 7f287099d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0b0c00 0x7f286c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.381+0000 7f287099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c156350 0x7f286c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.381+0000 7f287099d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0cb010 con 0x7f286c0b0c00 2023-10-10T21:14:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.381+0000 7f287099d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0ca400 con 0x7f286c0b0760 2023-10-10T21:14:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.381+0000 7f287099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0ca6e0 con 0x7f286c156350 2023-10-10T21:14:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0b0c00 0x7f286c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0b0c00 0x7f286c0c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47802/0 (socket says 172.21.15.154:47802) 2023-10-10T21:14:24.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286affd700 1 -- 172.21.15.154:0/2149709173 learned_addr learned my addr 172.21.15.154:0/2149709173 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286b7fe700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286c0b0760 0x7f286c0c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286bfff700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c156350 0x7f286c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286affd700 1 -- 172.21.15.154:0/2149709173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c156350 msgr2=0x7f286c06e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286affd700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c156350 0x7f286c06e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286affd700 1 -- 172.21.15.154:0/2149709173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286c0b0760 msgr2=0x7f286c0c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286affd700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286c0b0760 0x7f286c0c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286affd700 1 -- 172.21.15.154:0/2149709173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c009ae0 con 0x7f286c0b0c00 2023-10-10T21:14:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f286affd700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0b0c00 0x7f286c0c7850 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f286000c4e0 tx=0x7f286000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.382+0000 7f28537fe700 1 -- 172.21.15.154:0/2149709173 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011590 con 0x7f286c0b0c00 2023-10-10T21:14:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.383+0000 7f28537fe700 1 -- 172.21.15.154:0/2149709173 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860011710 con 0x7f286c0b0c00 2023-10-10T21:14:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.383+0000 7f28537fe700 1 -- 172.21.15.154:0/2149709173 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011ad0 con 0x7f286c0b0c00 2023-10-10T21:14:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.383+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286400b6d0 con 0x7f286c0b0c00 2023-10-10T21:14:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.383+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c0caca0 con 0x7f286c0b0c00 2023-10-10T21:14:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.384+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286c0cb180 con 0x7f286c0b0c00 2023-10-10T21:14:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.384+0000 7f28537fe700 1 -- 172.21.15.154:0/2149709173 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f286001b3b0 con 0x7f286c0b0c00 2023-10-10T21:14:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.385+0000 7f28537fe700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2858067160 0x7f2858069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.385+0000 7f28537fe700 1 -- 172.21.15.154:0/2149709173 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f2860083fe0 con 0x7f286c0b0c00 2023-10-10T21:14:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.386+0000 7f286b7fe700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2858067160 0x7f2858069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.386+0000 7f286b7fe700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2858067160 0x7f2858069610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f285c009ab0 tx=0x7f285c00b040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.390+0000 7f28537fe700 1 -- 172.21.15.154:0/2149709173 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2860050e50 con 0x7f286c0b0c00 2023-10-10T21:14:24.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.608+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f286c04c3c0 con 0x7f2858067160 2023-10-10T21:14:24.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.673+0000 7f28537fe700 1 -- 172.21.15.154:0/2149709173 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f286c04c3c0 con 0x7f2858067160 2023-10-10T21:14:24.676 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-10-10T21:14:24.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2858067160 msgr2=0x7f2858069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2858067160 0x7f2858069610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f285c009ab0 tx=0x7f285c00b040 comp rx=0 tx=0).stop 2023-10-10T21:14:24.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0b0c00 msgr2=0x7f286c0c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0b0c00 0x7f286c0c7850 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f286000c4e0 tx=0x7f286000c8a0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 shutdown_connections 2023-10-10T21:14:24.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2858067160 0x7f2858069610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286c156350 0x7f286c06e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286c0b0760 0x7f286c0c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 --2- 172.21.15.154:0/2149709173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0b0c00 0x7f286c0c7850 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 >> 172.21.15.154:0/2149709173 conn(0x7f286c068e20 msgr2=0x7f286c0add60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:24.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 shutdown_connections 2023-10-10T21:14:24.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.676+0000 7f287099d700 1 -- 172.21.15.154:0/2149709173 wait complete. 2023-10-10T21:14:24.695 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-10-10T21:14:24.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-10T21:14:24.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.880+0000 7f798b59e700 1 Processor -- start 2023-10-10T21:14:24.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.881+0000 7f798b59e700 1 -- start start 2023-10-10T21:14:24.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f798b59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f798c153850 0x7f798c1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f798b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798c159bf0 0x7f798c157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f798b59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798c15a480 con 0x7f798c153480 2023-10-10T21:14:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f798b59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798c15a070 con 0x7f798c153850 2023-10-10T21:14:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f798b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0afb40 con 0x7f798c159bf0 2023-10-10T21:14:24.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f798a59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f798c153480 0x7f798c0ae750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57772/0 (socket says 172.21.15.154:57772) 2023-10-10T21:14:24.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f798a59c700 1 -- 172.21.15.154:0/4201709148 learned_addr learned my addr 172.21.15.154:0/4201709148 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:24.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f7989d9b700 1 --2- 172.21.15.154:0/4201709148 >> v2:172.21.15.179:3300/0 conn(0x7f798c153850 0x7f798c1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f798ad9d700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798c159bf0 0x7f798c157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.882+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352010815 0 0) 0x7f798c15a480 con 0x7f798c153480 2023-10-10T21:14:24.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7974003570 con 0x7f798c153480 2023-10-10T21:14:24.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 447915968 0 0) 0x7f7974003570 con 0x7f798c153480 2023-10-10T21:14:24.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798c159bf0 msgr2=0x7f798c157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798c159bf0 0x7f798c157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 >> v2:172.21.15.179:3300/0 conn(0x7f798c153850 msgr2=0x7f798c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 --2- 172.21.15.154:0/4201709148 >> v2:172.21.15.179:3300/0 conn(0x7f798c153850 0x7f798c1596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0afe20 con 0x7f798c153480 2023-10-10T21:14:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f797c001470 con 0x7f798c153480 2023-10-10T21:14:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 >> v1:172.21.15.154:6789/0 conn(0x7f798c153480 legacy=0x7f798c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7974003ae0 0x7f7974003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798c159bf0 0x7f7974004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7974004d50 0x7f79740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c15a070 con 0x7f7974003ae0 2023-10-10T21:14:24.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0afb40 con 0x7f7974004d50 2023-10-10T21:14:24.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797400bb10 con 0x7f798c159bf0 2023-10-10T21:14:24.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798a59c700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7974003ae0 0x7f7974003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f7989d9b700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798c159bf0 0x7f7974004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.883+0000 7f798ad9d700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7974004d50 0x7f79740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.884+0000 7f798a59c700 1 -- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798c159bf0 msgr2=0x7f7974004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.884+0000 7f798a59c700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798c159bf0 0x7f7974004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.884+0000 7f798a59c700 1 -- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7974004d50 msgr2=0x7f79740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.884+0000 7f798a59c700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7974004d50 0x7f79740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.884+0000 7f798a59c700 1 -- 172.21.15.154:0/4201709148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974003570 con 0x7f7974003ae0 2023-10-10T21:14:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.884+0000 7f798a59c700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7974003ae0 0x7f7974003ef0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f797c00c2d0 tx=0x7f798c1570c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff417b384b31a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.884+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c00cbc0 con 0x7f7974003ae0 2023-10-10T21:14:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.884+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c00cd20 con 0x7f7974003ae0 2023-10-10T21:14:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.884+0000 7f798959a700 1 -- 172.21.15.154:0/4201709148 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c005b70 con 0x7f7974003ae0 2023-10-10T21:14:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.885+0000 7f798b59e700 1 -- 172.21.15.154:0/4201709148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7974003ae0 msgr2=0x7f7974003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.885+0000 7f798b59e700 1 --2- 172.21.15.154:0/4201709148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7974003ae0 0x7f7974003ef0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f797c00c2d0 tx=0x7f798c1570c0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.885+0000 7f798ad9d700 1 -- 172.21.15.154:0/4201709148 reap_dead start 2023-10-10T21:14:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.885+0000 7f798b59e700 1 -- 172.21.15.154:0/4201709148 shutdown_connections 2023-10-10T21:14:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.885+0000 7f798b59e700 1 -- 172.21.15.154:0/4201709148 >> 172.21.15.154:0/4201709148 conn(0x7f798c068e20 msgr2=0x7f798c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:24.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.885+0000 7f798b59e700 1 -- 172.21.15.154:0/4201709148 shutdown_connections 2023-10-10T21:14:24.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.885+0000 7f798b59e700 1 -- 172.21.15.154:0/4201709148 wait complete. 2023-10-10T21:14:24.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.886+0000 7f798b59e700 1 Processor -- start 2023-10-10T21:14:24.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.887+0000 7f798b59e700 1 -- start start 2023-10-10T21:14:24.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.887+0000 7f798b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7974003ae0 0x7f798c151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.887+0000 7f798b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c16a4b0 0x7f798c154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.887+0000 7f798b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798c15a790 0x7f798c15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.887+0000 7f798b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c16db90 con 0x7f798c15a790 2023-10-10T21:14:24.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.887+0000 7f798b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c15b140 con 0x7f798c16a4b0 2023-10-10T21:14:24.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.887+0000 7f798b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c152310 con 0x7f7974003ae0 2023-10-10T21:14:24.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798c15a790 0x7f798c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798c15a790 0x7f798c15ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47820/0 (socket says 172.21.15.154:47820) 2023-10-10T21:14:24.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798ad9d700 1 -- 172.21.15.154:0/976403685 learned_addr learned my addr 172.21.15.154:0/976403685 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:24.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798a59c700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7974003ae0 0x7f798c151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f7989d9b700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c16a4b0 0x7f798c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798ad9d700 1 -- 172.21.15.154:0/976403685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7974003ae0 msgr2=0x7f798c151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798ad9d700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7974003ae0 0x7f798c151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798ad9d700 1 -- 172.21.15.154:0/976403685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c16a4b0 msgr2=0x7f798c154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:24.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798ad9d700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c16a4b0 0x7f798c154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:24.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798ad9d700 1 -- 172.21.15.154:0/976403685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c16cf10 con 0x7f798c15a790 2023-10-10T21:14:24.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f7989d9b700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c16a4b0 0x7f798c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:24.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.888+0000 7f798ad9d700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798c15a790 0x7f798c15ac00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f79840094d0 tx=0x7f798400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:24.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.889+0000 7f797a7fc700 1 -- 172.21.15.154:0/976403685 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400e040 con 0x7f798c15a790 2023-10-10T21:14:24.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.889+0000 7f797a7fc700 1 -- 172.21.15.154:0/976403685 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400f040 con 0x7f798c15a790 2023-10-10T21:14:24.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.889+0000 7f797a7fc700 1 -- 172.21.15.154:0/976403685 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400fe50 con 0x7f798c15a790 2023-10-10T21:14:24.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.889+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798c16d1f0 con 0x7f798c15a790 2023-10-10T21:14:24.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.889+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798c16d7b0 con 0x7f798c15a790 2023-10-10T21:14:24.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.890+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798c16dcd0 con 0x7f798c15a790 2023-10-10T21:14:24.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.891+0000 7f797a7fc700 1 -- 172.21.15.154:0/976403685 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f7984015640 con 0x7f798c15a790 2023-10-10T21:14:24.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.892+0000 7f797a7fc700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f796c067130 0x7f796c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:24.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.893+0000 7f797a7fc700 1 -- 172.21.15.154:0/976403685 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f7984085290 con 0x7f798c15a790 2023-10-10T21:14:24.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.893+0000 7f798a59c700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f796c067130 0x7f796c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:24.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.893+0000 7f798a59c700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f796c067130 0x7f796c0695e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f797c007c60 tx=0x7f797c015000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:24.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:24.897+0000 7f797a7fc700 1 -- 172.21.15.154:0/976403685 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f798c16dcd0 con 0x7f798c15a790 2023-10-10T21:14:25.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.119+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f798c16dcd0 con 0x7f796c067130 2023-10-10T21:14:25.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.187+0000 7f797a7fc700 1 -- 172.21.15.154:0/976403685 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f798c16dcd0 con 0x7f796c067130 2023-10-10T21:14:25.189 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-10-10T21:14:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f796c067130 msgr2=0x7f796c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f796c067130 0x7f796c0695e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f797c007c60 tx=0x7f797c015000 comp rx=0 tx=0).stop 2023-10-10T21:14:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798c15a790 msgr2=0x7f798c15ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798c15a790 0x7f798c15ac00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f79840094d0 tx=0x7f798400b040 comp rx=0 tx=0).stop 2023-10-10T21:14:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 shutdown_connections 2023-10-10T21:14:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798c15a790 0x7f798c15ac00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f796c067130 0x7f796c0695e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7974003ae0 0x7f798c151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 --2- 172.21.15.154:0/976403685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c16a4b0 0x7f798c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 >> 172.21.15.154:0/976403685 conn(0x7f798c068e20 msgr2=0x7f798c06e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 shutdown_connections 2023-10-10T21:14:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.189+0000 7f798b59e700 1 -- 172.21.15.154:0/976403685 wait complete. 2023-10-10T21:14:25.209 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-10-10T21:14:25.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-10T21:14:25.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.398+0000 7ffb4a1ff700 1 Processor -- start 2023-10-10T21:14:25.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.398+0000 7ffb4a1ff700 1 -- start start 2023-10-10T21:14:25.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.399+0000 7ffb4a1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb440c8490 0x7ffb440c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:25.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.399+0000 7ffb4a1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb44069a50 0x7ffb44156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:25.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.399+0000 7ffb4a1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb440ac030 con 0x7ffb4415a490 2023-10-10T21:14:25.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.399+0000 7ffb4a1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb44068aa0 con 0x7ffb44069a50 2023-10-10T21:14:25.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.399+0000 7ffb4a1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb440ab820 con 0x7ffb440c8490 2023-10-10T21:14:25.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb43fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb44069a50 0x7ffb44156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:25.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb437fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb440c8490 0x7ffb440c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:25.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb43fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb44069a50 0x7ffb44156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:46010/0 (socket says 172.21.15.154:46010) 2023-10-10T21:14:25.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb437fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb440c8490 0x7ffb440c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:42384/0 (socket says 172.21.15.154:42384) 2023-10-10T21:14:25.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb43fff700 1 -- 172.21.15.154:0/4058920604 learned_addr learned my addr 172.21.15.154:0/4058920604 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:25.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb43fff700 1 -- 172.21.15.154:0/4058920604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb440c8490 msgr2=0x7ffb440c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:25.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb43fff700 1 --2- 172.21.15.154:0/4058920604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb440c8490 0x7ffb440c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb43fff700 1 -- 172.21.15.154:0/4058920604 >> v1:172.21.15.179:6789/0 conn(0x7ffb4415a490 legacy=0x7ffb44068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:25.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb43fff700 1 -- 172.21.15.154:0/4058920604 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4406dbb0 con 0x7ffb44069a50 2023-10-10T21:14:25.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.400+0000 7ffb437fe700 1 --2- 172.21.15.154:0/4058920604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb440c8490 0x7ffb440c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:25.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.401+0000 7ffb43fff700 1 --2- 172.21.15.154:0/4058920604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb44069a50 0x7ffb44156ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00bc50 tx=0x7ffb3c00b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ef61c9483c5fa7d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:25.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.401+0000 7ffb427fc700 1 -- 172.21.15.154:0/4058920604 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00dbf0 con 0x7ffb44069a50 2023-10-10T21:14:25.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.401+0000 7ffb427fc700 1 -- 172.21.15.154:0/4058920604 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c00dd50 con 0x7ffb44069a50 2023-10-10T21:14:25.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.401+0000 7ffb427fc700 1 -- 172.21.15.154:0/4058920604 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0196b0 con 0x7ffb44069a50 2023-10-10T21:14:25.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.401+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4058920604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb44069a50 msgr2=0x7ffb44156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.401+0000 7ffb4a1ff700 1 --2- 172.21.15.154:0/4058920604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb44069a50 0x7ffb44156ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00bc50 tx=0x7ffb3c00b4f0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.401+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4058920604 shutdown_connections 2023-10-10T21:14:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.402+0000 7ffb4a1ff700 1 --2- 172.21.15.154:0/4058920604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb44069a50 0x7ffb44156ab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.402+0000 7ffb4a1ff700 1 --2- 172.21.15.154:0/4058920604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb440c8490 0x7ffb440c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.402+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4058920604 >> 172.21.15.154:0/4058920604 conn(0x7ffb440c8f90 msgr2=0x7ffb440c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:25.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.402+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4058920604 shutdown_connections 2023-10-10T21:14:25.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.402+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4058920604 wait complete. 2023-10-10T21:14:25.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.403+0000 7ffb4a1ff700 1 Processor -- start 2023-10-10T21:14:25.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.403+0000 7ffb4a1ff700 1 -- start start 2023-10-10T21:14:25.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.404+0000 7ffb4a1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb44069a50 0x7ffb441449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:25.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.404+0000 7ffb4a1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb440c8490 0x7ffb440afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:25.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.404+0000 7ffb4a1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb4415a490 0x7ffb44145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:25.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.404+0000 7ffb4a1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb440c4840 con 0x7ffb4415a490 2023-10-10T21:14:25.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.404+0000 7ffb4a1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44144ef0 con 0x7ffb440c8490 2023-10-10T21:14:25.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.404+0000 7ffb4a1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb440c5660 con 0x7ffb44069a50 2023-10-10T21:14:25.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.404+0000 7ffb43fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb4415a490 0x7ffb44145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:25.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.404+0000 7ffb43fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb4415a490 0x7ffb44145280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47830/0 (socket says 172.21.15.154:47830) 2023-10-10T21:14:25.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.404+0000 7ffb43fff700 1 -- 172.21.15.154:0/4160415296 learned_addr learned my addr 172.21.15.154:0/4160415296 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:25.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb437fe700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb44069a50 0x7ffb441449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:25.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb42ffd700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb440c8490 0x7ffb440afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:25.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb43fff700 1 -- 172.21.15.154:0/4160415296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb44069a50 msgr2=0x7ffb441449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:25.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb43fff700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb44069a50 0x7ffb441449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb43fff700 1 -- 172.21.15.154:0/4160415296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb440c8490 msgr2=0x7ffb440afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:25.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb43fff700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb440c8490 0x7ffb440afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb43fff700 1 -- 172.21.15.154:0/4160415296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb34009a20 con 0x7ffb4415a490 2023-10-10T21:14:25.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb43fff700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb4415a490 0x7ffb44145280 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c006fd0 tx=0x7ffb3c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:25.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb2b7fe700 1 -- 172.21.15.154:0/4160415296 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c028070 con 0x7ffb4415a490 2023-10-10T21:14:25.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb2b7fe700 1 -- 172.21.15.154:0/4160415296 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c01e050 con 0x7ffb4415a490 2023-10-10T21:14:25.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb2b7fe700 1 -- 172.21.15.154:0/4160415296 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00dbf0 con 0x7ffb4415a490 2023-10-10T21:14:25.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3c00b790 con 0x7ffb4415a490 2023-10-10T21:14:25.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.405+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb440c4d30 con 0x7ffb4415a490 2023-10-10T21:14:25.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.406+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb440c57d0 con 0x7ffb4415a490 2023-10-10T21:14:25.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.407+0000 7ffb2b7fe700 1 -- 172.21.15.154:0/4160415296 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7ffb3c024680 con 0x7ffb4415a490 2023-10-10T21:14:25.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.408+0000 7ffb2b7fe700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffb30067130 0x7ffb300695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:25.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.408+0000 7ffb2b7fe700 1 -- 172.21.15.154:0/4160415296 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ffb3c014070 con 0x7ffb4415a490 2023-10-10T21:14:25.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.408+0000 7ffb437fe700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffb30067130 0x7ffb300695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:25.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.409+0000 7ffb437fe700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffb30067130 0x7ffb300695e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb340099f0 tx=0x7ffb3400b040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:25.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.413+0000 7ffb2b7fe700 1 -- 172.21.15.154:0/4160415296 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb3c055d90 con 0x7ffb4415a490 2023-10-10T21:14:25.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.633+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb440718b0 con 0x7ffb30067130 2023-10-10T21:14:25.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.704+0000 7ffb2b7fe700 1 -- 172.21.15.154:0/4160415296 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ffb440718b0 con 0x7ffb30067130 2023-10-10T21:14:25.706 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-10-10T21:14:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffb30067130 msgr2=0x7ffb300695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffb30067130 0x7ffb300695e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb340099f0 tx=0x7ffb3400b040 comp rx=0 tx=0).stop 2023-10-10T21:14:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb4415a490 msgr2=0x7ffb44145280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb4415a490 0x7ffb44145280 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c006fd0 tx=0x7ffb3c01b000 comp rx=0 tx=0).stop 2023-10-10T21:14:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 shutdown_connections 2023-10-10T21:14:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb4415a490 0x7ffb44145280 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7ffb30067130 0x7ffb300695e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb44069a50 0x7ffb441449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 --2- 172.21.15.154:0/4160415296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb440c8490 0x7ffb440afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 >> 172.21.15.154:0/4160415296 conn(0x7ffb440c8f90 msgr2=0x7ffb4406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 shutdown_connections 2023-10-10T21:14:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.707+0000 7ffb4a1ff700 1 -- 172.21.15.154:0/4160415296 wait complete. 2023-10-10T21:14:25.726 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-10-10T21:14:25.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:25.727 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-10T21:14:25.767 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:25.767 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:25.767 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:25.768 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:25.768 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:25.768 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:25.768 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:25.768 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:25.768 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:25.769 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:25.769 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:25.770 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_00_UTC', 'scheduled-2023-10-10-21_08_00_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:25.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-10-10T21:14:25.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.994+0000 7f87bf39d700 1 Processor -- start 2023-10-10T21:14:25.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.994+0000 7f87bf39d700 1 -- start start 2023-10-10T21:14:25.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.995+0000 7f87bf39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87b815ca70 0x7f87b81645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:25.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.995+0000 7f87bf39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b8159db0 con 0x7f87b80cb560 2023-10-10T21:14:25.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.995+0000 7f87bf39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b806a470 con 0x7f87b80ccb40 2023-10-10T21:14:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.995+0000 7f87bf39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b806aa30 con 0x7f87b815ca70 2023-10-10T21:14:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.995+0000 7f87be39b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f87b80cb560 0x7f87b80cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42656/0 (socket says 172.21.15.154:42656) 2023-10-10T21:14:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.995+0000 7f87be39b700 1 -- 172.21.15.154:0/935799152 learned_addr learned my addr 172.21.15.154:0/935799152 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:26.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87beb9c700 1 --2- 172.21.15.154:0/935799152 >> v2:172.21.15.179:3300/0 conn(0x7f87b815ca70 0x7f87b81645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201616624 0 0) 0x7f87b8159db0 con 0x7f87b80cb560 2023-10-10T21:14:26.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a4003570 con 0x7f87b80cb560 2023-10-10T21:14:26.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 97856298 0 0) 0x7f87a4003570 con 0x7f87b80cb560 2023-10-10T21:14:26.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 >> v2:172.21.15.179:3300/0 conn(0x7f87b815ca70 msgr2=0x7f87b81645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:26.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 --2- 172.21.15.154:0/935799152 >> v2:172.21.15.179:3300/0 conn(0x7f87b815ca70 0x7f87b81645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 >> v1:172.21.15.179:6789/0 conn(0x7f87b80ccb40 legacy=0x7f87b80697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b806a750 con 0x7f87b80cb560 2023-10-10T21:14:26.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f87b4001470 con 0x7f87b80cb560 2023-10-10T21:14:26.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 >> v1:172.21.15.154:6789/0 conn(0x7f87b80cb560 legacy=0x7f87b80cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a4003a60 0x7f87a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87a4004810 0x7f87a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87a40051c0 0x7f87a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b806aa30 con 0x7f87a4004810 2023-10-10T21:14:26.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a400c160 con 0x7f87a4003a60 2023-10-10T21:14:26.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.996+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a400c320 con 0x7f87a40051c0 2023-10-10T21:14:26.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bdb9a700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87a4004810 0x7f87a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87be39b700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a4003a60 0x7f87a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87beb9c700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87a40051c0 0x7f87a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bdb9a700 1 -- 172.21.15.154:0/935799152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87a40051c0 msgr2=0x7f87a400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bdb9a700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87a40051c0 0x7f87a400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bdb9a700 1 -- 172.21.15.154:0/935799152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a4003a60 msgr2=0x7f87a4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bdb9a700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87a4003a60 0x7f87a4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bdb9a700 1 -- 172.21.15.154:0/935799152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4003570 con 0x7f87a4004810 2023-10-10T21:14:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87beb9c700 1 -- 172.21.15.154:0/935799152 reap_dead start 2023-10-10T21:14:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bdb9a700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87a4004810 0x7f87a4004c80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87b80ccf40 tx=0x7f87a8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b172488ec636a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8012420 con 0x7f87a4004810 2023-10-10T21:14:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a80125a0 con 0x7f87a4004810 2023-10-10T21:14:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.997+0000 7f87bd399700 1 -- 172.21.15.154:0/935799152 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8012960 con 0x7f87a4004810 2023-10-10T21:14:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.998+0000 7f87bf39d700 1 -- 172.21.15.154:0/935799152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87a4004810 msgr2=0x7f87a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.998+0000 7f87bf39d700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87a4004810 0x7f87a4004c80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87b80ccf40 tx=0x7f87a8007d30 comp rx=0 tx=0).stop 2023-10-10T21:14:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.998+0000 7f87bf39d700 1 -- 172.21.15.154:0/935799152 shutdown_connections 2023-10-10T21:14:26.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.998+0000 7f87bf39d700 1 --2- 172.21.15.154:0/935799152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87a4004810 0x7f87a4004c80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.998+0000 7f87bf39d700 1 -- 172.21.15.154:0/935799152 >> 172.21.15.154:0/935799152 conn(0x7f87b806baf0 msgr2=0x7f87b806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:26.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.998+0000 7f87bf39d700 1 -- 172.21.15.154:0/935799152 shutdown_connections 2023-10-10T21:14:26.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:25.998+0000 7f87bf39d700 1 -- 172.21.15.154:0/935799152 wait complete. 2023-10-10T21:14:26.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.000+0000 7f87bf39d700 1 Processor -- start 2023-10-10T21:14:26.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.000+0000 7f87bf39d700 1 -- start start 2023-10-10T21:14:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87bf39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87a4004810 0x7f87b8156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87bf39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b8146da0 0x7f87b8147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87bf39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87b8169250 0x7f87b81696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87bf39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b814a230 con 0x7f87b8169250 2023-10-10T21:14:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87bf39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8147b10 con 0x7f87b8146da0 2023-10-10T21:14:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87bf39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8147df0 con 0x7f87a4004810 2023-10-10T21:14:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87beb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87b8169250 0x7f87b81696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87beb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87b8169250 0x7f87b81696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41526/0 (socket says 172.21.15.154:41526) 2023-10-10T21:14:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87beb9c700 1 -- 172.21.15.154:0/3055265888 learned_addr learned my addr 172.21.15.154:0/3055265888 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87bdb9a700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b8146da0 0x7f87b8147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87be39b700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87a4004810 0x7f87b8156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87beb9c700 1 -- 172.21.15.154:0/3055265888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87a4004810 msgr2=0x7f87b8156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87beb9c700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87a4004810 0x7f87b8156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87beb9c700 1 -- 172.21.15.154:0/3055265888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b8146da0 msgr2=0x7f87b8147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87beb9c700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b8146da0 0x7f87b8147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.001+0000 7f87beb9c700 1 -- 172.21.15.154:0/3055265888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b81480d0 con 0x7f87b8169250 2023-10-10T21:14:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.002+0000 7f87beb9c700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87b8169250 0x7f87b81696c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f87b80cdd40 tx=0x7f87b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.002+0000 7f87ae7fc700 1 -- 172.21.15.154:0/3055265888 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b000e070 con 0x7f87b8169250 2023-10-10T21:14:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.002+0000 7f87ae7fc700 1 -- 172.21.15.154:0/3055265888 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b0011b80 con 0x7f87b8169250 2023-10-10T21:14:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.002+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b81483b0 con 0x7f87b8169250 2023-10-10T21:14:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.002+0000 7f87ae7fc700 1 -- 172.21.15.154:0/3055265888 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0016470 con 0x7f87b8169250 2023-10-10T21:14:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.002+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b8147750 con 0x7f87b8169250 2023-10-10T21:14:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.003+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b81488d0 con 0x7f87b8169250 2023-10-10T21:14:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.004+0000 7f87ae7fc700 1 -- 172.21.15.154:0/3055265888 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f87b0016860 con 0x7f87b8169250 2023-10-10T21:14:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.005+0000 7f87ae7fc700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f879c067130 0x7f879c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.005+0000 7f87ae7fc700 1 -- 172.21.15.154:0/3055265888 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f87b0085540 con 0x7f87b8169250 2023-10-10T21:14:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.005+0000 7f87be39b700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f879c067130 0x7f879c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.006+0000 7f87be39b700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f879c067130 0x7f879c0695e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f87b4001ce0 tx=0x7f87b4001e50 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:26.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.009+0000 7f87ae7fc700 1 -- 172.21.15.154:0/3055265888 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87b81488d0 con 0x7f87b8169250 2023-10-10T21:14:26.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.227+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87b81488d0 con 0x7f879c067130 2023-10-10T21:14:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.236+0000 7f87ae7fc700 1 -- 172.21.15.154:0/3055265888 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f87b81488d0 con 0x7f879c067130 2023-10-10T21:14:26.238 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:26.238 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:35", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f879c067130 msgr2=0x7f879c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f879c067130 0x7f879c0695e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f87b4001ce0 tx=0x7f87b4001e50 comp rx=0 tx=0).stop 2023-10-10T21:14:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87b8169250 msgr2=0x7f87b81696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87b8169250 0x7f87b81696c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f87b80cdd40 tx=0x7f87b000b040 comp rx=0 tx=0).stop 2023-10-10T21:14:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 shutdown_connections 2023-10-10T21:14:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87b8169250 0x7f87b81696c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f879c067130 0x7f879c0695e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87a4004810 0x7f87b8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 --2- 172.21.15.154:0/3055265888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b8146da0 0x7f87b8147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 >> 172.21.15.154:0/3055265888 conn(0x7f87b806baf0 msgr2=0x7f87b815a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 shutdown_connections 2023-10-10T21:14:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.239+0000 7f87bf39d700 1 -- 172.21.15.154:0/3055265888 wait complete. 2023-10-10T21:14:26.258 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:35", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:26.261 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:35', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:26.261 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:26.262 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:26.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:26.263 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-10T21:14:26.301 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:26.301 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:26.301 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:26.301 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:26.302 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:26.302 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:26.302 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:26.302 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:26.302 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:26.303 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:26.303 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:26.304 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_00_UTC', 'scheduled-2023-10-10-21_08_00_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:26.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-10-10T21:14:26.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.530+0000 7f75ebdff700 1 Processor -- start 2023-10-10T21:14:26.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.530+0000 7f75ebdff700 1 -- start start 2023-10-10T21:14:26.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.531+0000 7f75ebdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e415a440 0x7f75e40acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.531+0000 7f75ebdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75e4068890 0x7f75e40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.531+0000 7f75ebdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e415a9b0 con 0x7f75e41563b0 2023-10-10T21:14:26.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.531+0000 7f75ebdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e415ac90 con 0x7f75e4068890 2023-10-10T21:14:26.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75ebdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e415af70 con 0x7f75e415a440 2023-10-10T21:14:26.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e9b9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f75e41563b0 0x7f75e4156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42670/0 (socket says 172.21.15.154:42670) 2023-10-10T21:14:26.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e9b9b700 1 -- 172.21.15.154:0/2558334882 learned_addr learned my addr 172.21.15.154:0/2558334882 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:26.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e939a700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e415a440 0x7f75e40acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75ea39c700 1 --2- 172.21.15.154:0/2558334882 >> v2:172.21.15.179:3300/0 conn(0x7f75e4068890 0x7f75e40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177309457 0 0) 0x7f75e415a9b0 con 0x7f75e41563b0 2023-10-10T21:14:26.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d0003570 con 0x7f75e41563b0 2023-10-10T21:14:26.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2797570204 0 0) 0x7f75d0003570 con 0x7f75e41563b0 2023-10-10T21:14:26.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e415a440 msgr2=0x7f75e40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:26.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e415a440 0x7f75e40acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 >> v2:172.21.15.179:3300/0 conn(0x7f75e4068890 msgr2=0x7f75e40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:26.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 --2- 172.21.15.154:0/2558334882 >> v2:172.21.15.179:3300/0 conn(0x7f75e4068890 0x7f75e40c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e415b250 con 0x7f75e41563b0 2023-10-10T21:14:26.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f75e0001470 con 0x7f75e41563b0 2023-10-10T21:14:26.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.532+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 >> v1:172.21.15.154:6789/0 conn(0x7f75e41563b0 legacy=0x7f75e4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e8b99700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d0003a60 0x7f75d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e8b99700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e8b99700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e415a440 0x7f75d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e415ac90 con 0x7f75d0004810 2023-10-10T21:14:26.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e415af70 con 0x7f75d0003a60 2023-10-10T21:14:26.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d000ba60 con 0x7f75e415a440 2023-10-10T21:14:26.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e939a700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e9b9b700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d0003a60 0x7f75d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75ea39c700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e415a440 0x7f75d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e939a700 1 -- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e415a440 msgr2=0x7f75d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:26.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e939a700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e415a440 0x7f75d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e939a700 1 -- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d0003a60 msgr2=0x7f75d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:26.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e939a700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d0003a60 0x7f75d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e939a700 1 -- 172.21.15.154:0/2558334882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d0003570 con 0x7f75d0004810 2023-10-10T21:14:26.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75ea39c700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e415a440 0x7f75d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:26.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.533+0000 7f75e939a700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75d0004c80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f75d400bee0 tx=0x7f75d400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6d16c88033fce6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:26.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4010c00 con 0x7f75d0004810 2023-10-10T21:14:26.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4010d60 con 0x7f75d0004810 2023-10-10T21:14:26.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75e8b99700 1 -- 172.21.15.154:0/2558334882 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4011680 con 0x7f75d0004810 2023-10-10T21:14:26.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75ebdff700 1 -- 172.21.15.154:0/2558334882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 msgr2=0x7f75d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75ebdff700 1 --2- 172.21.15.154:0/2558334882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75d0004c80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f75d400bee0 tx=0x7f75d400b430 comp rx=0 tx=0).stop 2023-10-10T21:14:26.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75ea39c700 1 -- 172.21.15.154:0/2558334882 reap_dead start 2023-10-10T21:14:26.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75ebdff700 1 -- 172.21.15.154:0/2558334882 shutdown_connections 2023-10-10T21:14:26.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75ebdff700 1 -- 172.21.15.154:0/2558334882 >> 172.21.15.154:0/2558334882 conn(0x7f75e40c8f90 msgr2=0x7f75e40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:26.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75ebdff700 1 -- 172.21.15.154:0/2558334882 shutdown_connections 2023-10-10T21:14:26.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.534+0000 7f75ebdff700 1 -- 172.21.15.154:0/2558334882 wait complete. 2023-10-10T21:14:26.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.536+0000 7f75ebdff700 1 Processor -- start 2023-10-10T21:14:26.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.536+0000 7f75ebdff700 1 -- start start 2023-10-10T21:14:26.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75ebdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75e4147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75ebdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e416ce00 0x7f75e416b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75ebdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e416d270 0x7f75e40afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75ebdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e416c970 con 0x7f75d0004810 2023-10-10T21:14:26.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75ebdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e4147e40 con 0x7f75e416d270 2023-10-10T21:14:26.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75ebdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e416bd60 con 0x7f75e416ce00 2023-10-10T21:14:26.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75e9b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75e4147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75e9b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75e4147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41536/0 (socket says 172.21.15.154:41536) 2023-10-10T21:14:26.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75e9b9b700 1 -- 172.21.15.154:0/2883018997 learned_addr learned my addr 172.21.15.154:0/2883018997 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:26.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75e939a700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e416ce00 0x7f75e416b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75ea39c700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e416d270 0x7f75e40afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75e9b9b700 1 -- 172.21.15.154:0/2883018997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e416ce00 msgr2=0x7f75e416b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75e9b9b700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e416ce00 0x7f75e416b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75e9b9b700 1 -- 172.21.15.154:0/2883018997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e416d270 msgr2=0x7f75e40afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75e9b9b700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e416d270 0x7f75e40afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75e9b9b700 1 -- 172.21.15.154:0/2883018997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e416c040 con 0x7f75d0004810 2023-10-10T21:14:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.537+0000 7f75ea39c700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e416d270 0x7f75e40afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.538+0000 7f75e9b9b700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75e4147900 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f75e0007370 tx=0x7f75e0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.538+0000 7f75d9ffb700 1 -- 172.21.15.154:0/2883018997 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0018030 con 0x7f75d0004810 2023-10-10T21:14:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.538+0000 7f75d9ffb700 1 -- 172.21.15.154:0/2883018997 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e000f9a0 con 0x7f75d0004810 2023-10-10T21:14:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.538+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e416c320 con 0x7f75d0004810 2023-10-10T21:14:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.538+0000 7f75d9ffb700 1 -- 172.21.15.154:0/2883018997 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e000fd40 con 0x7f75d0004810 2023-10-10T21:14:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.538+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e40b1da0 con 0x7f75d0004810 2023-10-10T21:14:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.539+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e416cc50 con 0x7f75d0004810 2023-10-10T21:14:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.540+0000 7f75d9ffb700 1 -- 172.21.15.154:0/2883018997 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f75e001b070 con 0x7f75d0004810 2023-10-10T21:14:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.541+0000 7f75d9ffb700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f75c8067130 0x7f75c80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.541+0000 7f75d9ffb700 1 -- 172.21.15.154:0/2883018997 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f75e0019070 con 0x7f75d0004810 2023-10-10T21:14:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.541+0000 7f75e939a700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f75c8067130 0x7f75c80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.541+0000 7f75e939a700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f75c8067130 0x7f75c80695e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75d400b2c0 tx=0x7f75d401c000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.545+0000 7f75d9ffb700 1 -- 172.21.15.154:0/2883018997 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75e0051810 con 0x7f75d0004810 2023-10-10T21:14:26.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.759+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75e416cab0 con 0x7f75c8067130 2023-10-10T21:14:26.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.767+0000 7f75d9ffb700 1 -- 172.21.15.154:0/2883018997 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f75d400b860 con 0x7f75c8067130 2023-10-10T21:14:26.768 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:26.769 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:35", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:26.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f75c8067130 msgr2=0x7f75c80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f75c8067130 0x7f75c80695e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75d400b2c0 tx=0x7f75d401c000 comp rx=0 tx=0).stop 2023-10-10T21:14:26.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 msgr2=0x7f75e4147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:26.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75e4147900 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f75e0007370 tx=0x7f75e0001e90 comp rx=0 tx=0).stop 2023-10-10T21:14:26.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 shutdown_connections 2023-10-10T21:14:26.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e416d270 0x7f75e40afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d0004810 0x7f75e4147900 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f75c8067130 0x7f75c80695e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 --2- 172.21.15.154:0/2883018997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e416ce00 0x7f75e416b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:26.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 >> 172.21.15.154:0/2883018997 conn(0x7f75e40c8f90 msgr2=0x7f75e40acef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:26.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 shutdown_connections 2023-10-10T21:14:26.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:26.770+0000 7f75ebdff700 1 -- 172.21.15.154:0/2883018997 wait complete. 2023-10-10T21:14:26.788 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:35", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:26.789 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:35', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:26.789 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:26.789 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:26.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:26.790 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-10T21:14:26.828 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:26.829 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:26.829 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:26.829 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:26.829 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:26.830 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:26.830 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:26.830 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:26.830 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:26.830 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:26.831 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:26.832 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_00_UTC', 'scheduled-2023-10-10-21_08_00_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:26.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-10-10T21:14:27.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.056+0000 7f40ea99d700 1 Processor -- start 2023-10-10T21:14:27.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.056+0000 7f40ea99d700 1 -- start start 2023-10-10T21:14:27.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.057+0000 7f40ea99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f40e4153480 0x7f40e40ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.057+0000 7f40ea99d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40e4159dc0 0x7f40e4157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.057+0000 7f40ea99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e40aec90 con 0x7f40e4153850 2023-10-10T21:14:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.057+0000 7f40ea99d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e415a480 con 0x7f40e4159dc0 2023-10-10T21:14:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.057+0000 7f40ea99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40afb40 con 0x7f40e4153480 2023-10-10T21:14:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.057+0000 7f40ea19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40e4159dc0 0x7f40e4157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.058+0000 7f40ea19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40e4159dc0 0x7f40e4157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41550/0 (socket says 172.21.15.154:41550) 2023-10-10T21:14:27.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.058+0000 7f40ea19c700 1 -- 172.21.15.154:0/3854216787 learned_addr learned my addr 172.21.15.154:0/3854216787 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:27.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.058+0000 7f40e999b700 1 --2- 172.21.15.154:0/3854216787 >> v2:172.21.15.179:3300/0 conn(0x7f40e4153480 0x7f40e40ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.058+0000 7f40ea19c700 1 -- 172.21.15.154:0/3854216787 >> v2:172.21.15.179:3300/0 conn(0x7f40e4153480 msgr2=0x7f40e40ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:27.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.058+0000 7f40ea19c700 1 --2- 172.21.15.154:0/3854216787 >> v2:172.21.15.179:3300/0 conn(0x7f40e4153480 0x7f40e40ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.058+0000 7f40ea19c700 1 -- 172.21.15.154:0/3854216787 >> v1:172.21.15.179:6789/0 conn(0x7f40e4153850 legacy=0x7f40e41596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:27.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.058+0000 7f40ea19c700 1 -- 172.21.15.154:0/3854216787 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40afe20 con 0x7f40e4159dc0 2023-10-10T21:14:27.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.058+0000 7f40ea19c700 1 --2- 172.21.15.154:0/3854216787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 0x7f40e4157280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f40e406cf00 tx=0x7f40dc00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bcc90c83763a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:27.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.058+0000 7f40e8999700 1 -- 172.21.15.154:0/3854216787 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00ca00 con 0x7f40e4159dc0 2023-10-10T21:14:27.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40e8999700 1 -- 172.21.15.154:0/3854216787 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc00cb60 con 0x7f40e4159dc0 2023-10-10T21:14:27.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40e8999700 1 -- 172.21.15.154:0/3854216787 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0183f0 con 0x7f40e4159dc0 2023-10-10T21:14:27.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40ea99d700 1 -- 172.21.15.154:0/3854216787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 msgr2=0x7f40e4157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40ea99d700 1 --2- 172.21.15.154:0/3854216787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 0x7f40e4157280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f40e406cf00 tx=0x7f40dc00a3f0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40ea99d700 1 -- 172.21.15.154:0/3854216787 shutdown_connections 2023-10-10T21:14:27.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40ea99d700 1 --2- 172.21.15.154:0/3854216787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 0x7f40e4157280 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40ea99d700 1 --2- 172.21.15.154:0/3854216787 >> v2:172.21.15.179:3300/0 conn(0x7f40e4153480 0x7f40e40ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40ea99d700 1 -- 172.21.15.154:0/3854216787 >> 172.21.15.154:0/3854216787 conn(0x7f40e4068e20 msgr2=0x7f40e40cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:27.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40ea99d700 1 -- 172.21.15.154:0/3854216787 shutdown_connections 2023-10-10T21:14:27.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.059+0000 7f40ea99d700 1 -- 172.21.15.154:0/3854216787 wait complete. 2023-10-10T21:14:27.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.061+0000 7f40ea99d700 1 Processor -- start 2023-10-10T21:14:27.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.061+0000 7f40ea99d700 1 -- start start 2023-10-10T21:14:27.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4153480 0x7f40e4157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4153850 0x7f40e414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 0x7f40e40a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41577a0 con 0x7f40e4159dc0 2023-10-10T21:14:27.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41561c0 con 0x7f40e4153850 2023-10-10T21:14:27.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41564a0 con 0x7f40e4153480 2023-10-10T21:14:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 0x7f40e40a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 0x7f40e40a8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41564/0 (socket says 172.21.15.154:41564) 2023-10-10T21:14:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea19c700 1 -- 172.21.15.154:0/881995107 learned_addr learned my addr 172.21.15.154:0/881995107 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40e999b700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4153480 0x7f40e4157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40e919a700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4153850 0x7f40e414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea19c700 1 -- 172.21.15.154:0/881995107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4153480 msgr2=0x7f40e4157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.062+0000 7f40ea19c700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4153480 0x7f40e4157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40ea19c700 1 -- 172.21.15.154:0/881995107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4153850 msgr2=0x7f40e414eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40ea19c700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4153850 0x7f40e414eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40ea19c700 1 -- 172.21.15.154:0/881995107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc00a690 con 0x7f40e4159dc0 2023-10-10T21:14:27.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40e919a700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4153850 0x7f40e414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:27.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40ea19c700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 0x7f40e40a8ea0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0030c0 tx=0x7f40dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:27.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40d9ffb700 1 -- 172.21.15.154:0/881995107 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc01d070 con 0x7f40e4159dc0 2023-10-10T21:14:27.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40d9ffb700 1 -- 172.21.15.154:0/881995107 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc010600 con 0x7f40e4159dc0 2023-10-10T21:14:27.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e4156780 con 0x7f40e4159dc0 2023-10-10T21:14:27.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40d9ffb700 1 -- 172.21.15.154:0/881995107 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0109a0 con 0x7f40e4159dc0 2023-10-10T21:14:27.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.063+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e4156d40 con 0x7f40e4159dc0 2023-10-10T21:14:27.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.064+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4156f30 con 0x7f40e4159dc0 2023-10-10T21:14:27.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.065+0000 7f40d9ffb700 1 -- 172.21.15.154:0/881995107 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f40dc010d10 con 0x7f40e4159dc0 2023-10-10T21:14:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.066+0000 7f40d9ffb700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40c8067130 0x7f40c80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.066+0000 7f40d9ffb700 1 -- 172.21.15.154:0/881995107 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f40dc085fc0 con 0x7f40e4159dc0 2023-10-10T21:14:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.066+0000 7f40e999b700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40c8067130 0x7f40c80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.067+0000 7f40e999b700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40c8067130 0x7f40c80695e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40e0007620 tx=0x7f40e0009850 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:27.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.070+0000 7f40d9ffb700 1 -- 172.21.15.154:0/881995107 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40dc0b75a0 con 0x7f40e4159dc0 2023-10-10T21:14:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.286+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40e404c3c0 con 0x7f40c8067130 2023-10-10T21:14:27.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.294+0000 7f40d9ffb700 1 -- 172.21.15.154:0/881995107 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f40e404c3c0 con 0x7f40c8067130 2023-10-10T21:14:27.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:27.295 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:36", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:27.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40c8067130 msgr2=0x7f40c80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40c8067130 0x7f40c80695e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40e0007620 tx=0x7f40e0009850 comp rx=0 tx=0).stop 2023-10-10T21:14:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 msgr2=0x7f40e40a8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 0x7f40e40a8ea0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0030c0 tx=0x7f40dc017000 comp rx=0 tx=0).stop 2023-10-10T21:14:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 shutdown_connections 2023-10-10T21:14:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e4159dc0 0x7f40e40a8ea0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f40c8067130 0x7f40c80695e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4153480 0x7f40e4157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 --2- 172.21.15.154:0/881995107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4153850 0x7f40e414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 >> 172.21.15.154:0/881995107 conn(0x7f40e4068e20 msgr2=0x7f40e40acb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 shutdown_connections 2023-10-10T21:14:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.296+0000 7f40ea99d700 1 -- 172.21.15.154:0/881995107 wait complete. 2023-10-10T21:14:27.315 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:36", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:27.315 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:36', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:27.315 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:27.316 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:27.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:27.316 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-10T21:14:27.355 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:27.356 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:27.356 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:27.356 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:27.356 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:27.356 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:27.357 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:27.357 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:27.357 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:27.357 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:27.357 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:27.358 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_00_UTC', 'scheduled-2023-10-10-21_08_00_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:27.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-10-10T21:14:27.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.583+0000 7f75639ff700 1 Processor -- start 2023-10-10T21:14:27.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.584+0000 7f75639ff700 1 -- start start 2023-10-10T21:14:27.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f75639ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 0x7f755c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f75639ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f755c0c8490 0x7f755c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f75639ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f755c069e20 0x7f755c06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f75639ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c0ac030 con 0x7f755c0c8490 2023-10-10T21:14:27.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f75639ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c0ab820 con 0x7f755c069e20 2023-10-10T21:14:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f75639ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c06dbb0 con 0x7f755c069a50 2023-10-10T21:14:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f7560f9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f755c0c8490 0x7f755c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f7560f9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f755c0c8490 0x7f755c15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41576/0 (socket says 172.21.15.154:41576) 2023-10-10T21:14:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f7560f9a700 1 -- 172.21.15.154:0/3050142860 learned_addr learned my addr 172.21.15.154:0/3050142860 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f7561f9c700 1 --2- 172.21.15.154:0/3050142860 >> v2:172.21.15.179:3300/0 conn(0x7f755c069e20 0x7f755c06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f756179b700 1 --2- 172.21.15.154:0/3050142860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 0x7f755c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f7560f9a700 1 -- 172.21.15.154:0/3050142860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 msgr2=0x7f755c0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f7560f9a700 1 --2- 172.21.15.154:0/3050142860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 0x7f755c0c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f7560f9a700 1 -- 172.21.15.154:0/3050142860 >> v2:172.21.15.179:3300/0 conn(0x7f755c069e20 msgr2=0x7f755c06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.585+0000 7f7560f9a700 1 --2- 172.21.15.154:0/3050142860 >> v2:172.21.15.179:3300/0 conn(0x7f755c069e20 0x7f755c06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.586+0000 7f7560f9a700 1 -- 172.21.15.154:0/3050142860 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c15a9d0 con 0x7f755c0c8490 2023-10-10T21:14:27.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.586+0000 7f7560f9a700 1 --2- 172.21.15.154:0/3050142860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 0x7f755c15a490 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f754c0099e0 tx=0x7f754c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbce8c539b86ac2e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:27.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.586+0000 7f7553fff700 1 -- 172.21.15.154:0/3050142860 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00b7e0 con 0x7f755c0c8490 2023-10-10T21:14:27.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.586+0000 7f7553fff700 1 -- 172.21.15.154:0/3050142860 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00b940 con 0x7f755c0c8490 2023-10-10T21:14:27.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.586+0000 7f7553fff700 1 -- 172.21.15.154:0/3050142860 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00bce0 con 0x7f755c0c8490 2023-10-10T21:14:27.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.586+0000 7f75639ff700 1 -- 172.21.15.154:0/3050142860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 msgr2=0x7f755c15a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.586+0000 7f75639ff700 1 --2- 172.21.15.154:0/3050142860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 0x7f755c15a490 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f754c0099e0 tx=0x7f754c009250 comp rx=0 tx=0).stop 2023-10-10T21:14:27.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.587+0000 7f75639ff700 1 -- 172.21.15.154:0/3050142860 shutdown_connections 2023-10-10T21:14:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.587+0000 7f75639ff700 1 --2- 172.21.15.154:0/3050142860 >> v2:172.21.15.179:3300/0 conn(0x7f755c069e20 0x7f755c06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.587+0000 7f75639ff700 1 --2- 172.21.15.154:0/3050142860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 0x7f755c0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.587+0000 7f75639ff700 1 --2- 172.21.15.154:0/3050142860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 0x7f755c15a490 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.587+0000 7f75639ff700 1 -- 172.21.15.154:0/3050142860 >> 172.21.15.154:0/3050142860 conn(0x7f755c0c8f90 msgr2=0x7f755c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.587+0000 7f75639ff700 1 -- 172.21.15.154:0/3050142860 shutdown_connections 2023-10-10T21:14:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.587+0000 7f75639ff700 1 -- 172.21.15.154:0/3050142860 wait complete. 2023-10-10T21:14:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.588+0000 7f75639ff700 1 Processor -- start 2023-10-10T21:14:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.588+0000 7f75639ff700 1 -- start start 2023-10-10T21:14:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f75639ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 0x7f755c157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f75639ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f755c069e20 0x7f755c169600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f75639ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 0x7f755c158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f75639ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c159200 con 0x7f755c0c8490 2023-10-10T21:14:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f75639ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0aa3b0 con 0x7f755c069e20 2023-10-10T21:14:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f75639ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0a9a80 con 0x7f755c069a50 2023-10-10T21:14:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f7561f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 0x7f755c158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f7561f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 0x7f755c158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41592/0 (socket says 172.21.15.154:41592) 2023-10-10T21:14:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f7561f9c700 1 -- 172.21.15.154:0/3014887214 learned_addr learned my addr 172.21.15.154:0/3014887214 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.589+0000 7f756179b700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 0x7f755c157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f7560f9a700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f755c069e20 0x7f755c169600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f7561f9c700 1 -- 172.21.15.154:0/3014887214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 msgr2=0x7f755c157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f7561f9c700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 0x7f755c157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f7561f9c700 1 -- 172.21.15.154:0/3014887214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f755c069e20 msgr2=0x7f755c169600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f7561f9c700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f755c069e20 0x7f755c169600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f7561f9c700 1 -- 172.21.15.154:0/3014887214 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0094f0 con 0x7f755c0c8490 2023-10-10T21:14:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f7561f9c700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 0x7f755c158970 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7554009fa0 tx=0x7f7554009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f75517fa700 1 -- 172.21.15.154:0/3014887214 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400ebc0 con 0x7f755c0c8490 2023-10-10T21:14:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f75517fa700 1 -- 172.21.15.154:0/3014887214 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755400ed20 con 0x7f755c0c8490 2023-10-10T21:14:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f75517fa700 1 -- 172.21.15.154:0/3014887214 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554014670 con 0x7f755c0c8490 2023-10-10T21:14:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c0a9d60 con 0x7f755c0c8490 2023-10-10T21:14:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.590+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c158eb0 con 0x7f755c0c8490 2023-10-10T21:14:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.591+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c0aa520 con 0x7f755c0c8490 2023-10-10T21:14:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.592+0000 7f75517fa700 1 -- 172.21.15.154:0/3014887214 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f75540149e0 con 0x7f755c0c8490 2023-10-10T21:14:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.593+0000 7f75517fa700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7540067130 0x7f75400695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.593+0000 7f75517fa700 1 -- 172.21.15.154:0/3014887214 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f7554085000 con 0x7f755c0c8490 2023-10-10T21:14:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.593+0000 7f756179b700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7540067130 0x7f75400695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.594+0000 7f756179b700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7540067130 0x7f75400695e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7558006fd0 tx=0x7f7558008040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.597+0000 7f75517fa700 1 -- 172.21.15.154:0/3014887214 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7554051ef0 con 0x7f755c0c8490 2023-10-10T21:14:27.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.812+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f755c0718b0 con 0x7f7540067130 2023-10-10T21:14:27.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.820+0000 7f75517fa700 1 -- 172.21.15.154:0/3014887214 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f755c0718b0 con 0x7f7540067130 2023-10-10T21:14:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:27.822 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:37", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7540067130 msgr2=0x7f75400695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7540067130 0x7f75400695e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7558006fd0 tx=0x7f7558008040 comp rx=0 tx=0).stop 2023-10-10T21:14:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 msgr2=0x7f755c158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 0x7f755c158970 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7554009fa0 tx=0x7f7554009900 comp rx=0 tx=0).stop 2023-10-10T21:14:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 shutdown_connections 2023-10-10T21:14:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f755c0c8490 0x7f755c158970 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f7540067130 0x7f75400695e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f755c069a50 0x7f755c157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 --2- 172.21.15.154:0/3014887214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f755c069e20 0x7f755c169600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 >> 172.21.15.154:0/3014887214 conn(0x7f755c0c8f90 msgr2=0x7f755c0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 shutdown_connections 2023-10-10T21:14:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:27.823+0000 7f75639ff700 1 -- 172.21.15.154:0/3014887214 wait complete. 2023-10-10T21:14:27.842 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:37", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:27.842 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:37', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:27.842 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:27.843 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:27.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:27.844 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-10T21:14:27.883 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:27.884 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:27.884 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:27.884 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:27.884 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:27.884 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:27.885 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:27.885 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:27.885 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:27.885 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:27.885 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:27.888 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_00_UTC', 'scheduled-2023-10-10-21_08_00_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:27.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-10-10T21:14:28.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.112+0000 7fe5273ff700 1 Processor -- start 2023-10-10T21:14:28.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.113+0000 7fe5273ff700 1 -- start start 2023-10-10T21:14:28.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe5273ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 0x7fe520156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe5273ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe520068890 0x7fe5200c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe5273ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52015a9b0 con 0x7fe52015a440 2023-10-10T21:14:28.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe5273ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52015ac90 con 0x7fe520068890 2023-10-10T21:14:28.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe5273ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52015af70 con 0x7fe5201563b0 2023-10-10T21:14:28.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe52499a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe52015a440 0x7fe5200acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42686/0 (socket says 172.21.15.154:42686) 2023-10-10T21:14:28.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe52499a700 1 -- 172.21.15.154:0/1347490084 learned_addr learned my addr 172.21.15.154:0/1347490084 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:28.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe52599c700 1 --2- 172.21.15.154:0/1347490084 >> v2:172.21.15.179:3300/0 conn(0x7fe520068890 0x7fe5200c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe52519b700 1 --2- 172.21.15.154:0/1347490084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 0x7fe520156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.114+0000 7fe517fff700 1 -- 172.21.15.154:0/1347490084 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176501155 0 0) 0x7fe52015a9b0 con 0x7fe52015a440 2023-10-10T21:14:28.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.115+0000 7fe517fff700 1 -- 172.21.15.154:0/1347490084 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe50c003570 con 0x7fe52015a440 2023-10-10T21:14:28.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.115+0000 7fe52599c700 1 -- 172.21.15.154:0/1347490084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 msgr2=0x7fe520156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:28.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.115+0000 7fe52599c700 1 --2- 172.21.15.154:0/1347490084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 0x7fe520156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.115+0000 7fe52599c700 1 -- 172.21.15.154:0/1347490084 >> v1:172.21.15.154:6789/0 conn(0x7fe52015a440 legacy=0x7fe5200acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.115+0000 7fe52599c700 1 -- 172.21.15.154:0/1347490084 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52015b250 con 0x7fe520068890 2023-10-10T21:14:28.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.115+0000 7fe52599c700 1 --2- 172.21.15.154:0/1347490084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe520068890 0x7fe5200c8230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe518009e60 tx=0x7fe518009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7299035d707820 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:28.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.115+0000 7fe517fff700 1 -- 172.21.15.154:0/1347490084 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800e070 con 0x7fe520068890 2023-10-10T21:14:28.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.115+0000 7fe517fff700 1 -- 172.21.15.154:0/1347490084 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51800bab0 con 0x7fe520068890 2023-10-10T21:14:28.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.115+0000 7fe517fff700 1 -- 172.21.15.154:0/1347490084 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800be70 con 0x7fe520068890 2023-10-10T21:14:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.116+0000 7fe5273ff700 1 -- 172.21.15.154:0/1347490084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe520068890 msgr2=0x7fe5200c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.116+0000 7fe5273ff700 1 --2- 172.21.15.154:0/1347490084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe520068890 0x7fe5200c8230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe518009e60 tx=0x7fe518009780 comp rx=0 tx=0).stop 2023-10-10T21:14:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.116+0000 7fe5273ff700 1 -- 172.21.15.154:0/1347490084 shutdown_connections 2023-10-10T21:14:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.116+0000 7fe5273ff700 1 --2- 172.21.15.154:0/1347490084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe520068890 0x7fe5200c8230 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.116+0000 7fe5273ff700 1 --2- 172.21.15.154:0/1347490084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 0x7fe520156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.116+0000 7fe5273ff700 1 -- 172.21.15.154:0/1347490084 >> 172.21.15.154:0/1347490084 conn(0x7fe5200c8f90 msgr2=0x7fe5200c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:28.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.116+0000 7fe5273ff700 1 -- 172.21.15.154:0/1347490084 shutdown_connections 2023-10-10T21:14:28.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.116+0000 7fe5273ff700 1 -- 172.21.15.154:0/1347490084 wait complete. 2023-10-10T21:14:28.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.117+0000 7fe5273ff700 1 Processor -- start 2023-10-10T21:14:28.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.117+0000 7fe5273ff700 1 -- start start 2023-10-10T21:14:28.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.118+0000 7fe5273ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe520068890 0x7fe520157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.118+0000 7fe5273ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 0x7fe5201583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.118+0000 7fe5273ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015a440 0x7fe520169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.118+0000 7fe5273ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe520158bf0 con 0x7fe52015a440 2023-10-10T21:14:28.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.118+0000 7fe5273ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52016b9c0 con 0x7fe520068890 2023-10-10T21:14:28.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.118+0000 7fe5273ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52016b090 con 0x7fe5201563b0 2023-10-10T21:14:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52599c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015a440 0x7fe520169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52599c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015a440 0x7fe520169d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41600/0 (socket says 172.21.15.154:41600) 2023-10-10T21:14:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52599c700 1 -- 172.21.15.154:0/3835824840 learned_addr learned my addr 172.21.15.154:0/3835824840 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52519b700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe520068890 0x7fe520157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52499a700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 0x7fe5201583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52599c700 1 -- 172.21.15.154:0/3835824840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 msgr2=0x7fe5201583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52599c700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 0x7fe5201583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52599c700 1 -- 172.21.15.154:0/3835824840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe520068890 msgr2=0x7fe520157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52599c700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe520068890 0x7fe520157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52599c700 1 -- 172.21.15.154:0/3835824840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518009a20 con 0x7fe52015a440 2023-10-10T21:14:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.119+0000 7fe52599c700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015a440 0x7fe520169d00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe52006bbb0 tx=0x7fe518019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.120+0000 7fe5157fa700 1 -- 172.21.15.154:0/3835824840 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518012e10 con 0x7fe52015a440 2023-10-10T21:14:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.120+0000 7fe5157fa700 1 -- 172.21.15.154:0/3835824840 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518027470 con 0x7fe52015a440 2023-10-10T21:14:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.120+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52016b370 con 0x7fe52015a440 2023-10-10T21:14:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.120+0000 7fe5157fa700 1 -- 172.21.15.154:0/3835824840 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518027830 con 0x7fe52015a440 2023-10-10T21:14:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.120+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe520158900 con 0x7fe52015a440 2023-10-10T21:14:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.121+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5200718b0 con 0x7fe52015a440 2023-10-10T21:14:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.122+0000 7fe5157fa700 1 -- 172.21.15.154:0/3835824840 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fe518024070 con 0x7fe52015a440 2023-10-10T21:14:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.122+0000 7fe5157fa700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe504067130 0x7fe5040695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.122+0000 7fe5157fa700 1 -- 172.21.15.154:0/3835824840 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe5180872e0 con 0x7fe52015a440 2023-10-10T21:14:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.123+0000 7fe52519b700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe504067130 0x7fe5040695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.123+0000 7fe52519b700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe504067130 0x7fe5040695e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe5200687f0 tx=0x7fe51c0091a0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.127+0000 7fe5157fa700 1 -- 172.21.15.154:0/3835824840 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5180541d0 con 0x7fe52015a440 2023-10-10T21:14:28.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.348+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe52006d6a0 con 0x7fe504067130 2023-10-10T21:14:28.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.356+0000 7fe5157fa700 1 -- 172.21.15.154:0/3835824840 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe52006d6a0 con 0x7fe504067130 2023-10-10T21:14:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:28.357 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:37", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:28.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe504067130 msgr2=0x7fe5040695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe504067130 0x7fe5040695e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe5200687f0 tx=0x7fe51c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015a440 msgr2=0x7fe520169d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015a440 0x7fe520169d00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe52006bbb0 tx=0x7fe518019000 comp rx=0 tx=0).stop 2023-10-10T21:14:28.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 shutdown_connections 2023-10-10T21:14:28.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015a440 0x7fe520169d00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe520068890 0x7fe520157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe504067130 0x7fe5040695e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 --2- 172.21.15.154:0/3835824840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5201563b0 0x7fe5201583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 >> 172.21.15.154:0/3835824840 conn(0x7fe5200c8f90 msgr2=0x7fe52006dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.358+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 shutdown_connections 2023-10-10T21:14:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.359+0000 7fe5273ff700 1 -- 172.21.15.154:0/3835824840 wait complete. 2023-10-10T21:14:28.377 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:37", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:28.377 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:37', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:28.377 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:28.378 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:28.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:28.378 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-10T21:14:28.417 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:28.417 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:28.417 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:28.417 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_01_UTC 2023-10-10T21:14:28.418 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:28.418 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:28.418 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:28.418 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:28.418 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:28.419 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:28.419 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:28.420 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_01_UTC', 'scheduled-2023-10-10-21_08_00_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:28.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-10-10T21:14:28.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.646+0000 7f70be1ff700 1 Processor -- start 2023-10-10T21:14:28.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.647+0000 7f70be1ff700 1 -- start start 2023-10-10T21:14:28.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.648+0000 7f70be1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70b8157740 0x7f70b80adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.648+0000 7f70be1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 0x7f70b8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.648+0000 7f70be1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b806dc20 con 0x7f70b80688d0 2023-10-10T21:14:28.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.648+0000 7f70be1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80acc00 con 0x7f70b8157740 2023-10-10T21:14:28.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.648+0000 7f70be1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b806d6a0 con 0x7f70b80b2100 2023-10-10T21:14:28.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.648+0000 7f70b7fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f70b80688d0 0x7f70b8069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42700/0 (socket says 172.21.15.154:42700) 2023-10-10T21:14:28.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.648+0000 7f70b7fff700 1 -- 172.21.15.154:0/2481583557 learned_addr learned my addr 172.21.15.154:0/2481583557 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:28.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.648+0000 7f70b77fe700 1 --2- 172.21.15.154:0/2481583557 >> v2:172.21.15.154:3300/0 conn(0x7f70b8157740 0x7f70b80adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.648+0000 7f70b6ffd700 1 --2- 172.21.15.154:0/2481583557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 0x7f70b8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b67fc700 1 -- 172.21.15.154:0/2481583557 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441545876 0 0) 0x7f70b806dc20 con 0x7f70b80688d0 2023-10-10T21:14:28.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b67fc700 1 -- 172.21.15.154:0/2481583557 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a0003570 con 0x7f70b80688d0 2023-10-10T21:14:28.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b77fe700 1 -- 172.21.15.154:0/2481583557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 msgr2=0x7f70b8068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:28.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b77fe700 1 --2- 172.21.15.154:0/2481583557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 0x7f70b8068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b77fe700 1 -- 172.21.15.154:0/2481583557 >> v1:172.21.15.154:6789/0 conn(0x7f70b80688d0 legacy=0x7f70b8069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b77fe700 1 -- 172.21.15.154:0/2481583557 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80ae910 con 0x7f70b8157740 2023-10-10T21:14:28.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b77fe700 1 --2- 172.21.15.154:0/2481583557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 0x7f70b80adfc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f70a80098e0 tx=0x7f70a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ab297523b23a51 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:28.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b67fc700 1 -- 172.21.15.154:0/2481583557 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8011630 con 0x7f70b8157740 2023-10-10T21:14:28.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b67fc700 1 -- 172.21.15.154:0/2481583557 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8011790 con 0x7f70b8157740 2023-10-10T21:14:28.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.649+0000 7f70b67fc700 1 -- 172.21.15.154:0/2481583557 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8011b30 con 0x7f70b8157740 2023-10-10T21:14:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.650+0000 7f70be1ff700 1 -- 172.21.15.154:0/2481583557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 msgr2=0x7f70b80adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.650+0000 7f70be1ff700 1 --2- 172.21.15.154:0/2481583557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 0x7f70b80adfc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f70a80098e0 tx=0x7f70a80091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.650+0000 7f70be1ff700 1 -- 172.21.15.154:0/2481583557 shutdown_connections 2023-10-10T21:14:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.650+0000 7f70be1ff700 1 --2- 172.21.15.154:0/2481583557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 0x7f70b80adfc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.650+0000 7f70be1ff700 1 --2- 172.21.15.154:0/2481583557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 0x7f70b8068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.650+0000 7f70be1ff700 1 -- 172.21.15.154:0/2481583557 >> 172.21.15.154:0/2481583557 conn(0x7f70b80c8f90 msgr2=0x7f70b80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:28.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.650+0000 7f70be1ff700 1 -- 172.21.15.154:0/2481583557 shutdown_connections 2023-10-10T21:14:28.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.650+0000 7f70be1ff700 1 -- 172.21.15.154:0/2481583557 wait complete. 2023-10-10T21:14:28.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.651+0000 7f70be1ff700 1 Processor -- start 2023-10-10T21:14:28.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.651+0000 7f70be1ff700 1 -- start start 2023-10-10T21:14:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.652+0000 7f70be1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b80688d0 0x7f70b815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.652+0000 7f70be1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 0x7f70b815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.652+0000 7f70be1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 0x7f70b80ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.652+0000 7f70be1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b815f270 con 0x7f70b8157740 2023-10-10T21:14:28.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.652+0000 7f70be1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b815cb80 con 0x7f70b80688d0 2023-10-10T21:14:28.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.652+0000 7f70be1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b815ac70 con 0x7f70b80b2100 2023-10-10T21:14:28.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 0x7f70b80ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 0x7f70b80ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41622/0 (socket says 172.21.15.154:41622) 2023-10-10T21:14:28.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b7fff700 1 -- 172.21.15.154:0/1304058752 learned_addr learned my addr 172.21.15.154:0/1304058752 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:28.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b77fe700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b80688d0 0x7f70b815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b6ffd700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 0x7f70b815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b7fff700 1 -- 172.21.15.154:0/1304058752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 msgr2=0x7f70b815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b7fff700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 0x7f70b815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b7fff700 1 -- 172.21.15.154:0/1304058752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b80688d0 msgr2=0x7f70b815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b7fff700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b80688d0 0x7f70b815ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b7fff700 1 -- 172.21.15.154:0/1304058752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a8009420 con 0x7f70b8157740 2023-10-10T21:14:28.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.653+0000 7f70b7fff700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 0x7f70b80ab800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f70b0001460 tx=0x7f70b0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:28.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.654+0000 7f709f7fe700 1 -- 172.21.15.154:0/1304058752 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b000a870 con 0x7f70b8157740 2023-10-10T21:14:28.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.654+0000 7f709f7fe700 1 -- 172.21.15.154:0/1304058752 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b000a9d0 con 0x7f70b8157740 2023-10-10T21:14:28.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.654+0000 7f709f7fe700 1 -- 172.21.15.154:0/1304058752 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b000ad50 con 0x7f70b8157740 2023-10-10T21:14:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.654+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b815af50 con 0x7f70b8157740 2023-10-10T21:14:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.654+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b815c810 con 0x7f70b8157740 2023-10-10T21:14:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.655+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b80718b0 con 0x7f70b8157740 2023-10-10T21:14:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.656+0000 7f709f7fe700 1 -- 172.21.15.154:0/1304058752 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f70b0007300 con 0x7f70b8157740 2023-10-10T21:14:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.657+0000 7f709f7fe700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f70a4067130 0x7f70a40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.657+0000 7f709f7fe700 1 -- 172.21.15.154:0/1304058752 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f70b0084d40 con 0x7f70b8157740 2023-10-10T21:14:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.657+0000 7f70b77fe700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f70a4067130 0x7f70a40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.658+0000 7f70b77fe700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f70a4067130 0x7f70a40695e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f70a80091e0 tx=0x7f70a8017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.661+0000 7f709f7fe700 1 -- 172.21.15.154:0/1304058752 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70b0051b80 con 0x7f70b8157740 2023-10-10T21:14:28.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.876+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70b80678d0 con 0x7f70a4067130 2023-10-10T21:14:28.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.885+0000 7f709f7fe700 1 -- 172.21.15.154:0/1304058752 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f70b80678d0 con 0x7f70a4067130 2023-10-10T21:14:28.886 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:28.887 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:38", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:28.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f70a4067130 msgr2=0x7f70a40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f70a4067130 0x7f70a40695e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f70a80091e0 tx=0x7f70a8017000 comp rx=0 tx=0).stop 2023-10-10T21:14:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 msgr2=0x7f70b80ab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 0x7f70b80ab800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f70b0001460 tx=0x7f70b0001a40 comp rx=0 tx=0).stop 2023-10-10T21:14:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 shutdown_connections 2023-10-10T21:14:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70b8157740 0x7f70b80ab800 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b80688d0 0x7f70b815ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f70a4067130 0x7f70a40695e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 --2- 172.21.15.154:0/1304058752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b80b2100 0x7f70b815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.887+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 >> 172.21.15.154:0/1304058752 conn(0x7f70b80c8f90 msgr2=0x7f70b815f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.888+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 shutdown_connections 2023-10-10T21:14:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:28.888+0000 7f70be1ff700 1 -- 172.21.15.154:0/1304058752 wait complete. 2023-10-10T21:14:28.906 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:38", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:28.906 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:38', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:28.907 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:28.907 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:28.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:28.908 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-10T21:14:28.946 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:28.947 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:28.947 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:28.948 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:28.948 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:28.948 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:28.949 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:28.949 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:28.949 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:28.950 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:28.950 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:28.952 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_00_UTC', 'scheduled-2023-10-10-21_08_00_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:28.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-10-10T21:14:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.178+0000 7f30dffff700 1 Processor -- start 2023-10-10T21:14:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.178+0000 7f30dffff700 1 -- start start 2023-10-10T21:14:29.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.180+0000 7f30dffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0159dc0 0x7f30e0160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.180+0000 7f30dffff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e015a480 con 0x7f30e0153480 2023-10-10T21:14:29.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.180+0000 7f30dffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e00afb40 con 0x7f30e0153850 2023-10-10T21:14:29.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.180+0000 7f30dffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00afe20 con 0x7f30e0159dc0 2023-10-10T21:14:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.180+0000 7f30deffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f30e0153480 0x7f30e00ae750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42714/0 (socket says 172.21.15.154:42714) 2023-10-10T21:14:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.180+0000 7f30deffd700 1 -- 172.21.15.154:0/3194393065 learned_addr learned my addr 172.21.15.154:0/3194393065 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.180+0000 7f30df7fe700 1 --2- 172.21.15.154:0/3194393065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0159dc0 0x7f30e0160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.180+0000 7f30de7fc700 1 -- 172.21.15.154:0/3194393065 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577411842 0 0) 0x7f30e015a480 con 0x7f30e0153480 2023-10-10T21:14:29.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.180+0000 7f30de7fc700 1 -- 172.21.15.154:0/3194393065 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30cc004680 con 0x7f30e0153480 2023-10-10T21:14:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30de7fc700 1 -- 172.21.15.154:0/3194393065 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835675075 0 0) 0x7f30e00afb40 con 0x7f30e0153850 2023-10-10T21:14:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30de7fc700 1 -- 172.21.15.154:0/3194393065 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e015a480 con 0x7f30e0153850 2023-10-10T21:14:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30df7fe700 1 -- 172.21.15.154:0/3194393065 >> v1:172.21.15.179:6789/0 conn(0x7f30e0153850 legacy=0x7f30e01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30df7fe700 1 -- 172.21.15.154:0/3194393065 >> v1:172.21.15.154:6789/0 conn(0x7f30e0153480 legacy=0x7f30e00ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30de7fc700 1 -- 172.21.15.154:0/3194393065 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3725637529 0 0) 0x7f30cc004680 con 0x7f30e0153480 2023-10-10T21:14:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30df7fe700 1 -- 172.21.15.154:0/3194393065 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e00b0100 con 0x7f30e0159dc0 2023-10-10T21:14:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30df7fe700 1 --2- 172.21.15.154:0/3194393065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0159dc0 0x7f30e0160a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009e90 tx=0x7f30d8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a46cf7f74a7ee9d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30de7fc700 1 -- 172.21.15.154:0/3194393065 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800e070 con 0x7f30e0159dc0 2023-10-10T21:14:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30de7fc700 1 -- 172.21.15.154:0/3194393065 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800b870 con 0x7f30e0159dc0 2023-10-10T21:14:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.181+0000 7f30de7fc700 1 -- 172.21.15.154:0/3194393065 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d0001470 con 0x7f30e0159dc0 2023-10-10T21:14:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.182+0000 7f30dffff700 1 -- 172.21.15.154:0/3194393065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0159dc0 msgr2=0x7f30e0160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.182+0000 7f30dffff700 1 --2- 172.21.15.154:0/3194393065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0159dc0 0x7f30e0160a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009e90 tx=0x7f30d8009780 comp rx=0 tx=0).stop 2023-10-10T21:14:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.182+0000 7f30dffff700 1 -- 172.21.15.154:0/3194393065 shutdown_connections 2023-10-10T21:14:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.182+0000 7f30dffff700 1 --2- 172.21.15.154:0/3194393065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0159dc0 0x7f30e0160a50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.182+0000 7f30dffff700 1 -- 172.21.15.154:0/3194393065 >> 172.21.15.154:0/3194393065 conn(0x7f30e0068e20 msgr2=0x7f30e00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.182+0000 7f30dffff700 1 -- 172.21.15.154:0/3194393065 shutdown_connections 2023-10-10T21:14:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.182+0000 7f30dffff700 1 -- 172.21.15.154:0/3194393065 wait complete. 2023-10-10T21:14:29.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.183+0000 7f30dffff700 1 Processor -- start 2023-10-10T21:14:29.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.184+0000 7f30dffff700 1 -- start start 2023-10-10T21:14:29.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.184+0000 7f30dffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0153480 0x7f30e00ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.184+0000 7f30dffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30e0153850 0x7f30e014ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30dffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e0159dc0 0x7f30e006ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30dffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00c9680 con 0x7f30e0159dc0 2023-10-10T21:14:29.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30dffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00ca670 con 0x7f30e0153850 2023-10-10T21:14:29.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30dffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00c8790 con 0x7f30e0153480 2023-10-10T21:14:29.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30df7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e0159dc0 0x7f30e006ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30df7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e0159dc0 0x7f30e006ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41632/0 (socket says 172.21.15.154:41632) 2023-10-10T21:14:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30df7fe700 1 -- 172.21.15.154:0/63653259 learned_addr learned my addr 172.21.15.154:0/63653259 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30deffd700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0153480 0x7f30e00ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30d7fff700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30e0153850 0x7f30e014ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30df7fe700 1 -- 172.21.15.154:0/63653259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0153480 msgr2=0x7f30e00ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30df7fe700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0153480 0x7f30e00ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30df7fe700 1 -- 172.21.15.154:0/63653259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30e0153850 msgr2=0x7f30e014ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30df7fe700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30e0153850 0x7f30e014ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30df7fe700 1 -- 172.21.15.154:0/63653259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d8009a20 con 0x7f30e0159dc0 2023-10-10T21:14:29.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.185+0000 7f30df7fe700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e0159dc0 0x7f30e006ea10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f30d80097c0 tx=0x7f30d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:29.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.186+0000 7f30d6ffd700 1 -- 172.21.15.154:0/63653259 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8012bb0 con 0x7f30e0159dc0 2023-10-10T21:14:29.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.186+0000 7f30d6ffd700 1 -- 172.21.15.154:0/63653259 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d8012d30 con 0x7f30e0159dc0 2023-10-10T21:14:29.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.186+0000 7f30d6ffd700 1 -- 172.21.15.154:0/63653259 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8012ea0 con 0x7f30e0159dc0 2023-10-10T21:14:29.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.186+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e00c8a70 con 0x7f30e0159dc0 2023-10-10T21:14:29.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.186+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e00c9030 con 0x7f30e0159dc0 2023-10-10T21:14:29.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.187+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e014df60 con 0x7f30e0159dc0 2023-10-10T21:14:29.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.188+0000 7f30d6ffd700 1 -- 172.21.15.154:0/63653259 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f30d801d440 con 0x7f30e0159dc0 2023-10-10T21:14:29.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.189+0000 7f30d6ffd700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f30c0067130 0x7f30c00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.189+0000 7f30d6ffd700 1 -- 172.21.15.154:0/63653259 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f30d8086cc0 con 0x7f30e0159dc0 2023-10-10T21:14:29.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.189+0000 7f30deffd700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f30c0067130 0x7f30c00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.190+0000 7f30deffd700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f30c0067130 0x7f30c00695e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30d00011e0 tx=0x7f30d0001620 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:29.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.193+0000 7f30d6ffd700 1 -- 172.21.15.154:0/63653259 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30d808d080 con 0x7f30e0159dc0 2023-10-10T21:14:29.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.411+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30e004c3c0 con 0x7f30c0067130 2023-10-10T21:14:29.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.420+0000 7f30d6ffd700 1 -- 172.21.15.154:0/63653259 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f30e004c3c0 con 0x7f30c0067130 2023-10-10T21:14:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:29.422 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:38", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:29.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f30c0067130 msgr2=0x7f30c00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f30c0067130 0x7f30c00695e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30d00011e0 tx=0x7f30d0001620 comp rx=0 tx=0).stop 2023-10-10T21:14:29.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e0159dc0 msgr2=0x7f30e006ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e0159dc0 0x7f30e006ea10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f30d80097c0 tx=0x7f30d8017000 comp rx=0 tx=0).stop 2023-10-10T21:14:29.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 shutdown_connections 2023-10-10T21:14:29.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e0159dc0 0x7f30e006ea10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f30c0067130 0x7f30c00695e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30e0153480 0x7f30e00ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 --2- 172.21.15.154:0/63653259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30e0153850 0x7f30e014ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.422+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 >> 172.21.15.154:0/63653259 conn(0x7f30e0068e20 msgr2=0x7f30e00ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:29.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.423+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 shutdown_connections 2023-10-10T21:14:29.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.423+0000 7f30dffff700 1 -- 172.21.15.154:0/63653259 wait complete. 2023-10-10T21:14:29.441 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:38", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:29.442 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:38', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:29.442 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:29.442 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:29.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:29.443 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-10T21:14:29.481 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:29.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:29.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:29.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:29.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_01_UTC 2023-10-10T21:14:29.483 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:29.483 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:29.483 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:29.483 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:29.483 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:29.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:29.485 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_00_UTC', 'scheduled-2023-10-10-21_08_01_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:29.485 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-10-10T21:14:29.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.709+0000 7fb0acbff700 1 Processor -- start 2023-10-10T21:14:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.709+0000 7fb0acbff700 1 -- start start 2023-10-10T21:14:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0acbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a81563b0 0x7fb0a8156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0acbff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0a815a440 0x7fb0a80acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0acbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a815a9b0 con 0x7fb0a8068890 2023-10-10T21:14:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0acbff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a815ac90 con 0x7fb0a815a440 2023-10-10T21:14:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0acbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a815af70 con 0x7fb0a81563b0 2023-10-10T21:14:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0a5d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0a815a440 0x7fb0a80acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0a6d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb0a8068890 0x7fb0a80c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42726/0 (socket says 172.21.15.154:42726) 2023-10-10T21:14:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0a6d9d700 1 -- 172.21.15.154:0/2373465845 learned_addr learned my addr 172.21.15.154:0/2373465845 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0a659c700 1 --2- 172.21.15.154:0/2373465845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a81563b0 0x7fb0a8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0a559a700 1 -- 172.21.15.154:0/2373465845 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003275929 0 0) 0x7fb0a815a9b0 con 0x7fb0a8068890 2023-10-10T21:14:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0a5d9b700 1 -- 172.21.15.154:0/2373465845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a81563b0 msgr2=0x7fb0a8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0a5d9b700 1 --2- 172.21.15.154:0/2373465845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a81563b0 0x7fb0a8156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0a5d9b700 1 -- 172.21.15.154:0/2373465845 >> v1:172.21.15.154:6789/0 conn(0x7fb0a8068890 legacy=0x7fb0a80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.711+0000 7fb0a5d9b700 1 -- 172.21.15.154:0/2373465845 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a815b250 con 0x7fb0a815a440 2023-10-10T21:14:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.712+0000 7fb0a5d9b700 1 --2- 172.21.15.154:0/2373465845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 0x7fb0a80acf30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0098e0 tx=0x7fb09c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5115c355934090fc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.712+0000 7fb0a559a700 1 -- 172.21.15.154:0/2373465845 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00b640 con 0x7fb0a815a440 2023-10-10T21:14:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.712+0000 7fb0a559a700 1 -- 172.21.15.154:0/2373465845 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00b7a0 con 0x7fb0a815a440 2023-10-10T21:14:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.712+0000 7fb0a559a700 1 -- 172.21.15.154:0/2373465845 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00bb40 con 0x7fb0a815a440 2023-10-10T21:14:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.712+0000 7fb0acbff700 1 -- 172.21.15.154:0/2373465845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 msgr2=0x7fb0a80acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.712+0000 7fb0acbff700 1 --2- 172.21.15.154:0/2373465845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 0x7fb0a80acf30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0098e0 tx=0x7fb09c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.713+0000 7fb0acbff700 1 -- 172.21.15.154:0/2373465845 shutdown_connections 2023-10-10T21:14:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.713+0000 7fb0acbff700 1 --2- 172.21.15.154:0/2373465845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a81563b0 0x7fb0a8156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.713+0000 7fb0acbff700 1 --2- 172.21.15.154:0/2373465845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 0x7fb0a80acf30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.713+0000 7fb0acbff700 1 -- 172.21.15.154:0/2373465845 >> 172.21.15.154:0/2373465845 conn(0x7fb0a80c8f90 msgr2=0x7fb0a80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.713+0000 7fb0acbff700 1 -- 172.21.15.154:0/2373465845 shutdown_connections 2023-10-10T21:14:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.713+0000 7fb0acbff700 1 -- 172.21.15.154:0/2373465845 wait complete. 2023-10-10T21:14:29.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.714+0000 7fb0acbff700 1 Processor -- start 2023-10-10T21:14:29.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.714+0000 7fb0acbff700 1 -- start start 2023-10-10T21:14:29.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0acbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a8068890 0x7fb0a80cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0acbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a81563b0 0x7fb0a814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0acbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 0x7fb0a80c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0acbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80cb390 con 0x7fb0a815a440 2023-10-10T21:14:29.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0acbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80cbd60 con 0x7fb0a81563b0 2023-10-10T21:14:29.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0acbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80ca780 con 0x7fb0a8068890 2023-10-10T21:14:29.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0a6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 0x7fb0a80c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0a6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 0x7fb0a80c21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41646/0 (socket says 172.21.15.154:41646) 2023-10-10T21:14:29.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0a6d9d700 1 -- 172.21.15.154:0/3724784877 learned_addr learned my addr 172.21.15.154:0/3724784877 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:29.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0a5d9b700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a81563b0 0x7fb0a814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.715+0000 7fb0a659c700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a8068890 0x7fb0a80cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0a6d9d700 1 -- 172.21.15.154:0/3724784877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a8068890 msgr2=0x7fb0a80cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0a6d9d700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a8068890 0x7fb0a80cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0a6d9d700 1 -- 172.21.15.154:0/3724784877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a81563b0 msgr2=0x7fb0a814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0a6d9d700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a81563b0 0x7fb0a814cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0a6d9d700 1 -- 172.21.15.154:0/3724784877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009420 con 0x7fb0a815a440 2023-10-10T21:14:29.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0a6d9d700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 0x7fb0a80c21d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000cc10 tx=0x7fb0a0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:29.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0967fc700 1 -- 172.21.15.154:0/3724784877 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000a850 con 0x7fb0a815a440 2023-10-10T21:14:29.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0967fc700 1 -- 172.21.15.154:0/3724784877 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a000a9d0 con 0x7fb0a815a440 2023-10-10T21:14:29.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0967fc700 1 -- 172.21.15.154:0/3724784877 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000ad90 con 0x7fb0a815a440 2023-10-10T21:14:29.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a80caa60 con 0x7fb0a815a440 2023-10-10T21:14:29.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.716+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a80cb020 con 0x7fb0a815a440 2023-10-10T21:14:29.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.717+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a80718b0 con 0x7fb0a815a440 2023-10-10T21:14:29.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.718+0000 7fb0967fc700 1 -- 172.21.15.154:0/3724784877 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fb0a0007300 con 0x7fb0a815a440 2023-10-10T21:14:29.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.719+0000 7fb0967fc700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb088067130 0x7fb0880695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:29.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.719+0000 7fb0967fc700 1 -- 172.21.15.154:0/3724784877 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fb0a0084d00 con 0x7fb0a815a440 2023-10-10T21:14:29.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.720+0000 7fb0a659c700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb088067130 0x7fb0880695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:29.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.720+0000 7fb0a659c700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb088067130 0x7fb0880695e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb098009db0 tx=0x7fb0980091a0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:29.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.723+0000 7fb0967fc700 1 -- 172.21.15.154:0/3724784877 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0a0051b40 con 0x7fb0a815a440 2023-10-10T21:14:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.939+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0a806d6a0 con 0x7fb088067130 2023-10-10T21:14:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.946+0000 7fb0967fc700 1 -- 172.21.15.154:0/3724784877 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fb0a806d6a0 con 0x7fb088067130 2023-10-10T21:14:29.947 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:39", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb088067130 msgr2=0x7fb0880695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb088067130 0x7fb0880695e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb098009db0 tx=0x7fb0980091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 msgr2=0x7fb0a80c21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:29.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 0x7fb0a80c21d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000cc10 tx=0x7fb0a0001970 comp rx=0 tx=0).stop 2023-10-10T21:14:29.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 shutdown_connections 2023-10-10T21:14:29.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0a815a440 0x7fb0a80c21d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb088067130 0x7fb0880695e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a8068890 0x7fb0a80cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 --2- 172.21.15.154:0/3724784877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a81563b0 0x7fb0a814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:29.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 >> 172.21.15.154:0/3724784877 conn(0x7fb0a80c8f90 msgr2=0x7fb0a814d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:29.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 shutdown_connections 2023-10-10T21:14:29.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:29.949+0000 7fb0acbff700 1 -- 172.21.15.154:0/3724784877 wait complete. 2023-10-10T21:14:29.967 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:39", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:29.968 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:39', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:29.968 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:29.969 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:29.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:29.970 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-10T21:14:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:30.012 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_00_UTC', 'scheduled-2023-10-10-21_08_00_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:30.012 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-10-10T21:14:30.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.240+0000 7f52f8bff700 1 Processor -- start 2023-10-10T21:14:30.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.240+0000 7f52f8bff700 1 -- start start 2023-10-10T21:14:30.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.241+0000 7f52f8bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52f4069a50 0x7f52f40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.241+0000 7f52f8bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52f4069e20 0x7f52f41569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.241+0000 7f52f8bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f40ac030 con 0x7f52f40c8490 2023-10-10T21:14:30.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.241+0000 7f52f8bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f40ab820 con 0x7f52f4069a50 2023-10-10T21:14:30.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.241+0000 7f52f8bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f406dbb0 con 0x7f52f4069e20 2023-10-10T21:14:30.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.242+0000 7f52f259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52f4069a50 0x7f52f40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.242+0000 7f52f259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52f4069a50 0x7f52f40c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41652/0 (socket says 172.21.15.154:41652) 2023-10-10T21:14:30.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.242+0000 7f52f259c700 1 -- 172.21.15.154:0/3502494028 learned_addr learned my addr 172.21.15.154:0/3502494028 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:30.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.242+0000 7f52f2d9d700 1 --2- 172.21.15.154:0/3502494028 >> v2:172.21.15.179:3300/0 conn(0x7f52f4069e20 0x7f52f41569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.242+0000 7f52f259c700 1 -- 172.21.15.154:0/3502494028 >> v2:172.21.15.179:3300/0 conn(0x7f52f4069e20 msgr2=0x7f52f41569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:30.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.242+0000 7f52f259c700 1 --2- 172.21.15.154:0/3502494028 >> v2:172.21.15.179:3300/0 conn(0x7f52f4069e20 0x7f52f41569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.242+0000 7f52f259c700 1 -- 172.21.15.154:0/3502494028 >> v1:172.21.15.179:6789/0 conn(0x7f52f40c8490 legacy=0x7f52f415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:30.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.242+0000 7f52f259c700 1 -- 172.21.15.154:0/3502494028 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40aba70 con 0x7f52f4069a50 2023-10-10T21:14:30.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.242+0000 7f52f259c700 1 --2- 172.21.15.154:0/3502494028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069a50 0x7f52f40c6ac0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f52f406db20 tx=0x7f52e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8505d5176fbcf349 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:30.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f1d9b700 1 -- 172.21.15.154:0/3502494028 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400b820 con 0x7f52f4069a50 2023-10-10T21:14:30.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f1d9b700 1 -- 172.21.15.154:0/3502494028 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400b980 con 0x7f52f4069a50 2023-10-10T21:14:30.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f1d9b700 1 -- 172.21.15.154:0/3502494028 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400bd20 con 0x7f52f4069a50 2023-10-10T21:14:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f8bff700 1 -- 172.21.15.154:0/3502494028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069a50 msgr2=0x7f52f40c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f8bff700 1 --2- 172.21.15.154:0/3502494028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069a50 0x7f52f40c6ac0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f52f406db20 tx=0x7f52e4009250 comp rx=0 tx=0).stop 2023-10-10T21:14:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f8bff700 1 -- 172.21.15.154:0/3502494028 shutdown_connections 2023-10-10T21:14:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f8bff700 1 --2- 172.21.15.154:0/3502494028 >> v2:172.21.15.179:3300/0 conn(0x7f52f4069e20 0x7f52f41569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f8bff700 1 --2- 172.21.15.154:0/3502494028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069a50 0x7f52f40c6ac0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f8bff700 1 -- 172.21.15.154:0/3502494028 >> 172.21.15.154:0/3502494028 conn(0x7f52f40c8f90 msgr2=0x7f52f40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f8bff700 1 -- 172.21.15.154:0/3502494028 shutdown_connections 2023-10-10T21:14:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.243+0000 7f52f8bff700 1 -- 172.21.15.154:0/3502494028 wait complete. 2023-10-10T21:14:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.245+0000 7f52f8bff700 1 Processor -- start 2023-10-10T21:14:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.245+0000 7f52f8bff700 1 -- start start 2023-10-10T21:14:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52f8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52f4069a50 0x7f52f41549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52f8bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069e20 0x7f52f40cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52f8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52f40c8490 0x7f52f40cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52f8bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40c0df0 con 0x7f52f4069e20 2023-10-10T21:14:30.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52f8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40c0aa0 con 0x7f52f4069a50 2023-10-10T21:14:30.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52f8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40c5840 con 0x7f52f40c8490 2023-10-10T21:14:30.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52ebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069e20 0x7f52f40cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52ebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069e20 0x7f52f40cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41660/0 (socket says 172.21.15.154:41660) 2023-10-10T21:14:30.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52ebfff700 1 -- 172.21.15.154:0/384485259 learned_addr learned my addr 172.21.15.154:0/384485259 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52f259c700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52f4069a50 0x7f52f41549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.246+0000 7f52f2d9d700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52f40c8490 0x7f52f40cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52ebfff700 1 -- 172.21.15.154:0/384485259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52f40c8490 msgr2=0x7f52f40cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52ebfff700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52f40c8490 0x7f52f40cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52ebfff700 1 -- 172.21.15.154:0/384485259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52f4069a50 msgr2=0x7f52f41549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:30.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52ebfff700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52f4069a50 0x7f52f41549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52ebfff700 1 -- 172.21.15.154:0/384485259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40094f0 con 0x7f52f4069e20 2023-10-10T21:14:30.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52f2d9d700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52f40c8490 0x7f52f40cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:30.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52ebfff700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069e20 0x7f52f40cc500 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00c5d0 tx=0x7f52dc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:30.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52ea7fc700 1 -- 172.21.15.154:0/384485259 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc011590 con 0x7f52f4069e20 2023-10-10T21:14:30.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52ea7fc700 1 -- 172.21.15.154:0/384485259 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc011710 con 0x7f52f4069e20 2023-10-10T21:14:30.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f40c5b20 con 0x7f52f4069e20 2023-10-10T21:14:30.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52ea7fc700 1 -- 172.21.15.154:0/384485259 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc011ad0 con 0x7f52f4069e20 2023-10-10T21:14:30.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.247+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f4154f20 con 0x7f52f4069e20 2023-10-10T21:14:30.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.248+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f40c0fa0 con 0x7f52f4069e20 2023-10-10T21:14:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.249+0000 7f52ea7fc700 1 -- 172.21.15.154:0/384485259 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f52dc01c460 con 0x7f52f4069e20 2023-10-10T21:14:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.250+0000 7f52ea7fc700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52d4067160 0x7f52d4069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.250+0000 7f52ea7fc700 1 -- 172.21.15.154:0/384485259 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f52dc084670 con 0x7f52f4069e20 2023-10-10T21:14:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.250+0000 7f52f259c700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52d4067160 0x7f52d4069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.251+0000 7f52f259c700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52d4067160 0x7f52d4069610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52f406db20 tx=0x7f52e4016000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:30.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.255+0000 7f52ea7fc700 1 -- 172.21.15.154:0/384485259 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52f40c0fa0 con 0x7f52f4069e20 2023-10-10T21:14:30.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.471+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52f40718b0 con 0x7f52d4067160 2023-10-10T21:14:30.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.480+0000 7f52ea7fc700 1 -- 172.21.15.154:0/384485259 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f52f40718b0 con 0x7f52d4067160 2023-10-10T21:14:30.481 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:30.481 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:40", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:30.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52d4067160 msgr2=0x7f52d4069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:30.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52d4067160 0x7f52d4069610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52f406db20 tx=0x7f52e4016000 comp rx=0 tx=0).stop 2023-10-10T21:14:30.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069e20 msgr2=0x7f52f40cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:30.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069e20 0x7f52f40cc500 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00c5d0 tx=0x7f52dc007f60 comp rx=0 tx=0).stop 2023-10-10T21:14:30.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 shutdown_connections 2023-10-10T21:14:30.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f52d4067160 0x7f52d4069610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52f40c8490 0x7f52f40cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52f4069a50 0x7f52f41549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 --2- 172.21.15.154:0/384485259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52f4069e20 0x7f52f40cc500 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 >> 172.21.15.154:0/384485259 conn(0x7f52f40c8f90 msgr2=0x7f52f40c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:30.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 shutdown_connections 2023-10-10T21:14:30.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.482+0000 7f52f8bff700 1 -- 172.21.15.154:0/384485259 wait complete. 2023-10-10T21:14:30.500 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:40", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:30.501 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:40', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:30.501 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:30.501 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:30.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:30.502 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-10T21:14:30.540 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:30.541 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:30.541 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:30.541 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:30.541 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:30.542 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:30.542 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:30.542 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:30.542 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:30.542 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:30.542 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:30.543 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_04_00_UTC', 'scheduled-2023-10-10-21_05_00_UTC', 'scheduled-2023-10-10-21_06_00_UTC', 'scheduled-2023-10-10-21_07_00_UTC', 'scheduled-2023-10-10-21_08_00_UTC', 'scheduled-2023-10-10-21_09_00_UTC', 'scheduled-2023-10-10-21_10_00_UTC', 'scheduled-2023-10-10-21_11_00_UTC', 'scheduled-2023-10-10-21_12_00_UTC', 'scheduled-2023-10-10-21_13_00_UTC', 'scheduled-2023-10-10-21_14_00_UTC'] 2023-10-10T21:14:30.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-10-10T21:14:30.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.769+0000 7f23cebff700 1 Processor -- start 2023-10-10T21:14:30.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.769+0000 7f23cebff700 1 -- start start 2023-10-10T21:14:30.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.770+0000 7f23cebff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f23c815a440 0x7f23c80acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.770+0000 7f23cebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c80c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.770+0000 7f23cebff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c815a9b0 con 0x7f23c81563b0 2023-10-10T21:14:30.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.770+0000 7f23cebff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c815ac90 con 0x7f23c815a440 2023-10-10T21:14:30.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.770+0000 7f23cebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c815af70 con 0x7f23c8068890 2023-10-10T21:14:30.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23cc99b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f23c81563b0 0x7f23c8156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42738/0 (socket says 172.21.15.154:42738) 2023-10-10T21:14:30.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23cc99b700 1 -- 172.21.15.154:0/3544418432 learned_addr learned my addr 172.21.15.154:0/3544418432 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:30.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23c7fff700 1 --2- 172.21.15.154:0/3544418432 >> v2:172.21.15.179:3300/0 conn(0x7f23c815a440 0x7f23c80acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23cd19c700 1 --2- 172.21.15.154:0/3544418432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c80c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23c77fe700 1 -- 172.21.15.154:0/3544418432 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354756195 0 0) 0x7f23c815a9b0 con 0x7f23c81563b0 2023-10-10T21:14:30.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23c77fe700 1 -- 172.21.15.154:0/3544418432 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23b8003570 con 0x7f23c81563b0 2023-10-10T21:14:30.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23c7fff700 1 -- 172.21.15.154:0/3544418432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 msgr2=0x7f23c80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:30.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23c7fff700 1 --2- 172.21.15.154:0/3544418432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c80c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23c7fff700 1 -- 172.21.15.154:0/3544418432 >> v1:172.21.15.154:6789/0 conn(0x7f23c81563b0 legacy=0x7f23c8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:30.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23c7fff700 1 -- 172.21.15.154:0/3544418432 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c815b250 con 0x7f23c815a440 2023-10-10T21:14:30.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.771+0000 7f23cd19c700 1 --2- 172.21.15.154:0/3544418432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c80c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:30.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.772+0000 7f23c7fff700 1 --2- 172.21.15.154:0/3544418432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c815a440 0x7f23c80acf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f23b40098e0 tx=0x7f23b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cf38b24be9c31d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:30.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.772+0000 7f23c77fe700 1 -- 172.21.15.154:0/3544418432 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b400f6b0 con 0x7f23c815a440 2023-10-10T21:14:30.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.772+0000 7f23c77fe700 1 -- 172.21.15.154:0/3544418432 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b400f810 con 0x7f23c815a440 2023-10-10T21:14:30.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.772+0000 7f23c77fe700 1 -- 172.21.15.154:0/3544418432 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b400fbb0 con 0x7f23c815a440 2023-10-10T21:14:30.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.773+0000 7f23cebff700 1 -- 172.21.15.154:0/3544418432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c815a440 msgr2=0x7f23c80acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:30.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.773+0000 7f23cebff700 1 --2- 172.21.15.154:0/3544418432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c815a440 0x7f23c80acf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f23b40098e0 tx=0x7f23b40091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.773+0000 7f23cebff700 1 -- 172.21.15.154:0/3544418432 shutdown_connections 2023-10-10T21:14:30.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.773+0000 7f23cebff700 1 --2- 172.21.15.154:0/3544418432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c80c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.773+0000 7f23cebff700 1 --2- 172.21.15.154:0/3544418432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c815a440 0x7f23c80acf30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.773+0000 7f23cebff700 1 -- 172.21.15.154:0/3544418432 >> 172.21.15.154:0/3544418432 conn(0x7f23c80c8f90 msgr2=0x7f23c80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:30.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.773+0000 7f23cebff700 1 -- 172.21.15.154:0/3544418432 shutdown_connections 2023-10-10T21:14:30.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.773+0000 7f23cebff700 1 -- 172.21.15.154:0/3544418432 wait complete. 2023-10-10T21:14:30.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.774+0000 7f23cebff700 1 Processor -- start 2023-10-10T21:14:30.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.774+0000 7f23cebff700 1 -- start start 2023-10-10T21:14:30.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.775+0000 7f23cebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c8169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.775+0000 7f23cebff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c81563b0 0x7f23c8152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.775+0000 7f23cebff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c815a440 0x7f23c80b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.775+0000 7f23cebff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80b0510 con 0x7f23c815a440 2023-10-10T21:14:30.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.775+0000 7f23cebff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8154160 con 0x7f23c81563b0 2023-10-10T21:14:30.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.775+0000 7f23cebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80afcb0 con 0x7f23c8068890 2023-10-10T21:14:30.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.775+0000 7f23cd19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c815a440 0x7f23c80b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.775+0000 7f23cd19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c815a440 0x7f23c80b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41674/0 (socket says 172.21.15.154:41674) 2023-10-10T21:14:30.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.775+0000 7f23cd19c700 1 -- 172.21.15.154:0/607637337 learned_addr learned my addr 172.21.15.154:0/607637337 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23cc99b700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c8169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23c7fff700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c81563b0 0x7f23c8152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23cd19c700 1 -- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 msgr2=0x7f23c8169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23cd19c700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c8169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23cd19c700 1 -- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c81563b0 msgr2=0x7f23c8152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23cd19c700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c81563b0 0x7f23c8152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23cd19c700 1 -- 172.21.15.154:0/607637337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0009a20 con 0x7f23c815a440 2023-10-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23cc99b700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c8169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23c7fff700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c81563b0 0x7f23c8152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23cd19c700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c815a440 0x7f23c80b19c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009f50 tx=0x7f23c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23c4ff9700 1 -- 172.21.15.154:0/607637337 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000ccb0 con 0x7f23c815a440 2023-10-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23c4ff9700 1 -- 172.21.15.154:0/607637337 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c000f040 con 0x7f23c815a440 2023-10-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23c4ff9700 1 -- 172.21.15.154:0/607637337 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0014480 con 0x7f23c815a440 2023-10-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.776+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b4009420 con 0x7f23c815a440 2023-10-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.777+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c80b02b0 con 0x7f23c815a440 2023-10-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.778+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c80718b0 con 0x7f23c815a440 2023-10-10T21:14:30.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.778+0000 7f23c4ff9700 1 -- 172.21.15.154:0/607637337 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f23c0003020 con 0x7f23c815a440 2023-10-10T21:14:30.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.780+0000 7f23c4ff9700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23ac067130 0x7f23ac0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:30.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.780+0000 7f23c4ff9700 1 -- 172.21.15.154:0/607637337 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f23c0085530 con 0x7f23c815a440 2023-10-10T21:14:30.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.780+0000 7f23cc99b700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23ac067130 0x7f23ac0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:30.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.780+0000 7f23cc99b700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23ac067130 0x7f23ac0695e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0058d0 tx=0x7f23bc009040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:30.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.784+0000 7f23c4ff9700 1 -- 172.21.15.154:0/607637337 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23c0052270 con 0x7f23c815a440 2023-10-10T21:14:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:30.999+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23c806d6a0 con 0x7f23ac067130 2023-10-10T21:14:31.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.007+0000 7f23c4ff9700 1 -- 172.21.15.154:0/607637337 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f23c806d6a0 con 0x7f23ac067130 2023-10-10T21:14:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:31.008 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:40", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:31.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23ac067130 msgr2=0x7f23ac0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:31.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23ac067130 0x7f23ac0695e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0058d0 tx=0x7f23bc009040 comp rx=0 tx=0).stop 2023-10-10T21:14:31.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c815a440 msgr2=0x7f23c80b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:31.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c815a440 0x7f23c80b19c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009f50 tx=0x7f23c000b040 comp rx=0 tx=0).stop 2023-10-10T21:14:31.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 shutdown_connections 2023-10-10T21:14:31.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c815a440 0x7f23c80b19c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f23ac067130 0x7f23ac0695e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c8068890 0x7f23c8169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 --2- 172.21.15.154:0/607637337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c81563b0 0x7f23c8152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 >> 172.21.15.154:0/607637337 conn(0x7f23c80c8f90 msgr2=0x7f23c806e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:31.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 shutdown_connections 2023-10-10T21:14:31.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.009+0000 7f23cebff700 1 -- 172.21.15.154:0/607637337 wait complete. 2023-10-10T21:14:31.028 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:03:40", "first": "2023-10-10T21:04:00", "last": "2023-10-10T21:14:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-10T21:14:31.028 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:03:40', 'first': '2023-10-10T21:04:00', 'last': '2023-10-10T21:14:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-10T21:14:31.028 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T21:14:31.029 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T21:14:31.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-10-10T21:14:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.218+0000 7f8b6339d700 1 Processor -- start 2023-10-10T21:14:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.218+0000 7f8b6339d700 1 -- start start 2023-10-10T21:14:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.219+0000 7f8b6339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 0x7f8b5c157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.219+0000 7f8b6339d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b5c0b0760 0x7f8b5c0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.219+0000 7f8b6339d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5c0b1110 con 0x7f8b5c159f20 2023-10-10T21:14:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.219+0000 7f8b6339d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c0b0570 con 0x7f8b5c0b0760 2023-10-10T21:14:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.219+0000 7f8b6339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c1578b0 con 0x7f8b5c156350 2023-10-10T21:14:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.219+0000 7f8b61b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b5c0b0760 0x7f8b5c0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b5c0b0760 0x7f8b5c0b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41676/0 (socket says 172.21.15.154:41676) 2023-10-10T21:14:31.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61b9a700 1 -- 172.21.15.154:0/2149293781 learned_addr learned my addr 172.21.15.154:0/2149293781 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:31.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b6239b700 1 --2- 172.21.15.154:0/2149293781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 0x7f8b5c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:31.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61b9a700 1 -- 172.21.15.154:0/2149293781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 msgr2=0x7f8b5c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:31.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61b9a700 1 --2- 172.21.15.154:0/2149293781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 0x7f8b5c157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61b9a700 1 -- 172.21.15.154:0/2149293781 >> v1:172.21.15.179:6789/0 conn(0x7f8b5c159f20 legacy=0x7f8b5c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:31.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61b9a700 1 -- 172.21.15.154:0/2149293781 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c0af4d0 con 0x7f8b5c0b0760 2023-10-10T21:14:31.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61b9a700 1 --2- 172.21.15.154:0/2149293781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c0b0760 0x7f8b5c0b0bd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0099b0 tx=0x7f8b4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e1c033509d5463 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:31.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61399700 1 -- 172.21.15.154:0/2149293781 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c009ea0 con 0x7f8b5c0b0760 2023-10-10T21:14:31.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61399700 1 -- 172.21.15.154:0/2149293781 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c00b860 con 0x7f8b5c0b0760 2023-10-10T21:14:31.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.220+0000 7f8b61399700 1 -- 172.21.15.154:0/2149293781 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c00bc00 con 0x7f8b5c0b0760 2023-10-10T21:14:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.221+0000 7f8b6339d700 1 -- 172.21.15.154:0/2149293781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c0b0760 msgr2=0x7f8b5c0b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.221+0000 7f8b6339d700 1 --2- 172.21.15.154:0/2149293781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c0b0760 0x7f8b5c0b0bd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0099b0 tx=0x7f8b4c009250 comp rx=0 tx=0).stop 2023-10-10T21:14:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.221+0000 7f8b6339d700 1 -- 172.21.15.154:0/2149293781 shutdown_connections 2023-10-10T21:14:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.221+0000 7f8b6339d700 1 --2- 172.21.15.154:0/2149293781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 0x7f8b5c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.221+0000 7f8b6339d700 1 --2- 172.21.15.154:0/2149293781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c0b0760 0x7f8b5c0b0bd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.221+0000 7f8b6339d700 1 -- 172.21.15.154:0/2149293781 >> 172.21.15.154:0/2149293781 conn(0x7f8b5c068e20 msgr2=0x7f8b5c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.221+0000 7f8b6339d700 1 -- 172.21.15.154:0/2149293781 shutdown_connections 2023-10-10T21:14:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.221+0000 7f8b6339d700 1 -- 172.21.15.154:0/2149293781 wait complete. 2023-10-10T21:14:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.223+0000 7f8b6339d700 1 Processor -- start 2023-10-10T21:14:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.223+0000 7f8b6339d700 1 -- start start 2023-10-10T21:14:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b6339d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b0760 0x7f8b5c148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b6339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 0x7f8b5c148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b6339d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c159f20 0x7f8b5c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b6339d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0ca140 con 0x7f8b5c159f20 2023-10-10T21:14:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b6339d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c148ad0 con 0x7f8b5c0b0760 2023-10-10T21:14:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b6339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0c9530 con 0x7f8b5c156350 2023-10-10T21:14:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b62b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c159f20 0x7f8b5c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b62b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c159f20 0x7f8b5c0ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41690/0 (socket says 172.21.15.154:41690) 2023-10-10T21:14:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b61b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 0x7f8b5c148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b62b9c700 1 -- 172.21.15.154:0/656725582 learned_addr learned my addr 172.21.15.154:0/656725582 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b6239b700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b0760 0x7f8b5c148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b62b9c700 1 -- 172.21.15.154:0/656725582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 msgr2=0x7f8b5c148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b62b9c700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 0x7f8b5c148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b62b9c700 1 -- 172.21.15.154:0/656725582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b0760 msgr2=0x7f8b5c148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b62b9c700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b0760 0x7f8b5c148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.224+0000 7f8b62b9c700 1 -- 172.21.15.154:0/656725582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c0094f0 con 0x7f8b5c159f20 2023-10-10T21:14:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.225+0000 7f8b62b9c700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c159f20 0x7f8b5c0ca730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c840 tx=0x7f8b54001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.225+0000 7f8b527fc700 1 -- 172.21.15.154:0/656725582 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54012630 con 0x7f8b5c159f20 2023-10-10T21:14:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.225+0000 7f8b527fc700 1 -- 172.21.15.154:0/656725582 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b540127b0 con 0x7f8b5c159f20 2023-10-10T21:14:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.225+0000 7f8b527fc700 1 -- 172.21.15.154:0/656725582 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54012b70 con 0x7f8b5c159f20 2023-10-10T21:14:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.225+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c0c9810 con 0x7f8b5c159f20 2023-10-10T21:14:31.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.225+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c0c9dd0 con 0x7f8b5c159f20 2023-10-10T21:14:31.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.226+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c04c3c0 con 0x7f8b5c159f20 2023-10-10T21:14:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.227+0000 7f8b527fc700 1 -- 172.21.15.154:0/656725582 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f8b5401a3a0 con 0x7f8b5c159f20 2023-10-10T21:14:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.228+0000 7f8b527fc700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8b40067130 0x7f8b400695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.228+0000 7f8b527fc700 1 -- 172.21.15.154:0/656725582 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f8b54084b80 con 0x7f8b5c159f20 2023-10-10T21:14:31.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.228+0000 7f8b6239b700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8b40067130 0x7f8b400695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:31.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.228+0000 7f8b6239b700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8b40067130 0x7f8b400695e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009d10 tx=0x7f8b580091a0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:31.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.232+0000 7f8b527fc700 1 -- 172.21.15.154:0/656725582 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b540519d0 con 0x7f8b5c159f20 2023-10-10T21:14:31.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.448+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b5c0af7b0 con 0x7f8b40067130 2023-10-10T21:14:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.528+0000 7f8b527fc700 1 -- 172.21.15.154:0/656725582 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f8b5c0af7b0 con 0x7f8b40067130 2023-10-10T21:14:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-10-10T21:14:31.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8b40067130 msgr2=0x7f8b400695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:31.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8b40067130 0x7f8b400695e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009d10 tx=0x7f8b580091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c159f20 msgr2=0x7f8b5c0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:31.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c159f20 0x7f8b5c0ca730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c840 tx=0x7f8b54001670 comp rx=0 tx=0).stop 2023-10-10T21:14:31.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 shutdown_connections 2023-10-10T21:14:31.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c159f20 0x7f8b5c0ca730 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b0760 0x7f8b5c148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8b40067130 0x7f8b400695e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 --2- 172.21.15.154:0/656725582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c156350 0x7f8b5c148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:31.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 >> 172.21.15.154:0/656725582 conn(0x7f8b5c068e20 msgr2=0x7f8b5c0704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:31.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 shutdown_connections 2023-10-10T21:14:31.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:31.531+0000 7f8b6339d700 1 -- 172.21.15.154:0/656725582 wait complete. 2023-10-10T21:14:31.549 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-10-10T21:14:31.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:31.550 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-10T21:14:31.587 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:31.591 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:31.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:31.591 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:31.674 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:31.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:31.675 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:31.758 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:31.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:31.759 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:31.844 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:31.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:31.845 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_07_00_UTC) 2023-10-10T21:14:31.927 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:31.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:31.928 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_08_00_UTC) 2023-10-10T21:14:32.011 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:32.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:32.012 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:32.096 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:32.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:32.097 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:32.181 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:32.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:32.182 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:32.265 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:32.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:32.266 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:32.349 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:32.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:32.350 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:32.433 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:32.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:32.434 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:32.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:32.518 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-10-10T21:14:32.598 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-10-10T21:14:32.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.825+0000 7f9d9f59e700 1 Processor -- start 2023-10-10T21:14:32.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.826+0000 7f9d9f59e700 1 -- start start 2023-10-10T21:14:32.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.827+0000 7f9d9f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 0x7f9da01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:32.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.827+0000 7f9d9f59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da015a050 con 0x7f9da0159bf0 2023-10-10T21:14:32.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.827+0000 7f9d9f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da015a480 con 0x7f9da0153480 2023-10-10T21:14:32.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.827+0000 7f9d9f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00afb40 con 0x7f9da0153850 2023-10-10T21:14:32.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.827+0000 7f9d9ed9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9da0159bf0 0x7f9da0157280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42740/0 (socket says 172.21.15.154:42740) 2023-10-10T21:14:32.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.827+0000 7f9d9ed9d700 1 -- 172.21.15.154:0/1091804495 learned_addr learned my addr 172.21.15.154:0/1091804495 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:32.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.827+0000 7f9d9dd9b700 1 --2- 172.21.15.154:0/1091804495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 0x7f9da01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:32.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.828+0000 7f9d9d59a700 1 -- 172.21.15.154:0/1091804495 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693197623 0 0) 0x7f9d98001110 con 0x7f9da0159bf0 2023-10-10T21:14:32.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.828+0000 7f9d9d59a700 1 -- 172.21.15.154:0/1091804495 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d88004680 con 0x7f9da0159bf0 2023-10-10T21:14:32.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.828+0000 7f9d9d59a700 1 -- 172.21.15.154:0/1091804495 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932601181 0 0) 0x7f9da015a480 con 0x7f9da0153480 2023-10-10T21:14:32.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.828+0000 7f9d9d59a700 1 -- 172.21.15.154:0/1091804495 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d98001110 con 0x7f9da0153480 2023-10-10T21:14:32.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.828+0000 7f9d9dd9b700 1 -- 172.21.15.154:0/1091804495 >> v1:172.21.15.179:6789/0 conn(0x7f9da0153480 legacy=0x7f9da00ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:32.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.828+0000 7f9d9dd9b700 1 -- 172.21.15.154:0/1091804495 >> v1:172.21.15.154:6789/0 conn(0x7f9da0159bf0 legacy=0x7f9da0157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:32.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.828+0000 7f9d9dd9b700 1 -- 172.21.15.154:0/1091804495 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da00afe20 con 0x7f9da0153850 2023-10-10T21:14:32.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.828+0000 7f9d9dd9b700 1 --2- 172.21.15.154:0/1091804495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 0x7f9da01596b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009910 tx=0x7f9d940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b50b92054113ccfd server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:32.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.828+0000 7f9d9d59a700 1 -- 172.21.15.154:0/1091804495 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d94011630 con 0x7f9da0153850 2023-10-10T21:14:32.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.829+0000 7f9d9d59a700 1 -- 172.21.15.154:0/1091804495 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d94011790 con 0x7f9da0153850 2023-10-10T21:14:32.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.829+0000 7f9d9d59a700 1 -- 172.21.15.154:0/1091804495 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d94011b30 con 0x7f9da0153850 2023-10-10T21:14:32.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.829+0000 7f9d9f59e700 1 -- 172.21.15.154:0/1091804495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 msgr2=0x7f9da01596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:32.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.829+0000 7f9d9f59e700 1 --2- 172.21.15.154:0/1091804495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 0x7f9da01596b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009910 tx=0x7f9d940091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:32.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.829+0000 7f9d9f59e700 1 -- 172.21.15.154:0/1091804495 shutdown_connections 2023-10-10T21:14:32.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.829+0000 7f9d9f59e700 1 --2- 172.21.15.154:0/1091804495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 0x7f9da01596b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:32.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.829+0000 7f9d9f59e700 1 -- 172.21.15.154:0/1091804495 >> 172.21.15.154:0/1091804495 conn(0x7f9da0068e20 msgr2=0x7f9da00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:32.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.829+0000 7f9d9f59e700 1 -- 172.21.15.154:0/1091804495 shutdown_connections 2023-10-10T21:14:32.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.829+0000 7f9d9f59e700 1 -- 172.21.15.154:0/1091804495 wait complete. 2023-10-10T21:14:32.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.831+0000 7f9d9f59e700 1 Processor -- start 2023-10-10T21:14:32.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.831+0000 7f9d9f59e700 1 -- start start 2023-10-10T21:14:32.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da0153480 0x7f9da015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:32.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 0x7f9da00c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:32.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da0159bf0 0x7f9da00c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:32.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9f59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0156800 con 0x7f9da0153480 2023-10-10T21:14:32.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00c6090 con 0x7f9da0159bf0 2023-10-10T21:14:32.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00c6370 con 0x7f9da0153850 2023-10-10T21:14:32.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da0153480 0x7f9da015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:32.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da0153480 0x7f9da015dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41702/0 (socket says 172.21.15.154:41702) 2023-10-10T21:14:32.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9e59c700 1 -- 172.21.15.154:0/3666291244 learned_addr learned my addr 172.21.15.154:0/3666291244 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:32.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9ed9d700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da0159bf0 0x7f9da00c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:32.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9dd9b700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 0x7f9da00c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:32.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9e59c700 1 -- 172.21.15.154:0/3666291244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 msgr2=0x7f9da00c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:32.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.832+0000 7f9d9e59c700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 0x7f9da00c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:32.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.833+0000 7f9d9e59c700 1 -- 172.21.15.154:0/3666291244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da0159bf0 msgr2=0x7f9da00c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:32.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.833+0000 7f9d9e59c700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da0159bf0 0x7f9da00c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:32.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.833+0000 7f9d9e59c700 1 -- 172.21.15.154:0/3666291244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94009420 con 0x7f9da0153480 2023-10-10T21:14:32.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.833+0000 7f9d9e59c700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da0153480 0x7f9da015dea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000cb10 tx=0x7f9d90002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:32.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.833+0000 7f9d8e7fc700 1 -- 172.21.15.154:0/3666291244 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000ce20 con 0x7f9da0153480 2023-10-10T21:14:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.833+0000 7f9d8e7fc700 1 -- 172.21.15.154:0/3666291244 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9000a7e0 con 0x7f9da0153480 2023-10-10T21:14:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.833+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da00c6650 con 0x7f9da0153480 2023-10-10T21:14:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.833+0000 7f9d8e7fc700 1 -- 172.21.15.154:0/3666291244 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000ab80 con 0x7f9da0153480 2023-10-10T21:14:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.833+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da0153cd0 con 0x7f9da0153480 2023-10-10T21:14:32.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.834+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da004c3c0 con 0x7f9da0153480 2023-10-10T21:14:32.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.835+0000 7f9d8e7fc700 1 -- 172.21.15.154:0/3666291244 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f9d90012420 con 0x7f9da0153480 2023-10-10T21:14:32.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.836+0000 7f9d8e7fc700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9d80067100 0x7f9d800695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.836+0000 7f9d8e7fc700 1 -- 172.21.15.154:0/3666291244 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9d90084ce0 con 0x7f9da0153480 2023-10-10T21:14:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.836+0000 7f9d9dd9b700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9d80067100 0x7f9d800695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.837+0000 7f9d9dd9b700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9d80067100 0x7f9d800695b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9da0153ca0 tx=0x7f9d94017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:32.840+0000 7f9d8e7fc700 1 -- 172.21.15.154:0/3666291244 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d90051b30 con 0x7f9da0153480 2023-10-10T21:14:33.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.058+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9da00c61d0 con 0x7f9d80067100 2023-10-10T21:14:33.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.133+0000 7f9d8e7fc700 1 -- 172.21.15.154:0/3666291244 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f9da00c61d0 con 0x7f9d80067100 2023-10-10T21:14:33.134 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-10-10T21:14:33.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9d80067100 msgr2=0x7f9d800695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:33.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9d80067100 0x7f9d800695b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9da0153ca0 tx=0x7f9d94017000 comp rx=0 tx=0).stop 2023-10-10T21:14:33.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da0153480 msgr2=0x7f9da015dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:33.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da0153480 0x7f9da015dea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000cb10 tx=0x7f9d90002820 comp rx=0 tx=0).stop 2023-10-10T21:14:33.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 shutdown_connections 2023-10-10T21:14:33.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da0159bf0 0x7f9da00c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:33.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da0153480 0x7f9da015dea0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:33.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9d80067100 0x7f9d800695b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:33.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 --2- 172.21.15.154:0/3666291244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da0153850 0x7f9da00c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:33.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 >> 172.21.15.154:0/3666291244 conn(0x7f9da0068e20 msgr2=0x7f9da00694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:33.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 shutdown_connections 2023-10-10T21:14:33.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:33.136+0000 7f9d9f59e700 1 -- 172.21.15.154:0/3666291244 wait complete. 2023-10-10T21:14:33.154 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-10-10T21:14:33.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.155 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-10T21:14:33.194 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:33.194 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:33.194 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:33.195 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:33.195 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:33.195 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:33.195 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:33.196 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:33.196 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:33.196 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:33.196 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:33.197 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:33.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.198 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:33.285 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:33.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.286 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:33.330 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:33.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.331 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:33.415 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:33.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.415 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_07_00_UTC) 2023-10-10T21:14:33.499 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:33.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.500 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_08_00_UTC) 2023-10-10T21:14:33.583 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:33.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.583 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:33.666 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:33.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.667 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:33.750 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:33.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.751 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:33.834 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:33.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.835 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:33.919 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:33.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:33.920 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:34.004 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:34.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:34.005 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:34.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:34.090 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-10-10T21:14:34.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-10-10T21:14:34.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.504+0000 7f97c199d700 1 Processor -- start 2023-10-10T21:14:34.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.504+0000 7f97c199d700 1 -- start start 2023-10-10T21:14:34.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.505+0000 7f97c199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:34.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.505+0000 7f97c199d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f97bc1591e0 0x7f97bc159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:34.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.506+0000 7f97c199d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97bc0cfa00 con 0x7f97bc0b0790 2023-10-10T21:14:34.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.506+0000 7f97c199d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97bc0cb580 con 0x7f97bc1591e0 2023-10-10T21:14:34.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.506+0000 7f97c199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0cf160 con 0x7f97bc0b03c0 2023-10-10T21:14:34.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.506+0000 7f97bbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f97bc0b0790 0x7f97bc0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42752/0 (socket says 172.21.15.154:42752) 2023-10-10T21:14:34.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.506+0000 7f97bbfff700 1 -- 172.21.15.154:0/902806140 learned_addr learned my addr 172.21.15.154:0/902806140 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:34.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.506+0000 7f97c099b700 1 --2- 172.21.15.154:0/902806140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:34.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.506+0000 7f97c119c700 1 --2- 172.21.15.154:0/902806140 >> v2:172.21.15.179:3300/0 conn(0x7f97bc1591e0 0x7f97bc159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:34.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.506+0000 7f97bb7fe700 1 -- 172.21.15.154:0/902806140 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919920389 0 0) 0x7f97bc0cfa00 con 0x7f97bc0b0790 2023-10-10T21:14:34.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.506+0000 7f97bb7fe700 1 -- 172.21.15.154:0/902806140 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97ac003570 con 0x7f97bc0b0790 2023-10-10T21:14:34.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.507+0000 7f97c099b700 1 -- 172.21.15.154:0/902806140 >> v2:172.21.15.179:3300/0 conn(0x7f97bc1591e0 msgr2=0x7f97bc159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:34.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.507+0000 7f97c099b700 1 --2- 172.21.15.154:0/902806140 >> v2:172.21.15.179:3300/0 conn(0x7f97bc1591e0 0x7f97bc159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.507+0000 7f97c099b700 1 -- 172.21.15.154:0/902806140 >> v1:172.21.15.154:6789/0 conn(0x7f97bc0b0790 legacy=0x7f97bc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:34.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.507+0000 7f97c099b700 1 -- 172.21.15.154:0/902806140 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc0cf440 con 0x7f97bc0b03c0 2023-10-10T21:14:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.507+0000 7f97c099b700 1 --2- 172.21.15.154:0/902806140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc0cea70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97b00098e0 tx=0x7f97b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e606e53807df6d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.507+0000 7f97bb7fe700 1 -- 172.21.15.154:0/902806140 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0011630 con 0x7f97bc0b03c0 2023-10-10T21:14:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.507+0000 7f97bb7fe700 1 -- 172.21.15.154:0/902806140 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b0011790 con 0x7f97bc0b03c0 2023-10-10T21:14:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.507+0000 7f97bb7fe700 1 -- 172.21.15.154:0/902806140 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0011b30 con 0x7f97bc0b03c0 2023-10-10T21:14:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.508+0000 7f97c199d700 1 -- 172.21.15.154:0/902806140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 msgr2=0x7f97bc0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.508+0000 7f97c199d700 1 --2- 172.21.15.154:0/902806140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc0cea70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97b00098e0 tx=0x7f97b00091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.508+0000 7f97c199d700 1 -- 172.21.15.154:0/902806140 shutdown_connections 2023-10-10T21:14:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.508+0000 7f97c199d700 1 --2- 172.21.15.154:0/902806140 >> v2:172.21.15.179:3300/0 conn(0x7f97bc1591e0 0x7f97bc159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.508+0000 7f97c199d700 1 --2- 172.21.15.154:0/902806140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc0cea70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.508+0000 7f97c199d700 1 -- 172.21.15.154:0/902806140 >> 172.21.15.154:0/902806140 conn(0x7f97bc063230 msgr2=0x7f97bc063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.508+0000 7f97c199d700 1 -- 172.21.15.154:0/902806140 shutdown_connections 2023-10-10T21:14:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.508+0000 7f97c199d700 1 -- 172.21.15.154:0/902806140 wait complete. 2023-10-10T21:14:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.510+0000 7f97c199d700 1 Processor -- start 2023-10-10T21:14:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.510+0000 7f97c199d700 1 -- start start 2023-10-10T21:14:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.511+0000 7f97c199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.511+0000 7f97c199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97bc0b0790 0x7f97bc15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97c199d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97bc1591e0 0x7f97bc0c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97c199d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0c3ff0 con 0x7f97bc1591e0 2023-10-10T21:14:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97c199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc159b60 con 0x7f97bc0b0790 2023-10-10T21:14:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97c199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc1698b0 con 0x7f97bc0b03c0 2023-10-10T21:14:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97bbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97bc0b0790 0x7f97bc15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97c099b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97bbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97bc0b0790 0x7f97bc15cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:47022/0 (socket says 172.21.15.154:47022) 2023-10-10T21:14:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97bbfff700 1 -- 172.21.15.154:0/1434095506 learned_addr learned my addr 172.21.15.154:0/1434095506 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97c099b700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:60506/0 (socket says 172.21.15.154:60506) 2023-10-10T21:14:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.512+0000 7f97c119c700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97bc1591e0 0x7f97bc0c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.513+0000 7f97bbfff700 1 -- 172.21.15.154:0/1434095506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 msgr2=0x7f97bc159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.513+0000 7f97bbfff700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.513+0000 7f97bbfff700 1 -- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97bc1591e0 msgr2=0x7f97bc0c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.513+0000 7f97bbfff700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97bc1591e0 0x7f97bc0c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.513+0000 7f97bbfff700 1 -- 172.21.15.154:0/1434095506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0009420 con 0x7f97bc0b0790 2023-10-10T21:14:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.513+0000 7f97c119c700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97bc1591e0 0x7f97bc0c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.513+0000 7f97bbfff700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97bc0b0790 0x7f97bc15cfe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c7c0 tx=0x7f97a8007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.513+0000 7f97b8ff9700 1 -- 172.21.15.154:0/1434095506 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8005cd0 con 0x7f97bc0b0790 2023-10-10T21:14:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.513+0000 7f97b8ff9700 1 -- 172.21.15.154:0/1434095506 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a8005e30 con 0x7f97bc0b0790 2023-10-10T21:14:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.514+0000 7f97b8ff9700 1 -- 172.21.15.154:0/1434095506 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8007320 con 0x7f97bc0b0790 2023-10-10T21:14:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.514+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc169b90 con 0x7f97bc0b0790 2023-10-10T21:14:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.514+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc16a150 con 0x7f97bc0b0790 2023-10-10T21:14:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.515+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97bc04c3c0 con 0x7f97bc0b0790 2023-10-10T21:14:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.516+0000 7f97b8ff9700 1 -- 172.21.15.154:0/1434095506 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f97a8007690 con 0x7f97bc0b0790 2023-10-10T21:14:34.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.517+0000 7f97b8ff9700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f97a0067130 0x7f97a00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:34.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.517+0000 7f97b8ff9700 1 -- 172.21.15.154:0/1434095506 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6659+0+0 (secure 0 0 0) 0x7f97a80842e0 con 0x7f97bc0b0790 2023-10-10T21:14:34.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.517+0000 7f97c099b700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f97a0067130 0x7f97a00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:34.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.518+0000 7f97c099b700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f97a0067130 0x7f97a00695e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97b00091e0 tx=0x7f97b0017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:34.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.521+0000 7f97b8ff9700 1 -- 172.21.15.154:0/1434095506 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97a8050e70 con 0x7f97bc0b0790 2023-10-10T21:14:34.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.736+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f97bc0cad50 con 0x7f97a0067130 2023-10-10T21:14:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.812+0000 7f97b8ff9700 1 -- 172.21.15.154:0/1434095506 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f97bc0cad50 con 0x7f97a0067130 2023-10-10T21:14:34.814 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-10-10T21:14:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f97a0067130 msgr2=0x7f97a00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f97a0067130 0x7f97a00695e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97b00091e0 tx=0x7f97b0017000 comp rx=0 tx=0).stop 2023-10-10T21:14:34.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97bc0b0790 msgr2=0x7f97bc15cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:34.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97bc0b0790 0x7f97bc15cfe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c7c0 tx=0x7f97a8007e00 comp rx=0 tx=0).stop 2023-10-10T21:14:34.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 shutdown_connections 2023-10-10T21:14:34.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97bc1591e0 0x7f97bc0c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f97a0067130 0x7f97a00695e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97bc0b03c0 0x7f97bc159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 --2- 172.21.15.154:0/1434095506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97bc0b0790 0x7f97bc15cfe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:34.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 >> 172.21.15.154:0/1434095506 conn(0x7f97bc063230 msgr2=0x7f97bc1587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:34.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 shutdown_connections 2023-10-10T21:14:34.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:34.814+0000 7f97c199d700 1 -- 172.21.15.154:0/1434095506 wait complete. 2023-10-10T21:14:34.833 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-10-10T21:14:34.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:34.834 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-10T21:14:34.874 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:34.874 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:34.874 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:34.874 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:34.877 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:34.877 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:34.877 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:34.877 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:34.878 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:34.878 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:34.878 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:34.879 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:34.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:34.880 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:34.965 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:34.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:34.966 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:35.050 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:35.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.051 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:35.135 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:35.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.136 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_07_00_UTC) 2023-10-10T21:14:35.223 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:35.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.225 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_08_00_UTC) 2023-10-10T21:14:35.268 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:35.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.269 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:35.354 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:35.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.355 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:35.440 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:35.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.441 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:35.524 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:35.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.525 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:35.608 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:35.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.609 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:35.692 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:35.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.693 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:35.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:35.777 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-10-10T21:14:35.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-10-10T21:14:36.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.085+0000 7fe03a39d700 1 Processor -- start 2023-10-10T21:14:36.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.085+0000 7fe03a39d700 1 -- start start 2023-10-10T21:14:36.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe03a39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0341597d0 0x7fe0340afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:36.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe03a39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 0x7fe03415d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe03a39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03406e510 con 0x7fe0340ac0e0 2023-10-10T21:14:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe03a39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe034069180 con 0x7fe0341597d0 2023-10-10T21:14:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe03a39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03406dec0 con 0x7fe03406f0b0 2023-10-10T21:14:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe038b9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe0340ac0e0 0x7fe03406e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44608/0 (socket says 172.21.15.154:44608) 2023-10-10T21:14:36.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe038b9a700 1 -- 172.21.15.154:0/2437756402 learned_addr learned my addr 172.21.15.154:0/2437756402 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:36.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe039b9c700 1 --2- 172.21.15.154:0/2437756402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 0x7fe03415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:36.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe03939b700 1 --2- 172.21.15.154:0/2437756402 >> v2:172.21.15.179:3300/0 conn(0x7fe0341597d0 0x7fe0340afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe02bfff700 1 -- 172.21.15.154:0/2437756402 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425595315 0 0) 0x7fe03406e510 con 0x7fe0340ac0e0 2023-10-10T21:14:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.087+0000 7fe02bfff700 1 -- 172.21.15.154:0/2437756402 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe020003570 con 0x7fe0340ac0e0 2023-10-10T21:14:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.088+0000 7fe03939b700 1 -- 172.21.15.154:0/2437756402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 msgr2=0x7fe03415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.088+0000 7fe02bfff700 1 -- 172.21.15.154:0/2437756402 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1026325025 0 0) 0x7fe020003570 con 0x7fe0340ac0e0 2023-10-10T21:14:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.088+0000 7fe03939b700 1 --2- 172.21.15.154:0/2437756402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 0x7fe03415d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.088+0000 7fe03939b700 1 -- 172.21.15.154:0/2437756402 >> v1:172.21.15.154:6789/0 conn(0x7fe0340ac0e0 legacy=0x7fe03406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.088+0000 7fe03939b700 1 -- 172.21.15.154:0/2437756402 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03406e1a0 con 0x7fe0341597d0 2023-10-10T21:14:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.088+0000 7fe03939b700 1 --2- 172.21.15.154:0/2437756402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0341597d0 0x7fe0340afa40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0300098e0 tx=0x7fe0300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a80a6631654f985e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:36.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.088+0000 7fe02bfff700 1 -- 172.21.15.154:0/2437756402 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024001470 con 0x7fe0341597d0 2023-10-10T21:14:36.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.088+0000 7fe02bfff700 1 -- 172.21.15.154:0/2437756402 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe030011420 con 0x7fe0341597d0 2023-10-10T21:14:36.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.088+0000 7fe02bfff700 1 -- 172.21.15.154:0/2437756402 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0300117c0 con 0x7fe0341597d0 2023-10-10T21:14:36.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.089+0000 7fe03a39d700 1 -- 172.21.15.154:0/2437756402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0341597d0 msgr2=0x7fe0340afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:36.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.089+0000 7fe03a39d700 1 --2- 172.21.15.154:0/2437756402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0341597d0 0x7fe0340afa40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0300098e0 tx=0x7fe0300091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.089+0000 7fe03a39d700 1 -- 172.21.15.154:0/2437756402 shutdown_connections 2023-10-10T21:14:36.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.089+0000 7fe03a39d700 1 --2- 172.21.15.154:0/2437756402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 0x7fe03415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.089+0000 7fe03a39d700 1 --2- 172.21.15.154:0/2437756402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0341597d0 0x7fe0340afa40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.089+0000 7fe03a39d700 1 -- 172.21.15.154:0/2437756402 >> 172.21.15.154:0/2437756402 conn(0x7fe03406adf0 msgr2=0x7fe0340ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:36.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.089+0000 7fe03a39d700 1 -- 172.21.15.154:0/2437756402 shutdown_connections 2023-10-10T21:14:36.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.089+0000 7fe03a39d700 1 -- 172.21.15.154:0/2437756402 wait complete. 2023-10-10T21:14:36.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.090+0000 7fe03a39d700 1 Processor -- start 2023-10-10T21:14:36.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.090+0000 7fe03a39d700 1 -- start start 2023-10-10T21:14:36.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.091+0000 7fe03a39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 0x7fe034156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:36.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.091+0000 7fe03a39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0341597d0 0x7fe0340ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:36.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.091+0000 7fe03a39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0341554d0 0x7fe034145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:36.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.091+0000 7fe03a39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0341561b0 con 0x7fe0341554d0 2023-10-10T21:14:36.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.091+0000 7fe03a39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0341568d0 con 0x7fe0341597d0 2023-10-10T21:14:36.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.091+0000 7fe03a39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0341559a0 con 0x7fe03406f0b0 2023-10-10T21:14:36.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe039b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0341554d0 0x7fe034145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:36.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe03939b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 0x7fe034156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:36.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe039b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0341554d0 0x7fe034145210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44008/0 (socket says 172.21.15.154:44008) 2023-10-10T21:14:36.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe039b9c700 1 -- 172.21.15.154:0/384545002 learned_addr learned my addr 172.21.15.154:0/384545002 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:36.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe038b9a700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0341597d0 0x7fe0340ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:36.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe039b9c700 1 -- 172.21.15.154:0/384545002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 msgr2=0x7fe034156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:36.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe039b9c700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 0x7fe034156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe039b9c700 1 -- 172.21.15.154:0/384545002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0341597d0 msgr2=0x7fe0340ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:36.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe039b9c700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0341597d0 0x7fe0340ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe039b9c700 1 -- 172.21.15.154:0/384545002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe030009420 con 0x7fe0341554d0 2023-10-10T21:14:36.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.092+0000 7fe039b9c700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0341554d0 0x7fe034145210 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009e90 tx=0x7fe02c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:36.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.093+0000 7fe0297fa700 1 -- 172.21.15.154:0/384545002 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00cb10 con 0x7fe0341554d0 2023-10-10T21:14:36.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.093+0000 7fe0297fa700 1 -- 172.21.15.154:0/384545002 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c00f040 con 0x7fe0341554d0 2023-10-10T21:14:36.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.093+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0341532c0 con 0x7fe0341554d0 2023-10-10T21:14:36.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.093+0000 7fe0297fa700 1 -- 172.21.15.154:0/384545002 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00cee0 con 0x7fe0341554d0 2023-10-10T21:14:36.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.093+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe034155ed0 con 0x7fe0341554d0 2023-10-10T21:14:36.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.094+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe034153450 con 0x7fe0341554d0 2023-10-10T21:14:36.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.095+0000 7fe0297fa700 1 -- 172.21.15.154:0/384545002 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fe02c014690 con 0x7fe0341554d0 2023-10-10T21:14:36.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.095+0000 7fe0297fa700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe018067130 0x7fe0180695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:36.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.096+0000 7fe0297fa700 1 -- 172.21.15.154:0/384545002 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6371+0+0 (secure 0 0 0) 0x7fe02c085670 con 0x7fe0341554d0 2023-10-10T21:14:36.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.096+0000 7fe03939b700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe018067130 0x7fe0180695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:36.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.096+0000 7fe03939b700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe018067130 0x7fe0180695e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0300030c0 tx=0x7fe030016000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:36.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.100+0000 7fe0297fa700 1 -- 172.21.15.154:0/384545002 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe02c055ca0 con 0x7fe0341554d0 2023-10-10T21:14:36.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.323+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0340cd4a0 con 0x7fe018067130 2023-10-10T21:14:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.409+0000 7fe0297fa700 1 -- 172.21.15.154:0/384545002 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fe0340cd4a0 con 0x7fe018067130 2023-10-10T21:14:36.411 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-10-10T21:14:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe018067130 msgr2=0x7fe0180695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe018067130 0x7fe0180695e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0300030c0 tx=0x7fe030016000 comp rx=0 tx=0).stop 2023-10-10T21:14:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0341554d0 msgr2=0x7fe034145210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0341554d0 0x7fe034145210 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009e90 tx=0x7fe02c00b040 comp rx=0 tx=0).stop 2023-10-10T21:14:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 shutdown_connections 2023-10-10T21:14:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0341554d0 0x7fe034145210 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe018067130 0x7fe0180695e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe03406f0b0 0x7fe034156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 --2- 172.21.15.154:0/384545002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0341597d0 0x7fe0340ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 >> 172.21.15.154:0/384545002 conn(0x7fe03406adf0 msgr2=0x7fe034159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 shutdown_connections 2023-10-10T21:14:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:36.412+0000 7fe03a39d700 1 -- 172.21.15.154:0/384545002 wait complete. 2023-10-10T21:14:36.430 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-10-10T21:14:36.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:36.431 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-10T21:14:36.469 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:36.469 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:36.470 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:36.470 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:36.470 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:36.470 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:36.470 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:36.471 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:36.471 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:36.471 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:36.471 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:36.472 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:36.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:36.473 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:36.568 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:36.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:36.569 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:36.613 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:36.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:36.614 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:36.697 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:36.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:36.698 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_07_00_UTC) 2023-10-10T21:14:36.782 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:36.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:36.783 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_08_00_UTC) 2023-10-10T21:14:36.866 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:36.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:36.867 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:36.950 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:36.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:36.951 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:37.035 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:37.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:37.036 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:37.121 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:37.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:37.122 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:37.207 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:37.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:37.208 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:37.307 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:37.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:37.307 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:37.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:37.357 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-10-10T21:14:37.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-10-10T21:14:37.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.663+0000 7fe67b1ff700 1 Processor -- start 2023-10-10T21:14:37.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.664+0000 7fe67b1ff700 1 -- start start 2023-10-10T21:14:37.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe67b1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe674069a50 0x7fe6740c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:37.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe67b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 0x7fe6741569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:37.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe67b1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6740ac030 con 0x7fe6740c8490 2023-10-10T21:14:37.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe67b1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6740ab820 con 0x7fe674069a50 2023-10-10T21:14:37.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe67b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67406dbb0 con 0x7fe674069e20 2023-10-10T21:14:37.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe673fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe6740c8490 0x7fe67415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44610/0 (socket says 172.21.15.154:44610) 2023-10-10T21:14:37.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe673fff700 1 -- 172.21.15.154:0/2226530909 learned_addr learned my addr 172.21.15.154:0/2226530909 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:37.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe67979c700 1 --2- 172.21.15.154:0/2226530909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 0x7fe6741569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:37.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe678f9b700 1 --2- 172.21.15.154:0/2226530909 >> v2:172.21.15.179:3300/0 conn(0x7fe674069a50 0x7fe6740c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:37.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.665+0000 7fe6737fe700 1 -- 172.21.15.154:0/2226530909 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338457482 0 0) 0x7fe660001110 con 0x7fe6740c8490 2023-10-10T21:14:37.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe6737fe700 1 -- 172.21.15.154:0/2226530909 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe664003570 con 0x7fe6740c8490 2023-10-10T21:14:37.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe6737fe700 1 -- 172.21.15.154:0/2226530909 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3843355562 0 0) 0x7fe664003570 con 0x7fe6740c8490 2023-10-10T21:14:37.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe67979c700 1 -- 172.21.15.154:0/2226530909 >> v2:172.21.15.179:3300/0 conn(0x7fe674069a50 msgr2=0x7fe6740c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:37.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe67979c700 1 --2- 172.21.15.154:0/2226530909 >> v2:172.21.15.179:3300/0 conn(0x7fe674069a50 0x7fe6740c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe67979c700 1 -- 172.21.15.154:0/2226530909 >> v1:172.21.15.154:6789/0 conn(0x7fe6740c8490 legacy=0x7fe67415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:37.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe67979c700 1 -- 172.21.15.154:0/2226530909 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740aba70 con 0x7fe674069e20 2023-10-10T21:14:37.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe67979c700 1 --2- 172.21.15.154:0/2226530909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 0x7fe6741569b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009e60 tx=0x7fe66c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72019e34c86e9782 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:37.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe6737fe700 1 -- 172.21.15.154:0/2226530909 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00e070 con 0x7fe674069e20 2023-10-10T21:14:37.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe6737fe700 1 -- 172.21.15.154:0/2226530909 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c00b7a0 con 0x7fe674069e20 2023-10-10T21:14:37.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.666+0000 7fe6737fe700 1 -- 172.21.15.154:0/2226530909 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660001600 con 0x7fe674069e20 2023-10-10T21:14:37.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.667+0000 7fe67b1ff700 1 -- 172.21.15.154:0/2226530909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 msgr2=0x7fe6741569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:37.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.667+0000 7fe67b1ff700 1 --2- 172.21.15.154:0/2226530909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 0x7fe6741569b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009e60 tx=0x7fe66c009780 comp rx=0 tx=0).stop 2023-10-10T21:14:37.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.667+0000 7fe67b1ff700 1 -- 172.21.15.154:0/2226530909 shutdown_connections 2023-10-10T21:14:37.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.667+0000 7fe67b1ff700 1 --2- 172.21.15.154:0/2226530909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 0x7fe6741569b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.667+0000 7fe67b1ff700 1 --2- 172.21.15.154:0/2226530909 >> v2:172.21.15.179:3300/0 conn(0x7fe674069a50 0x7fe6740c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.667+0000 7fe67b1ff700 1 -- 172.21.15.154:0/2226530909 >> 172.21.15.154:0/2226530909 conn(0x7fe6740c8f90 msgr2=0x7fe6740c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:37.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.667+0000 7fe67b1ff700 1 -- 172.21.15.154:0/2226530909 shutdown_connections 2023-10-10T21:14:37.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.667+0000 7fe67b1ff700 1 -- 172.21.15.154:0/2226530909 wait complete. 2023-10-10T21:14:37.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.668+0000 7fe67b1ff700 1 Processor -- start 2023-10-10T21:14:37.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.669+0000 7fe67b1ff700 1 -- start start 2023-10-10T21:14:37.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.669+0000 7fe67b1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe674069a50 0x7fe674167690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:37.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.669+0000 7fe67b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 0x7fe674158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:37.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.669+0000 7fe67b1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6740c8490 0x7fe674153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:37.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe67b1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe674159360 con 0x7fe674069a50 2023-10-10T21:14:37.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe67b1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe674154330 con 0x7fe6740c8490 2023-10-10T21:14:37.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe67b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe674158750 con 0x7fe674069e20 2023-10-10T21:14:37.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe678f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe674069a50 0x7fe674167690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:37.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe678f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe674069a50 0x7fe674167690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44022/0 (socket says 172.21.15.154:44022) 2023-10-10T21:14:37.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe678f9b700 1 -- 172.21.15.154:0/3002024713 learned_addr learned my addr 172.21.15.154:0/3002024713 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:37.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe678f9b700 1 -- 172.21.15.154:0/3002024713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 msgr2=0x7fe674158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:37.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe678f9b700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 0x7fe674158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe678f9b700 1 -- 172.21.15.154:0/3002024713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6740c8490 msgr2=0x7fe674153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:37.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe678f9b700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6740c8490 0x7fe674153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe678f9b700 1 -- 172.21.15.154:0/3002024713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c009a20 con 0x7fe674069a50 2023-10-10T21:14:37.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.670+0000 7fe678f9b700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe674069a50 0x7fe674167690 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e930 tx=0x7fe6680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:37.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.671+0000 7fe670ff9700 1 -- 172.21.15.154:0/3002024713 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800eed0 con 0x7fe674069a50 2023-10-10T21:14:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.671+0000 7fe670ff9700 1 -- 172.21.15.154:0/3002024713 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800c850 con 0x7fe674069a50 2023-10-10T21:14:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.671+0000 7fe670ff9700 1 -- 172.21.15.154:0/3002024713 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800cbf0 con 0x7fe674069a50 2023-10-10T21:14:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.671+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe674158a30 con 0x7fe674069a50 2023-10-10T21:14:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.671+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe674158ff0 con 0x7fe674069a50 2023-10-10T21:14:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.672+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6740718b0 con 0x7fe674069a50 2023-10-10T21:14:37.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.673+0000 7fe670ff9700 1 -- 172.21.15.154:0/3002024713 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fe668013470 con 0x7fe674069a50 2023-10-10T21:14:37.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.673+0000 7fe670ff9700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe658067130 0x7fe6580695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:37.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.674+0000 7fe670ff9700 1 -- 172.21.15.154:0/3002024713 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6467+0+0 (secure 0 0 0) 0x7fe668084e80 con 0x7fe674069a50 2023-10-10T21:14:37.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.674+0000 7fe673fff700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe658067130 0x7fe6580695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:37.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.674+0000 7fe673fff700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe658067130 0x7fe6580695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe660001ed0 tx=0x7fe660000fe0 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:37.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.678+0000 7fe670ff9700 1 -- 172.21.15.154:0/3002024713 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe668051ad0 con 0x7fe674069a50 2023-10-10T21:14:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.916+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6741594a0 con 0x7fe658067130 2023-10-10T21:14:37.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.993+0000 7fe670ff9700 1 -- 172.21.15.154:0/3002024713 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fe660007140 con 0x7fe658067130 2023-10-10T21:14:37.995 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-10-10T21:14:37.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.995+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe658067130 msgr2=0x7fe6580695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:37.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.995+0000 7fe67b1ff700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe658067130 0x7fe6580695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe660001ed0 tx=0x7fe660000fe0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.995+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe674069a50 msgr2=0x7fe674167690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:37.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.995+0000 7fe67b1ff700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe674069a50 0x7fe674167690 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e930 tx=0x7fe6680091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.996+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 shutdown_connections 2023-10-10T21:14:37.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.996+0000 7fe67b1ff700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6740c8490 0x7fe674153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.996+0000 7fe67b1ff700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe674069a50 0x7fe674167690 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.996+0000 7fe67b1ff700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fe658067130 0x7fe6580695e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.996+0000 7fe67b1ff700 1 --2- 172.21.15.154:0/3002024713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe674069e20 0x7fe674158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:37.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.996+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 >> 172.21.15.154:0/3002024713 conn(0x7fe6740c8f90 msgr2=0x7fe6740b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:37.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.996+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 shutdown_connections 2023-10-10T21:14:37.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:37.996+0000 7fe67b1ff700 1 -- 172.21.15.154:0/3002024713 wait complete. 2023-10-10T21:14:38.014 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-10-10T21:14:38.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.015 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-10T21:14:38.054 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:38.054 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:38.054 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:38.055 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:38.055 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:38.055 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:38.055 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:38.055 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:38.056 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:38.056 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:38.056 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:38.057 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:38.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.058 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:38.143 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:38.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.144 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:38.247 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:38.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.248 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:38.300 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:38.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.301 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_07_00_UTC) 2023-10-10T21:14:38.350 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:38.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.351 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_08_00_UTC) 2023-10-10T21:14:38.395 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:38.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.396 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:38.479 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:38.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.480 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:38.565 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:38.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.566 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:38.649 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:38.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.650 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:38.737 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:38.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.738 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:38.821 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:38.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.822 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:38.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:38.908 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-10-10T21:14:38.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-10-10T21:14:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.179+0000 7f969339d700 1 Processor -- start 2023-10-10T21:14:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.179+0000 7f969339d700 1 -- start start 2023-10-10T21:14:39.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.180+0000 7f969339d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f968c0b03c0 0x7f968c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:39.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.180+0000 7f969339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b0790 0x7f968c0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.180+0000 7f969339d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f968c1591e0 0x7f968c159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.180+0000 7f969339d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c0cfa00 con 0x7f968c0b03c0 2023-10-10T21:14:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.180+0000 7f969339d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c0cb580 con 0x7f968c1591e0 2023-10-10T21:14:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.180+0000 7f969339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0b2de0 con 0x7f968c0b0790 2023-10-10T21:14:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.180+0000 7f969239b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f968c0b03c0 0x7f968c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f969239b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f968c0b03c0 0x7f968c0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44024/0 (socket says 172.21.15.154:44024) 2023-10-10T21:14:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f969239b700 1 -- 172.21.15.154:0/959631401 learned_addr learned my addr 172.21.15.154:0/959631401 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f9691b9a700 1 --2- 172.21.15.154:0/959631401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b0790 0x7f968c0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f9692b9c700 1 --2- 172.21.15.154:0/959631401 >> v2:172.21.15.179:3300/0 conn(0x7f968c1591e0 0x7f968c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f969239b700 1 -- 172.21.15.154:0/959631401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b0790 msgr2=0x7f968c0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:39.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f969239b700 1 --2- 172.21.15.154:0/959631401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b0790 0x7f968c0b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f969239b700 1 -- 172.21.15.154:0/959631401 >> v2:172.21.15.179:3300/0 conn(0x7f968c1591e0 msgr2=0x7f968c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:39.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f969239b700 1 --2- 172.21.15.154:0/959631401 >> v2:172.21.15.179:3300/0 conn(0x7f968c1591e0 0x7f968c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f969239b700 1 -- 172.21.15.154:0/959631401 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0cf160 con 0x7f968c0b03c0 2023-10-10T21:14:39.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f9691b9a700 1 --2- 172.21.15.154:0/959631401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b0790 0x7f968c0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:39.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f9692b9c700 1 --2- 172.21.15.154:0/959631401 >> v2:172.21.15.179:3300/0 conn(0x7f968c1591e0 0x7f968c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:39.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f969239b700 1 --2- 172.21.15.154:0/959631401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c0b03c0 0x7f968c0cea70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f968c0cb4f0 tx=0x7f9688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdccb967201a1cf server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:39.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.181+0000 7f9691399700 1 -- 172.21.15.154:0/959631401 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800b860 con 0x7f968c0b03c0 2023-10-10T21:14:39.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f9691399700 1 -- 172.21.15.154:0/959631401 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968800b9c0 con 0x7f968c0b03c0 2023-10-10T21:14:39.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f9691399700 1 -- 172.21.15.154:0/959631401 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800bd60 con 0x7f968c0b03c0 2023-10-10T21:14:39.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f969339d700 1 -- 172.21.15.154:0/959631401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c0b03c0 msgr2=0x7f968c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:39.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f969339d700 1 --2- 172.21.15.154:0/959631401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c0b03c0 0x7f968c0cea70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f968c0cb4f0 tx=0x7f9688009250 comp rx=0 tx=0).stop 2023-10-10T21:14:39.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f969339d700 1 -- 172.21.15.154:0/959631401 shutdown_connections 2023-10-10T21:14:39.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f969339d700 1 --2- 172.21.15.154:0/959631401 >> v2:172.21.15.179:3300/0 conn(0x7f968c1591e0 0x7f968c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f969339d700 1 --2- 172.21.15.154:0/959631401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c0b03c0 0x7f968c0cea70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f969339d700 1 --2- 172.21.15.154:0/959631401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b0790 0x7f968c0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f969339d700 1 -- 172.21.15.154:0/959631401 >> 172.21.15.154:0/959631401 conn(0x7f968c063230 msgr2=0x7f968c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:39.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f969339d700 1 -- 172.21.15.154:0/959631401 shutdown_connections 2023-10-10T21:14:39.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.182+0000 7f969339d700 1 -- 172.21.15.154:0/959631401 wait complete. 2023-10-10T21:14:39.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.184+0000 7f969339d700 1 Processor -- start 2023-10-10T21:14:39.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.184+0000 7f969339d700 1 -- start start 2023-10-10T21:14:39.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f969339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b03c0 0x7f968c0c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:39.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f969339d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f968c0b0790 0x7f968c0c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:39.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f969339d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c1591e0 0x7f968c169670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:39.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f969339d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0c44f0 con 0x7f968c1591e0 2023-10-10T21:14:39.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f969339d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0c47d0 con 0x7f968c0b0790 2023-10-10T21:14:39.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f969339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0c4ab0 con 0x7f968c0b03c0 2023-10-10T21:14:39.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9692b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c1591e0 0x7f968c169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:39.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9692b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c1591e0 0x7f968c169670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44026/0 (socket says 172.21.15.154:44026) 2023-10-10T21:14:39.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9692b9c700 1 -- 172.21.15.154:0/874979758 learned_addr learned my addr 172.21.15.154:0/874979758 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:39.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9691b9a700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f968c0b0790 0x7f968c0c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:39.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9692b9c700 1 -- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b03c0 msgr2=0x7f968c0c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:39.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f969239b700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b03c0 0x7f968c0c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:39.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9692b9c700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b03c0 0x7f968c0c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9692b9c700 1 -- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f968c0b0790 msgr2=0x7f968c0c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:39.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9692b9c700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f968c0b0790 0x7f968c0c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9692b9c700 1 -- 172.21.15.154:0/874979758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96880094f0 con 0x7f968c1591e0 2023-10-10T21:14:39.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9691b9a700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f968c0b0790 0x7f968c0c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:39.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f969239b700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b03c0 0x7f968c0c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:39.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.185+0000 7f9692b9c700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c1591e0 0x7f968c169670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f968400a380 tx=0x7f9684007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:39.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.186+0000 7f96827fc700 1 -- 172.21.15.154:0/874979758 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400ae10 con 0x7f968c1591e0 2023-10-10T21:14:39.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.186+0000 7f96827fc700 1 -- 172.21.15.154:0/874979758 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400d650 con 0x7f968c1591e0 2023-10-10T21:14:39.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.186+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c0c4d90 con 0x7f968c1591e0 2023-10-10T21:14:39.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.186+0000 7f96827fc700 1 -- 172.21.15.154:0/874979758 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400da10 con 0x7f968c1591e0 2023-10-10T21:14:39.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.186+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c0c5590 con 0x7f968c1591e0 2023-10-10T21:14:39.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.187+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c0ca1d0 con 0x7f968c1591e0 2023-10-10T21:14:39.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.188+0000 7f96827fc700 1 -- 172.21.15.154:0/874979758 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f968401e3b0 con 0x7f968c1591e0 2023-10-10T21:14:39.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.188+0000 7f96827fc700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9670067130 0x7f96700695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:39.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.189+0000 7f96827fc700 1 -- 172.21.15.154:0/874979758 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f9684085660 con 0x7f968c1591e0 2023-10-10T21:14:39.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.189+0000 7f969239b700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9670067130 0x7f96700695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:39.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.189+0000 7f969239b700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9670067130 0x7f96700695e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f968c0cb4f0 tx=0x7f9688017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:39.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.192+0000 7f96827fc700 1 -- 172.21.15.154:0/874979758 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f968c0ca1d0 con 0x7f968c1591e0 2023-10-10T21:14:39.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.442+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f968c0c4940 con 0x7f9670067130 2023-10-10T21:14:39.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.579+0000 7f96827fc700 1 -- 172.21.15.154:0/874979758 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f968c0c4940 con 0x7f9670067130 2023-10-10T21:14:39.580 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-10-10T21:14:39.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9670067130 msgr2=0x7f96700695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:39.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9670067130 0x7f96700695e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f968c0cb4f0 tx=0x7f9688017000 comp rx=0 tx=0).stop 2023-10-10T21:14:39.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c1591e0 msgr2=0x7f968c169670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:39.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c1591e0 0x7f968c169670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f968400a380 tx=0x7f9684007900 comp rx=0 tx=0).stop 2023-10-10T21:14:39.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 shutdown_connections 2023-10-10T21:14:39.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c1591e0 0x7f968c169670 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f9670067130 0x7f96700695e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f968c0b03c0 0x7f968c0c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 --2- 172.21.15.154:0/874979758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f968c0b0790 0x7f968c0c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 >> 172.21.15.154:0/874979758 conn(0x7f968c063230 msgr2=0x7f968c0b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 shutdown_connections 2023-10-10T21:14:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:39.581+0000 7f969339d700 1 -- 172.21.15.154:0/874979758 wait complete. 2023-10-10T21:14:39.599 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-10-10T21:14:39.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:39.601 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-10T21:14:39.639 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:39.639 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:39.640 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:39.640 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_01_UTC 2023-10-10T21:14:39.640 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:39.640 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:39.640 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:39.641 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:39.641 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:39.641 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:39.641 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:39.642 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:39.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:39.643 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:39.725 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:39.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:39.726 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:39.809 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:39.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:39.810 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:39.892 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_07_01_UTC 2023-10-10T21:14:39.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:39.893 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_07_01_UTC) 2023-10-10T21:14:39.976 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:39.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:39.977 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_08_00_UTC) 2023-10-10T21:14:40.074 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:40.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:40.075 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:40.118 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:40.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:40.119 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:40.200 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:40.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:40.201 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:40.285 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:40.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:40.286 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:40.370 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:40.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:40.371 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:40.453 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:40.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:40.454 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:40.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:40.538 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-10-10T21:14:40.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-10-10T21:14:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.843+0000 7f5a8299d700 1 Processor -- start 2023-10-10T21:14:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.843+0000 7f5a8299d700 1 -- start start 2023-10-10T21:14:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.844+0000 7f5a8299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 0x7f5a7c0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.844+0000 7f5a8299d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a7c0ac0e0 0x7f5a7c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.844+0000 7f5a8299d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a7c06eee0 0x7f5a7c06f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:40.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.844+0000 7f5a8299d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c06e510 con 0x7f5a7c0ac0e0 2023-10-10T21:14:40.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.844+0000 7f5a8299d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c069180 con 0x7f5a7c06eee0 2023-10-10T21:14:40.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.844+0000 7f5a8299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c06dec0 con 0x7f5a7c1597d0 2023-10-10T21:14:40.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8119a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a7c0ac0e0 0x7f5a7c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:40.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8119a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a7c0ac0e0 0x7f5a7c06e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44030/0 (socket says 172.21.15.154:44030) 2023-10-10T21:14:40.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8119a700 1 -- 172.21.15.154:0/7239537 learned_addr learned my addr 172.21.15.154:0/7239537 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:40.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8199b700 1 --2- 172.21.15.154:0/7239537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 0x7f5a7c0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:40.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8219c700 1 --2- 172.21.15.154:0/7239537 >> v2:172.21.15.179:3300/0 conn(0x7f5a7c06eee0 0x7f5a7c06f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:40.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8119a700 1 -- 172.21.15.154:0/7239537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 msgr2=0x7f5a7c0afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:40.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8119a700 1 --2- 172.21.15.154:0/7239537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 0x7f5a7c0afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:40.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8119a700 1 -- 172.21.15.154:0/7239537 >> v2:172.21.15.179:3300/0 conn(0x7f5a7c06eee0 msgr2=0x7f5a7c06f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:40.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8119a700 1 --2- 172.21.15.154:0/7239537 >> v2:172.21.15.179:3300/0 conn(0x7f5a7c06eee0 0x7f5a7c06f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:40.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8119a700 1 -- 172.21.15.154:0/7239537 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c06e1a0 con 0x7f5a7c0ac0e0 2023-10-10T21:14:40.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8219c700 1 --2- 172.21.15.154:0/7239537 >> v2:172.21.15.179:3300/0 conn(0x7f5a7c06eee0 0x7f5a7c06f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:40.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.845+0000 7f5a8119a700 1 --2- 172.21.15.154:0/7239537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c0ac0e0 0x7f5a7c06e9a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c069890 tx=0x7f5a6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d8772b35913154 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:40.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a80999700 1 -- 172.21.15.154:0/7239537 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c00b860 con 0x7f5a7c0ac0e0 2023-10-10T21:14:40.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a80999700 1 -- 172.21.15.154:0/7239537 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c00b9c0 con 0x7f5a7c0ac0e0 2023-10-10T21:14:40.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a80999700 1 -- 172.21.15.154:0/7239537 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c00bd60 con 0x7f5a7c0ac0e0 2023-10-10T21:14:40.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a8299d700 1 -- 172.21.15.154:0/7239537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c0ac0e0 msgr2=0x7f5a7c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:40.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a8299d700 1 --2- 172.21.15.154:0/7239537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c0ac0e0 0x7f5a7c06e9a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c069890 tx=0x7f5a6c009250 comp rx=0 tx=0).stop 2023-10-10T21:14:40.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a8299d700 1 -- 172.21.15.154:0/7239537 shutdown_connections 2023-10-10T21:14:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a8299d700 1 --2- 172.21.15.154:0/7239537 >> v2:172.21.15.179:3300/0 conn(0x7f5a7c06eee0 0x7f5a7c06f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a8299d700 1 --2- 172.21.15.154:0/7239537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 0x7f5a7c0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a8299d700 1 --2- 172.21.15.154:0/7239537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c0ac0e0 0x7f5a7c06e9a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a8299d700 1 -- 172.21.15.154:0/7239537 >> 172.21.15.154:0/7239537 conn(0x7f5a7c06adf0 msgr2=0x7f5a7c0ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a8299d700 1 -- 172.21.15.154:0/7239537 shutdown_connections 2023-10-10T21:14:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.846+0000 7f5a8299d700 1 -- 172.21.15.154:0/7239537 wait complete. 2023-10-10T21:14:40.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.848+0000 7f5a8299d700 1 Processor -- start 2023-10-10T21:14:40.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.848+0000 7f5a8299d700 1 -- start start 2023-10-10T21:14:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a7c06eee0 0x7f5a7c169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 0x7f5a7c156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8299d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c16d0c0 0x7f5a7c16d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8299d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0c20b0 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c15e980 con 0x7f5a7c06eee0 2023-10-10T21:14:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c16df10 con 0x7f5a7c1597d0 2023-10-10T21:14:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8199b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a7c06eee0 0x7f5a7c169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8119a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 0x7f5a7c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8219c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c16d0c0 0x7f5a7c16d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8199b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a7c06eee0 0x7f5a7c169b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:50916/0 (socket says 172.21.15.154:50916) 2023-10-10T21:14:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.849+0000 7f5a8199b700 1 -- 172.21.15.154:0/3424948553 learned_addr learned my addr 172.21.15.154:0/3424948553 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a8219c700 1 -- 172.21.15.154:0/3424948553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 msgr2=0x7f5a7c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a8219c700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 0x7f5a7c156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a8219c700 1 -- 172.21.15.154:0/3424948553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a7c06eee0 msgr2=0x7f5a7c169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a8219c700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a7c06eee0 0x7f5a7c169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a8219c700 1 -- 172.21.15.154:0/3424948553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0094f0 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a8199b700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a7c06eee0 0x7f5a7c169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:40.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a8219c700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c16d0c0 0x7f5a7c16d560 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400cf30 tx=0x7f5a74007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:40.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a71ffb700 1 -- 172.21.15.154:0/3424948553 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400ae40 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a71ffb700 1 -- 172.21.15.154:0/3424948553 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74015440 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c16dc30 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a71ffb700 1 -- 172.21.15.154:0/3424948553 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74015800 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.850+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c0c1d40 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.851+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7c0c2220 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.852+0000 7f5a71ffb700 1 -- 172.21.15.154:0/3424948553 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f5a7400d440 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.853+0000 7f5a71ffb700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a60067130 0x7f5a600695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:40.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.853+0000 7f5a71ffb700 1 -- 172.21.15.154:0/3424948553 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5a740858d0 con 0x7f5a7c16d0c0 2023-10-10T21:14:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.853+0000 7f5a8199b700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a60067130 0x7f5a600695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.854+0000 7f5a8199b700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a60067130 0x7f5a600695e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a78006fd0 tx=0x7f5a78008040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:40.858+0000 7f5a71ffb700 1 -- 172.21.15.154:0/3424948553 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a74052430 con 0x7f5a7c16d0c0 2023-10-10T21:14:41.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.090+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a7c0af4e0 con 0x7f5a60067130 2023-10-10T21:14:41.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.186+0000 7f5a71ffb700 1 -- 172.21.15.154:0/3424948553 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5a7c0af4e0 con 0x7f5a60067130 2023-10-10T21:14:41.188 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-10-10T21:14:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a60067130 msgr2=0x7f5a600695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a60067130 0x7f5a600695e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a78006fd0 tx=0x7f5a78008040 comp rx=0 tx=0).stop 2023-10-10T21:14:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c16d0c0 msgr2=0x7f5a7c16d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c16d0c0 0x7f5a7c16d560 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400cf30 tx=0x7f5a74007840 comp rx=0 tx=0).stop 2023-10-10T21:14:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 shutdown_connections 2023-10-10T21:14:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a7c16d0c0 0x7f5a7c16d560 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a7c06eee0 0x7f5a7c169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f5a60067130 0x7f5a600695e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 --2- 172.21.15.154:0/3424948553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7c1597d0 0x7f5a7c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 >> 172.21.15.154:0/3424948553 conn(0x7f5a7c06adf0 msgr2=0x7f5a7c0ac650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:41.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 shutdown_connections 2023-10-10T21:14:41.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:41.189+0000 7f5a8299d700 1 -- 172.21.15.154:0/3424948553 wait complete. 2023-10-10T21:14:41.208 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-10-10T21:14:41.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.209 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-10T21:14:41.248 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:41.248 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:41.249 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:41.249 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:41.249 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:41.249 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:41.249 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:41.249 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:41.250 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:41.250 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:41.250 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:41.251 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:41.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.253 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:41.338 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:41.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.339 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:41.421 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:41.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.422 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:41.506 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:41.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.507 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_07_00_UTC) 2023-10-10T21:14:41.589 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:41.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.590 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_08_00_UTC) 2023-10-10T21:14:41.672 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:41.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.673 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:41.757 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:41.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.757 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:41.840 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:41.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.841 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:41.924 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:41.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:41.925 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:42.007 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:42.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:42.008 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:42.111 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:42.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:42.112 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:42.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:42.158 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-10-10T21:14:42.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-10-10T21:14:42.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.482+0000 7fa808f9d700 1 Processor -- start 2023-10-10T21:14:42.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.482+0000 7fa808f9d700 1 -- start start 2023-10-10T21:14:42.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.483+0000 7fa808f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8040b03c0 0x7fa8040cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:42.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.483+0000 7fa808f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040cfa00 con 0x7fa8041591e0 2023-10-10T21:14:42.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.484+0000 7fa808f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040cb580 con 0x7fa8040b0790 2023-10-10T21:14:42.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.484+0000 7fa808f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8040cf160 con 0x7fa8040b03c0 2023-10-10T21:14:42.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.484+0000 7fa8037fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8040b03c0 0x7fa8040cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:42.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.484+0000 7fa803fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa8041591e0 0x7fa804159600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44624/0 (socket says 172.21.15.154:44624) 2023-10-10T21:14:42.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.484+0000 7fa803fff700 1 -- 172.21.15.154:0/2955929826 learned_addr learned my addr 172.21.15.154:0/2955929826 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:42.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.484+0000 7fa8037fe700 1 -- 172.21.15.154:0/2955929826 >> v1:172.21.15.179:6789/0 conn(0x7fa8040b0790 legacy=0x7fa8040b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:42.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.484+0000 7fa8027fc700 1 -- 172.21.15.154:0/2955929826 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147029391 0 0) 0x7fa8040cb580 con 0x7fa8040b0790 2023-10-10T21:14:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.484+0000 7fa8037fe700 1 -- 172.21.15.154:0/2955929826 >> v1:172.21.15.154:6789/0 conn(0x7fa8041591e0 legacy=0x7fa804159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.484+0000 7fa8037fe700 1 -- 172.21.15.154:0/2955929826 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040cf440 con 0x7fa8040b03c0 2023-10-10T21:14:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.485+0000 7fa8037fe700 1 --2- 172.21.15.154:0/2955929826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b03c0 0x7fa8040cea70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009910 tx=0x7fa7f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cfe920c067a6a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.485+0000 7fa8027fc700 1 -- 172.21.15.154:0/2955929826 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400b820 con 0x7fa8040b03c0 2023-10-10T21:14:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.485+0000 7fa8027fc700 1 -- 172.21.15.154:0/2955929826 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400b980 con 0x7fa8040b03c0 2023-10-10T21:14:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.485+0000 7fa8027fc700 1 -- 172.21.15.154:0/2955929826 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400bd20 con 0x7fa8040b03c0 2023-10-10T21:14:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.485+0000 7fa808f9d700 1 -- 172.21.15.154:0/2955929826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b03c0 msgr2=0x7fa8040cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.485+0000 7fa808f9d700 1 --2- 172.21.15.154:0/2955929826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b03c0 0x7fa8040cea70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009910 tx=0x7fa7f40091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.486+0000 7fa808f9d700 1 -- 172.21.15.154:0/2955929826 shutdown_connections 2023-10-10T21:14:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.486+0000 7fa808f9d700 1 --2- 172.21.15.154:0/2955929826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b03c0 0x7fa8040cea70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:42.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.486+0000 7fa808f9d700 1 -- 172.21.15.154:0/2955929826 >> 172.21.15.154:0/2955929826 conn(0x7fa804063230 msgr2=0x7fa804063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:42.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.486+0000 7fa808f9d700 1 -- 172.21.15.154:0/2955929826 shutdown_connections 2023-10-10T21:14:42.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.486+0000 7fa808f9d700 1 -- 172.21.15.154:0/2955929826 wait complete. 2023-10-10T21:14:42.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.487+0000 7fa808f9d700 1 Processor -- start 2023-10-10T21:14:42.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.487+0000 7fa808f9d700 1 -- start start 2023-10-10T21:14:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.488+0000 7fa808f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8040b03c0 0x7fa8040c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.488+0000 7fa808f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b0790 0x7fa804156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.488+0000 7fa808f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8041591e0 0x7fa80416d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.488+0000 7fa808f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80416d070 con 0x7fa8040b0790 2023-10-10T21:14:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.488+0000 7fa808f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c83e0 con 0x7fa8041591e0 2023-10-10T21:14:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.488+0000 7fa808f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c5f70 con 0x7fa8040b03c0 2023-10-10T21:14:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.488+0000 7fa802ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b0790 0x7fa804156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.488+0000 7fa802ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b0790 0x7fa804156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44070/0 (socket says 172.21.15.154:44070) 2023-10-10T21:14:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.488+0000 7fa802ffd700 1 -- 172.21.15.154:0/1402056412 learned_addr learned my addr 172.21.15.154:0/1402056412 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa8037fe700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8040b03c0 0x7fa8040c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:42.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa803fff700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8041591e0 0x7fa80416d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:42.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa802ffd700 1 -- 172.21.15.154:0/1402056412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8040b03c0 msgr2=0x7fa8040c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:42.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa802ffd700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8040b03c0 0x7fa8040c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:42.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa802ffd700 1 -- 172.21.15.154:0/1402056412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8041591e0 msgr2=0x7fa80416d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:42.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa802ffd700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8041591e0 0x7fa80416d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:42.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa802ffd700 1 -- 172.21.15.154:0/1402056412 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4009420 con 0x7fa8040b0790 2023-10-10T21:14:42.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa802ffd700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b0790 0x7fa804156960 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c840 tx=0x7fa7f8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:42.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa7eb7fe700 1 -- 172.21.15.154:0/1402056412 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80105c0 con 0x7fa8040b0790 2023-10-10T21:14:42.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa7eb7fe700 1 -- 172.21.15.154:0/1402056412 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8010720 con 0x7fa8040b0790 2023-10-10T21:14:42.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8040c7b40 con 0x7fa8040b0790 2023-10-10T21:14:42.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.489+0000 7fa7eb7fe700 1 -- 172.21.15.154:0/1402056412 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8010ae0 con 0x7fa8040b0790 2023-10-10T21:14:42.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.490+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8040c8100 con 0x7fa8040b0790 2023-10-10T21:14:42.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.490+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80404c3c0 con 0x7fa8040b0790 2023-10-10T21:14:42.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.491+0000 7fa7eb7fe700 1 -- 172.21.15.154:0/1402056412 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fa7f801b3b0 con 0x7fa8040b0790 2023-10-10T21:14:42.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.492+0000 7fa7eb7fe700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa7f0067130 0x7fa7f00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:42.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.492+0000 7fa7eb7fe700 1 -- 172.21.15.154:0/1402056412 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6451+0+0 (secure 0 0 0) 0x7fa7f8084120 con 0x7fa8040b0790 2023-10-10T21:14:42.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.492+0000 7fa8037fe700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa7f0067130 0x7fa7f00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:42.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.493+0000 7fa8037fe700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa7f0067130 0x7fa7f00695e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40093f0 tx=0x7fa7f4017000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:42.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.496+0000 7fa7eb7fe700 1 -- 172.21.15.154:0/1402056412 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7f8050e20 con 0x7fa8040b0790 2023-10-10T21:14:42.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.713+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa804159c00 con 0x7fa7f0067130 2023-10-10T21:14:42.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.792+0000 7fa7eb7fe700 1 -- 172.21.15.154:0/1402056412 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fa804159c00 con 0x7fa7f0067130 2023-10-10T21:14:42.794 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-10-10T21:14:42.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.794+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa7f0067130 msgr2=0x7fa7f00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:42.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.794+0000 7fa808f9d700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa7f0067130 0x7fa7f00695e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40093f0 tx=0x7fa7f4017000 comp rx=0 tx=0).stop 2023-10-10T21:14:42.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.794+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b0790 msgr2=0x7fa804156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.794+0000 7fa808f9d700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b0790 0x7fa804156960 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c840 tx=0x7fa7f8007df0 comp rx=0 tx=0).stop 2023-10-10T21:14:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.795+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 shutdown_connections 2023-10-10T21:14:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.795+0000 7fa808f9d700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8041591e0 0x7fa80416d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.795+0000 7fa808f9d700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fa7f0067130 0x7fa7f00695e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.795+0000 7fa808f9d700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8040b03c0 0x7fa8040c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.795+0000 7fa808f9d700 1 --2- 172.21.15.154:0/1402056412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8040b0790 0x7fa804156960 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.795+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 >> 172.21.15.154:0/1402056412 conn(0x7fa804063230 msgr2=0x7fa804068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.795+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 shutdown_connections 2023-10-10T21:14:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:42.795+0000 7fa808f9d700 1 -- 172.21.15.154:0/1402056412 wait complete. 2023-10-10T21:14:42.812 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-10-10T21:14:42.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:42.814 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-10T21:14:42.852 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:42.852 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:42.853 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:42.853 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:42.853 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_01_UTC 2023-10-10T21:14:42.854 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:42.854 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:42.854 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:42.855 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:42.855 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:42.855 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:42.857 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:42.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:42.858 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:42.942 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:42.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:42.944 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:43.027 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:43.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.028 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:43.130 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:43.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.131 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_07_00_UTC) 2023-10-10T21:14:43.177 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_08_01_UTC 2023-10-10T21:14:43.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.178 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_08_01_UTC) 2023-10-10T21:14:43.261 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:43.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.262 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:43.345 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:43.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.346 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:43.429 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:43.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.430 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:43.521 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:43.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.523 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:43.579 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:43.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.580 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:43.623 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:43.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.624 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:43.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:43.708 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-10-10T21:14:43.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-10-10T21:14:44.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.013+0000 7f3dd97ff700 1 Processor -- start 2023-10-10T21:14:44.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.013+0000 7f3dd97ff700 1 -- start start 2023-10-10T21:14:44.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd97ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3dd41563b0 0x7f3dd4156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:44.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd97ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3dd4068890 0x7f3dd40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:44.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd97ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd415a9b0 con 0x7f3dd415a440 2023-10-10T21:14:44.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd97ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd415ac90 con 0x7f3dd4068890 2023-10-10T21:14:44.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd97ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd415af70 con 0x7f3dd41563b0 2023-10-10T21:14:44.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3dd4068890 0x7f3dd40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:44.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3dd4068890 0x7f3dd40c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44082/0 (socket says 172.21.15.154:44082) 2023-10-10T21:14:44.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd37fe700 1 -- 172.21.15.154:0/127623363 learned_addr learned my addr 172.21.15.154:0/127623363 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:44.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd2ffd700 1 --2- 172.21.15.154:0/127623363 >> v2:172.21.15.179:3300/0 conn(0x7f3dd41563b0 0x7f3dd4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:44.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd37fe700 1 -- 172.21.15.154:0/127623363 >> v2:172.21.15.179:3300/0 conn(0x7f3dd41563b0 msgr2=0x7f3dd4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:44.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd37fe700 1 --2- 172.21.15.154:0/127623363 >> v2:172.21.15.179:3300/0 conn(0x7f3dd41563b0 0x7f3dd4156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:44.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd37fe700 1 -- 172.21.15.154:0/127623363 >> v1:172.21.15.179:6789/0 conn(0x7f3dd415a440 legacy=0x7f3dd40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:44.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.015+0000 7f3dd37fe700 1 -- 172.21.15.154:0/127623363 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd415b250 con 0x7f3dd4068890 2023-10-10T21:14:44.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.016+0000 7f3dd37fe700 1 --2- 172.21.15.154:0/127623363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd4068890 0x7f3dd40c8230 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3dd406a9f0 tx=0x7f3dcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42ff922225d2fd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:44.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.016+0000 7f3dd27fc700 1 -- 172.21.15.154:0/127623363 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00e070 con 0x7f3dd4068890 2023-10-10T21:14:44.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.016+0000 7f3dd27fc700 1 -- 172.21.15.154:0/127623363 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc00ba10 con 0x7f3dd4068890 2023-10-10T21:14:44.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.016+0000 7f3dd27fc700 1 -- 172.21.15.154:0/127623363 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0092e0 con 0x7f3dd4068890 2023-10-10T21:14:44.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.016+0000 7f3dd97ff700 1 -- 172.21.15.154:0/127623363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd4068890 msgr2=0x7f3dd40c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.016+0000 7f3dd97ff700 1 --2- 172.21.15.154:0/127623363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd4068890 0x7f3dd40c8230 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3dd406a9f0 tx=0x7f3dcc009840 comp rx=0 tx=0).stop 2023-10-10T21:14:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.016+0000 7f3dd97ff700 1 -- 172.21.15.154:0/127623363 shutdown_connections 2023-10-10T21:14:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.017+0000 7f3dd97ff700 1 --2- 172.21.15.154:0/127623363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd4068890 0x7f3dd40c8230 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.017+0000 7f3dd97ff700 1 --2- 172.21.15.154:0/127623363 >> v2:172.21.15.179:3300/0 conn(0x7f3dd41563b0 0x7f3dd4156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.017+0000 7f3dd97ff700 1 -- 172.21.15.154:0/127623363 >> 172.21.15.154:0/127623363 conn(0x7f3dd40c8f90 msgr2=0x7f3dd40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.017+0000 7f3dd97ff700 1 -- 172.21.15.154:0/127623363 shutdown_connections 2023-10-10T21:14:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.017+0000 7f3dd97ff700 1 -- 172.21.15.154:0/127623363 wait complete. 2023-10-10T21:14:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.018+0000 7f3dd97ff700 1 Processor -- start 2023-10-10T21:14:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.018+0000 7f3dd97ff700 1 -- start start 2023-10-10T21:14:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.019+0000 7f3dd97ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd4068890 0x7f3dd40bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.019+0000 7f3dd97ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd41563b0 0x7f3dd4152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.019+0000 7f3dd97ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd415a440 0x7f3dd40b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.019+0000 7f3dd97ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40b0a00 con 0x7f3dd415a440 2023-10-10T21:14:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.019+0000 7f3dd97ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40b0720 con 0x7f3dd41563b0 2023-10-10T21:14:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.019+0000 7f3dd97ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd41585e0 con 0x7f3dd4068890 2023-10-10T21:14:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.019+0000 7f3dd37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd415a440 0x7f3dd40b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.019+0000 7f3dd37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd415a440 0x7f3dd40b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44086/0 (socket says 172.21.15.154:44086) 2023-10-10T21:14:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.019+0000 7f3dd37fe700 1 -- 172.21.15.154:0/3736310855 learned_addr learned my addr 172.21.15.154:0/3736310855 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dd2ffd700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd4068890 0x7f3dd40bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dcbfff700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd41563b0 0x7f3dd4152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dd37fe700 1 -- 172.21.15.154:0/3736310855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd4068890 msgr2=0x7f3dd40bfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:44.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dd37fe700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd4068890 0x7f3dd40bfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:44.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dd37fe700 1 -- 172.21.15.154:0/3736310855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd41563b0 msgr2=0x7f3dd4152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:44.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dd37fe700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd41563b0 0x7f3dd4152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:44.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dd37fe700 1 -- 172.21.15.154:0/3736310855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc009ae0 con 0x7f3dd415a440 2023-10-10T21:14:44.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dd37fe700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd415a440 0x7f3dd40b1660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009880 tx=0x7f3dcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dcaffd700 1 -- 172.21.15.154:0/3736310855 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc012e60 con 0x7f3dd415a440 2023-10-10T21:14:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dcaffd700 1 -- 172.21.15.154:0/3736310855 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc0092e0 con 0x7f3dd415a440 2023-10-10T21:14:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dcaffd700 1 -- 172.21.15.154:0/3736310855 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc01d650 con 0x7f3dd415a440 2023-10-10T21:14:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd41588c0 con 0x7f3dd415a440 2023-10-10T21:14:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.020+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd40b0340 con 0x7f3dd415a440 2023-10-10T21:14:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.021+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd4158440 con 0x7f3dd415a440 2023-10-10T21:14:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.022+0000 7f3dcaffd700 1 -- 172.21.15.154:0/3736310855 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f3dcc01da40 con 0x7f3dd415a440 2023-10-10T21:14:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.023+0000 7f3dcaffd700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3db4067130 0x7f3db40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.023+0000 7f3dcaffd700 1 -- 172.21.15.154:0/3736310855 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f3dcc086530 con 0x7f3dd415a440 2023-10-10T21:14:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.023+0000 7f3dd2ffd700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3db4067130 0x7f3db40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.024+0000 7f3dd2ffd700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3db4067130 0x7f3db40695e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4006fd0 tx=0x7f3dc4008040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.027+0000 7f3dcaffd700 1 -- 172.21.15.154:0/3736310855 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dd4158440 con 0x7f3dd415a440 2023-10-10T21:14:44.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.266+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dd4158de0 con 0x7f3db4067130 2023-10-10T21:14:44.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.348+0000 7f3dcaffd700 1 -- 172.21.15.154:0/3736310855 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f3dd4158de0 con 0x7f3db4067130 2023-10-10T21:14:44.350 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-10-10T21:14:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3db4067130 msgr2=0x7f3db40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3db4067130 0x7f3db40695e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4006fd0 tx=0x7f3dc4008040 comp rx=0 tx=0).stop 2023-10-10T21:14:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd415a440 msgr2=0x7f3dd40b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd415a440 0x7f3dd40b1660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009880 tx=0x7f3dcc017000 comp rx=0 tx=0).stop 2023-10-10T21:14:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 shutdown_connections 2023-10-10T21:14:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd415a440 0x7f3dd40b1660 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f3db4067130 0x7f3db40695e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd4068890 0x7f3dd40bfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:44.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 --2- 172.21.15.154:0/3736310855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd41563b0 0x7f3dd4152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:44.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 >> 172.21.15.154:0/3736310855 conn(0x7f3dd40c8f90 msgr2=0x7f3dd406e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:44.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 shutdown_connections 2023-10-10T21:14:44.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:44.351+0000 7f3dd97ff700 1 -- 172.21.15.154:0/3736310855 wait complete. 2023-10-10T21:14:44.369 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-10-10T21:14:44.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:44.370 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-10T21:14:44.408 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:44.408 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:44.408 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:44.409 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:44.409 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:44.409 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:44.409 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:44.409 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:44.410 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:44.410 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:44.410 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:44.411 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:44.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:44.412 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:44.495 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:44.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:44.496 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:44.580 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:44.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:44.581 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:44.663 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:44.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:44.664 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_07_00_UTC) 2023-10-10T21:14:44.749 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:44.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:44.750 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_08_00_UTC) 2023-10-10T21:14:44.837 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:44.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:44.838 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:44.883 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:44.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:44.884 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:44.970 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:44.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:44.971 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:45.087 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:45.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:45.087 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:45.131 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:45.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:45.132 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:45.215 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:45.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:45.216 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:45.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:45.316 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-10-10T21:14:45.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-10-10T21:14:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.563+0000 7f8f7959d700 1 Processor -- start 2023-10-10T21:14:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.563+0000 7f8f7959d700 1 -- start start 2023-10-10T21:14:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.564+0000 7f8f7959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 0x7f8f740cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.564+0000 7f8f7959d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f740cfa00 con 0x7f8f740b03c0 2023-10-10T21:14:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.564+0000 7f8f7959d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f740cb580 con 0x7f8f740b0790 2023-10-10T21:14:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.564+0000 7f8f7959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f740cf160 con 0x7f8f740cca20 2023-10-10T21:14:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.564+0000 7f8f73fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8f740b03c0 0x7f8f740b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44628/0 (socket says 172.21.15.154:44628) 2023-10-10T21:14:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.564+0000 7f8f73fff700 1 -- 172.21.15.154:0/3378980896 learned_addr learned my addr 172.21.15.154:0/3378980896 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.565+0000 7f8f78d9c700 1 --2- 172.21.15.154:0/3378980896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 0x7f8f740cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.565+0000 7f8f72ffd700 1 -- 172.21.15.154:0/3378980896 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916671664 0 0) 0x7f8f740cfa00 con 0x7f8f740b03c0 2023-10-10T21:14:45.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.565+0000 7f8f72ffd700 1 -- 172.21.15.154:0/3378980896 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f5c003570 con 0x7f8f740b03c0 2023-10-10T21:14:45.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.565+0000 7f8f78d9c700 1 -- 172.21.15.154:0/3378980896 >> v1:172.21.15.179:6789/0 conn(0x7f8f740b0790 legacy=0x7f8f741591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:45.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.565+0000 7f8f72ffd700 1 -- 172.21.15.154:0/3378980896 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285408601 0 0) 0x7f8f740cb580 con 0x7f8f740b0790 2023-10-10T21:14:45.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.565+0000 7f8f78d9c700 1 -- 172.21.15.154:0/3378980896 >> v1:172.21.15.154:6789/0 conn(0x7f8f740b03c0 legacy=0x7f8f740b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:45.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.565+0000 7f8f78d9c700 1 -- 172.21.15.154:0/3378980896 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f740cf440 con 0x7f8f740cca20 2023-10-10T21:14:45.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.565+0000 7f8f78d9c700 1 --2- 172.21.15.154:0/3378980896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 0x7f8f740cea70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009ec0 tx=0x7f8f6c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb71ae073affdbc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:45.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f72ffd700 1 -- 172.21.15.154:0/3378980896 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00e070 con 0x7f8f740cca20 2023-10-10T21:14:45.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f72ffd700 1 -- 172.21.15.154:0/3378980896 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c00bbf0 con 0x7f8f740cca20 2023-10-10T21:14:45.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f72ffd700 1 -- 172.21.15.154:0/3378980896 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c012430 con 0x7f8f740cca20 2023-10-10T21:14:45.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f7959d700 1 -- 172.21.15.154:0/3378980896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 msgr2=0x7f8f740cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:45.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f7959d700 1 --2- 172.21.15.154:0/3378980896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 0x7f8f740cea70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009ec0 tx=0x7f8f6c009780 comp rx=0 tx=0).stop 2023-10-10T21:14:45.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f7959d700 1 -- 172.21.15.154:0/3378980896 shutdown_connections 2023-10-10T21:14:45.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f7959d700 1 --2- 172.21.15.154:0/3378980896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 0x7f8f740cea70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:45.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f7959d700 1 -- 172.21.15.154:0/3378980896 >> 172.21.15.154:0/3378980896 conn(0x7f8f74063230 msgr2=0x7f8f74063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:45.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f7959d700 1 -- 172.21.15.154:0/3378980896 shutdown_connections 2023-10-10T21:14:45.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.566+0000 7f8f7959d700 1 -- 172.21.15.154:0/3378980896 wait complete. 2023-10-10T21:14:45.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.568+0000 7f8f7959d700 1 Processor -- start 2023-10-10T21:14:45.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.568+0000 7f8f7959d700 1 -- start start 2023-10-10T21:14:45.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f7959d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f740b03c0 0x7f8f740c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:45.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f7959d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f740b0790 0x7f8f7415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:45.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f7959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 0x7f8f7415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:45.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f7959d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f740ca270 con 0x7f8f740b0790 2023-10-10T21:14:45.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f7959d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f74169280 con 0x7f8f740b03c0 2023-10-10T21:14:45.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f7959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f740c9660 con 0x7f8f740cca20 2023-10-10T21:14:45.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f737fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f740b0790 0x7f8f7415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:45.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f737fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f740b0790 0x7f8f7415a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44092/0 (socket says 172.21.15.154:44092) 2023-10-10T21:14:45.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f737fe700 1 -- 172.21.15.154:0/3223470917 learned_addr learned my addr 172.21.15.154:0/3223470917 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:45.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f78d9c700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 0x7f8f7415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:45.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f73fff700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f740b03c0 0x7f8f740c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:45.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f737fe700 1 -- 172.21.15.154:0/3223470917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 msgr2=0x7f8f7415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:45.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f737fe700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 0x7f8f7415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:45.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f737fe700 1 -- 172.21.15.154:0/3223470917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f740b03c0 msgr2=0x7f8f740c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:45.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f737fe700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f740b03c0 0x7f8f740c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:45.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f737fe700 1 -- 172.21.15.154:0/3223470917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c009a20 con 0x7f8f740b0790 2023-10-10T21:14:45.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.569+0000 7f8f73fff700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f740b03c0 0x7f8f740c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:45.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.570+0000 7f8f737fe700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f740b0790 0x7f8f7415a730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800c810 tx=0x7f8f68007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:45.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.570+0000 7f8f5bfff700 1 -- 172.21.15.154:0/3223470917 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68011590 con 0x7f8f740b0790 2023-10-10T21:14:45.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.570+0000 7f8f5bfff700 1 -- 172.21.15.154:0/3223470917 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f68011710 con 0x7f8f740b0790 2023-10-10T21:14:45.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.570+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f740c9940 con 0x7f8f740b0790 2023-10-10T21:14:45.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.570+0000 7f8f5bfff700 1 -- 172.21.15.154:0/3223470917 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68011ad0 con 0x7f8f740b0790 2023-10-10T21:14:45.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.570+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f740c9f00 con 0x7f8f740b0790 2023-10-10T21:14:45.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.571+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f740ca420 con 0x7f8f740b0790 2023-10-10T21:14:45.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.572+0000 7f8f5bfff700 1 -- 172.21.15.154:0/3223470917 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f8f6801b3b0 con 0x7f8f740b0790 2023-10-10T21:14:45.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.573+0000 7f8f5bfff700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8f60067130 0x7f8f600695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:45.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.573+0000 7f8f5bfff700 1 -- 172.21.15.154:0/3223470917 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f8f680842f0 con 0x7f8f740b0790 2023-10-10T21:14:45.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.573+0000 7f8f73fff700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8f60067130 0x7f8f600695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:45.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.574+0000 7f8f73fff700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8f60067130 0x7f8f600695e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f640058d0 tx=0x7f8f64009040 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:45.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.577+0000 7f8f5bfff700 1 -- 172.21.15.154:0/3223470917 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f740ca420 con 0x7f8f740b0790 2023-10-10T21:14:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.795+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 --> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f740ca420 con 0x7f8f60067130 2023-10-10T21:14:45.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.869+0000 7f8f5bfff700 1 -- 172.21.15.154:0/3223470917 <== mgr.5157 v2:172.21.15.154:6832/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f8f740ca420 con 0x7f8f60067130 2023-10-10T21:14:45.870 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-10-10T21:14:45.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8f60067130 msgr2=0x7f8f600695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:45.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8f60067130 0x7f8f600695e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f640058d0 tx=0x7f8f64009040 comp rx=0 tx=0).stop 2023-10-10T21:14:45.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f740b0790 msgr2=0x7f8f7415a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:45.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f740b0790 0x7f8f7415a730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800c810 tx=0x7f8f68007df0 comp rx=0 tx=0).stop 2023-10-10T21:14:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 shutdown_connections 2023-10-10T21:14:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8f60067130 0x7f8f600695e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f740cca20 0x7f8f7415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f740b03c0 0x7f8f740c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:45.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 --2- 172.21.15.154:0/3223470917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f740b0790 0x7f8f7415a730 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 >> 172.21.15.154:0/3223470917 conn(0x7f8f74063230 msgr2=0x7f8f7415dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 shutdown_connections 2023-10-10T21:14:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:45.872+0000 7f8f7959d700 1 -- 172.21.15.154:0/3223470917 wait complete. 2023-10-10T21:14:45.890 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-10-10T21:14:45.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:45.891 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-10T21:14:45.929 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:45.930 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:45.930 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:45.930 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:45.930 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:45.930 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:45.931 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:45.931 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:45.931 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:45.931 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:45.931 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:45.932 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_04_00_UTC 2023-10-10T21:14:45.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:45.933 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_04_00_UTC) 2023-10-10T21:14:46.019 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_05_00_UTC 2023-10-10T21:14:46.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.020 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_05_00_UTC) 2023-10-10T21:14:46.122 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_06_00_UTC 2023-10-10T21:14:46.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.123 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_06_00_UTC) 2023-10-10T21:14:46.168 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_07_00_UTC 2023-10-10T21:14:46.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.169 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_07_00_UTC) 2023-10-10T21:14:46.254 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_08_00_UTC 2023-10-10T21:14:46.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.255 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_08_00_UTC) 2023-10-10T21:14:46.339 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_09_00_UTC 2023-10-10T21:14:46.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.340 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_09_00_UTC) 2023-10-10T21:14:46.422 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_10_00_UTC 2023-10-10T21:14:46.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.423 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_10_00_UTC) 2023-10-10T21:14:46.507 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_11_00_UTC 2023-10-10T21:14:46.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.508 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_11_00_UTC) 2023-10-10T21:14:46.591 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_12_00_UTC 2023-10-10T21:14:46.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.592 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_12_00_UTC) 2023-10-10T21:14:46.681 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_13_00_UTC 2023-10-10T21:14:46.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.682 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_13_00_UTC) 2023-10-10T21:14:46.738 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_14_00_UTC 2023-10-10T21:14:46.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.739 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-10-21_14_00_UTC) 2023-10-10T21:14:46.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:46.783 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-10-10T21:14:46.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T21:14:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.096+0000 7f1b9b59e700 1 Processor -- start 2023-10-10T21:14:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.096+0000 7f1b9b59e700 1 -- start start 2023-10-10T21:14:47.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b9c0cb1a0 0x7f1b9c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:47.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c15a8a0 0x7f1b9c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:47.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c06ebd0 con 0x7f1b9c06f5a0 2023-10-10T21:14:47.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9b59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c15b2e0 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c15ad20 con 0x7f1b9c15a8a0 2023-10-10T21:14:47.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b9c0cb1a0 0x7f1b9c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:47.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b9c0cb1a0 0x7f1b9c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54360/0 (socket says 172.21.15.154:54360) 2023-10-10T21:14:47.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9a59c700 1 -- 172.21.15.154:0/2944663616 learned_addr learned my addr 172.21.15.154:0/2944663616 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:47.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b99d9b700 1 --2- 172.21.15.154:0/2944663616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c15a8a0 0x7f1b9c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:47.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9a59c700 1 -- 172.21.15.154:0/2944663616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c15a8a0 msgr2=0x7f1b9c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:47.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9a59c700 1 --2- 172.21.15.154:0/2944663616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c15a8a0 0x7f1b9c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:47.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.098+0000 7f1b9a59c700 1 -- 172.21.15.154:0/2944663616 >> v1:172.21.15.179:6789/0 conn(0x7f1b9c06f5a0 legacy=0x7f1b9c0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:47.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.099+0000 7f1b9a59c700 1 -- 172.21.15.154:0/2944663616 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c15b000 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.099+0000 7f1b9a59c700 1 --2- 172.21.15.154:0/2944663616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 0x7f1b9c15a360 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00bc50 tx=0x7f1b8c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb450897555dc5c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:47.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.099+0000 7f1b9959a700 1 -- 172.21.15.154:0/2944663616 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00de90 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.099+0000 7f1b9959a700 1 -- 172.21.15.154:0/2944663616 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00be60 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.099+0000 7f1b9959a700 1 -- 172.21.15.154:0/2944663616 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c0196b0 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.100+0000 7f1b9b59e700 1 -- 172.21.15.154:0/2944663616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 msgr2=0x7f1b9c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:47.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.100+0000 7f1b9b59e700 1 --2- 172.21.15.154:0/2944663616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 0x7f1b9c15a360 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00bc50 tx=0x7f1b8c00b4f0 comp rx=0 tx=0).stop 2023-10-10T21:14:47.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.100+0000 7f1b9b59e700 1 -- 172.21.15.154:0/2944663616 shutdown_connections 2023-10-10T21:14:47.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.100+0000 7f1b9b59e700 1 --2- 172.21.15.154:0/2944663616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 0x7f1b9c15a360 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.100+0000 7f1b9b59e700 1 --2- 172.21.15.154:0/2944663616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c15a8a0 0x7f1b9c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.100+0000 7f1b9b59e700 1 -- 172.21.15.154:0/2944663616 >> 172.21.15.154:0/2944663616 conn(0x7f1b9c0cc1e0 msgr2=0x7f1b9c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.100+0000 7f1b9b59e700 1 -- 172.21.15.154:0/2944663616 shutdown_connections 2023-10-10T21:14:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.100+0000 7f1b9b59e700 1 -- 172.21.15.154:0/2944663616 wait complete. 2023-10-10T21:14:47.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.101+0000 7f1b9b59e700 1 Processor -- start 2023-10-10T21:14:47.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.101+0000 7f1b9b59e700 1 -- start start 2023-10-10T21:14:47.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.102+0000 7f1b9b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c06f5a0 0x7f1b9c0c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.102+0000 7f1b9b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 0x7f1b9c154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.102+0000 7f1b9b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c166ad0 0x7f1b9c154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.102+0000 7f1b9b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c165db0 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.102+0000 7f1b9b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c166640 con 0x7f1b9c06f5a0 2023-10-10T21:14:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.102+0000 7f1b9b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c16a0a0 con 0x7f1b9c166ad0 2023-10-10T21:14:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.102+0000 7f1b99d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 0x7f1b9c154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.102+0000 7f1b99d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 0x7f1b9c154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54366/0 (socket says 172.21.15.154:54366) 2023-10-10T21:14:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b99d9b700 1 -- 172.21.15.154:0/122096556 learned_addr learned my addr 172.21.15.154:0/122096556 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b9a59c700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c06f5a0 0x7f1b9c0c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b9ad9d700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c166ad0 0x7f1b9c154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b99d9b700 1 -- 172.21.15.154:0/122096556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c166ad0 msgr2=0x7f1b9c154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b99d9b700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c166ad0 0x7f1b9c154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b99d9b700 1 -- 172.21.15.154:0/122096556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c06f5a0 msgr2=0x7f1b9c0c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b99d9b700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c06f5a0 0x7f1b9c0c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b99d9b700 1 -- 172.21.15.154:0/122096556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c00b790 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b99d9b700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 0x7f1b9c154230 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000d860 tx=0x7f1b90008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:47.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b8a7fc700 1 -- 172.21.15.154:0/122096556 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900125f0 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b8a7fc700 1 -- 172.21.15.154:0/122096556 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90012770 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c165ff0 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.103+0000 7f1b8a7fc700 1 -- 172.21.15.154:0/122096556 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90012b30 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.104+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c0c46e0 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.104+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c0caf60 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.105+0000 7f1b8a7fc700 1 -- 172.21.15.154:0/122096556 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f1b90013480 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.107+0000 7f1b8a7fc700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1b7c067130 0x7f1b7c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:47.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.107+0000 7f1b8a7fc700 1 -- 172.21.15.154:0/122096556 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f1b90084f50 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.107+0000 7f1b9a59c700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1b7c067130 0x7f1b7c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:47.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.108+0000 7f1b9a59c700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1b7c067130 0x7f1b7c0695e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00bc50 tx=0x7f1b8c01b000 comp rx=0 tx=0).ready entity=mgr.5157 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:47.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.111+0000 7f1b8a7fc700 1 -- 172.21.15.154:0/122096556 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b90051bc0 con 0x7f1b9c0cb1a0 2023-10-10T21:14:47.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:47.371+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f1b9c0c30b0 con 0x7f1b9c0cb1a0 2023-10-10T21:14:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.071+0000 7f1b8a7fc700 1 -- 172.21.15.154:0/122096556 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f1b90051f90 con 0x7f1b9c0cb1a0 2023-10-10T21:14:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.072+0000 7f1b8a7fc700 1 -- 172.21.15.154:0/122096556 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v14) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1b90051bc0 con 0x7f1b9c0cb1a0 2023-10-10T21:14:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1b7c067130 msgr2=0x7f1b7c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1b7c067130 0x7f1b7c0695e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00bc50 tx=0x7f1b8c01b000 comp rx=0 tx=0).stop 2023-10-10T21:14:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 msgr2=0x7f1b9c154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 0x7f1b9c154230 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000d860 tx=0x7f1b90008040 comp rx=0 tx=0).stop 2023-10-10T21:14:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 shutdown_connections 2023-10-10T21:14:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1b7c067130 0x7f1b7c0695e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b9c166ad0 0x7f1b9c154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9c06f5a0 0x7f1b9c0c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 --2- 172.21.15.154:0/122096556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b9c0cb1a0 0x7f1b9c154230 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 >> 172.21.15.154:0/122096556 conn(0x7f1b9c0cc1e0 msgr2=0x7f1b9c152850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 shutdown_connections 2023-10-10T21:14:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.075+0000 7f1b9b59e700 1 -- 172.21.15.154:0/122096556 wait complete. 2023-10-10T21:14:48.098 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:14:48.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:14:48.183 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:14:48.267 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:14:48.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T21:14:48.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:14:48.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T21:14:48.379 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:14:48.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:14:48.380 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T21:14:48.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:14:48.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:14:48.561 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:14:48.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.644+0000 7f2dd499d700 1 Processor -- start 2023-10-10T21:14:48.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.645+0000 7f2dd499d700 1 -- start start 2023-10-10T21:14:48.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.646+0000 7f2dd499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd0142ea0 0x7f2dd00b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:48.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.646+0000 7f2dd499d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd00b40f0 con 0x7f2dd00ad870 2023-10-10T21:14:48.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.646+0000 7f2dd499d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd0069640 con 0x7f2dd006c0f0 2023-10-10T21:14:48.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.646+0000 7f2dd499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd0069920 con 0x7f2dd0142ea0 2023-10-10T21:14:48.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.646+0000 7f2dceffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2dd00ad870 0x7f2dd006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36656/0 (socket says 172.21.15.154:36656) 2023-10-10T21:14:48.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.646+0000 7f2dceffd700 1 -- 172.21.15.154:0/4236011703 learned_addr learned my addr 172.21.15.154:0/4236011703 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:48.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.646+0000 7f2dcf7fe700 1 --2- 172.21.15.154:0/4236011703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd0142ea0 0x7f2dd00b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:48.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.647+0000 7f2dce7fc700 1 -- 172.21.15.154:0/4236011703 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580783000 0 0) 0x7f2dd00b40f0 con 0x7f2dd00ad870 2023-10-10T21:14:48.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.647+0000 7f2dce7fc700 1 -- 172.21.15.154:0/4236011703 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db8003570 con 0x7f2dd00ad870 2023-10-10T21:14:48.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.647+0000 7f2dce7fc700 1 -- 172.21.15.154:0/4236011703 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071808565 0 0) 0x7f2dd0069640 con 0x7f2dd006c0f0 2023-10-10T21:14:48.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.647+0000 7f2dce7fc700 1 -- 172.21.15.154:0/4236011703 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd00b40f0 con 0x7f2dd006c0f0 2023-10-10T21:14:48.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.647+0000 7f2dcf7fe700 1 -- 172.21.15.154:0/4236011703 >> v1:172.21.15.179:6789/0 conn(0x7f2dd006c0f0 legacy=0x7f2dd006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:48.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.647+0000 7f2dcf7fe700 1 -- 172.21.15.154:0/4236011703 >> v1:172.21.15.154:6789/0 conn(0x7f2dd00ad870 legacy=0x7f2dd006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:48.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.647+0000 7f2dcf7fe700 1 -- 172.21.15.154:0/4236011703 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0069c00 con 0x7f2dd0142ea0 2023-10-10T21:14:48.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.647+0000 7f2dcf7fe700 1 --2- 172.21.15.154:0/4236011703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd0142ea0 0x7f2dd00b3630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009910 tx=0x7f2dc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb4afbbc22a6ca1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:48.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.647+0000 7f2dce7fc700 1 -- 172.21.15.154:0/4236011703 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0011630 con 0x7f2dd0142ea0 2023-10-10T21:14:48.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.648+0000 7f2dce7fc700 1 -- 172.21.15.154:0/4236011703 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0011790 con 0x7f2dd0142ea0 2023-10-10T21:14:48.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.648+0000 7f2dce7fc700 1 -- 172.21.15.154:0/4236011703 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0011b30 con 0x7f2dd0142ea0 2023-10-10T21:14:48.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.648+0000 7f2dd499d700 1 -- 172.21.15.154:0/4236011703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd0142ea0 msgr2=0x7f2dd00b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:48.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.648+0000 7f2dd499d700 1 --2- 172.21.15.154:0/4236011703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd0142ea0 0x7f2dd00b3630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009910 tx=0x7f2dc00091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.648+0000 7f2dd499d700 1 -- 172.21.15.154:0/4236011703 shutdown_connections 2023-10-10T21:14:48.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.648+0000 7f2dd499d700 1 --2- 172.21.15.154:0/4236011703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd0142ea0 0x7f2dd00b3630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.648+0000 7f2dd499d700 1 -- 172.21.15.154:0/4236011703 >> 172.21.15.154:0/4236011703 conn(0x7f2dd00ce430 msgr2=0x7f2dd00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:48.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.648+0000 7f2dd499d700 1 -- 172.21.15.154:0/4236011703 shutdown_connections 2023-10-10T21:14:48.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.648+0000 7f2dd499d700 1 -- 172.21.15.154:0/4236011703 wait complete. 2023-10-10T21:14:48.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.650+0000 7f2dd499d700 1 Processor -- start 2023-10-10T21:14:48.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.650+0000 7f2dd499d700 1 -- start start 2023-10-10T21:14:48.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dd499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd006c0f0 0x7f2dd0159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:48.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dd499d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dd0142ea0 0x7f2dd00cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:48.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dd499d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00cc870 0x7f2dd015d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:48.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dd499d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00ccd10 con 0x7f2dd00cc870 2023-10-10T21:14:48.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dd499d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd015e540 con 0x7f2dd0142ea0 2023-10-10T21:14:48.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dd499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00c75e0 con 0x7f2dd006c0f0 2023-10-10T21:14:48.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dcf7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd006c0f0 0x7f2dd0159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:48.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dcffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00cc870 0x7f2dd015d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:48.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dcf7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd006c0f0 0x7f2dd0159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:50882/0 (socket says 172.21.15.154:50882) 2023-10-10T21:14:48.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dcf7fe700 1 -- 172.21.15.154:0/715469761 learned_addr learned my addr 172.21.15.154:0/715469761 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:48.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dceffd700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dd0142ea0 0x7f2dd00cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:48.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dcf7fe700 1 -- 172.21.15.154:0/715469761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dd0142ea0 msgr2=0x7f2dd00cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:48.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dcf7fe700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dd0142ea0 0x7f2dd00cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dcf7fe700 1 -- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00cc870 msgr2=0x7f2dd015d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:48.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dcf7fe700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00cc870 0x7f2dd015d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.651+0000 7f2dcf7fe700 1 -- 172.21.15.154:0/715469761 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009420 con 0x7f2dd006c0f0 2023-10-10T21:14:48.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.652+0000 7f2dcf7fe700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd006c0f0 0x7f2dd0159110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009f00 tx=0x7f2dc0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:48.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.652+0000 7f2db77fe700 1 -- 172.21.15.154:0/715469761 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc001f070 con 0x7f2dd006c0f0 2023-10-10T21:14:48.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.652+0000 7f2db77fe700 1 -- 172.21.15.154:0/715469761 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0002f70 con 0x7f2dd006c0f0 2023-10-10T21:14:48.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.652+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd00c78c0 con 0x7f2dd006c0f0 2023-10-10T21:14:48.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.652+0000 7f2db77fe700 1 -- 172.21.15.154:0/715469761 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0011900 con 0x7f2dd006c0f0 2023-10-10T21:14:48.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.652+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd00c7e80 con 0x7f2dd006c0f0 2023-10-10T21:14:48.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.653+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd004c3c0 con 0x7f2dd006c0f0 2023-10-10T21:14:48.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.654+0000 7f2db77fe700 1 -- 172.21.15.154:0/715469761 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f2dc0023070 con 0x7f2dd006c0f0 2023-10-10T21:14:48.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.655+0000 7f2db77fe700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:48.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.655+0000 7f2db77fe700 1 -- 172.21.15.154:0/715469761 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f2dc0085e70 con 0x7f2dd006c0f0 2023-10-10T21:14:48.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.655+0000 7f2dceffd700 1 -- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2dbc0670e0 msgr2=0x7f2dbc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:48.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.655+0000 7f2dceffd700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:48.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.661+0000 7f2db77fe700 1 -- 172.21.15.154:0/715469761 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dc0052aa0 con 0x7f2dd006c0f0 2023-10-10T21:14:48.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.856+0000 7f2dceffd700 1 -- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2dbc0670e0 msgr2=0x7f2dbc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:48.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.856+0000 7f2dceffd700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:48.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.930+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2dd00c8070 con 0x7f2dd006c0f0 2023-10-10T21:14:48.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.931+0000 7f2db77fe700 1 -- 172.21.15.154:0/715469761 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f2dc002a090 con 0x7f2dd006c0f0 2023-10-10T21:14:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:48.932 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/343222653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":343222653},{"type":"v1","addr":"172.21.15.154:6837","nonce":343222653}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2558521496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2558521496},{"type":"v1","addr":"172.21.15.179:6834","nonce":2558521496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3578232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3578232941},{"type":"v1","addr":"172.21.15.179:6835","nonce":3578232941}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:03:13.344673+0000","modified":"2023-10-10T21:03:17.047547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6836/2035241338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2035241338},{"type":"v1","addr":"172.21.15.154:6836","nonce":2035241338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-10T21:14:48.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2dbc0670e0 msgr2=0x7f2dbc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:48.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd006c0f0 msgr2=0x7f2dd0159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:48.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd006c0f0 0x7f2dd0159110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009f00 tx=0x7f2dc0017000 comp rx=0 tx=0).stop 2023-10-10T21:14:48.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 shutdown_connections 2023-10-10T21:14:48.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd00cc870 0x7f2dd015d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dd006c0f0 0x7f2dd0159110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 --2- 172.21.15.154:0/715469761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dd0142ea0 0x7f2dd00cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 >> 172.21.15.154:0/715469761 conn(0x7f2dd00ce430 msgr2=0x7f2dd0141e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 shutdown_connections 2023-10-10T21:14:48.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:48.935+0000 7f2dd499d700 1 -- 172.21.15.154:0/715469761 wait complete. 2023-10-10T21:14:48.939 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 14 2023-10-10T21:14:48.964 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:14:49.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.153+0000 7f8c98f9d700 1 Processor -- start 2023-10-10T21:14:49.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.154+0000 7f8c98f9d700 1 -- start start 2023-10-10T21:14:49.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.155+0000 7f8c98f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c941597f0 0x7f8c940b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.155+0000 7f8c98f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c9415d230 0x7f8c9415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.155+0000 7f8c98f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9415db70 con 0x7f8c94159420 2023-10-10T21:14:49.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.155+0000 7f8c98f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940b11d0 con 0x7f8c9415d230 2023-10-10T21:14:49.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.155+0000 7f8c98f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940b14b0 con 0x7f8c941597f0 2023-10-10T21:14:49.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.155+0000 7f8c93fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c9415d230 0x7f8c9415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.155+0000 7f8c92ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c941597f0 0x7f8c940b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.155+0000 7f8c93fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c9415d230 0x7f8c9415d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54402/0 (socket says 172.21.15.154:54402) 2023-10-10T21:14:49.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.155+0000 7f8c93fff700 1 -- 172.21.15.154:0/3471751573 learned_addr learned my addr 172.21.15.154:0/3471751573 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.156+0000 7f8c93fff700 1 -- 172.21.15.154:0/3471751573 >> v2:172.21.15.179:3300/0 conn(0x7f8c941597f0 msgr2=0x7f8c940b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.156+0000 7f8c93fff700 1 --2- 172.21.15.154:0/3471751573 >> v2:172.21.15.179:3300/0 conn(0x7f8c941597f0 0x7f8c940b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.156+0000 7f8c93fff700 1 -- 172.21.15.154:0/3471751573 >> v1:172.21.15.179:6789/0 conn(0x7f8c94159420 legacy=0x7f8c940b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.156+0000 7f8c93fff700 1 -- 172.21.15.154:0/3471751573 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940b1790 con 0x7f8c9415d230 2023-10-10T21:14:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.156+0000 7f8c93fff700 1 --2- 172.21.15.154:0/3471751573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9415d230 0x7f8c9415d630 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c94089750 tx=0x7f8c8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0265c11ec68c7d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.156+0000 7f8c927fc700 1 -- 172.21.15.154:0/3471751573 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00e070 con 0x7f8c9415d230 2023-10-10T21:14:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.156+0000 7f8c927fc700 1 -- 172.21.15.154:0/3471751573 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c00ba20 con 0x7f8c9415d230 2023-10-10T21:14:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.156+0000 7f8c927fc700 1 -- 172.21.15.154:0/3471751573 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0092e0 con 0x7f8c9415d230 2023-10-10T21:14:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.157+0000 7f8c98f9d700 1 -- 172.21.15.154:0/3471751573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9415d230 msgr2=0x7f8c9415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.157+0000 7f8c98f9d700 1 --2- 172.21.15.154:0/3471751573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9415d230 0x7f8c9415d630 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c94089750 tx=0x7f8c8c009840 comp rx=0 tx=0).stop 2023-10-10T21:14:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.157+0000 7f8c98f9d700 1 -- 172.21.15.154:0/3471751573 shutdown_connections 2023-10-10T21:14:49.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.157+0000 7f8c98f9d700 1 --2- 172.21.15.154:0/3471751573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c9415d230 0x7f8c9415d630 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.157+0000 7f8c98f9d700 1 --2- 172.21.15.154:0/3471751573 >> v2:172.21.15.179:3300/0 conn(0x7f8c941597f0 0x7f8c940b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.157+0000 7f8c98f9d700 1 -- 172.21.15.154:0/3471751573 >> 172.21.15.154:0/3471751573 conn(0x7f8c940d0660 msgr2=0x7f8c940d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:49.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.157+0000 7f8c98f9d700 1 -- 172.21.15.154:0/3471751573 shutdown_connections 2023-10-10T21:14:49.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.157+0000 7f8c98f9d700 1 -- 172.21.15.154:0/3471751573 wait complete. 2023-10-10T21:14:49.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.159+0000 7f8c98f9d700 1 Processor -- start 2023-10-10T21:14:49.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.159+0000 7f8c98f9d700 1 -- start start 2023-10-10T21:14:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c98f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c94159420 0x7f8c94148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c98f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c941597f0 0x7f8c940c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c98f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9415d230 0x7f8c94155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c98f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940c5da0 con 0x7f8c94159420 2023-10-10T21:14:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c98f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940c6080 con 0x7f8c9415d230 2023-10-10T21:14:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c98f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940c6360 con 0x7f8c941597f0 2023-10-10T21:14:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c94159420 0x7f8c94148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c94159420 0x7f8c94148fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54412/0 (socket says 172.21.15.154:54412) 2023-10-10T21:14:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c937fe700 1 -- 172.21.15.154:0/1831665783 learned_addr learned my addr 172.21.15.154:0/1831665783 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c92ffd700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c941597f0 0x7f8c940c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c93fff700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9415d230 0x7f8c94155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c937fe700 1 -- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c941597f0 msgr2=0x7f8c940c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c937fe700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c941597f0 0x7f8c940c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c937fe700 1 -- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9415d230 msgr2=0x7f8c94155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c937fe700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9415d230 0x7f8c94155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c937fe700 1 -- 172.21.15.154:0/1831665783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c009ae0 con 0x7f8c94159420 2023-10-10T21:14:49.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c92ffd700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c941597f0 0x7f8c940c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:49.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.160+0000 7f8c93fff700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9415d230 0x7f8c94155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:49.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.161+0000 7f8c937fe700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c94159420 0x7f8c94148fe0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c590 tx=0x7f8c8400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:49.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.161+0000 7f8c7b7fe700 1 -- 172.21.15.154:0/1831665783 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84011590 con 0x7f8c94159420 2023-10-10T21:14:49.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.161+0000 7f8c7b7fe700 1 -- 172.21.15.154:0/1831665783 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c840116f0 con 0x7f8c94159420 2023-10-10T21:14:49.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.161+0000 7f8c7b7fe700 1 -- 172.21.15.154:0/1831665783 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84011ab0 con 0x7f8c94159420 2023-10-10T21:14:49.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.161+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9415ac70 con 0x7f8c94159420 2023-10-10T21:14:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.161+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c94149520 con 0x7f8c94159420 2023-10-10T21:14:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.162+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9404c3c0 con 0x7f8c94159420 2023-10-10T21:14:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.163+0000 7f8c7b7fe700 1 -- 172.21.15.154:0/1831665783 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f8c8401b3b0 con 0x7f8c94159420 2023-10-10T21:14:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.164+0000 7f8c7b7fe700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c800670e0 0x7f8c80069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.164+0000 7f8c7b7fe700 1 -- 172.21.15.154:0/1831665783 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f8c84084120 con 0x7f8c94159420 2023-10-10T21:14:49.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.164+0000 7f8c92ffd700 1 -- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c800670e0 msgr2=0x7f8c80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:49.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.164+0000 7f8c92ffd700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c800670e0 0x7f8c80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:49.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.168+0000 7f8c7b7fe700 1 -- 172.21.15.154:0/1831665783 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c84050df0 con 0x7f8c94159420 2023-10-10T21:14:49.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.365+0000 7f8c92ffd700 1 -- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c800670e0 msgr2=0x7f8c80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:49.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.365+0000 7f8c92ffd700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c800670e0 0x7f8c80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:49.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.369+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c940b1a70 con 0x7f8c94159420 2023-10-10T21:14:49.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.370+0000 7f8c7b7fe700 1 -- 172.21.15.154:0/1831665783 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f8c84054410 con 0x7f8c94159420 2023-10-10T21:14:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:49.372 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":50,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:14:48.028002+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:03:11.022869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-10T21:03:12.323498+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/1040461821":"2023-10-11T21:03:34.274742+0000","172.21.15.154:0/885917098":"2023-10-11T21:03:34.274742+0000","172.21.15.154:6833/85496":"2023-10-11T21:03:34.274742+0000","172.21.15.154:6832/85496":"2023-10-11T21:03:34.274742+0000","172.21.15.154:0/2392137030":"2023-10-11T21:03:34.274742+0000","172.21.15.154:0/2001266548":"2023-10-11T21:03:34.274742+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2},{"begin":7,"length":3},{"begin":12,"length":2},{"begin":17,"length":3},{"begin":24,"length":2},{"begin":29,"length":3},{"begin":34,"length":2},{"begin":39,"length":4},{"begin":45,"length":2},{"begin":50,"length":4},{"begin":56,"length":2},{"begin":61,"length":4},{"begin":67,"length":2},{"begin":73,"length":3},{"begin":78,"length":2},{"begin":84,"length":3},{"begin":89,"length":2},{"begin":95,"length":3},{"begin":100,"length":3},{"begin":107,"length":2},{"begin":111,"length":1},{"begin":167,"length":54}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":7,"length":1},{"begin":17,"length":1},{"begin":29,"length":1},{"begin":39,"length":1},{"begin":50,"length":1},{"begin":61,"length":2},{"begin":73,"length":1},{"begin":84,"length":1},{"begin":95,"length":1},{"begin":211,"length":10}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:14:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c800670e0 msgr2=0x7f8c80069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c800670e0 0x7f8c80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c94159420 msgr2=0x7f8c94148fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c94159420 0x7f8c94148fe0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c590 tx=0x7f8c8400c950 comp rx=0 tx=0).stop 2023-10-10T21:14:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 shutdown_connections 2023-10-10T21:14:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c9415d230 0x7f8c94155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c94159420 0x7f8c94148fe0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f8c800670e0 0x7f8c80069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 --2- 172.21.15.154:0/1831665783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c941597f0 0x7f8c940c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 >> 172.21.15.154:0/1831665783 conn(0x7f8c940d0660 msgr2=0x7f8c94158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:49.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 shutdown_connections 2023-10-10T21:14:49.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.373+0000 7f8c98f9d700 1 -- 172.21.15.154:0/1831665783 wait complete. 2023-10-10T21:14:49.392 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:03:11.022869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:03:12.323498+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 50, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:14:49.393 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:14:49.408 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:49.407+0000 7f838c085180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:14:49.479 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:49.478+0000 7f42cc0f8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:14:49.571 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:49.570+0000 7f838c085180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:14:49.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.583+0000 7fbf2d99d700 1 Processor -- start 2023-10-10T21:14:49.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.584+0000 7fbf2d99d700 1 -- start start 2023-10-10T21:14:49.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.586+0000 7fbf2d99d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf280b4e70 0x7fbf280ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.586+0000 7fbf2d99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbf280b16d0 0x7fbf280b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.586+0000 7fbf2d99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf280b2080 con 0x7fbf2815d240 2023-10-10T21:14:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.586+0000 7fbf2d99d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf280cfb00 con 0x7fbf280b4e70 2023-10-10T21:14:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.586+0000 7fbf2d99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf280b5c40 con 0x7fbf280b16d0 2023-10-10T21:14:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.586+0000 7fbf2c99b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf280b4e70 0x7fbf280ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.586+0000 7fbf2c99b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf280b4e70 0x7fbf280ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54424/0 (socket says 172.21.15.154:54424) 2023-10-10T21:14:49.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.586+0000 7fbf2c99b700 1 -- 172.21.15.154:0/3885751953 learned_addr learned my addr 172.21.15.154:0/3885751953 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:49.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.586+0000 7fbf27fff700 1 --2- 172.21.15.154:0/3885751953 >> v2:172.21.15.179:3300/0 conn(0x7fbf280b16d0 0x7fbf280b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.587+0000 7fbf2c99b700 1 -- 172.21.15.154:0/3885751953 >> v2:172.21.15.179:3300/0 conn(0x7fbf280b16d0 msgr2=0x7fbf280b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:49.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.587+0000 7fbf2c99b700 1 --2- 172.21.15.154:0/3885751953 >> v2:172.21.15.179:3300/0 conn(0x7fbf280b16d0 0x7fbf280b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.587+0000 7fbf2c99b700 1 -- 172.21.15.154:0/3885751953 >> v1:172.21.15.179:6789/0 conn(0x7fbf2815d240 legacy=0x7fbf2815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.587+0000 7fbf2c99b700 1 -- 172.21.15.154:0/3885751953 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280b5f20 con 0x7fbf280b4e70 2023-10-10T21:14:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.587+0000 7fbf2c99b700 1 --2- 172.21.15.154:0/3885751953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b4e70 0x7fbf280ccff0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbf28089830 tx=0x7fbf1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e36417d9f54b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.587+0000 7fbf277fe700 1 -- 172.21.15.154:0/3885751953 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c009e70 con 0x7fbf280b4e70 2023-10-10T21:14:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.587+0000 7fbf277fe700 1 -- 172.21.15.154:0/3885751953 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c00b860 con 0x7fbf280b4e70 2023-10-10T21:14:49.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.587+0000 7fbf277fe700 1 -- 172.21.15.154:0/3885751953 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00bc00 con 0x7fbf280b4e70 2023-10-10T21:14:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.588+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3885751953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b4e70 msgr2=0x7fbf280ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.588+0000 7fbf2d99d700 1 --2- 172.21.15.154:0/3885751953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b4e70 0x7fbf280ccff0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbf28089830 tx=0x7fbf1c009250 comp rx=0 tx=0).stop 2023-10-10T21:14:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.588+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3885751953 shutdown_connections 2023-10-10T21:14:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.588+0000 7fbf2d99d700 1 --2- 172.21.15.154:0/3885751953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b4e70 0x7fbf280ccff0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.588+0000 7fbf2d99d700 1 --2- 172.21.15.154:0/3885751953 >> v2:172.21.15.179:3300/0 conn(0x7fbf280b16d0 0x7fbf280b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.588+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3885751953 >> 172.21.15.154:0/3885751953 conn(0x7fbf280d10c0 msgr2=0x7fbf280affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.588+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3885751953 shutdown_connections 2023-10-10T21:14:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.588+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3885751953 wait complete. 2023-10-10T21:14:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.590+0000 7fbf2d99d700 1 Processor -- start 2023-10-10T21:14:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.590+0000 7fbf2d99d700 1 -- start start 2023-10-10T21:14:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2d99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b16d0 0x7fbf280ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2d99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b4e70 0x7fbf28159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2d99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815d240 0x7fbf280cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2d99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c8a20 con 0x7fbf280b16d0 2023-10-10T21:14:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2d99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c94f0 con 0x7fbf280b4e70 2023-10-10T21:14:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2d99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c97d0 con 0x7fbf2815d240 2023-10-10T21:14:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2c99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b16d0 0x7fbf280ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2c99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b16d0 0x7fbf280ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54430/0 (socket says 172.21.15.154:54430) 2023-10-10T21:14:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2c99b700 1 -- 172.21.15.154:0/3947225487 learned_addr learned my addr 172.21.15.154:0/3947225487 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf27fff700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b4e70 0x7fbf28159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2d19c700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815d240 0x7fbf280cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2c99b700 1 -- 172.21.15.154:0/3947225487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815d240 msgr2=0x7fbf280cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2c99b700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815d240 0x7fbf280cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2c99b700 1 -- 172.21.15.154:0/3947225487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b4e70 msgr2=0x7fbf28159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2c99b700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b4e70 0x7fbf28159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2c99b700 1 -- 172.21.15.154:0/3947225487 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0094f0 con 0x7fbf280b16d0 2023-10-10T21:14:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.591+0000 7fbf2d19c700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815d240 0x7fbf280cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:14:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.592+0000 7fbf2c99b700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b16d0 0x7fbf280ca2b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbf28070dd0 tx=0x7fbf1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.592+0000 7fbf24ff9700 1 -- 172.21.15.154:0/3947225487 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00bbe0 con 0x7fbf280b16d0 2023-10-10T21:14:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.592+0000 7fbf24ff9700 1 -- 172.21.15.154:0/3947225487 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c011420 con 0x7fbf280b16d0 2023-10-10T21:14:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.592+0000 7fbf24ff9700 1 -- 172.21.15.154:0/3947225487 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0117a0 con 0x7fbf280b16d0 2023-10-10T21:14:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.592+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf280c9ab0 con 0x7fbf280b16d0 2023-10-10T21:14:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.592+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf280cc0b0 con 0x7fbf280b16d0 2023-10-10T21:14:49.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.593+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf280c9fd0 con 0x7fbf280b16d0 2023-10-10T21:14:49.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.594+0000 7fbf24ff9700 1 -- 172.21.15.154:0/3947225487 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fbf1c011b90 con 0x7fbf280b16d0 2023-10-10T21:14:49.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.595+0000 7fbf24ff9700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbf0c0670e0 0x7fbf0c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:49.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.595+0000 7fbf24ff9700 1 -- 172.21.15.154:0/3947225487 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6499+0+0 (secure 0 0 0) 0x7fbf1c086430 con 0x7fbf280b16d0 2023-10-10T21:14:49.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.595+0000 7fbf27fff700 1 -- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbf0c0670e0 msgr2=0x7fbf0c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.595+0000 7fbf27fff700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbf0c0670e0 0x7fbf0c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.599+0000 7fbf24ff9700 1 -- 172.21.15.154:0/3947225487 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf280c9fd0 con 0x7fbf280b16d0 2023-10-10T21:14:49.651 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:49.650+0000 7f42cc0f8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:14:49.657 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:49.656+0000 7f838c085180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:14:49.738 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:49.737+0000 7f42cc0f8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:14:49.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.795+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf280c9fd0 con 0x7fbf280b16d0 2023-10-10T21:14:49.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.796+0000 7fbf27fff700 1 -- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbf0c0670e0 msgr2=0x7fbf0c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:49.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.796+0000 7fbf27fff700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbf0c0670e0 0x7fbf0c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:49.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.796+0000 7fbf24ff9700 1 -- 172.21.15.154:0/3947225487 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf280c9fd0 con 0x7fbf280b16d0 2023-10-10T21:14:49.798 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:14:49.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.798+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbf0c0670e0 msgr2=0x7fbf0c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:49.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.798+0000 7fbf2d99d700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbf0c0670e0 0x7fbf0c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.798+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b16d0 msgr2=0x7fbf280ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:49.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.798+0000 7fbf2d99d700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b16d0 0x7fbf280ca2b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbf28070dd0 tx=0x7fbf1c017000 comp rx=0 tx=0).stop 2023-10-10T21:14:49.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.799+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 shutdown_connections 2023-10-10T21:14:49.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.799+0000 7fbf2d99d700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fbf0c0670e0 0x7fbf0c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.799+0000 7fbf2d99d700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815d240 0x7fbf280cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.799+0000 7fbf2d99d700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf280b16d0 0x7fbf280ca2b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.799+0000 7fbf2d99d700 1 --2- 172.21.15.154:0/3947225487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b4e70 0x7fbf28159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:49.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.799+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 >> 172.21.15.154:0/3947225487 conn(0x7fbf280d10c0 msgr2=0x7fbf2815ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:49.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.799+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 shutdown_connections 2023-10-10T21:14:49.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:49.799+0000 7fbf2d99d700 1 -- 172.21.15.154:0/3947225487 wait complete. 2023-10-10T21:14:49.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:14:49.880 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:49.879+0000 7f838c085180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:14:49.973 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:49.972+0000 7f42cc0f8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:14:50.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.009+0000 7f436239d700 1 Processor -- start 2023-10-10T21:14:50.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.009+0000 7f436239d700 1 -- start start 2023-10-10T21:14:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f436239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b16d0 0x7f435c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f436239d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f435c0b33b0 0x7f435c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f436239d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c0b2080 con 0x7f435c0b4e70 2023-10-10T21:14:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f436239d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0cfb00 con 0x7f435c0b33b0 2023-10-10T21:14:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f436239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0b5c40 con 0x7f435c0b16d0 2023-10-10T21:14:50.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f4361b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f435c0b33b0 0x7f435c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f4360b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b16d0 0x7f435c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f4361b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f435c0b33b0 0x7f435c0b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54444/0 (socket says 172.21.15.154:54444) 2023-10-10T21:14:50.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f436139b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f435c0b4e70 0x7f435c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:56310/0 (socket says 172.21.15.154:56310) 2023-10-10T21:14:50.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f4361b9c700 1 -- 172.21.15.154:0/1854504367 learned_addr learned my addr 172.21.15.154:0/1854504367 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.011+0000 7f4353fff700 1 -- 172.21.15.154:0/1854504367 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516365952 0 0) 0x7f435c0b2080 con 0x7f435c0b4e70 2023-10-10T21:14:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4353fff700 1 -- 172.21.15.154:0/1854504367 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4348003570 con 0x7f435c0b4e70 2023-10-10T21:14:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4360b9a700 1 -- 172.21.15.154:0/1854504367 >> v2:172.21.15.154:3300/0 conn(0x7f435c0b33b0 msgr2=0x7f435c0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4360b9a700 1 --2- 172.21.15.154:0/1854504367 >> v2:172.21.15.154:3300/0 conn(0x7f435c0b33b0 0x7f435c0b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4360b9a700 1 -- 172.21.15.154:0/1854504367 >> v1:172.21.15.179:6789/0 conn(0x7f435c0b4e70 legacy=0x7f435c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4360b9a700 1 -- 172.21.15.154:0/1854504367 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0b5f20 con 0x7f435c0b16d0 2023-10-10T21:14:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4361b9c700 1 --2- 172.21.15.154:0/1854504367 >> v2:172.21.15.154:3300/0 conn(0x7f435c0b33b0 0x7f435c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4360b9a700 1 --2- 172.21.15.154:0/1854504367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b16d0 0x7f435c0b1b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f434c0098e0 tx=0x7f434c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24b5be509cecddb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4353fff700 1 -- 172.21.15.154:0/1854504367 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c011630 con 0x7f435c0b16d0 2023-10-10T21:14:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4353fff700 1 -- 172.21.15.154:0/1854504367 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c011790 con 0x7f435c0b16d0 2023-10-10T21:14:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.012+0000 7f4353fff700 1 -- 172.21.15.154:0/1854504367 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c011b30 con 0x7f435c0b16d0 2023-10-10T21:14:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.013+0000 7f436239d700 1 -- 172.21.15.154:0/1854504367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b16d0 msgr2=0x7f435c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.013+0000 7f436239d700 1 --2- 172.21.15.154:0/1854504367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b16d0 0x7f435c0b1b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f434c0098e0 tx=0x7f434c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.013+0000 7f436239d700 1 -- 172.21.15.154:0/1854504367 shutdown_connections 2023-10-10T21:14:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.013+0000 7f436239d700 1 --2- 172.21.15.154:0/1854504367 >> v2:172.21.15.154:3300/0 conn(0x7f435c0b33b0 0x7f435c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.013+0000 7f436239d700 1 --2- 172.21.15.154:0/1854504367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b16d0 0x7f435c0b1b40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.013+0000 7f436239d700 1 -- 172.21.15.154:0/1854504367 >> 172.21.15.154:0/1854504367 conn(0x7f435c0d10c0 msgr2=0x7f435c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.013+0000 7f436239d700 1 -- 172.21.15.154:0/1854504367 shutdown_connections 2023-10-10T21:14:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.013+0000 7f436239d700 1 -- 172.21.15.154:0/1854504367 wait complete. 2023-10-10T21:14:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.014+0000 7f436239d700 1 Processor -- start 2023-10-10T21:14:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.015+0000 7f436239d700 1 -- start start 2023-10-10T21:14:50.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.015+0000 7f436239d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435c0b16d0 0x7f435c0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f436239d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f435c0b33b0 0x7f435c16d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f436239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b4e70 0x7f435c16dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f436239d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c157dd0 con 0x7f435c0b33b0 2023-10-10T21:14:50.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f436239d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c16ba20 con 0x7f435c0b16d0 2023-10-10T21:14:50.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f436239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c16e3c0 con 0x7f435c0b4e70 2023-10-10T21:14:50.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4360b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f435c0b33b0 0x7f435c16d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4360b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f435c0b33b0 0x7f435c16d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54448/0 (socket says 172.21.15.154:54448) 2023-10-10T21:14:50.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4360b9a700 1 -- 172.21.15.154:0/1014289125 learned_addr learned my addr 172.21.15.154:0/1014289125 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:50.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f436139b700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435c0b16d0 0x7f435c0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4361b9c700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b4e70 0x7f435c16dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4360b9a700 1 -- 172.21.15.154:0/1014289125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b4e70 msgr2=0x7f435c16dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4360b9a700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b4e70 0x7f435c16dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4360b9a700 1 -- 172.21.15.154:0/1014289125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435c0b16d0 msgr2=0x7f435c0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4360b9a700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435c0b16d0 0x7f435c0af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4360b9a700 1 -- 172.21.15.154:0/1014289125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354009ae0 con 0x7f435c0b33b0 2023-10-10T21:14:50.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.016+0000 7f4360b9a700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f435c0b33b0 0x7f435c16d800 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f434c009ed0 tx=0x7f434c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:50.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.017+0000 7f43517fa700 1 -- 172.21.15.154:0/1014289125 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c01f070 con 0x7f435c0b33b0 2023-10-10T21:14:50.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.017+0000 7f43517fa700 1 -- 172.21.15.154:0/1014289125 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c002f30 con 0x7f435c0b33b0 2023-10-10T21:14:50.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.017+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c009420 con 0x7f435c0b33b0 2023-10-10T21:14:50.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.017+0000 7f43517fa700 1 -- 172.21.15.154:0/1014289125 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c011900 con 0x7f435c0b33b0 2023-10-10T21:14:50.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.017+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c16b6b0 con 0x7f435c0b33b0 2023-10-10T21:14:50.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.018+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c16bbb0 con 0x7f435c0b33b0 2023-10-10T21:14:50.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.019+0000 7f43517fa700 1 -- 172.21.15.154:0/1014289125 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f434c023070 con 0x7f435c0b33b0 2023-10-10T21:14:50.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.019+0000 7f43517fa700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f43400670e0 0x7f4340069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.020+0000 7f43517fa700 1 -- 172.21.15.154:0/1014289125 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f434c085c40 con 0x7f435c0b33b0 2023-10-10T21:14:50.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.020+0000 7f436139b700 1 -- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f43400670e0 msgr2=0x7f4340069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:50.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.020+0000 7f436139b700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f43400670e0 0x7f4340069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:50.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.024+0000 7f43517fa700 1 -- 172.21.15.154:0/1014289125 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f434c052920 con 0x7f435c0b33b0 2023-10-10T21:14:50.064 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:50.063+0000 7f838c085180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:14:50.160 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:50.159+0000 7f838c085180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:14:50.167 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:50.166+0000 7f42cc0f8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:14:50.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.221+0000 7f436139b700 1 -- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f43400670e0 msgr2=0x7f4340069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:50.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.221+0000 7f436139b700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f43400670e0 0x7f4340069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:50.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.234+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f435c069b20 con 0x7f435c0b33b0 2023-10-10T21:14:50.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.234+0000 7f43517fa700 1 -- 172.21.15.154:0/1014289125 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f434c02a020 con 0x7f435c0b33b0 2023-10-10T21:14:50.235 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:14:50.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f43400670e0 msgr2=0x7f4340069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:50.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f43400670e0 0x7f4340069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f435c0b33b0 msgr2=0x7f435c16d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f435c0b33b0 0x7f435c16d800 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f434c009ed0 tx=0x7f434c017000 comp rx=0 tx=0).stop 2023-10-10T21:14:50.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 shutdown_connections 2023-10-10T21:14:50.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f43400670e0 0x7f4340069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435c0b4e70 0x7f435c16dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435c0b16d0 0x7f435c0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 --2- 172.21.15.154:0/1014289125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f435c0b33b0 0x7f435c16d800 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 >> 172.21.15.154:0/1014289125 conn(0x7f435c0d10c0 msgr2=0x7f435c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:50.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 shutdown_connections 2023-10-10T21:14:50.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.237+0000 7f436239d700 1 -- 172.21.15.154:0/1014289125 wait complete. 2023-10-10T21:14:50.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:14:50.266 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:50.265+0000 7f42cc0f8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:14:50.324 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:50.323+0000 7f838c085180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:14:50.431 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:50.429+0000 7f838c085180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:14:50.443 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:50.443+0000 7f42cc0f8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:14:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.458+0000 7f934759e700 1 Processor -- start 2023-10-10T21:14:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.458+0000 7f934759e700 1 -- start start 2023-10-10T21:14:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.459+0000 7f934759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934815a3b0 0x7f934815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f934759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f934806e470 0x7f934806e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f934759e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93480aea70 con 0x7f93480aef00 2023-10-10T21:14:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f934759e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934806ee30 con 0x7f934806e470 2023-10-10T21:14:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f934759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934815dad0 con 0x7f934815a3b0 2023-10-10T21:14:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f9346d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f934806e470 0x7f934806e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f9345d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f93480aef00 0x7f934815d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36660/0 (socket says 172.21.15.154:36660) 2023-10-10T21:14:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f9346d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f934806e470 0x7f934806e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54456/0 (socket says 172.21.15.154:54456) 2023-10-10T21:14:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f9345d9b700 1 -- 172.21.15.154:0/2400173214 learned_addr learned my addr 172.21.15.154:0/2400173214 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f934659c700 1 --2- 172.21.15.154:0/2400173214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934815a3b0 0x7f934815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f9346d9d700 1 -- 172.21.15.154:0/2400173214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934815a3b0 msgr2=0x7f934815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f9346d9d700 1 --2- 172.21.15.154:0/2400173214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934815a3b0 0x7f934815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f9346d9d700 1 -- 172.21.15.154:0/2400173214 >> v1:172.21.15.154:6789/0 conn(0x7f93480aef00 legacy=0x7f934815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.460+0000 7f9346d9d700 1 -- 172.21.15.154:0/2400173214 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93480ae480 con 0x7f934806e470 2023-10-10T21:14:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.461+0000 7f9346d9d700 1 --2- 172.21.15.154:0/2400173214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 0x7f934806e8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9340009e60 tx=0x7f9340009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcaa7c1646ef1e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.461+0000 7f934559a700 1 -- 172.21.15.154:0/2400173214 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934000e070 con 0x7f934806e470 2023-10-10T21:14:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.461+0000 7f934559a700 1 -- 172.21.15.154:0/2400173214 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934000bb60 con 0x7f934806e470 2023-10-10T21:14:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.461+0000 7f934559a700 1 -- 172.21.15.154:0/2400173214 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340012430 con 0x7f934806e470 2023-10-10T21:14:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.461+0000 7f934759e700 1 -- 172.21.15.154:0/2400173214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 msgr2=0x7f934806e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.461+0000 7f934759e700 1 --2- 172.21.15.154:0/2400173214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 0x7f934806e8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9340009e60 tx=0x7f9340009780 comp rx=0 tx=0).stop 2023-10-10T21:14:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.462+0000 7f934759e700 1 -- 172.21.15.154:0/2400173214 shutdown_connections 2023-10-10T21:14:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.462+0000 7f934759e700 1 --2- 172.21.15.154:0/2400173214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 0x7f934806e8f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.462+0000 7f934759e700 1 --2- 172.21.15.154:0/2400173214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934815a3b0 0x7f934815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.462+0000 7f934759e700 1 -- 172.21.15.154:0/2400173214 >> 172.21.15.154:0/2400173214 conn(0x7f93480c9f70 msgr2=0x7f934806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.462+0000 7f934759e700 1 -- 172.21.15.154:0/2400173214 shutdown_connections 2023-10-10T21:14:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.462+0000 7f934759e700 1 -- 172.21.15.154:0/2400173214 wait complete. 2023-10-10T21:14:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.463+0000 7f934759e700 1 Processor -- start 2023-10-10T21:14:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.463+0000 7f934759e700 1 -- start start 2023-10-10T21:14:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.464+0000 7f934759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 0x7f9348154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.464+0000 7f934759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480aef00 0x7f9348169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.464+0000 7f934759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f934815a3b0 0x7f934816a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.464+0000 7f934759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934816b350 con 0x7f934806e470 2023-10-10T21:14:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.464+0000 7f934759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93480c6580 con 0x7f934815a3b0 2023-10-10T21:14:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.464+0000 7f934759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934816a710 con 0x7f93480aef00 2023-10-10T21:14:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f934659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 0x7f9348154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f934659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 0x7f9348154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54462/0 (socket says 172.21.15.154:54462) 2023-10-10T21:14:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f934659c700 1 -- 172.21.15.154:0/2908291157 learned_addr learned my addr 172.21.15.154:0/2908291157 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:50.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f9345d9b700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480aef00 0x7f9348169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f9346d9d700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f934815a3b0 0x7f934816a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f934659c700 1 -- 172.21.15.154:0/2908291157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480aef00 msgr2=0x7f9348169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f934659c700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480aef00 0x7f9348169b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f934659c700 1 -- 172.21.15.154:0/2908291157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f934815a3b0 msgr2=0x7f934816a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f934659c700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f934815a3b0 0x7f934816a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f934659c700 1 -- 172.21.15.154:0/2908291157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340009a20 con 0x7f934806e470 2023-10-10T21:14:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.465+0000 7f934659c700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 0x7f9348154850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f933800e930 tx=0x7f93380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.466+0000 7f93367fc700 1 -- 172.21.15.154:0/2908291157 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338013680 con 0x7f934806e470 2023-10-10T21:14:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.466+0000 7f93367fc700 1 -- 172.21.15.154:0/2908291157 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93380137e0 con 0x7f934806e470 2023-10-10T21:14:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.466+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934816a9f0 con 0x7f934806e470 2023-10-10T21:14:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.466+0000 7f93367fc700 1 -- 172.21.15.154:0/2908291157 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338013ba0 con 0x7f934806e470 2023-10-10T21:14:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.466+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934816afe0 con 0x7f934806e470 2023-10-10T21:14:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.467+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934806cfa0 con 0x7f934806e470 2023-10-10T21:14:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.469+0000 7f93367fc700 1 -- 172.21.15.154:0/2908291157 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f933800c3e0 con 0x7f934806e470 2023-10-10T21:14:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.470+0000 7f93367fc700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f93280670e0 0x7f9328069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.470+0000 7f93367fc700 1 -- 172.21.15.154:0/2908291157 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9338084cc0 con 0x7f934806e470 2023-10-10T21:14:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.470+0000 7f9345d9b700 1 -- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f93280670e0 msgr2=0x7f9328069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.470+0000 7f9345d9b700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f93280670e0 0x7f9328069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.474+0000 7f93367fc700 1 -- 172.21.15.154:0/2908291157 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93380518c0 con 0x7f934806e470 2023-10-10T21:14:50.552 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:50.551+0000 7f42cc0f8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:14:50.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.671+0000 7f9345d9b700 1 -- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f93280670e0 msgr2=0x7f9328069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:50.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.671+0000 7f9345d9b700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f93280670e0 0x7f9328069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:50.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.673+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f934804bb80 con 0x7f934806e470 2023-10-10T21:14:50.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.674+0000 7f93367fc700 1 -- 172.21.15.154:0/2908291157 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9338054ee0 con 0x7f934806e470 2023-10-10T21:14:50.675 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:14:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.676+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f93280670e0 msgr2=0x7f9328069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.676+0000 7f934759e700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f93280670e0 0x7f9328069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.676+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 msgr2=0x7f9348154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.676+0000 7f934759e700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 0x7f9348154850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f933800e930 tx=0x7f93380091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.676+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 shutdown_connections 2023-10-10T21:14:50.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.676+0000 7f934759e700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f934815a3b0 0x7f934816a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.676+0000 7f934759e700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934806e470 0x7f9348154850 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.676+0000 7f934759e700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f93280670e0 0x7f9328069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.676+0000 7f934759e700 1 --2- 172.21.15.154:0/2908291157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480aef00 0x7f9348169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.677+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 >> 172.21.15.154:0/2908291157 conn(0x7f93480c9f70 msgr2=0x7f9348152460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.677+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 shutdown_connections 2023-10-10T21:14:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.677+0000 7f934759e700 1 -- 172.21.15.154:0/2908291157 wait complete. 2023-10-10T21:14:50.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:14:50.911 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:50.910+0000 7f838c085180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:14:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.925+0000 7f4e1e99d700 1 Processor -- start 2023-10-10T21:14:50.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.925+0000 7f4e1e99d700 1 -- start start 2023-10-10T21:14:50.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.926+0000 7f4e1e99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e180c6c60 0x7f4e180c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.926+0000 7f4e1e99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e1806e8c0 0x7f4e180c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.926+0000 7f4e1e99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e180b1410 con 0x7f4e181595a0 2023-10-10T21:14:50.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.926+0000 7f4e1e99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e180b2b90 con 0x7f4e1806e8c0 2023-10-10T21:14:50.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.926+0000 7f4e1e99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e18063230 con 0x7f4e180c6c60 2023-10-10T21:14:50.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1d19a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e180c6c60 0x7f4e180c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1e19c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e1806e8c0 0x7f4e180c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1d19a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e180c6c60 0x7f4e180c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:50956/0 (socket says 172.21.15.154:50956) 2023-10-10T21:14:50.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1d19a700 1 -- 172.21.15.154:0/3192900776 learned_addr learned my addr 172.21.15.154:0/3192900776 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:50.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1d99b700 1 --1- 172.21.15.154:0/3192900776 >> v1:172.21.15.179:6789/0 conn(0x7f4e181595a0 0x7f4e180b18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:56320/0 (socket says 172.21.15.154:56320) 2023-10-10T21:14:50.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1e19c700 1 -- 172.21.15.154:0/3192900776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e180c6c60 msgr2=0x7f4e180c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:50.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1e19c700 1 --2- 172.21.15.154:0/3192900776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e180c6c60 0x7f4e180c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1e19c700 1 -- 172.21.15.154:0/3192900776 >> v1:172.21.15.179:6789/0 conn(0x7f4e181595a0 legacy=0x7f4e180b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1e19c700 1 -- 172.21.15.154:0/3192900776 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180634f0 con 0x7f4e1806e8c0 2023-10-10T21:14:50.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1c999700 1 -- 172.21.15.154:0/3192900776 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358990302 0 0) 0x7f4e180b1410 con 0x7f4e181595a0 2023-10-10T21:14:50.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.927+0000 7f4e1e19c700 1 --2- 172.21.15.154:0/3192900776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e1806e8c0 0x7f4e180c8660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009e60 tx=0x7f4e10009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c3a36da72e70fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:50.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.928+0000 7f4e1c999700 1 -- 172.21.15.154:0/3192900776 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000e070 con 0x7f4e1806e8c0 2023-10-10T21:14:50.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.928+0000 7f4e1c999700 1 -- 172.21.15.154:0/3192900776 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1000bb60 con 0x7f4e1806e8c0 2023-10-10T21:14:50.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.928+0000 7f4e1c999700 1 -- 172.21.15.154:0/3192900776 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10012430 con 0x7f4e1806e8c0 2023-10-10T21:14:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.928+0000 7f4e1e99d700 1 -- 172.21.15.154:0/3192900776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e1806e8c0 msgr2=0x7f4e180c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.929+0000 7f4e1e99d700 1 --2- 172.21.15.154:0/3192900776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e1806e8c0 0x7f4e180c8660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009e60 tx=0x7f4e10009780 comp rx=0 tx=0).stop 2023-10-10T21:14:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.929+0000 7f4e1e99d700 1 -- 172.21.15.154:0/3192900776 shutdown_connections 2023-10-10T21:14:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.929+0000 7f4e1e99d700 1 --2- 172.21.15.154:0/3192900776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e1806e8c0 0x7f4e180c8660 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.929+0000 7f4e1e99d700 1 --2- 172.21.15.154:0/3192900776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e180c6c60 0x7f4e180c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.929+0000 7f4e1e99d700 1 -- 172.21.15.154:0/3192900776 >> 172.21.15.154:0/3192900776 conn(0x7f4e1806ddb0 msgr2=0x7f4e1806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.929+0000 7f4e1e99d700 1 -- 172.21.15.154:0/3192900776 shutdown_connections 2023-10-10T21:14:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.929+0000 7f4e1e99d700 1 -- 172.21.15.154:0/3192900776 wait complete. 2023-10-10T21:14:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.931+0000 7f4e1e99d700 1 Processor -- start 2023-10-10T21:14:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.932+0000 7f4e1e99d700 1 -- start start 2023-10-10T21:14:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.933+0000 7f4e1e99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e1806e8c0 0x7f4e1815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.933+0000 7f4e1e99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e180c6c60 0x7f4e18151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.933+0000 7f4e1e99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e181595a0 0x7f4e1813c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.933+0000 7f4e1e99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1814cbc0 con 0x7f4e180c6c60 2023-10-10T21:14:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.933+0000 7f4e1e99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e18152060 con 0x7f4e1806e8c0 2023-10-10T21:14:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.933+0000 7f4e1e99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1814d110 con 0x7f4e181595a0 2023-10-10T21:14:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d19a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e180c6c60 0x7f4e18151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d19a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e180c6c60 0x7f4e18151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54472/0 (socket says 172.21.15.154:54472) 2023-10-10T21:14:50.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d19a700 1 -- 172.21.15.154:0/1210816411 learned_addr learned my addr 172.21.15.154:0/1210816411 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:50.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d99b700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e1806e8c0 0x7f4e1815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1e19c700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e181595a0 0x7f4e1813c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:50.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d19a700 1 -- 172.21.15.154:0/1210816411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e181595a0 msgr2=0x7f4e1813c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d19a700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e181595a0 0x7f4e1813c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d19a700 1 -- 172.21.15.154:0/1210816411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e1806e8c0 msgr2=0x7f4e1815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:50.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d19a700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e1806e8c0 0x7f4e1815c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:50.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d19a700 1 -- 172.21.15.154:0/1210816411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e10009a20 con 0x7f4e180c6c60 2023-10-10T21:14:50.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.934+0000 7f4e1d19a700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e180c6c60 0x7f4e18151b20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800ea50 tx=0x7f4e08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:50.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.935+0000 7f4e0dffb700 1 -- 172.21.15.154:0/1210816411 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800c640 con 0x7f4e180c6c60 2023-10-10T21:14:50.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.935+0000 7f4e0dffb700 1 -- 172.21.15.154:0/1210816411 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0800c7a0 con 0x7f4e180c6c60 2023-10-10T21:14:50.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.935+0000 7f4e0dffb700 1 -- 172.21.15.154:0/1210816411 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800cb20 con 0x7f4e180c6c60 2023-10-10T21:14:50.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.935+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1815ccd0 con 0x7f4e180c6c60 2023-10-10T21:14:50.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.935+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1814cda0 con 0x7f4e180c6c60 2023-10-10T21:14:50.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.936+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1815d1f0 con 0x7f4e180c6c60 2023-10-10T21:14:50.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.937+0000 7f4e0dffb700 1 -- 172.21.15.154:0/1210816411 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f4e08013470 con 0x7f4e180c6c60 2023-10-10T21:14:50.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.937+0000 7f4e0dffb700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4dfc0670e0 0x7f4dfc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:50.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.938+0000 7f4e0dffb700 1 -- 172.21.15.154:0/1210816411 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4e08084e30 con 0x7f4e180c6c60 2023-10-10T21:14:50.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.938+0000 7f4e1d99b700 1 -- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4dfc0670e0 msgr2=0x7f4dfc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:50.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.938+0000 7f4e1d99b700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4dfc0670e0 0x7f4dfc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:50.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:50.941+0000 7f4e0dffb700 1 -- 172.21.15.154:0/1210816411 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e1815d1f0 con 0x7f4e180c6c60 2023-10-10T21:14:51.006 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:51.004+0000 7f838c085180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:14:51.059 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:51.059+0000 7f42cc0f8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:14:51.096 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:51.095+0000 7f838c085180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:14:51.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.139+0000 7f4e1d99b700 1 -- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4dfc0670e0 msgr2=0x7f4dfc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:51.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.139+0000 7f4e1d99b700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4dfc0670e0 0x7f4dfc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:51.156 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:51.155+0000 7f42cc0f8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:14:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.185+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e1815d1f0 con 0x7f4e180c6c60 2023-10-10T21:14:51.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.186+0000 7f4e0dffb700 1 -- 172.21.15.154:0/1210816411 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f4e1815d1f0 con 0x7f4e180c6c60 2023-10-10T21:14:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:51.187 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/343222653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":343222653},{"type":"v1","addr":"172.21.15.154:6837","nonce":343222653}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2558521496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2558521496},{"type":"v1","addr":"172.21.15.179:6834","nonce":2558521496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3578232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3578232941},{"type":"v1","addr":"172.21.15.179:6835","nonce":3578232941}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:03:13.344673+0000","modified":"2023-10-10T21:03:17.047547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6836/2035241338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2035241338},{"type":"v1","addr":"172.21.15.154:6836","nonce":2035241338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-10T21:14:51.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.188+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4dfc0670e0 msgr2=0x7f4dfc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:51.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.188+0000 7f4e1e99d700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4dfc0670e0 0x7f4dfc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.188+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e180c6c60 msgr2=0x7f4e18151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.188+0000 7f4e1e99d700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e180c6c60 0x7f4e18151b20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800ea50 tx=0x7f4e08009250 comp rx=0 tx=0).stop 2023-10-10T21:14:51.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.189+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 shutdown_connections 2023-10-10T21:14:51.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.189+0000 7f4e1e99d700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f4dfc0670e0 0x7f4dfc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.189+0000 7f4e1e99d700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e181595a0 0x7f4e1813c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.189+0000 7f4e1e99d700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e1806e8c0 0x7f4e1815c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.189+0000 7f4e1e99d700 1 --2- 172.21.15.154:0/1210816411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e180c6c60 0x7f4e18151b20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.189+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 >> 172.21.15.154:0/1210816411 conn(0x7f4e1806ddb0 msgr2=0x7f4e1813d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:51.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.189+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 shutdown_connections 2023-10-10T21:14:51.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.189+0000 7f4e1e99d700 1 -- 172.21.15.154:0/1210816411 wait complete. 2023-10-10T21:14:51.192 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 14 2023-10-10T21:14:51.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:14:51.250 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:51.249+0000 7f42cc0f8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:14:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.396+0000 7fb3d359e700 1 Processor -- start 2023-10-10T21:14:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.396+0000 7fb3d359e700 1 -- start start 2023-10-10T21:14:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.397+0000 7fb3d359e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3d4159420 0x7fb3d40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.397+0000 7fb3d359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb3d415d230 0x7fb3d415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.397+0000 7fb3d359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d40b2980 con 0x7fb3d41597f0 2023-10-10T21:14:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.397+0000 7fb3d359e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d415db70 con 0x7fb3d4159420 2023-10-10T21:14:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.397+0000 7fb3d359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d40b11d0 con 0x7fb3d415d230 2023-10-10T21:14:51.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.398+0000 7fb3d259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3d4159420 0x7fb3d40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:51.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.398+0000 7fb3d259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3d4159420 0x7fb3d40b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54480/0 (socket says 172.21.15.154:54480) 2023-10-10T21:14:51.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.398+0000 7fb3d259c700 1 -- 172.21.15.154:0/2396077978 learned_addr learned my addr 172.21.15.154:0/2396077978 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:51.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.398+0000 7fb3d2d9d700 1 --2- 172.21.15.154:0/2396077978 >> v2:172.21.15.179:3300/0 conn(0x7fb3d415d230 0x7fb3d415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:51.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.398+0000 7fb3d259c700 1 -- 172.21.15.154:0/2396077978 >> v2:172.21.15.179:3300/0 conn(0x7fb3d415d230 msgr2=0x7fb3d415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.398+0000 7fb3d259c700 1 --2- 172.21.15.154:0/2396077978 >> v2:172.21.15.179:3300/0 conn(0x7fb3d415d230 0x7fb3d415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.398+0000 7fb3d259c700 1 -- 172.21.15.154:0/2396077978 >> v1:172.21.15.179:6789/0 conn(0x7fb3d41597f0 legacy=0x7fb3d40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.398+0000 7fb3d259c700 1 -- 172.21.15.154:0/2396077978 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40b14b0 con 0x7fb3d4159420 2023-10-10T21:14:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d259c700 1 --2- 172.21.15.154:0/2396077978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d4159420 0x7fb3d40b5f40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb3d415d170 tx=0x7fb3c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33d3d6e0626c706 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d159a700 1 -- 172.21.15.154:0/2396077978 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4009e70 con 0x7fb3d4159420 2023-10-10T21:14:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d159a700 1 -- 172.21.15.154:0/2396077978 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c400b860 con 0x7fb3d4159420 2023-10-10T21:14:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d159a700 1 -- 172.21.15.154:0/2396077978 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c400bc00 con 0x7fb3d4159420 2023-10-10T21:14:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d359e700 1 -- 172.21.15.154:0/2396077978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d4159420 msgr2=0x7fb3d40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d359e700 1 --2- 172.21.15.154:0/2396077978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d4159420 0x7fb3d40b5f40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb3d415d170 tx=0x7fb3c4009250 comp rx=0 tx=0).stop 2023-10-10T21:14:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d359e700 1 -- 172.21.15.154:0/2396077978 shutdown_connections 2023-10-10T21:14:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d359e700 1 --2- 172.21.15.154:0/2396077978 >> v2:172.21.15.179:3300/0 conn(0x7fb3d415d230 0x7fb3d415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d359e700 1 --2- 172.21.15.154:0/2396077978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d4159420 0x7fb3d40b5f40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.399+0000 7fb3d359e700 1 -- 172.21.15.154:0/2396077978 >> 172.21.15.154:0/2396077978 conn(0x7fb3d40d0660 msgr2=0x7fb3d40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.400+0000 7fb3d359e700 1 -- 172.21.15.154:0/2396077978 shutdown_connections 2023-10-10T21:14:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.400+0000 7fb3d359e700 1 -- 172.21.15.154:0/2396077978 wait complete. 2023-10-10T21:14:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.401+0000 7fb3d359e700 1 Processor -- start 2023-10-10T21:14:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.401+0000 7fb3d359e700 1 -- start start 2023-10-10T21:14:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.402+0000 7fb3d359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d4159420 0x7fb3d4146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.402+0000 7fb3d359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d41597f0 0x7fb3d40cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.402+0000 7fb3d359e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d415d230 0x7fb3d4158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.402+0000 7fb3d359e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40cb290 con 0x7fb3d415d230 2023-10-10T21:14:51.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.402+0000 7fb3d359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40ca6c0 con 0x7fb3d4159420 2023-10-10T21:14:51.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.402+0000 7fb3d359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40ca960 con 0x7fb3d41597f0 2023-10-10T21:14:51.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.402+0000 7fb3d2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d415d230 0x7fb3d4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:51.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.402+0000 7fb3d259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d4159420 0x7fb3d4146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:51.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d415d230 0x7fb3d4158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54494/0 (socket says 172.21.15.154:54494) 2023-10-10T21:14:51.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d4159420 0x7fb3d4146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:42096/0 (socket says 172.21.15.154:42096) 2023-10-10T21:14:51.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d2d9d700 1 -- 172.21.15.154:0/32342215 learned_addr learned my addr 172.21.15.154:0/32342215 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:51.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d1d9b700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d41597f0 0x7fb3d40cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:51.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d259c700 1 -- 172.21.15.154:0/32342215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d41597f0 msgr2=0x7fb3d40cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d259c700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d41597f0 0x7fb3d40cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d259c700 1 -- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d415d230 msgr2=0x7fb3d4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d259c700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d415d230 0x7fb3d4158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d259c700 1 -- 172.21.15.154:0/32342215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40094f0 con 0x7fb3d4159420 2023-10-10T21:14:51.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d2d9d700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d415d230 0x7fb3d4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:51.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3d259c700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d4159420 0x7fb3d4146fc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4089750 tx=0x7fb3c4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:51.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.403+0000 7fb3c27fc700 1 -- 172.21.15.154:0/32342215 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4000c90 con 0x7fb3d4159420 2023-10-10T21:14:51.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.404+0000 7fb3c27fc700 1 -- 172.21.15.154:0/32342215 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c400b9d0 con 0x7fb3d4159420 2023-10-10T21:14:51.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.404+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d40cac40 con 0x7fb3d4159420 2023-10-10T21:14:51.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.404+0000 7fb3c27fc700 1 -- 172.21.15.154:0/32342215 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4025420 con 0x7fb3d4159420 2023-10-10T21:14:51.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.404+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d4147500 con 0x7fb3d4159420 2023-10-10T21:14:51.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.405+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d40caaa0 con 0x7fb3d4159420 2023-10-10T21:14:51.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.406+0000 7fb3c27fc700 1 -- 172.21.15.154:0/32342215 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fb3c4023070 con 0x7fb3d4159420 2023-10-10T21:14:51.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.407+0000 7fb3c27fc700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb3b40670e0 0x7fb3b4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.407+0000 7fb3c27fc700 1 -- 172.21.15.154:0/32342215 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb3c4086130 con 0x7fb3d4159420 2023-10-10T21:14:51.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.407+0000 7fb3d1d9b700 1 -- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb3b40670e0 msgr2=0x7fb3b4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:51.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.407+0000 7fb3d1d9b700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb3b40670e0 0x7fb3b4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:51.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.411+0000 7fb3c27fc700 1 -- 172.21.15.154:0/32342215 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3d40caaa0 con 0x7fb3d4159420 2023-10-10T21:14:51.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.608+0000 7fb3d1d9b700 1 -- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb3b40670e0 msgr2=0x7fb3b4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:51.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.608+0000 7fb3d1d9b700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb3b40670e0 0x7fb3b4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:51.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.646+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3d40caaa0 con 0x7fb3d4159420 2023-10-10T21:14:51.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.648+0000 7fb3c27fc700 1 -- 172.21.15.154:0/32342215 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fb3d40caaa0 con 0x7fb3d4159420 2023-10-10T21:14:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:51.650 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":51,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:14:50.025098+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:03:11.022869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-10T21:03:12.323498+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/1040461821":"2023-10-11T21:03:34.274742+0000","172.21.15.154:0/885917098":"2023-10-11T21:03:34.274742+0000","172.21.15.154:6833/85496":"2023-10-11T21:03:34.274742+0000","172.21.15.154:6832/85496":"2023-10-11T21:03:34.274742+0000","172.21.15.154:0/2392137030":"2023-10-11T21:03:34.274742+0000","172.21.15.154:0/2001266548":"2023-10-11T21:03:34.274742+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":106,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":8,"length":2},{"begin":13,"length":1},{"begin":18,"length":2},{"begin":25,"length":1},{"begin":30,"length":2},{"begin":35,"length":1},{"begin":40,"length":3},{"begin":46,"length":1},{"begin":51,"length":3},{"begin":57,"length":1},{"begin":63,"length":2},{"begin":68,"length":1},{"begin":74,"length":2},{"begin":79,"length":1},{"begin":85,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":2},{"begin":108,"length":1},{"begin":167,"length":32}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:14:51.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb3b40670e0 msgr2=0x7fb3b4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:51.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb3b40670e0 0x7fb3b4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d4159420 msgr2=0x7fb3d4146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d4159420 0x7fb3d4146fc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4089750 tx=0x7fb3c4017000 comp rx=0 tx=0).stop 2023-10-10T21:14:51.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 shutdown_connections 2023-10-10T21:14:51.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3d415d230 0x7fb3d4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d4159420 0x7fb3d4146fc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb3b40670e0 0x7fb3b4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 --2- 172.21.15.154:0/32342215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d41597f0 0x7fb3d40cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 >> 172.21.15.154:0/32342215 conn(0x7fb3d40d0660 msgr2=0x7fb3d4069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:51.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 shutdown_connections 2023-10-10T21:14:51.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.651+0000 7fb3d359e700 1 -- 172.21.15.154:0/32342215 wait complete. 2023-10-10T21:14:51.671 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T21:14:51.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:14:51.718 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:51.717+0000 7f838c085180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:14:51.889 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:51.887+0000 7f838c085180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:14:51.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.923+0000 7fb091f9d700 1 Processor -- start 2023-10-10T21:14:51.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.924+0000 7fb091f9d700 1 -- start start 2023-10-10T21:14:51.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.925+0000 7fb091f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1593b0 0x7fb08c159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.925+0000 7fb091f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c0cfe20 con 0x7fb08c0b1e50 2023-10-10T21:14:51.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.925+0000 7fb091f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c0cf210 con 0x7fb08c0ceaa0 2023-10-10T21:14:51.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.925+0000 7fb091f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0cf4f0 con 0x7fb08c1593b0 2023-10-10T21:14:51.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.925+0000 7fb09179c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb08c0b1e50 0x7fb08c0b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36668/0 (socket says 172.21.15.154:36668) 2023-10-10T21:14:51.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.925+0000 7fb09179c700 1 -- 172.21.15.154:0/1045657182 learned_addr learned my addr 172.21.15.154:0/1045657182 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:51.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.925+0000 7fb090f9b700 1 --2- 172.21.15.154:0/1045657182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1593b0 0x7fb08c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:51.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb08b7fe700 1 -- 172.21.15.154:0/1045657182 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062095420 0 0) 0x7fb08c0cfe20 con 0x7fb08c0b1e50 2023-10-10T21:14:51.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb08b7fe700 1 -- 172.21.15.154:0/1045657182 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c003570 con 0x7fb08c0b1e50 2023-10-10T21:14:51.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb08b7fe700 1 -- 172.21.15.154:0/1045657182 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148966570 0 0) 0x7fb08c0cf210 con 0x7fb08c0ceaa0 2023-10-10T21:14:51.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb08b7fe700 1 -- 172.21.15.154:0/1045657182 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb08c0cfe20 con 0x7fb08c0ceaa0 2023-10-10T21:14:51.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb090f9b700 1 -- 172.21.15.154:0/1045657182 >> v1:172.21.15.179:6789/0 conn(0x7fb08c0ceaa0 legacy=0x7fb08c0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb090f9b700 1 -- 172.21.15.154:0/1045657182 >> v1:172.21.15.154:6789/0 conn(0x7fb08c0b1e50 legacy=0x7fb08c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb090f9b700 1 -- 172.21.15.154:0/1045657182 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0cf7d0 con 0x7fb08c1593b0 2023-10-10T21:14:51.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb090f9b700 1 --2- 172.21.15.154:0/1045657182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1593b0 0x7fb08c159780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb080009e90 tx=0x7fb080009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e1edf41812c7493 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:51.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb08b7fe700 1 -- 172.21.15.154:0/1045657182 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000e070 con 0x7fb08c1593b0 2023-10-10T21:14:51.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb08b7fe700 1 -- 172.21.15.154:0/1045657182 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08000bb80 con 0x7fb08c1593b0 2023-10-10T21:14:51.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.926+0000 7fb08b7fe700 1 -- 172.21.15.154:0/1045657182 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080012430 con 0x7fb08c1593b0 2023-10-10T21:14:51.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.927+0000 7fb091f9d700 1 -- 172.21.15.154:0/1045657182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1593b0 msgr2=0x7fb08c159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.927+0000 7fb091f9d700 1 --2- 172.21.15.154:0/1045657182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1593b0 0x7fb08c159780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb080009e90 tx=0x7fb080009780 comp rx=0 tx=0).stop 2023-10-10T21:14:51.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.927+0000 7fb091f9d700 1 -- 172.21.15.154:0/1045657182 shutdown_connections 2023-10-10T21:14:51.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.927+0000 7fb091f9d700 1 --2- 172.21.15.154:0/1045657182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1593b0 0x7fb08c159780 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.927+0000 7fb091f9d700 1 -- 172.21.15.154:0/1045657182 >> 172.21.15.154:0/1045657182 conn(0x7fb08c0d1130 msgr2=0x7fb08c0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:51.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.927+0000 7fb091f9d700 1 -- 172.21.15.154:0/1045657182 shutdown_connections 2023-10-10T21:14:51.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.927+0000 7fb091f9d700 1 -- 172.21.15.154:0/1045657182 wait complete. 2023-10-10T21:14:51.933 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:51.928+0000 7f42cc0f8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:14:51.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.929+0000 7fb091f9d700 1 Processor -- start 2023-10-10T21:14:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.929+0000 7fb091f9d700 1 -- start start 2023-10-10T21:14:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb091f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c0b1e50 0x7fb08c14e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb091f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c0ceaa0 0x7fb08c15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb091f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c1593b0 0x7fb08c15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb091f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c15a670 con 0x7fb08c0ceaa0 2023-10-10T21:14:51.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb091f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c150d60 con 0x7fb08c1593b0 2023-10-10T21:14:51.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb091f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c15b1c0 con 0x7fb08c0b1e50 2023-10-10T21:14:51.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb08bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c0ceaa0 0x7fb08c15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:51.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb090f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c0b1e50 0x7fb08c14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:51.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb09179c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c1593b0 0x7fb08c15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:51.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb090f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c0b1e50 0x7fb08c14e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:50982/0 (socket says 172.21.15.154:50982) 2023-10-10T21:14:51.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb08bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c0ceaa0 0x7fb08c15a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54496/0 (socket says 172.21.15.154:54496) 2023-10-10T21:14:51.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb090f9b700 1 -- 172.21.15.154:0/2908996978 learned_addr learned my addr 172.21.15.154:0/2908996978 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:51.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb090f9b700 1 -- 172.21.15.154:0/2908996978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c1593b0 msgr2=0x7fb08c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb090f9b700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c1593b0 0x7fb08c15dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb090f9b700 1 -- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c0ceaa0 msgr2=0x7fb08c15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:51.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.930+0000 7fb090f9b700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c0ceaa0 0x7fb08c15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:51.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.931+0000 7fb090f9b700 1 -- 172.21.15.154:0/2908996978 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080009a20 con 0x7fb08c0b1e50 2023-10-10T21:14:51.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.931+0000 7fb090f9b700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c0b1e50 0x7fb08c14e300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb0800099f0 tx=0x7fb080019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:51.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.931+0000 7fb088ff9700 1 -- 172.21.15.154:0/2908996978 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000be40 con 0x7fb08c0b1e50 2023-10-10T21:14:51.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.931+0000 7fb088ff9700 1 -- 172.21.15.154:0/2908996978 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080027470 con 0x7fb08c0b1e50 2023-10-10T21:14:51.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.931+0000 7fb088ff9700 1 -- 172.21.15.154:0/2908996978 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080027830 con 0x7fb08c0b1e50 2023-10-10T21:14:51.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.931+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c150150 con 0x7fb08c0b1e50 2023-10-10T21:14:51.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.931+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c150710 con 0x7fb08c0b1e50 2023-10-10T21:14:51.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.932+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c04c3c0 con 0x7fb08c0b1e50 2023-10-10T21:14:51.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.933+0000 7fb088ff9700 1 -- 172.21.15.154:0/2908996978 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fb080024070 con 0x7fb08c0b1e50 2023-10-10T21:14:51.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.934+0000 7fb088ff9700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb0700670e0 0x7fb070069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:51.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.934+0000 7fb088ff9700 1 -- 172.21.15.154:0/2908996978 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb080087810 con 0x7fb08c0b1e50 2023-10-10T21:14:51.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.934+0000 7fb08bfff700 1 -- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb0700670e0 msgr2=0x7fb070069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:51.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.934+0000 7fb08bfff700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb0700670e0 0x7fb070069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:51.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:51.943+0000 7fb088ff9700 1 -- 172.21.15.154:0/2908996978 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0800544a0 con 0x7fb08c0b1e50 2023-10-10T21:14:51.990 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:51.989+0000 7f838c085180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:14:52.109 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:52.108+0000 7f42cc0f8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:14:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.135+0000 7fb08bfff700 1 -- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb0700670e0 msgr2=0x7fb070069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.135+0000 7fb08bfff700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb0700670e0 0x7fb070069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:52.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.188+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb08c0b2510 con 0x7fb08c0b1e50 2023-10-10T21:14:52.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.188+0000 7fb088ff9700 1 -- 172.21.15.154:0/2908996978 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fb08002c020 con 0x7fb08c0b1e50 2023-10-10T21:14:52.190 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:52.190 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/343222653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":343222653},{"type":"v1","addr":"172.21.15.154:6837","nonce":343222653}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2558521496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2558521496},{"type":"v1","addr":"172.21.15.179:6834","nonce":2558521496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3578232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3578232941},{"type":"v1","addr":"172.21.15.179:6835","nonce":3578232941}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:03:13.344673+0000","modified":"2023-10-10T21:03:17.047547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6836/2035241338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2035241338},{"type":"v1","addr":"172.21.15.154:6836","nonce":2035241338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-10T21:14:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb0700670e0 msgr2=0x7fb070069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb0700670e0 0x7fb070069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c0b1e50 msgr2=0x7fb08c14e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c0b1e50 0x7fb08c14e300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb0800099f0 tx=0x7fb080019000 comp rx=0 tx=0).stop 2023-10-10T21:14:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 shutdown_connections 2023-10-10T21:14:52.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c1593b0 0x7fb08c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb0700670e0 0x7fb070069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c0b1e50 0x7fb08c14e300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 --2- 172.21.15.154:0/2908996978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c0ceaa0 0x7fb08c15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 >> 172.21.15.154:0/2908996978 conn(0x7fb08c0d1130 msgr2=0x7fb08c1579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:52.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 shutdown_connections 2023-10-10T21:14:52.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.191+0000 7fb091f9d700 1 -- 172.21.15.154:0/2908996978 wait complete. 2023-10-10T21:14:52.196 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 14 2023-10-10T21:14:52.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:14:52.211 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:52.209+0000 7f42cc0f8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:14:52.286 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:52.285+0000 7f838c085180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:14:52.380 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:52.379+0000 7f838c085180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:14:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.401+0000 7f1e1bfff700 1 Processor -- start 2023-10-10T21:14:52.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.402+0000 7f1e1bfff700 1 -- start start 2023-10-10T21:14:52.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.403+0000 7f1e1bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c159420 0x7f1e1c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.403+0000 7f1e1bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1e1c1597f0 0x7f1e1c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.403+0000 7f1e1bfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c0b11d0 con 0x7f1e1c15d230 2023-10-10T21:14:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.403+0000 7f1e1bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0b14b0 con 0x7f1e1c1597f0 2023-10-10T21:14:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.403+0000 7f1e1bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0b1790 con 0x7f1e1c159420 2023-10-10T21:14:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.403+0000 7f1e1b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1e1c15d230 0x7f1e1c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36670/0 (socket says 172.21.15.154:36670) 2023-10-10T21:14:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.403+0000 7f1e1b7fe700 1 -- 172.21.15.154:0/1479580856 learned_addr learned my addr 172.21.15.154:0/1479580856 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.403+0000 7f1e1a7fc700 1 --2- 172.21.15.154:0/1479580856 >> v2:172.21.15.179:3300/0 conn(0x7f1e1c1597f0 0x7f1e1c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.403+0000 7f1e1affd700 1 --2- 172.21.15.154:0/1479580856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c159420 0x7f1e1c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.404+0000 7f1e19ffb700 1 -- 172.21.15.154:0/1479580856 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367890144 0 0) 0x7f1e1c0b11d0 con 0x7f1e1c15d230 2023-10-10T21:14:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.404+0000 7f1e19ffb700 1 -- 172.21.15.154:0/1479580856 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e04003570 con 0x7f1e1c15d230 2023-10-10T21:14:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.404+0000 7f1e1affd700 1 -- 172.21.15.154:0/1479580856 >> v2:172.21.15.179:3300/0 conn(0x7f1e1c1597f0 msgr2=0x7f1e1c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.404+0000 7f1e1affd700 1 --2- 172.21.15.154:0/1479580856 >> v2:172.21.15.179:3300/0 conn(0x7f1e1c1597f0 0x7f1e1c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.404+0000 7f1e1affd700 1 -- 172.21.15.154:0/1479580856 >> v1:172.21.15.154:6789/0 conn(0x7f1e1c15d230 legacy=0x7f1e1c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.404+0000 7f1e1affd700 1 -- 172.21.15.154:0/1479580856 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0b1a70 con 0x7f1e1c159420 2023-10-10T21:14:52.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.404+0000 7f1e1a7fc700 1 --2- 172.21.15.154:0/1479580856 >> v2:172.21.15.179:3300/0 conn(0x7f1e1c1597f0 0x7f1e1c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:52.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.404+0000 7f1e1affd700 1 --2- 172.21.15.154:0/1479580856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c159420 0x7f1e1c0b5f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0098e0 tx=0x7f1e0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422e1476b5cbd83c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:52.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.404+0000 7f1e19ffb700 1 -- 172.21.15.154:0/1479580856 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c011630 con 0x7f1e1c159420 2023-10-10T21:14:52.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e19ffb700 1 -- 172.21.15.154:0/1479580856 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c011790 con 0x7f1e1c159420 2023-10-10T21:14:52.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e19ffb700 1 -- 172.21.15.154:0/1479580856 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c011b30 con 0x7f1e1c159420 2023-10-10T21:14:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e1bfff700 1 -- 172.21.15.154:0/1479580856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c159420 msgr2=0x7f1e1c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/1479580856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c159420 0x7f1e1c0b5f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0098e0 tx=0x7f1e0c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e1bfff700 1 -- 172.21.15.154:0/1479580856 shutdown_connections 2023-10-10T21:14:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/1479580856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c159420 0x7f1e1c0b5f40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/1479580856 >> v2:172.21.15.179:3300/0 conn(0x7f1e1c1597f0 0x7f1e1c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e1bfff700 1 -- 172.21.15.154:0/1479580856 >> 172.21.15.154:0/1479580856 conn(0x7f1e1c0d0660 msgr2=0x7f1e1c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e1bfff700 1 -- 172.21.15.154:0/1479580856 shutdown_connections 2023-10-10T21:14:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.405+0000 7f1e1bfff700 1 -- 172.21.15.154:0/1479580856 wait complete. 2023-10-10T21:14:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.407+0000 7f1e1bfff700 1 Processor -- start 2023-10-10T21:14:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.407+0000 7f1e1bfff700 1 -- start start 2023-10-10T21:14:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c159420 0x7f1e1c16ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e1c1597f0 0x7f1e1c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c15d230 0x7f1e1c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c153380 con 0x7f1e1c159420 2023-10-10T21:14:52.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c153660 con 0x7f1e1c1597f0 2023-10-10T21:14:52.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c153940 con 0x7f1e1c15d230 2023-10-10T21:14:52.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c159420 0x7f1e1c16ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c159420 0x7f1e1c16ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54500/0 (socket says 172.21.15.154:54500) 2023-10-10T21:14:52.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1affd700 1 -- 172.21.15.154:0/310670230 learned_addr learned my addr 172.21.15.154:0/310670230 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:52.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1b7fe700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c15d230 0x7f1e1c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.408+0000 7f1e1a7fc700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e1c1597f0 0x7f1e1c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e1affd700 1 -- 172.21.15.154:0/310670230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c15d230 msgr2=0x7f1e1c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:52.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e1affd700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c15d230 0x7f1e1c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e1affd700 1 -- 172.21.15.154:0/310670230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e1c1597f0 msgr2=0x7f1e1c154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e1affd700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e1c1597f0 0x7f1e1c154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e1affd700 1 -- 172.21.15.154:0/310670230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e10009420 con 0x7f1e1c159420 2023-10-10T21:14:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e1affd700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c159420 0x7f1e1c16ab10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0b18d0 tx=0x7f1e0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e02ffd700 1 -- 172.21.15.154:0/310670230 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c000d10 con 0x7f1e1c159420 2023-10-10T21:14:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e02ffd700 1 -- 172.21.15.154:0/310670230 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c011b10 con 0x7f1e1c159420 2023-10-10T21:14:52.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e02ffd700 1 -- 172.21.15.154:0/310670230 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c025660 con 0x7f1e1c159420 2023-10-10T21:14:52.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0c009420 con 0x7f1e1c159420 2023-10-10T21:14:52.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.409+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c16b050 con 0x7f1e1c159420 2023-10-10T21:14:52.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.410+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c153e40 con 0x7f1e1c159420 2023-10-10T21:14:52.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.411+0000 7f1e02ffd700 1 -- 172.21.15.154:0/310670230 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f1e0c025a50 con 0x7f1e1c159420 2023-10-10T21:14:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.413+0000 7f1e02ffd700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1e080670e0 0x7f1e08069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.413+0000 7f1e02ffd700 1 -- 172.21.15.154:0/310670230 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1e0c0864a0 con 0x7f1e1c159420 2023-10-10T21:14:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.413+0000 7f1e1a7fc700 1 -- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1e080670e0 msgr2=0x7f1e08069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.413+0000 7f1e1a7fc700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1e080670e0 0x7f1e08069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:52.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.423+0000 7f1e02ffd700 1 -- 172.21.15.154:0/310670230 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e0c053000 con 0x7f1e1c159420 2023-10-10T21:14:52.522 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:52.521+0000 7f42cc0f8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:14:52.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.614+0000 7f1e1a7fc700 1 -- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1e080670e0 msgr2=0x7f1e08069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:52.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.614+0000 7f1e1a7fc700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1e080670e0 0x7f1e08069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:52.620 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:52.620+0000 7f42cc0f8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:14:52.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.668+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e1c1534c0 con 0x7f1e1c159420 2023-10-10T21:14:52.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.669+0000 7f1e02ffd700 1 -- 172.21.15.154:0/310670230 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f1e1c1534c0 con 0x7f1e1c159420 2023-10-10T21:14:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:52.671 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/343222653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":343222653},{"type":"v1","addr":"172.21.15.154:6837","nonce":343222653}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2558521496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2558521496},{"type":"v1","addr":"172.21.15.179:6834","nonce":2558521496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3578232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3578232941},{"type":"v1","addr":"172.21.15.179:6835","nonce":3578232941}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:03:13.344673+0000","modified":"2023-10-10T21:03:17.047547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6836/2035241338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2035241338},{"type":"v1","addr":"172.21.15.154:6836","nonce":2035241338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-10T21:14:52.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1e080670e0 msgr2=0x7f1e08069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:52.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1e080670e0 0x7f1e08069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c159420 msgr2=0x7f1e1c16ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:52.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c159420 0x7f1e1c16ab10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0b18d0 tx=0x7f1e0c017000 comp rx=0 tx=0).stop 2023-10-10T21:14:52.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 shutdown_connections 2023-10-10T21:14:52.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f1e080670e0 0x7f1e08069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e1c15d230 0x7f1e1c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c159420 0x7f1e1c16ab10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/310670230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e1c1597f0 0x7f1e1c154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 >> 172.21.15.154:0/310670230 conn(0x7f1e1c0d0660 msgr2=0x7f1e1c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:52.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 shutdown_connections 2023-10-10T21:14:52.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.672+0000 7f1e1bfff700 1 -- 172.21.15.154:0/310670230 wait complete. 2023-10-10T21:14:52.676 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 14 2023-10-10T21:14:52.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:14:52.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.877+0000 7f2445d9d700 1 Processor -- start 2023-10-10T21:14:52.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.877+0000 7f2445d9d700 1 -- start start 2023-10-10T21:14:52.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.878+0000 7f2445d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2440142ea0 0x7f24400b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.878+0000 7f2445d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f24400ad870 0x7f244006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.878+0000 7f2445d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b3b70 0x7f244006bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.878+0000 7f2445d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24400b40f0 con 0x7f2440142ea0 2023-10-10T21:14:52.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.878+0000 7f2445d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2440069640 con 0x7f24400ad870 2023-10-10T21:14:52.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.878+0000 7f2445d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2440069920 con 0x7f24400b3b70 2023-10-10T21:14:52.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f2444d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2440142ea0 0x7f24400b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f2444d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2440142ea0 0x7f24400b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54506/0 (socket says 172.21.15.154:54506) 2023-10-10T21:14:52.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f2444d9b700 1 -- 172.21.15.154:0/2171802862 learned_addr learned my addr 172.21.15.154:0/2171802862 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:52.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f243ffff700 1 --2- 172.21.15.154:0/2171802862 >> v2:172.21.15.179:3300/0 conn(0x7f24400ad870 0x7f244006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f244559c700 1 --2- 172.21.15.154:0/2171802862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b3b70 0x7f244006bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f2444d9b700 1 -- 172.21.15.154:0/2171802862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b3b70 msgr2=0x7f244006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:52.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f2444d9b700 1 --2- 172.21.15.154:0/2171802862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b3b70 0x7f244006bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f2444d9b700 1 -- 172.21.15.154:0/2171802862 >> v2:172.21.15.179:3300/0 conn(0x7f24400ad870 msgr2=0x7f244006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:52.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f2444d9b700 1 --2- 172.21.15.154:0/2171802862 >> v2:172.21.15.179:3300/0 conn(0x7f24400ad870 0x7f244006b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.879+0000 7f2444d9b700 1 -- 172.21.15.154:0/2171802862 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440069c00 con 0x7f2440142ea0 2023-10-10T21:14:52.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f2444d9b700 1 --2- 172.21.15.154:0/2171802862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2440142ea0 0x7f24400b3630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f24400b0e10 tx=0x7f2434009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e19f6283c78a435 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:52.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f243f7fe700 1 -- 172.21.15.154:0/2171802862 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243400b640 con 0x7f2440142ea0 2023-10-10T21:14:52.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f243f7fe700 1 -- 172.21.15.154:0/2171802862 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243400b7a0 con 0x7f2440142ea0 2023-10-10T21:14:52.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f243f7fe700 1 -- 172.21.15.154:0/2171802862 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243400bb60 con 0x7f2440142ea0 2023-10-10T21:14:52.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f2445d9d700 1 -- 172.21.15.154:0/2171802862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2440142ea0 msgr2=0x7f24400b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:52.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2171802862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2440142ea0 0x7f24400b3630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f24400b0e10 tx=0x7f2434009250 comp rx=0 tx=0).stop 2023-10-10T21:14:52.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f2445d9d700 1 -- 172.21.15.154:0/2171802862 shutdown_connections 2023-10-10T21:14:52.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2171802862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b3b70 0x7f244006bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2171802862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2440142ea0 0x7f24400b3630 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2171802862 >> v2:172.21.15.179:3300/0 conn(0x7f24400ad870 0x7f244006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f2445d9d700 1 -- 172.21.15.154:0/2171802862 >> 172.21.15.154:0/2171802862 conn(0x7f24400ce430 msgr2=0x7f24400ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:52.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.880+0000 7f2445d9d700 1 -- 172.21.15.154:0/2171802862 shutdown_connections 2023-10-10T21:14:52.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.881+0000 7f2445d9d700 1 -- 172.21.15.154:0/2171802862 wait complete. 2023-10-10T21:14:52.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.882+0000 7f2445d9d700 1 Processor -- start 2023-10-10T21:14:52.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.882+0000 7f2445d9d700 1 -- start start 2023-10-10T21:14:52.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f2445d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b3b70 0x7f24400c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f2445d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440142ea0 0x7f24400af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f2445d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400c9300 0x7f244013fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f2445d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400ca480 con 0x7f24400b3b70 2023-10-10T21:14:52.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f2445d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400c9870 con 0x7f2440142ea0 2023-10-10T21:14:52.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f2445d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24400c9b50 con 0x7f24400c9300 2023-10-10T21:14:52.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f2444d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b3b70 0x7f24400c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f2444d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b3b70 0x7f24400c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54522/0 (socket says 172.21.15.154:54522) 2023-10-10T21:14:52.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f2444d9b700 1 -- 172.21.15.154:0/2091534701 learned_addr learned my addr 172.21.15.154:0/2091534701 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:52.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f243ffff700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440142ea0 0x7f24400af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.883+0000 7f244559c700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400c9300 0x7f244013fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:52.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f2444d9b700 1 -- 172.21.15.154:0/2091534701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400c9300 msgr2=0x7f244013fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:52.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f2444d9b700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400c9300 0x7f244013fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f2444d9b700 1 -- 172.21.15.154:0/2091534701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440142ea0 msgr2=0x7f24400af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:52.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f2444d9b700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440142ea0 0x7f24400af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:52.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f2444d9b700 1 -- 172.21.15.154:0/2091534701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340094f0 con 0x7f24400b3b70 2023-10-10T21:14:52.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f2444d9b700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b3b70 0x7f24400c81b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f244006f0d0 tx=0x7f2434017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:52.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f243cff9700 1 -- 172.21.15.154:0/2091534701 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243400b910 con 0x7f24400b3b70 2023-10-10T21:14:52.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f243cff9700 1 -- 172.21.15.154:0/2091534701 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243400ba70 con 0x7f24400b3b70 2023-10-10T21:14:52.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24400c9e30 con 0x7f24400b3b70 2023-10-10T21:14:52.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f243cff9700 1 -- 172.21.15.154:0/2091534701 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434011630 con 0x7f24400b3b70 2023-10-10T21:14:52.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.884+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24400c86f0 con 0x7f24400b3b70 2023-10-10T21:14:52.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.886+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244004c3c0 con 0x7f24400b3b70 2023-10-10T21:14:52.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.886+0000 7f243cff9700 1 -- 172.21.15.154:0/2091534701 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f24340119a0 con 0x7f24400b3b70 2023-10-10T21:14:52.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.887+0000 7f243cff9700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f24240670e0 0x7f2424069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:52.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.887+0000 7f243cff9700 1 -- 172.21.15.154:0/2091534701 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2434086370 con 0x7f24400b3b70 2023-10-10T21:14:52.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.887+0000 7f243ffff700 1 -- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f24240670e0 msgr2=0x7f2424069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:52.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.887+0000 7f243ffff700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f24240670e0 0x7f2424069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:52.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:52.891+0000 7f243cff9700 1 -- 172.21.15.154:0/2091534701 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2434052ed0 con 0x7f24400b3b70 2023-10-10T21:14:53.072 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:53.071+0000 7f838c085180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:14:53.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.088+0000 7f243ffff700 1 -- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f24240670e0 msgr2=0x7f2424069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:53.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.088+0000 7f243ffff700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f24240670e0 0x7f2424069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:53.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.088+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2440143270 con 0x7f24400b3b70 2023-10-10T21:14:53.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.089+0000 7f243cff9700 1 -- 172.21.15.154:0/2091534701 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f24340564f0 con 0x7f24400b3b70 2023-10-10T21:14:53.090 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:14:53.091 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":51,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:14:50.025098+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:03:11.022869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-10T21:03:12.323498+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/1040461821":"2023-10-11T21:03:34.274742+0000","172.21.15.154:0/885917098":"2023-10-11T21:03:34.274742+0000","172.21.15.154:6833/85496":"2023-10-11T21:03:34.274742+0000","172.21.15.154:6832/85496":"2023-10-11T21:03:34.274742+0000","172.21.15.154:0/2392137030":"2023-10-11T21:03:34.274742+0000","172.21.15.154:0/2001266548":"2023-10-11T21:03:34.274742+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":106,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":8,"length":2},{"begin":13,"length":1},{"begin":18,"length":2},{"begin":25,"length":1},{"begin":30,"length":2},{"begin":35,"length":1},{"begin":40,"length":3},{"begin":46,"length":1},{"begin":51,"length":3},{"begin":57,"length":1},{"begin":63,"length":2},{"begin":68,"length":1},{"begin":74,"length":2},{"begin":79,"length":1},{"begin":85,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":2},{"begin":108,"length":1},{"begin":167,"length":32}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:14:53.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f24240670e0 msgr2=0x7f2424069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:53.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f24240670e0 0x7f2424069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b3b70 msgr2=0x7f24400c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b3b70 0x7f24400c81b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f244006f0d0 tx=0x7f2434017000 comp rx=0 tx=0).stop 2023-10-10T21:14:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 shutdown_connections 2023-10-10T21:14:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f24240670e0 0x7f2424069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400c9300 0x7f244013fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b3b70 0x7f24400c81b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 --2- 172.21.15.154:0/2091534701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440142ea0 0x7f24400af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 >> 172.21.15.154:0/2091534701 conn(0x7f24400ce430 msgr2=0x7f24400ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:53.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 shutdown_connections 2023-10-10T21:14:53.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.091+0000 7f2445d9d700 1 -- 172.21.15.154:0/2091534701 wait complete. 2023-10-10T21:14:53.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T21:14:53.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.299+0000 7f68ed99d700 1 Processor -- start 2023-10-10T21:14:53.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.299+0000 7f68ed99d700 1 -- start start 2023-10-10T21:14:53.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.300+0000 7f68ed99d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68e8156310 0x7f68e80c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68ed99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e80ca860 con 0x7f68e81566e0 2023-10-10T21:14:53.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68ed99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e80cab40 con 0x7f68e80ae710 2023-10-10T21:14:53.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68ed99d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e80cae20 con 0x7f68e8156310 2023-10-10T21:14:53.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68ec99b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68e8156310 0x7f68e80c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68ec99b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68e8156310 0x7f68e80c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54538/0 (socket says 172.21.15.154:54538) 2023-10-10T21:14:53.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68ec99b700 1 -- 172.21.15.154:0/323595564 learned_addr learned my addr 172.21.15.154:0/323595564 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:53.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68e7fff700 1 --1- 172.21.15.154:0/323595564 >> v1:172.21.15.154:6789/0 conn(0x7f68e81566e0 0x7f68e80ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36676/0 (socket says 172.21.15.154:36676) 2023-10-10T21:14:53.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68e77fe700 1 -- 172.21.15.154:0/323595564 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637302550 0 0) 0x7f68e80ca860 con 0x7f68e81566e0 2023-10-10T21:14:53.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68e77fe700 1 -- 172.21.15.154:0/323595564 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68d8003570 con 0x7f68e81566e0 2023-10-10T21:14:53.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68e77fe700 1 -- 172.21.15.154:0/323595564 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599111903 0 0) 0x7f68e80cab40 con 0x7f68e80ae710 2023-10-10T21:14:53.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68ec99b700 1 -- 172.21.15.154:0/323595564 >> v1:172.21.15.179:6789/0 conn(0x7f68e80ae710 legacy=0x7f68e80c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68ec99b700 1 -- 172.21.15.154:0/323595564 >> v1:172.21.15.154:6789/0 conn(0x7f68e81566e0 legacy=0x7f68e80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.301+0000 7f68ec99b700 1 -- 172.21.15.154:0/323595564 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e80cb100 con 0x7f68e8156310 2023-10-10T21:14:53.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.302+0000 7f68ec99b700 1 --2- 172.21.15.154:0/323595564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 0x7f68e80c9dc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00bc50 tx=0x7f68dc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e790ce70098b327 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:53.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.302+0000 7f68e77fe700 1 -- 172.21.15.154:0/323595564 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc00dbf0 con 0x7f68e8156310 2023-10-10T21:14:53.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.302+0000 7f68e77fe700 1 -- 172.21.15.154:0/323595564 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc00dd50 con 0x7f68e8156310 2023-10-10T21:14:53.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.302+0000 7f68e77fe700 1 -- 172.21.15.154:0/323595564 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0196b0 con 0x7f68e8156310 2023-10-10T21:14:53.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.303+0000 7f68ed99d700 1 -- 172.21.15.154:0/323595564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 msgr2=0x7f68e80c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.303+0000 7f68ed99d700 1 --2- 172.21.15.154:0/323595564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 0x7f68e80c9dc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00bc50 tx=0x7f68dc00b4f0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.303+0000 7f68ed99d700 1 -- 172.21.15.154:0/323595564 shutdown_connections 2023-10-10T21:14:53.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.303+0000 7f68ed99d700 1 --2- 172.21.15.154:0/323595564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 0x7f68e80c9dc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.303+0000 7f68ed99d700 1 -- 172.21.15.154:0/323595564 >> 172.21.15.154:0/323595564 conn(0x7f68e80cc1f0 msgr2=0x7f68e80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:53.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.303+0000 7f68ed99d700 1 -- 172.21.15.154:0/323595564 shutdown_connections 2023-10-10T21:14:53.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.303+0000 7f68ed99d700 1 -- 172.21.15.154:0/323595564 wait complete. 2023-10-10T21:14:53.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.304+0000 7f68ed99d700 1 Processor -- start 2023-10-10T21:14:53.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.304+0000 7f68ed99d700 1 -- start start 2023-10-10T21:14:53.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.305+0000 7f68ed99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68e80ae710 0x7f68e80b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.305+0000 7f68ed99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 0x7f68e8150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.305+0000 7f68ed99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68e81566e0 0x7f68e815eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.305+0000 7f68ed99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80b15a0 con 0x7f68e8156310 2023-10-10T21:14:53.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.305+0000 7f68ed99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e814b920 con 0x7f68e81566e0 2023-10-10T21:14:53.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.305+0000 7f68ed99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e8150a60 con 0x7f68e80ae710 2023-10-10T21:14:53.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 0x7f68e8150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 0x7f68e8150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54552/0 (socket says 172.21.15.154:54552) 2023-10-10T21:14:53.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e7fff700 1 -- 172.21.15.154:0/1902440425 learned_addr learned my addr 172.21.15.154:0/1902440425 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:53.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68ec99b700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68e80ae710 0x7f68e80b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68ed19c700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68e81566e0 0x7f68e815eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e7fff700 1 -- 172.21.15.154:0/1902440425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68e80ae710 msgr2=0x7f68e80b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e7fff700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68e80ae710 0x7f68e80b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e7fff700 1 -- 172.21.15.154:0/1902440425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68e81566e0 msgr2=0x7f68e815eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e7fff700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68e81566e0 0x7f68e815eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e7fff700 1 -- 172.21.15.154:0/1902440425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc00b790 con 0x7f68e8156310 2023-10-10T21:14:53.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e7fff700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 0x7f68e8150520 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f68d400c7f0 tx=0x7f68d4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:53.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.306+0000 7f68e4ff9700 1 -- 172.21.15.154:0/1902440425 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4005a70 con 0x7f68e8156310 2023-10-10T21:14:53.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.307+0000 7f68e4ff9700 1 -- 172.21.15.154:0/1902440425 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4005bf0 con 0x7f68e8156310 2023-10-10T21:14:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.307+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e814b640 con 0x7f68e8156310 2023-10-10T21:14:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.307+0000 7f68e4ff9700 1 -- 172.21.15.154:0/1902440425 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d40070d0 con 0x7f68e8156310 2023-10-10T21:14:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.307+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e80b1230 con 0x7f68e8156310 2023-10-10T21:14:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.308+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e80b1750 con 0x7f68e8156310 2023-10-10T21:14:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.309+0000 7f68e4ff9700 1 -- 172.21.15.154:0/1902440425 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f68d4007480 con 0x7f68e8156310 2023-10-10T21:14:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.309+0000 7f68e4ff9700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68cc0670e0 0x7f68cc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.310+0000 7f68e4ff9700 1 -- 172.21.15.154:0/1902440425 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f68d4083f90 con 0x7f68e8156310 2023-10-10T21:14:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.310+0000 7f68ec99b700 1 -- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68cc0670e0 msgr2=0x7f68cc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.310+0000 7f68ec99b700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68cc0670e0 0x7f68cc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:14:53.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.318+0000 7f68e4ff9700 1 -- 172.21.15.154:0/1902440425 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68e80b1750 con 0x7f68e8156310 2023-10-10T21:14:53.361 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:53.359+0000 7f838c085180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:14:53.365 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:53.364+0000 7f42cc0f8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:14:53.452 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:53.451+0000 7f838c085180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:14:53.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.511+0000 7f68ec99b700 1 -- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68cc0670e0 msgr2=0x7f68cc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/85496 2023-10-10T21:14:53.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.511+0000 7f68ec99b700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68cc0670e0 0x7f68cc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:14:53.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.562+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f68e80b1750 con 0x7f68e8156310 2023-10-10T21:14:53.563 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T21:14:53.563+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T21:14:53.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.568+0000 7f68e4ff9700 1 -- 172.21.15.154:0/1902440425 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7f68e80b1750 con 0x7f68e8156310 2023-10-10T21:14:53.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68cc0670e0 msgr2=0x7f68cc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:14:53.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68cc0670e0 0x7f68cc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 msgr2=0x7f68e8150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 0x7f68e8150520 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f68d400c7f0 tx=0x7f68d4007d90 comp rx=0 tx=0).stop 2023-10-10T21:14:53.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 shutdown_connections 2023-10-10T21:14:53.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68e81566e0 0x7f68e815eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7f68cc0670e0 0x7f68cc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68e80ae710 0x7f68e80b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 --2- 172.21.15.154:0/1902440425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8156310 0x7f68e8150520 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 >> 172.21.15.154:0/1902440425 conn(0x7f68e80cc1f0 msgr2=0x7f68e806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:53.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 shutdown_connections 2023-10-10T21:14:53.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.570+0000 7f68ed99d700 1 -- 172.21.15.154:0/1902440425 wait complete. 2023-10-10T21:14:53.574 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T21:14:53.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T21:14:53.607 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:53.605+0000 7f838c085180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:14:53.627 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:14:53.665 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:53.665+0000 7f42cc0f8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:14:53.714 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:53.713+0000 7f838c085180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:14:53.762 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:53.761+0000 7f42cc0f8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:14:53.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.783+0000 7fb749f9d700 1 Processor -- start 2023-10-10T21:14:53.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.783+0000 7fb749f9d700 1 -- start start 2023-10-10T21:14:53.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.784+0000 7fb749f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7440b4e70 0x7fb7440ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.784+0000 7fb749f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 0x7fb7440b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.784+0000 7fb749f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7440b2080 con 0x7fb74415d240 2023-10-10T21:14:53.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.784+0000 7fb749f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7440cfb00 con 0x7fb7440b4e70 2023-10-10T21:14:53.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.784+0000 7fb749f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440b5c40 con 0x7fb7440b16d0 2023-10-10T21:14:53.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.785+0000 7fb748f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7440b4e70 0x7fb7440ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.785+0000 7fb748f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7440b4e70 0x7fb7440ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54566/0 (socket says 172.21.15.154:54566) 2023-10-10T21:14:53.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.785+0000 7fb748f9b700 1 -- 172.21.15.154:0/4085477424 learned_addr learned my addr 172.21.15.154:0/4085477424 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:53.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.785+0000 7fb743fff700 1 --2- 172.21.15.154:0/4085477424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 0x7fb7440b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.785+0000 7fb748f9b700 1 -- 172.21.15.154:0/4085477424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 msgr2=0x7fb7440b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:53.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.785+0000 7fb748f9b700 1 --2- 172.21.15.154:0/4085477424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 0x7fb7440b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.785+0000 7fb748f9b700 1 -- 172.21.15.154:0/4085477424 >> v1:172.21.15.154:6789/0 conn(0x7fb74415d240 legacy=0x7fb74415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.785+0000 7fb748f9b700 1 -- 172.21.15.154:0/4085477424 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440b5f20 con 0x7fb7440b4e70 2023-10-10T21:14:53.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.785+0000 7fb748f9b700 1 --2- 172.21.15.154:0/4085477424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 0x7fb7440ccff0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb7380099b0 tx=0x7fb738009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae908182680df779 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:53.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb7437fe700 1 -- 172.21.15.154:0/4085477424 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738009ea0 con 0x7fb7440b4e70 2023-10-10T21:14:53.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb7437fe700 1 -- 172.21.15.154:0/4085477424 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73800b860 con 0x7fb7440b4e70 2023-10-10T21:14:53.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb7437fe700 1 -- 172.21.15.154:0/4085477424 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800bc00 con 0x7fb7440b4e70 2023-10-10T21:14:53.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb749f9d700 1 -- 172.21.15.154:0/4085477424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 msgr2=0x7fb7440ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb749f9d700 1 --2- 172.21.15.154:0/4085477424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 0x7fb7440ccff0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb7380099b0 tx=0x7fb738009250 comp rx=0 tx=0).stop 2023-10-10T21:14:53.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb749f9d700 1 -- 172.21.15.154:0/4085477424 shutdown_connections 2023-10-10T21:14:53.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb749f9d700 1 --2- 172.21.15.154:0/4085477424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 0x7fb7440ccff0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb749f9d700 1 --2- 172.21.15.154:0/4085477424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 0x7fb7440b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb749f9d700 1 -- 172.21.15.154:0/4085477424 >> 172.21.15.154:0/4085477424 conn(0x7fb7440d10c0 msgr2=0x7fb7440affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:53.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.786+0000 7fb749f9d700 1 -- 172.21.15.154:0/4085477424 shutdown_connections 2023-10-10T21:14:53.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.787+0000 7fb749f9d700 1 -- 172.21.15.154:0/4085477424 wait complete. 2023-10-10T21:14:53.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.788+0000 7fb749f9d700 1 Processor -- start 2023-10-10T21:14:53.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.788+0000 7fb749f9d700 1 -- start start 2023-10-10T21:14:53.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb749f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 0x7fb7440ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb749f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 0x7fb74414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb749f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74415d240 0x7fb744068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb749f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74414b600 con 0x7fb7440b4e70 2023-10-10T21:14:53.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb749f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440caf10 con 0x7fb74415d240 2023-10-10T21:14:53.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb749f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440cb1f0 con 0x7fb7440b16d0 2023-10-10T21:14:53.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb743fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 0x7fb74414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb743fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 0x7fb74414b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54582/0 (socket says 172.21.15.154:54582) 2023-10-10T21:14:53.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb743fff700 1 -- 172.21.15.154:0/557557816 learned_addr learned my addr 172.21.15.154:0/557557816 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:53.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb748f9b700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 0x7fb7440ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.789+0000 7fb74979c700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74415d240 0x7fb744068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb743fff700 1 -- 172.21.15.154:0/557557816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 msgr2=0x7fb7440ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb743fff700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 0x7fb7440ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb743fff700 1 -- 172.21.15.154:0/557557816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74415d240 msgr2=0x7fb744068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:53.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb743fff700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74415d240 0x7fb744068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb743fff700 1 -- 172.21.15.154:0/557557816 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7380094f0 con 0x7fb7440b4e70 2023-10-10T21:14:53.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb743fff700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 0x7fb74414b0c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb73000ec80 tx=0x7fb7300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:53.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb740ff9700 1 -- 172.21.15.154:0/557557816 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000c850 con 0x7fb7440b4e70 2023-10-10T21:14:53.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb740ff9700 1 -- 172.21.15.154:0/557557816 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73000c9b0 con 0x7fb7440b4e70 2023-10-10T21:14:53.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb740ff9700 1 -- 172.21.15.154:0/557557816 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000cd50 con 0x7fb7440b4e70 2023-10-10T21:14:53.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb749f9d700 1 -- 172.21.15.154:0/557557816 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7440cb4d0 con 0x7fb7440b4e70 2023-10-10T21:14:53.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.790+0000 7fb749f9d700 1 -- 172.21.15.154:0/557557816 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7440cba90 con 0x7fb7440b4e70 2023-10-10T21:14:53.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.791+0000 7fb749f9d700 1 -- 172.21.15.154:0/557557816 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb744088990 con 0x7fb7440b4e70 2023-10-10T21:14:53.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.792+0000 7fb740ff9700 1 -- 172.21.15.154:0/557557816 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fb730013680 con 0x7fb7440b4e70 2023-10-10T21:14:53.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.793+0000 7fb740ff9700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7280670e0 0x7fb728069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:53.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.793+0000 7fb740ff9700 1 -- 172.21.15.154:0/557557816 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fb730084de0 con 0x7fb7440b4e70 2023-10-10T21:14:53.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.793+0000 7fb748f9b700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7280670e0 0x7fb728069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:53.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.794+0000 7fb748f9b700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7280670e0 0x7fb728069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello connection peer type does not match what peer advertises 16 != 2 2023-10-10T21:14:53.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.794+0000 7fb748f9b700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7280670e0 0x7fb728069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.794+0000 7fb740ff9700 1 -- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7280670e0 msgr2=0x7fb728069590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-10T21:14:53.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.794+0000 7fb740ff9700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7280670e0 0x7fb728069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:53.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:53.797+0000 7fb740ff9700 1 -- 172.21.15.154:0/557557816 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb730051a70 con 0x7fb7440b4e70 2023-10-10T21:14:53.900 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:53.899+0000 7f838c085180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:14:53.923 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:53.922+0000 7f42cc0f8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:14:53.990 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:53.989+0000 7f838c085180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:14:54.030 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.029+0000 7f42cc0f8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:14:54.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.043+0000 7fb749f9d700 1 -- 172.21.15.154:0/557557816 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb74404bb80 con 0x7fb7440b4e70 2023-10-10T21:14:54.079 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:54.078+0000 7f838c085180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:14:54.175 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:14:54.173+0000 7f838c085180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:14:54.220 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.219+0000 7f42cc0f8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:14:54.312 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.311+0000 7f42cc0f8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:14:54.404 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.403+0000 7f42cc0f8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:14:54.497 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.496+0000 7f42cc0f8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:14:54.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.505+0000 7fb740ff9700 1 -- 172.21.15.154:0/557557816 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 15) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fb730051e40 con 0x7fb7440b4e70 2023-10-10T21:14:54.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.569+0000 7fb740ff9700 1 -- 172.21.15.154:0/557557816 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb730055500 con 0x7fb7440b4e70 2023-10-10T21:14:54.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.572+0000 7fb749f9d700 1 -- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 msgr2=0x7fb74414b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:54.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.572+0000 7fb749f9d700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 0x7fb74414b0c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb73000ec80 tx=0x7fb7300091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.572+0000 7fb749f9d700 1 -- 172.21.15.154:0/557557816 shutdown_connections 2023-10-10T21:14:54.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.573+0000 7fb749f9d700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb74415d240 0x7fb744068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.573+0000 7fb749f9d700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:6832/85496,v1:172.21.15.154:6833/85496] conn(0x7fb7280670e0 0x7fb728069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.573+0000 7fb749f9d700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7440b16d0 0x7fb7440ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.573+0000 7fb749f9d700 1 --2- 172.21.15.154:0/557557816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7440b4e70 0x7fb74414b0c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.573+0000 7fb749f9d700 1 -- 172.21.15.154:0/557557816 >> 172.21.15.154:0/557557816 conn(0x7fb7440d10c0 msgr2=0x7fb7441590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:54.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.573+0000 7fb749f9d700 1 -- 172.21.15.154:0/557557816 shutdown_connections 2023-10-10T21:14:54.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.573+0000 7fb749f9d700 1 -- 172.21.15.154:0/557557816 wait complete. 2023-10-10T21:14:54.576 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.573+0000 7f4246cc2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.576 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.573+0000 7f4246cc2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.577 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.573+0000 7f4246cc2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.577 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.573+0000 7f4246cc2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.577 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.573+0000 7f4246cc2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.577 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.575+0000 7f424a4c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.578 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.575+0000 7f424a4c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.578 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.575+0000 7f424a4c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.578 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.575+0000 7f424a4c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.579 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.575+0000 7f424a4c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:14:54.579 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.576+0000 7f4246cc2700 -1 client.5473 mdsmap subscription failed: (2) No such file or directory 2023-10-10T21:14:54.579 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:14:54.578+0000 7f424a4c9700 -1 client.5476 mdsmap subscription failed: (2) No such file or directory 2023-10-10T21:14:54.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T21:14:54.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.823+0000 7efc7b7ff700 1 Processor -- start 2023-10-10T21:14:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.823+0000 7efc7b7ff700 1 -- start start 2023-10-10T21:14:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc7b7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc7415a440 0x7efc740acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc7b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc74068890 0x7efc740c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc7b7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7415a9b0 con 0x7efc741563b0 2023-10-10T21:14:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc7b7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7415ac90 con 0x7efc7415a440 2023-10-10T21:14:54.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc7b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7415af70 con 0x7efc74068890 2023-10-10T21:14:54.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc78d9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc7415a440 0x7efc740acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:54.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc78d9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc7415a440 0x7efc740acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54702/0 (socket says 172.21.15.154:54702) 2023-10-10T21:14:54.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc78d9a700 1 -- 172.21.15.154:0/2273809760 learned_addr learned my addr 172.21.15.154:0/2273809760 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:54.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc7959b700 1 --1- 172.21.15.154:0/2273809760 >> v1:172.21.15.154:6789/0 conn(0x7efc741563b0 0x7efc74156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36700/0 (socket says 172.21.15.154:36700) 2023-10-10T21:14:54.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc79d9c700 1 --2- 172.21.15.154:0/2273809760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc74068890 0x7efc740c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:54.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.825+0000 7efc6bfff700 1 -- 172.21.15.154:0/2273809760 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369560259 0 0) 0x7efc7415a9b0 con 0x7efc741563b0 2023-10-10T21:14:54.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.826+0000 7efc6bfff700 1 -- 172.21.15.154:0/2273809760 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc60003570 con 0x7efc741563b0 2023-10-10T21:14:54.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.826+0000 7efc78d9a700 1 -- 172.21.15.154:0/2273809760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc74068890 msgr2=0x7efc740c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:54.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.826+0000 7efc78d9a700 1 --2- 172.21.15.154:0/2273809760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc74068890 0x7efc740c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.826+0000 7efc78d9a700 1 -- 172.21.15.154:0/2273809760 >> v1:172.21.15.154:6789/0 conn(0x7efc741563b0 legacy=0x7efc74156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:54.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.826+0000 7efc78d9a700 1 -- 172.21.15.154:0/2273809760 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7415b250 con 0x7efc7415a440 2023-10-10T21:14:54.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.826+0000 7efc78d9a700 1 --2- 172.21.15.154:0/2273809760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7415a440 0x7efc740acf30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efc640099b0 tx=0x7efc64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c7ebec598b19f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:54.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.826+0000 7efc6bfff700 1 -- 172.21.15.154:0/2273809760 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400b680 con 0x7efc7415a440 2023-10-10T21:14:54.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.826+0000 7efc6bfff700 1 -- 172.21.15.154:0/2273809760 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400b7e0 con 0x7efc7415a440 2023-10-10T21:14:54.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.826+0000 7efc6bfff700 1 -- 172.21.15.154:0/2273809760 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400bb80 con 0x7efc7415a440 2023-10-10T21:14:54.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.827+0000 7efc7b7ff700 1 -- 172.21.15.154:0/2273809760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7415a440 msgr2=0x7efc740acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:54.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.827+0000 7efc7b7ff700 1 --2- 172.21.15.154:0/2273809760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7415a440 0x7efc740acf30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efc640099b0 tx=0x7efc64009250 comp rx=0 tx=0).stop 2023-10-10T21:14:54.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.827+0000 7efc7b7ff700 1 -- 172.21.15.154:0/2273809760 shutdown_connections 2023-10-10T21:14:54.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.827+0000 7efc7b7ff700 1 --2- 172.21.15.154:0/2273809760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc74068890 0x7efc740c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.827+0000 7efc7b7ff700 1 --2- 172.21.15.154:0/2273809760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7415a440 0x7efc740acf30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.827+0000 7efc7b7ff700 1 -- 172.21.15.154:0/2273809760 >> 172.21.15.154:0/2273809760 conn(0x7efc740c8f90 msgr2=0x7efc740c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.827+0000 7efc7b7ff700 1 -- 172.21.15.154:0/2273809760 shutdown_connections 2023-10-10T21:14:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.827+0000 7efc7b7ff700 1 -- 172.21.15.154:0/2273809760 wait complete. 2023-10-10T21:14:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.828+0000 7efc7b7ff700 1 Processor -- start 2023-10-10T21:14:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.828+0000 7efc7b7ff700 1 -- start start 2023-10-10T21:14:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.829+0000 7efc7b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc74068890 0x7efc740b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.829+0000 7efc7b7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc741563b0 0x7efc74150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.829+0000 7efc7b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc7415a440 0x7efc74158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.829+0000 7efc7b7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc74165bd0 con 0x7efc741563b0 2023-10-10T21:14:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.829+0000 7efc7b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc74165d30 con 0x7efc74068890 2023-10-10T21:14:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.829+0000 7efc7b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc74159390 con 0x7efc7415a440 2023-10-10T21:14:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.829+0000 7efc78d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc741563b0 0x7efc74150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc78d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc741563b0 0x7efc74150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54710/0 (socket says 172.21.15.154:54710) 2023-10-10T21:14:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc78d9a700 1 -- 172.21.15.154:0/55349074 learned_addr learned my addr 172.21.15.154:0/55349074 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc7959b700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc74068890 0x7efc740b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc79d9c700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc7415a440 0x7efc74158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc78d9a700 1 -- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc7415a440 msgr2=0x7efc74158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc78d9a700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc7415a440 0x7efc74158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc78d9a700 1 -- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc74068890 msgr2=0x7efc740b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:54.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc78d9a700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc74068890 0x7efc740b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:54.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc78d9a700 1 -- 172.21.15.154:0/55349074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc640094f0 con 0x7efc741563b0 2023-10-10T21:14:54.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc7959b700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc74068890 0x7efc740b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:54.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc79d9c700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc7415a440 0x7efc74158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:54.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc78d9a700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc741563b0 0x7efc74150510 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7efc64009290 tx=0x7efc64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:54.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc697fa700 1 -- 172.21.15.154:0/55349074 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400b950 con 0x7efc741563b0 2023-10-10T21:14:54.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc697fa700 1 -- 172.21.15.154:0/55349074 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400bad0 con 0x7efc741563b0 2023-10-10T21:14:54.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc697fa700 1 -- 172.21.15.154:0/55349074 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6401a680 con 0x7efc741563b0 2023-10-10T21:14:54.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.830+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc74159670 con 0x7efc741563b0 2023-10-10T21:14:54.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.831+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc74159c30 con 0x7efc741563b0 2023-10-10T21:14:54.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.831+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc74165ec0 con 0x7efc741563b0 2023-10-10T21:14:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.832+0000 7efc697fa700 1 -- 172.21.15.154:0/55349074 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) v1 ==== 84451+0+0 (secure 0 0 0) 0x7efc6401aa30 con 0x7efc741563b0 2023-10-10T21:14:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.833+0000 7efc697fa700 1 -- 172.21.15.154:0/55349074 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6714+0+0 (secure 0 0 0) 0x7efc64086180 con 0x7efc741563b0 2023-10-10T21:14:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:54.838+0000 7efc697fa700 1 -- 172.21.15.154:0/55349074 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc640532d0 con 0x7efc741563b0 2023-10-10T21:14:55.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:55.031+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc740718b0 con 0x7efc741563b0 2023-10-10T21:14:55.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:55.514+0000 7efc697fa700 1 -- 172.21.15.154:0/55349074 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 16) v1 ==== 84578+0+0 (secure 0 0 0) 0x7efc6401ace0 con 0x7efc741563b0 2023-10-10T21:14:55.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:55.515+0000 7efc697fa700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efc5806c980 0x7efc5806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:55.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:55.516+0000 7efc7959b700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efc5806c980 0x7efc5806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:55.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:55.520+0000 7efc7959b700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efc5806c980 0x7efc5806ed60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efc70001a10 tx=0x7efc7000b040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:56.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.036+0000 7efc697fa700 1 -- 172.21.15.154:0/55349074 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7efc64008b10 con 0x7efc741563b0 2023-10-10T21:14:56.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efc5806c980 msgr2=0x7efc5806ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:56.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efc5806c980 0x7efc5806ed60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efc70001a10 tx=0x7efc7000b040 comp rx=0 tx=0).stop 2023-10-10T21:14:56.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc741563b0 msgr2=0x7efc74150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:56.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc741563b0 0x7efc74150510 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7efc64009290 tx=0x7efc64017000 comp rx=0 tx=0).stop 2023-10-10T21:14:56.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 shutdown_connections 2023-10-10T21:14:56.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc7415a440 0x7efc74158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:56.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efc5806c980 0x7efc5806ed60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:56.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc74068890 0x7efc740b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:56.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 --2- 172.21.15.154:0/55349074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc741563b0 0x7efc74150510 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:56.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.040+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 >> 172.21.15.154:0/55349074 conn(0x7efc740c8f90 msgr2=0x7efc741523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:56.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.041+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 shutdown_connections 2023-10-10T21:14:56.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.041+0000 7efc7b7ff700 1 -- 172.21.15.154:0/55349074 wait complete. 2023-10-10T21:14:56.044 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T21:14:56.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T21:14:56.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.262+0000 7f40b93ff700 1 Processor -- start 2023-10-10T21:14:56.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.263+0000 7f40b93ff700 1 -- start start 2023-10-10T21:14:56.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.264+0000 7f40b93ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40b4068890 0x7f40b40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:56.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.264+0000 7f40b93ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b415a9b0 con 0x7f40b41563b0 2023-10-10T21:14:56.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.264+0000 7f40b93ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b415ac90 con 0x7f40b415a440 2023-10-10T21:14:56.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.264+0000 7f40b93ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b415af70 con 0x7f40b4068890 2023-10-10T21:14:56.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.264+0000 7f40b2ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f40b41563b0 0x7f40b4156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53622/0 (socket says 172.21.15.154:53622) 2023-10-10T21:14:56.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.264+0000 7f40b2ffd700 1 -- 172.21.15.154:0/3836428965 learned_addr learned my addr 172.21.15.154:0/3836428965 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:56.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.264+0000 7f40b37fe700 1 --2- 172.21.15.154:0/3836428965 >> v2:172.21.15.154:3300/0 conn(0x7f40b4068890 0x7f40b40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:56.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.265+0000 7f40b1ffb700 1 -- 172.21.15.154:0/3836428965 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286301888 0 0) 0x7f40b415a9b0 con 0x7f40b41563b0 2023-10-10T21:14:56.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.265+0000 7f40b1ffb700 1 -- 172.21.15.154:0/3836428965 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f409c003570 con 0x7f40b41563b0 2023-10-10T21:14:56.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.265+0000 7f40b37fe700 1 -- 172.21.15.154:0/3836428965 >> v1:172.21.15.179:6789/0 conn(0x7f40b415a440 legacy=0x7f40b40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:56.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.265+0000 7f40b37fe700 1 -- 172.21.15.154:0/3836428965 >> v1:172.21.15.154:6789/0 conn(0x7f40b41563b0 legacy=0x7f40b4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:56.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.265+0000 7f40b37fe700 1 -- 172.21.15.154:0/3836428965 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b415b250 con 0x7f40b4068890 2023-10-10T21:14:56.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.265+0000 7f40b37fe700 1 --2- 172.21.15.154:0/3836428965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b4068890 0x7f40b40c8230 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0098e0 tx=0x7f40ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12100d7f6fb3742 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:56.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.265+0000 7f40b1ffb700 1 -- 172.21.15.154:0/3836428965 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00b640 con 0x7f40b4068890 2023-10-10T21:14:56.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.265+0000 7f40b1ffb700 1 -- 172.21.15.154:0/3836428965 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac00b7a0 con 0x7f40b4068890 2023-10-10T21:14:56.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.265+0000 7f40b1ffb700 1 -- 172.21.15.154:0/3836428965 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00bb40 con 0x7f40b4068890 2023-10-10T21:14:56.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.266+0000 7f40b93ff700 1 -- 172.21.15.154:0/3836428965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b4068890 msgr2=0x7f40b40c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:56.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.266+0000 7f40b93ff700 1 --2- 172.21.15.154:0/3836428965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b4068890 0x7f40b40c8230 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0098e0 tx=0x7f40ac0091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.266+0000 7f40b93ff700 1 -- 172.21.15.154:0/3836428965 shutdown_connections 2023-10-10T21:14:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.266+0000 7f40b93ff700 1 --2- 172.21.15.154:0/3836428965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b4068890 0x7f40b40c8230 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.266+0000 7f40b93ff700 1 -- 172.21.15.154:0/3836428965 >> 172.21.15.154:0/3836428965 conn(0x7f40b40c8f90 msgr2=0x7f40b40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.266+0000 7f40b93ff700 1 -- 172.21.15.154:0/3836428965 shutdown_connections 2023-10-10T21:14:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.266+0000 7f40b93ff700 1 -- 172.21.15.154:0/3836428965 wait complete. 2023-10-10T21:14:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.267+0000 7f40b93ff700 1 Processor -- start 2023-10-10T21:14:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.267+0000 7f40b93ff700 1 -- start start 2023-10-10T21:14:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.268+0000 7f40b93ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b4068890 0x7f40b414d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.268+0000 7f40b93ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b41563b0 0x7f40b40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.268+0000 7f40b93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40b415a440 0x7f40b40c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.268+0000 7f40b93ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b414de10 con 0x7f40b41563b0 2023-10-10T21:14:56.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.268+0000 7f40b93ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b414e360 con 0x7f40b4068890 2023-10-10T21:14:56.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.268+0000 7f40b93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b416a670 con 0x7f40b415a440 2023-10-10T21:14:56.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.268+0000 7f40b27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b41563b0 0x7f40b40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:56.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b41563b0 0x7f40b40c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57928/0 (socket says 172.21.15.154:57928) 2023-10-10T21:14:56.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b27fc700 1 -- 172.21.15.154:0/236049230 learned_addr learned my addr 172.21.15.154:0/236049230 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:56.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b2ffd700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b4068890 0x7f40b414d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:56.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b27fc700 1 -- 172.21.15.154:0/236049230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40b415a440 msgr2=0x7f40b40c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b27fc700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40b415a440 0x7f40b40c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b27fc700 1 -- 172.21.15.154:0/236049230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b4068890 msgr2=0x7f40b414d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b27fc700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b4068890 0x7f40b414d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b27fc700 1 -- 172.21.15.154:0/236049230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009420 con 0x7f40b41563b0 2023-10-10T21:14:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b27fc700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b41563b0 0x7f40b40c8230 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c4e0 tx=0x7f40a800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f409affd700 1 -- 172.21.15.154:0/236049230 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8011590 con 0x7f40b41563b0 2023-10-10T21:14:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f409affd700 1 -- 172.21.15.154:0/236049230 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8011710 con 0x7f40b41563b0 2023-10-10T21:14:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f409affd700 1 -- 172.21.15.154:0/236049230 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8011ad0 con 0x7f40b41563b0 2023-10-10T21:14:56.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.269+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b4169db0 con 0x7f40b41563b0 2023-10-10T21:14:56.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.270+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b416a020 con 0x7f40b41563b0 2023-10-10T21:14:56.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.271+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b416a7e0 con 0x7f40b41563b0 2023-10-10T21:14:56.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.271+0000 7f409affd700 1 -- 172.21.15.154:0/236049230 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f40a801b3b0 con 0x7f40b41563b0 2023-10-10T21:14:56.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.273+0000 7f409affd700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40a0066d80 0x7f40a0069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:56.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.273+0000 7f409affd700 1 -- 172.21.15.154:0/236049230 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6276+0+0 (secure 0 0 0) 0x7f40a80838f0 con 0x7f40b41563b0 2023-10-10T21:14:56.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.273+0000 7f40b2ffd700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40a0066d80 0x7f40a0069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:56.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.273+0000 7f40b2ffd700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40a0066d80 0x7f40a0069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005c50 tx=0x7f40a4009040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:56.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.277+0000 7f409affd700 1 -- 172.21.15.154:0/236049230 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40a8050bd0 con 0x7f40b41563b0 2023-10-10T21:14:56.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:56.470+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40b40718b0 con 0x7f40b41563b0 2023-10-10T21:14:57.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.041+0000 7f409affd700 1 -- 172.21.15.154:0/236049230 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40a8050fa0 con 0x7f40b41563b0 2023-10-10T21:14:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.045+0000 7f409affd700 1 -- 172.21.15.154:0/236049230 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7f40a806f4a0 con 0x7f40b41563b0 2023-10-10T21:14:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40a0066d80 msgr2=0x7f40a0069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40a0066d80 0x7f40a0069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005c50 tx=0x7f40a4009040 comp rx=0 tx=0).stop 2023-10-10T21:14:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b41563b0 msgr2=0x7f40b40c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b41563b0 0x7f40b40c8230 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c4e0 tx=0x7f40a800c8a0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 shutdown_connections 2023-10-10T21:14:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40b415a440 0x7f40b40c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40a0066d80 0x7f40a0069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40b4068890 0x7f40b414d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 --2- 172.21.15.154:0/236049230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b41563b0 0x7f40b40c8230 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 >> 172.21.15.154:0/236049230 conn(0x7f40b40c8f90 msgr2=0x7f40b40ade90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:57.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 shutdown_connections 2023-10-10T21:14:57.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.050+0000 7f40b93ff700 1 -- 172.21.15.154:0/236049230 wait complete. 2023-10-10T21:14:57.053 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T21:14:57.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T21:14:57.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.253+0000 7f69e75ff700 1 Processor -- start 2023-10-10T21:14:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.254+0000 7f69e75ff700 1 -- start start 2023-10-10T21:14:57.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.255+0000 7f69e75ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e01568e0 0x7f69e01616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.255+0000 7f69e75ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e015b0d0 con 0x7f69e00ccee0 2023-10-10T21:14:57.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.255+0000 7f69e75ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e015a4c0 con 0x7f69e00c83f0 2023-10-10T21:14:57.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.255+0000 7f69e75ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e015a7a0 con 0x7f69e01568e0 2023-10-10T21:14:57.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.255+0000 7f69e4b9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f69e00ccee0 0x7f69e01561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53628/0 (socket says 172.21.15.154:53628) 2023-10-10T21:14:57.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.255+0000 7f69e4b9a700 1 -- 172.21.15.154:0/2132787979 learned_addr learned my addr 172.21.15.154:0/2132787979 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:57.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69e5b9c700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e01568e0 0x7f69e01616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918479996 0 0) 0x7f69e015b0d0 con 0x7f69e00ccee0 2023-10-10T21:14:57.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69cc003570 con 0x7f69e00ccee0 2023-10-10T21:14:57.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3404971076 0 0) 0x7f69cc003570 con 0x7f69e00ccee0 2023-10-10T21:14:57.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e01568e0 msgr2=0x7f69e01616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:57.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e01568e0 0x7f69e01616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 >> v1:172.21.15.179:6789/0 conn(0x7f69e00c83f0 legacy=0x7f69e00c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e015aa80 con 0x7f69e00ccee0 2023-10-10T21:14:57.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f69d0001470 con 0x7f69e00ccee0 2023-10-10T21:14:57.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 >> v1:172.21.15.154:6789/0 conn(0x7f69e00ccee0 legacy=0x7f69e01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69cc004810 0x7f69cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e01568e0 0x7f69cc005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e015a7a0 con 0x7f69cc003a90 2023-10-10T21:14:57.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc00bbf0 con 0x7f69cc004810 2023-10-10T21:14:57.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc00bd80 con 0x7f69e01568e0 2023-10-10T21:14:57.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69e539b700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.256+0000 7f69e5b9c700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e01568e0 0x7f69cc005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69e4b9a700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69cc004810 0x7f69cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69e539b700 1 -- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e01568e0 msgr2=0x7f69cc005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:57.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69e539b700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e01568e0 0x7f69cc005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69e539b700 1 -- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69cc004810 msgr2=0x7f69cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:57.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69e539b700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69cc004810 0x7f69cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69e539b700 1 -- 172.21.15.154:0/2132787979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc003570 con 0x7f69cc003a90 2023-10-10T21:14:57.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69e539b700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69cc003ea0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0018e0 tx=0x7f69dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594cbd769523c9f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:57.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc012420 con 0x7f69cc003a90 2023-10-10T21:14:57.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc012580 con 0x7f69cc003a90 2023-10-10T21:14:57.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.257+0000 7f69d7fff700 1 -- 172.21.15.154:0/2132787979 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc012920 con 0x7f69cc003a90 2023-10-10T21:14:57.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.258+0000 7f69e75ff700 1 -- 172.21.15.154:0/2132787979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 msgr2=0x7f69cc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.258+0000 7f69e75ff700 1 --2- 172.21.15.154:0/2132787979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69cc003ea0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0018e0 tx=0x7f69dc007d30 comp rx=0 tx=0).stop 2023-10-10T21:14:57.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.258+0000 7f69e5b9c700 1 -- 172.21.15.154:0/2132787979 reap_dead start 2023-10-10T21:14:57.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.258+0000 7f69e75ff700 1 -- 172.21.15.154:0/2132787979 shutdown_connections 2023-10-10T21:14:57.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.258+0000 7f69e75ff700 1 -- 172.21.15.154:0/2132787979 >> 172.21.15.154:0/2132787979 conn(0x7f69e0068e10 msgr2=0x7f69e00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:57.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.258+0000 7f69e75ff700 1 -- 172.21.15.154:0/2132787979 shutdown_connections 2023-10-10T21:14:57.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.258+0000 7f69e75ff700 1 -- 172.21.15.154:0/2132787979 wait complete. 2023-10-10T21:14:57.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.259+0000 7f69e75ff700 1 Processor -- start 2023-10-10T21:14:57.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.260+0000 7f69e75ff700 1 -- start start 2023-10-10T21:14:57.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.260+0000 7f69e75ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69e00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.260+0000 7f69e75ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e0147210 0x7f69e00c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.260+0000 7f69e75ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e00c2400 0x7f69e0158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.260+0000 7f69e75ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00c4fd0 con 0x7f69cc003a90 2023-10-10T21:14:57.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.260+0000 7f69e75ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00c2870 con 0x7f69e0147210 2023-10-10T21:14:57.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.260+0000 7f69e75ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e01570f0 con 0x7f69e00c2400 2023-10-10T21:14:57.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e539b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69e00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e539b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69e00c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57932/0 (socket says 172.21.15.154:57932) 2023-10-10T21:14:57.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e539b700 1 -- 172.21.15.154:0/1673260844 learned_addr learned my addr 172.21.15.154:0/1673260844 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:57.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e5b9c700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e00c2400 0x7f69e0158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e4b9a700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e0147210 0x7f69e00c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e539b700 1 -- 172.21.15.154:0/1673260844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e00c2400 msgr2=0x7f69e0158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e539b700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e00c2400 0x7f69e0158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e539b700 1 -- 172.21.15.154:0/1673260844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e0147210 msgr2=0x7f69e00c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e539b700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e0147210 0x7f69e00c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e539b700 1 -- 172.21.15.154:0/1673260844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e0159840 con 0x7f69cc003a90 2023-10-10T21:14:57.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.261+0000 7f69e539b700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69e00c4a90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00c0e0 tx=0x7f69dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:57.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.262+0000 7f69d57fa700 1 -- 172.21.15.154:0/1673260844 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc012420 con 0x7f69cc003a90 2023-10-10T21:14:57.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.262+0000 7f69d57fa700 1 -- 172.21.15.154:0/1673260844 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc001200 con 0x7f69cc003a90 2023-10-10T21:14:57.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.262+0000 7f69d57fa700 1 -- 172.21.15.154:0/1673260844 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00cee0 con 0x7f69cc003a90 2023-10-10T21:14:57.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.262+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e0159b20 con 0x7f69cc003a90 2023-10-10T21:14:57.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.262+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e0156d80 con 0x7f69cc003a90 2023-10-10T21:14:57.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.263+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e004c3c0 con 0x7f69cc003a90 2023-10-10T21:14:57.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.264+0000 7f69d57fa700 1 -- 172.21.15.154:0/1673260844 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69dc019070 con 0x7f69cc003a90 2023-10-10T21:14:57.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.265+0000 7f69d57fa700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f69c4066f30 0x7f69c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.265+0000 7f69d57fa700 1 -- 172.21.15.154:0/1673260844 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f69dc085ce0 con 0x7f69cc003a90 2023-10-10T21:14:57.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.265+0000 7f69e4b9a700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f69c4066f30 0x7f69c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.265+0000 7f69e4b9a700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f69c4066f30 0x7f69c40693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f69e00c2dd0 tx=0x7f69e006e870 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:57.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.269+0000 7f69d57fa700 1 -- 172.21.15.154:0/1673260844 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69dc052e10 con 0x7f69cc003a90 2023-10-10T21:14:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.459+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f69e015ad60 con 0x7f69cc003a90 2023-10-10T21:14:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.463+0000 7f69d57fa700 1 -- 172.21.15.154:0/1673260844 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f69dc0170a0 con 0x7f69cc003a90 2023-10-10T21:14:57.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f69c4066f30 msgr2=0x7f69c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f69c4066f30 0x7f69c40693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f69e00c2dd0 tx=0x7f69e006e870 comp rx=0 tx=0).stop 2023-10-10T21:14:57.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 msgr2=0x7f69e00c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69e00c4a90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00c0e0 tx=0x7f69dc015000 comp rx=0 tx=0).stop 2023-10-10T21:14:57.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 shutdown_connections 2023-10-10T21:14:57.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e00c2400 0x7f69e0158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69cc003a90 0x7f69e00c4a90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f69c4066f30 0x7f69c40693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 --2- 172.21.15.154:0/1673260844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e0147210 0x7f69e00c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 >> 172.21.15.154:0/1673260844 conn(0x7f69e0068e10 msgr2=0x7f69e00ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 shutdown_connections 2023-10-10T21:14:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.466+0000 7f69e75ff700 1 -- 172.21.15.154:0/1673260844 wait complete. 2023-10-10T21:14:57.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T21:14:57.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.673+0000 7fd76ffff700 1 Processor -- start 2023-10-10T21:14:57.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.673+0000 7fd76ffff700 1 -- start start 2023-10-10T21:14:57.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.674+0000 7fd76ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7700cb230 0x7fd7700cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.674+0000 7fd76ffff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7700c9f30 con 0x7fd7700ccc00 2023-10-10T21:14:57.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.674+0000 7fd76ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7700ca470 con 0x7fd770159a60 2023-10-10T21:14:57.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.674+0000 7fd76ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700cbbd0 con 0x7fd7700cb230 2023-10-10T21:14:57.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.674+0000 7fd76e7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd7700ccc00 0x7fd770069ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53638/0 (socket says 172.21.15.154:53638) 2023-10-10T21:14:57.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.674+0000 7fd76e7fc700 1 -- 172.21.15.154:0/496920827 learned_addr learned my addr 172.21.15.154:0/496920827 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:57.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76f7fe700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7700cb230 0x7fd7700cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926064932 0 0) 0x7fd7700c9f30 con 0x7fd7700ccc00 2023-10-10T21:14:57.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd758003570 con 0x7fd7700ccc00 2023-10-10T21:14:57.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785372840 0 0) 0x7fd7700ca470 con 0x7fd770159a60 2023-10-10T21:14:57.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7700c9f30 con 0x7fd770159a60 2023-10-10T21:14:57.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3370670364 0 0) 0x7fd758003570 con 0x7fd7700ccc00 2023-10-10T21:14:57.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7700cb230 msgr2=0x7fd7700cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:57.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7700cb230 0x7fd7700cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 >> v1:172.21.15.179:6789/0 conn(0x7fd770159a60 legacy=0x7fd7700c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7700ca750 con 0x7fd7700ccc00 2023-10-10T21:14:57.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fd764001470 con 0x7fd7700ccc00 2023-10-10T21:14:57.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 >> v1:172.21.15.154:6789/0 conn(0x7fd7700ccc00 legacy=0x7fd770069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd758003c20 0x7fd758004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7700cb230 0x7fd758004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd758004d50 0x7fd7580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75800bb40 con 0x7fd758003c20 2023-10-10T21:14:57.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75800bc80 con 0x7fd758004d50 2023-10-10T21:14:57.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75800be40 con 0x7fd7700cb230 2023-10-10T21:14:57.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.675+0000 7fd76effd700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd758003c20 0x7fd758004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76f7fe700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd758004d50 0x7fd7580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76e7fc700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7700cb230 0x7fd758004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76effd700 1 -- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7700cb230 msgr2=0x7fd758004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:57.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76effd700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7700cb230 0x7fd758004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76effd700 1 -- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd758004d50 msgr2=0x7fd7580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:57.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76effd700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd758004d50 0x7fd7580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76effd700 1 -- 172.21.15.154:0/496920827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758003570 con 0x7fd758003c20 2023-10-10T21:14:57.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76effd700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd758003c20 0x7fd758004010 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd760001a10 tx=0x7fd760007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bd6640a012e60b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:57.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76000c5d0 con 0x7fd758003c20 2023-10-10T21:14:57.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76000c730 con 0x7fd758003c20 2023-10-10T21:14:57.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.676+0000 7fd76dffb700 1 -- 172.21.15.154:0/496920827 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76000cad0 con 0x7fd758003c20 2023-10-10T21:14:57.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.677+0000 7fd76ffff700 1 -- 172.21.15.154:0/496920827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd758003c20 msgr2=0x7fd758004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.677+0000 7fd76ffff700 1 --2- 172.21.15.154:0/496920827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd758003c20 0x7fd758004010 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd760001a10 tx=0x7fd760007d30 comp rx=0 tx=0).stop 2023-10-10T21:14:57.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.677+0000 7fd76f7fe700 1 -- 172.21.15.154:0/496920827 reap_dead start 2023-10-10T21:14:57.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.677+0000 7fd76ffff700 1 -- 172.21.15.154:0/496920827 shutdown_connections 2023-10-10T21:14:57.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.677+0000 7fd76ffff700 1 -- 172.21.15.154:0/496920827 >> 172.21.15.154:0/496920827 conn(0x7fd77006baa0 msgr2=0x7fd77006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:57.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.677+0000 7fd76ffff700 1 -- 172.21.15.154:0/496920827 shutdown_connections 2023-10-10T21:14:57.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.677+0000 7fd76ffff700 1 -- 172.21.15.154:0/496920827 wait complete. 2023-10-10T21:14:57.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.678+0000 7fd76ffff700 1 Processor -- start 2023-10-10T21:14:57.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.679+0000 7fd76ffff700 1 -- start start 2023-10-10T21:14:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd758003c20 0x7fd7700c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd77016a540 0x7fd770140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7700c5740 0x7fd7700c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700c89d0 con 0x7fd7700c5740 2023-10-10T21:14:57.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700c60e0 con 0x7fd77016a540 2023-10-10T21:14:57.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700c7e50 con 0x7fd758003c20 2023-10-10T21:14:57.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7700c5740 0x7fd7700c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7700c5740 0x7fd7700c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57952/0 (socket says 172.21.15.154:57952) 2023-10-10T21:14:57.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76f7fe700 1 -- 172.21.15.154:0/2183469128 learned_addr learned my addr 172.21.15.154:0/2183469128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:57.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76effd700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd758003c20 0x7fd7700c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76e7fc700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd77016a540 0x7fd770140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76f7fe700 1 -- 172.21.15.154:0/2183469128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd758003c20 msgr2=0x7fd7700c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76f7fe700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd758003c20 0x7fd7700c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76f7fe700 1 -- 172.21.15.154:0/2183469128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd77016a540 msgr2=0x7fd770140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76f7fe700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd77016a540 0x7fd770140a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.680+0000 7fd76f7fe700 1 -- 172.21.15.154:0/2183469128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7700c8130 con 0x7fd7700c5740 2023-10-10T21:14:57.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.681+0000 7fd76f7fe700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7700c5740 0x7fd7700c5ba0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd7680094d0 tx=0x7fd76800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:57.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.681+0000 7fd756ffd700 1 -- 172.21.15.154:0/2183469128 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800e040 con 0x7fd7700c5740 2023-10-10T21:14:57.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.681+0000 7fd756ffd700 1 -- 172.21.15.154:0/2183469128 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76800f040 con 0x7fd7700c5740 2023-10-10T21:14:57.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.681+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7700c8410 con 0x7fd7700c5740 2023-10-10T21:14:57.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.681+0000 7fd756ffd700 1 -- 172.21.15.154:0/2183469128 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800fd60 con 0x7fd7700c5740 2023-10-10T21:14:57.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.681+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77016a990 con 0x7fd7700c5740 2023-10-10T21:14:57.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.682+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd770155070 con 0x7fd7700c5740 2023-10-10T21:14:57.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.683+0000 7fd756ffd700 1 -- 172.21.15.154:0/2183469128 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd768015640 con 0x7fd7700c5740 2023-10-10T21:14:57.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.684+0000 7fd756ffd700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd75c066f30 0x7fd75c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:57.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.684+0000 7fd756ffd700 1 -- 172.21.15.154:0/2183469128 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5862+0+0 (secure 0 0 0) 0x7fd768084eb0 con 0x7fd7700c5740 2023-10-10T21:14:57.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.684+0000 7fd76effd700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd75c066f30 0x7fd75c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:57.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.685+0000 7fd76effd700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd75c066f30 0x7fd75c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd760008fd0 tx=0x7fd760015000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:57.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.688+0000 7fd756ffd700 1 -- 172.21.15.154:0/2183469128 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd770155070 con 0x7fd7700c5740 2023-10-10T21:14:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.884+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fd770155070 con 0x7fd7700c5740 2023-10-10T21:14:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.888+0000 7fd756ffd700 1 -- 172.21.15.154:0/2183469128 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v14) v1 ==== 115+0+0 (secure 0 0 0) 0x7fd770155070 con 0x7fd7700c5740 2023-10-10T21:14:57.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd75c066f30 msgr2=0x7fd75c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd75c066f30 0x7fd75c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd760008fd0 tx=0x7fd760015000 comp rx=0 tx=0).stop 2023-10-10T21:14:57.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7700c5740 msgr2=0x7fd7700c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:57.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7700c5740 0x7fd7700c5ba0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd7680094d0 tx=0x7fd76800b040 comp rx=0 tx=0).stop 2023-10-10T21:14:57.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 shutdown_connections 2023-10-10T21:14:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7700c5740 0x7fd7700c5ba0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd758003c20 0x7fd7700c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd75c066f30 0x7fd75c0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 --2- 172.21.15.154:0/2183469128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd77016a540 0x7fd770140a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.891+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 >> 172.21.15.154:0/2183469128 conn(0x7fd77006baa0 msgr2=0x7fd7700c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.892+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 shutdown_connections 2023-10-10T21:14:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:57.892+0000 7fd76ffff700 1 -- 172.21.15.154:0/2183469128 wait complete. 2023-10-10T21:14:57.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T21:14:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.096+0000 7f2a2539d700 1 Processor -- start 2023-10-10T21:14:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.097+0000 7f2a2539d700 1 -- start start 2023-10-10T21:14:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.099+0000 7f2a2539d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a200b4e70 0x7f2a200ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.099+0000 7f2a2539d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a200b16d0 0x7f2a200b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.099+0000 7f2a2539d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a200b2080 con 0x7f2a2015d240 2023-10-10T21:14:58.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.099+0000 7f2a2539d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a200cfb00 con 0x7f2a200b16d0 2023-10-10T21:14:58.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.099+0000 7f2a2539d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a200b5c40 con 0x7f2a200b4e70 2023-10-10T21:14:58.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.099+0000 7f2a1f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a200b16d0 0x7f2a200b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.099+0000 7f2a1f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a200b16d0 0x7f2a200b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57966/0 (socket says 172.21.15.154:57966) 2023-10-10T21:14:58.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.099+0000 7f2a1f7fe700 1 -- 172.21.15.154:0/740978000 learned_addr learned my addr 172.21.15.154:0/740978000 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:58.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.099+0000 7f2a1ffff700 1 --2- 172.21.15.154:0/740978000 >> v2:172.21.15.179:3300/0 conn(0x7f2a200b4e70 0x7f2a200ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.100+0000 7f2a1f7fe700 1 -- 172.21.15.154:0/740978000 >> v2:172.21.15.179:3300/0 conn(0x7f2a200b4e70 msgr2=0x7f2a200ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.100+0000 7f2a1f7fe700 1 --2- 172.21.15.154:0/740978000 >> v2:172.21.15.179:3300/0 conn(0x7f2a200b4e70 0x7f2a200ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.100+0000 7f2a1f7fe700 1 -- 172.21.15.154:0/740978000 >> v1:172.21.15.179:6789/0 conn(0x7f2a2015d240 legacy=0x7f2a2015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.100+0000 7f2a1f7fe700 1 -- 172.21.15.154:0/740978000 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200b5f20 con 0x7f2a200b16d0 2023-10-10T21:14:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.100+0000 7f2a1f7fe700 1 --2- 172.21.15.154:0/740978000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 0x7f2a200b1b40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2a20064910 tx=0x7f2a14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fea310250c73715 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.100+0000 7f2a1effd700 1 -- 172.21.15.154:0/740978000 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14009e70 con 0x7f2a200b16d0 2023-10-10T21:14:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.100+0000 7f2a1effd700 1 -- 172.21.15.154:0/740978000 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1400b860 con 0x7f2a200b16d0 2023-10-10T21:14:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.100+0000 7f2a1effd700 1 -- 172.21.15.154:0/740978000 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400bc00 con 0x7f2a200b16d0 2023-10-10T21:14:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.101+0000 7f2a2539d700 1 -- 172.21.15.154:0/740978000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 msgr2=0x7f2a200b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.101+0000 7f2a2539d700 1 --2- 172.21.15.154:0/740978000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 0x7f2a200b1b40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2a20064910 tx=0x7f2a14009250 comp rx=0 tx=0).stop 2023-10-10T21:14:58.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.101+0000 7f2a2539d700 1 -- 172.21.15.154:0/740978000 shutdown_connections 2023-10-10T21:14:58.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.101+0000 7f2a2539d700 1 --2- 172.21.15.154:0/740978000 >> v2:172.21.15.179:3300/0 conn(0x7f2a200b4e70 0x7f2a200ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.101+0000 7f2a2539d700 1 --2- 172.21.15.154:0/740978000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 0x7f2a200b1b40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.101+0000 7f2a2539d700 1 -- 172.21.15.154:0/740978000 >> 172.21.15.154:0/740978000 conn(0x7f2a200d10c0 msgr2=0x7f2a200affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:58.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.101+0000 7f2a2539d700 1 -- 172.21.15.154:0/740978000 shutdown_connections 2023-10-10T21:14:58.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.101+0000 7f2a2539d700 1 -- 172.21.15.154:0/740978000 wait complete. 2023-10-10T21:14:58.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.103+0000 7f2a2539d700 1 Processor -- start 2023-10-10T21:14:58.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.103+0000 7f2a2539d700 1 -- start start 2023-10-10T21:14:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a2539d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 0x7f2a200a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a2539d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a200b4e70 0x7f2a200cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a2539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a2015d240 0x7f2a2014afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a2539d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200ca070 con 0x7f2a200b16d0 2023-10-10T21:14:58.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a2539d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200cc240 con 0x7f2a200b4e70 2023-10-10T21:14:58.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a2539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200c9460 con 0x7f2a2015d240 2023-10-10T21:14:58.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 0x7f2a200a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 0x7f2a200a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57978/0 (socket says 172.21.15.154:57978) 2023-10-10T21:14:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a1ffff700 1 -- 172.21.15.154:0/301064498 learned_addr learned my addr 172.21.15.154:0/301064498 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a1f7fe700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a200b4e70 0x7f2a200cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a24b9c700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a2015d240 0x7f2a2014afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a1ffff700 1 -- 172.21.15.154:0/301064498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a2015d240 msgr2=0x7f2a2014afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a1ffff700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a2015d240 0x7f2a2014afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a1ffff700 1 -- 172.21.15.154:0/301064498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a200b4e70 msgr2=0x7f2a200cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a1ffff700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a200b4e70 0x7f2a200cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.104+0000 7f2a1ffff700 1 -- 172.21.15.154:0/301064498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140094f0 con 0x7f2a200b16d0 2023-10-10T21:14:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.105+0000 7f2a1ffff700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 0x7f2a200a6fb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000ec80 tx=0x7f2a100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.105+0000 7f2a07fff700 1 -- 172.21.15.154:0/301064498 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000c850 con 0x7f2a200b16d0 2023-10-10T21:14:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.105+0000 7f2a07fff700 1 -- 172.21.15.154:0/301064498 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1000c9d0 con 0x7f2a200b16d0 2023-10-10T21:14:58.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.105+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a200c9740 con 0x7f2a200b16d0 2023-10-10T21:14:58.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.105+0000 7f2a07fff700 1 -- 172.21.15.154:0/301064498 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000cd90 con 0x7f2a200b16d0 2023-10-10T21:14:58.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.105+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a200c9d00 con 0x7f2a200b16d0 2023-10-10T21:14:58.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.106+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a20088990 con 0x7f2a200b16d0 2023-10-10T21:14:58.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.107+0000 7f2a07fff700 1 -- 172.21.15.154:0/301064498 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a10013680 con 0x7f2a200b16d0 2023-10-10T21:14:58.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.108+0000 7f2a07fff700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2a0c066f30 0x7f2a0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.109+0000 7f2a07fff700 1 -- 172.21.15.154:0/301064498 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f2a100848d0 con 0x7f2a200b16d0 2023-10-10T21:14:58.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.109+0000 7f2a1f7fe700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2a0c066f30 0x7f2a0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.109+0000 7f2a1f7fe700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2a0c066f30 0x7f2a0c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a20064910 tx=0x7f2a14017000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:58.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.113+0000 7f2a07fff700 1 -- 172.21.15.154:0/301064498 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a10051aa0 con 0x7f2a200b16d0 2023-10-10T21:14:58.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.306+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f2a2004bb80 con 0x7f2a200b16d0 2023-10-10T21:14:58.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.310+0000 7f2a07fff700 1 -- 172.21.15.154:0/301064498 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v15) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2a100840b0 con 0x7f2a200b16d0 2023-10-10T21:14:58.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.312+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2a0c066f30 msgr2=0x7f2a0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.312+0000 7f2a2539d700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2a0c066f30 0x7f2a0c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a20064910 tx=0x7f2a14017000 comp rx=0 tx=0).stop 2023-10-10T21:14:58.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.312+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 msgr2=0x7f2a200a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.312+0000 7f2a2539d700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 0x7f2a200a6fb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000ec80 tx=0x7f2a100091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.312+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 shutdown_connections 2023-10-10T21:14:58.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.312+0000 7f2a2539d700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a2015d240 0x7f2a2014afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.312+0000 7f2a2539d700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a200b16d0 0x7f2a200a6fb0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.312+0000 7f2a2539d700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2a0c066f30 0x7f2a0c0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.312+0000 7f2a2539d700 1 --2- 172.21.15.154:0/301064498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a200b4e70 0x7f2a200cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.313+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 >> 172.21.15.154:0/301064498 conn(0x7f2a200d10c0 msgr2=0x7f2a200b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:58.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.313+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 shutdown_connections 2023-10-10T21:14:58.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.313+0000 7f2a2539d700 1 -- 172.21.15.154:0/301064498 wait complete. 2023-10-10T21:14:58.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-10T21:14:58.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.512+0000 7fefd8bff700 1 Processor -- start 2023-10-10T21:14:58.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.513+0000 7fefd8bff700 1 -- start start 2023-10-10T21:14:58.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.514+0000 7fefd8bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefd40cbf30 0x7fefd40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.514+0000 7fefd8bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd40cc300 con 0x7fefd40b1420 2023-10-10T21:14:58.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.514+0000 7fefd8bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd40ad370 con 0x7fefd40ccf90 2023-10-10T21:14:58.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.514+0000 7fefd8bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd4156bf0 con 0x7fefd40cbf30 2023-10-10T21:14:58.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.514+0000 7fefd259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefd40cbf30 0x7fefd40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.514+0000 7fefd2d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fefd40b1420 0x7fefd40c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53652/0 (socket says 172.21.15.154:53652) 2023-10-10T21:14:58.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.514+0000 7fefd2d9d700 1 -- 172.21.15.154:0/2201364510 learned_addr learned my addr 172.21.15.154:0/2201364510 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:14:58.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.515+0000 7fefd259c700 1 -- 172.21.15.154:0/2201364510 >> v1:172.21.15.179:6789/0 conn(0x7fefd40ccf90 legacy=0x7fefd40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.515+0000 7fefd259c700 1 -- 172.21.15.154:0/2201364510 >> v1:172.21.15.154:6789/0 conn(0x7fefd40b1420 legacy=0x7fefd40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.515+0000 7fefd259c700 1 -- 172.21.15.154:0/2201364510 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd40ad650 con 0x7fefd40cbf30 2023-10-10T21:14:58.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.515+0000 7fefd259c700 1 --2- 172.21.15.154:0/2201364510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40cbf30 0x7fefd40ae410 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fefc40098e0 tx=0x7fefc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82a81321c694c43 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:58.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.515+0000 7fefd159a700 1 -- 172.21.15.154:0/2201364510 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4009e80 con 0x7fefd40cbf30 2023-10-10T21:14:58.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.515+0000 7fefd159a700 1 -- 172.21.15.154:0/2201364510 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc400b860 con 0x7fefd40cbf30 2023-10-10T21:14:58.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.515+0000 7fefd159a700 1 -- 172.21.15.154:0/2201364510 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc400bbe0 con 0x7fefd40cbf30 2023-10-10T21:14:58.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.516+0000 7fefd8bff700 1 -- 172.21.15.154:0/2201364510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40cbf30 msgr2=0x7fefd40ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.516+0000 7fefd8bff700 1 --2- 172.21.15.154:0/2201364510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40cbf30 0x7fefd40ae410 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fefc40098e0 tx=0x7fefc40091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.516+0000 7fefd8bff700 1 -- 172.21.15.154:0/2201364510 shutdown_connections 2023-10-10T21:14:58.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.516+0000 7fefd8bff700 1 --2- 172.21.15.154:0/2201364510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40cbf30 0x7fefd40ae410 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.516+0000 7fefd8bff700 1 -- 172.21.15.154:0/2201364510 >> 172.21.15.154:0/2201364510 conn(0x7fefd406a320 msgr2=0x7fefd40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:58.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.516+0000 7fefd8bff700 1 -- 172.21.15.154:0/2201364510 shutdown_connections 2023-10-10T21:14:58.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.516+0000 7fefd8bff700 1 -- 172.21.15.154:0/2201364510 wait complete. 2023-10-10T21:14:58.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.517+0000 7fefd8bff700 1 Processor -- start 2023-10-10T21:14:58.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.518+0000 7fefd8bff700 1 -- start start 2023-10-10T21:14:58.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.518+0000 7fefd8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefd40b1420 0x7fefd4155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.518+0000 7fefd8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefd40cbf30 0x7fefd415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.518+0000 7fefd8bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40ccf90 0x7fefd415e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd8bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd415c570 con 0x7fefd40ccf90 2023-10-10T21:14:58.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd415c290 con 0x7fefd40cbf30 2023-10-10T21:14:58.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd415d3c0 con 0x7fefd40b1420 2023-10-10T21:14:58.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40ccf90 0x7fefd415e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40ccf90 0x7fefd415e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57998/0 (socket says 172.21.15.154:57998) 2023-10-10T21:14:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd2d9d700 1 -- 172.21.15.154:0/1102049129 learned_addr learned my addr 172.21.15.154:0/1102049129 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd2d9d700 1 -- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefd40b1420 msgr2=0x7fefd4155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd259c700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefd40b1420 0x7fefd4155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd2d9d700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefd40b1420 0x7fefd4155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd2d9d700 1 -- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefd40cbf30 msgr2=0x7fefd415e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:58.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd1d9b700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefd40cbf30 0x7fefd415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd2d9d700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefd40cbf30 0x7fefd415e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:58.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd2d9d700 1 -- 172.21.15.154:0/1102049129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc4009420 con 0x7fefd40ccf90 2023-10-10T21:14:58.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd259c700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefd40b1420 0x7fefd4155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:58.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.519+0000 7fefd1d9b700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefd40cbf30 0x7fefd415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:58.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.520+0000 7fefd2d9d700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40ccf90 0x7fefd415e8e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00cc40 tx=0x7fefcc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:58.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.520+0000 7fefc27fc700 1 -- 172.21.15.154:0/1102049129 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00a9c0 con 0x7fefd40ccf90 2023-10-10T21:14:58.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.520+0000 7fefc27fc700 1 -- 172.21.15.154:0/1102049129 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc00ab40 con 0x7fefd40ccf90 2023-10-10T21:14:58.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.520+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd415d6a0 con 0x7fefd40ccf90 2023-10-10T21:14:58.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.520+0000 7fefc27fc700 1 -- 172.21.15.154:0/1102049129 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0070f0 con 0x7fefd40ccf90 2023-10-10T21:14:58.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.520+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd415bef0 con 0x7fefd40ccf90 2023-10-10T21:14:58.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.521+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd40c6bf0 con 0x7fefd40ccf90 2023-10-10T21:14:58.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.522+0000 7fefc27fc700 1 -- 172.21.15.154:0/1102049129 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefcc0074e0 con 0x7fefd40ccf90 2023-10-10T21:14:58.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.523+0000 7fefc27fc700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fefb4066f30 0x7fefb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:58.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.523+0000 7fefc27fc700 1 -- 172.21.15.154:0/1102049129 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5862+0+0 (secure 0 0 0) 0x7fefcc0849f0 con 0x7fefd40ccf90 2023-10-10T21:14:58.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.523+0000 7fefd259c700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fefb4066f30 0x7fefb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:58.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.524+0000 7fefd259c700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fefb4066f30 0x7fefb40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fefc4003080 tx=0x7fefc4017000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:58.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.527+0000 7fefc27fc700 1 -- 172.21.15.154:0/1102049129 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefd40c6bf0 con 0x7fefd40ccf90 2023-10-10T21:14:58.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:58.794+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fefd40c6bf0 con 0x7fefd40ccf90 2023-10-10T21:14:59.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.041+0000 7fefc27fc700 1 -- 172.21.15.154:0/1102049129 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v455) v1 ==== 158+0+0 (secure 0 0 0) 0x7fefd40c6bf0 con 0x7fefd40ccf90 2023-10-10T21:14:59.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fefb4066f30 msgr2=0x7fefb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:59.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fefb4066f30 0x7fefb40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fefc4003080 tx=0x7fefc4017000 comp rx=0 tx=0).stop 2023-10-10T21:14:59.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40ccf90 msgr2=0x7fefd415e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:59.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40ccf90 0x7fefd415e8e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00cc40 tx=0x7fefcc001a50 comp rx=0 tx=0).stop 2023-10-10T21:14:59.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 shutdown_connections 2023-10-10T21:14:59.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd40ccf90 0x7fefd415e8e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefd40b1420 0x7fefd4155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fefb4066f30 0x7fefb40693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 --2- 172.21.15.154:0/1102049129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefd40cbf30 0x7fefd415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 >> 172.21.15.154:0/1102049129 conn(0x7fefd406a320 msgr2=0x7fefd4159670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:59.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 shutdown_connections 2023-10-10T21:14:59.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.044+0000 7fefd8bff700 1 -- 172.21.15.154:0/1102049129 wait complete. 2023-10-10T21:14:59.062 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-10-10T21:14:59.063 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-10-10T21:14:59.063 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T21:14:59.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-10T21:14:59.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.246+0000 7fd1d25ff700 1 Processor -- start 2023-10-10T21:14:59.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.246+0000 7fd1d25ff700 1 -- start start 2023-10-10T21:14:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.247+0000 7fd1d25ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cbf30 0x7fd1cc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.247+0000 7fd1d25ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1cc0ccf90 0x7fd1cc0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.247+0000 7fd1d25ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0cc300 con 0x7fd1cc15a270 2023-10-10T21:14:59.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.247+0000 7fd1d25ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc156bf0 con 0x7fd1cc0ccf90 2023-10-10T21:14:59.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.247+0000 7fd1d25ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0ae950 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.248+0000 7fd1cbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cbf30 0x7fd1cc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.248+0000 7fd1c3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1cc0ccf90 0x7fd1cc0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.248+0000 7fd1cbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cbf30 0x7fd1cc0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:54290/0 (socket says 172.21.15.154:54290) 2023-10-10T21:14:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.248+0000 7fd1cbfff700 1 -- 172.21.15.154:0/1299469802 learned_addr learned my addr 172.21.15.154:0/1299469802 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.248+0000 7fd1c3fff700 1 -- 172.21.15.154:0/1299469802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cbf30 msgr2=0x7fd1cc0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:14:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.248+0000 7fd1c3fff700 1 --2- 172.21.15.154:0/1299469802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cbf30 0x7fd1cc0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.248+0000 7fd1c3fff700 1 -- 172.21.15.154:0/1299469802 >> v1:172.21.15.179:6789/0 conn(0x7fd1cc15a270 legacy=0x7fd1cc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.248+0000 7fd1c3fff700 1 -- 172.21.15.154:0/1299469802 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0ad370 con 0x7fd1cc0ccf90 2023-10-10T21:14:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.248+0000 7fd1cbfff700 1 --2- 172.21.15.154:0/1299469802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cbf30 0x7fd1cc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:14:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.249+0000 7fd1c3fff700 1 --2- 172.21.15.154:0/1299469802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc0ccf90 0x7fd1cc0b0d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009910 tx=0x7fd1b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c8a918b68893639 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.249+0000 7fd1cb7fe700 1 -- 172.21.15.154:0/1299469802 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400b640 con 0x7fd1cc0ccf90 2023-10-10T21:14:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.249+0000 7fd1cb7fe700 1 -- 172.21.15.154:0/1299469802 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400b7a0 con 0x7fd1cc0ccf90 2023-10-10T21:14:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.249+0000 7fd1cb7fe700 1 -- 172.21.15.154:0/1299469802 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400bb60 con 0x7fd1cc0ccf90 2023-10-10T21:14:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.250+0000 7fd1d25ff700 1 -- 172.21.15.154:0/1299469802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc0ccf90 msgr2=0x7fd1cc0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.250+0000 7fd1d25ff700 1 --2- 172.21.15.154:0/1299469802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc0ccf90 0x7fd1cc0b0d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009910 tx=0x7fd1b40091a0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.250+0000 7fd1d25ff700 1 -- 172.21.15.154:0/1299469802 shutdown_connections 2023-10-10T21:14:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.250+0000 7fd1d25ff700 1 --2- 172.21.15.154:0/1299469802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cbf30 0x7fd1cc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.250+0000 7fd1d25ff700 1 --2- 172.21.15.154:0/1299469802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc0ccf90 0x7fd1cc0b0d10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.250+0000 7fd1d25ff700 1 -- 172.21.15.154:0/1299469802 >> 172.21.15.154:0/1299469802 conn(0x7fd1cc06a320 msgr2=0x7fd1cc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:14:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.250+0000 7fd1d25ff700 1 -- 172.21.15.154:0/1299469802 shutdown_connections 2023-10-10T21:14:59.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.250+0000 7fd1d25ff700 1 -- 172.21.15.154:0/1299469802 wait complete. 2023-10-10T21:14:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.251+0000 7fd1d25ff700 1 Processor -- start 2023-10-10T21:14:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.251+0000 7fd1d25ff700 1 -- start start 2023-10-10T21:14:59.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.252+0000 7fd1d25ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1cc0cbf30 0x7fd1cc144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:59.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.252+0000 7fd1d25ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0ccf90 0x7fd1cc0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:59.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.252+0000 7fd1d25ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15a270 0x7fd1cc0cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:59.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.252+0000 7fd1d25ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc16bb10 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.252+0000 7fd1d25ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc16b530 con 0x7fd1cc15a270 2023-10-10T21:14:59.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.252+0000 7fd1d25ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0abfa0 con 0x7fd1cc0ccf90 2023-10-10T21:14:59.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1cbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1cc0cbf30 0x7fd1cc144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:59.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1cbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1cc0cbf30 0x7fd1cc144270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58002/0 (socket says 172.21.15.154:58002) 2023-10-10T21:14:59.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1cbfff700 1 -- 172.21.15.154:0/3960929497 learned_addr learned my addr 172.21.15.154:0/3960929497 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:14:59.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1c3fff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0ccf90 0x7fd1cc0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:59.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1d0b9c700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15a270 0x7fd1cc0cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:59.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1cbfff700 1 -- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0ccf90 msgr2=0x7fd1cc0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:59.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1cbfff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0ccf90 0x7fd1cc0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1cbfff700 1 -- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15a270 msgr2=0x7fd1cc0cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:14:59.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1cbfff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15a270 0x7fd1cc0cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:14:59.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1cbfff700 1 -- 172.21.15.154:0/3960929497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0094f0 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1c3fff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0ccf90 0x7fd1cc0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1d0b9c700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15a270 0x7fd1cc0cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:14:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1cbfff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1cc0cbf30 0x7fd1cc144270 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00ec50 tx=0x7fd1bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.253+0000 7fd1c8ff9700 1 -- 172.21.15.154:0/3960929497 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00c9d0 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.254+0000 7fd1c8ff9700 1 -- 172.21.15.154:0/3960929497 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00cb30 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.254+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b4009420 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.254+0000 7fd1c8ff9700 1 -- 172.21.15.154:0/3960929497 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc013470 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.254+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc1447b0 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.255+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc0cd460 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.256+0000 7fd1c8ff9700 1 -- 172.21.15.154:0/3960929497 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1bc013860 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.256+0000 7fd1c8ff9700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd1ac066f30 0x7fd1ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:14:59.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.257+0000 7fd1c8ff9700 1 -- 172.21.15.154:0/3960929497 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5862+0+0 (secure 0 0 0) 0x7fd1bc084d60 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.257+0000 7fd1c3fff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd1ac066f30 0x7fd1ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:14:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.257+0000 7fd1c3fff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd1ac066f30 0x7fd1ac0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009860 tx=0x7fd1b4017000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:14:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.261+0000 7fd1c8ff9700 1 -- 172.21.15.154:0/3960929497 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1bc051f30 con 0x7fd1cc0cbf30 2023-10-10T21:14:59.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:14:59.528+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7fd1cc04c3c0 con 0x7fd1cc0cbf30 2023-10-10T21:15:00.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.043+0000 7fd1c8ff9700 1 -- 172.21.15.154:0/3960929497 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v456) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd1bc055550 con 0x7fd1cc0cbf30 2023-10-10T21:15:00.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.045+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd1ac066f30 msgr2=0x7fd1ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.045+0000 7fd1d25ff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd1ac066f30 0x7fd1ac0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009860 tx=0x7fd1b4017000 comp rx=0 tx=0).stop 2023-10-10T21:15:00.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1cc0cbf30 msgr2=0x7fd1cc144270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1cc0cbf30 0x7fd1cc144270 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00ec50 tx=0x7fd1bc009250 comp rx=0 tx=0).stop 2023-10-10T21:15:00.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 shutdown_connections 2023-10-10T21:15:00.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd1ac066f30 0x7fd1ac0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15a270 0x7fd1cc0cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1cc0cbf30 0x7fd1cc144270 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 --2- 172.21.15.154:0/3960929497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0ccf90 0x7fd1cc0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 >> 172.21.15.154:0/3960929497 conn(0x7fd1cc06a320 msgr2=0x7fd1cc1540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:00.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 shutdown_connections 2023-10-10T21:15:00.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.046+0000 7fd1d25ff700 1 -- 172.21.15.154:0/3960929497 wait complete. 2023-10-10T21:15:00.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T21:15:00.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.250+0000 7fb0335ff700 1 Processor -- start 2023-10-10T21:15:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.251+0000 7fb0335ff700 1 -- start start 2023-10-10T21:15:00.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.252+0000 7fb0335ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c0699c0 0x7fb02c06f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.252+0000 7fb0335ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb02c06f750 0x7fb02c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.252+0000 7fb0335ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c06de10 con 0x7fb02c069d90 2023-10-10T21:15:00.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.252+0000 7fb0335ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c06e0f0 con 0x7fb02c06f750 2023-10-10T21:15:00.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.252+0000 7fb0335ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c06e3d0 con 0x7fb02c0699c0 2023-10-10T21:15:00.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb03139b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c0699c0 0x7fb02c06f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:00.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb030b9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb02c06f750 0x7fb02c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:00.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb031b9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb02c069d90 0x7fb02c15d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44312/0 (socket says 172.21.15.154:44312) 2023-10-10T21:15:00.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb031b9c700 1 -- 172.21.15.154:0/3355759179 learned_addr learned my addr 172.21.15.154:0/3355759179 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:00.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb03139b700 1 -- 172.21.15.154:0/3355759179 >> v2:172.21.15.179:3300/0 conn(0x7fb02c06f750 msgr2=0x7fb02c1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:00.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb03139b700 1 --2- 172.21.15.154:0/3355759179 >> v2:172.21.15.179:3300/0 conn(0x7fb02c06f750 0x7fb02c1596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb03139b700 1 -- 172.21.15.154:0/3355759179 >> v1:172.21.15.179:6789/0 conn(0x7fb02c069d90 legacy=0x7fb02c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb03139b700 1 -- 172.21.15.154:0/3355759179 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c06e6b0 con 0x7fb02c0699c0 2023-10-10T21:15:00.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb030b9a700 1 --2- 172.21.15.154:0/3355759179 >> v2:172.21.15.179:3300/0 conn(0x7fb02c06f750 0x7fb02c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:15:00.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.253+0000 7fb03139b700 1 --2- 172.21.15.154:0/3355759179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c0699c0 0x7fb02c06f210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0280098e0 tx=0x7fb0280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ef61e8004c10478 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:00.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb023fff700 1 -- 172.21.15.154:0/3355759179 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800b640 con 0x7fb02c0699c0 2023-10-10T21:15:00.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb023fff700 1 -- 172.21.15.154:0/3355759179 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02800b7a0 con 0x7fb02c0699c0 2023-10-10T21:15:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb023fff700 1 -- 172.21.15.154:0/3355759179 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800bb40 con 0x7fb02c0699c0 2023-10-10T21:15:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb0335ff700 1 -- 172.21.15.154:0/3355759179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c0699c0 msgr2=0x7fb02c06f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb0335ff700 1 --2- 172.21.15.154:0/3355759179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c0699c0 0x7fb02c06f210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0280098e0 tx=0x7fb0280091a0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb0335ff700 1 -- 172.21.15.154:0/3355759179 shutdown_connections 2023-10-10T21:15:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb0335ff700 1 --2- 172.21.15.154:0/3355759179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c0699c0 0x7fb02c06f210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb0335ff700 1 --2- 172.21.15.154:0/3355759179 >> v2:172.21.15.179:3300/0 conn(0x7fb02c06f750 0x7fb02c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb0335ff700 1 -- 172.21.15.154:0/3355759179 >> 172.21.15.154:0/3355759179 conn(0x7fb02c068e10 msgr2=0x7fb02c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb0335ff700 1 -- 172.21.15.154:0/3355759179 shutdown_connections 2023-10-10T21:15:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.254+0000 7fb0335ff700 1 -- 172.21.15.154:0/3355759179 wait complete. 2023-10-10T21:15:00.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.256+0000 7fb0335ff700 1 Processor -- start 2023-10-10T21:15:00.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.256+0000 7fb0335ff700 1 -- start start 2023-10-10T21:15:00.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb0335ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c0699c0 0x7fb02c151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb0335ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c069d90 0x7fb02c0ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb0335ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c06f750 0x7fb02c0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb0335ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1523c0 con 0x7fb02c069d90 2023-10-10T21:15:00.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb0335ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0acdc0 con 0x7fb02c0699c0 2023-10-10T21:15:00.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb0335ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0ad090 con 0x7fb02c06f750 2023-10-10T21:15:00.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb030b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c069d90 0x7fb02c0ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:00.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb030b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c069d90 0x7fb02c0ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58018/0 (socket says 172.21.15.154:58018) 2023-10-10T21:15:00.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb030b9a700 1 -- 172.21.15.154:0/693970830 learned_addr learned my addr 172.21.15.154:0/693970830 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:00.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb03139b700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c0699c0 0x7fb02c151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:00.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb031b9c700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c06f750 0x7fb02c0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:00.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb030b9a700 1 -- 172.21.15.154:0/693970830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c06f750 msgr2=0x7fb02c0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb030b9a700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c06f750 0x7fb02c0b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb030b9a700 1 -- 172.21.15.154:0/693970830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c0699c0 msgr2=0x7fb02c151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb030b9a700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c0699c0 0x7fb02c151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb030b9a700 1 -- 172.21.15.154:0/693970830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c009420 con 0x7fb02c069d90 2023-10-10T21:15:00.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.257+0000 7fb03139b700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c0699c0 0x7fb02c151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:00.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.258+0000 7fb030b9a700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c069d90 0x7fb02c0ac880 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00ec50 tx=0x7fb01c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:00.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.258+0000 7fb0217fa700 1 -- 172.21.15.154:0/693970830 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00c9d0 con 0x7fb02c069d90 2023-10-10T21:15:00.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.258+0000 7fb0217fa700 1 -- 172.21.15.154:0/693970830 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c00cb30 con 0x7fb02c069d90 2023-10-10T21:15:00.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.258+0000 7fb0217fa700 1 -- 172.21.15.154:0/693970830 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c013470 con 0x7fb02c069d90 2023-10-10T21:15:00.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.258+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb028009420 con 0x7fb02c069d90 2023-10-10T21:15:00.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.258+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c0ad650 con 0x7fb02c069d90 2023-10-10T21:15:00.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.259+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c0a98d0 con 0x7fb02c069d90 2023-10-10T21:15:00.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.260+0000 7fb0217fa700 1 -- 172.21.15.154:0/693970830 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb01c0137e0 con 0x7fb02c069d90 2023-10-10T21:15:00.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.261+0000 7fb0217fa700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb010066f30 0x7fb0100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.261+0000 7fb0217fa700 1 -- 172.21.15.154:0/693970830 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5862+0+0 (secure 0 0 0) 0x7fb01c084cd0 con 0x7fb02c069d90 2023-10-10T21:15:00.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.261+0000 7fb03139b700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb010066f30 0x7fb0100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:00.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.262+0000 7fb03139b700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb010066f30 0x7fb0100693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb0280093f0 tx=0x7fb028017000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:00.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.265+0000 7fb0217fa700 1 -- 172.21.15.154:0/693970830 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb02c0a98d0 con 0x7fb02c069d90 2023-10-10T21:15:00.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.456+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb02c0a98d0 con 0x7fb02c069d90 2023-10-10T21:15:00.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.460+0000 7fb0217fa700 1 -- 172.21.15.154:0/693970830 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb02c0a98d0 con 0x7fb02c069d90 2023-10-10T21:15:00.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb010066f30 msgr2=0x7fb0100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb010066f30 0x7fb0100693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb0280093f0 tx=0x7fb028017000 comp rx=0 tx=0).stop 2023-10-10T21:15:00.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c069d90 msgr2=0x7fb02c0ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c069d90 0x7fb02c0ac880 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00ec50 tx=0x7fb01c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 shutdown_connections 2023-10-10T21:15:00.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c06f750 0x7fb02c0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb010066f30 0x7fb0100693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c0699c0 0x7fb02c151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 --2- 172.21.15.154:0/693970830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c069d90 0x7fb02c0ac880 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 >> 172.21.15.154:0/693970830 conn(0x7fb02c068e10 msgr2=0x7fb02c0c2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:00.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.462+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 shutdown_connections 2023-10-10T21:15:00.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.463+0000 7fb0335ff700 1 -- 172.21.15.154:0/693970830 wait complete. 2023-10-10T21:15:00.481 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:15:00.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:15:00.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:15:00.653 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:15:00.653 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T21:15:00.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:15:00.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.834+0000 7fae949ff700 1 Processor -- start 2023-10-10T21:15:00.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.834+0000 7fae949ff700 1 -- start start 2023-10-10T21:15:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae949ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae90155c10 0x7fae90155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae949ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae900ac6d0 0x7fae900b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae949ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae900acac0 con 0x7fae900ac230 2023-10-10T21:15:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae949ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae900ad930 con 0x7fae90155c10 2023-10-10T21:15:00.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae949ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae900acd20 con 0x7fae900ac6d0 2023-10-10T21:15:00.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae8e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae90155c10 0x7fae90155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:00.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae8e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae90155c10 0x7fae90155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58022/0 (socket says 172.21.15.154:58022) 2023-10-10T21:15:00.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae8e59c700 1 -- 172.21.15.154:0/3752244945 learned_addr learned my addr 172.21.15.154:0/3752244945 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae8e59c700 1 -- 172.21.15.154:0/3752244945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae900ac6d0 msgr2=0x7fae900b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae8e59c700 1 --2- 172.21.15.154:0/3752244945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae900ac6d0 0x7fae900b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae8e59c700 1 -- 172.21.15.154:0/3752244945 >> v1:172.21.15.179:6789/0 conn(0x7fae900ac230 legacy=0x7fae901568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.836+0000 7fae8e59c700 1 -- 172.21.15.154:0/3752244945 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900ad000 con 0x7fae90155c10 2023-10-10T21:15:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.837+0000 7fae8e59c700 1 --2- 172.21.15.154:0/3752244945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae90155c10 0x7fae90155fe0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fae900acc50 tx=0x7fae80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3968f8574f9927e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:00.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.837+0000 7fae8d59a700 1 -- 172.21.15.154:0/3752244945 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000b820 con 0x7fae90155c10 2023-10-10T21:15:00.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.837+0000 7fae8d59a700 1 -- 172.21.15.154:0/3752244945 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8000b980 con 0x7fae90155c10 2023-10-10T21:15:00.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.837+0000 7fae8d59a700 1 -- 172.21.15.154:0/3752244945 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000bd20 con 0x7fae90155c10 2023-10-10T21:15:00.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.837+0000 7fae949ff700 1 -- 172.21.15.154:0/3752244945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae90155c10 msgr2=0x7fae90155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.837+0000 7fae949ff700 1 --2- 172.21.15.154:0/3752244945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae90155c10 0x7fae90155fe0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fae900acc50 tx=0x7fae80009250 comp rx=0 tx=0).stop 2023-10-10T21:15:00.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.838+0000 7fae949ff700 1 -- 172.21.15.154:0/3752244945 shutdown_connections 2023-10-10T21:15:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.838+0000 7fae949ff700 1 --2- 172.21.15.154:0/3752244945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae900ac6d0 0x7fae900b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.838+0000 7fae949ff700 1 --2- 172.21.15.154:0/3752244945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae90155c10 0x7fae90155fe0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.838+0000 7fae949ff700 1 -- 172.21.15.154:0/3752244945 >> 172.21.15.154:0/3752244945 conn(0x7fae9006a320 msgr2=0x7fae900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.838+0000 7fae949ff700 1 -- 172.21.15.154:0/3752244945 shutdown_connections 2023-10-10T21:15:00.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.838+0000 7fae949ff700 1 -- 172.21.15.154:0/3752244945 wait complete. 2023-10-10T21:15:00.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.839+0000 7fae949ff700 1 Processor -- start 2023-10-10T21:15:00.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.839+0000 7fae949ff700 1 -- start start 2023-10-10T21:15:00.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.840+0000 7fae949ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae900ac230 0x7fae90140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.840+0000 7fae949ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae900ac6d0 0x7fae900c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.840+0000 7fae949ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae90155c10 0x7fae9016de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.840+0000 7fae949ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9014c600 con 0x7fae900ac230 2023-10-10T21:15:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.840+0000 7fae949ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae900ca270 con 0x7fae90155c10 2023-10-10T21:15:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.840+0000 7fae949ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9016bf40 con 0x7fae900ac6d0 2023-10-10T21:15:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.840+0000 7fae8e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae900ac230 0x7fae90140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.840+0000 7fae8e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae900ac230 0x7fae90140c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58038/0 (socket says 172.21.15.154:58038) 2023-10-10T21:15:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.840+0000 7fae8e59c700 1 -- 172.21.15.154:0/2908967972 learned_addr learned my addr 172.21.15.154:0/2908967972 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae8e59c700 1 -- 172.21.15.154:0/2908967972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae900ac6d0 msgr2=0x7fae900c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae8e59c700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae900ac6d0 0x7fae900c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae8e59c700 1 -- 172.21.15.154:0/2908967972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae90155c10 msgr2=0x7fae9016de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae8e59c700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae90155c10 0x7fae9016de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae8e59c700 1 -- 172.21.15.154:0/2908967972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800094f0 con 0x7fae900ac230 2023-10-10T21:15:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae8e59c700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae900ac230 0x7fae90140c70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fae800090b0 tx=0x7fae80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae7e7fc700 1 -- 172.21.15.154:0/2908967972 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80026480 con 0x7fae900ac230 2023-10-10T21:15:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae7e7fc700 1 -- 172.21.15.154:0/2908967972 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8001f070 con 0x7fae900ac230 2023-10-10T21:15:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9016c220 con 0x7fae900ac230 2023-10-10T21:15:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae7e7fc700 1 -- 172.21.15.154:0/2908967972 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80026830 con 0x7fae900ac230 2023-10-10T21:15:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.841+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9016c7e0 con 0x7fae900ac230 2023-10-10T21:15:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.842+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9004c3c0 con 0x7fae900ac230 2023-10-10T21:15:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.843+0000 7fae7e7fc700 1 -- 172.21.15.154:0/2908967972 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae8001a430 con 0x7fae900ac230 2023-10-10T21:15:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.844+0000 7fae7e7fc700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae70066f30 0x7fae700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:00.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.844+0000 7fae7e7fc700 1 -- 172.21.15.154:0/2908967972 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5862+0+0 (secure 0 0 0) 0x7fae80021070 con 0x7fae900ac230 2023-10-10T21:15:00.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.845+0000 7fae8dd9b700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae70066f30 0x7fae700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:00.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.845+0000 7fae8dd9b700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae70066f30 0x7fae700693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fae9014cfe0 tx=0x7fae84006ce0 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:00.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:00.848+0000 7fae7e7fc700 1 -- 172.21.15.154:0/2908967972 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae80053720 con 0x7fae900ac230 2023-10-10T21:15:01.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.079+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae900ad2e0 con 0x7fae900ac230 2023-10-10T21:15:01.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.080+0000 7fae7e7fc700 1 -- 172.21.15.154:0/2908967972 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3538 (secure 0 0 0) 0x7fae80056d40 con 0x7fae900ac230 2023-10-10T21:15:01.082 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:01.083 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/343222653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":343222653},{"type":"v1","addr":"172.21.15.154:6837","nonce":343222653}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2558521496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2558521496},{"type":"v1","addr":"172.21.15.179:6834","nonce":2558521496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3578232941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3578232941},{"type":"v1","addr":"172.21.15.179:6835","nonce":3578232941}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/2333251107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2333251107},{"type":"v1","addr":"172.21.15.154:6833","nonce":2333251107}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2023-10-10T21:15:01.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae70066f30 msgr2=0x7fae700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:01.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae70066f30 0x7fae700693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fae9014cfe0 tx=0x7fae84006ce0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae900ac230 msgr2=0x7fae90140c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:01.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae900ac230 0x7fae90140c70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fae800090b0 tx=0x7fae80017000 comp rx=0 tx=0).stop 2023-10-10T21:15:01.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 shutdown_connections 2023-10-10T21:15:01.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae70066f30 0x7fae700693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae90155c10 0x7fae9016de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae900ac230 0x7fae90140c70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 --2- 172.21.15.154:0/2908967972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae900ac6d0 0x7fae900c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 >> 172.21.15.154:0/2908967972 conn(0x7fae9006a320 msgr2=0x7fae900af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:01.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 shutdown_connections 2023-10-10T21:15:01.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.082+0000 7fae949ff700 1 -- 172.21.15.154:0/2908967972 wait complete. 2023-10-10T21:15:01.087 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 16 2023-10-10T21:15:01.102 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T21:15:01.103 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T21:15:01.103 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T21:15:01.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:15:01.104 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T21:15:01.104 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T21:15:01.104 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T21:15:01.105 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:15:01.105 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T21:15:01.105 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T21:15:01.105 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T21:15:01.106 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:15:01.106 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T21:15:01.106 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T21:15:01.107 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T21:15:01.107 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:15:01.116 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T21:15:01.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T21:15:01.118 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T21:15:01.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T21:15:01.122 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T21:15:01.122 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T21:15:01.123 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T21:15:01.124 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T21:15:01.163 INFO:tasks.ceph.mds.a:Started 2023-10-10T21:15:01.163 DEBUG:teuthology.parallel:result is None 2023-10-10T21:15:01.167 INFO:tasks.ceph.mds.c:Started 2023-10-10T21:15:01.168 DEBUG:teuthology.parallel:result is None 2023-10-10T21:15:01.169 INFO:tasks.ceph.mds.b:Started 2023-10-10T21:15:01.169 DEBUG:teuthology.parallel:result is None 2023-10-10T21:15:01.172 INFO:tasks.ceph.mds.d:Started 2023-10-10T21:15:01.173 DEBUG:teuthology.parallel:result is None 2023-10-10T21:15:01.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T21:15:01.296 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:15:01.299 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:15:01.307 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:15:01.309 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T21:15:01.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.368+0000 7f678e5ff700 1 Processor -- start 2023-10-10T21:15:01.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.368+0000 7f678e5ff700 1 -- start start 2023-10-10T21:15:01.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.369+0000 7f678e5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f678806c0a0 0x7f67880caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:01.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.369+0000 7f678e5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f678815df50 0x7f678815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:01.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.369+0000 7f678e5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678815d7e0 con 0x7f678806bcd0 2023-10-10T21:15:01.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.369+0000 7f678e5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678815dac0 con 0x7f678806c0a0 2023-10-10T21:15:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.369+0000 7f678e5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678815aa30 con 0x7f678815df50 2023-10-10T21:15:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.369+0000 7f67877fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f678806c0a0 0x7f67880caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f6787fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f678806bcd0 0x7f678815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44338/0 (socket says 172.21.15.154:44338) 2023-10-10T21:15:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f6787fff700 1 -- 172.21.15.154:0/165415678 learned_addr learned my addr 172.21.15.154:0/165415678 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f678cb9c700 1 --2- 172.21.15.154:0/165415678 >> v2:172.21.15.179:3300/0 conn(0x7f678815df50 0x7f678815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f678cb9c700 1 -- 172.21.15.154:0/165415678 >> v2:172.21.15.154:3300/0 conn(0x7f678806c0a0 msgr2=0x7f67880caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f678cb9c700 1 --2- 172.21.15.154:0/165415678 >> v2:172.21.15.154:3300/0 conn(0x7f678806c0a0 0x7f67880caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f6786ffd700 1 -- 172.21.15.154:0/165415678 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046490794 0 0) 0x7f678815d7e0 con 0x7f678806bcd0 2023-10-10T21:15:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f678cb9c700 1 -- 172.21.15.154:0/165415678 >> v1:172.21.15.179:6789/0 conn(0x7f678806bcd0 legacy=0x7f678815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f678cb9c700 1 -- 172.21.15.154:0/165415678 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678815ad10 con 0x7f678815df50 2023-10-10T21:15:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f678cb9c700 1 --2- 172.21.15.154:0/165415678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678815df50 0x7f678815e3b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f678815d720 tx=0x7f6780009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=590c1f49f1854b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.370+0000 7f6786ffd700 1 -- 172.21.15.154:0/165415678 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000e070 con 0x7f678815df50 2023-10-10T21:15:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f6786ffd700 1 -- 172.21.15.154:0/165415678 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678000bb60 con 0x7f678815df50 2023-10-10T21:15:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f6786ffd700 1 -- 172.21.15.154:0/165415678 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780012430 con 0x7f678815df50 2023-10-10T21:15:01.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f678e5ff700 1 -- 172.21.15.154:0/165415678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678815df50 msgr2=0x7f678815e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:01.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f678e5ff700 1 --2- 172.21.15.154:0/165415678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678815df50 0x7f678815e3b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f678815d720 tx=0x7f6780009780 comp rx=0 tx=0).stop 2023-10-10T21:15:01.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f678e5ff700 1 -- 172.21.15.154:0/165415678 shutdown_connections 2023-10-10T21:15:01.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f678e5ff700 1 --2- 172.21.15.154:0/165415678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678815df50 0x7f678815e3b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f678e5ff700 1 --2- 172.21.15.154:0/165415678 >> v2:172.21.15.154:3300/0 conn(0x7f678806c0a0 0x7f67880caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f678e5ff700 1 -- 172.21.15.154:0/165415678 >> 172.21.15.154:0/165415678 conn(0x7f67880ce600 msgr2=0x7f67880cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:01.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f678e5ff700 1 -- 172.21.15.154:0/165415678 shutdown_connections 2023-10-10T21:15:01.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.371+0000 7f678e5ff700 1 -- 172.21.15.154:0/165415678 wait complete. 2023-10-10T21:15:01.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.373+0000 7f678e5ff700 1 Processor -- start 2023-10-10T21:15:01.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.373+0000 7f678e5ff700 1 -- start start 2023-10-10T21:15:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f678e5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678806bcd0 0x7f678816f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f678e5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678806c0a0 0x7f67880c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f678e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f678815df50 0x7f67880c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f678e5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c6c00 con 0x7f678806bcd0 2023-10-10T21:15:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f678e5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c6ee0 con 0x7f678806c0a0 2023-10-10T21:15:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f678e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c71c0 con 0x7f678815df50 2023-10-10T21:15:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f6787fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678806bcd0 0x7f678816f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f6787fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678806bcd0 0x7f678816f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58084/0 (socket says 172.21.15.154:58084) 2023-10-10T21:15:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f6787fff700 1 -- 172.21.15.154:0/4065773369 learned_addr learned my addr 172.21.15.154:0/4065773369 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f67877fe700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678806c0a0 0x7f67880c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f678cb9c700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f678815df50 0x7f67880c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:01.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f6787fff700 1 -- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f678815df50 msgr2=0x7f67880c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:01.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f6787fff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f678815df50 0x7f67880c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f6787fff700 1 -- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678806c0a0 msgr2=0x7f67880c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:01.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f6787fff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678806c0a0 0x7f67880c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f6787fff700 1 -- 172.21.15.154:0/4065773369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780009a20 con 0x7f678806bcd0 2023-10-10T21:15:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f678cb9c700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f678815df50 0x7f67880c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:15:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.374+0000 7f67877fe700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678806c0a0 0x7f67880c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.375+0000 7f6787fff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678806bcd0 0x7f678816f4e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f677800c5b0 tx=0x7f6778001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.375+0000 7f676ffff700 1 -- 172.21.15.154:0/4065773369 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778005b30 con 0x7f678806bcd0 2023-10-10T21:15:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.375+0000 7f676ffff700 1 -- 172.21.15.154:0/4065773369 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778005c90 con 0x7f678806bcd0 2023-10-10T21:15:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.375+0000 7f676ffff700 1 -- 172.21.15.154:0/4065773369 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778007300 con 0x7f678806bcd0 2023-10-10T21:15:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.375+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67880c74a0 con 0x7f678806bcd0 2023-10-10T21:15:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.375+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678816fa20 con 0x7f678806bcd0 2023-10-10T21:15:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.376+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67880c79c0 con 0x7f678806bcd0 2023-10-10T21:15:01.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.377+0000 7f676ffff700 1 -- 172.21.15.154:0/4065773369 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f677801b3b0 con 0x7f678806bcd0 2023-10-10T21:15:01.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.378+0000 7f676ffff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:01.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.378+0000 7f676ffff700 1 -- 172.21.15.154:0/4065773369 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f6778083bb0 con 0x7f678806bcd0 2023-10-10T21:15:01.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.378+0000 7f67877fe700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:01.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.379+0000 7f67877fe700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6774066f30 0x7f67740693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f678815d040 tx=0x7f677c008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:01.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.382+0000 7f676ffff700 1 -- 172.21.15.154:0/4065773369 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6778050ce0 con 0x7f678806bcd0 2023-10-10T21:15:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:01.592+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f678804c3c0 con 0x7f678806bcd0 2023-10-10T21:15:02.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.488+0000 7f676ffff700 1 -- 172.21.15.154:0/4065773369 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6778017080 con 0x7f678806bcd0 2023-10-10T21:15:02.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.491+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6774066f30 msgr2=0x7f67740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:02.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.491+0000 7f678e5ff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6774066f30 0x7f67740693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f678815d040 tx=0x7f677c008040 comp rx=0 tx=0).stop 2023-10-10T21:15:02.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.491+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678806bcd0 msgr2=0x7f678816f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:02.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.491+0000 7f678e5ff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678806bcd0 0x7f678816f4e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f677800c5b0 tx=0x7f6778001070 comp rx=0 tx=0).stop 2023-10-10T21:15:02.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.492+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 shutdown_connections 2023-10-10T21:15:02.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.492+0000 7f678e5ff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f678815df50 0x7f67880c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:02.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.492+0000 7f678e5ff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678806bcd0 0x7f678816f4e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:02.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.492+0000 7f678e5ff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:02.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.492+0000 7f678e5ff700 1 --2- 172.21.15.154:0/4065773369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f678806c0a0 0x7f67880c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:02.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.492+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 >> 172.21.15.154:0/4065773369 conn(0x7f67880ce600 msgr2=0x7f678815b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:02.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.492+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 shutdown_connections 2023-10-10T21:15:02.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.492+0000 7f678e5ff700 1 -- 172.21.15.154:0/4065773369 wait complete. 2023-10-10T21:15:02.496 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T21:15:02.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T21:15:02.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.698+0000 7ff47cdff700 1 Processor -- start 2023-10-10T21:15:02.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.698+0000 7ff47cdff700 1 -- start start 2023-10-10T21:15:02.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff47cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780ccf90 0x7ff4780ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:02.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff47cdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4780cc300 con 0x7ff4780cbf30 2023-10-10T21:15:02.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff47cdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4780ad370 con 0x7ff4780b1420 2023-10-10T21:15:02.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff47cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff478156bf0 con 0x7ff4780ccf90 2023-10-10T21:15:02.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff47659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff4780cbf30 0x7ff4780b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53682/0 (socket says 172.21.15.154:53682) 2023-10-10T21:15:02.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff47659c700 1 -- 172.21.15.154:0/1958400924 learned_addr learned my addr 172.21.15.154:0/1958400924 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:02.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff476d9d700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780ccf90 0x7ff4780ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:02.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913963889 0 0) 0x7ff4780cc300 con 0x7ff4780cbf30 2023-10-10T21:15:02.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff464003570 con 0x7ff4780cbf30 2023-10-10T21:15:02.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167509675 0 0) 0x7ff4780ad370 con 0x7ff4780b1420 2023-10-10T21:15:02.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4780cc300 con 0x7ff4780b1420 2023-10-10T21:15:02.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481913422 0 0) 0x7ff464003570 con 0x7ff4780cbf30 2023-10-10T21:15:02.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780ccf90 msgr2=0x7ff4780ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:02.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780ccf90 0x7ff4780ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:02.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 >> v1:172.21.15.179:6789/0 conn(0x7ff4780b1420 legacy=0x7ff4780c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:02.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780ad650 con 0x7ff4780cbf30 2023-10-10T21:15:02.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7ff468001470 con 0x7ff4780cbf30 2023-10-10T21:15:02.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 >> v1:172.21.15.154:6789/0 conn(0x7ff4780cbf30 legacy=0x7ff4780b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:02.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780ccf90 0x7ff464003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:02.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff464004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:02.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff464004d50 0x7ff4640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:02.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478156bf0 con 0x7ff464004180 2023-10-10T21:15:02.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46400ddb0 con 0x7ff464004d50 2023-10-10T21:15:02.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46400df70 con 0x7ff4780ccf90 2023-10-10T21:15:02.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff46ffff700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff464004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff47659c700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780ccf90 0x7ff464003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.701+0000 7ff476d9d700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff464004d50 0x7ff4640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.702+0000 7ff46ffff700 1 -- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780ccf90 msgr2=0x7ff464003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.702+0000 7ff46ffff700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780ccf90 0x7ff464003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.702+0000 7ff46ffff700 1 -- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff464004d50 msgr2=0x7ff4640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:02.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.702+0000 7ff46ffff700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff464004d50 0x7ff4640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:02.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.702+0000 7ff46ffff700 1 -- 172.21.15.154:0/1958400924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464003570 con 0x7ff464004180 2023-10-10T21:15:02.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.702+0000 7ff46ffff700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff464004810 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff4780b1820 tx=0x7ff460007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cd58ee81e077b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:02.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.702+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000c5d0 con 0x7ff464004180 2023-10-10T21:15:02.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.702+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46000c730 con 0x7ff464004180 2023-10-10T21:15:02.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.702+0000 7ff475d9b700 1 -- 172.21.15.154:0/1958400924 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000cad0 con 0x7ff464004180 2023-10-10T21:15:02.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.703+0000 7ff47cdff700 1 -- 172.21.15.154:0/1958400924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 msgr2=0x7ff464004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:02.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.703+0000 7ff47cdff700 1 --2- 172.21.15.154:0/1958400924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff464004810 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff4780b1820 tx=0x7ff460007d30 comp rx=0 tx=0).stop 2023-10-10T21:15:02.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.703+0000 7ff476d9d700 1 -- 172.21.15.154:0/1958400924 reap_dead start 2023-10-10T21:15:02.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.703+0000 7ff47cdff700 1 -- 172.21.15.154:0/1958400924 shutdown_connections 2023-10-10T21:15:02.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.703+0000 7ff47cdff700 1 -- 172.21.15.154:0/1958400924 >> 172.21.15.154:0/1958400924 conn(0x7ff47806a320 msgr2=0x7ff4780cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:02.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.703+0000 7ff47cdff700 1 -- 172.21.15.154:0/1958400924 shutdown_connections 2023-10-10T21:15:02.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.703+0000 7ff47cdff700 1 -- 172.21.15.154:0/1958400924 wait complete. 2023-10-10T21:15:02.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.704+0000 7ff47cdff700 1 Processor -- start 2023-10-10T21:15:02.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.704+0000 7ff47cdff700 1 -- start start 2023-10-10T21:15:02.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.705+0000 7ff47cdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff478169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:02.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.705+0000 7ff47cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780abee0 0x7ff4780c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:02.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.705+0000 7ff47cdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47816ac50 0x7ff478159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:02.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.705+0000 7ff47cdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780ac350 con 0x7ff464004180 2023-10-10T21:15:02.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.705+0000 7ff47cdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780c1360 con 0x7ff47816ac50 2023-10-10T21:15:02.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.705+0000 7ff47cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780c3af0 con 0x7ff4780abee0 2023-10-10T21:15:02.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.705+0000 7ff47659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff478169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:02.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.705+0000 7ff47659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff478169a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58098/0 (socket says 172.21.15.154:58098) 2023-10-10T21:15:02.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.705+0000 7ff47659c700 1 -- 172.21.15.154:0/2060263814 learned_addr learned my addr 172.21.15.154:0/2060263814 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:02.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff476d9d700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47816ac50 0x7ff478159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:02.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff46ffff700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780abee0 0x7ff4780c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:02.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff47659c700 1 -- 172.21.15.154:0/2060263814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780abee0 msgr2=0x7ff4780c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:02.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff47659c700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780abee0 0x7ff4780c35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:02.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff47659c700 1 -- 172.21.15.154:0/2060263814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47816ac50 msgr2=0x7ff478159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:02.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff47659c700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47816ac50 0x7ff478159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:02.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff47659c700 1 -- 172.21.15.154:0/2060263814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47816a060 con 0x7ff464004180 2023-10-10T21:15:02.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff47659c700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff478169a80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff4680073c0 tx=0x7ff468001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:02.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff46e7fc700 1 -- 172.21.15.154:0/2060263814 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468018030 con 0x7ff464004180 2023-10-10T21:15:02.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff46e7fc700 1 -- 172.21.15.154:0/2060263814 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff468001040 con 0x7ff464004180 2023-10-10T21:15:02.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff46e7fc700 1 -- 172.21.15.154:0/2060263814 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800fac0 con 0x7ff464004180 2023-10-10T21:15:02.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47816a340 con 0x7ff464004180 2023-10-10T21:15:02.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.706+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47816a900 con 0x7ff464004180 2023-10-10T21:15:02.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.707+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47804c3c0 con 0x7ff464004180 2023-10-10T21:15:02.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.708+0000 7ff46e7fc700 1 -- 172.21.15.154:0/2060263814 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff46801b070 con 0x7ff464004180 2023-10-10T21:15:02.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.709+0000 7ff46e7fc700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff458066f30 0x7ff4580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:02.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.709+0000 7ff46e7fc700 1 -- 172.21.15.154:0/2060263814 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5217+0+0 (secure 0 0 0) 0x7ff468019070 con 0x7ff464004180 2023-10-10T21:15:02.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.709+0000 7ff46ffff700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff458066f30 0x7ff4580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:02.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.710+0000 7ff46ffff700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff458066f30 0x7ff4580693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff460008fd0 tx=0x7ff460015000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:02.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.714+0000 7ff46e7fc700 1 -- 172.21.15.154:0/2060263814 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4680515a0 con 0x7ff464004180 2023-10-10T21:15:02.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.976+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff4780ad930 con 0x7ff464004180 2023-10-10T21:15:02.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.977+0000 7ff46e7fc700 1 -- 172.21.15.154:0/2060263814 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff468054bc0 con 0x7ff464004180 2023-10-10T21:15:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:02.980 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:15:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T21:15:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T21:15:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T21:15:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:15:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:15:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:15:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T21:15:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T21:15:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:15:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:15:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:15:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T21:15:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T21:15:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:15:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:15:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:15:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T21:15:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T21:15:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:15:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:15:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:15:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T21:15:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T21:15:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:15:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:15:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T21:15:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T21:15:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:15:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:15:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T21:15:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T21:15:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:15:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:15:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T21:15:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T21:15:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:15:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:15:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T21:15:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T21:15:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:15:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:15:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T21:15:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T21:15:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:15:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:15:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T21:15:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T21:15:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:15:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:15:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T21:15:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T21:15:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:15:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:15:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T21:15:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T21:15:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:15:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T21:15:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T21:15:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T21:15:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T21:15:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:15:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:15:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:15:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:15:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T21:15:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T21:15:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:15:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:15:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:15:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:15:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T21:15:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T21:15:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:15:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:15:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:15:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:15:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T21:15:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T21:15:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:15:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:15:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:15:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T21:15:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T21:15:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:15:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:15:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:15:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T21:15:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T21:15:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:15:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:15:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:15:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:15:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T21:15:03.016 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:15:03.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff458066f30 msgr2=0x7ff4580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff458066f30 0x7ff4580693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff460008fd0 tx=0x7ff460015000 comp rx=0 tx=0).stop 2023-10-10T21:15:03.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 msgr2=0x7ff478169a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff478169a80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff4680073c0 tx=0x7ff468001df0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 shutdown_connections 2023-10-10T21:15:03.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff458066f30 0x7ff4580693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47816ac50 0x7ff478159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff464004180 0x7ff478169a80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 --2- 172.21.15.154:0/2060263814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4780abee0 0x7ff4780c35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 >> 172.21.15.154:0/2060263814 conn(0x7ff47806a320 msgr2=0x7ff4780ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:03.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 shutdown_connections 2023-10-10T21:15:03.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:02.979+0000 7ff47cdff700 1 -- 172.21.15.154:0/2060263814 wait complete. 2023-10-10T21:15:03.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0b19d700 1 Processor -- start 2023-10-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0b19d700 1 -- start start 2023-10-10T21:15:03.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 0x7f5b04157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0b19d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b040c7410 0x7f5b04069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0b19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0406e2a0 con 0x7f5b04150550 2023-10-10T21:15:03.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0b19d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0406b2e0 con 0x7f5b040c7410 2023-10-10T21:15:03.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040c78e0 con 0x7f5b04150180 2023-10-10T21:15:03.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0a99c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b040c7410 0x7f5b04069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0a99c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b040c7410 0x7f5b04069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58106/0 (socket says 172.21.15.154:58106) 2023-10-10T21:15:03.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.203+0000 7f5b0a99c700 1 -- 172.21.15.154:0/2954683197 learned_addr learned my addr 172.21.15.154:0/2954683197 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:03.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.204+0000 7f5b0a19b700 1 --2- 172.21.15.154:0/2954683197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 0x7f5b04157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.204+0000 7f5b0a99c700 1 -- 172.21.15.154:0/2954683197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 msgr2=0x7f5b04157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.204+0000 7f5b0a99c700 1 --2- 172.21.15.154:0/2954683197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 0x7f5b04157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.204+0000 7f5b0a99c700 1 -- 172.21.15.154:0/2954683197 >> v1:172.21.15.179:6789/0 conn(0x7f5b04150550 legacy=0x7f5b040c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.204+0000 7f5b0a99c700 1 -- 172.21.15.154:0/2954683197 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b040c7bc0 con 0x7f5b040c7410 2023-10-10T21:15:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.204+0000 7f5b0a99c700 1 --2- 172.21.15.154:0/2954683197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b040c7410 0x7f5b04069f50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009f20 tx=0x7f5afc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b2481a9471d4e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.204+0000 7f5b09199700 1 -- 172.21.15.154:0/2954683197 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc00e070 con 0x7f5b040c7410 2023-10-10T21:15:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.204+0000 7f5b09199700 1 -- 172.21.15.154:0/2954683197 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc00ba80 con 0x7f5b040c7410 2023-10-10T21:15:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.204+0000 7f5b09199700 1 -- 172.21.15.154:0/2954683197 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0092e0 con 0x7f5b040c7410 2023-10-10T21:15:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.205+0000 7f5b0b19d700 1 -- 172.21.15.154:0/2954683197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b040c7410 msgr2=0x7f5b04069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.205+0000 7f5b0b19d700 1 --2- 172.21.15.154:0/2954683197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b040c7410 0x7f5b04069f50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009f20 tx=0x7f5afc009840 comp rx=0 tx=0).stop 2023-10-10T21:15:03.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.205+0000 7f5b0b19d700 1 -- 172.21.15.154:0/2954683197 shutdown_connections 2023-10-10T21:15:03.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.205+0000 7f5b0b19d700 1 --2- 172.21.15.154:0/2954683197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b040c7410 0x7f5b04069f50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.205+0000 7f5b0b19d700 1 --2- 172.21.15.154:0/2954683197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 0x7f5b04157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.205+0000 7f5b0b19d700 1 -- 172.21.15.154:0/2954683197 >> 172.21.15.154:0/2954683197 conn(0x7f5b040cc1f0 msgr2=0x7f5b040cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:03.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.205+0000 7f5b0b19d700 1 -- 172.21.15.154:0/2954683197 shutdown_connections 2023-10-10T21:15:03.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.205+0000 7f5b0b19d700 1 -- 172.21.15.154:0/2954683197 wait complete. 2023-10-10T21:15:03.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.206+0000 7f5b0b19d700 1 Processor -- start 2023-10-10T21:15:03.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.207+0000 7f5b0b19d700 1 -- start start 2023-10-10T21:15:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.207+0000 7f5b0b19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b040c7410 0x7f5b0414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.207+0000 7f5b0b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 0x7f5b040ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.207+0000 7f5b0b19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b04150550 0x7f5b040ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.207+0000 7f5b0b19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0416aa60 con 0x7f5b04150550 2023-10-10T21:15:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.207+0000 7f5b0b19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040af9f0 con 0x7f5b040c7410 2023-10-10T21:15:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.207+0000 7f5b0b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0414b3e0 con 0x7f5b04150180 2023-10-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b04150550 0x7f5b040ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b04150550 0x7f5b040ad5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58122/0 (socket says 172.21.15.154:58122) 2023-10-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a99c700 1 -- 172.21.15.154:0/1641103952 learned_addr learned my addr 172.21.15.154:0/1641103952 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a19b700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b040c7410 0x7f5b0414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0999a700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 0x7f5b040ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a99c700 1 -- 172.21.15.154:0/1641103952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 msgr2=0x7f5b040ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a99c700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 0x7f5b040ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a99c700 1 -- 172.21.15.154:0/1641103952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b040c7410 msgr2=0x7f5b0414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a99c700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b040c7410 0x7f5b0414aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a99c700 1 -- 172.21.15.154:0/1641103952 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc009ae0 con 0x7f5b04150550 2023-10-10T21:15:03.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a19b700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b040c7410 0x7f5b0414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:03.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.208+0000 7f5b0a99c700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b04150550 0x7f5b040ad5c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00b6c0 tx=0x7f5afc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:03.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.209+0000 7f5afa7fc700 1 -- 172.21.15.154:0/1641103952 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0032f0 con 0x7f5b04150550 2023-10-10T21:15:03.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.209+0000 7f5afa7fc700 1 -- 172.21.15.154:0/1641103952 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc008e70 con 0x7f5b04150550 2023-10-10T21:15:03.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.209+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b040af0c0 con 0x7f5b04150550 2023-10-10T21:15:03.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.209+0000 7f5afa7fc700 1 -- 172.21.15.154:0/1641103952 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc026670 con 0x7f5b04150550 2023-10-10T21:15:03.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.209+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b040af680 con 0x7f5b04150550 2023-10-10T21:15:03.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.210+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b040afb80 con 0x7f5b04150550 2023-10-10T21:15:03.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.211+0000 7f5afa7fc700 1 -- 172.21.15.154:0/1641103952 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5afc003040 con 0x7f5b04150550 2023-10-10T21:15:03.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.212+0000 7f5afa7fc700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5ae8066f30 0x7f5ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.212+0000 7f5afa7fc700 1 -- 172.21.15.154:0/1641103952 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f5afc086400 con 0x7f5b04150550 2023-10-10T21:15:03.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.212+0000 7f5b0a19b700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5ae8066f30 0x7f5ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.213+0000 7f5b0a19b700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5ae8066f30 0x7f5ae80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006fd0 tx=0x7f5b00008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.216+0000 7f5afa7fc700 1 -- 172.21.15.154:0/1641103952 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5afc053850 con 0x7f5b04150550 2023-10-10T21:15:03.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.410+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b0404c3c0 con 0x7f5b04150550 2023-10-10T21:15:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.411+0000 7f5afa7fc700 1 -- 172.21.15.154:0/1641103952 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+12733 (secure 0 0 0) 0x7f5afc056e70 con 0x7f5b04150550 2023-10-10T21:15:03.415 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:03.415 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":60,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:15:02.482330+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:15:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5ae8066f30 msgr2=0x7f5ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5ae8066f30 0x7f5ae80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006fd0 tx=0x7f5b00008040 comp rx=0 tx=0).stop 2023-10-10T21:15:03.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b04150550 msgr2=0x7f5b040ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b04150550 0x7f5b040ad5c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00b6c0 tx=0x7f5afc018000 comp rx=0 tx=0).stop 2023-10-10T21:15:03.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 shutdown_connections 2023-10-10T21:15:03.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b04150550 0x7f5b040ad5c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5ae8066f30 0x7f5ae80693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b040c7410 0x7f5b0414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 --2- 172.21.15.154:0/1641103952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04150180 0x7f5b040ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.413+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 >> 172.21.15.154:0/1641103952 conn(0x7f5b040cc1f0 msgr2=0x7f5b040c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:03.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.414+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 shutdown_connections 2023-10-10T21:15:03.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.414+0000 7f5b0b19d700 1 -- 172.21.15.154:0/1641103952 wait complete. 2023-10-10T21:15:03.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T21:15:03.434 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:15:03.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.619+0000 7f54fddff700 1 Processor -- start 2023-10-10T21:15:03.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.619+0000 7f54fddff700 1 -- start start 2023-10-10T21:15:03.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.621+0000 7f54fddff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54f81568e0 0x7f54f81616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.621+0000 7f54fddff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f815b0d0 con 0x7f54f80c83f0 2023-10-10T21:15:03.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.621+0000 7f54fddff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f815a4c0 con 0x7f54f80ccee0 2023-10-10T21:15:03.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.621+0000 7f54fddff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f815a7a0 con 0x7f54f81568e0 2023-10-10T21:15:03.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.621+0000 7f54f77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f54f80c83f0 0x7f54f80c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53690/0 (socket says 172.21.15.154:53690) 2023-10-10T21:15:03.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.621+0000 7f54f77fe700 1 -- 172.21.15.154:0/1957417264 learned_addr learned my addr 172.21.15.154:0/1957417264 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:03.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.621+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782654207 0 0) 0x7f54f815b0d0 con 0x7f54f80c83f0 2023-10-10T21:15:03.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.621+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e4003570 con 0x7f54f80c83f0 2023-10-10T21:15:03.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.621+0000 7f54f7fff700 1 --2- 172.21.15.154:0/1957417264 >> v2:172.21.15.179:3300/0 conn(0x7f54f81568e0 0x7f54f81616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1624171064 0 0) 0x7f54e4003570 con 0x7f54f80c83f0 2023-10-10T21:15:03.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 >> v2:172.21.15.179:3300/0 conn(0x7f54f81568e0 msgr2=0x7f54f81616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:03.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 --2- 172.21.15.154:0/1957417264 >> v2:172.21.15.179:3300/0 conn(0x7f54f81568e0 0x7f54f81616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 >> v1:172.21.15.179:6789/0 conn(0x7f54f80ccee0 legacy=0x7f54f81561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f815aa80 con 0x7f54f80c83f0 2023-10-10T21:15:03.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f54e8001470 con 0x7f54f80c83f0 2023-10-10T21:15:03.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 >> v1:172.21.15.154:6789/0 conn(0x7f54f80c83f0 legacy=0x7f54f80c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54e4003a60 0x7f54e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54e4004810 0x7f54e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e40052e0 0x7f54e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f815a7a0 con 0x7f54e4003a60 2023-10-10T21:15:03.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e400c190 con 0x7f54e4004810 2023-10-10T21:15:03.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e400c350 con 0x7f54e40052e0 2023-10-10T21:15:03.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f77fe700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54e4003a60 0x7f54e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54f7fff700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e40052e0 0x7f54e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.622+0000 7f54effff700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54e4004810 0x7f54e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f77fe700 1 -- 172.21.15.154:0/1957417264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e40052e0 msgr2=0x7f54e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:03.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f77fe700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e40052e0 0x7f54e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f77fe700 1 -- 172.21.15.154:0/1957417264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54e4004810 msgr2=0x7f54e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:03.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f77fe700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54e4004810 0x7f54e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f77fe700 1 -- 172.21.15.154:0/1957417264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e4003570 con 0x7f54e4003a60 2023-10-10T21:15:03.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f7fff700 1 -- 172.21.15.154:0/1957417264 reap_dead start 2023-10-10T21:15:03.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f77fe700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54e4003a60 0x7f54e4003e70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f54e800c3c0 tx=0x7f54e8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6dd2b610924fc65 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:03.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e800cc90 con 0x7f54e4003a60 2023-10-10T21:15:03.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e800cdf0 con 0x7f54e4003a60 2023-10-10T21:15:03.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54f6ffd700 1 -- 172.21.15.154:0/1957417264 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8005b50 con 0x7f54e4003a60 2023-10-10T21:15:03.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54fddff700 1 -- 172.21.15.154:0/1957417264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54e4003a60 msgr2=0x7f54e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.623+0000 7f54fddff700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54e4003a60 0x7f54e4003e70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f54e800c3c0 tx=0x7f54e8001e50 comp rx=0 tx=0).stop 2023-10-10T21:15:03.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.624+0000 7f54fddff700 1 -- 172.21.15.154:0/1957417264 shutdown_connections 2023-10-10T21:15:03.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.624+0000 7f54fddff700 1 --2- 172.21.15.154:0/1957417264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54e4003a60 0x7f54e4003e70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.624+0000 7f54fddff700 1 -- 172.21.15.154:0/1957417264 >> 172.21.15.154:0/1957417264 conn(0x7f54f8068e10 msgr2=0x7f54f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:03.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.624+0000 7f54fddff700 1 -- 172.21.15.154:0/1957417264 shutdown_connections 2023-10-10T21:15:03.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.624+0000 7f54fddff700 1 -- 172.21.15.154:0/1957417264 wait complete. 2023-10-10T21:15:03.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.625+0000 7f54fddff700 1 Processor -- start 2023-10-10T21:15:03.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.625+0000 7f54fddff700 1 -- start start 2023-10-10T21:15:03.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.626+0000 7f54fddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e4003a60 0x7f54f80c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.626+0000 7f54fddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f8154bc0 0x7f54f8155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.626+0000 7f54fddff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f80b15e0 0x7f54f80b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.626+0000 7f54fddff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80afca0 con 0x7f54f80b15e0 2023-10-10T21:15:03.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.626+0000 7f54fddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80c2e10 con 0x7f54f8154bc0 2023-10-10T21:15:03.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.626+0000 7f54fddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8155570 con 0x7f54e4003a60 2023-10-10T21:15:03.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f80b15e0 0x7f54f80b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f80b15e0 0x7f54f80b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58138/0 (socket says 172.21.15.154:58138) 2023-10-10T21:15:03.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f7fff700 1 -- 172.21.15.154:0/4029740925 learned_addr learned my addr 172.21.15.154:0/4029740925 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:03.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54effff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f8154bc0 0x7f54f8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f77fe700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e4003a60 0x7f54f80c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f7fff700 1 -- 172.21.15.154:0/4029740925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e4003a60 msgr2=0x7f54f80c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f7fff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e4003a60 0x7f54f80c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f7fff700 1 -- 172.21.15.154:0/4029740925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f8154bc0 msgr2=0x7f54f8155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f7fff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f8154bc0 0x7f54f8155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f7fff700 1 -- 172.21.15.154:0/4029740925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f816b710 con 0x7f54f80b15e0 2023-10-10T21:15:03.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54f7fff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f80b15e0 0x7f54f80b1a60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f54f806fdc0 tx=0x7f54f0009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:03.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.627+0000 7f54ef7fe700 1 -- 172.21.15.154:0/4029740925 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0009b10 con 0x7f54f80b15e0 2023-10-10T21:15:03.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.628+0000 7f54ef7fe700 1 -- 172.21.15.154:0/4029740925 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0002c00 con 0x7f54f80b15e0 2023-10-10T21:15:03.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.628+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f80c2570 con 0x7f54f80b15e0 2023-10-10T21:15:03.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.628+0000 7f54ef7fe700 1 -- 172.21.15.154:0/4029740925 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0015420 con 0x7f54f80b15e0 2023-10-10T21:15:03.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.628+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f80c2b30 con 0x7f54f80b15e0 2023-10-10T21:15:03.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.629+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f816b4e0 con 0x7f54f80b15e0 2023-10-10T21:15:03.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.629+0000 7f54ef7fe700 1 -- 172.21.15.154:0/4029740925 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54f0003040 con 0x7f54f80b15e0 2023-10-10T21:15:03.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.630+0000 7f54ef7fe700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f54d8066f30 0x7f54d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:03.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.630+0000 7f54ef7fe700 1 -- 172.21.15.154:0/4029740925 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f54f00848b0 con 0x7f54f80b15e0 2023-10-10T21:15:03.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.630+0000 7f54f77fe700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f54d8066f30 0x7f54d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:03.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.631+0000 7f54f77fe700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f54d8066f30 0x7f54d80693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f54e8007cd0 tx=0x7f54e8015000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:03.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.634+0000 7f54ef7fe700 1 -- 172.21.15.154:0/4029740925 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54f816b4e0 con 0x7f54f80b15e0 2023-10-10T21:15:03.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.824+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54f816b4e0 con 0x7f54f80b15e0 2023-10-10T21:15:03.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.825+0000 7f54ef7fe700 1 -- 172.21.15.154:0/4029740925 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54f816b4e0 con 0x7f54f80b15e0 2023-10-10T21:15:03.826 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:15:03.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f54d8066f30 msgr2=0x7f54d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f54d8066f30 0x7f54d80693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f54e8007cd0 tx=0x7f54e8015000 comp rx=0 tx=0).stop 2023-10-10T21:15:03.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f80b15e0 msgr2=0x7f54f80b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:03.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f80b15e0 0x7f54f80b1a60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f54f806fdc0 tx=0x7f54f0009710 comp rx=0 tx=0).stop 2023-10-10T21:15:03.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 shutdown_connections 2023-10-10T21:15:03.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f80b15e0 0x7f54f80b1a60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e4003a60 0x7f54f80c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f54d8066f30 0x7f54d80693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 --2- 172.21.15.154:0/4029740925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f8154bc0 0x7f54f8155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:03.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 >> 172.21.15.154:0/4029740925 conn(0x7f54f8068e10 msgr2=0x7f54f80c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:03.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 shutdown_connections 2023-10-10T21:15:03.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:03.827+0000 7f54fddff700 1 -- 172.21.15.154:0/4029740925 wait complete. 2023-10-10T21:15:03.845 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T21:15:04.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.025+0000 7f7cd759d700 1 Processor -- start 2023-10-10T21:15:04.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.025+0000 7f7cd759d700 1 -- start start 2023-10-10T21:15:04.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.026+0000 7f7cd759d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7cd0159420 0x7f7cd00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.026+0000 7f7cd759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.026+0000 7f7cd759d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd00b2980 con 0x7f7cd01597f0 2023-10-10T21:15:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.026+0000 7f7cd759d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd015dbb0 con 0x7f7cd0159420 2023-10-10T21:15:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.026+0000 7f7cd759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00b11d0 con 0x7f7cd015d230 2023-10-10T21:15:04.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.027+0000 7f7cd6d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.027+0000 7f7cd6d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd015d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:54474/0 (socket says 172.21.15.154:54474) 2023-10-10T21:15:04.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.027+0000 7f7cd6d9c700 1 -- 172.21.15.154:0/2979503871 learned_addr learned my addr 172.21.15.154:0/2979503871 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:04.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.027+0000 7f7cd659b700 1 --2- 172.21.15.154:0/2979503871 >> v2:172.21.15.179:3300/0 conn(0x7f7cd0159420 0x7f7cd00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.027+0000 7f7cd6d9c700 1 -- 172.21.15.154:0/2979503871 >> v2:172.21.15.179:3300/0 conn(0x7f7cd0159420 msgr2=0x7f7cd00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:04.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.027+0000 7f7cd6d9c700 1 --2- 172.21.15.154:0/2979503871 >> v2:172.21.15.179:3300/0 conn(0x7f7cd0159420 0x7f7cd00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.027+0000 7f7cd6d9c700 1 -- 172.21.15.154:0/2979503871 >> v1:172.21.15.179:6789/0 conn(0x7f7cd01597f0 legacy=0x7f7cd00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.027+0000 7f7cd6d9c700 1 -- 172.21.15.154:0/2979503871 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd00b14b0 con 0x7f7cd015d230 2023-10-10T21:15:04.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.027+0000 7f7cd6d9c700 1 --2- 172.21.15.154:0/2979503871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd015d670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009f20 tx=0x7f7cc8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d858f1898d529ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:04.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd5599700 1 -- 172.21.15.154:0/2979503871 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800e070 con 0x7f7cd015d230 2023-10-10T21:15:04.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd5599700 1 -- 172.21.15.154:0/2979503871 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc800b9d0 con 0x7f7cd015d230 2023-10-10T21:15:04.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd5599700 1 -- 172.21.15.154:0/2979503871 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80092e0 con 0x7f7cd015d230 2023-10-10T21:15:04.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd759d700 1 -- 172.21.15.154:0/2979503871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 msgr2=0x7f7cd015d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd759d700 1 --2- 172.21.15.154:0/2979503871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd015d670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009f20 tx=0x7f7cc8009840 comp rx=0 tx=0).stop 2023-10-10T21:15:04.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd759d700 1 -- 172.21.15.154:0/2979503871 shutdown_connections 2023-10-10T21:15:04.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd759d700 1 --2- 172.21.15.154:0/2979503871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd015d670 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd759d700 1 --2- 172.21.15.154:0/2979503871 >> v2:172.21.15.179:3300/0 conn(0x7f7cd0159420 0x7f7cd00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd759d700 1 -- 172.21.15.154:0/2979503871 >> 172.21.15.154:0/2979503871 conn(0x7f7cd00d0660 msgr2=0x7f7cd00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:04.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd759d700 1 -- 172.21.15.154:0/2979503871 shutdown_connections 2023-10-10T21:15:04.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.028+0000 7f7cd759d700 1 -- 172.21.15.154:0/2979503871 wait complete. 2023-10-10T21:15:04.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.030+0000 7f7cd759d700 1 Processor -- start 2023-10-10T21:15:04.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.030+0000 7f7cd759d700 1 -- start start 2023-10-10T21:15:04.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cd0159420 0x7f7cd00c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd759d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd01597f0 0x7f7cd015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd759d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd015bd40 con 0x7f7cd01597f0 2023-10-10T21:15:04.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd015cb60 con 0x7f7cd0159420 2023-10-10T21:15:04.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd0155460 con 0x7f7cd015d230 2023-10-10T21:15:04.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd5d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd01597f0 0x7f7cd015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd5d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd01597f0 0x7f7cd015b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58142/0 (socket says 172.21.15.154:58142) 2023-10-10T21:15:04.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd5d9a700 1 -- 172.21.15.154:0/727177831 learned_addr learned my addr 172.21.15.154:0/727177831 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:04.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd6d9c700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd659b700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cd0159420 0x7f7cd00c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd5d9a700 1 -- 172.21.15.154:0/727177831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 msgr2=0x7f7cd0154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd5d9a700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd0154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd5d9a700 1 -- 172.21.15.154:0/727177831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cd0159420 msgr2=0x7f7cd00c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.031+0000 7f7cd5d9a700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cd0159420 0x7f7cd00c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.032+0000 7f7cd5d9a700 1 -- 172.21.15.154:0/727177831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc8009ae0 con 0x7f7cd01597f0 2023-10-10T21:15:04.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.032+0000 7f7cd5d9a700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd01597f0 0x7f7cd015b800 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c7c0 tx=0x7f7cc0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:04.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.032+0000 7f7cc67fc700 1 -- 172.21.15.154:0/727177831 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0011590 con 0x7f7cd01597f0 2023-10-10T21:15:04.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.032+0000 7f7cc67fc700 1 -- 172.21.15.154:0/727177831 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00116f0 con 0x7f7cd01597f0 2023-10-10T21:15:04.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.032+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd015bf50 con 0x7f7cd01597f0 2023-10-10T21:15:04.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.032+0000 7f7cc67fc700 1 -- 172.21.15.154:0/727177831 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0011ab0 con 0x7f7cd01597f0 2023-10-10T21:15:04.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.032+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd015c510 con 0x7f7cd01597f0 2023-10-10T21:15:04.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.033+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd015ccf0 con 0x7f7cd01597f0 2023-10-10T21:15:04.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.034+0000 7f7cc67fc700 1 -- 172.21.15.154:0/727177831 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cc001b3b0 con 0x7f7cd01597f0 2023-10-10T21:15:04.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.035+0000 7f7cc67fc700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7cb4066f30 0x7f7cb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.035+0000 7f7cc67fc700 1 -- 172.21.15.154:0/727177831 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f7cc0083810 con 0x7f7cd01597f0 2023-10-10T21:15:04.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.035+0000 7f7cd659b700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7cb4066f30 0x7f7cb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.036+0000 7f7cd659b700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7cb4066f30 0x7f7cb40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009db0 tx=0x7f7ccc0091a0 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:04.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.039+0000 7f7cc67fc700 1 -- 172.21.15.154:0/727177831 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cc0050bc0 con 0x7f7cd01597f0 2023-10-10T21:15:04.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.237+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7cd004c3c0 con 0x7f7cd01597f0 2023-10-10T21:15:04.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.237+0000 7f7cc67fc700 1 -- 172.21.15.154:0/727177831 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7cc0017090 con 0x7f7cd01597f0 2023-10-10T21:15:04.239 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:04.240 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:15:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T21:15:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T21:15:04.240 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:04.241 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:15:04.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.239+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7cb4066f30 msgr2=0x7f7cb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.239+0000 7f7cd759d700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7cb4066f30 0x7f7cb40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009db0 tx=0x7f7ccc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.239+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd01597f0 msgr2=0x7f7cd015b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.239+0000 7f7cd759d700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd01597f0 0x7f7cd015b800 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c7c0 tx=0x7f7cc0007f50 comp rx=0 tx=0).stop 2023-10-10T21:15:04.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.240+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 shutdown_connections 2023-10-10T21:15:04.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.240+0000 7f7cd759d700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cd015d230 0x7f7cd0154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.240+0000 7f7cd759d700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7cb4066f30 0x7f7cb40693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.240+0000 7f7cd759d700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cd0159420 0x7f7cd00c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.240+0000 7f7cd759d700 1 --2- 172.21.15.154:0/727177831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd01597f0 0x7f7cd015b800 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.240+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 >> 172.21.15.154:0/727177831 conn(0x7f7cd00d0660 msgr2=0x7f7cd0155750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:04.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.240+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 shutdown_connections 2023-10-10T21:15:04.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.240+0000 7f7cd759d700 1 -- 172.21.15.154:0/727177831 wait complete. 2023-10-10T21:15:04.258 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T21:15:04.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T21:15:04.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.444+0000 7f40d259d700 1 Processor -- start 2023-10-10T21:15:04.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.445+0000 7f40d259d700 1 -- start start 2023-10-10T21:15:04.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.446+0000 7f40d259d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0c00 0x7f40cc0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.446+0000 7f40d259d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0b0570 con 0x7f40cc0b0760 2023-10-10T21:15:04.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.446+0000 7f40d259d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0af4d0 con 0x7f40cc156350 2023-10-10T21:15:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.446+0000 7f40d259d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0af7b0 con 0x7f40cc0b0c00 2023-10-10T21:15:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.446+0000 7f40d0d9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f40cc0b0760 0x7f40cc0ace60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53694/0 (socket says 172.21.15.154:53694) 2023-10-10T21:15:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.446+0000 7f40d0d9a700 1 -- 172.21.15.154:0/4233864837 learned_addr learned my addr 172.21.15.154:0/4233864837 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.447+0000 7f40d1d9c700 1 --2- 172.21.15.154:0/4233864837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0c00 0x7f40cc0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.447+0000 7f40c3fff700 1 -- 172.21.15.154:0/4233864837 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428309712 0 0) 0x7f40cc0b0570 con 0x7f40cc0b0760 2023-10-10T21:15:04.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.447+0000 7f40c3fff700 1 -- 172.21.15.154:0/4233864837 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b8003570 con 0x7f40cc0b0760 2023-10-10T21:15:04.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.447+0000 7f40c3fff700 1 -- 172.21.15.154:0/4233864837 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209324581 0 0) 0x7f40cc0af4d0 con 0x7f40cc156350 2023-10-10T21:15:04.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.447+0000 7f40c3fff700 1 -- 172.21.15.154:0/4233864837 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40cc0b0570 con 0x7f40cc156350 2023-10-10T21:15:04.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.447+0000 7f40d1d9c700 1 -- 172.21.15.154:0/4233864837 >> v1:172.21.15.179:6789/0 conn(0x7f40cc156350 legacy=0x7f40cc157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.447+0000 7f40d1d9c700 1 -- 172.21.15.154:0/4233864837 >> v1:172.21.15.154:6789/0 conn(0x7f40cc0b0760 legacy=0x7f40cc0ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.447+0000 7f40d1d9c700 1 -- 172.21.15.154:0/4233864837 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0afa90 con 0x7f40cc0b0c00 2023-10-10T21:15:04.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.447+0000 7f40d1d9c700 1 --2- 172.21.15.154:0/4233864837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0c00 0x7f40cc0ad570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009e90 tx=0x7f40c4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6595ca47040c3e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:04.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40c3fff700 1 -- 172.21.15.154:0/4233864837 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400e070 con 0x7f40cc0b0c00 2023-10-10T21:15:04.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40c3fff700 1 -- 172.21.15.154:0/4233864837 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c400bb80 con 0x7f40cc0b0c00 2023-10-10T21:15:04.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40c3fff700 1 -- 172.21.15.154:0/4233864837 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4012430 con 0x7f40cc0b0c00 2023-10-10T21:15:04.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40d259d700 1 -- 172.21.15.154:0/4233864837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0c00 msgr2=0x7f40cc0ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40d259d700 1 --2- 172.21.15.154:0/4233864837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0c00 0x7f40cc0ad570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009e90 tx=0x7f40c4009780 comp rx=0 tx=0).stop 2023-10-10T21:15:04.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40d259d700 1 -- 172.21.15.154:0/4233864837 shutdown_connections 2023-10-10T21:15:04.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40d259d700 1 --2- 172.21.15.154:0/4233864837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0c00 0x7f40cc0ad570 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40d259d700 1 -- 172.21.15.154:0/4233864837 >> 172.21.15.154:0/4233864837 conn(0x7f40cc068e20 msgr2=0x7f40cc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:04.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40d259d700 1 -- 172.21.15.154:0/4233864837 shutdown_connections 2023-10-10T21:15:04.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.448+0000 7f40d259d700 1 -- 172.21.15.154:0/4233864837 wait complete. 2023-10-10T21:15:04.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.450+0000 7f40d259d700 1 Processor -- start 2023-10-10T21:15:04.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.450+0000 7f40d259d700 1 -- start start 2023-10-10T21:15:04.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d259d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0760 0x7f40cc13e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d259d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40cc0b0c00 0x7f40cc15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d259d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc156350 0x7f40cc159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d259d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc13eac0 con 0x7f40cc156350 2023-10-10T21:15:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d259d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15afb0 con 0x7f40cc0b0c00 2023-10-10T21:15:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d259d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15bdc0 con 0x7f40cc0b0760 2023-10-10T21:15:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d1d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc156350 0x7f40cc159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d1d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc156350 0x7f40cc159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58146/0 (socket says 172.21.15.154:58146) 2023-10-10T21:15:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d1d9c700 1 -- 172.21.15.154:0/2629256513 learned_addr learned my addr 172.21.15.154:0/2629256513 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d159b700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0760 0x7f40cc13e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d0d9a700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40cc0b0c00 0x7f40cc15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d1d9c700 1 -- 172.21.15.154:0/2629256513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0760 msgr2=0x7f40cc13e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d1d9c700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0760 0x7f40cc13e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d1d9c700 1 -- 172.21.15.154:0/2629256513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40cc0b0c00 msgr2=0x7f40cc15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.451+0000 7f40d1d9c700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40cc0b0c00 0x7f40cc15aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.452+0000 7f40d1d9c700 1 -- 172.21.15.154:0/2629256513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4009a20 con 0x7f40cc156350 2023-10-10T21:15:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.452+0000 7f40d159b700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0760 0x7f40cc13e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.452+0000 7f40d1d9c700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc156350 0x7f40cc159a10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0714a0 tx=0x7f40c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.452+0000 7f40c17fa700 1 -- 172.21.15.154:0/2629256513 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4012e00 con 0x7f40cc156350 2023-10-10T21:15:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.452+0000 7f40c17fa700 1 -- 172.21.15.154:0/2629256513 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c401b630 con 0x7f40cc156350 2023-10-10T21:15:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.452+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc15b1b0 con 0x7f40cc156350 2023-10-10T21:15:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.452+0000 7f40c17fa700 1 -- 172.21.15.154:0/2629256513 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c401b9f0 con 0x7f40cc156350 2023-10-10T21:15:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.452+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc15b770 con 0x7f40cc156350 2023-10-10T21:15:04.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.453+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc04c3c0 con 0x7f40cc156350 2023-10-10T21:15:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.454+0000 7f40c17fa700 1 -- 172.21.15.154:0/2629256513 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40c401c400 con 0x7f40cc156350 2023-10-10T21:15:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.455+0000 7f40c17fa700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40b0066f30 0x7f40b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.455+0000 7f40c17fa700 1 -- 172.21.15.154:0/2629256513 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f40c40861e0 con 0x7f40cc156350 2023-10-10T21:15:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.455+0000 7f40d159b700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40b0066f30 0x7f40b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.455+0000 7f40d159b700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40b0066f30 0x7f40b00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40c8003990 tx=0x7f40c8009040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.459+0000 7f40c17fa700 1 -- 172.21.15.154:0/2629256513 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40c4053590 con 0x7f40cc156350 2023-10-10T21:15:04.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:04.653+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f40cc0afd70 con 0x7f40cc156350 2023-10-10T21:15:05.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.061+0000 7f40c17fa700 1 -- 172.21.15.154:0/2629256513 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) v1 ==== 138+0+0 (secure 0 0 0) 0x7f40c4056bb0 con 0x7f40cc156350 2023-10-10T21:15:05.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.066+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40b0066f30 msgr2=0x7f40b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:05.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.066+0000 7f40d259d700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40b0066f30 0x7f40b00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40c8003990 tx=0x7f40c8009040 comp rx=0 tx=0).stop 2023-10-10T21:15:05.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.066+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc156350 msgr2=0x7f40cc159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:05.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.066+0000 7f40d259d700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc156350 0x7f40cc159a10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0714a0 tx=0x7f40c4019000 comp rx=0 tx=0).stop 2023-10-10T21:15:05.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.067+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 shutdown_connections 2023-10-10T21:15:05.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.067+0000 7f40d259d700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc156350 0x7f40cc159a10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:05.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.067+0000 7f40d259d700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40cc0b0760 0x7f40cc13e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:05.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.067+0000 7f40d259d700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40b0066f30 0x7f40b00693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:05.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.067+0000 7f40d259d700 1 --2- 172.21.15.154:0/2629256513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40cc0b0c00 0x7f40cc15aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:05.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.067+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 >> 172.21.15.154:0/2629256513 conn(0x7f40cc068e20 msgr2=0x7f40cc156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:05.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.068+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 shutdown_connections 2023-10-10T21:15:05.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.068+0000 7f40d259d700 1 -- 172.21.15.154:0/2629256513 wait complete. 2023-10-10T21:15:05.071 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T21:15:05.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T21:15:05.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.279+0000 7f5b82f9d700 1 Processor -- start 2023-10-10T21:15:05.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.279+0000 7f5b82f9d700 1 -- start start 2023-10-10T21:15:05.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.280+0000 7f5b82f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 0x7f5b7c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:05.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.280+0000 7f5b82f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b7c15d930 0x7f5b7c0b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:05.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.280+0000 7f5b82f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0b10f0 con 0x7f5b7c0cf480 2023-10-10T21:15:05.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.280+0000 7f5b82f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0cd530 con 0x7f5b7c15d930 2023-10-10T21:15:05.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.280+0000 7f5b82f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c15e000 con 0x7f5b7c1595d0 2023-10-10T21:15:05.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.280+0000 7f5b8279c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b7c15d930 0x7f5b7c0b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:05.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b8279c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b7c15d930 0x7f5b7c0b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58156/0 (socket says 172.21.15.154:58156) 2023-10-10T21:15:05.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b8279c700 1 -- 172.21.15.154:0/2567172487 learned_addr learned my addr 172.21.15.154:0/2567172487 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:05.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b81f9b700 1 --2- 172.21.15.154:0/2567172487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 0x7f5b7c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:05.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b8279c700 1 -- 172.21.15.154:0/2567172487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 msgr2=0x7f5b7c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:05.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b8279c700 1 --2- 172.21.15.154:0/2567172487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 0x7f5b7c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:05.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b8279c700 1 -- 172.21.15.154:0/2567172487 >> v1:172.21.15.179:6789/0 conn(0x7f5b7c0cf480 legacy=0x7f5b7c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:05.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b8279c700 1 -- 172.21.15.154:0/2567172487 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0cf990 con 0x7f5b7c15d930 2023-10-10T21:15:05.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b8279c700 1 --2- 172.21.15.154:0/2567172487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 0x7f5b7c0b1580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009f20 tx=0x7f5b74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efebf299176840f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:05.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b80f99700 1 -- 172.21.15.154:0/2567172487 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400e070 con 0x7f5b7c15d930 2023-10-10T21:15:05.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.281+0000 7f5b80f99700 1 -- 172.21.15.154:0/2567172487 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7400b9d0 con 0x7f5b7c15d930 2023-10-10T21:15:05.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.282+0000 7f5b80f99700 1 -- 172.21.15.154:0/2567172487 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740092e0 con 0x7f5b7c15d930 2023-10-10T21:15:05.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.282+0000 7f5b82f9d700 1 -- 172.21.15.154:0/2567172487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 msgr2=0x7f5b7c0b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:05.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.282+0000 7f5b82f9d700 1 --2- 172.21.15.154:0/2567172487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 0x7f5b7c0b1580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009f20 tx=0x7f5b74009840 comp rx=0 tx=0).stop 2023-10-10T21:15:05.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.282+0000 7f5b82f9d700 1 -- 172.21.15.154:0/2567172487 shutdown_connections 2023-10-10T21:15:05.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.282+0000 7f5b82f9d700 1 --2- 172.21.15.154:0/2567172487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 0x7f5b7c0b1580 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:05.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.282+0000 7f5b82f9d700 1 --2- 172.21.15.154:0/2567172487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 0x7f5b7c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:05.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.282+0000 7f5b82f9d700 1 -- 172.21.15.154:0/2567172487 >> 172.21.15.154:0/2567172487 conn(0x7f5b7c0d05f0 msgr2=0x7f5b7c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:05.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.282+0000 7f5b82f9d700 1 -- 172.21.15.154:0/2567172487 shutdown_connections 2023-10-10T21:15:05.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.282+0000 7f5b82f9d700 1 -- 172.21.15.154:0/2567172487 wait complete. 2023-10-10T21:15:05.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.284+0000 7f5b82f9d700 1 Processor -- start 2023-10-10T21:15:05.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.284+0000 7f5b82f9d700 1 -- start start 2023-10-10T21:15:05.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b82f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b7c0cf480 0x7f5b7c16a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:05.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b82f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 0x7f5b7c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:05.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b82f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 0x7f5b7c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:05.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b82f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c154830 con 0x7f5b7c15d930 2023-10-10T21:15:05.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b82f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c153c20 con 0x7f5b7c0cf480 2023-10-10T21:15:05.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b82f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c153f00 con 0x7f5b7c1595d0 2023-10-10T21:15:05.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8279c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 0x7f5b7c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:05.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8279c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 0x7f5b7c0cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58166/0 (socket says 172.21.15.154:58166) 2023-10-10T21:15:05.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8279c700 1 -- 172.21.15.154:0/1794823703 learned_addr learned my addr 172.21.15.154:0/1794823703 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:05.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b81f9b700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b7c0cf480 0x7f5b7c16a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:05.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8179a700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 0x7f5b7c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:05.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8279c700 1 -- 172.21.15.154:0/1794823703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 msgr2=0x7f5b7c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:05.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8279c700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 0x7f5b7c153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:05.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8279c700 1 -- 172.21.15.154:0/1794823703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b7c0cf480 msgr2=0x7f5b7c16a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:05.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8279c700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b7c0cf480 0x7f5b7c16a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:05.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8279c700 1 -- 172.21.15.154:0/1794823703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009ae0 con 0x7f5b7c15d930 2023-10-10T21:15:05.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b81f9b700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b7c0cf480 0x7f5b7c16a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:05.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.285+0000 7f5b8279c700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 0x7f5b7c0cc6d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0895f0 tx=0x7f5b74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:05.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.286+0000 7f5b71ffb700 1 -- 172.21.15.154:0/1794823703 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74008c30 con 0x7f5b7c15d930 2023-10-10T21:15:05.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.286+0000 7f5b71ffb700 1 -- 172.21.15.154:0/1794823703 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74008d90 con 0x7f5b7c15d930 2023-10-10T21:15:05.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.286+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c1541e0 con 0x7f5b7c15d930 2023-10-10T21:15:05.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.286+0000 7f5b71ffb700 1 -- 172.21.15.154:0/1794823703 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740256b0 con 0x7f5b7c15d930 2023-10-10T21:15:05.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.286+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c0ccc10 con 0x7f5b7c15d930 2023-10-10T21:15:05.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.287+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c1549e0 con 0x7f5b7c15d930 2023-10-10T21:15:05.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.289+0000 7f5b71ffb700 1 -- 172.21.15.154:0/1794823703 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b74003040 con 0x7f5b7c15d930 2023-10-10T21:15:05.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.289+0000 7f5b71ffb700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5b60066f30 0x7f5b600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:05.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.290+0000 7f5b71ffb700 1 -- 172.21.15.154:0/1794823703 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5587+0+0 (secure 0 0 0) 0x7f5b74086380 con 0x7f5b7c15d930 2023-10-10T21:15:05.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.290+0000 7f5b81f9b700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5b60066f30 0x7f5b600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:05.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.290+0000 7f5b81f9b700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5b60066f30 0x7f5b600693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009d70 tx=0x7f5b78008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:05.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.294+0000 7f5b71ffb700 1 -- 172.21.15.154:0/1794823703 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b74053660 con 0x7f5b7c15d930 2023-10-10T21:15:05.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:05.489+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5b7c04c3c0 con 0x7f5b7c15d930 2023-10-10T21:15:06.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.067+0000 7f5b71ffb700 1 -- 172.21.15.154:0/1794823703 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5b74056c80 con 0x7f5b7c15d930 2023-10-10T21:15:06.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.080+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5b60066f30 msgr2=0x7f5b600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:06.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.080+0000 7f5b82f9d700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5b60066f30 0x7f5b600693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009d70 tx=0x7f5b78008040 comp rx=0 tx=0).stop 2023-10-10T21:15:06.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.080+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 msgr2=0x7f5b7c0cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.080+0000 7f5b82f9d700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 0x7f5b7c0cc6d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0895f0 tx=0x7f5b74018000 comp rx=0 tx=0).stop 2023-10-10T21:15:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.082+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 shutdown_connections 2023-10-10T21:15:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.082+0000 7f5b82f9d700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b7c15d930 0x7f5b7c0cc6d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.082+0000 7f5b82f9d700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5b60066f30 0x7f5b600693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.082+0000 7f5b82f9d700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b7c0cf480 0x7f5b7c16a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.082+0000 7f5b82f9d700 1 --2- 172.21.15.154:0/1794823703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b7c1595d0 0x7f5b7c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.082+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 >> 172.21.15.154:0/1794823703 conn(0x7f5b7c0d05f0 msgr2=0x7f5b7c15a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:06.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.083+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 shutdown_connections 2023-10-10T21:15:06.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.083+0000 7f5b82f9d700 1 -- 172.21.15.154:0/1794823703 wait complete. 2023-10-10T21:15:06.088 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T21:15:06.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T21:15:06.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.294+0000 7f902b59e700 1 Processor -- start 2023-10-10T21:15:06.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.295+0000 7f902b59e700 1 -- start start 2023-10-10T21:15:06.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.296+0000 7f902b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f902c0cb1a0 0x7f902c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:06.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.296+0000 7f902b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 0x7f902c0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:06.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.296+0000 7f902b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902c06ebd0 con 0x7f902c15a8a0 2023-10-10T21:15:06.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.296+0000 7f902b59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c15b2e0 con 0x7f902c0cb1a0 2023-10-10T21:15:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.296+0000 7f902b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0aea30 con 0x7f902c0ae0d0 2023-10-10T21:15:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.296+0000 7f902a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f902c0cb1a0 0x7f902c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.296+0000 7f902a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f902c0cb1a0 0x7f902c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39292/0 (socket says 172.21.15.154:39292) 2023-10-10T21:15:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.296+0000 7f902a59c700 1 -- 172.21.15.154:0/2094819882 learned_addr learned my addr 172.21.15.154:0/2094819882 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.296+0000 7f902ad9d700 1 --2- 172.21.15.154:0/2094819882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 0x7f902c0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:06.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.297+0000 7f902a59c700 1 -- 172.21.15.154:0/2094819882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 msgr2=0x7f902c0ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:06.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.297+0000 7f902a59c700 1 --2- 172.21.15.154:0/2094819882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 0x7f902c0ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.297+0000 7f902a59c700 1 -- 172.21.15.154:0/2094819882 >> v1:172.21.15.179:6789/0 conn(0x7f902c15a8a0 legacy=0x7f902c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:06.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.297+0000 7f902a59c700 1 -- 172.21.15.154:0/2094819882 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c15ad20 con 0x7f902c0cb1a0 2023-10-10T21:15:06.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.297+0000 7f902ad9d700 1 --2- 172.21.15.154:0/2094819882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 0x7f902c0ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:06.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.297+0000 7f902a59c700 1 --2- 172.21.15.154:0/2094819882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0cb1a0 0x7f902c15a360 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f901c00bc50 tx=0x7f901c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c074dc356e7a1c38 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:06.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.297+0000 7f902959a700 1 -- 172.21.15.154:0/2094819882 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00de90 con 0x7f902c0cb1a0 2023-10-10T21:15:06.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.297+0000 7f902959a700 1 -- 172.21.15.154:0/2094819882 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c00be60 con 0x7f902c0cb1a0 2023-10-10T21:15:06.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.297+0000 7f902959a700 1 -- 172.21.15.154:0/2094819882 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c0196b0 con 0x7f902c0cb1a0 2023-10-10T21:15:06.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.298+0000 7f902b59e700 1 -- 172.21.15.154:0/2094819882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0cb1a0 msgr2=0x7f902c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.298+0000 7f902b59e700 1 --2- 172.21.15.154:0/2094819882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0cb1a0 0x7f902c15a360 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f901c00bc50 tx=0x7f901c00b4f0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.298+0000 7f902b59e700 1 -- 172.21.15.154:0/2094819882 shutdown_connections 2023-10-10T21:15:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.298+0000 7f902b59e700 1 --2- 172.21.15.154:0/2094819882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 0x7f902c0ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.298+0000 7f902b59e700 1 --2- 172.21.15.154:0/2094819882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c0cb1a0 0x7f902c15a360 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.298+0000 7f902b59e700 1 -- 172.21.15.154:0/2094819882 >> 172.21.15.154:0/2094819882 conn(0x7f902c0cc1e0 msgr2=0x7f902c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:06.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.298+0000 7f902b59e700 1 -- 172.21.15.154:0/2094819882 shutdown_connections 2023-10-10T21:15:06.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.298+0000 7f902b59e700 1 -- 172.21.15.154:0/2094819882 wait complete. 2023-10-10T21:15:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.299+0000 7f902b59e700 1 Processor -- start 2023-10-10T21:15:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.299+0000 7f902b59e700 1 -- start start 2023-10-10T21:15:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.300+0000 7f902b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 0x7f902c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.300+0000 7f902b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0cb1a0 0x7f902c16b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.300+0000 7f902b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c16d5d0 0x7f902c16da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.300+0000 7f902b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c16df90 con 0x7f902c16d5d0 2023-10-10T21:15:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.300+0000 7f902b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c158a70 con 0x7f902c0cb1a0 2023-10-10T21:15:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.300+0000 7f902b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c16b6e0 con 0x7f902c0ae0d0 2023-10-10T21:15:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.300+0000 7f902ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c16d5d0 0x7f902c16da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.300+0000 7f902ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c16d5d0 0x7f902c16da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39300/0 (socket says 172.21.15.154:39300) 2023-10-10T21:15:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f902ad9d700 1 -- 172.21.15.154:0/1218724769 learned_addr learned my addr 172.21.15.154:0/1218724769 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f9029d9b700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0cb1a0 0x7f902c16b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f902a59c700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 0x7f902c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f902ad9d700 1 -- 172.21.15.154:0/1218724769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 msgr2=0x7f902c156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f902ad9d700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 0x7f902c156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f902ad9d700 1 -- 172.21.15.154:0/1218724769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0cb1a0 msgr2=0x7f902c16b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f902ad9d700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0cb1a0 0x7f902c16b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f902ad9d700 1 -- 172.21.15.154:0/1218724769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c00b790 con 0x7f902c16d5d0 2023-10-10T21:15:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f902ad9d700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c16d5d0 0x7f902c16da50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f902400d1b0 tx=0x7f9024009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f901a7fc700 1 -- 172.21.15.154:0/1218724769 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400dcf0 con 0x7f902c16d5d0 2023-10-10T21:15:06.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f901a7fc700 1 -- 172.21.15.154:0/1218724769 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902400f040 con 0x7f902c16d5d0 2023-10-10T21:15:06.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f901a7fc700 1 -- 172.21.15.154:0/1218724769 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024015690 con 0x7f902c16d5d0 2023-10-10T21:15:06.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.301+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c0b1a40 con 0x7f902c16d5d0 2023-10-10T21:15:06.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.302+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c158f80 con 0x7f902c16d5d0 2023-10-10T21:15:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.302+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c06c450 con 0x7f902c16d5d0 2023-10-10T21:15:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.304+0000 7f901a7fc700 1 -- 172.21.15.154:0/1218724769 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f902401e3b0 con 0x7f902c16d5d0 2023-10-10T21:15:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.305+0000 7f901a7fc700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f900c066f30 0x7f900c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.305+0000 7f901a7fc700 1 -- 172.21.15.154:0/1218724769 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f9024084b30 con 0x7f902c16d5d0 2023-10-10T21:15:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.305+0000 7f902a59c700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f900c066f30 0x7f900c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:06.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.306+0000 7f902a59c700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f900c066f30 0x7f900c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f901c00bc50 tx=0x7f901c01b000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:06.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.309+0000 7f901a7fc700 1 -- 172.21.15.154:0/1218724769 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9024051bf0 con 0x7f902c16d5d0 2023-10-10T21:15:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:06.543+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f902c04bb80 con 0x7f902c16d5d0 2023-10-10T21:15:07.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.094+0000 7f901a7fc700 1 -- 172.21.15.154:0/1218724769 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 172+0+0 (secure 0 0 0) 0x7f902401a0c0 con 0x7f902c16d5d0 2023-10-10T21:15:07.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.098+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f900c066f30 msgr2=0x7f900c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.098+0000 7f902b59e700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f900c066f30 0x7f900c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f901c00bc50 tx=0x7f901c01b000 comp rx=0 tx=0).stop 2023-10-10T21:15:07.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.098+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c16d5d0 msgr2=0x7f902c16da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.098+0000 7f902b59e700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c16d5d0 0x7f902c16da50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f902400d1b0 tx=0x7f9024009a50 comp rx=0 tx=0).stop 2023-10-10T21:15:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.103+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 shutdown_connections 2023-10-10T21:15:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.103+0000 7f902b59e700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f902c16d5d0 0x7f902c16da50 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.103+0000 7f902b59e700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c0ae0d0 0x7f902c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.103+0000 7f902b59e700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f900c066f30 0x7f900c0693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.103+0000 7f902b59e700 1 --2- 172.21.15.154:0/1218724769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0cb1a0 0x7f902c16b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.103+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 >> 172.21.15.154:0/1218724769 conn(0x7f902c0cc1e0 msgr2=0x7f902c0c7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:07.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.106+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 shutdown_connections 2023-10-10T21:15:07.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.106+0000 7f902b59e700 1 -- 172.21.15.154:0/1218724769 wait complete. 2023-10-10T21:15:07.110 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 6 and data pool 7 2023-10-10T21:15:07.133 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:15:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.315+0000 7f4f6659d700 1 Processor -- start 2023-10-10T21:15:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.315+0000 7f4f6659d700 1 -- start start 2023-10-10T21:15:07.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.316+0000 7f4f6659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f60156310 0x7f4f600c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.316+0000 7f4f6659d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f601566e0 0x7f4f600ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.316+0000 7f4f6659d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600ca860 con 0x7f4f600ca300 2023-10-10T21:15:07.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.316+0000 7f4f6659d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f600cab40 con 0x7f4f601566e0 2023-10-10T21:15:07.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.316+0000 7f4f6659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600cae20 con 0x7f4f60156310 2023-10-10T21:15:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.316+0000 7f4f64d9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f601566e0 0x7f4f600ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.317+0000 7f4f64d9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f601566e0 0x7f4f600ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39302/0 (socket says 172.21.15.154:39302) 2023-10-10T21:15:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.317+0000 7f4f64d9a700 1 -- 172.21.15.154:0/2323969718 learned_addr learned my addr 172.21.15.154:0/2323969718 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.317+0000 7f4f6559b700 1 --2- 172.21.15.154:0/2323969718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f60156310 0x7f4f600c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.317+0000 7f4f64d9a700 1 -- 172.21.15.154:0/2323969718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f60156310 msgr2=0x7f4f600c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.317+0000 7f4f64d9a700 1 --2- 172.21.15.154:0/2323969718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f60156310 0x7f4f600c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.317+0000 7f4f64d9a700 1 -- 172.21.15.154:0/2323969718 >> v1:172.21.15.179:6789/0 conn(0x7f4f600ca300 legacy=0x7f4f600c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.317+0000 7f4f64d9a700 1 -- 172.21.15.154:0/2323969718 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f600cb100 con 0x7f4f601566e0 2023-10-10T21:15:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.317+0000 7f4f64d9a700 1 --2- 172.21.15.154:0/2323969718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 0x7f4f600ae000 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4f500099b0 tx=0x7f4f50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db55bb4ec5a5034f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.317+0000 7f4f57fff700 1 -- 172.21.15.154:0/2323969718 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000b860 con 0x7f4f601566e0 2023-10-10T21:15:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f57fff700 1 -- 172.21.15.154:0/2323969718 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5000b9c0 con 0x7f4f601566e0 2023-10-10T21:15:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f57fff700 1 -- 172.21.15.154:0/2323969718 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000bd60 con 0x7f4f601566e0 2023-10-10T21:15:07.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f6659d700 1 -- 172.21.15.154:0/2323969718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 msgr2=0x7f4f600ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f6659d700 1 --2- 172.21.15.154:0/2323969718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 0x7f4f600ae000 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4f500099b0 tx=0x7f4f50009250 comp rx=0 tx=0).stop 2023-10-10T21:15:07.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f6659d700 1 -- 172.21.15.154:0/2323969718 shutdown_connections 2023-10-10T21:15:07.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f6659d700 1 --2- 172.21.15.154:0/2323969718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f60156310 0x7f4f600c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f6659d700 1 --2- 172.21.15.154:0/2323969718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 0x7f4f600ae000 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f6659d700 1 -- 172.21.15.154:0/2323969718 >> 172.21.15.154:0/2323969718 conn(0x7f4f600cc1f0 msgr2=0x7f4f600cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:07.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f6659d700 1 -- 172.21.15.154:0/2323969718 shutdown_connections 2023-10-10T21:15:07.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.318+0000 7f4f6659d700 1 -- 172.21.15.154:0/2323969718 wait complete. 2023-10-10T21:15:07.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.320+0000 7f4f6659d700 1 Processor -- start 2023-10-10T21:15:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.320+0000 7f4f6659d700 1 -- start start 2023-10-10T21:15:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f6659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f600ca300 0x7f4f6016ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f6659d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f60156310 0x7f4f600b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f6659d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 0x7f4f60069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f6659d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600af030 con 0x7f4f601566e0 2023-10-10T21:15:07.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f6659d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600af2d0 con 0x7f4f60156310 2023-10-10T21:15:07.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f6659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600af5b0 con 0x7f4f600ca300 2023-10-10T21:15:07.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f65d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 0x7f4f60069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f65d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 0x7f4f60069c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39318/0 (socket says 172.21.15.154:39318) 2023-10-10T21:15:07.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f65d9c700 1 -- 172.21.15.154:0/492271904 learned_addr learned my addr 172.21.15.154:0/492271904 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:07.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f64d9a700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f60156310 0x7f4f600b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f6559b700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f600ca300 0x7f4f6016ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f65d9c700 1 -- 172.21.15.154:0/492271904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f600ca300 msgr2=0x7f4f6016ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f65d9c700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f600ca300 0x7f4f6016ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f65d9c700 1 -- 172.21.15.154:0/492271904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f60156310 msgr2=0x7f4f600b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f65d9c700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f60156310 0x7f4f600b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.321+0000 7f4f65d9c700 1 -- 172.21.15.154:0/492271904 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f500094f0 con 0x7f4f601566e0 2023-10-10T21:15:07.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.322+0000 7f4f65d9c700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 0x7f4f60069c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800c840 tx=0x7f4f58001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:07.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.322+0000 7f4f557fa700 1 -- 172.21.15.154:0/492271904 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58012630 con 0x7f4f601566e0 2023-10-10T21:15:07.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.322+0000 7f4f557fa700 1 -- 172.21.15.154:0/492271904 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f580127b0 con 0x7f4f601566e0 2023-10-10T21:15:07.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.322+0000 7f4f557fa700 1 -- 172.21.15.154:0/492271904 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58012b70 con 0x7f4f601566e0 2023-10-10T21:15:07.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.322+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f600af890 con 0x7f4f601566e0 2023-10-10T21:15:07.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.322+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6016b270 con 0x7f4f601566e0 2023-10-10T21:15:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.323+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f600afab0 con 0x7f4f601566e0 2023-10-10T21:15:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.324+0000 7f4f557fa700 1 -- 172.21.15.154:0/492271904 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f58003030 con 0x7f4f601566e0 2023-10-10T21:15:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.325+0000 7f4f557fa700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4f44066f30 0x7f4f440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.325+0000 7f4f557fa700 1 -- 172.21.15.154:0/492271904 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4f58084660 con 0x7f4f601566e0 2023-10-10T21:15:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.325+0000 7f4f6559b700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4f44066f30 0x7f4f440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.326+0000 7f4f6559b700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4f44066f30 0x7f4f440693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c006fd0 tx=0x7f4f5c008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.329+0000 7f4f557fa700 1 -- 172.21.15.154:0/492271904 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f58051760 con 0x7f4f601566e0 2023-10-10T21:15:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.519+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f6004c3c0 con 0x7f4f601566e0 2023-10-10T21:15:07.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.520+0000 7f4f557fa700 1 -- 172.21.15.154:0/492271904 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15962 (secure 0 0 0) 0x7f4f58054d80 con 0x7f4f601566e0 2023-10-10T21:15:07.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:07.521 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":63,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:15:06.545056+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:15:04.691966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-10T21:15:05.529376+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:15:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4f44066f30 msgr2=0x7f4f440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4f44066f30 0x7f4f440693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c006fd0 tx=0x7f4f5c008040 comp rx=0 tx=0).stop 2023-10-10T21:15:07.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 msgr2=0x7f4f60069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 0x7f4f60069c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800c840 tx=0x7f4f58001670 comp rx=0 tx=0).stop 2023-10-10T21:15:07.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 shutdown_connections 2023-10-10T21:15:07.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f601566e0 0x7f4f60069c20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f600ca300 0x7f4f6016ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4f44066f30 0x7f4f440693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 --2- 172.21.15.154:0/492271904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f60156310 0x7f4f600b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 >> 172.21.15.154:0/492271904 conn(0x7f4f600cc1f0 msgr2=0x7f4f6014e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:07.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 shutdown_connections 2023-10-10T21:15:07.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.522+0000 7f4f6659d700 1 -- 172.21.15.154:0/492271904 wait complete. 2023-10-10T21:15:07.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:15:07.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.722+0000 7f5216fff700 1 Processor -- start 2023-10-10T21:15:07.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.722+0000 7f5216fff700 1 -- start start 2023-10-10T21:15:07.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.723+0000 7f5216fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f521006c0a0 0x7f52100caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.723+0000 7f5216fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f521015df50 0x7f521015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.723+0000 7f5216fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521015d7e0 con 0x7f521006bcd0 2023-10-10T21:15:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.723+0000 7f5216fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521015dac0 con 0x7f521006c0a0 2023-10-10T21:15:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.723+0000 7f5216fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521015aa30 con 0x7f521015df50 2023-10-10T21:15:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.724+0000 7f520ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f521006c0a0 0x7f52100caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.724+0000 7f520ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f521006c0a0 0x7f52100caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39328/0 (socket says 172.21.15.154:39328) 2023-10-10T21:15:07.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.724+0000 7f520ffff700 1 -- 172.21.15.154:0/1615498060 learned_addr learned my addr 172.21.15.154:0/1615498060 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:07.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.724+0000 7f521559c700 1 --2- 172.21.15.154:0/1615498060 >> v2:172.21.15.179:3300/0 conn(0x7f521015df50 0x7f521015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.724+0000 7f520ffff700 1 -- 172.21.15.154:0/1615498060 >> v2:172.21.15.179:3300/0 conn(0x7f521015df50 msgr2=0x7f521015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:07.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.724+0000 7f520ffff700 1 --2- 172.21.15.154:0/1615498060 >> v2:172.21.15.179:3300/0 conn(0x7f521015df50 0x7f521015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.724+0000 7f520ffff700 1 -- 172.21.15.154:0/1615498060 >> v1:172.21.15.179:6789/0 conn(0x7f521006bcd0 legacy=0x7f521015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.724+0000 7f520ffff700 1 -- 172.21.15.154:0/1615498060 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521015ad10 con 0x7f521006c0a0 2023-10-10T21:15:07.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.724+0000 7f520ffff700 1 --2- 172.21.15.154:0/1615498060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 0x7f52100caa90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f521015d720 tx=0x7f51fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19ddc9dff8a593c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:07.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f520f7fe700 1 -- 172.21.15.154:0/1615498060 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc009e70 con 0x7f521006c0a0 2023-10-10T21:15:07.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f520f7fe700 1 -- 172.21.15.154:0/1615498060 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc00b860 con 0x7f521006c0a0 2023-10-10T21:15:07.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f520f7fe700 1 -- 172.21.15.154:0/1615498060 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00bc20 con 0x7f521006c0a0 2023-10-10T21:15:07.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f5216fff700 1 -- 172.21.15.154:0/1615498060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 msgr2=0x7f52100caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f5216fff700 1 --2- 172.21.15.154:0/1615498060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 0x7f52100caa90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f521015d720 tx=0x7f51fc009250 comp rx=0 tx=0).stop 2023-10-10T21:15:07.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f5216fff700 1 -- 172.21.15.154:0/1615498060 shutdown_connections 2023-10-10T21:15:07.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f5216fff700 1 --2- 172.21.15.154:0/1615498060 >> v2:172.21.15.179:3300/0 conn(0x7f521015df50 0x7f521015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f5216fff700 1 --2- 172.21.15.154:0/1615498060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 0x7f52100caa90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f5216fff700 1 -- 172.21.15.154:0/1615498060 >> 172.21.15.154:0/1615498060 conn(0x7f52100ce600 msgr2=0x7f52100cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:07.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f5216fff700 1 -- 172.21.15.154:0/1615498060 shutdown_connections 2023-10-10T21:15:07.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.725+0000 7f5216fff700 1 -- 172.21.15.154:0/1615498060 wait complete. 2023-10-10T21:15:07.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.727+0000 7f5216fff700 1 Processor -- start 2023-10-10T21:15:07.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.727+0000 7f5216fff700 1 -- start start 2023-10-10T21:15:07.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f5216fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521006bcd0 0x7f52100b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f5216fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 0x7f5210169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f5216fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521015df50 0x7f52100c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f5216fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52100b0580 con 0x7f521006c0a0 2023-10-10T21:15:07.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f5216fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52100b24d0 con 0x7f521006bcd0 2023-10-10T21:15:07.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f5216fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52100b3330 con 0x7f521015df50 2023-10-10T21:15:07.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f520ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 0x7f5210169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f520ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 0x7f5210169d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39332/0 (socket says 172.21.15.154:39332) 2023-10-10T21:15:07.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f520ffff700 1 -- 172.21.15.154:0/3956768406 learned_addr learned my addr 172.21.15.154:0/3956768406 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:07.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f5214d9b700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521006bcd0 0x7f52100b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f521559c700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521015df50 0x7f52100c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f520ffff700 1 -- 172.21.15.154:0/3956768406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521015df50 msgr2=0x7f52100c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f520ffff700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521015df50 0x7f52100c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f520ffff700 1 -- 172.21.15.154:0/3956768406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521006bcd0 msgr2=0x7f52100b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f520ffff700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521006bcd0 0x7f52100b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f520ffff700 1 -- 172.21.15.154:0/3956768406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc0094f0 con 0x7f521006c0a0 2023-10-10T21:15:07.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.728+0000 7f5214d9b700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521006bcd0 0x7f52100b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:07.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.729+0000 7f520ffff700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 0x7f5210169d60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f51fc006fd0 tx=0x7f51fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:07.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.729+0000 7f520cff9700 1 -- 172.21.15.154:0/3956768406 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc01f070 con 0x7f521006c0a0 2023-10-10T21:15:07.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.729+0000 7f520cff9700 1 -- 172.21.15.154:0/3956768406 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc000bc0 con 0x7f521006c0a0 2023-10-10T21:15:07.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.729+0000 7f520cff9700 1 -- 172.21.15.154:0/3956768406 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00bc20 con 0x7f521006c0a0 2023-10-10T21:15:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.729+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52100b2720 con 0x7f521006c0a0 2023-10-10T21:15:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.729+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52100b2ce0 con 0x7f521006c0a0 2023-10-10T21:15:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.730+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521004c3c0 con 0x7f521006c0a0 2023-10-10T21:15:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.731+0000 7f520cff9700 1 -- 172.21.15.154:0/3956768406 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51fc023070 con 0x7f521006c0a0 2023-10-10T21:15:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.732+0000 7f520cff9700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f51f4066f30 0x7f51f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.732+0000 7f520cff9700 1 -- 172.21.15.154:0/3956768406 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f51fc0859e0 con 0x7f521006c0a0 2023-10-10T21:15:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.732+0000 7f5214d9b700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f51f4066f30 0x7f51f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.733+0000 7f5214d9b700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f51f4066f30 0x7f51f40693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5204007fd0 tx=0x7f5204009040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:07.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.736+0000 7f520cff9700 1 -- 172.21.15.154:0/3956768406 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51fc052a40 con 0x7f521006c0a0 2023-10-10T21:15:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.927+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52100b0720 con 0x7f521006c0a0 2023-10-10T21:15:07.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.928+0000 7f520cff9700 1 -- 172.21.15.154:0/3956768406 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15962 (secure 0 0 0) 0x7f51fc02a090 con 0x7f521006c0a0 2023-10-10T21:15:07.929 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:07.929 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":63,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:15:06.545056+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:15:04.691966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-10T21:15:05.529376+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:15:07.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f51f4066f30 msgr2=0x7f51f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f51f4066f30 0x7f51f40693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5204007fd0 tx=0x7f5204009040 comp rx=0 tx=0).stop 2023-10-10T21:15:07.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 msgr2=0x7f5210169d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:07.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 0x7f5210169d60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f51fc006fd0 tx=0x7f51fc017000 comp rx=0 tx=0).stop 2023-10-10T21:15:07.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 shutdown_connections 2023-10-10T21:15:07.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521015df50 0x7f52100c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f51f4066f30 0x7f51f40693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521006bcd0 0x7f52100b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 --2- 172.21.15.154:0/3956768406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521006c0a0 0x7f5210169d60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 >> 172.21.15.154:0/3956768406 conn(0x7f52100ce600 msgr2=0x7f52100c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 shutdown_connections 2023-10-10T21:15:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:07.930+0000 7f5216fff700 1 -- 172.21.15.154:0/3956768406 wait complete. 2023-10-10T21:15:07.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T21:15:08.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.138+0000 7f5f9a7ff700 1 Processor -- start 2023-10-10T21:15:08.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.138+0000 7f5f9a7ff700 1 -- start start 2023-10-10T21:15:08.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f9a7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f941568e0 0x7f5f941616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:08.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f9a7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9415b0d0 con 0x7f5f940c83f0 2023-10-10T21:15:08.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f9a7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9415a4c0 con 0x7f5f940ccee0 2023-10-10T21:15:08.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f9a7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9415a7a0 con 0x7f5f941568e0 2023-10-10T21:15:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f98d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f941568e0 0x7f5f941616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f98d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f941568e0 0x7f5f941616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39342/0 (socket says 172.21.15.154:39342) 2023-10-10T21:15:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f98d9c700 1 -- 172.21.15.154:0/204554285 learned_addr learned my addr 172.21.15.154:0/204554285 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f93fff700 1 --1- 172.21.15.154:0/204554285 >> v1:172.21.15.154:6789/0 conn(0x7f5f940c83f0 0x7f5f940c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36304/0 (socket says 172.21.15.154:36304) 2023-10-10T21:15:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f98d9c700 1 -- 172.21.15.154:0/204554285 >> v1:172.21.15.179:6789/0 conn(0x7f5f940ccee0 legacy=0x7f5f941561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:08.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f98d9c700 1 -- 172.21.15.154:0/204554285 >> v1:172.21.15.154:6789/0 conn(0x7f5f940c83f0 legacy=0x7f5f940c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:08.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f98d9c700 1 -- 172.21.15.154:0/204554285 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9415aa80 con 0x7f5f941568e0 2023-10-10T21:15:08.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.140+0000 7f5f92ffd700 1 -- 172.21.15.154:0/204554285 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82717502 0 0) 0x7f5f9415b0d0 con 0x7f5f940c83f0 2023-10-10T21:15:08.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.141+0000 7f5f98d9c700 1 --2- 172.21.15.154:0/204554285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f941568e0 0x7f5f941616c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009f20 tx=0x7f5f8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea829eb6a0fd06f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:08.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.141+0000 7f5f92ffd700 1 -- 172.21.15.154:0/204554285 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00e070 con 0x7f5f941568e0 2023-10-10T21:15:08.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.141+0000 7f5f92ffd700 1 -- 172.21.15.154:0/204554285 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00ba80 con 0x7f5f941568e0 2023-10-10T21:15:08.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.141+0000 7f5f92ffd700 1 -- 172.21.15.154:0/204554285 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0092e0 con 0x7f5f941568e0 2023-10-10T21:15:08.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.141+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/204554285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f941568e0 msgr2=0x7f5f941616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:08.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.141+0000 7f5f9a7ff700 1 --2- 172.21.15.154:0/204554285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f941568e0 0x7f5f941616c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009f20 tx=0x7f5f8c009840 comp rx=0 tx=0).stop 2023-10-10T21:15:08.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.141+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/204554285 shutdown_connections 2023-10-10T21:15:08.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.141+0000 7f5f9a7ff700 1 --2- 172.21.15.154:0/204554285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f941568e0 0x7f5f941616c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:08.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.141+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/204554285 >> 172.21.15.154:0/204554285 conn(0x7f5f94068e10 msgr2=0x7f5f940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:08.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.142+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/204554285 shutdown_connections 2023-10-10T21:15:08.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.142+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/204554285 wait complete. 2023-10-10T21:15:08.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.143+0000 7f5f9a7ff700 1 Processor -- start 2023-10-10T21:15:08.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.143+0000 7f5f9a7ff700 1 -- start start 2023-10-10T21:15:08.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f9a7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f940c83f0 0x7f5f9414d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:08.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f9a7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f940ccee0 0x7f5f9414a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:08.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f9a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f941568e0 0x7f5f940c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:08.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f9a7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9414df30 con 0x7f5f940ccee0 2023-10-10T21:15:08.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f9a7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9414d9e0 con 0x7f5f940c83f0 2023-10-10T21:15:08.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f9a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940b16a0 con 0x7f5f941568e0 2023-10-10T21:15:08.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f940ccee0 0x7f5f9414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:08.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f940ccee0 0x7f5f9414a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39356/0 (socket says 172.21.15.154:39356) 2023-10-10T21:15:08.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f937fe700 1 -- 172.21.15.154:0/1959769978 learned_addr learned my addr 172.21.15.154:0/1959769978 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:08.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f98d9c700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f941568e0 0x7f5f940c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:08.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.144+0000 7f5f93fff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f940c83f0 0x7f5f9414d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:08.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f937fe700 1 -- 172.21.15.154:0/1959769978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f941568e0 msgr2=0x7f5f940c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:08.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f937fe700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f941568e0 0x7f5f940c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:08.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f937fe700 1 -- 172.21.15.154:0/1959769978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f940c83f0 msgr2=0x7f5f9414d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:08.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f937fe700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f940c83f0 0x7f5f9414d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:08.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f937fe700 1 -- 172.21.15.154:0/1959769978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c009ae0 con 0x7f5f940ccee0 2023-10-10T21:15:08.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f937fe700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f940ccee0 0x7f5f9414a030 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c7c0 tx=0x7f5f88007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:08.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f7bfff700 1 -- 172.21.15.154:0/1959769978 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88011590 con 0x7f5f940ccee0 2023-10-10T21:15:08.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f7bfff700 1 -- 172.21.15.154:0/1959769978 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f88011710 con 0x7f5f940ccee0 2023-10-10T21:15:08.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f940b0a90 con 0x7f5f940ccee0 2023-10-10T21:15:08.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f7bfff700 1 -- 172.21.15.154:0/1959769978 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88011ad0 con 0x7f5f940ccee0 2023-10-10T21:15:08.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.145+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f940b0e20 con 0x7f5f940ccee0 2023-10-10T21:15:08.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.146+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f940c3120 con 0x7f5f940ccee0 2023-10-10T21:15:08.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.147+0000 7f5f7bfff700 1 -- 172.21.15.154:0/1959769978 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f8801b3b0 con 0x7f5f940ccee0 2023-10-10T21:15:08.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.148+0000 7f5f7bfff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5f80066f30 0x7f5f800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:08.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.148+0000 7f5f7bfff700 1 -- 172.21.15.154:0/1959769978 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f5f88083bd0 con 0x7f5f940ccee0 2023-10-10T21:15:08.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.148+0000 7f5f93fff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5f80066f30 0x7f5f800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:08.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.149+0000 7f5f93fff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5f80066f30 0x7f5f800693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f840069f0 tx=0x7f5f84009040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:08.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.152+0000 7f5f7bfff700 1 -- 172.21.15.154:0/1959769978 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f88050c30 con 0x7f5f940ccee0 2023-10-10T21:15:08.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:08.391+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5f940c3f30 con 0x7f5f940ccee0 2023-10-10T21:15:09.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.109+0000 7f5f7bfff700 1 -- 172.21.15.154:0/1959769978 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5f88017070 con 0x7f5f940ccee0 2023-10-10T21:15:09.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.111+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5f80066f30 msgr2=0x7f5f800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:09.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.111+0000 7f5f9a7ff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5f80066f30 0x7f5f800693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f840069f0 tx=0x7f5f84009040 comp rx=0 tx=0).stop 2023-10-10T21:15:09.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.111+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f940ccee0 msgr2=0x7f5f9414a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:09.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.111+0000 7f5f9a7ff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f940ccee0 0x7f5f9414a030 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c7c0 tx=0x7f5f88007f60 comp rx=0 tx=0).stop 2023-10-10T21:15:09.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.112+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 shutdown_connections 2023-10-10T21:15:09.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.112+0000 7f5f9a7ff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f941568e0 0x7f5f940c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:09.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.112+0000 7f5f9a7ff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5f80066f30 0x7f5f800693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:09.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.112+0000 7f5f9a7ff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f940c83f0 0x7f5f9414d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:09.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.112+0000 7f5f9a7ff700 1 --2- 172.21.15.154:0/1959769978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f940ccee0 0x7f5f9414a030 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:09.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.112+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 >> 172.21.15.154:0/1959769978 conn(0x7f5f94068e10 msgr2=0x7f5f940cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:09.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.112+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 shutdown_connections 2023-10-10T21:15:09.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.112+0000 7f5f9a7ff700 1 -- 172.21.15.154:0/1959769978 wait complete. 2023-10-10T21:15:09.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T21:15:09.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.316+0000 7faf841ff700 1 Processor -- start 2023-10-10T21:15:09.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.317+0000 7faf841ff700 1 -- start start 2023-10-10T21:15:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.318+0000 7faf841ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf7c069e80 0x7faf7c160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.318+0000 7faf841ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c06e950 con 0x7faf7c0c70b0 2023-10-10T21:15:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.318+0000 7faf841ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c06eb90 con 0x7faf7c155eb0 2023-10-10T21:15:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.318+0000 7faf841ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c06ee70 con 0x7faf7c069e80 2023-10-10T21:15:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.318+0000 7faf8179a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faf7c0c70b0 0x7faf7c069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36318/0 (socket says 172.21.15.154:36318) 2023-10-10T21:15:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.318+0000 7faf8179a700 1 -- 172.21.15.154:0/1511899676 learned_addr learned my addr 172.21.15.154:0/1511899676 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.318+0000 7faf8279c700 1 --2- 172.21.15.154:0/1511899676 >> v2:172.21.15.154:3300/0 conn(0x7faf7c069e80 0x7faf7c160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.319+0000 7faf80f99700 1 -- 172.21.15.154:0/1511899676 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517119717 0 0) 0x7faf6c001110 con 0x7faf7c0c70b0 2023-10-10T21:15:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.319+0000 7faf8279c700 1 -- 172.21.15.154:0/1511899676 >> v1:172.21.15.179:6789/0 conn(0x7faf7c155eb0 legacy=0x7faf7c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.319+0000 7faf8279c700 1 -- 172.21.15.154:0/1511899676 >> v1:172.21.15.154:6789/0 conn(0x7faf7c0c70b0 legacy=0x7faf7c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.319+0000 7faf8279c700 1 -- 172.21.15.154:0/1511899676 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c06f150 con 0x7faf7c069e80 2023-10-10T21:15:09.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.319+0000 7faf8279c700 1 --2- 172.21.15.154:0/1511899676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c069e80 0x7faf7c160bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faf7400af70 tx=0x7faf7400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b56ae7a8258e5ab server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:09.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.319+0000 7faf80f99700 1 -- 172.21.15.154:0/1511899676 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7400f070 con 0x7faf7c069e80 2023-10-10T21:15:09.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.319+0000 7faf80f99700 1 -- 172.21.15.154:0/1511899676 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7400a2e0 con 0x7faf7c069e80 2023-10-10T21:15:09.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.319+0000 7faf80f99700 1 -- 172.21.15.154:0/1511899676 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7400cd20 con 0x7faf7c069e80 2023-10-10T21:15:09.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.320+0000 7faf841ff700 1 -- 172.21.15.154:0/1511899676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c069e80 msgr2=0x7faf7c160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.320+0000 7faf841ff700 1 --2- 172.21.15.154:0/1511899676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c069e80 0x7faf7c160bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faf7400af70 tx=0x7faf7400a890 comp rx=0 tx=0).stop 2023-10-10T21:15:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.320+0000 7faf841ff700 1 -- 172.21.15.154:0/1511899676 shutdown_connections 2023-10-10T21:15:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.320+0000 7faf841ff700 1 --2- 172.21.15.154:0/1511899676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c069e80 0x7faf7c160bf0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.320+0000 7faf841ff700 1 -- 172.21.15.154:0/1511899676 >> 172.21.15.154:0/1511899676 conn(0x7faf7c068e10 msgr2=0x7faf7c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.320+0000 7faf841ff700 1 -- 172.21.15.154:0/1511899676 shutdown_connections 2023-10-10T21:15:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.320+0000 7faf841ff700 1 -- 172.21.15.154:0/1511899676 wait complete. 2023-10-10T21:15:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.321+0000 7faf841ff700 1 Processor -- start 2023-10-10T21:15:09.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.321+0000 7faf841ff700 1 -- start start 2023-10-10T21:15:09.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.322+0000 7faf841ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf7c069e80 0x7faf7c0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:09.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.322+0000 7faf841ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf7c0c70b0 0x7faf7c167510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:09.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.322+0000 7faf841ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c155eb0 0x7faf7c158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.322+0000 7faf841ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c1563b0 con 0x7faf7c155eb0 2023-10-10T21:15:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.322+0000 7faf841ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0c6510 con 0x7faf7c069e80 2023-10-10T21:15:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.322+0000 7faf841ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c167b40 con 0x7faf7c0c70b0 2023-10-10T21:15:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.322+0000 7faf8279c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c155eb0 0x7faf7c158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf8279c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c155eb0 0x7faf7c158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39368/0 (socket says 172.21.15.154:39368) 2023-10-10T21:15:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf8279c700 1 -- 172.21.15.154:0/3218837055 learned_addr learned my addr 172.21.15.154:0/3218837055 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf8179a700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf7c0c70b0 0x7faf7c167510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf81f9b700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf7c069e80 0x7faf7c0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf8279c700 1 -- 172.21.15.154:0/3218837055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf7c0c70b0 msgr2=0x7faf7c167510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf8279c700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf7c0c70b0 0x7faf7c167510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf8279c700 1 -- 172.21.15.154:0/3218837055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf7c069e80 msgr2=0x7faf7c0c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf8279c700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf7c069e80 0x7faf7c0c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf8279c700 1 -- 172.21.15.154:0/3218837055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7400ab30 con 0x7faf7c155eb0 2023-10-10T21:15:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf8279c700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c155eb0 0x7faf7c158b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faf74013000 tx=0x7faf74019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf71ffb700 1 -- 172.21.15.154:0/3218837055 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74026460 con 0x7faf7c155eb0 2023-10-10T21:15:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf71ffb700 1 -- 172.21.15.154:0/3218837055 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf740265e0 con 0x7faf7c155eb0 2023-10-10T21:15:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c167e20 con 0x7faf7c155eb0 2023-10-10T21:15:09.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.323+0000 7faf71ffb700 1 -- 172.21.15.154:0/3218837055 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf740269a0 con 0x7faf7c155eb0 2023-10-10T21:15:09.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.324+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c1683e0 con 0x7faf7c155eb0 2023-10-10T21:15:09.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.324+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c04c3c0 con 0x7faf7c155eb0 2023-10-10T21:15:09.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.325+0000 7faf71ffb700 1 -- 172.21.15.154:0/3218837055 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf74026d50 con 0x7faf7c155eb0 2023-10-10T21:15:09.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.326+0000 7faf71ffb700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faf60066f30 0x7faf600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:09.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.326+0000 7faf71ffb700 1 -- 172.21.15.154:0/3218837055 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7faf74086460 con 0x7faf7c155eb0 2023-10-10T21:15:09.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.326+0000 7faf81f9b700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faf60066f30 0x7faf600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:09.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.327+0000 7faf81f9b700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faf60066f30 0x7faf600693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0c51f0 tx=0x7faf78009040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:09.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.330+0000 7faf71ffb700 1 -- 172.21.15.154:0/3218837055 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf74053570 con 0x7faf7c155eb0 2023-10-10T21:15:09.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:09.564+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faf7c06f430 con 0x7faf7c155eb0 2023-10-10T21:15:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.110+0000 7faf71ffb700 1 -- 172.21.15.154:0/3218837055 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7faf74056b90 con 0x7faf7c155eb0 2023-10-10T21:15:10.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faf60066f30 msgr2=0x7faf600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faf60066f30 0x7faf600693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0c51f0 tx=0x7faf78009040 comp rx=0 tx=0).stop 2023-10-10T21:15:10.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c155eb0 msgr2=0x7faf7c158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c155eb0 0x7faf7c158b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faf74013000 tx=0x7faf74019000 comp rx=0 tx=0).stop 2023-10-10T21:15:10.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 shutdown_connections 2023-10-10T21:15:10.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c155eb0 0x7faf7c158b40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faf60066f30 0x7faf600693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf7c069e80 0x7faf7c0c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 --2- 172.21.15.154:0/3218837055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf7c0c70b0 0x7faf7c167510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 >> 172.21.15.154:0/3218837055 conn(0x7faf7c068e10 msgr2=0x7faf7c1550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 shutdown_connections 2023-10-10T21:15:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.113+0000 7faf841ff700 1 -- 172.21.15.154:0/3218837055 wait complete. 2023-10-10T21:15:10.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:15:10.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.313+0000 7f7891f9d700 1 Processor -- start 2023-10-10T21:15:10.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.313+0000 7f7891f9d700 1 -- start start 2023-10-10T21:15:10.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f7891f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f788c150550 0x7f788c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f7891f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f788c0c7410 0x7f788c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f7891f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c06e2a0 con 0x7f788c150180 2023-10-10T21:15:10.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f7891f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c06b2e0 con 0x7f788c150550 2023-10-10T21:15:10.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f7891f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c0c78e0 con 0x7f788c0c7410 2023-10-10T21:15:10.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f7890f9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f788c150180 0x7f788c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36328/0 (socket says 172.21.15.154:36328) 2023-10-10T21:15:10.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f7890f9b700 1 -- 172.21.15.154:0/2695120176 learned_addr learned my addr 172.21.15.154:0/2695120176 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:10.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f788bfff700 1 --2- 172.21.15.154:0/2695120176 >> v2:172.21.15.154:3300/0 conn(0x7f788c150550 0x7f788c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f789179c700 1 --2- 172.21.15.154:0/2695120176 >> v2:172.21.15.179:3300/0 conn(0x7f788c0c7410 0x7f788c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f788b7fe700 1 -- 172.21.15.154:0/2695120176 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627547181 0 0) 0x7f788c06e2a0 con 0x7f788c150180 2023-10-10T21:15:10.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.315+0000 7f788b7fe700 1 -- 172.21.15.154:0/2695120176 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f787c003570 con 0x7f788c150180 2023-10-10T21:15:10.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.316+0000 7f788bfff700 1 -- 172.21.15.154:0/2695120176 >> v2:172.21.15.179:3300/0 conn(0x7f788c0c7410 msgr2=0x7f788c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:10.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.316+0000 7f788bfff700 1 --2- 172.21.15.154:0/2695120176 >> v2:172.21.15.179:3300/0 conn(0x7f788c0c7410 0x7f788c069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.316+0000 7f788bfff700 1 -- 172.21.15.154:0/2695120176 >> v1:172.21.15.154:6789/0 conn(0x7f788c150180 legacy=0x7f788c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.316+0000 7f788bfff700 1 -- 172.21.15.154:0/2695120176 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0c7bc0 con 0x7f788c150550 2023-10-10T21:15:10.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.316+0000 7f788bfff700 1 --2- 172.21.15.154:0/2695120176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150550 0x7f788c157770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f788c156270 tx=0x7f78780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f356462cfcdd1bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:10.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.316+0000 7f788b7fe700 1 -- 172.21.15.154:0/2695120176 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878011630 con 0x7f788c150550 2023-10-10T21:15:10.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.316+0000 7f788b7fe700 1 -- 172.21.15.154:0/2695120176 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78780117b0 con 0x7f788c150550 2023-10-10T21:15:10.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.316+0000 7f788b7fe700 1 -- 172.21.15.154:0/2695120176 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878011b30 con 0x7f788c150550 2023-10-10T21:15:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.317+0000 7f7891f9d700 1 -- 172.21.15.154:0/2695120176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150550 msgr2=0x7f788c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.317+0000 7f7891f9d700 1 --2- 172.21.15.154:0/2695120176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150550 0x7f788c157770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f788c156270 tx=0x7f78780091a0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.317+0000 7f7891f9d700 1 -- 172.21.15.154:0/2695120176 shutdown_connections 2023-10-10T21:15:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.317+0000 7f7891f9d700 1 --2- 172.21.15.154:0/2695120176 >> v2:172.21.15.179:3300/0 conn(0x7f788c0c7410 0x7f788c069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.317+0000 7f7891f9d700 1 --2- 172.21.15.154:0/2695120176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150550 0x7f788c157770 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.317+0000 7f7891f9d700 1 -- 172.21.15.154:0/2695120176 >> 172.21.15.154:0/2695120176 conn(0x7f788c0cc1f0 msgr2=0x7f788c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.317+0000 7f7891f9d700 1 -- 172.21.15.154:0/2695120176 shutdown_connections 2023-10-10T21:15:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.317+0000 7f7891f9d700 1 -- 172.21.15.154:0/2695120176 wait complete. 2023-10-10T21:15:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.318+0000 7f7891f9d700 1 Processor -- start 2023-10-10T21:15:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.318+0000 7f7891f9d700 1 -- start start 2023-10-10T21:15:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.319+0000 7f7891f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c0c7410 0x7f788c14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.319+0000 7f7891f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150180 0x7f788c0ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.319+0000 7f7891f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c150550 0x7f788c169160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.319+0000 7f7891f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c14ea00 con 0x7f788c150180 2023-10-10T21:15:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.319+0000 7f7891f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0ac990 con 0x7f788c150550 2023-10-10T21:15:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.319+0000 7f7891f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0acc70 con 0x7f788c0c7410 2023-10-10T21:15:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f788bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150180 0x7f788c0ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f788bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150180 0x7f788c0ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39376/0 (socket says 172.21.15.154:39376) 2023-10-10T21:15:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f788bfff700 1 -- 172.21.15.154:0/4119718396 learned_addr learned my addr 172.21.15.154:0/4119718396 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f788bfff700 1 -- 172.21.15.154:0/4119718396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c0c7410 msgr2=0x7f788c14ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f788bfff700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c0c7410 0x7f788c14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f788bfff700 1 -- 172.21.15.154:0/4119718396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c150550 msgr2=0x7f788c169160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f788bfff700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c150550 0x7f788c169160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f788bfff700 1 -- 172.21.15.154:0/4119718396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878009420 con 0x7f788c150180 2023-10-10T21:15:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f788bfff700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150180 0x7f788c0ac2b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7878013000 tx=0x7f7878017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.320+0000 7f7888ff9700 1 -- 172.21.15.154:0/4119718396 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878011b30 con 0x7f788c150180 2023-10-10T21:15:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.321+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c0acf50 con 0x7f788c150180 2023-10-10T21:15:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.321+0000 7f7888ff9700 1 -- 172.21.15.154:0/4119718396 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7878000d10 con 0x7f788c150180 2023-10-10T21:15:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.321+0000 7f7888ff9700 1 -- 172.21.15.154:0/4119718396 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787801a660 con 0x7f788c150180 2023-10-10T21:15:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.321+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c0ad510 con 0x7f788c150180 2023-10-10T21:15:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.322+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788c0ad730 con 0x7f788c150180 2023-10-10T21:15:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.323+0000 7f7888ff9700 1 -- 172.21.15.154:0/4119718396 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f787801aa10 con 0x7f788c150180 2023-10-10T21:15:10.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.323+0000 7f7888ff9700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7870066f30 0x7f78700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.323+0000 7f7888ff9700 1 -- 172.21.15.154:0/4119718396 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f78780863f0 con 0x7f788c150180 2023-10-10T21:15:10.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.324+0000 7f7890f9b700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7870066f30 0x7f78700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.324+0000 7f7890f9b700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7870066f30 0x7f78700693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78800058d0 tx=0x7f78800079d0 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:10.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.328+0000 7f7888ff9700 1 -- 172.21.15.154:0/4119718396 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7878053450 con 0x7f788c150180 2023-10-10T21:15:10.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.562+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f788c04c3c0 con 0x7f788c150180 2023-10-10T21:15:10.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.563+0000 7f7888ff9700 1 -- 172.21.15.154:0/4119718396 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f7878056a70 con 0x7f788c150180 2023-10-10T21:15:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:10.564 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1501601746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1501601746},{"type":"v1","addr":"172.21.15.179:6833","nonce":1501601746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4046528016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4046528016},{"type":"v1","addr":"172.21.15.179:6835","nonce":4046528016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5533,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/634585840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":634585840},{"type":"v1","addr":"172.21.15.154:6837","nonce":634585840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:15:06.545399+0000","modified":"2023-10-10T21:15:10.108541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6833/1321064128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1321064128},{"type":"v1","addr":"172.21.15.154:6833","nonce":1321064128}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-10T21:15:10.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7870066f30 msgr2=0x7f78700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7870066f30 0x7f78700693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78800058d0 tx=0x7f78800079d0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150180 msgr2=0x7f788c0ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150180 0x7f788c0ac2b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7878013000 tx=0x7f7878017000 comp rx=0 tx=0).stop 2023-10-10T21:15:10.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 shutdown_connections 2023-10-10T21:15:10.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7870066f30 0x7f78700693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c150550 0x7f788c169160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c0c7410 0x7f788c14ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 --2- 172.21.15.154:0/4119718396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f788c150180 0x7f788c0ac2b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 >> 172.21.15.154:0/4119718396 conn(0x7f788c0cc1f0 msgr2=0x7f788c069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:10.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 shutdown_connections 2023-10-10T21:15:10.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.565+0000 7f7891f9d700 1 -- 172.21.15.154:0/4119718396 wait complete. 2023-10-10T21:15:10.569 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 22 2023-10-10T21:15:10.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:15:10.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.765+0000 7fe67e3ff700 1 Processor -- start 2023-10-10T21:15:10.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.765+0000 7fe67e3ff700 1 -- start start 2023-10-10T21:15:10.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.766+0000 7fe67e3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe6781599c0 0x7fe678069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.766+0000 7fe67e3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe6780cbd00 0x7fe6780ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.766+0000 7fe67e3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67806a220 con 0x7fe678069aa0 2023-10-10T21:15:10.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.766+0000 7fe67e3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe678069f40 con 0x7fe6781599c0 2023-10-10T21:15:10.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.766+0000 7fe67e3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67815a0b0 con 0x7fe6780cbd00 2023-10-10T21:15:10.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe677fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe6781599c0 0x7fe678069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe6777fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe678069aa0 0x7fe6780cb5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36334/0 (socket says 172.21.15.154:36334) 2023-10-10T21:15:10.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe6777fe700 1 -- 172.21.15.154:0/3470041399 learned_addr learned my addr 172.21.15.154:0/3470041399 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:10.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe67c99c700 1 --2- 172.21.15.154:0/3470041399 >> v2:172.21.15.179:3300/0 conn(0x7fe6780cbd00 0x7fe6780ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe677fff700 1 -- 172.21.15.154:0/3470041399 >> v2:172.21.15.179:3300/0 conn(0x7fe6780cbd00 msgr2=0x7fe6780ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:10.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe677fff700 1 --2- 172.21.15.154:0/3470041399 >> v2:172.21.15.179:3300/0 conn(0x7fe6780cbd00 0x7fe6780ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe677fff700 1 -- 172.21.15.154:0/3470041399 >> v1:172.21.15.154:6789/0 conn(0x7fe678069aa0 legacy=0x7fe6780cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe677fff700 1 -- 172.21.15.154:0/3470041399 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67815a390 con 0x7fe6781599c0 2023-10-10T21:15:10.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe676ffd700 1 -- 172.21.15.154:0/3470041399 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435402240 0 0) 0x7fe67806a220 con 0x7fe678069aa0 2023-10-10T21:15:10.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.767+0000 7fe677fff700 1 --2- 172.21.15.154:0/3470041399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6781599c0 0x7fe678069560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098e0 tx=0x7fe6680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4874efcac88340f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:10.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe676ffd700 1 -- 172.21.15.154:0/3470041399 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668011630 con 0x7fe6781599c0 2023-10-10T21:15:10.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe676ffd700 1 -- 172.21.15.154:0/3470041399 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe668011790 con 0x7fe6781599c0 2023-10-10T21:15:10.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe676ffd700 1 -- 172.21.15.154:0/3470041399 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668011b30 con 0x7fe6781599c0 2023-10-10T21:15:10.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe67e3ff700 1 -- 172.21.15.154:0/3470041399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6781599c0 msgr2=0x7fe678069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe67e3ff700 1 --2- 172.21.15.154:0/3470041399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6781599c0 0x7fe678069560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098e0 tx=0x7fe6680091a0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe67e3ff700 1 -- 172.21.15.154:0/3470041399 shutdown_connections 2023-10-10T21:15:10.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe67e3ff700 1 --2- 172.21.15.154:0/3470041399 >> v2:172.21.15.179:3300/0 conn(0x7fe6780cbd00 0x7fe6780ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe67e3ff700 1 --2- 172.21.15.154:0/3470041399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6781599c0 0x7fe678069560 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe67e3ff700 1 -- 172.21.15.154:0/3470041399 >> 172.21.15.154:0/3470041399 conn(0x7fe678068e10 msgr2=0x7fe6780d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:10.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe67e3ff700 1 -- 172.21.15.154:0/3470041399 shutdown_connections 2023-10-10T21:15:10.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.768+0000 7fe67e3ff700 1 -- 172.21.15.154:0/3470041399 wait complete. 2023-10-10T21:15:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.770+0000 7fe67e3ff700 1 Processor -- start 2023-10-10T21:15:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.770+0000 7fe67e3ff700 1 -- start start 2023-10-10T21:15:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe67e3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe678069aa0 0x7fe6781471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe67e3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6780cbd00 0x7fe6780b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe67e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781599c0 0x7fe6780b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe67e3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6781476f0 con 0x7fe6780cbd00 2023-10-10T21:15:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe67e3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780b4940 con 0x7fe678069aa0 2023-10-10T21:15:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe67e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780b4c20 con 0x7fe6781599c0 2023-10-10T21:15:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe6777fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6780cbd00 0x7fe6780b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe6777fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6780cbd00 0x7fe6780b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39386/0 (socket says 172.21.15.154:39386) 2023-10-10T21:15:10.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe6777fe700 1 -- 172.21.15.154:0/2264914252 learned_addr learned my addr 172.21.15.154:0/2264914252 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:10.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe677fff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe678069aa0 0x7fe6781471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.771+0000 7fe67c99c700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781599c0 0x7fe6780b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe6777fe700 1 -- 172.21.15.154:0/2264914252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781599c0 msgr2=0x7fe6780b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe6777fe700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781599c0 0x7fe6780b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe6777fe700 1 -- 172.21.15.154:0/2264914252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe678069aa0 msgr2=0x7fe6781471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe6777fe700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe678069aa0 0x7fe6781471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe6777fe700 1 -- 172.21.15.154:0/2264914252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009420 con 0x7fe6780cbd00 2023-10-10T21:15:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe67c99c700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781599c0 0x7fe6780b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:15:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe6777fe700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6780cbd00 0x7fe6780b5d00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00c810 tx=0x7fe66c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe65ffff700 1 -- 172.21.15.154:0/2264914252 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c005b30 con 0x7fe6780cbd00 2023-10-10T21:15:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe65ffff700 1 -- 172.21.15.154:0/2264914252 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c005cb0 con 0x7fe6780cbd00 2023-10-10T21:15:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe65ffff700 1 -- 172.21.15.154:0/2264914252 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c007340 con 0x7fe6780cbd00 2023-10-10T21:15:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6780b4f00 con 0x7fe6780cbd00 2023-10-10T21:15:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.772+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6780b6240 con 0x7fe6780cbd00 2023-10-10T21:15:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.773+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678064550 con 0x7fe6780cbd00 2023-10-10T21:15:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.774+0000 7fe65ffff700 1 -- 172.21.15.154:0/2264914252 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe66c01b400 con 0x7fe6780cbd00 2023-10-10T21:15:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.775+0000 7fe65ffff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe664066f60 0x7fe664069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.775+0000 7fe65ffff700 1 -- 172.21.15.154:0/2264914252 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe66c084070 con 0x7fe6780cbd00 2023-10-10T21:15:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.775+0000 7fe677fff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe664066f60 0x7fe664069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:10.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.776+0000 7fe677fff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe664066f60 0x7fe664069410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6680091e0 tx=0x7fe668017000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:10.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.779+0000 7fe65ffff700 1 -- 172.21.15.154:0/2264914252 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe66c0511f0 con 0x7fe6780cbd00 2023-10-10T21:15:10.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.969+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe67804c3c0 con 0x7fe6780cbd00 2023-10-10T21:15:10.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.970+0000 7fe65ffff700 1 -- 172.21.15.154:0/2264914252 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15949 (secure 0 0 0) 0x7fe66c0076f0 con 0x7fe6780cbd00 2023-10-10T21:15:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:10.972 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":64,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:15:08.077822+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:15:04.691966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-10T21:15:05.529376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:15:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe664066f60 msgr2=0x7fe664069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe664066f60 0x7fe664069410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6680091e0 tx=0x7fe668017000 comp rx=0 tx=0).stop 2023-10-10T21:15:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6780cbd00 msgr2=0x7fe6780b5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6780cbd00 0x7fe6780b5d00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00c810 tx=0x7fe66c007db0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 shutdown_connections 2023-10-10T21:15:10.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781599c0 0x7fe6780b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe664066f60 0x7fe664069410 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe678069aa0 0x7fe6781471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 --2- 172.21.15.154:0/2264914252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6780cbd00 0x7fe6780b5d00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:10.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 >> 172.21.15.154:0/2264914252 conn(0x7fe678068e10 msgr2=0x7fe6780c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:10.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 shutdown_connections 2023-10-10T21:15:10.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:10.973+0000 7fe67e3ff700 1 -- 172.21.15.154:0/2264914252 wait complete. 2023-10-10T21:15:10.992 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T21:15:10.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:15:11.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.175+0000 7f69a21ff700 1 Processor -- start 2023-10-10T21:15:11.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.175+0000 7f69a21ff700 1 -- start start 2023-10-10T21:15:11.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.176+0000 7f69a21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 0x7f699c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.176+0000 7f69a21ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f699c15db10 0x7f699c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.177+0000 7f69a21ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c15a160 con 0x7f699c159890 2023-10-10T21:15:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.177+0000 7f69a21ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699c0d13a0 con 0x7f699c15db10 2023-10-10T21:15:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.177+0000 7f69a21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c15e140 con 0x7f699c159c60 2023-10-10T21:15:11.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.177+0000 7f699affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 0x7f699c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.177+0000 7f699b7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f699c159890 0x7f699c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44336/0 (socket says 172.21.15.154:44336) 2023-10-10T21:15:11.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.177+0000 7f699bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f699c15db10 0x7f699c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.177+0000 7f699b7fe700 1 -- 172.21.15.154:0/2705709355 learned_addr learned my addr 172.21.15.154:0/2705709355 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:11.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699a7fc700 1 -- 172.21.15.154:0/2705709355 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025253673 0 0) 0x7f699c15a160 con 0x7f699c159890 2023-10-10T21:15:11.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699a7fc700 1 -- 172.21.15.154:0/2705709355 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6984003570 con 0x7f699c159890 2023-10-10T21:15:11.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699affd700 1 -- 172.21.15.154:0/2705709355 >> v2:172.21.15.179:3300/0 conn(0x7f699c15db10 msgr2=0x7f699c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:11.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699affd700 1 --2- 172.21.15.154:0/2705709355 >> v2:172.21.15.179:3300/0 conn(0x7f699c15db10 0x7f699c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699affd700 1 -- 172.21.15.154:0/2705709355 >> v1:172.21.15.179:6789/0 conn(0x7f699c159890 legacy=0x7f699c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699affd700 1 -- 172.21.15.154:0/2705709355 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c15a3d0 con 0x7f699c159c60 2023-10-10T21:15:11.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699bfff700 1 --2- 172.21.15.154:0/2705709355 >> v2:172.21.15.179:3300/0 conn(0x7f699c15db10 0x7f699c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:15:11.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699affd700 1 --2- 172.21.15.154:0/2705709355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 0x7f699c15d5d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69900098e0 tx=0x7f69900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc4b720f095a055 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:11.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699a7fc700 1 -- 172.21.15.154:0/2705709355 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990011630 con 0x7f699c159c60 2023-10-10T21:15:11.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699a7fc700 1 -- 172.21.15.154:0/2705709355 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6990011790 con 0x7f699c159c60 2023-10-10T21:15:11.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.178+0000 7f699a7fc700 1 -- 172.21.15.154:0/2705709355 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990011b30 con 0x7f699c159c60 2023-10-10T21:15:11.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.179+0000 7f69a21ff700 1 -- 172.21.15.154:0/2705709355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 msgr2=0x7f699c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.179+0000 7f69a21ff700 1 --2- 172.21.15.154:0/2705709355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 0x7f699c15d5d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69900098e0 tx=0x7f69900091a0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.179+0000 7f69a21ff700 1 -- 172.21.15.154:0/2705709355 shutdown_connections 2023-10-10T21:15:11.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.179+0000 7f69a21ff700 1 --2- 172.21.15.154:0/2705709355 >> v2:172.21.15.179:3300/0 conn(0x7f699c15db10 0x7f699c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.179+0000 7f69a21ff700 1 --2- 172.21.15.154:0/2705709355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 0x7f699c15d5d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.179+0000 7f69a21ff700 1 -- 172.21.15.154:0/2705709355 >> 172.21.15.154:0/2705709355 conn(0x7f699c068e20 msgr2=0x7f699c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:11.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.179+0000 7f69a21ff700 1 -- 172.21.15.154:0/2705709355 shutdown_connections 2023-10-10T21:15:11.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.179+0000 7f69a21ff700 1 -- 172.21.15.154:0/2705709355 wait complete. 2023-10-10T21:15:11.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.180+0000 7f69a21ff700 1 Processor -- start 2023-10-10T21:15:11.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.181+0000 7f69a21ff700 1 -- start start 2023-10-10T21:15:11.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.181+0000 7f69a21ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f699c159890 0x7f699c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.181+0000 7f69a21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 0x7f699c0c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.181+0000 7f69a21ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f699c15db10 0x7f699c14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.181+0000 7f69a21ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0b4e80 con 0x7f699c159890 2023-10-10T21:15:11.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.181+0000 7f69a21ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0b5160 con 0x7f699c15db10 2023-10-10T21:15:11.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.181+0000 7f69a21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0b5440 con 0x7f699c159c60 2023-10-10T21:15:11.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f699c159890 0x7f699c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f699c159890 0x7f699c0b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39392/0 (socket says 172.21.15.154:39392) 2023-10-10T21:15:11.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699b7fe700 1 -- 172.21.15.154:0/1945723180 learned_addr learned my addr 172.21.15.154:0/1945723180 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:11.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699b7fe700 1 -- 172.21.15.154:0/1945723180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 msgr2=0x7f699c0c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699b7fe700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 0x7f699c0c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699bfff700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f699c15db10 0x7f699c14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699b7fe700 1 -- 172.21.15.154:0/1945723180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f699c15db10 msgr2=0x7f699c14cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699b7fe700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f699c15db10 0x7f699c14cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699b7fe700 1 -- 172.21.15.154:0/1945723180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994009a20 con 0x7f699c159890 2023-10-10T21:15:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f699b7fe700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f699c159890 0x7f699c0b3fa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c7c0 tx=0x7f698c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:11.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.182+0000 7f69837fe700 1 -- 172.21.15.154:0/1945723180 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c005b30 con 0x7f699c159890 2023-10-10T21:15:11.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.183+0000 7f69837fe700 1 -- 172.21.15.154:0/1945723180 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c005c90 con 0x7f699c159890 2023-10-10T21:15:11.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.183+0000 7f69837fe700 1 -- 172.21.15.154:0/1945723180 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c007320 con 0x7f699c159890 2023-10-10T21:15:11.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.183+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6990009420 con 0x7f699c159890 2023-10-10T21:15:11.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.183+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c0c71b0 con 0x7f699c159890 2023-10-10T21:15:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.184+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699c0c7460 con 0x7f699c159890 2023-10-10T21:15:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.184+0000 7f69837fe700 1 -- 172.21.15.154:0/1945723180 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f698c01b400 con 0x7f699c159890 2023-10-10T21:15:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.186+0000 7f69837fe700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6988066f30 0x7f69880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.186+0000 7f69837fe700 1 -- 172.21.15.154:0/1945723180 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f698c0842e0 con 0x7f699c159890 2023-10-10T21:15:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.186+0000 7f699affd700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6988066f30 0x7f69880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.187+0000 7f699affd700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6988066f30 0x7f69880693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f699c15a090 tx=0x7f6990017000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:11.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.190+0000 7f69837fe700 1 -- 172.21.15.154:0/1945723180 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f698c0513c0 con 0x7f699c159890 2023-10-10T21:15:11.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.378+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f699c159120 con 0x7f6988066f30 2023-10-10T21:15:11.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.388+0000 7f69837fe700 1 -- 172.21.15.154:0/1945723180 <== mgr.5565 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279806 (secure 0 0 0) 0x7f699c159120 con 0x7f6988066f30 2023-10-10T21:15:11.394 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:11.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6988066f30 msgr2=0x7f69880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6988066f30 0x7f69880693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f699c15a090 tx=0x7f6990017000 comp rx=0 tx=0).stop 2023-10-10T21:15:11.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f699c159890 msgr2=0x7f699c0b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f699c159890 0x7f699c0b3fa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c7c0 tx=0x7f698c007e00 comp rx=0 tx=0).stop 2023-10-10T21:15:11.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 shutdown_connections 2023-10-10T21:15:11.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6988066f30 0x7f69880693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f699c15db10 0x7f699c14cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f699c159890 0x7f699c0b3fa0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 --2- 172.21.15.154:0/1945723180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f699c159c60 0x7f699c0c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 >> 172.21.15.154:0/1945723180 conn(0x7f699c068e20 msgr2=0x7f699c15d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:11.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.392+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 shutdown_connections 2023-10-10T21:15:11.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.393+0000 7f69a21ff700 1 -- 172.21.15.154:0/1945723180 wait complete. 2023-10-10T21:15:11.401 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:15:11.411 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:15:10.518488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590956,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":207,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421960,"kb_used_data":6792,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752552760,"statfs":{"total":773094113280,"available":770614026240,"internally_reserved":0,"allocated":6955008,"data_stored":3847684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":588,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457655"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105516+0000","last_change":"2023-10-10T21:15:07.101273+0000","last_active":"2023-10-10T21:15:07.105516+0000","last_peered":"2023-10-10T21:15:07.105516+0000","last_clean":"2023-10-10T21:15:07.105516+0000","last_became_active":"2023-10-10T21:15:07.100986+0000","last_became_peered":"2023-10-10T21:15:07.100986+0000","last_unstale":"2023-10-10T21:15:07.105516+0000","last_undegraded":"2023-10-10T21:15:07.105516+0000","last_fullsized":"2023-10-10T21:15:07.105516+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.296297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107320+0000","last_change":"2023-10-10T21:15:07.106043+0000","last_active":"2023-10-10T21:15:07.107320+0000","last_peered":"2023-10-10T21:15:07.107320+0000","last_clean":"2023-10-10T21:15:07.107320+0000","last_became_active":"2023-10-10T21:15:07.105509+0000","last_became_peered":"2023-10-10T21:15:07.105509+0000","last_unstale":"2023-10-10T21:15:07.107320+0000","last_undegraded":"2023-10-10T21:15:07.107320+0000","last_fullsized":"2023-10-10T21:15:07.107320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:18.210078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107176+0000","last_change":"2023-10-10T21:15:07.101459+0000","last_active":"2023-10-10T21:15:07.107176+0000","last_peered":"2023-10-10T21:15:07.107176+0000","last_clean":"2023-10-10T21:15:07.107176+0000","last_became_active":"2023-10-10T21:15:07.101193+0000","last_became_peered":"2023-10-10T21:15:07.101193+0000","last_unstale":"2023-10-10T21:15:07.107176+0000","last_undegraded":"2023-10-10T21:15:07.107176+0000","last_fullsized":"2023-10-10T21:15:07.107176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:31:25.837715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105365+0000","last_change":"2023-10-10T21:15:07.097858+0000","last_active":"2023-10-10T21:15:07.105365+0000","last_peered":"2023-10-10T21:15:07.105365+0000","last_clean":"2023-10-10T21:15:07.105365+0000","last_became_active":"2023-10-10T21:15:07.097647+0000","last_became_peered":"2023-10-10T21:15:07.097647+0000","last_unstale":"2023-10-10T21:15:07.105365+0000","last_undegraded":"2023-10-10T21:15:07.105365+0000","last_fullsized":"2023-10-10T21:15:07.105365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:13.008471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.111679+0000","last_change":"2023-10-10T21:15:06.092828+0000","last_active":"2023-10-10T21:15:07.111679+0000","last_peered":"2023-10-10T21:15:07.111679+0000","last_clean":"2023-10-10T21:15:07.111679+0000","last_became_active":"2023-10-10T21:15:06.092557+0000","last_became_peered":"2023-10-10T21:15:06.092557+0000","last_unstale":"2023-10-10T21:15:07.111679+0000","last_undegraded":"2023-10-10T21:15:07.111679+0000","last_fullsized":"2023-10-10T21:15:07.111679+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:13.532469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.064760+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:21:13.803869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069737+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:20:01.195252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066996+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:17:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109536+0000","last_change":"2023-10-10T21:15:06.088657+0000","last_active":"2023-10-10T21:15:07.109536+0000","last_peered":"2023-10-10T21:15:07.109536+0000","last_clean":"2023-10-10T21:15:07.109536+0000","last_became_active":"2023-10-10T21:15:06.088320+0000","last_became_peered":"2023-10-10T21:15:06.088320+0000","last_unstale":"2023-10-10T21:15:07.109536+0000","last_undegraded":"2023-10-10T21:15:07.109536+0000","last_fullsized":"2023-10-10T21:15:07.109536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:30.505874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.064448+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063793+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:17.062651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067903+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063785+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067097+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106436+0000","last_change":"2023-10-10T21:15:07.092528+0000","last_active":"2023-10-10T21:15:07.106436+0000","last_peered":"2023-10-10T21:15:07.106436+0000","last_clean":"2023-10-10T21:15:07.106436+0000","last_became_active":"2023-10-10T21:15:07.092265+0000","last_became_peered":"2023-10-10T21:15:07.092265+0000","last_unstale":"2023-10-10T21:15:07.106436+0000","last_undegraded":"2023-10-10T21:15:07.106436+0000","last_fullsized":"2023-10-10T21:15:07.106436+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:10:53.807646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067892+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:23.304984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069475+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:30:14.673983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.117735+0000","last_change":"2023-10-10T21:15:06.089522+0000","last_active":"2023-10-10T21:15:07.117735+0000","last_peered":"2023-10-10T21:15:07.117735+0000","last_clean":"2023-10-10T21:15:07.117735+0000","last_became_active":"2023-10-10T21:15:06.089268+0000","last_became_peered":"2023-10-10T21:15:06.089268+0000","last_unstale":"2023-10-10T21:15:07.117735+0000","last_undegraded":"2023-10-10T21:15:07.117735+0000","last_fullsized":"2023-10-10T21:15:07.117735+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:02.311839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066989+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:59:53.023107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105466+0000","last_change":"2023-10-10T21:15:07.092596+0000","last_active":"2023-10-10T21:15:07.105466+0000","last_peered":"2023-10-10T21:15:07.105466+0000","last_clean":"2023-10-10T21:15:07.105466+0000","last_became_active":"2023-10-10T21:15:07.092320+0000","last_became_peered":"2023-10-10T21:15:07.092320+0000","last_unstale":"2023-10-10T21:15:07.105466+0000","last_undegraded":"2023-10-10T21:15:07.105466+0000","last_fullsized":"2023-10-10T21:15:07.105466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:16:24.209480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091819+0000","last_change":"2023-10-10T21:15:06.089710+0000","last_active":"2023-10-10T21:15:07.091819+0000","last_peered":"2023-10-10T21:15:07.091819+0000","last_clean":"2023-10-10T21:15:07.091819+0000","last_became_active":"2023-10-10T21:15:06.089385+0000","last_became_peered":"2023-10-10T21:15:06.089385+0000","last_unstale":"2023-10-10T21:15:07.091819+0000","last_undegraded":"2023-10-10T21:15:07.091819+0000","last_fullsized":"2023-10-10T21:15:07.091819+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:45.674860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066937+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:18:48.648687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069590+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:56.169031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063775+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:25:40.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063773+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:28.877065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.087569+0000","last_change":"2023-10-10T21:15:06.090826+0000","last_active":"2023-10-10T21:15:07.087569+0000","last_peered":"2023-10-10T21:15:07.087569+0000","last_clean":"2023-10-10T21:15:07.087569+0000","last_became_active":"2023-10-10T21:15:06.090567+0000","last_became_peered":"2023-10-10T21:15:06.090567+0000","last_unstale":"2023-10-10T21:15:07.087569+0000","last_undegraded":"2023-10-10T21:15:07.087569+0000","last_fullsized":"2023-10-10T21:15:07.087569+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:02.927652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106677+0000","last_change":"2023-10-10T21:15:07.103070+0000","last_active":"2023-10-10T21:15:07.106677+0000","last_peered":"2023-10-10T21:15:07.106677+0000","last_clean":"2023-10-10T21:15:07.106677+0000","last_became_active":"2023-10-10T21:15:07.102143+0000","last_became_peered":"2023-10-10T21:15:07.102143+0000","last_unstale":"2023-10-10T21:15:07.106677+0000","last_undegraded":"2023-10-10T21:15:07.106677+0000","last_fullsized":"2023-10-10T21:15:07.106677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:52.486720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109649+0000","last_change":"2023-10-10T21:15:06.089714+0000","last_active":"2023-10-10T21:15:07.109649+0000","last_peered":"2023-10-10T21:15:07.109649+0000","last_clean":"2023-10-10T21:15:07.109649+0000","last_became_active":"2023-10-10T21:15:06.089472+0000","last_became_peered":"2023-10-10T21:15:06.089472+0000","last_unstale":"2023-10-10T21:15:07.109649+0000","last_undegraded":"2023-10-10T21:15:07.109649+0000","last_fullsized":"2023-10-10T21:15:07.109649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:31.996775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063838+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:48.393884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066966+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:20:01.195252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067778+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:39:08.189286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091817+0000","last_change":"2023-10-10T21:15:06.089097+0000","last_active":"2023-10-10T21:15:07.091817+0000","last_peered":"2023-10-10T21:15:07.091817+0000","last_clean":"2023-10-10T21:15:07.091817+0000","last_became_active":"2023-10-10T21:15:06.088816+0000","last_became_peered":"2023-10-10T21:15:06.088816+0000","last_unstale":"2023-10-10T21:15:07.091817+0000","last_undegraded":"2023-10-10T21:15:07.091817+0000","last_fullsized":"2023-10-10T21:15:07.091817+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:58:06.775845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067047+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:25:30.204517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069857+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105498+0000","last_change":"2023-10-10T21:15:07.093269+0000","last_active":"2023-10-10T21:15:07.105498+0000","last_peered":"2023-10-10T21:15:07.105498+0000","last_clean":"2023-10-10T21:15:07.105498+0000","last_became_active":"2023-10-10T21:15:07.093033+0000","last_became_peered":"2023-10-10T21:15:07.093033+0000","last_unstale":"2023-10-10T21:15:07.105498+0000","last_undegraded":"2023-10-10T21:15:07.105498+0000","last_fullsized":"2023-10-10T21:15:07.105498+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:22:26.447544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067153+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:06.418042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107200+0000","last_change":"2023-10-10T21:15:07.103541+0000","last_active":"2023-10-10T21:15:07.107200+0000","last_peered":"2023-10-10T21:15:07.107200+0000","last_clean":"2023-10-10T21:15:07.107200+0000","last_became_active":"2023-10-10T21:15:07.103293+0000","last_became_peered":"2023-10-10T21:15:07.103293+0000","last_unstale":"2023-10-10T21:15:07.107200+0000","last_undegraded":"2023-10-10T21:15:07.107200+0000","last_fullsized":"2023-10-10T21:15:07.107200+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:42.410363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063770+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069749+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:18:48.648687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067455+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.064560+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:12:15.710315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":276,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-10T21:15:02.804752+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:15:02.804752+0000","last_peered":"2023-10-10T21:15:02.804752+0000","last_clean":"2023-10-10T21:15:02.804752+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:15:02.804752+0000","last_undegraded":"2023-10-10T21:15:02.804752+0000","last_fullsized":"2023-10-10T21:15:02.804752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":588,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":1314816,"data_stored":924195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.40400000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.1859999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70599999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.92400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.498},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.45100000000000001,"15min":0.41399999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.123},"last":0.65200000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.71299999999999997},"min":{"1min":0.54600000000000004,"5min":0.48299999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.57999999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.60099999999999998,"5min":0.497,"15min":0.46500000000000002},"max":{"1min":1.0249999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.49099999999999999},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.056},"last":0.53300000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.621},"min":{"1min":0.42999999999999999,"5min":0.374,"15min":0.33500000000000002},"max":{"1min":0.81799999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.40799999999999997},"max":{"1min":0.97399999999999998,"5min":0.98299999999999998,"15min":1.022},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.376},"max":{"1min":0.90600000000000003,"5min":0.91300000000000003,"15min":0.98899999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.629,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":0.98699999999999999,"15min":1.135},"last":0.79500000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302088,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069752,"statfs":{"total":96636764160,"available":96327426048,"internally_reserved":0,"allocated":720896,"data_stored":333827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.45000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.90000000000000002,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.71899999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.41099999999999998},"max":{"1min":0.84799999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.51000000000000001,"5min":0.45500000000000002,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.0129999999999999,"15min":1.143},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":1.073,"15min":1.073},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":0.98199999999999998,"15min":1.151},"last":0.62},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.498,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46300000000000002},"max":{"1min":0.94799999999999995,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.627,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.746,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.345},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":1.048,"15min":1.238},"last":0.76000000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72799999999999998,"15min":0.745},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.202},"last":0.82299999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.251},"max":{"1min":0.61799999999999999,"5min":0.73199999999999998,"15min":1.258},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":0.81599999999999995,"15min":1.964},"last":0.30199999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.29599999999999999},"max":{"1min":0.66200000000000003,"5min":0.80300000000000005,"15min":1.4550000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":2.085},"last":0.40699999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.8919999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.80400000000000005,"15min":2.117},"last":0.51800000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.024,"5min":1.0509999999999999,"15min":2.052},"last":0.747},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":0.91600000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.036,"5min":1.0409999999999999,"15min":1.181},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79900000000000004},"min":{"1min":0.625,"5min":0.502,"15min":0.46400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":2.012},"last":0.77200000000000002}]},{"osd":6,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.63200000000000001,"5min":0.55600000000000005,"15min":0.51200000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":2.25},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.53400000000000003},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":2.169},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.79500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298572,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073268,"statfs":{"total":96636764160,"available":96331026432,"internally_reserved":0,"allocated":1314816,"data_stored":924195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.68000000000000005,"5min":0.752,"15min":1.4890000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.78200000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":1.706},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.1739999999999999},"last":0.503}]},{"osd":3,"last update":"Tue Oct 10 21:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.30399999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.6499999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":1.2909999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82399999999999995,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":1.101,"5min":1.1040000000000001,"15min":1.2270000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":0.77100000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.78200000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.371},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80800000000000005,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":0.94099999999999995,"5min":1.1439999999999999,"15min":1.3899999999999999},"last":0.624}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.82999999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.874,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.1339999999999999,"15min":1.306},"last":0.67200000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85599999999999998,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.503},"max":{"1min":1.1319999999999999,"5min":1.169,"15min":1.363},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85799999999999998,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.60099999999999998,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.165,"15min":1.3300000000000001},"last":0.755}]}]},{"osd":2,"up_from":14,"seq":60129542302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306172,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065668,"statfs":{"total":96636764160,"available":96323244032,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.28699999999999998},"max":{"1min":0.59299999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39700000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":1.2070000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.88800000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.85999999999999999},"last":0.437}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77000000000000002,"15min":0.76500000000000001},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":1.286,"15min":1.3220000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.46600000000000003},"max":{"1min":0.97099999999999997,"5min":1.1659999999999999,"15min":1.2849999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93799999999999994,"5min":1.196,"15min":1.385},"last":0.752},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51900000000000002},"max":{"1min":0.94999999999999996,"5min":1.268,"15min":1.268},"last":0.88400000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.61199999999999999,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":0.98099999999999998,"5min":1.3080000000000001,"15min":1.3400000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":1.022,"5min":1.107,"15min":1.3759999999999999},"last":0.90000000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51200000000000001},"max":{"1min":1.0049999999999999,"5min":1.1659999999999999,"15min":1.2},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.625,"5min":0.57399999999999995,"15min":0.49199999999999999},"max":{"1min":0.95699999999999996,"5min":1.2330000000000001,"15min":1.3109999999999999},"last":0.84699999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509598,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":770048,"data_stored":354835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":0.58199999999999996,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.378},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":1.544},"last":0.48199999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":1.6759999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.66500000000000004,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.45200000000000001,"5min":0.42399999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.78900000000000003,"15min":1.7070000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.38700000000000001},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.439}]},{"osd":4,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.434},"max":{"1min":1.0529999999999999,"5min":1.107,"15min":1.6359999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.80100000000000005,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1859999999999999,"5min":1.246,"15min":1.246},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78800000000000003,"15min":0.77200000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.262},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.48699999999999999},"max":{"1min":0.94299999999999995,"5min":1.1579999999999999,"15min":1.579},"last":0.61499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52900000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":1.1040000000000001,"15min":1.6080000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82999999999999996,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51300000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.3200000000000001},"last":0.72099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306172,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065668,"statfs":{"total":96636764160,"available":96323244032,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.69599999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.752},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95399999999999996,"5min":0.96499999999999997,"15min":1.758},"last":0.78000000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.42099999999999999},"max":{"1min":0.93000000000000005,"5min":1.1359999999999999,"15min":1.47},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.437},"max":{"1min":0.85199999999999998,"5min":0.95499999999999996,"15min":1.929},"last":0.747}]},{"osd":2,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.48999999999999999},"max":{"1min":0.96199999999999997,"5min":1.02,"15min":1.6890000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.3100000000000001,"15min":1.468},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.75800000000000001},"min":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.0820000000000001,"15min":1.397},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.385,"15min":1.385},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63400000000000001,"15min":0.68400000000000005},"min":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.39900000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.38100000000000001},"max":{"1min":0.93000000000000005,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.0609999999999999,"15min":1.464},"last":0.82699999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.97899999999999998,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.42199999999999999},"max":{"1min":0.91300000000000003,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.879}]}]},{"osd":5,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.92000000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.747,"15min":0.71299999999999997},"min":{"1min":0.57599999999999996,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.95899999999999996,"15min":1.371},"last":0.58499999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.42599999999999999,"15min":0.38500000000000001},"max":{"1min":0.93300000000000005,"5min":0.96599999999999997,"15min":3.895},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.83299999999999996},"min":{"1min":0.49199999999999999,"5min":0.41699999999999998,"15min":0.39000000000000001},"max":{"1min":0.90700000000000003,"5min":1.018,"15min":8.9909999999999997},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.71499999999999997},"min":{"1min":0.58899999999999997,"5min":0.44900000000000001,"15min":0.439},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2889999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.82699999999999996,"5min":0.93300000000000005,"15min":1.3540000000000001},"last":0.71299999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.437},"max":{"1min":0.871,"5min":0.99299999999999999,"15min":8.9309999999999992},"last":0.63},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.502,"15min":0.45900000000000002},"max":{"1min":0.89000000000000001,"5min":1.044,"15min":2.9409999999999998},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":9.0250000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83299999999999996,"5min":0.89200000000000002,"15min":4.2789999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.85899999999999999},"min":{"1min":0.57499999999999996,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":0.95399999999999996,"5min":0.96899999999999997,"15min":8.8480000000000008},"last":0.79900000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.74299999999999999},"min":{"1min":0.503,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93500000000000005,"5min":0.95499999999999996,"15min":2.8900000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68799999999999994,"15min":0.754},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.98899999999999999,"15min":3.9420000000000002},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:15:11.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:15:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.633+0000 7f09ea39d700 1 Processor -- start 2023-10-10T21:15:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.634+0000 7f09ea39d700 1 -- start start 2023-10-10T21:15:11.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.635+0000 7f09ea39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09e4150180 0x7f09e4157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.635+0000 7f09ea39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 0x7f09e4069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.635+0000 7f09ea39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e406e2a0 con 0x7f09e4150550 2023-10-10T21:15:11.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.635+0000 7f09ea39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e406b2e0 con 0x7f09e4150180 2023-10-10T21:15:11.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.635+0000 7f09ea39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c78e0 con 0x7f09e40c7410 2023-10-10T21:15:11.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.635+0000 7f09e939b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09e4150180 0x7f09e4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.635+0000 7f09e939b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09e4150180 0x7f09e4157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39402/0 (socket says 172.21.15.154:39402) 2023-10-10T21:15:11.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.635+0000 7f09e939b700 1 -- 172.21.15.154:0/1159218662 learned_addr learned my addr 172.21.15.154:0/1159218662 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:11.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.636+0000 7f09e9b9c700 1 --2- 172.21.15.154:0/1159218662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 0x7f09e4069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.636+0000 7f09e939b700 1 -- 172.21.15.154:0/1159218662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 msgr2=0x7f09e4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:11.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.636+0000 7f09e939b700 1 --2- 172.21.15.154:0/1159218662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 0x7f09e4069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.636+0000 7f09e939b700 1 -- 172.21.15.154:0/1159218662 >> v1:172.21.15.179:6789/0 conn(0x7f09e4150550 legacy=0x7f09e40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.636+0000 7f09e939b700 1 -- 172.21.15.154:0/1159218662 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40c7bc0 con 0x7f09e4150180 2023-10-10T21:15:11.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.636+0000 7f09e939b700 1 --2- 172.21.15.154:0/1159218662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150180 0x7f09e4157770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f09e00099b0 tx=0x7f09e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ce315ddcdecc25 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:11.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.636+0000 7f09dbfff700 1 -- 172.21.15.154:0/1159218662 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0009ea0 con 0x7f09e4150180 2023-10-10T21:15:11.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.636+0000 7f09dbfff700 1 -- 172.21.15.154:0/1159218662 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e000b860 con 0x7f09e4150180 2023-10-10T21:15:11.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.636+0000 7f09dbfff700 1 -- 172.21.15.154:0/1159218662 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000bc00 con 0x7f09e4150180 2023-10-10T21:15:11.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.637+0000 7f09ea39d700 1 -- 172.21.15.154:0/1159218662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150180 msgr2=0x7f09e4157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.637+0000 7f09ea39d700 1 --2- 172.21.15.154:0/1159218662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150180 0x7f09e4157770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f09e00099b0 tx=0x7f09e0009250 comp rx=0 tx=0).stop 2023-10-10T21:15:11.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.637+0000 7f09ea39d700 1 -- 172.21.15.154:0/1159218662 shutdown_connections 2023-10-10T21:15:11.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.637+0000 7f09ea39d700 1 --2- 172.21.15.154:0/1159218662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 0x7f09e4069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.637+0000 7f09ea39d700 1 --2- 172.21.15.154:0/1159218662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150180 0x7f09e4157770 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.637+0000 7f09ea39d700 1 -- 172.21.15.154:0/1159218662 >> 172.21.15.154:0/1159218662 conn(0x7f09e40cc1f0 msgr2=0x7f09e40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:11.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.637+0000 7f09ea39d700 1 -- 172.21.15.154:0/1159218662 shutdown_connections 2023-10-10T21:15:11.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.637+0000 7f09ea39d700 1 -- 172.21.15.154:0/1159218662 wait complete. 2023-10-10T21:15:11.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.638+0000 7f09ea39d700 1 Processor -- start 2023-10-10T21:15:11.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.639+0000 7f09ea39d700 1 -- start start 2023-10-10T21:15:11.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.639+0000 7f09ea39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 0x7f09e41692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09ea39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e4150180 0x7f09e40b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09ea39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150550 0x7f09e415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09ea39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e414a750 con 0x7f09e4150550 2023-10-10T21:15:11.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09ea39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4169b20 con 0x7f09e4150180 2023-10-10T21:15:11.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09ea39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4169e00 con 0x7f09e40c7410 2023-10-10T21:15:11.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e9b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150550 0x7f09e415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e9b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150550 0x7f09e415dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39416/0 (socket says 172.21.15.154:39416) 2023-10-10T21:15:11.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e9b9c700 1 -- 172.21.15.154:0/677458106 learned_addr learned my addr 172.21.15.154:0/677458106 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:11.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e939b700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 0x7f09e41692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e8b9a700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e4150180 0x7f09e40b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e9b9c700 1 -- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 msgr2=0x7f09e41692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e9b9c700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 0x7f09e41692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e9b9c700 1 -- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e4150180 msgr2=0x7f09e40b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e9b9c700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e4150180 0x7f09e40b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e9b9c700 1 -- 172.21.15.154:0/677458106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e00094f0 con 0x7f09e4150550 2023-10-10T21:15:11.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e939b700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 0x7f09e41692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:15:11.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.640+0000 7f09e8b9a700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e4150180 0x7f09e40b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:15:11.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.641+0000 7f09e9b9c700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150550 0x7f09e415dc10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009ec0 tx=0x7f09dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:11.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.641+0000 7f09d97fa700 1 -- 172.21.15.154:0/677458106 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00cc20 con 0x7f09e4150550 2023-10-10T21:15:11.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.641+0000 7f09d97fa700 1 -- 172.21.15.154:0/677458106 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc00f040 con 0x7f09e4150550 2023-10-10T21:15:11.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.641+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e416a0e0 con 0x7f09e4150550 2023-10-10T21:15:11.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.641+0000 7f09d97fa700 1 -- 172.21.15.154:0/677458106 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc014480 con 0x7f09e4150550 2023-10-10T21:15:11.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.641+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e4169810 con 0x7f09e4150550 2023-10-10T21:15:11.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.642+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e416a8e0 con 0x7f09e4150550 2023-10-10T21:15:11.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.643+0000 7f09d97fa700 1 -- 172.21.15.154:0/677458106 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09dc014810 con 0x7f09e4150550 2023-10-10T21:15:11.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.644+0000 7f09d97fa700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f09c8066f30 0x7f09c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:11.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.644+0000 7f09d97fa700 1 -- 172.21.15.154:0/677458106 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f09dc0851f0 con 0x7f09e4150550 2023-10-10T21:15:11.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.644+0000 7f09e939b700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f09c8066f30 0x7f09c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:11.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.645+0000 7f09e939b700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f09c8066f30 0x7f09c80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09e00099b0 tx=0x7f09e0018000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:11.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.648+0000 7f09d97fa700 1 -- 172.21.15.154:0/677458106 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09e416a8e0 con 0x7f09e4150550 2023-10-10T21:15:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.832+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09e416a8e0 con 0x7f09c8066f30 2023-10-10T21:15:11.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.840+0000 7f09d97fa700 1 -- 172.21.15.154:0/677458106 <== mgr.5565 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279806 (secure 0 0 0) 0x7f09e416a8e0 con 0x7f09c8066f30 2023-10-10T21:15:11.845 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:11.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f09c8066f30 msgr2=0x7f09c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f09c8066f30 0x7f09c80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09e00099b0 tx=0x7f09e0018000 comp rx=0 tx=0).stop 2023-10-10T21:15:11.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150550 msgr2=0x7f09e415dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:11.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150550 0x7f09e415dc10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009ec0 tx=0x7f09dc00b040 comp rx=0 tx=0).stop 2023-10-10T21:15:11.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 shutdown_connections 2023-10-10T21:15:11.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4150550 0x7f09e415dc10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09e40c7410 0x7f09e41692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f09c8066f30 0x7f09c80693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 --2- 172.21.15.154:0/677458106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e4150180 0x7f09e40b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:11.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 >> 172.21.15.154:0/677458106 conn(0x7f09e40cc1f0 msgr2=0x7f09e40c1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:11.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 shutdown_connections 2023-10-10T21:15:11.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:11.845+0000 7f09ea39d700 1 -- 172.21.15.154:0/677458106 wait complete. 2023-10-10T21:15:11.850 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:15:11.863 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:15:10.518488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590956,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":207,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421960,"kb_used_data":6792,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752552760,"statfs":{"total":773094113280,"available":770614026240,"internally_reserved":0,"allocated":6955008,"data_stored":3847684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":588,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457655"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105516+0000","last_change":"2023-10-10T21:15:07.101273+0000","last_active":"2023-10-10T21:15:07.105516+0000","last_peered":"2023-10-10T21:15:07.105516+0000","last_clean":"2023-10-10T21:15:07.105516+0000","last_became_active":"2023-10-10T21:15:07.100986+0000","last_became_peered":"2023-10-10T21:15:07.100986+0000","last_unstale":"2023-10-10T21:15:07.105516+0000","last_undegraded":"2023-10-10T21:15:07.105516+0000","last_fullsized":"2023-10-10T21:15:07.105516+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.296297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107320+0000","last_change":"2023-10-10T21:15:07.106043+0000","last_active":"2023-10-10T21:15:07.107320+0000","last_peered":"2023-10-10T21:15:07.107320+0000","last_clean":"2023-10-10T21:15:07.107320+0000","last_became_active":"2023-10-10T21:15:07.105509+0000","last_became_peered":"2023-10-10T21:15:07.105509+0000","last_unstale":"2023-10-10T21:15:07.107320+0000","last_undegraded":"2023-10-10T21:15:07.107320+0000","last_fullsized":"2023-10-10T21:15:07.107320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:18.210078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107176+0000","last_change":"2023-10-10T21:15:07.101459+0000","last_active":"2023-10-10T21:15:07.107176+0000","last_peered":"2023-10-10T21:15:07.107176+0000","last_clean":"2023-10-10T21:15:07.107176+0000","last_became_active":"2023-10-10T21:15:07.101193+0000","last_became_peered":"2023-10-10T21:15:07.101193+0000","last_unstale":"2023-10-10T21:15:07.107176+0000","last_undegraded":"2023-10-10T21:15:07.107176+0000","last_fullsized":"2023-10-10T21:15:07.107176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:31:25.837715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105365+0000","last_change":"2023-10-10T21:15:07.097858+0000","last_active":"2023-10-10T21:15:07.105365+0000","last_peered":"2023-10-10T21:15:07.105365+0000","last_clean":"2023-10-10T21:15:07.105365+0000","last_became_active":"2023-10-10T21:15:07.097647+0000","last_became_peered":"2023-10-10T21:15:07.097647+0000","last_unstale":"2023-10-10T21:15:07.105365+0000","last_undegraded":"2023-10-10T21:15:07.105365+0000","last_fullsized":"2023-10-10T21:15:07.105365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:13.008471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.111679+0000","last_change":"2023-10-10T21:15:06.092828+0000","last_active":"2023-10-10T21:15:07.111679+0000","last_peered":"2023-10-10T21:15:07.111679+0000","last_clean":"2023-10-10T21:15:07.111679+0000","last_became_active":"2023-10-10T21:15:06.092557+0000","last_became_peered":"2023-10-10T21:15:06.092557+0000","last_unstale":"2023-10-10T21:15:07.111679+0000","last_undegraded":"2023-10-10T21:15:07.111679+0000","last_fullsized":"2023-10-10T21:15:07.111679+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:13.532469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.064760+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:21:13.803869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069737+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:20:01.195252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066996+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:17:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109536+0000","last_change":"2023-10-10T21:15:06.088657+0000","last_active":"2023-10-10T21:15:07.109536+0000","last_peered":"2023-10-10T21:15:07.109536+0000","last_clean":"2023-10-10T21:15:07.109536+0000","last_became_active":"2023-10-10T21:15:06.088320+0000","last_became_peered":"2023-10-10T21:15:06.088320+0000","last_unstale":"2023-10-10T21:15:07.109536+0000","last_undegraded":"2023-10-10T21:15:07.109536+0000","last_fullsized":"2023-10-10T21:15:07.109536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:30.505874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.064448+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063793+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:17.062651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067903+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063785+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067097+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106436+0000","last_change":"2023-10-10T21:15:07.092528+0000","last_active":"2023-10-10T21:15:07.106436+0000","last_peered":"2023-10-10T21:15:07.106436+0000","last_clean":"2023-10-10T21:15:07.106436+0000","last_became_active":"2023-10-10T21:15:07.092265+0000","last_became_peered":"2023-10-10T21:15:07.092265+0000","last_unstale":"2023-10-10T21:15:07.106436+0000","last_undegraded":"2023-10-10T21:15:07.106436+0000","last_fullsized":"2023-10-10T21:15:07.106436+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:10:53.807646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067892+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:23.304984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069475+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:30:14.673983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.117735+0000","last_change":"2023-10-10T21:15:06.089522+0000","last_active":"2023-10-10T21:15:07.117735+0000","last_peered":"2023-10-10T21:15:07.117735+0000","last_clean":"2023-10-10T21:15:07.117735+0000","last_became_active":"2023-10-10T21:15:06.089268+0000","last_became_peered":"2023-10-10T21:15:06.089268+0000","last_unstale":"2023-10-10T21:15:07.117735+0000","last_undegraded":"2023-10-10T21:15:07.117735+0000","last_fullsized":"2023-10-10T21:15:07.117735+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:02.311839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066989+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:59:53.023107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105466+0000","last_change":"2023-10-10T21:15:07.092596+0000","last_active":"2023-10-10T21:15:07.105466+0000","last_peered":"2023-10-10T21:15:07.105466+0000","last_clean":"2023-10-10T21:15:07.105466+0000","last_became_active":"2023-10-10T21:15:07.092320+0000","last_became_peered":"2023-10-10T21:15:07.092320+0000","last_unstale":"2023-10-10T21:15:07.105466+0000","last_undegraded":"2023-10-10T21:15:07.105466+0000","last_fullsized":"2023-10-10T21:15:07.105466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:16:24.209480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091819+0000","last_change":"2023-10-10T21:15:06.089710+0000","last_active":"2023-10-10T21:15:07.091819+0000","last_peered":"2023-10-10T21:15:07.091819+0000","last_clean":"2023-10-10T21:15:07.091819+0000","last_became_active":"2023-10-10T21:15:06.089385+0000","last_became_peered":"2023-10-10T21:15:06.089385+0000","last_unstale":"2023-10-10T21:15:07.091819+0000","last_undegraded":"2023-10-10T21:15:07.091819+0000","last_fullsized":"2023-10-10T21:15:07.091819+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:45.674860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066937+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:18:48.648687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069590+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:56.169031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063775+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:25:40.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063773+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:28.877065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.087569+0000","last_change":"2023-10-10T21:15:06.090826+0000","last_active":"2023-10-10T21:15:07.087569+0000","last_peered":"2023-10-10T21:15:07.087569+0000","last_clean":"2023-10-10T21:15:07.087569+0000","last_became_active":"2023-10-10T21:15:06.090567+0000","last_became_peered":"2023-10-10T21:15:06.090567+0000","last_unstale":"2023-10-10T21:15:07.087569+0000","last_undegraded":"2023-10-10T21:15:07.087569+0000","last_fullsized":"2023-10-10T21:15:07.087569+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:02.927652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106677+0000","last_change":"2023-10-10T21:15:07.103070+0000","last_active":"2023-10-10T21:15:07.106677+0000","last_peered":"2023-10-10T21:15:07.106677+0000","last_clean":"2023-10-10T21:15:07.106677+0000","last_became_active":"2023-10-10T21:15:07.102143+0000","last_became_peered":"2023-10-10T21:15:07.102143+0000","last_unstale":"2023-10-10T21:15:07.106677+0000","last_undegraded":"2023-10-10T21:15:07.106677+0000","last_fullsized":"2023-10-10T21:15:07.106677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:52.486720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109649+0000","last_change":"2023-10-10T21:15:06.089714+0000","last_active":"2023-10-10T21:15:07.109649+0000","last_peered":"2023-10-10T21:15:07.109649+0000","last_clean":"2023-10-10T21:15:07.109649+0000","last_became_active":"2023-10-10T21:15:06.089472+0000","last_became_peered":"2023-10-10T21:15:06.089472+0000","last_unstale":"2023-10-10T21:15:07.109649+0000","last_undegraded":"2023-10-10T21:15:07.109649+0000","last_fullsized":"2023-10-10T21:15:07.109649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:31.996775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063838+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:48.393884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066966+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:20:01.195252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067778+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:39:08.189286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091817+0000","last_change":"2023-10-10T21:15:06.089097+0000","last_active":"2023-10-10T21:15:07.091817+0000","last_peered":"2023-10-10T21:15:07.091817+0000","last_clean":"2023-10-10T21:15:07.091817+0000","last_became_active":"2023-10-10T21:15:06.088816+0000","last_became_peered":"2023-10-10T21:15:06.088816+0000","last_unstale":"2023-10-10T21:15:07.091817+0000","last_undegraded":"2023-10-10T21:15:07.091817+0000","last_fullsized":"2023-10-10T21:15:07.091817+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:58:06.775845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067047+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:25:30.204517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069857+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105498+0000","last_change":"2023-10-10T21:15:07.093269+0000","last_active":"2023-10-10T21:15:07.105498+0000","last_peered":"2023-10-10T21:15:07.105498+0000","last_clean":"2023-10-10T21:15:07.105498+0000","last_became_active":"2023-10-10T21:15:07.093033+0000","last_became_peered":"2023-10-10T21:15:07.093033+0000","last_unstale":"2023-10-10T21:15:07.105498+0000","last_undegraded":"2023-10-10T21:15:07.105498+0000","last_fullsized":"2023-10-10T21:15:07.105498+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:22:26.447544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067153+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:06.418042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107200+0000","last_change":"2023-10-10T21:15:07.103541+0000","last_active":"2023-10-10T21:15:07.107200+0000","last_peered":"2023-10-10T21:15:07.107200+0000","last_clean":"2023-10-10T21:15:07.107200+0000","last_became_active":"2023-10-10T21:15:07.103293+0000","last_became_peered":"2023-10-10T21:15:07.103293+0000","last_unstale":"2023-10-10T21:15:07.107200+0000","last_undegraded":"2023-10-10T21:15:07.107200+0000","last_fullsized":"2023-10-10T21:15:07.107200+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:42.410363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063770+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069749+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:18:48.648687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067455+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.064560+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:12:15.710315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":276,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-10T21:15:02.804752+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:15:02.804752+0000","last_peered":"2023-10-10T21:15:02.804752+0000","last_clean":"2023-10-10T21:15:02.804752+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:15:02.804752+0000","last_undegraded":"2023-10-10T21:15:02.804752+0000","last_fullsized":"2023-10-10T21:15:02.804752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":588,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":1314816,"data_stored":924195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.40400000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.1859999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70599999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.92400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.498},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.45100000000000001,"15min":0.41399999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.123},"last":0.65200000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.71299999999999997},"min":{"1min":0.54600000000000004,"5min":0.48299999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.57999999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.60099999999999998,"5min":0.497,"15min":0.46500000000000002},"max":{"1min":1.0249999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.49099999999999999},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.056},"last":0.53300000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.621},"min":{"1min":0.42999999999999999,"5min":0.374,"15min":0.33500000000000002},"max":{"1min":0.81799999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.40799999999999997},"max":{"1min":0.97399999999999998,"5min":0.98299999999999998,"15min":1.022},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.376},"max":{"1min":0.90600000000000003,"5min":0.91300000000000003,"15min":0.98899999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.629,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":0.98699999999999999,"15min":1.135},"last":0.79500000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302088,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069752,"statfs":{"total":96636764160,"available":96327426048,"internally_reserved":0,"allocated":720896,"data_stored":333827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.45000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.90000000000000002,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.71899999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.41099999999999998},"max":{"1min":0.84799999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.51000000000000001,"5min":0.45500000000000002,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.0129999999999999,"15min":1.143},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":1.073,"15min":1.073},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":0.98199999999999998,"15min":1.151},"last":0.62},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.498,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46300000000000002},"max":{"1min":0.94799999999999995,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.627,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.746,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.345},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":1.048,"15min":1.238},"last":0.76000000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72799999999999998,"15min":0.745},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.202},"last":0.82299999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.251},"max":{"1min":0.61799999999999999,"5min":0.73199999999999998,"15min":1.258},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":0.81599999999999995,"15min":1.964},"last":0.30199999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.29599999999999999},"max":{"1min":0.66200000000000003,"5min":0.80300000000000005,"15min":1.4550000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":2.085},"last":0.40699999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.8919999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.80400000000000005,"15min":2.117},"last":0.51800000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.024,"5min":1.0509999999999999,"15min":2.052},"last":0.747},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":0.91600000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.036,"5min":1.0409999999999999,"15min":1.181},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79900000000000004},"min":{"1min":0.625,"5min":0.502,"15min":0.46400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":2.012},"last":0.77200000000000002}]},{"osd":6,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.63200000000000001,"5min":0.55600000000000005,"15min":0.51200000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":2.25},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.53400000000000003},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":2.169},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.79500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298572,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073268,"statfs":{"total":96636764160,"available":96331026432,"internally_reserved":0,"allocated":1314816,"data_stored":924195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.68000000000000005,"5min":0.752,"15min":1.4890000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.78200000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":1.706},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.1739999999999999},"last":0.503}]},{"osd":3,"last update":"Tue Oct 10 21:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.30399999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.6499999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":1.2909999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82399999999999995,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":1.101,"5min":1.1040000000000001,"15min":1.2270000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":0.77100000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.78200000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.371},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80800000000000005,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":0.94099999999999995,"5min":1.1439999999999999,"15min":1.3899999999999999},"last":0.624}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.82999999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.874,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.1339999999999999,"15min":1.306},"last":0.67200000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85599999999999998,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.503},"max":{"1min":1.1319999999999999,"5min":1.169,"15min":1.363},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85799999999999998,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.60099999999999998,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.165,"15min":1.3300000000000001},"last":0.755}]}]},{"osd":2,"up_from":14,"seq":60129542302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306172,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065668,"statfs":{"total":96636764160,"available":96323244032,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.28699999999999998},"max":{"1min":0.59299999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39700000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":1.2070000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.88800000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.85999999999999999},"last":0.437}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77000000000000002,"15min":0.76500000000000001},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":1.286,"15min":1.3220000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.46600000000000003},"max":{"1min":0.97099999999999997,"5min":1.1659999999999999,"15min":1.2849999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93799999999999994,"5min":1.196,"15min":1.385},"last":0.752},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51900000000000002},"max":{"1min":0.94999999999999996,"5min":1.268,"15min":1.268},"last":0.88400000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.61199999999999999,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":0.98099999999999998,"5min":1.3080000000000001,"15min":1.3400000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":1.022,"5min":1.107,"15min":1.3759999999999999},"last":0.90000000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51200000000000001},"max":{"1min":1.0049999999999999,"5min":1.1659999999999999,"15min":1.2},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.625,"5min":0.57399999999999995,"15min":0.49199999999999999},"max":{"1min":0.95699999999999996,"5min":1.2330000000000001,"15min":1.3109999999999999},"last":0.84699999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509598,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":770048,"data_stored":354835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":0.58199999999999996,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.378},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":1.544},"last":0.48199999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":1.6759999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.66500000000000004,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.45200000000000001,"5min":0.42399999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.78900000000000003,"15min":1.7070000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.38700000000000001},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.439}]},{"osd":4,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.434},"max":{"1min":1.0529999999999999,"5min":1.107,"15min":1.6359999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.80100000000000005,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1859999999999999,"5min":1.246,"15min":1.246},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78800000000000003,"15min":0.77200000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.262},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.48699999999999999},"max":{"1min":0.94299999999999995,"5min":1.1579999999999999,"15min":1.579},"last":0.61499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52900000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":1.1040000000000001,"15min":1.6080000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82999999999999996,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51300000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.3200000000000001},"last":0.72099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306172,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065668,"statfs":{"total":96636764160,"available":96323244032,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.69599999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.752},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95399999999999996,"5min":0.96499999999999997,"15min":1.758},"last":0.78000000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.42099999999999999},"max":{"1min":0.93000000000000005,"5min":1.1359999999999999,"15min":1.47},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.437},"max":{"1min":0.85199999999999998,"5min":0.95499999999999996,"15min":1.929},"last":0.747}]},{"osd":2,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.48999999999999999},"max":{"1min":0.96199999999999997,"5min":1.02,"15min":1.6890000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.3100000000000001,"15min":1.468},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.75800000000000001},"min":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.0820000000000001,"15min":1.397},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.385,"15min":1.385},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63400000000000001,"15min":0.68400000000000005},"min":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.39900000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.38100000000000001},"max":{"1min":0.93000000000000005,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.0609999999999999,"15min":1.464},"last":0.82699999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.97899999999999998,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.42199999999999999},"max":{"1min":0.91300000000000003,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.879}]}]},{"osd":5,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.92000000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.747,"15min":0.71299999999999997},"min":{"1min":0.57599999999999996,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.95899999999999996,"15min":1.371},"last":0.58499999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.42599999999999999,"15min":0.38500000000000001},"max":{"1min":0.93300000000000005,"5min":0.96599999999999997,"15min":3.895},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.83299999999999996},"min":{"1min":0.49199999999999999,"5min":0.41699999999999998,"15min":0.39000000000000001},"max":{"1min":0.90700000000000003,"5min":1.018,"15min":8.9909999999999997},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.71499999999999997},"min":{"1min":0.58899999999999997,"5min":0.44900000000000001,"15min":0.439},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2889999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.82699999999999996,"5min":0.93300000000000005,"15min":1.3540000000000001},"last":0.71299999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.437},"max":{"1min":0.871,"5min":0.99299999999999999,"15min":8.9309999999999992},"last":0.63},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.502,"15min":0.45900000000000002},"max":{"1min":0.89000000000000001,"5min":1.044,"15min":2.9409999999999998},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":9.0250000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83299999999999996,"5min":0.89200000000000002,"15min":4.2789999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.85899999999999999},"min":{"1min":0.57499999999999996,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":0.95399999999999996,"5min":0.96899999999999997,"15min":8.8480000000000008},"last":0.79900000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.74299999999999999},"min":{"1min":0.503,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93500000000000005,"5min":0.95499999999999996,"15min":2.8900000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68799999999999994,"15min":0.754},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.98899999999999999,"15min":3.9420000000000002},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:15:11.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:15:12.058 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-10-10T21:15:12.057+0000 7feecd7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:15:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.085+0000 7f343e3ff700 1 Processor -- start 2023-10-10T21:15:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.085+0000 7f343e3ff700 1 -- start start 2023-10-10T21:15:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.087+0000 7f343e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380cbf30 0x7f34380ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.087+0000 7f343e3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f34380ccf90 0x7f34380b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.087+0000 7f343e3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34380cc300 con 0x7f343815a270 2023-10-10T21:15:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.087+0000 7f343e3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3438156bf0 con 0x7f34380ccf90 2023-10-10T21:15:12.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.087+0000 7f343e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34380ae950 con 0x7f34380cbf30 2023-10-10T21:15:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.087+0000 7f3437fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380cbf30 0x7f34380ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.087+0000 7f3437fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380cbf30 0x7f34380ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:57390/0 (socket says 172.21.15.154:57390) 2023-10-10T21:15:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.087+0000 7f3437fff700 1 -- 172.21.15.154:0/3393553671 learned_addr learned my addr 172.21.15.154:0/3393553671 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.087+0000 7f342ffff700 1 --2- 172.21.15.154:0/3393553671 >> v2:172.21.15.179:3300/0 conn(0x7f34380ccf90 0x7f34380b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.088+0000 7f3437fff700 1 -- 172.21.15.154:0/3393553671 >> v2:172.21.15.179:3300/0 conn(0x7f34380ccf90 msgr2=0x7f34380b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.088+0000 7f3437fff700 1 --2- 172.21.15.154:0/3393553671 >> v2:172.21.15.179:3300/0 conn(0x7f34380ccf90 0x7f34380b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.088+0000 7f3437fff700 1 -- 172.21.15.154:0/3393553671 >> v1:172.21.15.179:6789/0 conn(0x7f343815a270 legacy=0x7f34380c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.088+0000 7f3437fff700 1 -- 172.21.15.154:0/3393553671 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380ad370 con 0x7f34380cbf30 2023-10-10T21:15:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.088+0000 7f34377fe700 1 -- 172.21.15.154:0/3393553671 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576231787 0 0) 0x7f34380cc300 con 0x7f343815a270 2023-10-10T21:15:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.088+0000 7f3437fff700 1 --2- 172.21.15.154:0/3393553671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380cbf30 0x7f34380ae410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34280099b0 tx=0x7f3428009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=338df8c20d55e642 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.088+0000 7f34377fe700 1 -- 172.21.15.154:0/3393553671 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428009ea0 con 0x7f34380cbf30 2023-10-10T21:15:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.088+0000 7f34377fe700 1 -- 172.21.15.154:0/3393553671 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342800b860 con 0x7f34380cbf30 2023-10-10T21:15:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.089+0000 7f34377fe700 1 -- 172.21.15.154:0/3393553671 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800bc00 con 0x7f34380cbf30 2023-10-10T21:15:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.089+0000 7f343e3ff700 1 -- 172.21.15.154:0/3393553671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380cbf30 msgr2=0x7f34380ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.089+0000 7f343e3ff700 1 --2- 172.21.15.154:0/3393553671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380cbf30 0x7f34380ae410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34280099b0 tx=0x7f3428009250 comp rx=0 tx=0).stop 2023-10-10T21:15:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.089+0000 7f343e3ff700 1 -- 172.21.15.154:0/3393553671 shutdown_connections 2023-10-10T21:15:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.089+0000 7f343e3ff700 1 --2- 172.21.15.154:0/3393553671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380cbf30 0x7f34380ae410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.089+0000 7f343e3ff700 1 --2- 172.21.15.154:0/3393553671 >> v2:172.21.15.179:3300/0 conn(0x7f34380ccf90 0x7f34380b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.089+0000 7f343e3ff700 1 -- 172.21.15.154:0/3393553671 >> 172.21.15.154:0/3393553671 conn(0x7f343806a320 msgr2=0x7f34380cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.089+0000 7f343e3ff700 1 -- 172.21.15.154:0/3393553671 shutdown_connections 2023-10-10T21:15:12.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.089+0000 7f343e3ff700 1 -- 172.21.15.154:0/3393553671 wait complete. 2023-10-10T21:15:12.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.091+0000 7f343e3ff700 1 Processor -- start 2023-10-10T21:15:12.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.091+0000 7f343e3ff700 1 -- start start 2023-10-10T21:15:12.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f343e3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34380cbf30 0x7f34380c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f343e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380ccf90 0x7f34380a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f343e3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f343815a270 0x7f34380a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f343e3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34380ab050 con 0x7f34380cbf30 2023-10-10T21:15:12.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f343e3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343816a2b0 con 0x7f343815a270 2023-10-10T21:15:12.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f343e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34380aa440 con 0x7f34380ccf90 2023-10-10T21:15:12.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f3437fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34380cbf30 0x7f34380c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f3437fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34380cbf30 0x7f34380c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39428/0 (socket says 172.21.15.154:39428) 2023-10-10T21:15:12.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f3437fff700 1 -- 172.21.15.154:0/3544280556 learned_addr learned my addr 172.21.15.154:0/3544280556 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:12.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f342ffff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380ccf90 0x7f34380a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f343c99c700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f343815a270 0x7f34380a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f3437fff700 1 -- 172.21.15.154:0/3544280556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380ccf90 msgr2=0x7f34380a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f3437fff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380ccf90 0x7f34380a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f3437fff700 1 -- 172.21.15.154:0/3544280556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f343815a270 msgr2=0x7f34380a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f3437fff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f343815a270 0x7f34380a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.092+0000 7f3437fff700 1 -- 172.21.15.154:0/3544280556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280094f0 con 0x7f34380cbf30 2023-10-10T21:15:12.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.093+0000 7f3437fff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34380cbf30 0x7f34380c3ad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3428006fd0 tx=0x7f3428017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:12.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.093+0000 7f3434ff9700 1 -- 172.21.15.154:0/3544280556 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342801f070 con 0x7f34380cbf30 2023-10-10T21:15:12.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.093+0000 7f3434ff9700 1 -- 172.21.15.154:0/3544280556 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428000c90 con 0x7f34380cbf30 2023-10-10T21:15:12.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.093+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34380aa720 con 0x7f34380cbf30 2023-10-10T21:15:12.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.093+0000 7f3434ff9700 1 -- 172.21.15.154:0/3544280556 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428025420 con 0x7f34380cbf30 2023-10-10T21:15:12.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.093+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34380aace0 con 0x7f34380cbf30 2023-10-10T21:15:12.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.094+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343804c3c0 con 0x7f34380cbf30 2023-10-10T21:15:12.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.095+0000 7f3434ff9700 1 -- 172.21.15.154:0/3544280556 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3428023070 con 0x7f34380cbf30 2023-10-10T21:15:12.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.096+0000 7f3434ff9700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3418066f30 0x7f34180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.096+0000 7f3434ff9700 1 -- 172.21.15.154:0/3544280556 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3428085b90 con 0x7f34380cbf30 2023-10-10T21:15:12.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.096+0000 7f342ffff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3418066f30 0x7f34180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.097+0000 7f342ffff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3418066f30 0x7f34180693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34380abfe0 tx=0x7f3420008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:12.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.100+0000 7f3434ff9700 1 -- 172.21.15.154:0/3544280556 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3428052bf0 con 0x7f34380cbf30 2023-10-10T21:15:12.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.287+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34380ab190 con 0x7f3418066f30 2023-10-10T21:15:12.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.295+0000 7f3434ff9700 1 -- 172.21.15.154:0/3544280556 <== mgr.5565 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279806 (secure 0 0 0) 0x7f3420009e50 con 0x7f3418066f30 2023-10-10T21:15:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:12.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.299+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3418066f30 msgr2=0x7f34180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.299+0000 7f343e3ff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3418066f30 0x7f34180693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34380abfe0 tx=0x7f3420008040 comp rx=0 tx=0).stop 2023-10-10T21:15:12.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.299+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34380cbf30 msgr2=0x7f34380c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.299+0000 7f343e3ff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34380cbf30 0x7f34380c3ad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3428006fd0 tx=0x7f3428017000 comp rx=0 tx=0).stop 2023-10-10T21:15:12.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.300+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 shutdown_connections 2023-10-10T21:15:12.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.300+0000 7f343e3ff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3418066f30 0x7f34180693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.300+0000 7f343e3ff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f343815a270 0x7f34380a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.300+0000 7f343e3ff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34380cbf30 0x7f34380c3ad0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.300+0000 7f343e3ff700 1 --2- 172.21.15.154:0/3544280556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34380ccf90 0x7f34380a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.300+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 >> 172.21.15.154:0/3544280556 conn(0x7f343806a320 msgr2=0x7f34380c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:12.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.300+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 shutdown_connections 2023-10-10T21:15:12.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.300+0000 7f343e3ff700 1 -- 172.21.15.154:0/3544280556 wait complete. 2023-10-10T21:15:12.309 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:15:12.318 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:15:10.518488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590956,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":207,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421960,"kb_used_data":6792,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752552760,"statfs":{"total":773094113280,"available":770614026240,"internally_reserved":0,"allocated":6955008,"data_stored":3847684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":588,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457655"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105516+0000","last_change":"2023-10-10T21:15:07.101273+0000","last_active":"2023-10-10T21:15:07.105516+0000","last_peered":"2023-10-10T21:15:07.105516+0000","last_clean":"2023-10-10T21:15:07.105516+0000","last_became_active":"2023-10-10T21:15:07.100986+0000","last_became_peered":"2023-10-10T21:15:07.100986+0000","last_unstale":"2023-10-10T21:15:07.105516+0000","last_undegraded":"2023-10-10T21:15:07.105516+0000","last_fullsized":"2023-10-10T21:15:07.105516+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.296297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107320+0000","last_change":"2023-10-10T21:15:07.106043+0000","last_active":"2023-10-10T21:15:07.107320+0000","last_peered":"2023-10-10T21:15:07.107320+0000","last_clean":"2023-10-10T21:15:07.107320+0000","last_became_active":"2023-10-10T21:15:07.105509+0000","last_became_peered":"2023-10-10T21:15:07.105509+0000","last_unstale":"2023-10-10T21:15:07.107320+0000","last_undegraded":"2023-10-10T21:15:07.107320+0000","last_fullsized":"2023-10-10T21:15:07.107320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:18.210078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107176+0000","last_change":"2023-10-10T21:15:07.101459+0000","last_active":"2023-10-10T21:15:07.107176+0000","last_peered":"2023-10-10T21:15:07.107176+0000","last_clean":"2023-10-10T21:15:07.107176+0000","last_became_active":"2023-10-10T21:15:07.101193+0000","last_became_peered":"2023-10-10T21:15:07.101193+0000","last_unstale":"2023-10-10T21:15:07.107176+0000","last_undegraded":"2023-10-10T21:15:07.107176+0000","last_fullsized":"2023-10-10T21:15:07.107176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:31:25.837715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105365+0000","last_change":"2023-10-10T21:15:07.097858+0000","last_active":"2023-10-10T21:15:07.105365+0000","last_peered":"2023-10-10T21:15:07.105365+0000","last_clean":"2023-10-10T21:15:07.105365+0000","last_became_active":"2023-10-10T21:15:07.097647+0000","last_became_peered":"2023-10-10T21:15:07.097647+0000","last_unstale":"2023-10-10T21:15:07.105365+0000","last_undegraded":"2023-10-10T21:15:07.105365+0000","last_fullsized":"2023-10-10T21:15:07.105365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:13.008471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.111679+0000","last_change":"2023-10-10T21:15:06.092828+0000","last_active":"2023-10-10T21:15:07.111679+0000","last_peered":"2023-10-10T21:15:07.111679+0000","last_clean":"2023-10-10T21:15:07.111679+0000","last_became_active":"2023-10-10T21:15:06.092557+0000","last_became_peered":"2023-10-10T21:15:06.092557+0000","last_unstale":"2023-10-10T21:15:07.111679+0000","last_undegraded":"2023-10-10T21:15:07.111679+0000","last_fullsized":"2023-10-10T21:15:07.111679+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:13.532469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.064760+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:21:13.803869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069737+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:20:01.195252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066996+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:17:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109536+0000","last_change":"2023-10-10T21:15:06.088657+0000","last_active":"2023-10-10T21:15:07.109536+0000","last_peered":"2023-10-10T21:15:07.109536+0000","last_clean":"2023-10-10T21:15:07.109536+0000","last_became_active":"2023-10-10T21:15:06.088320+0000","last_became_peered":"2023-10-10T21:15:06.088320+0000","last_unstale":"2023-10-10T21:15:07.109536+0000","last_undegraded":"2023-10-10T21:15:07.109536+0000","last_fullsized":"2023-10-10T21:15:07.109536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:30.505874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.064448+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063793+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:17.062651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067903+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063785+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067097+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106436+0000","last_change":"2023-10-10T21:15:07.092528+0000","last_active":"2023-10-10T21:15:07.106436+0000","last_peered":"2023-10-10T21:15:07.106436+0000","last_clean":"2023-10-10T21:15:07.106436+0000","last_became_active":"2023-10-10T21:15:07.092265+0000","last_became_peered":"2023-10-10T21:15:07.092265+0000","last_unstale":"2023-10-10T21:15:07.106436+0000","last_undegraded":"2023-10-10T21:15:07.106436+0000","last_fullsized":"2023-10-10T21:15:07.106436+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:10:53.807646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067892+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:23.304984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069475+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:30:14.673983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.117735+0000","last_change":"2023-10-10T21:15:06.089522+0000","last_active":"2023-10-10T21:15:07.117735+0000","last_peered":"2023-10-10T21:15:07.117735+0000","last_clean":"2023-10-10T21:15:07.117735+0000","last_became_active":"2023-10-10T21:15:06.089268+0000","last_became_peered":"2023-10-10T21:15:06.089268+0000","last_unstale":"2023-10-10T21:15:07.117735+0000","last_undegraded":"2023-10-10T21:15:07.117735+0000","last_fullsized":"2023-10-10T21:15:07.117735+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:02.311839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066989+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:59:53.023107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105466+0000","last_change":"2023-10-10T21:15:07.092596+0000","last_active":"2023-10-10T21:15:07.105466+0000","last_peered":"2023-10-10T21:15:07.105466+0000","last_clean":"2023-10-10T21:15:07.105466+0000","last_became_active":"2023-10-10T21:15:07.092320+0000","last_became_peered":"2023-10-10T21:15:07.092320+0000","last_unstale":"2023-10-10T21:15:07.105466+0000","last_undegraded":"2023-10-10T21:15:07.105466+0000","last_fullsized":"2023-10-10T21:15:07.105466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:16:24.209480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091819+0000","last_change":"2023-10-10T21:15:06.089710+0000","last_active":"2023-10-10T21:15:07.091819+0000","last_peered":"2023-10-10T21:15:07.091819+0000","last_clean":"2023-10-10T21:15:07.091819+0000","last_became_active":"2023-10-10T21:15:06.089385+0000","last_became_peered":"2023-10-10T21:15:06.089385+0000","last_unstale":"2023-10-10T21:15:07.091819+0000","last_undegraded":"2023-10-10T21:15:07.091819+0000","last_fullsized":"2023-10-10T21:15:07.091819+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:45.674860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066937+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:18:48.648687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069590+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:56.169031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063775+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:25:40.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063773+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:28.877065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.087569+0000","last_change":"2023-10-10T21:15:06.090826+0000","last_active":"2023-10-10T21:15:07.087569+0000","last_peered":"2023-10-10T21:15:07.087569+0000","last_clean":"2023-10-10T21:15:07.087569+0000","last_became_active":"2023-10-10T21:15:06.090567+0000","last_became_peered":"2023-10-10T21:15:06.090567+0000","last_unstale":"2023-10-10T21:15:07.087569+0000","last_undegraded":"2023-10-10T21:15:07.087569+0000","last_fullsized":"2023-10-10T21:15:07.087569+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:02.927652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106677+0000","last_change":"2023-10-10T21:15:07.103070+0000","last_active":"2023-10-10T21:15:07.106677+0000","last_peered":"2023-10-10T21:15:07.106677+0000","last_clean":"2023-10-10T21:15:07.106677+0000","last_became_active":"2023-10-10T21:15:07.102143+0000","last_became_peered":"2023-10-10T21:15:07.102143+0000","last_unstale":"2023-10-10T21:15:07.106677+0000","last_undegraded":"2023-10-10T21:15:07.106677+0000","last_fullsized":"2023-10-10T21:15:07.106677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:52.486720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109649+0000","last_change":"2023-10-10T21:15:06.089714+0000","last_active":"2023-10-10T21:15:07.109649+0000","last_peered":"2023-10-10T21:15:07.109649+0000","last_clean":"2023-10-10T21:15:07.109649+0000","last_became_active":"2023-10-10T21:15:06.089472+0000","last_became_peered":"2023-10-10T21:15:06.089472+0000","last_unstale":"2023-10-10T21:15:07.109649+0000","last_undegraded":"2023-10-10T21:15:07.109649+0000","last_fullsized":"2023-10-10T21:15:07.109649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:31.996775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063838+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:48.393884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.066966+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:20:01.195252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067778+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:39:08.189286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091817+0000","last_change":"2023-10-10T21:15:06.089097+0000","last_active":"2023-10-10T21:15:07.091817+0000","last_peered":"2023-10-10T21:15:07.091817+0000","last_clean":"2023-10-10T21:15:07.091817+0000","last_became_active":"2023-10-10T21:15:06.088816+0000","last_became_peered":"2023-10-10T21:15:06.088816+0000","last_unstale":"2023-10-10T21:15:07.091817+0000","last_undegraded":"2023-10-10T21:15:07.091817+0000","last_fullsized":"2023-10-10T21:15:07.091817+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:58:06.775845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067047+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:25:30.204517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069857+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105498+0000","last_change":"2023-10-10T21:15:07.093269+0000","last_active":"2023-10-10T21:15:07.105498+0000","last_peered":"2023-10-10T21:15:07.105498+0000","last_clean":"2023-10-10T21:15:07.105498+0000","last_became_active":"2023-10-10T21:15:07.093033+0000","last_became_peered":"2023-10-10T21:15:07.093033+0000","last_unstale":"2023-10-10T21:15:07.105498+0000","last_undegraded":"2023-10-10T21:15:07.105498+0000","last_fullsized":"2023-10-10T21:15:07.105498+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:22:26.447544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067153+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:06.418042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107200+0000","last_change":"2023-10-10T21:15:07.103541+0000","last_active":"2023-10-10T21:15:07.107200+0000","last_peered":"2023-10-10T21:15:07.107200+0000","last_clean":"2023-10-10T21:15:07.107200+0000","last_became_active":"2023-10-10T21:15:07.103293+0000","last_became_peered":"2023-10-10T21:15:07.103293+0000","last_unstale":"2023-10-10T21:15:07.107200+0000","last_undegraded":"2023-10-10T21:15:07.107200+0000","last_fullsized":"2023-10-10T21:15:07.107200+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:42.410363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.063770+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.069749+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:18:48.648687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.067455+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:15:06.060127+0000","last_change":"2023-10-10T21:15:06.060127+0000","last_active":"2023-10-10T21:15:06.060127+0000","last_peered":"2023-10-10T21:15:06.060127+0000","last_clean":"2023-10-10T21:15:06.060127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:06.060127+0000","last_undegraded":"2023-10-10T21:15:06.060127+0000","last_fullsized":"2023-10-10T21:15:06.060127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:15:05.054602+0000","last_change":"2023-10-10T21:15:05.064560+0000","last_active":"2023-10-10T21:15:05.054602+0000","last_peered":"2023-10-10T21:15:05.054602+0000","last_clean":"2023-10-10T21:15:05.054602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:15:05.054602+0000","last_undegraded":"2023-10-10T21:15:05.054602+0000","last_fullsized":"2023-10-10T21:15:05.054602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:12:15.710315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":276,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-10T21:15:02.804752+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:15:02.804752+0000","last_peered":"2023-10-10T21:15:02.804752+0000","last_clean":"2023-10-10T21:15:02.804752+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:15:02.804752+0000","last_undegraded":"2023-10-10T21:15:02.804752+0000","last_fullsized":"2023-10-10T21:15:02.804752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":588,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":1314816,"data_stored":924195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.40400000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.1859999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70599999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.92400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.498},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.45100000000000001,"15min":0.41399999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.123},"last":0.65200000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.71299999999999997},"min":{"1min":0.54600000000000004,"5min":0.48299999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.57999999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.60099999999999998,"5min":0.497,"15min":0.46500000000000002},"max":{"1min":1.0249999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.49099999999999999},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.056},"last":0.53300000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.621},"min":{"1min":0.42999999999999999,"5min":0.374,"15min":0.33500000000000002},"max":{"1min":0.81799999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.40799999999999997},"max":{"1min":0.97399999999999998,"5min":0.98299999999999998,"15min":1.022},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.376},"max":{"1min":0.90600000000000003,"5min":0.91300000000000003,"15min":0.98899999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.629,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":0.98699999999999999,"15min":1.135},"last":0.79500000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302088,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069752,"statfs":{"total":96636764160,"available":96327426048,"internally_reserved":0,"allocated":720896,"data_stored":333827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.45000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.90000000000000002,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.71899999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.41099999999999998},"max":{"1min":0.84799999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.51000000000000001,"5min":0.45500000000000002,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.0129999999999999,"15min":1.143},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":1.073,"15min":1.073},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":0.98199999999999998,"15min":1.151},"last":0.62},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.498,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46300000000000002},"max":{"1min":0.94799999999999995,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.627,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.746,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.345},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":1.048,"15min":1.238},"last":0.76000000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72799999999999998,"15min":0.745},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.202},"last":0.82299999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.251},"max":{"1min":0.61799999999999999,"5min":0.73199999999999998,"15min":1.258},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":0.81599999999999995,"15min":1.964},"last":0.30199999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.29599999999999999},"max":{"1min":0.66200000000000003,"5min":0.80300000000000005,"15min":1.4550000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":2.085},"last":0.40699999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.8919999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.80400000000000005,"15min":2.117},"last":0.51800000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.024,"5min":1.0509999999999999,"15min":2.052},"last":0.747},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":0.91600000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.036,"5min":1.0409999999999999,"15min":1.181},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79900000000000004},"min":{"1min":0.625,"5min":0.502,"15min":0.46400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":2.012},"last":0.77200000000000002}]},{"osd":6,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.63200000000000001,"5min":0.55600000000000005,"15min":0.51200000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":2.25},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.53400000000000003},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":2.169},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.79500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298572,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073268,"statfs":{"total":96636764160,"available":96331026432,"internally_reserved":0,"allocated":1314816,"data_stored":924195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.68000000000000005,"5min":0.752,"15min":1.4890000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.78200000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":1.706},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.1739999999999999},"last":0.503}]},{"osd":3,"last update":"Tue Oct 10 21:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.30399999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.6499999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":1.2909999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82399999999999995,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":1.101,"5min":1.1040000000000001,"15min":1.2270000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":0.77100000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.78200000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.371},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80800000000000005,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":0.94099999999999995,"5min":1.1439999999999999,"15min":1.3899999999999999},"last":0.624}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.82999999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.874,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.1339999999999999,"15min":1.306},"last":0.67200000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85599999999999998,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.503},"max":{"1min":1.1319999999999999,"5min":1.169,"15min":1.363},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85799999999999998,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.60099999999999998,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.165,"15min":1.3300000000000001},"last":0.755}]}]},{"osd":2,"up_from":14,"seq":60129542302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306172,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065668,"statfs":{"total":96636764160,"available":96323244032,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.28699999999999998},"max":{"1min":0.59299999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39700000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":1.2070000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.88800000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.85999999999999999},"last":0.437}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77000000000000002,"15min":0.76500000000000001},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":1.286,"15min":1.3220000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.46600000000000003},"max":{"1min":0.97099999999999997,"5min":1.1659999999999999,"15min":1.2849999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93799999999999994,"5min":1.196,"15min":1.385},"last":0.752},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51900000000000002},"max":{"1min":0.94999999999999996,"5min":1.268,"15min":1.268},"last":0.88400000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.61199999999999999,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":0.98099999999999998,"5min":1.3080000000000001,"15min":1.3400000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":1.022,"5min":1.107,"15min":1.3759999999999999},"last":0.90000000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51200000000000001},"max":{"1min":1.0049999999999999,"5min":1.1659999999999999,"15min":1.2},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.625,"5min":0.57399999999999995,"15min":0.49199999999999999},"max":{"1min":0.95699999999999996,"5min":1.2330000000000001,"15min":1.3109999999999999},"last":0.84699999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509598,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":770048,"data_stored":354835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":0.58199999999999996,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.378},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":1.544},"last":0.48199999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":1.6759999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.66500000000000004,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.45200000000000001,"5min":0.42399999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.78900000000000003,"15min":1.7070000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.38700000000000001},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.439}]},{"osd":4,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.434},"max":{"1min":1.0529999999999999,"5min":1.107,"15min":1.6359999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.80100000000000005,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1859999999999999,"5min":1.246,"15min":1.246},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78800000000000003,"15min":0.77200000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.262},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.48699999999999999},"max":{"1min":0.94299999999999995,"5min":1.1579999999999999,"15min":1.579},"last":0.61499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52900000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":1.1040000000000001,"15min":1.6080000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82999999999999996,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51300000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.3200000000000001},"last":0.72099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306172,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065668,"statfs":{"total":96636764160,"available":96323244032,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.69599999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.752},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95399999999999996,"5min":0.96499999999999997,"15min":1.758},"last":0.78000000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.42099999999999999},"max":{"1min":0.93000000000000005,"5min":1.1359999999999999,"15min":1.47},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.437},"max":{"1min":0.85199999999999998,"5min":0.95499999999999996,"15min":1.929},"last":0.747}]},{"osd":2,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.48999999999999999},"max":{"1min":0.96199999999999997,"5min":1.02,"15min":1.6890000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.3100000000000001,"15min":1.468},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.75800000000000001},"min":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.0820000000000001,"15min":1.397},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.385,"15min":1.385},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63400000000000001,"15min":0.68400000000000005},"min":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.39900000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.38100000000000001},"max":{"1min":0.93000000000000005,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.0609999999999999,"15min":1.464},"last":0.82699999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.97899999999999998,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.42199999999999999},"max":{"1min":0.91300000000000003,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.879}]}]},{"osd":5,"up_from":14,"seq":60129542300,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":327658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.92000000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.747,"15min":0.71299999999999997},"min":{"1min":0.57599999999999996,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.95899999999999996,"15min":1.371},"last":0.58499999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.42599999999999999,"15min":0.38500000000000001},"max":{"1min":0.93300000000000005,"5min":0.96599999999999997,"15min":3.895},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.83299999999999996},"min":{"1min":0.49199999999999999,"5min":0.41699999999999998,"15min":0.39000000000000001},"max":{"1min":0.90700000000000003,"5min":1.018,"15min":8.9909999999999997},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.71499999999999997},"min":{"1min":0.58899999999999997,"5min":0.44900000000000001,"15min":0.439},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2889999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.82699999999999996,"5min":0.93300000000000005,"15min":1.3540000000000001},"last":0.71299999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.437},"max":{"1min":0.871,"5min":0.99299999999999999,"15min":8.9309999999999992},"last":0.63},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.502,"15min":0.45900000000000002},"max":{"1min":0.89000000000000001,"5min":1.044,"15min":2.9409999999999998},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":9.0250000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83299999999999996,"5min":0.89200000000000002,"15min":4.2789999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.85899999999999999},"min":{"1min":0.57499999999999996,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":0.95399999999999996,"5min":0.96899999999999997,"15min":8.8480000000000008},"last":0.79900000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.74299999999999999},"min":{"1min":0.503,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93500000000000005,"5min":0.95499999999999996,"15min":2.8900000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68799999999999994,"15min":0.754},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.98899999999999999,"15min":3.9420000000000002},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:15:12.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-10-10T21:15:12.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-10-10T21:15:12.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-10-10T21:15:12.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-10-10T21:15:12.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-10-10T21:15:12.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-10-10T21:15:12.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-10-10T21:15:12.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-10-10T21:15:12.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-10-10T21:15:12.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-10-10T21:15:12.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-10-10T21:15:12.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-10-10T21:15:12.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-10-10T21:15:12.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-10-10T21:15:12.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-10-10T21:15:12.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-10-10T21:15:12.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-10-10T21:15:12.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-10-10T21:15:12.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-10-10T21:15:12.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-10-10T21:15:12.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-10-10T21:15:12.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-10-10T21:15:12.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-10-10T21:15:12.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-10-10T21:15:12.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-10-10T21:15:12.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-10-10T21:15:12.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-10-10T21:15:12.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-10-10T21:15:12.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-10-10T21:15:12.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-10-10T21:15:12.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-10-10T21:15:12.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.064760+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:21:13.803869+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:15:12.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-10-10T21:15:12.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-10-10T21:15:12.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.069737+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:20:01.195252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:15:12.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-10-10T21:15:12.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-10-10T21:15:12.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.066996+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:17:59.089464+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:15:12.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-10-10T21:15:12.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-10-10T21:15:12.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-10-10T21:15:12.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.064448+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:15:12.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-10-10T21:15:12.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-10-10T21:15:12.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.063793+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:38:17.062651+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:15:12.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-10-10T21:15:12.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-10-10T21:15:12.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.067903+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:15:12.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-10-10T21:15:12.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-10-10T21:15:12.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.063785+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:15:12.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-10-10T21:15:12.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-10-10T21:15:12.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.067097+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:15:12.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-10-10T21:15:12.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.067892+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:16:23.304984+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:15:12.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-10-10T21:15:12.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-10-10T21:15:12.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.069475+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:30:14.673983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:15:12.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-10-10T21:15:12.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-10-10T21:15:12.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-10-10T21:15:12.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.066989+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:59:53.023107+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:15:12.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-10-10T21:15:12.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-10-10T21:15:12.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.066937+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:18:48.648687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:15:12.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-10-10T21:15:12.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-10-10T21:15:12.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.069590+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:02:56.169031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:15:12.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-10-10T21:15:12.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-10-10T21:15:12.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.063775+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T21:25:40.360752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:15:12.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-10-10T21:15:12.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-10-10T21:15:12.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.063773+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:57:28.877065+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:15:12.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-10-10T21:15:12.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-10-10T21:15:12.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-10-10T21:15:12.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.063838+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:26:48.393884+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:15:12.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-10-10T21:15:12.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-10-10T21:15:12.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.066966+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:20:01.195252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:15:12.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-10-10T21:15:12.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-10-10T21:15:12.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.067778+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:39:08.189286+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:15:12.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-10-10T21:15:12.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-10-10T21:15:12.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-10-10T21:15:12.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.067047+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:25:30.204517+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:15:12.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-10-10T21:15:12.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-10-10T21:15:12.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.069857+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:15:12.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-10-10T21:15:12.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.067153+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:58:06.418042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:15:12.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-10-10T21:15:12.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.063770+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T21:16:59.107011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:15:12.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-10-10T21:15:12.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-10-10T21:15:12.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.069749+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:18:48.648687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:15:12.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-10-10T21:15:12.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-10-10T21:15:12.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.067455+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:15:12.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-10-10T21:15:12.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:15:06.060127+0000', 'last_change': '2023-10-10T21:15:06.060127+0000', 'last_active': '2023-10-10T21:15:06.060127+0000', 'last_peered': '2023-10-10T21:15:06.060127+0000', 'last_clean': '2023-10-10T21:15:06.060127+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:06.060127+0000', 'last_undegraded': '2023-10-10T21:15:06.060127+0000', 'last_fullsized': '2023-10-10T21:15:06.060127+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:06.060127+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:15:12.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-10-10T21:15:12.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:15:05.054602+0000', 'last_change': '2023-10-10T21:15:05.064560+0000', 'last_active': '2023-10-10T21:15:05.054602+0000', 'last_peered': '2023-10-10T21:15:05.054602+0000', 'last_clean': '2023-10-10T21:15:05.054602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:15:05.054602+0000', 'last_undegraded': '2023-10-10T21:15:05.054602+0000', 'last_fullsized': '2023-10-10T21:15:05.054602+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'last_clean_scrub_stamp': '2023-10-10T21:15:05.054602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:12:15.710315+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:15:12.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T21:15:12.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.570+0000 7f21733ff700 1 Processor -- start 2023-10-10T21:15:12.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.570+0000 7f21733ff700 1 -- start start 2023-10-10T21:15:12.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.571+0000 7f21733ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f216c156510 0x7f216c0ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.571+0000 7f21733ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f216c0acd40 0x7f216c1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.572+0000 7f21733ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c153f10 con 0x7f216c156e20 2023-10-10T21:15:12.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.572+0000 7f21733ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c0ad9d0 con 0x7f216c0acd40 2023-10-10T21:15:12.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.572+0000 7f21733ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0aed00 con 0x7f216c156510 2023-10-10T21:15:12.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.572+0000 7f217199c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f216c156e20 0x7f216c0afc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36350/0 (socket says 172.21.15.154:36350) 2023-10-10T21:15:12.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.572+0000 7f217199c700 1 -- 172.21.15.154:0/3134039370 learned_addr learned my addr 172.21.15.154:0/3134039370 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:12.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.572+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262364260 0 0) 0x7f216c153f10 con 0x7f216c156e20 2023-10-10T21:15:12.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.572+0000 7f217119b700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f216c156510 0x7f216c0ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.572+0000 7f217099a700 1 --2- 172.21.15.154:0/3134039370 >> v2:172.21.15.179:3300/0 conn(0x7f216c0acd40 0x7f216c1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.572+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2158004680 con 0x7f216c156e20 2023-10-10T21:15:12.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 797159572 0 0) 0x7f2158004680 con 0x7f216c156e20 2023-10-10T21:15:12.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f216c156510 msgr2=0x7f216c0ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:12.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f216c156510 0x7f216c0ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 >> v2:172.21.15.179:3300/0 conn(0x7f216c0acd40 msgr2=0x7f216c1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:12.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 --2- 172.21.15.154:0/3134039370 >> v2:172.21.15.179:3300/0 conn(0x7f216c0acd40 0x7f216c1568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0af800 con 0x7f216c156e20 2023-10-10T21:15:12.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f21640017f0 con 0x7f216c156e20 2023-10-10T21:15:12.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 >> v1:172.21.15.154:6789/0 conn(0x7f216c156e20 legacy=0x7f216c0afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2158004bf0 0x7f2158005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2158005920 0x7f2158005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f216c156510 0x7f21580062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0ad9d0 con 0x7f2158004bf0 2023-10-10T21:15:12.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0aed00 con 0x7f2158005920 2023-10-10T21:15:12.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2158003540 con 0x7f216c156510 2023-10-10T21:15:12.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f217119b700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2158004bf0 0x7f2158005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f217099a700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2158005920 0x7f2158005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f217199c700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f216c156510 0x7f21580062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f217119b700 1 -- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f216c156510 msgr2=0x7f21580062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:12.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f217119b700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f216c156510 0x7f21580062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f217119b700 1 -- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2158005920 msgr2=0x7f2158005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:12.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f217119b700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2158005920 0x7f2158005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f217119b700 1 -- 172.21.15.154:0/3134039370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158004680 con 0x7f2158004bf0 2023-10-10T21:15:12.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.573+0000 7f217099a700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2158005920 0x7f2158005d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:12.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f217119b700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2158004bf0 0x7f2158005000 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f216800beb0 tx=0x7f216800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d260318c892ca065 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:12.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168010c00 con 0x7f2158004bf0 2023-10-10T21:15:12.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2168010d60 con 0x7f2158004bf0 2023-10-10T21:15:12.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f2163fff700 1 -- 172.21.15.154:0/3134039370 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168011680 con 0x7f2158004bf0 2023-10-10T21:15:12.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f21733ff700 1 -- 172.21.15.154:0/3134039370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2158004bf0 msgr2=0x7f2158005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f21733ff700 1 --2- 172.21.15.154:0/3134039370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2158004bf0 0x7f2158005000 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f216800beb0 tx=0x7f216800b430 comp rx=0 tx=0).stop 2023-10-10T21:15:12.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f217199c700 1 -- 172.21.15.154:0/3134039370 reap_dead start 2023-10-10T21:15:12.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f21733ff700 1 -- 172.21.15.154:0/3134039370 shutdown_connections 2023-10-10T21:15:12.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f21733ff700 1 -- 172.21.15.154:0/3134039370 >> 172.21.15.154:0/3134039370 conn(0x7f216c06a310 msgr2=0x7f216c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:12.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f21733ff700 1 -- 172.21.15.154:0/3134039370 shutdown_connections 2023-10-10T21:15:12.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.574+0000 7f21733ff700 1 -- 172.21.15.154:0/3134039370 wait complete. 2023-10-10T21:15:12.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.576+0000 7f21733ff700 1 Processor -- start 2023-10-10T21:15:12.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.576+0000 7f21733ff700 1 -- start start 2023-10-10T21:15:12.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f21733ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2158004bf0 0x7f216c144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f21733ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0c12d0 0x7f216c0c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f21733ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f216c0aa290 0x7f216c0aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f21733ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c9c60 con 0x7f216c0c12d0 2023-10-10T21:15:12.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f21733ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c1c80 con 0x7f216c0aa290 2023-10-10T21:15:12.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f21733ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0ca8a0 con 0x7f2158004bf0 2023-10-10T21:15:12.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f217099a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0c12d0 0x7f216c0c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f217099a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0c12d0 0x7f216c0c1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39448/0 (socket says 172.21.15.154:39448) 2023-10-10T21:15:12.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f217099a700 1 -- 172.21.15.154:0/3546637316 learned_addr learned my addr 172.21.15.154:0/3546637316 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:12.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f217119b700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2158004bf0 0x7f216c144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.577+0000 7f217199c700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f216c0aa290 0x7f216c0aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f217099a700 1 -- 172.21.15.154:0/3546637316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2158004bf0 msgr2=0x7f216c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f217099a700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2158004bf0 0x7f216c144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f217099a700 1 -- 172.21.15.154:0/3546637316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f216c0aa290 msgr2=0x7f216c0aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f217099a700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f216c0aa290 0x7f216c0aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f217099a700 1 -- 172.21.15.154:0/3546637316 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0ca290 con 0x7f216c0c12d0 2023-10-10T21:15:12.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f217119b700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2158004bf0 0x7f216c144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:15:12.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f217099a700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0c12d0 0x7f216c0c1740 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f215c0118e0 tx=0x7f215c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:12.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f21617fa700 1 -- 172.21.15.154:0/3546637316 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c015670 con 0x7f216c0c12d0 2023-10-10T21:15:12.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f21617fa700 1 -- 172.21.15.154:0/3546637316 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c0157d0 con 0x7f216c0c12d0 2023-10-10T21:15:12.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f21617fa700 1 -- 172.21.15.154:0/3546637316 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c015b70 con 0x7f216c0c12d0 2023-10-10T21:15:12.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c0aac00 con 0x7f216c0c12d0 2023-10-10T21:15:12.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.578+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c0ca530 con 0x7f216c0c12d0 2023-10-10T21:15:12.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.579+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c0b12f0 con 0x7f216c0c12d0 2023-10-10T21:15:12.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.580+0000 7f21617fa700 1 -- 172.21.15.154:0/3546637316 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f215c013410 con 0x7f216c0c12d0 2023-10-10T21:15:12.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.581+0000 7f21617fa700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2150066f30 0x7f21500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:12.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.581+0000 7f21617fa700 1 -- 172.21.15.154:0/3546637316 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f215c084d70 con 0x7f216c0c12d0 2023-10-10T21:15:12.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.581+0000 7f217119b700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2150066f30 0x7f21500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:12.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.582+0000 7f217119b700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2150066f30 0x7f21500693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f216800b2c0 tx=0x7f216801c000 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:12.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.585+0000 7f21617fa700 1 -- 172.21.15.154:0/3546637316 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f215c051e70 con 0x7f216c0c12d0 2023-10-10T21:15:12.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.855+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f216c04c3c0 con 0x7f216c0c12d0 2023-10-10T21:15:12.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.855+0000 7f21617fa700 1 -- 172.21.15.154:0/3546637316 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1176 (secure 0 0 0) 0x7f215c055490 con 0x7f216c0c12d0 2023-10-10T21:15:12.857 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:12.857 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":797,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":64,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":55},{"state_name":"creating+peering","count":25},{"state_name":"active+clean","count":17}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590956,"bytes_used":2480087040,"bytes_avail":770614026240,"bytes_total":773094113280,"unknown_pgs_ratio":0.56701028347015381,"inactive_pgs_ratio":0.25773194432258606,"write_bytes_sec":1313,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":22,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5751}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-10T21:04:36.307528+0000","services":{}},"progress_events":{}} 2023-10-10T21:15:12.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2150066f30 msgr2=0x7f21500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2150066f30 0x7f21500693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f216800b2c0 tx=0x7f216801c000 comp rx=0 tx=0).stop 2023-10-10T21:15:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0c12d0 msgr2=0x7f216c0c1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0c12d0 0x7f216c0c1740 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f215c0118e0 tx=0x7f215c008040 comp rx=0 tx=0).stop 2023-10-10T21:15:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 shutdown_connections 2023-10-10T21:15:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2150066f30 0x7f21500693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f216c0aa290 0x7f216c0aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2158004bf0 0x7f216c144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 --2- 172.21.15.154:0/3546637316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0c12d0 0x7f216c0c1740 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 >> 172.21.15.154:0/3546637316 conn(0x7f216c06a310 msgr2=0x7f216c0afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 shutdown_connections 2023-10-10T21:15:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:12.858+0000 7f21733ff700 1 -- 172.21.15.154:0/3546637316 wait complete. 2023-10-10T21:15:12.877 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T21:15:12.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:15:13.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.059+0000 7f7f1bfff700 1 Processor -- start 2023-10-10T21:15:13.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.059+0000 7f7f1bfff700 1 -- start start 2023-10-10T21:15:13.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f1bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f14155c10 0x7f7f14155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:13.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f1bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7f140ac230 0x7f7f140ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:13.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f1bfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f140ad930 con 0x7f7f141568a0 2023-10-10T21:15:13.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f1bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f140acd20 con 0x7f7f140ac230 2023-10-10T21:15:13.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f1bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140ad000 con 0x7f7f14155c10 2023-10-10T21:15:13.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f1a59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7f141568a0 0x7f7f14156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36358/0 (socket says 172.21.15.154:36358) 2023-10-10T21:15:13.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f1a59c700 1 -- 172.21.15.154:0/2380379245 learned_addr learned my addr 172.21.15.154:0/2380379245 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:13.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f19d9b700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f14155c10 0x7f7f14155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:13.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f1959a700 1 --2- 172.21.15.154:0/2380379245 >> v2:172.21.15.179:3300/0 conn(0x7f7f140ac230 0x7f7f140ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:13.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284977664 0 0) 0x7f7f140ad930 con 0x7f7f141568a0 2023-10-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.061+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f00003570 con 0x7f7f141568a0 2023-10-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641572177 0 0) 0x7f7f00003570 con 0x7f7f141568a0 2023-10-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f14155c10 msgr2=0x7f7f14155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f14155c10 0x7f7f14155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 >> v2:172.21.15.179:3300/0 conn(0x7f7f140ac230 msgr2=0x7f7f140ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:13.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 --2- 172.21.15.154:0/2380379245 >> v2:172.21.15.179:3300/0 conn(0x7f7f140ac230 0x7f7f140ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140ad2e0 con 0x7f7f141568a0 2023-10-10T21:15:13.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f7f0c0017f0 con 0x7f7f141568a0 2023-10-10T21:15:13.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 >> v1:172.21.15.154:6789/0 conn(0x7f7f141568a0 legacy=0x7f7f14156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:13.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00003a60 0x7f7f00003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:13.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f00004810 0x7f7f00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:13.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f000051c0 0x7f7f0000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:13.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140acd20 con 0x7f7f000051c0 2023-10-10T21:15:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140ad000 con 0x7f7f00003a60 2023-10-10T21:15:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0000bfa0 con 0x7f7f00004810 2023-10-10T21:15:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f19d9b700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f14155c10 0x7f7f14155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:15:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f1a59c700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f000051c0 0x7f7f0000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f1959a700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f00004810 0x7f7f00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.062+0000 7f7f19d9b700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00003a60 0x7f7f00003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.063+0000 7f7f1a59c700 1 -- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f00004810 msgr2=0x7f7f00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.063+0000 7f7f1a59c700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f00004810 0x7f7f00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.063+0000 7f7f1a59c700 1 -- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00003a60 msgr2=0x7f7f00003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.063+0000 7f7f1a59c700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00003a60 0x7f7f00003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.063+0000 7f7f1a59c700 1 -- 172.21.15.154:0/2380379245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00003570 con 0x7f7f000051c0 2023-10-10T21:15:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.063+0000 7f7f1a59c700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f000051c0 0x7f7f0000ba60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00a970 tx=0x7f7f140ad8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a71b523d4912bc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.063+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0070d0 con 0x7f7f000051c0 2023-10-10T21:15:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.063+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c007270 con 0x7f7f000051c0 2023-10-10T21:15:13.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.063+0000 7f7f18d99700 1 -- 172.21.15.154:0/2380379245 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c007630 con 0x7f7f000051c0 2023-10-10T21:15:13.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.064+0000 7f7f1bfff700 1 -- 172.21.15.154:0/2380379245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f000051c0 msgr2=0x7f7f0000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:13.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.064+0000 7f7f1bfff700 1 --2- 172.21.15.154:0/2380379245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f000051c0 0x7f7f0000ba60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00a970 tx=0x7f7f140ad8a0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.064+0000 7f7f1a59c700 1 -- 172.21.15.154:0/2380379245 reap_dead start 2023-10-10T21:15:13.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.064+0000 7f7f1bfff700 1 -- 172.21.15.154:0/2380379245 shutdown_connections 2023-10-10T21:15:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.064+0000 7f7f1bfff700 1 -- 172.21.15.154:0/2380379245 >> 172.21.15.154:0/2380379245 conn(0x7f7f1406a320 msgr2=0x7f7f140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.064+0000 7f7f1bfff700 1 -- 172.21.15.154:0/2380379245 shutdown_connections 2023-10-10T21:15:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.064+0000 7f7f1bfff700 1 -- 172.21.15.154:0/2380379245 wait complete. 2023-10-10T21:15:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.065+0000 7f7f1bfff700 1 Processor -- start 2023-10-10T21:15:13.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.065+0000 7f7f1bfff700 1 -- start start 2023-10-10T21:15:13.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f1bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f000051c0 0x7f7f14169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:13.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f1bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f1415e240 0x7f7f1415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:13.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f1bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f1415e6b0 0x7f7f1415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:13.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f1bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1415b8f0 con 0x7f7f1415e6b0 2023-10-10T21:15:13.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f1bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14158eb0 con 0x7f7f1415e240 2023-10-10T21:15:13.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f1bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1415b640 con 0x7f7f000051c0 2023-10-10T21:15:13.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f1a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f1415e6b0 0x7f7f1415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:13.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f1a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f1415e6b0 0x7f7f1415b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39468/0 (socket says 172.21.15.154:39468) 2023-10-10T21:15:13.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f1a59c700 1 -- 172.21.15.154:0/3835664413 learned_addr learned my addr 172.21.15.154:0/3835664413 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:13.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.066+0000 7f7f19d9b700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f000051c0 0x7f7f14169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:13.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f1959a700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f1415e240 0x7f7f1415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:13.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f1a59c700 1 -- 172.21.15.154:0/3835664413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f000051c0 msgr2=0x7f7f14169c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f1a59c700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f000051c0 0x7f7f14169c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f1a59c700 1 -- 172.21.15.154:0/3835664413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f1415e240 msgr2=0x7f7f1415abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f1a59c700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f1415e240 0x7f7f1415abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f1a59c700 1 -- 172.21.15.154:0/3835664413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14158580 con 0x7f7f1415e6b0 2023-10-10T21:15:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f1a59c700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f1415e6b0 0x7f7f1415b100 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c000f80 tx=0x7f7f0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f09ffb700 1 -- 172.21.15.154:0/3835664413 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c023070 con 0x7f7f1415e6b0 2023-10-10T21:15:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f09ffb700 1 -- 172.21.15.154:0/3835664413 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c0017b0 con 0x7f7f1415e6b0 2023-10-10T21:15:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f09ffb700 1 -- 172.21.15.154:0/3835664413 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0070d0 con 0x7f7f1415e6b0 2023-10-10T21:15:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f14158860 con 0x7f7f1415e6b0 2023-10-10T21:15:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.067+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1416a1a0 con 0x7f7f1415e6b0 2023-10-10T21:15:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.068+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1416a390 con 0x7f7f1415e6b0 2023-10-10T21:15:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.069+0000 7f7f09ffb700 1 -- 172.21.15.154:0/3835664413 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f0c01e430 con 0x7f7f1415e6b0 2023-10-10T21:15:13.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.070+0000 7f7f09ffb700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7ef8066f30 0x7f7ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:13.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.070+0000 7f7f09ffb700 1 -- 172.21.15.154:0/3835664413 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7f0c086900 con 0x7f7f1415e6b0 2023-10-10T21:15:13.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.070+0000 7f7f19d9b700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7ef8066f30 0x7f7ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:13.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.071+0000 7f7f19d9b700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7ef8066f30 0x7f7ef80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f100093f0 tx=0x7f7f10008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:13.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.074+0000 7f7f09ffb700 1 -- 172.21.15.154:0/3835664413 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f0c053a00 con 0x7f7f1415e6b0 2023-10-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.262+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f14159040 con 0x7f7ef8066f30 2023-10-10T21:15:13.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.271+0000 7f7f09ffb700 1 -- 172.21.15.154:0/3835664413 <== mgr.5565 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289080 (secure 0 0 0) 0x7f7f14159040 con 0x7f7ef8066f30 2023-10-10T21:15:13.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:13.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7ef8066f30 msgr2=0x7f7ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:13.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7ef8066f30 0x7f7ef80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f100093f0 tx=0x7f7f10008040 comp rx=0 tx=0).stop 2023-10-10T21:15:13.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f1415e6b0 msgr2=0x7f7f1415b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f1415e6b0 0x7f7f1415b100 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c000f80 tx=0x7f7f0c016000 comp rx=0 tx=0).stop 2023-10-10T21:15:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 shutdown_connections 2023-10-10T21:15:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f1415e6b0 0x7f7f1415b100 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f000051c0 0x7f7f14169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7ef8066f30 0x7f7ef80693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 --2- 172.21.15.154:0/3835664413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f1415e240 0x7f7f1415abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 >> 172.21.15.154:0/3835664413 conn(0x7f7f1406a320 msgr2=0x7f7f1406e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 shutdown_connections 2023-10-10T21:15:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:13.275+0000 7f7f1bfff700 1 -- 172.21.15.154:0/3835664413 wait complete. 2023-10-10T21:15:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:15:13.294 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-10T21:15:12.518838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426408,"kb_used_data":7144,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752548312,"statfs":{"total":773094113280,"available":770609471488,"internally_reserved":0,"allocated":7315456,"data_stored":4019148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.454592"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.100385+0000","last_change":"2023-10-10T21:15:07.098511+0000","last_active":"2023-10-10T21:15:07.100385+0000","last_peered":"2023-10-10T21:15:07.100385+0000","last_clean":"2023-10-10T21:15:07.100385+0000","last_became_active":"2023-10-10T21:15:07.098245+0000","last_became_peered":"2023-10-10T21:15:07.098245+0000","last_unstale":"2023-10-10T21:15:07.100385+0000","last_undegraded":"2023-10-10T21:15:07.100385+0000","last_fullsized":"2023-10-10T21:15:07.100385+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:26:18.039539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118921+0000","last_change":"2023-10-10T21:15:07.116515+0000","last_active":"2023-10-10T21:15:07.118921+0000","last_peered":"2023-10-10T21:15:07.118921+0000","last_clean":"2023-10-10T21:15:07.118921+0000","last_became_active":"2023-10-10T21:15:07.116085+0000","last_became_peered":"2023-10-10T21:15:07.116085+0000","last_unstale":"2023-10-10T21:15:07.118921+0000","last_undegraded":"2023-10-10T21:15:07.118921+0000","last_fullsized":"2023-10-10T21:15:07.118921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:30:43.795898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.097349+0000","last_change":"2023-10-10T21:15:07.091266+0000","last_active":"2023-10-10T21:15:07.097349+0000","last_peered":"2023-10-10T21:15:07.097349+0000","last_clean":"2023-10-10T21:15:07.097349+0000","last_became_active":"2023-10-10T21:15:07.090540+0000","last_became_peered":"2023-10-10T21:15:07.090540+0000","last_unstale":"2023-10-10T21:15:07.097349+0000","last_undegraded":"2023-10-10T21:15:07.097349+0000","last_fullsized":"2023-10-10T21:15:07.097349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:59:54.028632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119191+0000","last_change":"2023-10-10T21:15:07.115201+0000","last_active":"2023-10-10T21:15:07.119191+0000","last_peered":"2023-10-10T21:15:07.119191+0000","last_clean":"2023-10-10T21:15:07.119191+0000","last_became_active":"2023-10-10T21:15:07.114890+0000","last_became_peered":"2023-10-10T21:15:07.114890+0000","last_unstale":"2023-10-10T21:15:07.119191+0000","last_undegraded":"2023-10-10T21:15:07.119191+0000","last_fullsized":"2023-10-10T21:15:07.119191+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:35:39.936568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118689+0000","last_change":"2023-10-10T21:15:07.116147+0000","last_active":"2023-10-10T21:15:07.118689+0000","last_peered":"2023-10-10T21:15:07.118689+0000","last_clean":"2023-10-10T21:15:07.118689+0000","last_became_active":"2023-10-10T21:15:07.115845+0000","last_became_peered":"2023-10-10T21:15:07.115845+0000","last_unstale":"2023-10-10T21:15:07.118689+0000","last_undegraded":"2023-10-10T21:15:07.118689+0000","last_fullsized":"2023-10-10T21:15:07.118689+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:57.528533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105516+0000","last_change":"2023-10-10T21:15:07.101273+0000","last_active":"2023-10-10T21:15:07.105516+0000","last_peered":"2023-10-10T21:15:07.105516+0000","last_clean":"2023-10-10T21:15:07.105516+0000","last_became_active":"2023-10-10T21:15:07.100986+0000","last_became_peered":"2023-10-10T21:15:07.100986+0000","last_unstale":"2023-10-10T21:15:07.105516+0000","last_undegraded":"2023-10-10T21:15:07.105516+0000","last_fullsized":"2023-10-10T21:15:07.105516+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.296297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104073+0000","last_change":"2023-10-10T21:15:07.102852+0000","last_active":"2023-10-10T21:15:07.104073+0000","last_peered":"2023-10-10T21:15:07.104073+0000","last_clean":"2023-10-10T21:15:07.104073+0000","last_became_active":"2023-10-10T21:15:07.102518+0000","last_became_peered":"2023-10-10T21:15:07.102518+0000","last_unstale":"2023-10-10T21:15:07.104073+0000","last_undegraded":"2023-10-10T21:15:07.104073+0000","last_fullsized":"2023-10-10T21:15:07.104073+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:32:16.865865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119409+0000","last_change":"2023-10-10T21:15:07.115457+0000","last_active":"2023-10-10T21:15:07.119409+0000","last_peered":"2023-10-10T21:15:07.119409+0000","last_clean":"2023-10-10T21:15:07.119409+0000","last_became_active":"2023-10-10T21:15:07.115270+0000","last_became_peered":"2023-10-10T21:15:07.115270+0000","last_unstale":"2023-10-10T21:15:07.119409+0000","last_undegraded":"2023-10-10T21:15:07.119409+0000","last_fullsized":"2023-10-10T21:15:07.119409+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:10.301679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.120041+0000","last_change":"2023-10-10T21:15:07.114191+0000","last_active":"2023-10-10T21:15:07.120041+0000","last_peered":"2023-10-10T21:15:07.120041+0000","last_clean":"2023-10-10T21:15:07.120041+0000","last_became_active":"2023-10-10T21:15:07.113991+0000","last_became_peered":"2023-10-10T21:15:07.113991+0000","last_unstale":"2023-10-10T21:15:07.120041+0000","last_undegraded":"2023-10-10T21:15:07.120041+0000","last_fullsized":"2023-10-10T21:15:07.120041+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:46:15.242718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119229+0000","last_change":"2023-10-10T21:15:07.115450+0000","last_active":"2023-10-10T21:15:07.119229+0000","last_peered":"2023-10-10T21:15:07.119229+0000","last_clean":"2023-10-10T21:15:07.119229+0000","last_became_active":"2023-10-10T21:15:07.115022+0000","last_became_peered":"2023-10-10T21:15:07.115022+0000","last_unstale":"2023-10-10T21:15:07.119229+0000","last_undegraded":"2023-10-10T21:15:07.119229+0000","last_fullsized":"2023-10-10T21:15:07.119229+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:16:19.050946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118875+0000","last_change":"2023-10-10T21:15:07.115057+0000","last_active":"2023-10-10T21:15:07.118875+0000","last_peered":"2023-10-10T21:15:07.118875+0000","last_clean":"2023-10-10T21:15:07.118875+0000","last_became_active":"2023-10-10T21:15:07.114715+0000","last_became_peered":"2023-10-10T21:15:07.114715+0000","last_unstale":"2023-10-10T21:15:07.118875+0000","last_undegraded":"2023-10-10T21:15:07.118875+0000","last_fullsized":"2023-10-10T21:15:07.118875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:30:43.795898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.094769+0000","last_change":"2023-10-10T21:15:07.091553+0000","last_active":"2023-10-10T21:15:07.094769+0000","last_peered":"2023-10-10T21:15:07.094769+0000","last_clean":"2023-10-10T21:15:07.094769+0000","last_became_active":"2023-10-10T21:15:07.091284+0000","last_became_peered":"2023-10-10T21:15:07.091284+0000","last_unstale":"2023-10-10T21:15:07.094769+0000","last_undegraded":"2023-10-10T21:15:07.094769+0000","last_fullsized":"2023-10-10T21:15:07.094769+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:56:46.378810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106481+0000","last_change":"2023-10-10T21:15:07.103386+0000","last_active":"2023-10-10T21:15:07.106481+0000","last_peered":"2023-10-10T21:15:07.106481+0000","last_clean":"2023-10-10T21:15:07.106481+0000","last_became_active":"2023-10-10T21:15:07.103057+0000","last_became_peered":"2023-10-10T21:15:07.103057+0000","last_unstale":"2023-10-10T21:15:07.106481+0000","last_undegraded":"2023-10-10T21:15:07.106481+0000","last_fullsized":"2023-10-10T21:15:07.106481+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:26:38.700045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118491+0000","last_change":"2023-10-10T21:15:07.114433+0000","last_active":"2023-10-10T21:15:07.118491+0000","last_peered":"2023-10-10T21:15:07.118491+0000","last_clean":"2023-10-10T21:15:07.118491+0000","last_became_active":"2023-10-10T21:15:07.114181+0000","last_became_peered":"2023-10-10T21:15:07.114181+0000","last_unstale":"2023-10-10T21:15:07.118491+0000","last_undegraded":"2023-10-10T21:15:07.118491+0000","last_fullsized":"2023-10-10T21:15:07.118491+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:56:46.378810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107320+0000","last_change":"2023-10-10T21:15:07.106043+0000","last_active":"2023-10-10T21:15:07.107320+0000","last_peered":"2023-10-10T21:15:07.107320+0000","last_clean":"2023-10-10T21:15:07.107320+0000","last_became_active":"2023-10-10T21:15:07.105509+0000","last_became_peered":"2023-10-10T21:15:07.105509+0000","last_unstale":"2023-10-10T21:15:07.107320+0000","last_undegraded":"2023-10-10T21:15:07.107320+0000","last_fullsized":"2023-10-10T21:15:07.107320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:18.210078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.123556+0000","last_change":"2023-10-10T21:15:07.118784+0000","last_active":"2023-10-10T21:15:07.123556+0000","last_peered":"2023-10-10T21:15:07.123556+0000","last_clean":"2023-10-10T21:15:07.123556+0000","last_became_active":"2023-10-10T21:15:07.118463+0000","last_became_peered":"2023-10-10T21:15:07.118463+0000","last_unstale":"2023-10-10T21:15:07.123556+0000","last_undegraded":"2023-10-10T21:15:07.123556+0000","last_fullsized":"2023-10-10T21:15:07.123556+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:18.068176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.096056+0000","last_change":"2023-10-10T21:15:07.089975+0000","last_active":"2023-10-10T21:15:07.096056+0000","last_peered":"2023-10-10T21:15:07.096056+0000","last_clean":"2023-10-10T21:15:07.096056+0000","last_became_active":"2023-10-10T21:15:07.089717+0000","last_became_peered":"2023-10-10T21:15:07.089717+0000","last_unstale":"2023-10-10T21:15:07.096056+0000","last_undegraded":"2023-10-10T21:15:07.096056+0000","last_fullsized":"2023-10-10T21:15:07.096056+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:42:46.240563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118174+0000","last_change":"2023-10-10T21:15:07.115766+0000","last_active":"2023-10-10T21:15:07.118174+0000","last_peered":"2023-10-10T21:15:07.118174+0000","last_clean":"2023-10-10T21:15:07.118174+0000","last_became_active":"2023-10-10T21:15:07.115485+0000","last_became_peered":"2023-10-10T21:15:07.115485+0000","last_unstale":"2023-10-10T21:15:07.118174+0000","last_undegraded":"2023-10-10T21:15:07.118174+0000","last_fullsized":"2023-10-10T21:15:07.118174+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:39:09.194811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.121108+0000","last_change":"2023-10-10T21:15:07.118553+0000","last_active":"2023-10-10T21:15:07.121108+0000","last_peered":"2023-10-10T21:15:07.121108+0000","last_clean":"2023-10-10T21:15:07.121108+0000","last_became_active":"2023-10-10T21:15:07.118255+0000","last_became_peered":"2023-10-10T21:15:07.118255+0000","last_unstale":"2023-10-10T21:15:07.121108+0000","last_undegraded":"2023-10-10T21:15:07.121108+0000","last_fullsized":"2023-10-10T21:15:07.121108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:12:16.715840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.120908+0000","last_change":"2023-10-10T21:15:07.119453+0000","last_active":"2023-10-10T21:15:07.120908+0000","last_peered":"2023-10-10T21:15:07.120908+0000","last_clean":"2023-10-10T21:15:07.120908+0000","last_became_active":"2023-10-10T21:15:07.119198+0000","last_became_peered":"2023-10-10T21:15:07.119198+0000","last_unstale":"2023-10-10T21:15:07.120908+0000","last_undegraded":"2023-10-10T21:15:07.120908+0000","last_fullsized":"2023-10-10T21:15:07.120908+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:55:54.859118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107176+0000","last_change":"2023-10-10T21:15:07.101459+0000","last_active":"2023-10-10T21:15:07.107176+0000","last_peered":"2023-10-10T21:15:07.107176+0000","last_clean":"2023-10-10T21:15:07.107176+0000","last_became_active":"2023-10-10T21:15:07.101193+0000","last_became_peered":"2023-10-10T21:15:07.101193+0000","last_unstale":"2023-10-10T21:15:07.107176+0000","last_undegraded":"2023-10-10T21:15:07.107176+0000","last_fullsized":"2023-10-10T21:15:07.107176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:31:25.837715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118515+0000","last_change":"2023-10-10T21:15:07.114483+0000","last_active":"2023-10-10T21:15:07.118515+0000","last_peered":"2023-10-10T21:15:07.118515+0000","last_clean":"2023-10-10T21:15:07.118515+0000","last_became_active":"2023-10-10T21:15:07.114006+0000","last_became_peered":"2023-10-10T21:15:07.114006+0000","last_unstale":"2023-10-10T21:15:07.118515+0000","last_undegraded":"2023-10-10T21:15:07.118515+0000","last_fullsized":"2023-10-10T21:15:07.118515+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:18:43.718993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104010+0000","last_change":"2023-10-10T21:15:07.100546+0000","last_active":"2023-10-10T21:15:07.104010+0000","last_peered":"2023-10-10T21:15:07.104010+0000","last_clean":"2023-10-10T21:15:07.104010+0000","last_became_active":"2023-10-10T21:15:07.100272+0000","last_became_peered":"2023-10-10T21:15:07.100272+0000","last_unstale":"2023-10-10T21:15:07.104010+0000","last_undegraded":"2023-10-10T21:15:07.104010+0000","last_fullsized":"2023-10-10T21:15:07.104010+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:38.608342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103195+0000","last_change":"2023-10-10T21:15:07.099054+0000","last_active":"2023-10-10T21:15:07.103195+0000","last_peered":"2023-10-10T21:15:07.103195+0000","last_clean":"2023-10-10T21:15:07.103195+0000","last_became_active":"2023-10-10T21:15:07.098773+0000","last_became_peered":"2023-10-10T21:15:07.098773+0000","last_unstale":"2023-10-10T21:15:07.103195+0000","last_undegraded":"2023-10-10T21:15:07.103195+0000","last_fullsized":"2023-10-10T21:15:07.103195+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:10:14.840069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.095623+0000","last_change":"2023-10-10T21:15:07.091778+0000","last_active":"2023-10-10T21:15:07.095623+0000","last_peered":"2023-10-10T21:15:07.095623+0000","last_clean":"2023-10-10T21:15:07.095623+0000","last_became_active":"2023-10-10T21:15:07.091316+0000","last_became_peered":"2023-10-10T21:15:07.091316+0000","last_unstale":"2023-10-10T21:15:07.095623+0000","last_undegraded":"2023-10-10T21:15:07.095623+0000","last_fullsized":"2023-10-10T21:15:07.095623+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:07:35.124904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106503+0000","last_change":"2023-10-10T21:15:07.103800+0000","last_active":"2023-10-10T21:15:07.106503+0000","last_peered":"2023-10-10T21:15:07.106503+0000","last_clean":"2023-10-10T21:15:07.106503+0000","last_became_active":"2023-10-10T21:15:07.103555+0000","last_became_peered":"2023-10-10T21:15:07.103555+0000","last_unstale":"2023-10-10T21:15:07.106503+0000","last_undegraded":"2023-10-10T21:15:07.106503+0000","last_fullsized":"2023-10-10T21:15:07.106503+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:57.676116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091375+0000","last_change":"2023-10-10T21:15:07.089333+0000","last_active":"2023-10-10T21:15:07.091375+0000","last_peered":"2023-10-10T21:15:07.091375+0000","last_clean":"2023-10-10T21:15:07.091375+0000","last_became_active":"2023-10-10T21:15:07.089067+0000","last_became_peered":"2023-10-10T21:15:07.089067+0000","last_unstale":"2023-10-10T21:15:07.091375+0000","last_undegraded":"2023-10-10T21:15:07.091375+0000","last_fullsized":"2023-10-10T21:15:07.091375+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:24.310509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.094744+0000","last_change":"2023-10-10T21:15:07.090919+0000","last_active":"2023-10-10T21:15:07.094744+0000","last_peered":"2023-10-10T21:15:07.094744+0000","last_clean":"2023-10-10T21:15:07.094744+0000","last_became_active":"2023-10-10T21:15:07.089823+0000","last_became_peered":"2023-10-10T21:15:07.089823+0000","last_unstale":"2023-10-10T21:15:07.094744+0000","last_undegraded":"2023-10-10T21:15:07.094744+0000","last_fullsized":"2023-10-10T21:15:07.094744+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:35:39.936568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.097081+0000","last_change":"2023-10-10T21:15:07.094521+0000","last_active":"2023-10-10T21:15:07.097081+0000","last_peered":"2023-10-10T21:15:07.097081+0000","last_clean":"2023-10-10T21:15:07.097081+0000","last_became_active":"2023-10-10T21:15:07.094193+0000","last_became_peered":"2023-10-10T21:15:07.094193+0000","last_unstale":"2023-10-10T21:15:07.097081+0000","last_undegraded":"2023-10-10T21:15:07.097081+0000","last_fullsized":"2023-10-10T21:15:07.097081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:25:05.048719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.100868+0000","last_change":"2023-10-10T21:15:07.097922+0000","last_active":"2023-10-10T21:15:07.100868+0000","last_peered":"2023-10-10T21:15:07.100868+0000","last_clean":"2023-10-10T21:15:07.100868+0000","last_became_active":"2023-10-10T21:15:07.097644+0000","last_became_peered":"2023-10-10T21:15:07.097644+0000","last_unstale":"2023-10-10T21:15:07.100868+0000","last_undegraded":"2023-10-10T21:15:07.100868+0000","last_fullsized":"2023-10-10T21:15:07.100868+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:25:31.210042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105365+0000","last_change":"2023-10-10T21:15:07.097858+0000","last_active":"2023-10-10T21:15:07.105365+0000","last_peered":"2023-10-10T21:15:07.105365+0000","last_clean":"2023-10-10T21:15:07.105365+0000","last_became_active":"2023-10-10T21:15:07.097647+0000","last_became_peered":"2023-10-10T21:15:07.097647+0000","last_unstale":"2023-10-10T21:15:07.105365+0000","last_undegraded":"2023-10-10T21:15:07.105365+0000","last_fullsized":"2023-10-10T21:15:07.105365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:13.008471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.100868+0000","last_change":"2023-10-10T21:15:07.091247+0000","last_active":"2023-10-10T21:15:07.100868+0000","last_peered":"2023-10-10T21:15:07.100868+0000","last_clean":"2023-10-10T21:15:07.100868+0000","last_became_active":"2023-10-10T21:15:07.091011+0000","last_became_peered":"2023-10-10T21:15:07.091011+0000","last_unstale":"2023-10-10T21:15:07.100868+0000","last_undegraded":"2023-10-10T21:15:07.100868+0000","last_fullsized":"2023-10-10T21:15:07.100868+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:27.253735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.108424+0000","last_change":"2023-10-10T21:15:07.107295+0000","last_active":"2023-10-10T21:15:07.108424+0000","last_peered":"2023-10-10T21:15:07.108424+0000","last_clean":"2023-10-10T21:15:07.108424+0000","last_became_active":"2023-10-10T21:15:07.107040+0000","last_became_peered":"2023-10-10T21:15:07.107040+0000","last_unstale":"2023-10-10T21:15:07.108424+0000","last_undegraded":"2023-10-10T21:15:07.108424+0000","last_fullsized":"2023-10-10T21:15:07.108424+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:07:35.124904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.111679+0000","last_change":"2023-10-10T21:15:06.092828+0000","last_active":"2023-10-10T21:15:07.111679+0000","last_peered":"2023-10-10T21:15:07.111679+0000","last_clean":"2023-10-10T21:15:07.111679+0000","last_became_active":"2023-10-10T21:15:06.092557+0000","last_became_peered":"2023-10-10T21:15:06.092557+0000","last_unstale":"2023-10-10T21:15:07.111679+0000","last_undegraded":"2023-10-10T21:15:07.111679+0000","last_fullsized":"2023-10-10T21:15:07.111679+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:13.532469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.097228+0000","last_change":"2023-10-10T21:15:07.094640+0000","last_active":"2023-10-10T21:15:07.097228+0000","last_peered":"2023-10-10T21:15:07.097228+0000","last_clean":"2023-10-10T21:15:07.097228+0000","last_became_active":"2023-10-10T21:15:07.094345+0000","last_became_peered":"2023-10-10T21:15:07.094345+0000","last_unstale":"2023-10-10T21:15:07.097228+0000","last_undegraded":"2023-10-10T21:15:07.097228+0000","last_fullsized":"2023-10-10T21:15:07.097228+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:16:30.373404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112467+0000","last_change":"2023-10-10T21:15:06.091709+0000","last_active":"2023-10-10T21:15:07.112467+0000","last_peered":"2023-10-10T21:15:07.112467+0000","last_clean":"2023-10-10T21:15:07.112467+0000","last_became_active":"2023-10-10T21:15:06.091434+0000","last_became_peered":"2023-10-10T21:15:06.091434+0000","last_unstale":"2023-10-10T21:15:07.112467+0000","last_undegraded":"2023-10-10T21:15:07.112467+0000","last_fullsized":"2023-10-10T21:15:07.112467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:47:32.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.100331+0000","last_change":"2023-10-10T21:15:07.094649+0000","last_active":"2023-10-10T21:15:07.100331+0000","last_peered":"2023-10-10T21:15:07.100331+0000","last_clean":"2023-10-10T21:15:07.100331+0000","last_became_active":"2023-10-10T21:15:07.094397+0000","last_became_peered":"2023-10-10T21:15:07.094397+0000","last_unstale":"2023-10-10T21:15:07.100331+0000","last_undegraded":"2023-10-10T21:15:07.100331+0000","last_fullsized":"2023-10-10T21:15:07.100331+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:10.301679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.108515+0000","last_change":"2023-10-10T21:15:06.088094+0000","last_active":"2023-10-10T21:15:07.108515+0000","last_peered":"2023-10-10T21:15:07.108515+0000","last_clean":"2023-10-10T21:15:07.108515+0000","last_became_active":"2023-10-10T21:15:06.087823+0000","last_became_peered":"2023-10-10T21:15:06.087823+0000","last_unstale":"2023-10-10T21:15:07.108515+0000","last_undegraded":"2023-10-10T21:15:07.108515+0000","last_fullsized":"2023-10-10T21:15:07.108515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.102132+0000","last_change":"2023-10-10T21:15:07.099450+0000","last_active":"2023-10-10T21:15:07.102132+0000","last_peered":"2023-10-10T21:15:07.102132+0000","last_clean":"2023-10-10T21:15:07.102132+0000","last_became_active":"2023-10-10T21:15:07.099154+0000","last_became_peered":"2023-10-10T21:15:07.099154+0000","last_unstale":"2023-10-10T21:15:07.102132+0000","last_undegraded":"2023-10-10T21:15:07.102132+0000","last_fullsized":"2023-10-10T21:15:07.102132+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:10:14.840069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112486+0000","last_change":"2023-10-10T21:15:06.087703+0000","last_active":"2023-10-10T21:15:07.112486+0000","last_peered":"2023-10-10T21:15:07.112486+0000","last_clean":"2023-10-10T21:15:07.112486+0000","last_became_active":"2023-10-10T21:15:06.087414+0000","last_became_peered":"2023-10-10T21:15:06.087414+0000","last_unstale":"2023-10-10T21:15:07.112486+0000","last_undegraded":"2023-10-10T21:15:07.112486+0000","last_fullsized":"2023-10-10T21:15:07.112486+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:05:44.422914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.099562+0000","last_change":"2023-10-10T21:15:07.096133+0000","last_active":"2023-10-10T21:15:07.099562+0000","last_peered":"2023-10-10T21:15:07.099562+0000","last_clean":"2023-10-10T21:15:07.099562+0000","last_became_active":"2023-10-10T21:15:07.095833+0000","last_became_peered":"2023-10-10T21:15:07.095833+0000","last_unstale":"2023-10-10T21:15:07.099562+0000","last_undegraded":"2023-10-10T21:15:07.099562+0000","last_fullsized":"2023-10-10T21:15:07.099562+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:05:45.428439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109536+0000","last_change":"2023-10-10T21:15:06.088657+0000","last_active":"2023-10-10T21:15:07.109536+0000","last_peered":"2023-10-10T21:15:07.109536+0000","last_clean":"2023-10-10T21:15:07.109536+0000","last_became_active":"2023-10-10T21:15:06.088320+0000","last_became_peered":"2023-10-10T21:15:06.088320+0000","last_unstale":"2023-10-10T21:15:07.109536+0000","last_undegraded":"2023-10-10T21:15:07.109536+0000","last_fullsized":"2023-10-10T21:15:07.109536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:30.505874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118936+0000","last_change":"2023-10-10T21:15:07.115118+0000","last_active":"2023-10-10T21:15:07.118936+0000","last_peered":"2023-10-10T21:15:07.118936+0000","last_clean":"2023-10-10T21:15:07.118936+0000","last_became_active":"2023-10-10T21:15:07.114743+0000","last_became_peered":"2023-10-10T21:15:07.114743+0000","last_unstale":"2023-10-10T21:15:07.118936+0000","last_undegraded":"2023-10-10T21:15:07.118936+0000","last_fullsized":"2023-10-10T21:15:07.118936+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:05:45.428439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.110987+0000","last_change":"2023-10-10T21:15:06.084039+0000","last_active":"2023-10-10T21:15:07.110987+0000","last_peered":"2023-10-10T21:15:07.110987+0000","last_clean":"2023-10-10T21:15:07.110987+0000","last_became_active":"2023-10-10T21:15:06.083773+0000","last_became_peered":"2023-10-10T21:15:06.083773+0000","last_unstale":"2023-10-10T21:15:07.110987+0000","last_undegraded":"2023-10-10T21:15:07.110987+0000","last_fullsized":"2023-10-10T21:15:07.110987+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:25:04.043194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119387+0000","last_change":"2023-10-10T21:15:07.115375+0000","last_active":"2023-10-10T21:15:07.119387+0000","last_peered":"2023-10-10T21:15:07.119387+0000","last_clean":"2023-10-10T21:15:07.119387+0000","last_became_active":"2023-10-10T21:15:07.114686+0000","last_became_peered":"2023-10-10T21:15:07.114686+0000","last_unstale":"2023-10-10T21:15:07.119387+0000","last_undegraded":"2023-10-10T21:15:07.119387+0000","last_fullsized":"2023-10-10T21:15:07.119387+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:51.580942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.082087+0000","last_change":"2023-10-10T21:15:06.081290+0000","last_active":"2023-10-10T21:15:07.082087+0000","last_peered":"2023-10-10T21:15:07.082087+0000","last_clean":"2023-10-10T21:15:07.082087+0000","last_became_active":"2023-10-10T21:15:06.081006+0000","last_became_peered":"2023-10-10T21:15:06.081006+0000","last_unstale":"2023-10-10T21:15:07.082087+0000","last_undegraded":"2023-10-10T21:15:07.082087+0000","last_fullsized":"2023-10-10T21:15:07.082087+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:58:37.051603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103179+0000","last_change":"2023-10-10T21:15:07.099811+0000","last_active":"2023-10-10T21:15:07.103179+0000","last_peered":"2023-10-10T21:15:07.103179+0000","last_clean":"2023-10-10T21:15:07.103179+0000","last_became_active":"2023-10-10T21:15:07.099438+0000","last_became_peered":"2023-10-10T21:15:07.099438+0000","last_unstale":"2023-10-10T21:15:07.103179+0000","last_undegraded":"2023-10-10T21:15:07.103179+0000","last_fullsized":"2023-10-10T21:15:07.103179+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:58:38.057128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103570+0000","last_change":"2023-10-10T21:15:06.083230+0000","last_active":"2023-10-10T21:15:07.103570+0000","last_peered":"2023-10-10T21:15:07.103570+0000","last_clean":"2023-10-10T21:15:07.103570+0000","last_became_active":"2023-10-10T21:15:06.082892+0000","last_became_peered":"2023-10-10T21:15:06.082892+0000","last_unstale":"2023-10-10T21:15:07.103570+0000","last_undegraded":"2023-10-10T21:15:07.103570+0000","last_fullsized":"2023-10-10T21:15:07.103570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:25:04.043194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118192+0000","last_change":"2023-10-10T21:15:07.115851+0000","last_active":"2023-10-10T21:15:07.118192+0000","last_peered":"2023-10-10T21:15:07.118192+0000","last_clean":"2023-10-10T21:15:07.118192+0000","last_became_active":"2023-10-10T21:15:07.115495+0000","last_became_peered":"2023-10-10T21:15:07.115495+0000","last_unstale":"2023-10-10T21:15:07.118192+0000","last_undegraded":"2023-10-10T21:15:07.118192+0000","last_fullsized":"2023-10-10T21:15:07.118192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:07.423567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.083905+0000","last_change":"2023-10-10T21:15:06.081208+0000","last_active":"2023-10-10T21:15:07.083905+0000","last_peered":"2023-10-10T21:15:07.083905+0000","last_clean":"2023-10-10T21:15:07.083905+0000","last_became_active":"2023-10-10T21:15:06.080785+0000","last_became_peered":"2023-10-10T21:15:06.080785+0000","last_unstale":"2023-10-10T21:15:07.083905+0000","last_undegraded":"2023-10-10T21:15:07.083905+0000","last_fullsized":"2023-10-10T21:15:07.083905+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:56:10.494994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.099541+0000","last_change":"2023-10-10T21:15:07.097589+0000","last_active":"2023-10-10T21:15:07.099541+0000","last_peered":"2023-10-10T21:15:07.099541+0000","last_clean":"2023-10-10T21:15:07.099541+0000","last_became_active":"2023-10-10T21:15:07.097299+0000","last_became_peered":"2023-10-10T21:15:07.097299+0000","last_unstale":"2023-10-10T21:15:07.099541+0000","last_undegraded":"2023-10-10T21:15:07.099541+0000","last_fullsized":"2023-10-10T21:15:07.099541+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:18:47.104316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105276+0000","last_change":"2023-10-10T21:15:06.080102+0000","last_active":"2023-10-10T21:15:07.105276+0000","last_peered":"2023-10-10T21:15:07.105276+0000","last_clean":"2023-10-10T21:15:07.105276+0000","last_became_active":"2023-10-10T21:15:06.079798+0000","last_became_peered":"2023-10-10T21:15:06.079798+0000","last_unstale":"2023-10-10T21:15:07.105276+0000","last_undegraded":"2023-10-10T21:15:07.105276+0000","last_fullsized":"2023-10-10T21:15:07.105276+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:21:13.803869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106436+0000","last_change":"2023-10-10T21:15:07.092528+0000","last_active":"2023-10-10T21:15:07.106436+0000","last_peered":"2023-10-10T21:15:07.106436+0000","last_clean":"2023-10-10T21:15:07.106436+0000","last_became_active":"2023-10-10T21:15:07.092265+0000","last_became_peered":"2023-10-10T21:15:07.092265+0000","last_unstale":"2023-10-10T21:15:07.106436+0000","last_undegraded":"2023-10-10T21:15:07.106436+0000","last_fullsized":"2023-10-10T21:15:07.106436+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:10:53.807646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"63'3","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112884+0000","last_change":"2023-10-10T21:15:06.092181+0000","last_active":"2023-10-10T21:15:07.112884+0000","last_peered":"2023-10-10T21:15:07.112884+0000","last_clean":"2023-10-10T21:15:07.112884+0000","last_became_active":"2023-10-10T21:15:06.091710+0000","last_became_peered":"2023-10-10T21:15:06.091710+0000","last_unstale":"2023-10-10T21:15:07.112884+0000","last_undegraded":"2023-10-10T21:15:07.112884+0000","last_fullsized":"2023-10-10T21:15:07.112884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:30:42.790373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104035+0000","last_change":"2023-10-10T21:15:07.102811+0000","last_active":"2023-10-10T21:15:07.104035+0000","last_peered":"2023-10-10T21:15:07.104035+0000","last_clean":"2023-10-10T21:15:07.104035+0000","last_became_active":"2023-10-10T21:15:07.102540+0000","last_became_peered":"2023-10-10T21:15:07.102540+0000","last_unstale":"2023-10-10T21:15:07.104035+0000","last_undegraded":"2023-10-10T21:15:07.104035+0000","last_fullsized":"2023-10-10T21:15:07.104035+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:36:41.383776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"63'6","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.120605+0000","last_change":"2023-10-10T21:15:06.082352+0000","last_active":"2023-10-10T21:15:07.120605+0000","last_peered":"2023-10-10T21:15:07.120605+0000","last_clean":"2023-10-10T21:15:07.120605+0000","last_became_active":"2023-10-10T21:15:06.082074+0000","last_became_peered":"2023-10-10T21:15:06.082074+0000","last_unstale":"2023-10-10T21:15:07.120605+0000","last_undegraded":"2023-10-10T21:15:07.120605+0000","last_fullsized":"2023-10-10T21:15:07.120605+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:32:03.467041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118925+0000","last_change":"2023-10-10T21:15:07.117196+0000","last_active":"2023-10-10T21:15:07.118925+0000","last_peered":"2023-10-10T21:15:07.118925+0000","last_clean":"2023-10-10T21:15:07.118925+0000","last_became_active":"2023-10-10T21:15:07.116924+0000","last_became_peered":"2023-10-10T21:15:07.116924+0000","last_unstale":"2023-10-10T21:15:07.118925+0000","last_undegraded":"2023-10-10T21:15:07.118925+0000","last_fullsized":"2023-10-10T21:15:07.118925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:49.399409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.117735+0000","last_change":"2023-10-10T21:15:06.089522+0000","last_active":"2023-10-10T21:15:07.117735+0000","last_peered":"2023-10-10T21:15:07.117735+0000","last_clean":"2023-10-10T21:15:07.117735+0000","last_became_active":"2023-10-10T21:15:06.089268+0000","last_became_peered":"2023-10-10T21:15:06.089268+0000","last_unstale":"2023-10-10T21:15:07.117735+0000","last_undegraded":"2023-10-10T21:15:07.117735+0000","last_fullsized":"2023-10-10T21:15:07.117735+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:02.311839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.116496+0000","last_change":"2023-10-10T21:15:07.112293+0000","last_active":"2023-10-10T21:15:07.116496+0000","last_peered":"2023-10-10T21:15:07.116496+0000","last_clean":"2023-10-10T21:15:07.116496+0000","last_became_active":"2023-10-10T21:15:07.112121+0000","last_became_peered":"2023-10-10T21:15:07.112121+0000","last_unstale":"2023-10-10T21:15:07.116496+0000","last_undegraded":"2023-10-10T21:15:07.116496+0000","last_fullsized":"2023-10-10T21:15:07.116496+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:07.423567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.092198+0000","last_change":"2023-10-10T21:15:06.080977+0000","last_active":"2023-10-10T21:15:07.092198+0000","last_peered":"2023-10-10T21:15:07.092198+0000","last_clean":"2023-10-10T21:15:07.092198+0000","last_became_active":"2023-10-10T21:15:06.080700+0000","last_became_peered":"2023-10-10T21:15:06.080700+0000","last_unstale":"2023-10-10T21:15:07.092198+0000","last_undegraded":"2023-10-10T21:15:07.092198+0000","last_fullsized":"2023-10-10T21:15:07.092198+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:56.523008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105466+0000","last_change":"2023-10-10T21:15:07.092596+0000","last_active":"2023-10-10T21:15:07.105466+0000","last_peered":"2023-10-10T21:15:07.105466+0000","last_clean":"2023-10-10T21:15:07.105466+0000","last_became_active":"2023-10-10T21:15:07.092320+0000","last_became_peered":"2023-10-10T21:15:07.092320+0000","last_unstale":"2023-10-10T21:15:07.105466+0000","last_undegraded":"2023-10-10T21:15:07.105466+0000","last_fullsized":"2023-10-10T21:15:07.105466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:16:24.209480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091819+0000","last_change":"2023-10-10T21:15:06.089710+0000","last_active":"2023-10-10T21:15:07.091819+0000","last_peered":"2023-10-10T21:15:07.091819+0000","last_clean":"2023-10-10T21:15:07.091819+0000","last_became_active":"2023-10-10T21:15:06.089385+0000","last_became_peered":"2023-10-10T21:15:06.089385+0000","last_unstale":"2023-10-10T21:15:07.091819+0000","last_undegraded":"2023-10-10T21:15:07.091819+0000","last_fullsized":"2023-10-10T21:15:07.091819+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:45.674860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105656+0000","last_change":"2023-10-10T21:15:07.103940+0000","last_active":"2023-10-10T21:15:07.105656+0000","last_peered":"2023-10-10T21:15:07.105656+0000","last_clean":"2023-10-10T21:15:07.105656+0000","last_became_active":"2023-10-10T21:15:07.103533+0000","last_became_peered":"2023-10-10T21:15:07.103533+0000","last_unstale":"2023-10-10T21:15:07.105656+0000","last_undegraded":"2023-10-10T21:15:07.105656+0000","last_fullsized":"2023-10-10T21:15:07.105656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:19:05.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"63'8","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.127035+0000","last_change":"2023-10-10T21:15:06.083506+0000","last_active":"2023-10-10T21:15:07.127035+0000","last_peered":"2023-10-10T21:15:07.127035+0000","last_clean":"2023-10-10T21:15:07.127035+0000","last_became_active":"2023-10-10T21:15:06.083253+0000","last_became_peered":"2023-10-10T21:15:06.083253+0000","last_unstale":"2023-10-10T21:15:07.127035+0000","last_undegraded":"2023-10-10T21:15:07.127035+0000","last_fullsized":"2023-10-10T21:15:07.127035+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:47:32.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106277+0000","last_change":"2023-10-10T21:15:07.096304+0000","last_active":"2023-10-10T21:15:07.106277+0000","last_peered":"2023-10-10T21:15:07.106277+0000","last_clean":"2023-10-10T21:15:07.106277+0000","last_became_active":"2023-10-10T21:15:07.095985+0000","last_became_peered":"2023-10-10T21:15:07.095985+0000","last_unstale":"2023-10-10T21:15:07.106277+0000","last_undegraded":"2023-10-10T21:15:07.106277+0000","last_fullsized":"2023-10-10T21:15:07.106277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:49:18.889370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.113346+0000","last_change":"2023-10-10T21:15:06.079634+0000","last_active":"2023-10-10T21:15:07.113346+0000","last_peered":"2023-10-10T21:15:07.113346+0000","last_clean":"2023-10-10T21:15:07.113346+0000","last_became_active":"2023-10-10T21:15:06.079349+0000","last_became_peered":"2023-10-10T21:15:06.079349+0000","last_unstale":"2023-10-10T21:15:07.113346+0000","last_undegraded":"2023-10-10T21:15:07.113346+0000","last_fullsized":"2023-10-10T21:15:07.113346+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:42:25.785573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.120060+0000","last_change":"2023-10-10T21:15:07.115513+0000","last_active":"2023-10-10T21:15:07.120060+0000","last_peered":"2023-10-10T21:15:07.120060+0000","last_clean":"2023-10-10T21:15:07.120060+0000","last_became_active":"2023-10-10T21:15:07.115167+0000","last_became_peered":"2023-10-10T21:15:07.115167+0000","last_unstale":"2023-10-10T21:15:07.120060+0000","last_undegraded":"2023-10-10T21:15:07.120060+0000","last_fullsized":"2023-10-10T21:15:07.120060+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:41:32.603813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.111513+0000","last_change":"2023-10-10T21:15:06.085533+0000","last_active":"2023-10-10T21:15:07.111513+0000","last_peered":"2023-10-10T21:15:07.111513+0000","last_clean":"2023-10-10T21:15:07.111513+0000","last_became_active":"2023-10-10T21:15:06.084929+0000","last_became_peered":"2023-10-10T21:15:06.084929+0000","last_unstale":"2023-10-10T21:15:07.111513+0000","last_undegraded":"2023-10-10T21:15:07.111513+0000","last_fullsized":"2023-10-10T21:15:07.111513+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:10:13.834544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104056+0000","last_change":"2023-10-10T21:15:07.102495+0000","last_active":"2023-10-10T21:15:07.104056+0000","last_peered":"2023-10-10T21:15:07.104056+0000","last_clean":"2023-10-10T21:15:07.104056+0000","last_became_active":"2023-10-10T21:15:07.102090+0000","last_became_peered":"2023-10-10T21:15:07.102090+0000","last_unstale":"2023-10-10T21:15:07.104056+0000","last_undegraded":"2023-10-10T21:15:07.104056+0000","last_fullsized":"2023-10-10T21:15:07.104056+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:29.882590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112832+0000","last_change":"2023-10-10T21:15:06.082316+0000","last_active":"2023-10-10T21:15:07.112832+0000","last_peered":"2023-10-10T21:15:07.112832+0000","last_clean":"2023-10-10T21:15:07.112832+0000","last_became_active":"2023-10-10T21:15:06.082053+0000","last_became_peered":"2023-10-10T21:15:06.082053+0000","last_unstale":"2023-10-10T21:15:07.112832+0000","last_undegraded":"2023-10-10T21:15:07.112832+0000","last_fullsized":"2023-10-10T21:15:07.112832+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:17:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104044+0000","last_change":"2023-10-10T21:15:07.101570+0000","last_active":"2023-10-10T21:15:07.104044+0000","last_peered":"2023-10-10T21:15:07.104044+0000","last_clean":"2023-10-10T21:15:07.104044+0000","last_became_active":"2023-10-10T21:15:07.101247+0000","last_became_peered":"2023-10-10T21:15:07.101247+0000","last_unstale":"2023-10-10T21:15:07.104044+0000","last_undegraded":"2023-10-10T21:15:07.104044+0000","last_fullsized":"2023-10-10T21:15:07.104044+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:47:33.766607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.087569+0000","last_change":"2023-10-10T21:15:06.090826+0000","last_active":"2023-10-10T21:15:07.087569+0000","last_peered":"2023-10-10T21:15:07.087569+0000","last_clean":"2023-10-10T21:15:07.087569+0000","last_became_active":"2023-10-10T21:15:06.090567+0000","last_became_peered":"2023-10-10T21:15:06.090567+0000","last_unstale":"2023-10-10T21:15:07.087569+0000","last_undegraded":"2023-10-10T21:15:07.087569+0000","last_fullsized":"2023-10-10T21:15:07.087569+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:02.927652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106677+0000","last_change":"2023-10-10T21:15:07.103070+0000","last_active":"2023-10-10T21:15:07.106677+0000","last_peered":"2023-10-10T21:15:07.106677+0000","last_clean":"2023-10-10T21:15:07.106677+0000","last_became_active":"2023-10-10T21:15:07.102143+0000","last_became_peered":"2023-10-10T21:15:07.102143+0000","last_unstale":"2023-10-10T21:15:07.106677+0000","last_undegraded":"2023-10-10T21:15:07.106677+0000","last_fullsized":"2023-10-10T21:15:07.106677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:52.486720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109649+0000","last_change":"2023-10-10T21:15:06.089714+0000","last_active":"2023-10-10T21:15:07.109649+0000","last_peered":"2023-10-10T21:15:07.109649+0000","last_clean":"2023-10-10T21:15:07.109649+0000","last_became_active":"2023-10-10T21:15:06.089472+0000","last_became_peered":"2023-10-10T21:15:06.089472+0000","last_unstale":"2023-10-10T21:15:07.109649+0000","last_undegraded":"2023-10-10T21:15:07.109649+0000","last_fullsized":"2023-10-10T21:15:07.109649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:31.996775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.097963+0000","last_change":"2023-10-10T21:15:07.089609+0000","last_active":"2023-10-10T21:15:07.097963+0000","last_peered":"2023-10-10T21:15:07.097963+0000","last_clean":"2023-10-10T21:15:07.097963+0000","last_became_active":"2023-10-10T21:15:07.089353+0000","last_became_peered":"2023-10-10T21:15:07.089353+0000","last_unstale":"2023-10-10T21:15:07.097963+0000","last_undegraded":"2023-10-10T21:15:07.097963+0000","last_fullsized":"2023-10-10T21:15:07.097963+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:56:11.500519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.082299+0000","last_change":"2023-10-10T21:15:06.091050+0000","last_active":"2023-10-10T21:15:07.082299+0000","last_peered":"2023-10-10T21:15:07.082299+0000","last_clean":"2023-10-10T21:15:07.082299+0000","last_became_active":"2023-10-10T21:15:06.090769+0000","last_became_peered":"2023-10-10T21:15:06.090769+0000","last_unstale":"2023-10-10T21:15:07.082299+0000","last_undegraded":"2023-10-10T21:15:07.082299+0000","last_fullsized":"2023-10-10T21:15:07.082299+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:16:29.367879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106372+0000","last_change":"2023-10-10T21:15:07.100774+0000","last_active":"2023-10-10T21:15:07.106372+0000","last_peered":"2023-10-10T21:15:07.106372+0000","last_clean":"2023-10-10T21:15:07.106372+0000","last_became_active":"2023-10-10T21:15:07.100483+0000","last_became_peered":"2023-10-10T21:15:07.100483+0000","last_unstale":"2023-10-10T21:15:07.106372+0000","last_undegraded":"2023-10-10T21:15:07.106372+0000","last_fullsized":"2023-10-10T21:15:07.106372+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:20.556193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.102894+0000","last_change":"2023-10-10T21:15:06.080996+0000","last_active":"2023-10-10T21:15:07.102894+0000","last_peered":"2023-10-10T21:15:07.102894+0000","last_clean":"2023-10-10T21:15:07.102894+0000","last_became_active":"2023-10-10T21:15:06.079486+0000","last_became_peered":"2023-10-10T21:15:06.079486+0000","last_unstale":"2023-10-10T21:15:07.102894+0000","last_undegraded":"2023-10-10T21:15:07.102894+0000","last_fullsized":"2023-10-10T21:15:07.102894+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:25:40.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118757+0000","last_change":"2023-10-10T21:15:07.114150+0000","last_active":"2023-10-10T21:15:07.118757+0000","last_peered":"2023-10-10T21:15:07.118757+0000","last_clean":"2023-10-10T21:15:07.118757+0000","last_became_active":"2023-10-10T21:15:07.113969+0000","last_became_peered":"2023-10-10T21:15:07.113969+0000","last_unstale":"2023-10-10T21:15:07.118757+0000","last_undegraded":"2023-10-10T21:15:07.118757+0000","last_fullsized":"2023-10-10T21:15:07.118757+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:02.784745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.090820+0000","last_change":"2023-10-10T21:15:06.081894+0000","last_active":"2023-10-10T21:15:07.090820+0000","last_peered":"2023-10-10T21:15:07.090820+0000","last_clean":"2023-10-10T21:15:07.090820+0000","last_became_active":"2023-10-10T21:15:06.081576+0000","last_became_peered":"2023-10-10T21:15:06.081576+0000","last_unstale":"2023-10-10T21:15:07.090820+0000","last_undegraded":"2023-10-10T21:15:07.090820+0000","last_fullsized":"2023-10-10T21:15:07.090820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:56:45.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118868+0000","last_change":"2023-10-10T21:15:07.116577+0000","last_active":"2023-10-10T21:15:07.118868+0000","last_peered":"2023-10-10T21:15:07.118868+0000","last_clean":"2023-10-10T21:15:07.118868+0000","last_became_active":"2023-10-10T21:15:07.116303+0000","last_became_peered":"2023-10-10T21:15:07.116303+0000","last_unstale":"2023-10-10T21:15:07.118868+0000","last_undegraded":"2023-10-10T21:15:07.118868+0000","last_fullsized":"2023-10-10T21:15:07.118868+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:18:00.094989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091817+0000","last_change":"2023-10-10T21:15:06.089097+0000","last_active":"2023-10-10T21:15:07.091817+0000","last_peered":"2023-10-10T21:15:07.091817+0000","last_clean":"2023-10-10T21:15:07.091817+0000","last_became_active":"2023-10-10T21:15:06.088816+0000","last_became_peered":"2023-10-10T21:15:06.088816+0000","last_unstale":"2023-10-10T21:15:07.091817+0000","last_undegraded":"2023-10-10T21:15:07.091817+0000","last_fullsized":"2023-10-10T21:15:07.091817+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:58:06.775845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119211+0000","last_change":"2023-10-10T21:15:07.116010+0000","last_active":"2023-10-10T21:15:07.119211+0000","last_peered":"2023-10-10T21:15:07.119211+0000","last_clean":"2023-10-10T21:15:07.119211+0000","last_became_active":"2023-10-10T21:15:07.115714+0000","last_became_peered":"2023-10-10T21:15:07.115714+0000","last_unstale":"2023-10-10T21:15:07.119211+0000","last_undegraded":"2023-10-10T21:15:07.119211+0000","last_fullsized":"2023-10-10T21:15:07.119211+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:57.528533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.092959+0000","last_change":"2023-10-10T21:15:06.092389+0000","last_active":"2023-10-10T21:15:07.092959+0000","last_peered":"2023-10-10T21:15:07.092959+0000","last_clean":"2023-10-10T21:15:07.092959+0000","last_became_active":"2023-10-10T21:15:06.092084+0000","last_became_peered":"2023-10-10T21:15:06.092084+0000","last_unstale":"2023-10-10T21:15:07.092959+0000","last_undegraded":"2023-10-10T21:15:07.092959+0000","last_fullsized":"2023-10-10T21:15:07.092959+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:42:45.235038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.108612+0000","last_change":"2023-10-10T21:15:07.107492+0000","last_active":"2023-10-10T21:15:07.108612+0000","last_peered":"2023-10-10T21:15:07.108612+0000","last_clean":"2023-10-10T21:15:07.108612+0000","last_became_active":"2023-10-10T21:15:07.107190+0000","last_became_peered":"2023-10-10T21:15:07.107190+0000","last_unstale":"2023-10-10T21:15:07.108612+0000","last_undegraded":"2023-10-10T21:15:07.108612+0000","last_fullsized":"2023-10-10T21:15:07.108612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:51:11.425493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.082620+0000","last_change":"2023-10-10T21:15:06.088136+0000","last_active":"2023-10-10T21:15:07.082620+0000","last_peered":"2023-10-10T21:15:07.082620+0000","last_clean":"2023-10-10T21:15:07.082620+0000","last_became_active":"2023-10-10T21:15:06.087797+0000","last_became_peered":"2023-10-10T21:15:06.087797+0000","last_unstale":"2023-10-10T21:15:07.082620+0000","last_undegraded":"2023-10-10T21:15:07.082620+0000","last_fullsized":"2023-10-10T21:15:07.082620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:25:40.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105498+0000","last_change":"2023-10-10T21:15:07.093269+0000","last_active":"2023-10-10T21:15:07.105498+0000","last_peered":"2023-10-10T21:15:07.105498+0000","last_clean":"2023-10-10T21:15:07.105498+0000","last_became_active":"2023-10-10T21:15:07.093033+0000","last_became_peered":"2023-10-10T21:15:07.093033+0000","last_unstale":"2023-10-10T21:15:07.105498+0000","last_undegraded":"2023-10-10T21:15:07.105498+0000","last_fullsized":"2023-10-10T21:15:07.105498+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:22:26.447544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.092629+0000","last_change":"2023-10-10T21:15:06.092046+0000","last_active":"2023-10-10T21:15:07.092629+0000","last_peered":"2023-10-10T21:15:07.092629+0000","last_clean":"2023-10-10T21:15:07.092629+0000","last_became_active":"2023-10-10T21:15:06.090893+0000","last_became_peered":"2023-10-10T21:15:06.090893+0000","last_unstale":"2023-10-10T21:15:07.092629+0000","last_undegraded":"2023-10-10T21:15:07.092629+0000","last_fullsized":"2023-10-10T21:15:07.092629+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:01.779220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107200+0000","last_change":"2023-10-10T21:15:07.103541+0000","last_active":"2023-10-10T21:15:07.107200+0000","last_peered":"2023-10-10T21:15:07.107200+0000","last_clean":"2023-10-10T21:15:07.107200+0000","last_became_active":"2023-10-10T21:15:07.103293+0000","last_became_peered":"2023-10-10T21:15:07.103293+0000","last_unstale":"2023-10-10T21:15:07.107200+0000","last_undegraded":"2023-10-10T21:15:07.107200+0000","last_fullsized":"2023-10-10T21:15:07.107200+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:42.410363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.083747+0000","last_change":"2023-10-10T21:15:06.088264+0000","last_active":"2023-10-10T21:15:07.083747+0000","last_peered":"2023-10-10T21:15:07.083747+0000","last_clean":"2023-10-10T21:15:07.083747+0000","last_became_active":"2023-10-10T21:15:06.087904+0000","last_became_peered":"2023-10-10T21:15:06.087904+0000","last_unstale":"2023-10-10T21:15:07.083747+0000","last_undegraded":"2023-10-10T21:15:07.083747+0000","last_fullsized":"2023-10-10T21:15:07.083747+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:22.415717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.088583+0000","last_change":"2023-10-10T21:15:07.084909+0000","last_active":"2023-10-10T21:15:07.088583+0000","last_peered":"2023-10-10T21:15:07.088583+0000","last_clean":"2023-10-10T21:15:07.088583+0000","last_became_active":"2023-10-10T21:15:07.084674+0000","last_became_peered":"2023-10-10T21:15:07.084674+0000","last_unstale":"2023-10-10T21:15:07.088583+0000","last_undegraded":"2023-10-10T21:15:07.088583+0000","last_fullsized":"2023-10-10T21:15:07.088583+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:51.580942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.082786+0000","last_change":"2023-10-10T21:15:06.091301+0000","last_active":"2023-10-10T21:15:07.082786+0000","last_peered":"2023-10-10T21:15:07.082786+0000","last_clean":"2023-10-10T21:15:07.082786+0000","last_became_active":"2023-10-10T21:15:06.090910+0000","last_became_peered":"2023-10-10T21:15:06.090910+0000","last_unstale":"2023-10-10T21:15:07.082786+0000","last_undegraded":"2023-10-10T21:15:07.082786+0000","last_fullsized":"2023-10-10T21:15:07.082786+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103946+0000","last_change":"2023-10-10T21:15:07.102516+0000","last_active":"2023-10-10T21:15:07.103946+0000","last_peered":"2023-10-10T21:15:07.103946+0000","last_clean":"2023-10-10T21:15:07.103946+0000","last_became_active":"2023-10-10T21:15:07.102235+0000","last_became_peered":"2023-10-10T21:15:07.102235+0000","last_unstale":"2023-10-10T21:15:07.103946+0000","last_undegraded":"2023-10-10T21:15:07.103946+0000","last_fullsized":"2023-10-10T21:15:07.103946+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:02.784745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103474+0000","last_change":"2023-10-10T21:15:06.090826+0000","last_active":"2023-10-10T21:15:07.103474+0000","last_peered":"2023-10-10T21:15:07.103474+0000","last_clean":"2023-10-10T21:15:07.103474+0000","last_became_active":"2023-10-10T21:15:06.090516+0000","last_became_peered":"2023-10-10T21:15:06.090516+0000","last_unstale":"2023-10-10T21:15:07.103474+0000","last_undegraded":"2023-10-10T21:15:07.103474+0000","last_fullsized":"2023-10-10T21:15:07.103474+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:22.415717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119246+0000","last_change":"2023-10-10T21:15:07.115765+0000","last_active":"2023-10-10T21:15:07.119246+0000","last_peered":"2023-10-10T21:15:07.119246+0000","last_clean":"2023-10-10T21:15:07.119246+0000","last_became_active":"2023-10-10T21:15:07.115520+0000","last_became_peered":"2023-10-10T21:15:07.115520+0000","last_unstale":"2023-10-10T21:15:07.119246+0000","last_undegraded":"2023-10-10T21:15:07.119246+0000","last_fullsized":"2023-10-10T21:15:07.119246+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:39:09.194811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112916+0000","last_change":"2023-10-10T21:15:06.083202+0000","last_active":"2023-10-10T21:15:07.112916+0000","last_peered":"2023-10-10T21:15:07.112916+0000","last_clean":"2023-10-10T21:15:07.112916+0000","last_became_active":"2023-10-10T21:15:06.082933+0000","last_became_peered":"2023-10-10T21:15:06.082933+0000","last_unstale":"2023-10-10T21:15:07.112916+0000","last_undegraded":"2023-10-10T21:15:07.112916+0000","last_fullsized":"2023-10-10T21:15:07.112916+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:37.602817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":279,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.090450+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:15:07.090450+0000","last_peered":"2023-10-10T21:15:07.090450+0000","last_clean":"2023-10-10T21:15:07.090450+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:15:07.090450+0000","last_undegraded":"2023-10-10T21:15:07.090450+0000","last_fullsized":"2023-10-10T21:15:07.090450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542302,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302708,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069132,"statfs":{"total":96636764160,"available":96326791168,"internally_reserved":0,"allocated":1355776,"data_stored":944683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.40400000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.1859999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70599999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.92400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.749},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.45100000000000001,"15min":0.41399999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.123},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.71299999999999997},"min":{"1min":0.54600000000000004,"5min":0.48299999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.60099999999999998,"5min":0.497,"15min":0.46500000000000002},"max":{"1min":1.0249999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.49099999999999999},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.056},"last":0.72899999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.621},"min":{"1min":0.42999999999999999,"5min":0.374,"15min":0.33500000000000002},"max":{"1min":0.81799999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.57299999999999995}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.40799999999999997},"max":{"1min":0.97399999999999998,"5min":0.98299999999999998,"15min":1.022},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.376},"max":{"1min":0.90600000000000003,"5min":0.91300000000000003,"15min":0.98899999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.629,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":0.98699999999999999,"15min":1.135},"last":0.71499999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542301,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":765952,"data_stored":354869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.45000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.90000000000000002,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.71899999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.41099999999999998},"max":{"1min":0.84799999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.51000000000000001,"5min":0.45500000000000002,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.0129999999999999,"15min":1.143},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":1.073,"15min":1.073},"last":0.84399999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":0.98199999999999998,"15min":1.151},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.621}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.498,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.872},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46300000000000002},"max":{"1min":0.94799999999999995,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.627,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.746,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.345},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":1.048,"15min":1.238},"last":0.56699999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72799999999999998,"15min":0.745},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.202},"last":0.75900000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542301,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":761856,"data_stored":354295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.251},"max":{"1min":0.61799999999999999,"5min":0.73199999999999998,"15min":1.258},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":0.81599999999999995,"15min":1.964},"last":0.35399999999999998}]},{"osd":2,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.29599999999999999},"max":{"1min":0.66200000000000003,"5min":0.80300000000000005,"15min":1.4550000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":2.085},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.8919999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.80400000000000005,"15min":2.117},"last":0.55900000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.024,"5min":1.0509999999999999,"15min":2.052},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":0.70899999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.036,"5min":1.0409999999999999,"15min":1.181},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79900000000000004},"min":{"1min":0.625,"5min":0.502,"15min":0.46400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":2.012},"last":0.873}]},{"osd":6,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.63200000000000001,"5min":0.55600000000000005,"15min":0.51200000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":2.25},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.53400000000000003},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":2.169},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.71799999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542303,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298612,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073228,"statfs":{"total":96636764160,"available":96330985472,"internally_reserved":0,"allocated":1355776,"data_stored":944627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.68000000000000005,"5min":0.752,"15min":1.4890000000000001},"last":0.372},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.78200000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":1.706},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.1739999999999999},"last":0.5}]},{"osd":3,"last update":"Tue Oct 10 21:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.30399999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.6499999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":1.2909999999999999},"last":0.43099999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82399999999999995,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":1.101,"5min":1.1040000000000001,"15min":1.2270000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":0.77100000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.78200000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.371},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80800000000000005,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":0.94099999999999995,"5min":1.1439999999999999,"15min":1.3899999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.82999999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.874,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.1339999999999999,"15min":1.306},"last":0.92800000000000005}]},{"osd":7,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85599999999999998,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.503},"max":{"1min":1.1319999999999999,"5min":1.169,"15min":1.363},"last":0.874},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85799999999999998,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.60099999999999998,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.165,"15min":1.3300000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542303,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306236,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":774144,"data_stored":355783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.28699999999999998},"max":{"1min":0.59299999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.377}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":1.2070000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.88800000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.85999999999999999},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77000000000000002,"15min":0.76500000000000001},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":1.286,"15min":1.3220000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.46600000000000003},"max":{"1min":0.97099999999999997,"5min":1.1659999999999999,"15min":1.2849999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93799999999999994,"5min":1.196,"15min":1.385},"last":0.624},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51900000000000002},"max":{"1min":0.94999999999999996,"5min":1.268,"15min":1.268},"last":0.65000000000000002}]},{"osd":6,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.61199999999999999,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":0.98099999999999998,"5min":1.3080000000000001,"15min":1.3400000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":1.022,"5min":1.107,"15min":1.3759999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51200000000000001},"max":{"1min":1.0049999999999999,"5min":1.1659999999999999,"15min":1.2},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.625,"5min":0.57399999999999995,"15min":0.49199999999999999},"max":{"1min":0.95699999999999996,"5min":1.2330000000000001,"15min":1.3109999999999999},"last":0.58799999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509598,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":770048,"data_stored":354835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":0.58199999999999996,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.378},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":1.544},"last":0.48199999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":1.6759999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.66500000000000004,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.45200000000000001,"5min":0.42399999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.78900000000000003,"15min":1.7070000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.38700000000000001},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.439}]},{"osd":4,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.434},"max":{"1min":1.0529999999999999,"5min":1.107,"15min":1.6359999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.80100000000000005,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1859999999999999,"5min":1.246,"15min":1.246},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78800000000000003,"15min":0.77200000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.262},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.48699999999999999},"max":{"1min":0.94299999999999995,"5min":1.1579999999999999,"15min":1.579},"last":0.61499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52900000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":1.1040000000000001,"15min":1.6080000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82999999999999996,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51300000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.3200000000000001},"last":0.72099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542303,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":770048,"data_stored":355761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.69599999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.752},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95399999999999996,"5min":0.96499999999999997,"15min":1.758},"last":0.73599999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.42099999999999999},"max":{"1min":0.93000000000000005,"5min":1.1359999999999999,"15min":1.47},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.437},"max":{"1min":0.85199999999999998,"5min":0.95499999999999996,"15min":1.929},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.48999999999999999},"max":{"1min":0.96199999999999997,"5min":1.02,"15min":1.6890000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.3100000000000001,"15min":1.468},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.75800000000000001},"min":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.0820000000000001,"15min":1.397},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.385,"15min":1.385},"last":0.63500000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.496},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63400000000000001,"15min":0.68400000000000005},"min":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.39900000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.54300000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.38100000000000001},"max":{"1min":0.93000000000000005,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.0609999999999999,"15min":1.464},"last":0.61399999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.97899999999999998,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.42199999999999999},"max":{"1min":0.91300000000000003,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.46600000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542301,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":761856,"data_stored":354295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.92000000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.747,"15min":0.71299999999999997},"min":{"1min":0.57599999999999996,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.95899999999999996,"15min":1.371},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.42599999999999999,"15min":0.38500000000000001},"max":{"1min":0.93300000000000005,"5min":0.96599999999999997,"15min":3.895},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.83299999999999996},"min":{"1min":0.49199999999999999,"5min":0.41699999999999998,"15min":0.39000000000000001},"max":{"1min":0.90700000000000003,"5min":1.018,"15min":8.9909999999999997},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.71499999999999997},"min":{"1min":0.58899999999999997,"5min":0.44900000000000001,"15min":0.439},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2889999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.82699999999999996,"5min":0.93300000000000005,"15min":1.3540000000000001},"last":0.84299999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.437},"max":{"1min":0.871,"5min":0.99299999999999999,"15min":8.9309999999999992},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.502,"15min":0.45900000000000002},"max":{"1min":0.89000000000000001,"5min":1.044,"15min":2.9409999999999998},"last":0.746}]},{"osd":4,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":9.0250000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83299999999999996,"5min":0.89200000000000002,"15min":4.2789999999999999},"last":0.79100000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.85899999999999999},"min":{"1min":0.57499999999999996,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":0.95399999999999996,"5min":0.96899999999999997,"15min":8.8480000000000008},"last":0.86699999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.74299999999999999},"min":{"1min":0.503,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93500000000000005,"5min":0.95499999999999996,"15min":2.8900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68799999999999994,"15min":0.754},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.98899999999999999,"15min":3.9420000000000002},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:15:16.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:15:16.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.492+0000 7fb10cdff700 1 Processor -- start 2023-10-10T21:15:16.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.492+0000 7fb10cdff700 1 -- start start 2023-10-10T21:15:16.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb10cdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb1080b1420 0x7fb1080ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb10cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080ccf90 0x7fb1080c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb10cdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080cc300 con 0x7fb1080cbf30 2023-10-10T21:15:16.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb10cdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb108156bf0 con 0x7fb1080b1420 2023-10-10T21:15:16.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb10cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080ae950 con 0x7fb1080ccf90 2023-10-10T21:15:16.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb10659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb1080cbf30 0x7fb1080b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45410/0 (socket says 172.21.15.154:45410) 2023-10-10T21:15:16.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb10659c700 1 -- 172.21.15.154:0/1059567950 learned_addr learned my addr 172.21.15.154:0/1059567950 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:16.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb0fffff700 1 --2- 172.21.15.154:0/1059567950 >> v2:172.21.15.179:3300/0 conn(0x7fb1080b1420 0x7fb1080ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb106d9d700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080ccf90 0x7fb1080c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.494+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295649601 0 0) 0x7fb1080cc300 con 0x7fb1080cbf30 2023-10-10T21:15:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f4003570 con 0x7fb1080cbf30 2023-10-10T21:15:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 630745055 0 0) 0x7fb0f4003570 con 0x7fb1080cbf30 2023-10-10T21:15:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080ccf90 msgr2=0x7fb1080c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080ccf90 0x7fb1080c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 >> v2:172.21.15.179:3300/0 conn(0x7fb1080b1420 msgr2=0x7fb1080ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 --2- 172.21.15.154:0/1059567950 >> v2:172.21.15.179:3300/0 conn(0x7fb1080b1420 0x7fb1080ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080ad370 con 0x7fb1080cbf30 2023-10-10T21:15:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fb0f8001470 con 0x7fb1080cbf30 2023-10-10T21:15:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb0fffff700 1 --2- 172.21.15.154:0/1059567950 >> v2:172.21.15.179:3300/0 conn(0x7fb1080b1420 0x7fb1080ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:15:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 >> v1:172.21.15.154:6789/0 conn(0x7fb1080cbf30 legacy=0x7fb1080b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb0f4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0f4004810 0x7fb0f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080ccf90 0x7fb0f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb108156bf0 con 0x7fb0f4003a90 2023-10-10T21:15:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080ae950 con 0x7fb0f4004810 2023-10-10T21:15:16.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f400ba60 con 0x7fb1080ccf90 2023-10-10T21:15:16.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb10659c700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb0f4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb0fffff700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0f4004810 0x7fb0f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.495+0000 7fb106d9d700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080ccf90 0x7fb0f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.496+0000 7fb10659c700 1 -- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080ccf90 msgr2=0x7fb0f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:16.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.496+0000 7fb10659c700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080ccf90 0x7fb0f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.496+0000 7fb10659c700 1 -- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0f4004810 msgr2=0x7fb0f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:16.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.496+0000 7fb10659c700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0f4004810 0x7fb0f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.496+0000 7fb10659c700 1 -- 172.21.15.154:0/1059567950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4003570 con 0x7fb0f4003a90 2023-10-10T21:15:16.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.496+0000 7fb10659c700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb0f4003ea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800c3c0 tx=0x7fb1080c8fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcda10966d894208 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:16.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.496+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800cc50 con 0x7fb0f4003a90 2023-10-10T21:15:16.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.496+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f800cdb0 con 0x7fb0f4003a90 2023-10-10T21:15:16.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.496+0000 7fb105d9b700 1 -- 172.21.15.154:0/1059567950 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8005b70 con 0x7fb0f4003a90 2023-10-10T21:15:16.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.497+0000 7fb10cdff700 1 -- 172.21.15.154:0/1059567950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 msgr2=0x7fb0f4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:16.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.497+0000 7fb10cdff700 1 --2- 172.21.15.154:0/1059567950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb0f4003ea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800c3c0 tx=0x7fb1080c8fd0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.497+0000 7fb106d9d700 1 -- 172.21.15.154:0/1059567950 reap_dead start 2023-10-10T21:15:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.497+0000 7fb10cdff700 1 -- 172.21.15.154:0/1059567950 shutdown_connections 2023-10-10T21:15:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.497+0000 7fb10cdff700 1 -- 172.21.15.154:0/1059567950 >> 172.21.15.154:0/1059567950 conn(0x7fb10806a320 msgr2=0x7fb1080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.497+0000 7fb10cdff700 1 -- 172.21.15.154:0/1059567950 shutdown_connections 2023-10-10T21:15:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.497+0000 7fb10cdff700 1 -- 172.21.15.154:0/1059567950 wait complete. 2023-10-10T21:15:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.498+0000 7fb10cdff700 1 Processor -- start 2023-10-10T21:15:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.498+0000 7fb10cdff700 1 -- start start 2023-10-10T21:15:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.499+0000 7fb10cdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb1081685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.499+0000 7fb10cdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1080c42b0 0x7fb1080c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.499+0000 7fb10cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6c80 0x7fb1080c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.499+0000 7fb10cdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080c7660 con 0x7fb0f4003a90 2023-10-10T21:15:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.499+0000 7fb10cdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080c59a0 con 0x7fb1080c42b0 2023-10-10T21:15:16.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.499+0000 7fb10cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb108168b20 con 0x7fb1080c6c80 2023-10-10T21:15:16.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.499+0000 7fb10659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb1081685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.499+0000 7fb10659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb1081685e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42568/0 (socket says 172.21.15.154:42568) 2023-10-10T21:15:16.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.499+0000 7fb10659c700 1 -- 172.21.15.154:0/3394026800 learned_addr learned my addr 172.21.15.154:0/3394026800 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:16.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb0fffff700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1080c42b0 0x7fb1080c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb106d9d700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6c80 0x7fb1080c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb10659c700 1 -- 172.21.15.154:0/3394026800 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6c80 msgr2=0x7fb1080c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb10659c700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6c80 0x7fb1080c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb10659c700 1 -- 172.21.15.154:0/3394026800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1080c42b0 msgr2=0x7fb1080c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb10659c700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1080c42b0 0x7fb1080c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb10659c700 1 -- 172.21.15.154:0/3394026800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080c4d90 con 0x7fb0f4003a90 2023-10-10T21:15:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb10659c700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb1081685e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4004700 tx=0x7fb0f8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb0fe7fc700 1 -- 172.21.15.154:0/3394026800 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8000f50 con 0x7fb0f4003a90 2023-10-10T21:15:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb0fe7fc700 1 -- 172.21.15.154:0/3394026800 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f80072e0 con 0x7fb0f4003a90 2023-10-10T21:15:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb0fe7fc700 1 -- 172.21.15.154:0/3394026800 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80076a0 con 0x7fb0f4003a90 2023-10-10T21:15:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1080c5070 con 0x7fb0f4003a90 2023-10-10T21:15:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.500+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1080c5630 con 0x7fb0f4003a90 2023-10-10T21:15:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.501+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10804c3c0 con 0x7fb0f4003a90 2023-10-10T21:15:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.502+0000 7fb0fe7fc700 1 -- 172.21.15.154:0/3394026800 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0f8019030 con 0x7fb0f4003a90 2023-10-10T21:15:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.503+0000 7fb0fe7fc700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0e8066f30 0x7fb0e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.503+0000 7fb0fe7fc700 1 -- 172.21.15.154:0/3394026800 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb0f8085ad0 con 0x7fb0f4003a90 2023-10-10T21:15:16.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.503+0000 7fb0fffff700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0e8066f30 0x7fb0e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.504+0000 7fb0fffff700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0e8066f30 0x7fb0e80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0006dc0 tx=0x7fb0f0008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:16.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.508+0000 7fb0fe7fc700 1 -- 172.21.15.154:0/3394026800 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0f8052b30 con 0x7fb0f4003a90 2023-10-10T21:15:16.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.698+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1080ad650 con 0x7fb0e8066f30 2023-10-10T21:15:16.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.707+0000 7fb0fe7fc700 1 -- 172.21.15.154:0/3394026800 <== mgr.5565 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288983 (secure 0 0 0) 0x7fb1080ad650 con 0x7fb0e8066f30 2023-10-10T21:15:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:16.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0e8066f30 msgr2=0x7fb0e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:16.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0e8066f30 0x7fb0e80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0006dc0 tx=0x7fb0f0008040 comp rx=0 tx=0).stop 2023-10-10T21:15:16.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 msgr2=0x7fb1081685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:16.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb1081685e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4004700 tx=0x7fb0f8015000 comp rx=0 tx=0).stop 2023-10-10T21:15:16.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 shutdown_connections 2023-10-10T21:15:16.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6c80 0x7fb1080c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0f4003a90 0x7fb1081685e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0e8066f30 0x7fb0e80693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 --2- 172.21.15.154:0/3394026800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1080c42b0 0x7fb1080c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 >> 172.21.15.154:0/3394026800 conn(0x7fb10806a320 msgr2=0x7fb10806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:16.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 shutdown_connections 2023-10-10T21:15:16.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.711+0000 7fb10cdff700 1 -- 172.21.15.154:0/3394026800 wait complete. 2023-10-10T21:15:16.716 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:15:16.729 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-10T21:15:16.519827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426408,"kb_used_data":7144,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752548312,"statfs":{"total":773094113280,"available":770609471488,"internally_reserved":0,"allocated":7315456,"data_stored":4019148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.439411"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.100385+0000","last_change":"2023-10-10T21:15:07.098511+0000","last_active":"2023-10-10T21:15:07.100385+0000","last_peered":"2023-10-10T21:15:07.100385+0000","last_clean":"2023-10-10T21:15:07.100385+0000","last_became_active":"2023-10-10T21:15:07.098245+0000","last_became_peered":"2023-10-10T21:15:07.098245+0000","last_unstale":"2023-10-10T21:15:07.100385+0000","last_undegraded":"2023-10-10T21:15:07.100385+0000","last_fullsized":"2023-10-10T21:15:07.100385+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:26:18.039539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118921+0000","last_change":"2023-10-10T21:15:07.116515+0000","last_active":"2023-10-10T21:15:07.118921+0000","last_peered":"2023-10-10T21:15:07.118921+0000","last_clean":"2023-10-10T21:15:07.118921+0000","last_became_active":"2023-10-10T21:15:07.116085+0000","last_became_peered":"2023-10-10T21:15:07.116085+0000","last_unstale":"2023-10-10T21:15:07.118921+0000","last_undegraded":"2023-10-10T21:15:07.118921+0000","last_fullsized":"2023-10-10T21:15:07.118921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:30:43.795898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.097349+0000","last_change":"2023-10-10T21:15:07.091266+0000","last_active":"2023-10-10T21:15:07.097349+0000","last_peered":"2023-10-10T21:15:07.097349+0000","last_clean":"2023-10-10T21:15:07.097349+0000","last_became_active":"2023-10-10T21:15:07.090540+0000","last_became_peered":"2023-10-10T21:15:07.090540+0000","last_unstale":"2023-10-10T21:15:07.097349+0000","last_undegraded":"2023-10-10T21:15:07.097349+0000","last_fullsized":"2023-10-10T21:15:07.097349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:59:54.028632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119191+0000","last_change":"2023-10-10T21:15:07.115201+0000","last_active":"2023-10-10T21:15:07.119191+0000","last_peered":"2023-10-10T21:15:07.119191+0000","last_clean":"2023-10-10T21:15:07.119191+0000","last_became_active":"2023-10-10T21:15:07.114890+0000","last_became_peered":"2023-10-10T21:15:07.114890+0000","last_unstale":"2023-10-10T21:15:07.119191+0000","last_undegraded":"2023-10-10T21:15:07.119191+0000","last_fullsized":"2023-10-10T21:15:07.119191+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:35:39.936568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118689+0000","last_change":"2023-10-10T21:15:07.116147+0000","last_active":"2023-10-10T21:15:07.118689+0000","last_peered":"2023-10-10T21:15:07.118689+0000","last_clean":"2023-10-10T21:15:07.118689+0000","last_became_active":"2023-10-10T21:15:07.115845+0000","last_became_peered":"2023-10-10T21:15:07.115845+0000","last_unstale":"2023-10-10T21:15:07.118689+0000","last_undegraded":"2023-10-10T21:15:07.118689+0000","last_fullsized":"2023-10-10T21:15:07.118689+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:57.528533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105516+0000","last_change":"2023-10-10T21:15:07.101273+0000","last_active":"2023-10-10T21:15:07.105516+0000","last_peered":"2023-10-10T21:15:07.105516+0000","last_clean":"2023-10-10T21:15:07.105516+0000","last_became_active":"2023-10-10T21:15:07.100986+0000","last_became_peered":"2023-10-10T21:15:07.100986+0000","last_unstale":"2023-10-10T21:15:07.105516+0000","last_undegraded":"2023-10-10T21:15:07.105516+0000","last_fullsized":"2023-10-10T21:15:07.105516+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.296297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104073+0000","last_change":"2023-10-10T21:15:07.102852+0000","last_active":"2023-10-10T21:15:07.104073+0000","last_peered":"2023-10-10T21:15:07.104073+0000","last_clean":"2023-10-10T21:15:07.104073+0000","last_became_active":"2023-10-10T21:15:07.102518+0000","last_became_peered":"2023-10-10T21:15:07.102518+0000","last_unstale":"2023-10-10T21:15:07.104073+0000","last_undegraded":"2023-10-10T21:15:07.104073+0000","last_fullsized":"2023-10-10T21:15:07.104073+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:32:16.865865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119409+0000","last_change":"2023-10-10T21:15:07.115457+0000","last_active":"2023-10-10T21:15:07.119409+0000","last_peered":"2023-10-10T21:15:07.119409+0000","last_clean":"2023-10-10T21:15:07.119409+0000","last_became_active":"2023-10-10T21:15:07.115270+0000","last_became_peered":"2023-10-10T21:15:07.115270+0000","last_unstale":"2023-10-10T21:15:07.119409+0000","last_undegraded":"2023-10-10T21:15:07.119409+0000","last_fullsized":"2023-10-10T21:15:07.119409+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:10.301679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.120041+0000","last_change":"2023-10-10T21:15:07.114191+0000","last_active":"2023-10-10T21:15:07.120041+0000","last_peered":"2023-10-10T21:15:07.120041+0000","last_clean":"2023-10-10T21:15:07.120041+0000","last_became_active":"2023-10-10T21:15:07.113991+0000","last_became_peered":"2023-10-10T21:15:07.113991+0000","last_unstale":"2023-10-10T21:15:07.120041+0000","last_undegraded":"2023-10-10T21:15:07.120041+0000","last_fullsized":"2023-10-10T21:15:07.120041+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:46:15.242718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119229+0000","last_change":"2023-10-10T21:15:07.115450+0000","last_active":"2023-10-10T21:15:07.119229+0000","last_peered":"2023-10-10T21:15:07.119229+0000","last_clean":"2023-10-10T21:15:07.119229+0000","last_became_active":"2023-10-10T21:15:07.115022+0000","last_became_peered":"2023-10-10T21:15:07.115022+0000","last_unstale":"2023-10-10T21:15:07.119229+0000","last_undegraded":"2023-10-10T21:15:07.119229+0000","last_fullsized":"2023-10-10T21:15:07.119229+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:16:19.050946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118875+0000","last_change":"2023-10-10T21:15:07.115057+0000","last_active":"2023-10-10T21:15:07.118875+0000","last_peered":"2023-10-10T21:15:07.118875+0000","last_clean":"2023-10-10T21:15:07.118875+0000","last_became_active":"2023-10-10T21:15:07.114715+0000","last_became_peered":"2023-10-10T21:15:07.114715+0000","last_unstale":"2023-10-10T21:15:07.118875+0000","last_undegraded":"2023-10-10T21:15:07.118875+0000","last_fullsized":"2023-10-10T21:15:07.118875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:30:43.795898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.094769+0000","last_change":"2023-10-10T21:15:07.091553+0000","last_active":"2023-10-10T21:15:07.094769+0000","last_peered":"2023-10-10T21:15:07.094769+0000","last_clean":"2023-10-10T21:15:07.094769+0000","last_became_active":"2023-10-10T21:15:07.091284+0000","last_became_peered":"2023-10-10T21:15:07.091284+0000","last_unstale":"2023-10-10T21:15:07.094769+0000","last_undegraded":"2023-10-10T21:15:07.094769+0000","last_fullsized":"2023-10-10T21:15:07.094769+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:56:46.378810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106481+0000","last_change":"2023-10-10T21:15:07.103386+0000","last_active":"2023-10-10T21:15:07.106481+0000","last_peered":"2023-10-10T21:15:07.106481+0000","last_clean":"2023-10-10T21:15:07.106481+0000","last_became_active":"2023-10-10T21:15:07.103057+0000","last_became_peered":"2023-10-10T21:15:07.103057+0000","last_unstale":"2023-10-10T21:15:07.106481+0000","last_undegraded":"2023-10-10T21:15:07.106481+0000","last_fullsized":"2023-10-10T21:15:07.106481+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:26:38.700045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118491+0000","last_change":"2023-10-10T21:15:07.114433+0000","last_active":"2023-10-10T21:15:07.118491+0000","last_peered":"2023-10-10T21:15:07.118491+0000","last_clean":"2023-10-10T21:15:07.118491+0000","last_became_active":"2023-10-10T21:15:07.114181+0000","last_became_peered":"2023-10-10T21:15:07.114181+0000","last_unstale":"2023-10-10T21:15:07.118491+0000","last_undegraded":"2023-10-10T21:15:07.118491+0000","last_fullsized":"2023-10-10T21:15:07.118491+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:56:46.378810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107320+0000","last_change":"2023-10-10T21:15:07.106043+0000","last_active":"2023-10-10T21:15:07.107320+0000","last_peered":"2023-10-10T21:15:07.107320+0000","last_clean":"2023-10-10T21:15:07.107320+0000","last_became_active":"2023-10-10T21:15:07.105509+0000","last_became_peered":"2023-10-10T21:15:07.105509+0000","last_unstale":"2023-10-10T21:15:07.107320+0000","last_undegraded":"2023-10-10T21:15:07.107320+0000","last_fullsized":"2023-10-10T21:15:07.107320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:18.210078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.123556+0000","last_change":"2023-10-10T21:15:07.118784+0000","last_active":"2023-10-10T21:15:07.123556+0000","last_peered":"2023-10-10T21:15:07.123556+0000","last_clean":"2023-10-10T21:15:07.123556+0000","last_became_active":"2023-10-10T21:15:07.118463+0000","last_became_peered":"2023-10-10T21:15:07.118463+0000","last_unstale":"2023-10-10T21:15:07.123556+0000","last_undegraded":"2023-10-10T21:15:07.123556+0000","last_fullsized":"2023-10-10T21:15:07.123556+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:18.068176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.096056+0000","last_change":"2023-10-10T21:15:07.089975+0000","last_active":"2023-10-10T21:15:07.096056+0000","last_peered":"2023-10-10T21:15:07.096056+0000","last_clean":"2023-10-10T21:15:07.096056+0000","last_became_active":"2023-10-10T21:15:07.089717+0000","last_became_peered":"2023-10-10T21:15:07.089717+0000","last_unstale":"2023-10-10T21:15:07.096056+0000","last_undegraded":"2023-10-10T21:15:07.096056+0000","last_fullsized":"2023-10-10T21:15:07.096056+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:42:46.240563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118174+0000","last_change":"2023-10-10T21:15:07.115766+0000","last_active":"2023-10-10T21:15:07.118174+0000","last_peered":"2023-10-10T21:15:07.118174+0000","last_clean":"2023-10-10T21:15:07.118174+0000","last_became_active":"2023-10-10T21:15:07.115485+0000","last_became_peered":"2023-10-10T21:15:07.115485+0000","last_unstale":"2023-10-10T21:15:07.118174+0000","last_undegraded":"2023-10-10T21:15:07.118174+0000","last_fullsized":"2023-10-10T21:15:07.118174+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:39:09.194811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.121108+0000","last_change":"2023-10-10T21:15:07.118553+0000","last_active":"2023-10-10T21:15:07.121108+0000","last_peered":"2023-10-10T21:15:07.121108+0000","last_clean":"2023-10-10T21:15:07.121108+0000","last_became_active":"2023-10-10T21:15:07.118255+0000","last_became_peered":"2023-10-10T21:15:07.118255+0000","last_unstale":"2023-10-10T21:15:07.121108+0000","last_undegraded":"2023-10-10T21:15:07.121108+0000","last_fullsized":"2023-10-10T21:15:07.121108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:12:16.715840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.120908+0000","last_change":"2023-10-10T21:15:07.119453+0000","last_active":"2023-10-10T21:15:07.120908+0000","last_peered":"2023-10-10T21:15:07.120908+0000","last_clean":"2023-10-10T21:15:07.120908+0000","last_became_active":"2023-10-10T21:15:07.119198+0000","last_became_peered":"2023-10-10T21:15:07.119198+0000","last_unstale":"2023-10-10T21:15:07.120908+0000","last_undegraded":"2023-10-10T21:15:07.120908+0000","last_fullsized":"2023-10-10T21:15:07.120908+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:55:54.859118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107176+0000","last_change":"2023-10-10T21:15:07.101459+0000","last_active":"2023-10-10T21:15:07.107176+0000","last_peered":"2023-10-10T21:15:07.107176+0000","last_clean":"2023-10-10T21:15:07.107176+0000","last_became_active":"2023-10-10T21:15:07.101193+0000","last_became_peered":"2023-10-10T21:15:07.101193+0000","last_unstale":"2023-10-10T21:15:07.107176+0000","last_undegraded":"2023-10-10T21:15:07.107176+0000","last_fullsized":"2023-10-10T21:15:07.107176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:31:25.837715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118515+0000","last_change":"2023-10-10T21:15:07.114483+0000","last_active":"2023-10-10T21:15:07.118515+0000","last_peered":"2023-10-10T21:15:07.118515+0000","last_clean":"2023-10-10T21:15:07.118515+0000","last_became_active":"2023-10-10T21:15:07.114006+0000","last_became_peered":"2023-10-10T21:15:07.114006+0000","last_unstale":"2023-10-10T21:15:07.118515+0000","last_undegraded":"2023-10-10T21:15:07.118515+0000","last_fullsized":"2023-10-10T21:15:07.118515+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:18:43.718993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104010+0000","last_change":"2023-10-10T21:15:07.100546+0000","last_active":"2023-10-10T21:15:07.104010+0000","last_peered":"2023-10-10T21:15:07.104010+0000","last_clean":"2023-10-10T21:15:07.104010+0000","last_became_active":"2023-10-10T21:15:07.100272+0000","last_became_peered":"2023-10-10T21:15:07.100272+0000","last_unstale":"2023-10-10T21:15:07.104010+0000","last_undegraded":"2023-10-10T21:15:07.104010+0000","last_fullsized":"2023-10-10T21:15:07.104010+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:38.608342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103195+0000","last_change":"2023-10-10T21:15:07.099054+0000","last_active":"2023-10-10T21:15:07.103195+0000","last_peered":"2023-10-10T21:15:07.103195+0000","last_clean":"2023-10-10T21:15:07.103195+0000","last_became_active":"2023-10-10T21:15:07.098773+0000","last_became_peered":"2023-10-10T21:15:07.098773+0000","last_unstale":"2023-10-10T21:15:07.103195+0000","last_undegraded":"2023-10-10T21:15:07.103195+0000","last_fullsized":"2023-10-10T21:15:07.103195+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:10:14.840069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.095623+0000","last_change":"2023-10-10T21:15:07.091778+0000","last_active":"2023-10-10T21:15:07.095623+0000","last_peered":"2023-10-10T21:15:07.095623+0000","last_clean":"2023-10-10T21:15:07.095623+0000","last_became_active":"2023-10-10T21:15:07.091316+0000","last_became_peered":"2023-10-10T21:15:07.091316+0000","last_unstale":"2023-10-10T21:15:07.095623+0000","last_undegraded":"2023-10-10T21:15:07.095623+0000","last_fullsized":"2023-10-10T21:15:07.095623+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:07:35.124904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106503+0000","last_change":"2023-10-10T21:15:07.103800+0000","last_active":"2023-10-10T21:15:07.106503+0000","last_peered":"2023-10-10T21:15:07.106503+0000","last_clean":"2023-10-10T21:15:07.106503+0000","last_became_active":"2023-10-10T21:15:07.103555+0000","last_became_peered":"2023-10-10T21:15:07.103555+0000","last_unstale":"2023-10-10T21:15:07.106503+0000","last_undegraded":"2023-10-10T21:15:07.106503+0000","last_fullsized":"2023-10-10T21:15:07.106503+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:57.676116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091375+0000","last_change":"2023-10-10T21:15:07.089333+0000","last_active":"2023-10-10T21:15:07.091375+0000","last_peered":"2023-10-10T21:15:07.091375+0000","last_clean":"2023-10-10T21:15:07.091375+0000","last_became_active":"2023-10-10T21:15:07.089067+0000","last_became_peered":"2023-10-10T21:15:07.089067+0000","last_unstale":"2023-10-10T21:15:07.091375+0000","last_undegraded":"2023-10-10T21:15:07.091375+0000","last_fullsized":"2023-10-10T21:15:07.091375+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:24.310509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.094744+0000","last_change":"2023-10-10T21:15:07.090919+0000","last_active":"2023-10-10T21:15:07.094744+0000","last_peered":"2023-10-10T21:15:07.094744+0000","last_clean":"2023-10-10T21:15:07.094744+0000","last_became_active":"2023-10-10T21:15:07.089823+0000","last_became_peered":"2023-10-10T21:15:07.089823+0000","last_unstale":"2023-10-10T21:15:07.094744+0000","last_undegraded":"2023-10-10T21:15:07.094744+0000","last_fullsized":"2023-10-10T21:15:07.094744+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:35:39.936568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.097081+0000","last_change":"2023-10-10T21:15:07.094521+0000","last_active":"2023-10-10T21:15:07.097081+0000","last_peered":"2023-10-10T21:15:07.097081+0000","last_clean":"2023-10-10T21:15:07.097081+0000","last_became_active":"2023-10-10T21:15:07.094193+0000","last_became_peered":"2023-10-10T21:15:07.094193+0000","last_unstale":"2023-10-10T21:15:07.097081+0000","last_undegraded":"2023-10-10T21:15:07.097081+0000","last_fullsized":"2023-10-10T21:15:07.097081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:25:05.048719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.100868+0000","last_change":"2023-10-10T21:15:07.097922+0000","last_active":"2023-10-10T21:15:07.100868+0000","last_peered":"2023-10-10T21:15:07.100868+0000","last_clean":"2023-10-10T21:15:07.100868+0000","last_became_active":"2023-10-10T21:15:07.097644+0000","last_became_peered":"2023-10-10T21:15:07.097644+0000","last_unstale":"2023-10-10T21:15:07.100868+0000","last_undegraded":"2023-10-10T21:15:07.100868+0000","last_fullsized":"2023-10-10T21:15:07.100868+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:25:31.210042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105365+0000","last_change":"2023-10-10T21:15:07.097858+0000","last_active":"2023-10-10T21:15:07.105365+0000","last_peered":"2023-10-10T21:15:07.105365+0000","last_clean":"2023-10-10T21:15:07.105365+0000","last_became_active":"2023-10-10T21:15:07.097647+0000","last_became_peered":"2023-10-10T21:15:07.097647+0000","last_unstale":"2023-10-10T21:15:07.105365+0000","last_undegraded":"2023-10-10T21:15:07.105365+0000","last_fullsized":"2023-10-10T21:15:07.105365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:13.008471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.100868+0000","last_change":"2023-10-10T21:15:07.091247+0000","last_active":"2023-10-10T21:15:07.100868+0000","last_peered":"2023-10-10T21:15:07.100868+0000","last_clean":"2023-10-10T21:15:07.100868+0000","last_became_active":"2023-10-10T21:15:07.091011+0000","last_became_peered":"2023-10-10T21:15:07.091011+0000","last_unstale":"2023-10-10T21:15:07.100868+0000","last_undegraded":"2023-10-10T21:15:07.100868+0000","last_fullsized":"2023-10-10T21:15:07.100868+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:27.253735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.108424+0000","last_change":"2023-10-10T21:15:07.107295+0000","last_active":"2023-10-10T21:15:07.108424+0000","last_peered":"2023-10-10T21:15:07.108424+0000","last_clean":"2023-10-10T21:15:07.108424+0000","last_became_active":"2023-10-10T21:15:07.107040+0000","last_became_peered":"2023-10-10T21:15:07.107040+0000","last_unstale":"2023-10-10T21:15:07.108424+0000","last_undegraded":"2023-10-10T21:15:07.108424+0000","last_fullsized":"2023-10-10T21:15:07.108424+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:07:35.124904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.111679+0000","last_change":"2023-10-10T21:15:06.092828+0000","last_active":"2023-10-10T21:15:07.111679+0000","last_peered":"2023-10-10T21:15:07.111679+0000","last_clean":"2023-10-10T21:15:07.111679+0000","last_became_active":"2023-10-10T21:15:06.092557+0000","last_became_peered":"2023-10-10T21:15:06.092557+0000","last_unstale":"2023-10-10T21:15:07.111679+0000","last_undegraded":"2023-10-10T21:15:07.111679+0000","last_fullsized":"2023-10-10T21:15:07.111679+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:13.532469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.097228+0000","last_change":"2023-10-10T21:15:07.094640+0000","last_active":"2023-10-10T21:15:07.097228+0000","last_peered":"2023-10-10T21:15:07.097228+0000","last_clean":"2023-10-10T21:15:07.097228+0000","last_became_active":"2023-10-10T21:15:07.094345+0000","last_became_peered":"2023-10-10T21:15:07.094345+0000","last_unstale":"2023-10-10T21:15:07.097228+0000","last_undegraded":"2023-10-10T21:15:07.097228+0000","last_fullsized":"2023-10-10T21:15:07.097228+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:16:30.373404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112467+0000","last_change":"2023-10-10T21:15:06.091709+0000","last_active":"2023-10-10T21:15:07.112467+0000","last_peered":"2023-10-10T21:15:07.112467+0000","last_clean":"2023-10-10T21:15:07.112467+0000","last_became_active":"2023-10-10T21:15:06.091434+0000","last_became_peered":"2023-10-10T21:15:06.091434+0000","last_unstale":"2023-10-10T21:15:07.112467+0000","last_undegraded":"2023-10-10T21:15:07.112467+0000","last_fullsized":"2023-10-10T21:15:07.112467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:47:32.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.100331+0000","last_change":"2023-10-10T21:15:07.094649+0000","last_active":"2023-10-10T21:15:07.100331+0000","last_peered":"2023-10-10T21:15:07.100331+0000","last_clean":"2023-10-10T21:15:07.100331+0000","last_became_active":"2023-10-10T21:15:07.094397+0000","last_became_peered":"2023-10-10T21:15:07.094397+0000","last_unstale":"2023-10-10T21:15:07.100331+0000","last_undegraded":"2023-10-10T21:15:07.100331+0000","last_fullsized":"2023-10-10T21:15:07.100331+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:10.301679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.108515+0000","last_change":"2023-10-10T21:15:06.088094+0000","last_active":"2023-10-10T21:15:07.108515+0000","last_peered":"2023-10-10T21:15:07.108515+0000","last_clean":"2023-10-10T21:15:07.108515+0000","last_became_active":"2023-10-10T21:15:06.087823+0000","last_became_peered":"2023-10-10T21:15:06.087823+0000","last_unstale":"2023-10-10T21:15:07.108515+0000","last_undegraded":"2023-10-10T21:15:07.108515+0000","last_fullsized":"2023-10-10T21:15:07.108515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.192673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.102132+0000","last_change":"2023-10-10T21:15:07.099450+0000","last_active":"2023-10-10T21:15:07.102132+0000","last_peered":"2023-10-10T21:15:07.102132+0000","last_clean":"2023-10-10T21:15:07.102132+0000","last_became_active":"2023-10-10T21:15:07.099154+0000","last_became_peered":"2023-10-10T21:15:07.099154+0000","last_unstale":"2023-10-10T21:15:07.102132+0000","last_undegraded":"2023-10-10T21:15:07.102132+0000","last_fullsized":"2023-10-10T21:15:07.102132+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:10:14.840069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112486+0000","last_change":"2023-10-10T21:15:06.087703+0000","last_active":"2023-10-10T21:15:07.112486+0000","last_peered":"2023-10-10T21:15:07.112486+0000","last_clean":"2023-10-10T21:15:07.112486+0000","last_became_active":"2023-10-10T21:15:06.087414+0000","last_became_peered":"2023-10-10T21:15:06.087414+0000","last_unstale":"2023-10-10T21:15:07.112486+0000","last_undegraded":"2023-10-10T21:15:07.112486+0000","last_fullsized":"2023-10-10T21:15:07.112486+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:05:44.422914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.099562+0000","last_change":"2023-10-10T21:15:07.096133+0000","last_active":"2023-10-10T21:15:07.099562+0000","last_peered":"2023-10-10T21:15:07.099562+0000","last_clean":"2023-10-10T21:15:07.099562+0000","last_became_active":"2023-10-10T21:15:07.095833+0000","last_became_peered":"2023-10-10T21:15:07.095833+0000","last_unstale":"2023-10-10T21:15:07.099562+0000","last_undegraded":"2023-10-10T21:15:07.099562+0000","last_fullsized":"2023-10-10T21:15:07.099562+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:05:45.428439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109536+0000","last_change":"2023-10-10T21:15:06.088657+0000","last_active":"2023-10-10T21:15:07.109536+0000","last_peered":"2023-10-10T21:15:07.109536+0000","last_clean":"2023-10-10T21:15:07.109536+0000","last_became_active":"2023-10-10T21:15:06.088320+0000","last_became_peered":"2023-10-10T21:15:06.088320+0000","last_unstale":"2023-10-10T21:15:07.109536+0000","last_undegraded":"2023-10-10T21:15:07.109536+0000","last_fullsized":"2023-10-10T21:15:07.109536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:30.505874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118936+0000","last_change":"2023-10-10T21:15:07.115118+0000","last_active":"2023-10-10T21:15:07.118936+0000","last_peered":"2023-10-10T21:15:07.118936+0000","last_clean":"2023-10-10T21:15:07.118936+0000","last_became_active":"2023-10-10T21:15:07.114743+0000","last_became_peered":"2023-10-10T21:15:07.114743+0000","last_unstale":"2023-10-10T21:15:07.118936+0000","last_undegraded":"2023-10-10T21:15:07.118936+0000","last_fullsized":"2023-10-10T21:15:07.118936+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:05:45.428439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.110987+0000","last_change":"2023-10-10T21:15:06.084039+0000","last_active":"2023-10-10T21:15:07.110987+0000","last_peered":"2023-10-10T21:15:07.110987+0000","last_clean":"2023-10-10T21:15:07.110987+0000","last_became_active":"2023-10-10T21:15:06.083773+0000","last_became_peered":"2023-10-10T21:15:06.083773+0000","last_unstale":"2023-10-10T21:15:07.110987+0000","last_undegraded":"2023-10-10T21:15:07.110987+0000","last_fullsized":"2023-10-10T21:15:07.110987+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:25:04.043194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119387+0000","last_change":"2023-10-10T21:15:07.115375+0000","last_active":"2023-10-10T21:15:07.119387+0000","last_peered":"2023-10-10T21:15:07.119387+0000","last_clean":"2023-10-10T21:15:07.119387+0000","last_became_active":"2023-10-10T21:15:07.114686+0000","last_became_peered":"2023-10-10T21:15:07.114686+0000","last_unstale":"2023-10-10T21:15:07.119387+0000","last_undegraded":"2023-10-10T21:15:07.119387+0000","last_fullsized":"2023-10-10T21:15:07.119387+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:51.580942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.082087+0000","last_change":"2023-10-10T21:15:06.081290+0000","last_active":"2023-10-10T21:15:07.082087+0000","last_peered":"2023-10-10T21:15:07.082087+0000","last_clean":"2023-10-10T21:15:07.082087+0000","last_became_active":"2023-10-10T21:15:06.081006+0000","last_became_peered":"2023-10-10T21:15:06.081006+0000","last_unstale":"2023-10-10T21:15:07.082087+0000","last_undegraded":"2023-10-10T21:15:07.082087+0000","last_fullsized":"2023-10-10T21:15:07.082087+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:58:37.051603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103179+0000","last_change":"2023-10-10T21:15:07.099811+0000","last_active":"2023-10-10T21:15:07.103179+0000","last_peered":"2023-10-10T21:15:07.103179+0000","last_clean":"2023-10-10T21:15:07.103179+0000","last_became_active":"2023-10-10T21:15:07.099438+0000","last_became_peered":"2023-10-10T21:15:07.099438+0000","last_unstale":"2023-10-10T21:15:07.103179+0000","last_undegraded":"2023-10-10T21:15:07.103179+0000","last_fullsized":"2023-10-10T21:15:07.103179+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:58:38.057128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103570+0000","last_change":"2023-10-10T21:15:06.083230+0000","last_active":"2023-10-10T21:15:07.103570+0000","last_peered":"2023-10-10T21:15:07.103570+0000","last_clean":"2023-10-10T21:15:07.103570+0000","last_became_active":"2023-10-10T21:15:06.082892+0000","last_became_peered":"2023-10-10T21:15:06.082892+0000","last_unstale":"2023-10-10T21:15:07.103570+0000","last_undegraded":"2023-10-10T21:15:07.103570+0000","last_fullsized":"2023-10-10T21:15:07.103570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:25:04.043194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118192+0000","last_change":"2023-10-10T21:15:07.115851+0000","last_active":"2023-10-10T21:15:07.118192+0000","last_peered":"2023-10-10T21:15:07.118192+0000","last_clean":"2023-10-10T21:15:07.118192+0000","last_became_active":"2023-10-10T21:15:07.115495+0000","last_became_peered":"2023-10-10T21:15:07.115495+0000","last_unstale":"2023-10-10T21:15:07.118192+0000","last_undegraded":"2023-10-10T21:15:07.118192+0000","last_fullsized":"2023-10-10T21:15:07.118192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:07.423567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.083905+0000","last_change":"2023-10-10T21:15:06.081208+0000","last_active":"2023-10-10T21:15:07.083905+0000","last_peered":"2023-10-10T21:15:07.083905+0000","last_clean":"2023-10-10T21:15:07.083905+0000","last_became_active":"2023-10-10T21:15:06.080785+0000","last_became_peered":"2023-10-10T21:15:06.080785+0000","last_unstale":"2023-10-10T21:15:07.083905+0000","last_undegraded":"2023-10-10T21:15:07.083905+0000","last_fullsized":"2023-10-10T21:15:07.083905+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:56:10.494994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.099541+0000","last_change":"2023-10-10T21:15:07.097589+0000","last_active":"2023-10-10T21:15:07.099541+0000","last_peered":"2023-10-10T21:15:07.099541+0000","last_clean":"2023-10-10T21:15:07.099541+0000","last_became_active":"2023-10-10T21:15:07.097299+0000","last_became_peered":"2023-10-10T21:15:07.097299+0000","last_unstale":"2023-10-10T21:15:07.099541+0000","last_undegraded":"2023-10-10T21:15:07.099541+0000","last_fullsized":"2023-10-10T21:15:07.099541+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:18:47.104316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105276+0000","last_change":"2023-10-10T21:15:06.080102+0000","last_active":"2023-10-10T21:15:07.105276+0000","last_peered":"2023-10-10T21:15:07.105276+0000","last_clean":"2023-10-10T21:15:07.105276+0000","last_became_active":"2023-10-10T21:15:06.079798+0000","last_became_peered":"2023-10-10T21:15:06.079798+0000","last_unstale":"2023-10-10T21:15:07.105276+0000","last_undegraded":"2023-10-10T21:15:07.105276+0000","last_fullsized":"2023-10-10T21:15:07.105276+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:21:13.803869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106436+0000","last_change":"2023-10-10T21:15:07.092528+0000","last_active":"2023-10-10T21:15:07.106436+0000","last_peered":"2023-10-10T21:15:07.106436+0000","last_clean":"2023-10-10T21:15:07.106436+0000","last_became_active":"2023-10-10T21:15:07.092265+0000","last_became_peered":"2023-10-10T21:15:07.092265+0000","last_unstale":"2023-10-10T21:15:07.106436+0000","last_undegraded":"2023-10-10T21:15:07.106436+0000","last_fullsized":"2023-10-10T21:15:07.106436+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:10:53.807646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"63'3","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112884+0000","last_change":"2023-10-10T21:15:06.092181+0000","last_active":"2023-10-10T21:15:07.112884+0000","last_peered":"2023-10-10T21:15:07.112884+0000","last_clean":"2023-10-10T21:15:07.112884+0000","last_became_active":"2023-10-10T21:15:06.091710+0000","last_became_peered":"2023-10-10T21:15:06.091710+0000","last_unstale":"2023-10-10T21:15:07.112884+0000","last_undegraded":"2023-10-10T21:15:07.112884+0000","last_fullsized":"2023-10-10T21:15:07.112884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:30:42.790373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104035+0000","last_change":"2023-10-10T21:15:07.102811+0000","last_active":"2023-10-10T21:15:07.104035+0000","last_peered":"2023-10-10T21:15:07.104035+0000","last_clean":"2023-10-10T21:15:07.104035+0000","last_became_active":"2023-10-10T21:15:07.102540+0000","last_became_peered":"2023-10-10T21:15:07.102540+0000","last_unstale":"2023-10-10T21:15:07.104035+0000","last_undegraded":"2023-10-10T21:15:07.104035+0000","last_fullsized":"2023-10-10T21:15:07.104035+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:36:41.383776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"63'6","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.120605+0000","last_change":"2023-10-10T21:15:06.082352+0000","last_active":"2023-10-10T21:15:07.120605+0000","last_peered":"2023-10-10T21:15:07.120605+0000","last_clean":"2023-10-10T21:15:07.120605+0000","last_became_active":"2023-10-10T21:15:06.082074+0000","last_became_peered":"2023-10-10T21:15:06.082074+0000","last_unstale":"2023-10-10T21:15:07.120605+0000","last_undegraded":"2023-10-10T21:15:07.120605+0000","last_fullsized":"2023-10-10T21:15:07.120605+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:32:03.467041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118925+0000","last_change":"2023-10-10T21:15:07.117196+0000","last_active":"2023-10-10T21:15:07.118925+0000","last_peered":"2023-10-10T21:15:07.118925+0000","last_clean":"2023-10-10T21:15:07.118925+0000","last_became_active":"2023-10-10T21:15:07.116924+0000","last_became_peered":"2023-10-10T21:15:07.116924+0000","last_unstale":"2023-10-10T21:15:07.118925+0000","last_undegraded":"2023-10-10T21:15:07.118925+0000","last_fullsized":"2023-10-10T21:15:07.118925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:26:49.399409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.117735+0000","last_change":"2023-10-10T21:15:06.089522+0000","last_active":"2023-10-10T21:15:07.117735+0000","last_peered":"2023-10-10T21:15:07.117735+0000","last_clean":"2023-10-10T21:15:07.117735+0000","last_became_active":"2023-10-10T21:15:06.089268+0000","last_became_peered":"2023-10-10T21:15:06.089268+0000","last_unstale":"2023-10-10T21:15:07.117735+0000","last_undegraded":"2023-10-10T21:15:07.117735+0000","last_fullsized":"2023-10-10T21:15:07.117735+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:02.311839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.116496+0000","last_change":"2023-10-10T21:15:07.112293+0000","last_active":"2023-10-10T21:15:07.116496+0000","last_peered":"2023-10-10T21:15:07.116496+0000","last_clean":"2023-10-10T21:15:07.116496+0000","last_became_active":"2023-10-10T21:15:07.112121+0000","last_became_peered":"2023-10-10T21:15:07.112121+0000","last_unstale":"2023-10-10T21:15:07.116496+0000","last_undegraded":"2023-10-10T21:15:07.116496+0000","last_fullsized":"2023-10-10T21:15:07.116496+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:07.423567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.092198+0000","last_change":"2023-10-10T21:15:06.080977+0000","last_active":"2023-10-10T21:15:07.092198+0000","last_peered":"2023-10-10T21:15:07.092198+0000","last_clean":"2023-10-10T21:15:07.092198+0000","last_became_active":"2023-10-10T21:15:06.080700+0000","last_became_peered":"2023-10-10T21:15:06.080700+0000","last_unstale":"2023-10-10T21:15:07.092198+0000","last_undegraded":"2023-10-10T21:15:07.092198+0000","last_fullsized":"2023-10-10T21:15:07.092198+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:56.523008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105466+0000","last_change":"2023-10-10T21:15:07.092596+0000","last_active":"2023-10-10T21:15:07.105466+0000","last_peered":"2023-10-10T21:15:07.105466+0000","last_clean":"2023-10-10T21:15:07.105466+0000","last_became_active":"2023-10-10T21:15:07.092320+0000","last_became_peered":"2023-10-10T21:15:07.092320+0000","last_unstale":"2023-10-10T21:15:07.105466+0000","last_undegraded":"2023-10-10T21:15:07.105466+0000","last_fullsized":"2023-10-10T21:15:07.105466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:16:24.209480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.091819+0000","last_change":"2023-10-10T21:15:06.089710+0000","last_active":"2023-10-10T21:15:07.091819+0000","last_peered":"2023-10-10T21:15:07.091819+0000","last_clean":"2023-10-10T21:15:07.091819+0000","last_became_active":"2023-10-10T21:15:06.089385+0000","last_became_peered":"2023-10-10T21:15:06.089385+0000","last_unstale":"2023-10-10T21:15:07.091819+0000","last_undegraded":"2023-10-10T21:15:07.091819+0000","last_fullsized":"2023-10-10T21:15:07.091819+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:45.674860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105656+0000","last_change":"2023-10-10T21:15:07.103940+0000","last_active":"2023-10-10T21:15:07.105656+0000","last_peered":"2023-10-10T21:15:07.105656+0000","last_clean":"2023-10-10T21:15:07.105656+0000","last_became_active":"2023-10-10T21:15:07.103533+0000","last_became_peered":"2023-10-10T21:15:07.103533+0000","last_unstale":"2023-10-10T21:15:07.105656+0000","last_undegraded":"2023-10-10T21:15:07.105656+0000","last_fullsized":"2023-10-10T21:15:07.105656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:19:05.206240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"63'8","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.127035+0000","last_change":"2023-10-10T21:15:06.083506+0000","last_active":"2023-10-10T21:15:07.127035+0000","last_peered":"2023-10-10T21:15:07.127035+0000","last_clean":"2023-10-10T21:15:07.127035+0000","last_became_active":"2023-10-10T21:15:06.083253+0000","last_became_peered":"2023-10-10T21:15:06.083253+0000","last_unstale":"2023-10-10T21:15:07.127035+0000","last_undegraded":"2023-10-10T21:15:07.127035+0000","last_fullsized":"2023-10-10T21:15:07.127035+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:47:32.761082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106277+0000","last_change":"2023-10-10T21:15:07.096304+0000","last_active":"2023-10-10T21:15:07.106277+0000","last_peered":"2023-10-10T21:15:07.106277+0000","last_clean":"2023-10-10T21:15:07.106277+0000","last_became_active":"2023-10-10T21:15:07.095985+0000","last_became_peered":"2023-10-10T21:15:07.095985+0000","last_unstale":"2023-10-10T21:15:07.106277+0000","last_undegraded":"2023-10-10T21:15:07.106277+0000","last_fullsized":"2023-10-10T21:15:07.106277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:49:18.889370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.113346+0000","last_change":"2023-10-10T21:15:06.079634+0000","last_active":"2023-10-10T21:15:07.113346+0000","last_peered":"2023-10-10T21:15:07.113346+0000","last_clean":"2023-10-10T21:15:07.113346+0000","last_became_active":"2023-10-10T21:15:06.079349+0000","last_became_peered":"2023-10-10T21:15:06.079349+0000","last_unstale":"2023-10-10T21:15:07.113346+0000","last_undegraded":"2023-10-10T21:15:07.113346+0000","last_fullsized":"2023-10-10T21:15:07.113346+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:42:25.785573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.120060+0000","last_change":"2023-10-10T21:15:07.115513+0000","last_active":"2023-10-10T21:15:07.120060+0000","last_peered":"2023-10-10T21:15:07.120060+0000","last_clean":"2023-10-10T21:15:07.120060+0000","last_became_active":"2023-10-10T21:15:07.115167+0000","last_became_peered":"2023-10-10T21:15:07.115167+0000","last_unstale":"2023-10-10T21:15:07.120060+0000","last_undegraded":"2023-10-10T21:15:07.120060+0000","last_fullsized":"2023-10-10T21:15:07.120060+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:41:32.603813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.111513+0000","last_change":"2023-10-10T21:15:06.085533+0000","last_active":"2023-10-10T21:15:07.111513+0000","last_peered":"2023-10-10T21:15:07.111513+0000","last_clean":"2023-10-10T21:15:07.111513+0000","last_became_active":"2023-10-10T21:15:06.084929+0000","last_became_peered":"2023-10-10T21:15:06.084929+0000","last_unstale":"2023-10-10T21:15:07.111513+0000","last_undegraded":"2023-10-10T21:15:07.111513+0000","last_fullsized":"2023-10-10T21:15:07.111513+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:10:13.834544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104056+0000","last_change":"2023-10-10T21:15:07.102495+0000","last_active":"2023-10-10T21:15:07.104056+0000","last_peered":"2023-10-10T21:15:07.104056+0000","last_clean":"2023-10-10T21:15:07.104056+0000","last_became_active":"2023-10-10T21:15:07.102090+0000","last_became_peered":"2023-10-10T21:15:07.102090+0000","last_unstale":"2023-10-10T21:15:07.104056+0000","last_undegraded":"2023-10-10T21:15:07.104056+0000","last_fullsized":"2023-10-10T21:15:07.104056+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:29.882590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112832+0000","last_change":"2023-10-10T21:15:06.082316+0000","last_active":"2023-10-10T21:15:07.112832+0000","last_peered":"2023-10-10T21:15:07.112832+0000","last_clean":"2023-10-10T21:15:07.112832+0000","last_became_active":"2023-10-10T21:15:06.082053+0000","last_became_peered":"2023-10-10T21:15:06.082053+0000","last_unstale":"2023-10-10T21:15:07.112832+0000","last_undegraded":"2023-10-10T21:15:07.112832+0000","last_fullsized":"2023-10-10T21:15:07.112832+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:17:59.089464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.104044+0000","last_change":"2023-10-10T21:15:07.101570+0000","last_active":"2023-10-10T21:15:07.104044+0000","last_peered":"2023-10-10T21:15:07.104044+0000","last_clean":"2023-10-10T21:15:07.104044+0000","last_became_active":"2023-10-10T21:15:07.101247+0000","last_became_peered":"2023-10-10T21:15:07.101247+0000","last_unstale":"2023-10-10T21:15:07.104044+0000","last_undegraded":"2023-10-10T21:15:07.104044+0000","last_fullsized":"2023-10-10T21:15:07.104044+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:47:33.766607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.087569+0000","last_change":"2023-10-10T21:15:06.090826+0000","last_active":"2023-10-10T21:15:07.087569+0000","last_peered":"2023-10-10T21:15:07.087569+0000","last_clean":"2023-10-10T21:15:07.087569+0000","last_became_active":"2023-10-10T21:15:06.090567+0000","last_became_peered":"2023-10-10T21:15:06.090567+0000","last_unstale":"2023-10-10T21:15:07.087569+0000","last_undegraded":"2023-10-10T21:15:07.087569+0000","last_fullsized":"2023-10-10T21:15:07.087569+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:21:02.927652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106677+0000","last_change":"2023-10-10T21:15:07.103070+0000","last_active":"2023-10-10T21:15:07.106677+0000","last_peered":"2023-10-10T21:15:07.106677+0000","last_clean":"2023-10-10T21:15:07.106677+0000","last_became_active":"2023-10-10T21:15:07.102143+0000","last_became_peered":"2023-10-10T21:15:07.102143+0000","last_unstale":"2023-10-10T21:15:07.106677+0000","last_undegraded":"2023-10-10T21:15:07.106677+0000","last_fullsized":"2023-10-10T21:15:07.106677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:52.486720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.109649+0000","last_change":"2023-10-10T21:15:06.089714+0000","last_active":"2023-10-10T21:15:07.109649+0000","last_peered":"2023-10-10T21:15:07.109649+0000","last_clean":"2023-10-10T21:15:07.109649+0000","last_became_active":"2023-10-10T21:15:06.089472+0000","last_became_peered":"2023-10-10T21:15:06.089472+0000","last_unstale":"2023-10-10T21:15:07.109649+0000","last_undegraded":"2023-10-10T21:15:07.109649+0000","last_fullsized":"2023-10-10T21:15:07.109649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:31.996775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.097963+0000","last_change":"2023-10-10T21:15:07.089609+0000","last_active":"2023-10-10T21:15:07.097963+0000","last_peered":"2023-10-10T21:15:07.097963+0000","last_clean":"2023-10-10T21:15:07.097963+0000","last_became_active":"2023-10-10T21:15:07.089353+0000","last_became_peered":"2023-10-10T21:15:07.089353+0000","last_unstale":"2023-10-10T21:15:07.097963+0000","last_undegraded":"2023-10-10T21:15:07.097963+0000","last_fullsized":"2023-10-10T21:15:07.097963+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:56:11.500519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.082299+0000","last_change":"2023-10-10T21:15:06.091050+0000","last_active":"2023-10-10T21:15:07.082299+0000","last_peered":"2023-10-10T21:15:07.082299+0000","last_clean":"2023-10-10T21:15:07.082299+0000","last_became_active":"2023-10-10T21:15:06.090769+0000","last_became_peered":"2023-10-10T21:15:06.090769+0000","last_unstale":"2023-10-10T21:15:07.082299+0000","last_undegraded":"2023-10-10T21:15:07.082299+0000","last_fullsized":"2023-10-10T21:15:07.082299+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:16:29.367879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.106372+0000","last_change":"2023-10-10T21:15:07.100774+0000","last_active":"2023-10-10T21:15:07.106372+0000","last_peered":"2023-10-10T21:15:07.106372+0000","last_clean":"2023-10-10T21:15:07.106372+0000","last_became_active":"2023-10-10T21:15:07.100483+0000","last_became_peered":"2023-10-10T21:15:07.100483+0000","last_unstale":"2023-10-10T21:15:07.106372+0000","last_undegraded":"2023-10-10T21:15:07.106372+0000","last_fullsized":"2023-10-10T21:15:07.106372+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:48:20.556193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.102894+0000","last_change":"2023-10-10T21:15:06.080996+0000","last_active":"2023-10-10T21:15:07.102894+0000","last_peered":"2023-10-10T21:15:07.102894+0000","last_clean":"2023-10-10T21:15:07.102894+0000","last_became_active":"2023-10-10T21:15:06.079486+0000","last_became_peered":"2023-10-10T21:15:06.079486+0000","last_unstale":"2023-10-10T21:15:07.102894+0000","last_undegraded":"2023-10-10T21:15:07.102894+0000","last_fullsized":"2023-10-10T21:15:07.102894+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:25:40.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118757+0000","last_change":"2023-10-10T21:15:07.114150+0000","last_active":"2023-10-10T21:15:07.118757+0000","last_peered":"2023-10-10T21:15:07.118757+0000","last_clean":"2023-10-10T21:15:07.118757+0000","last_became_active":"2023-10-10T21:15:07.113969+0000","last_became_peered":"2023-10-10T21:15:07.113969+0000","last_unstale":"2023-10-10T21:15:07.118757+0000","last_undegraded":"2023-10-10T21:15:07.118757+0000","last_fullsized":"2023-10-10T21:15:07.118757+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:02.784745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.090820+0000","last_change":"2023-10-10T21:15:06.081894+0000","last_active":"2023-10-10T21:15:07.090820+0000","last_peered":"2023-10-10T21:15:07.090820+0000","last_clean":"2023-10-10T21:15:07.090820+0000","last_became_active":"2023-10-10T21:15:06.081576+0000","last_became_peered":"2023-10-10T21:15:06.081576+0000","last_unstale":"2023-10-10T21:15:07.090820+0000","last_undegraded":"2023-10-10T21:15:07.090820+0000","last_fullsized":"2023-10-10T21:15:07.090820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:56:45.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.118868+0000","last_change":"2023-10-10T21:15:07.116577+0000","last_active":"2023-10-10T21:15:07.118868+0000","last_peered":"2023-10-10T21:15:07.118868+0000","last_clean":"2023-10-10T21:15:07.118868+0000","last_became_active":"2023-10-10T21:15:07.116303+0000","last_became_peered":"2023-10-10T21:15:07.116303+0000","last_unstale":"2023-10-10T21:15:07.118868+0000","last_undegraded":"2023-10-10T21:15:07.118868+0000","last_fullsized":"2023-10-10T21:15:07.118868+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:18:00.094989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-10T21:15:08.407287+0000","last_change":"2023-10-10T21:15:06.089097+0000","last_active":"2023-10-10T21:15:08.407287+0000","last_peered":"2023-10-10T21:15:08.407287+0000","last_clean":"2023-10-10T21:15:08.407287+0000","last_became_active":"2023-10-10T21:15:06.088816+0000","last_became_peered":"2023-10-10T21:15:06.088816+0000","last_unstale":"2023-10-10T21:15:08.407287+0000","last_undegraded":"2023-10-10T21:15:08.407287+0000","last_fullsized":"2023-10-10T21:15:08.407287+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:58:06.775845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119211+0000","last_change":"2023-10-10T21:15:07.116010+0000","last_active":"2023-10-10T21:15:07.119211+0000","last_peered":"2023-10-10T21:15:07.119211+0000","last_clean":"2023-10-10T21:15:07.119211+0000","last_became_active":"2023-10-10T21:15:07.115714+0000","last_became_peered":"2023-10-10T21:15:07.115714+0000","last_unstale":"2023-10-10T21:15:07.119211+0000","last_undegraded":"2023-10-10T21:15:07.119211+0000","last_fullsized":"2023-10-10T21:15:07.119211+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:57.528533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.092959+0000","last_change":"2023-10-10T21:15:06.092389+0000","last_active":"2023-10-10T21:15:07.092959+0000","last_peered":"2023-10-10T21:15:07.092959+0000","last_clean":"2023-10-10T21:15:07.092959+0000","last_became_active":"2023-10-10T21:15:06.092084+0000","last_became_peered":"2023-10-10T21:15:06.092084+0000","last_unstale":"2023-10-10T21:15:07.092959+0000","last_undegraded":"2023-10-10T21:15:07.092959+0000","last_fullsized":"2023-10-10T21:15:07.092959+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:42:45.235038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.108612+0000","last_change":"2023-10-10T21:15:07.107492+0000","last_active":"2023-10-10T21:15:07.108612+0000","last_peered":"2023-10-10T21:15:07.108612+0000","last_clean":"2023-10-10T21:15:07.108612+0000","last_became_active":"2023-10-10T21:15:07.107190+0000","last_became_peered":"2023-10-10T21:15:07.107190+0000","last_unstale":"2023-10-10T21:15:07.108612+0000","last_undegraded":"2023-10-10T21:15:07.108612+0000","last_fullsized":"2023-10-10T21:15:07.108612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:51:11.425493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.082620+0000","last_change":"2023-10-10T21:15:06.088136+0000","last_active":"2023-10-10T21:15:07.082620+0000","last_peered":"2023-10-10T21:15:07.082620+0000","last_clean":"2023-10-10T21:15:07.082620+0000","last_became_active":"2023-10-10T21:15:06.087797+0000","last_became_peered":"2023-10-10T21:15:06.087797+0000","last_unstale":"2023-10-10T21:15:07.082620+0000","last_undegraded":"2023-10-10T21:15:07.082620+0000","last_fullsized":"2023-10-10T21:15:07.082620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:25:40.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.105498+0000","last_change":"2023-10-10T21:15:07.093269+0000","last_active":"2023-10-10T21:15:07.105498+0000","last_peered":"2023-10-10T21:15:07.105498+0000","last_clean":"2023-10-10T21:15:07.105498+0000","last_became_active":"2023-10-10T21:15:07.093033+0000","last_became_peered":"2023-10-10T21:15:07.093033+0000","last_unstale":"2023-10-10T21:15:07.105498+0000","last_undegraded":"2023-10-10T21:15:07.105498+0000","last_fullsized":"2023-10-10T21:15:07.105498+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:22:26.447544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.092629+0000","last_change":"2023-10-10T21:15:06.092046+0000","last_active":"2023-10-10T21:15:07.092629+0000","last_peered":"2023-10-10T21:15:07.092629+0000","last_clean":"2023-10-10T21:15:07.092629+0000","last_became_active":"2023-10-10T21:15:06.090893+0000","last_became_peered":"2023-10-10T21:15:06.090893+0000","last_unstale":"2023-10-10T21:15:07.092629+0000","last_undegraded":"2023-10-10T21:15:07.092629+0000","last_fullsized":"2023-10-10T21:15:07.092629+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:01.779220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.107200+0000","last_change":"2023-10-10T21:15:07.103541+0000","last_active":"2023-10-10T21:15:07.107200+0000","last_peered":"2023-10-10T21:15:07.107200+0000","last_clean":"2023-10-10T21:15:07.107200+0000","last_became_active":"2023-10-10T21:15:07.103293+0000","last_became_peered":"2023-10-10T21:15:07.103293+0000","last_unstale":"2023-10-10T21:15:07.107200+0000","last_undegraded":"2023-10-10T21:15:07.107200+0000","last_fullsized":"2023-10-10T21:15:07.107200+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:51:42.410363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.083747+0000","last_change":"2023-10-10T21:15:06.088264+0000","last_active":"2023-10-10T21:15:07.083747+0000","last_peered":"2023-10-10T21:15:07.083747+0000","last_clean":"2023-10-10T21:15:07.083747+0000","last_became_active":"2023-10-10T21:15:06.087904+0000","last_became_peered":"2023-10-10T21:15:06.087904+0000","last_unstale":"2023-10-10T21:15:07.083747+0000","last_undegraded":"2023-10-10T21:15:07.083747+0000","last_fullsized":"2023-10-10T21:15:07.083747+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:22.415717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.088583+0000","last_change":"2023-10-10T21:15:07.084909+0000","last_active":"2023-10-10T21:15:07.088583+0000","last_peered":"2023-10-10T21:15:07.088583+0000","last_clean":"2023-10-10T21:15:07.088583+0000","last_became_active":"2023-10-10T21:15:07.084674+0000","last_became_peered":"2023-10-10T21:15:07.084674+0000","last_unstale":"2023-10-10T21:15:07.088583+0000","last_undegraded":"2023-10-10T21:15:07.088583+0000","last_fullsized":"2023-10-10T21:15:07.088583+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:51.580942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.082786+0000","last_change":"2023-10-10T21:15:06.091301+0000","last_active":"2023-10-10T21:15:07.082786+0000","last_peered":"2023-10-10T21:15:07.082786+0000","last_clean":"2023-10-10T21:15:07.082786+0000","last_became_active":"2023-10-10T21:15:06.090910+0000","last_became_peered":"2023-10-10T21:15:06.090910+0000","last_unstale":"2023-10-10T21:15:07.082786+0000","last_undegraded":"2023-10-10T21:15:07.082786+0000","last_fullsized":"2023-10-10T21:15:07.082786+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:28:28.977471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103946+0000","last_change":"2023-10-10T21:15:07.102516+0000","last_active":"2023-10-10T21:15:07.103946+0000","last_peered":"2023-10-10T21:15:07.103946+0000","last_clean":"2023-10-10T21:15:07.103946+0000","last_became_active":"2023-10-10T21:15:07.102235+0000","last_became_peered":"2023-10-10T21:15:07.102235+0000","last_unstale":"2023-10-10T21:15:07.103946+0000","last_undegraded":"2023-10-10T21:15:07.103946+0000","last_fullsized":"2023-10-10T21:15:07.103946+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:02.784745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.103474+0000","last_change":"2023-10-10T21:15:06.090826+0000","last_active":"2023-10-10T21:15:07.103474+0000","last_peered":"2023-10-10T21:15:07.103474+0000","last_clean":"2023-10-10T21:15:07.103474+0000","last_became_active":"2023-10-10T21:15:06.090516+0000","last_became_peered":"2023-10-10T21:15:06.090516+0000","last_unstale":"2023-10-10T21:15:07.103474+0000","last_undegraded":"2023-10-10T21:15:07.103474+0000","last_fullsized":"2023-10-10T21:15:07.103474+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:10:22.415717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.119246+0000","last_change":"2023-10-10T21:15:07.115765+0000","last_active":"2023-10-10T21:15:07.119246+0000","last_peered":"2023-10-10T21:15:07.119246+0000","last_clean":"2023-10-10T21:15:07.119246+0000","last_became_active":"2023-10-10T21:15:07.115520+0000","last_became_peered":"2023-10-10T21:15:07.115520+0000","last_unstale":"2023-10-10T21:15:07.119246+0000","last_undegraded":"2023-10-10T21:15:07.119246+0000","last_fullsized":"2023-10-10T21:15:07.119246+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:06.060127+0000","last_clean_scrub_stamp":"2023-10-10T21:15:06.060127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:39:09.194811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.112916+0000","last_change":"2023-10-10T21:15:06.083202+0000","last_active":"2023-10-10T21:15:07.112916+0000","last_peered":"2023-10-10T21:15:07.112916+0000","last_clean":"2023-10-10T21:15:07.112916+0000","last_became_active":"2023-10-10T21:15:06.082933+0000","last_became_peered":"2023-10-10T21:15:06.082933+0000","last_unstale":"2023-10-10T21:15:07.112916+0000","last_undegraded":"2023-10-10T21:15:07.112916+0000","last_fullsized":"2023-10-10T21:15:07.112916+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:15:05.054602+0000","last_clean_scrub_stamp":"2023-10-10T21:15:05.054602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:37.602817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":279,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-10T21:15:07.090450+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:15:07.090450+0000","last_peered":"2023-10-10T21:15:07.090450+0000","last_clean":"2023-10-10T21:15:07.090450+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:15:07.090450+0000","last_undegraded":"2023-10-10T21:15:07.090450+0000","last_fullsized":"2023-10-10T21:15:07.090450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542303,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302708,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069132,"statfs":{"total":96636764160,"available":96326791168,"internally_reserved":0,"allocated":1355776,"data_stored":944683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.40400000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.1859999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.48399999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70599999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.92400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.45100000000000001,"15min":0.41399999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.123},"last":0.54100000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.71299999999999997},"min":{"1min":0.54600000000000004,"5min":0.48299999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.60099999999999998,"5min":0.497,"15min":0.46500000000000002},"max":{"1min":1.0249999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.49099999999999999},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.056},"last":0.61299999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60599999999999998,"15min":0.621},"min":{"1min":0.42999999999999999,"5min":0.374,"15min":0.33500000000000002},"max":{"1min":0.81799999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.502},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.40799999999999997},"max":{"1min":0.97399999999999998,"5min":0.98299999999999998,"15min":1.022},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.376},"max":{"1min":0.90600000000000003,"5min":0.91300000000000003,"15min":0.98899999999999999},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.629,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":0.98699999999999999,"15min":1.135},"last":0.89200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542302,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":765952,"data_stored":354869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.45000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.90000000000000002,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.71899999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.41099999999999998},"max":{"1min":0.84799999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.50700000000000001}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.51000000000000001,"5min":0.45500000000000002,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.0129999999999999,"15min":1.143},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":1.073,"15min":1.073},"last":0.67300000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":0.98199999999999998,"15min":1.151},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.498,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46300000000000002},"max":{"1min":0.94799999999999995,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.70999999999999996}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.627,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.746,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.627}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.345},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":1.048,"15min":1.238},"last":0.78700000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72799999999999998,"15min":0.745},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.202},"last":0.74199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542302,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":761856,"data_stored":354295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.251},"max":{"1min":0.61799999999999999,"5min":0.73199999999999998,"15min":1.258},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":0.81599999999999995,"15min":1.964},"last":0.60999999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.29599999999999999},"max":{"1min":0.66200000000000003,"5min":0.80300000000000005,"15min":1.4550000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":2.085},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.8919999999999999},"last":0.628},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":0.80400000000000005,"15min":2.117},"last":0.56299999999999994}]},{"osd":4,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.024,"5min":1.0509999999999999,"15min":2.052},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":0.83399999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.036,"5min":1.0409999999999999,"15min":1.181},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79900000000000004},"min":{"1min":0.625,"5min":0.502,"15min":0.46400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":2.012},"last":0.88700000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.63200000000000001,"5min":0.55600000000000005,"15min":0.51200000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":2.25},"last":0.873},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.53400000000000003},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":2.169},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.149,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.79900000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542304,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298612,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073228,"statfs":{"total":96636764160,"available":96330985472,"internally_reserved":0,"allocated":1355776,"data_stored":944627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.68000000000000005,"5min":0.752,"15min":1.4890000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.78200000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":1.706},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35499999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.1739999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.30399999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.6499999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":1.2909999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82399999999999995,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":1.101,"5min":1.1040000000000001,"15min":1.2270000000000001},"last":0.626},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":0.77100000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.96599999999999997,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.78200000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.371},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80800000000000005,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":0.94099999999999995,"5min":1.1439999999999999,"15min":1.3899999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.82999999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.874,"15min":0.83899999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.1339999999999999,"15min":1.306},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:14:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85599999999999998,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.503},"max":{"1min":1.1319999999999999,"5min":1.169,"15min":1.363},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85799999999999998,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.60099999999999998,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.165,"15min":1.3300000000000001},"last":0.749}]}]},{"osd":2,"up_from":14,"seq":60129542304,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306236,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":774144,"data_stored":355783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.28699999999999998},"max":{"1min":0.59299999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.63300000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":1.2070000000000001},"last":0.40799999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.88800000000000001},"last":0.438},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.85999999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77000000000000002,"15min":0.76500000000000001},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":1.286,"15min":1.3220000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.46600000000000003},"max":{"1min":0.97099999999999997,"5min":1.1659999999999999,"15min":1.2849999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93799999999999994,"5min":1.196,"15min":1.385},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51900000000000002},"max":{"1min":0.94999999999999996,"5min":1.268,"15min":1.268},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.61199999999999999,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":0.98099999999999998,"5min":1.3080000000000001,"15min":1.3400000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":1.022,"5min":1.107,"15min":1.3759999999999999},"last":0.747}]},{"osd":7,"last update":"Tue Oct 10 21:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81999999999999995,"15min":0.80800000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51200000000000001},"max":{"1min":1.0049999999999999,"5min":1.1659999999999999,"15min":1.2},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.625,"5min":0.57399999999999995,"15min":0.49199999999999999},"max":{"1min":0.95699999999999996,"5min":1.2330000000000001,"15min":1.3109999999999999},"last":0.80400000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509599,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":770048,"data_stored":354835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":0.58199999999999996,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":1.544},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":1.6759999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.66500000000000004,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.45200000000000001,"5min":0.42399999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.78900000000000003,"15min":1.7070000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.38700000000000001},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.434},"max":{"1min":1.0529999999999999,"5min":1.107,"15min":1.6359999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.80100000000000005,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1859999999999999,"5min":1.246,"15min":1.246},"last":0.80300000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78800000000000003,"15min":0.77200000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.262},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.48699999999999999},"max":{"1min":0.94299999999999995,"5min":1.1579999999999999,"15min":1.579},"last":0.75}]},{"osd":6,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80800000000000005,"15min":0.79100000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52900000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.67500000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:14:38 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":1.1040000000000001,"15min":1.6080000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82999999999999996,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51300000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.3200000000000001},"last":0.65000000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542304,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":770048,"data_stored":355761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.69599999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.30399999999999999},"max":{"1min":0.89800000000000002,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.752},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95399999999999996,"5min":0.96499999999999997,"15min":1.758},"last":0.85199999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.42099999999999999},"max":{"1min":0.93000000000000005,"5min":1.1359999999999999,"15min":1.47},"last":0.755},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.437},"max":{"1min":0.85199999999999998,"5min":0.95499999999999996,"15min":1.929},"last":0.79100000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.48999999999999999},"max":{"1min":0.96199999999999997,"5min":1.02,"15min":1.6890000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.3100000000000001,"15min":1.468},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.75800000000000001},"min":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.0820000000000001,"15min":1.397},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":0.97699999999999998,"5min":1.385,"15min":1.385},"last":0.89900000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63400000000000001,"15min":0.68400000000000005},"min":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.39900000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.38100000000000001},"max":{"1min":0.93000000000000005,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.51900000000000002,"5min":0.46100000000000002,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.0609999999999999,"15min":1.464},"last":0.83899999999999997}]},{"osd":7,"last update":"Tue Oct 10 21:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.97899999999999998,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.42199999999999999},"max":{"1min":0.91300000000000003,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.86099999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542302,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":761856,"data_stored":354295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.92000000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.504},{"interface":"front","average":{"1min":0.749,"5min":0.747,"15min":0.71299999999999997},"min":{"1min":0.57599999999999996,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.95899999999999996,"15min":1.371},"last":0.67100000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.42599999999999999,"15min":0.38500000000000001},"max":{"1min":0.93300000000000005,"5min":0.96599999999999997,"15min":3.895},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.83299999999999996},"min":{"1min":0.49199999999999999,"5min":0.41699999999999998,"15min":0.39000000000000001},"max":{"1min":0.90700000000000003,"5min":1.018,"15min":8.9909999999999997},"last":0.69499999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.71499999999999997},"min":{"1min":0.58899999999999997,"5min":0.44900000000000001,"15min":0.439},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2889999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.82699999999999996,"5min":0.93300000000000005,"15min":1.3540000000000001},"last":0.71199999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.437},"max":{"1min":0.871,"5min":0.99299999999999999,"15min":8.9309999999999992},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.502,"15min":0.45900000000000002},"max":{"1min":0.89000000000000001,"5min":1.044,"15min":2.9409999999999998},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.38500000000000001,"15min":0.38},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":9.0250000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83299999999999996,"5min":0.89200000000000002,"15min":4.2789999999999999},"last":0.75}]},{"osd":6,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.86599999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.85899999999999999},"min":{"1min":0.57499999999999996,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":0.95399999999999996,"5min":0.96899999999999997,"15min":8.8480000000000008},"last":0.73399999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.74299999999999999},"min":{"1min":0.503,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93500000000000005,"5min":0.95499999999999996,"15min":2.8900000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68799999999999994,"15min":0.754},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.98899999999999999,"15min":3.9420000000000002},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:15:16.735 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T21:15:16.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T21:15:16.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.958+0000 7f32e59ff700 1 Processor -- start 2023-10-10T21:15:16.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.958+0000 7f32e59ff700 1 -- start start 2023-10-10T21:15:16.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.959+0000 7f32e59ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e00c85c0 0x7f32e006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.959+0000 7f32e59ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32e0156ee0 0x7f32e0069890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.959+0000 7f32e59ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f32e0069dd0 0x7f32e0159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.959+0000 7f32e59ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e006a210 con 0x7f32e0156ee0 2023-10-10T21:15:16.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.959+0000 7f32e59ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e0156340 con 0x7f32e0069dd0 2023-10-10T21:15:16.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.959+0000 7f32e59ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00c8990 con 0x7f32e00c85c0 2023-10-10T21:15:16.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32de7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32e0156ee0 0x7f32e0069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32de7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32e0156ee0 0x7f32e0069890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42580/0 (socket says 172.21.15.154:42580) 2023-10-10T21:15:16.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32de7fc700 1 -- 172.21.15.154:0/4061990755 learned_addr learned my addr 172.21.15.154:0/4061990755 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:16.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32df7fe700 1 --2- 172.21.15.154:0/4061990755 >> v2:172.21.15.179:3300/0 conn(0x7f32e0069dd0 0x7f32e0159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32deffd700 1 --2- 172.21.15.154:0/4061990755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e00c85c0 0x7f32e006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32de7fc700 1 -- 172.21.15.154:0/4061990755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e00c85c0 msgr2=0x7f32e006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32de7fc700 1 --2- 172.21.15.154:0/4061990755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e00c85c0 0x7f32e006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32de7fc700 1 -- 172.21.15.154:0/4061990755 >> v2:172.21.15.179:3300/0 conn(0x7f32e0069dd0 msgr2=0x7f32e0159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32de7fc700 1 --2- 172.21.15.154:0/4061990755 >> v2:172.21.15.179:3300/0 conn(0x7f32e0069dd0 0x7f32e0159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32de7fc700 1 -- 172.21.15.154:0/4061990755 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e006ee20 con 0x7f32e0156ee0 2023-10-10T21:15:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32df7fe700 1 --2- 172.21.15.154:0/4061990755 >> v2:172.21.15.179:3300/0 conn(0x7f32e0069dd0 0x7f32e0159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.960+0000 7f32de7fc700 1 --2- 172.21.15.154:0/4061990755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e0156ee0 0x7f32e0069890 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f32e00bfae0 tx=0x7f32d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c46faabbf0323 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:16.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32ddffb700 1 -- 172.21.15.154:0/4061990755 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400b860 con 0x7f32e0156ee0 2023-10-10T21:15:16.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32ddffb700 1 -- 172.21.15.154:0/4061990755 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d400b9c0 con 0x7f32e0156ee0 2023-10-10T21:15:16.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32ddffb700 1 -- 172.21.15.154:0/4061990755 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400bd60 con 0x7f32e0156ee0 2023-10-10T21:15:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32e59ff700 1 -- 172.21.15.154:0/4061990755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e0156ee0 msgr2=0x7f32e0069890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32e59ff700 1 --2- 172.21.15.154:0/4061990755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e0156ee0 0x7f32e0069890 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f32e00bfae0 tx=0x7f32d4009250 comp rx=0 tx=0).stop 2023-10-10T21:15:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32e59ff700 1 -- 172.21.15.154:0/4061990755 shutdown_connections 2023-10-10T21:15:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32e59ff700 1 --2- 172.21.15.154:0/4061990755 >> v2:172.21.15.179:3300/0 conn(0x7f32e0069dd0 0x7f32e0159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32e59ff700 1 --2- 172.21.15.154:0/4061990755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e00c85c0 0x7f32e006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32e59ff700 1 --2- 172.21.15.154:0/4061990755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e0156ee0 0x7f32e0069890 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32e59ff700 1 -- 172.21.15.154:0/4061990755 >> 172.21.15.154:0/4061990755 conn(0x7f32e00cc540 msgr2=0x7f32e00cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32e59ff700 1 -- 172.21.15.154:0/4061990755 shutdown_connections 2023-10-10T21:15:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.961+0000 7f32e59ff700 1 -- 172.21.15.154:0/4061990755 wait complete. 2023-10-10T21:15:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.963+0000 7f32e59ff700 1 Processor -- start 2023-10-10T21:15:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.963+0000 7f32e59ff700 1 -- start start 2023-10-10T21:15:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32e59ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32e0069dd0 0x7f32e00c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32e59ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e00c85c0 0x7f32e01553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32e59ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e0156ee0 0x7f32e016a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32e59ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01572f0 con 0x7f32e00c85c0 2023-10-10T21:15:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32e59ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0157b20 con 0x7f32e0069dd0 2023-10-10T21:15:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32e59ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0155920 con 0x7f32e0156ee0 2023-10-10T21:15:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32de7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e00c85c0 0x7f32e01553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32de7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e00c85c0 0x7f32e01553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42586/0 (socket says 172.21.15.154:42586) 2023-10-10T21:15:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32de7fc700 1 -- 172.21.15.154:0/723314992 learned_addr learned my addr 172.21.15.154:0/723314992 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:16.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32df7fe700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e0156ee0 0x7f32e016a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32deffd700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32e0069dd0 0x7f32e00c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32de7fc700 1 -- 172.21.15.154:0/723314992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e0156ee0 msgr2=0x7f32e016a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:16.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32de7fc700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e0156ee0 0x7f32e016a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32de7fc700 1 -- 172.21.15.154:0/723314992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32e0069dd0 msgr2=0x7f32e00c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:16.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32de7fc700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32e0069dd0 0x7f32e00c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:16.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32de7fc700 1 -- 172.21.15.154:0/723314992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40094f0 con 0x7f32e00c85c0 2023-10-10T21:15:16.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.964+0000 7f32deffd700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32e0069dd0 0x7f32e00c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:16.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.965+0000 7f32de7fc700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e00c85c0 0x7f32e01553e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f32d40090b0 tx=0x7f32d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:16.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.965+0000 7f32c6ffd700 1 -- 172.21.15.154:0/723314992 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4024440 con 0x7f32e00c85c0 2023-10-10T21:15:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.965+0000 7f32c6ffd700 1 -- 172.21.15.154:0/723314992 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d40245e0 con 0x7f32e00c85c0 2023-10-10T21:15:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.965+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e00a5a70 con 0x7f32e00c85c0 2023-10-10T21:15:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.965+0000 7f32c6ffd700 1 -- 172.21.15.154:0/723314992 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40249a0 con 0x7f32e00c85c0 2023-10-10T21:15:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.965+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e01577b0 con 0x7f32e00c85c0 2023-10-10T21:15:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.966+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e0157cb0 con 0x7f32e00c85c0 2023-10-10T21:15:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.967+0000 7f32c6ffd700 1 -- 172.21.15.154:0/723314992 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32d401a420 con 0x7f32e00c85c0 2023-10-10T21:15:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.968+0000 7f32c6ffd700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32cc066f30 0x7f32cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.968+0000 7f32c6ffd700 1 -- 172.21.15.154:0/723314992 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f32d4086430 con 0x7f32e00c85c0 2023-10-10T21:15:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.968+0000 7f32deffd700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32cc066f30 0x7f32cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.968+0000 7f32deffd700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32cc066f30 0x7f32cc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f32d0006fd0 tx=0x7f32d0008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:16.972+0000 7f32c6ffd700 1 -- 172.21.15.154:0/723314992 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32d4053590 con 0x7f32e00c85c0 2023-10-10T21:15:17.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.238+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f32e00718b0 con 0x7f32e00c85c0 2023-10-10T21:15:17.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.242+0000 7f32c6ffd700 1 -- 172.21.15.154:0/723314992 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f32d4056bb0 con 0x7f32e00c85c0 2023-10-10T21:15:17.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32cc066f30 msgr2=0x7f32cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:17.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32cc066f30 0x7f32cc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f32d0006fd0 tx=0x7f32d0008040 comp rx=0 tx=0).stop 2023-10-10T21:15:17.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e00c85c0 msgr2=0x7f32e01553e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:17.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e00c85c0 0x7f32e01553e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f32d40090b0 tx=0x7f32d4017000 comp rx=0 tx=0).stop 2023-10-10T21:15:17.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 shutdown_connections 2023-10-10T21:15:17.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32e0156ee0 0x7f32e016a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32cc066f30 0x7f32cc0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32e0069dd0 0x7f32e00c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 --2- 172.21.15.154:0/723314992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32e00c85c0 0x7f32e01553e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 >> 172.21.15.154:0/723314992 conn(0x7f32e00cc540 msgr2=0x7f32e00ac6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 shutdown_connections 2023-10-10T21:15:17.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.245+0000 7f32e59ff700 1 -- 172.21.15.154:0/723314992 wait complete. 2023-10-10T21:15:17.249 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T21:15:17.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:15:17.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.446+0000 7f1f4239d700 1 Processor -- start 2023-10-10T21:15:17.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.446+0000 7f1f4239d700 1 -- start start 2023-10-10T21:15:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.447+0000 7f1f4239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c150180 0x7f1f3c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.447+0000 7f1f4239d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c06e2a0 con 0x7f1f3c0c7410 2023-10-10T21:15:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.447+0000 7f1f4239d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c06b2e0 con 0x7f1f3c150550 2023-10-10T21:15:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.447+0000 7f1f4239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c78e0 con 0x7f1f3c150180 2023-10-10T21:15:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f41b9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1f3c0c7410 0x7f1f3c069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45422/0 (socket says 172.21.15.154:45422) 2023-10-10T21:15:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f41b9c700 1 -- 172.21.15.154:0/334989426 learned_addr learned my addr 172.21.15.154:0/334989426 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f4139b700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c150180 0x7f1f3c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482997983 0 0) 0x7f1f3c06e2a0 con 0x7f1f3c0c7410 2023-10-10T21:15:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f28003570 con 0x7f1f3c0c7410 2023-10-10T21:15:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403892753 0 0) 0x7f1f28003570 con 0x7f1f3c0c7410 2023-10-10T21:15:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c150180 msgr2=0x7f1f3c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f33fff700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c150180 0x7f1f3c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 >> v1:172.21.15.179:6789/0 conn(0x7f1f3c150550 legacy=0x7f1f3c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0c7bc0 con 0x7f1f3c0c7410 2023-10-10T21:15:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.448+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f1f340017f0 con 0x7f1f3c0c7410 2023-10-10T21:15:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 >> v1:172.21.15.154:6789/0 conn(0x7f1f3c0c7410 legacy=0x7f1f3c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f33fff700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c150180 0x7f1f28003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:17.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f33fff700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f28004010 0x7f1f28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:17.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f33fff700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28004d50 0x7f1f280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:17.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c78e0 con 0x7f1f28004d50 2023-10-10T21:15:17.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2800de00 con 0x7f1f28004010 2023-10-10T21:15:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2800dfc0 con 0x7f1f3c150180 2023-10-10T21:15:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f41b9c700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28004d50 0x7f1f280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f4139b700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c150180 0x7f1f28003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f40b9a700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f28004010 0x7f1f28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f41b9c700 1 -- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c150180 msgr2=0x7f1f28003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f41b9c700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c150180 0x7f1f28003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f41b9c700 1 -- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f28004010 msgr2=0x7f1f28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f41b9c700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f28004010 0x7f1f28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f41b9c700 1 -- 172.21.15.154:0/334989426 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f28003570 con 0x7f1f28004d50 2023-10-10T21:15:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.449+0000 7f1f41b9c700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28004d50 0x7f1f280051c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1f34002230 tx=0x7f1f3c06d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff54287bdf342ef server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340070d0 con 0x7f1f28004d50 2023-10-10T21:15:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34007230 con 0x7f1f28004d50 2023-10-10T21:15:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f33fff700 1 -- 172.21.15.154:0/334989426 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340075d0 con 0x7f1f28004d50 2023-10-10T21:15:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f4239d700 1 -- 172.21.15.154:0/334989426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28004d50 msgr2=0x7f1f280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f4239d700 1 --2- 172.21.15.154:0/334989426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28004d50 0x7f1f280051c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1f34002230 tx=0x7f1f3c06d620 comp rx=0 tx=0).stop 2023-10-10T21:15:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f41b9c700 1 -- 172.21.15.154:0/334989426 reap_dead start 2023-10-10T21:15:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f4239d700 1 -- 172.21.15.154:0/334989426 shutdown_connections 2023-10-10T21:15:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f4239d700 1 -- 172.21.15.154:0/334989426 >> 172.21.15.154:0/334989426 conn(0x7f1f3c0cc1f0 msgr2=0x7f1f3c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f4239d700 1 -- 172.21.15.154:0/334989426 shutdown_connections 2023-10-10T21:15:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.450+0000 7f1f4239d700 1 -- 172.21.15.154:0/334989426 wait complete. 2023-10-10T21:15:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.452+0000 7f1f4239d700 1 Processor -- start 2023-10-10T21:15:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.452+0000 7f1f4239d700 1 -- start start 2023-10-10T21:15:17.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f4239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f28004d50 0x7f1f3c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:17.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f4239d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c0ac4f0 0x7f1f3c0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:17.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f4239d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c1586e0 0x7f1f3c142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:17.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f4239d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0ad570 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f4239d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0adf40 con 0x7f1f3c1586e0 2023-10-10T21:15:17.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f4239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0ac960 con 0x7f1f28004d50 2023-10-10T21:15:17.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f40b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c0ac4f0 0x7f1f3c0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:17.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f40b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c0ac4f0 0x7f1f3c0ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42612/0 (socket says 172.21.15.154:42612) 2023-10-10T21:15:17.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f40b9a700 1 -- 172.21.15.154:0/1355120834 learned_addr learned my addr 172.21.15.154:0/1355120834 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:17.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f41b9c700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c1586e0 0x7f1f3c142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:17.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f4139b700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f28004d50 0x7f1f3c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:17.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f40b9a700 1 -- 172.21.15.154:0/1355120834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f28004d50 msgr2=0x7f1f3c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:17.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f40b9a700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f28004d50 0x7f1f3c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f40b9a700 1 -- 172.21.15.154:0/1355120834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c1586e0 msgr2=0x7f1f3c142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:17.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f40b9a700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c1586e0 0x7f1f3c142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f40b9a700 1 -- 172.21.15.154:0/1355120834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0acc40 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.453+0000 7f1f41b9c700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c1586e0 0x7f1f3c142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:17.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.454+0000 7f1f40b9a700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c0ac4f0 0x7f1f3c0ada00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e7b0 tx=0x7f1f2c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:17.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.454+0000 7f1f317fa700 1 -- 172.21.15.154:0/1355120834 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c012500 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.454+0000 7f1f317fa700 1 -- 172.21.15.154:0/1355120834 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c010040 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.454+0000 7f1f317fa700 1 -- 172.21.15.154:0/1355120834 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c012890 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.454+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c0acf20 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.454+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c1430a0 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.455+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c0ad6e0 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.456+0000 7f1f317fa700 1 -- 172.21.15.154:0/1355120834 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f2c012c00 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.457+0000 7f1f317fa700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f20066f30 0x7f1f200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:17.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.457+0000 7f1f317fa700 1 -- 172.21.15.154:0/1355120834 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1f2c084280 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.457+0000 7f1f4139b700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f20066f30 0x7f1f200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:17.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.457+0000 7f1f4139b700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f20066f30 0x7f1f200693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009d10 tx=0x7f1f38008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:17.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.461+0000 7f1f317fa700 1 -- 172.21.15.154:0/1355120834 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f2c051380 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.694+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f3c04c3c0 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.695+0000 7f1f317fa700 1 -- 172.21.15.154:0/1355120834 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f1f2c0549a0 con 0x7f1f3c0ac4f0 2023-10-10T21:15:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:17.697 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1501601746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1501601746},{"type":"v1","addr":"172.21.15.179:6833","nonce":1501601746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4046528016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4046528016},{"type":"v1","addr":"172.21.15.179:6835","nonce":4046528016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5533,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/634585840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":634585840},{"type":"v1","addr":"172.21.15.154:6837","nonce":634585840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:15:06.545399+0000","modified":"2023-10-10T21:15:10.108541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6833/1321064128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1321064128},{"type":"v1","addr":"172.21.15.154:6833","nonce":1321064128}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-10T21:15:17.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.697+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f20066f30 msgr2=0x7f1f200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:17.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f20066f30 0x7f1f200693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009d10 tx=0x7f1f38008040 comp rx=0 tx=0).stop 2023-10-10T21:15:17.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c0ac4f0 msgr2=0x7f1f3c0ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:17.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c0ac4f0 0x7f1f3c0ada00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e7b0 tx=0x7f1f2c009040 comp rx=0 tx=0).stop 2023-10-10T21:15:17.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 shutdown_connections 2023-10-10T21:15:17.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f20066f30 0x7f1f200693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c1586e0 0x7f1f3c142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f28004d50 0x7f1f3c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 --2- 172.21.15.154:0/1355120834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c0ac4f0 0x7f1f3c0ada00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 >> 172.21.15.154:0/1355120834 conn(0x7f1f3c0cc1f0 msgr2=0x7f1f3c14b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 shutdown_connections 2023-10-10T21:15:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:17.698+0000 7f1f4239d700 1 -- 172.21.15.154:0/1355120834 wait complete. 2023-10-10T21:15:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 22 2023-10-10T21:15:18.118 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T21:15:06.545399+0000', 'modified': '2023-10-10T21:15:10.108541+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5751}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5751': {'gid': 5751, 'name': 'a', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6833/1321064128', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 1321064128}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 1321064128}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T21:15:18.119 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T21:15:18.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-10T21:15:18.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.305+0000 7f510adff700 1 Processor -- start 2023-10-10T21:15:18.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.305+0000 7f510adff700 1 -- start start 2023-10-10T21:15:18.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.306+0000 7f510adff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51040b0a10 0x7f5104155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.307+0000 7f510adff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51040ad930 con 0x7f51041578b0 2023-10-10T21:15:18.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.307+0000 7f510adff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51040acd20 con 0x7f5104155c10 2023-10-10T21:15:18.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.307+0000 7f510adff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51040ad000 con 0x7f51040b0a10 2023-10-10T21:15:18.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.307+0000 7f5103fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f51041578b0 0x7f51040af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45428/0 (socket says 172.21.15.154:45428) 2023-10-10T21:15:18.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.307+0000 7f5103fff700 1 -- 172.21.15.154:0/715741782 learned_addr learned my addr 172.21.15.154:0/715741782 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:18.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.307+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62928426 0 0) 0x7f51040ad930 con 0x7f51041578b0 2023-10-10T21:15:18.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.307+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f4004680 con 0x7f51041578b0 2023-10-10T21:15:18.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.307+0000 7f510939c700 1 --2- 172.21.15.154:0/715741782 >> v2:172.21.15.179:3300/0 conn(0x7f51040b0a10 0x7f5104155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 938550175 0 0) 0x7f50f4004680 con 0x7f51041578b0 2023-10-10T21:15:18.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 >> v2:172.21.15.179:3300/0 conn(0x7f51040b0a10 msgr2=0x7f5104155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 --2- 172.21.15.154:0/715741782 >> v2:172.21.15.179:3300/0 conn(0x7f51040b0a10 0x7f5104155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 >> v1:172.21.15.179:6789/0 conn(0x7f5104155c10 legacy=0x7f51040ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51040ad2e0 con 0x7f51041578b0 2023-10-10T21:15:18.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f50f0001470 con 0x7f51041578b0 2023-10-10T21:15:18.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 >> v1:172.21.15.154:6789/0 conn(0x7f51041578b0 legacy=0x7f51040af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f4004b70 0x7f50f4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50f4005920 0x7f50f4005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40062d0 0x7f50f400cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51040ad000 con 0x7f50f4005920 2023-10-10T21:15:18.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f400d1c0 con 0x7f50f4004b70 2023-10-10T21:15:18.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f400d380 con 0x7f50f40062d0 2023-10-10T21:15:18.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f5103fff700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50f4005920 0x7f50f4005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f5108b9b700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f4004b70 0x7f50f4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f510939c700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40062d0 0x7f50f400cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f5103fff700 1 -- 172.21.15.154:0/715741782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40062d0 msgr2=0x7f50f400cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.308+0000 7f5103fff700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40062d0 0x7f50f400cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f5103fff700 1 -- 172.21.15.154:0/715741782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f4004b70 msgr2=0x7f50f4004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f5103fff700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f4004b70 0x7f50f4004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f5103fff700 1 -- 172.21.15.154:0/715741782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4004680 con 0x7f50f4005920 2023-10-10T21:15:18.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f510939c700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40062d0 0x7f50f400cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:18.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f510939c700 1 -- 172.21.15.154:0/715741782 reap_dead start 2023-10-10T21:15:18.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f5103fff700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50f4005920 0x7f50f4005d90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f50f000c2d0 tx=0x7f50f0001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb9be026fef95af server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f000cba0 con 0x7f50f4005920 2023-10-10T21:15:18.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f000cd40 con 0x7f50f4005920 2023-10-10T21:15:18.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f51037fe700 1 -- 172.21.15.154:0/715741782 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0005b70 con 0x7f50f4005920 2023-10-10T21:15:18.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f510adff700 1 -- 172.21.15.154:0/715741782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50f4005920 msgr2=0x7f50f4005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.309+0000 7f510adff700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50f4005920 0x7f50f4005d90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f50f000c2d0 tx=0x7f50f0001da0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.310+0000 7f510adff700 1 -- 172.21.15.154:0/715741782 shutdown_connections 2023-10-10T21:15:18.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.310+0000 7f510adff700 1 --2- 172.21.15.154:0/715741782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50f4005920 0x7f50f4005d90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.310+0000 7f510adff700 1 -- 172.21.15.154:0/715741782 >> 172.21.15.154:0/715741782 conn(0x7f510406a320 msgr2=0x7f51040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:18.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.310+0000 7f510adff700 1 -- 172.21.15.154:0/715741782 shutdown_connections 2023-10-10T21:15:18.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.310+0000 7f510adff700 1 -- 172.21.15.154:0/715741782 wait complete. 2023-10-10T21:15:18.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.311+0000 7f510adff700 1 Processor -- start 2023-10-10T21:15:18.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.311+0000 7f510adff700 1 -- start start 2023-10-10T21:15:18.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.312+0000 7f510adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f4005920 0x7f510416a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.312+0000 7f510adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51040cb9f0 0x7f51041532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.312+0000 7f510adff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51040c9a40 0x7f51040c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.312+0000 7f510adff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510416ac30 con 0x7f51040c9a40 2023-10-10T21:15:18.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.312+0000 7f510adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51040ca3e0 con 0x7f51040cb9f0 2023-10-10T21:15:18.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.312+0000 7f510adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51040c92c0 con 0x7f50f4005920 2023-10-10T21:15:18.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.312+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51040c9a40 0x7f51040c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.312+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51040c9a40 0x7f51040c9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42632/0 (socket says 172.21.15.154:42632) 2023-10-10T21:15:18.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.312+0000 7f510939c700 1 -- 172.21.15.154:0/2139128519 learned_addr learned my addr 172.21.15.154:0/2139128519 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:18.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f5108b9b700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f4005920 0x7f510416a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f5103fff700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51040cb9f0 0x7f51041532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f510939c700 1 -- 172.21.15.154:0/2139128519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f4005920 msgr2=0x7f510416a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f510939c700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f4005920 0x7f510416a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f510939c700 1 -- 172.21.15.154:0/2139128519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51040cb9f0 msgr2=0x7f51041532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f510939c700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51040cb9f0 0x7f51041532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f510939c700 1 -- 172.21.15.154:0/2139128519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51040cbf80 con 0x7f51040c9a40 2023-10-10T21:15:18.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f510939c700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51040c9a40 0x7f51040c9ea0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f51040ad8a0 tx=0x7f50fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f5100ff9700 1 -- 172.21.15.154:0/2139128519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc01b070 con 0x7f51040c9a40 2023-10-10T21:15:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f5100ff9700 1 -- 172.21.15.154:0/2139128519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc00f040 con 0x7f51040c9a40 2023-10-10T21:15:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f510adff700 1 -- 172.21.15.154:0/2139128519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51040cc260 con 0x7f51040c9a40 2023-10-10T21:15:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f5100ff9700 1 -- 172.21.15.154:0/2139128519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00e050 con 0x7f51040c9a40 2023-10-10T21:15:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.313+0000 7f510adff700 1 -- 172.21.15.154:0/2139128519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51040cc820 con 0x7f51040c9a40 2023-10-10T21:15:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.315+0000 7f5100ff9700 1 -- 172.21.15.154:0/2139128519 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50fc003020 con 0x7f51040c9a40 2023-10-10T21:15:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.317+0000 7f5100ff9700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f50e8066f30 0x7f50e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.317+0000 7f5100ff9700 1 -- 172.21.15.154:0/2139128519 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f50fc084d00 con 0x7f51040c9a40 2023-10-10T21:15:18.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.317+0000 7f5108b9b700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f50e8066f30 0x7f50e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.317+0000 7f5108b9b700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f50e8066f30 0x7f50e80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50f8007a60 tx=0x7f50f8009040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.319+0000 7f51195c0b80 1 Processor -- start 2023-10-10T21:15:18.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.319+0000 7f51195c0b80 1 -- start start 2023-10-10T21:15:18.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.319+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de74617e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.319+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74661d00 0x55de74640a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.319+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74640f60 0x55de74613cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.319+0000 7f51195c0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de7456ea70 con 0x55de74640f60 2023-10-10T21:15:18.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.319+0000 7f51195c0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de7456c270 con 0x55de74617a50 2023-10-10T21:15:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.319+0000 7f51195c0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de74568060 con 0x55de74661d00 2023-10-10T21:15:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74640f60 0x55de74613cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74640f60 0x55de74613cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42638/0 (socket says 172.21.15.154:42638) 2023-10-10T21:15:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f510939c700 1 -- 172.21.15.154:0/871954156 learned_addr learned my addr 172.21.15.154:0/871954156 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f5108b9b700 1 --2- 172.21.15.154:0/871954156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de74617e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f5103fff700 1 --2- 172.21.15.154:0/871954156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74661d00 0x55de74640a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f510939c700 1 -- 172.21.15.154:0/871954156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74661d00 msgr2=0x55de74640a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f510939c700 1 --2- 172.21.15.154:0/871954156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74661d00 0x55de74640a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f510939c700 1 -- 172.21.15.154:0/871954156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 msgr2=0x55de74617e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f510939c700 1 --2- 172.21.15.154:0/871954156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de74617e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f510939c700 1 -- 172.21.15.154:0/871954156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de74402270 con 0x55de74640f60 2023-10-10T21:15:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.320+0000 7f510939c700 1 --2- 172.21.15.154:0/871954156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74640f60 0x55de74613cf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f50fc002230 tx=0x7f50fc082f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f40d2b9b4958d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f50edffb700 1 -- 172.21.15.154:0/871954156 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc058c70 con 0x55de74640f60 2023-10-10T21:15:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f50edffb700 1 -- 172.21.15.154:0/871954156 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc05c9c0 con 0x55de74640f60 2023-10-10T21:15:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f50edffb700 1 -- 172.21.15.154:0/871954156 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc053dc0 con 0x55de74640f60 2023-10-10T21:15:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f51195c0b80 1 -- 172.21.15.154:0/871954156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74640f60 msgr2=0x55de74613cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f51195c0b80 1 --2- 172.21.15.154:0/871954156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74640f60 0x55de74613cf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f50fc002230 tx=0x7f50fc082f70 comp rx=0 tx=0).stop 2023-10-10T21:15:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f51195c0b80 1 -- 172.21.15.154:0/871954156 shutdown_connections 2023-10-10T21:15:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f51195c0b80 1 --2- 172.21.15.154:0/871954156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74640f60 0x55de74613cf0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f51195c0b80 1 --2- 172.21.15.154:0/871954156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de74617e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f51195c0b80 1 --2- 172.21.15.154:0/871954156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74661d00 0x55de74640a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f51195c0b80 1 -- 172.21.15.154:0/871954156 >> 172.21.15.154:0/871954156 conn(0x55de74619370 msgr2=0x55de74619740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f51195c0b80 1 -- 172.21.15.154:0/871954156 shutdown_connections 2023-10-10T21:15:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.321+0000 7f51195c0b80 1 -- 172.21.15.154:0/871954156 wait complete. 2023-10-10T21:15:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.322+0000 7f51195c0b80 1 -- start start 2023-10-10T21:15:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.322+0000 7f51195c0b80 1 Processor -- start 2023-10-10T21:15:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.323+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74617a50 0x55de7465eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.323+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74640f60 0x55de746604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.323+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74614650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.323+0000 7f51195c0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de74513890 con 0x55de74661d00 2023-10-10T21:15:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.323+0000 7f51195c0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de7452eea0 con 0x55de74640f60 2023-10-10T21:15:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.323+0000 7f51195c0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de743eae30 con 0x55de74617a50 2023-10-10T21:15:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.323+0000 7f51195c0b80 10 client.0 _ll_register_callbacks cb 0x55de745db110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:15:18.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74614650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74614650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42642/0 (socket says 172.21.15.154:42642) 2023-10-10T21:15:18.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f510939c700 1 -- 172.21.15.154:0/2540967867 learned_addr learned my addr 172.21.15.154:0/2540967867 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:18.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f5103fff700 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74640f60 0x55de746604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f5108b9b700 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74617a50 0x55de7465eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f510939c700 1 -- 172.21.15.154:0/2540967867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74617a50 msgr2=0x55de7465eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f510939c700 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74617a50 0x55de7465eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f510939c700 1 -- 172.21.15.154:0/2540967867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74640f60 msgr2=0x55de746604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f510939c700 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74640f60 0x55de746604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f510939c700 1 -- 172.21.15.154:0/2540967867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51040cc820 con 0x55de74661d00 2023-10-10T21:15:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f5108b9b700 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74617a50 0x55de7465eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f510939c700 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74614650 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f50fc002230 tx=0x7f50fc069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1023d91902aa770 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f50e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:15:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.324+0000 7f50e2ffd700 1 -- 172.21.15.154:0/2540967867 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc053dc0 con 0x55de74661d00 2023-10-10T21:15:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f50e2ffd700 1 -- 172.21.15.154:0/2540967867 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f50fc051810 con 0x55de74661d00 2023-10-10T21:15:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f51195c0b80 1 -- 172.21.15.154:0/2540967867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de7460cb70 con 0x55de74661d00 2023-10-10T21:15:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f50e2ffd700 1 -- 172.21.15.154:0/2540967867 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50fc054980 con 0x55de74661d00 2023-10-10T21:15:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f51195c0b80 10 client.5913 fetch_fsmap learned FSMap version 22 2023-10-10T21:15:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f51195c0b80 1 -- 172.21.15.154:0/2540967867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55de743a4fe0 con 0x55de74661d00 2023-10-10T21:15:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f50e2ffd700 1 -- 172.21.15.154:0/2540967867 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55de7460cb70 con 0x55de74661d00 2023-10-10T21:15:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f50e2ffd700 1 -- 172.21.15.154:0/2540967867 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 22) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f50fc054ae0 con 0x55de74661d00 2023-10-10T21:15:18.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f51195c0b80 10 client.5913 fetch_fsmap finished waiting for FSMap version 22 2023-10-10T21:15:18.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f51195c0b80 10 client.5913 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-10T21:15:18.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f51195c0b80 20 client.5913 populate_metadata read hostname 'smithi154' 2023-10-10T21:15:18.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f51195c0b80 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] conn(0x55de74658030 0x55de74658400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f51195c0b80 4 client.5913 mds_command: new command op to 5751 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T21:15:18.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f51195c0b80 1 -- 172.21.15.154:0/2540967867 --> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de745e9aa0 con 0x55de74658030 2023-10-10T21:15:18.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.325+0000 7f5108b9b700 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] conn(0x55de74658030 0x55de74658400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.326+0000 7f50e2ffd700 10 client.5913 ms_handle_connect on v2:172.21.15.154:6832/1321064128 2023-10-10T21:15:18.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.326+0000 7f5108b9b700 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] conn(0x55de74658030 0x55de74658400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=779d5966183ccc6c server_cookie=9ad53b81df1923f1 in_seq=0 out_seq=0 2023-10-10T21:15:18.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f50e2ffd700 1 -- 172.21.15.154:0/2540967867 <== mds.0 v2:172.21.15.154:6832/1321064128 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55de745e9aa0 con 0x55de74658030 2023-10-10T21:15:18.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f50e2ffd700 10 client.5913 handle_command_reply: tid=0 2023-10-10T21:15:18.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 client.5913 shutdown 2023-10-10T21:15:18.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 -- 172.21.15.154:0/2540967867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 msgr2=0x55de74614650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74614650 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f50fc002230 tx=0x7f50fc069000 comp rx=0 tx=0).stop 2023-10-10T21:15:18.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 -- 172.21.15.154:0/2540967867 shutdown_connections 2023-10-10T21:15:18.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] conn(0x55de74658030 0x55de74658400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74614650 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74617a50 0x55de7465eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f50e2ffd700 0 client.5913 ms_handle_reset on v2:172.21.15.154:6832/1321064128 2023-10-10T21:15:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 --2- 172.21.15.154:0/2540967867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74640f60 0x55de746604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 -- 172.21.15.154:0/2540967867 >> 172.21.15.154:0/2540967867 conn(0x55de74619370 msgr2=0x55de7465d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 -- 172.21.15.154:0/2540967867 shutdown_connections 2023-10-10T21:15:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 1 -- 172.21.15.154:0/2540967867 wait complete. 2023-10-10T21:15:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.327+0000 7f51195c0b80 20 client.5913 trim_cache size 0 max 16384 2023-10-10T21:15:18.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.344+0000 7f51195c0b80 1 Processor -- start 2023-10-10T21:15:18.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.345+0000 7f51195c0b80 1 -- start start 2023-10-10T21:15:18.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.345+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de74612c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.345+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 0x55de74613160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.345+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74654560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.345+0000 7f51195c0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de7461af80 con 0x55de74661d00 2023-10-10T21:15:18.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.345+0000 7f51195c0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de74640da0 con 0x55de74617a50 2023-10-10T21:15:18.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.345+0000 7f51195c0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de745f04b0 con 0x55de74640f60 2023-10-10T21:15:18.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74654560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74654560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42646/0 (socket says 172.21.15.154:42646) 2023-10-10T21:15:18.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f510939c700 1 -- 172.21.15.154:0/1165061600 learned_addr learned my addr 172.21.15.154:0/1165061600 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:18.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f5108b9b700 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de74612c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f5103fff700 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 0x55de74613160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f510939c700 1 -- 172.21.15.154:0/1165061600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 msgr2=0x55de74613160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f510939c700 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 0x55de74613160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f510939c700 1 -- 172.21.15.154:0/1165061600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 msgr2=0x55de74612c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f510939c700 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de74612c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f510939c700 1 -- 172.21.15.154:0/1165061600 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de74536780 con 0x55de74661d00 2023-10-10T21:15:18.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f5108b9b700 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de74612c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:18.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f510939c700 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74654560 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f50fc056080 tx=0x7f50fc070070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77cf5601bb26add server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f50ee7fc700 1 -- 172.21.15.154:0/1165061600 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc051810 con 0x55de74661d00 2023-10-10T21:15:18.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f50ee7fc700 1 -- 172.21.15.154:0/1165061600 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc053dc0 con 0x55de74661d00 2023-10-10T21:15:18.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.346+0000 7f50ee7fc700 1 -- 172.21.15.154:0/1165061600 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc054980 con 0x55de74661d00 2023-10-10T21:15:18.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.347+0000 7f51195c0b80 1 -- 172.21.15.154:0/1165061600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 msgr2=0x55de74654560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.347+0000 7f51195c0b80 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74654560 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f50fc056080 tx=0x7f50fc070070 comp rx=0 tx=0).stop 2023-10-10T21:15:18.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.347+0000 7f51195c0b80 1 -- 172.21.15.154:0/1165061600 shutdown_connections 2023-10-10T21:15:18.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.347+0000 7f51195c0b80 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74654560 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.347+0000 7f51195c0b80 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de74612c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.347+0000 7f51195c0b80 1 --2- 172.21.15.154:0/1165061600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 0x55de74613160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.347+0000 7f51195c0b80 1 -- 172.21.15.154:0/1165061600 >> 172.21.15.154:0/1165061600 conn(0x55de74619370 msgr2=0x55de746138d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:18.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.347+0000 7f51195c0b80 1 -- 172.21.15.154:0/1165061600 shutdown_connections 2023-10-10T21:15:18.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.347+0000 7f51195c0b80 1 -- 172.21.15.154:0/1165061600 wait complete. 2023-10-10T21:15:18.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.348+0000 7f51195c0b80 1 -- start start 2023-10-10T21:15:18.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.348+0000 7f51195c0b80 1 Processor -- start 2023-10-10T21:15:18.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de746c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 0x55de74612c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f51195c0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74613160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f51195c0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de7465b610 con 0x55de74661d00 2023-10-10T21:15:18.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f51195c0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de746c39d0 con 0x55de74617a50 2023-10-10T21:15:18.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f51195c0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de746c4880 con 0x55de74640f60 2023-10-10T21:15:18.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f51195c0b80 10 client.0 _ll_register_callbacks cb 0x55de745db110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:15:18.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74613160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f510939c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74613160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42650/0 (socket says 172.21.15.154:42650) 2023-10-10T21:15:18.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f510939c700 1 -- 172.21.15.154:0/3973700117 learned_addr learned my addr 172.21.15.154:0/3973700117 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:18.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f5108b9b700 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de746c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.349+0000 7f5103fff700 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 0x55de74612c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f510939c700 1 -- 172.21.15.154:0/3973700117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 msgr2=0x55de74612c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f510939c700 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 0x55de74612c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f510939c700 1 -- 172.21.15.154:0/3973700117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 msgr2=0x55de746c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f510939c700 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de746c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f510939c700 1 -- 172.21.15.154:0/3973700117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de743a4fe0 con 0x55de74661d00 2023-10-10T21:15:18.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f510939c700 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74613160 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f50fc051f20 tx=0x7f50fc07f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa3bd66bd423ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f50e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:15:18.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f50e2ffd700 1 -- 172.21.15.154:0/3973700117 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc054980 con 0x55de74661d00 2023-10-10T21:15:18.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f50e2ffd700 1 -- 172.21.15.154:0/3973700117 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f50fc051810 con 0x55de74661d00 2023-10-10T21:15:18.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f51195c0b80 1 -- 172.21.15.154:0/3973700117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5104159fd0 con 0x55de74661d00 2023-10-10T21:15:18.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f50e2ffd700 1 -- 172.21.15.154:0/3973700117 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50fc058c70 con 0x55de74661d00 2023-10-10T21:15:18.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f51195c0b80 10 client.5919 fetch_fsmap learned FSMap version 22 2023-10-10T21:15:18.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f51195c0b80 1 -- 172.21.15.154:0/3973700117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55de7451d470 con 0x55de74661d00 2023-10-10T21:15:18.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f50e2ffd700 1 -- 172.21.15.154:0/3973700117 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5104159fd0 con 0x55de74661d00 2023-10-10T21:15:18.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f50e2ffd700 1 -- 172.21.15.154:0/3973700117 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 22) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f50fc067070 con 0x55de74661d00 2023-10-10T21:15:18.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f51195c0b80 10 client.5919 fetch_fsmap finished waiting for FSMap version 22 2023-10-10T21:15:18.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f51195c0b80 10 client.5919 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-10T21:15:18.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f51195c0b80 20 client.5919 populate_metadata read hostname 'smithi154' 2023-10-10T21:15:18.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.350+0000 7f51195c0b80 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] conn(0x55de746c6e30 0x55de746c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.351+0000 7f51195c0b80 4 client.5919 mds_command: new command op to 5751 tid=0[{"prefix": "status"}] 2023-10-10T21:15:18.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.351+0000 7f51195c0b80 1 -- 172.21.15.154:0/3973700117 --> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f50fc05c9c0 con 0x55de746c6e30 2023-10-10T21:15:18.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.351+0000 7f5108b9b700 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] conn(0x55de746c6e30 0x55de746c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.351+0000 7f5108b9b700 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] conn(0x55de746c6e30 0x55de746c7200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5088271cf3607e96 server_cookie=1429c0bdb1b34742 in_seq=0 out_seq=0 2023-10-10T21:15:18.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.351+0000 7f50e2ffd700 10 client.5919 ms_handle_connect on v2:172.21.15.154:6832/1321064128 2023-10-10T21:15:18.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.351+0000 7f50e2ffd700 1 -- 172.21.15.154:0/3973700117 <== mds.0 v2:172.21.15.154:6832/1321064128 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f50fc05c9c0 con 0x55de746c6e30 2023-10-10T21:15:18.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.351+0000 7f50e2ffd700 10 client.5919 handle_command_reply: tid=0 2023-10-10T21:15:18.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.351+0000 7f51195c0b80 1 client.5919 shutdown 2023-10-10T21:15:18.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 -- 172.21.15.154:0/3973700117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 msgr2=0x55de74613160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74613160 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f50fc051f20 tx=0x7f50fc07f040 comp rx=0 tx=0).stop 2023-10-10T21:15:18.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 -- 172.21.15.154:0/3973700117 shutdown_connections 2023-10-10T21:15:18.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.154:6832/1321064128,v1:172.21.15.154:6833/1321064128] conn(0x55de746c6e30 0x55de746c7200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de74661d00 0x55de74613160 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55de74617a50 0x55de746c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f50e2ffd700 0 client.5919 ms_handle_reset on v2:172.21.15.154:6832/1321064128 2023-10-10T21:15:18.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 --2- 172.21.15.154:0/3973700117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55de74640f60 0x55de74612c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 -- 172.21.15.154:0/3973700117 >> 172.21.15.154:0/3973700117 conn(0x55de74619370 msgr2=0x55de74617e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:18.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 -- 172.21.15.154:0/3973700117 shutdown_connections 2023-10-10T21:15:18.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 1 -- 172.21.15.154:0/3973700117 wait complete. 2023-10-10T21:15:18.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f51195c0b80 20 client.5919 trim_cache size 0 max 16384 2023-10-10T21:15:18.373 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:15:18.373 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T21:15:18.373 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T21:15:18.373 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 5751, 2023-10-10T21:15:18.374 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T21:15:18.374 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T21:15:18.374 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T21:15:18.374 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.262108101000001, 2023-10-10T21:15:18.374 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 22, 2023-10-10T21:15:18.374 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 64, 2023-10-10T21:15:18.375 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 64, 2023-10-10T21:15:18.375 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.051172756 2023-10-10T21:15:18.375 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:15:18.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f510adff700 1 -- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f50e8066f30 msgr2=0x7f50e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f510adff700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f50e8066f30 0x7f50e80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50f8007a60 tx=0x7f50f8009040 comp rx=0 tx=0).stop 2023-10-10T21:15:18.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f510adff700 1 -- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51040c9a40 msgr2=0x7f51040c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.352+0000 7f510adff700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51040c9a40 0x7f51040c9ea0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f51040ad8a0 tx=0x7f50fc00b040 comp rx=0 tx=0).stop 2023-10-10T21:15:18.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.353+0000 7f510adff700 1 -- 172.21.15.154:0/2139128519 shutdown_connections 2023-10-10T21:15:18.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.353+0000 7f510adff700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51040c9a40 0x7f51040c9ea0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.353+0000 7f510adff700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f4005920 0x7f510416a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.353+0000 7f510adff700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f50e8066f30 0x7f50e80693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.353+0000 7f510adff700 1 --2- 172.21.15.154:0/2139128519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51040cb9f0 0x7f51041532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.353+0000 7f510adff700 1 -- 172.21.15.154:0/2139128519 >> 172.21.15.154:0/2139128519 conn(0x7f510406a320 msgr2=0x7f510406d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:18.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.353+0000 7f510adff700 1 -- 172.21.15.154:0/2139128519 shutdown_connections 2023-10-10T21:15:18.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.353+0000 7f510adff700 1 -- 172.21.15.154:0/2139128519 wait complete. 2023-10-10T21:15:18.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:15:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.560+0000 7f71d29ff700 1 Processor -- start 2023-10-10T21:15:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.560+0000 7f71d29ff700 1 -- start start 2023-10-10T21:15:18.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.562+0000 7f71d29ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f71cc0b1420 0x7f71cc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.562+0000 7f71d29ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71cc0ccf90 0x7f71cc0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.562+0000 7f71d29ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71cc0cc300 con 0x7f71cc0cbf30 2023-10-10T21:15:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.562+0000 7f71d29ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc156bf0 con 0x7f71cc0ccf90 2023-10-10T21:15:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.562+0000 7f71d29ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc0ae950 con 0x7f71cc0b1420 2023-10-10T21:15:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.562+0000 7f71d0f9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71cc0ccf90 0x7f71cc0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.562+0000 7f71d0f9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71cc0ccf90 0x7f71cc0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42666/0 (socket says 172.21.15.154:42666) 2023-10-10T21:15:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.562+0000 7f71d0f9c700 1 -- 172.21.15.154:0/3117990890 learned_addr learned my addr 172.21.15.154:0/3117990890 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.562+0000 7f71c3fff700 1 --2- 172.21.15.154:0/3117990890 >> v2:172.21.15.179:3300/0 conn(0x7f71cc0b1420 0x7f71cc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.563+0000 7f71d0f9c700 1 -- 172.21.15.154:0/3117990890 >> v2:172.21.15.179:3300/0 conn(0x7f71cc0b1420 msgr2=0x7f71cc0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.563+0000 7f71d0f9c700 1 --2- 172.21.15.154:0/3117990890 >> v2:172.21.15.179:3300/0 conn(0x7f71cc0b1420 0x7f71cc0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.563+0000 7f71d0f9c700 1 -- 172.21.15.154:0/3117990890 >> v1:172.21.15.179:6789/0 conn(0x7f71cc0cbf30 legacy=0x7f71cc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.563+0000 7f71cb7fe700 1 -- 172.21.15.154:0/3117990890 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183403525 0 0) 0x7f71cc0cc300 con 0x7f71cc0cbf30 2023-10-10T21:15:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.563+0000 7f71d0f9c700 1 -- 172.21.15.154:0/3117990890 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0ad370 con 0x7f71cc0ccf90 2023-10-10T21:15:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.563+0000 7f71d0f9c700 1 --2- 172.21.15.154:0/3117990890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0ccf90 0x7f71cc0c9740 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0c9280 tx=0x7f71c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41808fab38af5237 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.563+0000 7f71cb7fe700 1 -- 172.21.15.154:0/3117990890 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400e070 con 0x7f71cc0ccf90 2023-10-10T21:15:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.563+0000 7f71cb7fe700 1 -- 172.21.15.154:0/3117990890 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400b990 con 0x7f71cc0ccf90 2023-10-10T21:15:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.563+0000 7f71cb7fe700 1 -- 172.21.15.154:0/3117990890 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40092e0 con 0x7f71cc0ccf90 2023-10-10T21:15:18.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.564+0000 7f71d29ff700 1 -- 172.21.15.154:0/3117990890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0ccf90 msgr2=0x7f71cc0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.564+0000 7f71d29ff700 1 --2- 172.21.15.154:0/3117990890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0ccf90 0x7f71cc0c9740 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0c9280 tx=0x7f71c4009840 comp rx=0 tx=0).stop 2023-10-10T21:15:18.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.564+0000 7f71d29ff700 1 -- 172.21.15.154:0/3117990890 shutdown_connections 2023-10-10T21:15:18.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.564+0000 7f71d29ff700 1 --2- 172.21.15.154:0/3117990890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0ccf90 0x7f71cc0c9740 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.564+0000 7f71d29ff700 1 --2- 172.21.15.154:0/3117990890 >> v2:172.21.15.179:3300/0 conn(0x7f71cc0b1420 0x7f71cc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.564+0000 7f71d29ff700 1 -- 172.21.15.154:0/3117990890 >> 172.21.15.154:0/3117990890 conn(0x7f71cc06a320 msgr2=0x7f71cc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:18.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.564+0000 7f71d29ff700 1 -- 172.21.15.154:0/3117990890 shutdown_connections 2023-10-10T21:15:18.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.564+0000 7f71d29ff700 1 -- 172.21.15.154:0/3117990890 wait complete. 2023-10-10T21:15:18.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.565+0000 7f71d29ff700 1 Processor -- start 2023-10-10T21:15:18.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.565+0000 7f71d29ff700 1 -- start start 2023-10-10T21:15:18.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.566+0000 7f71d29ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0b1420 0x7f71cc147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.566+0000 7f71d29ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71cc0cbf30 0x7f71cc169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.566+0000 7f71d29ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71cc0ccf90 0x7f71cc0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.566+0000 7f71d29ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc16d660 con 0x7f71cc0b1420 2023-10-10T21:15:18.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.566+0000 7f71d29ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc16d330 con 0x7f71cc0ccf90 2023-10-10T21:15:18.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.566+0000 7f71d29ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc16ab20 con 0x7f71cc0cbf30 2023-10-10T21:15:18.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.566+0000 7f71cbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0b1420 0x7f71cc147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.566+0000 7f71cbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0b1420 0x7f71cc147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42674/0 (socket says 172.21.15.154:42674) 2023-10-10T21:15:18.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.566+0000 7f71cbfff700 1 -- 172.21.15.154:0/3662637681 learned_addr learned my addr 172.21.15.154:0/3662637681 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:18.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71c3fff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71cc0cbf30 0x7f71cc169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71d0f9c700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71cc0ccf90 0x7f71cc0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71cbfff700 1 -- 172.21.15.154:0/3662637681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71cc0cbf30 msgr2=0x7f71cc169c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71cbfff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71cc0cbf30 0x7f71cc169c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71cbfff700 1 -- 172.21.15.154:0/3662637681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71cc0ccf90 msgr2=0x7f71cc0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71cbfff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71cc0ccf90 0x7f71cc0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71cbfff700 1 -- 172.21.15.154:0/3662637681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009ae0 con 0x7f71cc0b1420 2023-10-10T21:15:18.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71c3fff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71cc0cbf30 0x7f71cc169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:18.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71cbfff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0b1420 0x7f71cc147ee0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c7e0 tx=0x7f71bc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71c8ff9700 1 -- 172.21.15.154:0/3662637681 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc011590 con 0x7f71cc0b1420 2023-10-10T21:15:18.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71c8ff9700 1 -- 172.21.15.154:0/3662637681 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc011710 con 0x7f71cc0b1420 2023-10-10T21:15:18.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc16a560 con 0x7f71cc0b1420 2023-10-10T21:15:18.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71c8ff9700 1 -- 172.21.15.154:0/3662637681 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc011ad0 con 0x7f71cc0b1420 2023-10-10T21:15:18.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.567+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc148420 con 0x7f71cc0b1420 2023-10-10T21:15:18.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.568+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71cc04c3c0 con 0x7f71cc0b1420 2023-10-10T21:15:18.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.569+0000 7f71c8ff9700 1 -- 172.21.15.154:0/3662637681 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71bc01b3b0 con 0x7f71cc0b1420 2023-10-10T21:15:18.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.571+0000 7f71c8ff9700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f71ac066f30 0x7f71ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:18.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.571+0000 7f71c8ff9700 1 -- 172.21.15.154:0/3662637681 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f71bc083bf0 con 0x7f71cc0b1420 2023-10-10T21:15:18.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.571+0000 7f71c3fff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f71ac066f30 0x7f71ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:18.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.571+0000 7f71c3fff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f71ac066f30 0x7f71ac0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f71cc167750 tx=0x7f71b4008040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:18.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.575+0000 7f71c8ff9700 1 -- 172.21.15.154:0/3662637681 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71bc050cf0 con 0x7f71cc0b1420 2023-10-10T21:15:18.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:15:18.669 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:15:18.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.814+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f71cc16d940 con 0x7f71cc0b1420 2023-10-10T21:15:18.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.815+0000 7f71c8ff9700 1 -- 172.21.15.154:0/3662637681 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7f71bc017070 con 0x7f71cc0b1420 2023-10-10T21:15:18.816 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:15:18.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f71ac066f30 msgr2=0x7f71ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f71ac066f30 0x7f71ac0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f71cc167750 tx=0x7f71b4008040 comp rx=0 tx=0).stop 2023-10-10T21:15:18.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0b1420 msgr2=0x7f71cc147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:18.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0b1420 0x7f71cc147ee0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c7e0 tx=0x7f71bc007df0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 shutdown_connections 2023-10-10T21:15:18.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f71ac066f30 0x7f71ac0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71cc0ccf90 0x7f71cc0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71cc0b1420 0x7f71cc147ee0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 --2- 172.21.15.154:0/3662637681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71cc0cbf30 0x7f71cc169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:18.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.817+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 >> 172.21.15.154:0/3662637681 conn(0x7f71cc06a320 msgr2=0x7f71cc0b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:18.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.818+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 shutdown_connections 2023-10-10T21:15:18.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:18.818+0000 7f71d29ff700 1 -- 172.21.15.154:0/3662637681 wait complete. 2023-10-10T21:15:18.836 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T21:15:18.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:15:18.837 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T21:15:18.837 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T21:15:18.837 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T21:15:18.838 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T21:15:18.838 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T21:15:18.838 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:15:18.839 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:15:18.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:15:18.840 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T21:15:18.914 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:15:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:15:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:15:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:15:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:15:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:15:18.915 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:15:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:15:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T21:15:18.916 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:15:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:15:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T21:15:18.916 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:15:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:15:18.917 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:15:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:15:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:15:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 41495sec preferred_lft 41495sec 2023-10-10T21:15:18.918 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T21:15:18.918 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:15:18.918 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:15:18.918 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:15:18.918 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T21:15:18.919 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:15:18.919 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T21:15:18.919 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:15:18.919 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:15:18.919 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T21:15:18.920 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T21:15:18.920 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:15:18.920 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:15:18.920 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T21:15:18.920 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T21:15:18.921 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:15:18.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:15:18.921 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:15:19.014 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T21:15:19.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:15:19.018 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T21:15:19.057 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T21:15:19.057 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:15:19.058 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:15:19.058 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:15:19.058 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:15:19.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:15:19.060 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:15:19.060 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:15:19.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:15:19.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:15:19.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:15:19.062 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:15:19.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:15:19.257 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:15:19.294 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T21:15:19.294 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T21:15:19.295 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:15:19.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:15:19.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T21:15:19.396 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:15:19.397 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T21:15:19.433 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:15:19.434 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:15:19.434 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:15:19.509 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:15:19.510 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:15:19.510 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:15:19.641 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:15:19.642 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:15:19.642 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:15:19.658 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:15:19.658 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:15:19.658 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:15:19.658 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:15:19.659 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:15:19.679 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:15:19.679 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:15:19.680 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:15:19.680 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:15:19.680 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:15:19.680 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:15:19.680 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:15:19.680 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:15:19.685 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:15:19.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:15:19.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:15:19.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T21:15:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.930+0000 7f355bfff700 1 Processor -- start 2023-10-10T21:15:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.930+0000 7f355bfff700 1 -- start start 2023-10-10T21:15:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f355bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3554155c10 0x7f3554155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f355bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 0x7f35540ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f355bfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540ad930 con 0x7f35541568a0 2023-10-10T21:15:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f355bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35540acd20 con 0x7f3554155c10 2023-10-10T21:15:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f355bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540ad000 con 0x7f35540ac230 2023-10-10T21:15:19.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f355a59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f35541568a0 0x7f3554156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45440/0 (socket says 172.21.15.154:45440) 2023-10-10T21:15:19.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f355a59c700 1 -- 172.21.15.154:0/2821412499 learned_addr learned my addr 172.21.15.154:0/2821412499 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:19.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f355959a700 1 --2- 172.21.15.154:0/2821412499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 0x7f35540ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:19.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f3559d9b700 1 --2- 172.21.15.154:0/2821412499 >> v2:172.21.15.179:3300/0 conn(0x7f3554155c10 0x7f3554155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:19.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.932+0000 7f3558d99700 1 -- 172.21.15.154:0/2821412499 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732962435 0 0) 0x7f35540ad930 con 0x7f35541568a0 2023-10-10T21:15:19.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.933+0000 7f3558d99700 1 -- 172.21.15.154:0/2821412499 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3540003570 con 0x7f35541568a0 2023-10-10T21:15:19.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.933+0000 7f355959a700 1 -- 172.21.15.154:0/2821412499 >> v2:172.21.15.179:3300/0 conn(0x7f3554155c10 msgr2=0x7f3554155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:19.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.933+0000 7f355959a700 1 --2- 172.21.15.154:0/2821412499 >> v2:172.21.15.179:3300/0 conn(0x7f3554155c10 0x7f3554155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:19.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.933+0000 7f355959a700 1 -- 172.21.15.154:0/2821412499 >> v1:172.21.15.154:6789/0 conn(0x7f35541568a0 legacy=0x7f3554156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:19.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.933+0000 7f355959a700 1 -- 172.21.15.154:0/2821412499 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540ad2e0 con 0x7f35540ac230 2023-10-10T21:15:19.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.933+0000 7f355959a700 1 --2- 172.21.15.154:0/2821412499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 0x7f35540ac6a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f35440098e0 tx=0x7f35440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9238e9ba641060f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:19.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.933+0000 7f3558d99700 1 -- 172.21.15.154:0/2821412499 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544011630 con 0x7f35540ac230 2023-10-10T21:15:19.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.933+0000 7f3558d99700 1 -- 172.21.15.154:0/2821412499 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3544011790 con 0x7f35540ac230 2023-10-10T21:15:19.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.933+0000 7f3558d99700 1 -- 172.21.15.154:0/2821412499 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544011b30 con 0x7f35540ac230 2023-10-10T21:15:19.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.934+0000 7f355bfff700 1 -- 172.21.15.154:0/2821412499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 msgr2=0x7f35540ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.934+0000 7f355bfff700 1 --2- 172.21.15.154:0/2821412499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 0x7f35540ac6a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f35440098e0 tx=0x7f35440091a0 comp rx=0 tx=0).stop 2023-10-10T21:15:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.934+0000 7f355bfff700 1 -- 172.21.15.154:0/2821412499 shutdown_connections 2023-10-10T21:15:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.934+0000 7f355bfff700 1 --2- 172.21.15.154:0/2821412499 >> v2:172.21.15.179:3300/0 conn(0x7f3554155c10 0x7f3554155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.934+0000 7f355bfff700 1 --2- 172.21.15.154:0/2821412499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 0x7f35540ac6a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.934+0000 7f355bfff700 1 -- 172.21.15.154:0/2821412499 >> 172.21.15.154:0/2821412499 conn(0x7f355406a320 msgr2=0x7f35540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:19.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.934+0000 7f355bfff700 1 -- 172.21.15.154:0/2821412499 shutdown_connections 2023-10-10T21:15:19.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.934+0000 7f355bfff700 1 -- 172.21.15.154:0/2821412499 wait complete. 2023-10-10T21:15:19.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.935+0000 7f355bfff700 1 Processor -- start 2023-10-10T21:15:19.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.935+0000 7f355bfff700 1 -- start start 2023-10-10T21:15:19.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.936+0000 7f355bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 0x7f35540cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:19.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.936+0000 7f355bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3554155c10 0x7f35541513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:19.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.936+0000 7f355bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35541568a0 0x7f35541518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:19.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.936+0000 7f355bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3554159750 con 0x7f3554155c10 2023-10-10T21:15:19.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.936+0000 7f355bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3554158b40 con 0x7f35541568a0 2023-10-10T21:15:19.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.936+0000 7f355bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3554158e20 con 0x7f35540ac230 2023-10-10T21:15:19.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355959a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3554155c10 0x7f35541513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:19.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355959a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3554155c10 0x7f35541513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42684/0 (socket says 172.21.15.154:42684) 2023-10-10T21:15:19.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355959a700 1 -- 172.21.15.154:0/1709258783 learned_addr learned my addr 172.21.15.154:0/1709258783 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:19.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355a59c700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35541568a0 0x7f35541518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:19.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f3559d9b700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 0x7f35540cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:19.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355959a700 1 -- 172.21.15.154:0/1709258783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 msgr2=0x7f35540cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:19.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355959a700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 0x7f35540cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:19.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355959a700 1 -- 172.21.15.154:0/1709258783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35541568a0 msgr2=0x7f35541518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:19.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355959a700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35541568a0 0x7f35541518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:19.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355959a700 1 -- 172.21.15.154:0/1709258783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544009420 con 0x7f3554155c10 2023-10-10T21:15:19.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.937+0000 7f355959a700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3554155c10 0x7f35541513b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f35540ad140 tx=0x7f3544017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:19.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.938+0000 7f3549ffb700 1 -- 172.21.15.154:0/1709258783 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544011900 con 0x7f3554155c10 2023-10-10T21:15:19.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.938+0000 7f3549ffb700 1 -- 172.21.15.154:0/1709258783 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3544011a60 con 0x7f3554155c10 2023-10-10T21:15:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.938+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3554159100 con 0x7f3554155c10 2023-10-10T21:15:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.938+0000 7f3549ffb700 1 -- 172.21.15.154:0/1709258783 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544025640 con 0x7f3554155c10 2023-10-10T21:15:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.938+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35541587a0 con 0x7f3554155c10 2023-10-10T21:15:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.939+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35541598c0 con 0x7f3554155c10 2023-10-10T21:15:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.940+0000 7f3549ffb700 1 -- 172.21.15.154:0/1709258783 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3544025a30 con 0x7f3554155c10 2023-10-10T21:15:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.940+0000 7f3549ffb700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3538066f30 0x7f35380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.940+0000 7f3549ffb700 1 -- 172.21.15.154:0/1709258783 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3544085e40 con 0x7f3554155c10 2023-10-10T21:15:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.941+0000 7f3559d9b700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3538066f30 0x7f35380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.941+0000 7f3559d9b700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3538066f30 0x7f35380693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3550015410 tx=0x7f355000f040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:19.945+0000 7f3549ffb700 1 -- 172.21.15.154:0/1709258783 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3544052ea0 con 0x7f3554155c10 2023-10-10T21:15:20.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.165+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f355404c3c0 con 0x7f3538066f30 2023-10-10T21:15:20.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.167+0000 7f3549ffb700 1 -- 172.21.15.154:0/1709258783 <== mgr.5565 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f355404c3c0 con 0x7f3538066f30 2023-10-10T21:15:20.168 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:15:20.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:15:20.169 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T21:15:20.169 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:15:20.169 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:15:20.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3538066f30 msgr2=0x7f35380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:20.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3538066f30 0x7f35380693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3550015410 tx=0x7f355000f040 comp rx=0 tx=0).stop 2023-10-10T21:15:20.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3554155c10 msgr2=0x7f35541513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:20.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3554155c10 0x7f35541513b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f35540ad140 tx=0x7f3544017000 comp rx=0 tx=0).stop 2023-10-10T21:15:20.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 shutdown_connections 2023-10-10T21:15:20.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3538066f30 0x7f35380693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35541568a0 0x7f35541518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35540ac230 0x7f35540cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 --2- 172.21.15.154:0/1709258783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3554155c10 0x7f35541513b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 >> 172.21.15.154:0/1709258783 conn(0x7f355406a320 msgr2=0x7f35541535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:20.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 shutdown_connections 2023-10-10T21:15:20.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.169+0000 7f355bfff700 1 -- 172.21.15.154:0/1709258783 wait complete. 2023-10-10T21:15:20.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T21:15:20.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.373+0000 7f273b7ff700 1 Processor -- start 2023-10-10T21:15:20.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.373+0000 7f273b7ff700 1 -- start start 2023-10-10T21:15:20.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f273b7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2734069e80 0x7f27340c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:20.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f273b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340b0a70 0x7f27340c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:20.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f273b7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27340af2f0 con 0x7f273415ac80 2023-10-10T21:15:20.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f273b7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27340af5d0 con 0x7f2734069e80 2023-10-10T21:15:20.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f273b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27340c8660 con 0x7f27340b0a70 2023-10-10T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f2738d9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2734069e80 0x7f27340c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f273959b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f273415ac80 0x7f2734069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45448/0 (socket says 172.21.15.154:45448) 2023-10-10T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f273959b700 1 -- 172.21.15.154:0/263432632 learned_addr learned my addr 172.21.15.154:0/263432632 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f2738d9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2734069e80 0x7f27340c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42698/0 (socket says 172.21.15.154:42698) 2023-10-10T21:15:20.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f2738d9a700 1 -- 172.21.15.154:0/263432632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340b0a70 msgr2=0x7f27340c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:20.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f2739d9c700 1 --2- 172.21.15.154:0/263432632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340b0a70 0x7f27340c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:20.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f272bfff700 1 -- 172.21.15.154:0/263432632 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801254437 0 0) 0x7f27340af2f0 con 0x7f273415ac80 2023-10-10T21:15:20.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f2738d9a700 1 --2- 172.21.15.154:0/263432632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340b0a70 0x7f27340c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f2738d9a700 1 -- 172.21.15.154:0/263432632 >> v1:172.21.15.154:6789/0 conn(0x7f273415ac80 legacy=0x7f2734069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:20.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f2738d9a700 1 -- 172.21.15.154:0/263432632 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27340c8940 con 0x7f2734069e80 2023-10-10T21:15:20.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.375+0000 7f2739d9c700 1 --2- 172.21.15.154:0/263432632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340b0a70 0x7f27340c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:15:20.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.376+0000 7f2738d9a700 1 --2- 172.21.15.154:0/263432632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2734069e80 0x7f27340c6b70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f27240098e0 tx=0x7f27240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312c996c8967949a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:20.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.376+0000 7f272bfff700 1 -- 172.21.15.154:0/263432632 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724009e80 con 0x7f2734069e80 2023-10-10T21:15:20.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.376+0000 7f272bfff700 1 -- 172.21.15.154:0/263432632 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272400b860 con 0x7f2734069e80 2023-10-10T21:15:20.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.376+0000 7f272bfff700 1 -- 172.21.15.154:0/263432632 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400bbe0 con 0x7f2734069e80 2023-10-10T21:15:20.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.376+0000 7f273b7ff700 1 -- 172.21.15.154:0/263432632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2734069e80 msgr2=0x7f27340c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:20.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.376+0000 7f273b7ff700 1 --2- 172.21.15.154:0/263432632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2734069e80 0x7f27340c6b70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f27240098e0 tx=0x7f27240091a0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.377+0000 7f273b7ff700 1 -- 172.21.15.154:0/263432632 shutdown_connections 2023-10-10T21:15:20.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.377+0000 7f273b7ff700 1 --2- 172.21.15.154:0/263432632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340b0a70 0x7f27340c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.377+0000 7f273b7ff700 1 --2- 172.21.15.154:0/263432632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2734069e80 0x7f27340c6b70 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.377+0000 7f273b7ff700 1 -- 172.21.15.154:0/263432632 >> 172.21.15.154:0/263432632 conn(0x7f2734068e10 msgr2=0x7f27340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:20.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.377+0000 7f273b7ff700 1 -- 172.21.15.154:0/263432632 shutdown_connections 2023-10-10T21:15:20.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.377+0000 7f273b7ff700 1 -- 172.21.15.154:0/263432632 wait complete. 2023-10-10T21:15:20.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.378+0000 7f273b7ff700 1 Processor -- start 2023-10-10T21:15:20.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.378+0000 7f273b7ff700 1 -- start start 2023-10-10T21:15:20.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.379+0000 7f273b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2734069e80 0x7f27340ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:20.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.379+0000 7f273b7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27340b0a70 0x7f27340c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:20.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.379+0000 7f273b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415ac80 0x7f2734142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:20.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.379+0000 7f273b7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340c21f0 con 0x7f27340b0a70 2023-10-10T21:15:20.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.379+0000 7f273b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2734158c60 con 0x7f2734069e80 2023-10-10T21:15:20.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.379+0000 7f273b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27340c2c80 con 0x7f273415ac80 2023-10-10T21:15:20.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.379+0000 7f2738d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27340b0a70 0x7f27340c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:20.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.379+0000 7f2738d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27340b0a70 0x7f27340c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42708/0 (socket says 172.21.15.154:42708) 2023-10-10T21:15:20.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.379+0000 7f2738d9a700 1 -- 172.21.15.154:0/2053373262 learned_addr learned my addr 172.21.15.154:0/2053373262 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:20.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f2739d9c700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415ac80 0x7f2734142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:20.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f273959b700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2734069e80 0x7f27340ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:20.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f2738d9a700 1 -- 172.21.15.154:0/2053373262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415ac80 msgr2=0x7f2734142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:20.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f2738d9a700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415ac80 0x7f2734142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f2738d9a700 1 -- 172.21.15.154:0/2053373262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2734069e80 msgr2=0x7f27340ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:20.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f2738d9a700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2734069e80 0x7f27340ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:20.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f2738d9a700 1 -- 172.21.15.154:0/2053373262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724009420 con 0x7f27340b0a70 2023-10-10T21:15:20.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f2738d9a700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27340b0a70 0x7f27340c1cb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2724013000 tx=0x7f2724017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:20.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f27297fa700 1 -- 172.21.15.154:0/2053373262 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400bbe0 con 0x7f27340b0a70 2023-10-10T21:15:20.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f27297fa700 1 -- 172.21.15.154:0/2053373262 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724011420 con 0x7f27340b0a70 2023-10-10T21:15:20.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27340c23e0 con 0x7f27340b0a70 2023-10-10T21:15:20.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f27297fa700 1 -- 172.21.15.154:0/2053373262 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27240117e0 con 0x7f27340b0a70 2023-10-10T21:15:20.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.380+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27340c29a0 con 0x7f27340b0a70 2023-10-10T21:15:20.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.381+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273404c3c0 con 0x7f27340b0a70 2023-10-10T21:15:20.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.382+0000 7f27297fa700 1 -- 172.21.15.154:0/2053373262 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2724011bd0 con 0x7f27340b0a70 2023-10-10T21:15:20.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.383+0000 7f27297fa700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2718066f30 0x7f27180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:20.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.383+0000 7f27297fa700 1 -- 172.21.15.154:0/2053373262 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f2724086250 con 0x7f27340b0a70 2023-10-10T21:15:20.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.383+0000 7f273959b700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2718066f30 0x7f27180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:20.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.384+0000 7f273959b700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2718066f30 0x7f27180693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2730002230 tx=0x7f2730009040 comp rx=0 tx=0).ready entity=mgr.5565 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:20.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.388+0000 7f27297fa700 1 -- 172.21.15.154:0/2053373262 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27240532b0 con 0x7f27340b0a70 2023-10-10T21:15:20.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:20.636+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f27340c8c20 con 0x7f27340b0a70 2023-10-10T21:15:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.164+0000 7f27297fa700 1 -- 172.21.15.154:0/2053373262 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 18) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f2724053680 con 0x7f27340b0a70 2023-10-10T21:15:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.165+0000 7f27297fa700 1 -- 172.21.15.154:0/2053373262 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) v1 ==== 92+0+0 (secure 0 0 0) 0x7f2724056d40 con 0x7f27340b0a70 2023-10-10T21:15:21.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2718066f30 msgr2=0x7f27180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2718066f30 0x7f27180693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2730002230 tx=0x7f2730009040 comp rx=0 tx=0).stop 2023-10-10T21:15:21.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27340b0a70 msgr2=0x7f27340c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27340b0a70 0x7f27340c1cb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2724013000 tx=0x7f2724017000 comp rx=0 tx=0).stop 2023-10-10T21:15:21.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 shutdown_connections 2023-10-10T21:15:21.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415ac80 0x7f2734142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2718066f30 0x7f27180693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2734069e80 0x7f27340ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 --2- 172.21.15.154:0/2053373262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27340b0a70 0x7f27340c1cb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 >> 172.21.15.154:0/2053373262 conn(0x7f2734068e10 msgr2=0x7f2734155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:21.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 shutdown_connections 2023-10-10T21:15:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.168+0000 7f273b7ff700 1 -- 172.21.15.154:0/2053373262 wait complete. 2023-10-10T21:15:21.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T21:15:21.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.386+0000 7fa92e59d700 1 Processor -- start 2023-10-10T21:15:21.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.386+0000 7fa92e59d700 1 -- start start 2023-10-10T21:15:21.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.387+0000 7fa92e59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa92815a3b0 0x7fa92815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.387+0000 7fa92e59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa92806e470 0x7fa92806e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.387+0000 7fa92e59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9280aea70 con 0x7fa9280aef00 2023-10-10T21:15:21.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.387+0000 7fa92e59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92806ee30 con 0x7fa92806e470 2023-10-10T21:15:21.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.387+0000 7fa92e59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92815dad0 con 0x7fa92815a3b0 2023-10-10T21:15:21.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.388+0000 7fa92dd9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa92806e470 0x7fa92806e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.388+0000 7fa92dd9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa92806e470 0x7fa92806e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42736/0 (socket says 172.21.15.154:42736) 2023-10-10T21:15:21.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.388+0000 7fa92dd9c700 1 -- 172.21.15.154:0/1493602102 learned_addr learned my addr 172.21.15.154:0/1493602102 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:21.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.388+0000 7fa92d59b700 1 --2- 172.21.15.154:0/1493602102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa92815a3b0 0x7fa92815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.388+0000 7fa92dd9c700 1 -- 172.21.15.154:0/1493602102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa92815a3b0 msgr2=0x7fa92815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:21.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.388+0000 7fa92dd9c700 1 --2- 172.21.15.154:0/1493602102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa92815a3b0 0x7fa92815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.388+0000 7fa92dd9c700 1 -- 172.21.15.154:0/1493602102 >> v1:172.21.15.154:6789/0 conn(0x7fa9280aef00 legacy=0x7fa92815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.388+0000 7fa92dd9c700 1 -- 172.21.15.154:0/1493602102 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9280ae480 con 0x7fa92806e470 2023-10-10T21:15:21.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.389+0000 7fa92dd9c700 1 --2- 172.21.15.154:0/1493602102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92806e470 0x7fa92806e8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa920009f20 tx=0x7fa920009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff70c7b88cd203a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:21.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.389+0000 7fa91ffff700 1 -- 172.21.15.154:0/1493602102 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92000e070 con 0x7fa92806e470 2023-10-10T21:15:21.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.389+0000 7fa91ffff700 1 -- 172.21.15.154:0/1493602102 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92000b9d0 con 0x7fa92806e470 2023-10-10T21:15:21.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.389+0000 7fa91ffff700 1 -- 172.21.15.154:0/1493602102 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9200092e0 con 0x7fa92806e470 2023-10-10T21:15:21.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.389+0000 7fa92e59d700 1 -- 172.21.15.154:0/1493602102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92806e470 msgr2=0x7fa92806e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.389+0000 7fa92e59d700 1 --2- 172.21.15.154:0/1493602102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92806e470 0x7fa92806e8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa920009f20 tx=0x7fa920009840 comp rx=0 tx=0).stop 2023-10-10T21:15:21.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.390+0000 7fa92e59d700 1 -- 172.21.15.154:0/1493602102 shutdown_connections 2023-10-10T21:15:21.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.390+0000 7fa92e59d700 1 --2- 172.21.15.154:0/1493602102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92806e470 0x7fa92806e8f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.390+0000 7fa92e59d700 1 --2- 172.21.15.154:0/1493602102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa92815a3b0 0x7fa92815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.390+0000 7fa92e59d700 1 -- 172.21.15.154:0/1493602102 >> 172.21.15.154:0/1493602102 conn(0x7fa9280c9f70 msgr2=0x7fa92806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:21.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.390+0000 7fa92e59d700 1 -- 172.21.15.154:0/1493602102 shutdown_connections 2023-10-10T21:15:21.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.390+0000 7fa92e59d700 1 -- 172.21.15.154:0/1493602102 wait complete. 2023-10-10T21:15:21.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.391+0000 7fa92e59d700 1 Processor -- start 2023-10-10T21:15:21.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.391+0000 7fa92e59d700 1 -- start start 2023-10-10T21:15:21.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.392+0000 7fa92e59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92806e470 0x7fa928154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.392+0000 7fa92e59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9280aef00 0x7fa928169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.392+0000 7fa92e59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92815a3b0 0x7fa92816a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.392+0000 7fa92e59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92816b350 con 0x7fa92815a3b0 2023-10-10T21:15:21.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.392+0000 7fa92e59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280c6580 con 0x7fa92806e470 2023-10-10T21:15:21.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.392+0000 7fa92e59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92816a710 con 0x7fa9280aef00 2023-10-10T21:15:21.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.392+0000 7fa92dd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92815a3b0 0x7fa92816a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92dd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92815a3b0 0x7fa92816a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42746/0 (socket says 172.21.15.154:42746) 2023-10-10T21:15:21.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92d59b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92806e470 0x7fa928154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92dd9c700 1 -- 172.21.15.154:0/4250421942 learned_addr learned my addr 172.21.15.154:0/4250421942 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:21.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92cd9a700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9280aef00 0x7fa928169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92dd9c700 1 -- 172.21.15.154:0/4250421942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9280aef00 msgr2=0x7fa928169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92dd9c700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9280aef00 0x7fa928169b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92dd9c700 1 -- 172.21.15.154:0/4250421942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92806e470 msgr2=0x7fa928154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92dd9c700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92806e470 0x7fa928154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92dd9c700 1 -- 172.21.15.154:0/4250421942 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920009ae0 con 0x7fa92815a3b0 2023-10-10T21:15:21.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa92dd9c700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92815a3b0 0x7fa92816a070 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa92000b610 tx=0x7fa920018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:21.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.393+0000 7fa91d7fa700 1 -- 172.21.15.154:0/4250421942 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920008ad0 con 0x7fa92815a3b0 2023-10-10T21:15:21.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.394+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92816a9f0 con 0x7fa92815a3b0 2023-10-10T21:15:21.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.394+0000 7fa91d7fa700 1 -- 172.21.15.154:0/4250421942 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920008c30 con 0x7fa92815a3b0 2023-10-10T21:15:21.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.394+0000 7fa91d7fa700 1 -- 172.21.15.154:0/4250421942 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920026460 con 0x7fa92815a3b0 2023-10-10T21:15:21.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.394+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92816afe0 con 0x7fa92815a3b0 2023-10-10T21:15:21.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.395+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92806cfa0 con 0x7fa92815a3b0 2023-10-10T21:15:21.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.396+0000 7fa91d7fa700 1 -- 172.21.15.154:0/4250421942 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fa920003040 con 0x7fa92815a3b0 2023-10-10T21:15:21.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.396+0000 7fa91d7fa700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa90c066f80 0x7fa90c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.397+0000 7fa91d7fa700 1 -- 172.21.15.154:0/4250421942 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa920086600 con 0x7fa92815a3b0 2023-10-10T21:15:21.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.397+0000 7fa92d59b700 1 -- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa90c066f80 msgr2=0x7fa90c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:15:21.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.397+0000 7fa92d59b700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa90c066f80 0x7fa90c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:15:21.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.404+0000 7fa91d7fa700 1 -- 172.21.15.154:0/4250421942 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa920053660 con 0x7fa92815a3b0 2023-10-10T21:15:21.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.598+0000 7fa92d59b700 1 -- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa90c066f80 msgr2=0x7fa90c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:15:21.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.598+0000 7fa92d59b700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa90c066f80 0x7fa90c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:15:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.605+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fa92816b490 con 0x7fa92815a3b0 2023-10-10T21:15:21.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.609+0000 7fa91d7fa700 1 -- 172.21.15.154:0/4250421942 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa920056c80 con 0x7fa92815a3b0 2023-10-10T21:15:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.611+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa90c066f80 msgr2=0x7fa90c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:15:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.611+0000 7fa92e59d700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa90c066f80 0x7fa90c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.611+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92815a3b0 msgr2=0x7fa92816a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.611+0000 7fa92e59d700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92815a3b0 0x7fa92816a070 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa92000b610 tx=0x7fa920018000 comp rx=0 tx=0).stop 2023-10-10T21:15:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.612+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 shutdown_connections 2023-10-10T21:15:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.612+0000 7fa92e59d700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92815a3b0 0x7fa92816a070 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.612+0000 7fa92e59d700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa90c066f80 0x7fa90c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.612+0000 7fa92e59d700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92806e470 0x7fa928154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.612+0000 7fa92e59d700 1 --2- 172.21.15.154:0/4250421942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9280aef00 0x7fa928169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.612+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 >> 172.21.15.154:0/4250421942 conn(0x7fa9280c9f70 msgr2=0x7fa928152460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:21.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.612+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 shutdown_connections 2023-10-10T21:15:21.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.612+0000 7fa92e59d700 1 -- 172.21.15.154:0/4250421942 wait complete. 2023-10-10T21:15:21.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T21:15:21.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.822+0000 7fb708d9d700 1 Processor -- start 2023-10-10T21:15:21.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.822+0000 7fb708d9d700 1 -- start start 2023-10-10T21:15:21.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.823+0000 7fb708d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7040b4e70 0x7fb7040ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.823+0000 7fb708d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7040b1b40 0x7fb70415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.823+0000 7fb708d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7040cfb00 con 0x7fb7040b16d0 2023-10-10T21:15:21.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.823+0000 7fb708d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7040b5c40 con 0x7fb7040b1b40 2023-10-10T21:15:21.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.823+0000 7fb708d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7040b5f20 con 0x7fb7040b4e70 2023-10-10T21:15:21.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.823+0000 7fb703fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7040b1b40 0x7fb70415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.824+0000 7fb703fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7040b1b40 0x7fb70415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42750/0 (socket says 172.21.15.154:42750) 2023-10-10T21:15:21.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.824+0000 7fb703fff700 1 -- 172.21.15.154:0/4274191910 learned_addr learned my addr 172.21.15.154:0/4274191910 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:21.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.824+0000 7fb7037fe700 1 --2- 172.21.15.154:0/4274191910 >> v2:172.21.15.179:3300/0 conn(0x7fb7040b4e70 0x7fb7040ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.824+0000 7fb703fff700 1 -- 172.21.15.154:0/4274191910 >> v2:172.21.15.179:3300/0 conn(0x7fb7040b4e70 msgr2=0x7fb7040ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:21.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.824+0000 7fb703fff700 1 --2- 172.21.15.154:0/4274191910 >> v2:172.21.15.179:3300/0 conn(0x7fb7040b4e70 0x7fb7040ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.824+0000 7fb703fff700 1 -- 172.21.15.154:0/4274191910 >> v1:172.21.15.154:6789/0 conn(0x7fb7040b16d0 legacy=0x7fb70415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.824+0000 7fb703fff700 1 -- 172.21.15.154:0/4274191910 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7040b6200 con 0x7fb7040b1b40 2023-10-10T21:15:21.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.824+0000 7fb703fff700 1 --2- 172.21.15.154:0/4274191910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 0x7fb70415d950 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb704064910 tx=0x7fb6fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544b5414e9ce6a22 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:21.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.824+0000 7fb7027fc700 1 -- 172.21.15.154:0/4274191910 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00e070 con 0x7fb7040b1b40 2023-10-10T21:15:21.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb7027fc700 1 -- 172.21.15.154:0/4274191910 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc00ba20 con 0x7fb7040b1b40 2023-10-10T21:15:21.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb7027fc700 1 -- 172.21.15.154:0/4274191910 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc0092e0 con 0x7fb7040b1b40 2023-10-10T21:15:21.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb708d9d700 1 -- 172.21.15.154:0/4274191910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 msgr2=0x7fb70415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb708d9d700 1 --2- 172.21.15.154:0/4274191910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 0x7fb70415d950 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb704064910 tx=0x7fb6fc009840 comp rx=0 tx=0).stop 2023-10-10T21:15:21.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb708d9d700 1 -- 172.21.15.154:0/4274191910 shutdown_connections 2023-10-10T21:15:21.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb708d9d700 1 --2- 172.21.15.154:0/4274191910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 0x7fb70415d950 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb708d9d700 1 --2- 172.21.15.154:0/4274191910 >> v2:172.21.15.179:3300/0 conn(0x7fb7040b4e70 0x7fb7040ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb708d9d700 1 -- 172.21.15.154:0/4274191910 >> 172.21.15.154:0/4274191910 conn(0x7fb7040d10c0 msgr2=0x7fb7040affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:21.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb708d9d700 1 -- 172.21.15.154:0/4274191910 shutdown_connections 2023-10-10T21:15:21.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.825+0000 7fb708d9d700 1 -- 172.21.15.154:0/4274191910 wait complete. 2023-10-10T21:15:21.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.827+0000 7fb708d9d700 1 Processor -- start 2023-10-10T21:15:21.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.827+0000 7fb708d9d700 1 -- start start 2023-10-10T21:15:21.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb708d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7040b16d0 0x7fb7040c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb708d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 0x7fb7040c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb708d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7040b4e70 0x7fb704169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb708d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040c7070 con 0x7fb7040b1b40 2023-10-10T21:15:21.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb708d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70416ae10 con 0x7fb7040b16d0 2023-10-10T21:15:21.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb708d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040c6ab0 con 0x7fb7040b4e70 2023-10-10T21:15:21.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb702ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 0x7fb7040c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb702ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 0x7fb7040c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42758/0 (socket says 172.21.15.154:42758) 2023-10-10T21:15:21.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb703fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7040b4e70 0x7fb704169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb702ffd700 1 -- 172.21.15.154:0/2602085750 learned_addr learned my addr 172.21.15.154:0/2602085750 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:21.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.828+0000 7fb7037fe700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7040b16d0 0x7fb7040c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:21.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb702ffd700 1 -- 172.21.15.154:0/2602085750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7040b4e70 msgr2=0x7fb704169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb702ffd700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7040b4e70 0x7fb704169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb702ffd700 1 -- 172.21.15.154:0/2602085750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7040b16d0 msgr2=0x7fb7040c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:21.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb702ffd700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7040b16d0 0x7fb7040c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:21.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb702ffd700 1 -- 172.21.15.154:0/2602085750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc009ae0 con 0x7fb7040b1b40 2023-10-10T21:15:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb702ffd700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 0x7fb7040c6290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c590 tx=0x7fb6f800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/2602085750 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8011590 con 0x7fb7040b1b40 2023-10-10T21:15:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/2602085750 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f8011710 con 0x7fb7040b1b40 2023-10-10T21:15:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/2602085750 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8011ad0 con 0x7fb7040b1b40 2023-10-10T21:15:21.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.829+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7040c6d90 con 0x7fb7040b1b40 2023-10-10T21:15:21.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.830+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7040c67d0 con 0x7fb7040b1b40 2023-10-10T21:15:21.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.830+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70416b2f0 con 0x7fb7040b1b40 2023-10-10T21:15:21.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.831+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/2602085750 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb6f801b3b0 con 0x7fb7040b1b40 2023-10-10T21:15:21.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.832+0000 7fb6eb7fe700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f0066f80 0x7fb6f0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:21.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.832+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/2602085750 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb6f8083bb0 con 0x7fb7040b1b40 2023-10-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.833+0000 7fb7037fe700 1 -- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f0066f80 msgr2=0x7fb6f0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.833+0000 7fb7037fe700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f0066f80 0x7fb6f0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:21.837+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/2602085750 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb70416b2f0 con 0x7fb7040b1b40 2023-10-10T21:15:22.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.034+0000 7fb7037fe700 1 -- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f0066f80 msgr2=0x7fb6f0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:15:22.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.034+0000 7fb7037fe700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f0066f80 0x7fb6f0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:15:22.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.039+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fb70416b2f0 con 0x7fb7040b1b40 2023-10-10T21:15:22.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.043+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/2602085750 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb70416b2f0 con 0x7fb7040b1b40 2023-10-10T21:15:22.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f0066f80 msgr2=0x7fb6f0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:15:22.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f0066f80 0x7fb6f0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 msgr2=0x7fb7040c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:22.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 0x7fb7040c6290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c590 tx=0x7fb6f800c8a0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 shutdown_connections 2023-10-10T21:15:22.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7040b4e70 0x7fb704169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f0066f80 0x7fb6f0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7040b16d0 0x7fb7040c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 --2- 172.21.15.154:0/2602085750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7040b1b40 0x7fb7040c6290 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 >> 172.21.15.154:0/2602085750 conn(0x7fb7040d10c0 msgr2=0x7fb7040b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:22.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 shutdown_connections 2023-10-10T21:15:22.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.045+0000 7fb708d9d700 1 -- 172.21.15.154:0/2602085750 wait complete. 2023-10-10T21:15:22.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:22.065 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-10T21:15:22.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-10T21:15:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.339+0000 7fb902b9d700 1 Processor -- start 2023-10-10T21:15:22.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.340+0000 7fb902b9d700 1 -- start start 2023-10-10T21:15:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb902b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8fc0b03c0 0x7fb8fc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb902b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb8fc0b0790 0x7fb8fc0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb902b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc1591e0 0x7fb8fc159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb902b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc0cfa00 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb902b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc0cb580 con 0x7fb8fc0b0790 2023-10-10T21:15:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb902b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc0b2de0 con 0x7fb8fc1591e0 2023-10-10T21:15:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb901b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8fc0b03c0 0x7fb8fc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb901b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8fc0b03c0 0x7fb8fc0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42768/0 (socket says 172.21.15.154:42768) 2023-10-10T21:15:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb901b9b700 1 -- 172.21.15.154:0/477455663 learned_addr learned my addr 172.21.15.154:0/477455663 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb90139a700 1 --2- 172.21.15.154:0/477455663 >> v2:172.21.15.179:3300/0 conn(0x7fb8fc0b0790 0x7fb8fc0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb90239c700 1 --2- 172.21.15.154:0/477455663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc1591e0 0x7fb8fc159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.341+0000 7fb901b9b700 1 -- 172.21.15.154:0/477455663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc1591e0 msgr2=0x7fb8fc159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.342+0000 7fb901b9b700 1 --2- 172.21.15.154:0/477455663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc1591e0 0x7fb8fc159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.342+0000 7fb901b9b700 1 -- 172.21.15.154:0/477455663 >> v2:172.21.15.179:3300/0 conn(0x7fb8fc0b0790 msgr2=0x7fb8fc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.342+0000 7fb901b9b700 1 --2- 172.21.15.154:0/477455663 >> v2:172.21.15.179:3300/0 conn(0x7fb8fc0b0790 0x7fb8fc0b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.342+0000 7fb901b9b700 1 -- 172.21.15.154:0/477455663 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc0cf160 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.342+0000 7fb90139a700 1 --2- 172.21.15.154:0/477455663 >> v2:172.21.15.179:3300/0 conn(0x7fb8fc0b0790 0x7fb8fc0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:15:22.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.342+0000 7fb901b9b700 1 --2- 172.21.15.154:0/477455663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 0x7fb8fc0cea70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80099b0 tx=0x7fb8f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450761db3b36a7b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:22.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.342+0000 7fb900b99700 1 -- 172.21.15.154:0/477455663 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800b640 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.342+0000 7fb900b99700 1 -- 172.21.15.154:0/477455663 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f800b7a0 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.342+0000 7fb900b99700 1 -- 172.21.15.154:0/477455663 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800bb40 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.343+0000 7fb902b9d700 1 -- 172.21.15.154:0/477455663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 msgr2=0x7fb8fc0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:22.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.343+0000 7fb902b9d700 1 --2- 172.21.15.154:0/477455663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 0x7fb8fc0cea70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80099b0 tx=0x7fb8f8009250 comp rx=0 tx=0).stop 2023-10-10T21:15:22.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.343+0000 7fb902b9d700 1 -- 172.21.15.154:0/477455663 shutdown_connections 2023-10-10T21:15:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.343+0000 7fb902b9d700 1 --2- 172.21.15.154:0/477455663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc1591e0 0x7fb8fc159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.343+0000 7fb902b9d700 1 --2- 172.21.15.154:0/477455663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 0x7fb8fc0cea70 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.343+0000 7fb902b9d700 1 --2- 172.21.15.154:0/477455663 >> v2:172.21.15.179:3300/0 conn(0x7fb8fc0b0790 0x7fb8fc0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.343+0000 7fb902b9d700 1 -- 172.21.15.154:0/477455663 >> 172.21.15.154:0/477455663 conn(0x7fb8fc063230 msgr2=0x7fb8fc063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.343+0000 7fb902b9d700 1 -- 172.21.15.154:0/477455663 shutdown_connections 2023-10-10T21:15:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.343+0000 7fb902b9d700 1 -- 172.21.15.154:0/477455663 wait complete. 2023-10-10T21:15:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.344+0000 7fb902b9d700 1 Processor -- start 2023-10-10T21:15:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.345+0000 7fb902b9d700 1 -- start start 2023-10-10T21:15:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.345+0000 7fb902b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 0x7fb8fc159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.345+0000 7fb902b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc0b0790 0x7fb8fc147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.345+0000 7fb902b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8fc1591e0 0x7fb8fc0c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.345+0000 7fb902b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc16b3d0 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.345+0000 7fb902b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc16a7c0 con 0x7fb8fc1591e0 2023-10-10T21:15:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.345+0000 7fb902b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc16aaa0 con 0x7fb8fc0b0790 2023-10-10T21:15:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb901b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 0x7fb8fc159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb901b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 0x7fb8fc159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42770/0 (socket says 172.21.15.154:42770) 2023-10-10T21:15:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb901b9b700 1 -- 172.21.15.154:0/4079079634 learned_addr learned my addr 172.21.15.154:0/4079079634 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb90139a700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc0b0790 0x7fb8fc147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb90239c700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8fc1591e0 0x7fb8fc0c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb901b9b700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc0b0790 msgr2=0x7fb8fc147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb901b9b700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc0b0790 0x7fb8fc147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb901b9b700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8fc1591e0 msgr2=0x7fb8fc0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb901b9b700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8fc1591e0 0x7fb8fc0c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb901b9b700 1 -- 172.21.15.154:0/4079079634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec009420 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.346+0000 7fb901b9b700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 0x7fb8fc159c10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009fd0 tx=0x7fb8f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:22.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.347+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800bb20 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.347+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f8000c90 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.347+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8011630 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.347+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f80094f0 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.347+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8fc16b060 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.348+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8fc04c3c0 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.349+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb8f8011a60 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.349+0000 7fb8f1ffb700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:22.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.350+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb8f8085ba0 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.350+0000 7fb90139a700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 msgr2=0x7fb8e0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:15:22.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.350+0000 7fb90139a700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:15:22.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.354+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8f8052c00 con 0x7fb8fc0b03c0 2023-10-10T21:15:22.447 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:22.447+0000 7ffa9ce85180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:15:22.531 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:22.530+0000 7feca02ac180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:15:22.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.551+0000 7fb90139a700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 msgr2=0x7fb8e0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:15:22.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.551+0000 7fb90139a700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:15:22.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.581+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8fc16b510 con 0x7fb8e0066f80 2023-10-10T21:15:22.611 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:22.610+0000 7ffa9ce85180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:15:22.696 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:22.696+0000 7ffa9ce85180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:15:22.700 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:22.700+0000 7feca02ac180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:15:22.786 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:22.785+0000 7feca02ac180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:15:22.920 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:22.920+0000 7ffa9ce85180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:15:22.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.952+0000 7fb90139a700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 msgr2=0x7fb8e0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:15:22.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:22.952+0000 7fb90139a700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:15:23.012 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:23.011+0000 7feca02ac180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:15:23.097 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:23.097+0000 7ffa9ce85180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:15:23.192 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:23.191+0000 7ffa9ce85180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:15:23.196 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:23.196+0000 7feca02ac180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:15:23.289 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:23.288+0000 7feca02ac180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:15:23.353 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:23.353+0000 7ffa9ce85180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:15:23.452 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:23.452+0000 7feca02ac180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:15:23.453 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:23.452+0000 7ffa9ce85180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:15:23.555 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:23.554+0000 7feca02ac180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:15:23.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:23.753+0000 7fb90139a700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 msgr2=0x7fb8e0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:15:23.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:23.753+0000 7fb90139a700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T21:15:23.937 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:23.936+0000 7ffa9ce85180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:15:24.030 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:24.030+0000 7ffa9ce85180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:15:24.044 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:24.043+0000 7feca02ac180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:15:24.122 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:24.120+0000 7ffa9ce85180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:15:24.140 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:24.139+0000 7feca02ac180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:15:24.231 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:24.230+0000 7feca02ac180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:15:24.743 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:24.742+0000 7ffa9ce85180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:15:24.861 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:24.860+0000 7feca02ac180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:15:24.914 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:24.913+0000 7ffa9ce85180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:15:25.008 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:25.008+0000 7ffa9ce85180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:15:25.034 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:25.033+0000 7feca02ac180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:15:25.133 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:25.132+0000 7feca02ac180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:15:25.305 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:25.304+0000 7ffa9ce85180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:15:25.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:25.355+0000 7fb90139a700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 msgr2=0x7fb8e0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:15:25.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:25.355+0000 7fb90139a700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T21:15:25.401 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:25.400+0000 7ffa9ce85180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:15:25.430 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:25.429+0000 7feca02ac180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:15:25.528 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:25.527+0000 7feca02ac180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:15:26.100 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:26.099+0000 7ffa9ce85180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:15:26.241 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:26.240+0000 7feca02ac180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:15:26.387 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:26.386+0000 7ffa9ce85180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:15:26.478 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:26.478+0000 7ffa9ce85180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:15:26.530 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:26.529+0000 7feca02ac180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:15:26.625 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:26.624+0000 7feca02ac180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:15:26.630 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:26.629+0000 7ffa9ce85180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:15:26.734 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:26.733+0000 7ffa9ce85180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:15:26.781 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:26.780+0000 7feca02ac180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:15:26.888 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:26.887+0000 7feca02ac180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:15:26.920 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:26.920+0000 7ffa9ce85180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:15:27.011 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:27.011+0000 7ffa9ce85180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:15:27.081 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.080+0000 7feca02ac180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:15:27.101 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:27.101+0000 7ffa9ce85180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:15:27.175 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.174+0000 7feca02ac180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:15:27.192 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:15:27.192+0000 7ffa9ce85180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:15:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:27.251+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 19) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb8f8052fd0 con 0x7fb8fc0b03c0 2023-10-10T21:15:27.271 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.270+0000 7feca02ac180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:15:27.367 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.366+0000 7feca02ac180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:15:27.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:27.380+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mgrmap(e 20) v1 ==== 84468+0+0 (secure 0 0 0) 0x7fb8f8059d70 con 0x7fb8fc0b03c0 2023-10-10T21:15:27.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:27.381+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 msgr2=0x7fb8e0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:15:27.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:27.381+0000 7fb8f1ffb700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:27.506 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.504+0000 7fec115ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:27.506 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.504+0000 7fec115ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:27.506 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.504+0000 7fec115ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:27.507 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.504+0000 7fec115ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:27.507 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.504+0000 7fec115ef700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:27.507 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.505+0000 7fec155f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:27.507 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.505+0000 7fec155f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:27.507 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.505+0000 7fec155f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:27.507 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.505+0000 7fec155f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:27.508 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:15:27.505+0000 7fec155f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:15:28.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.384+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mon.0 v2:172.21.15.154:3300/0 9 ==== mgrmap(e 21) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fb8f801dd50 con 0x7fb8fc0b03c0 2023-10-10T21:15:28.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.384+0000 7fb8f1ffb700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:28.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.384+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8e0033140 con 0x7fb8e0066f80 2023-10-10T21:15:28.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.386+0000 7fb90139a700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:28.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.391+0000 7fb90139a700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e00693b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc16a5d0 tx=0x7fb8ec0091a0 comp rx=0 tx=0).ready entity=mgr.5955 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:28.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.455+0000 7fb8f1ffb700 1 -- 172.21.15.154:0/4079079634 <== mgr.5955 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb8e0033140 con 0x7fb8e0066f80 2023-10-10T21:15:28.457 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path snap_test_dir1 2023-10-10T21:15:28.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 msgr2=0x7fb8e00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:28.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e00693b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc16a5d0 tx=0x7fb8ec0091a0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 msgr2=0x7fb8fc159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 0x7fb8fc159c10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009fd0 tx=0x7fb8f8017000 comp rx=0 tx=0).stop 2023-10-10T21:15:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 shutdown_connections 2023-10-10T21:15:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb8e0066f80 0x7fb8e00693b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8fc1591e0 0x7fb8fc0c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc0b03c0 0x7fb8fc159c10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 --2- 172.21.15.154:0/4079079634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8fc0b0790 0x7fb8fc147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 >> 172.21.15.154:0/4079079634 conn(0x7fb8fc063230 msgr2=0x7fb8fc0d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 shutdown_connections 2023-10-10T21:15:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.458+0000 7fb902b9d700 1 -- 172.21.15.154:0/4079079634 wait complete. 2023-10-10T21:15:28.477 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-10T21:15:28.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-10-10T21:15:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.664+0000 7f79eb9ff700 1 Processor -- start 2023-10-10T21:15:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.665+0000 7f79eb9ff700 1 -- start start 2023-10-10T21:15:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.666+0000 7f79eb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069a50 0x7f79e40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.666+0000 7f79eb9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79e40c8490 0x7f79e415a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.666+0000 7f79eb9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e40ac030 con 0x7f79e4069e20 2023-10-10T21:15:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.666+0000 7f79eb9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e40ab820 con 0x7f79e40c8490 2023-10-10T21:15:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.666+0000 7f79eb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e406dbb0 con 0x7f79e4069a50 2023-10-10T21:15:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.666+0000 7f79e8f9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79e40c8490 0x7f79e415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.666+0000 7f79e8f9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79e40c8490 0x7f79e415a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42514/0 (socket says 172.21.15.154:42514) 2023-10-10T21:15:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.666+0000 7f79e8f9a700 1 -- 172.21.15.154:0/3028847294 learned_addr learned my addr 172.21.15.154:0/3028847294 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.666+0000 7f79e979b700 1 --2- 172.21.15.154:0/3028847294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069a50 0x7f79e40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.667+0000 7f79e8f9a700 1 -- 172.21.15.154:0/3028847294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069a50 msgr2=0x7f79e40c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.667+0000 7f79e8f9a700 1 --2- 172.21.15.154:0/3028847294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069a50 0x7f79e40c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.667+0000 7f79e8f9a700 1 -- 172.21.15.154:0/3028847294 >> v1:172.21.15.179:6789/0 conn(0x7f79e4069e20 legacy=0x7f79e406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.667+0000 7f79dbfff700 1 -- 172.21.15.154:0/3028847294 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311868645 0 0) 0x7f79dc001490 con 0x7f79e4069e20 2023-10-10T21:15:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.667+0000 7f79e8f9a700 1 -- 172.21.15.154:0/3028847294 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e415a9d0 con 0x7f79e40c8490 2023-10-10T21:15:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.667+0000 7f79e8f9a700 1 --2- 172.21.15.154:0/3028847294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 0x7f79e415a490 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f79d40099e0 tx=0x7f79d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510b5385b904ced1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.667+0000 7f79dbfff700 1 -- 172.21.15.154:0/3028847294 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d400b820 con 0x7f79e40c8490 2023-10-10T21:15:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.667+0000 7f79dbfff700 1 -- 172.21.15.154:0/3028847294 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d400b980 con 0x7f79e40c8490 2023-10-10T21:15:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.667+0000 7f79dbfff700 1 -- 172.21.15.154:0/3028847294 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d400bd20 con 0x7f79e40c8490 2023-10-10T21:15:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.668+0000 7f79eb9ff700 1 -- 172.21.15.154:0/3028847294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 msgr2=0x7f79e415a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.668+0000 7f79eb9ff700 1 --2- 172.21.15.154:0/3028847294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 0x7f79e415a490 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f79d40099e0 tx=0x7f79d4009250 comp rx=0 tx=0).stop 2023-10-10T21:15:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.668+0000 7f79eb9ff700 1 -- 172.21.15.154:0/3028847294 shutdown_connections 2023-10-10T21:15:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.668+0000 7f79eb9ff700 1 --2- 172.21.15.154:0/3028847294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069a50 0x7f79e40c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.668+0000 7f79eb9ff700 1 --2- 172.21.15.154:0/3028847294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 0x7f79e415a490 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.668+0000 7f79eb9ff700 1 -- 172.21.15.154:0/3028847294 >> 172.21.15.154:0/3028847294 conn(0x7f79e40c8f90 msgr2=0x7f79e40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.668+0000 7f79eb9ff700 1 -- 172.21.15.154:0/3028847294 shutdown_connections 2023-10-10T21:15:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.668+0000 7f79eb9ff700 1 -- 172.21.15.154:0/3028847294 wait complete. 2023-10-10T21:15:28.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.669+0000 7f79eb9ff700 1 Processor -- start 2023-10-10T21:15:28.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.669+0000 7f79eb9ff700 1 -- start start 2023-10-10T21:15:28.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.670+0000 7f79eb9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e4069a50 0x7f79e414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:28.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.670+0000 7f79eb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069e20 0x7f79e414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:28.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.670+0000 7f79eb9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 0x7f79e414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:28.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.670+0000 7f79eb9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40bfad0 con 0x7f79e40c8490 2023-10-10T21:15:28.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.670+0000 7f79eb9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40c08f0 con 0x7f79e4069a50 2023-10-10T21:15:28.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.670+0000 7f79eb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40bfce0 con 0x7f79e4069e20 2023-10-10T21:15:28.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e9f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 0x7f79e414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e9f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 0x7f79e414e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42520/0 (socket says 172.21.15.154:42520) 2023-10-10T21:15:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e9f9c700 1 -- 172.21.15.154:0/275618144 learned_addr learned my addr 172.21.15.154:0/275618144 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e979b700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e4069a50 0x7f79e414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e8f9a700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069e20 0x7f79e414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e9f9c700 1 -- 172.21.15.154:0/275618144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069e20 msgr2=0x7f79e414df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e9f9c700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069e20 0x7f79e414df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e9f9c700 1 -- 172.21.15.154:0/275618144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e4069a50 msgr2=0x7f79e414f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e9f9c700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e4069a50 0x7f79e414f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e9f9c700 1 -- 172.21.15.154:0/275618144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40094f0 con 0x7f79e40c8490 2023-10-10T21:15:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e979b700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e4069a50 0x7f79e414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.671+0000 7f79e9f9c700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 0x7f79e414e4c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00c950 tx=0x7f79dc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.672+0000 7f79d97fa700 1 -- 172.21.15.154:0/275618144 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc012630 con 0x7f79e40c8490 2023-10-10T21:15:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.672+0000 7f79d97fa700 1 -- 172.21.15.154:0/275618144 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc012790 con 0x7f79e40c8490 2023-10-10T21:15:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.672+0000 7f79d97fa700 1 -- 172.21.15.154:0/275618144 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc012b50 con 0x7f79e40c8490 2023-10-10T21:15:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.672+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e40bffc0 con 0x7f79e40c8490 2023-10-10T21:15:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.672+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e40c0580 con 0x7f79e40c8490 2023-10-10T21:15:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.673+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e40c0a80 con 0x7f79e40c8490 2023-10-10T21:15:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.673+0000 7f79d97fa700 1 -- 172.21.15.154:0/275618144 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 21) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f79dc003030 con 0x7f79e40c8490 2023-10-10T21:15:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.674+0000 7f79d97fa700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f79c8066dd0 0x7f79c8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.674+0000 7f79d97fa700 1 -- 172.21.15.154:0/275618144 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6327+0+0 (secure 0 0 0) 0x7f79dc084430 con 0x7f79e40c8490 2023-10-10T21:15:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.675+0000 7f79e979b700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f79c8066dd0 0x7f79c8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.675+0000 7f79e979b700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f79c8066dd0 0x7f79c8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f79e4152980 tx=0x7f79e0008040 comp rx=0 tx=0).ready entity=mgr.5955 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.679+0000 7f79d97fa700 1 -- 172.21.15.154:0/275618144 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79dc051610 con 0x7f79e40c8490 2023-10-10T21:15:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.896+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f79e40ac030 con 0x7f79c8066dd0 2023-10-10T21:15:28.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.950+0000 7f79d97fa700 1 -- 172.21.15.154:0/275618144 <== mgr.5955 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f79e40ac030 con 0x7f79c8066dd0 2023-10-10T21:15:28.952 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path snap_test_dir1 2023-10-10T21:15:28.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f79c8066dd0 msgr2=0x7f79c8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:28.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f79c8066dd0 0x7f79c8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f79e4152980 tx=0x7f79e0008040 comp rx=0 tx=0).stop 2023-10-10T21:15:28.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 msgr2=0x7f79e414e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:28.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 0x7f79e414e4c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00c950 tx=0x7f79dc007f60 comp rx=0 tx=0).stop 2023-10-10T21:15:28.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 shutdown_connections 2023-10-10T21:15:28.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79e40c8490 0x7f79e414e4c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f79c8066dd0 0x7f79c8069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e4069a50 0x7f79e414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 --2- 172.21.15.154:0/275618144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e4069e20 0x7f79e414df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:28.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 >> 172.21.15.154:0/275618144 conn(0x7f79e40c8f90 msgr2=0x7f79e41568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:28.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 shutdown_connections 2023-10-10T21:15:28.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:28.953+0000 7f79eb9ff700 1 -- 172.21.15.154:0/275618144 wait complete. 2023-10-10T21:15:28.972 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-10T21:15:28.972 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-10-21_16_00 in ~32s... 2023-10-10T21:15:28.973 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-10-21_17_00 in ~92s... 2023-10-10T21:15:28.973 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-10-10T21:15:28.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-10T21:15:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.161+0000 7f6ab5fff700 1 Processor -- start 2023-10-10T21:15:29.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.161+0000 7f6ab5fff700 1 -- start start 2023-10-10T21:15:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6ab5fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6ab0159ec0 0x7f6ab00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6ab5fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ab00b53d0 0x7f6ab00cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6ab5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab00cce40 0x7f6ab00cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6ab5fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00b5b00 con 0x7f6ab00b53d0 2023-10-10T21:15:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6ab5fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00b5850 con 0x7f6ab0159ec0 2023-10-10T21:15:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6ab5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00b5da0 con 0x7f6ab00cce40 2023-10-10T21:15:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aa7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ab00b53d0 0x7f6ab00cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aa7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ab00b53d0 0x7f6ab00cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42524/0 (socket says 172.21.15.154:42524) 2023-10-10T21:15:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aa7fff700 1 -- 172.21.15.154:0/3779009858 learned_addr learned my addr 172.21.15.154:0/3779009858 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aaffff700 1 --2- 172.21.15.154:0/3779009858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab00cce40 0x7f6ab00cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aaf7fe700 1 --2- 172.21.15.154:0/3779009858 >> v2:172.21.15.179:3300/0 conn(0x7f6ab0159ec0 0x7f6ab00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aa7fff700 1 -- 172.21.15.154:0/3779009858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab00cce40 msgr2=0x7f6ab00cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aa7fff700 1 --2- 172.21.15.154:0/3779009858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab00cce40 0x7f6ab00cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aa7fff700 1 -- 172.21.15.154:0/3779009858 >> v2:172.21.15.179:3300/0 conn(0x7f6ab0159ec0 msgr2=0x7f6ab00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:15:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aa7fff700 1 --2- 172.21.15.154:0/3779009858 >> v2:172.21.15.179:3300/0 conn(0x7f6ab0159ec0 0x7f6ab00b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aa7fff700 1 -- 172.21.15.154:0/3779009858 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00b6080 con 0x7f6ab00b53d0 2023-10-10T21:15:29.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aaffff700 1 --2- 172.21.15.154:0/3779009858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab00cce40 0x7f6ab00cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:15:29.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.163+0000 7f6aaf7fe700 1 --2- 172.21.15.154:0/3779009858 >> v2:172.21.15.179:3300/0 conn(0x7f6ab0159ec0 0x7f6ab00b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:15:29.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.164+0000 7f6aa7fff700 1 --2- 172.21.15.154:0/3779009858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 0x7f6ab00cc900 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0089120 tx=0x7f6a98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0dad4279a09202 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:29.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.164+0000 7f6aaeffd700 1 -- 172.21.15.154:0/3779009858 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800b860 con 0x7f6ab00b53d0 2023-10-10T21:15:29.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.164+0000 7f6aaeffd700 1 -- 172.21.15.154:0/3779009858 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9800b9c0 con 0x7f6ab00b53d0 2023-10-10T21:15:29.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.164+0000 7f6aaeffd700 1 -- 172.21.15.154:0/3779009858 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800bd60 con 0x7f6ab00b53d0 2023-10-10T21:15:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.164+0000 7f6ab5fff700 1 -- 172.21.15.154:0/3779009858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 msgr2=0x7f6ab00cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.164+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/3779009858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 0x7f6ab00cc900 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0089120 tx=0x7f6a98009250 comp rx=0 tx=0).stop 2023-10-10T21:15:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.165+0000 7f6ab5fff700 1 -- 172.21.15.154:0/3779009858 shutdown_connections 2023-10-10T21:15:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.165+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/3779009858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab00cce40 0x7f6ab00cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.165+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/3779009858 >> v2:172.21.15.179:3300/0 conn(0x7f6ab0159ec0 0x7f6ab00b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.165+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/3779009858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 0x7f6ab00cc900 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.165+0000 7f6ab5fff700 1 -- 172.21.15.154:0/3779009858 >> 172.21.15.154:0/3779009858 conn(0x7f6ab00999f0 msgr2=0x7f6ab00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.165+0000 7f6ab5fff700 1 -- 172.21.15.154:0/3779009858 shutdown_connections 2023-10-10T21:15:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.165+0000 7f6ab5fff700 1 -- 172.21.15.154:0/3779009858 wait complete. 2023-10-10T21:15:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.166+0000 7f6ab5fff700 1 Processor -- start 2023-10-10T21:15:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.166+0000 7f6ab5fff700 1 -- start start 2023-10-10T21:15:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6ab5fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 0x7f6ab0068c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6ab5fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab00cce40 0x7f6ab01570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6ab5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab0159ec0 0x7f6ab009b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6ab5fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab006a130 con 0x7f6ab00b53d0 2023-10-10T21:15:29.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6ab5fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0069520 con 0x7f6ab00cce40 2023-10-10T21:15:29.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6ab5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0069800 con 0x7f6ab0159ec0 2023-10-10T21:15:29.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 0x7f6ab0068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:29.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 0x7f6ab0068c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42526/0 (socket says 172.21.15.154:42526) 2023-10-10T21:15:29.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6aaf7fe700 1 -- 172.21.15.154:0/2239953253 learned_addr learned my addr 172.21.15.154:0/2239953253 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:15:29.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6aaffff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab0159ec0 0x7f6ab009b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:29.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.167+0000 7f6aa7fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab00cce40 0x7f6ab01570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:29.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aaf7fe700 1 -- 172.21.15.154:0/2239953253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab0159ec0 msgr2=0x7f6ab009b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:29.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aaf7fe700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab0159ec0 0x7f6ab009b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aaf7fe700 1 -- 172.21.15.154:0/2239953253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab00cce40 msgr2=0x7f6ab01570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aaf7fe700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab00cce40 0x7f6ab01570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aaf7fe700 1 -- 172.21.15.154:0/2239953253 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a980094f0 con 0x7f6ab00b53d0 2023-10-10T21:15:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aa7fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab00cce40 0x7f6ab01570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:15:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aaf7fe700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 0x7f6ab0068c60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c880 tx=0x7f6aa0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aa77fe700 1 -- 172.21.15.154:0/2239953253 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0005a00 con 0x7f6ab00b53d0 2023-10-10T21:15:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aa77fe700 1 -- 172.21.15.154:0/2239953253 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0005b60 con 0x7f6ab00b53d0 2023-10-10T21:15:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6aa77fe700 1 -- 172.21.15.154:0/2239953253 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0011600 con 0x7f6ab00b53d0 2023-10-10T21:15:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab0069ae0 con 0x7f6ab00b53d0 2023-10-10T21:15:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.168+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab006a5c0 con 0x7f6ab00b53d0 2023-10-10T21:15:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.169+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab0063c90 con 0x7f6ab00b53d0 2023-10-10T21:15:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.170+0000 7f6aa77fe700 1 -- 172.21.15.154:0/2239953253 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 21) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f6aa00119f0 con 0x7f6ab00b53d0 2023-10-10T21:15:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.171+0000 7f6aa77fe700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6a90066dd0 0x7f6a90069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:15:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.171+0000 7f6aa77fe700 1 -- 172.21.15.154:0/2239953253 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6327+0+0 (secure 0 0 0) 0x7f6aa0084360 con 0x7f6ab00b53d0 2023-10-10T21:15:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.171+0000 7f6aa7fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6a90066dd0 0x7f6a90069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:15:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.172+0000 7f6aa7fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6a90066dd0 0x7f6a90069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0089120 tx=0x7f6a98017000 comp rx=0 tx=0).ready entity=mgr.5955 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:15:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.175+0000 7f6aa77fe700 1 -- 172.21.15.154:0/2239953253 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6aa0051540 con 0x7f6ab00b53d0 2023-10-10T21:15:29.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.390+0000 7f6aa77fe700 1 -- 172.21.15.154:0/2239953253 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 22) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f6aa0051910 con 0x7f6ab00b53d0 2023-10-10T21:15:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.395+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ab006a270 con 0x7f6a90066dd0 2023-10-10T21:15:29.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.403+0000 7f6aa77fe700 1 -- 172.21.15.154:0/2239953253 <== mgr.5955 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f6a9800bbc0 con 0x7f6a90066dd0 2023-10-10T21:15:29.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:15:29.405 INFO:teuthology.orchestra.run.smithi154.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-10T21:15:29.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6a90066dd0 msgr2=0x7f6a90069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:29.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6a90066dd0 0x7f6a90069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0089120 tx=0x7f6a98017000 comp rx=0 tx=0).stop 2023-10-10T21:15:29.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 msgr2=0x7f6ab0068c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:15:29.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 0x7f6ab0068c60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c880 tx=0x7f6aa0008040 comp rx=0 tx=0).stop 2023-10-10T21:15:29.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 shutdown_connections 2023-10-10T21:15:29.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab0159ec0 0x7f6ab009b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ab00b53d0 0x7f6ab0068c60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6a90066dd0 0x7f6a90069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 --2- 172.21.15.154:0/2239953253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab00cce40 0x7f6ab01570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:15:29.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 >> 172.21.15.154:0/2239953253 conn(0x7f6ab00999f0 msgr2=0x7f6ab0158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:15:29.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 shutdown_connections 2023-10-10T21:15:29.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:15:29.406+0000 7f6ab5fff700 1 -- 172.21.15.154:0/2239953253 wait complete. 2023-10-10T21:15:29.424 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-10T21:15:29.425 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-10-10T21:15:29.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:29.426 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:29.465 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:29.465 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:29.466 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:30.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:30.467 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:30.511 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:30.512 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:30.512 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:31.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:31.513 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:31.557 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:31.558 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:31.558 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:32.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:32.561 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:32.604 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:32.604 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:32.605 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:33.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:33.606 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:33.650 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:33.650 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:33.651 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:34.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:34.652 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:34.696 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:34.696 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:34.696 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:35.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:35.698 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:35.742 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:35.742 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:35.743 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:36.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:36.744 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:36.787 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:36.788 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:36.788 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:37.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:37.789 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:37.833 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:37.833 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:37.833 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:38.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:38.835 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:38.879 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:38.879 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:38.880 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:39.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:39.881 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:39.925 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:39.925 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:39.926 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:40.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:40.927 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:40.971 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:40.972 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:40.972 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:41.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:41.973 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:42.017 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:42.017 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:42.017 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:43.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:43.019 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:43.063 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:43.063 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:43.064 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:44.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:44.065 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:44.109 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:44.110 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:44.110 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:45.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:45.112 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:45.155 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:45.155 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:45.155 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:46.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:46.157 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:46.201 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:46.201 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:46.201 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:47.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:47.203 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:47.246 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:47.246 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:47.247 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:48.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:48.248 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:48.292 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:48.292 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:48.292 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:48.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:15:48.803 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:15:49.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:49.294 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:49.338 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:49.338 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:49.339 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:50.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:50.341 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:50.385 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:50.386 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:50.386 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:51.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:51.388 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:51.431 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:51.432 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:51.432 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:52.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:52.434 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:52.477 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:52.478 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:52.478 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:53.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:53.480 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:53.523 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:53.524 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:53.524 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:54.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:54.526 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:54.570 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:54.570 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:54.571 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:55.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:55.572 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:55.616 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:55.616 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:55.617 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:56.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:56.619 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:56.662 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:56.663 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:56.663 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:57.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:57.665 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:57.709 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:57.709 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:57.709 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:58.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:58.712 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:58.755 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:58.755 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:58.756 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:15:59.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:15:59.758 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:15:59.799 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:15:59.799 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:15:59.799 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:00.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:00.801 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:00.845 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:16:00.845 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:00.846 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:00.964 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:16:00.963+0000 7fec045d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:16:00.965 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:16:00.963+0000 7fec045d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:16:00.965 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:16:00.963+0000 7fec045d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:16:00.965 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:16:00.963+0000 7fec045d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:16:00.965 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:16:00.963+0000 7fec045d5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:16:01.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:01.848 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:01.891 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:01.892 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:01.893 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:01.893 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:01.893 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-10-21_16_00_UTC'] 2023-10-10T21:16:01.893 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696972528.9726682, now = 1696972561.8939672, timo = 32 2023-10-10T21:16:02.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:02.895 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:02.938 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:02.939 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:02.939 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:02.940 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:03.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:03.941 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:03.984 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:03.985 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:03.985 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:03.985 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:04.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:04.988 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:05.030 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:05.031 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:05.031 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:05.032 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:06.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:06.034 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:06.077 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:06.078 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:06.079 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:06.079 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:07.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:07.081 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:07.124 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:07.125 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:07.125 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:07.126 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:08.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:08.127 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:08.169 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:08.171 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:08.171 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:08.172 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:09.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:09.175 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:09.217 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:09.219 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:09.219 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:09.219 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:10.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:10.222 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:10.264 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:10.265 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:10.265 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:10.266 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:11.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:11.268 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:11.310 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:11.311 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:11.312 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:11.312 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:12.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:12.314 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:12.356 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:12.358 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:12.358 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:12.358 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:13.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:13.361 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:13.404 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:13.405 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:13.406 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:13.406 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:14.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:14.408 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:14.450 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:14.451 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:14.451 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:14.452 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:15.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:15.454 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:15.496 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:15.497 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:15.498 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:15.498 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:16.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:16.499 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:16.542 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:16.543 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:16.543 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:16.544 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:17.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:17.545 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:17.588 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:17.589 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:17.589 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:17.590 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:18.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:18.592 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:18.636 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:18.637 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:18.637 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:18.638 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:18.908 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:16:18.914 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:16:19.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:19.641 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:19.684 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:19.685 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:19.685 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:19.685 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:20.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:20.687 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:20.729 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:20.731 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:20.731 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:20.731 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:21.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:21.733 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:21.776 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:21.778 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:21.778 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:21.779 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:22.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:22.781 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:22.823 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:22.824 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:22.825 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:22.825 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:23.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:23.826 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:23.868 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:23.869 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:23.870 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:23.870 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:24.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:24.871 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:24.914 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:24.915 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:24.915 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:24.916 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:25.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:25.918 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:25.960 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:25.961 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:25.962 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:25.962 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:26.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:26.963 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:27.006 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:27.007 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:27.007 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:27.008 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:28.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:28.010 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:28.052 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:28.053 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:28.054 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:28.054 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:29.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:29.055 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:29.097 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:29.099 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:29.099 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:29.099 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:30.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:30.101 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:30.143 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:30.144 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:30.145 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:30.145 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:31.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:31.146 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:31.189 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:31.190 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:31.191 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:31.191 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:32.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:32.193 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:32.235 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:32.236 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:32.237 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:32.237 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:33.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:33.239 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:33.281 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:33.283 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:33.283 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:33.283 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:34.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:34.285 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:34.329 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:34.330 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:34.330 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:34.331 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:35.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:35.332 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:35.375 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:35.376 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:35.376 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:35.376 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:36.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:36.379 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:36.420 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:36.421 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:36.422 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:36.422 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:37.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:37.424 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:37.467 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:37.469 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:37.469 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:37.470 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:38.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:38.471 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:38.515 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:38.516 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:38.516 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:38.517 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:39.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:39.518 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:39.562 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:39.563 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:39.563 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:39.563 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:40.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:40.565 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:40.608 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:40.609 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:40.610 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:40.610 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:41.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:41.612 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:41.654 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:41.656 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:41.656 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:41.656 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:42.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:42.657 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:42.700 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:42.701 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:42.701 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:42.702 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:43.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:43.703 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:43.746 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:43.747 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:43.747 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:43.748 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:44.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:44.749 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:44.791 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:45.063 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:45.064 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:45.064 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:46.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:46.066 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:46.109 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:46.110 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:46.111 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:46.111 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:47.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:47.112 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:47.155 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:47.156 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:47.156 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:47.156 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:48.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:48.158 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:48.200 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:48.201 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:48.202 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:48.202 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:49.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:16:49.044 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:16:49.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:49.204 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:49.243 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:49.244 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:49.245 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:49.245 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:50.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:50.246 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:50.290 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:50.291 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:50.291 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:50.292 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:51.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:51.293 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:51.336 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:51.337 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:51.337 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:51.338 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:52.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:52.339 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:52.381 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:52.383 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:52.384 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:52.385 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:53.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:53.387 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:53.434 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:53.435 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:53.435 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:53.436 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:54.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:54.437 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:54.480 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:54.482 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:54.482 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:54.483 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:55.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:55.484 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:55.526 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:55.528 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:55.528 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:55.528 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:56.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:56.530 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:56.572 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:56.573 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:56.574 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:56.574 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:57.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:57.576 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:57.618 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:57.619 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:57.620 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:57.620 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:58.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:58.622 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:58.664 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:58.665 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:58.666 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:58.666 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:16:59.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:16:59.668 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:16:59.710 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:16:59.712 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC'} 2023-10-10T21:16:59.712 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:16:59.713 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:17:00.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:17:00.715 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:17:00.756 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:17:00.757 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_17_00_UTC 2023-10-10T21:17:00.758 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_16_00_UTC', 'scheduled-2023-10-10-21_17_00_UTC'} 2023-10-10T21:17:00.759 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-10-21_17_00_UTC'} 2023-10-10T21:17:00.759 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:17:00.760 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-10-21_17_00_UTC'] 2023-10-10T21:17:00.760 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696972528.9726682, now = 1696972620.760449, timo = 92 2023-10-10T21:17:01.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-10T21:17:01.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.955+0000 7f7ac99ff700 1 Processor -- start 2023-10-10T21:17:01.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.956+0000 7f7ac99ff700 1 -- start start 2023-10-10T21:17:01.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.957+0000 7f7ac99ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ac40c8490 0x7f7ac40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:01.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.957+0000 7f7ac99ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ac4069e20 0x7f7ac41569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:01.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.957+0000 7f7ac99ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac40ac030 con 0x7f7ac4069a50 2023-10-10T21:17:01.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.957+0000 7f7ac99ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac40ab820 con 0x7f7ac40c8490 2023-10-10T21:17:01.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.957+0000 7f7ac99ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac406dbb0 con 0x7f7ac4069e20 2023-10-10T21:17:01.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.957+0000 7f7abbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ac40c8490 0x7f7ac40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:01.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.957+0000 7f7abbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ac40c8490 0x7f7ac40c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33096/0 (socket says 172.21.15.154:33096) 2023-10-10T21:17:01.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.957+0000 7f7abbfff700 1 -- 172.21.15.154:0/1124680156 learned_addr learned my addr 172.21.15.154:0/1124680156 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:01.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.957+0000 7f7ac37fe700 1 --2- 172.21.15.154:0/1124680156 >> v2:172.21.15.179:3300/0 conn(0x7f7ac4069e20 0x7f7ac41569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:01.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.958+0000 7f7abbfff700 1 -- 172.21.15.154:0/1124680156 >> v2:172.21.15.179:3300/0 conn(0x7f7ac4069e20 msgr2=0x7f7ac41569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:01.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.958+0000 7f7abbfff700 1 --2- 172.21.15.154:0/1124680156 >> v2:172.21.15.179:3300/0 conn(0x7f7ac4069e20 0x7f7ac41569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:01.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.958+0000 7f7abbfff700 1 -- 172.21.15.154:0/1124680156 >> v1:172.21.15.179:6789/0 conn(0x7f7ac4069a50 legacy=0x7f7ac415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:01.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.958+0000 7f7abbfff700 1 -- 172.21.15.154:0/1124680156 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40aba70 con 0x7f7ac40c8490 2023-10-10T21:17:01.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.958+0000 7f7ac37fe700 1 --2- 172.21.15.154:0/1124680156 >> v2:172.21.15.179:3300/0 conn(0x7f7ac4069e20 0x7f7ac41569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:17:01.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.958+0000 7f7abbfff700 1 --2- 172.21.15.154:0/1124680156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac40c8490 0x7f7ac40c6ac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7ac406db20 tx=0x7f7aac00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ae69b312848d49 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:01.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.958+0000 7f7ac27fc700 1 -- 172.21.15.154:0/1124680156 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00ca00 con 0x7f7ac40c8490 2023-10-10T21:17:01.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.958+0000 7f7ac27fc700 1 -- 172.21.15.154:0/1124680156 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00cb60 con 0x7f7ac40c8490 2023-10-10T21:17:01.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.958+0000 7f7ac27fc700 1 -- 172.21.15.154:0/1124680156 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0183f0 con 0x7f7ac40c8490 2023-10-10T21:17:01.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.959+0000 7f7ac99ff700 1 -- 172.21.15.154:0/1124680156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac40c8490 msgr2=0x7f7ac40c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:01.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.959+0000 7f7ac99ff700 1 --2- 172.21.15.154:0/1124680156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac40c8490 0x7f7ac40c6ac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7ac406db20 tx=0x7f7aac00a3f0 comp rx=0 tx=0).stop 2023-10-10T21:17:01.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.959+0000 7f7ac99ff700 1 -- 172.21.15.154:0/1124680156 shutdown_connections 2023-10-10T21:17:01.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.959+0000 7f7ac99ff700 1 --2- 172.21.15.154:0/1124680156 >> v2:172.21.15.179:3300/0 conn(0x7f7ac4069e20 0x7f7ac41569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:01.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.959+0000 7f7ac99ff700 1 --2- 172.21.15.154:0/1124680156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac40c8490 0x7f7ac40c6ac0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:01.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.959+0000 7f7ac99ff700 1 -- 172.21.15.154:0/1124680156 >> 172.21.15.154:0/1124680156 conn(0x7f7ac40c8f90 msgr2=0x7f7ac40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:01.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.959+0000 7f7ac99ff700 1 -- 172.21.15.154:0/1124680156 shutdown_connections 2023-10-10T21:17:01.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.959+0000 7f7ac99ff700 1 -- 172.21.15.154:0/1124680156 wait complete. 2023-10-10T21:17:01.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.960+0000 7f7ac99ff700 1 Processor -- start 2023-10-10T21:17:01.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.960+0000 7f7ac99ff700 1 -- start start 2023-10-10T21:17:01.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.961+0000 7f7ac99ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac4069a50 0x7f7ac40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:01.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.961+0000 7f7ac99ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac4069e20 0x7f7ac4159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:01.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.961+0000 7f7ac99ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac40c8490 0x7f7ac4154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:01.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.961+0000 7f7ac99ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40aab60 con 0x7f7ac4069a50 2023-10-10T21:17:01.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.961+0000 7f7ac99ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40a9f50 con 0x7f7ac4069e20 2023-10-10T21:17:01.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.961+0000 7f7ac99ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40aa230 con 0x7f7ac40c8490 2023-10-10T21:17:01.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac4069a50 0x7f7ac40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:01.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac4069a50 0x7f7ac40a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33100/0 (socket says 172.21.15.154:33100) 2023-10-10T21:17:01.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac2ffd700 1 -- 172.21.15.154:0/754846901 learned_addr learned my addr 172.21.15.154:0/754846901 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:01.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7abbfff700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac4069e20 0x7f7ac4159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:01.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac37fe700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac40c8490 0x7f7ac4154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:01.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac2ffd700 1 -- 172.21.15.154:0/754846901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac40c8490 msgr2=0x7f7ac4154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:01.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac2ffd700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac40c8490 0x7f7ac4154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:01.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac2ffd700 1 -- 172.21.15.154:0/754846901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac4069e20 msgr2=0x7f7ac4159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:01.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac2ffd700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac4069e20 0x7f7ac4159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:01.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac2ffd700 1 -- 172.21.15.154:0/754846901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac00a690 con 0x7f7ac4069a50 2023-10-10T21:17:01.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7ac2ffd700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac4069a50 0x7f7ac40a98e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400b5e0 tx=0x7f7ab4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:01.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.962+0000 7f7abaffd700 1 -- 172.21.15.154:0/754846901 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400f510 con 0x7f7ac4069a50 2023-10-10T21:17:01.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.963+0000 7f7abaffd700 1 -- 172.21.15.154:0/754846901 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab400f670 con 0x7f7ac4069a50 2023-10-10T21:17:01.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.963+0000 7f7abaffd700 1 -- 172.21.15.154:0/754846901 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400fa30 con 0x7f7ac4069a50 2023-10-10T21:17:01.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.963+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac40aa510 con 0x7f7ac4069a50 2023-10-10T21:17:01.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.963+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac41551b0 con 0x7f7ac4069a50 2023-10-10T21:17:01.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.964+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac40718b0 con 0x7f7ac4069a50 2023-10-10T21:17:01.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.965+0000 7f7abaffd700 1 -- 172.21.15.154:0/754846901 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 24) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f7ab401a400 con 0x7f7ac4069a50 2023-10-10T21:17:01.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.965+0000 7f7abaffd700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7aa40670a0 0x7f7aa4069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:01.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.966+0000 7f7abaffd700 1 -- 172.21.15.154:0/754846901 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f7ab4084590 con 0x7f7ac4069a50 2023-10-10T21:17:01.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.966+0000 7f7abbfff700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7aa40670a0 0x7f7aa4069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:01.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.966+0000 7f7abbfff700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7aa40670a0 0x7f7aa4069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ac406db20 tx=0x7f7aac017000 comp rx=0 tx=0).ready entity=mgr.5955 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:01.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:01.970+0000 7f7abaffd700 1 -- 172.21.15.154:0/754846901 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ab4051420 con 0x7f7ac4069a50 2023-10-10T21:17:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.188+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ac40aaca0 con 0x7f7aa40670a0 2023-10-10T21:17:02.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.257+0000 7f7abaffd700 1 -- 172.21.15.154:0/754846901 <== mgr.5955 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7aac01f040 con 0x7f7aa40670a0 2023-10-10T21:17:02.258 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path snap_test_dir1 2023-10-10T21:17:02.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7aa40670a0 msgr2=0x7f7aa4069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:02.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7aa40670a0 0x7f7aa4069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ac406db20 tx=0x7f7aac017000 comp rx=0 tx=0).stop 2023-10-10T21:17:02.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac4069a50 msgr2=0x7f7ac40a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:02.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac4069a50 0x7f7ac40a98e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400b5e0 tx=0x7f7ab4009120 comp rx=0 tx=0).stop 2023-10-10T21:17:02.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 shutdown_connections 2023-10-10T21:17:02.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac40c8490 0x7f7ac4154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:02.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac4069a50 0x7f7ac40a98e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:02.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7aa40670a0 0x7f7aa4069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:02.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 --2- 172.21.15.154:0/754846901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac4069e20 0x7f7ac4159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:02.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.259+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 >> 172.21.15.154:0/754846901 conn(0x7f7ac40c8f90 msgr2=0x7f7ac40cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:02.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.260+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 shutdown_connections 2023-10-10T21:17:02.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.260+0000 7f7ac99ff700 1 -- 172.21.15.154:0/754846901 wait complete. 2023-10-10T21:17:02.278 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-10T21:17:02.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:17:02.279 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:17:02.316 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:17:02.316 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_17_00_UTC 2023-10-10T21:17:02.317 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_16_00_UTC 2023-10-10T21:17:02.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:17:02.318 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_16_00_UTC) 2023-10-10T21:17:02.400 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_17_00_UTC 2023-10-10T21:17:02.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:17:02.401 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_17_00_UTC) 2023-10-10T21:17:02.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:17:02.484 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-10T21:17:02.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T21:17:02.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.786+0000 7f243499d700 1 Processor -- start 2023-10-10T21:17:02.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.786+0000 7f243499d700 1 -- start start 2023-10-10T21:17:02.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.787+0000 7f243499d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f243006f060 0x7f24300ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:02.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.787+0000 7f243499d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f243006f4b0 0x7f24300ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:02.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.787+0000 7f243499d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243006ebd0 con 0x7f24300cb1a0 2023-10-10T21:17:02.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.787+0000 7f243499d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243015b2e0 con 0x7f243006f060 2023-10-10T21:17:02.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.787+0000 7f243499d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243015aa70 con 0x7f243006f4b0 2023-10-10T21:17:02.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.787+0000 7f242effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f243006f060 0x7f24300ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:02.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.788+0000 7f242effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f243006f060 0x7f24300ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33116/0 (socket says 172.21.15.154:33116) 2023-10-10T21:17:02.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.788+0000 7f242effd700 1 -- 172.21.15.154:0/1421671907 learned_addr learned my addr 172.21.15.154:0/1421671907 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:02.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.788+0000 7f242ffff700 1 --2- 172.21.15.154:0/1421671907 >> v2:172.21.15.179:3300/0 conn(0x7f243006f4b0 0x7f24300ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:02.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.788+0000 7f242effd700 1 -- 172.21.15.154:0/1421671907 >> v2:172.21.15.179:3300/0 conn(0x7f243006f4b0 msgr2=0x7f24300ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:02.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.788+0000 7f242effd700 1 --2- 172.21.15.154:0/1421671907 >> v2:172.21.15.179:3300/0 conn(0x7f243006f4b0 0x7f24300ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:02.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.788+0000 7f242effd700 1 -- 172.21.15.154:0/1421671907 >> v1:172.21.15.179:6789/0 conn(0x7f24300cb1a0 legacy=0x7f243015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:02.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.788+0000 7f242effd700 1 -- 172.21.15.154:0/1421671907 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243015ad20 con 0x7f243006f060 2023-10-10T21:17:02.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.788+0000 7f242effd700 1 --2- 172.21.15.154:0/1421671907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f060 0x7f24300ae0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f243006d480 tx=0x7f2424009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a63bdbfaaf08369 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:02.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f242e7fc700 1 -- 172.21.15.154:0/1421671907 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424009e70 con 0x7f243006f060 2023-10-10T21:17:02.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f242e7fc700 1 -- 172.21.15.154:0/1421671907 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242400b8f0 con 0x7f243006f060 2023-10-10T21:17:02.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f242e7fc700 1 -- 172.21.15.154:0/1421671907 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242400bc90 con 0x7f243006f060 2023-10-10T21:17:02.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f243499d700 1 -- 172.21.15.154:0/1421671907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f060 msgr2=0x7f24300ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:02.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f243499d700 1 --2- 172.21.15.154:0/1421671907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f060 0x7f24300ae0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f243006d480 tx=0x7f2424009250 comp rx=0 tx=0).stop 2023-10-10T21:17:02.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f243499d700 1 -- 172.21.15.154:0/1421671907 shutdown_connections 2023-10-10T21:17:02.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f243499d700 1 --2- 172.21.15.154:0/1421671907 >> v2:172.21.15.179:3300/0 conn(0x7f243006f4b0 0x7f24300ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:02.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f243499d700 1 --2- 172.21.15.154:0/1421671907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f060 0x7f24300ae0d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:02.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f243499d700 1 -- 172.21.15.154:0/1421671907 >> 172.21.15.154:0/1421671907 conn(0x7f24300cc1e0 msgr2=0x7f24300cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:02.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f243499d700 1 -- 172.21.15.154:0/1421671907 shutdown_connections 2023-10-10T21:17:02.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.789+0000 7f243499d700 1 -- 172.21.15.154:0/1421671907 wait complete. 2023-10-10T21:17:02.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.791+0000 7f243499d700 1 Processor -- start 2023-10-10T21:17:02.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.791+0000 7f243499d700 1 -- start start 2023-10-10T21:17:02.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f243499d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243006f060 0x7f2430141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:02.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f243499d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f4b0 0x7f243015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:02.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f243499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24300cb1a0 0x7f243016d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:02.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f243499d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24301599f0 con 0x7f243006f4b0 2023-10-10T21:17:02.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f243499d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243015cb30 con 0x7f243006f060 2023-10-10T21:17:02.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f243499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243015bf20 con 0x7f24300cb1a0 2023-10-10T21:17:02.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f4b0 0x7f243015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:02.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f4b0 0x7f243015b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33118/0 (socket says 172.21.15.154:33118) 2023-10-10T21:17:02.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242effd700 1 -- 172.21.15.154:0/1156292705 learned_addr learned my addr 172.21.15.154:0/1156292705 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:02.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242f7fe700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243006f060 0x7f2430141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:02.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242ffff700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24300cb1a0 0x7f243016d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:02.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242effd700 1 -- 172.21.15.154:0/1156292705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24300cb1a0 msgr2=0x7f243016d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:02.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242effd700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24300cb1a0 0x7f243016d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:02.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242effd700 1 -- 172.21.15.154:0/1156292705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243006f060 msgr2=0x7f2430141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:02.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242effd700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243006f060 0x7f2430141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:02.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242effd700 1 -- 172.21.15.154:0/1156292705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24240094f0 con 0x7f243006f4b0 2023-10-10T21:17:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.792+0000 7f242ffff700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24300cb1a0 0x7f243016d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:17:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.793+0000 7f242effd700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f4b0 0x7f243015b4a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2424006fd0 tx=0x7f2424017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.793+0000 7f24177fe700 1 -- 172.21.15.154:0/1156292705 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242400bc70 con 0x7f243006f4b0 2023-10-10T21:17:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.793+0000 7f24177fe700 1 -- 172.21.15.154:0/1156292705 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2424024440 con 0x7f243006f4b0 2023-10-10T21:17:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.793+0000 7f24177fe700 1 -- 172.21.15.154:0/1156292705 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24240247e0 con 0x7f243006f4b0 2023-10-10T21:17:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.793+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243015c200 con 0x7f243006f4b0 2023-10-10T21:17:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.793+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243015c7c0 con 0x7f243006f4b0 2023-10-10T21:17:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.794+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24300ae760 con 0x7f243006f4b0 2023-10-10T21:17:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.795+0000 7f24177fe700 1 -- 172.21.15.154:0/1156292705 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 24) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f242401a420 con 0x7f243006f4b0 2023-10-10T21:17:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.796+0000 7f24177fe700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f241c0670a0 0x7f241c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.796+0000 7f24177fe700 1 -- 172.21.15.154:0/1156292705 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f2424086400 con 0x7f243006f4b0 2023-10-10T21:17:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.796+0000 7f242f7fe700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f241c0670a0 0x7f241c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.796+0000 7f242f7fe700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f241c0670a0 0x7f241c069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f243016eae0 tx=0x7f2420009040 comp rx=0 tx=0).ready entity=mgr.5955 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:02.800+0000 7f24177fe700 1 -- 172.21.15.154:0/1156292705 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2424053210 con 0x7f243006f4b0 2023-10-10T21:17:03.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.045+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f243015cc70 con 0x7f243006f4b0 2023-10-10T21:17:03.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.475+0000 7f24177fe700 1 -- 172.21.15.154:0/1156292705 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f24240535e0 con 0x7f243006f4b0 2023-10-10T21:17:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.476+0000 7f24177fe700 1 -- 172.21.15.154:0/1156292705 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v25) v1 ==== 93+0+0 (secure 0 0 0) 0x7f2424069720 con 0x7f243006f4b0 2023-10-10T21:17:03.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f241c0670a0 msgr2=0x7f241c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:03.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f241c0670a0 0x7f241c069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f243016eae0 tx=0x7f2420009040 comp rx=0 tx=0).stop 2023-10-10T21:17:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f4b0 msgr2=0x7f243015b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f4b0 0x7f243015b4a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2424006fd0 tx=0x7f2424017000 comp rx=0 tx=0).stop 2023-10-10T21:17:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 shutdown_connections 2023-10-10T21:17:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24300cb1a0 0x7f243016d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f241c0670a0 0x7f241c069550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243006f060 0x7f2430141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 --2- 172.21.15.154:0/1156292705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243006f4b0 0x7f243015b4a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 >> 172.21.15.154:0/1156292705 conn(0x7f24300cc1e0 msgr2=0x7f2430069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 shutdown_connections 2023-10-10T21:17:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:03.479+0000 7f243499d700 1 -- 172.21.15.154:0/1156292705 wait complete. 2023-10-10T21:17:03.500 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:17:03.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:17:03.581 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:17:03.666 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:17:03.667 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T21:17:03.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:17:03.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T21:17:03.753 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:17:03.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:17:03.754 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T21:17:03.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:04.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.017+0000 7f5666d9d700 1 Processor -- start 2023-10-10T21:17:04.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.018+0000 7f5666d9d700 1 -- start start 2023-10-10T21:17:04.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f5666d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 0x7f56600c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f5666d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56601566e0 0x7f56600ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f5666d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f56600ca300 0x7f56600ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f5666d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56600ca860 con 0x7f56601566e0 2023-10-10T21:17:04.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f5666d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56600cab40 con 0x7f56600ca300 2023-10-10T21:17:04.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f5666d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56600cae20 con 0x7f5660156310 2023-10-10T21:17:04.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f566559a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56601566e0 0x7f56600ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f566559a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56601566e0 0x7f56600ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33130/0 (socket says 172.21.15.154:33130) 2023-10-10T21:17:04.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f566559a700 1 -- 172.21.15.154:0/3056321774 learned_addr learned my addr 172.21.15.154:0/3056321774 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:04.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f566659c700 1 --2- 172.21.15.154:0/3056321774 >> v2:172.21.15.179:3300/0 conn(0x7f56600ca300 0x7f56600ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.019+0000 7f5665d9b700 1 --2- 172.21.15.154:0/3056321774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 0x7f56600c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.020+0000 7f566559a700 1 -- 172.21.15.154:0/3056321774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 msgr2=0x7f56600c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:04.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.020+0000 7f566559a700 1 --2- 172.21.15.154:0/3056321774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 0x7f56600c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.020+0000 7f566559a700 1 -- 172.21.15.154:0/3056321774 >> v2:172.21.15.179:3300/0 conn(0x7f56600ca300 msgr2=0x7f56600ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:04.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.020+0000 7f566559a700 1 --2- 172.21.15.154:0/3056321774 >> v2:172.21.15.179:3300/0 conn(0x7f56600ca300 0x7f56600ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.020+0000 7f566559a700 1 -- 172.21.15.154:0/3056321774 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600cb100 con 0x7f56601566e0 2023-10-10T21:17:04.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.020+0000 7f566559a700 1 --2- 172.21.15.154:0/3056321774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56601566e0 0x7f56600ae000 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f566006f970 tx=0x7f5650009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5fd95713f070db server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:04.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.020+0000 7f5664d99700 1 -- 172.21.15.154:0/3056321774 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000b640 con 0x7f56601566e0 2023-10-10T21:17:04.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.020+0000 7f5664d99700 1 -- 172.21.15.154:0/3056321774 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565000b7a0 con 0x7f56601566e0 2023-10-10T21:17:04.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.020+0000 7f5664d99700 1 -- 172.21.15.154:0/3056321774 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000bb60 con 0x7f56601566e0 2023-10-10T21:17:04.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.021+0000 7f5666d9d700 1 -- 172.21.15.154:0/3056321774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56601566e0 msgr2=0x7f56600ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.021+0000 7f5666d9d700 1 --2- 172.21.15.154:0/3056321774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56601566e0 0x7f56600ae000 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f566006f970 tx=0x7f5650009250 comp rx=0 tx=0).stop 2023-10-10T21:17:04.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.021+0000 7f5666d9d700 1 -- 172.21.15.154:0/3056321774 shutdown_connections 2023-10-10T21:17:04.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.021+0000 7f5666d9d700 1 --2- 172.21.15.154:0/3056321774 >> v2:172.21.15.179:3300/0 conn(0x7f56600ca300 0x7f56600ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.021+0000 7f5666d9d700 1 --2- 172.21.15.154:0/3056321774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 0x7f56600c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.021+0000 7f5666d9d700 1 --2- 172.21.15.154:0/3056321774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56601566e0 0x7f56600ae000 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.021+0000 7f5666d9d700 1 -- 172.21.15.154:0/3056321774 >> 172.21.15.154:0/3056321774 conn(0x7f56600cc1f0 msgr2=0x7f56600cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:04.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.021+0000 7f5666d9d700 1 -- 172.21.15.154:0/3056321774 shutdown_connections 2023-10-10T21:17:04.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.021+0000 7f5666d9d700 1 -- 172.21.15.154:0/3056321774 wait complete. 2023-10-10T21:17:04.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.022+0000 7f5666d9d700 1 Processor -- start 2023-10-10T21:17:04.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.023+0000 7f5666d9d700 1 -- start start 2023-10-10T21:17:04.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.023+0000 7f5666d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600ca300 0x7f56600c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.023+0000 7f5666d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 0x7f56600c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5666d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56601566e0 0x7f5660146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5666d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5660147a80 con 0x7f56600ca300 2023-10-10T21:17:04.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5666d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56600c6d10 con 0x7f56601566e0 2023-10-10T21:17:04.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5666d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56600c5ea0 con 0x7f5660156310 2023-10-10T21:17:04.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5665d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600ca300 0x7f56600c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5665d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600ca300 0x7f56600c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33134/0 (socket says 172.21.15.154:33134) 2023-10-10T21:17:04.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5665d9b700 1 -- 172.21.15.154:0/421961250 learned_addr learned my addr 172.21.15.154:0/421961250 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:04.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f566559a700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 0x7f56600c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f566659c700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56601566e0 0x7f5660146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5665d9b700 1 -- 172.21.15.154:0/421961250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 msgr2=0x7f56600c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5665d9b700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 0x7f56600c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5665d9b700 1 -- 172.21.15.154:0/421961250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56601566e0 msgr2=0x7f5660146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5665d9b700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56601566e0 0x7f5660146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5665d9b700 1 -- 172.21.15.154:0/421961250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500094f0 con 0x7f56600ca300 2023-10-10T21:17:04.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f566659c700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56601566e0 0x7f5660146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:04.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.024+0000 7f5665d9b700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600ca300 0x7f56600c4b10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f565c00ec80 tx=0x7f565c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:04.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.025+0000 7f5655ffb700 1 -- 172.21.15.154:0/421961250 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00c850 con 0x7f56600ca300 2023-10-10T21:17:04.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.025+0000 7f5655ffb700 1 -- 172.21.15.154:0/421961250 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c00c9d0 con 0x7f56600ca300 2023-10-10T21:17:04.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.025+0000 7f5655ffb700 1 -- 172.21.15.154:0/421961250 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00cd90 con 0x7f56600ca300 2023-10-10T21:17:04.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.025+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56600c6100 con 0x7f56600ca300 2023-10-10T21:17:04.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.025+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56600c66c0 con 0x7f56600ca300 2023-10-10T21:17:04.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.026+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566004c3c0 con 0x7f56600ca300 2023-10-10T21:17:04.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.027+0000 7f5655ffb700 1 -- 172.21.15.154:0/421961250 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f565c013680 con 0x7f56600ca300 2023-10-10T21:17:04.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.027+0000 7f5655ffb700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5644067050 0x7f5644069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.028+0000 7f566559a700 1 -- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5644067050 msgr2=0x7f5644069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:04.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.028+0000 7f5655ffb700 1 -- 172.21.15.154:0/421961250 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f565c084d10 con 0x7f56600ca300 2023-10-10T21:17:04.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.028+0000 7f566559a700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5644067050 0x7f5644069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:04.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.036+0000 7f5655ffb700 1 -- 172.21.15.154:0/421961250 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f565c08a020 con 0x7f56600ca300 2023-10-10T21:17:04.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.229+0000 7f566559a700 1 -- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5644067050 msgr2=0x7f5644069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:04.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.229+0000 7f566559a700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5644067050 0x7f5644069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:04.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.279+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56600cd0b0 con 0x7f56600ca300 2023-10-10T21:17:04.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.280+0000 7f5655ffb700 1 -- 172.21.15.154:0/421961250 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f565c051b20 con 0x7f56600ca300 2023-10-10T21:17:04.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:04.281 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1501601746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1501601746},{"type":"v1","addr":"172.21.15.179:6833","nonce":1501601746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4046528016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4046528016},{"type":"v1","addr":"172.21.15.179:6835","nonce":4046528016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5533,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/634585840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":634585840},{"type":"v1","addr":"172.21.15.154:6837","nonce":634585840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:15:06.545399+0000","modified":"2023-10-10T21:15:10.108541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6833/1321064128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1321064128},{"type":"v1","addr":"172.21.15.154:6833","nonce":1321064128}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-10T21:17:04.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5644067050 msgr2=0x7f5644069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:04.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5644067050 0x7f5644069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600ca300 msgr2=0x7f56600c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600ca300 0x7f56600c4b10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f565c00ec80 tx=0x7f565c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 shutdown_connections 2023-10-10T21:17:04.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5644067050 0x7f5644069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56601566e0 0x7f5660146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600ca300 0x7f56600c4b10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 --2- 172.21.15.154:0/421961250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660156310 0x7f56600c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 >> 172.21.15.154:0/421961250 conn(0x7f56600cc1f0 msgr2=0x7f56600b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:04.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 shutdown_connections 2023-10-10T21:17:04.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.282+0000 7f5666d9d700 1 -- 172.21.15.154:0/421961250 wait complete. 2023-10-10T21:17:04.286 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 22 2023-10-10T21:17:04.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.492+0000 7f9ff179d700 1 Processor -- start 2023-10-10T21:17:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.492+0000 7f9ff179d700 1 -- start start 2023-10-10T21:17:04.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.493+0000 7f9ff179d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9fec0c6c60 0x7f9fec0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.493+0000 7f9ff179d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fec06e8c0 0x7f9fec0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.493+0000 7f9ff179d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec0b1410 con 0x7f9fec1595a0 2023-10-10T21:17:04.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.493+0000 7f9ff179d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec0b2b90 con 0x7f9fec06e8c0 2023-10-10T21:17:04.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.493+0000 7f9ff179d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec063230 con 0x7f9fec0c6c60 2023-10-10T21:17:04.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.493+0000 7f9ff0f9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fec06e8c0 0x7f9fec0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.493+0000 7f9febfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9fec1595a0 0x7f9fec0b18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35438/0 (socket says 172.21.15.154:35438) 2023-10-10T21:17:04.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.494+0000 7f9febfff700 1 -- 172.21.15.154:0/1166082539 learned_addr learned my addr 172.21.15.154:0/1166082539 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:04.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.494+0000 7f9feb7fe700 1 --2- 172.21.15.154:0/1166082539 >> v2:172.21.15.179:3300/0 conn(0x7f9fec0c6c60 0x7f9fec0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.494+0000 7f9ff0f9c700 1 -- 172.21.15.154:0/1166082539 >> v2:172.21.15.179:3300/0 conn(0x7f9fec0c6c60 msgr2=0x7f9fec0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:04.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.494+0000 7f9ff0f9c700 1 --2- 172.21.15.154:0/1166082539 >> v2:172.21.15.179:3300/0 conn(0x7f9fec0c6c60 0x7f9fec0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.494+0000 7f9ff0f9c700 1 -- 172.21.15.154:0/1166082539 >> v1:172.21.15.154:6789/0 conn(0x7f9fec1595a0 legacy=0x7f9fec0b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.494+0000 7f9ff0f9c700 1 -- 172.21.15.154:0/1166082539 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0634f0 con 0x7f9fec06e8c0 2023-10-10T21:17:04.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.494+0000 7f9feaffd700 1 -- 172.21.15.154:0/1166082539 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799378992 0 0) 0x7f9fec0b1410 con 0x7f9fec1595a0 2023-10-10T21:17:04.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.494+0000 7f9ff0f9c700 1 --2- 172.21.15.154:0/1166082539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec06e8c0 0x7f9fec0c8660 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0b07d0 tx=0x7f9fe4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69db962df787b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:04.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.494+0000 7f9feaffd700 1 -- 172.21.15.154:0/1166082539 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400e070 con 0x7f9fec06e8c0 2023-10-10T21:17:04.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9feaffd700 1 -- 172.21.15.154:0/1166082539 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe400bb60 con 0x7f9fec06e8c0 2023-10-10T21:17:04.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9feaffd700 1 -- 172.21.15.154:0/1166082539 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4012430 con 0x7f9fec06e8c0 2023-10-10T21:17:04.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9ff179d700 1 -- 172.21.15.154:0/1166082539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec06e8c0 msgr2=0x7f9fec0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9ff179d700 1 --2- 172.21.15.154:0/1166082539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec06e8c0 0x7f9fec0c8660 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0b07d0 tx=0x7f9fe4009780 comp rx=0 tx=0).stop 2023-10-10T21:17:04.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9ff179d700 1 -- 172.21.15.154:0/1166082539 shutdown_connections 2023-10-10T21:17:04.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9ff179d700 1 --2- 172.21.15.154:0/1166082539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec06e8c0 0x7f9fec0c8660 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9ff179d700 1 --2- 172.21.15.154:0/1166082539 >> v2:172.21.15.179:3300/0 conn(0x7f9fec0c6c60 0x7f9fec0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9ff179d700 1 -- 172.21.15.154:0/1166082539 >> 172.21.15.154:0/1166082539 conn(0x7f9fec06ddb0 msgr2=0x7f9fec06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:04.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9ff179d700 1 -- 172.21.15.154:0/1166082539 shutdown_connections 2023-10-10T21:17:04.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.495+0000 7f9ff179d700 1 -- 172.21.15.154:0/1166082539 wait complete. 2023-10-10T21:17:04.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.497+0000 7f9ff179d700 1 Processor -- start 2023-10-10T21:17:04.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.497+0000 7f9ff179d700 1 -- start start 2023-10-10T21:17:04.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9ff179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06e8c0 0x7f9fec0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9ff179d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec0c6c60 0x7f9fec13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9ff179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec1595a0 0x7f9fec13ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9ff179d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec1541b0 con 0x7f9fec0c6c60 2023-10-10T21:17:04.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9ff179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec13f4c0 con 0x7f9fec1595a0 2023-10-10T21:17:04.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9ff179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec15b6e0 con 0x7f9fec06e8c0 2023-10-10T21:17:04.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9feb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec0c6c60 0x7f9fec13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9feb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec0c6c60 0x7f9fec13ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33156/0 (socket says 172.21.15.154:33156) 2023-10-10T21:17:04.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9feb7fe700 1 -- 172.21.15.154:0/591500451 learned_addr learned my addr 172.21.15.154:0/591500451 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:04.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9febfff700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06e8c0 0x7f9fec0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.498+0000 7f9ff0f9c700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec1595a0 0x7f9fec13ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9feb7fe700 1 -- 172.21.15.154:0/591500451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06e8c0 msgr2=0x7f9fec0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9feb7fe700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06e8c0 0x7f9fec0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9feb7fe700 1 -- 172.21.15.154:0/591500451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec1595a0 msgr2=0x7f9fec13ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9feb7fe700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec1595a0 0x7f9fec13ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9feb7fe700 1 -- 172.21.15.154:0/591500451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4009a20 con 0x7f9fec0c6c60 2023-10-10T21:17:04.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9feb7fe700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec0c6c60 0x7f9fec13ea40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000ec50 tx=0x7f9fe00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:04.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9fd3fff700 1 -- 172.21.15.154:0/591500451 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000c850 con 0x7f9fec0c6c60 2023-10-10T21:17:04.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9fd3fff700 1 -- 172.21.15.154:0/591500451 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000c9b0 con 0x7f9fec0c6c60 2023-10-10T21:17:04.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9fd3fff700 1 -- 172.21.15.154:0/591500451 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000cd70 con 0x7f9fec0c6c60 2023-10-10T21:17:04.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec160e60 con 0x7f9fec0c6c60 2023-10-10T21:17:04.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.499+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec1616a0 con 0x7f9fec0c6c60 2023-10-10T21:17:04.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.500+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec15b870 con 0x7f9fec0c6c60 2023-10-10T21:17:04.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.502+0000 7f9fd3fff700 1 -- 172.21.15.154:0/591500451 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f9fe0013680 con 0x7f9fec0c6c60 2023-10-10T21:17:04.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.503+0000 7f9fd3fff700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fd8067050 0x7f9fd8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.503+0000 7f9fd3fff700 1 -- 172.21.15.154:0/591500451 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f9fe0084c10 con 0x7f9fec0c6c60 2023-10-10T21:17:04.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.503+0000 7f9febfff700 1 -- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fd8067050 msgr2=0x7f9fd8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:04.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.503+0000 7f9febfff700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fd8067050 0x7f9fd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:04.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.507+0000 7f9fd3fff700 1 -- 172.21.15.154:0/591500451 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fe0051a20 con 0x7f9fec0c6c60 2023-10-10T21:17:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.704+0000 7f9febfff700 1 -- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fd8067050 msgr2=0x7f9fd8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.704+0000 7f9febfff700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fd8067050 0x7f9fd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:04.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.709+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fec04c3c0 con 0x7f9fec0c6c60 2023-10-10T21:17:04.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.710+0000 7f9fd3fff700 1 -- 172.21.15.154:0/591500451 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16416 (secure 0 0 0) 0x7f9fe0055040 con 0x7f9fec0c6c60 2023-10-10T21:17:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:04.713 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":67,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:16:29.148829+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:15:04.691966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-10T21:15:05.529376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6834/85496":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/1786819764":"2023-10-11T21:15:27.369273+0000","172.21.15.154:6836/85496":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/1234721096":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/181182255":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/883061507":"2023-10-11T21:15:27.369273+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:04.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fd8067050 msgr2=0x7f9fd8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:04.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fd8067050 0x7f9fd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec0c6c60 msgr2=0x7f9fec13ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec0c6c60 0x7f9fec13ea40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000ec50 tx=0x7f9fe00091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 shutdown_connections 2023-10-10T21:17:04.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fd8067050 0x7f9fd8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec1595a0 0x7f9fec13ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06e8c0 0x7f9fec0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 --2- 172.21.15.154:0/591500451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fec0c6c60 0x7f9fec13ea40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 >> 172.21.15.154:0/591500451 conn(0x7f9fec06ddb0 msgr2=0x7f9fec157500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:04.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 shutdown_connections 2023-10-10T21:17:04.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.713+0000 7f9ff179d700 1 -- 172.21.15.154:0/591500451 wait complete. 2023-10-10T21:17:04.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:15:04.691966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:15:05.529376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:17:04.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:17:04.802 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:04.800+0000 7fb38aa79180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:17:04.823 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:04.822+0000 7f8d94094180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:17:04.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.924+0000 7feed1f9d700 1 Processor -- start 2023-10-10T21:17:04.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.925+0000 7feed1f9d700 1 -- start start 2023-10-10T21:17:04.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.927+0000 7feed1f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feecc15a3b0 0x7feecc15a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.927+0000 7feed1f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc0aea70 con 0x7feecc0aef00 2023-10-10T21:17:04.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.927+0000 7feed1f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc15dad0 con 0x7feecc06e470 2023-10-10T21:17:04.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.927+0000 7feed1f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc0ae480 con 0x7feecc15a3b0 2023-10-10T21:17:04.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.927+0000 7feecbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7feecc0aef00 0x7feecc15d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35454/0 (socket says 172.21.15.154:35454) 2023-10-10T21:17:04.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.927+0000 7feecbfff700 1 -- 172.21.15.154:0/2145984716 learned_addr learned my addr 172.21.15.154:0/2145984716 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:04.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.927+0000 7feed0f9b700 1 --2- 172.21.15.154:0/2145984716 >> v2:172.21.15.179:3300/0 conn(0x7feecc15a3b0 0x7feecc15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.927+0000 7feecb7fe700 1 -- 172.21.15.154:0/2145984716 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613777276 0 0) 0x7feecc0aea70 con 0x7feecc0aef00 2023-10-10T21:17:04.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feecb7fe700 1 -- 172.21.15.154:0/2145984716 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feebc003570 con 0x7feecc0aef00 2023-10-10T21:17:04.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feecb7fe700 1 -- 172.21.15.154:0/2145984716 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818059181 0 0) 0x7feecc15dad0 con 0x7feecc06e470 2023-10-10T21:17:04.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feecb7fe700 1 -- 172.21.15.154:0/2145984716 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feecc0aea70 con 0x7feecc06e470 2023-10-10T21:17:04.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feed0f9b700 1 -- 172.21.15.154:0/2145984716 >> v1:172.21.15.179:6789/0 conn(0x7feecc06e470 legacy=0x7feecc0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feed0f9b700 1 -- 172.21.15.154:0/2145984716 >> v1:172.21.15.154:6789/0 conn(0x7feecc0aef00 legacy=0x7feecc15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feed0f9b700 1 -- 172.21.15.154:0/2145984716 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc15acc0 con 0x7feecc15a3b0 2023-10-10T21:17:04.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feed0f9b700 1 --2- 172.21.15.154:0/2145984716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc15a3b0 0x7feecc15a780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feec00098e0 tx=0x7feec00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9b213574d622976 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:04.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feecb7fe700 1 -- 172.21.15.154:0/2145984716 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0011630 con 0x7feecc15a3b0 2023-10-10T21:17:04.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feecb7fe700 1 -- 172.21.15.154:0/2145984716 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0011790 con 0x7feecc15a3b0 2023-10-10T21:17:04.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.928+0000 7feecb7fe700 1 -- 172.21.15.154:0/2145984716 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0011b30 con 0x7feecc15a3b0 2023-10-10T21:17:04.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.929+0000 7feed1f9d700 1 -- 172.21.15.154:0/2145984716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc15a3b0 msgr2=0x7feecc15a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.929+0000 7feed1f9d700 1 --2- 172.21.15.154:0/2145984716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc15a3b0 0x7feecc15a780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feec00098e0 tx=0x7feec00091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.929+0000 7feed1f9d700 1 -- 172.21.15.154:0/2145984716 shutdown_connections 2023-10-10T21:17:04.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.929+0000 7feed1f9d700 1 --2- 172.21.15.154:0/2145984716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc15a3b0 0x7feecc15a780 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.929+0000 7feed1f9d700 1 -- 172.21.15.154:0/2145984716 >> 172.21.15.154:0/2145984716 conn(0x7feecc0c9f70 msgr2=0x7feecc06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:04.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.929+0000 7feed1f9d700 1 -- 172.21.15.154:0/2145984716 shutdown_connections 2023-10-10T21:17:04.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.929+0000 7feed1f9d700 1 -- 172.21.15.154:0/2145984716 wait complete. 2023-10-10T21:17:04.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.932+0000 7feed1f9d700 1 Processor -- start 2023-10-10T21:17:04.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.932+0000 7feed1f9d700 1 -- start start 2023-10-10T21:17:04.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.933+0000 7feed1f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc06e470 0x7feecc0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.933+0000 7feed1f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc0aef00 0x7feecc1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.933+0000 7feed1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feecc15a3b0 0x7feecc151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.933+0000 7feed1f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc151d40 con 0x7feecc0aef00 2023-10-10T21:17:04.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.933+0000 7feed1f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc157c60 con 0x7feecc06e470 2023-10-10T21:17:04.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feed1f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc157f40 con 0x7feecc15a3b0 2023-10-10T21:17:04.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feecbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc0aef00 0x7feecc1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feecbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc0aef00 0x7feecc1512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33160/0 (socket says 172.21.15.154:33160) 2023-10-10T21:17:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feecbfff700 1 -- 172.21.15.154:0/3155855262 learned_addr learned my addr 172.21.15.154:0/3155855262 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feed0f9b700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc06e470 0x7feecc0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feed179c700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feecc15a3b0 0x7feecc151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feecbfff700 1 -- 172.21.15.154:0/3155855262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feecc15a3b0 msgr2=0x7feecc151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feecbfff700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feecc15a3b0 0x7feecc151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feecbfff700 1 -- 172.21.15.154:0/3155855262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc06e470 msgr2=0x7feecc0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:04.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feecbfff700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc06e470 0x7feecc0cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:04.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feecbfff700 1 -- 172.21.15.154:0/3155855262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009420 con 0x7feecc0aef00 2023-10-10T21:17:04.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feed0f9b700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc06e470 0x7feecc0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:04.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.934+0000 7feecbfff700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc0aef00 0x7feecc1512c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c790 tx=0x7feeb8007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:04.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.935+0000 7feec8ff9700 1 -- 172.21.15.154:0/3155855262 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8005b30 con 0x7feecc0aef00 2023-10-10T21:17:04.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.935+0000 7feec8ff9700 1 -- 172.21.15.154:0/3155855262 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8005c90 con 0x7feecc0aef00 2023-10-10T21:17:04.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.935+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc158220 con 0x7feecc0aef00 2023-10-10T21:17:04.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.935+0000 7feec8ff9700 1 -- 172.21.15.154:0/3155855262 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8007300 con 0x7feecc0aef00 2023-10-10T21:17:04.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.935+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc1587e0 con 0x7feecc0aef00 2023-10-10T21:17:04.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.936+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc06cfa0 con 0x7feecc0aef00 2023-10-10T21:17:04.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.937+0000 7feec8ff9700 1 -- 172.21.15.154:0/3155855262 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7feeb801b3b0 con 0x7feecc0aef00 2023-10-10T21:17:04.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.938+0000 7feec8ff9700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feeb0067050 0x7feeb0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:04.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.938+0000 7feec8ff9700 1 -- 172.21.15.154:0/3155855262 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6385+0+0 (secure 0 0 0) 0x7feeb8083ec0 con 0x7feecc0aef00 2023-10-10T21:17:04.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.938+0000 7feed0f9b700 1 -- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feeb0067050 msgr2=0x7feeb0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:04.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.938+0000 7feed0f9b700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feeb0067050 0x7feeb0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:04.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:04.943+0000 7feec8ff9700 1 -- 172.21.15.154:0/3155855262 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feeb8050d70 con 0x7feecc0aef00 2023-10-10T21:17:04.974 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:04.973+0000 7fb38aa79180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:04.998 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:04.997+0000 7f8d94094180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:05.064 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:05.063+0000 7fb38aa79180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:17:05.086 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:05.086+0000 7f8d94094180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:17:05.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.139+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feecc15dd30 con 0x7feecc0aef00 2023-10-10T21:17:05.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.139+0000 7feed0f9b700 1 -- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feeb0067050 msgr2=0x7feeb0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:05.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.139+0000 7feed0f9b700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feeb0067050 0x7feeb0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:05.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.139+0000 7feec8ff9700 1 -- 172.21.15.154:0/3155855262 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7feeb8017020 con 0x7feecc0aef00 2023-10-10T21:17:05.143 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:17:05.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.141+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feeb0067050 msgr2=0x7feeb0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:05.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feeb0067050 0x7feeb0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc0aef00 msgr2=0x7feecc1512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc0aef00 0x7feecc1512c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c790 tx=0x7feeb8007ea0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 shutdown_connections 2023-10-10T21:17:05.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feecc15a3b0 0x7feecc151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feeb0067050 0x7feeb0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feecc06e470 0x7feecc0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 --2- 172.21.15.154:0/3155855262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc0aef00 0x7feecc1512c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 >> 172.21.15.154:0/3155855262 conn(0x7feecc0c9f70 msgr2=0x7feecc0704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:05.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 shutdown_connections 2023-10-10T21:17:05.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.142+0000 7feed1f9d700 1 -- 172.21.15.154:0/3155855262 wait complete. 2023-10-10T21:17:05.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:17:05.298 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:05.296+0000 7fb38aa79180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:05.322 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:05.321+0000 7f8d94094180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:05.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.355+0000 7fce33fff700 1 Processor -- start 2023-10-10T21:17:05.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.355+0000 7fce33fff700 1 -- start start 2023-10-10T21:17:05.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.356+0000 7fce33fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce340b4e70 0x7fce340ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.356+0000 7fce33fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce340cfb00 con 0x7fce340b1b40 2023-10-10T21:17:05.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.356+0000 7fce33fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3415e060 con 0x7fce340b16d0 2023-10-10T21:17:05.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.356+0000 7fce33fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce340b5c40 con 0x7fce340b4e70 2023-10-10T21:17:05.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.357+0000 7fce32ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce340b4e70 0x7fce340ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:05.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.357+0000 7fce337fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fce340b1b40 0x7fce3415d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35462/0 (socket says 172.21.15.154:35462) 2023-10-10T21:17:05.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.357+0000 7fce337fe700 1 -- 172.21.15.154:0/2561417981 learned_addr learned my addr 172.21.15.154:0/2561417981 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:05.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.357+0000 7fce32ffd700 1 -- 172.21.15.154:0/2561417981 >> v1:172.21.15.179:6789/0 conn(0x7fce340b16d0 legacy=0x7fce3415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.357+0000 7fce32ffd700 1 -- 172.21.15.154:0/2561417981 >> v1:172.21.15.154:6789/0 conn(0x7fce340b1b40 legacy=0x7fce3415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.357+0000 7fce32ffd700 1 -- 172.21.15.154:0/2561417981 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce340b5f20 con 0x7fce340b4e70 2023-10-10T21:17:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.357+0000 7fce31ffb700 1 -- 172.21.15.154:0/2561417981 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718398224 0 0) 0x7fce340cfb00 con 0x7fce340b1b40 2023-10-10T21:17:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.357+0000 7fce32ffd700 1 --2- 172.21.15.154:0/2561417981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b4e70 0x7fce340ccff0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fce240098e0 tx=0x7fce240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3167f5227a7e3973 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce31ffb700 1 -- 172.21.15.154:0/2561417981 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24009e80 con 0x7fce340b4e70 2023-10-10T21:17:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce31ffb700 1 -- 172.21.15.154:0/2561417981 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2400b860 con 0x7fce340b4e70 2023-10-10T21:17:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce31ffb700 1 -- 172.21.15.154:0/2561417981 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2400bbe0 con 0x7fce340b4e70 2023-10-10T21:17:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce33fff700 1 -- 172.21.15.154:0/2561417981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b4e70 msgr2=0x7fce340ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce33fff700 1 --2- 172.21.15.154:0/2561417981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b4e70 0x7fce340ccff0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fce240098e0 tx=0x7fce240091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce33fff700 1 -- 172.21.15.154:0/2561417981 shutdown_connections 2023-10-10T21:17:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce33fff700 1 --2- 172.21.15.154:0/2561417981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b4e70 0x7fce340ccff0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce33fff700 1 -- 172.21.15.154:0/2561417981 >> 172.21.15.154:0/2561417981 conn(0x7fce340d10c0 msgr2=0x7fce340affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:05.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce33fff700 1 -- 172.21.15.154:0/2561417981 shutdown_connections 2023-10-10T21:17:05.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.358+0000 7fce33fff700 1 -- 172.21.15.154:0/2561417981 wait complete. 2023-10-10T21:17:05.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.361+0000 7fce33fff700 1 Processor -- start 2023-10-10T21:17:05.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.361+0000 7fce33fff700 1 -- start start 2023-10-10T21:17:05.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.362+0000 7fce33fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b16d0 0x7fce3416ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.362+0000 7fce33fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce340b1b40 0x7fce340af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.362+0000 7fce33fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce340b4e70 0x7fce340caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.362+0000 7fce33fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340c8420 con 0x7fce340b16d0 2023-10-10T21:17:05.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.362+0000 7fce33fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3416b260 con 0x7fce340b1b40 2023-10-10T21:17:05.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.362+0000 7fce33fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce340c8f40 con 0x7fce340b4e70 2023-10-10T21:17:05.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce32ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b16d0 0x7fce3416ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:05.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce32ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b16d0 0x7fce3416ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33186/0 (socket says 172.21.15.154:33186) 2023-10-10T21:17:05.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce32ffd700 1 -- 172.21.15.154:0/1165741169 learned_addr learned my addr 172.21.15.154:0/1165741169 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:05.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce327fc700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce340b1b40 0x7fce340af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:05.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce337fe700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce340b4e70 0x7fce340caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:05.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce32ffd700 1 -- 172.21.15.154:0/1165741169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce340b4e70 msgr2=0x7fce340caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce32ffd700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce340b4e70 0x7fce340caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce32ffd700 1 -- 172.21.15.154:0/1165741169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce340b1b40 msgr2=0x7fce340af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce32ffd700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce340b1b40 0x7fce340af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce32ffd700 1 -- 172.21.15.154:0/1165741169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce24009420 con 0x7fce340b16d0 2023-10-10T21:17:05.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.363+0000 7fce32ffd700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b16d0 0x7fce3416ad20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fce34070dd0 tx=0x7fce24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:05.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.364+0000 7fce1affd700 1 -- 172.21.15.154:0/1165741169 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2401f070 con 0x7fce340b16d0 2023-10-10T21:17:05.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.364+0000 7fce1affd700 1 -- 172.21.15.154:0/1165741169 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce24000c90 con 0x7fce340b16d0 2023-10-10T21:17:05.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.364+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce340c9220 con 0x7fce340b16d0 2023-10-10T21:17:05.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.364+0000 7fce1affd700 1 -- 172.21.15.154:0/1165741169 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24025420 con 0x7fce340b16d0 2023-10-10T21:17:05.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.364+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce340c95b0 con 0x7fce340b16d0 2023-10-10T21:17:05.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.365+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce34088990 con 0x7fce340b16d0 2023-10-10T21:17:05.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.366+0000 7fce1affd700 1 -- 172.21.15.154:0/1165741169 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fce24023070 con 0x7fce340b16d0 2023-10-10T21:17:05.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.367+0000 7fce1affd700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce20067050 0x7fce20069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.368+0000 7fce327fc700 1 -- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce20067050 msgr2=0x7fce20069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:05.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.368+0000 7fce1affd700 1 -- 172.21.15.154:0/1165741169 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fce24085e20 con 0x7fce340b16d0 2023-10-10T21:17:05.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.368+0000 7fce327fc700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce20067050 0x7fce20069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:05.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.372+0000 7fce1affd700 1 -- 172.21.15.154:0/1165741169 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce24052c30 con 0x7fce340b16d0 2023-10-10T21:17:05.484 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:05.483+0000 7fb38aa79180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:17:05.509 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:05.508+0000 7f8d94094180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:17:05.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.569+0000 7fce327fc700 1 -- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce20067050 msgr2=0x7fce20069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:05.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.569+0000 7fce327fc700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce20067050 0x7fce20069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:05.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.572+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce340b5440 con 0x7fce340b16d0 2023-10-10T21:17:05.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.572+0000 7fce1affd700 1 -- 172.21.15.154:0/1165741169 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce2402a0a0 con 0x7fce340b16d0 2023-10-10T21:17:05.573 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:17:05.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce20067050 msgr2=0x7fce20069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:05.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce20067050 0x7fce20069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b16d0 msgr2=0x7fce3416ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b16d0 0x7fce3416ad20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fce34070dd0 tx=0x7fce24017000 comp rx=0 tx=0).stop 2023-10-10T21:17:05.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 shutdown_connections 2023-10-10T21:17:05.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce340b4e70 0x7fce340caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce340b16d0 0x7fce3416ad20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce20067050 0x7fce20069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 --2- 172.21.15.154:0/1165741169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce340b1b40 0x7fce340af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 >> 172.21.15.154:0/1165741169 conn(0x7fce340d10c0 msgr2=0x7fce34068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:05.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 shutdown_connections 2023-10-10T21:17:05.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.575+0000 7fce33fff700 1 -- 172.21.15.154:0/1165741169 wait complete. 2023-10-10T21:17:05.580 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:05.579+0000 7fb38aa79180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:17:05.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:17:05.605 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:05.605+0000 7f8d94094180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:17:05.747 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:05.746+0000 7fb38aa79180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:17:05.779 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:05.778+0000 7f8d94094180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:17:05.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.789+0000 7f0de1f9d700 1 Processor -- start 2023-10-10T21:17:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.789+0000 7f0de1f9d700 1 -- start start 2023-10-10T21:17:05.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0de1f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ddc0b16d0 0x7f0ddc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0de1f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ddc0b33b0 0x7f0ddc0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0de1f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc0b2080 con 0x7f0ddc0b4e70 2023-10-10T21:17:05.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0de1f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0cfb00 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0de1f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b5c40 con 0x7f0ddc0b33b0 2023-10-10T21:17:05.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0ddbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ddc0b16d0 0x7f0ddc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0ddbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ddc0b16d0 0x7f0ddc0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33196/0 (socket says 172.21.15.154:33196) 2023-10-10T21:17:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0ddbfff700 1 -- 172.21.15.154:0/2809160029 learned_addr learned my addr 172.21.15.154:0/2809160029 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0de0f9b700 1 --1- 172.21.15.154:0/2809160029 >> v1:172.21.15.154:6789/0 conn(0x7f0ddc0b4e70 0x7f0ddc0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35474/0 (socket says 172.21.15.154:35474) 2023-10-10T21:17:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.790+0000 7f0de179c700 1 --2- 172.21.15.154:0/2809160029 >> v2:172.21.15.179:3300/0 conn(0x7f0ddc0b33b0 0x7f0ddc0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.791+0000 7f0ddbfff700 1 -- 172.21.15.154:0/2809160029 >> v2:172.21.15.179:3300/0 conn(0x7f0ddc0b33b0 msgr2=0x7f0ddc0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.791+0000 7f0ddbfff700 1 --2- 172.21.15.154:0/2809160029 >> v2:172.21.15.179:3300/0 conn(0x7f0ddc0b33b0 0x7f0ddc0b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.791+0000 7f0ddbfff700 1 -- 172.21.15.154:0/2809160029 >> v1:172.21.15.154:6789/0 conn(0x7f0ddc0b4e70 legacy=0x7f0ddc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.791+0000 7f0ddbfff700 1 -- 172.21.15.154:0/2809160029 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0b5f20 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.791+0000 7f0ddb7fe700 1 -- 172.21.15.154:0/2809160029 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620141495 0 0) 0x7f0ddc0b2080 con 0x7f0ddc0b4e70 2023-10-10T21:17:05.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.791+0000 7f0ddbfff700 1 --2- 172.21.15.154:0/2809160029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 0x7f0ddc0b1b40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc071380 tx=0x7f0dc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bfaa9807b4671b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:05.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.791+0000 7f0ddb7fe700 1 -- 172.21.15.154:0/2809160029 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8009e70 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.791+0000 7f0ddb7fe700 1 -- 172.21.15.154:0/2809160029 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc800b860 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.791+0000 7f0ddb7fe700 1 -- 172.21.15.154:0/2809160029 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc800bc20 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.792+0000 7f0de1f9d700 1 -- 172.21.15.154:0/2809160029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 msgr2=0x7f0ddc0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.792+0000 7f0de1f9d700 1 --2- 172.21.15.154:0/2809160029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 0x7f0ddc0b1b40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc071380 tx=0x7f0dc8009250 comp rx=0 tx=0).stop 2023-10-10T21:17:05.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.792+0000 7f0de1f9d700 1 -- 172.21.15.154:0/2809160029 shutdown_connections 2023-10-10T21:17:05.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.792+0000 7f0de1f9d700 1 --2- 172.21.15.154:0/2809160029 >> v2:172.21.15.179:3300/0 conn(0x7f0ddc0b33b0 0x7f0ddc0b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.792+0000 7f0de1f9d700 1 --2- 172.21.15.154:0/2809160029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 0x7f0ddc0b1b40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.792+0000 7f0de1f9d700 1 -- 172.21.15.154:0/2809160029 >> 172.21.15.154:0/2809160029 conn(0x7f0ddc0d10c0 msgr2=0x7f0ddc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:05.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.792+0000 7f0de1f9d700 1 -- 172.21.15.154:0/2809160029 shutdown_connections 2023-10-10T21:17:05.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.792+0000 7f0de1f9d700 1 -- 172.21.15.154:0/2809160029 wait complete. 2023-10-10T21:17:05.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.793+0000 7f0de1f9d700 1 Processor -- start 2023-10-10T21:17:05.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.793+0000 7f0de1f9d700 1 -- start start 2023-10-10T21:17:05.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.794+0000 7f0de1f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 0x7f0ddc14aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.794+0000 7f0de1f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ddc0b33b0 0x7f0ddc14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.794+0000 7f0de1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ddc0b4e70 0x7f0ddc16d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.794+0000 7f0de1f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0a9b10 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.794+0000 7f0de1f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0a8f00 con 0x7f0ddc0b33b0 2023-10-10T21:17:05.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.794+0000 7f0de1f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0a91e0 con 0x7f0ddc0b4e70 2023-10-10T21:17:05.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de0f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 0x7f0ddc14aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:05.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de0f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 0x7f0ddc14aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33202/0 (socket says 172.21.15.154:33202) 2023-10-10T21:17:05.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de0f9b700 1 -- 172.21.15.154:0/1166379798 learned_addr learned my addr 172.21.15.154:0/1166379798 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:05.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0ddbfff700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ddc0b33b0 0x7f0ddc14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:05.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de179c700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ddc0b4e70 0x7f0ddc16d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:05.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de0f9b700 1 -- 172.21.15.154:0/1166379798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ddc0b4e70 msgr2=0x7f0ddc16d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de0f9b700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ddc0b4e70 0x7f0ddc16d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de0f9b700 1 -- 172.21.15.154:0/1166379798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ddc0b33b0 msgr2=0x7f0ddc14af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:05.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de0f9b700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ddc0b33b0 0x7f0ddc14af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:05.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de0f9b700 1 -- 172.21.15.154:0/1166379798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80094f0 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.795+0000 7f0de0f9b700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 0x7f0ddc14aa10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000cdd0 tx=0x7f0dd0001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:05.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.796+0000 7f0dd8ff9700 1 -- 172.21.15.154:0/1166379798 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0005df0 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.796+0000 7f0dd8ff9700 1 -- 172.21.15.154:0/1166379798 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000a8b0 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.796+0000 7f0dd8ff9700 1 -- 172.21.15.154:0/1166379798 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000ac70 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.796+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc0a94c0 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.796+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc14b5a0 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.797+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc0aaf70 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.798+0000 7f0dd8ff9700 1 -- 172.21.15.154:0/1166379798 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f0dd0007300 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.798+0000 7f0dd8ff9700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc0067050 0x7f0dc0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:05.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.799+0000 7f0dd8ff9700 1 -- 172.21.15.154:0/1166379798 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f0dd0084b90 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.799+0000 7f0ddbfff700 1 -- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc0067050 msgr2=0x7f0dc0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:05.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.799+0000 7f0ddbfff700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc0067050 0x7f0dc0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:05.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:05.806+0000 7f0dd8ff9700 1 -- 172.21.15.154:0/1166379798 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dd0051a20 con 0x7f0ddc0b16d0 2023-10-10T21:17:05.851 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:05.850+0000 7fb38aa79180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:05.888 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:05.888+0000 7f8d94094180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.000+0000 7f0ddbfff700 1 -- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc0067050 msgr2=0x7f0dc0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.000+0000 7f0ddbfff700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc0067050 0x7f0dc0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.005+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ddc04bb80 con 0x7f0ddc0b16d0 2023-10-10T21:17:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.006+0000 7f0dd8ff9700 1 -- 172.21.15.154:0/1166379798 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0dd0055040 con 0x7f0ddc0b16d0 2023-10-10T21:17:06.007 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:17:06.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc0067050 msgr2=0x7f0dc0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:06.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc0067050 0x7f0dc0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 msgr2=0x7f0ddc14aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 0x7f0ddc14aa10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000cdd0 tx=0x7f0dd0001bc0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 shutdown_connections 2023-10-10T21:17:06.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ddc0b4e70 0x7f0ddc16d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ddc0b16d0 0x7f0ddc14aa10 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc0067050 0x7f0dc0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 --2- 172.21.15.154:0/1166379798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ddc0b33b0 0x7f0ddc14af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.008+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 >> 172.21.15.154:0/1166379798 conn(0x7f0ddc0d10c0 msgr2=0x7f0ddc0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:06.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.009+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 shutdown_connections 2023-10-10T21:17:06.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.009+0000 7f0de1f9d700 1 -- 172.21.15.154:0/1166379798 wait complete. 2023-10-10T21:17:06.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:06.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.261+0000 7f5d3cf9d700 1 Processor -- start 2023-10-10T21:17:06.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.262+0000 7f5d3cf9d700 1 -- start start 2023-10-10T21:17:06.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d3cf9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d381595a0 0x7f5d380b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d3cf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d380c6c60 0x7f5d380c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d3cf9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5d380b1de0 0x7f5d380c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d3cf9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380b2b90 con 0x7f5d381595a0 2023-10-10T21:17:06.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d3cf9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380b1410 con 0x7f5d380b1de0 2023-10-10T21:17:06.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d3cf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38063230 con 0x7f5d380c6c60 2023-10-10T21:17:06.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d377fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d381595a0 0x7f5d380b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d377fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d381595a0 0x7f5d380b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34124/0 (socket says 172.21.15.154:34124) 2023-10-10T21:17:06.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d377fe700 1 -- 172.21.15.154:0/3601261823 learned_addr learned my addr 172.21.15.154:0/3601261823 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:06.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d36ffd700 1 --2- 172.21.15.154:0/3601261823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d380c6c60 0x7f5d380c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.263+0000 7f5d37fff700 1 --2- 172.21.15.154:0/3601261823 >> v2:172.21.15.179:3300/0 conn(0x7f5d380b1de0 0x7f5d380c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.264+0000 7f5d377fe700 1 -- 172.21.15.154:0/3601261823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d380c6c60 msgr2=0x7f5d380c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.264+0000 7f5d377fe700 1 --2- 172.21.15.154:0/3601261823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d380c6c60 0x7f5d380c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.264+0000 7f5d377fe700 1 -- 172.21.15.154:0/3601261823 >> v2:172.21.15.179:3300/0 conn(0x7f5d380b1de0 msgr2=0x7f5d380c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.264+0000 7f5d377fe700 1 --2- 172.21.15.154:0/3601261823 >> v2:172.21.15.179:3300/0 conn(0x7f5d380b1de0 0x7f5d380c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.264+0000 7f5d377fe700 1 -- 172.21.15.154:0/3601261823 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d380634f0 con 0x7f5d381595a0 2023-10-10T21:17:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.264+0000 7f5d377fe700 1 --2- 172.21.15.154:0/3601261823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d381595a0 0x7f5d380b18a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5d3815d3c0 tx=0x7f5d28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bd1561729bde65 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.264+0000 7f5d367fc700 1 -- 172.21.15.154:0/3601261823 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800b640 con 0x7f5d381595a0 2023-10-10T21:17:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.264+0000 7f5d367fc700 1 -- 172.21.15.154:0/3601261823 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800b7a0 con 0x7f5d381595a0 2023-10-10T21:17:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.264+0000 7f5d367fc700 1 -- 172.21.15.154:0/3601261823 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800bb60 con 0x7f5d381595a0 2023-10-10T21:17:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.265+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/3601261823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d381595a0 msgr2=0x7f5d380b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.265+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/3601261823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d381595a0 0x7f5d380b18a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5d3815d3c0 tx=0x7f5d28009250 comp rx=0 tx=0).stop 2023-10-10T21:17:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.265+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/3601261823 shutdown_connections 2023-10-10T21:17:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.265+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/3601261823 >> v2:172.21.15.179:3300/0 conn(0x7f5d380b1de0 0x7f5d380c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.265+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/3601261823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d381595a0 0x7f5d380b18a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.265+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/3601261823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d380c6c60 0x7f5d380c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.265+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/3601261823 >> 172.21.15.154:0/3601261823 conn(0x7f5d3806ddb0 msgr2=0x7f5d3806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.265+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/3601261823 shutdown_connections 2023-10-10T21:17:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.265+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/3601261823 wait complete. 2023-10-10T21:17:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.266+0000 7f5d3cf9d700 1 Processor -- start 2023-10-10T21:17:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.266+0000 7f5d3cf9d700 1 -- start start 2023-10-10T21:17:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.267+0000 7f5d3cf9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d380b1de0 0x7f5d3813d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.267+0000 7f5d3cf9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380c6c60 0x7f5d3814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.267+0000 7f5d3cf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d381595a0 0x7f5d3814d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.267+0000 7f5d3cf9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3813dab0 con 0x7f5d380c6c60 2023-10-10T21:17:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.267+0000 7f5d3cf9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3816d7b0 con 0x7f5d380b1de0 2023-10-10T21:17:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.267+0000 7f5d3cf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3816e610 con 0x7f5d381595a0 2023-10-10T21:17:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d36ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380c6c60 0x7f5d3814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d36ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380c6c60 0x7f5d3814d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34128/0 (socket says 172.21.15.154:34128) 2023-10-10T21:17:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d36ffd700 1 -- 172.21.15.154:0/2263805178 learned_addr learned my addr 172.21.15.154:0/2263805178 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d377fe700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d380b1de0 0x7f5d3813d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d37fff700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d381595a0 0x7f5d3814d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d36ffd700 1 -- 172.21.15.154:0/2263805178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d381595a0 msgr2=0x7f5d3814d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d36ffd700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d381595a0 0x7f5d3814d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d36ffd700 1 -- 172.21.15.154:0/2263805178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d380b1de0 msgr2=0x7f5d3813d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d36ffd700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d380b1de0 0x7f5d3813d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d36ffd700 1 -- 172.21.15.154:0/2263805178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280094f0 con 0x7f5d380c6c60 2023-10-10T21:17:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d36ffd700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380c6c60 0x7f5d3814d1c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00ecb0 tx=0x7f5d2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.268+0000 7f5d1f7fe700 1 -- 172.21.15.154:0/2263805178 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00c850 con 0x7f5d380c6c60 2023-10-10T21:17:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.269+0000 7f5d1f7fe700 1 -- 172.21.15.154:0/2263805178 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c00c9d0 con 0x7f5d380c6c60 2023-10-10T21:17:06.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.269+0000 7f5d1f7fe700 1 -- 172.21.15.154:0/2263805178 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00cd90 con 0x7f5d380c6c60 2023-10-10T21:17:06.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.269+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3816da00 con 0x7f5d380c6c60 2023-10-10T21:17:06.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.269+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3816dfc0 con 0x7f5d380c6c60 2023-10-10T21:17:06.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.270+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3804c3c0 con 0x7f5d380c6c60 2023-10-10T21:17:06.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.271+0000 7f5d1f7fe700 1 -- 172.21.15.154:0/2263805178 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f5d2c013680 con 0x7f5d380c6c60 2023-10-10T21:17:06.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.272+0000 7f5d1f7fe700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5d24067050 0x7f5d24069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.272+0000 7f5d1f7fe700 1 -- 172.21.15.154:0/2263805178 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f5d2c084ba0 con 0x7f5d380c6c60 2023-10-10T21:17:06.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.272+0000 7f5d377fe700 1 -- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5d24067050 msgr2=0x7f5d24069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:06.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.272+0000 7f5d377fe700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5d24067050 0x7f5d24069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:06.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.276+0000 7f5d1f7fe700 1 -- 172.21.15.154:0/2263805178 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d2c051a50 con 0x7f5d380c6c60 2023-10-10T21:17:06.347 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:06.346+0000 7fb38aa79180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:17:06.420 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:06.419+0000 7f8d94094180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:17:06.441 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:06.440+0000 7fb38aa79180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:17:06.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.473+0000 7f5d377fe700 1 -- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5d24067050 msgr2=0x7f5d24069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:06.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.473+0000 7f5d377fe700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5d24067050 0x7f5d24069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:06.522 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:06.521+0000 7f8d94094180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:17:06.541 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:06.540+0000 7fb38aa79180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:17:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.552+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d380637d0 con 0x7f5d380c6c60 2023-10-10T21:17:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.552+0000 7f5d1f7fe700 1 -- 172.21.15.154:0/2263805178 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f5d2c055070 con 0x7f5d380c6c60 2023-10-10T21:17:06.553 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:06.554 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1501601746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1501601746},{"type":"v1","addr":"172.21.15.179:6833","nonce":1501601746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4046528016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4046528016},{"type":"v1","addr":"172.21.15.179:6835","nonce":4046528016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5533,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/634585840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":634585840},{"type":"v1","addr":"172.21.15.154:6837","nonce":634585840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:15:06.545399+0000","modified":"2023-10-10T21:15:10.108541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6833/1321064128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1321064128},{"type":"v1","addr":"172.21.15.154:6833","nonce":1321064128}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-10T21:17:06.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5d24067050 msgr2=0x7f5d24069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:06.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5d24067050 0x7f5d24069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380c6c60 msgr2=0x7f5d3814d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380c6c60 0x7f5d3814d1c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00ecb0 tx=0x7f5d2c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 shutdown_connections 2023-10-10T21:17:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d381595a0 0x7f5d3814d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5d24067050 0x7f5d24069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d380b1de0 0x7f5d3813d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 --2- 172.21.15.154:0/2263805178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380c6c60 0x7f5d3814d1c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 >> 172.21.15.154:0/2263805178 conn(0x7f5d3806ddb0 msgr2=0x7f5d38154040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 shutdown_connections 2023-10-10T21:17:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.555+0000 7f5d3cf9d700 1 -- 172.21.15.154:0/2263805178 wait complete. 2023-10-10T21:17:06.562 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 22 2023-10-10T21:17:06.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:06.621 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:06.620+0000 7f8d94094180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:17:06.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.763+0000 7f165cf9d700 1 Processor -- start 2023-10-10T21:17:06.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.763+0000 7f165cf9d700 1 -- start start 2023-10-10T21:17:06.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f165cf9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f16581595a0 0x7f16580b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f165cf9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16580c6c60 0x7f16580c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f165cf9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16580b1410 con 0x7f16580b1de0 2023-10-10T21:17:06.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f165cf9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16580b2b90 con 0x7f16580c6c60 2023-10-10T21:17:06.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f165cf9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1658063230 con 0x7f16581595a0 2023-10-10T21:17:06.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f1656ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16580c6c60 0x7f16580c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f1657fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f16580b1de0 0x7f165815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40746/0 (socket says 172.21.15.154:40746) 2023-10-10T21:17:06.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f1656ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16580c6c60 0x7f16580c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34134/0 (socket says 172.21.15.154:34134) 2023-10-10T21:17:06.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f1657fff700 1 -- 172.21.15.154:0/3517902417 learned_addr learned my addr 172.21.15.154:0/3517902417 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:06.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f16577fe700 1 --2- 172.21.15.154:0/3517902417 >> v2:172.21.15.179:3300/0 conn(0x7f16581595a0 0x7f16580b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f1656ffd700 1 -- 172.21.15.154:0/3517902417 >> v2:172.21.15.179:3300/0 conn(0x7f16581595a0 msgr2=0x7f16580b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:06.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f1656ffd700 1 --2- 172.21.15.154:0/3517902417 >> v2:172.21.15.179:3300/0 conn(0x7f16581595a0 0x7f16580b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f1656ffd700 1 -- 172.21.15.154:0/3517902417 >> v1:172.21.15.154:6789/0 conn(0x7f16580b1de0 legacy=0x7f165815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.766+0000 7f1656ffd700 1 -- 172.21.15.154:0/3517902417 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16580634f0 con 0x7f16580c6c60 2023-10-10T21:17:06.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.765+0000 7f16567fc700 1 -- 172.21.15.154:0/3517902417 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644384939 0 0) 0x7f16580b1410 con 0x7f16580b1de0 2023-10-10T21:17:06.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.766+0000 7f1656ffd700 1 --2- 172.21.15.154:0/3517902417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580c6c60 0x7f16580c8120 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f16580c8d10 tx=0x7f164c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9260e0a162f5f4e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:06.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.766+0000 7f16567fc700 1 -- 172.21.15.154:0/3517902417 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c011630 con 0x7f16580c6c60 2023-10-10T21:17:06.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.766+0000 7f16567fc700 1 -- 172.21.15.154:0/3517902417 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c011790 con 0x7f16580c6c60 2023-10-10T21:17:06.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.766+0000 7f16567fc700 1 -- 172.21.15.154:0/3517902417 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c011b30 con 0x7f16580c6c60 2023-10-10T21:17:06.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.767+0000 7f165cf9d700 1 -- 172.21.15.154:0/3517902417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580c6c60 msgr2=0x7f16580c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.767+0000 7f165cf9d700 1 --2- 172.21.15.154:0/3517902417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580c6c60 0x7f16580c8120 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f16580c8d10 tx=0x7f164c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.767+0000 7f165cf9d700 1 -- 172.21.15.154:0/3517902417 shutdown_connections 2023-10-10T21:17:06.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.767+0000 7f165cf9d700 1 --2- 172.21.15.154:0/3517902417 >> v2:172.21.15.179:3300/0 conn(0x7f16581595a0 0x7f16580b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.767+0000 7f165cf9d700 1 --2- 172.21.15.154:0/3517902417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580c6c60 0x7f16580c8120 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.767+0000 7f165cf9d700 1 -- 172.21.15.154:0/3517902417 >> 172.21.15.154:0/3517902417 conn(0x7f165806ddb0 msgr2=0x7f165806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:06.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.767+0000 7f165cf9d700 1 -- 172.21.15.154:0/3517902417 shutdown_connections 2023-10-10T21:17:06.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.767+0000 7f165cf9d700 1 -- 172.21.15.154:0/3517902417 wait complete. 2023-10-10T21:17:06.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.768+0000 7f165cf9d700 1 Processor -- start 2023-10-10T21:17:06.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.768+0000 7f165cf9d700 1 -- start start 2023-10-10T21:17:06.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.769+0000 7f165cf9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580b1de0 0x7f1658151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.769+0000 7f165cf9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16580c6c60 0x7f16581570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.769+0000 7f165cf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16581595a0 0x7f1658157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.769+0000 7f165cf9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16580c4030 con 0x7f16580b1de0 2023-10-10T21:17:06.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.769+0000 7f165cf9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16580c54a0 con 0x7f16580c6c60 2023-10-10T21:17:06.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.769+0000 7f165cf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16580c5740 con 0x7f16581595a0 2023-10-10T21:17:06.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f16577fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580b1de0 0x7f1658151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f16577fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580b1de0 0x7f1658151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34138/0 (socket says 172.21.15.154:34138) 2023-10-10T21:17:06.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f16577fe700 1 -- 172.21.15.154:0/3729664759 learned_addr learned my addr 172.21.15.154:0/3729664759 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:06.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f1656ffd700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16580c6c60 0x7f16581570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f1657fff700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16581595a0 0x7f1658157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:06.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f16577fe700 1 -- 172.21.15.154:0/3729664759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16581595a0 msgr2=0x7f1658157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f16577fe700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16581595a0 0x7f1658157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f16577fe700 1 -- 172.21.15.154:0/3729664759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16580c6c60 msgr2=0x7f16581570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f16577fe700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16580c6c60 0x7f16581570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f16577fe700 1 -- 172.21.15.154:0/3729664759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c009420 con 0x7f16580b1de0 2023-10-10T21:17:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f1657fff700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16581595a0 0x7f1658157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f16577fe700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580b1de0 0x7f1658151c30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f164800e930 tx=0x7f16480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.770+0000 7f163f7fe700 1 -- 172.21.15.154:0/3729664759 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648013680 con 0x7f16580b1de0 2023-10-10T21:17:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.771+0000 7f163f7fe700 1 -- 172.21.15.154:0/3729664759 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16480137e0 con 0x7f16580b1de0 2023-10-10T21:17:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.771+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16580c5a20 con 0x7f16580b1de0 2023-10-10T21:17:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.771+0000 7f163f7fe700 1 -- 172.21.15.154:0/3729664759 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648013b80 con 0x7f16580b1de0 2023-10-10T21:17:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.771+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16580c5fe0 con 0x7f16580b1de0 2023-10-10T21:17:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.772+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16580c6350 con 0x7f16580b1de0 2023-10-10T21:17:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.773+0000 7f163f7fe700 1 -- 172.21.15.154:0/3729664759 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f164800c460 con 0x7f16580b1de0 2023-10-10T21:17:06.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.773+0000 7f163f7fe700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1644067050 0x7f1644069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:06.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.774+0000 7f163f7fe700 1 -- 172.21.15.154:0/3729664759 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f1648084ba0 con 0x7f16580b1de0 2023-10-10T21:17:06.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.774+0000 7f1656ffd700 1 -- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1644067050 msgr2=0x7f1644069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:06.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.774+0000 7f1656ffd700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1644067050 0x7f1644069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:06.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.777+0000 7f163f7fe700 1 -- 172.21.15.154:0/3729664759 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1648051980 con 0x7f16580b1de0 2023-10-10T21:17:06.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.975+0000 7f1656ffd700 1 -- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1644067050 msgr2=0x7f1644069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:06.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.975+0000 7f1656ffd700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1644067050 0x7f1644069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:06.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.991+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f165804c3c0 con 0x7f16580b1de0 2023-10-10T21:17:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.992+0000 7f163f7fe700 1 -- 172.21.15.154:0/3729664759 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16525 (secure 0 0 0) 0x7f1648054fa0 con 0x7f16580b1de0 2023-10-10T21:17:06.993 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:06.993 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":68,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:06.473898+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:15:04.691966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-10T21:15:05.529376+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6834/85496":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/1786819764":"2023-10-11T21:15:27.369273+0000","172.21.15.154:6836/85496":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/1234721096":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/181182255":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/883061507":"2023-10-11T21:15:27.369273+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1644067050 msgr2=0x7f1644069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1644067050 0x7f1644069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580b1de0 msgr2=0x7f1658151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580b1de0 0x7f1658151c30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f164800e930 tx=0x7f16480091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 shutdown_connections 2023-10-10T21:17:06.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16581595a0 0x7f1658157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16580b1de0 0x7f1658151c30 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1644067050 0x7f1644069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 --2- 172.21.15.154:0/3729664759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16580c6c60 0x7f16581570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:06.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.994+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 >> 172.21.15.154:0/3729664759 conn(0x7f165806ddb0 msgr2=0x7f16581585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:06.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.995+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 shutdown_connections 2023-10-10T21:17:06.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:06.995+0000 7f165cf9d700 1 -- 172.21.15.154:0/3729664759 wait complete. 2023-10-10T21:17:07.013 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T21:17:07.014 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:07.165 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:07.164+0000 7fb38aa79180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:17:07.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.236+0000 7fce7b59e700 1 Processor -- start 2023-10-10T21:17:07.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.236+0000 7fce7b59e700 1 -- start start 2023-10-10T21:17:07.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.237+0000 7fce7b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.237+0000 7fce7b59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c0b40f0 con 0x7fce7c06c0f0 2023-10-10T21:17:07.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.237+0000 7fce7b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c069640 con 0x7fce7c0ad870 2023-10-10T21:17:07.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.237+0000 7fce7b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c069920 con 0x7fce7c142ea0 2023-10-10T21:17:07.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7ad9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fce7c06c0f0 0x7fce7c06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40762/0 (socket says 172.21.15.154:40762) 2023-10-10T21:17:07.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7ad9d700 1 -- 172.21.15.154:0/3073285218 learned_addr learned my addr 172.21.15.154:0/3073285218 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:07.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7a59c700 1 --2- 172.21.15.154:0/3073285218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:07.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7959a700 1 -- 172.21.15.154:0/3073285218 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341633670 0 0) 0x7fce7c0b40f0 con 0x7fce7c06c0f0 2023-10-10T21:17:07.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7959a700 1 -- 172.21.15.154:0/3073285218 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce64003570 con 0x7fce7c06c0f0 2023-10-10T21:17:07.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7959a700 1 -- 172.21.15.154:0/3073285218 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202023798 0 0) 0x7fce7c069640 con 0x7fce7c0ad870 2023-10-10T21:17:07.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7959a700 1 -- 172.21.15.154:0/3073285218 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce7c0b40f0 con 0x7fce7c0ad870 2023-10-10T21:17:07.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7a59c700 1 -- 172.21.15.154:0/3073285218 >> v1:172.21.15.179:6789/0 conn(0x7fce7c0ad870 legacy=0x7fce7c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7a59c700 1 -- 172.21.15.154:0/3073285218 >> v1:172.21.15.154:6789/0 conn(0x7fce7c06c0f0 legacy=0x7fce7c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.238+0000 7fce7a59c700 1 -- 172.21.15.154:0/3073285218 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c069c00 con 0x7fce7c142ea0 2023-10-10T21:17:07.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.239+0000 7fce7a59c700 1 --2- 172.21.15.154:0/3073285218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c0b3630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009910 tx=0x7fce6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1db1c5ba8d94881 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:07.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.239+0000 7fce7959a700 1 -- 172.21.15.154:0/3073285218 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c011630 con 0x7fce7c142ea0 2023-10-10T21:17:07.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.239+0000 7fce7959a700 1 -- 172.21.15.154:0/3073285218 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c011790 con 0x7fce7c142ea0 2023-10-10T21:17:07.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.239+0000 7fce7959a700 1 -- 172.21.15.154:0/3073285218 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c011b30 con 0x7fce7c142ea0 2023-10-10T21:17:07.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.239+0000 7fce7b59e700 1 -- 172.21.15.154:0/3073285218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 msgr2=0x7fce7c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.239+0000 7fce7b59e700 1 --2- 172.21.15.154:0/3073285218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c0b3630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009910 tx=0x7fce6c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.239+0000 7fce7b59e700 1 -- 172.21.15.154:0/3073285218 shutdown_connections 2023-10-10T21:17:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.239+0000 7fce7b59e700 1 --2- 172.21.15.154:0/3073285218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c0b3630 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.239+0000 7fce7b59e700 1 -- 172.21.15.154:0/3073285218 >> 172.21.15.154:0/3073285218 conn(0x7fce7c0ce430 msgr2=0x7fce7c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.240+0000 7fce7b59e700 1 -- 172.21.15.154:0/3073285218 shutdown_connections 2023-10-10T21:17:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.240+0000 7fce7b59e700 1 -- 172.21.15.154:0/3073285218 wait complete. 2023-10-10T21:17:07.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.241+0000 7fce7b59e700 1 Processor -- start 2023-10-10T21:17:07.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.241+0000 7fce7b59e700 1 -- start start 2023-10-10T21:17:07.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce7b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce7c06c0f0 0x7fce7c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce7b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce7b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7c0c9190 0x7fce7c15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce7b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0ca280 con 0x7fce7c06c0f0 2023-10-10T21:17:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce7b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c15c590 con 0x7fce7c0c9190 2023-10-10T21:17:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce7b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0c9700 con 0x7fce7c142ea0 2023-10-10T21:17:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce7a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce7c06c0f0 0x7fce7c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce79d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:07.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce7a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce7c06c0f0 0x7fce7c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34142/0 (socket says 172.21.15.154:34142) 2023-10-10T21:17:07.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.242+0000 7fce7a59c700 1 -- 172.21.15.154:0/117866095 learned_addr learned my addr 172.21.15.154:0/117866095 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:07.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce7ad9d700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7c0c9190 0x7fce7c15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:07.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce79d9b700 1 -- 172.21.15.154:0/117866095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7c0c9190 msgr2=0x7fce7c15a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce79d9b700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7c0c9190 0x7fce7c15a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce79d9b700 1 -- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce7c06c0f0 msgr2=0x7fce7c0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce79d9b700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce7c06c0f0 0x7fce7c0cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce79d9b700 1 -- 172.21.15.154:0/117866095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c009420 con 0x7fce7c142ea0 2023-10-10T21:17:07.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce79d9b700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c158ec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c560 tx=0x7fce70007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:07.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce6a7fc700 1 -- 172.21.15.154:0/117866095 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011590 con 0x7fce7c142ea0 2023-10-10T21:17:07.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce6a7fc700 1 -- 172.21.15.154:0/117866095 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce700116f0 con 0x7fce7c142ea0 2023-10-10T21:17:07.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c0c99e0 con 0x7fce7c142ea0 2023-10-10T21:17:07.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.243+0000 7fce6a7fc700 1 -- 172.21.15.154:0/117866095 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011ab0 con 0x7fce7c142ea0 2023-10-10T21:17:07.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.244+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c0c9fa0 con 0x7fce7c142ea0 2023-10-10T21:17:07.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.244+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c15c700 con 0x7fce7c142ea0 2023-10-10T21:17:07.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.245+0000 7fce6a7fc700 1 -- 172.21.15.154:0/117866095 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fce7001c460 con 0x7fce7c142ea0 2023-10-10T21:17:07.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.246+0000 7fce6a7fc700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce5c0670d0 0x7fce5c069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.247+0000 7fce6a7fc700 1 -- 172.21.15.154:0/117866095 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6441+0+0 (secure 0 0 0) 0x7fce700845f0 con 0x7fce7c142ea0 2023-10-10T21:17:07.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.247+0000 7fce7a59c700 1 -- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce5c0670d0 msgr2=0x7fce5c069580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:07.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.247+0000 7fce7a59c700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce5c0670d0 0x7fce5c069580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:07.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.251+0000 7fce6a7fc700 1 -- 172.21.15.154:0/117866095 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce7c15c700 con 0x7fce7c142ea0 2023-10-10T21:17:07.292 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:07.291+0000 7f8d94094180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:17:07.334 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:07.333+0000 7fb38aa79180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:07.429 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:07.428+0000 7fb38aa79180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:17:07.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.448+0000 7fce7a59c700 1 -- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce5c0670d0 msgr2=0x7fce5c069580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:07.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.448+0000 7fce7a59c700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce5c0670d0 0x7fce5c069580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:07.470 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:07.469+0000 7f8d94094180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:07.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.497+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce7c15c700 con 0x7fce7c142ea0 2023-10-10T21:17:07.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.498+0000 7fce6a7fc700 1 -- 172.21.15.154:0/117866095 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fce7c15c700 con 0x7fce7c142ea0 2023-10-10T21:17:07.499 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:07.500 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1501601746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1501601746},{"type":"v1","addr":"172.21.15.179:6833","nonce":1501601746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4046528016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4046528016},{"type":"v1","addr":"172.21.15.179:6835","nonce":4046528016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5533,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/634585840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":634585840},{"type":"v1","addr":"172.21.15.154:6837","nonce":634585840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:15:06.545399+0000","modified":"2023-10-10T21:15:10.108541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6833/1321064128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1321064128},{"type":"v1","addr":"172.21.15.154:6833","nonce":1321064128}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-10T21:17:07.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce5c0670d0 msgr2=0x7fce5c069580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce5c0670d0 0x7fce5c069580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 msgr2=0x7fce7c158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c158ec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c560 tx=0x7fce70007d50 comp rx=0 tx=0).stop 2023-10-10T21:17:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 shutdown_connections 2023-10-10T21:17:07.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce5c0670d0 0x7fce5c069580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7c0c9190 0x7fce7c15a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce7c06c0f0 0x7fce7c0cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 --2- 172.21.15.154:0/117866095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7c142ea0 0x7fce7c158ec0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.500+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 >> 172.21.15.154:0/117866095 conn(0x7fce7c0ce430 msgr2=0x7fce7c141ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:07.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.501+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 shutdown_connections 2023-10-10T21:17:07.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.501+0000 7fce7b59e700 1 -- 172.21.15.154:0/117866095 wait complete. 2023-10-10T21:17:07.505 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 22 2023-10-10T21:17:07.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:07.575 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:07.574+0000 7f8d94094180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:17:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.708+0000 7fc3ac9ff700 1 Processor -- start 2023-10-10T21:17:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.708+0000 7fc3ac9ff700 1 -- start start 2023-10-10T21:17:07.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.709+0000 7fc3ac9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc3a8159890 0x7fc3a815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.709+0000 7fc3ac9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a815a160 con 0x7fc3a8159c60 2023-10-10T21:17:07.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.709+0000 7fc3ac9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a80d13a0 con 0x7fc3a8069560 2023-10-10T21:17:07.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.709+0000 7fc3ac9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a815e140 con 0x7fc3a8159890 2023-10-10T21:17:07.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.709+0000 7fc3a5d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc3a8159c60 0x7fc3a815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40774/0 (socket says 172.21.15.154:40774) 2023-10-10T21:17:07.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.709+0000 7fc3a5d9b700 1 -- 172.21.15.154:0/2799564980 learned_addr learned my addr 172.21.15.154:0/2799564980 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:07.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.710+0000 7fc3a659c700 1 --2- 172.21.15.154:0/2799564980 >> v2:172.21.15.179:3300/0 conn(0x7fc3a8159890 0x7fc3a815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:07.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.710+0000 7fc3a559a700 1 -- 172.21.15.154:0/2799564980 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103371899 0 0) 0x7fc3a80d13a0 con 0x7fc3a8069560 2023-10-10T21:17:07.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.710+0000 7fc3a559a700 1 -- 172.21.15.154:0/2799564980 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc390003570 con 0x7fc3a8069560 2023-10-10T21:17:07.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.710+0000 7fc3a559a700 1 -- 172.21.15.154:0/2799564980 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876220913 0 0) 0x7fc3a815a160 con 0x7fc3a8159c60 2023-10-10T21:17:07.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.710+0000 7fc3a559a700 1 -- 172.21.15.154:0/2799564980 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a80d13a0 con 0x7fc3a8159c60 2023-10-10T21:17:07.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.710+0000 7fc3a659c700 1 -- 172.21.15.154:0/2799564980 >> v1:172.21.15.179:6789/0 conn(0x7fc3a8069560 legacy=0x7fc3a80ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.710+0000 7fc3a659c700 1 -- 172.21.15.154:0/2799564980 >> v1:172.21.15.154:6789/0 conn(0x7fc3a8159c60 legacy=0x7fc3a815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.710+0000 7fc3a659c700 1 -- 172.21.15.154:0/2799564980 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a815a3d0 con 0x7fc3a8159890 2023-10-10T21:17:07.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.710+0000 7fc3a659c700 1 --2- 172.21.15.154:0/2799564980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8159890 0x7fc3a815abd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc3980098e0 tx=0x7fc3980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f507d6fbd75fabe server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:07.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.711+0000 7fc3a559a700 1 -- 172.21.15.154:0/2799564980 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011630 con 0x7fc3a8159890 2023-10-10T21:17:07.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.711+0000 7fc3a559a700 1 -- 172.21.15.154:0/2799564980 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398011790 con 0x7fc3a8159890 2023-10-10T21:17:07.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.711+0000 7fc3a559a700 1 -- 172.21.15.154:0/2799564980 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011b30 con 0x7fc3a8159890 2023-10-10T21:17:07.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.711+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2799564980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8159890 msgr2=0x7fc3a815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.711+0000 7fc3ac9ff700 1 --2- 172.21.15.154:0/2799564980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8159890 0x7fc3a815abd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc3980098e0 tx=0x7fc3980091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.712+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2799564980 shutdown_connections 2023-10-10T21:17:07.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.712+0000 7fc3ac9ff700 1 --2- 172.21.15.154:0/2799564980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8159890 0x7fc3a815abd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.712+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2799564980 >> 172.21.15.154:0/2799564980 conn(0x7fc3a8068e20 msgr2=0x7fc3a80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:07.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.712+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2799564980 shutdown_connections 2023-10-10T21:17:07.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.712+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2799564980 wait complete. 2023-10-10T21:17:07.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.714+0000 7fc3ac9ff700 1 Processor -- start 2023-10-10T21:17:07.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.714+0000 7fc3ac9ff700 1 -- start start 2023-10-10T21:17:07.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.715+0000 7fc3ac9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8069560 0x7fc3a80b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.715+0000 7fc3ac9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a8159890 0x7fc3a80c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.715+0000 7fc3ac9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a8159c60 0x7fc3a814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.715+0000 7fc3ac9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80c8c70 con 0x7fc3a8159c60 2023-10-10T21:17:07.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.715+0000 7fc3ac9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80c7de0 con 0x7fc3a8069560 2023-10-10T21:17:07.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.715+0000 7fc3ac9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80c8060 con 0x7fc3a8159890 2023-10-10T21:17:07.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a8159c60 0x7fc3a814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:07.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a659c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8069560 0x7fc3a80b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:07.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a5d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a8159890 0x7fc3a80c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:07.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a8159c60 0x7fc3a814d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34146/0 (socket says 172.21.15.154:34146) 2023-10-10T21:17:07.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a6d9d700 1 -- 172.21.15.154:0/2448898532 learned_addr learned my addr 172.21.15.154:0/2448898532 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:07.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a659c700 1 -- 172.21.15.154:0/2448898532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a8159890 msgr2=0x7fc3a80c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a659c700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a8159890 0x7fc3a80c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a659c700 1 -- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a8159c60 msgr2=0x7fc3a814d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a659c700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a8159c60 0x7fc3a814d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a659c700 1 -- 172.21.15.154:0/2448898532 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398009420 con 0x7fc3a8069560 2023-10-10T21:17:07.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.716+0000 7fc3a659c700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8069560 0x7fc3a80b4ad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc398016000 tx=0x7fc398017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:07.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.717+0000 7fc3967fc700 1 -- 172.21.15.154:0/2448898532 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39801f070 con 0x7fc3a8069560 2023-10-10T21:17:07.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.717+0000 7fc3967fc700 1 -- 172.21.15.154:0/2448898532 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398000bc0 con 0x7fc3a8069560 2023-10-10T21:17:07.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.717+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a80c8340 con 0x7fc3a8069560 2023-10-10T21:17:07.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.717+0000 7fc3967fc700 1 -- 172.21.15.154:0/2448898532 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398025420 con 0x7fc3a8069560 2023-10-10T21:17:07.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.717+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a80c8900 con 0x7fc3a8069560 2023-10-10T21:17:07.724 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:07.721+0000 7fb38aa79180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:17:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.718+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a804c3c0 con 0x7fc3a8069560 2023-10-10T21:17:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.719+0000 7fc3967fc700 1 -- 172.21.15.154:0/2448898532 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fc398023070 con 0x7fc3a8069560 2023-10-10T21:17:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.720+0000 7fc3967fc700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc388067050 0x7fc388069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:07.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.720+0000 7fc3967fc700 1 -- 172.21.15.154:0/2448898532 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6441+0+0 (secure 0 0 0) 0x7fc398085af0 con 0x7fc3a8069560 2023-10-10T21:17:07.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.720+0000 7fc3a5d9b700 1 -- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc388067050 msgr2=0x7fc388069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:07.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.720+0000 7fc3a5d9b700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc388067050 0x7fc388069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:07.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.724+0000 7fc3967fc700 1 -- 172.21.15.154:0/2448898532 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3980528d0 con 0x7fc3a8069560 2023-10-10T21:17:07.816 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:07.814+0000 7fb38aa79180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:17:07.884 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:07.883+0000 7f8d94094180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:17:07.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.921+0000 7fc3a5d9b700 1 -- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc388067050 msgr2=0x7fc388069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:07.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.921+0000 7fc3a5d9b700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc388067050 0x7fc388069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:07.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.969+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3a80d0f10 con 0x7fc3a8069560 2023-10-10T21:17:07.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.969+0000 7fc3967fc700 1 -- 172.21.15.154:0/2448898532 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fc398015090 con 0x7fc3a8069560 2023-10-10T21:17:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:07.971 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1501601746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1501601746},{"type":"v1","addr":"172.21.15.179:6833","nonce":1501601746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4046528016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4046528016},{"type":"v1","addr":"172.21.15.179:6835","nonce":4046528016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5533,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/634585840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":634585840},{"type":"v1","addr":"172.21.15.154:6837","nonce":634585840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:15:06.545399+0000","modified":"2023-10-10T21:15:10.108541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6833/1321064128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1321064128},{"type":"v1","addr":"172.21.15.154:6833","nonce":1321064128}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-10T21:17:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc388067050 msgr2=0x7fc388069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc388067050 0x7fc388069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8069560 msgr2=0x7fc3a80b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8069560 0x7fc3a80b4ad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc398016000 tx=0x7fc398017000 comp rx=0 tx=0).stop 2023-10-10T21:17:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 shutdown_connections 2023-10-10T21:17:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a8159c60 0x7fc3a814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc388067050 0x7fc388069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3a8069560 0x7fc3a80b4ad0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 --2- 172.21.15.154:0/2448898532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3a8159890 0x7fc3a80c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 >> 172.21.15.154:0/2448898532 conn(0x7fc3a8068e20 msgr2=0x7fc3a80c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 shutdown_connections 2023-10-10T21:17:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:07.972+0000 7fc3ac9ff700 1 -- 172.21.15.154:0/2448898532 wait complete. 2023-10-10T21:17:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 22 2023-10-10T21:17:07.985 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:07.984+0000 7f8d94094180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:17:07.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:08.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.178+0000 7f9bf759e700 1 Processor -- start 2023-10-10T21:17:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.178+0000 7f9bf759e700 1 -- start start 2023-10-10T21:17:08.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bf8159420 0x7f9bf80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf81597f0 0x7f9bf80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf80b11d0 con 0x7f9bf815d230 2023-10-10T21:17:08.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf759e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf80b14b0 con 0x7f9bf8159420 2023-10-10T21:17:08.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80b1790 con 0x7f9bf81597f0 2023-10-10T21:17:08.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bf8159420 0x7f9bf80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bf8159420 0x7f9bf80b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34154/0 (socket says 172.21.15.154:34154) 2023-10-10T21:17:08.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf5d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf81597f0 0x7f9bf80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf659c700 1 -- 172.21.15.154:0/2193959043 learned_addr learned my addr 172.21.15.154:0/2193959043 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:08.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.180+0000 7f9bf6d9d700 1 --1- 172.21.15.154:0/2193959043 >> v1:172.21.15.179:6789/0 conn(0x7f9bf815d230 0x7f9bf80b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:51880/0 (socket says 172.21.15.154:51880) 2023-10-10T21:17:08.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.181+0000 7f9bf659c700 1 -- 172.21.15.154:0/2193959043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf81597f0 msgr2=0x7f9bf80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:08.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.181+0000 7f9bf659c700 1 --2- 172.21.15.154:0/2193959043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf81597f0 0x7f9bf80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.181+0000 7f9bf659c700 1 -- 172.21.15.154:0/2193959043 >> v1:172.21.15.179:6789/0 conn(0x7f9bf815d230 legacy=0x7f9bf80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.181+0000 7f9bf659c700 1 -- 172.21.15.154:0/2193959043 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf80b1a70 con 0x7f9bf8159420 2023-10-10T21:17:08.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.181+0000 7f9bf559a700 1 -- 172.21.15.154:0/2193959043 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925280984 0 0) 0x7f9bf80b11d0 con 0x7f9bf815d230 2023-10-10T21:17:08.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.181+0000 7f9bf659c700 1 --2- 172.21.15.154:0/2193959043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 0x7f9bf80b5f40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9be80099b0 tx=0x7f9be8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee8960e94078c4b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:08.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.181+0000 7f9bf559a700 1 -- 172.21.15.154:0/2193959043 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8009ea0 con 0x7f9bf8159420 2023-10-10T21:17:08.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.181+0000 7f9bf559a700 1 -- 172.21.15.154:0/2193959043 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be800b860 con 0x7f9bf8159420 2023-10-10T21:17:08.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.181+0000 7f9bf559a700 1 -- 172.21.15.154:0/2193959043 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be800bc00 con 0x7f9bf8159420 2023-10-10T21:17:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.182+0000 7f9bf759e700 1 -- 172.21.15.154:0/2193959043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 msgr2=0x7f9bf80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.182+0000 7f9bf759e700 1 --2- 172.21.15.154:0/2193959043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 0x7f9bf80b5f40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9be80099b0 tx=0x7f9be8009250 comp rx=0 tx=0).stop 2023-10-10T21:17:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.182+0000 7f9bf759e700 1 -- 172.21.15.154:0/2193959043 shutdown_connections 2023-10-10T21:17:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.182+0000 7f9bf759e700 1 --2- 172.21.15.154:0/2193959043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 0x7f9bf80b5f40 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.182+0000 7f9bf759e700 1 --2- 172.21.15.154:0/2193959043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf81597f0 0x7f9bf80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.182+0000 7f9bf759e700 1 -- 172.21.15.154:0/2193959043 >> 172.21.15.154:0/2193959043 conn(0x7f9bf80d0660 msgr2=0x7f9bf80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.182+0000 7f9bf759e700 1 -- 172.21.15.154:0/2193959043 shutdown_connections 2023-10-10T21:17:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.182+0000 7f9bf759e700 1 -- 172.21.15.154:0/2193959043 wait complete. 2023-10-10T21:17:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.184+0000 7f9bf759e700 1 Processor -- start 2023-10-10T21:17:08.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.185+0000 7f9bf759e700 1 -- start start 2023-10-10T21:17:08.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 0x7f9bf81567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf81597f0 0x7f9bf81577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf815d230 0x7f9bf8169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80c81f0 con 0x7f9bf8159420 2023-10-10T21:17:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80c84d0 con 0x7f9bf81597f0 2023-10-10T21:17:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf816a660 con 0x7f9bf815d230 2023-10-10T21:17:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 0x7f9bf81567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 0x7f9bf81567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34156/0 (socket says 172.21.15.154:34156) 2023-10-10T21:17:08.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf659c700 1 -- 172.21.15.154:0/503889701 learned_addr learned my addr 172.21.15.154:0/503889701 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:08.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf5d9b700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf81597f0 0x7f9bf81577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.186+0000 7f9bf6d9d700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf815d230 0x7f9bf8169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.187+0000 7f9bf659c700 1 -- 172.21.15.154:0/503889701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf815d230 msgr2=0x7f9bf8169e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.187+0000 7f9bf659c700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf815d230 0x7f9bf8169e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.187+0000 7f9bf659c700 1 -- 172.21.15.154:0/503889701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf81597f0 msgr2=0x7f9bf81577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.187+0000 7f9bf659c700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf81597f0 0x7f9bf81577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.187+0000 7f9bf659c700 1 -- 172.21.15.154:0/503889701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be80094f0 con 0x7f9bf8159420 2023-10-10T21:17:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.187+0000 7f9bf5d9b700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf81597f0 0x7f9bf81577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.187+0000 7f9bf659c700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 0x7f9bf81567b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8089340 tx=0x7f9be8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:08.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.188+0000 7f9be67fc700 1 -- 172.21.15.154:0/503889701 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8000d10 con 0x7f9bf8159420 2023-10-10T21:17:08.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.188+0000 7f9be67fc700 1 -- 172.21.15.154:0/503889701 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be800bbe0 con 0x7f9bf8159420 2023-10-10T21:17:08.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.188+0000 7f9bf759e700 1 -- 172.21.15.154:0/503889701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf816a940 con 0x7f9bf8159420 2023-10-10T21:17:08.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.188+0000 7f9be67fc700 1 -- 172.21.15.154:0/503889701 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8011690 con 0x7f9bf8159420 2023-10-10T21:17:08.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.188+0000 7f9bf759e700 1 -- 172.21.15.154:0/503889701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf816a350 con 0x7f9bf8159420 2023-10-10T21:17:08.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.189+0000 7f9bd7fff700 1 -- 172.21.15.154:0/503889701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf80cc610 con 0x7f9bf8159420 2023-10-10T21:17:08.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.190+0000 7f9be67fc700 1 -- 172.21.15.154:0/503889701 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f9be8011ac0 con 0x7f9bf8159420 2023-10-10T21:17:08.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.191+0000 7f9be67fc700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9bd8067050 0x7f9bd8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.191+0000 7f9be67fc700 1 -- 172.21.15.154:0/503889701 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f9be80862c0 con 0x7f9bf8159420 2023-10-10T21:17:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.191+0000 7f9bf5d9b700 1 -- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9bd8067050 msgr2=0x7f9bd8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.191+0000 7f9bf5d9b700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9bd8067050 0x7f9bd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.195+0000 7f9be67fc700 1 -- 172.21.15.154:0/503889701 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9be80530a0 con 0x7f9bf8159420 2023-10-10T21:17:08.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.391+0000 7f9bd7fff700 1 -- 172.21.15.154:0/503889701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bf804c3c0 con 0x7f9bf8159420 2023-10-10T21:17:08.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.392+0000 7f9bf5d9b700 1 -- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9bd8067050 msgr2=0x7f9bd8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:08.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.392+0000 7f9bf5d9b700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9bd8067050 0x7f9bd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:08.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.392+0000 7f9be67fc700 1 -- 172.21.15.154:0/503889701 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16525 (secure 0 0 0) 0x7f9be80566c0 con 0x7f9bf8159420 2023-10-10T21:17:08.394 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:08.394 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":68,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:06.473898+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:15:04.691966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-10T21:15:05.529376+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6834/85496":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/1786819764":"2023-10-11T21:15:27.369273+0000","172.21.15.154:6836/85496":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/1234721096":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/181182255":"2023-10-11T21:15:27.369273+0000","172.21.15.154:0/883061507":"2023-10-11T21:15:27.369273+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:08.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.394+0000 7f9bd7fff700 1 -- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9bd8067050 msgr2=0x7f9bd8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:08.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.394+0000 7f9bd7fff700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9bd8067050 0x7f9bd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.394+0000 7f9bd7fff700 1 -- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 msgr2=0x7f9bf81567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.394+0000 7f9bd7fff700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 0x7f9bf81567b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8089340 tx=0x7f9be8017000 comp rx=0 tx=0).stop 2023-10-10T21:17:08.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.395+0000 7f9bd7fff700 1 -- 172.21.15.154:0/503889701 shutdown_connections 2023-10-10T21:17:08.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.395+0000 7f9bd7fff700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf815d230 0x7f9bf8169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.395+0000 7f9bd7fff700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf8159420 0x7f9bf81567b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.395+0000 7f9bd7fff700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9bd8067050 0x7f9bd8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.395+0000 7f9bd7fff700 1 --2- 172.21.15.154:0/503889701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf81597f0 0x7f9bf81577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.395+0000 7f9bd7fff700 1 -- 172.21.15.154:0/503889701 >> 172.21.15.154:0/503889701 conn(0x7f9bf80d0660 msgr2=0x7f9bf8158420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:08.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.395+0000 7f9bd7fff700 1 -- 172.21.15.154:0/503889701 shutdown_connections 2023-10-10T21:17:08.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.395+0000 7f9bd7fff700 1 -- 172.21.15.154:0/503889701 wait complete. 2023-10-10T21:17:08.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T21:17:08.504 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:08.503+0000 7fb38aa79180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:17:08.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.603+0000 7fc17f59e700 1 Processor -- start 2023-10-10T21:17:08.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.603+0000 7fc17f59e700 1 -- start start 2023-10-10T21:17:08.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.604+0000 7fc17f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc1801595a0 0x7fc1800b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.604+0000 7fc17f59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1800c6c60 0x7fc1800c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.604+0000 7fc17f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1800b1410 con 0x7fc1800b1de0 2023-10-10T21:17:08.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.604+0000 7fc17f59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1800b2b90 con 0x7fc1800c6c60 2023-10-10T21:17:08.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.604+0000 7fc17f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc180063230 con 0x7fc1801595a0 2023-10-10T21:17:08.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.605+0000 7fc17dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1800c6c60 0x7fc1800c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.605+0000 7fc17dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1800c6c60 0x7fc1800c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34158/0 (socket says 172.21.15.154:34158) 2023-10-10T21:17:08.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.605+0000 7fc17dd9b700 1 -- 172.21.15.154:0/3076425356 learned_addr learned my addr 172.21.15.154:0/3076425356 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:08.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.605+0000 7fc17e59c700 1 --2- 172.21.15.154:0/3076425356 >> v2:172.21.15.179:3300/0 conn(0x7fc1801595a0 0x7fc1800b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.605+0000 7fc17dd9b700 1 -- 172.21.15.154:0/3076425356 >> v2:172.21.15.179:3300/0 conn(0x7fc1801595a0 msgr2=0x7fc1800b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:08.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.605+0000 7fc17dd9b700 1 --2- 172.21.15.154:0/3076425356 >> v2:172.21.15.179:3300/0 conn(0x7fc1801595a0 0x7fc1800b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.605+0000 7fc17dd9b700 1 -- 172.21.15.154:0/3076425356 >> v1:172.21.15.179:6789/0 conn(0x7fc1800b1de0 legacy=0x7fc18015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.605+0000 7fc17dd9b700 1 -- 172.21.15.154:0/3076425356 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1800634f0 con 0x7fc1800c6c60 2023-10-10T21:17:08.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.605+0000 7fc17d59a700 1 -- 172.21.15.154:0/3076425356 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813120494 0 0) 0x7fc1800b1410 con 0x7fc1800b1de0 2023-10-10T21:17:08.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.606+0000 7fc17dd9b700 1 --2- 172.21.15.154:0/3076425356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800c6c60 0x7fc1800c8120 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc1800c8d10 tx=0x7fc174009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1626ed4c52b09ff server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.606+0000 7fc17d59a700 1 -- 172.21.15.154:0/3076425356 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174009e70 con 0x7fc1800c6c60 2023-10-10T21:17:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.606+0000 7fc17d59a700 1 -- 172.21.15.154:0/3076425356 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17400b860 con 0x7fc1800c6c60 2023-10-10T21:17:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.606+0000 7fc17d59a700 1 -- 172.21.15.154:0/3076425356 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17400bc00 con 0x7fc1800c6c60 2023-10-10T21:17:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.606+0000 7fc17f59e700 1 -- 172.21.15.154:0/3076425356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800c6c60 msgr2=0x7fc1800c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.606+0000 7fc17f59e700 1 --2- 172.21.15.154:0/3076425356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800c6c60 0x7fc1800c8120 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc1800c8d10 tx=0x7fc174009250 comp rx=0 tx=0).stop 2023-10-10T21:17:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.607+0000 7fc17f59e700 1 -- 172.21.15.154:0/3076425356 shutdown_connections 2023-10-10T21:17:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.607+0000 7fc17f59e700 1 --2- 172.21.15.154:0/3076425356 >> v2:172.21.15.179:3300/0 conn(0x7fc1801595a0 0x7fc1800b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.607+0000 7fc17f59e700 1 --2- 172.21.15.154:0/3076425356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800c6c60 0x7fc1800c8120 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.607+0000 7fc17f59e700 1 -- 172.21.15.154:0/3076425356 >> 172.21.15.154:0/3076425356 conn(0x7fc18006ddb0 msgr2=0x7fc18006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.607+0000 7fc17f59e700 1 -- 172.21.15.154:0/3076425356 shutdown_connections 2023-10-10T21:17:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.607+0000 7fc17f59e700 1 -- 172.21.15.154:0/3076425356 wait complete. 2023-10-10T21:17:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.608+0000 7fc17f59e700 1 Processor -- start 2023-10-10T21:17:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.608+0000 7fc17f59e700 1 -- start start 2023-10-10T21:17:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.609+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800b1de0 0x7fc1800c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.609+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1800c6c60 0x7fc1800c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.609+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1801595a0 0x7fc1800c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.609+0000 7fc17f59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1800c2830 con 0x7fc1800b1de0 2023-10-10T21:17:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.609+0000 7fc17f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1800c1e60 con 0x7fc1800c6c60 2023-10-10T21:17:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.609+0000 7fc17f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1800c3130 con 0x7fc1801595a0 2023-10-10T21:17:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.609+0000 7fc17e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800b1de0 0x7fc1800c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.609+0000 7fc17e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800b1de0 0x7fc1800c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34162/0 (socket says 172.21.15.154:34162) 2023-10-10T21:17:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17e59c700 1 -- 172.21.15.154:0/3808125413 learned_addr learned my addr 172.21.15.154:0/3808125413 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17dd9b700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1800c6c60 0x7fc1800c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17ed9d700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1801595a0 0x7fc1800c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17e59c700 1 -- 172.21.15.154:0/3808125413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1801595a0 msgr2=0x7fc1800c2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17e59c700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1801595a0 0x7fc1800c2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17e59c700 1 -- 172.21.15.154:0/3808125413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1800c6c60 msgr2=0x7fc1800c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17e59c700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1800c6c60 0x7fc1800c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17e59c700 1 -- 172.21.15.154:0/3808125413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740094f0 con 0x7fc1800b1de0 2023-10-10T21:17:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17dd9b700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1800c6c60 0x7fc1800c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc17e59c700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800b1de0 0x7fc1800c35e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc17000e960 tx=0x7fc1700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.610+0000 7fc16e7fc700 1 -- 172.21.15.154:0/3808125413 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000c850 con 0x7fc1800b1de0 2023-10-10T21:17:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.611+0000 7fc16e7fc700 1 -- 172.21.15.154:0/3808125413 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17000c9b0 con 0x7fc1800b1de0 2023-10-10T21:17:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.611+0000 7fc16e7fc700 1 -- 172.21.15.154:0/3808125413 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000cd50 con 0x7fc1800b1de0 2023-10-10T21:17:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.611+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1800c4180 con 0x7fc1800b1de0 2023-10-10T21:17:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.611+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1800c3ea0 con 0x7fc1800b1de0 2023-10-10T21:17:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.612+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1800c2140 con 0x7fc1800b1de0 2023-10-10T21:17:08.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.613+0000 7fc16e7fc700 1 -- 172.21.15.154:0/3808125413 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fc170013680 con 0x7fc1800b1de0 2023-10-10T21:17:08.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.614+0000 7fc16e7fc700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc160067050 0x7fc160069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:08.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.614+0000 7fc17dd9b700 1 -- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc160067050 msgr2=0x7fc160069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:08.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.614+0000 7fc16e7fc700 1 -- 172.21.15.154:0/3808125413 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6441+0+0 (secure 0 0 0) 0x7fc170084c60 con 0x7fc1800b1de0 2023-10-10T21:17:08.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.614+0000 7fc17dd9b700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc160067050 0x7fc160069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:08.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.621+0000 7fc16e7fc700 1 -- 172.21.15.154:0/3808125413 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc170051a40 con 0x7fc1800b1de0 2023-10-10T21:17:08.729 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:08.728+0000 7f8d94094180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:17:08.790 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:08.788+0000 7fb38aa79180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:17:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.815+0000 7fc17dd9b700 1 -- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc160067050 msgr2=0x7fc160069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.815+0000 7fc17dd9b700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc160067050 0x7fc160069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:08.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.866+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc18004c3c0 con 0x7fc1800b1de0 2023-10-10T21:17:08.868 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T21:17:08.867+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T21:17:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.876+0000 7fc16e7fc700 1 -- 172.21.15.154:0/3808125413 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc170055060 con 0x7fc1800b1de0 2023-10-10T21:17:08.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc160067050 msgr2=0x7fc160069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc160067050 0x7fc160069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800b1de0 msgr2=0x7fc1800c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800b1de0 0x7fc1800c35e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc17000e960 tx=0x7fc1700091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 shutdown_connections 2023-10-10T21:17:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1801595a0 0x7fc1800c2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1800b1de0 0x7fc1800c35e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc160067050 0x7fc160069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 --2- 172.21.15.154:0/3808125413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1800c6c60 0x7fc1800c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.878+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 >> 172.21.15.154:0/3808125413 conn(0x7fc18006ddb0 msgr2=0x7fc180156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.879+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 shutdown_connections 2023-10-10T21:17:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:08.879+0000 7fc17f59e700 1 -- 172.21.15.154:0/3808125413 wait complete. 2023-10-10T21:17:08.882 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:08.880+0000 7fb38aa79180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:17:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T21:17:08.899 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T21:17:08.951 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:17:09.034 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:09.032+0000 7fb38aa79180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:17:09.043 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:09.042+0000 7f8d94094180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:17:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.095+0000 7f143339d700 1 Processor -- start 2023-10-10T21:17:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.095+0000 7f143339d700 1 -- start start 2023-10-10T21:17:09.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.096+0000 7f143339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 0x7f142c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.096+0000 7f143339d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f142c0b33b0 0x7f142c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.096+0000 7f143339d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c0b2080 con 0x7f142c0b4e70 2023-10-10T21:17:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.096+0000 7f143339d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c0cfb00 con 0x7f142c0b33b0 2023-10-10T21:17:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.096+0000 7f143339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0b5c40 con 0x7f142c0b16d0 2023-10-10T21:17:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f143239b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f142c0b4e70 0x7f142c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40788/0 (socket says 172.21.15.154:40788) 2023-10-10T21:17:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f143239b700 1 -- 172.21.15.154:0/1145858410 learned_addr learned my addr 172.21.15.154:0/1145858410 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f1432b9c700 1 --2- 172.21.15.154:0/1145858410 >> v2:172.21.15.154:3300/0 conn(0x7f142c0b33b0 0x7f142c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f1431b9a700 1 --2- 172.21.15.154:0/1145858410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 0x7f142c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f1432b9c700 1 -- 172.21.15.154:0/1145858410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 msgr2=0x7f142c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f1432b9c700 1 --2- 172.21.15.154:0/1145858410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 0x7f142c0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f1432b9c700 1 -- 172.21.15.154:0/1145858410 >> v1:172.21.15.154:6789/0 conn(0x7f142c0b4e70 legacy=0x7f142c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f1432b9c700 1 -- 172.21.15.154:0/1145858410 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c0b5f20 con 0x7f142c0b33b0 2023-10-10T21:17:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f1431399700 1 -- 172.21.15.154:0/1145858410 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711162805 0 0) 0x7f142c0b2080 con 0x7f142c0b4e70 2023-10-10T21:17:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.097+0000 7f1432b9c700 1 --2- 172.21.15.154:0/1145858410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b33b0 0x7f142c0b3830 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1424009e60 tx=0x7f1424009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61c2901ed229828 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f1431399700 1 -- 172.21.15.154:0/1145858410 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142400e070 con 0x7f142c0b33b0 2023-10-10T21:17:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f1431399700 1 -- 172.21.15.154:0/1145858410 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142400bb60 con 0x7f142c0b33b0 2023-10-10T21:17:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f1431399700 1 -- 172.21.15.154:0/1145858410 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424012430 con 0x7f142c0b33b0 2023-10-10T21:17:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f143339d700 1 -- 172.21.15.154:0/1145858410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b33b0 msgr2=0x7f142c0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f143339d700 1 --2- 172.21.15.154:0/1145858410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b33b0 0x7f142c0b3830 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1424009e60 tx=0x7f1424009780 comp rx=0 tx=0).stop 2023-10-10T21:17:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f143339d700 1 -- 172.21.15.154:0/1145858410 shutdown_connections 2023-10-10T21:17:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f143339d700 1 --2- 172.21.15.154:0/1145858410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b33b0 0x7f142c0b3830 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f143339d700 1 --2- 172.21.15.154:0/1145858410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 0x7f142c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f143339d700 1 -- 172.21.15.154:0/1145858410 >> 172.21.15.154:0/1145858410 conn(0x7f142c0d10c0 msgr2=0x7f142c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:09.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f143339d700 1 -- 172.21.15.154:0/1145858410 shutdown_connections 2023-10-10T21:17:09.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.098+0000 7f143339d700 1 -- 172.21.15.154:0/1145858410 wait complete. 2023-10-10T21:17:09.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.100+0000 7f143339d700 1 Processor -- start 2023-10-10T21:17:09.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.100+0000 7f143339d700 1 -- start start 2023-10-10T21:17:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f143339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 0x7f142c0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f143339d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f142c0b33b0 0x7f142c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f143339d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b4e70 0x7f142c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f143339d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0c6660 con 0x7f142c0b4e70 2023-10-10T21:17:09.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f143339d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c16dfa0 con 0x7f142c0b33b0 2023-10-10T21:17:09.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f143339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0c5d30 con 0x7f142c0b16d0 2023-10-10T21:17:09.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f1432b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b4e70 0x7f142c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:09.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f143239b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 0x7f142c0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:09.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f1432b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b4e70 0x7f142c068f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34196/0 (socket says 172.21.15.154:34196) 2023-10-10T21:17:09.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f1432b9c700 1 -- 172.21.15.154:0/692205206 learned_addr learned my addr 172.21.15.154:0/692205206 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:09.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.101+0000 7f1431b9a700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f142c0b33b0 0x7f142c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:09.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f1432b9c700 1 -- 172.21.15.154:0/692205206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 msgr2=0x7f142c0ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:09.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f1432b9c700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 0x7f142c0ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f1432b9c700 1 -- 172.21.15.154:0/692205206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f142c0b33b0 msgr2=0x7f142c068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:09.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f1432b9c700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f142c0b33b0 0x7f142c068a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f1432b9c700 1 -- 172.21.15.154:0/692205206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1424009a20 con 0x7f142c0b4e70 2023-10-10T21:17:09.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f143239b700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 0x7f142c0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:09.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f1432b9c700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b4e70 0x7f142c068f40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f142400b6c0 tx=0x7f1424019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:09.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f14227fc700 1 -- 172.21.15.154:0/692205206 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424025440 con 0x7f142c0b4e70 2023-10-10T21:17:09.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f14227fc700 1 -- 172.21.15.154:0/692205206 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14240255c0 con 0x7f142c0b4e70 2023-10-10T21:17:09.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c0c6010 con 0x7f142c0b4e70 2023-10-10T21:17:09.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f14227fc700 1 -- 172.21.15.154:0/692205206 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424025980 con 0x7f142c0b4e70 2023-10-10T21:17:09.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.102+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c0ca790 con 0x7f142c0b4e70 2023-10-10T21:17:09.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.103+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c088990 con 0x7f142c0b4e70 2023-10-10T21:17:09.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.104+0000 7f14227fc700 1 -- 172.21.15.154:0/692205206 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f1424003050 con 0x7f142c0b4e70 2023-10-10T21:17:09.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.105+0000 7f14227fc700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 0x7f1410069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:09.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.105+0000 7f14227fc700 1 -- 172.21.15.154:0/692205206 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f1424086b10 con 0x7f142c0b4e70 2023-10-10T21:17:09.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.105+0000 7f143239b700 1 -- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 msgr2=0x7f1410069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:09.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.105+0000 7f143239b700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 0x7f1410069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:09.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.109+0000 7f14227fc700 1 -- 172.21.15.154:0/692205206 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1424053840 con 0x7f142c0b4e70 2023-10-10T21:17:09.137 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:09.135+0000 7fb38aa79180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:17:09.141 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:09.140+0000 7f8d94094180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:17:09.300 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:09.299+0000 7f8d94094180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:17:09.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.306+0000 7f143239b700 1 -- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 msgr2=0x7f1410069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:09.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.306+0000 7f143239b700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 0x7f1410069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:09.319 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:09.318+0000 7fb38aa79180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:17:09.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.355+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f142c0c67a0 con 0x7f142c0b4e70 2023-10-10T21:17:09.408 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:09.407+0000 7f8d94094180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:17:09.410 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:09.408+0000 7fb38aa79180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:17:09.500 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:09.499+0000 7fb38aa79180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:17:09.591 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:09.590+0000 7fb38aa79180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:17:09.600 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:09.599+0000 7f8d94094180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:17:09.692 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:09.691+0000 7f8d94094180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:17:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.707+0000 7f143239b700 1 -- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 msgr2=0x7f1410069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.707+0000 7f143239b700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 0x7f1410069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:17:09.784 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:09.783+0000 7f8d94094180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:17:09.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.877+0000 7f14227fc700 1 -- 172.21.15.154:0/692205206 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1424056e60 con 0x7f142c0b4e70 2023-10-10T21:17:09.879 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:09.879+0000 7f8d94094180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:17:09.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.879+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 msgr2=0x7f1410069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:09.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.879+0000 7f143339d700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 0x7f1410069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.879+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b4e70 msgr2=0x7f142c068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:09.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.879+0000 7f143339d700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b4e70 0x7f142c068f40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f142400b6c0 tx=0x7f1424019000 comp rx=0 tx=0).stop 2023-10-10T21:17:09.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.880+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 shutdown_connections 2023-10-10T21:17:09.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.880+0000 7f143339d700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0b4e70 0x7f142c068f40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.880+0000 7f143339d700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f142c0b16d0 0x7f142c0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.880+0000 7f143339d700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1410067050 0x7f1410069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.880+0000 7f143339d700 1 --2- 172.21.15.154:0/692205206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f142c0b33b0 0x7f142c068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:09.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.880+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 >> 172.21.15.154:0/692205206 conn(0x7f142c0d10c0 msgr2=0x7f142c158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:09.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.880+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 shutdown_connections 2023-10-10T21:17:09.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:09.880+0000 7f143339d700 1 -- 172.21.15.154:0/692205206 wait complete. 2023-10-10T21:17:09.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T21:17:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.103+0000 7f13c2dff700 1 Processor -- start 2023-10-10T21:17:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.103+0000 7f13c2dff700 1 -- start start 2023-10-10T21:17:10.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.104+0000 7f13c2dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13bc0c8490 0x7f13bc0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c2dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f13bc15a490 0x7f13bc068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c2dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 0x7f13bc156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c2dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc0ac030 con 0x7f13bc0c8490 2023-10-10T21:17:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c2dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc0ab820 con 0x7f13bc15a490 2023-10-10T21:17:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c2dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc06dbb0 con 0x7f13bc069a50 2023-10-10T21:17:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c0b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13bc0c8490 0x7f13bc0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c0b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13bc0c8490 0x7f13bc0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34284/0 (socket says 172.21.15.154:34284) 2023-10-10T21:17:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c0b9b700 1 -- 172.21.15.154:0/2330429640 learned_addr learned my addr 172.21.15.154:0/2330429640 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13bbfff700 1 --2- 172.21.15.154:0/2330429640 >> v2:172.21.15.179:3300/0 conn(0x7f13bc15a490 0x7f13bc068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c139c700 1 --2- 172.21.15.154:0/2330429640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 0x7f13bc156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c0b9b700 1 -- 172.21.15.154:0/2330429640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 msgr2=0x7f13bc156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c0b9b700 1 --2- 172.21.15.154:0/2330429640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 0x7f13bc156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c0b9b700 1 -- 172.21.15.154:0/2330429640 >> v2:172.21.15.179:3300/0 conn(0x7f13bc15a490 msgr2=0x7f13bc068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c0b9b700 1 --2- 172.21.15.154:0/2330429640 >> v2:172.21.15.179:3300/0 conn(0x7f13bc15a490 0x7f13bc068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.105+0000 7f13c0b9b700 1 -- 172.21.15.154:0/2330429640 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc0aba70 con 0x7f13bc0c8490 2023-10-10T21:17:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.106+0000 7f13c0b9b700 1 --2- 172.21.15.154:0/2330429640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0c8490 0x7f13bc0c6ac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f13bc06b920 tx=0x7f13b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28745da5bd8f6f22 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.106+0000 7f13bb7fe700 1 -- 172.21.15.154:0/2330429640 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b000b640 con 0x7f13bc0c8490 2023-10-10T21:17:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.106+0000 7f13bb7fe700 1 -- 172.21.15.154:0/2330429640 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b000b7a0 con 0x7f13bc0c8490 2023-10-10T21:17:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.106+0000 7f13bb7fe700 1 -- 172.21.15.154:0/2330429640 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b000bb60 con 0x7f13bc0c8490 2023-10-10T21:17:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.106+0000 7f13c2dff700 1 -- 172.21.15.154:0/2330429640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0c8490 msgr2=0x7f13bc0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:10.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.106+0000 7f13c2dff700 1 --2- 172.21.15.154:0/2330429640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0c8490 0x7f13bc0c6ac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f13bc06b920 tx=0x7f13b0009250 comp rx=0 tx=0).stop 2023-10-10T21:17:10.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.106+0000 7f13c2dff700 1 -- 172.21.15.154:0/2330429640 shutdown_connections 2023-10-10T21:17:10.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.106+0000 7f13c2dff700 1 --2- 172.21.15.154:0/2330429640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 0x7f13bc156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:10.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.107+0000 7f13c2dff700 1 --2- 172.21.15.154:0/2330429640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc0c8490 0x7f13bc0c6ac0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:10.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.107+0000 7f13c2dff700 1 --2- 172.21.15.154:0/2330429640 >> v2:172.21.15.179:3300/0 conn(0x7f13bc15a490 0x7f13bc068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:10.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.107+0000 7f13c2dff700 1 -- 172.21.15.154:0/2330429640 >> 172.21.15.154:0/2330429640 conn(0x7f13bc0c8f90 msgr2=0x7f13bc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:10.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.107+0000 7f13c2dff700 1 -- 172.21.15.154:0/2330429640 shutdown_connections 2023-10-10T21:17:10.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.107+0000 7f13c2dff700 1 -- 172.21.15.154:0/2330429640 wait complete. 2023-10-10T21:17:10.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.108+0000 7f13c2dff700 1 Processor -- start 2023-10-10T21:17:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.108+0000 7f13c2dff700 1 -- start start 2023-10-10T21:17:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c2dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 0x7f13bc1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c2dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13bc0c8490 0x7f13bc0aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c2dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc15a490 0x7f13bc1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:10.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c2dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0ab3e0 con 0x7f13bc15a490 2023-10-10T21:17:10.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c2dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0c2e70 con 0x7f13bc0c8490 2023-10-10T21:17:10.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c2dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0c1670 con 0x7f13bc069a50 2023-10-10T21:17:10.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc15a490 0x7f13bc1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:10.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc15a490 0x7f13bc1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34296/0 (socket says 172.21.15.154:34296) 2023-10-10T21:17:10.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c139c700 1 -- 172.21.15.154:0/921274947 learned_addr learned my addr 172.21.15.154:0/921274947 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:10.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13bbfff700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13bc0c8490 0x7f13bc0aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:10.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.109+0000 7f13c0b9b700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 0x7f13bc1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:10.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13c139c700 1 -- 172.21.15.154:0/921274947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 msgr2=0x7f13bc1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:10.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13c139c700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 0x7f13bc1548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:10.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13c139c700 1 -- 172.21.15.154:0/921274947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13bc0c8490 msgr2=0x7f13bc0aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:10.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13c139c700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13bc0c8490 0x7f13bc0aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:10.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13c139c700 1 -- 172.21.15.154:0/921274947 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00094f0 con 0x7f13bc15a490 2023-10-10T21:17:10.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13c139c700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc15a490 0x7f13bc1559a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009ec0 tx=0x7f13b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:10.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13b8ff9700 1 -- 172.21.15.154:0/921274947 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b400cb70 con 0x7f13bc15a490 2023-10-10T21:17:10.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13b8ff9700 1 -- 172.21.15.154:0/921274947 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b400f040 con 0x7f13bc15a490 2023-10-10T21:17:10.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc0ab160 con 0x7f13bc15a490 2023-10-10T21:17:10.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13b8ff9700 1 -- 172.21.15.154:0/921274947 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4014480 con 0x7f13bc15a490 2023-10-10T21:17:10.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.110+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc0c2b90 con 0x7f13bc15a490 2023-10-10T21:17:10.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.112+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13bc0718b0 con 0x7f13bc15a490 2023-10-10T21:17:10.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.112+0000 7f13b8ff9700 1 -- 172.21.15.154:0/921274947 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 26) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f13b4014830 con 0x7f13bc15a490 2023-10-10T21:17:10.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.113+0000 7f13b8ff9700 1 -- 172.21.15.154:0/921274947 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f13b4084dd0 con 0x7f13bc15a490 2023-10-10T21:17:10.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.118+0000 7f13b8ff9700 1 -- 172.21.15.154:0/921274947 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13b4051ef0 con 0x7f13bc15a490 2023-10-10T21:17:10.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.308+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f13bc068e00 con 0x7f13bc15a490 2023-10-10T21:17:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.894+0000 7f13b8ff9700 1 -- 172.21.15.154:0/921274947 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 27) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f13b408b080 con 0x7f13bc15a490 2023-10-10T21:17:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.895+0000 7f13b8ff9700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f13a006ca50 0x7f13a006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:10.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.896+0000 7f13c0b9b700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f13a006ca50 0x7f13a006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:10.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:10.899+0000 7f13c0b9b700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f13a006ca50 0x7f13a006ee30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f13bc06b920 tx=0x7f13b0017000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:11.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.066+0000 7f13b8ff9700 1 -- 172.21.15.154:0/921274947 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7f13b4070440 con 0x7f13bc15a490 2023-10-10T21:17:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f13a006ca50 msgr2=0x7f13a006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:11.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f13a006ca50 0x7f13a006ee30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f13bc06b920 tx=0x7f13b0017000 comp rx=0 tx=0).stop 2023-10-10T21:17:11.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc15a490 msgr2=0x7f13bc1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:11.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc15a490 0x7f13bc1559a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009ec0 tx=0x7f13b400b040 comp rx=0 tx=0).stop 2023-10-10T21:17:11.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 shutdown_connections 2023-10-10T21:17:11.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13bc15a490 0x7f13bc1559a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13bc069a50 0x7f13bc1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f13a006ca50 0x7f13a006ee30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 --2- 172.21.15.154:0/921274947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13bc0c8490 0x7f13bc0aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 >> 172.21.15.154:0/921274947 conn(0x7f13bc0c8f90 msgr2=0x7f13bc06e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:11.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 shutdown_connections 2023-10-10T21:17:11.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.070+0000 7f13c2dff700 1 -- 172.21.15.154:0/921274947 wait complete. 2023-10-10T21:17:11.074 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T21:17:11.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T21:17:11.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.276+0000 7efe0179d700 1 Processor -- start 2023-10-10T21:17:11.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.276+0000 7efe0179d700 1 -- start start 2023-10-10T21:17:11.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.277+0000 7efe0179d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efdfc0cb560 0x7efdfc0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:11.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.277+0000 7efe0179d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc159db0 con 0x7efdfc0cc970 2023-10-10T21:17:11.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.277+0000 7efe0179d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc06a470 con 0x7efdfc069ec0 2023-10-10T21:17:11.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.277+0000 7efe0179d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc06aa30 con 0x7efdfc0cb560 2023-10-10T21:17:11.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfb7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efdfc0cc970 0x7efdfc0697b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40796/0 (socket says 172.21.15.154:40796) 2023-10-10T21:17:11.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfb7fe700 1 -- 172.21.15.154:0/3161315003 learned_addr learned my addr 172.21.15.154:0/3161315003 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:11.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfbfff700 1 --2- 172.21.15.154:0/3161315003 >> v2:172.21.15.179:3300/0 conn(0x7efdfc0cb560 0x7efdfc0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:11.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109078323 0 0) 0x7efdfc159db0 con 0x7efdfc0cc970 2023-10-10T21:17:11.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde4003570 con 0x7efdfc0cc970 2023-10-10T21:17:11.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 968435893 0 0) 0x7efde4003570 con 0x7efdfc0cc970 2023-10-10T21:17:11.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 >> v2:172.21.15.179:3300/0 conn(0x7efdfc0cb560 msgr2=0x7efdfc0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:11.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 --2- 172.21.15.154:0/3161315003 >> v2:172.21.15.179:3300/0 conn(0x7efdfc0cb560 0x7efdfc0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 >> v1:172.21.15.179:6789/0 conn(0x7efdfc069ec0 legacy=0x7efdfc15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:11.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc06a750 con 0x7efdfc0cc970 2023-10-10T21:17:11.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7efdf0001470 con 0x7efdfc0cc970 2023-10-10T21:17:11.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 >> v1:172.21.15.154:6789/0 conn(0x7efdfc0cc970 legacy=0x7efdfc0697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:11.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4003ab0 0x7efde4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde4004810 0x7efde4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efde4005210 0x7efde400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc06aa30 con 0x7efde4004810 2023-10-10T21:17:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde400c1b0 con 0x7efde4005210 2023-10-10T21:17:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.278+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde400c370 con 0x7efde4003ab0 2023-10-10T21:17:11.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efdfb7fe700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde4004810 0x7efde4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:11.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efdfbfff700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4003ab0 0x7efde4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:11.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efe00f9c700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efde4005210 0x7efde400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:11.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efdfb7fe700 1 -- 172.21.15.154:0/3161315003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4003ab0 msgr2=0x7efde4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:11.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efdfb7fe700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4003ab0 0x7efde4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efdfb7fe700 1 -- 172.21.15.154:0/3161315003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efde4005210 msgr2=0x7efde400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:11.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efdfb7fe700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efde4005210 0x7efde400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efdfb7fe700 1 -- 172.21.15.154:0/3161315003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4003570 con 0x7efde4004810 2023-10-10T21:17:11.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efe00f9c700 1 -- 172.21.15.154:0/3161315003 reap_dead start 2023-10-10T21:17:11.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efdfbfff700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4003ab0 0x7efde4003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:11.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.279+0000 7efdfb7fe700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde4004810 0x7efde4004c80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c2d0 tx=0x7efdf0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc9e7d98402a6bc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:11.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf000cba0 con 0x7efde4004810 2023-10-10T21:17:11.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf000cd20 con 0x7efde4004810 2023-10-10T21:17:11.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efdfaffd700 1 -- 172.21.15.154:0/3161315003 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0005b70 con 0x7efde4004810 2023-10-10T21:17:11.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efe0179d700 1 -- 172.21.15.154:0/3161315003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde4004810 msgr2=0x7efde4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:11.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efe0179d700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde4004810 0x7efde4004c80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c2d0 tx=0x7efdf0001d80 comp rx=0 tx=0).stop 2023-10-10T21:17:11.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efe0179d700 1 -- 172.21.15.154:0/3161315003 shutdown_connections 2023-10-10T21:17:11.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efe0179d700 1 --2- 172.21.15.154:0/3161315003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde4004810 0x7efde4004c80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efe0179d700 1 -- 172.21.15.154:0/3161315003 >> 172.21.15.154:0/3161315003 conn(0x7efdfc06baf0 msgr2=0x7efdfc06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:11.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efe0179d700 1 -- 172.21.15.154:0/3161315003 shutdown_connections 2023-10-10T21:17:11.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.280+0000 7efe0179d700 1 -- 172.21.15.154:0/3161315003 wait complete. 2023-10-10T21:17:11.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.282+0000 7efe0179d700 1 Processor -- start 2023-10-10T21:17:11.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.282+0000 7efe0179d700 1 -- start start 2023-10-10T21:17:11.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe0179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4004810 0x7efdfc153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:11.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe0179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdfc14ffa0 0x7efdfc14f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:11.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe0179d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdfc169cf0 0x7efdfc16a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:11.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe0179d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0c6db0 con 0x7efdfc169cf0 2023-10-10T21:17:11.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe0179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0c7930 con 0x7efdfc14ffa0 2023-10-10T21:17:11.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe0179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0c7000 con 0x7efde4004810 2023-10-10T21:17:11.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe00f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdfc169cf0 0x7efdfc16a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:11.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe00f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdfc169cf0 0x7efdfc16a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34312/0 (socket says 172.21.15.154:34312) 2023-10-10T21:17:11.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe00f9c700 1 -- 172.21.15.154:0/2887821345 learned_addr learned my addr 172.21.15.154:0/2887821345 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:11.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efdfb7fe700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdfc14ffa0 0x7efdfc14f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:11.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efdfbfff700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4004810 0x7efdfc153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:11.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe00f9c700 1 -- 172.21.15.154:0/2887821345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4004810 msgr2=0x7efdfc153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:11.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe00f9c700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4004810 0x7efdfc153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe00f9c700 1 -- 172.21.15.154:0/2887821345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdfc14ffa0 msgr2=0x7efdfc14f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:11.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe00f9c700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdfc14ffa0 0x7efdfc14f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:11.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe00f9c700 1 -- 172.21.15.154:0/2887821345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0c72e0 con 0x7efdfc169cf0 2023-10-10T21:17:11.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.283+0000 7efe00f9c700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdfc169cf0 0x7efdfc16a160 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0b4650 tx=0x7efdf4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:11.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.284+0000 7efde3fff700 1 -- 172.21.15.154:0/2887821345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4006db0 con 0x7efdfc169cf0 2023-10-10T21:17:11.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.284+0000 7efde3fff700 1 -- 172.21.15.154:0/2887821345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4003070 con 0x7efdfc169cf0 2023-10-10T21:17:11.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.284+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc0c75c0 con 0x7efdfc169cf0 2023-10-10T21:17:11.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.284+0000 7efde3fff700 1 -- 172.21.15.154:0/2887821345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4003430 con 0x7efdfc169cf0 2023-10-10T21:17:11.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.284+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc150710 con 0x7efdfc169cf0 2023-10-10T21:17:11.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.285+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc04c3c0 con 0x7efdfc169cf0 2023-10-10T21:17:11.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.286+0000 7efde3fff700 1 -- 172.21.15.154:0/2887821345 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 27) v1 ==== 84578+0+0 (secure 0 0 0) 0x7efdf4001790 con 0x7efdfc169cf0 2023-10-10T21:17:11.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.286+0000 7efde3fff700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efde8066d80 0x7efde8069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:11.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.286+0000 7efde3fff700 1 -- 172.21.15.154:0/2887821345 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6319+0+0 (secure 0 0 0) 0x7efdf4083d90 con 0x7efdfc169cf0 2023-10-10T21:17:11.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.287+0000 7efdfbfff700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efde8066d80 0x7efde8069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:11.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.287+0000 7efdfbfff700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efde8066d80 0x7efde8069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efdec0093f0 tx=0x7efdec008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:11.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.291+0000 7efde3fff700 1 -- 172.21.15.154:0/2887821345 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdf4051050 con 0x7efdfc169cf0 2023-10-10T21:17:11.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:11.482+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efdfc0c7a70 con 0x7efdfc169cf0 2023-10-10T21:17:12.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.071+0000 7efde3fff700 1 -- 172.21.15.154:0/2887821345 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7efdf40190d0 con 0x7efdfc169cf0 2023-10-10T21:17:12.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efde8066d80 msgr2=0x7efde8069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efde8066d80 0x7efde8069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efdec0093f0 tx=0x7efdec008040 comp rx=0 tx=0).stop 2023-10-10T21:17:12.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdfc169cf0 msgr2=0x7efdfc16a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdfc169cf0 0x7efdfc16a160 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0b4650 tx=0x7efdf4009040 comp rx=0 tx=0).stop 2023-10-10T21:17:12.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 shutdown_connections 2023-10-10T21:17:12.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdfc169cf0 0x7efdfc16a160 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efde4004810 0x7efdfc153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efde8066d80 0x7efde8069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 --2- 172.21.15.154:0/2887821345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdfc14ffa0 0x7efdfc14f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.075+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 >> 172.21.15.154:0/2887821345 conn(0x7efdfc06baf0 msgr2=0x7efdfc0c4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:12.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.076+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 shutdown_connections 2023-10-10T21:17:12.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.076+0000 7efe0179d700 1 -- 172.21.15.154:0/2887821345 wait complete. 2023-10-10T21:17:12.080 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T21:17:12.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T21:17:12.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.286+0000 7fc1b31ff700 1 Processor -- start 2023-10-10T21:17:12.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.286+0000 7fc1b31ff700 1 -- start start 2023-10-10T21:17:12.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.287+0000 7fc1b31ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c83f0 0x7fc1ac0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.287+0000 7fc1b31ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1ac0ccee0 0x7fc1ac1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1b31ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac15b0d0 con 0x7fc1ac0c87c0 2023-10-10T21:17:12.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1b31ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0c7a60 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1b31ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac15a4c0 con 0x7fc1ac0c83f0 2023-10-10T21:17:12.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1abfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1ac0ccee0 0x7fc1ac1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1b179c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc1ac0c87c0 0x7fc1ac06eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40806/0 (socket says 172.21.15.154:40806) 2023-10-10T21:17:12.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1b179c700 1 -- 172.21.15.154:0/3184086924 learned_addr learned my addr 172.21.15.154:0/3184086924 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:12.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1b0f9b700 1 --2- 172.21.15.154:0/3184086924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c83f0 0x7fc1ac0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1abfff700 1 -- 172.21.15.154:0/3184086924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c83f0 msgr2=0x7fc1ac0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:12.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1abfff700 1 --2- 172.21.15.154:0/3184086924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c83f0 0x7fc1ac0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1abfff700 1 -- 172.21.15.154:0/3184086924 >> v1:172.21.15.154:6789/0 conn(0x7fc1ac0c87c0 legacy=0x7fc1ac06eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1abfff700 1 -- 172.21.15.154:0/3184086924 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac15a7a0 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1ab7fe700 1 -- 172.21.15.154:0/3184086924 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484757729 0 0) 0x7fc1ac15b0d0 con 0x7fc1ac0c87c0 2023-10-10T21:17:12.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.288+0000 7fc1b0f9b700 1 --2- 172.21.15.154:0/3184086924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c83f0 0x7fc1ac0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:17:12.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1abfff700 1 --2- 172.21.15.154:0/3184086924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 0x7fc1ac1561d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc1980098e0 tx=0x7fc1980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ef09d3672269a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:12.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1ab7fe700 1 -- 172.21.15.154:0/3184086924 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198009e80 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1ab7fe700 1 -- 172.21.15.154:0/3184086924 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19800b860 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1ab7fe700 1 -- 172.21.15.154:0/3184086924 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19800bbe0 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1b31ff700 1 -- 172.21.15.154:0/3184086924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 msgr2=0x7fc1ac1561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1b31ff700 1 --2- 172.21.15.154:0/3184086924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 0x7fc1ac1561d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc1980098e0 tx=0x7fc1980091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1b31ff700 1 -- 172.21.15.154:0/3184086924 shutdown_connections 2023-10-10T21:17:12.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1b31ff700 1 --2- 172.21.15.154:0/3184086924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c83f0 0x7fc1ac0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1b31ff700 1 --2- 172.21.15.154:0/3184086924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 0x7fc1ac1561d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.289+0000 7fc1b31ff700 1 -- 172.21.15.154:0/3184086924 >> 172.21.15.154:0/3184086924 conn(0x7fc1ac068e10 msgr2=0x7fc1ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:12.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.290+0000 7fc1b31ff700 1 -- 172.21.15.154:0/3184086924 shutdown_connections 2023-10-10T21:17:12.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.290+0000 7fc1b31ff700 1 -- 172.21.15.154:0/3184086924 wait complete. 2023-10-10T21:17:12.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.291+0000 7fc1b31ff700 1 Processor -- start 2023-10-10T21:17:12.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.291+0000 7fc1b31ff700 1 -- start start 2023-10-10T21:17:12.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b31ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ac0c83f0 0x7fc1ac0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b31ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c87c0 0x7fc1ac149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b31ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 0x7fc1ac14f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b31ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac154780 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b31ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0b1140 con 0x7fc1ac0c83f0 2023-10-10T21:17:12.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b31ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac153e50 con 0x7fc1ac0c87c0 2023-10-10T21:17:12.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b179c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 0x7fc1ac14f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b179c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 0x7fc1ac14f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34326/0 (socket says 172.21.15.154:34326) 2023-10-10T21:17:12.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b179c700 1 -- 172.21.15.154:0/1751601223 learned_addr learned my addr 172.21.15.154:0/1751601223 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:12.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1b0f9b700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ac0c83f0 0x7fc1ac0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.292+0000 7fc1abfff700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c87c0 0x7fc1ac149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1b179c700 1 -- 172.21.15.154:0/1751601223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c87c0 msgr2=0x7fc1ac149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1b179c700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c87c0 0x7fc1ac149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1b179c700 1 -- 172.21.15.154:0/1751601223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ac0c83f0 msgr2=0x7fc1ac0b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1b179c700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ac0c83f0 0x7fc1ac0b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1b179c700 1 -- 172.21.15.154:0/1751601223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198009420 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1b179c700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 0x7fc1ac14f160 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400cc90 tx=0x7fc1a4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:12.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1a8ff9700 1 -- 172.21.15.154:0/1751601223 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400a8b0 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1a8ff9700 1 -- 172.21.15.154:0/1751601223 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a400aa10 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1a8ff9700 1 -- 172.21.15.154:0/1751601223 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400add0 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac154130 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.293+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac14f6a0 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.294+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac04c3c0 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.295+0000 7fc1a8ff9700 1 -- 172.21.15.154:0/1751601223 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1a4007300 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.296+0000 7fc1a8ff9700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc190066f30 0x7fc1900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.296+0000 7fc1a8ff9700 1 -- 172.21.15.154:0/1751601223 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5847+0+0 (secure 0 0 0) 0x7fc1a40849c0 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.296+0000 7fc1b0f9b700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc190066f30 0x7fc1900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.297+0000 7fc1b0f9b700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc190066f30 0x7fc1900693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000adc0 tx=0x7fc1a0006f90 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:12.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.301+0000 7fc1a8ff9700 1 -- 172.21.15.154:0/1751601223 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1a4051b80 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.493+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc1ac15aa80 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.498+0000 7fc1a8ff9700 1 -- 172.21.15.154:0/1751601223 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc1a40551a0 con 0x7fc1ac0ccee0 2023-10-10T21:17:12.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc190066f30 msgr2=0x7fc1900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc190066f30 0x7fc1900693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000adc0 tx=0x7fc1a0006f90 comp rx=0 tx=0).stop 2023-10-10T21:17:12.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 msgr2=0x7fc1ac14f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 0x7fc1ac14f160 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400cc90 tx=0x7fc1a4001a80 comp rx=0 tx=0).stop 2023-10-10T21:17:12.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 shutdown_connections 2023-10-10T21:17:12.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ac0ccee0 0x7fc1ac14f160 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc190066f30 0x7fc1900693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ac0c83f0 0x7fc1ac0b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 --2- 172.21.15.154:0/1751601223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ac0c87c0 0x7fc1ac149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 >> 172.21.15.154:0/1751601223 conn(0x7fc1ac068e10 msgr2=0x7fc1ac06f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:12.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.500+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 shutdown_connections 2023-10-10T21:17:12.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.501+0000 7fc1b31ff700 1 -- 172.21.15.154:0/1751601223 wait complete. 2023-10-10T21:17:12.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T21:17:12.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.703+0000 7f44fe5ff700 1 Processor -- start 2023-10-10T21:17:12.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.703+0000 7f44fe5ff700 1 -- start start 2023-10-10T21:17:12.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.704+0000 7f44fe5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f8159890 0x7f44f815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.704+0000 7f44fe5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f44f8159c60 0x7f44f815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.704+0000 7f44fe5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44f815db10 0x7f44f8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.704+0000 7f44fe5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f815a160 con 0x7f44f815db10 2023-10-10T21:17:12.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fe5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f80d13a0 con 0x7f44f8159c60 2023-10-10T21:17:12.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fe5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f815e140 con 0x7f44f8159890 2023-10-10T21:17:12.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fcb9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44f815db10 0x7f44f8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fcb9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44f815db10 0x7f44f8069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34330/0 (socket says 172.21.15.154:34330) 2023-10-10T21:17:12.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fcb9c700 1 -- 172.21.15.154:0/3977855942 learned_addr learned my addr 172.21.15.154:0/3977855942 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:12.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44f7fff700 1 --2- 172.21.15.154:0/3977855942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f8159890 0x7f44f815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44f77fe700 1 --2- 172.21.15.154:0/3977855942 >> v2:172.21.15.179:3300/0 conn(0x7f44f8159c60 0x7f44f815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fcb9c700 1 -- 172.21.15.154:0/3977855942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f8159890 msgr2=0x7f44f815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:12.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fcb9c700 1 --2- 172.21.15.154:0/3977855942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f8159890 0x7f44f815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fcb9c700 1 -- 172.21.15.154:0/3977855942 >> v2:172.21.15.179:3300/0 conn(0x7f44f8159c60 msgr2=0x7f44f815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:12.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fcb9c700 1 --2- 172.21.15.154:0/3977855942 >> v2:172.21.15.179:3300/0 conn(0x7f44f8159c60 0x7f44f815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fcb9c700 1 -- 172.21.15.154:0/3977855942 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f815a3d0 con 0x7f44f815db10 2023-10-10T21:17:12.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.705+0000 7f44fcb9c700 1 --2- 172.21.15.154:0/3977855942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f815db10 0x7f44f8069560 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f44f80650f0 tx=0x7f44f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65a4522c77c61e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:12.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44f6ffd700 1 -- 172.21.15.154:0/3977855942 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f000e070 con 0x7f44f815db10 2023-10-10T21:17:12.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44f6ffd700 1 -- 172.21.15.154:0/3977855942 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f000ba50 con 0x7f44f815db10 2023-10-10T21:17:12.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44f6ffd700 1 -- 172.21.15.154:0/3977855942 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00092e0 con 0x7f44f815db10 2023-10-10T21:17:12.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44fe5ff700 1 -- 172.21.15.154:0/3977855942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f815db10 msgr2=0x7f44f8069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/3977855942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f815db10 0x7f44f8069560 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f44f80650f0 tx=0x7f44f0009840 comp rx=0 tx=0).stop 2023-10-10T21:17:12.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44fe5ff700 1 -- 172.21.15.154:0/3977855942 shutdown_connections 2023-10-10T21:17:12.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/3977855942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f815db10 0x7f44f8069560 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/3977855942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f8159890 0x7f44f815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/3977855942 >> v2:172.21.15.179:3300/0 conn(0x7f44f8159c60 0x7f44f815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44fe5ff700 1 -- 172.21.15.154:0/3977855942 >> 172.21.15.154:0/3977855942 conn(0x7f44f8068e20 msgr2=0x7f44f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:12.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.706+0000 7f44fe5ff700 1 -- 172.21.15.154:0/3977855942 shutdown_connections 2023-10-10T21:17:12.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.707+0000 7f44fe5ff700 1 -- 172.21.15.154:0/3977855942 wait complete. 2023-10-10T21:17:12.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.708+0000 7f44fe5ff700 1 Processor -- start 2023-10-10T21:17:12.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.708+0000 7f44fe5ff700 1 -- start start 2023-10-10T21:17:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44fe5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f8159890 0x7f44f8150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44fe5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f8159c60 0x7f44f80cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44fe5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f815db10 0x7f44f80cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44fe5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f8155460 con 0x7f44f8159890 2023-10-10T21:17:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44fe5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f8155180 con 0x7f44f8159c60 2023-10-10T21:17:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44fe5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80b0760 con 0x7f44f815db10 2023-10-10T21:17:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44f7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f8159890 0x7f44f8150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44f7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f8159890 0x7f44f8150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34342/0 (socket says 172.21.15.154:34342) 2023-10-10T21:17:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44f7fff700 1 -- 172.21.15.154:0/261698576 learned_addr learned my addr 172.21.15.154:0/261698576 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44fcb9c700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f815db10 0x7f44f80cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.709+0000 7f44f77fe700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f8159c60 0x7f44f80cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44f7fff700 1 -- 172.21.15.154:0/261698576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f815db10 msgr2=0x7f44f80cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44f7fff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f815db10 0x7f44f80cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44f7fff700 1 -- 172.21.15.154:0/261698576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f8159c60 msgr2=0x7f44f80cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44f7fff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f8159c60 0x7f44f80cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44f7fff700 1 -- 172.21.15.154:0/261698576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f0009ae0 con 0x7f44f8159890 2023-10-10T21:17:12.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44f7fff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f8159890 0x7f44f8150ff0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f44e800d890 tx=0x7f44e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:12.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44dffff700 1 -- 172.21.15.154:0/261698576 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e80125f0 con 0x7f44f8159890 2023-10-10T21:17:12.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44dffff700 1 -- 172.21.15.154:0/261698576 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e8012770 con 0x7f44f8159890 2023-10-10T21:17:12.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44dffff700 1 -- 172.21.15.154:0/261698576 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8012b30 con 0x7f44f8159890 2023-10-10T21:17:12.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f80b0a40 con 0x7f44f8159890 2023-10-10T21:17:12.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.710+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f80b3590 con 0x7f44f8159890 2023-10-10T21:17:12.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.711+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f80b05c0 con 0x7f44f8159890 2023-10-10T21:17:12.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.712+0000 7f44dffff700 1 -- 172.21.15.154:0/261698576 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44e801e460 con 0x7f44f8159890 2023-10-10T21:17:12.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.713+0000 7f44dffff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44e4066f30 0x7f44e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:12.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.713+0000 7f44dffff700 1 -- 172.21.15.154:0/261698576 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f44e8084be0 con 0x7f44f8159890 2023-10-10T21:17:12.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.713+0000 7f44f77fe700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44e4066f30 0x7f44e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:12.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.714+0000 7f44f77fe700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44e4066f30 0x7f44e40693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f44ec006fd0 tx=0x7f44ec008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:12.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.717+0000 7f44dffff700 1 -- 172.21.15.154:0/261698576 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44f80b05c0 con 0x7f44f8159890 2023-10-10T21:17:12.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.920+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f44f80b05c0 con 0x7f44f8159890 2023-10-10T21:17:12.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.923+0000 7f44dffff700 1 -- 172.21.15.154:0/261698576 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v20) v1 ==== 115+0+0 (secure 0 0 0) 0x7f44f80b05c0 con 0x7f44f8159890 2023-10-10T21:17:12.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44e4066f30 msgr2=0x7f44e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44e4066f30 0x7f44e40693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f44ec006fd0 tx=0x7f44ec008040 comp rx=0 tx=0).stop 2023-10-10T21:17:12.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f8159890 msgr2=0x7f44f8150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:12.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f8159890 0x7f44f8150ff0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f44e800d890 tx=0x7f44e8008040 comp rx=0 tx=0).stop 2023-10-10T21:17:12.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 shutdown_connections 2023-10-10T21:17:12.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44f815db10 0x7f44f80cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44f8159890 0x7f44f8150ff0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44e4066f30 0x7f44e40693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 --2- 172.21.15.154:0/261698576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f8159c60 0x7f44f80cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 >> 172.21.15.154:0/261698576 conn(0x7f44f8068e20 msgr2=0x7f44f8152c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 shutdown_connections 2023-10-10T21:17:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:12.926+0000 7f44fe5ff700 1 -- 172.21.15.154:0/261698576 wait complete. 2023-10-10T21:17:12.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T21:17:13.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.131+0000 7fabce79d700 1 Processor -- start 2023-10-10T21:17:13.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.131+0000 7fabce79d700 1 -- start start 2023-10-10T21:17:13.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.132+0000 7fabce79d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabc80b4e70 0x7fabc80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.132+0000 7fabce79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabc80b1b40 0x7fabc815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.132+0000 7fabce79d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80cfb00 con 0x7fabc80b16d0 2023-10-10T21:17:13.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.132+0000 7fabce79d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc80b5c40 con 0x7fabc80b4e70 2023-10-10T21:17:13.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.132+0000 7fabce79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc80b5f20 con 0x7fabc80b1b40 2023-10-10T21:17:13.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.132+0000 7fabcd79b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabc80b4e70 0x7fabc80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabcd79b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabc80b4e70 0x7fabc80ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34350/0 (socket says 172.21.15.154:34350) 2023-10-10T21:17:13.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.132+0000 7fabccf9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fabc80b16d0 0x7fabc815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40820/0 (socket says 172.21.15.154:40820) 2023-10-10T21:17:13.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabcd79b700 1 -- 172.21.15.154:0/2546264121 learned_addr learned my addr 172.21.15.154:0/2546264121 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:13.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabcdf9c700 1 --2- 172.21.15.154:0/2546264121 >> v2:172.21.15.179:3300/0 conn(0x7fabc80b1b40 0x7fabc815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabcd79b700 1 -- 172.21.15.154:0/2546264121 >> v2:172.21.15.179:3300/0 conn(0x7fabc80b1b40 msgr2=0x7fabc815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:13.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabcd79b700 1 --2- 172.21.15.154:0/2546264121 >> v2:172.21.15.179:3300/0 conn(0x7fabc80b1b40 0x7fabc815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabcd79b700 1 -- 172.21.15.154:0/2546264121 >> v1:172.21.15.154:6789/0 conn(0x7fabc80b16d0 legacy=0x7fabc815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:13.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabcd79b700 1 -- 172.21.15.154:0/2546264121 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80b6200 con 0x7fabc80b4e70 2023-10-10T21:17:13.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabbffff700 1 -- 172.21.15.154:0/2546264121 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607090282 0 0) 0x7fabc80cfb00 con 0x7fabc80b16d0 2023-10-10T21:17:13.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabcd79b700 1 --2- 172.21.15.154:0/2546264121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b4e70 0x7fabc80ccff0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fabc8071380 tx=0x7fabc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32eede66f50cf2e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:13.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.133+0000 7fabbffff700 1 -- 172.21.15.154:0/2546264121 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400b860 con 0x7fabc80b4e70 2023-10-10T21:17:13.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabbffff700 1 -- 172.21.15.154:0/2546264121 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc400b9c0 con 0x7fabc80b4e70 2023-10-10T21:17:13.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabbffff700 1 -- 172.21.15.154:0/2546264121 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400bd60 con 0x7fabc80b4e70 2023-10-10T21:17:13.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabce79d700 1 -- 172.21.15.154:0/2546264121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b4e70 msgr2=0x7fabc80ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:13.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabce79d700 1 --2- 172.21.15.154:0/2546264121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b4e70 0x7fabc80ccff0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fabc8071380 tx=0x7fabc4009250 comp rx=0 tx=0).stop 2023-10-10T21:17:13.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabce79d700 1 -- 172.21.15.154:0/2546264121 shutdown_connections 2023-10-10T21:17:13.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabce79d700 1 --2- 172.21.15.154:0/2546264121 >> v2:172.21.15.179:3300/0 conn(0x7fabc80b1b40 0x7fabc815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabce79d700 1 --2- 172.21.15.154:0/2546264121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b4e70 0x7fabc80ccff0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabce79d700 1 -- 172.21.15.154:0/2546264121 >> 172.21.15.154:0/2546264121 conn(0x7fabc80d10c0 msgr2=0x7fabc80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:13.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabce79d700 1 -- 172.21.15.154:0/2546264121 shutdown_connections 2023-10-10T21:17:13.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.134+0000 7fabce79d700 1 -- 172.21.15.154:0/2546264121 wait complete. 2023-10-10T21:17:13.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.136+0000 7fabce79d700 1 Processor -- start 2023-10-10T21:17:13.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.136+0000 7fabce79d700 1 -- start start 2023-10-10T21:17:13.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabce79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc80b16d0 0x7fabc80cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabce79d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b1b40 0x7fabc815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabce79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc80b4e70 0x7fabc815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabce79d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80cbef0 con 0x7fabc80b1b40 2023-10-10T21:17:13.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabce79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc815c380 con 0x7fabc80b4e70 2023-10-10T21:17:13.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabce79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80cb2e0 con 0x7fabc80b16d0 2023-10-10T21:17:13.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabccf9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b1b40 0x7fabc815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabccf9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b1b40 0x7fabc815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34364/0 (socket says 172.21.15.154:34364) 2023-10-10T21:17:13.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabccf9a700 1 -- 172.21.15.154:0/2689982720 learned_addr learned my addr 172.21.15.154:0/2689982720 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:13.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabcd79b700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc80b16d0 0x7fabc80cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabcdf9c700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc80b4e70 0x7fabc815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabccf9a700 1 -- 172.21.15.154:0/2689982720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc80b16d0 msgr2=0x7fabc80cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:13.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabccf9a700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc80b16d0 0x7fabc80cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabccf9a700 1 -- 172.21.15.154:0/2689982720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc80b4e70 msgr2=0x7fabc815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:13.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabccf9a700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc80b4e70 0x7fabc815cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabccf9a700 1 -- 172.21.15.154:0/2689982720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc40094f0 con 0x7fabc80b1b40 2023-10-10T21:17:13.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.137+0000 7fabccf9a700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b1b40 0x7fabc815be40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fabb80011e0 tx=0x7fabb8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:13.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.138+0000 7fabbd7fa700 1 -- 172.21.15.154:0/2689982720 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8007300 con 0x7fabc80b1b40 2023-10-10T21:17:13.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.138+0000 7fabbd7fa700 1 -- 172.21.15.154:0/2689982720 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8007460 con 0x7fabc80b1b40 2023-10-10T21:17:13.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.138+0000 7fabbd7fa700 1 -- 172.21.15.154:0/2689982720 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8004830 con 0x7fabc80b1b40 2023-10-10T21:17:13.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.138+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc80cb5c0 con 0x7fabc80b1b40 2023-10-10T21:17:13.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.138+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc80cbb80 con 0x7fabc80b1b40 2023-10-10T21:17:13.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.139+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc8088990 con 0x7fabc80b1b40 2023-10-10T21:17:13.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.140+0000 7fabbd7fa700 1 -- 172.21.15.154:0/2689982720 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabb8004be0 con 0x7fabc80b1b40 2023-10-10T21:17:13.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.141+0000 7fabbd7fa700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fabac066f30 0x7fabac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.141+0000 7fabbd7fa700 1 -- 172.21.15.154:0/2689982720 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5847+0+0 (secure 0 0 0) 0x7fabb8083b70 con 0x7fabc80b1b40 2023-10-10T21:17:13.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.141+0000 7fabcd79b700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fabac066f30 0x7fabac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.141+0000 7fabcd79b700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fabac066f30 0x7fabac0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fabc8071380 tx=0x7fabc4017000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:13.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.145+0000 7fabbd7fa700 1 -- 172.21.15.154:0/2689982720 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabb8050d30 con 0x7fabc80b1b40 2023-10-10T21:17:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.336+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fabc804bb80 con 0x7fabc80b1b40 2023-10-10T21:17:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.340+0000 7fabbd7fa700 1 -- 172.21.15.154:0/2689982720 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7fabb80180b0 con 0x7fabc80b1b40 2023-10-10T21:17:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.342+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fabac066f30 msgr2=0x7fabac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.342+0000 7fabce79d700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fabac066f30 0x7fabac0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fabc8071380 tx=0x7fabc4017000 comp rx=0 tx=0).stop 2023-10-10T21:17:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.342+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b1b40 msgr2=0x7fabc815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.342+0000 7fabce79d700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b1b40 0x7fabc815be40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fabb80011e0 tx=0x7fabb8007e10 comp rx=0 tx=0).stop 2023-10-10T21:17:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.343+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 shutdown_connections 2023-10-10T21:17:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.343+0000 7fabce79d700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fabac066f30 0x7fabac0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.343+0000 7fabce79d700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc80b4e70 0x7fabc815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.343+0000 7fabce79d700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc80b16d0 0x7fabc80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.343+0000 7fabce79d700 1 --2- 172.21.15.154:0/2689982720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabc80b1b40 0x7fabc815be40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.343+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 >> 172.21.15.154:0/2689982720 conn(0x7fabc80d10c0 msgr2=0x7fabc80b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.343+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 shutdown_connections 2023-10-10T21:17:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.343+0000 7fabce79d700 1 -- 172.21.15.154:0/2689982720 wait complete. 2023-10-10T21:17:13.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-10T21:17:13.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.542+0000 7f1f8559d700 1 Processor -- start 2023-10-10T21:17:13.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.542+0000 7f1f8559d700 1 -- start start 2023-10-10T21:17:13.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f8559d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1f80150180 0x7f1f80157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f8559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150550 0x7f1f800c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f8559d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f800c7240 0x7f1f8006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f8559d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f800c76c0 con 0x7f1f800c7240 2023-10-10T21:17:13.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f8559d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8006e2a0 con 0x7f1f80150180 2023-10-10T21:17:13.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f8559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8006b2e0 con 0x7f1f80150550 2023-10-10T21:17:13.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f84d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f800c7240 0x7f1f8006e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f84d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f800c7240 0x7f1f8006e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34378/0 (socket says 172.21.15.154:34378) 2023-10-10T21:17:13.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f84d9c700 1 -- 172.21.15.154:0/1975473343 learned_addr learned my addr 172.21.15.154:0/1975473343 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:13.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f7ffff700 1 --2- 172.21.15.154:0/1975473343 >> v2:172.21.15.179:3300/0 conn(0x7f1f80150180 0x7f1f80157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.544+0000 7f1f7f7fe700 1 --2- 172.21.15.154:0/1975473343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150550 0x7f1f800c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f84d9c700 1 -- 172.21.15.154:0/1975473343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150550 msgr2=0x7f1f800c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:13.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f84d9c700 1 --2- 172.21.15.154:0/1975473343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150550 0x7f1f800c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f84d9c700 1 -- 172.21.15.154:0/1975473343 >> v2:172.21.15.179:3300/0 conn(0x7f1f80150180 msgr2=0x7f1f80157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:13.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f84d9c700 1 --2- 172.21.15.154:0/1975473343 >> v2:172.21.15.179:3300/0 conn(0x7f1f80150180 0x7f1f80157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f84d9c700 1 -- 172.21.15.154:0/1975473343 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800c78e0 con 0x7f1f800c7240 2023-10-10T21:17:13.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f7f7fe700 1 --2- 172.21.15.154:0/1975473343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150550 0x7f1f800c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:13.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f84d9c700 1 --2- 172.21.15.154:0/1975473343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f800c7240 0x7f1f8006e730 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009f50 tx=0x7f1f78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859317c861b28c5e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:13.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f7effd700 1 -- 172.21.15.154:0/1975473343 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800e070 con 0x7f1f800c7240 2023-10-10T21:17:13.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f7effd700 1 -- 172.21.15.154:0/1975473343 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7800b980 con 0x7f1f800c7240 2023-10-10T21:17:13.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.545+0000 7f1f7effd700 1 -- 172.21.15.154:0/1975473343 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780092e0 con 0x7f1f800c7240 2023-10-10T21:17:13.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.546+0000 7f1f8559d700 1 -- 172.21.15.154:0/1975473343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f800c7240 msgr2=0x7f1f8006e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:13.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.546+0000 7f1f8559d700 1 --2- 172.21.15.154:0/1975473343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f800c7240 0x7f1f8006e730 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009f50 tx=0x7f1f78009840 comp rx=0 tx=0).stop 2023-10-10T21:17:13.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.546+0000 7f1f8559d700 1 -- 172.21.15.154:0/1975473343 shutdown_connections 2023-10-10T21:17:13.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.546+0000 7f1f8559d700 1 --2- 172.21.15.154:0/1975473343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f800c7240 0x7f1f8006e730 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.546+0000 7f1f8559d700 1 --2- 172.21.15.154:0/1975473343 >> v2:172.21.15.179:3300/0 conn(0x7f1f80150180 0x7f1f80157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.546+0000 7f1f8559d700 1 --2- 172.21.15.154:0/1975473343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150550 0x7f1f800c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.546+0000 7f1f8559d700 1 -- 172.21.15.154:0/1975473343 >> 172.21.15.154:0/1975473343 conn(0x7f1f800cc1f0 msgr2=0x7f1f800cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:13.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.546+0000 7f1f8559d700 1 -- 172.21.15.154:0/1975473343 shutdown_connections 2023-10-10T21:17:13.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.546+0000 7f1f8559d700 1 -- 172.21.15.154:0/1975473343 wait complete. 2023-10-10T21:17:13.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.547+0000 7f1f8559d700 1 Processor -- start 2023-10-10T21:17:13.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.547+0000 7f1f8559d700 1 -- start start 2023-10-10T21:17:13.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.548+0000 7f1f8559d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f800c7240 0x7f1f801697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.548+0000 7f1f8559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150180 0x7f1f800b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.548+0000 7f1f8559d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f80150550 0x7f1f800ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.548+0000 7f1f8559d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800af370 con 0x7f1f80150550 2023-10-10T21:17:13.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.548+0000 7f1f8559d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800af650 con 0x7f1f800c7240 2023-10-10T21:17:13.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.548+0000 7f1f8559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800af930 con 0x7f1f80150180 2023-10-10T21:17:13.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f84d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f80150550 0x7f1f800ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f84d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f80150550 0x7f1f800ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34394/0 (socket says 172.21.15.154:34394) 2023-10-10T21:17:13.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f84d9c700 1 -- 172.21.15.154:0/529869857 learned_addr learned my addr 172.21.15.154:0/529869857 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:13.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f7ffff700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f800c7240 0x7f1f801697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f7f7fe700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150180 0x7f1f800b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f84d9c700 1 -- 172.21.15.154:0/529869857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150180 msgr2=0x7f1f800b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:13.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f84d9c700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150180 0x7f1f800b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f84d9c700 1 -- 172.21.15.154:0/529869857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f800c7240 msgr2=0x7f1f801697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:13.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f84d9c700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f800c7240 0x7f1f801697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:13.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f84d9c700 1 -- 172.21.15.154:0/529869857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78009ae0 con 0x7f1f80150550 2023-10-10T21:17:13.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.549+0000 7f1f84d9c700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f80150550 0x7f1f800ca6e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009880 tx=0x7f1f78018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:13.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.550+0000 7f1f67fff700 1 -- 172.21.15.154:0/529869857 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78008ad0 con 0x7f1f80150550 2023-10-10T21:17:13.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.550+0000 7f1f67fff700 1 -- 172.21.15.154:0/529869857 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f78008c70 con 0x7f1f80150550 2023-10-10T21:17:13.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.550+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f800afc10 con 0x7f1f80150550 2023-10-10T21:17:13.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.550+0000 7f1f67fff700 1 -- 172.21.15.154:0/529869857 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7801c410 con 0x7f1f80150550 2023-10-10T21:17:13.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.550+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f800aef90 con 0x7f1f80150550 2023-10-10T21:17:13.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.551+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8004c3c0 con 0x7f1f80150550 2023-10-10T21:17:13.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.552+0000 7f1f67fff700 1 -- 172.21.15.154:0/529869857 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f78003040 con 0x7f1f80150550 2023-10-10T21:17:13.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.552+0000 7f1f67fff700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f6c066f30 0x7f1f6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:13.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.552+0000 7f1f67fff700 1 -- 172.21.15.154:0/529869857 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f1f780860a0 con 0x7f1f80150550 2023-10-10T21:17:13.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.553+0000 7f1f7ffff700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f6c066f30 0x7f1f6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:13.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.553+0000 7f1f7ffff700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f6c066f30 0x7f1f6c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009db0 tx=0x7f1f700091a0 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:13.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.557+0000 7f1f67fff700 1 -- 172.21.15.154:0/529869857 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f78053280 con 0x7f1f80150550 2023-10-10T21:17:13.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:13.827+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f1f80157ad0 con 0x7f1f80150550 2023-10-10T21:17:14.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.074+0000 7f1f67fff700 1 -- 172.21.15.154:0/529869857 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v541) v1 ==== 154+0+0 (secure 0 0 0) 0x7f1f780568a0 con 0x7f1f80150550 2023-10-10T21:17:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f6c066f30 msgr2=0x7f1f6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f6c066f30 0x7f1f6c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009db0 tx=0x7f1f700091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f80150550 msgr2=0x7f1f800ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f80150550 0x7f1f800ca6e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009880 tx=0x7f1f78018000 comp rx=0 tx=0).stop 2023-10-10T21:17:14.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 shutdown_connections 2023-10-10T21:17:14.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f80150550 0x7f1f800ca6e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1f6c066f30 0x7f1f6c0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f800c7240 0x7f1f801697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 --2- 172.21.15.154:0/529869857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f80150180 0x7f1f800b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 >> 172.21.15.154:0/529869857 conn(0x7f1f800cc1f0 msgr2=0x7f1f801562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:14.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 shutdown_connections 2023-10-10T21:17:14.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.077+0000 7f1f8559d700 1 -- 172.21.15.154:0/529869857 wait complete. 2023-10-10T21:17:14.096 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-10-10T21:17:14.097 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-10-10T21:17:14.098 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T21:17:14.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-10T21:17:14.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.279+0000 7fb28d5ff700 1 Processor -- start 2023-10-10T21:17:14.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.280+0000 7fb28d5ff700 1 -- start start 2023-10-10T21:17:14.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.281+0000 7fb28d5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2880b1c20 0x7fb2881572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:14.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.281+0000 7fb28d5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb288157820 0x7fb2880abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:14.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.281+0000 7fb28d5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb288157c60 con 0x7fb2880b1850 2023-10-10T21:17:14.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.281+0000 7fb28d5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28806fc30 con 0x7fb288157820 2023-10-10T21:17:14.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.281+0000 7fb28d5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880cc260 con 0x7fb2880b1c20 2023-10-10T21:17:14.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.281+0000 7fb2877fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb288157820 0x7fb2880abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:14.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.281+0000 7fb2877fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb288157820 0x7fb2880abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34400/0 (socket says 172.21.15.154:34400) 2023-10-10T21:17:14.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.281+0000 7fb2877fe700 1 -- 172.21.15.154:0/1431079132 learned_addr learned my addr 172.21.15.154:0/1431079132 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:14.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.281+0000 7fb2867fc700 1 --2- 172.21.15.154:0/1431079132 >> v2:172.21.15.179:3300/0 conn(0x7fb2880b1c20 0x7fb2881572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:14.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.282+0000 7fb2877fe700 1 -- 172.21.15.154:0/1431079132 >> v2:172.21.15.179:3300/0 conn(0x7fb2880b1c20 msgr2=0x7fb2881572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:14.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.282+0000 7fb2877fe700 1 --2- 172.21.15.154:0/1431079132 >> v2:172.21.15.179:3300/0 conn(0x7fb2880b1c20 0x7fb2881572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.282+0000 7fb2877fe700 1 -- 172.21.15.154:0/1431079132 >> v1:172.21.15.179:6789/0 conn(0x7fb2880b1850 legacy=0x7fb2880ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:14.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.282+0000 7fb2877fe700 1 -- 172.21.15.154:0/1431079132 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880cb300 con 0x7fb288157820 2023-10-10T21:17:14.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.282+0000 7fb2877fe700 1 --2- 172.21.15.154:0/1431079132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb288157820 0x7fb2880abf60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb28806d340 tx=0x7fb280009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed48a4b2c370aca server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:14.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.282+0000 7fb285ffb700 1 -- 172.21.15.154:0/1431079132 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000e070 con 0x7fb288157820 2023-10-10T21:17:14.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.282+0000 7fb285ffb700 1 -- 172.21.15.154:0/1431079132 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28000ba20 con 0x7fb288157820 2023-10-10T21:17:14.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.282+0000 7fb285ffb700 1 -- 172.21.15.154:0/1431079132 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800092e0 con 0x7fb288157820 2023-10-10T21:17:14.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.283+0000 7fb28d5ff700 1 -- 172.21.15.154:0/1431079132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb288157820 msgr2=0x7fb2880abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:14.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.283+0000 7fb28d5ff700 1 --2- 172.21.15.154:0/1431079132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb288157820 0x7fb2880abf60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb28806d340 tx=0x7fb280009840 comp rx=0 tx=0).stop 2023-10-10T21:17:14.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.283+0000 7fb28d5ff700 1 -- 172.21.15.154:0/1431079132 shutdown_connections 2023-10-10T21:17:14.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.283+0000 7fb28d5ff700 1 --2- 172.21.15.154:0/1431079132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb288157820 0x7fb2880abf60 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.283+0000 7fb28d5ff700 1 --2- 172.21.15.154:0/1431079132 >> v2:172.21.15.179:3300/0 conn(0x7fb2880b1c20 0x7fb2881572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.283+0000 7fb28d5ff700 1 -- 172.21.15.154:0/1431079132 >> 172.21.15.154:0/1431079132 conn(0x7fb28806a320 msgr2=0x7fb2880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:14.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.283+0000 7fb28d5ff700 1 -- 172.21.15.154:0/1431079132 shutdown_connections 2023-10-10T21:17:14.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.283+0000 7fb28d5ff700 1 -- 172.21.15.154:0/1431079132 wait complete. 2023-10-10T21:17:14.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.284+0000 7fb28d5ff700 1 Processor -- start 2023-10-10T21:17:14.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.284+0000 7fb28d5ff700 1 -- start start 2023-10-10T21:17:14.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.285+0000 7fb28d5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2880b1850 0x7fb28814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:14.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.285+0000 7fb28d5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880b1c20 0x7fb2880af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:14.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.285+0000 7fb28d5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288157820 0x7fb28816d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:14.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.285+0000 7fb28d5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28816dea0 con 0x7fb2880b1850 2023-10-10T21:17:14.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.285+0000 7fb28d5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880b1420 con 0x7fb288157820 2023-10-10T21:17:14.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.285+0000 7fb28d5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb288151ca0 con 0x7fb2880b1c20 2023-10-10T21:17:14.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb286ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2880b1850 0x7fb28814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:14.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb286ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2880b1850 0x7fb28814c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34402/0 (socket says 172.21.15.154:34402) 2023-10-10T21:17:14.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb286ffd700 1 -- 172.21.15.154:0/92285911 learned_addr learned my addr 172.21.15.154:0/92285911 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:14.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb2867fc700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880b1c20 0x7fb2880af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:14.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb2877fe700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288157820 0x7fb28816d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:14.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb286ffd700 1 -- 172.21.15.154:0/92285911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880b1c20 msgr2=0x7fb2880af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:14.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb286ffd700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880b1c20 0x7fb2880af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb286ffd700 1 -- 172.21.15.154:0/92285911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288157820 msgr2=0x7fb28816d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb286ffd700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288157820 0x7fb28816d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb286ffd700 1 -- 172.21.15.154:0/92285911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280009ae0 con 0x7fb2880b1850 2023-10-10T21:17:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb286ffd700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2880b1850 0x7fb28814c0e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c590 tx=0x7fb27800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb26effd700 1 -- 172.21.15.154:0/92285911 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278011590 con 0x7fb2880b1850 2023-10-10T21:17:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb26effd700 1 -- 172.21.15.154:0/92285911 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2780116f0 con 0x7fb2880b1850 2023-10-10T21:17:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.286+0000 7fb26effd700 1 -- 172.21.15.154:0/92285911 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278011ab0 con 0x7fb2880b1850 2023-10-10T21:17:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.287+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28814fc30 con 0x7fb2880b1850 2023-10-10T21:17:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.287+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2881501f0 con 0x7fb2880b1850 2023-10-10T21:17:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.288+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb288150410 con 0x7fb2880b1850 2023-10-10T21:17:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.288+0000 7fb26effd700 1 -- 172.21.15.154:0/92285911 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb27801c440 con 0x7fb2880b1850 2023-10-10T21:17:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.290+0000 7fb26effd700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb274066f30 0x7fb2740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:14.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.290+0000 7fb26effd700 1 -- 172.21.15.154:0/92285911 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5847+0+0 (secure 0 0 0) 0x7fb278083b60 con 0x7fb2880b1850 2023-10-10T21:17:14.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.290+0000 7fb2867fc700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb274066f30 0x7fb2740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:14.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.291+0000 7fb2867fc700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb274066f30 0x7fb2740693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb28815d8b0 tx=0x7fb27c008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:14.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.294+0000 7fb26effd700 1 -- 172.21.15.154:0/92285911 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb278050ca0 con 0x7fb2880b1850 2023-10-10T21:17:14.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:14.568+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fb2880cb5e0 con 0x7fb2880b1850 2023-10-10T21:17:15.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.075+0000 7fb26effd700 1 -- 172.21.15.154:0/92285911 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v542) v1 ==== 159+0+0 (secure 0 0 0) 0x7fb278017020 con 0x7fb2880b1850 2023-10-10T21:17:15.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb274066f30 msgr2=0x7fb2740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb274066f30 0x7fb2740693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb28815d8b0 tx=0x7fb27c008040 comp rx=0 tx=0).stop 2023-10-10T21:17:15.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2880b1850 msgr2=0x7fb28814c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2880b1850 0x7fb28814c0e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c590 tx=0x7fb27800c950 comp rx=0 tx=0).stop 2023-10-10T21:17:15.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 shutdown_connections 2023-10-10T21:17:15.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb274066f30 0x7fb2740693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288157820 0x7fb28816d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2880b1850 0x7fb28814c0e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 --2- 172.21.15.154:0/92285911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880b1c20 0x7fb2880af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 >> 172.21.15.154:0/92285911 conn(0x7fb28806a320 msgr2=0x7fb28814f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 shutdown_connections 2023-10-10T21:17:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.078+0000 7fb28d5ff700 1 -- 172.21.15.154:0/92285911 wait complete. 2023-10-10T21:17:15.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T21:17:15.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.281+0000 7f6ddb9ff700 1 Processor -- start 2023-10-10T21:17:15.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.281+0000 7f6ddb9ff700 1 -- start start 2023-10-10T21:17:15.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.282+0000 7f6ddb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dd4069e80 0x7f6dd40c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.282+0000 7f6ddb9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6dd40b0a70 0x7f6dd40c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.283+0000 7f6ddb9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40af2f0 con 0x7f6dd415ac80 2023-10-10T21:17:15.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.283+0000 7f6ddb9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40af5d0 con 0x7f6dd40b0a70 2023-10-10T21:17:15.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.283+0000 7f6ddb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40c8660 con 0x7f6dd4069e80 2023-10-10T21:17:15.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.283+0000 7f6dd979b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6dd415ac80 0x7f6dd4069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40836/0 (socket says 172.21.15.154:40836) 2023-10-10T21:17:15.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.283+0000 7f6dd979b700 1 -- 172.21.15.154:0/2469160674 learned_addr learned my addr 172.21.15.154:0/2469160674 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:15.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.283+0000 7f6dd9f9c700 1 --2- 172.21.15.154:0/2469160674 >> v2:172.21.15.179:3300/0 conn(0x7f6dd40b0a70 0x7f6dd40c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.283+0000 7f6dd8f9a700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dd4069e80 0x7f6dd40c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.283+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062537513 0 0) 0x7f6dd40af2f0 con 0x7f6dd415ac80 2023-10-10T21:17:15.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.283+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dc0003570 con 0x7f6dd415ac80 2023-10-10T21:17:15.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1423609502 0 0) 0x7f6dc0003570 con 0x7f6dd415ac80 2023-10-10T21:17:15.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dd4069e80 msgr2=0x7f6dd40c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:15.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dd4069e80 0x7f6dd40c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 >> v2:172.21.15.179:3300/0 conn(0x7f6dd40b0a70 msgr2=0x7f6dd40c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:15.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 --2- 172.21.15.154:0/2469160674 >> v2:172.21.15.179:3300/0 conn(0x7f6dd40b0a70 0x7f6dd40c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40c8940 con 0x7f6dd415ac80 2023-10-10T21:17:15.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f6dd0001470 con 0x7f6dd415ac80 2023-10-10T21:17:15.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 >> v1:172.21.15.154:6789/0 conn(0x7f6dd415ac80 legacy=0x7f6dd4069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dc0003a60 0x7f6dc0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc0004810 0x7f6dc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dd4069e80 0x7f6dc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40af5d0 con 0x7f6dc0003a60 2023-10-10T21:17:15.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40c8660 con 0x7f6dc0004810 2023-10-10T21:17:15.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc000ba60 con 0x7f6dd4069e80 2023-10-10T21:17:15.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dd9f9c700 1 --2- 172.21.15.154:0/2469160674 >> v2:172.21.15.179:3300/0 conn(0x7f6dd40b0a70 0x7f6dd40c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:15.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dd979b700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dc0003a60 0x7f6dc0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dd8f9a700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc0004810 0x7f6dc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dd9f9c700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dd4069e80 0x7f6dc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dd979b700 1 -- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dd4069e80 msgr2=0x7f6dc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:15.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dd979b700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dd4069e80 0x7f6dc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dd979b700 1 -- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc0004810 msgr2=0x7f6dc0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:15.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dd979b700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc0004810 0x7f6dc0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.284+0000 7f6dd979b700 1 -- 172.21.15.154:0/2469160674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0003570 con 0x7f6dc0003a60 2023-10-10T21:17:15.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.285+0000 7f6dd979b700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dc0003a60 0x7f6dc0003e70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000c3f0 tx=0x7f6dd406f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17de783fbdd7dca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:15.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.285+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd000cc80 con 0x7f6dc0003a60 2023-10-10T21:17:15.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.285+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd000ce20 con 0x7f6dc0003a60 2023-10-10T21:17:15.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.285+0000 7f6dcbfff700 1 -- 172.21.15.154:0/2469160674 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0005b70 con 0x7f6dc0003a60 2023-10-10T21:17:15.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.285+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/2469160674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dc0003a60 msgr2=0x7f6dc0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.285+0000 7f6ddb9ff700 1 --2- 172.21.15.154:0/2469160674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dc0003a60 0x7f6dc0003e70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000c3f0 tx=0x7f6dd406f7c0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.285+0000 7f6dd9f9c700 1 -- 172.21.15.154:0/2469160674 reap_dead start 2023-10-10T21:17:15.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.286+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/2469160674 shutdown_connections 2023-10-10T21:17:15.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.286+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/2469160674 >> 172.21.15.154:0/2469160674 conn(0x7f6dd4068e10 msgr2=0x7f6dd40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:15.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.286+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/2469160674 shutdown_connections 2023-10-10T21:17:15.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.286+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/2469160674 wait complete. 2023-10-10T21:17:15.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.287+0000 7f6ddb9ff700 1 Processor -- start 2023-10-10T21:17:15.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.287+0000 7f6ddb9ff700 1 -- start start 2023-10-10T21:17:15.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6ddb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc0003a60 0x7f6dd40ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6ddb9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd4169aa0 0x7f6dd40cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6ddb9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dd40b15d0 0x7f6dd40b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6ddb9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd416aad0 con 0x7f6dd4169aa0 2023-10-10T21:17:15.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6ddb9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40b1140 con 0x7f6dd40b15d0 2023-10-10T21:17:15.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6ddb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd416a230 con 0x7f6dc0003a60 2023-10-10T21:17:15.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6dd8f9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd4169aa0 0x7f6dd40cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6dd8f9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd4169aa0 0x7f6dd40cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34426/0 (socket says 172.21.15.154:34426) 2023-10-10T21:17:15.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6dd8f9a700 1 -- 172.21.15.154:0/3902292073 learned_addr learned my addr 172.21.15.154:0/3902292073 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:15.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6dd9f9c700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dd40b15d0 0x7f6dd40b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.288+0000 7f6dd979b700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc0003a60 0x7f6dd40ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dd8f9a700 1 -- 172.21.15.154:0/3902292073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc0003a60 msgr2=0x7f6dd40ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dd8f9a700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc0003a60 0x7f6dd40ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dd8f9a700 1 -- 172.21.15.154:0/3902292073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dd40b15d0 msgr2=0x7f6dd40b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dd8f9a700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dd40b15d0 0x7f6dd40b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dd8f9a700 1 -- 172.21.15.154:0/3902292073 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd416a510 con 0x7f6dd4169aa0 2023-10-10T21:17:15.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dd979b700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc0003a60 0x7f6dd40ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:15.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dd8f9a700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd4169aa0 0x7f6dd40cb420 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4011b70 tx=0x7f6dc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:15.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dc97fa700 1 -- 172.21.15.154:0/3902292073 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400f990 con 0x7f6dd4169aa0 2023-10-10T21:17:15.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dc97fa700 1 -- 172.21.15.154:0/3902292073 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc400faf0 con 0x7f6dd4169aa0 2023-10-10T21:17:15.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6dc97fa700 1 -- 172.21.15.154:0/3902292073 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400fe90 con 0x7f6dd4169aa0 2023-10-10T21:17:15.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd416a7f0 con 0x7f6dd4169aa0 2023-10-10T21:17:15.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.289+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd40cb960 con 0x7f6dd4169aa0 2023-10-10T21:17:15.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.290+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd40b0f10 con 0x7f6dd4169aa0 2023-10-10T21:17:15.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.291+0000 7f6dc97fa700 1 -- 172.21.15.154:0/3902292073 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6dc401d690 con 0x7f6dd4169aa0 2023-10-10T21:17:15.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.292+0000 7f6dc97fa700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6db8066f30 0x7f6db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.292+0000 7f6dc97fa700 1 -- 172.21.15.154:0/3902292073 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f6dc4018070 con 0x7f6dd4169aa0 2023-10-10T21:17:15.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.292+0000 7f6dd979b700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6db8066f30 0x7f6db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.293+0000 7f6dd979b700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6db8066f30 0x7f6db80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000c3f0 tx=0x7f6dd0015000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:15.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.297+0000 7f6dc97fa700 1 -- 172.21.15.154:0/3902292073 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6dd40b0f10 con 0x7f6dd4169aa0 2023-10-10T21:17:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.492+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6dd40b0f10 con 0x7f6dd4169aa0 2023-10-10T21:17:15.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.498+0000 7f6dc97fa700 1 -- 172.21.15.154:0/3902292073 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6dd40b0f10 con 0x7f6dd4169aa0 2023-10-10T21:17:15.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.500+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6db8066f30 msgr2=0x7f6db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.500+0000 7f6ddb9ff700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6db8066f30 0x7f6db80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000c3f0 tx=0x7f6dd0015000 comp rx=0 tx=0).stop 2023-10-10T21:17:15.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd4169aa0 msgr2=0x7f6dd40cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd4169aa0 0x7f6dd40cb420 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4011b70 tx=0x7f6dc40091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 shutdown_connections 2023-10-10T21:17:15.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6db8066f30 0x7f6db80693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dd40b15d0 0x7f6dd40b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc0003a60 0x7f6dd40ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 --2- 172.21.15.154:0/3902292073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd4169aa0 0x7f6dd40cb420 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 >> 172.21.15.154:0/3902292073 conn(0x7f6dd4068e10 msgr2=0x7f6dd4153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:15.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 shutdown_connections 2023-10-10T21:17:15.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.501+0000 7f6ddb9ff700 1 -- 172.21.15.154:0/3902292073 wait complete. 2023-10-10T21:17:15.519 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:17:15.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:17:15.599 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:17:15.680 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:17:15.680 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T21:17:15.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.863+0000 7f218edff700 1 Processor -- start 2023-10-10T21:17:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.863+0000 7f218edff700 1 -- start start 2023-10-10T21:17:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f218edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 0x7f2188155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f218edff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21880ac230 0x7f21880ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f218edff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880ad930 con 0x7f21881568a0 2023-10-10T21:17:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f218edff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21880acd20 con 0x7f21880ac230 2023-10-10T21:17:15.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f218edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21880ad000 con 0x7f2188155c10 2023-10-10T21:17:15.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f2187fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21880ac230 0x7f21880ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f2187fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21880ac230 0x7f21880ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37976/0 (socket says 172.21.15.154:37976) 2023-10-10T21:17:15.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f2187fff700 1 -- 172.21.15.154:0/3962083402 learned_addr learned my addr 172.21.15.154:0/3962083402 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f218cb9b700 1 --2- 172.21.15.154:0/3962083402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 0x7f2188155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f2187fff700 1 -- 172.21.15.154:0/3962083402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 msgr2=0x7f2188155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f2187fff700 1 --2- 172.21.15.154:0/3962083402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 0x7f2188155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f2187fff700 1 -- 172.21.15.154:0/3962083402 >> v1:172.21.15.179:6789/0 conn(0x7f21881568a0 legacy=0x7f2188156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f2187fff700 1 -- 172.21.15.154:0/3962083402 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880ad2e0 con 0x7f21880ac230 2023-10-10T21:17:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.865+0000 7f218cb9b700 1 --2- 172.21.15.154:0/3962083402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 0x7f2188155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.866+0000 7f2187fff700 1 --2- 172.21.15.154:0/3962083402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21880ac230 0x7f21880ac6a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f217400ab50 tx=0x7f217400a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c986a7d42cb6eb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.866+0000 7f21877fe700 1 -- 172.21.15.154:0/3962083402 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217400ca60 con 0x7f21880ac230 2023-10-10T21:17:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.866+0000 7f21877fe700 1 -- 172.21.15.154:0/3962083402 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217400cbc0 con 0x7f21880ac230 2023-10-10T21:17:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.866+0000 7f21877fe700 1 -- 172.21.15.154:0/3962083402 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174018400 con 0x7f21880ac230 2023-10-10T21:17:15.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.866+0000 7f218edff700 1 -- 172.21.15.154:0/3962083402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21880ac230 msgr2=0x7f21880ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.866+0000 7f218edff700 1 --2- 172.21.15.154:0/3962083402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21880ac230 0x7f21880ac6a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f217400ab50 tx=0x7f217400a3f0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.867+0000 7f218edff700 1 -- 172.21.15.154:0/3962083402 shutdown_connections 2023-10-10T21:17:15.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.867+0000 7f218edff700 1 --2- 172.21.15.154:0/3962083402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 0x7f2188155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.867+0000 7f218edff700 1 --2- 172.21.15.154:0/3962083402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21880ac230 0x7f21880ac6a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.867+0000 7f218edff700 1 -- 172.21.15.154:0/3962083402 >> 172.21.15.154:0/3962083402 conn(0x7f218806a320 msgr2=0x7f21880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:15.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.867+0000 7f218edff700 1 -- 172.21.15.154:0/3962083402 shutdown_connections 2023-10-10T21:17:15.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.867+0000 7f218edff700 1 -- 172.21.15.154:0/3962083402 wait complete. 2023-10-10T21:17:15.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.868+0000 7f218edff700 1 Processor -- start 2023-10-10T21:17:15.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.868+0000 7f218edff700 1 -- start start 2023-10-10T21:17:15.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21880ac230 0x7f218814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 0x7f218814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218edff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21881568a0 0x7f21880aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218edff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2188159880 con 0x7f21881568a0 2023-10-10T21:17:15.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218edff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2188168590 con 0x7f21880ac230 2023-10-10T21:17:15.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2188168870 con 0x7f2188155c10 2023-10-10T21:17:15.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218d39c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21881568a0 0x7f21880aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f2187fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 0x7f218814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218d39c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21881568a0 0x7f21880aac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37990/0 (socket says 172.21.15.154:37990) 2023-10-10T21:17:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218d39c700 1 -- 172.21.15.154:0/1893752854 learned_addr learned my addr 172.21.15.154:0/1893752854 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.869+0000 7f218cb9b700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21880ac230 0x7f218814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f218d39c700 1 -- 172.21.15.154:0/1893752854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 msgr2=0x7f218814d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f218d39c700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 0x7f218814d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f218d39c700 1 -- 172.21.15.154:0/1893752854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21880ac230 msgr2=0x7f218814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:15.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f218d39c700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21880ac230 0x7f218814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:15.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f218d39c700 1 -- 172.21.15.154:0/1893752854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217400a690 con 0x7f21881568a0 2023-10-10T21:17:15.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f218cb9b700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21880ac230 0x7f218814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:15.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f218d39c700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21881568a0 0x7f21880aac10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f218000c840 tx=0x7f2180001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:15.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f2184ff9700 1 -- 172.21.15.154:0/1893752854 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180012630 con 0x7f21881568a0 2023-10-10T21:17:15.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f2184ff9700 1 -- 172.21.15.154:0/1893752854 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21800127b0 con 0x7f21881568a0 2023-10-10T21:17:15.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2188168b50 con 0x7f21881568a0 2023-10-10T21:17:15.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f2184ff9700 1 -- 172.21.15.154:0/1893752854 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180012b70 con 0x7f21881568a0 2023-10-10T21:17:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.870+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21880ab150 con 0x7f21881568a0 2023-10-10T21:17:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.872+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2188159a80 con 0x7f21881568a0 2023-10-10T21:17:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.872+0000 7f2184ff9700 1 -- 172.21.15.154:0/1893752854 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f218001a3a0 con 0x7f21881568a0 2023-10-10T21:17:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.873+0000 7f2184ff9700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f216c066f30 0x7f216c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.873+0000 7f2184ff9700 1 -- 172.21.15.154:0/1893752854 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f21800847c0 con 0x7f21881568a0 2023-10-10T21:17:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.873+0000 7f218cb9b700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f216c066f30 0x7f216c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:15.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.874+0000 7f218cb9b700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f216c066f30 0x7f216c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f217c006f00 tx=0x7f217c008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:15.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:15.877+0000 7f2184ff9700 1 -- 172.21.15.154:0/1893752854 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2188159a80 con 0x7f21881568a0 2023-10-10T21:17:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.113+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2188159a80 con 0x7f21881568a0 2023-10-10T21:17:16.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.114+0000 7f2184ff9700 1 -- 172.21.15.154:0/1893752854 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f2188159a80 con 0x7f21881568a0 2023-10-10T21:17:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:16.116 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1501601746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1501601746},{"type":"v1","addr":"172.21.15.179:6833","nonce":1501601746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4046528016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4046528016},{"type":"v1","addr":"172.21.15.179:6835","nonce":4046528016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5533,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/634585840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":634585840},{"type":"v1","addr":"172.21.15.154:6837","nonce":634585840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3062978953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3062978953},{"type":"v1","addr":"172.21.15.154:6833","nonce":3062978953}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2023-10-10T21:17:16.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.116+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f216c066f30 msgr2=0x7f216c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:16.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.116+0000 7f218edff700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f216c066f30 0x7f216c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f217c006f00 tx=0x7f217c008040 comp rx=0 tx=0).stop 2023-10-10T21:17:16.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.116+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21881568a0 msgr2=0x7f21880aac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.116+0000 7f218edff700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21881568a0 0x7f21880aac10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f218000c840 tx=0x7f2180001670 comp rx=0 tx=0).stop 2023-10-10T21:17:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.117+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 shutdown_connections 2023-10-10T21:17:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.117+0000 7f218edff700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21881568a0 0x7f21880aac10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.117+0000 7f218edff700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f216c066f30 0x7f216c0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.117+0000 7f218edff700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21880ac230 0x7f218814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.117+0000 7f218edff700 1 --2- 172.21.15.154:0/1893752854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2188155c10 0x7f218814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.117+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 >> 172.21.15.154:0/1893752854 conn(0x7f218806a320 msgr2=0x7f21881538a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.117+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 shutdown_connections 2023-10-10T21:17:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.117+0000 7f218edff700 1 -- 172.21.15.154:0/1893752854 wait complete. 2023-10-10T21:17:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 24 2023-10-10T21:17:16.135 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T21:17:16.135 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T21:17:16.136 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T21:17:16.136 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:17:16.136 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T21:17:16.136 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T21:17:16.137 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T21:17:16.137 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:17:16.137 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T21:17:16.138 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T21:17:16.138 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T21:17:16.138 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:17:16.138 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T21:17:16.139 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T21:17:16.139 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T21:17:16.139 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:17:16.152 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T21:17:16.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T21:17:16.153 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T21:17:16.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T21:17:16.155 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T21:17:16.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T21:17:16.157 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T21:17:16.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T21:17:16.197 INFO:tasks.ceph.mds.a:Started 2023-10-10T21:17:16.197 DEBUG:teuthology.parallel:result is None 2023-10-10T21:17:16.200 INFO:tasks.ceph.mds.c:Started 2023-10-10T21:17:16.200 DEBUG:teuthology.parallel:result is None 2023-10-10T21:17:16.201 INFO:tasks.ceph.mds.d:Started 2023-10-10T21:17:16.202 DEBUG:teuthology.parallel:result is None 2023-10-10T21:17:16.205 INFO:tasks.ceph.mds.b:Started 2023-10-10T21:17:16.205 DEBUG:teuthology.parallel:result is None 2023-10-10T21:17:16.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T21:17:16.333 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:17:16.333 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:17:16.337 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:17:16.338 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T21:17:16.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.401+0000 7f04db5ff700 1 Processor -- start 2023-10-10T21:17:16.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.401+0000 7f04db5ff700 1 -- start start 2023-10-10T21:17:16.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04db5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04d4068550 0x7f04d4068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:16.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04db5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04d415e010 0x7f04d406f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:16.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04db5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d406ec70 con 0x7f04d406f640 2023-10-10T21:17:16.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04db5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d40b3430 con 0x7f04d415e010 2023-10-10T21:17:16.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04db5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d40b2e70 con 0x7f04d4068550 2023-10-10T21:17:16.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04d8b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04d415e010 0x7f04d406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:16.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04d8b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04d415e010 0x7f04d406f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38018/0 (socket says 172.21.15.154:38018) 2023-10-10T21:17:16.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04d8b9a700 1 -- 172.21.15.154:0/1395522546 learned_addr learned my addr 172.21.15.154:0/1395522546 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:16.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04d9b9c700 1 --1- 172.21.15.154:0/1395522546 >> v1:172.21.15.154:6789/0 conn(0x7f04d406f640 0x7f04d406a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56686/0 (socket says 172.21.15.154:56686) 2023-10-10T21:17:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04d939b700 1 --2- 172.21.15.154:0/1395522546 >> v2:172.21.15.179:3300/0 conn(0x7f04d4068550 0x7f04d4068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04d8b9a700 1 -- 172.21.15.154:0/1395522546 >> v2:172.21.15.179:3300/0 conn(0x7f04d4068550 msgr2=0x7f04d4068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04d8b9a700 1 --2- 172.21.15.154:0/1395522546 >> v2:172.21.15.179:3300/0 conn(0x7f04d4068550 0x7f04d4068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04d8b9a700 1 -- 172.21.15.154:0/1395522546 >> v1:172.21.15.154:6789/0 conn(0x7f04d406f640 legacy=0x7f04d406a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.403+0000 7f04d8b9a700 1 -- 172.21.15.154:0/1395522546 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40b3150 con 0x7f04d415e010 2023-10-10T21:17:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.404+0000 7f04d8b9a700 1 --2- 172.21.15.154:0/1395522546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d415e010 0x7f04d406f100 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f04d406e170 tx=0x7f04c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac4bf9e0af1009f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.404+0000 7f04cbfff700 1 -- 172.21.15.154:0/1395522546 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4009e70 con 0x7f04d415e010 2023-10-10T21:17:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.404+0000 7f04cbfff700 1 -- 172.21.15.154:0/1395522546 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400b860 con 0x7f04d415e010 2023-10-10T21:17:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.404+0000 7f04cbfff700 1 -- 172.21.15.154:0/1395522546 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400bc00 con 0x7f04d415e010 2023-10-10T21:17:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.404+0000 7f04db5ff700 1 -- 172.21.15.154:0/1395522546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d415e010 msgr2=0x7f04d406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:16.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.404+0000 7f04db5ff700 1 --2- 172.21.15.154:0/1395522546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d415e010 0x7f04d406f100 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f04d406e170 tx=0x7f04c4009250 comp rx=0 tx=0).stop 2023-10-10T21:17:16.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.404+0000 7f04db5ff700 1 -- 172.21.15.154:0/1395522546 shutdown_connections 2023-10-10T21:17:16.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.404+0000 7f04db5ff700 1 --2- 172.21.15.154:0/1395522546 >> v2:172.21.15.179:3300/0 conn(0x7f04d4068550 0x7f04d4068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:16.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.405+0000 7f04db5ff700 1 --2- 172.21.15.154:0/1395522546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d415e010 0x7f04d406f100 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:16.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.405+0000 7f04db5ff700 1 -- 172.21.15.154:0/1395522546 >> 172.21.15.154:0/1395522546 conn(0x7f04d40cd480 msgr2=0x7f04d40cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:16.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.405+0000 7f04db5ff700 1 -- 172.21.15.154:0/1395522546 shutdown_connections 2023-10-10T21:17:16.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.405+0000 7f04db5ff700 1 -- 172.21.15.154:0/1395522546 wait complete. 2023-10-10T21:17:16.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.406+0000 7f04db5ff700 1 Processor -- start 2023-10-10T21:17:16.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.406+0000 7f04db5ff700 1 -- start start 2023-10-10T21:17:16.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04db5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04d4068550 0x7f04d4140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:16.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04db5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d406f640 0x7f04d40aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:16.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04db5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d415e010 0x7f04d40af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:16.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04db5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4147630 con 0x7f04d406f640 2023-10-10T21:17:16.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04db5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4142ec0 con 0x7f04d415e010 2023-10-10T21:17:16.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04db5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d41431a0 con 0x7f04d4068550 2023-10-10T21:17:16.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04d8b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d406f640 0x7f04d40aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:16.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04d8b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d406f640 0x7f04d40aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38028/0 (socket says 172.21.15.154:38028) 2023-10-10T21:17:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04d8b9a700 1 -- 172.21.15.154:0/955007146 learned_addr learned my addr 172.21.15.154:0/955007146 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04d939b700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04d4068550 0x7f04d4140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.407+0000 7f04d9b9c700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d415e010 0x7f04d40af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.408+0000 7f04d8b9a700 1 -- 172.21.15.154:0/955007146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04d4068550 msgr2=0x7f04d4140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.408+0000 7f04d8b9a700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04d4068550 0x7f04d4140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.408+0000 7f04d8b9a700 1 -- 172.21.15.154:0/955007146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d415e010 msgr2=0x7f04d40af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.408+0000 7f04d8b9a700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d415e010 0x7f04d40af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.408+0000 7f04d8b9a700 1 -- 172.21.15.154:0/955007146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c40094f0 con 0x7f04d406f640 2023-10-10T21:17:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.408+0000 7f04d8b9a700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d406f640 0x7f04d40aeef0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f04d40ce220 tx=0x7f04c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.408+0000 7f04c97fa700 1 -- 172.21.15.154:0/955007146 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400bbe0 con 0x7f04d406f640 2023-10-10T21:17:16.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.408+0000 7f04c97fa700 1 -- 172.21.15.154:0/955007146 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c4027450 con 0x7f04d406f640 2023-10-10T21:17:16.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.408+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d4143480 con 0x7f04d406f640 2023-10-10T21:17:16.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.409+0000 7f04c97fa700 1 -- 172.21.15.154:0/955007146 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4027810 con 0x7f04d406f640 2023-10-10T21:17:16.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.409+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d4143a40 con 0x7f04d406f640 2023-10-10T21:17:16.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.410+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d4143c30 con 0x7f04d406f640 2023-10-10T21:17:16.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.410+0000 7f04c97fa700 1 -- 172.21.15.154:0/955007146 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04c401a430 con 0x7f04d406f640 2023-10-10T21:17:16.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.411+0000 7f04c97fa700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:16.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.411+0000 7f04c97fa700 1 -- 172.21.15.154:0/955007146 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f04c40863e0 con 0x7f04d406f640 2023-10-10T21:17:16.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.411+0000 7f04d939b700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:16.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.412+0000 7f04d939b700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009db0 tx=0x7f04d00091a0 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:16.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.415+0000 7f04c97fa700 1 -- 172.21.15.154:0/955007146 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04c4053640 con 0x7f04d406f640 2023-10-10T21:17:16.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:16.626+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f04d404c3c0 con 0x7f04d406f640 2023-10-10T21:17:17.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.524+0000 7f04c97fa700 1 -- 172.21.15.154:0/955007146 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7f04c4056c60 con 0x7f04d406f640 2023-10-10T21:17:17.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f04b8066f30 msgr2=0x7f04b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009db0 tx=0x7f04d00091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d406f640 msgr2=0x7f04d40aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d406f640 0x7f04d40aeef0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f04d40ce220 tx=0x7f04c4017000 comp rx=0 tx=0).stop 2023-10-10T21:17:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 shutdown_connections 2023-10-10T21:17:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04d415e010 0x7f04d40af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04d4068550 0x7f04d4140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 --2- 172.21.15.154:0/955007146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d406f640 0x7f04d40aeef0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 >> 172.21.15.154:0/955007146 conn(0x7f04d40cd480 msgr2=0x7f04d4152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 shutdown_connections 2023-10-10T21:17:17.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.527+0000 7f04db5ff700 1 -- 172.21.15.154:0/955007146 wait complete. 2023-10-10T21:17:17.531 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T21:17:17.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T21:17:17.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.733+0000 7f311759e700 1 Processor -- start 2023-10-10T21:17:17.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.733+0000 7f311759e700 1 -- start start 2023-10-10T21:17:17.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.734+0000 7f311759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3118142ea0 0x7f31180b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:17.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.734+0000 7f311759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31180ad870 0x7f311806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:17.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.734+0000 7f311759e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31180b40f0 con 0x7f31180b3b70 2023-10-10T21:17:17.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.734+0000 7f311759e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3118069640 con 0x7f3118142ea0 2023-10-10T21:17:17.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.734+0000 7f311759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3118069920 con 0x7f31180ad870 2023-10-10T21:17:17.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.734+0000 7f311659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3118142ea0 0x7f31180b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:17.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.734+0000 7f311659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3118142ea0 0x7f31180b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38032/0 (socket says 172.21.15.154:38032) 2023-10-10T21:17:17.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.734+0000 7f311659c700 1 -- 172.21.15.154:0/1460011693 learned_addr learned my addr 172.21.15.154:0/1460011693 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:17.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.735+0000 7f3115d9b700 1 --2- 172.21.15.154:0/1460011693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31180ad870 0x7f311806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:17.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.735+0000 7f311659c700 1 -- 172.21.15.154:0/1460011693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31180ad870 msgr2=0x7f311806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:17.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.735+0000 7f311659c700 1 --2- 172.21.15.154:0/1460011693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31180ad870 0x7f311806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.735+0000 7f311659c700 1 -- 172.21.15.154:0/1460011693 >> v1:172.21.15.154:6789/0 conn(0x7f31180b3b70 legacy=0x7f311806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:17.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.735+0000 7f311659c700 1 -- 172.21.15.154:0/1460011693 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3118069c00 con 0x7f3118142ea0 2023-10-10T21:17:17.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.735+0000 7f311659c700 1 --2- 172.21.15.154:0/1460011693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 0x7f31180b3630 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f31080099b0 tx=0x7f3108009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240ae5f27ed237de server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:17.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.735+0000 7f311559a700 1 -- 172.21.15.154:0/1460011693 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310800b860 con 0x7f3118142ea0 2023-10-10T21:17:17.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.735+0000 7f311559a700 1 -- 172.21.15.154:0/1460011693 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310800b9c0 con 0x7f3118142ea0 2023-10-10T21:17:17.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.735+0000 7f311559a700 1 -- 172.21.15.154:0/1460011693 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310800bd60 con 0x7f3118142ea0 2023-10-10T21:17:17.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.736+0000 7f311759e700 1 -- 172.21.15.154:0/1460011693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 msgr2=0x7f31180b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:17.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.736+0000 7f311759e700 1 --2- 172.21.15.154:0/1460011693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 0x7f31180b3630 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f31080099b0 tx=0x7f3108009250 comp rx=0 tx=0).stop 2023-10-10T21:17:17.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.736+0000 7f311759e700 1 -- 172.21.15.154:0/1460011693 shutdown_connections 2023-10-10T21:17:17.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.736+0000 7f311759e700 1 --2- 172.21.15.154:0/1460011693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 0x7f31180b3630 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.736+0000 7f311759e700 1 --2- 172.21.15.154:0/1460011693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31180ad870 0x7f311806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.736+0000 7f311759e700 1 -- 172.21.15.154:0/1460011693 >> 172.21.15.154:0/1460011693 conn(0x7f31180ce430 msgr2=0x7f31180ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:17.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.736+0000 7f311759e700 1 -- 172.21.15.154:0/1460011693 shutdown_connections 2023-10-10T21:17:17.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.736+0000 7f311759e700 1 -- 172.21.15.154:0/1460011693 wait complete. 2023-10-10T21:17:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.737+0000 7f311759e700 1 Processor -- start 2023-10-10T21:17:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.738+0000 7f311759e700 1 -- start start 2023-10-10T21:17:17.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.738+0000 7f311759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31180b3b70 0x7f31181590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:17.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.738+0000 7f311759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 0x7f3118141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.738+0000 7f311759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f311815c600 0x7f31180aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.738+0000 7f311759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311815ca70 con 0x7f3118142ea0 2023-10-10T21:17:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.738+0000 7f311759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311815cd50 con 0x7f31180b3b70 2023-10-10T21:17:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.738+0000 7f311759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311815d030 con 0x7f311815c600 2023-10-10T21:17:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3115d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 0x7f3118141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3115d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 0x7f3118141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38048/0 (socket says 172.21.15.154:38048) 2023-10-10T21:17:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3115d9b700 1 -- 172.21.15.154:0/3185962599 learned_addr learned my addr 172.21.15.154:0/3185962599 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f311659c700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31180b3b70 0x7f31181590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3116d9d700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f311815c600 0x7f31180aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3115d9b700 1 -- 172.21.15.154:0/3185962599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f311815c600 msgr2=0x7f31180aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3115d9b700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f311815c600 0x7f31180aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3115d9b700 1 -- 172.21.15.154:0/3185962599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31180b3b70 msgr2=0x7f31181590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3115d9b700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31180b3b70 0x7f31181590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3115d9b700 1 -- 172.21.15.154:0/3185962599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31080094f0 con 0x7f3118142ea0 2023-10-10T21:17:17.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.739+0000 7f3115d9b700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 0x7f3118141160 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f310c00d890 tx=0x7f310c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.740+0000 7f31067fc700 1 -- 172.21.15.154:0/3185962599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0125f0 con 0x7f3118142ea0 2023-10-10T21:17:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.740+0000 7f31067fc700 1 -- 172.21.15.154:0/3185962599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c012750 con 0x7f3118142ea0 2023-10-10T21:17:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.740+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311815d310 con 0x7f3118142ea0 2023-10-10T21:17:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.740+0000 7f31067fc700 1 -- 172.21.15.154:0/3185962599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c012af0 con 0x7f3118142ea0 2023-10-10T21:17:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.740+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31181595e0 con 0x7f3118142ea0 2023-10-10T21:17:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.741+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311804c3c0 con 0x7f3118142ea0 2023-10-10T21:17:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.742+0000 7f31067fc700 1 -- 172.21.15.154:0/3185962599 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f310c01e460 con 0x7f3118142ea0 2023-10-10T21:17:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.743+0000 7f31067fc700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f30f8066f30 0x7f30f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.743+0000 7f31067fc700 1 -- 172.21.15.154:0/3185962599 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f310c0848d0 con 0x7f3118142ea0 2023-10-10T21:17:17.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.743+0000 7f311659c700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f30f8066f30 0x7f30f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:17.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.744+0000 7f311659c700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f30f8066f30 0x7f30f80693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31080099b0 tx=0x7f3108017000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:17.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:17.746+0000 7f31067fc700 1 -- 172.21.15.154:0/3185962599 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f310c051d10 con 0x7f3118142ea0 2023-10-10T21:17:18.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.010+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3118143270 con 0x7f3118142ea0 2023-10-10T21:17:18.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.011+0000 7f31067fc700 1 -- 172.21.15.154:0/3185962599 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f310c055330 con 0x7f3118142ea0 2023-10-10T21:17:18.012 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:18.012 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:17:18.012 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T21:17:18.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.013 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T21:17:18.013 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T21:17:18.013 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.013 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:18.014 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:18.014 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:18.014 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.014 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.015 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T21:17:18.015 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T21:17:18.015 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.015 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:18.016 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:18.016 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:18.016 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.017 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T21:17:18.017 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T21:17:18.018 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.018 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:18.018 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:18.018 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:18.018 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.019 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.019 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T21:17:18.019 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T21:17:18.019 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.020 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:18.020 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:18.020 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:18.020 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.021 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T21:17:18.021 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T21:17:18.021 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.022 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:18.022 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:18.022 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.023 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T21:17:18.023 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T21:17:18.023 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.023 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:18.024 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:18.024 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.024 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T21:17:18.025 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T21:17:18.025 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.025 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:18.026 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:18.026 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.026 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.027 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T21:17:18.027 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T21:17:18.027 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.027 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:18.028 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:18.028 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.029 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T21:17:18.029 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T21:17:18.029 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.029 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:18.030 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:18.030 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.034 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T21:17:18.034 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T21:17:18.034 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.035 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:18.035 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:18.035 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.035 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.036 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T21:17:18.037 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T21:17:18.037 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.037 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:18.037 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:18.038 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.038 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T21:17:18.039 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T21:17:18.039 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.039 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:18.039 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:18.039 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.040 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.040 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T21:17:18.040 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T21:17:18.040 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.041 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:18.041 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T21:17:18.041 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T21:17:18.041 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.042 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T21:17:18.042 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T21:17:18.042 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.042 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:18.043 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:17:18.043 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:17:18.043 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:17:18.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.044 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T21:17:18.044 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T21:17:18.044 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.044 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:18.045 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:17:18.045 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:17:18.045 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:17:18.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.046 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T21:17:18.046 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T21:17:18.046 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.046 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:18.046 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:17:18.047 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:17:18.047 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:17:18.047 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.048 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T21:17:18.048 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T21:17:18.048 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.048 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:17:18.048 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:18.049 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:18.049 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.049 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.049 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T21:17:18.050 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T21:17:18.050 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.050 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:17:18.050 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:17:18.050 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.051 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:18.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:18.051 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T21:17:18.051 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T21:17:18.052 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:18.052 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:17:18.052 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:17:18.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:18.052 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.053 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:18.053 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T21:17:18.053 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:17:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f30f8066f30 msgr2=0x7f30f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f30f8066f30 0x7f30f80693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31080099b0 tx=0x7f3108017000 comp rx=0 tx=0).stop 2023-10-10T21:17:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 msgr2=0x7f3118141160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 0x7f3118141160 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f310c00d890 tx=0x7f310c008040 comp rx=0 tx=0).stop 2023-10-10T21:17:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 shutdown_connections 2023-10-10T21:17:18.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f311815c600 0x7f31180aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f30f8066f30 0x7f30f80693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31180b3b70 0x7f31181590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 --2- 172.21.15.154:0/3185962599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3118142ea0 0x7f3118141160 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 >> 172.21.15.154:0/3185962599 conn(0x7f31180ce430 msgr2=0x7f31180cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:18.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 shutdown_connections 2023-10-10T21:17:18.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.013+0000 7f311759e700 1 -- 172.21.15.154:0/3185962599 wait complete. 2023-10-10T21:17:18.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:18.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.241+0000 7fa05bfff700 1 Processor -- start 2023-10-10T21:17:18.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.241+0000 7fa05bfff700 1 -- start start 2023-10-10T21:17:18.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.242+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c0ae710 0x7fa05c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.242+0000 7fa05bfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c0ca860 con 0x7fa05c156310 2023-10-10T21:17:18.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.242+0000 7fa05bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c0cab40 con 0x7fa05c1566e0 2023-10-10T21:17:18.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.242+0000 7fa05bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0cae20 con 0x7fa05c0ae710 2023-10-10T21:17:18.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.242+0000 7fa05affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa05c156310 0x7fa05c0c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56712/0 (socket says 172.21.15.154:56712) 2023-10-10T21:17:18.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.242+0000 7fa05affd700 1 -- 172.21.15.154:0/1963673059 learned_addr learned my addr 172.21.15.154:0/1963673059 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:18.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05b7fe700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c0ae710 0x7fa05c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475959593 0 0) 0x7fa05c0ca860 con 0x7fa05c156310 2023-10-10T21:17:18.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa048003570 con 0x7fa05c156310 2023-10-10T21:17:18.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994332025 0 0) 0x7fa05c0cab40 con 0x7fa05c1566e0 2023-10-10T21:17:18.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa05c0ca860 con 0x7fa05c1566e0 2023-10-10T21:17:18.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559878791 0 0) 0x7fa048003570 con 0x7fa05c156310 2023-10-10T21:17:18.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c0ae710 msgr2=0x7fa05c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:18.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c0ae710 0x7fa05c0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 >> v1:172.21.15.179:6789/0 conn(0x7fa05c1566e0 legacy=0x7fa05c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0cb100 con 0x7fa05c156310 2023-10-10T21:17:18.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fa04c001470 con 0x7fa05c156310 2023-10-10T21:17:18.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05b7fe700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c0ae710 0x7fa05c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:18.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 >> v1:172.21.15.154:6789/0 conn(0x7fa05c156310 legacy=0x7fa05c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa048003c20 0x7fa048004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c0ae710 0x7fa048004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa0480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0cae20 con 0x7fa048004d50 2023-10-10T21:17:18.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04800bb70 con 0x7fa048003c20 2023-10-10T21:17:18.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.243+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04800df40 con 0x7fa05c0ae710 2023-10-10T21:17:18.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05b7fe700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa0480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa053fff700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c0ae710 0x7fa048004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05affd700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa048003c20 0x7fa048004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05b7fe700 1 -- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c0ae710 msgr2=0x7fa048004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:18.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05b7fe700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c0ae710 0x7fa048004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05b7fe700 1 -- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa048003c20 msgr2=0x7fa048004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:18.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05b7fe700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa048003c20 0x7fa048004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05b7fe700 1 -- 172.21.15.154:0/1963673059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054009a20 con 0x7fa048004d50 2023-10-10T21:17:18.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05affd700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa048003c20 0x7fa048004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:18.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05b7fe700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa0480051c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0aeb10 tx=0x7fa05400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3715380dcb3b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:18.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054009c50 con 0x7fa048004d50 2023-10-10T21:17:18.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05400f040 con 0x7fa048004d50 2023-10-10T21:17:18.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.244+0000 7fa05a7fc700 1 -- 172.21.15.154:0/1963673059 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400ee70 con 0x7fa048004d50 2023-10-10T21:17:18.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.245+0000 7fa05bfff700 1 -- 172.21.15.154:0/1963673059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 msgr2=0x7fa0480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.245+0000 7fa05bfff700 1 --2- 172.21.15.154:0/1963673059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa0480051c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0aeb10 tx=0x7fa05400b040 comp rx=0 tx=0).stop 2023-10-10T21:17:18.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.245+0000 7fa05b7fe700 1 -- 172.21.15.154:0/1963673059 reap_dead start 2023-10-10T21:17:18.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.245+0000 7fa05bfff700 1 -- 172.21.15.154:0/1963673059 shutdown_connections 2023-10-10T21:17:18.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.245+0000 7fa05bfff700 1 -- 172.21.15.154:0/1963673059 >> 172.21.15.154:0/1963673059 conn(0x7fa05c0cc1f0 msgr2=0x7fa05c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:18.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.245+0000 7fa05bfff700 1 -- 172.21.15.154:0/1963673059 shutdown_connections 2023-10-10T21:17:18.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.245+0000 7fa05bfff700 1 -- 172.21.15.154:0/1963673059 wait complete. 2023-10-10T21:17:18.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.246+0000 7fa05bfff700 1 Processor -- start 2023-10-10T21:17:18.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.247+0000 7fa05bfff700 1 -- start start 2023-10-10T21:17:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.247+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa05c0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.247+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c154260 0x7fa05c1665b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa05c1546d0 0x7fa05c166af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c150730 con 0x7fa048004d50 2023-10-10T21:17:18.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0c6b00 con 0x7fa05c1546d0 2023-10-10T21:17:18.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0c6260 con 0x7fa05c154260 2023-10-10T21:17:18.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa05c0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa05c0ace30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38068/0 (socket says 172.21.15.154:38068) 2023-10-10T21:17:18.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05affd700 1 -- 172.21.15.154:0/2500928386 learned_addr learned my addr 172.21.15.154:0/2500928386 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:18.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa053fff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c154260 0x7fa05c1665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05b7fe700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa05c1546d0 0x7fa05c166af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05affd700 1 -- 172.21.15.154:0/2500928386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c154260 msgr2=0x7fa05c1665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05affd700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c154260 0x7fa05c1665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05affd700 1 -- 172.21.15.154:0/2500928386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa05c1546d0 msgr2=0x7fa05c166af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05affd700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa05c1546d0 0x7fa05c166af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05affd700 1 -- 172.21.15.154:0/2500928386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0c6540 con 0x7fa048004d50 2023-10-10T21:17:18.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa053fff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c154260 0x7fa05c1665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:18.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa05affd700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa05c0ace30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00e7b0 tx=0x7fa04c000c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:18.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.248+0000 7fa052ffd700 1 -- 172.21.15.154:0/2500928386 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c0125d0 con 0x7fa048004d50 2023-10-10T21:17:18.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.249+0000 7fa052ffd700 1 -- 172.21.15.154:0/2500928386 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c010040 con 0x7fa048004d50 2023-10-10T21:17:18.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.249+0000 7fa052ffd700 1 -- 172.21.15.154:0/2500928386 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c012960 con 0x7fa048004d50 2023-10-10T21:17:18.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.249+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c0c6820 con 0x7fa048004d50 2023-10-10T21:17:18.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.249+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c0c5f10 con 0x7fa048004d50 2023-10-10T21:17:18.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.250+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c168aa0 con 0x7fa048004d50 2023-10-10T21:17:18.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.250+0000 7fa052ffd700 1 -- 172.21.15.154:0/2500928386 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa04c012d10 con 0x7fa048004d50 2023-10-10T21:17:18.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.251+0000 7fa052ffd700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa03c066f30 0x7fa03c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.251+0000 7fa052ffd700 1 -- 172.21.15.154:0/2500928386 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fa04c083700 con 0x7fa048004d50 2023-10-10T21:17:18.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.252+0000 7fa053fff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa03c066f30 0x7fa03c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.252+0000 7fa053fff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa03c066f30 0x7fa03c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa05c06d2b0 tx=0x7fa044009040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:18.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.255+0000 7fa052ffd700 1 -- 172.21.15.154:0/2500928386 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa04c04d5a0 con 0x7fa048004d50 2023-10-10T21:17:18.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.449+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa05c04c3c0 con 0x7fa048004d50 2023-10-10T21:17:18.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.450+0000 7fa052ffd700 1 -- 172.21.15.154:0/2500928386 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+12777 (secure 0 0 0) 0x7fa04c019020 con 0x7fa048004d50 2023-10-10T21:17:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:18.452 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":77,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:17.520976+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:18.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.452+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa03c066f30 msgr2=0x7fa03c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa03c066f30 0x7fa03c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa05c06d2b0 tx=0x7fa044009040 comp rx=0 tx=0).stop 2023-10-10T21:17:18.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 msgr2=0x7fa05c0ace30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa05c0ace30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00e7b0 tx=0x7fa04c000c30 comp rx=0 tx=0).stop 2023-10-10T21:17:18.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 shutdown_connections 2023-10-10T21:17:18.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa03c066f30 0x7fa03c0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa05c1546d0 0x7fa05c166af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048004d50 0x7fa05c0ace30 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 --2- 172.21.15.154:0/2500928386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c154260 0x7fa05c1665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 >> 172.21.15.154:0/2500928386 conn(0x7fa05c0cc1f0 msgr2=0x7fa05c0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:18.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 shutdown_connections 2023-10-10T21:17:18.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.453+0000 7fa05bfff700 1 -- 172.21.15.154:0/2500928386 wait complete. 2023-10-10T21:17:18.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T21:17:18.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:17:18.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.657+0000 7fe7ce3ff700 1 Processor -- start 2023-10-10T21:17:18.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.657+0000 7fe7ce3ff700 1 -- start start 2023-10-10T21:17:18.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7ce3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7c815ac80 0x7fe7c8069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7ce3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7c815b050 0x7fe7c8069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7ce3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c80af2f0 con 0x7fe7c80afa60 2023-10-10T21:17:18.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7ce3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c80af5d0 con 0x7fe7c815b050 2023-10-10T21:17:18.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7ce3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c80c8660 con 0x7fe7c815ac80 2023-10-10T21:17:18.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7bffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7c815b050 0x7fe7c8069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7bffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7c815b050 0x7fe7c8069cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38082/0 (socket says 172.21.15.154:38082) 2023-10-10T21:17:18.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7bffff700 1 -- 172.21.15.154:0/3748155105 learned_addr learned my addr 172.21.15.154:0/3748155105 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:18.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7cc99c700 1 --1- 172.21.15.154:0/3748155105 >> v1:172.21.15.154:6789/0 conn(0x7fe7c80afa60 0x7fe7c80afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56726/0 (socket says 172.21.15.154:56726) 2023-10-10T21:17:18.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.659+0000 7fe7c7fff700 1 --2- 172.21.15.154:0/3748155105 >> v2:172.21.15.179:3300/0 conn(0x7fe7c815ac80 0x7fe7c8069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.660+0000 7fe7bffff700 1 -- 172.21.15.154:0/3748155105 >> v2:172.21.15.179:3300/0 conn(0x7fe7c815ac80 msgr2=0x7fe7c8069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:18.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.660+0000 7fe7bffff700 1 --2- 172.21.15.154:0/3748155105 >> v2:172.21.15.179:3300/0 conn(0x7fe7c815ac80 0x7fe7c8069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.660+0000 7fe7bffff700 1 -- 172.21.15.154:0/3748155105 >> v1:172.21.15.154:6789/0 conn(0x7fe7c80afa60 legacy=0x7fe7c80afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.660+0000 7fe7bffff700 1 -- 172.21.15.154:0/3748155105 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80c8940 con 0x7fe7c815b050 2023-10-10T21:17:18.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.660+0000 7fe7bffff700 1 --2- 172.21.15.154:0/3748155105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 0x7fe7c8069cb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe7c806fdc0 tx=0x7fe7b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6a1df72402bf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:18.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.660+0000 7fe7c77fe700 1 -- 172.21.15.154:0/3748155105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0009e70 con 0x7fe7c815b050 2023-10-10T21:17:18.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.660+0000 7fe7c77fe700 1 -- 172.21.15.154:0/3748155105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b000b860 con 0x7fe7c815b050 2023-10-10T21:17:18.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.660+0000 7fe7c77fe700 1 -- 172.21.15.154:0/3748155105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000bc00 con 0x7fe7c815b050 2023-10-10T21:17:18.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.661+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3748155105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 msgr2=0x7fe7c8069cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.661+0000 7fe7ce3ff700 1 --2- 172.21.15.154:0/3748155105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 0x7fe7c8069cb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe7c806fdc0 tx=0x7fe7b0009250 comp rx=0 tx=0).stop 2023-10-10T21:17:18.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.661+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3748155105 shutdown_connections 2023-10-10T21:17:18.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.661+0000 7fe7ce3ff700 1 --2- 172.21.15.154:0/3748155105 >> v2:172.21.15.179:3300/0 conn(0x7fe7c815ac80 0x7fe7c8069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.661+0000 7fe7ce3ff700 1 --2- 172.21.15.154:0/3748155105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 0x7fe7c8069cb0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.661+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3748155105 >> 172.21.15.154:0/3748155105 conn(0x7fe7c8068e10 msgr2=0x7fe7c80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:18.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.661+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3748155105 shutdown_connections 2023-10-10T21:17:18.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.661+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3748155105 wait complete. 2023-10-10T21:17:18.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.662+0000 7fe7ce3ff700 1 Processor -- start 2023-10-10T21:17:18.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.663+0000 7fe7ce3ff700 1 -- start start 2023-10-10T21:17:18.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.663+0000 7fe7ce3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7c80afa60 0x7fe7c81490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.663+0000 7fe7ce3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7c815ac80 0x7fe7c80ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.663+0000 7fe7ce3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 0x7fe7c815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.663+0000 7fe7ce3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c81495f0 con 0x7fe7c815b050 2023-10-10T21:17:18.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.663+0000 7fe7ce3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80ac350 con 0x7fe7c815ac80 2023-10-10T21:17:18.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7ce3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c815dd70 con 0x7fe7c80afa60 2023-10-10T21:17:18.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7cc99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 0x7fe7c815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7cc99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 0x7fe7c815b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38098/0 (socket says 172.21.15.154:38098) 2023-10-10T21:17:18.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7cc99c700 1 -- 172.21.15.154:0/3041703934 learned_addr learned my addr 172.21.15.154:0/3041703934 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:18.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7bffff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7c815ac80 0x7fe7c80ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7c7fff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7c80afa60 0x7fe7c81490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7cc99c700 1 -- 172.21.15.154:0/3041703934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7c80afa60 msgr2=0x7fe7c81490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7cc99c700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7c80afa60 0x7fe7c81490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7cc99c700 1 -- 172.21.15.154:0/3041703934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7c815ac80 msgr2=0x7fe7c80ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7cc99c700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7c815ac80 0x7fe7c80ca7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7cc99c700 1 -- 172.21.15.154:0/3041703934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00094f0 con 0x7fe7c815b050 2023-10-10T21:17:18.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.664+0000 7fe7cc99c700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 0x7fe7c815b530 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000cd00 tx=0x7fe7c0001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:18.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.665+0000 7fe7c4ff9700 1 -- 172.21.15.154:0/3041703934 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0005df0 con 0x7fe7c815b050 2023-10-10T21:17:18.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.665+0000 7fe7c4ff9700 1 -- 172.21.15.154:0/3041703934 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c000a960 con 0x7fe7c815b050 2023-10-10T21:17:18.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.665+0000 7fe7c4ff9700 1 -- 172.21.15.154:0/3041703934 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000ad00 con 0x7fe7c815b050 2023-10-10T21:17:18.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.665+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c815da40 con 0x7fe7c815b050 2023-10-10T21:17:18.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.665+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c80cb3f0 con 0x7fe7c815b050 2023-10-10T21:17:18.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.666+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c815dee0 con 0x7fe7c815b050 2023-10-10T21:17:18.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.667+0000 7fe7c4ff9700 1 -- 172.21.15.154:0/3041703934 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7c0007300 con 0x7fe7c815b050 2023-10-10T21:17:18.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.667+0000 7fe7c4ff9700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe7a8066f30 0x7fe7a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:18.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.668+0000 7fe7c4ff9700 1 -- 172.21.15.154:0/3041703934 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fe7c0084540 con 0x7fe7c815b050 2023-10-10T21:17:18.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.668+0000 7fe7c7fff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe7a8066f30 0x7fe7a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:18.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.668+0000 7fe7c7fff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe7a8066f30 0x7fe7a80693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009d40 tx=0x7fe7b8008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:18.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.672+0000 7fe7c4ff9700 1 -- 172.21.15.154:0/3041703934 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7c0051960 con 0x7fe7c815b050 2023-10-10T21:17:18.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.860+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7c804c3c0 con 0x7fe7c815b050 2023-10-10T21:17:18.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.861+0000 7fe7c4ff9700 1 -- 172.21.15.154:0/3041703934 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7c000ae60 con 0x7fe7c815b050 2023-10-10T21:17:18.866 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:17:18.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.863+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe7a8066f30 msgr2=0x7fe7a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.863+0000 7fe7ce3ff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe7a8066f30 0x7fe7a80693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009d40 tx=0x7fe7b8008040 comp rx=0 tx=0).stop 2023-10-10T21:17:18.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 msgr2=0x7fe7c815b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:18.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 0x7fe7c815b530 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000cd00 tx=0x7fe7c0001b10 comp rx=0 tx=0).stop 2023-10-10T21:17:18.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 shutdown_connections 2023-10-10T21:17:18.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c815b050 0x7fe7c815b530 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7c80afa60 0x7fe7c81490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe7a8066f30 0x7fe7a80693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 --2- 172.21.15.154:0/3041703934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7c815ac80 0x7fe7c80ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 >> 172.21.15.154:0/3041703934 conn(0x7fe7c8068e10 msgr2=0x7fe7c81572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 shutdown_connections 2023-10-10T21:17:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:18.864+0000 7fe7ce3ff700 1 -- 172.21.15.154:0/3041703934 wait complete. 2023-10-10T21:17:18.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T21:17:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.065+0000 7fd296fff700 1 Processor -- start 2023-10-10T21:17:19.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.065+0000 7fd296fff700 1 -- start start 2023-10-10T21:17:19.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.066+0000 7fd296fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 0x7fd29015d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.066+0000 7fd296fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd29015dd90 0x7fd2900adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.066+0000 7fd296fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2900b0750 con 0x7fd2900afc40 2023-10-10T21:17:19.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.066+0000 7fd296fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2900aca70 con 0x7fd29015dd90 2023-10-10T21:17:19.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.066+0000 7fd296fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900acd50 con 0x7fd2900b0010 2023-10-10T21:17:19.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.067+0000 7fd29559c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd29015dd90 0x7fd2900adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.067+0000 7fd29559c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd29015dd90 0x7fd2900adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38104/0 (socket says 172.21.15.154:38104) 2023-10-10T21:17:19.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.067+0000 7fd29559c700 1 -- 172.21.15.154:0/1578288656 learned_addr learned my addr 172.21.15.154:0/1578288656 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:19.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.067+0000 7fd28ffff700 1 --2- 172.21.15.154:0/1578288656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 0x7fd29015d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.067+0000 7fd29559c700 1 -- 172.21.15.154:0/1578288656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 msgr2=0x7fd29015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:19.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.067+0000 7fd29559c700 1 --2- 172.21.15.154:0/1578288656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 0x7fd29015d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.067+0000 7fd29559c700 1 -- 172.21.15.154:0/1578288656 >> v1:172.21.15.179:6789/0 conn(0x7fd2900afc40 legacy=0x7fd2900b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.067+0000 7fd29559c700 1 -- 172.21.15.154:0/1578288656 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2900ad030 con 0x7fd29015dd90 2023-10-10T21:17:19.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.067+0000 7fd28ffff700 1 --2- 172.21.15.154:0/1578288656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 0x7fd29015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:19.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd29559c700 1 --2- 172.21.15.154:0/1578288656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 0x7fd2900adb10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd288009f20 tx=0x7fd288009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5cfc5f66079cfe server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:19.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd28f7fe700 1 -- 172.21.15.154:0/1578288656 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800e070 con 0x7fd29015dd90 2023-10-10T21:17:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd28f7fe700 1 -- 172.21.15.154:0/1578288656 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28800ba80 con 0x7fd29015dd90 2023-10-10T21:17:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd28f7fe700 1 -- 172.21.15.154:0/1578288656 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880092e0 con 0x7fd29015dd90 2023-10-10T21:17:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd296fff700 1 -- 172.21.15.154:0/1578288656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 msgr2=0x7fd2900adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd296fff700 1 --2- 172.21.15.154:0/1578288656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 0x7fd2900adb10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd288009f20 tx=0x7fd288009840 comp rx=0 tx=0).stop 2023-10-10T21:17:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd296fff700 1 -- 172.21.15.154:0/1578288656 shutdown_connections 2023-10-10T21:17:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd296fff700 1 --2- 172.21.15.154:0/1578288656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 0x7fd2900adb10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd296fff700 1 --2- 172.21.15.154:0/1578288656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 0x7fd29015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd296fff700 1 -- 172.21.15.154:0/1578288656 >> 172.21.15.154:0/1578288656 conn(0x7fd29006a320 msgr2=0x7fd2900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:19.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.068+0000 7fd296fff700 1 -- 172.21.15.154:0/1578288656 shutdown_connections 2023-10-10T21:17:19.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.069+0000 7fd296fff700 1 -- 172.21.15.154:0/1578288656 wait complete. 2023-10-10T21:17:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.070+0000 7fd296fff700 1 Processor -- start 2023-10-10T21:17:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.070+0000 7fd296fff700 1 -- start start 2023-10-10T21:17:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd296fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2900afc40 0x7fd2901716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd296fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 0x7fd290152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd296fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 0x7fd29014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd296fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290157450 con 0x7fd29015dd90 2023-10-10T21:17:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd296fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29014f840 con 0x7fd2900afc40 2023-10-10T21:17:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd296fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd290171cd0 con 0x7fd2900b0010 2023-10-10T21:17:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd29559c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 0x7fd29014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd29559c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 0x7fd29014f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38116/0 (socket says 172.21.15.154:38116) 2023-10-10T21:17:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd29559c700 1 -- 172.21.15.154:0/4128398414 learned_addr learned my addr 172.21.15.154:0/4128398414 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd28ffff700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 0x7fd290152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.071+0000 7fd294d9b700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2900afc40 0x7fd2901716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd29559c700 1 -- 172.21.15.154:0/4128398414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 msgr2=0x7fd290152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd29559c700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 0x7fd290152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd29559c700 1 -- 172.21.15.154:0/4128398414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2900afc40 msgr2=0x7fd2901716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd29559c700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2900afc40 0x7fd2901716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd29559c700 1 -- 172.21.15.154:0/4128398414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288009ae0 con 0x7fd29015dd90 2023-10-10T21:17:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd29559c700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 0x7fd29014f300 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd28800b6c0 tx=0x7fd288018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd28cff9700 1 -- 172.21.15.154:0/4128398414 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880032f0 con 0x7fd29015dd90 2023-10-10T21:17:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd28cff9700 1 -- 172.21.15.154:0/4128398414 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288008d50 con 0x7fd29015dd90 2023-10-10T21:17:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd290171fb0 con 0x7fd29015dd90 2023-10-10T21:17:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd28cff9700 1 -- 172.21.15.154:0/4128398414 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288025690 con 0x7fd29015dd90 2023-10-10T21:17:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.072+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd290172570 con 0x7fd29015dd90 2023-10-10T21:17:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.073+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd290157220 con 0x7fd29015dd90 2023-10-10T21:17:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.074+0000 7fd28cff9700 1 -- 172.21.15.154:0/4128398414 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd288003040 con 0x7fd29015dd90 2023-10-10T21:17:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.075+0000 7fd28cff9700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd274066f30 0x7fd2740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.075+0000 7fd28cff9700 1 -- 172.21.15.154:0/4128398414 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fd288085f80 con 0x7fd29015dd90 2023-10-10T21:17:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.075+0000 7fd294d9b700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd274066f30 0x7fd2740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.076+0000 7fd294d9b700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd274066f30 0x7fd2740693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd284003a80 tx=0x7fd284007ec0 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:19.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.079+0000 7fd28cff9700 1 -- 172.21.15.154:0/4128398414 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd290157220 con 0x7fd29015dd90 2023-10-10T21:17:19.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:17:19.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:17:19.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.282+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd290157220 con 0x7fd29015dd90 2023-10-10T21:17:19.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.282+0000 7fd28cff9700 1 -- 172.21.15.154:0/4128398414 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd290157220 con 0x7fd29015dd90 2023-10-10T21:17:19.284 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:19.284 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:17:19.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:19.284 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T21:17:19.285 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T21:17:19.285 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:19.285 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:17:19.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd274066f30 msgr2=0x7fd2740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd274066f30 0x7fd2740693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd284003a80 tx=0x7fd284007ec0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 msgr2=0x7fd29014f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 0x7fd29014f300 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd28800b6c0 tx=0x7fd288018000 comp rx=0 tx=0).stop 2023-10-10T21:17:19.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 shutdown_connections 2023-10-10T21:17:19.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015dd90 0x7fd29014f300 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd274066f30 0x7fd2740693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2900afc40 0x7fd2901716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 --2- 172.21.15.154:0/4128398414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0010 0x7fd290152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 >> 172.21.15.154:0/4128398414 conn(0x7fd29006a320 msgr2=0x7fd2900ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:19.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 shutdown_connections 2023-10-10T21:17:19.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.285+0000 7fd296fff700 1 -- 172.21.15.154:0/4128398414 wait complete. 2023-10-10T21:17:19.303 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T21:17:19.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T21:17:19.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.529+0000 7f1aecbff700 1 Processor -- start 2023-10-10T21:17:19.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.529+0000 7f1aecbff700 1 -- start start 2023-10-10T21:17:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1aecbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ae8069a50 0x7f1ae80c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1aecbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae8069e20 0x7f1ae81569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1aecbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae80ac030 con 0x7f1ae80c8490 2023-10-10T21:17:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1aecbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae80ab820 con 0x7f1ae8069a50 2023-10-10T21:17:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1aecbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae806dbb0 con 0x7f1ae8069e20 2023-10-10T21:17:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1ae659c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ae8069a50 0x7f1ae80c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1ae6d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae8069e20 0x7f1ae81569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1adffff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1ae80c8490 0x7f1ae815a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:54004/0 (socket says 172.21.15.154:54004) 2023-10-10T21:17:19.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1ae659c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ae8069a50 0x7f1ae80c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:38472/0 (socket says 172.21.15.154:38472) 2023-10-10T21:17:19.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.531+0000 7f1adffff700 1 -- 172.21.15.154:0/2363394729 learned_addr learned my addr 172.21.15.154:0/2363394729 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:19.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae5d9b700 1 -- 172.21.15.154:0/2363394729 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277351474 0 0) 0x7f1ad0001110 con 0x7f1ae80c8490 2023-10-10T21:17:19.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae5d9b700 1 -- 172.21.15.154:0/2363394729 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad4003570 con 0x7f1ae80c8490 2023-10-10T21:17:19.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae659c700 1 -- 172.21.15.154:0/2363394729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae8069e20 msgr2=0x7f1ae81569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:19.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae659c700 1 --2- 172.21.15.154:0/2363394729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae8069e20 0x7f1ae81569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae659c700 1 -- 172.21.15.154:0/2363394729 >> v1:172.21.15.179:6789/0 conn(0x7f1ae80c8490 legacy=0x7f1ae815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae659c700 1 -- 172.21.15.154:0/2363394729 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80aba70 con 0x7f1ae8069a50 2023-10-10T21:17:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae6d9d700 1 --2- 172.21.15.154:0/2363394729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae8069e20 0x7f1ae81569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae659c700 1 --2- 172.21.15.154:0/2363394729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae8069a50 0x7f1ae80c6ac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80098e0 tx=0x7f1ad80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e4ddf485bc66e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae5d9b700 1 -- 172.21.15.154:0/2363394729 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011630 con 0x7f1ae8069a50 2023-10-10T21:17:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae5d9b700 1 -- 172.21.15.154:0/2363394729 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad8011790 con 0x7f1ae8069a50 2023-10-10T21:17:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.532+0000 7f1ae5d9b700 1 -- 172.21.15.154:0/2363394729 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011b30 con 0x7f1ae8069a50 2023-10-10T21:17:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.533+0000 7f1aecbff700 1 -- 172.21.15.154:0/2363394729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae8069a50 msgr2=0x7f1ae80c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.533+0000 7f1aecbff700 1 --2- 172.21.15.154:0/2363394729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae8069a50 0x7f1ae80c6ac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80098e0 tx=0x7f1ad80091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.533+0000 7f1aecbff700 1 -- 172.21.15.154:0/2363394729 shutdown_connections 2023-10-10T21:17:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.533+0000 7f1aecbff700 1 --2- 172.21.15.154:0/2363394729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae8069e20 0x7f1ae81569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.533+0000 7f1aecbff700 1 --2- 172.21.15.154:0/2363394729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae8069a50 0x7f1ae80c6ac0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.533+0000 7f1aecbff700 1 -- 172.21.15.154:0/2363394729 >> 172.21.15.154:0/2363394729 conn(0x7f1ae80c8f90 msgr2=0x7f1ae80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.533+0000 7f1aecbff700 1 -- 172.21.15.154:0/2363394729 shutdown_connections 2023-10-10T21:17:19.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.533+0000 7f1aecbff700 1 -- 172.21.15.154:0/2363394729 wait complete. 2023-10-10T21:17:19.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.534+0000 7f1aecbff700 1 Processor -- start 2023-10-10T21:17:19.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.535+0000 7f1aecbff700 1 -- start start 2023-10-10T21:17:19.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.535+0000 7f1aecbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae8069a50 0x7f1ae8168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.535+0000 7f1aecbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae8069e20 0x7f1ae80b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.535+0000 7f1aecbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae80c8490 0x7f1ae80b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.535+0000 7f1aecbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae80c4140 con 0x7f1ae8069a50 2023-10-10T21:17:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.535+0000 7f1aecbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae80c3530 con 0x7f1ae8069e20 2023-10-10T21:17:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.535+0000 7f1aecbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae80c3810 con 0x7f1ae80c8490 2023-10-10T21:17:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae8069a50 0x7f1ae8168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae8069a50 0x7f1ae8168720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38124/0 (socket says 172.21.15.154:38124) 2023-10-10T21:17:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae659c700 1 -- 172.21.15.154:0/791196748 learned_addr learned my addr 172.21.15.154:0/791196748 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1adffff700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae8069e20 0x7f1ae80b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae6d9d700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae80c8490 0x7f1ae80b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae659c700 1 -- 172.21.15.154:0/791196748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae80c8490 msgr2=0x7f1ae80b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae659c700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae80c8490 0x7f1ae80b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae659c700 1 -- 172.21.15.154:0/791196748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae8069e20 msgr2=0x7f1ae80b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae659c700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae8069e20 0x7f1ae80b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae659c700 1 -- 172.21.15.154:0/791196748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae000ab30 con 0x7f1ae8069a50 2023-10-10T21:17:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.536+0000 7f1ae659c700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae8069a50 0x7f1ae8168720 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1ae80cc0b0 tx=0x7f1ad8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.537+0000 7f1ade7fc700 1 -- 172.21.15.154:0/791196748 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011900 con 0x7f1ae8069a50 2023-10-10T21:17:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.537+0000 7f1ade7fc700 1 -- 172.21.15.154:0/791196748 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad8011a60 con 0x7f1ae8069a50 2023-10-10T21:17:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.537+0000 7f1ade7fc700 1 -- 172.21.15.154:0/791196748 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8025640 con 0x7f1ae8069a50 2023-10-10T21:17:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.537+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad8009420 con 0x7f1ae8069a50 2023-10-10T21:17:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.537+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae80c3dd0 con 0x7f1ae8069a50 2023-10-10T21:17:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.538+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae80c4420 con 0x7f1ae8069a50 2023-10-10T21:17:19.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.539+0000 7f1ade7fc700 1 -- 172.21.15.154:0/791196748 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ad8025a30 con 0x7f1ae8069a50 2023-10-10T21:17:19.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.539+0000 7f1ade7fc700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1ac8066f30 0x7f1ac80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:19.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.540+0000 7f1ade7fc700 1 -- 172.21.15.154:0/791196748 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f1ad80859d0 con 0x7f1ae8069a50 2023-10-10T21:17:19.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.540+0000 7f1adffff700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1ac8066f30 0x7f1ac80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:19.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.540+0000 7f1adffff700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1ac8066f30 0x7f1ac80693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1ae80c4b10 tx=0x7f1ad0007bf0 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.544+0000 7f1ade7fc700 1 -- 172.21.15.154:0/791196748 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad8052e10 con 0x7f1ae8069a50 2023-10-10T21:17:19.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:19.736+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1ae80718b0 con 0x7f1ae8069a50 2023-10-10T21:17:20.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.089+0000 7f1ade7fc700 1 -- 172.21.15.154:0/791196748 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1ad8056430 con 0x7f1ae8069a50 2023-10-10T21:17:20.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.095+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1ac8066f30 msgr2=0x7f1ac80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:20.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.095+0000 7f1aecbff700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1ac8066f30 0x7f1ac80693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1ae80c4b10 tx=0x7f1ad0007bf0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.095+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae8069a50 msgr2=0x7f1ae8168720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:20.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.095+0000 7f1aecbff700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae8069a50 0x7f1ae8168720 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1ae80cc0b0 tx=0x7f1ad8017000 comp rx=0 tx=0).stop 2023-10-10T21:17:20.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.096+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 shutdown_connections 2023-10-10T21:17:20.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.096+0000 7f1aecbff700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae80c8490 0x7f1ae80b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.096+0000 7f1aecbff700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae8069a50 0x7f1ae8168720 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.096+0000 7f1aecbff700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1ac8066f30 0x7f1ac80693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.096+0000 7f1aecbff700 1 --2- 172.21.15.154:0/791196748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae8069e20 0x7f1ae80b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.096+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 >> 172.21.15.154:0/791196748 conn(0x7f1ae80c8f90 msgr2=0x7f1ae8156d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:20.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.097+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 shutdown_connections 2023-10-10T21:17:20.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.097+0000 7f1aecbff700 1 -- 172.21.15.154:0/791196748 wait complete. 2023-10-10T21:17:20.100 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T21:17:20.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T21:17:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.304+0000 7f588619d700 1 Processor -- start 2023-10-10T21:17:20.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.304+0000 7f588619d700 1 -- start start 2023-10-10T21:17:20.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.305+0000 7f588619d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58801563b0 0x7f58800ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.305+0000 7f588619d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5880156780 0x7f58800cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.305+0000 7f588619d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58800cbe50 con 0x7f58800ae2b0 2023-10-10T21:17:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.305+0000 7f588619d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58800cb370 con 0x7f58801563b0 2023-10-10T21:17:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.305+0000 7f588619d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58800cb650 con 0x7f5880156780 2023-10-10T21:17:20.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.305+0000 7f588519b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58801563b0 0x7f58800ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:20.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.305+0000 7f588519b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58801563b0 0x7f58800ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38126/0 (socket says 172.21.15.154:38126) 2023-10-10T21:17:20.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.305+0000 7f588519b700 1 -- 172.21.15.154:0/794629383 learned_addr learned my addr 172.21.15.154:0/794629383 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:20.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.306+0000 7f588499a700 1 --2- 172.21.15.154:0/794629383 >> v2:172.21.15.179:3300/0 conn(0x7f5880156780 0x7f58800cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:20.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.306+0000 7f588519b700 1 -- 172.21.15.154:0/794629383 >> v2:172.21.15.179:3300/0 conn(0x7f5880156780 msgr2=0x7f58800cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:20.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.306+0000 7f588519b700 1 --2- 172.21.15.154:0/794629383 >> v2:172.21.15.179:3300/0 conn(0x7f5880156780 0x7f58800cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.306+0000 7f588519b700 1 -- 172.21.15.154:0/794629383 >> v1:172.21.15.179:6789/0 conn(0x7f58800ae2b0 legacy=0x7f58800ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:20.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.306+0000 7f588519b700 1 -- 172.21.15.154:0/794629383 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800c6860 con 0x7f58801563b0 2023-10-10T21:17:20.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.306+0000 7f588519b700 1 --2- 172.21.15.154:0/794629383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58801563b0 0x7f58800ca7d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5880065950 tx=0x7f587c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b555467a0db99475 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:20.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.306+0000 7f5877fff700 1 -- 172.21.15.154:0/794629383 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c009e70 con 0x7f58801563b0 2023-10-10T21:17:20.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.306+0000 7f5877fff700 1 -- 172.21.15.154:0/794629383 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c00b860 con 0x7f58801563b0 2023-10-10T21:17:20.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.306+0000 7f5877fff700 1 -- 172.21.15.154:0/794629383 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c00bc00 con 0x7f58801563b0 2023-10-10T21:17:20.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.307+0000 7f588619d700 1 -- 172.21.15.154:0/794629383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58801563b0 msgr2=0x7f58800ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:20.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.307+0000 7f588619d700 1 --2- 172.21.15.154:0/794629383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58801563b0 0x7f58800ca7d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5880065950 tx=0x7f587c009250 comp rx=0 tx=0).stop 2023-10-10T21:17:20.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.307+0000 7f588619d700 1 -- 172.21.15.154:0/794629383 shutdown_connections 2023-10-10T21:17:20.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.307+0000 7f588619d700 1 --2- 172.21.15.154:0/794629383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58801563b0 0x7f58800ca7d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.307+0000 7f588619d700 1 --2- 172.21.15.154:0/794629383 >> v2:172.21.15.179:3300/0 conn(0x7f5880156780 0x7f58800cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.307+0000 7f588619d700 1 -- 172.21.15.154:0/794629383 >> 172.21.15.154:0/794629383 conn(0x7f5880068e20 msgr2=0x7f58800cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:20.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.307+0000 7f588619d700 1 -- 172.21.15.154:0/794629383 shutdown_connections 2023-10-10T21:17:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.307+0000 7f588619d700 1 -- 172.21.15.154:0/794629383 wait complete. 2023-10-10T21:17:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.309+0000 7f588619d700 1 Processor -- start 2023-10-10T21:17:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.309+0000 7f588619d700 1 -- start start 2023-10-10T21:17:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588619d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58800ae2b0 0x7f5880151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58801563b0 0x7f58800c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:20.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588619d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5880156780 0x7f58800b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:20.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588619d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800af0f0 con 0x7f58800ae2b0 2023-10-10T21:17:20.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588619d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800af3d0 con 0x7f5880156780 2023-10-10T21:17:20.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800b1800 con 0x7f58801563b0 2023-10-10T21:17:20.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588519b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58800ae2b0 0x7f5880151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:20.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588519b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58800ae2b0 0x7f5880151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38130/0 (socket says 172.21.15.154:38130) 2023-10-10T21:17:20.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588519b700 1 -- 172.21.15.154:0/1359949054 learned_addr learned my addr 172.21.15.154:0/1359949054 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:20.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588499a700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58801563b0 0x7f58800c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:20.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588599c700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5880156780 0x7f58800b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:20.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588519b700 1 -- 172.21.15.154:0/1359949054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58801563b0 msgr2=0x7f58800c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:20.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588519b700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58801563b0 0x7f58800c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588519b700 1 -- 172.21.15.154:0/1359949054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5880156780 msgr2=0x7f58800b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:20.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588519b700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5880156780 0x7f58800b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:20.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588519b700 1 -- 172.21.15.154:0/1359949054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0094f0 con 0x7f58800ae2b0 2023-10-10T21:17:20.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.310+0000 7f588599c700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5880156780 0x7f58800b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:20.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.311+0000 7f588519b700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58800ae2b0 0x7f5880151060 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f587c006fd0 tx=0x7f587c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:20.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.311+0000 7f58757fa700 1 -- 172.21.15.154:0/1359949054 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c011420 con 0x7f58800ae2b0 2023-10-10T21:17:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.311+0000 7f58757fa700 1 -- 172.21.15.154:0/1359949054 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c0115a0 con 0x7f58800ae2b0 2023-10-10T21:17:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.311+0000 7f58757fa700 1 -- 172.21.15.154:0/1359949054 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c011960 con 0x7f58800ae2b0 2023-10-10T21:17:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.311+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58800b1ae0 con 0x7f58800ae2b0 2023-10-10T21:17:20.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.311+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58801515a0 con 0x7f58800ae2b0 2023-10-10T21:17:20.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.312+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588004c3c0 con 0x7f58800ae2b0 2023-10-10T21:17:20.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.313+0000 7f58757fa700 1 -- 172.21.15.154:0/1359949054 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f587c0253f0 con 0x7f58800ae2b0 2023-10-10T21:17:20.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.314+0000 7f58757fa700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5864066f30 0x7f58640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:20.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.314+0000 7f58757fa700 1 -- 172.21.15.154:0/1359949054 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f587c086690 con 0x7f58800ae2b0 2023-10-10T21:17:20.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.314+0000 7f588499a700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5864066f30 0x7f58640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:20.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.315+0000 7f588499a700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5864066f30 0x7f58640693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58800b0b40 tx=0x7f5870008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:20.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.318+0000 7f58757fa700 1 -- 172.21.15.154:0/1359949054 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f587c053a60 con 0x7f58800ae2b0 2023-10-10T21:17:20.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:20.511+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f58800c6b40 con 0x7f58800ae2b0 2023-10-10T21:17:21.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.094+0000 7f58757fa700 1 -- 172.21.15.154:0/1359949054 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7f587c0330d0 con 0x7f58800ae2b0 2023-10-10T21:17:21.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.106+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5864066f30 msgr2=0x7f58640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:21.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.106+0000 7f588619d700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5864066f30 0x7f58640693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58800b0b40 tx=0x7f5870008040 comp rx=0 tx=0).stop 2023-10-10T21:17:21.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.106+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58800ae2b0 msgr2=0x7f5880151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:21.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.106+0000 7f588619d700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58800ae2b0 0x7f5880151060 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f587c006fd0 tx=0x7f587c017000 comp rx=0 tx=0).stop 2023-10-10T21:17:21.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.110+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 shutdown_connections 2023-10-10T21:17:21.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.110+0000 7f588619d700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5864066f30 0x7f58640693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:21.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.110+0000 7f588619d700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5880156780 0x7f58800b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:21.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.110+0000 7f588619d700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58800ae2b0 0x7f5880151060 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:21.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.110+0000 7f588619d700 1 --2- 172.21.15.154:0/1359949054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58801563b0 0x7f58800c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:21.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.110+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 >> 172.21.15.154:0/1359949054 conn(0x7f5880068e20 msgr2=0x7f5880152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:21.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.113+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 shutdown_connections 2023-10-10T21:17:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.115+0000 7f588619d700 1 -- 172.21.15.154:0/1359949054 wait complete. 2023-10-10T21:17:21.118 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T21:17:21.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T21:17:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.320+0000 7f0ea5dff700 1 Processor -- start 2023-10-10T21:17:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.320+0000 7f0ea5dff700 1 -- start start 2023-10-10T21:17:21.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.321+0000 7f0ea5dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ea0159930 0x7f0ea0159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:21.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.321+0000 7f0ea5dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ea00cb710 0x7f0ea00b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:21.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.321+0000 7f0ea5dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea00689e0 con 0x7f0ea00cd1c0 2023-10-10T21:17:21.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.321+0000 7f0ea5dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea00cbcc0 con 0x7f0ea00cb710 2023-10-10T21:17:21.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.321+0000 7f0ea5dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea00cbfa0 con 0x7f0ea0159930 2023-10-10T21:17:21.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.322+0000 7f0e97fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ea00cb710 0x7f0ea00b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:21.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.322+0000 7f0e97fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ea00cb710 0x7f0ea00b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38136/0 (socket says 172.21.15.154:38136) 2023-10-10T21:17:21.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.322+0000 7f0e97fff700 1 -- 172.21.15.154:0/2955501568 learned_addr learned my addr 172.21.15.154:0/2955501568 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:21.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.322+0000 7f0e9f7fe700 1 --2- 172.21.15.154:0/2955501568 >> v2:172.21.15.179:3300/0 conn(0x7f0ea0159930 0x7f0ea0159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.322+0000 7f0e97fff700 1 -- 172.21.15.154:0/2955501568 >> v2:172.21.15.179:3300/0 conn(0x7f0ea0159930 msgr2=0x7f0ea0159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.322+0000 7f0e97fff700 1 --2- 172.21.15.154:0/2955501568 >> v2:172.21.15.179:3300/0 conn(0x7f0ea0159930 0x7f0ea0159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.322+0000 7f0e97fff700 1 -- 172.21.15.154:0/2955501568 >> v1:172.21.15.179:6789/0 conn(0x7f0ea00cd1c0 legacy=0x7f0ea00b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.322+0000 7f0e97fff700 1 -- 172.21.15.154:0/2955501568 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0068390 con 0x7f0ea00cb710 2023-10-10T21:17:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.322+0000 7f0e97fff700 1 --2- 172.21.15.154:0/2955501568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea00cb710 0x7f0ea00b3ef0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0089860 tx=0x7f0e88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6957e3326d331c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:21.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0e9effd700 1 -- 172.21.15.154:0/2955501568 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8800b8f0 con 0x7f0ea00cb710 2023-10-10T21:17:21.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0e9effd700 1 -- 172.21.15.154:0/2955501568 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8800ba50 con 0x7f0ea00cb710 2023-10-10T21:17:21.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0e9effd700 1 -- 172.21.15.154:0/2955501568 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8800bdf0 con 0x7f0ea00cb710 2023-10-10T21:17:21.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2955501568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea00cb710 msgr2=0x7f0ea00b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:21.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0ea5dff700 1 --2- 172.21.15.154:0/2955501568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea00cb710 0x7f0ea00b3ef0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0089860 tx=0x7f0e88009250 comp rx=0 tx=0).stop 2023-10-10T21:17:21.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2955501568 shutdown_connections 2023-10-10T21:17:21.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0ea5dff700 1 --2- 172.21.15.154:0/2955501568 >> v2:172.21.15.179:3300/0 conn(0x7f0ea0159930 0x7f0ea0159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:21.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0ea5dff700 1 --2- 172.21.15.154:0/2955501568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea00cb710 0x7f0ea00b3ef0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:21.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2955501568 >> 172.21.15.154:0/2955501568 conn(0x7f0ea00999d0 msgr2=0x7f0ea00b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:21.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2955501568 shutdown_connections 2023-10-10T21:17:21.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.323+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2955501568 wait complete. 2023-10-10T21:17:21.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.325+0000 7f0ea5dff700 1 Processor -- start 2023-10-10T21:17:21.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.325+0000 7f0ea5dff700 1 -- start start 2023-10-10T21:17:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0ea5dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ea00cb710 0x7f0ea0151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0ea5dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ea00cd1c0 0x7f0ea00c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0ea5dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0159930 0x7f0ea00ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0ea5dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015d9f0 con 0x7f0ea0159930 2023-10-10T21:17:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0ea5dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015dcd0 con 0x7f0ea00cd1c0 2023-10-10T21:17:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0ea5dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015dfb0 con 0x7f0ea00cb710 2023-10-10T21:17:21.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0159930 0x7f0ea00ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:21.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0159930 0x7f0ea00ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38142/0 (socket says 172.21.15.154:38142) 2023-10-10T21:17:21.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e9ffff700 1 -- 172.21.15.154:0/2057485611 learned_addr learned my addr 172.21.15.154:0/2057485611 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:21.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e9f7fe700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ea00cb710 0x7f0ea0151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:21.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e97fff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ea00cd1c0 0x7f0ea00c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:21.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e9ffff700 1 -- 172.21.15.154:0/2057485611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ea00cb710 msgr2=0x7f0ea0151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e9ffff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ea00cb710 0x7f0ea0151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e9ffff700 1 -- 172.21.15.154:0/2057485611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ea00cd1c0 msgr2=0x7f0ea00c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e9ffff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ea00cd1c0 0x7f0ea00c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.326+0000 7f0e9ffff700 1 -- 172.21.15.154:0/2057485611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880094f0 con 0x7f0ea0159930 2023-10-10T21:17:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.327+0000 7f0e9ffff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0159930 0x7f0ea00ca3b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c8e0 tx=0x7f0e98001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.327+0000 7f0e977fe700 1 -- 172.21.15.154:0/2057485611 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800ce80 con 0x7f0ea0159930 2023-10-10T21:17:21.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.327+0000 7f0e977fe700 1 -- 172.21.15.154:0/2057485611 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9800a7e0 con 0x7f0ea0159930 2023-10-10T21:17:21.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.327+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea015e290 con 0x7f0ea0159930 2023-10-10T21:17:21.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.327+0000 7f0e977fe700 1 -- 172.21.15.154:0/2057485611 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800ab80 con 0x7f0ea0159930 2023-10-10T21:17:21.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.327+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea00c8700 con 0x7f0ea0159930 2023-10-10T21:17:21.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.328+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea004c3c0 con 0x7f0ea0159930 2023-10-10T21:17:21.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.329+0000 7f0e977fe700 1 -- 172.21.15.154:0/2057485611 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e98024420 con 0x7f0ea0159930 2023-10-10T21:17:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.330+0000 7f0e977fe700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.330+0000 7f0e977fe700 1 -- 172.21.15.154:0/2057485611 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f0e980850f0 con 0x7f0ea0159930 2023-10-10T21:17:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.331+0000 7f0e9f7fe700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.331+0000 7f0e9f7fe700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e90006aa0 tx=0x7f0e90008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.334+0000 7f0e977fe700 1 -- 172.21.15.154:0/2057485611 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e980522c0 con 0x7f0ea0159930 2023-10-10T21:17:21.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:21.569+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0ea00ad240 con 0x7f0ea0159930 2023-10-10T21:17:22.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.114+0000 7f0e977fe700 1 -- 172.21.15.154:0/2057485611 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0e980558e0 con 0x7f0ea0159930 2023-10-10T21:17:22.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.124+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0e80066f30 msgr2=0x7f0e800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.124+0000 7f0ea5dff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e90006aa0 tx=0x7f0e90008040 comp rx=0 tx=0).stop 2023-10-10T21:17:22.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.124+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0159930 msgr2=0x7f0ea00ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.124+0000 7f0ea5dff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0159930 0x7f0ea00ca3b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c8e0 tx=0x7f0e98001710 comp rx=0 tx=0).stop 2023-10-10T21:17:22.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.125+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 shutdown_connections 2023-10-10T21:17:22.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.125+0000 7f0ea5dff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0159930 0x7f0ea00ca3b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.125+0000 7f0ea5dff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ea00cb710 0x7f0ea0151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.125+0000 7f0ea5dff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e90006aa0 tx=0x7f0e90008040 comp rx=0 tx=0).stop 2023-10-10T21:17:22.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.125+0000 7f0ea5dff700 1 --2- 172.21.15.154:0/2057485611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ea00cd1c0 0x7f0ea00c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.125+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 >> 172.21.15.154:0/2057485611 conn(0x7f0ea00999d0 msgr2=0x7f0ea0069360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.130+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 shutdown_connections 2023-10-10T21:17:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.130+0000 7f0ea5dff700 1 -- 172.21.15.154:0/2057485611 wait complete. 2023-10-10T21:17:22.135 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 8 and data pool 9 2023-10-10T21:17:22.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.337+0000 7f4c1c1ff700 1 Processor -- start 2023-10-10T21:17:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.337+0000 7f4c1c1ff700 1 -- start start 2023-10-10T21:17:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.338+0000 7f4c1c1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c14159c60 0x7f4c1415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.338+0000 7f4c1c1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1415a160 con 0x7f4c14159890 2023-10-10T21:17:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.338+0000 7f4c1c1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140d13a0 con 0x7f4c1415db10 2023-10-10T21:17:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.338+0000 7f4c1c1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1415df50 con 0x7f4c14159c60 2023-10-10T21:17:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c19f9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4c14159890 0x7f4c1415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56742/0 (socket says 172.21.15.154:56742) 2023-10-10T21:17:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c19f9b700 1 -- 172.21.15.154:0/713599841 learned_addr learned my addr 172.21.15.154:0/713599841 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c1979a700 1 --2- 172.21.15.154:0/713599841 >> v2:172.21.15.179:3300/0 conn(0x7f4c14159c60 0x7f4c1415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c18f99700 1 -- 172.21.15.154:0/713599841 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827342063 0 0) 0x7f4c1415a160 con 0x7f4c14159890 2023-10-10T21:17:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c18f99700 1 -- 172.21.15.154:0/713599841 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c00003570 con 0x7f4c14159890 2023-10-10T21:17:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c18f99700 1 -- 172.21.15.154:0/713599841 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494717484 0 0) 0x7f4c140d13a0 con 0x7f4c1415db10 2023-10-10T21:17:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c18f99700 1 -- 172.21.15.154:0/713599841 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c1415a160 con 0x7f4c1415db10 2023-10-10T21:17:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c1979a700 1 -- 172.21.15.154:0/713599841 >> v1:172.21.15.179:6789/0 conn(0x7f4c1415db10 legacy=0x7f4c14069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c1979a700 1 -- 172.21.15.154:0/713599841 >> v1:172.21.15.154:6789/0 conn(0x7f4c14159890 legacy=0x7f4c1415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c1979a700 1 -- 172.21.15.154:0/713599841 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1415e140 con 0x7f4c14159c60 2023-10-10T21:17:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.339+0000 7f4c1979a700 1 --2- 172.21.15.154:0/713599841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159c60 0x7f4c1415d5d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c040098e0 tx=0x7f4c040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=852310e5edcae898 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c18f99700 1 -- 172.21.15.154:0/713599841 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04011630 con 0x7f4c14159c60 2023-10-10T21:17:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c18f99700 1 -- 172.21.15.154:0/713599841 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c04011790 con 0x7f4c14159c60 2023-10-10T21:17:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c18f99700 1 -- 172.21.15.154:0/713599841 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04011b30 con 0x7f4c14159c60 2023-10-10T21:17:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/713599841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159c60 msgr2=0x7f4c1415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c1c1ff700 1 --2- 172.21.15.154:0/713599841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159c60 0x7f4c1415d5d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c040098e0 tx=0x7f4c040091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/713599841 shutdown_connections 2023-10-10T21:17:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c1c1ff700 1 --2- 172.21.15.154:0/713599841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159c60 0x7f4c1415d5d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/713599841 >> 172.21.15.154:0/713599841 conn(0x7f4c14068e20 msgr2=0x7f4c140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/713599841 shutdown_connections 2023-10-10T21:17:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.340+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/713599841 wait complete. 2023-10-10T21:17:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.342+0000 7f4c1c1ff700 1 Processor -- start 2023-10-10T21:17:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.342+0000 7f4c1c1ff700 1 -- start start 2023-10-10T21:17:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1c1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159890 0x7f4c14152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1c1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c14159c60 0x7f4c140cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1c1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1415db10 0x7f4c140ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1c1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140b3720 con 0x7f4c14159c60 2023-10-10T21:17:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1c1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140b3930 con 0x7f4c14159890 2023-10-10T21:17:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1c1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140b3c10 con 0x7f4c1415db10 2023-10-10T21:17:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1979a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c14159c60 0x7f4c140cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1979a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c14159c60 0x7f4c140cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38148/0 (socket says 172.21.15.154:38148) 2023-10-10T21:17:22.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1979a700 1 -- 172.21.15.154:0/4244891388 learned_addr learned my addr 172.21.15.154:0/4244891388 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:22.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c19f9b700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159890 0x7f4c14152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1a79c700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1415db10 0x7f4c140ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1979a700 1 -- 172.21.15.154:0/4244891388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1415db10 msgr2=0x7f4c140ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1979a700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1415db10 0x7f4c140ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1979a700 1 -- 172.21.15.154:0/4244891388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159890 msgr2=0x7f4c14152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1979a700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159890 0x7f4c14152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c1979a700 1 -- 172.21.15.154:0/4244891388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c04009420 con 0x7f4c14159c60 2023-10-10T21:17:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.343+0000 7f4c19f9b700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159890 0x7f4c14152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:22.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.344+0000 7f4c1979a700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c14159c60 0x7f4c140cdd60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4c14070e20 tx=0x7f4c04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.344+0000 7f4c09ffb700 1 -- 172.21.15.154:0/4244891388 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0401f070 con 0x7f4c14159c60 2023-10-10T21:17:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.344+0000 7f4c09ffb700 1 -- 172.21.15.154:0/4244891388 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c04000c90 con 0x7f4c14159c60 2023-10-10T21:17:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.344+0000 7f4c09ffb700 1 -- 172.21.15.154:0/4244891388 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04025420 con 0x7f4c14159c60 2023-10-10T21:17:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.344+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c140b3ef0 con 0x7f4c14159c60 2023-10-10T21:17:22.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.344+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c14152aa0 con 0x7f4c14159c60 2023-10-10T21:17:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.345+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1404c3c0 con 0x7f4c14159c60 2023-10-10T21:17:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.346+0000 7f4c09ffb700 1 -- 172.21.15.154:0/4244891388 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c04023070 con 0x7f4c14159c60 2023-10-10T21:17:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.347+0000 7f4c09ffb700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4bf8066f30 0x7f4bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.347+0000 7f4c09ffb700 1 -- 172.21.15.154:0/4244891388 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4c04085af0 con 0x7f4c14159c60 2023-10-10T21:17:22.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.347+0000 7f4c19f9b700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4bf8066f30 0x7f4bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.348+0000 7f4c19f9b700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4bf8066f30 0x7f4bf80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c100058d0 tx=0x7f4c10009040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.351+0000 7f4c09ffb700 1 -- 172.21.15.154:0/4244891388 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c04052bd0 con 0x7f4c14159c60 2023-10-10T21:17:22.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.545+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c140d1270 con 0x7f4c14159c60 2023-10-10T21:17:22.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.546+0000 7f4c09ffb700 1 -- 172.21.15.154:0/4244891388 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16006 (secure 0 0 0) 0x7f4c0402a090 con 0x7f4c14159c60 2023-10-10T21:17:22.547 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:22.547 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":80,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:21.570770+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:17:19.775384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-10T21:17:20.550408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:22.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4bf8066f30 msgr2=0x7f4bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4bf8066f30 0x7f4bf80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c100058d0 tx=0x7f4c10009040 comp rx=0 tx=0).stop 2023-10-10T21:17:22.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c14159c60 msgr2=0x7f4c140cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c14159c60 0x7f4c140cdd60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4c14070e20 tx=0x7f4c04017000 comp rx=0 tx=0).stop 2023-10-10T21:17:22.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 shutdown_connections 2023-10-10T21:17:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1415db10 0x7f4c140ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4bf8066f30 0x7f4bf80693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c14159890 0x7f4c14152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 --2- 172.21.15.154:0/4244891388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c14159c60 0x7f4c140cdd60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.548+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 >> 172.21.15.154:0/4244891388 conn(0x7f4c14068e20 msgr2=0x7f4c14153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:22.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.549+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 shutdown_connections 2023-10-10T21:17:22.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.549+0000 7f4c1c1ff700 1 -- 172.21.15.154:0/4244891388 wait complete. 2023-10-10T21:17:22.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:22.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.750+0000 7f5dfa1ff700 1 Processor -- start 2023-10-10T21:17:22.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.750+0000 7f5dfa1ff700 1 -- start start 2023-10-10T21:17:22.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.751+0000 7f5dfa1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 0x7f5df40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.751+0000 7f5dfa1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df40cc300 con 0x7f5df40cbf30 2023-10-10T21:17:22.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.751+0000 7f5dfa1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df40ad370 con 0x7f5df40b1420 2023-10-10T21:17:22.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.751+0000 7f5dfa1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4156bf0 con 0x7f5df40ccf90 2023-10-10T21:17:22.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df37fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5df40cbf30 0x7f5df40b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56746/0 (socket says 172.21.15.154:56746) 2023-10-10T21:17:22.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df37fe700 1 -- 172.21.15.154:0/2427717502 learned_addr learned my addr 172.21.15.154:0/2427717502 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:22.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df3fff700 1 --2- 172.21.15.154:0/2427717502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 0x7f5df40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df27fc700 1 -- 172.21.15.154:0/2427717502 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455696596 0 0) 0x7f5df40cc300 con 0x7f5df40cbf30 2023-10-10T21:17:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df27fc700 1 -- 172.21.15.154:0/2427717502 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ddc003570 con 0x7f5df40cbf30 2023-10-10T21:17:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df27fc700 1 -- 172.21.15.154:0/2427717502 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637908092 0 0) 0x7f5df40ad370 con 0x7f5df40b1420 2023-10-10T21:17:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df27fc700 1 -- 172.21.15.154:0/2427717502 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df40cc300 con 0x7f5df40b1420 2023-10-10T21:17:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df3fff700 1 -- 172.21.15.154:0/2427717502 >> v1:172.21.15.179:6789/0 conn(0x7f5df40b1420 legacy=0x7f5df40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df3fff700 1 -- 172.21.15.154:0/2427717502 >> v1:172.21.15.154:6789/0 conn(0x7f5df40cbf30 legacy=0x7f5df40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.752+0000 7f5df3fff700 1 -- 172.21.15.154:0/2427717502 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df40ad650 con 0x7f5df40ccf90 2023-10-10T21:17:22.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5df3fff700 1 --2- 172.21.15.154:0/2427717502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 0x7f5df40ae410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009e90 tx=0x7f5dec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6f3c774218acc62 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:22.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5df27fc700 1 -- 172.21.15.154:0/2427717502 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00e070 con 0x7f5df40ccf90 2023-10-10T21:17:22.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5df27fc700 1 -- 172.21.15.154:0/2427717502 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00bb80 con 0x7f5df40ccf90 2023-10-10T21:17:22.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5df27fc700 1 -- 172.21.15.154:0/2427717502 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec012430 con 0x7f5df40ccf90 2023-10-10T21:17:22.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/2427717502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 msgr2=0x7f5df40ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5dfa1ff700 1 --2- 172.21.15.154:0/2427717502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 0x7f5df40ae410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009e90 tx=0x7f5dec009780 comp rx=0 tx=0).stop 2023-10-10T21:17:22.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/2427717502 shutdown_connections 2023-10-10T21:17:22.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5dfa1ff700 1 --2- 172.21.15.154:0/2427717502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 0x7f5df40ae410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/2427717502 >> 172.21.15.154:0/2427717502 conn(0x7f5df406a320 msgr2=0x7f5df40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.753+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/2427717502 shutdown_connections 2023-10-10T21:17:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.754+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/2427717502 wait complete. 2023-10-10T21:17:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.755+0000 7f5dfa1ff700 1 Processor -- start 2023-10-10T21:17:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.755+0000 7f5dfa1ff700 1 -- start start 2023-10-10T21:17:22.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5dfa1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df40b1420 0x7f5df4156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5dfa1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df40cbf30 0x7f5df40c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5dfa1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 0x7f5df40c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5dfa1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4156680 con 0x7f5df40cbf30 2023-10-10T21:17:22.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5dfa1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4169cf0 con 0x7f5df40b1420 2023-10-10T21:17:22.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5dfa1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df41595a0 con 0x7f5df40ccf90 2023-10-10T21:17:22.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5df2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df40cbf30 0x7f5df40c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5df2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df40cbf30 0x7f5df40c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38156/0 (socket says 172.21.15.154:38156) 2023-10-10T21:17:22.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5df2ffd700 1 -- 172.21.15.154:0/1543518301 learned_addr learned my addr 172.21.15.154:0/1543518301 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:22.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5df37fe700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df40b1420 0x7f5df4156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.756+0000 7f5df3fff700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 0x7f5df40c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5df2ffd700 1 -- 172.21.15.154:0/1543518301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 msgr2=0x7f5df40c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5df2ffd700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 0x7f5df40c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5df2ffd700 1 -- 172.21.15.154:0/1543518301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df40b1420 msgr2=0x7f5df4156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5df2ffd700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df40b1420 0x7f5df4156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5df2ffd700 1 -- 172.21.15.154:0/1543518301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec009a20 con 0x7f5df40cbf30 2023-10-10T21:17:22.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5df2ffd700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df40cbf30 0x7f5df40c7830 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5de800c590 tx=0x7f5de8007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:22.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5ddb7fe700 1 -- 172.21.15.154:0/1543518301 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8010510 con 0x7f5df40cbf30 2023-10-10T21:17:22.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5ddb7fe700 1 -- 172.21.15.154:0/1543518301 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8010690 con 0x7f5df40cbf30 2023-10-10T21:17:22.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df4159880 con 0x7f5df40cbf30 2023-10-10T21:17:22.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5ddb7fe700 1 -- 172.21.15.154:0/1543518301 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8010a50 con 0x7f5df40cbf30 2023-10-10T21:17:22.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.757+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df4159e40 con 0x7f5df40cbf30 2023-10-10T21:17:22.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.758+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df4169f40 con 0x7f5df40cbf30 2023-10-10T21:17:22.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.759+0000 7f5ddb7fe700 1 -- 172.21.15.154:0/1543518301 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5de801b400 con 0x7f5df40cbf30 2023-10-10T21:17:22.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.760+0000 7f5ddb7fe700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5de0066f30 0x7f5de00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:22.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.761+0000 7f5ddb7fe700 1 -- 172.21.15.154:0/1543518301 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5de80841d0 con 0x7f5df40cbf30 2023-10-10T21:17:22.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.761+0000 7f5df37fe700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5de0066f30 0x7f5de00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:22.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.761+0000 7f5df37fe700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5de0066f30 0x7f5de00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5de4007fd0 tx=0x7f5de4009040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:22.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.765+0000 7f5ddb7fe700 1 -- 172.21.15.154:0/1543518301 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5df4169f40 con 0x7f5df40cbf30 2023-10-10T21:17:22.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.960+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5df4169f40 con 0x7f5df40cbf30 2023-10-10T21:17:22.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.961+0000 7f5ddb7fe700 1 -- 172.21.15.154:0/1543518301 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16006 (secure 0 0 0) 0x7f5df4169f40 con 0x7f5df40cbf30 2023-10-10T21:17:22.963 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:22.964 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":80,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:21.570770+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:17:19.775384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-10T21:17:20.550408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5de0066f30 msgr2=0x7f5de00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5de0066f30 0x7f5de00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5de4007fd0 tx=0x7f5de4009040 comp rx=0 tx=0).stop 2023-10-10T21:17:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df40cbf30 msgr2=0x7f5df40c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:22.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df40cbf30 0x7f5df40c7830 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5de800c590 tx=0x7f5de8007db0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 shutdown_connections 2023-10-10T21:17:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5df40ccf90 0x7f5df40c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5de0066f30 0x7f5de00693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5df40b1420 0x7f5df4156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 --2- 172.21.15.154:0/1543518301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df40cbf30 0x7f5df40c7830 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 >> 172.21.15.154:0/1543518301 conn(0x7f5df406a320 msgr2=0x7f5df415a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 shutdown_connections 2023-10-10T21:17:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:22.963+0000 7f5dfa1ff700 1 -- 172.21.15.154:0/1543518301 wait complete. 2023-10-10T21:17:22.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T21:17:23.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.169+0000 7f2a17fff700 1 Processor -- start 2023-10-10T21:17:23.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.169+0000 7f2a17fff700 1 -- start start 2023-10-10T21:17:23.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.170+0000 7f2a17fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a10069e80 0x7f2a100c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.171+0000 7f2a17fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a100af2f0 con 0x7f2a1015ac80 2023-10-10T21:17:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.171+0000 7f2a17fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a100af5d0 con 0x7f2a100b0a70 2023-10-10T21:17:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.171+0000 7f2a17fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a100c8660 con 0x7f2a10069e80 2023-10-10T21:17:23.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.171+0000 7f2a15d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2a1015ac80 0x7f2a10069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56760/0 (socket says 172.21.15.154:56760) 2023-10-10T21:17:23.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.171+0000 7f2a15d9b700 1 -- 172.21.15.154:0/1491899184 learned_addr learned my addr 172.21.15.154:0/1491899184 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:23.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.171+0000 7f2a1559a700 1 --2- 172.21.15.154:0/1491899184 >> v2:172.21.15.154:3300/0 conn(0x7f2a10069e80 0x7f2a100c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:23.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.171+0000 7f2a1559a700 1 -- 172.21.15.154:0/1491899184 >> v1:172.21.15.179:6789/0 conn(0x7f2a100b0a70 legacy=0x7f2a100c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:23.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.171+0000 7f2a1559a700 1 -- 172.21.15.154:0/1491899184 >> v1:172.21.15.154:6789/0 conn(0x7f2a1015ac80 legacy=0x7f2a10069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:23.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.171+0000 7f2a1559a700 1 -- 172.21.15.154:0/1491899184 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100c8940 con 0x7f2a10069e80 2023-10-10T21:17:23.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.172+0000 7f2a1559a700 1 --2- 172.21.15.154:0/1491899184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 0x7f2a100c6b70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2a000098e0 tx=0x7f2a000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878b55457aeb8d2b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:23.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.172+0000 7f2a14d99700 1 -- 172.21.15.154:0/1491899184 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00009e80 con 0x7f2a10069e80 2023-10-10T21:17:23.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.172+0000 7f2a14d99700 1 -- 172.21.15.154:0/1491899184 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0000b860 con 0x7f2a10069e80 2023-10-10T21:17:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.172+0000 7f2a14d99700 1 -- 172.21.15.154:0/1491899184 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000bbe0 con 0x7f2a10069e80 2023-10-10T21:17:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.172+0000 7f2a17fff700 1 -- 172.21.15.154:0/1491899184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 msgr2=0x7f2a100c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.172+0000 7f2a17fff700 1 --2- 172.21.15.154:0/1491899184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 0x7f2a100c6b70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2a000098e0 tx=0x7f2a000091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.172+0000 7f2a17fff700 1 -- 172.21.15.154:0/1491899184 shutdown_connections 2023-10-10T21:17:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.172+0000 7f2a17fff700 1 --2- 172.21.15.154:0/1491899184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 0x7f2a100c6b70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:23.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.172+0000 7f2a17fff700 1 -- 172.21.15.154:0/1491899184 >> 172.21.15.154:0/1491899184 conn(0x7f2a10068e10 msgr2=0x7f2a100cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:23.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.173+0000 7f2a17fff700 1 -- 172.21.15.154:0/1491899184 shutdown_connections 2023-10-10T21:17:23.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.173+0000 7f2a17fff700 1 -- 172.21.15.154:0/1491899184 wait complete. 2023-10-10T21:17:23.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.174+0000 7f2a17fff700 1 Processor -- start 2023-10-10T21:17:23.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.174+0000 7f2a17fff700 1 -- start start 2023-10-10T21:17:23.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a17fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 0x7f2a101534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:23.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a17fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a100b0a70 0x7f2a101697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a17fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a1015ac80 0x7f2a1015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a17fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10153a30 con 0x7f2a10069e80 2023-10-10T21:17:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a17fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10169ce0 con 0x7f2a100b0a70 2023-10-10T21:17:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a17fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1016a790 con 0x7f2a1015ac80 2023-10-10T21:17:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a15d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 0x7f2a101534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:23.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a15d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 0x7f2a101534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38170/0 (socket says 172.21.15.154:38170) 2023-10-10T21:17:23.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a15d9b700 1 -- 172.21.15.154:0/2212665477 learned_addr learned my addr 172.21.15.154:0/2212665477 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:23.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a1559a700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a100b0a70 0x7f2a101697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:23.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.175+0000 7f2a1659c700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a1015ac80 0x7f2a1015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:23.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a15d9b700 1 -- 172.21.15.154:0/2212665477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a1015ac80 msgr2=0x7f2a1015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:23.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a15d9b700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a1015ac80 0x7f2a1015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:23.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a15d9b700 1 -- 172.21.15.154:0/2212665477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a100b0a70 msgr2=0x7f2a101697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:23.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a15d9b700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a100b0a70 0x7f2a101697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:23.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a15d9b700 1 -- 172.21.15.154:0/2212665477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a00009420 con 0x7f2a10069e80 2023-10-10T21:17:23.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a15d9b700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 0x7f2a101534f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00c590 tx=0x7f2a0c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:23.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a05ffb700 1 -- 172.21.15.154:0/2212665477 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c005b30 con 0x7f2a10069e80 2023-10-10T21:17:23.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a05ffb700 1 -- 172.21.15.154:0/2212665477 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c005cb0 con 0x7f2a10069e80 2023-10-10T21:17:23.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a10156b70 con 0x7f2a10069e80 2023-10-10T21:17:23.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.176+0000 7f2a05ffb700 1 -- 172.21.15.154:0/2212665477 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c007320 con 0x7f2a10069e80 2023-10-10T21:17:23.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.177+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a10169ef0 con 0x7f2a10069e80 2023-10-10T21:17:23.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.177+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1016d0c0 con 0x7f2a10069e80 2023-10-10T21:17:23.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.178+0000 7f2a05ffb700 1 -- 172.21.15.154:0/2212665477 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a0c01b3b0 con 0x7f2a10069e80 2023-10-10T21:17:23.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.179+0000 7f2a05ffb700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f29f4066f30 0x7f29f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:23.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.179+0000 7f2a05ffb700 1 -- 172.21.15.154:0/2212665477 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f2a0c083ad0 con 0x7f2a10069e80 2023-10-10T21:17:23.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.179+0000 7f2a1559a700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f29f4066f30 0x7f29f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:23.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.180+0000 7f2a1559a700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f29f4066f30 0x7f29f40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a000098e0 tx=0x7f2a00017000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:23.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.183+0000 7f2a05ffb700 1 -- 172.21.15.154:0/2212665477 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a0c050b10 con 0x7f2a10069e80 2023-10-10T21:17:23.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:23.417+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2a1004c3c0 con 0x7f2a10069e80 2023-10-10T21:17:24.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.131+0000 7f2a05ffb700 1 -- 172.21.15.154:0/2212665477 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2a0c0170b0 con 0x7f2a10069e80 2023-10-10T21:17:24.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f29f4066f30 msgr2=0x7f29f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:24.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f29f4066f30 0x7f29f40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a000098e0 tx=0x7f2a00017000 comp rx=0 tx=0).stop 2023-10-10T21:17:24.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 msgr2=0x7f2a101534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:24.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 0x7f2a101534f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00c590 tx=0x7f2a0c001020 comp rx=0 tx=0).stop 2023-10-10T21:17:24.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 shutdown_connections 2023-10-10T21:17:24.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a1015ac80 0x7f2a1015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:24.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a10069e80 0x7f2a101534f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f29f4066f30 0x7f29f40693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 --2- 172.21.15.154:0/2212665477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a100b0a70 0x7f2a101697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 >> 172.21.15.154:0/2212665477 conn(0x7f2a10068e10 msgr2=0x7f2a10154220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 shutdown_connections 2023-10-10T21:17:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.134+0000 7f2a17fff700 1 -- 172.21.15.154:0/2212665477 wait complete. 2023-10-10T21:17:24.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T21:17:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.338+0000 7f87b21ff700 1 Processor -- start 2023-10-10T21:17:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.338+0000 7f87b21ff700 1 -- start start 2023-10-10T21:17:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.340+0000 7f87b21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159890 0x7f87ac15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.340+0000 7f87b21ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87ac159c60 0x7f87ac15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.340+0000 7f87b21ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac15a160 con 0x7f87ac15db10 2023-10-10T21:17:24.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.340+0000 7f87b21ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0d13a0 con 0x7f87ac159c60 2023-10-10T21:17:24.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.340+0000 7f87b21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac15e140 con 0x7f87ac159890 2023-10-10T21:17:24.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.340+0000 7f87aaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87ac159c60 0x7f87ac15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:24.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.340+0000 7f87aaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87ac159c60 0x7f87ac15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:38544/0 (socket says 172.21.15.154:38544) 2023-10-10T21:17:24.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.340+0000 7f87aaffd700 1 -- 172.21.15.154:0/1452591060 learned_addr learned my addr 172.21.15.154:0/1452591060 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:24.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.340+0000 7f87ab7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159890 0x7f87ac15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.341+0000 7f87aaffd700 1 -- 172.21.15.154:0/1452591060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159890 msgr2=0x7f87ac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.341+0000 7f87aaffd700 1 --2- 172.21.15.154:0/1452591060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159890 0x7f87ac15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.341+0000 7f87aaffd700 1 -- 172.21.15.154:0/1452591060 >> v1:172.21.15.179:6789/0 conn(0x7f87ac15db10 legacy=0x7f87ac069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.341+0000 7f87aaffd700 1 -- 172.21.15.154:0/1452591060 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac15a3d0 con 0x7f87ac159c60 2023-10-10T21:17:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.341+0000 7f87aaffd700 1 --2- 172.21.15.154:0/1452591060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac159c60 0x7f87ac15d5d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f87a00099b0 tx=0x7f87a0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d190d2afafc97fe server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.341+0000 7f87aa7fc700 1 -- 172.21.15.154:0/1452591060 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0009ea0 con 0x7f87ac159c60 2023-10-10T21:17:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.341+0000 7f87aa7fc700 1 -- 172.21.15.154:0/1452591060 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a000b860 con 0x7f87ac159c60 2023-10-10T21:17:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.341+0000 7f87aa7fc700 1 -- 172.21.15.154:0/1452591060 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a000bc00 con 0x7f87ac159c60 2023-10-10T21:17:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.342+0000 7f87b21ff700 1 -- 172.21.15.154:0/1452591060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac159c60 msgr2=0x7f87ac15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.342+0000 7f87b21ff700 1 --2- 172.21.15.154:0/1452591060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac159c60 0x7f87ac15d5d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f87a00099b0 tx=0x7f87a0009250 comp rx=0 tx=0).stop 2023-10-10T21:17:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.342+0000 7f87b21ff700 1 -- 172.21.15.154:0/1452591060 shutdown_connections 2023-10-10T21:17:24.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.342+0000 7f87b21ff700 1 --2- 172.21.15.154:0/1452591060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159890 0x7f87ac15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:24.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.342+0000 7f87b21ff700 1 --2- 172.21.15.154:0/1452591060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac159c60 0x7f87ac15d5d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:24.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.342+0000 7f87b21ff700 1 -- 172.21.15.154:0/1452591060 >> 172.21.15.154:0/1452591060 conn(0x7f87ac068e20 msgr2=0x7f87ac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:24.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.342+0000 7f87b21ff700 1 -- 172.21.15.154:0/1452591060 shutdown_connections 2023-10-10T21:17:24.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.342+0000 7f87b21ff700 1 -- 172.21.15.154:0/1452591060 wait complete. 2023-10-10T21:17:24.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.343+0000 7f87b21ff700 1 Processor -- start 2023-10-10T21:17:24.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.344+0000 7f87b21ff700 1 -- start start 2023-10-10T21:17:24.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.344+0000 7f87b21ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ac159890 0x7f87ac148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:24.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.344+0000 7f87b21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159c60 0x7f87ac0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:24.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.344+0000 7f87b21ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15db10 0x7f87ac0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:24.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87b21ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac153770 con 0x7f87ac159890 2023-10-10T21:17:24.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87b21ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac16a310 con 0x7f87ac15db10 2023-10-10T21:17:24.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87b21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0b62d0 con 0x7f87ac159c60 2023-10-10T21:17:24.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87ab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ac159890 0x7f87ac148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:24.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87ab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ac159890 0x7f87ac148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38180/0 (socket says 172.21.15.154:38180) 2023-10-10T21:17:24.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87ab7fe700 1 -- 172.21.15.154:0/3526401972 learned_addr learned my addr 172.21.15.154:0/3526401972 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:24.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87aaffd700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159c60 0x7f87ac0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:24.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87abfff700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15db10 0x7f87ac0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:24.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87ab7fe700 1 -- 172.21.15.154:0/3526401972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159c60 msgr2=0x7f87ac0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:24.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87ab7fe700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159c60 0x7f87ac0b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:24.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87ab7fe700 1 -- 172.21.15.154:0/3526401972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15db10 msgr2=0x7f87ac0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:24.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87ab7fe700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15db10 0x7f87ac0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:24.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87ab7fe700 1 -- 172.21.15.154:0/3526401972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a00094f0 con 0x7f87ac159890 2023-10-10T21:17:24.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87abfff700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15db10 0x7f87ac0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:24.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.345+0000 7f87ab7fe700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ac159890 0x7f87ac148160 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f879c00ec80 tx=0x7f879c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:24.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.346+0000 7f87937fe700 1 -- 172.21.15.154:0/3526401972 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00c9d0 con 0x7f87ac159890 2023-10-10T21:17:24.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.346+0000 7f87937fe700 1 -- 172.21.15.154:0/3526401972 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c00cb30 con 0x7f87ac159890 2023-10-10T21:17:24.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.346+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac169cc0 con 0x7f87ac159890 2023-10-10T21:17:24.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.346+0000 7f87937fe700 1 -- 172.21.15.154:0/3526401972 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c013470 con 0x7f87ac159890 2023-10-10T21:17:24.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.346+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac1699b0 con 0x7f87ac159890 2023-10-10T21:17:24.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.347+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac04c3c0 con 0x7f87ac159890 2023-10-10T21:17:24.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.348+0000 7f87937fe700 1 -- 172.21.15.154:0/3526401972 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f879c013820 con 0x7f87ac159890 2023-10-10T21:17:24.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.349+0000 7f87937fe700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8798066f30 0x7f87980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:24.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.349+0000 7f87937fe700 1 -- 172.21.15.154:0/3526401972 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f879c084a50 con 0x7f87ac159890 2023-10-10T21:17:24.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.349+0000 7f87aaffd700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8798066f30 0x7f87980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:24.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.350+0000 7f87aaffd700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8798066f30 0x7f87980693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87a00099b0 tx=0x7f87a0017000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:24.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.353+0000 7f87937fe700 1 -- 172.21.15.154:0/3526401972 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f879c051b30 con 0x7f87ac159890 2023-10-10T21:17:24.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:24.587+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f87ac06a5b0 con 0x7f87ac159890 2023-10-10T21:17:25.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.132+0000 7f87937fe700 1 -- 172.21.15.154:0/3526401972 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f879c055150 con 0x7f87ac159890 2023-10-10T21:17:25.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8798066f30 msgr2=0x7f87980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8798066f30 0x7f87980693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87a00099b0 tx=0x7f87a0017000 comp rx=0 tx=0).stop 2023-10-10T21:17:25.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ac159890 msgr2=0x7f87ac148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ac159890 0x7f87ac148160 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f879c00ec80 tx=0x7f879c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 shutdown_connections 2023-10-10T21:17:25.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8798066f30 0x7f87980693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ac15db10 0x7f87ac0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ac159890 0x7f87ac148160 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 --2- 172.21.15.154:0/3526401972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ac159c60 0x7f87ac0b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.135+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 >> 172.21.15.154:0/3526401972 conn(0x7f87ac068e20 msgr2=0x7f87ac154310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:25.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.136+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 shutdown_connections 2023-10-10T21:17:25.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.136+0000 7f87b21ff700 1 -- 172.21.15.154:0/3526401972 wait complete. 2023-10-10T21:17:25.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:25.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.337+0000 7f487b59d700 1 Processor -- start 2023-10-10T21:17:25.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.337+0000 7f487b59d700 1 -- start start 2023-10-10T21:17:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.338+0000 7f487b59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48741595a0 0x7f48740b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.338+0000 7f487b59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48740c8830 0x7f4874159970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.338+0000 7f487b59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48740b1410 con 0x7f48740c6c60 2023-10-10T21:17:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.338+0000 7f487b59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48740b2b90 con 0x7f48741595a0 2023-10-10T21:17:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.338+0000 7f487b59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4874063230 con 0x7f48740c8830 2023-10-10T21:17:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.338+0000 7f487a59b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48741595a0 0x7f48740b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.338+0000 7f487a59b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48741595a0 0x7f48740b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38194/0 (socket says 172.21.15.154:38194) 2023-10-10T21:17:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.338+0000 7f487a59b700 1 -- 172.21.15.154:0/1460288916 learned_addr learned my addr 172.21.15.154:0/1460288916 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.339+0000 7f487a59b700 1 -- 172.21.15.154:0/1460288916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48740c8830 msgr2=0x7f4874159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.339+0000 7f487a59b700 1 --2- 172.21.15.154:0/1460288916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48740c8830 0x7f4874159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.339+0000 7f487a59b700 1 -- 172.21.15.154:0/1460288916 >> v1:172.21.15.179:6789/0 conn(0x7f48740c6c60 legacy=0x7f48740c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.339+0000 7f487a59b700 1 -- 172.21.15.154:0/1460288916 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48740634f0 con 0x7f48741595a0 2023-10-10T21:17:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.339+0000 7f487a59b700 1 --2- 172.21.15.154:0/1460288916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48741595a0 0x7f48740b18a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4870009f20 tx=0x7f4870009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5281ebbed5323d71 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.339+0000 7f4879599700 1 -- 172.21.15.154:0/1460288916 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487000e070 con 0x7f48741595a0 2023-10-10T21:17:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.339+0000 7f4879599700 1 -- 172.21.15.154:0/1460288916 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487000ba40 con 0x7f48741595a0 2023-10-10T21:17:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.339+0000 7f4879599700 1 -- 172.21.15.154:0/1460288916 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700092e0 con 0x7f48741595a0 2023-10-10T21:17:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.340+0000 7f487b59d700 1 -- 172.21.15.154:0/1460288916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48741595a0 msgr2=0x7f48740b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.340+0000 7f487b59d700 1 --2- 172.21.15.154:0/1460288916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48741595a0 0x7f48740b18a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4870009f20 tx=0x7f4870009840 comp rx=0 tx=0).stop 2023-10-10T21:17:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.340+0000 7f487b59d700 1 -- 172.21.15.154:0/1460288916 shutdown_connections 2023-10-10T21:17:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.340+0000 7f487b59d700 1 --2- 172.21.15.154:0/1460288916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48740c8830 0x7f4874159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.340+0000 7f487b59d700 1 --2- 172.21.15.154:0/1460288916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48741595a0 0x7f48740b18a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.340+0000 7f487b59d700 1 -- 172.21.15.154:0/1460288916 >> 172.21.15.154:0/1460288916 conn(0x7f487406ddb0 msgr2=0x7f487406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.340+0000 7f487b59d700 1 -- 172.21.15.154:0/1460288916 shutdown_connections 2023-10-10T21:17:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.340+0000 7f487b59d700 1 -- 172.21.15.154:0/1460288916 wait complete. 2023-10-10T21:17:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.341+0000 7f487b59d700 1 Processor -- start 2023-10-10T21:17:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.341+0000 7f487b59d700 1 -- start start 2023-10-10T21:17:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.342+0000 7f487b59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48740c6c60 0x7f4874146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.342+0000 7f487b59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48740c8830 0x7f4874155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.342+0000 7f487b59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48741595a0 0x7f4874156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.342+0000 7f487b59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487416b2c0 con 0x7f48740c6c60 2023-10-10T21:17:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.342+0000 7f487b59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48740a6a70 con 0x7f48741595a0 2023-10-10T21:17:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.342+0000 7f487b59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4874146ac0 con 0x7f48740c8830 2023-10-10T21:17:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487a59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48740c6c60 0x7f4874146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487a59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48740c6c60 0x7f4874146580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38196/0 (socket says 172.21.15.154:38196) 2023-10-10T21:17:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487a59b700 1 -- 172.21.15.154:0/3398991075 learned_addr learned my addr 172.21.15.154:0/3398991075 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f4879d9a700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48740c8830 0x7f4874155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487ad9c700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48741595a0 0x7f4874156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487a59b700 1 -- 172.21.15.154:0/3398991075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48740c8830 msgr2=0x7f4874155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487a59b700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48740c8830 0x7f4874155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487a59b700 1 -- 172.21.15.154:0/3398991075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48741595a0 msgr2=0x7f4874156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487a59b700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48741595a0 0x7f4874156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487a59b700 1 -- 172.21.15.154:0/3398991075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4870009ae0 con 0x7f48740c6c60 2023-10-10T21:17:25.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.343+0000 7f487a59b700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48740c6c60 0x7f4874146580 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4874064340 tx=0x7f4870017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:25.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.344+0000 7f486a7fc700 1 -- 172.21.15.154:0/3398991075 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700129d0 con 0x7f48740c6c60 2023-10-10T21:17:25.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.344+0000 7f486a7fc700 1 -- 172.21.15.154:0/3398991075 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4870012b50 con 0x7f48740c6c60 2023-10-10T21:17:25.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.344+0000 7f486a7fc700 1 -- 172.21.15.154:0/3398991075 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487001e430 con 0x7f48740c6c60 2023-10-10T21:17:25.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.344+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48740a64b0 con 0x7f48740c6c60 2023-10-10T21:17:25.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.344+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48740c4b70 con 0x7f48740c6c60 2023-10-10T21:17:25.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.345+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4874157150 con 0x7f48740c6c60 2023-10-10T21:17:25.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.346+0000 7f486a7fc700 1 -- 172.21.15.154:0/3398991075 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f487001e860 con 0x7f48740c6c60 2023-10-10T21:17:25.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.347+0000 7f486a7fc700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4858066f60 0x7f4858069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.347+0000 7f486a7fc700 1 -- 172.21.15.154:0/3398991075 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4870086020 con 0x7f48740c6c60 2023-10-10T21:17:25.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.347+0000 7f4879d9a700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4858066f60 0x7f4858069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.347+0000 7f4879d9a700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4858066f60 0x7f4858069410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4864006fd0 tx=0x7f4864008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:25.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.351+0000 7f486a7fc700 1 -- 172.21.15.154:0/3398991075 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4870053100 con 0x7f48740c6c60 2023-10-10T21:17:25.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.585+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f487404c3c0 con 0x7f48740c6c60 2023-10-10T21:17:25.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.586+0000 7f486a7fc700 1 -- 172.21.15.154:0/3398991075 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f4870009940 con 0x7f48740c6c60 2023-10-10T21:17:25.587 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:25.587 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/209340130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":209340130},{"type":"v1","addr":"172.21.15.179:6834","nonce":209340130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3372685755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3372685755},{"type":"v1","addr":"172.21.15.154:6835","nonce":3372685755}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1909692066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1909692066},{"type":"v1","addr":"172.21.15.154:6837","nonce":1909692066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:17:21.571274+0000","modified":"2023-10-10T21:17:25.130727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6019":{"gid":6019,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2833897496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2833897496},{"type":"v1","addr":"172.21.15.179:6835","nonce":2833897496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-10T21:17:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.588+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4858066f60 msgr2=0x7f4858069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.588+0000 7f487b59d700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4858066f60 0x7f4858069410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4864006fd0 tx=0x7f4864008040 comp rx=0 tx=0).stop 2023-10-10T21:17:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.588+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48740c6c60 msgr2=0x7f4874146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.588+0000 7f487b59d700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48740c6c60 0x7f4874146580 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4874064340 tx=0x7f4870017000 comp rx=0 tx=0).stop 2023-10-10T21:17:25.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.589+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 shutdown_connections 2023-10-10T21:17:25.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.589+0000 7f487b59d700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4858066f60 0x7f4858069410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.589+0000 7f487b59d700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48741595a0 0x7f4874156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.589+0000 7f487b59d700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48740c6c60 0x7f4874146580 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.589+0000 7f487b59d700 1 --2- 172.21.15.154:0/3398991075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48740c8830 0x7f4874155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.589+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 >> 172.21.15.154:0/3398991075 conn(0x7f487406ddb0 msgr2=0x7f4874157390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:25.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.589+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 shutdown_connections 2023-10-10T21:17:25.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.589+0000 7f487b59d700 1 -- 172.21.15.154:0/3398991075 wait complete. 2023-10-10T21:17:25.592 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 30 2023-10-10T21:17:25.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:25.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.791+0000 7f4157fff700 1 Processor -- start 2023-10-10T21:17:25.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.791+0000 7f4157fff700 1 -- start start 2023-10-10T21:17:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.792+0000 7f4157fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f415806c0f0 0x7f41581642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.792+0000 7f4157fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41580b40f0 con 0x7f41580ad870 2023-10-10T21:17:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.792+0000 7f4157fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4158069640 con 0x7f4158142ea0 2023-10-10T21:17:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.792+0000 7f4157fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4158069920 con 0x7f415806c0f0 2023-10-10T21:17:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.792+0000 7f41567fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f41580ad870 0x7f415806b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56766/0 (socket says 172.21.15.154:56766) 2023-10-10T21:17:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.792+0000 7f41567fc700 1 -- 172.21.15.154:0/728608515 learned_addr learned my addr 172.21.15.154:0/728608515 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.793+0000 7f41577fe700 1 --2- 172.21.15.154:0/728608515 >> v2:172.21.15.179:3300/0 conn(0x7f415806c0f0 0x7f41581642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.793+0000 7f4155ffb700 1 -- 172.21.15.154:0/728608515 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333939610 0 0) 0x7f41580b40f0 con 0x7f41580ad870 2023-10-10T21:17:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.793+0000 7f4155ffb700 1 -- 172.21.15.154:0/728608515 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4140003570 con 0x7f41580ad870 2023-10-10T21:17:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.793+0000 7f4155ffb700 1 -- 172.21.15.154:0/728608515 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794034644 0 0) 0x7f4158069640 con 0x7f4158142ea0 2023-10-10T21:17:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.793+0000 7f4155ffb700 1 -- 172.21.15.154:0/728608515 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41580b40f0 con 0x7f4158142ea0 2023-10-10T21:17:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.793+0000 7f4155ffb700 1 -- 172.21.15.154:0/728608515 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 72828369 0 0) 0x7f4140003570 con 0x7f41580ad870 2023-10-10T21:17:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.793+0000 7f41577fe700 1 -- 172.21.15.154:0/728608515 >> v1:172.21.15.179:6789/0 conn(0x7f4158142ea0 legacy=0x7f41580b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.793+0000 7f41577fe700 1 -- 172.21.15.154:0/728608515 >> v1:172.21.15.154:6789/0 conn(0x7f41580ad870 legacy=0x7f415806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.793+0000 7f41577fe700 1 -- 172.21.15.154:0/728608515 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4158069c00 con 0x7f415806c0f0 2023-10-10T21:17:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.794+0000 7f41577fe700 1 --2- 172.21.15.154:0/728608515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f415806c0f0 0x7f41581642e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4150009e60 tx=0x7f4150009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca1fd92ab958e59a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.794+0000 7f4155ffb700 1 -- 172.21.15.154:0/728608515 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000e070 con 0x7f415806c0f0 2023-10-10T21:17:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.794+0000 7f4155ffb700 1 -- 172.21.15.154:0/728608515 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000b7a0 con 0x7f415806c0f0 2023-10-10T21:17:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.794+0000 7f4155ffb700 1 -- 172.21.15.154:0/728608515 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c001470 con 0x7f415806c0f0 2023-10-10T21:17:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.794+0000 7f4157fff700 1 -- 172.21.15.154:0/728608515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f415806c0f0 msgr2=0x7f41581642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.794+0000 7f4157fff700 1 --2- 172.21.15.154:0/728608515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f415806c0f0 0x7f41581642e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4150009e60 tx=0x7f4150009780 comp rx=0 tx=0).stop 2023-10-10T21:17:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.794+0000 7f4157fff700 1 -- 172.21.15.154:0/728608515 shutdown_connections 2023-10-10T21:17:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.794+0000 7f4157fff700 1 --2- 172.21.15.154:0/728608515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f415806c0f0 0x7f41581642e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.794+0000 7f4157fff700 1 -- 172.21.15.154:0/728608515 >> 172.21.15.154:0/728608515 conn(0x7f41580ce430 msgr2=0x7f41580ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.795+0000 7f4157fff700 1 -- 172.21.15.154:0/728608515 shutdown_connections 2023-10-10T21:17:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.795+0000 7f4157fff700 1 -- 172.21.15.154:0/728608515 wait complete. 2023-10-10T21:17:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.796+0000 7f4157fff700 1 Processor -- start 2023-10-10T21:17:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.796+0000 7f4157fff700 1 -- start start 2023-10-10T21:17:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f4157fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f415806c0f0 0x7f415815c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f4157fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4158142ea0 0x7f4158158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f4157fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41580c86a0 0x7f41580c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f4157fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580c9820 con 0x7f41580c86a0 2023-10-10T21:17:25.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f4157fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580c8c10 con 0x7f4158142ea0 2023-10-10T21:17:25.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f4157fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41580c8ef0 con 0x7f415806c0f0 2023-10-10T21:17:25.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f41577fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41580c86a0 0x7f41580c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f41577fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41580c86a0 0x7f41580c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38198/0 (socket says 172.21.15.154:38198) 2023-10-10T21:17:25.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f41577fe700 1 -- 172.21.15.154:0/374878659 learned_addr learned my addr 172.21.15.154:0/374878659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:25.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f41567fc700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4158142ea0 0x7f4158158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.797+0000 7f4156ffd700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f415806c0f0 0x7f415815c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f41577fe700 1 -- 172.21.15.154:0/374878659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f415806c0f0 msgr2=0x7f415815c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f41577fe700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f415806c0f0 0x7f415815c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f41577fe700 1 -- 172.21.15.154:0/374878659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4158142ea0 msgr2=0x7f4158158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:25.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f41577fe700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4158142ea0 0x7f4158158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:25.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f41577fe700 1 -- 172.21.15.154:0/374878659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4150009a20 con 0x7f41580c86a0 2023-10-10T21:17:25.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f41577fe700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41580c86a0 0x7f41580c9cb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4150003000 tx=0x7f4150017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:25.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f413effd700 1 -- 172.21.15.154:0/374878659 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150012c40 con 0x7f41580c86a0 2023-10-10T21:17:25.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f413effd700 1 -- 172.21.15.154:0/374878659 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4150012da0 con 0x7f41580c86a0 2023-10-10T21:17:25.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f413effd700 1 -- 172.21.15.154:0/374878659 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415001e680 con 0x7f41580c86a0 2023-10-10T21:17:25.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41580c91d0 con 0x7f41580c86a0 2023-10-10T21:17:25.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.798+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4158159ed0 con 0x7f41580c86a0 2023-10-10T21:17:25.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.799+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41580c9990 con 0x7f41580c86a0 2023-10-10T21:17:25.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.800+0000 7f413effd700 1 -- 172.21.15.154:0/374878659 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f415001e9f0 con 0x7f41580c86a0 2023-10-10T21:17:25.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.801+0000 7f413effd700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4144066f30 0x7f41440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:25.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.802+0000 7f413effd700 1 -- 172.21.15.154:0/374878659 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4150086830 con 0x7f41580c86a0 2023-10-10T21:17:25.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.802+0000 7f4156ffd700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4144066f30 0x7f41440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:25.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.802+0000 7f4156ffd700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4144066f30 0x7f41440693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41580cdf30 tx=0x7f4148007d50 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:25.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.805+0000 7f413effd700 1 -- 172.21.15.154:0/374878659 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4150053910 con 0x7f41580c86a0 2023-10-10T21:17:26.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:25.999+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f415804c3c0 con 0x7f41580c86a0 2023-10-10T21:17:26.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.000+0000 7f413effd700 1 -- 172.21.15.154:0/374878659 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f4150056f30 con 0x7f41580c86a0 2023-10-10T21:17:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:26.002 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":81,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:23.111109+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:17:19.775384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-10T21:17:20.550408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:26.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4144066f30 msgr2=0x7f41440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4144066f30 0x7f41440693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41580cdf30 tx=0x7f4148007d50 comp rx=0 tx=0).stop 2023-10-10T21:17:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41580c86a0 msgr2=0x7f41580c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41580c86a0 0x7f41580c9cb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4150003000 tx=0x7f4150017000 comp rx=0 tx=0).stop 2023-10-10T21:17:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 shutdown_connections 2023-10-10T21:17:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41580c86a0 0x7f41580c9cb0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f415806c0f0 0x7f415815c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4144066f30 0x7f41440693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 --2- 172.21.15.154:0/374878659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4158142ea0 0x7f4158158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 >> 172.21.15.154:0/374878659 conn(0x7f41580ce430 msgr2=0x7f4158141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 shutdown_connections 2023-10-10T21:17:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.003+0000 7f4157fff700 1 -- 172.21.15.154:0/374878659 wait complete. 2023-10-10T21:17:26.022 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T21:17:26.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:17:26.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.208+0000 7f8b675ff700 1 Processor -- start 2023-10-10T21:17:26.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.208+0000 7f8b675ff700 1 -- start start 2023-10-10T21:17:26.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.209+0000 7f8b675ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b60155c10 0x7f8b60155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b675ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac6d0 0x7f8b600b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b675ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b600acac0 con 0x7f8b600ac230 2023-10-10T21:17:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b675ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b600ad930 con 0x7f8b60155c10 2023-10-10T21:17:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b675ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600acd20 con 0x7f8b600ac6d0 2023-10-10T21:17:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b6539b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b60155c10 0x7f8b60155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b6539b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b60155c10 0x7f8b60155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58008/0 (socket says 172.21.15.154:58008) 2023-10-10T21:17:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b6539b700 1 -- 172.21.15.154:0/3073759152 learned_addr learned my addr 172.21.15.154:0/3073759152 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b65b9c700 1 --2- 172.21.15.154:0/3073759152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac6d0 0x7f8b600b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b6539b700 1 -- 172.21.15.154:0/3073759152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac6d0 msgr2=0x7f8b600b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b6539b700 1 --2- 172.21.15.154:0/3073759152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac6d0 0x7f8b600b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b6539b700 1 -- 172.21.15.154:0/3073759152 >> v1:172.21.15.179:6789/0 conn(0x7f8b600ac230 legacy=0x7f8b601568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b6539b700 1 -- 172.21.15.154:0/3073759152 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600ad000 con 0x7f8b60155c10 2023-10-10T21:17:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.210+0000 7f8b65b9c700 1 --2- 172.21.15.154:0/3073759152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac6d0 0x7f8b600b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b6539b700 1 --2- 172.21.15.154:0/3073759152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b60155c10 0x7f8b60155fe0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8b600acc50 tx=0x7f8b5c00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7554129c6fd53755 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b57fff700 1 -- 172.21.15.154:0/3073759152 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c00ca40 con 0x7f8b60155c10 2023-10-10T21:17:26.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b57fff700 1 -- 172.21.15.154:0/3073759152 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c00cba0 con 0x7f8b60155c10 2023-10-10T21:17:26.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b57fff700 1 -- 172.21.15.154:0/3073759152 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c0183f0 con 0x7f8b60155c10 2023-10-10T21:17:26.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b675ff700 1 -- 172.21.15.154:0/3073759152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b60155c10 msgr2=0x7f8b60155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b675ff700 1 --2- 172.21.15.154:0/3073759152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b60155c10 0x7f8b60155fe0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8b600acc50 tx=0x7f8b5c00a3f0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b675ff700 1 -- 172.21.15.154:0/3073759152 shutdown_connections 2023-10-10T21:17:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b675ff700 1 --2- 172.21.15.154:0/3073759152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac6d0 0x7f8b600b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b675ff700 1 --2- 172.21.15.154:0/3073759152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b60155c10 0x7f8b60155fe0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.211+0000 7f8b675ff700 1 -- 172.21.15.154:0/3073759152 >> 172.21.15.154:0/3073759152 conn(0x7f8b6006a320 msgr2=0x7f8b600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:26.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.212+0000 7f8b675ff700 1 -- 172.21.15.154:0/3073759152 shutdown_connections 2023-10-10T21:17:26.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.212+0000 7f8b675ff700 1 -- 172.21.15.154:0/3073759152 wait complete. 2023-10-10T21:17:26.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.213+0000 7f8b675ff700 1 Processor -- start 2023-10-10T21:17:26.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.213+0000 7f8b675ff700 1 -- start start 2023-10-10T21:17:26.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.214+0000 7f8b675ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac230 0x7f8b600aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.214+0000 7f8b675ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b600ac6d0 0x7f8b601571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.214+0000 7f8b675ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b60155c10 0x7f8b6016d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.214+0000 7f8b675ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6016ae90 con 0x7f8b600ac6d0 2023-10-10T21:17:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.214+0000 7f8b675ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60158450 con 0x7f8b60155c10 2023-10-10T21:17:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.214+0000 7f8b675ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60157bb0 con 0x7f8b600ac230 2023-10-10T21:17:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.214+0000 7f8b64b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b600ac6d0 0x7f8b601571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.214+0000 7f8b64b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b600ac6d0 0x7f8b601571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58018/0 (socket says 172.21.15.154:58018) 2023-10-10T21:17:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.214+0000 7f8b64b9a700 1 -- 172.21.15.154:0/756020627 learned_addr learned my addr 172.21.15.154:0/756020627 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b6539b700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac230 0x7f8b600aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b65b9c700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b60155c10 0x7f8b6016d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b64b9a700 1 -- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac230 msgr2=0x7f8b600aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b64b9a700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac230 0x7f8b600aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b64b9a700 1 -- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b60155c10 msgr2=0x7f8b6016d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b64b9a700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b60155c10 0x7f8b6016d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b64b9a700 1 -- 172.21.15.154:0/756020627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c00a690 con 0x7f8b600ac6d0 2023-10-10T21:17:26.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b65b9c700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b60155c10 0x7f8b6016d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:17:26.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b6539b700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac230 0x7f8b600aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:17:26.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b64b9a700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b600ac6d0 0x7f8b601571b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c590 tx=0x7f8b5000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:26.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b557fa700 1 -- 172.21.15.154:0/756020627 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50011590 con 0x7f8b600ac6d0 2023-10-10T21:17:26.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b557fa700 1 -- 172.21.15.154:0/756020627 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b500116f0 con 0x7f8b600ac6d0 2023-10-10T21:17:26.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b557fa700 1 -- 172.21.15.154:0/756020627 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50011ab0 con 0x7f8b600ac6d0 2023-10-10T21:17:26.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b60157e90 con 0x7f8b600ac6d0 2023-10-10T21:17:26.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.215+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b601576f0 con 0x7f8b600ac6d0 2023-10-10T21:17:26.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.216+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60157960 con 0x7f8b600ac6d0 2023-10-10T21:17:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.217+0000 7f8b557fa700 1 -- 172.21.15.154:0/756020627 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b5001b3b0 con 0x7f8b600ac6d0 2023-10-10T21:17:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.218+0000 7f8b557fa700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8b44066f30 0x7f8b440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.218+0000 7f8b557fa700 1 -- 172.21.15.154:0/756020627 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8b50083c70 con 0x7f8b600ac6d0 2023-10-10T21:17:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.218+0000 7f8b6539b700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8b44066f30 0x7f8b440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.219+0000 7f8b6539b700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8b44066f30 0x7f8b440693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b600acc50 tx=0x7f8b5c017000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.222+0000 7f8b557fa700 1 -- 172.21.15.154:0/756020627 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b50050d50 con 0x7f8b600ac6d0 2023-10-10T21:17:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.411+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b6004c3c0 con 0x7f8b44066f30 2023-10-10T21:17:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.421+0000 7f8b557fa700 1 -- 172.21.15.154:0/756020627 <== mgr.6063 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284040 (secure 0 0 0) 0x7f8b6004c3c0 con 0x7f8b44066f30 2023-10-10T21:17:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8b44066f30 msgr2=0x7f8b440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8b44066f30 0x7f8b440693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b600acc50 tx=0x7f8b5c017000 comp rx=0 tx=0).stop 2023-10-10T21:17:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b600ac6d0 msgr2=0x7f8b601571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b600ac6d0 0x7f8b601571b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c590 tx=0x7f8b5000c950 comp rx=0 tx=0).stop 2023-10-10T21:17:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 shutdown_connections 2023-10-10T21:17:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8b44066f30 0x7f8b440693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b60155c10 0x7f8b6016d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600ac230 0x7f8b600aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 --2- 172.21.15.154:0/756020627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b600ac6d0 0x7f8b601571b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 >> 172.21.15.154:0/756020627 conn(0x7f8b6006a320 msgr2=0x7f8b600af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 shutdown_connections 2023-10-10T21:17:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.425+0000 7f8b675ff700 1 -- 172.21.15.154:0/756020627 wait complete. 2023-10-10T21:17:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:17:26.444 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:17:25.904145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590978,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":257,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427932,"kb_used_data":8668,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752546788,"statfs":{"total":773094113280,"available":770607910912,"internally_reserved":0,"allocated":8876032,"data_stored":4825628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.815659"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120312+0000","last_change":"2023-10-10T21:17:22.115843+0000","last_active":"2023-10-10T21:17:22.120312+0000","last_peered":"2023-10-10T21:17:22.120312+0000","last_clean":"2023-10-10T21:17:22.120312+0000","last_became_active":"2023-10-10T21:17:22.115575+0000","last_became_peered":"2023-10-10T21:17:22.115575+0000","last_unstale":"2023-10-10T21:17:22.120312+0000","last_undegraded":"2023-10-10T21:17:22.120312+0000","last_fullsized":"2023-10-10T21:17:22.120312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:44.446813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130785+0000","last_change":"2023-10-10T21:17:22.128294+0000","last_active":"2023-10-10T21:17:22.130785+0000","last_peered":"2023-10-10T21:17:22.130785+0000","last_clean":"2023-10-10T21:17:22.130785+0000","last_became_active":"2023-10-10T21:17:22.128005+0000","last_became_peered":"2023-10-10T21:17:22.128005+0000","last_unstale":"2023-10-10T21:17:22.130785+0000","last_undegraded":"2023-10-10T21:17:22.130785+0000","last_fullsized":"2023-10-10T21:17:22.130785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:40:31.293324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133303+0000","last_change":"2023-10-10T21:17:22.130045+0000","last_active":"2023-10-10T21:17:22.133303+0000","last_peered":"2023-10-10T21:17:22.133303+0000","last_clean":"2023-10-10T21:17:22.133303+0000","last_became_active":"2023-10-10T21:17:22.129693+0000","last_became_peered":"2023-10-10T21:17:22.129693+0000","last_unstale":"2023-10-10T21:17:22.133303+0000","last_undegraded":"2023-10-10T21:17:22.133303+0000","last_fullsized":"2023-10-10T21:17:22.133303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:46:57.495512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.131879+0000","last_change":"2023-10-10T21:17:22.130808+0000","last_active":"2023-10-10T21:17:22.131879+0000","last_peered":"2023-10-10T21:17:22.131879+0000","last_clean":"2023-10-10T21:17:22.131879+0000","last_became_active":"2023-10-10T21:17:22.130493+0000","last_became_peered":"2023-10-10T21:17:22.130493+0000","last_unstale":"2023-10-10T21:17:22.131879+0000","last_undegraded":"2023-10-10T21:17:22.131879+0000","last_fullsized":"2023-10-10T21:17:22.131879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:45:03.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126358+0000","last_change":"2023-10-10T21:17:22.123593+0000","last_active":"2023-10-10T21:17:22.126358+0000","last_peered":"2023-10-10T21:17:22.126358+0000","last_clean":"2023-10-10T21:17:22.126358+0000","last_became_active":"2023-10-10T21:17:22.123331+0000","last_became_peered":"2023-10-10T21:17:22.123331+0000","last_unstale":"2023-10-10T21:17:22.126358+0000","last_undegraded":"2023-10-10T21:17:22.126358+0000","last_fullsized":"2023-10-10T21:17:22.126358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:32:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124611+0000","last_change":"2023-10-10T21:17:22.117278+0000","last_active":"2023-10-10T21:17:22.124611+0000","last_peered":"2023-10-10T21:17:22.124611+0000","last_clean":"2023-10-10T21:17:22.124611+0000","last_became_active":"2023-10-10T21:17:22.117007+0000","last_became_peered":"2023-10-10T21:17:22.117007+0000","last_unstale":"2023-10-10T21:17:22.124611+0000","last_undegraded":"2023-10-10T21:17:22.124611+0000","last_fullsized":"2023-10-10T21:17:22.124611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:45:07.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124875+0000","last_change":"2023-10-10T21:17:22.120210+0000","last_active":"2023-10-10T21:17:22.124875+0000","last_peered":"2023-10-10T21:17:22.124875+0000","last_clean":"2023-10-10T21:17:22.124875+0000","last_became_active":"2023-10-10T21:17:22.119950+0000","last_became_peered":"2023-10-10T21:17:22.119950+0000","last_unstale":"2023-10-10T21:17:22.124875+0000","last_undegraded":"2023-10-10T21:17:22.124875+0000","last_fullsized":"2023-10-10T21:17:22.124875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:18.967395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130380+0000","last_change":"2023-10-10T21:17:22.129225+0000","last_active":"2023-10-10T21:17:22.130380+0000","last_peered":"2023-10-10T21:17:22.130380+0000","last_clean":"2023-10-10T21:17:22.130380+0000","last_became_active":"2023-10-10T21:17:22.128916+0000","last_became_peered":"2023-10-10T21:17:22.128916+0000","last_unstale":"2023-10-10T21:17:22.130380+0000","last_undegraded":"2023-10-10T21:17:22.130380+0000","last_fullsized":"2023-10-10T21:17:22.130380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:52.331235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125675+0000","last_change":"2023-10-10T21:17:22.122283+0000","last_active":"2023-10-10T21:17:22.125675+0000","last_peered":"2023-10-10T21:17:22.125675+0000","last_clean":"2023-10-10T21:17:22.125675+0000","last_became_active":"2023-10-10T21:17:22.122017+0000","last_became_peered":"2023-10-10T21:17:22.122017+0000","last_unstale":"2023-10-10T21:17:22.125675+0000","last_undegraded":"2023-10-10T21:17:22.125675+0000","last_fullsized":"2023-10-10T21:17:22.125675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:20.043886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.119814+0000","last_change":"2023-10-10T21:17:22.115157+0000","last_active":"2023-10-10T21:17:22.119814+0000","last_peered":"2023-10-10T21:17:22.119814+0000","last_clean":"2023-10-10T21:17:22.119814+0000","last_became_active":"2023-10-10T21:17:22.114892+0000","last_became_peered":"2023-10-10T21:17:22.114892+0000","last_unstale":"2023-10-10T21:17:22.119814+0000","last_undegraded":"2023-10-10T21:17:22.119814+0000","last_fullsized":"2023-10-10T21:17:22.119814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:27.875920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130792+0000","last_change":"2023-10-10T21:17:22.129274+0000","last_active":"2023-10-10T21:17:22.130792+0000","last_peered":"2023-10-10T21:17:22.130792+0000","last_clean":"2023-10-10T21:17:22.130792+0000","last_became_active":"2023-10-10T21:17:22.128901+0000","last_became_peered":"2023-10-10T21:17:22.128901+0000","last_unstale":"2023-10-10T21:17:22.130792+0000","last_undegraded":"2023-10-10T21:17:22.130792+0000","last_fullsized":"2023-10-10T21:17:22.130792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:44.298941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125704+0000","last_change":"2023-10-10T21:17:22.122632+0000","last_active":"2023-10-10T21:17:22.125704+0000","last_peered":"2023-10-10T21:17:22.125704+0000","last_clean":"2023-10-10T21:17:22.125704+0000","last_became_active":"2023-10-10T21:17:22.122206+0000","last_became_peered":"2023-10-10T21:17:22.122206+0000","last_unstale":"2023-10-10T21:17:22.125704+0000","last_undegraded":"2023-10-10T21:17:22.125704+0000","last_fullsized":"2023-10-10T21:17:22.125704+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:49:14.111746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.128015+0000","last_change":"2023-10-10T21:17:22.125884+0000","last_active":"2023-10-10T21:17:22.128015+0000","last_peered":"2023-10-10T21:17:22.128015+0000","last_clean":"2023-10-10T21:17:22.128015+0000","last_became_active":"2023-10-10T21:17:22.125606+0000","last_became_peered":"2023-10-10T21:17:22.125606+0000","last_unstale":"2023-10-10T21:17:22.128015+0000","last_undegraded":"2023-10-10T21:17:22.128015+0000","last_fullsized":"2023-10-10T21:17:22.128015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:49.550718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130740+0000","last_change":"2023-10-10T21:17:22.129337+0000","last_active":"2023-10-10T21:17:22.130740+0000","last_peered":"2023-10-10T21:17:22.130740+0000","last_clean":"2023-10-10T21:17:22.130740+0000","last_became_active":"2023-10-10T21:17:22.129079+0000","last_became_peered":"2023-10-10T21:17:22.129079+0000","last_unstale":"2023-10-10T21:17:22.130740+0000","last_undegraded":"2023-10-10T21:17:22.130740+0000","last_fullsized":"2023-10-10T21:17:22.130740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:28.435380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133331+0000","last_change":"2023-10-10T21:17:22.130216+0000","last_active":"2023-10-10T21:17:22.133331+0000","last_peered":"2023-10-10T21:17:22.133331+0000","last_clean":"2023-10-10T21:17:22.133331+0000","last_became_active":"2023-10-10T21:17:22.129734+0000","last_became_peered":"2023-10-10T21:17:22.129734+0000","last_unstale":"2023-10-10T21:17:22.133331+0000","last_undegraded":"2023-10-10T21:17:22.133331+0000","last_fullsized":"2023-10-10T21:17:22.133331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:10.135356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139036+0000","last_change":"2023-10-10T21:17:22.135399+0000","last_active":"2023-10-10T21:17:22.139036+0000","last_peered":"2023-10-10T21:17:22.139036+0000","last_clean":"2023-10-10T21:17:22.139036+0000","last_became_active":"2023-10-10T21:17:22.135102+0000","last_became_peered":"2023-10-10T21:17:22.135102+0000","last_unstale":"2023-10-10T21:17:22.139036+0000","last_undegraded":"2023-10-10T21:17:22.139036+0000","last_fullsized":"2023-10-10T21:17:22.139036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:41.564999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120420+0000","last_change":"2023-10-10T21:17:22.117520+0000","last_active":"2023-10-10T21:17:22.120420+0000","last_peered":"2023-10-10T21:17:22.120420+0000","last_clean":"2023-10-10T21:17:22.120420+0000","last_became_active":"2023-10-10T21:17:22.117259+0000","last_became_peered":"2023-10-10T21:17:22.117259+0000","last_unstale":"2023-10-10T21:17:22.120420+0000","last_undegraded":"2023-10-10T21:17:22.120420+0000","last_fullsized":"2023-10-10T21:17:22.120420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:43.565186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127830+0000","last_change":"2023-10-10T21:17:22.125575+0000","last_active":"2023-10-10T21:17:22.127830+0000","last_peered":"2023-10-10T21:17:22.127830+0000","last_clean":"2023-10-10T21:17:22.127830+0000","last_became_active":"2023-10-10T21:17:22.125234+0000","last_became_peered":"2023-10-10T21:17:22.125234+0000","last_unstale":"2023-10-10T21:17:22.127830+0000","last_undegraded":"2023-10-10T21:17:22.127830+0000","last_fullsized":"2023-10-10T21:17:22.127830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:34:00.644220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123193+0000","last_change":"2023-10-10T21:17:22.120461+0000","last_active":"2023-10-10T21:17:22.123193+0000","last_peered":"2023-10-10T21:17:22.123193+0000","last_clean":"2023-10-10T21:17:22.123193+0000","last_became_active":"2023-10-10T21:17:22.120180+0000","last_became_peered":"2023-10-10T21:17:22.120180+0000","last_unstale":"2023-10-10T21:17:22.123193+0000","last_undegraded":"2023-10-10T21:17:22.123193+0000","last_fullsized":"2023-10-10T21:17:22.123193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:13.790306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.142034+0000","last_change":"2023-10-10T21:17:21.110380+0000","last_active":"2023-10-10T21:17:22.142034+0000","last_peered":"2023-10-10T21:17:22.142034+0000","last_clean":"2023-10-10T21:17:22.142034+0000","last_became_active":"2023-10-10T21:17:21.110146+0000","last_became_peered":"2023-10-10T21:17:21.110146+0000","last_unstale":"2023-10-10T21:17:22.142034+0000","last_undegraded":"2023-10-10T21:17:22.142034+0000","last_fullsized":"2023-10-10T21:17:22.142034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125033+0000","last_change":"2023-10-10T21:17:22.119505+0000","last_active":"2023-10-10T21:17:22.125033+0000","last_peered":"2023-10-10T21:17:22.125033+0000","last_clean":"2023-10-10T21:17:22.125033+0000","last_became_active":"2023-10-10T21:17:22.119224+0000","last_became_peered":"2023-10-10T21:17:22.119224+0000","last_unstale":"2023-10-10T21:17:22.125033+0000","last_undegraded":"2023-10-10T21:17:22.125033+0000","last_fullsized":"2023-10-10T21:17:22.125033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:00:07.895891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139718+0000","last_change":"2023-10-10T21:17:21.111302+0000","last_active":"2023-10-10T21:17:22.139718+0000","last_peered":"2023-10-10T21:17:22.139718+0000","last_clean":"2023-10-10T21:17:22.139718+0000","last_became_active":"2023-10-10T21:17:21.109679+0000","last_became_peered":"2023-10-10T21:17:21.109679+0000","last_unstale":"2023-10-10T21:17:22.139718+0000","last_undegraded":"2023-10-10T21:17:22.139718+0000","last_fullsized":"2023-10-10T21:17:22.139718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:29.027774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134656+0000","last_change":"2023-10-10T21:17:22.131469+0000","last_active":"2023-10-10T21:17:22.134656+0000","last_peered":"2023-10-10T21:17:22.134656+0000","last_clean":"2023-10-10T21:17:22.134656+0000","last_became_active":"2023-10-10T21:17:22.130839+0000","last_became_peered":"2023-10-10T21:17:22.130839+0000","last_unstale":"2023-10-10T21:17:22.134656+0000","last_undegraded":"2023-10-10T21:17:22.134656+0000","last_fullsized":"2023-10-10T21:17:22.134656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:02.566076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139455+0000","last_change":"2023-10-10T21:17:21.105421+0000","last_active":"2023-10-10T21:17:22.139455+0000","last_peered":"2023-10-10T21:17:22.139455+0000","last_clean":"2023-10-10T21:17:22.139455+0000","last_became_active":"2023-10-10T21:17:21.104957+0000","last_became_peered":"2023-10-10T21:17:21.104957+0000","last_unstale":"2023-10-10T21:17:22.139455+0000","last_undegraded":"2023-10-10T21:17:22.139455+0000","last_fullsized":"2023-10-10T21:17:22.139455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140395+0000","last_change":"2023-10-10T21:17:22.138180+0000","last_active":"2023-10-10T21:17:22.140395+0000","last_peered":"2023-10-10T21:17:22.140395+0000","last_clean":"2023-10-10T21:17:22.140395+0000","last_became_active":"2023-10-10T21:17:22.137905+0000","last_became_peered":"2023-10-10T21:17:22.137905+0000","last_unstale":"2023-10-10T21:17:22.140395+0000","last_undegraded":"2023-10-10T21:17:22.140395+0000","last_fullsized":"2023-10-10T21:17:22.140395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:53.511832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092346+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:30.424526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.122719+0000","last_change":"2023-10-10T21:17:22.120590+0000","last_active":"2023-10-10T21:17:22.122719+0000","last_peered":"2023-10-10T21:17:22.122719+0000","last_clean":"2023-10-10T21:17:22.122719+0000","last_became_active":"2023-10-10T21:17:22.120332+0000","last_became_peered":"2023-10-10T21:17:22.120332+0000","last_unstale":"2023-10-10T21:17:22.122719+0000","last_undegraded":"2023-10-10T21:17:22.122719+0000","last_fullsized":"2023-10-10T21:17:22.122719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:29.688214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.097427+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:30.424526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.132205+0000","last_change":"2023-10-10T21:17:22.129664+0000","last_active":"2023-10-10T21:17:22.132205+0000","last_peered":"2023-10-10T21:17:22.132205+0000","last_clean":"2023-10-10T21:17:22.132205+0000","last_became_active":"2023-10-10T21:17:22.129392+0000","last_became_peered":"2023-10-10T21:17:22.129392+0000","last_unstale":"2023-10-10T21:17:22.132205+0000","last_undegraded":"2023-10-10T21:17:22.132205+0000","last_fullsized":"2023-10-10T21:17:22.132205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:37:26.419533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139710+0000","last_change":"2023-10-10T21:17:21.104091+0000","last_active":"2023-10-10T21:17:22.139710+0000","last_peered":"2023-10-10T21:17:22.139710+0000","last_clean":"2023-10-10T21:17:22.139710+0000","last_became_active":"2023-10-10T21:17:21.103772+0000","last_became_peered":"2023-10-10T21:17:21.103772+0000","last_unstale":"2023-10-10T21:17:22.139710+0000","last_undegraded":"2023-10-10T21:17:22.139710+0000","last_fullsized":"2023-10-10T21:17:22.139710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:17:09.167468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092308+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:41.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120843+0000","last_change":"2023-10-10T21:17:22.118158+0000","last_active":"2023-10-10T21:17:22.120843+0000","last_peered":"2023-10-10T21:17:22.120843+0000","last_clean":"2023-10-10T21:17:22.120843+0000","last_became_active":"2023-10-10T21:17:22.117833+0000","last_became_peered":"2023-10-10T21:17:22.117833+0000","last_unstale":"2023-10-10T21:17:22.120843+0000","last_undegraded":"2023-10-10T21:17:22.120843+0000","last_fullsized":"2023-10-10T21:17:22.120843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:02:00.520880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.095806+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:52:34.309774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.095640+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118476+0000","last_change":"2023-10-10T21:17:21.111763+0000","last_active":"2023-10-10T21:17:22.118476+0000","last_peered":"2023-10-10T21:17:22.118476+0000","last_clean":"2023-10-10T21:17:22.118476+0000","last_became_active":"2023-10-10T21:17:21.111518+0000","last_became_peered":"2023-10-10T21:17:21.111518+0000","last_unstale":"2023-10-10T21:17:22.118476+0000","last_undegraded":"2023-10-10T21:17:22.118476+0000","last_fullsized":"2023-10-10T21:17:22.118476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:01:00.565221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126465+0000","last_change":"2023-10-10T21:17:22.121020+0000","last_active":"2023-10-10T21:17:22.126465+0000","last_peered":"2023-10-10T21:17:22.126465+0000","last_clean":"2023-10-10T21:17:22.126465+0000","last_became_active":"2023-10-10T21:17:22.120556+0000","last_became_peered":"2023-10-10T21:17:22.120556+0000","last_unstale":"2023-10-10T21:17:22.126465+0000","last_undegraded":"2023-10-10T21:17:22.126465+0000","last_fullsized":"2023-10-10T21:17:22.126465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:18.893169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.095730+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.096848+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:41.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139085+0000","last_change":"2023-10-10T21:17:21.112845+0000","last_active":"2023-10-10T21:17:22.139085+0000","last_peered":"2023-10-10T21:17:22.139085+0000","last_clean":"2023-10-10T21:17:22.139085+0000","last_became_active":"2023-10-10T21:17:21.112572+0000","last_became_peered":"2023-10-10T21:17:21.112572+0000","last_unstale":"2023-10-10T21:17:22.139085+0000","last_undegraded":"2023-10-10T21:17:22.139085+0000","last_fullsized":"2023-10-10T21:17:22.139085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:25:28.217784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092119+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:45:05.277480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091663+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:29:17.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.097529+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:11:09.152293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139072+0000","last_change":"2023-10-10T21:17:21.109113+0000","last_active":"2023-10-10T21:17:22.139072+0000","last_peered":"2023-10-10T21:17:22.139072+0000","last_clean":"2023-10-10T21:17:22.139072+0000","last_became_active":"2023-10-10T21:17:21.106685+0000","last_became_peered":"2023-10-10T21:17:21.106685+0000","last_unstale":"2023-10-10T21:17:22.139072+0000","last_undegraded":"2023-10-10T21:17:22.139072+0000","last_fullsized":"2023-10-10T21:17:22.139072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:51:52.120571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139601+0000","last_change":"2023-10-10T21:17:21.112175+0000","last_active":"2023-10-10T21:17:22.139601+0000","last_peered":"2023-10-10T21:17:22.139601+0000","last_clean":"2023-10-10T21:17:22.139601+0000","last_became_active":"2023-10-10T21:17:21.111931+0000","last_became_peered":"2023-10-10T21:17:21.111931+0000","last_unstale":"2023-10-10T21:17:22.139601+0000","last_undegraded":"2023-10-10T21:17:22.139601+0000","last_fullsized":"2023-10-10T21:17:22.139601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:41.727455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125643+0000","last_change":"2023-10-10T21:17:22.122912+0000","last_active":"2023-10-10T21:17:22.125643+0000","last_peered":"2023-10-10T21:17:22.125643+0000","last_clean":"2023-10-10T21:17:22.125643+0000","last_became_active":"2023-10-10T21:17:22.122663+0000","last_became_peered":"2023-10-10T21:17:22.122663+0000","last_unstale":"2023-10-10T21:17:22.125643+0000","last_undegraded":"2023-10-10T21:17:22.125643+0000","last_fullsized":"2023-10-10T21:17:22.125643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:53:40.085195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091890+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:11:42.908611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.108547+0000","last_change":"2023-10-10T21:17:21.116009+0000","last_active":"2023-10-10T21:17:22.108547+0000","last_peered":"2023-10-10T21:17:22.108547+0000","last_clean":"2023-10-10T21:17:22.108547+0000","last_became_active":"2023-10-10T21:17:21.115764+0000","last_became_peered":"2023-10-10T21:17:21.115764+0000","last_unstale":"2023-10-10T21:17:22.108547+0000","last_undegraded":"2023-10-10T21:17:22.108547+0000","last_fullsized":"2023-10-10T21:17:22.108547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:11:09.152293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.141309+0000","last_change":"2023-10-10T21:17:21.109031+0000","last_active":"2023-10-10T21:17:22.141309+0000","last_peered":"2023-10-10T21:17:22.141309+0000","last_clean":"2023-10-10T21:17:22.141309+0000","last_became_active":"2023-10-10T21:17:21.108292+0000","last_became_peered":"2023-10-10T21:17:21.108292+0000","last_unstale":"2023-10-10T21:17:22.141309+0000","last_undegraded":"2023-10-10T21:17:22.141309+0000","last_fullsized":"2023-10-10T21:17:22.141309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:15:17.264995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129441+0000","last_change":"2023-10-10T21:17:22.126967+0000","last_active":"2023-10-10T21:17:22.129441+0000","last_peered":"2023-10-10T21:17:22.129441+0000","last_clean":"2023-10-10T21:17:22.129441+0000","last_became_active":"2023-10-10T21:17:22.126688+0000","last_became_peered":"2023-10-10T21:17:22.126688+0000","last_unstale":"2023-10-10T21:17:22.129441+0000","last_undegraded":"2023-10-10T21:17:22.129441+0000","last_fullsized":"2023-10-10T21:17:22.129441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:06:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104746+0000","last_change":"2023-10-10T21:17:21.107533+0000","last_active":"2023-10-10T21:17:22.104746+0000","last_peered":"2023-10-10T21:17:22.104746+0000","last_clean":"2023-10-10T21:17:22.104746+0000","last_became_active":"2023-10-10T21:17:21.107293+0000","last_became_peered":"2023-10-10T21:17:21.107293+0000","last_unstale":"2023-10-10T21:17:22.104746+0000","last_undegraded":"2023-10-10T21:17:22.104746+0000","last_fullsized":"2023-10-10T21:17:22.104746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:15.822758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123986+0000","last_change":"2023-10-10T21:17:22.121229+0000","last_active":"2023-10-10T21:17:22.123986+0000","last_peered":"2023-10-10T21:17:22.123986+0000","last_clean":"2023-10-10T21:17:22.123986+0000","last_became_active":"2023-10-10T21:17:22.120968+0000","last_became_peered":"2023-10-10T21:17:22.120968+0000","last_unstale":"2023-10-10T21:17:22.123986+0000","last_undegraded":"2023-10-10T21:17:22.123986+0000","last_fullsized":"2023-10-10T21:17:22.123986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:31:51.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091661+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:45.952790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140519+0000","last_change":"2023-10-10T21:17:21.116165+0000","last_active":"2023-10-10T21:17:22.140519+0000","last_peered":"2023-10-10T21:17:22.140519+0000","last_clean":"2023-10-10T21:17:22.140519+0000","last_became_active":"2023-10-10T21:17:21.115910+0000","last_became_peered":"2023-10-10T21:17:21.115910+0000","last_unstale":"2023-10-10T21:17:22.140519+0000","last_undegraded":"2023-10-10T21:17:22.140519+0000","last_fullsized":"2023-10-10T21:17:22.140519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:35:48.191005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110044+0000","last_change":"2023-10-10T21:17:21.107240+0000","last_active":"2023-10-10T21:17:22.110044+0000","last_peered":"2023-10-10T21:17:22.110044+0000","last_clean":"2023-10-10T21:17:22.110044+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.110044+0000","last_undegraded":"2023-10-10T21:17:22.110044+0000","last_fullsized":"2023-10-10T21:17:22.110044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:41.329697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126446+0000","last_change":"2023-10-10T21:17:22.120807+0000","last_active":"2023-10-10T21:17:22.126446+0000","last_peered":"2023-10-10T21:17:22.126446+0000","last_clean":"2023-10-10T21:17:22.126446+0000","last_became_active":"2023-10-10T21:17:22.120231+0000","last_became_peered":"2023-10-10T21:17:22.120231+0000","last_unstale":"2023-10-10T21:17:22.126446+0000","last_undegraded":"2023-10-10T21:17:22.126446+0000","last_fullsized":"2023-10-10T21:17:22.126446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:39.969510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091653+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:44:18.353609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.138890+0000","last_change":"2023-10-10T21:17:22.135588+0000","last_active":"2023-10-10T21:17:22.138890+0000","last_peered":"2023-10-10T21:17:22.138890+0000","last_clean":"2023-10-10T21:17:22.138890+0000","last_became_active":"2023-10-10T21:17:22.135336+0000","last_became_peered":"2023-10-10T21:17:22.135336+0000","last_unstale":"2023-10-10T21:17:22.138890+0000","last_undegraded":"2023-10-10T21:17:22.138890+0000","last_fullsized":"2023-10-10T21:17:22.138890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:54.513628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091732+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:52:34.309774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127696+0000","last_change":"2023-10-10T21:17:22.126342+0000","last_active":"2023-10-10T21:17:22.127696+0000","last_peered":"2023-10-10T21:17:22.127696+0000","last_clean":"2023-10-10T21:17:22.127696+0000","last_became_active":"2023-10-10T21:17:22.126073+0000","last_became_peered":"2023-10-10T21:17:22.126073+0000","last_unstale":"2023-10-10T21:17:22.127696+0000","last_undegraded":"2023-10-10T21:17:22.127696+0000","last_fullsized":"2023-10-10T21:17:22.127696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:16.335987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104748+0000","last_change":"2023-10-10T21:17:21.114873+0000","last_active":"2023-10-10T21:17:22.104748+0000","last_peered":"2023-10-10T21:17:22.104748+0000","last_clean":"2023-10-10T21:17:22.104748+0000","last_became_active":"2023-10-10T21:17:21.114212+0000","last_became_peered":"2023-10-10T21:17:21.114212+0000","last_unstale":"2023-10-10T21:17:22.104748+0000","last_undegraded":"2023-10-10T21:17:22.104748+0000","last_fullsized":"2023-10-10T21:17:22.104748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:36.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.096282+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:11:42.908611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127572+0000","last_change":"2023-10-10T21:17:22.121370+0000","last_active":"2023-10-10T21:17:22.127572+0000","last_peered":"2023-10-10T21:17:22.127572+0000","last_clean":"2023-10-10T21:17:22.127572+0000","last_became_active":"2023-10-10T21:17:22.117631+0000","last_became_peered":"2023-10-10T21:17:22.117631+0000","last_unstale":"2023-10-10T21:17:22.127572+0000","last_undegraded":"2023-10-10T21:17:22.127572+0000","last_fullsized":"2023-10-10T21:17:22.127572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:09:00.391451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104781+0000","last_change":"2023-10-10T21:17:21.107269+0000","last_active":"2023-10-10T21:17:22.104781+0000","last_peered":"2023-10-10T21:17:22.104781+0000","last_clean":"2023-10-10T21:17:22.104781+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.104781+0000","last_undegraded":"2023-10-10T21:17:22.104781+0000","last_fullsized":"2023-10-10T21:17:22.104781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:23:20.098680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118254+0000","last_change":"2023-10-10T21:17:22.113811+0000","last_active":"2023-10-10T21:17:22.118254+0000","last_peered":"2023-10-10T21:17:22.118254+0000","last_clean":"2023-10-10T21:17:22.118254+0000","last_became_active":"2023-10-10T21:17:22.113536+0000","last_became_peered":"2023-10-10T21:17:22.113536+0000","last_unstale":"2023-10-10T21:17:22.118254+0000","last_undegraded":"2023-10-10T21:17:22.118254+0000","last_fullsized":"2023-10-10T21:17:22.118254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:46.588070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.112091+0000","last_change":"2023-10-10T21:17:21.115869+0000","last_active":"2023-10-10T21:17:22.112091+0000","last_peered":"2023-10-10T21:17:22.112091+0000","last_clean":"2023-10-10T21:17:22.112091+0000","last_became_active":"2023-10-10T21:17:21.115625+0000","last_became_peered":"2023-10-10T21:17:21.115625+0000","last_unstale":"2023-10-10T21:17:22.112091+0000","last_undegraded":"2023-10-10T21:17:22.112091+0000","last_fullsized":"2023-10-10T21:17:22.112091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:14.597592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129353+0000","last_change":"2023-10-10T21:17:22.126892+0000","last_active":"2023-10-10T21:17:22.129353+0000","last_peered":"2023-10-10T21:17:22.129353+0000","last_clean":"2023-10-10T21:17:22.129353+0000","last_became_active":"2023-10-10T21:17:22.126627+0000","last_became_peered":"2023-10-10T21:17:22.126627+0000","last_unstale":"2023-10-10T21:17:22.129353+0000","last_undegraded":"2023-10-10T21:17:22.129353+0000","last_fullsized":"2023-10-10T21:17:22.129353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:39:59.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092505+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:32:47.406455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":368,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-10T21:17:18.530637+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:17:18.530637+0000","last_peered":"2023-10-10T21:17:18.530637+0000","last_clean":"2023-10-10T21:17:18.530637+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:17:18.530637+0000","last_undegraded":"2023-10-10T21:17:18.530637+0000","last_fullsized":"2023-10-10T21:17:18.530637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542327,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302880,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068960,"statfs":{"total":96636764160,"available":96326615040,"internally_reserved":0,"allocated":1531904,"data_stored":1035452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.55800000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.89600000000000002,"5min":1.014,"15min":1.1859999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.47499999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75,"15min":0.73699999999999999},"min":{"1min":0.629,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0069999999999999,"15min":1.123},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.61599999999999999},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.624},"min":{"1min":0.42599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78000000000000003,"5min":0.98299999999999998,"15min":1.022},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.67400000000000004},"min":{"1min":0.499,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":0.82899999999999996,"5min":0.90600000000000003,"15min":0.98899999999999999},"last":0.495}]},{"osd":6,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.52600000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.625,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.135},"last":0.58599999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542326,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":445084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.59199999999999997,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.747,"15min":0.75},"min":{"1min":0.626,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.143},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.65700000000000003,"5min":0.497,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":1.073,"15min":1.073},"last":0.64100000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.98199999999999998,"15min":1.151},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.58999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97799999999999998,"15min":1.01},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.74199999999999999,"15min":0.73199999999999998},"min":{"1min":0.621,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83699999999999997,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.1200000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.62,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72099999999999997,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.34799999999999998},"max":{"1min":0.86499999999999999,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.755}]},{"osd":5,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.87,"5min":1.022,"15min":1.345},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.879,"5min":1.048,"15min":1.238},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":0.86099999999999999,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0289999999999999,"15min":1.202},"last":0.84199999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542327,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302340,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069500,"statfs":{"total":96636764160,"available":96327168000,"internally_reserved":0,"allocated":978944,"data_stored":465656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32600000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66300000000000003,"5min":0.79700000000000004,"15min":1.258},"last":8.0839999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":1.964},"last":13.223000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.89300000000000002,"15min":1.4550000000000001},"last":2.254},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.44,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":2.085},"last":1.9019999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.84399999999999997,"15min":1.8919999999999999},"last":4.0060000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":2.117},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.48099999999999998},"max":{"1min":1.042,"5min":1.0509999999999999,"15min":2.052},"last":4.806},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.66400000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96999999999999997,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":3.9180000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.61499999999999999,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.0409999999999999,"15min":1.181},"last":6.968},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.46400000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":2.012},"last":13.130000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.60999999999999999,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":1.01,"5min":1.1240000000000001,"15min":2.25},"last":3.9569999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.72099999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":2.2999999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78800000000000003,"15min":0.78900000000000003},"min":{"1min":0.69199999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.04,"5min":1.1639999999999999,"15min":2.169},"last":12.026},{"interface":"front","average":{"1min":0.877,"5min":0.81799999999999995,"15min":0.82099999999999995},"min":{"1min":0.70999999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.05,"5min":1.149,"15min":1.1850000000000001},"last":3.7229999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073004,"statfs":{"total":96636764160,"available":96330756096,"internally_reserved":0,"allocated":1585152,"data_stored":1058024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.67200000000000004,"5min":0.74299999999999999,"15min":1.4890000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.879,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.44}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.42499999999999999,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":1.706},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.874,"15min":1.2909999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.101,"15min":1.2270000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95599999999999996,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.008,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":1.0980000000000001,"5min":1.119,"15min":1.3899999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83099999999999996,"15min":0.82799999999999996},"min":{"1min":0.65700000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0640000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.83799999999999997},"min":{"1min":0.66700000000000004,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0109999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.73999999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.1439999999999999,"15min":1.363},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.64400000000000002,"5min":0.58799999999999997,"15min":0.54200000000000004},"max":{"1min":1.024,"5min":1.165,"15min":1.3300000000000001},"last":0.78600000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.35699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.73399999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.495}]},{"osd":1,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91200000000000003,"5min":1.157,"15min":1.3220000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.63200000000000001,"5min":0.53500000000000003,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":1.26,"15min":1.2849999999999999},"last":0.96899999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.65800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98199999999999998,"5min":2.21,"15min":2.21},"last":1.008},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78200000000000003,"15min":0.78300000000000003},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.165,"15min":1.268},"last":0.92600000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.67800000000000005,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":1.018,"5min":1.151,"15min":1.3400000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.65600000000000003,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":1.0349999999999999,"15min":1.3759999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81000000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.0029999999999999,"5min":1.716,"15min":1.716},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.81200000000000006},"min":{"1min":0.71699999999999997,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.97799999999999998,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509624,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.442,"15min":0.45800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.66400000000000003,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.495,"15min":0.499},"min":{"1min":0.42799999999999999,"5min":0.33700000000000002,"15min":0.28799999999999998},"max":{"1min":0.65100000000000002,"5min":0.73399999999999999,"15min":1.544},"last":0.35999999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.40899999999999997,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":1.6759999999999999},"last":0.315},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.45800000000000002,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.432}]},{"osd":2,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.7070000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.38700000000000001},"max":{"1min":0.77700000000000002,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.63100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96499999999999997,"5min":1.054,"15min":1.6359999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76700000000000002,"15min":0.78600000000000003},"min":{"1min":0.61199999999999999,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.016,"5min":1.1859999999999999,"15min":1.246},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.65000000000000002,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":0.996,"5min":1.1240000000000001,"15min":1.262},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76800000000000002,"15min":0.77800000000000002},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":0.97999999999999998,"5min":1.2250000000000001,"15min":1.579},"last":0.64100000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61399999999999999,"5min":0.502,"15min":0.47099999999999997},"max":{"1min":1.05,"5min":1.27,"15min":1.27},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.68400000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.224,"15min":1.224},"last":0.624}]},{"osd":7,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":0.98999999999999999,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.81499999999999995},"min":{"1min":0.66000000000000003,"5min":0.53500000000000003,"15min":0.51300000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.3200000000000001},"last":0.501}]}]},{"osd":4,"up_from":14,"seq":60129542328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306396,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065444,"statfs":{"total":96636764160,"available":96323014656,"internally_reserved":0,"allocated":937984,"data_stored":445084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.92000000000000004,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.95099999999999996,"5min":0.96299999999999997,"15min":1.758},"last":0.502}]},{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.1359999999999999,"15min":1.47},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":0.98299999999999998,"15min":1.929},"last":0.67000000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.6890000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.98399999999999999,"5min":1.3100000000000001,"15min":1.468},"last":0.64500000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.046,"5min":1.0820000000000001,"15min":1.397},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":1.385,"15min":1.385},"last":0.58999999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79700000000000004,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.874,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":1.0609999999999999,"15min":1.464},"last":0.75800000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.83599999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542326,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":445084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.52300000000000002,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.371},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.56000000000000005,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":0.90100000000000002,"5min":0.93300000000000005,"15min":3.895},"last":0.442},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73599999999999999,"15min":0.78000000000000003},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.71599999999999997},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.97499999999999998,"5min":1.01,"15min":1.2889999999999999},"last":0.5},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":1.3540000000000001},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76000000000000001,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.748},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.59099999999999997,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.83499999999999996}]},{"osd":4,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.496,"15min":4.2789999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.80200000000000005},"min":{"1min":0.56699999999999995,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.84699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.51200000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":2.8900000000000001},"last":0.872},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.96099999999999997,"5min":1.077,"15min":3.9420000000000002},"last":0.82199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:17:26.450 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:17:26.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.664+0000 7f972999d700 1 Processor -- start 2023-10-10T21:17:26.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.665+0000 7f972999d700 1 -- start start 2023-10-10T21:17:26.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.666+0000 7f972999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97241566e0 0x7f97240ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.666+0000 7f972999d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97240cb900 0x7f97240ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.666+0000 7f972999d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97240ca860 con 0x7f9724156310 2023-10-10T21:17:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.666+0000 7f972999d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97240cab40 con 0x7f97240cb900 2023-10-10T21:17:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.666+0000 7f972999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97240cae20 con 0x7f97241566e0 2023-10-10T21:17:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.666+0000 7f972919c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97240cb900 0x7f97240ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.666+0000 7f972919c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97240cb900 0x7f97240ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58028/0 (socket says 172.21.15.154:58028) 2023-10-10T21:17:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.666+0000 7f972919c700 1 -- 172.21.15.154:0/1762312281 learned_addr learned my addr 172.21.15.154:0/1762312281 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:26.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.666+0000 7f9723fff700 1 --2- 172.21.15.154:0/1762312281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97241566e0 0x7f97240ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.667+0000 7f972919c700 1 -- 172.21.15.154:0/1762312281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97241566e0 msgr2=0x7f97240ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:26.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.667+0000 7f972919c700 1 --2- 172.21.15.154:0/1762312281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97241566e0 0x7f97240ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.667+0000 7f972919c700 1 -- 172.21.15.154:0/1762312281 >> v1:172.21.15.154:6789/0 conn(0x7f9724156310 legacy=0x7f97240c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.667+0000 7f972919c700 1 -- 172.21.15.154:0/1762312281 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240cb100 con 0x7f97240cb900 2023-10-10T21:17:26.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.667+0000 7f972919c700 1 --2- 172.21.15.154:0/1762312281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97240cb900 0x7f97240ae540 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f971c009f20 tx=0x7f971c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b652c8a71436dc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.667+0000 7f97237fe700 1 -- 172.21.15.154:0/1762312281 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c00e070 con 0x7f97240cb900 2023-10-10T21:17:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.667+0000 7f97237fe700 1 -- 172.21.15.154:0/1762312281 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c00b9d0 con 0x7f97240cb900 2023-10-10T21:17:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.667+0000 7f97237fe700 1 -- 172.21.15.154:0/1762312281 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c0092e0 con 0x7f97240cb900 2023-10-10T21:17:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.668+0000 7f972999d700 1 -- 172.21.15.154:0/1762312281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97240cb900 msgr2=0x7f97240ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.668+0000 7f972999d700 1 --2- 172.21.15.154:0/1762312281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97240cb900 0x7f97240ae540 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f971c009f20 tx=0x7f971c009840 comp rx=0 tx=0).stop 2023-10-10T21:17:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.668+0000 7f972999d700 1 -- 172.21.15.154:0/1762312281 shutdown_connections 2023-10-10T21:17:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.668+0000 7f972999d700 1 --2- 172.21.15.154:0/1762312281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97240cb900 0x7f97240ae540 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.668+0000 7f972999d700 1 --2- 172.21.15.154:0/1762312281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97241566e0 0x7f97240ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.668+0000 7f972999d700 1 -- 172.21.15.154:0/1762312281 >> 172.21.15.154:0/1762312281 conn(0x7f97240cc1f0 msgr2=0x7f97240cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.668+0000 7f972999d700 1 -- 172.21.15.154:0/1762312281 shutdown_connections 2023-10-10T21:17:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.668+0000 7f972999d700 1 -- 172.21.15.154:0/1762312281 wait complete. 2023-10-10T21:17:26.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.669+0000 7f972999d700 1 Processor -- start 2023-10-10T21:17:26.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.669+0000 7f972999d700 1 -- start start 2023-10-10T21:17:26.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.670+0000 7f972999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97240cb900 0x7f9724157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.670+0000 7f972999d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9724156310 0x7f972416a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.670+0000 7f972999d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97241566e0 0x7f97240c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.670+0000 7f972999d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9724157640 con 0x7f9724156310 2023-10-10T21:17:26.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.670+0000 7f972999d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972416ab30 con 0x7f97241566e0 2023-10-10T21:17:26.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.670+0000 7f972999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97240c1160 con 0x7f97240cb900 2023-10-10T21:17:26.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9723fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9724156310 0x7f972416a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9723fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9724156310 0x7f972416a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58044/0 (socket says 172.21.15.154:58044) 2023-10-10T21:17:26.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9723fff700 1 -- 172.21.15.154:0/2298665950 learned_addr learned my addr 172.21.15.154:0/2298665950 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:26.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f972899b700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97240cb900 0x7f9724157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f972919c700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97241566e0 0x7f97240c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9723fff700 1 -- 172.21.15.154:0/2298665950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97240cb900 msgr2=0x7f9724157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9723fff700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97240cb900 0x7f9724157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9723fff700 1 -- 172.21.15.154:0/2298665950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97241566e0 msgr2=0x7f97240c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9723fff700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97241566e0 0x7f97240c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9723fff700 1 -- 172.21.15.154:0/2298665950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c009ae0 con 0x7f9724156310 2023-10-10T21:17:26.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9723fff700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9724156310 0x7f972416a5f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f971000e900 tx=0x7f97100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:26.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.671+0000 7f9720ff9700 1 -- 172.21.15.154:0/2298665950 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971000eea0 con 0x7f9724156310 2023-10-10T21:17:26.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.672+0000 7f9720ff9700 1 -- 172.21.15.154:0/2298665950 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971000c850 con 0x7f9724156310 2023-10-10T21:17:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.672+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97240c1440 con 0x7f9724156310 2023-10-10T21:17:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.672+0000 7f9720ff9700 1 -- 172.21.15.154:0/2298665950 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971000cc10 con 0x7f9724156310 2023-10-10T21:17:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.672+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97240c1a00 con 0x7f9724156310 2023-10-10T21:17:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.673+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972404c3c0 con 0x7f9724156310 2023-10-10T21:17:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.674+0000 7f9720ff9700 1 -- 172.21.15.154:0/2298665950 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9710013470 con 0x7f9724156310 2023-10-10T21:17:26.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.675+0000 7f9720ff9700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9708066f30 0x7f97080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:26.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.675+0000 7f9720ff9700 1 -- 172.21.15.154:0/2298665950 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f9710084640 con 0x7f9724156310 2023-10-10T21:17:26.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.675+0000 7f972899b700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9708066f30 0x7f97080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:26.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.676+0000 7f972899b700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9708066f30 0x7f97080693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97240accf0 tx=0x7f9718009040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:26.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.679+0000 7f9720ff9700 1 -- 172.21.15.154:0/2298665950 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9710051720 con 0x7f9724156310 2023-10-10T21:17:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.868+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97240cd0b0 con 0x7f9708066f30 2023-10-10T21:17:26.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.876+0000 7f9720ff9700 1 -- 172.21.15.154:0/2298665950 <== mgr.6063 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284040 (secure 0 0 0) 0x7f97240cd0b0 con 0x7f9708066f30 2023-10-10T21:17:26.881 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9708066f30 msgr2=0x7f97080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9708066f30 0x7f97080693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97240accf0 tx=0x7f9718009040 comp rx=0 tx=0).stop 2023-10-10T21:17:26.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9724156310 msgr2=0x7f972416a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:26.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9724156310 0x7f972416a5f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f971000e900 tx=0x7f97100091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 shutdown_connections 2023-10-10T21:17:26.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9708066f30 0x7f97080693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97241566e0 0x7f97240c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97240cb900 0x7f9724157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 --2- 172.21.15.154:0/2298665950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9724156310 0x7f972416a5f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:26.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.880+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 >> 172.21.15.154:0/2298665950 conn(0x7f97240cc1f0 msgr2=0x7f972406ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:26.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.881+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 shutdown_connections 2023-10-10T21:17:26.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:26.881+0000 7f972999d700 1 -- 172.21.15.154:0/2298665950 wait complete. 2023-10-10T21:17:26.886 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:17:26.899 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:17:25.904145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590978,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":257,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427932,"kb_used_data":8668,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752546788,"statfs":{"total":773094113280,"available":770607910912,"internally_reserved":0,"allocated":8876032,"data_stored":4825628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.815659"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120312+0000","last_change":"2023-10-10T21:17:22.115843+0000","last_active":"2023-10-10T21:17:22.120312+0000","last_peered":"2023-10-10T21:17:22.120312+0000","last_clean":"2023-10-10T21:17:22.120312+0000","last_became_active":"2023-10-10T21:17:22.115575+0000","last_became_peered":"2023-10-10T21:17:22.115575+0000","last_unstale":"2023-10-10T21:17:22.120312+0000","last_undegraded":"2023-10-10T21:17:22.120312+0000","last_fullsized":"2023-10-10T21:17:22.120312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:44.446813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130785+0000","last_change":"2023-10-10T21:17:22.128294+0000","last_active":"2023-10-10T21:17:22.130785+0000","last_peered":"2023-10-10T21:17:22.130785+0000","last_clean":"2023-10-10T21:17:22.130785+0000","last_became_active":"2023-10-10T21:17:22.128005+0000","last_became_peered":"2023-10-10T21:17:22.128005+0000","last_unstale":"2023-10-10T21:17:22.130785+0000","last_undegraded":"2023-10-10T21:17:22.130785+0000","last_fullsized":"2023-10-10T21:17:22.130785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:40:31.293324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133303+0000","last_change":"2023-10-10T21:17:22.130045+0000","last_active":"2023-10-10T21:17:22.133303+0000","last_peered":"2023-10-10T21:17:22.133303+0000","last_clean":"2023-10-10T21:17:22.133303+0000","last_became_active":"2023-10-10T21:17:22.129693+0000","last_became_peered":"2023-10-10T21:17:22.129693+0000","last_unstale":"2023-10-10T21:17:22.133303+0000","last_undegraded":"2023-10-10T21:17:22.133303+0000","last_fullsized":"2023-10-10T21:17:22.133303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:46:57.495512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.131879+0000","last_change":"2023-10-10T21:17:22.130808+0000","last_active":"2023-10-10T21:17:22.131879+0000","last_peered":"2023-10-10T21:17:22.131879+0000","last_clean":"2023-10-10T21:17:22.131879+0000","last_became_active":"2023-10-10T21:17:22.130493+0000","last_became_peered":"2023-10-10T21:17:22.130493+0000","last_unstale":"2023-10-10T21:17:22.131879+0000","last_undegraded":"2023-10-10T21:17:22.131879+0000","last_fullsized":"2023-10-10T21:17:22.131879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:45:03.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126358+0000","last_change":"2023-10-10T21:17:22.123593+0000","last_active":"2023-10-10T21:17:22.126358+0000","last_peered":"2023-10-10T21:17:22.126358+0000","last_clean":"2023-10-10T21:17:22.126358+0000","last_became_active":"2023-10-10T21:17:22.123331+0000","last_became_peered":"2023-10-10T21:17:22.123331+0000","last_unstale":"2023-10-10T21:17:22.126358+0000","last_undegraded":"2023-10-10T21:17:22.126358+0000","last_fullsized":"2023-10-10T21:17:22.126358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:32:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124611+0000","last_change":"2023-10-10T21:17:22.117278+0000","last_active":"2023-10-10T21:17:22.124611+0000","last_peered":"2023-10-10T21:17:22.124611+0000","last_clean":"2023-10-10T21:17:22.124611+0000","last_became_active":"2023-10-10T21:17:22.117007+0000","last_became_peered":"2023-10-10T21:17:22.117007+0000","last_unstale":"2023-10-10T21:17:22.124611+0000","last_undegraded":"2023-10-10T21:17:22.124611+0000","last_fullsized":"2023-10-10T21:17:22.124611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:45:07.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124875+0000","last_change":"2023-10-10T21:17:22.120210+0000","last_active":"2023-10-10T21:17:22.124875+0000","last_peered":"2023-10-10T21:17:22.124875+0000","last_clean":"2023-10-10T21:17:22.124875+0000","last_became_active":"2023-10-10T21:17:22.119950+0000","last_became_peered":"2023-10-10T21:17:22.119950+0000","last_unstale":"2023-10-10T21:17:22.124875+0000","last_undegraded":"2023-10-10T21:17:22.124875+0000","last_fullsized":"2023-10-10T21:17:22.124875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:18.967395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130380+0000","last_change":"2023-10-10T21:17:22.129225+0000","last_active":"2023-10-10T21:17:22.130380+0000","last_peered":"2023-10-10T21:17:22.130380+0000","last_clean":"2023-10-10T21:17:22.130380+0000","last_became_active":"2023-10-10T21:17:22.128916+0000","last_became_peered":"2023-10-10T21:17:22.128916+0000","last_unstale":"2023-10-10T21:17:22.130380+0000","last_undegraded":"2023-10-10T21:17:22.130380+0000","last_fullsized":"2023-10-10T21:17:22.130380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:52.331235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125675+0000","last_change":"2023-10-10T21:17:22.122283+0000","last_active":"2023-10-10T21:17:22.125675+0000","last_peered":"2023-10-10T21:17:22.125675+0000","last_clean":"2023-10-10T21:17:22.125675+0000","last_became_active":"2023-10-10T21:17:22.122017+0000","last_became_peered":"2023-10-10T21:17:22.122017+0000","last_unstale":"2023-10-10T21:17:22.125675+0000","last_undegraded":"2023-10-10T21:17:22.125675+0000","last_fullsized":"2023-10-10T21:17:22.125675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:20.043886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.119814+0000","last_change":"2023-10-10T21:17:22.115157+0000","last_active":"2023-10-10T21:17:22.119814+0000","last_peered":"2023-10-10T21:17:22.119814+0000","last_clean":"2023-10-10T21:17:22.119814+0000","last_became_active":"2023-10-10T21:17:22.114892+0000","last_became_peered":"2023-10-10T21:17:22.114892+0000","last_unstale":"2023-10-10T21:17:22.119814+0000","last_undegraded":"2023-10-10T21:17:22.119814+0000","last_fullsized":"2023-10-10T21:17:22.119814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:27.875920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130792+0000","last_change":"2023-10-10T21:17:22.129274+0000","last_active":"2023-10-10T21:17:22.130792+0000","last_peered":"2023-10-10T21:17:22.130792+0000","last_clean":"2023-10-10T21:17:22.130792+0000","last_became_active":"2023-10-10T21:17:22.128901+0000","last_became_peered":"2023-10-10T21:17:22.128901+0000","last_unstale":"2023-10-10T21:17:22.130792+0000","last_undegraded":"2023-10-10T21:17:22.130792+0000","last_fullsized":"2023-10-10T21:17:22.130792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:44.298941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125704+0000","last_change":"2023-10-10T21:17:22.122632+0000","last_active":"2023-10-10T21:17:22.125704+0000","last_peered":"2023-10-10T21:17:22.125704+0000","last_clean":"2023-10-10T21:17:22.125704+0000","last_became_active":"2023-10-10T21:17:22.122206+0000","last_became_peered":"2023-10-10T21:17:22.122206+0000","last_unstale":"2023-10-10T21:17:22.125704+0000","last_undegraded":"2023-10-10T21:17:22.125704+0000","last_fullsized":"2023-10-10T21:17:22.125704+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:49:14.111746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.128015+0000","last_change":"2023-10-10T21:17:22.125884+0000","last_active":"2023-10-10T21:17:22.128015+0000","last_peered":"2023-10-10T21:17:22.128015+0000","last_clean":"2023-10-10T21:17:22.128015+0000","last_became_active":"2023-10-10T21:17:22.125606+0000","last_became_peered":"2023-10-10T21:17:22.125606+0000","last_unstale":"2023-10-10T21:17:22.128015+0000","last_undegraded":"2023-10-10T21:17:22.128015+0000","last_fullsized":"2023-10-10T21:17:22.128015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:49.550718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130740+0000","last_change":"2023-10-10T21:17:22.129337+0000","last_active":"2023-10-10T21:17:22.130740+0000","last_peered":"2023-10-10T21:17:22.130740+0000","last_clean":"2023-10-10T21:17:22.130740+0000","last_became_active":"2023-10-10T21:17:22.129079+0000","last_became_peered":"2023-10-10T21:17:22.129079+0000","last_unstale":"2023-10-10T21:17:22.130740+0000","last_undegraded":"2023-10-10T21:17:22.130740+0000","last_fullsized":"2023-10-10T21:17:22.130740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:28.435380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133331+0000","last_change":"2023-10-10T21:17:22.130216+0000","last_active":"2023-10-10T21:17:22.133331+0000","last_peered":"2023-10-10T21:17:22.133331+0000","last_clean":"2023-10-10T21:17:22.133331+0000","last_became_active":"2023-10-10T21:17:22.129734+0000","last_became_peered":"2023-10-10T21:17:22.129734+0000","last_unstale":"2023-10-10T21:17:22.133331+0000","last_undegraded":"2023-10-10T21:17:22.133331+0000","last_fullsized":"2023-10-10T21:17:22.133331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:10.135356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139036+0000","last_change":"2023-10-10T21:17:22.135399+0000","last_active":"2023-10-10T21:17:22.139036+0000","last_peered":"2023-10-10T21:17:22.139036+0000","last_clean":"2023-10-10T21:17:22.139036+0000","last_became_active":"2023-10-10T21:17:22.135102+0000","last_became_peered":"2023-10-10T21:17:22.135102+0000","last_unstale":"2023-10-10T21:17:22.139036+0000","last_undegraded":"2023-10-10T21:17:22.139036+0000","last_fullsized":"2023-10-10T21:17:22.139036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:41.564999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120420+0000","last_change":"2023-10-10T21:17:22.117520+0000","last_active":"2023-10-10T21:17:22.120420+0000","last_peered":"2023-10-10T21:17:22.120420+0000","last_clean":"2023-10-10T21:17:22.120420+0000","last_became_active":"2023-10-10T21:17:22.117259+0000","last_became_peered":"2023-10-10T21:17:22.117259+0000","last_unstale":"2023-10-10T21:17:22.120420+0000","last_undegraded":"2023-10-10T21:17:22.120420+0000","last_fullsized":"2023-10-10T21:17:22.120420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:43.565186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127830+0000","last_change":"2023-10-10T21:17:22.125575+0000","last_active":"2023-10-10T21:17:22.127830+0000","last_peered":"2023-10-10T21:17:22.127830+0000","last_clean":"2023-10-10T21:17:22.127830+0000","last_became_active":"2023-10-10T21:17:22.125234+0000","last_became_peered":"2023-10-10T21:17:22.125234+0000","last_unstale":"2023-10-10T21:17:22.127830+0000","last_undegraded":"2023-10-10T21:17:22.127830+0000","last_fullsized":"2023-10-10T21:17:22.127830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:34:00.644220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123193+0000","last_change":"2023-10-10T21:17:22.120461+0000","last_active":"2023-10-10T21:17:22.123193+0000","last_peered":"2023-10-10T21:17:22.123193+0000","last_clean":"2023-10-10T21:17:22.123193+0000","last_became_active":"2023-10-10T21:17:22.120180+0000","last_became_peered":"2023-10-10T21:17:22.120180+0000","last_unstale":"2023-10-10T21:17:22.123193+0000","last_undegraded":"2023-10-10T21:17:22.123193+0000","last_fullsized":"2023-10-10T21:17:22.123193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:13.790306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.142034+0000","last_change":"2023-10-10T21:17:21.110380+0000","last_active":"2023-10-10T21:17:22.142034+0000","last_peered":"2023-10-10T21:17:22.142034+0000","last_clean":"2023-10-10T21:17:22.142034+0000","last_became_active":"2023-10-10T21:17:21.110146+0000","last_became_peered":"2023-10-10T21:17:21.110146+0000","last_unstale":"2023-10-10T21:17:22.142034+0000","last_undegraded":"2023-10-10T21:17:22.142034+0000","last_fullsized":"2023-10-10T21:17:22.142034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125033+0000","last_change":"2023-10-10T21:17:22.119505+0000","last_active":"2023-10-10T21:17:22.125033+0000","last_peered":"2023-10-10T21:17:22.125033+0000","last_clean":"2023-10-10T21:17:22.125033+0000","last_became_active":"2023-10-10T21:17:22.119224+0000","last_became_peered":"2023-10-10T21:17:22.119224+0000","last_unstale":"2023-10-10T21:17:22.125033+0000","last_undegraded":"2023-10-10T21:17:22.125033+0000","last_fullsized":"2023-10-10T21:17:22.125033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:00:07.895891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139718+0000","last_change":"2023-10-10T21:17:21.111302+0000","last_active":"2023-10-10T21:17:22.139718+0000","last_peered":"2023-10-10T21:17:22.139718+0000","last_clean":"2023-10-10T21:17:22.139718+0000","last_became_active":"2023-10-10T21:17:21.109679+0000","last_became_peered":"2023-10-10T21:17:21.109679+0000","last_unstale":"2023-10-10T21:17:22.139718+0000","last_undegraded":"2023-10-10T21:17:22.139718+0000","last_fullsized":"2023-10-10T21:17:22.139718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:29.027774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134656+0000","last_change":"2023-10-10T21:17:22.131469+0000","last_active":"2023-10-10T21:17:22.134656+0000","last_peered":"2023-10-10T21:17:22.134656+0000","last_clean":"2023-10-10T21:17:22.134656+0000","last_became_active":"2023-10-10T21:17:22.130839+0000","last_became_peered":"2023-10-10T21:17:22.130839+0000","last_unstale":"2023-10-10T21:17:22.134656+0000","last_undegraded":"2023-10-10T21:17:22.134656+0000","last_fullsized":"2023-10-10T21:17:22.134656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:02.566076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139455+0000","last_change":"2023-10-10T21:17:21.105421+0000","last_active":"2023-10-10T21:17:22.139455+0000","last_peered":"2023-10-10T21:17:22.139455+0000","last_clean":"2023-10-10T21:17:22.139455+0000","last_became_active":"2023-10-10T21:17:21.104957+0000","last_became_peered":"2023-10-10T21:17:21.104957+0000","last_unstale":"2023-10-10T21:17:22.139455+0000","last_undegraded":"2023-10-10T21:17:22.139455+0000","last_fullsized":"2023-10-10T21:17:22.139455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140395+0000","last_change":"2023-10-10T21:17:22.138180+0000","last_active":"2023-10-10T21:17:22.140395+0000","last_peered":"2023-10-10T21:17:22.140395+0000","last_clean":"2023-10-10T21:17:22.140395+0000","last_became_active":"2023-10-10T21:17:22.137905+0000","last_became_peered":"2023-10-10T21:17:22.137905+0000","last_unstale":"2023-10-10T21:17:22.140395+0000","last_undegraded":"2023-10-10T21:17:22.140395+0000","last_fullsized":"2023-10-10T21:17:22.140395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:53.511832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092346+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:30.424526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.122719+0000","last_change":"2023-10-10T21:17:22.120590+0000","last_active":"2023-10-10T21:17:22.122719+0000","last_peered":"2023-10-10T21:17:22.122719+0000","last_clean":"2023-10-10T21:17:22.122719+0000","last_became_active":"2023-10-10T21:17:22.120332+0000","last_became_peered":"2023-10-10T21:17:22.120332+0000","last_unstale":"2023-10-10T21:17:22.122719+0000","last_undegraded":"2023-10-10T21:17:22.122719+0000","last_fullsized":"2023-10-10T21:17:22.122719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:29.688214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.097427+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:30.424526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.132205+0000","last_change":"2023-10-10T21:17:22.129664+0000","last_active":"2023-10-10T21:17:22.132205+0000","last_peered":"2023-10-10T21:17:22.132205+0000","last_clean":"2023-10-10T21:17:22.132205+0000","last_became_active":"2023-10-10T21:17:22.129392+0000","last_became_peered":"2023-10-10T21:17:22.129392+0000","last_unstale":"2023-10-10T21:17:22.132205+0000","last_undegraded":"2023-10-10T21:17:22.132205+0000","last_fullsized":"2023-10-10T21:17:22.132205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:37:26.419533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139710+0000","last_change":"2023-10-10T21:17:21.104091+0000","last_active":"2023-10-10T21:17:22.139710+0000","last_peered":"2023-10-10T21:17:22.139710+0000","last_clean":"2023-10-10T21:17:22.139710+0000","last_became_active":"2023-10-10T21:17:21.103772+0000","last_became_peered":"2023-10-10T21:17:21.103772+0000","last_unstale":"2023-10-10T21:17:22.139710+0000","last_undegraded":"2023-10-10T21:17:22.139710+0000","last_fullsized":"2023-10-10T21:17:22.139710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:17:09.167468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092308+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:41.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120843+0000","last_change":"2023-10-10T21:17:22.118158+0000","last_active":"2023-10-10T21:17:22.120843+0000","last_peered":"2023-10-10T21:17:22.120843+0000","last_clean":"2023-10-10T21:17:22.120843+0000","last_became_active":"2023-10-10T21:17:22.117833+0000","last_became_peered":"2023-10-10T21:17:22.117833+0000","last_unstale":"2023-10-10T21:17:22.120843+0000","last_undegraded":"2023-10-10T21:17:22.120843+0000","last_fullsized":"2023-10-10T21:17:22.120843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:02:00.520880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.095806+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:52:34.309774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.095640+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118476+0000","last_change":"2023-10-10T21:17:21.111763+0000","last_active":"2023-10-10T21:17:22.118476+0000","last_peered":"2023-10-10T21:17:22.118476+0000","last_clean":"2023-10-10T21:17:22.118476+0000","last_became_active":"2023-10-10T21:17:21.111518+0000","last_became_peered":"2023-10-10T21:17:21.111518+0000","last_unstale":"2023-10-10T21:17:22.118476+0000","last_undegraded":"2023-10-10T21:17:22.118476+0000","last_fullsized":"2023-10-10T21:17:22.118476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:01:00.565221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126465+0000","last_change":"2023-10-10T21:17:22.121020+0000","last_active":"2023-10-10T21:17:22.126465+0000","last_peered":"2023-10-10T21:17:22.126465+0000","last_clean":"2023-10-10T21:17:22.126465+0000","last_became_active":"2023-10-10T21:17:22.120556+0000","last_became_peered":"2023-10-10T21:17:22.120556+0000","last_unstale":"2023-10-10T21:17:22.126465+0000","last_undegraded":"2023-10-10T21:17:22.126465+0000","last_fullsized":"2023-10-10T21:17:22.126465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:18.893169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.095730+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.096848+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:41.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139085+0000","last_change":"2023-10-10T21:17:21.112845+0000","last_active":"2023-10-10T21:17:22.139085+0000","last_peered":"2023-10-10T21:17:22.139085+0000","last_clean":"2023-10-10T21:17:22.139085+0000","last_became_active":"2023-10-10T21:17:21.112572+0000","last_became_peered":"2023-10-10T21:17:21.112572+0000","last_unstale":"2023-10-10T21:17:22.139085+0000","last_undegraded":"2023-10-10T21:17:22.139085+0000","last_fullsized":"2023-10-10T21:17:22.139085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:25:28.217784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092119+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:45:05.277480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091663+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:29:17.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.097529+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:11:09.152293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139072+0000","last_change":"2023-10-10T21:17:21.109113+0000","last_active":"2023-10-10T21:17:22.139072+0000","last_peered":"2023-10-10T21:17:22.139072+0000","last_clean":"2023-10-10T21:17:22.139072+0000","last_became_active":"2023-10-10T21:17:21.106685+0000","last_became_peered":"2023-10-10T21:17:21.106685+0000","last_unstale":"2023-10-10T21:17:22.139072+0000","last_undegraded":"2023-10-10T21:17:22.139072+0000","last_fullsized":"2023-10-10T21:17:22.139072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:51:52.120571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139601+0000","last_change":"2023-10-10T21:17:21.112175+0000","last_active":"2023-10-10T21:17:22.139601+0000","last_peered":"2023-10-10T21:17:22.139601+0000","last_clean":"2023-10-10T21:17:22.139601+0000","last_became_active":"2023-10-10T21:17:21.111931+0000","last_became_peered":"2023-10-10T21:17:21.111931+0000","last_unstale":"2023-10-10T21:17:22.139601+0000","last_undegraded":"2023-10-10T21:17:22.139601+0000","last_fullsized":"2023-10-10T21:17:22.139601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:41.727455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125643+0000","last_change":"2023-10-10T21:17:22.122912+0000","last_active":"2023-10-10T21:17:22.125643+0000","last_peered":"2023-10-10T21:17:22.125643+0000","last_clean":"2023-10-10T21:17:22.125643+0000","last_became_active":"2023-10-10T21:17:22.122663+0000","last_became_peered":"2023-10-10T21:17:22.122663+0000","last_unstale":"2023-10-10T21:17:22.125643+0000","last_undegraded":"2023-10-10T21:17:22.125643+0000","last_fullsized":"2023-10-10T21:17:22.125643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:53:40.085195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091890+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:11:42.908611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.108547+0000","last_change":"2023-10-10T21:17:21.116009+0000","last_active":"2023-10-10T21:17:22.108547+0000","last_peered":"2023-10-10T21:17:22.108547+0000","last_clean":"2023-10-10T21:17:22.108547+0000","last_became_active":"2023-10-10T21:17:21.115764+0000","last_became_peered":"2023-10-10T21:17:21.115764+0000","last_unstale":"2023-10-10T21:17:22.108547+0000","last_undegraded":"2023-10-10T21:17:22.108547+0000","last_fullsized":"2023-10-10T21:17:22.108547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:11:09.152293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.141309+0000","last_change":"2023-10-10T21:17:21.109031+0000","last_active":"2023-10-10T21:17:22.141309+0000","last_peered":"2023-10-10T21:17:22.141309+0000","last_clean":"2023-10-10T21:17:22.141309+0000","last_became_active":"2023-10-10T21:17:21.108292+0000","last_became_peered":"2023-10-10T21:17:21.108292+0000","last_unstale":"2023-10-10T21:17:22.141309+0000","last_undegraded":"2023-10-10T21:17:22.141309+0000","last_fullsized":"2023-10-10T21:17:22.141309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:15:17.264995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129441+0000","last_change":"2023-10-10T21:17:22.126967+0000","last_active":"2023-10-10T21:17:22.129441+0000","last_peered":"2023-10-10T21:17:22.129441+0000","last_clean":"2023-10-10T21:17:22.129441+0000","last_became_active":"2023-10-10T21:17:22.126688+0000","last_became_peered":"2023-10-10T21:17:22.126688+0000","last_unstale":"2023-10-10T21:17:22.129441+0000","last_undegraded":"2023-10-10T21:17:22.129441+0000","last_fullsized":"2023-10-10T21:17:22.129441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:06:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104746+0000","last_change":"2023-10-10T21:17:21.107533+0000","last_active":"2023-10-10T21:17:22.104746+0000","last_peered":"2023-10-10T21:17:22.104746+0000","last_clean":"2023-10-10T21:17:22.104746+0000","last_became_active":"2023-10-10T21:17:21.107293+0000","last_became_peered":"2023-10-10T21:17:21.107293+0000","last_unstale":"2023-10-10T21:17:22.104746+0000","last_undegraded":"2023-10-10T21:17:22.104746+0000","last_fullsized":"2023-10-10T21:17:22.104746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:15.822758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123986+0000","last_change":"2023-10-10T21:17:22.121229+0000","last_active":"2023-10-10T21:17:22.123986+0000","last_peered":"2023-10-10T21:17:22.123986+0000","last_clean":"2023-10-10T21:17:22.123986+0000","last_became_active":"2023-10-10T21:17:22.120968+0000","last_became_peered":"2023-10-10T21:17:22.120968+0000","last_unstale":"2023-10-10T21:17:22.123986+0000","last_undegraded":"2023-10-10T21:17:22.123986+0000","last_fullsized":"2023-10-10T21:17:22.123986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:31:51.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091661+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:45.952790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140519+0000","last_change":"2023-10-10T21:17:21.116165+0000","last_active":"2023-10-10T21:17:22.140519+0000","last_peered":"2023-10-10T21:17:22.140519+0000","last_clean":"2023-10-10T21:17:22.140519+0000","last_became_active":"2023-10-10T21:17:21.115910+0000","last_became_peered":"2023-10-10T21:17:21.115910+0000","last_unstale":"2023-10-10T21:17:22.140519+0000","last_undegraded":"2023-10-10T21:17:22.140519+0000","last_fullsized":"2023-10-10T21:17:22.140519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:35:48.191005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110044+0000","last_change":"2023-10-10T21:17:21.107240+0000","last_active":"2023-10-10T21:17:22.110044+0000","last_peered":"2023-10-10T21:17:22.110044+0000","last_clean":"2023-10-10T21:17:22.110044+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.110044+0000","last_undegraded":"2023-10-10T21:17:22.110044+0000","last_fullsized":"2023-10-10T21:17:22.110044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:41.329697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126446+0000","last_change":"2023-10-10T21:17:22.120807+0000","last_active":"2023-10-10T21:17:22.126446+0000","last_peered":"2023-10-10T21:17:22.126446+0000","last_clean":"2023-10-10T21:17:22.126446+0000","last_became_active":"2023-10-10T21:17:22.120231+0000","last_became_peered":"2023-10-10T21:17:22.120231+0000","last_unstale":"2023-10-10T21:17:22.126446+0000","last_undegraded":"2023-10-10T21:17:22.126446+0000","last_fullsized":"2023-10-10T21:17:22.126446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:39.969510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091653+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:44:18.353609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.138890+0000","last_change":"2023-10-10T21:17:22.135588+0000","last_active":"2023-10-10T21:17:22.138890+0000","last_peered":"2023-10-10T21:17:22.138890+0000","last_clean":"2023-10-10T21:17:22.138890+0000","last_became_active":"2023-10-10T21:17:22.135336+0000","last_became_peered":"2023-10-10T21:17:22.135336+0000","last_unstale":"2023-10-10T21:17:22.138890+0000","last_undegraded":"2023-10-10T21:17:22.138890+0000","last_fullsized":"2023-10-10T21:17:22.138890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:54.513628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091732+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:52:34.309774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127696+0000","last_change":"2023-10-10T21:17:22.126342+0000","last_active":"2023-10-10T21:17:22.127696+0000","last_peered":"2023-10-10T21:17:22.127696+0000","last_clean":"2023-10-10T21:17:22.127696+0000","last_became_active":"2023-10-10T21:17:22.126073+0000","last_became_peered":"2023-10-10T21:17:22.126073+0000","last_unstale":"2023-10-10T21:17:22.127696+0000","last_undegraded":"2023-10-10T21:17:22.127696+0000","last_fullsized":"2023-10-10T21:17:22.127696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:16.335987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104748+0000","last_change":"2023-10-10T21:17:21.114873+0000","last_active":"2023-10-10T21:17:22.104748+0000","last_peered":"2023-10-10T21:17:22.104748+0000","last_clean":"2023-10-10T21:17:22.104748+0000","last_became_active":"2023-10-10T21:17:21.114212+0000","last_became_peered":"2023-10-10T21:17:21.114212+0000","last_unstale":"2023-10-10T21:17:22.104748+0000","last_undegraded":"2023-10-10T21:17:22.104748+0000","last_fullsized":"2023-10-10T21:17:22.104748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:36.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.096282+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:11:42.908611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127572+0000","last_change":"2023-10-10T21:17:22.121370+0000","last_active":"2023-10-10T21:17:22.127572+0000","last_peered":"2023-10-10T21:17:22.127572+0000","last_clean":"2023-10-10T21:17:22.127572+0000","last_became_active":"2023-10-10T21:17:22.117631+0000","last_became_peered":"2023-10-10T21:17:22.117631+0000","last_unstale":"2023-10-10T21:17:22.127572+0000","last_undegraded":"2023-10-10T21:17:22.127572+0000","last_fullsized":"2023-10-10T21:17:22.127572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:09:00.391451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104781+0000","last_change":"2023-10-10T21:17:21.107269+0000","last_active":"2023-10-10T21:17:22.104781+0000","last_peered":"2023-10-10T21:17:22.104781+0000","last_clean":"2023-10-10T21:17:22.104781+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.104781+0000","last_undegraded":"2023-10-10T21:17:22.104781+0000","last_fullsized":"2023-10-10T21:17:22.104781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:23:20.098680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118254+0000","last_change":"2023-10-10T21:17:22.113811+0000","last_active":"2023-10-10T21:17:22.118254+0000","last_peered":"2023-10-10T21:17:22.118254+0000","last_clean":"2023-10-10T21:17:22.118254+0000","last_became_active":"2023-10-10T21:17:22.113536+0000","last_became_peered":"2023-10-10T21:17:22.113536+0000","last_unstale":"2023-10-10T21:17:22.118254+0000","last_undegraded":"2023-10-10T21:17:22.118254+0000","last_fullsized":"2023-10-10T21:17:22.118254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:46.588070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.112091+0000","last_change":"2023-10-10T21:17:21.115869+0000","last_active":"2023-10-10T21:17:22.112091+0000","last_peered":"2023-10-10T21:17:22.112091+0000","last_clean":"2023-10-10T21:17:22.112091+0000","last_became_active":"2023-10-10T21:17:21.115625+0000","last_became_peered":"2023-10-10T21:17:21.115625+0000","last_unstale":"2023-10-10T21:17:22.112091+0000","last_undegraded":"2023-10-10T21:17:22.112091+0000","last_fullsized":"2023-10-10T21:17:22.112091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:14.597592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129353+0000","last_change":"2023-10-10T21:17:22.126892+0000","last_active":"2023-10-10T21:17:22.129353+0000","last_peered":"2023-10-10T21:17:22.129353+0000","last_clean":"2023-10-10T21:17:22.129353+0000","last_became_active":"2023-10-10T21:17:22.126627+0000","last_became_peered":"2023-10-10T21:17:22.126627+0000","last_unstale":"2023-10-10T21:17:22.129353+0000","last_undegraded":"2023-10-10T21:17:22.129353+0000","last_fullsized":"2023-10-10T21:17:22.129353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:39:59.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092505+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:32:47.406455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":368,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-10T21:17:18.530637+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:17:18.530637+0000","last_peered":"2023-10-10T21:17:18.530637+0000","last_clean":"2023-10-10T21:17:18.530637+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:17:18.530637+0000","last_undegraded":"2023-10-10T21:17:18.530637+0000","last_fullsized":"2023-10-10T21:17:18.530637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542327,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302880,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068960,"statfs":{"total":96636764160,"available":96326615040,"internally_reserved":0,"allocated":1531904,"data_stored":1035452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.55800000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.89600000000000002,"5min":1.014,"15min":1.1859999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.47499999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75,"15min":0.73699999999999999},"min":{"1min":0.629,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0069999999999999,"15min":1.123},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.61599999999999999},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.624},"min":{"1min":0.42599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78000000000000003,"5min":0.98299999999999998,"15min":1.022},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.67400000000000004},"min":{"1min":0.499,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":0.82899999999999996,"5min":0.90600000000000003,"15min":0.98899999999999999},"last":0.495}]},{"osd":6,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.52600000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.625,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.135},"last":0.58599999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542326,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":445084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.59199999999999997,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.747,"15min":0.75},"min":{"1min":0.626,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.143},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.65700000000000003,"5min":0.497,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":1.073,"15min":1.073},"last":0.64100000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.98199999999999998,"15min":1.151},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.58999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97799999999999998,"15min":1.01},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.74199999999999999,"15min":0.73199999999999998},"min":{"1min":0.621,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83699999999999997,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.1200000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.62,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72099999999999997,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.34799999999999998},"max":{"1min":0.86499999999999999,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.755}]},{"osd":5,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.87,"5min":1.022,"15min":1.345},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.879,"5min":1.048,"15min":1.238},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":0.86099999999999999,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0289999999999999,"15min":1.202},"last":0.84199999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542327,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302340,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069500,"statfs":{"total":96636764160,"available":96327168000,"internally_reserved":0,"allocated":978944,"data_stored":465656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32600000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66300000000000003,"5min":0.79700000000000004,"15min":1.258},"last":8.0839999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":1.964},"last":13.223000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.89300000000000002,"15min":1.4550000000000001},"last":2.254},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.44,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":2.085},"last":1.9019999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.84399999999999997,"15min":1.8919999999999999},"last":4.0060000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":2.117},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.48099999999999998},"max":{"1min":1.042,"5min":1.0509999999999999,"15min":2.052},"last":4.806},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.66400000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96999999999999997,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":3.9180000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.61499999999999999,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.0409999999999999,"15min":1.181},"last":6.968},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.46400000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":2.012},"last":13.130000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.60999999999999999,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":1.01,"5min":1.1240000000000001,"15min":2.25},"last":3.9569999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.72099999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":2.2999999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78800000000000003,"15min":0.78900000000000003},"min":{"1min":0.69199999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.04,"5min":1.1639999999999999,"15min":2.169},"last":12.026},{"interface":"front","average":{"1min":0.877,"5min":0.81799999999999995,"15min":0.82099999999999995},"min":{"1min":0.70999999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.05,"5min":1.149,"15min":1.1850000000000001},"last":3.7229999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073004,"statfs":{"total":96636764160,"available":96330756096,"internally_reserved":0,"allocated":1585152,"data_stored":1058024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.67200000000000004,"5min":0.74299999999999999,"15min":1.4890000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.879,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.44}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.42499999999999999,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":1.706},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.874,"15min":1.2909999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.101,"15min":1.2270000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95599999999999996,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.008,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":1.0980000000000001,"5min":1.119,"15min":1.3899999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83099999999999996,"15min":0.82799999999999996},"min":{"1min":0.65700000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0640000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.83799999999999997},"min":{"1min":0.66700000000000004,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0109999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.73999999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.1439999999999999,"15min":1.363},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.64400000000000002,"5min":0.58799999999999997,"15min":0.54200000000000004},"max":{"1min":1.024,"5min":1.165,"15min":1.3300000000000001},"last":0.78600000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.35699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.73399999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.495}]},{"osd":1,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91200000000000003,"5min":1.157,"15min":1.3220000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.63200000000000001,"5min":0.53500000000000003,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":1.26,"15min":1.2849999999999999},"last":0.96899999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.65800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98199999999999998,"5min":2.21,"15min":2.21},"last":1.008},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78200000000000003,"15min":0.78300000000000003},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.165,"15min":1.268},"last":0.92600000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.67800000000000005,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":1.018,"5min":1.151,"15min":1.3400000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.65600000000000003,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":1.0349999999999999,"15min":1.3759999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81000000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.0029999999999999,"5min":1.716,"15min":1.716},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.81200000000000006},"min":{"1min":0.71699999999999997,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.97799999999999998,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509624,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.442,"15min":0.45800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.66400000000000003,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.495,"15min":0.499},"min":{"1min":0.42799999999999999,"5min":0.33700000000000002,"15min":0.28799999999999998},"max":{"1min":0.65100000000000002,"5min":0.73399999999999999,"15min":1.544},"last":0.35999999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.40899999999999997,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":1.6759999999999999},"last":0.315},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.45800000000000002,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.432}]},{"osd":2,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.7070000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.38700000000000001},"max":{"1min":0.77700000000000002,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.63100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96499999999999997,"5min":1.054,"15min":1.6359999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76700000000000002,"15min":0.78600000000000003},"min":{"1min":0.61199999999999999,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.016,"5min":1.1859999999999999,"15min":1.246},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.65000000000000002,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":0.996,"5min":1.1240000000000001,"15min":1.262},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76800000000000002,"15min":0.77800000000000002},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":0.97999999999999998,"5min":1.2250000000000001,"15min":1.579},"last":0.64100000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61399999999999999,"5min":0.502,"15min":0.47099999999999997},"max":{"1min":1.05,"5min":1.27,"15min":1.27},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.68400000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.224,"15min":1.224},"last":0.624}]},{"osd":7,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":0.98999999999999999,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.81499999999999995},"min":{"1min":0.66000000000000003,"5min":0.53500000000000003,"15min":0.51300000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.3200000000000001},"last":0.501}]}]},{"osd":4,"up_from":14,"seq":60129542328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306396,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065444,"statfs":{"total":96636764160,"available":96323014656,"internally_reserved":0,"allocated":937984,"data_stored":445084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.92000000000000004,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.95099999999999996,"5min":0.96299999999999997,"15min":1.758},"last":0.502}]},{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.1359999999999999,"15min":1.47},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":0.98299999999999998,"15min":1.929},"last":0.67000000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.6890000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.98399999999999999,"5min":1.3100000000000001,"15min":1.468},"last":0.64500000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.046,"5min":1.0820000000000001,"15min":1.397},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":1.385,"15min":1.385},"last":0.58999999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79700000000000004,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.874,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":1.0609999999999999,"15min":1.464},"last":0.75800000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.83599999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542326,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":445084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.52300000000000002,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.371},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.56000000000000005,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":0.90100000000000002,"5min":0.93300000000000005,"15min":3.895},"last":0.442},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73599999999999999,"15min":0.78000000000000003},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.71599999999999997},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.97499999999999998,"5min":1.01,"15min":1.2889999999999999},"last":0.5},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":1.3540000000000001},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76000000000000001,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.748},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.59099999999999997,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.83499999999999996}]},{"osd":4,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.496,"15min":4.2789999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.80200000000000005},"min":{"1min":0.56699999999999995,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.84699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.51200000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":2.8900000000000001},"last":0.872},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.96099999999999997,"5min":1.077,"15min":3.9420000000000002},"last":0.82199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:17:26.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:17:27.087 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-10-10T21:17:27.086+0000 7f19ebdf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:17:27.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.121+0000 7fd269fff700 1 Processor -- start 2023-10-10T21:17:27.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.121+0000 7fd269fff700 1 -- start start 2023-10-10T21:17:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd269fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd264155c10 0x7fd264155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd269fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd2640ac6d0 0x7fd2640b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd269fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2640acac0 con 0x7fd2640ac230 2023-10-10T21:17:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd269fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2640ad930 con 0x7fd2640ac6d0 2023-10-10T21:17:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd269fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2640acd20 con 0x7fd264155c10 2023-10-10T21:17:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd263fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd2640ac6d0 0x7fd2640b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd263fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd2640ac6d0 0x7fd2640b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58048/0 (socket says 172.21.15.154:58048) 2023-10-10T21:17:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd263fff700 1 -- 172.21.15.154:0/1770251149 learned_addr learned my addr 172.21.15.154:0/1770251149 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd2637fe700 1 --2- 172.21.15.154:0/1770251149 >> v2:172.21.15.179:3300/0 conn(0x7fd264155c10 0x7fd264155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd263fff700 1 -- 172.21.15.154:0/1770251149 >> v2:172.21.15.179:3300/0 conn(0x7fd264155c10 msgr2=0x7fd264155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.123+0000 7fd263fff700 1 --2- 172.21.15.154:0/1770251149 >> v2:172.21.15.179:3300/0 conn(0x7fd264155c10 0x7fd264155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.124+0000 7fd263fff700 1 -- 172.21.15.154:0/1770251149 >> v1:172.21.15.179:6789/0 conn(0x7fd2640ac230 legacy=0x7fd2641568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.124+0000 7fd263fff700 1 -- 172.21.15.154:0/1770251149 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2640ad000 con 0x7fd2640ac6d0 2023-10-10T21:17:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.124+0000 7fd2637fe700 1 --2- 172.21.15.154:0/1770251149 >> v2:172.21.15.179:3300/0 conn(0x7fd264155c10 0x7fd264155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.124+0000 7fd263fff700 1 --2- 172.21.15.154:0/1770251149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac6d0 0x7fd2640b0300 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd264063d40 tx=0x7fd25c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7875f3bc2dd3adcc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:27.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.124+0000 7fd2627fc700 1 -- 172.21.15.154:0/1770251149 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c010070 con 0x7fd2640ac6d0 2023-10-10T21:17:27.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.124+0000 7fd2627fc700 1 -- 172.21.15.154:0/1770251149 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c00dc80 con 0x7fd2640ac6d0 2023-10-10T21:17:27.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.124+0000 7fd2627fc700 1 -- 172.21.15.154:0/1770251149 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c016400 con 0x7fd2640ac6d0 2023-10-10T21:17:27.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.125+0000 7fd269fff700 1 -- 172.21.15.154:0/1770251149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac6d0 msgr2=0x7fd2640b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.125+0000 7fd269fff700 1 --2- 172.21.15.154:0/1770251149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac6d0 0x7fd2640b0300 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd264063d40 tx=0x7fd25c00ba50 comp rx=0 tx=0).stop 2023-10-10T21:17:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.125+0000 7fd269fff700 1 -- 172.21.15.154:0/1770251149 shutdown_connections 2023-10-10T21:17:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.125+0000 7fd269fff700 1 --2- 172.21.15.154:0/1770251149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac6d0 0x7fd2640b0300 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.125+0000 7fd269fff700 1 --2- 172.21.15.154:0/1770251149 >> v2:172.21.15.179:3300/0 conn(0x7fd264155c10 0x7fd264155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.125+0000 7fd269fff700 1 -- 172.21.15.154:0/1770251149 >> 172.21.15.154:0/1770251149 conn(0x7fd26406a320 msgr2=0x7fd2640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.125+0000 7fd269fff700 1 -- 172.21.15.154:0/1770251149 shutdown_connections 2023-10-10T21:17:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.125+0000 7fd269fff700 1 -- 172.21.15.154:0/1770251149 wait complete. 2023-10-10T21:17:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.126+0000 7fd269fff700 1 Processor -- start 2023-10-10T21:17:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.126+0000 7fd269fff700 1 -- start start 2023-10-10T21:17:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.127+0000 7fd269fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac230 0x7fd264150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.127+0000 7fd269fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2640ac6d0 0x7fd26414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.127+0000 7fd269fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd264155c10 0x7fd26415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.127+0000 7fd269fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd264159080 con 0x7fd2640ac230 2023-10-10T21:17:27.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.127+0000 7fd269fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26414f980 con 0x7fd2640ac6d0 2023-10-10T21:17:27.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.127+0000 7fd269fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2641569d0 con 0x7fd264155c10 2023-10-10T21:17:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.127+0000 7fd2637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac230 0x7fd264150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.127+0000 7fd2637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac230 0x7fd264150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58060/0 (socket says 172.21.15.154:58060) 2023-10-10T21:17:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.127+0000 7fd2637fe700 1 -- 172.21.15.154:0/633641105 learned_addr learned my addr 172.21.15.154:0/633641105 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd263fff700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd264155c10 0x7fd26415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd262ffd700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2640ac6d0 0x7fd26414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd2637fe700 1 -- 172.21.15.154:0/633641105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd264155c10 msgr2=0x7fd26415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd2637fe700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd264155c10 0x7fd26415a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd2637fe700 1 -- 172.21.15.154:0/633641105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2640ac6d0 msgr2=0x7fd26414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd2637fe700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2640ac6d0 0x7fd26414f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd2637fe700 1 -- 172.21.15.154:0/633641105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c00bcf0 con 0x7fd2640ac230 2023-10-10T21:17:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd262ffd700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2640ac6d0 0x7fd26414f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd2637fe700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac230 0x7fd264150640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd25400d860 tx=0x7fd254008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd24b7fe700 1 -- 172.21.15.154:0/633641105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540125f0 con 0x7fd2640ac230 2023-10-10T21:17:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd24b7fe700 1 -- 172.21.15.154:0/633641105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254012750 con 0x7fd2640ac230 2023-10-10T21:17:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd24b7fe700 1 -- 172.21.15.154:0/633641105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254012af0 con 0x7fd2640ac230 2023-10-10T21:17:27.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.128+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26415ad90 con 0x7fd2640ac230 2023-10-10T21:17:27.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.129+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26415b350 con 0x7fd2640ac230 2023-10-10T21:17:27.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.129+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd264156cb0 con 0x7fd2640ac230 2023-10-10T21:17:27.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.130+0000 7fd24b7fe700 1 -- 172.21.15.154:0/633641105 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd254014430 con 0x7fd2640ac230 2023-10-10T21:17:27.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.131+0000 7fd24b7fe700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd250066f30 0x7fd2500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.131+0000 7fd24b7fe700 1 -- 172.21.15.154:0/633641105 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fd254084a20 con 0x7fd2640ac230 2023-10-10T21:17:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.131+0000 7fd262ffd700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd250066f30 0x7fd2500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.132+0000 7fd262ffd700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd250066f30 0x7fd2500693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd258007fd0 tx=0x7fd258009040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.135+0000 7fd24b7fe700 1 -- 172.21.15.154:0/633641105 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd254051b00 con 0x7fd2640ac230 2023-10-10T21:17:27.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.324+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd26404c3c0 con 0x7fd250066f30 2023-10-10T21:17:27.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.332+0000 7fd24b7fe700 1 -- 172.21.15.154:0/633641105 <== mgr.6063 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284040 (secure 0 0 0) 0x7fd26404c3c0 con 0x7fd250066f30 2023-10-10T21:17:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.336+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd250066f30 msgr2=0x7fd2500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.336+0000 7fd269fff700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd250066f30 0x7fd2500693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd258007fd0 tx=0x7fd258009040 comp rx=0 tx=0).stop 2023-10-10T21:17:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.336+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac230 msgr2=0x7fd264150640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.336+0000 7fd269fff700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac230 0x7fd264150640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd25400d860 tx=0x7fd254008040 comp rx=0 tx=0).stop 2023-10-10T21:17:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.337+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 shutdown_connections 2023-10-10T21:17:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.337+0000 7fd269fff700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd264155c10 0x7fd26415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.337+0000 7fd269fff700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2640ac230 0x7fd264150640 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.337+0000 7fd269fff700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd250066f30 0x7fd2500693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.337+0000 7fd269fff700 1 --2- 172.21.15.154:0/633641105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2640ac6d0 0x7fd26414f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.337+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 >> 172.21.15.154:0/633641105 conn(0x7fd26406a320 msgr2=0x7fd26415c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.337+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 shutdown_connections 2023-10-10T21:17:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.337+0000 7fd269fff700 1 -- 172.21.15.154:0/633641105 wait complete. 2023-10-10T21:17:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:17:27.356 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:17:25.904145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590978,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":257,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427932,"kb_used_data":8668,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752546788,"statfs":{"total":773094113280,"available":770607910912,"internally_reserved":0,"allocated":8876032,"data_stored":4825628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.815659"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120312+0000","last_change":"2023-10-10T21:17:22.115843+0000","last_active":"2023-10-10T21:17:22.120312+0000","last_peered":"2023-10-10T21:17:22.120312+0000","last_clean":"2023-10-10T21:17:22.120312+0000","last_became_active":"2023-10-10T21:17:22.115575+0000","last_became_peered":"2023-10-10T21:17:22.115575+0000","last_unstale":"2023-10-10T21:17:22.120312+0000","last_undegraded":"2023-10-10T21:17:22.120312+0000","last_fullsized":"2023-10-10T21:17:22.120312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:44.446813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130785+0000","last_change":"2023-10-10T21:17:22.128294+0000","last_active":"2023-10-10T21:17:22.130785+0000","last_peered":"2023-10-10T21:17:22.130785+0000","last_clean":"2023-10-10T21:17:22.130785+0000","last_became_active":"2023-10-10T21:17:22.128005+0000","last_became_peered":"2023-10-10T21:17:22.128005+0000","last_unstale":"2023-10-10T21:17:22.130785+0000","last_undegraded":"2023-10-10T21:17:22.130785+0000","last_fullsized":"2023-10-10T21:17:22.130785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:40:31.293324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133303+0000","last_change":"2023-10-10T21:17:22.130045+0000","last_active":"2023-10-10T21:17:22.133303+0000","last_peered":"2023-10-10T21:17:22.133303+0000","last_clean":"2023-10-10T21:17:22.133303+0000","last_became_active":"2023-10-10T21:17:22.129693+0000","last_became_peered":"2023-10-10T21:17:22.129693+0000","last_unstale":"2023-10-10T21:17:22.133303+0000","last_undegraded":"2023-10-10T21:17:22.133303+0000","last_fullsized":"2023-10-10T21:17:22.133303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:46:57.495512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.131879+0000","last_change":"2023-10-10T21:17:22.130808+0000","last_active":"2023-10-10T21:17:22.131879+0000","last_peered":"2023-10-10T21:17:22.131879+0000","last_clean":"2023-10-10T21:17:22.131879+0000","last_became_active":"2023-10-10T21:17:22.130493+0000","last_became_peered":"2023-10-10T21:17:22.130493+0000","last_unstale":"2023-10-10T21:17:22.131879+0000","last_undegraded":"2023-10-10T21:17:22.131879+0000","last_fullsized":"2023-10-10T21:17:22.131879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:45:03.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126358+0000","last_change":"2023-10-10T21:17:22.123593+0000","last_active":"2023-10-10T21:17:22.126358+0000","last_peered":"2023-10-10T21:17:22.126358+0000","last_clean":"2023-10-10T21:17:22.126358+0000","last_became_active":"2023-10-10T21:17:22.123331+0000","last_became_peered":"2023-10-10T21:17:22.123331+0000","last_unstale":"2023-10-10T21:17:22.126358+0000","last_undegraded":"2023-10-10T21:17:22.126358+0000","last_fullsized":"2023-10-10T21:17:22.126358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:32:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124611+0000","last_change":"2023-10-10T21:17:22.117278+0000","last_active":"2023-10-10T21:17:22.124611+0000","last_peered":"2023-10-10T21:17:22.124611+0000","last_clean":"2023-10-10T21:17:22.124611+0000","last_became_active":"2023-10-10T21:17:22.117007+0000","last_became_peered":"2023-10-10T21:17:22.117007+0000","last_unstale":"2023-10-10T21:17:22.124611+0000","last_undegraded":"2023-10-10T21:17:22.124611+0000","last_fullsized":"2023-10-10T21:17:22.124611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:45:07.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124875+0000","last_change":"2023-10-10T21:17:22.120210+0000","last_active":"2023-10-10T21:17:22.124875+0000","last_peered":"2023-10-10T21:17:22.124875+0000","last_clean":"2023-10-10T21:17:22.124875+0000","last_became_active":"2023-10-10T21:17:22.119950+0000","last_became_peered":"2023-10-10T21:17:22.119950+0000","last_unstale":"2023-10-10T21:17:22.124875+0000","last_undegraded":"2023-10-10T21:17:22.124875+0000","last_fullsized":"2023-10-10T21:17:22.124875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:18.967395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130380+0000","last_change":"2023-10-10T21:17:22.129225+0000","last_active":"2023-10-10T21:17:22.130380+0000","last_peered":"2023-10-10T21:17:22.130380+0000","last_clean":"2023-10-10T21:17:22.130380+0000","last_became_active":"2023-10-10T21:17:22.128916+0000","last_became_peered":"2023-10-10T21:17:22.128916+0000","last_unstale":"2023-10-10T21:17:22.130380+0000","last_undegraded":"2023-10-10T21:17:22.130380+0000","last_fullsized":"2023-10-10T21:17:22.130380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:52.331235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125675+0000","last_change":"2023-10-10T21:17:22.122283+0000","last_active":"2023-10-10T21:17:22.125675+0000","last_peered":"2023-10-10T21:17:22.125675+0000","last_clean":"2023-10-10T21:17:22.125675+0000","last_became_active":"2023-10-10T21:17:22.122017+0000","last_became_peered":"2023-10-10T21:17:22.122017+0000","last_unstale":"2023-10-10T21:17:22.125675+0000","last_undegraded":"2023-10-10T21:17:22.125675+0000","last_fullsized":"2023-10-10T21:17:22.125675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:20.043886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.119814+0000","last_change":"2023-10-10T21:17:22.115157+0000","last_active":"2023-10-10T21:17:22.119814+0000","last_peered":"2023-10-10T21:17:22.119814+0000","last_clean":"2023-10-10T21:17:22.119814+0000","last_became_active":"2023-10-10T21:17:22.114892+0000","last_became_peered":"2023-10-10T21:17:22.114892+0000","last_unstale":"2023-10-10T21:17:22.119814+0000","last_undegraded":"2023-10-10T21:17:22.119814+0000","last_fullsized":"2023-10-10T21:17:22.119814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:27.875920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130792+0000","last_change":"2023-10-10T21:17:22.129274+0000","last_active":"2023-10-10T21:17:22.130792+0000","last_peered":"2023-10-10T21:17:22.130792+0000","last_clean":"2023-10-10T21:17:22.130792+0000","last_became_active":"2023-10-10T21:17:22.128901+0000","last_became_peered":"2023-10-10T21:17:22.128901+0000","last_unstale":"2023-10-10T21:17:22.130792+0000","last_undegraded":"2023-10-10T21:17:22.130792+0000","last_fullsized":"2023-10-10T21:17:22.130792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:44.298941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125704+0000","last_change":"2023-10-10T21:17:22.122632+0000","last_active":"2023-10-10T21:17:22.125704+0000","last_peered":"2023-10-10T21:17:22.125704+0000","last_clean":"2023-10-10T21:17:22.125704+0000","last_became_active":"2023-10-10T21:17:22.122206+0000","last_became_peered":"2023-10-10T21:17:22.122206+0000","last_unstale":"2023-10-10T21:17:22.125704+0000","last_undegraded":"2023-10-10T21:17:22.125704+0000","last_fullsized":"2023-10-10T21:17:22.125704+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:49:14.111746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.128015+0000","last_change":"2023-10-10T21:17:22.125884+0000","last_active":"2023-10-10T21:17:22.128015+0000","last_peered":"2023-10-10T21:17:22.128015+0000","last_clean":"2023-10-10T21:17:22.128015+0000","last_became_active":"2023-10-10T21:17:22.125606+0000","last_became_peered":"2023-10-10T21:17:22.125606+0000","last_unstale":"2023-10-10T21:17:22.128015+0000","last_undegraded":"2023-10-10T21:17:22.128015+0000","last_fullsized":"2023-10-10T21:17:22.128015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:49.550718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130740+0000","last_change":"2023-10-10T21:17:22.129337+0000","last_active":"2023-10-10T21:17:22.130740+0000","last_peered":"2023-10-10T21:17:22.130740+0000","last_clean":"2023-10-10T21:17:22.130740+0000","last_became_active":"2023-10-10T21:17:22.129079+0000","last_became_peered":"2023-10-10T21:17:22.129079+0000","last_unstale":"2023-10-10T21:17:22.130740+0000","last_undegraded":"2023-10-10T21:17:22.130740+0000","last_fullsized":"2023-10-10T21:17:22.130740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:28.435380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133331+0000","last_change":"2023-10-10T21:17:22.130216+0000","last_active":"2023-10-10T21:17:22.133331+0000","last_peered":"2023-10-10T21:17:22.133331+0000","last_clean":"2023-10-10T21:17:22.133331+0000","last_became_active":"2023-10-10T21:17:22.129734+0000","last_became_peered":"2023-10-10T21:17:22.129734+0000","last_unstale":"2023-10-10T21:17:22.133331+0000","last_undegraded":"2023-10-10T21:17:22.133331+0000","last_fullsized":"2023-10-10T21:17:22.133331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:10.135356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139036+0000","last_change":"2023-10-10T21:17:22.135399+0000","last_active":"2023-10-10T21:17:22.139036+0000","last_peered":"2023-10-10T21:17:22.139036+0000","last_clean":"2023-10-10T21:17:22.139036+0000","last_became_active":"2023-10-10T21:17:22.135102+0000","last_became_peered":"2023-10-10T21:17:22.135102+0000","last_unstale":"2023-10-10T21:17:22.139036+0000","last_undegraded":"2023-10-10T21:17:22.139036+0000","last_fullsized":"2023-10-10T21:17:22.139036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:41.564999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120420+0000","last_change":"2023-10-10T21:17:22.117520+0000","last_active":"2023-10-10T21:17:22.120420+0000","last_peered":"2023-10-10T21:17:22.120420+0000","last_clean":"2023-10-10T21:17:22.120420+0000","last_became_active":"2023-10-10T21:17:22.117259+0000","last_became_peered":"2023-10-10T21:17:22.117259+0000","last_unstale":"2023-10-10T21:17:22.120420+0000","last_undegraded":"2023-10-10T21:17:22.120420+0000","last_fullsized":"2023-10-10T21:17:22.120420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:43.565186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127830+0000","last_change":"2023-10-10T21:17:22.125575+0000","last_active":"2023-10-10T21:17:22.127830+0000","last_peered":"2023-10-10T21:17:22.127830+0000","last_clean":"2023-10-10T21:17:22.127830+0000","last_became_active":"2023-10-10T21:17:22.125234+0000","last_became_peered":"2023-10-10T21:17:22.125234+0000","last_unstale":"2023-10-10T21:17:22.127830+0000","last_undegraded":"2023-10-10T21:17:22.127830+0000","last_fullsized":"2023-10-10T21:17:22.127830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:34:00.644220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123193+0000","last_change":"2023-10-10T21:17:22.120461+0000","last_active":"2023-10-10T21:17:22.123193+0000","last_peered":"2023-10-10T21:17:22.123193+0000","last_clean":"2023-10-10T21:17:22.123193+0000","last_became_active":"2023-10-10T21:17:22.120180+0000","last_became_peered":"2023-10-10T21:17:22.120180+0000","last_unstale":"2023-10-10T21:17:22.123193+0000","last_undegraded":"2023-10-10T21:17:22.123193+0000","last_fullsized":"2023-10-10T21:17:22.123193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:13.790306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.142034+0000","last_change":"2023-10-10T21:17:21.110380+0000","last_active":"2023-10-10T21:17:22.142034+0000","last_peered":"2023-10-10T21:17:22.142034+0000","last_clean":"2023-10-10T21:17:22.142034+0000","last_became_active":"2023-10-10T21:17:21.110146+0000","last_became_peered":"2023-10-10T21:17:21.110146+0000","last_unstale":"2023-10-10T21:17:22.142034+0000","last_undegraded":"2023-10-10T21:17:22.142034+0000","last_fullsized":"2023-10-10T21:17:22.142034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125033+0000","last_change":"2023-10-10T21:17:22.119505+0000","last_active":"2023-10-10T21:17:22.125033+0000","last_peered":"2023-10-10T21:17:22.125033+0000","last_clean":"2023-10-10T21:17:22.125033+0000","last_became_active":"2023-10-10T21:17:22.119224+0000","last_became_peered":"2023-10-10T21:17:22.119224+0000","last_unstale":"2023-10-10T21:17:22.125033+0000","last_undegraded":"2023-10-10T21:17:22.125033+0000","last_fullsized":"2023-10-10T21:17:22.125033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:00:07.895891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139718+0000","last_change":"2023-10-10T21:17:21.111302+0000","last_active":"2023-10-10T21:17:22.139718+0000","last_peered":"2023-10-10T21:17:22.139718+0000","last_clean":"2023-10-10T21:17:22.139718+0000","last_became_active":"2023-10-10T21:17:21.109679+0000","last_became_peered":"2023-10-10T21:17:21.109679+0000","last_unstale":"2023-10-10T21:17:22.139718+0000","last_undegraded":"2023-10-10T21:17:22.139718+0000","last_fullsized":"2023-10-10T21:17:22.139718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:29.027774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134656+0000","last_change":"2023-10-10T21:17:22.131469+0000","last_active":"2023-10-10T21:17:22.134656+0000","last_peered":"2023-10-10T21:17:22.134656+0000","last_clean":"2023-10-10T21:17:22.134656+0000","last_became_active":"2023-10-10T21:17:22.130839+0000","last_became_peered":"2023-10-10T21:17:22.130839+0000","last_unstale":"2023-10-10T21:17:22.134656+0000","last_undegraded":"2023-10-10T21:17:22.134656+0000","last_fullsized":"2023-10-10T21:17:22.134656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:02.566076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139455+0000","last_change":"2023-10-10T21:17:21.105421+0000","last_active":"2023-10-10T21:17:22.139455+0000","last_peered":"2023-10-10T21:17:22.139455+0000","last_clean":"2023-10-10T21:17:22.139455+0000","last_became_active":"2023-10-10T21:17:21.104957+0000","last_became_peered":"2023-10-10T21:17:21.104957+0000","last_unstale":"2023-10-10T21:17:22.139455+0000","last_undegraded":"2023-10-10T21:17:22.139455+0000","last_fullsized":"2023-10-10T21:17:22.139455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140395+0000","last_change":"2023-10-10T21:17:22.138180+0000","last_active":"2023-10-10T21:17:22.140395+0000","last_peered":"2023-10-10T21:17:22.140395+0000","last_clean":"2023-10-10T21:17:22.140395+0000","last_became_active":"2023-10-10T21:17:22.137905+0000","last_became_peered":"2023-10-10T21:17:22.137905+0000","last_unstale":"2023-10-10T21:17:22.140395+0000","last_undegraded":"2023-10-10T21:17:22.140395+0000","last_fullsized":"2023-10-10T21:17:22.140395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:53.511832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092346+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:30.424526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.122719+0000","last_change":"2023-10-10T21:17:22.120590+0000","last_active":"2023-10-10T21:17:22.122719+0000","last_peered":"2023-10-10T21:17:22.122719+0000","last_clean":"2023-10-10T21:17:22.122719+0000","last_became_active":"2023-10-10T21:17:22.120332+0000","last_became_peered":"2023-10-10T21:17:22.120332+0000","last_unstale":"2023-10-10T21:17:22.122719+0000","last_undegraded":"2023-10-10T21:17:22.122719+0000","last_fullsized":"2023-10-10T21:17:22.122719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:29.688214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.097427+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:30.424526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.132205+0000","last_change":"2023-10-10T21:17:22.129664+0000","last_active":"2023-10-10T21:17:22.132205+0000","last_peered":"2023-10-10T21:17:22.132205+0000","last_clean":"2023-10-10T21:17:22.132205+0000","last_became_active":"2023-10-10T21:17:22.129392+0000","last_became_peered":"2023-10-10T21:17:22.129392+0000","last_unstale":"2023-10-10T21:17:22.132205+0000","last_undegraded":"2023-10-10T21:17:22.132205+0000","last_fullsized":"2023-10-10T21:17:22.132205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:37:26.419533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139710+0000","last_change":"2023-10-10T21:17:21.104091+0000","last_active":"2023-10-10T21:17:22.139710+0000","last_peered":"2023-10-10T21:17:22.139710+0000","last_clean":"2023-10-10T21:17:22.139710+0000","last_became_active":"2023-10-10T21:17:21.103772+0000","last_became_peered":"2023-10-10T21:17:21.103772+0000","last_unstale":"2023-10-10T21:17:22.139710+0000","last_undegraded":"2023-10-10T21:17:22.139710+0000","last_fullsized":"2023-10-10T21:17:22.139710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:17:09.167468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092308+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:41.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120843+0000","last_change":"2023-10-10T21:17:22.118158+0000","last_active":"2023-10-10T21:17:22.120843+0000","last_peered":"2023-10-10T21:17:22.120843+0000","last_clean":"2023-10-10T21:17:22.120843+0000","last_became_active":"2023-10-10T21:17:22.117833+0000","last_became_peered":"2023-10-10T21:17:22.117833+0000","last_unstale":"2023-10-10T21:17:22.120843+0000","last_undegraded":"2023-10-10T21:17:22.120843+0000","last_fullsized":"2023-10-10T21:17:22.120843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:02:00.520880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.095806+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:52:34.309774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.095640+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118476+0000","last_change":"2023-10-10T21:17:21.111763+0000","last_active":"2023-10-10T21:17:22.118476+0000","last_peered":"2023-10-10T21:17:22.118476+0000","last_clean":"2023-10-10T21:17:22.118476+0000","last_became_active":"2023-10-10T21:17:21.111518+0000","last_became_peered":"2023-10-10T21:17:21.111518+0000","last_unstale":"2023-10-10T21:17:22.118476+0000","last_undegraded":"2023-10-10T21:17:22.118476+0000","last_fullsized":"2023-10-10T21:17:22.118476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:01:00.565221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126465+0000","last_change":"2023-10-10T21:17:22.121020+0000","last_active":"2023-10-10T21:17:22.126465+0000","last_peered":"2023-10-10T21:17:22.126465+0000","last_clean":"2023-10-10T21:17:22.126465+0000","last_became_active":"2023-10-10T21:17:22.120556+0000","last_became_peered":"2023-10-10T21:17:22.120556+0000","last_unstale":"2023-10-10T21:17:22.126465+0000","last_undegraded":"2023-10-10T21:17:22.126465+0000","last_fullsized":"2023-10-10T21:17:22.126465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:18.893169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.095730+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.096848+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:41.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139085+0000","last_change":"2023-10-10T21:17:21.112845+0000","last_active":"2023-10-10T21:17:22.139085+0000","last_peered":"2023-10-10T21:17:22.139085+0000","last_clean":"2023-10-10T21:17:22.139085+0000","last_became_active":"2023-10-10T21:17:21.112572+0000","last_became_peered":"2023-10-10T21:17:21.112572+0000","last_unstale":"2023-10-10T21:17:22.139085+0000","last_undegraded":"2023-10-10T21:17:22.139085+0000","last_fullsized":"2023-10-10T21:17:22.139085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:25:28.217784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092119+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:45:05.277480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091663+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:29:17.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.097529+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:11:09.152293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139072+0000","last_change":"2023-10-10T21:17:21.109113+0000","last_active":"2023-10-10T21:17:22.139072+0000","last_peered":"2023-10-10T21:17:22.139072+0000","last_clean":"2023-10-10T21:17:22.139072+0000","last_became_active":"2023-10-10T21:17:21.106685+0000","last_became_peered":"2023-10-10T21:17:21.106685+0000","last_unstale":"2023-10-10T21:17:22.139072+0000","last_undegraded":"2023-10-10T21:17:22.139072+0000","last_fullsized":"2023-10-10T21:17:22.139072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:51:52.120571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139601+0000","last_change":"2023-10-10T21:17:21.112175+0000","last_active":"2023-10-10T21:17:22.139601+0000","last_peered":"2023-10-10T21:17:22.139601+0000","last_clean":"2023-10-10T21:17:22.139601+0000","last_became_active":"2023-10-10T21:17:21.111931+0000","last_became_peered":"2023-10-10T21:17:21.111931+0000","last_unstale":"2023-10-10T21:17:22.139601+0000","last_undegraded":"2023-10-10T21:17:22.139601+0000","last_fullsized":"2023-10-10T21:17:22.139601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:41.727455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125643+0000","last_change":"2023-10-10T21:17:22.122912+0000","last_active":"2023-10-10T21:17:22.125643+0000","last_peered":"2023-10-10T21:17:22.125643+0000","last_clean":"2023-10-10T21:17:22.125643+0000","last_became_active":"2023-10-10T21:17:22.122663+0000","last_became_peered":"2023-10-10T21:17:22.122663+0000","last_unstale":"2023-10-10T21:17:22.125643+0000","last_undegraded":"2023-10-10T21:17:22.125643+0000","last_fullsized":"2023-10-10T21:17:22.125643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:53:40.085195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091890+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:11:42.908611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.108547+0000","last_change":"2023-10-10T21:17:21.116009+0000","last_active":"2023-10-10T21:17:22.108547+0000","last_peered":"2023-10-10T21:17:22.108547+0000","last_clean":"2023-10-10T21:17:22.108547+0000","last_became_active":"2023-10-10T21:17:21.115764+0000","last_became_peered":"2023-10-10T21:17:21.115764+0000","last_unstale":"2023-10-10T21:17:22.108547+0000","last_undegraded":"2023-10-10T21:17:22.108547+0000","last_fullsized":"2023-10-10T21:17:22.108547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:11:09.152293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.141309+0000","last_change":"2023-10-10T21:17:21.109031+0000","last_active":"2023-10-10T21:17:22.141309+0000","last_peered":"2023-10-10T21:17:22.141309+0000","last_clean":"2023-10-10T21:17:22.141309+0000","last_became_active":"2023-10-10T21:17:21.108292+0000","last_became_peered":"2023-10-10T21:17:21.108292+0000","last_unstale":"2023-10-10T21:17:22.141309+0000","last_undegraded":"2023-10-10T21:17:22.141309+0000","last_fullsized":"2023-10-10T21:17:22.141309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:15:17.264995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129441+0000","last_change":"2023-10-10T21:17:22.126967+0000","last_active":"2023-10-10T21:17:22.129441+0000","last_peered":"2023-10-10T21:17:22.129441+0000","last_clean":"2023-10-10T21:17:22.129441+0000","last_became_active":"2023-10-10T21:17:22.126688+0000","last_became_peered":"2023-10-10T21:17:22.126688+0000","last_unstale":"2023-10-10T21:17:22.129441+0000","last_undegraded":"2023-10-10T21:17:22.129441+0000","last_fullsized":"2023-10-10T21:17:22.129441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:06:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104746+0000","last_change":"2023-10-10T21:17:21.107533+0000","last_active":"2023-10-10T21:17:22.104746+0000","last_peered":"2023-10-10T21:17:22.104746+0000","last_clean":"2023-10-10T21:17:22.104746+0000","last_became_active":"2023-10-10T21:17:21.107293+0000","last_became_peered":"2023-10-10T21:17:21.107293+0000","last_unstale":"2023-10-10T21:17:22.104746+0000","last_undegraded":"2023-10-10T21:17:22.104746+0000","last_fullsized":"2023-10-10T21:17:22.104746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:15.822758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123986+0000","last_change":"2023-10-10T21:17:22.121229+0000","last_active":"2023-10-10T21:17:22.123986+0000","last_peered":"2023-10-10T21:17:22.123986+0000","last_clean":"2023-10-10T21:17:22.123986+0000","last_became_active":"2023-10-10T21:17:22.120968+0000","last_became_peered":"2023-10-10T21:17:22.120968+0000","last_unstale":"2023-10-10T21:17:22.123986+0000","last_undegraded":"2023-10-10T21:17:22.123986+0000","last_fullsized":"2023-10-10T21:17:22.123986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:31:51.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091661+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:45.952790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140519+0000","last_change":"2023-10-10T21:17:21.116165+0000","last_active":"2023-10-10T21:17:22.140519+0000","last_peered":"2023-10-10T21:17:22.140519+0000","last_clean":"2023-10-10T21:17:22.140519+0000","last_became_active":"2023-10-10T21:17:21.115910+0000","last_became_peered":"2023-10-10T21:17:21.115910+0000","last_unstale":"2023-10-10T21:17:22.140519+0000","last_undegraded":"2023-10-10T21:17:22.140519+0000","last_fullsized":"2023-10-10T21:17:22.140519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:35:48.191005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110044+0000","last_change":"2023-10-10T21:17:21.107240+0000","last_active":"2023-10-10T21:17:22.110044+0000","last_peered":"2023-10-10T21:17:22.110044+0000","last_clean":"2023-10-10T21:17:22.110044+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.110044+0000","last_undegraded":"2023-10-10T21:17:22.110044+0000","last_fullsized":"2023-10-10T21:17:22.110044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:41.329697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126446+0000","last_change":"2023-10-10T21:17:22.120807+0000","last_active":"2023-10-10T21:17:22.126446+0000","last_peered":"2023-10-10T21:17:22.126446+0000","last_clean":"2023-10-10T21:17:22.126446+0000","last_became_active":"2023-10-10T21:17:22.120231+0000","last_became_peered":"2023-10-10T21:17:22.120231+0000","last_unstale":"2023-10-10T21:17:22.126446+0000","last_undegraded":"2023-10-10T21:17:22.126446+0000","last_fullsized":"2023-10-10T21:17:22.126446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:39.969510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091653+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:44:18.353609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.138890+0000","last_change":"2023-10-10T21:17:22.135588+0000","last_active":"2023-10-10T21:17:22.138890+0000","last_peered":"2023-10-10T21:17:22.138890+0000","last_clean":"2023-10-10T21:17:22.138890+0000","last_became_active":"2023-10-10T21:17:22.135336+0000","last_became_peered":"2023-10-10T21:17:22.135336+0000","last_unstale":"2023-10-10T21:17:22.138890+0000","last_undegraded":"2023-10-10T21:17:22.138890+0000","last_fullsized":"2023-10-10T21:17:22.138890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:54.513628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.091732+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:52:34.309774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127696+0000","last_change":"2023-10-10T21:17:22.126342+0000","last_active":"2023-10-10T21:17:22.127696+0000","last_peered":"2023-10-10T21:17:22.127696+0000","last_clean":"2023-10-10T21:17:22.127696+0000","last_became_active":"2023-10-10T21:17:22.126073+0000","last_became_peered":"2023-10-10T21:17:22.126073+0000","last_unstale":"2023-10-10T21:17:22.127696+0000","last_undegraded":"2023-10-10T21:17:22.127696+0000","last_fullsized":"2023-10-10T21:17:22.127696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:16.335987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104748+0000","last_change":"2023-10-10T21:17:21.114873+0000","last_active":"2023-10-10T21:17:22.104748+0000","last_peered":"2023-10-10T21:17:22.104748+0000","last_clean":"2023-10-10T21:17:22.104748+0000","last_became_active":"2023-10-10T21:17:21.114212+0000","last_became_peered":"2023-10-10T21:17:21.114212+0000","last_unstale":"2023-10-10T21:17:22.104748+0000","last_undegraded":"2023-10-10T21:17:22.104748+0000","last_fullsized":"2023-10-10T21:17:22.104748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:36.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:17:21.088145+0000","last_change":"2023-10-10T21:17:21.088145+0000","last_active":"2023-10-10T21:17:21.088145+0000","last_peered":"2023-10-10T21:17:21.088145+0000","last_clean":"2023-10-10T21:17:21.088145+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:21.088145+0000","last_undegraded":"2023-10-10T21:17:21.088145+0000","last_fullsized":"2023-10-10T21:17:21.088145+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.096282+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:11:42.908611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127572+0000","last_change":"2023-10-10T21:17:22.121370+0000","last_active":"2023-10-10T21:17:22.127572+0000","last_peered":"2023-10-10T21:17:22.127572+0000","last_clean":"2023-10-10T21:17:22.127572+0000","last_became_active":"2023-10-10T21:17:22.117631+0000","last_became_peered":"2023-10-10T21:17:22.117631+0000","last_unstale":"2023-10-10T21:17:22.127572+0000","last_undegraded":"2023-10-10T21:17:22.127572+0000","last_fullsized":"2023-10-10T21:17:22.127572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:09:00.391451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104781+0000","last_change":"2023-10-10T21:17:21.107269+0000","last_active":"2023-10-10T21:17:22.104781+0000","last_peered":"2023-10-10T21:17:22.104781+0000","last_clean":"2023-10-10T21:17:22.104781+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.104781+0000","last_undegraded":"2023-10-10T21:17:22.104781+0000","last_fullsized":"2023-10-10T21:17:22.104781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:23:20.098680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118254+0000","last_change":"2023-10-10T21:17:22.113811+0000","last_active":"2023-10-10T21:17:22.118254+0000","last_peered":"2023-10-10T21:17:22.118254+0000","last_clean":"2023-10-10T21:17:22.118254+0000","last_became_active":"2023-10-10T21:17:22.113536+0000","last_became_peered":"2023-10-10T21:17:22.113536+0000","last_unstale":"2023-10-10T21:17:22.118254+0000","last_undegraded":"2023-10-10T21:17:22.118254+0000","last_fullsized":"2023-10-10T21:17:22.118254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:46.588070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.112091+0000","last_change":"2023-10-10T21:17:21.115869+0000","last_active":"2023-10-10T21:17:22.112091+0000","last_peered":"2023-10-10T21:17:22.112091+0000","last_clean":"2023-10-10T21:17:22.112091+0000","last_became_active":"2023-10-10T21:17:21.115625+0000","last_became_peered":"2023-10-10T21:17:21.115625+0000","last_unstale":"2023-10-10T21:17:22.112091+0000","last_undegraded":"2023-10-10T21:17:22.112091+0000","last_fullsized":"2023-10-10T21:17:22.112091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:14.597592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129353+0000","last_change":"2023-10-10T21:17:22.126892+0000","last_active":"2023-10-10T21:17:22.129353+0000","last_peered":"2023-10-10T21:17:22.129353+0000","last_clean":"2023-10-10T21:17:22.129353+0000","last_became_active":"2023-10-10T21:17:22.126627+0000","last_became_peered":"2023-10-10T21:17:22.126627+0000","last_unstale":"2023-10-10T21:17:22.129353+0000","last_undegraded":"2023-10-10T21:17:22.129353+0000","last_fullsized":"2023-10-10T21:17:22.129353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:39:59.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:17:20.083505+0000","last_change":"2023-10-10T21:17:20.092505+0000","last_active":"2023-10-10T21:17:20.083505+0000","last_peered":"2023-10-10T21:17:20.083505+0000","last_clean":"2023-10-10T21:17:20.083505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:17:20.083505+0000","last_undegraded":"2023-10-10T21:17:20.083505+0000","last_fullsized":"2023-10-10T21:17:20.083505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:32:47.406455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":368,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-10T21:17:18.530637+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:17:18.530637+0000","last_peered":"2023-10-10T21:17:18.530637+0000","last_clean":"2023-10-10T21:17:18.530637+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:17:18.530637+0000","last_undegraded":"2023-10-10T21:17:18.530637+0000","last_fullsized":"2023-10-10T21:17:18.530637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":610,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542327,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302880,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068960,"statfs":{"total":96636764160,"available":96326615040,"internally_reserved":0,"allocated":1531904,"data_stored":1035452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.55800000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.89600000000000002,"5min":1.014,"15min":1.1859999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.47499999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75,"15min":0.73699999999999999},"min":{"1min":0.629,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0069999999999999,"15min":1.123},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.61599999999999999},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.624},"min":{"1min":0.42599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78000000000000003,"5min":0.98299999999999998,"15min":1.022},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.67400000000000004},"min":{"1min":0.499,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":0.82899999999999996,"5min":0.90600000000000003,"15min":0.98899999999999999},"last":0.495}]},{"osd":6,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.52600000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.625,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.135},"last":0.58599999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542326,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":445084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.59199999999999997,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.747,"15min":0.75},"min":{"1min":0.626,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.143},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.65700000000000003,"5min":0.497,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":1.073,"15min":1.073},"last":0.64100000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.98199999999999998,"15min":1.151},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.58999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97799999999999998,"15min":1.01},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.74199999999999999,"15min":0.73199999999999998},"min":{"1min":0.621,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83699999999999997,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.1200000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.62,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72099999999999997,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.34799999999999998},"max":{"1min":0.86499999999999999,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.755}]},{"osd":5,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.87,"5min":1.022,"15min":1.345},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.879,"5min":1.048,"15min":1.238},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":0.86099999999999999,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0289999999999999,"15min":1.202},"last":0.84199999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542327,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302340,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069500,"statfs":{"total":96636764160,"available":96327168000,"internally_reserved":0,"allocated":978944,"data_stored":465656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32600000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66300000000000003,"5min":0.79700000000000004,"15min":1.258},"last":8.0839999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":1.964},"last":13.223000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.89300000000000002,"15min":1.4550000000000001},"last":2.254},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.44,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":2.085},"last":1.9019999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.84399999999999997,"15min":1.8919999999999999},"last":4.0060000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":2.117},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.48099999999999998},"max":{"1min":1.042,"5min":1.0509999999999999,"15min":2.052},"last":4.806},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.66400000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96999999999999997,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":3.9180000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.61499999999999999,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.0409999999999999,"15min":1.181},"last":6.968},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.46400000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":2.012},"last":13.130000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.60999999999999999,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":1.01,"5min":1.1240000000000001,"15min":2.25},"last":3.9569999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.72099999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":2.2999999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78800000000000003,"15min":0.78900000000000003},"min":{"1min":0.69199999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.04,"5min":1.1639999999999999,"15min":2.169},"last":12.026},{"interface":"front","average":{"1min":0.877,"5min":0.81799999999999995,"15min":0.82099999999999995},"min":{"1min":0.70999999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.05,"5min":1.149,"15min":1.1850000000000001},"last":3.7229999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073004,"statfs":{"total":96636764160,"available":96330756096,"internally_reserved":0,"allocated":1585152,"data_stored":1058024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.67200000000000004,"5min":0.74299999999999999,"15min":1.4890000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.879,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.44}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.42499999999999999,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":1.706},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.874,"15min":1.2909999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.101,"15min":1.2270000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95599999999999996,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.008,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":1.0980000000000001,"5min":1.119,"15min":1.3899999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83099999999999996,"15min":0.82799999999999996},"min":{"1min":0.65700000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0640000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.83799999999999997},"min":{"1min":0.66700000000000004,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0109999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.73999999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.1439999999999999,"15min":1.363},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.64400000000000002,"5min":0.58799999999999997,"15min":0.54200000000000004},"max":{"1min":1.024,"5min":1.165,"15min":1.3300000000000001},"last":0.78600000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.35699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.73399999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.495}]},{"osd":1,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91200000000000003,"5min":1.157,"15min":1.3220000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.63200000000000001,"5min":0.53500000000000003,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":1.26,"15min":1.2849999999999999},"last":0.96899999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.65800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98199999999999998,"5min":2.21,"15min":2.21},"last":1.008},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78200000000000003,"15min":0.78300000000000003},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.165,"15min":1.268},"last":0.92600000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.67800000000000005,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":1.018,"5min":1.151,"15min":1.3400000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.65600000000000003,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":1.0349999999999999,"15min":1.3759999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81000000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.0029999999999999,"5min":1.716,"15min":1.716},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.81200000000000006},"min":{"1min":0.71699999999999997,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.97799999999999998,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509624,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.442,"15min":0.45800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.66400000000000003,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.495,"15min":0.499},"min":{"1min":0.42799999999999999,"5min":0.33700000000000002,"15min":0.28799999999999998},"max":{"1min":0.65100000000000002,"5min":0.73399999999999999,"15min":1.544},"last":0.35999999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.40899999999999997,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":1.6759999999999999},"last":0.315},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.45800000000000002,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.432}]},{"osd":2,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.7070000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.38700000000000001},"max":{"1min":0.77700000000000002,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.63100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96499999999999997,"5min":1.054,"15min":1.6359999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76700000000000002,"15min":0.78600000000000003},"min":{"1min":0.61199999999999999,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.016,"5min":1.1859999999999999,"15min":1.246},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.65000000000000002,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":0.996,"5min":1.1240000000000001,"15min":1.262},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76800000000000002,"15min":0.77800000000000002},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":0.97999999999999998,"5min":1.2250000000000001,"15min":1.579},"last":0.64100000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61399999999999999,"5min":0.502,"15min":0.47099999999999997},"max":{"1min":1.05,"5min":1.27,"15min":1.27},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.68400000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.224,"15min":1.224},"last":0.624}]},{"osd":7,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":0.98999999999999999,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.81499999999999995},"min":{"1min":0.66000000000000003,"5min":0.53500000000000003,"15min":0.51300000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.3200000000000001},"last":0.501}]}]},{"osd":4,"up_from":14,"seq":60129542328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306396,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065444,"statfs":{"total":96636764160,"available":96323014656,"internally_reserved":0,"allocated":937984,"data_stored":445084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.92000000000000004,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.95099999999999996,"5min":0.96299999999999997,"15min":1.758},"last":0.502}]},{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.1359999999999999,"15min":1.47},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":0.98299999999999998,"15min":1.929},"last":0.67000000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.6890000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.98399999999999999,"5min":1.3100000000000001,"15min":1.468},"last":0.64500000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.046,"5min":1.0820000000000001,"15min":1.397},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":1.385,"15min":1.385},"last":0.58999999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79700000000000004,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.874,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":1.0609999999999999,"15min":1.464},"last":0.75800000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.83599999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542326,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":937984,"data_stored":445084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.52300000000000002,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.371},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.56000000000000005,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":0.90100000000000002,"5min":0.93300000000000005,"15min":3.895},"last":0.442},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73599999999999999,"15min":0.78000000000000003},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.71599999999999997},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.97499999999999998,"5min":1.01,"15min":1.2889999999999999},"last":0.5},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":1.3540000000000001},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76000000000000001,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.748},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.59099999999999997,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.83499999999999996}]},{"osd":4,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.496,"15min":4.2789999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.80200000000000005},"min":{"1min":0.56699999999999995,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.84699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.51200000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":2.8900000000000001},"last":0.872},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.96099999999999997,"5min":1.077,"15min":3.9420000000000002},"last":0.82199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:17:27.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-10T21:17:27.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-10T21:17:27.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-10T21:17:27.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-10T21:17:27.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-10T21:17:27.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-10T21:17:27.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-10T21:17:27.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-10T21:17:27.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-10T21:17:27.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-10T21:17:27.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-10T21:17:27.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-10T21:17:27.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-10T21:17:27.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-10T21:17:27.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-10-10T21:17:27.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.092346+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:09:30.424526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:17:27.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-10T21:17:27.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.097427+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:09:30.424526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:17:27.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-10T21:17:27.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-10-10T21:17:27.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.092308+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:06:41.542576+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:17:27.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-10T21:17:27.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.095806+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:52:34.309774+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:17:27.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-10T21:17:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-10-10T21:17:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.095640+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:17:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-10T21:17:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-10-10T21:17:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.095730+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:17:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-10T21:17:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-10T21:17:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.096848+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:06:41.542576+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:17:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-10T21:17:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-10T21:17:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-10T21:17:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.092119+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:45:05.277480+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:17:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-10T21:17:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-10-10T21:17:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.091663+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:29:17.901112+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:17:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-10T21:17:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-10-10T21:17:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.097529+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:11:09.152293+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:17:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-10T21:17:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-10T21:17:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-10-10T21:17:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.091890+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:11:42.908611+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:17:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-10T21:17:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-10T21:17:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-10-10T21:17:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.091661+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:33:45.952790+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:17:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-10T21:17:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-10T21:17:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-10T21:17:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.091653+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T07:44:18.353609+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:17:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-10-10T21:17:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.091732+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:52:34.309774+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:17:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-10T21:17:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:17:21.088145+0000', 'last_change': '2023-10-10T21:17:21.088145+0000', 'last_active': '2023-10-10T21:17:21.088145+0000', 'last_peered': '2023-10-10T21:17:21.088145+0000', 'last_clean': '2023-10-10T21:17:21.088145+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:21.088145+0000', 'last_undegraded': '2023-10-10T21:17:21.088145+0000', 'last_fullsized': '2023-10-10T21:17:21.088145+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:21.088145+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:17:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-10T21:17:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.096282+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:11:42.908611+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:17:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-10T21:17:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:17:20.083505+0000', 'last_change': '2023-10-10T21:17:20.092505+0000', 'last_active': '2023-10-10T21:17:20.083505+0000', 'last_peered': '2023-10-10T21:17:20.083505+0000', 'last_clean': '2023-10-10T21:17:20.083505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:17:20.083505+0000', 'last_undegraded': '2023-10-10T21:17:20.083505+0000', 'last_fullsized': '2023-10-10T21:17:20.083505+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'last_clean_scrub_stamp': '2023-10-10T21:17:20.083505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:32:47.406455+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:17:27.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T21:17:27.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.583+0000 7fd42b7ff700 1 Processor -- start 2023-10-10T21:17:27.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.583+0000 7fd42b7ff700 1 -- start start 2023-10-10T21:17:27.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42b7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd424156510 0x7fd4240ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4240acd40 0x7fd4241568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42b7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd424153f10 con 0x7fd424156e20 2023-10-10T21:17:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42b7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240ad9d0 con 0x7fd424156510 2023-10-10T21:17:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240aed00 con 0x7fd4240acd40 2023-10-10T21:17:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42959b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd424156510 0x7fd4240ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42959b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd424156510 0x7fd4240ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58068/0 (socket says 172.21.15.154:58068) 2023-10-10T21:17:27.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42959b700 1 -- 172.21.15.154:0/889742912 learned_addr learned my addr 172.21.15.154:0/889742912 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd428d9a700 1 --2- 172.21.15.154:0/889742912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4240acd40 0x7fd4241568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42959b700 1 -- 172.21.15.154:0/889742912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4240acd40 msgr2=0x7fd4241568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42959b700 1 --2- 172.21.15.154:0/889742912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4240acd40 0x7fd4241568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42959b700 1 -- 172.21.15.154:0/889742912 >> v1:172.21.15.179:6789/0 conn(0x7fd424156e20 legacy=0x7fd4240ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.585+0000 7fd42959b700 1 -- 172.21.15.154:0/889742912 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240af800 con 0x7fd424156510 2023-10-10T21:17:27.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.586+0000 7fd42959b700 1 --2- 172.21.15.154:0/889742912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd424156510 0x7fd4240ac800 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd4200099b0 tx=0x7fd420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc111645bb8435b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:27.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.586+0000 7fd41bfff700 1 -- 172.21.15.154:0/889742912 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42000b860 con 0x7fd424156510 2023-10-10T21:17:27.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.586+0000 7fd41bfff700 1 -- 172.21.15.154:0/889742912 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42000b9c0 con 0x7fd424156510 2023-10-10T21:17:27.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.586+0000 7fd41bfff700 1 -- 172.21.15.154:0/889742912 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42000bd60 con 0x7fd424156510 2023-10-10T21:17:27.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.586+0000 7fd42b7ff700 1 -- 172.21.15.154:0/889742912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd424156510 msgr2=0x7fd4240ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.586+0000 7fd42b7ff700 1 --2- 172.21.15.154:0/889742912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd424156510 0x7fd4240ac800 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd4200099b0 tx=0x7fd420009250 comp rx=0 tx=0).stop 2023-10-10T21:17:27.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.587+0000 7fd42b7ff700 1 -- 172.21.15.154:0/889742912 shutdown_connections 2023-10-10T21:17:27.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.587+0000 7fd42b7ff700 1 --2- 172.21.15.154:0/889742912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd424156510 0x7fd4240ac800 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.587+0000 7fd42b7ff700 1 --2- 172.21.15.154:0/889742912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4240acd40 0x7fd4241568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.587+0000 7fd42b7ff700 1 -- 172.21.15.154:0/889742912 >> 172.21.15.154:0/889742912 conn(0x7fd42406a310 msgr2=0x7fd4240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.587+0000 7fd42b7ff700 1 -- 172.21.15.154:0/889742912 shutdown_connections 2023-10-10T21:17:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.587+0000 7fd42b7ff700 1 -- 172.21.15.154:0/889742912 wait complete. 2023-10-10T21:17:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.588+0000 7fd42b7ff700 1 Processor -- start 2023-10-10T21:17:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.588+0000 7fd42b7ff700 1 -- start start 2023-10-10T21:17:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.589+0000 7fd42b7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4240acd40 0x7fd42415a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.589+0000 7fd42b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd424156510 0x7fd42415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.589+0000 7fd42b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd424156e20 0x7fd424167b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.589+0000 7fd42b7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424168ed0 con 0x7fd4240acd40 2023-10-10T21:17:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.589+0000 7fd42b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4241691b0 con 0x7fd424156510 2023-10-10T21:17:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.589+0000 7fd42b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd424169490 con 0x7fd424156e20 2023-10-10T21:17:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.589+0000 7fd42959b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4240acd40 0x7fd42415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.589+0000 7fd42959b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4240acd40 0x7fd42415a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58082/0 (socket says 172.21.15.154:58082) 2023-10-10T21:17:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.589+0000 7fd42959b700 1 -- 172.21.15.154:0/1963831893 learned_addr learned my addr 172.21.15.154:0/1963831893 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd428d9a700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd424156510 0x7fd42415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd429d9c700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd424156e20 0x7fd424167b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd42959b700 1 -- 172.21.15.154:0/1963831893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd424156e20 msgr2=0x7fd424167b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd42959b700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd424156e20 0x7fd424167b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd42959b700 1 -- 172.21.15.154:0/1963831893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd424156510 msgr2=0x7fd42415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd42959b700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd424156510 0x7fd42415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd42959b700 1 -- 172.21.15.154:0/1963831893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200094f0 con 0x7fd4240acd40 2023-10-10T21:17:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd428d9a700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd424156510 0x7fd42415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd42959b700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4240acd40 0x7fd42415a480 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd4240cd610 tx=0x7fd420017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd4197fa700 1 -- 172.21.15.154:0/1963831893 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420024440 con 0x7fd4240acd40 2023-10-10T21:17:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd4197fa700 1 -- 172.21.15.154:0/1963831893 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4200245a0 con 0x7fd4240acd40 2023-10-10T21:17:27.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd424169770 con 0x7fd4240acd40 2023-10-10T21:17:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.590+0000 7fd4197fa700 1 -- 172.21.15.154:0/1963831893 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420024940 con 0x7fd4240acd40 2023-10-10T21:17:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.591+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42415b0c0 con 0x7fd4240acd40 2023-10-10T21:17:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.591+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42404c3c0 con 0x7fd4240acd40 2023-10-10T21:17:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.592+0000 7fd4197fa700 1 -- 172.21.15.154:0/1963831893 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd42001a420 con 0x7fd4240acd40 2023-10-10T21:17:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.593+0000 7fd4197fa700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd408066f30 0x7fd4080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.593+0000 7fd4197fa700 1 -- 172.21.15.154:0/1963831893 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fd420086460 con 0x7fd4240acd40 2023-10-10T21:17:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.594+0000 7fd428d9a700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd408066f30 0x7fd4080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.594+0000 7fd428d9a700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd408066f30 0x7fd4080693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4240a6d10 tx=0x7fd414008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.598+0000 7fd4197fa700 1 -- 172.21.15.154:0/1963831893 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4200535c0 con 0x7fd4240acd40 2023-10-10T21:17:27.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.867+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd4240678d0 con 0x7fd4240acd40 2023-10-10T21:17:27.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.867+0000 7fd4197fa700 1 -- 172.21.15.154:0/1963831893 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1177 (secure 0 0 0) 0x7fd420056be0 con 0x7fd4240acd40 2023-10-10T21:17:27.869 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:27.869 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":932,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":52},{"state_name":"unknown","count":29},{"state_name":"creating+peering","count":16}],"num_pgs":97,"num_pools":3,"num_objects":11,"data_bytes":590978,"bytes_used":2486202368,"bytes_avail":770607910912,"bytes_total":773094113280,"unknown_pgs_ratio":0.29896906018257141,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":1408,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":30,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6019}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-10T21:16:29.405712+0000","services":{}},"progress_events":{}} 2023-10-10T21:17:27.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd408066f30 msgr2=0x7fd4080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd408066f30 0x7fd4080693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4240a6d10 tx=0x7fd414008040 comp rx=0 tx=0).stop 2023-10-10T21:17:27.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4240acd40 msgr2=0x7fd42415a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:27.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4240acd40 0x7fd42415a480 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd4240cd610 tx=0x7fd420017000 comp rx=0 tx=0).stop 2023-10-10T21:17:27.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 shutdown_connections 2023-10-10T21:17:27.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd424156e20 0x7fd424167b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4240acd40 0x7fd42415a480 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd408066f30 0x7fd4080693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 --2- 172.21.15.154:0/1963831893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd424156510 0x7fd42415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:27.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.869+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 >> 172.21.15.154:0/1963831893 conn(0x7fd42406a310 msgr2=0x7fd4240afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:27.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.870+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 shutdown_connections 2023-10-10T21:17:27.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:27.870+0000 7fd42b7ff700 1 -- 172.21.15.154:0/1963831893 wait complete. 2023-10-10T21:17:27.888 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T21:17:27.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:17:28.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.069+0000 7f99ba1ff700 1 Processor -- start 2023-10-10T21:17:28.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.069+0000 7f99ba1ff700 1 -- start start 2023-10-10T21:17:28.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.070+0000 7f99ba1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f99b4155c10 0x7f99b4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.070+0000 7f99ba1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99b40ac230 0x7f99b40ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.070+0000 7f99ba1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b40ad930 con 0x7f99b41568a0 2023-10-10T21:17:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.070+0000 7f99ba1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40acd20 con 0x7f99b40ac230 2023-10-10T21:17:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.070+0000 7f99ba1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40ad000 con 0x7f99b4155c10 2023-10-10T21:17:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99abfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99b40ac230 0x7f99b40ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:28.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99abfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99b40ac230 0x7f99b40ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58092/0 (socket says 172.21.15.154:58092) 2023-10-10T21:17:28.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99abfff700 1 -- 172.21.15.154:0/2450605002 learned_addr learned my addr 172.21.15.154:0/2450605002 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:28.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99b37fe700 1 --2- 172.21.15.154:0/2450605002 >> v2:172.21.15.179:3300/0 conn(0x7f99b4155c10 0x7f99b4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:28.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99abfff700 1 -- 172.21.15.154:0/2450605002 >> v2:172.21.15.179:3300/0 conn(0x7f99b4155c10 msgr2=0x7f99b4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:28.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99abfff700 1 --2- 172.21.15.154:0/2450605002 >> v2:172.21.15.179:3300/0 conn(0x7f99b4155c10 0x7f99b4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99abfff700 1 -- 172.21.15.154:0/2450605002 >> v1:172.21.15.179:6789/0 conn(0x7f99b41568a0 legacy=0x7f99b4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99abfff700 1 -- 172.21.15.154:0/2450605002 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40ad2e0 con 0x7f99b40ac230 2023-10-10T21:17:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99b37fe700 1 --2- 172.21.15.154:0/2450605002 >> v2:172.21.15.179:3300/0 conn(0x7f99b4155c10 0x7f99b4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.071+0000 7f99abfff700 1 --2- 172.21.15.154:0/2450605002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b40ac230 0x7f99b40ac6d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f99b4063d40 tx=0x7f999c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494d0db81e4c70f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99b2ffd700 1 -- 172.21.15.154:0/2450605002 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c00dc50 con 0x7f99b40ac230 2023-10-10T21:17:28.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99b2ffd700 1 -- 172.21.15.154:0/2450605002 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c00ddb0 con 0x7f99b40ac230 2023-10-10T21:17:28.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99b2ffd700 1 -- 172.21.15.154:0/2450605002 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0196d0 con 0x7f99b40ac230 2023-10-10T21:17:28.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99ba1ff700 1 -- 172.21.15.154:0/2450605002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b40ac230 msgr2=0x7f99b40ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:28.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99ba1ff700 1 --2- 172.21.15.154:0/2450605002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b40ac230 0x7f99b40ac6d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f99b4063d40 tx=0x7f999c00b4f0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99ba1ff700 1 -- 172.21.15.154:0/2450605002 shutdown_connections 2023-10-10T21:17:28.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99ba1ff700 1 --2- 172.21.15.154:0/2450605002 >> v2:172.21.15.179:3300/0 conn(0x7f99b4155c10 0x7f99b4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99ba1ff700 1 --2- 172.21.15.154:0/2450605002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b40ac230 0x7f99b40ac6d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99ba1ff700 1 -- 172.21.15.154:0/2450605002 >> 172.21.15.154:0/2450605002 conn(0x7f99b406a320 msgr2=0x7f99b40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99ba1ff700 1 -- 172.21.15.154:0/2450605002 shutdown_connections 2023-10-10T21:17:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.072+0000 7f99ba1ff700 1 -- 172.21.15.154:0/2450605002 wait complete. 2023-10-10T21:17:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.074+0000 7f99ba1ff700 1 Processor -- start 2023-10-10T21:17:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.074+0000 7f99ba1ff700 1 -- start start 2023-10-10T21:17:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99ba1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99b40ac230 0x7f99b415e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99ba1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99b4155c10 0x7f99b40aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99ba1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b41568a0 0x7f99b40aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99ba1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4150b90 con 0x7f99b41568a0 2023-10-10T21:17:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99ba1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b415a340 con 0x7f99b4155c10 2023-10-10T21:17:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99ba1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b415a590 con 0x7f99b40ac230 2023-10-10T21:17:28.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b41568a0 0x7f99b40aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:28.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b41568a0 0x7f99b40aa610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58108/0 (socket says 172.21.15.154:58108) 2023-10-10T21:17:28.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99b3fff700 1 -- 172.21.15.154:0/3907846426 learned_addr learned my addr 172.21.15.154:0/3907846426 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:28.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99abfff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99b4155c10 0x7f99b40aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:28.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99b37fe700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99b40ac230 0x7f99b415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:28.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99b3fff700 1 -- 172.21.15.154:0/3907846426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99b40ac230 msgr2=0x7f99b415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:28.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99b3fff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99b40ac230 0x7f99b415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99b3fff700 1 -- 172.21.15.154:0/3907846426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99b4155c10 msgr2=0x7f99b40aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:28.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99b3fff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99b4155c10 0x7f99b40aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.075+0000 7f99b3fff700 1 -- 172.21.15.154:0/3907846426 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c00b790 con 0x7f99b41568a0 2023-10-10T21:17:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.076+0000 7f99b3fff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b41568a0 0x7f99b40aa610 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c840 tx=0x7f99ac001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.076+0000 7f99ab7fe700 1 -- 172.21.15.154:0/3907846426 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac012630 con 0x7f99b41568a0 2023-10-10T21:17:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.076+0000 7f99ab7fe700 1 -- 172.21.15.154:0/3907846426 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac0127b0 con 0x7f99b41568a0 2023-10-10T21:17:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.076+0000 7f99ab7fe700 1 -- 172.21.15.154:0/3907846426 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac012b70 con 0x7f99b41568a0 2023-10-10T21:17:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.076+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b415a870 con 0x7f99b41568a0 2023-10-10T21:17:28.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.076+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b415ae30 con 0x7f99b41568a0 2023-10-10T21:17:28.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.077+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b415b050 con 0x7f99b41568a0 2023-10-10T21:17:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.078+0000 7f99ab7fe700 1 -- 172.21.15.154:0/3907846426 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99ac003030 con 0x7f99b41568a0 2023-10-10T21:17:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.079+0000 7f99ab7fe700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.079+0000 7f99ab7fe700 1 -- 172.21.15.154:0/3907846426 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f99ac084570 con 0x7f99b41568a0 2023-10-10T21:17:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.079+0000 7f99b37fe700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.080+0000 7f99b37fe700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9994066f30 0x7f99940693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99a4006f00 tx=0x7f99a4008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.083+0000 7f99ab7fe700 1 -- 172.21.15.154:0/3907846426 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99ac0550e0 con 0x7f99b41568a0 2023-10-10T21:17:28.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.271+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99b404c3c0 con 0x7f9994066f30 2023-10-10T21:17:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.280+0000 7f99ab7fe700 1 -- 172.21.15.154:0/3907846426 <== mgr.6063 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289026 (secure 0 0 0) 0x7f99b404c3c0 con 0x7f9994066f30 2023-10-10T21:17:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:28.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9994066f30 msgr2=0x7f99940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:28.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9994066f30 0x7f99940693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99a4006f00 tx=0x7f99a4008040 comp rx=0 tx=0).stop 2023-10-10T21:17:28.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b41568a0 msgr2=0x7f99b40aa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:28.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b41568a0 0x7f99b40aa610 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c840 tx=0x7f99ac001670 comp rx=0 tx=0).stop 2023-10-10T21:17:28.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 shutdown_connections 2023-10-10T21:17:28.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b41568a0 0x7f99b40aa610 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99b40ac230 0x7f99b415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 --2- 172.21.15.154:0/3907846426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99b4155c10 0x7f99b40aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 >> 172.21.15.154:0/3907846426 conn(0x7f99b406a320 msgr2=0x7f99b4154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 shutdown_connections 2023-10-10T21:17:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:28.284+0000 7f99ba1ff700 1 -- 172.21.15.154:0/3907846426 wait complete. 2023-10-10T21:17:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:17:28.303 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-10T21:17:27.904648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432200,"kb_used_data":8840,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752542520,"statfs":{"total":773094113280,"available":770603540480,"internally_reserved":0,"allocated":9052160,"data_stored":4909876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.812673"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120312+0000","last_change":"2023-10-10T21:17:22.115843+0000","last_active":"2023-10-10T21:17:22.120312+0000","last_peered":"2023-10-10T21:17:22.120312+0000","last_clean":"2023-10-10T21:17:22.120312+0000","last_became_active":"2023-10-10T21:17:22.115575+0000","last_became_peered":"2023-10-10T21:17:22.115575+0000","last_unstale":"2023-10-10T21:17:22.120312+0000","last_undegraded":"2023-10-10T21:17:22.120312+0000","last_fullsized":"2023-10-10T21:17:22.120312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:44.446813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130785+0000","last_change":"2023-10-10T21:17:22.128294+0000","last_active":"2023-10-10T21:17:22.130785+0000","last_peered":"2023-10-10T21:17:22.130785+0000","last_clean":"2023-10-10T21:17:22.130785+0000","last_became_active":"2023-10-10T21:17:22.128005+0000","last_became_peered":"2023-10-10T21:17:22.128005+0000","last_unstale":"2023-10-10T21:17:22.130785+0000","last_undegraded":"2023-10-10T21:17:22.130785+0000","last_fullsized":"2023-10-10T21:17:22.130785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:40:31.293324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.135261+0000","last_change":"2023-10-10T21:17:22.130059+0000","last_active":"2023-10-10T21:17:22.135261+0000","last_peered":"2023-10-10T21:17:22.135261+0000","last_clean":"2023-10-10T21:17:22.135261+0000","last_became_active":"2023-10-10T21:17:22.129809+0000","last_became_peered":"2023-10-10T21:17:22.129809+0000","last_unstale":"2023-10-10T21:17:22.135261+0000","last_undegraded":"2023-10-10T21:17:22.135261+0000","last_fullsized":"2023-10-10T21:17:22.135261+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:13.761233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136448+0000","last_change":"2023-10-10T21:17:22.132183+0000","last_active":"2023-10-10T21:17:22.136448+0000","last_peered":"2023-10-10T21:17:22.136448+0000","last_clean":"2023-10-10T21:17:22.136448+0000","last_became_active":"2023-10-10T21:17:22.129309+0000","last_became_peered":"2023-10-10T21:17:22.129309+0000","last_unstale":"2023-10-10T21:17:22.136448+0000","last_undegraded":"2023-10-10T21:17:22.136448+0000","last_fullsized":"2023-10-10T21:17:22.136448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:48:45.097688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133303+0000","last_change":"2023-10-10T21:17:22.130045+0000","last_active":"2023-10-10T21:17:22.133303+0000","last_peered":"2023-10-10T21:17:22.133303+0000","last_clean":"2023-10-10T21:17:22.133303+0000","last_became_active":"2023-10-10T21:17:22.129693+0000","last_became_peered":"2023-10-10T21:17:22.129693+0000","last_unstale":"2023-10-10T21:17:22.133303+0000","last_undegraded":"2023-10-10T21:17:22.133303+0000","last_fullsized":"2023-10-10T21:17:22.133303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:46:57.495512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.131879+0000","last_change":"2023-10-10T21:17:22.130808+0000","last_active":"2023-10-10T21:17:22.131879+0000","last_peered":"2023-10-10T21:17:22.131879+0000","last_clean":"2023-10-10T21:17:22.131879+0000","last_became_active":"2023-10-10T21:17:22.130493+0000","last_became_peered":"2023-10-10T21:17:22.130493+0000","last_unstale":"2023-10-10T21:17:22.131879+0000","last_undegraded":"2023-10-10T21:17:22.131879+0000","last_fullsized":"2023-10-10T21:17:22.131879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:45:03.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130770+0000","last_change":"2023-10-10T21:17:22.128884+0000","last_active":"2023-10-10T21:17:22.130770+0000","last_peered":"2023-10-10T21:17:22.130770+0000","last_clean":"2023-10-10T21:17:22.130770+0000","last_became_active":"2023-10-10T21:17:22.128618+0000","last_became_peered":"2023-10-10T21:17:22.128618+0000","last_unstale":"2023-10-10T21:17:22.130770+0000","last_undegraded":"2023-10-10T21:17:22.130770+0000","last_fullsized":"2023-10-10T21:17:22.130770+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:57:05.794362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126358+0000","last_change":"2023-10-10T21:17:22.123593+0000","last_active":"2023-10-10T21:17:22.126358+0000","last_peered":"2023-10-10T21:17:22.126358+0000","last_clean":"2023-10-10T21:17:22.126358+0000","last_became_active":"2023-10-10T21:17:22.123331+0000","last_became_peered":"2023-10-10T21:17:22.123331+0000","last_unstale":"2023-10-10T21:17:22.126358+0000","last_undegraded":"2023-10-10T21:17:22.126358+0000","last_fullsized":"2023-10-10T21:17:22.126358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:32:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130155+0000","last_change":"2023-10-10T21:17:22.127917+0000","last_active":"2023-10-10T21:17:22.130155+0000","last_peered":"2023-10-10T21:17:22.130155+0000","last_clean":"2023-10-10T21:17:22.130155+0000","last_became_active":"2023-10-10T21:17:22.127535+0000","last_became_peered":"2023-10-10T21:17:22.127535+0000","last_unstale":"2023-10-10T21:17:22.130155+0000","last_undegraded":"2023-10-10T21:17:22.130155+0000","last_fullsized":"2023-10-10T21:17:22.130155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:42.714118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124611+0000","last_change":"2023-10-10T21:17:22.117278+0000","last_active":"2023-10-10T21:17:22.124611+0000","last_peered":"2023-10-10T21:17:22.124611+0000","last_clean":"2023-10-10T21:17:22.124611+0000","last_became_active":"2023-10-10T21:17:22.117007+0000","last_became_peered":"2023-10-10T21:17:22.117007+0000","last_unstale":"2023-10-10T21:17:22.124611+0000","last_undegraded":"2023-10-10T21:17:22.124611+0000","last_fullsized":"2023-10-10T21:17:22.124611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:45:07.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124875+0000","last_change":"2023-10-10T21:17:22.120210+0000","last_active":"2023-10-10T21:17:22.124875+0000","last_peered":"2023-10-10T21:17:22.124875+0000","last_clean":"2023-10-10T21:17:22.124875+0000","last_became_active":"2023-10-10T21:17:22.119950+0000","last_became_peered":"2023-10-10T21:17:22.119950+0000","last_unstale":"2023-10-10T21:17:22.124875+0000","last_undegraded":"2023-10-10T21:17:22.124875+0000","last_fullsized":"2023-10-10T21:17:22.124875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:18.967395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134404+0000","last_change":"2023-10-10T21:17:22.124351+0000","last_active":"2023-10-10T21:17:22.134404+0000","last_peered":"2023-10-10T21:17:22.134404+0000","last_clean":"2023-10-10T21:17:22.134404+0000","last_became_active":"2023-10-10T21:17:22.124076+0000","last_became_peered":"2023-10-10T21:17:22.124076+0000","last_unstale":"2023-10-10T21:17:22.134404+0000","last_undegraded":"2023-10-10T21:17:22.134404+0000","last_fullsized":"2023-10-10T21:17:22.134404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:02.566076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.121107+0000","last_change":"2023-10-10T21:17:22.117841+0000","last_active":"2023-10-10T21:17:22.121107+0000","last_peered":"2023-10-10T21:17:22.121107+0000","last_clean":"2023-10-10T21:17:22.121107+0000","last_became_active":"2023-10-10T21:17:22.117597+0000","last_became_peered":"2023-10-10T21:17:22.117597+0000","last_unstale":"2023-10-10T21:17:22.121107+0000","last_undegraded":"2023-10-10T21:17:22.121107+0000","last_fullsized":"2023-10-10T21:17:22.121107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:46.957429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123556+0000","last_change":"2023-10-10T21:17:22.118527+0000","last_active":"2023-10-10T21:17:22.123556+0000","last_peered":"2023-10-10T21:17:22.123556+0000","last_clean":"2023-10-10T21:17:22.123556+0000","last_became_active":"2023-10-10T21:17:22.118267+0000","last_became_peered":"2023-10-10T21:17:22.118267+0000","last_unstale":"2023-10-10T21:17:22.123556+0000","last_undegraded":"2023-10-10T21:17:22.123556+0000","last_fullsized":"2023-10-10T21:17:22.123556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:44:18.482531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123520+0000","last_change":"2023-10-10T21:17:22.118081+0000","last_active":"2023-10-10T21:17:22.123520+0000","last_peered":"2023-10-10T21:17:22.123520+0000","last_clean":"2023-10-10T21:17:22.123520+0000","last_became_active":"2023-10-10T21:17:22.117816+0000","last_became_peered":"2023-10-10T21:17:22.117816+0000","last_unstale":"2023-10-10T21:17:22.123520+0000","last_undegraded":"2023-10-10T21:17:22.123520+0000","last_fullsized":"2023-10-10T21:17:22.123520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:07.524278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130380+0000","last_change":"2023-10-10T21:17:22.129225+0000","last_active":"2023-10-10T21:17:22.130380+0000","last_peered":"2023-10-10T21:17:22.130380+0000","last_clean":"2023-10-10T21:17:22.130380+0000","last_became_active":"2023-10-10T21:17:22.128916+0000","last_became_peered":"2023-10-10T21:17:22.128916+0000","last_unstale":"2023-10-10T21:17:22.130380+0000","last_undegraded":"2023-10-10T21:17:22.130380+0000","last_fullsized":"2023-10-10T21:17:22.130380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:52.331235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125675+0000","last_change":"2023-10-10T21:17:22.122283+0000","last_active":"2023-10-10T21:17:22.125675+0000","last_peered":"2023-10-10T21:17:22.125675+0000","last_clean":"2023-10-10T21:17:22.125675+0000","last_became_active":"2023-10-10T21:17:22.122017+0000","last_became_peered":"2023-10-10T21:17:22.122017+0000","last_unstale":"2023-10-10T21:17:22.125675+0000","last_undegraded":"2023-10-10T21:17:22.125675+0000","last_fullsized":"2023-10-10T21:17:22.125675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:20.043886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126448+0000","last_change":"2023-10-10T21:17:22.119216+0000","last_active":"2023-10-10T21:17:22.126448+0000","last_peered":"2023-10-10T21:17:22.126448+0000","last_clean":"2023-10-10T21:17:22.126448+0000","last_became_active":"2023-10-10T21:17:22.118926+0000","last_became_peered":"2023-10-10T21:17:22.118926+0000","last_unstale":"2023-10-10T21:17:22.126448+0000","last_undegraded":"2023-10-10T21:17:22.126448+0000","last_fullsized":"2023-10-10T21:17:22.126448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:52.331235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.119814+0000","last_change":"2023-10-10T21:17:22.115157+0000","last_active":"2023-10-10T21:17:22.119814+0000","last_peered":"2023-10-10T21:17:22.119814+0000","last_clean":"2023-10-10T21:17:22.119814+0000","last_became_active":"2023-10-10T21:17:22.114892+0000","last_became_peered":"2023-10-10T21:17:22.114892+0000","last_unstale":"2023-10-10T21:17:22.119814+0000","last_undegraded":"2023-10-10T21:17:22.119814+0000","last_fullsized":"2023-10-10T21:17:22.119814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:27.875920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130792+0000","last_change":"2023-10-10T21:17:22.129274+0000","last_active":"2023-10-10T21:17:22.130792+0000","last_peered":"2023-10-10T21:17:22.130792+0000","last_clean":"2023-10-10T21:17:22.130792+0000","last_became_active":"2023-10-10T21:17:22.128901+0000","last_became_peered":"2023-10-10T21:17:22.128901+0000","last_unstale":"2023-10-10T21:17:22.130792+0000","last_undegraded":"2023-10-10T21:17:22.130792+0000","last_fullsized":"2023-10-10T21:17:22.130792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:44.298941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.144002+0000","last_change":"2023-10-10T21:17:22.139331+0000","last_active":"2023-10-10T21:17:22.144002+0000","last_peered":"2023-10-10T21:17:22.144002+0000","last_clean":"2023-10-10T21:17:22.144002+0000","last_became_active":"2023-10-10T21:17:22.139057+0000","last_became_peered":"2023-10-10T21:17:22.139057+0000","last_unstale":"2023-10-10T21:17:22.144002+0000","last_undegraded":"2023-10-10T21:17:22.144002+0000","last_fullsized":"2023-10-10T21:17:22.144002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:53.973755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125704+0000","last_change":"2023-10-10T21:17:22.122632+0000","last_active":"2023-10-10T21:17:22.125704+0000","last_peered":"2023-10-10T21:17:22.125704+0000","last_clean":"2023-10-10T21:17:22.125704+0000","last_became_active":"2023-10-10T21:17:22.122206+0000","last_became_peered":"2023-10-10T21:17:22.122206+0000","last_unstale":"2023-10-10T21:17:22.125704+0000","last_undegraded":"2023-10-10T21:17:22.125704+0000","last_fullsized":"2023-10-10T21:17:22.125704+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:49:14.111746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136254+0000","last_change":"2023-10-10T21:17:22.133079+0000","last_active":"2023-10-10T21:17:22.136254+0000","last_peered":"2023-10-10T21:17:22.136254+0000","last_clean":"2023-10-10T21:17:22.136254+0000","last_became_active":"2023-10-10T21:17:22.131464+0000","last_became_peered":"2023-10-10T21:17:22.131464+0000","last_unstale":"2023-10-10T21:17:22.136254+0000","last_undegraded":"2023-10-10T21:17:22.136254+0000","last_fullsized":"2023-10-10T21:17:22.136254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:28.435380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.121570+0000","last_change":"2023-10-10T21:17:22.117198+0000","last_active":"2023-10-10T21:17:22.121570+0000","last_peered":"2023-10-10T21:17:22.121570+0000","last_clean":"2023-10-10T21:17:22.121570+0000","last_became_active":"2023-10-10T21:17:22.116938+0000","last_became_peered":"2023-10-10T21:17:22.116938+0000","last_unstale":"2023-10-10T21:17:22.121570+0000","last_undegraded":"2023-10-10T21:17:22.121570+0000","last_fullsized":"2023-10-10T21:17:22.121570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:29:18.905751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.128015+0000","last_change":"2023-10-10T21:17:22.125884+0000","last_active":"2023-10-10T21:17:22.128015+0000","last_peered":"2023-10-10T21:17:22.128015+0000","last_clean":"2023-10-10T21:17:22.128015+0000","last_became_active":"2023-10-10T21:17:22.125606+0000","last_became_peered":"2023-10-10T21:17:22.125606+0000","last_unstale":"2023-10-10T21:17:22.128015+0000","last_undegraded":"2023-10-10T21:17:22.128015+0000","last_fullsized":"2023-10-10T21:17:22.128015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:49.550718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136543+0000","last_change":"2023-10-10T21:17:22.129786+0000","last_active":"2023-10-10T21:17:22.136543+0000","last_peered":"2023-10-10T21:17:22.136543+0000","last_clean":"2023-10-10T21:17:22.136543+0000","last_became_active":"2023-10-10T21:17:22.129508+0000","last_became_peered":"2023-10-10T21:17:22.129508+0000","last_unstale":"2023-10-10T21:17:22.136543+0000","last_undegraded":"2023-10-10T21:17:22.136543+0000","last_fullsized":"2023-10-10T21:17:22.136543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:54.513628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130740+0000","last_change":"2023-10-10T21:17:22.129337+0000","last_active":"2023-10-10T21:17:22.130740+0000","last_peered":"2023-10-10T21:17:22.130740+0000","last_clean":"2023-10-10T21:17:22.130740+0000","last_became_active":"2023-10-10T21:17:22.129079+0000","last_became_peered":"2023-10-10T21:17:22.129079+0000","last_unstale":"2023-10-10T21:17:22.130740+0000","last_undegraded":"2023-10-10T21:17:22.130740+0000","last_fullsized":"2023-10-10T21:17:22.130740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:28.435380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133331+0000","last_change":"2023-10-10T21:17:22.130216+0000","last_active":"2023-10-10T21:17:22.133331+0000","last_peered":"2023-10-10T21:17:22.133331+0000","last_clean":"2023-10-10T21:17:22.133331+0000","last_became_active":"2023-10-10T21:17:22.129734+0000","last_became_peered":"2023-10-10T21:17:22.129734+0000","last_unstale":"2023-10-10T21:17:22.133331+0000","last_undegraded":"2023-10-10T21:17:22.133331+0000","last_fullsized":"2023-10-10T21:17:22.133331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:10.135356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139036+0000","last_change":"2023-10-10T21:17:22.135399+0000","last_active":"2023-10-10T21:17:22.139036+0000","last_peered":"2023-10-10T21:17:22.139036+0000","last_clean":"2023-10-10T21:17:22.139036+0000","last_became_active":"2023-10-10T21:17:22.135102+0000","last_became_peered":"2023-10-10T21:17:22.135102+0000","last_unstale":"2023-10-10T21:17:22.139036+0000","last_undegraded":"2023-10-10T21:17:22.139036+0000","last_fullsized":"2023-10-10T21:17:22.139036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:41.564999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133665+0000","last_change":"2023-10-10T21:17:22.128692+0000","last_active":"2023-10-10T21:17:22.133665+0000","last_peered":"2023-10-10T21:17:22.133665+0000","last_clean":"2023-10-10T21:17:22.133665+0000","last_became_active":"2023-10-10T21:17:22.128397+0000","last_became_peered":"2023-10-10T21:17:22.128397+0000","last_unstale":"2023-10-10T21:17:22.133665+0000","last_undegraded":"2023-10-10T21:17:22.133665+0000","last_fullsized":"2023-10-10T21:17:22.133665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:13.790306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120420+0000","last_change":"2023-10-10T21:17:22.117520+0000","last_active":"2023-10-10T21:17:22.120420+0000","last_peered":"2023-10-10T21:17:22.120420+0000","last_clean":"2023-10-10T21:17:22.120420+0000","last_became_active":"2023-10-10T21:17:22.117259+0000","last_became_peered":"2023-10-10T21:17:22.117259+0000","last_unstale":"2023-10-10T21:17:22.120420+0000","last_undegraded":"2023-10-10T21:17:22.120420+0000","last_fullsized":"2023-10-10T21:17:22.120420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:43.565186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127830+0000","last_change":"2023-10-10T21:17:22.125575+0000","last_active":"2023-10-10T21:17:22.127830+0000","last_peered":"2023-10-10T21:17:22.127830+0000","last_clean":"2023-10-10T21:17:22.127830+0000","last_became_active":"2023-10-10T21:17:22.125234+0000","last_became_peered":"2023-10-10T21:17:22.125234+0000","last_unstale":"2023-10-10T21:17:22.127830+0000","last_undegraded":"2023-10-10T21:17:22.127830+0000","last_fullsized":"2023-10-10T21:17:22.127830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:34:00.644220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123193+0000","last_change":"2023-10-10T21:17:22.120461+0000","last_active":"2023-10-10T21:17:22.123193+0000","last_peered":"2023-10-10T21:17:22.123193+0000","last_clean":"2023-10-10T21:17:22.123193+0000","last_became_active":"2023-10-10T21:17:22.120180+0000","last_became_peered":"2023-10-10T21:17:22.120180+0000","last_unstale":"2023-10-10T21:17:22.123193+0000","last_undegraded":"2023-10-10T21:17:22.123193+0000","last_fullsized":"2023-10-10T21:17:22.123193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:13.790306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.142034+0000","last_change":"2023-10-10T21:17:21.110380+0000","last_active":"2023-10-10T21:17:22.142034+0000","last_peered":"2023-10-10T21:17:22.142034+0000","last_clean":"2023-10-10T21:17:22.142034+0000","last_became_active":"2023-10-10T21:17:21.110146+0000","last_became_peered":"2023-10-10T21:17:21.110146+0000","last_unstale":"2023-10-10T21:17:22.142034+0000","last_undegraded":"2023-10-10T21:17:22.142034+0000","last_fullsized":"2023-10-10T21:17:22.142034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125033+0000","last_change":"2023-10-10T21:17:22.119505+0000","last_active":"2023-10-10T21:17:22.125033+0000","last_peered":"2023-10-10T21:17:22.125033+0000","last_clean":"2023-10-10T21:17:22.125033+0000","last_became_active":"2023-10-10T21:17:22.119224+0000","last_became_peered":"2023-10-10T21:17:22.119224+0000","last_unstale":"2023-10-10T21:17:22.125033+0000","last_undegraded":"2023-10-10T21:17:22.125033+0000","last_fullsized":"2023-10-10T21:17:22.125033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:00:07.895891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139718+0000","last_change":"2023-10-10T21:17:21.111302+0000","last_active":"2023-10-10T21:17:22.139718+0000","last_peered":"2023-10-10T21:17:22.139718+0000","last_clean":"2023-10-10T21:17:22.139718+0000","last_became_active":"2023-10-10T21:17:21.109679+0000","last_became_peered":"2023-10-10T21:17:21.109679+0000","last_unstale":"2023-10-10T21:17:22.139718+0000","last_undegraded":"2023-10-10T21:17:22.139718+0000","last_fullsized":"2023-10-10T21:17:22.139718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:29.027774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134656+0000","last_change":"2023-10-10T21:17:22.131469+0000","last_active":"2023-10-10T21:17:22.134656+0000","last_peered":"2023-10-10T21:17:22.134656+0000","last_clean":"2023-10-10T21:17:22.134656+0000","last_became_active":"2023-10-10T21:17:22.130839+0000","last_became_peered":"2023-10-10T21:17:22.130839+0000","last_unstale":"2023-10-10T21:17:22.134656+0000","last_undegraded":"2023-10-10T21:17:22.134656+0000","last_fullsized":"2023-10-10T21:17:22.134656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:02.566076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139455+0000","last_change":"2023-10-10T21:17:21.105421+0000","last_active":"2023-10-10T21:17:22.139455+0000","last_peered":"2023-10-10T21:17:22.139455+0000","last_clean":"2023-10-10T21:17:22.139455+0000","last_became_active":"2023-10-10T21:17:21.104957+0000","last_became_peered":"2023-10-10T21:17:21.104957+0000","last_unstale":"2023-10-10T21:17:22.139455+0000","last_undegraded":"2023-10-10T21:17:22.139455+0000","last_fullsized":"2023-10-10T21:17:22.139455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140395+0000","last_change":"2023-10-10T21:17:22.138180+0000","last_active":"2023-10-10T21:17:22.140395+0000","last_peered":"2023-10-10T21:17:22.140395+0000","last_clean":"2023-10-10T21:17:22.140395+0000","last_became_active":"2023-10-10T21:17:22.137905+0000","last_became_peered":"2023-10-10T21:17:22.137905+0000","last_unstale":"2023-10-10T21:17:22.140395+0000","last_undegraded":"2023-10-10T21:17:22.140395+0000","last_fullsized":"2023-10-10T21:17:22.140395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:53.511832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.144448+0000","last_change":"2023-10-10T21:17:21.114324+0000","last_active":"2023-10-10T21:17:22.144448+0000","last_peered":"2023-10-10T21:17:22.144448+0000","last_clean":"2023-10-10T21:17:22.144448+0000","last_became_active":"2023-10-10T21:17:21.113995+0000","last_became_peered":"2023-10-10T21:17:21.113995+0000","last_unstale":"2023-10-10T21:17:22.144448+0000","last_undegraded":"2023-10-10T21:17:22.144448+0000","last_fullsized":"2023-10-10T21:17:22.144448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:29.991865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.122719+0000","last_change":"2023-10-10T21:17:22.120590+0000","last_active":"2023-10-10T21:17:22.122719+0000","last_peered":"2023-10-10T21:17:22.122719+0000","last_clean":"2023-10-10T21:17:22.122719+0000","last_became_active":"2023-10-10T21:17:22.120332+0000","last_became_peered":"2023-10-10T21:17:22.120332+0000","last_unstale":"2023-10-10T21:17:22.122719+0000","last_undegraded":"2023-10-10T21:17:22.122719+0000","last_fullsized":"2023-10-10T21:17:22.122719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:29.688214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.138193+0000","last_change":"2023-10-10T21:17:21.111800+0000","last_active":"2023-10-10T21:17:22.138193+0000","last_peered":"2023-10-10T21:17:22.138193+0000","last_clean":"2023-10-10T21:17:22.138193+0000","last_became_active":"2023-10-10T21:17:21.111532+0000","last_became_peered":"2023-10-10T21:17:21.111532+0000","last_unstale":"2023-10-10T21:17:22.138193+0000","last_undegraded":"2023-10-10T21:17:22.138193+0000","last_fullsized":"2023-10-10T21:17:22.138193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:41:58.143202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.132205+0000","last_change":"2023-10-10T21:17:22.129664+0000","last_active":"2023-10-10T21:17:22.132205+0000","last_peered":"2023-10-10T21:17:22.132205+0000","last_clean":"2023-10-10T21:17:22.132205+0000","last_became_active":"2023-10-10T21:17:22.129392+0000","last_became_peered":"2023-10-10T21:17:22.129392+0000","last_unstale":"2023-10-10T21:17:22.132205+0000","last_undegraded":"2023-10-10T21:17:22.132205+0000","last_fullsized":"2023-10-10T21:17:22.132205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:37:26.419533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139710+0000","last_change":"2023-10-10T21:17:21.104091+0000","last_active":"2023-10-10T21:17:22.139710+0000","last_peered":"2023-10-10T21:17:22.139710+0000","last_clean":"2023-10-10T21:17:22.139710+0000","last_became_active":"2023-10-10T21:17:21.103772+0000","last_became_peered":"2023-10-10T21:17:21.103772+0000","last_unstale":"2023-10-10T21:17:22.139710+0000","last_undegraded":"2023-10-10T21:17:22.139710+0000","last_fullsized":"2023-10-10T21:17:22.139710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:17:09.167468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126710+0000","last_change":"2023-10-10T21:17:22.121437+0000","last_active":"2023-10-10T21:17:22.126710+0000","last_peered":"2023-10-10T21:17:22.126710+0000","last_clean":"2023-10-10T21:17:22.126710+0000","last_became_active":"2023-10-10T21:17:22.120627+0000","last_became_peered":"2023-10-10T21:17:22.120627+0000","last_unstale":"2023-10-10T21:17:22.126710+0000","last_undegraded":"2023-10-10T21:17:22.126710+0000","last_fullsized":"2023-10-10T21:17:22.126710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:28:44.264117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.109286+0000","last_change":"2023-10-10T21:17:21.117087+0000","last_active":"2023-10-10T21:17:22.109286+0000","last_peered":"2023-10-10T21:17:22.109286+0000","last_clean":"2023-10-10T21:17:22.109286+0000","last_became_active":"2023-10-10T21:17:21.116820+0000","last_became_peered":"2023-10-10T21:17:21.116820+0000","last_unstale":"2023-10-10T21:17:22.109286+0000","last_undegraded":"2023-10-10T21:17:22.109286+0000","last_fullsized":"2023-10-10T21:17:22.109286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:29:13.413040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120843+0000","last_change":"2023-10-10T21:17:22.118158+0000","last_active":"2023-10-10T21:17:22.120843+0000","last_peered":"2023-10-10T21:17:22.120843+0000","last_clean":"2023-10-10T21:17:22.120843+0000","last_became_active":"2023-10-10T21:17:22.117833+0000","last_became_peered":"2023-10-10T21:17:22.117833+0000","last_unstale":"2023-10-10T21:17:22.120843+0000","last_undegraded":"2023-10-10T21:17:22.120843+0000","last_fullsized":"2023-10-10T21:17:22.120843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:02:00.520880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.106776+0000","last_change":"2023-10-10T21:17:21.107669+0000","last_active":"2023-10-10T21:17:22.106776+0000","last_peered":"2023-10-10T21:17:22.106776+0000","last_clean":"2023-10-10T21:17:22.106776+0000","last_became_active":"2023-10-10T21:17:21.107381+0000","last_became_peered":"2023-10-10T21:17:21.107381+0000","last_unstale":"2023-10-10T21:17:22.106776+0000","last_undegraded":"2023-10-10T21:17:22.106776+0000","last_fullsized":"2023-10-10T21:17:22.106776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:19:29.467260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129082+0000","last_change":"2023-10-10T21:17:22.127136+0000","last_active":"2023-10-10T21:17:22.129082+0000","last_peered":"2023-10-10T21:17:22.129082+0000","last_clean":"2023-10-10T21:17:22.129082+0000","last_became_active":"2023-10-10T21:17:22.126876+0000","last_became_peered":"2023-10-10T21:17:22.126876+0000","last_unstale":"2023-10-10T21:17:22.129082+0000","last_undegraded":"2023-10-10T21:17:22.129082+0000","last_fullsized":"2023-10-10T21:17:22.129082+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:27:57.520144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.113390+0000","last_change":"2023-10-10T21:17:21.111997+0000","last_active":"2023-10-10T21:17:22.113390+0000","last_peered":"2023-10-10T21:17:22.113390+0000","last_clean":"2023-10-10T21:17:22.113390+0000","last_became_active":"2023-10-10T21:17:21.111721+0000","last_became_peered":"2023-10-10T21:17:21.111721+0000","last_unstale":"2023-10-10T21:17:22.113390+0000","last_undegraded":"2023-10-10T21:17:22.113390+0000","last_fullsized":"2023-10-10T21:17:22.113390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:41.329697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.138705+0000","last_change":"2023-10-10T21:17:22.135717+0000","last_active":"2023-10-10T21:17:22.138705+0000","last_peered":"2023-10-10T21:17:22.138705+0000","last_clean":"2023-10-10T21:17:22.138705+0000","last_became_active":"2023-10-10T21:17:22.135223+0000","last_became_peered":"2023-10-10T21:17:22.135223+0000","last_unstale":"2023-10-10T21:17:22.138705+0000","last_undegraded":"2023-10-10T21:17:22.138705+0000","last_fullsized":"2023-10-10T21:17:22.138705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:31:51.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118476+0000","last_change":"2023-10-10T21:17:21.111763+0000","last_active":"2023-10-10T21:17:22.118476+0000","last_peered":"2023-10-10T21:17:22.118476+0000","last_clean":"2023-10-10T21:17:22.118476+0000","last_became_active":"2023-10-10T21:17:21.111518+0000","last_became_peered":"2023-10-10T21:17:21.111518+0000","last_unstale":"2023-10-10T21:17:22.118476+0000","last_undegraded":"2023-10-10T21:17:22.118476+0000","last_fullsized":"2023-10-10T21:17:22.118476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:01:00.565221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126465+0000","last_change":"2023-10-10T21:17:22.121020+0000","last_active":"2023-10-10T21:17:22.126465+0000","last_peered":"2023-10-10T21:17:22.126465+0000","last_clean":"2023-10-10T21:17:22.126465+0000","last_became_active":"2023-10-10T21:17:22.120556+0000","last_became_peered":"2023-10-10T21:17:22.120556+0000","last_unstale":"2023-10-10T21:17:22.126465+0000","last_undegraded":"2023-10-10T21:17:22.126465+0000","last_fullsized":"2023-10-10T21:17:22.126465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:18.893169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"80'3","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.141520+0000","last_change":"2023-10-10T21:17:21.113636+0000","last_active":"2023-10-10T21:17:22.141520+0000","last_peered":"2023-10-10T21:17:22.141520+0000","last_clean":"2023-10-10T21:17:22.141520+0000","last_became_active":"2023-10-10T21:17:21.113183+0000","last_became_peered":"2023-10-10T21:17:21.113183+0000","last_unstale":"2023-10-10T21:17:22.141520+0000","last_undegraded":"2023-10-10T21:17:22.141520+0000","last_fullsized":"2023-10-10T21:17:22.141520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:41.727455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.137932+0000","last_change":"2023-10-10T21:17:22.132195+0000","last_active":"2023-10-10T21:17:22.137932+0000","last_peered":"2023-10-10T21:17:22.137932+0000","last_clean":"2023-10-10T21:17:22.137932+0000","last_became_active":"2023-10-10T21:17:22.131304+0000","last_became_peered":"2023-10-10T21:17:22.131304+0000","last_unstale":"2023-10-10T21:17:22.137932+0000","last_undegraded":"2023-10-10T21:17:22.137932+0000","last_fullsized":"2023-10-10T21:17:22.137932+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:51.850002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"80'6","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.143755+0000","last_change":"2023-10-10T21:17:21.114400+0000","last_active":"2023-10-10T21:17:22.143755+0000","last_peered":"2023-10-10T21:17:22.143755+0000","last_clean":"2023-10-10T21:17:22.143755+0000","last_became_active":"2023-10-10T21:17:21.114089+0000","last_became_peered":"2023-10-10T21:17:21.114089+0000","last_unstale":"2023-10-10T21:17:22.143755+0000","last_undegraded":"2023-10-10T21:17:22.143755+0000","last_fullsized":"2023-10-10T21:17:22.143755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:29.991865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133458+0000","last_change":"2023-10-10T21:17:22.124297+0000","last_active":"2023-10-10T21:17:22.133458+0000","last_peered":"2023-10-10T21:17:22.133458+0000","last_clean":"2023-10-10T21:17:22.133458+0000","last_became_active":"2023-10-10T21:17:22.124000+0000","last_became_peered":"2023-10-10T21:17:22.124000+0000","last_unstale":"2023-10-10T21:17:22.133458+0000","last_undegraded":"2023-10-10T21:17:22.133458+0000","last_fullsized":"2023-10-10T21:17:22.133458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:06:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139085+0000","last_change":"2023-10-10T21:17:21.112845+0000","last_active":"2023-10-10T21:17:22.139085+0000","last_peered":"2023-10-10T21:17:22.139085+0000","last_clean":"2023-10-10T21:17:22.139085+0000","last_became_active":"2023-10-10T21:17:21.112572+0000","last_became_peered":"2023-10-10T21:17:21.112572+0000","last_unstale":"2023-10-10T21:17:22.139085+0000","last_undegraded":"2023-10-10T21:17:22.139085+0000","last_fullsized":"2023-10-10T21:17:22.139085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:25:28.217784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134814+0000","last_change":"2023-10-10T21:17:22.127757+0000","last_active":"2023-10-10T21:17:22.134814+0000","last_peered":"2023-10-10T21:17:22.134814+0000","last_clean":"2023-10-10T21:17:22.134814+0000","last_became_active":"2023-10-10T21:17:22.127049+0000","last_became_peered":"2023-10-10T21:17:22.127049+0000","last_unstale":"2023-10-10T21:17:22.134814+0000","last_undegraded":"2023-10-10T21:17:22.134814+0000","last_fullsized":"2023-10-10T21:17:22.134814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:02.566076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110716+0000","last_change":"2023-10-10T21:17:21.106041+0000","last_active":"2023-10-10T21:17:22.110716+0000","last_peered":"2023-10-10T21:17:22.110716+0000","last_clean":"2023-10-10T21:17:22.110716+0000","last_became_active":"2023-10-10T21:17:21.105741+0000","last_became_peered":"2023-10-10T21:17:21.105741+0000","last_unstale":"2023-10-10T21:17:22.110716+0000","last_undegraded":"2023-10-10T21:17:22.110716+0000","last_fullsized":"2023-10-10T21:17:22.110716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:45:06.671253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.128313+0000","last_change":"2023-10-10T21:17:22.126951+0000","last_active":"2023-10-10T21:17:22.128313+0000","last_peered":"2023-10-10T21:17:22.128313+0000","last_clean":"2023-10-10T21:17:22.128313+0000","last_became_active":"2023-10-10T21:17:22.126636+0000","last_became_peered":"2023-10-10T21:17:22.126636+0000","last_unstale":"2023-10-10T21:17:22.128313+0000","last_undegraded":"2023-10-10T21:17:22.128313+0000","last_fullsized":"2023-10-10T21:17:22.128313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:59:45.805481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.109333+0000","last_change":"2023-10-10T21:17:21.118436+0000","last_active":"2023-10-10T21:17:22.109333+0000","last_peered":"2023-10-10T21:17:22.109333+0000","last_clean":"2023-10-10T21:17:22.109333+0000","last_became_active":"2023-10-10T21:17:21.118108+0000","last_became_peered":"2023-10-10T21:17:21.118108+0000","last_unstale":"2023-10-10T21:17:22.109333+0000","last_undegraded":"2023-10-10T21:17:22.109333+0000","last_fullsized":"2023-10-10T21:17:22.109333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:41:58.143202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136234+0000","last_change":"2023-10-10T21:17:22.132671+0000","last_active":"2023-10-10T21:17:22.136234+0000","last_peered":"2023-10-10T21:17:22.136234+0000","last_clean":"2023-10-10T21:17:22.136234+0000","last_became_active":"2023-10-10T21:17:22.131067+0000","last_became_peered":"2023-10-10T21:17:22.131067+0000","last_unstale":"2023-10-10T21:17:22.136234+0000","last_undegraded":"2023-10-10T21:17:22.136234+0000","last_fullsized":"2023-10-10T21:17:22.136234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:53.511832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"80'8","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.144764+0000","last_change":"2023-10-10T21:17:21.115664+0000","last_active":"2023-10-10T21:17:22.144764+0000","last_peered":"2023-10-10T21:17:22.144764+0000","last_clean":"2023-10-10T21:17:22.144764+0000","last_became_active":"2023-10-10T21:17:21.115412+0000","last_became_peered":"2023-10-10T21:17:21.115412+0000","last_unstale":"2023-10-10T21:17:22.144764+0000","last_undegraded":"2023-10-10T21:17:22.144764+0000","last_fullsized":"2023-10-10T21:17:22.144764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:17:09.167468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133620+0000","last_change":"2023-10-10T21:17:22.129661+0000","last_active":"2023-10-10T21:17:22.133620+0000","last_peered":"2023-10-10T21:17:22.133620+0000","last_clean":"2023-10-10T21:17:22.133620+0000","last_became_active":"2023-10-10T21:17:22.129250+0000","last_became_peered":"2023-10-10T21:17:22.129250+0000","last_unstale":"2023-10-10T21:17:22.133620+0000","last_undegraded":"2023-10-10T21:17:22.133620+0000","last_fullsized":"2023-10-10T21:17:22.133620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:45:03.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139072+0000","last_change":"2023-10-10T21:17:21.109113+0000","last_active":"2023-10-10T21:17:22.139072+0000","last_peered":"2023-10-10T21:17:22.139072+0000","last_clean":"2023-10-10T21:17:22.139072+0000","last_became_active":"2023-10-10T21:17:21.106685+0000","last_became_peered":"2023-10-10T21:17:21.106685+0000","last_unstale":"2023-10-10T21:17:22.139072+0000","last_undegraded":"2023-10-10T21:17:22.139072+0000","last_fullsized":"2023-10-10T21:17:22.139072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:51:52.120571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136601+0000","last_change":"2023-10-10T21:17:22.132622+0000","last_active":"2023-10-10T21:17:22.136601+0000","last_peered":"2023-10-10T21:17:22.136601+0000","last_clean":"2023-10-10T21:17:22.136601+0000","last_became_active":"2023-10-10T21:17:22.132194+0000","last_became_peered":"2023-10-10T21:17:22.132194+0000","last_unstale":"2023-10-10T21:17:22.136601+0000","last_undegraded":"2023-10-10T21:17:22.136601+0000","last_fullsized":"2023-10-10T21:17:22.136601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:23:29.301886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139601+0000","last_change":"2023-10-10T21:17:21.112175+0000","last_active":"2023-10-10T21:17:22.139601+0000","last_peered":"2023-10-10T21:17:22.139601+0000","last_clean":"2023-10-10T21:17:22.139601+0000","last_became_active":"2023-10-10T21:17:21.111931+0000","last_became_peered":"2023-10-10T21:17:21.111931+0000","last_unstale":"2023-10-10T21:17:22.139601+0000","last_undegraded":"2023-10-10T21:17:22.139601+0000","last_fullsized":"2023-10-10T21:17:22.139601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:41.727455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125643+0000","last_change":"2023-10-10T21:17:22.122912+0000","last_active":"2023-10-10T21:17:22.125643+0000","last_peered":"2023-10-10T21:17:22.125643+0000","last_clean":"2023-10-10T21:17:22.125643+0000","last_became_active":"2023-10-10T21:17:22.122663+0000","last_became_peered":"2023-10-10T21:17:22.122663+0000","last_unstale":"2023-10-10T21:17:22.125643+0000","last_undegraded":"2023-10-10T21:17:22.125643+0000","last_fullsized":"2023-10-10T21:17:22.125643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:53:40.085195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.144305+0000","last_change":"2023-10-10T21:17:21.113232+0000","last_active":"2023-10-10T21:17:22.144305+0000","last_peered":"2023-10-10T21:17:22.144305+0000","last_clean":"2023-10-10T21:17:22.144305+0000","last_became_active":"2023-10-10T21:17:21.112808+0000","last_became_peered":"2023-10-10T21:17:21.112808+0000","last_unstale":"2023-10-10T21:17:22.144305+0000","last_undegraded":"2023-10-10T21:17:22.144305+0000","last_fullsized":"2023-10-10T21:17:22.144305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.137951+0000","last_change":"2023-10-10T21:17:22.132401+0000","last_active":"2023-10-10T21:17:22.137951+0000","last_peered":"2023-10-10T21:17:22.137951+0000","last_clean":"2023-10-10T21:17:22.137951+0000","last_became_active":"2023-10-10T21:17:22.131777+0000","last_became_peered":"2023-10-10T21:17:22.131777+0000","last_unstale":"2023-10-10T21:17:22.137951+0000","last_undegraded":"2023-10-10T21:17:22.137951+0000","last_fullsized":"2023-10-10T21:17:22.137951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:34:00.644220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.108547+0000","last_change":"2023-10-10T21:17:21.116009+0000","last_active":"2023-10-10T21:17:22.108547+0000","last_peered":"2023-10-10T21:17:22.108547+0000","last_clean":"2023-10-10T21:17:22.108547+0000","last_became_active":"2023-10-10T21:17:21.115764+0000","last_became_peered":"2023-10-10T21:17:21.115764+0000","last_unstale":"2023-10-10T21:17:22.108547+0000","last_undegraded":"2023-10-10T21:17:22.108547+0000","last_fullsized":"2023-10-10T21:17:22.108547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:11:09.152293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127941+0000","last_change":"2023-10-10T21:17:22.117269+0000","last_active":"2023-10-10T21:17:22.127941+0000","last_peered":"2023-10-10T21:17:22.127941+0000","last_clean":"2023-10-10T21:17:22.127941+0000","last_became_active":"2023-10-10T21:17:22.116984+0000","last_became_peered":"2023-10-10T21:17:22.116984+0000","last_unstale":"2023-10-10T21:17:22.127941+0000","last_undegraded":"2023-10-10T21:17:22.127941+0000","last_fullsized":"2023-10-10T21:17:22.127941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:00:42.902712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.141309+0000","last_change":"2023-10-10T21:17:21.109031+0000","last_active":"2023-10-10T21:17:22.141309+0000","last_peered":"2023-10-10T21:17:22.141309+0000","last_clean":"2023-10-10T21:17:22.141309+0000","last_became_active":"2023-10-10T21:17:21.108292+0000","last_became_peered":"2023-10-10T21:17:21.108292+0000","last_unstale":"2023-10-10T21:17:22.141309+0000","last_undegraded":"2023-10-10T21:17:22.141309+0000","last_fullsized":"2023-10-10T21:17:22.141309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:15:17.264995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129441+0000","last_change":"2023-10-10T21:17:22.126967+0000","last_active":"2023-10-10T21:17:22.129441+0000","last_peered":"2023-10-10T21:17:22.129441+0000","last_clean":"2023-10-10T21:17:22.129441+0000","last_became_active":"2023-10-10T21:17:22.126688+0000","last_became_peered":"2023-10-10T21:17:22.126688+0000","last_unstale":"2023-10-10T21:17:22.129441+0000","last_undegraded":"2023-10-10T21:17:22.129441+0000","last_fullsized":"2023-10-10T21:17:22.129441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:06:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104746+0000","last_change":"2023-10-10T21:17:21.107533+0000","last_active":"2023-10-10T21:17:22.104746+0000","last_peered":"2023-10-10T21:17:22.104746+0000","last_clean":"2023-10-10T21:17:22.104746+0000","last_became_active":"2023-10-10T21:17:21.107293+0000","last_became_peered":"2023-10-10T21:17:21.107293+0000","last_unstale":"2023-10-10T21:17:22.104746+0000","last_undegraded":"2023-10-10T21:17:22.104746+0000","last_fullsized":"2023-10-10T21:17:22.104746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:15.822758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123986+0000","last_change":"2023-10-10T21:17:22.121229+0000","last_active":"2023-10-10T21:17:22.123986+0000","last_peered":"2023-10-10T21:17:22.123986+0000","last_clean":"2023-10-10T21:17:22.123986+0000","last_became_active":"2023-10-10T21:17:22.120968+0000","last_became_peered":"2023-10-10T21:17:22.120968+0000","last_unstale":"2023-10-10T21:17:22.123986+0000","last_undegraded":"2023-10-10T21:17:22.123986+0000","last_fullsized":"2023-10-10T21:17:22.123986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:31:51.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.109501+0000","last_change":"2023-10-10T21:17:21.115386+0000","last_active":"2023-10-10T21:17:22.109501+0000","last_peered":"2023-10-10T21:17:22.109501+0000","last_clean":"2023-10-10T21:17:22.109501+0000","last_became_active":"2023-10-10T21:17:21.114903+0000","last_became_peered":"2023-10-10T21:17:21.114903+0000","last_unstale":"2023-10-10T21:17:22.109501+0000","last_undegraded":"2023-10-10T21:17:22.109501+0000","last_fullsized":"2023-10-10T21:17:22.109501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:19:29.467260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134435+0000","last_change":"2023-10-10T21:17:22.122742+0000","last_active":"2023-10-10T21:17:22.134435+0000","last_peered":"2023-10-10T21:17:22.134435+0000","last_clean":"2023-10-10T21:17:22.134435+0000","last_became_active":"2023-10-10T21:17:22.122466+0000","last_became_peered":"2023-10-10T21:17:22.122466+0000","last_unstale":"2023-10-10T21:17:22.134435+0000","last_undegraded":"2023-10-10T21:17:22.134435+0000","last_fullsized":"2023-10-10T21:17:22.134435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:59:45.805481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140519+0000","last_change":"2023-10-10T21:17:21.116165+0000","last_active":"2023-10-10T21:17:22.140519+0000","last_peered":"2023-10-10T21:17:22.140519+0000","last_clean":"2023-10-10T21:17:22.140519+0000","last_became_active":"2023-10-10T21:17:21.115910+0000","last_became_peered":"2023-10-10T21:17:21.115910+0000","last_unstale":"2023-10-10T21:17:22.140519+0000","last_undegraded":"2023-10-10T21:17:22.140519+0000","last_fullsized":"2023-10-10T21:17:22.140519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:35:48.191005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133233+0000","last_change":"2023-10-10T21:17:22.126146+0000","last_active":"2023-10-10T21:17:22.133233+0000","last_peered":"2023-10-10T21:17:22.133233+0000","last_clean":"2023-10-10T21:17:22.133233+0000","last_became_active":"2023-10-10T21:17:22.125871+0000","last_became_peered":"2023-10-10T21:17:22.125871+0000","last_unstale":"2023-10-10T21:17:22.133233+0000","last_undegraded":"2023-10-10T21:17:22.133233+0000","last_fullsized":"2023-10-10T21:17:22.133233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:59:04.686826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110044+0000","last_change":"2023-10-10T21:17:21.107240+0000","last_active":"2023-10-10T21:17:22.110044+0000","last_peered":"2023-10-10T21:17:22.110044+0000","last_clean":"2023-10-10T21:17:22.110044+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.110044+0000","last_undegraded":"2023-10-10T21:17:22.110044+0000","last_fullsized":"2023-10-10T21:17:22.110044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:41.329697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126446+0000","last_change":"2023-10-10T21:17:22.120807+0000","last_active":"2023-10-10T21:17:22.126446+0000","last_peered":"2023-10-10T21:17:22.126446+0000","last_clean":"2023-10-10T21:17:22.126446+0000","last_became_active":"2023-10-10T21:17:22.120231+0000","last_became_peered":"2023-10-10T21:17:22.120231+0000","last_unstale":"2023-10-10T21:17:22.126446+0000","last_undegraded":"2023-10-10T21:17:22.126446+0000","last_fullsized":"2023-10-10T21:17:22.126446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:39.969510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110305+0000","last_change":"2023-10-10T21:17:21.109362+0000","last_active":"2023-10-10T21:17:22.110305+0000","last_peered":"2023-10-10T21:17:22.110305+0000","last_clean":"2023-10-10T21:17:22.110305+0000","last_became_active":"2023-10-10T21:17:21.109065+0000","last_became_peered":"2023-10-10T21:17:21.109065+0000","last_unstale":"2023-10-10T21:17:22.110305+0000","last_undegraded":"2023-10-10T21:17:22.110305+0000","last_fullsized":"2023-10-10T21:17:22.110305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:38.964871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.138890+0000","last_change":"2023-10-10T21:17:22.135588+0000","last_active":"2023-10-10T21:17:22.138890+0000","last_peered":"2023-10-10T21:17:22.138890+0000","last_clean":"2023-10-10T21:17:22.138890+0000","last_became_active":"2023-10-10T21:17:22.135336+0000","last_became_peered":"2023-10-10T21:17:22.135336+0000","last_unstale":"2023-10-10T21:17:22.138890+0000","last_undegraded":"2023-10-10T21:17:22.138890+0000","last_fullsized":"2023-10-10T21:17:22.138890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:54.513628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110172+0000","last_change":"2023-10-10T21:17:21.116511+0000","last_active":"2023-10-10T21:17:22.110172+0000","last_peered":"2023-10-10T21:17:22.110172+0000","last_clean":"2023-10-10T21:17:22.110172+0000","last_became_active":"2023-10-10T21:17:21.116175+0000","last_became_peered":"2023-10-10T21:17:21.116175+0000","last_unstale":"2023-10-10T21:17:22.110172+0000","last_undegraded":"2023-10-10T21:17:22.110172+0000","last_fullsized":"2023-10-10T21:17:22.110172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127696+0000","last_change":"2023-10-10T21:17:22.126342+0000","last_active":"2023-10-10T21:17:22.127696+0000","last_peered":"2023-10-10T21:17:22.127696+0000","last_clean":"2023-10-10T21:17:22.127696+0000","last_became_active":"2023-10-10T21:17:22.126073+0000","last_became_peered":"2023-10-10T21:17:22.126073+0000","last_unstale":"2023-10-10T21:17:22.127696+0000","last_undegraded":"2023-10-10T21:17:22.127696+0000","last_fullsized":"2023-10-10T21:17:22.127696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:16.335987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104748+0000","last_change":"2023-10-10T21:17:21.114873+0000","last_active":"2023-10-10T21:17:22.104748+0000","last_peered":"2023-10-10T21:17:22.104748+0000","last_clean":"2023-10-10T21:17:22.104748+0000","last_became_active":"2023-10-10T21:17:21.114212+0000","last_became_peered":"2023-10-10T21:17:21.114212+0000","last_unstale":"2023-10-10T21:17:22.104748+0000","last_undegraded":"2023-10-10T21:17:22.104748+0000","last_fullsized":"2023-10-10T21:17:22.104748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:36.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127515+0000","last_change":"2023-10-10T21:17:22.121612+0000","last_active":"2023-10-10T21:17:22.127515+0000","last_peered":"2023-10-10T21:17:22.127515+0000","last_clean":"2023-10-10T21:17:22.127515+0000","last_became_active":"2023-10-10T21:17:22.121353+0000","last_became_peered":"2023-10-10T21:17:22.121353+0000","last_unstale":"2023-10-10T21:17:22.127515+0000","last_undegraded":"2023-10-10T21:17:22.127515+0000","last_fullsized":"2023-10-10T21:17:22.127515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:17:39.285584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.106936+0000","last_change":"2023-10-10T21:17:21.114183+0000","last_active":"2023-10-10T21:17:22.106936+0000","last_peered":"2023-10-10T21:17:22.106936+0000","last_clean":"2023-10-10T21:17:22.106936+0000","last_became_active":"2023-10-10T21:17:21.113784+0000","last_became_peered":"2023-10-10T21:17:21.113784+0000","last_unstale":"2023-10-10T21:17:22.106936+0000","last_undegraded":"2023-10-10T21:17:22.106936+0000","last_fullsized":"2023-10-10T21:17:22.106936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:29:13.413040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127572+0000","last_change":"2023-10-10T21:17:22.121370+0000","last_active":"2023-10-10T21:17:22.127572+0000","last_peered":"2023-10-10T21:17:22.127572+0000","last_clean":"2023-10-10T21:17:22.127572+0000","last_became_active":"2023-10-10T21:17:22.117631+0000","last_became_peered":"2023-10-10T21:17:22.117631+0000","last_unstale":"2023-10-10T21:17:22.127572+0000","last_undegraded":"2023-10-10T21:17:22.127572+0000","last_fullsized":"2023-10-10T21:17:22.127572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:09:00.391451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104781+0000","last_change":"2023-10-10T21:17:21.107269+0000","last_active":"2023-10-10T21:17:22.104781+0000","last_peered":"2023-10-10T21:17:22.104781+0000","last_clean":"2023-10-10T21:17:22.104781+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.104781+0000","last_undegraded":"2023-10-10T21:17:22.104781+0000","last_fullsized":"2023-10-10T21:17:22.104781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:23:20.098680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118254+0000","last_change":"2023-10-10T21:17:22.113811+0000","last_active":"2023-10-10T21:17:22.118254+0000","last_peered":"2023-10-10T21:17:22.118254+0000","last_clean":"2023-10-10T21:17:22.118254+0000","last_became_active":"2023-10-10T21:17:22.113536+0000","last_became_peered":"2023-10-10T21:17:22.113536+0000","last_unstale":"2023-10-10T21:17:22.118254+0000","last_undegraded":"2023-10-10T21:17:22.118254+0000","last_fullsized":"2023-10-10T21:17:22.118254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:46.588070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.112091+0000","last_change":"2023-10-10T21:17:21.115869+0000","last_active":"2023-10-10T21:17:22.112091+0000","last_peered":"2023-10-10T21:17:22.112091+0000","last_clean":"2023-10-10T21:17:22.112091+0000","last_became_active":"2023-10-10T21:17:21.115625+0000","last_became_peered":"2023-10-10T21:17:21.115625+0000","last_unstale":"2023-10-10T21:17:22.112091+0000","last_undegraded":"2023-10-10T21:17:22.112091+0000","last_fullsized":"2023-10-10T21:17:22.112091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:14.597592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129353+0000","last_change":"2023-10-10T21:17:22.126892+0000","last_active":"2023-10-10T21:17:22.129353+0000","last_peered":"2023-10-10T21:17:22.129353+0000","last_clean":"2023-10-10T21:17:22.129353+0000","last_became_active":"2023-10-10T21:17:22.126627+0000","last_became_peered":"2023-10-10T21:17:22.126627+0000","last_unstale":"2023-10-10T21:17:22.129353+0000","last_undegraded":"2023-10-10T21:17:22.129353+0000","last_fullsized":"2023-10-10T21:17:22.129353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:39:59.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110142+0000","last_change":"2023-10-10T21:17:21.115248+0000","last_active":"2023-10-10T21:17:22.110142+0000","last_peered":"2023-10-10T21:17:22.110142+0000","last_clean":"2023-10-10T21:17:22.110142+0000","last_became_active":"2023-10-10T21:17:21.114947+0000","last_became_peered":"2023-10-10T21:17:21.114947+0000","last_unstale":"2023-10-10T21:17:22.110142+0000","last_undegraded":"2023-10-10T21:17:22.110142+0000","last_fullsized":"2023-10-10T21:17:22.110142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:59.386811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":371,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.115478+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:17:22.115478+0000","last_peered":"2023-10-10T21:17:22.115478+0000","last_clean":"2023-10-10T21:17:22.115478+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:17:22.115478+0000","last_undegraded":"2023-10-10T21:17:22.115478+0000","last_fullsized":"2023-10-10T21:17:22.115478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542328,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1576960,"data_stored":1056094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.55800000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.89600000000000002,"5min":1.014,"15min":1.1859999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75,"15min":0.73699999999999999},"min":{"1min":0.629,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0069999999999999,"15min":1.123},"last":0.73499999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.624},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81100000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.61599999999999999},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.624},"min":{"1min":0.42599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78000000000000003,"5min":0.98299999999999998,"15min":1.022},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.67400000000000004},"min":{"1min":0.499,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":0.82899999999999996,"5min":0.90600000000000003,"15min":0.98899999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.52600000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.625,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.135},"last":0.89100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542327,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302336,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069504,"statfs":{"total":96636764160,"available":96327172096,"internally_reserved":0,"allocated":974848,"data_stored":465566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.59199999999999997,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69099999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.747,"15min":0.75},"min":{"1min":0.626,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.143},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.65700000000000003,"5min":0.497,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":1.073,"15min":1.073},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.98199999999999998,"15min":1.151},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.58999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97799999999999998,"15min":1.01},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.74199999999999999,"15min":0.73199999999999998},"min":{"1min":0.621,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83699999999999997,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.1200000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.62,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72099999999999997,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.496},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.34799999999999998},"max":{"1min":0.86499999999999999,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.87,"5min":1.022,"15min":1.345},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.879,"5min":1.048,"15min":1.238},"last":0.60299999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":0.86099999999999999,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0289999999999999,"15min":1.202},"last":0.623}]}]},{"osd":1,"up_from":14,"seq":60129542327,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302340,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069500,"statfs":{"total":96636764160,"available":96327168000,"internally_reserved":0,"allocated":978944,"data_stored":465656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32600000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66300000000000003,"5min":0.79700000000000004,"15min":1.258},"last":8.0839999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":1.964},"last":13.223000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.89300000000000002,"15min":1.4550000000000001},"last":2.254},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.44,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":2.085},"last":1.9019999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.84399999999999997,"15min":1.8919999999999999},"last":4.0060000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":2.117},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.48099999999999998},"max":{"1min":1.042,"5min":1.0509999999999999,"15min":2.052},"last":4.806},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.66400000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96999999999999997,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":3.9180000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.61499999999999999,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.0409999999999999,"15min":1.181},"last":6.968},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.46400000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":2.012},"last":13.130000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.60999999999999999,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":1.01,"5min":1.1240000000000001,"15min":2.25},"last":3.9569999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.72099999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":2.2999999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78800000000000003,"15min":0.78900000000000003},"min":{"1min":0.69199999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.04,"5min":1.1639999999999999,"15min":2.169},"last":12.026},{"interface":"front","average":{"1min":0.877,"5min":0.81799999999999995,"15min":0.82099999999999995},"min":{"1min":0.70999999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.05,"5min":1.149,"15min":1.1850000000000001},"last":3.7229999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073004,"statfs":{"total":96636764160,"available":96330756096,"internally_reserved":0,"allocated":1585152,"data_stored":1058024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.67200000000000004,"5min":0.74299999999999999,"15min":1.4890000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.879,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.44}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.42499999999999999,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":1.706},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.874,"15min":1.2909999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.101,"15min":1.2270000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95599999999999996,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.008,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":1.0980000000000001,"5min":1.119,"15min":1.3899999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83099999999999996,"15min":0.82799999999999996},"min":{"1min":0.65700000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0640000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.83799999999999997},"min":{"1min":0.66700000000000004,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0109999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.73999999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.1439999999999999,"15min":1.363},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.64400000000000002,"5min":0.58799999999999997,"15min":0.54200000000000004},"max":{"1min":1.024,"5min":1.165,"15min":1.3300000000000001},"last":0.78600000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.35699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.73399999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.495}]},{"osd":1,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91200000000000003,"5min":1.157,"15min":1.3220000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.63200000000000001,"5min":0.53500000000000003,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":1.26,"15min":1.2849999999999999},"last":0.96899999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.65800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98199999999999998,"5min":2.21,"15min":2.21},"last":1.008},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78200000000000003,"15min":0.78300000000000003},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.165,"15min":1.268},"last":0.92600000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.67800000000000005,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":1.018,"5min":1.151,"15min":1.3400000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.65600000000000003,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":1.0349999999999999,"15min":1.3759999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81000000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.0029999999999999,"5min":1.716,"15min":1.716},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.81200000000000006},"min":{"1min":0.71699999999999997,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.97799999999999998,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509624,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.442,"15min":0.45800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.66400000000000003,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.495,"15min":0.499},"min":{"1min":0.42799999999999999,"5min":0.33700000000000002,"15min":0.28799999999999998},"max":{"1min":0.65100000000000002,"5min":0.73399999999999999,"15min":1.544},"last":0.35999999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.40899999999999997,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":1.6759999999999999},"last":0.315},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.45800000000000002,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.432}]},{"osd":2,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.7070000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.38700000000000001},"max":{"1min":0.77700000000000002,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.63100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96499999999999997,"5min":1.054,"15min":1.6359999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76700000000000002,"15min":0.78600000000000003},"min":{"1min":0.61199999999999999,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.016,"5min":1.1859999999999999,"15min":1.246},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.65000000000000002,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":0.996,"5min":1.1240000000000001,"15min":1.262},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76800000000000002,"15min":0.77800000000000002},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":0.97999999999999998,"5min":1.2250000000000001,"15min":1.579},"last":0.64100000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61399999999999999,"5min":0.502,"15min":0.47099999999999997},"max":{"1min":1.05,"5min":1.27,"15min":1.27},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.68400000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.224,"15min":1.224},"last":0.624}]},{"osd":7,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":0.98999999999999999,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.81499999999999995},"min":{"1min":0.66000000000000003,"5min":0.53500000000000003,"15min":0.51300000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.3200000000000001},"last":0.501}]}]},{"osd":4,"up_from":14,"seq":60129542329,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310540,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061300,"statfs":{"total":96636764160,"available":96318771200,"internally_reserved":0,"allocated":987136,"data_stored":467102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.92000000000000004,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.95099999999999996,"5min":0.96299999999999997,"15min":1.758},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.1359999999999999,"15min":1.47},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":0.98299999999999998,"15min":1.929},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.6890000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.98399999999999999,"5min":1.3100000000000001,"15min":1.468},"last":0.5}]},{"osd":3,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.046,"5min":1.0820000000000001,"15min":1.397},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":1.385,"15min":1.385},"last":0.55500000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79700000000000004,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.874,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":1.0609999999999999,"15min":1.464},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.59899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542327,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":983040,"data_stored":466190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.502},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.52300000000000002,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.371},"last":0.57899999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.56000000000000005,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":0.90100000000000002,"5min":0.93300000000000005,"15min":3.895},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73599999999999999,"15min":0.78000000000000003},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.56200000000000006}]},{"osd":2,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.71599999999999997},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.97499999999999998,"5min":1.01,"15min":1.2889999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":1.3540000000000001},"last":0.81499999999999995}]},{"osd":3,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76000000000000001,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.59099999999999997,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.63600000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.496,"15min":4.2789999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.80200000000000005},"min":{"1min":0.56699999999999995,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.752}]},{"osd":7,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.51200000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":2.8900000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.96099999999999997,"5min":1.077,"15min":3.9420000000000002},"last":0.84499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:17:31.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:17:31.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.501+0000 7fbdad3ff700 1 Processor -- start 2023-10-10T21:17:31.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.502+0000 7fbdad3ff700 1 -- start start 2023-10-10T21:17:31.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.503+0000 7fbdad3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbda80cbf30 0x7fbda80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.503+0000 7fbdad3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbda80ccf90 0x7fbda80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.503+0000 7fbdad3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda80cc300 con 0x7fbda815a270 2023-10-10T21:17:31.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.503+0000 7fbdad3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda8156bf0 con 0x7fbda80cbf30 2023-10-10T21:17:31.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.503+0000 7fbdad3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda80ae950 con 0x7fbda80ccf90 2023-10-10T21:17:31.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.503+0000 7fbda6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbda80cbf30 0x7fbda80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.503+0000 7fbda6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbda80cbf30 0x7fbda80ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58118/0 (socket says 172.21.15.154:58118) 2023-10-10T21:17:31.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.503+0000 7fbda6ffd700 1 -- 172.21.15.154:0/3405794593 learned_addr learned my addr 172.21.15.154:0/3405794593 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:31.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.503+0000 7fbda67fc700 1 --2- 172.21.15.154:0/3405794593 >> v2:172.21.15.179:3300/0 conn(0x7fbda80ccf90 0x7fbda80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.504+0000 7fbda6ffd700 1 -- 172.21.15.154:0/3405794593 >> v2:172.21.15.179:3300/0 conn(0x7fbda80ccf90 msgr2=0x7fbda80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:31.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.504+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/3405794593 >> v2:172.21.15.179:3300/0 conn(0x7fbda80ccf90 0x7fbda80b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.504+0000 7fbda6ffd700 1 -- 172.21.15.154:0/3405794593 >> v1:172.21.15.179:6789/0 conn(0x7fbda815a270 legacy=0x7fbda80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.504+0000 7fbda6ffd700 1 -- 172.21.15.154:0/3405794593 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80ad370 con 0x7fbda80cbf30 2023-10-10T21:17:31.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.504+0000 7fbda67fc700 1 --2- 172.21.15.154:0/3405794593 >> v2:172.21.15.179:3300/0 conn(0x7fbda80ccf90 0x7fbda80b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:31.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.504+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/3405794593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80cbf30 0x7fbda80ae410 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbda806d670 tx=0x7fbd9800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4ea66883e4e78d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:31.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.504+0000 7fbda5ffb700 1 -- 172.21.15.154:0/3405794593 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800be60 con 0x7fbda80cbf30 2023-10-10T21:17:31.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.504+0000 7fbda5ffb700 1 -- 172.21.15.154:0/3405794593 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9800ddc0 con 0x7fbda80cbf30 2023-10-10T21:17:31.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.504+0000 7fbda5ffb700 1 -- 172.21.15.154:0/3405794593 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980196b0 con 0x7fbda80cbf30 2023-10-10T21:17:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.505+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3405794593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80cbf30 msgr2=0x7fbda80ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.505+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/3405794593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80cbf30 0x7fbda80ae410 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbda806d670 tx=0x7fbd9800b4f0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.505+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3405794593 shutdown_connections 2023-10-10T21:17:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.505+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/3405794593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80cbf30 0x7fbda80ae410 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.505+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/3405794593 >> v2:172.21.15.179:3300/0 conn(0x7fbda80ccf90 0x7fbda80b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.505+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3405794593 >> 172.21.15.154:0/3405794593 conn(0x7fbda806a320 msgr2=0x7fbda80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.505+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3405794593 shutdown_connections 2023-10-10T21:17:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.505+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3405794593 wait complete. 2023-10-10T21:17:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.506+0000 7fbdad3ff700 1 Processor -- start 2023-10-10T21:17:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.507+0000 7fbdad3ff700 1 -- start start 2023-10-10T21:17:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.507+0000 7fbdad3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cbf30 0x7fbda81561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.507+0000 7fbdad3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80ccf90 0x7fbda8169c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.507+0000 7fbdad3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbda815a270 0x7fbda80c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.507+0000 7fbdad3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8156730 con 0x7fbda80ccf90 2023-10-10T21:17:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.507+0000 7fbdad3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80c46f0 con 0x7fbda80cbf30 2023-10-10T21:17:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.507+0000 7fbdad3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80c49d0 con 0x7fbda815a270 2023-10-10T21:17:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80ccf90 0x7fbda8169c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80ccf90 0x7fbda8169c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58124/0 (socket says 172.21.15.154:58124) 2023-10-10T21:17:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda67fc700 1 -- 172.21.15.154:0/101300928 learned_addr learned my addr 172.21.15.154:0/101300928 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cbf30 0x7fbda81561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda77fe700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbda815a270 0x7fbda80c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda67fc700 1 -- 172.21.15.154:0/101300928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbda815a270 msgr2=0x7fbda80c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda67fc700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbda815a270 0x7fbda80c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda67fc700 1 -- 172.21.15.154:0/101300928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cbf30 msgr2=0x7fbda81561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda67fc700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cbf30 0x7fbda81561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda67fc700 1 -- 172.21.15.154:0/101300928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9800b790 con 0x7fbda80ccf90 2023-10-10T21:17:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cbf30 0x7fbda81561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.508+0000 7fbda67fc700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80ccf90 0x7fbda8169c90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00e8d0 tx=0x7fbd9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.509+0000 7fbd8effd700 1 -- 172.21.15.154:0/101300928 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00ee70 con 0x7fbda80ccf90 2023-10-10T21:17:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.509+0000 7fbd8effd700 1 -- 172.21.15.154:0/101300928 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c00c5e0 con 0x7fbda80ccf90 2023-10-10T21:17:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.509+0000 7fbd8effd700 1 -- 172.21.15.154:0/101300928 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00c980 con 0x7fbda80ccf90 2023-10-10T21:17:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.509+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda816a510 con 0x7fbda80ccf90 2023-10-10T21:17:31.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.509+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda816aad0 con 0x7fbda80ccf90 2023-10-10T21:17:31.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.510+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda80b1a10 con 0x7fbda80ccf90 2023-10-10T21:17:31.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.511+0000 7fbd8effd700 1 -- 172.21.15.154:0/101300928 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd9c00cd30 con 0x7fbda80ccf90 2023-10-10T21:17:31.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.512+0000 7fbd8effd700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbd94066f30 0x7fbd940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.512+0000 7fbd8effd700 1 -- 172.21.15.154:0/101300928 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fbd9c084460 con 0x7fbda80ccf90 2023-10-10T21:17:31.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.512+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbd94066f30 0x7fbd940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.513+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbd94066f30 0x7fbd940693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbda806d670 tx=0x7fbd9801b000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:31.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.516+0000 7fbd8effd700 1 -- 172.21.15.154:0/101300928 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd9c051540 con 0x7fbda80ccf90 2023-10-10T21:17:31.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.702+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbda804c3c0 con 0x7fbd94066f30 2023-10-10T21:17:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.710+0000 7fbd8effd700 1 -- 172.21.15.154:0/101300928 <== mgr.6063 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289026 (secure 0 0 0) 0x7fbda804c3c0 con 0x7fbd94066f30 2023-10-10T21:17:31.716 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbd94066f30 msgr2=0x7fbd940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbd94066f30 0x7fbd940693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbda806d670 tx=0x7fbd9801b000 comp rx=0 tx=0).stop 2023-10-10T21:17:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80ccf90 msgr2=0x7fbda8169c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80ccf90 0x7fbda8169c90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00e8d0 tx=0x7fbd9c008040 comp rx=0 tx=0).stop 2023-10-10T21:17:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 shutdown_connections 2023-10-10T21:17:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbda815a270 0x7fbda80c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbd94066f30 0x7fbd940693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cbf30 0x7fbda81561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/101300928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80ccf90 0x7fbda8169c90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 >> 172.21.15.154:0/101300928 conn(0x7fbda806a320 msgr2=0x7fbda8159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 shutdown_connections 2023-10-10T21:17:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.715+0000 7fbdad3ff700 1 -- 172.21.15.154:0/101300928 wait complete. 2023-10-10T21:17:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:17:31.734 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-10T21:17:29.905138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432200,"kb_used_data":8840,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752542520,"statfs":{"total":773094113280,"available":770603540480,"internally_reserved":0,"allocated":9052160,"data_stored":4909876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001766"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120312+0000","last_change":"2023-10-10T21:17:22.115843+0000","last_active":"2023-10-10T21:17:22.120312+0000","last_peered":"2023-10-10T21:17:22.120312+0000","last_clean":"2023-10-10T21:17:22.120312+0000","last_became_active":"2023-10-10T21:17:22.115575+0000","last_became_peered":"2023-10-10T21:17:22.115575+0000","last_unstale":"2023-10-10T21:17:22.120312+0000","last_undegraded":"2023-10-10T21:17:22.120312+0000","last_fullsized":"2023-10-10T21:17:22.120312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:47:44.446813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130785+0000","last_change":"2023-10-10T21:17:22.128294+0000","last_active":"2023-10-10T21:17:22.130785+0000","last_peered":"2023-10-10T21:17:22.130785+0000","last_clean":"2023-10-10T21:17:22.130785+0000","last_became_active":"2023-10-10T21:17:22.128005+0000","last_became_peered":"2023-10-10T21:17:22.128005+0000","last_unstale":"2023-10-10T21:17:22.130785+0000","last_undegraded":"2023-10-10T21:17:22.130785+0000","last_fullsized":"2023-10-10T21:17:22.130785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:40:31.293324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.135261+0000","last_change":"2023-10-10T21:17:22.130059+0000","last_active":"2023-10-10T21:17:22.135261+0000","last_peered":"2023-10-10T21:17:22.135261+0000","last_clean":"2023-10-10T21:17:22.135261+0000","last_became_active":"2023-10-10T21:17:22.129809+0000","last_became_peered":"2023-10-10T21:17:22.129809+0000","last_unstale":"2023-10-10T21:17:22.135261+0000","last_undegraded":"2023-10-10T21:17:22.135261+0000","last_fullsized":"2023-10-10T21:17:22.135261+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:13.761233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136448+0000","last_change":"2023-10-10T21:17:22.132183+0000","last_active":"2023-10-10T21:17:22.136448+0000","last_peered":"2023-10-10T21:17:22.136448+0000","last_clean":"2023-10-10T21:17:22.136448+0000","last_became_active":"2023-10-10T21:17:22.129309+0000","last_became_peered":"2023-10-10T21:17:22.129309+0000","last_unstale":"2023-10-10T21:17:22.136448+0000","last_undegraded":"2023-10-10T21:17:22.136448+0000","last_fullsized":"2023-10-10T21:17:22.136448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:48:45.097688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133303+0000","last_change":"2023-10-10T21:17:22.130045+0000","last_active":"2023-10-10T21:17:22.133303+0000","last_peered":"2023-10-10T21:17:22.133303+0000","last_clean":"2023-10-10T21:17:22.133303+0000","last_became_active":"2023-10-10T21:17:22.129693+0000","last_became_peered":"2023-10-10T21:17:22.129693+0000","last_unstale":"2023-10-10T21:17:22.133303+0000","last_undegraded":"2023-10-10T21:17:22.133303+0000","last_fullsized":"2023-10-10T21:17:22.133303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:46:57.495512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.131879+0000","last_change":"2023-10-10T21:17:22.130808+0000","last_active":"2023-10-10T21:17:22.131879+0000","last_peered":"2023-10-10T21:17:22.131879+0000","last_clean":"2023-10-10T21:17:22.131879+0000","last_became_active":"2023-10-10T21:17:22.130493+0000","last_became_peered":"2023-10-10T21:17:22.130493+0000","last_unstale":"2023-10-10T21:17:22.131879+0000","last_undegraded":"2023-10-10T21:17:22.131879+0000","last_fullsized":"2023-10-10T21:17:22.131879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:45:03.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130770+0000","last_change":"2023-10-10T21:17:22.128884+0000","last_active":"2023-10-10T21:17:22.130770+0000","last_peered":"2023-10-10T21:17:22.130770+0000","last_clean":"2023-10-10T21:17:22.130770+0000","last_became_active":"2023-10-10T21:17:22.128618+0000","last_became_peered":"2023-10-10T21:17:22.128618+0000","last_unstale":"2023-10-10T21:17:22.130770+0000","last_undegraded":"2023-10-10T21:17:22.130770+0000","last_fullsized":"2023-10-10T21:17:22.130770+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:57:05.794362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126358+0000","last_change":"2023-10-10T21:17:22.123593+0000","last_active":"2023-10-10T21:17:22.126358+0000","last_peered":"2023-10-10T21:17:22.126358+0000","last_clean":"2023-10-10T21:17:22.126358+0000","last_became_active":"2023-10-10T21:17:22.123331+0000","last_became_peered":"2023-10-10T21:17:22.123331+0000","last_unstale":"2023-10-10T21:17:22.126358+0000","last_undegraded":"2023-10-10T21:17:22.126358+0000","last_fullsized":"2023-10-10T21:17:22.126358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:32:54.593442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130155+0000","last_change":"2023-10-10T21:17:22.127917+0000","last_active":"2023-10-10T21:17:22.130155+0000","last_peered":"2023-10-10T21:17:22.130155+0000","last_clean":"2023-10-10T21:17:22.130155+0000","last_became_active":"2023-10-10T21:17:22.127535+0000","last_became_peered":"2023-10-10T21:17:22.127535+0000","last_unstale":"2023-10-10T21:17:22.130155+0000","last_undegraded":"2023-10-10T21:17:22.130155+0000","last_fullsized":"2023-10-10T21:17:22.130155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:42.714118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124611+0000","last_change":"2023-10-10T21:17:22.117278+0000","last_active":"2023-10-10T21:17:22.124611+0000","last_peered":"2023-10-10T21:17:22.124611+0000","last_clean":"2023-10-10T21:17:22.124611+0000","last_became_active":"2023-10-10T21:17:22.117007+0000","last_became_peered":"2023-10-10T21:17:22.117007+0000","last_unstale":"2023-10-10T21:17:22.124611+0000","last_undegraded":"2023-10-10T21:17:22.124611+0000","last_fullsized":"2023-10-10T21:17:22.124611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:45:07.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.124875+0000","last_change":"2023-10-10T21:17:22.120210+0000","last_active":"2023-10-10T21:17:22.124875+0000","last_peered":"2023-10-10T21:17:22.124875+0000","last_clean":"2023-10-10T21:17:22.124875+0000","last_became_active":"2023-10-10T21:17:22.119950+0000","last_became_peered":"2023-10-10T21:17:22.119950+0000","last_unstale":"2023-10-10T21:17:22.124875+0000","last_undegraded":"2023-10-10T21:17:22.124875+0000","last_fullsized":"2023-10-10T21:17:22.124875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:18.967395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134404+0000","last_change":"2023-10-10T21:17:22.124351+0000","last_active":"2023-10-10T21:17:22.134404+0000","last_peered":"2023-10-10T21:17:22.134404+0000","last_clean":"2023-10-10T21:17:22.134404+0000","last_became_active":"2023-10-10T21:17:22.124076+0000","last_became_peered":"2023-10-10T21:17:22.124076+0000","last_unstale":"2023-10-10T21:17:22.134404+0000","last_undegraded":"2023-10-10T21:17:22.134404+0000","last_fullsized":"2023-10-10T21:17:22.134404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:02.566076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.121107+0000","last_change":"2023-10-10T21:17:22.117841+0000","last_active":"2023-10-10T21:17:22.121107+0000","last_peered":"2023-10-10T21:17:22.121107+0000","last_clean":"2023-10-10T21:17:22.121107+0000","last_became_active":"2023-10-10T21:17:22.117597+0000","last_became_peered":"2023-10-10T21:17:22.117597+0000","last_unstale":"2023-10-10T21:17:22.121107+0000","last_undegraded":"2023-10-10T21:17:22.121107+0000","last_fullsized":"2023-10-10T21:17:22.121107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:46.957429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123556+0000","last_change":"2023-10-10T21:17:22.118527+0000","last_active":"2023-10-10T21:17:22.123556+0000","last_peered":"2023-10-10T21:17:22.123556+0000","last_clean":"2023-10-10T21:17:22.123556+0000","last_became_active":"2023-10-10T21:17:22.118267+0000","last_became_peered":"2023-10-10T21:17:22.118267+0000","last_unstale":"2023-10-10T21:17:22.123556+0000","last_undegraded":"2023-10-10T21:17:22.123556+0000","last_fullsized":"2023-10-10T21:17:22.123556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:44:18.482531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123520+0000","last_change":"2023-10-10T21:17:22.118081+0000","last_active":"2023-10-10T21:17:22.123520+0000","last_peered":"2023-10-10T21:17:22.123520+0000","last_clean":"2023-10-10T21:17:22.123520+0000","last_became_active":"2023-10-10T21:17:22.117816+0000","last_became_peered":"2023-10-10T21:17:22.117816+0000","last_unstale":"2023-10-10T21:17:22.123520+0000","last_undegraded":"2023-10-10T21:17:22.123520+0000","last_fullsized":"2023-10-10T21:17:22.123520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:07.524278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130380+0000","last_change":"2023-10-10T21:17:22.129225+0000","last_active":"2023-10-10T21:17:22.130380+0000","last_peered":"2023-10-10T21:17:22.130380+0000","last_clean":"2023-10-10T21:17:22.130380+0000","last_became_active":"2023-10-10T21:17:22.128916+0000","last_became_peered":"2023-10-10T21:17:22.128916+0000","last_unstale":"2023-10-10T21:17:22.130380+0000","last_undegraded":"2023-10-10T21:17:22.130380+0000","last_fullsized":"2023-10-10T21:17:22.130380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:52.331235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125675+0000","last_change":"2023-10-10T21:17:22.122283+0000","last_active":"2023-10-10T21:17:22.125675+0000","last_peered":"2023-10-10T21:17:22.125675+0000","last_clean":"2023-10-10T21:17:22.125675+0000","last_became_active":"2023-10-10T21:17:22.122017+0000","last_became_peered":"2023-10-10T21:17:22.122017+0000","last_unstale":"2023-10-10T21:17:22.125675+0000","last_undegraded":"2023-10-10T21:17:22.125675+0000","last_fullsized":"2023-10-10T21:17:22.125675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:20.043886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126448+0000","last_change":"2023-10-10T21:17:22.119216+0000","last_active":"2023-10-10T21:17:22.126448+0000","last_peered":"2023-10-10T21:17:22.126448+0000","last_clean":"2023-10-10T21:17:22.126448+0000","last_became_active":"2023-10-10T21:17:22.118926+0000","last_became_peered":"2023-10-10T21:17:22.118926+0000","last_unstale":"2023-10-10T21:17:22.126448+0000","last_undegraded":"2023-10-10T21:17:22.126448+0000","last_fullsized":"2023-10-10T21:17:22.126448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:52.331235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.119814+0000","last_change":"2023-10-10T21:17:22.115157+0000","last_active":"2023-10-10T21:17:22.119814+0000","last_peered":"2023-10-10T21:17:22.119814+0000","last_clean":"2023-10-10T21:17:22.119814+0000","last_became_active":"2023-10-10T21:17:22.114892+0000","last_became_peered":"2023-10-10T21:17:22.114892+0000","last_unstale":"2023-10-10T21:17:22.119814+0000","last_undegraded":"2023-10-10T21:17:22.119814+0000","last_fullsized":"2023-10-10T21:17:22.119814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:27.875920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130792+0000","last_change":"2023-10-10T21:17:22.129274+0000","last_active":"2023-10-10T21:17:22.130792+0000","last_peered":"2023-10-10T21:17:22.130792+0000","last_clean":"2023-10-10T21:17:22.130792+0000","last_became_active":"2023-10-10T21:17:22.128901+0000","last_became_peered":"2023-10-10T21:17:22.128901+0000","last_unstale":"2023-10-10T21:17:22.130792+0000","last_undegraded":"2023-10-10T21:17:22.130792+0000","last_fullsized":"2023-10-10T21:17:22.130792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:44.298941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.144002+0000","last_change":"2023-10-10T21:17:22.139331+0000","last_active":"2023-10-10T21:17:22.144002+0000","last_peered":"2023-10-10T21:17:22.144002+0000","last_clean":"2023-10-10T21:17:22.144002+0000","last_became_active":"2023-10-10T21:17:22.139057+0000","last_became_peered":"2023-10-10T21:17:22.139057+0000","last_unstale":"2023-10-10T21:17:22.144002+0000","last_undegraded":"2023-10-10T21:17:22.144002+0000","last_fullsized":"2023-10-10T21:17:22.144002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:53.973755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125704+0000","last_change":"2023-10-10T21:17:22.122632+0000","last_active":"2023-10-10T21:17:22.125704+0000","last_peered":"2023-10-10T21:17:22.125704+0000","last_clean":"2023-10-10T21:17:22.125704+0000","last_became_active":"2023-10-10T21:17:22.122206+0000","last_became_peered":"2023-10-10T21:17:22.122206+0000","last_unstale":"2023-10-10T21:17:22.125704+0000","last_undegraded":"2023-10-10T21:17:22.125704+0000","last_fullsized":"2023-10-10T21:17:22.125704+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:49:14.111746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136254+0000","last_change":"2023-10-10T21:17:22.133079+0000","last_active":"2023-10-10T21:17:22.136254+0000","last_peered":"2023-10-10T21:17:22.136254+0000","last_clean":"2023-10-10T21:17:22.136254+0000","last_became_active":"2023-10-10T21:17:22.131464+0000","last_became_peered":"2023-10-10T21:17:22.131464+0000","last_unstale":"2023-10-10T21:17:22.136254+0000","last_undegraded":"2023-10-10T21:17:22.136254+0000","last_fullsized":"2023-10-10T21:17:22.136254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:28.435380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.121570+0000","last_change":"2023-10-10T21:17:22.117198+0000","last_active":"2023-10-10T21:17:22.121570+0000","last_peered":"2023-10-10T21:17:22.121570+0000","last_clean":"2023-10-10T21:17:22.121570+0000","last_became_active":"2023-10-10T21:17:22.116938+0000","last_became_peered":"2023-10-10T21:17:22.116938+0000","last_unstale":"2023-10-10T21:17:22.121570+0000","last_undegraded":"2023-10-10T21:17:22.121570+0000","last_fullsized":"2023-10-10T21:17:22.121570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:29:18.905751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.128015+0000","last_change":"2023-10-10T21:17:22.125884+0000","last_active":"2023-10-10T21:17:22.128015+0000","last_peered":"2023-10-10T21:17:22.128015+0000","last_clean":"2023-10-10T21:17:22.128015+0000","last_became_active":"2023-10-10T21:17:22.125606+0000","last_became_peered":"2023-10-10T21:17:22.125606+0000","last_unstale":"2023-10-10T21:17:22.128015+0000","last_undegraded":"2023-10-10T21:17:22.128015+0000","last_fullsized":"2023-10-10T21:17:22.128015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:49.550718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136543+0000","last_change":"2023-10-10T21:17:22.129786+0000","last_active":"2023-10-10T21:17:22.136543+0000","last_peered":"2023-10-10T21:17:22.136543+0000","last_clean":"2023-10-10T21:17:22.136543+0000","last_became_active":"2023-10-10T21:17:22.129508+0000","last_became_peered":"2023-10-10T21:17:22.129508+0000","last_unstale":"2023-10-10T21:17:22.136543+0000","last_undegraded":"2023-10-10T21:17:22.136543+0000","last_fullsized":"2023-10-10T21:17:22.136543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:54.513628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.130740+0000","last_change":"2023-10-10T21:17:22.129337+0000","last_active":"2023-10-10T21:17:22.130740+0000","last_peered":"2023-10-10T21:17:22.130740+0000","last_clean":"2023-10-10T21:17:22.130740+0000","last_became_active":"2023-10-10T21:17:22.129079+0000","last_became_peered":"2023-10-10T21:17:22.129079+0000","last_unstale":"2023-10-10T21:17:22.130740+0000","last_undegraded":"2023-10-10T21:17:22.130740+0000","last_fullsized":"2023-10-10T21:17:22.130740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:28.435380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133331+0000","last_change":"2023-10-10T21:17:22.130216+0000","last_active":"2023-10-10T21:17:22.133331+0000","last_peered":"2023-10-10T21:17:22.133331+0000","last_clean":"2023-10-10T21:17:22.133331+0000","last_became_active":"2023-10-10T21:17:22.129734+0000","last_became_peered":"2023-10-10T21:17:22.129734+0000","last_unstale":"2023-10-10T21:17:22.133331+0000","last_undegraded":"2023-10-10T21:17:22.133331+0000","last_fullsized":"2023-10-10T21:17:22.133331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:10.135356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139036+0000","last_change":"2023-10-10T21:17:22.135399+0000","last_active":"2023-10-10T21:17:22.139036+0000","last_peered":"2023-10-10T21:17:22.139036+0000","last_clean":"2023-10-10T21:17:22.139036+0000","last_became_active":"2023-10-10T21:17:22.135102+0000","last_became_peered":"2023-10-10T21:17:22.135102+0000","last_unstale":"2023-10-10T21:17:22.139036+0000","last_undegraded":"2023-10-10T21:17:22.139036+0000","last_fullsized":"2023-10-10T21:17:22.139036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:41.564999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133665+0000","last_change":"2023-10-10T21:17:22.128692+0000","last_active":"2023-10-10T21:17:22.133665+0000","last_peered":"2023-10-10T21:17:22.133665+0000","last_clean":"2023-10-10T21:17:22.133665+0000","last_became_active":"2023-10-10T21:17:22.128397+0000","last_became_peered":"2023-10-10T21:17:22.128397+0000","last_unstale":"2023-10-10T21:17:22.133665+0000","last_undegraded":"2023-10-10T21:17:22.133665+0000","last_fullsized":"2023-10-10T21:17:22.133665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:13.790306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120420+0000","last_change":"2023-10-10T21:17:22.117520+0000","last_active":"2023-10-10T21:17:22.120420+0000","last_peered":"2023-10-10T21:17:22.120420+0000","last_clean":"2023-10-10T21:17:22.120420+0000","last_became_active":"2023-10-10T21:17:22.117259+0000","last_became_peered":"2023-10-10T21:17:22.117259+0000","last_unstale":"2023-10-10T21:17:22.120420+0000","last_undegraded":"2023-10-10T21:17:22.120420+0000","last_fullsized":"2023-10-10T21:17:22.120420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:43.565186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127830+0000","last_change":"2023-10-10T21:17:22.125575+0000","last_active":"2023-10-10T21:17:22.127830+0000","last_peered":"2023-10-10T21:17:22.127830+0000","last_clean":"2023-10-10T21:17:22.127830+0000","last_became_active":"2023-10-10T21:17:22.125234+0000","last_became_peered":"2023-10-10T21:17:22.125234+0000","last_unstale":"2023-10-10T21:17:22.127830+0000","last_undegraded":"2023-10-10T21:17:22.127830+0000","last_fullsized":"2023-10-10T21:17:22.127830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:34:00.644220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123193+0000","last_change":"2023-10-10T21:17:22.120461+0000","last_active":"2023-10-10T21:17:22.123193+0000","last_peered":"2023-10-10T21:17:22.123193+0000","last_clean":"2023-10-10T21:17:22.123193+0000","last_became_active":"2023-10-10T21:17:22.120180+0000","last_became_peered":"2023-10-10T21:17:22.120180+0000","last_unstale":"2023-10-10T21:17:22.123193+0000","last_undegraded":"2023-10-10T21:17:22.123193+0000","last_fullsized":"2023-10-10T21:17:22.123193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:13.790306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.142034+0000","last_change":"2023-10-10T21:17:21.110380+0000","last_active":"2023-10-10T21:17:22.142034+0000","last_peered":"2023-10-10T21:17:22.142034+0000","last_clean":"2023-10-10T21:17:22.142034+0000","last_became_active":"2023-10-10T21:17:21.110146+0000","last_became_peered":"2023-10-10T21:17:21.110146+0000","last_unstale":"2023-10-10T21:17:22.142034+0000","last_undegraded":"2023-10-10T21:17:22.142034+0000","last_fullsized":"2023-10-10T21:17:22.142034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125033+0000","last_change":"2023-10-10T21:17:22.119505+0000","last_active":"2023-10-10T21:17:22.125033+0000","last_peered":"2023-10-10T21:17:22.125033+0000","last_clean":"2023-10-10T21:17:22.125033+0000","last_became_active":"2023-10-10T21:17:22.119224+0000","last_became_peered":"2023-10-10T21:17:22.119224+0000","last_unstale":"2023-10-10T21:17:22.125033+0000","last_undegraded":"2023-10-10T21:17:22.125033+0000","last_fullsized":"2023-10-10T21:17:22.125033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:00:07.895891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139718+0000","last_change":"2023-10-10T21:17:21.111302+0000","last_active":"2023-10-10T21:17:22.139718+0000","last_peered":"2023-10-10T21:17:22.139718+0000","last_clean":"2023-10-10T21:17:22.139718+0000","last_became_active":"2023-10-10T21:17:21.109679+0000","last_became_peered":"2023-10-10T21:17:21.109679+0000","last_unstale":"2023-10-10T21:17:22.139718+0000","last_undegraded":"2023-10-10T21:17:22.139718+0000","last_fullsized":"2023-10-10T21:17:22.139718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:29.027774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134656+0000","last_change":"2023-10-10T21:17:22.131469+0000","last_active":"2023-10-10T21:17:22.134656+0000","last_peered":"2023-10-10T21:17:22.134656+0000","last_clean":"2023-10-10T21:17:22.134656+0000","last_became_active":"2023-10-10T21:17:22.130839+0000","last_became_peered":"2023-10-10T21:17:22.130839+0000","last_unstale":"2023-10-10T21:17:22.134656+0000","last_undegraded":"2023-10-10T21:17:22.134656+0000","last_fullsized":"2023-10-10T21:17:22.134656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:02.566076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139455+0000","last_change":"2023-10-10T21:17:21.105421+0000","last_active":"2023-10-10T21:17:22.139455+0000","last_peered":"2023-10-10T21:17:22.139455+0000","last_clean":"2023-10-10T21:17:22.139455+0000","last_became_active":"2023-10-10T21:17:21.104957+0000","last_became_peered":"2023-10-10T21:17:21.104957+0000","last_unstale":"2023-10-10T21:17:22.139455+0000","last_undegraded":"2023-10-10T21:17:22.139455+0000","last_fullsized":"2023-10-10T21:17:22.139455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140395+0000","last_change":"2023-10-10T21:17:22.138180+0000","last_active":"2023-10-10T21:17:22.140395+0000","last_peered":"2023-10-10T21:17:22.140395+0000","last_clean":"2023-10-10T21:17:22.140395+0000","last_became_active":"2023-10-10T21:17:22.137905+0000","last_became_peered":"2023-10-10T21:17:22.137905+0000","last_unstale":"2023-10-10T21:17:22.140395+0000","last_undegraded":"2023-10-10T21:17:22.140395+0000","last_fullsized":"2023-10-10T21:17:22.140395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:53.511832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.144448+0000","last_change":"2023-10-10T21:17:21.114324+0000","last_active":"2023-10-10T21:17:22.144448+0000","last_peered":"2023-10-10T21:17:22.144448+0000","last_clean":"2023-10-10T21:17:22.144448+0000","last_became_active":"2023-10-10T21:17:21.113995+0000","last_became_peered":"2023-10-10T21:17:21.113995+0000","last_unstale":"2023-10-10T21:17:22.144448+0000","last_undegraded":"2023-10-10T21:17:22.144448+0000","last_fullsized":"2023-10-10T21:17:22.144448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:29.991865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.122719+0000","last_change":"2023-10-10T21:17:22.120590+0000","last_active":"2023-10-10T21:17:22.122719+0000","last_peered":"2023-10-10T21:17:22.122719+0000","last_clean":"2023-10-10T21:17:22.122719+0000","last_became_active":"2023-10-10T21:17:22.120332+0000","last_became_peered":"2023-10-10T21:17:22.120332+0000","last_unstale":"2023-10-10T21:17:22.122719+0000","last_undegraded":"2023-10-10T21:17:22.122719+0000","last_fullsized":"2023-10-10T21:17:22.122719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:29.688214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.138193+0000","last_change":"2023-10-10T21:17:21.111800+0000","last_active":"2023-10-10T21:17:22.138193+0000","last_peered":"2023-10-10T21:17:22.138193+0000","last_clean":"2023-10-10T21:17:22.138193+0000","last_became_active":"2023-10-10T21:17:21.111532+0000","last_became_peered":"2023-10-10T21:17:21.111532+0000","last_unstale":"2023-10-10T21:17:22.138193+0000","last_undegraded":"2023-10-10T21:17:22.138193+0000","last_fullsized":"2023-10-10T21:17:22.138193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:41:58.143202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.132205+0000","last_change":"2023-10-10T21:17:22.129664+0000","last_active":"2023-10-10T21:17:22.132205+0000","last_peered":"2023-10-10T21:17:22.132205+0000","last_clean":"2023-10-10T21:17:22.132205+0000","last_became_active":"2023-10-10T21:17:22.129392+0000","last_became_peered":"2023-10-10T21:17:22.129392+0000","last_unstale":"2023-10-10T21:17:22.132205+0000","last_undegraded":"2023-10-10T21:17:22.132205+0000","last_fullsized":"2023-10-10T21:17:22.132205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:37:26.419533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139710+0000","last_change":"2023-10-10T21:17:21.104091+0000","last_active":"2023-10-10T21:17:22.139710+0000","last_peered":"2023-10-10T21:17:22.139710+0000","last_clean":"2023-10-10T21:17:22.139710+0000","last_became_active":"2023-10-10T21:17:21.103772+0000","last_became_peered":"2023-10-10T21:17:21.103772+0000","last_unstale":"2023-10-10T21:17:22.139710+0000","last_undegraded":"2023-10-10T21:17:22.139710+0000","last_fullsized":"2023-10-10T21:17:22.139710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:17:09.167468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126710+0000","last_change":"2023-10-10T21:17:22.121437+0000","last_active":"2023-10-10T21:17:22.126710+0000","last_peered":"2023-10-10T21:17:22.126710+0000","last_clean":"2023-10-10T21:17:22.126710+0000","last_became_active":"2023-10-10T21:17:22.120627+0000","last_became_peered":"2023-10-10T21:17:22.120627+0000","last_unstale":"2023-10-10T21:17:22.126710+0000","last_undegraded":"2023-10-10T21:17:22.126710+0000","last_fullsized":"2023-10-10T21:17:22.126710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:28:44.264117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.109286+0000","last_change":"2023-10-10T21:17:21.117087+0000","last_active":"2023-10-10T21:17:22.109286+0000","last_peered":"2023-10-10T21:17:22.109286+0000","last_clean":"2023-10-10T21:17:22.109286+0000","last_became_active":"2023-10-10T21:17:21.116820+0000","last_became_peered":"2023-10-10T21:17:21.116820+0000","last_unstale":"2023-10-10T21:17:22.109286+0000","last_undegraded":"2023-10-10T21:17:22.109286+0000","last_fullsized":"2023-10-10T21:17:22.109286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:29:13.413040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.120843+0000","last_change":"2023-10-10T21:17:22.118158+0000","last_active":"2023-10-10T21:17:22.120843+0000","last_peered":"2023-10-10T21:17:22.120843+0000","last_clean":"2023-10-10T21:17:22.120843+0000","last_became_active":"2023-10-10T21:17:22.117833+0000","last_became_peered":"2023-10-10T21:17:22.117833+0000","last_unstale":"2023-10-10T21:17:22.120843+0000","last_undegraded":"2023-10-10T21:17:22.120843+0000","last_fullsized":"2023-10-10T21:17:22.120843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:02:00.520880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.106776+0000","last_change":"2023-10-10T21:17:21.107669+0000","last_active":"2023-10-10T21:17:22.106776+0000","last_peered":"2023-10-10T21:17:22.106776+0000","last_clean":"2023-10-10T21:17:22.106776+0000","last_became_active":"2023-10-10T21:17:21.107381+0000","last_became_peered":"2023-10-10T21:17:21.107381+0000","last_unstale":"2023-10-10T21:17:22.106776+0000","last_undegraded":"2023-10-10T21:17:22.106776+0000","last_fullsized":"2023-10-10T21:17:22.106776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:19:29.467260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129082+0000","last_change":"2023-10-10T21:17:22.127136+0000","last_active":"2023-10-10T21:17:22.129082+0000","last_peered":"2023-10-10T21:17:22.129082+0000","last_clean":"2023-10-10T21:17:22.129082+0000","last_became_active":"2023-10-10T21:17:22.126876+0000","last_became_peered":"2023-10-10T21:17:22.126876+0000","last_unstale":"2023-10-10T21:17:22.129082+0000","last_undegraded":"2023-10-10T21:17:22.129082+0000","last_fullsized":"2023-10-10T21:17:22.129082+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:27:57.520144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.113390+0000","last_change":"2023-10-10T21:17:21.111997+0000","last_active":"2023-10-10T21:17:22.113390+0000","last_peered":"2023-10-10T21:17:22.113390+0000","last_clean":"2023-10-10T21:17:22.113390+0000","last_became_active":"2023-10-10T21:17:21.111721+0000","last_became_peered":"2023-10-10T21:17:21.111721+0000","last_unstale":"2023-10-10T21:17:22.113390+0000","last_undegraded":"2023-10-10T21:17:22.113390+0000","last_fullsized":"2023-10-10T21:17:22.113390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:41.329697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.138705+0000","last_change":"2023-10-10T21:17:22.135717+0000","last_active":"2023-10-10T21:17:22.138705+0000","last_peered":"2023-10-10T21:17:22.138705+0000","last_clean":"2023-10-10T21:17:22.138705+0000","last_became_active":"2023-10-10T21:17:22.135223+0000","last_became_peered":"2023-10-10T21:17:22.135223+0000","last_unstale":"2023-10-10T21:17:22.138705+0000","last_undegraded":"2023-10-10T21:17:22.138705+0000","last_fullsized":"2023-10-10T21:17:22.138705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:31:51.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118476+0000","last_change":"2023-10-10T21:17:21.111763+0000","last_active":"2023-10-10T21:17:22.118476+0000","last_peered":"2023-10-10T21:17:22.118476+0000","last_clean":"2023-10-10T21:17:22.118476+0000","last_became_active":"2023-10-10T21:17:21.111518+0000","last_became_peered":"2023-10-10T21:17:21.111518+0000","last_unstale":"2023-10-10T21:17:22.118476+0000","last_undegraded":"2023-10-10T21:17:22.118476+0000","last_fullsized":"2023-10-10T21:17:22.118476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:01:00.565221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126465+0000","last_change":"2023-10-10T21:17:22.121020+0000","last_active":"2023-10-10T21:17:22.126465+0000","last_peered":"2023-10-10T21:17:22.126465+0000","last_clean":"2023-10-10T21:17:22.126465+0000","last_became_active":"2023-10-10T21:17:22.120556+0000","last_became_peered":"2023-10-10T21:17:22.120556+0000","last_unstale":"2023-10-10T21:17:22.126465+0000","last_undegraded":"2023-10-10T21:17:22.126465+0000","last_fullsized":"2023-10-10T21:17:22.126465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:18.893169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"80'3","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.141520+0000","last_change":"2023-10-10T21:17:21.113636+0000","last_active":"2023-10-10T21:17:22.141520+0000","last_peered":"2023-10-10T21:17:22.141520+0000","last_clean":"2023-10-10T21:17:22.141520+0000","last_became_active":"2023-10-10T21:17:21.113183+0000","last_became_peered":"2023-10-10T21:17:21.113183+0000","last_unstale":"2023-10-10T21:17:22.141520+0000","last_undegraded":"2023-10-10T21:17:22.141520+0000","last_fullsized":"2023-10-10T21:17:22.141520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:41.727455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.137932+0000","last_change":"2023-10-10T21:17:22.132195+0000","last_active":"2023-10-10T21:17:22.137932+0000","last_peered":"2023-10-10T21:17:22.137932+0000","last_clean":"2023-10-10T21:17:22.137932+0000","last_became_active":"2023-10-10T21:17:22.131304+0000","last_became_peered":"2023-10-10T21:17:22.131304+0000","last_unstale":"2023-10-10T21:17:22.137932+0000","last_undegraded":"2023-10-10T21:17:22.137932+0000","last_fullsized":"2023-10-10T21:17:22.137932+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:30:51.850002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"80'6","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.143755+0000","last_change":"2023-10-10T21:17:21.114400+0000","last_active":"2023-10-10T21:17:22.143755+0000","last_peered":"2023-10-10T21:17:22.143755+0000","last_clean":"2023-10-10T21:17:22.143755+0000","last_became_active":"2023-10-10T21:17:21.114089+0000","last_became_peered":"2023-10-10T21:17:21.114089+0000","last_unstale":"2023-10-10T21:17:22.143755+0000","last_undegraded":"2023-10-10T21:17:22.143755+0000","last_fullsized":"2023-10-10T21:17:22.143755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:29.991865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133458+0000","last_change":"2023-10-10T21:17:22.124297+0000","last_active":"2023-10-10T21:17:22.133458+0000","last_peered":"2023-10-10T21:17:22.133458+0000","last_clean":"2023-10-10T21:17:22.133458+0000","last_became_active":"2023-10-10T21:17:22.124000+0000","last_became_peered":"2023-10-10T21:17:22.124000+0000","last_unstale":"2023-10-10T21:17:22.133458+0000","last_undegraded":"2023-10-10T21:17:22.133458+0000","last_fullsized":"2023-10-10T21:17:22.133458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:06:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139085+0000","last_change":"2023-10-10T21:17:21.112845+0000","last_active":"2023-10-10T21:17:22.139085+0000","last_peered":"2023-10-10T21:17:22.139085+0000","last_clean":"2023-10-10T21:17:22.139085+0000","last_became_active":"2023-10-10T21:17:21.112572+0000","last_became_peered":"2023-10-10T21:17:21.112572+0000","last_unstale":"2023-10-10T21:17:22.139085+0000","last_undegraded":"2023-10-10T21:17:22.139085+0000","last_fullsized":"2023-10-10T21:17:22.139085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:25:28.217784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134814+0000","last_change":"2023-10-10T21:17:22.127757+0000","last_active":"2023-10-10T21:17:22.134814+0000","last_peered":"2023-10-10T21:17:22.134814+0000","last_clean":"2023-10-10T21:17:22.134814+0000","last_became_active":"2023-10-10T21:17:22.127049+0000","last_became_peered":"2023-10-10T21:17:22.127049+0000","last_unstale":"2023-10-10T21:17:22.134814+0000","last_undegraded":"2023-10-10T21:17:22.134814+0000","last_fullsized":"2023-10-10T21:17:22.134814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:02.566076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110716+0000","last_change":"2023-10-10T21:17:21.106041+0000","last_active":"2023-10-10T21:17:22.110716+0000","last_peered":"2023-10-10T21:17:22.110716+0000","last_clean":"2023-10-10T21:17:22.110716+0000","last_became_active":"2023-10-10T21:17:21.105741+0000","last_became_peered":"2023-10-10T21:17:21.105741+0000","last_unstale":"2023-10-10T21:17:22.110716+0000","last_undegraded":"2023-10-10T21:17:22.110716+0000","last_fullsized":"2023-10-10T21:17:22.110716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:45:06.671253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.128313+0000","last_change":"2023-10-10T21:17:22.126951+0000","last_active":"2023-10-10T21:17:22.128313+0000","last_peered":"2023-10-10T21:17:22.128313+0000","last_clean":"2023-10-10T21:17:22.128313+0000","last_became_active":"2023-10-10T21:17:22.126636+0000","last_became_peered":"2023-10-10T21:17:22.126636+0000","last_unstale":"2023-10-10T21:17:22.128313+0000","last_undegraded":"2023-10-10T21:17:22.128313+0000","last_fullsized":"2023-10-10T21:17:22.128313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:59:45.805481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.109333+0000","last_change":"2023-10-10T21:17:21.118436+0000","last_active":"2023-10-10T21:17:22.109333+0000","last_peered":"2023-10-10T21:17:22.109333+0000","last_clean":"2023-10-10T21:17:22.109333+0000","last_became_active":"2023-10-10T21:17:21.118108+0000","last_became_peered":"2023-10-10T21:17:21.118108+0000","last_unstale":"2023-10-10T21:17:22.109333+0000","last_undegraded":"2023-10-10T21:17:22.109333+0000","last_fullsized":"2023-10-10T21:17:22.109333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:41:58.143202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136234+0000","last_change":"2023-10-10T21:17:22.132671+0000","last_active":"2023-10-10T21:17:22.136234+0000","last_peered":"2023-10-10T21:17:22.136234+0000","last_clean":"2023-10-10T21:17:22.136234+0000","last_became_active":"2023-10-10T21:17:22.131067+0000","last_became_peered":"2023-10-10T21:17:22.131067+0000","last_unstale":"2023-10-10T21:17:22.136234+0000","last_undegraded":"2023-10-10T21:17:22.136234+0000","last_fullsized":"2023-10-10T21:17:22.136234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:53.511832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"80'8","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.144764+0000","last_change":"2023-10-10T21:17:21.115664+0000","last_active":"2023-10-10T21:17:22.144764+0000","last_peered":"2023-10-10T21:17:22.144764+0000","last_clean":"2023-10-10T21:17:22.144764+0000","last_became_active":"2023-10-10T21:17:21.115412+0000","last_became_peered":"2023-10-10T21:17:21.115412+0000","last_unstale":"2023-10-10T21:17:22.144764+0000","last_undegraded":"2023-10-10T21:17:22.144764+0000","last_fullsized":"2023-10-10T21:17:22.144764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:17:09.167468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133620+0000","last_change":"2023-10-10T21:17:22.129661+0000","last_active":"2023-10-10T21:17:22.133620+0000","last_peered":"2023-10-10T21:17:22.133620+0000","last_clean":"2023-10-10T21:17:22.133620+0000","last_became_active":"2023-10-10T21:17:22.129250+0000","last_became_peered":"2023-10-10T21:17:22.129250+0000","last_unstale":"2023-10-10T21:17:22.133620+0000","last_undegraded":"2023-10-10T21:17:22.133620+0000","last_fullsized":"2023-10-10T21:17:22.133620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:45:03.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139072+0000","last_change":"2023-10-10T21:17:21.109113+0000","last_active":"2023-10-10T21:17:22.139072+0000","last_peered":"2023-10-10T21:17:22.139072+0000","last_clean":"2023-10-10T21:17:22.139072+0000","last_became_active":"2023-10-10T21:17:21.106685+0000","last_became_peered":"2023-10-10T21:17:21.106685+0000","last_unstale":"2023-10-10T21:17:22.139072+0000","last_undegraded":"2023-10-10T21:17:22.139072+0000","last_fullsized":"2023-10-10T21:17:22.139072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:51:52.120571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.136601+0000","last_change":"2023-10-10T21:17:22.132622+0000","last_active":"2023-10-10T21:17:22.136601+0000","last_peered":"2023-10-10T21:17:22.136601+0000","last_clean":"2023-10-10T21:17:22.136601+0000","last_became_active":"2023-10-10T21:17:22.132194+0000","last_became_peered":"2023-10-10T21:17:22.132194+0000","last_unstale":"2023-10-10T21:17:22.136601+0000","last_undegraded":"2023-10-10T21:17:22.136601+0000","last_fullsized":"2023-10-10T21:17:22.136601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:23:29.301886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.139601+0000","last_change":"2023-10-10T21:17:21.112175+0000","last_active":"2023-10-10T21:17:22.139601+0000","last_peered":"2023-10-10T21:17:22.139601+0000","last_clean":"2023-10-10T21:17:22.139601+0000","last_became_active":"2023-10-10T21:17:21.111931+0000","last_became_peered":"2023-10-10T21:17:21.111931+0000","last_unstale":"2023-10-10T21:17:22.139601+0000","last_undegraded":"2023-10-10T21:17:22.139601+0000","last_fullsized":"2023-10-10T21:17:22.139601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:45:41.727455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.125643+0000","last_change":"2023-10-10T21:17:22.122912+0000","last_active":"2023-10-10T21:17:22.125643+0000","last_peered":"2023-10-10T21:17:22.125643+0000","last_clean":"2023-10-10T21:17:22.125643+0000","last_became_active":"2023-10-10T21:17:22.122663+0000","last_became_peered":"2023-10-10T21:17:22.122663+0000","last_unstale":"2023-10-10T21:17:22.125643+0000","last_undegraded":"2023-10-10T21:17:22.125643+0000","last_fullsized":"2023-10-10T21:17:22.125643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:53:40.085195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.144305+0000","last_change":"2023-10-10T21:17:21.113232+0000","last_active":"2023-10-10T21:17:22.144305+0000","last_peered":"2023-10-10T21:17:22.144305+0000","last_clean":"2023-10-10T21:17:22.144305+0000","last_became_active":"2023-10-10T21:17:21.112808+0000","last_became_peered":"2023-10-10T21:17:21.112808+0000","last_unstale":"2023-10-10T21:17:22.144305+0000","last_undegraded":"2023-10-10T21:17:22.144305+0000","last_fullsized":"2023-10-10T21:17:22.144305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:25.453111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.137951+0000","last_change":"2023-10-10T21:17:22.132401+0000","last_active":"2023-10-10T21:17:22.137951+0000","last_peered":"2023-10-10T21:17:22.137951+0000","last_clean":"2023-10-10T21:17:22.137951+0000","last_became_active":"2023-10-10T21:17:22.131777+0000","last_became_peered":"2023-10-10T21:17:22.131777+0000","last_unstale":"2023-10-10T21:17:22.137951+0000","last_undegraded":"2023-10-10T21:17:22.137951+0000","last_fullsized":"2023-10-10T21:17:22.137951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:34:00.644220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.108547+0000","last_change":"2023-10-10T21:17:21.116009+0000","last_active":"2023-10-10T21:17:22.108547+0000","last_peered":"2023-10-10T21:17:22.108547+0000","last_clean":"2023-10-10T21:17:22.108547+0000","last_became_active":"2023-10-10T21:17:21.115764+0000","last_became_peered":"2023-10-10T21:17:21.115764+0000","last_unstale":"2023-10-10T21:17:22.108547+0000","last_undegraded":"2023-10-10T21:17:22.108547+0000","last_fullsized":"2023-10-10T21:17:22.108547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:11:09.152293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127941+0000","last_change":"2023-10-10T21:17:22.117269+0000","last_active":"2023-10-10T21:17:22.127941+0000","last_peered":"2023-10-10T21:17:22.127941+0000","last_clean":"2023-10-10T21:17:22.127941+0000","last_became_active":"2023-10-10T21:17:22.116984+0000","last_became_peered":"2023-10-10T21:17:22.116984+0000","last_unstale":"2023-10-10T21:17:22.127941+0000","last_undegraded":"2023-10-10T21:17:22.127941+0000","last_fullsized":"2023-10-10T21:17:22.127941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:00:42.902712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.141309+0000","last_change":"2023-10-10T21:17:21.109031+0000","last_active":"2023-10-10T21:17:22.141309+0000","last_peered":"2023-10-10T21:17:22.141309+0000","last_clean":"2023-10-10T21:17:22.141309+0000","last_became_active":"2023-10-10T21:17:21.108292+0000","last_became_peered":"2023-10-10T21:17:21.108292+0000","last_unstale":"2023-10-10T21:17:22.141309+0000","last_undegraded":"2023-10-10T21:17:22.141309+0000","last_fullsized":"2023-10-10T21:17:22.141309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:15:17.264995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129441+0000","last_change":"2023-10-10T21:17:22.126967+0000","last_active":"2023-10-10T21:17:22.129441+0000","last_peered":"2023-10-10T21:17:22.129441+0000","last_clean":"2023-10-10T21:17:22.129441+0000","last_became_active":"2023-10-10T21:17:22.126688+0000","last_became_peered":"2023-10-10T21:17:22.126688+0000","last_unstale":"2023-10-10T21:17:22.129441+0000","last_undegraded":"2023-10-10T21:17:22.129441+0000","last_fullsized":"2023-10-10T21:17:22.129441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:06:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104746+0000","last_change":"2023-10-10T21:17:21.107533+0000","last_active":"2023-10-10T21:17:22.104746+0000","last_peered":"2023-10-10T21:17:22.104746+0000","last_clean":"2023-10-10T21:17:22.104746+0000","last_became_active":"2023-10-10T21:17:21.107293+0000","last_became_peered":"2023-10-10T21:17:21.107293+0000","last_unstale":"2023-10-10T21:17:22.104746+0000","last_undegraded":"2023-10-10T21:17:22.104746+0000","last_fullsized":"2023-10-10T21:17:22.104746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:59:15.822758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.123986+0000","last_change":"2023-10-10T21:17:22.121229+0000","last_active":"2023-10-10T21:17:22.123986+0000","last_peered":"2023-10-10T21:17:22.123986+0000","last_clean":"2023-10-10T21:17:22.123986+0000","last_became_active":"2023-10-10T21:17:22.120968+0000","last_became_peered":"2023-10-10T21:17:22.120968+0000","last_unstale":"2023-10-10T21:17:22.123986+0000","last_undegraded":"2023-10-10T21:17:22.123986+0000","last_fullsized":"2023-10-10T21:17:22.123986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:31:51.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.109501+0000","last_change":"2023-10-10T21:17:21.115386+0000","last_active":"2023-10-10T21:17:22.109501+0000","last_peered":"2023-10-10T21:17:22.109501+0000","last_clean":"2023-10-10T21:17:22.109501+0000","last_became_active":"2023-10-10T21:17:21.114903+0000","last_became_peered":"2023-10-10T21:17:21.114903+0000","last_unstale":"2023-10-10T21:17:22.109501+0000","last_undegraded":"2023-10-10T21:17:22.109501+0000","last_fullsized":"2023-10-10T21:17:22.109501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:19:29.467260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.134435+0000","last_change":"2023-10-10T21:17:22.122742+0000","last_active":"2023-10-10T21:17:22.134435+0000","last_peered":"2023-10-10T21:17:22.134435+0000","last_clean":"2023-10-10T21:17:22.134435+0000","last_became_active":"2023-10-10T21:17:22.122466+0000","last_became_peered":"2023-10-10T21:17:22.122466+0000","last_unstale":"2023-10-10T21:17:22.134435+0000","last_undegraded":"2023-10-10T21:17:22.134435+0000","last_fullsized":"2023-10-10T21:17:22.134435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:59:45.805481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.140519+0000","last_change":"2023-10-10T21:17:21.116165+0000","last_active":"2023-10-10T21:17:22.140519+0000","last_peered":"2023-10-10T21:17:22.140519+0000","last_clean":"2023-10-10T21:17:22.140519+0000","last_became_active":"2023-10-10T21:17:21.115910+0000","last_became_peered":"2023-10-10T21:17:21.115910+0000","last_unstale":"2023-10-10T21:17:22.140519+0000","last_undegraded":"2023-10-10T21:17:22.140519+0000","last_fullsized":"2023-10-10T21:17:22.140519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:35:48.191005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.133233+0000","last_change":"2023-10-10T21:17:22.126146+0000","last_active":"2023-10-10T21:17:22.133233+0000","last_peered":"2023-10-10T21:17:22.133233+0000","last_clean":"2023-10-10T21:17:22.133233+0000","last_became_active":"2023-10-10T21:17:22.125871+0000","last_became_peered":"2023-10-10T21:17:22.125871+0000","last_unstale":"2023-10-10T21:17:22.133233+0000","last_undegraded":"2023-10-10T21:17:22.133233+0000","last_fullsized":"2023-10-10T21:17:22.133233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:59:04.686826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110044+0000","last_change":"2023-10-10T21:17:21.107240+0000","last_active":"2023-10-10T21:17:22.110044+0000","last_peered":"2023-10-10T21:17:22.110044+0000","last_clean":"2023-10-10T21:17:22.110044+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.110044+0000","last_undegraded":"2023-10-10T21:17:22.110044+0000","last_fullsized":"2023-10-10T21:17:22.110044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:41.329697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.126446+0000","last_change":"2023-10-10T21:17:22.120807+0000","last_active":"2023-10-10T21:17:22.126446+0000","last_peered":"2023-10-10T21:17:22.126446+0000","last_clean":"2023-10-10T21:17:22.126446+0000","last_became_active":"2023-10-10T21:17:22.120231+0000","last_became_peered":"2023-10-10T21:17:22.120231+0000","last_unstale":"2023-10-10T21:17:22.126446+0000","last_undegraded":"2023-10-10T21:17:22.126446+0000","last_fullsized":"2023-10-10T21:17:22.126446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:39.969510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110305+0000","last_change":"2023-10-10T21:17:21.109362+0000","last_active":"2023-10-10T21:17:22.110305+0000","last_peered":"2023-10-10T21:17:22.110305+0000","last_clean":"2023-10-10T21:17:22.110305+0000","last_became_active":"2023-10-10T21:17:21.109065+0000","last_became_peered":"2023-10-10T21:17:21.109065+0000","last_unstale":"2023-10-10T21:17:22.110305+0000","last_undegraded":"2023-10-10T21:17:22.110305+0000","last_fullsized":"2023-10-10T21:17:22.110305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:16:38.964871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.138890+0000","last_change":"2023-10-10T21:17:22.135588+0000","last_active":"2023-10-10T21:17:22.138890+0000","last_peered":"2023-10-10T21:17:22.138890+0000","last_clean":"2023-10-10T21:17:22.138890+0000","last_became_active":"2023-10-10T21:17:22.135336+0000","last_became_peered":"2023-10-10T21:17:22.135336+0000","last_unstale":"2023-10-10T21:17:22.138890+0000","last_undegraded":"2023-10-10T21:17:22.138890+0000","last_fullsized":"2023-10-10T21:17:22.138890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:54.513628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110172+0000","last_change":"2023-10-10T21:17:21.116511+0000","last_active":"2023-10-10T21:17:22.110172+0000","last_peered":"2023-10-10T21:17:22.110172+0000","last_clean":"2023-10-10T21:17:22.110172+0000","last_became_active":"2023-10-10T21:17:21.116175+0000","last_became_peered":"2023-10-10T21:17:21.116175+0000","last_unstale":"2023-10-10T21:17:22.110172+0000","last_undegraded":"2023-10-10T21:17:22.110172+0000","last_fullsized":"2023-10-10T21:17:22.110172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:13.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127696+0000","last_change":"2023-10-10T21:17:22.126342+0000","last_active":"2023-10-10T21:17:22.127696+0000","last_peered":"2023-10-10T21:17:22.127696+0000","last_clean":"2023-10-10T21:17:22.127696+0000","last_became_active":"2023-10-10T21:17:22.126073+0000","last_became_peered":"2023-10-10T21:17:22.126073+0000","last_unstale":"2023-10-10T21:17:22.127696+0000","last_undegraded":"2023-10-10T21:17:22.127696+0000","last_fullsized":"2023-10-10T21:17:22.127696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:16.335987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104748+0000","last_change":"2023-10-10T21:17:21.114873+0000","last_active":"2023-10-10T21:17:22.104748+0000","last_peered":"2023-10-10T21:17:22.104748+0000","last_clean":"2023-10-10T21:17:22.104748+0000","last_became_active":"2023-10-10T21:17:21.114212+0000","last_became_peered":"2023-10-10T21:17:21.114212+0000","last_unstale":"2023-10-10T21:17:22.104748+0000","last_undegraded":"2023-10-10T21:17:22.104748+0000","last_fullsized":"2023-10-10T21:17:22.104748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:50:36.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127515+0000","last_change":"2023-10-10T21:17:22.121612+0000","last_active":"2023-10-10T21:17:22.127515+0000","last_peered":"2023-10-10T21:17:22.127515+0000","last_clean":"2023-10-10T21:17:22.127515+0000","last_became_active":"2023-10-10T21:17:22.121353+0000","last_became_peered":"2023-10-10T21:17:22.121353+0000","last_unstale":"2023-10-10T21:17:22.127515+0000","last_undegraded":"2023-10-10T21:17:22.127515+0000","last_fullsized":"2023-10-10T21:17:22.127515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:17:39.285584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.106936+0000","last_change":"2023-10-10T21:17:21.114183+0000","last_active":"2023-10-10T21:17:22.106936+0000","last_peered":"2023-10-10T21:17:22.106936+0000","last_clean":"2023-10-10T21:17:22.106936+0000","last_became_active":"2023-10-10T21:17:21.113784+0000","last_became_peered":"2023-10-10T21:17:21.113784+0000","last_unstale":"2023-10-10T21:17:22.106936+0000","last_undegraded":"2023-10-10T21:17:22.106936+0000","last_fullsized":"2023-10-10T21:17:22.106936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:29:13.413040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.127572+0000","last_change":"2023-10-10T21:17:22.121370+0000","last_active":"2023-10-10T21:17:22.127572+0000","last_peered":"2023-10-10T21:17:22.127572+0000","last_clean":"2023-10-10T21:17:22.127572+0000","last_became_active":"2023-10-10T21:17:22.117631+0000","last_became_peered":"2023-10-10T21:17:22.117631+0000","last_unstale":"2023-10-10T21:17:22.127572+0000","last_undegraded":"2023-10-10T21:17:22.127572+0000","last_fullsized":"2023-10-10T21:17:22.127572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:09:00.391451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.104781+0000","last_change":"2023-10-10T21:17:21.107269+0000","last_active":"2023-10-10T21:17:22.104781+0000","last_peered":"2023-10-10T21:17:22.104781+0000","last_clean":"2023-10-10T21:17:22.104781+0000","last_became_active":"2023-10-10T21:17:21.106987+0000","last_became_peered":"2023-10-10T21:17:21.106987+0000","last_unstale":"2023-10-10T21:17:22.104781+0000","last_undegraded":"2023-10-10T21:17:22.104781+0000","last_fullsized":"2023-10-10T21:17:22.104781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:23:20.098680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.118254+0000","last_change":"2023-10-10T21:17:22.113811+0000","last_active":"2023-10-10T21:17:22.118254+0000","last_peered":"2023-10-10T21:17:22.118254+0000","last_clean":"2023-10-10T21:17:22.118254+0000","last_became_active":"2023-10-10T21:17:22.113536+0000","last_became_peered":"2023-10-10T21:17:22.113536+0000","last_unstale":"2023-10-10T21:17:22.118254+0000","last_undegraded":"2023-10-10T21:17:22.118254+0000","last_fullsized":"2023-10-10T21:17:22.118254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:46.588070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.112091+0000","last_change":"2023-10-10T21:17:21.115869+0000","last_active":"2023-10-10T21:17:22.112091+0000","last_peered":"2023-10-10T21:17:22.112091+0000","last_clean":"2023-10-10T21:17:22.112091+0000","last_became_active":"2023-10-10T21:17:21.115625+0000","last_became_peered":"2023-10-10T21:17:21.115625+0000","last_unstale":"2023-10-10T21:17:22.112091+0000","last_undegraded":"2023-10-10T21:17:22.112091+0000","last_fullsized":"2023-10-10T21:17:22.112091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:14.597592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.129353+0000","last_change":"2023-10-10T21:17:22.126892+0000","last_active":"2023-10-10T21:17:22.129353+0000","last_peered":"2023-10-10T21:17:22.129353+0000","last_clean":"2023-10-10T21:17:22.129353+0000","last_became_active":"2023-10-10T21:17:22.126627+0000","last_became_peered":"2023-10-10T21:17:22.126627+0000","last_unstale":"2023-10-10T21:17:22.129353+0000","last_undegraded":"2023-10-10T21:17:22.129353+0000","last_fullsized":"2023-10-10T21:17:22.129353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:21.088145+0000","last_clean_scrub_stamp":"2023-10-10T21:17:21.088145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:39:59.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.110142+0000","last_change":"2023-10-10T21:17:21.115248+0000","last_active":"2023-10-10T21:17:22.110142+0000","last_peered":"2023-10-10T21:17:22.110142+0000","last_clean":"2023-10-10T21:17:22.110142+0000","last_became_active":"2023-10-10T21:17:21.114947+0000","last_became_peered":"2023-10-10T21:17:21.114947+0000","last_unstale":"2023-10-10T21:17:22.110142+0000","last_undegraded":"2023-10-10T21:17:22.110142+0000","last_fullsized":"2023-10-10T21:17:22.110142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:17:20.083505+0000","last_clean_scrub_stamp":"2023-10-10T21:17:20.083505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:59.386811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":371,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-10T21:17:22.115478+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:17:22.115478+0000","last_peered":"2023-10-10T21:17:22.115478+0000","last_clean":"2023-10-10T21:17:22.115478+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:17:22.115478+0000","last_undegraded":"2023-10-10T21:17:22.115478+0000","last_fullsized":"2023-10-10T21:17:22.115478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542328,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1576960,"data_stored":1056094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.55800000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.89600000000000002,"5min":1.014,"15min":1.1859999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":1.0409999999999999,"15min":1.0760000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75,"15min":0.73699999999999999},"min":{"1min":0.629,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0069999999999999,"15min":1.123},"last":0.73499999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.624},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81100000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.61599999999999999},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":1.1339999999999999,"15min":1.2669999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.624},"min":{"1min":0.42599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":1.3700000000000001,"15min":1.4139999999999999},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78000000000000003,"5min":0.98299999999999998,"15min":1.022},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.67400000000000004},"min":{"1min":0.499,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":0.82899999999999996,"5min":0.90600000000000003,"15min":0.98899999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.52600000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.99199999999999999,"15min":1.0980000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.625,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.94099999999999995,"5min":0.98699999999999999,"15min":1.135},"last":0.89100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542327,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302336,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069504,"statfs":{"total":96636764160,"available":96327172096,"internally_reserved":0,"allocated":974848,"data_stored":465566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.0569999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.59199999999999997,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69099999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.747,"15min":0.75},"min":{"1min":0.626,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.143},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.65700000000000003,"5min":0.497,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":1.073,"15min":1.073},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.59499999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.98199999999999998,"15min":1.151},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.58999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97799999999999998,"15min":1.01},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.74199999999999999,"15min":0.73199999999999998},"min":{"1min":0.621,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83699999999999997,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.1200000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.62,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72099999999999997,"5min":1.0369999999999999,"15min":1.2729999999999999},"last":0.496},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.34799999999999998},"max":{"1min":0.86499999999999999,"5min":0.97199999999999998,"15min":1.0880000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.87,"5min":1.022,"15min":1.345},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.879,"5min":1.048,"15min":1.238},"last":0.60299999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":0.86099999999999999,"5min":1.0629999999999999,"15min":1.4930000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0289999999999999,"15min":1.202},"last":0.623}]}]},{"osd":1,"up_from":14,"seq":60129542327,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302340,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069500,"statfs":{"total":96636764160,"available":96327168000,"internally_reserved":0,"allocated":978944,"data_stored":465656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32600000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66300000000000003,"5min":0.79700000000000004,"15min":1.258},"last":8.0839999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.34499999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":1.964},"last":13.223000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.89300000000000002,"15min":1.4550000000000001},"last":2.254},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.44,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":2.085},"last":1.9019999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.84399999999999997,"15min":1.8919999999999999},"last":4.0060000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.35399999999999998},"max":{"1min":0.999,"5min":0.999,"15min":2.117},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.48099999999999998},"max":{"1min":1.042,"5min":1.0509999999999999,"15min":2.052},"last":4.806},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.66400000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96999999999999997,"5min":1.0960000000000001,"15min":2.2160000000000002},"last":3.9180000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.61499999999999999,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.0409999999999999,"15min":1.181},"last":6.968},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.46400000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":2.012},"last":13.130000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.60999999999999999,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":1.01,"5min":1.1240000000000001,"15min":2.25},"last":3.9569999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.72099999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":2.2999999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78800000000000003,"15min":0.78900000000000003},"min":{"1min":0.69199999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.04,"5min":1.1639999999999999,"15min":2.169},"last":12.026},{"interface":"front","average":{"1min":0.877,"5min":0.81799999999999995,"15min":0.82099999999999995},"min":{"1min":0.70999999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.05,"5min":1.149,"15min":1.1850000000000001},"last":3.7229999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073004,"statfs":{"total":96636764160,"available":96330756096,"internally_reserved":0,"allocated":1585152,"data_stored":1058024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33600000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.67200000000000004,"5min":0.74299999999999999,"15min":1.4890000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.879,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.44}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.42499999999999999,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":1.706},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.874,"15min":1.2909999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.101,"15min":1.2270000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95599999999999996,"5min":1.1879999999999999,"15min":1.2909999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.008,"5min":1.2190000000000001,"15min":1.2729999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.45600000000000002},"max":{"1min":1.0980000000000001,"5min":1.119,"15min":1.3899999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83099999999999996,"15min":0.82799999999999996},"min":{"1min":0.65700000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0640000000000001,"5min":1.2090000000000001,"15min":1.2589999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.83799999999999997},"min":{"1min":0.66700000000000004,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0109999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.73999999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.1439999999999999,"15min":1.363},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.64400000000000002,"5min":0.58799999999999997,"15min":0.54200000000000004},"max":{"1min":1.024,"5min":1.165,"15min":1.3300000000000001},"last":0.78600000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.35699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.73399999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.495}]},{"osd":1,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91200000000000003,"5min":1.157,"15min":1.3220000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.63200000000000001,"5min":0.53500000000000003,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":1.26,"15min":1.2849999999999999},"last":0.96899999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.65800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98199999999999998,"5min":2.21,"15min":2.21},"last":1.008},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78200000000000003,"15min":0.78300000000000003},"min":{"1min":0.66100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.165,"15min":1.268},"last":0.92600000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.67800000000000005,"5min":0.54700000000000004,"15min":0.53300000000000003},"max":{"1min":1.018,"5min":1.151,"15min":1.3400000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.65600000000000003,"5min":0.50700000000000001,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":1.0349999999999999,"15min":1.3759999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81000000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.0029999999999999,"5min":1.716,"15min":1.716},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.81200000000000006},"min":{"1min":0.71699999999999997,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.97799999999999998,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509624,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306440,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065400,"statfs":{"total":96636764160,"available":96322969600,"internally_reserved":0,"allocated":983040,"data_stored":465622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.442,"15min":0.45800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.66400000000000003,"5min":0.71899999999999997,"15min":0.83099999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.495,"15min":0.499},"min":{"1min":0.42799999999999999,"5min":0.33700000000000002,"15min":0.28799999999999998},"max":{"1min":0.65100000000000002,"5min":0.73399999999999999,"15min":1.544},"last":0.35999999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.504},"min":{"1min":0.40899999999999997,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":1.6759999999999999},"last":0.315},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.45800000000000002,"5min":0.36799999999999999,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":1.4610000000000001},"last":0.432}]},{"osd":2,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":1.7070000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.38700000000000001},"max":{"1min":0.77700000000000002,"5min":0.82199999999999995,"15min":1.4990000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.63100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96499999999999997,"5min":1.054,"15min":1.6359999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76700000000000002,"15min":0.78600000000000003},"min":{"1min":0.61199999999999999,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.016,"5min":1.1859999999999999,"15min":1.246},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.65000000000000002,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":0.996,"5min":1.1240000000000001,"15min":1.262},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76800000000000002,"15min":0.77800000000000002},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":0.97999999999999998,"5min":1.2250000000000001,"15min":1.579},"last":0.64100000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61399999999999999,"5min":0.502,"15min":0.47099999999999997},"max":{"1min":1.05,"5min":1.27,"15min":1.27},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.68400000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.224,"15min":1.224},"last":0.624}]},{"osd":7,"last update":"Tue Oct 10 21:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.67800000000000005,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":0.98999999999999999,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.81499999999999995},"min":{"1min":0.66000000000000003,"5min":0.53500000000000003,"15min":0.51300000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.3200000000000001},"last":0.501}]}]},{"osd":4,"up_from":14,"seq":60129542329,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310540,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061300,"statfs":{"total":96636764160,"available":96318771200,"internally_reserved":0,"allocated":987136,"data_stored":467102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.92000000000000004,"5min":0.98399999999999999,"15min":1.1479999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.95099999999999996,"5min":0.96299999999999997,"15min":1.758},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.1359999999999999,"15min":1.47},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":0.98299999999999998,"15min":1.929},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.6890000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.98399999999999999,"5min":1.3100000000000001,"15min":1.468},"last":0.5}]},{"osd":3,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.046,"5min":1.0820000000000001,"15min":1.397},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":1.385,"15min":1.385},"last":0.55500000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.91500000000000004,"15min":1.105},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79700000000000004,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.874,"5min":1.3560000000000001,"15min":1.5209999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":1.0609999999999999,"15min":1.464},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.5700000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.59899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542327,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":983040,"data_stored":466190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.502},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72599999999999998,"15min":0.71499999999999997},"min":{"1min":0.52300000000000002,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.371},"last":0.57899999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.56000000000000005,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":0.90100000000000002,"5min":0.93300000000000005,"15min":3.895},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73599999999999999,"15min":0.78000000000000003},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.56200000000000006}]},{"osd":2,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.71599999999999997},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.97499999999999998,"5min":1.01,"15min":1.2889999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.72199999999999998},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":1.3540000000000001},"last":0.81499999999999995}]},{"osd":3,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76000000000000001,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.59099999999999997,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.63600000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.66700000000000004},"min":{"1min":0.46100000000000002,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.496,"15min":4.2789999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.93400000000000005,"15min":1.026},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.80200000000000005},"min":{"1min":0.56699999999999995,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.752}]},{"osd":7,"last update":"Tue Oct 10 21:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.51200000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":2.8900000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.96099999999999997,"5min":1.077,"15min":3.9420000000000002},"last":0.84499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:17:31.740 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T21:17:31.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T21:17:31.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.961+0000 7f030199d700 1 Processor -- start 2023-10-10T21:17:31.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.962+0000 7f030199d700 1 -- start start 2023-10-10T21:17:31.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.963+0000 7f030199d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02fc0ae5f0 0x7f02fc0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.963+0000 7f030199d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02fc0cce70 0x7f02fc156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.963+0000 7f030199d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc0c6990 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.963+0000 7f030199d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc157bb0 con 0x7f02fc0ae5f0 2023-10-10T21:17:31.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.963+0000 7f030199d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc06d770 con 0x7f02fc0cce70 2023-10-10T21:17:31.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.963+0000 7f030099b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02fc0ae5f0 0x7f02fc0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.963+0000 7f030099b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02fc0ae5f0 0x7f02fc0cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58132/0 (socket says 172.21.15.154:58132) 2023-10-10T21:17:31.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.963+0000 7f030099b700 1 -- 172.21.15.154:0/2928259720 learned_addr learned my addr 172.21.15.154:0/2928259720 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.963+0000 7f02fbfff700 1 --2- 172.21.15.154:0/2928259720 >> v2:172.21.15.179:3300/0 conn(0x7f02fc0cce70 0x7f02fc156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.964+0000 7f030099b700 1 -- 172.21.15.154:0/2928259720 >> v2:172.21.15.179:3300/0 conn(0x7f02fc0cce70 msgr2=0x7f02fc156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.964+0000 7f030099b700 1 --2- 172.21.15.154:0/2928259720 >> v2:172.21.15.179:3300/0 conn(0x7f02fc0cce70 0x7f02fc156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.964+0000 7f030099b700 1 -- 172.21.15.154:0/2928259720 >> v1:172.21.15.179:6789/0 conn(0x7f02fc0ae9c0 legacy=0x7f02fc1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.964+0000 7f030099b700 1 -- 172.21.15.154:0/2928259720 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc06da50 con 0x7f02fc0ae5f0 2023-10-10T21:17:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.964+0000 7f030099b700 1 --2- 172.21.15.154:0/2928259720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae5f0 0x7f02fc0cc930 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f02fc06a190 tx=0x7f02f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3624590a403d276 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.964+0000 7f02fb7fe700 1 -- 172.21.15.154:0/2928259720 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0009e70 con 0x7f02fc0ae5f0 2023-10-10T21:17:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.964+0000 7f02fb7fe700 1 -- 172.21.15.154:0/2928259720 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f000b860 con 0x7f02fc0ae5f0 2023-10-10T21:17:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.964+0000 7f02fb7fe700 1 -- 172.21.15.154:0/2928259720 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f000bc00 con 0x7f02fc0ae5f0 2023-10-10T21:17:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.965+0000 7f030199d700 1 -- 172.21.15.154:0/2928259720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae5f0 msgr2=0x7f02fc0cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.965+0000 7f030199d700 1 --2- 172.21.15.154:0/2928259720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae5f0 0x7f02fc0cc930 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f02fc06a190 tx=0x7f02f0009250 comp rx=0 tx=0).stop 2023-10-10T21:17:31.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.965+0000 7f030199d700 1 -- 172.21.15.154:0/2928259720 shutdown_connections 2023-10-10T21:17:31.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.965+0000 7f030199d700 1 --2- 172.21.15.154:0/2928259720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae5f0 0x7f02fc0cc930 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.965+0000 7f030199d700 1 --2- 172.21.15.154:0/2928259720 >> v2:172.21.15.179:3300/0 conn(0x7f02fc0cce70 0x7f02fc156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.965+0000 7f030199d700 1 -- 172.21.15.154:0/2928259720 >> 172.21.15.154:0/2928259720 conn(0x7f02fc068e20 msgr2=0x7f02fc0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:31.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.965+0000 7f030199d700 1 -- 172.21.15.154:0/2928259720 shutdown_connections 2023-10-10T21:17:31.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.965+0000 7f030199d700 1 -- 172.21.15.154:0/2928259720 wait complete. 2023-10-10T21:17:31.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.966+0000 7f030199d700 1 Processor -- start 2023-10-10T21:17:31.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.966+0000 7f030199d700 1 -- start start 2023-10-10T21:17:31.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.967+0000 7f030199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0ae5f0 0x7f02fc148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.967+0000 7f030199d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae9c0 0x7f02fc0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.967+0000 7f030199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02fc0cce70 0x7f02fc0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.967+0000 7f030199d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc1492c0 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.967+0000 7f030199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc15d9c0 con 0x7f02fc0cce70 2023-10-10T21:17:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.967+0000 7f030199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc15cdb0 con 0x7f02fc0ae5f0 2023-10-10T21:17:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02fbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae9c0 0x7f02fc0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02fbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae9c0 0x7f02fc0cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58148/0 (socket says 172.21.15.154:58148) 2023-10-10T21:17:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02fbfff700 1 -- 172.21.15.154:0/3485072346 learned_addr learned my addr 172.21.15.154:0/3485072346 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02fbfff700 1 -- 172.21.15.154:0/3485072346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0ae5f0 msgr2=0x7f02fc148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02fbfff700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0ae5f0 0x7f02fc148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02fbfff700 1 -- 172.21.15.154:0/3485072346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02fc0cce70 msgr2=0x7f02fc0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02fbfff700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02fc0cce70 0x7f02fc0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02fbfff700 1 -- 172.21.15.154:0/3485072346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f00094f0 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02fbfff700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae9c0 0x7f02fc0cb130 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f02e800e930 tx=0x7f02e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02f8ff9700 1 -- 172.21.15.154:0/3485072346 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800eed0 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f02f8ff9700 1 -- 172.21.15.154:0/3485072346 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e800c850 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.968+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc15d090 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.969+0000 7f02f8ff9700 1 -- 172.21.15.154:0/3485072346 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800cbf0 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.969+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc15d650 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.970+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc04c3c0 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.970+0000 7f02f8ff9700 1 -- 172.21.15.154:0/3485072346 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02e8013470 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.971+0000 7f02f8ff9700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f02e0066f30 0x7f02e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:31.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.971+0000 7f02f8ff9700 1 -- 172.21.15.154:0/3485072346 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f02e8084950 con 0x7f02fc0ae9c0 2023-10-10T21:17:31.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.972+0000 7f030099b700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f02e0066f30 0x7f02e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:31.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.972+0000 7f030099b700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f02e0066f30 0x7f02e00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02fc06a190 tx=0x7f02f0017000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:31.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:31.976+0000 7f02f8ff9700 1 -- 172.21.15.154:0/3485072346 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02e8051990 con 0x7f02fc0ae9c0 2023-10-10T21:17:32.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.239+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f02fc15db30 con 0x7f02fc0ae9c0 2023-10-10T21:17:32.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.245+0000 7f02f8ff9700 1 -- 172.21.15.154:0/3485072346 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f02e8054fb0 con 0x7f02fc0ae9c0 2023-10-10T21:17:32.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f02e0066f30 msgr2=0x7f02e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:32.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f02e0066f30 0x7f02e00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02fc06a190 tx=0x7f02f0017000 comp rx=0 tx=0).stop 2023-10-10T21:17:32.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae9c0 msgr2=0x7f02fc0cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:32.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae9c0 0x7f02fc0cb130 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f02e800e930 tx=0x7f02e80091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 shutdown_connections 2023-10-10T21:17:32.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f02e0066f30 0x7f02e00693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02fc0cce70 0x7f02fc0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0ae5f0 0x7f02fc148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 --2- 172.21.15.154:0/3485072346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02fc0ae9c0 0x7f02fc0cb130 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 >> 172.21.15.154:0/3485072346 conn(0x7f02fc068e20 msgr2=0x7f02fc0a9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:32.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 shutdown_connections 2023-10-10T21:17:32.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.247+0000 7f030199d700 1 -- 172.21.15.154:0/3485072346 wait complete. 2023-10-10T21:17:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T21:17:32.267 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:32.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.449+0000 7fcc4f7ff700 1 Processor -- start 2023-10-10T21:17:32.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.449+0000 7fcc4f7ff700 1 -- start start 2023-10-10T21:17:32.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.449+0000 7fcc4f7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc481578b0 0x7fcc48155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.449+0000 7fcc4f7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc480ad930 con 0x7fcc480af2f0 2023-10-10T21:17:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.449+0000 7fcc4f7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc480acd20 con 0x7fcc48155c10 2023-10-10T21:17:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.449+0000 7fcc4f7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc480ad000 con 0x7fcc481578b0 2023-10-10T21:17:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.450+0000 7fcc4cd9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc481578b0 0x7fcc48155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.450+0000 7fcc4cd9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc481578b0 0x7fcc48155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58154/0 (socket says 172.21.15.154:58154) 2023-10-10T21:17:32.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.450+0000 7fcc4cd9a700 1 -- 172.21.15.154:0/1667087029 learned_addr learned my addr 172.21.15.154:0/1667087029 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:32.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.450+0000 7fcc4cd9a700 1 -- 172.21.15.154:0/1667087029 >> v1:172.21.15.179:6789/0 conn(0x7fcc48155c10 legacy=0x7fcc480ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:32.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.450+0000 7fcc4cd9a700 1 -- 172.21.15.154:0/1667087029 >> v1:172.21.15.154:6789/0 conn(0x7fcc480af2f0 legacy=0x7fcc480af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:32.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.450+0000 7fcc4cd9a700 1 -- 172.21.15.154:0/1667087029 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc480ad2e0 con 0x7fcc481578b0 2023-10-10T21:17:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.450+0000 7fcc3ffff700 1 -- 172.21.15.154:0/1667087029 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550553697 0 0) 0x7fcc480acd20 con 0x7fcc48155c10 2023-10-10T21:17:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.450+0000 7fcc4cd9a700 1 --2- 172.21.15.154:0/1667087029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc481578b0 0x7fcc48155fe0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800ab50 tx=0x7fcc3800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17895b1f17558dc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc3ffff700 1 -- 172.21.15.154:0/1667087029 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800ca60 con 0x7fcc481578b0 2023-10-10T21:17:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc3ffff700 1 -- 172.21.15.154:0/1667087029 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3800cbc0 con 0x7fcc481578b0 2023-10-10T21:17:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc3ffff700 1 -- 172.21.15.154:0/1667087029 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38018400 con 0x7fcc481578b0 2023-10-10T21:17:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1667087029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc481578b0 msgr2=0x7fcc48155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc4f7ff700 1 --2- 172.21.15.154:0/1667087029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc481578b0 0x7fcc48155fe0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800ab50 tx=0x7fcc3800a3f0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1667087029 shutdown_connections 2023-10-10T21:17:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc4f7ff700 1 --2- 172.21.15.154:0/1667087029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc481578b0 0x7fcc48155fe0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1667087029 >> 172.21.15.154:0/1667087029 conn(0x7fcc4806a320 msgr2=0x7fcc480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1667087029 shutdown_connections 2023-10-10T21:17:32.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.451+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1667087029 wait complete. 2023-10-10T21:17:32.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.453+0000 7fcc4f7ff700 1 Processor -- start 2023-10-10T21:17:32.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.453+0000 7fcc4f7ff700 1 -- start start 2023-10-10T21:17:32.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4f7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc480af2f0 0x7fcc4816a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:32.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4f7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc48155c10 0x7fcc48152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:32.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4f7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc481578b0 0x7fcc4815b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:32.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4f7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48152d10 con 0x7fcc48155c10 2023-10-10T21:17:32.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4f7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4816ac80 con 0x7fcc480af2f0 2023-10-10T21:17:32.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4f7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4815a340 con 0x7fcc481578b0 2023-10-10T21:17:32.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4cd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc48155c10 0x7fcc48152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:32.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4cd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc48155c10 0x7fcc48152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58156/0 (socket says 172.21.15.154:58156) 2023-10-10T21:17:32.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4cd9a700 1 -- 172.21.15.154:0/1877454339 learned_addr learned my addr 172.21.15.154:0/1877454339 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:32.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4d59b700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc480af2f0 0x7fcc4816a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:32.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4dd9c700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc481578b0 0x7fcc4815b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:32.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4cd9a700 1 -- 172.21.15.154:0/1877454339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc481578b0 msgr2=0x7fcc4815b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:32.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4cd9a700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc481578b0 0x7fcc4815b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4cd9a700 1 -- 172.21.15.154:0/1877454339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc480af2f0 msgr2=0x7fcc4816a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:32.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4cd9a700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc480af2f0 0x7fcc4816a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4cd9a700 1 -- 172.21.15.154:0/1877454339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3800a690 con 0x7fcc48155c10 2023-10-10T21:17:32.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.454+0000 7fcc4dd9c700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc481578b0 0x7fcc4815b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:17:32.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.455+0000 7fcc4cd9a700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc48155c10 0x7fcc48152120 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcc48064290 tx=0x7fcc3801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:32.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.455+0000 7fcc3d7fa700 1 -- 172.21.15.154:0/1877454339 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3801c040 con 0x7fcc48155c10 2023-10-10T21:17:32.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.455+0000 7fcc3d7fa700 1 -- 172.21.15.154:0/1877454339 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc380106d0 con 0x7fcc48155c10 2023-10-10T21:17:32.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.455+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4815a620 con 0x7fcc48155c10 2023-10-10T21:17:32.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.455+0000 7fcc3d7fa700 1 -- 172.21.15.154:0/1877454339 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38010a90 con 0x7fcc48155c10 2023-10-10T21:17:32.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.455+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4815abe0 con 0x7fcc48155c10 2023-10-10T21:17:32.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.456+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc48155090 con 0x7fcc48155c10 2023-10-10T21:17:32.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.457+0000 7fcc3d7fa700 1 -- 172.21.15.154:0/1877454339 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc38021480 con 0x7fcc48155c10 2023-10-10T21:17:32.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.458+0000 7fcc3d7fa700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc2c066f30 0x7fcc2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:32.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.458+0000 7fcc3d7fa700 1 -- 172.21.15.154:0/1877454339 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fcc38085fe0 con 0x7fcc48155c10 2023-10-10T21:17:32.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.458+0000 7fcc4d59b700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc2c066f30 0x7fcc2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:32.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.459+0000 7fcc4d59b700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc2c066f30 0x7fcc2c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc440011e0 tx=0x7fcc44009040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:32.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.462+0000 7fcc3d7fa700 1 -- 172.21.15.154:0/1877454339 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc38053130 con 0x7fcc48155c10 2023-10-10T21:17:32.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.698+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc4804c3c0 con 0x7fcc48155c10 2023-10-10T21:17:32.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.698+0000 7fcc3d7fa700 1 -- 172.21.15.154:0/1877454339 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fcc38056750 con 0x7fcc48155c10 2023-10-10T21:17:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:32.701 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/209340130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":209340130},{"type":"v1","addr":"172.21.15.179:6834","nonce":209340130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3372685755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3372685755},{"type":"v1","addr":"172.21.15.154:6835","nonce":3372685755}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1909692066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1909692066},{"type":"v1","addr":"172.21.15.154:6837","nonce":1909692066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:17:21.571274+0000","modified":"2023-10-10T21:17:25.130727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6019":{"gid":6019,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2833897496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2833897496},{"type":"v1","addr":"172.21.15.179:6835","nonce":2833897496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-10T21:17:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc2c066f30 msgr2=0x7fcc2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc2c066f30 0x7fcc2c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc440011e0 tx=0x7fcc44009040 comp rx=0 tx=0).stop 2023-10-10T21:17:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc48155c10 msgr2=0x7fcc48152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc48155c10 0x7fcc48152120 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcc48064290 tx=0x7fcc3801a000 comp rx=0 tx=0).stop 2023-10-10T21:17:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 shutdown_connections 2023-10-10T21:17:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc481578b0 0x7fcc4815b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc2c066f30 0x7fcc2c0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc480af2f0 0x7fcc4816a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 --2- 172.21.15.154:0/1877454339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc48155c10 0x7fcc48152120 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:32.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.700+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 >> 172.21.15.154:0/1877454339 conn(0x7fcc4806a320 msgr2=0x7fcc480b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:32.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.702+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 shutdown_connections 2023-10-10T21:17:32.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:32.702+0000 7fcc4f7ff700 1 -- 172.21.15.154:0/1877454339 wait complete. 2023-10-10T21:17:32.706 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 30 2023-10-10T21:17:33.123 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T21:17:21.571274+0000', 'modified': '2023-10-10T21:17:25.130727+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6019}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6019': {'gid': 6019, 'name': 'd', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/2833897496', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6833', 'nonce': 2833897496}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 2833897496}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T21:17:33.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T21:17:33.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-10T21:17:33.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.309+0000 7f0afbdff700 1 Processor -- start 2023-10-10T21:17:33.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.309+0000 7f0afbdff700 1 -- start start 2023-10-10T21:17:33.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.310+0000 7f0afbdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0af406c0a0 0x7f0af40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.310+0000 7f0afbdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415df50 0x7f0af415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.310+0000 7f0afbdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af415d7e0 con 0x7f0af406bcd0 2023-10-10T21:17:33.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.310+0000 7f0afbdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af415dac0 con 0x7f0af406c0a0 2023-10-10T21:17:33.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.310+0000 7f0afbdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af415aa30 con 0x7f0af415df50 2023-10-10T21:17:33.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.310+0000 7f0af9b9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0af406bcd0 0x7f0af415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45036/0 (socket says 172.21.15.154:45036) 2023-10-10T21:17:33.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.310+0000 7f0af9b9b700 1 -- 172.21.15.154:0/608109157 learned_addr learned my addr 172.21.15.154:0/608109157 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122419221 0 0) 0x7f0af415d7e0 con 0x7f0af406bcd0 2023-10-10T21:17:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0afa39c700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415df50 0x7f0af415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af939a700 1 --2- 172.21.15.154:0/608109157 >> v2:172.21.15.179:3300/0 conn(0x7f0af406c0a0 0x7f0af40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae0003570 con 0x7f0af406bcd0 2023-10-10T21:17:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1461942756 0 0) 0x7f0ae0003570 con 0x7f0af406bcd0 2023-10-10T21:17:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415df50 msgr2=0x7f0af415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415df50 0x7f0af415e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 >> v2:172.21.15.179:3300/0 conn(0x7f0af406c0a0 msgr2=0x7f0af40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 --2- 172.21.15.154:0/608109157 >> v2:172.21.15.179:3300/0 conn(0x7f0af406c0a0 0x7f0af40caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af415ad10 con 0x7f0af406bcd0 2023-10-10T21:17:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f0af0001470 con 0x7f0af406bcd0 2023-10-10T21:17:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 >> v1:172.21.15.154:6789/0 conn(0x7f0af406bcd0 legacy=0x7f0af415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415df50 0x7f0ae0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ae0003fe0 0x7f0ae0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0004d50 0x7f0ae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af415dac0 con 0x7f0ae0003fe0 2023-10-10T21:17:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af415aa30 con 0x7f0ae0004d50 2023-10-10T21:17:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.311+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae000bb40 con 0x7f0af415df50 2023-10-10T21:17:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0af939a700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ae0003fe0 0x7f0ae0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415df50 0x7f0ae0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0afa39c700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0004d50 0x7f0ae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0af939a700 1 -- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415df50 msgr2=0x7f0ae0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0af939a700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415df50 0x7f0ae0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0af939a700 1 -- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0004d50 msgr2=0x7f0ae00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0af939a700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0004d50 0x7f0ae00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0af939a700 1 -- 172.21.15.154:0/608109157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0003570 con 0x7f0ae0003fe0 2023-10-10T21:17:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0afa39c700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0004d50 0x7f0ae00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.312+0000 7f0af939a700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ae0003fe0 0x7f0ae0004810 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4006f00 tx=0x7f0ae40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d7c14a4247ba97 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400e710 con 0x7f0ae0003fe0 2023-10-10T21:17:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae400e870 con 0x7f0ae0003fe0 2023-10-10T21:17:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0af8b99700 1 -- 172.21.15.154:0/608109157 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400ec30 con 0x7f0ae0003fe0 2023-10-10T21:17:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0afbdff700 1 -- 172.21.15.154:0/608109157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ae0003fe0 msgr2=0x7f0ae0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0afbdff700 1 --2- 172.21.15.154:0/608109157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ae0003fe0 0x7f0ae0004810 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4006f00 tx=0x7f0ae40091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0afa39c700 1 -- 172.21.15.154:0/608109157 reap_dead start 2023-10-10T21:17:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0afbdff700 1 -- 172.21.15.154:0/608109157 shutdown_connections 2023-10-10T21:17:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0afbdff700 1 -- 172.21.15.154:0/608109157 >> 172.21.15.154:0/608109157 conn(0x7f0af40ce600 msgr2=0x7f0af40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0afbdff700 1 -- 172.21.15.154:0/608109157 shutdown_connections 2023-10-10T21:17:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.313+0000 7f0afbdff700 1 -- 172.21.15.154:0/608109157 wait complete. 2023-10-10T21:17:33.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.315+0000 7f0afbdff700 1 Processor -- start 2023-10-10T21:17:33.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.315+0000 7f0afbdff700 1 -- start start 2023-10-10T21:17:33.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0afbdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0003fe0 0x7f0af4154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0afbdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40b2340 0x7f0af40c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0afbdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40c6130 0x7f0af40c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0afbdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40c65d0 con 0x7f0af40b2340 2023-10-10T21:17:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0afbdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40c4160 con 0x7f0ae0003fe0 2023-10-10T21:17:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0afbdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40c96e0 con 0x7f0af40c6130 2023-10-10T21:17:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af939a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40b2340 0x7f0af40c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af939a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40b2340 0x7f0af40c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58170/0 (socket says 172.21.15.154:58170) 2023-10-10T21:17:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af939a700 1 -- 172.21.15.154:0/4184762352 learned_addr learned my addr 172.21.15.154:0/4184762352 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0afa39c700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40c6130 0x7f0af40c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0003fe0 0x7f0af4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af939a700 1 -- 172.21.15.154:0/4184762352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40c6130 msgr2=0x7f0af40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af939a700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40c6130 0x7f0af40c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af939a700 1 -- 172.21.15.154:0/4184762352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0003fe0 msgr2=0x7f0af4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af939a700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0003fe0 0x7f0af4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af939a700 1 -- 172.21.15.154:0/4184762352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40c3b10 con 0x7f0af40b2340 2023-10-10T21:17:33.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.316+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0003fe0 0x7f0af4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:33.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.317+0000 7f0af939a700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40b2340 0x7f0af40c5bf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000ba90 tx=0x7f0ae401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.317+0000 7f0ae9ffb700 1 -- 172.21.15.154:0/4184762352 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4022070 con 0x7f0af40b2340 2023-10-10T21:17:33.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.317+0000 7f0ae9ffb700 1 -- 172.21.15.154:0/4184762352 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae400e9e0 con 0x7f0af40b2340 2023-10-10T21:17:33.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.317+0000 7f0ae9ffb700 1 -- 172.21.15.154:0/4184762352 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae401c450 con 0x7f0af40b2340 2023-10-10T21:17:33.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.317+0000 7f0afbdff700 1 -- 172.21.15.154:0/4184762352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af40c3df0 con 0x7f0af40b2340 2023-10-10T21:17:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.317+0000 7f0afbdff700 1 -- 172.21.15.154:0/4184762352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af40c8eb0 con 0x7f0af40b2340 2023-10-10T21:17:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.319+0000 7f0ae9ffb700 1 -- 172.21.15.154:0/4184762352 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ae401c860 con 0x7f0af40b2340 2023-10-10T21:17:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.320+0000 7f0ae9ffb700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ad8066f30 0x7f0ad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.320+0000 7f0ae9ffb700 1 -- 172.21.15.154:0/4184762352 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f0ae4085e40 con 0x7f0af40b2340 2023-10-10T21:17:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.320+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ad8066f30 0x7f0ad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.321+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ad8066f30 0x7f0ad80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0af0001620 tx=0x7f0af0009040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.322+0000 7f0b0a545b80 1 Processor -- start 2023-10-10T21:17:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.322+0000 7f0b0a545b80 1 -- start start 2023-10-10T21:17:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7648e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda7671a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7644cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda759fa70 con 0x55dda7648a50 2023-10-10T21:17:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda759d270 con 0x55dda7671f60 2023-10-10T21:17:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda7599060 con 0x55dda7692d00 2023-10-10T21:17:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af9b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7648e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af9b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7648e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58186/0 (socket says 172.21.15.154:58186) 2023-10-10T21:17:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1127548226 learned_addr learned my addr 172.21.15.154:0/1127548226 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af939a700 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda7671a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0afa39c700 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7644cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 msgr2=0x55dda7671a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda7671a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 msgr2=0x55dda7644cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7644cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1127548226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda7433270 con 0x55dda7648a50 2023-10-10T21:17:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0afa39c700 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7644cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.323+0000 7f0af939a700 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda7671a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:33.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.324+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7648e20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0af0007460 tx=0x7f0af0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6ca0bbd9aa6cf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.324+0000 7f0ad6ffd700 1 -- 172.21.15.154:0/1127548226 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0015ad0 con 0x55dda7648a50 2023-10-10T21:17:33.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.324+0000 7f0ad6ffd700 1 -- 172.21.15.154:0/1127548226 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af0015c30 con 0x55dda7648a50 2023-10-10T21:17:33.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.324+0000 7f0ad6ffd700 1 -- 172.21.15.154:0/1127548226 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0021450 con 0x55dda7648a50 2023-10-10T21:17:33.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1127548226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 msgr2=0x55dda7648e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7648e20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0af0007460 tx=0x7f0af0017000 comp rx=0 tx=0).stop 2023-10-10T21:17:33.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1127548226 shutdown_connections 2023-10-10T21:17:33.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7644cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7648e20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1127548226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda7671a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1127548226 >> 172.21.15.154:0/1127548226 conn(0x55dda764a370 msgr2=0x55dda764a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:33.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1127548226 shutdown_connections 2023-10-10T21:17:33.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1127548226 wait complete. 2023-10-10T21:17:33.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.325+0000 7f0b0a545b80 1 -- start start 2023-10-10T21:17:33.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.326+0000 7f0b0a545b80 1 Processor -- start 2023-10-10T21:17:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda76a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7688e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda76893b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda7544890 con 0x55dda7648a50 2023-10-10T21:17:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda755fea0 con 0x55dda7671f60 2023-10-10T21:17:33.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda741be30 con 0x55dda7692d00 2023-10-10T21:17:33.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0b0a545b80 10 client.0 _ll_register_callbacks cb 0x55dda760c110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:17:33.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0af9b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda76a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0af9b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda76a3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58188/0 (socket says 172.21.15.154:58188) 2023-10-10T21:17:33.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1807242397 learned_addr learned my addr 172.21.15.154:0/1807242397 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:33.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 msgr2=0x55dda76893b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda76893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 msgr2=0x55dda7688e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7688e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1807242397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af415ad10 con 0x55dda7648a50 2023-10-10T21:17:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda76a3030 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009010 tx=0x7f0af001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879faf18eac4bee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.327+0000 7f0acffff700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:17:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.328+0000 7f0acffff700 1 -- 172.21.15.154:0/1807242397 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0021450 con 0x55dda7648a50 2023-10-10T21:17:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.328+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1807242397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dda763db70 con 0x55dda7648a50 2023-10-10T21:17:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.328+0000 7f0acffff700 1 -- 172.21.15.154:0/1807242397 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f0af001a030 con 0x55dda7648a50 2023-10-10T21:17:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.328+0000 7f0acffff700 1 -- 172.21.15.154:0/1807242397 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0af002b610 con 0x55dda7648a50 2023-10-10T21:17:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.328+0000 7f0b0a545b80 10 client.6417 fetch_fsmap learned FSMap version 30 2023-10-10T21:17:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.328+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1807242397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55dda73d5fe0 con 0x55dda7648a50 2023-10-10T21:17:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.328+0000 7f0acffff700 1 -- 172.21.15.154:0/1807242397 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dda763db70 con 0x55dda7648a50 2023-10-10T21:17:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.328+0000 7f0acffff700 1 -- 172.21.15.154:0/1807242397 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0af002b770 con 0x55dda7648a50 2023-10-10T21:17:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.329+0000 7f0b0a545b80 10 client.6417 fetch_fsmap finished waiting for FSMap version 30 2023-10-10T21:17:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.329+0000 7f0b0a545b80 10 client.6417 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-10T21:17:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.329+0000 7f0b0a545b80 20 client.6417 populate_metadata read hostname 'smithi154' 2023-10-10T21:17:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.329+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] conn(0x55dda7692070 0x55dda7692440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.329+0000 7f0b0a545b80 4 client.6417 mds_command: new command op to 6019 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T21:17:33.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.329+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1807242397 --> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dda761aaa0 con 0x55dda7692070 2023-10-10T21:17:33.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.329+0000 7f0af939a700 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] conn(0x55dda7692070 0x55dda7692440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.330+0000 7f0af939a700 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] conn(0x55dda7692070 0x55dda7692440 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aa2088ebd3813b8 server_cookie=21d53af264cd85f4 in_seq=0 out_seq=0 2023-10-10T21:17:33.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.330+0000 7f0acffff700 10 client.6417 ms_handle_connect on v2:172.21.15.179:6833/2833897496 2023-10-10T21:17:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0acffff700 1 -- 172.21.15.154:0/1807242397 <== mds.0 v2:172.21.15.179:6833/2833897496 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55dda761aaa0 con 0x55dda7692070 2023-10-10T21:17:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0acffff700 10 client.6417 handle_command_reply: tid=0 2023-10-10T21:17:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 client.6417 shutdown 2023-10-10T21:17:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1807242397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 msgr2=0x55dda76a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda76a3030 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009010 tx=0x7f0af001b000 comp rx=0 tx=0).stop 2023-10-10T21:17:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1807242397 shutdown_connections 2023-10-10T21:17:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] conn(0x55dda7692070 0x55dda7692440 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0acffff700 0 client.6417 ms_handle_reset on v2:172.21.15.179:6833/2833897496 2023-10-10T21:17:33.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda76893b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda76a3030 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1807242397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7688e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1807242397 >> 172.21.15.154:0/1807242397 conn(0x55dda764a370 msgr2=0x55dda7645780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:33.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1807242397 shutdown_connections 2023-10-10T21:17:33.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1807242397 wait complete. 2023-10-10T21:17:33.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.331+0000 7f0b0a545b80 20 client.6417 trim_cache size 0 max 16384 2023-10-10T21:17:33.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.348+0000 7f0b0a545b80 1 Processor -- start 2023-10-10T21:17:33.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.348+0000 7f0b0a545b80 1 -- start start 2023-10-10T21:17:33.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.349+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7678530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.349+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda768e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.349+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda768e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.349+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda768f320 con 0x55dda7648a50 2023-10-10T21:17:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.349+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda766ef00 con 0x55dda7671f60 2023-10-10T21:17:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.349+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda7646b10 con 0x55dda7692d00 2023-10-10T21:17:33.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.349+0000 7f0af9b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7678530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.349+0000 7f0af9b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7678530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58194/0 (socket says 172.21.15.154:58194) 2023-10-10T21:17:33.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.349+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1116692778 learned_addr learned my addr 172.21.15.154:0/1116692778 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:33.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0af939a700 1 --2- 172.21.15.154:0/1116692778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda768e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0afa39c700 1 --2- 172.21.15.154:0/1116692778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda768e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1116692778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 msgr2=0x55dda768e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/1116692778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda768e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1116692778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 msgr2=0x55dda768e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/1116692778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda768e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0af9b9b700 1 -- 172.21.15.154:0/1116692778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda7567780 con 0x55dda7648a50 2023-10-10T21:17:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/1116692778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7678530 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0af00071f0 tx=0x7f0af002e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863c44da24a9ca40 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0ad77fe700 1 -- 172.21.15.154:0/1116692778 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af002bbe0 con 0x55dda7648a50 2023-10-10T21:17:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0ad77fe700 1 -- 172.21.15.154:0/1116692778 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af0021450 con 0x55dda7648a50 2023-10-10T21:17:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.350+0000 7f0ad77fe700 1 -- 172.21.15.154:0/1116692778 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0015aa0 con 0x55dda7648a50 2023-10-10T21:17:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1116692778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 msgr2=0x55dda7678530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1116692778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7678530 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0af00071f0 tx=0x7f0af002e040 comp rx=0 tx=0).stop 2023-10-10T21:17:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1116692778 shutdown_connections 2023-10-10T21:17:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1116692778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7692d00 0x55dda768e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1116692778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7648a50 0x55dda7678530 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/1116692778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda768e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1116692778 >> 172.21.15.154:0/1116692778 conn(0x55dda764a370 msgr2=0x55dda7692440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1116692778 shutdown_connections 2023-10-10T21:17:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 -- 172.21.15.154:0/1116692778 wait complete. 2023-10-10T21:17:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.351+0000 7f0b0a545b80 1 -- start start 2023-10-10T21:17:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.352+0000 7f0b0a545b80 1 Processor -- start 2023-10-10T21:17:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7648a50 0x55dda76ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7678530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0b0a545b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7692d00 0x55dda7678a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda76f4a20 con 0x55dda7692d00 2023-10-10T21:17:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda76f61a0 con 0x55dda7671f60 2023-10-10T21:17:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0b0a545b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda768f720 con 0x55dda7648a50 2023-10-10T21:17:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0b0a545b80 10 client.0 _ll_register_callbacks cb 0x55dda760c110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:17:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0afa39c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7692d00 0x55dda7678a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0afa39c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7692d00 0x55dda7678a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58196/0 (socket says 172.21.15.154:58196) 2023-10-10T21:17:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0afa39c700 1 -- 172.21.15.154:0/3774210009 learned_addr learned my addr 172.21.15.154:0/3774210009 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0afa39c700 1 -- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7648a50 msgr2=0x55dda76ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0afa39c700 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7648a50 0x55dda76ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0afa39c700 1 -- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 msgr2=0x55dda7678530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0afa39c700 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7678530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0afa39c700 1 -- 172.21.15.154:0/3774210009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dda73d5fe0 con 0x55dda7692d00 2023-10-10T21:17:33.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0afa39c700 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7692d00 0x55dda7678a70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0af406b640 tx=0x7f0aec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbe4968a494c11f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.353+0000 7f0acffff700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:17:33.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0acffff700 1 -- 172.21.15.154:0/3774210009 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec00e040 con 0x55dda7692d00 2023-10-10T21:17:33.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0acffff700 1 -- 172.21.15.154:0/3774210009 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f0aec023c50 con 0x55dda7692d00 2023-10-10T21:17:33.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0b0a545b80 1 -- 172.21.15.154:0/3774210009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0af406cd90 con 0x55dda7692d00 2023-10-10T21:17:33.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0acffff700 1 -- 172.21.15.154:0/3774210009 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aec007000 con 0x55dda7692d00 2023-10-10T21:17:33.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0b0a545b80 10 client.6423 fetch_fsmap learned FSMap version 30 2023-10-10T21:17:33.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0b0a545b80 1 -- 172.21.15.154:0/3774210009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x55dda754e470 con 0x55dda7692d00 2023-10-10T21:17:33.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0acffff700 1 -- 172.21.15.154:0/3774210009 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af406cd90 con 0x55dda7692d00 2023-10-10T21:17:33.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0acffff700 1 -- 172.21.15.154:0/3774210009 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0aec020070 con 0x55dda7692d00 2023-10-10T21:17:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0b0a545b80 10 client.6423 fetch_fsmap finished waiting for FSMap version 30 2023-10-10T21:17:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0b0a545b80 10 client.6423 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-10T21:17:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0b0a545b80 20 client.6423 populate_metadata read hostname 'smithi154' 2023-10-10T21:17:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] conn(0x55dda76f52e0 0x55dda769f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0b0a545b80 4 client.6423 mds_command: new command op to 6019 tid=0[{"prefix": "status"}] 2023-10-10T21:17:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.354+0000 7f0b0a545b80 1 -- 172.21.15.154:0/3774210009 --> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f0af0015c30 con 0x55dda76f52e0 2023-10-10T21:17:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.355+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] conn(0x55dda76f52e0 0x55dda769f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.355+0000 7f0af9b9b700 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] conn(0x55dda76f52e0 0x55dda769f130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=371f84d61016a3b3 server_cookie=8e9fb4b6f3a63fbd in_seq=0 out_seq=0 2023-10-10T21:17:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.355+0000 7f0acffff700 10 client.6423 ms_handle_connect on v2:172.21.15.179:6833/2833897496 2023-10-10T21:17:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.355+0000 7f0acffff700 1 -- 172.21.15.154:0/3774210009 <== mds.0 v2:172.21.15.179:6833/2833897496 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f0af0015c30 con 0x55dda76f52e0 2023-10-10T21:17:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.355+0000 7f0acffff700 10 client.6423 handle_command_reply: tid=0 2023-10-10T21:17:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.355+0000 7f0b0a545b80 1 client.6423 shutdown 2023-10-10T21:17:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 -- 172.21.15.154:0/3774210009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7692d00 msgr2=0x55dda7678a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7692d00 0x55dda7678a70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0af406b640 tx=0x7f0aec00b040 comp rx=0 tx=0).stop 2023-10-10T21:17:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 -- 172.21.15.154:0/3774210009 shutdown_connections 2023-10-10T21:17:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:6833/2833897496,v1:172.21.15.179:6835/2833897496] conn(0x55dda76f52e0 0x55dda769f130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dda7692d00 0x55dda7678a70 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dda7648a50 0x55dda76ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 --2- 172.21.15.154:0/3774210009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dda7671f60 0x55dda7678530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 -- 172.21.15.154:0/3774210009 >> 172.21.15.154:0/3774210009 conn(0x55dda764a370 msgr2=0x55dda7692440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:33.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0acffff700 0 client.6423 ms_handle_reset on v2:172.21.15.179:6833/2833897496 2023-10-10T21:17:33.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 -- 172.21.15.154:0/3774210009 shutdown_connections 2023-10-10T21:17:33.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 1 -- 172.21.15.154:0/3774210009 wait complete. 2023-10-10T21:17:33.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.356+0000 7f0b0a545b80 20 client.6423 trim_cache size 0 max 16384 2023-10-10T21:17:33.376 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:17:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T21:17:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T21:17:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 6019, 2023-10-10T21:17:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T21:17:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T21:17:33.378 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T21:17:33.378 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.241286819000001, 2023-10-10T21:17:33.378 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 30, 2023-10-10T21:17:33.378 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 81, 2023-10-10T21:17:33.378 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 81, 2023-10-10T21:17:33.379 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.014740427 2023-10-10T21:17:33.379 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:17:33.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 -- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ad8066f30 msgr2=0x7f0ad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ad8066f30 0x7f0ad80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0af0001620 tx=0x7f0af0009040 comp rx=0 tx=0).stop 2023-10-10T21:17:33.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 -- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40b2340 msgr2=0x7f0af40c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40b2340 0x7f0af40c5bf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000ba90 tx=0x7f0ae401a000 comp rx=0 tx=0).stop 2023-10-10T21:17:33.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 -- 172.21.15.154:0/4184762352 shutdown_connections 2023-10-10T21:17:33.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40c6130 0x7f0af40c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ad8066f30 0x7f0ad80693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ae0003fe0 0x7f0af4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 --2- 172.21.15.154:0/4184762352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40b2340 0x7f0af40c5bf0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 -- 172.21.15.154:0/4184762352 >> 172.21.15.154:0/4184762352 conn(0x7f0af40ce600 msgr2=0x7f0af40cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:33.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 -- 172.21.15.154:0/4184762352 shutdown_connections 2023-10-10T21:17:33.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.357+0000 7f0afbdff700 1 -- 172.21.15.154:0/4184762352 wait complete. 2023-10-10T21:17:33.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:17:33.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.563+0000 7f53b03ff700 1 Processor -- start 2023-10-10T21:17:33.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.563+0000 7f53b03ff700 1 -- start start 2023-10-10T21:17:33.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53b03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 0x7f53a8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53b03ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53a80ac230 0x7f53a80ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53b03ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a80ad930 con 0x7f53a81568a0 2023-10-10T21:17:33.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53b03ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a80acd20 con 0x7f53a80ac230 2023-10-10T21:17:33.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53b03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80ad000 con 0x7f53a8155c10 2023-10-10T21:17:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53ad99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53a80ac230 0x7f53a80ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53ad99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53a80ac230 0x7f53a80ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58198/0 (socket says 172.21.15.154:58198) 2023-10-10T21:17:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53ad99a700 1 -- 172.21.15.154:0/4139579132 learned_addr learned my addr 172.21.15.154:0/4139579132 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53ae19b700 1 --2- 172.21.15.154:0/4139579132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 0x7f53a8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53ad99a700 1 -- 172.21.15.154:0/4139579132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 msgr2=0x7f53a8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:33.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53ad99a700 1 --2- 172.21.15.154:0/4139579132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 0x7f53a8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.565+0000 7f53ad99a700 1 -- 172.21.15.154:0/4139579132 >> v1:172.21.15.154:6789/0 conn(0x7f53a81568a0 legacy=0x7f53a8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.566+0000 7f53ad99a700 1 -- 172.21.15.154:0/4139579132 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80ad2e0 con 0x7f53a80ac230 2023-10-10T21:17:33.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.566+0000 7f53ad99a700 1 --2- 172.21.15.154:0/4139579132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 0x7f53a80ac6a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f539800ab50 tx=0x7f539800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbd6d17d3972bd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.566+0000 7f53ad199700 1 -- 172.21.15.154:0/4139579132 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539800ca60 con 0x7f53a80ac230 2023-10-10T21:17:33.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.566+0000 7f53ad199700 1 -- 172.21.15.154:0/4139579132 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539800cbc0 con 0x7f53a80ac230 2023-10-10T21:17:33.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.566+0000 7f53ad199700 1 -- 172.21.15.154:0/4139579132 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398018400 con 0x7f53a80ac230 2023-10-10T21:17:33.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.567+0000 7f53b03ff700 1 -- 172.21.15.154:0/4139579132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 msgr2=0x7f53a80ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.567+0000 7f53b03ff700 1 --2- 172.21.15.154:0/4139579132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 0x7f53a80ac6a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f539800ab50 tx=0x7f539800a3f0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.567+0000 7f53b03ff700 1 -- 172.21.15.154:0/4139579132 shutdown_connections 2023-10-10T21:17:33.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.567+0000 7f53b03ff700 1 --2- 172.21.15.154:0/4139579132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 0x7f53a8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.567+0000 7f53b03ff700 1 --2- 172.21.15.154:0/4139579132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 0x7f53a80ac6a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.567+0000 7f53b03ff700 1 -- 172.21.15.154:0/4139579132 >> 172.21.15.154:0/4139579132 conn(0x7f53a806a320 msgr2=0x7f53a80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:33.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.567+0000 7f53b03ff700 1 -- 172.21.15.154:0/4139579132 shutdown_connections 2023-10-10T21:17:33.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.567+0000 7f53b03ff700 1 -- 172.21.15.154:0/4139579132 wait complete. 2023-10-10T21:17:33.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.568+0000 7f53b03ff700 1 Processor -- start 2023-10-10T21:17:33.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.568+0000 7f53b03ff700 1 -- start start 2023-10-10T21:17:33.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.569+0000 7f53b03ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 0x7f53a8145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.569+0000 7f53b03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 0x7f53a815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.569+0000 7f53b03ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a81568a0 0x7f53a8159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.569+0000 7f53b03ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a815b0a0 con 0x7f53a80ac230 2023-10-10T21:17:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.569+0000 7f53b03ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a815a490 con 0x7f53a81568a0 2023-10-10T21:17:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.569+0000 7f53b03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a815a770 con 0x7f53a8155c10 2023-10-10T21:17:33.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.569+0000 7f53ae19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 0x7f53a8145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ae19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 0x7f53a8145f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58212/0 (socket says 172.21.15.154:58212) 2023-10-10T21:17:33.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ae19b700 1 -- 172.21.15.154:0/382421044 learned_addr learned my addr 172.21.15.154:0/382421044 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:33.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ad99a700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 0x7f53a815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ae99c700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a81568a0 0x7f53a8159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ae19b700 1 -- 172.21.15.154:0/382421044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 msgr2=0x7f53a815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ae19b700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 0x7f53a815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ae19b700 1 -- 172.21.15.154:0/382421044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a81568a0 msgr2=0x7f53a8159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ae19b700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a81568a0 0x7f53a8159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ae19b700 1 -- 172.21.15.154:0/382421044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539800a690 con 0x7f53a80ac230 2023-10-10T21:17:33.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f53ae19b700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 0x7f53a8145f80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f53a400d890 tx=0x7f53a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.570+0000 7f539e7fc700 1 -- 172.21.15.154:0/382421044 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40125f0 con 0x7f53a80ac230 2023-10-10T21:17:33.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.571+0000 7f539e7fc700 1 -- 172.21.15.154:0/382421044 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a4012750 con 0x7f53a80ac230 2023-10-10T21:17:33.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.571+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a815aa50 con 0x7f53a80ac230 2023-10-10T21:17:33.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.571+0000 7f539e7fc700 1 -- 172.21.15.154:0/382421044 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a4012af0 con 0x7f53a80ac230 2023-10-10T21:17:33.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.571+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a81464c0 con 0x7f53a80ac230 2023-10-10T21:17:33.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.572+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a804c3c0 con 0x7f53a80ac230 2023-10-10T21:17:33.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.573+0000 7f539e7fc700 1 -- 172.21.15.154:0/382421044 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53a401e460 con 0x7f53a80ac230 2023-10-10T21:17:33.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.573+0000 7f539e7fc700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f538c066f30 0x7f538c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:33.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.574+0000 7f539e7fc700 1 -- 172.21.15.154:0/382421044 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f53a4084cf0 con 0x7f53a80ac230 2023-10-10T21:17:33.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.574+0000 7f53ad99a700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f538c066f30 0x7f538c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:33.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.574+0000 7f53ad99a700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f538c066f30 0x7f538c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f539800ab50 tx=0x7f539801a000 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:33.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.577+0000 7f539e7fc700 1 -- 172.21.15.154:0/382421044 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53a4051d30 con 0x7f53a80ac230 2023-10-10T21:17:33.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.815+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53a80ad5c0 con 0x7f53a80ac230 2023-10-10T21:17:33.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.816+0000 7f539e7fc700 1 -- 172.21.15.154:0/382421044 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f53a4055350 con 0x7f53a80ac230 2023-10-10T21:17:33.817 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:17:33.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f538c066f30 msgr2=0x7f538c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f538c066f30 0x7f538c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f539800ab50 tx=0x7f539801a000 comp rx=0 tx=0).stop 2023-10-10T21:17:33.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 msgr2=0x7f53a8145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:33.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 0x7f53a8145f80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f53a400d890 tx=0x7f53a4008040 comp rx=0 tx=0).stop 2023-10-10T21:17:33.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 shutdown_connections 2023-10-10T21:17:33.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f538c066f30 0x7f538c0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a81568a0 0x7f53a8159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a80ac230 0x7f53a8145f80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 --2- 172.21.15.154:0/382421044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8155c10 0x7f53a815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:33.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 >> 172.21.15.154:0/382421044 conn(0x7f53a806a320 msgr2=0x7f53a815ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:33.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.818+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 shutdown_connections 2023-10-10T21:17:33.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:33.819+0000 7f53b03ff700 1 -- 172.21.15.154:0/382421044 wait complete. 2023-10-10T21:17:33.837 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T21:17:33.837 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:17:33.837 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T21:17:33.838 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T21:17:33.838 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T21:17:33.838 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T21:17:33.839 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T21:17:33.839 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:17:33.839 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:17:33.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:17:33.840 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T21:17:33.877 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:17:33.878 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:17:33.878 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:17:33.878 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:17:33.878 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:17:33.879 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:17:33.879 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:17:33.879 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:17:33.879 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T21:17:33.879 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:17:33.880 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:17:33.880 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T21:17:33.880 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:17:33.880 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:17:33.880 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:17:33.881 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:17:33.881 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:17:33.881 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 41360sec preferred_lft 41360sec 2023-10-10T21:17:33.881 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T21:17:33.881 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:17:33.882 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:17:33.882 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:17:33.882 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T21:17:33.882 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:17:33.882 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T21:17:33.883 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:17:33.883 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:17:33.883 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T21:17:33.883 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T21:17:33.883 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:17:33.884 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:17:33.884 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T21:17:33.884 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T21:17:33.884 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:17:33.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:17:33.885 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:17:33.977 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T21:17:33.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:17:33.981 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T21:17:34.019 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T21:17:34.019 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:17:34.020 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:17:34.020 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:17:34.020 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:17:34.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:17:34.022 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:17:34.022 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:17:34.023 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:17:34.023 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:17:34.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:17:34.024 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:17:34.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:17:34.219 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:17:34.255 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T21:17:34.256 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T21:17:34.256 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:17:34.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:17:34.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T21:17:34.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:17:34.358 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T21:17:34.395 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:17:34.396 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:17:34.396 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:17:34.471 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:17:34.472 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:17:34.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:17:34.603 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:17:34.604 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:17:34.604 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:17:34.620 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:17:34.620 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:17:34.620 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:17:34.620 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:17:34.621 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:17:34.642 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:17:34.642 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:17:34.642 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:17:34.643 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:17:34.643 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:17:34.643 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:17:34.643 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:17:34.643 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:17:34.647 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:17:34.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:17:34.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:17:34.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T21:17:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.891+0000 7f935979d700 1 Processor -- start 2023-10-10T21:17:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.892+0000 7f935979d700 1 -- start start 2023-10-10T21:17:34.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.893+0000 7f935979d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93540ad870 0x7f935406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:34.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.893+0000 7f935979d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93540b40f0 con 0x7f9354142ea0 2023-10-10T21:17:34.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.893+0000 7f935979d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9354069640 con 0x7f935406bf20 2023-10-10T21:17:34.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.893+0000 7f935979d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935406c3a0 con 0x7f93540ad870 2023-10-10T21:17:34.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.893+0000 7f9353fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9354142ea0 0x7f93540b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45054/0 (socket says 172.21.15.154:45054) 2023-10-10T21:17:34.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.893+0000 7f9353fff700 1 -- 172.21.15.154:0/2812381446 learned_addr learned my addr 172.21.15.154:0/2812381446 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.893+0000 7f93537fe700 1 --2- 172.21.15.154:0/2812381446 >> v2:172.21.15.179:3300/0 conn(0x7f93540ad870 0x7f935406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.893+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350169220 0 0) 0x7f93540b40f0 con 0x7f9354142ea0 2023-10-10T21:17:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f933c003570 con 0x7f9354142ea0 2023-10-10T21:17:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1895913572 0 0) 0x7f933c003570 con 0x7f9354142ea0 2023-10-10T21:17:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 >> v2:172.21.15.179:3300/0 conn(0x7f93540ad870 msgr2=0x7f935406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 --2- 172.21.15.154:0/2812381446 >> v2:172.21.15.179:3300/0 conn(0x7f93540ad870 0x7f935406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 >> v1:172.21.15.179:6789/0 conn(0x7f935406bf20 legacy=0x7f935406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9354069920 con 0x7f9354142ea0 2023-10-10T21:17:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f9344001470 con 0x7f9354142ea0 2023-10-10T21:17:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 >> v1:172.21.15.154:6789/0 conn(0x7f9354142ea0 legacy=0x7f93540b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f933c003a60 0x7f933c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933c004810 0x7f933c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f933c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935406c3a0 con 0x7f933c0051c0 2023-10-10T21:17:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c00c0d0 con 0x7f933c003a60 2023-10-10T21:17:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c00c290 con 0x7f933c004810 2023-10-10T21:17:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9358f9c700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f933c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.894+0000 7f9353fff700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f933c003a60 0x7f933c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f93537fe700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933c004810 0x7f933c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9358f9c700 1 -- 172.21.15.154:0/2812381446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933c004810 msgr2=0x7f933c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9358f9c700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933c004810 0x7f933c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9358f9c700 1 -- 172.21.15.154:0/2812381446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f933c003a60 msgr2=0x7f933c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9358f9c700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f933c003a60 0x7f933c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9358f9c700 1 -- 172.21.15.154:0/2812381446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c003570 con 0x7f933c0051c0 2023-10-10T21:17:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f93537fe700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f933c004810 0x7f933c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9358f9c700 1 -- 172.21.15.154:0/2812381446 reap_dead start 2023-10-10T21:17:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9358f9c700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f933c00ba60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f934c001fc0 tx=0x7f934c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874dcc3aec019063 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c001950 con 0x7f933c0051c0 2023-10-10T21:17:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c00c8b0 con 0x7f933c0051c0 2023-10-10T21:17:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.895+0000 7f9352ffd700 1 -- 172.21.15.154:0/2812381446 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c00cc90 con 0x7f933c0051c0 2023-10-10T21:17:34.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.896+0000 7f935979d700 1 -- 172.21.15.154:0/2812381446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 msgr2=0x7f933c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:34.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.896+0000 7f935979d700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f933c00ba60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f934c001fc0 tx=0x7f934c001640 comp rx=0 tx=0).stop 2023-10-10T21:17:34.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.896+0000 7f935979d700 1 -- 172.21.15.154:0/2812381446 shutdown_connections 2023-10-10T21:17:34.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.896+0000 7f935979d700 1 --2- 172.21.15.154:0/2812381446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f933c00ba60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:34.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.896+0000 7f935979d700 1 -- 172.21.15.154:0/2812381446 >> 172.21.15.154:0/2812381446 conn(0x7f93540ce430 msgr2=0x7f93540ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.896+0000 7f935979d700 1 -- 172.21.15.154:0/2812381446 shutdown_connections 2023-10-10T21:17:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.896+0000 7f935979d700 1 -- 172.21.15.154:0/2812381446 wait complete. 2023-10-10T21:17:34.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.897+0000 7f935979d700 1 Processor -- start 2023-10-10T21:17:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.897+0000 7f935979d700 1 -- start start 2023-10-10T21:17:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.898+0000 7f935979d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f9354169810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.898+0000 7f935979d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93540ceca0 0x7f935415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.898+0000 7f935979d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f935415e650 0x7f935415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.898+0000 7f935979d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935416a760 con 0x7f933c0051c0 2023-10-10T21:17:34.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.898+0000 7f935979d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935416aaa0 con 0x7f93540ceca0 2023-10-10T21:17:34.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.898+0000 7f935979d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935415d1c0 con 0x7f935415e650 2023-10-10T21:17:34.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.898+0000 7f9353fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f9354169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:34.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f9353fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f9354169810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58232/0 (socket says 172.21.15.154:58232) 2023-10-10T21:17:34.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f9353fff700 1 -- 172.21.15.154:0/2279959628 learned_addr learned my addr 172.21.15.154:0/2279959628 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:34.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f9353fff700 1 -- 172.21.15.154:0/2279959628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f935415e650 msgr2=0x7f935415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:34.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f9353fff700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f935415e650 0x7f935415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:34.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f9353fff700 1 -- 172.21.15.154:0/2279959628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93540ceca0 msgr2=0x7f935415cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:34.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f9353fff700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93540ceca0 0x7f935415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:34.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f9353fff700 1 -- 172.21.15.154:0/2279959628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9354169ec0 con 0x7f933c0051c0 2023-10-10T21:17:34.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f9353fff700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f9354169810 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9344007390 tx=0x7f9344001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:34.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f933bfff700 1 -- 172.21.15.154:0/2279959628 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344018030 con 0x7f933c0051c0 2023-10-10T21:17:34.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f933bfff700 1 -- 172.21.15.154:0/2279959628 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934400f8d0 con 0x7f933c0051c0 2023-10-10T21:17:34.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f933bfff700 1 -- 172.21.15.154:0/2279959628 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934400fcb0 con 0x7f933c0051c0 2023-10-10T21:17:34.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.899+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935416a1a0 con 0x7f933c0051c0 2023-10-10T21:17:34.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.900+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935415f010 con 0x7f933c0051c0 2023-10-10T21:17:34.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.900+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935416aca0 con 0x7f933c0051c0 2023-10-10T21:17:34.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.901+0000 7f933bfff700 1 -- 172.21.15.154:0/2279959628 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f934401b070 con 0x7f933c0051c0 2023-10-10T21:17:34.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.902+0000 7f933bfff700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9340066f30 0x7f93400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:34.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.902+0000 7f933bfff700 1 -- 172.21.15.154:0/2279959628 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f9344019070 con 0x7f933c0051c0 2023-10-10T21:17:34.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.902+0000 7f93537fe700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9340066f30 0x7f93400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:34.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.903+0000 7f93537fe700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9340066f30 0x7f93400693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93540b12a0 tx=0x7f9348008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:34.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:34.906+0000 7f933bfff700 1 -- 172.21.15.154:0/2279959628 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f935416aca0 con 0x7f933c0051c0 2023-10-10T21:17:35.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.126+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f935416ac60 con 0x7f9340066f30 2023-10-10T21:17:35.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.127+0000 7f933bfff700 1 -- 172.21.15.154:0/2279959628 <== mgr.6063 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f935416ac60 con 0x7f9340066f30 2023-10-10T21:17:35.128 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:17:35.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:35.129 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T21:17:35.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:35.129 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:17:35.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.129+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9340066f30 msgr2=0x7f93400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:35.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.129+0000 7f935979d700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9340066f30 0x7f93400693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93540b12a0 tx=0x7f9348008040 comp rx=0 tx=0).stop 2023-10-10T21:17:35.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.129+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 msgr2=0x7f9354169810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.129+0000 7f935979d700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f9354169810 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9344007390 tx=0x7f9344001e50 comp rx=0 tx=0).stop 2023-10-10T21:17:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.130+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 shutdown_connections 2023-10-10T21:17:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.130+0000 7f935979d700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f935415e650 0x7f935415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.130+0000 7f935979d700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c0051c0 0x7f9354169810 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.130+0000 7f935979d700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9340066f30 0x7f93400693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.130+0000 7f935979d700 1 --2- 172.21.15.154:0/2279959628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93540ceca0 0x7f935415cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.130+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 >> 172.21.15.154:0/2279959628 conn(0x7f93540ce430 msgr2=0x7f9354141ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:35.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.130+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 shutdown_connections 2023-10-10T21:17:35.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.130+0000 7f935979d700 1 -- 172.21.15.154:0/2279959628 wait complete. 2023-10-10T21:17:35.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T21:17:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.331+0000 7fb64a5ff700 1 Processor -- start 2023-10-10T21:17:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.331+0000 7fb64a5ff700 1 -- start start 2023-10-10T21:17:35.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.332+0000 7fb64a5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb6440c83f0 0x7fb6440c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.332+0000 7fb64a5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6440ccee0 0x7fb6441561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.332+0000 7fb64a5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64415b0d0 con 0x7fb6440c87c0 2023-10-10T21:17:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.332+0000 7fb64a5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6440c7a60 con 0x7fb6440ccee0 2023-10-10T21:17:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.332+0000 7fb64a5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64415a4c0 con 0x7fb6440c83f0 2023-10-10T21:17:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb6437fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6440ccee0 0x7fb6441561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb6437fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6440ccee0 0x7fb6441561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58234/0 (socket says 172.21.15.154:58234) 2023-10-10T21:17:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb6437fe700 1 -- 172.21.15.154:0/2473140316 learned_addr learned my addr 172.21.15.154:0/2473140316 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb643fff700 1 --2- 172.21.15.154:0/2473140316 >> v2:172.21.15.179:3300/0 conn(0x7fb6440c83f0 0x7fb6440c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb6437fe700 1 -- 172.21.15.154:0/2473140316 >> v2:172.21.15.179:3300/0 conn(0x7fb6440c83f0 msgr2=0x7fb6440c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb6437fe700 1 --2- 172.21.15.154:0/2473140316 >> v2:172.21.15.179:3300/0 conn(0x7fb6440c83f0 0x7fb6440c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb6437fe700 1 -- 172.21.15.154:0/2473140316 >> v1:172.21.15.179:6789/0 conn(0x7fb6440c87c0 legacy=0x7fb64406eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb6437fe700 1 -- 172.21.15.154:0/2473140316 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64415a7a0 con 0x7fb6440ccee0 2023-10-10T21:17:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb643fff700 1 --2- 172.21.15.154:0/2473140316 >> v2:172.21.15.179:3300/0 conn(0x7fb6440c83f0 0x7fb6440c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:17:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.333+0000 7fb6437fe700 1 --2- 172.21.15.154:0/2473140316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440ccee0 0x7fb6441561d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb6440c9fd0 tx=0x7fb63800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296495716f8cf511 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:35.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb642ffd700 1 -- 172.21.15.154:0/2473140316 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800dc10 con 0x7fb6440ccee0 2023-10-10T21:17:35.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb642ffd700 1 -- 172.21.15.154:0/2473140316 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63800dd70 con 0x7fb6440ccee0 2023-10-10T21:17:35.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb642ffd700 1 -- 172.21.15.154:0/2473140316 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380106c0 con 0x7fb6440ccee0 2023-10-10T21:17:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2473140316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440ccee0 msgr2=0x7fb6441561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb64a5ff700 1 --2- 172.21.15.154:0/2473140316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440ccee0 0x7fb6441561d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb6440c9fd0 tx=0x7fb63800b4f0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2473140316 shutdown_connections 2023-10-10T21:17:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb64a5ff700 1 --2- 172.21.15.154:0/2473140316 >> v2:172.21.15.179:3300/0 conn(0x7fb6440c83f0 0x7fb6440c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb64a5ff700 1 --2- 172.21.15.154:0/2473140316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440ccee0 0x7fb6441561d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2473140316 >> 172.21.15.154:0/2473140316 conn(0x7fb644068e10 msgr2=0x7fb6440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:35.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2473140316 shutdown_connections 2023-10-10T21:17:35.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.334+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2473140316 wait complete. 2023-10-10T21:17:35.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.336+0000 7fb64a5ff700 1 Processor -- start 2023-10-10T21:17:35.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.336+0000 7fb64a5ff700 1 -- start start 2023-10-10T21:17:35.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb64a5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6440c83f0 0x7fb6441561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:35.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb64a5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440c87c0 0x7fb644158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:35.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb64a5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6440ccee0 0x7fb644144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:35.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb64a5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440c4fe0 con 0x7fb6440c87c0 2023-10-10T21:17:35.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb64a5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440c49b0 con 0x7fb6440c83f0 2023-10-10T21:17:35.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb64a5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb644159890 con 0x7fb6440ccee0 2023-10-10T21:17:35.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb6437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440c87c0 0x7fb644158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:35.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb6437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440c87c0 0x7fb644158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58238/0 (socket says 172.21.15.154:58238) 2023-10-10T21:17:35.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb6437fe700 1 -- 172.21.15.154:0/2228852505 learned_addr learned my addr 172.21.15.154:0/2228852505 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:35.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb6437fe700 1 -- 172.21.15.154:0/2228852505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6440ccee0 msgr2=0x7fb644144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:35.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb6437fe700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6440ccee0 0x7fb644144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb6437fe700 1 -- 172.21.15.154:0/2228852505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6440c83f0 msgr2=0x7fb6441561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:35.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb6437fe700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6440c83f0 0x7fb6441561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:35.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb6437fe700 1 -- 172.21.15.154:0/2228852505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63800b790 con 0x7fb6440c87c0 2023-10-10T21:17:35.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.337+0000 7fb6437fe700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440c87c0 0x7fb644158e40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb644063d40 tx=0x7fb63801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.338+0000 7fb62bfff700 1 -- 172.21.15.154:0/2228852505 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638018880 con 0x7fb6440c87c0 2023-10-10T21:17:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.338+0000 7fb62bfff700 1 -- 172.21.15.154:0/2228852505 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638018a00 con 0x7fb6440c87c0 2023-10-10T21:17:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.338+0000 7fb62bfff700 1 -- 172.21.15.154:0/2228852505 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638018dc0 con 0x7fb6440c87c0 2023-10-10T21:17:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.338+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb644159b70 con 0x7fb6440c87c0 2023-10-10T21:17:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.338+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb644153780 con 0x7fb6440c87c0 2023-10-10T21:17:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.339+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64404c3c0 con 0x7fb6440c87c0 2023-10-10T21:17:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.340+0000 7fb62bfff700 1 -- 172.21.15.154:0/2228852505 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb63802b450 con 0x7fb6440c87c0 2023-10-10T21:17:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.341+0000 7fb62bfff700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb630066f30 0x7fb6300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.341+0000 7fb62bfff700 1 -- 172.21.15.154:0/2228852505 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fb638014070 con 0x7fb6440c87c0 2023-10-10T21:17:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.341+0000 7fb643fff700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb630066f30 0x7fb6300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.341+0000 7fb643fff700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb630066f30 0x7fb6300693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb634006fd0 tx=0x7fb634008040 comp rx=0 tx=0).ready entity=mgr.6063 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.345+0000 7fb62bfff700 1 -- 172.21.15.154:0/2228852505 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6380536f0 con 0x7fb6440c87c0 2023-10-10T21:17:35.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:35.589+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb6440cbd90 con 0x7fb6440c87c0 2023-10-10T21:17:36.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.176+0000 7fb62bfff700 1 -- 172.21.15.154:0/2228852505 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 29) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb638053ac0 con 0x7fb6440c87c0 2023-10-10T21:17:36.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.177+0000 7fb62bfff700 1 -- 172.21.15.154:0/2228852505 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v29) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb638057180 con 0x7fb6440c87c0 2023-10-10T21:17:36.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb630066f30 msgr2=0x7fb6300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb630066f30 0x7fb6300693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb634006fd0 tx=0x7fb634008040 comp rx=0 tx=0).stop 2023-10-10T21:17:36.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440c87c0 msgr2=0x7fb644158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440c87c0 0x7fb644158e40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb644063d40 tx=0x7fb63801a000 comp rx=0 tx=0).stop 2023-10-10T21:17:36.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 shutdown_connections 2023-10-10T21:17:36.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6440ccee0 0x7fb644144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb630066f30 0x7fb6300693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6440c83f0 0x7fb6441561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 --2- 172.21.15.154:0/2228852505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6440c87c0 0x7fb644158e40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 >> 172.21.15.154:0/2228852505 conn(0x7fb644068e10 msgr2=0x7fb6440ca100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:36.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 shutdown_connections 2023-10-10T21:17:36.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.180+0000 7fb64a5ff700 1 -- 172.21.15.154:0/2228852505 wait complete. 2023-10-10T21:17:36.200 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T21:17:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.406+0000 7fb41619d700 1 Processor -- start 2023-10-10T21:17:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.406+0000 7fb41619d700 1 -- start start 2023-10-10T21:17:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.408+0000 7fb41619d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb4100b16d0 0x7fb4100b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.408+0000 7fb41619d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4100b2080 con 0x7fb4100b33b0 2023-10-10T21:17:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.408+0000 7fb41619d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4100cfb00 con 0x7fb4100b4e70 2023-10-10T21:17:36.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.408+0000 7fb41619d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4100b5c40 con 0x7fb4100b16d0 2023-10-10T21:17:36.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.408+0000 7fb41599c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb4100b33b0 0x7fb4100b37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54452/0 (socket says 172.21.15.154:54452) 2023-10-10T21:17:36.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.408+0000 7fb41599c700 1 -- 172.21.15.154:0/3031961578 learned_addr learned my addr 172.21.15.154:0/3031961578 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:36.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.408+0000 7fb41499a700 1 --2- 172.21.15.154:0/3031961578 >> v2:172.21.15.179:3300/0 conn(0x7fb4100b16d0 0x7fb4100b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:36.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.408+0000 7fb407fff700 1 -- 172.21.15.154:0/3031961578 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162601592 0 0) 0x7fb4100b2080 con 0x7fb4100b33b0 2023-10-10T21:17:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.408+0000 7fb407fff700 1 -- 172.21.15.154:0/3031961578 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3fc003570 con 0x7fb4100b33b0 2023-10-10T21:17:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.409+0000 7fb41499a700 1 -- 172.21.15.154:0/3031961578 >> v1:172.21.15.179:6789/0 conn(0x7fb4100b4e70 legacy=0x7fb4100ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.409+0000 7fb41499a700 1 -- 172.21.15.154:0/3031961578 >> v1:172.21.15.154:6789/0 conn(0x7fb4100b33b0 legacy=0x7fb4100b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.409+0000 7fb41499a700 1 -- 172.21.15.154:0/3031961578 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4100b5f20 con 0x7fb4100b16d0 2023-10-10T21:17:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.409+0000 7fb41499a700 1 --2- 172.21.15.154:0/3031961578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4100b16d0 0x7fb4100b1b40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb4000098e0 tx=0x7fb4000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5916fc1c83d0974 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.409+0000 7fb407fff700 1 -- 172.21.15.154:0/3031961578 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40000b640 con 0x7fb4100b16d0 2023-10-10T21:17:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.409+0000 7fb407fff700 1 -- 172.21.15.154:0/3031961578 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40000b7a0 con 0x7fb4100b16d0 2023-10-10T21:17:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.409+0000 7fb407fff700 1 -- 172.21.15.154:0/3031961578 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40000bb40 con 0x7fb4100b16d0 2023-10-10T21:17:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.410+0000 7fb41619d700 1 -- 172.21.15.154:0/3031961578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4100b16d0 msgr2=0x7fb4100b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.410+0000 7fb41619d700 1 --2- 172.21.15.154:0/3031961578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4100b16d0 0x7fb4100b1b40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb4000098e0 tx=0x7fb4000091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.410+0000 7fb41619d700 1 -- 172.21.15.154:0/3031961578 shutdown_connections 2023-10-10T21:17:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.410+0000 7fb41619d700 1 --2- 172.21.15.154:0/3031961578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4100b16d0 0x7fb4100b1b40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.410+0000 7fb41619d700 1 -- 172.21.15.154:0/3031961578 >> 172.21.15.154:0/3031961578 conn(0x7fb4100d10c0 msgr2=0x7fb4100affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:36.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.410+0000 7fb41619d700 1 -- 172.21.15.154:0/3031961578 shutdown_connections 2023-10-10T21:17:36.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.410+0000 7fb41619d700 1 -- 172.21.15.154:0/3031961578 wait complete. 2023-10-10T21:17:36.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.411+0000 7fb41619d700 1 Processor -- start 2023-10-10T21:17:36.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.412+0000 7fb41619d700 1 -- start start 2023-10-10T21:17:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.412+0000 7fb41619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4100b16d0 0x7fb41015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.412+0000 7fb41619d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4100b33b0 0x7fb41015c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.412+0000 7fb41619d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4100b4e70 0x7fb41016d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.412+0000 7fb41619d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41015d820 con 0x7fb4100b33b0 2023-10-10T21:17:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.412+0000 7fb41619d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41015c970 con 0x7fb4100b4e70 2023-10-10T21:17:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.412+0000 7fb41619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41015cc10 con 0x7fb4100b16d0 2023-10-10T21:17:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41499a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4100b33b0 0x7fb41015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41499a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4100b33b0 0x7fb41015c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41952/0 (socket says 172.21.15.154:41952) 2023-10-10T21:17:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41499a700 1 -- 172.21.15.154:0/3781365239 learned_addr learned my addr 172.21.15.154:0/3781365239 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41519b700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4100b16d0 0x7fb41015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41599c700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4100b4e70 0x7fb41016d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41499a700 1 -- 172.21.15.154:0/3781365239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4100b16d0 msgr2=0x7fb41015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41499a700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4100b16d0 0x7fb41015bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41499a700 1 -- 172.21.15.154:0/3781365239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4100b4e70 msgr2=0x7fb41016d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41499a700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4100b4e70 0x7fb41016d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.413+0000 7fb41499a700 1 -- 172.21.15.154:0/3781365239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb400009420 con 0x7fb4100b33b0 2023-10-10T21:17:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.414+0000 7fb41499a700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4100b33b0 0x7fb41015c430 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb410070dd0 tx=0x7fb400017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.414+0000 7fb4057fa700 1 -- 172.21.15.154:0/3781365239 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400000bc0 con 0x7fb4100b33b0 2023-10-10T21:17:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.414+0000 7fb4057fa700 1 -- 172.21.15.154:0/3781365239 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40000b910 con 0x7fb4100b33b0 2023-10-10T21:17:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.414+0000 7fb4057fa700 1 -- 172.21.15.154:0/3781365239 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400000d20 con 0x7fb4100b33b0 2023-10-10T21:17:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.414+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41015cef0 con 0x7fb4100b33b0 2023-10-10T21:17:36.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.414+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41015d4b0 con 0x7fb4100b33b0 2023-10-10T21:17:36.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.415+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41015d990 con 0x7fb4100b33b0 2023-10-10T21:17:36.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.416+0000 7fb4057fa700 1 -- 172.21.15.154:0/3781365239 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 29) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb400023070 con 0x7fb4100b33b0 2023-10-10T21:17:36.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.417+0000 7fb4057fa700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3f4066f80 0x7fb3f4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.417+0000 7fb4057fa700 1 -- 172.21.15.154:0/3781365239 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fb400085ce0 con 0x7fb4100b33b0 2023-10-10T21:17:36.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.417+0000 7fb41519b700 1 -- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3f4066f80 msgr2=0x7fb3f4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:36.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.417+0000 7fb41519b700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3f4066f80 0x7fb3f4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:36.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.421+0000 7fb4057fa700 1 -- 172.21.15.154:0/3781365239 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb400052d20 con 0x7fb4100b33b0 2023-10-10T21:17:36.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.618+0000 7fb41519b700 1 -- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3f4066f80 msgr2=0x7fb3f4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:36.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.618+0000 7fb41519b700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3f4066f80 0x7fb3f4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:36.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.619+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb410160b00 con 0x7fb4100b33b0 2023-10-10T21:17:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.625+0000 7fb4057fa700 1 -- 172.21.15.154:0/3781365239 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb4000150d0 con 0x7fb4100b33b0 2023-10-10T21:17:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3f4066f80 msgr2=0x7fb3f4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3f4066f80 0x7fb3f4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4100b33b0 msgr2=0x7fb41015c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4100b33b0 0x7fb41015c430 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb410070dd0 tx=0x7fb400017000 comp rx=0 tx=0).stop 2023-10-10T21:17:36.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 shutdown_connections 2023-10-10T21:17:36.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3f4066f80 0x7fb3f4069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4100b4e70 0x7fb41016d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4100b16d0 0x7fb41015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 --2- 172.21.15.154:0/3781365239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4100b33b0 0x7fb41015c430 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 >> 172.21.15.154:0/3781365239 conn(0x7fb4100d10c0 msgr2=0x7fb4100c5670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.627+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 shutdown_connections 2023-10-10T21:17:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.628+0000 7fb41619d700 1 -- 172.21.15.154:0/3781365239 wait complete. 2023-10-10T21:17:36.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T21:17:36.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.836+0000 7ff66699d700 1 Processor -- start 2023-10-10T21:17:36.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.836+0000 7ff66699d700 1 -- start start 2023-10-10T21:17:36.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.837+0000 7ff66699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.837+0000 7ff66699d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff6600b1b40 0x7ff66015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.837+0000 7ff66699d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6600cfb00 con 0x7ff6600b16d0 2023-10-10T21:17:36.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.837+0000 7ff66699d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6600b5c40 con 0x7ff6600b1b40 2023-10-10T21:17:36.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.837+0000 7ff66699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600b5f20 con 0x7ff6600b4e70 2023-10-10T21:17:36.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.838+0000 7ff66599b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:36.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.838+0000 7ff66599b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:55260/0 (socket says 172.21.15.154:55260) 2023-10-10T21:17:36.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.838+0000 7ff66599b700 1 -- 172.21.15.154:0/2079402180 learned_addr learned my addr 172.21.15.154:0/2079402180 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.838+0000 7ff66619c700 1 --2- 172.21.15.154:0/2079402180 >> v2:172.21.15.179:3300/0 conn(0x7ff6600b1b40 0x7ff66015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.838+0000 7ff66599b700 1 -- 172.21.15.154:0/2079402180 >> v2:172.21.15.179:3300/0 conn(0x7ff6600b1b40 msgr2=0x7ff66015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.838+0000 7ff66599b700 1 --2- 172.21.15.154:0/2079402180 >> v2:172.21.15.179:3300/0 conn(0x7ff6600b1b40 0x7ff66015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.838+0000 7ff66599b700 1 -- 172.21.15.154:0/2079402180 >> v1:172.21.15.179:6789/0 conn(0x7ff6600b16d0 legacy=0x7ff66015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.838+0000 7ff66599b700 1 -- 172.21.15.154:0/2079402180 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600b6200 con 0x7ff6600b4e70 2023-10-10T21:17:36.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.839+0000 7ff66599b700 1 --2- 172.21.15.154:0/2079402180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600ccff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0099b0 tx=0x7ff65c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a608a5db6b61fb73 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:36.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.839+0000 7ff664999700 1 -- 172.21.15.154:0/2079402180 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c009ea0 con 0x7ff6600b4e70 2023-10-10T21:17:36.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.839+0000 7ff664999700 1 -- 172.21.15.154:0/2079402180 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c00b860 con 0x7ff6600b4e70 2023-10-10T21:17:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.839+0000 7ff664999700 1 -- 172.21.15.154:0/2079402180 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c00bc00 con 0x7ff6600b4e70 2023-10-10T21:17:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.839+0000 7ff66699d700 1 -- 172.21.15.154:0/2079402180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 msgr2=0x7ff6600ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.839+0000 7ff66699d700 1 --2- 172.21.15.154:0/2079402180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600ccff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0099b0 tx=0x7ff65c009250 comp rx=0 tx=0).stop 2023-10-10T21:17:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.840+0000 7ff66699d700 1 -- 172.21.15.154:0/2079402180 shutdown_connections 2023-10-10T21:17:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.840+0000 7ff66699d700 1 --2- 172.21.15.154:0/2079402180 >> v2:172.21.15.179:3300/0 conn(0x7ff6600b1b40 0x7ff66015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.840+0000 7ff66699d700 1 --2- 172.21.15.154:0/2079402180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600ccff0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.840+0000 7ff66699d700 1 -- 172.21.15.154:0/2079402180 >> 172.21.15.154:0/2079402180 conn(0x7ff6600d10c0 msgr2=0x7ff6600affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:36.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.840+0000 7ff66699d700 1 -- 172.21.15.154:0/2079402180 shutdown_connections 2023-10-10T21:17:36.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.840+0000 7ff66699d700 1 -- 172.21.15.154:0/2079402180 wait complete. 2023-10-10T21:17:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.841+0000 7ff66699d700 1 Processor -- start 2023-10-10T21:17:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.841+0000 7ff66699d700 1 -- start start 2023-10-10T21:17:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66699d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600b16d0 0x7ff660169a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6600b1b40 0x7ff6600c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66699d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff660169fa0 con 0x7ff6600b16d0 2023-10-10T21:17:36.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600caf40 con 0x7ff6600b1b40 2023-10-10T21:17:36.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600ca330 con 0x7ff6600b4e70 2023-10-10T21:17:36.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66599b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600b16d0 0x7ff660169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:36.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66599b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600b16d0 0x7ff660169a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41966/0 (socket says 172.21.15.154:41966) 2023-10-10T21:17:36.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66599b700 1 -- 172.21.15.154:0/3513071210 learned_addr learned my addr 172.21.15.154:0/3513071210 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:36.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66619c700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:36.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.842+0000 7ff66519a700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6600b1b40 0x7ff6600c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:36.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff66599b700 1 -- 172.21.15.154:0/3513071210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 msgr2=0x7ff6600a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff66599b700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff66599b700 1 -- 172.21.15.154:0/3513071210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6600b1b40 msgr2=0x7ff6600c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:36.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff66599b700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6600b1b40 0x7ff6600c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:36.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff66599b700 1 -- 172.21.15.154:0/3513071210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0094f0 con 0x7ff6600b16d0 2023-10-10T21:17:36.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff66599b700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600b16d0 0x7ff660169a60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff6600b6060 tx=0x7ff65c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:36.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff655ffb700 1 -- 172.21.15.154:0/3513071210 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c000d10 con 0x7ff6600b16d0 2023-10-10T21:17:36.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff655ffb700 1 -- 172.21.15.154:0/3513071210 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c00b9d0 con 0x7ff6600b16d0 2023-10-10T21:17:36.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6600ca610 con 0x7ff6600b16d0 2023-10-10T21:17:36.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.843+0000 7ff655ffb700 1 -- 172.21.15.154:0/3513071210 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c025420 con 0x7ff6600b16d0 2023-10-10T21:17:36.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.844+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6600cabd0 con 0x7ff6600b16d0 2023-10-10T21:17:36.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.845+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff660088990 con 0x7ff6600b16d0 2023-10-10T21:17:36.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.845+0000 7ff655ffb700 1 -- 172.21.15.154:0/3513071210 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 29) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ff65c023070 con 0x7ff6600b16d0 2023-10-10T21:17:36.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.846+0000 7ff655ffb700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff644066f80 0x7ff644069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:36.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.846+0000 7ff66519a700 1 -- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff644066f80 msgr2=0x7ff644069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:36.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.846+0000 7ff655ffb700 1 -- 172.21.15.154:0/3513071210 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ff65c085d10 con 0x7ff6600b16d0 2023-10-10T21:17:36.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.846+0000 7ff66519a700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff644066f80 0x7ff644069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:36.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:36.851+0000 7ff655ffb700 1 -- 172.21.15.154:0/3513071210 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff65c052df0 con 0x7ff6600b16d0 2023-10-10T21:17:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.047+0000 7ff66519a700 1 -- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff644066f80 msgr2=0x7ff644069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:37.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.047+0000 7ff66519a700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff644066f80 0x7ff644069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:37.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.054+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7ff6600b5750 con 0x7ff6600b16d0 2023-10-10T21:17:37.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.058+0000 7ff655ffb700 1 -- 172.21.15.154:0/3513071210 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff65c02a0c0 con 0x7ff6600b16d0 2023-10-10T21:17:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff644066f80 msgr2=0x7ff644069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff644066f80 0x7ff644069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600b16d0 msgr2=0x7ff660169a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600b16d0 0x7ff660169a60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff6600b6060 tx=0x7ff65c017000 comp rx=0 tx=0).stop 2023-10-10T21:17:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 shutdown_connections 2023-10-10T21:17:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6600b4e70 0x7ff6600a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600b16d0 0x7ff660169a60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff644066f80 0x7ff644069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 --2- 172.21.15.154:0/3513071210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6600b1b40 0x7ff6600c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 >> 172.21.15.154:0/3513071210 conn(0x7ff6600d10c0 msgr2=0x7ff660068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 shutdown_connections 2023-10-10T21:17:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.060+0000 7ff66699d700 1 -- 172.21.15.154:0/3513071210 wait complete. 2023-10-10T21:17:37.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:17:37.082 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-10T21:17:37.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-10T21:17:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.360+0000 7fadfe39d700 1 Processor -- start 2023-10-10T21:17:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.360+0000 7fadfe39d700 1 -- start start 2023-10-10T21:17:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.361+0000 7fadfe39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadf80b03c0 0x7fadf80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.361+0000 7fadfe39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fadf81591e0 0x7fadf8159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.361+0000 7fadfe39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf80cfa00 con 0x7fadf80b0790 2023-10-10T21:17:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.361+0000 7fadfe39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf80cb580 con 0x7fadf80b03c0 2023-10-10T21:17:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.361+0000 7fadfe39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf80cf160 con 0x7fadf81591e0 2023-10-10T21:17:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.362+0000 7fadfd39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadf80b03c0 0x7fadf80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.362+0000 7fadfd39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadf80b03c0 0x7fadf80cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41974/0 (socket says 172.21.15.154:41974) 2023-10-10T21:17:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.362+0000 7fadfd39b700 1 -- 172.21.15.154:0/1050786235 learned_addr learned my addr 172.21.15.154:0/1050786235 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.362+0000 7fadfdb9c700 1 --2- 172.21.15.154:0/1050786235 >> v2:172.21.15.179:3300/0 conn(0x7fadf81591e0 0x7fadf8159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.362+0000 7fadfd39b700 1 -- 172.21.15.154:0/1050786235 >> v2:172.21.15.179:3300/0 conn(0x7fadf81591e0 msgr2=0x7fadf8159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:37.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.362+0000 7fadfd39b700 1 --2- 172.21.15.154:0/1050786235 >> v2:172.21.15.179:3300/0 conn(0x7fadf81591e0 0x7fadf8159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.362+0000 7fadfd39b700 1 -- 172.21.15.154:0/1050786235 >> v1:172.21.15.179:6789/0 conn(0x7fadf80b0790 legacy=0x7fadf80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:37.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.362+0000 7fadfd39b700 1 -- 172.21.15.154:0/1050786235 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80cf440 con 0x7fadf80b03c0 2023-10-10T21:17:37.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.363+0000 7fadfd39b700 1 --2- 172.21.15.154:0/1050786235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf80b03c0 0x7fadf80cea70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fadf40099b0 tx=0x7fadf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69847ef64d464996 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.363+0000 7fadeffff700 1 -- 172.21.15.154:0/1050786235 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4009ea0 con 0x7fadf80b03c0 2023-10-10T21:17:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.363+0000 7fadeffff700 1 -- 172.21.15.154:0/1050786235 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf400b820 con 0x7fadf80b03c0 2023-10-10T21:17:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.363+0000 7fadeffff700 1 -- 172.21.15.154:0/1050786235 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400bbe0 con 0x7fadf80b03c0 2023-10-10T21:17:37.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.363+0000 7fadfe39d700 1 -- 172.21.15.154:0/1050786235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf80b03c0 msgr2=0x7fadf80cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:37.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.363+0000 7fadfe39d700 1 --2- 172.21.15.154:0/1050786235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf80b03c0 0x7fadf80cea70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fadf40099b0 tx=0x7fadf4009250 comp rx=0 tx=0).stop 2023-10-10T21:17:37.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.364+0000 7fadfe39d700 1 -- 172.21.15.154:0/1050786235 shutdown_connections 2023-10-10T21:17:37.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.364+0000 7fadfe39d700 1 --2- 172.21.15.154:0/1050786235 >> v2:172.21.15.179:3300/0 conn(0x7fadf81591e0 0x7fadf8159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.364+0000 7fadfe39d700 1 --2- 172.21.15.154:0/1050786235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf80b03c0 0x7fadf80cea70 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.364+0000 7fadfe39d700 1 -- 172.21.15.154:0/1050786235 >> 172.21.15.154:0/1050786235 conn(0x7fadf8063230 msgr2=0x7fadf8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:37.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.364+0000 7fadfe39d700 1 -- 172.21.15.154:0/1050786235 shutdown_connections 2023-10-10T21:17:37.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.364+0000 7fadfe39d700 1 -- 172.21.15.154:0/1050786235 wait complete. 2023-10-10T21:17:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.365+0000 7fadfe39d700 1 Processor -- start 2023-10-10T21:17:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.365+0000 7fadfe39d700 1 -- start start 2023-10-10T21:17:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfe39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadf80b03c0 0x7fadf80c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfe39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf80b0790 0x7fadf815d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfe39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf81591e0 0x7fadf80c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfe39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80c6ca0 con 0x7fadf81591e0 2023-10-10T21:17:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfe39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80c56c0 con 0x7fadf80b03c0 2023-10-10T21:17:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfe39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80c59a0 con 0x7fadf80b0790 2023-10-10T21:17:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfdb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf81591e0 0x7fadf80c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfdb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf81591e0 0x7fadf80c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41990/0 (socket says 172.21.15.154:41990) 2023-10-10T21:17:37.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfdb9c700 1 -- 172.21.15.154:0/3983223552 learned_addr learned my addr 172.21.15.154:0/3983223552 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:37.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.366+0000 7fadfcb9a700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf80b0790 0x7fadf815d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:37.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7fadfd39b700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadf80b03c0 0x7fadf80c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:37.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7fadfdb9c700 1 -- 172.21.15.154:0/3983223552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf80b0790 msgr2=0x7fadf815d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:37.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7fadfdb9c700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf80b0790 0x7fadf815d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7fadfdb9c700 1 -- 172.21.15.154:0/3983223552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadf80b03c0 msgr2=0x7fadf80c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7fadfdb9c700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadf80b03c0 0x7fadf80c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7fadfdb9c700 1 -- 172.21.15.154:0/3983223552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf40094f0 con 0x7fadf81591e0 2023-10-10T21:17:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7fadfdb9c700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf81591e0 0x7fadf80c4de0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009e90 tx=0x7fadf000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000cb70 con 0x7fadf81591e0 2023-10-10T21:17:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000f040 con 0x7fadf81591e0 2023-10-10T21:17:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0014480 con 0x7fadf81591e0 2023-10-10T21:17:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.367+0000 7fadfe39d700 1 -- 172.21.15.154:0/3983223552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf80c5c80 con 0x7fadf81591e0 2023-10-10T21:17:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.368+0000 7fadfe39d700 1 -- 172.21.15.154:0/3983223552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf80c6240 con 0x7fadf81591e0 2023-10-10T21:17:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.369+0000 7fadfe39d700 1 -- 172.21.15.154:0/3983223552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf80c6460 con 0x7fadf81591e0 2023-10-10T21:17:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.369+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 29) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fadf0014830 con 0x7fadf81591e0 2023-10-10T21:17:37.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.370+0000 7faded7fa700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:37.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.370+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fadf0085470 con 0x7fadf81591e0 2023-10-10T21:17:37.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.370+0000 7fadfd39b700 1 -- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 msgr2=0x7faddc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:37.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.370+0000 7fadfd39b700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:37.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.378+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadf00524b0 con 0x7fadf81591e0 2023-10-10T21:17:37.457 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:37.456+0000 7fa3ceaae180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:17:37.540 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:37.539+0000 7f074b47e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:17:37.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.571+0000 7fadfd39b700 1 -- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 msgr2=0x7faddc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:37.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.571+0000 7fadfd39b700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.600+0000 7fadfe39d700 1 -- 172.21.15.154:0/3983223552 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fadf804c3c0 con 0x7faddc066f80 2023-10-10T21:17:37.619 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:37.619+0000 7fa3ceaae180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:37.705 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:37.705+0000 7fa3ceaae180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:17:37.708 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:37.708+0000 7f074b47e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:37.795 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:37.794+0000 7f074b47e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:17:37.930 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:37.929+0000 7fa3ceaae180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:37.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.972+0000 7fadfd39b700 1 -- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 msgr2=0x7faddc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:37.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:37.972+0000 7fadfd39b700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:17:38.021 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:38.020+0000 7f074b47e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:38.108 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:38.107+0000 7fa3ceaae180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:17:38.203 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:38.203+0000 7fa3ceaae180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:17:38.204 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:38.203+0000 7f074b47e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:17:38.297 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:38.296+0000 7f074b47e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:17:38.365 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:38.364+0000 7fa3ceaae180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:17:38.461 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:38.460+0000 7f074b47e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:17:38.465 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:38.465+0000 7fa3ceaae180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:38.562 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:38.561+0000 7f074b47e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:38.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:38.773+0000 7fadfd39b700 1 -- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 msgr2=0x7faddc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:38.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:38.773+0000 7fadfd39b700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T21:17:38.946 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:38.945+0000 7fa3ceaae180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:17:39.039 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:39.039+0000 7fa3ceaae180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:17:39.050 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:39.049+0000 7f074b47e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:17:39.130 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:39.129+0000 7fa3ceaae180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:17:39.145 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:39.144+0000 7f074b47e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:17:39.236 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:39.235+0000 7f074b47e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:17:39.750 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:39.749+0000 7fa3ceaae180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:17:39.865 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:39.864+0000 7f074b47e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:17:39.921 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:39.920+0000 7fa3ceaae180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:40.015 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:40.015+0000 7fa3ceaae180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:17:40.038 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:40.037+0000 7f074b47e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:40.136 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:40.135+0000 7f074b47e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:17:40.308 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:40.308+0000 7fa3ceaae180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:17:40.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:40.374+0000 7fadfd39b700 1 -- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 msgr2=0x7faddc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:40.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:40.374+0000 7fadfd39b700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T21:17:40.405 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:40.405+0000 7fa3ceaae180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:17:40.431 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:40.430+0000 7f074b47e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:17:40.528 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:40.527+0000 7f074b47e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:17:41.107 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:41.107+0000 7fa3ceaae180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:17:41.239 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:41.238+0000 7f074b47e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:17:41.394 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:41.393+0000 7fa3ceaae180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:17:41.486 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:41.485+0000 7fa3ceaae180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:17:41.527 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:41.526+0000 7f074b47e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:17:41.622 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:41.621+0000 7f074b47e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:17:41.639 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:41.639+0000 7fa3ceaae180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:17:41.743 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:41.743+0000 7fa3ceaae180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:17:41.776 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:41.775+0000 7f074b47e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:17:41.881 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:41.880+0000 7f074b47e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:17:41.931 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:41.930+0000 7fa3ceaae180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:17:42.021 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:42.021+0000 7fa3ceaae180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:17:42.071 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.070+0000 7f074b47e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:17:42.111 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:42.111+0000 7fa3ceaae180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:17:42.164 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.163+0000 7f074b47e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:17:42.205 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:42.204+0000 7fa3ceaae180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:17:42.258 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.257+0000 7f074b47e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:17:42.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:42.263+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 30) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fadf0052880 con 0x7fadf81591e0 2023-10-10T21:17:42.356 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.355+0000 7f074b47e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:17:42.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:42.364+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mgrmap(e 31) v1 ==== 84468+0+0 (secure 0 0 0) 0x7fadf0024300 con 0x7fadf81591e0 2023-10-10T21:17:42.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:42.364+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 msgr2=0x7faddc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:42.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:42.364+0000 7faded7fa700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:42.490 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06c07b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:42.491 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06c07b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:42.491 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06c07b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:42.491 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06c07b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:42.491 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06c07b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:42.491 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06bcfb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:42.492 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06bcfb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:42.492 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06bcfb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:42.492 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06bcfb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:42.492 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:42.489+0000 7f06bcfb0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:17:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.369+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mon.0 v2:172.21.15.154:3300/0 9 ==== mgrmap(e 32) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fadf0053150 con 0x7fadf81591e0 2023-10-10T21:17:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.369+0000 7faded7fa700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.369+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fadf804c3c0 con 0x7faddc066f80 2023-10-10T21:17:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.370+0000 7fadfd39b700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:43.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.372+0000 7fadfd39b700 1 --2- 172.21.15.154:0/3983223552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7faddc066f80 0x7faddc0693b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fadf40099b0 tx=0x7fadf4017000 comp rx=0 tx=0).ready entity=mgr.6459 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:43.384 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:43.383+0000 7f06c77c5700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-10T21:17:43.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.383+0000 7faded7fa700 1 -- 172.21.15.154:0/3983223552 <== mgr.6459 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fadf804c3c0 con 0x7faddc066f80 2023-10-10T21:17:43.387 INFO:teuthology.orchestra.run.smithi154.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-10T21:17:43.395 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-10T21:17:43.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:17:43.397 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-10T21:17:43.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T21:17:43.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.664+0000 7f9ce55ff700 1 Processor -- start 2023-10-10T21:17:43.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.664+0000 7f9ce55ff700 1 -- start start 2023-10-10T21:17:43.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.665+0000 7f9ce55ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce01568e0 0x7f9ce01616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:43.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.665+0000 7f9ce55ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce015b0d0 con 0x7f9ce00ccee0 2023-10-10T21:17:43.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.665+0000 7f9ce55ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce015a4c0 con 0x7f9ce00c83f0 2023-10-10T21:17:43.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.665+0000 7f9ce55ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce015a7a0 con 0x7f9ce01568e0 2023-10-10T21:17:43.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cde7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9ce00ccee0 0x7f9ce01561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54454/0 (socket says 172.21.15.154:54454) 2023-10-10T21:17:43.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cde7fc700 1 -- 172.21.15.154:0/2136111976 learned_addr learned my addr 172.21.15.154:0/2136111976 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:43.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cdf7fe700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce01568e0 0x7f9ce01616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:43.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854958539 0 0) 0x7f9ce015b0d0 con 0x7f9ce00ccee0 2023-10-10T21:17:43.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc8003570 con 0x7f9ce00ccee0 2023-10-10T21:17:43.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959433897 0 0) 0x7f9ce015a4c0 con 0x7f9ce00c83f0 2023-10-10T21:17:43.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce015b0d0 con 0x7f9ce00c83f0 2023-10-10T21:17:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2138910832 0 0) 0x7f9cc8003570 con 0x7f9ce00ccee0 2023-10-10T21:17:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce01568e0 msgr2=0x7f9ce01616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce01568e0 0x7f9ce01616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 >> v1:172.21.15.179:6789/0 conn(0x7f9ce00c83f0 legacy=0x7f9ce00c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce015aa80 con 0x7f9ce00ccee0 2023-10-10T21:17:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.666+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f9cd4001470 con 0x7f9ce00ccee0 2023-10-10T21:17:43.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 >> v1:172.21.15.154:6789/0 conn(0x7f9ce00ccee0 legacy=0x7f9ce01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:43.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cddffb700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc8003c20 0x7f9cc8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:43.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cddffb700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8004810 0x7f9cc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:43.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cddffb700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce01568e0 0x7f9cc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:43.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce015a7a0 con 0x7f9cc8003c20 2023-10-10T21:17:43.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc800bb40 con 0x7f9cc8004810 2023-10-10T21:17:43.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc800bd00 con 0x7f9ce01568e0 2023-10-10T21:17:43.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cdeffd700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc8003c20 0x7f9cc8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:43.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cde7fc700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8004810 0x7f9cc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:43.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cdf7fe700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce01568e0 0x7f9cc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:43.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cdeffd700 1 -- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce01568e0 msgr2=0x7f9cc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:43.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cdeffd700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce01568e0 0x7f9cc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:43.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cdeffd700 1 -- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8004810 msgr2=0x7f9cc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:43.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cdeffd700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cc8004810 0x7f9cc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:43.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.667+0000 7f9cdeffd700 1 -- 172.21.15.154:0/2136111976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc8003570 con 0x7f9cc8003c20 2023-10-10T21:17:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9cdeffd700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc8003c20 0x7f9cc8004010 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0001a10 tx=0x7f9cd0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fbddbce5483920 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd000c5d0 con 0x7f9cc8003c20 2023-10-10T21:17:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd000c730 con 0x7f9cc8003c20 2023-10-10T21:17:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9cddffb700 1 -- 172.21.15.154:0/2136111976 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd000cad0 con 0x7f9cc8003c20 2023-10-10T21:17:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2136111976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc8003c20 msgr2=0x7f9cc8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9ce55ff700 1 --2- 172.21.15.154:0/2136111976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc8003c20 0x7f9cc8004010 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0001a10 tx=0x7f9cd0007d30 comp rx=0 tx=0).stop 2023-10-10T21:17:43.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9cdf7fe700 1 -- 172.21.15.154:0/2136111976 reap_dead start 2023-10-10T21:17:43.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2136111976 shutdown_connections 2023-10-10T21:17:43.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2136111976 >> 172.21.15.154:0/2136111976 conn(0x7f9ce0068e10 msgr2=0x7f9ce00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:43.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2136111976 shutdown_connections 2023-10-10T21:17:43.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.668+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2136111976 wait complete. 2023-10-10T21:17:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.670+0000 7f9ce55ff700 1 Processor -- start 2023-10-10T21:17:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.670+0000 7f9ce55ff700 1 -- start start 2023-10-10T21:17:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9ce55ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc8003c20 0x7f9ce0154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9ce55ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce01527f0 0x7f9ce0152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9ce55ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce016a210 0x7f9ce016a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9ce55ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce0155b10 con 0x7f9ce016a210 2023-10-10T21:17:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9ce55ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce0154f00 con 0x7f9ce01527f0 2023-10-10T21:17:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9ce55ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce01551e0 con 0x7f9cc8003c20 2023-10-10T21:17:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9cdf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce016a210 0x7f9ce016a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9cdf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce016a210 0x7f9ce016a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42114/0 (socket says 172.21.15.154:42114) 2023-10-10T21:17:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9cdf7fe700 1 -- 172.21.15.154:0/2821999385 learned_addr learned my addr 172.21.15.154:0/2821999385 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9cde7fc700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce01527f0 0x7f9ce0152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.671+0000 7f9cdeffd700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc8003c20 0x7f9ce0154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9cdf7fe700 1 -- 172.21.15.154:0/2821999385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc8003c20 msgr2=0x7f9ce0154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9cdf7fe700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc8003c20 0x7f9ce0154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9cdf7fe700 1 -- 172.21.15.154:0/2821999385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce01527f0 msgr2=0x7f9ce0152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9cdf7fe700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce01527f0 0x7f9ce0152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9cdf7fe700 1 -- 172.21.15.154:0/2821999385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce01554c0 con 0x7f9ce016a210 2023-10-10T21:17:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9cdf7fe700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce016a210 0x7f9ce016a680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00c6b00 tx=0x7f9cd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9cc6ffd700 1 -- 172.21.15.154:0/2821999385 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd800e070 con 0x7f9ce016a210 2023-10-10T21:17:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9cc6ffd700 1 -- 172.21.15.154:0/2821999385 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd8011b80 con 0x7f9ce016a210 2023-10-10T21:17:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9cc6ffd700 1 -- 172.21.15.154:0/2821999385 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8016470 con 0x7f9ce016a210 2023-10-10T21:17:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce01557a0 con 0x7f9ce016a210 2023-10-10T21:17:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.672+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce0154ba0 con 0x7f9ce016a210 2023-10-10T21:17:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.673+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce00c4760 con 0x7f9ce016a210 2023-10-10T21:17:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.674+0000 7f9cc6ffd700 1 -- 172.21.15.154:0/2821999385 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 32) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f9cd8016860 con 0x7f9ce016a210 2023-10-10T21:17:43.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.675+0000 7f9cc6ffd700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9ccc066dd0 0x7f9ccc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:43.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.675+0000 7f9cc6ffd700 1 -- 172.21.15.154:0/2821999385 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f9cd8084f30 con 0x7f9ce016a210 2023-10-10T21:17:43.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.675+0000 7f9cdeffd700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9ccc066dd0 0x7f9ccc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:43.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.676+0000 7f9cdeffd700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9ccc066dd0 0x7f9ccc069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0008fd0 tx=0x7f9cd0015000 comp rx=0 tx=0).ready entity=mgr.6459 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:43.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.680+0000 7f9cc6ffd700 1 -- 172.21.15.154:0/2821999385 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ce00c4760 con 0x7f9ce016a210 2023-10-10T21:17:43.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:43.927+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f9ce004c3c0 con 0x7f9ce016a210 2023-10-10T21:17:44.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.379+0000 7f9cc6ffd700 1 -- 172.21.15.154:0/2821999385 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9cd805b080 con 0x7f9ce016a210 2023-10-10T21:17:44.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.380+0000 7f9cc6ffd700 1 -- 172.21.15.154:0/2821999385 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v33) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9cd8055c50 con 0x7f9ce016a210 2023-10-10T21:17:44.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9ccc066dd0 msgr2=0x7f9ccc069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:44.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9ccc066dd0 0x7f9ccc069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0008fd0 tx=0x7f9cd0015000 comp rx=0 tx=0).stop 2023-10-10T21:17:44.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce016a210 msgr2=0x7f9ce016a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:44.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce016a210 0x7f9ce016a680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00c6b00 tx=0x7f9cd800b040 comp rx=0 tx=0).stop 2023-10-10T21:17:44.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 shutdown_connections 2023-10-10T21:17:44.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce016a210 0x7f9ce016a680 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:44.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cc8003c20 0x7f9ce0154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:44.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9ccc066dd0 0x7f9ccc069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:44.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 --2- 172.21.15.154:0/2821999385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce01527f0 0x7f9ce0152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.383+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 >> 172.21.15.154:0/2821999385 conn(0x7f9ce0068e10 msgr2=0x7f9ce0158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.384+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 shutdown_connections 2023-10-10T21:17:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.384+0000 7f9ce55ff700 1 -- 172.21.15.154:0/2821999385 wait complete. 2023-10-10T21:17:44.403 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:17:44.404 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:17:44.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:17:44.571 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:17:44.572 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T21:17:44.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:17:44.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T21:17:44.656 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:17:44.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:17:44.657 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T21:17:44.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.921+0000 7fa3d659d700 1 Processor -- start 2023-10-10T21:17:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.922+0000 7fa3d659d700 1 -- start start 2023-10-10T21:17:44.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.923+0000 7fa3d659d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3d0159420 0x7fa3d00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:44.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.923+0000 7fa3d659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d015d230 0x7fa3d015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:44.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.923+0000 7fa3d659d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d00b2980 con 0x7fa3d01597f0 2023-10-10T21:17:44.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.923+0000 7fa3d659d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d015dbb0 con 0x7fa3d0159420 2023-10-10T21:17:44.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.923+0000 7fa3d659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00b11d0 con 0x7fa3d015d230 2023-10-10T21:17:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.923+0000 7fa3d559b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3d0159420 0x7fa3d00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3d5d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d015d230 0x7fa3d015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3d559b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3d0159420 0x7fa3d00b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:38386/0 (socket says 172.21.15.154:38386) 2023-10-10T21:17:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3d4d9a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa3d01597f0 0x7fa3d00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:48298/0 (socket says 172.21.15.154:48298) 2023-10-10T21:17:44.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3d559b700 1 -- 172.21.15.154:0/3875084519 learned_addr learned my addr 172.21.15.154:0/3875084519 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:44.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3c7fff700 1 -- 172.21.15.154:0/3875084519 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424490829 0 0) 0x7fa3d00b2980 con 0x7fa3d01597f0 2023-10-10T21:17:44.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3c7fff700 1 -- 172.21.15.154:0/3875084519 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3bc003570 con 0x7fa3d01597f0 2023-10-10T21:17:44.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3d559b700 1 -- 172.21.15.154:0/3875084519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d015d230 msgr2=0x7fa3d015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:44.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3d559b700 1 --2- 172.21.15.154:0/3875084519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d015d230 0x7fa3d015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:44.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3d559b700 1 -- 172.21.15.154:0/3875084519 >> v1:172.21.15.179:6789/0 conn(0x7fa3d01597f0 legacy=0x7fa3d00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:44.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3d559b700 1 -- 172.21.15.154:0/3875084519 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d00b14b0 con 0x7fa3d0159420 2023-10-10T21:17:44.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.924+0000 7fa3d559b700 1 --2- 172.21.15.154:0/3875084519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d0159420 0x7fa3d00b5f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0099b0 tx=0x7fa3cc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=772b56329fa48494 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:44.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3c7fff700 1 -- 172.21.15.154:0/3875084519 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00b680 con 0x7fa3d0159420 2023-10-10T21:17:44.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3c7fff700 1 -- 172.21.15.154:0/3875084519 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc00b7e0 con 0x7fa3d0159420 2023-10-10T21:17:44.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3c7fff700 1 -- 172.21.15.154:0/3875084519 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00bb80 con 0x7fa3d0159420 2023-10-10T21:17:44.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3d659d700 1 -- 172.21.15.154:0/3875084519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d0159420 msgr2=0x7fa3d00b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:44.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3d659d700 1 --2- 172.21.15.154:0/3875084519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d0159420 0x7fa3d00b5f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0099b0 tx=0x7fa3cc009250 comp rx=0 tx=0).stop 2023-10-10T21:17:44.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3d659d700 1 -- 172.21.15.154:0/3875084519 shutdown_connections 2023-10-10T21:17:44.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3d659d700 1 --2- 172.21.15.154:0/3875084519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d015d230 0x7fa3d015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:44.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3d659d700 1 --2- 172.21.15.154:0/3875084519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d0159420 0x7fa3d00b5f40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:44.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3d659d700 1 -- 172.21.15.154:0/3875084519 >> 172.21.15.154:0/3875084519 conn(0x7fa3d00d0660 msgr2=0x7fa3d00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:44.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3d659d700 1 -- 172.21.15.154:0/3875084519 shutdown_connections 2023-10-10T21:17:44.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.925+0000 7fa3d659d700 1 -- 172.21.15.154:0/3875084519 wait complete. 2023-10-10T21:17:44.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.927+0000 7fa3d659d700 1 Processor -- start 2023-10-10T21:17:44.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.927+0000 7fa3d659d700 1 -- start start 2023-10-10T21:17:44.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d659d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d0159420 0x7fa3d0157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:44.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d01597f0 0x7fa3d015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:44.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d659d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d015d230 0x7fa3d00c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:44.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d659d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00c79b0 con 0x7fa3d0159420 2023-10-10T21:17:44.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d659d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00c6de0 con 0x7fa3d015d230 2023-10-10T21:17:44.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00c7080 con 0x7fa3d01597f0 2023-10-10T21:17:44.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d559b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d0159420 0x7fa3d0157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:44.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d4d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d01597f0 0x7fa3d015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:44.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d4d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d01597f0 0x7fa3d015c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:55494/0 (socket says 172.21.15.154:55494) 2023-10-10T21:17:44.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d559b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d0159420 0x7fa3d0157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42138/0 (socket says 172.21.15.154:42138) 2023-10-10T21:17:44.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d4d9a700 1 -- 172.21.15.154:0/955021401 learned_addr learned my addr 172.21.15.154:0/955021401 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:44.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.928+0000 7fa3d5d9c700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d015d230 0x7fa3d00c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:44.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3d4d9a700 1 -- 172.21.15.154:0/955021401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d015d230 msgr2=0x7fa3d00c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:44.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3d4d9a700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d015d230 0x7fa3d00c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:44.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3d4d9a700 1 -- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d0159420 msgr2=0x7fa3d0157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:44.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3d4d9a700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d0159420 0x7fa3d0157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3d4d9a700 1 -- 172.21.15.154:0/955021401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0094f0 con 0x7fa3d01597f0 2023-10-10T21:17:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3d4d9a700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d01597f0 0x7fa3d015c5e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c7c0 tx=0x7fa3c0007dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3c57fa700 1 -- 172.21.15.154:0/955021401 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0005b40 con 0x7fa3d01597f0 2023-10-10T21:17:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3c57fa700 1 -- 172.21.15.154:0/955021401 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c0005ca0 con 0x7fa3d01597f0 2023-10-10T21:17:44.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d00c7360 con 0x7fa3d01597f0 2023-10-10T21:17:44.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3c57fa700 1 -- 172.21.15.154:0/955021401 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0007320 con 0x7fa3d01597f0 2023-10-10T21:17:44.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.929+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d00c7e40 con 0x7fa3d01597f0 2023-10-10T21:17:44.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.930+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d004c3c0 con 0x7fa3d01597f0 2023-10-10T21:17:44.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.931+0000 7fa3c57fa700 1 -- 172.21.15.154:0/955021401 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa3c001b3b0 con 0x7fa3d01597f0 2023-10-10T21:17:44.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.932+0000 7fa3c57fa700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa3b40670e0 0x7fa3b4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:44.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.932+0000 7fa3c57fa700 1 -- 172.21.15.154:0/955021401 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fa3c0083fe0 con 0x7fa3d01597f0 2023-10-10T21:17:44.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.932+0000 7fa3d559b700 1 -- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa3b40670e0 msgr2=0x7fa3b4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:44.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.932+0000 7fa3d559b700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa3b40670e0 0x7fa3b4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:44.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:44.936+0000 7fa3c57fa700 1 -- 172.21.15.154:0/955021401 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3c0050cc0 con 0x7fa3d01597f0 2023-10-10T21:17:45.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.133+0000 7fa3d559b700 1 -- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa3b40670e0 msgr2=0x7fa3b4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:45.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.133+0000 7fa3d559b700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa3b40670e0 0x7fa3b4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:45.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.182+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3d00b1790 con 0x7fa3d01597f0 2023-10-10T21:17:45.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.183+0000 7fa3c57fa700 1 -- 172.21.15.154:0/955021401 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fa3c0017020 con 0x7fa3d01597f0 2023-10-10T21:17:45.185 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:45.185 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/209340130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":209340130},{"type":"v1","addr":"172.21.15.179:6834","nonce":209340130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3372685755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3372685755},{"type":"v1","addr":"172.21.15.154:6835","nonce":3372685755}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1909692066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1909692066},{"type":"v1","addr":"172.21.15.154:6837","nonce":1909692066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:17:21.571274+0000","modified":"2023-10-10T21:17:25.130727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6019":{"gid":6019,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2833897496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2833897496},{"type":"v1","addr":"172.21.15.179:6835","nonce":2833897496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-10T21:17:45.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa3b40670e0 msgr2=0x7fa3b4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa3b40670e0 0x7fa3b4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d01597f0 msgr2=0x7fa3d015c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d01597f0 0x7fa3d015c5e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c7c0 tx=0x7fa3c0007dd0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 shutdown_connections 2023-10-10T21:17:45.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa3b40670e0 0x7fa3b4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d015d230 0x7fa3d00c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d0159420 0x7fa3d0157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 --2- 172.21.15.154:0/955021401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d01597f0 0x7fa3d015c5e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 >> 172.21.15.154:0/955021401 conn(0x7fa3d00d0660 msgr2=0x7fa3d0069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:45.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 shutdown_connections 2023-10-10T21:17:45.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.185+0000 7fa3d659d700 1 -- 172.21.15.154:0/955021401 wait complete. 2023-10-10T21:17:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 30 2023-10-10T21:17:45.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:45.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.394+0000 7f9fc359e700 1 Processor -- start 2023-10-10T21:17:45.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.394+0000 7f9fc359e700 1 -- start start 2023-10-10T21:17:45.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.395+0000 7f9fc359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9fc4159420 0x7f9fc40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.395+0000 7f9fc359e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fc41597f0 0x7f9fc40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.395+0000 7f9fc359e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc40b11d0 con 0x7f9fc415d230 2023-10-10T21:17:45.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.395+0000 7f9fc359e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc40b14b0 con 0x7f9fc41597f0 2023-10-10T21:17:45.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.395+0000 7f9fc359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc40b1790 con 0x7f9fc4159420 2023-10-10T21:17:45.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fc41597f0 0x7f9fc40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc2d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9fc415d230 0x7f9fc415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54458/0 (socket says 172.21.15.154:54458) 2023-10-10T21:17:45.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc2d9d700 1 -- 172.21.15.154:0/434686195 learned_addr learned my addr 172.21.15.154:0/434686195 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:45.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc259c700 1 --2- 172.21.15.154:0/434686195 >> v2:172.21.15.179:3300/0 conn(0x7f9fc4159420 0x7f9fc40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc159a700 1 -- 172.21.15.154:0/434686195 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887700529 0 0) 0x7f9fc40b11d0 con 0x7f9fc415d230 2023-10-10T21:17:45.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc259c700 1 -- 172.21.15.154:0/434686195 >> v2:172.21.15.154:3300/0 conn(0x7f9fc41597f0 msgr2=0x7f9fc40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:45.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc259c700 1 --2- 172.21.15.154:0/434686195 >> v2:172.21.15.154:3300/0 conn(0x7f9fc41597f0 0x7f9fc40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc259c700 1 -- 172.21.15.154:0/434686195 >> v1:172.21.15.154:6789/0 conn(0x7f9fc415d230 legacy=0x7f9fc415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc259c700 1 -- 172.21.15.154:0/434686195 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc40b1a70 con 0x7f9fc4159420 2023-10-10T21:17:45.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.396+0000 7f9fc259c700 1 --2- 172.21.15.154:0/434686195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc4159420 0x7f9fc40b5f40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40b2f20 tx=0x7f9fb40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=863f0b79111c5cd server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:45.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc159a700 1 -- 172.21.15.154:0/434686195 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4011630 con 0x7f9fc4159420 2023-10-10T21:17:45.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc159a700 1 -- 172.21.15.154:0/434686195 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4011790 con 0x7f9fc4159420 2023-10-10T21:17:45.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc159a700 1 -- 172.21.15.154:0/434686195 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4011b30 con 0x7f9fc4159420 2023-10-10T21:17:45.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc359e700 1 -- 172.21.15.154:0/434686195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc4159420 msgr2=0x7f9fc40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc359e700 1 --2- 172.21.15.154:0/434686195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc4159420 0x7f9fc40b5f40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40b2f20 tx=0x7f9fb40091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc359e700 1 -- 172.21.15.154:0/434686195 shutdown_connections 2023-10-10T21:17:45.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc359e700 1 --2- 172.21.15.154:0/434686195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc4159420 0x7f9fc40b5f40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc359e700 1 --2- 172.21.15.154:0/434686195 >> v2:172.21.15.154:3300/0 conn(0x7f9fc41597f0 0x7f9fc40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc359e700 1 -- 172.21.15.154:0/434686195 >> 172.21.15.154:0/434686195 conn(0x7f9fc40d0660 msgr2=0x7f9fc40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:45.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc359e700 1 -- 172.21.15.154:0/434686195 shutdown_connections 2023-10-10T21:17:45.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.397+0000 7f9fc359e700 1 -- 172.21.15.154:0/434686195 wait complete. 2023-10-10T21:17:45.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.399+0000 7f9fc359e700 1 Processor -- start 2023-10-10T21:17:45.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.399+0000 7f9fc359e700 1 -- start start 2023-10-10T21:17:45.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc4159420 0x7f9fc415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc359e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc41597f0 0x7f9fc4153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415d230 0x7f9fc41538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc359e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc416d540 con 0x7f9fc41597f0 2023-10-10T21:17:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc416d790 con 0x7f9fc415d230 2023-10-10T21:17:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc416da70 con 0x7f9fc4159420 2023-10-10T21:17:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc41597f0 0x7f9fc4153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc4159420 0x7f9fc415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc41597f0 0x7f9fc4153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42152/0 (socket says 172.21.15.154:42152) 2023-10-10T21:17:45.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc4159420 0x7f9fc415c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:55496/0 (socket says 172.21.15.154:55496) 2023-10-10T21:17:45.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc1d9b700 1 -- 172.21.15.154:0/1917866352 learned_addr learned my addr 172.21.15.154:0/1917866352 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:45.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.400+0000 7f9fc2d9d700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415d230 0x7f9fc41538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fc259c700 1 -- 172.21.15.154:0/1917866352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415d230 msgr2=0x7f9fc41538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fc259c700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415d230 0x7f9fc41538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fc259c700 1 -- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc41597f0 msgr2=0x7f9fc4153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fc259c700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc41597f0 0x7f9fc4153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fc259c700 1 -- 172.21.15.154:0/1917866352 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb4009420 con 0x7f9fc4159420 2023-10-10T21:17:45.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fc259c700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc4159420 0x7f9fc415c5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4016000 tx=0x7f9fb4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:45.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fb27fc700 1 -- 172.21.15.154:0/1917866352 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4011900 con 0x7f9fc4159420 2023-10-10T21:17:45.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fb27fc700 1 -- 172.21.15.154:0/1917866352 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4011aa0 con 0x7f9fc4159420 2023-10-10T21:17:45.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fb27fc700 1 -- 172.21.15.154:0/1917866352 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4025640 con 0x7f9fc4159420 2023-10-10T21:17:45.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc416dd50 con 0x7f9fc4159420 2023-10-10T21:17:45.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.401+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc416e310 con 0x7f9fc4159420 2023-10-10T21:17:45.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.402+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc404c3c0 con 0x7f9fc4159420 2023-10-10T21:17:45.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.403+0000 7f9fb27fc700 1 -- 172.21.15.154:0/1917866352 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9fb40193b0 con 0x7f9fc4159420 2023-10-10T21:17:45.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.404+0000 7f9fb27fc700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fa40670e0 0x7f9fa4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.404+0000 7f9fc1d9b700 1 -- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fa40670e0 msgr2=0x7f9fa4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:45.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.404+0000 7f9fb27fc700 1 -- 172.21.15.154:0/1917866352 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f9fb4086430 con 0x7f9fc4159420 2023-10-10T21:17:45.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.404+0000 7f9fc1d9b700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fa40670e0 0x7f9fa4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:45.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.408+0000 7f9fb27fc700 1 -- 172.21.15.154:0/1917866352 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fb40530f0 con 0x7f9fc4159420 2023-10-10T21:17:45.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.605+0000 7f9fc1d9b700 1 -- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fa40670e0 msgr2=0x7f9fa4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:45.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.605+0000 7f9fc1d9b700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fa40670e0 0x7f9fa4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:45.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.606+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fc40b1d50 con 0x7f9fc4159420 2023-10-10T21:17:45.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.607+0000 7f9fb27fc700 1 -- 172.21.15.154:0/1917866352 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16365 (secure 0 0 0) 0x7f9fb4056710 con 0x7f9fc4159420 2023-10-10T21:17:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:45.609 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":82,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:42.358139+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:17:19.775384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-10T21:17:20.550408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6834/85496":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/2784708064":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/4249601708":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/306558853":"2023-10-11T21:17:42.358108+0000","172.21.15.154:6836/85496":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/3472111112":"2023-10-11T21:17:42.358108+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:45.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fa40670e0 msgr2=0x7f9fa4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:45.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fa40670e0 0x7f9fa4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc4159420 msgr2=0x7f9fc415c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc4159420 0x7f9fc415c5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4016000 tx=0x7f9fb4017000 comp rx=0 tx=0).stop 2023-10-10T21:17:45.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 shutdown_connections 2023-10-10T21:17:45.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9fa40670e0 0x7f9fa4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415d230 0x7f9fc41538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc4159420 0x7f9fc415c5d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 --2- 172.21.15.154:0/1917866352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fc41597f0 0x7f9fc4153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 >> 172.21.15.154:0/1917866352 conn(0x7f9fc40d0660 msgr2=0x7f9fc40b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 shutdown_connections 2023-10-10T21:17:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.610+0000 7f9fc359e700 1 -- 172.21.15.154:0/1917866352 wait complete. 2023-10-10T21:17:45.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:17:19.775384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:17:20.550408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:17:45.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:17:45.669 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:45.669+0000 7fe54149d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:17:45.740 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:45.739+0000 7f2c1df19180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:17:45.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.828+0000 7f4497fff700 1 Processor -- start 2023-10-10T21:17:45.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.828+0000 7f4497fff700 1 -- start start 2023-10-10T21:17:45.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.829+0000 7f4497fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44980b16d0 0x7f44980b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.829+0000 7f4497fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f44980b33b0 0x7f44980b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.829+0000 7f4497fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44980b2080 con 0x7f44980b4e70 2023-10-10T21:17:45.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.829+0000 7f4497fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44980cfb00 con 0x7f44980b16d0 2023-10-10T21:17:45.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.829+0000 7f4497fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44980b5c40 con 0x7f44980b33b0 2023-10-10T21:17:45.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.829+0000 7f44967fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44980b16d0 0x7f44980b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.829+0000 7f4496ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f44980b4e70 0x7f44980ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54464/0 (socket says 172.21.15.154:54464) 2023-10-10T21:17:45.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.829+0000 7f4496ffd700 1 -- 172.21.15.154:0/950395792 learned_addr learned my addr 172.21.15.154:0/950395792 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:45.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.830+0000 7f44977fe700 1 --2- 172.21.15.154:0/950395792 >> v2:172.21.15.179:3300/0 conn(0x7f44980b33b0 0x7f44980b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.830+0000 7f4495ffb700 1 -- 172.21.15.154:0/950395792 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164642712 0 0) 0x7f44980b2080 con 0x7f44980b4e70 2023-10-10T21:17:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.830+0000 7f4495ffb700 1 -- 172.21.15.154:0/950395792 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4480003570 con 0x7f44980b4e70 2023-10-10T21:17:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.830+0000 7f44967fc700 1 -- 172.21.15.154:0/950395792 >> v2:172.21.15.179:3300/0 conn(0x7f44980b33b0 msgr2=0x7f44980b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.830+0000 7f44967fc700 1 --2- 172.21.15.154:0/950395792 >> v2:172.21.15.179:3300/0 conn(0x7f44980b33b0 0x7f44980b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.830+0000 7f44967fc700 1 -- 172.21.15.154:0/950395792 >> v1:172.21.15.154:6789/0 conn(0x7f44980b4e70 legacy=0x7f44980ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.830+0000 7f44967fc700 1 -- 172.21.15.154:0/950395792 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44980b5f20 con 0x7f44980b16d0 2023-10-10T21:17:45.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.830+0000 7f44977fe700 1 --2- 172.21.15.154:0/950395792 >> v2:172.21.15.179:3300/0 conn(0x7f44980b33b0 0x7f44980b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:45.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.830+0000 7f44967fc700 1 --2- 172.21.15.154:0/950395792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 0x7f44980b1b40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4498071380 tx=0x7f448c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c47bea8a389128 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:45.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4495ffb700 1 -- 172.21.15.154:0/950395792 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c011630 con 0x7f44980b16d0 2023-10-10T21:17:45.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4495ffb700 1 -- 172.21.15.154:0/950395792 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c0117b0 con 0x7f44980b16d0 2023-10-10T21:17:45.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4495ffb700 1 -- 172.21.15.154:0/950395792 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c011b30 con 0x7f44980b16d0 2023-10-10T21:17:45.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4497fff700 1 -- 172.21.15.154:0/950395792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 msgr2=0x7f44980b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4497fff700 1 --2- 172.21.15.154:0/950395792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 0x7f44980b1b40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4498071380 tx=0x7f448c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4497fff700 1 -- 172.21.15.154:0/950395792 shutdown_connections 2023-10-10T21:17:45.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4497fff700 1 --2- 172.21.15.154:0/950395792 >> v2:172.21.15.179:3300/0 conn(0x7f44980b33b0 0x7f44980b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4497fff700 1 --2- 172.21.15.154:0/950395792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 0x7f44980b1b40 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4497fff700 1 -- 172.21.15.154:0/950395792 >> 172.21.15.154:0/950395792 conn(0x7f44980d10c0 msgr2=0x7f44980affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:45.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.831+0000 7f4497fff700 1 -- 172.21.15.154:0/950395792 shutdown_connections 2023-10-10T21:17:45.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.832+0000 7f4497fff700 1 -- 172.21.15.154:0/950395792 wait complete. 2023-10-10T21:17:45.838 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:45.832+0000 7fe54149d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:45.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.833+0000 7f4497fff700 1 Processor -- start 2023-10-10T21:17:45.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.833+0000 7f4497fff700 1 -- start start 2023-10-10T21:17:45.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f4497fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b16d0 0x7f449814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f4497fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b33b0 0x7f449815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f4497fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 0x7f449815c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f4497fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449816b720 con 0x7f44980b4e70 2023-10-10T21:17:45.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f4497fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44980c92d0 con 0x7f44980b16d0 2023-10-10T21:17:45.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f4497fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449816adf0 con 0x7f44980b33b0 2023-10-10T21:17:45.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f44977fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 0x7f449815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f44977fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 0x7f449815c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42160/0 (socket says 172.21.15.154:42160) 2023-10-10T21:17:45.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f44977fe700 1 -- 172.21.15.154:0/2347912273 learned_addr learned my addr 172.21.15.154:0/2347912273 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:45.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f44967fc700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b33b0 0x7f449815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.834+0000 7f4496ffd700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b16d0 0x7f449814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:45.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f44977fe700 1 -- 172.21.15.154:0/2347912273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b33b0 msgr2=0x7f449815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f44977fe700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b33b0 0x7f449815baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f44977fe700 1 -- 172.21.15.154:0/2347912273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b16d0 msgr2=0x7f449814a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:45.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f44977fe700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b16d0 0x7f449814a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:45.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f44977fe700 1 -- 172.21.15.154:0/2347912273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490009a20 con 0x7f44980b4e70 2023-10-10T21:17:45.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f44977fe700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 0x7f449815c030 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4490009fc0 tx=0x7f449000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:45.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f447effd700 1 -- 172.21.15.154:0/2347912273 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000cbd0 con 0x7f44980b4e70 2023-10-10T21:17:45.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f447effd700 1 -- 172.21.15.154:0/2347912273 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449000f040 con 0x7f44980b4e70 2023-10-10T21:17:45.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c009420 con 0x7f44980b4e70 2023-10-10T21:17:45.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f447effd700 1 -- 172.21.15.154:0/2347912273 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490014480 con 0x7f44980b4e70 2023-10-10T21:17:45.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.835+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449816b3b0 con 0x7f44980b4e70 2023-10-10T21:17:45.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.836+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4498088990 con 0x7f44980b4e70 2023-10-10T21:17:45.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.837+0000 7f447effd700 1 -- 172.21.15.154:0/2347912273 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f4490003020 con 0x7f44980b4e70 2023-10-10T21:17:45.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.838+0000 7f447effd700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:45.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.838+0000 7f4496ffd700 1 -- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44840670e0 msgr2=0x7f4484069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:45.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.839+0000 7f447effd700 1 -- 172.21.15.154:0/2347912273 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f44900855b0 con 0x7f44980b4e70 2023-10-10T21:17:45.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.839+0000 7f4496ffd700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:45.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:45.843+0000 7f447effd700 1 -- 172.21.15.154:0/2347912273 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4490052160 con 0x7f44980b4e70 2023-10-10T21:17:45.915 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:45.914+0000 7f2c1df19180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:45.919 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:45.919+0000 7fe54149d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:17:46.004 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:46.003+0000 7f2c1df19180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:17:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.040+0000 7f4496ffd700 1 -- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44840670e0 msgr2=0x7f4484069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.040+0000 7f4496ffd700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:46.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.043+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f449804bb80 con 0x7f44980b4e70 2023-10-10T21:17:46.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.044+0000 7f447effd700 1 -- 172.21.15.154:0/2347912273 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4490055780 con 0x7f44980b4e70 2023-10-10T21:17:46.045 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:17:46.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.046+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44840670e0 msgr2=0x7f4484069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:46.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.046+0000 7f4497fff700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.046+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 msgr2=0x7f449815c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.046+0000 7f4497fff700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 0x7f449815c030 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4490009fc0 tx=0x7f449000b040 comp rx=0 tx=0).stop 2023-10-10T21:17:46.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.046+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 shutdown_connections 2023-10-10T21:17:46.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.046+0000 7f4497fff700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 0x7f449815c030 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.046+0000 7f4497fff700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.046+0000 7f4497fff700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b16d0 0x7f449814a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.046+0000 7f4497fff700 1 --2- 172.21.15.154:0/2347912273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b33b0 0x7f449815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.047+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 >> 172.21.15.154:0/2347912273 conn(0x7f44980d10c0 msgr2=0x7f44980ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:46.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.047+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 shutdown_connections 2023-10-10T21:17:46.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.047+0000 7f4497fff700 1 -- 172.21.15.154:0/2347912273 wait complete. 2023-10-10T21:17:46.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:17:46.148 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:46.147+0000 7fe54149d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:46.249 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:46.248+0000 7f2c1df19180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.265+0000 7f466699d700 1 Processor -- start 2023-10-10T21:17:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.265+0000 7f466699d700 1 -- start start 2023-10-10T21:17:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.266+0000 7f466699d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46600b16d0 0x7f46600b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.266+0000 7f466699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b33b0 0x7f46600b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.266+0000 7f466699d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46600b2080 con 0x7f46600b4e70 2023-10-10T21:17:46.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.266+0000 7f466699d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46600cfb00 con 0x7f46600b16d0 2023-10-10T21:17:46.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.266+0000 7f466699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46600b5c40 con 0x7f46600b33b0 2023-10-10T21:17:46.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.266+0000 7f466519a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46600b16d0 0x7f46600b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:46.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.266+0000 7f466519a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46600b16d0 0x7f46600b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36372/0 (socket says 172.21.15.154:36372) 2023-10-10T21:17:46.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.266+0000 7f466519a700 1 -- 172.21.15.154:0/3374150327 learned_addr learned my addr 172.21.15.154:0/3374150327 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:46.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.266+0000 7f466619c700 1 --2- 172.21.15.154:0/3374150327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b33b0 0x7f46600b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:46.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.267+0000 7f466519a700 1 -- 172.21.15.154:0/3374150327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b33b0 msgr2=0x7f46600b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.267+0000 7f466519a700 1 --2- 172.21.15.154:0/3374150327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b33b0 0x7f46600b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.267+0000 7f466519a700 1 -- 172.21.15.154:0/3374150327 >> v1:172.21.15.179:6789/0 conn(0x7f46600b4e70 legacy=0x7f46600ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.267+0000 7f466519a700 1 -- 172.21.15.154:0/3374150327 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600b5f20 con 0x7f46600b16d0 2023-10-10T21:17:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.267+0000 7f4664999700 1 -- 172.21.15.154:0/3374150327 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472281999 0 0) 0x7f46600b2080 con 0x7f46600b4e70 2023-10-10T21:17:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.267+0000 7f466519a700 1 --2- 172.21.15.154:0/3374150327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b16d0 0x7f46600b1b40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f46500099b0 tx=0x7f4650009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbcd54bd9bc3e2f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.267+0000 7f4664999700 1 -- 172.21.15.154:0/3374150327 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650009ea0 con 0x7f46600b16d0 2023-10-10T21:17:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.267+0000 7f4664999700 1 -- 172.21.15.154:0/3374150327 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465000b860 con 0x7f46600b16d0 2023-10-10T21:17:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.267+0000 7f4664999700 1 -- 172.21.15.154:0/3374150327 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465000bc20 con 0x7f46600b16d0 2023-10-10T21:17:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.268+0000 7f466699d700 1 -- 172.21.15.154:0/3374150327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b16d0 msgr2=0x7f46600b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.268+0000 7f466699d700 1 --2- 172.21.15.154:0/3374150327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b16d0 0x7f46600b1b40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f46500099b0 tx=0x7f4650009250 comp rx=0 tx=0).stop 2023-10-10T21:17:46.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.268+0000 7f466699d700 1 -- 172.21.15.154:0/3374150327 shutdown_connections 2023-10-10T21:17:46.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.268+0000 7f466699d700 1 --2- 172.21.15.154:0/3374150327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b33b0 0x7f46600b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.268+0000 7f466699d700 1 --2- 172.21.15.154:0/3374150327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b16d0 0x7f46600b1b40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.268+0000 7f466699d700 1 -- 172.21.15.154:0/3374150327 >> 172.21.15.154:0/3374150327 conn(0x7f46600d10c0 msgr2=0x7f46600affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.268+0000 7f466699d700 1 -- 172.21.15.154:0/3374150327 shutdown_connections 2023-10-10T21:17:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.268+0000 7f466699d700 1 -- 172.21.15.154:0/3374150327 wait complete. 2023-10-10T21:17:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.270+0000 7f466699d700 1 Processor -- start 2023-10-10T21:17:46.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.270+0000 7f466699d700 1 -- start start 2023-10-10T21:17:46.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b16d0 0x7f466014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46600b33b0 0x7f46600c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466699d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b4e70 0x7f4660169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466699d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466016cec0 con 0x7f46600b4e70 2023-10-10T21:17:46.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466016a100 con 0x7f46600b33b0 2023-10-10T21:17:46.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466016a3e0 con 0x7f46600b16d0 2023-10-10T21:17:46.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466619c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b4e70 0x7f4660169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:46.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466619c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b4e70 0x7f4660169870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36384/0 (socket says 172.21.15.154:36384) 2023-10-10T21:17:46.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466619c700 1 -- 172.21.15.154:0/835021553 learned_addr learned my addr 172.21.15.154:0/835021553 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:46.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466519a700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46600b33b0 0x7f46600c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:46.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466599b700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b16d0 0x7f466014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:46.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466519a700 1 -- 172.21.15.154:0/835021553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b16d0 msgr2=0x7f466014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466519a700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b16d0 0x7f466014a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466519a700 1 -- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b4e70 msgr2=0x7f4660169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466519a700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b4e70 0x7f4660169870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466519a700 1 -- 172.21.15.154:0/835021553 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46500094f0 con 0x7f46600b33b0 2023-10-10T21:17:46.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.271+0000 7f466619c700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b4e70 0x7f4660169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:46.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.272+0000 7f466519a700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46600b33b0 0x7f46600c8d10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4660064910 tx=0x7f4650017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:46.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.272+0000 7f4655ffb700 1 -- 172.21.15.154:0/835021553 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465001f070 con 0x7f46600b33b0 2023-10-10T21:17:46.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.272+0000 7f4655ffb700 1 -- 172.21.15.154:0/835021553 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465000b9d0 con 0x7f46600b33b0 2023-10-10T21:17:46.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.272+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466016a6c0 con 0x7f46600b33b0 2023-10-10T21:17:46.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.272+0000 7f4655ffb700 1 -- 172.21.15.154:0/835021553 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650011420 con 0x7f46600b33b0 2023-10-10T21:17:46.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.272+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4660169db0 con 0x7f46600b33b0 2023-10-10T21:17:46.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.273+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466016d310 con 0x7f46600b33b0 2023-10-10T21:17:46.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.274+0000 7f4655ffb700 1 -- 172.21.15.154:0/835021553 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f4650011810 con 0x7f46600b33b0 2023-10-10T21:17:46.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.275+0000 7f4655ffb700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f46440670e0 0x7f4644069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.275+0000 7f466599b700 1 -- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f46440670e0 msgr2=0x7f4644069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:46.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.275+0000 7f4655ffb700 1 -- 172.21.15.154:0/835021553 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f4650085a50 con 0x7f46600b33b0 2023-10-10T21:17:46.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.275+0000 7f466599b700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f46440670e0 0x7f4644069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:46.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.280+0000 7f4655ffb700 1 -- 172.21.15.154:0/835021553 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f466016d310 con 0x7f46600b33b0 2023-10-10T21:17:46.328 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:46.327+0000 7fe54149d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:17:46.422 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:46.422+0000 7fe54149d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:17:46.436 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:46.435+0000 7f2c1df19180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:17:46.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.476+0000 7f466599b700 1 -- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f46440670e0 msgr2=0x7f4644069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:46.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.476+0000 7f466599b700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f46440670e0 0x7f4644069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:46.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.480+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f466016d310 con 0x7f46600b33b0 2023-10-10T21:17:46.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.481+0000 7f4655ffb700 1 -- 172.21.15.154:0/835021553 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4650028020 con 0x7f46600b33b0 2023-10-10T21:17:46.482 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:17:46.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f46440670e0 msgr2=0x7f4644069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:46.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f46440670e0 0x7f4644069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46600b33b0 msgr2=0x7f46600c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46600b33b0 0x7f46600c8d10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4660064910 tx=0x7f4650017000 comp rx=0 tx=0).stop 2023-10-10T21:17:46.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 shutdown_connections 2023-10-10T21:17:46.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46600b4e70 0x7f4660169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600b16d0 0x7f466014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f46440670e0 0x7f4644069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 --2- 172.21.15.154:0/835021553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46600b33b0 0x7f46600c8d10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.483+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 >> 172.21.15.154:0/835021553 conn(0x7f46600d10c0 msgr2=0x7f466015c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:46.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.484+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 shutdown_connections 2023-10-10T21:17:46.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.484+0000 7f466699d700 1 -- 172.21.15.154:0/835021553 wait complete. 2023-10-10T21:17:46.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:17:46.533 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:46.532+0000 7f2c1df19180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:17:46.585 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:46.584+0000 7fe54149d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:17:46.686 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:46.686+0000 7fe54149d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:46.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.695+0000 7f39789fe700 1 Processor -- start 2023-10-10T21:17:46.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.695+0000 7f39789fe700 1 -- start start 2023-10-10T21:17:46.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.696+0000 7f39789fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f39740b4e70 0x7f39740ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.696+0000 7f39789fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39740cfb00 con 0x7f39740b16d0 2023-10-10T21:17:46.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f39789fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397415e060 con 0x7f39740b1b40 2023-10-10T21:17:46.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f39789fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39740b5c40 con 0x7f39740b4e70 2023-10-10T21:17:46.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f397259c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f39740b16d0 0x7f397415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36682/0 (socket says 172.21.15.154:36682) 2023-10-10T21:17:46.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f397259c700 1 -- 172.21.15.154:0/2917401608 learned_addr learned my addr 172.21.15.154:0/2917401608 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:46.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f3972d9d700 1 --2- 172.21.15.154:0/2917401608 >> v2:172.21.15.179:3300/0 conn(0x7f39740b4e70 0x7f39740ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:46.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f3971d9b700 1 -- 172.21.15.154:0/2917401608 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286924761 0 0) 0x7f39740cfb00 con 0x7f39740b16d0 2023-10-10T21:17:46.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f3971d9b700 1 -- 172.21.15.154:0/2917401608 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f395c003570 con 0x7f39740b16d0 2023-10-10T21:17:46.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f3972d9d700 1 -- 172.21.15.154:0/2917401608 >> v1:172.21.15.179:6789/0 conn(0x7f39740b1b40 legacy=0x7f397415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f3971d9b700 1 -- 172.21.15.154:0/2917401608 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129242201 0 0) 0x7f397415e060 con 0x7f39740b1b40 2023-10-10T21:17:46.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f3972d9d700 1 -- 172.21.15.154:0/2917401608 >> v1:172.21.15.154:6789/0 conn(0x7f39740b16d0 legacy=0x7f397415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.697+0000 7f3972d9d700 1 -- 172.21.15.154:0/2917401608 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39740b5f20 con 0x7f39740b4e70 2023-10-10T21:17:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.698+0000 7f3972d9d700 1 --2- 172.21.15.154:0/2917401608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39740b4e70 0x7f39740ccff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f39640098e0 tx=0x7f39640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3acbf8ba5f3e1505 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.698+0000 7f3971d9b700 1 -- 172.21.15.154:0/2917401608 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396400b640 con 0x7f39740b4e70 2023-10-10T21:17:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.698+0000 7f3971d9b700 1 -- 172.21.15.154:0/2917401608 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396400b7a0 con 0x7f39740b4e70 2023-10-10T21:17:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.698+0000 7f3971d9b700 1 -- 172.21.15.154:0/2917401608 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396400bb40 con 0x7f39740b4e70 2023-10-10T21:17:46.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.698+0000 7f39789fe700 1 -- 172.21.15.154:0/2917401608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39740b4e70 msgr2=0x7f39740ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.698+0000 7f39789fe700 1 --2- 172.21.15.154:0/2917401608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39740b4e70 0x7f39740ccff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f39640098e0 tx=0x7f39640091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.699+0000 7f39789fe700 1 -- 172.21.15.154:0/2917401608 shutdown_connections 2023-10-10T21:17:46.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.699+0000 7f39789fe700 1 --2- 172.21.15.154:0/2917401608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39740b4e70 0x7f39740ccff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.699+0000 7f39789fe700 1 -- 172.21.15.154:0/2917401608 >> 172.21.15.154:0/2917401608 conn(0x7f39740d10c0 msgr2=0x7f39740affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:46.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.699+0000 7f39789fe700 1 -- 172.21.15.154:0/2917401608 shutdown_connections 2023-10-10T21:17:46.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.699+0000 7f39789fe700 1 -- 172.21.15.154:0/2917401608 wait complete. 2023-10-10T21:17:46.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.700+0000 7f39789fe700 1 Processor -- start 2023-10-10T21:17:46.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.700+0000 7f39789fe700 1 -- start start 2023-10-10T21:17:46.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f39789fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39740b16d0 0x7f3974157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f39789fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39740b1b40 0x7f3974169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f39789fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39740b4e70 0x7f39740c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f39789fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39740c8360 con 0x7f39740b1b40 2023-10-10T21:17:46.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f39789fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39740c7750 con 0x7f39740b4e70 2023-10-10T21:17:46.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f39789fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39740c7a30 con 0x7f39740b16d0 2023-10-10T21:17:46.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f397259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39740b1b40 0x7f3974169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:46.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f397259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39740b1b40 0x7f3974169be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36386/0 (socket says 172.21.15.154:36386) 2023-10-10T21:17:46.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f397259c700 1 -- 172.21.15.154:0/1398158305 learned_addr learned my addr 172.21.15.154:0/1398158305 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:46.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f3972d9d700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39740b16d0 0x7f3974157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:46.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.701+0000 7f397359e700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39740b4e70 0x7f39740c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:46.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f397259c700 1 -- 172.21.15.154:0/1398158305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39740b16d0 msgr2=0x7f3974157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f397259c700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39740b16d0 0x7f3974157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f397259c700 1 -- 172.21.15.154:0/1398158305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39740b4e70 msgr2=0x7f39740c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f397259c700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39740b4e70 0x7f39740c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f397259c700 1 -- 172.21.15.154:0/1398158305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3964009420 con 0x7f39740b1b40 2023-10-10T21:17:46.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f397259c700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39740b1b40 0x7f3974169be0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f39680011e0 tx=0x7f3968007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:46.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f395affd700 1 -- 172.21.15.154:0/1398158305 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3968005b30 con 0x7f39740b1b40 2023-10-10T21:17:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f395affd700 1 -- 172.21.15.154:0/1398158305 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3968005c90 con 0x7f39740b1b40 2023-10-10T21:17:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f395affd700 1 -- 172.21.15.154:0/1398158305 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3968007300 con 0x7f39740b1b40 2023-10-10T21:17:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39740c7d10 con 0x7f39740b1b40 2023-10-10T21:17:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.702+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3974157dc0 con 0x7f39740b1b40 2023-10-10T21:17:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.703+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39740c84d0 con 0x7f39740b1b40 2023-10-10T21:17:46.715 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:46.703+0000 7f2c1df19180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:17:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.705+0000 7f395affd700 1 -- 172.21.15.154:0/1398158305 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f3968007670 con 0x7f39740b1b40 2023-10-10T21:17:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.706+0000 7f395affd700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f39600670e0 0x7f3960069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.706+0000 7f395affd700 1 -- 172.21.15.154:0/1398158305 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f3968083ef0 con 0x7f39740b1b40 2023-10-10T21:17:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.706+0000 7f3972d9d700 1 -- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f39600670e0 msgr2=0x7f3960069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.706+0000 7f3972d9d700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f39600670e0 0x7f3960069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.710+0000 7f395affd700 1 -- 172.21.15.154:0/1398158305 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3968050c50 con 0x7f39740b1b40 2023-10-10T21:17:46.810 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:46.809+0000 7f2c1df19180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:17:46.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.906+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f397404bb80 con 0x7f39740b1b40 2023-10-10T21:17:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.907+0000 7f3972d9d700 1 -- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f39600670e0 msgr2=0x7f3960069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.907+0000 7f395affd700 1 -- 172.21.15.154:0/1398158305 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3968017020 con 0x7f39740b1b40 2023-10-10T21:17:46.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.907+0000 7f3972d9d700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f39600670e0 0x7f3960069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:46.909 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:17:46.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f39600670e0 msgr2=0x7f3960069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f39600670e0 0x7f3960069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39740b1b40 msgr2=0x7f3974169be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39740b1b40 0x7f3974169be0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f39680011e0 tx=0x7f3968007df0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 shutdown_connections 2023-10-10T21:17:46.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f39600670e0 0x7f3960069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39740b4e70 0x7f39740c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39740b16d0 0x7f3974157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 --2- 172.21.15.154:0/1398158305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39740b1b40 0x7f3974169be0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 >> 172.21.15.154:0/1398158305 conn(0x7f39740d10c0 msgr2=0x7f3974158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 shutdown_connections 2023-10-10T21:17:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:46.909+0000 7f39789fe700 1 -- 172.21.15.154:0/1398158305 wait complete. 2023-10-10T21:17:46.929 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.163+0000 7fde5cf9d700 1 Processor -- start 2023-10-10T21:17:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.163+0000 7fde5cf9d700 1 -- start start 2023-10-10T21:17:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.164+0000 7fde5cf9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fde58159420 0x7fde580b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.164+0000 7fde5cf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde581597f0 0x7fde580b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.164+0000 7fde5cf9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde580b11d0 con 0x7fde5815d230 2023-10-10T21:17:47.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.164+0000 7fde5cf9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580b14b0 con 0x7fde58159420 2023-10-10T21:17:47.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.164+0000 7fde5cf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b1790 con 0x7fde581597f0 2023-10-10T21:17:47.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde56ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde581597f0 0x7fde580b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde577fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fde58159420 0x7fde580b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde57fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fde5815d230 0x7fde580b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:40904/0 (socket says 172.21.15.154:40904) 2023-10-10T21:17:47.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde577fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fde58159420 0x7fde580b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52126/0 (socket says 172.21.15.154:52126) 2023-10-10T21:17:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde56ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde581597f0 0x7fde580b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:52724/0 (socket says 172.21.15.154:52724) 2023-10-10T21:17:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde57fff700 1 -- 172.21.15.154:0/1511779105 learned_addr learned my addr 172.21.15.154:0/1511779105 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde577fe700 1 -- 172.21.15.154:0/1511779105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde581597f0 msgr2=0x7fde580b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde577fe700 1 --2- 172.21.15.154:0/1511779105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde581597f0 0x7fde580b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde577fe700 1 -- 172.21.15.154:0/1511779105 >> v1:172.21.15.179:6789/0 conn(0x7fde5815d230 legacy=0x7fde580b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.165+0000 7fde577fe700 1 -- 172.21.15.154:0/1511779105 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580b1a70 con 0x7fde58159420 2023-10-10T21:17:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.166+0000 7fde577fe700 1 --2- 172.21.15.154:0/1511779105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde58159420 0x7fde580b5f40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fde480098e0 tx=0x7fde480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3514619dc5d8cb6b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.166+0000 7fde567fc700 1 -- 172.21.15.154:0/1511779105 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800b640 con 0x7fde58159420 2023-10-10T21:17:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.166+0000 7fde567fc700 1 -- 172.21.15.154:0/1511779105 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4800b7a0 con 0x7fde58159420 2023-10-10T21:17:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.166+0000 7fde567fc700 1 -- 172.21.15.154:0/1511779105 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800bb40 con 0x7fde58159420 2023-10-10T21:17:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.166+0000 7fde5cf9d700 1 -- 172.21.15.154:0/1511779105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde58159420 msgr2=0x7fde580b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.166+0000 7fde5cf9d700 1 --2- 172.21.15.154:0/1511779105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde58159420 0x7fde580b5f40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fde480098e0 tx=0x7fde480091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.167+0000 7fde5cf9d700 1 -- 172.21.15.154:0/1511779105 shutdown_connections 2023-10-10T21:17:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.167+0000 7fde5cf9d700 1 --2- 172.21.15.154:0/1511779105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde58159420 0x7fde580b5f40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.167+0000 7fde5cf9d700 1 --2- 172.21.15.154:0/1511779105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde581597f0 0x7fde580b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.167+0000 7fde5cf9d700 1 -- 172.21.15.154:0/1511779105 >> 172.21.15.154:0/1511779105 conn(0x7fde580d0660 msgr2=0x7fde580d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.167+0000 7fde5cf9d700 1 -- 172.21.15.154:0/1511779105 shutdown_connections 2023-10-10T21:17:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.167+0000 7fde5cf9d700 1 -- 172.21.15.154:0/1511779105 wait complete. 2023-10-10T21:17:47.173 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:47.171+0000 7fe54149d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:17:47.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.168+0000 7fde5cf9d700 1 Processor -- start 2023-10-10T21:17:47.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.168+0000 7fde5cf9d700 1 -- start start 2023-10-10T21:17:47.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde5cf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde58159420 0x7fde58146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde5cf9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde581597f0 0x7fde580cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde5cf9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5815d230 0x7fde58156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde5cf9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5816dfb0 con 0x7fde581597f0 2023-10-10T21:17:47.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde5cf9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5816d3e0 con 0x7fde5815d230 2023-10-10T21:17:47.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde5cf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5816d680 con 0x7fde58159420 2023-10-10T21:17:47.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde56ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde581597f0 0x7fde580cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde56ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde581597f0 0x7fde580cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36394/0 (socket says 172.21.15.154:36394) 2023-10-10T21:17:47.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde56ffd700 1 -- 172.21.15.154:0/4124878149 learned_addr learned my addr 172.21.15.154:0/4124878149 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:47.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde577fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde58159420 0x7fde58146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.169+0000 7fde57fff700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5815d230 0x7fde58156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde577fe700 1 -- 172.21.15.154:0/4124878149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5815d230 msgr2=0x7fde58156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde577fe700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5815d230 0x7fde58156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde577fe700 1 -- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde581597f0 msgr2=0x7fde580cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde577fe700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde581597f0 0x7fde580cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde577fe700 1 -- 172.21.15.154:0/4124878149 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48009420 con 0x7fde58159420 2023-10-10T21:17:47.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde56ffd700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde581597f0 0x7fde580cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:47.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde57fff700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5815d230 0x7fde58156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:47.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde577fe700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde58159420 0x7fde58146280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fde48016000 tx=0x7fde48017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:47.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde3f7fe700 1 -- 172.21.15.154:0/4124878149 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4801bc40 con 0x7fde58159420 2023-10-10T21:17:47.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde3f7fe700 1 -- 172.21.15.154:0/4124878149 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4801bdc0 con 0x7fde58159420 2023-10-10T21:17:47.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde3f7fe700 1 -- 172.21.15.154:0/4124878149 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48011670 con 0x7fde58159420 2023-10-10T21:17:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.170+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5816d960 con 0x7fde58159420 2023-10-10T21:17:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.171+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580cfbc0 con 0x7fde58159420 2023-10-10T21:17:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.172+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5804c3c0 con 0x7fde58159420 2023-10-10T21:17:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.172+0000 7fde3f7fe700 1 -- 172.21.15.154:0/4124878149 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fde48011a20 con 0x7fde58159420 2023-10-10T21:17:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.173+0000 7fde3f7fe700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fde440670e0 0x7fde44069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.173+0000 7fde3f7fe700 1 -- 172.21.15.154:0/4124878149 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fde48085fe0 con 0x7fde58159420 2023-10-10T21:17:47.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.173+0000 7fde56ffd700 1 -- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fde440670e0 msgr2=0x7fde44069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:47.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.173+0000 7fde56ffd700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fde440670e0 0x7fde44069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:47.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.177+0000 7fde3f7fe700 1 -- 172.21.15.154:0/4124878149 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde48052d00 con 0x7fde58159420 2023-10-10T21:17:47.267 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:47.267+0000 7fe54149d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:17:47.321 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:47.320+0000 7f2c1df19180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:17:47.357 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:47.357+0000 7fe54149d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:17:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.374+0000 7fde56ffd700 1 -- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fde440670e0 msgr2=0x7fde44069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.374+0000 7fde56ffd700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fde440670e0 0x7fde44069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:47.418 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:47.417+0000 7f2c1df19180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:17:47.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.419+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde580b1d50 con 0x7fde58159420 2023-10-10T21:17:47.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.420+0000 7fde3f7fe700 1 -- 172.21.15.154:0/4124878149 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fde48056320 con 0x7fde58159420 2023-10-10T21:17:47.421 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:47.421 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/209340130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":209340130},{"type":"v1","addr":"172.21.15.179:6834","nonce":209340130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3372685755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3372685755},{"type":"v1","addr":"172.21.15.154:6835","nonce":3372685755}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1909692066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1909692066},{"type":"v1","addr":"172.21.15.154:6837","nonce":1909692066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:17:21.571274+0000","modified":"2023-10-10T21:17:25.130727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6019":{"gid":6019,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2833897496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2833897496},{"type":"v1","addr":"172.21.15.179:6835","nonce":2833897496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-10T21:17:47.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fde440670e0 msgr2=0x7fde44069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:47.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fde440670e0 0x7fde44069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde58159420 msgr2=0x7fde58146280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde58159420 0x7fde58146280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fde48016000 tx=0x7fde48017000 comp rx=0 tx=0).stop 2023-10-10T21:17:47.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 shutdown_connections 2023-10-10T21:17:47.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fde440670e0 0x7fde44069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5815d230 0x7fde58156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde58159420 0x7fde58146280 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 --2- 172.21.15.154:0/4124878149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde581597f0 0x7fde580cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.422+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 >> 172.21.15.154:0/4124878149 conn(0x7fde580d0660 msgr2=0x7fde5815fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:47.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.423+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 shutdown_connections 2023-10-10T21:17:47.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.423+0000 7fde5cf9d700 1 -- 172.21.15.154:0/4124878149 wait complete. 2023-10-10T21:17:47.426 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 30 2023-10-10T21:17:47.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:47.518 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:47.517+0000 7f2c1df19180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:17:47.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.629+0000 7f5444f9d700 1 Processor -- start 2023-10-10T21:17:47.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.629+0000 7f5444f9d700 1 -- start start 2023-10-10T21:17:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f5444f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54401593b0 0x7f5440159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f5444f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54400ceaa0 0x7f54400b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f5444f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54400b6570 con 0x7f54400b1740 2023-10-10T21:17:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f5444f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400cfe20 con 0x7f54401593b0 2023-10-10T21:17:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f5444f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400cf210 con 0x7f54400ceaa0 2023-10-10T21:17:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f543f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54401593b0 0x7f5440159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f543f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54401593b0 0x7f5440159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36406/0 (socket says 172.21.15.154:36406) 2023-10-10T21:17:47.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f543ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f54400b1740 0x7f54400b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36696/0 (socket says 172.21.15.154:36696) 2023-10-10T21:17:47.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f543f7fe700 1 -- 172.21.15.154:0/3545914504 learned_addr learned my addr 172.21.15.154:0/3545914504 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:47.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.630+0000 7f543effd700 1 --2- 172.21.15.154:0/3545914504 >> v2:172.21.15.179:3300/0 conn(0x7f54400ceaa0 0x7f54400b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.631+0000 7f543f7fe700 1 -- 172.21.15.154:0/3545914504 >> v2:172.21.15.179:3300/0 conn(0x7f54400ceaa0 msgr2=0x7f54400b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:47.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.631+0000 7f543f7fe700 1 --2- 172.21.15.154:0/3545914504 >> v2:172.21.15.179:3300/0 conn(0x7f54400ceaa0 0x7f54400b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.631+0000 7f543f7fe700 1 -- 172.21.15.154:0/3545914504 >> v1:172.21.15.154:6789/0 conn(0x7f54400b1740 legacy=0x7f54400b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.631+0000 7f543f7fe700 1 -- 172.21.15.154:0/3545914504 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400cf4f0 con 0x7f54401593b0 2023-10-10T21:17:47.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.631+0000 7f543e7fc700 1 -- 172.21.15.154:0/3545914504 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305973361 0 0) 0x7f5438001490 con 0x7f54400b1740 2023-10-10T21:17:47.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.631+0000 7f543f7fe700 1 --2- 172.21.15.154:0/3545914504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401593b0 0x7f5440159780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f54400b2d90 tx=0x7f5430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665c2356bcb92bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:47.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.631+0000 7f543e7fc700 1 -- 172.21.15.154:0/3545914504 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430009e70 con 0x7f54401593b0 2023-10-10T21:17:47.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.631+0000 7f543e7fc700 1 -- 172.21.15.154:0/3545914504 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543000b860 con 0x7f54401593b0 2023-10-10T21:17:47.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.631+0000 7f543e7fc700 1 -- 172.21.15.154:0/3545914504 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000bc00 con 0x7f54401593b0 2023-10-10T21:17:47.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.632+0000 7f5444f9d700 1 -- 172.21.15.154:0/3545914504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401593b0 msgr2=0x7f5440159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.632+0000 7f5444f9d700 1 --2- 172.21.15.154:0/3545914504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401593b0 0x7f5440159780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f54400b2d90 tx=0x7f5430009250 comp rx=0 tx=0).stop 2023-10-10T21:17:47.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.632+0000 7f5444f9d700 1 -- 172.21.15.154:0/3545914504 shutdown_connections 2023-10-10T21:17:47.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.632+0000 7f5444f9d700 1 --2- 172.21.15.154:0/3545914504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401593b0 0x7f5440159780 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.632+0000 7f5444f9d700 1 --2- 172.21.15.154:0/3545914504 >> v2:172.21.15.179:3300/0 conn(0x7f54400ceaa0 0x7f54400b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.632+0000 7f5444f9d700 1 -- 172.21.15.154:0/3545914504 >> 172.21.15.154:0/3545914504 conn(0x7f54400d1130 msgr2=0x7f54400b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:47.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.632+0000 7f5444f9d700 1 -- 172.21.15.154:0/3545914504 shutdown_connections 2023-10-10T21:17:47.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.632+0000 7f5444f9d700 1 -- 172.21.15.154:0/3545914504 wait complete. 2023-10-10T21:17:47.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.635+0000 7f5444f9d700 1 Processor -- start 2023-10-10T21:17:47.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.635+0000 7f5444f9d700 1 -- start start 2023-10-10T21:17:47.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.636+0000 7f5444f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54400b1740 0x7f5440154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.636+0000 7f5444f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54400ceaa0 0x7f544016d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.636+0000 7f5444f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54401593b0 0x7f544016d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.636+0000 7f5444f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544015ada0 con 0x7f54400b1740 2023-10-10T21:17:47.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.636+0000 7f5444f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544016bf40 con 0x7f54400ceaa0 2023-10-10T21:17:47.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.636+0000 7f5444f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544015a470 con 0x7f54401593b0 2023-10-10T21:17:47.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54400b1740 0x7f5440154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54400b1740 0x7f5440154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36418/0 (socket says 172.21.15.154:36418) 2023-10-10T21:17:47.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543f7fe700 1 -- 172.21.15.154:0/4159421586 learned_addr learned my addr 172.21.15.154:0/4159421586 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:47.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543effd700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54400ceaa0 0x7f544016d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543ffff700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54401593b0 0x7f544016d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:47.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543f7fe700 1 -- 172.21.15.154:0/4159421586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54401593b0 msgr2=0x7f544016d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543f7fe700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54401593b0 0x7f544016d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543f7fe700 1 -- 172.21.15.154:0/4159421586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54400ceaa0 msgr2=0x7f544016d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543f7fe700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54400ceaa0 0x7f544016d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543f7fe700 1 -- 172.21.15.154:0/4159421586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54300094f0 con 0x7f54400b1740 2023-10-10T21:17:47.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.637+0000 7f543f7fe700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54400b1740 0x7f5440154b20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f54300094c0 tx=0x7f5430017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:47.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.638+0000 7f54277fe700 1 -- 172.21.15.154:0/4159421586 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000bbe0 con 0x7f54400b1740 2023-10-10T21:17:47.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.638+0000 7f54277fe700 1 -- 172.21.15.154:0/4159421586 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430011420 con 0x7f54400b1740 2023-10-10T21:17:47.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.638+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544015a750 con 0x7f54400b1740 2023-10-10T21:17:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.638+0000 7f54277fe700 1 -- 172.21.15.154:0/4159421586 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300117c0 con 0x7f54400b1740 2023-10-10T21:17:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.638+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544015a130 con 0x7f54400b1740 2023-10-10T21:17:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.639+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544004c3c0 con 0x7f54400b1740 2023-10-10T21:17:47.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.640+0000 7f54277fe700 1 -- 172.21.15.154:0/4159421586 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f5430011bb0 con 0x7f54400b1740 2023-10-10T21:17:47.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.641+0000 7f54277fe700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f542c0671b0 0x7f542c069660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:47.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.641+0000 7f54277fe700 1 -- 172.21.15.154:0/4159421586 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f5430086170 con 0x7f54400b1740 2023-10-10T21:17:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.641+0000 7f543effd700 1 -- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f542c0671b0 msgr2=0x7f542c069660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.641+0000 7f543effd700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f542c0671b0 0x7f542c069660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.645+0000 7f54277fe700 1 -- 172.21.15.154:0/4159421586 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5430052eb0 con 0x7f54400b1740 2023-10-10T21:17:47.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.839+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f544015b080 con 0x7f54400b1740 2023-10-10T21:17:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.840+0000 7f54277fe700 1 -- 172.21.15.154:0/4159421586 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16365 (secure 0 0 0) 0x7f5430011e60 con 0x7f54400b1740 2023-10-10T21:17:47.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:47.842 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":82,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:42.358139+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:17:19.775384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-10T21:17:20.550408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6834/85496":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/2784708064":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/4249601708":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/306558853":"2023-10-11T21:17:42.358108+0000","172.21.15.154:6836/85496":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/3472111112":"2023-10-11T21:17:42.358108+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.842+0000 7f543effd700 1 -- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f542c0671b0 msgr2=0x7f542c069660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.842+0000 7f543effd700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f542c0671b0 0x7f542c069660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:47.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f542c0671b0 msgr2=0x7f542c069660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:47.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f542c0671b0 0x7f542c069660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54400b1740 msgr2=0x7f5440154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54400b1740 0x7f5440154b20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f54300094c0 tx=0x7f5430017000 comp rx=0 tx=0).stop 2023-10-10T21:17:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 shutdown_connections 2023-10-10T21:17:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54401593b0 0x7f544016d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54400b1740 0x7f5440154b20 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f542c0671b0 0x7f542c069660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 --2- 172.21.15.154:0/4159421586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54400ceaa0 0x7f544016d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 >> 172.21.15.154:0/4159421586 conn(0x7f54400d1130 msgr2=0x7f54401571a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 shutdown_connections 2023-10-10T21:17:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:47.843+0000 7f5444f9d700 1 -- 172.21.15.154:0/4159421586 wait complete. 2023-10-10T21:17:47.862 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T21:17:47.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:47.981 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:47.980+0000 7fe54149d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:17:48.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.058+0000 7fc2fa59d700 1 Processor -- start 2023-10-10T21:17:48.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.058+0000 7fc2fa59d700 1 -- start start 2023-10-10T21:17:48.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.060+0000 7fc2fa59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2f406e000 0x7fc2f406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.060+0000 7fc2fa59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f406e8c0 con 0x7fc2f415de70 2023-10-10T21:17:48.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.060+0000 7fc2fa59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f40ca740 con 0x7fc2f415daa0 2023-10-10T21:17:48.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.060+0000 7fc2fa59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f406e400 con 0x7fc2f406e000 2023-10-10T21:17:48.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f959b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc2f415daa0 0x7fc2f40c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:40914/0 (socket says 172.21.15.154:40914) 2023-10-10T21:17:48.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f959b700 1 -- 172.21.15.154:0/1061791191 learned_addr learned my addr 172.21.15.154:0/1061791191 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:48.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f9d9c700 1 --2- 172.21.15.154:0/1061791191 >> v2:172.21.15.154:3300/0 conn(0x7fc2f406e000 0x7fc2f406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007993238 0 0) 0x7fc2f40ca740 con 0x7fc2f415daa0 2023-10-10T21:17:48.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc003570 con 0x7fc2f415daa0 2023-10-10T21:17:48.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1414955113 0 0) 0x7fc2dc003570 con 0x7fc2f415daa0 2023-10-10T21:17:48.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 >> v2:172.21.15.154:3300/0 conn(0x7fc2f406e000 msgr2=0x7fc2f406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:48.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f3fff700 1 --2- 172.21.15.154:0/1061791191 >> v2:172.21.15.154:3300/0 conn(0x7fc2f406e000 0x7fc2f406ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 >> v1:172.21.15.154:6789/0 conn(0x7fc2f415de70 legacy=0x7fc2f40696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f406e5e0 con 0x7fc2f415daa0 2023-10-10T21:17:48.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fc2ec001470 con 0x7fc2f415daa0 2023-10-10T21:17:48.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.061+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 >> v1:172.21.15.179:6789/0 conn(0x7fc2f415daa0 legacy=0x7fc2f40c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.062+0000 7fc2f3fff700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2dc003ab0 0x7fc2dc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.062+0000 7fc2f3fff700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.062+0000 7fc2f3fff700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2dc005290 0x7fc2dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.062+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f406e400 con 0x7fc2dc004810 2023-10-10T21:17:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.062+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00c250 con 0x7fc2dc003ab0 2023-10-10T21:17:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.062+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00c410 con 0x7fc2dc005290 2023-10-10T21:17:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.062+0000 7fc2f959b700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2dc003ab0 0x7fc2dc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.062+0000 7fc2f8d9a700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.062+0000 7fc2f9d9c700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2dc005290 0x7fc2dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.063+0000 7fc2f959b700 1 -- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2dc005290 msgr2=0x7fc2dc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.063+0000 7fc2f959b700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2dc005290 0x7fc2dc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.063+0000 7fc2f959b700 1 -- 172.21.15.154:0/1061791191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc004810 msgr2=0x7fc2dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.063+0000 7fc2f959b700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.063+0000 7fc2f959b700 1 -- 172.21.15.154:0/1061791191 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc003570 con 0x7fc2dc003ab0 2023-10-10T21:17:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.063+0000 7fc2f9d9c700 1 -- 172.21.15.154:0/1061791191 reap_dead start 2023-10-10T21:17:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.063+0000 7fc2f959b700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2dc003ab0 0x7fc2dc003ec0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c2d0 tx=0x7fc2ec001d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c0b3662d84cf64 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.063+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00cba0 con 0x7fc2dc003ab0 2023-10-10T21:17:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.064+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec00cd00 con 0x7fc2dc003ab0 2023-10-10T21:17:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.064+0000 7fc2f3fff700 1 -- 172.21.15.154:0/1061791191 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec005b70 con 0x7fc2dc003ab0 2023-10-10T21:17:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.064+0000 7fc2fa59d700 1 -- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2dc003ab0 msgr2=0x7fc2dc003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.064+0000 7fc2fa59d700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2dc003ab0 0x7fc2dc003ec0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c2d0 tx=0x7fc2ec001d80 comp rx=0 tx=0).stop 2023-10-10T21:17:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.064+0000 7fc2fa59d700 1 -- 172.21.15.154:0/1061791191 shutdown_connections 2023-10-10T21:17:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.064+0000 7fc2fa59d700 1 --2- 172.21.15.154:0/1061791191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2dc003ab0 0x7fc2dc003ec0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.064+0000 7fc2fa59d700 1 -- 172.21.15.154:0/1061791191 >> 172.21.15.154:0/1061791191 conn(0x7fc2f40cc1f0 msgr2=0x7fc2f40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.065+0000 7fc2fa59d700 1 -- 172.21.15.154:0/1061791191 shutdown_connections 2023-10-10T21:17:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.065+0000 7fc2fa59d700 1 -- 172.21.15.154:0/1061791191 wait complete. 2023-10-10T21:17:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.067+0000 7fc2fa59d700 1 Processor -- start 2023-10-10T21:17:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.067+0000 7fc2fa59d700 1 -- start start 2023-10-10T21:17:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2fa59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2dc003ab0 0x7fc2f40c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2fa59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c16e0 0x7fc2f40c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2fa59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40c5690 0x7fc2f41499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2fa59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40c35f0 con 0x7fc2f40c16e0 2023-10-10T21:17:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2fa59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f415d370 con 0x7fc2f40c5690 2023-10-10T21:17:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2fa59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40c1b30 con 0x7fc2dc003ab0 2023-10-10T21:17:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2f9d9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40c5690 0x7fc2f41499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2f9d9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40c5690 0x7fc2f41499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52172/0 (socket says 172.21.15.154:52172) 2023-10-10T21:17:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2f9d9c700 1 -- 172.21.15.154:0/3008471162 learned_addr learned my addr 172.21.15.154:0/3008471162 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2f959b700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2dc003ab0 0x7fc2f40c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.069+0000 7fc2f8d9a700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c16e0 0x7fc2f40c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.070+0000 7fc2f9d9c700 1 -- 172.21.15.154:0/3008471162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2dc003ab0 msgr2=0x7fc2f40c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.070+0000 7fc2f9d9c700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2dc003ab0 0x7fc2f40c11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.070+0000 7fc2f9d9c700 1 -- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c16e0 msgr2=0x7fc2f40c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.070+0000 7fc2f9d9c700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c16e0 0x7fc2f40c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.070+0000 7fc2f9d9c700 1 -- 172.21.15.154:0/3008471162 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40c5ae0 con 0x7fc2f40c5690 2023-10-10T21:17:48.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.070+0000 7fc2f8d9a700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c16e0 0x7fc2f40c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:48.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.070+0000 7fc2f9d9c700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40c5690 0x7fc2f41499f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40ca6b0 tx=0x7fc2e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:48.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.071+0000 7fc2f17fa700 1 -- 172.21.15.154:0/3008471162 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8013750 con 0x7fc2f40c5690 2023-10-10T21:17:48.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.071+0000 7fc2f17fa700 1 -- 172.21.15.154:0/3008471162 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80138b0 con 0x7fc2f40c5690 2023-10-10T21:17:48.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.071+0000 7fc2f17fa700 1 -- 172.21.15.154:0/3008471162 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8013c30 con 0x7fc2f40c5690 2023-10-10T21:17:48.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.071+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f40c6080 con 0x7fc2f40c5690 2023-10-10T21:17:48.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.071+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f41467e0 con 0x7fc2f40c5690 2023-10-10T21:17:48.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.074+0000 7fc2f17fa700 1 -- 172.21.15.154:0/3008471162 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc2e8014650 con 0x7fc2f40c5690 2023-10-10T21:17:48.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.074+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f404c3c0 con 0x7fc2f40c5690 2023-10-10T21:17:48.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.075+0000 7fc2f17fa700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc2e0067110 0x7fc2e00695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.075+0000 7fc2f17fa700 1 -- 172.21.15.154:0/3008471162 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fc2e8084ec0 con 0x7fc2f40c5690 2023-10-10T21:17:48.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.076+0000 7fc2f959b700 1 -- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc2e0067110 msgr2=0x7fc2e00695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:48.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.076+0000 7fc2f959b700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc2e0067110 0x7fc2e00695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:48.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.079+0000 7fc2f17fa700 1 -- 172.21.15.154:0/3008471162 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2e8051ca0 con 0x7fc2f40c5690 2023-10-10T21:17:48.152 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:48.151+0000 7fe54149d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:48.169 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:48.168+0000 7f2c1df19180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:17:48.247 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:48.246+0000 7fe54149d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:17:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.277+0000 7fc2f959b700 1 -- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc2e0067110 msgr2=0x7fc2e00695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.277+0000 7fc2f959b700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc2e0067110 0x7fc2e00695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:48.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.333+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2f40ca0f0 con 0x7fc2f40c5690 2023-10-10T21:17:48.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.334+0000 7fc2f17fa700 1 -- 172.21.15.154:0/3008471162 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fc2e8022090 con 0x7fc2f40c5690 2023-10-10T21:17:48.335 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:48.336 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/209340130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":209340130},{"type":"v1","addr":"172.21.15.179:6834","nonce":209340130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3372685755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3372685755},{"type":"v1","addr":"172.21.15.154:6835","nonce":3372685755}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1909692066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1909692066},{"type":"v1","addr":"172.21.15.154:6837","nonce":1909692066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:17:21.571274+0000","modified":"2023-10-10T21:17:25.130727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6019":{"gid":6019,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2833897496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2833897496},{"type":"v1","addr":"172.21.15.179:6835","nonce":2833897496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-10T21:17:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc2e0067110 msgr2=0x7fc2e00695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc2e0067110 0x7fc2e00695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40c5690 msgr2=0x7fc2f41499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40c5690 0x7fc2f41499f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40ca6b0 tx=0x7fc2e80091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 shutdown_connections 2023-10-10T21:17:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc2e0067110 0x7fc2e00695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40c5690 0x7fc2f41499f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2dc003ab0 0x7fc2f40c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 --2- 172.21.15.154:0/3008471162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c16e0 0x7fc2f40c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 >> 172.21.15.154:0/3008471162 conn(0x7fc2f40cc1f0 msgr2=0x7fc2f40b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 shutdown_connections 2023-10-10T21:17:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.337+0000 7fc2fa59d700 1 -- 172.21.15.154:0/3008471162 wait complete. 2023-10-10T21:17:48.341 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 30 2023-10-10T21:17:48.346 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:48.344+0000 7f2c1df19180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:17:48.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:48.448 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:48.447+0000 7f2c1df19180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:17:48.538 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:48.538+0000 7fe54149d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:17:48.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.543+0000 7fa34519d700 1 Processor -- start 2023-10-10T21:17:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.544+0000 7fa34519d700 1 -- start start 2023-10-10T21:17:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa34519d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa340159420 0x7fa3400b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa34519d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3401597f0 0x7fa3400b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa34519d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3400b11d0 con 0x7fa34015d230 2023-10-10T21:17:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa34519d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3400b14b0 con 0x7fa340159420 2023-10-10T21:17:48.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa34519d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400b1790 con 0x7fa3401597f0 2023-10-10T21:17:48.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa34499c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa34015d230 0x7fa3400b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36716/0 (socket says 172.21.15.154:36716) 2023-10-10T21:17:48.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa34499c700 1 -- 172.21.15.154:0/716649455 learned_addr learned my addr 172.21.15.154:0/716649455 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:48.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa33ffff700 1 --2- 172.21.15.154:0/716649455 >> v2:172.21.15.179:3300/0 conn(0x7fa340159420 0x7fa3400b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa33f7fe700 1 --2- 172.21.15.154:0/716649455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3401597f0 0x7fa3400b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.545+0000 7fa33effd700 1 -- 172.21.15.154:0/716649455 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853712969 0 0) 0x7fa3400b11d0 con 0x7fa34015d230 2023-10-10T21:17:48.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.546+0000 7fa33ffff700 1 -- 172.21.15.154:0/716649455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3401597f0 msgr2=0x7fa3400b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:48.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.546+0000 7fa33ffff700 1 --2- 172.21.15.154:0/716649455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3401597f0 0x7fa3400b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.546+0000 7fa33ffff700 1 -- 172.21.15.154:0/716649455 >> v1:172.21.15.154:6789/0 conn(0x7fa34015d230 legacy=0x7fa3400b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.546+0000 7fa33ffff700 1 -- 172.21.15.154:0/716649455 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400b1a70 con 0x7fa340159420 2023-10-10T21:17:48.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.546+0000 7fa33f7fe700 1 --2- 172.21.15.154:0/716649455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3401597f0 0x7fa3400b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:48.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.546+0000 7fa33ffff700 1 --2- 172.21.15.154:0/716649455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 0x7fa3400b5f40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa3300098e0 tx=0x7fa3300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7abdf5a3af9db38e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:48.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.546+0000 7fa33effd700 1 -- 172.21.15.154:0/716649455 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000b640 con 0x7fa340159420 2023-10-10T21:17:48.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.546+0000 7fa33effd700 1 -- 172.21.15.154:0/716649455 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000b7a0 con 0x7fa340159420 2023-10-10T21:17:48.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.546+0000 7fa33effd700 1 -- 172.21.15.154:0/716649455 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000bb40 con 0x7fa340159420 2023-10-10T21:17:48.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.547+0000 7fa34519d700 1 -- 172.21.15.154:0/716649455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 msgr2=0x7fa3400b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.547+0000 7fa34519d700 1 --2- 172.21.15.154:0/716649455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 0x7fa3400b5f40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa3300098e0 tx=0x7fa3300091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.547+0000 7fa34519d700 1 -- 172.21.15.154:0/716649455 shutdown_connections 2023-10-10T21:17:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.547+0000 7fa34519d700 1 --2- 172.21.15.154:0/716649455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 0x7fa3400b5f40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.547+0000 7fa34519d700 1 --2- 172.21.15.154:0/716649455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3401597f0 0x7fa3400b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.547+0000 7fa34519d700 1 -- 172.21.15.154:0/716649455 >> 172.21.15.154:0/716649455 conn(0x7fa3400d0660 msgr2=0x7fa3400d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:48.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.547+0000 7fa34519d700 1 -- 172.21.15.154:0/716649455 shutdown_connections 2023-10-10T21:17:48.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.547+0000 7fa34519d700 1 -- 172.21.15.154:0/716649455 wait complete. 2023-10-10T21:17:48.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.548+0000 7fa34519d700 1 Processor -- start 2023-10-10T21:17:48.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.548+0000 7fa34519d700 1 -- start start 2023-10-10T21:17:48.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.549+0000 7fa34519d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 0x7fa3400c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.549+0000 7fa34519d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3401597f0 0x7fa340155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.549+0000 7fa34519d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34015d230 0x7fa3400c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.549+0000 7fa34519d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400c92f0 con 0x7fa3401597f0 2023-10-10T21:17:48.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.549+0000 7fa34519d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400c7dd0 con 0x7fa340159420 2023-10-10T21:17:48.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.549+0000 7fa34519d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400c7570 con 0x7fa34015d230 2023-10-10T21:17:48.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa33f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3401597f0 0x7fa340155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa33ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 0x7fa3400c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa34499c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34015d230 0x7fa3400c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:48.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa33f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3401597f0 0x7fa340155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36460/0 (socket says 172.21.15.154:36460) 2023-10-10T21:17:48.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa33ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 0x7fa3400c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52182/0 (socket says 172.21.15.154:52182) 2023-10-10T21:17:48.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa33f7fe700 1 -- 172.21.15.154:0/3337203484 learned_addr learned my addr 172.21.15.154:0/3337203484 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:48.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa34499c700 1 -- 172.21.15.154:0/3337203484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 msgr2=0x7fa3400c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa34499c700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 0x7fa3400c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa34499c700 1 -- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3401597f0 msgr2=0x7fa340155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa34499c700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3401597f0 0x7fa340155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa34499c700 1 -- 172.21.15.154:0/3337203484 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334009420 con 0x7fa34015d230 2023-10-10T21:17:48.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa33ffff700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 0x7fa3400c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:48.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.550+0000 7fa34499c700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34015d230 0x7fa3400c5400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa33800cb90 tx=0x7fa3380018f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:48.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.551+0000 7fa327fff700 1 -- 172.21.15.154:0/3337203484 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800a780 con 0x7fa34015d230 2023-10-10T21:17:48.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.551+0000 7fa327fff700 1 -- 172.21.15.154:0/3337203484 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33800a8e0 con 0x7fa34015d230 2023-10-10T21:17:48.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.551+0000 7fa327fff700 1 -- 172.21.15.154:0/3337203484 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800aca0 con 0x7fa34015d230 2023-10-10T21:17:48.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.551+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa330009420 con 0x7fa34015d230 2023-10-10T21:17:48.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.551+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3400c78c0 con 0x7fa34015d230 2023-10-10T21:17:48.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.552+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34004c3c0 con 0x7fa34015d230 2023-10-10T21:17:48.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.553+0000 7fa327fff700 1 -- 172.21.15.154:0/3337203484 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa338007300 con 0x7fa34015d230 2023-10-10T21:17:48.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.554+0000 7fa327fff700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa32c0670e0 0x7fa32c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:48.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.554+0000 7fa327fff700 1 -- 172.21.15.154:0/3337203484 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fa338084d30 con 0x7fa34015d230 2023-10-10T21:17:48.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.554+0000 7fa33ffff700 1 -- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa32c0670e0 msgr2=0x7fa32c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:48.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.554+0000 7fa33ffff700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa32c0670e0 0x7fa32c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:48.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.558+0000 7fa327fff700 1 -- 172.21.15.154:0/3337203484 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa338051a70 con 0x7fa34015d230 2023-10-10T21:17:48.634 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:48.634+0000 7fe54149d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:17:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.755+0000 7fa33ffff700 1 -- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa32c0670e0 msgr2=0x7fa32c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.755+0000 7fa33ffff700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa32c0670e0 0x7fa32c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:48.769 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:48.768+0000 7f2c1df19180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:17:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.817+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3400b1d50 con 0x7fa34015d230 2023-10-10T21:17:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.818+0000 7fa327fff700 1 -- 172.21.15.154:0/3337203484 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fa338055090 con 0x7fa34015d230 2023-10-10T21:17:48.819 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:48.820 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/209340130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":209340130},{"type":"v1","addr":"172.21.15.179:6834","nonce":209340130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3372685755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3372685755},{"type":"v1","addr":"172.21.15.154:6835","nonce":3372685755}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1909692066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1909692066},{"type":"v1","addr":"172.21.15.154:6837","nonce":1909692066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:17:21.571274+0000","modified":"2023-10-10T21:17:25.130727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6019":{"gid":6019,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/2833897496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2833897496},{"type":"v1","addr":"172.21.15.179:6835","nonce":2833897496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-10T21:17:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa32c0670e0 msgr2=0x7fa32c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa32c0670e0 0x7fa32c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34015d230 msgr2=0x7fa3400c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34015d230 0x7fa3400c5400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa33800cb90 tx=0x7fa3380018f0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 shutdown_connections 2023-10-10T21:17:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34015d230 0x7fa3400c5400 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa32c0670e0 0x7fa32c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa340159420 0x7fa3400c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 --2- 172.21.15.154:0/3337203484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3401597f0 0x7fa340155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.820+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 >> 172.21.15.154:0/3337203484 conn(0x7fa3400d0660 msgr2=0x7fa3401582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:48.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.821+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 shutdown_connections 2023-10-10T21:17:48.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:48.821+0000 7fa34519d700 1 -- 172.21.15.154:0/3337203484 wait complete. 2023-10-10T21:17:48.824 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 30 2023-10-10T21:17:48.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:48.870 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:48.869+0000 7f2c1df19180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:17:49.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.026+0000 7fd615f9d700 1 Processor -- start 2023-10-10T21:17:49.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.026+0000 7fd615f9d700 1 -- start start 2023-10-10T21:17:49.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd615f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd610159420 0x7fd6100b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd615f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6101597f0 0x7fd6100b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd615f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6100b11d0 con 0x7fd61015d230 2023-10-10T21:17:49.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd615f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6100b14b0 con 0x7fd6101597f0 2023-10-10T21:17:49.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd615f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6100b1790 con 0x7fd610159420 2023-10-10T21:17:49.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd60ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6101597f0 0x7fd6100b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd614f9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd610159420 0x7fd6100b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd60ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6101597f0 0x7fd6100b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36466/0 (socket says 172.21.15.154:36466) 2023-10-10T21:17:49.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd60ffff700 1 -- 172.21.15.154:0/765025890 learned_addr learned my addr 172.21.15.154:0/765025890 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:49.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.028+0000 7fd60f7fe700 1 -- 172.21.15.154:0/765025890 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357193216 0 0) 0x7fd6100b11d0 con 0x7fd61015d230 2023-10-10T21:17:49.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd60f7fe700 1 -- 172.21.15.154:0/765025890 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd600003570 con 0x7fd61015d230 2023-10-10T21:17:49.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd60ffff700 1 -- 172.21.15.154:0/765025890 >> v2:172.21.15.179:3300/0 conn(0x7fd610159420 msgr2=0x7fd6100b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:49.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd60ffff700 1 --2- 172.21.15.154:0/765025890 >> v2:172.21.15.179:3300/0 conn(0x7fd610159420 0x7fd6100b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd60ffff700 1 -- 172.21.15.154:0/765025890 >> v1:172.21.15.179:6789/0 conn(0x7fd61015d230 legacy=0x7fd61015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd60ffff700 1 -- 172.21.15.154:0/765025890 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6100b1a70 con 0x7fd6101597f0 2023-10-10T21:17:49.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd614f9b700 1 --2- 172.21.15.154:0/765025890 >> v2:172.21.15.179:3300/0 conn(0x7fd610159420 0x7fd6100b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:49.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd60ffff700 1 --2- 172.21.15.154:0/765025890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6101597f0 0x7fd6100b2270 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd6100b2f20 tx=0x7fd5fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fb354db0e7bf8e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:49.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd60f7fe700 1 -- 172.21.15.154:0/765025890 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00b640 con 0x7fd6101597f0 2023-10-10T21:17:49.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd60f7fe700 1 -- 172.21.15.154:0/765025890 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc00b7a0 con 0x7fd6101597f0 2023-10-10T21:17:49.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.029+0000 7fd60f7fe700 1 -- 172.21.15.154:0/765025890 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00bb60 con 0x7fd6101597f0 2023-10-10T21:17:49.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.030+0000 7fd615f9d700 1 -- 172.21.15.154:0/765025890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6101597f0 msgr2=0x7fd6100b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.030+0000 7fd615f9d700 1 --2- 172.21.15.154:0/765025890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6101597f0 0x7fd6100b2270 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd6100b2f20 tx=0x7fd5fc009250 comp rx=0 tx=0).stop 2023-10-10T21:17:49.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.030+0000 7fd615f9d700 1 -- 172.21.15.154:0/765025890 shutdown_connections 2023-10-10T21:17:49.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.030+0000 7fd615f9d700 1 --2- 172.21.15.154:0/765025890 >> v2:172.21.15.179:3300/0 conn(0x7fd610159420 0x7fd6100b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.030+0000 7fd615f9d700 1 --2- 172.21.15.154:0/765025890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6101597f0 0x7fd6100b2270 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.030+0000 7fd615f9d700 1 -- 172.21.15.154:0/765025890 >> 172.21.15.154:0/765025890 conn(0x7fd6100d0660 msgr2=0x7fd6100d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:49.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.030+0000 7fd615f9d700 1 -- 172.21.15.154:0/765025890 shutdown_connections 2023-10-10T21:17:49.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.030+0000 7fd615f9d700 1 -- 172.21.15.154:0/765025890 wait complete. 2023-10-10T21:17:49.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.032+0000 7fd615f9d700 1 Processor -- start 2023-10-10T21:17:49.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.032+0000 7fd615f9d700 1 -- start start 2023-10-10T21:17:49.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd615f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd610159420 0x7fd610144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd615f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6101597f0 0x7fd610068d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd615f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd61015d230 0x7fd610140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd615f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6101442b0 con 0x7fd61015d230 2023-10-10T21:17:49.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd615f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6101436a0 con 0x7fd610159420 2023-10-10T21:17:49.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd615f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd610143980 con 0x7fd6101597f0 2023-10-10T21:17:49.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd614f9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd610159420 0x7fd610144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd614f9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd610159420 0x7fd610144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52202/0 (socket says 172.21.15.154:52202) 2023-10-10T21:17:49.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd60ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6101597f0 0x7fd610068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd614f9b700 1 -- 172.21.15.154:0/1122097877 learned_addr learned my addr 172.21.15.154:0/1122097877 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:49.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd61579c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd61015d230 0x7fd610140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd614f9b700 1 -- 172.21.15.154:0/1122097877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6101597f0 msgr2=0x7fd610068d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd614f9b700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6101597f0 0x7fd610068d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd614f9b700 1 -- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd61015d230 msgr2=0x7fd610140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd614f9b700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd61015d230 0x7fd610140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.033+0000 7fd614f9b700 1 -- 172.21.15.154:0/1122097877 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604009420 con 0x7fd610159420 2023-10-10T21:17:49.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.034+0000 7fd614f9b700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd610159420 0x7fd610144740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd60400ec80 tx=0x7fd6040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:49.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.034+0000 7fd60cff9700 1 -- 172.21.15.154:0/1122097877 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60400c920 con 0x7fd610159420 2023-10-10T21:17:49.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.034+0000 7fd60cff9700 1 -- 172.21.15.154:0/1122097877 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60400ca80 con 0x7fd610159420 2023-10-10T21:17:49.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.034+0000 7fd60cff9700 1 -- 172.21.15.154:0/1122097877 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60400ce00 con 0x7fd610159420 2023-10-10T21:17:49.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.034+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5fc0094f0 con 0x7fd610159420 2023-10-10T21:17:49.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.034+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd610143f40 con 0x7fd610159420 2023-10-10T21:17:49.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.035+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd610144590 con 0x7fd610159420 2023-10-10T21:17:49.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.036+0000 7fd60cff9700 1 -- 172.21.15.154:0/1122097877 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fd604013680 con 0x7fd610159420 2023-10-10T21:17:49.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.037+0000 7fd60cff9700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd5f40670e0 0x7fd5f4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.037+0000 7fd60ffff700 1 -- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd5f40670e0 msgr2=0x7fd5f4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:49.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.037+0000 7fd60cff9700 1 -- 172.21.15.154:0/1122097877 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fd604085270 con 0x7fd610159420 2023-10-10T21:17:49.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.037+0000 7fd60ffff700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd5f40670e0 0x7fd5f4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:49.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.041+0000 7fd60cff9700 1 -- 172.21.15.154:0/1122097877 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd604051f30 con 0x7fd610159420 2023-10-10T21:17:49.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.238+0000 7fd60ffff700 1 -- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd5f40670e0 msgr2=0x7fd5f4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:49.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.238+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd61004c3c0 con 0x7fd610159420 2023-10-10T21:17:49.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.238+0000 7fd60ffff700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd5f40670e0 0x7fd5f4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.239+0000 7fd60cff9700 1 -- 172.21.15.154:0/1122097877 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16365 (secure 0 0 0) 0x7fd604055550 con 0x7fd610159420 2023-10-10T21:17:49.241 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:49.242 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":82,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:42.358139+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:17:19.775384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-10T21:17:20.550408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6834/85496":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/2784708064":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/4249601708":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/306558853":"2023-10-11T21:17:42.358108+0000","172.21.15.154:6836/85496":"2023-10-11T21:17:42.358108+0000","172.21.15.154:0/3472111112":"2023-10-11T21:17:42.358108+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd5f40670e0 msgr2=0x7fd5f4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd5f40670e0 0x7fd5f4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd610159420 msgr2=0x7fd610144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd610159420 0x7fd610144740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd60400ec80 tx=0x7fd6040091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 shutdown_connections 2023-10-10T21:17:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd61015d230 0x7fd610140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd5f40670e0 0x7fd5f4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd610159420 0x7fd610144740 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 --2- 172.21.15.154:0/1122097877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6101597f0 0x7fd610068d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 >> 172.21.15.154:0/1122097877 conn(0x7fd6100d0660 msgr2=0x7fd6100cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 shutdown_connections 2023-10-10T21:17:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.243+0000 7fd615f9d700 1 -- 172.21.15.154:0/1122097877 wait complete. 2023-10-10T21:17:49.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:17:49.270 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:17:49.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T21:17:49.336 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:49.334+0000 7fe54149d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:17:49.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.498+0000 7f241c9ff700 1 Processor -- start 2023-10-10T21:17:49.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.498+0000 7f241c9ff700 1 -- start start 2023-10-10T21:17:49.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.500+0000 7f241c9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2418159890 0x7f241815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.500+0000 7f241c9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2418069560 0x7f24180699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.500+0000 7f241c9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2418069ee0 con 0x7f2418159c60 2023-10-10T21:17:49.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.500+0000 7f241c9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241815a160 con 0x7f2418159890 2023-10-10T21:17:49.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.500+0000 7f241c9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24180d13a0 con 0x7f2418069560 2023-10-10T21:17:49.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.500+0000 7f241659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2418159890 0x7f241815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.500+0000 7f2415d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2418159c60 0x7f241815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36732/0 (socket says 172.21.15.154:36732) 2023-10-10T21:17:49.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.500+0000 7f2415d9b700 1 -- 172.21.15.154:0/2361465596 learned_addr learned my addr 172.21.15.154:0/2361465596 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:49.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.501+0000 7f2416d9d700 1 --2- 172.21.15.154:0/2361465596 >> v2:172.21.15.179:3300/0 conn(0x7f2418069560 0x7f24180699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.501+0000 7f241659c700 1 -- 172.21.15.154:0/2361465596 >> v2:172.21.15.179:3300/0 conn(0x7f2418069560 msgr2=0x7f24180699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:49.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.501+0000 7f241659c700 1 --2- 172.21.15.154:0/2361465596 >> v2:172.21.15.179:3300/0 conn(0x7f2418069560 0x7f24180699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.501+0000 7f241659c700 1 -- 172.21.15.154:0/2361465596 >> v1:172.21.15.154:6789/0 conn(0x7f2418159c60 legacy=0x7f241815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.501+0000 7f241659c700 1 -- 172.21.15.154:0/2361465596 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241815e140 con 0x7f2418159890 2023-10-10T21:17:49.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.501+0000 7f241559a700 1 -- 172.21.15.154:0/2361465596 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543483896 0 0) 0x7f2418069ee0 con 0x7f2418159c60 2023-10-10T21:17:49.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.501+0000 7f241659c700 1 --2- 172.21.15.154:0/2361465596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 0x7f241815abd0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f241806a890 tx=0x7f24080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1720314ca88900a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:49.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.501+0000 7f241559a700 1 -- 172.21.15.154:0/2361465596 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408011630 con 0x7f2418159890 2023-10-10T21:17:49.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241559a700 1 -- 172.21.15.154:0/2361465596 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2408011790 con 0x7f2418159890 2023-10-10T21:17:49.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241559a700 1 -- 172.21.15.154:0/2361465596 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408011b30 con 0x7f2418159890 2023-10-10T21:17:49.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241c9ff700 1 -- 172.21.15.154:0/2361465596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 msgr2=0x7f241815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241c9ff700 1 --2- 172.21.15.154:0/2361465596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 0x7f241815abd0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f241806a890 tx=0x7f24080091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241c9ff700 1 -- 172.21.15.154:0/2361465596 shutdown_connections 2023-10-10T21:17:49.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241c9ff700 1 --2- 172.21.15.154:0/2361465596 >> v2:172.21.15.179:3300/0 conn(0x7f2418069560 0x7f24180699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241c9ff700 1 --2- 172.21.15.154:0/2361465596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 0x7f241815abd0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241c9ff700 1 -- 172.21.15.154:0/2361465596 >> 172.21.15.154:0/2361465596 conn(0x7f2418068e20 msgr2=0x7f24180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:49.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241c9ff700 1 -- 172.21.15.154:0/2361465596 shutdown_connections 2023-10-10T21:17:49.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.502+0000 7f241c9ff700 1 -- 172.21.15.154:0/2361465596 wait complete. 2023-10-10T21:17:49.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.505+0000 7f241c9ff700 1 Processor -- start 2023-10-10T21:17:49.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.505+0000 7f241c9ff700 1 -- start start 2023-10-10T21:17:49.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.506+0000 7f241c9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2418069560 0x7f24181513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.506+0000 7f241c9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 0x7f241815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.506+0000 7f241c9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2418159c60 0x7f241815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.506+0000 7f241c9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241816a890 con 0x7f2418159890 2023-10-10T21:17:49.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.506+0000 7f241c9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24181518f0 con 0x7f2418159c60 2023-10-10T21:17:49.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.506+0000 7f241c9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2418169f60 con 0x7f2418069560 2023-10-10T21:17:49.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.506+0000 7f2415d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 0x7f241815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f2415d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 0x7f241815bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36486/0 (socket says 172.21.15.154:36486) 2023-10-10T21:17:49.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f2415d9b700 1 -- 172.21.15.154:0/2638890001 learned_addr learned my addr 172.21.15.154:0/2638890001 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:49.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f2416d9d700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2418159c60 0x7f241815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f241659c700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2418069560 0x7f24181513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f2415d9b700 1 -- 172.21.15.154:0/2638890001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2418069560 msgr2=0x7f24181513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f2415d9b700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2418069560 0x7f24181513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f2415d9b700 1 -- 172.21.15.154:0/2638890001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2418159c60 msgr2=0x7f241815c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f2415d9b700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2418159c60 0x7f241815c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f2415d9b700 1 -- 172.21.15.154:0/2638890001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408009420 con 0x7f2418159890 2023-10-10T21:17:49.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f241659c700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2418069560 0x7f24181513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:49.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f2415d9b700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 0x7f241815bdb0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c5b0 tx=0x7f240c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:49.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f24067fc700 1 -- 172.21.15.154:0/2638890001 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c005b30 con 0x7f2418159890 2023-10-10T21:17:49.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.507+0000 7f24067fc700 1 -- 172.21.15.154:0/2638890001 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c005c90 con 0x7f2418159890 2023-10-10T21:17:49.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.508+0000 7f24067fc700 1 -- 172.21.15.154:0/2638890001 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c007300 con 0x7f2418159890 2023-10-10T21:17:49.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.508+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241816a240 con 0x7f2418159890 2023-10-10T21:17:49.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.508+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241816ad20 con 0x7f2418159890 2023-10-10T21:17:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.509+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241816aa40 con 0x7f2418159890 2023-10-10T21:17:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.510+0000 7f24067fc700 1 -- 172.21.15.154:0/2638890001 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f240c01b3b0 con 0x7f2418159890 2023-10-10T21:17:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.510+0000 7f24067fc700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f23f80670e0 0x7f23f8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.511+0000 7f24067fc700 1 -- 172.21.15.154:0/2638890001 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f240c084060 con 0x7f2418159890 2023-10-10T21:17:49.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.511+0000 7f241659c700 1 -- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f23f80670e0 msgr2=0x7f23f8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:49.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.511+0000 7f241659c700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f23f80670e0 0x7f23f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:49.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.515+0000 7f24067fc700 1 -- 172.21.15.154:0/2638890001 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f241816aa40 con 0x7f2418159890 2023-10-10T21:17:49.625 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:49.623+0000 7fe54149d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:17:49.631 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:49.630+0000 7f2c1df19180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:17:49.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.712+0000 7f241659c700 1 -- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f23f80670e0 msgr2=0x7f23f8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:49.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.712+0000 7f241659c700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f23f80670e0 0x7f23f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:49.716 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:49.715+0000 7fe54149d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:17:49.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.753+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f241816aa40 con 0x7f2418159890 2023-10-10T21:17:49.755 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T21:17:49.754+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T21:17:49.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.759+0000 7f24067fc700 1 -- 172.21.15.154:0/2638890001 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7f241816aa40 con 0x7f2418159890 2023-10-10T21:17:49.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.761+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f23f80670e0 msgr2=0x7f23f8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:49.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f23f80670e0 0x7f23f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 msgr2=0x7f241815bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 0x7f241815bdb0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c5b0 tx=0x7f240c001070 comp rx=0 tx=0).stop 2023-10-10T21:17:49.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 shutdown_connections 2023-10-10T21:17:49.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f23f80670e0 0x7f23f8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2418159c60 0x7f241815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2418069560 0x7f24181513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 --2- 172.21.15.154:0/2638890001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418159890 0x7f241815bdb0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 >> 172.21.15.154:0/2638890001 conn(0x7f2418068e20 msgr2=0x7f2418155190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:49.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 shutdown_connections 2023-10-10T21:17:49.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.762+0000 7f241c9ff700 1 -- 172.21.15.154:0/2638890001 wait complete. 2023-10-10T21:17:49.765 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T21:17:49.766 INFO:tasks.ceph.mds.d.smithi179.stderr: -2229> 2023-10-10T21:17:27.086+0000 7f19ebdf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:17:49.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T21:17:49.805 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T21:17:49.873 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:49.872+0000 7fe54149d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:17:49.930 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:49.929+0000 7f2c1df19180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:17:49.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.974+0000 7ff5189fe700 1 Processor -- start 2023-10-10T21:17:49.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.974+0000 7ff5189fe700 1 -- start start 2023-10-10T21:17:49.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.975+0000 7ff5189fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5140b4e70 0x7ff5140ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.975+0000 7ff5189fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5140cfb00 con 0x7ff5140b16d0 2023-10-10T21:17:49.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.975+0000 7ff5189fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51415e060 con 0x7ff5140b1b40 2023-10-10T21:17:49.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.975+0000 7ff5189fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5140b5c40 con 0x7ff5140b4e70 2023-10-10T21:17:49.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.975+0000 7ff51259c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff5140b16d0 0x7ff51415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36734/0 (socket says 172.21.15.154:36734) 2023-10-10T21:17:49.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.976+0000 7ff51259c700 1 -- 172.21.15.154:0/4184966166 learned_addr learned my addr 172.21.15.154:0/4184966166 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:49.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.976+0000 7ff512d9d700 1 --2- 172.21.15.154:0/4184966166 >> v2:172.21.15.179:3300/0 conn(0x7ff5140b4e70 0x7ff5140ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.976+0000 7ff511d9b700 1 -- 172.21.15.154:0/4184966166 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839329652 0 0) 0x7ff5140cfb00 con 0x7ff5140b16d0 2023-10-10T21:17:49.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.976+0000 7ff511d9b700 1 -- 172.21.15.154:0/4184966166 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4fc003570 con 0x7ff5140b16d0 2023-10-10T21:17:49.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.976+0000 7ff512d9d700 1 -- 172.21.15.154:0/4184966166 >> v1:172.21.15.179:6789/0 conn(0x7ff5140b1b40 legacy=0x7ff51415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.976+0000 7ff511d9b700 1 -- 172.21.15.154:0/4184966166 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029709664 0 0) 0x7ff51415e060 con 0x7ff5140b1b40 2023-10-10T21:17:49.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.976+0000 7ff512d9d700 1 -- 172.21.15.154:0/4184966166 >> v1:172.21.15.154:6789/0 conn(0x7ff5140b16d0 legacy=0x7ff51415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.976+0000 7ff512d9d700 1 -- 172.21.15.154:0/4184966166 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5140b5f20 con 0x7ff5140b4e70 2023-10-10T21:17:49.982 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:49.976+0000 7fe54149d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:17:49.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.977+0000 7ff512d9d700 1 --2- 172.21.15.154:0/4184966166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5140b4e70 0x7ff5140ccff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff5040098e0 tx=0x7ff5040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=308c8a13f348dae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:49.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.977+0000 7ff511d9b700 1 -- 172.21.15.154:0/4184966166 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400b640 con 0x7ff5140b4e70 2023-10-10T21:17:49.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.977+0000 7ff511d9b700 1 -- 172.21.15.154:0/4184966166 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50400b7a0 con 0x7ff5140b4e70 2023-10-10T21:17:49.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.977+0000 7ff511d9b700 1 -- 172.21.15.154:0/4184966166 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400bb40 con 0x7ff5140b4e70 2023-10-10T21:17:49.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.977+0000 7ff5189fe700 1 -- 172.21.15.154:0/4184966166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5140b4e70 msgr2=0x7ff5140ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.977+0000 7ff5189fe700 1 --2- 172.21.15.154:0/4184966166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5140b4e70 0x7ff5140ccff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff5040098e0 tx=0x7ff5040091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.978+0000 7ff5189fe700 1 -- 172.21.15.154:0/4184966166 shutdown_connections 2023-10-10T21:17:49.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.978+0000 7ff5189fe700 1 --2- 172.21.15.154:0/4184966166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5140b4e70 0x7ff5140ccff0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.978+0000 7ff5189fe700 1 -- 172.21.15.154:0/4184966166 >> 172.21.15.154:0/4184966166 conn(0x7ff5140d10c0 msgr2=0x7ff5140affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:49.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.978+0000 7ff5189fe700 1 -- 172.21.15.154:0/4184966166 shutdown_connections 2023-10-10T21:17:49.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.978+0000 7ff5189fe700 1 -- 172.21.15.154:0/4184966166 wait complete. 2023-10-10T21:17:49.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.979+0000 7ff5189fe700 1 Processor -- start 2023-10-10T21:17:49.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.979+0000 7ff5189fe700 1 -- start start 2023-10-10T21:17:49.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.980+0000 7ff5189fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5140b16d0 0x7ff514157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.980+0000 7ff5189fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5140b1b40 0x7ff514169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.980+0000 7ff5189fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5140b4e70 0x7ff5140c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.980+0000 7ff5189fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140c8360 con 0x7ff5140b16d0 2023-10-10T21:17:49.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.980+0000 7ff5189fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140c7750 con 0x7ff5140b4e70 2023-10-10T21:17:49.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.980+0000 7ff5189fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140c7a30 con 0x7ff5140b1b40 2023-10-10T21:17:49.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.980+0000 7ff512d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5140b16d0 0x7ff514157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff512d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5140b16d0 0x7ff514157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36488/0 (socket says 172.21.15.154:36488) 2023-10-10T21:17:49.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff512d9d700 1 -- 172.21.15.154:0/2509289646 learned_addr learned my addr 172.21.15.154:0/2509289646 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:49.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff51259c700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5140b1b40 0x7ff514169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff51359e700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5140b4e70 0x7ff5140c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:49.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff512d9d700 1 -- 172.21.15.154:0/2509289646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5140b1b40 msgr2=0x7ff514169be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff512d9d700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5140b1b40 0x7ff514169be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff512d9d700 1 -- 172.21.15.154:0/2509289646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5140b4e70 msgr2=0x7ff5140c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:49.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff512d9d700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5140b4e70 0x7ff5140c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:49.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff512d9d700 1 -- 172.21.15.154:0/2509289646 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504009420 con 0x7ff5140b16d0 2023-10-10T21:17:49.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff51259c700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5140b1b40 0x7ff514169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:49.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff512d9d700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5140b16d0 0x7ff514157880 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff514070dd0 tx=0x7ff504017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:49.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff4faffd700 1 -- 172.21.15.154:0/2509289646 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50401f070 con 0x7ff5140b16d0 2023-10-10T21:17:49.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff4faffd700 1 -- 172.21.15.154:0/2509289646 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50400b910 con 0x7ff5140b16d0 2023-10-10T21:17:49.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.981+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5140c7d10 con 0x7ff5140b16d0 2023-10-10T21:17:49.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.982+0000 7ff4faffd700 1 -- 172.21.15.154:0/2509289646 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504011420 con 0x7ff5140b16d0 2023-10-10T21:17:49.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.982+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff514157dc0 con 0x7ff5140b16d0 2023-10-10T21:17:49.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.983+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff514088990 con 0x7ff5140b16d0 2023-10-10T21:17:49.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.983+0000 7ff4faffd700 1 -- 172.21.15.154:0/2509289646 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7ff504011790 con 0x7ff5140b16d0 2023-10-10T21:17:49.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.984+0000 7ff4faffd700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 0x7ff500069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:49.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.984+0000 7ff4faffd700 1 -- 172.21.15.154:0/2509289646 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6441+0+0 (secure 0 0 0) 0x7ff504085d90 con 0x7ff5140b16d0 2023-10-10T21:17:49.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.984+0000 7ff51259c700 1 -- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 msgr2=0x7ff500069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:49.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.984+0000 7ff51259c700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 0x7ff500069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:17:49.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:49.988+0000 7ff4faffd700 1 -- 172.21.15.154:0/2509289646 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff504052ab0 con 0x7ff5140b16d0 2023-10-10T21:17:50.030 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:50.029+0000 7f2c1df19180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:17:50.167 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:50.165+0000 7fe54149d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:17:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.185+0000 7ff51259c700 1 -- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 msgr2=0x7ff500069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.185+0000 7ff51259c700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 0x7ff500069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:17:50.189 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:50.188+0000 7f2c1df19180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:17:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.227+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff51404bb80 con 0x7ff5140b16d0 2023-10-10T21:17:50.258 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:50.256+0000 7fe54149d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:17:50.293 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:50.292+0000 7f2c1df19180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:17:50.348 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:50.346+0000 7fe54149d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:17:50.440 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:17:50.439+0000 7fe54149d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:17:50.484 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:50.483+0000 7f2c1df19180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:17:50.578 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:50.577+0000 7f2c1df19180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:17:50.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.586+0000 7ff51259c700 1 -- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 msgr2=0x7ff500069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:17:50.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.586+0000 7ff51259c700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 0x7ff500069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:17:50.671 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:50.670+0000 7f2c1df19180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:17:50.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.759+0000 7ff4faffd700 1 -- 172.21.15.154:0/2509289646 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff5040560d0 con 0x7ff5140b16d0 2023-10-10T21:17:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 msgr2=0x7ff500069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:17:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 0x7ff500069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5140b16d0 msgr2=0x7ff514157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5140b16d0 0x7ff514157880 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff514070dd0 tx=0x7ff504017000 comp rx=0 tx=0).stop 2023-10-10T21:17:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 shutdown_connections 2023-10-10T21:17:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff5000670e0 0x7ff500069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5140b4e70 0x7ff5140c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5140b16d0 0x7ff514157880 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 --2- 172.21.15.154:0/2509289646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5140b1b40 0x7ff514169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.761+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 >> 172.21.15.154:0/2509289646 conn(0x7ff5140d10c0 msgr2=0x7ff514158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.762+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 shutdown_connections 2023-10-10T21:17:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.762+0000 7ff5189fe700 1 -- 172.21.15.154:0/2509289646 wait complete. 2023-10-10T21:17:50.765 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:17:50.764+0000 7f2c1df19180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:17:50.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T21:17:50.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.980+0000 7feeb6b9d700 1 Processor -- start 2023-10-10T21:17:50.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.980+0000 7feeb6b9d700 1 -- start start 2023-10-10T21:17:50.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb6b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feeb0156350 0x7feeb0157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:50.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb6b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feeb00b0c00 0x7feeb015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:50.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb6b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00b0570 con 0x7feeb00b0760 2023-10-10T21:17:50.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb6b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb01578b0 con 0x7feeb00b0c00 2023-10-10T21:17:50.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb6b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00af4d0 con 0x7feeb0156350 2023-10-10T21:17:50.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb639c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feeb00b0c00 0x7feeb015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:50.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb5b9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feeb0156350 0x7feeb0157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:50.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb639c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feeb00b0c00 0x7feeb015a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36564/0 (socket says 172.21.15.154:36564) 2023-10-10T21:17:50.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb539a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7feeb00b0760 0x7feeb0159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36742/0 (socket says 172.21.15.154:36742) 2023-10-10T21:17:50.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.981+0000 7feeb639c700 1 -- 172.21.15.154:0/2930477251 learned_addr learned my addr 172.21.15.154:0/2930477251 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:50.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.982+0000 7feeb5b9b700 1 -- 172.21.15.154:0/2930477251 >> v2:172.21.15.154:3300/0 conn(0x7feeb00b0c00 msgr2=0x7feeb015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:50.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.982+0000 7feeb5b9b700 1 --2- 172.21.15.154:0/2930477251 >> v2:172.21.15.154:3300/0 conn(0x7feeb00b0c00 0x7feeb015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.982+0000 7feeb4b99700 1 -- 172.21.15.154:0/2930477251 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930020826 0 0) 0x7feeb00b0570 con 0x7feeb00b0760 2023-10-10T21:17:50.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.982+0000 7feeb5b9b700 1 -- 172.21.15.154:0/2930477251 >> v1:172.21.15.154:6789/0 conn(0x7feeb00b0760 legacy=0x7feeb0159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:50.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.982+0000 7feeb5b9b700 1 -- 172.21.15.154:0/2930477251 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00af7b0 con 0x7feeb0156350 2023-10-10T21:17:50.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.982+0000 7feeb639c700 1 --2- 172.21.15.154:0/2930477251 >> v2:172.21.15.154:3300/0 conn(0x7feeb00b0c00 0x7feeb015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:50.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.982+0000 7feeb5b9b700 1 --2- 172.21.15.154:0/2930477251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb0156350 0x7feeb0157370 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feeb0065950 tx=0x7feeac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1568445a8b52365 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.982+0000 7feeb4b99700 1 -- 172.21.15.154:0/2930477251 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac011630 con 0x7feeb0156350 2023-10-10T21:17:50.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.982+0000 7feeb4b99700 1 -- 172.21.15.154:0/2930477251 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac011790 con 0x7feeb0156350 2023-10-10T21:17:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.983+0000 7feeb4b99700 1 -- 172.21.15.154:0/2930477251 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac011b30 con 0x7feeb0156350 2023-10-10T21:17:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.983+0000 7feeb6b9d700 1 -- 172.21.15.154:0/2930477251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb0156350 msgr2=0x7feeb0157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.983+0000 7feeb6b9d700 1 --2- 172.21.15.154:0/2930477251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb0156350 0x7feeb0157370 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feeb0065950 tx=0x7feeac0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.983+0000 7feeb6b9d700 1 -- 172.21.15.154:0/2930477251 shutdown_connections 2023-10-10T21:17:50.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.983+0000 7feeb6b9d700 1 --2- 172.21.15.154:0/2930477251 >> v2:172.21.15.154:3300/0 conn(0x7feeb00b0c00 0x7feeb015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.983+0000 7feeb6b9d700 1 --2- 172.21.15.154:0/2930477251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb0156350 0x7feeb0157370 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.983+0000 7feeb6b9d700 1 -- 172.21.15.154:0/2930477251 >> 172.21.15.154:0/2930477251 conn(0x7feeb0068e20 msgr2=0x7feeb00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.983+0000 7feeb6b9d700 1 -- 172.21.15.154:0/2930477251 shutdown_connections 2023-10-10T21:17:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.983+0000 7feeb6b9d700 1 -- 172.21.15.154:0/2930477251 wait complete. 2023-10-10T21:17:50.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.985+0000 7feeb6b9d700 1 Processor -- start 2023-10-10T21:17:50.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.985+0000 7feeb6b9d700 1 -- start start 2023-10-10T21:17:50.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.985+0000 7feeb6b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b0760 0x7feeb0142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:50.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb6b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb00b0c00 0x7feeb00adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:50.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb6b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb0156350 0x7feeb00caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:50.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb6b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c9e90 con 0x7feeb00b0c00 2023-10-10T21:17:50.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb6b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00ca170 con 0x7feeb0156350 2023-10-10T21:17:50.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb6b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00ca450 con 0x7feeb00b0760 2023-10-10T21:17:50.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb539a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb00b0c00 0x7feeb00adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:50.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb539a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb00b0c00 0x7feeb00adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36576/0 (socket says 172.21.15.154:36576) 2023-10-10T21:17:50.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb539a700 1 -- 172.21.15.154:0/534602179 learned_addr learned my addr 172.21.15.154:0/534602179 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:50.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb5b9b700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b0760 0x7feeb0142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:50.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb639c700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb0156350 0x7feeb00caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:50.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb539a700 1 -- 172.21.15.154:0/534602179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b0760 msgr2=0x7feeb0142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:50.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb539a700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b0760 0x7feeb0142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb539a700 1 -- 172.21.15.154:0/534602179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb0156350 msgr2=0x7feeb00caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:50.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb539a700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb0156350 0x7feeb00caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:50.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.986+0000 7feeb539a700 1 -- 172.21.15.154:0/534602179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8009ae0 con 0x7feeb00b0c00 2023-10-10T21:17:50.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.987+0000 7feeb539a700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb00b0c00 0x7feeb00adc00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7feea000c5b0 tx=0x7feea0001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:50.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.987+0000 7feea5ffb700 1 -- 172.21.15.154:0/534602179 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0005a70 con 0x7feeb00b0c00 2023-10-10T21:17:50.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.987+0000 7feea5ffb700 1 -- 172.21.15.154:0/534602179 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0005bd0 con 0x7feeb00b0c00 2023-10-10T21:17:50.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.987+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac009420 con 0x7feeb00b0c00 2023-10-10T21:17:50.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.987+0000 7feea5ffb700 1 -- 172.21.15.154:0/534602179 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00070d0 con 0x7feeb00b0c00 2023-10-10T21:17:50.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.987+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb00c9ad0 con 0x7feeb00b0c00 2023-10-10T21:17:50.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.988+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb00cabd0 con 0x7feeb00b0c00 2023-10-10T21:17:50.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.989+0000 7feea5ffb700 1 -- 172.21.15.154:0/534602179 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 34) v1 ==== 84451+0+0 (secure 0 0 0) 0x7feea0007480 con 0x7feeb00b0c00 2023-10-10T21:17:50.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.990+0000 7feea5ffb700 1 -- 172.21.15.154:0/534602179 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6742+0+0 (secure 0 0 0) 0x7feea00839a0 con 0x7feeb00b0c00 2023-10-10T21:17:50.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:50.994+0000 7feea5ffb700 1 -- 172.21.15.154:0/534602179 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feea0050ad0 con 0x7feeb00b0c00 2023-10-10T21:17:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.184+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feeb004c3c0 con 0x7feeb00b0c00 2023-10-10T21:17:51.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.779+0000 7feea5ffb700 1 -- 172.21.15.154:0/534602179 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 35) v1 ==== 84578+0+0 (secure 0 0 0) 0x7feea0050580 con 0x7feeb00b0c00 2023-10-10T21:17:51.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.779+0000 7feea5ffb700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fee9406c9e0 0x7fee9406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:51.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.781+0000 7feeb5b9b700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fee9406c9e0 0x7fee9406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:51.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.784+0000 7feeb5b9b700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fee9406c9e0 0x7fee9406edc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feeac0093f0 tx=0x7feeac017000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:51.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.788+0000 7feea5ffb700 1 -- 172.21.15.154:0/534602179 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) v1 ==== 181+0+0 (secure 0 0 0) 0x7feea006fa50 con 0x7feeb00b0c00 2023-10-10T21:17:51.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fee9406c9e0 msgr2=0x7fee9406edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:51.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fee9406c9e0 0x7fee9406edc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feeac0093f0 tx=0x7feeac017000 comp rx=0 tx=0).stop 2023-10-10T21:17:51.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb00b0c00 msgr2=0x7feeb00adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:51.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb00b0c00 0x7feeb00adc00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7feea000c5b0 tx=0x7feea0001040 comp rx=0 tx=0).stop 2023-10-10T21:17:51.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 shutdown_connections 2023-10-10T21:17:51.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fee9406c9e0 0x7fee9406edc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:51.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb0156350 0x7feeb00caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b0760 0x7feeb0142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 --2- 172.21.15.154:0/534602179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb00b0c00 0x7feeb00adc00 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 >> 172.21.15.154:0/534602179 conn(0x7feeb0068e20 msgr2=0x7feeb0155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 shutdown_connections 2023-10-10T21:17:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:51.792+0000 7feeb6b9d700 1 -- 172.21.15.154:0/534602179 wait complete. 2023-10-10T21:17:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T21:17:51.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T21:17:52.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.002+0000 7f931bbff700 1 Processor -- start 2023-10-10T21:17:52.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.002+0000 7f931bbff700 1 -- start start 2023-10-10T21:17:52.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.003+0000 7f931bbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9314153f50 0x7f93140b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:52.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.003+0000 7f931bbff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f931406d840 0x7f9314069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:52.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.003+0000 7f931bbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93140b4570 con 0x7f9314154320 2023-10-10T21:17:52.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.003+0000 7f931bbff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931415a730 con 0x7f931406d840 2023-10-10T21:17:52.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.003+0000 7f931bbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931415aa10 con 0x7f9314153f50 2023-10-10T21:17:52.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931a19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f931406d840 0x7f9314069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:52.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931919a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9314154320 0x7f931406d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36744/0 (socket says 172.21.15.154:36744) 2023-10-10T21:17:52.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931919a700 1 -- 172.21.15.154:0/3778329803 learned_addr learned my addr 172.21.15.154:0/3778329803 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:52.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931999b700 1 --2- 172.21.15.154:0/3778329803 >> v2:172.21.15.179:3300/0 conn(0x7f9314153f50 0x7f93140b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:52.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931a19c700 1 -- 172.21.15.154:0/3778329803 >> v2:172.21.15.179:3300/0 conn(0x7f9314153f50 msgr2=0x7f93140b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:52.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931a19c700 1 --2- 172.21.15.154:0/3778329803 >> v2:172.21.15.179:3300/0 conn(0x7f9314153f50 0x7f93140b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:52.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931a19c700 1 -- 172.21.15.154:0/3778329803 >> v1:172.21.15.154:6789/0 conn(0x7f9314154320 legacy=0x7f931406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:52.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931a19c700 1 -- 172.21.15.154:0/3778329803 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931415acf0 con 0x7f931406d840 2023-10-10T21:17:52.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931999b700 1 --2- 172.21.15.154:0/3778329803 >> v2:172.21.15.179:3300/0 conn(0x7f9314153f50 0x7f93140b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:52.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f9318999700 1 -- 172.21.15.154:0/3778329803 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004514684 0 0) 0x7f93140b4570 con 0x7f9314154320 2023-10-10T21:17:52.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.004+0000 7f931a19c700 1 --2- 172.21.15.154:0/3778329803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931406d840 0x7f9314069e30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f930c009e60 tx=0x7f930c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d73d07d67373c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:52.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f9318999700 1 -- 172.21.15.154:0/3778329803 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c00e070 con 0x7f931406d840 2023-10-10T21:17:52.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f9318999700 1 -- 172.21.15.154:0/3778329803 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c00bbf0 con 0x7f931406d840 2023-10-10T21:17:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f9318999700 1 -- 172.21.15.154:0/3778329803 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c012430 con 0x7f931406d840 2023-10-10T21:17:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f931bbff700 1 -- 172.21.15.154:0/3778329803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931406d840 msgr2=0x7f9314069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f931bbff700 1 --2- 172.21.15.154:0/3778329803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931406d840 0x7f9314069e30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f930c009e60 tx=0x7f930c009780 comp rx=0 tx=0).stop 2023-10-10T21:17:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f931bbff700 1 -- 172.21.15.154:0/3778329803 shutdown_connections 2023-10-10T21:17:52.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f931bbff700 1 --2- 172.21.15.154:0/3778329803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931406d840 0x7f9314069e30 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:52.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f931bbff700 1 --2- 172.21.15.154:0/3778329803 >> v2:172.21.15.179:3300/0 conn(0x7f9314153f50 0x7f93140b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:52.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f931bbff700 1 -- 172.21.15.154:0/3778329803 >> 172.21.15.154:0/3778329803 conn(0x7f931406baf0 msgr2=0x7f931406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:52.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f931bbff700 1 -- 172.21.15.154:0/3778329803 shutdown_connections 2023-10-10T21:17:52.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.005+0000 7f931bbff700 1 -- 172.21.15.154:0/3778329803 wait complete. 2023-10-10T21:17:52.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.007+0000 7f931bbff700 1 Processor -- start 2023-10-10T21:17:52.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.007+0000 7f931bbff700 1 -- start start 2023-10-10T21:17:52.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931bbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f931406d840 0x7f931415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:52.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931bbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9314153f50 0x7f93140cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:52.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9314154320 0x7f931416e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:52.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931bbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931415e220 con 0x7f9314153f50 2023-10-10T21:17:52.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931bbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931416e5d0 con 0x7f931406d840 2023-10-10T21:17:52.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931415d610 con 0x7f9314154320 2023-10-10T21:17:52.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931919a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9314153f50 0x7f93140cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:52.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931919a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9314153f50 0x7f93140cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36580/0 (socket says 172.21.15.154:36580) 2023-10-10T21:17:52.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931919a700 1 -- 172.21.15.154:0/284520406 learned_addr learned my addr 172.21.15.154:0/284520406 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:52.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931999b700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f931406d840 0x7f931415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:52.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931a19c700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9314154320 0x7f931416e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:52.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931919a700 1 -- 172.21.15.154:0/284520406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9314154320 msgr2=0x7f931416e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:52.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931919a700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9314154320 0x7f931416e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:52.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931919a700 1 -- 172.21.15.154:0/284520406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f931406d840 msgr2=0x7f931415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:52.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931919a700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f931406d840 0x7f931415cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:52.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931919a700 1 -- 172.21.15.154:0/284520406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c009a20 con 0x7f9314153f50 2023-10-10T21:17:52.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.008+0000 7f931a19c700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9314154320 0x7f931416e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:52.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.009+0000 7f931919a700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9314153f50 0x7f93140cbd30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f930400c5b0 tx=0x7f9304001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:52.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.009+0000 7f9309ffb700 1 -- 172.21.15.154:0/284520406 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304005b30 con 0x7f9314153f50 2023-10-10T21:17:52.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.009+0000 7f9309ffb700 1 -- 172.21.15.154:0/284520406 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304005c90 con 0x7f9314153f50 2023-10-10T21:17:52.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.009+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931415d8f0 con 0x7f9314153f50 2023-10-10T21:17:52.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.009+0000 7f9309ffb700 1 -- 172.21.15.154:0/284520406 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304007300 con 0x7f9314153f50 2023-10-10T21:17:52.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.009+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931415deb0 con 0x7f9314153f50 2023-10-10T21:17:52.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.010+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931415e3d0 con 0x7f9314153f50 2023-10-10T21:17:52.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.011+0000 7f9309ffb700 1 -- 172.21.15.154:0/284520406 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 35) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f930401b3b0 con 0x7f9314153f50 2023-10-10T21:17:52.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.012+0000 7f9309ffb700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92f8066d80 0x7f92f8069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:52.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.012+0000 7f9309ffb700 1 -- 172.21.15.154:0/284520406 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f9304083a10 con 0x7f9314153f50 2023-10-10T21:17:52.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.012+0000 7f931999b700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92f8066d80 0x7f92f8069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:52.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.012+0000 7f931999b700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92f8066d80 0x7f92f8069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9310006f00 tx=0x7f9310008040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:52.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.016+0000 7f9309ffb700 1 -- 172.21.15.154:0/284520406 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f931415e3d0 con 0x7f9314153f50 2023-10-10T21:17:52.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.205+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f931415e3d0 con 0x7f9314153f50 2023-10-10T21:17:52.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.791+0000 7f9309ffb700 1 -- 172.21.15.154:0/284520406 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9304051000 con 0x7f9314153f50 2023-10-10T21:17:52.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.798+0000 7f9309ffb700 1 -- 172.21.15.154:0/284520406 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9304054430 con 0x7f9314153f50 2023-10-10T21:17:52.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.801+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92f8066d80 msgr2=0x7f92f8069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:52.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.801+0000 7f931bbff700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92f8066d80 0x7f92f8069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9310006f00 tx=0x7f9310008040 comp rx=0 tx=0).stop 2023-10-10T21:17:52.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.801+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9314153f50 msgr2=0x7f93140cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:52.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.801+0000 7f931bbff700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9314153f50 0x7f93140cbd30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f930400c5b0 tx=0x7f9304001070 comp rx=0 tx=0).stop 2023-10-10T21:17:52.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.802+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 shutdown_connections 2023-10-10T21:17:52.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.802+0000 7f931bbff700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9314154320 0x7f931416e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:52.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.802+0000 7f931bbff700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92f8066d80 0x7f92f8069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:52.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.802+0000 7f931bbff700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f931406d840 0x7f931415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:52.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.802+0000 7f931bbff700 1 --2- 172.21.15.154:0/284520406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9314153f50 0x7f93140cbd30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:52.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.802+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 >> 172.21.15.154:0/284520406 conn(0x7f931406baf0 msgr2=0x7f93140ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:52.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.802+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 shutdown_connections 2023-10-10T21:17:52.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:52.802+0000 7f931bbff700 1 -- 172.21.15.154:0/284520406 wait complete. 2023-10-10T21:17:52.806 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T21:17:52.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T21:17:53.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.007+0000 7f8144bff700 1 Processor -- start 2023-10-10T21:17:53.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.007+0000 7f8144bff700 1 -- start start 2023-10-10T21:17:53.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f8144bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81400ccee0 0x7f81401561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f8144bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400c87c0 0x7f8140156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f8144bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814015b0d0 con 0x7f81400c83f0 2023-10-10T21:17:53.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f8144bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8140156c50 con 0x7f81400ccee0 2023-10-10T21:17:53.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f8144bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814015a4c0 con 0x7f81400c87c0 2023-10-10T21:17:53.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f8137fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81400ccee0 0x7f81401561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f813ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400c87c0 0x7f8140156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f8137fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81400ccee0 0x7f81401561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52330/0 (socket says 172.21.15.154:52330) 2023-10-10T21:17:53.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f813ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400c87c0 0x7f8140156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:52914/0 (socket says 172.21.15.154:52914) 2023-10-10T21:17:53.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f8137fff700 1 -- 172.21.15.154:0/3635757128 learned_addr learned my addr 172.21.15.154:0/3635757128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:53.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.009+0000 7f813e59c700 1 --1- 172.21.15.154:0/3635757128 >> v1:172.21.15.179:6789/0 conn(0x7f81400c83f0 0x7f81400c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:40946/0 (socket says 172.21.15.154:40946) 2023-10-10T21:17:53.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.010+0000 7f8137fff700 1 -- 172.21.15.154:0/3635757128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400c87c0 msgr2=0x7f8140156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:53.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.010+0000 7f8137fff700 1 --2- 172.21.15.154:0/3635757128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400c87c0 0x7f8140156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.010+0000 7f8137fff700 1 -- 172.21.15.154:0/3635757128 >> v1:172.21.15.179:6789/0 conn(0x7f81400c83f0 legacy=0x7f81400c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.010+0000 7f8137fff700 1 -- 172.21.15.154:0/3635757128 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814015a7a0 con 0x7f81400ccee0 2023-10-10T21:17:53.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.010+0000 7f813dd9b700 1 -- 172.21.15.154:0/3635757128 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437586325 0 0) 0x7f814015b0d0 con 0x7f81400c83f0 2023-10-10T21:17:53.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.010+0000 7f8137fff700 1 --2- 172.21.15.154:0/3635757128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81400ccee0 0x7f81401561d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f81280099b0 tx=0x7f8128009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f010261dab7361 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:53.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.010+0000 7f813dd9b700 1 -- 172.21.15.154:0/3635757128 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128009ea0 con 0x7f81400ccee0 2023-10-10T21:17:53.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.010+0000 7f813dd9b700 1 -- 172.21.15.154:0/3635757128 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812800b860 con 0x7f81400ccee0 2023-10-10T21:17:53.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.010+0000 7f813dd9b700 1 -- 172.21.15.154:0/3635757128 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800bc00 con 0x7f81400ccee0 2023-10-10T21:17:53.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.011+0000 7f8144bff700 1 -- 172.21.15.154:0/3635757128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81400ccee0 msgr2=0x7f81401561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.011+0000 7f8144bff700 1 --2- 172.21.15.154:0/3635757128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81400ccee0 0x7f81401561d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f81280099b0 tx=0x7f8128009250 comp rx=0 tx=0).stop 2023-10-10T21:17:53.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.011+0000 7f8144bff700 1 -- 172.21.15.154:0/3635757128 shutdown_connections 2023-10-10T21:17:53.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.011+0000 7f8144bff700 1 --2- 172.21.15.154:0/3635757128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400c87c0 0x7f8140156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.011+0000 7f8144bff700 1 --2- 172.21.15.154:0/3635757128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81400ccee0 0x7f81401561d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.011+0000 7f8144bff700 1 -- 172.21.15.154:0/3635757128 >> 172.21.15.154:0/3635757128 conn(0x7f8140068e10 msgr2=0x7f81400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:53.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.011+0000 7f8144bff700 1 -- 172.21.15.154:0/3635757128 shutdown_connections 2023-10-10T21:17:53.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.011+0000 7f8144bff700 1 -- 172.21.15.154:0/3635757128 wait complete. 2023-10-10T21:17:53.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.012+0000 7f8144bff700 1 Processor -- start 2023-10-10T21:17:53.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.013+0000 7f8144bff700 1 -- start start 2023-10-10T21:17:53.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.013+0000 7f8144bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81400c83f0 0x7f81400c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.013+0000 7f8144bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81400c87c0 0x7f8140151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.013+0000 7f8144bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400ccee0 0x7f81400c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.013+0000 7f8144bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8140151880 con 0x7f81400c87c0 2023-10-10T21:17:53.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.013+0000 7f8144bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c6530 con 0x7f81400c83f0 2023-10-10T21:17:53.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.013+0000 7f8144bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c5680 con 0x7f81400ccee0 2023-10-10T21:17:53.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f8137fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81400c87c0 0x7f8140151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f8137fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81400c87c0 0x7f8140151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36586/0 (socket says 172.21.15.154:36586) 2023-10-10T21:17:53.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f8137fff700 1 -- 172.21.15.154:0/1795492630 learned_addr learned my addr 172.21.15.154:0/1795492630 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:53.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f813ed9d700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400ccee0 0x7f81400c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f813e59c700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81400c83f0 0x7f81400c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f8137fff700 1 -- 172.21.15.154:0/1795492630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400ccee0 msgr2=0x7f81400c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f8137fff700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400ccee0 0x7f81400c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f8137fff700 1 -- 172.21.15.154:0/1795492630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81400c83f0 msgr2=0x7f81400c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f8137fff700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81400c83f0 0x7f81400c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f8137fff700 1 -- 172.21.15.154:0/1795492630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280094f0 con 0x7f81400c87c0 2023-10-10T21:17:53.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.014+0000 7f8137fff700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81400c87c0 0x7f8140151340 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8128006fd0 tx=0x7f8128017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:53.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.015+0000 7f81367fc700 1 -- 172.21.15.154:0/1795492630 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128000d10 con 0x7f81400c87c0 2023-10-10T21:17:53.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.015+0000 7f81367fc700 1 -- 172.21.15.154:0/1795492630 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812800bbe0 con 0x7f81400c87c0 2023-10-10T21:17:53.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.015+0000 7f81367fc700 1 -- 172.21.15.154:0/1795492630 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128011670 con 0x7f81400c87c0 2023-10-10T21:17:53.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.015+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81400c5920 con 0x7f81400c87c0 2023-10-10T21:17:53.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.015+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81400c5ee0 con 0x7f81400c87c0 2023-10-10T21:17:53.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.016+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8140158140 con 0x7f81400c87c0 2023-10-10T21:17:53.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.017+0000 7f81367fc700 1 -- 172.21.15.154:0/1795492630 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8128011a60 con 0x7f81400c87c0 2023-10-10T21:17:53.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.017+0000 7f81367fc700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8120066f30 0x7f81200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.018+0000 7f81367fc700 1 -- 172.21.15.154:0/1795492630 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f8128085e50 con 0x7f81400c87c0 2023-10-10T21:17:53.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.018+0000 7f813e59c700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8120066f30 0x7f81200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.018+0000 7f813e59c700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8120066f30 0x7f81200693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8130001a60 tx=0x7f8130009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:53.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.022+0000 7f81367fc700 1 -- 172.21.15.154:0/1795492630 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8128052f60 con 0x7f81400c87c0 2023-10-10T21:17:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.225+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f814004c3c0 con 0x7f81400c87c0 2023-10-10T21:17:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.229+0000 7f81367fc700 1 -- 172.21.15.154:0/1795492630 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8128056580 con 0x7f81400c87c0 2023-10-10T21:17:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8120066f30 msgr2=0x7f81200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8120066f30 0x7f81200693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8130001a60 tx=0x7f8130009040 comp rx=0 tx=0).stop 2023-10-10T21:17:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81400c87c0 msgr2=0x7f8140151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81400c87c0 0x7f8140151340 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8128006fd0 tx=0x7f8128017000 comp rx=0 tx=0).stop 2023-10-10T21:17:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 shutdown_connections 2023-10-10T21:17:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81400ccee0 0x7f81400c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8120066f30 0x7f81200693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81400c83f0 0x7f81400c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 --2- 172.21.15.154:0/1795492630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81400c87c0 0x7f8140151340 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 >> 172.21.15.154:0/1795492630 conn(0x7f8140068e10 msgr2=0x7f8140151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 shutdown_connections 2023-10-10T21:17:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.232+0000 7f8144bff700 1 -- 172.21.15.154:0/1795492630 wait complete. 2023-10-10T21:17:53.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T21:17:53.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.435+0000 7fb27c9ff700 1 Processor -- start 2023-10-10T21:17:53.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.436+0000 7fb27c9ff700 1 -- start start 2023-10-10T21:17:53.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb27c9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2780c83f0 0x7fb2780c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb27c9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780ccee0 0x7fb2781561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb27c9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27815b0d0 con 0x7fb2780c87c0 2023-10-10T21:17:53.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb27c9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2780c7a60 con 0x7fb2780c83f0 2023-10-10T21:17:53.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb27c9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27815a4c0 con 0x7fb2780ccee0 2023-10-10T21:17:53.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb27659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2780c83f0 0x7fb2780c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb27659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2780c83f0 0x7fb2780c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36602/0 (socket says 172.21.15.154:36602) 2023-10-10T21:17:53.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb27659c700 1 -- 172.21.15.154:0/3040069882 learned_addr learned my addr 172.21.15.154:0/3040069882 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:53.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb276d9d700 1 --1- 172.21.15.154:0/3040069882 >> v1:172.21.15.154:6789/0 conn(0x7fb2780c87c0 0x7fb27806eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36758/0 (socket says 172.21.15.154:36758) 2023-10-10T21:17:53.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb26ffff700 1 --2- 172.21.15.154:0/3040069882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780ccee0 0x7fb2781561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.437+0000 7fb27659c700 1 -- 172.21.15.154:0/3040069882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780ccee0 msgr2=0x7fb2781561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:53.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.438+0000 7fb27659c700 1 --2- 172.21.15.154:0/3040069882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780ccee0 0x7fb2781561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.438+0000 7fb27659c700 1 -- 172.21.15.154:0/3040069882 >> v1:172.21.15.154:6789/0 conn(0x7fb2780c87c0 legacy=0x7fb27806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.438+0000 7fb27659c700 1 -- 172.21.15.154:0/3040069882 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27815a7a0 con 0x7fb2780c83f0 2023-10-10T21:17:53.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.438+0000 7fb26ffff700 1 --2- 172.21.15.154:0/3040069882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780ccee0 0x7fb2781561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:17:53.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.438+0000 7fb275d9b700 1 -- 172.21.15.154:0/3040069882 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281457471 0 0) 0x7fb27815b0d0 con 0x7fb2780c87c0 2023-10-10T21:17:53.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.438+0000 7fb27659c700 1 --2- 172.21.15.154:0/3040069882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780c83f0 0x7fb2780c7520 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb2680099b0 tx=0x7fb268009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6683ab0103403f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:53.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.438+0000 7fb275d9b700 1 -- 172.21.15.154:0/3040069882 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800b860 con 0x7fb2780c83f0 2023-10-10T21:17:53.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.438+0000 7fb275d9b700 1 -- 172.21.15.154:0/3040069882 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26800b9c0 con 0x7fb2780c83f0 2023-10-10T21:17:53.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.438+0000 7fb275d9b700 1 -- 172.21.15.154:0/3040069882 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800bd60 con 0x7fb2780c83f0 2023-10-10T21:17:53.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.439+0000 7fb27c9ff700 1 -- 172.21.15.154:0/3040069882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780c83f0 msgr2=0x7fb2780c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.439+0000 7fb27c9ff700 1 --2- 172.21.15.154:0/3040069882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780c83f0 0x7fb2780c7520 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb2680099b0 tx=0x7fb268009250 comp rx=0 tx=0).stop 2023-10-10T21:17:53.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.439+0000 7fb27c9ff700 1 -- 172.21.15.154:0/3040069882 shutdown_connections 2023-10-10T21:17:53.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.439+0000 7fb27c9ff700 1 --2- 172.21.15.154:0/3040069882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780c83f0 0x7fb2780c7520 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.439+0000 7fb27c9ff700 1 --2- 172.21.15.154:0/3040069882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780ccee0 0x7fb2781561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.439+0000 7fb27c9ff700 1 -- 172.21.15.154:0/3040069882 >> 172.21.15.154:0/3040069882 conn(0x7fb278068e10 msgr2=0x7fb2780cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:53.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.439+0000 7fb27c9ff700 1 -- 172.21.15.154:0/3040069882 shutdown_connections 2023-10-10T21:17:53.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.439+0000 7fb27c9ff700 1 -- 172.21.15.154:0/3040069882 wait complete. 2023-10-10T21:17:53.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.440+0000 7fb27c9ff700 1 Processor -- start 2023-10-10T21:17:53.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.440+0000 7fb27c9ff700 1 -- start start 2023-10-10T21:17:53.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.441+0000 7fb27c9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780c83f0 0x7fb27816a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.441+0000 7fb27c9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2780c87c0 0x7fb278152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.441+0000 7fb27c9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780ccee0 0x7fb27815d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.441+0000 7fb27c9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27815dee0 con 0x7fb2780ccee0 2023-10-10T21:17:53.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.441+0000 7fb27c9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780c3a30 con 0x7fb2780c87c0 2023-10-10T21:17:53.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.441+0000 7fb27c9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27815dc00 con 0x7fb2780c83f0 2023-10-10T21:17:53.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.441+0000 7fb276d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780ccee0 0x7fb27815d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb276d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780ccee0 0x7fb27815d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36608/0 (socket says 172.21.15.154:36608) 2023-10-10T21:17:53.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb276d9d700 1 -- 172.21.15.154:0/2422304492 learned_addr learned my addr 172.21.15.154:0/2422304492 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:53.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb27659c700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780c83f0 0x7fb27816a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb26ffff700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2780c87c0 0x7fb278152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb276d9d700 1 -- 172.21.15.154:0/2422304492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780c83f0 msgr2=0x7fb27816a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb276d9d700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780c83f0 0x7fb27816a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb276d9d700 1 -- 172.21.15.154:0/2422304492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2780c87c0 msgr2=0x7fb278152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb276d9d700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2780c87c0 0x7fb278152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb276d9d700 1 -- 172.21.15.154:0/2422304492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680094f0 con 0x7fb2780ccee0 2023-10-10T21:17:53.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb276d9d700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780ccee0 0x7fb27815d380 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb27000c990 tx=0x7fb270001920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:53.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb26e7fc700 1 -- 172.21.15.154:0/2422304492 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270004da0 con 0x7fb2780ccee0 2023-10-10T21:17:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb26e7fc700 1 -- 172.21.15.154:0/2422304492 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2700060f0 con 0x7fb2780ccee0 2023-10-10T21:17:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2780c3c70 con 0x7fb2780ccee0 2023-10-10T21:17:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.442+0000 7fb26e7fc700 1 -- 172.21.15.154:0/2422304492 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2700064b0 con 0x7fb2780ccee0 2023-10-10T21:17:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.443+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2780c4230 con 0x7fb2780ccee0 2023-10-10T21:17:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.443+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2780c7350 con 0x7fb2780ccee0 2023-10-10T21:17:53.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.444+0000 7fb26e7fc700 1 -- 172.21.15.154:0/2422304492 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2700068e0 con 0x7fb2780ccee0 2023-10-10T21:17:53.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.445+0000 7fb26e7fc700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb258066f30 0x7fb2580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.445+0000 7fb26e7fc700 1 -- 172.21.15.154:0/2422304492 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fb270084300 con 0x7fb2780ccee0 2023-10-10T21:17:53.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.446+0000 7fb27659c700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb258066f30 0x7fb2580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.446+0000 7fb27659c700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb258066f30 0x7fb2580693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb2680099b0 tx=0x7fb268017000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:53.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.449+0000 7fb26e7fc700 1 -- 172.21.15.154:0/2422304492 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb270051490 con 0x7fb2780ccee0 2023-10-10T21:17:53.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.642+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fb27804c3c0 con 0x7fb2780ccee0 2023-10-10T21:17:53.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.646+0000 7fb26e7fc700 1 -- 172.21.15.154:0/2422304492 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v26) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb270054ab0 con 0x7fb2780ccee0 2023-10-10T21:17:53.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb258066f30 msgr2=0x7fb2580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb258066f30 0x7fb2580693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb2680099b0 tx=0x7fb268017000 comp rx=0 tx=0).stop 2023-10-10T21:17:53.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780ccee0 msgr2=0x7fb27815d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780ccee0 0x7fb27815d380 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb27000c990 tx=0x7fb270001920 comp rx=0 tx=0).stop 2023-10-10T21:17:53.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 shutdown_connections 2023-10-10T21:17:53.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2780ccee0 0x7fb27815d380 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2780c83f0 0x7fb27816a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb258066f30 0x7fb2580693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 --2- 172.21.15.154:0/2422304492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2780c87c0 0x7fb278152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 >> 172.21.15.154:0/2422304492 conn(0x7fb278068e10 msgr2=0x7fb2780ca100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 shutdown_connections 2023-10-10T21:17:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.649+0000 7fb27c9ff700 1 -- 172.21.15.154:0/2422304492 wait complete. 2023-10-10T21:17:53.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T21:17:53.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.852+0000 7f0de5b9d700 1 Processor -- start 2023-10-10T21:17:53.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.852+0000 7f0de5b9d700 1 -- start start 2023-10-10T21:17:53.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.853+0000 7f0de5b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0de00b4e70 0x7f0de00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.853+0000 7f0de5b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00b1b40 0x7f0de015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.853+0000 7f0de5b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de00cfb00 con 0x7f0de00b16d0 2023-10-10T21:17:53.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.853+0000 7f0de5b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de00b5c40 con 0x7f0de00b4e70 2023-10-10T21:17:53.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.853+0000 7f0de5b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00b5f20 con 0x7f0de00b1b40 2023-10-10T21:17:53.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0de4b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0de00b4e70 0x7f0de00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0de4b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0de00b4e70 0x7f0de00ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36610/0 (socket says 172.21.15.154:36610) 2023-10-10T21:17:53.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0de4b9b700 1 -- 172.21.15.154:0/2112504739 learned_addr learned my addr 172.21.15.154:0/2112504739 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:53.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0ddffff700 1 --1- 172.21.15.154:0/2112504739 >> v1:172.21.15.154:6789/0 conn(0x7f0de00b16d0 0x7f0de015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36770/0 (socket says 172.21.15.154:36770) 2023-10-10T21:17:53.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0de539c700 1 --2- 172.21.15.154:0/2112504739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00b1b40 0x7f0de015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0de4b9b700 1 -- 172.21.15.154:0/2112504739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00b1b40 msgr2=0x7f0de015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:53.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0de4b9b700 1 --2- 172.21.15.154:0/2112504739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00b1b40 0x7f0de015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0de4b9b700 1 -- 172.21.15.154:0/2112504739 >> v1:172.21.15.154:6789/0 conn(0x7f0de00b16d0 legacy=0x7f0de015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0de4b9b700 1 -- 172.21.15.154:0/2112504739 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de00b6200 con 0x7f0de00b4e70 2023-10-10T21:17:53.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0ddf7fe700 1 -- 172.21.15.154:0/2112504739 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056218997 0 0) 0x7f0de00cfb00 con 0x7f0de00b16d0 2023-10-10T21:17:53.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0de4b9b700 1 --2- 172.21.15.154:0/2112504739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b4e70 0x7f0de00ccff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40099b0 tx=0x7f0dd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded4ceefcf6c166f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:53.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.854+0000 7f0ddf7fe700 1 -- 172.21.15.154:0/2112504739 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400b860 con 0x7f0de00b4e70 2023-10-10T21:17:53.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0ddf7fe700 1 -- 172.21.15.154:0/2112504739 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd400b9c0 con 0x7f0de00b4e70 2023-10-10T21:17:53.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0ddf7fe700 1 -- 172.21.15.154:0/2112504739 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400bd60 con 0x7f0de00b4e70 2023-10-10T21:17:53.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0de5b9d700 1 -- 172.21.15.154:0/2112504739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b4e70 msgr2=0x7f0de00ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0de5b9d700 1 --2- 172.21.15.154:0/2112504739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b4e70 0x7f0de00ccff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40099b0 tx=0x7f0dd4009250 comp rx=0 tx=0).stop 2023-10-10T21:17:53.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0de5b9d700 1 -- 172.21.15.154:0/2112504739 shutdown_connections 2023-10-10T21:17:53.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0de5b9d700 1 --2- 172.21.15.154:0/2112504739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00b1b40 0x7f0de015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0de5b9d700 1 --2- 172.21.15.154:0/2112504739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b4e70 0x7f0de00ccff0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0de5b9d700 1 -- 172.21.15.154:0/2112504739 >> 172.21.15.154:0/2112504739 conn(0x7f0de00d10c0 msgr2=0x7f0de00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0de5b9d700 1 -- 172.21.15.154:0/2112504739 shutdown_connections 2023-10-10T21:17:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.855+0000 7f0de5b9d700 1 -- 172.21.15.154:0/2112504739 wait complete. 2023-10-10T21:17:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.857+0000 7f0de5b9d700 1 Processor -- start 2023-10-10T21:17:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.857+0000 7f0de5b9d700 1 -- start start 2023-10-10T21:17:53.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de5b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b16d0 0x7f0de016dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de5b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0de00b1b40 0x7f0de00b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de5b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00b4e70 0x7f0de0146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de5b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00ca450 con 0x7f0de00b16d0 2023-10-10T21:17:53.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de5b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de016e290 con 0x7f0de00b1b40 2023-10-10T21:17:53.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de5b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00c9560 con 0x7f0de00b4e70 2023-10-10T21:17:53.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de4b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b16d0 0x7f0de016dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de4b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b16d0 0x7f0de016dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36616/0 (socket says 172.21.15.154:36616) 2023-10-10T21:17:53.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de4b9b700 1 -- 172.21.15.154:0/3519663489 learned_addr learned my addr 172.21.15.154:0/3519663489 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:53.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de4b9b700 1 -- 172.21.15.154:0/3519663489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00b4e70 msgr2=0x7f0de0146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de4b9b700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00b4e70 0x7f0de0146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de4b9b700 1 -- 172.21.15.154:0/3519663489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0de00b1b40 msgr2=0x7f0de00b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:53.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de4b9b700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0de00b1b40 0x7f0de00b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:53.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de4b9b700 1 -- 172.21.15.154:0/3519663489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd40094f0 con 0x7f0de00b16d0 2023-10-10T21:17:53.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.858+0000 7f0de4b9b700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b16d0 0x7f0de016dd50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0de0070dd0 tx=0x7f0dd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:53.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.859+0000 7f0ddcff9700 1 -- 172.21.15.154:0/3519663489 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4024440 con 0x7f0de00b16d0 2023-10-10T21:17:53.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.859+0000 7f0ddcff9700 1 -- 172.21.15.154:0/3519663489 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd40245c0 con 0x7f0de00b16d0 2023-10-10T21:17:53.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.859+0000 7f0ddcff9700 1 -- 172.21.15.154:0/3519663489 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4024980 con 0x7f0de00b16d0 2023-10-10T21:17:53.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.859+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de00c9840 con 0x7f0de00b16d0 2023-10-10T21:17:53.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.859+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de00c9e00 con 0x7f0de00b16d0 2023-10-10T21:17:53.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.860+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de0088990 con 0x7f0de00b16d0 2023-10-10T21:17:53.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.860+0000 7f0ddcff9700 1 -- 172.21.15.154:0/3519663489 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0dd401a420 con 0x7f0de00b16d0 2023-10-10T21:17:53.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.861+0000 7f0ddcff9700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc4066f30 0x7f0dc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:53.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.861+0000 7f0ddcff9700 1 -- 172.21.15.154:0/3519663489 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f0dd4086570 con 0x7f0de00b16d0 2023-10-10T21:17:53.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.862+0000 7f0ddffff700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc4066f30 0x7f0dc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:53.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.862+0000 7f0ddffff700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc4066f30 0x7f0dc40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0de00afb80 tx=0x7f0dcc007b70 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:53.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:53.865+0000 7f0ddcff9700 1 -- 172.21.15.154:0/3519663489 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dd4053680 con 0x7f0de00b16d0 2023-10-10T21:17:54.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.057+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f0de004bb80 con 0x7f0de00b16d0 2023-10-10T21:17:54.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.061+0000 7f0ddcff9700 1 -- 172.21.15.154:0/3519663489 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v27) v1 ==== 120+0+0 (secure 0 0 0) 0x7f0dd4056ca0 con 0x7f0de00b16d0 2023-10-10T21:17:54.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc4066f30 msgr2=0x7f0dc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:54.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc4066f30 0x7f0dc40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0de00afb80 tx=0x7f0dcc007b70 comp rx=0 tx=0).stop 2023-10-10T21:17:54.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b16d0 msgr2=0x7f0de016dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:54.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b16d0 0x7f0de016dd50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0de0070dd0 tx=0x7f0dd4017000 comp rx=0 tx=0).stop 2023-10-10T21:17:54.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 shutdown_connections 2023-10-10T21:17:54.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00b4e70 0x7f0de0146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0de00b16d0 0x7f0de016dd50 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0dc4066f30 0x7f0dc40693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 --2- 172.21.15.154:0/3519663489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0de00b1b40 0x7f0de00b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 >> 172.21.15.154:0/3519663489 conn(0x7f0de00d10c0 msgr2=0x7f0de0069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 shutdown_connections 2023-10-10T21:17:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.064+0000 7f0de5b9d700 1 -- 172.21.15.154:0/3519663489 wait complete. 2023-10-10T21:17:54.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-10T21:17:54.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.265+0000 7f1c9d9ff700 1 Processor -- start 2023-10-10T21:17:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.265+0000 7f1c9d9ff700 1 -- start start 2023-10-10T21:17:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.266+0000 7f1c9d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 0x7f1c980ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:54.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.266+0000 7f1c9d9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1c980ac770 0x7f1c980b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:54.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.266+0000 7f1c9d9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c980ad930 con 0x7f1c980ccc40 2023-10-10T21:17:54.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.266+0000 7f1c9d9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c980acd20 con 0x7f1c980ac770 2023-10-10T21:17:54.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.266+0000 7f1c9d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980ad000 con 0x7f1c980cd010 2023-10-10T21:17:54.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.267+0000 7f1c967fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 0x7f1c980ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:54.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.267+0000 7f1c96ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1c980ccc40 0x7f1c98155c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:40952/0 (socket says 172.21.15.154:40952) 2023-10-10T21:17:54.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.267+0000 7f1c96ffd700 1 -- 172.21.15.154:0/3186054734 learned_addr learned my addr 172.21.15.154:0/3186054734 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:54.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.267+0000 7f1c977fe700 1 --2- 172.21.15.154:0/3186054734 >> v2:172.21.15.179:3300/0 conn(0x7f1c980ac770 0x7f1c980b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:54.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c95ffb700 1 -- 172.21.15.154:0/3186054734 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194215500 0 0) 0x7f1c980ad930 con 0x7f1c980ccc40 2023-10-10T21:17:54.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c95ffb700 1 -- 172.21.15.154:0/3186054734 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c80003570 con 0x7f1c980ccc40 2023-10-10T21:17:54.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c977fe700 1 -- 172.21.15.154:0/3186054734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 msgr2=0x7f1c980ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:54.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c977fe700 1 --2- 172.21.15.154:0/3186054734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 0x7f1c980ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c977fe700 1 -- 172.21.15.154:0/3186054734 >> v1:172.21.15.179:6789/0 conn(0x7f1c980ccc40 legacy=0x7f1c98155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:54.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c977fe700 1 -- 172.21.15.154:0/3186054734 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c980ad2e0 con 0x7f1c980ac770 2023-10-10T21:17:54.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c967fc700 1 --2- 172.21.15.154:0/3186054734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 0x7f1c980ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:54.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c977fe700 1 --2- 172.21.15.154:0/3186054734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c980ac770 0x7f1c980b0300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009e60 tx=0x7f1c90009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66e2b5db40995415 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:54.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c95ffb700 1 -- 172.21.15.154:0/3186054734 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000e070 con 0x7f1c980ac770 2023-10-10T21:17:54.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c95ffb700 1 -- 172.21.15.154:0/3186054734 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9000bab0 con 0x7f1c980ac770 2023-10-10T21:17:54.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.268+0000 7f1c95ffb700 1 -- 172.21.15.154:0/3186054734 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000be70 con 0x7f1c980ac770 2023-10-10T21:17:54.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.269+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3186054734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c980ac770 msgr2=0x7f1c980b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:54.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.269+0000 7f1c9d9ff700 1 --2- 172.21.15.154:0/3186054734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c980ac770 0x7f1c980b0300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009e60 tx=0x7f1c90009780 comp rx=0 tx=0).stop 2023-10-10T21:17:54.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.269+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3186054734 shutdown_connections 2023-10-10T21:17:54.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.269+0000 7f1c9d9ff700 1 --2- 172.21.15.154:0/3186054734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c980ac770 0x7f1c980b0300 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.269+0000 7f1c9d9ff700 1 --2- 172.21.15.154:0/3186054734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 0x7f1c980ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.269+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3186054734 >> 172.21.15.154:0/3186054734 conn(0x7f1c9806a320 msgr2=0x7f1c980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:54.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.269+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3186054734 shutdown_connections 2023-10-10T21:17:54.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.269+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3186054734 wait complete. 2023-10-10T21:17:54.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.270+0000 7f1c9d9ff700 1 Processor -- start 2023-10-10T21:17:54.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.271+0000 7f1c9d9ff700 1 -- start start 2023-10-10T21:17:54.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.271+0000 7f1c9d9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c980ac770 0x7f1c9814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:54.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.271+0000 7f1c9d9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccc40 0x7f1c980cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:54.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.271+0000 7f1c9d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 0x7f1c980b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:54.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.271+0000 7f1c9d9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9816abd0 con 0x7f1c980ccc40 2023-10-10T21:17:54.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.271+0000 7f1c9d9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9816a050 con 0x7f1c980ac770 2023-10-10T21:17:54.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.271+0000 7f1c9d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9816a330 con 0x7f1c980cd010 2023-10-10T21:17:54.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c967fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccc40 0x7f1c980cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:54.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c967fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccc40 0x7f1c980cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36628/0 (socket says 172.21.15.154:36628) 2023-10-10T21:17:54.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c967fc700 1 -- 172.21.15.154:0/3180425552 learned_addr learned my addr 172.21.15.154:0/3180425552 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:54.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c977fe700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 0x7f1c980b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:54.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c96ffd700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c980ac770 0x7f1c9814afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:54.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c967fc700 1 -- 172.21.15.154:0/3180425552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 msgr2=0x7f1c980b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:54.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c967fc700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 0x7f1c980b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c967fc700 1 -- 172.21.15.154:0/3180425552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c980ac770 msgr2=0x7f1c9814afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:54.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c967fc700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c980ac770 0x7f1c9814afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c967fc700 1 -- 172.21.15.154:0/3180425552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c009420 con 0x7f1c980ccc40 2023-10-10T21:17:54.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.272+0000 7f1c967fc700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccc40 0x7f1c980cbb80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00ec80 tx=0x7f1c8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:54.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.273+0000 7f1c7effd700 1 -- 172.21.15.154:0/3180425552 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00c850 con 0x7f1c980ccc40 2023-10-10T21:17:54.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.273+0000 7f1c7effd700 1 -- 172.21.15.154:0/3180425552 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c00c9b0 con 0x7f1c980ccc40 2023-10-10T21:17:54.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.273+0000 7f1c7effd700 1 -- 172.21.15.154:0/3180425552 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00cd30 con 0x7f1c980ccc40 2023-10-10T21:17:54.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.273+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c90009a20 con 0x7f1c980ccc40 2023-10-10T21:17:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.273+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9816a8f0 con 0x7f1c980ccc40 2023-10-10T21:17:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.274+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9814b550 con 0x7f1c980ccc40 2023-10-10T21:17:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.275+0000 7f1c7effd700 1 -- 172.21.15.154:0/3180425552 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c8c013680 con 0x7f1c980ccc40 2023-10-10T21:17:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.276+0000 7f1c7effd700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c84066f30 0x7f1c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.276+0000 7f1c7effd700 1 -- 172.21.15.154:0/3180425552 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f1c8c084870 con 0x7f1c980ccc40 2023-10-10T21:17:54.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.276+0000 7f1c96ffd700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c84066f30 0x7f1c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:54.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.277+0000 7f1c96ffd700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c84066f30 0x7f1c840693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c88007fd0 tx=0x7f1c88009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:54.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.280+0000 7f1c7effd700 1 -- 172.21.15.154:0/3180425552 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c8c055410 con 0x7f1c980ccc40 2023-10-10T21:17:54.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.546+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f1c9804c3c0 con 0x7f1c980ccc40 2023-10-10T21:17:54.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.799+0000 7f1c7effd700 1 -- 172.21.15.154:0/3180425552 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v575) v1 ==== 156+0+0 (secure 0 0 0) 0x7f1c8c054fa0 con 0x7f1c980ccc40 2023-10-10T21:17:54.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c84066f30 msgr2=0x7f1c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:54.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c84066f30 0x7f1c840693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c88007fd0 tx=0x7f1c88009040 comp rx=0 tx=0).stop 2023-10-10T21:17:54.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccc40 msgr2=0x7f1c980cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:54.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccc40 0x7f1c980cbb80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00ec80 tx=0x7f1c8c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 shutdown_connections 2023-10-10T21:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980cd010 0x7f1c980b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c84066f30 0x7f1c840693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c980ac770 0x7f1c9814afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 --2- 172.21.15.154:0/3180425552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccc40 0x7f1c980cbb80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 >> 172.21.15.154:0/3180425552 conn(0x7f1c9806a320 msgr2=0x7f1c9806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:54.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.802+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 shutdown_connections 2023-10-10T21:17:54.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:54.803+0000 7f1c9d9ff700 1 -- 172.21.15.154:0/3180425552 wait complete. 2023-10-10T21:17:54.821 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-10-10T21:17:54.822 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-10-10T21:17:54.822 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T21:17:54.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-10T21:17:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.004+0000 7f69343ff700 1 Processor -- start 2023-10-10T21:17:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.004+0000 7f69343ff700 1 -- start start 2023-10-10T21:17:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f69343ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f692c0cbf30 0x7f692c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f69343ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c0cc300 con 0x7f692c0b1420 2023-10-10T21:17:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f69343ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c0ad370 con 0x7f692c0ccf90 2023-10-10T21:17:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f69343ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c156bf0 con 0x7f692c0cbf30 2023-10-10T21:17:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f693219b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f692c0cbf30 0x7f692c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f693299c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f692c0b1420 0x7f692c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36786/0 (socket says 172.21.15.154:36786) 2023-10-10T21:17:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f693299c700 1 -- 172.21.15.154:0/1727908182 learned_addr learned my addr 172.21.15.154:0/1727908182 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f693219b700 1 -- 172.21.15.154:0/1727908182 >> v1:172.21.15.179:6789/0 conn(0x7f692c0ccf90 legacy=0x7f692c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f693219b700 1 -- 172.21.15.154:0/1727908182 >> v1:172.21.15.154:6789/0 conn(0x7f692c0b1420 legacy=0x7f692c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.006+0000 7f693219b700 1 -- 172.21.15.154:0/1727908182 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c0ad650 con 0x7f692c0cbf30 2023-10-10T21:17:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.007+0000 7f693219b700 1 --2- 172.21.15.154:0/1727908182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 0x7f692c0ae410 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f69280098e0 tx=0x7f69280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c0805d2d566fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.007+0000 7f6931199700 1 -- 172.21.15.154:0/1727908182 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928009e80 con 0x7f692c0cbf30 2023-10-10T21:17:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.007+0000 7f6931199700 1 -- 172.21.15.154:0/1727908182 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692800b860 con 0x7f692c0cbf30 2023-10-10T21:17:55.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.007+0000 7f6931199700 1 -- 172.21.15.154:0/1727908182 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692800bbe0 con 0x7f692c0cbf30 2023-10-10T21:17:55.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.007+0000 7f69343ff700 1 -- 172.21.15.154:0/1727908182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 msgr2=0x7f692c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:55.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.007+0000 7f69343ff700 1 --2- 172.21.15.154:0/1727908182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 0x7f692c0ae410 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f69280098e0 tx=0x7f69280091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:55.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.008+0000 7f69343ff700 1 -- 172.21.15.154:0/1727908182 shutdown_connections 2023-10-10T21:17:55.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.008+0000 7f69343ff700 1 --2- 172.21.15.154:0/1727908182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 0x7f692c0ae410 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.008+0000 7f69343ff700 1 -- 172.21.15.154:0/1727908182 >> 172.21.15.154:0/1727908182 conn(0x7f692c06a320 msgr2=0x7f692c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.008+0000 7f69343ff700 1 -- 172.21.15.154:0/1727908182 shutdown_connections 2023-10-10T21:17:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.008+0000 7f69343ff700 1 -- 172.21.15.154:0/1727908182 wait complete. 2023-10-10T21:17:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.009+0000 7f69343ff700 1 Processor -- start 2023-10-10T21:17:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.009+0000 7f69343ff700 1 -- start start 2023-10-10T21:17:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f69343ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f692c0b1420 0x7f692c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f69343ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 0x7f692c167900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f69343ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692c0ccf90 0x7f692c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f69343ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c151970 con 0x7f692c0cbf30 2023-10-10T21:17:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f69343ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c15bbe0 con 0x7f692c0b1420 2023-10-10T21:17:55.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f69343ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c169010 con 0x7f692c0ccf90 2023-10-10T21:17:55.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f693199a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 0x7f692c167900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:55.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f693199a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 0x7f692c167900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36656/0 (socket says 172.21.15.154:36656) 2023-10-10T21:17:55.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f693219b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f692c0b1420 0x7f692c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:55.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f693199a700 1 -- 172.21.15.154:0/2827652172 learned_addr learned my addr 172.21.15.154:0/2827652172 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:55.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.010+0000 7f693299c700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692c0ccf90 0x7f692c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:55.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f693199a700 1 -- 172.21.15.154:0/2827652172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692c0ccf90 msgr2=0x7f692c153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:55.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f693199a700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692c0ccf90 0x7f692c153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:55.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f693199a700 1 -- 172.21.15.154:0/2827652172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f692c0b1420 msgr2=0x7f692c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:55.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f693199a700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f692c0b1420 0x7f692c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:55.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f693199a700 1 -- 172.21.15.154:0/2827652172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6928009420 con 0x7f692c0cbf30 2023-10-10T21:17:55.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f693219b700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f692c0b1420 0x7f692c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:55.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f693199a700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 0x7f692c167900 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c4e0 tx=0x7f691c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:55.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f69227fc700 1 -- 172.21.15.154:0/2827652172 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00cea0 con 0x7f692c0cbf30 2023-10-10T21:17:55.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f69227fc700 1 -- 172.21.15.154:0/2827652172 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c011590 con 0x7f692c0cbf30 2023-10-10T21:17:55.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f69227fc700 1 -- 172.21.15.154:0/2827652172 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011930 con 0x7f692c0cbf30 2023-10-10T21:17:55.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.011+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c168400 con 0x7f692c0cbf30 2023-10-10T21:17:55.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.012+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c1689c0 con 0x7f692c0cbf30 2023-10-10T21:17:55.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.013+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c169180 con 0x7f692c0cbf30 2023-10-10T21:17:55.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.013+0000 7f69227fc700 1 -- 172.21.15.154:0/2827652172 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f691c011d20 con 0x7f692c0cbf30 2023-10-10T21:17:55.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.014+0000 7f69227fc700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6910066f30 0x7f69100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:55.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.014+0000 7f69227fc700 1 -- 172.21.15.154:0/2827652172 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f691c0839a0 con 0x7f692c0cbf30 2023-10-10T21:17:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.014+0000 7f693219b700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6910066f30 0x7f69100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.015+0000 7f693219b700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6910066f30 0x7f69100693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f69280093f0 tx=0x7f6928017000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.019+0000 7f69227fc700 1 -- 172.21.15.154:0/2827652172 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f691c050ab0 con 0x7f692c0cbf30 2023-10-10T21:17:55.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.296+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f692c04c3c0 con 0x7f692c0cbf30 2023-10-10T21:17:55.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.802+0000 7f69227fc700 1 -- 172.21.15.154:0/2827652172 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v576) v1 ==== 169+0+0 (secure 0 0 0) 0x7f691c017070 con 0x7f692c0cbf30 2023-10-10T21:17:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6910066f30 msgr2=0x7f69100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6910066f30 0x7f69100693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f69280093f0 tx=0x7f6928017000 comp rx=0 tx=0).stop 2023-10-10T21:17:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 msgr2=0x7f692c167900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 0x7f692c167900 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c4e0 tx=0x7f691c00c7f0 comp rx=0 tx=0).stop 2023-10-10T21:17:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 shutdown_connections 2023-10-10T21:17:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692c0ccf90 0x7f692c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6910066f30 0x7f69100693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:55.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f692c0b1420 0x7f692c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:55.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 --2- 172.21.15.154:0/2827652172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c0cbf30 0x7f692c167900 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:55.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 >> 172.21.15.154:0/2827652172 conn(0x7f692c06a320 msgr2=0x7f692c0c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:55.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 shutdown_connections 2023-10-10T21:17:55.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:55.806+0000 7f69343ff700 1 -- 172.21.15.154:0/2827652172 wait complete. 2023-10-10T21:17:55.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T21:17:56.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.015+0000 7f411fdff700 1 Processor -- start 2023-10-10T21:17:56.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.015+0000 7f411fdff700 1 -- start start 2023-10-10T21:17:56.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.016+0000 7f411fdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4118069e80 0x7f41180c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.016+0000 7f411fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41180b0a70 0x7f41180c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.016+0000 7f411fdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41180af2f0 con 0x7f411815ac80 2023-10-10T21:17:56.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.016+0000 7f411fdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41180af5d0 con 0x7f4118069e80 2023-10-10T21:17:56.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.016+0000 7f411fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41180c8660 con 0x7f41180b0a70 2023-10-10T21:17:56.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411e39c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41180b0a70 0x7f41180c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411d39a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4118069e80 0x7f41180c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411e39c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41180b0a70 0x7f41180c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:41502/0 (socket says 172.21.15.154:41502) 2023-10-10T21:17:56.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411e39c700 1 -- 172.21.15.154:0/2876160625 learned_addr learned my addr 172.21.15.154:0/2876160625 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:56.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411db9b700 1 --1- 172.21.15.154:0/2876160625 >> v1:172.21.15.179:6789/0 conn(0x7f411815ac80 0x7f4118069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:51666/0 (socket says 172.21.15.154:51666) 2023-10-10T21:17:56.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411d39a700 1 -- 172.21.15.154:0/2876160625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41180b0a70 msgr2=0x7f41180c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:56.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411d39a700 1 --2- 172.21.15.154:0/2876160625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41180b0a70 0x7f41180c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411d39a700 1 -- 172.21.15.154:0/2876160625 >> v1:172.21.15.179:6789/0 conn(0x7f411815ac80 legacy=0x7f4118069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411d39a700 1 -- 172.21.15.154:0/2876160625 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41180c8940 con 0x7f4118069e80 2023-10-10T21:17:56.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.017+0000 7f411cb99700 1 -- 172.21.15.154:0/2876160625 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206744652 0 0) 0x7f41180af2f0 con 0x7f411815ac80 2023-10-10T21:17:56.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.018+0000 7f411e39c700 1 --2- 172.21.15.154:0/2876160625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41180b0a70 0x7f41180c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:56.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.018+0000 7f411d39a700 1 --2- 172.21.15.154:0/2876160625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4118069e80 0x7f41180c6b70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f41080098e0 tx=0x7f41080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0de4c7261637336 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:56.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.018+0000 7f411cb99700 1 -- 172.21.15.154:0/2876160625 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800b640 con 0x7f4118069e80 2023-10-10T21:17:56.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.018+0000 7f411cb99700 1 -- 172.21.15.154:0/2876160625 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410800b7a0 con 0x7f4118069e80 2023-10-10T21:17:56.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.018+0000 7f411cb99700 1 -- 172.21.15.154:0/2876160625 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800bb40 con 0x7f4118069e80 2023-10-10T21:17:56.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.019+0000 7f411fdff700 1 -- 172.21.15.154:0/2876160625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4118069e80 msgr2=0x7f41180c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.019+0000 7f411fdff700 1 --2- 172.21.15.154:0/2876160625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4118069e80 0x7f41180c6b70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f41080098e0 tx=0x7f41080091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.019+0000 7f411fdff700 1 -- 172.21.15.154:0/2876160625 shutdown_connections 2023-10-10T21:17:56.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.019+0000 7f411fdff700 1 --2- 172.21.15.154:0/2876160625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41180b0a70 0x7f41180c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.019+0000 7f411fdff700 1 --2- 172.21.15.154:0/2876160625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4118069e80 0x7f41180c6b70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.019+0000 7f411fdff700 1 -- 172.21.15.154:0/2876160625 >> 172.21.15.154:0/2876160625 conn(0x7f4118068e10 msgr2=0x7f41180cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:56.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.019+0000 7f411fdff700 1 -- 172.21.15.154:0/2876160625 shutdown_connections 2023-10-10T21:17:56.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.019+0000 7f411fdff700 1 -- 172.21.15.154:0/2876160625 wait complete. 2023-10-10T21:17:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.020+0000 7f411fdff700 1 Processor -- start 2023-10-10T21:17:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.020+0000 7f411fdff700 1 -- start start 2023-10-10T21:17:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.021+0000 7f411fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4118069e80 0x7f4118142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.021+0000 7f411fdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41180b0a70 0x7f41180b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.021+0000 7f411fdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411815ac80 0x7f41180b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.021+0000 7f411fdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41180ad5d0 con 0x7f411815ac80 2023-10-10T21:17:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.021+0000 7f411fdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41180ae130 con 0x7f41180b0a70 2023-10-10T21:17:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.021+0000 7f411fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411816e350 con 0x7f4118069e80 2023-10-10T21:17:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.021+0000 7f411e39c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411815ac80 0x7f41180b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411d39a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41180b0a70 0x7f41180b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411e39c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411815ac80 0x7f41180b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40772/0 (socket says 172.21.15.154:40772) 2023-10-10T21:17:56.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411e39c700 1 -- 172.21.15.154:0/963266433 learned_addr learned my addr 172.21.15.154:0/963266433 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:56.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411db9b700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4118069e80 0x7f4118142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411e39c700 1 -- 172.21.15.154:0/963266433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4118069e80 msgr2=0x7f4118142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411e39c700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4118069e80 0x7f4118142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411e39c700 1 -- 172.21.15.154:0/963266433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41180b0a70 msgr2=0x7f41180b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411e39c700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41180b0a70 0x7f41180b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411e39c700 1 -- 172.21.15.154:0/963266433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4110009ae0 con 0x7f411815ac80 2023-10-10T21:17:56.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411e39c700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411815ac80 0x7f41180b1e60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4110009fd0 tx=0x7f411000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:56.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f410dffb700 1 -- 172.21.15.154:0/963266433 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110018070 con 0x7f411815ac80 2023-10-10T21:17:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f410dffb700 1 -- 172.21.15.154:0/963266433 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000f040 con 0x7f411815ac80 2023-10-10T21:17:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.022+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4108009420 con 0x7f411815ac80 2023-10-10T21:17:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.023+0000 7f410dffb700 1 -- 172.21.15.154:0/963266433 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000cbd0 con 0x7f411815ac80 2023-10-10T21:17:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.023+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41180adae0 con 0x7f411815ac80 2023-10-10T21:17:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.024+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411804c3c0 con 0x7f411815ac80 2023-10-10T21:17:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.025+0000 7f410dffb700 1 -- 172.21.15.154:0/963266433 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4110003020 con 0x7f411815ac80 2023-10-10T21:17:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.025+0000 7f410dffb700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.025+0000 7f410dffb700 1 -- 172.21.15.154:0/963266433 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f41100844a0 con 0x7f411815ac80 2023-10-10T21:17:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.026+0000 7f411db9b700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.026+0000 7f411db9b700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4114007060 tx=0x7f4114007ef0 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.030+0000 7f410dffb700 1 -- 172.21.15.154:0/963266433 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f411004d5a0 con 0x7f411815ac80 2023-10-10T21:17:56.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.223+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f41180c8c90 con 0x7f411815ac80 2023-10-10T21:17:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.227+0000 7f410dffb700 1 -- 172.21.15.154:0/963266433 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4110051650 con 0x7f411815ac80 2023-10-10T21:17:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40fc066f30 msgr2=0x7f40fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4114007060 tx=0x7f4114007ef0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411815ac80 msgr2=0x7f41180b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411815ac80 0x7f41180b1e60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4110009fd0 tx=0x7f411000b040 comp rx=0 tx=0).stop 2023-10-10T21:17:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 shutdown_connections 2023-10-10T21:17:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f411815ac80 0x7f41180b1e60 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4118069e80 0x7f4118142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f40fc066f30 0x7f40fc0693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 --2- 172.21.15.154:0/963266433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41180b0a70 0x7f41180b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 >> 172.21.15.154:0/963266433 conn(0x7f4118068e10 msgr2=0x7f41180c2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 shutdown_connections 2023-10-10T21:17:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.230+0000 7f411fdff700 1 -- 172.21.15.154:0/963266433 wait complete. 2023-10-10T21:17:56.248 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:17:56.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:17:56.331 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:17:56.427 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:17:56.427 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T21:17:56.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:17:56.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.610+0000 7f72e25ff700 1 Processor -- start 2023-10-10T21:17:56.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.610+0000 7f72e25ff700 1 -- start start 2023-10-10T21:17:56.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.611+0000 7f72e25ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f72dc069560 0x7f72dc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.611+0000 7f72e25ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc069ee0 con 0x7f72dc159c60 2023-10-10T21:17:56.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72e25ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc15a160 con 0x7f72dc159890 2023-10-10T21:17:56.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72e25ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0d13a0 con 0x7f72dc069560 2023-10-10T21:17:56.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72db7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f72dc159c60 0x7f72dc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56622/0 (socket says 172.21.15.154:56622) 2023-10-10T21:17:56.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72db7fe700 1 -- 172.21.15.154:0/3078848374 learned_addr learned my addr 172.21.15.154:0/3078848374 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:56.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72e0b9c700 1 --2- 172.21.15.154:0/3078848374 >> v2:172.21.15.179:3300/0 conn(0x7f72dc069560 0x7f72dc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72daffd700 1 -- 172.21.15.154:0/3078848374 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193218387 0 0) 0x7f72dc069ee0 con 0x7f72dc159c60 2023-10-10T21:17:56.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72daffd700 1 -- 172.21.15.154:0/3078848374 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c4003570 con 0x7f72dc159c60 2023-10-10T21:17:56.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72e0b9c700 1 -- 172.21.15.154:0/3078848374 >> v1:172.21.15.179:6789/0 conn(0x7f72dc159890 legacy=0x7f72dc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72daffd700 1 -- 172.21.15.154:0/3078848374 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429780907 0 0) 0x7f72dc15a160 con 0x7f72dc159890 2023-10-10T21:17:56.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72e0b9c700 1 -- 172.21.15.154:0/3078848374 >> v1:172.21.15.154:6789/0 conn(0x7f72dc159c60 legacy=0x7f72dc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.612+0000 7f72e0b9c700 1 -- 172.21.15.154:0/3078848374 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc15e140 con 0x7f72dc069560 2023-10-10T21:17:56.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.613+0000 7f72e0b9c700 1 --2- 172.21.15.154:0/3078848374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72dc069560 0x7f72dc0699a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009e60 tx=0x7f72d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2a6e9b18dea19b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:56.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.613+0000 7f72daffd700 1 -- 172.21.15.154:0/3078848374 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400e070 con 0x7f72dc069560 2023-10-10T21:17:56.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.613+0000 7f72daffd700 1 -- 172.21.15.154:0/3078848374 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d400bb60 con 0x7f72dc069560 2023-10-10T21:17:56.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.613+0000 7f72daffd700 1 -- 172.21.15.154:0/3078848374 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4012430 con 0x7f72dc069560 2023-10-10T21:17:56.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.613+0000 7f72e25ff700 1 -- 172.21.15.154:0/3078848374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72dc069560 msgr2=0x7f72dc0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.613+0000 7f72e25ff700 1 --2- 172.21.15.154:0/3078848374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72dc069560 0x7f72dc0699a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009e60 tx=0x7f72d4009780 comp rx=0 tx=0).stop 2023-10-10T21:17:56.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.614+0000 7f72e25ff700 1 -- 172.21.15.154:0/3078848374 shutdown_connections 2023-10-10T21:17:56.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.614+0000 7f72e25ff700 1 --2- 172.21.15.154:0/3078848374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72dc069560 0x7f72dc0699a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.614+0000 7f72e25ff700 1 -- 172.21.15.154:0/3078848374 >> 172.21.15.154:0/3078848374 conn(0x7f72dc068e20 msgr2=0x7f72dc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.614+0000 7f72e25ff700 1 -- 172.21.15.154:0/3078848374 shutdown_connections 2023-10-10T21:17:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.614+0000 7f72e25ff700 1 -- 172.21.15.154:0/3078848374 wait complete. 2023-10-10T21:17:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.615+0000 7f72e25ff700 1 Processor -- start 2023-10-10T21:17:56.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.615+0000 7f72e25ff700 1 -- start start 2023-10-10T21:17:56.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.616+0000 7f72e25ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc069560 0x7f72dc0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.616+0000 7f72e25ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72dc159890 0x7f72dc154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.616+0000 7f72e25ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72dc159c60 0x7f72dc169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.616+0000 7f72e25ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0ce3b0 con 0x7f72dc069560 2023-10-10T21:17:56.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.616+0000 7f72e25ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0ce690 con 0x7f72dc159890 2023-10-10T21:17:56.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.616+0000 7f72e25ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0ce970 con 0x7f72dc159c60 2023-10-10T21:17:56.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.616+0000 7f72dbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc069560 0x7f72dc0b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.616+0000 7f72dbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc069560 0x7f72dc0b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40782/0 (socket says 172.21.15.154:40782) 2023-10-10T21:17:56.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.616+0000 7f72dbfff700 1 -- 172.21.15.154:0/3347197509 learned_addr learned my addr 172.21.15.154:0/3347197509 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:56.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72db7fe700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72dc159890 0x7f72dc154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72e0b9c700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72dc159c60 0x7f72dc169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72dbfff700 1 -- 172.21.15.154:0/3347197509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72dc159c60 msgr2=0x7f72dc169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72dbfff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72dc159c60 0x7f72dc169ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72dbfff700 1 -- 172.21.15.154:0/3347197509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72dc159890 msgr2=0x7f72dc154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72dbfff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72dc159890 0x7f72dc154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72dbfff700 1 -- 172.21.15.154:0/3347197509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4009a20 con 0x7f72dc069560 2023-10-10T21:17:56.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72dbfff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc069560 0x7f72dc0b5eb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c7e0 tx=0x7f72cc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:56.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72c3fff700 1 -- 172.21.15.154:0/3347197509 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc012700 con 0x7f72dc069560 2023-10-10T21:17:56.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72c3fff700 1 -- 172.21.15.154:0/3347197509 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc012880 con 0x7f72dc069560 2023-10-10T21:17:56.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc0cec50 con 0x7f72dc069560 2023-10-10T21:17:56.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72c3fff700 1 -- 172.21.15.154:0/3347197509 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc012c40 con 0x7f72dc069560 2023-10-10T21:17:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.617+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc0b63f0 con 0x7f72dc069560 2023-10-10T21:17:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.618+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc0cf170 con 0x7f72dc069560 2023-10-10T21:17:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.619+0000 7f72c3fff700 1 -- 172.21.15.154:0/3347197509 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72cc01b400 con 0x7f72dc069560 2023-10-10T21:17:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.620+0000 7f72c3fff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f72c8066f30 0x7f72c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.620+0000 7f72c3fff700 1 -- 172.21.15.154:0/3347197509 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f72cc084270 con 0x7f72dc069560 2023-10-10T21:17:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.620+0000 7f72db7fe700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f72c8066f30 0x7f72c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.621+0000 7f72db7fe700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f72c8066f30 0x7f72c80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b3640 tx=0x7f72d0009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:56.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.624+0000 7f72c3fff700 1 -- 172.21.15.154:0/3347197509 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72cc051380 con 0x7f72dc069560 2023-10-10T21:17:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.861+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72dc04c3c0 con 0x7f72dc069560 2023-10-10T21:17:56.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.862+0000 7f72c3fff700 1 -- 172.21.15.154:0/3347197509 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f72cc0549a0 con 0x7f72dc069560 2023-10-10T21:17:56.863 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:56.864 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5573,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/209340130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":209340130},{"type":"v1","addr":"172.21.15.179:6834","nonce":209340130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3372685755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3372685755},{"type":"v1","addr":"172.21.15.154:6835","nonce":3372685755}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1909692066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1909692066},{"type":"v1","addr":"172.21.15.154:6837","nonce":1909692066}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6361,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1826817931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1826817931},{"type":"v1","addr":"172.21.15.179:6835","nonce":1826817931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2023-10-10T21:17:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f72c8066f30 msgr2=0x7f72c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f72c8066f30 0x7f72c80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b3640 tx=0x7f72d0009040 comp rx=0 tx=0).stop 2023-10-10T21:17:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc069560 msgr2=0x7f72dc0b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc069560 0x7f72dc0b5eb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c7e0 tx=0x7f72cc007df0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 shutdown_connections 2023-10-10T21:17:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72dc159c60 0x7f72dc169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc069560 0x7f72dc0b5eb0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f72c8066f30 0x7f72c80693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 --2- 172.21.15.154:0/3347197509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72dc159890 0x7f72dc154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 >> 172.21.15.154:0/3347197509 conn(0x7f72dc068e20 msgr2=0x7f72dc0c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:56.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 shutdown_connections 2023-10-10T21:17:56.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:56.864+0000 7f72e25ff700 1 -- 172.21.15.154:0/3347197509 wait complete. 2023-10-10T21:17:56.868 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 32 2023-10-10T21:17:56.883 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T21:17:56.883 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T21:17:56.883 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T21:17:56.884 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:17:56.884 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T21:17:56.884 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T21:17:56.885 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T21:17:56.885 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:17:56.885 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T21:17:56.885 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T21:17:56.886 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T21:17:56.886 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:17:56.886 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T21:17:56.887 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T21:17:56.887 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T21:17:56.887 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:17:56.901 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T21:17:56.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T21:17:56.902 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T21:17:56.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T21:17:56.903 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T21:17:56.904 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T21:17:56.905 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T21:17:56.905 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T21:17:56.945 INFO:tasks.ceph.mds.a:Started 2023-10-10T21:17:56.946 DEBUG:teuthology.parallel:result is None 2023-10-10T21:17:56.948 INFO:tasks.ceph.mds.b:Started 2023-10-10T21:17:56.948 DEBUG:teuthology.parallel:result is None 2023-10-10T21:17:56.949 INFO:tasks.ceph.mds.c:Started 2023-10-10T21:17:56.949 DEBUG:teuthology.parallel:result is None 2023-10-10T21:17:56.950 INFO:tasks.ceph.mds.d:Started 2023-10-10T21:17:56.951 DEBUG:teuthology.parallel:result is None 2023-10-10T21:17:56.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T21:17:57.082 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:17:57.083 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:17:57.089 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T21:17:57.091 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:17:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.145+0000 7f3067bff700 1 Processor -- start 2023-10-10T21:17:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.146+0000 7f3067bff700 1 -- start start 2023-10-10T21:17:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.147+0000 7f3067bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3060159890 0x7f306015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.147+0000 7f3067bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3060069560 0x7f30600699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.147+0000 7f3067bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3060069ee0 con 0x7f3060159c60 2023-10-10T21:17:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.147+0000 7f3067bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306015a160 con 0x7f3060069560 2023-10-10T21:17:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.147+0000 7f3067bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30600d13a0 con 0x7f3060159890 2023-10-10T21:17:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.147+0000 7f306619c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3060069560 0x7f30600699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.147+0000 7f306619c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3060069560 0x7f30600699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40826/0 (socket says 172.21.15.154:40826) 2023-10-10T21:17:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.147+0000 7f306619c700 1 -- 172.21.15.154:0/2427874118 learned_addr learned my addr 172.21.15.154:0/2427874118 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.147+0000 7f306599b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3060159890 0x7f306015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.148+0000 7f306619c700 1 -- 172.21.15.154:0/2427874118 >> v2:172.21.15.179:3300/0 conn(0x7f3060159890 msgr2=0x7f306015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.148+0000 7f306619c700 1 --2- 172.21.15.154:0/2427874118 >> v2:172.21.15.179:3300/0 conn(0x7f3060159890 0x7f306015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.148+0000 7f306619c700 1 -- 172.21.15.154:0/2427874118 >> v1:172.21.15.179:6789/0 conn(0x7f3060159c60 legacy=0x7f306015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.148+0000 7f306619c700 1 -- 172.21.15.154:0/2427874118 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306015e140 con 0x7f3060069560 2023-10-10T21:17:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.148+0000 7f306619c700 1 --2- 172.21.15.154:0/2427874118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 0x7f30600699a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f30600d1090 tx=0x7f3058009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bd5dbf83b7daec server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.148+0000 7f3064999700 1 -- 172.21.15.154:0/2427874118 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800e070 con 0x7f3060069560 2023-10-10T21:17:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.148+0000 7f3064999700 1 -- 172.21.15.154:0/2427874118 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800ba20 con 0x7f3060069560 2023-10-10T21:17:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.148+0000 7f3064999700 1 -- 172.21.15.154:0/2427874118 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580092e0 con 0x7f3060069560 2023-10-10T21:17:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.149+0000 7f3067bff700 1 -- 172.21.15.154:0/2427874118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 msgr2=0x7f30600699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.149+0000 7f3067bff700 1 --2- 172.21.15.154:0/2427874118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 0x7f30600699a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f30600d1090 tx=0x7f3058009840 comp rx=0 tx=0).stop 2023-10-10T21:17:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.149+0000 7f3067bff700 1 -- 172.21.15.154:0/2427874118 shutdown_connections 2023-10-10T21:17:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.149+0000 7f3067bff700 1 --2- 172.21.15.154:0/2427874118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 0x7f30600699a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.149+0000 7f3067bff700 1 --2- 172.21.15.154:0/2427874118 >> v2:172.21.15.179:3300/0 conn(0x7f3060159890 0x7f306015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:57.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.149+0000 7f3067bff700 1 -- 172.21.15.154:0/2427874118 >> 172.21.15.154:0/2427874118 conn(0x7f3060068e20 msgr2=0x7f30600d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.149+0000 7f3067bff700 1 -- 172.21.15.154:0/2427874118 shutdown_connections 2023-10-10T21:17:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.149+0000 7f3067bff700 1 -- 172.21.15.154:0/2427874118 wait complete. 2023-10-10T21:17:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.150+0000 7f3067bff700 1 Processor -- start 2023-10-10T21:17:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.150+0000 7f3067bff700 1 -- start start 2023-10-10T21:17:57.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.151+0000 7f3067bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 0x7f30600b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.151+0000 7f3067bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3060159890 0x7f30600b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.151+0000 7f3067bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3060159c60 0x7f30600c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.151+0000 7f3067bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30600b6270 con 0x7f3060069560 2023-10-10T21:17:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.151+0000 7f3067bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306016d270 con 0x7f3060159c60 2023-10-10T21:17:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.151+0000 7f3067bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306016d550 con 0x7f3060159890 2023-10-10T21:17:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.151+0000 7f306599b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 0x7f30600b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306599b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 0x7f30600b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40828/0 (socket says 172.21.15.154:40828) 2023-10-10T21:17:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306599b700 1 -- 172.21.15.154:0/3488198287 learned_addr learned my addr 172.21.15.154:0/3488198287 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306519a700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3060159890 0x7f30600b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306619c700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3060159c60 0x7f30600c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306599b700 1 -- 172.21.15.154:0/3488198287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3060159890 msgr2=0x7f30600b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306599b700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3060159890 0x7f30600b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306599b700 1 -- 172.21.15.154:0/3488198287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3060159c60 msgr2=0x7f30600c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306599b700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3060159c60 0x7f30600c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306599b700 1 -- 172.21.15.154:0/3488198287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058009ae0 con 0x7f3060069560 2023-10-10T21:17:57.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306619c700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3060159c60 0x7f30600c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:17:57.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f306599b700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 0x7f30600b5bf0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f305c00ec80 tx=0x7f305c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:57.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f3055ffb700 1 -- 172.21.15.154:0/3488198287 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00c850 con 0x7f3060069560 2023-10-10T21:17:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f3055ffb700 1 -- 172.21.15.154:0/3488198287 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00c9b0 con 0x7f3060069560 2023-10-10T21:17:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f3055ffb700 1 -- 172.21.15.154:0/3488198287 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00cd50 con 0x7f3060069560 2023-10-10T21:17:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.152+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306016d830 con 0x7f3060069560 2023-10-10T21:17:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.153+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30600b46c0 con 0x7f3060069560 2023-10-10T21:17:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.154+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306016de80 con 0x7f3060069560 2023-10-10T21:17:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.154+0000 7f3055ffb700 1 -- 172.21.15.154:0/3488198287 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f305c013680 con 0x7f3060069560 2023-10-10T21:17:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.155+0000 7f3055ffb700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3044066f30 0x7f30440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.155+0000 7f3055ffb700 1 -- 172.21.15.154:0/3488198287 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f305c084950 con 0x7f3060069560 2023-10-10T21:17:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.156+0000 7f306519a700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3044066f30 0x7f30440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.156+0000 7f306519a700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3044066f30 0x7f30440693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3060153660 tx=0x7f3050007ec0 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.159+0000 7f3055ffb700 1 -- 172.21.15.154:0/3488198287 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f305c051a60 con 0x7f3060069560 2023-10-10T21:17:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:57.369+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f306004c3c0 con 0x7f3060069560 2023-10-10T21:17:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.251+0000 7f3055ffb700 1 -- 172.21.15.154:0/3488198287 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v91) v1 ==== 97+0+0 (secure 0 0 0) 0x7f305c055080 con 0x7f3060069560 2023-10-10T21:17:58.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3044066f30 msgr2=0x7f30440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3044066f30 0x7f30440693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3060153660 tx=0x7f3050007ec0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 msgr2=0x7f30600b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 0x7f30600b5bf0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f305c00ec80 tx=0x7f305c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 shutdown_connections 2023-10-10T21:17:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3044066f30 0x7f30440693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3060159c60 0x7f30600c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3060069560 0x7f30600b5bf0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 --2- 172.21.15.154:0/3488198287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3060159890 0x7f30600b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 >> 172.21.15.154:0/3488198287 conn(0x7f3060068e20 msgr2=0x7f306014d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 shutdown_connections 2023-10-10T21:17:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.255+0000 7f3067bff700 1 -- 172.21.15.154:0/3488198287 wait complete. 2023-10-10T21:17:58.259 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T21:17:58.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T21:17:58.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.465+0000 7f35c119d700 1 Processor -- start 2023-10-10T21:17:58.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.465+0000 7f35c119d700 1 -- start start 2023-10-10T21:17:58.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.466+0000 7f35c119d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc1566e0 0x7f35bc0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.466+0000 7f35c119d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc0ca860 con 0x7f35bc0cb900 2023-10-10T21:17:58.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.466+0000 7f35c119d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc0cab40 con 0x7f35bc156310 2023-10-10T21:17:58.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.466+0000 7f35c119d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0cae20 con 0x7f35bc1566e0 2023-10-10T21:17:58.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35c099c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f35bc0cb900 0x7f35bc0c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56632/0 (socket says 172.21.15.154:56632) 2023-10-10T21:17:58.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35c099c700 1 -- 172.21.15.154:0/3703325250 learned_addr learned my addr 172.21.15.154:0/3703325250 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:58.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35bb7fe700 1 --2- 172.21.15.154:0/3703325250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc1566e0 0x7f35bc0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:58.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35baffd700 1 -- 172.21.15.154:0/3703325250 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784947130 0 0) 0x7f35bc0ca860 con 0x7f35bc0cb900 2023-10-10T21:17:58.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35baffd700 1 -- 172.21.15.154:0/3703325250 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a4003570 con 0x7f35bc0cb900 2023-10-10T21:17:58.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35baffd700 1 -- 172.21.15.154:0/3703325250 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499405895 0 0) 0x7f35bc0cab40 con 0x7f35bc156310 2023-10-10T21:17:58.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35baffd700 1 -- 172.21.15.154:0/3703325250 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35bc0ca860 con 0x7f35bc156310 2023-10-10T21:17:58.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35bb7fe700 1 -- 172.21.15.154:0/3703325250 >> v1:172.21.15.179:6789/0 conn(0x7f35bc156310 legacy=0x7f35bc0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35bb7fe700 1 -- 172.21.15.154:0/3703325250 >> v1:172.21.15.154:6789/0 conn(0x7f35bc0cb900 legacy=0x7f35bc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35bb7fe700 1 -- 172.21.15.154:0/3703325250 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0cb100 con 0x7f35bc1566e0 2023-10-10T21:17:58.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.467+0000 7f35bb7fe700 1 --2- 172.21.15.154:0/3703325250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc1566e0 0x7f35bc0ae000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009910 tx=0x7f35b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab141cc83e8d667c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:58.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35baffd700 1 -- 172.21.15.154:0/3703325250 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0011630 con 0x7f35bc1566e0 2023-10-10T21:17:58.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35baffd700 1 -- 172.21.15.154:0/3703325250 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0011790 con 0x7f35bc1566e0 2023-10-10T21:17:58.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35baffd700 1 -- 172.21.15.154:0/3703325250 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0011b10 con 0x7f35bc1566e0 2023-10-10T21:17:58.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35c119d700 1 -- 172.21.15.154:0/3703325250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc1566e0 msgr2=0x7f35bc0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35c119d700 1 --2- 172.21.15.154:0/3703325250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc1566e0 0x7f35bc0ae000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009910 tx=0x7f35b00091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35c119d700 1 -- 172.21.15.154:0/3703325250 shutdown_connections 2023-10-10T21:17:58.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35c119d700 1 --2- 172.21.15.154:0/3703325250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc1566e0 0x7f35bc0ae000 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35c119d700 1 -- 172.21.15.154:0/3703325250 >> 172.21.15.154:0/3703325250 conn(0x7f35bc0cc1f0 msgr2=0x7f35bc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:58.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35c119d700 1 -- 172.21.15.154:0/3703325250 shutdown_connections 2023-10-10T21:17:58.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.468+0000 7f35c119d700 1 -- 172.21.15.154:0/3703325250 wait complete. 2023-10-10T21:17:58.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.470+0000 7f35c119d700 1 Processor -- start 2023-10-10T21:17:58.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.470+0000 7f35c119d700 1 -- start start 2023-10-10T21:17:58.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35c119d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35bc0cb900 0x7f35bc15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35c119d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc156310 0x7f35bc1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35c119d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35bc1566e0 0x7f35bc1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35c119d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc152f30 con 0x7f35bc0cb900 2023-10-10T21:17:58.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35c119d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc15b980 con 0x7f35bc1566e0 2023-10-10T21:17:58.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35c119d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc15ad70 con 0x7f35bc156310 2023-10-10T21:17:58.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35bc0cb900 0x7f35bc15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:58.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35bc0cb900 0x7f35bc15c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40832/0 (socket says 172.21.15.154:40832) 2023-10-10T21:17:58.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35bbfff700 1 -- 172.21.15.154:0/1448283166 learned_addr learned my addr 172.21.15.154:0/1448283166 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:58.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35bb7fe700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc156310 0x7f35bc1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:58.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35c099c700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35bc1566e0 0x7f35bc1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:58.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35bbfff700 1 -- 172.21.15.154:0/1448283166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc156310 msgr2=0x7f35bc1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35bbfff700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc156310 0x7f35bc1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35bbfff700 1 -- 172.21.15.154:0/1448283166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35bc1566e0 msgr2=0x7f35bc1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.471+0000 7f35bbfff700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35bc1566e0 0x7f35bc1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.472+0000 7f35bbfff700 1 -- 172.21.15.154:0/1448283166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0009420 con 0x7f35bc0cb900 2023-10-10T21:17:58.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.472+0000 7f35c099c700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35bc1566e0 0x7f35bc1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:17:58.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.472+0000 7f35bbfff700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35bc0cb900 0x7f35bc15c8e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00c7c0 tx=0x7f35ac007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:58.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.472+0000 7f35a3fff700 1 -- 172.21.15.154:0/1448283166 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac010510 con 0x7f35bc0cb900 2023-10-10T21:17:58.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.472+0000 7f35a3fff700 1 -- 172.21.15.154:0/1448283166 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac010670 con 0x7f35bc0cb900 2023-10-10T21:17:58.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.472+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc15b050 con 0x7f35bc0cb900 2023-10-10T21:17:58.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.472+0000 7f35a3fff700 1 -- 172.21.15.154:0/1448283166 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac010a30 con 0x7f35bc0cb900 2023-10-10T21:17:58.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.472+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc15b610 con 0x7f35bc0cb900 2023-10-10T21:17:58.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.473+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35bc04c3c0 con 0x7f35bc0cb900 2023-10-10T21:17:58.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.474+0000 7f35a3fff700 1 -- 172.21.15.154:0/1448283166 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35ac01b400 con 0x7f35bc0cb900 2023-10-10T21:17:58.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.475+0000 7f35a3fff700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f35a8066f30 0x7f35a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.475+0000 7f35a3fff700 1 -- 172.21.15.154:0/1448283166 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f35ac0840a0 con 0x7f35bc0cb900 2023-10-10T21:17:58.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.475+0000 7f35bb7fe700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f35a8066f30 0x7f35a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:58.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.476+0000 7f35bb7fe700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f35a8066f30 0x7f35a80693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009910 tx=0x7f35b0017000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:58.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.479+0000 7f35a3fff700 1 -- 172.21.15.154:0/1448283166 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35ac051440 con 0x7f35bc0cb900 2023-10-10T21:17:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.745+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f35bc0cd0b0 con 0x7f35bc0cb900 2023-10-10T21:17:58.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.746+0000 7f35a3fff700 1 -- 172.21.15.154:0/1448283166 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f35ac054a60 con 0x7f35bc0cb900 2023-10-10T21:17:58.747 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:58.748 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:17:58.748 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T21:17:58.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.748 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T21:17:58.748 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T21:17:58.749 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.749 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:58.749 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:58.749 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:58.749 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.750 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T21:17:58.750 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T21:17:58.750 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.751 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:58.751 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:58.751 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:58.751 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.751 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.752 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T21:17:58.752 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T21:17:58.752 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.752 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:58.753 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:58.753 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:58.753 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.754 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T21:17:58.754 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T21:17:58.754 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.754 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.756 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T21:17:58.756 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T21:17:58.756 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.756 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:58.756 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:58.757 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.757 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.757 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T21:17:58.757 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T21:17:58.758 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.758 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:58.758 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:58.758 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.758 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.759 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T21:17:58.759 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T21:17:58.759 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.760 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:58.760 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:58.760 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.760 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.761 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T21:17:58.761 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T21:17:58.761 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.761 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:58.761 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:58.762 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.762 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T21:17:58.762 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T21:17:58.763 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.763 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:58.763 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:58.763 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.763 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.764 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T21:17:58.764 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T21:17:58.764 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.764 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:58.765 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:58.765 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.766 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T21:17:58.766 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T21:17:58.766 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.766 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:58.766 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:58.766 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.767 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.767 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T21:17:58.767 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T21:17:58.768 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.768 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:17:58.768 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:17:58.768 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.768 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.769 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T21:17:58.769 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T21:17:58.769 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.769 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:58.770 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T21:17:58.770 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T21:17:58.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.771 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T21:17:58.771 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T21:17:58.771 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.771 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:58.771 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:17:58.772 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:17:58.772 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:17:58.772 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.772 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T21:17:58.773 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T21:17:58.773 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.773 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:58.773 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:17:58.773 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:17:58.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:17:58.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.774 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T21:17:58.775 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T21:17:58.775 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.775 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:17:58.775 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:17:58.775 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:17:58.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:17:58.776 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.776 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T21:17:58.776 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T21:17:58.777 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.777 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:17:58.777 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:17:58.777 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:17:58.777 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.777 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.778 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T21:17:58.778 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T21:17:58.778 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.779 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:17:58.779 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:17:58.779 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:17:58.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:17:58.780 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T21:17:58.780 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T21:17:58.780 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:17:58.780 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:17:58.780 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:17:58.781 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:17:58.781 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.781 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:17:58.781 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T21:17:58.781 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:17:58.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f35a8066f30 msgr2=0x7f35a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f35a8066f30 0x7f35a80693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009910 tx=0x7f35b0017000 comp rx=0 tx=0).stop 2023-10-10T21:17:58.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35bc0cb900 msgr2=0x7f35bc15c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35bc0cb900 0x7f35bc15c8e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00c7c0 tx=0x7f35ac007dc0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 shutdown_connections 2023-10-10T21:17:58.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f35a8066f30 0x7f35a80693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35bc1566e0 0x7f35bc1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35bc0cb900 0x7f35bc15c8e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 --2- 172.21.15.154:0/1448283166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35bc156310 0x7f35bc1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 >> 172.21.15.154:0/1448283166 conn(0x7f35bc0cc1f0 msgr2=0x7f35bc154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:58.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 shutdown_connections 2023-10-10T21:17:58.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.748+0000 7f35c119d700 1 -- 172.21.15.154:0/1448283166 wait complete. 2023-10-10T21:17:58.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:17:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.968+0000 7ff575b9d700 1 Processor -- start 2023-10-10T21:17:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.968+0000 7ff575b9d700 1 -- start start 2023-10-10T21:17:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.969+0000 7ff575b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5701597f0 0x7ff5700b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.969+0000 7ff575b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57015d230 0x7ff57015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.969+0000 7ff575b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57015dbb0 con 0x7ff570159420 2023-10-10T21:17:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.969+0000 7ff575b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5700b11d0 con 0x7ff5701597f0 2023-10-10T21:17:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.969+0000 7ff575b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700b14b0 con 0x7ff57015d230 2023-10-10T21:17:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.969+0000 7ff56ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5701597f0 0x7ff5700b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.970+0000 7ff56ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5701597f0 0x7ff5700b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40838/0 (socket says 172.21.15.154:40838) 2023-10-10T21:17:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.970+0000 7ff56ffff700 1 -- 172.21.15.154:0/2951451753 learned_addr learned my addr 172.21.15.154:0/2951451753 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.970+0000 7ff57539c700 1 --2- 172.21.15.154:0/2951451753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57015d230 0x7ff57015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.970+0000 7ff56ffff700 1 -- 172.21.15.154:0/2951451753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57015d230 msgr2=0x7ff57015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.970+0000 7ff56ffff700 1 --2- 172.21.15.154:0/2951451753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57015d230 0x7ff57015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.970+0000 7ff56ffff700 1 -- 172.21.15.154:0/2951451753 >> v1:172.21.15.179:6789/0 conn(0x7ff570159420 legacy=0x7ff5700b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.970+0000 7ff56ffff700 1 -- 172.21.15.154:0/2951451753 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700b1790 con 0x7ff5701597f0 2023-10-10T21:17:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.970+0000 7ff56ffff700 1 --2- 172.21.15.154:0/2951451753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701597f0 0x7ff5700b2270 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0099b0 tx=0x7ff55c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e4c19dcb369d8b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:58.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.970+0000 7ff56f7fe700 1 -- 172.21.15.154:0/2951451753 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00b860 con 0x7ff5701597f0 2023-10-10T21:17:58.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff56f7fe700 1 -- 172.21.15.154:0/2951451753 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00b9c0 con 0x7ff5701597f0 2023-10-10T21:17:58.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff56f7fe700 1 -- 172.21.15.154:0/2951451753 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00bd60 con 0x7ff5701597f0 2023-10-10T21:17:58.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff575b9d700 1 -- 172.21.15.154:0/2951451753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701597f0 msgr2=0x7ff5700b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff575b9d700 1 --2- 172.21.15.154:0/2951451753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701597f0 0x7ff5700b2270 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0099b0 tx=0x7ff55c009250 comp rx=0 tx=0).stop 2023-10-10T21:17:58.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff575b9d700 1 -- 172.21.15.154:0/2951451753 shutdown_connections 2023-10-10T21:17:58.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff575b9d700 1 --2- 172.21.15.154:0/2951451753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57015d230 0x7ff57015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff575b9d700 1 --2- 172.21.15.154:0/2951451753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701597f0 0x7ff5700b2270 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff575b9d700 1 -- 172.21.15.154:0/2951451753 >> 172.21.15.154:0/2951451753 conn(0x7ff5700d0660 msgr2=0x7ff5700d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff575b9d700 1 -- 172.21.15.154:0/2951451753 shutdown_connections 2023-10-10T21:17:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.971+0000 7ff575b9d700 1 -- 172.21.15.154:0/2951451753 wait complete. 2023-10-10T21:17:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.973+0000 7ff575b9d700 1 Processor -- start 2023-10-10T21:17:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.973+0000 7ff575b9d700 1 -- start start 2023-10-10T21:17:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff575b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff570159420 0x7ff570146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff575b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5701597f0 0x7ff570155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff575b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57015d230 0x7ff5701560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff575b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700c5400 con 0x7ff570159420 2023-10-10T21:17:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff575b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57016be20 con 0x7ff5701597f0 2023-10-10T21:17:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff575b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff570146690 con 0x7ff57015d230 2023-10-10T21:17:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff574b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff570159420 0x7ff570146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff574b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff570159420 0x7ff570146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40846/0 (socket says 172.21.15.154:40846) 2023-10-10T21:17:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff574b9b700 1 -- 172.21.15.154:0/2301551370 learned_addr learned my addr 172.21.15.154:0/2301551370 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff574b9b700 1 -- 172.21.15.154:0/2301551370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57015d230 msgr2=0x7ff5701560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff574b9b700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57015d230 0x7ff5701560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff574b9b700 1 -- 172.21.15.154:0/2301551370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5701597f0 msgr2=0x7ff570155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:58.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff574b9b700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5701597f0 0x7ff570155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:58.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff574b9b700 1 -- 172.21.15.154:0/2301551370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c0094f0 con 0x7ff570159420 2023-10-10T21:17:58.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.974+0000 7ff574b9b700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff570159420 0x7ff570146150 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff56400cb10 tx=0x7ff5640017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.975+0000 7ff56cff9700 1 -- 172.21.15.154:0/2301551370 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400a760 con 0x7ff570159420 2023-10-10T21:17:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.975+0000 7ff56cff9700 1 -- 172.21.15.154:0/2301551370 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400a8e0 con 0x7ff570159420 2023-10-10T21:17:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.975+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57016b210 con 0x7ff570159420 2023-10-10T21:17:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.975+0000 7ff56cff9700 1 -- 172.21.15.154:0/2301551370 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400aca0 con 0x7ff570159420 2023-10-10T21:17:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.975+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57016b7d0 con 0x7ff570159420 2023-10-10T21:17:58.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.976+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57004c3c0 con 0x7ff570159420 2023-10-10T21:17:58.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.976+0000 7ff56cff9700 1 -- 172.21.15.154:0/2301551370 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff564003030 con 0x7ff570159420 2023-10-10T21:17:58.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.977+0000 7ff56cff9700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff554066f30 0x7ff5540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:58.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.977+0000 7ff56cff9700 1 -- 172.21.15.154:0/2301551370 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5245+0+0 (secure 0 0 0) 0x7ff564084500 con 0x7ff570159420 2023-10-10T21:17:58.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.978+0000 7ff56ffff700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff554066f30 0x7ff5540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:58.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.978+0000 7ff56ffff700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff554066f30 0x7ff5540693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0099b0 tx=0x7ff55c017000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:58.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:58.981+0000 7ff56cff9700 1 -- 172.21.15.154:0/2301551370 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5640518a0 con 0x7ff570159420 2023-10-10T21:17:59.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.174+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5700b1a70 con 0x7ff570159420 2023-10-10T21:17:59.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.175+0000 7ff56cff9700 1 -- 172.21.15.154:0/2301551370 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+12777 (secure 0 0 0) 0x7ff564054ec0 con 0x7ff570159420 2023-10-10T21:17:59.176 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:59.176 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":91,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:17:58.247422+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:17:59.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff554066f30 msgr2=0x7ff5540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff554066f30 0x7ff5540693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0099b0 tx=0x7ff55c017000 comp rx=0 tx=0).stop 2023-10-10T21:17:59.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff570159420 msgr2=0x7ff570146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff570159420 0x7ff570146150 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff56400cb10 tx=0x7ff5640017b0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 shutdown_connections 2023-10-10T21:17:59.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57015d230 0x7ff5701560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff570159420 0x7ff570146150 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff554066f30 0x7ff5540693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 --2- 172.21.15.154:0/2301551370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5701597f0 0x7ff570155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 >> 172.21.15.154:0/2301551370 conn(0x7ff5700d0660 msgr2=0x7ff570155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:59.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.177+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 shutdown_connections 2023-10-10T21:17:59.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.178+0000 7ff575b9d700 1 -- 172.21.15.154:0/2301551370 wait complete. 2023-10-10T21:17:59.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T21:17:59.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:17:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.383+0000 7f077759d700 1 Processor -- start 2023-10-10T21:17:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.383+0000 7f077759d700 1 -- start start 2023-10-10T21:17:59.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f077759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f077015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f077759d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07700ae0d0 0x7f07700ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f077759d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077006ebd0 con 0x7f077015a8a0 2023-10-10T21:17:59.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f077759d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077015b2e0 con 0x7f07700ae0d0 2023-10-10T21:17:59.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f077759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07700aea50 con 0x7f07700cb1a0 2023-10-10T21:17:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f0776d9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07700ae0d0 0x7f07700ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f077659b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f077015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f0776d9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07700ae0d0 0x7f07700ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52258/0 (socket says 172.21.15.154:52258) 2023-10-10T21:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f077659b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f077015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:41608/0 (socket says 172.21.15.154:41608) 2023-10-10T21:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.385+0000 7f0776d9c700 1 -- 172.21.15.154:0/1887440895 learned_addr learned my addr 172.21.15.154:0/1887440895 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.386+0000 7f077659b700 1 -- 172.21.15.154:0/1887440895 >> v2:172.21.15.179:3300/0 conn(0x7f07700ae0d0 msgr2=0x7f07700ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.386+0000 7f077659b700 1 --2- 172.21.15.154:0/1887440895 >> v2:172.21.15.179:3300/0 conn(0x7f07700ae0d0 0x7f07700ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.386+0000 7f077659b700 1 -- 172.21.15.154:0/1887440895 >> v1:172.21.15.179:6789/0 conn(0x7f077015a8a0 legacy=0x7f077006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.386+0000 7f077659b700 1 -- 172.21.15.154:0/1887440895 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077015ad20 con 0x7f07700cb1a0 2023-10-10T21:17:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.386+0000 7f0775599700 1 -- 172.21.15.154:0/1887440895 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942203369 0 0) 0x7f077006ebd0 con 0x7f077015a8a0 2023-10-10T21:17:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.386+0000 7f077659b700 1 --2- 172.21.15.154:0/1887440895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f077015a360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f076c0098e0 tx=0x7f076c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f8b3389f99fc88 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.386+0000 7f0775599700 1 -- 172.21.15.154:0/1887440895 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c00b6d0 con 0x7f07700cb1a0 2023-10-10T21:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.386+0000 7f0775599700 1 -- 172.21.15.154:0/1887440895 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c00b830 con 0x7f07700cb1a0 2023-10-10T21:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.386+0000 7f0775599700 1 -- 172.21.15.154:0/1887440895 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c00bbd0 con 0x7f07700cb1a0 2023-10-10T21:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.387+0000 7f077759d700 1 -- 172.21.15.154:0/1887440895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 msgr2=0x7f077015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.387+0000 7f077759d700 1 --2- 172.21.15.154:0/1887440895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f077015a360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f076c0098e0 tx=0x7f076c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.387+0000 7f077759d700 1 -- 172.21.15.154:0/1887440895 shutdown_connections 2023-10-10T21:17:59.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.387+0000 7f077759d700 1 --2- 172.21.15.154:0/1887440895 >> v2:172.21.15.179:3300/0 conn(0x7f07700ae0d0 0x7f07700ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.387+0000 7f077759d700 1 --2- 172.21.15.154:0/1887440895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f077015a360 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.387+0000 7f077759d700 1 -- 172.21.15.154:0/1887440895 >> 172.21.15.154:0/1887440895 conn(0x7f07700cc1e0 msgr2=0x7f07700cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.387+0000 7f077759d700 1 -- 172.21.15.154:0/1887440895 shutdown_connections 2023-10-10T21:17:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.387+0000 7f077759d700 1 -- 172.21.15.154:0/1887440895 wait complete. 2023-10-10T21:17:59.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.388+0000 7f077759d700 1 Processor -- start 2023-10-10T21:17:59.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.389+0000 7f077759d700 1 -- start start 2023-10-10T21:17:59.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.389+0000 7f077759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07700ae0d0 0x7f0770166c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.389+0000 7f077759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f0770168900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.389+0000 7f077759d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07700b0f90 0x7f07700b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f077759d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0770166a60 con 0x7f07700b0f90 2023-10-10T21:17:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f077759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0770168e40 con 0x7f07700ae0d0 2023-10-10T21:17:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f077759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07700b1930 con 0x7f07700cb1a0 2023-10-10T21:17:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0776d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07700b0f90 0x7f07700b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0776d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07700b0f90 0x7f07700b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40852/0 (socket says 172.21.15.154:40852) 2023-10-10T21:17:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0776d9c700 1 -- 172.21.15.154:0/598929627 learned_addr learned my addr 172.21.15.154:0/598929627 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f077659b700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07700ae0d0 0x7f0770166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0775d9a700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f0770168900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0776d9c700 1 -- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 msgr2=0x7f0770168900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0776d9c700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f0770168900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0776d9c700 1 -- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07700ae0d0 msgr2=0x7f0770166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0776d9c700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07700ae0d0 0x7f0770166c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0776d9c700 1 -- 172.21.15.154:0/598929627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c009420 con 0x7f07700b0f90 2023-10-10T21:17:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f0775d9a700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f0770168900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.390+0000 7f077659b700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07700ae0d0 0x7f0770166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.391+0000 7f0776d9c700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07700b0f90 0x7f07700b13f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f076800e170 tx=0x7f076800d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.391+0000 7f07667fc700 1 -- 172.21.15.154:0/598929627 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800b320 con 0x7f07700b0f90 2023-10-10T21:17:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.391+0000 7f07667fc700 1 -- 172.21.15.154:0/598929627 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768011040 con 0x7f07700b0f90 2023-10-10T21:17:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.391+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0770157550 con 0x7f07700b0f90 2023-10-10T21:17:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.391+0000 7f07667fc700 1 -- 172.21.15.154:0/598929627 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800ec30 con 0x7f07700b0f90 2023-10-10T21:17:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.391+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0770156f00 con 0x7f07700b0f90 2023-10-10T21:17:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.392+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07701576e0 con 0x7f07700b0f90 2023-10-10T21:17:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.393+0000 7f07667fc700 1 -- 172.21.15.154:0/598929627 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0768009820 con 0x7f07700b0f90 2023-10-10T21:17:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.394+0000 7f07667fc700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0754066f30 0x7f07540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.394+0000 7f07667fc700 1 -- 172.21.15.154:0/598929627 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f0768086bf0 con 0x7f07700b0f90 2023-10-10T21:17:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.394+0000 7f077659b700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0754066f30 0x7f07540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.394+0000 7f077659b700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0754066f30 0x7f07540693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f076c0093f0 tx=0x7f076c017000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:59.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.398+0000 7f07667fc700 1 -- 172.21.15.154:0/598929627 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0768053f90 con 0x7f07700b0f90 2023-10-10T21:17:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.586+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f077006c480 con 0x7f07700b0f90 2023-10-10T21:17:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.587+0000 7f07667fc700 1 -- 172.21.15.154:0/598929627 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07680575b0 con 0x7f07700b0f90 2023-10-10T21:17:59.588 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:17:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0754066f30 msgr2=0x7f07540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0754066f30 0x7f07540693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f076c0093f0 tx=0x7f076c017000 comp rx=0 tx=0).stop 2023-10-10T21:17:59.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07700b0f90 msgr2=0x7f07700b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07700b0f90 0x7f07700b13f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f076800e170 tx=0x7f076800d040 comp rx=0 tx=0).stop 2023-10-10T21:17:59.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 shutdown_connections 2023-10-10T21:17:59.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07700b0f90 0x7f07700b13f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0754066f30 0x7f07540693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07700ae0d0 0x7f0770166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 --2- 172.21.15.154:0/598929627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07700cb1a0 0x7f0770168900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 >> 172.21.15.154:0/598929627 conn(0x7f07700cc1e0 msgr2=0x7f07700c7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:59.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 shutdown_connections 2023-10-10T21:17:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.589+0000 7f077759d700 1 -- 172.21.15.154:0/598929627 wait complete. 2023-10-10T21:17:59.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T21:17:59.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.789+0000 7fa0d3dff700 1 Processor -- start 2023-10-10T21:17:59.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.789+0000 7fa0d3dff700 1 -- start start 2023-10-10T21:17:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d3dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa0cc0b1420 0x7fa0cc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d3dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0ccf90 0x7fa0cc0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d3dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc0cc300 con 0x7fa0cc0cbf30 2023-10-10T21:17:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d3dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc156bf0 con 0x7fa0cc0b1420 2023-10-10T21:17:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d3dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0ae950 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d1b9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa0cc0cbf30 0x7fa0cc0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56634/0 (socket says 172.21.15.154:56634) 2023-10-10T21:17:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d1b9b700 1 -- 172.21.15.154:0/1897780688 learned_addr learned my addr 172.21.15.154:0/1897780688 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:17:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d139a700 1 --2- 172.21.15.154:0/1897780688 >> v2:172.21.15.179:3300/0 conn(0x7fa0cc0b1420 0x7fa0cc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d239c700 1 --2- 172.21.15.154:0/1897780688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0ccf90 0x7fa0cc0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d0b99700 1 -- 172.21.15.154:0/1897780688 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795393793 0 0) 0x7fa0cc0cc300 con 0x7fa0cc0cbf30 2023-10-10T21:17:59.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.791+0000 7fa0d0b99700 1 -- 172.21.15.154:0/1897780688 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b8003570 con 0x7fa0cc0cbf30 2023-10-10T21:17:59.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.792+0000 7fa0d139a700 1 -- 172.21.15.154:0/1897780688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0ccf90 msgr2=0x7fa0cc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:17:59.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.792+0000 7fa0d139a700 1 --2- 172.21.15.154:0/1897780688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0ccf90 0x7fa0cc0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.792+0000 7fa0d139a700 1 -- 172.21.15.154:0/1897780688 >> v1:172.21.15.154:6789/0 conn(0x7fa0cc0cbf30 legacy=0x7fa0cc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.792+0000 7fa0d139a700 1 -- 172.21.15.154:0/1897780688 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0ad370 con 0x7fa0cc0b1420 2023-10-10T21:17:59.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.792+0000 7fa0d239c700 1 --2- 172.21.15.154:0/1897780688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0ccf90 0x7fa0cc0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:17:59.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.792+0000 7fa0d139a700 1 --2- 172.21.15.154:0/1897780688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0cc0b1420 0x7fa0cc0ae410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009910 tx=0x7fa0bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54fef5800954d4c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:59.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.792+0000 7fa0d0b99700 1 -- 172.21.15.154:0/1897780688 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc011630 con 0x7fa0cc0b1420 2023-10-10T21:17:59.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.792+0000 7fa0d0b99700 1 -- 172.21.15.154:0/1897780688 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc011790 con 0x7fa0cc0b1420 2023-10-10T21:17:59.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.792+0000 7fa0d0b99700 1 -- 172.21.15.154:0/1897780688 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc011b30 con 0x7fa0cc0b1420 2023-10-10T21:17:59.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.793+0000 7fa0d3dff700 1 -- 172.21.15.154:0/1897780688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0cc0b1420 msgr2=0x7fa0cc0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.793+0000 7fa0d3dff700 1 --2- 172.21.15.154:0/1897780688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0cc0b1420 0x7fa0cc0ae410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009910 tx=0x7fa0bc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.793+0000 7fa0d3dff700 1 -- 172.21.15.154:0/1897780688 shutdown_connections 2023-10-10T21:17:59.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.793+0000 7fa0d3dff700 1 --2- 172.21.15.154:0/1897780688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0ccf90 0x7fa0cc0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.793+0000 7fa0d3dff700 1 --2- 172.21.15.154:0/1897780688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0cc0b1420 0x7fa0cc0ae410 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.793+0000 7fa0d3dff700 1 -- 172.21.15.154:0/1897780688 >> 172.21.15.154:0/1897780688 conn(0x7fa0cc06a320 msgr2=0x7fa0cc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:17:59.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.793+0000 7fa0d3dff700 1 -- 172.21.15.154:0/1897780688 shutdown_connections 2023-10-10T21:17:59.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.793+0000 7fa0d3dff700 1 -- 172.21.15.154:0/1897780688 wait complete. 2023-10-10T21:17:59.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.794+0000 7fa0d3dff700 1 Processor -- start 2023-10-10T21:17:59.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.795+0000 7fa0d3dff700 1 -- start start 2023-10-10T21:17:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.795+0000 7fa0d3dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0b1420 0x7fa0cc167330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.795+0000 7fa0d3dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0cc0cbf30 0x7fa0cc0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.795+0000 7fa0d3dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0cc0ccf90 0x7fa0cc0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.795+0000 7fa0d3dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc15d340 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.795+0000 7fa0d3dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc15b040 con 0x7fa0cc0cbf30 2023-10-10T21:17:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.795+0000 7fa0d3dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc15c7c0 con 0x7fa0cc0b1420 2023-10-10T21:17:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d239c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0cc0ccf90 0x7fa0cc0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d239c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0cc0ccf90 0x7fa0cc0cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40860/0 (socket says 172.21.15.154:40860) 2023-10-10T21:17:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d239c700 1 -- 172.21.15.154:0/4176717960 learned_addr learned my addr 172.21.15.154:0/4176717960 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:17:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d1b9b700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0b1420 0x7fa0cc167330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d139a700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0cc0cbf30 0x7fa0cc0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d239c700 1 -- 172.21.15.154:0/4176717960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0b1420 msgr2=0x7fa0cc167330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d239c700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0b1420 0x7fa0cc167330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d239c700 1 -- 172.21.15.154:0/4176717960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0cc0cbf30 msgr2=0x7fa0cc0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:17:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d239c700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0cc0cbf30 0x7fa0cc0ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:17:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d239c700 1 -- 172.21.15.154:0/4176717960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c4009a20 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.796+0000 7fa0d239c700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0cc0ccf90 0x7fa0cc0cacf0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009f20 tx=0x7fa0c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.797+0000 7fa0c1ffb700 1 -- 172.21.15.154:0/4176717960 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c400cc80 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.797+0000 7fa0c1ffb700 1 -- 172.21.15.154:0/4176717960 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c400f040 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.797+0000 7fa0c1ffb700 1 -- 172.21.15.154:0/4176717960 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4014480 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.797+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc009420 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.797+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc15ce00 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.798+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc04c3c0 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.799+0000 7fa0c1ffb700 1 -- 172.21.15.154:0/4176717960 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0c4003020 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.799+0000 7fa0c1ffb700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa0b0066f30 0x7fa0b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:17:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.799+0000 7fa0c1ffb700 1 -- 172.21.15.154:0/4176717960 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fa0c4084db0 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.800+0000 7fa0d1b9b700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa0b0066f30 0x7fa0b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:17:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.800+0000 7fa0d1b9b700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa0b0066f30 0x7fa0b00693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80058d0 tx=0x7fa0c8009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:17:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.803+0000 7fa0c1ffb700 1 -- 172.21.15.154:0/4176717960 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0c4089070 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.997+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa0cc15d120 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:17:59.997+0000 7fa0c1ffb700 1 -- 172.21.15.154:0/4176717960 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v91) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa0c4055be0 con 0x7fa0cc0ccf90 2023-10-10T21:17:59.999 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:17:59.999 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:17:59.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:00.000 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T21:18:00.000 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T21:18:00.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:00.000 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:18:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa0b0066f30 msgr2=0x7fa0b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa0b0066f30 0x7fa0b00693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80058d0 tx=0x7fa0c8009040 comp rx=0 tx=0).stop 2023-10-10T21:18:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0cc0ccf90 msgr2=0x7fa0cc0cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0cc0ccf90 0x7fa0cc0cacf0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009f20 tx=0x7fa0c400b040 comp rx=0 tx=0).stop 2023-10-10T21:18:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 shutdown_connections 2023-10-10T21:18:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0cc0ccf90 0x7fa0cc0cacf0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0cc0b1420 0x7fa0cc167330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa0b0066f30 0x7fa0b00693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 --2- 172.21.15.154:0/4176717960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0cc0cbf30 0x7fa0cc0ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 >> 172.21.15.154:0/4176717960 conn(0x7fa0cc06a320 msgr2=0x7fa0cc06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 shutdown_connections 2023-10-10T21:18:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.000+0000 7fa0d3dff700 1 -- 172.21.15.154:0/4176717960 wait complete. 2023-10-10T21:18:00.018 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T21:18:00.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T21:18:00.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.205+0000 7f2044f9d700 1 Processor -- start 2023-10-10T21:18:00.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.205+0000 7f2044f9d700 1 -- start start 2023-10-10T21:18:00.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.206+0000 7f2044f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20400b03c0 0x7f20400cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:00.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.206+0000 7f2044f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f20400b0790 0x7f20400b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:00.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.206+0000 7f2044f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20400cfa00 con 0x7f20401591e0 2023-10-10T21:18:00.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.206+0000 7f2044f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20400cb580 con 0x7f20400b0790 2023-10-10T21:18:00.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.206+0000 7f2044f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20400b2de0 con 0x7f20400b03c0 2023-10-10T21:18:00.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.207+0000 7f203effd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f20400b0790 0x7f20400b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.207+0000 7f203f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20400b03c0 0x7f20400cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.207+0000 7f203effd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f20400b0790 0x7f20400b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52308/0 (socket says 172.21.15.154:52308) 2023-10-10T21:18:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.207+0000 7f203effd700 1 -- 172.21.15.154:0/2449276817 learned_addr learned my addr 172.21.15.154:0/2449276817 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.207+0000 7f203effd700 1 -- 172.21.15.154:0/2449276817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20400b03c0 msgr2=0x7f20400cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.207+0000 7f203effd700 1 --2- 172.21.15.154:0/2449276817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20400b03c0 0x7f20400cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:00.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.207+0000 7f203effd700 1 -- 172.21.15.154:0/2449276817 >> v1:172.21.15.179:6789/0 conn(0x7f20401591e0 legacy=0x7f2040159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:00.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.207+0000 7f203effd700 1 -- 172.21.15.154:0/2449276817 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400cf160 con 0x7f20400b0790 2023-10-10T21:18:00.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f203effd700 1 --2- 172.21.15.154:0/2449276817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20400b0790 0x7f20400b28a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20340099b0 tx=0x7f2034009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce7fe3baa283a7b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:00.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f203e7fc700 1 -- 172.21.15.154:0/2449276817 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034009ea0 con 0x7f20400b0790 2023-10-10T21:18:00.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f203e7fc700 1 -- 172.21.15.154:0/2449276817 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203400b860 con 0x7f20400b0790 2023-10-10T21:18:00.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f203e7fc700 1 -- 172.21.15.154:0/2449276817 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400bc00 con 0x7f20400b0790 2023-10-10T21:18:00.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f2044f9d700 1 -- 172.21.15.154:0/2449276817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20400b0790 msgr2=0x7f20400b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:00.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f2044f9d700 1 --2- 172.21.15.154:0/2449276817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20400b0790 0x7f20400b28a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20340099b0 tx=0x7f2034009250 comp rx=0 tx=0).stop 2023-10-10T21:18:00.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f2044f9d700 1 -- 172.21.15.154:0/2449276817 shutdown_connections 2023-10-10T21:18:00.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f2044f9d700 1 --2- 172.21.15.154:0/2449276817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20400b03c0 0x7f20400cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:00.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f2044f9d700 1 --2- 172.21.15.154:0/2449276817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20400b0790 0x7f20400b28a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:00.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.208+0000 7f2044f9d700 1 -- 172.21.15.154:0/2449276817 >> 172.21.15.154:0/2449276817 conn(0x7f2040063230 msgr2=0x7f2040063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:00.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.209+0000 7f2044f9d700 1 -- 172.21.15.154:0/2449276817 shutdown_connections 2023-10-10T21:18:00.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.209+0000 7f2044f9d700 1 -- 172.21.15.154:0/2449276817 wait complete. 2023-10-10T21:18:00.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.210+0000 7f2044f9d700 1 Processor -- start 2023-10-10T21:18:00.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.210+0000 7f2044f9d700 1 -- start start 2023-10-10T21:18:00.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f2044f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b03c0 0x7f204014b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:00.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f2044f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20400b0790 0x7f20400c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:00.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f2044f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20401591e0 0x7f20400c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:00.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f2044f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20400c4540 con 0x7f20400b03c0 2023-10-10T21:18:00.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f2044f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20400c4820 con 0x7f20400b0790 2023-10-10T21:18:00.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f2044f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20400c4b00 con 0x7f20401591e0 2023-10-10T21:18:00.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f203f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b03c0 0x7f204014b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f203f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b03c0 0x7f204014b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40874/0 (socket says 172.21.15.154:40874) 2023-10-10T21:18:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f203f7fe700 1 -- 172.21.15.154:0/878896034 learned_addr learned my addr 172.21.15.154:0/878896034 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f203effd700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20400b0790 0x7f20400c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.211+0000 7f203ffff700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20401591e0 0x7f20400c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f203f7fe700 1 -- 172.21.15.154:0/878896034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20401591e0 msgr2=0x7f20400c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:00.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f203f7fe700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20401591e0 0x7f20400c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:00.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f203f7fe700 1 -- 172.21.15.154:0/878896034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20400b0790 msgr2=0x7f20400c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:00.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f203f7fe700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20400b0790 0x7f20400c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:00.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f203f7fe700 1 -- 172.21.15.154:0/878896034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20340094f0 con 0x7f20400b03c0 2023-10-10T21:18:00.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f203f7fe700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b03c0 0x7f204014b950 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f203000e930 tx=0x7f20300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:00.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f20277fe700 1 -- 172.21.15.154:0/878896034 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030013680 con 0x7f20400b03c0 2023-10-10T21:18:00.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f20277fe700 1 -- 172.21.15.154:0/878896034 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20300137e0 con 0x7f20400b03c0 2023-10-10T21:18:00.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20400c4de0 con 0x7f20400b03c0 2023-10-10T21:18:00.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.212+0000 7f20277fe700 1 -- 172.21.15.154:0/878896034 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030013ba0 con 0x7f20400b03c0 2023-10-10T21:18:00.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.213+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204015c750 con 0x7f20400b03c0 2023-10-10T21:18:00.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.214+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204004c3c0 con 0x7f20400b03c0 2023-10-10T21:18:00.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.215+0000 7f20277fe700 1 -- 172.21.15.154:0/878896034 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f203000c3e0 con 0x7f20400b03c0 2023-10-10T21:18:00.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.215+0000 7f20277fe700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f202c066f30 0x7f202c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:00.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.215+0000 7f20277fe700 1 -- 172.21.15.154:0/878896034 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f20300844b0 con 0x7f20400b03c0 2023-10-10T21:18:00.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.216+0000 7f203effd700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f202c066f30 0x7f202c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:00.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.216+0000 7f203effd700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f202c066f30 0x7f202c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20340099b0 tx=0x7f2034017000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:00.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.220+0000 7f20277fe700 1 -- 172.21.15.154:0/878896034 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2030051850 con 0x7f20400b03c0 2023-10-10T21:18:00.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:00.412+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f20400cad50 con 0x7f20400b03c0 2023-10-10T21:18:01.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.087+0000 7f20277fe700 1 -- 172.21.15.154:0/878896034 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v92) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2030054e70 con 0x7f20400b03c0 2023-10-10T21:18:01.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.092+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f202c066f30 msgr2=0x7f202c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:01.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.092+0000 7f2044f9d700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f202c066f30 0x7f202c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20340099b0 tx=0x7f2034017000 comp rx=0 tx=0).stop 2023-10-10T21:18:01.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.092+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b03c0 msgr2=0x7f204014b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:01.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.092+0000 7f2044f9d700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b03c0 0x7f204014b950 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f203000e930 tx=0x7f20300091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.092+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 shutdown_connections 2023-10-10T21:18:01.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.092+0000 7f2044f9d700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20401591e0 0x7f20400c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.092+0000 7f2044f9d700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b03c0 0x7f204014b950 secure :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f203000e930 tx=0x7f20300091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.092+0000 7f2044f9d700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f202c066f30 0x7f202c0693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.092+0000 7f2044f9d700 1 --2- 172.21.15.154:0/878896034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20400b0790 0x7f20400c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.093+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 >> 172.21.15.154:0/878896034 conn(0x7f2040063230 msgr2=0x7f20400d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:01.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.093+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 shutdown_connections 2023-10-10T21:18:01.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.093+0000 7f2044f9d700 1 -- 172.21.15.154:0/878896034 wait complete. 2023-10-10T21:18:01.096 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T21:18:01.114 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T21:18:01.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.302+0000 7f32f1bff700 1 Processor -- start 2023-10-10T21:18:01.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.302+0000 7f32f1bff700 1 -- start start 2023-10-10T21:18:01.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.303+0000 7f32f1bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f32ec1569f0 0x7f32ec0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:01.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.303+0000 7f32f1bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec068390 0x7f32ec068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:01.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.304+0000 7f32f1bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ec15a6f0 con 0x7f32ec156620 2023-10-10T21:18:01.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.304+0000 7f32f1bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ec0c8d30 con 0x7f32ec1569f0 2023-10-10T21:18:01.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.304+0000 7f32f1bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec068d70 con 0x7f32ec068390 2023-10-10T21:18:01.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.304+0000 7f32ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec068390 0x7f32ec068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:01.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.304+0000 7f32eaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f32ec1569f0 0x7f32ec0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:01.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.304+0000 7f32ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec068390 0x7f32ec068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:41668/0 (socket says 172.21.15.154:41668) 2023-10-10T21:18:01.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.304+0000 7f32ebfff700 1 -- 172.21.15.154:0/3938682243 learned_addr learned my addr 172.21.15.154:0/3938682243 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:01.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.305+0000 7f32ebfff700 1 -- 172.21.15.154:0/3938682243 >> v2:172.21.15.179:3300/0 conn(0x7f32ec1569f0 msgr2=0x7f32ec0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:01.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.305+0000 7f32ebfff700 1 --2- 172.21.15.154:0/3938682243 >> v2:172.21.15.179:3300/0 conn(0x7f32ec1569f0 0x7f32ec0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.305+0000 7f32ebfff700 1 -- 172.21.15.154:0/3938682243 >> v1:172.21.15.179:6789/0 conn(0x7f32ec156620 legacy=0x7f32ec0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:01.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.305+0000 7f32ebfff700 1 -- 172.21.15.154:0/3938682243 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec15a9d0 con 0x7f32ec068390 2023-10-10T21:18:01.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.305+0000 7f32eaffd700 1 --2- 172.21.15.154:0/3938682243 >> v2:172.21.15.179:3300/0 conn(0x7f32ec1569f0 0x7f32ec0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:01.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.305+0000 7f32ebfff700 1 --2- 172.21.15.154:0/3938682243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec068390 0x7f32ec068830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009f20 tx=0x7f32e4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4088efd8ba5266e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:01.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.305+0000 7f32ea7fc700 1 -- 172.21.15.154:0/3938682243 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e400e070 con 0x7f32ec068390 2023-10-10T21:18:01.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.305+0000 7f32ea7fc700 1 -- 172.21.15.154:0/3938682243 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e400b9d0 con 0x7f32ec068390 2023-10-10T21:18:01.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.305+0000 7f32ea7fc700 1 -- 172.21.15.154:0/3938682243 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e40092e0 con 0x7f32ec068390 2023-10-10T21:18:01.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.306+0000 7f32f1bff700 1 -- 172.21.15.154:0/3938682243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec068390 msgr2=0x7f32ec068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:01.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.306+0000 7f32f1bff700 1 --2- 172.21.15.154:0/3938682243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec068390 0x7f32ec068830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009f20 tx=0x7f32e4009840 comp rx=0 tx=0).stop 2023-10-10T21:18:01.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.306+0000 7f32f1bff700 1 -- 172.21.15.154:0/3938682243 shutdown_connections 2023-10-10T21:18:01.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.306+0000 7f32f1bff700 1 --2- 172.21.15.154:0/3938682243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec068390 0x7f32ec068830 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.306+0000 7f32f1bff700 1 --2- 172.21.15.154:0/3938682243 >> v2:172.21.15.179:3300/0 conn(0x7f32ec1569f0 0x7f32ec0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.306+0000 7f32f1bff700 1 -- 172.21.15.154:0/3938682243 >> 172.21.15.154:0/3938682243 conn(0x7f32ec0cc540 msgr2=0x7f32ec0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:01.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.306+0000 7f32f1bff700 1 -- 172.21.15.154:0/3938682243 shutdown_connections 2023-10-10T21:18:01.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.306+0000 7f32f1bff700 1 -- 172.21.15.154:0/3938682243 wait complete. 2023-10-10T21:18:01.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.307+0000 7f32f1bff700 1 Processor -- start 2023-10-10T21:18:01.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.307+0000 7f32f1bff700 1 -- start start 2023-10-10T21:18:01.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.308+0000 7f32f1bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32ec068390 0x7f32ec15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:01.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.308+0000 7f32f1bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec156620 0x7f32ec0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:01.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.308+0000 7f32f1bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32ec1569f0 0x7f32ec146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:01.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.308+0000 7f32f1bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec0b2210 con 0x7f32ec068390 2023-10-10T21:18:01.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.308+0000 7f32f1bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec157290 con 0x7f32ec1569f0 2023-10-10T21:18:01.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.308+0000 7f32f1bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec156f60 con 0x7f32ec156620 2023-10-10T21:18:01.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.308+0000 7f32eb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32ec068390 0x7f32ec15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:01.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32eb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32ec068390 0x7f32ec15a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40886/0 (socket says 172.21.15.154:40886) 2023-10-10T21:18:01.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32eb7fe700 1 -- 172.21.15.154:0/2579189240 learned_addr learned my addr 172.21.15.154:0/2579189240 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:01.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32ebfff700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32ec1569f0 0x7f32ec146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:01.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32eaffd700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec156620 0x7f32ec0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:01.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32eb7fe700 1 -- 172.21.15.154:0/2579189240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec156620 msgr2=0x7f32ec0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:01.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32eb7fe700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec156620 0x7f32ec0b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32eb7fe700 1 -- 172.21.15.154:0/2579189240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32ec1569f0 msgr2=0x7f32ec146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:01.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32eb7fe700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32ec1569f0 0x7f32ec146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:01.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32eb7fe700 1 -- 172.21.15.154:0/2579189240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e0009420 con 0x7f32ec068390 2023-10-10T21:18:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32eb7fe700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32ec068390 0x7f32ec15a060 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c590 tx=0x7f32dc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32d37fe700 1 -- 172.21.15.154:0/2579189240 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc011590 con 0x7f32ec068390 2023-10-10T21:18:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.309+0000 7f32d37fe700 1 -- 172.21.15.154:0/2579189240 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc011710 con 0x7f32ec068390 2023-10-10T21:18:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.310+0000 7f32d37fe700 1 -- 172.21.15.154:0/2579189240 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc011ad0 con 0x7f32ec068390 2023-10-10T21:18:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.310+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e4009ae0 con 0x7f32ec068390 2023-10-10T21:18:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.310+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ec0b1c50 con 0x7f32ec068390 2023-10-10T21:18:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.311+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ec156dc0 con 0x7f32ec068390 2023-10-10T21:18:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.312+0000 7f32d37fe700 1 -- 172.21.15.154:0/2579189240 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32dc01b3b0 con 0x7f32ec068390 2023-10-10T21:18:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.313+0000 7f32d37fe700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32d8066f30 0x7f32d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.313+0000 7f32d37fe700 1 -- 172.21.15.154:0/2579189240 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f32dc083b60 con 0x7f32ec068390 2023-10-10T21:18:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.313+0000 7f32eaffd700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32d8066f30 0x7f32d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.314+0000 7f32eaffd700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32d8066f30 0x7f32d80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f32ec15a5a0 tx=0x7f32e00091a0 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.316+0000 7f32d37fe700 1 -- 172.21.15.154:0/2579189240 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32dc050eb0 con 0x7f32ec068390 2023-10-10T21:18:01.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:01.507+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f32ec156dc0 con 0x7f32ec068390 2023-10-10T21:18:02.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.089+0000 7f32d37fe700 1 -- 172.21.15.154:0/2579189240 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v93) v1 ==== 170+0+0 (secure 0 0 0) 0x7f32ec156dc0 con 0x7f32ec068390 2023-10-10T21:18:02.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.094+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32d8066f30 msgr2=0x7f32d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:02.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.095+0000 7f32f1bff700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32d8066f30 0x7f32d80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f32ec15a5a0 tx=0x7f32e00091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.095+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32ec068390 msgr2=0x7f32ec15a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:02.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.095+0000 7f32f1bff700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32ec068390 0x7f32ec15a060 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c590 tx=0x7f32dc00c8a0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.098+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 shutdown_connections 2023-10-10T21:18:02.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.098+0000 7f32f1bff700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f32d8066f30 0x7f32d80693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.098+0000 7f32f1bff700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32ec1569f0 0x7f32ec146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.098+0000 7f32f1bff700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32ec068390 0x7f32ec15a060 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.098+0000 7f32f1bff700 1 --2- 172.21.15.154:0/2579189240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32ec156620 0x7f32ec0b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.098+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 >> 172.21.15.154:0/2579189240 conn(0x7f32ec0cc540 msgr2=0x7f32ec14f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:02.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.101+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 shutdown_connections 2023-10-10T21:18:02.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.102+0000 7f32f1bff700 1 -- 172.21.15.154:0/2579189240 wait complete. 2023-10-10T21:18:02.107 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T21:18:02.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T21:18:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.313+0000 7f270a59d700 1 Processor -- start 2023-10-10T21:18:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.313+0000 7f270a59d700 1 -- start start 2023-10-10T21:18:02.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.314+0000 7f270a59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27040b4e70 0x7f27040ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:02.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.314+0000 7f270a59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 0x7f270415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:02.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.314+0000 7f270a59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27040cfb00 con 0x7f27040b16d0 2023-10-10T21:18:02.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.314+0000 7f270a59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27040b5c40 con 0x7f27040b4e70 2023-10-10T21:18:02.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.314+0000 7f270a59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27040b5f20 con 0x7f27040b1b40 2023-10-10T21:18:02.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.314+0000 7f270959b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27040b4e70 0x7f27040ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:02.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.315+0000 7f270959b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27040b4e70 0x7f27040ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40902/0 (socket says 172.21.15.154:40902) 2023-10-10T21:18:02.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.315+0000 7f270959b700 1 -- 172.21.15.154:0/3913602221 learned_addr learned my addr 172.21.15.154:0/3913602221 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:02.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.315+0000 7f2709d9c700 1 --2- 172.21.15.154:0/3913602221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 0x7f270415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:02.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.315+0000 7f270959b700 1 -- 172.21.15.154:0/3913602221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 msgr2=0x7f270415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:02.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.315+0000 7f270959b700 1 --2- 172.21.15.154:0/3913602221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 0x7f270415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.315+0000 7f270959b700 1 -- 172.21.15.154:0/3913602221 >> v1:172.21.15.179:6789/0 conn(0x7f27040b16d0 legacy=0x7f270415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.315+0000 7f270959b700 1 -- 172.21.15.154:0/3913602221 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040b6200 con 0x7f27040b4e70 2023-10-10T21:18:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.315+0000 7f2709d9c700 1 --2- 172.21.15.154:0/3913602221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 0x7f270415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.315+0000 7f270959b700 1 --2- 172.21.15.154:0/3913602221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b4e70 0x7f27040ccff0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f27000099b0 tx=0x7f2700009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95b0181c61712f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f26fbfff700 1 -- 172.21.15.154:0/3913602221 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270000b860 con 0x7f27040b4e70 2023-10-10T21:18:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f26fbfff700 1 -- 172.21.15.154:0/3913602221 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270000b9c0 con 0x7f27040b4e70 2023-10-10T21:18:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f26fbfff700 1 -- 172.21.15.154:0/3913602221 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270000bd60 con 0x7f27040b4e70 2023-10-10T21:18:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f270a59d700 1 -- 172.21.15.154:0/3913602221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b4e70 msgr2=0x7f27040ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f270a59d700 1 --2- 172.21.15.154:0/3913602221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b4e70 0x7f27040ccff0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f27000099b0 tx=0x7f2700009250 comp rx=0 tx=0).stop 2023-10-10T21:18:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f270a59d700 1 -- 172.21.15.154:0/3913602221 shutdown_connections 2023-10-10T21:18:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f270a59d700 1 --2- 172.21.15.154:0/3913602221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 0x7f270415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f270a59d700 1 --2- 172.21.15.154:0/3913602221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b4e70 0x7f27040ccff0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f270a59d700 1 -- 172.21.15.154:0/3913602221 >> 172.21.15.154:0/3913602221 conn(0x7f27040d10c0 msgr2=0x7f27040affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:02.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f270a59d700 1 -- 172.21.15.154:0/3913602221 shutdown_connections 2023-10-10T21:18:02.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.316+0000 7f270a59d700 1 -- 172.21.15.154:0/3913602221 wait complete. 2023-10-10T21:18:02.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.318+0000 7f270a59d700 1 Processor -- start 2023-10-10T21:18:02.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.318+0000 7f270a59d700 1 -- start start 2023-10-10T21:18:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270a59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b16d0 0x7f2704147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270a59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 0x7f270416d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270a59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27040b4e70 0x7f270416db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270a59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2704169f80 con 0x7f27040b16d0 2023-10-10T21:18:02.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270a59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27040ca7c0 con 0x7f27040b4e70 2023-10-10T21:18:02.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270a59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27040caaa0 con 0x7f27040b1b40 2023-10-10T21:18:02.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270959b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b16d0 0x7f2704147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:02.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270959b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b16d0 0x7f2704147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40916/0 (socket says 172.21.15.154:40916) 2023-10-10T21:18:02.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270959b700 1 -- 172.21.15.154:0/2307769188 learned_addr learned my addr 172.21.15.154:0/2307769188 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:02.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f2708d9a700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 0x7f270416d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:02.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f2709d9c700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27040b4e70 0x7f270416db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:02.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270959b700 1 -- 172.21.15.154:0/2307769188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 msgr2=0x7f270416d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:02.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270959b700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 0x7f270416d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270959b700 1 -- 172.21.15.154:0/2307769188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27040b4e70 msgr2=0x7f270416db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:02.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270959b700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27040b4e70 0x7f270416db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:02.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f270959b700 1 -- 172.21.15.154:0/2307769188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000094f0 con 0x7f27040b16d0 2023-10-10T21:18:02.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.319+0000 7f2709d9c700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27040b4e70 0x7f270416db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:02.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.320+0000 7f270959b700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b16d0 0x7f2704147ec0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2700009290 tx=0x7f2700017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:02.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.320+0000 7f26f97fa700 1 -- 172.21.15.154:0/2307769188 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270001a450 con 0x7f27040b16d0 2023-10-10T21:18:02.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.320+0000 7f26f97fa700 1 -- 172.21.15.154:0/2307769188 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270001a5b0 con 0x7f27040b16d0 2023-10-10T21:18:02.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.320+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27040cad80 con 0x7f27040b16d0 2023-10-10T21:18:02.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.320+0000 7f26f97fa700 1 -- 172.21.15.154:0/2307769188 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270001a970 con 0x7f27040b16d0 2023-10-10T21:18:02.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.320+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27040cb340 con 0x7f27040b16d0 2023-10-10T21:18:02.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.321+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27040cb530 con 0x7f27040b16d0 2023-10-10T21:18:02.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.322+0000 7f26f97fa700 1 -- 172.21.15.154:0/2307769188 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f270001ad20 con 0x7f27040b16d0 2023-10-10T21:18:02.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.323+0000 7f26f97fa700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f26e8066f30 0x7f26e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:02.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.323+0000 7f26f97fa700 1 -- 172.21.15.154:0/2307769188 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f2700086190 con 0x7f27040b16d0 2023-10-10T21:18:02.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.324+0000 7f2708d9a700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f26e8066f30 0x7f26e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:02.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.324+0000 7f2708d9a700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f26e8066f30 0x7f26e80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f27041582d0 tx=0x7f26f4009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:02.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.327+0000 7f26f97fa700 1 -- 172.21.15.154:0/2307769188 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27000532c0 con 0x7f27040b16d0 2023-10-10T21:18:02.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:02.567+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2704069b20 con 0x7f27040b16d0 2023-10-10T21:18:03.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.113+0000 7f26f97fa700 1 -- 172.21.15.154:0/2307769188 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7f27000568e0 con 0x7f27040b16d0 2023-10-10T21:18:03.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.118+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f26e8066f30 msgr2=0x7f26e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.118+0000 7f270a59d700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f26e8066f30 0x7f26e80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f27041582d0 tx=0x7f26f4009040 comp rx=0 tx=0).stop 2023-10-10T21:18:03.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.118+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b16d0 msgr2=0x7f2704147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.118+0000 7f270a59d700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b16d0 0x7f2704147ec0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2700009290 tx=0x7f2700017000 comp rx=0 tx=0).stop 2023-10-10T21:18:03.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.119+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 shutdown_connections 2023-10-10T21:18:03.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.119+0000 7f270a59d700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f26e8066f30 0x7f26e80693e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f27041582d0 tx=0x7f26f4009040 comp rx=0 tx=0).stop 2023-10-10T21:18:03.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.119+0000 7f270a59d700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27040b4e70 0x7f270416db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.119+0000 7f270a59d700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27040b16d0 0x7f2704147ec0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.119+0000 7f270a59d700 1 --2- 172.21.15.154:0/2307769188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040b1b40 0x7f270416d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.119+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 >> 172.21.15.154:0/2307769188 conn(0x7f27040d10c0 msgr2=0x7f27040b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:03.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.120+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 shutdown_connections 2023-10-10T21:18:03.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.120+0000 7f270a59d700 1 -- 172.21.15.154:0/2307769188 wait complete. 2023-10-10T21:18:03.124 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 10 and data pool 11 2023-10-10T21:18:03.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:03.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.326+0000 7fcd937ff700 1 Processor -- start 2023-10-10T21:18:03.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.326+0000 7fcd937ff700 1 -- start start 2023-10-10T21:18:03.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd937ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcd8c0b1850 0x7fcd8c0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd937ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd8c1579f0 0x7fcd8c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd937ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c0cb300 con 0x7fcd8c0ae680 2023-10-10T21:18:03.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd937ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c06fc30 con 0x7fcd8c1579f0 2023-10-10T21:18:03.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd937ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c0cc260 con 0x7fcd8c0b1850 2023-10-10T21:18:03.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd91d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd8c1579f0 0x7fcd8c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd91d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd8c1579f0 0x7fcd8c0abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40926/0 (socket says 172.21.15.154:40926) 2023-10-10T21:18:03.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd91d9c700 1 -- 172.21.15.154:0/2051020208 learned_addr learned my addr 172.21.15.154:0/2051020208 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:03.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd9159b700 1 --2- 172.21.15.154:0/2051020208 >> v2:172.21.15.179:3300/0 conn(0x7fcd8c0b1850 0x7fcd8c0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd91d9c700 1 -- 172.21.15.154:0/2051020208 >> v2:172.21.15.179:3300/0 conn(0x7fcd8c0b1850 msgr2=0x7fcd8c0b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:03.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd91d9c700 1 --2- 172.21.15.154:0/2051020208 >> v2:172.21.15.179:3300/0 conn(0x7fcd8c0b1850 0x7fcd8c0b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd91d9c700 1 -- 172.21.15.154:0/2051020208 >> v1:172.21.15.179:6789/0 conn(0x7fcd8c0ae680 legacy=0x7fcd8c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:03.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.328+0000 7fcd91d9c700 1 -- 172.21.15.154:0/2051020208 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0cb5e0 con 0x7fcd8c1579f0 2023-10-10T21:18:03.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd91d9c700 1 --2- 172.21.15.154:0/2051020208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c1579f0 0x7fcd8c0abf60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0641e0 tx=0x7fcd84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242b175a0168766a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:03.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd83fff700 1 -- 172.21.15.154:0/2051020208 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400e070 con 0x7fcd8c1579f0 2023-10-10T21:18:03.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd83fff700 1 -- 172.21.15.154:0/2051020208 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8400ba10 con 0x7fcd8c1579f0 2023-10-10T21:18:03.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd83fff700 1 -- 172.21.15.154:0/2051020208 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd840092e0 con 0x7fcd8c1579f0 2023-10-10T21:18:03.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd937ff700 1 -- 172.21.15.154:0/2051020208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c1579f0 msgr2=0x7fcd8c0abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd937ff700 1 --2- 172.21.15.154:0/2051020208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c1579f0 0x7fcd8c0abf60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0641e0 tx=0x7fcd84009840 comp rx=0 tx=0).stop 2023-10-10T21:18:03.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd937ff700 1 -- 172.21.15.154:0/2051020208 shutdown_connections 2023-10-10T21:18:03.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd937ff700 1 --2- 172.21.15.154:0/2051020208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c1579f0 0x7fcd8c0abf60 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd937ff700 1 --2- 172.21.15.154:0/2051020208 >> v2:172.21.15.179:3300/0 conn(0x7fcd8c0b1850 0x7fcd8c0b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.329+0000 7fcd937ff700 1 -- 172.21.15.154:0/2051020208 >> 172.21.15.154:0/2051020208 conn(0x7fcd8c06a320 msgr2=0x7fcd8c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:03.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.330+0000 7fcd937ff700 1 -- 172.21.15.154:0/2051020208 shutdown_connections 2023-10-10T21:18:03.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.330+0000 7fcd937ff700 1 -- 172.21.15.154:0/2051020208 wait complete. 2023-10-10T21:18:03.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.331+0000 7fcd937ff700 1 Processor -- start 2023-10-10T21:18:03.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.331+0000 7fcd937ff700 1 -- start start 2023-10-10T21:18:03.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd937ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd8c0ae680 0x7fcd8c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd937ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c0b1850 0x7fcd8c154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd937ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8c1579f0 0x7fcd8c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd937ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c15c1e0 con 0x7fcd8c0b1850 2023-10-10T21:18:03.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd937ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c1676d0 con 0x7fcd8c0ae680 2023-10-10T21:18:03.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd937ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c15b660 con 0x7fcd8c1579f0 2023-10-10T21:18:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd90d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c0b1850 0x7fcd8c154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd90d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c0b1850 0x7fcd8c154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40942/0 (socket says 172.21.15.154:40942) 2023-10-10T21:18:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd90d9a700 1 -- 172.21.15.154:0/1728996666 learned_addr learned my addr 172.21.15.154:0/1728996666 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.332+0000 7fcd9159b700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd8c0ae680 0x7fcd8c150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd91d9c700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8c1579f0 0x7fcd8c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd90d9a700 1 -- 172.21.15.154:0/1728996666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8c1579f0 msgr2=0x7fcd8c155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd90d9a700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8c1579f0 0x7fcd8c155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd90d9a700 1 -- 172.21.15.154:0/1728996666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd8c0ae680 msgr2=0x7fcd8c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd90d9a700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd8c0ae680 0x7fcd8c150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd90d9a700 1 -- 172.21.15.154:0/1728996666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd84009ae0 con 0x7fcd8c0b1850 2023-10-10T21:18:03.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd90d9a700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c0b1850 0x7fcd8c154b30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00c5d0 tx=0x7fcd7c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:03.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd817fa700 1 -- 172.21.15.154:0/1728996666 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c011590 con 0x7fcd8c0b1850 2023-10-10T21:18:03.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd817fa700 1 -- 172.21.15.154:0/1728996666 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c011710 con 0x7fcd8c0b1850 2023-10-10T21:18:03.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd817fa700 1 -- 172.21.15.154:0/1728996666 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c011ad0 con 0x7fcd8c0b1850 2023-10-10T21:18:03.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c15b940 con 0x7fcd8c0b1850 2023-10-10T21:18:03.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.333+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c15bf00 con 0x7fcd8c0b1850 2023-10-10T21:18:03.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.334+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c167840 con 0x7fcd8c0b1850 2023-10-10T21:18:03.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.335+0000 7fcd817fa700 1 -- 172.21.15.154:0/1728996666 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd7c01c460 con 0x7fcd8c0b1850 2023-10-10T21:18:03.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.336+0000 7fcd817fa700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcd70066f30 0x7fcd700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.336+0000 7fcd817fa700 1 -- 172.21.15.154:0/1728996666 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fcd7c084500 con 0x7fcd8c0b1850 2023-10-10T21:18:03.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.336+0000 7fcd9159b700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcd70066f30 0x7fcd700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.337+0000 7fcd9159b700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcd70066f30 0x7fcd700693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006fd0 tx=0x7fcd88008040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:03.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.340+0000 7fcd817fa700 1 -- 172.21.15.154:0/1728996666 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd8c167840 con 0x7fcd8c0b1850 2023-10-10T21:18:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.531+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd8c167840 con 0x7fcd8c0b1850 2023-10-10T21:18:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.532+0000 7fcd817fa700 1 -- 172.21.15.154:0/1728996666 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16009 (secure 0 0 0) 0x7fcd8c167840 con 0x7fcd8c0b1850 2023-10-10T21:18:03.534 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":94,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:02.569271+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:00.451391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:01.546798+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcd70066f30 msgr2=0x7fcd700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcd70066f30 0x7fcd700693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006fd0 tx=0x7fcd88008040 comp rx=0 tx=0).stop 2023-10-10T21:18:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c0b1850 msgr2=0x7fcd8c154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c0b1850 0x7fcd8c154b30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00c5d0 tx=0x7fcd7c007f60 comp rx=0 tx=0).stop 2023-10-10T21:18:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 shutdown_connections 2023-10-10T21:18:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8c1579f0 0x7fcd8c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcd70066f30 0x7fcd700693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd8c0ae680 0x7fcd8c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 --2- 172.21.15.154:0/1728996666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd8c0b1850 0x7fcd8c154b30 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 >> 172.21.15.154:0/1728996666 conn(0x7fcd8c06a320 msgr2=0x7fcd8c06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:03.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 shutdown_connections 2023-10-10T21:18:03.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.535+0000 7fcd937ff700 1 -- 172.21.15.154:0/1728996666 wait complete. 2023-10-10T21:18:03.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:03.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.735+0000 7f879afff700 1 Processor -- start 2023-10-10T21:18:03.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.735+0000 7f879afff700 1 -- start start 2023-10-10T21:18:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f879afff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87940cbf30 0x7f87940ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f879afff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940b1420 0x7f87940c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f879afff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87940cc300 con 0x7f87940ccf90 2023-10-10T21:18:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f879afff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8794156bf0 con 0x7f87940cbf30 2023-10-10T21:18:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f879afff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87940ae950 con 0x7f87940b1420 2023-10-10T21:18:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f8793fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f87940ccf90 0x7f87940b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56650/0 (socket says 172.21.15.154:56650) 2023-10-10T21:18:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f8793fff700 1 -- 172.21.15.154:0/1489252086 learned_addr learned my addr 172.21.15.154:0/1489252086 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f879959c700 1 --2- 172.21.15.154:0/1489252086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940b1420 0x7f87940c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f8798d9b700 1 --2- 172.21.15.154:0/1489252086 >> v2:172.21.15.179:3300/0 conn(0x7f87940cbf30 0x7f87940ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f87937fe700 1 -- 172.21.15.154:0/1489252086 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939200556 0 0) 0x7f87940cc300 con 0x7f87940ccf90 2023-10-10T21:18:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.737+0000 7f87937fe700 1 -- 172.21.15.154:0/1489252086 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8784003570 con 0x7f87940ccf90 2023-10-10T21:18:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f879959c700 1 -- 172.21.15.154:0/1489252086 >> v2:172.21.15.179:3300/0 conn(0x7f87940cbf30 msgr2=0x7f87940ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f879959c700 1 --2- 172.21.15.154:0/1489252086 >> v2:172.21.15.179:3300/0 conn(0x7f87940cbf30 0x7f87940ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f879959c700 1 -- 172.21.15.154:0/1489252086 >> v1:172.21.15.154:6789/0 conn(0x7f87940ccf90 legacy=0x7f87940b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f87937fe700 1 -- 172.21.15.154:0/1489252086 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 772992982 0 0) 0x7f8784003570 con 0x7f87940ccf90 2023-10-10T21:18:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f879959c700 1 -- 172.21.15.154:0/1489252086 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87940ad370 con 0x7f87940b1420 2023-10-10T21:18:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f8798d9b700 1 --2- 172.21.15.154:0/1489252086 >> v2:172.21.15.179:3300/0 conn(0x7f87940cbf30 0x7f87940ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f879959c700 1 --2- 172.21.15.154:0/1489252086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940b1420 0x7f87940c9740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f878c009e60 tx=0x7f878c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c39c02c560a099f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f87937fe700 1 -- 172.21.15.154:0/1489252086 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c00e070 con 0x7f87940b1420 2023-10-10T21:18:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f87937fe700 1 -- 172.21.15.154:0/1489252086 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c00b7a0 con 0x7f87940b1420 2023-10-10T21:18:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.738+0000 7f87937fe700 1 -- 172.21.15.154:0/1489252086 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780001470 con 0x7f87940b1420 2023-10-10T21:18:03.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.739+0000 7f879afff700 1 -- 172.21.15.154:0/1489252086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940b1420 msgr2=0x7f87940c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.739+0000 7f879afff700 1 --2- 172.21.15.154:0/1489252086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940b1420 0x7f87940c9740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f878c009e60 tx=0x7f878c009780 comp rx=0 tx=0).stop 2023-10-10T21:18:03.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.739+0000 7f879afff700 1 -- 172.21.15.154:0/1489252086 shutdown_connections 2023-10-10T21:18:03.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.739+0000 7f879afff700 1 --2- 172.21.15.154:0/1489252086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940b1420 0x7f87940c9740 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.739+0000 7f879afff700 1 --2- 172.21.15.154:0/1489252086 >> v2:172.21.15.179:3300/0 conn(0x7f87940cbf30 0x7f87940ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.739+0000 7f879afff700 1 -- 172.21.15.154:0/1489252086 >> 172.21.15.154:0/1489252086 conn(0x7f879406a320 msgr2=0x7f87940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:03.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.739+0000 7f879afff700 1 -- 172.21.15.154:0/1489252086 shutdown_connections 2023-10-10T21:18:03.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.739+0000 7f879afff700 1 -- 172.21.15.154:0/1489252086 wait complete. 2023-10-10T21:18:03.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.740+0000 7f879afff700 1 Processor -- start 2023-10-10T21:18:03.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.741+0000 7f879afff700 1 -- start start 2023-10-10T21:18:03.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.741+0000 7f879afff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87940b1420 0x7f8794167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.741+0000 7f879afff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87940cbf30 0x7f87940c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.741+0000 7f879afff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940ccf90 0x7f87940c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.741+0000 7f879afff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87941680e0 con 0x7f87940b1420 2023-10-10T21:18:03.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.741+0000 7f879afff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87940c12d0 con 0x7f87940cbf30 2023-10-10T21:18:03.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.741+0000 7f879afff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879416a4b0 con 0x7f87940ccf90 2023-10-10T21:18:03.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8798d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87940b1420 0x7f8794167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8798d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87940b1420 0x7f8794167ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40952/0 (socket says 172.21.15.154:40952) 2023-10-10T21:18:03.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8798d9b700 1 -- 172.21.15.154:0/10392472 learned_addr learned my addr 172.21.15.154:0/10392472 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:03.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f879959c700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940ccf90 0x7f87940c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8793fff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87940cbf30 0x7f87940c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8798d9b700 1 -- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940ccf90 msgr2=0x7f87940c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8798d9b700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940ccf90 0x7f87940c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8798d9b700 1 -- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87940cbf30 msgr2=0x7f87940c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8798d9b700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87940cbf30 0x7f87940c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8798d9b700 1 -- 172.21.15.154:0/10392472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8788009420 con 0x7f87940b1420 2023-10-10T21:18:03.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8793fff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87940cbf30 0x7f87940c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:03.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f879959c700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940ccf90 0x7f87940c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:03.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.742+0000 7f8798d9b700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87940b1420 0x7f8794167ba0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f878800ec80 tx=0x7f87880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:03.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.743+0000 7f8790ff9700 1 -- 172.21.15.154:0/10392472 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800c9d0 con 0x7f87940b1420 2023-10-10T21:18:03.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.743+0000 7f8790ff9700 1 -- 172.21.15.154:0/10392472 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800cb30 con 0x7f87940b1420 2023-10-10T21:18:03.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.743+0000 7f8790ff9700 1 -- 172.21.15.154:0/10392472 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800ceb0 con 0x7f87940b1420 2023-10-10T21:18:03.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.743+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c009a20 con 0x7f87940b1420 2023-10-10T21:18:03.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.743+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879416aa70 con 0x7f87940b1420 2023-10-10T21:18:03.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.744+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87940b0590 con 0x7f87940b1420 2023-10-10T21:18:03.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.745+0000 7f8790ff9700 1 -- 172.21.15.154:0/10392472 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8788013680 con 0x7f87940b1420 2023-10-10T21:18:03.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.745+0000 7f8790ff9700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8778066f30 0x7f87780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:03.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.745+0000 7f8790ff9700 1 -- 172.21.15.154:0/10392472 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8788084b10 con 0x7f87940b1420 2023-10-10T21:18:03.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.746+0000 7f8793fff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8778066f30 0x7f87780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:03.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.746+0000 7f8793fff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8778066f30 0x7f87780693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8794148980 tx=0x7f8780001580 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:03.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.750+0000 7f8790ff9700 1 -- 172.21.15.154:0/10392472 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8788051bf0 con 0x7f87940b1420 2023-10-10T21:18:03.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.945+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f879404c3c0 con 0x7f87940b1420 2023-10-10T21:18:03.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.946+0000 7f8790ff9700 1 -- 172.21.15.154:0/10392472 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16009 (secure 0 0 0) 0x7f8788055210 con 0x7f87940b1420 2023-10-10T21:18:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:03.948 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":94,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:02.569271+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:00.451391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:01.546798+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:03.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8778066f30 msgr2=0x7f87780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8778066f30 0x7f87780693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8794148980 tx=0x7f8780001580 comp rx=0 tx=0).stop 2023-10-10T21:18:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87940b1420 msgr2=0x7f8794167ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87940b1420 0x7f8794167ba0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f878800ec80 tx=0x7f87880091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 shutdown_connections 2023-10-10T21:18:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87940ccf90 0x7f87940c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87940b1420 0x7f8794167ba0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8778066f30 0x7f87780693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 --2- 172.21.15.154:0/10392472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87940cbf30 0x7f87940c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:03.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 >> 172.21.15.154:0/10392472 conn(0x7f879406a320 msgr2=0x7f87941560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:03.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 shutdown_connections 2023-10-10T21:18:03.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:03.949+0000 7f879afff700 1 -- 172.21.15.154:0/10392472 wait complete. 2023-10-10T21:18:03.968 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T21:18:04.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.153+0000 7f7b6a3ff700 1 Processor -- start 2023-10-10T21:18:04.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.153+0000 7f7b6a3ff700 1 -- start start 2023-10-10T21:18:04.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.154+0000 7f7b6a3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7b640c83f0 0x7f7b640c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:04.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.154+0000 7f7b6a3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b641568e0 0x7f7b640ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:04.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6a3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6415b0d0 con 0x7f7b640ccee0 2023-10-10T21:18:04.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6a3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b640c7a60 con 0x7f7b641568e0 2023-10-10T21:18:04.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6a3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6415a4c0 con 0x7f7b640c83f0 2023-10-10T21:18:04.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6899c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b641568e0 0x7f7b640ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:04.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6899c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b641568e0 0x7f7b640ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40960/0 (socket says 172.21.15.154:40960) 2023-10-10T21:18:04.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6899c700 1 -- 172.21.15.154:0/871229739 learned_addr learned my addr 172.21.15.154:0/871229739 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:04.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b63fff700 1 --2- 172.21.15.154:0/871229739 >> v2:172.21.15.179:3300/0 conn(0x7f7b640c83f0 0x7f7b640c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:04.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6899c700 1 -- 172.21.15.154:0/871229739 >> v2:172.21.15.179:3300/0 conn(0x7f7b640c83f0 msgr2=0x7f7b640c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:04.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6899c700 1 --2- 172.21.15.154:0/871229739 >> v2:172.21.15.179:3300/0 conn(0x7f7b640c83f0 0x7f7b640c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:04.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6899c700 1 -- 172.21.15.154:0/871229739 >> v1:172.21.15.179:6789/0 conn(0x7f7b640ccee0 legacy=0x7f7b641561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:04.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.155+0000 7f7b6899c700 1 -- 172.21.15.154:0/871229739 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6415a7a0 con 0x7f7b641568e0 2023-10-10T21:18:04.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b6899c700 1 --2- 172.21.15.154:0/871229739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b641568e0 0x7f7b640ca1e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7b640c9fd0 tx=0x7f7b5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71cda999236757a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:04.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b62ffd700 1 -- 172.21.15.154:0/871229739 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00e070 con 0x7f7b641568e0 2023-10-10T21:18:04.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b62ffd700 1 -- 172.21.15.154:0/871229739 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c00ba10 con 0x7f7b641568e0 2023-10-10T21:18:04.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b62ffd700 1 -- 172.21.15.154:0/871229739 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0092e0 con 0x7f7b641568e0 2023-10-10T21:18:04.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/871229739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b641568e0 msgr2=0x7f7b640ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b6a3ff700 1 --2- 172.21.15.154:0/871229739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b641568e0 0x7f7b640ca1e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7b640c9fd0 tx=0x7f7b5c009840 comp rx=0 tx=0).stop 2023-10-10T21:18:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/871229739 shutdown_connections 2023-10-10T21:18:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b6a3ff700 1 --2- 172.21.15.154:0/871229739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b641568e0 0x7f7b640ca1e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b6a3ff700 1 --2- 172.21.15.154:0/871229739 >> v2:172.21.15.179:3300/0 conn(0x7f7b640c83f0 0x7f7b640c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:04.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/871229739 >> 172.21.15.154:0/871229739 conn(0x7f7b64068e10 msgr2=0x7f7b640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/871229739 shutdown_connections 2023-10-10T21:18:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.156+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/871229739 wait complete. 2023-10-10T21:18:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.158+0000 7f7b6a3ff700 1 Processor -- start 2023-10-10T21:18:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.158+0000 7f7b6a3ff700 1 -- start start 2023-10-10T21:18:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b6a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b640c83f0 0x7f7b640ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:04.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b6a3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b640ccee0 0x7f7b641511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b6a3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641568e0 0x7f7b640c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b6a3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b64159d00 con 0x7f7b640ccee0 2023-10-10T21:18:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b6a3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b64158e90 con 0x7f7b641568e0 2023-10-10T21:18:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b6a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641590f0 con 0x7f7b640c83f0 2023-10-10T21:18:04.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b640ccee0 0x7f7b641511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b640ccee0 0x7f7b641511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40974/0 (socket says 172.21.15.154:40974) 2023-10-10T21:18:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b637fe700 1 -- 172.21.15.154:0/186694679 learned_addr learned my addr 172.21.15.154:0/186694679 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b63fff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b640c83f0 0x7f7b640ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b6899c700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641568e0 0x7f7b640c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:04.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b637fe700 1 -- 172.21.15.154:0/186694679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b640c83f0 msgr2=0x7f7b640ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:04.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b637fe700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b640c83f0 0x7f7b640ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:04.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b637fe700 1 -- 172.21.15.154:0/186694679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641568e0 msgr2=0x7f7b640c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:04.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b637fe700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641568e0 0x7f7b640c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:04.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.159+0000 7f7b637fe700 1 -- 172.21.15.154:0/186694679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c009ae0 con 0x7f7b640ccee0 2023-10-10T21:18:04.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.160+0000 7f7b637fe700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b640ccee0 0x7f7b641511c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800c5d0 tx=0x7f7b58007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:04.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.160+0000 7f7b4bfff700 1 -- 172.21.15.154:0/186694679 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58011590 con 0x7f7b640ccee0 2023-10-10T21:18:04.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.160+0000 7f7b4bfff700 1 -- 172.21.15.154:0/186694679 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58011710 con 0x7f7b640ccee0 2023-10-10T21:18:04.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.160+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b641593d0 con 0x7f7b640ccee0 2023-10-10T21:18:04.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.160+0000 7f7b4bfff700 1 -- 172.21.15.154:0/186694679 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58011ad0 con 0x7f7b640ccee0 2023-10-10T21:18:04.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.160+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b64159990 con 0x7f7b640ccee0 2023-10-10T21:18:04.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.161+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6404c3c0 con 0x7f7b640ccee0 2023-10-10T21:18:04.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.162+0000 7f7b4bfff700 1 -- 172.21.15.154:0/186694679 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b5801c460 con 0x7f7b640ccee0 2023-10-10T21:18:04.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.163+0000 7f7b4bfff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7b50066f30 0x7f7b500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:04.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.163+0000 7f7b4bfff700 1 -- 172.21.15.154:0/186694679 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f7b580844c0 con 0x7f7b640ccee0 2023-10-10T21:18:04.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.163+0000 7f7b63fff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7b50066f30 0x7f7b500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:04.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.164+0000 7f7b63fff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7b50066f30 0x7f7b500693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b54006fd0 tx=0x7f7b54008040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:04.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.167+0000 7f7b4bfff700 1 -- 172.21.15.154:0/186694679 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b580515a0 con 0x7f7b640ccee0 2023-10-10T21:18:04.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:04.403+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7b64159b50 con 0x7f7b640ccee0 2023-10-10T21:18:05.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.125+0000 7f7b4bfff700 1 -- 172.21.15.154:0/186694679 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7b58054bc0 con 0x7f7b640ccee0 2023-10-10T21:18:05.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.127+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7b50066f30 msgr2=0x7f7b500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:05.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7b50066f30 0x7f7b500693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b54006fd0 tx=0x7f7b54008040 comp rx=0 tx=0).stop 2023-10-10T21:18:05.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b640ccee0 msgr2=0x7f7b641511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:05.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b640ccee0 0x7f7b641511c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800c5d0 tx=0x7f7b58007f60 comp rx=0 tx=0).stop 2023-10-10T21:18:05.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 shutdown_connections 2023-10-10T21:18:05.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7b50066f30 0x7f7b500693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:05.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641568e0 0x7f7b640c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:05.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b640c83f0 0x7f7b640ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:05.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 --2- 172.21.15.154:0/186694679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b640ccee0 0x7f7b641511c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:05.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 >> 172.21.15.154:0/186694679 conn(0x7f7b64068e10 msgr2=0x7f7b640c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:05.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 shutdown_connections 2023-10-10T21:18:05.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.128+0000 7f7b6a3ff700 1 -- 172.21.15.154:0/186694679 wait complete. 2023-10-10T21:18:05.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T21:18:05.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.337+0000 7f7cbd19d700 1 Processor -- start 2023-10-10T21:18:05.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.337+0000 7f7cbd19d700 1 -- start start 2023-10-10T21:18:05.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.338+0000 7f7cbd19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7cb80ccc00 0x7f7cb8069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:05.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.338+0000 7f7cbd19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 0x7f7cb80cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.338+0000 7f7cbd19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80c9f30 con 0x7f7cb8159a60 2023-10-10T21:18:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.338+0000 7f7cbd19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb806dfc0 con 0x7f7cb80ccc00 2023-10-10T21:18:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.338+0000 7f7cbd19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80ca470 con 0x7f7cb806a020 2023-10-10T21:18:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7caffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7cb80ccc00 0x7f7cb8069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7cbc99c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 0x7f7cb80cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7caffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7cb80ccc00 0x7f7cb8069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52404/0 (socket says 172.21.15.154:52404) 2023-10-10T21:18:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7caffff700 1 -- 172.21.15.154:0/3736930174 learned_addr learned my addr 172.21.15.154:0/3736930174 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7cb7fff700 1 --1- 172.21.15.154:0/3736930174 >> v1:172.21.15.179:6789/0 conn(0x7f7cb8159a60 0x7f7cb80c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:51784/0 (socket says 172.21.15.154:51784) 2023-10-10T21:18:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7caffff700 1 -- 172.21.15.154:0/3736930174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 msgr2=0x7f7cb80cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7caffff700 1 --2- 172.21.15.154:0/3736930174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 0x7f7cb80cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7caffff700 1 -- 172.21.15.154:0/3736930174 >> v1:172.21.15.179:6789/0 conn(0x7f7cb8159a60 legacy=0x7f7cb80c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:05.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7caffff700 1 -- 172.21.15.154:0/3736930174 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80ca750 con 0x7f7cb80ccc00 2023-10-10T21:18:05.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7cb77fe700 1 -- 172.21.15.154:0/3736930174 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753609405 0 0) 0x7f7cb80c9f30 con 0x7f7cb8159a60 2023-10-10T21:18:05.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.339+0000 7f7cbc99c700 1 --2- 172.21.15.154:0/3736930174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 0x7f7cb80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:05.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7caffff700 1 --2- 172.21.15.154:0/3736930174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb80ccc00 0x7f7cb8069ae0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00099b0 tx=0x7f7ca0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36f2378ed472f7ff server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:05.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7cb77fe700 1 -- 172.21.15.154:0/3736930174 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0009ea0 con 0x7f7cb80ccc00 2023-10-10T21:18:05.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7cb77fe700 1 -- 172.21.15.154:0/3736930174 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca000b8f0 con 0x7f7cb80ccc00 2023-10-10T21:18:05.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7cb77fe700 1 -- 172.21.15.154:0/3736930174 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000bc90 con 0x7f7cb80ccc00 2023-10-10T21:18:05.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3736930174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb80ccc00 msgr2=0x7f7cb8069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:05.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7cbd19d700 1 --2- 172.21.15.154:0/3736930174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb80ccc00 0x7f7cb8069ae0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00099b0 tx=0x7f7ca0009250 comp rx=0 tx=0).stop 2023-10-10T21:18:05.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3736930174 shutdown_connections 2023-10-10T21:18:05.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7cbd19d700 1 --2- 172.21.15.154:0/3736930174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 0x7f7cb80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:05.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7cbd19d700 1 --2- 172.21.15.154:0/3736930174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb80ccc00 0x7f7cb8069ae0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:05.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.340+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3736930174 >> 172.21.15.154:0/3736930174 conn(0x7f7cb806baa0 msgr2=0x7f7cb806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:05.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.341+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3736930174 shutdown_connections 2023-10-10T21:18:05.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.341+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3736930174 wait complete. 2023-10-10T21:18:05.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.342+0000 7f7cbd19d700 1 Processor -- start 2023-10-10T21:18:05.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.342+0000 7f7cbd19d700 1 -- start start 2023-10-10T21:18:05.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7cbd19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 0x7f7cb80c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:05.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7cbd19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb80ccc00 0x7f7cb8151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:05.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7cbd19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb8159a60 0x7f7cb80ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:05.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7cbd19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80c7090 con 0x7f7cb80ccc00 2023-10-10T21:18:05.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7cbd19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80b21e0 con 0x7f7cb8159a60 2023-10-10T21:18:05.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7cbd19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80c8a00 con 0x7f7cb806a020 2023-10-10T21:18:05.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7caffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb80ccc00 0x7f7cb8151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:05.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7caffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb80ccc00 0x7f7cb8151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40988/0 (socket says 172.21.15.154:40988) 2023-10-10T21:18:05.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7caffff700 1 -- 172.21.15.154:0/3888985493 learned_addr learned my addr 172.21.15.154:0/3888985493 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:05.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7cb7fff700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 0x7f7cb80c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:05.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.343+0000 7f7cbc99c700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb8159a60 0x7f7cb80ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:05.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7caffff700 1 -- 172.21.15.154:0/3888985493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 msgr2=0x7f7cb80c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:05.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7caffff700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 0x7f7cb80c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:05.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7caffff700 1 -- 172.21.15.154:0/3888985493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb8159a60 msgr2=0x7f7cb80ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:05.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7caffff700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb8159a60 0x7f7cb80ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:05.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7caffff700 1 -- 172.21.15.154:0/3888985493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb0009a20 con 0x7f7cb80ccc00 2023-10-10T21:18:05.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7caffff700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb80ccc00 0x7f7cb8151b60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000b3c0 tx=0x7f7ca0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:05.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7cb4ff9700 1 -- 172.21.15.154:0/3888985493 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000ba60 con 0x7f7cb80ccc00 2023-10-10T21:18:05.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7cb4ff9700 1 -- 172.21.15.154:0/3888985493 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca000bbc0 con 0x7f7cb80ccc00 2023-10-10T21:18:05.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca00094f0 con 0x7f7cb80ccc00 2023-10-10T21:18:05.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7cb4ff9700 1 -- 172.21.15.154:0/3888985493 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0026680 con 0x7f7cb80ccc00 2023-10-10T21:18:05.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.344+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb80b18b0 con 0x7f7cb80ccc00 2023-10-10T21:18:05.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.345+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb80b2370 con 0x7f7cb80ccc00 2023-10-10T21:18:05.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.346+0000 7f7cb4ff9700 1 -- 172.21.15.154:0/3888985493 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ca0023030 con 0x7f7cb80ccc00 2023-10-10T21:18:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.347+0000 7f7cb4ff9700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c98066f30 0x7f7c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.347+0000 7f7cb4ff9700 1 -- 172.21.15.154:0/3888985493 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f7ca0085ec0 con 0x7f7cb80ccc00 2023-10-10T21:18:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.348+0000 7f7cb7fff700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c98066f30 0x7f7c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.348+0000 7f7cb7fff700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c98066f30 0x7f7c980693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8007180 tx=0x7f7ca8007ef0 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.352+0000 7f7cb4ff9700 1 -- 172.21.15.154:0/3888985493 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ca0053040 con 0x7f7cb80ccc00 2023-10-10T21:18:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:05.586+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7cb80caa30 con 0x7f7cb80ccc00 2023-10-10T21:18:06.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.130+0000 7f7cb4ff9700 1 -- 172.21.15.154:0/3888985493 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7ca002e3a0 con 0x7f7cb80ccc00 2023-10-10T21:18:06.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c98066f30 msgr2=0x7f7c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c98066f30 0x7f7c980693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8007180 tx=0x7f7ca8007ef0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb80ccc00 msgr2=0x7f7cb8151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb80ccc00 0x7f7cb8151b60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000b3c0 tx=0x7f7ca0017000 comp rx=0 tx=0).stop 2023-10-10T21:18:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 shutdown_connections 2023-10-10T21:18:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c98066f30 0x7f7c980693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb8159a60 0x7f7cb80ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb806a020 0x7f7cb80c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 --2- 172.21.15.154:0/3888985493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb80ccc00 0x7f7cb8151b60 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 >> 172.21.15.154:0/3888985493 conn(0x7f7cb806baa0 msgr2=0x7f7cb8159e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 shutdown_connections 2023-10-10T21:18:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.133+0000 7f7cbd19d700 1 -- 172.21.15.154:0/3888985493 wait complete. 2023-10-10T21:18:06.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:18:06.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.335+0000 7f557b9ff700 1 Processor -- start 2023-10-10T21:18:06.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.335+0000 7f557b9ff700 1 -- start start 2023-10-10T21:18:06.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.336+0000 7f557b9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5574155c10 0x7f5574155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f557b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55740ac230 0x7f55740ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f557b9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740ad930 con 0x7f55741568a0 2023-10-10T21:18:06.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f557b9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55740acd20 con 0x7f5574155c10 2023-10-10T21:18:06.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f557b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740ad000 con 0x7f55740ac230 2023-10-10T21:18:06.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f5579f9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f55741568a0 0x7f5574156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33084/0 (socket says 172.21.15.154:33084) 2023-10-10T21:18:06.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f5579f9c700 1 -- 172.21.15.154:0/3189618385 learned_addr learned my addr 172.21.15.154:0/3189618385 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:06.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f557979b700 1 --2- 172.21.15.154:0/3189618385 >> v2:172.21.15.154:3300/0 conn(0x7f5574155c10 0x7f5574155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f5578f9a700 1 --2- 172.21.15.154:0/3189618385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55740ac230 0x7f55740ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f556bfff700 1 -- 172.21.15.154:0/3189618385 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193559396 0 0) 0x7f55740ad930 con 0x7f55741568a0 2023-10-10T21:18:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f556bfff700 1 -- 172.21.15.154:0/3189618385 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5560003570 con 0x7f55741568a0 2023-10-10T21:18:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f557979b700 1 -- 172.21.15.154:0/3189618385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55740ac230 msgr2=0x7f55740ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f557979b700 1 --2- 172.21.15.154:0/3189618385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55740ac230 0x7f55740ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f557979b700 1 -- 172.21.15.154:0/3189618385 >> v1:172.21.15.154:6789/0 conn(0x7f55741568a0 legacy=0x7f5574156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.337+0000 7f557979b700 1 -- 172.21.15.154:0/3189618385 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740ad2e0 con 0x7f5574155c10 2023-10-10T21:18:06.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f557979b700 1 --2- 172.21.15.154:0/3189618385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5574155c10 0x7f5574155fe0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f55700098e0 tx=0x7f55700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684c43a8acac7b6f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:06.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f556bfff700 1 -- 172.21.15.154:0/3189618385 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570011630 con 0x7f5574155c10 2023-10-10T21:18:06.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f556bfff700 1 -- 172.21.15.154:0/3189618385 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570011790 con 0x7f5574155c10 2023-10-10T21:18:06.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f556bfff700 1 -- 172.21.15.154:0/3189618385 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570011b30 con 0x7f5574155c10 2023-10-10T21:18:06.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f557b9ff700 1 -- 172.21.15.154:0/3189618385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5574155c10 msgr2=0x7f5574155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f557b9ff700 1 --2- 172.21.15.154:0/3189618385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5574155c10 0x7f5574155fe0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f55700098e0 tx=0x7f55700091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f557b9ff700 1 -- 172.21.15.154:0/3189618385 shutdown_connections 2023-10-10T21:18:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f557b9ff700 1 --2- 172.21.15.154:0/3189618385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5574155c10 0x7f5574155fe0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f557b9ff700 1 --2- 172.21.15.154:0/3189618385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55740ac230 0x7f55740ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.338+0000 7f557b9ff700 1 -- 172.21.15.154:0/3189618385 >> 172.21.15.154:0/3189618385 conn(0x7f557406a320 msgr2=0x7f55740cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.339+0000 7f557b9ff700 1 -- 172.21.15.154:0/3189618385 shutdown_connections 2023-10-10T21:18:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.339+0000 7f557b9ff700 1 -- 172.21.15.154:0/3189618385 wait complete. 2023-10-10T21:18:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.340+0000 7f557b9ff700 1 Processor -- start 2023-10-10T21:18:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.340+0000 7f557b9ff700 1 -- start start 2023-10-10T21:18:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.341+0000 7f557b9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55740ac230 0x7f55740a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.341+0000 7f557b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5574155c10 0x7f55740a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.341+0000 7f557b9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55741568a0 0x7f55740a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.341+0000 7f557b9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740a86c0 con 0x7f55740ac230 2023-10-10T21:18:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.341+0000 7f557b9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740a7ab0 con 0x7f55741568a0 2023-10-10T21:18:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.341+0000 7f557b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740a7d90 con 0x7f5574155c10 2023-10-10T21:18:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.341+0000 7f557979b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55740ac230 0x7f55740a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.341+0000 7f557979b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55740ac230 0x7f55740a73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37246/0 (socket says 172.21.15.154:37246) 2023-10-10T21:18:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.341+0000 7f557979b700 1 -- 172.21.15.154:0/2454674108 learned_addr learned my addr 172.21.15.154:0/2454674108 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f5579f9c700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55741568a0 0x7f55740a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f5578f9a700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5574155c10 0x7f55740a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f557979b700 1 -- 172.21.15.154:0/2454674108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5574155c10 msgr2=0x7f55740a9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f557979b700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5574155c10 0x7f55740a9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f557979b700 1 -- 172.21.15.154:0/2454674108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55741568a0 msgr2=0x7f55740a8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f557979b700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55741568a0 0x7f55740a8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f557979b700 1 -- 172.21.15.154:0/2454674108 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5570009420 con 0x7f55740ac230 2023-10-10T21:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f557979b700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55740ac230 0x7f55740a73d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5574064290 tx=0x7f5570017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f55697fa700 1 -- 172.21.15.154:0/2454674108 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570011b10 con 0x7f55740ac230 2023-10-10T21:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f55697fa700 1 -- 172.21.15.154:0/2454674108 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55700253f0 con 0x7f55740ac230 2023-10-10T21:18:06.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55740a8070 con 0x7f55740ac230 2023-10-10T21:18:06.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f55697fa700 1 -- 172.21.15.154:0/2454674108 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700257b0 con 0x7f55740ac230 2023-10-10T21:18:06.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.342+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55740a9090 con 0x7f55740ac230 2023-10-10T21:18:06.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.343+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557404c3c0 con 0x7f55740ac230 2023-10-10T21:18:06.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.344+0000 7f55697fa700 1 -- 172.21.15.154:0/2454674108 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5570025ba0 con 0x7f55740ac230 2023-10-10T21:18:06.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.345+0000 7f55697fa700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5558066f30 0x7f55580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.345+0000 7f55697fa700 1 -- 172.21.15.154:0/2454674108 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f55700860a0 con 0x7f55740ac230 2023-10-10T21:18:06.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.345+0000 7f5578f9a700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5558066f30 0x7f55580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.346+0000 7f5578f9a700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5558066f30 0x7f55580693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5574142b80 tx=0x7f5564008040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:06.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.350+0000 7f55697fa700 1 -- 172.21.15.154:0/2454674108 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55700530e0 con 0x7f55740ac230 2023-10-10T21:18:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.586+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55740a89a0 con 0x7f55740ac230 2023-10-10T21:18:06.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.587+0000 7f55697fa700 1 -- 172.21.15.154:0/2454674108 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f5570056700 con 0x7f55740ac230 2023-10-10T21:18:06.589 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:06.589 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/136831769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":136831769},{"type":"v1","addr":"172.21.15.154:6837","nonce":136831769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3500808204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3500808204},{"type":"v1","addr":"172.21.15.179:6833","nonce":3500808204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/953113300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":953113300},{"type":"v1","addr":"172.21.15.154:6835","nonce":953113300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:02.569626+0000","modified":"2023-10-10T21:18:06.123950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6472":{"gid":6472,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/434983583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":434983583},{"type":"v1","addr":"172.21.15.179:6835","nonce":434983583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-10T21:18:06.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5558066f30 msgr2=0x7f55580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5558066f30 0x7f55580693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5574142b80 tx=0x7f5564008040 comp rx=0 tx=0).stop 2023-10-10T21:18:06.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55740ac230 msgr2=0x7f55740a73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55740ac230 0x7f55740a73d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5574064290 tx=0x7f5570017000 comp rx=0 tx=0).stop 2023-10-10T21:18:06.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 shutdown_connections 2023-10-10T21:18:06.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5558066f30 0x7f55580693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55741568a0 0x7f55740a8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55740ac230 0x7f55740a73d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 --2- 172.21.15.154:0/2454674108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5574155c10 0x7f55740a9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 >> 172.21.15.154:0/2454674108 conn(0x7f557406a320 msgr2=0x7f55740b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:06.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 shutdown_connections 2023-10-10T21:18:06.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.589+0000 7f557b9ff700 1 -- 172.21.15.154:0/2454674108 wait complete. 2023-10-10T21:18:06.593 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 38 2023-10-10T21:18:06.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:06.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.789+0000 7f692c5ff700 1 Processor -- start 2023-10-10T21:18:06.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.789+0000 7f692c5ff700 1 -- start start 2023-10-10T21:18:06.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f692c5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69241578b0 0x7f6924155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f692c5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f69240af2f0 0x7f69240af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f692c5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240ad930 con 0x7f6924155c10 2023-10-10T21:18:06.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f692c5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240b0c80 con 0x7f69241578b0 2023-10-10T21:18:06.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f692c5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240acd20 con 0x7f69240af2f0 2023-10-10T21:18:06.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f692a39b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6924155c10 0x7f69240ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33092/0 (socket says 172.21.15.154:33092) 2023-10-10T21:18:06.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f692a39b700 1 -- 172.21.15.154:0/3483011897 learned_addr learned my addr 172.21.15.154:0/3483011897 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:06.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f6929b9a700 1 --2- 172.21.15.154:0/3483011897 >> v2:172.21.15.154:3300/0 conn(0x7f69241578b0 0x7f6924155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f692ab9c700 1 --2- 172.21.15.154:0/3483011897 >> v2:172.21.15.179:3300/0 conn(0x7f69240af2f0 0x7f69240af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f6929399700 1 -- 172.21.15.154:0/3483011897 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653923451 0 0) 0x7f69240ad930 con 0x7f6924155c10 2023-10-10T21:18:06.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.791+0000 7f6929399700 1 -- 172.21.15.154:0/3483011897 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6910003570 con 0x7f6924155c10 2023-10-10T21:18:06.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.792+0000 7f6929b9a700 1 -- 172.21.15.154:0/3483011897 >> v2:172.21.15.179:3300/0 conn(0x7f69240af2f0 msgr2=0x7f69240af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:06.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.792+0000 7f6929b9a700 1 --2- 172.21.15.154:0/3483011897 >> v2:172.21.15.179:3300/0 conn(0x7f69240af2f0 0x7f69240af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.792+0000 7f6929b9a700 1 -- 172.21.15.154:0/3483011897 >> v1:172.21.15.154:6789/0 conn(0x7f6924155c10 legacy=0x7f69240ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.792+0000 7f6929b9a700 1 -- 172.21.15.154:0/3483011897 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240ad000 con 0x7f69241578b0 2023-10-10T21:18:06.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.792+0000 7f6929b9a700 1 --2- 172.21.15.154:0/3483011897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 0x7f6924155fe0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6924065be0 tx=0x7f691400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39625cdd6bf4eeb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:06.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.792+0000 7f6929399700 1 -- 172.21.15.154:0/3483011897 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400aea0 con 0x7f69241578b0 2023-10-10T21:18:06.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.792+0000 7f6929399700 1 -- 172.21.15.154:0/3483011897 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691400c970 con 0x7f69241578b0 2023-10-10T21:18:06.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.792+0000 7f6929399700 1 -- 172.21.15.154:0/3483011897 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400cd10 con 0x7f69241578b0 2023-10-10T21:18:06.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.793+0000 7f692c5ff700 1 -- 172.21.15.154:0/3483011897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 msgr2=0x7f6924155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.793+0000 7f692c5ff700 1 --2- 172.21.15.154:0/3483011897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 0x7f6924155fe0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6924065be0 tx=0x7f691400a330 comp rx=0 tx=0).stop 2023-10-10T21:18:06.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.793+0000 7f692c5ff700 1 -- 172.21.15.154:0/3483011897 shutdown_connections 2023-10-10T21:18:06.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.793+0000 7f692c5ff700 1 --2- 172.21.15.154:0/3483011897 >> v2:172.21.15.179:3300/0 conn(0x7f69240af2f0 0x7f69240af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.793+0000 7f692c5ff700 1 --2- 172.21.15.154:0/3483011897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 0x7f6924155fe0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.793+0000 7f692c5ff700 1 -- 172.21.15.154:0/3483011897 >> 172.21.15.154:0/3483011897 conn(0x7f692406a320 msgr2=0x7f69240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:06.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.793+0000 7f692c5ff700 1 -- 172.21.15.154:0/3483011897 shutdown_connections 2023-10-10T21:18:06.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.793+0000 7f692c5ff700 1 -- 172.21.15.154:0/3483011897 wait complete. 2023-10-10T21:18:06.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.794+0000 7f692c5ff700 1 Processor -- start 2023-10-10T21:18:06.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.794+0000 7f692c5ff700 1 -- start start 2023-10-10T21:18:06.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.795+0000 7f692c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240af2f0 0x7f692406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.795+0000 7f692c5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6924155c10 0x7f6924159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.795+0000 7f692c5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 0x7f692415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.795+0000 7f692c5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692414e600 con 0x7f69241578b0 2023-10-10T21:18:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.795+0000 7f692c5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692415a9c0 con 0x7f6924155c10 2023-10-10T21:18:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.795+0000 7f692c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692415aca0 con 0x7f69240af2f0 2023-10-10T21:18:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692ab9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 0x7f692415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692ab9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 0x7f692415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37264/0 (socket says 172.21.15.154:37264) 2023-10-10T21:18:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692ab9c700 1 -- 172.21.15.154:0/2331664019 learned_addr learned my addr 172.21.15.154:0/2331664019 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692a39b700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240af2f0 0x7f692406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f6929b9a700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6924155c10 0x7f6924159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692ab9c700 1 -- 172.21.15.154:0/2331664019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240af2f0 msgr2=0x7f692406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692ab9c700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240af2f0 0x7f692406e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692ab9c700 1 -- 172.21.15.154:0/2331664019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6924155c10 msgr2=0x7f6924159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692ab9c700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6924155c10 0x7f6924159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692ab9c700 1 -- 172.21.15.154:0/2331664019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691400a5d0 con 0x7f69241578b0 2023-10-10T21:18:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.796+0000 7f692ab9c700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 0x7f692415a340 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f691c009e90 tx=0x7f691c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.797+0000 7f691a7fc700 1 -- 172.21.15.154:0/2331664019 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00cb70 con 0x7f69241578b0 2023-10-10T21:18:06.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.797+0000 7f691a7fc700 1 -- 172.21.15.154:0/2331664019 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c00f040 con 0x7f69241578b0 2023-10-10T21:18:06.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.797+0000 7f691a7fc700 1 -- 172.21.15.154:0/2331664019 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c014480 con 0x7f69241578b0 2023-10-10T21:18:06.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.797+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692415af80 con 0x7f69241578b0 2023-10-10T21:18:06.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.797+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692415b540 con 0x7f69241578b0 2023-10-10T21:18:06.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.798+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692404c3c0 con 0x7f69241578b0 2023-10-10T21:18:06.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.799+0000 7f691a7fc700 1 -- 172.21.15.154:0/2331664019 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f691c014830 con 0x7f69241578b0 2023-10-10T21:18:06.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.799+0000 7f691a7fc700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6908066f30 0x7f69080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:06.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.799+0000 7f691a7fc700 1 -- 172.21.15.154:0/2331664019 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f691c085130 con 0x7f69241578b0 2023-10-10T21:18:06.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.800+0000 7f692a39b700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6908066f30 0x7f69080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.800+0000 7f692a39b700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6908066f30 0x7f69080693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6920007fd0 tx=0x7f6920009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.804+0000 7f691a7fc700 1 -- 172.21.15.154:0/2331664019 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f691c052170 con 0x7f69241578b0 2023-10-10T21:18:06.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.996+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69240ad2e0 con 0x7f69241578b0 2023-10-10T21:18:06.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.997+0000 7f691a7fc700 1 -- 172.21.15.154:0/2331664019 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+15996 (secure 0 0 0) 0x7f691c055790 con 0x7f69241578b0 2023-10-10T21:18:06.998 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:06.998 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":95,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:04.109223+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:00.451391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:01.546798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6908066f30 msgr2=0x7f69080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6908066f30 0x7f69080693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6920007fd0 tx=0x7f6920009040 comp rx=0 tx=0).stop 2023-10-10T21:18:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 msgr2=0x7f692415a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 0x7f692415a340 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f691c009e90 tx=0x7f691c00b040 comp rx=0 tx=0).stop 2023-10-10T21:18:07.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 shutdown_connections 2023-10-10T21:18:07.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69241578b0 0x7f692415a340 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69240af2f0 0x7f692406e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6908066f30 0x7f69080693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 --2- 172.21.15.154:0/2331664019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6924155c10 0x7f6924159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 >> 172.21.15.154:0/2331664019 conn(0x7f692406a320 msgr2=0x7f692414ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:07.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 shutdown_connections 2023-10-10T21:18:07.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:06.999+0000 7f692c5ff700 1 -- 172.21.15.154:0/2331664019 wait complete. 2023-10-10T21:18:07.018 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T21:18:07.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:07.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.204+0000 7f5fed59d700 1 Processor -- start 2023-10-10T21:18:07.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.204+0000 7f5fed59d700 1 -- start start 2023-10-10T21:18:07.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.205+0000 7f5fed59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 0x7f5fe80ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.205+0000 7f5fed59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fe80cb900 0x7f5fe80ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.205+0000 7f5fed59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe80ca860 con 0x7f5fe8156310 2023-10-10T21:18:07.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.205+0000 7f5fed59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe80cab40 con 0x7f5fe80cb900 2023-10-10T21:18:07.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.205+0000 7f5fed59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe80cae20 con 0x7f5fe81566e0 2023-10-10T21:18:07.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.205+0000 7f5fecd9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fe80cb900 0x7f5fe80ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.205+0000 7f5fecd9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fe80cb900 0x7f5fe80ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37274/0 (socket says 172.21.15.154:37274) 2023-10-10T21:18:07.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.205+0000 7f5fecd9c700 1 -- 172.21.15.154:0/575036346 learned_addr learned my addr 172.21.15.154:0/575036346 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:07.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.205+0000 7f5fe7fff700 1 --1- 172.21.15.154:0/575036346 >> v1:172.21.15.154:6789/0 conn(0x7f5fe8156310 0x7f5fe80c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33104/0 (socket says 172.21.15.154:33104) 2023-10-10T21:18:07.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fe77fe700 1 --2- 172.21.15.154:0/575036346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 0x7f5fe80ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fecd9c700 1 -- 172.21.15.154:0/575036346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 msgr2=0x7f5fe80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fecd9c700 1 --2- 172.21.15.154:0/575036346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 0x7f5fe80ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fecd9c700 1 -- 172.21.15.154:0/575036346 >> v1:172.21.15.154:6789/0 conn(0x7f5fe8156310 legacy=0x7f5fe80c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fecd9c700 1 -- 172.21.15.154:0/575036346 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe80cb100 con 0x7f5fe80cb900 2023-10-10T21:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fe6ffd700 1 -- 172.21.15.154:0/575036346 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701992929 0 0) 0x7f5fe80ca860 con 0x7f5fe8156310 2023-10-10T21:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fe77fe700 1 --2- 172.21.15.154:0/575036346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 0x7f5fe80ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:07.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fecd9c700 1 --2- 172.21.15.154:0/575036346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe80cb900 0x7f5fe80ae540 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009f20 tx=0x7f5fe0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a28f05582eed1a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:07.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fe6ffd700 1 -- 172.21.15.154:0/575036346 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000e070 con 0x7f5fe80cb900 2023-10-10T21:18:07.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fe6ffd700 1 -- 172.21.15.154:0/575036346 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe000ba80 con 0x7f5fe80cb900 2023-10-10T21:18:07.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.206+0000 7f5fe6ffd700 1 -- 172.21.15.154:0/575036346 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00092e0 con 0x7f5fe80cb900 2023-10-10T21:18:07.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.207+0000 7f5fed59d700 1 -- 172.21.15.154:0/575036346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe80cb900 msgr2=0x7f5fe80ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.207+0000 7f5fed59d700 1 --2- 172.21.15.154:0/575036346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe80cb900 0x7f5fe80ae540 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009f20 tx=0x7f5fe0009840 comp rx=0 tx=0).stop 2023-10-10T21:18:07.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.207+0000 7f5fed59d700 1 -- 172.21.15.154:0/575036346 shutdown_connections 2023-10-10T21:18:07.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.207+0000 7f5fed59d700 1 --2- 172.21.15.154:0/575036346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe80cb900 0x7f5fe80ae540 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.207+0000 7f5fed59d700 1 --2- 172.21.15.154:0/575036346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 0x7f5fe80ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.207+0000 7f5fed59d700 1 -- 172.21.15.154:0/575036346 >> 172.21.15.154:0/575036346 conn(0x7f5fe80cc1f0 msgr2=0x7f5fe80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:07.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.207+0000 7f5fed59d700 1 -- 172.21.15.154:0/575036346 shutdown_connections 2023-10-10T21:18:07.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.207+0000 7f5fed59d700 1 -- 172.21.15.154:0/575036346 wait complete. 2023-10-10T21:18:07.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.208+0000 7f5fed59d700 1 Processor -- start 2023-10-10T21:18:07.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.209+0000 7f5fed59d700 1 -- start start 2023-10-10T21:18:07.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.209+0000 7f5fed59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe80cb900 0x7f5fe815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.209+0000 7f5fed59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe8156310 0x7f5fe8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.209+0000 7f5fed59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 0x7f5fe8157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.209+0000 7f5fed59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe814e400 con 0x7f5fe8156310 2023-10-10T21:18:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fed59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8158150 con 0x7f5fe80cb900 2023-10-10T21:18:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fed59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8158430 con 0x7f5fe81566e0 2023-10-10T21:18:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fe77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe8156310 0x7f5fe8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fe77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe8156310 0x7f5fe8157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37290/0 (socket says 172.21.15.154:37290) 2023-10-10T21:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fe77fe700 1 -- 172.21.15.154:0/587132473 learned_addr learned my addr 172.21.15.154:0/587132473 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fecd9c700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 0x7f5fe8157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fe7fff700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe80cb900 0x7f5fe815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fe77fe700 1 -- 172.21.15.154:0/587132473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 msgr2=0x7f5fe8157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fe77fe700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 0x7f5fe8157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fe77fe700 1 -- 172.21.15.154:0/587132473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe80cb900 msgr2=0x7f5fe815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fe77fe700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe80cb900 0x7f5fe815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.210+0000 7f5fe77fe700 1 -- 172.21.15.154:0/587132473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009ae0 con 0x7f5fe8156310 2023-10-10T21:18:07.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.211+0000 7f5fe77fe700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe8156310 0x7f5fe8157590 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00d7e0 tx=0x7f5fdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.211+0000 7f5fcffff700 1 -- 172.21.15.154:0/587132473 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0125f0 con 0x7f5fe8156310 2023-10-10T21:18:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.211+0000 7f5fcffff700 1 -- 172.21.15.154:0/587132473 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc012750 con 0x7f5fe8156310 2023-10-10T21:18:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.211+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe8158710 con 0x7f5fe8156310 2023-10-10T21:18:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.211+0000 7f5fcffff700 1 -- 172.21.15.154:0/587132473 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc012af0 con 0x7f5fe8156310 2023-10-10T21:18:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.211+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe815a690 con 0x7f5fe8156310 2023-10-10T21:18:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.212+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe815a8b0 con 0x7f5fe8156310 2023-10-10T21:18:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.213+0000 7f5fcffff700 1 -- 172.21.15.154:0/587132473 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fdc013480 con 0x7f5fe8156310 2023-10-10T21:18:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.214+0000 7f5fcffff700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5fd4066f30 0x7f5fd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.214+0000 7f5fcffff700 1 -- 172.21.15.154:0/587132473 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5fdc084a90 con 0x7f5fe8156310 2023-10-10T21:18:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.214+0000 7f5fe7fff700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5fd4066f30 0x7f5fd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.214+0000 7f5fe7fff700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5fd4066f30 0x7f5fd40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8007fd0 tx=0x7f5fd8007d50 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:07.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.218+0000 7f5fcffff700 1 -- 172.21.15.154:0/587132473 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fdc051ad0 con 0x7f5fe8156310 2023-10-10T21:18:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.406+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5fe813aa10 con 0x7f5fd4066f30 2023-10-10T21:18:07.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.416+0000 7f5fcffff700 1 -- 172.21.15.154:0/587132473 <== mgr.6531 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286187 (secure 0 0 0) 0x7f5fd8004ca0 con 0x7f5fd4066f30 2023-10-10T21:18:07.422 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:07.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5fd4066f30 msgr2=0x7f5fd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5fd4066f30 0x7f5fd40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8007fd0 tx=0x7f5fd8007d50 comp rx=0 tx=0).stop 2023-10-10T21:18:07.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe8156310 msgr2=0x7f5fe8157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe8156310 0x7f5fe8157590 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00d7e0 tx=0x7f5fdc008040 comp rx=0 tx=0).stop 2023-10-10T21:18:07.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 shutdown_connections 2023-10-10T21:18:07.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fe81566e0 0x7f5fe8157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5fd4066f30 0x7f5fd40693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe80cb900 0x7f5fe815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 --2- 172.21.15.154:0/587132473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe8156310 0x7f5fe8157590 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 >> 172.21.15.154:0/587132473 conn(0x7f5fe80cc1f0 msgr2=0x7f5fe8150f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:07.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 shutdown_connections 2023-10-10T21:18:07.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.421+0000 7f5fed59d700 1 -- 172.21.15.154:0/587132473 wait complete. 2023-10-10T21:18:07.429 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:07.441 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:18:06.790656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592582,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":314,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433524,"kb_used_data":10164,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541196,"statfs":{"total":773094113280,"available":770602184704,"internally_reserved":0,"allocated":10407936,"data_stored":5598858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2214,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.703887"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128453+0000","last_change":"2023-10-10T21:18:03.123147+0000","last_active":"2023-10-10T21:18:03.128453+0000","last_peered":"2023-10-10T21:18:03.128453+0000","last_clean":"2023-10-10T21:18:03.128453+0000","last_became_active":"2023-10-10T21:18:03.122883+0000","last_became_peered":"2023-10-10T21:18:03.122883+0000","last_unstale":"2023-10-10T21:18:03.128453+0000","last_undegraded":"2023-10-10T21:18:03.128453+0000","last_fullsized":"2023-10-10T21:18:03.128453+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:28:36.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121489+0000","last_change":"2023-10-10T21:18:03.116758+0000","last_active":"2023-10-10T21:18:03.121489+0000","last_peered":"2023-10-10T21:18:03.121489+0000","last_clean":"2023-10-10T21:18:03.121489+0000","last_became_active":"2023-10-10T21:18:03.116472+0000","last_became_peered":"2023-10-10T21:18:03.116472+0000","last_unstale":"2023-10-10T21:18:03.121489+0000","last_undegraded":"2023-10-10T21:18:03.121489+0000","last_fullsized":"2023-10-10T21:18:03.121489+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:26.091130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132434+0000","last_change":"2023-10-10T21:18:03.128869+0000","last_active":"2023-10-10T21:18:03.132434+0000","last_peered":"2023-10-10T21:18:03.132434+0000","last_clean":"2023-10-10T21:18:03.132434+0000","last_became_active":"2023-10-10T21:18:03.128610+0000","last_became_peered":"2023-10-10T21:18:03.128610+0000","last_unstale":"2023-10-10T21:18:03.132434+0000","last_undegraded":"2023-10-10T21:18:03.132434+0000","last_fullsized":"2023-10-10T21:18:03.132434+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:47.801041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.119402+0000","last_change":"2023-10-10T21:18:03.113980+0000","last_active":"2023-10-10T21:18:03.119402+0000","last_peered":"2023-10-10T21:18:03.119402+0000","last_clean":"2023-10-10T21:18:03.119402+0000","last_became_active":"2023-10-10T21:18:03.113689+0000","last_became_peered":"2023-10-10T21:18:03.113689+0000","last_unstale":"2023-10-10T21:18:03.119402+0000","last_undegraded":"2023-10-10T21:18:03.119402+0000","last_fullsized":"2023-10-10T21:18:03.119402+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:22:18.290768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121849+0000","last_change":"2023-10-10T21:18:03.115993+0000","last_active":"2023-10-10T21:18:03.121849+0000","last_peered":"2023-10-10T21:18:03.121849+0000","last_clean":"2023-10-10T21:18:03.121849+0000","last_became_active":"2023-10-10T21:18:03.114933+0000","last_became_peered":"2023-10-10T21:18:03.114933+0000","last_unstale":"2023-10-10T21:18:03.121849+0000","last_undegraded":"2023-10-10T21:18:03.121849+0000","last_fullsized":"2023-10-10T21:18:03.121849+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:09.169541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120078+0000","last_change":"2023-10-10T21:18:03.116446+0000","last_active":"2023-10-10T21:18:03.120078+0000","last_peered":"2023-10-10T21:18:03.120078+0000","last_clean":"2023-10-10T21:18:03.120078+0000","last_became_active":"2023-10-10T21:18:03.116170+0000","last_became_peered":"2023-10-10T21:18:03.116170+0000","last_unstale":"2023-10-10T21:18:03.120078+0000","last_undegraded":"2023-10-10T21:18:03.120078+0000","last_fullsized":"2023-10-10T21:18:03.120078+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:11:20.228457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126153+0000","last_change":"2023-10-10T21:18:03.122782+0000","last_active":"2023-10-10T21:18:03.126153+0000","last_peered":"2023-10-10T21:18:03.126153+0000","last_clean":"2023-10-10T21:18:03.126153+0000","last_became_active":"2023-10-10T21:18:03.122522+0000","last_became_peered":"2023-10-10T21:18:03.122522+0000","last_unstale":"2023-10-10T21:18:03.126153+0000","last_undegraded":"2023-10-10T21:18:03.126153+0000","last_fullsized":"2023-10-10T21:18:03.126153+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:16.215761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118425+0000","last_change":"2023-10-10T21:18:03.114857+0000","last_active":"2023-10-10T21:18:03.118425+0000","last_peered":"2023-10-10T21:18:03.118425+0000","last_clean":"2023-10-10T21:18:03.118425+0000","last_became_active":"2023-10-10T21:18:03.114601+0000","last_became_peered":"2023-10-10T21:18:03.114601+0000","last_unstale":"2023-10-10T21:18:03.118425+0000","last_undegraded":"2023-10-10T21:18:03.118425+0000","last_fullsized":"2023-10-10T21:18:03.118425+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:43.812657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124840+0000","last_change":"2023-10-10T21:18:03.124241+0000","last_active":"2023-10-10T21:18:03.124840+0000","last_peered":"2023-10-10T21:18:03.124840+0000","last_clean":"2023-10-10T21:18:03.124840+0000","last_became_active":"2023-10-10T21:18:03.123943+0000","last_became_peered":"2023-10-10T21:18:03.123943+0000","last_unstale":"2023-10-10T21:18:03.124840+0000","last_undegraded":"2023-10-10T21:18:03.124840+0000","last_fullsized":"2023-10-10T21:18:03.124840+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115678+0000","last_change":"2023-10-10T21:18:03.111549+0000","last_active":"2023-10-10T21:18:03.115678+0000","last_peered":"2023-10-10T21:18:03.115678+0000","last_clean":"2023-10-10T21:18:03.115678+0000","last_became_active":"2023-10-10T21:18:03.111171+0000","last_became_peered":"2023-10-10T21:18:03.111171+0000","last_unstale":"2023-10-10T21:18:03.115678+0000","last_undegraded":"2023-10-10T21:18:03.115678+0000","last_fullsized":"2023-10-10T21:18:03.115678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:48:55.981597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118815+0000","last_change":"2023-10-10T21:18:03.113743+0000","last_active":"2023-10-10T21:18:03.118815+0000","last_peered":"2023-10-10T21:18:03.118815+0000","last_clean":"2023-10-10T21:18:03.118815+0000","last_became_active":"2023-10-10T21:18:03.113483+0000","last_became_peered":"2023-10-10T21:18:03.113483+0000","last_unstale":"2023-10-10T21:18:03.118815+0000","last_undegraded":"2023-10-10T21:18:03.118815+0000","last_fullsized":"2023-10-10T21:18:03.118815+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:48.507042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135387+0000","last_change":"2023-10-10T21:18:03.133411+0000","last_active":"2023-10-10T21:18:03.135387+0000","last_peered":"2023-10-10T21:18:03.135387+0000","last_clean":"2023-10-10T21:18:03.135387+0000","last_became_active":"2023-10-10T21:18:03.133113+0000","last_became_peered":"2023-10-10T21:18:03.133113+0000","last_unstale":"2023-10-10T21:18:03.135387+0000","last_undegraded":"2023-10-10T21:18:03.135387+0000","last_fullsized":"2023-10-10T21:18:03.135387+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:07:30.524167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121779+0000","last_change":"2023-10-10T21:18:03.115176+0000","last_active":"2023-10-10T21:18:03.121779+0000","last_peered":"2023-10-10T21:18:03.121779+0000","last_clean":"2023-10-10T21:18:03.121779+0000","last_became_active":"2023-10-10T21:18:03.114425+0000","last_became_peered":"2023-10-10T21:18:03.114425+0000","last_unstale":"2023-10-10T21:18:03.121779+0000","last_undegraded":"2023-10-10T21:18:03.121779+0000","last_fullsized":"2023-10-10T21:18:03.121779+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:30.856134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132619+0000","last_change":"2023-10-10T21:18:03.128819+0000","last_active":"2023-10-10T21:18:03.132619+0000","last_peered":"2023-10-10T21:18:03.132619+0000","last_clean":"2023-10-10T21:18:03.132619+0000","last_became_active":"2023-10-10T21:18:03.128567+0000","last_became_peered":"2023-10-10T21:18:03.128567+0000","last_unstale":"2023-10-10T21:18:03.132619+0000","last_undegraded":"2023-10-10T21:18:03.132619+0000","last_fullsized":"2023-10-10T21:18:03.132619+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:01:23.478813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.114086+0000","last_change":"2023-10-10T21:18:03.109240+0000","last_active":"2023-10-10T21:18:03.114086+0000","last_peered":"2023-10-10T21:18:03.114086+0000","last_clean":"2023-10-10T21:18:03.114086+0000","last_became_active":"2023-10-10T21:18:03.108970+0000","last_became_peered":"2023-10-10T21:18:03.108970+0000","last_unstale":"2023-10-10T21:18:03.114086+0000","last_undegraded":"2023-10-10T21:18:03.114086+0000","last_fullsized":"2023-10-10T21:18:03.114086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:51:48.404639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124382+0000","last_change":"2023-10-10T21:18:03.117935+0000","last_active":"2023-10-10T21:18:03.124382+0000","last_peered":"2023-10-10T21:18:03.124382+0000","last_clean":"2023-10-10T21:18:03.124382+0000","last_became_active":"2023-10-10T21:18:03.117552+0000","last_became_peered":"2023-10-10T21:18:03.117552+0000","last_unstale":"2023-10-10T21:18:03.124382+0000","last_undegraded":"2023-10-10T21:18:03.124382+0000","last_fullsized":"2023-10-10T21:18:03.124382+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:24:39.255862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.122399+0000","last_change":"2023-10-10T21:18:03.113509+0000","last_active":"2023-10-10T21:18:03.122399+0000","last_peered":"2023-10-10T21:18:03.122399+0000","last_clean":"2023-10-10T21:18:03.122399+0000","last_became_active":"2023-10-10T21:18:03.113227+0000","last_became_peered":"2023-10-10T21:18:03.113227+0000","last_unstale":"2023-10-10T21:18:03.122399+0000","last_undegraded":"2023-10-10T21:18:03.122399+0000","last_fullsized":"2023-10-10T21:18:03.122399+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:19:10.967416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129924+0000","last_change":"2023-10-10T21:18:03.126424+0000","last_active":"2023-10-10T21:18:03.129924+0000","last_peered":"2023-10-10T21:18:03.129924+0000","last_clean":"2023-10-10T21:18:03.129924+0000","last_became_active":"2023-10-10T21:18:03.125673+0000","last_became_peered":"2023-10-10T21:18:03.125673+0000","last_unstale":"2023-10-10T21:18:03.129924+0000","last_undegraded":"2023-10-10T21:18:03.129924+0000","last_fullsized":"2023-10-10T21:18:03.129924+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:22.538251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138071+0000","last_change":"2023-10-10T21:18:03.136560+0000","last_active":"2023-10-10T21:18:03.138071+0000","last_peered":"2023-10-10T21:18:03.138071+0000","last_clean":"2023-10-10T21:18:03.138071+0000","last_became_active":"2023-10-10T21:18:03.136301+0000","last_became_peered":"2023-10-10T21:18:03.136301+0000","last_unstale":"2023-10-10T21:18:03.138071+0000","last_undegraded":"2023-10-10T21:18:03.138071+0000","last_fullsized":"2023-10-10T21:18:03.138071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:10.463301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128656+0000","last_change":"2023-10-10T21:18:03.125260+0000","last_active":"2023-10-10T21:18:03.128656+0000","last_peered":"2023-10-10T21:18:03.128656+0000","last_clean":"2023-10-10T21:18:03.128656+0000","last_became_active":"2023-10-10T21:18:03.124986+0000","last_became_peered":"2023-10-10T21:18:03.124986+0000","last_unstale":"2023-10-10T21:18:03.128656+0000","last_undegraded":"2023-10-10T21:18:03.128656+0000","last_fullsized":"2023-10-10T21:18:03.128656+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:28:14.399113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121625+0000","last_change":"2023-10-10T21:18:03.118901+0000","last_active":"2023-10-10T21:18:03.121625+0000","last_peered":"2023-10-10T21:18:03.121625+0000","last_clean":"2023-10-10T21:18:03.121625+0000","last_became_active":"2023-10-10T21:18:03.118655+0000","last_became_peered":"2023-10-10T21:18:03.118655+0000","last_unstale":"2023-10-10T21:18:03.121625+0000","last_undegraded":"2023-10-10T21:18:03.121625+0000","last_fullsized":"2023-10-10T21:18:03.121625+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:35:55.138638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125083+0000","last_change":"2023-10-10T21:18:03.121035+0000","last_active":"2023-10-10T21:18:03.125083+0000","last_peered":"2023-10-10T21:18:03.125083+0000","last_clean":"2023-10-10T21:18:03.125083+0000","last_became_active":"2023-10-10T21:18:03.120773+0000","last_became_peered":"2023-10-10T21:18:03.120773+0000","last_unstale":"2023-10-10T21:18:03.125083+0000","last_undegraded":"2023-10-10T21:18:03.125083+0000","last_fullsized":"2023-10-10T21:18:03.125083+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:14.654306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121369+0000","last_change":"2023-10-10T21:18:03.115215+0000","last_active":"2023-10-10T21:18:03.121369+0000","last_peered":"2023-10-10T21:18:03.121369+0000","last_clean":"2023-10-10T21:18:03.121369+0000","last_became_active":"2023-10-10T21:18:03.114868+0000","last_became_peered":"2023-10-10T21:18:03.114868+0000","last_unstale":"2023-10-10T21:18:03.121369+0000","last_undegraded":"2023-10-10T21:18:03.121369+0000","last_fullsized":"2023-10-10T21:18:03.121369+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:05.639479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129609+0000","last_change":"2023-10-10T21:18:03.126162+0000","last_active":"2023-10-10T21:18:03.129609+0000","last_peered":"2023-10-10T21:18:03.129609+0000","last_clean":"2023-10-10T21:18:03.129609+0000","last_became_active":"2023-10-10T21:18:03.125841+0000","last_became_peered":"2023-10-10T21:18:03.125841+0000","last_unstale":"2023-10-10T21:18:03.129609+0000","last_undegraded":"2023-10-10T21:18:03.129609+0000","last_fullsized":"2023-10-10T21:18:03.129609+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:21.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"94'4","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138188+0000","last_change":"2023-10-10T21:18:02.102666+0000","last_active":"2023-10-10T21:18:03.138188+0000","last_peered":"2023-10-10T21:18:03.138188+0000","last_clean":"2023-10-10T21:18:03.138188+0000","last_became_active":"2023-10-10T21:18:02.102354+0000","last_became_peered":"2023-10-10T21:18:02.102354+0000","last_unstale":"2023-10-10T21:18:03.138188+0000","last_undegraded":"2023-10-10T21:18:03.138188+0000","last_fullsized":"2023-10-10T21:18:03.138188+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121828+0000","last_change":"2023-10-10T21:18:03.115827+0000","last_active":"2023-10-10T21:18:03.121828+0000","last_peered":"2023-10-10T21:18:03.121828+0000","last_clean":"2023-10-10T21:18:03.121828+0000","last_became_active":"2023-10-10T21:18:03.114749+0000","last_became_peered":"2023-10-10T21:18:03.114749+0000","last_unstale":"2023-10-10T21:18:03.121828+0000","last_undegraded":"2023-10-10T21:18:03.121828+0000","last_fullsized":"2023-10-10T21:18:03.121828+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:25.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135289+0000","last_change":"2023-10-10T21:18:02.104346+0000","last_active":"2023-10-10T21:18:03.135289+0000","last_peered":"2023-10-10T21:18:03.135289+0000","last_clean":"2023-10-10T21:18:03.135289+0000","last_became_active":"2023-10-10T21:18:02.104087+0000","last_became_peered":"2023-10-10T21:18:02.104087+0000","last_unstale":"2023-10-10T21:18:03.135289+0000","last_undegraded":"2023-10-10T21:18:03.135289+0000","last_fullsized":"2023-10-10T21:18:03.135289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140721+0000","last_change":"2023-10-10T21:18:02.115690+0000","last_active":"2023-10-10T21:18:03.140721+0000","last_peered":"2023-10-10T21:18:03.140721+0000","last_clean":"2023-10-10T21:18:03.140721+0000","last_became_active":"2023-10-10T21:18:02.115385+0000","last_became_peered":"2023-10-10T21:18:02.115385+0000","last_unstale":"2023-10-10T21:18:03.140721+0000","last_undegraded":"2023-10-10T21:18:03.140721+0000","last_fullsized":"2023-10-10T21:18:03.140721+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:00.443737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124744+0000","last_change":"2023-10-10T21:18:03.117499+0000","last_active":"2023-10-10T21:18:03.124744+0000","last_peered":"2023-10-10T21:18:03.124744+0000","last_clean":"2023-10-10T21:18:03.124744+0000","last_became_active":"2023-10-10T21:18:03.117056+0000","last_became_peered":"2023-10-10T21:18:03.117056+0000","last_unstale":"2023-10-10T21:18:03.124744+0000","last_undegraded":"2023-10-10T21:18:03.124744+0000","last_fullsized":"2023-10-10T21:18:03.124744+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095815+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:23.810550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132671+0000","last_change":"2023-10-10T21:18:02.105454+0000","last_active":"2023-10-10T21:18:03.132671+0000","last_peered":"2023-10-10T21:18:03.132671+0000","last_clean":"2023-10-10T21:18:03.132671+0000","last_became_active":"2023-10-10T21:18:02.104962+0000","last_became_peered":"2023-10-10T21:18:02.104962+0000","last_unstale":"2023-10-10T21:18:03.132671+0000","last_undegraded":"2023-10-10T21:18:03.132671+0000","last_fullsized":"2023-10-10T21:18:03.132671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:42.291687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130936+0000","last_change":"2023-10-10T21:18:03.127926+0000","last_active":"2023-10-10T21:18:03.130936+0000","last_peered":"2023-10-10T21:18:03.130936+0000","last_clean":"2023-10-10T21:18:03.130936+0000","last_became_active":"2023-10-10T21:18:03.127034+0000","last_became_peered":"2023-10-10T21:18:03.127034+0000","last_unstale":"2023-10-10T21:18:03.130936+0000","last_undegraded":"2023-10-10T21:18:03.130936+0000","last_fullsized":"2023-10-10T21:18:03.130936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:05:17.246909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.097122+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:12:29.772033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124869+0000","last_change":"2023-10-10T21:18:03.122508+0000","last_active":"2023-10-10T21:18:03.124869+0000","last_peered":"2023-10-10T21:18:03.124869+0000","last_clean":"2023-10-10T21:18:03.124869+0000","last_became_active":"2023-10-10T21:18:03.122245+0000","last_became_peered":"2023-10-10T21:18:03.122245+0000","last_unstale":"2023-10-10T21:18:03.124869+0000","last_undegraded":"2023-10-10T21:18:03.124869+0000","last_fullsized":"2023-10-10T21:18:03.124869+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:41.065339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104533+0000","last_change":"2023-10-10T21:18:02.112370+0000","last_active":"2023-10-10T21:18:03.104533+0000","last_peered":"2023-10-10T21:18:03.104533+0000","last_clean":"2023-10-10T21:18:03.104533+0000","last_became_active":"2023-10-10T21:18:02.112099+0000","last_became_peered":"2023-10-10T21:18:02.112099+0000","last_unstale":"2023-10-10T21:18:03.104533+0000","last_undegraded":"2023-10-10T21:18:03.104533+0000","last_fullsized":"2023-10-10T21:18:03.104533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:03.288893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121084+0000","last_change":"2023-10-10T21:18:03.118553+0000","last_active":"2023-10-10T21:18:03.121084+0000","last_peered":"2023-10-10T21:18:03.121084+0000","last_clean":"2023-10-10T21:18:03.121084+0000","last_became_active":"2023-10-10T21:18:03.118289+0000","last_became_peered":"2023-10-10T21:18:03.118289+0000","last_unstale":"2023-10-10T21:18:03.121084+0000","last_undegraded":"2023-10-10T21:18:03.121084+0000","last_fullsized":"2023-10-10T21:18:03.121084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:05.319721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105764+0000","last_change":"2023-10-10T21:18:02.103988+0000","last_active":"2023-10-10T21:18:03.105764+0000","last_peered":"2023-10-10T21:18:03.105764+0000","last_clean":"2023-10-10T21:18:03.105764+0000","last_became_active":"2023-10-10T21:18:02.103709+0000","last_became_peered":"2023-10-10T21:18:02.103709+0000","last_unstale":"2023-10-10T21:18:03.105764+0000","last_undegraded":"2023-10-10T21:18:03.105764+0000","last_fullsized":"2023-10-10T21:18:03.105764+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:43.528613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105952+0000","last_change":"2023-10-10T21:18:02.097199+0000","last_active":"2023-10-10T21:18:03.105952+0000","last_peered":"2023-10-10T21:18:03.105952+0000","last_clean":"2023-10-10T21:18:03.105952+0000","last_became_active":"2023-10-10T21:18:02.096924+0000","last_became_peered":"2023-10-10T21:18:02.096924+0000","last_unstale":"2023-10-10T21:18:03.105952+0000","last_undegraded":"2023-10-10T21:18:03.105952+0000","last_fullsized":"2023-10-10T21:18:03.105952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:42.119227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137096+0000","last_change":"2023-10-10T21:18:03.134927+0000","last_active":"2023-10-10T21:18:03.137096+0000","last_peered":"2023-10-10T21:18:03.137096+0000","last_clean":"2023-10-10T21:18:03.137096+0000","last_became_active":"2023-10-10T21:18:03.134663+0000","last_became_peered":"2023-10-10T21:18:03.134663+0000","last_unstale":"2023-10-10T21:18:03.137096+0000","last_undegraded":"2023-10-10T21:18:03.137096+0000","last_fullsized":"2023-10-10T21:18:03.137096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:02:50.568864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095781+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:29:40.211849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"94'3","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135167+0000","last_change":"2023-10-10T21:18:02.112911+0000","last_active":"2023-10-10T21:18:03.135167+0000","last_peered":"2023-10-10T21:18:03.135167+0000","last_clean":"2023-10-10T21:18:03.135167+0000","last_became_active":"2023-10-10T21:18:02.112580+0000","last_became_peered":"2023-10-10T21:18:02.112580+0000","last_unstale":"2023-10-10T21:18:03.135167+0000","last_undegraded":"2023-10-10T21:18:03.135167+0000","last_fullsized":"2023-10-10T21:18:03.135167+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:49:28.212088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120562+0000","last_change":"2023-10-10T21:18:03.114601+0000","last_active":"2023-10-10T21:18:03.120562+0000","last_peered":"2023-10-10T21:18:03.120562+0000","last_clean":"2023-10-10T21:18:03.120562+0000","last_became_active":"2023-10-10T21:18:03.114335+0000","last_became_peered":"2023-10-10T21:18:03.114335+0000","last_unstale":"2023-10-10T21:18:03.120562+0000","last_undegraded":"2023-10-10T21:18:03.120562+0000","last_fullsized":"2023-10-10T21:18:03.120562+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:59:51.773918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"94'6","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137510+0000","last_change":"2023-10-10T21:18:02.104756+0000","last_active":"2023-10-10T21:18:03.137510+0000","last_peered":"2023-10-10T21:18:03.137510+0000","last_clean":"2023-10-10T21:18:03.137510+0000","last_became_active":"2023-10-10T21:18:02.104493+0000","last_became_peered":"2023-10-10T21:18:02.104493+0000","last_unstale":"2023-10-10T21:18:03.137510+0000","last_undegraded":"2023-10-10T21:18:03.137510+0000","last_fullsized":"2023-10-10T21:18:03.137510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:29:40.211849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127583+0000","last_change":"2023-10-10T21:18:03.123287+0000","last_active":"2023-10-10T21:18:03.127583+0000","last_peered":"2023-10-10T21:18:03.127583+0000","last_clean":"2023-10-10T21:18:03.127583+0000","last_became_active":"2023-10-10T21:18:03.121920+0000","last_became_peered":"2023-10-10T21:18:03.121920+0000","last_unstale":"2023-10-10T21:18:03.127583+0000","last_undegraded":"2023-10-10T21:18:03.127583+0000","last_fullsized":"2023-10-10T21:18:03.127583+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130881+0000","last_change":"2023-10-10T21:18:02.105096+0000","last_active":"2023-10-10T21:18:03.130881+0000","last_peered":"2023-10-10T21:18:03.130881+0000","last_clean":"2023-10-10T21:18:03.130881+0000","last_became_active":"2023-10-10T21:18:02.104823+0000","last_became_peered":"2023-10-10T21:18:02.104823+0000","last_unstale":"2023-10-10T21:18:03.130881+0000","last_undegraded":"2023-10-10T21:18:03.130881+0000","last_fullsized":"2023-10-10T21:18:03.130881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:23.810550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.096574+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:24:31.607986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125859+0000","last_change":"2023-10-10T21:18:03.125107+0000","last_active":"2023-10-10T21:18:03.125859+0000","last_peered":"2023-10-10T21:18:03.125859+0000","last_clean":"2023-10-10T21:18:03.125859+0000","last_became_active":"2023-10-10T21:18:03.124825+0000","last_became_peered":"2023-10-10T21:18:03.124825+0000","last_unstale":"2023-10-10T21:18:03.125859+0000","last_undegraded":"2023-10-10T21:18:03.125859+0000","last_fullsized":"2023-10-10T21:18:03.125859+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.093710+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:06.243413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120796+0000","last_change":"2023-10-10T21:18:03.114682+0000","last_active":"2023-10-10T21:18:03.120796+0000","last_peered":"2023-10-10T21:18:03.120796+0000","last_clean":"2023-10-10T21:18:03.120796+0000","last_became_active":"2023-10-10T21:18:03.114394+0000","last_became_peered":"2023-10-10T21:18:03.114394+0000","last_unstale":"2023-10-10T21:18:03.120796+0000","last_undegraded":"2023-10-10T21:18:03.120796+0000","last_fullsized":"2023-10-10T21:18:03.120796+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:57.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"94'8","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.141200+0000","last_change":"2023-10-10T21:18:02.106816+0000","last_active":"2023-10-10T21:18:03.141200+0000","last_peered":"2023-10-10T21:18:03.141200+0000","last_clean":"2023-10-10T21:18:03.141200+0000","last_became_active":"2023-10-10T21:18:02.106514+0000","last_became_peered":"2023-10-10T21:18:02.106514+0000","last_unstale":"2023-10-10T21:18:03.141200+0000","last_undegraded":"2023-10-10T21:18:03.141200+0000","last_fullsized":"2023-10-10T21:18:03.141200+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:06.243413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.123938+0000","last_change":"2023-10-10T21:18:03.118958+0000","last_active":"2023-10-10T21:18:03.123938+0000","last_peered":"2023-10-10T21:18:03.123938+0000","last_clean":"2023-10-10T21:18:03.123938+0000","last_became_active":"2023-10-10T21:18:03.118715+0000","last_became_peered":"2023-10-10T21:18:03.118715+0000","last_unstale":"2023-10-10T21:18:03.123938+0000","last_undegraded":"2023-10-10T21:18:03.123938+0000","last_fullsized":"2023-10-10T21:18:03.123938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:53.044728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.096578+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:12:58.528943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124747+0000","last_change":"2023-10-10T21:18:03.118846+0000","last_active":"2023-10-10T21:18:03.124747+0000","last_peered":"2023-10-10T21:18:03.124747+0000","last_clean":"2023-10-10T21:18:03.124747+0000","last_became_active":"2023-10-10T21:18:03.118599+0000","last_became_peered":"2023-10-10T21:18:03.118599+0000","last_unstale":"2023-10-10T21:18:03.124747+0000","last_undegraded":"2023-10-10T21:18:03.124747+0000","last_fullsized":"2023-10-10T21:18:03.124747+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:45.905044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140786+0000","last_change":"2023-10-10T21:18:02.116376+0000","last_active":"2023-10-10T21:18:03.140786+0000","last_peered":"2023-10-10T21:18:03.140786+0000","last_clean":"2023-10-10T21:18:03.140786+0000","last_became_active":"2023-10-10T21:18:02.115966+0000","last_became_peered":"2023-10-10T21:18:02.115966+0000","last_unstale":"2023-10-10T21:18:03.140786+0000","last_undegraded":"2023-10-10T21:18:03.140786+0000","last_fullsized":"2023-10-10T21:18:03.140786+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:49:30.267805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118446+0000","last_change":"2023-10-10T21:18:03.115328+0000","last_active":"2023-10-10T21:18:03.118446+0000","last_peered":"2023-10-10T21:18:03.118446+0000","last_clean":"2023-10-10T21:18:03.118446+0000","last_became_active":"2023-10-10T21:18:03.115038+0000","last_became_peered":"2023-10-10T21:18:03.115038+0000","last_unstale":"2023-10-10T21:18:03.118446+0000","last_undegraded":"2023-10-10T21:18:03.118446+0000","last_fullsized":"2023-10-10T21:18:03.118446+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:00:05.036333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095854+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:25:25.103439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127345+0000","last_change":"2023-10-10T21:18:03.126599+0000","last_active":"2023-10-10T21:18:03.127345+0000","last_peered":"2023-10-10T21:18:03.127345+0000","last_clean":"2023-10-10T21:18:03.127345+0000","last_became_active":"2023-10-10T21:18:03.126259+0000","last_became_peered":"2023-10-10T21:18:03.126259+0000","last_unstale":"2023-10-10T21:18:03.127345+0000","last_undegraded":"2023-10-10T21:18:03.127345+0000","last_fullsized":"2023-10-10T21:18:03.127345+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:27.054207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.106797+0000","last_change":"2023-10-10T21:18:02.112963+0000","last_active":"2023-10-10T21:18:03.106797+0000","last_peered":"2023-10-10T21:18:03.106797+0000","last_clean":"2023-10-10T21:18:03.106797+0000","last_became_active":"2023-10-10T21:18:02.112670+0000","last_became_peered":"2023-10-10T21:18:02.112670+0000","last_unstale":"2023-10-10T21:18:03.106797+0000","last_undegraded":"2023-10-10T21:18:03.106797+0000","last_fullsized":"2023-10-10T21:18:03.106797+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121389+0000","last_change":"2023-10-10T21:18:03.115159+0000","last_active":"2023-10-10T21:18:03.121389+0000","last_peered":"2023-10-10T21:18:03.121389+0000","last_clean":"2023-10-10T21:18:03.121389+0000","last_became_active":"2023-10-10T21:18:03.114547+0000","last_became_peered":"2023-10-10T21:18:03.114547+0000","last_unstale":"2023-10-10T21:18:03.121389+0000","last_undegraded":"2023-10-10T21:18:03.121389+0000","last_fullsized":"2023-10-10T21:18:03.121389+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.026791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095779+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:18.389100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135108+0000","last_change":"2023-10-10T21:18:03.131702+0000","last_active":"2023-10-10T21:18:03.135108+0000","last_peered":"2023-10-10T21:18:03.135108+0000","last_clean":"2023-10-10T21:18:03.135108+0000","last_became_active":"2023-10-10T21:18:03.131482+0000","last_became_peered":"2023-10-10T21:18:03.131482+0000","last_unstale":"2023-10-10T21:18:03.135108+0000","last_undegraded":"2023-10-10T21:18:03.135108+0000","last_fullsized":"2023-10-10T21:18:03.135108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:25.952411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.093138+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:24.809153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121608+0000","last_change":"2023-10-10T21:18:03.118181+0000","last_active":"2023-10-10T21:18:03.121608+0000","last_peered":"2023-10-10T21:18:03.121608+0000","last_clean":"2023-10-10T21:18:03.121608+0000","last_became_active":"2023-10-10T21:18:03.117789+0000","last_became_peered":"2023-10-10T21:18:03.117789+0000","last_unstale":"2023-10-10T21:18:03.121608+0000","last_undegraded":"2023-10-10T21:18:03.121608+0000","last_fullsized":"2023-10-10T21:18:03.121608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:52.592283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101483+0000","last_change":"2023-10-10T21:18:02.107231+0000","last_active":"2023-10-10T21:18:03.101483+0000","last_peered":"2023-10-10T21:18:03.101483+0000","last_clean":"2023-10-10T21:18:03.101483+0000","last_became_active":"2023-10-10T21:18:02.106958+0000","last_became_peered":"2023-10-10T21:18:02.106958+0000","last_unstale":"2023-10-10T21:18:03.101483+0000","last_undegraded":"2023-10-10T21:18:03.101483+0000","last_fullsized":"2023-10-10T21:18:03.101483+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:13.649666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115546+0000","last_change":"2023-10-10T21:18:03.112233+0000","last_active":"2023-10-10T21:18:03.115546+0000","last_peered":"2023-10-10T21:18:03.115546+0000","last_clean":"2023-10-10T21:18:03.115546+0000","last_became_active":"2023-10-10T21:18:03.111983+0000","last_became_peered":"2023-10-10T21:18:03.111983+0000","last_unstale":"2023-10-10T21:18:03.115546+0000","last_undegraded":"2023-10-10T21:18:03.115546+0000","last_fullsized":"2023-10-10T21:18:03.115546+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:57.687562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095953+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:15:05.288481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.092695+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:18:04.033567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129693+0000","last_change":"2023-10-10T21:18:03.126206+0000","last_active":"2023-10-10T21:18:03.129693+0000","last_peered":"2023-10-10T21:18:03.129693+0000","last_clean":"2023-10-10T21:18:03.129693+0000","last_became_active":"2023-10-10T21:18:03.125406+0000","last_became_peered":"2023-10-10T21:18:03.125406+0000","last_unstale":"2023-10-10T21:18:03.129693+0000","last_undegraded":"2023-10-10T21:18:03.129693+0000","last_fullsized":"2023-10-10T21:18:03.129693+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:17.091601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107309+0000","last_change":"2023-10-10T21:18:02.101559+0000","last_active":"2023-10-10T21:18:03.107309+0000","last_peered":"2023-10-10T21:18:03.107309+0000","last_clean":"2023-10-10T21:18:03.107309+0000","last_became_active":"2023-10-10T21:18:02.101311+0000","last_became_peered":"2023-10-10T21:18:02.101311+0000","last_unstale":"2023-10-10T21:18:03.107309+0000","last_undegraded":"2023-10-10T21:18:03.107309+0000","last_fullsized":"2023-10-10T21:18:03.107309+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:50.840955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124725+0000","last_change":"2023-10-10T21:18:03.117311+0000","last_active":"2023-10-10T21:18:03.124725+0000","last_peered":"2023-10-10T21:18:03.124725+0000","last_clean":"2023-10-10T21:18:03.124725+0000","last_became_active":"2023-10-10T21:18:03.116702+0000","last_became_peered":"2023-10-10T21:18:03.116702+0000","last_unstale":"2023-10-10T21:18:03.124725+0000","last_undegraded":"2023-10-10T21:18:03.124725+0000","last_fullsized":"2023-10-10T21:18:03.124725+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:50:21.902920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101734+0000","last_change":"2023-10-10T21:18:02.113291+0000","last_active":"2023-10-10T21:18:03.101734+0000","last_peered":"2023-10-10T21:18:03.101734+0000","last_clean":"2023-10-10T21:18:03.101734+0000","last_became_active":"2023-10-10T21:18:02.113013+0000","last_became_peered":"2023-10-10T21:18:02.113013+0000","last_unstale":"2023-10-10T21:18:03.101734+0000","last_undegraded":"2023-10-10T21:18:03.101734+0000","last_fullsized":"2023-10-10T21:18:03.101734+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118743+0000","last_change":"2023-10-10T21:18:03.112467+0000","last_active":"2023-10-10T21:18:03.118743+0000","last_peered":"2023-10-10T21:18:03.118743+0000","last_clean":"2023-10-10T21:18:03.118743+0000","last_became_active":"2023-10-10T21:18:03.112232+0000","last_became_peered":"2023-10-10T21:18:03.112232+0000","last_unstale":"2023-10-10T21:18:03.118743+0000","last_undegraded":"2023-10-10T21:18:03.118743+0000","last_fullsized":"2023-10-10T21:18:03.118743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:48.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107085+0000","last_change":"2023-10-10T21:18:02.114127+0000","last_active":"2023-10-10T21:18:03.107085+0000","last_peered":"2023-10-10T21:18:03.107085+0000","last_clean":"2023-10-10T21:18:03.107085+0000","last_became_active":"2023-10-10T21:18:02.113859+0000","last_became_peered":"2023-10-10T21:18:02.113859+0000","last_unstale":"2023-10-10T21:18:03.107085+0000","last_undegraded":"2023-10-10T21:18:03.107085+0000","last_fullsized":"2023-10-10T21:18:03.107085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:47:16.599994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104475+0000","last_change":"2023-10-10T21:18:02.113222+0000","last_active":"2023-10-10T21:18:03.104475+0000","last_peered":"2023-10-10T21:18:03.104475+0000","last_clean":"2023-10-10T21:18:03.104475+0000","last_became_active":"2023-10-10T21:18:02.112956+0000","last_became_peered":"2023-10-10T21:18:02.112956+0000","last_unstale":"2023-10-10T21:18:03.104475+0000","last_undegraded":"2023-10-10T21:18:03.104475+0000","last_fullsized":"2023-10-10T21:18:03.104475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:18.389100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.113293+0000","last_change":"2023-10-10T21:18:03.111805+0000","last_active":"2023-10-10T21:18:03.113293+0000","last_peered":"2023-10-10T21:18:03.113293+0000","last_clean":"2023-10-10T21:18:03.113293+0000","last_became_active":"2023-10-10T21:18:03.111563+0000","last_became_peered":"2023-10-10T21:18:03.111563+0000","last_unstale":"2023-10-10T21:18:03.113293+0000","last_undegraded":"2023-10-10T21:18:03.113293+0000","last_fullsized":"2023-10-10T21:18:03.113293+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:12:30.776673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104292+0000","last_change":"2023-10-10T21:18:02.105944+0000","last_active":"2023-10-10T21:18:03.104292+0000","last_peered":"2023-10-10T21:18:03.104292+0000","last_clean":"2023-10-10T21:18:03.104292+0000","last_became_active":"2023-10-10T21:18:02.105661+0000","last_became_peered":"2023-10-10T21:18:02.105661+0000","last_unstale":"2023-10-10T21:18:03.104292+0000","last_undegraded":"2023-10-10T21:18:03.104292+0000","last_fullsized":"2023-10-10T21:18:03.104292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:43:37.712234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095886+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:24:13.410567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126713+0000","last_change":"2023-10-10T21:18:03.125634+0000","last_active":"2023-10-10T21:18:03.126713+0000","last_peered":"2023-10-10T21:18:03.126713+0000","last_clean":"2023-10-10T21:18:03.126713+0000","last_became_active":"2023-10-10T21:18:03.125352+0000","last_became_peered":"2023-10-10T21:18:03.125352+0000","last_unstale":"2023-10-10T21:18:03.126713+0000","last_undegraded":"2023-10-10T21:18:03.126713+0000","last_fullsized":"2023-10-10T21:18:03.126713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:56.907952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095820+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:03.288893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"84'183","reported_seq":462,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107903+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:03.107903+0000","last_peered":"2023-10-10T21:18:03.107903+0000","last_clean":"2023-10-10T21:18:03.107903+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:03.107903+0000","last_undegraded":"2023-10-10T21:18:03.107903+0000","last_fullsized":"2023-10-10T21:18:03.107903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2214,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":1147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.995,"5min":1.014,"15min":1.1859999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.52200000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.435},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0069999999999999,"15min":1.123},"last":0.84599999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.71399999999999997},"min":{"1min":0.41399999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.504,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":1.2669999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.62,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.67400000000000004},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.58599999999999997,"5min":0.51300000000000001,"15min":0.42499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.135},"last":0.88100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542333,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":536344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":1.0569999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.97299999999999998,"5min":1.0129999999999999,"15min":1.143},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.378},"max":{"1min":0.92800000000000005,"5min":1.073,"15min":1.073},"last":0.81699999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.151},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93600000000000005,"5min":0.97799999999999998,"15min":1.01},"last":0.56100000000000005}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.503,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.018,"5min":1.042,"15min":1.1200000000000001},"last":0.64400000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":1.2729999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.443,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":0.85199999999999998,"5min":0.89200000000000002,"15min":1.0880000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66300000000000003,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":1.022,"15min":1.345},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":1.048,"15min":1.238},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.024,"15min":1.4930000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.202},"last":0.80200000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542336,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306620,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065220,"statfs":{"total":96636764160,"available":96322785280,"internally_reserved":0,"allocated":1167360,"data_stored":558370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64400000000000002,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.309},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.61599999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47199999999999998,"15min":0.48699999999999999},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66800000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.755},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.157,"15min":1.3220000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.77800000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.26,"15min":1.2849999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.008,"5min":2.21,"15min":2.21},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.165,"15min":1.268},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.53300000000000003},"max":{"1min":1.0409999999999999,"5min":1.0509999999999999,"15min":1.3400000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.61799999999999999,"5min":0.52800000000000002,"15min":0.505},"max":{"1min":1.026,"5min":1.026,"15min":1.3759999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.85299999999999998,"5min":1.716,"15min":1.716},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.92200000000000004,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298996,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072844,"statfs":{"total":96636764160,"available":96330592256,"internally_reserved":0,"allocated":1748992,"data_stored":1147202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.4890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.65600000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.501}]},{"osd":2,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":1.706},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.70899999999999996,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.72499999999999998,"5min":0.874,"15min":1.2909999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.101,"15min":1.2270000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.2909999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.03,"5min":1.075,"15min":1.2729999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.58199999999999996,"5min":0.57299999999999995,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0980000000000001,"15min":1.3899999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.65100000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.95699999999999996,"5min":1.0960000000000001,"15min":1.2589999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.83999999999999997},"min":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0249999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.92700000000000005}]},{"osd":7,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.64300000000000002,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":0.97299999999999998,"5min":1.139,"15min":1.363},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54200000000000004},"max":{"1min":0.96999999999999997,"5min":1.024,"15min":1.3300000000000001},"last":1.006}]}]},{"osd":1,"up_from":14,"seq":60129542334,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302532,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069308,"statfs":{"total":96636764160,"available":96326971392,"internally_reserved":0,"allocated":1175552,"data_stored":558958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.54200000000000004,"15min":0.48899999999999999},"min":{"1min":0.307,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":8.0839999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.378},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.63500000000000001,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":13.223000000000001,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.5}]},{"osd":2,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":2.085},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.60899999999999999,"15min":0.58199999999999996},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35399999999999998},"max":{"1min":0.88,"5min":0.999,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.81100000000000005,"15min":0.79700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.82799999999999996,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.413,"5min":0.92200000000000004,"15min":0.83599999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":13.130000000000001,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.81899999999999995,"15min":0.80700000000000005},"min":{"1min":0.57999999999999996,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84899999999999998,"15min":0.84299999999999997},"min":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.89300000000000002,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":12.026,"5min":12.026,"15min":12.026},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.751}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306616,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065224,"statfs":{"total":96636764160,"available":96322789376,"internally_reserved":0,"allocated":1163264,"data_stored":556946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28799999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.544},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.501},"min":{"1min":0.315,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.6759999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.68400000000000005,"5min":0.73399999999999999,"15min":1.4610000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.7070000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.4990000000000001},"last":0.501}]},{"osd":4,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.6359999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.246},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.262},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76700000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.2250000000000001,"15min":1.579},"last":0.70999999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.081,"5min":1.27,"15min":1.27},"last":0.75},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.224,"15min":1.224},"last":0.63}]},{"osd":7,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.111,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.228,"5min":1.228,"15min":1.3200000000000001},"last":0.67500000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542336,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310708,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061132,"statfs":{"total":96636764160,"available":96318599168,"internally_reserved":0,"allocated":1159168,"data_stored":556904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.88,"5min":0.92100000000000004,"15min":1.1479999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":0.96299999999999997,"15min":1.758},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.47},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68999999999999995,"15min":0.70299999999999996},"min":{"1min":0.53200000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.98299999999999998,"15min":1.929},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83899999999999997,"5min":1.002,"15min":1.6890000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.98399999999999999,"15min":1.468},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90400000000000003,"5min":1.046,"15min":1.397},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.42799999999999999},"max":{"1min":0.81899999999999995,"5min":0.97699999999999998,"15min":1.385},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":1.105},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":1.5209999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.435},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":1.464},"last":0.67200000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":1.006,"5min":1.006,"15min":1.5700000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51000000000000001,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.86599999999999999,"5min":0.91900000000000004,"15min":1.4139999999999999},"last":0.81499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542333,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":536344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.878,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":1.371},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88100000000000001,"5min":0.93300000000000005,"15min":3.895},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71699999999999997,"15min":0.748},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.97899999999999998,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.75}]},{"osd":2,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.2889999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.56100000000000005,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.3540000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.68200000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.65200000000000002},"min":{"1min":0.44900000000000001,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.496,"15min":4.2789999999999999},"last":0.621}]},{"osd":6,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.50800000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.026},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.748,"15min":0.77100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":2.8900000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.077,"15min":3.9420000000000002},"last":0.73699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:07.448 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:07.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.662+0000 7f277bbff700 1 Processor -- start 2023-10-10T21:18:07.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.662+0000 7f277bbff700 1 -- start start 2023-10-10T21:18:07.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.663+0000 7f277bbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2774159890 0x7f277415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f277bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2774159c60 0x7f277415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f277bbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277415a160 con 0x7f277415db10 2023-10-10T21:18:07.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f277bbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27740d13a0 con 0x7f2774159890 2023-10-10T21:18:07.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f277bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277415e140 con 0x7f2774159c60 2023-10-10T21:18:07.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f277a19c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f277415db10 0x7f2774069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33108/0 (socket says 172.21.15.154:33108) 2023-10-10T21:18:07.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f277a19c700 1 -- 172.21.15.154:0/1751410040 learned_addr learned my addr 172.21.15.154:0/1751410040 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:07.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f277999b700 1 --2- 172.21.15.154:0/1751410040 >> v2:172.21.15.179:3300/0 conn(0x7f2774159890 0x7f277415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f277919a700 1 --2- 172.21.15.154:0/1751410040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2774159c60 0x7f277415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f2778999700 1 -- 172.21.15.154:0/1751410040 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031178403 0 0) 0x7f277415a160 con 0x7f277415db10 2023-10-10T21:18:07.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.664+0000 7f2778999700 1 -- 172.21.15.154:0/1751410040 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2760003570 con 0x7f277415db10 2023-10-10T21:18:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.665+0000 7f277999b700 1 -- 172.21.15.154:0/1751410040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2774159c60 msgr2=0x7f277415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.665+0000 7f277999b700 1 --2- 172.21.15.154:0/1751410040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2774159c60 0x7f277415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.665+0000 7f277999b700 1 -- 172.21.15.154:0/1751410040 >> v1:172.21.15.154:6789/0 conn(0x7f277415db10 legacy=0x7f2774069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.665+0000 7f277999b700 1 -- 172.21.15.154:0/1751410040 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277415a3d0 con 0x7f2774159890 2023-10-10T21:18:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.665+0000 7f277999b700 1 --2- 172.21.15.154:0/1751410040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2774159890 0x7f277415abd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f27700098e0 tx=0x7f27700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89bf6629c29d1d55 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.665+0000 7f2778999700 1 -- 172.21.15.154:0/1751410040 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770011630 con 0x7f2774159890 2023-10-10T21:18:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.665+0000 7f2778999700 1 -- 172.21.15.154:0/1751410040 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2770011790 con 0x7f2774159890 2023-10-10T21:18:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.665+0000 7f2778999700 1 -- 172.21.15.154:0/1751410040 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770011b30 con 0x7f2774159890 2023-10-10T21:18:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.666+0000 7f277bbff700 1 -- 172.21.15.154:0/1751410040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2774159890 msgr2=0x7f277415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.666+0000 7f277bbff700 1 --2- 172.21.15.154:0/1751410040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2774159890 0x7f277415abd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f27700098e0 tx=0x7f27700091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.666+0000 7f277bbff700 1 -- 172.21.15.154:0/1751410040 shutdown_connections 2023-10-10T21:18:07.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.666+0000 7f277bbff700 1 --2- 172.21.15.154:0/1751410040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2774159890 0x7f277415abd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.666+0000 7f277bbff700 1 --2- 172.21.15.154:0/1751410040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2774159c60 0x7f277415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.666+0000 7f277bbff700 1 -- 172.21.15.154:0/1751410040 >> 172.21.15.154:0/1751410040 conn(0x7f2774068e20 msgr2=0x7f27740d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:07.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.666+0000 7f277bbff700 1 -- 172.21.15.154:0/1751410040 shutdown_connections 2023-10-10T21:18:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.666+0000 7f277bbff700 1 -- 172.21.15.154:0/1751410040 wait complete. 2023-10-10T21:18:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.667+0000 7f277bbff700 1 Processor -- start 2023-10-10T21:18:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.667+0000 7f277bbff700 1 -- start start 2023-10-10T21:18:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.668+0000 7f277bbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2774159890 0x7f27740b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.668+0000 7f277bbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2774159c60 0x7f2774169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.668+0000 7f277bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f277415db10 0x7f277416a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.668+0000 7f277bbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27740b4710 con 0x7f2774159c60 2023-10-10T21:18:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.668+0000 7f277bbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27740b3a90 con 0x7f2774159890 2023-10-10T21:18:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.668+0000 7f277bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27740b3d70 con 0x7f277415db10 2023-10-10T21:18:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.668+0000 7f277919a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2774159c60 0x7f2774169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.668+0000 7f277919a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2774159c60 0x7f2774169bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37304/0 (socket says 172.21.15.154:37304) 2023-10-10T21:18:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.668+0000 7f277919a700 1 -- 172.21.15.154:0/2798171343 learned_addr learned my addr 172.21.15.154:0/2798171343 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277a19c700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f277415db10 0x7f277416a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277999b700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2774159890 0x7f27740b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277919a700 1 -- 172.21.15.154:0/2798171343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f277415db10 msgr2=0x7f277416a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277919a700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f277415db10 0x7f277416a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277919a700 1 -- 172.21.15.154:0/2798171343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2774159890 msgr2=0x7f27740b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277919a700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2774159890 0x7f27740b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277919a700 1 -- 172.21.15.154:0/2798171343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009420 con 0x7f2774159c60 2023-10-10T21:18:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277919a700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2774159c60 0x7f2774169bf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f276400ec50 tx=0x7f27640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f2769ffb700 1 -- 172.21.15.154:0/2798171343 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400c9d0 con 0x7f2774159c60 2023-10-10T21:18:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f2769ffb700 1 -- 172.21.15.154:0/2798171343 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276400cb30 con 0x7f2774159c60 2023-10-10T21:18:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27740b4050 con 0x7f2774159c60 2023-10-10T21:18:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f2769ffb700 1 -- 172.21.15.154:0/2798171343 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764013470 con 0x7f2774159c60 2023-10-10T21:18:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.669+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277414fc60 con 0x7f2774159c60 2023-10-10T21:18:07.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.670+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277404c3c0 con 0x7f2774159c60 2023-10-10T21:18:07.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.671+0000 7f2769ffb700 1 -- 172.21.15.154:0/2798171343 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2764013860 con 0x7f2774159c60 2023-10-10T21:18:07.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.672+0000 7f2769ffb700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2758066f30 0x7f27580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:07.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.672+0000 7f2769ffb700 1 -- 172.21.15.154:0/2798171343 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f2764084ab0 con 0x7f2774159c60 2023-10-10T21:18:07.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.673+0000 7f277999b700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2758066f30 0x7f27580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:07.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.673+0000 7f277999b700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2758066f30 0x7f27580693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f27700091e0 tx=0x7f2770017000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:07.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.676+0000 7f2769ffb700 1 -- 172.21.15.154:0/2798171343 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2764051af0 con 0x7f2774159c60 2023-10-10T21:18:07.817 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-10-10T21:18:07.814+0000 7f4a825f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:18:07.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.863+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f277406a5b0 con 0x7f2758066f30 2023-10-10T21:18:07.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.871+0000 7f2769ffb700 1 -- 172.21.15.154:0/2798171343 <== mgr.6531 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286187 (secure 0 0 0) 0x7f277406a5b0 con 0x7f2758066f30 2023-10-10T21:18:07.877 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:07.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2758066f30 msgr2=0x7f27580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2758066f30 0x7f27580693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f27700091e0 tx=0x7f2770017000 comp rx=0 tx=0).stop 2023-10-10T21:18:07.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2774159c60 msgr2=0x7f2774169bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:07.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2774159c60 0x7f2774169bf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f276400ec50 tx=0x7f27640091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 shutdown_connections 2023-10-10T21:18:07.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f277415db10 0x7f277416a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2758066f30 0x7f27580693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2774159890 0x7f27740b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 --2- 172.21.15.154:0/2798171343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2774159c60 0x7f2774169bf0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:07.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 >> 172.21.15.154:0/2798171343 conn(0x7f2774068e20 msgr2=0x7f2774152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:07.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 shutdown_connections 2023-10-10T21:18:07.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:07.876+0000 7f277bbff700 1 -- 172.21.15.154:0/2798171343 wait complete. 2023-10-10T21:18:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:07.895 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:18:06.790656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592582,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":314,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433524,"kb_used_data":10164,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541196,"statfs":{"total":773094113280,"available":770602184704,"internally_reserved":0,"allocated":10407936,"data_stored":5598858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2214,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.703887"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128453+0000","last_change":"2023-10-10T21:18:03.123147+0000","last_active":"2023-10-10T21:18:03.128453+0000","last_peered":"2023-10-10T21:18:03.128453+0000","last_clean":"2023-10-10T21:18:03.128453+0000","last_became_active":"2023-10-10T21:18:03.122883+0000","last_became_peered":"2023-10-10T21:18:03.122883+0000","last_unstale":"2023-10-10T21:18:03.128453+0000","last_undegraded":"2023-10-10T21:18:03.128453+0000","last_fullsized":"2023-10-10T21:18:03.128453+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:28:36.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121489+0000","last_change":"2023-10-10T21:18:03.116758+0000","last_active":"2023-10-10T21:18:03.121489+0000","last_peered":"2023-10-10T21:18:03.121489+0000","last_clean":"2023-10-10T21:18:03.121489+0000","last_became_active":"2023-10-10T21:18:03.116472+0000","last_became_peered":"2023-10-10T21:18:03.116472+0000","last_unstale":"2023-10-10T21:18:03.121489+0000","last_undegraded":"2023-10-10T21:18:03.121489+0000","last_fullsized":"2023-10-10T21:18:03.121489+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:26.091130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132434+0000","last_change":"2023-10-10T21:18:03.128869+0000","last_active":"2023-10-10T21:18:03.132434+0000","last_peered":"2023-10-10T21:18:03.132434+0000","last_clean":"2023-10-10T21:18:03.132434+0000","last_became_active":"2023-10-10T21:18:03.128610+0000","last_became_peered":"2023-10-10T21:18:03.128610+0000","last_unstale":"2023-10-10T21:18:03.132434+0000","last_undegraded":"2023-10-10T21:18:03.132434+0000","last_fullsized":"2023-10-10T21:18:03.132434+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:47.801041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.119402+0000","last_change":"2023-10-10T21:18:03.113980+0000","last_active":"2023-10-10T21:18:03.119402+0000","last_peered":"2023-10-10T21:18:03.119402+0000","last_clean":"2023-10-10T21:18:03.119402+0000","last_became_active":"2023-10-10T21:18:03.113689+0000","last_became_peered":"2023-10-10T21:18:03.113689+0000","last_unstale":"2023-10-10T21:18:03.119402+0000","last_undegraded":"2023-10-10T21:18:03.119402+0000","last_fullsized":"2023-10-10T21:18:03.119402+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:22:18.290768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121849+0000","last_change":"2023-10-10T21:18:03.115993+0000","last_active":"2023-10-10T21:18:03.121849+0000","last_peered":"2023-10-10T21:18:03.121849+0000","last_clean":"2023-10-10T21:18:03.121849+0000","last_became_active":"2023-10-10T21:18:03.114933+0000","last_became_peered":"2023-10-10T21:18:03.114933+0000","last_unstale":"2023-10-10T21:18:03.121849+0000","last_undegraded":"2023-10-10T21:18:03.121849+0000","last_fullsized":"2023-10-10T21:18:03.121849+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:09.169541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120078+0000","last_change":"2023-10-10T21:18:03.116446+0000","last_active":"2023-10-10T21:18:03.120078+0000","last_peered":"2023-10-10T21:18:03.120078+0000","last_clean":"2023-10-10T21:18:03.120078+0000","last_became_active":"2023-10-10T21:18:03.116170+0000","last_became_peered":"2023-10-10T21:18:03.116170+0000","last_unstale":"2023-10-10T21:18:03.120078+0000","last_undegraded":"2023-10-10T21:18:03.120078+0000","last_fullsized":"2023-10-10T21:18:03.120078+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:11:20.228457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126153+0000","last_change":"2023-10-10T21:18:03.122782+0000","last_active":"2023-10-10T21:18:03.126153+0000","last_peered":"2023-10-10T21:18:03.126153+0000","last_clean":"2023-10-10T21:18:03.126153+0000","last_became_active":"2023-10-10T21:18:03.122522+0000","last_became_peered":"2023-10-10T21:18:03.122522+0000","last_unstale":"2023-10-10T21:18:03.126153+0000","last_undegraded":"2023-10-10T21:18:03.126153+0000","last_fullsized":"2023-10-10T21:18:03.126153+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:16.215761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118425+0000","last_change":"2023-10-10T21:18:03.114857+0000","last_active":"2023-10-10T21:18:03.118425+0000","last_peered":"2023-10-10T21:18:03.118425+0000","last_clean":"2023-10-10T21:18:03.118425+0000","last_became_active":"2023-10-10T21:18:03.114601+0000","last_became_peered":"2023-10-10T21:18:03.114601+0000","last_unstale":"2023-10-10T21:18:03.118425+0000","last_undegraded":"2023-10-10T21:18:03.118425+0000","last_fullsized":"2023-10-10T21:18:03.118425+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:43.812657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124840+0000","last_change":"2023-10-10T21:18:03.124241+0000","last_active":"2023-10-10T21:18:03.124840+0000","last_peered":"2023-10-10T21:18:03.124840+0000","last_clean":"2023-10-10T21:18:03.124840+0000","last_became_active":"2023-10-10T21:18:03.123943+0000","last_became_peered":"2023-10-10T21:18:03.123943+0000","last_unstale":"2023-10-10T21:18:03.124840+0000","last_undegraded":"2023-10-10T21:18:03.124840+0000","last_fullsized":"2023-10-10T21:18:03.124840+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115678+0000","last_change":"2023-10-10T21:18:03.111549+0000","last_active":"2023-10-10T21:18:03.115678+0000","last_peered":"2023-10-10T21:18:03.115678+0000","last_clean":"2023-10-10T21:18:03.115678+0000","last_became_active":"2023-10-10T21:18:03.111171+0000","last_became_peered":"2023-10-10T21:18:03.111171+0000","last_unstale":"2023-10-10T21:18:03.115678+0000","last_undegraded":"2023-10-10T21:18:03.115678+0000","last_fullsized":"2023-10-10T21:18:03.115678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:48:55.981597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118815+0000","last_change":"2023-10-10T21:18:03.113743+0000","last_active":"2023-10-10T21:18:03.118815+0000","last_peered":"2023-10-10T21:18:03.118815+0000","last_clean":"2023-10-10T21:18:03.118815+0000","last_became_active":"2023-10-10T21:18:03.113483+0000","last_became_peered":"2023-10-10T21:18:03.113483+0000","last_unstale":"2023-10-10T21:18:03.118815+0000","last_undegraded":"2023-10-10T21:18:03.118815+0000","last_fullsized":"2023-10-10T21:18:03.118815+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:48.507042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135387+0000","last_change":"2023-10-10T21:18:03.133411+0000","last_active":"2023-10-10T21:18:03.135387+0000","last_peered":"2023-10-10T21:18:03.135387+0000","last_clean":"2023-10-10T21:18:03.135387+0000","last_became_active":"2023-10-10T21:18:03.133113+0000","last_became_peered":"2023-10-10T21:18:03.133113+0000","last_unstale":"2023-10-10T21:18:03.135387+0000","last_undegraded":"2023-10-10T21:18:03.135387+0000","last_fullsized":"2023-10-10T21:18:03.135387+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:07:30.524167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121779+0000","last_change":"2023-10-10T21:18:03.115176+0000","last_active":"2023-10-10T21:18:03.121779+0000","last_peered":"2023-10-10T21:18:03.121779+0000","last_clean":"2023-10-10T21:18:03.121779+0000","last_became_active":"2023-10-10T21:18:03.114425+0000","last_became_peered":"2023-10-10T21:18:03.114425+0000","last_unstale":"2023-10-10T21:18:03.121779+0000","last_undegraded":"2023-10-10T21:18:03.121779+0000","last_fullsized":"2023-10-10T21:18:03.121779+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:30.856134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132619+0000","last_change":"2023-10-10T21:18:03.128819+0000","last_active":"2023-10-10T21:18:03.132619+0000","last_peered":"2023-10-10T21:18:03.132619+0000","last_clean":"2023-10-10T21:18:03.132619+0000","last_became_active":"2023-10-10T21:18:03.128567+0000","last_became_peered":"2023-10-10T21:18:03.128567+0000","last_unstale":"2023-10-10T21:18:03.132619+0000","last_undegraded":"2023-10-10T21:18:03.132619+0000","last_fullsized":"2023-10-10T21:18:03.132619+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:01:23.478813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.114086+0000","last_change":"2023-10-10T21:18:03.109240+0000","last_active":"2023-10-10T21:18:03.114086+0000","last_peered":"2023-10-10T21:18:03.114086+0000","last_clean":"2023-10-10T21:18:03.114086+0000","last_became_active":"2023-10-10T21:18:03.108970+0000","last_became_peered":"2023-10-10T21:18:03.108970+0000","last_unstale":"2023-10-10T21:18:03.114086+0000","last_undegraded":"2023-10-10T21:18:03.114086+0000","last_fullsized":"2023-10-10T21:18:03.114086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:51:48.404639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124382+0000","last_change":"2023-10-10T21:18:03.117935+0000","last_active":"2023-10-10T21:18:03.124382+0000","last_peered":"2023-10-10T21:18:03.124382+0000","last_clean":"2023-10-10T21:18:03.124382+0000","last_became_active":"2023-10-10T21:18:03.117552+0000","last_became_peered":"2023-10-10T21:18:03.117552+0000","last_unstale":"2023-10-10T21:18:03.124382+0000","last_undegraded":"2023-10-10T21:18:03.124382+0000","last_fullsized":"2023-10-10T21:18:03.124382+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:24:39.255862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.122399+0000","last_change":"2023-10-10T21:18:03.113509+0000","last_active":"2023-10-10T21:18:03.122399+0000","last_peered":"2023-10-10T21:18:03.122399+0000","last_clean":"2023-10-10T21:18:03.122399+0000","last_became_active":"2023-10-10T21:18:03.113227+0000","last_became_peered":"2023-10-10T21:18:03.113227+0000","last_unstale":"2023-10-10T21:18:03.122399+0000","last_undegraded":"2023-10-10T21:18:03.122399+0000","last_fullsized":"2023-10-10T21:18:03.122399+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:19:10.967416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129924+0000","last_change":"2023-10-10T21:18:03.126424+0000","last_active":"2023-10-10T21:18:03.129924+0000","last_peered":"2023-10-10T21:18:03.129924+0000","last_clean":"2023-10-10T21:18:03.129924+0000","last_became_active":"2023-10-10T21:18:03.125673+0000","last_became_peered":"2023-10-10T21:18:03.125673+0000","last_unstale":"2023-10-10T21:18:03.129924+0000","last_undegraded":"2023-10-10T21:18:03.129924+0000","last_fullsized":"2023-10-10T21:18:03.129924+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:22.538251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138071+0000","last_change":"2023-10-10T21:18:03.136560+0000","last_active":"2023-10-10T21:18:03.138071+0000","last_peered":"2023-10-10T21:18:03.138071+0000","last_clean":"2023-10-10T21:18:03.138071+0000","last_became_active":"2023-10-10T21:18:03.136301+0000","last_became_peered":"2023-10-10T21:18:03.136301+0000","last_unstale":"2023-10-10T21:18:03.138071+0000","last_undegraded":"2023-10-10T21:18:03.138071+0000","last_fullsized":"2023-10-10T21:18:03.138071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:10.463301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128656+0000","last_change":"2023-10-10T21:18:03.125260+0000","last_active":"2023-10-10T21:18:03.128656+0000","last_peered":"2023-10-10T21:18:03.128656+0000","last_clean":"2023-10-10T21:18:03.128656+0000","last_became_active":"2023-10-10T21:18:03.124986+0000","last_became_peered":"2023-10-10T21:18:03.124986+0000","last_unstale":"2023-10-10T21:18:03.128656+0000","last_undegraded":"2023-10-10T21:18:03.128656+0000","last_fullsized":"2023-10-10T21:18:03.128656+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:28:14.399113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121625+0000","last_change":"2023-10-10T21:18:03.118901+0000","last_active":"2023-10-10T21:18:03.121625+0000","last_peered":"2023-10-10T21:18:03.121625+0000","last_clean":"2023-10-10T21:18:03.121625+0000","last_became_active":"2023-10-10T21:18:03.118655+0000","last_became_peered":"2023-10-10T21:18:03.118655+0000","last_unstale":"2023-10-10T21:18:03.121625+0000","last_undegraded":"2023-10-10T21:18:03.121625+0000","last_fullsized":"2023-10-10T21:18:03.121625+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:35:55.138638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125083+0000","last_change":"2023-10-10T21:18:03.121035+0000","last_active":"2023-10-10T21:18:03.125083+0000","last_peered":"2023-10-10T21:18:03.125083+0000","last_clean":"2023-10-10T21:18:03.125083+0000","last_became_active":"2023-10-10T21:18:03.120773+0000","last_became_peered":"2023-10-10T21:18:03.120773+0000","last_unstale":"2023-10-10T21:18:03.125083+0000","last_undegraded":"2023-10-10T21:18:03.125083+0000","last_fullsized":"2023-10-10T21:18:03.125083+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:14.654306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121369+0000","last_change":"2023-10-10T21:18:03.115215+0000","last_active":"2023-10-10T21:18:03.121369+0000","last_peered":"2023-10-10T21:18:03.121369+0000","last_clean":"2023-10-10T21:18:03.121369+0000","last_became_active":"2023-10-10T21:18:03.114868+0000","last_became_peered":"2023-10-10T21:18:03.114868+0000","last_unstale":"2023-10-10T21:18:03.121369+0000","last_undegraded":"2023-10-10T21:18:03.121369+0000","last_fullsized":"2023-10-10T21:18:03.121369+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:05.639479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129609+0000","last_change":"2023-10-10T21:18:03.126162+0000","last_active":"2023-10-10T21:18:03.129609+0000","last_peered":"2023-10-10T21:18:03.129609+0000","last_clean":"2023-10-10T21:18:03.129609+0000","last_became_active":"2023-10-10T21:18:03.125841+0000","last_became_peered":"2023-10-10T21:18:03.125841+0000","last_unstale":"2023-10-10T21:18:03.129609+0000","last_undegraded":"2023-10-10T21:18:03.129609+0000","last_fullsized":"2023-10-10T21:18:03.129609+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:21.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"94'4","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138188+0000","last_change":"2023-10-10T21:18:02.102666+0000","last_active":"2023-10-10T21:18:03.138188+0000","last_peered":"2023-10-10T21:18:03.138188+0000","last_clean":"2023-10-10T21:18:03.138188+0000","last_became_active":"2023-10-10T21:18:02.102354+0000","last_became_peered":"2023-10-10T21:18:02.102354+0000","last_unstale":"2023-10-10T21:18:03.138188+0000","last_undegraded":"2023-10-10T21:18:03.138188+0000","last_fullsized":"2023-10-10T21:18:03.138188+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121828+0000","last_change":"2023-10-10T21:18:03.115827+0000","last_active":"2023-10-10T21:18:03.121828+0000","last_peered":"2023-10-10T21:18:03.121828+0000","last_clean":"2023-10-10T21:18:03.121828+0000","last_became_active":"2023-10-10T21:18:03.114749+0000","last_became_peered":"2023-10-10T21:18:03.114749+0000","last_unstale":"2023-10-10T21:18:03.121828+0000","last_undegraded":"2023-10-10T21:18:03.121828+0000","last_fullsized":"2023-10-10T21:18:03.121828+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:25.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135289+0000","last_change":"2023-10-10T21:18:02.104346+0000","last_active":"2023-10-10T21:18:03.135289+0000","last_peered":"2023-10-10T21:18:03.135289+0000","last_clean":"2023-10-10T21:18:03.135289+0000","last_became_active":"2023-10-10T21:18:02.104087+0000","last_became_peered":"2023-10-10T21:18:02.104087+0000","last_unstale":"2023-10-10T21:18:03.135289+0000","last_undegraded":"2023-10-10T21:18:03.135289+0000","last_fullsized":"2023-10-10T21:18:03.135289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140721+0000","last_change":"2023-10-10T21:18:02.115690+0000","last_active":"2023-10-10T21:18:03.140721+0000","last_peered":"2023-10-10T21:18:03.140721+0000","last_clean":"2023-10-10T21:18:03.140721+0000","last_became_active":"2023-10-10T21:18:02.115385+0000","last_became_peered":"2023-10-10T21:18:02.115385+0000","last_unstale":"2023-10-10T21:18:03.140721+0000","last_undegraded":"2023-10-10T21:18:03.140721+0000","last_fullsized":"2023-10-10T21:18:03.140721+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:00.443737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124744+0000","last_change":"2023-10-10T21:18:03.117499+0000","last_active":"2023-10-10T21:18:03.124744+0000","last_peered":"2023-10-10T21:18:03.124744+0000","last_clean":"2023-10-10T21:18:03.124744+0000","last_became_active":"2023-10-10T21:18:03.117056+0000","last_became_peered":"2023-10-10T21:18:03.117056+0000","last_unstale":"2023-10-10T21:18:03.124744+0000","last_undegraded":"2023-10-10T21:18:03.124744+0000","last_fullsized":"2023-10-10T21:18:03.124744+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095815+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:23.810550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132671+0000","last_change":"2023-10-10T21:18:02.105454+0000","last_active":"2023-10-10T21:18:03.132671+0000","last_peered":"2023-10-10T21:18:03.132671+0000","last_clean":"2023-10-10T21:18:03.132671+0000","last_became_active":"2023-10-10T21:18:02.104962+0000","last_became_peered":"2023-10-10T21:18:02.104962+0000","last_unstale":"2023-10-10T21:18:03.132671+0000","last_undegraded":"2023-10-10T21:18:03.132671+0000","last_fullsized":"2023-10-10T21:18:03.132671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:42.291687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130936+0000","last_change":"2023-10-10T21:18:03.127926+0000","last_active":"2023-10-10T21:18:03.130936+0000","last_peered":"2023-10-10T21:18:03.130936+0000","last_clean":"2023-10-10T21:18:03.130936+0000","last_became_active":"2023-10-10T21:18:03.127034+0000","last_became_peered":"2023-10-10T21:18:03.127034+0000","last_unstale":"2023-10-10T21:18:03.130936+0000","last_undegraded":"2023-10-10T21:18:03.130936+0000","last_fullsized":"2023-10-10T21:18:03.130936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:05:17.246909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.097122+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:12:29.772033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124869+0000","last_change":"2023-10-10T21:18:03.122508+0000","last_active":"2023-10-10T21:18:03.124869+0000","last_peered":"2023-10-10T21:18:03.124869+0000","last_clean":"2023-10-10T21:18:03.124869+0000","last_became_active":"2023-10-10T21:18:03.122245+0000","last_became_peered":"2023-10-10T21:18:03.122245+0000","last_unstale":"2023-10-10T21:18:03.124869+0000","last_undegraded":"2023-10-10T21:18:03.124869+0000","last_fullsized":"2023-10-10T21:18:03.124869+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:41.065339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104533+0000","last_change":"2023-10-10T21:18:02.112370+0000","last_active":"2023-10-10T21:18:03.104533+0000","last_peered":"2023-10-10T21:18:03.104533+0000","last_clean":"2023-10-10T21:18:03.104533+0000","last_became_active":"2023-10-10T21:18:02.112099+0000","last_became_peered":"2023-10-10T21:18:02.112099+0000","last_unstale":"2023-10-10T21:18:03.104533+0000","last_undegraded":"2023-10-10T21:18:03.104533+0000","last_fullsized":"2023-10-10T21:18:03.104533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:03.288893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121084+0000","last_change":"2023-10-10T21:18:03.118553+0000","last_active":"2023-10-10T21:18:03.121084+0000","last_peered":"2023-10-10T21:18:03.121084+0000","last_clean":"2023-10-10T21:18:03.121084+0000","last_became_active":"2023-10-10T21:18:03.118289+0000","last_became_peered":"2023-10-10T21:18:03.118289+0000","last_unstale":"2023-10-10T21:18:03.121084+0000","last_undegraded":"2023-10-10T21:18:03.121084+0000","last_fullsized":"2023-10-10T21:18:03.121084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:05.319721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105764+0000","last_change":"2023-10-10T21:18:02.103988+0000","last_active":"2023-10-10T21:18:03.105764+0000","last_peered":"2023-10-10T21:18:03.105764+0000","last_clean":"2023-10-10T21:18:03.105764+0000","last_became_active":"2023-10-10T21:18:02.103709+0000","last_became_peered":"2023-10-10T21:18:02.103709+0000","last_unstale":"2023-10-10T21:18:03.105764+0000","last_undegraded":"2023-10-10T21:18:03.105764+0000","last_fullsized":"2023-10-10T21:18:03.105764+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:43.528613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105952+0000","last_change":"2023-10-10T21:18:02.097199+0000","last_active":"2023-10-10T21:18:03.105952+0000","last_peered":"2023-10-10T21:18:03.105952+0000","last_clean":"2023-10-10T21:18:03.105952+0000","last_became_active":"2023-10-10T21:18:02.096924+0000","last_became_peered":"2023-10-10T21:18:02.096924+0000","last_unstale":"2023-10-10T21:18:03.105952+0000","last_undegraded":"2023-10-10T21:18:03.105952+0000","last_fullsized":"2023-10-10T21:18:03.105952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:42.119227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137096+0000","last_change":"2023-10-10T21:18:03.134927+0000","last_active":"2023-10-10T21:18:03.137096+0000","last_peered":"2023-10-10T21:18:03.137096+0000","last_clean":"2023-10-10T21:18:03.137096+0000","last_became_active":"2023-10-10T21:18:03.134663+0000","last_became_peered":"2023-10-10T21:18:03.134663+0000","last_unstale":"2023-10-10T21:18:03.137096+0000","last_undegraded":"2023-10-10T21:18:03.137096+0000","last_fullsized":"2023-10-10T21:18:03.137096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:02:50.568864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095781+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:29:40.211849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"94'3","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135167+0000","last_change":"2023-10-10T21:18:02.112911+0000","last_active":"2023-10-10T21:18:03.135167+0000","last_peered":"2023-10-10T21:18:03.135167+0000","last_clean":"2023-10-10T21:18:03.135167+0000","last_became_active":"2023-10-10T21:18:02.112580+0000","last_became_peered":"2023-10-10T21:18:02.112580+0000","last_unstale":"2023-10-10T21:18:03.135167+0000","last_undegraded":"2023-10-10T21:18:03.135167+0000","last_fullsized":"2023-10-10T21:18:03.135167+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:49:28.212088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120562+0000","last_change":"2023-10-10T21:18:03.114601+0000","last_active":"2023-10-10T21:18:03.120562+0000","last_peered":"2023-10-10T21:18:03.120562+0000","last_clean":"2023-10-10T21:18:03.120562+0000","last_became_active":"2023-10-10T21:18:03.114335+0000","last_became_peered":"2023-10-10T21:18:03.114335+0000","last_unstale":"2023-10-10T21:18:03.120562+0000","last_undegraded":"2023-10-10T21:18:03.120562+0000","last_fullsized":"2023-10-10T21:18:03.120562+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:59:51.773918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"94'6","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137510+0000","last_change":"2023-10-10T21:18:02.104756+0000","last_active":"2023-10-10T21:18:03.137510+0000","last_peered":"2023-10-10T21:18:03.137510+0000","last_clean":"2023-10-10T21:18:03.137510+0000","last_became_active":"2023-10-10T21:18:02.104493+0000","last_became_peered":"2023-10-10T21:18:02.104493+0000","last_unstale":"2023-10-10T21:18:03.137510+0000","last_undegraded":"2023-10-10T21:18:03.137510+0000","last_fullsized":"2023-10-10T21:18:03.137510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:29:40.211849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127583+0000","last_change":"2023-10-10T21:18:03.123287+0000","last_active":"2023-10-10T21:18:03.127583+0000","last_peered":"2023-10-10T21:18:03.127583+0000","last_clean":"2023-10-10T21:18:03.127583+0000","last_became_active":"2023-10-10T21:18:03.121920+0000","last_became_peered":"2023-10-10T21:18:03.121920+0000","last_unstale":"2023-10-10T21:18:03.127583+0000","last_undegraded":"2023-10-10T21:18:03.127583+0000","last_fullsized":"2023-10-10T21:18:03.127583+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130881+0000","last_change":"2023-10-10T21:18:02.105096+0000","last_active":"2023-10-10T21:18:03.130881+0000","last_peered":"2023-10-10T21:18:03.130881+0000","last_clean":"2023-10-10T21:18:03.130881+0000","last_became_active":"2023-10-10T21:18:02.104823+0000","last_became_peered":"2023-10-10T21:18:02.104823+0000","last_unstale":"2023-10-10T21:18:03.130881+0000","last_undegraded":"2023-10-10T21:18:03.130881+0000","last_fullsized":"2023-10-10T21:18:03.130881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:23.810550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.096574+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:24:31.607986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125859+0000","last_change":"2023-10-10T21:18:03.125107+0000","last_active":"2023-10-10T21:18:03.125859+0000","last_peered":"2023-10-10T21:18:03.125859+0000","last_clean":"2023-10-10T21:18:03.125859+0000","last_became_active":"2023-10-10T21:18:03.124825+0000","last_became_peered":"2023-10-10T21:18:03.124825+0000","last_unstale":"2023-10-10T21:18:03.125859+0000","last_undegraded":"2023-10-10T21:18:03.125859+0000","last_fullsized":"2023-10-10T21:18:03.125859+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.093710+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:06.243413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120796+0000","last_change":"2023-10-10T21:18:03.114682+0000","last_active":"2023-10-10T21:18:03.120796+0000","last_peered":"2023-10-10T21:18:03.120796+0000","last_clean":"2023-10-10T21:18:03.120796+0000","last_became_active":"2023-10-10T21:18:03.114394+0000","last_became_peered":"2023-10-10T21:18:03.114394+0000","last_unstale":"2023-10-10T21:18:03.120796+0000","last_undegraded":"2023-10-10T21:18:03.120796+0000","last_fullsized":"2023-10-10T21:18:03.120796+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:57.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"94'8","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.141200+0000","last_change":"2023-10-10T21:18:02.106816+0000","last_active":"2023-10-10T21:18:03.141200+0000","last_peered":"2023-10-10T21:18:03.141200+0000","last_clean":"2023-10-10T21:18:03.141200+0000","last_became_active":"2023-10-10T21:18:02.106514+0000","last_became_peered":"2023-10-10T21:18:02.106514+0000","last_unstale":"2023-10-10T21:18:03.141200+0000","last_undegraded":"2023-10-10T21:18:03.141200+0000","last_fullsized":"2023-10-10T21:18:03.141200+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:06.243413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.123938+0000","last_change":"2023-10-10T21:18:03.118958+0000","last_active":"2023-10-10T21:18:03.123938+0000","last_peered":"2023-10-10T21:18:03.123938+0000","last_clean":"2023-10-10T21:18:03.123938+0000","last_became_active":"2023-10-10T21:18:03.118715+0000","last_became_peered":"2023-10-10T21:18:03.118715+0000","last_unstale":"2023-10-10T21:18:03.123938+0000","last_undegraded":"2023-10-10T21:18:03.123938+0000","last_fullsized":"2023-10-10T21:18:03.123938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:53.044728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.096578+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:12:58.528943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124747+0000","last_change":"2023-10-10T21:18:03.118846+0000","last_active":"2023-10-10T21:18:03.124747+0000","last_peered":"2023-10-10T21:18:03.124747+0000","last_clean":"2023-10-10T21:18:03.124747+0000","last_became_active":"2023-10-10T21:18:03.118599+0000","last_became_peered":"2023-10-10T21:18:03.118599+0000","last_unstale":"2023-10-10T21:18:03.124747+0000","last_undegraded":"2023-10-10T21:18:03.124747+0000","last_fullsized":"2023-10-10T21:18:03.124747+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:45.905044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140786+0000","last_change":"2023-10-10T21:18:02.116376+0000","last_active":"2023-10-10T21:18:03.140786+0000","last_peered":"2023-10-10T21:18:03.140786+0000","last_clean":"2023-10-10T21:18:03.140786+0000","last_became_active":"2023-10-10T21:18:02.115966+0000","last_became_peered":"2023-10-10T21:18:02.115966+0000","last_unstale":"2023-10-10T21:18:03.140786+0000","last_undegraded":"2023-10-10T21:18:03.140786+0000","last_fullsized":"2023-10-10T21:18:03.140786+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:49:30.267805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118446+0000","last_change":"2023-10-10T21:18:03.115328+0000","last_active":"2023-10-10T21:18:03.118446+0000","last_peered":"2023-10-10T21:18:03.118446+0000","last_clean":"2023-10-10T21:18:03.118446+0000","last_became_active":"2023-10-10T21:18:03.115038+0000","last_became_peered":"2023-10-10T21:18:03.115038+0000","last_unstale":"2023-10-10T21:18:03.118446+0000","last_undegraded":"2023-10-10T21:18:03.118446+0000","last_fullsized":"2023-10-10T21:18:03.118446+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:00:05.036333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095854+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:25:25.103439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127345+0000","last_change":"2023-10-10T21:18:03.126599+0000","last_active":"2023-10-10T21:18:03.127345+0000","last_peered":"2023-10-10T21:18:03.127345+0000","last_clean":"2023-10-10T21:18:03.127345+0000","last_became_active":"2023-10-10T21:18:03.126259+0000","last_became_peered":"2023-10-10T21:18:03.126259+0000","last_unstale":"2023-10-10T21:18:03.127345+0000","last_undegraded":"2023-10-10T21:18:03.127345+0000","last_fullsized":"2023-10-10T21:18:03.127345+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:27.054207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.106797+0000","last_change":"2023-10-10T21:18:02.112963+0000","last_active":"2023-10-10T21:18:03.106797+0000","last_peered":"2023-10-10T21:18:03.106797+0000","last_clean":"2023-10-10T21:18:03.106797+0000","last_became_active":"2023-10-10T21:18:02.112670+0000","last_became_peered":"2023-10-10T21:18:02.112670+0000","last_unstale":"2023-10-10T21:18:03.106797+0000","last_undegraded":"2023-10-10T21:18:03.106797+0000","last_fullsized":"2023-10-10T21:18:03.106797+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121389+0000","last_change":"2023-10-10T21:18:03.115159+0000","last_active":"2023-10-10T21:18:03.121389+0000","last_peered":"2023-10-10T21:18:03.121389+0000","last_clean":"2023-10-10T21:18:03.121389+0000","last_became_active":"2023-10-10T21:18:03.114547+0000","last_became_peered":"2023-10-10T21:18:03.114547+0000","last_unstale":"2023-10-10T21:18:03.121389+0000","last_undegraded":"2023-10-10T21:18:03.121389+0000","last_fullsized":"2023-10-10T21:18:03.121389+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.026791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095779+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:18.389100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135108+0000","last_change":"2023-10-10T21:18:03.131702+0000","last_active":"2023-10-10T21:18:03.135108+0000","last_peered":"2023-10-10T21:18:03.135108+0000","last_clean":"2023-10-10T21:18:03.135108+0000","last_became_active":"2023-10-10T21:18:03.131482+0000","last_became_peered":"2023-10-10T21:18:03.131482+0000","last_unstale":"2023-10-10T21:18:03.135108+0000","last_undegraded":"2023-10-10T21:18:03.135108+0000","last_fullsized":"2023-10-10T21:18:03.135108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:25.952411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.093138+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:24.809153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121608+0000","last_change":"2023-10-10T21:18:03.118181+0000","last_active":"2023-10-10T21:18:03.121608+0000","last_peered":"2023-10-10T21:18:03.121608+0000","last_clean":"2023-10-10T21:18:03.121608+0000","last_became_active":"2023-10-10T21:18:03.117789+0000","last_became_peered":"2023-10-10T21:18:03.117789+0000","last_unstale":"2023-10-10T21:18:03.121608+0000","last_undegraded":"2023-10-10T21:18:03.121608+0000","last_fullsized":"2023-10-10T21:18:03.121608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:52.592283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101483+0000","last_change":"2023-10-10T21:18:02.107231+0000","last_active":"2023-10-10T21:18:03.101483+0000","last_peered":"2023-10-10T21:18:03.101483+0000","last_clean":"2023-10-10T21:18:03.101483+0000","last_became_active":"2023-10-10T21:18:02.106958+0000","last_became_peered":"2023-10-10T21:18:02.106958+0000","last_unstale":"2023-10-10T21:18:03.101483+0000","last_undegraded":"2023-10-10T21:18:03.101483+0000","last_fullsized":"2023-10-10T21:18:03.101483+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:13.649666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115546+0000","last_change":"2023-10-10T21:18:03.112233+0000","last_active":"2023-10-10T21:18:03.115546+0000","last_peered":"2023-10-10T21:18:03.115546+0000","last_clean":"2023-10-10T21:18:03.115546+0000","last_became_active":"2023-10-10T21:18:03.111983+0000","last_became_peered":"2023-10-10T21:18:03.111983+0000","last_unstale":"2023-10-10T21:18:03.115546+0000","last_undegraded":"2023-10-10T21:18:03.115546+0000","last_fullsized":"2023-10-10T21:18:03.115546+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:57.687562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095953+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:15:05.288481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.092695+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:18:04.033567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129693+0000","last_change":"2023-10-10T21:18:03.126206+0000","last_active":"2023-10-10T21:18:03.129693+0000","last_peered":"2023-10-10T21:18:03.129693+0000","last_clean":"2023-10-10T21:18:03.129693+0000","last_became_active":"2023-10-10T21:18:03.125406+0000","last_became_peered":"2023-10-10T21:18:03.125406+0000","last_unstale":"2023-10-10T21:18:03.129693+0000","last_undegraded":"2023-10-10T21:18:03.129693+0000","last_fullsized":"2023-10-10T21:18:03.129693+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:17.091601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107309+0000","last_change":"2023-10-10T21:18:02.101559+0000","last_active":"2023-10-10T21:18:03.107309+0000","last_peered":"2023-10-10T21:18:03.107309+0000","last_clean":"2023-10-10T21:18:03.107309+0000","last_became_active":"2023-10-10T21:18:02.101311+0000","last_became_peered":"2023-10-10T21:18:02.101311+0000","last_unstale":"2023-10-10T21:18:03.107309+0000","last_undegraded":"2023-10-10T21:18:03.107309+0000","last_fullsized":"2023-10-10T21:18:03.107309+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:50.840955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124725+0000","last_change":"2023-10-10T21:18:03.117311+0000","last_active":"2023-10-10T21:18:03.124725+0000","last_peered":"2023-10-10T21:18:03.124725+0000","last_clean":"2023-10-10T21:18:03.124725+0000","last_became_active":"2023-10-10T21:18:03.116702+0000","last_became_peered":"2023-10-10T21:18:03.116702+0000","last_unstale":"2023-10-10T21:18:03.124725+0000","last_undegraded":"2023-10-10T21:18:03.124725+0000","last_fullsized":"2023-10-10T21:18:03.124725+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:50:21.902920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101734+0000","last_change":"2023-10-10T21:18:02.113291+0000","last_active":"2023-10-10T21:18:03.101734+0000","last_peered":"2023-10-10T21:18:03.101734+0000","last_clean":"2023-10-10T21:18:03.101734+0000","last_became_active":"2023-10-10T21:18:02.113013+0000","last_became_peered":"2023-10-10T21:18:02.113013+0000","last_unstale":"2023-10-10T21:18:03.101734+0000","last_undegraded":"2023-10-10T21:18:03.101734+0000","last_fullsized":"2023-10-10T21:18:03.101734+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118743+0000","last_change":"2023-10-10T21:18:03.112467+0000","last_active":"2023-10-10T21:18:03.118743+0000","last_peered":"2023-10-10T21:18:03.118743+0000","last_clean":"2023-10-10T21:18:03.118743+0000","last_became_active":"2023-10-10T21:18:03.112232+0000","last_became_peered":"2023-10-10T21:18:03.112232+0000","last_unstale":"2023-10-10T21:18:03.118743+0000","last_undegraded":"2023-10-10T21:18:03.118743+0000","last_fullsized":"2023-10-10T21:18:03.118743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:48.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107085+0000","last_change":"2023-10-10T21:18:02.114127+0000","last_active":"2023-10-10T21:18:03.107085+0000","last_peered":"2023-10-10T21:18:03.107085+0000","last_clean":"2023-10-10T21:18:03.107085+0000","last_became_active":"2023-10-10T21:18:02.113859+0000","last_became_peered":"2023-10-10T21:18:02.113859+0000","last_unstale":"2023-10-10T21:18:03.107085+0000","last_undegraded":"2023-10-10T21:18:03.107085+0000","last_fullsized":"2023-10-10T21:18:03.107085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:47:16.599994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104475+0000","last_change":"2023-10-10T21:18:02.113222+0000","last_active":"2023-10-10T21:18:03.104475+0000","last_peered":"2023-10-10T21:18:03.104475+0000","last_clean":"2023-10-10T21:18:03.104475+0000","last_became_active":"2023-10-10T21:18:02.112956+0000","last_became_peered":"2023-10-10T21:18:02.112956+0000","last_unstale":"2023-10-10T21:18:03.104475+0000","last_undegraded":"2023-10-10T21:18:03.104475+0000","last_fullsized":"2023-10-10T21:18:03.104475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:18.389100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.113293+0000","last_change":"2023-10-10T21:18:03.111805+0000","last_active":"2023-10-10T21:18:03.113293+0000","last_peered":"2023-10-10T21:18:03.113293+0000","last_clean":"2023-10-10T21:18:03.113293+0000","last_became_active":"2023-10-10T21:18:03.111563+0000","last_became_peered":"2023-10-10T21:18:03.111563+0000","last_unstale":"2023-10-10T21:18:03.113293+0000","last_undegraded":"2023-10-10T21:18:03.113293+0000","last_fullsized":"2023-10-10T21:18:03.113293+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:12:30.776673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104292+0000","last_change":"2023-10-10T21:18:02.105944+0000","last_active":"2023-10-10T21:18:03.104292+0000","last_peered":"2023-10-10T21:18:03.104292+0000","last_clean":"2023-10-10T21:18:03.104292+0000","last_became_active":"2023-10-10T21:18:02.105661+0000","last_became_peered":"2023-10-10T21:18:02.105661+0000","last_unstale":"2023-10-10T21:18:03.104292+0000","last_undegraded":"2023-10-10T21:18:03.104292+0000","last_fullsized":"2023-10-10T21:18:03.104292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:43:37.712234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095886+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:24:13.410567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126713+0000","last_change":"2023-10-10T21:18:03.125634+0000","last_active":"2023-10-10T21:18:03.126713+0000","last_peered":"2023-10-10T21:18:03.126713+0000","last_clean":"2023-10-10T21:18:03.126713+0000","last_became_active":"2023-10-10T21:18:03.125352+0000","last_became_peered":"2023-10-10T21:18:03.125352+0000","last_unstale":"2023-10-10T21:18:03.126713+0000","last_undegraded":"2023-10-10T21:18:03.126713+0000","last_fullsized":"2023-10-10T21:18:03.126713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:56.907952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095820+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:03.288893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"84'183","reported_seq":462,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107903+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:03.107903+0000","last_peered":"2023-10-10T21:18:03.107903+0000","last_clean":"2023-10-10T21:18:03.107903+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:03.107903+0000","last_undegraded":"2023-10-10T21:18:03.107903+0000","last_fullsized":"2023-10-10T21:18:03.107903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2214,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":1147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.995,"5min":1.014,"15min":1.1859999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.52200000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.435},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0069999999999999,"15min":1.123},"last":0.84599999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.71399999999999997},"min":{"1min":0.41399999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.504,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":1.2669999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.62,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.67400000000000004},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.58599999999999997,"5min":0.51300000000000001,"15min":0.42499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.135},"last":0.88100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542333,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":536344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":1.0569999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.97299999999999998,"5min":1.0129999999999999,"15min":1.143},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.378},"max":{"1min":0.92800000000000005,"5min":1.073,"15min":1.073},"last":0.81699999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.151},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93600000000000005,"5min":0.97799999999999998,"15min":1.01},"last":0.56100000000000005}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.503,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.018,"5min":1.042,"15min":1.1200000000000001},"last":0.64400000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":1.2729999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.443,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":0.85199999999999998,"5min":0.89200000000000002,"15min":1.0880000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66300000000000003,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":1.022,"15min":1.345},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":1.048,"15min":1.238},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.024,"15min":1.4930000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.202},"last":0.80200000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542336,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306620,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065220,"statfs":{"total":96636764160,"available":96322785280,"internally_reserved":0,"allocated":1167360,"data_stored":558370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64400000000000002,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.309},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.61599999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47199999999999998,"15min":0.48699999999999999},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66800000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.755},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.157,"15min":1.3220000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.77800000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.26,"15min":1.2849999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.008,"5min":2.21,"15min":2.21},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.165,"15min":1.268},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.53300000000000003},"max":{"1min":1.0409999999999999,"5min":1.0509999999999999,"15min":1.3400000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.61799999999999999,"5min":0.52800000000000002,"15min":0.505},"max":{"1min":1.026,"5min":1.026,"15min":1.3759999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.85299999999999998,"5min":1.716,"15min":1.716},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.92200000000000004,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298996,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072844,"statfs":{"total":96636764160,"available":96330592256,"internally_reserved":0,"allocated":1748992,"data_stored":1147202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.4890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.65600000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.501}]},{"osd":2,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":1.706},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.70899999999999996,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.72499999999999998,"5min":0.874,"15min":1.2909999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.101,"15min":1.2270000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.2909999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.03,"5min":1.075,"15min":1.2729999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.58199999999999996,"5min":0.57299999999999995,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0980000000000001,"15min":1.3899999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.65100000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.95699999999999996,"5min":1.0960000000000001,"15min":1.2589999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.83999999999999997},"min":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0249999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.92700000000000005}]},{"osd":7,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.64300000000000002,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":0.97299999999999998,"5min":1.139,"15min":1.363},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54200000000000004},"max":{"1min":0.96999999999999997,"5min":1.024,"15min":1.3300000000000001},"last":1.006}]}]},{"osd":1,"up_from":14,"seq":60129542334,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302532,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069308,"statfs":{"total":96636764160,"available":96326971392,"internally_reserved":0,"allocated":1175552,"data_stored":558958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.54200000000000004,"15min":0.48899999999999999},"min":{"1min":0.307,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":8.0839999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.378},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.63500000000000001,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":13.223000000000001,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.5}]},{"osd":2,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":2.085},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.60899999999999999,"15min":0.58199999999999996},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35399999999999998},"max":{"1min":0.88,"5min":0.999,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.81100000000000005,"15min":0.79700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.82799999999999996,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.413,"5min":0.92200000000000004,"15min":0.83599999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":13.130000000000001,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.81899999999999995,"15min":0.80700000000000005},"min":{"1min":0.57999999999999996,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84899999999999998,"15min":0.84299999999999997},"min":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.89300000000000002,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":12.026,"5min":12.026,"15min":12.026},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.751}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306616,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065224,"statfs":{"total":96636764160,"available":96322789376,"internally_reserved":0,"allocated":1163264,"data_stored":556946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28799999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.544},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.501},"min":{"1min":0.315,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.6759999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.68400000000000005,"5min":0.73399999999999999,"15min":1.4610000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.7070000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.4990000000000001},"last":0.501}]},{"osd":4,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.6359999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.246},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.262},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76700000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.2250000000000001,"15min":1.579},"last":0.70999999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.081,"5min":1.27,"15min":1.27},"last":0.75},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.224,"15min":1.224},"last":0.63}]},{"osd":7,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.111,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.228,"5min":1.228,"15min":1.3200000000000001},"last":0.67500000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542336,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310708,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061132,"statfs":{"total":96636764160,"available":96318599168,"internally_reserved":0,"allocated":1159168,"data_stored":556904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.88,"5min":0.92100000000000004,"15min":1.1479999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":0.96299999999999997,"15min":1.758},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.47},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68999999999999995,"15min":0.70299999999999996},"min":{"1min":0.53200000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.98299999999999998,"15min":1.929},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83899999999999997,"5min":1.002,"15min":1.6890000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.98399999999999999,"15min":1.468},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90400000000000003,"5min":1.046,"15min":1.397},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.42799999999999999},"max":{"1min":0.81899999999999995,"5min":0.97699999999999998,"15min":1.385},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":1.105},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":1.5209999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.435},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":1.464},"last":0.67200000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":1.006,"5min":1.006,"15min":1.5700000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51000000000000001,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.86599999999999999,"5min":0.91900000000000004,"15min":1.4139999999999999},"last":0.81499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542333,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":536344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.878,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":1.371},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88100000000000001,"5min":0.93300000000000005,"15min":3.895},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71699999999999997,"15min":0.748},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.97899999999999998,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.75}]},{"osd":2,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.2889999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.56100000000000005,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.3540000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.68200000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.65200000000000002},"min":{"1min":0.44900000000000001,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.496,"15min":4.2789999999999999},"last":0.621}]},{"osd":6,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.50800000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.026},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.748,"15min":0.77100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":2.8900000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.077,"15min":3.9420000000000002},"last":0.73699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:07.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:08.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.115+0000 7fce421ff700 1 Processor -- start 2023-10-10T21:18:08.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.115+0000 7fce421ff700 1 -- start start 2023-10-10T21:18:08.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce421ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce3c0b1420 0x7fce3c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce421ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce3c0ccf90 0x7fce3c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce421ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c0cc300 con 0x7fce3c0cbf30 2023-10-10T21:18:08.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce421ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c156bf0 con 0x7fce3c0ccf90 2023-10-10T21:18:08.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce421ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c0ae950 con 0x7fce3c0b1420 2023-10-10T21:18:08.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce3bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce3c0ccf90 0x7fce3c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce3b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fce3c0cbf30 0x7fce3c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33122/0 (socket says 172.21.15.154:33122) 2023-10-10T21:18:08.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce3bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce3c0ccf90 0x7fce3c0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37310/0 (socket says 172.21.15.154:37310) 2023-10-10T21:18:08.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce3b7fe700 1 -- 172.21.15.154:0/1643140896 learned_addr learned my addr 172.21.15.154:0/1643140896 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:08.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce3affd700 1 --2- 172.21.15.154:0/1643140896 >> v2:172.21.15.179:3300/0 conn(0x7fce3c0b1420 0x7fce3c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce3bfff700 1 -- 172.21.15.154:0/1643140896 >> v2:172.21.15.179:3300/0 conn(0x7fce3c0b1420 msgr2=0x7fce3c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:08.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce3bfff700 1 --2- 172.21.15.154:0/1643140896 >> v2:172.21.15.179:3300/0 conn(0x7fce3c0b1420 0x7fce3c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.117+0000 7fce3bfff700 1 -- 172.21.15.154:0/1643140896 >> v1:172.21.15.154:6789/0 conn(0x7fce3c0cbf30 legacy=0x7fce3c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.118+0000 7fce3bfff700 1 -- 172.21.15.154:0/1643140896 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0ad370 con 0x7fce3c0ccf90 2023-10-10T21:18:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.118+0000 7fce3a7fc700 1 -- 172.21.15.154:0/1643140896 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549016210 0 0) 0x7fce3c0cc300 con 0x7fce3c0cbf30 2023-10-10T21:18:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.118+0000 7fce3bfff700 1 --2- 172.21.15.154:0/1643140896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 0x7fce3c0c9740 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0c9280 tx=0x7fce34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55182ee278fcd2db server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.118+0000 7fce3a7fc700 1 -- 172.21.15.154:0/1643140896 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400e070 con 0x7fce3c0ccf90 2023-10-10T21:18:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.118+0000 7fce3a7fc700 1 -- 172.21.15.154:0/1643140896 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3400bb20 con 0x7fce3c0ccf90 2023-10-10T21:18:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.118+0000 7fce3a7fc700 1 -- 172.21.15.154:0/1643140896 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34012430 con 0x7fce3c0ccf90 2023-10-10T21:18:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.119+0000 7fce421ff700 1 -- 172.21.15.154:0/1643140896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 msgr2=0x7fce3c0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.119+0000 7fce421ff700 1 --2- 172.21.15.154:0/1643140896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 0x7fce3c0c9740 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0c9280 tx=0x7fce34009780 comp rx=0 tx=0).stop 2023-10-10T21:18:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.119+0000 7fce421ff700 1 -- 172.21.15.154:0/1643140896 shutdown_connections 2023-10-10T21:18:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.119+0000 7fce421ff700 1 --2- 172.21.15.154:0/1643140896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 0x7fce3c0c9740 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.119+0000 7fce421ff700 1 --2- 172.21.15.154:0/1643140896 >> v2:172.21.15.179:3300/0 conn(0x7fce3c0b1420 0x7fce3c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.119+0000 7fce421ff700 1 -- 172.21.15.154:0/1643140896 >> 172.21.15.154:0/1643140896 conn(0x7fce3c06a320 msgr2=0x7fce3c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:08.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.119+0000 7fce421ff700 1 -- 172.21.15.154:0/1643140896 shutdown_connections 2023-10-10T21:18:08.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.119+0000 7fce421ff700 1 -- 172.21.15.154:0/1643140896 wait complete. 2023-10-10T21:18:08.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.120+0000 7fce421ff700 1 Processor -- start 2023-10-10T21:18:08.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.120+0000 7fce421ff700 1 -- start start 2023-10-10T21:18:08.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.121+0000 7fce421ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce3c0b1420 0x7fce3c166cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.121+0000 7fce421ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce3c0cbf30 0x7fce3c0aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.121+0000 7fce421ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 0x7fce3c0aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.121+0000 7fce421ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0a6e60 con 0x7fce3c0ccf90 2023-10-10T21:18:08.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.121+0000 7fce421ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0aa6f0 con 0x7fce3c0b1420 2023-10-10T21:18:08.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.121+0000 7fce421ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0a6530 con 0x7fce3c0cbf30 2023-10-10T21:18:08.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 0x7fce3c0aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 0x7fce3c0aaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37316/0 (socket says 172.21.15.154:37316) 2023-10-10T21:18:08.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3bfff700 1 -- 172.21.15.154:0/3961416547 learned_addr learned my addr 172.21.15.154:0/3961416547 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:08.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3b7fe700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce3c0b1420 0x7fce3c166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3affd700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce3c0cbf30 0x7fce3c0aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3bfff700 1 -- 172.21.15.154:0/3961416547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce3c0cbf30 msgr2=0x7fce3c0aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3bfff700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce3c0cbf30 0x7fce3c0aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3bfff700 1 -- 172.21.15.154:0/3961416547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce3c0b1420 msgr2=0x7fce3c166cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3bfff700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce3c0b1420 0x7fce3c166cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3bfff700 1 -- 172.21.15.154:0/3961416547 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34009a20 con 0x7fce3c0ccf90 2023-10-10T21:18:08.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce3bfff700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 0x7fce3c0aaf20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fce3c064290 tx=0x7fce34019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:08.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce237fe700 1 -- 172.21.15.154:0/3961416547 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34027470 con 0x7fce3c0ccf90 2023-10-10T21:18:08.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.122+0000 7fce237fe700 1 -- 172.21.15.154:0/3961416547 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce34027610 con 0x7fce3c0ccf90 2023-10-10T21:18:08.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.123+0000 7fce237fe700 1 -- 172.21.15.154:0/3961416547 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340279d0 con 0x7fce3c0ccf90 2023-10-10T21:18:08.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.123+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c0a6810 con 0x7fce3c0ccf90 2023-10-10T21:18:08.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.123+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c1671f0 con 0x7fce3c0ccf90 2023-10-10T21:18:08.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.124+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3c04c3c0 con 0x7fce3c0ccf90 2023-10-10T21:18:08.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.124+0000 7fce237fe700 1 -- 172.21.15.154:0/3961416547 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce34024070 con 0x7fce3c0ccf90 2023-10-10T21:18:08.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.125+0000 7fce237fe700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce28066f30 0x7fce280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.125+0000 7fce237fe700 1 -- 172.21.15.154:0/3961416547 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fce34086e30 con 0x7fce3c0ccf90 2023-10-10T21:18:08.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.126+0000 7fce3b7fe700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce28066f30 0x7fce280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.126+0000 7fce3b7fe700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce28066f30 0x7fce280693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007fd0 tx=0x7fce2c007d30 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:08.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.130+0000 7fce237fe700 1 -- 172.21.15.154:0/3961416547 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce34053e70 con 0x7fce3c0ccf90 2023-10-10T21:18:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.315+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce3c0a6fa0 con 0x7fce28066f30 2023-10-10T21:18:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.324+0000 7fce237fe700 1 -- 172.21.15.154:0/3961416547 <== mgr.6531 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286187 (secure 0 0 0) 0x7fce3c0a6fa0 con 0x7fce28066f30 2023-10-10T21:18:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:08.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce28066f30 msgr2=0x7fce280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce28066f30 0x7fce280693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007fd0 tx=0x7fce2c007d30 comp rx=0 tx=0).stop 2023-10-10T21:18:08.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 msgr2=0x7fce3c0aaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 0x7fce3c0aaf20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fce3c064290 tx=0x7fce34019000 comp rx=0 tx=0).stop 2023-10-10T21:18:08.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 shutdown_connections 2023-10-10T21:18:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0ccf90 0x7fce3c0aaf20 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce28066f30 0x7fce280693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce3c0b1420 0x7fce3c166cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 --2- 172.21.15.154:0/3961416547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce3c0cbf30 0x7fce3c0aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 >> 172.21.15.154:0/3961416547 conn(0x7fce3c06a320 msgr2=0x7fce3c155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 shutdown_connections 2023-10-10T21:18:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.328+0000 7fce421ff700 1 -- 172.21.15.154:0/3961416547 wait complete. 2023-10-10T21:18:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:08.347 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:18:06.790656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592582,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":314,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433524,"kb_used_data":10164,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541196,"statfs":{"total":773094113280,"available":770602184704,"internally_reserved":0,"allocated":10407936,"data_stored":5598858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2214,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.703887"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128453+0000","last_change":"2023-10-10T21:18:03.123147+0000","last_active":"2023-10-10T21:18:03.128453+0000","last_peered":"2023-10-10T21:18:03.128453+0000","last_clean":"2023-10-10T21:18:03.128453+0000","last_became_active":"2023-10-10T21:18:03.122883+0000","last_became_peered":"2023-10-10T21:18:03.122883+0000","last_unstale":"2023-10-10T21:18:03.128453+0000","last_undegraded":"2023-10-10T21:18:03.128453+0000","last_fullsized":"2023-10-10T21:18:03.128453+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:28:36.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121489+0000","last_change":"2023-10-10T21:18:03.116758+0000","last_active":"2023-10-10T21:18:03.121489+0000","last_peered":"2023-10-10T21:18:03.121489+0000","last_clean":"2023-10-10T21:18:03.121489+0000","last_became_active":"2023-10-10T21:18:03.116472+0000","last_became_peered":"2023-10-10T21:18:03.116472+0000","last_unstale":"2023-10-10T21:18:03.121489+0000","last_undegraded":"2023-10-10T21:18:03.121489+0000","last_fullsized":"2023-10-10T21:18:03.121489+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:26.091130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132434+0000","last_change":"2023-10-10T21:18:03.128869+0000","last_active":"2023-10-10T21:18:03.132434+0000","last_peered":"2023-10-10T21:18:03.132434+0000","last_clean":"2023-10-10T21:18:03.132434+0000","last_became_active":"2023-10-10T21:18:03.128610+0000","last_became_peered":"2023-10-10T21:18:03.128610+0000","last_unstale":"2023-10-10T21:18:03.132434+0000","last_undegraded":"2023-10-10T21:18:03.132434+0000","last_fullsized":"2023-10-10T21:18:03.132434+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:47.801041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.119402+0000","last_change":"2023-10-10T21:18:03.113980+0000","last_active":"2023-10-10T21:18:03.119402+0000","last_peered":"2023-10-10T21:18:03.119402+0000","last_clean":"2023-10-10T21:18:03.119402+0000","last_became_active":"2023-10-10T21:18:03.113689+0000","last_became_peered":"2023-10-10T21:18:03.113689+0000","last_unstale":"2023-10-10T21:18:03.119402+0000","last_undegraded":"2023-10-10T21:18:03.119402+0000","last_fullsized":"2023-10-10T21:18:03.119402+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:22:18.290768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121849+0000","last_change":"2023-10-10T21:18:03.115993+0000","last_active":"2023-10-10T21:18:03.121849+0000","last_peered":"2023-10-10T21:18:03.121849+0000","last_clean":"2023-10-10T21:18:03.121849+0000","last_became_active":"2023-10-10T21:18:03.114933+0000","last_became_peered":"2023-10-10T21:18:03.114933+0000","last_unstale":"2023-10-10T21:18:03.121849+0000","last_undegraded":"2023-10-10T21:18:03.121849+0000","last_fullsized":"2023-10-10T21:18:03.121849+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:09.169541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120078+0000","last_change":"2023-10-10T21:18:03.116446+0000","last_active":"2023-10-10T21:18:03.120078+0000","last_peered":"2023-10-10T21:18:03.120078+0000","last_clean":"2023-10-10T21:18:03.120078+0000","last_became_active":"2023-10-10T21:18:03.116170+0000","last_became_peered":"2023-10-10T21:18:03.116170+0000","last_unstale":"2023-10-10T21:18:03.120078+0000","last_undegraded":"2023-10-10T21:18:03.120078+0000","last_fullsized":"2023-10-10T21:18:03.120078+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:11:20.228457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126153+0000","last_change":"2023-10-10T21:18:03.122782+0000","last_active":"2023-10-10T21:18:03.126153+0000","last_peered":"2023-10-10T21:18:03.126153+0000","last_clean":"2023-10-10T21:18:03.126153+0000","last_became_active":"2023-10-10T21:18:03.122522+0000","last_became_peered":"2023-10-10T21:18:03.122522+0000","last_unstale":"2023-10-10T21:18:03.126153+0000","last_undegraded":"2023-10-10T21:18:03.126153+0000","last_fullsized":"2023-10-10T21:18:03.126153+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:16.215761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118425+0000","last_change":"2023-10-10T21:18:03.114857+0000","last_active":"2023-10-10T21:18:03.118425+0000","last_peered":"2023-10-10T21:18:03.118425+0000","last_clean":"2023-10-10T21:18:03.118425+0000","last_became_active":"2023-10-10T21:18:03.114601+0000","last_became_peered":"2023-10-10T21:18:03.114601+0000","last_unstale":"2023-10-10T21:18:03.118425+0000","last_undegraded":"2023-10-10T21:18:03.118425+0000","last_fullsized":"2023-10-10T21:18:03.118425+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:43.812657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124840+0000","last_change":"2023-10-10T21:18:03.124241+0000","last_active":"2023-10-10T21:18:03.124840+0000","last_peered":"2023-10-10T21:18:03.124840+0000","last_clean":"2023-10-10T21:18:03.124840+0000","last_became_active":"2023-10-10T21:18:03.123943+0000","last_became_peered":"2023-10-10T21:18:03.123943+0000","last_unstale":"2023-10-10T21:18:03.124840+0000","last_undegraded":"2023-10-10T21:18:03.124840+0000","last_fullsized":"2023-10-10T21:18:03.124840+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115678+0000","last_change":"2023-10-10T21:18:03.111549+0000","last_active":"2023-10-10T21:18:03.115678+0000","last_peered":"2023-10-10T21:18:03.115678+0000","last_clean":"2023-10-10T21:18:03.115678+0000","last_became_active":"2023-10-10T21:18:03.111171+0000","last_became_peered":"2023-10-10T21:18:03.111171+0000","last_unstale":"2023-10-10T21:18:03.115678+0000","last_undegraded":"2023-10-10T21:18:03.115678+0000","last_fullsized":"2023-10-10T21:18:03.115678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:48:55.981597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118815+0000","last_change":"2023-10-10T21:18:03.113743+0000","last_active":"2023-10-10T21:18:03.118815+0000","last_peered":"2023-10-10T21:18:03.118815+0000","last_clean":"2023-10-10T21:18:03.118815+0000","last_became_active":"2023-10-10T21:18:03.113483+0000","last_became_peered":"2023-10-10T21:18:03.113483+0000","last_unstale":"2023-10-10T21:18:03.118815+0000","last_undegraded":"2023-10-10T21:18:03.118815+0000","last_fullsized":"2023-10-10T21:18:03.118815+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:48.507042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135387+0000","last_change":"2023-10-10T21:18:03.133411+0000","last_active":"2023-10-10T21:18:03.135387+0000","last_peered":"2023-10-10T21:18:03.135387+0000","last_clean":"2023-10-10T21:18:03.135387+0000","last_became_active":"2023-10-10T21:18:03.133113+0000","last_became_peered":"2023-10-10T21:18:03.133113+0000","last_unstale":"2023-10-10T21:18:03.135387+0000","last_undegraded":"2023-10-10T21:18:03.135387+0000","last_fullsized":"2023-10-10T21:18:03.135387+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:07:30.524167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121779+0000","last_change":"2023-10-10T21:18:03.115176+0000","last_active":"2023-10-10T21:18:03.121779+0000","last_peered":"2023-10-10T21:18:03.121779+0000","last_clean":"2023-10-10T21:18:03.121779+0000","last_became_active":"2023-10-10T21:18:03.114425+0000","last_became_peered":"2023-10-10T21:18:03.114425+0000","last_unstale":"2023-10-10T21:18:03.121779+0000","last_undegraded":"2023-10-10T21:18:03.121779+0000","last_fullsized":"2023-10-10T21:18:03.121779+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:30.856134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132619+0000","last_change":"2023-10-10T21:18:03.128819+0000","last_active":"2023-10-10T21:18:03.132619+0000","last_peered":"2023-10-10T21:18:03.132619+0000","last_clean":"2023-10-10T21:18:03.132619+0000","last_became_active":"2023-10-10T21:18:03.128567+0000","last_became_peered":"2023-10-10T21:18:03.128567+0000","last_unstale":"2023-10-10T21:18:03.132619+0000","last_undegraded":"2023-10-10T21:18:03.132619+0000","last_fullsized":"2023-10-10T21:18:03.132619+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:01:23.478813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.114086+0000","last_change":"2023-10-10T21:18:03.109240+0000","last_active":"2023-10-10T21:18:03.114086+0000","last_peered":"2023-10-10T21:18:03.114086+0000","last_clean":"2023-10-10T21:18:03.114086+0000","last_became_active":"2023-10-10T21:18:03.108970+0000","last_became_peered":"2023-10-10T21:18:03.108970+0000","last_unstale":"2023-10-10T21:18:03.114086+0000","last_undegraded":"2023-10-10T21:18:03.114086+0000","last_fullsized":"2023-10-10T21:18:03.114086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:51:48.404639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124382+0000","last_change":"2023-10-10T21:18:03.117935+0000","last_active":"2023-10-10T21:18:03.124382+0000","last_peered":"2023-10-10T21:18:03.124382+0000","last_clean":"2023-10-10T21:18:03.124382+0000","last_became_active":"2023-10-10T21:18:03.117552+0000","last_became_peered":"2023-10-10T21:18:03.117552+0000","last_unstale":"2023-10-10T21:18:03.124382+0000","last_undegraded":"2023-10-10T21:18:03.124382+0000","last_fullsized":"2023-10-10T21:18:03.124382+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:24:39.255862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.122399+0000","last_change":"2023-10-10T21:18:03.113509+0000","last_active":"2023-10-10T21:18:03.122399+0000","last_peered":"2023-10-10T21:18:03.122399+0000","last_clean":"2023-10-10T21:18:03.122399+0000","last_became_active":"2023-10-10T21:18:03.113227+0000","last_became_peered":"2023-10-10T21:18:03.113227+0000","last_unstale":"2023-10-10T21:18:03.122399+0000","last_undegraded":"2023-10-10T21:18:03.122399+0000","last_fullsized":"2023-10-10T21:18:03.122399+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:19:10.967416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129924+0000","last_change":"2023-10-10T21:18:03.126424+0000","last_active":"2023-10-10T21:18:03.129924+0000","last_peered":"2023-10-10T21:18:03.129924+0000","last_clean":"2023-10-10T21:18:03.129924+0000","last_became_active":"2023-10-10T21:18:03.125673+0000","last_became_peered":"2023-10-10T21:18:03.125673+0000","last_unstale":"2023-10-10T21:18:03.129924+0000","last_undegraded":"2023-10-10T21:18:03.129924+0000","last_fullsized":"2023-10-10T21:18:03.129924+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:22.538251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138071+0000","last_change":"2023-10-10T21:18:03.136560+0000","last_active":"2023-10-10T21:18:03.138071+0000","last_peered":"2023-10-10T21:18:03.138071+0000","last_clean":"2023-10-10T21:18:03.138071+0000","last_became_active":"2023-10-10T21:18:03.136301+0000","last_became_peered":"2023-10-10T21:18:03.136301+0000","last_unstale":"2023-10-10T21:18:03.138071+0000","last_undegraded":"2023-10-10T21:18:03.138071+0000","last_fullsized":"2023-10-10T21:18:03.138071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:10.463301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128656+0000","last_change":"2023-10-10T21:18:03.125260+0000","last_active":"2023-10-10T21:18:03.128656+0000","last_peered":"2023-10-10T21:18:03.128656+0000","last_clean":"2023-10-10T21:18:03.128656+0000","last_became_active":"2023-10-10T21:18:03.124986+0000","last_became_peered":"2023-10-10T21:18:03.124986+0000","last_unstale":"2023-10-10T21:18:03.128656+0000","last_undegraded":"2023-10-10T21:18:03.128656+0000","last_fullsized":"2023-10-10T21:18:03.128656+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:28:14.399113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121625+0000","last_change":"2023-10-10T21:18:03.118901+0000","last_active":"2023-10-10T21:18:03.121625+0000","last_peered":"2023-10-10T21:18:03.121625+0000","last_clean":"2023-10-10T21:18:03.121625+0000","last_became_active":"2023-10-10T21:18:03.118655+0000","last_became_peered":"2023-10-10T21:18:03.118655+0000","last_unstale":"2023-10-10T21:18:03.121625+0000","last_undegraded":"2023-10-10T21:18:03.121625+0000","last_fullsized":"2023-10-10T21:18:03.121625+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:35:55.138638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125083+0000","last_change":"2023-10-10T21:18:03.121035+0000","last_active":"2023-10-10T21:18:03.125083+0000","last_peered":"2023-10-10T21:18:03.125083+0000","last_clean":"2023-10-10T21:18:03.125083+0000","last_became_active":"2023-10-10T21:18:03.120773+0000","last_became_peered":"2023-10-10T21:18:03.120773+0000","last_unstale":"2023-10-10T21:18:03.125083+0000","last_undegraded":"2023-10-10T21:18:03.125083+0000","last_fullsized":"2023-10-10T21:18:03.125083+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:14.654306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121369+0000","last_change":"2023-10-10T21:18:03.115215+0000","last_active":"2023-10-10T21:18:03.121369+0000","last_peered":"2023-10-10T21:18:03.121369+0000","last_clean":"2023-10-10T21:18:03.121369+0000","last_became_active":"2023-10-10T21:18:03.114868+0000","last_became_peered":"2023-10-10T21:18:03.114868+0000","last_unstale":"2023-10-10T21:18:03.121369+0000","last_undegraded":"2023-10-10T21:18:03.121369+0000","last_fullsized":"2023-10-10T21:18:03.121369+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:05.639479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129609+0000","last_change":"2023-10-10T21:18:03.126162+0000","last_active":"2023-10-10T21:18:03.129609+0000","last_peered":"2023-10-10T21:18:03.129609+0000","last_clean":"2023-10-10T21:18:03.129609+0000","last_became_active":"2023-10-10T21:18:03.125841+0000","last_became_peered":"2023-10-10T21:18:03.125841+0000","last_unstale":"2023-10-10T21:18:03.129609+0000","last_undegraded":"2023-10-10T21:18:03.129609+0000","last_fullsized":"2023-10-10T21:18:03.129609+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:21.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"94'4","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138188+0000","last_change":"2023-10-10T21:18:02.102666+0000","last_active":"2023-10-10T21:18:03.138188+0000","last_peered":"2023-10-10T21:18:03.138188+0000","last_clean":"2023-10-10T21:18:03.138188+0000","last_became_active":"2023-10-10T21:18:02.102354+0000","last_became_peered":"2023-10-10T21:18:02.102354+0000","last_unstale":"2023-10-10T21:18:03.138188+0000","last_undegraded":"2023-10-10T21:18:03.138188+0000","last_fullsized":"2023-10-10T21:18:03.138188+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121828+0000","last_change":"2023-10-10T21:18:03.115827+0000","last_active":"2023-10-10T21:18:03.121828+0000","last_peered":"2023-10-10T21:18:03.121828+0000","last_clean":"2023-10-10T21:18:03.121828+0000","last_became_active":"2023-10-10T21:18:03.114749+0000","last_became_peered":"2023-10-10T21:18:03.114749+0000","last_unstale":"2023-10-10T21:18:03.121828+0000","last_undegraded":"2023-10-10T21:18:03.121828+0000","last_fullsized":"2023-10-10T21:18:03.121828+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:25.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135289+0000","last_change":"2023-10-10T21:18:02.104346+0000","last_active":"2023-10-10T21:18:03.135289+0000","last_peered":"2023-10-10T21:18:03.135289+0000","last_clean":"2023-10-10T21:18:03.135289+0000","last_became_active":"2023-10-10T21:18:02.104087+0000","last_became_peered":"2023-10-10T21:18:02.104087+0000","last_unstale":"2023-10-10T21:18:03.135289+0000","last_undegraded":"2023-10-10T21:18:03.135289+0000","last_fullsized":"2023-10-10T21:18:03.135289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140721+0000","last_change":"2023-10-10T21:18:02.115690+0000","last_active":"2023-10-10T21:18:03.140721+0000","last_peered":"2023-10-10T21:18:03.140721+0000","last_clean":"2023-10-10T21:18:03.140721+0000","last_became_active":"2023-10-10T21:18:02.115385+0000","last_became_peered":"2023-10-10T21:18:02.115385+0000","last_unstale":"2023-10-10T21:18:03.140721+0000","last_undegraded":"2023-10-10T21:18:03.140721+0000","last_fullsized":"2023-10-10T21:18:03.140721+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:00.443737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124744+0000","last_change":"2023-10-10T21:18:03.117499+0000","last_active":"2023-10-10T21:18:03.124744+0000","last_peered":"2023-10-10T21:18:03.124744+0000","last_clean":"2023-10-10T21:18:03.124744+0000","last_became_active":"2023-10-10T21:18:03.117056+0000","last_became_peered":"2023-10-10T21:18:03.117056+0000","last_unstale":"2023-10-10T21:18:03.124744+0000","last_undegraded":"2023-10-10T21:18:03.124744+0000","last_fullsized":"2023-10-10T21:18:03.124744+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095815+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:23.810550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132671+0000","last_change":"2023-10-10T21:18:02.105454+0000","last_active":"2023-10-10T21:18:03.132671+0000","last_peered":"2023-10-10T21:18:03.132671+0000","last_clean":"2023-10-10T21:18:03.132671+0000","last_became_active":"2023-10-10T21:18:02.104962+0000","last_became_peered":"2023-10-10T21:18:02.104962+0000","last_unstale":"2023-10-10T21:18:03.132671+0000","last_undegraded":"2023-10-10T21:18:03.132671+0000","last_fullsized":"2023-10-10T21:18:03.132671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:42.291687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130936+0000","last_change":"2023-10-10T21:18:03.127926+0000","last_active":"2023-10-10T21:18:03.130936+0000","last_peered":"2023-10-10T21:18:03.130936+0000","last_clean":"2023-10-10T21:18:03.130936+0000","last_became_active":"2023-10-10T21:18:03.127034+0000","last_became_peered":"2023-10-10T21:18:03.127034+0000","last_unstale":"2023-10-10T21:18:03.130936+0000","last_undegraded":"2023-10-10T21:18:03.130936+0000","last_fullsized":"2023-10-10T21:18:03.130936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:05:17.246909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.097122+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:12:29.772033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124869+0000","last_change":"2023-10-10T21:18:03.122508+0000","last_active":"2023-10-10T21:18:03.124869+0000","last_peered":"2023-10-10T21:18:03.124869+0000","last_clean":"2023-10-10T21:18:03.124869+0000","last_became_active":"2023-10-10T21:18:03.122245+0000","last_became_peered":"2023-10-10T21:18:03.122245+0000","last_unstale":"2023-10-10T21:18:03.124869+0000","last_undegraded":"2023-10-10T21:18:03.124869+0000","last_fullsized":"2023-10-10T21:18:03.124869+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:41.065339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104533+0000","last_change":"2023-10-10T21:18:02.112370+0000","last_active":"2023-10-10T21:18:03.104533+0000","last_peered":"2023-10-10T21:18:03.104533+0000","last_clean":"2023-10-10T21:18:03.104533+0000","last_became_active":"2023-10-10T21:18:02.112099+0000","last_became_peered":"2023-10-10T21:18:02.112099+0000","last_unstale":"2023-10-10T21:18:03.104533+0000","last_undegraded":"2023-10-10T21:18:03.104533+0000","last_fullsized":"2023-10-10T21:18:03.104533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:03.288893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121084+0000","last_change":"2023-10-10T21:18:03.118553+0000","last_active":"2023-10-10T21:18:03.121084+0000","last_peered":"2023-10-10T21:18:03.121084+0000","last_clean":"2023-10-10T21:18:03.121084+0000","last_became_active":"2023-10-10T21:18:03.118289+0000","last_became_peered":"2023-10-10T21:18:03.118289+0000","last_unstale":"2023-10-10T21:18:03.121084+0000","last_undegraded":"2023-10-10T21:18:03.121084+0000","last_fullsized":"2023-10-10T21:18:03.121084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:05.319721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105764+0000","last_change":"2023-10-10T21:18:02.103988+0000","last_active":"2023-10-10T21:18:03.105764+0000","last_peered":"2023-10-10T21:18:03.105764+0000","last_clean":"2023-10-10T21:18:03.105764+0000","last_became_active":"2023-10-10T21:18:02.103709+0000","last_became_peered":"2023-10-10T21:18:02.103709+0000","last_unstale":"2023-10-10T21:18:03.105764+0000","last_undegraded":"2023-10-10T21:18:03.105764+0000","last_fullsized":"2023-10-10T21:18:03.105764+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:43.528613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105952+0000","last_change":"2023-10-10T21:18:02.097199+0000","last_active":"2023-10-10T21:18:03.105952+0000","last_peered":"2023-10-10T21:18:03.105952+0000","last_clean":"2023-10-10T21:18:03.105952+0000","last_became_active":"2023-10-10T21:18:02.096924+0000","last_became_peered":"2023-10-10T21:18:02.096924+0000","last_unstale":"2023-10-10T21:18:03.105952+0000","last_undegraded":"2023-10-10T21:18:03.105952+0000","last_fullsized":"2023-10-10T21:18:03.105952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:42.119227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137096+0000","last_change":"2023-10-10T21:18:03.134927+0000","last_active":"2023-10-10T21:18:03.137096+0000","last_peered":"2023-10-10T21:18:03.137096+0000","last_clean":"2023-10-10T21:18:03.137096+0000","last_became_active":"2023-10-10T21:18:03.134663+0000","last_became_peered":"2023-10-10T21:18:03.134663+0000","last_unstale":"2023-10-10T21:18:03.137096+0000","last_undegraded":"2023-10-10T21:18:03.137096+0000","last_fullsized":"2023-10-10T21:18:03.137096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:02:50.568864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095781+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:29:40.211849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"94'3","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135167+0000","last_change":"2023-10-10T21:18:02.112911+0000","last_active":"2023-10-10T21:18:03.135167+0000","last_peered":"2023-10-10T21:18:03.135167+0000","last_clean":"2023-10-10T21:18:03.135167+0000","last_became_active":"2023-10-10T21:18:02.112580+0000","last_became_peered":"2023-10-10T21:18:02.112580+0000","last_unstale":"2023-10-10T21:18:03.135167+0000","last_undegraded":"2023-10-10T21:18:03.135167+0000","last_fullsized":"2023-10-10T21:18:03.135167+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:49:28.212088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120562+0000","last_change":"2023-10-10T21:18:03.114601+0000","last_active":"2023-10-10T21:18:03.120562+0000","last_peered":"2023-10-10T21:18:03.120562+0000","last_clean":"2023-10-10T21:18:03.120562+0000","last_became_active":"2023-10-10T21:18:03.114335+0000","last_became_peered":"2023-10-10T21:18:03.114335+0000","last_unstale":"2023-10-10T21:18:03.120562+0000","last_undegraded":"2023-10-10T21:18:03.120562+0000","last_fullsized":"2023-10-10T21:18:03.120562+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:59:51.773918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"94'6","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137510+0000","last_change":"2023-10-10T21:18:02.104756+0000","last_active":"2023-10-10T21:18:03.137510+0000","last_peered":"2023-10-10T21:18:03.137510+0000","last_clean":"2023-10-10T21:18:03.137510+0000","last_became_active":"2023-10-10T21:18:02.104493+0000","last_became_peered":"2023-10-10T21:18:02.104493+0000","last_unstale":"2023-10-10T21:18:03.137510+0000","last_undegraded":"2023-10-10T21:18:03.137510+0000","last_fullsized":"2023-10-10T21:18:03.137510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:29:40.211849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127583+0000","last_change":"2023-10-10T21:18:03.123287+0000","last_active":"2023-10-10T21:18:03.127583+0000","last_peered":"2023-10-10T21:18:03.127583+0000","last_clean":"2023-10-10T21:18:03.127583+0000","last_became_active":"2023-10-10T21:18:03.121920+0000","last_became_peered":"2023-10-10T21:18:03.121920+0000","last_unstale":"2023-10-10T21:18:03.127583+0000","last_undegraded":"2023-10-10T21:18:03.127583+0000","last_fullsized":"2023-10-10T21:18:03.127583+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130881+0000","last_change":"2023-10-10T21:18:02.105096+0000","last_active":"2023-10-10T21:18:03.130881+0000","last_peered":"2023-10-10T21:18:03.130881+0000","last_clean":"2023-10-10T21:18:03.130881+0000","last_became_active":"2023-10-10T21:18:02.104823+0000","last_became_peered":"2023-10-10T21:18:02.104823+0000","last_unstale":"2023-10-10T21:18:03.130881+0000","last_undegraded":"2023-10-10T21:18:03.130881+0000","last_fullsized":"2023-10-10T21:18:03.130881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:23.810550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.096574+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:24:31.607986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125859+0000","last_change":"2023-10-10T21:18:03.125107+0000","last_active":"2023-10-10T21:18:03.125859+0000","last_peered":"2023-10-10T21:18:03.125859+0000","last_clean":"2023-10-10T21:18:03.125859+0000","last_became_active":"2023-10-10T21:18:03.124825+0000","last_became_peered":"2023-10-10T21:18:03.124825+0000","last_unstale":"2023-10-10T21:18:03.125859+0000","last_undegraded":"2023-10-10T21:18:03.125859+0000","last_fullsized":"2023-10-10T21:18:03.125859+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.093710+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:06.243413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120796+0000","last_change":"2023-10-10T21:18:03.114682+0000","last_active":"2023-10-10T21:18:03.120796+0000","last_peered":"2023-10-10T21:18:03.120796+0000","last_clean":"2023-10-10T21:18:03.120796+0000","last_became_active":"2023-10-10T21:18:03.114394+0000","last_became_peered":"2023-10-10T21:18:03.114394+0000","last_unstale":"2023-10-10T21:18:03.120796+0000","last_undegraded":"2023-10-10T21:18:03.120796+0000","last_fullsized":"2023-10-10T21:18:03.120796+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:57.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"94'8","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.141200+0000","last_change":"2023-10-10T21:18:02.106816+0000","last_active":"2023-10-10T21:18:03.141200+0000","last_peered":"2023-10-10T21:18:03.141200+0000","last_clean":"2023-10-10T21:18:03.141200+0000","last_became_active":"2023-10-10T21:18:02.106514+0000","last_became_peered":"2023-10-10T21:18:02.106514+0000","last_unstale":"2023-10-10T21:18:03.141200+0000","last_undegraded":"2023-10-10T21:18:03.141200+0000","last_fullsized":"2023-10-10T21:18:03.141200+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:06.243413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.123938+0000","last_change":"2023-10-10T21:18:03.118958+0000","last_active":"2023-10-10T21:18:03.123938+0000","last_peered":"2023-10-10T21:18:03.123938+0000","last_clean":"2023-10-10T21:18:03.123938+0000","last_became_active":"2023-10-10T21:18:03.118715+0000","last_became_peered":"2023-10-10T21:18:03.118715+0000","last_unstale":"2023-10-10T21:18:03.123938+0000","last_undegraded":"2023-10-10T21:18:03.123938+0000","last_fullsized":"2023-10-10T21:18:03.123938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:53.044728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.096578+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:12:58.528943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124747+0000","last_change":"2023-10-10T21:18:03.118846+0000","last_active":"2023-10-10T21:18:03.124747+0000","last_peered":"2023-10-10T21:18:03.124747+0000","last_clean":"2023-10-10T21:18:03.124747+0000","last_became_active":"2023-10-10T21:18:03.118599+0000","last_became_peered":"2023-10-10T21:18:03.118599+0000","last_unstale":"2023-10-10T21:18:03.124747+0000","last_undegraded":"2023-10-10T21:18:03.124747+0000","last_fullsized":"2023-10-10T21:18:03.124747+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:45.905044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140786+0000","last_change":"2023-10-10T21:18:02.116376+0000","last_active":"2023-10-10T21:18:03.140786+0000","last_peered":"2023-10-10T21:18:03.140786+0000","last_clean":"2023-10-10T21:18:03.140786+0000","last_became_active":"2023-10-10T21:18:02.115966+0000","last_became_peered":"2023-10-10T21:18:02.115966+0000","last_unstale":"2023-10-10T21:18:03.140786+0000","last_undegraded":"2023-10-10T21:18:03.140786+0000","last_fullsized":"2023-10-10T21:18:03.140786+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:49:30.267805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118446+0000","last_change":"2023-10-10T21:18:03.115328+0000","last_active":"2023-10-10T21:18:03.118446+0000","last_peered":"2023-10-10T21:18:03.118446+0000","last_clean":"2023-10-10T21:18:03.118446+0000","last_became_active":"2023-10-10T21:18:03.115038+0000","last_became_peered":"2023-10-10T21:18:03.115038+0000","last_unstale":"2023-10-10T21:18:03.118446+0000","last_undegraded":"2023-10-10T21:18:03.118446+0000","last_fullsized":"2023-10-10T21:18:03.118446+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:00:05.036333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095854+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:25:25.103439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127345+0000","last_change":"2023-10-10T21:18:03.126599+0000","last_active":"2023-10-10T21:18:03.127345+0000","last_peered":"2023-10-10T21:18:03.127345+0000","last_clean":"2023-10-10T21:18:03.127345+0000","last_became_active":"2023-10-10T21:18:03.126259+0000","last_became_peered":"2023-10-10T21:18:03.126259+0000","last_unstale":"2023-10-10T21:18:03.127345+0000","last_undegraded":"2023-10-10T21:18:03.127345+0000","last_fullsized":"2023-10-10T21:18:03.127345+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:27.054207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.106797+0000","last_change":"2023-10-10T21:18:02.112963+0000","last_active":"2023-10-10T21:18:03.106797+0000","last_peered":"2023-10-10T21:18:03.106797+0000","last_clean":"2023-10-10T21:18:03.106797+0000","last_became_active":"2023-10-10T21:18:02.112670+0000","last_became_peered":"2023-10-10T21:18:02.112670+0000","last_unstale":"2023-10-10T21:18:03.106797+0000","last_undegraded":"2023-10-10T21:18:03.106797+0000","last_fullsized":"2023-10-10T21:18:03.106797+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121389+0000","last_change":"2023-10-10T21:18:03.115159+0000","last_active":"2023-10-10T21:18:03.121389+0000","last_peered":"2023-10-10T21:18:03.121389+0000","last_clean":"2023-10-10T21:18:03.121389+0000","last_became_active":"2023-10-10T21:18:03.114547+0000","last_became_peered":"2023-10-10T21:18:03.114547+0000","last_unstale":"2023-10-10T21:18:03.121389+0000","last_undegraded":"2023-10-10T21:18:03.121389+0000","last_fullsized":"2023-10-10T21:18:03.121389+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.026791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095779+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:18.389100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135108+0000","last_change":"2023-10-10T21:18:03.131702+0000","last_active":"2023-10-10T21:18:03.135108+0000","last_peered":"2023-10-10T21:18:03.135108+0000","last_clean":"2023-10-10T21:18:03.135108+0000","last_became_active":"2023-10-10T21:18:03.131482+0000","last_became_peered":"2023-10-10T21:18:03.131482+0000","last_unstale":"2023-10-10T21:18:03.135108+0000","last_undegraded":"2023-10-10T21:18:03.135108+0000","last_fullsized":"2023-10-10T21:18:03.135108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:25.952411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.093138+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:24.809153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121608+0000","last_change":"2023-10-10T21:18:03.118181+0000","last_active":"2023-10-10T21:18:03.121608+0000","last_peered":"2023-10-10T21:18:03.121608+0000","last_clean":"2023-10-10T21:18:03.121608+0000","last_became_active":"2023-10-10T21:18:03.117789+0000","last_became_peered":"2023-10-10T21:18:03.117789+0000","last_unstale":"2023-10-10T21:18:03.121608+0000","last_undegraded":"2023-10-10T21:18:03.121608+0000","last_fullsized":"2023-10-10T21:18:03.121608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:52.592283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101483+0000","last_change":"2023-10-10T21:18:02.107231+0000","last_active":"2023-10-10T21:18:03.101483+0000","last_peered":"2023-10-10T21:18:03.101483+0000","last_clean":"2023-10-10T21:18:03.101483+0000","last_became_active":"2023-10-10T21:18:02.106958+0000","last_became_peered":"2023-10-10T21:18:02.106958+0000","last_unstale":"2023-10-10T21:18:03.101483+0000","last_undegraded":"2023-10-10T21:18:03.101483+0000","last_fullsized":"2023-10-10T21:18:03.101483+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:13.649666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115546+0000","last_change":"2023-10-10T21:18:03.112233+0000","last_active":"2023-10-10T21:18:03.115546+0000","last_peered":"2023-10-10T21:18:03.115546+0000","last_clean":"2023-10-10T21:18:03.115546+0000","last_became_active":"2023-10-10T21:18:03.111983+0000","last_became_peered":"2023-10-10T21:18:03.111983+0000","last_unstale":"2023-10-10T21:18:03.115546+0000","last_undegraded":"2023-10-10T21:18:03.115546+0000","last_fullsized":"2023-10-10T21:18:03.115546+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:57.687562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095953+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:15:05.288481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.092695+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:18:04.033567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129693+0000","last_change":"2023-10-10T21:18:03.126206+0000","last_active":"2023-10-10T21:18:03.129693+0000","last_peered":"2023-10-10T21:18:03.129693+0000","last_clean":"2023-10-10T21:18:03.129693+0000","last_became_active":"2023-10-10T21:18:03.125406+0000","last_became_peered":"2023-10-10T21:18:03.125406+0000","last_unstale":"2023-10-10T21:18:03.129693+0000","last_undegraded":"2023-10-10T21:18:03.129693+0000","last_fullsized":"2023-10-10T21:18:03.129693+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:17.091601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107309+0000","last_change":"2023-10-10T21:18:02.101559+0000","last_active":"2023-10-10T21:18:03.107309+0000","last_peered":"2023-10-10T21:18:03.107309+0000","last_clean":"2023-10-10T21:18:03.107309+0000","last_became_active":"2023-10-10T21:18:02.101311+0000","last_became_peered":"2023-10-10T21:18:02.101311+0000","last_unstale":"2023-10-10T21:18:03.107309+0000","last_undegraded":"2023-10-10T21:18:03.107309+0000","last_fullsized":"2023-10-10T21:18:03.107309+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:50.840955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124725+0000","last_change":"2023-10-10T21:18:03.117311+0000","last_active":"2023-10-10T21:18:03.124725+0000","last_peered":"2023-10-10T21:18:03.124725+0000","last_clean":"2023-10-10T21:18:03.124725+0000","last_became_active":"2023-10-10T21:18:03.116702+0000","last_became_peered":"2023-10-10T21:18:03.116702+0000","last_unstale":"2023-10-10T21:18:03.124725+0000","last_undegraded":"2023-10-10T21:18:03.124725+0000","last_fullsized":"2023-10-10T21:18:03.124725+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:50:21.902920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101734+0000","last_change":"2023-10-10T21:18:02.113291+0000","last_active":"2023-10-10T21:18:03.101734+0000","last_peered":"2023-10-10T21:18:03.101734+0000","last_clean":"2023-10-10T21:18:03.101734+0000","last_became_active":"2023-10-10T21:18:02.113013+0000","last_became_peered":"2023-10-10T21:18:02.113013+0000","last_unstale":"2023-10-10T21:18:03.101734+0000","last_undegraded":"2023-10-10T21:18:03.101734+0000","last_fullsized":"2023-10-10T21:18:03.101734+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118743+0000","last_change":"2023-10-10T21:18:03.112467+0000","last_active":"2023-10-10T21:18:03.118743+0000","last_peered":"2023-10-10T21:18:03.118743+0000","last_clean":"2023-10-10T21:18:03.118743+0000","last_became_active":"2023-10-10T21:18:03.112232+0000","last_became_peered":"2023-10-10T21:18:03.112232+0000","last_unstale":"2023-10-10T21:18:03.118743+0000","last_undegraded":"2023-10-10T21:18:03.118743+0000","last_fullsized":"2023-10-10T21:18:03.118743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:48.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107085+0000","last_change":"2023-10-10T21:18:02.114127+0000","last_active":"2023-10-10T21:18:03.107085+0000","last_peered":"2023-10-10T21:18:03.107085+0000","last_clean":"2023-10-10T21:18:03.107085+0000","last_became_active":"2023-10-10T21:18:02.113859+0000","last_became_peered":"2023-10-10T21:18:02.113859+0000","last_unstale":"2023-10-10T21:18:03.107085+0000","last_undegraded":"2023-10-10T21:18:03.107085+0000","last_fullsized":"2023-10-10T21:18:03.107085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:47:16.599994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104475+0000","last_change":"2023-10-10T21:18:02.113222+0000","last_active":"2023-10-10T21:18:03.104475+0000","last_peered":"2023-10-10T21:18:03.104475+0000","last_clean":"2023-10-10T21:18:03.104475+0000","last_became_active":"2023-10-10T21:18:02.112956+0000","last_became_peered":"2023-10-10T21:18:02.112956+0000","last_unstale":"2023-10-10T21:18:03.104475+0000","last_undegraded":"2023-10-10T21:18:03.104475+0000","last_fullsized":"2023-10-10T21:18:03.104475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:18.389100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.113293+0000","last_change":"2023-10-10T21:18:03.111805+0000","last_active":"2023-10-10T21:18:03.113293+0000","last_peered":"2023-10-10T21:18:03.113293+0000","last_clean":"2023-10-10T21:18:03.113293+0000","last_became_active":"2023-10-10T21:18:03.111563+0000","last_became_peered":"2023-10-10T21:18:03.111563+0000","last_unstale":"2023-10-10T21:18:03.113293+0000","last_undegraded":"2023-10-10T21:18:03.113293+0000","last_fullsized":"2023-10-10T21:18:03.113293+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:12:30.776673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104292+0000","last_change":"2023-10-10T21:18:02.105944+0000","last_active":"2023-10-10T21:18:03.104292+0000","last_peered":"2023-10-10T21:18:03.104292+0000","last_clean":"2023-10-10T21:18:03.104292+0000","last_became_active":"2023-10-10T21:18:02.105661+0000","last_became_peered":"2023-10-10T21:18:02.105661+0000","last_unstale":"2023-10-10T21:18:03.104292+0000","last_undegraded":"2023-10-10T21:18:03.104292+0000","last_fullsized":"2023-10-10T21:18:03.104292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:43:37.712234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:02.083687+0000","last_change":"2023-10-10T21:18:02.083687+0000","last_active":"2023-10-10T21:18:02.083687+0000","last_peered":"2023-10-10T21:18:02.083687+0000","last_clean":"2023-10-10T21:18:02.083687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:02.083687+0000","last_undegraded":"2023-10-10T21:18:02.083687+0000","last_fullsized":"2023-10-10T21:18:02.083687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095886+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:24:13.410567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126713+0000","last_change":"2023-10-10T21:18:03.125634+0000","last_active":"2023-10-10T21:18:03.126713+0000","last_peered":"2023-10-10T21:18:03.126713+0000","last_clean":"2023-10-10T21:18:03.126713+0000","last_became_active":"2023-10-10T21:18:03.125352+0000","last_became_peered":"2023-10-10T21:18:03.125352+0000","last_unstale":"2023-10-10T21:18:03.126713+0000","last_undegraded":"2023-10-10T21:18:03.126713+0000","last_fullsized":"2023-10-10T21:18:03.126713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:56.907952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:01.079047+0000","last_change":"2023-10-10T21:18:01.095820+0000","last_active":"2023-10-10T21:18:01.079047+0000","last_peered":"2023-10-10T21:18:01.079047+0000","last_clean":"2023-10-10T21:18:01.079047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:01.079047+0000","last_undegraded":"2023-10-10T21:18:01.079047+0000","last_fullsized":"2023-10-10T21:18:01.079047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:03.288893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"84'183","reported_seq":462,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107903+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:03.107903+0000","last_peered":"2023-10-10T21:18:03.107903+0000","last_clean":"2023-10-10T21:18:03.107903+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:03.107903+0000","last_undegraded":"2023-10-10T21:18:03.107903+0000","last_fullsized":"2023-10-10T21:18:03.107903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2214,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":1147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.995,"5min":1.014,"15min":1.1859999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.52200000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.435},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0069999999999999,"15min":1.123},"last":0.84599999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.71399999999999997},"min":{"1min":0.41399999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.504,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":1.2669999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.62,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.67400000000000004},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.58599999999999997,"5min":0.51300000000000001,"15min":0.42499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.135},"last":0.88100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542333,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":536344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":1.0569999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.97299999999999998,"5min":1.0129999999999999,"15min":1.143},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.378},"max":{"1min":0.92800000000000005,"5min":1.073,"15min":1.073},"last":0.81699999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.151},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93600000000000005,"5min":0.97799999999999998,"15min":1.01},"last":0.56100000000000005}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.503,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.018,"5min":1.042,"15min":1.1200000000000001},"last":0.64400000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":1.2729999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.443,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":0.85199999999999998,"5min":0.89200000000000002,"15min":1.0880000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66300000000000003,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":1.022,"15min":1.345},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":1.048,"15min":1.238},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.024,"15min":1.4930000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.202},"last":0.80200000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542336,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306620,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065220,"statfs":{"total":96636764160,"available":96322785280,"internally_reserved":0,"allocated":1167360,"data_stored":558370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64400000000000002,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.309},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.61599999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47199999999999998,"15min":0.48699999999999999},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66800000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.755},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.157,"15min":1.3220000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.77800000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.26,"15min":1.2849999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.008,"5min":2.21,"15min":2.21},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.165,"15min":1.268},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.53300000000000003},"max":{"1min":1.0409999999999999,"5min":1.0509999999999999,"15min":1.3400000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.61799999999999999,"5min":0.52800000000000002,"15min":0.505},"max":{"1min":1.026,"5min":1.026,"15min":1.3759999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.85299999999999998,"5min":1.716,"15min":1.716},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.92200000000000004,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298996,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072844,"statfs":{"total":96636764160,"available":96330592256,"internally_reserved":0,"allocated":1748992,"data_stored":1147202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.4890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.65600000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.501}]},{"osd":2,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":1.706},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.70899999999999996,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.72499999999999998,"5min":0.874,"15min":1.2909999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.101,"15min":1.2270000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.2909999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.03,"5min":1.075,"15min":1.2729999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.58199999999999996,"5min":0.57299999999999995,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0980000000000001,"15min":1.3899999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.65100000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.95699999999999996,"5min":1.0960000000000001,"15min":1.2589999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.83999999999999997},"min":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0249999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.92700000000000005}]},{"osd":7,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.64300000000000002,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":0.97299999999999998,"5min":1.139,"15min":1.363},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54200000000000004},"max":{"1min":0.96999999999999997,"5min":1.024,"15min":1.3300000000000001},"last":1.006}]}]},{"osd":1,"up_from":14,"seq":60129542334,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302532,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069308,"statfs":{"total":96636764160,"available":96326971392,"internally_reserved":0,"allocated":1175552,"data_stored":558958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.54200000000000004,"15min":0.48899999999999999},"min":{"1min":0.307,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":8.0839999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.378},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.63500000000000001,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":13.223000000000001,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.5}]},{"osd":2,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":2.085},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.60899999999999999,"15min":0.58199999999999996},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35399999999999998},"max":{"1min":0.88,"5min":0.999,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.81100000000000005,"15min":0.79700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.82799999999999996,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.413,"5min":0.92200000000000004,"15min":0.83599999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":13.130000000000001,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.81899999999999995,"15min":0.80700000000000005},"min":{"1min":0.57999999999999996,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84899999999999998,"15min":0.84299999999999997},"min":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.89300000000000002,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":12.026,"5min":12.026,"15min":12.026},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.751}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306616,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065224,"statfs":{"total":96636764160,"available":96322789376,"internally_reserved":0,"allocated":1163264,"data_stored":556946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28799999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.544},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.501},"min":{"1min":0.315,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.6759999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.68400000000000005,"5min":0.73399999999999999,"15min":1.4610000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.7070000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.4990000000000001},"last":0.501}]},{"osd":4,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.6359999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.246},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.262},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76700000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.2250000000000001,"15min":1.579},"last":0.70999999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.081,"5min":1.27,"15min":1.27},"last":0.75},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.224,"15min":1.224},"last":0.63}]},{"osd":7,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.111,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.228,"5min":1.228,"15min":1.3200000000000001},"last":0.67500000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542336,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310708,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061132,"statfs":{"total":96636764160,"available":96318599168,"internally_reserved":0,"allocated":1159168,"data_stored":556904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.88,"5min":0.92100000000000004,"15min":1.1479999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":0.96299999999999997,"15min":1.758},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.47},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68999999999999995,"15min":0.70299999999999996},"min":{"1min":0.53200000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.98299999999999998,"15min":1.929},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83899999999999997,"5min":1.002,"15min":1.6890000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.98399999999999999,"15min":1.468},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90400000000000003,"5min":1.046,"15min":1.397},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.42799999999999999},"max":{"1min":0.81899999999999995,"5min":0.97699999999999998,"15min":1.385},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":1.105},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":1.5209999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.435},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":1.464},"last":0.67200000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":1.006,"5min":1.006,"15min":1.5700000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51000000000000001,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.86599999999999999,"5min":0.91900000000000004,"15min":1.4139999999999999},"last":0.81499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542333,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":536344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.878,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":1.371},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88100000000000001,"5min":0.93300000000000005,"15min":3.895},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71699999999999997,"15min":0.748},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.97899999999999998,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.75}]},{"osd":2,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.2889999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.56100000000000005,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.3540000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.68200000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.65200000000000002},"min":{"1min":0.44900000000000001,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.496,"15min":4.2789999999999999},"last":0.621}]},{"osd":6,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.50800000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.026},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.748,"15min":0.77100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":2.8900000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.077,"15min":3.9420000000000002},"last":0.73699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:08.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-10T21:18:08.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-10T21:18:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-10T21:18:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-10T21:18:08.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-10T21:18:08.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-10T21:18:08.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-10T21:18:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-10T21:18:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-10T21:18:08.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-10T21:18:08.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-10-10T21:18:08.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.095815+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:11:23.810550+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-10T21:18:08.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-10-10T21:18:08.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.097122+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T09:12:29.772033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-10T21:18:08.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-10-10T21:18:08.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.095781+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:29:40.211849+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-10T21:18:08.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-10T21:18:08.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-10-10T21:18:08.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.096574+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:24:31.607986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-10T21:18:08.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.093710+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:42:06.243413+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:18:08.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-10-10T21:18:08.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.096578+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:12:58.528943+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-10-10T21:18:08.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.095854+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:25:25.103439+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-10-10T21:18:08.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.095779+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:35:18.389100+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-10T21:18:08.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.093138+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:03:24.809153+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:18:08.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-10-10T21:18:08.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.095953+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:15:05.288481+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-10T21:18:08.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-10T21:18:08.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.092695+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T21:18:04.033567+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:18:08.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-10T21:18:08.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-10T21:18:08.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:02.083687+0000', 'last_change': '2023-10-10T21:18:02.083687+0000', 'last_active': '2023-10-10T21:18:02.083687+0000', 'last_peered': '2023-10-10T21:18:02.083687+0000', 'last_clean': '2023-10-10T21:18:02.083687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:02.083687+0000', 'last_undegraded': '2023-10-10T21:18:02.083687+0000', 'last_fullsized': '2023-10-10T21:18:02.083687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:02.083687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:08.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-10-10T21:18:08.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.095886+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:24:13.410567+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-10-10T21:18:08.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:01.079047+0000', 'last_change': '2023-10-10T21:18:01.095820+0000', 'last_active': '2023-10-10T21:18:01.079047+0000', 'last_peered': '2023-10-10T21:18:01.079047+0000', 'last_clean': '2023-10-10T21:18:01.079047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:01.079047+0000', 'last_undegraded': '2023-10-10T21:18:01.079047+0000', 'last_fullsized': '2023-10-10T21:18:01.079047+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:01.079047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:42:03.288893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:08.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T21:18:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.568+0000 7f4a8f1ff700 1 Processor -- start 2023-10-10T21:18:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.568+0000 7f4a8f1ff700 1 -- start start 2023-10-10T21:18:08.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8f1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a880b2b80 0x7f4a880b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8f1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a880ad5f0 con 0x7f4a880ada80 2023-10-10T21:18:08.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8f1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a880cf310 con 0x7f4a880ced50 2023-10-10T21:18:08.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8f1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8815a060 con 0x7f4a880b2b80 2023-10-10T21:18:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8cf9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a880b2b80 0x7f4a880b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8d79c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4a880ada80 0x7f4a880ade80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33126/0 (socket says 172.21.15.154:33126) 2023-10-10T21:18:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8d79c700 1 -- 172.21.15.154:0/823619650 learned_addr learned my addr 172.21.15.154:0/823619650 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8cf9b700 1 -- 172.21.15.154:0/823619650 >> v1:172.21.15.179:6789/0 conn(0x7f4a880ced50 legacy=0x7f4a880b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8cf9b700 1 -- 172.21.15.154:0/823619650 >> v1:172.21.15.154:6789/0 conn(0x7f4a880ada80 legacy=0x7f4a880ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a8cf9b700 1 -- 172.21.15.154:0/823619650 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a880cf5f0 con 0x7f4a880b2b80 2023-10-10T21:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.570+0000 7f4a7f7fe700 1 -- 172.21.15.154:0/823619650 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217795121 0 0) 0x7f4a880ad5f0 con 0x7f4a880ada80 2023-10-10T21:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.571+0000 7f4a8cf9b700 1 --2- 172.21.15.154:0/823619650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880b2b80 0x7f4a880b4e90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4a840098d0 tx=0x7f4a84009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef863346690badb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.571+0000 7f4a7f7fe700 1 -- 172.21.15.154:0/823619650 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84009e70 con 0x7f4a880b2b80 2023-10-10T21:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.571+0000 7f4a7f7fe700 1 -- 172.21.15.154:0/823619650 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a84005c10 con 0x7f4a880b2b80 2023-10-10T21:18:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.571+0000 7f4a7f7fe700 1 -- 172.21.15.154:0/823619650 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8400b650 con 0x7f4a880b2b80 2023-10-10T21:18:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.571+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/823619650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880b2b80 msgr2=0x7f4a880b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.571+0000 7f4a8f1ff700 1 --2- 172.21.15.154:0/823619650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880b2b80 0x7f4a880b4e90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4a840098d0 tx=0x7f4a84009120 comp rx=0 tx=0).stop 2023-10-10T21:18:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.572+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/823619650 shutdown_connections 2023-10-10T21:18:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.572+0000 7f4a8f1ff700 1 --2- 172.21.15.154:0/823619650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880b2b80 0x7f4a880b4e90 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.572+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/823619650 >> 172.21.15.154:0/823619650 conn(0x7f4a880999f0 msgr2=0x7f4a880b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.572+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/823619650 shutdown_connections 2023-10-10T21:18:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.572+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/823619650 wait complete. 2023-10-10T21:18:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.573+0000 7f4a8f1ff700 1 Processor -- start 2023-10-10T21:18:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.573+0000 7f4a8f1ff700 1 -- start start 2023-10-10T21:18:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.574+0000 7f4a8f1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880ada80 0x7f4a88155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.574+0000 7f4a8f1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a880b2b80 0x7f4a8815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.574+0000 7f4a8f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a880ced50 0x7f4a88069010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.574+0000 7f4a8f1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880c7820 con 0x7f4a880ada80 2023-10-10T21:18:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.574+0000 7f4a8f1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8815c910 con 0x7f4a880b2b80 2023-10-10T21:18:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.574+0000 7f4a8f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880c7a70 con 0x7f4a880ced50 2023-10-10T21:18:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.574+0000 7f4a8cf9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880ada80 0x7f4a88155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.574+0000 7f4a8cf9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880ada80 0x7f4a88155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37336/0 (socket says 172.21.15.154:37336) 2023-10-10T21:18:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.574+0000 7f4a8cf9b700 1 -- 172.21.15.154:0/3713813938 learned_addr learned my addr 172.21.15.154:0/3713813938 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a7ffff700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a880b2b80 0x7f4a8815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a8d79c700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a880ced50 0x7f4a88069010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a8cf9b700 1 -- 172.21.15.154:0/3713813938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a880ced50 msgr2=0x7f4a88069010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a8cf9b700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a880ced50 0x7f4a88069010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a8cf9b700 1 -- 172.21.15.154:0/3713813938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a880b2b80 msgr2=0x7f4a8815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a8cf9b700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a880b2b80 0x7f4a8815c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a8cf9b700 1 -- 172.21.15.154:0/3713813938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840093c0 con 0x7f4a880ada80 2023-10-10T21:18:08.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a8d79c700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a880ced50 0x7f4a88069010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:08.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a8cf9b700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880ada80 0x7f4a88155f20 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009160 tx=0x7f4a84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:08.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a7cff9700 1 -- 172.21.15.154:0/3713813938 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84006460 con 0x7f4a880ada80 2023-10-10T21:18:08.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a7cff9700 1 -- 172.21.15.154:0/3713813938 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a840065c0 con 0x7f4a880ada80 2023-10-10T21:18:08.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a880c7d50 con 0x7f4a880ada80 2023-10-10T21:18:08.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.575+0000 7f4a7cff9700 1 -- 172.21.15.154:0/3713813938 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8401b480 con 0x7f4a880ada80 2023-10-10T21:18:08.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.576+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a880c8310 con 0x7f4a880ada80 2023-10-10T21:18:08.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.577+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a88063c90 con 0x7f4a880ada80 2023-10-10T21:18:08.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.577+0000 7f4a7cff9700 1 -- 172.21.15.154:0/3713813938 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a8401b830 con 0x7f4a880ada80 2023-10-10T21:18:08.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.578+0000 7f4a7cff9700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a74066f30 0x7f4a740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:08.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.578+0000 7f4a7cff9700 1 -- 172.21.15.154:0/3713813938 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4a84086980 con 0x7f4a880ada80 2023-10-10T21:18:08.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.579+0000 7f4a7ffff700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a74066f30 0x7f4a740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:08.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.579+0000 7f4a7ffff700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a74066f30 0x7f4a740693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4a8815b6e0 tx=0x7f4a78009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:08.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.582+0000 7f4a7cff9700 1 -- 172.21.15.154:0/3713813938 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a840539c0 con 0x7f4a880ada80 2023-10-10T21:18:08.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.852+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4a8804c3c0 con 0x7f4a880ada80 2023-10-10T21:18:08.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.853+0000 7f4a7cff9700 1 -- 172.21.15.154:0/3713813938 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1176 (secure 0 0 0) 0x7f4a84009220 con 0x7f4a880ada80 2023-10-10T21:18:08.855 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:08.855 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":973,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":67},{"state_name":"unknown","count":17},{"state_name":"creating+peering","count":13}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592582,"bytes_used":2491928576,"bytes_avail":770602184704,"bytes_total":773094113280,"unknown_pgs_ratio":0.17525772750377655,"inactive_pgs_ratio":0.1340206116437912,"write_bytes_sec":1974,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":38,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6472}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-10T21:16:29.405712+0000","services":{}},"progress_events":{}} 2023-10-10T21:18:08.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a74066f30 msgr2=0x7f4a740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a74066f30 0x7f4a740693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4a8815b6e0 tx=0x7f4a78009040 comp rx=0 tx=0).stop 2023-10-10T21:18:08.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880ada80 msgr2=0x7f4a88155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:08.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880ada80 0x7f4a88155f20 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009160 tx=0x7f4a84016000 comp rx=0 tx=0).stop 2023-10-10T21:18:08.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 shutdown_connections 2023-10-10T21:18:08.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a880ced50 0x7f4a88069010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a880ada80 0x7f4a88155f20 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a74066f30 0x7f4a740693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 --2- 172.21.15.154:0/3713813938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a880b2b80 0x7f4a8815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:08.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.855+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 >> 172.21.15.154:0/3713813938 conn(0x7f4a880999f0 msgr2=0x7f4a880cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:08.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.856+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 shutdown_connections 2023-10-10T21:18:08.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:08.856+0000 7f4a8f1ff700 1 -- 172.21.15.154:0/3713813938 wait complete. 2023-10-10T21:18:08.875 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T21:18:08.876 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:09.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.056+0000 7f86303ff700 1 Processor -- start 2023-10-10T21:18:09.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.056+0000 7f86303ff700 1 -- start start 2023-10-10T21:18:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f86303ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8628155c10 0x7f8628155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f86303ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86280ac6d0 0x7f86280b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f86303ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86280acac0 con 0x7f86280ac230 2023-10-10T21:18:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f86303ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280ad930 con 0x7f8628155c10 2023-10-10T21:18:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f86303ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280acd20 con 0x7f86280ac6d0 2023-10-10T21:18:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862e19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8628155c10 0x7f8628155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862e19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8628155c10 0x7f8628155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37352/0 (socket says 172.21.15.154:37352) 2023-10-10T21:18:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862d99a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f86280ac230 0x7f86281568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33138/0 (socket says 172.21.15.154:33138) 2023-10-10T21:18:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862e19b700 1 -- 172.21.15.154:0/3838524572 learned_addr learned my addr 172.21.15.154:0/3838524572 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:09.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862e99c700 1 --2- 172.21.15.154:0/3838524572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86280ac6d0 0x7f86280b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:09.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862e19b700 1 -- 172.21.15.154:0/3838524572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86280ac6d0 msgr2=0x7f86280b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:09.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862e19b700 1 --2- 172.21.15.154:0/3838524572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86280ac6d0 0x7f86280b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:09.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862e19b700 1 -- 172.21.15.154:0/3838524572 >> v1:172.21.15.154:6789/0 conn(0x7f86280ac230 legacy=0x7f86281568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:09.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862e19b700 1 -- 172.21.15.154:0/3838524572 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280ad000 con 0x7f8628155c10 2023-10-10T21:18:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.058+0000 7f862d199700 1 -- 172.21.15.154:0/3838524572 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666164578 0 0) 0x7f86280acac0 con 0x7f86280ac230 2023-10-10T21:18:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.059+0000 7f862e19b700 1 --2- 172.21.15.154:0/3838524572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8628155c10 0x7f8628155fe0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f86280acc50 tx=0x7f8624009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd46490dadb71dfb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.059+0000 7f862d199700 1 -- 172.21.15.154:0/3838524572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624009e70 con 0x7f8628155c10 2023-10-10T21:18:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.059+0000 7f862d199700 1 -- 172.21.15.154:0/3838524572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862400b860 con 0x7f8628155c10 2023-10-10T21:18:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.059+0000 7f862d199700 1 -- 172.21.15.154:0/3838524572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400bc20 con 0x7f8628155c10 2023-10-10T21:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.059+0000 7f86303ff700 1 -- 172.21.15.154:0/3838524572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8628155c10 msgr2=0x7f8628155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.059+0000 7f86303ff700 1 --2- 172.21.15.154:0/3838524572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8628155c10 0x7f8628155fe0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f86280acc50 tx=0x7f8624009250 comp rx=0 tx=0).stop 2023-10-10T21:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.060+0000 7f86303ff700 1 -- 172.21.15.154:0/3838524572 shutdown_connections 2023-10-10T21:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.060+0000 7f86303ff700 1 --2- 172.21.15.154:0/3838524572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86280ac6d0 0x7f86280b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.060+0000 7f86303ff700 1 --2- 172.21.15.154:0/3838524572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8628155c10 0x7f8628155fe0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.060+0000 7f86303ff700 1 -- 172.21.15.154:0/3838524572 >> 172.21.15.154:0/3838524572 conn(0x7f862806a320 msgr2=0x7f86280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.060+0000 7f86303ff700 1 -- 172.21.15.154:0/3838524572 shutdown_connections 2023-10-10T21:18:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.060+0000 7f86303ff700 1 -- 172.21.15.154:0/3838524572 wait complete. 2023-10-10T21:18:09.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.061+0000 7f86303ff700 1 Processor -- start 2023-10-10T21:18:09.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.061+0000 7f86303ff700 1 -- start start 2023-10-10T21:18:09.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.062+0000 7f86303ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86280ac230 0x7f862814f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:09.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.062+0000 7f86303ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86280ac6d0 0x7f862815f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.062+0000 7f86303ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8628155c10 0x7f862815fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.062+0000 7f86303ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8628158110 con 0x7f86280ac230 2023-10-10T21:18:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.062+0000 7f86303ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8628157260 con 0x7f86280ac6d0 2023-10-10T21:18:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.062+0000 7f86303ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8628157500 con 0x7f8628155c10 2023-10-10T21:18:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.062+0000 7f862e19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86280ac230 0x7f862814f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.062+0000 7f862e19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86280ac230 0x7f862814f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37356/0 (socket says 172.21.15.154:37356) 2023-10-10T21:18:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.062+0000 7f862e19b700 1 -- 172.21.15.154:0/1434419170 learned_addr learned my addr 172.21.15.154:0/1434419170 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862d99a700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86280ac6d0 0x7f862815f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862e19b700 1 -- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8628155c10 msgr2=0x7f862815fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862e99c700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8628155c10 0x7f862815fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862e19b700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8628155c10 0x7f862815fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862e19b700 1 -- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86280ac6d0 msgr2=0x7f862815f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862e19b700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86280ac6d0 0x7f862815f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862e19b700 1 -- 172.21.15.154:0/1434419170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240094f0 con 0x7f86280ac230 2023-10-10T21:18:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862d99a700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86280ac6d0 0x7f862815f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862e99c700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8628155c10 0x7f862815fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f862e19b700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86280ac230 0x7f862814f1e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8624009290 tx=0x7f8624018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f861e7fc700 1 -- 172.21.15.154:0/1434419170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400bbe0 con 0x7f86280ac230 2023-10-10T21:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f861e7fc700 1 -- 172.21.15.154:0/1434419170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8624018420 con 0x7f86280ac230 2023-10-10T21:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f861e7fc700 1 -- 172.21.15.154:0/1434419170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240187c0 con 0x7f86280ac230 2023-10-10T21:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.063+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86281577e0 con 0x7f86280ac230 2023-10-10T21:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.064+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8628157da0 con 0x7f86280ac230 2023-10-10T21:18:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.064+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862804c3c0 con 0x7f86280ac230 2023-10-10T21:18:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.065+0000 7f861e7fc700 1 -- 172.21.15.154:0/1434419170 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8624018b70 con 0x7f86280ac230 2023-10-10T21:18:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.066+0000 7f861e7fc700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f860c066f30 0x7f860c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.067+0000 7f861e7fc700 1 -- 172.21.15.154:0/1434419170 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8624014070 con 0x7f86280ac230 2023-10-10T21:18:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.067+0000 7f862d99a700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f860c066f30 0x7f860c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:09.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.067+0000 7f862d99a700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f860c066f30 0x7f860c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f862814fbd0 tx=0x7f8618009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:09.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.071+0000 7f861e7fc700 1 -- 172.21.15.154:0/1434419170 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8624052dc0 con 0x7f86280ac230 2023-10-10T21:18:09.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.259+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8628158250 con 0x7f860c066f30 2023-10-10T21:18:09.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.267+0000 7f861e7fc700 1 -- 172.21.15.154:0/1434419170 <== mgr.6531 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289161 (secure 0 0 0) 0x7f86180014f0 con 0x7f860c066f30 2023-10-10T21:18:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:09.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f860c066f30 msgr2=0x7f860c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:09.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f860c066f30 0x7f860c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f862814fbd0 tx=0x7f8618009040 comp rx=0 tx=0).stop 2023-10-10T21:18:09.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86280ac230 msgr2=0x7f862814f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:09.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86280ac230 0x7f862814f1e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8624009290 tx=0x7f8624018000 comp rx=0 tx=0).stop 2023-10-10T21:18:09.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 shutdown_connections 2023-10-10T21:18:09.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8628155c10 0x7f862815fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:09.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86280ac230 0x7f862814f1e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:09.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f860c066f30 0x7f860c0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:09.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 --2- 172.21.15.154:0/1434419170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86280ac6d0 0x7f862815f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:09.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 >> 172.21.15.154:0/1434419170 conn(0x7f862806a320 msgr2=0x7f862806e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:09.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 shutdown_connections 2023-10-10T21:18:09.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:09.271+0000 7f86303ff700 1 -- 172.21.15.154:0/1434419170 wait complete. 2023-10-10T21:18:09.278 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:09.291 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-10T21:18:08.791182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433608,"kb_used_data":10248,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541112,"statfs":{"total":773094113280,"available":770602098688,"internally_reserved":0,"allocated":10493952,"data_stored":5640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.704068"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128453+0000","last_change":"2023-10-10T21:18:03.123147+0000","last_active":"2023-10-10T21:18:03.128453+0000","last_peered":"2023-10-10T21:18:03.128453+0000","last_clean":"2023-10-10T21:18:03.128453+0000","last_became_active":"2023-10-10T21:18:03.122883+0000","last_became_peered":"2023-10-10T21:18:03.122883+0000","last_unstale":"2023-10-10T21:18:03.128453+0000","last_undegraded":"2023-10-10T21:18:03.128453+0000","last_fullsized":"2023-10-10T21:18:03.128453+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:28:36.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129100+0000","last_change":"2023-10-10T21:18:03.124081+0000","last_active":"2023-10-10T21:18:03.129100+0000","last_peered":"2023-10-10T21:18:03.129100+0000","last_clean":"2023-10-10T21:18:03.129100+0000","last_became_active":"2023-10-10T21:18:03.123814+0000","last_became_peered":"2023-10-10T21:18:03.123814+0000","last_unstale":"2023-10-10T21:18:03.129100+0000","last_undegraded":"2023-10-10T21:18:03.129100+0000","last_fullsized":"2023-10-10T21:18:03.129100+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:01.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121489+0000","last_change":"2023-10-10T21:18:03.116758+0000","last_active":"2023-10-10T21:18:03.121489+0000","last_peered":"2023-10-10T21:18:03.121489+0000","last_clean":"2023-10-10T21:18:03.121489+0000","last_became_active":"2023-10-10T21:18:03.116472+0000","last_became_peered":"2023-10-10T21:18:03.116472+0000","last_unstale":"2023-10-10T21:18:03.121489+0000","last_undegraded":"2023-10-10T21:18:03.121489+0000","last_fullsized":"2023-10-10T21:18:03.121489+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:26.091130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132434+0000","last_change":"2023-10-10T21:18:03.128869+0000","last_active":"2023-10-10T21:18:03.132434+0000","last_peered":"2023-10-10T21:18:03.132434+0000","last_clean":"2023-10-10T21:18:03.132434+0000","last_became_active":"2023-10-10T21:18:03.128610+0000","last_became_peered":"2023-10-10T21:18:03.128610+0000","last_unstale":"2023-10-10T21:18:03.132434+0000","last_undegraded":"2023-10-10T21:18:03.132434+0000","last_fullsized":"2023-10-10T21:18:03.132434+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:47.801041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.119402+0000","last_change":"2023-10-10T21:18:03.113980+0000","last_active":"2023-10-10T21:18:03.119402+0000","last_peered":"2023-10-10T21:18:03.119402+0000","last_clean":"2023-10-10T21:18:03.119402+0000","last_became_active":"2023-10-10T21:18:03.113689+0000","last_became_peered":"2023-10-10T21:18:03.113689+0000","last_unstale":"2023-10-10T21:18:03.119402+0000","last_undegraded":"2023-10-10T21:18:03.119402+0000","last_fullsized":"2023-10-10T21:18:03.119402+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:22:18.290768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135327+0000","last_change":"2023-10-10T21:18:03.130281+0000","last_active":"2023-10-10T21:18:03.135327+0000","last_peered":"2023-10-10T21:18:03.135327+0000","last_clean":"2023-10-10T21:18:03.135327+0000","last_became_active":"2023-10-10T21:18:03.129862+0000","last_became_peered":"2023-10-10T21:18:03.129862+0000","last_unstale":"2023-10-10T21:18:03.135327+0000","last_undegraded":"2023-10-10T21:18:03.135327+0000","last_fullsized":"2023-10-10T21:18:03.135327+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:07.248053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.123136+0000","last_change":"2023-10-10T21:18:03.115432+0000","last_active":"2023-10-10T21:18:03.123136+0000","last_peered":"2023-10-10T21:18:03.123136+0000","last_clean":"2023-10-10T21:18:03.123136+0000","last_became_active":"2023-10-10T21:18:03.114584+0000","last_became_peered":"2023-10-10T21:18:03.114584+0000","last_unstale":"2023-10-10T21:18:03.123136+0000","last_undegraded":"2023-10-10T21:18:03.123136+0000","last_fullsized":"2023-10-10T21:18:03.123136+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:58.943411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130560+0000","last_change":"2023-10-10T21:18:03.123719+0000","last_active":"2023-10-10T21:18:03.130560+0000","last_peered":"2023-10-10T21:18:03.130560+0000","last_clean":"2023-10-10T21:18:03.130560+0000","last_became_active":"2023-10-10T21:18:03.123411+0000","last_became_peered":"2023-10-10T21:18:03.123411+0000","last_unstale":"2023-10-10T21:18:03.130560+0000","last_undegraded":"2023-10-10T21:18:03.130560+0000","last_fullsized":"2023-10-10T21:18:03.130560+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:49:31.272445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121849+0000","last_change":"2023-10-10T21:18:03.115993+0000","last_active":"2023-10-10T21:18:03.121849+0000","last_peered":"2023-10-10T21:18:03.121849+0000","last_clean":"2023-10-10T21:18:03.121849+0000","last_became_active":"2023-10-10T21:18:03.114933+0000","last_became_peered":"2023-10-10T21:18:03.114933+0000","last_unstale":"2023-10-10T21:18:03.121849+0000","last_undegraded":"2023-10-10T21:18:03.121849+0000","last_fullsized":"2023-10-10T21:18:03.121849+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:09.169541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120078+0000","last_change":"2023-10-10T21:18:03.116446+0000","last_active":"2023-10-10T21:18:03.120078+0000","last_peered":"2023-10-10T21:18:03.120078+0000","last_clean":"2023-10-10T21:18:03.120078+0000","last_became_active":"2023-10-10T21:18:03.116170+0000","last_became_peered":"2023-10-10T21:18:03.116170+0000","last_unstale":"2023-10-10T21:18:03.120078+0000","last_undegraded":"2023-10-10T21:18:03.120078+0000","last_fullsized":"2023-10-10T21:18:03.120078+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:11:20.228457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126153+0000","last_change":"2023-10-10T21:18:03.122782+0000","last_active":"2023-10-10T21:18:03.126153+0000","last_peered":"2023-10-10T21:18:03.126153+0000","last_clean":"2023-10-10T21:18:03.126153+0000","last_became_active":"2023-10-10T21:18:03.122522+0000","last_became_peered":"2023-10-10T21:18:03.122522+0000","last_unstale":"2023-10-10T21:18:03.126153+0000","last_undegraded":"2023-10-10T21:18:03.126153+0000","last_fullsized":"2023-10-10T21:18:03.126153+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:16.215761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118425+0000","last_change":"2023-10-10T21:18:03.114857+0000","last_active":"2023-10-10T21:18:03.118425+0000","last_peered":"2023-10-10T21:18:03.118425+0000","last_clean":"2023-10-10T21:18:03.118425+0000","last_became_active":"2023-10-10T21:18:03.114601+0000","last_became_peered":"2023-10-10T21:18:03.114601+0000","last_unstale":"2023-10-10T21:18:03.118425+0000","last_undegraded":"2023-10-10T21:18:03.118425+0000","last_fullsized":"2023-10-10T21:18:03.118425+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:43.812657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124840+0000","last_change":"2023-10-10T21:18:03.124241+0000","last_active":"2023-10-10T21:18:03.124840+0000","last_peered":"2023-10-10T21:18:03.124840+0000","last_clean":"2023-10-10T21:18:03.124840+0000","last_became_active":"2023-10-10T21:18:03.123943+0000","last_became_peered":"2023-10-10T21:18:03.123943+0000","last_unstale":"2023-10-10T21:18:03.124840+0000","last_undegraded":"2023-10-10T21:18:03.124840+0000","last_fullsized":"2023-10-10T21:18:03.124840+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115678+0000","last_change":"2023-10-10T21:18:03.111549+0000","last_active":"2023-10-10T21:18:03.115678+0000","last_peered":"2023-10-10T21:18:03.115678+0000","last_clean":"2023-10-10T21:18:03.115678+0000","last_became_active":"2023-10-10T21:18:03.111171+0000","last_became_peered":"2023-10-10T21:18:03.111171+0000","last_unstale":"2023-10-10T21:18:03.115678+0000","last_undegraded":"2023-10-10T21:18:03.115678+0000","last_fullsized":"2023-10-10T21:18:03.115678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:48:55.981597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118815+0000","last_change":"2023-10-10T21:18:03.113743+0000","last_active":"2023-10-10T21:18:03.118815+0000","last_peered":"2023-10-10T21:18:03.118815+0000","last_clean":"2023-10-10T21:18:03.118815+0000","last_became_active":"2023-10-10T21:18:03.113483+0000","last_became_peered":"2023-10-10T21:18:03.113483+0000","last_unstale":"2023-10-10T21:18:03.118815+0000","last_undegraded":"2023-10-10T21:18:03.118815+0000","last_fullsized":"2023-10-10T21:18:03.118815+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:48.507042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135387+0000","last_change":"2023-10-10T21:18:03.133411+0000","last_active":"2023-10-10T21:18:03.135387+0000","last_peered":"2023-10-10T21:18:03.135387+0000","last_clean":"2023-10-10T21:18:03.135387+0000","last_became_active":"2023-10-10T21:18:03.133113+0000","last_became_peered":"2023-10-10T21:18:03.133113+0000","last_unstale":"2023-10-10T21:18:03.135387+0000","last_undegraded":"2023-10-10T21:18:03.135387+0000","last_fullsized":"2023-10-10T21:18:03.135387+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:07:30.524167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121779+0000","last_change":"2023-10-10T21:18:03.115176+0000","last_active":"2023-10-10T21:18:03.121779+0000","last_peered":"2023-10-10T21:18:03.121779+0000","last_clean":"2023-10-10T21:18:03.121779+0000","last_became_active":"2023-10-10T21:18:03.114425+0000","last_became_peered":"2023-10-10T21:18:03.114425+0000","last_unstale":"2023-10-10T21:18:03.121779+0000","last_undegraded":"2023-10-10T21:18:03.121779+0000","last_fullsized":"2023-10-10T21:18:03.121779+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:30.856134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132619+0000","last_change":"2023-10-10T21:18:03.128819+0000","last_active":"2023-10-10T21:18:03.132619+0000","last_peered":"2023-10-10T21:18:03.132619+0000","last_clean":"2023-10-10T21:18:03.132619+0000","last_became_active":"2023-10-10T21:18:03.128567+0000","last_became_peered":"2023-10-10T21:18:03.128567+0000","last_unstale":"2023-10-10T21:18:03.132619+0000","last_undegraded":"2023-10-10T21:18:03.132619+0000","last_fullsized":"2023-10-10T21:18:03.132619+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:01:23.478813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130419+0000","last_change":"2023-10-10T21:18:03.122999+0000","last_active":"2023-10-10T21:18:03.130419+0000","last_peered":"2023-10-10T21:18:03.130419+0000","last_clean":"2023-10-10T21:18:03.130419+0000","last_became_active":"2023-10-10T21:18:03.121360+0000","last_became_peered":"2023-10-10T21:18:03.121360+0000","last_unstale":"2023-10-10T21:18:03.130419+0000","last_undegraded":"2023-10-10T21:18:03.130419+0000","last_fullsized":"2023-10-10T21:18:03.130419+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:44:28.722321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.114086+0000","last_change":"2023-10-10T21:18:03.109240+0000","last_active":"2023-10-10T21:18:03.114086+0000","last_peered":"2023-10-10T21:18:03.114086+0000","last_clean":"2023-10-10T21:18:03.114086+0000","last_became_active":"2023-10-10T21:18:03.108970+0000","last_became_peered":"2023-10-10T21:18:03.108970+0000","last_unstale":"2023-10-10T21:18:03.114086+0000","last_undegraded":"2023-10-10T21:18:03.114086+0000","last_fullsized":"2023-10-10T21:18:03.114086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:51:48.404639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124382+0000","last_change":"2023-10-10T21:18:03.117935+0000","last_active":"2023-10-10T21:18:03.124382+0000","last_peered":"2023-10-10T21:18:03.124382+0000","last_clean":"2023-10-10T21:18:03.124382+0000","last_became_active":"2023-10-10T21:18:03.117552+0000","last_became_peered":"2023-10-10T21:18:03.117552+0000","last_unstale":"2023-10-10T21:18:03.124382+0000","last_undegraded":"2023-10-10T21:18:03.124382+0000","last_fullsized":"2023-10-10T21:18:03.124382+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:24:39.255862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.122399+0000","last_change":"2023-10-10T21:18:03.113509+0000","last_active":"2023-10-10T21:18:03.122399+0000","last_peered":"2023-10-10T21:18:03.122399+0000","last_clean":"2023-10-10T21:18:03.122399+0000","last_became_active":"2023-10-10T21:18:03.113227+0000","last_became_peered":"2023-10-10T21:18:03.113227+0000","last_unstale":"2023-10-10T21:18:03.122399+0000","last_undegraded":"2023-10-10T21:18:03.122399+0000","last_fullsized":"2023-10-10T21:18:03.122399+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:19:10.967416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129924+0000","last_change":"2023-10-10T21:18:03.126424+0000","last_active":"2023-10-10T21:18:03.129924+0000","last_peered":"2023-10-10T21:18:03.129924+0000","last_clean":"2023-10-10T21:18:03.129924+0000","last_became_active":"2023-10-10T21:18:03.125673+0000","last_became_peered":"2023-10-10T21:18:03.125673+0000","last_unstale":"2023-10-10T21:18:03.129924+0000","last_undegraded":"2023-10-10T21:18:03.129924+0000","last_fullsized":"2023-10-10T21:18:03.129924+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:22.538251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138071+0000","last_change":"2023-10-10T21:18:03.136560+0000","last_active":"2023-10-10T21:18:03.138071+0000","last_peered":"2023-10-10T21:18:03.138071+0000","last_clean":"2023-10-10T21:18:03.138071+0000","last_became_active":"2023-10-10T21:18:03.136301+0000","last_became_peered":"2023-10-10T21:18:03.136301+0000","last_unstale":"2023-10-10T21:18:03.138071+0000","last_undegraded":"2023-10-10T21:18:03.138071+0000","last_fullsized":"2023-10-10T21:18:03.138071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:10.463301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128656+0000","last_change":"2023-10-10T21:18:03.125260+0000","last_active":"2023-10-10T21:18:03.128656+0000","last_peered":"2023-10-10T21:18:03.128656+0000","last_clean":"2023-10-10T21:18:03.128656+0000","last_became_active":"2023-10-10T21:18:03.124986+0000","last_became_peered":"2023-10-10T21:18:03.124986+0000","last_unstale":"2023-10-10T21:18:03.128656+0000","last_undegraded":"2023-10-10T21:18:03.128656+0000","last_fullsized":"2023-10-10T21:18:03.128656+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:28:14.399113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126107+0000","last_change":"2023-10-10T21:18:03.125426+0000","last_active":"2023-10-10T21:18:03.126107+0000","last_peered":"2023-10-10T21:18:03.126107+0000","last_clean":"2023-10-10T21:18:03.126107+0000","last_became_active":"2023-10-10T21:18:03.125136+0000","last_became_peered":"2023-10-10T21:18:03.125136+0000","last_unstale":"2023-10-10T21:18:03.126107+0000","last_undegraded":"2023-10-10T21:18:03.126107+0000","last_fullsized":"2023-10-10T21:18:03.126107+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:05:17.246909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121625+0000","last_change":"2023-10-10T21:18:03.118901+0000","last_active":"2023-10-10T21:18:03.121625+0000","last_peered":"2023-10-10T21:18:03.121625+0000","last_clean":"2023-10-10T21:18:03.121625+0000","last_became_active":"2023-10-10T21:18:03.118655+0000","last_became_peered":"2023-10-10T21:18:03.118655+0000","last_unstale":"2023-10-10T21:18:03.121625+0000","last_undegraded":"2023-10-10T21:18:03.121625+0000","last_fullsized":"2023-10-10T21:18:03.121625+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:35:55.138638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125083+0000","last_change":"2023-10-10T21:18:03.121035+0000","last_active":"2023-10-10T21:18:03.125083+0000","last_peered":"2023-10-10T21:18:03.125083+0000","last_clean":"2023-10-10T21:18:03.125083+0000","last_became_active":"2023-10-10T21:18:03.120773+0000","last_became_peered":"2023-10-10T21:18:03.120773+0000","last_unstale":"2023-10-10T21:18:03.125083+0000","last_undegraded":"2023-10-10T21:18:03.125083+0000","last_fullsized":"2023-10-10T21:18:03.125083+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:14.654306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121369+0000","last_change":"2023-10-10T21:18:03.115215+0000","last_active":"2023-10-10T21:18:03.121369+0000","last_peered":"2023-10-10T21:18:03.121369+0000","last_clean":"2023-10-10T21:18:03.121369+0000","last_became_active":"2023-10-10T21:18:03.114868+0000","last_became_peered":"2023-10-10T21:18:03.114868+0000","last_unstale":"2023-10-10T21:18:03.121369+0000","last_undegraded":"2023-10-10T21:18:03.121369+0000","last_fullsized":"2023-10-10T21:18:03.121369+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:05.639479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128273+0000","last_change":"2023-10-10T21:18:03.126778+0000","last_active":"2023-10-10T21:18:03.128273+0000","last_peered":"2023-10-10T21:18:03.128273+0000","last_clean":"2023-10-10T21:18:03.128273+0000","last_became_active":"2023-10-10T21:18:03.126481+0000","last_became_peered":"2023-10-10T21:18:03.126481+0000","last_unstale":"2023-10-10T21:18:03.128273+0000","last_undegraded":"2023-10-10T21:18:03.128273+0000","last_fullsized":"2023-10-10T21:18:03.128273+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:24:39.255862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.123156+0000","last_change":"2023-10-10T21:18:03.115975+0000","last_active":"2023-10-10T21:18:03.123156+0000","last_peered":"2023-10-10T21:18:03.123156+0000","last_clean":"2023-10-10T21:18:03.123156+0000","last_became_active":"2023-10-10T21:18:03.115708+0000","last_became_peered":"2023-10-10T21:18:03.115708+0000","last_unstale":"2023-10-10T21:18:03.123156+0000","last_undegraded":"2023-10-10T21:18:03.123156+0000","last_fullsized":"2023-10-10T21:18:03.123156+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:11:20.228457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.131751+0000","last_change":"2023-10-10T21:18:03.129530+0000","last_active":"2023-10-10T21:18:03.131751+0000","last_peered":"2023-10-10T21:18:03.131751+0000","last_clean":"2023-10-10T21:18:03.131751+0000","last_became_active":"2023-10-10T21:18:03.126001+0000","last_became_peered":"2023-10-10T21:18:03.126001+0000","last_unstale":"2023-10-10T21:18:03.131751+0000","last_undegraded":"2023-10-10T21:18:03.131751+0000","last_fullsized":"2023-10-10T21:18:03.131751+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:43:38.716874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129609+0000","last_change":"2023-10-10T21:18:03.126162+0000","last_active":"2023-10-10T21:18:03.129609+0000","last_peered":"2023-10-10T21:18:03.129609+0000","last_clean":"2023-10-10T21:18:03.129609+0000","last_became_active":"2023-10-10T21:18:03.125841+0000","last_became_peered":"2023-10-10T21:18:03.125841+0000","last_unstale":"2023-10-10T21:18:03.129609+0000","last_undegraded":"2023-10-10T21:18:03.129609+0000","last_fullsized":"2023-10-10T21:18:03.129609+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:21.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"94'4","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138188+0000","last_change":"2023-10-10T21:18:02.102666+0000","last_active":"2023-10-10T21:18:03.138188+0000","last_peered":"2023-10-10T21:18:03.138188+0000","last_clean":"2023-10-10T21:18:03.138188+0000","last_became_active":"2023-10-10T21:18:02.102354+0000","last_became_peered":"2023-10-10T21:18:02.102354+0000","last_unstale":"2023-10-10T21:18:03.138188+0000","last_undegraded":"2023-10-10T21:18:03.138188+0000","last_fullsized":"2023-10-10T21:18:03.138188+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121828+0000","last_change":"2023-10-10T21:18:03.115827+0000","last_active":"2023-10-10T21:18:03.121828+0000","last_peered":"2023-10-10T21:18:03.121828+0000","last_clean":"2023-10-10T21:18:03.121828+0000","last_became_active":"2023-10-10T21:18:03.114749+0000","last_became_peered":"2023-10-10T21:18:03.114749+0000","last_unstale":"2023-10-10T21:18:03.121828+0000","last_undegraded":"2023-10-10T21:18:03.121828+0000","last_fullsized":"2023-10-10T21:18:03.121828+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:25.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135289+0000","last_change":"2023-10-10T21:18:02.104346+0000","last_active":"2023-10-10T21:18:03.135289+0000","last_peered":"2023-10-10T21:18:03.135289+0000","last_clean":"2023-10-10T21:18:03.135289+0000","last_became_active":"2023-10-10T21:18:02.104087+0000","last_became_peered":"2023-10-10T21:18:02.104087+0000","last_unstale":"2023-10-10T21:18:03.135289+0000","last_undegraded":"2023-10-10T21:18:03.135289+0000","last_fullsized":"2023-10-10T21:18:03.135289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135285+0000","last_change":"2023-10-10T21:18:03.131611+0000","last_active":"2023-10-10T21:18:03.135285+0000","last_peered":"2023-10-10T21:18:03.135285+0000","last_clean":"2023-10-10T21:18:03.135285+0000","last_became_active":"2023-10-10T21:18:03.131293+0000","last_became_peered":"2023-10-10T21:18:03.131293+0000","last_unstale":"2023-10-10T21:18:03.135285+0000","last_undegraded":"2023-10-10T21:18:03.135285+0000","last_fullsized":"2023-10-10T21:18:03.135285+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:34:05.657811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140721+0000","last_change":"2023-10-10T21:18:02.115690+0000","last_active":"2023-10-10T21:18:03.140721+0000","last_peered":"2023-10-10T21:18:03.140721+0000","last_clean":"2023-10-10T21:18:03.140721+0000","last_became_active":"2023-10-10T21:18:02.115385+0000","last_became_peered":"2023-10-10T21:18:02.115385+0000","last_unstale":"2023-10-10T21:18:03.140721+0000","last_undegraded":"2023-10-10T21:18:03.140721+0000","last_fullsized":"2023-10-10T21:18:03.140721+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:00.443737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124744+0000","last_change":"2023-10-10T21:18:03.117499+0000","last_active":"2023-10-10T21:18:03.124744+0000","last_peered":"2023-10-10T21:18:03.124744+0000","last_clean":"2023-10-10T21:18:03.124744+0000","last_became_active":"2023-10-10T21:18:03.117056+0000","last_became_peered":"2023-10-10T21:18:03.117056+0000","last_unstale":"2023-10-10T21:18:03.124744+0000","last_undegraded":"2023-10-10T21:18:03.124744+0000","last_fullsized":"2023-10-10T21:18:03.124744+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138765+0000","last_change":"2023-10-10T21:18:02.115455+0000","last_active":"2023-10-10T21:18:03.138765+0000","last_peered":"2023-10-10T21:18:03.138765+0000","last_clean":"2023-10-10T21:18:03.138765+0000","last_became_active":"2023-10-10T21:18:02.115102+0000","last_became_peered":"2023-10-10T21:18:02.115102+0000","last_unstale":"2023-10-10T21:18:03.138765+0000","last_undegraded":"2023-10-10T21:18:03.138765+0000","last_fullsized":"2023-10-10T21:18:03.138765+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:00:04.031693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.122533+0000","last_change":"2023-10-10T21:18:03.117395+0000","last_active":"2023-10-10T21:18:03.122533+0000","last_peered":"2023-10-10T21:18:03.122533+0000","last_clean":"2023-10-10T21:18:03.122533+0000","last_became_active":"2023-10-10T21:18:03.117065+0000","last_became_peered":"2023-10-10T21:18:03.117065+0000","last_unstale":"2023-10-10T21:18:03.122533+0000","last_undegraded":"2023-10-10T21:18:03.122533+0000","last_fullsized":"2023-10-10T21:18:03.122533+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:19:10.967416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132671+0000","last_change":"2023-10-10T21:18:02.105454+0000","last_active":"2023-10-10T21:18:03.132671+0000","last_peered":"2023-10-10T21:18:03.132671+0000","last_clean":"2023-10-10T21:18:03.132671+0000","last_became_active":"2023-10-10T21:18:02.104962+0000","last_became_peered":"2023-10-10T21:18:02.104962+0000","last_unstale":"2023-10-10T21:18:03.132671+0000","last_undegraded":"2023-10-10T21:18:03.132671+0000","last_fullsized":"2023-10-10T21:18:03.132671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:42.291687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130936+0000","last_change":"2023-10-10T21:18:03.127926+0000","last_active":"2023-10-10T21:18:03.130936+0000","last_peered":"2023-10-10T21:18:03.130936+0000","last_clean":"2023-10-10T21:18:03.130936+0000","last_became_active":"2023-10-10T21:18:03.127034+0000","last_became_peered":"2023-10-10T21:18:03.127034+0000","last_unstale":"2023-10-10T21:18:03.130936+0000","last_undegraded":"2023-10-10T21:18:03.130936+0000","last_fullsized":"2023-10-10T21:18:03.130936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:05:17.246909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.139849+0000","last_change":"2023-10-10T21:18:02.114944+0000","last_active":"2023-10-10T21:18:03.139849+0000","last_peered":"2023-10-10T21:18:03.139849+0000","last_clean":"2023-10-10T21:18:03.139849+0000","last_became_active":"2023-10-10T21:18:02.114633+0000","last_became_peered":"2023-10-10T21:18:02.114633+0000","last_unstale":"2023-10-10T21:18:03.139849+0000","last_undegraded":"2023-10-10T21:18:03.139849+0000","last_fullsized":"2023-10-10T21:18:03.139849+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:34:55.249703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124869+0000","last_change":"2023-10-10T21:18:03.122508+0000","last_active":"2023-10-10T21:18:03.124869+0000","last_peered":"2023-10-10T21:18:03.124869+0000","last_clean":"2023-10-10T21:18:03.124869+0000","last_became_active":"2023-10-10T21:18:03.122245+0000","last_became_peered":"2023-10-10T21:18:03.122245+0000","last_unstale":"2023-10-10T21:18:03.124869+0000","last_undegraded":"2023-10-10T21:18:03.124869+0000","last_fullsized":"2023-10-10T21:18:03.124869+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:41.065339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104533+0000","last_change":"2023-10-10T21:18:02.112370+0000","last_active":"2023-10-10T21:18:03.104533+0000","last_peered":"2023-10-10T21:18:03.104533+0000","last_clean":"2023-10-10T21:18:03.104533+0000","last_became_active":"2023-10-10T21:18:02.112099+0000","last_became_peered":"2023-10-10T21:18:02.112099+0000","last_unstale":"2023-10-10T21:18:03.104533+0000","last_undegraded":"2023-10-10T21:18:03.104533+0000","last_fullsized":"2023-10-10T21:18:03.104533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:03.288893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121084+0000","last_change":"2023-10-10T21:18:03.118553+0000","last_active":"2023-10-10T21:18:03.121084+0000","last_peered":"2023-10-10T21:18:03.121084+0000","last_clean":"2023-10-10T21:18:03.121084+0000","last_became_active":"2023-10-10T21:18:03.118289+0000","last_became_peered":"2023-10-10T21:18:03.118289+0000","last_unstale":"2023-10-10T21:18:03.121084+0000","last_undegraded":"2023-10-10T21:18:03.121084+0000","last_fullsized":"2023-10-10T21:18:03.121084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:05.319721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105764+0000","last_change":"2023-10-10T21:18:02.103988+0000","last_active":"2023-10-10T21:18:03.105764+0000","last_peered":"2023-10-10T21:18:03.105764+0000","last_clean":"2023-10-10T21:18:03.105764+0000","last_became_active":"2023-10-10T21:18:02.103709+0000","last_became_peered":"2023-10-10T21:18:02.103709+0000","last_unstale":"2023-10-10T21:18:03.105764+0000","last_undegraded":"2023-10-10T21:18:03.105764+0000","last_fullsized":"2023-10-10T21:18:03.105764+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:43.528613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.122566+0000","last_change":"2023-10-10T21:18:03.115125+0000","last_active":"2023-10-10T21:18:03.122566+0000","last_peered":"2023-10-10T21:18:03.122566+0000","last_clean":"2023-10-10T21:18:03.122566+0000","last_became_active":"2023-10-10T21:18:03.114782+0000","last_became_peered":"2023-10-10T21:18:03.114782+0000","last_unstale":"2023-10-10T21:18:03.122566+0000","last_undegraded":"2023-10-10T21:18:03.122566+0000","last_fullsized":"2023-10-10T21:18:03.122566+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:14.654306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105952+0000","last_change":"2023-10-10T21:18:02.097199+0000","last_active":"2023-10-10T21:18:03.105952+0000","last_peered":"2023-10-10T21:18:03.105952+0000","last_clean":"2023-10-10T21:18:03.105952+0000","last_became_active":"2023-10-10T21:18:02.096924+0000","last_became_peered":"2023-10-10T21:18:02.096924+0000","last_unstale":"2023-10-10T21:18:03.105952+0000","last_undegraded":"2023-10-10T21:18:03.105952+0000","last_fullsized":"2023-10-10T21:18:03.105952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:42.119227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137096+0000","last_change":"2023-10-10T21:18:03.134927+0000","last_active":"2023-10-10T21:18:03.137096+0000","last_peered":"2023-10-10T21:18:03.137096+0000","last_clean":"2023-10-10T21:18:03.137096+0000","last_became_active":"2023-10-10T21:18:03.134663+0000","last_became_peered":"2023-10-10T21:18:03.134663+0000","last_unstale":"2023-10-10T21:18:03.137096+0000","last_undegraded":"2023-10-10T21:18:03.137096+0000","last_fullsized":"2023-10-10T21:18:03.137096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:02:50.568864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115156+0000","last_change":"2023-10-10T21:18:02.114063+0000","last_active":"2023-10-10T21:18:03.115156+0000","last_peered":"2023-10-10T21:18:03.115156+0000","last_clean":"2023-10-10T21:18:03.115156+0000","last_became_active":"2023-10-10T21:18:02.113482+0000","last_became_peered":"2023-10-10T21:18:02.113482+0000","last_unstale":"2023-10-10T21:18:03.115156+0000","last_undegraded":"2023-10-10T21:18:03.115156+0000","last_fullsized":"2023-10-10T21:18:03.115156+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:12.635697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135263+0000","last_change":"2023-10-10T21:18:03.130251+0000","last_active":"2023-10-10T21:18:03.135263+0000","last_peered":"2023-10-10T21:18:03.135263+0000","last_clean":"2023-10-10T21:18:03.135263+0000","last_became_active":"2023-10-10T21:18:03.129958+0000","last_became_peered":"2023-10-10T21:18:03.129958+0000","last_unstale":"2023-10-10T21:18:03.135263+0000","last_undegraded":"2023-10-10T21:18:03.135263+0000","last_fullsized":"2023-10-10T21:18:03.135263+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:43.123867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"94'3","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135167+0000","last_change":"2023-10-10T21:18:02.112911+0000","last_active":"2023-10-10T21:18:03.135167+0000","last_peered":"2023-10-10T21:18:03.135167+0000","last_clean":"2023-10-10T21:18:03.135167+0000","last_became_active":"2023-10-10T21:18:02.112580+0000","last_became_peered":"2023-10-10T21:18:02.112580+0000","last_unstale":"2023-10-10T21:18:03.135167+0000","last_undegraded":"2023-10-10T21:18:03.135167+0000","last_fullsized":"2023-10-10T21:18:03.135167+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:49:28.212088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120562+0000","last_change":"2023-10-10T21:18:03.114601+0000","last_active":"2023-10-10T21:18:03.120562+0000","last_peered":"2023-10-10T21:18:03.120562+0000","last_clean":"2023-10-10T21:18:03.120562+0000","last_became_active":"2023-10-10T21:18:03.114335+0000","last_became_peered":"2023-10-10T21:18:03.114335+0000","last_unstale":"2023-10-10T21:18:03.120562+0000","last_undegraded":"2023-10-10T21:18:03.120562+0000","last_fullsized":"2023-10-10T21:18:03.120562+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:59:51.773918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"94'6","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137510+0000","last_change":"2023-10-10T21:18:02.104756+0000","last_active":"2023-10-10T21:18:03.137510+0000","last_peered":"2023-10-10T21:18:03.137510+0000","last_clean":"2023-10-10T21:18:03.137510+0000","last_became_active":"2023-10-10T21:18:02.104493+0000","last_became_peered":"2023-10-10T21:18:02.104493+0000","last_unstale":"2023-10-10T21:18:03.137510+0000","last_undegraded":"2023-10-10T21:18:03.137510+0000","last_fullsized":"2023-10-10T21:18:03.137510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:29:40.211849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127583+0000","last_change":"2023-10-10T21:18:03.123287+0000","last_active":"2023-10-10T21:18:03.127583+0000","last_peered":"2023-10-10T21:18:03.127583+0000","last_clean":"2023-10-10T21:18:03.127583+0000","last_became_active":"2023-10-10T21:18:03.121920+0000","last_became_peered":"2023-10-10T21:18:03.121920+0000","last_unstale":"2023-10-10T21:18:03.127583+0000","last_undegraded":"2023-10-10T21:18:03.127583+0000","last_fullsized":"2023-10-10T21:18:03.127583+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130881+0000","last_change":"2023-10-10T21:18:02.105096+0000","last_active":"2023-10-10T21:18:03.130881+0000","last_peered":"2023-10-10T21:18:03.130881+0000","last_clean":"2023-10-10T21:18:03.130881+0000","last_became_active":"2023-10-10T21:18:02.104823+0000","last_became_peered":"2023-10-10T21:18:02.104823+0000","last_unstale":"2023-10-10T21:18:03.130881+0000","last_undegraded":"2023-10-10T21:18:03.130881+0000","last_fullsized":"2023-10-10T21:18:03.130881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:23.810550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.110608+0000","last_change":"2023-10-10T21:18:03.109711+0000","last_active":"2023-10-10T21:18:03.110608+0000","last_peered":"2023-10-10T21:18:03.110608+0000","last_clean":"2023-10-10T21:18:03.110608+0000","last_became_active":"2023-10-10T21:18:03.109421+0000","last_became_peered":"2023-10-10T21:18:03.109421+0000","last_unstale":"2023-10-10T21:18:03.110608+0000","last_undegraded":"2023-10-10T21:18:03.110608+0000","last_fullsized":"2023-10-10T21:18:03.110608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:53.044728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121482+0000","last_change":"2023-10-10T21:18:02.110191+0000","last_active":"2023-10-10T21:18:03.121482+0000","last_peered":"2023-10-10T21:18:03.121482+0000","last_clean":"2023-10-10T21:18:03.121482+0000","last_became_active":"2023-10-10T21:18:02.109924+0000","last_became_peered":"2023-10-10T21:18:02.109924+0000","last_unstale":"2023-10-10T21:18:03.121482+0000","last_undegraded":"2023-10-10T21:18:03.121482+0000","last_fullsized":"2023-10-10T21:18:03.121482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:23:29.367513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125859+0000","last_change":"2023-10-10T21:18:03.125107+0000","last_active":"2023-10-10T21:18:03.125859+0000","last_peered":"2023-10-10T21:18:03.125859+0000","last_clean":"2023-10-10T21:18:03.125859+0000","last_became_active":"2023-10-10T21:18:03.124825+0000","last_became_peered":"2023-10-10T21:18:03.124825+0000","last_unstale":"2023-10-10T21:18:03.125859+0000","last_undegraded":"2023-10-10T21:18:03.125859+0000","last_fullsized":"2023-10-10T21:18:03.125859+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105063+0000","last_change":"2023-10-10T21:18:02.104851+0000","last_active":"2023-10-10T21:18:03.105063+0000","last_peered":"2023-10-10T21:18:03.105063+0000","last_clean":"2023-10-10T21:18:03.105063+0000","last_became_active":"2023-10-10T21:18:02.104566+0000","last_became_peered":"2023-10-10T21:18:02.104566+0000","last_unstale":"2023-10-10T21:18:03.105063+0000","last_undegraded":"2023-10-10T21:18:03.105063+0000","last_fullsized":"2023-10-10T21:18:03.105063+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:00.443737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120796+0000","last_change":"2023-10-10T21:18:03.114682+0000","last_active":"2023-10-10T21:18:03.120796+0000","last_peered":"2023-10-10T21:18:03.120796+0000","last_clean":"2023-10-10T21:18:03.120796+0000","last_became_active":"2023-10-10T21:18:03.114394+0000","last_became_peered":"2023-10-10T21:18:03.114394+0000","last_unstale":"2023-10-10T21:18:03.120796+0000","last_undegraded":"2023-10-10T21:18:03.120796+0000","last_fullsized":"2023-10-10T21:18:03.120796+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:57.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"94'8","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.141200+0000","last_change":"2023-10-10T21:18:02.106816+0000","last_active":"2023-10-10T21:18:03.141200+0000","last_peered":"2023-10-10T21:18:03.141200+0000","last_clean":"2023-10-10T21:18:03.141200+0000","last_became_active":"2023-10-10T21:18:02.106514+0000","last_became_peered":"2023-10-10T21:18:02.106514+0000","last_unstale":"2023-10-10T21:18:03.141200+0000","last_undegraded":"2023-10-10T21:18:03.141200+0000","last_fullsized":"2023-10-10T21:18:03.141200+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:06.243413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.123938+0000","last_change":"2023-10-10T21:18:03.118958+0000","last_active":"2023-10-10T21:18:03.123938+0000","last_peered":"2023-10-10T21:18:03.123938+0000","last_clean":"2023-10-10T21:18:03.123938+0000","last_became_active":"2023-10-10T21:18:03.118715+0000","last_became_peered":"2023-10-10T21:18:03.118715+0000","last_unstale":"2023-10-10T21:18:03.123938+0000","last_undegraded":"2023-10-10T21:18:03.123938+0000","last_fullsized":"2023-10-10T21:18:03.123938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:53.044728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.139587+0000","last_change":"2023-10-10T21:18:02.115240+0000","last_active":"2023-10-10T21:18:03.139587+0000","last_peered":"2023-10-10T21:18:03.139587+0000","last_clean":"2023-10-10T21:18:03.139587+0000","last_became_active":"2023-10-10T21:18:02.114964+0000","last_became_peered":"2023-10-10T21:18:02.114964+0000","last_unstale":"2023-10-10T21:18:03.139587+0000","last_undegraded":"2023-10-10T21:18:03.139587+0000","last_fullsized":"2023-10-10T21:18:03.139587+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:22.364093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124747+0000","last_change":"2023-10-10T21:18:03.118846+0000","last_active":"2023-10-10T21:18:03.124747+0000","last_peered":"2023-10-10T21:18:03.124747+0000","last_clean":"2023-10-10T21:18:03.124747+0000","last_became_active":"2023-10-10T21:18:03.118599+0000","last_became_peered":"2023-10-10T21:18:03.118599+0000","last_unstale":"2023-10-10T21:18:03.124747+0000","last_undegraded":"2023-10-10T21:18:03.124747+0000","last_fullsized":"2023-10-10T21:18:03.124747+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:45.905044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140786+0000","last_change":"2023-10-10T21:18:02.116376+0000","last_active":"2023-10-10T21:18:03.140786+0000","last_peered":"2023-10-10T21:18:03.140786+0000","last_clean":"2023-10-10T21:18:03.140786+0000","last_became_active":"2023-10-10T21:18:02.115966+0000","last_became_peered":"2023-10-10T21:18:02.115966+0000","last_unstale":"2023-10-10T21:18:03.140786+0000","last_undegraded":"2023-10-10T21:18:03.140786+0000","last_fullsized":"2023-10-10T21:18:03.140786+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:49:30.267805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118446+0000","last_change":"2023-10-10T21:18:03.115328+0000","last_active":"2023-10-10T21:18:03.118446+0000","last_peered":"2023-10-10T21:18:03.118446+0000","last_clean":"2023-10-10T21:18:03.118446+0000","last_became_active":"2023-10-10T21:18:03.115038+0000","last_became_peered":"2023-10-10T21:18:03.115038+0000","last_unstale":"2023-10-10T21:18:03.118446+0000","last_undegraded":"2023-10-10T21:18:03.118446+0000","last_fullsized":"2023-10-10T21:18:03.118446+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:00:05.036333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.141238+0000","last_change":"2023-10-10T21:18:02.109700+0000","last_active":"2023-10-10T21:18:03.141238+0000","last_peered":"2023-10-10T21:18:03.141238+0000","last_clean":"2023-10-10T21:18:03.141238+0000","last_became_active":"2023-10-10T21:18:02.109482+0000","last_became_peered":"2023-10-10T21:18:02.109482+0000","last_unstale":"2023-10-10T21:18:03.141238+0000","last_undegraded":"2023-10-10T21:18:03.141238+0000","last_fullsized":"2023-10-10T21:18:03.141238+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:39.469469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127345+0000","last_change":"2023-10-10T21:18:03.126599+0000","last_active":"2023-10-10T21:18:03.127345+0000","last_peered":"2023-10-10T21:18:03.127345+0000","last_clean":"2023-10-10T21:18:03.127345+0000","last_became_active":"2023-10-10T21:18:03.126259+0000","last_became_peered":"2023-10-10T21:18:03.126259+0000","last_unstale":"2023-10-10T21:18:03.127345+0000","last_undegraded":"2023-10-10T21:18:03.127345+0000","last_fullsized":"2023-10-10T21:18:03.127345+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:27.054207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.106797+0000","last_change":"2023-10-10T21:18:02.112963+0000","last_active":"2023-10-10T21:18:03.106797+0000","last_peered":"2023-10-10T21:18:03.106797+0000","last_clean":"2023-10-10T21:18:03.106797+0000","last_became_active":"2023-10-10T21:18:02.112670+0000","last_became_peered":"2023-10-10T21:18:02.112670+0000","last_unstale":"2023-10-10T21:18:03.106797+0000","last_undegraded":"2023-10-10T21:18:03.106797+0000","last_fullsized":"2023-10-10T21:18:03.106797+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121389+0000","last_change":"2023-10-10T21:18:03.115159+0000","last_active":"2023-10-10T21:18:03.121389+0000","last_peered":"2023-10-10T21:18:03.121389+0000","last_clean":"2023-10-10T21:18:03.121389+0000","last_became_active":"2023-10-10T21:18:03.114547+0000","last_became_peered":"2023-10-10T21:18:03.114547+0000","last_unstale":"2023-10-10T21:18:03.121389+0000","last_undegraded":"2023-10-10T21:18:03.121389+0000","last_fullsized":"2023-10-10T21:18:03.121389+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.026791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121608+0000","last_change":"2023-10-10T21:18:02.109706+0000","last_active":"2023-10-10T21:18:03.121608+0000","last_peered":"2023-10-10T21:18:03.121608+0000","last_clean":"2023-10-10T21:18:03.121608+0000","last_became_active":"2023-10-10T21:18:02.109440+0000","last_became_peered":"2023-10-10T21:18:02.109440+0000","last_unstale":"2023-10-10T21:18:03.121608+0000","last_undegraded":"2023-10-10T21:18:03.121608+0000","last_fullsized":"2023-10-10T21:18:03.121608+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:14:53.236051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135108+0000","last_change":"2023-10-10T21:18:03.131702+0000","last_active":"2023-10-10T21:18:03.135108+0000","last_peered":"2023-10-10T21:18:03.135108+0000","last_clean":"2023-10-10T21:18:03.135108+0000","last_became_active":"2023-10-10T21:18:03.131482+0000","last_became_peered":"2023-10-10T21:18:03.131482+0000","last_unstale":"2023-10-10T21:18:03.135108+0000","last_undegraded":"2023-10-10T21:18:03.135108+0000","last_fullsized":"2023-10-10T21:18:03.135108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:25.952411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105166+0000","last_change":"2023-10-10T21:18:02.109581+0000","last_active":"2023-10-10T21:18:03.105166+0000","last_peered":"2023-10-10T21:18:03.105166+0000","last_clean":"2023-10-10T21:18:03.105166+0000","last_became_active":"2023-10-10T21:18:02.109284+0000","last_became_peered":"2023-10-10T21:18:02.109284+0000","last_unstale":"2023-10-10T21:18:03.105166+0000","last_undegraded":"2023-10-10T21:18:03.105166+0000","last_fullsized":"2023-10-10T21:18:03.105166+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:42.119227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121608+0000","last_change":"2023-10-10T21:18:03.118181+0000","last_active":"2023-10-10T21:18:03.121608+0000","last_peered":"2023-10-10T21:18:03.121608+0000","last_clean":"2023-10-10T21:18:03.121608+0000","last_became_active":"2023-10-10T21:18:03.117789+0000","last_became_peered":"2023-10-10T21:18:03.117789+0000","last_unstale":"2023-10-10T21:18:03.121608+0000","last_undegraded":"2023-10-10T21:18:03.121608+0000","last_fullsized":"2023-10-10T21:18:03.121608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:52.592283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101483+0000","last_change":"2023-10-10T21:18:02.107231+0000","last_active":"2023-10-10T21:18:03.101483+0000","last_peered":"2023-10-10T21:18:03.101483+0000","last_clean":"2023-10-10T21:18:03.101483+0000","last_became_active":"2023-10-10T21:18:02.106958+0000","last_became_peered":"2023-10-10T21:18:02.106958+0000","last_unstale":"2023-10-10T21:18:03.101483+0000","last_undegraded":"2023-10-10T21:18:03.101483+0000","last_fullsized":"2023-10-10T21:18:03.101483+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:13.649666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115546+0000","last_change":"2023-10-10T21:18:03.112233+0000","last_active":"2023-10-10T21:18:03.115546+0000","last_peered":"2023-10-10T21:18:03.115546+0000","last_clean":"2023-10-10T21:18:03.115546+0000","last_became_active":"2023-10-10T21:18:03.111983+0000","last_became_peered":"2023-10-10T21:18:03.111983+0000","last_unstale":"2023-10-10T21:18:03.115546+0000","last_undegraded":"2023-10-10T21:18:03.115546+0000","last_fullsized":"2023-10-10T21:18:03.115546+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:57.687562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.139714+0000","last_change":"2023-10-10T21:18:02.115421+0000","last_active":"2023-10-10T21:18:03.139714+0000","last_peered":"2023-10-10T21:18:03.139714+0000","last_clean":"2023-10-10T21:18:03.139714+0000","last_became_active":"2023-10-10T21:18:02.114893+0000","last_became_peered":"2023-10-10T21:18:02.114893+0000","last_unstale":"2023-10-10T21:18:03.139714+0000","last_undegraded":"2023-10-10T21:18:03.139714+0000","last_fullsized":"2023-10-10T21:18:03.139714+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:01:22.474173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124037+0000","last_change":"2023-10-10T21:18:03.114414+0000","last_active":"2023-10-10T21:18:03.124037+0000","last_peered":"2023-10-10T21:18:03.124037+0000","last_clean":"2023-10-10T21:18:03.124037+0000","last_became_active":"2023-10-10T21:18:03.114110+0000","last_became_peered":"2023-10-10T21:18:03.114110+0000","last_unstale":"2023-10-10T21:18:03.124037+0000","last_undegraded":"2023-10-10T21:18:03.124037+0000","last_fullsized":"2023-10-10T21:18:03.124037+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:28:14.399113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104739+0000","last_change":"2023-10-10T21:18:02.108937+0000","last_active":"2023-10-10T21:18:03.104739+0000","last_peered":"2023-10-10T21:18:03.104739+0000","last_clean":"2023-10-10T21:18:03.104739+0000","last_became_active":"2023-10-10T21:18:02.108686+0000","last_became_peered":"2023-10-10T21:18:02.108686+0000","last_unstale":"2023-10-10T21:18:03.104739+0000","last_undegraded":"2023-10-10T21:18:03.104739+0000","last_fullsized":"2023-10-10T21:18:03.104739+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:43:37.712234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129693+0000","last_change":"2023-10-10T21:18:03.126206+0000","last_active":"2023-10-10T21:18:03.129693+0000","last_peered":"2023-10-10T21:18:03.129693+0000","last_clean":"2023-10-10T21:18:03.129693+0000","last_became_active":"2023-10-10T21:18:03.125406+0000","last_became_peered":"2023-10-10T21:18:03.125406+0000","last_unstale":"2023-10-10T21:18:03.129693+0000","last_undegraded":"2023-10-10T21:18:03.129693+0000","last_fullsized":"2023-10-10T21:18:03.129693+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:17.091601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107309+0000","last_change":"2023-10-10T21:18:02.101559+0000","last_active":"2023-10-10T21:18:03.107309+0000","last_peered":"2023-10-10T21:18:03.107309+0000","last_clean":"2023-10-10T21:18:03.107309+0000","last_became_active":"2023-10-10T21:18:02.101311+0000","last_became_peered":"2023-10-10T21:18:02.101311+0000","last_unstale":"2023-10-10T21:18:03.107309+0000","last_undegraded":"2023-10-10T21:18:03.107309+0000","last_fullsized":"2023-10-10T21:18:03.107309+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:50.840955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124725+0000","last_change":"2023-10-10T21:18:03.117311+0000","last_active":"2023-10-10T21:18:03.124725+0000","last_peered":"2023-10-10T21:18:03.124725+0000","last_clean":"2023-10-10T21:18:03.124725+0000","last_became_active":"2023-10-10T21:18:03.116702+0000","last_became_peered":"2023-10-10T21:18:03.116702+0000","last_unstale":"2023-10-10T21:18:03.124725+0000","last_undegraded":"2023-10-10T21:18:03.124725+0000","last_fullsized":"2023-10-10T21:18:03.124725+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:50:21.902920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101734+0000","last_change":"2023-10-10T21:18:02.113291+0000","last_active":"2023-10-10T21:18:03.101734+0000","last_peered":"2023-10-10T21:18:03.101734+0000","last_clean":"2023-10-10T21:18:03.101734+0000","last_became_active":"2023-10-10T21:18:02.113013+0000","last_became_peered":"2023-10-10T21:18:02.113013+0000","last_unstale":"2023-10-10T21:18:03.101734+0000","last_undegraded":"2023-10-10T21:18:03.101734+0000","last_fullsized":"2023-10-10T21:18:03.101734+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118743+0000","last_change":"2023-10-10T21:18:03.112467+0000","last_active":"2023-10-10T21:18:03.118743+0000","last_peered":"2023-10-10T21:18:03.118743+0000","last_clean":"2023-10-10T21:18:03.118743+0000","last_became_active":"2023-10-10T21:18:03.112232+0000","last_became_peered":"2023-10-10T21:18:03.112232+0000","last_unstale":"2023-10-10T21:18:03.118743+0000","last_undegraded":"2023-10-10T21:18:03.118743+0000","last_fullsized":"2023-10-10T21:18:03.118743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:48.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107085+0000","last_change":"2023-10-10T21:18:02.114127+0000","last_active":"2023-10-10T21:18:03.107085+0000","last_peered":"2023-10-10T21:18:03.107085+0000","last_clean":"2023-10-10T21:18:03.107085+0000","last_became_active":"2023-10-10T21:18:02.113859+0000","last_became_peered":"2023-10-10T21:18:02.113859+0000","last_unstale":"2023-10-10T21:18:03.107085+0000","last_undegraded":"2023-10-10T21:18:03.107085+0000","last_fullsized":"2023-10-10T21:18:03.107085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:47:16.599994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130361+0000","last_change":"2023-10-10T21:18:03.128729+0000","last_active":"2023-10-10T21:18:03.130361+0000","last_peered":"2023-10-10T21:18:03.130361+0000","last_clean":"2023-10-10T21:18:03.130361+0000","last_became_active":"2023-10-10T21:18:03.126563+0000","last_became_peered":"2023-10-10T21:18:03.126563+0000","last_unstale":"2023-10-10T21:18:03.130361+0000","last_undegraded":"2023-10-10T21:18:03.130361+0000","last_fullsized":"2023-10-10T21:18:03.130361+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:26:55.455367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104475+0000","last_change":"2023-10-10T21:18:02.113222+0000","last_active":"2023-10-10T21:18:03.104475+0000","last_peered":"2023-10-10T21:18:03.104475+0000","last_clean":"2023-10-10T21:18:03.104475+0000","last_became_active":"2023-10-10T21:18:02.112956+0000","last_became_peered":"2023-10-10T21:18:02.112956+0000","last_unstale":"2023-10-10T21:18:03.104475+0000","last_undegraded":"2023-10-10T21:18:03.104475+0000","last_fullsized":"2023-10-10T21:18:03.104475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:18.389100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.113293+0000","last_change":"2023-10-10T21:18:03.111805+0000","last_active":"2023-10-10T21:18:03.113293+0000","last_peered":"2023-10-10T21:18:03.113293+0000","last_clean":"2023-10-10T21:18:03.113293+0000","last_became_active":"2023-10-10T21:18:03.111563+0000","last_became_peered":"2023-10-10T21:18:03.111563+0000","last_unstale":"2023-10-10T21:18:03.113293+0000","last_undegraded":"2023-10-10T21:18:03.113293+0000","last_fullsized":"2023-10-10T21:18:03.113293+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:12:30.776673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104292+0000","last_change":"2023-10-10T21:18:02.105944+0000","last_active":"2023-10-10T21:18:03.104292+0000","last_peered":"2023-10-10T21:18:03.104292+0000","last_clean":"2023-10-10T21:18:03.104292+0000","last_became_active":"2023-10-10T21:18:02.105661+0000","last_became_peered":"2023-10-10T21:18:02.105661+0000","last_unstale":"2023-10-10T21:18:03.104292+0000","last_undegraded":"2023-10-10T21:18:03.104292+0000","last_fullsized":"2023-10-10T21:18:03.104292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:43:37.712234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130769+0000","last_change":"2023-10-10T21:18:03.129173+0000","last_active":"2023-10-10T21:18:03.130769+0000","last_peered":"2023-10-10T21:18:03.130769+0000","last_clean":"2023-10-10T21:18:03.130769+0000","last_became_active":"2023-10-10T21:18:03.125636+0000","last_became_peered":"2023-10-10T21:18:03.125636+0000","last_unstale":"2023-10-10T21:18:03.130769+0000","last_undegraded":"2023-10-10T21:18:03.130769+0000","last_fullsized":"2023-10-10T21:18:03.130769+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:18:05.038207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120752+0000","last_change":"2023-10-10T21:18:02.113839+0000","last_active":"2023-10-10T21:18:03.120752+0000","last_peered":"2023-10-10T21:18:03.120752+0000","last_clean":"2023-10-10T21:18:03.120752+0000","last_became_active":"2023-10-10T21:18:02.113532+0000","last_became_peered":"2023-10-10T21:18:02.113532+0000","last_unstale":"2023-10-10T21:18:03.120752+0000","last_undegraded":"2023-10-10T21:18:03.120752+0000","last_fullsized":"2023-10-10T21:18:03.120752+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:42.808017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126713+0000","last_change":"2023-10-10T21:18:03.125634+0000","last_active":"2023-10-10T21:18:03.126713+0000","last_peered":"2023-10-10T21:18:03.126713+0000","last_clean":"2023-10-10T21:18:03.126713+0000","last_became_active":"2023-10-10T21:18:03.125352+0000","last_became_peered":"2023-10-10T21:18:03.125352+0000","last_unstale":"2023-10-10T21:18:03.126713+0000","last_undegraded":"2023-10-10T21:18:03.126713+0000","last_fullsized":"2023-10-10T21:18:03.126713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:56.907952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140470+0000","last_change":"2023-10-10T21:18:02.111165+0000","last_active":"2023-10-10T21:18:03.140470+0000","last_peered":"2023-10-10T21:18:03.140470+0000","last_clean":"2023-10-10T21:18:03.140470+0000","last_became_active":"2023-10-10T21:18:02.110183+0000","last_became_peered":"2023-10-10T21:18:02.110183+0000","last_unstale":"2023-10-10T21:18:03.140470+0000","last_undegraded":"2023-10-10T21:18:03.140470+0000","last_fullsized":"2023-10-10T21:18:03.140470+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:46.796401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"84'183","reported_seq":462,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107903+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:03.107903+0000","last_peered":"2023-10-10T21:18:03.107903+0000","last_clean":"2023-10-10T21:18:03.107903+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:03.107903+0000","last_undegraded":"2023-10-10T21:18:03.107903+0000","last_fullsized":"2023-10-10T21:18:03.107903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":1147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.995,"5min":1.014,"15min":1.1859999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.52200000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.435},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0069999999999999,"15min":1.123},"last":0.84599999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.71399999999999997},"min":{"1min":0.41399999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.504,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":1.2669999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.62,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.67400000000000004},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.58599999999999997,"5min":0.51300000000000001,"15min":0.42499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.135},"last":0.88100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542334,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1163264,"data_stored":556926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":1.0569999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.97299999999999998,"5min":1.0129999999999999,"15min":1.143},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.378},"max":{"1min":0.92800000000000005,"5min":1.073,"15min":1.073},"last":0.73099999999999998}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.151},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93600000000000005,"5min":0.97799999999999998,"15min":1.01},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.503,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.018,"5min":1.042,"15min":1.1200000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":1.2729999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.443,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":0.85199999999999998,"5min":0.89200000000000002,"15min":1.0880000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66300000000000003,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":1.022,"15min":1.345},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":1.048,"15min":1.238},"last":0.88400000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.024,"15min":1.4930000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.202},"last":0.93600000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542336,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306620,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065220,"statfs":{"total":96636764160,"available":96322785280,"internally_reserved":0,"allocated":1167360,"data_stored":558370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64400000000000002,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.309},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.61599999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47199999999999998,"15min":0.48699999999999999},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66800000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.755},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.157,"15min":1.3220000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.77800000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.26,"15min":1.2849999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.008,"5min":2.21,"15min":2.21},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.165,"15min":1.268},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.53300000000000003},"max":{"1min":1.0409999999999999,"5min":1.0509999999999999,"15min":1.3400000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.61799999999999999,"5min":0.52800000000000002,"15min":0.505},"max":{"1min":1.026,"5min":1.026,"15min":1.3759999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.85299999999999998,"5min":1.716,"15min":1.716},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.92200000000000004,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298996,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072844,"statfs":{"total":96636764160,"available":96330592256,"internally_reserved":0,"allocated":1748992,"data_stored":1147202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.4890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.65600000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.501}]},{"osd":2,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":1.706},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.70899999999999996,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.72499999999999998,"5min":0.874,"15min":1.2909999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.101,"15min":1.2270000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.2909999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.03,"5min":1.075,"15min":1.2729999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.58199999999999996,"5min":0.57299999999999995,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0980000000000001,"15min":1.3899999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.65100000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.95699999999999996,"5min":1.0960000000000001,"15min":1.2589999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.83999999999999997},"min":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0249999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.92700000000000005}]},{"osd":7,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.64300000000000002,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":0.97299999999999998,"5min":1.139,"15min":1.363},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54200000000000004},"max":{"1min":0.96999999999999997,"5min":1.024,"15min":1.3300000000000001},"last":1.006}]}]},{"osd":1,"up_from":14,"seq":60129542334,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302532,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069308,"statfs":{"total":96636764160,"available":96326971392,"internally_reserved":0,"allocated":1175552,"data_stored":558958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.54200000000000004,"15min":0.48899999999999999},"min":{"1min":0.307,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":8.0839999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.378},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.63500000000000001,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":13.223000000000001,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.5}]},{"osd":2,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":2.085},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.60899999999999999,"15min":0.58199999999999996},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35399999999999998},"max":{"1min":0.88,"5min":0.999,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.81100000000000005,"15min":0.79700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.82799999999999996,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.413,"5min":0.92200000000000004,"15min":0.83599999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":13.130000000000001,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.81899999999999995,"15min":0.80700000000000005},"min":{"1min":0.57999999999999996,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84899999999999998,"15min":0.84299999999999997},"min":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.89300000000000002,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":12.026,"5min":12.026,"15min":12.026},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.751}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306616,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065224,"statfs":{"total":96636764160,"available":96322789376,"internally_reserved":0,"allocated":1163264,"data_stored":556946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28799999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.544},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.501},"min":{"1min":0.315,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.6759999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.68400000000000005,"5min":0.73399999999999999,"15min":1.4610000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.7070000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.4990000000000001},"last":0.501}]},{"osd":4,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.6359999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.246},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.262},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76700000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.2250000000000001,"15min":1.579},"last":0.70999999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.081,"5min":1.27,"15min":1.27},"last":0.75},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.224,"15min":1.224},"last":0.63}]},{"osd":7,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.111,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.228,"5min":1.228,"15min":1.3200000000000001},"last":0.67500000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542336,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310708,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061132,"statfs":{"total":96636764160,"available":96318599168,"internally_reserved":0,"allocated":1159168,"data_stored":556904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.88,"5min":0.92100000000000004,"15min":1.1479999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":0.96299999999999997,"15min":1.758},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.47},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68999999999999995,"15min":0.70299999999999996},"min":{"1min":0.53200000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.98299999999999998,"15min":1.929},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83899999999999997,"5min":1.002,"15min":1.6890000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.98399999999999999,"15min":1.468},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90400000000000003,"5min":1.046,"15min":1.397},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.42799999999999999},"max":{"1min":0.81899999999999995,"5min":0.97699999999999998,"15min":1.385},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":1.105},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":1.5209999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.435},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":1.464},"last":0.67200000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":1.006,"5min":1.006,"15min":1.5700000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51000000000000001,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.86599999999999999,"5min":0.91900000000000004,"15min":1.4139999999999999},"last":0.81499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542334,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302516,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069324,"statfs":{"total":96636764160,"available":96326987776,"internally_reserved":0,"allocated":1159168,"data_stored":556924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.878,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":1.371},"last":0.441}]},{"osd":1,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88100000000000001,"5min":0.93300000000000005,"15min":3.895},"last":0.623},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71699999999999997,"15min":0.748},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.97899999999999998,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.67700000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.2889999999999999},"last":0.499},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.56100000000000005,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.3540000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.65400000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.65200000000000002},"min":{"1min":0.44900000000000001,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.496,"15min":4.2789999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.50800000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.026},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.748,"15min":0.77100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.72099999999999997}]},{"osd":7,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":2.8900000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.077,"15min":3.9420000000000002},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:12.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:12.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.493+0000 7f3f9999d700 1 Processor -- start 2023-10-10T21:18:12.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.493+0000 7f3f9999d700 1 -- start start 2023-10-10T21:18:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9999d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f94150550 0x7f3f94157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9999d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f940c7410 0x7f3f94069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9999d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9406e2a0 con 0x7f3f94150180 2023-10-10T21:18:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9999d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9406b2e0 con 0x7f3f940c7410 2023-10-10T21:18:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9999d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f940c78e0 con 0x7f3f94150550 2023-10-10T21:18:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9919c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f940c7410 0x7f3f94069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9919c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f940c7410 0x7f3f94069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37366/0 (socket says 172.21.15.154:37366) 2023-10-10T21:18:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9919c700 1 -- 172.21.15.154:0/2011485861 learned_addr learned my addr 172.21.15.154:0/2011485861 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f93fff700 1 --2- 172.21.15.154:0/2011485861 >> v2:172.21.15.179:3300/0 conn(0x7f3f94150550 0x7f3f94157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9919c700 1 -- 172.21.15.154:0/2011485861 >> v2:172.21.15.179:3300/0 conn(0x7f3f94150550 msgr2=0x7f3f94157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:12.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9919c700 1 --2- 172.21.15.154:0/2011485861 >> v2:172.21.15.179:3300/0 conn(0x7f3f94150550 0x7f3f94157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9919c700 1 -- 172.21.15.154:0/2011485861 >> v1:172.21.15.179:6789/0 conn(0x7f3f94150180 legacy=0x7f3f940c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.495+0000 7f3f9919c700 1 -- 172.21.15.154:0/2011485861 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940c7bc0 con 0x7f3f940c7410 2023-10-10T21:18:12.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.496+0000 7f3f9919c700 1 --2- 172.21.15.154:0/2011485861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f940c7410 0x7f3f94069f50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3f9406d1e0 tx=0x7f3f8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748717bad0334cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:12.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.496+0000 7f3f937fe700 1 -- 172.21.15.154:0/2011485861 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00b950 con 0x7f3f940c7410 2023-10-10T21:18:12.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.496+0000 7f3f937fe700 1 -- 172.21.15.154:0/2011485861 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c00bab0 con 0x7f3f940c7410 2023-10-10T21:18:12.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.496+0000 7f3f937fe700 1 -- 172.21.15.154:0/2011485861 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00be70 con 0x7f3f940c7410 2023-10-10T21:18:12.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.496+0000 7f3f9999d700 1 -- 172.21.15.154:0/2011485861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f940c7410 msgr2=0x7f3f94069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.496+0000 7f3f9999d700 1 --2- 172.21.15.154:0/2011485861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f940c7410 0x7f3f94069f50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3f9406d1e0 tx=0x7f3f8c009840 comp rx=0 tx=0).stop 2023-10-10T21:18:12.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.497+0000 7f3f9999d700 1 -- 172.21.15.154:0/2011485861 shutdown_connections 2023-10-10T21:18:12.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.497+0000 7f3f9999d700 1 --2- 172.21.15.154:0/2011485861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f940c7410 0x7f3f94069f50 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.497+0000 7f3f9999d700 1 --2- 172.21.15.154:0/2011485861 >> v2:172.21.15.179:3300/0 conn(0x7f3f94150550 0x7f3f94157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.497+0000 7f3f9999d700 1 -- 172.21.15.154:0/2011485861 >> 172.21.15.154:0/2011485861 conn(0x7f3f940cc1f0 msgr2=0x7f3f940cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:12.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.497+0000 7f3f9999d700 1 -- 172.21.15.154:0/2011485861 shutdown_connections 2023-10-10T21:18:12.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.497+0000 7f3f9999d700 1 -- 172.21.15.154:0/2011485861 wait complete. 2023-10-10T21:18:12.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.498+0000 7f3f9999d700 1 Processor -- start 2023-10-10T21:18:12.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.498+0000 7f3f9999d700 1 -- start start 2023-10-10T21:18:12.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.499+0000 7f3f9999d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f940c7410 0x7f3f9414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.499+0000 7f3f9999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f94150180 0x7f3f94155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.499+0000 7f3f9999d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f94150550 0x7f3f940af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.499+0000 7f3f9999d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940c4c90 con 0x7f3f94150550 2023-10-10T21:18:12.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.499+0000 7f3f9999d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f941560b0 con 0x7f3f940c7410 2023-10-10T21:18:12.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.499+0000 7f3f9999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940c43a0 con 0x7f3f94150180 2023-10-10T21:18:12.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.499+0000 7f3f9919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f94150550 0x7f3f940af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.499+0000 7f3f9919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f94150550 0x7f3f940af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37382/0 (socket says 172.21.15.154:37382) 2023-10-10T21:18:12.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.499+0000 7f3f9919c700 1 -- 172.21.15.154:0/1626888495 learned_addr learned my addr 172.21.15.154:0/1626888495 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:12.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9899b700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f940c7410 0x7f3f9414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9919c700 1 -- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f94150180 msgr2=0x7f3f94155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f93fff700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f94150180 0x7f3f94155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9919c700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f94150180 0x7f3f94155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9919c700 1 -- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f940c7410 msgr2=0x7f3f9414b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9919c700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f940c7410 0x7f3f9414b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9919c700 1 -- 172.21.15.154:0/1626888495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c009ae0 con 0x7f3f94150550 2023-10-10T21:18:12.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9899b700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f940c7410 0x7f3f9414b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:12.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f93fff700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f94150180 0x7f3f94155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:12.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9919c700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f94150550 0x7f3f940af700 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c014000 tx=0x7f3f8c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:12.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f90ff9700 1 -- 172.21.15.154:0/1626888495 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00b950 con 0x7f3f94150550 2023-10-10T21:18:12.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f90ff9700 1 -- 172.21.15.154:0/1626888495 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c019640 con 0x7f3f94150550 2023-10-10T21:18:12.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f90ff9700 1 -- 172.21.15.154:0/1626888495 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c019a00 con 0x7f3f94150550 2023-10-10T21:18:12.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f940c4640 con 0x7f3f94150550 2023-10-10T21:18:12.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.500+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f94169590 con 0x7f3f94150550 2023-10-10T21:18:12.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.501+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f940c4e40 con 0x7f3f94150550 2023-10-10T21:18:12.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.502+0000 7f3f90ff9700 1 -- 172.21.15.154:0/1626888495 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f8c003040 con 0x7f3f94150550 2023-10-10T21:18:12.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.503+0000 7f3f90ff9700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3f78066f30 0x7f3f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.503+0000 7f3f90ff9700 1 -- 172.21.15.154:0/1626888495 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3f8c00e070 con 0x7f3f94150550 2023-10-10T21:18:12.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.503+0000 7f3f9899b700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3f78066f30 0x7f3f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.504+0000 7f3f9899b700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3f78066f30 0x7f3f780693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f940b18d0 tx=0x7f3f88009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:12.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.508+0000 7f3f90ff9700 1 -- 172.21.15.154:0/1626888495 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f940c4e40 con 0x7f3f94150550 2023-10-10T21:18:12.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.693+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f9404c3c0 con 0x7f3f78066f30 2023-10-10T21:18:12.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.702+0000 7f3f90ff9700 1 -- 172.21.15.154:0/1626888495 <== mgr.6531 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289161 (secure 0 0 0) 0x7f3f9404c3c0 con 0x7f3f78066f30 2023-10-10T21:18:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:12.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3f78066f30 msgr2=0x7f3f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3f78066f30 0x7f3f780693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f940b18d0 tx=0x7f3f88009040 comp rx=0 tx=0).stop 2023-10-10T21:18:12.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f94150550 msgr2=0x7f3f940af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f94150550 0x7f3f940af700 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c014000 tx=0x7f3f8c01a000 comp rx=0 tx=0).stop 2023-10-10T21:18:12.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 shutdown_connections 2023-10-10T21:18:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f94150550 0x7f3f940af700 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3f78066f30 0x7f3f780693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f940c7410 0x7f3f9414b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 --2- 172.21.15.154:0/1626888495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f94150180 0x7f3f94155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 >> 172.21.15.154:0/1626888495 conn(0x7f3f940cc1f0 msgr2=0x7f3f941562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 shutdown_connections 2023-10-10T21:18:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.706+0000 7f3f9999d700 1 -- 172.21.15.154:0/1626888495 wait complete. 2023-10-10T21:18:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:12.725 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-10T21:18:10.791704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433608,"kb_used_data":10248,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541112,"statfs":{"total":773094113280,"available":770602098688,"internally_reserved":0,"allocated":10493952,"data_stored":5640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001821"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128453+0000","last_change":"2023-10-10T21:18:03.123147+0000","last_active":"2023-10-10T21:18:03.128453+0000","last_peered":"2023-10-10T21:18:03.128453+0000","last_clean":"2023-10-10T21:18:03.128453+0000","last_became_active":"2023-10-10T21:18:03.122883+0000","last_became_peered":"2023-10-10T21:18:03.122883+0000","last_unstale":"2023-10-10T21:18:03.128453+0000","last_undegraded":"2023-10-10T21:18:03.128453+0000","last_fullsized":"2023-10-10T21:18:03.128453+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:28:36.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129100+0000","last_change":"2023-10-10T21:18:03.124081+0000","last_active":"2023-10-10T21:18:03.129100+0000","last_peered":"2023-10-10T21:18:03.129100+0000","last_clean":"2023-10-10T21:18:03.129100+0000","last_became_active":"2023-10-10T21:18:03.123814+0000","last_became_peered":"2023-10-10T21:18:03.123814+0000","last_unstale":"2023-10-10T21:18:03.129100+0000","last_undegraded":"2023-10-10T21:18:03.129100+0000","last_fullsized":"2023-10-10T21:18:03.129100+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:01.448377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121489+0000","last_change":"2023-10-10T21:18:03.116758+0000","last_active":"2023-10-10T21:18:03.121489+0000","last_peered":"2023-10-10T21:18:03.121489+0000","last_clean":"2023-10-10T21:18:03.121489+0000","last_became_active":"2023-10-10T21:18:03.116472+0000","last_became_peered":"2023-10-10T21:18:03.116472+0000","last_unstale":"2023-10-10T21:18:03.121489+0000","last_undegraded":"2023-10-10T21:18:03.121489+0000","last_fullsized":"2023-10-10T21:18:03.121489+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:26.091130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132434+0000","last_change":"2023-10-10T21:18:03.128869+0000","last_active":"2023-10-10T21:18:03.132434+0000","last_peered":"2023-10-10T21:18:03.132434+0000","last_clean":"2023-10-10T21:18:03.132434+0000","last_became_active":"2023-10-10T21:18:03.128610+0000","last_became_peered":"2023-10-10T21:18:03.128610+0000","last_unstale":"2023-10-10T21:18:03.132434+0000","last_undegraded":"2023-10-10T21:18:03.132434+0000","last_fullsized":"2023-10-10T21:18:03.132434+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:47.801041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.119402+0000","last_change":"2023-10-10T21:18:03.113980+0000","last_active":"2023-10-10T21:18:03.119402+0000","last_peered":"2023-10-10T21:18:03.119402+0000","last_clean":"2023-10-10T21:18:03.119402+0000","last_became_active":"2023-10-10T21:18:03.113689+0000","last_became_peered":"2023-10-10T21:18:03.113689+0000","last_unstale":"2023-10-10T21:18:03.119402+0000","last_undegraded":"2023-10-10T21:18:03.119402+0000","last_fullsized":"2023-10-10T21:18:03.119402+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:22:18.290768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135327+0000","last_change":"2023-10-10T21:18:03.130281+0000","last_active":"2023-10-10T21:18:03.135327+0000","last_peered":"2023-10-10T21:18:03.135327+0000","last_clean":"2023-10-10T21:18:03.135327+0000","last_became_active":"2023-10-10T21:18:03.129862+0000","last_became_peered":"2023-10-10T21:18:03.129862+0000","last_unstale":"2023-10-10T21:18:03.135327+0000","last_undegraded":"2023-10-10T21:18:03.135327+0000","last_fullsized":"2023-10-10T21:18:03.135327+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:07.248053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.123136+0000","last_change":"2023-10-10T21:18:03.115432+0000","last_active":"2023-10-10T21:18:03.123136+0000","last_peered":"2023-10-10T21:18:03.123136+0000","last_clean":"2023-10-10T21:18:03.123136+0000","last_became_active":"2023-10-10T21:18:03.114584+0000","last_became_peered":"2023-10-10T21:18:03.114584+0000","last_unstale":"2023-10-10T21:18:03.123136+0000","last_undegraded":"2023-10-10T21:18:03.123136+0000","last_fullsized":"2023-10-10T21:18:03.123136+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:58.943411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130560+0000","last_change":"2023-10-10T21:18:03.123719+0000","last_active":"2023-10-10T21:18:03.130560+0000","last_peered":"2023-10-10T21:18:03.130560+0000","last_clean":"2023-10-10T21:18:03.130560+0000","last_became_active":"2023-10-10T21:18:03.123411+0000","last_became_peered":"2023-10-10T21:18:03.123411+0000","last_unstale":"2023-10-10T21:18:03.130560+0000","last_undegraded":"2023-10-10T21:18:03.130560+0000","last_fullsized":"2023-10-10T21:18:03.130560+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:49:31.272445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121849+0000","last_change":"2023-10-10T21:18:03.115993+0000","last_active":"2023-10-10T21:18:03.121849+0000","last_peered":"2023-10-10T21:18:03.121849+0000","last_clean":"2023-10-10T21:18:03.121849+0000","last_became_active":"2023-10-10T21:18:03.114933+0000","last_became_peered":"2023-10-10T21:18:03.114933+0000","last_unstale":"2023-10-10T21:18:03.121849+0000","last_undegraded":"2023-10-10T21:18:03.121849+0000","last_fullsized":"2023-10-10T21:18:03.121849+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:09.169541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120078+0000","last_change":"2023-10-10T21:18:03.116446+0000","last_active":"2023-10-10T21:18:03.120078+0000","last_peered":"2023-10-10T21:18:03.120078+0000","last_clean":"2023-10-10T21:18:03.120078+0000","last_became_active":"2023-10-10T21:18:03.116170+0000","last_became_peered":"2023-10-10T21:18:03.116170+0000","last_unstale":"2023-10-10T21:18:03.120078+0000","last_undegraded":"2023-10-10T21:18:03.120078+0000","last_fullsized":"2023-10-10T21:18:03.120078+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:11:20.228457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126153+0000","last_change":"2023-10-10T21:18:03.122782+0000","last_active":"2023-10-10T21:18:03.126153+0000","last_peered":"2023-10-10T21:18:03.126153+0000","last_clean":"2023-10-10T21:18:03.126153+0000","last_became_active":"2023-10-10T21:18:03.122522+0000","last_became_peered":"2023-10-10T21:18:03.122522+0000","last_unstale":"2023-10-10T21:18:03.126153+0000","last_undegraded":"2023-10-10T21:18:03.126153+0000","last_fullsized":"2023-10-10T21:18:03.126153+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:16.215761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118425+0000","last_change":"2023-10-10T21:18:03.114857+0000","last_active":"2023-10-10T21:18:03.118425+0000","last_peered":"2023-10-10T21:18:03.118425+0000","last_clean":"2023-10-10T21:18:03.118425+0000","last_became_active":"2023-10-10T21:18:03.114601+0000","last_became_peered":"2023-10-10T21:18:03.114601+0000","last_unstale":"2023-10-10T21:18:03.118425+0000","last_undegraded":"2023-10-10T21:18:03.118425+0000","last_fullsized":"2023-10-10T21:18:03.118425+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:43.812657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124840+0000","last_change":"2023-10-10T21:18:03.124241+0000","last_active":"2023-10-10T21:18:03.124840+0000","last_peered":"2023-10-10T21:18:03.124840+0000","last_clean":"2023-10-10T21:18:03.124840+0000","last_became_active":"2023-10-10T21:18:03.123943+0000","last_became_peered":"2023-10-10T21:18:03.123943+0000","last_unstale":"2023-10-10T21:18:03.124840+0000","last_undegraded":"2023-10-10T21:18:03.124840+0000","last_fullsized":"2023-10-10T21:18:03.124840+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115678+0000","last_change":"2023-10-10T21:18:03.111549+0000","last_active":"2023-10-10T21:18:03.115678+0000","last_peered":"2023-10-10T21:18:03.115678+0000","last_clean":"2023-10-10T21:18:03.115678+0000","last_became_active":"2023-10-10T21:18:03.111171+0000","last_became_peered":"2023-10-10T21:18:03.111171+0000","last_unstale":"2023-10-10T21:18:03.115678+0000","last_undegraded":"2023-10-10T21:18:03.115678+0000","last_fullsized":"2023-10-10T21:18:03.115678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:48:55.981597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118815+0000","last_change":"2023-10-10T21:18:03.113743+0000","last_active":"2023-10-10T21:18:03.118815+0000","last_peered":"2023-10-10T21:18:03.118815+0000","last_clean":"2023-10-10T21:18:03.118815+0000","last_became_active":"2023-10-10T21:18:03.113483+0000","last_became_peered":"2023-10-10T21:18:03.113483+0000","last_unstale":"2023-10-10T21:18:03.118815+0000","last_undegraded":"2023-10-10T21:18:03.118815+0000","last_fullsized":"2023-10-10T21:18:03.118815+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:48.507042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135387+0000","last_change":"2023-10-10T21:18:03.133411+0000","last_active":"2023-10-10T21:18:03.135387+0000","last_peered":"2023-10-10T21:18:03.135387+0000","last_clean":"2023-10-10T21:18:03.135387+0000","last_became_active":"2023-10-10T21:18:03.133113+0000","last_became_peered":"2023-10-10T21:18:03.133113+0000","last_unstale":"2023-10-10T21:18:03.135387+0000","last_undegraded":"2023-10-10T21:18:03.135387+0000","last_fullsized":"2023-10-10T21:18:03.135387+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:07:30.524167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121779+0000","last_change":"2023-10-10T21:18:03.115176+0000","last_active":"2023-10-10T21:18:03.121779+0000","last_peered":"2023-10-10T21:18:03.121779+0000","last_clean":"2023-10-10T21:18:03.121779+0000","last_became_active":"2023-10-10T21:18:03.114425+0000","last_became_peered":"2023-10-10T21:18:03.114425+0000","last_unstale":"2023-10-10T21:18:03.121779+0000","last_undegraded":"2023-10-10T21:18:03.121779+0000","last_fullsized":"2023-10-10T21:18:03.121779+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:14:30.856134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132619+0000","last_change":"2023-10-10T21:18:03.128819+0000","last_active":"2023-10-10T21:18:03.132619+0000","last_peered":"2023-10-10T21:18:03.132619+0000","last_clean":"2023-10-10T21:18:03.132619+0000","last_became_active":"2023-10-10T21:18:03.128567+0000","last_became_peered":"2023-10-10T21:18:03.128567+0000","last_unstale":"2023-10-10T21:18:03.132619+0000","last_undegraded":"2023-10-10T21:18:03.132619+0000","last_fullsized":"2023-10-10T21:18:03.132619+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:01:23.478813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130419+0000","last_change":"2023-10-10T21:18:03.122999+0000","last_active":"2023-10-10T21:18:03.130419+0000","last_peered":"2023-10-10T21:18:03.130419+0000","last_clean":"2023-10-10T21:18:03.130419+0000","last_became_active":"2023-10-10T21:18:03.121360+0000","last_became_peered":"2023-10-10T21:18:03.121360+0000","last_unstale":"2023-10-10T21:18:03.130419+0000","last_undegraded":"2023-10-10T21:18:03.130419+0000","last_fullsized":"2023-10-10T21:18:03.130419+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:44:28.722321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.114086+0000","last_change":"2023-10-10T21:18:03.109240+0000","last_active":"2023-10-10T21:18:03.114086+0000","last_peered":"2023-10-10T21:18:03.114086+0000","last_clean":"2023-10-10T21:18:03.114086+0000","last_became_active":"2023-10-10T21:18:03.108970+0000","last_became_peered":"2023-10-10T21:18:03.108970+0000","last_unstale":"2023-10-10T21:18:03.114086+0000","last_undegraded":"2023-10-10T21:18:03.114086+0000","last_fullsized":"2023-10-10T21:18:03.114086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:51:48.404639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124382+0000","last_change":"2023-10-10T21:18:03.117935+0000","last_active":"2023-10-10T21:18:03.124382+0000","last_peered":"2023-10-10T21:18:03.124382+0000","last_clean":"2023-10-10T21:18:03.124382+0000","last_became_active":"2023-10-10T21:18:03.117552+0000","last_became_peered":"2023-10-10T21:18:03.117552+0000","last_unstale":"2023-10-10T21:18:03.124382+0000","last_undegraded":"2023-10-10T21:18:03.124382+0000","last_fullsized":"2023-10-10T21:18:03.124382+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:24:39.255862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.122399+0000","last_change":"2023-10-10T21:18:03.113509+0000","last_active":"2023-10-10T21:18:03.122399+0000","last_peered":"2023-10-10T21:18:03.122399+0000","last_clean":"2023-10-10T21:18:03.122399+0000","last_became_active":"2023-10-10T21:18:03.113227+0000","last_became_peered":"2023-10-10T21:18:03.113227+0000","last_unstale":"2023-10-10T21:18:03.122399+0000","last_undegraded":"2023-10-10T21:18:03.122399+0000","last_fullsized":"2023-10-10T21:18:03.122399+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:19:10.967416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129924+0000","last_change":"2023-10-10T21:18:03.126424+0000","last_active":"2023-10-10T21:18:03.129924+0000","last_peered":"2023-10-10T21:18:03.129924+0000","last_clean":"2023-10-10T21:18:03.129924+0000","last_became_active":"2023-10-10T21:18:03.125673+0000","last_became_peered":"2023-10-10T21:18:03.125673+0000","last_unstale":"2023-10-10T21:18:03.129924+0000","last_undegraded":"2023-10-10T21:18:03.129924+0000","last_fullsized":"2023-10-10T21:18:03.129924+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:22.538251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138071+0000","last_change":"2023-10-10T21:18:03.136560+0000","last_active":"2023-10-10T21:18:03.138071+0000","last_peered":"2023-10-10T21:18:03.138071+0000","last_clean":"2023-10-10T21:18:03.138071+0000","last_became_active":"2023-10-10T21:18:03.136301+0000","last_became_peered":"2023-10-10T21:18:03.136301+0000","last_unstale":"2023-10-10T21:18:03.138071+0000","last_undegraded":"2023-10-10T21:18:03.138071+0000","last_fullsized":"2023-10-10T21:18:03.138071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:10.463301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128656+0000","last_change":"2023-10-10T21:18:03.125260+0000","last_active":"2023-10-10T21:18:03.128656+0000","last_peered":"2023-10-10T21:18:03.128656+0000","last_clean":"2023-10-10T21:18:03.128656+0000","last_became_active":"2023-10-10T21:18:03.124986+0000","last_became_peered":"2023-10-10T21:18:03.124986+0000","last_unstale":"2023-10-10T21:18:03.128656+0000","last_undegraded":"2023-10-10T21:18:03.128656+0000","last_fullsized":"2023-10-10T21:18:03.128656+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:28:14.399113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126107+0000","last_change":"2023-10-10T21:18:03.125426+0000","last_active":"2023-10-10T21:18:03.126107+0000","last_peered":"2023-10-10T21:18:03.126107+0000","last_clean":"2023-10-10T21:18:03.126107+0000","last_became_active":"2023-10-10T21:18:03.125136+0000","last_became_peered":"2023-10-10T21:18:03.125136+0000","last_unstale":"2023-10-10T21:18:03.126107+0000","last_undegraded":"2023-10-10T21:18:03.126107+0000","last_fullsized":"2023-10-10T21:18:03.126107+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:05:17.246909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121625+0000","last_change":"2023-10-10T21:18:03.118901+0000","last_active":"2023-10-10T21:18:03.121625+0000","last_peered":"2023-10-10T21:18:03.121625+0000","last_clean":"2023-10-10T21:18:03.121625+0000","last_became_active":"2023-10-10T21:18:03.118655+0000","last_became_peered":"2023-10-10T21:18:03.118655+0000","last_unstale":"2023-10-10T21:18:03.121625+0000","last_undegraded":"2023-10-10T21:18:03.121625+0000","last_fullsized":"2023-10-10T21:18:03.121625+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:35:55.138638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125083+0000","last_change":"2023-10-10T21:18:03.121035+0000","last_active":"2023-10-10T21:18:03.125083+0000","last_peered":"2023-10-10T21:18:03.125083+0000","last_clean":"2023-10-10T21:18:03.125083+0000","last_became_active":"2023-10-10T21:18:03.120773+0000","last_became_peered":"2023-10-10T21:18:03.120773+0000","last_unstale":"2023-10-10T21:18:03.125083+0000","last_undegraded":"2023-10-10T21:18:03.125083+0000","last_fullsized":"2023-10-10T21:18:03.125083+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:14.654306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121369+0000","last_change":"2023-10-10T21:18:03.115215+0000","last_active":"2023-10-10T21:18:03.121369+0000","last_peered":"2023-10-10T21:18:03.121369+0000","last_clean":"2023-10-10T21:18:03.121369+0000","last_became_active":"2023-10-10T21:18:03.114868+0000","last_became_peered":"2023-10-10T21:18:03.114868+0000","last_unstale":"2023-10-10T21:18:03.121369+0000","last_undegraded":"2023-10-10T21:18:03.121369+0000","last_fullsized":"2023-10-10T21:18:03.121369+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:21:05.639479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.128273+0000","last_change":"2023-10-10T21:18:03.126778+0000","last_active":"2023-10-10T21:18:03.128273+0000","last_peered":"2023-10-10T21:18:03.128273+0000","last_clean":"2023-10-10T21:18:03.128273+0000","last_became_active":"2023-10-10T21:18:03.126481+0000","last_became_peered":"2023-10-10T21:18:03.126481+0000","last_unstale":"2023-10-10T21:18:03.128273+0000","last_undegraded":"2023-10-10T21:18:03.128273+0000","last_fullsized":"2023-10-10T21:18:03.128273+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:24:39.255862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.123156+0000","last_change":"2023-10-10T21:18:03.115975+0000","last_active":"2023-10-10T21:18:03.123156+0000","last_peered":"2023-10-10T21:18:03.123156+0000","last_clean":"2023-10-10T21:18:03.123156+0000","last_became_active":"2023-10-10T21:18:03.115708+0000","last_became_peered":"2023-10-10T21:18:03.115708+0000","last_unstale":"2023-10-10T21:18:03.123156+0000","last_undegraded":"2023-10-10T21:18:03.123156+0000","last_fullsized":"2023-10-10T21:18:03.123156+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:11:20.228457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.131751+0000","last_change":"2023-10-10T21:18:03.129530+0000","last_active":"2023-10-10T21:18:03.131751+0000","last_peered":"2023-10-10T21:18:03.131751+0000","last_clean":"2023-10-10T21:18:03.131751+0000","last_became_active":"2023-10-10T21:18:03.126001+0000","last_became_peered":"2023-10-10T21:18:03.126001+0000","last_unstale":"2023-10-10T21:18:03.131751+0000","last_undegraded":"2023-10-10T21:18:03.131751+0000","last_fullsized":"2023-10-10T21:18:03.131751+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:43:38.716874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129609+0000","last_change":"2023-10-10T21:18:03.126162+0000","last_active":"2023-10-10T21:18:03.129609+0000","last_peered":"2023-10-10T21:18:03.129609+0000","last_clean":"2023-10-10T21:18:03.129609+0000","last_became_active":"2023-10-10T21:18:03.125841+0000","last_became_peered":"2023-10-10T21:18:03.125841+0000","last_unstale":"2023-10-10T21:18:03.129609+0000","last_undegraded":"2023-10-10T21:18:03.129609+0000","last_fullsized":"2023-10-10T21:18:03.129609+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:21.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"94'4","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138188+0000","last_change":"2023-10-10T21:18:02.102666+0000","last_active":"2023-10-10T21:18:03.138188+0000","last_peered":"2023-10-10T21:18:03.138188+0000","last_clean":"2023-10-10T21:18:03.138188+0000","last_became_active":"2023-10-10T21:18:02.102354+0000","last_became_peered":"2023-10-10T21:18:02.102354+0000","last_unstale":"2023-10-10T21:18:03.138188+0000","last_undegraded":"2023-10-10T21:18:03.138188+0000","last_fullsized":"2023-10-10T21:18:03.138188+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121828+0000","last_change":"2023-10-10T21:18:03.115827+0000","last_active":"2023-10-10T21:18:03.121828+0000","last_peered":"2023-10-10T21:18:03.121828+0000","last_clean":"2023-10-10T21:18:03.121828+0000","last_became_active":"2023-10-10T21:18:03.114749+0000","last_became_peered":"2023-10-10T21:18:03.114749+0000","last_unstale":"2023-10-10T21:18:03.121828+0000","last_undegraded":"2023-10-10T21:18:03.121828+0000","last_fullsized":"2023-10-10T21:18:03.121828+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:25.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135289+0000","last_change":"2023-10-10T21:18:02.104346+0000","last_active":"2023-10-10T21:18:03.135289+0000","last_peered":"2023-10-10T21:18:03.135289+0000","last_clean":"2023-10-10T21:18:03.135289+0000","last_became_active":"2023-10-10T21:18:02.104087+0000","last_became_peered":"2023-10-10T21:18:02.104087+0000","last_unstale":"2023-10-10T21:18:03.135289+0000","last_undegraded":"2023-10-10T21:18:03.135289+0000","last_fullsized":"2023-10-10T21:18:03.135289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135285+0000","last_change":"2023-10-10T21:18:03.131611+0000","last_active":"2023-10-10T21:18:03.135285+0000","last_peered":"2023-10-10T21:18:03.135285+0000","last_clean":"2023-10-10T21:18:03.135285+0000","last_became_active":"2023-10-10T21:18:03.131293+0000","last_became_peered":"2023-10-10T21:18:03.131293+0000","last_unstale":"2023-10-10T21:18:03.135285+0000","last_undegraded":"2023-10-10T21:18:03.135285+0000","last_fullsized":"2023-10-10T21:18:03.135285+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:34:05.657811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140721+0000","last_change":"2023-10-10T21:18:02.115690+0000","last_active":"2023-10-10T21:18:03.140721+0000","last_peered":"2023-10-10T21:18:03.140721+0000","last_clean":"2023-10-10T21:18:03.140721+0000","last_became_active":"2023-10-10T21:18:02.115385+0000","last_became_peered":"2023-10-10T21:18:02.115385+0000","last_unstale":"2023-10-10T21:18:03.140721+0000","last_undegraded":"2023-10-10T21:18:03.140721+0000","last_fullsized":"2023-10-10T21:18:03.140721+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:00.443737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124744+0000","last_change":"2023-10-10T21:18:03.117499+0000","last_active":"2023-10-10T21:18:03.124744+0000","last_peered":"2023-10-10T21:18:03.124744+0000","last_clean":"2023-10-10T21:18:03.124744+0000","last_became_active":"2023-10-10T21:18:03.117056+0000","last_became_peered":"2023-10-10T21:18:03.117056+0000","last_unstale":"2023-10-10T21:18:03.124744+0000","last_undegraded":"2023-10-10T21:18:03.124744+0000","last_fullsized":"2023-10-10T21:18:03.124744+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:13.261240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.138765+0000","last_change":"2023-10-10T21:18:02.115455+0000","last_active":"2023-10-10T21:18:03.138765+0000","last_peered":"2023-10-10T21:18:03.138765+0000","last_clean":"2023-10-10T21:18:03.138765+0000","last_became_active":"2023-10-10T21:18:02.115102+0000","last_became_peered":"2023-10-10T21:18:02.115102+0000","last_unstale":"2023-10-10T21:18:03.138765+0000","last_undegraded":"2023-10-10T21:18:03.138765+0000","last_fullsized":"2023-10-10T21:18:03.138765+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:00:04.031693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.122533+0000","last_change":"2023-10-10T21:18:03.117395+0000","last_active":"2023-10-10T21:18:03.122533+0000","last_peered":"2023-10-10T21:18:03.122533+0000","last_clean":"2023-10-10T21:18:03.122533+0000","last_became_active":"2023-10-10T21:18:03.117065+0000","last_became_peered":"2023-10-10T21:18:03.117065+0000","last_unstale":"2023-10-10T21:18:03.122533+0000","last_undegraded":"2023-10-10T21:18:03.122533+0000","last_fullsized":"2023-10-10T21:18:03.122533+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:19:10.967416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.132671+0000","last_change":"2023-10-10T21:18:02.105454+0000","last_active":"2023-10-10T21:18:03.132671+0000","last_peered":"2023-10-10T21:18:03.132671+0000","last_clean":"2023-10-10T21:18:03.132671+0000","last_became_active":"2023-10-10T21:18:02.104962+0000","last_became_peered":"2023-10-10T21:18:02.104962+0000","last_unstale":"2023-10-10T21:18:03.132671+0000","last_undegraded":"2023-10-10T21:18:03.132671+0000","last_fullsized":"2023-10-10T21:18:03.132671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:42.291687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130936+0000","last_change":"2023-10-10T21:18:03.127926+0000","last_active":"2023-10-10T21:18:03.130936+0000","last_peered":"2023-10-10T21:18:03.130936+0000","last_clean":"2023-10-10T21:18:03.130936+0000","last_became_active":"2023-10-10T21:18:03.127034+0000","last_became_peered":"2023-10-10T21:18:03.127034+0000","last_unstale":"2023-10-10T21:18:03.130936+0000","last_undegraded":"2023-10-10T21:18:03.130936+0000","last_fullsized":"2023-10-10T21:18:03.130936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:05:17.246909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.139849+0000","last_change":"2023-10-10T21:18:02.114944+0000","last_active":"2023-10-10T21:18:03.139849+0000","last_peered":"2023-10-10T21:18:03.139849+0000","last_clean":"2023-10-10T21:18:03.139849+0000","last_became_active":"2023-10-10T21:18:02.114633+0000","last_became_peered":"2023-10-10T21:18:02.114633+0000","last_unstale":"2023-10-10T21:18:03.139849+0000","last_undegraded":"2023-10-10T21:18:03.139849+0000","last_fullsized":"2023-10-10T21:18:03.139849+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:34:55.249703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124869+0000","last_change":"2023-10-10T21:18:03.122508+0000","last_active":"2023-10-10T21:18:03.124869+0000","last_peered":"2023-10-10T21:18:03.124869+0000","last_clean":"2023-10-10T21:18:03.124869+0000","last_became_active":"2023-10-10T21:18:03.122245+0000","last_became_peered":"2023-10-10T21:18:03.122245+0000","last_unstale":"2023-10-10T21:18:03.124869+0000","last_undegraded":"2023-10-10T21:18:03.124869+0000","last_fullsized":"2023-10-10T21:18:03.124869+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:41.065339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104533+0000","last_change":"2023-10-10T21:18:02.112370+0000","last_active":"2023-10-10T21:18:03.104533+0000","last_peered":"2023-10-10T21:18:03.104533+0000","last_clean":"2023-10-10T21:18:03.104533+0000","last_became_active":"2023-10-10T21:18:02.112099+0000","last_became_peered":"2023-10-10T21:18:02.112099+0000","last_unstale":"2023-10-10T21:18:03.104533+0000","last_undegraded":"2023-10-10T21:18:03.104533+0000","last_fullsized":"2023-10-10T21:18:03.104533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:03.288893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121084+0000","last_change":"2023-10-10T21:18:03.118553+0000","last_active":"2023-10-10T21:18:03.121084+0000","last_peered":"2023-10-10T21:18:03.121084+0000","last_clean":"2023-10-10T21:18:03.121084+0000","last_became_active":"2023-10-10T21:18:03.118289+0000","last_became_peered":"2023-10-10T21:18:03.118289+0000","last_unstale":"2023-10-10T21:18:03.121084+0000","last_undegraded":"2023-10-10T21:18:03.121084+0000","last_fullsized":"2023-10-10T21:18:03.121084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:07:05.319721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105764+0000","last_change":"2023-10-10T21:18:02.103988+0000","last_active":"2023-10-10T21:18:03.105764+0000","last_peered":"2023-10-10T21:18:03.105764+0000","last_clean":"2023-10-10T21:18:03.105764+0000","last_became_active":"2023-10-10T21:18:02.103709+0000","last_became_peered":"2023-10-10T21:18:02.103709+0000","last_unstale":"2023-10-10T21:18:03.105764+0000","last_undegraded":"2023-10-10T21:18:03.105764+0000","last_fullsized":"2023-10-10T21:18:03.105764+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:43.528613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.122566+0000","last_change":"2023-10-10T21:18:03.115125+0000","last_active":"2023-10-10T21:18:03.122566+0000","last_peered":"2023-10-10T21:18:03.122566+0000","last_clean":"2023-10-10T21:18:03.122566+0000","last_became_active":"2023-10-10T21:18:03.114782+0000","last_became_peered":"2023-10-10T21:18:03.114782+0000","last_unstale":"2023-10-10T21:18:03.122566+0000","last_undegraded":"2023-10-10T21:18:03.122566+0000","last_fullsized":"2023-10-10T21:18:03.122566+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:14.654306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105952+0000","last_change":"2023-10-10T21:18:02.097199+0000","last_active":"2023-10-10T21:18:03.105952+0000","last_peered":"2023-10-10T21:18:03.105952+0000","last_clean":"2023-10-10T21:18:03.105952+0000","last_became_active":"2023-10-10T21:18:02.096924+0000","last_became_peered":"2023-10-10T21:18:02.096924+0000","last_unstale":"2023-10-10T21:18:03.105952+0000","last_undegraded":"2023-10-10T21:18:03.105952+0000","last_fullsized":"2023-10-10T21:18:03.105952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:42.119227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137096+0000","last_change":"2023-10-10T21:18:03.134927+0000","last_active":"2023-10-10T21:18:03.137096+0000","last_peered":"2023-10-10T21:18:03.137096+0000","last_clean":"2023-10-10T21:18:03.137096+0000","last_became_active":"2023-10-10T21:18:03.134663+0000","last_became_peered":"2023-10-10T21:18:03.134663+0000","last_unstale":"2023-10-10T21:18:03.137096+0000","last_undegraded":"2023-10-10T21:18:03.137096+0000","last_fullsized":"2023-10-10T21:18:03.137096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:02:50.568864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115156+0000","last_change":"2023-10-10T21:18:02.114063+0000","last_active":"2023-10-10T21:18:03.115156+0000","last_peered":"2023-10-10T21:18:03.115156+0000","last_clean":"2023-10-10T21:18:03.115156+0000","last_became_active":"2023-10-10T21:18:02.113482+0000","last_became_peered":"2023-10-10T21:18:02.113482+0000","last_unstale":"2023-10-10T21:18:03.115156+0000","last_undegraded":"2023-10-10T21:18:03.115156+0000","last_fullsized":"2023-10-10T21:18:03.115156+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:12.635697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135263+0000","last_change":"2023-10-10T21:18:03.130251+0000","last_active":"2023-10-10T21:18:03.135263+0000","last_peered":"2023-10-10T21:18:03.135263+0000","last_clean":"2023-10-10T21:18:03.135263+0000","last_became_active":"2023-10-10T21:18:03.129958+0000","last_became_peered":"2023-10-10T21:18:03.129958+0000","last_unstale":"2023-10-10T21:18:03.135263+0000","last_undegraded":"2023-10-10T21:18:03.135263+0000","last_fullsized":"2023-10-10T21:18:03.135263+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:43.123867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"94'3","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135167+0000","last_change":"2023-10-10T21:18:02.112911+0000","last_active":"2023-10-10T21:18:03.135167+0000","last_peered":"2023-10-10T21:18:03.135167+0000","last_clean":"2023-10-10T21:18:03.135167+0000","last_became_active":"2023-10-10T21:18:02.112580+0000","last_became_peered":"2023-10-10T21:18:02.112580+0000","last_unstale":"2023-10-10T21:18:03.135167+0000","last_undegraded":"2023-10-10T21:18:03.135167+0000","last_fullsized":"2023-10-10T21:18:03.135167+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:49:28.212088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120562+0000","last_change":"2023-10-10T21:18:03.114601+0000","last_active":"2023-10-10T21:18:03.120562+0000","last_peered":"2023-10-10T21:18:03.120562+0000","last_clean":"2023-10-10T21:18:03.120562+0000","last_became_active":"2023-10-10T21:18:03.114335+0000","last_became_peered":"2023-10-10T21:18:03.114335+0000","last_unstale":"2023-10-10T21:18:03.120562+0000","last_undegraded":"2023-10-10T21:18:03.120562+0000","last_fullsized":"2023-10-10T21:18:03.120562+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:59:51.773918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"94'6","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.137510+0000","last_change":"2023-10-10T21:18:02.104756+0000","last_active":"2023-10-10T21:18:03.137510+0000","last_peered":"2023-10-10T21:18:03.137510+0000","last_clean":"2023-10-10T21:18:03.137510+0000","last_became_active":"2023-10-10T21:18:02.104493+0000","last_became_peered":"2023-10-10T21:18:02.104493+0000","last_unstale":"2023-10-10T21:18:03.137510+0000","last_undegraded":"2023-10-10T21:18:03.137510+0000","last_fullsized":"2023-10-10T21:18:03.137510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:29:40.211849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127583+0000","last_change":"2023-10-10T21:18:03.123287+0000","last_active":"2023-10-10T21:18:03.127583+0000","last_peered":"2023-10-10T21:18:03.127583+0000","last_clean":"2023-10-10T21:18:03.127583+0000","last_became_active":"2023-10-10T21:18:03.121920+0000","last_became_peered":"2023-10-10T21:18:03.121920+0000","last_unstale":"2023-10-10T21:18:03.127583+0000","last_undegraded":"2023-10-10T21:18:03.127583+0000","last_fullsized":"2023-10-10T21:18:03.127583+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130881+0000","last_change":"2023-10-10T21:18:02.105096+0000","last_active":"2023-10-10T21:18:03.130881+0000","last_peered":"2023-10-10T21:18:03.130881+0000","last_clean":"2023-10-10T21:18:03.130881+0000","last_became_active":"2023-10-10T21:18:02.104823+0000","last_became_peered":"2023-10-10T21:18:02.104823+0000","last_unstale":"2023-10-10T21:18:03.130881+0000","last_undegraded":"2023-10-10T21:18:03.130881+0000","last_fullsized":"2023-10-10T21:18:03.130881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:23.810550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.110608+0000","last_change":"2023-10-10T21:18:03.109711+0000","last_active":"2023-10-10T21:18:03.110608+0000","last_peered":"2023-10-10T21:18:03.110608+0000","last_clean":"2023-10-10T21:18:03.110608+0000","last_became_active":"2023-10-10T21:18:03.109421+0000","last_became_peered":"2023-10-10T21:18:03.109421+0000","last_unstale":"2023-10-10T21:18:03.110608+0000","last_undegraded":"2023-10-10T21:18:03.110608+0000","last_fullsized":"2023-10-10T21:18:03.110608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:53.044728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121482+0000","last_change":"2023-10-10T21:18:02.110191+0000","last_active":"2023-10-10T21:18:03.121482+0000","last_peered":"2023-10-10T21:18:03.121482+0000","last_clean":"2023-10-10T21:18:03.121482+0000","last_became_active":"2023-10-10T21:18:02.109924+0000","last_became_peered":"2023-10-10T21:18:02.109924+0000","last_unstale":"2023-10-10T21:18:03.121482+0000","last_undegraded":"2023-10-10T21:18:03.121482+0000","last_fullsized":"2023-10-10T21:18:03.121482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:23:29.367513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.125859+0000","last_change":"2023-10-10T21:18:03.125107+0000","last_active":"2023-10-10T21:18:03.125859+0000","last_peered":"2023-10-10T21:18:03.125859+0000","last_clean":"2023-10-10T21:18:03.125859+0000","last_became_active":"2023-10-10T21:18:03.124825+0000","last_became_peered":"2023-10-10T21:18:03.124825+0000","last_unstale":"2023-10-10T21:18:03.125859+0000","last_undegraded":"2023-10-10T21:18:03.125859+0000","last_fullsized":"2023-10-10T21:18:03.125859+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:43:12.321335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105063+0000","last_change":"2023-10-10T21:18:02.104851+0000","last_active":"2023-10-10T21:18:03.105063+0000","last_peered":"2023-10-10T21:18:03.105063+0000","last_clean":"2023-10-10T21:18:03.105063+0000","last_became_active":"2023-10-10T21:18:02.104566+0000","last_became_peered":"2023-10-10T21:18:02.104566+0000","last_unstale":"2023-10-10T21:18:03.105063+0000","last_undegraded":"2023-10-10T21:18:03.105063+0000","last_fullsized":"2023-10-10T21:18:03.105063+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:37:00.443737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120796+0000","last_change":"2023-10-10T21:18:03.114682+0000","last_active":"2023-10-10T21:18:03.120796+0000","last_peered":"2023-10-10T21:18:03.120796+0000","last_clean":"2023-10-10T21:18:03.120796+0000","last_became_active":"2023-10-10T21:18:03.114394+0000","last_became_peered":"2023-10-10T21:18:03.114394+0000","last_unstale":"2023-10-10T21:18:03.120796+0000","last_undegraded":"2023-10-10T21:18:03.120796+0000","last_fullsized":"2023-10-10T21:18:03.120796+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:57.025855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"94'8","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.141200+0000","last_change":"2023-10-10T21:18:02.106816+0000","last_active":"2023-10-10T21:18:03.141200+0000","last_peered":"2023-10-10T21:18:03.141200+0000","last_clean":"2023-10-10T21:18:03.141200+0000","last_became_active":"2023-10-10T21:18:02.106514+0000","last_became_peered":"2023-10-10T21:18:02.106514+0000","last_unstale":"2023-10-10T21:18:03.141200+0000","last_undegraded":"2023-10-10T21:18:03.141200+0000","last_fullsized":"2023-10-10T21:18:03.141200+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:42:06.243413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.123938+0000","last_change":"2023-10-10T21:18:03.118958+0000","last_active":"2023-10-10T21:18:03.123938+0000","last_peered":"2023-10-10T21:18:03.123938+0000","last_clean":"2023-10-10T21:18:03.123938+0000","last_became_active":"2023-10-10T21:18:03.118715+0000","last_became_peered":"2023-10-10T21:18:03.118715+0000","last_unstale":"2023-10-10T21:18:03.123938+0000","last_undegraded":"2023-10-10T21:18:03.123938+0000","last_fullsized":"2023-10-10T21:18:03.123938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:53.044728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.139587+0000","last_change":"2023-10-10T21:18:02.115240+0000","last_active":"2023-10-10T21:18:03.139587+0000","last_peered":"2023-10-10T21:18:03.139587+0000","last_clean":"2023-10-10T21:18:03.139587+0000","last_became_active":"2023-10-10T21:18:02.114964+0000","last_became_peered":"2023-10-10T21:18:02.114964+0000","last_unstale":"2023-10-10T21:18:03.139587+0000","last_undegraded":"2023-10-10T21:18:03.139587+0000","last_fullsized":"2023-10-10T21:18:03.139587+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:06:22.364093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124747+0000","last_change":"2023-10-10T21:18:03.118846+0000","last_active":"2023-10-10T21:18:03.124747+0000","last_peered":"2023-10-10T21:18:03.124747+0000","last_clean":"2023-10-10T21:18:03.124747+0000","last_became_active":"2023-10-10T21:18:03.118599+0000","last_became_peered":"2023-10-10T21:18:03.118599+0000","last_unstale":"2023-10-10T21:18:03.124747+0000","last_undegraded":"2023-10-10T21:18:03.124747+0000","last_fullsized":"2023-10-10T21:18:03.124747+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:05:45.905044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140786+0000","last_change":"2023-10-10T21:18:02.116376+0000","last_active":"2023-10-10T21:18:03.140786+0000","last_peered":"2023-10-10T21:18:03.140786+0000","last_clean":"2023-10-10T21:18:03.140786+0000","last_became_active":"2023-10-10T21:18:02.115966+0000","last_became_peered":"2023-10-10T21:18:02.115966+0000","last_unstale":"2023-10-10T21:18:03.140786+0000","last_undegraded":"2023-10-10T21:18:03.140786+0000","last_fullsized":"2023-10-10T21:18:03.140786+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:49:30.267805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118446+0000","last_change":"2023-10-10T21:18:03.115328+0000","last_active":"2023-10-10T21:18:03.118446+0000","last_peered":"2023-10-10T21:18:03.118446+0000","last_clean":"2023-10-10T21:18:03.118446+0000","last_became_active":"2023-10-10T21:18:03.115038+0000","last_became_peered":"2023-10-10T21:18:03.115038+0000","last_unstale":"2023-10-10T21:18:03.118446+0000","last_undegraded":"2023-10-10T21:18:03.118446+0000","last_fullsized":"2023-10-10T21:18:03.118446+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:00:05.036333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.141238+0000","last_change":"2023-10-10T21:18:02.109700+0000","last_active":"2023-10-10T21:18:03.141238+0000","last_peered":"2023-10-10T21:18:03.141238+0000","last_clean":"2023-10-10T21:18:03.141238+0000","last_became_active":"2023-10-10T21:18:02.109482+0000","last_became_peered":"2023-10-10T21:18:02.109482+0000","last_unstale":"2023-10-10T21:18:03.141238+0000","last_undegraded":"2023-10-10T21:18:03.141238+0000","last_fullsized":"2023-10-10T21:18:03.141238+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:39.469469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.127345+0000","last_change":"2023-10-10T21:18:03.126599+0000","last_active":"2023-10-10T21:18:03.127345+0000","last_peered":"2023-10-10T21:18:03.127345+0000","last_clean":"2023-10-10T21:18:03.127345+0000","last_became_active":"2023-10-10T21:18:03.126259+0000","last_became_peered":"2023-10-10T21:18:03.126259+0000","last_unstale":"2023-10-10T21:18:03.127345+0000","last_undegraded":"2023-10-10T21:18:03.127345+0000","last_fullsized":"2023-10-10T21:18:03.127345+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:27.054207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.106797+0000","last_change":"2023-10-10T21:18:02.112963+0000","last_active":"2023-10-10T21:18:03.106797+0000","last_peered":"2023-10-10T21:18:03.106797+0000","last_clean":"2023-10-10T21:18:03.106797+0000","last_became_active":"2023-10-10T21:18:02.112670+0000","last_became_peered":"2023-10-10T21:18:02.112670+0000","last_unstale":"2023-10-10T21:18:03.106797+0000","last_undegraded":"2023-10-10T21:18:03.106797+0000","last_fullsized":"2023-10-10T21:18:03.106797+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:22:57.938771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121389+0000","last_change":"2023-10-10T21:18:03.115159+0000","last_active":"2023-10-10T21:18:03.121389+0000","last_peered":"2023-10-10T21:18:03.121389+0000","last_clean":"2023-10-10T21:18:03.121389+0000","last_became_active":"2023-10-10T21:18:03.114547+0000","last_became_peered":"2023-10-10T21:18:03.114547+0000","last_unstale":"2023-10-10T21:18:03.121389+0000","last_undegraded":"2023-10-10T21:18:03.121389+0000","last_fullsized":"2023-10-10T21:18:03.121389+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.026791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121608+0000","last_change":"2023-10-10T21:18:02.109706+0000","last_active":"2023-10-10T21:18:03.121608+0000","last_peered":"2023-10-10T21:18:03.121608+0000","last_clean":"2023-10-10T21:18:03.121608+0000","last_became_active":"2023-10-10T21:18:02.109440+0000","last_became_peered":"2023-10-10T21:18:02.109440+0000","last_unstale":"2023-10-10T21:18:03.121608+0000","last_undegraded":"2023-10-10T21:18:03.121608+0000","last_fullsized":"2023-10-10T21:18:03.121608+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:14:53.236051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.135108+0000","last_change":"2023-10-10T21:18:03.131702+0000","last_active":"2023-10-10T21:18:03.135108+0000","last_peered":"2023-10-10T21:18:03.135108+0000","last_clean":"2023-10-10T21:18:03.135108+0000","last_became_active":"2023-10-10T21:18:03.131482+0000","last_became_peered":"2023-10-10T21:18:03.131482+0000","last_unstale":"2023-10-10T21:18:03.135108+0000","last_undegraded":"2023-10-10T21:18:03.135108+0000","last_fullsized":"2023-10-10T21:18:03.135108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:25.952411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.105166+0000","last_change":"2023-10-10T21:18:02.109581+0000","last_active":"2023-10-10T21:18:03.105166+0000","last_peered":"2023-10-10T21:18:03.105166+0000","last_clean":"2023-10-10T21:18:03.105166+0000","last_became_active":"2023-10-10T21:18:02.109284+0000","last_became_peered":"2023-10-10T21:18:02.109284+0000","last_unstale":"2023-10-10T21:18:03.105166+0000","last_undegraded":"2023-10-10T21:18:03.105166+0000","last_fullsized":"2023-10-10T21:18:03.105166+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:42.119227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.121608+0000","last_change":"2023-10-10T21:18:03.118181+0000","last_active":"2023-10-10T21:18:03.121608+0000","last_peered":"2023-10-10T21:18:03.121608+0000","last_clean":"2023-10-10T21:18:03.121608+0000","last_became_active":"2023-10-10T21:18:03.117789+0000","last_became_peered":"2023-10-10T21:18:03.117789+0000","last_unstale":"2023-10-10T21:18:03.121608+0000","last_undegraded":"2023-10-10T21:18:03.121608+0000","last_fullsized":"2023-10-10T21:18:03.121608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:52.592283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101483+0000","last_change":"2023-10-10T21:18:02.107231+0000","last_active":"2023-10-10T21:18:03.101483+0000","last_peered":"2023-10-10T21:18:03.101483+0000","last_clean":"2023-10-10T21:18:03.101483+0000","last_became_active":"2023-10-10T21:18:02.106958+0000","last_became_peered":"2023-10-10T21:18:02.106958+0000","last_unstale":"2023-10-10T21:18:03.101483+0000","last_undegraded":"2023-10-10T21:18:03.101483+0000","last_fullsized":"2023-10-10T21:18:03.101483+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:25:13.649666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.115546+0000","last_change":"2023-10-10T21:18:03.112233+0000","last_active":"2023-10-10T21:18:03.115546+0000","last_peered":"2023-10-10T21:18:03.115546+0000","last_clean":"2023-10-10T21:18:03.115546+0000","last_became_active":"2023-10-10T21:18:03.111983+0000","last_became_peered":"2023-10-10T21:18:03.111983+0000","last_unstale":"2023-10-10T21:18:03.115546+0000","last_undegraded":"2023-10-10T21:18:03.115546+0000","last_fullsized":"2023-10-10T21:18:03.115546+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:57.687562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.139714+0000","last_change":"2023-10-10T21:18:02.115421+0000","last_active":"2023-10-10T21:18:03.139714+0000","last_peered":"2023-10-10T21:18:03.139714+0000","last_clean":"2023-10-10T21:18:03.139714+0000","last_became_active":"2023-10-10T21:18:02.114893+0000","last_became_peered":"2023-10-10T21:18:02.114893+0000","last_unstale":"2023-10-10T21:18:03.139714+0000","last_undegraded":"2023-10-10T21:18:03.139714+0000","last_fullsized":"2023-10-10T21:18:03.139714+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:01:22.474173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124037+0000","last_change":"2023-10-10T21:18:03.114414+0000","last_active":"2023-10-10T21:18:03.124037+0000","last_peered":"2023-10-10T21:18:03.124037+0000","last_clean":"2023-10-10T21:18:03.124037+0000","last_became_active":"2023-10-10T21:18:03.114110+0000","last_became_peered":"2023-10-10T21:18:03.114110+0000","last_unstale":"2023-10-10T21:18:03.124037+0000","last_undegraded":"2023-10-10T21:18:03.124037+0000","last_fullsized":"2023-10-10T21:18:03.124037+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:28:14.399113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104739+0000","last_change":"2023-10-10T21:18:02.108937+0000","last_active":"2023-10-10T21:18:03.104739+0000","last_peered":"2023-10-10T21:18:03.104739+0000","last_clean":"2023-10-10T21:18:03.104739+0000","last_became_active":"2023-10-10T21:18:02.108686+0000","last_became_peered":"2023-10-10T21:18:02.108686+0000","last_unstale":"2023-10-10T21:18:03.104739+0000","last_undegraded":"2023-10-10T21:18:03.104739+0000","last_fullsized":"2023-10-10T21:18:03.104739+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:43:37.712234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.129693+0000","last_change":"2023-10-10T21:18:03.126206+0000","last_active":"2023-10-10T21:18:03.129693+0000","last_peered":"2023-10-10T21:18:03.129693+0000","last_clean":"2023-10-10T21:18:03.129693+0000","last_became_active":"2023-10-10T21:18:03.125406+0000","last_became_peered":"2023-10-10T21:18:03.125406+0000","last_unstale":"2023-10-10T21:18:03.129693+0000","last_undegraded":"2023-10-10T21:18:03.129693+0000","last_fullsized":"2023-10-10T21:18:03.129693+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:17.091601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107309+0000","last_change":"2023-10-10T21:18:02.101559+0000","last_active":"2023-10-10T21:18:03.107309+0000","last_peered":"2023-10-10T21:18:03.107309+0000","last_clean":"2023-10-10T21:18:03.107309+0000","last_became_active":"2023-10-10T21:18:02.101311+0000","last_became_peered":"2023-10-10T21:18:02.101311+0000","last_unstale":"2023-10-10T21:18:03.107309+0000","last_undegraded":"2023-10-10T21:18:03.107309+0000","last_fullsized":"2023-10-10T21:18:03.107309+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:50.840955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.124725+0000","last_change":"2023-10-10T21:18:03.117311+0000","last_active":"2023-10-10T21:18:03.124725+0000","last_peered":"2023-10-10T21:18:03.124725+0000","last_clean":"2023-10-10T21:18:03.124725+0000","last_became_active":"2023-10-10T21:18:03.116702+0000","last_became_peered":"2023-10-10T21:18:03.116702+0000","last_unstale":"2023-10-10T21:18:03.124725+0000","last_undegraded":"2023-10-10T21:18:03.124725+0000","last_fullsized":"2023-10-10T21:18:03.124725+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:50:21.902920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.101734+0000","last_change":"2023-10-10T21:18:02.113291+0000","last_active":"2023-10-10T21:18:03.101734+0000","last_peered":"2023-10-10T21:18:03.101734+0000","last_clean":"2023-10-10T21:18:03.101734+0000","last_became_active":"2023-10-10T21:18:02.113013+0000","last_became_peered":"2023-10-10T21:18:02.113013+0000","last_unstale":"2023-10-10T21:18:03.101734+0000","last_undegraded":"2023-10-10T21:18:03.101734+0000","last_fullsized":"2023-10-10T21:18:03.101734+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:17.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.118743+0000","last_change":"2023-10-10T21:18:03.112467+0000","last_active":"2023-10-10T21:18:03.118743+0000","last_peered":"2023-10-10T21:18:03.118743+0000","last_clean":"2023-10-10T21:18:03.118743+0000","last_became_active":"2023-10-10T21:18:03.112232+0000","last_became_peered":"2023-10-10T21:18:03.112232+0000","last_unstale":"2023-10-10T21:18:03.118743+0000","last_undegraded":"2023-10-10T21:18:03.118743+0000","last_fullsized":"2023-10-10T21:18:03.118743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:48.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107085+0000","last_change":"2023-10-10T21:18:02.114127+0000","last_active":"2023-10-10T21:18:03.107085+0000","last_peered":"2023-10-10T21:18:03.107085+0000","last_clean":"2023-10-10T21:18:03.107085+0000","last_became_active":"2023-10-10T21:18:02.113859+0000","last_became_peered":"2023-10-10T21:18:02.113859+0000","last_unstale":"2023-10-10T21:18:03.107085+0000","last_undegraded":"2023-10-10T21:18:03.107085+0000","last_fullsized":"2023-10-10T21:18:03.107085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:47:16.599994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130361+0000","last_change":"2023-10-10T21:18:03.128729+0000","last_active":"2023-10-10T21:18:03.130361+0000","last_peered":"2023-10-10T21:18:03.130361+0000","last_clean":"2023-10-10T21:18:03.130361+0000","last_became_active":"2023-10-10T21:18:03.126563+0000","last_became_peered":"2023-10-10T21:18:03.126563+0000","last_unstale":"2023-10-10T21:18:03.130361+0000","last_undegraded":"2023-10-10T21:18:03.130361+0000","last_fullsized":"2023-10-10T21:18:03.130361+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:26:55.455367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104475+0000","last_change":"2023-10-10T21:18:02.113222+0000","last_active":"2023-10-10T21:18:03.104475+0000","last_peered":"2023-10-10T21:18:03.104475+0000","last_clean":"2023-10-10T21:18:03.104475+0000","last_became_active":"2023-10-10T21:18:02.112956+0000","last_became_peered":"2023-10-10T21:18:02.112956+0000","last_unstale":"2023-10-10T21:18:03.104475+0000","last_undegraded":"2023-10-10T21:18:03.104475+0000","last_fullsized":"2023-10-10T21:18:03.104475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:18.389100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.113293+0000","last_change":"2023-10-10T21:18:03.111805+0000","last_active":"2023-10-10T21:18:03.113293+0000","last_peered":"2023-10-10T21:18:03.113293+0000","last_clean":"2023-10-10T21:18:03.113293+0000","last_became_active":"2023-10-10T21:18:03.111563+0000","last_became_peered":"2023-10-10T21:18:03.111563+0000","last_unstale":"2023-10-10T21:18:03.113293+0000","last_undegraded":"2023-10-10T21:18:03.113293+0000","last_fullsized":"2023-10-10T21:18:03.113293+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:12:30.776673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.104292+0000","last_change":"2023-10-10T21:18:02.105944+0000","last_active":"2023-10-10T21:18:03.104292+0000","last_peered":"2023-10-10T21:18:03.104292+0000","last_clean":"2023-10-10T21:18:03.104292+0000","last_became_active":"2023-10-10T21:18:02.105661+0000","last_became_peered":"2023-10-10T21:18:02.105661+0000","last_unstale":"2023-10-10T21:18:03.104292+0000","last_undegraded":"2023-10-10T21:18:03.104292+0000","last_fullsized":"2023-10-10T21:18:03.104292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:43:37.712234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.130769+0000","last_change":"2023-10-10T21:18:03.129173+0000","last_active":"2023-10-10T21:18:03.130769+0000","last_peered":"2023-10-10T21:18:03.130769+0000","last_clean":"2023-10-10T21:18:03.130769+0000","last_became_active":"2023-10-10T21:18:03.125636+0000","last_became_peered":"2023-10-10T21:18:03.125636+0000","last_unstale":"2023-10-10T21:18:03.130769+0000","last_undegraded":"2023-10-10T21:18:03.130769+0000","last_fullsized":"2023-10-10T21:18:03.130769+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:18:05.038207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.120752+0000","last_change":"2023-10-10T21:18:02.113839+0000","last_active":"2023-10-10T21:18:03.120752+0000","last_peered":"2023-10-10T21:18:03.120752+0000","last_clean":"2023-10-10T21:18:03.120752+0000","last_became_active":"2023-10-10T21:18:02.113532+0000","last_became_peered":"2023-10-10T21:18:02.113532+0000","last_unstale":"2023-10-10T21:18:03.120752+0000","last_undegraded":"2023-10-10T21:18:03.120752+0000","last_fullsized":"2023-10-10T21:18:03.120752+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:49:42.808017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.126713+0000","last_change":"2023-10-10T21:18:03.125634+0000","last_active":"2023-10-10T21:18:03.126713+0000","last_peered":"2023-10-10T21:18:03.126713+0000","last_clean":"2023-10-10T21:18:03.126713+0000","last_became_active":"2023-10-10T21:18:03.125352+0000","last_became_peered":"2023-10-10T21:18:03.125352+0000","last_unstale":"2023-10-10T21:18:03.126713+0000","last_undegraded":"2023-10-10T21:18:03.126713+0000","last_fullsized":"2023-10-10T21:18:03.126713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:02.083687+0000","last_clean_scrub_stamp":"2023-10-10T21:18:02.083687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:56.907952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"94'2","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.140470+0000","last_change":"2023-10-10T21:18:02.111165+0000","last_active":"2023-10-10T21:18:03.140470+0000","last_peered":"2023-10-10T21:18:03.140470+0000","last_clean":"2023-10-10T21:18:03.140470+0000","last_became_active":"2023-10-10T21:18:02.110183+0000","last_became_peered":"2023-10-10T21:18:02.110183+0000","last_unstale":"2023-10-10T21:18:03.140470+0000","last_undegraded":"2023-10-10T21:18:03.140470+0000","last_fullsized":"2023-10-10T21:18:03.140470+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:01.079047+0000","last_clean_scrub_stamp":"2023-10-10T21:18:01.079047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:46.796401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"84'183","reported_seq":462,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-10T21:18:03.107903+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:03.107903+0000","last_peered":"2023-10-10T21:18:03.107903+0000","last_clean":"2023-10-10T21:18:03.107903+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:03.107903+0000","last_undegraded":"2023-10-10T21:18:03.107903+0000","last_fullsized":"2023-10-10T21:18:03.107903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1757184,"data_stored":1147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.995,"5min":1.014,"15min":1.1859999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.52200000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.435},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0069999999999999,"15min":1.123},"last":0.84599999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.71399999999999997},"min":{"1min":0.41399999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.504,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":1.2669999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.62,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.67400000000000004},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.376},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.58599999999999997,"5min":0.51300000000000001,"15min":0.42499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.135},"last":0.88100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542334,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1163264,"data_stored":556926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":1.0569999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.97299999999999998,"5min":1.0129999999999999,"15min":1.143},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.378},"max":{"1min":0.92800000000000005,"5min":1.073,"15min":1.073},"last":0.73099999999999998}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.151},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93600000000000005,"5min":0.97799999999999998,"15min":1.01},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.503,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88,"5min":1.0309999999999999,"15min":1.1839999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":1.018,"5min":1.042,"15min":1.1200000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":1.2729999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.443,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":0.85199999999999998,"5min":0.89200000000000002,"15min":1.0880000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66300000000000003,"15min":0.68200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.90900000000000003,"5min":1.022,"15min":1.345},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":1.048,"15min":1.238},"last":0.88400000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.92700000000000005,"5min":1.024,"15min":1.4930000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.202},"last":0.93600000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542336,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306620,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065220,"statfs":{"total":96636764160,"available":96322785280,"internally_reserved":0,"allocated":1167360,"data_stored":558370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.64400000000000002,"5min":0.78200000000000003,"15min":0.95699999999999996},"last":0.309},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.61599999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47199999999999998,"15min":0.48699999999999999},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.45500000000000002,"5min":0.40899999999999997,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66800000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.755},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.157,"15min":1.3220000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.77800000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.26,"15min":1.2849999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.008,"5min":2.21,"15min":2.21},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.165,"15min":1.268},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.53300000000000003},"max":{"1min":1.0409999999999999,"5min":1.0509999999999999,"15min":1.3400000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.61799999999999999,"5min":0.52800000000000002,"15min":0.505},"max":{"1min":1.026,"5min":1.026,"15min":1.3759999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.85299999999999998,"5min":1.716,"15min":1.716},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.92200000000000004,"5min":1.1140000000000001,"15min":1.3109999999999999},"last":0.82999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298996,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072844,"statfs":{"total":96636764160,"available":96330592256,"internally_reserved":0,"allocated":1748992,"data_stored":1147202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":1.4890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.65600000000000003,"5min":0.91800000000000004,"15min":1.4159999999999999},"last":0.501}]},{"osd":2,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":1.706},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.36399999999999999,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":1.1739999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.70899999999999996,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.72499999999999998,"5min":0.874,"15min":1.2909999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.101,"15min":1.2270000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.38500000000000001},"max":{"1min":0.95799999999999996,"5min":0.96599999999999997,"15min":1.2909999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.371},"max":{"1min":1.03,"5min":1.075,"15min":1.2729999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.58199999999999996,"5min":0.57299999999999995,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0980000000000001,"15min":1.3899999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.65100000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.95699999999999996,"5min":1.0960000000000001,"15min":1.2589999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.83999999999999997},"min":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.41099999999999998},"max":{"1min":1.0249999999999999,"5min":1.1140000000000001,"15min":1.306},"last":0.92700000000000005}]},{"osd":7,"last update":"Tue Oct 10 21:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.64300000000000002,"5min":0.57099999999999995,"15min":0.503},"max":{"1min":0.97299999999999998,"5min":1.139,"15min":1.363},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54200000000000004},"max":{"1min":0.96999999999999997,"5min":1.024,"15min":1.3300000000000001},"last":1.006}]}]},{"osd":1,"up_from":14,"seq":60129542334,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302532,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069308,"statfs":{"total":96636764160,"available":96326971392,"internally_reserved":0,"allocated":1175552,"data_stored":558958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.54200000000000004,"15min":0.48899999999999999},"min":{"1min":0.307,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":8.0839999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.378},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.63500000000000001,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":13.223000000000001,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.5}]},{"osd":2,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.29599999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.40500000000000003,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":2.085},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.60899999999999999,"15min":0.58199999999999996},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35399999999999998},"max":{"1min":0.88,"5min":0.999,"15min":2.117},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.81100000000000005,"15min":0.79700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.82799999999999996,"15min":0.79400000000000004},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.413,"5min":0.92200000000000004,"15min":0.83599999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":13.130000000000001,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.81899999999999995,"15min":0.80700000000000005},"min":{"1min":0.57999999999999996,"5min":0.55400000000000005,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84899999999999998,"15min":0.84299999999999997},"min":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:17:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.89300000000000002,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":12.026,"5min":12.026,"15min":12.026},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.751}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306616,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065224,"statfs":{"total":96636764160,"available":96322789376,"internally_reserved":0,"allocated":1163264,"data_stored":556946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28799999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.544},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.501},"min":{"1min":0.315,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.6759999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.68400000000000005,"5min":0.73399999999999999,"15min":1.4610000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.7070000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.4990000000000001},"last":0.501}]},{"osd":4,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.6359999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.246},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.262},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76700000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.2250000000000001,"15min":1.579},"last":0.70999999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.081,"5min":1.27,"15min":1.27},"last":0.75},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.224,"15min":1.224},"last":0.63}]},{"osd":7,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.111,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.228,"5min":1.228,"15min":1.3200000000000001},"last":0.67500000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542336,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310708,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061132,"statfs":{"total":96636764160,"available":96318599168,"internally_reserved":0,"allocated":1159168,"data_stored":556904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.88,"5min":0.92100000000000004,"15min":1.1479999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":0.96299999999999997,"15min":1.758},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.75},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.47},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68999999999999995,"15min":0.70299999999999996},"min":{"1min":0.53200000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.98299999999999998,"15min":1.929},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83899999999999997,"5min":1.002,"15min":1.6890000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.376},"max":{"1min":0.94499999999999995,"5min":0.98399999999999999,"15min":1.468},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90400000000000003,"5min":1.046,"15min":1.397},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.42799999999999999},"max":{"1min":0.81899999999999995,"5min":0.97699999999999998,"15min":1.385},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":1.105},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0009999999999999,"15min":1.8560000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.38100000000000001},"max":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":1.5209999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.435},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":1.464},"last":0.67200000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.47899999999999998,"15min":0.443},"max":{"1min":1.006,"5min":1.006,"15min":1.5700000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51000000000000001,"5min":0.46600000000000003,"15min":0.42199999999999999},"max":{"1min":0.86599999999999999,"5min":0.91900000000000004,"15min":1.4139999999999999},"last":0.81499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542334,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302516,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069324,"statfs":{"total":96636764160,"available":96326987776,"internally_reserved":0,"allocated":1159168,"data_stored":556924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.29799999999999999},"max":{"1min":0.878,"5min":0.93700000000000006,"15min":1.3169999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":1.371},"last":0.441}]},{"osd":1,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88100000000000001,"5min":0.93300000000000005,"15min":3.895},"last":0.623},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71699999999999997,"15min":0.748},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.39000000000000001},"max":{"1min":0.97899999999999998,"5min":0.99299999999999999,"15min":8.9909999999999997},"last":0.67700000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.2889999999999999},"last":0.499},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.56100000000000005,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.3540000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":1.2909999999999999,"15min":8.9309999999999992},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":2.9409999999999998},"last":0.65400000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":1.5900000000000001,"15min":9.0250000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.65200000000000002},"min":{"1min":0.44900000000000001,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.496,"15min":4.2789999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.50800000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.026},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.748,"15min":0.77100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0149999999999999,"15min":8.8480000000000008},"last":0.72099999999999997}]},{"osd":7,"last update":"Tue Oct 10 21:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":2.8900000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":1.077,"15min":3.9420000000000002},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:12.735 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T21:18:12.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T21:18:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.952+0000 7ff277fff700 1 Processor -- start 2023-10-10T21:18:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.952+0000 7ff277fff700 1 -- start start 2023-10-10T21:18:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.953+0000 7ff277fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff27006d6c0 0x7ff270156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.953+0000 7ff277fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 0x7ff270069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.953+0000 7ff277fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700c7bf0 con 0x7ff2700c85c0 2023-10-10T21:18:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.953+0000 7ff277fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff270068aa0 con 0x7ff27006d6c0 2023-10-10T21:18:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.953+0000 7ff277fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27006db40 con 0x7ff270069890 2023-10-10T21:18:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.953+0000 7ff275d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff2700c85c0 0x7ff270068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33150/0 (socket says 172.21.15.154:33150) 2023-10-10T21:18:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.953+0000 7ff275d9b700 1 -- 172.21.15.154:0/799713948 learned_addr learned my addr 172.21.15.154:0/799713948 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.953+0000 7ff27559a700 1 --2- 172.21.15.154:0/799713948 >> v2:172.21.15.154:3300/0 conn(0x7ff27006d6c0 0x7ff270156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff27659c700 1 --2- 172.21.15.154:0/799713948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 0x7ff270069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff274d99700 1 -- 172.21.15.154:0/799713948 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147007775 0 0) 0x7ff2700c7bf0 con 0x7ff2700c85c0 2023-10-10T21:18:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff27559a700 1 -- 172.21.15.154:0/799713948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 msgr2=0x7ff270069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff27559a700 1 --2- 172.21.15.154:0/799713948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 0x7ff270069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff27559a700 1 -- 172.21.15.154:0/799713948 >> v1:172.21.15.154:6789/0 conn(0x7ff2700c85c0 legacy=0x7ff270068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff27559a700 1 -- 172.21.15.154:0/799713948 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270157420 con 0x7ff27006d6c0 2023-10-10T21:18:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff27559a700 1 --2- 172.21.15.154:0/799713948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 0x7ff270156ee0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff2600098e0 tx=0x7ff2600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3643eed87306df1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:12.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff274d99700 1 -- 172.21.15.154:0/799713948 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260009e80 con 0x7ff27006d6c0 2023-10-10T21:18:12.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff274d99700 1 -- 172.21.15.154:0/799713948 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26000b860 con 0x7ff27006d6c0 2023-10-10T21:18:12.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.954+0000 7ff274d99700 1 -- 172.21.15.154:0/799713948 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26000bbe0 con 0x7ff27006d6c0 2023-10-10T21:18:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.955+0000 7ff277fff700 1 -- 172.21.15.154:0/799713948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 msgr2=0x7ff270156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.955+0000 7ff277fff700 1 --2- 172.21.15.154:0/799713948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 0x7ff270156ee0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff2600098e0 tx=0x7ff2600091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.955+0000 7ff277fff700 1 -- 172.21.15.154:0/799713948 shutdown_connections 2023-10-10T21:18:12.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.955+0000 7ff277fff700 1 --2- 172.21.15.154:0/799713948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 0x7ff270069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.955+0000 7ff277fff700 1 --2- 172.21.15.154:0/799713948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 0x7ff270156ee0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.955+0000 7ff277fff700 1 -- 172.21.15.154:0/799713948 >> 172.21.15.154:0/799713948 conn(0x7ff2700cc540 msgr2=0x7ff2700cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.955+0000 7ff277fff700 1 -- 172.21.15.154:0/799713948 shutdown_connections 2023-10-10T21:18:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.955+0000 7ff277fff700 1 -- 172.21.15.154:0/799713948 wait complete. 2023-10-10T21:18:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.956+0000 7ff277fff700 1 Processor -- start 2023-10-10T21:18:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.956+0000 7ff277fff700 1 -- start start 2023-10-10T21:18:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.957+0000 7ff277fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 0x7ff27014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.957+0000 7ff277fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 0x7ff2700aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.957+0000 7ff277fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2700c85c0 0x7ff2700aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.957+0000 7ff277fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27014ed80 con 0x7ff27006d6c0 2023-10-10T21:18:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.957+0000 7ff277fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2700ad410 con 0x7ff2700c85c0 2023-10-10T21:18:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.957+0000 7ff277fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2700acae0 con 0x7ff270069890 2023-10-10T21:18:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27559a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 0x7ff2700aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27559a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 0x7ff2700aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37400/0 (socket says 172.21.15.154:37400) 2023-10-10T21:18:12.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27559a700 1 -- 172.21.15.154:0/3434547325 learned_addr learned my addr 172.21.15.154:0/3434547325 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:12.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff275d9b700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 0x7ff27014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27659c700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2700c85c0 0x7ff2700aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27559a700 1 -- 172.21.15.154:0/3434547325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 msgr2=0x7ff27014e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27559a700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 0x7ff27014e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27559a700 1 -- 172.21.15.154:0/3434547325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2700c85c0 msgr2=0x7ff2700aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27559a700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2700c85c0 0x7ff2700aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27559a700 1 -- 172.21.15.154:0/3434547325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff260009420 con 0x7ff27006d6c0 2023-10-10T21:18:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27659c700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2700c85c0 0x7ff2700aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.958+0000 7ff27559a700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 0x7ff2700aa390 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff27006bc30 tx=0x7ff260017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.959+0000 7ff265ffb700 1 -- 172.21.15.154:0/3434547325 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26000b9d0 con 0x7ff27006d6c0 2023-10-10T21:18:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.959+0000 7ff265ffb700 1 -- 172.21.15.154:0/3434547325 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26000bb50 con 0x7ff27006d6c0 2023-10-10T21:18:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.959+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2700acdc0 con 0x7ff27006d6c0 2023-10-10T21:18:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.959+0000 7ff265ffb700 1 -- 172.21.15.154:0/3434547325 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260025670 con 0x7ff27006d6c0 2023-10-10T21:18:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.959+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2700aaf00 con 0x7ff27006d6c0 2023-10-10T21:18:12.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.960+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2700ad580 con 0x7ff27006d6c0 2023-10-10T21:18:12.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.961+0000 7ff265ffb700 1 -- 172.21.15.154:0/3434547325 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff260023070 con 0x7ff27006d6c0 2023-10-10T21:18:12.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.961+0000 7ff265ffb700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff254066f30 0x7ff2540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:12.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.962+0000 7ff265ffb700 1 -- 172.21.15.154:0/3434547325 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ff260085e20 con 0x7ff27006d6c0 2023-10-10T21:18:12.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.962+0000 7ff275d9b700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff254066f30 0x7ff2540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:12.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.962+0000 7ff275d9b700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff254066f30 0x7ff2540693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0011e0 tx=0x7ff26c009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:12.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:12.966+0000 7ff265ffb700 1 -- 172.21.15.154:0/3434547325 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff260052e60 con 0x7ff27006d6c0 2023-10-10T21:18:13.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.234+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff2700718b0 con 0x7ff27006d6c0 2023-10-10T21:18:13.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.238+0000 7ff265ffb700 1 -- 172.21.15.154:0/3434547325 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff260056480 con 0x7ff27006d6c0 2023-10-10T21:18:13.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff254066f30 msgr2=0x7ff2540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:13.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff254066f30 0x7ff2540693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0011e0 tx=0x7ff26c009040 comp rx=0 tx=0).stop 2023-10-10T21:18:13.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 msgr2=0x7ff2700aa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:13.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 0x7ff2700aa390 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff27006bc30 tx=0x7ff260017000 comp rx=0 tx=0).stop 2023-10-10T21:18:13.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 shutdown_connections 2023-10-10T21:18:13.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff254066f30 0x7ff2540693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2700c85c0 0x7ff2700aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff270069890 0x7ff27014e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 --2- 172.21.15.154:0/3434547325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff27006d6c0 0x7ff2700aa390 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 >> 172.21.15.154:0/3434547325 conn(0x7ff2700cc540 msgr2=0x7ff2700ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:13.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 shutdown_connections 2023-10-10T21:18:13.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.241+0000 7ff277fff700 1 -- 172.21.15.154:0/3434547325 wait complete. 2023-10-10T21:18:13.247 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T21:18:13.260 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:18:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.440+0000 7fcec2bff700 1 Processor -- start 2023-10-10T21:18:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.441+0000 7fcec2bff700 1 -- start start 2023-10-10T21:18:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.442+0000 7fcec2bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcebc0b1420 0x7fcebc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.442+0000 7fcec2bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0cc300 con 0x7fcebc0ccf90 2023-10-10T21:18:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.442+0000 7fcec2bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0ad370 con 0x7fcebc0cbf30 2023-10-10T21:18:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.442+0000 7fcec2bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc156bf0 con 0x7fcebc0b1420 2023-10-10T21:18:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.442+0000 7fcec119c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcebc0ccf90 0x7fcebc0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33158/0 (socket says 172.21.15.154:33158) 2023-10-10T21:18:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.442+0000 7fcec119c700 1 -- 172.21.15.154:0/3577659050 learned_addr learned my addr 172.21.15.154:0/3577659050 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:13.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.442+0000 7fcebbfff700 1 --2- 172.21.15.154:0/3577659050 >> v2:172.21.15.179:3300/0 conn(0x7fcebc0b1420 0x7fcebc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193548540 0 0) 0x7fcebc0cc300 con 0x7fcebc0ccf90 2023-10-10T21:18:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceac003570 con 0x7fcebc0ccf90 2023-10-10T21:18:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2665765432 0 0) 0x7fceac003570 con 0x7fcebc0ccf90 2023-10-10T21:18:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 >> v2:172.21.15.179:3300/0 conn(0x7fcebc0b1420 msgr2=0x7fcebc0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 --2- 172.21.15.154:0/3577659050 >> v2:172.21.15.179:3300/0 conn(0x7fcebc0b1420 0x7fcebc0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 >> v1:172.21.15.179:6789/0 conn(0x7fcebc0cbf30 legacy=0x7fcebc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0ad650 con 0x7fcebc0ccf90 2023-10-10T21:18:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fceb40017f0 con 0x7fcebc0ccf90 2023-10-10T21:18:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebbfff700 1 --2- 172.21.15.154:0/3577659050 >> v2:172.21.15.179:3300/0 conn(0x7fcebc0b1420 0x7fcebc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 >> v1:172.21.15.154:6789/0 conn(0x7fcebc0ccf90 legacy=0x7fcebc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 --2- 172.21.15.154:0/3577659050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fceac003a60 0x7fceac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 --2- 172.21.15.154:0/3577659050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fceac004810 0x7fceac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 --2- 172.21.15.154:0/3577659050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceac0051c0 0x7fceac00dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc156bf0 con 0x7fceac0051c0 2023-10-10T21:18:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac00e2e0 con 0x7fceac004810 2023-10-10T21:18:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac00e4a0 con 0x7fceac003a60 2023-10-10T21:18:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.443+0000 7fcec119c700 1 --2- 172.21.15.154:0/3577659050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceac0051c0 0x7fceac00dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcec119c700 1 -- 172.21.15.154:0/3577659050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fceac003a60 msgr2=0x7fceac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcec119c700 1 --2- 172.21.15.154:0/3577659050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fceac003a60 0x7fceac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcec119c700 1 -- 172.21.15.154:0/3577659050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fceac004810 msgr2=0x7fceac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcec119c700 1 --2- 172.21.15.154:0/3577659050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fceac004810 0x7fceac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcec119c700 1 -- 172.21.15.154:0/3577659050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac003570 con 0x7fceac0051c0 2023-10-10T21:18:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcec119c700 1 -- 172.21.15.154:0/3577659050 reap_dead start 2023-10-10T21:18:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcec119c700 1 --2- 172.21.15.154:0/3577659050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceac0051c0 0x7fceac00dc70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fceb400a930 tx=0x7fceb40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c2c767e2593894 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40070d0 con 0x7fceac0051c0 2023-10-10T21:18:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb4007230 con 0x7fceac0051c0 2023-10-10T21:18:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.444+0000 7fcebb7fe700 1 -- 172.21.15.154:0/3577659050 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40075d0 con 0x7fceac0051c0 2023-10-10T21:18:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.445+0000 7fcec2bff700 1 -- 172.21.15.154:0/3577659050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceac0051c0 msgr2=0x7fceac00dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.445+0000 7fcec2bff700 1 --2- 172.21.15.154:0/3577659050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceac0051c0 0x7fceac00dc70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fceb400a930 tx=0x7fceb40021d0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.445+0000 7fcec2bff700 1 -- 172.21.15.154:0/3577659050 shutdown_connections 2023-10-10T21:18:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.445+0000 7fcec2bff700 1 --2- 172.21.15.154:0/3577659050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceac0051c0 0x7fceac00dc70 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.445+0000 7fcec2bff700 1 -- 172.21.15.154:0/3577659050 >> 172.21.15.154:0/3577659050 conn(0x7fcebc06a320 msgr2=0x7fcebc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.445+0000 7fcec2bff700 1 -- 172.21.15.154:0/3577659050 shutdown_connections 2023-10-10T21:18:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.445+0000 7fcec2bff700 1 -- 172.21.15.154:0/3577659050 wait complete. 2023-10-10T21:18:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.446+0000 7fcec2bff700 1 Processor -- start 2023-10-10T21:18:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.447+0000 7fcec2bff700 1 -- start start 2023-10-10T21:18:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.447+0000 7fcec2bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fceac0051c0 0x7fcebc0c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.447+0000 7fcec2bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc0c4de0 0x7fcebc1694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.447+0000 7fcec2bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcebc142d00 0x7fcebc169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.447+0000 7fcec2bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0c5e90 con 0x7fcebc142d00 2023-10-10T21:18:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.447+0000 7fcec2bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc143260 con 0x7fcebc0c4de0 2023-10-10T21:18:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.447+0000 7fcec2bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0c5280 con 0x7fceac0051c0 2023-10-10T21:18:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec119c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcebc142d00 0x7fcebc169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec119c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcebc142d00 0x7fcebc169a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37420/0 (socket says 172.21.15.154:37420) 2023-10-10T21:18:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec119c700 1 -- 172.21.15.154:0/336736619 learned_addr learned my addr 172.21.15.154:0/336736619 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcebbfff700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc0c4de0 0x7fcebc1694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec099b700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fceac0051c0 0x7fcebc0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec119c700 1 -- 172.21.15.154:0/336736619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fceac0051c0 msgr2=0x7fcebc0c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec119c700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fceac0051c0 0x7fcebc0c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec119c700 1 -- 172.21.15.154:0/336736619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc0c4de0 msgr2=0x7fcebc1694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec119c700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc0c4de0 0x7fcebc1694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec119c700 1 -- 172.21.15.154:0/336736619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0c5560 con 0x7fcebc142d00 2023-10-10T21:18:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcebbfff700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc0c4de0 0x7fcebc1694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec119c700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcebc142d00 0x7fcebc169a10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fceb4000f80 tx=0x7fceb4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fceb8ff9700 1 -- 172.21.15.154:0/336736619 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40070d0 con 0x7fcebc142d00 2023-10-10T21:18:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fceb8ff9700 1 -- 172.21.15.154:0/336736619 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb40017b0 con 0x7fcebc142d00 2023-10-10T21:18:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fceb8ff9700 1 -- 172.21.15.154:0/336736619 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb401d860 con 0x7fcebc142d00 2023-10-10T21:18:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.448+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc0c5840 con 0x7fcebc142d00 2023-10-10T21:18:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.449+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc154a90 con 0x7fcebc142d00 2023-10-10T21:18:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.449+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc04c3c0 con 0x7fcebc142d00 2023-10-10T21:18:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.450+0000 7fceb8ff9700 1 -- 172.21.15.154:0/336736619 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fceb401dc50 con 0x7fcebc142d00 2023-10-10T21:18:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.451+0000 7fceb8ff9700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcea0066f30 0x7fcea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.451+0000 7fceb8ff9700 1 -- 172.21.15.154:0/336736619 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fceb40869d0 con 0x7fcebc142d00 2023-10-10T21:18:13.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.452+0000 7fcec099b700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcea0066f30 0x7fcea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:13.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.452+0000 7fcec099b700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcea0066f30 0x7fcea00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fceb00027d0 tx=0x7fceb0009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:13.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.455+0000 7fceb8ff9700 1 -- 172.21.15.154:0/336736619 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fceb4053a10 con 0x7fcebc142d00 2023-10-10T21:18:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.688+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcebc0c5fd0 con 0x7fcebc142d00 2023-10-10T21:18:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.688+0000 7fceb8ff9700 1 -- 172.21.15.154:0/336736619 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fceb4057030 con 0x7fcebc142d00 2023-10-10T21:18:13.690 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:13.690 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/136831769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":136831769},{"type":"v1","addr":"172.21.15.154:6837","nonce":136831769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3500808204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3500808204},{"type":"v1","addr":"172.21.15.179:6833","nonce":3500808204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/953113300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":953113300},{"type":"v1","addr":"172.21.15.154:6835","nonce":953113300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:02.569626+0000","modified":"2023-10-10T21:18:06.123950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6472":{"gid":6472,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/434983583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":434983583},{"type":"v1","addr":"172.21.15.179:6835","nonce":434983583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-10T21:18:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcea0066f30 msgr2=0x7fcea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcea0066f30 0x7fcea00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fceb00027d0 tx=0x7fceb0009040 comp rx=0 tx=0).stop 2023-10-10T21:18:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcebc142d00 msgr2=0x7fcebc169a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcebc142d00 0x7fcebc169a10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fceb4000f80 tx=0x7fceb4016000 comp rx=0 tx=0).stop 2023-10-10T21:18:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 shutdown_connections 2023-10-10T21:18:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcebc142d00 0x7fcebc169a10 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fceac0051c0 0x7fcebc0c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcea0066f30 0x7fcea00693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 --2- 172.21.15.154:0/336736619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcebc0c4de0 0x7fcebc1694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 >> 172.21.15.154:0/336736619 conn(0x7fcebc06a320 msgr2=0x7fcebc0ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 shutdown_connections 2023-10-10T21:18:13.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:13.691+0000 7fcec2bff700 1 -- 172.21.15.154:0/336736619 wait complete. 2023-10-10T21:18:13.695 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 38 2023-10-10T21:18:14.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T21:18:02.569626+0000', 'modified': '2023-10-10T21:18:06.123950+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6472': {'gid': 6472, 'name': 'b', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/434983583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 434983583}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 434983583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T21:18:14.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T21:18:14.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-10T21:18:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.295+0000 7fea22dff700 1 Processor -- start 2023-10-10T21:18:14.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.295+0000 7fea22dff700 1 -- start start 2023-10-10T21:18:14.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.297+0000 7fea22dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fea1c06c0a0 0x7fea1c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.297+0000 7fea22dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c15df50 0x7fea1c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.297+0000 7fea22dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c15d7e0 con 0x7fea1c06bcd0 2023-10-10T21:18:14.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.297+0000 7fea22dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c15dac0 con 0x7fea1c06c0a0 2023-10-10T21:18:14.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.297+0000 7fea22dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c15aa30 con 0x7fea1c15df50 2023-10-10T21:18:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.297+0000 7fea2139c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c15df50 0x7fea1c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.297+0000 7fea1bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fea1c06c0a0 0x7fea1c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.297+0000 7fea20b9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fea1c06bcd0 0x7fea1c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44596/0 (socket says 172.21.15.154:44596) 2023-10-10T21:18:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.297+0000 7fea20b9b700 1 -- 172.21.15.154:0/1200662804 learned_addr learned my addr 172.21.15.154:0/1200662804 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea1b7fe700 1 -- 172.21.15.154:0/1200662804 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675347438 0 0) 0x7fea1c15d7e0 con 0x7fea1c06bcd0 2023-10-10T21:18:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea1b7fe700 1 -- 172.21.15.154:0/1200662804 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea0c003570 con 0x7fea1c06bcd0 2023-10-10T21:18:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea2139c700 1 -- 172.21.15.154:0/1200662804 >> v2:172.21.15.179:3300/0 conn(0x7fea1c06c0a0 msgr2=0x7fea1c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:14.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea2139c700 1 --2- 172.21.15.154:0/1200662804 >> v2:172.21.15.179:3300/0 conn(0x7fea1c06c0a0 0x7fea1c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea2139c700 1 -- 172.21.15.154:0/1200662804 >> v1:172.21.15.179:6789/0 conn(0x7fea1c06bcd0 legacy=0x7fea1c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea2139c700 1 -- 172.21.15.154:0/1200662804 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c15ad10 con 0x7fea1c15df50 2023-10-10T21:18:14.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea1bfff700 1 --2- 172.21.15.154:0/1200662804 >> v2:172.21.15.179:3300/0 conn(0x7fea1c06c0a0 0x7fea1c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:14.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea2139c700 1 --2- 172.21.15.154:0/1200662804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c15df50 0x7fea1c15e3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fea140098e0 tx=0x7fea140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13d80e7d4bdfc57 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea1b7fe700 1 -- 172.21.15.154:0/1200662804 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14011630 con 0x7fea1c15df50 2023-10-10T21:18:14.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea1b7fe700 1 -- 172.21.15.154:0/1200662804 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14011790 con 0x7fea1c15df50 2023-10-10T21:18:14.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.298+0000 7fea1b7fe700 1 -- 172.21.15.154:0/1200662804 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14011b30 con 0x7fea1c15df50 2023-10-10T21:18:14.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.299+0000 7fea22dff700 1 -- 172.21.15.154:0/1200662804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c15df50 msgr2=0x7fea1c15e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.299+0000 7fea22dff700 1 --2- 172.21.15.154:0/1200662804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c15df50 0x7fea1c15e3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fea140098e0 tx=0x7fea140091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.299+0000 7fea22dff700 1 -- 172.21.15.154:0/1200662804 shutdown_connections 2023-10-10T21:18:14.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.299+0000 7fea22dff700 1 --2- 172.21.15.154:0/1200662804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c15df50 0x7fea1c15e3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.299+0000 7fea22dff700 1 --2- 172.21.15.154:0/1200662804 >> v2:172.21.15.179:3300/0 conn(0x7fea1c06c0a0 0x7fea1c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.299+0000 7fea22dff700 1 -- 172.21.15.154:0/1200662804 >> 172.21.15.154:0/1200662804 conn(0x7fea1c0ce600 msgr2=0x7fea1c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:14.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.299+0000 7fea22dff700 1 -- 172.21.15.154:0/1200662804 shutdown_connections 2023-10-10T21:18:14.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.299+0000 7fea22dff700 1 -- 172.21.15.154:0/1200662804 wait complete. 2023-10-10T21:18:14.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.300+0000 7fea22dff700 1 Processor -- start 2023-10-10T21:18:14.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.300+0000 7fea22dff700 1 -- start start 2023-10-10T21:18:14.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.301+0000 7fea22dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c06bcd0 0x7fea1c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.301+0000 7fea22dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c06c0a0 0x7fea1c0b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.301+0000 7fea22dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea1c15df50 0x7fea1c0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.301+0000 7fea22dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c158f40 con 0x7fea1c15df50 2023-10-10T21:18:14.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.301+0000 7fea22dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c158330 con 0x7fea1c06c0a0 2023-10-10T21:18:14.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.301+0000 7fea22dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c158610 con 0x7fea1c06bcd0 2023-10-10T21:18:14.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea2139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea1c15df50 0x7fea1c0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea2139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea1c15df50 0x7fea1c0c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37434/0 (socket says 172.21.15.154:37434) 2023-10-10T21:18:14.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea2139c700 1 -- 172.21.15.154:0/2905118862 learned_addr learned my addr 172.21.15.154:0/2905118862 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:14.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea1bfff700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c06c0a0 0x7fea1c0b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea20b9b700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c06bcd0 0x7fea1c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea2139c700 1 -- 172.21.15.154:0/2905118862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c06bcd0 msgr2=0x7fea1c1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea2139c700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c06bcd0 0x7fea1c1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea2139c700 1 -- 172.21.15.154:0/2905118862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c06c0a0 msgr2=0x7fea1c0b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea2139c700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c06c0a0 0x7fea1c0b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea2139c700 1 -- 172.21.15.154:0/2905118862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08009420 con 0x7fea1c15df50 2023-10-10T21:18:14.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea20b9b700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c06bcd0 0x7fea1c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:14.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.302+0000 7fea2139c700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea1c15df50 0x7fea1c0c6a60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fea14009ed0 tx=0x7fea14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.303+0000 7fea18ff9700 1 -- 172.21.15.154:0/2905118862 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14011b10 con 0x7fea1c15df50 2023-10-10T21:18:14.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.303+0000 7fea18ff9700 1 -- 172.21.15.154:0/2905118862 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea140253f0 con 0x7fea1c15df50 2023-10-10T21:18:14.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.303+0000 7fea22dff700 1 -- 172.21.15.154:0/2905118862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea14009420 con 0x7fea1c15df50 2023-10-10T21:18:14.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.303+0000 7fea18ff9700 1 -- 172.21.15.154:0/2905118862 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14025790 con 0x7fea1c15df50 2023-10-10T21:18:14.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.303+0000 7fea22dff700 1 -- 172.21.15.154:0/2905118862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c158bd0 con 0x7fea1c15df50 2023-10-10T21:18:14.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.305+0000 7fea18ff9700 1 -- 172.21.15.154:0/2905118862 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea14025b80 con 0x7fea1c15df50 2023-10-10T21:18:14.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.306+0000 7fea18ff9700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.306+0000 7fea18ff9700 1 -- 172.21.15.154:0/2905118862 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fea14085fe0 con 0x7fea1c15df50 2023-10-10T21:18:14.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.306+0000 7fea20b9b700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.306+0000 7fea20b9b700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea00066f30 0x7fea000693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea10005c50 tx=0x7fea10009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.307+0000 7fea314a0b80 1 Processor -- start 2023-10-10T21:18:14.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.308+0000 7fea314a0b80 1 -- start start 2023-10-10T21:18:14.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.308+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708c5ca50 0x55f708c5ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.308+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708ca6d00 0x55f708c85a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.308+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c58cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.308+0000 7fea314a0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f708bb3a70 con 0x55f708c5ca50 2023-10-10T21:18:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.308+0000 7fea314a0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f708bb1270 con 0x55f708ca6d00 2023-10-10T21:18:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.308+0000 7fea314a0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f708bad060 con 0x55f708c85f60 2023-10-10T21:18:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea20b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708c5ca50 0x55f708c5ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea20b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708c5ca50 0x55f708c5ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37446/0 (socket says 172.21.15.154:37446) 2023-10-10T21:18:14.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea20b9b700 1 -- 172.21.15.154:0/3086723093 learned_addr learned my addr 172.21.15.154:0/3086723093 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:14.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea1bfff700 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708ca6d00 0x55f708c85a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea2139c700 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c58cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea20b9b700 1 -- 172.21.15.154:0/3086723093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 msgr2=0x55f708c58cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:14.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea20b9b700 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c58cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea20b9b700 1 -- 172.21.15.154:0/3086723093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708ca6d00 msgr2=0x55f708c85a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea20b9b700 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708ca6d00 0x55f708c85a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea20b9b700 1 -- 172.21.15.154:0/3086723093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f708a47270 con 0x55f708c5ca50 2023-10-10T21:18:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea1bfff700 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708ca6d00 0x55f708c85a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea20b9b700 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708c5ca50 0x55f708c5ce20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fea1000f000 tx=0x7fea10013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ea8b67cf259ff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.309+0000 7fea05ffb700 1 -- 172.21.15.154:0/3086723093 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10015110 con 0x55f708c5ca50 2023-10-10T21:18:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea05ffb700 1 -- 172.21.15.154:0/3086723093 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea10015270 con 0x55f708c5ca50 2023-10-10T21:18:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea05ffb700 1 -- 172.21.15.154:0/3086723093 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10022630 con 0x55f708c5ca50 2023-10-10T21:18:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea314a0b80 1 -- 172.21.15.154:0/3086723093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708c5ca50 msgr2=0x55f708c5ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea314a0b80 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708c5ca50 0x55f708c5ce20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fea1000f000 tx=0x7fea10013000 comp rx=0 tx=0).stop 2023-10-10T21:18:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea314a0b80 1 -- 172.21.15.154:0/3086723093 shutdown_connections 2023-10-10T21:18:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea314a0b80 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c58cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea314a0b80 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708c5ca50 0x55f708c5ce20 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea314a0b80 1 --2- 172.21.15.154:0/3086723093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708ca6d00 0x55f708c85a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea314a0b80 1 -- 172.21.15.154:0/3086723093 >> 172.21.15.154:0/3086723093 conn(0x55f708c5e370 msgr2=0x55f708c5e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea314a0b80 1 -- 172.21.15.154:0/3086723093 shutdown_connections 2023-10-10T21:18:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.310+0000 7fea314a0b80 1 -- 172.21.15.154:0/3086723093 wait complete. 2023-10-10T21:18:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.311+0000 7fea314a0b80 1 -- start start 2023-10-10T21:18:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.311+0000 7fea314a0b80 1 Processor -- start 2023-10-10T21:18:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c5ca50 0x55f708ca1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c85f60 0x55f708c9ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c57c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea314a0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f708b58890 con 0x55f708ca6d00 2023-10-10T21:18:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea314a0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f708b73ea0 con 0x55f708c85f60 2023-10-10T21:18:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea314a0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f708a2fe30 con 0x55f708c5ca50 2023-10-10T21:18:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea314a0b80 10 client.0 _ll_register_callbacks cb 0x55f708c20110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:18:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea2139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c57c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea2139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c57c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37458/0 (socket says 172.21.15.154:37458) 2023-10-10T21:18:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea2139c700 1 -- 172.21.15.154:0/2508844890 learned_addr learned my addr 172.21.15.154:0/2508844890 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea1bfff700 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c85f60 0x55f708c9ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.312+0000 7fea20b9b700 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c5ca50 0x55f708ca1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea2139c700 1 -- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c5ca50 msgr2=0x55f708ca1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea2139c700 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c5ca50 0x55f708ca1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea2139c700 1 -- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c85f60 msgr2=0x55f708c9ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea2139c700 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c85f60 0x55f708c9ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea2139c700 1 -- 172.21.15.154:0/2508844890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1000f040 con 0x55f708ca6d00 2023-10-10T21:18:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea1bfff700 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c85f60 0x55f708c9ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea2139c700 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c57c20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fea14011f50 tx=0x7fea1405c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad302865b4c4acb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fe9faffd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:18:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fe9faffd700 1 -- 172.21.15.154:0/2508844890 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14056ce0 con 0x55f708ca6d00 2023-10-10T21:18:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fe9faffd700 1 -- 172.21.15.154:0/2508844890 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fea14059f30 con 0x55f708ca6d00 2023-10-10T21:18:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea314a0b80 1 -- 172.21.15.154:0/2508844890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f708c51b70 con 0x55f708ca6d00 2023-10-10T21:18:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fe9faffd700 1 -- 172.21.15.154:0/2508844890 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea1405dc80 con 0x55f708ca6d00 2023-10-10T21:18:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea314a0b80 10 client.6882 fetch_fsmap learned FSMap version 38 2023-10-10T21:18:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fea314a0b80 1 -- 172.21.15.154:0/2508844890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55f7089e9fe0 con 0x55f708ca6d00 2023-10-10T21:18:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.313+0000 7fe9faffd700 1 -- 172.21.15.154:0/2508844890 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14082070 con 0x55f708ca6d00 2023-10-10T21:18:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.314+0000 7fe9faffd700 1 -- 172.21.15.154:0/2508844890 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fea1405d7f0 con 0x55f708ca6d00 2023-10-10T21:18:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.314+0000 7fea314a0b80 10 client.6882 fetch_fsmap finished waiting for FSMap version 38 2023-10-10T21:18:14.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.314+0000 7fea314a0b80 10 client.6882 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-10T21:18:14.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.314+0000 7fea314a0b80 20 client.6882 populate_metadata read hostname 'smithi154' 2023-10-10T21:18:14.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.314+0000 7fea314a0b80 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] conn(0x55f708cb6910 0x55f708cb6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.314+0000 7fea314a0b80 4 client.6882 mds_command: new command op to 6472 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T21:18:14.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.314+0000 7fea314a0b80 1 -- 172.21.15.154:0/2508844890 --> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f708c2eaa0 con 0x55f708cb6910 2023-10-10T21:18:14.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.314+0000 7fea20b9b700 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] conn(0x55f708cb6910 0x55f708cb6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.315+0000 7fe9faffd700 10 client.6882 ms_handle_connect on v2:172.21.15.179:6834/434983583 2023-10-10T21:18:14.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.315+0000 7fea20b9b700 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] conn(0x55f708cb6910 0x55f708cb6ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d1b5cd2aa698ff9 server_cookie=6298eef3427d189f in_seq=0 out_seq=0 2023-10-10T21:18:14.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fe9faffd700 1 -- 172.21.15.154:0/2508844890 <== mds.0 v2:172.21.15.179:6834/434983583 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f708c2eaa0 con 0x55f708cb6910 2023-10-10T21:18:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fe9faffd700 10 client.6882 handle_command_reply: tid=0 2023-10-10T21:18:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 client.6882 shutdown 2023-10-10T21:18:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 -- 172.21.15.154:0/2508844890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 msgr2=0x55f708c57c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c57c20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fea14011f50 tx=0x7fea1405c040 comp rx=0 tx=0).stop 2023-10-10T21:18:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 -- 172.21.15.154:0/2508844890 shutdown_connections 2023-10-10T21:18:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c57c20 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c5ca50 0x55f708ca1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] conn(0x55f708cb6910 0x55f708cb6ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 --2- 172.21.15.154:0/2508844890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c85f60 0x55f708c9ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fe9faffd700 0 client.6882 ms_handle_reset on v2:172.21.15.179:6834/434983583 2023-10-10T21:18:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 -- 172.21.15.154:0/2508844890 >> 172.21.15.154:0/2508844890 conn(0x55f708c5e370 msgr2=0x55f708c5d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:14.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 -- 172.21.15.154:0/2508844890 shutdown_connections 2023-10-10T21:18:14.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 1 -- 172.21.15.154:0/2508844890 wait complete. 2023-10-10T21:18:14.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.316+0000 7fea314a0b80 20 client.6882 trim_cache size 0 max 16384 2023-10-10T21:18:14.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.333+0000 7fea314a0b80 1 Processor -- start 2023-10-10T21:18:14.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.333+0000 7fea314a0b80 1 -- start start 2023-10-10T21:18:14.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.334+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 0x55f708c5d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.334+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c5d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.334+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c8c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.334+0000 7fea314a0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f708cb6290 con 0x55f708ca6d00 2023-10-10T21:18:14.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.334+0000 7fea314a0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f708c9bf50 con 0x55f708c5ca50 2023-10-10T21:18:14.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.334+0000 7fea314a0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f708c59d70 con 0x55f708c85f60 2023-10-10T21:18:14.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.334+0000 7fea2139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c8c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.334+0000 7fea2139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c8c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37466/0 (socket says 172.21.15.154:37466) 2023-10-10T21:18:14.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.334+0000 7fea2139c700 1 -- 172.21.15.154:0/239944500 learned_addr learned my addr 172.21.15.154:0/239944500 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:14.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea20b9b700 1 --2- 172.21.15.154:0/239944500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 0x55f708c5d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea1bfff700 1 --2- 172.21.15.154:0/239944500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c5d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea2139c700 1 -- 172.21.15.154:0/239944500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 msgr2=0x55f708c5d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:14.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea2139c700 1 --2- 172.21.15.154:0/239944500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c5d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea2139c700 1 -- 172.21.15.154:0/239944500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 msgr2=0x55f708c5d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:14.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea2139c700 1 --2- 172.21.15.154:0/239944500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 0x55f708c5d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea2139c700 1 -- 172.21.15.154:0/239944500 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f708b7b780 con 0x55f708ca6d00 2023-10-10T21:18:14.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea2139c700 1 --2- 172.21.15.154:0/239944500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c8c2b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fea14056760 tx=0x7fea1406a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294f54780928805c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea067fc700 1 -- 172.21.15.154:0/239944500 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14006dd0 con 0x55f708ca6d00 2023-10-10T21:18:14.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea067fc700 1 -- 172.21.15.154:0/239944500 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14082040 con 0x55f708ca6d00 2023-10-10T21:18:14.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.335+0000 7fea067fc700 1 -- 172.21.15.154:0/239944500 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14059f30 con 0x55f708ca6d00 2023-10-10T21:18:14.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 -- 172.21.15.154:0/239944500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 msgr2=0x55f708c8c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 --2- 172.21.15.154:0/239944500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c8c2b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fea14056760 tx=0x7fea1406a000 comp rx=0 tx=0).stop 2023-10-10T21:18:14.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 -- 172.21.15.154:0/239944500 shutdown_connections 2023-10-10T21:18:14.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 --2- 172.21.15.154:0/239944500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c8c2b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 --2- 172.21.15.154:0/239944500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 0x55f708c5d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 --2- 172.21.15.154:0/239944500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c5d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 -- 172.21.15.154:0/239944500 >> 172.21.15.154:0/239944500 conn(0x55f708c5e370 msgr2=0x55f708c5e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:14.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 -- 172.21.15.154:0/239944500 shutdown_connections 2023-10-10T21:18:14.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 -- 172.21.15.154:0/239944500 wait complete. 2023-10-10T21:18:14.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.336+0000 7fea314a0b80 1 -- start start 2023-10-10T21:18:14.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.337+0000 7fea314a0b80 1 Processor -- start 2023-10-10T21:18:14.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.337+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 0x55f708d0b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.337+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c5cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.337+0000 7fea314a0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c5d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.337+0000 7fea314a0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f708cb1ad0 con 0x55f708ca6d00 2023-10-10T21:18:14.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.337+0000 7fea314a0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f708cb14a0 con 0x55f708c5ca50 2023-10-10T21:18:14.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.337+0000 7fea314a0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f708ca5330 con 0x55f708c85f60 2023-10-10T21:18:14.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.337+0000 7fea314a0b80 10 client.0 _ll_register_callbacks cb 0x55f708c20110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:18:14.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea2139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c5d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea2139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c5d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37470/0 (socket says 172.21.15.154:37470) 2023-10-10T21:18:14.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea2139c700 1 -- 172.21.15.154:0/973668110 learned_addr learned my addr 172.21.15.154:0/973668110 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:14.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea20b9b700 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 0x55f708d0b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea1bfff700 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c5cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea2139c700 1 -- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 msgr2=0x55f708c5cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:14.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea2139c700 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c5cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea2139c700 1 -- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 msgr2=0x55f708d0b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:14.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea2139c700 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 0x55f708d0b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea2139c700 1 -- 172.21.15.154:0/973668110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7089e9fe0 con 0x55f708ca6d00 2023-10-10T21:18:14.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea1bfff700 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c5cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:14.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea2139c700 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c5d520 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fea140531e0 tx=0x7fea1400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ca99536507692f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fe9faffd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:18:14.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fe9faffd700 1 -- 172.21.15.154:0/973668110 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1405dc80 con 0x55f708ca6d00 2023-10-10T21:18:14.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fe9faffd700 1 -- 172.21.15.154:0/973668110 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fea14061020 con 0x55f708ca6d00 2023-10-10T21:18:14.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.338+0000 7fea314a0b80 1 -- 172.21.15.154:0/973668110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea1c0c7780 con 0x55f708ca6d00 2023-10-10T21:18:14.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fe9faffd700 1 -- 172.21.15.154:0/973668110 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea14059f30 con 0x55f708ca6d00 2023-10-10T21:18:14.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fea314a0b80 10 client.6888 fetch_fsmap learned FSMap version 38 2023-10-10T21:18:14.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fea314a0b80 1 -- 172.21.15.154:0/973668110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55f708b62470 con 0x55f708ca6d00 2023-10-10T21:18:14.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fe9faffd700 1 -- 172.21.15.154:0/973668110 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c0c7780 con 0x55f708ca6d00 2023-10-10T21:18:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fe9faffd700 1 -- 172.21.15.154:0/973668110 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fea1405d7f0 con 0x55f708ca6d00 2023-10-10T21:18:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fea314a0b80 10 client.6888 fetch_fsmap finished waiting for FSMap version 38 2023-10-10T21:18:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fea314a0b80 10 client.6888 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-10T21:18:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fea314a0b80 20 client.6888 populate_metadata read hostname 'smithi154' 2023-10-10T21:18:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fea314a0b80 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] conn(0x55f708ca5a40 0x55f708ca5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fea314a0b80 4 client.6888 mds_command: new command op to 6472 tid=0[{"prefix": "status"}] 2023-10-10T21:18:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.339+0000 7fea314a0b80 1 -- 172.21.15.154:0/973668110 --> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fea10015270 con 0x55f708ca5a40 2023-10-10T21:18:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.340+0000 7fea20b9b700 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] conn(0x55f708ca5a40 0x55f708ca5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.340+0000 7fe9faffd700 10 client.6888 ms_handle_connect on v2:172.21.15.179:6834/434983583 2023-10-10T21:18:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.340+0000 7fea20b9b700 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] conn(0x55f708ca5a40 0x55f708ca5e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b84854f0c862aae2 server_cookie=802e2f182f7533f6 in_seq=0 out_seq=0 2023-10-10T21:18:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.340+0000 7fe9faffd700 1 -- 172.21.15.154:0/973668110 <== mds.0 v2:172.21.15.179:6834/434983583 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7fea10015270 con 0x55f708ca5a40 2023-10-10T21:18:14.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.340+0000 7fe9faffd700 10 client.6888 handle_command_reply: tid=0 2023-10-10T21:18:14.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.340+0000 7fea314a0b80 1 client.6888 shutdown 2023-10-10T21:18:14.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.340+0000 7fea314a0b80 1 -- 172.21.15.154:0/973668110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 msgr2=0x55f708c5d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.340+0000 7fea314a0b80 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c5d520 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fea140531e0 tx=0x7fea1400d000 comp rx=0 tx=0).stop 2023-10-10T21:18:14.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea314a0b80 1 -- 172.21.15.154:0/973668110 shutdown_connections 2023-10-10T21:18:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea314a0b80 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708ca6d00 0x55f708c5d520 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea314a0b80 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:6834/434983583,v1:172.21.15.179:6835/434983583] conn(0x55f708ca5a40 0x55f708ca5e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea314a0b80 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f708c5ca50 0x55f708d0b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea314a0b80 1 --2- 172.21.15.154:0/973668110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f708c85f60 0x55f708c5cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea314a0b80 1 -- 172.21.15.154:0/973668110 >> 172.21.15.154:0/973668110 conn(0x55f708c5e370 msgr2=0x55f708c596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fe9faffd700 0 client.6888 ms_handle_reset on v2:172.21.15.179:6834/434983583 2023-10-10T21:18:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea314a0b80 1 -- 172.21.15.154:0/973668110 shutdown_connections 2023-10-10T21:18:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea314a0b80 1 -- 172.21.15.154:0/973668110 wait complete. 2023-10-10T21:18:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea314a0b80 20 client.6888 trim_cache size 0 max 16384 2023-10-10T21:18:14.358 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:18:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T21:18:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T21:18:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 6472, 2023-10-10T21:18:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T21:18:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T21:18:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T21:18:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.23056379, 2023-10-10T21:18:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 38, 2023-10-10T21:18:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 95, 2023-10-10T21:18:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 95, 2023-10-10T21:18:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.245129294000002 2023-10-10T21:18:14.360 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:18:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 -- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea00066f30 msgr2=0x7fea000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea00066f30 0x7fea000693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea10005c50 tx=0x7fea10009040 comp rx=0 tx=0).stop 2023-10-10T21:18:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 -- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea1c15df50 msgr2=0x7fea1c0c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea1c15df50 0x7fea1c0c6a60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fea14009ed0 tx=0x7fea14017000 comp rx=0 tx=0).stop 2023-10-10T21:18:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 -- 172.21.15.154:0/2905118862 shutdown_connections 2023-10-10T21:18:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea1c15df50 0x7fea1c0c6a60 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea1c06bcd0 0x7fea1c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 --2- 172.21.15.154:0/2905118862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c06c0a0 0x7fea1c0b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.341+0000 7fea22dff700 1 -- 172.21.15.154:0/2905118862 >> 172.21.15.154:0/2905118862 conn(0x7fea1c0ce600 msgr2=0x7fea1c157200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:14.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.342+0000 7fea22dff700 1 -- 172.21.15.154:0/2905118862 shutdown_connections 2023-10-10T21:18:14.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.342+0000 7fea22dff700 1 -- 172.21.15.154:0/2905118862 wait complete. 2023-10-10T21:18:14.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:18:14.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.546+0000 7fd01abff700 1 Processor -- start 2023-10-10T21:18:14.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.546+0000 7fd01abff700 1 -- start start 2023-10-10T21:18:14.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.547+0000 7fd01abff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0141578b0 0x7fd014155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.547+0000 7fd01abff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0140ad930 con 0x7fd0140af2f0 2023-10-10T21:18:14.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.547+0000 7fd01abff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0140acd20 con 0x7fd014155c10 2023-10-10T21:18:14.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.547+0000 7fd01abff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0140ad000 con 0x7fd0141578b0 2023-10-10T21:18:14.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.547+0000 7fd013fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0141578b0 0x7fd014155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd013fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0141578b0 0x7fd014155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37474/0 (socket says 172.21.15.154:37474) 2023-10-10T21:18:14.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd013fff700 1 -- 172.21.15.154:0/3073441243 learned_addr learned my addr 172.21.15.154:0/3073441243 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:14.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd01919c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd0140af2f0 0x7fd0140af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33166/0 (socket says 172.21.15.154:33166) 2023-10-10T21:18:14.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd013fff700 1 -- 172.21.15.154:0/3073441243 >> v1:172.21.15.179:6789/0 conn(0x7fd014155c10 legacy=0x7fd0140ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd013fff700 1 -- 172.21.15.154:0/3073441243 >> v1:172.21.15.154:6789/0 conn(0x7fd0140af2f0 legacy=0x7fd0140af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd013fff700 1 -- 172.21.15.154:0/3073441243 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0140ad2e0 con 0x7fd0141578b0 2023-10-10T21:18:14.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd0137fe700 1 -- 172.21.15.154:0/3073441243 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685213507 0 0) 0x7fd0140ad930 con 0x7fd0140af2f0 2023-10-10T21:18:14.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd013fff700 1 --2- 172.21.15.154:0/3073441243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 0x7fd014155fe0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd00000bc50 tx=0x7fd00000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fa10d308e62044 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd0137fe700 1 -- 172.21.15.154:0/3073441243 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000be60 con 0x7fd0141578b0 2023-10-10T21:18:14.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd0137fe700 1 -- 172.21.15.154:0/3073441243 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00000de00 con 0x7fd0141578b0 2023-10-10T21:18:14.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.548+0000 7fd0137fe700 1 -- 172.21.15.154:0/3073441243 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000196b0 con 0x7fd0141578b0 2023-10-10T21:18:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.549+0000 7fd01abff700 1 -- 172.21.15.154:0/3073441243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 msgr2=0x7fd014155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.549+0000 7fd01abff700 1 --2- 172.21.15.154:0/3073441243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 0x7fd014155fe0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd00000bc50 tx=0x7fd00000b4f0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.549+0000 7fd01abff700 1 -- 172.21.15.154:0/3073441243 shutdown_connections 2023-10-10T21:18:14.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.549+0000 7fd01abff700 1 --2- 172.21.15.154:0/3073441243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 0x7fd014155fe0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.549+0000 7fd01abff700 1 -- 172.21.15.154:0/3073441243 >> 172.21.15.154:0/3073441243 conn(0x7fd01406a320 msgr2=0x7fd0140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:14.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.549+0000 7fd01abff700 1 -- 172.21.15.154:0/3073441243 shutdown_connections 2023-10-10T21:18:14.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.549+0000 7fd01abff700 1 -- 172.21.15.154:0/3073441243 wait complete. 2023-10-10T21:18:14.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.550+0000 7fd01abff700 1 Processor -- start 2023-10-10T21:18:14.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.551+0000 7fd01abff700 1 -- start start 2023-10-10T21:18:14.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.551+0000 7fd01abff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0140af2f0 0x7fd0140cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd014155c10 0x7fd0140c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01abff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 0x7fd014068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01abff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140c8ba0 con 0x7fd0141578b0 2023-10-10T21:18:14.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01abff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140aaaa0 con 0x7fd0140af2f0 2023-10-10T21:18:14.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140abeb0 con 0x7fd014155c10 2023-10-10T21:18:14.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 0x7fd014068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 0x7fd014068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37480/0 (socket says 172.21.15.154:37480) 2023-10-10T21:18:14.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01919c700 1 -- 172.21.15.154:0/2857095095 learned_addr learned my addr 172.21.15.154:0/2857095095 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:14.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd013fff700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd014155c10 0x7fd0140c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01899b700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0140af2f0 0x7fd0140cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01919c700 1 -- 172.21.15.154:0/2857095095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd014155c10 msgr2=0x7fd0140c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01919c700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd014155c10 0x7fd0140c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01919c700 1 -- 172.21.15.154:0/2857095095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0140af2f0 msgr2=0x7fd0140cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01919c700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0140af2f0 0x7fd0140cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01919c700 1 -- 172.21.15.154:0/2857095095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00000b790 con 0x7fd0141578b0 2023-10-10T21:18:14.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.552+0000 7fd01919c700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 0x7fd014068390 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00cd00 tx=0x7fd00c001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.553+0000 7fd010ff9700 1 -- 172.21.15.154:0/2857095095 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c005df0 con 0x7fd0141578b0 2023-10-10T21:18:14.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.553+0000 7fd010ff9700 1 -- 172.21.15.154:0/2857095095 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c00a960 con 0x7fd0141578b0 2023-10-10T21:18:14.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.553+0000 7fd010ff9700 1 -- 172.21.15.154:0/2857095095 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c00ad20 con 0x7fd0141578b0 2023-10-10T21:18:14.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.553+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0140a9e90 con 0x7fd0141578b0 2023-10-10T21:18:14.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.553+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0140aa450 con 0x7fd0141578b0 2023-10-10T21:18:14.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.554+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01404c3c0 con 0x7fd0141578b0 2023-10-10T21:18:14.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.555+0000 7fd010ff9700 1 -- 172.21.15.154:0/2857095095 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd00c007300 con 0x7fd0141578b0 2023-10-10T21:18:14.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.556+0000 7fd010ff9700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcff8066f30 0x7fcff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:14.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.556+0000 7fd010ff9700 1 -- 172.21.15.154:0/2857095095 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fd00c084950 con 0x7fd0141578b0 2023-10-10T21:18:14.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.556+0000 7fd01899b700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcff8066f30 0x7fcff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:14.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.556+0000 7fd01899b700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcff8066f30 0x7fcff80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0140cd140 tx=0x7fd008009040 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:14.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.559+0000 7fd010ff9700 1 -- 172.21.15.154:0/2857095095 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd00c051a10 con 0x7fd0141578b0 2023-10-10T21:18:14.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.794+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0140ad5c0 con 0x7fd0141578b0 2023-10-10T21:18:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.794+0000 7fd010ff9700 1 -- 172.21.15.154:0/2857095095 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd00c055030 con 0x7fd0141578b0 2023-10-10T21:18:14.796 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:18:14.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcff8066f30 msgr2=0x7fcff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcff8066f30 0x7fcff80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0140cd140 tx=0x7fd008009040 comp rx=0 tx=0).stop 2023-10-10T21:18:14.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 msgr2=0x7fd014068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:14.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 0x7fd014068390 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00cd00 tx=0x7fd00c001ac0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 shutdown_connections 2023-10-10T21:18:14.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0141578b0 0x7fd014068390 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcff8066f30 0x7fcff80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0140af2f0 0x7fd0140cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 --2- 172.21.15.154:0/2857095095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd014155c10 0x7fd0140c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 >> 172.21.15.154:0/2857095095 conn(0x7fd01406a320 msgr2=0x7fd01415aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 shutdown_connections 2023-10-10T21:18:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:14.797+0000 7fd01abff700 1 -- 172.21.15.154:0/2857095095 wait complete. 2023-10-10T21:18:14.815 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T21:18:14.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:18:14.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T21:18:14.816 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T21:18:14.817 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T21:18:14.817 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T21:18:14.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T21:18:14.818 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:18:14.818 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:18:14.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:14.819 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T21:18:14.856 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:18:14.857 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:18:14.857 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:18:14.857 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:14.857 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:18:14.858 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:14.858 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:18:14.858 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:14.858 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T21:18:14.858 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:18:14.859 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:14.859 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T21:18:14.859 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:18:14.859 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:14.859 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:18:14.860 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:14.860 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:18:14.860 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 41319sec preferred_lft 41319sec 2023-10-10T21:18:14.860 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T21:18:14.860 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:14.861 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:18:14.861 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:14.861 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T21:18:14.861 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:14.861 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T21:18:14.861 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:14.862 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:18:14.862 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T21:18:14.862 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T21:18:14.862 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:14.862 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:18:14.863 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T21:18:14.863 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T21:18:14.863 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:14.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:14.864 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:18:14.955 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T21:18:14.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:14.958 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T21:18:14.997 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T21:18:14.997 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:18:14.997 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:18:14.998 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:18:14.998 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:18:14.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:14.999 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:18:15.000 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:18:15.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:18:15.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:18:15.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:18:15.001 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:18:15.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:15.197 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:18:15.234 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T21:18:15.234 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T21:18:15.235 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:18:15.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:15.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T21:18:15.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:18:15.336 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T21:18:15.373 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:18:15.373 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:18:15.374 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:18:15.449 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:18:15.449 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:18:15.450 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:18:15.580 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:18:15.581 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:18:15.581 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:18:15.596 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:18:15.597 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:18:15.597 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:18:15.597 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:18:15.598 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:18:15.618 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:18:15.619 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:18:15.619 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:18:15.620 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:18:15.620 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:18:15.620 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:18:15.621 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:18:15.621 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:18:15.623 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:18:15.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:15.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:18:15.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T21:18:15.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.875+0000 7f4cecbff700 1 Processor -- start 2023-10-10T21:18:15.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.875+0000 7f4cecbff700 1 -- start start 2023-10-10T21:18:15.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.876+0000 7f4cecbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4ce8068550 0x7f4ce8068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:15.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.876+0000 7f4cecbff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ce815e010 0x7f4ce806f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:15.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.876+0000 7f4cecbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce806ec70 con 0x7f4ce806f640 2023-10-10T21:18:15.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.876+0000 7f4cecbff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80b3430 con 0x7f4ce815e010 2023-10-10T21:18:15.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.876+0000 7f4cecbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80b2e70 con 0x7f4ce8068550 2023-10-10T21:18:15.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.877+0000 7f4ce5d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ce815e010 0x7f4ce806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:15.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.877+0000 7f4ce5d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ce815e010 0x7f4ce806f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41912/0 (socket says 172.21.15.154:41912) 2023-10-10T21:18:15.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.877+0000 7f4ce5d9b700 1 -- 172.21.15.154:0/3735349049 learned_addr learned my addr 172.21.15.154:0/3735349049 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:15.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.877+0000 7f4ce659c700 1 --2- 172.21.15.154:0/3735349049 >> v2:172.21.15.179:3300/0 conn(0x7f4ce8068550 0x7f4ce8068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:15.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.877+0000 7f4ce5d9b700 1 -- 172.21.15.154:0/3735349049 >> v2:172.21.15.179:3300/0 conn(0x7f4ce8068550 msgr2=0x7f4ce8068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:15.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.877+0000 7f4ce5d9b700 1 --2- 172.21.15.154:0/3735349049 >> v2:172.21.15.179:3300/0 conn(0x7f4ce8068550 0x7f4ce8068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:15.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.877+0000 7f4ce5d9b700 1 -- 172.21.15.154:0/3735349049 >> v1:172.21.15.179:6789/0 conn(0x7f4ce806f640 legacy=0x7f4ce806a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:15.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.877+0000 7f4ce5d9b700 1 -- 172.21.15.154:0/3735349049 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80b3150 con 0x7f4ce815e010 2023-10-10T21:18:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.877+0000 7f4ce5d9b700 1 --2- 172.21.15.154:0/3735349049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce815e010 0x7f4ce806f100 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4ce806e170 tx=0x7f4cdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dabe1ec285584 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4ce559a700 1 -- 172.21.15.154:0/3735349049 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00b860 con 0x7f4ce815e010 2023-10-10T21:18:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4ce559a700 1 -- 172.21.15.154:0/3735349049 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc00b9c0 con 0x7f4ce815e010 2023-10-10T21:18:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4ce559a700 1 -- 172.21.15.154:0/3735349049 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00bd60 con 0x7f4ce815e010 2023-10-10T21:18:15.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4cecbff700 1 -- 172.21.15.154:0/3735349049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce815e010 msgr2=0x7f4ce806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:15.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4cecbff700 1 --2- 172.21.15.154:0/3735349049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce815e010 0x7f4ce806f100 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4ce806e170 tx=0x7f4cdc009250 comp rx=0 tx=0).stop 2023-10-10T21:18:15.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4cecbff700 1 -- 172.21.15.154:0/3735349049 shutdown_connections 2023-10-10T21:18:15.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4cecbff700 1 --2- 172.21.15.154:0/3735349049 >> v2:172.21.15.179:3300/0 conn(0x7f4ce8068550 0x7f4ce8068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:15.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4cecbff700 1 --2- 172.21.15.154:0/3735349049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce815e010 0x7f4ce806f100 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:15.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4cecbff700 1 -- 172.21.15.154:0/3735349049 >> 172.21.15.154:0/3735349049 conn(0x7f4ce80cd480 msgr2=0x7f4ce80cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:15.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.878+0000 7f4cecbff700 1 -- 172.21.15.154:0/3735349049 shutdown_connections 2023-10-10T21:18:15.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.879+0000 7f4cecbff700 1 -- 172.21.15.154:0/3735349049 wait complete. 2023-10-10T21:18:15.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.880+0000 7f4cecbff700 1 Processor -- start 2023-10-10T21:18:15.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.880+0000 7f4cecbff700 1 -- start start 2023-10-10T21:18:15.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4cecbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce8068550 0x7f4ce8140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:15.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4cecbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce806f640 0x7f4ce80aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:15.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4cecbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce815e010 0x7f4ce80af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:15.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4cecbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8147630 con 0x7f4ce8068550 2023-10-10T21:18:15.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4cecbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8142ec0 con 0x7f4ce806f640 2023-10-10T21:18:15.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4cecbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce81431a0 con 0x7f4ce815e010 2023-10-10T21:18:15.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4ce659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce8068550 0x7f4ce8140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:15.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4ce659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce8068550 0x7f4ce8140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41918/0 (socket says 172.21.15.154:41918) 2023-10-10T21:18:15.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4ce659c700 1 -- 172.21.15.154:0/4122867864 learned_addr learned my addr 172.21.15.154:0/4122867864 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:15.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4ce5d9b700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce806f640 0x7f4ce80aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:15.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.881+0000 7f4ce6d9d700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce815e010 0x7f4ce80af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:15.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4ce659c700 1 -- 172.21.15.154:0/4122867864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce815e010 msgr2=0x7f4ce80af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:15.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4ce659c700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce815e010 0x7f4ce80af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:15.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4ce659c700 1 -- 172.21.15.154:0/4122867864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce806f640 msgr2=0x7f4ce80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:15.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4ce659c700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce806f640 0x7f4ce80aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:15.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4ce659c700 1 -- 172.21.15.154:0/4122867864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0094f0 con 0x7f4ce8068550 2023-10-10T21:18:15.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4ce659c700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce8068550 0x7f4ce8140a80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800d890 tx=0x7f4cd8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:15.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4cd67fc700 1 -- 172.21.15.154:0/4122867864 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80125f0 con 0x7f4ce8068550 2023-10-10T21:18:15.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4cd67fc700 1 -- 172.21.15.154:0/4122867864 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8012750 con 0x7f4ce8068550 2023-10-10T21:18:15.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4cd67fc700 1 -- 172.21.15.154:0/4122867864 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8012ad0 con 0x7f4ce8068550 2023-10-10T21:18:15.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce8143480 con 0x7f4ce8068550 2023-10-10T21:18:15.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.882+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce8143a40 con 0x7f4ce8068550 2023-10-10T21:18:15.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.883+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce8143c00 con 0x7f4ce8068550 2023-10-10T21:18:15.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.884+0000 7f4cd67fc700 1 -- 172.21.15.154:0/4122867864 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cd801e460 con 0x7f4ce8068550 2023-10-10T21:18:15.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.885+0000 7f4cd67fc700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4cc8066f30 0x7f4cc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:15.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.885+0000 7f4cd67fc700 1 -- 172.21.15.154:0/4122867864 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4cd8084d70 con 0x7f4ce8068550 2023-10-10T21:18:15.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.885+0000 7f4ce5d9b700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4cc8066f30 0x7f4cc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:15.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.886+0000 7f4ce5d9b700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4cc8066f30 0x7f4cc80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ce806e170 tx=0x7f4cdc017000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:15.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:15.889+0000 7f4cd67fc700 1 -- 172.21.15.154:0/4122867864 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cd8051db0 con 0x7f4ce8068550 2023-10-10T21:18:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.107+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ce8143db0 con 0x7f4cc8066f30 2023-10-10T21:18:16.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.109+0000 7f4cd67fc700 1 -- 172.21.15.154:0/4122867864 <== mgr.6531 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4ce8143db0 con 0x7f4cc8066f30 2023-10-10T21:18:16.110 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:18:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T21:18:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:16.111 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:18:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4cc8066f30 msgr2=0x7f4cc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4cc8066f30 0x7f4cc80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ce806e170 tx=0x7f4cdc017000 comp rx=0 tx=0).stop 2023-10-10T21:18:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce8068550 msgr2=0x7f4ce8140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce8068550 0x7f4ce8140a80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800d890 tx=0x7f4cd8008040 comp rx=0 tx=0).stop 2023-10-10T21:18:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 shutdown_connections 2023-10-10T21:18:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce815e010 0x7f4ce80af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce8068550 0x7f4ce8140a80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4cc8066f30 0x7f4cc80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 --2- 172.21.15.154:0/4122867864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce806f640 0x7f4ce80aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 >> 172.21.15.154:0/4122867864 conn(0x7f4ce80cd480 msgr2=0x7f4ce8152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:16.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 shutdown_connections 2023-10-10T21:18:16.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.111+0000 7f4cecbff700 1 -- 172.21.15.154:0/4122867864 wait complete. 2023-10-10T21:18:16.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T21:18:16.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.312+0000 7f5cd7fff700 1 Processor -- start 2023-10-10T21:18:16.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.312+0000 7f5cd7fff700 1 -- start start 2023-10-10T21:18:16.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.313+0000 7f5cd7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5cd81407e0 0x7f5cd806a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:16.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.313+0000 7f5cd7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 0x7f5cd806a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:16.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.313+0000 7f5cd7fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd80c6820 con 0x7f5cd8140bb0 2023-10-10T21:18:16.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.313+0000 7f5cd7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd80c6de0 con 0x7f5cd81407e0 2023-10-10T21:18:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.313+0000 7f5cd7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8141270 con 0x7f5cd806dc00 2023-10-10T21:18:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd67fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5cd8140bb0 0x7f5cd806d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35482/0 (socket says 172.21.15.154:35482) 2023-10-10T21:18:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd67fc700 1 -- 172.21.15.154:0/3507137961 learned_addr learned my addr 172.21.15.154:0/3507137961 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd6ffd700 1 --2- 172.21.15.154:0/3507137961 >> v2:172.21.15.179:3300/0 conn(0x7f5cd81407e0 0x7f5cd806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd77fe700 1 --2- 172.21.15.154:0/3507137961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 0x7f5cd806a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:16.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd5ffb700 1 -- 172.21.15.154:0/3507137961 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110116573 0 0) 0x7f5cd80c6820 con 0x7f5cd8140bb0 2023-10-10T21:18:16.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd5ffb700 1 -- 172.21.15.154:0/3507137961 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc0003570 con 0x7f5cd8140bb0 2023-10-10T21:18:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd5ffb700 1 -- 172.21.15.154:0/3507137961 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991750789 0 0) 0x7f5cc0003570 con 0x7f5cd8140bb0 2023-10-10T21:18:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd6ffd700 1 -- 172.21.15.154:0/3507137961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 msgr2=0x7f5cd806a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd6ffd700 1 --2- 172.21.15.154:0/3507137961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 0x7f5cd806a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd6ffd700 1 -- 172.21.15.154:0/3507137961 >> v1:172.21.15.154:6789/0 conn(0x7f5cd8140bb0 legacy=0x7f5cd806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd6ffd700 1 -- 172.21.15.154:0/3507137961 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd806acf0 con 0x7f5cd81407e0 2023-10-10T21:18:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.314+0000 7f5cd77fe700 1 --2- 172.21.15.154:0/3507137961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 0x7f5cd806a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.315+0000 7f5cd6ffd700 1 --2- 172.21.15.154:0/3507137961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 0x7f5cd806a180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80098e0 tx=0x7f5cc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=305a3eb5282d7437 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.315+0000 7f5cd5ffb700 1 -- 172.21.15.154:0/3507137961 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc001470 con 0x7f5cd81407e0 2023-10-10T21:18:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.315+0000 7f5cd5ffb700 1 -- 172.21.15.154:0/3507137961 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc8011420 con 0x7f5cd81407e0 2023-10-10T21:18:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.315+0000 7f5cd5ffb700 1 -- 172.21.15.154:0/3507137961 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc80117c0 con 0x7f5cd81407e0 2023-10-10T21:18:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.316+0000 7f5cd7fff700 1 -- 172.21.15.154:0/3507137961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 msgr2=0x7f5cd806a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.316+0000 7f5cd7fff700 1 --2- 172.21.15.154:0/3507137961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 0x7f5cd806a180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80098e0 tx=0x7f5cc80091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.316+0000 7f5cd7fff700 1 -- 172.21.15.154:0/3507137961 shutdown_connections 2023-10-10T21:18:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.316+0000 7f5cd7fff700 1 --2- 172.21.15.154:0/3507137961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 0x7f5cd806a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.316+0000 7f5cd7fff700 1 --2- 172.21.15.154:0/3507137961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 0x7f5cd806a180 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.316+0000 7f5cd7fff700 1 -- 172.21.15.154:0/3507137961 >> 172.21.15.154:0/3507137961 conn(0x7f5cd80cc1e0 msgr2=0x7f5cd80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.316+0000 7f5cd7fff700 1 -- 172.21.15.154:0/3507137961 shutdown_connections 2023-10-10T21:18:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.316+0000 7f5cd7fff700 1 -- 172.21.15.154:0/3507137961 wait complete. 2023-10-10T21:18:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.317+0000 7f5cd7fff700 1 Processor -- start 2023-10-10T21:18:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.317+0000 7f5cd7fff700 1 -- start start 2023-10-10T21:18:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 0x7f5cd813a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 0x7f5cd816d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cd8140bb0 0x7f5cd816de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd7fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80ca4a0 con 0x7f5cd8140bb0 2023-10-10T21:18:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd815cef0 con 0x7f5cd81407e0 2023-10-10T21:18:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80c4420 con 0x7f5cd806dc00 2023-10-10T21:18:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cd8140bb0 0x7f5cd816de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cd8140bb0 0x7f5cd816de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41924/0 (socket says 172.21.15.154:41924) 2023-10-10T21:18:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd77fe700 1 -- 172.21.15.154:0/4255057580 learned_addr learned my addr 172.21.15.154:0/4255057580 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.318+0000 7f5cd6ffd700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 0x7f5cd813a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd67fc700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 0x7f5cd816d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd77fe700 1 -- 172.21.15.154:0/4255057580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 msgr2=0x7f5cd813a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd77fe700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 0x7f5cd813a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd77fe700 1 -- 172.21.15.154:0/4255057580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 msgr2=0x7f5cd816d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd77fe700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 0x7f5cd816d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd77fe700 1 -- 172.21.15.154:0/4255057580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0009a20 con 0x7f5cd8140bb0 2023-10-10T21:18:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd67fc700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 0x7f5cd816d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd77fe700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cd8140bb0 0x7f5cd816de60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000efc0 tx=0x7f5cd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cbeffd700 1 -- 172.21.15.154:0/4255057580 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000cc80 con 0x7f5cd8140bb0 2023-10-10T21:18:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cbeffd700 1 -- 172.21.15.154:0/4255057580 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd000f040 con 0x7f5cd8140bb0 2023-10-10T21:18:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc8009420 con 0x7f5cd8140bb0 2023-10-10T21:18:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cbeffd700 1 -- 172.21.15.154:0/4255057580 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0014480 con 0x7f5cd8140bb0 2023-10-10T21:18:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.319+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd80c9e50 con 0x7f5cd8140bb0 2023-10-10T21:18:16.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.320+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd806c450 con 0x7f5cd8140bb0 2023-10-10T21:18:16.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.321+0000 7f5cbeffd700 1 -- 172.21.15.154:0/4255057580 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cd0014870 con 0x7f5cd8140bb0 2023-10-10T21:18:16.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.322+0000 7f5cbeffd700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5cc4066f30 0x7f5cc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:16.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.322+0000 7f5cbeffd700 1 -- 172.21.15.154:0/4255057580 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5cd0085580 con 0x7f5cd8140bb0 2023-10-10T21:18:16.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.322+0000 7f5cd6ffd700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5cc4066f30 0x7f5cc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:16.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.323+0000 7f5cd6ffd700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5cc4066f30 0x7f5cc40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80030c0 tx=0x7f5cc8016000 comp rx=0 tx=0).ready entity=mgr.6531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:16.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.326+0000 7f5cbeffd700 1 -- 172.21.15.154:0/4255057580 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cd00525c0 con 0x7f5cd8140bb0 2023-10-10T21:18:16.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:16.571+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f5cd806b000 con 0x7f5cd8140bb0 2023-10-10T21:18:17.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.174+0000 7f5cbeffd700 1 -- 172.21.15.154:0/4255057580 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f5cd0052990 con 0x7f5cd8140bb0 2023-10-10T21:18:17.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.174+0000 7f5cbeffd700 1 -- 172.21.15.154:0/4255057580 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v37) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5cd00525c0 con 0x7f5cd8140bb0 2023-10-10T21:18:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5cc4066f30 msgr2=0x7f5cc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5cc4066f30 0x7f5cc40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80030c0 tx=0x7f5cc8016000 comp rx=0 tx=0).stop 2023-10-10T21:18:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cd8140bb0 msgr2=0x7f5cd816de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cd8140bb0 0x7f5cd816de60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000efc0 tx=0x7f5cd000b040 comp rx=0 tx=0).stop 2023-10-10T21:18:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 shutdown_connections 2023-10-10T21:18:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cd8140bb0 0x7f5cd816de60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cd806dc00 0x7f5cd813a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5cc4066f30 0x7f5cc40693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 --2- 172.21.15.154:0/4255057580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cd81407e0 0x7f5cd816d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 >> 172.21.15.154:0/4255057580 conn(0x7f5cd80cc1e0 msgr2=0x7f5cd806a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 shutdown_connections 2023-10-10T21:18:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.178+0000 7f5cd7fff700 1 -- 172.21.15.154:0/4255057580 wait complete. 2023-10-10T21:18:17.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T21:18:17.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.396+0000 7f19bb59e700 1 Processor -- start 2023-10-10T21:18:17.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.396+0000 7f19bb59e700 1 -- start start 2023-10-10T21:18:17.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.397+0000 7f19bb59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19bc0b4e70 0x7f19bc0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.397+0000 7f19bb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b16d0 0x7f19bc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.397+0000 7f19bb59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc0b2080 con 0x7f19bc15d240 2023-10-10T21:18:17.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.397+0000 7f19bb59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0cfb00 con 0x7f19bc0b4e70 2023-10-10T21:18:17.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.397+0000 7f19bb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0b5c40 con 0x7f19bc0b16d0 2023-10-10T21:18:17.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19bad9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f19bc15d240 0x7f19bc15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35490/0 (socket says 172.21.15.154:35490) 2023-10-10T21:18:17.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19bad9d700 1 -- 172.21.15.154:0/3044051891 learned_addr learned my addr 172.21.15.154:0/3044051891 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:17.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19ba59c700 1 --2- 172.21.15.154:0/3044051891 >> v2:172.21.15.179:3300/0 conn(0x7f19bc0b4e70 0x7f19bc0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19b9d9b700 1 --2- 172.21.15.154:0/3044051891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b16d0 0x7f19bc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19ba59c700 1 -- 172.21.15.154:0/3044051891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b16d0 msgr2=0x7f19bc0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:17.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19ba59c700 1 --2- 172.21.15.154:0/3044051891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b16d0 0x7f19bc0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19ba59c700 1 -- 172.21.15.154:0/3044051891 >> v1:172.21.15.154:6789/0 conn(0x7f19bc15d240 legacy=0x7f19bc15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19b959a700 1 -- 172.21.15.154:0/3044051891 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418744865 0 0) 0x7f19bc0b2080 con 0x7f19bc15d240 2023-10-10T21:18:17.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19ba59c700 1 -- 172.21.15.154:0/3044051891 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc0b5f20 con 0x7f19bc0b4e70 2023-10-10T21:18:17.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19b9d9b700 1 --2- 172.21.15.154:0/3044051891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b16d0 0x7f19bc0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:17.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.398+0000 7f19ba59c700 1 --2- 172.21.15.154:0/3044051891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc0b4e70 0x7f19bc0ccff0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0098e0 tx=0x7f19ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df32751d569168c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:17.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19b959a700 1 -- 172.21.15.154:0/3044051891 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00b640 con 0x7f19bc0b4e70 2023-10-10T21:18:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19b959a700 1 -- 172.21.15.154:0/3044051891 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac00b7a0 con 0x7f19bc0b4e70 2023-10-10T21:18:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19b959a700 1 -- 172.21.15.154:0/3044051891 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00bb40 con 0x7f19bc0b4e70 2023-10-10T21:18:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19bb59e700 1 -- 172.21.15.154:0/3044051891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc0b4e70 msgr2=0x7f19bc0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19bb59e700 1 --2- 172.21.15.154:0/3044051891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc0b4e70 0x7f19bc0ccff0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0098e0 tx=0x7f19ac0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19bb59e700 1 -- 172.21.15.154:0/3044051891 shutdown_connections 2023-10-10T21:18:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19bb59e700 1 --2- 172.21.15.154:0/3044051891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc0b4e70 0x7f19bc0ccff0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19bb59e700 1 --2- 172.21.15.154:0/3044051891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b16d0 0x7f19bc0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19bb59e700 1 -- 172.21.15.154:0/3044051891 >> 172.21.15.154:0/3044051891 conn(0x7f19bc0d10c0 msgr2=0x7f19bc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.399+0000 7f19bb59e700 1 -- 172.21.15.154:0/3044051891 shutdown_connections 2023-10-10T21:18:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.400+0000 7f19bb59e700 1 -- 172.21.15.154:0/3044051891 wait complete. 2023-10-10T21:18:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.401+0000 7f19bb59e700 1 Processor -- start 2023-10-10T21:18:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.401+0000 7f19bb59e700 1 -- start start 2023-10-10T21:18:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19bb59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19bc0b16d0 0x7f19bc1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19bb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b4e70 0x7f19bc0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19bb59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc15d240 0x7f19bc0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19bb59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0cc430 con 0x7f19bc0b16d0 2023-10-10T21:18:17.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19bb59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0c6770 con 0x7f19bc15d240 2023-10-10T21:18:17.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19bb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0c9e90 con 0x7f19bc0b4e70 2023-10-10T21:18:17.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19ba59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19bc0b16d0 0x7f19bc1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19ba59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19bc0b16d0 0x7f19bc1576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41960/0 (socket says 172.21.15.154:41960) 2023-10-10T21:18:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19ba59c700 1 -- 172.21.15.154:0/1263188354 learned_addr learned my addr 172.21.15.154:0/1263188354 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19b9d9b700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b4e70 0x7f19bc0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.402+0000 7f19bad9d700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc15d240 0x7f19bc0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19ba59c700 1 -- 172.21.15.154:0/1263188354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b4e70 msgr2=0x7f19bc0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19ba59c700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b4e70 0x7f19bc0cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19ba59c700 1 -- 172.21.15.154:0/1263188354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc15d240 msgr2=0x7f19bc0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19ba59c700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc15d240 0x7f19bc0cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19ba59c700 1 -- 172.21.15.154:0/1263188354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0009420 con 0x7f19bc0b16d0 2023-10-10T21:18:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19ba59c700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19bc0b16d0 0x7f19bc1576e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0093f0 tx=0x7f19ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19aa7fc700 1 -- 172.21.15.154:0/1263188354 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac01f070 con 0x7f19bc0b16d0 2023-10-10T21:18:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19aa7fc700 1 -- 172.21.15.154:0/1263188354 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac00b910 con 0x7f19bc0b16d0 2023-10-10T21:18:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19aa7fc700 1 -- 172.21.15.154:0/1263188354 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac011420 con 0x7f19bc0b16d0 2023-10-10T21:18:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac009420 con 0x7f19bc0b16d0 2023-10-10T21:18:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.403+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc0ca220 con 0x7f19bc0b16d0 2023-10-10T21:18:17.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.404+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc0ca570 con 0x7f19bc0b16d0 2023-10-10T21:18:17.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.405+0000 7f19aa7fc700 1 -- 172.21.15.154:0/1263188354 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f19ac0117d0 con 0x7f19bc0b16d0 2023-10-10T21:18:17.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.407+0000 7f19aa7fc700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f199c066f80 0x7f199c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.407+0000 7f19b9d9b700 1 -- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f199c066f80 msgr2=0x7f199c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:17.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.407+0000 7f19aa7fc700 1 -- 172.21.15.154:0/1263188354 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f19ac085f60 con 0x7f19bc0b16d0 2023-10-10T21:18:17.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.407+0000 7f19b9d9b700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f199c066f80 0x7f199c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:17.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.410+0000 7f19aa7fc700 1 -- 172.21.15.154:0/1263188354 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19ac052fa0 con 0x7f19bc0b16d0 2023-10-10T21:18:17.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.608+0000 7f19b9d9b700 1 -- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f199c066f80 msgr2=0x7f199c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:17.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.608+0000 7f19b9d9b700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f199c066f80 0x7f199c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:17.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.609+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f19bc04bb80 con 0x7f19bc0b16d0 2023-10-10T21:18:17.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.615+0000 7f19aa7fc700 1 -- 172.21.15.154:0/1263188354 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f19ac0565c0 con 0x7f19bc0b16d0 2023-10-10T21:18:17.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.617+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f199c066f80 msgr2=0x7f199c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:17.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.617+0000 7f19bb59e700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f199c066f80 0x7f199c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.617+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19bc0b16d0 msgr2=0x7f19bc1576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.617+0000 7f19bb59e700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19bc0b16d0 0x7f19bc1576e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0093f0 tx=0x7f19ac017000 comp rx=0 tx=0).stop 2023-10-10T21:18:17.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.618+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 shutdown_connections 2023-10-10T21:18:17.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.618+0000 7f19bb59e700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f199c066f80 0x7f199c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.618+0000 7f19bb59e700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc15d240 0x7f19bc0cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.618+0000 7f19bb59e700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19bc0b16d0 0x7f19bc1576e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.618+0000 7f19bb59e700 1 --2- 172.21.15.154:0/1263188354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19bc0b4e70 0x7f19bc0cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.618+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 >> 172.21.15.154:0/1263188354 conn(0x7f19bc0d10c0 msgr2=0x7f19bc15c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:17.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.618+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 shutdown_connections 2023-10-10T21:18:17.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.618+0000 7f19bb59e700 1 -- 172.21.15.154:0/1263188354 wait complete. 2023-10-10T21:18:17.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T21:18:17.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.827+0000 7efee099d700 1 Processor -- start 2023-10-10T21:18:17.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.827+0000 7efee099d700 1 -- start start 2023-10-10T21:18:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.828+0000 7efee099d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efedc0cb1a0 0x7efedc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.828+0000 7efee099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc15a8a0 0x7efedc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.828+0000 7efee099d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efedc06ebd0 con 0x7efedc06f5a0 2023-10-10T21:18:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.828+0000 7efee099d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efedc15b2e0 con 0x7efedc0cb1a0 2023-10-10T21:18:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.828+0000 7efee099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc15ad20 con 0x7efedc15a8a0 2023-10-10T21:18:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.828+0000 7efedbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efedc06f5a0 0x7efedc0ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35498/0 (socket says 172.21.15.154:35498) 2023-10-10T21:18:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.828+0000 7efedbfff700 1 -- 172.21.15.154:0/2547252902 learned_addr learned my addr 172.21.15.154:0/2547252902 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.829+0000 7efedb7fe700 1 --2- 172.21.15.154:0/2547252902 >> v2:172.21.15.179:3300/0 conn(0x7efedc0cb1a0 0x7efedc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.829+0000 7efedaffd700 1 --2- 172.21.15.154:0/2547252902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc15a8a0 0x7efedc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.829+0000 7efeda7fc700 1 -- 172.21.15.154:0/2547252902 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007179874 0 0) 0x7efedc06ebd0 con 0x7efedc06f5a0 2023-10-10T21:18:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.829+0000 7efeda7fc700 1 -- 172.21.15.154:0/2547252902 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec4003570 con 0x7efedc06f5a0 2023-10-10T21:18:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.829+0000 7efedaffd700 1 -- 172.21.15.154:0/2547252902 >> v2:172.21.15.179:3300/0 conn(0x7efedc0cb1a0 msgr2=0x7efedc15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.829+0000 7efedaffd700 1 --2- 172.21.15.154:0/2547252902 >> v2:172.21.15.179:3300/0 conn(0x7efedc0cb1a0 0x7efedc15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.829+0000 7efedaffd700 1 -- 172.21.15.154:0/2547252902 >> v1:172.21.15.154:6789/0 conn(0x7efedc06f5a0 legacy=0x7efedc0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.829+0000 7efedaffd700 1 -- 172.21.15.154:0/2547252902 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc15b000 con 0x7efedc15a8a0 2023-10-10T21:18:17.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.829+0000 7efedaffd700 1 --2- 172.21.15.154:0/2547252902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc15a8a0 0x7efedc06f060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efed00098e0 tx=0x7efed00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb45815c334c8786 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:17.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efeda7fc700 1 -- 172.21.15.154:0/2547252902 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0011630 con 0x7efedc15a8a0 2023-10-10T21:18:17.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efeda7fc700 1 -- 172.21.15.154:0/2547252902 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed0011790 con 0x7efedc15a8a0 2023-10-10T21:18:17.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efeda7fc700 1 -- 172.21.15.154:0/2547252902 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0011b30 con 0x7efedc15a8a0 2023-10-10T21:18:17.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efee099d700 1 -- 172.21.15.154:0/2547252902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc15a8a0 msgr2=0x7efedc06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efee099d700 1 --2- 172.21.15.154:0/2547252902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc15a8a0 0x7efedc06f060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efed00098e0 tx=0x7efed00091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efee099d700 1 -- 172.21.15.154:0/2547252902 shutdown_connections 2023-10-10T21:18:17.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efee099d700 1 --2- 172.21.15.154:0/2547252902 >> v2:172.21.15.179:3300/0 conn(0x7efedc0cb1a0 0x7efedc15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efee099d700 1 --2- 172.21.15.154:0/2547252902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc15a8a0 0x7efedc06f060 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efee099d700 1 -- 172.21.15.154:0/2547252902 >> 172.21.15.154:0/2547252902 conn(0x7efedc0cc1e0 msgr2=0x7efedc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:17.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efee099d700 1 -- 172.21.15.154:0/2547252902 shutdown_connections 2023-10-10T21:18:17.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.830+0000 7efee099d700 1 -- 172.21.15.154:0/2547252902 wait complete. 2023-10-10T21:18:17.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.832+0000 7efee099d700 1 Processor -- start 2023-10-10T21:18:17.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.832+0000 7efee099d700 1 -- start start 2023-10-10T21:18:17.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efee099d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efedc06f5a0 0x7efedc14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efee099d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efedc0cb1a0 0x7efedc0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efee099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc0c7df0 0x7efedc0c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efee099d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0c5770 con 0x7efedc06f5a0 2023-10-10T21:18:17.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efee099d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0c5d30 con 0x7efedc0cb1a0 2023-10-10T21:18:17.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efee099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0c8250 con 0x7efedc0c7df0 2023-10-10T21:18:17.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efedc06f5a0 0x7efedc14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efedc06f5a0 0x7efedc14fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41970/0 (socket says 172.21.15.154:41970) 2023-10-10T21:18:17.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedb7fe700 1 -- 172.21.15.154:0/1370649154 learned_addr learned my addr 172.21.15.154:0/1370649154 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:17.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedaffd700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efedc0cb1a0 0x7efedc0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedbfff700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc0c7df0 0x7efedc0c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:17.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedb7fe700 1 -- 172.21.15.154:0/1370649154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc0c7df0 msgr2=0x7efedc0c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedb7fe700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc0c7df0 0x7efedc0c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedb7fe700 1 -- 172.21.15.154:0/1370649154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efedc0cb1a0 msgr2=0x7efedc0c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:17.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedb7fe700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efedc0cb1a0 0x7efedc0c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:17.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedb7fe700 1 -- 172.21.15.154:0/1370649154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0009420 con 0x7efedc06f5a0 2023-10-10T21:18:17.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.833+0000 7efedbfff700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc0c7df0 0x7efedc0c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:17.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.834+0000 7efedb7fe700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efedc06f5a0 0x7efedc14fdb0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efecc00ecb0 tx=0x7efecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:17.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.834+0000 7efec37fe700 1 -- 172.21.15.154:0/1370649154 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00c920 con 0x7efedc06f5a0 2023-10-10T21:18:17.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.834+0000 7efec37fe700 1 -- 172.21.15.154:0/1370649154 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc00ca80 con 0x7efedc06f5a0 2023-10-10T21:18:17.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.834+0000 7efec37fe700 1 -- 172.21.15.154:0/1370649154 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00ce20 con 0x7efedc06f5a0 2023-10-10T21:18:17.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.834+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc0c4050 con 0x7efedc06f5a0 2023-10-10T21:18:17.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.834+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc0c59c0 con 0x7efedc06f5a0 2023-10-10T21:18:17.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.835+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efedc06c450 con 0x7efedc06f5a0 2023-10-10T21:18:17.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.836+0000 7efec37fe700 1 -- 172.21.15.154:0/1370649154 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7efecc013680 con 0x7efedc06f5a0 2023-10-10T21:18:17.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.837+0000 7efec37fe700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efec8066f80 0x7efec8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:17.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.837+0000 7efec37fe700 1 -- 172.21.15.154:0/1370649154 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7efecc084a70 con 0x7efedc06f5a0 2023-10-10T21:18:17.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.837+0000 7efedaffd700 1 -- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efec8066f80 msgr2=0x7efec8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:17.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.837+0000 7efedaffd700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efec8066f80 0x7efec8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:17.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:17.845+0000 7efec37fe700 1 -- 172.21.15.154:0/1370649154 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efecc051b50 con 0x7efedc06f5a0 2023-10-10T21:18:18.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.038+0000 7efedaffd700 1 -- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efec8066f80 msgr2=0x7efec8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:18.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.038+0000 7efedaffd700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efec8066f80 0x7efec8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:18.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.045+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7efedc06e860 con 0x7efedc06f5a0 2023-10-10T21:18:18.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.050+0000 7efec37fe700 1 -- 172.21.15.154:0/1370649154 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7efecc055170 con 0x7efedc06f5a0 2023-10-10T21:18:18.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efec8066f80 msgr2=0x7efec8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efec8066f80 0x7efec8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efedc06f5a0 msgr2=0x7efedc14fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efedc06f5a0 0x7efedc14fdb0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efecc00ecb0 tx=0x7efecc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 shutdown_connections 2023-10-10T21:18:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efedc0c7df0 0x7efedc0c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efedc06f5a0 0x7efedc14fdb0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efec8066f80 0x7efec8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 --2- 172.21.15.154:0/1370649154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efedc0cb1a0 0x7efedc0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 >> 172.21.15.154:0/1370649154 conn(0x7efedc0cc1e0 msgr2=0x7efedc0af140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 shutdown_connections 2023-10-10T21:18:18.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.052+0000 7efee099d700 1 -- 172.21.15.154:0/1370649154 wait complete. 2023-10-10T21:18:18.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-10T21:18:18.446 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:18.446+0000 7fb0b673c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:18:18.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.472+0000 7fa93239d700 1 Processor -- start 2023-10-10T21:18:18.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.472+0000 7fa93239d700 1 -- start start 2023-10-10T21:18:18.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.473+0000 7fa93239d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa92c0ac0e0 0x7fa92c0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:18.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.473+0000 7fa93239d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa92c06f0b0 0x7fa92c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:18.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.473+0000 7fa93239d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c06e510 con 0x7fa92c1597d0 2023-10-10T21:18:18.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.473+0000 7fa93239d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c069180 con 0x7fa92c06f0b0 2023-10-10T21:18:18.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.473+0000 7fa93239d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c06dec0 con 0x7fa92c0ac0e0 2023-10-10T21:18:18.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.474+0000 7fa931b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa92c06f0b0 0x7fa92c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:18.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.474+0000 7fa931b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa92c06f0b0 0x7fa92c15d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41984/0 (socket says 172.21.15.154:41984) 2023-10-10T21:18:18.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.474+0000 7fa931b9c700 1 -- 172.21.15.154:0/3139014938 learned_addr learned my addr 172.21.15.154:0/3139014938 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:18.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.474+0000 7fa930b9a700 1 --2- 172.21.15.154:0/3139014938 >> v2:172.21.15.179:3300/0 conn(0x7fa92c0ac0e0 0x7fa92c0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:18.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.474+0000 7fa931b9c700 1 -- 172.21.15.154:0/3139014938 >> v2:172.21.15.179:3300/0 conn(0x7fa92c0ac0e0 msgr2=0x7fa92c0afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:18.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.474+0000 7fa931b9c700 1 --2- 172.21.15.154:0/3139014938 >> v2:172.21.15.179:3300/0 conn(0x7fa92c0ac0e0 0x7fa92c0afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.474+0000 7fa931b9c700 1 -- 172.21.15.154:0/3139014938 >> v1:172.21.15.154:6789/0 conn(0x7fa92c1597d0 legacy=0x7fa92c06e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:18.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.474+0000 7fa931b9c700 1 -- 172.21.15.154:0/3139014938 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c06e1a0 con 0x7fa92c06f0b0 2023-10-10T21:18:18.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.475+0000 7fa931b9c700 1 --2- 172.21.15.154:0/3139014938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c06f0b0 0x7fa92c15d440 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa92c06dbf0 tx=0x7fa924009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb646f57103996d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:18.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.475+0000 7fa923fff700 1 -- 172.21.15.154:0/3139014938 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92400e070 con 0x7fa92c06f0b0 2023-10-10T21:18:18.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.475+0000 7fa923fff700 1 -- 172.21.15.154:0/3139014938 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92400ba20 con 0x7fa92c06f0b0 2023-10-10T21:18:18.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.475+0000 7fa923fff700 1 -- 172.21.15.154:0/3139014938 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9240092e0 con 0x7fa92c06f0b0 2023-10-10T21:18:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.476+0000 7fa93239d700 1 -- 172.21.15.154:0/3139014938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c06f0b0 msgr2=0x7fa92c15d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.476+0000 7fa93239d700 1 --2- 172.21.15.154:0/3139014938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c06f0b0 0x7fa92c15d440 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa92c06dbf0 tx=0x7fa924009840 comp rx=0 tx=0).stop 2023-10-10T21:18:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.476+0000 7fa93239d700 1 -- 172.21.15.154:0/3139014938 shutdown_connections 2023-10-10T21:18:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.476+0000 7fa93239d700 1 --2- 172.21.15.154:0/3139014938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c06f0b0 0x7fa92c15d440 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.476+0000 7fa93239d700 1 --2- 172.21.15.154:0/3139014938 >> v2:172.21.15.179:3300/0 conn(0x7fa92c0ac0e0 0x7fa92c0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.476+0000 7fa93239d700 1 -- 172.21.15.154:0/3139014938 >> 172.21.15.154:0/3139014938 conn(0x7fa92c06adf0 msgr2=0x7fa92c0ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:18.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.476+0000 7fa93239d700 1 -- 172.21.15.154:0/3139014938 shutdown_connections 2023-10-10T21:18:18.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.476+0000 7fa93239d700 1 -- 172.21.15.154:0/3139014938 wait complete. 2023-10-10T21:18:18.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.477+0000 7fa93239d700 1 Processor -- start 2023-10-10T21:18:18.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.477+0000 7fa93239d700 1 -- start start 2023-10-10T21:18:18.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.478+0000 7fa93239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa92c06f0b0 0x7fa92c147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:18.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.478+0000 7fa93239d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92c1597d0 0x7fa92c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:18.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.478+0000 7fa93239d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c0aede0 0x7fa92c15d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:18.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.478+0000 7fa93239d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0af240 con 0x7fa92c0aede0 2023-10-10T21:18:18.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.478+0000 7fa93239d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c16ad30 con 0x7fa92c1597d0 2023-10-10T21:18:18.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.478+0000 7fa93239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c16b5d0 con 0x7fa92c06f0b0 2023-10-10T21:18:18.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa931b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c0aede0 0x7fa92c15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:18.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa930b9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92c1597d0 0x7fa92c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:18.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa931b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c0aede0 0x7fa92c15d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41998/0 (socket says 172.21.15.154:41998) 2023-10-10T21:18:18.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa930b9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92c1597d0 0x7fa92c0ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:46676/0 (socket says 172.21.15.154:46676) 2023-10-10T21:18:18.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa931b9c700 1 -- 172.21.15.154:0/51620657 learned_addr learned my addr 172.21.15.154:0/51620657 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:18.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa93139b700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa92c06f0b0 0x7fa92c147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:18.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa930b9a700 1 -- 172.21.15.154:0/51620657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa92c06f0b0 msgr2=0x7fa92c147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:18.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa930b9a700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa92c06f0b0 0x7fa92c147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa930b9a700 1 -- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c0aede0 msgr2=0x7fa92c15d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:18.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa930b9a700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c0aede0 0x7fa92c15d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:18.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa930b9a700 1 -- 172.21.15.154:0/51620657 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924009ae0 con 0x7fa92c1597d0 2023-10-10T21:18:18.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa931b9c700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa92c0aede0 0x7fa92c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:18.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.479+0000 7fa930b9a700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa92c1597d0 0x7fa92c0ae8a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00ea50 tx=0x7fa91c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:18.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.480+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c00ee90 con 0x7fa92c1597d0 2023-10-10T21:18:18.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.480+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c00c7f0 con 0x7fa92c1597d0 2023-10-10T21:18:18.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.480+0000 7fa93239d700 1 -- 172.21.15.154:0/51620657 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c15dd80 con 0x7fa92c1597d0 2023-10-10T21:18:18.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.480+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c00cb90 con 0x7fa92c1597d0 2023-10-10T21:18:18.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.480+0000 7fa93239d700 1 -- 172.21.15.154:0/51620657 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c16b260 con 0x7fa92c1597d0 2023-10-10T21:18:18.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.481+0000 7fa93239d700 1 -- 172.21.15.154:0/51620657 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c04c3c0 con 0x7fa92c1597d0 2023-10-10T21:18:18.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.482+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fa91c013470 con 0x7fa92c1597d0 2023-10-10T21:18:18.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.483+0000 7fa9217fa700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa910069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:18.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.483+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa91c084950 con 0x7fa92c1597d0 2023-10-10T21:18:18.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.483+0000 7fa93139b700 1 -- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 msgr2=0x7fa910069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:18.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.483+0000 7fa93139b700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa910069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:18.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.487+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa91c051990 con 0x7fa92c1597d0 2023-10-10T21:18:18.525 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:18.524+0000 7f96d005e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:18:18.610 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:18.610+0000 7fb0b673c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:18.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.684+0000 7fa93139b700 1 -- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 msgr2=0x7fa910069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:18.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.684+0000 7fa93139b700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa910069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:18.696 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:18.695+0000 7fb0b673c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:18:18.696 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:18.696+0000 7f96d005e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:18.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:18.712+0000 7fa93239d700 1 -- 172.21.15.154:0/51620657 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa92c068390 con 0x7fa910066f80 2023-10-10T21:18:18.781 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:18.780+0000 7f96d005e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:18:18.921 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:18.921+0000 7fb0b673c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:18:19.008 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:19.006+0000 7f96d005e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:18:19.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:19.085+0000 7fa93139b700 1 -- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 msgr2=0x7fa910069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:19.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:19.085+0000 7fa93139b700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa910069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:18:19.100 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:19.099+0000 7fb0b673c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:18:19.191 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:19.190+0000 7f96d005e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:18:19.196 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:19.196+0000 7fb0b673c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:18:19.284 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:19.283+0000 7f96d005e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:18:19.358 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:19.357+0000 7fb0b673c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:18:19.369 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:18:19.374 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:18:19.453 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:19.452+0000 7f96d005e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:18:19.463 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:19.463+0000 7fb0b673c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:19.556 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:19.555+0000 7f96d005e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:19.886+0000 7fa93139b700 1 -- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 msgr2=0x7fa910069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:19.886+0000 7fa93139b700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa910069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T21:18:19.948 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:19.947+0000 7fb0b673c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:18:20.042 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:20.041+0000 7fb0b673c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:18:20.045 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:20.044+0000 7f96d005e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:18:20.138 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:20.133+0000 7fb0b673c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:18:20.140 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:20.139+0000 7f96d005e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:18:20.231 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:20.230+0000 7f96d005e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:18:20.754 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:20.754+0000 7fb0b673c180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:18:20.859 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:20.858+0000 7f96d005e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:18:20.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:20.927+0000 7fb0b673c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:18:21.022 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:21.021+0000 7fb0b673c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:18:21.033 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:21.032+0000 7f96d005e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:18:21.130 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:21.129+0000 7f96d005e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:18:21.318 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:21.318+0000 7fb0b673c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:18:21.415 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:21.414+0000 7fb0b673c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:18:21.427 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:21.426+0000 7f96d005e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:18:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:21.488+0000 7fa93139b700 1 -- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 msgr2=0x7fa910069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:21.488+0000 7fa93139b700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa910069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T21:18:21.524 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:21.522+0000 7f96d005e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:18:22.115 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:22.114+0000 7fb0b673c180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:18:22.229 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:22.228+0000 7f96d005e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:18:22.400 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:22.400+0000 7fb0b673c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:18:22.493 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:22.492+0000 7fb0b673c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:18:22.516 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:22.515+0000 7f96d005e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:18:22.611 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:22.610+0000 7f96d005e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:18:22.646 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:22.645+0000 7fb0b673c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:18:22.750 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:22.750+0000 7fb0b673c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:18:22.766 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:22.765+0000 7f96d005e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:18:22.872 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:22.871+0000 7f96d005e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:18:22.936 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:22.936+0000 7fb0b673c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:18:23.027 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:23.027+0000 7fb0b673c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:18:23.065 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.064+0000 7f96d005e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:18:23.118 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:23.117+0000 7fb0b673c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:18:23.159 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.158+0000 7f96d005e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:18:23.211 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:23.211+0000 7fb0b673c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:18:23.251 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.250+0000 7f96d005e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:18:23.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:23.271+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mgrmap(e 38) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fa91c051d60 con 0x7fa92c1597d0 2023-10-10T21:18:23.349 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.348+0000 7f96d005e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:18:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:23.362+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mon.1 v2:172.21.15.179:3300/0 8 ==== mgrmap(e 39) v1 ==== 84468+0+0 (secure 0 0 0) 0x7fa91c060a50 con 0x7fa92c1597d0 2023-10-10T21:18:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:23.363+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 msgr2=0x7fa910069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:23.363+0000 7fa9217fa700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa910069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:23.481 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.479+0000 7f9645337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:23.482 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.479+0000 7f9645337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:23.482 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.479+0000 7f9645337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:23.482 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.479+0000 7f9645337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:23.483 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.479+0000 7f9645337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:23.483 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.480+0000 7f9641b30700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:23.483 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.480+0000 7f9641b30700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:23.483 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.480+0000 7f9641b30700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:23.484 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.480+0000 7f9641b30700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:23.484 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:23.480+0000 7f9641b30700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:18:24.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.365+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mon.1 v2:172.21.15.179:3300/0 9 ==== mgrmap(e 40) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fa91c052630 con 0x7fa92c1597d0 2023-10-10T21:18:24.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.366+0000 7fa9217fa700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa9100693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:24.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.366+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa92c068390 con 0x7fa910066f80 2023-10-10T21:18:24.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.368+0000 7fa93139b700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa9100693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:24.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.370+0000 7fa93139b700 1 --2- 172.21.15.154:0/51620657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fa910066f80 0x7fa9100693b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa928001200 tx=0x7fa928007ec0 comp rx=0 tx=0).ready entity=mgr.6924 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:24.379 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:24.378+0000 7f964c345700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-10T21:18:24.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.378+0000 7fa9217fa700 1 -- 172.21.15.154:0/51620657 <== mgr.6924 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fa92c068390 con 0x7fa910066f80 2023-10-10T21:18:24.381 INFO:teuthology.orchestra.run.smithi154.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-10T21:18:24.390 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-10T21:18:24.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T21:18:24.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.575+0000 7fce6d99d700 1 Processor -- start 2023-10-10T21:18:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.576+0000 7fce6d99d700 1 -- start start 2023-10-10T21:18:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.577+0000 7fce6d99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce680ae7e0 0x7fce680c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.577+0000 7fce6d99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6806ebd0 con 0x7fce680cb1a0 2023-10-10T21:18:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.577+0000 7fce6d99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6815aa70 con 0x7fce6806f060 2023-10-10T21:18:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.577+0000 7fce6d99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6815b2e0 con 0x7fce680ae7e0 2023-10-10T21:18:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.577+0000 7fce6c99b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fce680cb1a0 0x7fce6815a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35518/0 (socket says 172.21.15.154:35518) 2023-10-10T21:18:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.577+0000 7fce6c99b700 1 -- 172.21.15.154:0/3465742392 learned_addr learned my addr 172.21.15.154:0/3465742392 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.577+0000 7fce6d19c700 1 --2- 172.21.15.154:0/3465742392 >> v2:172.21.15.179:3300/0 conn(0x7fce680ae7e0 0x7fce680c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.577+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343606843 0 0) 0x7fce6806ebd0 con 0x7fce680cb1a0 2023-10-10T21:18:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce58003570 con 0x7fce680cb1a0 2023-10-10T21:18:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 813267598 0 0) 0x7fce58003570 con 0x7fce680cb1a0 2023-10-10T21:18:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 >> v2:172.21.15.179:3300/0 conn(0x7fce680ae7e0 msgr2=0x7fce680c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 --2- 172.21.15.154:0/3465742392 >> v2:172.21.15.179:3300/0 conn(0x7fce680ae7e0 0x7fce680c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 >> v1:172.21.15.179:6789/0 conn(0x7fce6806f060 legacy=0x7fce680ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6815ad20 con 0x7fce680cb1a0 2023-10-10T21:18:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fce5c001470 con 0x7fce680cb1a0 2023-10-10T21:18:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 >> v1:172.21.15.154:6789/0 conn(0x7fce680cb1a0 legacy=0x7fce6815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce58003a60 0x7fce58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce58004810 0x7fce58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:24.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce580051c0 0x7fce5800dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:24.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6815b2e0 con 0x7fce58003a60 2023-10-10T21:18:24.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5800e2e0 con 0x7fce58004810 2023-10-10T21:18:24.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5800e4a0 con 0x7fce580051c0 2023-10-10T21:18:24.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce6d19c700 1 --2- 172.21.15.154:0/3465742392 >> v2:172.21.15.179:3300/0 conn(0x7fce680ae7e0 0x7fce680c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:24.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce6c99b700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce58003a60 0x7fce58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:24.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.578+0000 7fce67fff700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce58004810 0x7fce58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:24.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6d19c700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce580051c0 0x7fce5800dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:24.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6c99b700 1 -- 172.21.15.154:0/3465742392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce580051c0 msgr2=0x7fce5800dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:24.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6c99b700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce580051c0 0x7fce5800dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:24.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6c99b700 1 -- 172.21.15.154:0/3465742392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce58004810 msgr2=0x7fce58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:24.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6c99b700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce58004810 0x7fce58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:24.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6c99b700 1 -- 172.21.15.154:0/3465742392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58003570 con 0x7fce58003a60 2023-10-10T21:18:24.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6d19c700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce580051c0 0x7fce5800dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:24.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6d19c700 1 -- 172.21.15.154:0/3465742392 reap_dead start 2023-10-10T21:18:24.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6c99b700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce58003a60 0x7fce58003e70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00c390 tx=0x7fce680c8be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238f3cb0137642a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:24.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00cc60 con 0x7fce58003a60 2023-10-10T21:18:24.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c00cdc0 con 0x7fce58003a60 2023-10-10T21:18:24.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce677fe700 1 -- 172.21.15.154:0/3465742392 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c005b70 con 0x7fce58003a60 2023-10-10T21:18:24.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6d99d700 1 -- 172.21.15.154:0/3465742392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce58003a60 msgr2=0x7fce58003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:24.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.579+0000 7fce6d99d700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce58003a60 0x7fce58003e70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00c390 tx=0x7fce680c8be0 comp rx=0 tx=0).stop 2023-10-10T21:18:24.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.580+0000 7fce6d99d700 1 -- 172.21.15.154:0/3465742392 shutdown_connections 2023-10-10T21:18:24.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.580+0000 7fce6d99d700 1 --2- 172.21.15.154:0/3465742392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce58003a60 0x7fce58003e70 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:24.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.580+0000 7fce6d99d700 1 -- 172.21.15.154:0/3465742392 >> 172.21.15.154:0/3465742392 conn(0x7fce680cc1e0 msgr2=0x7fce680cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:24.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.580+0000 7fce6d99d700 1 -- 172.21.15.154:0/3465742392 shutdown_connections 2023-10-10T21:18:24.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.580+0000 7fce6d99d700 1 -- 172.21.15.154:0/3465742392 wait complete. 2023-10-10T21:18:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.581+0000 7fce6d99d700 1 Processor -- start 2023-10-10T21:18:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.581+0000 7fce6d99d700 1 -- start start 2023-10-10T21:18:24.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6d99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce58003a60 0x7fce680c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:24.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6d99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6814b020 0x7fce680b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:24.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6d99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce680c3290 0x7fce680c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:24.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6d99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce680c3c40 con 0x7fce680c3290 2023-10-10T21:18:24.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6d99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce680b0600 con 0x7fce6814b020 2023-10-10T21:18:24.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6d99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce680afa30 con 0x7fce58003a60 2023-10-10T21:18:24.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6d19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce680c3290 0x7fce680c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:24.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6d19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce680c3290 0x7fce680c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42162/0 (socket says 172.21.15.154:42162) 2023-10-10T21:18:24.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6c99b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce58003a60 0x7fce680c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:24.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce6d19c700 1 -- 172.21.15.154:0/3714553715 learned_addr learned my addr 172.21.15.154:0/3714553715 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.582+0000 7fce67fff700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6814b020 0x7fce680b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce6d19c700 1 -- 172.21.15.154:0/3714553715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce58003a60 msgr2=0x7fce680c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce6d19c700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce58003a60 0x7fce680c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce6d19c700 1 -- 172.21.15.154:0/3714553715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6814b020 msgr2=0x7fce680b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce6d19c700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6814b020 0x7fce680b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce6d19c700 1 -- 172.21.15.154:0/3714553715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce680afcd0 con 0x7fce680c3290 2023-10-10T21:18:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce6d19c700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce680c3290 0x7fce680c3700 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fce6806d2a0 tx=0x7fce6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce64ff9700 1 -- 172.21.15.154:0/3714553715 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000fc20 con 0x7fce680c3290 2023-10-10T21:18:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce64ff9700 1 -- 172.21.15.154:0/3714553715 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6000fda0 con 0x7fce680c3290 2023-10-10T21:18:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce680affb0 con 0x7fce680c3290 2023-10-10T21:18:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce64ff9700 1 -- 172.21.15.154:0/3714553715 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60016670 con 0x7fce680c3290 2023-10-10T21:18:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.583+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce680b1790 con 0x7fce680c3290 2023-10-10T21:18:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.584+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce680b07b0 con 0x7fce680c3290 2023-10-10T21:18:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.585+0000 7fce64ff9700 1 -- 172.21.15.154:0/3714553715 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 40) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fce60016a60 con 0x7fce680c3290 2023-10-10T21:18:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.586+0000 7fce64ff9700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce4c066dd0 0x7fce4c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.586+0000 7fce64ff9700 1 -- 172.21.15.154:0/3714553715 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fce60084f20 con 0x7fce680c3290 2023-10-10T21:18:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.586+0000 7fce6c99b700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce4c066dd0 0x7fce4c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.587+0000 7fce6c99b700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce4c066dd0 0x7fce4c069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fce5c007cd0 tx=0x7fce5c015000 comp rx=0 tx=0).ready entity=mgr.6924 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.591+0000 7fce64ff9700 1 -- 172.21.15.154:0/3714553715 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce680b07b0 con 0x7fce680c3290 2023-10-10T21:18:24.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:24.834+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fce680b0770 con 0x7fce680c3290 2023-10-10T21:18:25.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.372+0000 7fce64ff9700 1 -- 172.21.15.154:0/3714553715 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fce60088030 con 0x7fce680c3290 2023-10-10T21:18:25.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.373+0000 7fce64ff9700 1 -- 172.21.15.154:0/3714553715 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v41) v1 ==== 93+0+0 (secure 0 0 0) 0x7fce600520e0 con 0x7fce680c3290 2023-10-10T21:18:25.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce4c066dd0 msgr2=0x7fce4c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:25.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce4c066dd0 0x7fce4c069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fce5c007cd0 tx=0x7fce5c015000 comp rx=0 tx=0).stop 2023-10-10T21:18:25.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce680c3290 msgr2=0x7fce680c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:25.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce680c3290 0x7fce680c3700 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fce6806d2a0 tx=0x7fce6000b040 comp rx=0 tx=0).stop 2023-10-10T21:18:25.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 shutdown_connections 2023-10-10T21:18:25.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce680c3290 0x7fce680c3700 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:25.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce58003a60 0x7fce680c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:25.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fce4c066dd0 0x7fce4c069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:25.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 --2- 172.21.15.154:0/3714553715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce6814b020 0x7fce680b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:25.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 >> 172.21.15.154:0/3714553715 conn(0x7fce680cc1e0 msgr2=0x7fce680c0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:25.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 shutdown_connections 2023-10-10T21:18:25.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.377+0000 7fce6d99d700 1 -- 172.21.15.154:0/3714553715 wait complete. 2023-10-10T21:18:25.399 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:18:25.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:18:25.487 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:18:25.571 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:18:25.571 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T21:18:25.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:18:25.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T21:18:25.656 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:18:25.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:25.657 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T21:18:25.698 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:18:25.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.925+0000 7fd9cf59e700 1 Processor -- start 2023-10-10T21:18:25.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.925+0000 7fd9cf59e700 1 -- start start 2023-10-10T21:18:25.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.926+0000 7fd9cf59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9d015d230 0x7fd9d015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:25.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.926+0000 7fd9cf59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d00b2980 con 0x7fd9d0159420 2023-10-10T21:18:25.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.926+0000 7fd9cf59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d015db70 con 0x7fd9d01597f0 2023-10-10T21:18:25.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.926+0000 7fd9cf59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d00b11d0 con 0x7fd9d015d230 2023-10-10T21:18:25.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.926+0000 7fd9ce59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd9d0159420 0x7fd9d00b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34376/0 (socket says 172.21.15.154:34376) 2023-10-10T21:18:25.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.926+0000 7fd9ce59c700 1 -- 172.21.15.154:0/3380362394 learned_addr learned my addr 172.21.15.154:0/3380362394 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:25.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.927+0000 7fd9ced9d700 1 --2- 172.21.15.154:0/3380362394 >> v2:172.21.15.154:3300/0 conn(0x7fd9d015d230 0x7fd9d015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.927+0000 7fd9cd59a700 1 -- 172.21.15.154:0/3380362394 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726457890 0 0) 0x7fd9d00b2980 con 0x7fd9d0159420 2023-10-10T21:18:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.927+0000 7fd9cd59a700 1 -- 172.21.15.154:0/3380362394 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b8003570 con 0x7fd9d0159420 2023-10-10T21:18:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.927+0000 7fd9cd59a700 1 -- 172.21.15.154:0/3380362394 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562831567 0 0) 0x7fd9d015db70 con 0x7fd9d01597f0 2023-10-10T21:18:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.927+0000 7fd9cd59a700 1 -- 172.21.15.154:0/3380362394 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d00b2980 con 0x7fd9d01597f0 2023-10-10T21:18:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.927+0000 7fd9ced9d700 1 -- 172.21.15.154:0/3380362394 >> v1:172.21.15.179:6789/0 conn(0x7fd9d01597f0 legacy=0x7fd9d00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.927+0000 7fd9ced9d700 1 -- 172.21.15.154:0/3380362394 >> v1:172.21.15.154:6789/0 conn(0x7fd9d0159420 legacy=0x7fd9d00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.927+0000 7fd9ced9d700 1 -- 172.21.15.154:0/3380362394 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00b14b0 con 0x7fd9d015d230 2023-10-10T21:18:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.928+0000 7fd9ced9d700 1 --2- 172.21.15.154:0/3380362394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 0x7fd9d015d630 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009e60 tx=0x7fd9c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b743aa9c9a00c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.928+0000 7fd9cd59a700 1 -- 172.21.15.154:0/3380362394 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800e070 con 0x7fd9d015d230 2023-10-10T21:18:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.928+0000 7fd9cd59a700 1 -- 172.21.15.154:0/3380362394 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c800bab0 con 0x7fd9d015d230 2023-10-10T21:18:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.928+0000 7fd9cd59a700 1 -- 172.21.15.154:0/3380362394 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800be30 con 0x7fd9d015d230 2023-10-10T21:18:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.928+0000 7fd9cf59e700 1 -- 172.21.15.154:0/3380362394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 msgr2=0x7fd9d015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:25.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.928+0000 7fd9cf59e700 1 --2- 172.21.15.154:0/3380362394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 0x7fd9d015d630 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009e60 tx=0x7fd9c8009780 comp rx=0 tx=0).stop 2023-10-10T21:18:25.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.929+0000 7fd9cf59e700 1 -- 172.21.15.154:0/3380362394 shutdown_connections 2023-10-10T21:18:25.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.929+0000 7fd9cf59e700 1 --2- 172.21.15.154:0/3380362394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 0x7fd9d015d630 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:25.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.929+0000 7fd9cf59e700 1 -- 172.21.15.154:0/3380362394 >> 172.21.15.154:0/3380362394 conn(0x7fd9d00d0660 msgr2=0x7fd9d00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:25.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.929+0000 7fd9cf59e700 1 -- 172.21.15.154:0/3380362394 shutdown_connections 2023-10-10T21:18:25.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.929+0000 7fd9cf59e700 1 -- 172.21.15.154:0/3380362394 wait complete. 2023-10-10T21:18:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.930+0000 7fd9cf59e700 1 Processor -- start 2023-10-10T21:18:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.930+0000 7fd9cf59e700 1 -- start start 2023-10-10T21:18:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.931+0000 7fd9cf59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d0159420 0x7fd9d00c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.931+0000 7fd9cf59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d01597f0 0x7fd9d0154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.931+0000 7fd9cf59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 0x7fd9d00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.931+0000 7fd9cf59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d015cc50 con 0x7fd9d015d230 2023-10-10T21:18:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.931+0000 7fd9cf59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d015c040 con 0x7fd9d01597f0 2023-10-10T21:18:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.931+0000 7fd9cf59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d015c320 con 0x7fd9d0159420 2023-10-10T21:18:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.931+0000 7fd9ced9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 0x7fd9d00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.931+0000 7fd9ced9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 0x7fd9d00b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37150/0 (socket says 172.21.15.154:37150) 2023-10-10T21:18:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.931+0000 7fd9ced9d700 1 -- 172.21.15.154:0/1642092055 learned_addr learned my addr 172.21.15.154:0/1642092055 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9ce59c700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d0159420 0x7fd9d00c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9cdd9b700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d01597f0 0x7fd9d0154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9ced9d700 1 -- 172.21.15.154:0/1642092055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d0159420 msgr2=0x7fd9d00c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9ced9d700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d0159420 0x7fd9d00c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9ced9d700 1 -- 172.21.15.154:0/1642092055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d01597f0 msgr2=0x7fd9d0154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9ced9d700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d01597f0 0x7fd9d0154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9ced9d700 1 -- 172.21.15.154:0/1642092055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c8009a20 con 0x7fd9d015d230 2023-10-10T21:18:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9ced9d700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 0x7fd9d00b4e20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80097c0 tx=0x7fd9c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9be7fc700 1 -- 172.21.15.154:0/1642092055 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8012dd0 con 0x7fd9d015d230 2023-10-10T21:18:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.932+0000 7fd9be7fc700 1 -- 172.21.15.154:0/1642092055 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8027470 con 0x7fd9d015d230 2023-10-10T21:18:25.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.933+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d015c600 con 0x7fd9d015d230 2023-10-10T21:18:25.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.933+0000 7fd9be7fc700 1 -- 172.21.15.154:0/1642092055 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8027810 con 0x7fd9d015d230 2023-10-10T21:18:25.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.933+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d00c66f0 con 0x7fd9d015d230 2023-10-10T21:18:25.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.934+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d015cfe0 con 0x7fd9d015d230 2023-10-10T21:18:25.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.935+0000 7fd9be7fc700 1 -- 172.21.15.154:0/1642092055 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fd9c8024070 con 0x7fd9d015d230 2023-10-10T21:18:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.936+0000 7fd9be7fc700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd9b00670e0 0x7fd9b0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.936+0000 7fd9be7fc700 1 -- 172.21.15.154:0/1642092055 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fd9c80874e0 con 0x7fd9d015d230 2023-10-10T21:18:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.936+0000 7fd9ce59c700 1 -- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd9b00670e0 msgr2=0x7fd9b0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.936+0000 7fd9ce59c700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd9b00670e0 0x7fd9b0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:25.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:25.940+0000 7fd9be7fc700 1 -- 172.21.15.154:0/1642092055 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9c8054240 con 0x7fd9d015d230 2023-10-10T21:18:26.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.137+0000 7fd9ce59c700 1 -- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd9b00670e0 msgr2=0x7fd9b0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:26.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.137+0000 7fd9ce59c700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd9b00670e0 0x7fd9b0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.206+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9d00b2d60 con 0x7fd9d015d230 2023-10-10T21:18:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.207+0000 7fd9be7fc700 1 -- 172.21.15.154:0/1642092055 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fd9c8057860 con 0x7fd9d015d230 2023-10-10T21:18:26.208 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:26.208 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/136831769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":136831769},{"type":"v1","addr":"172.21.15.154:6837","nonce":136831769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3500808204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3500808204},{"type":"v1","addr":"172.21.15.179:6833","nonce":3500808204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/953113300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":953113300},{"type":"v1","addr":"172.21.15.154:6835","nonce":953113300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:02.569626+0000","modified":"2023-10-10T21:18:06.123950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6472":{"gid":6472,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/434983583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":434983583},{"type":"v1","addr":"172.21.15.179:6835","nonce":434983583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-10T21:18:26.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd9b00670e0 msgr2=0x7fd9b0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:26.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd9b00670e0 0x7fd9b0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 msgr2=0x7fd9d00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:26.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 0x7fd9d00b4e20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80097c0 tx=0x7fd9c8019000 comp rx=0 tx=0).stop 2023-10-10T21:18:26.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 shutdown_connections 2023-10-10T21:18:26.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d015d230 0x7fd9d00b4e20 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d0159420 0x7fd9d00c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd9b00670e0 0x7fd9b0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 --2- 172.21.15.154:0/1642092055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d01597f0 0x7fd9d0154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 >> 172.21.15.154:0/1642092055 conn(0x7fd9d00d0660 msgr2=0x7fd9d00afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 shutdown_connections 2023-10-10T21:18:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.209+0000 7fd9cf59e700 1 -- 172.21.15.154:0/1642092055 wait complete. 2023-10-10T21:18:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 38 2023-10-10T21:18:26.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.420+0000 7fb9a0f9d700 1 Processor -- start 2023-10-10T21:18:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.420+0000 7fb9a0f9d700 1 -- start start 2023-10-10T21:18:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb9a0f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb99c142ea0 0x7fb99c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb9a0f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb99c0ad870 0x7fb99c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb9a0f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0b3b70 0x7fb99c06bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb9a0f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c0b40f0 con 0x7fb99c142ea0 2023-10-10T21:18:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb9a0f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c069640 con 0x7fb99c0ad870 2023-10-10T21:18:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb9a0f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c069920 con 0x7fb99c0b3b70 2023-10-10T21:18:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb99b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb99c142ea0 0x7fb99c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb99b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb99c142ea0 0x7fb99c0b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37158/0 (socket says 172.21.15.154:37158) 2023-10-10T21:18:26.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb99b7fe700 1 -- 172.21.15.154:0/889838622 learned_addr learned my addr 172.21.15.154:0/889838622 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:26.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb99bfff700 1 --2- 172.21.15.154:0/889838622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0b3b70 0x7fb99c06bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb99affd700 1 --2- 172.21.15.154:0/889838622 >> v2:172.21.15.179:3300/0 conn(0x7fb99c0ad870 0x7fb99c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb99b7fe700 1 -- 172.21.15.154:0/889838622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0b3b70 msgr2=0x7fb99c06bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.422+0000 7fb99b7fe700 1 --2- 172.21.15.154:0/889838622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0b3b70 0x7fb99c06bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.423+0000 7fb99b7fe700 1 -- 172.21.15.154:0/889838622 >> v2:172.21.15.179:3300/0 conn(0x7fb99c0ad870 msgr2=0x7fb99c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.423+0000 7fb99b7fe700 1 --2- 172.21.15.154:0/889838622 >> v2:172.21.15.179:3300/0 conn(0x7fb99c0ad870 0x7fb99c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.423+0000 7fb99b7fe700 1 -- 172.21.15.154:0/889838622 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c069c00 con 0x7fb99c142ea0 2023-10-10T21:18:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.423+0000 7fb99b7fe700 1 --2- 172.21.15.154:0/889838622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c142ea0 0x7fb99c0b3630 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0b0e10 tx=0x7fb98c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd02afcfa2ea296 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.423+0000 7fb99a7fc700 1 -- 172.21.15.154:0/889838622 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00b640 con 0x7fb99c142ea0 2023-10-10T21:18:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.423+0000 7fb99a7fc700 1 -- 172.21.15.154:0/889838622 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c00b7a0 con 0x7fb99c142ea0 2023-10-10T21:18:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.423+0000 7fb99a7fc700 1 -- 172.21.15.154:0/889838622 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00bb60 con 0x7fb99c142ea0 2023-10-10T21:18:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.424+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/889838622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c142ea0 msgr2=0x7fb99c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.424+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/889838622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c142ea0 0x7fb99c0b3630 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0b0e10 tx=0x7fb98c009250 comp rx=0 tx=0).stop 2023-10-10T21:18:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.424+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/889838622 shutdown_connections 2023-10-10T21:18:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.424+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/889838622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0b3b70 0x7fb99c06bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.424+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/889838622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c142ea0 0x7fb99c0b3630 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.424+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/889838622 >> v2:172.21.15.179:3300/0 conn(0x7fb99c0ad870 0x7fb99c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.424+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/889838622 >> 172.21.15.154:0/889838622 conn(0x7fb99c0ce430 msgr2=0x7fb99c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.424+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/889838622 shutdown_connections 2023-10-10T21:18:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.424+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/889838622 wait complete. 2023-10-10T21:18:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.425+0000 7fb9a0f9d700 1 Processor -- start 2023-10-10T21:18:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.425+0000 7fb9a0f9d700 1 -- start start 2023-10-10T21:18:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.426+0000 7fb9a0f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c0b3b70 0x7fb99c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.426+0000 7fb9a0f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb99c142ea0 0x7fb99c0c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.426+0000 7fb9a0f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0c98b0 0x7fb99c0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.426+0000 7fb9a0f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0c9d20 con 0x7fb99c0b3b70 2023-10-10T21:18:26.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.426+0000 7fb9a0f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0c8f40 con 0x7fb99c142ea0 2023-10-10T21:18:26.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.426+0000 7fb9a0f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0c83c0 con 0x7fb99c0c98b0 2023-10-10T21:18:26.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c0b3b70 0x7fb99c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb99c142ea0 0x7fb99c0c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c0b3b70 0x7fb99c131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37174/0 (socket says 172.21.15.154:37174) 2023-10-10T21:18:26.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99b7fe700 1 -- 172.21.15.154:0/2457284903 learned_addr learned my addr 172.21.15.154:0/2457284903 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:26.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99bfff700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0c98b0 0x7fb99c0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99b7fe700 1 -- 172.21.15.154:0/2457284903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0c98b0 msgr2=0x7fb99c0c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:26.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99b7fe700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0c98b0 0x7fb99c0c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99b7fe700 1 -- 172.21.15.154:0/2457284903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb99c142ea0 msgr2=0x7fb99c0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:26.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99b7fe700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb99c142ea0 0x7fb99c0c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99b7fe700 1 -- 172.21.15.154:0/2457284903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c0094f0 con 0x7fb99c0b3b70 2023-10-10T21:18:26.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb99b7fe700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c0b3b70 0x7fb99c131f00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb99c06f0d0 tx=0x7fb98c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:26.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb9837fe700 1 -- 172.21.15.154:0/2457284903 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00b910 con 0x7fb99c0b3b70 2023-10-10T21:18:26.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.427+0000 7fb9837fe700 1 -- 172.21.15.154:0/2457284903 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c00ba70 con 0x7fb99c0b3b70 2023-10-10T21:18:26.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.428+0000 7fb9837fe700 1 -- 172.21.15.154:0/2457284903 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c011630 con 0x7fb99c0b3b70 2023-10-10T21:18:26.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.428+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c0c86a0 con 0x7fb99c0b3b70 2023-10-10T21:18:26.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.428+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c0c8c60 con 0x7fb99c0b3b70 2023-10-10T21:18:26.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.429+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99c04c3c0 con 0x7fb99c0b3b70 2023-10-10T21:18:26.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.430+0000 7fb9837fe700 1 -- 172.21.15.154:0/2457284903 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fb98c0119a0 con 0x7fb99c0b3b70 2023-10-10T21:18:26.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.430+0000 7fb9837fe700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb9880670e0 0x7fb988069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.431+0000 7fb9837fe700 1 -- 172.21.15.154:0/2457284903 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fb98c0861d0 con 0x7fb99c0b3b70 2023-10-10T21:18:26.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.431+0000 7fb99affd700 1 -- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb9880670e0 msgr2=0x7fb988069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:26.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.431+0000 7fb99affd700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb9880670e0 0x7fb988069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:26.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.435+0000 7fb9837fe700 1 -- 172.21.15.154:0/2457284903 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb98c052f30 con 0x7fb99c0b3b70 2023-10-10T21:18:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.632+0000 7fb99affd700 1 -- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb9880670e0 msgr2=0x7fb988069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.632+0000 7fb99affd700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb9880670e0 0x7fb988069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.634+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb99c143270 con 0x7fb99c0b3b70 2023-10-10T21:18:26.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.635+0000 7fb9837fe700 1 -- 172.21.15.154:0/2457284903 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16369 (secure 0 0 0) 0x7fb98c056550 con 0x7fb99c0b3b70 2023-10-10T21:18:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:26.637 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":96,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:23.351056+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:00.451391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:01.546798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/85496":"2023-10-11T21:18:23.351023+0000","172.21.15.154:6834/85496":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/1555365363":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/4291137101":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/3849709290":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/1118596147":"2023-10-11T21:18:23.351023+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:26.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb9880670e0 msgr2=0x7fb988069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:26.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb9880670e0 0x7fb988069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c0b3b70 msgr2=0x7fb99c131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:26.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c0b3b70 0x7fb99c131f00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb99c06f0d0 tx=0x7fb98c017000 comp rx=0 tx=0).stop 2023-10-10T21:18:26.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 shutdown_connections 2023-10-10T21:18:26.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb99c0c98b0 0x7fb99c0c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb99c0b3b70 0x7fb99c131f00 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb9880670e0 0x7fb988069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 --2- 172.21.15.154:0/2457284903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb99c142ea0 0x7fb99c0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 >> 172.21.15.154:0/2457284903 conn(0x7fb99c0ce430 msgr2=0x7fb99c0cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 shutdown_connections 2023-10-10T21:18:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.638+0000 7fb9a0f9d700 1 -- 172.21.15.154:0/2457284903 wait complete. 2023-10-10T21:18:26.648 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:26.648+0000 7fa74f4e8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:18:26.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:18:00.451391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:18:01.546798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:18:26.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:18:26.753 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:26.752+0000 7f6868b91180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:18:26.809 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:26.808+0000 7fa74f4e8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.854+0000 7fea2579d700 1 Processor -- start 2023-10-10T21:18:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.855+0000 7fea2579d700 1 -- start start 2023-10-10T21:18:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea2579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea200b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea2579d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fea200b33b0 0x7fea200b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea2579d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200b2080 con 0x7fea200b4e70 2023-10-10T21:18:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea2579d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea200cfb00 con 0x7fea200b33b0 2023-10-10T21:18:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea2579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200b5c40 con 0x7fea200b16d0 2023-10-10T21:18:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea1f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea200b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea24f9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fea200b33b0 0x7fea200b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea1f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea200b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:35708/0 (socket says 172.21.15.154:35708) 2023-10-10T21:18:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea1f7fe700 1 -- 172.21.15.154:0/78366402 learned_addr learned my addr 172.21.15.154:0/78366402 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.856+0000 7fea1ffff700 1 --1- 172.21.15.154:0/78366402 >> v1:172.21.15.179:6789/0 conn(0x7fea200b4e70 0x7fea200ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:39012/0 (socket says 172.21.15.154:39012) 2023-10-10T21:18:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea24f9c700 1 -- 172.21.15.154:0/78366402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 msgr2=0x7fea200b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea24f9c700 1 --2- 172.21.15.154:0/78366402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea200b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea24f9c700 1 -- 172.21.15.154:0/78366402 >> v1:172.21.15.179:6789/0 conn(0x7fea200b4e70 legacy=0x7fea200ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea24f9c700 1 -- 172.21.15.154:0/78366402 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200b5f20 con 0x7fea200b33b0 2023-10-10T21:18:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea1f7fe700 1 --2- 172.21.15.154:0/78366402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea200b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea1effd700 1 -- 172.21.15.154:0/78366402 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582527249 0 0) 0x7fea200b2080 con 0x7fea200b4e70 2023-10-10T21:18:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea24f9c700 1 --2- 172.21.15.154:0/78366402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 0x7fea200b3830 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fea18009e60 tx=0x7fea18009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ead1eb494c18211a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea1effd700 1 -- 172.21.15.154:0/78366402 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1800e070 con 0x7fea200b33b0 2023-10-10T21:18:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea1effd700 1 -- 172.21.15.154:0/78366402 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1800bb60 con 0x7fea200b33b0 2023-10-10T21:18:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.857+0000 7fea1effd700 1 -- 172.21.15.154:0/78366402 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18012430 con 0x7fea200b33b0 2023-10-10T21:18:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.858+0000 7fea2579d700 1 -- 172.21.15.154:0/78366402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 msgr2=0x7fea200b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.858+0000 7fea2579d700 1 --2- 172.21.15.154:0/78366402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 0x7fea200b3830 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fea18009e60 tx=0x7fea18009780 comp rx=0 tx=0).stop 2023-10-10T21:18:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.858+0000 7fea2579d700 1 -- 172.21.15.154:0/78366402 shutdown_connections 2023-10-10T21:18:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.858+0000 7fea2579d700 1 --2- 172.21.15.154:0/78366402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 0x7fea200b3830 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.858+0000 7fea2579d700 1 --2- 172.21.15.154:0/78366402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea200b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.858+0000 7fea2579d700 1 -- 172.21.15.154:0/78366402 >> 172.21.15.154:0/78366402 conn(0x7fea200d10c0 msgr2=0x7fea200affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.858+0000 7fea2579d700 1 -- 172.21.15.154:0/78366402 shutdown_connections 2023-10-10T21:18:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.858+0000 7fea2579d700 1 -- 172.21.15.154:0/78366402 wait complete. 2023-10-10T21:18:26.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.860+0000 7fea2579d700 1 Processor -- start 2023-10-10T21:18:26.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.860+0000 7fea2579d700 1 -- start start 2023-10-10T21:18:26.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.860+0000 7fea2579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea2016ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea2579d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 0x7fea200c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea2579d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea200b4e70 0x7fea200c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea2579d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200c90e0 con 0x7fea200b4e70 2023-10-10T21:18:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea2579d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200c84d0 con 0x7fea200b33b0 2023-10-10T21:18:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea2579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200c87b0 con 0x7fea200b16d0 2023-10-10T21:18:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea1ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea2016ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea24f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea200b4e70 0x7fea200c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea1f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 0x7fea200c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea1ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea2016ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:35724/0 (socket says 172.21.15.154:35724) 2023-10-10T21:18:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea1ffff700 1 -- 172.21.15.154:0/3504752578 learned_addr learned my addr 172.21.15.154:0/3504752578 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea1f7fe700 1 -- 172.21.15.154:0/3504752578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 msgr2=0x7fea2016ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea1f7fe700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea2016ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea1f7fe700 1 -- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea200b4e70 msgr2=0x7fea200c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea1f7fe700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea200b4e70 0x7fea200c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.861+0000 7fea1f7fe700 1 -- 172.21.15.154:0/3504752578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140094f0 con 0x7fea200b33b0 2023-10-10T21:18:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.862+0000 7fea1f7fe700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 0x7fea200c7af0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea14006fd0 tx=0x7fea14009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.862+0000 7fea07fff700 1 -- 172.21.15.154:0/3504752578 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400c6a0 con 0x7fea200b33b0 2023-10-10T21:18:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.862+0000 7fea07fff700 1 -- 172.21.15.154:0/3504752578 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400c800 con 0x7fea200b33b0 2023-10-10T21:18:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.862+0000 7fea07fff700 1 -- 172.21.15.154:0/3504752578 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400cb80 con 0x7fea200b33b0 2023-10-10T21:18:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.862+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea18009a20 con 0x7fea200b33b0 2023-10-10T21:18:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.862+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea200c8d70 con 0x7fea200b33b0 2023-10-10T21:18:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.863+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea20169b00 con 0x7fea200b33b0 2023-10-10T21:18:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.864+0000 7fea07fff700 1 -- 172.21.15.154:0/3504752578 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fea14013470 con 0x7fea200b33b0 2023-10-10T21:18:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.865+0000 7fea07fff700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea0c0670e0 0x7fea0c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.865+0000 7fea07fff700 1 -- 172.21.15.154:0/3504752578 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fea14084bb0 con 0x7fea200b33b0 2023-10-10T21:18:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.865+0000 7fea1ffff700 1 -- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea0c0670e0 msgr2=0x7fea0c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.865+0000 7fea1ffff700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea0c0670e0 0x7fea0c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:26.869+0000 7fea07fff700 1 -- 172.21.15.154:0/3504752578 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea14051910 con 0x7fea200b33b0 2023-10-10T21:18:26.895 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:26.894+0000 7fa74f4e8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:18:26.927 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:26.926+0000 7f6868b91180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:27.015 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:27.014+0000 7f6868b91180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:18:27.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.066+0000 7fea1ffff700 1 -- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea0c0670e0 msgr2=0x7fea0c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:27.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.066+0000 7fea1ffff700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea0c0670e0 0x7fea0c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.069+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea200cf850 con 0x7fea200b33b0 2023-10-10T21:18:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.070+0000 7fea07fff700 1 -- 172.21.15.154:0/3504752578 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea140200a0 con 0x7fea200b33b0 2023-10-10T21:18:27.071 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:18:27.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea0c0670e0 msgr2=0x7fea0c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:27.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea0c0670e0 0x7fea0c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 msgr2=0x7fea200c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 0x7fea200c7af0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea14006fd0 tx=0x7fea14009250 comp rx=0 tx=0).stop 2023-10-10T21:18:27.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 shutdown_connections 2023-10-10T21:18:27.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea200b4e70 0x7fea200c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea200b16d0 0x7fea2016ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fea0c0670e0 0x7fea0c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 --2- 172.21.15.154:0/3504752578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea200b33b0 0x7fea200c7af0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 >> 172.21.15.154:0/3504752578 conn(0x7fea200d10c0 msgr2=0x7fea20158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 shutdown_connections 2023-10-10T21:18:27.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.072+0000 7fea2579d700 1 -- 172.21.15.154:0/3504752578 wait complete. 2023-10-10T21:18:27.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:18:27.119 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:27.119+0000 7fa74f4e8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:18:27.255 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:27.254+0000 7f6868b91180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:18:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.285+0000 7fae4939d700 1 Processor -- start 2023-10-10T21:18:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.285+0000 7fae4939d700 1 -- start start 2023-10-10T21:18:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae4939d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae440b4e70 0x7fae440ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae4939d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae440b1b40 0x7fae4415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae4939d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae440cfb00 con 0x7fae440b16d0 2023-10-10T21:18:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae4939d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae440b5c40 con 0x7fae440b1b40 2023-10-10T21:18:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae4939d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae440b5f20 con 0x7fae440b4e70 2023-10-10T21:18:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae48b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae440b1b40 0x7fae4415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae48b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae440b1b40 0x7fae4415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37182/0 (socket says 172.21.15.154:37182) 2023-10-10T21:18:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae48b9c700 1 -- 172.21.15.154:0/1262142535 learned_addr learned my addr 172.21.15.154:0/1262142535 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:27.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae43fff700 1 --2- 172.21.15.154:0/1262142535 >> v2:172.21.15.179:3300/0 conn(0x7fae440b4e70 0x7fae440ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae48b9c700 1 -- 172.21.15.154:0/1262142535 >> v2:172.21.15.179:3300/0 conn(0x7fae440b4e70 msgr2=0x7fae440ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:27.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae48b9c700 1 --2- 172.21.15.154:0/1262142535 >> v2:172.21.15.179:3300/0 conn(0x7fae440b4e70 0x7fae440ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae48b9c700 1 -- 172.21.15.154:0/1262142535 >> v1:172.21.15.179:6789/0 conn(0x7fae440b16d0 legacy=0x7fae4415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.287+0000 7fae48b9c700 1 -- 172.21.15.154:0/1262142535 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae440b6200 con 0x7fae440b1b40 2023-10-10T21:18:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.288+0000 7fae48b9c700 1 --2- 172.21.15.154:0/1262142535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b1b40 0x7fae4415d950 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fae44064910 tx=0x7fae3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4941042f71f0d5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.288+0000 7fae42ffd700 1 -- 172.21.15.154:0/1262142535 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c00e070 con 0x7fae440b1b40 2023-10-10T21:18:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.288+0000 7fae42ffd700 1 -- 172.21.15.154:0/1262142535 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c00ba20 con 0x7fae440b1b40 2023-10-10T21:18:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.288+0000 7fae42ffd700 1 -- 172.21.15.154:0/1262142535 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0092e0 con 0x7fae440b1b40 2023-10-10T21:18:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.289+0000 7fae4939d700 1 -- 172.21.15.154:0/1262142535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b1b40 msgr2=0x7fae4415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.289+0000 7fae4939d700 1 --2- 172.21.15.154:0/1262142535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b1b40 0x7fae4415d950 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fae44064910 tx=0x7fae3c009840 comp rx=0 tx=0).stop 2023-10-10T21:18:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.289+0000 7fae4939d700 1 -- 172.21.15.154:0/1262142535 shutdown_connections 2023-10-10T21:18:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.289+0000 7fae4939d700 1 --2- 172.21.15.154:0/1262142535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b1b40 0x7fae4415d950 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.289+0000 7fae4939d700 1 --2- 172.21.15.154:0/1262142535 >> v2:172.21.15.179:3300/0 conn(0x7fae440b4e70 0x7fae440ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.289+0000 7fae4939d700 1 -- 172.21.15.154:0/1262142535 >> 172.21.15.154:0/1262142535 conn(0x7fae440d10c0 msgr2=0x7fae440affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:27.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.289+0000 7fae4939d700 1 -- 172.21.15.154:0/1262142535 shutdown_connections 2023-10-10T21:18:27.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.289+0000 7fae4939d700 1 -- 172.21.15.154:0/1262142535 wait complete. 2023-10-10T21:18:27.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.291+0000 7fae4939d700 1 Processor -- start 2023-10-10T21:18:27.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.291+0000 7fae4939d700 1 -- start start 2023-10-10T21:18:27.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae4939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae440b16d0 0x7fae440c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae4939d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae440b1b40 0x7fae440c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae4939d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b4e70 0x7fae44169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae4939d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae440c7070 con 0x7fae440b4e70 2023-10-10T21:18:27.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae4939d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4416ae10 con 0x7fae440b1b40 2023-10-10T21:18:27.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae4939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae440c6ab0 con 0x7fae440b16d0 2023-10-10T21:18:27.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae43fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae440b16d0 0x7fae440c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae48b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b4e70 0x7fae44169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae437fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae440b1b40 0x7fae440c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae43fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae440b16d0 0x7fae440c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:35734/0 (socket says 172.21.15.154:35734) 2023-10-10T21:18:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae48b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b4e70 0x7fae44169bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37198/0 (socket says 172.21.15.154:37198) 2023-10-10T21:18:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.293+0000 7fae43fff700 1 -- 172.21.15.154:0/2799288666 learned_addr learned my addr 172.21.15.154:0/2799288666 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae48b9c700 1 -- 172.21.15.154:0/2799288666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae440b16d0 msgr2=0x7fae440c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae48b9c700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae440b16d0 0x7fae440c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae48b9c700 1 -- 172.21.15.154:0/2799288666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae440b1b40 msgr2=0x7fae440c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae48b9c700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae440b1b40 0x7fae440c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae48b9c700 1 -- 172.21.15.154:0/2799288666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c009ae0 con 0x7fae440b4e70 2023-10-10T21:18:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae48b9c700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b4e70 0x7fae44169bb0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fae3c015000 tx=0x7fae3c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae2bfff700 1 -- 172.21.15.154:0/2799288666 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c008a80 con 0x7fae440b4e70 2023-10-10T21:18:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae2bfff700 1 -- 172.21.15.154:0/2799288666 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c008c20 con 0x7fae440b4e70 2023-10-10T21:18:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae440c6d90 con 0x7fae440b4e70 2023-10-10T21:18:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae2bfff700 1 -- 172.21.15.154:0/2799288666 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c026460 con 0x7fae440b4e70 2023-10-10T21:18:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.294+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae440c67d0 con 0x7fae440b4e70 2023-10-10T21:18:27.301 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:27.299+0000 7fa74f4e8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:18:27.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.296+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4416b2f0 con 0x7fae440b4e70 2023-10-10T21:18:27.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.297+0000 7fae2bfff700 1 -- 172.21.15.154:0/2799288666 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fae3c003040 con 0x7fae440b4e70 2023-10-10T21:18:27.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.298+0000 7fae2bfff700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae300670e0 0x7fae30069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.298+0000 7fae43fff700 1 -- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae300670e0 msgr2=0x7fae30069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.298+0000 7fae2bfff700 1 -- 172.21.15.154:0/2799288666 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fae3c0869a0 con 0x7fae440b4e70 2023-10-10T21:18:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.298+0000 7fae43fff700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae300670e0 0x7fae30069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:27.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.301+0000 7fae2bfff700 1 -- 172.21.15.154:0/2799288666 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae3c053600 con 0x7fae440b4e70 2023-10-10T21:18:27.392 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:27.392+0000 7fa74f4e8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:18:27.445 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:27.444+0000 7f6868b91180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:18:27.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.499+0000 7fae43fff700 1 -- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae300670e0 msgr2=0x7fae30069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:27.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.499+0000 7fae43fff700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae300670e0 0x7fae30069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:27.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.503+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae4404bb80 con 0x7fae440b4e70 2023-10-10T21:18:27.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.504+0000 7fae2bfff700 1 -- 172.21.15.154:0/2799288666 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae3c056c20 con 0x7fae440b4e70 2023-10-10T21:18:27.505 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:18:27.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae300670e0 msgr2=0x7fae30069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:27.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae300670e0 0x7fae30069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b4e70 msgr2=0x7fae44169bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b4e70 0x7fae44169bb0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fae3c015000 tx=0x7fae3c018000 comp rx=0 tx=0).stop 2023-10-10T21:18:27.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 shutdown_connections 2023-10-10T21:18:27.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae440b4e70 0x7fae44169bb0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae440b16d0 0x7fae440c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fae300670e0 0x7fae30069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 --2- 172.21.15.154:0/2799288666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae440b1b40 0x7fae440c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 >> 172.21.15.154:0/2799288666 conn(0x7fae440d10c0 msgr2=0x7fae440b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 shutdown_connections 2023-10-10T21:18:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.506+0000 7fae4939d700 1 -- 172.21.15.154:0/2799288666 wait complete. 2023-10-10T21:18:27.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:18:27.543 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:27.542+0000 7f6868b91180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:18:27.553 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:27.552+0000 7fa74f4e8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:18:27.654 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:27.653+0000 7fa74f4e8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:27.715 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:27.714+0000 7f6868b91180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:18:27.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.717+0000 7f359ffff700 1 Processor -- start 2023-10-10T21:18:27.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.717+0000 7f359ffff700 1 -- start start 2023-10-10T21:18:27.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 0x7f35a00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 0x7f35a00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359ffff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00b2080 con 0x7f35a015d240 2023-10-10T21:18:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a00cfb00 con 0x7f35a00b16d0 2023-10-10T21:18:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00b5c40 con 0x7f35a00b4e70 2023-10-10T21:18:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f35a015d240 0x7f35a015d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34384/0 (socket says 172.21.15.154:34384) 2023-10-10T21:18:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359f7fe700 1 -- 172.21.15.154:0/3326551917 learned_addr learned my addr 172.21.15.154:0/3326551917 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359e7fc700 1 --2- 172.21.15.154:0/3326551917 >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 0x7f35a00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359effd700 1 --2- 172.21.15.154:0/3326551917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 0x7f35a00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359dffb700 1 -- 172.21.15.154:0/3326551917 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929849720 0 0) 0x7f35a00b2080 con 0x7f35a015d240 2023-10-10T21:18:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.719+0000 7f359dffb700 1 -- 172.21.15.154:0/3326551917 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3588003570 con 0x7f35a015d240 2023-10-10T21:18:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.720+0000 7f359effd700 1 -- 172.21.15.154:0/3326551917 >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 msgr2=0x7f35a00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.720+0000 7f359effd700 1 --2- 172.21.15.154:0/3326551917 >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 0x7f35a00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.720+0000 7f359effd700 1 -- 172.21.15.154:0/3326551917 >> v1:172.21.15.154:6789/0 conn(0x7f35a015d240 legacy=0x7f35a015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.720+0000 7f359effd700 1 -- 172.21.15.154:0/3326551917 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00b5f20 con 0x7f35a00b4e70 2023-10-10T21:18:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.720+0000 7f359effd700 1 --2- 172.21.15.154:0/3326551917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 0x7f35a00ccff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35900098e0 tx=0x7f35900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a51f9730e5823c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.720+0000 7f359dffb700 1 -- 172.21.15.154:0/3326551917 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590011630 con 0x7f35a00b4e70 2023-10-10T21:18:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.720+0000 7f359dffb700 1 -- 172.21.15.154:0/3326551917 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3590011790 con 0x7f35a00b4e70 2023-10-10T21:18:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.720+0000 7f359dffb700 1 -- 172.21.15.154:0/3326551917 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590011b30 con 0x7f35a00b4e70 2023-10-10T21:18:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.721+0000 7f359ffff700 1 -- 172.21.15.154:0/3326551917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 msgr2=0x7f35a00ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.721+0000 7f359ffff700 1 --2- 172.21.15.154:0/3326551917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 0x7f35a00ccff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35900098e0 tx=0x7f35900091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.721+0000 7f359ffff700 1 -- 172.21.15.154:0/3326551917 shutdown_connections 2023-10-10T21:18:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.721+0000 7f359ffff700 1 --2- 172.21.15.154:0/3326551917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 0x7f35a00ccff0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.721+0000 7f359ffff700 1 --2- 172.21.15.154:0/3326551917 >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 0x7f35a00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.721+0000 7f359ffff700 1 -- 172.21.15.154:0/3326551917 >> 172.21.15.154:0/3326551917 conn(0x7f35a00d10c0 msgr2=0x7f35a00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.721+0000 7f359ffff700 1 -- 172.21.15.154:0/3326551917 shutdown_connections 2023-10-10T21:18:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.721+0000 7f359ffff700 1 -- 172.21.15.154:0/3326551917 wait complete. 2023-10-10T21:18:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.722+0000 7f359ffff700 1 Processor -- start 2023-10-10T21:18:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.723+0000 7f359ffff700 1 -- start start 2023-10-10T21:18:27.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.723+0000 7f359ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b16d0 0x7f35a01527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.723+0000 7f359ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a00b4e70 0x7f35a015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.723+0000 7f359ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 0x7f35a015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0152dd0 con 0x7f35a00b4e70 2023-10-10T21:18:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a01530b0 con 0x7f35a00b16d0 2023-10-10T21:18:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0153390 con 0x7f35a015d240 2023-10-10T21:18:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a00b4e70 0x7f35a015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a00b4e70 0x7f35a015b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37210/0 (socket says 172.21.15.154:37210) 2023-10-10T21:18:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359e7fc700 1 -- 172.21.15.154:0/3718651172 learned_addr learned my addr 172.21.15.154:0/3718651172 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359effd700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b16d0 0x7f35a01527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359f7fe700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 0x7f35a015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359e7fc700 1 -- 172.21.15.154:0/3718651172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 msgr2=0x7f35a015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359e7fc700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 0x7f35a015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359e7fc700 1 -- 172.21.15.154:0/3718651172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b16d0 msgr2=0x7f35a01527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359e7fc700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b16d0 0x7f35a01527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359e7fc700 1 -- 172.21.15.154:0/3718651172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3590009420 con 0x7f35a00b4e70 2023-10-10T21:18:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.724+0000 7f359e7fc700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a00b4e70 0x7f35a015b6c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f359400ec80 tx=0x7f35940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.725+0000 7f3586ffd700 1 -- 172.21.15.154:0/3718651172 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400c850 con 0x7f35a00b4e70 2023-10-10T21:18:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.725+0000 7f3586ffd700 1 -- 172.21.15.154:0/3718651172 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400c9b0 con 0x7f35a00b4e70 2023-10-10T21:18:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.725+0000 7f3586ffd700 1 -- 172.21.15.154:0/3718651172 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400cd50 con 0x7f35a00b4e70 2023-10-10T21:18:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.725+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a0153670 con 0x7f35a00b4e70 2023-10-10T21:18:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.725+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a015bc00 con 0x7f35a00b4e70 2023-10-10T21:18:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.726+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a0088990 con 0x7f35a00b4e70 2023-10-10T21:18:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.727+0000 7f3586ffd700 1 -- 172.21.15.154:0/3718651172 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f3594013680 con 0x7f35a00b4e70 2023-10-10T21:18:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.728+0000 7f3586ffd700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f358c0670e0 0x7f358c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.728+0000 7f3586ffd700 1 -- 172.21.15.154:0/3718651172 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f3594084d10 con 0x7f35a00b4e70 2023-10-10T21:18:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.728+0000 7f359effd700 1 -- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f358c0670e0 msgr2=0x7f358c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:27.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.728+0000 7f359effd700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f358c0670e0 0x7f358c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:27.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.736+0000 7f3586ffd700 1 -- 172.21.15.154:0/3718651172 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3594051a70 con 0x7f35a00b4e70 2023-10-10T21:18:27.824 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:27.823+0000 7f6868b91180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:27.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.929+0000 7f359effd700 1 -- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f358c0670e0 msgr2=0x7f358c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:27.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.929+0000 7f359effd700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f358c0670e0 0x7f358c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:27.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.935+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35a004bb80 con 0x7f35a00b4e70 2023-10-10T21:18:27.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.936+0000 7f3586ffd700 1 -- 172.21.15.154:0/3718651172 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3594055090 con 0x7f35a00b4e70 2023-10-10T21:18:27.937 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:18:27.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f358c0670e0 msgr2=0x7f358c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:27.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f358c0670e0 0x7f358c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a00b4e70 msgr2=0x7f35a015b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:27.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a00b4e70 0x7f35a015b6c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f359400ec80 tx=0x7f35940091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 shutdown_connections 2023-10-10T21:18:27.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 0x7f35a015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f358c0670e0 0x7f358c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b16d0 0x7f35a01527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 --2- 172.21.15.154:0/3718651172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a00b4e70 0x7f35a015b6c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:27.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 >> 172.21.15.154:0/3718651172 conn(0x7f35a00d10c0 msgr2=0x7f35a00cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:27.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.938+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 shutdown_connections 2023-10-10T21:18:27.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:27.939+0000 7f359ffff700 1 -- 172.21.15.154:0/3718651172 wait complete. 2023-10-10T21:18:27.958 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:18:28.135 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:28.135+0000 7fa74f4e8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:18:28.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.189+0000 7fed0f39d700 1 Processor -- start 2023-10-10T21:18:28.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.189+0000 7fed0f39d700 1 -- start start 2023-10-10T21:18:28.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.190+0000 7fed0f39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fed080c6c60 0x7fed080c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.190+0000 7fed0f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.190+0000 7fed0f39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed080b1410 con 0x7fed081595a0 2023-10-10T21:18:28.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.190+0000 7fed0f39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed080b2b90 con 0x7fed080c6c60 2023-10-10T21:18:28.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.190+0000 7fed0f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed08063230 con 0x7fed0806e8c0 2023-10-10T21:18:28.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0db9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fed080c6c60 0x7fed080c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0eb9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0db9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fed080c6c60 0x7fed080c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:38194/0 (socket says 172.21.15.154:38194) 2023-10-10T21:18:28.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0db9a700 1 -- 172.21.15.154:0/3660920971 learned_addr learned my addr 172.21.15.154:0/3660920971 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:28.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0e39b700 1 --1- 172.21.15.154:0/3660920971 >> v1:172.21.15.179:6789/0 conn(0x7fed081595a0 0x7fed080b18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:39026/0 (socket says 172.21.15.154:39026) 2023-10-10T21:18:28.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0d399700 1 -- 172.21.15.154:0/3660920971 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068822058 0 0) 0x7fed080b1410 con 0x7fed081595a0 2023-10-10T21:18:28.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0d399700 1 -- 172.21.15.154:0/3660920971 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf4003570 con 0x7fed081595a0 2023-10-10T21:18:28.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0db9a700 1 -- 172.21.15.154:0/3660920971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 msgr2=0x7fed080c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:28.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0db9a700 1 --2- 172.21.15.154:0/3660920971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0db9a700 1 -- 172.21.15.154:0/3660920971 >> v1:172.21.15.179:6789/0 conn(0x7fed081595a0 legacy=0x7fed080b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0db9a700 1 -- 172.21.15.154:0/3660920971 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed080634f0 con 0x7fed080c6c60 2023-10-10T21:18:28.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.191+0000 7fed0eb9c700 1 --2- 172.21.15.154:0/3660920971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:28.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.192+0000 7fed0db9a700 1 --2- 172.21.15.154:0/3660920971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed080c6c60 0x7fed080c8120 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fecf80099b0 tx=0x7fecf8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dfd5ca9f1a98035 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:28.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.192+0000 7fed0d399700 1 -- 172.21.15.154:0/3660920971 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf800b680 con 0x7fed080c6c60 2023-10-10T21:18:28.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.192+0000 7fed0d399700 1 -- 172.21.15.154:0/3660920971 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf800b7e0 con 0x7fed080c6c60 2023-10-10T21:18:28.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.192+0000 7fed0d399700 1 -- 172.21.15.154:0/3660920971 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf800bb80 con 0x7fed080c6c60 2023-10-10T21:18:28.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.192+0000 7fed0f39d700 1 -- 172.21.15.154:0/3660920971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed080c6c60 msgr2=0x7fed080c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.192+0000 7fed0f39d700 1 --2- 172.21.15.154:0/3660920971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed080c6c60 0x7fed080c8120 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fecf80099b0 tx=0x7fecf8009250 comp rx=0 tx=0).stop 2023-10-10T21:18:28.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.193+0000 7fed0f39d700 1 -- 172.21.15.154:0/3660920971 shutdown_connections 2023-10-10T21:18:28.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.193+0000 7fed0f39d700 1 --2- 172.21.15.154:0/3660920971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.193+0000 7fed0f39d700 1 --2- 172.21.15.154:0/3660920971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed080c6c60 0x7fed080c8120 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.193+0000 7fed0f39d700 1 -- 172.21.15.154:0/3660920971 >> 172.21.15.154:0/3660920971 conn(0x7fed0806ddb0 msgr2=0x7fed0806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:28.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.193+0000 7fed0f39d700 1 -- 172.21.15.154:0/3660920971 shutdown_connections 2023-10-10T21:18:28.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.193+0000 7fed0f39d700 1 -- 172.21.15.154:0/3660920971 wait complete. 2023-10-10T21:18:28.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.194+0000 7fed0f39d700 1 Processor -- start 2023-10-10T21:18:28.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.194+0000 7fed0f39d700 1 -- start start 2023-10-10T21:18:28.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0f39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed080c6c60 0x7fed080a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0f39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed081595a0 0x7fed080a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0f39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed080c3200 con 0x7fed080c6c60 2023-10-10T21:18:28.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0f39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed080c25f0 con 0x7fed081595a0 2023-10-10T21:18:28.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed080c28d0 con 0x7fed0806e8c0 2023-10-10T21:18:28.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0db9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed080c6c60 0x7fed080a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0e39b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0db9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed080c6c60 0x7fed080a54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37224/0 (socket says 172.21.15.154:37224) 2023-10-10T21:18:28.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0db9a700 1 -- 172.21.15.154:0/3341898869 learned_addr learned my addr 172.21.15.154:0/3341898869 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:28.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.195+0000 7fed0eb9c700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed081595a0 0x7fed080a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fed0db9a700 1 -- 172.21.15.154:0/3341898869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 msgr2=0x7fed080aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fed0db9a700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fed0db9a700 1 -- 172.21.15.154:0/3341898869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed081595a0 msgr2=0x7fed080a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fed0db9a700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed081595a0 0x7fed080a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fed0db9a700 1 -- 172.21.15.154:0/3341898869 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00009a20 con 0x7fed080c6c60 2023-10-10T21:18:28.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fed0e39b700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:28.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fed0eb9c700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed081595a0 0x7fed080a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:28.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fed0db9a700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed080c6c60 0x7fed080a54c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009290 tx=0x7fecf8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:28.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fecfe7fc700 1 -- 172.21.15.154:0/3341898869 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf800b950 con 0x7fed080c6c60 2023-10-10T21:18:28.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fecfe7fc700 1 -- 172.21.15.154:0/3341898869 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf800bab0 con 0x7fed080c6c60 2023-10-10T21:18:28.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.196+0000 7fecfe7fc700 1 -- 172.21.15.154:0/3341898869 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf801a680 con 0x7fed080c6c60 2023-10-10T21:18:28.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.197+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf80094f0 con 0x7fed080c6c60 2023-10-10T21:18:28.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.197+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed080c2e90 con 0x7fed080c6c60 2023-10-10T21:18:28.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.198+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0804c3c0 con 0x7fed080c6c60 2023-10-10T21:18:28.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.198+0000 7fecfe7fc700 1 -- 172.21.15.154:0/3341898869 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fecf801aa70 con 0x7fed080c6c60 2023-10-10T21:18:28.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.199+0000 7fecfe7fc700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fecec0670e0 0x7fecec069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.199+0000 7fecfe7fc700 1 -- 172.21.15.154:0/3341898869 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fecf80866b0 con 0x7fed080c6c60 2023-10-10T21:18:28.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.199+0000 7fed0e39b700 1 -- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fecec0670e0 msgr2=0x7fecec069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:28.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.199+0000 7fed0e39b700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fecec0670e0 0x7fecec069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.203+0000 7fecfe7fc700 1 -- 172.21.15.154:0/3341898869 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecf8053430 con 0x7fed080c6c60 2023-10-10T21:18:28.230 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:28.229+0000 7fa74f4e8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:18:28.319 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:28.318+0000 7fa74f4e8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:18:28.336 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:28.335+0000 7f6868b91180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:18:28.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.400+0000 7fed0e39b700 1 -- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fecec0670e0 msgr2=0x7fecec069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:28.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.400+0000 7fed0e39b700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fecec0670e0 0x7fecec069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:28.435 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:28.434+0000 7f6868b91180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:18:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.448+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed080c3340 con 0x7fed080c6c60 2023-10-10T21:18:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.448+0000 7fecfe7fc700 1 -- 172.21.15.154:0/3341898869 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fecf8056a50 con 0x7fed080c6c60 2023-10-10T21:18:28.450 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:28.450 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/136831769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":136831769},{"type":"v1","addr":"172.21.15.154:6837","nonce":136831769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3500808204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3500808204},{"type":"v1","addr":"172.21.15.179:6833","nonce":3500808204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/953113300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":953113300},{"type":"v1","addr":"172.21.15.154:6835","nonce":953113300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:02.569626+0000","modified":"2023-10-10T21:18:06.123950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6472":{"gid":6472,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/434983583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":434983583},{"type":"v1","addr":"172.21.15.179:6835","nonce":434983583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-10T21:18:28.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fecec0670e0 msgr2=0x7fecec069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:28.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fecec0670e0 0x7fecec069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed080c6c60 msgr2=0x7fed080a54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed080c6c60 0x7fed080a54c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009290 tx=0x7fecf8017000 comp rx=0 tx=0).stop 2023-10-10T21:18:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 shutdown_connections 2023-10-10T21:18:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fecec0670e0 0x7fecec069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed081595a0 0x7fed080a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed0806e8c0 0x7fed080aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 --2- 172.21.15.154:0/3341898869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed080c6c60 0x7fed080a54c0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 >> 172.21.15.154:0/3341898869 conn(0x7fed0806ddb0 msgr2=0x7fed08153d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 shutdown_connections 2023-10-10T21:18:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.451+0000 7fed0f39d700 1 -- 172.21.15.154:0/3341898869 wait complete. 2023-10-10T21:18:28.455 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 38 2023-10-10T21:18:28.471 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:28.546 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:28.545+0000 7f6868b91180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:18:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.670+0000 7fb3e099d700 1 Processor -- start 2023-10-10T21:18:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.670+0000 7fb3e099d700 1 -- start start 2023-10-10T21:18:28.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.672+0000 7fb3e099d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb3dc1597f0 0x7fb3dc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.672+0000 7fb3e099d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3dc15d230 0x7fb3dc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.672+0000 7fb3e099d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc15db70 con 0x7fb3dc159420 2023-10-10T21:18:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.672+0000 7fb3e099d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0b11d0 con 0x7fb3dc15d230 2023-10-10T21:18:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.672+0000 7fb3e099d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0b14b0 con 0x7fb3dc1597f0 2023-10-10T21:18:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.672+0000 7fb3dbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3dc15d230 0x7fb3dc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.672+0000 7fb3db7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb3dc159420 0x7fb3dc0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34390/0 (socket says 172.21.15.154:34390) 2023-10-10T21:18:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.672+0000 7fb3db7fe700 1 -- 172.21.15.154:0/205248216 learned_addr learned my addr 172.21.15.154:0/205248216 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.672+0000 7fb3daffd700 1 --2- 172.21.15.154:0/205248216 >> v2:172.21.15.179:3300/0 conn(0x7fb3dc1597f0 0x7fb3dc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.673+0000 7fb3dbfff700 1 -- 172.21.15.154:0/205248216 >> v2:172.21.15.179:3300/0 conn(0x7fb3dc1597f0 msgr2=0x7fb3dc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.673+0000 7fb3dbfff700 1 --2- 172.21.15.154:0/205248216 >> v2:172.21.15.179:3300/0 conn(0x7fb3dc1597f0 0x7fb3dc0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.673+0000 7fb3dbfff700 1 -- 172.21.15.154:0/205248216 >> v1:172.21.15.154:6789/0 conn(0x7fb3dc159420 legacy=0x7fb3dc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.673+0000 7fb3dbfff700 1 -- 172.21.15.154:0/205248216 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0b1790 con 0x7fb3dc15d230 2023-10-10T21:18:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.673+0000 7fb3da7fc700 1 -- 172.21.15.154:0/205248216 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105791138 0 0) 0x7fb3dc15db70 con 0x7fb3dc159420 2023-10-10T21:18:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.673+0000 7fb3dbfff700 1 --2- 172.21.15.154:0/205248216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 0x7fb3dc15d630 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc089750 tx=0x7fb3d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2461619c5952a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.673+0000 7fb3da7fc700 1 -- 172.21.15.154:0/205248216 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400e070 con 0x7fb3dc15d230 2023-10-10T21:18:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.673+0000 7fb3da7fc700 1 -- 172.21.15.154:0/205248216 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400bb60 con 0x7fb3dc15d230 2023-10-10T21:18:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.673+0000 7fb3da7fc700 1 -- 172.21.15.154:0/205248216 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4012430 con 0x7fb3dc15d230 2023-10-10T21:18:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.674+0000 7fb3e099d700 1 -- 172.21.15.154:0/205248216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 msgr2=0x7fb3dc15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.674+0000 7fb3e099d700 1 --2- 172.21.15.154:0/205248216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 0x7fb3dc15d630 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc089750 tx=0x7fb3d4009780 comp rx=0 tx=0).stop 2023-10-10T21:18:28.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.674+0000 7fb3e099d700 1 -- 172.21.15.154:0/205248216 shutdown_connections 2023-10-10T21:18:28.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.674+0000 7fb3e099d700 1 --2- 172.21.15.154:0/205248216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 0x7fb3dc15d630 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.674+0000 7fb3e099d700 1 --2- 172.21.15.154:0/205248216 >> v2:172.21.15.179:3300/0 conn(0x7fb3dc1597f0 0x7fb3dc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.674+0000 7fb3e099d700 1 -- 172.21.15.154:0/205248216 >> 172.21.15.154:0/205248216 conn(0x7fb3dc0d0660 msgr2=0x7fb3dc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.674+0000 7fb3e099d700 1 -- 172.21.15.154:0/205248216 shutdown_connections 2023-10-10T21:18:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.674+0000 7fb3e099d700 1 -- 172.21.15.154:0/205248216 wait complete. 2023-10-10T21:18:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.675+0000 7fb3e099d700 1 Processor -- start 2023-10-10T21:18:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.675+0000 7fb3e099d700 1 -- start start 2023-10-10T21:18:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.676+0000 7fb3e099d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc159420 0x7fb3dc154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.676+0000 7fb3e099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1597f0 0x7fb3dc0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.676+0000 7fb3e099d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 0x7fb3dc0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.676+0000 7fb3e099d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0b55d0 con 0x7fb3dc15d230 2023-10-10T21:18:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.676+0000 7fb3e099d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15acb0 con 0x7fb3dc159420 2023-10-10T21:18:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.676+0000 7fb3e099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc155230 con 0x7fb3dc1597f0 2023-10-10T21:18:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3dbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 0x7fb3dc0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3db7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc159420 0x7fb3dc154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3dbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 0x7fb3dc0b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37242/0 (socket says 172.21.15.154:37242) 2023-10-10T21:18:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3dbfff700 1 -- 172.21.15.154:0/1818926900 learned_addr learned my addr 172.21.15.154:0/1818926900 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3db7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc159420 0x7fb3dc154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:38220/0 (socket says 172.21.15.154:38220) 2023-10-10T21:18:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3daffd700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1597f0 0x7fb3dc0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3dbfff700 1 -- 172.21.15.154:0/1818926900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1597f0 msgr2=0x7fb3dc0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3dbfff700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1597f0 0x7fb3dc0b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3dbfff700 1 -- 172.21.15.154:0/1818926900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc159420 msgr2=0x7fb3dc154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3dbfff700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc159420 0x7fb3dc154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3dbfff700 1 -- 172.21.15.154:0/1818926900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009a20 con 0x7fb3dc15d230 2023-10-10T21:18:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.677+0000 7fb3dbfff700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 0x7fb3dc0b4390 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40099f0 tx=0x7fb3d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.678+0000 7fb3c37fe700 1 -- 172.21.15.154:0/1818926900 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4027470 con 0x7fb3dc15d230 2023-10-10T21:18:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.678+0000 7fb3c37fe700 1 -- 172.21.15.154:0/1818926900 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4027610 con 0x7fb3dc15d230 2023-10-10T21:18:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.678+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc0b49c0 con 0x7fb3dc15d230 2023-10-10T21:18:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.678+0000 7fb3c37fe700 1 -- 172.21.15.154:0/1818926900 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40279d0 con 0x7fb3dc15d230 2023-10-10T21:18:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.678+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc0b4f80 con 0x7fb3dc15d230 2023-10-10T21:18:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.679+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc0b5780 con 0x7fb3dc15d230 2023-10-10T21:18:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.680+0000 7fb3c37fe700 1 -- 172.21.15.154:0/1818926900 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fb3d4024070 con 0x7fb3dc15d230 2023-10-10T21:18:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.681+0000 7fb3c37fe700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3c80670e0 0x7fb3c8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.681+0000 7fb3db7fe700 1 -- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3c80670e0 msgr2=0x7fb3c8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.681+0000 7fb3c37fe700 1 -- 172.21.15.154:0/1818926900 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fb3d4087230 con 0x7fb3dc15d230 2023-10-10T21:18:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.681+0000 7fb3db7fe700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3c80670e0 0x7fb3c8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.685+0000 7fb3c37fe700 1 -- 172.21.15.154:0/1818926900 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3dc0b5780 con 0x7fb3dc15d230 2023-10-10T21:18:28.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.882+0000 7fb3db7fe700 1 -- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3c80670e0 msgr2=0x7fb3c8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:28.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.882+0000 7fb3db7fe700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3c80670e0 0x7fb3c8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.889+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3dc04c3c0 con 0x7fb3dc15d230 2023-10-10T21:18:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.890+0000 7fb3c37fe700 1 -- 172.21.15.154:0/1818926900 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16369 (secure 0 0 0) 0x7fb3d4053fa0 con 0x7fb3dc15d230 2023-10-10T21:18:28.892 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:28.892 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":96,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:23.351056+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:00.451391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:01.546798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/85496":"2023-10-11T21:18:23.351023+0000","172.21.15.154:6834/85496":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/1555365363":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/4291137101":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/3849709290":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/1118596147":"2023-10-11T21:18:23.351023+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3c80670e0 msgr2=0x7fb3c8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3c80670e0 0x7fb3c8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 msgr2=0x7fb3dc0b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 0x7fb3dc0b4390 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40099f0 tx=0x7fb3d4019000 comp rx=0 tx=0).stop 2023-10-10T21:18:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 shutdown_connections 2023-10-10T21:18:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc15d230 0x7fb3dc0b4390 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb3c80670e0 0x7fb3c8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc159420 0x7fb3dc154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 --2- 172.21.15.154:0/1818926900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1597f0 0x7fb3dc0b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 >> 172.21.15.154:0/1818926900 conn(0x7fb3dc0d0660 msgr2=0x7fb3dc157190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 shutdown_connections 2023-10-10T21:18:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:28.893+0000 7fb3e099d700 1 -- 172.21.15.154:0/1818926900 wait complete. 2023-10-10T21:18:28.914 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T21:18:28.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:18:28.945 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:28.942+0000 7fa74f4e8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:18:29.115 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:29.114+0000 7fa74f4e8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:18:29.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.132+0000 7f6bebfff700 1 Processor -- start 2023-10-10T21:18:29.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.132+0000 7f6bebfff700 1 -- start start 2023-10-10T21:18:29.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.135+0000 7f6bebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.135+0000 7f6bebfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec06e8c0 con 0x7f6bec0696c0 2023-10-10T21:18:29.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.135+0000 7f6bebfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec0ca740 con 0x7f6bec15daa0 2023-10-10T21:18:29.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.135+0000 7f6bebfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec06e5e0 con 0x7f6bec15de70 2023-10-10T21:18:29.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.135+0000 7f6bea7fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:29.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.135+0000 7f6beaffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6bec15daa0 0x7f6bec0c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:39036/0 (socket says 172.21.15.154:39036) 2023-10-10T21:18:29.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.135+0000 7f6beaffd700 1 -- 172.21.15.154:0/1788969385 learned_addr learned my addr 172.21.15.154:0/1788969385 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:29.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.136+0000 7f6be9ffb700 1 -- 172.21.15.154:0/1788969385 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354965853 0 0) 0x7f6bec0ca740 con 0x7f6bec15daa0 2023-10-10T21:18:29.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.136+0000 7f6be9ffb700 1 -- 172.21.15.154:0/1788969385 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd8003570 con 0x7f6bec15daa0 2023-10-10T21:18:29.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.136+0000 7f6bea7fc700 1 -- 172.21.15.154:0/1788969385 >> v1:172.21.15.179:6789/0 conn(0x7f6bec15daa0 legacy=0x7f6bec0c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.136+0000 7f6bea7fc700 1 -- 172.21.15.154:0/1788969385 >> v1:172.21.15.154:6789/0 conn(0x7f6bec0696c0 legacy=0x7f6bec06ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.136+0000 7f6bea7fc700 1 -- 172.21.15.154:0/1788969385 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0ca0f0 con 0x7f6bec15de70 2023-10-10T21:18:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.136+0000 7f6bea7fc700 1 --2- 172.21.15.154:0/1788969385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec06e000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009e90 tx=0x7f6bd4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd62430446b62060 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.136+0000 7f6be9ffb700 1 -- 172.21.15.154:0/1788969385 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400e070 con 0x7f6bec15de70 2023-10-10T21:18:29.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.137+0000 7f6be9ffb700 1 -- 172.21.15.154:0/1788969385 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd400bbf0 con 0x7f6bec15de70 2023-10-10T21:18:29.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.137+0000 7f6be9ffb700 1 -- 172.21.15.154:0/1788969385 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4012430 con 0x7f6bec15de70 2023-10-10T21:18:29.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.137+0000 7f6bebfff700 1 -- 172.21.15.154:0/1788969385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 msgr2=0x7f6bec06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.137+0000 7f6bebfff700 1 --2- 172.21.15.154:0/1788969385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec06e000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009e90 tx=0x7f6bd4009780 comp rx=0 tx=0).stop 2023-10-10T21:18:29.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.137+0000 7f6bebfff700 1 -- 172.21.15.154:0/1788969385 shutdown_connections 2023-10-10T21:18:29.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.137+0000 7f6bebfff700 1 --2- 172.21.15.154:0/1788969385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec06e000 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.137+0000 7f6bebfff700 1 -- 172.21.15.154:0/1788969385 >> 172.21.15.154:0/1788969385 conn(0x7f6bec0cc1f0 msgr2=0x7f6bec0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:29.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.138+0000 7f6bebfff700 1 -- 172.21.15.154:0/1788969385 shutdown_connections 2023-10-10T21:18:29.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.138+0000 7f6bebfff700 1 -- 172.21.15.154:0/1788969385 wait complete. 2023-10-10T21:18:29.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.140+0000 7f6bebfff700 1 Processor -- start 2023-10-10T21:18:29.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.140+0000 7f6bebfff700 1 -- start start 2023-10-10T21:18:29.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.141+0000 7f6bebfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0696c0 0x7f6bec149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.141+0000 7f6bebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec15daa0 0x7f6bec186d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.141+0000 7f6bebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec18ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.141+0000 7f6bebfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0c5fd0 con 0x7f6bec15daa0 2023-10-10T21:18:29.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.141+0000 7f6bebfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0c5a10 con 0x7f6bec0696c0 2023-10-10T21:18:29.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.141+0000 7f6bebfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0c5cf0 con 0x7f6bec15de70 2023-10-10T21:18:29.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beaffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0696c0 0x7f6bec149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:29.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6bea7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec15daa0 0x7f6bec186d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:29.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beb7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec18ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beaffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0696c0 0x7f6bec149c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:38236/0 (socket says 172.21.15.154:38236) 2023-10-10T21:18:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beaffd700 1 -- 172.21.15.154:0/2579037133 learned_addr learned my addr 172.21.15.154:0/2579037133 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beaffd700 1 -- 172.21.15.154:0/2579037133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 msgr2=0x7f6bec18ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beaffd700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec18ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beaffd700 1 -- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec15daa0 msgr2=0x7f6bec186d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beaffd700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec15daa0 0x7f6bec186d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beaffd700 1 -- 172.21.15.154:0/2579037133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009a20 con 0x7f6bec0696c0 2023-10-10T21:18:29.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.142+0000 7f6beb7fe700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec18ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:29.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.143+0000 7f6beaffd700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0696c0 0x7f6bec149c00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c5c0 tx=0x7f6be4007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:29.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.143+0000 7f6be2ffd700 1 -- 172.21.15.154:0/2579037133 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4005b30 con 0x7f6bec0696c0 2023-10-10T21:18:29.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.143+0000 7f6be2ffd700 1 -- 172.21.15.154:0/2579037133 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4005cb0 con 0x7f6bec0696c0 2023-10-10T21:18:29.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.143+0000 7f6be2ffd700 1 -- 172.21.15.154:0/2579037133 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4007320 con 0x7f6bec0696c0 2023-10-10T21:18:29.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.143+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec147380 con 0x7f6bec0696c0 2023-10-10T21:18:29.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.143+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec14a140 con 0x7f6bec0696c0 2023-10-10T21:18:29.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.144+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec1471e0 con 0x7f6bec0696c0 2023-10-10T21:18:29.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.145+0000 7f6be2ffd700 1 -- 172.21.15.154:0/2579037133 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f6be401b3b0 con 0x7f6bec0696c0 2023-10-10T21:18:29.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.146+0000 7f6be2ffd700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6bcc0670e0 0x7f6bcc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.146+0000 7f6be2ffd700 1 -- 172.21.15.154:0/2579037133 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f6be4083fb0 con 0x7f6bec0696c0 2023-10-10T21:18:29.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.146+0000 7f6bea7fc700 1 -- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6bcc0670e0 msgr2=0x7f6bcc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:29.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.146+0000 7f6bea7fc700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6bcc0670e0 0x7f6bcc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:29.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.150+0000 7f6be2ffd700 1 -- 172.21.15.154:0/2579037133 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bec1471e0 con 0x7f6bec0696c0 2023-10-10T21:18:29.202 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:29.201+0000 7f6868b91180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:18:29.212 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:29.212+0000 7fa74f4e8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:18:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.347+0000 7f6bea7fc700 1 -- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6bcc0670e0 msgr2=0x7f6bcc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.347+0000 7f6bea7fc700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6bcc0670e0 0x7f6bcc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:29.384 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:29.383+0000 7f6868b91180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:18:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.395+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bec1471e0 con 0x7f6bec0696c0 2023-10-10T21:18:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.395+0000 7f6be2ffd700 1 -- 172.21.15.154:0/2579037133 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f6bec1471e0 con 0x7f6bec0696c0 2023-10-10T21:18:29.397 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:29.397 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/136831769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":136831769},{"type":"v1","addr":"172.21.15.154:6837","nonce":136831769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3500808204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3500808204},{"type":"v1","addr":"172.21.15.179:6833","nonce":3500808204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/953113300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":953113300},{"type":"v1","addr":"172.21.15.154:6835","nonce":953113300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:02.569626+0000","modified":"2023-10-10T21:18:06.123950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6472":{"gid":6472,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/434983583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":434983583},{"type":"v1","addr":"172.21.15.179:6835","nonce":434983583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-10T21:18:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6bcc0670e0 msgr2=0x7f6bcc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6bcc0670e0 0x7f6bcc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0696c0 msgr2=0x7f6bec149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0696c0 0x7f6bec149c00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c5c0 tx=0x7f6be4007e00 comp rx=0 tx=0).stop 2023-10-10T21:18:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 shutdown_connections 2023-10-10T21:18:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec15de70 0x7f6bec18ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6bcc0670e0 0x7f6bcc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0696c0 0x7f6bec149c00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 --2- 172.21.15.154:0/2579037133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec15daa0 0x7f6bec186d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 >> 172.21.15.154:0/2579037133 conn(0x7f6bec0cc1f0 msgr2=0x7f6bec0c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:29.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 shutdown_connections 2023-10-10T21:18:29.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.398+0000 7f6bebfff700 1 -- 172.21.15.154:0/2579037133 wait complete. 2023-10-10T21:18:29.402 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 38 2023-10-10T21:18:29.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:18:29.488 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:29.487+0000 7f6868b91180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:18:29.507 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:29.506+0000 7fa74f4e8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:18:29.602 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:29.601+0000 7fa74f4e8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:18:29.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.606+0000 7f42fc7ff700 1 Processor -- start 2023-10-10T21:18:29.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.606+0000 7f42fc7ff700 1 -- start start 2023-10-10T21:18:29.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.607+0000 7f42fc7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42f406c0a0 0x7f42f40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.607+0000 7f42fc7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f415d7e0 con 0x7f42f406bcd0 2023-10-10T21:18:29.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.607+0000 7f42fc7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f415dac0 con 0x7f42f415df50 2023-10-10T21:18:29.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.607+0000 7f42fc7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f415aa30 con 0x7f42f406c0a0 2023-10-10T21:18:29.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42fa59b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f42f406bcd0 0x7f42f415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34418/0 (socket says 172.21.15.154:34418) 2023-10-10T21:18:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42fa59b700 1 -- 172.21.15.154:0/3796367460 learned_addr learned my addr 172.21.15.154:0/3796367460 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42f9d9a700 1 --2- 172.21.15.154:0/3796367460 >> v2:172.21.15.179:3300/0 conn(0x7f42f406c0a0 0x7f42f40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:29.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42f9599700 1 -- 172.21.15.154:0/3796367460 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913192132 0 0) 0x7f42f415d7e0 con 0x7f42f406bcd0 2023-10-10T21:18:29.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42f9599700 1 -- 172.21.15.154:0/3796367460 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42e0003570 con 0x7f42f406bcd0 2023-10-10T21:18:29.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42f9599700 1 -- 172.21.15.154:0/3796367460 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913975097 0 0) 0x7f42f415dac0 con 0x7f42f415df50 2023-10-10T21:18:29.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42f9599700 1 -- 172.21.15.154:0/3796367460 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f415d7e0 con 0x7f42f415df50 2023-10-10T21:18:29.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42f9d9a700 1 -- 172.21.15.154:0/3796367460 >> v1:172.21.15.179:6789/0 conn(0x7f42f415df50 legacy=0x7f42f40c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42f9d9a700 1 -- 172.21.15.154:0/3796367460 >> v1:172.21.15.154:6789/0 conn(0x7f42f406bcd0 legacy=0x7f42f415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.608+0000 7f42f9d9a700 1 -- 172.21.15.154:0/3796367460 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f415ad10 con 0x7f42f406c0a0 2023-10-10T21:18:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.609+0000 7f42f9d9a700 1 --2- 172.21.15.154:0/3796367460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 0x7f42f40caa90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f42e40098e0 tx=0x7f42e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b869ec0c826b6b77 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.609+0000 7f42f9599700 1 -- 172.21.15.154:0/3796367460 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4011630 con 0x7f42f406c0a0 2023-10-10T21:18:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.609+0000 7f42f9599700 1 -- 172.21.15.154:0/3796367460 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e4011790 con 0x7f42f406c0a0 2023-10-10T21:18:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.609+0000 7f42f9599700 1 -- 172.21.15.154:0/3796367460 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4011b30 con 0x7f42f406c0a0 2023-10-10T21:18:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.610+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3796367460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 msgr2=0x7f42f40caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.610+0000 7f42fc7ff700 1 --2- 172.21.15.154:0/3796367460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 0x7f42f40caa90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f42e40098e0 tx=0x7f42e40091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.610+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3796367460 shutdown_connections 2023-10-10T21:18:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.610+0000 7f42fc7ff700 1 --2- 172.21.15.154:0/3796367460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 0x7f42f40caa90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.610+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3796367460 >> 172.21.15.154:0/3796367460 conn(0x7f42f40ce600 msgr2=0x7f42f40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.610+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3796367460 shutdown_connections 2023-10-10T21:18:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.610+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3796367460 wait complete. 2023-10-10T21:18:29.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.611+0000 7f42fc7ff700 1 Processor -- start 2023-10-10T21:18:29.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.612+0000 7f42fc7ff700 1 -- start start 2023-10-10T21:18:29.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.612+0000 7f42fc7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f406bcd0 0x7f42f416b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.612+0000 7f42fc7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 0x7f42f41576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.612+0000 7f42fc7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f415df50 0x7f42f40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.612+0000 7f42fc7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f416a170 con 0x7f42f406bcd0 2023-10-10T21:18:29.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.612+0000 7f42fc7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4157c30 con 0x7f42f406c0a0 2023-10-10T21:18:29.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.612+0000 7f42fc7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40c7d00 con 0x7f42f415df50 2023-10-10T21:18:29.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42fa59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f406bcd0 0x7f42f416b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:29.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42f9d9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 0x7f42f41576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:29.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42fa59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f406bcd0 0x7f42f416b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37256/0 (socket says 172.21.15.154:37256) 2023-10-10T21:18:29.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42fa59b700 1 -- 172.21.15.154:0/3734897862 learned_addr learned my addr 172.21.15.154:0/3734897862 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:29.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42fad9c700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f415df50 0x7f42f40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:29.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42fa59b700 1 -- 172.21.15.154:0/3734897862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f415df50 msgr2=0x7f42f40c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42fa59b700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f415df50 0x7f42f40c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42fa59b700 1 -- 172.21.15.154:0/3734897862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 msgr2=0x7f42f41576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42fa59b700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 0x7f42f41576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42fa59b700 1 -- 172.21.15.154:0/3734897862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4009420 con 0x7f42f406bcd0 2023-10-10T21:18:29.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.613+0000 7f42f9d9a700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 0x7f42f41576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:29.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.614+0000 7f42fa59b700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f406bcd0 0x7f42f416b4d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c790 tx=0x7f42f0007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:29.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.614+0000 7f42ea7fc700 1 -- 172.21.15.154:0/3734897862 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0005b30 con 0x7f42f406bcd0 2023-10-10T21:18:29.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.614+0000 7f42ea7fc700 1 -- 172.21.15.154:0/3734897862 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0005cd0 con 0x7f42f406bcd0 2023-10-10T21:18:29.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.614+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f40c7fd0 con 0x7f42f406bcd0 2023-10-10T21:18:29.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.614+0000 7f42ea7fc700 1 -- 172.21.15.154:0/3734897862 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0007320 con 0x7f42f406bcd0 2023-10-10T21:18:29.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.614+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f40c8590 con 0x7f42f406bcd0 2023-10-10T21:18:29.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.615+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f4169f90 con 0x7f42f406bcd0 2023-10-10T21:18:29.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.616+0000 7f42ea7fc700 1 -- 172.21.15.154:0/3734897862 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f42f0012400 con 0x7f42f406bcd0 2023-10-10T21:18:29.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.617+0000 7f42ea7fc700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f42d80670e0 0x7f42d8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:29.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.617+0000 7f42ea7fc700 1 -- 172.21.15.154:0/3734897862 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f42f0083ec0 con 0x7f42f406bcd0 2023-10-10T21:18:29.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.617+0000 7f42f9d9a700 1 -- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f42d80670e0 msgr2=0x7f42d8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:29.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.617+0000 7f42f9d9a700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f42d80670e0 0x7f42d8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:29.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.621+0000 7f42ea7fc700 1 -- 172.21.15.154:0/3734897862 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42f004b5a0 con 0x7f42f406bcd0 2023-10-10T21:18:29.796 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:29.795+0000 7f6868b91180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:18:29.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.818+0000 7f42f9d9a700 1 -- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f42d80670e0 msgr2=0x7f42d8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:29.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.818+0000 7f42f9d9a700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f42d80670e0 0x7f42d8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:29.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.863+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42f404c3c0 con 0x7f42f406bcd0 2023-10-10T21:18:29.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.863+0000 7f42ea7fc700 1 -- 172.21.15.154:0/3734897862 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f42f0017020 con 0x7f42f406bcd0 2023-10-10T21:18:29.865 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:29.865 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/136831769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":136831769},{"type":"v1","addr":"172.21.15.154:6837","nonce":136831769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3500808204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3500808204},{"type":"v1","addr":"172.21.15.179:6833","nonce":3500808204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/953113300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":953113300},{"type":"v1","addr":"172.21.15.154:6835","nonce":953113300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:02.569626+0000","modified":"2023-10-10T21:18:06.123950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6472":{"gid":6472,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/434983583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":434983583},{"type":"v1","addr":"172.21.15.179:6835","nonce":434983583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-10T21:18:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f42d80670e0 msgr2=0x7f42d8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f42d80670e0 0x7f42d8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f406bcd0 msgr2=0x7f42f416b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f406bcd0 0x7f42f416b4d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c790 tx=0x7f42f0007e80 comp rx=0 tx=0).stop 2023-10-10T21:18:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 shutdown_connections 2023-10-10T21:18:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f415df50 0x7f42f40c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f406bcd0 0x7f42f416b4d0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f42d80670e0 0x7f42d8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 --2- 172.21.15.154:0/3734897862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f406c0a0 0x7f42f41576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:29.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 >> 172.21.15.154:0/3734897862 conn(0x7f42f40ce600 msgr2=0x7f42f415a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:29.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 shutdown_connections 2023-10-10T21:18:29.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:29.866+0000 7f42fc7ff700 1 -- 172.21.15.154:0/3734897862 wait complete. 2023-10-10T21:18:29.870 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 38 2023-10-10T21:18:29.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:29.897 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:29.896+0000 7f6868b91180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:18:30.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.076+0000 7fcb739ff700 1 Processor -- start 2023-10-10T21:18:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.076+0000 7fcb739ff700 1 -- start start 2023-10-10T21:18:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.078+0000 7fcb739ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb6c0cbf30 0x7fcb6c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.078+0000 7fcb739ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb6c0b1420 0x7fcb6c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.078+0000 7fcb739ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c0cc300 con 0x7fcb6c0ccf90 2023-10-10T21:18:30.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.078+0000 7fcb739ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c156bf0 con 0x7fcb6c0b1420 2023-10-10T21:18:30.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.078+0000 7fcb739ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c0ae950 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.078+0000 7fcb71f9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb6c0b1420 0x7fcb6c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:30.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.078+0000 7fcb71f9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb6c0b1420 0x7fcb6c0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37266/0 (socket says 172.21.15.154:37266) 2023-10-10T21:18:30.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.078+0000 7fcb71f9c700 1 -- 172.21.15.154:0/3922170663 learned_addr learned my addr 172.21.15.154:0/3922170663 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:30.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.078+0000 7fcb7179b700 1 --2- 172.21.15.154:0/3922170663 >> v2:172.21.15.179:3300/0 conn(0x7fcb6c0cbf30 0x7fcb6c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:30.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.079+0000 7fcb71f9c700 1 -- 172.21.15.154:0/3922170663 >> v2:172.21.15.179:3300/0 conn(0x7fcb6c0cbf30 msgr2=0x7fcb6c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.079+0000 7fcb71f9c700 1 --2- 172.21.15.154:0/3922170663 >> v2:172.21.15.179:3300/0 conn(0x7fcb6c0cbf30 0x7fcb6c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.079+0000 7fcb71f9c700 1 -- 172.21.15.154:0/3922170663 >> v1:172.21.15.179:6789/0 conn(0x7fcb6c0ccf90 legacy=0x7fcb6c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.079+0000 7fcb71f9c700 1 -- 172.21.15.154:0/3922170663 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0ad370 con 0x7fcb6c0b1420 2023-10-10T21:18:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.079+0000 7fcb63fff700 1 -- 172.21.15.154:0/3922170663 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848906566 0 0) 0x7fcb6c0cc300 con 0x7fcb6c0ccf90 2023-10-10T21:18:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.079+0000 7fcb7179b700 1 --2- 172.21.15.154:0/3922170663 >> v2:172.21.15.179:3300/0 conn(0x7fcb6c0cbf30 0x7fcb6c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.079+0000 7fcb71f9c700 1 --2- 172.21.15.154:0/3922170663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0b1420 0x7fcb6c0c9740 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c063d40 tx=0x7fcb64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f91b58b3017f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.080+0000 7fcb63fff700 1 -- 172.21.15.154:0/3922170663 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400e070 con 0x7fcb6c0b1420 2023-10-10T21:18:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.080+0000 7fcb63fff700 1 -- 172.21.15.154:0/3922170663 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6400b990 con 0x7fcb6c0b1420 2023-10-10T21:18:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.080+0000 7fcb63fff700 1 -- 172.21.15.154:0/3922170663 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb640092e0 con 0x7fcb6c0b1420 2023-10-10T21:18:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.081+0000 7fcb739ff700 1 -- 172.21.15.154:0/3922170663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0b1420 msgr2=0x7fcb6c0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.081+0000 7fcb739ff700 1 --2- 172.21.15.154:0/3922170663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0b1420 0x7fcb6c0c9740 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c063d40 tx=0x7fcb64009840 comp rx=0 tx=0).stop 2023-10-10T21:18:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.081+0000 7fcb739ff700 1 -- 172.21.15.154:0/3922170663 shutdown_connections 2023-10-10T21:18:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.081+0000 7fcb739ff700 1 --2- 172.21.15.154:0/3922170663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0b1420 0x7fcb6c0c9740 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.081+0000 7fcb739ff700 1 --2- 172.21.15.154:0/3922170663 >> v2:172.21.15.179:3300/0 conn(0x7fcb6c0cbf30 0x7fcb6c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.081+0000 7fcb739ff700 1 -- 172.21.15.154:0/3922170663 >> 172.21.15.154:0/3922170663 conn(0x7fcb6c06a320 msgr2=0x7fcb6c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:30.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.081+0000 7fcb739ff700 1 -- 172.21.15.154:0/3922170663 shutdown_connections 2023-10-10T21:18:30.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.081+0000 7fcb739ff700 1 -- 172.21.15.154:0/3922170663 wait complete. 2023-10-10T21:18:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.082+0000 7fcb739ff700 1 Processor -- start 2023-10-10T21:18:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.083+0000 7fcb739ff700 1 -- start start 2023-10-10T21:18:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.083+0000 7fcb739ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6c0b1420 0x7fcb6c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.083+0000 7fcb739ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0cbf30 0x7fcb6c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.083+0000 7fcb739ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb6c0ccf90 0x7fcb6c0a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.083+0000 7fcb739ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c141e80 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.083+0000 7fcb739ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c142090 con 0x7fcb6c0ccf90 2023-10-10T21:18:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb739ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c142370 con 0x7fcb6c0b1420 2023-10-10T21:18:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb70f9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0cbf30 0x7fcb6c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb71f9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb6c0ccf90 0x7fcb6c0a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb70f9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0cbf30 0x7fcb6c15a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37272/0 (socket says 172.21.15.154:37272) 2023-10-10T21:18:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb71f9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb6c0ccf90 0x7fcb6c0a54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:38280/0 (socket says 172.21.15.154:38280) 2023-10-10T21:18:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb70f9a700 1 -- 172.21.15.154:0/2549630982 learned_addr learned my addr 172.21.15.154:0/2549630982 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb7179b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6c0b1420 0x7fcb6c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb70f9a700 1 -- 172.21.15.154:0/2549630982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6c0b1420 msgr2=0x7fcb6c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb70f9a700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6c0b1420 0x7fcb6c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb70f9a700 1 -- 172.21.15.154:0/2549630982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb6c0ccf90 msgr2=0x7fcb6c0a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb70f9a700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb6c0ccf90 0x7fcb6c0a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.084+0000 7fcb70f9a700 1 -- 172.21.15.154:0/2549630982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68009420 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.085+0000 7fcb70f9a700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0cbf30 0x7fcb6c15a250 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c530 tx=0x7fcb5c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.085+0000 7fcb617fa700 1 -- 172.21.15.154:0/2549630982 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c011590 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.085+0000 7fcb617fa700 1 -- 172.21.15.154:0/2549630982 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c011710 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.085+0000 7fcb617fa700 1 -- 172.21.15.154:0/2549630982 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c011ad0 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.085+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb64009ae0 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.085+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c142930 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.086+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c04c3c0 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.087+0000 7fcb617fa700 1 -- 172.21.15.154:0/2549630982 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fcb5c01b3b0 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.088+0000 7fcb617fa700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcb500670e0 0x7fcb50069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.088+0000 7fcb7179b700 1 -- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcb500670e0 msgr2=0x7fcb50069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:30.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.088+0000 7fcb617fa700 1 -- 172.21.15.154:0/2549630982 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fcb5c083ff0 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.088+0000 7fcb7179b700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcb500670e0 0x7fcb50069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:30.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.093+0000 7fcb617fa700 1 -- 172.21.15.154:0/2549630982 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb5c050cd0 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.289+0000 7fcb7179b700 1 -- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcb500670e0 msgr2=0x7fcb50069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:30.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.289+0000 7fcb7179b700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcb500670e0 0x7fcb50069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.291+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb6c0ad650 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.292+0000 7fcb617fa700 1 -- 172.21.15.154:0/2549630982 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16369 (secure 0 0 0) 0x7fcb5c017070 con 0x7fcb6c0cbf30 2023-10-10T21:18:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:30.294 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":96,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:23.351056+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:00.451391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:01.546798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/85496":"2023-10-11T21:18:23.351023+0000","172.21.15.154:6834/85496":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/1555365363":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/4291137101":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/3849709290":"2023-10-11T21:18:23.351023+0000","172.21.15.154:0/1118596147":"2023-10-11T21:18:23.351023+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.294+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcb500670e0 msgr2=0x7fcb50069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.294+0000 7fcb739ff700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcb500670e0 0x7fcb50069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0cbf30 msgr2=0x7fcb6c15a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0cbf30 0x7fcb6c15a250 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c530 tx=0x7fcb5c00c840 comp rx=0 tx=0).stop 2023-10-10T21:18:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 shutdown_connections 2023-10-10T21:18:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcb500670e0 0x7fcb50069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb6c0ccf90 0x7fcb6c0a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6c0b1420 0x7fcb6c159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 --2- 172.21.15.154:0/2549630982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb6c0cbf30 0x7fcb6c15a250 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 >> 172.21.15.154:0/2549630982 conn(0x7fcb6c06a320 msgr2=0x7fcb6c0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:30.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 shutdown_connections 2023-10-10T21:18:30.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.295+0000 7fcb739ff700 1 -- 172.21.15.154:0/2549630982 wait complete. 2023-10-10T21:18:30.304 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:30.304+0000 7fa74f4e8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:18:30.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T21:18:30.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.547+0000 7f89bbfff700 1 Processor -- start 2023-10-10T21:18:30.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.547+0000 7f89bbfff700 1 -- start start 2023-10-10T21:18:30.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.548+0000 7f89bbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f89bc159420 0x7f89bc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.548+0000 7f89bbfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89bc0b2980 con 0x7f89bc1597f0 2023-10-10T21:18:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.548+0000 7f89bbfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89bc0b11d0 con 0x7f89bc15d230 2023-10-10T21:18:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.548+0000 7f89bbfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89bc0b14b0 con 0x7f89bc159420 2023-10-10T21:18:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89ba7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f89bc1597f0 0x7f89bc0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34430/0 (socket says 172.21.15.154:34430) 2023-10-10T21:18:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89ba7fc700 1 -- 172.21.15.154:0/2641758731 learned_addr learned my addr 172.21.15.154:0/2641758731 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:30.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89baffd700 1 --2- 172.21.15.154:0/2641758731 >> v2:172.21.15.179:3300/0 conn(0x7f89bc159420 0x7f89bc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:30.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89b9ffb700 1 -- 172.21.15.154:0/2641758731 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519178229 0 0) 0x7f89bc0b2980 con 0x7f89bc1597f0 2023-10-10T21:18:30.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89b9ffb700 1 -- 172.21.15.154:0/2641758731 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89a4003570 con 0x7f89bc1597f0 2023-10-10T21:18:30.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89b9ffb700 1 -- 172.21.15.154:0/2641758731 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098152068 0 0) 0x7f89bc0b11d0 con 0x7f89bc15d230 2023-10-10T21:18:30.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89b9ffb700 1 -- 172.21.15.154:0/2641758731 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89bc0b2980 con 0x7f89bc15d230 2023-10-10T21:18:30.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89baffd700 1 -- 172.21.15.154:0/2641758731 >> v1:172.21.15.179:6789/0 conn(0x7f89bc15d230 legacy=0x7f89bc15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89baffd700 1 -- 172.21.15.154:0/2641758731 >> v1:172.21.15.154:6789/0 conn(0x7f89bc1597f0 legacy=0x7f89bc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.549+0000 7f89baffd700 1 -- 172.21.15.154:0/2641758731 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc0b1790 con 0x7f89bc159420 2023-10-10T21:18:30.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.550+0000 7f89baffd700 1 --2- 172.21.15.154:0/2641758731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89bc159420 0x7f89bc0b5f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0098e0 tx=0x7f89ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76f1fb96b5b2c0e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:30.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.550+0000 7f89b9ffb700 1 -- 172.21.15.154:0/2641758731 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac011630 con 0x7f89bc159420 2023-10-10T21:18:30.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.550+0000 7f89b9ffb700 1 -- 172.21.15.154:0/2641758731 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ac011790 con 0x7f89bc159420 2023-10-10T21:18:30.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.550+0000 7f89b9ffb700 1 -- 172.21.15.154:0/2641758731 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac011b30 con 0x7f89bc159420 2023-10-10T21:18:30.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.550+0000 7f89bbfff700 1 -- 172.21.15.154:0/2641758731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89bc159420 msgr2=0x7f89bc0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.550+0000 7f89bbfff700 1 --2- 172.21.15.154:0/2641758731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89bc159420 0x7f89bc0b5f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0098e0 tx=0x7f89ac0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.551+0000 7f89bbfff700 1 -- 172.21.15.154:0/2641758731 shutdown_connections 2023-10-10T21:18:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.551+0000 7f89bbfff700 1 --2- 172.21.15.154:0/2641758731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89bc159420 0x7f89bc0b5f40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.551+0000 7f89bbfff700 1 -- 172.21.15.154:0/2641758731 >> 172.21.15.154:0/2641758731 conn(0x7f89bc0d0660 msgr2=0x7f89bc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.551+0000 7f89bbfff700 1 -- 172.21.15.154:0/2641758731 shutdown_connections 2023-10-10T21:18:30.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.551+0000 7f89bbfff700 1 -- 172.21.15.154:0/2641758731 wait complete. 2023-10-10T21:18:30.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.552+0000 7f89bbfff700 1 Processor -- start 2023-10-10T21:18:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.552+0000 7f89bbfff700 1 -- start start 2023-10-10T21:18:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89bbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89bc159420 0x7f89bc155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89bbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89bc1597f0 0x7f89bc0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89bbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89bc15d230 0x7f89bc15e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89bbfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc0c7b20 con 0x7f89bc15d230 2023-10-10T21:18:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89bbfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc0c6f10 con 0x7f89bc1597f0 2023-10-10T21:18:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89bbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc0c71f0 con 0x7f89bc159420 2023-10-10T21:18:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89bb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89bc15d230 0x7f89bc15e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89ba7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89bc1597f0 0x7f89bc0c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:30.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89bb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89bc15d230 0x7f89bc15e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37280/0 (socket says 172.21.15.154:37280) 2023-10-10T21:18:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89bb7fe700 1 -- 172.21.15.154:0/1777567693 learned_addr learned my addr 172.21.15.154:0/1777567693 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.553+0000 7f89baffd700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89bc159420 0x7f89bc155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89bb7fe700 1 -- 172.21.15.154:0/1777567693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89bc159420 msgr2=0x7f89bc155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89bb7fe700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89bc159420 0x7f89bc155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89bb7fe700 1 -- 172.21.15.154:0/1777567693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89bc1597f0 msgr2=0x7f89bc0c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89bb7fe700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89bc1597f0 0x7f89bc0c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89bb7fe700 1 -- 172.21.15.154:0/1777567693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac009420 con 0x7f89bc15d230 2023-10-10T21:18:30.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89bb7fe700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89bc15d230 0x7f89bc15e370 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c830 tx=0x7f89b4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:30.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89a2ffd700 1 -- 172.21.15.154:0/1777567693 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4012630 con 0x7f89bc15d230 2023-10-10T21:18:30.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89a2ffd700 1 -- 172.21.15.154:0/1777567693 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4012790 con 0x7f89bc15d230 2023-10-10T21:18:30.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc0c74d0 con 0x7f89bc15d230 2023-10-10T21:18:30.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89a2ffd700 1 -- 172.21.15.154:0/1777567693 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4012b50 con 0x7f89bc15d230 2023-10-10T21:18:30.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.554+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc155ad0 con 0x7f89bc15d230 2023-10-10T21:18:30.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.555+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89bc04c3c0 con 0x7f89bc15d230 2023-10-10T21:18:30.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.556+0000 7f89a2ffd700 1 -- 172.21.15.154:0/1777567693 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f89b401a3b0 con 0x7f89bc15d230 2023-10-10T21:18:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.557+0000 7f89a2ffd700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f89a80670e0 0x7f89a8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.557+0000 7f89a2ffd700 1 -- 172.21.15.154:0/1777567693 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f89b4084790 con 0x7f89bc15d230 2023-10-10T21:18:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.557+0000 7f89baffd700 1 -- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f89a80670e0 msgr2=0x7f89a8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.557+0000 7f89baffd700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f89a80670e0 0x7f89a8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.561+0000 7f89a2ffd700 1 -- 172.21.15.154:0/1777567693 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89b4051450 con 0x7f89bc15d230 2023-10-10T21:18:30.592 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:30.591+0000 7fa74f4e8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:18:30.648 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:30.647+0000 7f6868b91180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:18:30.683 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:30.683+0000 7fa74f4e8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:18:30.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.758+0000 7f89baffd700 1 -- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f89a80670e0 msgr2=0x7f89a8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:30.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.758+0000 7f89baffd700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f89a80670e0 0x7f89a8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.801+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f89bc0c7c60 con 0x7f89bc15d230 2023-10-10T21:18:30.803 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T21:18:30.802+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T21:18:30.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.810+0000 7f89a2ffd700 1 -- 172.21.15.154:0/1777567693 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f89b4054a70 con 0x7f89bc15d230 2023-10-10T21:18:30.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f89a80670e0 msgr2=0x7f89a8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:30.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f89a80670e0 0x7f89a8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89bc15d230 msgr2=0x7f89bc15e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89bc15d230 0x7f89bc15e370 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c830 tx=0x7f89b4007f90 comp rx=0 tx=0).stop 2023-10-10T21:18:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 shutdown_connections 2023-10-10T21:18:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89bc15d230 0x7f89bc15e370 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89bc159420 0x7f89bc155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f89a80670e0 0x7f89a8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 --2- 172.21.15.154:0/1777567693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89bc1597f0 0x7f89bc0c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 >> 172.21.15.154:0/1777567693 conn(0x7f89bc0d0660 msgr2=0x7f89bc069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 shutdown_connections 2023-10-10T21:18:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:30.813+0000 7f89bbfff700 1 -- 172.21.15.154:0/1777567693 wait complete. 2023-10-10T21:18:30.817 INFO:tasks.ceph.mds.b.smithi179.stderr: -1263> 2023-10-10T21:18:07.814+0000 7f4a825f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:18:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T21:18:30.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T21:18:30.855 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:30.855+0000 7fa74f4e8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:18:30.868 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:18:30.944 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:30.943+0000 7f6868b91180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:18:30.965 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:30.965+0000 7fa74f4e8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:18:31.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.021+0000 7f928cb9d700 1 Processor -- start 2023-10-10T21:18:31.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.022+0000 7f928cb9d700 1 -- start start 2023-10-10T21:18:31.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f928cb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 0x7f92880ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f928cb9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92880b16d0 0x7f92880b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f928cb9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f928815d240 0x7f928815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f928cb9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92880b2080 con 0x7f928815d240 2023-10-10T21:18:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f928cb9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92880cfb00 con 0x7f92880b16d0 2023-10-10T21:18:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f928cb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92880b5c40 con 0x7f92880b4e70 2023-10-10T21:18:31.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f9287fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f928815d240 0x7f928815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:31.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f9287fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f928815d240 0x7f928815d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37288/0 (socket says 172.21.15.154:37288) 2023-10-10T21:18:31.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f9287fff700 1 -- 172.21.15.154:0/3932486045 learned_addr learned my addr 172.21.15.154:0/3932486045 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:31.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.023+0000 7f9286ffd700 1 --2- 172.21.15.154:0/3932486045 >> v2:172.21.15.179:3300/0 conn(0x7f92880b16d0 0x7f92880b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:31.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.024+0000 7f92877fe700 1 --2- 172.21.15.154:0/3932486045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 0x7f92880ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:31.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.024+0000 7f9287fff700 1 -- 172.21.15.154:0/3932486045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 msgr2=0x7f92880ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:31.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.024+0000 7f9287fff700 1 --2- 172.21.15.154:0/3932486045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 0x7f92880ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.024+0000 7f9287fff700 1 -- 172.21.15.154:0/3932486045 >> v2:172.21.15.179:3300/0 conn(0x7f92880b16d0 msgr2=0x7f92880b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:31.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.024+0000 7f9287fff700 1 --2- 172.21.15.154:0/3932486045 >> v2:172.21.15.179:3300/0 conn(0x7f92880b16d0 0x7f92880b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.024+0000 7f9287fff700 1 -- 172.21.15.154:0/3932486045 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92880b5f20 con 0x7f928815d240 2023-10-10T21:18:31.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.024+0000 7f9286ffd700 1 --2- 172.21.15.154:0/3932486045 >> v2:172.21.15.179:3300/0 conn(0x7f92880b16d0 0x7f92880b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:31.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.025+0000 7f9287fff700 1 --2- 172.21.15.154:0/3932486045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928815d240 0x7f928815d6c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f9288089440 tx=0x7f9280009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41deb570016e5ce server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:31.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.025+0000 7f92867fc700 1 -- 172.21.15.154:0/3932486045 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000e070 con 0x7f928815d240 2023-10-10T21:18:31.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.025+0000 7f92867fc700 1 -- 172.21.15.154:0/3932486045 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928000b970 con 0x7f928815d240 2023-10-10T21:18:31.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.025+0000 7f92867fc700 1 -- 172.21.15.154:0/3932486045 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800092e0 con 0x7f928815d240 2023-10-10T21:18:31.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.026+0000 7f928cb9d700 1 -- 172.21.15.154:0/3932486045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928815d240 msgr2=0x7f928815d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:31.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.026+0000 7f928cb9d700 1 --2- 172.21.15.154:0/3932486045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928815d240 0x7f928815d6c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f9288089440 tx=0x7f9280009840 comp rx=0 tx=0).stop 2023-10-10T21:18:31.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.026+0000 7f928cb9d700 1 -- 172.21.15.154:0/3932486045 shutdown_connections 2023-10-10T21:18:31.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.026+0000 7f928cb9d700 1 --2- 172.21.15.154:0/3932486045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928815d240 0x7f928815d6c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.026+0000 7f928cb9d700 1 --2- 172.21.15.154:0/3932486045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 0x7f92880ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.026+0000 7f928cb9d700 1 --2- 172.21.15.154:0/3932486045 >> v2:172.21.15.179:3300/0 conn(0x7f92880b16d0 0x7f92880b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.026+0000 7f928cb9d700 1 -- 172.21.15.154:0/3932486045 >> 172.21.15.154:0/3932486045 conn(0x7f92880d10c0 msgr2=0x7f92880affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:31.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.026+0000 7f928cb9d700 1 -- 172.21.15.154:0/3932486045 shutdown_connections 2023-10-10T21:18:31.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.026+0000 7f928cb9d700 1 -- 172.21.15.154:0/3932486045 wait complete. 2023-10-10T21:18:31.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.028+0000 7f928cb9d700 1 Processor -- start 2023-10-10T21:18:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.028+0000 7f928cb9d700 1 -- start start 2023-10-10T21:18:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f928cb9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92880b16d0 0x7f928816a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f928cb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 0x7f92880ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f928cb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f928815d240 0x7f92880c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f928cb9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92880c5fa0 con 0x7f92880b16d0 2023-10-10T21:18:31.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f928cb9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92880c7d90 con 0x7f928815d240 2023-10-10T21:18:31.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f928cb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92880c5390 con 0x7f92880b4e70 2023-10-10T21:18:31.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f92877fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92880b16d0 0x7f928816a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:31.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f92877fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92880b16d0 0x7f928816a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37298/0 (socket says 172.21.15.154:37298) 2023-10-10T21:18:31.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f92877fe700 1 -- 172.21.15.154:0/80048841 learned_addr learned my addr 172.21.15.154:0/80048841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:31.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f9286ffd700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 0x7f92880ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:31.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.029+0000 7f9287fff700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f928815d240 0x7f92880c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:31.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f92877fe700 1 -- 172.21.15.154:0/80048841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 msgr2=0x7f92880ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:31.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f92877fe700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 0x7f92880ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f92877fe700 1 -- 172.21.15.154:0/80048841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f928815d240 msgr2=0x7f92880c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:31.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f92877fe700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f928815d240 0x7f92880c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f92877fe700 1 -- 172.21.15.154:0/80048841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009420 con 0x7f92880b16d0 2023-10-10T21:18:31.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f9286ffd700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 0x7f92880ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:31.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f92877fe700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92880b16d0 0x7f928816a090 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f927800ec80 tx=0x7f92780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:31.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f926f7fe700 1 -- 172.21.15.154:0/80048841 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800c850 con 0x7f92880b16d0 2023-10-10T21:18:31.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f926f7fe700 1 -- 172.21.15.154:0/80048841 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927800c9b0 con 0x7f92880b16d0 2023-10-10T21:18:31.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f926f7fe700 1 -- 172.21.15.154:0/80048841 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800cd50 con 0x7f92880b16d0 2023-10-10T21:18:31.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.030+0000 7f928cb9d700 1 -- 172.21.15.154:0/80048841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9280009ae0 con 0x7f92880b16d0 2023-10-10T21:18:31.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.031+0000 7f928cb9d700 1 -- 172.21.15.154:0/80048841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92880c5950 con 0x7f92880b16d0 2023-10-10T21:18:31.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.032+0000 7f928cb9d700 1 -- 172.21.15.154:0/80048841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92880cf510 con 0x7f92880b16d0 2023-10-10T21:18:31.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.032+0000 7f926f7fe700 1 -- 172.21.15.154:0/80048841 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9278013680 con 0x7f92880b16d0 2023-10-10T21:18:31.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.033+0000 7f926f7fe700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 0x7f9274069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:31.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.033+0000 7f926f7fe700 1 -- 172.21.15.154:0/80048841 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f9278084d50 con 0x7f92880b16d0 2023-10-10T21:18:31.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.034+0000 7f9286ffd700 1 -- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 msgr2=0x7f9274069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:31.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.034+0000 7f9286ffd700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 0x7f9274069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:31.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.037+0000 7f926f7fe700 1 -- 172.21.15.154:0/80048841 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9278088030 con 0x7f92880b16d0 2023-10-10T21:18:31.043 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:31.042+0000 7f6868b91180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:18:31.155 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:31.155+0000 7fa74f4e8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:18:31.201 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:31.200+0000 7f6868b91180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:18:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.235+0000 7f9286ffd700 1 -- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 msgr2=0x7f9274069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.235+0000 7f9286ffd700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 0x7f9274069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:31.247 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:31.247+0000 7fa74f4e8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:18:31.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.275+0000 7f928cb9d700 1 -- 172.21.15.154:0/80048841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f928804bb80 con 0x7f92880b16d0 2023-10-10T21:18:31.308 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:31.307+0000 7f6868b91180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:18:31.339 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:31.339+0000 7fa74f4e8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:18:31.434 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:31.434+0000 7fa74f4e8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:18:31.498 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:31.497+0000 7f6868b91180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:18:31.591 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:31.590+0000 7f6868b91180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:18:31.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.636+0000 7f9286ffd700 1 -- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 msgr2=0x7f9274069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:31.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.636+0000 7f9286ffd700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 0x7f9274069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:18:31.686 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:31.685+0000 7f6868b91180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:18:31.779 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:31.778+0000 7f6868b91180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:18:31.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.789+0000 7f926f7fe700 1 -- 172.21.15.154:0/80048841 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 42) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f9278051e30 con 0x7f92880b16d0 2023-10-10T21:18:31.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.789+0000 7f926f7fe700 1 -- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 msgr2=0x7f9274069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:31.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.789+0000 7f926f7fe700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 0x7f9274069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.811+0000 7f926f7fe700 1 -- 172.21.15.154:0/80048841 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7f927806ffb0 con 0x7f92880b16d0 2023-10-10T21:18:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.813+0000 7f928cb9d700 1 -- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92880b16d0 msgr2=0x7f928816a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.813+0000 7f928cb9d700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92880b16d0 0x7f928816a090 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f927800ec80 tx=0x7f92780091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.813+0000 7f928cb9d700 1 -- 172.21.15.154:0/80048841 shutdown_connections 2023-10-10T21:18:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.813+0000 7f928cb9d700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f92740670e0 0x7f9274069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.813+0000 7f928cb9d700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f928815d240 0x7f92880c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.813+0000 7f928cb9d700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92880b16d0 0x7f928816a090 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.813+0000 7f928cb9d700 1 --2- 172.21.15.154:0/80048841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b4e70 0x7f92880ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.813+0000 7f928cb9d700 1 -- 172.21.15.154:0/80048841 >> 172.21.15.154:0/80048841 conn(0x7f92880d10c0 msgr2=0x7f9288068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.814+0000 7f928cb9d700 1 -- 172.21.15.154:0/80048841 shutdown_connections 2023-10-10T21:18:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:31.814+0000 7f928cb9d700 1 -- 172.21.15.154:0/80048841 wait complete. 2023-10-10T21:18:31.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T21:18:32.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.025+0000 7fcc511ff700 1 Processor -- start 2023-10-10T21:18:32.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.026+0000 7fcc511ff700 1 -- start start 2023-10-10T21:18:32.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc511ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcc4c1563b0 0x7fcc4c156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:32.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc511ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc4c15a440 0x7fcc4c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:32.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc511ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c15a9b0 con 0x7fcc4c068890 2023-10-10T21:18:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc511ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c15ac90 con 0x7fcc4c15a440 2023-10-10T21:18:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc511ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c15af70 con 0x7fcc4c1563b0 2023-10-10T21:18:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc4a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc4c15a440 0x7fcc4c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc4a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc4c15a440 0x7fcc4c0acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37384/0 (socket says 172.21.15.154:37384) 2023-10-10T21:18:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc4a59c700 1 -- 172.21.15.154:0/2129245267 learned_addr learned my addr 172.21.15.154:0/2129245267 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:32.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc4ad9d700 1 --2- 172.21.15.154:0/2129245267 >> v2:172.21.15.179:3300/0 conn(0x7fcc4c1563b0 0x7fcc4c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:32.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc4a59c700 1 -- 172.21.15.154:0/2129245267 >> v2:172.21.15.179:3300/0 conn(0x7fcc4c1563b0 msgr2=0x7fcc4c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:32.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc4a59c700 1 --2- 172.21.15.154:0/2129245267 >> v2:172.21.15.179:3300/0 conn(0x7fcc4c1563b0 0x7fcc4c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc4a59c700 1 -- 172.21.15.154:0/2129245267 >> v1:172.21.15.179:6789/0 conn(0x7fcc4c068890 legacy=0x7fcc4c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:32.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.028+0000 7fcc4a59c700 1 -- 172.21.15.154:0/2129245267 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c15b250 con 0x7fcc4c15a440 2023-10-10T21:18:32.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.027+0000 7fcc49d9b700 1 -- 172.21.15.154:0/2129245267 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013949216 0 0) 0x7fcc4c15a9b0 con 0x7fcc4c068890 2023-10-10T21:18:32.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.028+0000 7fcc4a59c700 1 --2- 172.21.15.154:0/2129245267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c15a440 0x7fcc4c0acf30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06a9f0 tx=0x7fcc40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918ca94f8d4f0052 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:32.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.028+0000 7fcc49d9b700 1 -- 172.21.15.154:0/2129245267 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40009e70 con 0x7fcc4c15a440 2023-10-10T21:18:32.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.028+0000 7fcc49d9b700 1 -- 172.21.15.154:0/2129245267 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4000b860 con 0x7fcc4c15a440 2023-10-10T21:18:32.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.028+0000 7fcc49d9b700 1 -- 172.21.15.154:0/2129245267 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000bc00 con 0x7fcc4c15a440 2023-10-10T21:18:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.028+0000 7fcc511ff700 1 -- 172.21.15.154:0/2129245267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c15a440 msgr2=0x7fcc4c0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.028+0000 7fcc511ff700 1 --2- 172.21.15.154:0/2129245267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c15a440 0x7fcc4c0acf30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06a9f0 tx=0x7fcc40009250 comp rx=0 tx=0).stop 2023-10-10T21:18:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.029+0000 7fcc511ff700 1 -- 172.21.15.154:0/2129245267 shutdown_connections 2023-10-10T21:18:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.029+0000 7fcc511ff700 1 --2- 172.21.15.154:0/2129245267 >> v2:172.21.15.179:3300/0 conn(0x7fcc4c1563b0 0x7fcc4c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.029+0000 7fcc511ff700 1 --2- 172.21.15.154:0/2129245267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c15a440 0x7fcc4c0acf30 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.029+0000 7fcc511ff700 1 -- 172.21.15.154:0/2129245267 >> 172.21.15.154:0/2129245267 conn(0x7fcc4c0c8f90 msgr2=0x7fcc4c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.029+0000 7fcc511ff700 1 -- 172.21.15.154:0/2129245267 shutdown_connections 2023-10-10T21:18:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.029+0000 7fcc511ff700 1 -- 172.21.15.154:0/2129245267 wait complete. 2023-10-10T21:18:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.030+0000 7fcc511ff700 1 Processor -- start 2023-10-10T21:18:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.030+0000 7fcc511ff700 1 -- start start 2023-10-10T21:18:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.031+0000 7fcc511ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c068890 0x7fcc4c0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.031+0000 7fcc511ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c1563b0 0x7fcc4c0cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.031+0000 7fcc511ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc4c15a440 0x7fcc4c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.031+0000 7fcc511ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0caed0 con 0x7fcc4c1563b0 2023-10-10T21:18:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.031+0000 7fcc511ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c169c50 con 0x7fcc4c068890 2023-10-10T21:18:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.031+0000 7fcc511ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0cb890 con 0x7fcc4c15a440 2023-10-10T21:18:32.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.031+0000 7fcc4a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c1563b0 0x7fcc4c0cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:32.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4ad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c068890 0x7fcc4c0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:32.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c1563b0 0x7fcc4c0cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37394/0 (socket says 172.21.15.154:37394) 2023-10-10T21:18:32.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4a59c700 1 -- 172.21.15.154:0/1057794417 learned_addr learned my addr 172.21.15.154:0/1057794417 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:32.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4b59e700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc4c15a440 0x7fcc4c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:32.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4a59c700 1 -- 172.21.15.154:0/1057794417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc4c15a440 msgr2=0x7fcc4c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:32.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4a59c700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc4c15a440 0x7fcc4c0b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4a59c700 1 -- 172.21.15.154:0/1057794417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c068890 msgr2=0x7fcc4c0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:32.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4a59c700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c068890 0x7fcc4c0ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4a59c700 1 -- 172.21.15.154:0/1057794417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400094f0 con 0x7fcc4c1563b0 2023-10-10T21:18:32.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc4a59c700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c1563b0 0x7fcc4c0cbbe0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcc400094c0 tx=0x7fcc40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:32.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc32ffd700 1 -- 172.21.15.154:0/1057794417 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000bbe0 con 0x7fcc4c1563b0 2023-10-10T21:18:32.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc32ffd700 1 -- 172.21.15.154:0/1057794417 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc40000c90 con 0x7fcc4c1563b0 2023-10-10T21:18:32.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c0ca630 con 0x7fcc4c1563b0 2023-10-10T21:18:32.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.032+0000 7fcc32ffd700 1 -- 172.21.15.154:0/1057794417 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40011650 con 0x7fcc4c1563b0 2023-10-10T21:18:32.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.033+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c0cabf0 con 0x7fcc4c1563b0 2023-10-10T21:18:32.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.034+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c169a20 con 0x7fcc4c1563b0 2023-10-10T21:18:32.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.034+0000 7fcc32ffd700 1 -- 172.21.15.154:0/1057794417 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 42) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fcc40011a40 con 0x7fcc4c1563b0 2023-10-10T21:18:32.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.035+0000 7fcc32ffd700 1 -- 172.21.15.154:0/1057794417 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6742+0+0 (secure 0 0 0) 0x7fcc40085be0 con 0x7fcc4c1563b0 2023-10-10T21:18:32.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.039+0000 7fcc32ffd700 1 -- 172.21.15.154:0/1057794417 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc4c169a20 con 0x7fcc4c1563b0 2023-10-10T21:18:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.234+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc4c169a20 con 0x7fcc4c1563b0 2023-10-10T21:18:32.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.818+0000 7fcc32ffd700 1 -- 172.21.15.154:0/1057794417 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 43) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fcc400527c0 con 0x7fcc4c1563b0 2023-10-10T21:18:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.819+0000 7fcc32ffd700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc3806c9e0 0x7fcc3806edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.821+0000 7fcc4ad9d700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc3806c9e0 0x7fcc3806edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:32.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.823+0000 7fcc4ad9d700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc3806c9e0 0x7fcc3806edc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0c3130 tx=0x7fcc3c0091a0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:32.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.830+0000 7fcc32ffd700 1 -- 172.21.15.154:0/1057794417 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcc40027c20 con 0x7fcc4c1563b0 2023-10-10T21:18:32.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.834+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc3806c9e0 msgr2=0x7fcc3806edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:32.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.834+0000 7fcc511ff700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc3806c9e0 0x7fcc3806edc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0c3130 tx=0x7fcc3c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.834+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c1563b0 msgr2=0x7fcc4c0cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:32.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.834+0000 7fcc511ff700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c1563b0 0x7fcc4c0cbbe0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcc400094c0 tx=0x7fcc40017000 comp rx=0 tx=0).stop 2023-10-10T21:18:32.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.834+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 shutdown_connections 2023-10-10T21:18:32.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.835+0000 7fcc511ff700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc4c15a440 0x7fcc4c0b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.835+0000 7fcc511ff700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcc3806c9e0 0x7fcc3806edc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.835+0000 7fcc511ff700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c068890 0x7fcc4c0ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.835+0000 7fcc511ff700 1 --2- 172.21.15.154:0/1057794417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc4c1563b0 0x7fcc4c0cbbe0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:32.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.835+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 >> 172.21.15.154:0/1057794417 conn(0x7fcc4c0c8f90 msgr2=0x7fcc4c155a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:32.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.835+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 shutdown_connections 2023-10-10T21:18:32.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:32.835+0000 7fcc511ff700 1 -- 172.21.15.154:0/1057794417 wait complete. 2023-10-10T21:18:32.839 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T21:18:32.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T21:18:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.044+0000 7f188939d700 1 Processor -- start 2023-10-10T21:18:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.044+0000 7f188939d700 1 -- start start 2023-10-10T21:18:33.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.045+0000 7f188939d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1884153480 0x7f18840ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:33.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.045+0000 7f188939d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1884153850 0x7f18841596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.045+0000 7f188939d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188415a030 con 0x7f1884159bf0 2023-10-10T21:18:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.045+0000 7f188939d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18840aec90 con 0x7f1884153850 2023-10-10T21:18:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.045+0000 7f188939d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188415a480 con 0x7f1884153480 2023-10-10T21:18:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.045+0000 7f18837fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1884153850 0x7f18841596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.045+0000 7f18837fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1884153850 0x7f18841596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37408/0 (socket says 172.21.15.154:37408) 2023-10-10T21:18:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.045+0000 7f18837fe700 1 -- 172.21.15.154:0/3078520307 learned_addr learned my addr 172.21.15.154:0/3078520307 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f1883fff700 1 --2- 172.21.15.154:0/3078520307 >> v2:172.21.15.179:3300/0 conn(0x7f1884153480 0x7f18840ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f18837fe700 1 -- 172.21.15.154:0/3078520307 >> v2:172.21.15.179:3300/0 conn(0x7f1884153480 msgr2=0x7f18840ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:33.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f18837fe700 1 --2- 172.21.15.154:0/3078520307 >> v2:172.21.15.179:3300/0 conn(0x7f1884153480 0x7f18840ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:33.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f18837fe700 1 -- 172.21.15.154:0/3078520307 >> v1:172.21.15.154:6789/0 conn(0x7f1884159bf0 legacy=0x7f18841560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:33.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f1882ffd700 1 -- 172.21.15.154:0/3078520307 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096877417 0 0) 0x7f188415a030 con 0x7f1884159bf0 2023-10-10T21:18:33.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f18837fe700 1 -- 172.21.15.154:0/3078520307 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840afb40 con 0x7f1884153850 2023-10-10T21:18:33.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f18837fe700 1 --2- 172.21.15.154:0/3078520307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884153850 0x7f18841596b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f188406cf00 tx=0x7f1878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c0a7a25f7b01a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:33.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f1882ffd700 1 -- 172.21.15.154:0/3078520307 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187800b860 con 0x7f1884153850 2023-10-10T21:18:33.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f1882ffd700 1 -- 172.21.15.154:0/3078520307 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187800b9c0 con 0x7f1884153850 2023-10-10T21:18:33.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.046+0000 7f1882ffd700 1 -- 172.21.15.154:0/3078520307 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187800bd60 con 0x7f1884153850 2023-10-10T21:18:33.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.047+0000 7f188939d700 1 -- 172.21.15.154:0/3078520307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884153850 msgr2=0x7f18841596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:33.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.047+0000 7f188939d700 1 --2- 172.21.15.154:0/3078520307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884153850 0x7f18841596b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f188406cf00 tx=0x7f1878009250 comp rx=0 tx=0).stop 2023-10-10T21:18:33.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.047+0000 7f188939d700 1 -- 172.21.15.154:0/3078520307 shutdown_connections 2023-10-10T21:18:33.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.047+0000 7f188939d700 1 --2- 172.21.15.154:0/3078520307 >> v2:172.21.15.179:3300/0 conn(0x7f1884153480 0x7f18840ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:33.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.047+0000 7f188939d700 1 --2- 172.21.15.154:0/3078520307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884153850 0x7f18841596b0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:33.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.047+0000 7f188939d700 1 -- 172.21.15.154:0/3078520307 >> 172.21.15.154:0/3078520307 conn(0x7f1884068e20 msgr2=0x7f18840cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:33.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.047+0000 7f188939d700 1 -- 172.21.15.154:0/3078520307 shutdown_connections 2023-10-10T21:18:33.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.047+0000 7f188939d700 1 -- 172.21.15.154:0/3078520307 wait complete. 2023-10-10T21:18:33.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.049+0000 7f188939d700 1 Processor -- start 2023-10-10T21:18:33.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.049+0000 7f188939d700 1 -- start start 2023-10-10T21:18:33.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f188939d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1884153480 0x7f1884144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:33.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f188939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1884153850 0x7f18840c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:33.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f188939d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884159bf0 0x7f18840c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:33.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f188939d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1884168610 con 0x7f1884159bf0 2023-10-10T21:18:33.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f188939d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18840c3050 con 0x7f1884153480 2023-10-10T21:18:33.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f188939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18840c3330 con 0x7f1884153850 2023-10-10T21:18:33.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f1888b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884159bf0 0x7f18840c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:33.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f1888b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884159bf0 0x7f18840c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37412/0 (socket says 172.21.15.154:37412) 2023-10-10T21:18:33.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f1888b9c700 1 -- 172.21.15.154:0/2406486866 learned_addr learned my addr 172.21.15.154:0/2406486866 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:33.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f18837fe700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1884153850 0x7f18840c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:33.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f1883fff700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1884153480 0x7f1884144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f1888b9c700 1 -- 172.21.15.154:0/2406486866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1884153850 msgr2=0x7f18840c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f1888b9c700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1884153850 0x7f18840c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f1888b9c700 1 -- 172.21.15.154:0/2406486866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1884153480 msgr2=0x7f1884144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f1888b9c700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1884153480 0x7f1884144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.050+0000 7f1888b9c700 1 -- 172.21.15.154:0/2406486866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18780094f0 con 0x7f1884159bf0 2023-10-10T21:18:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.051+0000 7f1888b9c700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884159bf0 0x7f18840c6ad0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f187c001560 tx=0x7f187c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.051+0000 7f186bfff700 1 -- 172.21.15.154:0/2406486866 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c00a780 con 0x7f1884159bf0 2023-10-10T21:18:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.051+0000 7f186bfff700 1 -- 172.21.15.154:0/2406486866 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c00a8e0 con 0x7f1884159bf0 2023-10-10T21:18:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.051+0000 7f186bfff700 1 -- 172.21.15.154:0/2406486866 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c00aca0 con 0x7f1884159bf0 2023-10-10T21:18:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.051+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18840c3610 con 0x7f1884159bf0 2023-10-10T21:18:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.051+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1884145120 con 0x7f1884159bf0 2023-10-10T21:18:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.052+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18840cb9d0 con 0x7f1884159bf0 2023-10-10T21:18:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.053+0000 7f186bfff700 1 -- 172.21.15.154:0/2406486866 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 43) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f187c012630 con 0x7f1884159bf0 2023-10-10T21:18:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.054+0000 7f186bfff700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1870066d80 0x7f1870069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.054+0000 7f186bfff700 1 -- 172.21.15.154:0/2406486866 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f187c084780 con 0x7f1884159bf0 2023-10-10T21:18:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.054+0000 7f1883fff700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1870066d80 0x7f1870069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:33.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.055+0000 7f1883fff700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1870066d80 0x7f1870069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1884158470 tx=0x7f1874008040 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:33.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.058+0000 7f186bfff700 1 -- 172.21.15.154:0/2406486866 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f187c051a50 con 0x7f1884159bf0 2023-10-10T21:18:33.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.249+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f188404c3c0 con 0x7f1884159bf0 2023-10-10T21:18:33.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.834+0000 7f186bfff700 1 -- 172.21.15.154:0/2406486866 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f187c051e20 con 0x7f1884159bf0 2023-10-10T21:18:33.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.844+0000 7f186bfff700 1 -- 172.21.15.154:0/2406486866 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) v1 ==== 169+0+0 (secure 0 0 0) 0x7f187c0704f0 con 0x7f1884159bf0 2023-10-10T21:18:33.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1870066d80 msgr2=0x7f1870069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:33.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1870066d80 0x7f1870069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1884158470 tx=0x7f1874008040 comp rx=0 tx=0).stop 2023-10-10T21:18:33.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884159bf0 msgr2=0x7f18840c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:33.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884159bf0 0x7f18840c6ad0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f187c001560 tx=0x7f187c001770 comp rx=0 tx=0).stop 2023-10-10T21:18:33.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 shutdown_connections 2023-10-10T21:18:33.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1884159bf0 0x7f18840c6ad0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:33.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1870066d80 0x7f1870069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:33.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1884153480 0x7f1884144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:33.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 --2- 172.21.15.154:0/2406486866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1884153850 0x7f18840c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:33.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 >> 172.21.15.154:0/2406486866 conn(0x7f1884068e20 msgr2=0x7f18840ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:33.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 shutdown_connections 2023-10-10T21:18:33.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:33.848+0000 7f188939d700 1 -- 172.21.15.154:0/2406486866 wait complete. 2023-10-10T21:18:33.854 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T21:18:33.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T21:18:34.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.053+0000 7f3f04bff700 1 Processor -- start 2023-10-10T21:18:34.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.053+0000 7f3f04bff700 1 -- start start 2023-10-10T21:18:34.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.054+0000 7f3f04bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00159890 0x7f3f0015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.054+0000 7f3f04bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f00069560 0x7f3f000699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.054+0000 7f3f04bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0015a160 con 0x7f3f00159c60 2023-10-10T21:18:34.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.054+0000 7f3f04bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f00069f20 con 0x7f3f00069560 2023-10-10T21:18:34.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.054+0000 7f3f04bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000d13a0 con 0x7f3f00159890 2023-10-10T21:18:34.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efdd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3f00159c60 0x7f3f0015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34448/0 (socket says 172.21.15.154:34448) 2023-10-10T21:18:34.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efdd9b700 1 -- 172.21.15.154:0/3343891850 learned_addr learned my addr 172.21.15.154:0/3343891850 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:34.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efed9d700 1 --2- 172.21.15.154:0/3343891850 >> v2:172.21.15.179:3300/0 conn(0x7f3f00069560 0x7f3f000699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efe59c700 1 --2- 172.21.15.154:0/3343891850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00159890 0x7f3f0015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efd59a700 1 -- 172.21.15.154:0/3343891850 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755883495 0 0) 0x7f3f0015a160 con 0x7f3f00159c60 2023-10-10T21:18:34.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efd59a700 1 -- 172.21.15.154:0/3343891850 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee8003570 con 0x7f3f00159c60 2023-10-10T21:18:34.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efd59a700 1 -- 172.21.15.154:0/3343891850 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2100430410 0 0) 0x7f3ee8003570 con 0x7f3f00159c60 2023-10-10T21:18:34.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efed9d700 1 -- 172.21.15.154:0/3343891850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00159890 msgr2=0x7f3f0015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:34.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efed9d700 1 --2- 172.21.15.154:0/3343891850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00159890 0x7f3f0015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efed9d700 1 -- 172.21.15.154:0/3343891850 >> v1:172.21.15.154:6789/0 conn(0x7f3f00159c60 legacy=0x7f3f0015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efed9d700 1 -- 172.21.15.154:0/3343891850 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0015e140 con 0x7f3f00069560 2023-10-10T21:18:34.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.055+0000 7f3efe59c700 1 --2- 172.21.15.154:0/3343891850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00159890 0x7f3f0015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:34.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.056+0000 7f3efed9d700 1 --2- 172.21.15.154:0/3343891850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f00069560 0x7f3f000699e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009e60 tx=0x7f3ef8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81bead6a93ddf0ea server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:34.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.056+0000 7f3efd59a700 1 -- 172.21.15.154:0/3343891850 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef800e070 con 0x7f3f00069560 2023-10-10T21:18:34.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.056+0000 7f3efd59a700 1 -- 172.21.15.154:0/3343891850 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef800b7a0 con 0x7f3f00069560 2023-10-10T21:18:34.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.056+0000 7f3efd59a700 1 -- 172.21.15.154:0/3343891850 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4001470 con 0x7f3f00069560 2023-10-10T21:18:34.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.056+0000 7f3f04bff700 1 -- 172.21.15.154:0/3343891850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f00069560 msgr2=0x7f3f000699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.056+0000 7f3f04bff700 1 --2- 172.21.15.154:0/3343891850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f00069560 0x7f3f000699e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009e60 tx=0x7f3ef8009780 comp rx=0 tx=0).stop 2023-10-10T21:18:34.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.057+0000 7f3f04bff700 1 -- 172.21.15.154:0/3343891850 shutdown_connections 2023-10-10T21:18:34.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.057+0000 7f3f04bff700 1 --2- 172.21.15.154:0/3343891850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f00069560 0x7f3f000699e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.057+0000 7f3f04bff700 1 --2- 172.21.15.154:0/3343891850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00159890 0x7f3f0015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.057+0000 7f3f04bff700 1 -- 172.21.15.154:0/3343891850 >> 172.21.15.154:0/3343891850 conn(0x7f3f00068e20 msgr2=0x7f3f000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:34.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.057+0000 7f3f04bff700 1 -- 172.21.15.154:0/3343891850 shutdown_connections 2023-10-10T21:18:34.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.057+0000 7f3f04bff700 1 -- 172.21.15.154:0/3343891850 wait complete. 2023-10-10T21:18:34.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.058+0000 7f3f04bff700 1 Processor -- start 2023-10-10T21:18:34.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.058+0000 7f3f04bff700 1 -- start start 2023-10-10T21:18:34.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3f04bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00069560 0x7f3f001492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3f04bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f00159890 0x7f3f000b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3f04bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f00159c60 0x7f3f000ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3f04bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000b4660 con 0x7f3f00159890 2023-10-10T21:18:34.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3f04bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000b3a50 con 0x7f3f00159c60 2023-10-10T21:18:34.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3f04bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000b3d30 con 0x7f3f00069560 2023-10-10T21:18:34.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3efdd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f00159890 0x7f3f000b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3efdd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f00159890 0x7f3f000b5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37424/0 (socket says 172.21.15.154:37424) 2023-10-10T21:18:34.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3efdd9b700 1 -- 172.21.15.154:0/2943160457 learned_addr learned my addr 172.21.15.154:0/2943160457 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:34.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3efe59c700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00069560 0x7f3f001492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.059+0000 7f3efed9d700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f00159c60 0x7f3f000ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3efdd9b700 1 -- 172.21.15.154:0/2943160457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00069560 msgr2=0x7f3f001492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3efdd9b700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00069560 0x7f3f001492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3efdd9b700 1 -- 172.21.15.154:0/2943160457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f00159c60 msgr2=0x7f3f000ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3efdd9b700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f00159c60 0x7f3f000ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3efdd9b700 1 -- 172.21.15.154:0/2943160457 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0009420 con 0x7f3f00159890 2023-10-10T21:18:34.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3efdd9b700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f00159890 0x7f3f000b5570 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c960 tx=0x7f3ef40019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:34.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3eee7fc700 1 -- 172.21.15.154:0/2943160457 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4005b30 con 0x7f3f00159890 2023-10-10T21:18:34.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3eee7fc700 1 -- 172.21.15.154:0/2943160457 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4005c90 con 0x7f3f00159890 2023-10-10T21:18:34.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3eee7fc700 1 -- 172.21.15.154:0/2943160457 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4007320 con 0x7f3f00159890 2023-10-10T21:18:34.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef8009a20 con 0x7f3f00159890 2023-10-10T21:18:34.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.060+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f000b42f0 con 0x7f3f00159890 2023-10-10T21:18:34.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.061+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0004c3c0 con 0x7f3f00159890 2023-10-10T21:18:34.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.062+0000 7f3eee7fc700 1 -- 172.21.15.154:0/2943160457 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ef401b400 con 0x7f3f00159890 2023-10-10T21:18:34.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.063+0000 7f3eee7fc700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3ee0066f30 0x7f3ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.063+0000 7f3eee7fc700 1 -- 172.21.15.154:0/2943160457 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f3ef40842f0 con 0x7f3f00159890 2023-10-10T21:18:34.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.063+0000 7f3efe59c700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3ee0066f30 0x7f3ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.064+0000 7f3efe59c700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3ee0066f30 0x7f3ee00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009f40 tx=0x7f3ef00091a0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:34.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.067+0000 7f3eee7fc700 1 -- 172.21.15.154:0/2943160457 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ef40514a0 con 0x7f3f00159890 2023-10-10T21:18:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.257+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3f000b47a0 con 0x7f3f00159890 2023-10-10T21:18:34.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.262+0000 7f3eee7fc700 1 -- 172.21.15.154:0/2943160457 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3ef4054ac0 con 0x7f3f00159890 2023-10-10T21:18:34.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.264+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3ee0066f30 msgr2=0x7f3ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.264+0000 7f3f04bff700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3ee0066f30 0x7f3ee00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009f40 tx=0x7f3ef00091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.264+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f00159890 msgr2=0x7f3f000b5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.264+0000 7f3f04bff700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f00159890 0x7f3f000b5570 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c960 tx=0x7f3ef40019d0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.264+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 shutdown_connections 2023-10-10T21:18:34.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.264+0000 7f3f04bff700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f3ee0066f30 0x7f3ee00693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.265+0000 7f3f04bff700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f00159c60 0x7f3f000ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.265+0000 7f3f04bff700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f00069560 0x7f3f001492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.265+0000 7f3f04bff700 1 --2- 172.21.15.154:0/2943160457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f00159890 0x7f3f000b5570 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.265+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 >> 172.21.15.154:0/2943160457 conn(0x7f3f00068e20 msgr2=0x7f3f00157720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:34.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.265+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 shutdown_connections 2023-10-10T21:18:34.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.265+0000 7f3f04bff700 1 -- 172.21.15.154:0/2943160457 wait complete. 2023-10-10T21:18:34.283 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T21:18:34.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.466+0000 7f00903ff700 1 Processor -- start 2023-10-10T21:18:34.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.467+0000 7f00903ff700 1 -- start start 2023-10-10T21:18:34.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.468+0000 7f00903ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00880c83f0 0x7f00880c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.468+0000 7f00903ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 0x7f00880ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.468+0000 7f00903ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008815b0d0 con 0x7f00880ccee0 2023-10-10T21:18:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.468+0000 7f00903ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00880c7a60 con 0x7f00880c83f0 2023-10-10T21:18:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.468+0000 7f00903ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008815a4c0 con 0x7f00881568e0 2023-10-10T21:18:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.468+0000 7f008e19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00880c83f0 0x7f00880c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.468+0000 7f008e19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00880c83f0 0x7f00880c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37440/0 (socket says 172.21.15.154:37440) 2023-10-10T21:18:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.468+0000 7f008e19b700 1 -- 172.21.15.154:0/1893126219 learned_addr learned my addr 172.21.15.154:0/1893126219 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.468+0000 7f008e99c700 1 --2- 172.21.15.154:0/1893126219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 0x7f00880ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.469+0000 7f008e19b700 1 -- 172.21.15.154:0/1893126219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 msgr2=0x7f00880ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.469+0000 7f008e19b700 1 --2- 172.21.15.154:0/1893126219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 0x7f00880ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.469+0000 7f008e19b700 1 -- 172.21.15.154:0/1893126219 >> v1:172.21.15.179:6789/0 conn(0x7f00880ccee0 legacy=0x7f00881561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.469+0000 7f008e19b700 1 -- 172.21.15.154:0/1893126219 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008815a7a0 con 0x7f00880c83f0 2023-10-10T21:18:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.469+0000 7f008e99c700 1 --2- 172.21.15.154:0/1893126219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 0x7f00880ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.469+0000 7f008e19b700 1 --2- 172.21.15.154:0/1893126219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 0x7f00880c7520 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f00840099b0 tx=0x7f0084009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d49cb973aba1d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.469+0000 7f008d199700 1 -- 172.21.15.154:0/1893126219 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400b860 con 0x7f00880c83f0 2023-10-10T21:18:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.469+0000 7f008d199700 1 -- 172.21.15.154:0/1893126219 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008400b9c0 con 0x7f00880c83f0 2023-10-10T21:18:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.469+0000 7f008d199700 1 -- 172.21.15.154:0/1893126219 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400bd60 con 0x7f00880c83f0 2023-10-10T21:18:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.470+0000 7f00903ff700 1 -- 172.21.15.154:0/1893126219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 msgr2=0x7f00880c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.470+0000 7f00903ff700 1 --2- 172.21.15.154:0/1893126219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 0x7f00880c7520 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f00840099b0 tx=0x7f0084009250 comp rx=0 tx=0).stop 2023-10-10T21:18:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.470+0000 7f00903ff700 1 -- 172.21.15.154:0/1893126219 shutdown_connections 2023-10-10T21:18:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.470+0000 7f00903ff700 1 --2- 172.21.15.154:0/1893126219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 0x7f00880ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.470+0000 7f00903ff700 1 --2- 172.21.15.154:0/1893126219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 0x7f00880c7520 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.470+0000 7f00903ff700 1 -- 172.21.15.154:0/1893126219 >> 172.21.15.154:0/1893126219 conn(0x7f0088068e10 msgr2=0x7f00880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.470+0000 7f00903ff700 1 -- 172.21.15.154:0/1893126219 shutdown_connections 2023-10-10T21:18:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.470+0000 7f00903ff700 1 -- 172.21.15.154:0/1893126219 wait complete. 2023-10-10T21:18:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.471+0000 7f00903ff700 1 Processor -- start 2023-10-10T21:18:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.471+0000 7f00903ff700 1 -- start start 2023-10-10T21:18:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.472+0000 7f00903ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 0x7f00880af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.472+0000 7f00903ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00880ccee0 0x7f00880b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.472+0000 7f00903ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 0x7f008814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.472+0000 7f00903ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00880b21e0 con 0x7f00880c83f0 2023-10-10T21:18:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.472+0000 7f00903ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0088157550 con 0x7f00880ccee0 2023-10-10T21:18:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.472+0000 7f00903ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00880b1c80 con 0x7f00881568e0 2023-10-10T21:18:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 0x7f00880af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 0x7f00880af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37448/0 (socket says 172.21.15.154:37448) 2023-10-10T21:18:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e19b700 1 -- 172.21.15.154:0/2902756860 learned_addr learned my addr 172.21.15.154:0/2902756860 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e99c700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 0x7f008814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008d99a700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00880ccee0 0x7f00880b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e19b700 1 -- 172.21.15.154:0/2902756860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 msgr2=0x7f008814ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e19b700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 0x7f008814ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e19b700 1 -- 172.21.15.154:0/2902756860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00880ccee0 msgr2=0x7f00880b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e19b700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00880ccee0 0x7f00880b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e19b700 1 -- 172.21.15.154:0/2902756860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840094f0 con 0x7f00880c83f0 2023-10-10T21:18:34.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f008e19b700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 0x7f00880af340 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0084009290 tx=0x7f0084017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:34.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.473+0000 7f007e7fc700 1 -- 172.21.15.154:0/2902756860 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084011e40 con 0x7f00880c83f0 2023-10-10T21:18:34.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.474+0000 7f007e7fc700 1 -- 172.21.15.154:0/2902756860 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0084024440 con 0x7f00880c83f0 2023-10-10T21:18:34.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.474+0000 7f007e7fc700 1 -- 172.21.15.154:0/2902756860 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840247e0 con 0x7f00880c83f0 2023-10-10T21:18:34.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.474+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00880b1f00 con 0x7f00880c83f0 2023-10-10T21:18:34.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.474+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00881571e0 con 0x7f00880c83f0 2023-10-10T21:18:34.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.475+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0088156d60 con 0x7f00880c83f0 2023-10-10T21:18:34.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.476+0000 7f007e7fc700 1 -- 172.21.15.154:0/2902756860 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f008401a420 con 0x7f00880c83f0 2023-10-10T21:18:34.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.477+0000 7f007e7fc700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.477+0000 7f007e7fc700 1 -- 172.21.15.154:0/2902756860 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f0084086580 con 0x7f00880c83f0 2023-10-10T21:18:34.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.477+0000 7f008d99a700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.478+0000 7f008d99a700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f006c066f30 0x7f006c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f00880ae9d0 tx=0x7f0078007ec0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:34.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.481+0000 7f007e7fc700 1 -- 172.21.15.154:0/2902756860 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0088156d60 con 0x7f00880c83f0 2023-10-10T21:18:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.676+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f0088156d60 con 0x7f00880c83f0 2023-10-10T21:18:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.680+0000 7f007e7fc700 1 -- 172.21.15.154:0/2902756860 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v32) v1 ==== 115+0+0 (secure 0 0 0) 0x7f0088156d60 con 0x7f00880c83f0 2023-10-10T21:18:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.683+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f006c066f30 msgr2=0x7f006c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.683+0000 7f00903ff700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f006c066f30 0x7f006c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f00880ae9d0 tx=0x7f0078007ec0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.683+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 msgr2=0x7f00880af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.683+0000 7f00903ff700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 0x7f00880af340 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0084009290 tx=0x7f0084017000 comp rx=0 tx=0).stop 2023-10-10T21:18:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.684+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 shutdown_connections 2023-10-10T21:18:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.684+0000 7f00903ff700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00881568e0 0x7f008814ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.684+0000 7f00903ff700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00880c83f0 0x7f00880af340 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.684+0000 7f00903ff700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.684+0000 7f00903ff700 1 --2- 172.21.15.154:0/2902756860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00880ccee0 0x7f00880b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.684+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 >> 172.21.15.154:0/2902756860 conn(0x7f0088068e10 msgr2=0x7f0088148d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.684+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 shutdown_connections 2023-10-10T21:18:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.684+0000 7f00903ff700 1 -- 172.21.15.154:0/2902756860 wait complete. 2023-10-10T21:18:34.703 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T21:18:34.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.888+0000 7f36ff1ff700 1 Processor -- start 2023-10-10T21:18:34.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.888+0000 7f36ff1ff700 1 -- start start 2023-10-10T21:18:34.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.889+0000 7f36ff1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36f8159890 0x7f36f815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.889+0000 7f36ff1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f36f8159c60 0x7f36f815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.889+0000 7f36ff1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f815a160 con 0x7f36f815db10 2023-10-10T21:18:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.889+0000 7f36ff1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f815df50 con 0x7f36f8159890 2023-10-10T21:18:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.889+0000 7f36ff1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80d13a0 con 0x7f36f8159c60 2023-10-10T21:18:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36fcf9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36f8159890 0x7f36f815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36fcf9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36f8159890 0x7f36f815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37454/0 (socket says 172.21.15.154:37454) 2023-10-10T21:18:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36fcf9b700 1 -- 172.21.15.154:0/2071502014 learned_addr learned my addr 172.21.15.154:0/2071502014 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36f7fff700 1 --2- 172.21.15.154:0/2071502014 >> v2:172.21.15.179:3300/0 conn(0x7f36f8159c60 0x7f36f815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36fcf9b700 1 -- 172.21.15.154:0/2071502014 >> v2:172.21.15.179:3300/0 conn(0x7f36f8159c60 msgr2=0x7f36f815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36fcf9b700 1 --2- 172.21.15.154:0/2071502014 >> v2:172.21.15.179:3300/0 conn(0x7f36f8159c60 0x7f36f815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36fcf9b700 1 -- 172.21.15.154:0/2071502014 >> v1:172.21.15.179:6789/0 conn(0x7f36f815db10 legacy=0x7f36f8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36fcf9b700 1 -- 172.21.15.154:0/2071502014 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f815e140 con 0x7f36f8159890 2023-10-10T21:18:34.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36fcf9b700 1 --2- 172.21.15.154:0/2071502014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f8159890 0x7f36f815abd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f36f80b67f0 tx=0x7f36ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a281eada74be24e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:34.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.890+0000 7f36f77fe700 1 -- 172.21.15.154:0/2071502014 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec009e70 con 0x7f36f8159890 2023-10-10T21:18:34.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36f77fe700 1 -- 172.21.15.154:0/2071502014 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec00b860 con 0x7f36f8159890 2023-10-10T21:18:34.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36f77fe700 1 -- 172.21.15.154:0/2071502014 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00bc00 con 0x7f36f8159890 2023-10-10T21:18:34.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36ff1ff700 1 -- 172.21.15.154:0/2071502014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f8159890 msgr2=0x7f36f815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36ff1ff700 1 --2- 172.21.15.154:0/2071502014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f8159890 0x7f36f815abd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f36f80b67f0 tx=0x7f36ec009250 comp rx=0 tx=0).stop 2023-10-10T21:18:34.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36ff1ff700 1 -- 172.21.15.154:0/2071502014 shutdown_connections 2023-10-10T21:18:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36ff1ff700 1 --2- 172.21.15.154:0/2071502014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f8159890 0x7f36f815abd0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36ff1ff700 1 --2- 172.21.15.154:0/2071502014 >> v2:172.21.15.179:3300/0 conn(0x7f36f8159c60 0x7f36f815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36ff1ff700 1 -- 172.21.15.154:0/2071502014 >> 172.21.15.154:0/2071502014 conn(0x7f36f8068e20 msgr2=0x7f36f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36ff1ff700 1 -- 172.21.15.154:0/2071502014 shutdown_connections 2023-10-10T21:18:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.891+0000 7f36ff1ff700 1 -- 172.21.15.154:0/2071502014 wait complete. 2023-10-10T21:18:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.893+0000 7f36ff1ff700 1 Processor -- start 2023-10-10T21:18:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.893+0000 7f36ff1ff700 1 -- start start 2023-10-10T21:18:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36ff1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36f8159890 0x7f36f80b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36ff1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36f8159c60 0x7f36f816b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36ff1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f815db10 0x7f36f80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36ff1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80ceb60 con 0x7f36f815db10 2023-10-10T21:18:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36ff1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80ce230 con 0x7f36f8159c60 2023-10-10T21:18:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36ff1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80ce510 con 0x7f36f8159890 2023-10-10T21:18:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fd79c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f815db10 0x7f36f80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fd79c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f815db10 0x7f36f80b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37468/0 (socket says 172.21.15.154:37468) 2023-10-10T21:18:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fd79c700 1 -- 172.21.15.154:0/1622669265 learned_addr learned my addr 172.21.15.154:0/1622669265 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36f7fff700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36f8159c60 0x7f36f816b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fcf9b700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36f8159890 0x7f36f80b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fd79c700 1 -- 172.21.15.154:0/1622669265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36f8159890 msgr2=0x7f36f80b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fd79c700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36f8159890 0x7f36f80b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fd79c700 1 -- 172.21.15.154:0/1622669265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36f8159c60 msgr2=0x7f36f816b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fd79c700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36f8159c60 0x7f36f816b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fd79c700 1 -- 172.21.15.154:0/1622669265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec0094f0 con 0x7f36f815db10 2023-10-10T21:18:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.894+0000 7f36fd79c700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f815db10 0x7f36f80b3590 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c840 tx=0x7f36f0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.895+0000 7f36f4ff9700 1 -- 172.21.15.154:0/1622669265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0012630 con 0x7f36f815db10 2023-10-10T21:18:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.895+0000 7f36f4ff9700 1 -- 172.21.15.154:0/1622669265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f00127b0 con 0x7f36f815db10 2023-10-10T21:18:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.895+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f80ce7f0 con 0x7f36f815db10 2023-10-10T21:18:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.895+0000 7f36f4ff9700 1 -- 172.21.15.154:0/1622669265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0012b70 con 0x7f36f815db10 2023-10-10T21:18:34.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.895+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f80b3ad0 con 0x7f36f815db10 2023-10-10T21:18:34.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.896+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f80ced10 con 0x7f36f815db10 2023-10-10T21:18:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.897+0000 7f36f4ff9700 1 -- 172.21.15.154:0/1622669265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36f0003030 con 0x7f36f815db10 2023-10-10T21:18:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.898+0000 7f36f4ff9700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f36dc066f30 0x7f36dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.898+0000 7f36f4ff9700 1 -- 172.21.15.154:0/1622669265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f36f0084550 con 0x7f36f815db10 2023-10-10T21:18:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.898+0000 7f36fcf9b700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f36dc066f30 0x7f36dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.898+0000 7f36fcf9b700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f36dc066f30 0x7f36dc0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f36f80b67f0 tx=0x7f36ec017000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:34.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:34.902+0000 7f36f4ff9700 1 -- 172.21.15.154:0/1622669265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36f80ced10 con 0x7f36f815db10 2023-10-10T21:18:35.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.095+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f36f804c3c0 con 0x7f36f815db10 2023-10-10T21:18:35.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.100+0000 7f36f4ff9700 1 -- 172.21.15.154:0/1622669265 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v33) v1 ==== 120+0+0 (secure 0 0 0) 0x7f36f0051700 con 0x7f36f815db10 2023-10-10T21:18:35.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f36dc066f30 msgr2=0x7f36dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:35.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f36dc066f30 0x7f36dc0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f36f80b67f0 tx=0x7f36ec017000 comp rx=0 tx=0).stop 2023-10-10T21:18:35.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f815db10 msgr2=0x7f36f80b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:35.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f815db10 0x7f36f80b3590 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c840 tx=0x7f36f0001670 comp rx=0 tx=0).stop 2023-10-10T21:18:35.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 shutdown_connections 2023-10-10T21:18:35.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f815db10 0x7f36f80b3590 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36f8159890 0x7f36f80b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f36dc066f30 0x7f36dc0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 --2- 172.21.15.154:0/1622669265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36f8159c60 0x7f36f816b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 >> 172.21.15.154:0/1622669265 conn(0x7f36f8068e20 msgr2=0x7f36f80b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:35.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 shutdown_connections 2023-10-10T21:18:35.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.103+0000 7f36ff1ff700 1 -- 172.21.15.154:0/1622669265 wait complete. 2023-10-10T21:18:35.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-10T21:18:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.305+0000 7fe3b59ff700 1 Processor -- start 2023-10-10T21:18:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.305+0000 7fe3b59ff700 1 -- start start 2023-10-10T21:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3b59ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3b00cbf30 0x7fe3b00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3b59ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00b1420 0x7fe3b00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3b59ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b00cc300 con 0x7fe3b00ccf90 2023-10-10T21:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3b59ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b0156bf0 con 0x7fe3b00cbf30 2023-10-10T21:18:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3b59ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00ae950 con 0x7fe3b00b1420 2023-10-10T21:18:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3aeffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3b00cbf30 0x7fe3b00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3ae7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe3b00ccf90 0x7fe3b00b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34452/0 (socket says 172.21.15.154:34452) 2023-10-10T21:18:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3ae7fc700 1 -- 172.21.15.154:0/304184158 learned_addr learned my addr 172.21.15.154:0/304184158 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3af7fe700 1 --2- 172.21.15.154:0/304184158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00b1420 0x7fe3b00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3aeffd700 1 -- 172.21.15.154:0/304184158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00b1420 msgr2=0x7fe3b00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3aeffd700 1 --2- 172.21.15.154:0/304184158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00b1420 0x7fe3b00c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3aeffd700 1 -- 172.21.15.154:0/304184158 >> v1:172.21.15.154:6789/0 conn(0x7fe3b00ccf90 legacy=0x7fe3b00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3aeffd700 1 -- 172.21.15.154:0/304184158 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b00ad370 con 0x7fe3b00cbf30 2023-10-10T21:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.307+0000 7fe3af7fe700 1 --2- 172.21.15.154:0/304184158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00b1420 0x7fe3b00c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.308+0000 7fe3aeffd700 1 --2- 172.21.15.154:0/304184158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 0x7fe3b00ae410 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009910 tx=0x7fe3a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6266b57d00cde10 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:35.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.308+0000 7fe3adffb700 1 -- 172.21.15.154:0/304184158 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a000b820 con 0x7fe3b00cbf30 2023-10-10T21:18:35.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.308+0000 7fe3adffb700 1 -- 172.21.15.154:0/304184158 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a000b980 con 0x7fe3b00cbf30 2023-10-10T21:18:35.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.308+0000 7fe3adffb700 1 -- 172.21.15.154:0/304184158 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a000bd20 con 0x7fe3b00cbf30 2023-10-10T21:18:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.308+0000 7fe3b59ff700 1 -- 172.21.15.154:0/304184158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 msgr2=0x7fe3b00ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.308+0000 7fe3b59ff700 1 --2- 172.21.15.154:0/304184158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 0x7fe3b00ae410 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009910 tx=0x7fe3a00091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.309+0000 7fe3b59ff700 1 -- 172.21.15.154:0/304184158 shutdown_connections 2023-10-10T21:18:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.309+0000 7fe3b59ff700 1 --2- 172.21.15.154:0/304184158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00b1420 0x7fe3b00c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.309+0000 7fe3b59ff700 1 --2- 172.21.15.154:0/304184158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 0x7fe3b00ae410 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.309+0000 7fe3b59ff700 1 -- 172.21.15.154:0/304184158 >> 172.21.15.154:0/304184158 conn(0x7fe3b006a320 msgr2=0x7fe3b00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.309+0000 7fe3b59ff700 1 -- 172.21.15.154:0/304184158 shutdown_connections 2023-10-10T21:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.309+0000 7fe3b59ff700 1 -- 172.21.15.154:0/304184158 wait complete. 2023-10-10T21:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.310+0000 7fe3b59ff700 1 Processor -- start 2023-10-10T21:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.310+0000 7fe3b59ff700 1 -- start start 2023-10-10T21:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.311+0000 7fe3b59ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3b00b1420 0x7fe3b01555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.311+0000 7fe3b59ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 0x7fe3b016a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.311+0000 7fe3b59ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00ccf90 0x7fe3b0154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.311+0000 7fe3b59ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b015cde0 con 0x7fe3b00cbf30 2023-10-10T21:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.311+0000 7fe3b59ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b015d0c0 con 0x7fe3b00b1420 2023-10-10T21:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.311+0000 7fe3b59ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b016aed0 con 0x7fe3b00ccf90 2023-10-10T21:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.311+0000 7fe3ae7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 0x7fe3b016a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3ae7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 0x7fe3b016a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37482/0 (socket says 172.21.15.154:37482) 2023-10-10T21:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3ae7fc700 1 -- 172.21.15.154:0/4201787067 learned_addr learned my addr 172.21.15.154:0/4201787067 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3aeffd700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3b00b1420 0x7fe3b01555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3af7fe700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00ccf90 0x7fe3b0154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3ae7fc700 1 -- 172.21.15.154:0/4201787067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00ccf90 msgr2=0x7fe3b0154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3ae7fc700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00ccf90 0x7fe3b0154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3ae7fc700 1 -- 172.21.15.154:0/4201787067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3b00b1420 msgr2=0x7fe3b01555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3ae7fc700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3b00b1420 0x7fe3b01555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3ae7fc700 1 -- 172.21.15.154:0/4201787067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0009420 con 0x7fe3b00cbf30 2023-10-10T21:18:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3af7fe700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00ccf90 0x7fe3b0154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3ae7fc700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 0x7fe3b016a990 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400c590 tx=0x7fe3a4001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe396ffd700 1 -- 172.21.15.154:0/4201787067 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4005b30 con 0x7fe3b00cbf30 2023-10-10T21:18:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe396ffd700 1 -- 172.21.15.154:0/4201787067 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a4005cb0 con 0x7fe3b00cbf30 2023-10-10T21:18:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b0155400 con 0x7fe3b00cbf30 2023-10-10T21:18:35.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.312+0000 7fe396ffd700 1 -- 172.21.15.154:0/4201787067 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4007320 con 0x7fe3b00cbf30 2023-10-10T21:18:35.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.313+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b00abcd0 con 0x7fe3b00cbf30 2023-10-10T21:18:35.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.313+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b004c3c0 con 0x7fe3b00cbf30 2023-10-10T21:18:35.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.314+0000 7fe396ffd700 1 -- 172.21.15.154:0/4201787067 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3a401b3b0 con 0x7fe3b00cbf30 2023-10-10T21:18:35.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.315+0000 7fe396ffd700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe39c066f30 0x7fe39c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:35.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.315+0000 7fe396ffd700 1 -- 172.21.15.154:0/4201787067 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fe3a4083b90 con 0x7fe3b00cbf30 2023-10-10T21:18:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.316+0000 7fe3aeffd700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe39c066f30 0x7fe39c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.316+0000 7fe3aeffd700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe39c066f30 0x7fe39c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00091e0 tx=0x7fe3a0017000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.320+0000 7fe396ffd700 1 -- 172.21.15.154:0/4201787067 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3a4050ca0 con 0x7fe3b00cbf30 2023-10-10T21:18:35.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:35.589+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fe3b00678d0 con 0x7fe3b00cbf30 2023-10-10T21:18:36.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.087+0000 7fe396ffd700 1 -- 172.21.15.154:0/4201787067 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v609) v1 ==== 166+0+0 (secure 0 0 0) 0x7fe3a4017020 con 0x7fe3b00cbf30 2023-10-10T21:18:36.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe39c066f30 msgr2=0x7fe39c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:36.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe39c066f30 0x7fe39c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00091e0 tx=0x7fe3a0017000 comp rx=0 tx=0).stop 2023-10-10T21:18:36.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 msgr2=0x7fe3b016a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 0x7fe3b016a990 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400c590 tx=0x7fe3a4001020 comp rx=0 tx=0).stop 2023-10-10T21:18:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 shutdown_connections 2023-10-10T21:18:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3b00ccf90 0x7fe3b0154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe39c066f30 0x7fe39c0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3b00b1420 0x7fe3b01555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 --2- 172.21.15.154:0/4201787067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b00cbf30 0x7fe3b016a990 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 >> 172.21.15.154:0/4201787067 conn(0x7fe3b006a320 msgr2=0x7fe3b006e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 shutdown_connections 2023-10-10T21:18:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.090+0000 7fe3b59ff700 1 -- 172.21.15.154:0/4201787067 wait complete. 2023-10-10T21:18:36.110 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-10-10T21:18:36.111 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2023-10-10T21:18:36.111 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T21:18:36.112 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-10T21:18:36.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.291+0000 7fe61179d700 1 Processor -- start 2023-10-10T21:18:36.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.292+0000 7fe61179d700 1 -- start start 2023-10-10T21:18:36.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.293+0000 7fe61179d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe60c150180 0x7fe60c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:36.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.293+0000 7fe61179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 0x7fe60c0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:36.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.293+0000 7fe61179d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c06e2a0 con 0x7fe60c0c7240 2023-10-10T21:18:36.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.293+0000 7fe61179d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60c0c76c0 con 0x7fe60c150180 2023-10-10T21:18:36.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.293+0000 7fe61179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c06b2e0 con 0x7fe60c150550 2023-10-10T21:18:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.293+0000 7fe60bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe60c150180 0x7fe60c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.293+0000 7fe60bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe60c150180 0x7fe60c157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52422/0 (socket says 172.21.15.154:52422) 2023-10-10T21:18:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.293+0000 7fe60bfff700 1 -- 172.21.15.154:0/2755752528 learned_addr learned my addr 172.21.15.154:0/2755752528 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.293+0000 7fe60b7fe700 1 --2- 172.21.15.154:0/2755752528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 0x7fe60c0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.294+0000 7fe60bfff700 1 -- 172.21.15.154:0/2755752528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 msgr2=0x7fe60c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.294+0000 7fe60bfff700 1 --2- 172.21.15.154:0/2755752528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 0x7fe60c0c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.294+0000 7fe60bfff700 1 -- 172.21.15.154:0/2755752528 >> v1:172.21.15.179:6789/0 conn(0x7fe60c0c7240 legacy=0x7fe60c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.294+0000 7fe60bfff700 1 -- 172.21.15.154:0/2755752528 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0c78e0 con 0x7fe60c150180 2023-10-10T21:18:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.294+0000 7fe60bfff700 1 --2- 172.21.15.154:0/2755752528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 0x7fe60c157770 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0099e0 tx=0x7fe5fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a634f8e3281b7b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:36.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.294+0000 7fe60affd700 1 -- 172.21.15.154:0/2755752528 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00b820 con 0x7fe60c150180 2023-10-10T21:18:36.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.294+0000 7fe60affd700 1 -- 172.21.15.154:0/2755752528 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc00b980 con 0x7fe60c150180 2023-10-10T21:18:36.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.294+0000 7fe60affd700 1 -- 172.21.15.154:0/2755752528 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00bd20 con 0x7fe60c150180 2023-10-10T21:18:36.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.295+0000 7fe61179d700 1 -- 172.21.15.154:0/2755752528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 msgr2=0x7fe60c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:36.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.295+0000 7fe61179d700 1 --2- 172.21.15.154:0/2755752528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 0x7fe60c157770 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0099e0 tx=0x7fe5fc009250 comp rx=0 tx=0).stop 2023-10-10T21:18:36.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.295+0000 7fe61179d700 1 -- 172.21.15.154:0/2755752528 shutdown_connections 2023-10-10T21:18:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.295+0000 7fe61179d700 1 --2- 172.21.15.154:0/2755752528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 0x7fe60c157770 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.295+0000 7fe61179d700 1 --2- 172.21.15.154:0/2755752528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 0x7fe60c0c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.295+0000 7fe61179d700 1 -- 172.21.15.154:0/2755752528 >> 172.21.15.154:0/2755752528 conn(0x7fe60c0cc1f0 msgr2=0x7fe60c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.295+0000 7fe61179d700 1 -- 172.21.15.154:0/2755752528 shutdown_connections 2023-10-10T21:18:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.295+0000 7fe61179d700 1 -- 172.21.15.154:0/2755752528 wait complete. 2023-10-10T21:18:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.296+0000 7fe61179d700 1 Processor -- start 2023-10-10T21:18:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.296+0000 7fe61179d700 1 -- start start 2023-10-10T21:18:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.297+0000 7fe61179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60c0c7240 0x7fe60c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.297+0000 7fe61179d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 0x7fe60c0afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.297+0000 7fe61179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 0x7fe60c0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.297+0000 7fe61179d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0ad640 con 0x7fe60c150180 2023-10-10T21:18:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.297+0000 7fe61179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0aca30 con 0x7fe60c0c7240 2023-10-10T21:18:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.297+0000 7fe61179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0acd10 con 0x7fe60c150550 2023-10-10T21:18:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.297+0000 7fe60b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 0x7fe60c0afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.297+0000 7fe60b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 0x7fe60c0afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52426/0 (socket says 172.21.15.154:52426) 2023-10-10T21:18:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.297+0000 7fe60b7fe700 1 -- 172.21.15.154:0/3167833657 learned_addr learned my addr 172.21.15.154:0/3167833657 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe60bfff700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60c0c7240 0x7fe60c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe610f9c700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 0x7fe60c0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe60b7fe700 1 -- 172.21.15.154:0/3167833657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 msgr2=0x7fe60c0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe60b7fe700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 0x7fe60c0aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe60b7fe700 1 -- 172.21.15.154:0/3167833657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60c0c7240 msgr2=0x7fe60c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe60b7fe700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60c0c7240 0x7fe60c14f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe60b7fe700 1 -- 172.21.15.154:0/3167833657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0094f0 con 0x7fe60c150180 2023-10-10T21:18:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe610f9c700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 0x7fe60c0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe60b7fe700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 0x7fe60c0afc90 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fe60000e930 tx=0x7fe6000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe5f3fff700 1 -- 172.21.15.154:0/3167833657 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600009510 con 0x7fe60c150180 2023-10-10T21:18:36.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe5f3fff700 1 -- 172.21.15.154:0/3167833657 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000c850 con 0x7fe60c150180 2023-10-10T21:18:36.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe5f3fff700 1 -- 172.21.15.154:0/3167833657 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000cc10 con 0x7fe60c150180 2023-10-10T21:18:36.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.298+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c0acff0 con 0x7fe60c150180 2023-10-10T21:18:36.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.299+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c0b01d0 con 0x7fe60c150180 2023-10-10T21:18:36.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.299+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c04c3c0 con 0x7fe60c150180 2023-10-10T21:18:36.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.301+0000 7fe5f3fff700 1 -- 172.21.15.154:0/3167833657 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe600013470 con 0x7fe60c150180 2023-10-10T21:18:36.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.301+0000 7fe5f3fff700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe5f8066f30 0x7fe5f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:36.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.302+0000 7fe5f3fff700 1 -- 172.21.15.154:0/3167833657 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fe600084830 con 0x7fe60c150180 2023-10-10T21:18:36.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.302+0000 7fe60bfff700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe5f8066f30 0x7fe5f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:36.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.302+0000 7fe60bfff700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe5f8066f30 0x7fe5f80693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0099e0 tx=0x7fe5fc017000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:36.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.305+0000 7fe5f3fff700 1 -- 172.21.15.154:0/3167833657 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe600051940 con 0x7fe60c150180 2023-10-10T21:18:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:36.572+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7fe60c0ad490 con 0x7fe60c150180 2023-10-10T21:18:37.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.089+0000 7fe5f3fff700 1 -- 172.21.15.154:0/3167833657 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v610) v1 ==== 186+0+0 (secure 0 0 0) 0x7fe600054f60 con 0x7fe60c150180 2023-10-10T21:18:37.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe5f8066f30 msgr2=0x7fe5f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe5f8066f30 0x7fe5f80693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0099e0 tx=0x7fe5fc017000 comp rx=0 tx=0).stop 2023-10-10T21:18:37.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 msgr2=0x7fe60c0afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 0x7fe60c0afc90 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fe60000e930 tx=0x7fe6000091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 shutdown_connections 2023-10-10T21:18:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60c150550 0x7fe60c0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe5f8066f30 0x7fe5f80693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60c0c7240 0x7fe60c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 --2- 172.21.15.154:0/3167833657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe60c150180 0x7fe60c0afc90 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.091+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 >> 172.21.15.154:0/3167833657 conn(0x7fe60c0cc1f0 msgr2=0x7fe60c0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.092+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 shutdown_connections 2023-10-10T21:18:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.092+0000 7fe61179d700 1 -- 172.21.15.154:0/3167833657 wait complete. 2023-10-10T21:18:37.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T21:18:37.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.293+0000 7f5e2dbff700 1 Processor -- start 2023-10-10T21:18:37.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.293+0000 7f5e2dbff700 1 -- start start 2023-10-10T21:18:37.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.295+0000 7f5e2dbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5e2806bcd0 0x7f5e280caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.295+0000 7f5e2dbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2815d7e0 con 0x7f5e2815df50 2023-10-10T21:18:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.295+0000 7f5e2dbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2815dac0 con 0x7f5e2806c0a0 2023-10-10T21:18:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.295+0000 7f5e2dbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2815aa30 con 0x7f5e2806bcd0 2023-10-10T21:18:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.295+0000 7f5e27fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5e2815df50 0x7f5e280c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55892/0 (socket says 172.21.15.154:55892) 2023-10-10T21:18:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.295+0000 7f5e27fff700 1 -- 172.21.15.154:0/2711601 learned_addr learned my addr 172.21.15.154:0/2711601 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.295+0000 7f5e277fe700 1 --2- 172.21.15.154:0/2711601 >> v2:172.21.15.179:3300/0 conn(0x7f5e2806bcd0 0x7f5e280caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e267fc700 1 -- 172.21.15.154:0/2711601 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856815414 0 0) 0x7f5e2815d7e0 con 0x7f5e2815df50 2023-10-10T21:18:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e267fc700 1 -- 172.21.15.154:0/2711601 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e10003570 con 0x7f5e2815df50 2023-10-10T21:18:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e267fc700 1 -- 172.21.15.154:0/2711601 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539259007 0 0) 0x7f5e2815dac0 con 0x7f5e2806c0a0 2023-10-10T21:18:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e267fc700 1 -- 172.21.15.154:0/2711601 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e2815d7e0 con 0x7f5e2806c0a0 2023-10-10T21:18:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e277fe700 1 -- 172.21.15.154:0/2711601 >> v1:172.21.15.179:6789/0 conn(0x7f5e2806c0a0 legacy=0x7f5e2815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e277fe700 1 -- 172.21.15.154:0/2711601 >> v1:172.21.15.154:6789/0 conn(0x7f5e2815df50 legacy=0x7f5e280c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e277fe700 1 -- 172.21.15.154:0/2711601 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2815ad10 con 0x7f5e2806bcd0 2023-10-10T21:18:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e277fe700 1 --2- 172.21.15.154:0/2711601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e2806bcd0 0x7f5e280caa90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5e180098e0 tx=0x7f5e180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b07ac9d158c74d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e267fc700 1 -- 172.21.15.154:0/2711601 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18011630 con 0x7f5e2806bcd0 2023-10-10T21:18:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e267fc700 1 -- 172.21.15.154:0/2711601 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e18011790 con 0x7f5e2806bcd0 2023-10-10T21:18:37.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.296+0000 7f5e267fc700 1 -- 172.21.15.154:0/2711601 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18011b30 con 0x7f5e2806bcd0 2023-10-10T21:18:37.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.297+0000 7f5e2dbff700 1 -- 172.21.15.154:0/2711601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e2806bcd0 msgr2=0x7f5e280caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.297+0000 7f5e2dbff700 1 --2- 172.21.15.154:0/2711601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e2806bcd0 0x7f5e280caa90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5e180098e0 tx=0x7f5e180091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.297+0000 7f5e2dbff700 1 -- 172.21.15.154:0/2711601 shutdown_connections 2023-10-10T21:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.297+0000 7f5e2dbff700 1 --2- 172.21.15.154:0/2711601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e2806bcd0 0x7f5e280caa90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.297+0000 7f5e2dbff700 1 -- 172.21.15.154:0/2711601 >> 172.21.15.154:0/2711601 conn(0x7f5e280ce600 msgr2=0x7f5e280cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.297+0000 7f5e2dbff700 1 -- 172.21.15.154:0/2711601 shutdown_connections 2023-10-10T21:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.297+0000 7f5e2dbff700 1 -- 172.21.15.154:0/2711601 wait complete. 2023-10-10T21:18:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.298+0000 7f5e2dbff700 1 Processor -- start 2023-10-10T21:18:37.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.298+0000 7f5e2dbff700 1 -- start start 2023-10-10T21:18:37.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.299+0000 7f5e2dbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2806bcd0 0x7f5e2814c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.299+0000 7f5e2dbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2806c0a0 0x7f5e280c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.299+0000 7f5e2dbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e2815df50 0x7f5e280c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.299+0000 7f5e2dbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28158250 con 0x7f5e2806c0a0 2023-10-10T21:18:37.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.299+0000 7f5e2dbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2814b600 con 0x7f5e2815df50 2023-10-10T21:18:37.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.299+0000 7f5e2dbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2814b8e0 con 0x7f5e2806bcd0 2023-10-10T21:18:37.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e26ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2806c0a0 0x7f5e280c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:37.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e26ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2806c0a0 0x7f5e280c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52438/0 (socket says 172.21.15.154:52438) 2023-10-10T21:18:37.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e26ffd700 1 -- 172.21.15.154:0/744793446 learned_addr learned my addr 172.21.15.154:0/744793446 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e277fe700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2806bcd0 0x7f5e2814c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e27fff700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e2815df50 0x7f5e280c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e26ffd700 1 -- 172.21.15.154:0/744793446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2806bcd0 msgr2=0x7f5e2814c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e26ffd700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2806bcd0 0x7f5e2814c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e26ffd700 1 -- 172.21.15.154:0/744793446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e2815df50 msgr2=0x7f5e280c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e26ffd700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e2815df50 0x7f5e280c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e26ffd700 1 -- 172.21.15.154:0/744793446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e18009420 con 0x7f5e2806c0a0 2023-10-10T21:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.300+0000 7f5e26ffd700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2806c0a0 0x7f5e280c5880 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c580 tx=0x7f5e1c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.301+0000 7f5e0f7fe700 1 -- 172.21.15.154:0/744793446 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c010510 con 0x7f5e2806c0a0 2023-10-10T21:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.301+0000 7f5e0f7fe700 1 -- 172.21.15.154:0/744793446 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c010670 con 0x7f5e2806c0a0 2023-10-10T21:18:37.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.301+0000 7f5e0f7fe700 1 -- 172.21.15.154:0/744793446 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c010a30 con 0x7f5e2806c0a0 2023-10-10T21:18:37.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.301+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2814bbc0 con 0x7f5e2806c0a0 2023-10-10T21:18:37.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.301+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2814c180 con 0x7f5e2806c0a0 2023-10-10T21:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.302+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2814c3a0 con 0x7f5e2806c0a0 2023-10-10T21:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.303+0000 7f5e0f7fe700 1 -- 172.21.15.154:0/744793446 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e1c01b400 con 0x7f5e2806c0a0 2023-10-10T21:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.303+0000 7f5e0f7fe700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e14066f30 0x7f5e140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.303+0000 7f5e0f7fe700 1 -- 172.21.15.154:0/744793446 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f5e1c084320 con 0x7f5e2806c0a0 2023-10-10T21:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.304+0000 7f5e277fe700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e14066f30 0x7f5e140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.304+0000 7f5e277fe700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e14066f30 0x7f5e140693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e180093f0 tx=0x7f5e18017000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.308+0000 7f5e0f7fe700 1 -- 172.21.15.154:0/744793446 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e1c051430 con 0x7f5e2806c0a0 2023-10-10T21:18:37.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.499+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5e2804c3c0 con 0x7f5e2806c0a0 2023-10-10T21:18:37.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.504+0000 7f5e0f7fe700 1 -- 172.21.15.154:0/744793446 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5e1c054a50 con 0x7f5e2806c0a0 2023-10-10T21:18:37.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e14066f30 msgr2=0x7f5e140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e14066f30 0x7f5e140693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e180093f0 tx=0x7f5e18017000 comp rx=0 tx=0).stop 2023-10-10T21:18:37.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2806c0a0 msgr2=0x7f5e280c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2806c0a0 0x7f5e280c5880 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c580 tx=0x7f5e1c007e10 comp rx=0 tx=0).stop 2023-10-10T21:18:37.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 shutdown_connections 2023-10-10T21:18:37.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e14066f30 0x7f5e140693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e2815df50 0x7f5e280c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2806bcd0 0x7f5e2814c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 --2- 172.21.15.154:0/744793446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2806c0a0 0x7f5e280c5880 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 >> 172.21.15.154:0/744793446 conn(0x7f5e280ce600 msgr2=0x7f5e280cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:37.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 shutdown_connections 2023-10-10T21:18:37.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.506+0000 7f5e2dbff700 1 -- 172.21.15.154:0/744793446 wait complete. 2023-10-10T21:18:37.525 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:18:37.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:18:37.608 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:18:37.701 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:18:37.701 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T21:18:37.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:18:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.885+0000 7f5cbf7ff700 1 Processor -- start 2023-10-10T21:18:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.885+0000 7f5cbf7ff700 1 -- start start 2023-10-10T21:18:37.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.887+0000 7f5cbf7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb81578b0 0x7f5cb8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.887+0000 7f5cbf7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb80ad930 con 0x7f5cb80af2f0 2023-10-10T21:18:37.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.887+0000 7f5cbf7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb80acd20 con 0x7f5cb8155c10 2023-10-10T21:18:37.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.887+0000 7f5cbf7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80ad000 con 0x7f5cb81578b0 2023-10-10T21:18:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.887+0000 7f5cbdd9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5cb80af2f0 0x7f5cb80af710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55894/0 (socket says 172.21.15.154:55894) 2023-10-10T21:18:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.887+0000 7f5cbdd9c700 1 -- 172.21.15.154:0/1271009614 learned_addr learned my addr 172.21.15.154:0/1271009614 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.887+0000 7f5cbcd9a700 1 --2- 172.21.15.154:0/1271009614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb81578b0 0x7f5cb8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.887+0000 7f5caffff700 1 -- 172.21.15.154:0/1271009614 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169194704 0 0) 0x7f5cb80ad930 con 0x7f5cb80af2f0 2023-10-10T21:18:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.887+0000 7f5caffff700 1 -- 172.21.15.154:0/1271009614 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca4003570 con 0x7f5cb80af2f0 2023-10-10T21:18:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.888+0000 7f5caffff700 1 -- 172.21.15.154:0/1271009614 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708169665 0 0) 0x7f5cb80acd20 con 0x7f5cb8155c10 2023-10-10T21:18:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.888+0000 7f5caffff700 1 -- 172.21.15.154:0/1271009614 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb80ad930 con 0x7f5cb8155c10 2023-10-10T21:18:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.888+0000 7f5cbcd9a700 1 -- 172.21.15.154:0/1271009614 >> v1:172.21.15.179:6789/0 conn(0x7f5cb8155c10 legacy=0x7f5cb80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.888+0000 7f5cbcd9a700 1 -- 172.21.15.154:0/1271009614 >> v1:172.21.15.154:6789/0 conn(0x7f5cb80af2f0 legacy=0x7f5cb80af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.888+0000 7f5cbcd9a700 1 -- 172.21.15.154:0/1271009614 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80ad2e0 con 0x7f5cb81578b0 2023-10-10T21:18:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.888+0000 7f5cbcd9a700 1 --2- 172.21.15.154:0/1271009614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb81578b0 0x7f5cb8155fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800aac0 tx=0x7f5ca800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea7be28bacc0a17b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.888+0000 7f5caffff700 1 -- 172.21.15.154:0/1271009614 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca800c970 con 0x7f5cb81578b0 2023-10-10T21:18:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.888+0000 7f5caffff700 1 -- 172.21.15.154:0/1271009614 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca800cad0 con 0x7f5cb81578b0 2023-10-10T21:18:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.888+0000 7f5caffff700 1 -- 172.21.15.154:0/1271009614 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca800ce70 con 0x7f5cb81578b0 2023-10-10T21:18:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.889+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1271009614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb81578b0 msgr2=0x7f5cb8155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.889+0000 7f5cbf7ff700 1 --2- 172.21.15.154:0/1271009614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb81578b0 0x7f5cb8155fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800aac0 tx=0x7f5ca800a330 comp rx=0 tx=0).stop 2023-10-10T21:18:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.889+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1271009614 shutdown_connections 2023-10-10T21:18:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.889+0000 7f5cbf7ff700 1 --2- 172.21.15.154:0/1271009614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb81578b0 0x7f5cb8155fe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.889+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1271009614 >> 172.21.15.154:0/1271009614 conn(0x7f5cb806a320 msgr2=0x7f5cb80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.889+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1271009614 shutdown_connections 2023-10-10T21:18:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.889+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1271009614 wait complete. 2023-10-10T21:18:37.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.890+0000 7f5cbf7ff700 1 Processor -- start 2023-10-10T21:18:37.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.891+0000 7f5cbf7ff700 1 -- start start 2023-10-10T21:18:37.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.891+0000 7f5cbf7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb80af2f0 0x7f5cb8152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.891+0000 7f5cbf7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb8155c10 0x7f5cb815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.891+0000 7f5cbf7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb81578b0 0x7f5cb815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.891+0000 7f5cbf7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80a82a0 con 0x7f5cb8155c10 2023-10-10T21:18:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.891+0000 7f5cbf7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8152f70 con 0x7f5cb81578b0 2023-10-10T21:18:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.891+0000 7f5cbf7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb815acf0 con 0x7f5cb80af2f0 2023-10-10T21:18:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbcd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb8155c10 0x7f5cb815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbcd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb8155c10 0x7f5cb815bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52448/0 (socket says 172.21.15.154:52448) 2023-10-10T21:18:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbcd9a700 1 -- 172.21.15.154:0/1358581587 learned_addr learned my addr 172.21.15.154:0/1358581587 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbdd9c700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb81578b0 0x7f5cb815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbcd9a700 1 -- 172.21.15.154:0/1358581587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb80af2f0 msgr2=0x7f5cb8152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbcd9a700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb80af2f0 0x7f5cb8152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbcd9a700 1 -- 172.21.15.154:0/1358581587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb81578b0 msgr2=0x7f5cb815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:37.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbcd9a700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb81578b0 0x7f5cb815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:37.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbcd9a700 1 -- 172.21.15.154:0/1358581587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca800a5d0 con 0x7f5cb8155c10 2023-10-10T21:18:37.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbdd9c700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb81578b0 0x7f5cb815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:37.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.892+0000 7f5cbcd9a700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb8155c10 0x7f5cb815bc20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800a370 tx=0x7f5ca801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:37.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.893+0000 7f5cad7fa700 1 -- 172.21.15.154:0/1358581587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8022410 con 0x7f5cb8155c10 2023-10-10T21:18:37.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.893+0000 7f5cad7fa700 1 -- 172.21.15.154:0/1358581587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8022590 con 0x7f5cb8155c10 2023-10-10T21:18:37.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.893+0000 7f5cad7fa700 1 -- 172.21.15.154:0/1358581587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8022950 con 0x7f5cb8155c10 2023-10-10T21:18:37.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.893+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb815afd0 con 0x7f5cb8155c10 2023-10-10T21:18:37.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.893+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb815b590 con 0x7f5cb8155c10 2023-10-10T21:18:37.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.894+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb804c3c0 con 0x7f5cb8155c10 2023-10-10T21:18:37.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.895+0000 7f5cad7fa700 1 -- 172.21.15.154:0/1358581587 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ca80103f0 con 0x7f5cb8155c10 2023-10-10T21:18:37.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.895+0000 7f5cad7fa700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c9c066f30 0x7f5c9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:37.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.896+0000 7f5cad7fa700 1 -- 172.21.15.154:0/1358581587 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f5ca8085e90 con 0x7f5cb8155c10 2023-10-10T21:18:37.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.896+0000 7f5cbd59b700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c9c066f30 0x7f5c9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:37.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.896+0000 7f5cbd59b700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c9c066f30 0x7f5c9c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80affb0 tx=0x7f5cb40079d0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:37.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:37.900+0000 7f5cad7fa700 1 -- 172.21.15.154:0/1358581587 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ca8053040 con 0x7f5cb8155c10 2023-10-10T21:18:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.135+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cb80ad5c0 con 0x7f5cb8155c10 2023-10-10T21:18:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.135+0000 7f5cad7fa700 1 -- 172.21.15.154:0/1358581587 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f5ca8027090 con 0x7f5cb8155c10 2023-10-10T21:18:38.137 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:38.137 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/136831769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":136831769},{"type":"v1","addr":"172.21.15.154:6837","nonce":136831769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3500808204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3500808204},{"type":"v1","addr":"172.21.15.179:6833","nonce":3500808204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/953113300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":953113300},{"type":"v1","addr":"172.21.15.154:6835","nonce":953113300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6814,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3591756283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3591756283},{"type":"v1","addr":"172.21.15.179:6835","nonce":3591756283}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[]} 2023-10-10T21:18:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.137+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c9c066f30 msgr2=0x7f5c9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.137+0000 7f5cbf7ff700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c9c066f30 0x7f5c9c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80affb0 tx=0x7f5cb40079d0 comp rx=0 tx=0).stop 2023-10-10T21:18:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.137+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb8155c10 msgr2=0x7f5cb815bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.137+0000 7f5cbf7ff700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb8155c10 0x7f5cb815bc20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800a370 tx=0x7f5ca801a000 comp rx=0 tx=0).stop 2023-10-10T21:18:38.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.138+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 shutdown_connections 2023-10-10T21:18:38.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.138+0000 7f5cbf7ff700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c9c066f30 0x7f5c9c0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:38.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.138+0000 7f5cbf7ff700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb81578b0 0x7f5cb815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:38.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.138+0000 7f5cbf7ff700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb80af2f0 0x7f5cb8152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:38.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.138+0000 7f5cbf7ff700 1 --2- 172.21.15.154:0/1358581587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb8155c10 0x7f5cb815bc20 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:38.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.138+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 >> 172.21.15.154:0/1358581587 conn(0x7f5cb806a320 msgr2=0x7f5cb8154810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:38.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.138+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 shutdown_connections 2023-10-10T21:18:38.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.138+0000 7f5cbf7ff700 1 -- 172.21.15.154:0/1358581587 wait complete. 2023-10-10T21:18:38.141 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 40 2023-10-10T21:18:38.156 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T21:18:38.157 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T21:18:38.157 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T21:18:38.158 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:18:38.158 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T21:18:38.158 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T21:18:38.159 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T21:18:38.159 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:18:38.159 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T21:18:38.161 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T21:18:38.162 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T21:18:38.162 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:18:38.162 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T21:18:38.163 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T21:18:38.163 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T21:18:38.163 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:18:38.175 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T21:18:38.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T21:18:38.176 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T21:18:38.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T21:18:38.179 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T21:18:38.180 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T21:18:38.181 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T21:18:38.181 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T21:18:38.220 INFO:tasks.ceph.mds.c:Started 2023-10-10T21:18:38.220 DEBUG:teuthology.parallel:result is None 2023-10-10T21:18:38.222 INFO:tasks.ceph.mds.a:Started 2023-10-10T21:18:38.222 DEBUG:teuthology.parallel:result is None 2023-10-10T21:18:38.225 INFO:tasks.ceph.mds.b:Started 2023-10-10T21:18:38.226 DEBUG:teuthology.parallel:result is None 2023-10-10T21:18:38.229 INFO:tasks.ceph.mds.d:Started 2023-10-10T21:18:38.230 DEBUG:teuthology.parallel:result is None 2023-10-10T21:18:38.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T21:18:38.354 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:18:38.354 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:18:38.367 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T21:18:38.367 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:18:38.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.422+0000 7f5903fff700 1 Processor -- start 2023-10-10T21:18:38.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.422+0000 7f5903fff700 1 -- start start 2023-10-10T21:18:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.423+0000 7f5903fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58fc0cbf30 0x7f58fc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f5903fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0cc300 con 0x7f58fc0b1420 2023-10-10T21:18:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f5903fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0ad370 con 0x7f58fc0ccf90 2023-10-10T21:18:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f5903fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc156bf0 con 0x7f58fc0cbf30 2023-10-10T21:18:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f590259c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f58fc0b1420 0x7f58fc0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55920/0 (socket says 172.21.15.154:55920) 2023-10-10T21:18:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f590259c700 1 -- 172.21.15.154:0/39802387 learned_addr learned my addr 172.21.15.154:0/39802387 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f5901d9b700 1 --2- 172.21.15.154:0/39802387 >> v2:172.21.15.179:3300/0 conn(0x7f58fc0cbf30 0x7f58fc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f5900d99700 1 -- 172.21.15.154:0/39802387 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101476000 0 0) 0x7f58fc0cc300 con 0x7f58fc0b1420 2023-10-10T21:18:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f5900d99700 1 -- 172.21.15.154:0/39802387 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e8003570 con 0x7f58fc0b1420 2023-10-10T21:18:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f5900d99700 1 -- 172.21.15.154:0/39802387 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136205585 0 0) 0x7f58fc0ad370 con 0x7f58fc0ccf90 2023-10-10T21:18:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.424+0000 7f5900d99700 1 -- 172.21.15.154:0/39802387 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58fc0cc300 con 0x7f58fc0ccf90 2023-10-10T21:18:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.425+0000 7f5901d9b700 1 -- 172.21.15.154:0/39802387 >> v1:172.21.15.179:6789/0 conn(0x7f58fc0ccf90 legacy=0x7f58fc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.425+0000 7f5901d9b700 1 -- 172.21.15.154:0/39802387 >> v1:172.21.15.154:6789/0 conn(0x7f58fc0b1420 legacy=0x7f58fc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.425+0000 7f5901d9b700 1 -- 172.21.15.154:0/39802387 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0ad650 con 0x7f58fc0cbf30 2023-10-10T21:18:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.425+0000 7f5901d9b700 1 --2- 172.21.15.154:0/39802387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc0cbf30 0x7f58fc0ae410 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f58f80098e0 tx=0x7f58f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=352d2591f9474c0c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:38.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.425+0000 7f5900d99700 1 -- 172.21.15.154:0/39802387 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8011630 con 0x7f58fc0cbf30 2023-10-10T21:18:38.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.425+0000 7f5900d99700 1 -- 172.21.15.154:0/39802387 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f8011790 con 0x7f58fc0cbf30 2023-10-10T21:18:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.425+0000 7f5900d99700 1 -- 172.21.15.154:0/39802387 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8011b30 con 0x7f58fc0cbf30 2023-10-10T21:18:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.426+0000 7f5903fff700 1 -- 172.21.15.154:0/39802387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc0cbf30 msgr2=0x7f58fc0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.426+0000 7f5903fff700 1 --2- 172.21.15.154:0/39802387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc0cbf30 0x7f58fc0ae410 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f58f80098e0 tx=0x7f58f80091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.426+0000 7f5903fff700 1 -- 172.21.15.154:0/39802387 shutdown_connections 2023-10-10T21:18:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.426+0000 7f5903fff700 1 --2- 172.21.15.154:0/39802387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc0cbf30 0x7f58fc0ae410 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.426+0000 7f5903fff700 1 -- 172.21.15.154:0/39802387 >> 172.21.15.154:0/39802387 conn(0x7f58fc06a320 msgr2=0x7f58fc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.426+0000 7f5903fff700 1 -- 172.21.15.154:0/39802387 shutdown_connections 2023-10-10T21:18:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.426+0000 7f5903fff700 1 -- 172.21.15.154:0/39802387 wait complete. 2023-10-10T21:18:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.427+0000 7f5903fff700 1 Processor -- start 2023-10-10T21:18:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.427+0000 7f5903fff700 1 -- start start 2023-10-10T21:18:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.428+0000 7f5903fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc0b1420 0x7f58fc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.428+0000 7f5903fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc0cbf30 0x7f58fc1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.428+0000 7f5903fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58fc0ccf90 0x7f58fc16d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.428+0000 7f5903fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc155310 con 0x7f58fc0b1420 2023-10-10T21:18:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.428+0000 7f5903fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1555f0 con 0x7f58fc0cbf30 2023-10-10T21:18:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.428+0000 7f5903fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1558d0 con 0x7f58fc0ccf90 2023-10-10T21:18:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.429+0000 7f5901d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc0b1420 0x7f58fc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.429+0000 7f5901d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc0b1420 0x7f58fc15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52498/0 (socket says 172.21.15.154:52498) 2023-10-10T21:18:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.429+0000 7f5901d9b700 1 -- 172.21.15.154:0/3597550059 learned_addr learned my addr 172.21.15.154:0/3597550059 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.429+0000 7f5901d9b700 1 -- 172.21.15.154:0/3597550059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58fc0ccf90 msgr2=0x7f58fc16d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.429+0000 7f5901d9b700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58fc0ccf90 0x7f58fc16d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.429+0000 7f5901d9b700 1 -- 172.21.15.154:0/3597550059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc0cbf30 msgr2=0x7f58fc1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.429+0000 7f5901d9b700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc0cbf30 0x7f58fc1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.429+0000 7f5901d9b700 1 -- 172.21.15.154:0/3597550059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f8009420 con 0x7f58fc0b1420 2023-10-10T21:18:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.429+0000 7f5901d9b700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc0b1420 0x7f58fc15a490 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f58fc064290 tx=0x7f58f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.430+0000 7f58f1ffb700 1 -- 172.21.15.154:0/3597550059 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f801f070 con 0x7f58fc0b1420 2023-10-10T21:18:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.430+0000 7f58f1ffb700 1 -- 172.21.15.154:0/3597550059 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f8000c90 con 0x7f58fc0b1420 2023-10-10T21:18:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.430+0000 7f58f1ffb700 1 -- 172.21.15.154:0/3597550059 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8025420 con 0x7f58fc0b1420 2023-10-10T21:18:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.430+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc155bb0 con 0x7f58fc0b1420 2023-10-10T21:18:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.430+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc15a9d0 con 0x7f58fc0b1420 2023-10-10T21:18:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.431+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc157c30 con 0x7f58fc0b1420 2023-10-10T21:18:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.431+0000 7f58f1ffb700 1 -- 172.21.15.154:0/3597550059 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58f8023070 con 0x7f58fc0b1420 2023-10-10T21:18:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.432+0000 7f58f1ffb700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f58e0066f30 0x7f58e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.432+0000 7f58f1ffb700 1 -- 172.21.15.154:0/3597550059 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f58f8085ac0 con 0x7f58fc0b1420 2023-10-10T21:18:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.433+0000 7f590159a700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f58e0066f30 0x7f58e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.433+0000 7f590159a700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f58e0066f30 0x7f58e00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f58fc159a50 tx=0x7f58ec0079d0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.436+0000 7f58f1ffb700 1 -- 172.21.15.154:0/3597550059 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58fc157c30 con 0x7f58fc0b1420 2023-10-10T21:18:38.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:38.650+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f58fc157c30 con 0x7f58fc0b1420 2023-10-10T21:18:39.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.523+0000 7f58f1ffb700 1 -- 172.21.15.154:0/3597550059 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v105) v1 ==== 97+0+0 (secure 0 0 0) 0x7f58fc157c30 con 0x7f58fc0b1420 2023-10-10T21:18:39.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f58e0066f30 msgr2=0x7f58e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f58e0066f30 0x7f58e00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f58fc159a50 tx=0x7f58ec0079d0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc0b1420 msgr2=0x7f58fc15a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc0b1420 0x7f58fc15a490 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f58fc064290 tx=0x7f58f8017000 comp rx=0 tx=0).stop 2023-10-10T21:18:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 shutdown_connections 2023-10-10T21:18:39.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58fc0ccf90 0x7f58fc16d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc0b1420 0x7f58fc15a490 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f58e0066f30 0x7f58e00693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 --2- 172.21.15.154:0/3597550059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc0cbf30 0x7f58fc1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 >> 172.21.15.154:0/3597550059 conn(0x7f58fc06a320 msgr2=0x7f58fc0ac660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:39.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 shutdown_connections 2023-10-10T21:18:39.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.526+0000 7f5903fff700 1 -- 172.21.15.154:0/3597550059 wait complete. 2023-10-10T21:18:39.530 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T21:18:39.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T21:18:39.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.730+0000 7feba9bff700 1 Processor -- start 2023-10-10T21:18:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.730+0000 7feba9bff700 1 -- start start 2023-10-10T21:18:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba9bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feba41578b0 0x7feba4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba9bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feba40af2f0 0x7feba40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba9bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40ad930 con 0x7feba4155c10 2023-10-10T21:18:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba9bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba40b0c80 con 0x7feba41578b0 2023-10-10T21:18:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba9bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba40acd20 con 0x7feba40af2f0 2023-10-10T21:18:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feba41578b0 0x7feba4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba37fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7feba4155c10 0x7feba40ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55936/0 (socket says 172.21.15.154:55936) 2023-10-10T21:18:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba37fe700 1 -- 172.21.15.154:0/3096340712 learned_addr learned my addr 172.21.15.154:0/3096340712 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba3fff700 1 --2- 172.21.15.154:0/3096340712 >> v2:172.21.15.179:3300/0 conn(0x7feba40af2f0 0x7feba40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba27fc700 1 -- 172.21.15.154:0/3096340712 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747093298 0 0) 0x7feba40ad930 con 0x7feba4155c10 2023-10-10T21:18:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.732+0000 7feba27fc700 1 -- 172.21.15.154:0/3096340712 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb8c004680 con 0x7feba4155c10 2023-10-10T21:18:39.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.733+0000 7feba2ffd700 1 -- 172.21.15.154:0/3096340712 >> v2:172.21.15.179:3300/0 conn(0x7feba40af2f0 msgr2=0x7feba40af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:39.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.733+0000 7feba2ffd700 1 --2- 172.21.15.154:0/3096340712 >> v2:172.21.15.179:3300/0 conn(0x7feba40af2f0 0x7feba40af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.733+0000 7feba2ffd700 1 -- 172.21.15.154:0/3096340712 >> v1:172.21.15.154:6789/0 conn(0x7feba4155c10 legacy=0x7feba40ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:39.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.733+0000 7feba2ffd700 1 -- 172.21.15.154:0/3096340712 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40ad000 con 0x7feba41578b0 2023-10-10T21:18:39.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.733+0000 7feba2ffd700 1 --2- 172.21.15.154:0/3096340712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba41578b0 0x7feba4155fe0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7feba4065be0 tx=0x7feb980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9565fceadfe9c1b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:39.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.733+0000 7feba27fc700 1 -- 172.21.15.154:0/3096340712 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800f6b0 con 0x7feba41578b0 2023-10-10T21:18:39.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.733+0000 7feba27fc700 1 -- 172.21.15.154:0/3096340712 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800f830 con 0x7feba41578b0 2023-10-10T21:18:39.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.733+0000 7feba27fc700 1 -- 172.21.15.154:0/3096340712 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800fbb0 con 0x7feba41578b0 2023-10-10T21:18:39.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.734+0000 7feba9bff700 1 -- 172.21.15.154:0/3096340712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba41578b0 msgr2=0x7feba4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:39.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.734+0000 7feba9bff700 1 --2- 172.21.15.154:0/3096340712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba41578b0 0x7feba4155fe0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7feba4065be0 tx=0x7feb980091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.734+0000 7feba9bff700 1 -- 172.21.15.154:0/3096340712 shutdown_connections 2023-10-10T21:18:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.734+0000 7feba9bff700 1 --2- 172.21.15.154:0/3096340712 >> v2:172.21.15.179:3300/0 conn(0x7feba40af2f0 0x7feba40af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.734+0000 7feba9bff700 1 --2- 172.21.15.154:0/3096340712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba41578b0 0x7feba4155fe0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.734+0000 7feba9bff700 1 -- 172.21.15.154:0/3096340712 >> 172.21.15.154:0/3096340712 conn(0x7feba406a320 msgr2=0x7feba40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.734+0000 7feba9bff700 1 -- 172.21.15.154:0/3096340712 shutdown_connections 2023-10-10T21:18:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.734+0000 7feba9bff700 1 -- 172.21.15.154:0/3096340712 wait complete. 2023-10-10T21:18:39.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.735+0000 7feba9bff700 1 Processor -- start 2023-10-10T21:18:39.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.735+0000 7feba9bff700 1 -- start start 2023-10-10T21:18:39.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.736+0000 7feba9bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba40af2f0 0x7feba414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.736+0000 7feba9bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba4155c10 0x7feba4158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.736+0000 7feba9bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba41578b0 0x7feba413ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.736+0000 7feba9bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba414f0a0 con 0x7feba4155c10 2023-10-10T21:18:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.736+0000 7feba9bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba414f8e0 con 0x7feba41578b0 2023-10-10T21:18:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.736+0000 7feba9bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba414fbc0 con 0x7feba40af2f0 2023-10-10T21:18:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba4155c10 0x7feba4158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba4155c10 0x7feba4158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52520/0 (socket says 172.21.15.154:52520) 2023-10-10T21:18:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba2ffd700 1 -- 172.21.15.154:0/3828376345 learned_addr learned my addr 172.21.15.154:0/3828376345 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba2ffd700 1 -- 172.21.15.154:0/3828376345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba40af2f0 msgr2=0x7feba414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba2ffd700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba40af2f0 0x7feba414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba2ffd700 1 -- 172.21.15.154:0/3828376345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba41578b0 msgr2=0x7feba413ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba2ffd700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba41578b0 0x7feba413ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba2ffd700 1 -- 172.21.15.154:0/3828376345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009420 con 0x7feba4155c10 2023-10-10T21:18:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba2ffd700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba4155c10 0x7feba4158170 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7feb98015000 tx=0x7feb98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feb8b7fe700 1 -- 172.21.15.154:0/3828376345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9801d040 con 0x7feba4155c10 2023-10-10T21:18:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feb8b7fe700 1 -- 172.21.15.154:0/3828376345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98000c90 con 0x7feba4155c10 2023-10-10T21:18:39.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.737+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba414fea0 con 0x7feba4155c10 2023-10-10T21:18:39.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.738+0000 7feb8b7fe700 1 -- 172.21.15.154:0/3828376345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800fbb0 con 0x7feba4155c10 2023-10-10T21:18:39.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.738+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4159f50 con 0x7feba4155c10 2023-10-10T21:18:39.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.739+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba41503c0 con 0x7feba4155c10 2023-10-10T21:18:39.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.739+0000 7feb8b7fe700 1 -- 172.21.15.154:0/3828376345 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb980233f0 con 0x7feba4155c10 2023-10-10T21:18:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.740+0000 7feb8b7fe700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feb90066f30 0x7feb900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.740+0000 7feb8b7fe700 1 -- 172.21.15.154:0/3828376345 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5245+0+0 (secure 0 0 0) 0x7feb98014070 con 0x7feba4155c10 2023-10-10T21:18:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.740+0000 7feba37fe700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feb90066f30 0x7feb900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.741+0000 7feba37fe700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feb90066f30 0x7feb900693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb940058d0 tx=0x7feb940079d0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:39.744+0000 7feb8b7fe700 1 -- 172.21.15.154:0/3828376345 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb98053280 con 0x7feba4155c10 2023-10-10T21:18:40.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.009+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feba415a1a0 con 0x7feba4155c10 2023-10-10T21:18:40.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.010+0000 7feb8b7fe700 1 -- 172.21.15.154:0/3828376345 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7feba415a1a0 con 0x7feba4155c10 2023-10-10T21:18:40.011 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:40.011 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:18:40.012 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T21:18:40.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.012 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T21:18:40.012 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T21:18:40.012 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.012 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:18:40.013 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:18:40.013 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:18:40.013 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.014 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T21:18:40.014 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T21:18:40.014 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.014 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:18:40.015 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:18:40.015 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:18:40.015 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.016 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T21:18:40.016 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T21:18:40.016 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.016 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:18:40.016 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:18:40.017 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:18:40.017 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.018 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T21:18:40.018 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T21:18:40.018 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.018 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:18:40.018 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:18:40.019 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:18:40.019 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.019 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.020 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T21:18:40.020 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T21:18:40.020 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.020 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:18:40.020 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:18:40.020 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.021 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T21:18:40.021 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T21:18:40.022 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.022 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:18:40.022 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:18:40.022 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.024 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T21:18:40.024 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T21:18:40.024 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.024 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:18:40.025 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:18:40.025 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.025 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.026 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T21:18:40.026 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T21:18:40.026 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.026 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:18:40.026 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:18:40.027 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.028 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T21:18:40.028 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T21:18:40.028 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.029 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:18:40.029 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:18:40.029 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.030 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T21:18:40.030 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T21:18:40.030 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.030 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:18:40.031 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:18:40.031 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.031 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.032 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T21:18:40.032 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T21:18:40.032 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.032 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:18:40.033 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:18:40.033 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.034 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T21:18:40.034 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T21:18:40.034 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.034 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:18:40.035 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:18:40.035 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.035 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.036 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T21:18:40.036 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T21:18:40.036 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.036 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:18:40.037 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T21:18:40.037 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T21:18:40.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.037 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T21:18:40.038 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T21:18:40.038 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.038 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:18:40.039 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:18:40.039 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:18:40.039 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:18:40.040 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.040 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T21:18:40.041 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T21:18:40.041 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.041 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:18:40.041 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:18:40.041 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:18:40.042 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:18:40.042 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.042 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T21:18:40.043 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T21:18:40.043 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.043 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:18:40.043 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:18:40.043 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:18:40.044 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:18:40.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.044 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T21:18:40.044 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T21:18:40.045 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.045 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:18:40.045 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:18:40.045 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:18:40.045 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.046 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.046 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T21:18:40.046 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T21:18:40.047 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.047 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:18:40.047 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:18:40.047 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.047 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:18:40.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:40.048 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T21:18:40.048 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T21:18:40.048 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:18:40.048 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:18:40.049 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:18:40.049 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:18:40.049 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:40.050 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T21:18:40.050 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:18:40.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feb90066f30 msgr2=0x7feb900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feb90066f30 0x7feb900693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb940058d0 tx=0x7feb940079d0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba4155c10 msgr2=0x7feba4158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba4155c10 0x7feba4158170 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7feb98015000 tx=0x7feb98019000 comp rx=0 tx=0).stop 2023-10-10T21:18:40.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 shutdown_connections 2023-10-10T21:18:40.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7feb90066f30 0x7feb900693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba41578b0 0x7feba413ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba40af2f0 0x7feba414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 --2- 172.21.15.154:0/3828376345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba4155c10 0x7feba4158170 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 >> 172.21.15.154:0/3828376345 conn(0x7feba406a320 msgr2=0x7feba40ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:40.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 shutdown_connections 2023-10-10T21:18:40.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.012+0000 7feba9bff700 1 -- 172.21.15.154:0/3828376345 wait complete. 2023-10-10T21:18:40.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:40.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.236+0000 7ff0a43ff700 1 Processor -- start 2023-10-10T21:18:40.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.236+0000 7ff0a43ff700 1 -- start start 2023-10-10T21:18:40.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a43ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff09c155c10 0x7ff09c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a43ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff09c0ac6d0 0x7ff09c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a43ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c0acac0 con 0x7ff09c0ac230 2023-10-10T21:18:40.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a43ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0ad930 con 0x7ff09c155c10 2023-10-10T21:18:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a43ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0acd20 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a219b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff09c155c10 0x7ff09c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a199a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff09c0ac230 0x7ff09c1568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55950/0 (socket says 172.21.15.154:55950) 2023-10-10T21:18:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a199a700 1 -- 172.21.15.154:0/185713639 learned_addr learned my addr 172.21.15.154:0/185713639 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a219b700 1 -- 172.21.15.154:0/185713639 >> v2:172.21.15.179:3300/0 conn(0x7ff09c0ac6d0 msgr2=0x7ff09c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a299c700 1 --2- 172.21.15.154:0/185713639 >> v2:172.21.15.179:3300/0 conn(0x7ff09c0ac6d0 0x7ff09c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a219b700 1 --2- 172.21.15.154:0/185713639 >> v2:172.21.15.179:3300/0 conn(0x7ff09c0ac6d0 0x7ff09c0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a219b700 1 -- 172.21.15.154:0/185713639 >> v1:172.21.15.154:6789/0 conn(0x7ff09c0ac230 legacy=0x7ff09c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a219b700 1 -- 172.21.15.154:0/185713639 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0ad000 con 0x7ff09c155c10 2023-10-10T21:18:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.238+0000 7ff0a1199700 1 -- 172.21.15.154:0/185713639 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468890101 0 0) 0x7ff09c0acac0 con 0x7ff09c0ac230 2023-10-10T21:18:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.239+0000 7ff0a299c700 1 --2- 172.21.15.154:0/185713639 >> v2:172.21.15.179:3300/0 conn(0x7ff09c0ac6d0 0x7ff09c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.239+0000 7ff0a219b700 1 --2- 172.21.15.154:0/185713639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c155c10 0x7ff09c155fe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0ae0c0 tx=0x7ff09800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb554f06ee1cce15 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.239+0000 7ff0a1199700 1 -- 172.21.15.154:0/185713639 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800c910 con 0x7ff09c155c10 2023-10-10T21:18:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.239+0000 7ff0a1199700 1 -- 172.21.15.154:0/185713639 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800ca70 con 0x7ff09c155c10 2023-10-10T21:18:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.239+0000 7ff0a1199700 1 -- 172.21.15.154:0/185713639 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800ce10 con 0x7ff09c155c10 2023-10-10T21:18:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.239+0000 7ff0a43ff700 1 -- 172.21.15.154:0/185713639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c155c10 msgr2=0x7ff09c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.239+0000 7ff0a43ff700 1 --2- 172.21.15.154:0/185713639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c155c10 0x7ff09c155fe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0ae0c0 tx=0x7ff09800a330 comp rx=0 tx=0).stop 2023-10-10T21:18:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.240+0000 7ff0a43ff700 1 -- 172.21.15.154:0/185713639 shutdown_connections 2023-10-10T21:18:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.240+0000 7ff0a43ff700 1 --2- 172.21.15.154:0/185713639 >> v2:172.21.15.179:3300/0 conn(0x7ff09c0ac6d0 0x7ff09c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.240+0000 7ff0a43ff700 1 --2- 172.21.15.154:0/185713639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c155c10 0x7ff09c155fe0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.240+0000 7ff0a43ff700 1 -- 172.21.15.154:0/185713639 >> 172.21.15.154:0/185713639 conn(0x7ff09c06a320 msgr2=0x7ff09c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.240+0000 7ff0a43ff700 1 -- 172.21.15.154:0/185713639 shutdown_connections 2023-10-10T21:18:40.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.240+0000 7ff0a43ff700 1 -- 172.21.15.154:0/185713639 wait complete. 2023-10-10T21:18:40.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.241+0000 7ff0a43ff700 1 Processor -- start 2023-10-10T21:18:40.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.241+0000 7ff0a43ff700 1 -- start start 2023-10-10T21:18:40.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.242+0000 7ff0a43ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09c0ac230 0x7ff09c0a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.242+0000 7ff0a43ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c0ac6d0 0x7ff09c169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.242+0000 7ff0a43ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09c155c10 0x7ff09c0a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.242+0000 7ff0a43ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c153a70 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.242+0000 7ff0a43ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0a6a50 con 0x7ff09c155c10 2023-10-10T21:18:40.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.242+0000 7ff0a43ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c150890 con 0x7ff09c0ac230 2023-10-10T21:18:40.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.242+0000 7ff0a199a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c0ac6d0 0x7ff09c169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a199a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c0ac6d0 0x7ff09c169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52532/0 (socket says 172.21.15.154:52532) 2023-10-10T21:18:40.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a199a700 1 -- 172.21.15.154:0/594856777 learned_addr learned my addr 172.21.15.154:0/594856777 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:40.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a219b700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09c0ac230 0x7ff09c0a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a299c700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09c155c10 0x7ff09c0a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a199a700 1 -- 172.21.15.154:0/594856777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09c0ac230 msgr2=0x7ff09c0a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a199a700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09c0ac230 0x7ff09c0a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a199a700 1 -- 172.21.15.154:0/594856777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09c155c10 msgr2=0x7ff09c0a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a199a700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09c155c10 0x7ff09c0a7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a199a700 1 -- 172.21.15.154:0/594856777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09800a5d0 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0a199a700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c0ac6d0 0x7ff09c169ae0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c7e0 tx=0x7ff08c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:40.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0927fc700 1 -- 172.21.15.154:0/594856777 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c005b30 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.243+0000 7ff0927fc700 1 -- 172.21.15.154:0/594856777 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c005c90 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.244+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09c150b70 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.244+0000 7ff0927fc700 1 -- 172.21.15.154:0/594856777 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c007300 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.244+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c151130 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.245+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c151320 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.245+0000 7ff0927fc700 1 -- 172.21.15.154:0/594856777 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff08c01b400 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.246+0000 7ff0927fc700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff080066f30 0x7ff0800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.246+0000 7ff0927fc700 1 -- 172.21.15.154:0/594856777 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5245+0+0 (secure 0 0 0) 0x7ff08c083f70 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.247+0000 7ff0a219b700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff080066f30 0x7ff0800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.247+0000 7ff0a219b700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff080066f30 0x7ff0800693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff09800a5a0 tx=0x7ff098017000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:40.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.251+0000 7ff0927fc700 1 -- 172.21.15.154:0/594856777 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff08c051390 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.444+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff09c04c3c0 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.445+0000 7ff0927fc700 1 -- 172.21.15.154:0/594856777 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+12779 (secure 0 0 0) 0x7ff08c0549b0 con 0x7ff09c0ac6d0 2023-10-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":105,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:39.519186+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff080066f30 msgr2=0x7ff0800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff080066f30 0x7ff0800693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff09800a5a0 tx=0x7ff098017000 comp rx=0 tx=0).stop 2023-10-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c0ac6d0 msgr2=0x7ff09c169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c0ac6d0 0x7ff09c169ae0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c7e0 tx=0x7ff08c007df0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 shutdown_connections 2023-10-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff080066f30 0x7ff0800693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09c155c10 0x7ff09c0a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09c0ac230 0x7ff09c0a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 --2- 172.21.15.154:0/594856777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff09c0ac6d0 0x7ff09c169ae0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 >> 172.21.15.154:0/594856777 conn(0x7ff09c06a320 msgr2=0x7ff09c0aa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 shutdown_connections 2023-10-10T21:18:40.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.448+0000 7ff0a43ff700 1 -- 172.21.15.154:0/594856777 wait complete. 2023-10-10T21:18:40.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T21:18:40.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:18:40.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.652+0000 7f9da63ff700 1 Processor -- start 2023-10-10T21:18:40.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.653+0000 7f9da63ff700 1 -- start start 2023-10-10T21:18:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.654+0000 7f9da63ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9da00c83f0 0x7f9da00c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.654+0000 7f9da63ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00ccee0 0x7f9da01561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.654+0000 7f9da63ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da015b0d0 con 0x7f9da00c87c0 2023-10-10T21:18:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.654+0000 7f9da63ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da00c7a60 con 0x7f9da00c83f0 2023-10-10T21:18:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.654+0000 7f9da63ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da015a4c0 con 0x7f9da00ccee0 2023-10-10T21:18:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.654+0000 7f9d9ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9da00c83f0 0x7f9da00c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.654+0000 7f9d9ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9da00c83f0 0x7f9da00c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52540/0 (socket says 172.21.15.154:52540) 2023-10-10T21:18:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.654+0000 7f9da499c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9da00c87c0 0x7f9da006eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55956/0 (socket says 172.21.15.154:55956) 2023-10-10T21:18:40.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.654+0000 7f9d9ffff700 1 -- 172.21.15.154:0/2553177732 learned_addr learned my addr 172.21.15.154:0/2553177732 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:40.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.655+0000 7f9d9ffff700 1 -- 172.21.15.154:0/2553177732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00ccee0 msgr2=0x7f9da01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:40.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.655+0000 7f9d9ffff700 1 --2- 172.21.15.154:0/2553177732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00ccee0 0x7f9da01561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.655+0000 7f9d9ffff700 1 -- 172.21.15.154:0/2553177732 >> v1:172.21.15.154:6789/0 conn(0x7f9da00c87c0 legacy=0x7f9da006eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.655+0000 7f9d9ffff700 1 -- 172.21.15.154:0/2553177732 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da015a7a0 con 0x7f9da00c83f0 2023-10-10T21:18:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.655+0000 7f9d9effd700 1 -- 172.21.15.154:0/2553177732 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223909410 0 0) 0x7f9da015b0d0 con 0x7f9da00c87c0 2023-10-10T21:18:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.655+0000 7f9d9ffff700 1 --2- 172.21.15.154:0/2553177732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00c83f0 0x7f9da00c7520 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009f20 tx=0x7f9d90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3eb737ffe3f612 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.655+0000 7f9d9effd700 1 -- 172.21.15.154:0/2553177732 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000e070 con 0x7f9da00c83f0 2023-10-10T21:18:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.655+0000 7f9d9effd700 1 -- 172.21.15.154:0/2553177732 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9000ba80 con 0x7f9da00c83f0 2023-10-10T21:18:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.655+0000 7f9d9effd700 1 -- 172.21.15.154:0/2553177732 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900092e0 con 0x7f9da00c83f0 2023-10-10T21:18:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.656+0000 7f9da63ff700 1 -- 172.21.15.154:0/2553177732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00c83f0 msgr2=0x7f9da00c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.656+0000 7f9da63ff700 1 --2- 172.21.15.154:0/2553177732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00c83f0 0x7f9da00c7520 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009f20 tx=0x7f9d90009840 comp rx=0 tx=0).stop 2023-10-10T21:18:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.656+0000 7f9da63ff700 1 -- 172.21.15.154:0/2553177732 shutdown_connections 2023-10-10T21:18:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.656+0000 7f9da63ff700 1 --2- 172.21.15.154:0/2553177732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00c83f0 0x7f9da00c7520 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.656+0000 7f9da63ff700 1 --2- 172.21.15.154:0/2553177732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00ccee0 0x7f9da01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.656+0000 7f9da63ff700 1 -- 172.21.15.154:0/2553177732 >> 172.21.15.154:0/2553177732 conn(0x7f9da0068e10 msgr2=0x7f9da00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:40.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.656+0000 7f9da63ff700 1 -- 172.21.15.154:0/2553177732 shutdown_connections 2023-10-10T21:18:40.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.656+0000 7f9da63ff700 1 -- 172.21.15.154:0/2553177732 wait complete. 2023-10-10T21:18:40.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.657+0000 7f9da63ff700 1 Processor -- start 2023-10-10T21:18:40.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.657+0000 7f9da63ff700 1 -- start start 2023-10-10T21:18:40.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.658+0000 7f9da63ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00c83f0 0x7f9da00b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.658+0000 7f9da63ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00c87c0 0x7f9da00b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.658+0000 7f9da63ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00ccee0 0x7f9da013ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.658+0000 7f9da63ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da016a2f0 con 0x7f9da00ccee0 2023-10-10T21:18:40.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.658+0000 7f9da63ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00b0990 con 0x7f9da00c87c0 2023-10-10T21:18:40.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.658+0000 7f9da63ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0169fa0 con 0x7f9da00c83f0 2023-10-10T21:18:40.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9da499c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00ccee0 0x7f9da013ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9da499c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00ccee0 0x7f9da013ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52544/0 (socket says 172.21.15.154:52544) 2023-10-10T21:18:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9da499c700 1 -- 172.21.15.154:0/3167461865 learned_addr learned my addr 172.21.15.154:0/3167461865 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9d9ffff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00c83f0 0x7f9da00b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9d9f7fe700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00c87c0 0x7f9da00b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9da499c700 1 -- 172.21.15.154:0/3167461865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00c83f0 msgr2=0x7f9da00b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9da499c700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00c83f0 0x7f9da00b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9da499c700 1 -- 172.21.15.154:0/3167461865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00c87c0 msgr2=0x7f9da00b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9da499c700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00c87c0 0x7f9da00b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9da499c700 1 -- 172.21.15.154:0/3167461865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d90009ae0 con 0x7f9da00ccee0 2023-10-10T21:18:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9d9f7fe700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00c87c0 0x7f9da00b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.659+0000 7f9da499c700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00ccee0 0x7f9da013ce40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9d98001eb0 tx=0x7f9d98007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.660+0000 7f9d87fff700 1 -- 172.21.15.154:0/3167461865 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98005a70 con 0x7f9da00ccee0 2023-10-10T21:18:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.660+0000 7f9d87fff700 1 -- 172.21.15.154:0/3167461865 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d98005bd0 con 0x7f9da00ccee0 2023-10-10T21:18:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.660+0000 7f9d87fff700 1 -- 172.21.15.154:0/3167461865 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980070d0 con 0x7f9da00ccee0 2023-10-10T21:18:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.660+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da00b0c30 con 0x7f9da00ccee0 2023-10-10T21:18:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.660+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da00b11f0 con 0x7f9da00ccee0 2023-10-10T21:18:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.661+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da004c3c0 con 0x7f9da00ccee0 2023-10-10T21:18:40.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.662+0000 7f9d87fff700 1 -- 172.21.15.154:0/3167461865 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d98007480 con 0x7f9da00ccee0 2023-10-10T21:18:40.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.662+0000 7f9d87fff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d8c066f30 0x7f9d8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:40.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.663+0000 7f9d87fff700 1 -- 172.21.15.154:0/3167461865 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f9d980837e0 con 0x7f9da00ccee0 2023-10-10T21:18:40.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.663+0000 7f9d9ffff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d8c066f30 0x7f9d8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:40.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.663+0000 7f9d9ffff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d8c066f30 0x7f9d8c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009880 tx=0x7f9d90018000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:40.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.666+0000 7f9d87fff700 1 -- 172.21.15.154:0/3167461865 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d98050c20 con 0x7f9da00ccee0 2023-10-10T21:18:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.857+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9da015aa80 con 0x7f9da00ccee0 2023-10-10T21:18:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.857+0000 7f9d87fff700 1 -- 172.21.15.154:0/3167461865 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d98017070 con 0x7f9da00ccee0 2023-10-10T21:18:40.859 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:18:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d8c066f30 msgr2=0x7f9d8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d8c066f30 0x7f9d8c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009880 tx=0x7f9d90018000 comp rx=0 tx=0).stop 2023-10-10T21:18:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00ccee0 msgr2=0x7f9da013ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00ccee0 0x7f9da013ce40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9d98001eb0 tx=0x7f9d98007d10 comp rx=0 tx=0).stop 2023-10-10T21:18:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 shutdown_connections 2023-10-10T21:18:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da00ccee0 0x7f9da013ce40 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00c83f0 0x7f9da00b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d8c066f30 0x7f9d8c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 --2- 172.21.15.154:0/3167461865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00c87c0 0x7f9da00b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:40.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 >> 172.21.15.154:0/3167461865 conn(0x7f9da0068e10 msgr2=0x7f9da00c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:40.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 shutdown_connections 2023-10-10T21:18:40.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:40.860+0000 7f9da63ff700 1 -- 172.21.15.154:0/3167461865 wait complete. 2023-10-10T21:18:40.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T21:18:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.061+0000 7f793299d700 1 Processor -- start 2023-10-10T21:18:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.062+0000 7f793299d700 1 -- start start 2023-10-10T21:18:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.063+0000 7f793299d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f792c159420 0x7f792c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.063+0000 7f793299d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f792c1597f0 0x7f792c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.063+0000 7f793299d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c0b11d0 con 0x7f792c15d230 2023-10-10T21:18:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.063+0000 7f793299d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c0b14b0 con 0x7f792c1597f0 2023-10-10T21:18:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.063+0000 7f793299d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c0b1790 con 0x7f792c159420 2023-10-10T21:18:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.063+0000 7f793119a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f792c1597f0 0x7f792c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.063+0000 7f793219c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f792c15d230 0x7f792c15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55966/0 (socket says 172.21.15.154:55966) 2023-10-10T21:18:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.063+0000 7f793219c700 1 -- 172.21.15.154:0/412077846 learned_addr learned my addr 172.21.15.154:0/412077846 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f793199b700 1 --2- 172.21.15.154:0/412077846 >> v2:172.21.15.179:3300/0 conn(0x7f792c159420 0x7f792c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f793119a700 1 -- 172.21.15.154:0/412077846 >> v2:172.21.15.179:3300/0 conn(0x7f792c159420 msgr2=0x7f792c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f793119a700 1 --2- 172.21.15.154:0/412077846 >> v2:172.21.15.179:3300/0 conn(0x7f792c159420 0x7f792c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f793119a700 1 -- 172.21.15.154:0/412077846 >> v1:172.21.15.154:6789/0 conn(0x7f792c15d230 legacy=0x7f792c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f793119a700 1 -- 172.21.15.154:0/412077846 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c0b1a70 con 0x7f792c1597f0 2023-10-10T21:18:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f7930999700 1 -- 172.21.15.154:0/412077846 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711014301 0 0) 0x7f792c0b11d0 con 0x7f792c15d230 2023-10-10T21:18:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f793119a700 1 --2- 172.21.15.154:0/412077846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c1597f0 0x7f792c0b2270 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f792c0b2f20 tx=0x7f791c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e75af7ac6d27484 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f7930999700 1 -- 172.21.15.154:0/412077846 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00b6b0 con 0x7f792c1597f0 2023-10-10T21:18:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f7930999700 1 -- 172.21.15.154:0/412077846 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00b810 con 0x7f792c1597f0 2023-10-10T21:18:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.064+0000 7f7930999700 1 -- 172.21.15.154:0/412077846 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00bbb0 con 0x7f792c1597f0 2023-10-10T21:18:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.065+0000 7f793299d700 1 -- 172.21.15.154:0/412077846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c1597f0 msgr2=0x7f792c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.065+0000 7f793299d700 1 --2- 172.21.15.154:0/412077846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c1597f0 0x7f792c0b2270 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f792c0b2f20 tx=0x7f791c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.065+0000 7f793299d700 1 -- 172.21.15.154:0/412077846 shutdown_connections 2023-10-10T21:18:41.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.065+0000 7f793299d700 1 --2- 172.21.15.154:0/412077846 >> v2:172.21.15.179:3300/0 conn(0x7f792c159420 0x7f792c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.065+0000 7f793299d700 1 --2- 172.21.15.154:0/412077846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c1597f0 0x7f792c0b2270 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.065+0000 7f793299d700 1 -- 172.21.15.154:0/412077846 >> 172.21.15.154:0/412077846 conn(0x7f792c0d0660 msgr2=0x7f792c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:41.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.065+0000 7f793299d700 1 -- 172.21.15.154:0/412077846 shutdown_connections 2023-10-10T21:18:41.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.065+0000 7f793299d700 1 -- 172.21.15.154:0/412077846 wait complete. 2023-10-10T21:18:41.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.066+0000 7f793299d700 1 Processor -- start 2023-10-10T21:18:41.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.067+0000 7f793299d700 1 -- start start 2023-10-10T21:18:41.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.067+0000 7f793299d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c159420 0x7f792c15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.067+0000 7f793299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792c1597f0 0x7f792c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.067+0000 7f793299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f792c15d230 0x7f792c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.067+0000 7f793299d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c15cc80 con 0x7f792c159420 2023-10-10T21:18:41.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.067+0000 7f793299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c16a9b0 con 0x7f792c15d230 2023-10-10T21:18:41.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.067+0000 7f793299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c1699b0 con 0x7f792c1597f0 2023-10-10T21:18:41.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c159420 0x7f792c15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c159420 0x7f792c15c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52556/0 (socket says 172.21.15.154:52556) 2023-10-10T21:18:41.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793199b700 1 -- 172.21.15.154:0/3856488477 learned_addr learned my addr 172.21.15.154:0/3856488477 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:41.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793219c700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f792c15d230 0x7f792c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793199b700 1 -- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792c1597f0 msgr2=0x7f792c153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793119a700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792c1597f0 0x7f792c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793199b700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792c1597f0 0x7f792c153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793199b700 1 -- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f792c15d230 msgr2=0x7f792c0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793199b700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f792c15d230 0x7f792c0c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793199b700 1 -- 172.21.15.154:0/3856488477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009420 con 0x7f792c159420 2023-10-10T21:18:41.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793219c700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f792c15d230 0x7f792c0c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:41.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793119a700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792c1597f0 0x7f792c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:41.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f793199b700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c159420 0x7f792c15c3a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f792800d8c0 tx=0x7f7928008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:41.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f7921ffb700 1 -- 172.21.15.154:0/3856488477 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800b570 con 0x7f792c159420 2023-10-10T21:18:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.068+0000 7f7921ffb700 1 -- 172.21.15.154:0/3856488477 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792800b6d0 con 0x7f792c159420 2023-10-10T21:18:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.069+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c169bf0 con 0x7f792c159420 2023-10-10T21:18:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.069+0000 7f7921ffb700 1 -- 172.21.15.154:0/3856488477 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800ba70 con 0x7f792c159420 2023-10-10T21:18:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.069+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c16a490 con 0x7f792c159420 2023-10-10T21:18:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.070+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c169de0 con 0x7f792c159420 2023-10-10T21:18:41.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.070+0000 7f7921ffb700 1 -- 172.21.15.154:0/3856488477 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f792801e460 con 0x7f792c159420 2023-10-10T21:18:41.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.071+0000 7f7921ffb700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7910066f30 0x7f79100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.071+0000 7f7921ffb700 1 -- 172.21.15.154:0/3856488477 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f7928084970 con 0x7f792c159420 2023-10-10T21:18:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.072+0000 7f793119a700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7910066f30 0x7f79100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.072+0000 7f793119a700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7910066f30 0x7f79100693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f792c159c70 tx=0x7f791c017000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.076+0000 7f7921ffb700 1 -- 172.21.15.154:0/3856488477 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7928051db0 con 0x7f792c159420 2023-10-10T21:18:41.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.271+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f792c0b1d50 con 0x7f792c159420 2023-10-10T21:18:41.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.271+0000 7f7921ffb700 1 -- 172.21.15.154:0/3856488477 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v105) v1 ==== 84+0+65 (secure 0 0 0) 0x7f79280553d0 con 0x7f792c159420 2023-10-10T21:18:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:41.273 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:18:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T21:18:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T21:18:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:41.274 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:18:41.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7910066f30 msgr2=0x7f79100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7910066f30 0x7f79100693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f792c159c70 tx=0x7f791c017000 comp rx=0 tx=0).stop 2023-10-10T21:18:41.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c159420 msgr2=0x7f792c15c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c159420 0x7f792c15c3a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f792800d8c0 tx=0x7f7928008040 comp rx=0 tx=0).stop 2023-10-10T21:18:41.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 shutdown_connections 2023-10-10T21:18:41.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7910066f30 0x7f79100693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f792c15d230 0x7f792c0c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f792c159420 0x7f792c15c3a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 --2- 172.21.15.154:0/3856488477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792c1597f0 0x7f792c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 >> 172.21.15.154:0/3856488477 conn(0x7f792c0d0660 msgr2=0x7f792c0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:41.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 shutdown_connections 2023-10-10T21:18:41.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.274+0000 7f793299d700 1 -- 172.21.15.154:0/3856488477 wait complete. 2023-10-10T21:18:41.292 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T21:18:41.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T21:18:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.481+0000 7f28fb3ff700 1 Processor -- start 2023-10-10T21:18:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.481+0000 7f28fb3ff700 1 -- start start 2023-10-10T21:18:41.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28fb3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 0x7f28f40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28fb3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28f40c8490 0x7f28f415a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28fb3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f40ac030 con 0x7f28f4069e20 2023-10-10T21:18:41.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28fb3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40ab820 con 0x7f28f40c8490 2023-10-10T21:18:41.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28fb3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f406dbb0 con 0x7f28f4069a50 2023-10-10T21:18:41.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28f899a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28f40c8490 0x7f28f415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28f999c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f28f4069e20 0x7f28f406e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55976/0 (socket says 172.21.15.154:55976) 2023-10-10T21:18:41.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28f999c700 1 -- 172.21.15.154:0/2848428257 learned_addr learned my addr 172.21.15.154:0/2848428257 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:41.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28f919b700 1 --2- 172.21.15.154:0/2848428257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 0x7f28f40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.483+0000 7f28f899a700 1 -- 172.21.15.154:0/2848428257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 msgr2=0x7f28f40c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:41.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.484+0000 7f28f899a700 1 --2- 172.21.15.154:0/2848428257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 0x7f28f40c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.484+0000 7f28f899a700 1 -- 172.21.15.154:0/2848428257 >> v1:172.21.15.154:6789/0 conn(0x7f28f4069e20 legacy=0x7f28f406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.484+0000 7f28f899a700 1 -- 172.21.15.154:0/2848428257 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f415a9d0 con 0x7f28f40c8490 2023-10-10T21:18:41.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.484+0000 7f28ebfff700 1 -- 172.21.15.154:0/2848428257 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897070734 0 0) 0x7f28ec001110 con 0x7f28f4069e20 2023-10-10T21:18:41.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.484+0000 7f28f899a700 1 --2- 172.21.15.154:0/2848428257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f40c8490 0x7f28f415a490 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009910 tx=0x7f28e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0d1242a022609 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.484+0000 7f28ebfff700 1 -- 172.21.15.154:0/2848428257 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400b820 con 0x7f28f40c8490 2023-10-10T21:18:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.484+0000 7f28ebfff700 1 -- 172.21.15.154:0/2848428257 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400b980 con 0x7f28f40c8490 2023-10-10T21:18:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.484+0000 7f28ebfff700 1 -- 172.21.15.154:0/2848428257 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400bd20 con 0x7f28f40c8490 2023-10-10T21:18:41.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.485+0000 7f28fb3ff700 1 -- 172.21.15.154:0/2848428257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f40c8490 msgr2=0x7f28f415a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.485+0000 7f28fb3ff700 1 --2- 172.21.15.154:0/2848428257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f40c8490 0x7f28f415a490 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009910 tx=0x7f28e40091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.485+0000 7f28fb3ff700 1 -- 172.21.15.154:0/2848428257 shutdown_connections 2023-10-10T21:18:41.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.485+0000 7f28fb3ff700 1 --2- 172.21.15.154:0/2848428257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 0x7f28f40c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.485+0000 7f28fb3ff700 1 --2- 172.21.15.154:0/2848428257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f40c8490 0x7f28f415a490 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.485+0000 7f28fb3ff700 1 -- 172.21.15.154:0/2848428257 >> 172.21.15.154:0/2848428257 conn(0x7f28f40c8f90 msgr2=0x7f28f40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:41.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.485+0000 7f28fb3ff700 1 -- 172.21.15.154:0/2848428257 shutdown_connections 2023-10-10T21:18:41.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.485+0000 7f28fb3ff700 1 -- 172.21.15.154:0/2848428257 wait complete. 2023-10-10T21:18:41.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.486+0000 7f28fb3ff700 1 Processor -- start 2023-10-10T21:18:41.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.486+0000 7f28fb3ff700 1 -- start start 2023-10-10T21:18:41.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.487+0000 7f28fb3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 0x7f28f40c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.487+0000 7f28fb3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f4069e20 0x7f28f40b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.487+0000 7f28fb3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f40c8490 0x7f28f40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.487+0000 7f28fb3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c5580 con 0x7f28f4069e20 2023-10-10T21:18:41.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.487+0000 7f28fb3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c4970 con 0x7f28f40c8490 2023-10-10T21:18:41.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.487+0000 7f28fb3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c4c50 con 0x7f28f4069a50 2023-10-10T21:18:41.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.487+0000 7f28f899a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f4069e20 0x7f28f40b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.487+0000 7f28f899a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f4069e20 0x7f28f40b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52588/0 (socket says 172.21.15.154:52588) 2023-10-10T21:18:41.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.487+0000 7f28f899a700 1 -- 172.21.15.154:0/3464118641 learned_addr learned my addr 172.21.15.154:0/3464118641 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:41.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28f999c700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f40c8490 0x7f28f40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28f919b700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 0x7f28f40c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28f899a700 1 -- 172.21.15.154:0/3464118641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 msgr2=0x7f28f40c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28f899a700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 0x7f28f40c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28f899a700 1 -- 172.21.15.154:0/3464118641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f40c8490 msgr2=0x7f28f40ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:41.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28f899a700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f40c8490 0x7f28f40ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:41.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28f899a700 1 -- 172.21.15.154:0/3464118641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4009420 con 0x7f28f4069e20 2023-10-10T21:18:41.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28f899a700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f4069e20 0x7f28f40b1ae0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f28e400b3c0 tx=0x7f28e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:41.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28e97fa700 1 -- 172.21.15.154:0/3464118641 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e401a420 con 0x7f28f4069e20 2023-10-10T21:18:41.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28e97fa700 1 -- 172.21.15.154:0/3464118641 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e401a580 con 0x7f28f4069e20 2023-10-10T21:18:41.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28e97fa700 1 -- 172.21.15.154:0/3464118641 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e401a920 con 0x7f28f4069e20 2023-10-10T21:18:41.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f40c4f30 con 0x7f28f4069e20 2023-10-10T21:18:41.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.488+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f40b2020 con 0x7f28f4069e20 2023-10-10T21:18:41.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.489+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f40718b0 con 0x7f28f4069e20 2023-10-10T21:18:41.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.490+0000 7f28e97fa700 1 -- 172.21.15.154:0/3464118641 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28e401ad10 con 0x7f28f4069e20 2023-10-10T21:18:41.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.491+0000 7f28e97fa700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f28d8066f30 0x7f28d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:41.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.491+0000 7f28e97fa700 1 -- 172.21.15.154:0/3464118641 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f28e4085a00 con 0x7f28f4069e20 2023-10-10T21:18:41.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.491+0000 7f28f919b700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f28d8066f30 0x7f28d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:41.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.492+0000 7f28f919b700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f28d8066f30 0x7f28d80693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f28f00074f0 tx=0x7f28f0009700 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:41.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.495+0000 7f28e97fa700 1 -- 172.21.15.154:0/3464118641 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28e4052e20 con 0x7f28f4069e20 2023-10-10T21:18:41.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:41.687+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f28f415a170 con 0x7f28f4069e20 2023-10-10T21:18:42.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.106+0000 7f28e97fa700 1 -- 172.21.15.154:0/3464118641 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v106) v1 ==== 138+0+0 (secure 0 0 0) 0x7f28e4056440 con 0x7f28f4069e20 2023-10-10T21:18:42.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.110+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f28d8066f30 msgr2=0x7f28d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:42.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.110+0000 7f28fb3ff700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f28d8066f30 0x7f28d80693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f28f00074f0 tx=0x7f28f0009700 comp rx=0 tx=0).stop 2023-10-10T21:18:42.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.110+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f4069e20 msgr2=0x7f28f40b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:42.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.110+0000 7f28fb3ff700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f4069e20 0x7f28f40b1ae0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f28e400b3c0 tx=0x7f28e4017000 comp rx=0 tx=0).stop 2023-10-10T21:18:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.112+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 shutdown_connections 2023-10-10T21:18:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.112+0000 7f28fb3ff700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f28d8066f30 0x7f28d80693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.112+0000 7f28fb3ff700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f40c8490 0x7f28f40ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.112+0000 7f28fb3ff700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f4069a50 0x7f28f40c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.112+0000 7f28fb3ff700 1 --2- 172.21.15.154:0/3464118641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f4069e20 0x7f28f40b1ae0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.112+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 >> 172.21.15.154:0/3464118641 conn(0x7f28f40c8f90 msgr2=0x7f28f4068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.112+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 shutdown_connections 2023-10-10T21:18:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.112+0000 7f28fb3ff700 1 -- 172.21.15.154:0/3464118641 wait complete. 2023-10-10T21:18:42.116 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T21:18:42.133 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T21:18:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.322+0000 7f1b25b9d700 1 Processor -- start 2023-10-10T21:18:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.322+0000 7f1b25b9d700 1 -- start start 2023-10-10T21:18:42.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b25b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1b200c7840 0x7f1b20159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:42.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b25b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b200c7c10 0x7f1b20159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:42.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b25b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 0x7f1b2006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:42.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b25b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200c7220 con 0x7f1b200c7c10 2023-10-10T21:18:42.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b25b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2006e510 con 0x7f1b200c7840 2023-10-10T21:18:42.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b25b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2006df20 con 0x7f1b2015a3a0 2023-10-10T21:18:42.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b1ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b200c7c10 0x7f1b20159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:42.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b1ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b200c7c10 0x7f1b20159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52604/0 (socket says 172.21.15.154:52604) 2023-10-10T21:18:42.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b1ffff700 1 -- 172.21.15.154:0/722066269 learned_addr learned my addr 172.21.15.154:0/722066269 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:42.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b24b9b700 1 --2- 172.21.15.154:0/722066269 >> v2:172.21.15.179:3300/0 conn(0x7f1b200c7840 0x7f1b20159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:42.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.323+0000 7f1b2539c700 1 --2- 172.21.15.154:0/722066269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 0x7f1b2006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:42.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b1ffff700 1 -- 172.21.15.154:0/722066269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 msgr2=0x7f1b2006e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:42.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b1ffff700 1 --2- 172.21.15.154:0/722066269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 0x7f1b2006e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b1ffff700 1 -- 172.21.15.154:0/722066269 >> v2:172.21.15.179:3300/0 conn(0x7f1b200c7840 msgr2=0x7f1b20159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:42.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b1ffff700 1 --2- 172.21.15.154:0/722066269 >> v2:172.21.15.179:3300/0 conn(0x7f1b200c7840 0x7f1b20159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b1ffff700 1 -- 172.21.15.154:0/722066269 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b20157040 con 0x7f1b200c7c10 2023-10-10T21:18:42.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b24b9b700 1 --2- 172.21.15.154:0/722066269 >> v2:172.21.15.179:3300/0 conn(0x7f1b200c7840 0x7f1b20159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:42.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b1ffff700 1 --2- 172.21.15.154:0/722066269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 0x7f1b20159e60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1b2006c110 tx=0x7f1b0c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5712841624f311eb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:42.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b1f7fe700 1 -- 172.21.15.154:0/722066269 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c00dce0 con 0x7f1b200c7c10 2023-10-10T21:18:42.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b1f7fe700 1 -- 172.21.15.154:0/722066269 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c00de40 con 0x7f1b200c7c10 2023-10-10T21:18:42.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.324+0000 7f1b1f7fe700 1 -- 172.21.15.154:0/722066269 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0196d0 con 0x7f1b200c7c10 2023-10-10T21:18:42.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.325+0000 7f1b25b9d700 1 -- 172.21.15.154:0/722066269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 msgr2=0x7f1b20159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:42.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.325+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/722066269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 0x7f1b20159e60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1b2006c110 tx=0x7f1b0c00b4f0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.325+0000 7f1b25b9d700 1 -- 172.21.15.154:0/722066269 shutdown_connections 2023-10-10T21:18:42.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.325+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/722066269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 0x7f1b2006e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.325+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/722066269 >> v2:172.21.15.179:3300/0 conn(0x7f1b200c7840 0x7f1b20159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.325+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/722066269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 0x7f1b20159e60 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.325+0000 7f1b25b9d700 1 -- 172.21.15.154:0/722066269 >> 172.21.15.154:0/722066269 conn(0x7f1b20068e20 msgr2=0x7f1b200cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:42.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.325+0000 7f1b25b9d700 1 -- 172.21.15.154:0/722066269 shutdown_connections 2023-10-10T21:18:42.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.325+0000 7f1b25b9d700 1 -- 172.21.15.154:0/722066269 wait complete. 2023-10-10T21:18:42.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.326+0000 7f1b25b9d700 1 Processor -- start 2023-10-10T21:18:42.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.326+0000 7f1b25b9d700 1 -- start start 2023-10-10T21:18:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.327+0000 7f1b25b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b200c7840 0x7f1b2016e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.327+0000 7f1b25b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 0x7f1b20147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.327+0000 7f1b25b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 0x7f1b200c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.327+0000 7f1b25b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c36e0 con 0x7f1b200c7c10 2023-10-10T21:18:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.327+0000 7f1b25b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2016a0d0 con 0x7f1b200c7840 2023-10-10T21:18:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.327+0000 7f1b25b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c6a80 con 0x7f1b2015a3a0 2023-10-10T21:18:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 0x7f1b20147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 0x7f1b20147e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52608/0 (socket says 172.21.15.154:52608) 2023-10-10T21:18:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1ffff700 1 -- 172.21.15.154:0/2315642812 learned_addr learned my addr 172.21.15.154:0/2315642812 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b24b9b700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b200c7840 0x7f1b2016e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b2539c700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 0x7f1b200c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1ffff700 1 -- 172.21.15.154:0/2315642812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 msgr2=0x7f1b200c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1ffff700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 0x7f1b200c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1ffff700 1 -- 172.21.15.154:0/2315642812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b200c7840 msgr2=0x7f1b2016e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1ffff700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b200c7840 0x7f1b2016e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1ffff700 1 -- 172.21.15.154:0/2315642812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c00b790 con 0x7f1b200c7c10 2023-10-10T21:18:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b24b9b700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b200c7840 0x7f1b2016e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1ffff700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 0x7f1b20147e20 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f1b20064f90 tx=0x7f1b0c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.328+0000 7f1b1cff9700 1 -- 172.21.15.154:0/2315642812 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c010640 con 0x7f1b200c7c10 2023-10-10T21:18:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.329+0000 7f1b1cff9700 1 -- 172.21.15.154:0/2315642812 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c010800 con 0x7f1b200c7c10 2023-10-10T21:18:42.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.329+0000 7f1b1cff9700 1 -- 172.21.15.154:0/2315642812 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c010bc0 con 0x7f1b200c7c10 2023-10-10T21:18:42.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.329+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b200c5bb0 con 0x7f1b200c7c10 2023-10-10T21:18:42.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.329+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b200c6170 con 0x7f1b200c7c10 2023-10-10T21:18:42.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.330+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b200c3850 con 0x7f1b200c7c10 2023-10-10T21:18:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.331+0000 7f1b1cff9700 1 -- 172.21.15.154:0/2315642812 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b0c020070 con 0x7f1b200c7c10 2023-10-10T21:18:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.332+0000 7f1b1cff9700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1b04066f30 0x7f1b040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.332+0000 7f1b1cff9700 1 -- 172.21.15.154:0/2315642812 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f1b0c014070 con 0x7f1b200c7c10 2023-10-10T21:18:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.332+0000 7f1b24b9b700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1b04066f30 0x7f1b040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.332+0000 7f1b24b9b700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1b04066f30 0x7f1b040693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1b14006f00 tx=0x7f1b14008040 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:42.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.336+0000 7f1b1cff9700 1 -- 172.21.15.154:0/2315642812 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b0c053190 con 0x7f1b200c7c10 2023-10-10T21:18:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:42.528+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1b2004c3c0 con 0x7f1b200c7c10 2023-10-10T21:18:43.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.111+0000 7f1b1cff9700 1 -- 172.21.15.154:0/2315642812 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v107) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1b0c0567b0 con 0x7f1b200c7c10 2023-10-10T21:18:43.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.120+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1b04066f30 msgr2=0x7f1b040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:43.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.120+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1b04066f30 0x7f1b040693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1b14006f00 tx=0x7f1b14008040 comp rx=0 tx=0).stop 2023-10-10T21:18:43.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.120+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 msgr2=0x7f1b20147e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:43.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.120+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 0x7f1b20147e20 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f1b20064f90 tx=0x7f1b0c01b000 comp rx=0 tx=0).stop 2023-10-10T21:18:43.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.123+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 shutdown_connections 2023-10-10T21:18:43.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.123+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b2015a3a0 0x7f1b200c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:43.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.123+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1b04066f30 0x7f1b040693e0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1b14006f00 tx=0x7f1b14008040 comp rx=0 tx=0).stop 2023-10-10T21:18:43.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.123+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b200c7840 0x7f1b2016e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:43.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.123+0000 7f1b25b9d700 1 --2- 172.21.15.154:0/2315642812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b200c7c10 0x7f1b20147e20 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:43.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.123+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 >> 172.21.15.154:0/2315642812 conn(0x7f1b20068e20 msgr2=0x7f1b201589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:43.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.125+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 shutdown_connections 2023-10-10T21:18:43.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.126+0000 7f1b25b9d700 1 -- 172.21.15.154:0/2315642812 wait complete. 2023-10-10T21:18:43.131 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T21:18:43.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T21:18:43.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.337+0000 7f969cdff700 1 Processor -- start 2023-10-10T21:18:43.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.337+0000 7f969cdff700 1 -- start start 2023-10-10T21:18:43.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.338+0000 7f969cdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f969815ac80 0x7f9698069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:43.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.338+0000 7f969cdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9698069cb0 0x7f96980c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:43.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.338+0000 7f969cdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96980af2f0 con 0x7f969815b050 2023-10-10T21:18:43.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.338+0000 7f969cdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96980af5d0 con 0x7f9698069cb0 2023-10-10T21:18:43.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.338+0000 7f969cdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969806a0e0 con 0x7f969815ac80 2023-10-10T21:18:43.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.339+0000 7f9696d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9698069cb0 0x7f96980c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:43.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.339+0000 7f9696d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9698069cb0 0x7f96980c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52618/0 (socket says 172.21.15.154:52618) 2023-10-10T21:18:43.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.339+0000 7f9696d9d700 1 -- 172.21.15.154:0/83161915 learned_addr learned my addr 172.21.15.154:0/83161915 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:43.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.339+0000 7f969659c700 1 --2- 172.21.15.154:0/83161915 >> v2:172.21.15.179:3300/0 conn(0x7f969815ac80 0x7f9698069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:43.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.339+0000 7f9696d9d700 1 -- 172.21.15.154:0/83161915 >> v2:172.21.15.179:3300/0 conn(0x7f969815ac80 msgr2=0x7f9698069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:43.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.339+0000 7f9696d9d700 1 --2- 172.21.15.154:0/83161915 >> v2:172.21.15.179:3300/0 conn(0x7f969815ac80 0x7f9698069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:43.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.339+0000 7f9696d9d700 1 -- 172.21.15.154:0/83161915 >> v1:172.21.15.179:6789/0 conn(0x7f969815b050 legacy=0x7f96980afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:43.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.339+0000 7f9696d9d700 1 -- 172.21.15.154:0/83161915 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980c8660 con 0x7f9698069cb0 2023-10-10T21:18:43.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.339+0000 7f9696d9d700 1 --2- 172.21.15.154:0/83161915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9698069cb0 0x7f96980c7b80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f969806fdc0 tx=0x7f9690009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c4e4652bcc6b6c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:43.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969559a700 1 -- 172.21.15.154:0/83161915 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000e070 con 0x7f9698069cb0 2023-10-10T21:18:43.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969559a700 1 -- 172.21.15.154:0/83161915 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000ba10 con 0x7f9698069cb0 2023-10-10T21:18:43.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969559a700 1 -- 172.21.15.154:0/83161915 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96900092e0 con 0x7f9698069cb0 2023-10-10T21:18:43.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969cdff700 1 -- 172.21.15.154:0/83161915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9698069cb0 msgr2=0x7f96980c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:43.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969cdff700 1 --2- 172.21.15.154:0/83161915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9698069cb0 0x7f96980c7b80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f969806fdc0 tx=0x7f9690009840 comp rx=0 tx=0).stop 2023-10-10T21:18:43.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969cdff700 1 -- 172.21.15.154:0/83161915 shutdown_connections 2023-10-10T21:18:43.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969cdff700 1 --2- 172.21.15.154:0/83161915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9698069cb0 0x7f96980c7b80 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:43.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969cdff700 1 --2- 172.21.15.154:0/83161915 >> v2:172.21.15.179:3300/0 conn(0x7f969815ac80 0x7f9698069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:43.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969cdff700 1 -- 172.21.15.154:0/83161915 >> 172.21.15.154:0/83161915 conn(0x7f9698068e10 msgr2=0x7f96980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:43.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969cdff700 1 -- 172.21.15.154:0/83161915 shutdown_connections 2023-10-10T21:18:43.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.340+0000 7f969cdff700 1 -- 172.21.15.154:0/83161915 wait complete. 2023-10-10T21:18:43.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.342+0000 7f969cdff700 1 Processor -- start 2023-10-10T21:18:43.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.342+0000 7f969cdff700 1 -- start start 2023-10-10T21:18:43.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f969cdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9698069cb0 0x7f969815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:43.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f969cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f969815ac80 0x7f969815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:43.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f969cdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f969815b050 0x7f969814bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:43.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f969cdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969815c610 con 0x7f969815b050 2023-10-10T21:18:43.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f969cdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9698169600 con 0x7f9698069cb0 2023-10-10T21:18:43.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f969cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96980ca0e0 con 0x7f969815ac80 2023-10-10T21:18:43.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f9696d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f969815b050 0x7f969814bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:43.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f9696d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f969815b050 0x7f969814bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52632/0 (socket says 172.21.15.154:52632) 2023-10-10T21:18:43.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f9696d9d700 1 -- 172.21.15.154:0/3768966475 learned_addr learned my addr 172.21.15.154:0/3768966475 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:43.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f969659c700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9698069cb0 0x7f969815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:43.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f9696d9d700 1 -- 172.21.15.154:0/3768966475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f969815ac80 msgr2=0x7f969815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:43.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f9696d9d700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f969815ac80 0x7f969815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:43.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f9696d9d700 1 -- 172.21.15.154:0/3768966475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9698069cb0 msgr2=0x7f969815cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:43.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f9696d9d700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9698069cb0 0x7f969815cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:43.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f9696d9d700 1 -- 172.21.15.154:0/3768966475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690009ae0 con 0x7f969815b050 2023-10-10T21:18:43.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.343+0000 7f969659c700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9698069cb0 0x7f969815cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:43.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.344+0000 7f9696d9d700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f969815b050 0x7f969814bbf0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f9690009fd0 tx=0x7f9690017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:43.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.344+0000 7f96867fc700 1 -- 172.21.15.154:0/3768966475 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000bee0 con 0x7f969815b050 2023-10-10T21:18:43.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.344+0000 7f96867fc700 1 -- 172.21.15.154:0/3768966475 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9690012e90 con 0x7f969815b050 2023-10-10T21:18:43.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.344+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969815d640 con 0x7f969815b050 2023-10-10T21:18:43.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.344+0000 7f96867fc700 1 -- 172.21.15.154:0/3768966475 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969001d650 con 0x7f969815b050 2023-10-10T21:18:43.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.344+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969815dc00 con 0x7f969815b050 2023-10-10T21:18:43.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.345+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969804c3c0 con 0x7f969815b050 2023-10-10T21:18:43.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.346+0000 7f96867fc700 1 -- 172.21.15.154:0/3768966475 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f969001da80 con 0x7f969815b050 2023-10-10T21:18:43.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.347+0000 7f96867fc700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9678066f30 0x7f96780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:43.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.347+0000 7f96867fc700 1 -- 172.21.15.154:0/3768966475 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f9690086290 con 0x7f969815b050 2023-10-10T21:18:43.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.347+0000 7f969659c700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9678066f30 0x7f96780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:43.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.348+0000 7f969659c700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9678066f30 0x7f96780693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9688006fd0 tx=0x7f9688008040 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:43.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.351+0000 7f96867fc700 1 -- 172.21.15.154:0/3768966475 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9690053460 con 0x7f969815b050 2023-10-10T21:18:43.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:43.588+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f96980c89a0 con 0x7f969815b050 2023-10-10T21:18:44.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.142+0000 7f96867fc700 1 -- 172.21.15.154:0/3768966475 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9690056a80 con 0x7f969815b050 2023-10-10T21:18:44.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9678066f30 msgr2=0x7f96780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9678066f30 0x7f96780693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9688006fd0 tx=0x7f9688008040 comp rx=0 tx=0).stop 2023-10-10T21:18:44.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f969815b050 msgr2=0x7f969814bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f969815b050 0x7f969814bbf0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f9690009fd0 tx=0x7f9690017000 comp rx=0 tx=0).stop 2023-10-10T21:18:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 shutdown_connections 2023-10-10T21:18:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f969815b050 0x7f969814bbf0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9678066f30 0x7f96780693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9698069cb0 0x7f969815cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 --2- 172.21.15.154:0/3768966475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f969815ac80 0x7f969815c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.154+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 >> 172.21.15.154:0/3768966475 conn(0x7f9698068e10 msgr2=0x7f96980c2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:44.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.155+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 shutdown_connections 2023-10-10T21:18:44.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.155+0000 7f969cdff700 1 -- 172.21.15.154:0/3768966475 wait complete. 2023-10-10T21:18:44.159 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 12 and data pool 13 2023-10-10T21:18:44.177 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:44.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.358+0000 7f22e0dff700 1 Processor -- start 2023-10-10T21:18:44.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.358+0000 7f22e0dff700 1 -- start start 2023-10-10T21:18:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.359+0000 7f22e0dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22dc155c10 0x7f22dc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.359+0000 7f22e0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc0ac230 0x7f22dc0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.359+0000 7f22e0dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22dc1568a0 0x7f22dc156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.359+0000 7f22e0dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc0ad930 con 0x7f22dc1568a0 2023-10-10T21:18:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.359+0000 7f22e0dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc0acd20 con 0x7f22dc155c10 2023-10-10T21:18:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.359+0000 7f22e0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0ad000 con 0x7f22dc0ac230 2023-10-10T21:18:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22dad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22dc1568a0 0x7f22dc156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22dad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22dc1568a0 0x7f22dc156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52648/0 (socket says 172.21.15.154:52648) 2023-10-10T21:18:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22dad9d700 1 -- 172.21.15.154:0/480336600 learned_addr learned my addr 172.21.15.154:0/480336600 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22da59c700 1 --2- 172.21.15.154:0/480336600 >> v2:172.21.15.179:3300/0 conn(0x7f22dc155c10 0x7f22dc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22d9d9b700 1 --2- 172.21.15.154:0/480336600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc0ac230 0x7f22dc0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22dad9d700 1 -- 172.21.15.154:0/480336600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc0ac230 msgr2=0x7f22dc0ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22dad9d700 1 --2- 172.21.15.154:0/480336600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc0ac230 0x7f22dc0ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22dad9d700 1 -- 172.21.15.154:0/480336600 >> v2:172.21.15.179:3300/0 conn(0x7f22dc155c10 msgr2=0x7f22dc155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22dad9d700 1 --2- 172.21.15.154:0/480336600 >> v2:172.21.15.179:3300/0 conn(0x7f22dc155c10 0x7f22dc155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22dad9d700 1 -- 172.21.15.154:0/480336600 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0ad2e0 con 0x7f22dc1568a0 2023-10-10T21:18:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22d9d9b700 1 --2- 172.21.15.154:0/480336600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc0ac230 0x7f22dc0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.360+0000 7f22dad9d700 1 --2- 172.21.15.154:0/480336600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc1568a0 0x7f22dc156cc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f22dc063d40 tx=0x7f22d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b708a96e58f127 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22d959a700 1 -- 172.21.15.154:0/480336600 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400e070 con 0x7f22dc1568a0 2023-10-10T21:18:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22d959a700 1 -- 172.21.15.154:0/480336600 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d400ba20 con 0x7f22dc1568a0 2023-10-10T21:18:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22d959a700 1 -- 172.21.15.154:0/480336600 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40092e0 con 0x7f22dc1568a0 2023-10-10T21:18:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22e0dff700 1 -- 172.21.15.154:0/480336600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc1568a0 msgr2=0x7f22dc156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22e0dff700 1 --2- 172.21.15.154:0/480336600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc1568a0 0x7f22dc156cc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f22dc063d40 tx=0x7f22d4009840 comp rx=0 tx=0).stop 2023-10-10T21:18:44.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22e0dff700 1 -- 172.21.15.154:0/480336600 shutdown_connections 2023-10-10T21:18:44.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22e0dff700 1 --2- 172.21.15.154:0/480336600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc1568a0 0x7f22dc156cc0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22e0dff700 1 --2- 172.21.15.154:0/480336600 >> v2:172.21.15.179:3300/0 conn(0x7f22dc155c10 0x7f22dc155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22e0dff700 1 --2- 172.21.15.154:0/480336600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc0ac230 0x7f22dc0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22e0dff700 1 -- 172.21.15.154:0/480336600 >> 172.21.15.154:0/480336600 conn(0x7f22dc06a320 msgr2=0x7f22dc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22e0dff700 1 -- 172.21.15.154:0/480336600 shutdown_connections 2023-10-10T21:18:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.361+0000 7f22e0dff700 1 -- 172.21.15.154:0/480336600 wait complete. 2023-10-10T21:18:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.363+0000 7f22e0dff700 1 Processor -- start 2023-10-10T21:18:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.363+0000 7f22e0dff700 1 -- start start 2023-10-10T21:18:44.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22e0dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ac230 0x7f22dc1414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22e0dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc155c10 0x7f22dc0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22e0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc1568a0 0x7f22dc148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22e0dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc146f40 con 0x7f22dc0ac230 2023-10-10T21:18:44.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22e0dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc142870 con 0x7f22dc155c10 2023-10-10T21:18:44.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22e0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc142b50 con 0x7f22dc1568a0 2023-10-10T21:18:44.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22da59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ac230 0x7f22dc1414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22da59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ac230 0x7f22dc1414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52662/0 (socket says 172.21.15.154:52662) 2023-10-10T21:18:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22da59c700 1 -- 172.21.15.154:0/248742060 learned_addr learned my addr 172.21.15.154:0/248742060 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22d9d9b700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc155c10 0x7f22dc0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22dad9d700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc1568a0 0x7f22dc148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22da59c700 1 -- 172.21.15.154:0/248742060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc1568a0 msgr2=0x7f22dc148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22da59c700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc1568a0 0x7f22dc148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22da59c700 1 -- 172.21.15.154:0/248742060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc155c10 msgr2=0x7f22dc0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22da59c700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc155c10 0x7f22dc0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22da59c700 1 -- 172.21.15.154:0/248742060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4009ae0 con 0x7f22dc0ac230 2023-10-10T21:18:44.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.364+0000 7f22d9d9b700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc155c10 0x7f22dc0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:44.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.365+0000 7f22da59c700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ac230 0x7f22dc1414a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00ec80 tx=0x7f22cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:44.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.365+0000 7f22ca7fc700 1 -- 172.21.15.154:0/248742060 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00c9d0 con 0x7f22dc0ac230 2023-10-10T21:18:44.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.365+0000 7f22ca7fc700 1 -- 172.21.15.154:0/248742060 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc00cb30 con 0x7f22dc0ac230 2023-10-10T21:18:44.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.365+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc142e30 con 0x7f22dc0ac230 2023-10-10T21:18:44.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.365+0000 7f22ca7fc700 1 -- 172.21.15.154:0/248742060 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc013470 con 0x7f22dc0ac230 2023-10-10T21:18:44.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.365+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc1424d0 con 0x7f22dc0ac230 2023-10-10T21:18:44.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.366+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc147220 con 0x7f22dc0ac230 2023-10-10T21:18:44.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.367+0000 7f22ca7fc700 1 -- 172.21.15.154:0/248742060 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22cc013820 con 0x7f22dc0ac230 2023-10-10T21:18:44.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.368+0000 7f22ca7fc700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f22bc066f30 0x7f22bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.368+0000 7f22ca7fc700 1 -- 172.21.15.154:0/248742060 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f22cc084a50 con 0x7f22dc0ac230 2023-10-10T21:18:44.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.368+0000 7f22d9d9b700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f22bc066f30 0x7f22bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.369+0000 7f22d9d9b700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f22bc066f30 0x7f22bc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006f00 tx=0x7f22d0008040 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:44.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.372+0000 7f22ca7fc700 1 -- 172.21.15.154:0/248742060 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22cc051b30 con 0x7f22dc0ac230 2023-10-10T21:18:44.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.567+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22dc1432d0 con 0x7f22dc0ac230 2023-10-10T21:18:44.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.568+0000 7f22ca7fc700 1 -- 172.21.15.154:0/248742060 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16020 (secure 0 0 0) 0x7f22dc1432d0 con 0x7f22dc0ac230 2023-10-10T21:18:44.570 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:44.571 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":108,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:43.589462+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:41.726498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:42.567446+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f22bc066f30 msgr2=0x7f22bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f22bc066f30 0x7f22bc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006f00 tx=0x7f22d0008040 comp rx=0 tx=0).stop 2023-10-10T21:18:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ac230 msgr2=0x7f22dc1414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ac230 0x7f22dc1414a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00ec80 tx=0x7f22cc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 shutdown_connections 2023-10-10T21:18:44.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22dc1568a0 0x7f22dc148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22dc0ac230 0x7f22dc1414a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f22bc066f30 0x7f22bc0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 --2- 172.21.15.154:0/248742060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22dc155c10 0x7f22dc0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 >> 172.21.15.154:0/248742060 conn(0x7f22dc06a320 msgr2=0x7f22dc0ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:44.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 shutdown_connections 2023-10-10T21:18:44.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.571+0000 7f22e0dff700 1 -- 172.21.15.154:0/248742060 wait complete. 2023-10-10T21:18:44.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:44.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.770+0000 7f4a6c9ff700 1 Processor -- start 2023-10-10T21:18:44.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.770+0000 7f4a6c9ff700 1 -- start start 2023-10-10T21:18:44.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a6c9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a680b0a10 0x7f4a68155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a6c9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a680ad930 con 0x7f4a68155c10 2023-10-10T21:18:44.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a6c9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a680acd20 con 0x7f4a681578b0 2023-10-10T21:18:44.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a6c9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680ad000 con 0x7f4a680b0a10 2023-10-10T21:18:44.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a66d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a680b0a10 0x7f4a68155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a6659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4a68155c10 0x7f4a680ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55992/0 (socket says 172.21.15.154:55992) 2023-10-10T21:18:44.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a6659c700 1 -- 172.21.15.154:0/2529375541 learned_addr learned my addr 172.21.15.154:0/2529375541 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:44.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a66d9d700 1 -- 172.21.15.154:0/2529375541 >> v1:172.21.15.179:6789/0 conn(0x7f4a681578b0 legacy=0x7f4a680af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a66d9d700 1 -- 172.21.15.154:0/2529375541 >> v1:172.21.15.154:6789/0 conn(0x7f4a68155c10 legacy=0x7f4a680ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a65d9b700 1 -- 172.21.15.154:0/2529375541 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087102790 0 0) 0x7f4a680ad930 con 0x7f4a68155c10 2023-10-10T21:18:44.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.772+0000 7f4a66d9d700 1 -- 172.21.15.154:0/2529375541 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680ad2e0 con 0x7f4a680b0a10 2023-10-10T21:18:44.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.773+0000 7f4a66d9d700 1 --2- 172.21.15.154:0/2529375541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a680b0a10 0x7f4a68155fe0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009e60 tx=0x7f4a60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db04096b60002cb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:44.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.773+0000 7f4a65d9b700 1 -- 172.21.15.154:0/2529375541 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000e070 con 0x7f4a680b0a10 2023-10-10T21:18:44.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.773+0000 7f4a65d9b700 1 -- 172.21.15.154:0/2529375541 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6000bc30 con 0x7f4a680b0a10 2023-10-10T21:18:44.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.773+0000 7f4a65d9b700 1 -- 172.21.15.154:0/2529375541 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a60012430 con 0x7f4a680b0a10 2023-10-10T21:18:44.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.773+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2529375541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a680b0a10 msgr2=0x7f4a68155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.773+0000 7f4a6c9ff700 1 --2- 172.21.15.154:0/2529375541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a680b0a10 0x7f4a68155fe0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009e60 tx=0x7f4a60009780 comp rx=0 tx=0).stop 2023-10-10T21:18:44.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.774+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2529375541 shutdown_connections 2023-10-10T21:18:44.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.774+0000 7f4a6c9ff700 1 --2- 172.21.15.154:0/2529375541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a680b0a10 0x7f4a68155fe0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.774+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2529375541 >> 172.21.15.154:0/2529375541 conn(0x7f4a6806a320 msgr2=0x7f4a680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:44.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.774+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2529375541 shutdown_connections 2023-10-10T21:18:44.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.774+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2529375541 wait complete. 2023-10-10T21:18:44.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.775+0000 7f4a6c9ff700 1 Processor -- start 2023-10-10T21:18:44.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.775+0000 7f4a6c9ff700 1 -- start start 2023-10-10T21:18:44.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a6c9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a680b0a10 0x7f4a6814c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a6c9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a68155c10 0x7f4a6815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a6c9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a681578b0 0x7f4a6814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a6c9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a681528d0 con 0x7f4a681578b0 2023-10-10T21:18:44.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a6c9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68151d00 con 0x7f4a680b0a10 2023-10-10T21:18:44.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a6c9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68151fa0 con 0x7f4a68155c10 2023-10-10T21:18:44.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a66d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a681578b0 0x7f4a6814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a66d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a681578b0 0x7f4a6814f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52682/0 (socket says 172.21.15.154:52682) 2023-10-10T21:18:44.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a66d9d700 1 -- 172.21.15.154:0/2262348815 learned_addr learned my addr 172.21.15.154:0/2262348815 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:44.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a6659c700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a680b0a10 0x7f4a6814c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.776+0000 7f4a5ffff700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a68155c10 0x7f4a6815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a66d9d700 1 -- 172.21.15.154:0/2262348815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a68155c10 msgr2=0x7f4a6815a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a66d9d700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a68155c10 0x7f4a6815a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a66d9d700 1 -- 172.21.15.154:0/2262348815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a680b0a10 msgr2=0x7f4a6814c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a66d9d700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a680b0a10 0x7f4a6814c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a66d9d700 1 -- 172.21.15.154:0/2262348815 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60009a20 con 0x7f4a681578b0 2023-10-10T21:18:44.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a6659c700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a680b0a10 0x7f4a6814c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:44.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a66d9d700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a681578b0 0x7f4a6814f160 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4a60013000 tx=0x7f4a60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:44.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a5e7fc700 1 -- 172.21.15.154:0/2262348815 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6001b630 con 0x7f4a681578b0 2023-10-10T21:18:44.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a5e7fc700 1 -- 172.21.15.154:0/2262348815 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6001b790 con 0x7f4a681578b0 2023-10-10T21:18:44.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a5e7fc700 1 -- 172.21.15.154:0/2262348815 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6001bb30 con 0x7f4a681578b0 2023-10-10T21:18:44.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a68152280 con 0x7f4a681578b0 2023-10-10T21:18:44.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.777+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6815ae30 con 0x7f4a681578b0 2023-10-10T21:18:44.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.778+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a68152a40 con 0x7f4a681578b0 2023-10-10T21:18:44.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.779+0000 7f4a5e7fc700 1 -- 172.21.15.154:0/2262348815 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a6001c400 con 0x7f4a681578b0 2023-10-10T21:18:44.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.780+0000 7f4a5e7fc700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a48066f30 0x7f4a480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:44.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.780+0000 7f4a5e7fc700 1 -- 172.21.15.154:0/2262348815 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4a600865a0 con 0x7f4a681578b0 2023-10-10T21:18:44.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.781+0000 7f4a6659c700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a48066f30 0x7f4a480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:44.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.781+0000 7f4a6659c700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a48066f30 0x7f4a480693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4a580011e0 tx=0x7f4a58009040 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:44.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.785+0000 7f4a5e7fc700 1 -- 172.21.15.154:0/2262348815 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a60053680 con 0x7f4a681578b0 2023-10-10T21:18:44.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.979+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a6804c3c0 con 0x7f4a681578b0 2023-10-10T21:18:44.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.980+0000 7f4a5e7fc700 1 -- 172.21.15.154:0/2262348815 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16020 (secure 0 0 0) 0x7f4a60009880 con 0x7f4a681578b0 2023-10-10T21:18:44.982 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:44.983 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":108,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:43.589462+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:41.726498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:42.567446+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:44.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a48066f30 msgr2=0x7f4a480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a48066f30 0x7f4a480693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4a580011e0 tx=0x7f4a58009040 comp rx=0 tx=0).stop 2023-10-10T21:18:44.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a681578b0 msgr2=0x7f4a6814f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:44.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a681578b0 0x7f4a6814f160 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4a60013000 tx=0x7f4a60019000 comp rx=0 tx=0).stop 2023-10-10T21:18:44.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 shutdown_connections 2023-10-10T21:18:44.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a681578b0 0x7f4a6814f160 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4a48066f30 0x7f4a480693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a680b0a10 0x7f4a6814c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 --2- 172.21.15.154:0/2262348815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a68155c10 0x7f4a6815a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:44.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 >> 172.21.15.154:0/2262348815 conn(0x7f4a6806a320 msgr2=0x7f4a680cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:44.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.982+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 shutdown_connections 2023-10-10T21:18:44.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:44.983+0000 7f4a6c9ff700 1 -- 172.21.15.154:0/2262348815 wait complete. 2023-10-10T21:18:45.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T21:18:45.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.188+0000 7f37e77ff700 1 Processor -- start 2023-10-10T21:18:45.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.188+0000 7f37e77ff700 1 -- start start 2023-10-10T21:18:45.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.189+0000 7f37e77ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37e0155eb0 0x7f37e006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.189+0000 7f37e77ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e0069e80 0x7f37e00ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.189+0000 7f37e77ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e006eb90 con 0x7f37e00c70b0 2023-10-10T21:18:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.189+0000 7f37e77ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e006ee70 con 0x7f37e0155eb0 2023-10-10T21:18:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.189+0000 7f37e77ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e006f150 con 0x7f37e0069e80 2023-10-10T21:18:45.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.190+0000 7f37e4d9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f37e00c70b0 0x7f37e0069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55998/0 (socket says 172.21.15.154:55998) 2023-10-10T21:18:45.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.190+0000 7f37e4d9a700 1 -- 172.21.15.154:0/3683264994 learned_addr learned my addr 172.21.15.154:0/3683264994 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.190+0000 7f37e5d9c700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e0069e80 0x7f37e00ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.190+0000 7f37e559b700 1 --2- 172.21.15.154:0/3683264994 >> v2:172.21.15.179:3300/0 conn(0x7f37e0155eb0 0x7f37e006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.190+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587046313 0 0) 0x7f37e006eb90 con 0x7f37e00c70b0 2023-10-10T21:18:45.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.190+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37cc003570 con 0x7f37e00c70b0 2023-10-10T21:18:45.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197323131 0 0) 0x7f37cc003570 con 0x7f37e00c70b0 2023-10-10T21:18:45.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e0069e80 msgr2=0x7f37e00ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:45.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e0069e80 0x7f37e00ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:45.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 >> v2:172.21.15.179:3300/0 conn(0x7f37e0155eb0 msgr2=0x7f37e006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:45.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 --2- 172.21.15.154:0/3683264994 >> v2:172.21.15.179:3300/0 conn(0x7f37e0155eb0 0x7f37e006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:45.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e006f430 con 0x7f37e00c70b0 2023-10-10T21:18:45.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f37d0001470 con 0x7f37e00c70b0 2023-10-10T21:18:45.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 >> v1:172.21.15.154:6789/0 conn(0x7f37e00c70b0 legacy=0x7f37e0069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:45.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e0069e80 0x7f37cc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc003fe0 0x7f37cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc004d50 0x7f37cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e006ee70 con 0x7f37cc003fe0 2023-10-10T21:18:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e006f150 con 0x7f37cc004d50 2023-10-10T21:18:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc00dca0 con 0x7f37e0069e80 2023-10-10T21:18:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37e4d9a700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc003fe0 0x7f37cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37e559b700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e0069e80 0x7f37cc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37e5d9c700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc004d50 0x7f37cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37e4d9a700 1 -- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e0069e80 msgr2=0x7f37cc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37e4d9a700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e0069e80 0x7f37cc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37e4d9a700 1 -- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc004d50 msgr2=0x7f37cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37e4d9a700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc004d50 0x7f37cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.191+0000 7f37e4d9a700 1 -- 172.21.15.154:0/3683264994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc003570 con 0x7f37cc003fe0 2023-10-10T21:18:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.192+0000 7f37e4d9a700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc003fe0 0x7f37cc004810 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f37d000c3c0 tx=0x7f37d0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3432d0429742f390 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.192+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000cc30 con 0x7f37cc003fe0 2023-10-10T21:18:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.192+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000cdd0 con 0x7f37cc003fe0 2023-10-10T21:18:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.192+0000 7f37d7fff700 1 -- 172.21.15.154:0/3683264994 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0005b70 con 0x7f37cc003fe0 2023-10-10T21:18:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.192+0000 7f37e77ff700 1 -- 172.21.15.154:0/3683264994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc003fe0 msgr2=0x7f37cc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.192+0000 7f37e77ff700 1 --2- 172.21.15.154:0/3683264994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc003fe0 0x7f37cc004810 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f37d000c3c0 tx=0x7f37d0001e90 comp rx=0 tx=0).stop 2023-10-10T21:18:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.192+0000 7f37e5d9c700 1 -- 172.21.15.154:0/3683264994 reap_dead start 2023-10-10T21:18:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.192+0000 7f37e77ff700 1 -- 172.21.15.154:0/3683264994 shutdown_connections 2023-10-10T21:18:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.193+0000 7f37e77ff700 1 -- 172.21.15.154:0/3683264994 >> 172.21.15.154:0/3683264994 conn(0x7f37e0068e10 msgr2=0x7f37e00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.193+0000 7f37e77ff700 1 -- 172.21.15.154:0/3683264994 shutdown_connections 2023-10-10T21:18:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.193+0000 7f37e77ff700 1 -- 172.21.15.154:0/3683264994 wait complete. 2023-10-10T21:18:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.194+0000 7f37e77ff700 1 Processor -- start 2023-10-10T21:18:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.194+0000 7f37e77ff700 1 -- start start 2023-10-10T21:18:45.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e77ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc003fe0 0x7f37e016a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:45.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e77ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e00c55b0 0x7f37e00c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:45.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e77ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37e0157c20 0x7f37e0158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e77ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e016ade0 con 0x7f37e0157c20 2023-10-10T21:18:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e77ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00c5f60 con 0x7f37cc003fe0 2023-10-10T21:18:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e77ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0158950 con 0x7f37e00c55b0 2023-10-10T21:18:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e5d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37e0157c20 0x7f37e0158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e5d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37e0157c20 0x7f37e0158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52696/0 (socket says 172.21.15.154:52696) 2023-10-10T21:18:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e5d9c700 1 -- 172.21.15.154:0/1061815032 learned_addr learned my addr 172.21.15.154:0/1061815032 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e4d9a700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e00c55b0 0x7f37e00c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.195+0000 7f37e559b700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc003fe0 0x7f37e016a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e5d9c700 1 -- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e00c55b0 msgr2=0x7f37e00c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e5d9c700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e00c55b0 0x7f37e00c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e5d9c700 1 -- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc003fe0 msgr2=0x7f37e016a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e5d9c700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc003fe0 0x7f37e016a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e5d9c700 1 -- 172.21.15.154:0/1061815032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0158c30 con 0x7f37e0157c20 2023-10-10T21:18:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e4d9a700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e00c55b0 0x7f37e00c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e559b700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc003fe0 0x7f37e016a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e5d9c700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37e0157c20 0x7f37e0158090 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f37e006a280 tx=0x7f37d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37d57fa700 1 -- 172.21.15.154:0/1061815032 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d800e040 con 0x7f37e0157c20 2023-10-10T21:18:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37d57fa700 1 -- 172.21.15.154:0/1061815032 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d800f040 con 0x7f37e0157c20 2023-10-10T21:18:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37d57fa700 1 -- 172.21.15.154:0/1061815032 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d800fe50 con 0x7f37e0157c20 2023-10-10T21:18:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e0158f10 con 0x7f37e0157c20 2023-10-10T21:18:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.196+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e01585d0 con 0x7f37e0157c20 2023-10-10T21:18:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.197+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e01593b0 con 0x7f37e0157c20 2023-10-10T21:18:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.198+0000 7f37d57fa700 1 -- 172.21.15.154:0/1061815032 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37d8015640 con 0x7f37e0157c20 2023-10-10T21:18:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.199+0000 7f37d57fa700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37c4066f30 0x7f37c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.199+0000 7f37d57fa700 1 -- 172.21.15.154:0/1061815032 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f37d8084ed0 con 0x7f37e0157c20 2023-10-10T21:18:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.200+0000 7f37e559b700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37c4066f30 0x7f37c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.200+0000 7f37e559b700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37c4066f30 0x7f37c40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37dc0093f0 tx=0x7f37dc008040 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.204+0000 7f37d57fa700 1 -- 172.21.15.154:0/1061815032 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37d8051fb0 con 0x7f37e0157c20 2023-10-10T21:18:45.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:45.439+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f37e004c3c0 con 0x7f37e0157c20 2023-10-10T21:18:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.155+0000 7f37d57fa700 1 -- 172.21.15.154:0/1061815032 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) v1 ==== 118+0+0 (secure 0 0 0) 0x7f37d80555d0 con 0x7f37e0157c20 2023-10-10T21:18:46.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37c4066f30 msgr2=0x7f37c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:46.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37c4066f30 0x7f37c40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37dc0093f0 tx=0x7f37dc008040 comp rx=0 tx=0).stop 2023-10-10T21:18:46.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37e0157c20 msgr2=0x7f37e0158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:46.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37e0157c20 0x7f37e0158090 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f37e006a280 tx=0x7f37d800b040 comp rx=0 tx=0).stop 2023-10-10T21:18:46.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 shutdown_connections 2023-10-10T21:18:46.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37e0157c20 0x7f37e0158090 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:46.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37c4066f30 0x7f37c40693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:46.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc003fe0 0x7f37e016a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:46.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 --2- 172.21.15.154:0/1061815032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37e00c55b0 0x7f37e00c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:46.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 >> 172.21.15.154:0/1061815032 conn(0x7f37e0068e10 msgr2=0x7f37e00b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:46.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 shutdown_connections 2023-10-10T21:18:46.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.158+0000 7f37e77ff700 1 -- 172.21.15.154:0/1061815032 wait complete. 2023-10-10T21:18:46.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T21:18:46.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.365+0000 7f4186f9d700 1 Processor -- start 2023-10-10T21:18:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.365+0000 7f4186f9d700 1 -- start start 2023-10-10T21:18:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.366+0000 7f4186f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159820 0x7f41800a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.366+0000 7f4186f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800c8730 con 0x7f41800a9e20 2023-10-10T21:18:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.366+0000 7f4186f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800c7b00 con 0x7f4180159450 2023-10-10T21:18:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.366+0000 7f4186f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c89a0 con 0x7f4180159820 2023-10-10T21:18:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.366+0000 7f418679c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f41800a9e20 0x7f418006d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33888/0 (socket says 172.21.15.154:33888) 2023-10-10T21:18:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.366+0000 7f418679c700 1 -- 172.21.15.154:0/3211667390 learned_addr learned my addr 172.21.15.154:0/3211667390 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f418579a700 1 --2- 172.21.15.154:0/3211667390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159820 0x7f41800a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f4184f99700 1 -- 172.21.15.154:0/3211667390 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203600430 0 0) 0x7f41800c8730 con 0x7f41800a9e20 2023-10-10T21:18:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f4184f99700 1 -- 172.21.15.154:0/3211667390 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f416c003570 con 0x7f41800a9e20 2023-10-10T21:18:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f4184f99700 1 -- 172.21.15.154:0/3211667390 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356287767 0 0) 0x7f41800c7b00 con 0x7f4180159450 2023-10-10T21:18:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f4184f99700 1 -- 172.21.15.154:0/3211667390 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41800c8730 con 0x7f4180159450 2023-10-10T21:18:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f418579a700 1 -- 172.21.15.154:0/3211667390 >> v1:172.21.15.179:6789/0 conn(0x7f4180159450 legacy=0x7f41800c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f4184f99700 1 -- 172.21.15.154:0/3211667390 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 67756992 0 0) 0x7f416c003570 con 0x7f41800a9e20 2023-10-10T21:18:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f418579a700 1 -- 172.21.15.154:0/3211667390 >> v1:172.21.15.154:6789/0 conn(0x7f41800a9e20 legacy=0x7f418006d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:46.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f418579a700 1 -- 172.21.15.154:0/3211667390 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800c8c80 con 0x7f4180159820 2023-10-10T21:18:46.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.367+0000 7f418579a700 1 --2- 172.21.15.154:0/3211667390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159820 0x7f41800a98e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4170009910 tx=0x7f41700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299fc02d47854200 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:46.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.368+0000 7f4184f99700 1 -- 172.21.15.154:0/3211667390 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780017f0 con 0x7f4180159820 2023-10-10T21:18:46.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.368+0000 7f4184f99700 1 -- 172.21.15.154:0/3211667390 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170011420 con 0x7f4180159820 2023-10-10T21:18:46.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.368+0000 7f4184f99700 1 -- 172.21.15.154:0/3211667390 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700117c0 con 0x7f4180159820 2023-10-10T21:18:46.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.368+0000 7f4186f9d700 1 -- 172.21.15.154:0/3211667390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159820 msgr2=0x7f41800a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:46.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.368+0000 7f4186f9d700 1 --2- 172.21.15.154:0/3211667390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159820 0x7f41800a98e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4170009910 tx=0x7f41700091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:46.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.368+0000 7f4186f9d700 1 -- 172.21.15.154:0/3211667390 shutdown_connections 2023-10-10T21:18:46.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.368+0000 7f4186f9d700 1 --2- 172.21.15.154:0/3211667390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159820 0x7f41800a98e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:46.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.368+0000 7f4186f9d700 1 -- 172.21.15.154:0/3211667390 >> 172.21.15.154:0/3211667390 conn(0x7f41800698e0 msgr2=0x7f4180069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:46.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.368+0000 7f4186f9d700 1 -- 172.21.15.154:0/3211667390 shutdown_connections 2023-10-10T21:18:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.369+0000 7f4186f9d700 1 -- 172.21.15.154:0/3211667390 wait complete. 2023-10-10T21:18:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.370+0000 7f4186f9d700 1 Processor -- start 2023-10-10T21:18:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.370+0000 7f4186f9d700 1 -- start start 2023-10-10T21:18:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f4186f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41800a9e20 0x7f418015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f4186f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159450 0x7f4180158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f4186f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4180159820 0x7f41801503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f4186f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180152d20 con 0x7f41800a9e20 2023-10-10T21:18:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f4186f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418015f210 con 0x7f4180159820 2023-10-10T21:18:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f4186f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4180156a50 con 0x7f4180159450 2023-10-10T21:18:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f4185f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41800a9e20 0x7f418015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f4185f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41800a9e20 0x7f418015eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42670/0 (socket says 172.21.15.154:42670) 2023-10-10T21:18:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f4185f9b700 1 -- 172.21.15.154:0/3061789685 learned_addr learned my addr 172.21.15.154:0/3061789685 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:46.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f418579a700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159450 0x7f4180158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:46.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.371+0000 7f418679c700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4180159820 0x7f41801503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:46.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4185f9b700 1 -- 172.21.15.154:0/3061789685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159450 msgr2=0x7f4180158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:46.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4185f9b700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159450 0x7f4180158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:46.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4185f9b700 1 -- 172.21.15.154:0/3061789685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4180159820 msgr2=0x7f41801503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:46.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4185f9b700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4180159820 0x7f41801503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:46.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4185f9b700 1 -- 172.21.15.154:0/3061789685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170009420 con 0x7f41800a9e20 2023-10-10T21:18:46.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4185f9b700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41800a9e20 0x7f418015eb50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c790 tx=0x7f417c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:46.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4175ffb700 1 -- 172.21.15.154:0/3061789685 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c010510 con 0x7f41800a9e20 2023-10-10T21:18:46.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418015d190 con 0x7f41800a9e20 2023-10-10T21:18:46.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4175ffb700 1 -- 172.21.15.154:0/3061789685 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c010690 con 0x7f41800a9e20 2023-10-10T21:18:46.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.372+0000 7f4175ffb700 1 -- 172.21.15.154:0/3061789685 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c010a50 con 0x7f41800a9e20 2023-10-10T21:18:46.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.373+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180156ca0 con 0x7f41800a9e20 2023-10-10T21:18:46.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.374+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800a9c60 con 0x7f41800a9e20 2023-10-10T21:18:46.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.374+0000 7f4175ffb700 1 -- 172.21.15.154:0/3061789685 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f417c01b3b0 con 0x7f41800a9e20 2023-10-10T21:18:46.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.375+0000 7f4175ffb700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4164066f30 0x7f41640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:46.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.375+0000 7f4175ffb700 1 -- 172.21.15.154:0/3061789685 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f417c083f20 con 0x7f41800a9e20 2023-10-10T21:18:46.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.376+0000 7f418579a700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4164066f30 0x7f41640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:46.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.376+0000 7f418579a700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4164066f30 0x7f41640693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f41700030c0 tx=0x7f4170016000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:46.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.380+0000 7f4175ffb700 1 -- 172.21.15.154:0/3061789685 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f417c051000 con 0x7f41800a9e20 2023-10-10T21:18:46.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:46.617+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f41800c7de0 con 0x7f41800a9e20 2023-10-10T21:18:47.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.155+0000 7f4175ffb700 1 -- 172.21.15.154:0/3061789685 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) v1 ==== 122+0+0 (secure 0 0 0) 0x7f417c017020 con 0x7f41800a9e20 2023-10-10T21:18:47.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.157+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4164066f30 msgr2=0x7f41640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.157+0000 7f4186f9d700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4164066f30 0x7f41640693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f41700030c0 tx=0x7f4170016000 comp rx=0 tx=0).stop 2023-10-10T21:18:47.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.157+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41800a9e20 msgr2=0x7f418015eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.157+0000 7f4186f9d700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41800a9e20 0x7f418015eb50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c790 tx=0x7f417c007e10 comp rx=0 tx=0).stop 2023-10-10T21:18:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.158+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 shutdown_connections 2023-10-10T21:18:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.158+0000 7f4186f9d700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4164066f30 0x7f41640693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.158+0000 7f4186f9d700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4180159820 0x7f41801503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.158+0000 7f4186f9d700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41800a9e20 0x7f418015eb50 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.158+0000 7f4186f9d700 1 --2- 172.21.15.154:0/3061789685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4180159450 0x7f4180158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.158+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 >> 172.21.15.154:0/3061789685 conn(0x7f41800698e0 msgr2=0x7f41800c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:47.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.158+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 shutdown_connections 2023-10-10T21:18:47.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.158+0000 7f4186f9d700 1 -- 172.21.15.154:0/3061789685 wait complete. 2023-10-10T21:18:47.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:18:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.359+0000 7f77459ff700 1 Processor -- start 2023-10-10T21:18:47.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.359+0000 7f77459ff700 1 -- start start 2023-10-10T21:18:47.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f77459ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7740155c10 0x7f7740155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f77459ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac6d0 0x7f77400b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f77459ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400acac0 con 0x7f77400ac230 2023-10-10T21:18:47.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f77459ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77400ad930 con 0x7f7740155c10 2023-10-10T21:18:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f77459ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77400acd20 con 0x7f77400ac6d0 2023-10-10T21:18:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f773e7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f77400ac230 0x7f77401568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33902/0 (socket says 172.21.15.154:33902) 2023-10-10T21:18:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f773e7fc700 1 -- 172.21.15.154:0/4212179010 learned_addr learned my addr 172.21.15.154:0/4212179010 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f773f7fe700 1 --2- 172.21.15.154:0/4212179010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac6d0 0x7f77400b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f773effd700 1 --2- 172.21.15.154:0/4212179010 >> v2:172.21.15.179:3300/0 conn(0x7f7740155c10 0x7f7740155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f773dffb700 1 -- 172.21.15.154:0/4212179010 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388967304 0 0) 0x7f77400acac0 con 0x7f77400ac230 2023-10-10T21:18:47.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.361+0000 7f773dffb700 1 -- 172.21.15.154:0/4212179010 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7728003570 con 0x7f77400ac230 2023-10-10T21:18:47.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.362+0000 7f773f7fe700 1 -- 172.21.15.154:0/4212179010 >> v2:172.21.15.179:3300/0 conn(0x7f7740155c10 msgr2=0x7f7740155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:47.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.362+0000 7f773f7fe700 1 --2- 172.21.15.154:0/4212179010 >> v2:172.21.15.179:3300/0 conn(0x7f7740155c10 0x7f7740155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.362+0000 7f773f7fe700 1 -- 172.21.15.154:0/4212179010 >> v1:172.21.15.154:6789/0 conn(0x7f77400ac230 legacy=0x7f77401568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.362+0000 7f773f7fe700 1 -- 172.21.15.154:0/4212179010 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77400ad000 con 0x7f77400ac6d0 2023-10-10T21:18:47.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.362+0000 7f773effd700 1 --2- 172.21.15.154:0/4212179010 >> v2:172.21.15.179:3300/0 conn(0x7f7740155c10 0x7f7740155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:47.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.362+0000 7f773f7fe700 1 --2- 172.21.15.154:0/4212179010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac6d0 0x7f77400b0300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77400acc50 tx=0x7f7738009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd12bdee3e9fc82b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:47.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.362+0000 7f773dffb700 1 -- 172.21.15.154:0/4212179010 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800bab0 con 0x7f77400ac6d0 2023-10-10T21:18:47.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.362+0000 7f773dffb700 1 -- 172.21.15.154:0/4212179010 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800bc10 con 0x7f77400ac6d0 2023-10-10T21:18:47.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.362+0000 7f773dffb700 1 -- 172.21.15.154:0/4212179010 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738011400 con 0x7f77400ac6d0 2023-10-10T21:18:47.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.363+0000 7f77459ff700 1 -- 172.21.15.154:0/4212179010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac6d0 msgr2=0x7f77400b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.363+0000 7f77459ff700 1 --2- 172.21.15.154:0/4212179010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac6d0 0x7f77400b0300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77400acc50 tx=0x7f7738009780 comp rx=0 tx=0).stop 2023-10-10T21:18:47.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.363+0000 7f77459ff700 1 -- 172.21.15.154:0/4212179010 shutdown_connections 2023-10-10T21:18:47.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.363+0000 7f77459ff700 1 --2- 172.21.15.154:0/4212179010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac6d0 0x7f77400b0300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.363+0000 7f77459ff700 1 --2- 172.21.15.154:0/4212179010 >> v2:172.21.15.179:3300/0 conn(0x7f7740155c10 0x7f7740155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.363+0000 7f77459ff700 1 -- 172.21.15.154:0/4212179010 >> 172.21.15.154:0/4212179010 conn(0x7f774006a320 msgr2=0x7f77400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:47.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.363+0000 7f77459ff700 1 -- 172.21.15.154:0/4212179010 shutdown_connections 2023-10-10T21:18:47.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.363+0000 7f77459ff700 1 -- 172.21.15.154:0/4212179010 wait complete. 2023-10-10T21:18:47.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.364+0000 7f77459ff700 1 Processor -- start 2023-10-10T21:18:47.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.365+0000 7f77459ff700 1 -- start start 2023-10-10T21:18:47.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.365+0000 7f77459ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac230 0x7f7740148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.365+0000 7f77459ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77400ac6d0 0x7f77400a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.365+0000 7f77459ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7740155c10 0x7f77400aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.365+0000 7f77459ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77400cc320 con 0x7f77400ac6d0 2023-10-10T21:18:47.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.365+0000 7f77459ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77400aa4b0 con 0x7f7740155c10 2023-10-10T21:18:47.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.365+0000 7f77459ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77400a9c00 con 0x7f77400ac230 2023-10-10T21:18:47.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77400ac6d0 0x7f77400a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77400ac6d0 0x7f77400a65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42674/0 (socket says 172.21.15.154:42674) 2023-10-10T21:18:47.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773e7fc700 1 -- 172.21.15.154:0/1741674242 learned_addr learned my addr 172.21.15.154:0/1741674242 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:47.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773f7fe700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7740155c10 0x7f77400aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773effd700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac230 0x7f7740148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773e7fc700 1 -- 172.21.15.154:0/1741674242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac230 msgr2=0x7f7740148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773e7fc700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac230 0x7f7740148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773e7fc700 1 -- 172.21.15.154:0/1741674242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7740155c10 msgr2=0x7f77400aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773e7fc700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7740155c10 0x7f77400aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773e7fc700 1 -- 172.21.15.154:0/1741674242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7730009420 con 0x7f77400ac6d0 2023-10-10T21:18:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773f7fe700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7740155c10 0x7f77400aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.366+0000 7f773e7fc700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77400ac6d0 0x7f77400a65a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f773400c7c0 tx=0x7f7734007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.367+0000 7f7726ffd700 1 -- 172.21.15.154:0/1741674242 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734005b30 con 0x7f77400ac6d0 2023-10-10T21:18:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.367+0000 7f7726ffd700 1 -- 172.21.15.154:0/1741674242 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7734005cb0 con 0x7f77400ac6d0 2023-10-10T21:18:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.367+0000 7f7726ffd700 1 -- 172.21.15.154:0/1741674242 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734007320 con 0x7f77400ac6d0 2023-10-10T21:18:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.367+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7738009a20 con 0x7f77400ac6d0 2023-10-10T21:18:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.367+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77400a6ae0 con 0x7f77400ac6d0 2023-10-10T21:18:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.368+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774004c3c0 con 0x7f77400ac6d0 2023-10-10T21:18:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.369+0000 7f7726ffd700 1 -- 172.21.15.154:0/1741674242 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f773401b3b0 con 0x7f77400ac6d0 2023-10-10T21:18:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.370+0000 7f7726ffd700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f772c066f30 0x7f772c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.370+0000 7f7726ffd700 1 -- 172.21.15.154:0/1741674242 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f7734083bf0 con 0x7f77400ac6d0 2023-10-10T21:18:47.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.370+0000 7f773effd700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f772c066f30 0x7f772c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.371+0000 7f773effd700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f772c066f30 0x7f772c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7730009ea0 tx=0x7f77300091a0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:47.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.373+0000 7f7726ffd700 1 -- 172.21.15.154:0/1741674242 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7734050cd0 con 0x7f77400ac6d0 2023-10-10T21:18:47.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.612+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77400aa5f0 con 0x7f77400ac6d0 2023-10-10T21:18:47.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.612+0000 7f7726ffd700 1 -- 172.21.15.154:0/1741674242 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f7734017020 con 0x7f77400ac6d0 2023-10-10T21:18:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:47.614 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1983002927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1983002927},{"type":"v1","addr":"172.21.15.179:6835","nonce":1983002927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3483729269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3483729269},{"type":"v1","addr":"172.21.15.179:6834","nonce":3483729269}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3602154448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3602154448},{"type":"v1","addr":"172.21.15.154:6837","nonce":3602154448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:43.589800+0000","modified":"2023-10-10T21:18:47.153053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/2335601961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2335601961},{"type":"v1","addr":"172.21.15.154:6835","nonce":2335601961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-10T21:18:47.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.614+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f772c066f30 msgr2=0x7f772c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.614+0000 7f77459ff700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f772c066f30 0x7f772c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7730009ea0 tx=0x7f77300091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.614+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77400ac6d0 msgr2=0x7f77400a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.614+0000 7f77459ff700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77400ac6d0 0x7f77400a65a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f773400c7c0 tx=0x7f7734007e00 comp rx=0 tx=0).stop 2023-10-10T21:18:47.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.615+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 shutdown_connections 2023-10-10T21:18:47.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.615+0000 7f77459ff700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f772c066f30 0x7f772c0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.615+0000 7f77459ff700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7740155c10 0x7f77400aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.615+0000 7f77459ff700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77400ac230 0x7f7740148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.615+0000 7f77459ff700 1 --2- 172.21.15.154:0/1741674242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77400ac6d0 0x7f77400a65a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.615+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 >> 172.21.15.154:0/1741674242 conn(0x7f774006a320 msgr2=0x7f774006e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:47.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.615+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 shutdown_connections 2023-10-10T21:18:47.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.615+0000 7f77459ff700 1 -- 172.21.15.154:0/1741674242 wait complete. 2023-10-10T21:18:47.618 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 45 2023-10-10T21:18:47.633 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:18:47.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.816+0000 7f33fdb9d700 1 Processor -- start 2023-10-10T21:18:47.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.817+0000 7f33fdb9d700 1 -- start start 2023-10-10T21:18:47.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.818+0000 7f33fdb9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f33f806d950 0x7f33f80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.818+0000 7f33fdb9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33f806a0a0 0x7f33f80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.818+0000 7f33fdb9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f806ae70 con 0x7f33f806dd20 2023-10-10T21:18:47.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.818+0000 7f33fdb9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f806a540 con 0x7f33f806a0a0 2023-10-10T21:18:47.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.818+0000 7f33fdb9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f806a820 con 0x7f33f806d950 2023-10-10T21:18:47.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.818+0000 7f33f7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33f806a0a0 0x7f33f80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.818+0000 7f33f7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33f806a0a0 0x7f33f80c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42678/0 (socket says 172.21.15.154:42678) 2023-10-10T21:18:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.818+0000 7f33f7fff700 1 -- 172.21.15.154:0/1114559934 learned_addr learned my addr 172.21.15.154:0/1114559934 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.818+0000 7f33fcb9b700 1 --2- 172.21.15.154:0/1114559934 >> v2:172.21.15.179:3300/0 conn(0x7f33f806d950 0x7f33f80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.819+0000 7f33f7fff700 1 -- 172.21.15.154:0/1114559934 >> v2:172.21.15.179:3300/0 conn(0x7f33f806d950 msgr2=0x7f33f80c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:47.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.819+0000 7f33f7fff700 1 --2- 172.21.15.154:0/1114559934 >> v2:172.21.15.179:3300/0 conn(0x7f33f806d950 0x7f33f80c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.819+0000 7f33f7fff700 1 -- 172.21.15.154:0/1114559934 >> v1:172.21.15.179:6789/0 conn(0x7f33f806dd20 legacy=0x7f33f80c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.819+0000 7f33f7fff700 1 -- 172.21.15.154:0/1114559934 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f806ab00 con 0x7f33f806a0a0 2023-10-10T21:18:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.819+0000 7f33f7fff700 1 --2- 172.21.15.154:0/1114559934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806a0a0 0x7f33f80c6c10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f33f80c9c70 tx=0x7f33e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691c5aebe4bac048 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.819+0000 7f33f77fe700 1 -- 172.21.15.154:0/1114559934 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4009e70 con 0x7f33f806a0a0 2023-10-10T21:18:47.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.819+0000 7f33f77fe700 1 -- 172.21.15.154:0/1114559934 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e400b860 con 0x7f33f806a0a0 2023-10-10T21:18:47.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.819+0000 7f33f77fe700 1 -- 172.21.15.154:0/1114559934 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400bc00 con 0x7f33f806a0a0 2023-10-10T21:18:47.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.820+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1114559934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806a0a0 msgr2=0x7f33f80c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.820+0000 7f33fdb9d700 1 --2- 172.21.15.154:0/1114559934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806a0a0 0x7f33f80c6c10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f33f80c9c70 tx=0x7f33e4009250 comp rx=0 tx=0).stop 2023-10-10T21:18:47.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.820+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1114559934 shutdown_connections 2023-10-10T21:18:47.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.820+0000 7f33fdb9d700 1 --2- 172.21.15.154:0/1114559934 >> v2:172.21.15.179:3300/0 conn(0x7f33f806d950 0x7f33f80c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.820+0000 7f33fdb9d700 1 --2- 172.21.15.154:0/1114559934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806a0a0 0x7f33f80c6c10 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.820+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1114559934 >> 172.21.15.154:0/1114559934 conn(0x7f33f80cc1f0 msgr2=0x7f33f80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:47.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.820+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1114559934 shutdown_connections 2023-10-10T21:18:47.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.820+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1114559934 wait complete. 2023-10-10T21:18:47.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.821+0000 7f33fdb9d700 1 Processor -- start 2023-10-10T21:18:47.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.821+0000 7f33fdb9d700 1 -- start start 2023-10-10T21:18:47.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.822+0000 7f33fdb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33f806a0a0 0x7f33f80ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.822+0000 7f33fdb9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806d950 0x7f33f80cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.822+0000 7f33fdb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33f806dd20 0x7f33f80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.822+0000 7f33fdb9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80ca520 con 0x7f33f806d950 2023-10-10T21:18:47.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.822+0000 7f33fdb9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80c5f00 con 0x7f33f806dd20 2023-10-10T21:18:47.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.822+0000 7f33fdb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80cbdc0 con 0x7f33f806a0a0 2023-10-10T21:18:47.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33f7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806d950 0x7f33f80cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33f7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806d950 0x7f33f80cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42684/0 (socket says 172.21.15.154:42684) 2023-10-10T21:18:47.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33f7fff700 1 -- 172.21.15.154:0/1126428893 learned_addr learned my addr 172.21.15.154:0/1126428893 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:47.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33fcb9b700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33f806a0a0 0x7f33f80ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33fd39c700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33f806dd20 0x7f33f80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33f7fff700 1 -- 172.21.15.154:0/1126428893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33f806a0a0 msgr2=0x7f33f80ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33f7fff700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33f806a0a0 0x7f33f80ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33f7fff700 1 -- 172.21.15.154:0/1126428893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33f806dd20 msgr2=0x7f33f80adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:47.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33f7fff700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33f806dd20 0x7f33f80adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:47.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33f7fff700 1 -- 172.21.15.154:0/1126428893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40094f0 con 0x7f33f806d950 2023-10-10T21:18:47.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.823+0000 7f33f7fff700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806d950 0x7f33f80cb880 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f33f806fe40 tx=0x7f33e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:47.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.824+0000 7f33f4ff9700 1 -- 172.21.15.154:0/1126428893 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400bbe0 con 0x7f33f806d950 2023-10-10T21:18:47.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.824+0000 7f33f4ff9700 1 -- 172.21.15.154:0/1126428893 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4011420 con 0x7f33f806d950 2023-10-10T21:18:47.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.824+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f80af500 con 0x7f33f806d950 2023-10-10T21:18:47.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.824+0000 7f33f4ff9700 1 -- 172.21.15.154:0/1126428893 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40117e0 con 0x7f33f806d950 2023-10-10T21:18:47.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.824+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f80ca140 con 0x7f33f806d950 2023-10-10T21:18:47.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.825+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f80ca660 con 0x7f33f806d950 2023-10-10T21:18:47.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.826+0000 7f33f4ff9700 1 -- 172.21.15.154:0/1126428893 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33e4011c10 con 0x7f33f806d950 2023-10-10T21:18:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.827+0000 7f33f4ff9700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f33dc066f30 0x7f33dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.827+0000 7f33f4ff9700 1 -- 172.21.15.154:0/1126428893 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f33e4085f30 con 0x7f33f806d950 2023-10-10T21:18:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.827+0000 7f33fcb9b700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f33dc066f30 0x7f33dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.828+0000 7f33fcb9b700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f33dc066f30 0x7f33dc0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009db0 tx=0x7f33ec0091a0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:47.832+0000 7f33f4ff9700 1 -- 172.21.15.154:0/1126428893 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33f80ca660 con 0x7f33f806d950 2023-10-10T21:18:48.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.024+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33f80ca660 con 0x7f33f806d950 2023-10-10T21:18:48.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.025+0000 7f33f4ff9700 1 -- 172.21.15.154:0/1126428893 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16007 (secure 0 0 0) 0x7f33f80ca660 con 0x7f33f806d950 2023-10-10T21:18:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:48.027 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":109,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:18:45.134253+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:41.726498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:42.567446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:18:48.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f33dc066f30 msgr2=0x7f33dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f33dc066f30 0x7f33dc0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009db0 tx=0x7f33ec0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806d950 msgr2=0x7f33f80cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806d950 0x7f33f80cb880 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f33f806fe40 tx=0x7f33e4017000 comp rx=0 tx=0).stop 2023-10-10T21:18:48.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 shutdown_connections 2023-10-10T21:18:48.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f33dc066f30 0x7f33dc0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33f806dd20 0x7f33f80adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33f806a0a0 0x7f33f80ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 --2- 172.21.15.154:0/1126428893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f806d950 0x7f33f80cb880 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 >> 172.21.15.154:0/1126428893 conn(0x7f33f80cc1f0 msgr2=0x7f33f8155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:48.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 shutdown_connections 2023-10-10T21:18:48.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.028+0000 7f33fdb9d700 1 -- 172.21.15.154:0/1126428893 wait complete. 2023-10-10T21:18:48.047 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T21:18:48.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:48.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.228+0000 7f86829ff700 1 Processor -- start 2023-10-10T21:18:48.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.229+0000 7f86829ff700 1 -- start start 2023-10-10T21:18:48.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.230+0000 7f86829ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f867c0b1850 0x7f867c0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.230+0000 7f86829ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f867c0ae680 0x7f867c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.230+0000 7f86829ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c0cb300 con 0x7f867c0aeb00 2023-10-10T21:18:48.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.230+0000 7f86829ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c06fc30 con 0x7f867c0b1850 2023-10-10T21:18:48.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.230+0000 7f86829ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c0cc260 con 0x7f867c0ae680 2023-10-10T21:18:48.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.230+0000 7f867bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f867c0b1850 0x7f867c0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:48.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.230+0000 7f8680f9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f867c0aeb00 0x7f867c15b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33904/0 (socket says 172.21.15.154:33904) 2023-10-10T21:18:48.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.230+0000 7f8680f9c700 1 -- 172.21.15.154:0/2448412754 learned_addr learned my addr 172.21.15.154:0/2448412754 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:48.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.230+0000 7f867b7fe700 1 --2- 172.21.15.154:0/2448412754 >> v2:172.21.15.179:3300/0 conn(0x7f867c0ae680 0x7f867c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:48.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867affd700 1 -- 172.21.15.154:0/2448412754 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286734259 0 0) 0x7f867c0cb300 con 0x7f867c0aeb00 2023-10-10T21:18:48.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867bfff700 1 -- 172.21.15.154:0/2448412754 >> v2:172.21.15.179:3300/0 conn(0x7f867c0ae680 msgr2=0x7f867c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:48.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867bfff700 1 --2- 172.21.15.154:0/2448412754 >> v2:172.21.15.179:3300/0 conn(0x7f867c0ae680 0x7f867c1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867bfff700 1 -- 172.21.15.154:0/2448412754 >> v1:172.21.15.154:6789/0 conn(0x7f867c0aeb00 legacy=0x7f867c15b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867bfff700 1 -- 172.21.15.154:0/2448412754 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0cb5e0 con 0x7f867c0b1850 2023-10-10T21:18:48.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867b7fe700 1 --2- 172.21.15.154:0/2448412754 >> v2:172.21.15.179:3300/0 conn(0x7f867c0ae680 0x7f867c1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:48.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867bfff700 1 --2- 172.21.15.154:0/2448412754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0b1850 0x7f867c0b1c20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f867c06d340 tx=0x7f866c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29ee8f4b327dcb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:48.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867affd700 1 -- 172.21.15.154:0/2448412754 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c00b6b0 con 0x7f867c0b1850 2023-10-10T21:18:48.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867affd700 1 -- 172.21.15.154:0/2448412754 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c00b810 con 0x7f867c0b1850 2023-10-10T21:18:48.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.231+0000 7f867affd700 1 -- 172.21.15.154:0/2448412754 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c00bbb0 con 0x7f867c0b1850 2023-10-10T21:18:48.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.232+0000 7f86829ff700 1 -- 172.21.15.154:0/2448412754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0b1850 msgr2=0x7f867c0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.232+0000 7f86829ff700 1 --2- 172.21.15.154:0/2448412754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0b1850 0x7f867c0b1c20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f867c06d340 tx=0x7f866c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.232+0000 7f86829ff700 1 -- 172.21.15.154:0/2448412754 shutdown_connections 2023-10-10T21:18:48.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.232+0000 7f86829ff700 1 --2- 172.21.15.154:0/2448412754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0b1850 0x7f867c0b1c20 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.232+0000 7f86829ff700 1 --2- 172.21.15.154:0/2448412754 >> v2:172.21.15.179:3300/0 conn(0x7f867c0ae680 0x7f867c1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.232+0000 7f86829ff700 1 -- 172.21.15.154:0/2448412754 >> 172.21.15.154:0/2448412754 conn(0x7f867c06a320 msgr2=0x7f867c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:48.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.232+0000 7f86829ff700 1 -- 172.21.15.154:0/2448412754 shutdown_connections 2023-10-10T21:18:48.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.232+0000 7f86829ff700 1 -- 172.21.15.154:0/2448412754 wait complete. 2023-10-10T21:18:48.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.233+0000 7f86829ff700 1 Processor -- start 2023-10-10T21:18:48.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.233+0000 7f86829ff700 1 -- start start 2023-10-10T21:18:48.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.234+0000 7f86829ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0ae680 0x7f867c167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.234+0000 7f86829ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f867c0aeb00 0x7f867c14c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.234+0000 7f86829ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f867c0b1850 0x7f867c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.234+0000 7f86829ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0a5990 con 0x7f867c0ae680 2023-10-10T21:18:48.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.234+0000 7f86829ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1682c0 con 0x7f867c0b1850 2023-10-10T21:18:48.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.234+0000 7f86829ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1685a0 con 0x7f867c0aeb00 2023-10-10T21:18:48.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.234+0000 7f867bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0ae680 0x7f867c167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:48.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.234+0000 7f867bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0ae680 0x7f867c167a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42698/0 (socket says 172.21.15.154:42698) 2023-10-10T21:18:48.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f867bfff700 1 -- 172.21.15.154:0/1782792268 learned_addr learned my addr 172.21.15.154:0/1782792268 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:48.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f867bfff700 1 -- 172.21.15.154:0/1782792268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f867c0aeb00 msgr2=0x7f867c14c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f867bfff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f867c0aeb00 0x7f867c14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f867bfff700 1 -- 172.21.15.154:0/1782792268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f867c0b1850 msgr2=0x7f867c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f867bfff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f867c0b1850 0x7f867c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f867bfff700 1 -- 172.21.15.154:0/1782792268 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c009420 con 0x7f867c0ae680 2023-10-10T21:18:48.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f867bfff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0ae680 0x7f867c167a70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f867c064290 tx=0x7f866c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:48.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f8663fff700 1 -- 172.21.15.154:0/1782792268 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c00bb90 con 0x7f867c0ae680 2023-10-10T21:18:48.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f8663fff700 1 -- 172.21.15.154:0/1782792268 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c011420 con 0x7f867c0ae680 2023-10-10T21:18:48.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c168880 con 0x7f867c0ae680 2023-10-10T21:18:48.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.235+0000 7f8663fff700 1 -- 172.21.15.154:0/1782792268 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c0117a0 con 0x7f867c0ae680 2023-10-10T21:18:48.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.236+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c167fb0 con 0x7f867c0ae680 2023-10-10T21:18:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.236+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c04c3c0 con 0x7f867c0ae680 2023-10-10T21:18:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.237+0000 7f8663fff700 1 -- 172.21.15.154:0/1782792268 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f866c011b90 con 0x7f867c0ae680 2023-10-10T21:18:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.239+0000 7f8663fff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8668066f30 0x7f86680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.239+0000 7f8663fff700 1 -- 172.21.15.154:0/1782792268 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f866c085a50 con 0x7f867c0ae680 2023-10-10T21:18:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.239+0000 7f867b7fe700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8668066f30 0x7f86680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:48.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.239+0000 7f867b7fe700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8668066f30 0x7f86680693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8670006fd0 tx=0x7f8670008040 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:48.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.243+0000 7f8663fff700 1 -- 172.21.15.154:0/1782792268 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f866c052bb0 con 0x7f867c0ae680 2023-10-10T21:18:48.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.429+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f867c0cb930 con 0x7f8668066f30 2023-10-10T21:18:48.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.440+0000 7f8663fff700 1 -- 172.21.15.154:0/1782792268 <== mgr.7005 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278435 (secure 0 0 0) 0x7f867c0cb930 con 0x7f8668066f30 2023-10-10T21:18:48.444 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:48.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8668066f30 msgr2=0x7f86680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8668066f30 0x7f86680693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8670006fd0 tx=0x7f8670008040 comp rx=0 tx=0).stop 2023-10-10T21:18:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0ae680 msgr2=0x7f867c167a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0ae680 0x7f867c167a70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f867c064290 tx=0x7f866c017000 comp rx=0 tx=0).stop 2023-10-10T21:18:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 shutdown_connections 2023-10-10T21:18:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f8668066f30 0x7f86680693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f867c0b1850 0x7f867c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f867c0ae680 0x7f867c167a70 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 --2- 172.21.15.154:0/1782792268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f867c0aeb00 0x7f867c14c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 >> 172.21.15.154:0/1782792268 conn(0x7f867c06a320 msgr2=0x7f867c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 shutdown_connections 2023-10-10T21:18:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.444+0000 7f86829ff700 1 -- 172.21.15.154:0/1782792268 wait complete. 2023-10-10T21:18:48.450 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:48.463 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:18:47.802873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434652,"kb_used_data":11292,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752540068,"statfs":{"total":773094113280,"available":770601029632,"internally_reserved":0,"allocated":11563008,"data_stored":6195435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.697706"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.115534+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:35:46.290302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109843+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109010+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:55:49.835696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108971+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:36:27.443230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.110359+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:10:05.363157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.111398+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108874+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:17.981214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114314+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:53:41.232395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114973+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:42:45.021098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114882+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:17:51.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114971+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.906487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109760+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114342+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:45:17.482713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112808+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:46.150644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109400+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108400+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:23.191516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114034+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:40:19.580114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108499+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:19.947370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108351+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112998+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:16:11.845827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.111209+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:12:06.218712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.111194+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:34:39.569883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112855+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:48:02.772181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114393+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:09.281034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.115019+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:00:53.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.113755+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:59:19.441836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114142+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:32.382395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108369+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.110832+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114618+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:34.565647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109674+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112548+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:12:12.433840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"98'205","reported_seq":549,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-10T21:18:40.743304+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:40.743304+0000","last_peered":"2023-10-10T21:18:40.743304+0000","last_clean":"2023-10-10T21:18:40.743304+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:40.743304+0000","last_undegraded":"2023-10-10T21:18:40.743304+0000","last_fullsized":"2023-10-10T21:18:40.743304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542341,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303232,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068608,"statfs":{"total":96636764160,"available":96326254592,"internally_reserved":0,"allocated":1892352,"data_stored":1217980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.014,"15min":1.1859999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.72299999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.45200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.79600000000000004,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88600000000000001,"5min":1.0069999999999999,"15min":1.123},"last":0.624}]},{"osd":2,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67000000000000004,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.50600000000000001,"5min":0.504,"15min":0.433},"max":{"1min":0.79800000000000004,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Tue Oct 10 21:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.0589999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2669999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.623,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":0.88200000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.627},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90300000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.81899999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.995}]}]},{"osd":6,"up_from":14,"seq":60129542340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66200000000000003,"15min":0.68999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":1.0189999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.92600000000000005,"15min":1.1040000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.502,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.03},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.497,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.98699999999999999,"15min":1.073},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.69299999999999995},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86199999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.54900000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.64000000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.501,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":0.84599999999999997,"5min":1.042,"15min":1.042},"last":0.69999999999999996}]},{"osd":4,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.97199999999999998},"last":0.626}]},{"osd":5,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.54200000000000004,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.022},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.94499999999999995,"5min":1.024,"15min":1.0629999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.0289999999999999},"last":0.72999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.61899999999999999,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":0.622,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.503,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.63700000000000001,"5min":2.254,"15min":2.254},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66300000000000003,"5min":0.999,"15min":0.999},"last":0.46899999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80700000000000005,"5min":4.806,"15min":4.806},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.754,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.871,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.625}]},{"osd":5,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.79500000000000004,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.73499999999999999,"5min":6.968,"15min":6.968},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.89000000000000001,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.876,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91500000000000004,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.83499999999999996},"min":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84199999999999997,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.81699999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.502,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.83499999999999996,"5min":12.026,"15min":12.026},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.86599999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.85899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542342,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":1217980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.61199999999999999,"5min":0.74399999999999999,"15min":0.752},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68899999999999995,"5min":0.879,"15min":0.91800000000000004},"last":0.44600000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.82099999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.34499999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.70899999999999996,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.72499999999999998,"5min":0.874,"15min":1.2909999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.58799999999999997,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.96799999999999997,"5min":1.101,"15min":1.1080000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.49099999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85999999999999999,"5min":0.96599999999999997,"15min":1.1879999999999999},"last":0.626}]},{"osd":5,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":0.96899999999999997,"5min":1.03,"15min":1.2190000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79500000000000004,"15min":0.82399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.054,"15min":1.143},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0529999999999999,"5min":1.139,"15min":1.169},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.024,"15min":1.165},"last":0.61599999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542342,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306736,"kb_used_data":1256,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065104,"statfs":{"total":96636764160,"available":96322666496,"internally_reserved":0,"allocated":1286144,"data_stored":621415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.75,"15min":0.95699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.443,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53600000000000003,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.496},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71899999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.53400000000000003,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.92000000000000004,"5min":1.157,"15min":1.3109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":0.91900000000000004,"5min":1.26,"15min":1.26},"last":0.53500000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97299999999999998,"5min":2.21,"15min":2.21},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.75,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.268},"last":0.623}]},{"osd":6,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.0509999999999999,"15min":1.3080000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.79500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.63600000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.79200000000000004},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2290000000000001,"5min":1.716,"15min":1.716},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":1.006,"15min":1.2330000000000001},"last":0.64800000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509637,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306748,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065092,"statfs":{"total":96636764160,"available":96322654208,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.371},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28799999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.544},"last":0.501}]},{"osd":1,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.501},"min":{"1min":0.315,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.6759999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.68400000000000005,"5min":0.73399999999999999,"15min":1.4610000000000001},"last":0.436}]},{"osd":2,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.7070000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.4990000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.6359999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.246},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.262},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76700000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.2250000000000001,"15min":1.579},"last":0.66800000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.081,"5min":1.27,"15min":1.27},"last":0.625},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.224,"15min":1.224},"last":0.72199999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.111,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.228,"5min":1.228,"15min":1.3200000000000001},"last":0.65200000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542342,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310844,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060996,"statfs":{"total":96636764160,"available":96318459904,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41499999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.68799999999999994,"15min":0.72599999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.121,"5min":1.121,"15min":1.5029999999999999},"last":0.44}]},{"osd":1,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.47},"last":0.628},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67100000000000004,"15min":0.69699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.52800000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97499999999999998,"5min":1.002,"15min":1.536},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.397},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.385},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1,"5min":1.0009999999999999,"15min":1.196},"last":0.57999999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.66700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.68899999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.216},"last":0.69699999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98999999999999999,"5min":1.006,"15min":1.2390000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70199999999999996,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":1.034,"5min":1.034,"15min":1.4139999999999999},"last":0.63700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.66700000000000004,"15min":0.68999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.95399999999999996},"last":0.75},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.79300000000000004,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.66800000000000004,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.748,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.68100000000000005,"15min":0.71299999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.99299999999999999,"15min":1.018},"last":0.56699999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68200000000000005,"15min":0.71099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96699999999999997},"last":0.78400000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.5,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":1.044},"last":0.627}]},{"osd":4,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.62,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.78800000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":1.496,"15min":1.496},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84799999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0049999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.81599999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93500000000000005,"5min":1.077,"15min":1.077},"last":0.90400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:48.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:48.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.685+0000 7f368fdff700 1 Processor -- start 2023-10-10T21:18:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.685+0000 7f368fdff700 1 -- start start 2023-10-10T21:18:48.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368fdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36880b0a10 0x7f3688155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368fdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36880ad930 con 0x7f3688155c10 2023-10-10T21:18:48.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368fdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36880acd20 con 0x7f36881578b0 2023-10-10T21:18:48.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368fdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36880ad000 con 0x7f36880b0a10 2023-10-10T21:18:48.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368e39c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36880b0a10 0x7f3688155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368e39c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36880b0a10 0x7f3688155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42708/0 (socket says 172.21.15.154:42708) 2023-10-10T21:18:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368e39c700 1 -- 172.21.15.154:0/2015223224 learned_addr learned my addr 172.21.15.154:0/2015223224 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368db9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3688155c10 0x7f36880ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33916/0 (socket says 172.21.15.154:33916) 2023-10-10T21:18:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368e39c700 1 -- 172.21.15.154:0/2015223224 >> v1:172.21.15.179:6789/0 conn(0x7f36881578b0 legacy=0x7f36880af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368e39c700 1 -- 172.21.15.154:0/2015223224 >> v1:172.21.15.154:6789/0 conn(0x7f3688155c10 legacy=0x7f36880ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368e39c700 1 -- 172.21.15.154:0/2015223224 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880ad2e0 con 0x7f36880b0a10 2023-10-10T21:18:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.687+0000 7f368cb99700 1 -- 172.21.15.154:0/2015223224 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435706546 0 0) 0x7f36880ad930 con 0x7f3688155c10 2023-10-10T21:18:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.688+0000 7f368e39c700 1 --2- 172.21.15.154:0/2015223224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36880b0a10 0x7f3688155fe0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3680009f20 tx=0x7f3680009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7e6124a64020c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.688+0000 7f368cb99700 1 -- 172.21.15.154:0/2015223224 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000e070 con 0x7f36880b0a10 2023-10-10T21:18:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.688+0000 7f368cb99700 1 -- 172.21.15.154:0/2015223224 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368000ba80 con 0x7f36880b0a10 2023-10-10T21:18:48.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.688+0000 7f368cb99700 1 -- 172.21.15.154:0/2015223224 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36800092e0 con 0x7f36880b0a10 2023-10-10T21:18:48.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.688+0000 7f368fdff700 1 -- 172.21.15.154:0/2015223224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36880b0a10 msgr2=0x7f3688155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.688+0000 7f368fdff700 1 --2- 172.21.15.154:0/2015223224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36880b0a10 0x7f3688155fe0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3680009f20 tx=0x7f3680009840 comp rx=0 tx=0).stop 2023-10-10T21:18:48.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.688+0000 7f368fdff700 1 -- 172.21.15.154:0/2015223224 shutdown_connections 2023-10-10T21:18:48.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.688+0000 7f368fdff700 1 --2- 172.21.15.154:0/2015223224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36880b0a10 0x7f3688155fe0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.688+0000 7f368fdff700 1 -- 172.21.15.154:0/2015223224 >> 172.21.15.154:0/2015223224 conn(0x7f368806a320 msgr2=0x7f36880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:48.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.689+0000 7f368fdff700 1 -- 172.21.15.154:0/2015223224 shutdown_connections 2023-10-10T21:18:48.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.689+0000 7f368fdff700 1 -- 172.21.15.154:0/2015223224 wait complete. 2023-10-10T21:18:48.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.690+0000 7f368fdff700 1 Processor -- start 2023-10-10T21:18:48.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.690+0000 7f368fdff700 1 -- start start 2023-10-10T21:18:48.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36880b0a10 0x7f368815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368fdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688155c10 0x7f368816b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368fdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36881578b0 0x7f368813e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368fdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368816b560 con 0x7f3688155c10 2023-10-10T21:18:48.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368fdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368816c360 con 0x7f36881578b0 2023-10-10T21:18:48.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368816b750 con 0x7f36880b0a10 2023-10-10T21:18:48.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368d39a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688155c10 0x7f368816b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:48.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368d39a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688155c10 0x7f368816b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42724/0 (socket says 172.21.15.154:42724) 2023-10-10T21:18:48.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368d39a700 1 -- 172.21.15.154:0/1904730182 learned_addr learned my addr 172.21.15.154:0/1904730182 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:48.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368db9b700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36880b0a10 0x7f368815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:48.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.691+0000 7f368e39c700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36881578b0 0x7f368813e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:48.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f368d39a700 1 -- 172.21.15.154:0/1904730182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36880b0a10 msgr2=0x7f368815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f368d39a700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36880b0a10 0x7f368815ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f368d39a700 1 -- 172.21.15.154:0/1904730182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36881578b0 msgr2=0x7f368813e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f368d39a700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36881578b0 0x7f368813e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f368d39a700 1 -- 172.21.15.154:0/1904730182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680009ae0 con 0x7f3688155c10 2023-10-10T21:18:48.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f368d39a700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688155c10 0x7f368816b020 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f367800c510 tx=0x7f367800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:48.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f367dffb700 1 -- 172.21.15.154:0/1904730182 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678011590 con 0x7f3688155c10 2023-10-10T21:18:48.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f367dffb700 1 -- 172.21.15.154:0/1904730182 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3678011710 con 0x7f3688155c10 2023-10-10T21:18:48.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368816ba30 con 0x7f3688155c10 2023-10-10T21:18:48.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f367dffb700 1 -- 172.21.15.154:0/1904730182 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678011ad0 con 0x7f3688155c10 2023-10-10T21:18:48.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.692+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368816bff0 con 0x7f3688155c10 2023-10-10T21:18:48.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.693+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368804c3c0 con 0x7f3688155c10 2023-10-10T21:18:48.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.694+0000 7f367dffb700 1 -- 172.21.15.154:0/1904730182 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f367801b3b0 con 0x7f3688155c10 2023-10-10T21:18:48.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.695+0000 7f367dffb700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f366c066f30 0x7f366c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:48.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.695+0000 7f367dffb700 1 -- 172.21.15.154:0/1904730182 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3678083a80 con 0x7f3688155c10 2023-10-10T21:18:48.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.695+0000 7f368db9b700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f366c066f30 0x7f366c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:48.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.696+0000 7f368db9b700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f366c066f30 0x7f366c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f36881418a0 tx=0x7f3684007d30 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:48.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.699+0000 7f367dffb700 1 -- 172.21.15.154:0/1904730182 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3678050b60 con 0x7f3688155c10 2023-10-10T21:18:48.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.885+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f368816c4a0 con 0x7f366c066f30 2023-10-10T21:18:48.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.893+0000 7f367dffb700 1 -- 172.21.15.154:0/1904730182 <== mgr.7005 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278435 (secure 0 0 0) 0x7f368816c4a0 con 0x7f366c066f30 2023-10-10T21:18:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:48.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f366c066f30 msgr2=0x7f366c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f366c066f30 0x7f366c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f36881418a0 tx=0x7f3684007d30 comp rx=0 tx=0).stop 2023-10-10T21:18:48.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688155c10 msgr2=0x7f368816b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:48.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688155c10 0x7f368816b020 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f367800c510 tx=0x7f367800c820 comp rx=0 tx=0).stop 2023-10-10T21:18:48.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 shutdown_connections 2023-10-10T21:18:48.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f366c066f30 0x7f366c0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36881578b0 0x7f368813e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36880b0a10 0x7f368815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 --2- 172.21.15.154:0/1904730182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688155c10 0x7f368816b020 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:48.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.897+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 >> 172.21.15.154:0/1904730182 conn(0x7f368806a320 msgr2=0x7f36880b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:48.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.898+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 shutdown_connections 2023-10-10T21:18:48.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:48.898+0000 7f368fdff700 1 -- 172.21.15.154:0/1904730182 wait complete. 2023-10-10T21:18:48.903 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:48.916 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:18:47.802873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434652,"kb_used_data":11292,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752540068,"statfs":{"total":773094113280,"available":770601029632,"internally_reserved":0,"allocated":11563008,"data_stored":6195435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.697706"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.115534+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:35:46.290302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109843+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109010+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:55:49.835696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108971+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:36:27.443230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.110359+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:10:05.363157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.111398+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108874+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:17.981214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114314+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:53:41.232395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114973+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:42:45.021098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114882+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:17:51.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114971+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.906487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109760+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114342+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:45:17.482713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112808+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:46.150644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109400+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108400+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:23.191516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114034+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:40:19.580114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108499+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:19.947370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108351+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112998+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:16:11.845827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.111209+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:12:06.218712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.111194+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:34:39.569883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112855+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:48:02.772181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114393+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:09.281034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.115019+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:00:53.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.113755+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:59:19.441836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114142+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:32.382395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108369+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.110832+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114618+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:34.565647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109674+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112548+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:12:12.433840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"98'205","reported_seq":549,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-10T21:18:40.743304+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:40.743304+0000","last_peered":"2023-10-10T21:18:40.743304+0000","last_clean":"2023-10-10T21:18:40.743304+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:40.743304+0000","last_undegraded":"2023-10-10T21:18:40.743304+0000","last_fullsized":"2023-10-10T21:18:40.743304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542341,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303232,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068608,"statfs":{"total":96636764160,"available":96326254592,"internally_reserved":0,"allocated":1892352,"data_stored":1217980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.014,"15min":1.1859999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.72299999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.45200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.79600000000000004,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88600000000000001,"5min":1.0069999999999999,"15min":1.123},"last":0.624}]},{"osd":2,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67000000000000004,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.50600000000000001,"5min":0.504,"15min":0.433},"max":{"1min":0.79800000000000004,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Tue Oct 10 21:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.0589999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2669999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.623,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":0.88200000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.627},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90300000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.81899999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.995}]}]},{"osd":6,"up_from":14,"seq":60129542340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66200000000000003,"15min":0.68999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":1.0189999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.92600000000000005,"15min":1.1040000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.502,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.03},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.497,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.98699999999999999,"15min":1.073},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.69299999999999995},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86199999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.54900000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.64000000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.501,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":0.84599999999999997,"5min":1.042,"15min":1.042},"last":0.69999999999999996}]},{"osd":4,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.97199999999999998},"last":0.626}]},{"osd":5,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.54200000000000004,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.022},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.94499999999999995,"5min":1.024,"15min":1.0629999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.0289999999999999},"last":0.72999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.61899999999999999,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":0.622,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.503,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.63700000000000001,"5min":2.254,"15min":2.254},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66300000000000003,"5min":0.999,"15min":0.999},"last":0.46899999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80700000000000005,"5min":4.806,"15min":4.806},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.754,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.871,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.625}]},{"osd":5,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.79500000000000004,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.73499999999999999,"5min":6.968,"15min":6.968},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.89000000000000001,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.876,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91500000000000004,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.83499999999999996},"min":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84199999999999997,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.81699999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.502,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.83499999999999996,"5min":12.026,"15min":12.026},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.86599999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.85899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542342,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":1217980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.61199999999999999,"5min":0.74399999999999999,"15min":0.752},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68899999999999995,"5min":0.879,"15min":0.91800000000000004},"last":0.44600000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.82099999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.34499999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.70899999999999996,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.72499999999999998,"5min":0.874,"15min":1.2909999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.58799999999999997,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.96799999999999997,"5min":1.101,"15min":1.1080000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.49099999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85999999999999999,"5min":0.96599999999999997,"15min":1.1879999999999999},"last":0.626}]},{"osd":5,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":0.96899999999999997,"5min":1.03,"15min":1.2190000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79500000000000004,"15min":0.82399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.054,"15min":1.143},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0529999999999999,"5min":1.139,"15min":1.169},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.024,"15min":1.165},"last":0.61599999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542342,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306736,"kb_used_data":1256,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065104,"statfs":{"total":96636764160,"available":96322666496,"internally_reserved":0,"allocated":1286144,"data_stored":621415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.75,"15min":0.95699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.443,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53600000000000003,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.496},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71899999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.53400000000000003,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.92000000000000004,"5min":1.157,"15min":1.3109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":0.91900000000000004,"5min":1.26,"15min":1.26},"last":0.53500000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97299999999999998,"5min":2.21,"15min":2.21},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.75,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.268},"last":0.623}]},{"osd":6,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.0509999999999999,"15min":1.3080000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.79500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.63600000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.79200000000000004},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2290000000000001,"5min":1.716,"15min":1.716},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":1.006,"15min":1.2330000000000001},"last":0.64800000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509637,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306748,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065092,"statfs":{"total":96636764160,"available":96322654208,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.371},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28799999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.544},"last":0.501}]},{"osd":1,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.501},"min":{"1min":0.315,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.6759999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.68400000000000005,"5min":0.73399999999999999,"15min":1.4610000000000001},"last":0.436}]},{"osd":2,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.7070000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.4990000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.6359999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.246},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.262},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76700000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.2250000000000001,"15min":1.579},"last":0.66800000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.081,"5min":1.27,"15min":1.27},"last":0.625},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.224,"15min":1.224},"last":0.72199999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.111,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.228,"5min":1.228,"15min":1.3200000000000001},"last":0.65200000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542342,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310844,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060996,"statfs":{"total":96636764160,"available":96318459904,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41499999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.68799999999999994,"15min":0.72599999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.121,"5min":1.121,"15min":1.5029999999999999},"last":0.44}]},{"osd":1,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.47},"last":0.628},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67100000000000004,"15min":0.69699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.52800000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97499999999999998,"5min":1.002,"15min":1.536},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.397},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.385},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1,"5min":1.0009999999999999,"15min":1.196},"last":0.57999999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.66700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.68899999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.216},"last":0.69699999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98999999999999999,"5min":1.006,"15min":1.2390000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70199999999999996,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":1.034,"5min":1.034,"15min":1.4139999999999999},"last":0.63700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.66700000000000004,"15min":0.68999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.95399999999999996},"last":0.75},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.79300000000000004,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.66800000000000004,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.748,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.68100000000000005,"15min":0.71299999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.99299999999999999,"15min":1.018},"last":0.56699999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68200000000000005,"15min":0.71099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96699999999999997},"last":0.78400000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.5,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":1.044},"last":0.627}]},{"osd":4,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.62,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.78800000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":1.496,"15min":1.496},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84799999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0049999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.81599999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93500000000000005,"5min":1.077,"15min":1.077},"last":0.90400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:48.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:49.099 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-10-10T21:18:49.098+0000 7f3dc49f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:18:49.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.137+0000 7f5c6699d700 1 Processor -- start 2023-10-10T21:18:49.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.137+0000 7f5c6699d700 1 -- start start 2023-10-10T21:18:49.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.138+0000 7f5c6699d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c60156060 0x7f5c60156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.138+0000 7f5c6699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c600b15a0 0x7f5c6006a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.138+0000 7f5c6699d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6015af10 con 0x7f5c6015aa70 2023-10-10T21:18:49.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.138+0000 7f5c6699d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c600b00b0 con 0x7f5c60156060 2023-10-10T21:18:49.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.138+0000 7f5c6699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600b1d10 con 0x7f5c600b15a0 2023-10-10T21:18:49.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.138+0000 7f5c6599b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c60156060 0x7f5c60156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.138+0000 7f5c6599b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c60156060 0x7f5c60156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42732/0 (socket says 172.21.15.154:42732) 2023-10-10T21:18:49.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.138+0000 7f5c6599b700 1 -- 172.21.15.154:0/2586227185 learned_addr learned my addr 172.21.15.154:0/2586227185 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:49.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.138+0000 7f5c6519a700 1 --1- 172.21.15.154:0/2586227185 >> v1:172.21.15.154:6789/0 conn(0x7f5c6015aa70 0x7f5c600b0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33918/0 (socket says 172.21.15.154:33918) 2023-10-10T21:18:49.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c6619c700 1 --2- 172.21.15.154:0/2586227185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c600b15a0 0x7f5c6006a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c6599b700 1 -- 172.21.15.154:0/2586227185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c600b15a0 msgr2=0x7f5c6006a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:49.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c6599b700 1 --2- 172.21.15.154:0/2586227185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c600b15a0 0x7f5c6006a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c6599b700 1 -- 172.21.15.154:0/2586227185 >> v1:172.21.15.154:6789/0 conn(0x7f5c6015aa70 legacy=0x7f5c600b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c6599b700 1 -- 172.21.15.154:0/2586227185 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600b1ff0 con 0x7f5c60156060 2023-10-10T21:18:49.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c64999700 1 -- 172.21.15.154:0/2586227185 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164063786 0 0) 0x7f5c6015af10 con 0x7f5c6015aa70 2023-10-10T21:18:49.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c6599b700 1 --2- 172.21.15.154:0/2586227185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 0x7f5c60156430 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0099b0 tx=0x7f5c5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cd5e24028c2b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:49.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c64999700 1 -- 172.21.15.154:0/2586227185 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c009ea0 con 0x7f5c60156060 2023-10-10T21:18:49.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c64999700 1 -- 172.21.15.154:0/2586227185 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c00b8f0 con 0x7f5c60156060 2023-10-10T21:18:49.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.139+0000 7f5c64999700 1 -- 172.21.15.154:0/2586227185 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c00bc90 con 0x7f5c60156060 2023-10-10T21:18:49.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.140+0000 7f5c6699d700 1 -- 172.21.15.154:0/2586227185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 msgr2=0x7f5c60156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.140+0000 7f5c6699d700 1 --2- 172.21.15.154:0/2586227185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 0x7f5c60156430 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0099b0 tx=0x7f5c5c009250 comp rx=0 tx=0).stop 2023-10-10T21:18:49.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.140+0000 7f5c6699d700 1 -- 172.21.15.154:0/2586227185 shutdown_connections 2023-10-10T21:18:49.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.140+0000 7f5c6699d700 1 --2- 172.21.15.154:0/2586227185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c600b15a0 0x7f5c6006a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.140+0000 7f5c6699d700 1 --2- 172.21.15.154:0/2586227185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 0x7f5c60156430 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.140+0000 7f5c6699d700 1 -- 172.21.15.154:0/2586227185 >> 172.21.15.154:0/2586227185 conn(0x7f5c600cd310 msgr2=0x7f5c600cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:49.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.140+0000 7f5c6699d700 1 -- 172.21.15.154:0/2586227185 shutdown_connections 2023-10-10T21:18:49.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.140+0000 7f5c6699d700 1 -- 172.21.15.154:0/2586227185 wait complete. 2023-10-10T21:18:49.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.141+0000 7f5c6699d700 1 Processor -- start 2023-10-10T21:18:49.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.142+0000 7f5c6699d700 1 -- start start 2023-10-10T21:18:49.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.142+0000 7f5c6699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c600b15a0 0x7f5c60153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.142+0000 7f5c6699d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 0x7f5c6014a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.142+0000 7f5c6699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6015aa70 0x7f5c6016b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.142+0000 7f5c6699d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60154080 con 0x7f5c60156060 2023-10-10T21:18:49.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.142+0000 7f5c6699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c601526f0 con 0x7f5c600b15a0 2023-10-10T21:18:49.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.142+0000 7f5c6699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c601529d0 con 0x7f5c6015aa70 2023-10-10T21:18:49.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6519a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 0x7f5c6014a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6519a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 0x7f5c6014a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42738/0 (socket says 172.21.15.154:42738) 2023-10-10T21:18:49.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6519a700 1 -- 172.21.15.154:0/3169895608 learned_addr learned my addr 172.21.15.154:0/3169895608 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:49.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6599b700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c600b15a0 0x7f5c60153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6619c700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6015aa70 0x7f5c6016b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6519a700 1 -- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6015aa70 msgr2=0x7f5c6016b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6519a700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6015aa70 0x7f5c6016b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6519a700 1 -- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c600b15a0 msgr2=0x7f5c60153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6519a700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c600b15a0 0x7f5c60153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6519a700 1 -- 172.21.15.154:0/3169895608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c0094f0 con 0x7f5c60156060 2023-10-10T21:18:49.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6599b700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c600b15a0 0x7f5c60153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:49.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6619c700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6015aa70 0x7f5c6016b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:49.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c6519a700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 0x7f5c6014a260 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c5b0 tx=0x7f5c50001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:49.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.143+0000 7f5c55ffb700 1 -- 172.21.15.154:0/3169895608 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50005a70 con 0x7f5c60156060 2023-10-10T21:18:49.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.144+0000 7f5c55ffb700 1 -- 172.21.15.154:0/3169895608 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50005bd0 con 0x7f5c60156060 2023-10-10T21:18:49.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.144+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c60152cb0 con 0x7f5c60156060 2023-10-10T21:18:49.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.144+0000 7f5c55ffb700 1 -- 172.21.15.154:0/3169895608 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c500070d0 con 0x7f5c60156060 2023-10-10T21:18:49.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.144+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6016ac00 con 0x7f5c60156060 2023-10-10T21:18:49.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.145+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6016ae20 con 0x7f5c60156060 2023-10-10T21:18:49.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.146+0000 7f5c55ffb700 1 -- 172.21.15.154:0/3169895608 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c50007480 con 0x7f5c60156060 2023-10-10T21:18:49.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.146+0000 7f5c55ffb700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c44066f30 0x7f5c440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.146+0000 7f5c55ffb700 1 -- 172.21.15.154:0/3169895608 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5c50083c80 con 0x7f5c60156060 2023-10-10T21:18:49.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.147+0000 7f5c6599b700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c44066f30 0x7f5c440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.147+0000 7f5c6599b700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c44066f30 0x7f5c440693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0099b0 tx=0x7f5c5c017000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.151+0000 7f5c55ffb700 1 -- 172.21.15.154:0/3169895608 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c50050cc0 con 0x7f5c60156060 2023-10-10T21:18:49.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.336+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c6004c3c0 con 0x7f5c44066f30 2023-10-10T21:18:49.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.345+0000 7f5c55ffb700 1 -- 172.21.15.154:0/3169895608 <== mgr.7005 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278435 (secure 0 0 0) 0x7f5c6004c3c0 con 0x7f5c44066f30 2023-10-10T21:18:49.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:49.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c44066f30 msgr2=0x7f5c440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c44066f30 0x7f5c440693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0099b0 tx=0x7f5c5c017000 comp rx=0 tx=0).stop 2023-10-10T21:18:49.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 msgr2=0x7f5c6014a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 0x7f5c6014a260 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c5b0 tx=0x7f5c50001040 comp rx=0 tx=0).stop 2023-10-10T21:18:49.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 shutdown_connections 2023-10-10T21:18:49.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6015aa70 0x7f5c6016b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5c44066f30 0x7f5c440693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c600b15a0 0x7f5c60153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 --2- 172.21.15.154:0/3169895608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c60156060 0x7f5c6014a260 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 >> 172.21.15.154:0/3169895608 conn(0x7f5c600cd310 msgr2=0x7f5c6015d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:49.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 shutdown_connections 2023-10-10T21:18:49.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.349+0000 7f5c6699d700 1 -- 172.21.15.154:0/3169895608 wait complete. 2023-10-10T21:18:49.438 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:49.438 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:18:47.802873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434652,"kb_used_data":11292,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752540068,"statfs":{"total":773094113280,"available":770601029632,"internally_reserved":0,"allocated":11563008,"data_stored":6195435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.697706"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.115534+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:35:46.290302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109843+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109010+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:55:49.835696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108971+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:36:27.443230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.110359+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:10:05.363157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.111398+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108874+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:17.981214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114314+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:53:41.232395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114973+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:42:45.021098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114882+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:17:51.860347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114971+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.906487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109760+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114342+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:45:17.482713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112808+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:55:46.150644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109400+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108400+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:23.191516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114034+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:40:19.580114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108499+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:19.947370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108351+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112998+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:16:11.845827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.111209+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:12:06.218712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.111194+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:34:39.569883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112855+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:48:02.772181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114393+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:09.281034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.115019+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:00:53.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.113755+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:59:19.441836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114142+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:32.382395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.108369+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.110832+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.114618+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:34.565647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.109674+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:18:43.104747+0000","last_change":"2023-10-10T21:18:43.104747+0000","last_active":"2023-10-10T21:18:43.104747+0000","last_peered":"2023-10-10T21:18:43.104747+0000","last_clean":"2023-10-10T21:18:43.104747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:43.104747+0000","last_undegraded":"2023-10-10T21:18:43.104747+0000","last_fullsized":"2023-10-10T21:18:43.104747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:18:42.098878+0000","last_change":"2023-10-10T21:18:42.112548+0000","last_active":"2023-10-10T21:18:42.098878+0000","last_peered":"2023-10-10T21:18:42.098878+0000","last_clean":"2023-10-10T21:18:42.098878+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:18:42.098878+0000","last_undegraded":"2023-10-10T21:18:42.098878+0000","last_fullsized":"2023-10-10T21:18:42.098878+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:12:12.433840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"98'205","reported_seq":549,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-10T21:18:40.743304+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:40.743304+0000","last_peered":"2023-10-10T21:18:40.743304+0000","last_clean":"2023-10-10T21:18:40.743304+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:40.743304+0000","last_undegraded":"2023-10-10T21:18:40.743304+0000","last_fullsized":"2023-10-10T21:18:40.743304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542341,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303232,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068608,"statfs":{"total":96636764160,"available":96326254592,"internally_reserved":0,"allocated":1892352,"data_stored":1217980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.014,"15min":1.1859999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.72299999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.45200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.79600000000000004,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88600000000000001,"5min":1.0069999999999999,"15min":1.123},"last":0.624}]},{"osd":2,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67000000000000004,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.50600000000000001,"5min":0.504,"15min":0.433},"max":{"1min":0.79800000000000004,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Tue Oct 10 21:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.0589999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2669999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.623,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":0.88200000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.627},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90300000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.81899999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.995}]}]},{"osd":6,"up_from":14,"seq":60129542340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66200000000000003,"15min":0.68999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":1.0189999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.92600000000000005,"15min":1.1040000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.502,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.03},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.497,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.98699999999999999,"15min":1.073},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.69299999999999995},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86199999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.54900000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.64000000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.501,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":0.84599999999999997,"5min":1.042,"15min":1.042},"last":0.69999999999999996}]},{"osd":4,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.97199999999999998},"last":0.626}]},{"osd":5,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.54200000000000004,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.022},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.94499999999999995,"5min":1.024,"15min":1.0629999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.0289999999999999},"last":0.72999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.61899999999999999,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":0.622,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.503,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.63700000000000001,"5min":2.254,"15min":2.254},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66300000000000003,"5min":0.999,"15min":0.999},"last":0.46899999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80700000000000005,"5min":4.806,"15min":4.806},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.754,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.871,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.625}]},{"osd":5,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.79500000000000004,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.73499999999999999,"5min":6.968,"15min":6.968},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.89000000000000001,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.876,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91500000000000004,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.83499999999999996},"min":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84199999999999997,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.81699999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.502,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.83499999999999996,"5min":12.026,"15min":12.026},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.86599999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.85899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542342,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":1217980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.61199999999999999,"5min":0.74399999999999999,"15min":0.752},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68899999999999995,"5min":0.879,"15min":0.91800000000000004},"last":0.44600000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.82099999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.34499999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.70899999999999996,"5min":0.85999999999999999,"15min":1.6499999999999999},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.35899999999999999},"max":{"1min":0.72499999999999998,"5min":0.874,"15min":1.2909999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.58799999999999997,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.96799999999999997,"5min":1.101,"15min":1.1080000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.49099999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85999999999999999,"5min":0.96599999999999997,"15min":1.1879999999999999},"last":0.626}]},{"osd":5,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":0.96899999999999997,"5min":1.03,"15min":1.2190000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79500000000000004,"15min":0.82399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.054,"15min":1.143},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0529999999999999,"5min":1.139,"15min":1.169},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.024,"15min":1.165},"last":0.61599999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542342,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306736,"kb_used_data":1256,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065104,"statfs":{"total":96636764160,"available":96322666496,"internally_reserved":0,"allocated":1286144,"data_stored":621415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.75,"15min":0.95699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.443,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53600000000000003,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.496},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71899999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.53400000000000003,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.92000000000000004,"5min":1.157,"15min":1.3109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":0.91900000000000004,"5min":1.26,"15min":1.26},"last":0.53500000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97299999999999998,"5min":2.21,"15min":2.21},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.75,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.268},"last":0.623}]},{"osd":6,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.0509999999999999,"15min":1.3080000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.79500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.63600000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.79200000000000004},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2290000000000001,"5min":1.716,"15min":1.716},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":1.006,"15min":1.2330000000000001},"last":0.64800000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509637,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306748,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065092,"statfs":{"total":96636764160,"available":96322654208,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.27900000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.371},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28799999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":1.544},"last":0.501}]},{"osd":1,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.501},"min":{"1min":0.315,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.6759999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.68400000000000005,"5min":0.73399999999999999,"15min":1.4610000000000001},"last":0.436}]},{"osd":2,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.35899999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.7070000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.4990000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.6359999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.246},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.262},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76700000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.2250000000000001,"15min":1.579},"last":0.66800000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.081,"5min":1.27,"15min":1.27},"last":0.625},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.224,"15min":1.224},"last":0.72199999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.111,"5min":1.1319999999999999,"15min":1.6080000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.228,"5min":1.228,"15min":1.3200000000000001},"last":0.65200000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542342,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310844,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060996,"statfs":{"total":96636764160,"available":96318459904,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41499999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.68799999999999994,"15min":0.72599999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.121,"5min":1.121,"15min":1.5029999999999999},"last":0.44}]},{"osd":1,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.47},"last":0.628},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67100000000000004,"15min":0.69699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.52800000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97499999999999998,"5min":1.002,"15min":1.536},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.397},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.385},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1,"5min":1.0009999999999999,"15min":1.196},"last":0.57999999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.66700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.68899999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.216},"last":0.69699999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98999999999999999,"5min":1.006,"15min":1.2390000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70199999999999996,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":1.034,"5min":1.034,"15min":1.4139999999999999},"last":0.63700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302652,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069188,"statfs":{"total":96636764160,"available":96326848512,"internally_reserved":0,"allocated":1298432,"data_stored":627612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.66700000000000004,"15min":0.68999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.95399999999999996},"last":0.75},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.79300000000000004,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.66800000000000004,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.748,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.68100000000000005,"15min":0.71299999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.99299999999999999,"15min":1.018},"last":0.56699999999999995}]},{"osd":2,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68200000000000005,"15min":0.71099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96699999999999997},"last":0.78400000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.5,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":1.044},"last":0.627}]},{"osd":4,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.62,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.78800000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":1.496,"15min":1.496},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84799999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0049999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.81599999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93500000000000005,"5min":1.077,"15min":1.077},"last":0.90400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:49.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-10-10T21:18:49.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-10-10T21:18:49.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-10-10T21:18:49.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-10-10T21:18:49.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-10-10T21:18:49.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-10-10T21:18:49.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-10-10T21:18:49.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-10-10T21:18:49.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-10-10T21:18:49.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-10-10T21:18:49.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-10-10T21:18:49.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-10-10T21:18:49.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-10-10T21:18:49.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-10-10T21:18:49.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-10-10T21:18:49.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-10-10T21:18:49.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-10-10T21:18:49.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-10-10T21:18:49.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-10-10T21:18:49.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-10-10T21:18:49.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-10-10T21:18:49.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-10-10T21:18:49.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-10-10T21:18:49.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-10-10T21:18:49.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-10-10T21:18:49.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-10-10T21:18:49.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-10-10T21:18:49.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-10-10T21:18:49.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-10-10T21:18:49.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-10-10T21:18:49.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-10-10T21:18:49.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-10-10T21:18:49.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-10-10T21:18:49.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-10-10T21:18:49.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.115534+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:35:46.290302+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:49.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-10-10T21:18:49.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-10-10T21:18:49.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.109843+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:18:49.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-10-10T21:18:49.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-10-10T21:18:49.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.109010+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:55:49.835696+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:18:49.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-10-10T21:18:49.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-10-10T21:18:49.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.108971+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T21:36:27.443230+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:18:49.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-10-10T21:18:49.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-10-10T21:18:49.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.110359+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T09:10:05.363157+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:18:49.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-10-10T21:18:49.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-10-10T21:18:49.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.111398+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:18:49.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-10-10T21:18:49.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-10-10T21:18:49.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.108874+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:14:17.981214+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:18:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-10-10T21:18:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-10-10T21:18:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.114314+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:53:41.232395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:18:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-10-10T21:18:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-10-10T21:18:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.114973+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:42:45.021098+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-10-10T21:18:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-10-10T21:18:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.114882+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:17:51.860347+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-10-10T21:18:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-10-10T21:18:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.114971+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:09:10.906487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-10-10T21:18:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-10-10T21:18:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.109760+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:18:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-10-10T21:18:49.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-10-10T21:18:49.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.114342+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:45:17.482713+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:18:49.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-10-10T21:18:49.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-10-10T21:18:49.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.112808+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:55:46.150644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:18:49.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-10-10T21:18:49.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-10-10T21:18:49.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.109400+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:18:49.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-10-10T21:18:49.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-10-10T21:18:49.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.108400+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:32:23.191516+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:18:49.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-10-10T21:18:49.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-10-10T21:18:49.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.114034+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:40:19.580114+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:49.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-10-10T21:18:49.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-10-10T21:18:49.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.108499+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:45:19.947370+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:18:49.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-10-10T21:18:49.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-10-10T21:18:49.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.108351+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:18:49.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-10-10T21:18:49.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-10-10T21:18:49.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.112998+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:16:11.845827+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:18:49.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-10-10T21:18:49.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-10-10T21:18:49.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.111209+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:12:06.218712+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:18:49.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-10-10T21:18:49.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-10-10T21:18:49.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.111194+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:34:39.569883+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:18:49.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-10-10T21:18:49.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-10-10T21:18:49.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.112855+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:48:02.772181+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:18:49.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-10-10T21:18:49.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-10-10T21:18:49.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.114393+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:55:09.281034+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:18:49.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-10-10T21:18:49.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-10-10T21:18:49.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.115019+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:00:53.803014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:18:49.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-10-10T21:18:49.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-10-10T21:18:49.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.113755+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:59:19.441836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:49.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-10-10T21:18:49.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-10-10T21:18:49.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.114142+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T07:47:32.382395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:49.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-10-10T21:18:49.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-10-10T21:18:49.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.108369+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:18:49.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-10-10T21:18:49.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-10-10T21:18:49.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.110832+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:18:49.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-10-10T21:18:49.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-10-10T21:18:49.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.114618+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:10:34.565647+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:18:49.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-10-10T21:18:49.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-10-10T21:18:49.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.109674+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:18:49.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-10-10T21:18:49.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:18:43.104747+0000', 'last_change': '2023-10-10T21:18:43.104747+0000', 'last_active': '2023-10-10T21:18:43.104747+0000', 'last_peered': '2023-10-10T21:18:43.104747+0000', 'last_clean': '2023-10-10T21:18:43.104747+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:43.104747+0000', 'last_undegraded': '2023-10-10T21:18:43.104747+0000', 'last_fullsized': '2023-10-10T21:18:43.104747+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:43.104747+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:18:49.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-10-10T21:18:49.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:18:42.098878+0000', 'last_change': '2023-10-10T21:18:42.112548+0000', 'last_active': '2023-10-10T21:18:42.098878+0000', 'last_peered': '2023-10-10T21:18:42.098878+0000', 'last_clean': '2023-10-10T21:18:42.098878+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:18:42.098878+0000', 'last_undegraded': '2023-10-10T21:18:42.098878+0000', 'last_fullsized': '2023-10-10T21:18:42.098878+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'last_clean_scrub_stamp': '2023-10-10T21:18:42.098878+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:12:12.433840+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:18:49.528 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T21:18:49.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:18:49.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:18:49.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.724+0000 7f37d299d700 1 Processor -- start 2023-10-10T21:18:49.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.725+0000 7f37d299d700 1 -- start start 2023-10-10T21:18:49.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.726+0000 7f37d299d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37cc1567b0 0x7f37cc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.726+0000 7f37d299d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37cc157780 con 0x7f37cc1563e0 2023-10-10T21:18:49.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.726+0000 7f37d299d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37cc06f100 con 0x7f37cc06ece0 2023-10-10T21:18:49.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.726+0000 7f37d299d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37cc156c50 con 0x7f37cc1567b0 2023-10-10T21:18:49.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.726+0000 7f37d199b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f37cc1563e0 0x7f37cc0c9350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33932/0 (socket says 172.21.15.154:33932) 2023-10-10T21:18:49.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.726+0000 7f37d199b700 1 -- 172.21.15.154:0/1231834852 learned_addr learned my addr 172.21.15.154:0/1231834852 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:49.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.726+0000 7f37d119a700 1 --2- 172.21.15.154:0/1231834852 >> v2:172.21.15.179:3300/0 conn(0x7f37cc1567b0 0x7f37cc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.726+0000 7f37d0999700 1 -- 172.21.15.154:0/1231834852 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057860957 0 0) 0x7f37cc157780 con 0x7f37cc1563e0 2023-10-10T21:18:49.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d0999700 1 -- 172.21.15.154:0/1231834852 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b8003570 con 0x7f37cc1563e0 2023-10-10T21:18:49.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d0999700 1 -- 172.21.15.154:0/1231834852 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389773775 0 0) 0x7f37cc06f100 con 0x7f37cc06ece0 2023-10-10T21:18:49.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d0999700 1 -- 172.21.15.154:0/1231834852 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37cc157780 con 0x7f37cc06ece0 2023-10-10T21:18:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d0999700 1 -- 172.21.15.154:0/1231834852 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460433179 0 0) 0x7f37b8003570 con 0x7f37cc1563e0 2023-10-10T21:18:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d119a700 1 -- 172.21.15.154:0/1231834852 >> v1:172.21.15.179:6789/0 conn(0x7f37cc06ece0 legacy=0x7f37cc0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d119a700 1 -- 172.21.15.154:0/1231834852 >> v1:172.21.15.154:6789/0 conn(0x7f37cc1563e0 legacy=0x7f37cc0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d119a700 1 -- 172.21.15.154:0/1231834852 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc156e50 con 0x7f37cc1567b0 2023-10-10T21:18:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d119a700 1 --2- 172.21.15.154:0/1231834852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1567b0 0x7f37cc06e7a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0098e0 tx=0x7f37bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c28726a0e3d8a3eb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d0999700 1 -- 172.21.15.154:0/1231834852 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8001470 con 0x7f37cc1567b0 2023-10-10T21:18:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.727+0000 7f37d0999700 1 -- 172.21.15.154:0/1231834852 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc011420 con 0x7f37cc1567b0 2023-10-10T21:18:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.728+0000 7f37d0999700 1 -- 172.21.15.154:0/1231834852 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0117c0 con 0x7f37cc1567b0 2023-10-10T21:18:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.728+0000 7f37d299d700 1 -- 172.21.15.154:0/1231834852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1567b0 msgr2=0x7f37cc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.728+0000 7f37d299d700 1 --2- 172.21.15.154:0/1231834852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1567b0 0x7f37cc06e7a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0098e0 tx=0x7f37bc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.728+0000 7f37d299d700 1 -- 172.21.15.154:0/1231834852 shutdown_connections 2023-10-10T21:18:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.728+0000 7f37d299d700 1 --2- 172.21.15.154:0/1231834852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1567b0 0x7f37cc06e7a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.728+0000 7f37d299d700 1 -- 172.21.15.154:0/1231834852 >> 172.21.15.154:0/1231834852 conn(0x7f37cc0ccca0 msgr2=0x7f37cc0c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.728+0000 7f37d299d700 1 -- 172.21.15.154:0/1231834852 shutdown_connections 2023-10-10T21:18:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.728+0000 7f37d299d700 1 -- 172.21.15.154:0/1231834852 wait complete. 2023-10-10T21:18:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.730+0000 7f37d299d700 1 Processor -- start 2023-10-10T21:18:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.730+0000 7f37d299d700 1 -- start start 2023-10-10T21:18:49.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.730+0000 7f37d299d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc06ece0 0x7f37cc0c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1563e0 0x7f37cc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37cc1567b0 0x7f37cc14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d299d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0c3ef0 con 0x7f37cc06ece0 2023-10-10T21:18:49.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0c41d0 con 0x7f37cc1563e0 2023-10-10T21:18:49.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0c44b0 con 0x7f37cc1567b0 2023-10-10T21:18:49.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc06ece0 0x7f37cc0c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc06ece0 0x7f37cc0c36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42746/0 (socket says 172.21.15.154:42746) 2023-10-10T21:18:49.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d199b700 1 -- 172.21.15.154:0/1413165707 learned_addr learned my addr 172.21.15.154:0/1413165707 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:49.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d119a700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1563e0 0x7f37cc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d199b700 1 -- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37cc1567b0 msgr2=0x7f37cc14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d219c700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37cc1567b0 0x7f37cc14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d199b700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37cc1567b0 0x7f37cc14bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d199b700 1 -- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1563e0 msgr2=0x7f37cc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:49.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d199b700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1563e0 0x7f37cc06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:49.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d199b700 1 -- 172.21.15.154:0/1413165707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc009420 con 0x7f37cc06ece0 2023-10-10T21:18:49.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d119a700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1563e0 0x7f37cc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:49.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d219c700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37cc1567b0 0x7f37cc14bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:49.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.731+0000 7f37d199b700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc06ece0 0x7f37cc0c36a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f37c800cb90 tx=0x7f37c8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:49.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.732+0000 7f37c1ffb700 1 -- 172.21.15.154:0/1413165707 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8001d00 con 0x7f37cc06ece0 2023-10-10T21:18:49.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.732+0000 7f37c1ffb700 1 -- 172.21.15.154:0/1413165707 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c8007360 con 0x7f37cc06ece0 2023-10-10T21:18:49.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.732+0000 7f37c1ffb700 1 -- 172.21.15.154:0/1413165707 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8004830 con 0x7f37cc06ece0 2023-10-10T21:18:49.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.732+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37cc0c4790 con 0x7f37cc06ece0 2023-10-10T21:18:49.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.732+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37cc0c3be0 con 0x7f37cc06ece0 2023-10-10T21:18:49.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.733+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37cc04c3c0 con 0x7f37cc06ece0 2023-10-10T21:18:49.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.734+0000 7f37c1ffb700 1 -- 172.21.15.154:0/1413165707 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37c8004be0 con 0x7f37cc06ece0 2023-10-10T21:18:49.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.734+0000 7f37c1ffb700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37b0066f30 0x7f37b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:49.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.735+0000 7f37c1ffb700 1 -- 172.21.15.154:0/1413165707 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f37c8083f60 con 0x7f37cc06ece0 2023-10-10T21:18:49.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.735+0000 7f37d119a700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37b0066f30 0x7f37b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:49.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.735+0000 7f37d119a700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37b0066f30 0x7f37b00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0c2cd0 tx=0x7f37bc016000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:49.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:49.739+0000 7f37c1ffb700 1 -- 172.21.15.154:0/1413165707 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37c80510c0 con 0x7f37cc06ece0 2023-10-10T21:18:50.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.007+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f37cc04bb80 con 0x7f37cc06ece0 2023-10-10T21:18:50.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.008+0000 7f37c1ffb700 1 -- 172.21.15.154:0/1413165707 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1113 (secure 0 0 0) 0x7f37c8018080 con 0x7f37cc06ece0 2023-10-10T21:18:50.010 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:50.010 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1014,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2493083648,"bytes_avail":770601029632,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":45,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7179}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-10T21:16:29.405712+0000","services":{}},"progress_events":{}} 2023-10-10T21:18:50.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37b0066f30 msgr2=0x7f37b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37b0066f30 0x7f37b00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0c2cd0 tx=0x7f37bc016000 comp rx=0 tx=0).stop 2023-10-10T21:18:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc06ece0 msgr2=0x7f37cc0c36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc06ece0 0x7f37cc0c36a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f37c800cb90 tx=0x7f37c8001ab0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 shutdown_connections 2023-10-10T21:18:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37cc1567b0 0x7f37cc14bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37cc06ece0 0x7f37cc0c36a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f37b0066f30 0x7f37b00693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 --2- 172.21.15.154:0/1413165707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37cc1563e0 0x7f37cc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 >> 172.21.15.154:0/1413165707 conn(0x7f37cc0ccca0 msgr2=0x7f37cc0adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.010+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 shutdown_connections 2023-10-10T21:18:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.011+0000 7f37d299d700 1 -- 172.21.15.154:0/1413165707 wait complete. 2023-10-10T21:18:50.029 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T21:18:50.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:50.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.218+0000 7fcff3bff700 1 Processor -- start 2023-10-10T21:18:50.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.218+0000 7fcff3bff700 1 -- start start 2023-10-10T21:18:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.219+0000 7fcff3bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcfec0b1570 0x7fcfec0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.219+0000 7fcff3bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcfec15ae00 0x7fcfec0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.219+0000 7fcff3bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec06a280 con 0x7fcfec099bb0 2023-10-10T21:18:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.219+0000 7fcff3bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec0c8c30 con 0x7fcfec0b1570 2023-10-10T21:18:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.219+0000 7fcff3bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec0c8950 con 0x7fcfec15ae00 2023-10-10T21:18:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.219+0000 7fcff199b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcfec0b1570 0x7fcfec0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.219+0000 7fcff199b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcfec0b1570 0x7fcfec0c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42756/0 (socket says 172.21.15.154:42756) 2023-10-10T21:18:50.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.219+0000 7fcff199b700 1 -- 172.21.15.154:0/3095282099 learned_addr learned my addr 172.21.15.154:0/3095282099 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:50.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff199b700 1 -- 172.21.15.154:0/3095282099 >> v2:172.21.15.179:3300/0 conn(0x7fcfec15ae00 msgr2=0x7fcfec0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:50.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff219c700 1 --2- 172.21.15.154:0/3095282099 >> v2:172.21.15.179:3300/0 conn(0x7fcfec15ae00 0x7fcfec0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:50.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff199b700 1 --2- 172.21.15.154:0/3095282099 >> v2:172.21.15.179:3300/0 conn(0x7fcfec15ae00 0x7fcfec0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff199b700 1 -- 172.21.15.154:0/3095282099 >> v1:172.21.15.154:6789/0 conn(0x7fcfec099bb0 legacy=0x7fcfec15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:50.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff0999700 1 -- 172.21.15.154:0/3095282099 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816358600 0 0) 0x7fcfec06a280 con 0x7fcfec099bb0 2023-10-10T21:18:50.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff199b700 1 -- 172.21.15.154:0/3095282099 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec069c30 con 0x7fcfec0b1570 2023-10-10T21:18:50.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff219c700 1 --2- 172.21.15.154:0/3095282099 >> v2:172.21.15.179:3300/0 conn(0x7fcfec15ae00 0x7fcfec0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:50.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff199b700 1 --2- 172.21.15.154:0/3095282099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 0x7fcfec0c8300 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ad4f0 tx=0x7fcfe8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d9d3cb1e5bd68f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:50.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff0999700 1 -- 172.21.15.154:0/3095282099 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800b860 con 0x7fcfec0b1570 2023-10-10T21:18:50.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff0999700 1 -- 172.21.15.154:0/3095282099 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe800b9c0 con 0x7fcfec0b1570 2023-10-10T21:18:50.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.220+0000 7fcff0999700 1 -- 172.21.15.154:0/3095282099 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800bd60 con 0x7fcfec0b1570 2023-10-10T21:18:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.221+0000 7fcff3bff700 1 -- 172.21.15.154:0/3095282099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 msgr2=0x7fcfec0c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.221+0000 7fcff3bff700 1 --2- 172.21.15.154:0/3095282099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 0x7fcfec0c8300 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ad4f0 tx=0x7fcfe8009250 comp rx=0 tx=0).stop 2023-10-10T21:18:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.221+0000 7fcff3bff700 1 -- 172.21.15.154:0/3095282099 shutdown_connections 2023-10-10T21:18:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.221+0000 7fcff3bff700 1 --2- 172.21.15.154:0/3095282099 >> v2:172.21.15.179:3300/0 conn(0x7fcfec15ae00 0x7fcfec0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.221+0000 7fcff3bff700 1 --2- 172.21.15.154:0/3095282099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 0x7fcfec0c8300 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.221+0000 7fcff3bff700 1 -- 172.21.15.154:0/3095282099 >> 172.21.15.154:0/3095282099 conn(0x7fcfec06d5a0 msgr2=0x7fcfec068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.221+0000 7fcff3bff700 1 -- 172.21.15.154:0/3095282099 shutdown_connections 2023-10-10T21:18:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.221+0000 7fcff3bff700 1 -- 172.21.15.154:0/3095282099 wait complete. 2023-10-10T21:18:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.222+0000 7fcff3bff700 1 Processor -- start 2023-10-10T21:18:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.223+0000 7fcff3bff700 1 -- start start 2023-10-10T21:18:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.223+0000 7fcff3bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfec099bb0 0x7fcfec096af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.223+0000 7fcff3bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 0x7fcfec16b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.223+0000 7fcff3bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfec15ae00 0x7fcfec159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.223+0000 7fcff3bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec16c330 con 0x7fcfec0b1570 2023-10-10T21:18:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.223+0000 7fcff3bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec15a250 con 0x7fcfec15ae00 2023-10-10T21:18:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.223+0000 7fcff3bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec1533d0 con 0x7fcfec099bb0 2023-10-10T21:18:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff119a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 0x7fcfec16b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff119a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 0x7fcfec16b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42766/0 (socket says 172.21.15.154:42766) 2023-10-10T21:18:50.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff119a700 1 -- 172.21.15.154:0/3028330944 learned_addr learned my addr 172.21.15.154:0/3028330944 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:50.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff219c700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfec15ae00 0x7fcfec159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:50.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff199b700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfec099bb0 0x7fcfec096af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:50.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff119a700 1 -- 172.21.15.154:0/3028330944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfec099bb0 msgr2=0x7fcfec096af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:50.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff119a700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfec099bb0 0x7fcfec096af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff119a700 1 -- 172.21.15.154:0/3028330944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfec15ae00 msgr2=0x7fcfec159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:50.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff119a700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfec15ae00 0x7fcfec159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff119a700 1 -- 172.21.15.154:0/3028330944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80094f0 con 0x7fcfec0b1570 2023-10-10T21:18:50.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcff119a700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 0x7fcfec16b3b0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c7e0 tx=0x7fcfdc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:50.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.224+0000 7fcfe1ffb700 1 -- 172.21.15.154:0/3028330944 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc012700 con 0x7fcfec0b1570 2023-10-10T21:18:50.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.225+0000 7fcfe1ffb700 1 -- 172.21.15.154:0/3028330944 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc012880 con 0x7fcfec0b1570 2023-10-10T21:18:50.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.225+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec153690 con 0x7fcfec0b1570 2023-10-10T21:18:50.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.225+0000 7fcfe1ffb700 1 -- 172.21.15.154:0/3028330944 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc012c40 con 0x7fcfec0b1570 2023-10-10T21:18:50.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.225+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec16bd70 con 0x7fcfec0b1570 2023-10-10T21:18:50.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.226+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec04c3c0 con 0x7fcfec0b1570 2023-10-10T21:18:50.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.226+0000 7fcfe1ffb700 1 -- 172.21.15.154:0/3028330944 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfdc01b400 con 0x7fcfec0b1570 2023-10-10T21:18:50.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.227+0000 7fcfe1ffb700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcfd0066f30 0x7fcfd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:50.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.227+0000 7fcfe1ffb700 1 -- 172.21.15.154:0/3028330944 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fcfdc084290 con 0x7fcfec0b1570 2023-10-10T21:18:50.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.228+0000 7fcff199b700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcfd0066f30 0x7fcfd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:50.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.228+0000 7fcff199b700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcfd0066f30 0x7fcfd00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ad4f0 tx=0x7fcfe8017000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:50.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.232+0000 7fcfe1ffb700 1 -- 172.21.15.154:0/3028330944 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfdc051370 con 0x7fcfec0b1570 2023-10-10T21:18:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.421+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfec069f10 con 0x7fcfd0066f30 2023-10-10T21:18:50.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.430+0000 7fcfe1ffb700 1 -- 172.21.15.154:0/3028330944 <== mgr.7005 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289530 (secure 0 0 0) 0x7fcfec069f10 con 0x7fcfd0066f30 2023-10-10T21:18:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.434+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcfd0066f30 msgr2=0x7fcfd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.434+0000 7fcff3bff700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcfd0066f30 0x7fcfd00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ad4f0 tx=0x7fcfe8017000 comp rx=0 tx=0).stop 2023-10-10T21:18:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.434+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 msgr2=0x7fcfec16b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.434+0000 7fcff3bff700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 0x7fcfec16b3b0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c7e0 tx=0x7fcfdc007df0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.435+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 shutdown_connections 2023-10-10T21:18:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.435+0000 7fcff3bff700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fcfd0066f30 0x7fcfd00693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.435+0000 7fcff3bff700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfec15ae00 0x7fcfec159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.435+0000 7fcff3bff700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfec099bb0 0x7fcfec096af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.435+0000 7fcff3bff700 1 --2- 172.21.15.154:0/3028330944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfec0b1570 0x7fcfec16b3b0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:50.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.435+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 >> 172.21.15.154:0/3028330944 conn(0x7fcfec06d5a0 msgr2=0x7fcfec06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.435+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 shutdown_connections 2023-10-10T21:18:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:50.435+0000 7fcff3bff700 1 -- 172.21.15.154:0/3028330944 wait complete. 2023-10-10T21:18:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:50.454 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-10T21:18:49.803208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439112,"kb_used_data":11656,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752535608,"statfs":{"total":773094113280,"available":770596462592,"internally_reserved":0,"allocated":11935744,"data_stored":6370164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.694834"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.148073+0000","last_change":"2023-10-10T21:18:44.145637+0000","last_active":"2023-10-10T21:18:44.148073+0000","last_peered":"2023-10-10T21:18:44.148073+0000","last_clean":"2023-10-10T21:18:44.148073+0000","last_became_active":"2023-10-10T21:18:44.145323+0000","last_became_peered":"2023-10-10T21:18:44.145323+0000","last_unstale":"2023-10-10T21:18:44.148073+0000","last_undegraded":"2023-10-10T21:18:44.148073+0000","last_fullsized":"2023-10-10T21:18:44.148073+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:02.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155598+0000","last_change":"2023-10-10T21:18:44.151823+0000","last_active":"2023-10-10T21:18:44.155598+0000","last_peered":"2023-10-10T21:18:44.155598+0000","last_clean":"2023-10-10T21:18:44.155598+0000","last_became_active":"2023-10-10T21:18:44.151567+0000","last_became_peered":"2023-10-10T21:18:44.151567+0000","last_unstale":"2023-10-10T21:18:44.155598+0000","last_undegraded":"2023-10-10T21:18:44.155598+0000","last_fullsized":"2023-10-10T21:18:44.155598+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:17:52.866216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.144885+0000","last_change":"2023-10-10T21:18:44.141834+0000","last_active":"2023-10-10T21:18:44.144885+0000","last_peered":"2023-10-10T21:18:44.144885+0000","last_clean":"2023-10-10T21:18:44.144885+0000","last_became_active":"2023-10-10T21:18:44.141601+0000","last_became_peered":"2023-10-10T21:18:44.141601+0000","last_unstale":"2023-10-10T21:18:44.144885+0000","last_undegraded":"2023-10-10T21:18:44.144885+0000","last_fullsized":"2023-10-10T21:18:44.144885+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:03.362101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146151+0000","last_change":"2023-10-10T21:18:44.138191+0000","last_active":"2023-10-10T21:18:44.146151+0000","last_peered":"2023-10-10T21:18:44.146151+0000","last_clean":"2023-10-10T21:18:44.146151+0000","last_became_active":"2023-10-10T21:18:44.137894+0000","last_became_peered":"2023-10-10T21:18:44.137894+0000","last_unstale":"2023-10-10T21:18:44.146151+0000","last_undegraded":"2023-10-10T21:18:44.146151+0000","last_fullsized":"2023-10-10T21:18:44.146151+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:51.180926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145006+0000","last_change":"2023-10-10T21:18:44.137189+0000","last_active":"2023-10-10T21:18:44.145006+0000","last_peered":"2023-10-10T21:18:44.145006+0000","last_clean":"2023-10-10T21:18:44.145006+0000","last_became_active":"2023-10-10T21:18:44.136931+0000","last_became_peered":"2023-10-10T21:18:44.136931+0000","last_unstale":"2023-10-10T21:18:44.145006+0000","last_undegraded":"2023-10-10T21:18:44.145006+0000","last_fullsized":"2023-10-10T21:18:44.145006+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:30.899645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143547+0000","last_change":"2023-10-10T21:18:44.141887+0000","last_active":"2023-10-10T21:18:44.143547+0000","last_peered":"2023-10-10T21:18:44.143547+0000","last_clean":"2023-10-10T21:18:44.143547+0000","last_became_active":"2023-10-10T21:18:44.141545+0000","last_became_peered":"2023-10-10T21:18:44.141545+0000","last_unstale":"2023-10-10T21:18:44.143547+0000","last_undegraded":"2023-10-10T21:18:44.143547+0000","last_fullsized":"2023-10-10T21:18:44.143547+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:15.469400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.141601+0000","last_change":"2023-10-10T21:18:44.136523+0000","last_active":"2023-10-10T21:18:44.141601+0000","last_peered":"2023-10-10T21:18:44.141601+0000","last_clean":"2023-10-10T21:18:44.141601+0000","last_became_active":"2023-10-10T21:18:44.136256+0000","last_became_peered":"2023-10-10T21:18:44.136256+0000","last_unstale":"2023-10-10T21:18:44.141601+0000","last_undegraded":"2023-10-10T21:18:44.141601+0000","last_fullsized":"2023-10-10T21:18:44.141601+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:43.030832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152165+0000","last_change":"2023-10-10T21:18:44.150277+0000","last_active":"2023-10-10T21:18:44.152165+0000","last_peered":"2023-10-10T21:18:44.152165+0000","last_clean":"2023-10-10T21:18:44.152165+0000","last_became_active":"2023-10-10T21:18:44.150000+0000","last_became_peered":"2023-10-10T21:18:44.150000+0000","last_unstale":"2023-10-10T21:18:44.152165+0000","last_undegraded":"2023-10-10T21:18:44.152165+0000","last_fullsized":"2023-10-10T21:18:44.152165+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:12:13.439709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143516+0000","last_change":"2023-10-10T21:18:44.140379+0000","last_active":"2023-10-10T21:18:44.143516+0000","last_peered":"2023-10-10T21:18:44.143516+0000","last_clean":"2023-10-10T21:18:44.143516+0000","last_became_active":"2023-10-10T21:18:44.140099+0000","last_became_peered":"2023-10-10T21:18:44.140099+0000","last_unstale":"2023-10-10T21:18:44.143516+0000","last_undegraded":"2023-10-10T21:18:44.143516+0000","last_fullsized":"2023-10-10T21:18:44.143516+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:31:30.967539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146017+0000","last_change":"2023-10-10T21:18:44.141754+0000","last_active":"2023-10-10T21:18:44.146017+0000","last_peered":"2023-10-10T21:18:44.146017+0000","last_clean":"2023-10-10T21:18:44.146017+0000","last_became_active":"2023-10-10T21:18:44.141304+0000","last_became_peered":"2023-10-10T21:18:44.141304+0000","last_unstale":"2023-10-10T21:18:44.146017+0000","last_undegraded":"2023-10-10T21:18:44.146017+0000","last_fullsized":"2023-10-10T21:18:44.146017+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:51.644127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139733+0000","last_change":"2023-10-10T21:18:44.134706+0000","last_active":"2023-10-10T21:18:44.139733+0000","last_peered":"2023-10-10T21:18:44.139733+0000","last_clean":"2023-10-10T21:18:44.139733+0000","last_became_active":"2023-10-10T21:18:44.134442+0000","last_became_peered":"2023-10-10T21:18:44.134442+0000","last_unstale":"2023-10-10T21:18:44.139733+0000","last_undegraded":"2023-10-10T21:18:44.139733+0000","last_fullsized":"2023-10-10T21:18:44.139733+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:59:09.994907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143405+0000","last_change":"2023-10-10T21:18:44.137923+0000","last_active":"2023-10-10T21:18:44.143405+0000","last_peered":"2023-10-10T21:18:44.143405+0000","last_clean":"2023-10-10T21:18:44.143405+0000","last_became_active":"2023-10-10T21:18:44.137667+0000","last_became_peered":"2023-10-10T21:18:44.137667+0000","last_unstale":"2023-10-10T21:18:44.143405+0000","last_undegraded":"2023-10-10T21:18:44.143405+0000","last_fullsized":"2023-10-10T21:18:44.143405+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:10.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.140006+0000","last_change":"2023-10-10T21:18:44.134509+0000","last_active":"2023-10-10T21:18:44.140006+0000","last_peered":"2023-10-10T21:18:44.140006+0000","last_clean":"2023-10-10T21:18:44.140006+0000","last_became_active":"2023-10-10T21:18:44.134236+0000","last_became_peered":"2023-10-10T21:18:44.134236+0000","last_unstale":"2023-10-10T21:18:44.140006+0000","last_undegraded":"2023-10-10T21:18:44.140006+0000","last_fullsized":"2023-10-10T21:18:44.140006+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:04:35.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.157260+0000","last_change":"2023-10-10T21:18:44.152951+0000","last_active":"2023-10-10T21:18:44.157260+0000","last_peered":"2023-10-10T21:18:44.157260+0000","last_clean":"2023-10-10T21:18:44.157260+0000","last_became_active":"2023-10-10T21:18:44.152657+0000","last_became_peered":"2023-10-10T21:18:44.152657+0000","last_unstale":"2023-10-10T21:18:44.157260+0000","last_undegraded":"2023-10-10T21:18:44.157260+0000","last_fullsized":"2023-10-10T21:18:44.157260+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:34.990082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143863+0000","last_change":"2023-10-10T21:18:44.141072+0000","last_active":"2023-10-10T21:18:44.143863+0000","last_peered":"2023-10-10T21:18:44.143863+0000","last_clean":"2023-10-10T21:18:44.143863+0000","last_became_active":"2023-10-10T21:18:44.140771+0000","last_became_peered":"2023-10-10T21:18:44.140771+0000","last_unstale":"2023-10-10T21:18:44.143863+0000","last_undegraded":"2023-10-10T21:18:44.143863+0000","last_fullsized":"2023-10-10T21:18:44.143863+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:24:23.454059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143682+0000","last_change":"2023-10-10T21:18:44.134354+0000","last_active":"2023-10-10T21:18:44.143682+0000","last_peered":"2023-10-10T21:18:44.143682+0000","last_clean":"2023-10-10T21:18:44.143682+0000","last_became_active":"2023-10-10T21:18:44.134057+0000","last_became_peered":"2023-10-10T21:18:44.134057+0000","last_unstale":"2023-10-10T21:18:44.143682+0000","last_undegraded":"2023-10-10T21:18:44.143682+0000","last_fullsized":"2023-10-10T21:18:44.143682+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:03.362101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.144088+0000","last_change":"2023-10-10T21:18:44.134241+0000","last_active":"2023-10-10T21:18:44.144088+0000","last_peered":"2023-10-10T21:18:44.144088+0000","last_clean":"2023-10-10T21:18:44.144088+0000","last_became_active":"2023-10-10T21:18:44.132075+0000","last_became_peered":"2023-10-10T21:18:44.132075+0000","last_unstale":"2023-10-10T21:18:44.144088+0000","last_undegraded":"2023-10-10T21:18:44.144088+0000","last_fullsized":"2023-10-10T21:18:44.144088+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:38:01.405596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147585+0000","last_change":"2023-10-10T21:18:44.142780+0000","last_active":"2023-10-10T21:18:44.147585+0000","last_peered":"2023-10-10T21:18:44.147585+0000","last_clean":"2023-10-10T21:18:44.147585+0000","last_became_active":"2023-10-10T21:18:44.142513+0000","last_became_peered":"2023-10-10T21:18:44.142513+0000","last_unstale":"2023-10-10T21:18:44.147585+0000","last_undegraded":"2023-10-10T21:18:44.147585+0000","last_fullsized":"2023-10-10T21:18:44.147585+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:10:41.722417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147728+0000","last_change":"2023-10-10T21:18:44.140824+0000","last_active":"2023-10-10T21:18:44.147728+0000","last_peered":"2023-10-10T21:18:44.147728+0000","last_clean":"2023-10-10T21:18:44.147728+0000","last_became_active":"2023-10-10T21:18:44.140586+0000","last_became_peered":"2023-10-10T21:18:44.140586+0000","last_unstale":"2023-10-10T21:18:44.147728+0000","last_undegraded":"2023-10-10T21:18:44.147728+0000","last_fullsized":"2023-10-10T21:18:44.147728+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:32.643038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152770+0000","last_change":"2023-10-10T21:18:44.149558+0000","last_active":"2023-10-10T21:18:44.152770+0000","last_peered":"2023-10-10T21:18:44.152770+0000","last_clean":"2023-10-10T21:18:44.152770+0000","last_became_active":"2023-10-10T21:18:44.149223+0000","last_became_peered":"2023-10-10T21:18:44.149223+0000","last_unstale":"2023-10-10T21:18:44.152770+0000","last_undegraded":"2023-10-10T21:18:44.152770+0000","last_fullsized":"2023-10-10T21:18:44.152770+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:27:51.213821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151488+0000","last_change":"2023-10-10T21:18:44.148960+0000","last_active":"2023-10-10T21:18:44.151488+0000","last_peered":"2023-10-10T21:18:44.151488+0000","last_clean":"2023-10-10T21:18:44.151488+0000","last_became_active":"2023-10-10T21:18:44.148651+0000","last_became_peered":"2023-10-10T21:18:44.148651+0000","last_unstale":"2023-10-10T21:18:44.151488+0000","last_undegraded":"2023-10-10T21:18:44.151488+0000","last_fullsized":"2023-10-10T21:18:44.151488+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:19:48.206567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155460+0000","last_change":"2023-10-10T21:18:44.150911+0000","last_active":"2023-10-10T21:18:44.155460+0000","last_peered":"2023-10-10T21:18:44.155460+0000","last_clean":"2023-10-10T21:18:44.155460+0000","last_became_active":"2023-10-10T21:18:44.150640+0000","last_became_peered":"2023-10-10T21:18:44.150640+0000","last_unstale":"2023-10-10T21:18:44.155460+0000","last_undegraded":"2023-10-10T21:18:44.155460+0000","last_fullsized":"2023-10-10T21:18:44.155460+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:33.388265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.148711+0000","last_change":"2023-10-10T21:18:44.147257+0000","last_active":"2023-10-10T21:18:44.148711+0000","last_peered":"2023-10-10T21:18:44.148711+0000","last_clean":"2023-10-10T21:18:44.148711+0000","last_became_active":"2023-10-10T21:18:44.146356+0000","last_became_peered":"2023-10-10T21:18:44.146356+0000","last_unstale":"2023-10-10T21:18:44.148711+0000","last_undegraded":"2023-10-10T21:18:44.148711+0000","last_fullsized":"2023-10-10T21:18:44.148711+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:32.643038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151716+0000","last_change":"2023-10-10T21:18:44.149026+0000","last_active":"2023-10-10T21:18:44.151716+0000","last_peered":"2023-10-10T21:18:44.151716+0000","last_clean":"2023-10-10T21:18:44.151716+0000","last_became_active":"2023-10-10T21:18:44.148678+0000","last_became_peered":"2023-10-10T21:18:44.148678+0000","last_unstale":"2023-10-10T21:18:44.151716+0000","last_undegraded":"2023-10-10T21:18:44.151716+0000","last_fullsized":"2023-10-10T21:18:44.151716+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:27:39.663979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155546+0000","last_change":"2023-10-10T21:18:44.151769+0000","last_active":"2023-10-10T21:18:44.155546+0000","last_peered":"2023-10-10T21:18:44.155546+0000","last_clean":"2023-10-10T21:18:44.155546+0000","last_became_active":"2023-10-10T21:18:44.151498+0000","last_became_peered":"2023-10-10T21:18:44.151498+0000","last_unstale":"2023-10-10T21:18:44.155546+0000","last_undegraded":"2023-10-10T21:18:44.155546+0000","last_fullsized":"2023-10-10T21:18:44.155546+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:40:20.585984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139823+0000","last_change":"2023-10-10T21:18:44.137259+0000","last_active":"2023-10-10T21:18:44.139823+0000","last_peered":"2023-10-10T21:18:44.139823+0000","last_clean":"2023-10-10T21:18:44.139823+0000","last_became_active":"2023-10-10T21:18:44.137007+0000","last_became_peered":"2023-10-10T21:18:44.137007+0000","last_unstale":"2023-10-10T21:18:44.139823+0000","last_undegraded":"2023-10-10T21:18:44.139823+0000","last_fullsized":"2023-10-10T21:18:44.139823+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:25:06.926121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143935+0000","last_change":"2023-10-10T21:18:44.136505+0000","last_active":"2023-10-10T21:18:44.143935+0000","last_peered":"2023-10-10T21:18:44.143935+0000","last_clean":"2023-10-10T21:18:44.143935+0000","last_became_active":"2023-10-10T21:18:44.136212+0000","last_became_peered":"2023-10-10T21:18:44.136212+0000","last_unstale":"2023-10-10T21:18:44.143935+0000","last_undegraded":"2023-10-10T21:18:44.143935+0000","last_fullsized":"2023-10-10T21:18:44.143935+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:43:11.303976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147897+0000","last_change":"2023-10-10T21:18:44.144851+0000","last_active":"2023-10-10T21:18:44.147897+0000","last_peered":"2023-10-10T21:18:44.147897+0000","last_clean":"2023-10-10T21:18:44.147897+0000","last_became_active":"2023-10-10T21:18:44.144591+0000","last_became_peered":"2023-10-10T21:18:44.144591+0000","last_unstale":"2023-10-10T21:18:44.147897+0000","last_undegraded":"2023-10-10T21:18:44.147897+0000","last_fullsized":"2023-10-10T21:18:44.147897+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:48:39.640408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139592+0000","last_change":"2023-10-10T21:18:44.137448+0000","last_active":"2023-10-10T21:18:44.139592+0000","last_peered":"2023-10-10T21:18:44.139592+0000","last_clean":"2023-10-10T21:18:44.139592+0000","last_became_active":"2023-10-10T21:18:44.137167+0000","last_became_peered":"2023-10-10T21:18:44.137167+0000","last_unstale":"2023-10-10T21:18:44.139592+0000","last_undegraded":"2023-10-10T21:18:44.139592+0000","last_fullsized":"2023-10-10T21:18:44.139592+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:59:20.447705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152340+0000","last_change":"2023-10-10T21:18:44.142947+0000","last_active":"2023-10-10T21:18:44.152340+0000","last_peered":"2023-10-10T21:18:44.152340+0000","last_clean":"2023-10-10T21:18:44.152340+0000","last_became_active":"2023-10-10T21:18:44.142670+0000","last_became_peered":"2023-10-10T21:18:44.142670+0000","last_unstale":"2023-10-10T21:18:44.152340+0000","last_undegraded":"2023-10-10T21:18:44.152340+0000","last_fullsized":"2023-10-10T21:18:44.152340+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:14:31.962528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146606+0000","last_change":"2023-10-10T21:18:44.143640+0000","last_active":"2023-10-10T21:18:44.146606+0000","last_peered":"2023-10-10T21:18:44.146606+0000","last_clean":"2023-10-10T21:18:44.146606+0000","last_became_active":"2023-10-10T21:18:44.143064+0000","last_became_peered":"2023-10-10T21:18:44.143064+0000","last_unstale":"2023-10-10T21:18:44.146606+0000","last_undegraded":"2023-10-10T21:18:44.146606+0000","last_fullsized":"2023-10-10T21:18:44.146606+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:10.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155424+0000","last_change":"2023-10-10T21:18:44.154055+0000","last_active":"2023-10-10T21:18:44.155424+0000","last_peered":"2023-10-10T21:18:44.155424+0000","last_clean":"2023-10-10T21:18:44.155424+0000","last_became_active":"2023-10-10T21:18:44.152996+0000","last_became_peered":"2023-10-10T21:18:44.152996+0000","last_unstale":"2023-10-10T21:18:44.155424+0000","last_undegraded":"2023-10-10T21:18:44.155424+0000","last_fullsized":"2023-10-10T21:18:44.155424+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:01.450647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145238+0000","last_change":"2023-10-10T21:18:44.141739+0000","last_active":"2023-10-10T21:18:44.145238+0000","last_peered":"2023-10-10T21:18:44.145238+0000","last_clean":"2023-10-10T21:18:44.145238+0000","last_became_active":"2023-10-10T21:18:44.141475+0000","last_became_peered":"2023-10-10T21:18:44.141475+0000","last_unstale":"2023-10-10T21:18:44.145238+0000","last_undegraded":"2023-10-10T21:18:44.145238+0000","last_fullsized":"2023-10-10T21:18:44.145238+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:01.450647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.158134+0000","last_change":"2023-10-10T21:18:43.130556+0000","last_active":"2023-10-10T21:18:44.158134+0000","last_peered":"2023-10-10T21:18:44.158134+0000","last_clean":"2023-10-10T21:18:44.158134+0000","last_became_active":"2023-10-10T21:18:43.130267+0000","last_became_peered":"2023-10-10T21:18:43.130267+0000","last_unstale":"2023-10-10T21:18:44.158134+0000","last_undegraded":"2023-10-10T21:18:44.158134+0000","last_fullsized":"2023-10-10T21:18:44.158134+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.148640+0000","last_change":"2023-10-10T21:18:44.146558+0000","last_active":"2023-10-10T21:18:44.148640+0000","last_peered":"2023-10-10T21:18:44.148640+0000","last_clean":"2023-10-10T21:18:44.148640+0000","last_became_active":"2023-10-10T21:18:44.146124+0000","last_became_peered":"2023-10-10T21:18:44.146124+0000","last_unstale":"2023-10-10T21:18:44.148640+0000","last_undegraded":"2023-10-10T21:18:44.148640+0000","last_fullsized":"2023-10-10T21:18:44.148640+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:32.107198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.154097+0000","last_change":"2023-10-10T21:18:43.132390+0000","last_active":"2023-10-10T21:18:44.154097+0000","last_peered":"2023-10-10T21:18:44.154097+0000","last_clean":"2023-10-10T21:18:44.154097+0000","last_became_active":"2023-10-10T21:18:43.132049+0000","last_became_peered":"2023-10-10T21:18:43.132049+0000","last_unstale":"2023-10-10T21:18:44.154097+0000","last_undegraded":"2023-10-10T21:18:44.154097+0000","last_fullsized":"2023-10-10T21:18:44.154097+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:19.947370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155484+0000","last_change":"2023-10-10T21:18:44.154399+0000","last_active":"2023-10-10T21:18:44.155484+0000","last_peered":"2023-10-10T21:18:44.155484+0000","last_clean":"2023-10-10T21:18:44.155484+0000","last_became_active":"2023-10-10T21:18:44.154104+0000","last_became_peered":"2023-10-10T21:18:44.154104+0000","last_unstale":"2023-10-10T21:18:44.155484+0000","last_undegraded":"2023-10-10T21:18:44.155484+0000","last_fullsized":"2023-10-10T21:18:44.155484+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:04:35.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.163071+0000","last_change":"2023-10-10T21:18:43.129850+0000","last_active":"2023-10-10T21:18:44.163071+0000","last_peered":"2023-10-10T21:18:44.163071+0000","last_clean":"2023-10-10T21:18:44.163071+0000","last_became_active":"2023-10-10T21:18:43.129601+0000","last_became_peered":"2023-10-10T21:18:43.129601+0000","last_unstale":"2023-10-10T21:18:44.163071+0000","last_undegraded":"2023-10-10T21:18:44.163071+0000","last_fullsized":"2023-10-10T21:18:44.163071+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:12:12.433840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.144862+0000","last_change":"2023-10-10T21:18:44.141720+0000","last_active":"2023-10-10T21:18:44.144862+0000","last_peered":"2023-10-10T21:18:44.144862+0000","last_clean":"2023-10-10T21:18:44.144862+0000","last_became_active":"2023-10-10T21:18:44.141244+0000","last_became_peered":"2023-10-10T21:18:44.141244+0000","last_unstale":"2023-10-10T21:18:44.144862+0000","last_undegraded":"2023-10-10T21:18:44.144862+0000","last_fullsized":"2023-10-10T21:18:44.144862+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:10.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.163135+0000","last_change":"2023-10-10T21:18:43.123833+0000","last_active":"2023-10-10T21:18:44.163135+0000","last_peered":"2023-10-10T21:18:44.163135+0000","last_clean":"2023-10-10T21:18:44.163135+0000","last_became_active":"2023-10-10T21:18:43.123586+0000","last_became_peered":"2023-10-10T21:18:43.123586+0000","last_unstale":"2023-10-10T21:18:44.163135+0000","last_undegraded":"2023-10-10T21:18:44.163135+0000","last_fullsized":"2023-10-10T21:18:44.163135+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:16:07.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143074+0000","last_change":"2023-10-10T21:18:44.136641+0000","last_active":"2023-10-10T21:18:44.143074+0000","last_peered":"2023-10-10T21:18:44.143074+0000","last_clean":"2023-10-10T21:18:44.143074+0000","last_became_active":"2023-10-10T21:18:44.136399+0000","last_became_peered":"2023-10-10T21:18:44.136399+0000","last_unstale":"2023-10-10T21:18:44.143074+0000","last_undegraded":"2023-10-10T21:18:44.143074+0000","last_fullsized":"2023-10-10T21:18:44.143074+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:04:57.198476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.156488+0000","last_change":"2023-10-10T21:18:43.126395+0000","last_active":"2023-10-10T21:18:44.156488+0000","last_peered":"2023-10-10T21:18:44.156488+0000","last_clean":"2023-10-10T21:18:44.156488+0000","last_became_active":"2023-10-10T21:18:43.126099+0000","last_became_peered":"2023-10-10T21:18:43.126099+0000","last_unstale":"2023-10-10T21:18:44.156488+0000","last_undegraded":"2023-10-10T21:18:44.156488+0000","last_fullsized":"2023-10-10T21:18:44.156488+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:55:49.835696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145143+0000","last_change":"2023-10-10T21:18:44.138131+0000","last_active":"2023-10-10T21:18:44.145143+0000","last_peered":"2023-10-10T21:18:44.145143+0000","last_clean":"2023-10-10T21:18:44.145143+0000","last_became_active":"2023-10-10T21:18:44.137830+0000","last_became_peered":"2023-10-10T21:18:44.137830+0000","last_unstale":"2023-10-10T21:18:44.145143+0000","last_undegraded":"2023-10-10T21:18:44.145143+0000","last_fullsized":"2023-10-10T21:18:44.145143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:32.107198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155139+0000","last_change":"2023-10-10T21:18:43.133201+0000","last_active":"2023-10-10T21:18:44.155139+0000","last_peered":"2023-10-10T21:18:44.155139+0000","last_clean":"2023-10-10T21:18:44.155139+0000","last_became_active":"2023-10-10T21:18:43.132509+0000","last_became_peered":"2023-10-10T21:18:43.132509+0000","last_unstale":"2023-10-10T21:18:44.155139+0000","last_undegraded":"2023-10-10T21:18:44.155139+0000","last_fullsized":"2023-10-10T21:18:44.155139+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:36:27.443230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151246+0000","last_change":"2023-10-10T21:18:44.149507+0000","last_active":"2023-10-10T21:18:44.151246+0000","last_peered":"2023-10-10T21:18:44.151246+0000","last_clean":"2023-10-10T21:18:44.151246+0000","last_became_active":"2023-10-10T21:18:44.149177+0000","last_became_peered":"2023-10-10T21:18:44.149177+0000","last_unstale":"2023-10-10T21:18:44.151246+0000","last_undegraded":"2023-10-10T21:18:44.151246+0000","last_fullsized":"2023-10-10T21:18:44.151246+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:30.899645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.124214+0000","last_change":"2023-10-10T21:18:43.131142+0000","last_active":"2023-10-10T21:18:44.124214+0000","last_peered":"2023-10-10T21:18:44.124214+0000","last_clean":"2023-10-10T21:18:44.124214+0000","last_became_active":"2023-10-10T21:18:43.130866+0000","last_became_peered":"2023-10-10T21:18:43.130866+0000","last_unstale":"2023-10-10T21:18:44.124214+0000","last_undegraded":"2023-10-10T21:18:44.124214+0000","last_fullsized":"2023-10-10T21:18:44.124214+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:29:42.872498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143845+0000","last_change":"2023-10-10T21:18:44.140340+0000","last_active":"2023-10-10T21:18:44.143845+0000","last_peered":"2023-10-10T21:18:44.143845+0000","last_clean":"2023-10-10T21:18:44.143845+0000","last_became_active":"2023-10-10T21:18:44.140089+0000","last_became_peered":"2023-10-10T21:18:44.140089+0000","last_unstale":"2023-10-10T21:18:44.143845+0000","last_undegraded":"2023-10-10T21:18:44.143845+0000","last_fullsized":"2023-10-10T21:18:44.143845+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:31:24.447408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.127912+0000","last_change":"2023-10-10T21:18:43.122854+0000","last_active":"2023-10-10T21:18:44.127912+0000","last_peered":"2023-10-10T21:18:44.127912+0000","last_clean":"2023-10-10T21:18:44.127912+0000","last_became_active":"2023-10-10T21:18:43.122586+0000","last_became_peered":"2023-10-10T21:18:43.122586+0000","last_unstale":"2023-10-10T21:18:44.127912+0000","last_undegraded":"2023-10-10T21:18:44.127912+0000","last_fullsized":"2023-10-10T21:18:44.127912+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:53:44.764034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152677+0000","last_change":"2023-10-10T21:18:44.150298+0000","last_active":"2023-10-10T21:18:44.152677+0000","last_peered":"2023-10-10T21:18:44.152677+0000","last_clean":"2023-10-10T21:18:44.152677+0000","last_became_active":"2023-10-10T21:18:44.150034+0000","last_became_peered":"2023-10-10T21:18:44.150034+0000","last_unstale":"2023-10-10T21:18:44.152677+0000","last_undegraded":"2023-10-10T21:18:44.152677+0000","last_fullsized":"2023-10-10T21:18:44.152677+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:11:34.664480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.138465+0000","last_change":"2023-10-10T21:18:43.132195+0000","last_active":"2023-10-10T21:18:44.138465+0000","last_peered":"2023-10-10T21:18:44.138465+0000","last_clean":"2023-10-10T21:18:44.138465+0000","last_became_active":"2023-10-10T21:18:43.131936+0000","last_became_peered":"2023-10-10T21:18:43.131936+0000","last_unstale":"2023-10-10T21:18:44.138465+0000","last_undegraded":"2023-10-10T21:18:44.138465+0000","last_fullsized":"2023-10-10T21:18:44.138465+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143573+0000","last_change":"2023-10-10T21:18:44.141973+0000","last_active":"2023-10-10T21:18:44.143573+0000","last_peered":"2023-10-10T21:18:44.143573+0000","last_clean":"2023-10-10T21:18:44.143573+0000","last_became_active":"2023-10-10T21:18:44.141657+0000","last_became_peered":"2023-10-10T21:18:44.141657+0000","last_unstale":"2023-10-10T21:18:44.143573+0000","last_undegraded":"2023-10-10T21:18:44.143573+0000","last_fullsized":"2023-10-10T21:18:44.143573+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:16:08.398473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.138201+0000","last_change":"2023-10-10T21:18:43.127785+0000","last_active":"2023-10-10T21:18:44.138201+0000","last_peered":"2023-10-10T21:18:44.138201+0000","last_clean":"2023-10-10T21:18:44.138201+0000","last_became_active":"2023-10-10T21:18:43.127345+0000","last_became_peered":"2023-10-10T21:18:43.127345+0000","last_unstale":"2023-10-10T21:18:44.138201+0000","last_undegraded":"2023-10-10T21:18:44.138201+0000","last_fullsized":"2023-10-10T21:18:44.138201+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:35:02.697980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147699+0000","last_change":"2023-10-10T21:18:44.141875+0000","last_active":"2023-10-10T21:18:44.147699+0000","last_peered":"2023-10-10T21:18:44.147699+0000","last_clean":"2023-10-10T21:18:44.147699+0000","last_became_active":"2023-10-10T21:18:44.141590+0000","last_became_peered":"2023-10-10T21:18:44.141590+0000","last_unstale":"2023-10-10T21:18:44.147699+0000","last_undegraded":"2023-10-10T21:18:44.147699+0000","last_fullsized":"2023-10-10T21:18:44.147699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:01.450647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.163074+0000","last_change":"2023-10-10T21:18:43.130621+0000","last_active":"2023-10-10T21:18:44.163074+0000","last_peered":"2023-10-10T21:18:44.163074+0000","last_clean":"2023-10-10T21:18:44.163074+0000","last_became_active":"2023-10-10T21:18:43.130311+0000","last_became_peered":"2023-10-10T21:18:43.130311+0000","last_unstale":"2023-10-10T21:18:44.163074+0000","last_undegraded":"2023-10-10T21:18:44.163074+0000","last_fullsized":"2023-10-10T21:18:44.163074+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145279+0000","last_change":"2023-10-10T21:18:44.143646+0000","last_active":"2023-10-10T21:18:44.145279+0000","last_peered":"2023-10-10T21:18:44.145279+0000","last_clean":"2023-10-10T21:18:44.145279+0000","last_became_active":"2023-10-10T21:18:44.143143+0000","last_became_peered":"2023-10-10T21:18:44.143143+0000","last_unstale":"2023-10-10T21:18:44.145279+0000","last_undegraded":"2023-10-10T21:18:44.145279+0000","last_fullsized":"2023-10-10T21:18:44.145279+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:41:05.642091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"108'6","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.162625+0000","last_change":"2023-10-10T21:18:43.132304+0000","last_active":"2023-10-10T21:18:44.162625+0000","last_peered":"2023-10-10T21:18:44.162625+0000","last_clean":"2023-10-10T21:18:44.162625+0000","last_became_active":"2023-10-10T21:18:43.132032+0000","last_became_peered":"2023-10-10T21:18:43.132032+0000","last_unstale":"2023-10-10T21:18:44.162625+0000","last_undegraded":"2023-10-10T21:18:44.162625+0000","last_fullsized":"2023-10-10T21:18:44.162625+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.154073+0000","last_change":"2023-10-10T21:18:44.144511+0000","last_active":"2023-10-10T21:18:44.154073+0000","last_peered":"2023-10-10T21:18:44.154073+0000","last_clean":"2023-10-10T21:18:44.154073+0000","last_became_active":"2023-10-10T21:18:44.144262+0000","last_became_peered":"2023-10-10T21:18:44.144262+0000","last_unstale":"2023-10-10T21:18:44.154073+0000","last_undegraded":"2023-10-10T21:18:44.154073+0000","last_fullsized":"2023-10-10T21:18:44.154073+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:32.107198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.160576+0000","last_change":"2023-10-10T21:18:43.129649+0000","last_active":"2023-10-10T21:18:44.160576+0000","last_peered":"2023-10-10T21:18:44.160576+0000","last_clean":"2023-10-10T21:18:44.160576+0000","last_became_active":"2023-10-10T21:18:43.129328+0000","last_became_peered":"2023-10-10T21:18:43.129328+0000","last_unstale":"2023-10-10T21:18:44.160576+0000","last_undegraded":"2023-10-10T21:18:44.160576+0000","last_fullsized":"2023-10-10T21:18:44.160576+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:38:35.627483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151218+0000","last_change":"2023-10-10T21:18:44.149505+0000","last_active":"2023-10-10T21:18:44.151218+0000","last_peered":"2023-10-10T21:18:44.151218+0000","last_clean":"2023-10-10T21:18:44.151218+0000","last_became_active":"2023-10-10T21:18:44.149189+0000","last_became_peered":"2023-10-10T21:18:44.149189+0000","last_unstale":"2023-10-10T21:18:44.151218+0000","last_undegraded":"2023-10-10T21:18:44.151218+0000","last_fullsized":"2023-10-10T21:18:44.151218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:05:05.133734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.129638+0000","last_change":"2023-10-10T21:18:43.131186+0000","last_active":"2023-10-10T21:18:44.129638+0000","last_peered":"2023-10-10T21:18:44.129638+0000","last_clean":"2023-10-10T21:18:44.129638+0000","last_became_active":"2023-10-10T21:18:43.130936+0000","last_became_peered":"2023-10-10T21:18:43.130936+0000","last_unstale":"2023-10-10T21:18:44.129638+0000","last_undegraded":"2023-10-10T21:18:44.129638+0000","last_fullsized":"2023-10-10T21:18:44.129638+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:08:10.463497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.140651+0000","last_change":"2023-10-10T21:18:44.135977+0000","last_active":"2023-10-10T21:18:44.140651+0000","last_peered":"2023-10-10T21:18:44.140651+0000","last_clean":"2023-10-10T21:18:44.140651+0000","last_became_active":"2023-10-10T21:18:44.135714+0000","last_became_peered":"2023-10-10T21:18:44.135714+0000","last_unstale":"2023-10-10T21:18:44.140651+0000","last_undegraded":"2023-10-10T21:18:44.140651+0000","last_fullsized":"2023-10-10T21:18:44.140651+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:26:50.175674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.125906+0000","last_change":"2023-10-10T21:18:43.121951+0000","last_active":"2023-10-10T21:18:44.125906+0000","last_peered":"2023-10-10T21:18:44.125906+0000","last_clean":"2023-10-10T21:18:44.125906+0000","last_became_active":"2023-10-10T21:18:43.121641+0000","last_became_peered":"2023-10-10T21:18:43.121641+0000","last_unstale":"2023-10-10T21:18:44.125906+0000","last_undegraded":"2023-10-10T21:18:44.125906+0000","last_fullsized":"2023-10-10T21:18:44.125906+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:10:05.363157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152078+0000","last_change":"2023-10-10T21:18:44.141709+0000","last_active":"2023-10-10T21:18:44.152078+0000","last_peered":"2023-10-10T21:18:44.152078+0000","last_clean":"2023-10-10T21:18:44.152078+0000","last_became_active":"2023-10-10T21:18:44.140902+0000","last_became_peered":"2023-10-10T21:18:44.140902+0000","last_unstale":"2023-10-10T21:18:44.152078+0000","last_undegraded":"2023-10-10T21:18:44.152078+0000","last_fullsized":"2023-10-10T21:18:44.152078+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:35.571516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"108'8","reported_seq":18,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.163436+0000","last_change":"2023-10-10T21:18:43.125619+0000","last_active":"2023-10-10T21:18:44.163436+0000","last_peered":"2023-10-10T21:18:44.163436+0000","last_clean":"2023-10-10T21:18:44.163436+0000","last_became_active":"2023-10-10T21:18:43.125361+0000","last_became_peered":"2023-10-10T21:18:43.125361+0000","last_unstale":"2023-10-10T21:18:44.163436+0000","last_undegraded":"2023-10-10T21:18:44.163436+0000","last_fullsized":"2023-10-10T21:18:44.163436+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:14.463530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139802+0000","last_change":"2023-10-10T21:18:44.133827+0000","last_active":"2023-10-10T21:18:44.139802+0000","last_peered":"2023-10-10T21:18:44.139802+0000","last_clean":"2023-10-10T21:18:44.139802+0000","last_became_active":"2023-10-10T21:18:44.133563+0000","last_became_peered":"2023-10-10T21:18:44.133563+0000","last_unstale":"2023-10-10T21:18:44.139802+0000","last_undegraded":"2023-10-10T21:18:44.139802+0000","last_fullsized":"2023-10-10T21:18:44.139802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:41:05.642091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.154713+0000","last_change":"2023-10-10T21:18:43.130993+0000","last_active":"2023-10-10T21:18:44.154713+0000","last_peered":"2023-10-10T21:18:44.154713+0000","last_clean":"2023-10-10T21:18:44.154713+0000","last_became_active":"2023-10-10T21:18:43.130746+0000","last_became_peered":"2023-10-10T21:18:43.130746+0000","last_unstale":"2023-10-10T21:18:44.154713+0000","last_undegraded":"2023-10-10T21:18:44.154713+0000","last_fullsized":"2023-10-10T21:18:44.154713+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:19:12.203234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146047+0000","last_change":"2023-10-10T21:18:44.142504+0000","last_active":"2023-10-10T21:18:44.146047+0000","last_peered":"2023-10-10T21:18:44.146047+0000","last_clean":"2023-10-10T21:18:44.146047+0000","last_became_active":"2023-10-10T21:18:44.142235+0000","last_became_peered":"2023-10-10T21:18:44.142235+0000","last_unstale":"2023-10-10T21:18:44.146047+0000","last_undegraded":"2023-10-10T21:18:44.146047+0000","last_fullsized":"2023-10-10T21:18:44.146047+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:38:01.405596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.162729+0000","last_change":"2023-10-10T21:18:43.126357+0000","last_active":"2023-10-10T21:18:44.162729+0000","last_peered":"2023-10-10T21:18:44.162729+0000","last_clean":"2023-10-10T21:18:44.162729+0000","last_became_active":"2023-10-10T21:18:43.126155+0000","last_became_peered":"2023-10-10T21:18:43.126155+0000","last_unstale":"2023-10-10T21:18:44.162729+0000","last_undegraded":"2023-10-10T21:18:44.162729+0000","last_fullsized":"2023-10-10T21:18:44.162729+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:31:29.961670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145080+0000","last_change":"2023-10-10T21:18:44.137901+0000","last_active":"2023-10-10T21:18:44.145080+0000","last_peered":"2023-10-10T21:18:44.145080+0000","last_clean":"2023-10-10T21:18:44.145080+0000","last_became_active":"2023-10-10T21:18:44.137552+0000","last_became_peered":"2023-10-10T21:18:44.137552+0000","last_unstale":"2023-10-10T21:18:44.145080+0000","last_undegraded":"2023-10-10T21:18:44.145080+0000","last_fullsized":"2023-10-10T21:18:44.145080+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:05:05.133734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.124471+0000","last_change":"2023-10-10T21:18:43.130918+0000","last_active":"2023-10-10T21:18:44.124471+0000","last_peered":"2023-10-10T21:18:44.124471+0000","last_clean":"2023-10-10T21:18:44.124471+0000","last_became_active":"2023-10-10T21:18:43.130678+0000","last_became_peered":"2023-10-10T21:18:43.130678+0000","last_unstale":"2023-10-10T21:18:44.124471+0000","last_undegraded":"2023-10-10T21:18:44.124471+0000","last_fullsized":"2023-10-10T21:18:44.124471+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:21:20.776241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.157241+0000","last_change":"2023-10-10T21:18:44.152900+0000","last_active":"2023-10-10T21:18:44.157241+0000","last_peered":"2023-10-10T21:18:44.157241+0000","last_clean":"2023-10-10T21:18:44.157241+0000","last_became_active":"2023-10-10T21:18:44.152265+0000","last_became_peered":"2023-10-10T21:18:44.152265+0000","last_unstale":"2023-10-10T21:18:44.157241+0000","last_undegraded":"2023-10-10T21:18:44.157241+0000","last_fullsized":"2023-10-10T21:18:44.157241+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:59:07.088476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.157415+0000","last_change":"2023-10-10T21:18:43.121194+0000","last_active":"2023-10-10T21:18:44.157415+0000","last_peered":"2023-10-10T21:18:44.157415+0000","last_clean":"2023-10-10T21:18:44.157415+0000","last_became_active":"2023-10-10T21:18:43.120883+0000","last_became_peered":"2023-10-10T21:18:43.120883+0000","last_unstale":"2023-10-10T21:18:44.157415+0000","last_undegraded":"2023-10-10T21:18:44.157415+0000","last_fullsized":"2023-10-10T21:18:44.157415+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:02.698245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139935+0000","last_change":"2023-10-10T21:18:44.136517+0000","last_active":"2023-10-10T21:18:44.139935+0000","last_peered":"2023-10-10T21:18:44.139935+0000","last_clean":"2023-10-10T21:18:44.139935+0000","last_became_active":"2023-10-10T21:18:44.136159+0000","last_became_peered":"2023-10-10T21:18:44.136159+0000","last_unstale":"2023-10-10T21:18:44.139935+0000","last_undegraded":"2023-10-10T21:18:44.139935+0000","last_fullsized":"2023-10-10T21:18:44.139935+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:02.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.131139+0000","last_change":"2023-10-10T21:18:43.124166+0000","last_active":"2023-10-10T21:18:44.131139+0000","last_peered":"2023-10-10T21:18:44.131139+0000","last_clean":"2023-10-10T21:18:44.131139+0000","last_became_active":"2023-10-10T21:18:43.123879+0000","last_became_peered":"2023-10-10T21:18:43.123879+0000","last_unstale":"2023-10-10T21:18:44.131139+0000","last_undegraded":"2023-10-10T21:18:44.131139+0000","last_fullsized":"2023-10-10T21:18:44.131139+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:38:11.312886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146123+0000","last_change":"2023-10-10T21:18:44.139955+0000","last_active":"2023-10-10T21:18:44.146123+0000","last_peered":"2023-10-10T21:18:44.146123+0000","last_clean":"2023-10-10T21:18:44.146123+0000","last_became_active":"2023-10-10T21:18:44.139700+0000","last_became_peered":"2023-10-10T21:18:44.139700+0000","last_unstale":"2023-10-10T21:18:44.146123+0000","last_undegraded":"2023-10-10T21:18:44.146123+0000","last_fullsized":"2023-10-10T21:18:44.146123+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:56:03.532703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.128501+0000","last_change":"2023-10-10T21:18:43.126416+0000","last_active":"2023-10-10T21:18:44.128501+0000","last_peered":"2023-10-10T21:18:44.128501+0000","last_clean":"2023-10-10T21:18:44.128501+0000","last_became_active":"2023-10-10T21:18:43.126177+0000","last_became_peered":"2023-10-10T21:18:43.126177+0000","last_unstale":"2023-10-10T21:18:44.128501+0000","last_undegraded":"2023-10-10T21:18:44.128501+0000","last_fullsized":"2023-10-10T21:18:44.128501+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:06.702924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.142469+0000","last_change":"2023-10-10T21:18:44.139728+0000","last_active":"2023-10-10T21:18:44.142469+0000","last_peered":"2023-10-10T21:18:44.142469+0000","last_clean":"2023-10-10T21:18:44.142469+0000","last_became_active":"2023-10-10T21:18:44.139399+0000","last_became_peered":"2023-10-10T21:18:44.139399+0000","last_unstale":"2023-10-10T21:18:44.142469+0000","last_undegraded":"2023-10-10T21:18:44.142469+0000","last_fullsized":"2023-10-10T21:18:44.142469+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:17:45.061288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.127347+0000","last_change":"2023-10-10T21:18:43.117676+0000","last_active":"2023-10-10T21:18:44.127347+0000","last_peered":"2023-10-10T21:18:44.127347+0000","last_clean":"2023-10-10T21:18:44.127347+0000","last_became_active":"2023-10-10T21:18:43.117357+0000","last_became_peered":"2023-10-10T21:18:43.117357+0000","last_unstale":"2023-10-10T21:18:44.127347+0000","last_undegraded":"2023-10-10T21:18:44.127347+0000","last_fullsized":"2023-10-10T21:18:44.127347+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:33:06.578580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143905+0000","last_change":"2023-10-10T21:18:44.135537+0000","last_active":"2023-10-10T21:18:44.143905+0000","last_peered":"2023-10-10T21:18:44.143905+0000","last_clean":"2023-10-10T21:18:44.143905+0000","last_became_active":"2023-10-10T21:18:44.135245+0000","last_became_peered":"2023-10-10T21:18:44.135245+0000","last_unstale":"2023-10-10T21:18:44.143905+0000","last_undegraded":"2023-10-10T21:18:44.143905+0000","last_fullsized":"2023-10-10T21:18:44.143905+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:32.643038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.157785+0000","last_change":"2023-10-10T21:18:43.125770+0000","last_active":"2023-10-10T21:18:44.157785+0000","last_peered":"2023-10-10T21:18:44.157785+0000","last_clean":"2023-10-10T21:18:44.157785+0000","last_became_active":"2023-10-10T21:18:43.125519+0000","last_became_peered":"2023-10-10T21:18:43.125519+0000","last_unstale":"2023-10-10T21:18:44.157785+0000","last_undegraded":"2023-10-10T21:18:44.157785+0000","last_fullsized":"2023-10-10T21:18:44.157785+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:18.164743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145072+0000","last_change":"2023-10-10T21:18:44.141540+0000","last_active":"2023-10-10T21:18:44.145072+0000","last_peered":"2023-10-10T21:18:44.145072+0000","last_clean":"2023-10-10T21:18:44.145072+0000","last_became_active":"2023-10-10T21:18:44.141272+0000","last_became_peered":"2023-10-10T21:18:44.141272+0000","last_unstale":"2023-10-10T21:18:44.145072+0000","last_undegraded":"2023-10-10T21:18:44.145072+0000","last_fullsized":"2023-10-10T21:18:44.145072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:43:11.303976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.131383+0000","last_change":"2023-10-10T21:18:43.130251+0000","last_active":"2023-10-10T21:18:44.131383+0000","last_peered":"2023-10-10T21:18:44.131383+0000","last_clean":"2023-10-10T21:18:44.131383+0000","last_became_active":"2023-10-10T21:18:43.130005+0000","last_became_peered":"2023-10-10T21:18:43.130005+0000","last_unstale":"2023-10-10T21:18:44.131383+0000","last_undegraded":"2023-10-10T21:18:44.131383+0000","last_fullsized":"2023-10-10T21:18:44.131383+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:48:47.942889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.148695+0000","last_change":"2023-10-10T21:18:44.147072+0000","last_active":"2023-10-10T21:18:44.148695+0000","last_peered":"2023-10-10T21:18:44.148695+0000","last_clean":"2023-10-10T21:18:44.148695+0000","last_became_active":"2023-10-10T21:18:44.146319+0000","last_became_peered":"2023-10-10T21:18:44.146319+0000","last_unstale":"2023-10-10T21:18:44.148695+0000","last_undegraded":"2023-10-10T21:18:44.148695+0000","last_fullsized":"2023-10-10T21:18:44.148695+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:04:42.359540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.133207+0000","last_change":"2023-10-10T21:18:43.126049+0000","last_active":"2023-10-10T21:18:44.133207+0000","last_peered":"2023-10-10T21:18:44.133207+0000","last_clean":"2023-10-10T21:18:44.133207+0000","last_became_active":"2023-10-10T21:18:43.125803+0000","last_became_peered":"2023-10-10T21:18:43.125803+0000","last_unstale":"2023-10-10T21:18:44.133207+0000","last_undegraded":"2023-10-10T21:18:44.133207+0000","last_fullsized":"2023-10-10T21:18:44.133207+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:52:50.993864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145264+0000","last_change":"2023-10-10T21:18:44.143450+0000","last_active":"2023-10-10T21:18:44.145264+0000","last_peered":"2023-10-10T21:18:44.145264+0000","last_clean":"2023-10-10T21:18:44.145264+0000","last_became_active":"2023-10-10T21:18:44.142803+0000","last_became_peered":"2023-10-10T21:18:44.142803+0000","last_unstale":"2023-10-10T21:18:44.145264+0000","last_undegraded":"2023-10-10T21:18:44.145264+0000","last_fullsized":"2023-10-10T21:18:44.145264+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:04:35.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.135969+0000","last_change":"2023-10-10T21:18:43.132746+0000","last_active":"2023-10-10T21:18:44.135969+0000","last_peered":"2023-10-10T21:18:44.135969+0000","last_clean":"2023-10-10T21:18:44.135969+0000","last_became_active":"2023-10-10T21:18:43.132482+0000","last_became_peered":"2023-10-10T21:18:43.132482+0000","last_unstale":"2023-10-10T21:18:44.135969+0000","last_undegraded":"2023-10-10T21:18:44.135969+0000","last_fullsized":"2023-10-10T21:18:44.135969+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.141729+0000","last_change":"2023-10-10T21:18:44.136660+0000","last_active":"2023-10-10T21:18:44.141729+0000","last_peered":"2023-10-10T21:18:44.141729+0000","last_clean":"2023-10-10T21:18:44.141729+0000","last_became_active":"2023-10-10T21:18:44.135538+0000","last_became_peered":"2023-10-10T21:18:44.135538+0000","last_unstale":"2023-10-10T21:18:44.141729+0000","last_undegraded":"2023-10-10T21:18:44.141729+0000","last_fullsized":"2023-10-10T21:18:44.141729+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:17:14.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.124705+0000","last_change":"2023-10-10T21:18:43.127941+0000","last_active":"2023-10-10T21:18:44.124705+0000","last_peered":"2023-10-10T21:18:44.124705+0000","last_clean":"2023-10-10T21:18:44.124705+0000","last_became_active":"2023-10-10T21:18:43.127638+0000","last_became_peered":"2023-10-10T21:18:43.127638+0000","last_unstale":"2023-10-10T21:18:44.124705+0000","last_undegraded":"2023-10-10T21:18:44.124705+0000","last_fullsized":"2023-10-10T21:18:44.124705+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:17:44.055418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151001+0000","last_change":"2023-10-10T21:18:44.145444+0000","last_active":"2023-10-10T21:18:44.151001+0000","last_peered":"2023-10-10T21:18:44.151001+0000","last_clean":"2023-10-10T21:18:44.151001+0000","last_became_active":"2023-10-10T21:18:44.145210+0000","last_became_peered":"2023-10-10T21:18:44.145210+0000","last_unstale":"2023-10-10T21:18:44.151001+0000","last_undegraded":"2023-10-10T21:18:44.151001+0000","last_fullsized":"2023-10-10T21:18:44.151001+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:38:01.405596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.125531+0000","last_change":"2023-10-10T21:18:43.133519+0000","last_active":"2023-10-10T21:18:44.125531+0000","last_peered":"2023-10-10T21:18:44.125531+0000","last_clean":"2023-10-10T21:18:44.125531+0000","last_became_active":"2023-10-10T21:18:43.132933+0000","last_became_peered":"2023-10-10T21:18:43.132933+0000","last_unstale":"2023-10-10T21:18:44.125531+0000","last_undegraded":"2023-10-10T21:18:44.125531+0000","last_fullsized":"2023-10-10T21:18:44.125531+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:17.981214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.154168+0000","last_change":"2023-10-10T21:18:44.152116+0000","last_active":"2023-10-10T21:18:44.154168+0000","last_peered":"2023-10-10T21:18:44.154168+0000","last_clean":"2023-10-10T21:18:44.154168+0000","last_became_active":"2023-10-10T21:18:44.151845+0000","last_became_peered":"2023-10-10T21:18:44.151845+0000","last_unstale":"2023-10-10T21:18:44.154168+0000","last_undegraded":"2023-10-10T21:18:44.154168+0000","last_fullsized":"2023-10-10T21:18:44.154168+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:19:54.163904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.133507+0000","last_change":"2023-10-10T21:18:43.133431+0000","last_active":"2023-10-10T21:18:44.133507+0000","last_peered":"2023-10-10T21:18:44.133507+0000","last_clean":"2023-10-10T21:18:44.133507+0000","last_became_active":"2023-10-10T21:18:43.133080+0000","last_became_peered":"2023-10-10T21:18:43.133080+0000","last_unstale":"2023-10-10T21:18:44.133507+0000","last_undegraded":"2023-10-10T21:18:44.133507+0000","last_fullsized":"2023-10-10T21:18:44.133507+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:10:05.363157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147340+0000","last_change":"2023-10-10T21:18:44.142116+0000","last_active":"2023-10-10T21:18:44.147340+0000","last_peered":"2023-10-10T21:18:44.147340+0000","last_clean":"2023-10-10T21:18:44.147340+0000","last_became_active":"2023-10-10T21:18:44.141672+0000","last_became_peered":"2023-10-10T21:18:44.141672+0000","last_unstale":"2023-10-10T21:18:44.147340+0000","last_undegraded":"2023-10-10T21:18:44.147340+0000","last_fullsized":"2023-10-10T21:18:44.147340+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:17:14.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.125278+0000","last_change":"2023-10-10T21:18:43.127755+0000","last_active":"2023-10-10T21:18:44.125278+0000","last_peered":"2023-10-10T21:18:44.125278+0000","last_clean":"2023-10-10T21:18:44.125278+0000","last_became_active":"2023-10-10T21:18:43.127377+0000","last_became_peered":"2023-10-10T21:18:43.127377+0000","last_unstale":"2023-10-10T21:18:44.125278+0000","last_undegraded":"2023-10-10T21:18:44.125278+0000","last_fullsized":"2023-10-10T21:18:44.125278+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:23.191516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.142471+0000","last_change":"2023-10-10T21:18:44.137551+0000","last_active":"2023-10-10T21:18:44.142471+0000","last_peered":"2023-10-10T21:18:44.142471+0000","last_clean":"2023-10-10T21:18:44.142471+0000","last_became_active":"2023-10-10T21:18:44.137297+0000","last_became_peered":"2023-10-10T21:18:44.137297+0000","last_unstale":"2023-10-10T21:18:44.142471+0000","last_undegraded":"2023-10-10T21:18:44.142471+0000","last_fullsized":"2023-10-10T21:18:44.142471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:12.206390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.160864+0000","last_change":"2023-10-10T21:18:43.130236+0000","last_active":"2023-10-10T21:18:44.160864+0000","last_peered":"2023-10-10T21:18:44.160864+0000","last_clean":"2023-10-10T21:18:44.160864+0000","last_became_active":"2023-10-10T21:18:43.129963+0000","last_became_peered":"2023-10-10T21:18:43.129963+0000","last_unstale":"2023-10-10T21:18:44.160864+0000","last_undegraded":"2023-10-10T21:18:44.160864+0000","last_fullsized":"2023-10-10T21:18:44.160864+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:17:44.055418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"98'205","reported_seq":552,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.130163+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:44.130163+0000","last_peered":"2023-10-10T21:18:44.130163+0000","last_clean":"2023-10-10T21:18:44.130163+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:44.130163+0000","last_undegraded":"2023-10-10T21:18:44.130163+0000","last_fullsized":"2023-10-10T21:18:44.130163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542342,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303272,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068568,"statfs":{"total":96636764160,"available":96326213632,"internally_reserved":0,"allocated":1933312,"data_stored":1238540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.014,"15min":1.1859999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.53900000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.45200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.79600000000000004,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88600000000000001,"5min":1.0069999999999999,"15min":1.123},"last":0.58599999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67000000000000004,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.752},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.50600000000000001,"5min":0.504,"15min":0.433},"max":{"1min":0.79800000000000004,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.0589999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2669999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.623,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":1.016}]},{"osd":5,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.627},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90300000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.85499999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.88500000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542341,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1347584,"data_stored":648768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66200000000000003,"15min":0.68999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":1.0189999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.92600000000000005,"15min":1.1040000000000001},"last":0.54400000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.502,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.03},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.497,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.98699999999999999,"15min":1.073},"last":0.60299999999999998}]},{"osd":2,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.69299999999999995},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86199999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.54900000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.624}]},{"osd":3,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.501,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":0.84599999999999997,"5min":1.042,"15min":1.042},"last":0.57899999999999996}]},{"osd":4,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.97199999999999998},"last":0.81799999999999995}]},{"osd":5,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.54200000000000004,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.022},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.94499999999999995,"5min":1.024,"15min":1.0629999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.0289999999999999},"last":0.79000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542341,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1347584,"data_stored":648296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.61899999999999999,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":0.622,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.442}]},{"osd":2,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.503,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.63700000000000001,"5min":2.254,"15min":2.254},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.48399999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66300000000000003,"5min":0.999,"15min":0.999},"last":0.52400000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80700000000000005,"5min":4.806,"15min":4.806},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.754,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.871,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.60599999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.79500000000000004,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.73499999999999999,"5min":6.968,"15min":6.968},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.89000000000000001,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.876,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91500000000000004,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.83499999999999996},"min":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84199999999999997,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.752}]},{"osd":7,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.502,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.83499999999999996,"5min":12.026,"15min":12.026},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.86599999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.66400000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542343,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299176,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072664,"statfs":{"total":96636764160,"available":96330407936,"internally_reserved":0,"allocated":1933312,"data_stored":1238504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.61199999999999999,"5min":0.74399999999999999,"15min":0.752},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68899999999999995,"5min":0.879,"15min":0.91800000000000004},"last":0.35599999999999998}]},{"osd":2,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.82099999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51000000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":0.85999999999999999,"15min":0.90300000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.40300000000000002},"max":{"1min":0.73499999999999999,"5min":0.874,"15min":0.874},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.58799999999999997,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.96799999999999997,"5min":1.101,"15min":1.1080000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.49099999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85999999999999999,"5min":0.96599999999999997,"15min":1.1879999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":0.96899999999999997,"5min":1.03,"15min":1.2190000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79500000000000004,"15min":0.82399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.754},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.054,"15min":1.143},"last":0.80400000000000005}]},{"osd":7,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0529999999999999,"5min":1.139,"15min":1.169},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.024,"15min":1.165},"last":0.73299999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542343,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310884,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060956,"statfs":{"total":96636764160,"available":96318418944,"internally_reserved":0,"allocated":1339392,"data_stored":648656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.75,"15min":0.95699999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.433}]},{"osd":1,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.5}]},{"osd":3,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53600000000000003,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71899999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.54200000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.53400000000000003,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.92000000000000004,"5min":1.157,"15min":1.3109999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":0.91900000000000004,"5min":1.26,"15min":1.26},"last":0.93400000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97299999999999998,"5min":2.21,"15min":2.21},"last":1.03},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.75,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.268},"last":0.96499999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.0509999999999999,"15min":1.3080000000000001},"last":1.008},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.79500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.042}]},{"osd":7,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.79200000000000004},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2290000000000001,"5min":1.716,"15min":1.716},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":1.006,"15min":1.2330000000000001},"last":0.90900000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509638,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1347584,"data_stored":649638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27900000000000003},"max":{"1min":0.55800000000000005,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.47799999999999998,"15min":0.495},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28799999999999998},"max":{"1min":0.59999999999999998,"5min":0.77000000000000002,"15min":0.84399999999999997},"last":0.40300000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46999999999999997,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":0.68300000000000005,"5min":0.87,"15min":0.87},"last":0.379},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.50800000000000001,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.76500000000000001},"last":0.48599999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.35899999999999999},"max":{"1min":0.85799999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76900000000000002,"5min":0.78900000000000003,"15min":0.92200000000000004},"last":0.59899999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73799999999999999,"15min":0.77200000000000002},"min":{"1min":0.48799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0149999999999999,"5min":1.1200000000000001,"15min":1.3440000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73799999999999999,"15min":0.78700000000000003},"min":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.1859999999999999,"15min":1.246},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":0.94199999999999995,"5min":1.21,"15min":1.262},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":0.91600000000000004,"5min":1.2250000000000001,"15min":1.228},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.56200000000000006,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":0.97999999999999998,"5min":1.27,"15min":1.27},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77900000000000003,"15min":0.80000000000000004},"min":{"1min":0.58999999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.997,"5min":1.224,"15min":1.224},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.117,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78700000000000003,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.0720000000000001,"5min":1.228,"15min":1.3200000000000001},"last":0.82599999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542343,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310880,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060960,"statfs":{"total":96636764160,"available":96318423040,"internally_reserved":0,"allocated":1335296,"data_stored":648102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41499999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63,"5min":0.68799999999999994,"15min":0.72599999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.121,"5min":1.121,"15min":1.5029999999999999},"last":0.59599999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.47},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67100000000000004,"15min":0.69699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97499999999999998,"5min":1.002,"15min":1.536},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.397},"last":0.75},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.385},"last":0.68300000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1,"5min":1.0009999999999999,"15min":1.196},"last":0.69899999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.66700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.68899999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.216},"last":0.61399999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98999999999999999,"5min":1.006,"15min":1.2390000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70199999999999996,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":1.034,"5min":1.034,"15min":1.4139999999999999},"last":0.73899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542341,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302704,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069136,"statfs":{"total":96636764160,"available":96326795264,"internally_reserved":0,"allocated":1351680,"data_stored":649660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.66700000000000004,"15min":0.68999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.95399999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.79300000000000004,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.66800000000000004,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.748,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.627},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.68100000000000005,"15min":0.71299999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.99299999999999999,"15min":1.018},"last":0.60199999999999998}]},{"osd":2,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68200000000000005,"15min":0.71099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96699999999999997},"last":0.67500000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.5,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":1.044},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.62,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.78800000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":1.496,"15min":1.496},"last":0.55200000000000005}]},{"osd":6,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84799999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0049999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93500000000000005,"5min":1.077,"15min":1.077},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:53.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:18:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.652+0000 7fd5b19ff700 1 Processor -- start 2023-10-10T21:18:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.652+0000 7fd5b19ff700 1 -- start start 2023-10-10T21:18:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5b19ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd5ac155c10 0x7fd5ac155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5b19ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ac230 0x7fd5ac0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5b19ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5ac0ccc40 0x7fd5ac0af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5b19ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0ad930 con 0x7fd5ac0ccc40 2023-10-10T21:18:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5b19ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0acd20 con 0x7fd5ac155c10 2023-10-10T21:18:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5b19ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac0ad000 con 0x7fd5ac0ac230 2023-10-10T21:18:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5ab7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5ac0ccc40 0x7fd5ac0af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5ab7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5ac0ccc40 0x7fd5ac0af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42772/0 (socket says 172.21.15.154:42772) 2023-10-10T21:18:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5ab7fe700 1 -- 172.21.15.154:0/2527327152 learned_addr learned my addr 172.21.15.154:0/2527327152 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5a3fff700 1 --2- 172.21.15.154:0/2527327152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ac230 0x7fd5ac0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5aaffd700 1 --2- 172.21.15.154:0/2527327152 >> v2:172.21.15.179:3300/0 conn(0x7fd5ac155c10 0x7fd5ac155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5ab7fe700 1 -- 172.21.15.154:0/2527327152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ac230 msgr2=0x7fd5ac0ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.654+0000 7fd5ab7fe700 1 --2- 172.21.15.154:0/2527327152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ac230 0x7fd5ac0ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.655+0000 7fd5ab7fe700 1 -- 172.21.15.154:0/2527327152 >> v2:172.21.15.179:3300/0 conn(0x7fd5ac155c10 msgr2=0x7fd5ac155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.655+0000 7fd5ab7fe700 1 --2- 172.21.15.154:0/2527327152 >> v2:172.21.15.179:3300/0 conn(0x7fd5ac155c10 0x7fd5ac155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.655+0000 7fd5ab7fe700 1 -- 172.21.15.154:0/2527327152 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac0ad2e0 con 0x7fd5ac0ccc40 2023-10-10T21:18:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.655+0000 7fd5ab7fe700 1 --2- 172.21.15.154:0/2527327152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac0ccc40 0x7fd5ac0af2f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac063d40 tx=0x7fd5a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136b3ef47e37a5bf server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:53.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.655+0000 7fd5aa7fc700 1 -- 172.21.15.154:0/2527327152 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a400e070 con 0x7fd5ac0ccc40 2023-10-10T21:18:53.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.655+0000 7fd5aa7fc700 1 -- 172.21.15.154:0/2527327152 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a400b970 con 0x7fd5ac0ccc40 2023-10-10T21:18:53.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.655+0000 7fd5aa7fc700 1 -- 172.21.15.154:0/2527327152 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40092e0 con 0x7fd5ac0ccc40 2023-10-10T21:18:53.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.655+0000 7fd5b19ff700 1 -- 172.21.15.154:0/2527327152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac0ccc40 msgr2=0x7fd5ac0af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:53.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.655+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/2527327152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac0ccc40 0x7fd5ac0af2f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac063d40 tx=0x7fd5a4009840 comp rx=0 tx=0).stop 2023-10-10T21:18:53.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.656+0000 7fd5b19ff700 1 -- 172.21.15.154:0/2527327152 shutdown_connections 2023-10-10T21:18:53.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.656+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/2527327152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac0ccc40 0x7fd5ac0af2f0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.656+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/2527327152 >> v2:172.21.15.179:3300/0 conn(0x7fd5ac155c10 0x7fd5ac155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.656+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/2527327152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ac230 0x7fd5ac0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.656+0000 7fd5b19ff700 1 -- 172.21.15.154:0/2527327152 >> 172.21.15.154:0/2527327152 conn(0x7fd5ac06a320 msgr2=0x7fd5ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:53.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.656+0000 7fd5b19ff700 1 -- 172.21.15.154:0/2527327152 shutdown_connections 2023-10-10T21:18:53.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.656+0000 7fd5b19ff700 1 -- 172.21.15.154:0/2527327152 wait complete. 2023-10-10T21:18:53.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.657+0000 7fd5b19ff700 1 Processor -- start 2023-10-10T21:18:53.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.657+0000 7fd5b19ff700 1 -- start start 2023-10-10T21:18:53.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.658+0000 7fd5b19ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac0ac230 0x7fd5ac16d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:53.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.658+0000 7fd5b19ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ccc40 0x7fd5ac154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:53.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.658+0000 7fd5b19ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac155c10 0x7fd5ac1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:53.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.658+0000 7fd5b19ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac15f150 con 0x7fd5ac155c10 2023-10-10T21:18:53.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.658+0000 7fd5b19ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac15e730 con 0x7fd5ac0ac230 2023-10-10T21:18:53.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.658+0000 7fd5b19ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac154f10 con 0x7fd5ac0ccc40 2023-10-10T21:18:53.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5ab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac155c10 0x7fd5ac1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:53.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5ab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac155c10 0x7fd5ac1567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42778/0 (socket says 172.21.15.154:42778) 2023-10-10T21:18:53.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5ab7fe700 1 -- 172.21.15.154:0/1005033249 learned_addr learned my addr 172.21.15.154:0/1005033249 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:53.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5aaffd700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac0ac230 0x7fd5ac16d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:53.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5a3fff700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ccc40 0x7fd5ac154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:53.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5ab7fe700 1 -- 172.21.15.154:0/1005033249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ccc40 msgr2=0x7fd5ac154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:53.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5ab7fe700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ccc40 0x7fd5ac154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5ab7fe700 1 -- 172.21.15.154:0/1005033249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac0ac230 msgr2=0x7fd5ac16d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:53.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5ab7fe700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac0ac230 0x7fd5ac16d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5ab7fe700 1 -- 172.21.15.154:0/1005033249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4009ae0 con 0x7fd5ac155c10 2023-10-10T21:18:53.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.659+0000 7fd5ab7fe700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac155c10 0x7fd5ac1567a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac064290 tx=0x7fd5a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.660+0000 7fd5a2ffd700 1 -- 172.21.15.154:0/1005033249 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4008ad0 con 0x7fd5ac155c10 2023-10-10T21:18:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.660+0000 7fd5a2ffd700 1 -- 172.21.15.154:0/1005033249 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4008c30 con 0x7fd5ac155c10 2023-10-10T21:18:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.660+0000 7fd5a2ffd700 1 -- 172.21.15.154:0/1005033249 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4026460 con 0x7fd5ac155c10 2023-10-10T21:18:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.660+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ac15ebb0 con 0x7fd5ac155c10 2023-10-10T21:18:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.660+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac15e3c0 con 0x7fd5ac155c10 2023-10-10T21:18:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.661+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac04c3c0 con 0x7fd5ac155c10 2023-10-10T21:18:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.662+0000 7fd5a2ffd700 1 -- 172.21.15.154:0/1005033249 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5a4003040 con 0x7fd5ac155c10 2023-10-10T21:18:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.662+0000 7fd5a2ffd700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd58c066f30 0x7fd58c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.662+0000 7fd5a2ffd700 1 -- 172.21.15.154:0/1005033249 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fd5a4086520 con 0x7fd5ac155c10 2023-10-10T21:18:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.663+0000 7fd5aaffd700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd58c066f30 0x7fd58c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.663+0000 7fd5aaffd700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd58c066f30 0x7fd58c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009d10 tx=0x7fd59c0091a0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.667+0000 7fd5a2ffd700 1 -- 172.21.15.154:0/1005033249 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5a40536b0 con 0x7fd5ac155c10 2023-10-10T21:18:53.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.855+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5ac0ad5c0 con 0x7fd58c066f30 2023-10-10T21:18:53.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.864+0000 7fd5a2ffd700 1 -- 172.21.15.154:0/1005033249 <== mgr.7005 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289435 (secure 0 0 0) 0x7fd5ac0ad5c0 con 0x7fd58c066f30 2023-10-10T21:18:53.869 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:53.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd58c066f30 msgr2=0x7fd58c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd58c066f30 0x7fd58c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009d10 tx=0x7fd59c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac155c10 msgr2=0x7fd5ac1567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac155c10 0x7fd5ac1567a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac064290 tx=0x7fd5a4018000 comp rx=0 tx=0).stop 2023-10-10T21:18:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 shutdown_connections 2023-10-10T21:18:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5ac155c10 0x7fd5ac1567a0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fd58c066f30 0x7fd58c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac0ac230 0x7fd5ac16d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 --2- 172.21.15.154:0/1005033249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0ccc40 0x7fd5ac154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:53.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 >> 172.21.15.154:0/1005033249 conn(0x7fd5ac06a320 msgr2=0x7fd5ac15f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:53.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 shutdown_connections 2023-10-10T21:18:53.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:53.869+0000 7fd5b19ff700 1 -- 172.21.15.154:0/1005033249 wait complete. 2023-10-10T21:18:53.874 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:18:53.888 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-10T21:18:53.804138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439112,"kb_used_data":11656,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752535608,"statfs":{"total":773094113280,"available":770596462592,"internally_reserved":0,"allocated":11935744,"data_stored":6370164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.681975"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.148073+0000","last_change":"2023-10-10T21:18:44.145637+0000","last_active":"2023-10-10T21:18:44.148073+0000","last_peered":"2023-10-10T21:18:44.148073+0000","last_clean":"2023-10-10T21:18:44.148073+0000","last_became_active":"2023-10-10T21:18:44.145323+0000","last_became_peered":"2023-10-10T21:18:44.145323+0000","last_unstale":"2023-10-10T21:18:44.148073+0000","last_undegraded":"2023-10-10T21:18:44.148073+0000","last_fullsized":"2023-10-10T21:18:44.148073+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:02.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155598+0000","last_change":"2023-10-10T21:18:44.151823+0000","last_active":"2023-10-10T21:18:44.155598+0000","last_peered":"2023-10-10T21:18:44.155598+0000","last_clean":"2023-10-10T21:18:44.155598+0000","last_became_active":"2023-10-10T21:18:44.151567+0000","last_became_peered":"2023-10-10T21:18:44.151567+0000","last_unstale":"2023-10-10T21:18:44.155598+0000","last_undegraded":"2023-10-10T21:18:44.155598+0000","last_fullsized":"2023-10-10T21:18:44.155598+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:17:52.866216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.144885+0000","last_change":"2023-10-10T21:18:44.141834+0000","last_active":"2023-10-10T21:18:44.144885+0000","last_peered":"2023-10-10T21:18:44.144885+0000","last_clean":"2023-10-10T21:18:44.144885+0000","last_became_active":"2023-10-10T21:18:44.141601+0000","last_became_peered":"2023-10-10T21:18:44.141601+0000","last_unstale":"2023-10-10T21:18:44.144885+0000","last_undegraded":"2023-10-10T21:18:44.144885+0000","last_fullsized":"2023-10-10T21:18:44.144885+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:03.362101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146151+0000","last_change":"2023-10-10T21:18:44.138191+0000","last_active":"2023-10-10T21:18:44.146151+0000","last_peered":"2023-10-10T21:18:44.146151+0000","last_clean":"2023-10-10T21:18:44.146151+0000","last_became_active":"2023-10-10T21:18:44.137894+0000","last_became_peered":"2023-10-10T21:18:44.137894+0000","last_unstale":"2023-10-10T21:18:44.146151+0000","last_undegraded":"2023-10-10T21:18:44.146151+0000","last_fullsized":"2023-10-10T21:18:44.146151+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:51.180926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145006+0000","last_change":"2023-10-10T21:18:44.137189+0000","last_active":"2023-10-10T21:18:44.145006+0000","last_peered":"2023-10-10T21:18:44.145006+0000","last_clean":"2023-10-10T21:18:44.145006+0000","last_became_active":"2023-10-10T21:18:44.136931+0000","last_became_peered":"2023-10-10T21:18:44.136931+0000","last_unstale":"2023-10-10T21:18:44.145006+0000","last_undegraded":"2023-10-10T21:18:44.145006+0000","last_fullsized":"2023-10-10T21:18:44.145006+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:30.899645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143547+0000","last_change":"2023-10-10T21:18:44.141887+0000","last_active":"2023-10-10T21:18:44.143547+0000","last_peered":"2023-10-10T21:18:44.143547+0000","last_clean":"2023-10-10T21:18:44.143547+0000","last_became_active":"2023-10-10T21:18:44.141545+0000","last_became_peered":"2023-10-10T21:18:44.141545+0000","last_unstale":"2023-10-10T21:18:44.143547+0000","last_undegraded":"2023-10-10T21:18:44.143547+0000","last_fullsized":"2023-10-10T21:18:44.143547+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:15.469400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.141601+0000","last_change":"2023-10-10T21:18:44.136523+0000","last_active":"2023-10-10T21:18:44.141601+0000","last_peered":"2023-10-10T21:18:44.141601+0000","last_clean":"2023-10-10T21:18:44.141601+0000","last_became_active":"2023-10-10T21:18:44.136256+0000","last_became_peered":"2023-10-10T21:18:44.136256+0000","last_unstale":"2023-10-10T21:18:44.141601+0000","last_undegraded":"2023-10-10T21:18:44.141601+0000","last_fullsized":"2023-10-10T21:18:44.141601+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:55:43.030832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152165+0000","last_change":"2023-10-10T21:18:44.150277+0000","last_active":"2023-10-10T21:18:44.152165+0000","last_peered":"2023-10-10T21:18:44.152165+0000","last_clean":"2023-10-10T21:18:44.152165+0000","last_became_active":"2023-10-10T21:18:44.150000+0000","last_became_peered":"2023-10-10T21:18:44.150000+0000","last_unstale":"2023-10-10T21:18:44.152165+0000","last_undegraded":"2023-10-10T21:18:44.152165+0000","last_fullsized":"2023-10-10T21:18:44.152165+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:12:13.439709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143516+0000","last_change":"2023-10-10T21:18:44.140379+0000","last_active":"2023-10-10T21:18:44.143516+0000","last_peered":"2023-10-10T21:18:44.143516+0000","last_clean":"2023-10-10T21:18:44.143516+0000","last_became_active":"2023-10-10T21:18:44.140099+0000","last_became_peered":"2023-10-10T21:18:44.140099+0000","last_unstale":"2023-10-10T21:18:44.143516+0000","last_undegraded":"2023-10-10T21:18:44.143516+0000","last_fullsized":"2023-10-10T21:18:44.143516+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:31:30.967539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146017+0000","last_change":"2023-10-10T21:18:44.141754+0000","last_active":"2023-10-10T21:18:44.146017+0000","last_peered":"2023-10-10T21:18:44.146017+0000","last_clean":"2023-10-10T21:18:44.146017+0000","last_became_active":"2023-10-10T21:18:44.141304+0000","last_became_peered":"2023-10-10T21:18:44.141304+0000","last_unstale":"2023-10-10T21:18:44.146017+0000","last_undegraded":"2023-10-10T21:18:44.146017+0000","last_fullsized":"2023-10-10T21:18:44.146017+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:51.644127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139733+0000","last_change":"2023-10-10T21:18:44.134706+0000","last_active":"2023-10-10T21:18:44.139733+0000","last_peered":"2023-10-10T21:18:44.139733+0000","last_clean":"2023-10-10T21:18:44.139733+0000","last_became_active":"2023-10-10T21:18:44.134442+0000","last_became_peered":"2023-10-10T21:18:44.134442+0000","last_unstale":"2023-10-10T21:18:44.139733+0000","last_undegraded":"2023-10-10T21:18:44.139733+0000","last_fullsized":"2023-10-10T21:18:44.139733+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:59:09.994907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143405+0000","last_change":"2023-10-10T21:18:44.137923+0000","last_active":"2023-10-10T21:18:44.143405+0000","last_peered":"2023-10-10T21:18:44.143405+0000","last_clean":"2023-10-10T21:18:44.143405+0000","last_became_active":"2023-10-10T21:18:44.137667+0000","last_became_peered":"2023-10-10T21:18:44.137667+0000","last_unstale":"2023-10-10T21:18:44.143405+0000","last_undegraded":"2023-10-10T21:18:44.143405+0000","last_fullsized":"2023-10-10T21:18:44.143405+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:10.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.140006+0000","last_change":"2023-10-10T21:18:44.134509+0000","last_active":"2023-10-10T21:18:44.140006+0000","last_peered":"2023-10-10T21:18:44.140006+0000","last_clean":"2023-10-10T21:18:44.140006+0000","last_became_active":"2023-10-10T21:18:44.134236+0000","last_became_peered":"2023-10-10T21:18:44.134236+0000","last_unstale":"2023-10-10T21:18:44.140006+0000","last_undegraded":"2023-10-10T21:18:44.140006+0000","last_fullsized":"2023-10-10T21:18:44.140006+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:04:35.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.157260+0000","last_change":"2023-10-10T21:18:44.152951+0000","last_active":"2023-10-10T21:18:44.157260+0000","last_peered":"2023-10-10T21:18:44.157260+0000","last_clean":"2023-10-10T21:18:44.157260+0000","last_became_active":"2023-10-10T21:18:44.152657+0000","last_became_peered":"2023-10-10T21:18:44.152657+0000","last_unstale":"2023-10-10T21:18:44.157260+0000","last_undegraded":"2023-10-10T21:18:44.157260+0000","last_fullsized":"2023-10-10T21:18:44.157260+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:34.990082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143863+0000","last_change":"2023-10-10T21:18:44.141072+0000","last_active":"2023-10-10T21:18:44.143863+0000","last_peered":"2023-10-10T21:18:44.143863+0000","last_clean":"2023-10-10T21:18:44.143863+0000","last_became_active":"2023-10-10T21:18:44.140771+0000","last_became_peered":"2023-10-10T21:18:44.140771+0000","last_unstale":"2023-10-10T21:18:44.143863+0000","last_undegraded":"2023-10-10T21:18:44.143863+0000","last_fullsized":"2023-10-10T21:18:44.143863+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:24:23.454059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143682+0000","last_change":"2023-10-10T21:18:44.134354+0000","last_active":"2023-10-10T21:18:44.143682+0000","last_peered":"2023-10-10T21:18:44.143682+0000","last_clean":"2023-10-10T21:18:44.143682+0000","last_became_active":"2023-10-10T21:18:44.134057+0000","last_became_peered":"2023-10-10T21:18:44.134057+0000","last_unstale":"2023-10-10T21:18:44.143682+0000","last_undegraded":"2023-10-10T21:18:44.143682+0000","last_fullsized":"2023-10-10T21:18:44.143682+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:03.362101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.144088+0000","last_change":"2023-10-10T21:18:44.134241+0000","last_active":"2023-10-10T21:18:44.144088+0000","last_peered":"2023-10-10T21:18:44.144088+0000","last_clean":"2023-10-10T21:18:44.144088+0000","last_became_active":"2023-10-10T21:18:44.132075+0000","last_became_peered":"2023-10-10T21:18:44.132075+0000","last_unstale":"2023-10-10T21:18:44.144088+0000","last_undegraded":"2023-10-10T21:18:44.144088+0000","last_fullsized":"2023-10-10T21:18:44.144088+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:38:01.405596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147585+0000","last_change":"2023-10-10T21:18:44.142780+0000","last_active":"2023-10-10T21:18:44.147585+0000","last_peered":"2023-10-10T21:18:44.147585+0000","last_clean":"2023-10-10T21:18:44.147585+0000","last_became_active":"2023-10-10T21:18:44.142513+0000","last_became_peered":"2023-10-10T21:18:44.142513+0000","last_unstale":"2023-10-10T21:18:44.147585+0000","last_undegraded":"2023-10-10T21:18:44.147585+0000","last_fullsized":"2023-10-10T21:18:44.147585+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:10:41.722417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147728+0000","last_change":"2023-10-10T21:18:44.140824+0000","last_active":"2023-10-10T21:18:44.147728+0000","last_peered":"2023-10-10T21:18:44.147728+0000","last_clean":"2023-10-10T21:18:44.147728+0000","last_became_active":"2023-10-10T21:18:44.140586+0000","last_became_peered":"2023-10-10T21:18:44.140586+0000","last_unstale":"2023-10-10T21:18:44.147728+0000","last_undegraded":"2023-10-10T21:18:44.147728+0000","last_fullsized":"2023-10-10T21:18:44.147728+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:32.643038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152770+0000","last_change":"2023-10-10T21:18:44.149558+0000","last_active":"2023-10-10T21:18:44.152770+0000","last_peered":"2023-10-10T21:18:44.152770+0000","last_clean":"2023-10-10T21:18:44.152770+0000","last_became_active":"2023-10-10T21:18:44.149223+0000","last_became_peered":"2023-10-10T21:18:44.149223+0000","last_unstale":"2023-10-10T21:18:44.152770+0000","last_undegraded":"2023-10-10T21:18:44.152770+0000","last_fullsized":"2023-10-10T21:18:44.152770+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:27:51.213821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151488+0000","last_change":"2023-10-10T21:18:44.148960+0000","last_active":"2023-10-10T21:18:44.151488+0000","last_peered":"2023-10-10T21:18:44.151488+0000","last_clean":"2023-10-10T21:18:44.151488+0000","last_became_active":"2023-10-10T21:18:44.148651+0000","last_became_peered":"2023-10-10T21:18:44.148651+0000","last_unstale":"2023-10-10T21:18:44.151488+0000","last_undegraded":"2023-10-10T21:18:44.151488+0000","last_fullsized":"2023-10-10T21:18:44.151488+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:19:48.206567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155460+0000","last_change":"2023-10-10T21:18:44.150911+0000","last_active":"2023-10-10T21:18:44.155460+0000","last_peered":"2023-10-10T21:18:44.155460+0000","last_clean":"2023-10-10T21:18:44.155460+0000","last_became_active":"2023-10-10T21:18:44.150640+0000","last_became_peered":"2023-10-10T21:18:44.150640+0000","last_unstale":"2023-10-10T21:18:44.155460+0000","last_undegraded":"2023-10-10T21:18:44.155460+0000","last_fullsized":"2023-10-10T21:18:44.155460+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:33.388265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.148711+0000","last_change":"2023-10-10T21:18:44.147257+0000","last_active":"2023-10-10T21:18:44.148711+0000","last_peered":"2023-10-10T21:18:44.148711+0000","last_clean":"2023-10-10T21:18:44.148711+0000","last_became_active":"2023-10-10T21:18:44.146356+0000","last_became_peered":"2023-10-10T21:18:44.146356+0000","last_unstale":"2023-10-10T21:18:44.148711+0000","last_undegraded":"2023-10-10T21:18:44.148711+0000","last_fullsized":"2023-10-10T21:18:44.148711+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:32.643038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151716+0000","last_change":"2023-10-10T21:18:44.149026+0000","last_active":"2023-10-10T21:18:44.151716+0000","last_peered":"2023-10-10T21:18:44.151716+0000","last_clean":"2023-10-10T21:18:44.151716+0000","last_became_active":"2023-10-10T21:18:44.148678+0000","last_became_peered":"2023-10-10T21:18:44.148678+0000","last_unstale":"2023-10-10T21:18:44.151716+0000","last_undegraded":"2023-10-10T21:18:44.151716+0000","last_fullsized":"2023-10-10T21:18:44.151716+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:27:39.663979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155546+0000","last_change":"2023-10-10T21:18:44.151769+0000","last_active":"2023-10-10T21:18:44.155546+0000","last_peered":"2023-10-10T21:18:44.155546+0000","last_clean":"2023-10-10T21:18:44.155546+0000","last_became_active":"2023-10-10T21:18:44.151498+0000","last_became_peered":"2023-10-10T21:18:44.151498+0000","last_unstale":"2023-10-10T21:18:44.155546+0000","last_undegraded":"2023-10-10T21:18:44.155546+0000","last_fullsized":"2023-10-10T21:18:44.155546+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:40:20.585984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139823+0000","last_change":"2023-10-10T21:18:44.137259+0000","last_active":"2023-10-10T21:18:44.139823+0000","last_peered":"2023-10-10T21:18:44.139823+0000","last_clean":"2023-10-10T21:18:44.139823+0000","last_became_active":"2023-10-10T21:18:44.137007+0000","last_became_peered":"2023-10-10T21:18:44.137007+0000","last_unstale":"2023-10-10T21:18:44.139823+0000","last_undegraded":"2023-10-10T21:18:44.139823+0000","last_fullsized":"2023-10-10T21:18:44.139823+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:25:06.926121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143935+0000","last_change":"2023-10-10T21:18:44.136505+0000","last_active":"2023-10-10T21:18:44.143935+0000","last_peered":"2023-10-10T21:18:44.143935+0000","last_clean":"2023-10-10T21:18:44.143935+0000","last_became_active":"2023-10-10T21:18:44.136212+0000","last_became_peered":"2023-10-10T21:18:44.136212+0000","last_unstale":"2023-10-10T21:18:44.143935+0000","last_undegraded":"2023-10-10T21:18:44.143935+0000","last_fullsized":"2023-10-10T21:18:44.143935+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:43:11.303976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147897+0000","last_change":"2023-10-10T21:18:44.144851+0000","last_active":"2023-10-10T21:18:44.147897+0000","last_peered":"2023-10-10T21:18:44.147897+0000","last_clean":"2023-10-10T21:18:44.147897+0000","last_became_active":"2023-10-10T21:18:44.144591+0000","last_became_peered":"2023-10-10T21:18:44.144591+0000","last_unstale":"2023-10-10T21:18:44.147897+0000","last_undegraded":"2023-10-10T21:18:44.147897+0000","last_fullsized":"2023-10-10T21:18:44.147897+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:48:39.640408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139592+0000","last_change":"2023-10-10T21:18:44.137448+0000","last_active":"2023-10-10T21:18:44.139592+0000","last_peered":"2023-10-10T21:18:44.139592+0000","last_clean":"2023-10-10T21:18:44.139592+0000","last_became_active":"2023-10-10T21:18:44.137167+0000","last_became_peered":"2023-10-10T21:18:44.137167+0000","last_unstale":"2023-10-10T21:18:44.139592+0000","last_undegraded":"2023-10-10T21:18:44.139592+0000","last_fullsized":"2023-10-10T21:18:44.139592+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:59:20.447705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152340+0000","last_change":"2023-10-10T21:18:44.142947+0000","last_active":"2023-10-10T21:18:44.152340+0000","last_peered":"2023-10-10T21:18:44.152340+0000","last_clean":"2023-10-10T21:18:44.152340+0000","last_became_active":"2023-10-10T21:18:44.142670+0000","last_became_peered":"2023-10-10T21:18:44.142670+0000","last_unstale":"2023-10-10T21:18:44.152340+0000","last_undegraded":"2023-10-10T21:18:44.152340+0000","last_fullsized":"2023-10-10T21:18:44.152340+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:14:31.962528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146606+0000","last_change":"2023-10-10T21:18:44.143640+0000","last_active":"2023-10-10T21:18:44.146606+0000","last_peered":"2023-10-10T21:18:44.146606+0000","last_clean":"2023-10-10T21:18:44.146606+0000","last_became_active":"2023-10-10T21:18:44.143064+0000","last_became_peered":"2023-10-10T21:18:44.143064+0000","last_unstale":"2023-10-10T21:18:44.146606+0000","last_undegraded":"2023-10-10T21:18:44.146606+0000","last_fullsized":"2023-10-10T21:18:44.146606+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:10.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155424+0000","last_change":"2023-10-10T21:18:44.154055+0000","last_active":"2023-10-10T21:18:44.155424+0000","last_peered":"2023-10-10T21:18:44.155424+0000","last_clean":"2023-10-10T21:18:44.155424+0000","last_became_active":"2023-10-10T21:18:44.152996+0000","last_became_peered":"2023-10-10T21:18:44.152996+0000","last_unstale":"2023-10-10T21:18:44.155424+0000","last_undegraded":"2023-10-10T21:18:44.155424+0000","last_fullsized":"2023-10-10T21:18:44.155424+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:01.450647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145238+0000","last_change":"2023-10-10T21:18:44.141739+0000","last_active":"2023-10-10T21:18:44.145238+0000","last_peered":"2023-10-10T21:18:44.145238+0000","last_clean":"2023-10-10T21:18:44.145238+0000","last_became_active":"2023-10-10T21:18:44.141475+0000","last_became_peered":"2023-10-10T21:18:44.141475+0000","last_unstale":"2023-10-10T21:18:44.145238+0000","last_undegraded":"2023-10-10T21:18:44.145238+0000","last_fullsized":"2023-10-10T21:18:44.145238+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:01.450647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.158134+0000","last_change":"2023-10-10T21:18:43.130556+0000","last_active":"2023-10-10T21:18:44.158134+0000","last_peered":"2023-10-10T21:18:44.158134+0000","last_clean":"2023-10-10T21:18:44.158134+0000","last_became_active":"2023-10-10T21:18:43.130267+0000","last_became_peered":"2023-10-10T21:18:43.130267+0000","last_unstale":"2023-10-10T21:18:44.158134+0000","last_undegraded":"2023-10-10T21:18:44.158134+0000","last_fullsized":"2023-10-10T21:18:44.158134+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:01.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.148640+0000","last_change":"2023-10-10T21:18:44.146558+0000","last_active":"2023-10-10T21:18:44.148640+0000","last_peered":"2023-10-10T21:18:44.148640+0000","last_clean":"2023-10-10T21:18:44.148640+0000","last_became_active":"2023-10-10T21:18:44.146124+0000","last_became_peered":"2023-10-10T21:18:44.146124+0000","last_unstale":"2023-10-10T21:18:44.148640+0000","last_undegraded":"2023-10-10T21:18:44.148640+0000","last_fullsized":"2023-10-10T21:18:44.148640+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:32.107198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.154097+0000","last_change":"2023-10-10T21:18:43.132390+0000","last_active":"2023-10-10T21:18:44.154097+0000","last_peered":"2023-10-10T21:18:44.154097+0000","last_clean":"2023-10-10T21:18:44.154097+0000","last_became_active":"2023-10-10T21:18:43.132049+0000","last_became_peered":"2023-10-10T21:18:43.132049+0000","last_unstale":"2023-10-10T21:18:44.154097+0000","last_undegraded":"2023-10-10T21:18:44.154097+0000","last_fullsized":"2023-10-10T21:18:44.154097+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:19.947370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155484+0000","last_change":"2023-10-10T21:18:44.154399+0000","last_active":"2023-10-10T21:18:44.155484+0000","last_peered":"2023-10-10T21:18:44.155484+0000","last_clean":"2023-10-10T21:18:44.155484+0000","last_became_active":"2023-10-10T21:18:44.154104+0000","last_became_peered":"2023-10-10T21:18:44.154104+0000","last_unstale":"2023-10-10T21:18:44.155484+0000","last_undegraded":"2023-10-10T21:18:44.155484+0000","last_fullsized":"2023-10-10T21:18:44.155484+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:04:35.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.163071+0000","last_change":"2023-10-10T21:18:43.129850+0000","last_active":"2023-10-10T21:18:44.163071+0000","last_peered":"2023-10-10T21:18:44.163071+0000","last_clean":"2023-10-10T21:18:44.163071+0000","last_became_active":"2023-10-10T21:18:43.129601+0000","last_became_peered":"2023-10-10T21:18:43.129601+0000","last_unstale":"2023-10-10T21:18:44.163071+0000","last_undegraded":"2023-10-10T21:18:44.163071+0000","last_fullsized":"2023-10-10T21:18:44.163071+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:12:12.433840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.144862+0000","last_change":"2023-10-10T21:18:44.141720+0000","last_active":"2023-10-10T21:18:44.144862+0000","last_peered":"2023-10-10T21:18:44.144862+0000","last_clean":"2023-10-10T21:18:44.144862+0000","last_became_active":"2023-10-10T21:18:44.141244+0000","last_became_peered":"2023-10-10T21:18:44.141244+0000","last_unstale":"2023-10-10T21:18:44.144862+0000","last_undegraded":"2023-10-10T21:18:44.144862+0000","last_fullsized":"2023-10-10T21:18:44.144862+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:12:10.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.163135+0000","last_change":"2023-10-10T21:18:43.123833+0000","last_active":"2023-10-10T21:18:44.163135+0000","last_peered":"2023-10-10T21:18:44.163135+0000","last_clean":"2023-10-10T21:18:44.163135+0000","last_became_active":"2023-10-10T21:18:43.123586+0000","last_became_peered":"2023-10-10T21:18:43.123586+0000","last_unstale":"2023-10-10T21:18:44.163135+0000","last_undegraded":"2023-10-10T21:18:44.163135+0000","last_fullsized":"2023-10-10T21:18:44.163135+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:16:07.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143074+0000","last_change":"2023-10-10T21:18:44.136641+0000","last_active":"2023-10-10T21:18:44.143074+0000","last_peered":"2023-10-10T21:18:44.143074+0000","last_clean":"2023-10-10T21:18:44.143074+0000","last_became_active":"2023-10-10T21:18:44.136399+0000","last_became_peered":"2023-10-10T21:18:44.136399+0000","last_unstale":"2023-10-10T21:18:44.143074+0000","last_undegraded":"2023-10-10T21:18:44.143074+0000","last_fullsized":"2023-10-10T21:18:44.143074+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:04:57.198476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.156488+0000","last_change":"2023-10-10T21:18:43.126395+0000","last_active":"2023-10-10T21:18:44.156488+0000","last_peered":"2023-10-10T21:18:44.156488+0000","last_clean":"2023-10-10T21:18:44.156488+0000","last_became_active":"2023-10-10T21:18:43.126099+0000","last_became_peered":"2023-10-10T21:18:43.126099+0000","last_unstale":"2023-10-10T21:18:44.156488+0000","last_undegraded":"2023-10-10T21:18:44.156488+0000","last_fullsized":"2023-10-10T21:18:44.156488+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:55:49.835696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145143+0000","last_change":"2023-10-10T21:18:44.138131+0000","last_active":"2023-10-10T21:18:44.145143+0000","last_peered":"2023-10-10T21:18:44.145143+0000","last_clean":"2023-10-10T21:18:44.145143+0000","last_became_active":"2023-10-10T21:18:44.137830+0000","last_became_peered":"2023-10-10T21:18:44.137830+0000","last_unstale":"2023-10-10T21:18:44.145143+0000","last_undegraded":"2023-10-10T21:18:44.145143+0000","last_fullsized":"2023-10-10T21:18:44.145143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:32.107198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.155139+0000","last_change":"2023-10-10T21:18:43.133201+0000","last_active":"2023-10-10T21:18:44.155139+0000","last_peered":"2023-10-10T21:18:44.155139+0000","last_clean":"2023-10-10T21:18:44.155139+0000","last_became_active":"2023-10-10T21:18:43.132509+0000","last_became_peered":"2023-10-10T21:18:43.132509+0000","last_unstale":"2023-10-10T21:18:44.155139+0000","last_undegraded":"2023-10-10T21:18:44.155139+0000","last_fullsized":"2023-10-10T21:18:44.155139+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:36:27.443230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151246+0000","last_change":"2023-10-10T21:18:44.149507+0000","last_active":"2023-10-10T21:18:44.151246+0000","last_peered":"2023-10-10T21:18:44.151246+0000","last_clean":"2023-10-10T21:18:44.151246+0000","last_became_active":"2023-10-10T21:18:44.149177+0000","last_became_peered":"2023-10-10T21:18:44.149177+0000","last_unstale":"2023-10-10T21:18:44.151246+0000","last_undegraded":"2023-10-10T21:18:44.151246+0000","last_fullsized":"2023-10-10T21:18:44.151246+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:30.899645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.124214+0000","last_change":"2023-10-10T21:18:43.131142+0000","last_active":"2023-10-10T21:18:44.124214+0000","last_peered":"2023-10-10T21:18:44.124214+0000","last_clean":"2023-10-10T21:18:44.124214+0000","last_became_active":"2023-10-10T21:18:43.130866+0000","last_became_peered":"2023-10-10T21:18:43.130866+0000","last_unstale":"2023-10-10T21:18:44.124214+0000","last_undegraded":"2023-10-10T21:18:44.124214+0000","last_fullsized":"2023-10-10T21:18:44.124214+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:29:42.872498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143845+0000","last_change":"2023-10-10T21:18:44.140340+0000","last_active":"2023-10-10T21:18:44.143845+0000","last_peered":"2023-10-10T21:18:44.143845+0000","last_clean":"2023-10-10T21:18:44.143845+0000","last_became_active":"2023-10-10T21:18:44.140089+0000","last_became_peered":"2023-10-10T21:18:44.140089+0000","last_unstale":"2023-10-10T21:18:44.143845+0000","last_undegraded":"2023-10-10T21:18:44.143845+0000","last_fullsized":"2023-10-10T21:18:44.143845+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:31:24.447408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.127912+0000","last_change":"2023-10-10T21:18:43.122854+0000","last_active":"2023-10-10T21:18:44.127912+0000","last_peered":"2023-10-10T21:18:44.127912+0000","last_clean":"2023-10-10T21:18:44.127912+0000","last_became_active":"2023-10-10T21:18:43.122586+0000","last_became_peered":"2023-10-10T21:18:43.122586+0000","last_unstale":"2023-10-10T21:18:44.127912+0000","last_undegraded":"2023-10-10T21:18:44.127912+0000","last_fullsized":"2023-10-10T21:18:44.127912+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:53:44.764034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152677+0000","last_change":"2023-10-10T21:18:44.150298+0000","last_active":"2023-10-10T21:18:44.152677+0000","last_peered":"2023-10-10T21:18:44.152677+0000","last_clean":"2023-10-10T21:18:44.152677+0000","last_became_active":"2023-10-10T21:18:44.150034+0000","last_became_peered":"2023-10-10T21:18:44.150034+0000","last_unstale":"2023-10-10T21:18:44.152677+0000","last_undegraded":"2023-10-10T21:18:44.152677+0000","last_fullsized":"2023-10-10T21:18:44.152677+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:11:34.664480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.138465+0000","last_change":"2023-10-10T21:18:43.132195+0000","last_active":"2023-10-10T21:18:44.138465+0000","last_peered":"2023-10-10T21:18:44.138465+0000","last_clean":"2023-10-10T21:18:44.138465+0000","last_became_active":"2023-10-10T21:18:43.131936+0000","last_became_peered":"2023-10-10T21:18:43.131936+0000","last_unstale":"2023-10-10T21:18:44.138465+0000","last_undegraded":"2023-10-10T21:18:44.138465+0000","last_fullsized":"2023-10-10T21:18:44.138465+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143573+0000","last_change":"2023-10-10T21:18:44.141973+0000","last_active":"2023-10-10T21:18:44.143573+0000","last_peered":"2023-10-10T21:18:44.143573+0000","last_clean":"2023-10-10T21:18:44.143573+0000","last_became_active":"2023-10-10T21:18:44.141657+0000","last_became_peered":"2023-10-10T21:18:44.141657+0000","last_unstale":"2023-10-10T21:18:44.143573+0000","last_undegraded":"2023-10-10T21:18:44.143573+0000","last_fullsized":"2023-10-10T21:18:44.143573+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:16:08.398473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.138201+0000","last_change":"2023-10-10T21:18:43.127785+0000","last_active":"2023-10-10T21:18:44.138201+0000","last_peered":"2023-10-10T21:18:44.138201+0000","last_clean":"2023-10-10T21:18:44.138201+0000","last_became_active":"2023-10-10T21:18:43.127345+0000","last_became_peered":"2023-10-10T21:18:43.127345+0000","last_unstale":"2023-10-10T21:18:44.138201+0000","last_undegraded":"2023-10-10T21:18:44.138201+0000","last_fullsized":"2023-10-10T21:18:44.138201+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:35:02.697980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147699+0000","last_change":"2023-10-10T21:18:44.141875+0000","last_active":"2023-10-10T21:18:44.147699+0000","last_peered":"2023-10-10T21:18:44.147699+0000","last_clean":"2023-10-10T21:18:44.147699+0000","last_became_active":"2023-10-10T21:18:44.141590+0000","last_became_peered":"2023-10-10T21:18:44.141590+0000","last_unstale":"2023-10-10T21:18:44.147699+0000","last_undegraded":"2023-10-10T21:18:44.147699+0000","last_fullsized":"2023-10-10T21:18:44.147699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:01.450647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.163074+0000","last_change":"2023-10-10T21:18:43.130621+0000","last_active":"2023-10-10T21:18:44.163074+0000","last_peered":"2023-10-10T21:18:44.163074+0000","last_clean":"2023-10-10T21:18:44.163074+0000","last_became_active":"2023-10-10T21:18:43.130311+0000","last_became_peered":"2023-10-10T21:18:43.130311+0000","last_unstale":"2023-10-10T21:18:44.163074+0000","last_undegraded":"2023-10-10T21:18:44.163074+0000","last_fullsized":"2023-10-10T21:18:44.163074+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:56:48.269119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145279+0000","last_change":"2023-10-10T21:18:44.143646+0000","last_active":"2023-10-10T21:18:44.145279+0000","last_peered":"2023-10-10T21:18:44.145279+0000","last_clean":"2023-10-10T21:18:44.145279+0000","last_became_active":"2023-10-10T21:18:44.143143+0000","last_became_peered":"2023-10-10T21:18:44.143143+0000","last_unstale":"2023-10-10T21:18:44.145279+0000","last_undegraded":"2023-10-10T21:18:44.145279+0000","last_fullsized":"2023-10-10T21:18:44.145279+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:41:05.642091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"108'6","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.162625+0000","last_change":"2023-10-10T21:18:43.132304+0000","last_active":"2023-10-10T21:18:44.162625+0000","last_peered":"2023-10-10T21:18:44.162625+0000","last_clean":"2023-10-10T21:18:44.162625+0000","last_became_active":"2023-10-10T21:18:43.132032+0000","last_became_peered":"2023-10-10T21:18:43.132032+0000","last_unstale":"2023-10-10T21:18:44.162625+0000","last_undegraded":"2023-10-10T21:18:44.162625+0000","last_fullsized":"2023-10-10T21:18:44.162625+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:45.662898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.154073+0000","last_change":"2023-10-10T21:18:44.144511+0000","last_active":"2023-10-10T21:18:44.154073+0000","last_peered":"2023-10-10T21:18:44.154073+0000","last_clean":"2023-10-10T21:18:44.154073+0000","last_became_active":"2023-10-10T21:18:44.144262+0000","last_became_peered":"2023-10-10T21:18:44.144262+0000","last_unstale":"2023-10-10T21:18:44.154073+0000","last_undegraded":"2023-10-10T21:18:44.154073+0000","last_fullsized":"2023-10-10T21:18:44.154073+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:40:32.107198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.160576+0000","last_change":"2023-10-10T21:18:43.129649+0000","last_active":"2023-10-10T21:18:44.160576+0000","last_peered":"2023-10-10T21:18:44.160576+0000","last_clean":"2023-10-10T21:18:44.160576+0000","last_became_active":"2023-10-10T21:18:43.129328+0000","last_became_peered":"2023-10-10T21:18:43.129328+0000","last_unstale":"2023-10-10T21:18:44.160576+0000","last_undegraded":"2023-10-10T21:18:44.160576+0000","last_fullsized":"2023-10-10T21:18:44.160576+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:38:35.627483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151218+0000","last_change":"2023-10-10T21:18:44.149505+0000","last_active":"2023-10-10T21:18:44.151218+0000","last_peered":"2023-10-10T21:18:44.151218+0000","last_clean":"2023-10-10T21:18:44.151218+0000","last_became_active":"2023-10-10T21:18:44.149189+0000","last_became_peered":"2023-10-10T21:18:44.149189+0000","last_unstale":"2023-10-10T21:18:44.151218+0000","last_undegraded":"2023-10-10T21:18:44.151218+0000","last_fullsized":"2023-10-10T21:18:44.151218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:05:05.133734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.129638+0000","last_change":"2023-10-10T21:18:43.131186+0000","last_active":"2023-10-10T21:18:44.129638+0000","last_peered":"2023-10-10T21:18:44.129638+0000","last_clean":"2023-10-10T21:18:44.129638+0000","last_became_active":"2023-10-10T21:18:43.130936+0000","last_became_peered":"2023-10-10T21:18:43.130936+0000","last_unstale":"2023-10-10T21:18:44.129638+0000","last_undegraded":"2023-10-10T21:18:44.129638+0000","last_fullsized":"2023-10-10T21:18:44.129638+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:08:10.463497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.140651+0000","last_change":"2023-10-10T21:18:44.135977+0000","last_active":"2023-10-10T21:18:44.140651+0000","last_peered":"2023-10-10T21:18:44.140651+0000","last_clean":"2023-10-10T21:18:44.140651+0000","last_became_active":"2023-10-10T21:18:44.135714+0000","last_became_peered":"2023-10-10T21:18:44.135714+0000","last_unstale":"2023-10-10T21:18:44.140651+0000","last_undegraded":"2023-10-10T21:18:44.140651+0000","last_fullsized":"2023-10-10T21:18:44.140651+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:26:50.175674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.125906+0000","last_change":"2023-10-10T21:18:43.121951+0000","last_active":"2023-10-10T21:18:44.125906+0000","last_peered":"2023-10-10T21:18:44.125906+0000","last_clean":"2023-10-10T21:18:44.125906+0000","last_became_active":"2023-10-10T21:18:43.121641+0000","last_became_peered":"2023-10-10T21:18:43.121641+0000","last_unstale":"2023-10-10T21:18:44.125906+0000","last_undegraded":"2023-10-10T21:18:44.125906+0000","last_fullsized":"2023-10-10T21:18:44.125906+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:10:05.363157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.152078+0000","last_change":"2023-10-10T21:18:44.141709+0000","last_active":"2023-10-10T21:18:44.152078+0000","last_peered":"2023-10-10T21:18:44.152078+0000","last_clean":"2023-10-10T21:18:44.152078+0000","last_became_active":"2023-10-10T21:18:44.140902+0000","last_became_peered":"2023-10-10T21:18:44.140902+0000","last_unstale":"2023-10-10T21:18:44.152078+0000","last_undegraded":"2023-10-10T21:18:44.152078+0000","last_fullsized":"2023-10-10T21:18:44.152078+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:35.571516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"108'8","reported_seq":18,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.163436+0000","last_change":"2023-10-10T21:18:43.125619+0000","last_active":"2023-10-10T21:18:44.163436+0000","last_peered":"2023-10-10T21:18:44.163436+0000","last_clean":"2023-10-10T21:18:44.163436+0000","last_became_active":"2023-10-10T21:18:43.125361+0000","last_became_peered":"2023-10-10T21:18:43.125361+0000","last_unstale":"2023-10-10T21:18:44.163436+0000","last_undegraded":"2023-10-10T21:18:44.163436+0000","last_fullsized":"2023-10-10T21:18:44.163436+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:24:14.463530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139802+0000","last_change":"2023-10-10T21:18:44.133827+0000","last_active":"2023-10-10T21:18:44.139802+0000","last_peered":"2023-10-10T21:18:44.139802+0000","last_clean":"2023-10-10T21:18:44.139802+0000","last_became_active":"2023-10-10T21:18:44.133563+0000","last_became_peered":"2023-10-10T21:18:44.133563+0000","last_unstale":"2023-10-10T21:18:44.139802+0000","last_undegraded":"2023-10-10T21:18:44.139802+0000","last_fullsized":"2023-10-10T21:18:44.139802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:41:05.642091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.154713+0000","last_change":"2023-10-10T21:18:43.130993+0000","last_active":"2023-10-10T21:18:44.154713+0000","last_peered":"2023-10-10T21:18:44.154713+0000","last_clean":"2023-10-10T21:18:44.154713+0000","last_became_active":"2023-10-10T21:18:43.130746+0000","last_became_peered":"2023-10-10T21:18:43.130746+0000","last_unstale":"2023-10-10T21:18:44.154713+0000","last_undegraded":"2023-10-10T21:18:44.154713+0000","last_fullsized":"2023-10-10T21:18:44.154713+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:19:12.203234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146047+0000","last_change":"2023-10-10T21:18:44.142504+0000","last_active":"2023-10-10T21:18:44.146047+0000","last_peered":"2023-10-10T21:18:44.146047+0000","last_clean":"2023-10-10T21:18:44.146047+0000","last_became_active":"2023-10-10T21:18:44.142235+0000","last_became_peered":"2023-10-10T21:18:44.142235+0000","last_unstale":"2023-10-10T21:18:44.146047+0000","last_undegraded":"2023-10-10T21:18:44.146047+0000","last_fullsized":"2023-10-10T21:18:44.146047+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:38:01.405596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.162729+0000","last_change":"2023-10-10T21:18:43.126357+0000","last_active":"2023-10-10T21:18:44.162729+0000","last_peered":"2023-10-10T21:18:44.162729+0000","last_clean":"2023-10-10T21:18:44.162729+0000","last_became_active":"2023-10-10T21:18:43.126155+0000","last_became_peered":"2023-10-10T21:18:43.126155+0000","last_unstale":"2023-10-10T21:18:44.162729+0000","last_undegraded":"2023-10-10T21:18:44.162729+0000","last_fullsized":"2023-10-10T21:18:44.162729+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:31:29.961670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145080+0000","last_change":"2023-10-10T21:18:44.137901+0000","last_active":"2023-10-10T21:18:44.145080+0000","last_peered":"2023-10-10T21:18:44.145080+0000","last_clean":"2023-10-10T21:18:44.145080+0000","last_became_active":"2023-10-10T21:18:44.137552+0000","last_became_peered":"2023-10-10T21:18:44.137552+0000","last_unstale":"2023-10-10T21:18:44.145080+0000","last_undegraded":"2023-10-10T21:18:44.145080+0000","last_fullsized":"2023-10-10T21:18:44.145080+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:05:05.133734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.124471+0000","last_change":"2023-10-10T21:18:43.130918+0000","last_active":"2023-10-10T21:18:44.124471+0000","last_peered":"2023-10-10T21:18:44.124471+0000","last_clean":"2023-10-10T21:18:44.124471+0000","last_became_active":"2023-10-10T21:18:43.130678+0000","last_became_peered":"2023-10-10T21:18:43.130678+0000","last_unstale":"2023-10-10T21:18:44.124471+0000","last_undegraded":"2023-10-10T21:18:44.124471+0000","last_fullsized":"2023-10-10T21:18:44.124471+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:21:20.776241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.157241+0000","last_change":"2023-10-10T21:18:44.152900+0000","last_active":"2023-10-10T21:18:44.157241+0000","last_peered":"2023-10-10T21:18:44.157241+0000","last_clean":"2023-10-10T21:18:44.157241+0000","last_became_active":"2023-10-10T21:18:44.152265+0000","last_became_peered":"2023-10-10T21:18:44.152265+0000","last_unstale":"2023-10-10T21:18:44.157241+0000","last_undegraded":"2023-10-10T21:18:44.157241+0000","last_fullsized":"2023-10-10T21:18:44.157241+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:59:07.088476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.157415+0000","last_change":"2023-10-10T21:18:43.121194+0000","last_active":"2023-10-10T21:18:44.157415+0000","last_peered":"2023-10-10T21:18:44.157415+0000","last_clean":"2023-10-10T21:18:44.157415+0000","last_became_active":"2023-10-10T21:18:43.120883+0000","last_became_peered":"2023-10-10T21:18:43.120883+0000","last_unstale":"2023-10-10T21:18:44.157415+0000","last_undegraded":"2023-10-10T21:18:44.157415+0000","last_fullsized":"2023-10-10T21:18:44.157415+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:02.698245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.139935+0000","last_change":"2023-10-10T21:18:44.136517+0000","last_active":"2023-10-10T21:18:44.139935+0000","last_peered":"2023-10-10T21:18:44.139935+0000","last_clean":"2023-10-10T21:18:44.139935+0000","last_became_active":"2023-10-10T21:18:44.136159+0000","last_became_peered":"2023-10-10T21:18:44.136159+0000","last_unstale":"2023-10-10T21:18:44.139935+0000","last_undegraded":"2023-10-10T21:18:44.139935+0000","last_fullsized":"2023-10-10T21:18:44.139935+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:02.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.131139+0000","last_change":"2023-10-10T21:18:43.124166+0000","last_active":"2023-10-10T21:18:44.131139+0000","last_peered":"2023-10-10T21:18:44.131139+0000","last_clean":"2023-10-10T21:18:44.131139+0000","last_became_active":"2023-10-10T21:18:43.123879+0000","last_became_peered":"2023-10-10T21:18:43.123879+0000","last_unstale":"2023-10-10T21:18:44.131139+0000","last_undegraded":"2023-10-10T21:18:44.131139+0000","last_fullsized":"2023-10-10T21:18:44.131139+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:38:11.312886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.146123+0000","last_change":"2023-10-10T21:18:44.139955+0000","last_active":"2023-10-10T21:18:44.146123+0000","last_peered":"2023-10-10T21:18:44.146123+0000","last_clean":"2023-10-10T21:18:44.146123+0000","last_became_active":"2023-10-10T21:18:44.139700+0000","last_became_peered":"2023-10-10T21:18:44.139700+0000","last_unstale":"2023-10-10T21:18:44.146123+0000","last_undegraded":"2023-10-10T21:18:44.146123+0000","last_fullsized":"2023-10-10T21:18:44.146123+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:56:03.532703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.128501+0000","last_change":"2023-10-10T21:18:43.126416+0000","last_active":"2023-10-10T21:18:44.128501+0000","last_peered":"2023-10-10T21:18:44.128501+0000","last_clean":"2023-10-10T21:18:44.128501+0000","last_became_active":"2023-10-10T21:18:43.126177+0000","last_became_peered":"2023-10-10T21:18:43.126177+0000","last_unstale":"2023-10-10T21:18:44.128501+0000","last_undegraded":"2023-10-10T21:18:44.128501+0000","last_fullsized":"2023-10-10T21:18:44.128501+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:06.702924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.142469+0000","last_change":"2023-10-10T21:18:44.139728+0000","last_active":"2023-10-10T21:18:44.142469+0000","last_peered":"2023-10-10T21:18:44.142469+0000","last_clean":"2023-10-10T21:18:44.142469+0000","last_became_active":"2023-10-10T21:18:44.139399+0000","last_became_peered":"2023-10-10T21:18:44.139399+0000","last_unstale":"2023-10-10T21:18:44.142469+0000","last_undegraded":"2023-10-10T21:18:44.142469+0000","last_fullsized":"2023-10-10T21:18:44.142469+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:17:45.061288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.127347+0000","last_change":"2023-10-10T21:18:43.117676+0000","last_active":"2023-10-10T21:18:44.127347+0000","last_peered":"2023-10-10T21:18:44.127347+0000","last_clean":"2023-10-10T21:18:44.127347+0000","last_became_active":"2023-10-10T21:18:43.117357+0000","last_became_peered":"2023-10-10T21:18:43.117357+0000","last_unstale":"2023-10-10T21:18:44.127347+0000","last_undegraded":"2023-10-10T21:18:44.127347+0000","last_fullsized":"2023-10-10T21:18:44.127347+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:33:06.578580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.143905+0000","last_change":"2023-10-10T21:18:44.135537+0000","last_active":"2023-10-10T21:18:44.143905+0000","last_peered":"2023-10-10T21:18:44.143905+0000","last_clean":"2023-10-10T21:18:44.143905+0000","last_became_active":"2023-10-10T21:18:44.135245+0000","last_became_peered":"2023-10-10T21:18:44.135245+0000","last_unstale":"2023-10-10T21:18:44.143905+0000","last_undegraded":"2023-10-10T21:18:44.143905+0000","last_fullsized":"2023-10-10T21:18:44.143905+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:33:32.643038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.157785+0000","last_change":"2023-10-10T21:18:43.125770+0000","last_active":"2023-10-10T21:18:44.157785+0000","last_peered":"2023-10-10T21:18:44.157785+0000","last_clean":"2023-10-10T21:18:44.157785+0000","last_became_active":"2023-10-10T21:18:43.125519+0000","last_became_peered":"2023-10-10T21:18:43.125519+0000","last_unstale":"2023-10-10T21:18:44.157785+0000","last_undegraded":"2023-10-10T21:18:44.157785+0000","last_fullsized":"2023-10-10T21:18:44.157785+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:18.164743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145072+0000","last_change":"2023-10-10T21:18:44.141540+0000","last_active":"2023-10-10T21:18:44.145072+0000","last_peered":"2023-10-10T21:18:44.145072+0000","last_clean":"2023-10-10T21:18:44.145072+0000","last_became_active":"2023-10-10T21:18:44.141272+0000","last_became_peered":"2023-10-10T21:18:44.141272+0000","last_unstale":"2023-10-10T21:18:44.145072+0000","last_undegraded":"2023-10-10T21:18:44.145072+0000","last_fullsized":"2023-10-10T21:18:44.145072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:43:11.303976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"109'1","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-10T21:18:46.197802+0000","last_change":"2023-10-10T21:18:43.130251+0000","last_active":"2023-10-10T21:18:46.197802+0000","last_peered":"2023-10-10T21:18:46.197802+0000","last_clean":"2023-10-10T21:18:46.197802+0000","last_became_active":"2023-10-10T21:18:43.130005+0000","last_became_peered":"2023-10-10T21:18:43.130005+0000","last_unstale":"2023-10-10T21:18:46.197802+0000","last_undegraded":"2023-10-10T21:18:46.197802+0000","last_fullsized":"2023-10-10T21:18:46.197802+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:48:47.942889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.148695+0000","last_change":"2023-10-10T21:18:44.147072+0000","last_active":"2023-10-10T21:18:44.148695+0000","last_peered":"2023-10-10T21:18:44.148695+0000","last_clean":"2023-10-10T21:18:44.148695+0000","last_became_active":"2023-10-10T21:18:44.146319+0000","last_became_peered":"2023-10-10T21:18:44.146319+0000","last_unstale":"2023-10-10T21:18:44.148695+0000","last_undegraded":"2023-10-10T21:18:44.148695+0000","last_fullsized":"2023-10-10T21:18:44.148695+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:04:42.359540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.133207+0000","last_change":"2023-10-10T21:18:43.126049+0000","last_active":"2023-10-10T21:18:44.133207+0000","last_peered":"2023-10-10T21:18:44.133207+0000","last_clean":"2023-10-10T21:18:44.133207+0000","last_became_active":"2023-10-10T21:18:43.125803+0000","last_became_peered":"2023-10-10T21:18:43.125803+0000","last_unstale":"2023-10-10T21:18:44.133207+0000","last_undegraded":"2023-10-10T21:18:44.133207+0000","last_fullsized":"2023-10-10T21:18:44.133207+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:52:50.993864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.145264+0000","last_change":"2023-10-10T21:18:44.143450+0000","last_active":"2023-10-10T21:18:44.145264+0000","last_peered":"2023-10-10T21:18:44.145264+0000","last_clean":"2023-10-10T21:18:44.145264+0000","last_became_active":"2023-10-10T21:18:44.142803+0000","last_became_peered":"2023-10-10T21:18:44.142803+0000","last_unstale":"2023-10-10T21:18:44.145264+0000","last_undegraded":"2023-10-10T21:18:44.145264+0000","last_fullsized":"2023-10-10T21:18:44.145264+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:04:35.029398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.135969+0000","last_change":"2023-10-10T21:18:43.132746+0000","last_active":"2023-10-10T21:18:44.135969+0000","last_peered":"2023-10-10T21:18:44.135969+0000","last_clean":"2023-10-10T21:18:44.135969+0000","last_became_active":"2023-10-10T21:18:43.132482+0000","last_became_peered":"2023-10-10T21:18:43.132482+0000","last_unstale":"2023-10-10T21:18:44.135969+0000","last_undegraded":"2023-10-10T21:18:44.135969+0000","last_fullsized":"2023-10-10T21:18:44.135969+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:55:39.818907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.141729+0000","last_change":"2023-10-10T21:18:44.136660+0000","last_active":"2023-10-10T21:18:44.141729+0000","last_peered":"2023-10-10T21:18:44.141729+0000","last_clean":"2023-10-10T21:18:44.141729+0000","last_became_active":"2023-10-10T21:18:44.135538+0000","last_became_peered":"2023-10-10T21:18:44.135538+0000","last_unstale":"2023-10-10T21:18:44.141729+0000","last_undegraded":"2023-10-10T21:18:44.141729+0000","last_fullsized":"2023-10-10T21:18:44.141729+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:17:14.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.124705+0000","last_change":"2023-10-10T21:18:43.127941+0000","last_active":"2023-10-10T21:18:44.124705+0000","last_peered":"2023-10-10T21:18:44.124705+0000","last_clean":"2023-10-10T21:18:44.124705+0000","last_became_active":"2023-10-10T21:18:43.127638+0000","last_became_peered":"2023-10-10T21:18:43.127638+0000","last_unstale":"2023-10-10T21:18:44.124705+0000","last_undegraded":"2023-10-10T21:18:44.124705+0000","last_fullsized":"2023-10-10T21:18:44.124705+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:17:44.055418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.151001+0000","last_change":"2023-10-10T21:18:44.145444+0000","last_active":"2023-10-10T21:18:44.151001+0000","last_peered":"2023-10-10T21:18:44.151001+0000","last_clean":"2023-10-10T21:18:44.151001+0000","last_became_active":"2023-10-10T21:18:44.145210+0000","last_became_peered":"2023-10-10T21:18:44.145210+0000","last_unstale":"2023-10-10T21:18:44.151001+0000","last_undegraded":"2023-10-10T21:18:44.151001+0000","last_fullsized":"2023-10-10T21:18:44.151001+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:38:01.405596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.125531+0000","last_change":"2023-10-10T21:18:43.133519+0000","last_active":"2023-10-10T21:18:44.125531+0000","last_peered":"2023-10-10T21:18:44.125531+0000","last_clean":"2023-10-10T21:18:44.125531+0000","last_became_active":"2023-10-10T21:18:43.132933+0000","last_became_peered":"2023-10-10T21:18:43.132933+0000","last_unstale":"2023-10-10T21:18:44.125531+0000","last_undegraded":"2023-10-10T21:18:44.125531+0000","last_fullsized":"2023-10-10T21:18:44.125531+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:17.981214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.154168+0000","last_change":"2023-10-10T21:18:44.152116+0000","last_active":"2023-10-10T21:18:44.154168+0000","last_peered":"2023-10-10T21:18:44.154168+0000","last_clean":"2023-10-10T21:18:44.154168+0000","last_became_active":"2023-10-10T21:18:44.151845+0000","last_became_peered":"2023-10-10T21:18:44.151845+0000","last_unstale":"2023-10-10T21:18:44.154168+0000","last_undegraded":"2023-10-10T21:18:44.154168+0000","last_fullsized":"2023-10-10T21:18:44.154168+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:19:54.163904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.133507+0000","last_change":"2023-10-10T21:18:43.133431+0000","last_active":"2023-10-10T21:18:44.133507+0000","last_peered":"2023-10-10T21:18:44.133507+0000","last_clean":"2023-10-10T21:18:44.133507+0000","last_became_active":"2023-10-10T21:18:43.133080+0000","last_became_peered":"2023-10-10T21:18:43.133080+0000","last_unstale":"2023-10-10T21:18:44.133507+0000","last_undegraded":"2023-10-10T21:18:44.133507+0000","last_fullsized":"2023-10-10T21:18:44.133507+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:10:05.363157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.147340+0000","last_change":"2023-10-10T21:18:44.142116+0000","last_active":"2023-10-10T21:18:44.147340+0000","last_peered":"2023-10-10T21:18:44.147340+0000","last_clean":"2023-10-10T21:18:44.147340+0000","last_became_active":"2023-10-10T21:18:44.141672+0000","last_became_peered":"2023-10-10T21:18:44.141672+0000","last_unstale":"2023-10-10T21:18:44.147340+0000","last_undegraded":"2023-10-10T21:18:44.147340+0000","last_fullsized":"2023-10-10T21:18:44.147340+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:17:14.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.125278+0000","last_change":"2023-10-10T21:18:43.127755+0000","last_active":"2023-10-10T21:18:44.125278+0000","last_peered":"2023-10-10T21:18:44.125278+0000","last_clean":"2023-10-10T21:18:44.125278+0000","last_became_active":"2023-10-10T21:18:43.127377+0000","last_became_peered":"2023-10-10T21:18:43.127377+0000","last_unstale":"2023-10-10T21:18:44.125278+0000","last_undegraded":"2023-10-10T21:18:44.125278+0000","last_fullsized":"2023-10-10T21:18:44.125278+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:23.191516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.142471+0000","last_change":"2023-10-10T21:18:44.137551+0000","last_active":"2023-10-10T21:18:44.142471+0000","last_peered":"2023-10-10T21:18:44.142471+0000","last_clean":"2023-10-10T21:18:44.142471+0000","last_became_active":"2023-10-10T21:18:44.137297+0000","last_became_peered":"2023-10-10T21:18:44.137297+0000","last_unstale":"2023-10-10T21:18:44.142471+0000","last_undegraded":"2023-10-10T21:18:44.142471+0000","last_fullsized":"2023-10-10T21:18:44.142471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:43.104747+0000","last_clean_scrub_stamp":"2023-10-10T21:18:43.104747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:12.206390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.160864+0000","last_change":"2023-10-10T21:18:43.130236+0000","last_active":"2023-10-10T21:18:44.160864+0000","last_peered":"2023-10-10T21:18:44.160864+0000","last_clean":"2023-10-10T21:18:44.160864+0000","last_became_active":"2023-10-10T21:18:43.129963+0000","last_became_peered":"2023-10-10T21:18:43.129963+0000","last_unstale":"2023-10-10T21:18:44.160864+0000","last_undegraded":"2023-10-10T21:18:44.160864+0000","last_fullsized":"2023-10-10T21:18:44.160864+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:18:42.098878+0000","last_clean_scrub_stamp":"2023-10-10T21:18:42.098878+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:17:44.055418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"98'205","reported_seq":552,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-10T21:18:44.130163+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:18:44.130163+0000","last_peered":"2023-10-10T21:18:44.130163+0000","last_clean":"2023-10-10T21:18:44.130163+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:18:44.130163+0000","last_undegraded":"2023-10-10T21:18:44.130163+0000","last_fullsized":"2023-10-10T21:18:44.130163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542343,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303272,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068568,"statfs":{"total":96636764160,"available":96326213632,"internally_reserved":0,"allocated":1933312,"data_stored":1238540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65500000000000003,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.014,"15min":1.1859999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.81899999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67600000000000005,"15min":0.71199999999999997},"min":{"1min":0.45200000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.79600000000000004,"5min":0.93799999999999994,"15min":1.0149999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88600000000000001,"5min":1.0069999999999999,"15min":1.123},"last":0.73699999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67000000000000004,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":0.99299999999999999,"15min":1.1240000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.50600000000000001,"5min":0.504,"15min":0.433},"max":{"1min":0.79800000000000004,"5min":0.96399999999999997,"15min":1.2929999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.0589999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70399999999999996,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91800000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2669999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.623,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":1.4139999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.627},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90300000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.41099999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.79500000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542342,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1347584,"data_stored":648768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66200000000000003,"15min":0.68999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":1.0189999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.92600000000000005,"15min":1.1040000000000001},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.502,"5min":0.42999999999999999,"15min":0.40400000000000003},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.03},"last":0.745},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.497,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.98699999999999999,"15min":1.073},"last":0.64200000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.69299999999999995},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86199999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"last":0.626},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.54900000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.97799999999999998,"15min":1.01},"last":0.70599999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.501,"5min":0.48699999999999999,"15min":0.46300000000000002},"max":{"1min":0.84599999999999997,"5min":1.042,"15min":1.042},"last":0.66100000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.97199999999999998},"last":0.45600000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.54200000000000004,"5min":0.39500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.022},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.94499999999999995,"5min":1.024,"15min":1.0629999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.0289999999999999},"last":0.503}]}]},{"osd":1,"up_from":14,"seq":60129542342,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1347584,"data_stored":648296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.61899999999999999,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":0.622,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.503,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.63700000000000001,"5min":2.254,"15min":2.254},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.434}]},{"osd":3,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.443},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56299999999999994,"15min":0.57999999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66300000000000003,"5min":0.999,"15min":0.999},"last":0.46999999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80700000000000005,"5min":4.806,"15min":4.806},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.754,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.871,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.77300000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.79500000000000004,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.73499999999999999,"5min":6.968,"15min":6.968},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.89000000000000001,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.876,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91500000000000004,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.83499999999999996},"min":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84199999999999997,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.502,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.83499999999999996,"5min":12.026,"15min":12.026},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.86599999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.68200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542344,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299176,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072664,"statfs":{"total":96636764160,"available":96330407936,"internally_reserved":0,"allocated":1933312,"data_stored":1238504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.61199999999999999,"5min":0.74399999999999999,"15min":0.752},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68899999999999995,"5min":0.879,"15min":0.91800000000000004},"last":0.34599999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.82099999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":0.85999999999999999,"15min":0.90300000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58099999999999996,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.40300000000000002},"max":{"1min":0.73499999999999999,"5min":0.874,"15min":0.874},"last":0.5}]},{"osd":4,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.58799999999999997,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.96799999999999997,"5min":1.101,"15min":1.1080000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.49099999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85999999999999999,"5min":0.96599999999999997,"15min":1.1879999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.52600000000000002},"max":{"1min":0.96899999999999997,"5min":1.03,"15min":1.2190000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79500000000000004,"15min":0.82399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.054,"15min":1.143},"last":0.85699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0529999999999999,"5min":1.139,"15min":1.169},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77900000000000003,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.024,"15min":1.165},"last":0.82699999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542344,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310884,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060956,"statfs":{"total":96636764160,"available":96318418944,"internally_reserved":0,"allocated":1339392,"data_stored":648656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.75,"15min":0.95699999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.307}]},{"osd":1,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28699999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.71099999999999997,"15min":0.83999999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.52500000000000002,"15min":0.54200000000000004},"min":{"1min":0.35199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53600000000000003,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71899999999999997,"5min":0.84599999999999997,"15min":0.85999999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.53400000000000003,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":0.92000000000000004,"5min":1.157,"15min":1.3109999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":0.91900000000000004,"5min":1.26,"15min":1.26},"last":0.89800000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97299999999999998,"5min":2.21,"15min":2.21},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.75,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.268},"last":0.875}]},{"osd":6,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76500000000000001,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.0509999999999999,"15min":1.3080000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.79500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.79200000000000004},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2290000000000001,"5min":1.716,"15min":1.716},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.50800000000000001,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":1.006,"15min":1.2330000000000001},"last":0.82299999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509639,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1347584,"data_stored":649638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27900000000000003},"max":{"1min":0.55800000000000005,"5min":0.69799999999999995,"15min":0.83099999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.47799999999999998,"15min":0.495},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28799999999999998},"max":{"1min":0.59999999999999998,"5min":0.77000000000000002,"15min":0.84399999999999997},"last":0.437}]},{"osd":1,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46999999999999997,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":0.68300000000000005,"5min":0.87,"15min":0.87},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.50800000000000001,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.76500000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.35899999999999999},"max":{"1min":0.85799999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76900000000000002,"5min":0.78900000000000003,"15min":0.92200000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73799999999999999,"15min":0.77200000000000002},"min":{"1min":0.48799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0149999999999999,"5min":1.1200000000000001,"15min":1.3440000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73799999999999999,"15min":0.78700000000000003},"min":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.1859999999999999,"15min":1.246},"last":0.754}]},{"osd":5,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.48199999999999998},"max":{"1min":0.94199999999999995,"5min":1.21,"15min":1.262},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":0.91600000000000004,"5min":1.2250000000000001,"15min":1.228},"last":0.84499999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.56200000000000006,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":0.97999999999999998,"5min":1.27,"15min":1.27},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77900000000000003,"15min":0.80000000000000004},"min":{"1min":0.58999999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.997,"5min":1.224,"15min":1.224},"last":0.82299999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":1.117,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78700000000000003,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.0720000000000001,"5min":1.228,"15min":1.3200000000000001},"last":0.874}]}]},{"osd":4,"up_from":14,"seq":60129542344,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310880,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060960,"statfs":{"total":96636764160,"available":96318423040,"internally_reserved":0,"allocated":1335296,"data_stored":648102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41499999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.68799999999999994,"15min":0.72599999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.121,"5min":1.121,"15min":1.5029999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.47},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67100000000000004,"15min":0.69699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.63300000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97499999999999998,"5min":1.002,"15min":1.536},"last":0.874},{"interface":"front","average":{"1min":0.628,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.397},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.385},"last":0.82399999999999995}]},{"osd":5,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1,"5min":1.0009999999999999,"15min":1.196},"last":0.48899999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.66700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.68899999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.216},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Oct 10 21:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98999999999999999,"5min":1.006,"15min":1.2390000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70199999999999996,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":1.034,"5min":1.034,"15min":1.4139999999999999},"last":0.54700000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542342,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302704,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069136,"statfs":{"total":96636764160,"available":96326795264,"internally_reserved":0,"allocated":1351680,"data_stored":649660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.66700000000000004,"15min":0.68999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.95399999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.79300000000000004,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.66800000000000004,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.748,"5min":0.93300000000000005,"15min":0.97299999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.68100000000000005,"15min":0.71299999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.99299999999999999,"15min":1.018},"last":0.67600000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68200000000000005,"15min":0.71099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96699999999999997},"last":0.65400000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80700000000000005,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.75},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.5,"5min":0.48799999999999999,"15min":0.45900000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":1.044},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.62,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.78800000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":1.496,"15min":1.496},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84799999999999998,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0049999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93500000000000005,"5min":1.077,"15min":1.077},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:18:53.894 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T21:18:53.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T21:18:54.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.115+0000 7fe9c5dff700 1 Processor -- start 2023-10-10T21:18:54.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.116+0000 7fe9c5dff700 1 -- start start 2023-10-10T21:18:54.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9c5dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c00c85c0 0x7fe9c006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9c5dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe9c0156ee0 0x7fe9c0069890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9c5dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9c0069dd0 0x7fe9c0159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9c5dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c006a210 con 0x7fe9c0069dd0 2023-10-10T21:18:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9c5dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c00c7bf0 con 0x7fe9c0156ee0 2023-10-10T21:18:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9c5dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c0156340 con 0x7fe9c00c85c0 2023-10-10T21:18:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9bffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9c0069dd0 0x7fe9c0159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9bffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9c0069dd0 0x7fe9c0159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42780/0 (socket says 172.21.15.154:42780) 2023-10-10T21:18:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9bffff700 1 -- 172.21.15.154:0/2955669799 learned_addr learned my addr 172.21.15.154:0/2955669799 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9bf7fe700 1 --2- 172.21.15.154:0/2955669799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c00c85c0 0x7fe9c006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.117+0000 7fe9beffd700 1 --2- 172.21.15.154:0/2955669799 >> v2:172.21.15.179:3300/0 conn(0x7fe9c0156ee0 0x7fe9c0069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9bffff700 1 -- 172.21.15.154:0/2955669799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c00c85c0 msgr2=0x7fe9c006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9bffff700 1 --2- 172.21.15.154:0/2955669799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c00c85c0 0x7fe9c006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9bffff700 1 -- 172.21.15.154:0/2955669799 >> v2:172.21.15.179:3300/0 conn(0x7fe9c0156ee0 msgr2=0x7fe9c0069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9bffff700 1 --2- 172.21.15.154:0/2955669799 >> v2:172.21.15.179:3300/0 conn(0x7fe9c0156ee0 0x7fe9c0069890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9bffff700 1 -- 172.21.15.154:0/2955669799 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00c8990 con 0x7fe9c0069dd0 2023-10-10T21:18:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9bf7fe700 1 --2- 172.21.15.154:0/2955669799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c00c85c0 0x7fe9c006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9beffd700 1 --2- 172.21.15.154:0/2955669799 >> v2:172.21.15.179:3300/0 conn(0x7fe9c0156ee0 0x7fe9c0069890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9bffff700 1 --2- 172.21.15.154:0/2955669799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c0069dd0 0x7fe9c0159ab0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe9c006b8e0 tx=0x7fe9b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b50b142b037901 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9be7fc700 1 -- 172.21.15.154:0/2955669799 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800b860 con 0x7fe9c0069dd0 2023-10-10T21:18:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9be7fc700 1 -- 172.21.15.154:0/2955669799 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b800b9c0 con 0x7fe9c0069dd0 2023-10-10T21:18:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.118+0000 7fe9be7fc700 1 -- 172.21.15.154:0/2955669799 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800bd60 con 0x7fe9c0069dd0 2023-10-10T21:18:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.119+0000 7fe9c5dff700 1 -- 172.21.15.154:0/2955669799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c0069dd0 msgr2=0x7fe9c0159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.119+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/2955669799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c0069dd0 0x7fe9c0159ab0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe9c006b8e0 tx=0x7fe9b8009250 comp rx=0 tx=0).stop 2023-10-10T21:18:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.119+0000 7fe9c5dff700 1 -- 172.21.15.154:0/2955669799 shutdown_connections 2023-10-10T21:18:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.119+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/2955669799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c0069dd0 0x7fe9c0159ab0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.119+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/2955669799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c00c85c0 0x7fe9c006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.119+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/2955669799 >> v2:172.21.15.179:3300/0 conn(0x7fe9c0156ee0 0x7fe9c0069890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.119+0000 7fe9c5dff700 1 -- 172.21.15.154:0/2955669799 >> 172.21.15.154:0/2955669799 conn(0x7fe9c00cc540 msgr2=0x7fe9c00cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.119+0000 7fe9c5dff700 1 -- 172.21.15.154:0/2955669799 shutdown_connections 2023-10-10T21:18:54.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.119+0000 7fe9c5dff700 1 -- 172.21.15.154:0/2955669799 wait complete. 2023-10-10T21:18:54.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.120+0000 7fe9c5dff700 1 Processor -- start 2023-10-10T21:18:54.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.120+0000 7fe9c5dff700 1 -- start start 2023-10-10T21:18:54.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.121+0000 7fe9c5dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c0069dd0 0x7fe9c00aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.121+0000 7fe9c5dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00c85c0 0x7fe9c0169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.121+0000 7fe9c5dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c0156ee0 0x7fe9c016a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.121+0000 7fe9c5dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00c1cd0 con 0x7fe9c00c85c0 2023-10-10T21:18:54.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.121+0000 7fe9c5dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00c19a0 con 0x7fe9c0156ee0 2023-10-10T21:18:54.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.121+0000 7fe9c5dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00ab100 con 0x7fe9c0069dd0 2023-10-10T21:18:54.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.121+0000 7fe9beffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00c85c0 0x7fe9c0169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.121+0000 7fe9beffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00c85c0 0x7fe9c0169730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42790/0 (socket says 172.21.15.154:42790) 2023-10-10T21:18:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.121+0000 7fe9beffd700 1 -- 172.21.15.154:0/3668460921 learned_addr learned my addr 172.21.15.154:0/3668460921 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9bf7fe700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c0069dd0 0x7fe9c00aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9bffff700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c0156ee0 0x7fe9c016a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9beffd700 1 -- 172.21.15.154:0/3668460921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c0069dd0 msgr2=0x7fe9c00aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9beffd700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c0069dd0 0x7fe9c00aabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9beffd700 1 -- 172.21.15.154:0/3668460921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c0156ee0 msgr2=0x7fe9c016a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9beffd700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c0156ee0 0x7fe9c016a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9beffd700 1 -- 172.21.15.154:0/3668460921 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b80094f0 con 0x7fe9c00c85c0 2023-10-10T21:18:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9beffd700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00c85c0 0x7fe9c0169730 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400c850 tx=0x7fe9b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9a77fe700 1 -- 172.21.15.154:0/3668460921 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4011600 con 0x7fe9c00c85c0 2023-10-10T21:18:54.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9a77fe700 1 -- 172.21.15.154:0/3668460921 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b4011760 con 0x7fe9c00c85c0 2023-10-10T21:18:54.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9a77fe700 1 -- 172.21.15.154:0/3668460921 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4011b00 con 0x7fe9c00c85c0 2023-10-10T21:18:54.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.122+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c016a0a0 con 0x7fe9c00c85c0 2023-10-10T21:18:54.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.123+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c016a660 con 0x7fe9c00c85c0 2023-10-10T21:18:54.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.124+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c00718b0 con 0x7fe9c00c85c0 2023-10-10T21:18:54.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.124+0000 7fe9a77fe700 1 -- 172.21.15.154:0/3668460921 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9b40223a0 con 0x7fe9c00c85c0 2023-10-10T21:18:54.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.125+0000 7fe9a77fe700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe9ac066f30 0x7fe9ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.125+0000 7fe9a77fe700 1 -- 172.21.15.154:0/3668460921 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe9b4084890 con 0x7fe9c00c85c0 2023-10-10T21:18:54.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.125+0000 7fe9bf7fe700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe9ac066f30 0x7fe9ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.126+0000 7fe9bf7fe700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe9ac066f30 0x7fe9ac0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0007fd0 tx=0x7fe9b00077c0 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:54.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.129+0000 7fe9a77fe700 1 -- 172.21.15.154:0/3668460921 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9b4051970 con 0x7fe9c00c85c0 2023-10-10T21:18:54.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.395+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe9c00c1e10 con 0x7fe9c00c85c0 2023-10-10T21:18:54.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.401+0000 7fe9a77fe700 1 -- 172.21.15.154:0/3668460921 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe9b401e0e0 con 0x7fe9c00c85c0 2023-10-10T21:18:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe9ac066f30 msgr2=0x7fe9ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe9ac066f30 0x7fe9ac0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0007fd0 tx=0x7fe9b00077c0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00c85c0 msgr2=0x7fe9c0169730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00c85c0 0x7fe9c0169730 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400c850 tx=0x7fe9b4008040 comp rx=0 tx=0).stop 2023-10-10T21:18:54.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 shutdown_connections 2023-10-10T21:18:54.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe9ac066f30 0x7fe9ac0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9c0156ee0 0x7fe9c016a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9c0069dd0 0x7fe9c00aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 --2- 172.21.15.154:0/3668460921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00c85c0 0x7fe9c0169730 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 >> 172.21.15.154:0/3668460921 conn(0x7fe9c00cc540 msgr2=0x7fe9c0158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 shutdown_connections 2023-10-10T21:18:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.403+0000 7fe9c5dff700 1 -- 172.21.15.154:0/3668460921 wait complete. 2023-10-10T21:18:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T21:18:54.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:18:54.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.603+0000 7fb2e03ff700 1 Processor -- start 2023-10-10T21:18:54.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.603+0000 7fb2e03ff700 1 -- start start 2023-10-10T21:18:54.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.604+0000 7fb2e03ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2d80b0a10 0x7fb2d8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.604+0000 7fb2e03ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80ad930 con 0x7fb2d8155c10 2023-10-10T21:18:54.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.604+0000 7fb2e03ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80acd20 con 0x7fb2d81578b0 2023-10-10T21:18:54.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.604+0000 7fb2e03ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80ad000 con 0x7fb2d80b0a10 2023-10-10T21:18:54.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2de19b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb2d8155c10 0x7fb2d80ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33956/0 (socket says 172.21.15.154:33956) 2023-10-10T21:18:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2de19b700 1 -- 172.21.15.154:0/3400908278 learned_addr learned my addr 172.21.15.154:0/3400908278 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2de99c700 1 --2- 172.21.15.154:0/3400908278 >> v2:172.21.15.179:3300/0 conn(0x7fb2d80b0a10 0x7fb2d8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617826083 0 0) 0x7fb2d80ad930 con 0x7fb2d8155c10 2023-10-10T21:18:54.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c4004680 con 0x7fb2d8155c10 2023-10-10T21:18:54.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674961089 0 0) 0x7fb2d80acd20 con 0x7fb2d81578b0 2023-10-10T21:18:54.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d80ad930 con 0x7fb2d81578b0 2023-10-10T21:18:54.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 512149876 0 0) 0x7fb2c4004680 con 0x7fb2d8155c10 2023-10-10T21:18:54.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 >> v2:172.21.15.179:3300/0 conn(0x7fb2d80b0a10 msgr2=0x7fb2d8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:54.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 --2- 172.21.15.154:0/3400908278 >> v2:172.21.15.179:3300/0 conn(0x7fb2d80b0a10 0x7fb2d8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 >> v1:172.21.15.179:6789/0 conn(0x7fb2d81578b0 legacy=0x7fb2d80af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80ad2e0 con 0x7fb2d8155c10 2023-10-10T21:18:54.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fb2d4001470 con 0x7fb2d8155c10 2023-10-10T21:18:54.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.605+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 >> v1:172.21.15.154:6789/0 conn(0x7fb2d8155c10 legacy=0x7fb2d80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2dd199700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2c4005140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2dd199700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2c4005920 0x7fb2c4005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2dd199700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2c4006320 0x7fb2c4003490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80ad000 con 0x7fb2c4004d50 2023-10-10T21:18:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4003bc0 con 0x7fb2c4005920 2023-10-10T21:18:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4003d80 con 0x7fb2c4006320 2023-10-10T21:18:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de19b700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2c4005140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2dd99a700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2c4005920 0x7fb2c4005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de99c700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2c4006320 0x7fb2c4003490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de19b700 1 -- 172.21.15.154:0/3400908278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2c4006320 msgr2=0x7fb2c4003490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:54.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de19b700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2c4006320 0x7fb2c4003490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de19b700 1 -- 172.21.15.154:0/3400908278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2c4005920 msgr2=0x7fb2c4005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:54.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de19b700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2c4005920 0x7fb2c4005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de19b700 1 -- 172.21.15.154:0/3400908278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4004680 con 0x7fb2c4004d50 2023-10-10T21:18:54.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de99c700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2c4006320 0x7fb2c4003490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:18:54.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de99c700 1 -- 172.21.15.154:0/3400908278 reap_dead start 2023-10-10T21:18:54.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.606+0000 7fb2de19b700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2c4005140 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400c1e0 tx=0x7fb2d4001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d8d15305ccaf39 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:54.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400cb10 con 0x7fb2c4004d50 2023-10-10T21:18:54.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d400cc90 con 0x7fb2c4004d50 2023-10-10T21:18:54.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2dd199700 1 -- 172.21.15.154:0/3400908278 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4005b70 con 0x7fb2c4004d50 2023-10-10T21:18:54.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2e03ff700 1 -- 172.21.15.154:0/3400908278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 msgr2=0x7fb2c4005140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2e03ff700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2c4005140 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400c1e0 tx=0x7fb2d4001d40 comp rx=0 tx=0).stop 2023-10-10T21:18:54.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2e03ff700 1 -- 172.21.15.154:0/3400908278 shutdown_connections 2023-10-10T21:18:54.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2e03ff700 1 --2- 172.21.15.154:0/3400908278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2c4005140 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2e03ff700 1 -- 172.21.15.154:0/3400908278 >> 172.21.15.154:0/3400908278 conn(0x7fb2d806a320 msgr2=0x7fb2d80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:54.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2e03ff700 1 -- 172.21.15.154:0/3400908278 shutdown_connections 2023-10-10T21:18:54.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.607+0000 7fb2e03ff700 1 -- 172.21.15.154:0/3400908278 wait complete. 2023-10-10T21:18:54.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.609+0000 7fb2e03ff700 1 Processor -- start 2023-10-10T21:18:54.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.609+0000 7fb2e03ff700 1 -- start start 2023-10-10T21:18:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2e03ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2d813ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2e03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d8154070 0x7fb2d81544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2e03ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2d81509d0 0x7fb2d8150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2e03ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8154a20 con 0x7fb2c4004d50 2023-10-10T21:18:54.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2e03ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d814c7c0 con 0x7fb2d81509d0 2023-10-10T21:18:54.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2e03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8151790 con 0x7fb2d8154070 2023-10-10T21:18:54.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2de19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2d813ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2de19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2d813ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42800/0 (socket says 172.21.15.154:42800) 2023-10-10T21:18:54.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2de19b700 1 -- 172.21.15.154:0/4052580101 learned_addr learned my addr 172.21.15.154:0/4052580101 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:54.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2de19b700 1 -- 172.21.15.154:0/4052580101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d8154070 msgr2=0x7fb2d81544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2de19b700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d8154070 0x7fb2d81544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2de19b700 1 -- 172.21.15.154:0/4052580101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2d81509d0 msgr2=0x7fb2d8150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2de19b700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2d81509d0 0x7fb2d8150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.610+0000 7fb2de19b700 1 -- 172.21.15.154:0/4052580101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d814c170 con 0x7fb2c4004d50 2023-10-10T21:18:54.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.611+0000 7fb2de19b700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2d813ada0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4006fd0 tx=0x7fb2d4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:54.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.611+0000 7fb2ce7fc700 1 -- 172.21.15.154:0/4052580101 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4001650 con 0x7fb2c4004d50 2023-10-10T21:18:54.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.611+0000 7fb2ce7fc700 1 -- 172.21.15.154:0/4052580101 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d40070d0 con 0x7fb2c4004d50 2023-10-10T21:18:54.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.611+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d814c450 con 0x7fb2c4004d50 2023-10-10T21:18:54.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.611+0000 7fb2ce7fc700 1 -- 172.21.15.154:0/4052580101 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4007470 con 0x7fb2c4004d50 2023-10-10T21:18:54.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.611+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d813b2e0 con 0x7fb2c4004d50 2023-10-10T21:18:54.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.612+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d814bfb0 con 0x7fb2c4004d50 2023-10-10T21:18:54.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.613+0000 7fb2ce7fc700 1 -- 172.21.15.154:0/4052580101 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2d4019030 con 0x7fb2c4004d50 2023-10-10T21:18:54.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.614+0000 7fb2ce7fc700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb2bc066f30 0x7fb2bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:54.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.614+0000 7fb2ce7fc700 1 -- 172.21.15.154:0/4052580101 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fb2d40857d0 con 0x7fb2c4004d50 2023-10-10T21:18:54.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.614+0000 7fb2dd99a700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb2bc066f30 0x7fb2bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:54.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.614+0000 7fb2dd99a700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb2bc066f30 0x7fb2bc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80010e0 tx=0x7fb2c8007d30 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:54.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.618+0000 7fb2ce7fc700 1 -- 172.21.15.154:0/4052580101 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2d40528b0 con 0x7fb2c4004d50 2023-10-10T21:18:54.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.849+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2d8154a20 con 0x7fb2c4004d50 2023-10-10T21:18:54.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.850+0000 7fb2ce7fc700 1 -- 172.21.15.154:0/4052580101 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fb2d4017090 con 0x7fb2c4004d50 2023-10-10T21:18:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:18:54.851 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1983002927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1983002927},{"type":"v1","addr":"172.21.15.179:6835","nonce":1983002927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3483729269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3483729269},{"type":"v1","addr":"172.21.15.179:6834","nonce":3483729269}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3602154448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3602154448},{"type":"v1","addr":"172.21.15.154:6837","nonce":3602154448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:43.589800+0000","modified":"2023-10-10T21:18:47.153053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/2335601961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2335601961},{"type":"v1","addr":"172.21.15.154:6835","nonce":2335601961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-10T21:18:54.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb2bc066f30 msgr2=0x7fb2bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb2bc066f30 0x7fb2bc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80010e0 tx=0x7fb2c8007d30 comp rx=0 tx=0).stop 2023-10-10T21:18:54.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 msgr2=0x7fb2d813ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:54.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2d813ada0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4006fd0 tx=0x7fb2d4015000 comp rx=0 tx=0).stop 2023-10-10T21:18:54.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 shutdown_connections 2023-10-10T21:18:54.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb2bc066f30 0x7fb2bc0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2d81509d0 0x7fb2d8150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c4004d50 0x7fb2d813ada0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 --2- 172.21.15.154:0/4052580101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d8154070 0x7fb2d81544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:54.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 >> 172.21.15.154:0/4052580101 conn(0x7fb2d806a320 msgr2=0x7fb2d80afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:54.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 shutdown_connections 2023-10-10T21:18:54.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:54.852+0000 7fb2e03ff700 1 -- 172.21.15.154:0/4052580101 wait complete. 2023-10-10T21:18:54.856 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 45 2023-10-10T21:18:55.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T21:18:43.589800+0000', 'modified': '2023-10-10T21:18:47.153053+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7179}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7179': {'gid': 7179, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6835/2335601961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 2335601961}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 2335601961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T21:18:55.274 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T21:18:55.274 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-10T21:18:55.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.458+0000 7fc5a539d700 1 Processor -- start 2023-10-10T21:18:55.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.458+0000 7fc5a539d700 1 -- start start 2023-10-10T21:18:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.459+0000 7fc5a539d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5a006a660 0x7fc5a0157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.459+0000 7fc5a539d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a006e2a0 con 0x7fc5a0150550 2023-10-10T21:18:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.459+0000 7fc5a539d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a006b2e0 con 0x7fc5a0150180 2023-10-10T21:18:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.460+0000 7fc5a539d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a00c78e0 con 0x7fc5a006a660 2023-10-10T21:18:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.460+0000 7fc5a4b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5a006a660 0x7fc5a0157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.460+0000 7fc59f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc5a0150550 0x7fc5a0069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33958/0 (socket says 172.21.15.154:33958) 2023-10-10T21:18:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.460+0000 7fc59f7fe700 1 -- 172.21.15.154:0/2976968874 learned_addr learned my addr 172.21.15.154:0/2976968874 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:55.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.460+0000 7fc5a4b9c700 1 -- 172.21.15.154:0/2976968874 >> v1:172.21.15.179:6789/0 conn(0x7fc5a0150180 legacy=0x7fc5a00c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.460+0000 7fc5a4b9c700 1 -- 172.21.15.154:0/2976968874 >> v1:172.21.15.154:6789/0 conn(0x7fc5a0150550 legacy=0x7fc5a0069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.460+0000 7fc5a4b9c700 1 -- 172.21.15.154:0/2976968874 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00c7bc0 con 0x7fc5a006a660 2023-10-10T21:18:55.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.460+0000 7fc5a4b9c700 1 --2- 172.21.15.154:0/2976968874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a006a660 0x7fc5a0157770 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc59800afa0 tx=0x7fc59800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dddf8109855715 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc59effd700 1 -- 172.21.15.154:0/2976968874 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59800f070 con 0x7fc5a006a660 2023-10-10T21:18:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc59effd700 1 -- 172.21.15.154:0/2976968874 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59800a2e0 con 0x7fc5a006a660 2023-10-10T21:18:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc59effd700 1 -- 172.21.15.154:0/2976968874 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59800cd10 con 0x7fc5a006a660 2023-10-10T21:18:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc5a539d700 1 -- 172.21.15.154:0/2976968874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a006a660 msgr2=0x7fc5a0157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc5a539d700 1 --2- 172.21.15.154:0/2976968874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a006a660 0x7fc5a0157770 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc59800afa0 tx=0x7fc59800a890 comp rx=0 tx=0).stop 2023-10-10T21:18:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc5a539d700 1 -- 172.21.15.154:0/2976968874 shutdown_connections 2023-10-10T21:18:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc5a539d700 1 --2- 172.21.15.154:0/2976968874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a006a660 0x7fc5a0157770 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc5a539d700 1 -- 172.21.15.154:0/2976968874 >> 172.21.15.154:0/2976968874 conn(0x7fc5a00cc1f0 msgr2=0x7fc5a00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc5a539d700 1 -- 172.21.15.154:0/2976968874 shutdown_connections 2023-10-10T21:18:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.461+0000 7fc5a539d700 1 -- 172.21.15.154:0/2976968874 wait complete. 2023-10-10T21:18:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.463+0000 7fc5a539d700 1 Processor -- start 2023-10-10T21:18:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.463+0000 7fc5a539d700 1 -- start start 2023-10-10T21:18:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a539d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5a006a660 0x7fc5a0156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5a0150180 0x7fc5a00b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a539d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a0150550 0x7fc5a014abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a539d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00b18f0 con 0x7fc5a0150550 2023-10-10T21:18:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a539d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00b0e50 con 0x7fc5a006a660 2023-10-10T21:18:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a014ced0 con 0x7fc5a0150180 2023-10-10T21:18:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a4b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a0150550 0x7fc5a014abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a4b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a0150550 0x7fc5a014abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42816/0 (socket says 172.21.15.154:42816) 2023-10-10T21:18:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a4b9c700 1 -- 172.21.15.154:0/3489404885 learned_addr learned my addr 172.21.15.154:0/3489404885 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a4b9c700 1 -- 172.21.15.154:0/3489404885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5a0150180 msgr2=0x7fc5a00b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a4b9c700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5a0150180 0x7fc5a00b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a4b9c700 1 -- 172.21.15.154:0/3489404885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5a006a660 msgr2=0x7fc5a0156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a4b9c700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5a006a660 0x7fc5a0156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.464+0000 7fc5a4b9c700 1 -- 172.21.15.154:0/3489404885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59800ab30 con 0x7fc5a0150550 2023-10-10T21:18:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.465+0000 7fc5a4b9c700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a0150550 0x7fc5a014abe0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc598013000 tx=0x7fc598019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.465+0000 7fc587fff700 1 -- 172.21.15.154:0/3489404885 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598009e90 con 0x7fc5a0150550 2023-10-10T21:18:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.465+0000 7fc587fff700 1 -- 172.21.15.154:0/3489404885 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598027410 con 0x7fc5a0150550 2023-10-10T21:18:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.465+0000 7fc587fff700 1 -- 172.21.15.154:0/3489404885 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5980277f0 con 0x7fc5a0150550 2023-10-10T21:18:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.465+0000 7fc5a539d700 1 -- 172.21.15.154:0/3489404885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a014d190 con 0x7fc5a0150550 2023-10-10T21:18:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.465+0000 7fc5a539d700 1 -- 172.21.15.154:0/3489404885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a00b1330 con 0x7fc5a0150550 2023-10-10T21:18:55.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.467+0000 7fc587fff700 1 -- 172.21.15.154:0/3489404885 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc59801d410 con 0x7fc5a0150550 2023-10-10T21:18:55.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.468+0000 7fc587fff700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc58c066f30 0x7fc58c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.468+0000 7fc587fff700 1 -- 172.21.15.154:0/3489404885 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc598086270 con 0x7fc5a0150550 2023-10-10T21:18:55.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.468+0000 7fc59ffff700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc58c066f30 0x7fc58c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.469+0000 7fc59ffff700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc58c066f30 0x7fc58c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc590001730 tx=0x7fc590007b40 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.470+0000 7fc5b4c9eb80 1 Processor -- start 2023-10-10T21:18:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.470+0000 7fc5b4c9eb80 1 -- start start 2023-10-10T21:18:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bde6480 0x564a2bdc57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bd9bb80 0x564a2bd9bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2bcf2a70 con 0x564a2bd995f0 2023-10-10T21:18:55.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2bcf0270 con 0x564a2bd9bb80 2023-10-10T21:18:55.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a2bcec060 con 0x564a2bde6480 2023-10-10T21:18:55.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc59f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc59f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42826/0 (socket says 172.21.15.154:42826) 2023-10-10T21:18:55.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc59f7fe700 1 -- 172.21.15.154:0/777917626 learned_addr learned my addr 172.21.15.154:0/777917626 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:55.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc59ffff700 1 --2- 172.21.15.154:0/777917626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bde6480 0x564a2bdc57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc5a4b9c700 1 --2- 172.21.15.154:0/777917626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bd9bb80 0x564a2bd9bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc59f7fe700 1 -- 172.21.15.154:0/777917626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bde6480 msgr2=0x564a2bdc57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:55.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc59f7fe700 1 --2- 172.21.15.154:0/777917626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bde6480 0x564a2bdc57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc59f7fe700 1 -- 172.21.15.154:0/777917626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bd9bb80 msgr2=0x564a2bd9bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:55.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc59f7fe700 1 --2- 172.21.15.154:0/777917626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bd9bb80 0x564a2bd9bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.471+0000 7fc59f7fe700 1 -- 172.21.15.154:0/777917626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a2bb86270 con 0x564a2bd995f0 2023-10-10T21:18:55.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.472+0000 7fc59f7fe700 1 --2- 172.21.15.154:0/777917626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde6850 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc5940014b0 tx=0x7fc594007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f496fbf57697427d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.472+0000 7fc5857fa700 1 -- 172.21.15.154:0/777917626 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594005b30 con 0x564a2bd995f0 2023-10-10T21:18:55.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.472+0000 7fc5857fa700 1 -- 172.21.15.154:0/777917626 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc594005c90 con 0x564a2bd995f0 2023-10-10T21:18:55.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.472+0000 7fc5857fa700 1 -- 172.21.15.154:0/777917626 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594007360 con 0x564a2bd995f0 2023-10-10T21:18:55.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.472+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/777917626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 msgr2=0x564a2bde6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.472+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/777917626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde6850 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc5940014b0 tx=0x7fc594007f10 comp rx=0 tx=0).stop 2023-10-10T21:18:55.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.473+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/777917626 shutdown_connections 2023-10-10T21:18:55.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.473+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/777917626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bd9bb80 0x564a2bd9bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.473+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/777917626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bde6480 0x564a2bdc57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.473+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/777917626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde6850 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.473+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/777917626 >> 172.21.15.154:0/777917626 conn(0x564a2bd9d0c0 msgr2=0x564a2bd9d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:55.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.473+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/777917626 shutdown_connections 2023-10-10T21:18:55.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.473+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/777917626 wait complete. 2023-10-10T21:18:55.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.473+0000 7fc5b4c9eb80 1 -- start start 2023-10-10T21:18:55.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.474+0000 7fc5b4c9eb80 1 Processor -- start 2023-10-10T21:18:55.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bd9c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bdbfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2bc97890 con 0x564a2bd995f0 2023-10-10T21:18:55.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2bcb2ea0 con 0x564a2bde6480 2023-10-10T21:18:55.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a2bb6ee30 con 0x564a2bd9bb80 2023-10-10T21:18:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc5b4c9eb80 10 client.0 _ll_register_callbacks cb 0x564a2bd5f2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:18:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc59ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc59ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42836/0 (socket says 172.21.15.154:42836) 2023-10-10T21:18:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc59ffff700 1 -- 172.21.15.154:0/4034847196 learned_addr learned my addr 172.21.15.154:0/4034847196 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc59ffff700 1 -- 172.21.15.154:0/4034847196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 msgr2=0x564a2bd9c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:55.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc59ffff700 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bd9c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc59ffff700 1 -- 172.21.15.154:0/4034847196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 msgr2=0x564a2bdbfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:55.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc59ffff700 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bdbfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc59ffff700 1 -- 172.21.15.154:0/4034847196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a006e2a0 con 0x564a2bd995f0 2023-10-10T21:18:55.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc59ffff700 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde2980 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c7b0 tx=0x7fc59001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a48c5ca965dc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.475+0000 7fc57e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:18:55.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc57e7fc700 1 -- 172.21.15.154:0/4034847196 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59001d040 con 0x564a2bd995f0 2023-10-10T21:18:55.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc57e7fc700 1 -- 172.21.15.154:0/4034847196 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc590023c80 con 0x564a2bd995f0 2023-10-10T21:18:55.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/4034847196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a2bd90cd0 con 0x564a2bd995f0 2023-10-10T21:18:55.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc57e7fc700 1 -- 172.21.15.154:0/4034847196 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5900185a0 con 0x564a2bd995f0 2023-10-10T21:18:55.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc5b4c9eb80 10 client.7368 fetch_fsmap learned FSMap version 45 2023-10-10T21:18:55.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/4034847196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x564a2bb28fe0 con 0x564a2bd995f0 2023-10-10T21:18:55.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc57e7fc700 1 -- 172.21.15.154:0/4034847196 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564a2bd90cd0 con 0x564a2bd995f0 2023-10-10T21:18:55.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc57e7fc700 1 -- 172.21.15.154:0/4034847196 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 45) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc590015810 con 0x564a2bd995f0 2023-10-10T21:18:55.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc5b4c9eb80 10 client.7368 fetch_fsmap finished waiting for FSMap version 45 2023-10-10T21:18:55.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc5b4c9eb80 10 client.7368 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-10T21:18:55.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc5b4c9eb80 20 client.7368 populate_metadata read hostname 'smithi154' 2023-10-10T21:18:55.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] conn(0x564a2bdf5d20 0x564a2bdf60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc5b4c9eb80 4 client.7368 mds_command: new command op to 7179 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T21:18:55.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.476+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/4034847196 --> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a2bd6daa0 con 0x564a2bdf5d20 2023-10-10T21:18:55.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.477+0000 7fc59f7fe700 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] conn(0x564a2bdf5d20 0x564a2bdf60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.477+0000 7fc57e7fc700 10 client.7368 ms_handle_connect on v2:172.21.15.154:6832/2335601961 2023-10-10T21:18:55.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.477+0000 7fc59f7fe700 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] conn(0x564a2bdf5d20 0x564a2bdf60f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe8572dedc5f28ac server_cookie=b160ffd168f4ea32 in_seq=0 out_seq=0 2023-10-10T21:18:55.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc57e7fc700 1 -- 172.21.15.154:0/4034847196 <== mds.0 v2:172.21.15.154:6832/2335601961 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564a2bd6daa0 con 0x564a2bdf5d20 2023-10-10T21:18:55.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc57e7fc700 10 client.7368 handle_command_reply: tid=0 2023-10-10T21:18:55.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 client.7368 shutdown 2023-10-10T21:18:55.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/4034847196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 msgr2=0x564a2bde2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde2980 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c7b0 tx=0x7fc59001a040 comp rx=0 tx=0).stop 2023-10-10T21:18:55.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/4034847196 shutdown_connections 2023-10-10T21:18:55.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] conn(0x564a2bdf5d20 0x564a2bdf60f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bdbfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bde2980 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc57e7fc700 0 client.7368 ms_handle_reset on v2:172.21.15.154:6832/2335601961 2023-10-10T21:18:55.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/4034847196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bd9c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/4034847196 >> 172.21.15.154:0/4034847196 conn(0x564a2bd9d0c0 msgr2=0x564a2bd92c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:55.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/4034847196 shutdown_connections 2023-10-10T21:18:55.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.478+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/4034847196 wait complete. 2023-10-10T21:18:55.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.479+0000 7fc5b4c9eb80 20 client.7368 trim_cache size 0 max 16384 2023-10-10T21:18:55.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.496+0000 7fc5b4c9eb80 1 Processor -- start 2023-10-10T21:18:55.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.496+0000 7fc5b4c9eb80 1 -- start start 2023-10-10T21:18:55.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bd98c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bde3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bde38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2bde4ef0 con 0x564a2bd995f0 2023-10-10T21:18:55.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2bd99b90 con 0x564a2bde6480 2023-10-10T21:18:55.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a2bd94730 con 0x564a2bd9bb80 2023-10-10T21:18:55.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc59ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bd98c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc59ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bd98c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42852/0 (socket says 172.21.15.154:42852) 2023-10-10T21:18:55.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc59ffff700 1 -- 172.21.15.154:0/2432492667 learned_addr learned my addr 172.21.15.154:0/2432492667 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:55.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc59ffff700 1 -- 172.21.15.154:0/2432492667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 msgr2=0x564a2bde3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:55.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc59ffff700 1 --2- 172.21.15.154:0/2432492667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bde3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc59ffff700 1 -- 172.21.15.154:0/2432492667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 msgr2=0x564a2bde38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:55.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc59ffff700 1 --2- 172.21.15.154:0/2432492667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bde38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc59ffff700 1 -- 172.21.15.154:0/2432492667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a2bcba780 con 0x564a2bd995f0 2023-10-10T21:18:55.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.497+0000 7fc59ffff700 1 --2- 172.21.15.154:0/2432492667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bd98c10 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc590001e80 tx=0x7fc590016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d313d7f22b40aaf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc585ffb700 1 -- 172.21.15.154:0/2432492667 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59001d040 con 0x564a2bd995f0 2023-10-10T21:18:55.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc585ffb700 1 -- 172.21.15.154:0/2432492667 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590015d70 con 0x564a2bd995f0 2023-10-10T21:18:55.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc585ffb700 1 -- 172.21.15.154:0/2432492667 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590000c30 con 0x564a2bd995f0 2023-10-10T21:18:55.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/2432492667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 msgr2=0x564a2bd98c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/2432492667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bd98c10 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc590001e80 tx=0x7fc590016000 comp rx=0 tx=0).stop 2023-10-10T21:18:55.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/2432492667 shutdown_connections 2023-10-10T21:18:55.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/2432492667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bde38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/2432492667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2bd98c10 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/2432492667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bde3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/2432492667 >> 172.21.15.154:0/2432492667 conn(0x564a2bd9d0c0 msgr2=0x564a2bdbf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:55.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/2432492667 shutdown_connections 2023-10-10T21:18:55.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.498+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/2432492667 wait complete. 2023-10-10T21:18:55.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.499+0000 7fc5b4c9eb80 1 -- start start 2023-10-10T21:18:55.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.499+0000 7fc5b4c9eb80 1 Processor -- start 2023-10-10T21:18:55.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2be49e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bde3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc5b4c9eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bde38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2bdf5be0 con 0x564a2bd995f0 2023-10-10T21:18:55.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2be4e150 con 0x564a2bde6480 2023-10-10T21:18:55.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc5b4c9eb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a2bdf5990 con 0x564a2bd9bb80 2023-10-10T21:18:55.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc5b4c9eb80 10 client.0 _ll_register_callbacks cb 0x564a2bd5f2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:18:55.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc59ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2be49e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc59ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2be49e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42860/0 (socket says 172.21.15.154:42860) 2023-10-10T21:18:55.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc59ffff700 1 -- 172.21.15.154:0/1829567467 learned_addr learned my addr 172.21.15.154:0/1829567467 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:55.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc59f7fe700 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bde3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.500+0000 7fc5a4b9c700 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bde38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc59ffff700 1 -- 172.21.15.154:0/1829567467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 msgr2=0x564a2bde3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:55.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc59ffff700 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bde3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc59ffff700 1 -- 172.21.15.154:0/1829567467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 msgr2=0x564a2bde38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:55.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc59ffff700 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bde38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc59ffff700 1 -- 172.21.15.154:0/1829567467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc590019e70 con 0x564a2bd995f0 2023-10-10T21:18:55.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc59ffff700 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2be49e60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fc590007ef0 tx=0x7fc59002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ab3eb8ee9d60a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc57e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:18:55.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc57e7fc700 1 -- 172.21.15.154:0/1829567467 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59001d040 con 0x564a2bd995f0 2023-10-10T21:18:55.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc57e7fc700 1 -- 172.21.15.154:0/1829567467 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc59002c470 con 0x564a2bd995f0 2023-10-10T21:18:55.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/1829567467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5a00c5c20 con 0x564a2bd995f0 2023-10-10T21:18:55.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc57e7fc700 1 -- 172.21.15.154:0/1829567467 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc59000c4b0 con 0x564a2bd995f0 2023-10-10T21:18:55.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc5b4c9eb80 10 client.7374 fetch_fsmap learned FSMap version 45 2023-10-10T21:18:55.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.501+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/1829567467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x564a2bca1470 con 0x564a2bd995f0 2023-10-10T21:18:55.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.502+0000 7fc57e7fc700 1 -- 172.21.15.154:0/1829567467 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a00c5c20 con 0x564a2bd995f0 2023-10-10T21:18:55.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.502+0000 7fc57e7fc700 1 -- 172.21.15.154:0/1829567467 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 45) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc59003e400 con 0x564a2bd995f0 2023-10-10T21:18:55.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.502+0000 7fc5b4c9eb80 10 client.7374 fetch_fsmap finished waiting for FSMap version 45 2023-10-10T21:18:55.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.502+0000 7fc5b4c9eb80 10 client.7374 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-10T21:18:55.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.502+0000 7fc5b4c9eb80 20 client.7374 populate_metadata read hostname 'smithi154' 2023-10-10T21:18:55.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.502+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] conn(0x564a2bde0d50 0x564a2bde1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.502+0000 7fc5b4c9eb80 4 client.7374 mds_command: new command op to 7179 tid=0[{"prefix": "status"}] 2023-10-10T21:18:55.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.502+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/1829567467 --> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fc594005c90 con 0x564a2bde0d50 2023-10-10T21:18:55.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.502+0000 7fc59f7fe700 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] conn(0x564a2bde0d50 0x564a2bde1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc59f7fe700 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] conn(0x564a2bde0d50 0x564a2bde1120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a32e29ebcace5525 server_cookie=3ec2160df5644db8 in_seq=0 out_seq=0 2023-10-10T21:18:55.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc57e7fc700 10 client.7374 ms_handle_connect on v2:172.21.15.154:6832/2335601961 2023-10-10T21:18:55.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc57e7fc700 1 -- 172.21.15.154:0/1829567467 <== mds.0 v2:172.21.15.154:6832/2335601961 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fc594005c90 con 0x564a2bde0d50 2023-10-10T21:18:55.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc57e7fc700 10 client.7374 handle_command_reply: tid=0 2023-10-10T21:18:55.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 client.7374 shutdown 2023-10-10T21:18:55.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/1829567467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 msgr2=0x564a2be49e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2be49e60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fc590007ef0 tx=0x7fc59002e070 comp rx=0 tx=0).stop 2023-10-10T21:18:55.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/1829567467 shutdown_connections 2023-10-10T21:18:55.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.154:6832/2335601961,v1:172.21.15.154:6835/2335601961] conn(0x564a2bde0d50 0x564a2bde1120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564a2bde6480 0x564a2bde38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a2bd995f0 0x564a2be49e60 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc57e7fc700 0 client.7374 ms_handle_reset on v2:172.21.15.154:6832/2335601961 2023-10-10T21:18:55.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 --2- 172.21.15.154:0/1829567467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564a2bd9bb80 0x564a2bde3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/1829567467 >> 172.21.15.154:0/1829567467 conn(0x564a2bd9d0c0 msgr2=0x564a2bde6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:55.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/1829567467 shutdown_connections 2023-10-10T21:18:55.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.503+0000 7fc5b4c9eb80 1 -- 172.21.15.154:0/1829567467 wait complete. 2023-10-10T21:18:55.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5b4c9eb80 20 client.7374 trim_cache size 0 max 16384 2023-10-10T21:18:55.518 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:18:55.518 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T21:18:55.519 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T21:18:55.519 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 7179, 2023-10-10T21:18:55.519 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T21:18:55.519 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T21:18:55.519 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T21:18:55.520 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.367585927, 2023-10-10T21:18:55.520 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 45, 2023-10-10T21:18:55.520 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 109, 2023-10-10T21:18:55.520 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 109, 2023-10-10T21:18:55.520 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.146657363999999 2023-10-10T21:18:55.521 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:18:55.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 -- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc58c066f30 msgr2=0x7fc58c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc58c066f30 0x7fc58c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc590001730 tx=0x7fc590007b40 comp rx=0 tx=0).stop 2023-10-10T21:18:55.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 -- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a0150550 msgr2=0x7fc5a014abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a0150550 0x7fc5a014abe0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc598013000 tx=0x7fc598019000 comp rx=0 tx=0).stop 2023-10-10T21:18:55.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 -- 172.21.15.154:0/3489404885 shutdown_connections 2023-10-10T21:18:55.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a0150550 0x7fc5a014abe0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc58c066f30 0x7fc58c0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5a006a660 0x7fc5a0156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 --2- 172.21.15.154:0/3489404885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5a0150180 0x7fc5a00b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 -- 172.21.15.154:0/3489404885 >> 172.21.15.154:0/3489404885 conn(0x7fc5a00cc1f0 msgr2=0x7fc5a0158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:55.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 -- 172.21.15.154:0/3489404885 shutdown_connections 2023-10-10T21:18:55.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.504+0000 7fc5a539d700 1 -- 172.21.15.154:0/3489404885 wait complete. 2023-10-10T21:18:55.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:18:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.706+0000 7ff30359e700 1 Processor -- start 2023-10-10T21:18:55.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.707+0000 7ff30359e700 1 -- start start 2023-10-10T21:18:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.708+0000 7ff30359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff304150180 0x7ff304157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.708+0000 7ff30359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3040c7410 0x7ff304069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.708+0000 7ff30359e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30406e2a0 con 0x7ff304150550 2023-10-10T21:18:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.708+0000 7ff30359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30406b2e0 con 0x7ff3040c7410 2023-10-10T21:18:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.708+0000 7ff30359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040c78e0 con 0x7ff304150180 2023-10-10T21:18:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.708+0000 7ff301d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff304150550 0x7ff3040c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33960/0 (socket says 172.21.15.154:33960) 2023-10-10T21:18:55.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.708+0000 7ff301d9b700 1 -- 172.21.15.154:0/3569357509 learned_addr learned my addr 172.21.15.154:0/3569357509 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:55.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.708+0000 7ff30259c700 1 --2- 172.21.15.154:0/3569357509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff304150180 0x7ff304157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.708+0000 7ff302d9d700 1 --2- 172.21.15.154:0/3569357509 >> v2:172.21.15.179:3300/0 conn(0x7ff3040c7410 0x7ff304069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.709+0000 7ff30159a700 1 -- 172.21.15.154:0/3569357509 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912421850 0 0) 0x7ff30406e2a0 con 0x7ff304150550 2023-10-10T21:18:55.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.709+0000 7ff30159a700 1 -- 172.21.15.154:0/3569357509 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ec003570 con 0x7ff304150550 2023-10-10T21:18:55.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.709+0000 7ff30159a700 1 -- 172.21.15.154:0/3569357509 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2073595447 0 0) 0x7ff2ec003570 con 0x7ff304150550 2023-10-10T21:18:55.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.709+0000 7ff302d9d700 1 -- 172.21.15.154:0/3569357509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff304150180 msgr2=0x7ff304157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:55.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.709+0000 7ff302d9d700 1 --2- 172.21.15.154:0/3569357509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff304150180 0x7ff304157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.709+0000 7ff302d9d700 1 -- 172.21.15.154:0/3569357509 >> v1:172.21.15.154:6789/0 conn(0x7ff304150550 legacy=0x7ff3040c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.709+0000 7ff302d9d700 1 -- 172.21.15.154:0/3569357509 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040c7bc0 con 0x7ff3040c7410 2023-10-10T21:18:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.709+0000 7ff30259c700 1 --2- 172.21.15.154:0/3569357509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff304150180 0x7ff304157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.709+0000 7ff302d9d700 1 --2- 172.21.15.154:0/3569357509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3040c7410 0x7ff304069f50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009e60 tx=0x7ff2fc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c91ca711cbe6155 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30159a700 1 -- 172.21.15.154:0/3569357509 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00e070 con 0x7ff3040c7410 2023-10-10T21:18:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30159a700 1 -- 172.21.15.154:0/3569357509 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc00b7a0 con 0x7ff3040c7410 2023-10-10T21:18:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30159a700 1 -- 172.21.15.154:0/3569357509 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8001470 con 0x7ff3040c7410 2023-10-10T21:18:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30359e700 1 -- 172.21.15.154:0/3569357509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3040c7410 msgr2=0x7ff304069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30359e700 1 --2- 172.21.15.154:0/3569357509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3040c7410 0x7ff304069f50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009e60 tx=0x7ff2fc009780 comp rx=0 tx=0).stop 2023-10-10T21:18:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30359e700 1 -- 172.21.15.154:0/3569357509 shutdown_connections 2023-10-10T21:18:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30359e700 1 --2- 172.21.15.154:0/3569357509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3040c7410 0x7ff304069f50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30359e700 1 --2- 172.21.15.154:0/3569357509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff304150180 0x7ff304157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30359e700 1 -- 172.21.15.154:0/3569357509 >> 172.21.15.154:0/3569357509 conn(0x7ff3040cc1f0 msgr2=0x7ff3040cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30359e700 1 -- 172.21.15.154:0/3569357509 shutdown_connections 2023-10-10T21:18:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.710+0000 7ff30359e700 1 -- 172.21.15.154:0/3569357509 wait complete. 2023-10-10T21:18:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.712+0000 7ff30359e700 1 Processor -- start 2023-10-10T21:18:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.712+0000 7ff30359e700 1 -- start start 2023-10-10T21:18:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff30359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3040c7410 0x7ff3040c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff30359e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff304150180 0x7ff304158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff30359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff304150550 0x7ff304158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff30359e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040af0c0 con 0x7ff304150180 2023-10-10T21:18:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff30359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040af3a0 con 0x7ff304150550 2023-10-10T21:18:55.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff30359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040af680 con 0x7ff3040c7410 2023-10-10T21:18:55.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff301d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff304150180 0x7ff304158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff301d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff304150180 0x7ff304158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42864/0 (socket says 172.21.15.154:42864) 2023-10-10T21:18:55.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff301d9b700 1 -- 172.21.15.154:0/2851791629 learned_addr learned my addr 172.21.15.154:0/2851791629 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:55.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff30259c700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3040c7410 0x7ff3040c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff302d9d700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff304150550 0x7ff304158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff301d9b700 1 -- 172.21.15.154:0/2851791629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3040c7410 msgr2=0x7ff3040c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff301d9b700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3040c7410 0x7ff3040c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff301d9b700 1 -- 172.21.15.154:0/2851791629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff304150550 msgr2=0x7ff304158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff301d9b700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff304150550 0x7ff304158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.713+0000 7ff301d9b700 1 -- 172.21.15.154:0/2851791629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f400a5d0 con 0x7ff304150180 2023-10-10T21:18:55.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.714+0000 7ff301d9b700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff304150180 0x7ff304158740 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800cb90 tx=0x7ff2f8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.714+0000 7ff2f27fc700 1 -- 172.21.15.154:0/2851791629 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8001d40 con 0x7ff304150180 2023-10-10T21:18:55.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.714+0000 7ff2f27fc700 1 -- 172.21.15.154:0/2851791629 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f8007360 con 0x7ff304150180 2023-10-10T21:18:55.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.714+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc009a20 con 0x7ff304150180 2023-10-10T21:18:55.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.714+0000 7ff2f27fc700 1 -- 172.21.15.154:0/2851791629 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8004830 con 0x7ff304150180 2023-10-10T21:18:55.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.714+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3040afc40 con 0x7ff304150180 2023-10-10T21:18:55.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.715+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30404c3c0 con 0x7ff304150180 2023-10-10T21:18:55.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.716+0000 7ff2f27fc700 1 -- 172.21.15.154:0/2851791629 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2f8004ba0 con 0x7ff304150180 2023-10-10T21:18:55.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.717+0000 7ff2f27fc700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff2e4066f30 0x7ff2e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:55.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.717+0000 7ff2f27fc700 1 -- 172.21.15.154:0/2851791629 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ff2f8083f70 con 0x7ff304150180 2023-10-10T21:18:55.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.717+0000 7ff30259c700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff2e4066f30 0x7ff2e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:55.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.718+0000 7ff30259c700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff2e4066f30 0x7ff2e40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400af50 tx=0x7ff2f4008040 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:55.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.721+0000 7ff2f27fc700 1 -- 172.21.15.154:0/2851791629 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2f80510d0 con 0x7ff304150180 2023-10-10T21:18:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.958+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff30406ada0 con 0x7ff304150180 2023-10-10T21:18:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.958+0000 7ff2f27fc700 1 -- 172.21.15.154:0/2851791629 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff2f8018020 con 0x7ff304150180 2023-10-10T21:18:55.960 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:18:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff2e4066f30 msgr2=0x7ff2e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff2e4066f30 0x7ff2e40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400af50 tx=0x7ff2f4008040 comp rx=0 tx=0).stop 2023-10-10T21:18:55.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff304150180 msgr2=0x7ff304158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:55.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff304150180 0x7ff304158740 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800cb90 tx=0x7ff2f8001ab0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 shutdown_connections 2023-10-10T21:18:55.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff2e4066f30 0x7ff2e40693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff304150550 0x7ff304158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3040c7410 0x7ff3040c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 --2- 172.21.15.154:0/2851791629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff304150180 0x7ff304158740 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 >> 172.21.15.154:0/2851791629 conn(0x7ff3040cc1f0 msgr2=0x7ff304069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 shutdown_connections 2023-10-10T21:18:55.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:55.961+0000 7ff30359e700 1 -- 172.21.15.154:0/2851791629 wait complete. 2023-10-10T21:18:55.979 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T21:18:55.980 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:18:55.980 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T21:18:55.980 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T21:18:55.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T21:18:55.981 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T21:18:55.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T21:18:55.982 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:18:55.982 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:18:55.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:55.983 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T21:18:56.022 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:18:56.022 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:18:56.023 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:18:56.023 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:56.023 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:18:56.024 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:56.024 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:18:56.024 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:56.025 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T21:18:56.025 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:18:56.025 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:56.025 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T21:18:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:18:56.026 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:18:56.026 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:56.026 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:18:56.027 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 41278sec preferred_lft 41278sec 2023-10-10T21:18:56.027 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T21:18:56.027 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:56.027 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:18:56.027 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:18:56.028 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T21:18:56.028 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:56.028 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T21:18:56.028 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:56.028 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:18:56.029 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T21:18:56.029 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T21:18:56.029 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:56.029 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:18:56.029 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T21:18:56.030 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T21:18:56.030 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:18:56.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:56.031 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:18:56.121 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T21:18:56.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:56.125 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T21:18:56.163 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T21:18:56.164 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:18:56.164 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:18:56.164 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:18:56.164 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:18:56.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:56.166 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:18:56.167 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:18:56.167 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:18:56.168 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:18:56.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:18:56.169 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:18:56.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:56.363 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:18:56.400 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T21:18:56.401 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T21:18:56.402 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:18:56.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:56.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T21:18:56.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:18:56.504 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T21:18:56.541 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:18:56.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:18:56.541 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:18:56.617 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:18:56.618 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:18:56.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:18:56.747 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:18:56.748 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:18:56.748 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:18:56.764 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:18:56.765 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:18:56.765 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:18:56.765 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:18:56.765 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:18:56.786 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:18:56.787 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:18:56.787 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:18:56.787 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:18:56.787 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:18:56.788 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:18:56.788 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:18:56.788 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:18:56.790 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:18:56.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:18:56.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:18:56.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T21:18:57.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.038+0000 7f4925d9d700 1 Processor -- start 2023-10-10T21:18:57.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.038+0000 7f4925d9d700 1 -- start start 2023-10-10T21:18:57.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.039+0000 7f4925d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49201597f0 0x7f49200b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.039+0000 7f4925d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f492015d230 0x7f492015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.039+0000 7f4925d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492015dbb0 con 0x7f4920159420 2023-10-10T21:18:57.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.039+0000 7f4925d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49200b11d0 con 0x7f49201597f0 2023-10-10T21:18:57.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.039+0000 7f4925d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49200b14b0 con 0x7f492015d230 2023-10-10T21:18:57.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f491ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49201597f0 0x7f49200b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f492559c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f492015d230 0x7f492015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f491ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49201597f0 0x7f49200b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:36656/0 (socket says 172.21.15.154:36656) 2023-10-10T21:18:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f4924d9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4920159420 0x7f49200b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44114/0 (socket says 172.21.15.154:44114) 2023-10-10T21:18:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f491ffff700 1 -- 172.21.15.154:0/1242475908 learned_addr learned my addr 172.21.15.154:0/1242475908 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f491ffff700 1 -- 172.21.15.154:0/1242475908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f492015d230 msgr2=0x7f492015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f491ffff700 1 --2- 172.21.15.154:0/1242475908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f492015d230 0x7f492015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f491ffff700 1 -- 172.21.15.154:0/1242475908 >> v1:172.21.15.179:6789/0 conn(0x7f4920159420 legacy=0x7f49200b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f491ffff700 1 -- 172.21.15.154:0/1242475908 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200b1790 con 0x7f49201597f0 2023-10-10T21:18:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.040+0000 7f491f7fe700 1 -- 172.21.15.154:0/1242475908 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581734602 0 0) 0x7f492015dbb0 con 0x7f4920159420 2023-10-10T21:18:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f491ffff700 1 --2- 172.21.15.154:0/1242475908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49201597f0 0x7f49200b2270 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f490c0099b0 tx=0x7f490c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba7f0aa7eb2fd90d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f491f7fe700 1 -- 172.21.15.154:0/1242475908 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c009ea0 con 0x7f49201597f0 2023-10-10T21:18:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f491f7fe700 1 -- 172.21.15.154:0/1242475908 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c00b860 con 0x7f49201597f0 2023-10-10T21:18:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f491f7fe700 1 -- 172.21.15.154:0/1242475908 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c00bc00 con 0x7f49201597f0 2023-10-10T21:18:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f4925d9d700 1 -- 172.21.15.154:0/1242475908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49201597f0 msgr2=0x7f49200b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f4925d9d700 1 --2- 172.21.15.154:0/1242475908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49201597f0 0x7f49200b2270 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f490c0099b0 tx=0x7f490c009250 comp rx=0 tx=0).stop 2023-10-10T21:18:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f4925d9d700 1 -- 172.21.15.154:0/1242475908 shutdown_connections 2023-10-10T21:18:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f4925d9d700 1 --2- 172.21.15.154:0/1242475908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f492015d230 0x7f492015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f4925d9d700 1 --2- 172.21.15.154:0/1242475908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49201597f0 0x7f49200b2270 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.041+0000 7f4925d9d700 1 -- 172.21.15.154:0/1242475908 >> 172.21.15.154:0/1242475908 conn(0x7f49200d0660 msgr2=0x7f49200d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.042+0000 7f4925d9d700 1 -- 172.21.15.154:0/1242475908 shutdown_connections 2023-10-10T21:18:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.042+0000 7f4925d9d700 1 -- 172.21.15.154:0/1242475908 wait complete. 2023-10-10T21:18:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.043+0000 7f4925d9d700 1 Processor -- start 2023-10-10T21:18:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.043+0000 7f4925d9d700 1 -- start start 2023-10-10T21:18:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.044+0000 7f4925d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4920159420 0x7f49201575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.044+0000 7f4925d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49201597f0 0x7f492015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.044+0000 7f4925d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f492015d230 0x7f4920153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.044+0000 7f4925d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49200c5530 con 0x7f4920159420 2023-10-10T21:18:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.044+0000 7f4925d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492015cba0 con 0x7f492015d230 2023-10-10T21:18:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.044+0000 7f4925d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492015c300 con 0x7f49201597f0 2023-10-10T21:18:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.044+0000 7f4924d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4920159420 0x7f49201575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.044+0000 7f4924d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4920159420 0x7f49201575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38864/0 (socket says 172.21.15.154:38864) 2023-10-10T21:18:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.044+0000 7f4924d9b700 1 -- 172.21.15.154:0/1846262784 learned_addr learned my addr 172.21.15.154:0/1846262784 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f492559c700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f492015d230 0x7f4920153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f491ffff700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49201597f0 0x7f492015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f4924d9b700 1 -- 172.21.15.154:0/1846262784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49201597f0 msgr2=0x7f492015b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f4924d9b700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49201597f0 0x7f492015b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f4924d9b700 1 -- 172.21.15.154:0/1846262784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f492015d230 msgr2=0x7f4920153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f4924d9b700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f492015d230 0x7f4920153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f4924d9b700 1 -- 172.21.15.154:0/1846262784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c0094f0 con 0x7f4920159420 2023-10-10T21:18:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f4924d9b700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4920159420 0x7f49201575a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f49140011e0 tx=0x7f4914007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f491cff9700 1 -- 172.21.15.154:0/1846262784 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914005a70 con 0x7f4920159420 2023-10-10T21:18:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f491cff9700 1 -- 172.21.15.154:0/1846262784 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4914005bd0 con 0x7f4920159420 2023-10-10T21:18:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f491cff9700 1 -- 172.21.15.154:0/1846262784 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140070d0 con 0x7f4920159420 2023-10-10T21:18:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492015c5e0 con 0x7f4920159420 2023-10-10T21:18:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.045+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4920159e50 con 0x7f4920159420 2023-10-10T21:18:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.046+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492004c3c0 con 0x7f4920159420 2023-10-10T21:18:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.047+0000 7f491cff9700 1 -- 172.21.15.154:0/1846262784 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4914007480 con 0x7f4920159420 2023-10-10T21:18:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.048+0000 7f491cff9700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4904066f30 0x7f49040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.048+0000 7f491cff9700 1 -- 172.21.15.154:0/1846262784 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4914083c10 con 0x7f4920159420 2023-10-10T21:18:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.049+0000 7f491ffff700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4904066f30 0x7f49040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.049+0000 7f491ffff700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4904066f30 0x7f49040693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f490c0099b0 tx=0x7f490c017000 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:57.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.053+0000 7f491cff9700 1 -- 172.21.15.154:0/1846262784 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4914050c50 con 0x7f4920159420 2023-10-10T21:18:57.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.274+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f49200c5670 con 0x7f4904066f30 2023-10-10T21:18:57.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.276+0000 7f491cff9700 1 -- 172.21.15.154:0/1846262784 <== mgr.7005 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f490c00b9d0 con 0x7f4904066f30 2023-10-10T21:18:57.277 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:18:57.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:18:57.278 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T21:18:57.278 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:18:57.278 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:18:57.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4904066f30 msgr2=0x7f49040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4904066f30 0x7f49040693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f490c0099b0 tx=0x7f490c017000 comp rx=0 tx=0).stop 2023-10-10T21:18:57.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4920159420 msgr2=0x7f49201575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4920159420 0x7f49201575a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f49140011e0 tx=0x7f4914007e10 comp rx=0 tx=0).stop 2023-10-10T21:18:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 shutdown_connections 2023-10-10T21:18:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f4904066f30 0x7f49040693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f492015d230 0x7f4920153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4920159420 0x7f49201575a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 --2- 172.21.15.154:0/1846262784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49201597f0 0x7f492015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.278+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 >> 172.21.15.154:0/1846262784 conn(0x7f49200d0660 msgr2=0x7f4920156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:57.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.279+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 shutdown_connections 2023-10-10T21:18:57.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.279+0000 7f4925d9d700 1 -- 172.21.15.154:0/1846262784 wait complete. 2023-10-10T21:18:57.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T21:18:57.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.482+0000 7fe754bff700 1 Processor -- start 2023-10-10T21:18:57.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.482+0000 7fe754bff700 1 -- start start 2023-10-10T21:18:57.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.483+0000 7fe754bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750155eb0 0x7fe75006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe754bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe750069e80 0x7fe7500ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe754bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75006eb90 con 0x7fe7500c70b0 2023-10-10T21:18:57.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe754bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75006ee70 con 0x7fe750069e80 2023-10-10T21:18:57.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe754bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75006f150 con 0x7fe750155eb0 2023-10-10T21:18:57.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe750069e80 0x7fe7500ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74dd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe7500c70b0 0x7fe750069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56238/0 (socket says 172.21.15.154:56238) 2023-10-10T21:18:57.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74dd9b700 1 -- 172.21.15.154:0/2371934885 learned_addr learned my addr 172.21.15.154:0/2371934885 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:57.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74e59c700 1 --2- 172.21.15.154:0/2371934885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750155eb0 0x7fe75006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74ed9d700 1 -- 172.21.15.154:0/2371934885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750155eb0 msgr2=0x7fe75006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:57.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74ed9d700 1 --2- 172.21.15.154:0/2371934885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750155eb0 0x7fe75006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74ed9d700 1 -- 172.21.15.154:0/2371934885 >> v1:172.21.15.154:6789/0 conn(0x7fe7500c70b0 legacy=0x7fe750069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74ed9d700 1 -- 172.21.15.154:0/2371934885 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75006f430 con 0x7fe750069e80 2023-10-10T21:18:57.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74d59a700 1 -- 172.21.15.154:0/2371934885 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81300274 0 0) 0x7fe75006eb90 con 0x7fe7500c70b0 2023-10-10T21:18:57.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.484+0000 7fe74e59c700 1 --2- 172.21.15.154:0/2371934885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750155eb0 0x7fe75006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:18:57.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe74ed9d700 1 --2- 172.21.15.154:0/2371934885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe750069e80 0x7fe7500ca4c0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe748009e60 tx=0x7fe748009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1284744522070ce server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:57.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe74d59a700 1 -- 172.21.15.154:0/2371934885 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800e070 con 0x7fe750069e80 2023-10-10T21:18:57.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe74d59a700 1 -- 172.21.15.154:0/2371934885 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74800bc30 con 0x7fe750069e80 2023-10-10T21:18:57.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe74d59a700 1 -- 172.21.15.154:0/2371934885 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748012430 con 0x7fe750069e80 2023-10-10T21:18:57.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe754bff700 1 -- 172.21.15.154:0/2371934885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe750069e80 msgr2=0x7fe7500ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe754bff700 1 --2- 172.21.15.154:0/2371934885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe750069e80 0x7fe7500ca4c0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe748009e60 tx=0x7fe748009780 comp rx=0 tx=0).stop 2023-10-10T21:18:57.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe754bff700 1 -- 172.21.15.154:0/2371934885 shutdown_connections 2023-10-10T21:18:57.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe754bff700 1 --2- 172.21.15.154:0/2371934885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe750069e80 0x7fe7500ca4c0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe754bff700 1 --2- 172.21.15.154:0/2371934885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750155eb0 0x7fe75006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe754bff700 1 -- 172.21.15.154:0/2371934885 >> 172.21.15.154:0/2371934885 conn(0x7fe750068e10 msgr2=0x7fe7500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:57.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe754bff700 1 -- 172.21.15.154:0/2371934885 shutdown_connections 2023-10-10T21:18:57.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.485+0000 7fe754bff700 1 -- 172.21.15.154:0/2371934885 wait complete. 2023-10-10T21:18:57.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.487+0000 7fe754bff700 1 Processor -- start 2023-10-10T21:18:57.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.487+0000 7fe754bff700 1 -- start start 2023-10-10T21:18:57.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe754bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750069e80 0x7fe7500afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe754bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7500c70b0 0x7fe750148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe754bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe750155eb0 0x7fe750149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe754bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500b0350 con 0x7fe7500c70b0 2023-10-10T21:18:57.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe754bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500b0630 con 0x7fe750155eb0 2023-10-10T21:18:57.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe754bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500b0910 con 0x7fe750069e80 2023-10-10T21:18:57.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe74dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7500c70b0 0x7fe750148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe74dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7500c70b0 0x7fe750148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38882/0 (socket says 172.21.15.154:38882) 2023-10-10T21:18:57.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe74dd9b700 1 -- 172.21.15.154:0/3590558848 learned_addr learned my addr 172.21.15.154:0/3590558848 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:57.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe74e59c700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750069e80 0x7fe7500afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe74ed9d700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe750155eb0 0x7fe750149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe74dd9b700 1 -- 172.21.15.154:0/3590558848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750069e80 msgr2=0x7fe7500afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.488+0000 7fe74dd9b700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750069e80 0x7fe7500afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.489+0000 7fe74dd9b700 1 -- 172.21.15.154:0/3590558848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe750155eb0 msgr2=0x7fe750149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:57.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.489+0000 7fe74dd9b700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe750155eb0 0x7fe750149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:57.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.489+0000 7fe74dd9b700 1 -- 172.21.15.154:0/3590558848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe748009a20 con 0x7fe7500c70b0 2023-10-10T21:18:57.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.489+0000 7fe74dd9b700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7500c70b0 0x7fe750148540 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c7e0 tx=0x7fe744007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:57.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.489+0000 7fe73e7fc700 1 -- 172.21.15.154:0/3590558848 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744005b30 con 0x7fe7500c70b0 2023-10-10T21:18:57.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.489+0000 7fe73e7fc700 1 -- 172.21.15.154:0/3590558848 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe744005c90 con 0x7fe7500c70b0 2023-10-10T21:18:57.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.489+0000 7fe73e7fc700 1 -- 172.21.15.154:0/3590558848 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744007300 con 0x7fe7500c70b0 2023-10-10T21:18:57.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.489+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7500b0bf0 con 0x7fe7500c70b0 2023-10-10T21:18:57.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.489+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe750148a80 con 0x7fe7500c70b0 2023-10-10T21:18:57.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.490+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75004c3c0 con 0x7fe7500c70b0 2023-10-10T21:18:57.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.491+0000 7fe73e7fc700 1 -- 172.21.15.154:0/3590558848 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe74401b3b0 con 0x7fe7500c70b0 2023-10-10T21:18:57.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.492+0000 7fe73e7fc700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe730066f60 0x7fe730069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:57.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.492+0000 7fe73e7fc700 1 -- 172.21.15.154:0/3590558848 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe744083c50 con 0x7fe7500c70b0 2023-10-10T21:18:57.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.492+0000 7fe74e59c700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe730066f60 0x7fe730069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:57.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.493+0000 7fe74e59c700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe730066f60 0x7fe730069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe740006fd0 tx=0x7fe740008040 comp rx=0 tx=0).ready entity=mgr.7005 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:57.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.496+0000 7fe73e7fc700 1 -- 172.21.15.154:0/3590558848 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe744050c90 con 0x7fe7500c70b0 2023-10-10T21:18:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:57.738+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe750156280 con 0x7fe7500c70b0 2023-10-10T21:18:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.206+0000 7fe73e7fc700 1 -- 172.21.15.154:0/3590558848 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 45) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fe744051060 con 0x7fe7500c70b0 2023-10-10T21:18:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.208+0000 7fe73e7fc700 1 -- 172.21.15.154:0/3590558848 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v45) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe744054720 con 0x7fe7500c70b0 2023-10-10T21:18:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe730066f60 msgr2=0x7fe730069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe730066f60 0x7fe730069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe740006fd0 tx=0x7fe740008040 comp rx=0 tx=0).stop 2023-10-10T21:18:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7500c70b0 msgr2=0x7fe750148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7500c70b0 0x7fe750148540 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c7e0 tx=0x7fe744007df0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 shutdown_connections 2023-10-10T21:18:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fe730066f60 0x7fe730069410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe750155eb0 0x7fe750149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe750069e80 0x7fe7500afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 --2- 172.21.15.154:0/3590558848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7500c70b0 0x7fe750148540 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 >> 172.21.15.154:0/3590558848 conn(0x7fe750068e10 msgr2=0x7fe7500ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:58.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 shutdown_connections 2023-10-10T21:18:58.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.211+0000 7fe754bff700 1 -- 172.21.15.154:0/3590558848 wait complete. 2023-10-10T21:18:58.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T21:18:58.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.425+0000 7f7ca7fff700 1 Processor -- start 2023-10-10T21:18:58.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.425+0000 7f7ca7fff700 1 -- start start 2023-10-10T21:18:58.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.427+0000 7f7ca7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80cb1a0 0x7f7ca815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.427+0000 7f7ca7fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca806ebd0 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.427+0000 7f7ca7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca815ad20 con 0x7f7ca815a8a0 2023-10-10T21:18:58.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.427+0000 7f7ca7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca815b2e0 con 0x7f7ca80cb1a0 2023-10-10T21:18:58.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.427+0000 7f7ca77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7ca80ae0d0 0x7f7ca80c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56260/0 (socket says 172.21.15.154:56260) 2023-10-10T21:18:58.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.427+0000 7f7ca77fe700 1 -- 172.21.15.154:0/1245036586 learned_addr learned my addr 172.21.15.154:0/1245036586 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:58.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.427+0000 7f7ca6ffd700 1 --2- 172.21.15.154:0/1245036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80cb1a0 0x7f7ca815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.427+0000 7f7ca5ffb700 1 -- 172.21.15.154:0/1245036586 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192000902 0 0) 0x7f7ca806ebd0 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.427+0000 7f7ca5ffb700 1 -- 172.21.15.154:0/1245036586 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c90003570 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.428+0000 7f7ca5ffb700 1 -- 172.21.15.154:0/1245036586 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905451716 0 0) 0x7f7ca815ad20 con 0x7f7ca815a8a0 2023-10-10T21:18:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.428+0000 7f7ca5ffb700 1 -- 172.21.15.154:0/1245036586 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca806ebd0 con 0x7f7ca815a8a0 2023-10-10T21:18:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.428+0000 7f7ca6ffd700 1 -- 172.21.15.154:0/1245036586 >> v1:172.21.15.179:6789/0 conn(0x7f7ca815a8a0 legacy=0x7f7ca806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.428+0000 7f7ca6ffd700 1 -- 172.21.15.154:0/1245036586 >> v1:172.21.15.154:6789/0 conn(0x7f7ca80ae0d0 legacy=0x7f7ca80c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.428+0000 7f7ca6ffd700 1 -- 172.21.15.154:0/1245036586 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca815b000 con 0x7f7ca80cb1a0 2023-10-10T21:18:58.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.428+0000 7f7ca6ffd700 1 --2- 172.21.15.154:0/1245036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80cb1a0 0x7f7ca815a360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009910 tx=0x7f7c980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ab9e6045a7127de server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:58.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.428+0000 7f7ca5ffb700 1 -- 172.21.15.154:0/1245036586 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800b690 con 0x7f7ca80cb1a0 2023-10-10T21:18:58.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.428+0000 7f7ca5ffb700 1 -- 172.21.15.154:0/1245036586 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9800b7f0 con 0x7f7ca80cb1a0 2023-10-10T21:18:58.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.428+0000 7f7ca5ffb700 1 -- 172.21.15.154:0/1245036586 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800bb90 con 0x7f7ca80cb1a0 2023-10-10T21:18:58.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.429+0000 7f7ca7fff700 1 -- 172.21.15.154:0/1245036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80cb1a0 msgr2=0x7f7ca815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.429+0000 7f7ca7fff700 1 --2- 172.21.15.154:0/1245036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80cb1a0 0x7f7ca815a360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009910 tx=0x7f7c980091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.429+0000 7f7ca7fff700 1 -- 172.21.15.154:0/1245036586 shutdown_connections 2023-10-10T21:18:58.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.429+0000 7f7ca7fff700 1 --2- 172.21.15.154:0/1245036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80cb1a0 0x7f7ca815a360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.429+0000 7f7ca7fff700 1 -- 172.21.15.154:0/1245036586 >> 172.21.15.154:0/1245036586 conn(0x7f7ca80cc1e0 msgr2=0x7f7ca80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.429+0000 7f7ca7fff700 1 -- 172.21.15.154:0/1245036586 shutdown_connections 2023-10-10T21:18:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.429+0000 7f7ca7fff700 1 -- 172.21.15.154:0/1245036586 wait complete. 2023-10-10T21:18:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.430+0000 7f7ca7fff700 1 Processor -- start 2023-10-10T21:18:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.430+0000 7f7ca7fff700 1 -- start start 2023-10-10T21:18:58.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.431+0000 7f7ca7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca80ae0d0 0x7f7ca80c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.431+0000 7f7ca7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ca80cb1a0 0x7f7ca816a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.431+0000 7f7ca7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80c3290 0x7f7ca814ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.431+0000 7f7ca7fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80c4b40 con 0x7f7ca80cb1a0 2023-10-10T21:18:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.431+0000 7f7ca7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca8150b70 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.431+0000 7f7ca7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80af4d0 con 0x7f7ca80c3290 2023-10-10T21:18:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ca80cb1a0 0x7f7ca816a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca6ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca80ae0d0 0x7f7ca80c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ca80cb1a0 0x7f7ca816a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38902/0 (socket says 172.21.15.154:38902) 2023-10-10T21:18:58.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca67fc700 1 -- 172.21.15.154:0/328738901 learned_addr learned my addr 172.21.15.154:0/328738901 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:58.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca77fe700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80c3290 0x7f7ca814ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:58.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca6ffd700 1 -- 172.21.15.154:0/328738901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80c3290 msgr2=0x7f7ca814ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca6ffd700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80c3290 0x7f7ca814ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca6ffd700 1 -- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ca80cb1a0 msgr2=0x7f7ca816a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca6ffd700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ca80cb1a0 0x7f7ca816a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca6ffd700 1 -- 172.21.15.154:0/328738901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98009420 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca67fc700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ca80cb1a0 0x7f7ca816a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:58.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.432+0000 7f7ca6ffd700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca80ae0d0 0x7f7ca80c4600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7c98013000 tx=0x7f7c98017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:58.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.433+0000 7f7c8effd700 1 -- 172.21.15.154:0/328738901 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9801f070 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.433+0000 7f7c8effd700 1 -- 172.21.15.154:0/328738901 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c98002f70 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.433+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca816ac40 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.433+0000 7f7c8effd700 1 -- 172.21.15.154:0/328738901 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800bb90 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.433+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca80c3ac0 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.434+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca806c450 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.435+0000 7f7c8effd700 1 -- 172.21.15.154:0/328738901 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 45) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7c98011420 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.436+0000 7f7c8effd700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c94066f80 0x7f7c94069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.436+0000 7f7c8effd700 1 -- 172.21.15.154:0/328738901 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f7c98085800 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.436+0000 7f7ca67fc700 1 -- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c94066f80 msgr2=0x7f7c94069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:58.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.436+0000 7f7ca67fc700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c94066f80 0x7f7c94069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:58.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.440+0000 7f7c8effd700 1 -- 172.21.15.154:0/328738901 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c98052840 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.637+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f7ca806e890 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.637+0000 7f7ca67fc700 1 -- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c94066f80 msgr2=0x7f7c94069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:58.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.637+0000 7f7ca67fc700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c94066f80 0x7f7c94069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:58.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.645+0000 7f7c8effd700 1 -- 172.21.15.154:0/328738901 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7c98055e60 con 0x7f7ca80ae0d0 2023-10-10T21:18:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c94066f80 msgr2=0x7f7c94069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c94066f80 0x7f7c94069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca80ae0d0 msgr2=0x7f7ca80c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca80ae0d0 0x7f7ca80c4600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7c98013000 tx=0x7f7c98017000 comp rx=0 tx=0).stop 2023-10-10T21:18:58.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 shutdown_connections 2023-10-10T21:18:58.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ca80c3290 0x7f7ca814ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c94066f80 0x7f7c94069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca80ae0d0 0x7f7ca80c4600 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 --2- 172.21.15.154:0/328738901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ca80cb1a0 0x7f7ca816a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 >> 172.21.15.154:0/328738901 conn(0x7f7ca80cc1e0 msgr2=0x7f7ca81525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:58.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 shutdown_connections 2023-10-10T21:18:58.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.647+0000 7f7ca7fff700 1 -- 172.21.15.154:0/328738901 wait complete. 2023-10-10T21:18:58.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T21:18:58.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.856+0000 7fb707fff700 1 Processor -- start 2023-10-10T21:18:58.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.856+0000 7fb707fff700 1 -- start start 2023-10-10T21:18:58.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.857+0000 7fb707fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70815d990 0x7fb708164620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.857+0000 7fb707fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb708150b50 con 0x7fb7080cc9d0 2023-10-10T21:18:58.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.857+0000 7fb707fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7080cede0 con 0x7fb7080cc600 2023-10-10T21:18:58.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.857+0000 7fb707fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080b2260 con 0x7fb70815d990 2023-10-10T21:18:58.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.857+0000 7fb7067fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb7080cc9d0 0x7fb70815d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56270/0 (socket says 172.21.15.154:56270) 2023-10-10T21:18:58.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.857+0000 7fb7067fc700 1 -- 172.21.15.154:0/1641497514 learned_addr learned my addr 172.21.15.154:0/1641497514 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:58.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.857+0000 7fb7077fe700 1 --2- 172.21.15.154:0/1641497514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70815d990 0x7fb708164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:58.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.858+0000 7fb705ffb700 1 -- 172.21.15.154:0/1641497514 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512222044 0 0) 0x7fb708150b50 con 0x7fb7080cc9d0 2023-10-10T21:18:58.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.858+0000 7fb705ffb700 1 -- 172.21.15.154:0/1641497514 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f0003570 con 0x7fb7080cc9d0 2023-10-10T21:18:58.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.858+0000 7fb705ffb700 1 -- 172.21.15.154:0/1641497514 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639925381 0 0) 0x7fb7080cede0 con 0x7fb7080cc600 2023-10-10T21:18:58.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.858+0000 7fb705ffb700 1 -- 172.21.15.154:0/1641497514 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb708150b50 con 0x7fb7080cc600 2023-10-10T21:18:58.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.858+0000 7fb7077fe700 1 -- 172.21.15.154:0/1641497514 >> v1:172.21.15.179:6789/0 conn(0x7fb7080cc600 legacy=0x7fb7080b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.858+0000 7fb7077fe700 1 -- 172.21.15.154:0/1641497514 >> v1:172.21.15.154:6789/0 conn(0x7fb7080cc9d0 legacy=0x7fb70815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.858+0000 7fb7077fe700 1 -- 172.21.15.154:0/1641497514 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7080b2540 con 0x7fb70815d990 2023-10-10T21:18:58.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.858+0000 7fb7077fe700 1 --2- 172.21.15.154:0/1641497514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70815d990 0x7fb708164620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb700009e90 tx=0x7fb700009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39ab4761514581f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:58.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb705ffb700 1 -- 172.21.15.154:0/1641497514 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000e070 con 0x7fb70815d990 2023-10-10T21:18:58.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb705ffb700 1 -- 172.21.15.154:0/1641497514 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000bb80 con 0x7fb70815d990 2023-10-10T21:18:58.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb705ffb700 1 -- 172.21.15.154:0/1641497514 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700012430 con 0x7fb70815d990 2023-10-10T21:18:58.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb707fff700 1 -- 172.21.15.154:0/1641497514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70815d990 msgr2=0x7fb708164620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb707fff700 1 --2- 172.21.15.154:0/1641497514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70815d990 0x7fb708164620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb700009e90 tx=0x7fb700009780 comp rx=0 tx=0).stop 2023-10-10T21:18:58.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb707fff700 1 -- 172.21.15.154:0/1641497514 shutdown_connections 2023-10-10T21:18:58.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb707fff700 1 --2- 172.21.15.154:0/1641497514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70815d990 0x7fb708164620 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb707fff700 1 -- 172.21.15.154:0/1641497514 >> 172.21.15.154:0/1641497514 conn(0x7fb7080d0630 msgr2=0x7fb7080d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:58.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb707fff700 1 -- 172.21.15.154:0/1641497514 shutdown_connections 2023-10-10T21:18:58.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.859+0000 7fb707fff700 1 -- 172.21.15.154:0/1641497514 wait complete. 2023-10-10T21:18:58.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.861+0000 7fb707fff700 1 Processor -- start 2023-10-10T21:18:58.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.861+0000 7fb707fff700 1 -- start start 2023-10-10T21:18:58.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb707fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7080cc600 0x7fb70815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb707fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7080cc9d0 0x7fb70816af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb707fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb70815d990 0x7fb708141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb707fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70814e810 con 0x7fb7080cc600 2023-10-10T21:18:58.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb707fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70816c200 con 0x7fb70815d990 2023-10-10T21:18:58.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb707fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70816b5f0 con 0x7fb7080cc9d0 2023-10-10T21:18:58.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb706ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7080cc600 0x7fb70815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:58.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb706ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7080cc600 0x7fb70815a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38904/0 (socket says 172.21.15.154:38904) 2023-10-10T21:18:58.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb706ffd700 1 -- 172.21.15.154:0/1463510332 learned_addr learned my addr 172.21.15.154:0/1463510332 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:58.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb7067fc700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7080cc9d0 0x7fb70816af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:58.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb7077fe700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb70815d990 0x7fb708141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:58.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb706ffd700 1 -- 172.21.15.154:0/1463510332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7080cc9d0 msgr2=0x7fb70816af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.862+0000 7fb706ffd700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7080cc9d0 0x7fb70816af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.863+0000 7fb706ffd700 1 -- 172.21.15.154:0/1463510332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb70815d990 msgr2=0x7fb708141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:58.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.863+0000 7fb706ffd700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb70815d990 0x7fb708141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:58.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.863+0000 7fb706ffd700 1 -- 172.21.15.154:0/1463510332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700009a20 con 0x7fb7080cc600 2023-10-10T21:18:58.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.863+0000 7fb706ffd700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7080cc600 0x7fb70815a0c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c7c0 tx=0x7fb6f8007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:58.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.863+0000 7fb6eeffd700 1 -- 172.21.15.154:0/1463510332 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80015f0 con 0x7fb7080cc600 2023-10-10T21:18:58.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.863+0000 7fb6eeffd700 1 -- 172.21.15.154:0/1463510332 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f8001790 con 0x7fb7080cc600 2023-10-10T21:18:58.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.863+0000 7fb707fff700 1 -- 172.21.15.154:0/1463510332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70816b8d0 con 0x7fb7080cc600 2023-10-10T21:18:58.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.863+0000 7fb6eeffd700 1 -- 172.21.15.154:0/1463510332 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8001b50 con 0x7fb7080cc600 2023-10-10T21:18:58.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.863+0000 7fb707fff700 1 -- 172.21.15.154:0/1463510332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70816be90 con 0x7fb7080cc600 2023-10-10T21:18:58.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.864+0000 7fb6ecff9700 1 -- 172.21.15.154:0/1463510332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7080889d0 con 0x7fb7080cc600 2023-10-10T21:18:58.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.865+0000 7fb6eeffd700 1 -- 172.21.15.154:0/1463510332 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 45) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb6f801b400 con 0x7fb7080cc600 2023-10-10T21:18:58.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.866+0000 7fb6eeffd700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f4066f80 0x7fb6f4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:58.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.866+0000 7fb6eeffd700 1 -- 172.21.15.154:0/1463510332 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fb6f8084630 con 0x7fb7080cc600 2023-10-10T21:18:58.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.866+0000 7fb7067fc700 1 -- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f4066f80 msgr2=0x7fb6f4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:58.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.866+0000 7fb7067fc700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f4066f80 0x7fb6f4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:58.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:58.871+0000 7fb6eeffd700 1 -- 172.21.15.154:0/1463510332 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6f8051670 con 0x7fb7080cc600 2023-10-10T21:18:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.066+0000 7fb6ecff9700 1 -- 172.21.15.154:0/1463510332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fb7080b2820 con 0x7fb7080cc600 2023-10-10T21:18:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.067+0000 7fb7067fc700 1 -- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f4066f80 msgr2=0x7fb6f4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:59.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.067+0000 7fb7067fc700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f4066f80 0x7fb6f4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:59.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.070+0000 7fb6eeffd700 1 -- 172.21.15.154:0/1463510332 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb6f8054c90 con 0x7fb7080cc600 2023-10-10T21:18:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 -- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f4066f80 msgr2=0x7fb6f4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:18:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f4066f80 0x7fb6f4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 -- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7080cc600 msgr2=0x7fb70815a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7080cc600 0x7fb70815a0c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c7c0 tx=0x7fb6f8007dd0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 -- 172.21.15.154:0/1463510332 shutdown_connections 2023-10-10T21:18:59.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fb6f4066f80 0x7fb6f4069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb70815d990 0x7fb708141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7080cc600 0x7fb70815a0c0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 --2- 172.21.15.154:0/1463510332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7080cc9d0 0x7fb70816af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 -- 172.21.15.154:0/1463510332 >> 172.21.15.154:0/1463510332 conn(0x7fb7080d0630 msgr2=0x7fb7080b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:59.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 -- 172.21.15.154:0/1463510332 shutdown_connections 2023-10-10T21:18:59.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.073+0000 7fb6ecff9700 1 -- 172.21.15.154:0/1463510332 wait complete. 2023-10-10T21:18:59.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-10-10T21:18:59.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.290+0000 7f6c4959d700 1 Processor -- start 2023-10-10T21:18:59.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.290+0000 7f6c4959d700 1 -- start start 2023-10-10T21:18:59.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.291+0000 7f6c4959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c441597d0 0x7f6c440afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:59.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.291+0000 7f6c4959d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c440ac0e0 0x7f6c4406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:59.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.291+0000 7f6c4959d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4406e510 con 0x7f6c4406eee0 2023-10-10T21:18:59.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.291+0000 7f6c4959d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4415e450 con 0x7f6c440ac0e0 2023-10-10T21:18:59.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.291+0000 7f6c4959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44069180 con 0x7f6c441597d0 2023-10-10T21:18:59.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c437fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c440ac0e0 0x7f6c4406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:59.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c43fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c441597d0 0x7f6c440afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:59.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c48d9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6c4406eee0 0x7f6c440a98d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44170/0 (socket says 172.21.15.154:44170) 2023-10-10T21:18:59.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c48d9c700 1 -- 172.21.15.154:0/1308868544 learned_addr learned my addr 172.21.15.154:0/1308868544 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:18:59.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c43fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c441597d0 0x7f6c440afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58618/0 (socket says 172.21.15.154:58618) 2023-10-10T21:18:59.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c437fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c440ac0e0 0x7f6c4406e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:36718/0 (socket says 172.21.15.154:36718) 2023-10-10T21:18:59.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c42ffd700 1 -- 172.21.15.154:0/1308868544 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972856961 0 0) 0x7f6c4406e510 con 0x7f6c4406eee0 2023-10-10T21:18:59.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c42ffd700 1 -- 172.21.15.154:0/1308868544 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c2c003570 con 0x7f6c4406eee0 2023-10-10T21:18:59.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c43fff700 1 -- 172.21.15.154:0/1308868544 >> v2:172.21.15.179:3300/0 conn(0x7f6c440ac0e0 msgr2=0x7f6c4406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:18:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c43fff700 1 --2- 172.21.15.154:0/1308868544 >> v2:172.21.15.179:3300/0 conn(0x7f6c440ac0e0 0x7f6c4406e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c43fff700 1 -- 172.21.15.154:0/1308868544 >> v1:172.21.15.179:6789/0 conn(0x7f6c4406eee0 legacy=0x7f6c440a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c43fff700 1 -- 172.21.15.154:0/1308868544 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4406dec0 con 0x7f6c441597d0 2023-10-10T21:18:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.292+0000 7f6c437fe700 1 --2- 172.21.15.154:0/1308868544 >> v2:172.21.15.179:3300/0 conn(0x7f6c440ac0e0 0x7f6c4406e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:18:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.293+0000 7f6c43fff700 1 --2- 172.21.15.154:0/1308868544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c441597d0 0x7f6c440afa40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c340098e0 tx=0x7f6c340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb9a7500648874fb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.293+0000 7f6c42ffd700 1 -- 172.21.15.154:0/1308868544 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34011630 con 0x7f6c441597d0 2023-10-10T21:18:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.293+0000 7f6c42ffd700 1 -- 172.21.15.154:0/1308868544 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c34011790 con 0x7f6c441597d0 2023-10-10T21:18:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.293+0000 7f6c42ffd700 1 -- 172.21.15.154:0/1308868544 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34011b30 con 0x7f6c441597d0 2023-10-10T21:18:59.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.293+0000 7f6c4959d700 1 -- 172.21.15.154:0/1308868544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c441597d0 msgr2=0x7f6c440afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:59.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.293+0000 7f6c4959d700 1 --2- 172.21.15.154:0/1308868544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c441597d0 0x7f6c440afa40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c340098e0 tx=0x7f6c340091a0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.294+0000 7f6c4959d700 1 -- 172.21.15.154:0/1308868544 shutdown_connections 2023-10-10T21:18:59.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.294+0000 7f6c4959d700 1 --2- 172.21.15.154:0/1308868544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c441597d0 0x7f6c440afa40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.294+0000 7f6c4959d700 1 --2- 172.21.15.154:0/1308868544 >> v2:172.21.15.179:3300/0 conn(0x7f6c440ac0e0 0x7f6c4406e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.294+0000 7f6c4959d700 1 -- 172.21.15.154:0/1308868544 >> 172.21.15.154:0/1308868544 conn(0x7f6c4406adf0 msgr2=0x7f6c440ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:18:59.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.294+0000 7f6c4959d700 1 -- 172.21.15.154:0/1308868544 shutdown_connections 2023-10-10T21:18:59.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.294+0000 7f6c4959d700 1 -- 172.21.15.154:0/1308868544 wait complete. 2023-10-10T21:18:59.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.295+0000 7f6c4959d700 1 Processor -- start 2023-10-10T21:18:59.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.295+0000 7f6c4959d700 1 -- start start 2023-10-10T21:18:59.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.296+0000 7f6c4959d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c4406eee0 0x7f6c441552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:59.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.296+0000 7f6c4959d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c441597d0 0x7f6c4415cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:59.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.296+0000 7f6c4959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4416aaf0 0x7f6c4415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.296+0000 7f6c4959d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4416cd00 con 0x7f6c441597d0 2023-10-10T21:18:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.296+0000 7f6c4959d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4415b650 con 0x7f6c4406eee0 2023-10-10T21:18:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.296+0000 7f6c4959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440c28f0 con 0x7f6c4416aaf0 2023-10-10T21:18:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.296+0000 7f6c437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c441597d0 0x7f6c4415cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:59.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.296+0000 7f6c43fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c4406eee0 0x7f6c441552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:59.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c441597d0 0x7f6c4415cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38920/0 (socket says 172.21.15.154:38920) 2023-10-10T21:18:59.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c437fe700 1 -- 172.21.15.154:0/3584297572 learned_addr learned my addr 172.21.15.154:0/3584297572 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:18:59.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c48d9c700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4416aaf0 0x7f6c4415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:18:59.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c437fe700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4416aaf0 msgr2=0x7f6c4415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:59.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c437fe700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4416aaf0 0x7f6c4415d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c437fe700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c4406eee0 msgr2=0x7f6c441552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:18:59.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c437fe700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c4406eee0 0x7f6c441552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:18:59.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c437fe700 1 -- 172.21.15.154:0/3584297572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38009420 con 0x7f6c441597d0 2023-10-10T21:18:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c437fe700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c441597d0 0x7f6c4415cf90 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800ec80 tx=0x7f6c380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:18:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800c920 con 0x7f6c441597d0 2023-10-10T21:18:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3800ca80 con 0x7f6c441597d0 2023-10-10T21:18:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800ce00 con 0x7f6c441597d0 2023-10-10T21:18:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.297+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c34009420 con 0x7f6c441597d0 2023-10-10T21:18:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.298+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4415b000 con 0x7f6c441597d0 2023-10-10T21:18:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.299+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c440cc8d0 con 0x7f6c441597d0 2023-10-10T21:18:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.300+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 45) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6c38013680 con 0x7f6c441597d0 2023-10-10T21:18:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.301+0000 7f6c2bfff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c30069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:18:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.301+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6c38084eb0 con 0x7f6c441597d0 2023-10-10T21:18:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.301+0000 7f6c43fff700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 msgr2=0x7f6c30069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.301+0000 7f6c43fff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c30069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:18:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.305+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c38051ef0 con 0x7f6c441597d0 2023-10-10T21:18:59.494 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:59.493+0000 7f83afa5e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:18:59.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.502+0000 7f6c43fff700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 msgr2=0x7f6c30069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:59.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.502+0000 7f6c43fff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c30069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:18:59.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.526+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c4404c3c0 con 0x7f6c30066f80 2023-10-10T21:18:59.538 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:59.537+0000 7f71830d9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:18:59.656 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:59.655+0000 7f83afa5e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:59.702 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:59.701+0000 7f71830d9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:18:59.743 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:59.742+0000 7f83afa5e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:18:59.785 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:18:59.784+0000 7f71830d9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:18:59.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.903+0000 7f6c43fff700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 msgr2=0x7f6c30069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:18:59.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:18:59.903+0000 7f6c43fff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c30069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:18:59.966 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:18:59.965+0000 7f83afa5e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:19:00.008 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:00.007+0000 7f71830d9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:19:00.145 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:00.144+0000 7f83afa5e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:19:00.187 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:00.186+0000 7f71830d9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:19:00.237 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:00.236+0000 7f83afa5e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:19:00.278 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:00.277+0000 7f71830d9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:19:00.399 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:00.398+0000 7f83afa5e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:19:00.439 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:00.438+0000 7f71830d9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:19:00.500 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:00.499+0000 7f83afa5e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:19:00.539 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:00.538+0000 7f71830d9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:19:00.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:00.704+0000 7f6c43fff700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 msgr2=0x7f6c30069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:19:00.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:00.704+0000 7f6c43fff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c30069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T21:19:00.987 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:00.985+0000 7f83afa5e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:19:01.021 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:01.020+0000 7f71830d9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:19:01.080 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:01.079+0000 7f83afa5e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:19:01.115 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:01.114+0000 7f71830d9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:19:01.170 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:01.168+0000 7f83afa5e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:19:01.204 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:01.203+0000 7f71830d9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:19:01.791 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:01.790+0000 7f83afa5e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:19:01.824 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:01.823+0000 7f71830d9180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:19:01.961 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:01.960+0000 7f83afa5e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:19:01.997 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:01.996+0000 7f71830d9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:19:02.055 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:02.053+0000 7f83afa5e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:19:02.091 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:02.090+0000 7f71830d9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:19:02.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:02.306+0000 7f6c43fff700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 msgr2=0x7f6c30069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:19:02.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:02.306+0000 7f6c43fff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c30069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T21:19:02.347 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:02.346+0000 7f83afa5e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:19:02.385 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:02.384+0000 7f71830d9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:19:02.444 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:02.442+0000 7f83afa5e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:19:02.481 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:02.480+0000 7f71830d9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:19:03.143 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:03.141+0000 7f83afa5e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:19:03.184 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:03.183+0000 7f71830d9180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:19:03.429 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:03.428+0000 7f83afa5e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:19:03.470 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:03.469+0000 7f71830d9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:19:03.522 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:03.521+0000 7f83afa5e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:19:03.562 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:03.560+0000 7f71830d9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:19:03.676 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:03.676+0000 7f83afa5e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:19:03.714 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:03.713+0000 7f71830d9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:19:03.782 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:03.780+0000 7f83afa5e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:19:03.817 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:03.817+0000 7f71830d9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:19:03.967 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:03.966+0000 7f83afa5e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:19:04.007 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.006+0000 7f71830d9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:19:04.059 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:04.058+0000 7f83afa5e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:19:04.099 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.098+0000 7f71830d9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:19:04.150 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:04.150+0000 7f83afa5e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:19:04.192 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.191+0000 7f71830d9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:19:04.243 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:19:04.242+0000 7f83afa5e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:19:04.285 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.284+0000 7f71830d9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:19:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:04.294+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 46) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f6c380522c0 con 0x7f6c441597d0 2023-10-10T21:19:04.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:04.295+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 msgr2=0x7f6c30069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:19:04.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:04.295+0000 7f6c2bfff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c30069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:04.426 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.425+0000 7f70f8437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:04.427 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.425+0000 7f70f8437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:04.427 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.425+0000 7f70f8437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:04.427 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.425+0000 7f70f8437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:04.427 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.425+0000 7f70f8437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:04.428 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.427+0000 7f70f5431700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:04.428 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.427+0000 7f70f5431700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:04.428 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.427+0000 7f70f5431700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:04.429 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.427+0000 7f70f5431700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:04.429 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:19:04.427+0000 7f70f5431700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:19:05.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.315+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mgrmap(e 47) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f6c38084b20 con 0x7f6c441597d0 2023-10-10T21:19:05.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.316+0000 7f6c2bfff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c300693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:19:05.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.316+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c4404c3c0 con 0x7f6c30066f80 2023-10-10T21:19:05.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.317+0000 7f6c43fff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c300693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:19:05.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.321+0000 7f6c43fff700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c300693b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6c340091e0 tx=0x7f6c34017000 comp rx=0 tx=0).ready entity=mgr.7404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:19:05.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.387+0000 7f6c2bfff700 1 -- 172.21.15.154:0/3584297572 <== mgr.7404 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f6c4404c3c0 con 0x7f6c30066f80 2023-10-10T21:19:05.389 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /bad-path 2023-10-10T21:19:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 msgr2=0x7f6c300693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:19:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c300693b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6c340091e0 tx=0x7f6c34017000 comp rx=0 tx=0).stop 2023-10-10T21:19:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c441597d0 msgr2=0x7f6c4415cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:19:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c441597d0 0x7f6c4415cf90 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800ec80 tx=0x7f6c380091a0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 shutdown_connections 2023-10-10T21:19:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4416aaf0 0x7f6c4415d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f6c30066f80 0x7f6c300693b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c4406eee0 0x7f6c441552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 --2- 172.21.15.154:0/3584297572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c441597d0 0x7f6c4415cf90 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 >> 172.21.15.154:0/3584297572 conn(0x7f6c4406adf0 msgr2=0x7f6c44156110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:19:05.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.389+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 shutdown_connections 2023-10-10T21:19:05.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.390+0000 7f6c4959d700 1 -- 172.21.15.154:0/3584297572 wait complete. 2023-10-10T21:19:05.410 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-10-10T21:19:05.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-10T21:19:05.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.597+0000 7f0dbcb9d700 1 Processor -- start 2023-10-10T21:19:05.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.598+0000 7f0dbcb9d700 1 -- start start 2023-10-10T21:19:05.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0dbcb9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0db80b0760 0x7f0db80b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:19:05.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0dbcb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db80ace60 0x7f0db80ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:19:05.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0dbcb9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db80b0570 con 0x7f0db8156350 2023-10-10T21:19:05.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0dbcb9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80b1140 con 0x7f0db80b0760 2023-10-10T21:19:05.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0dbcb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80af4d0 con 0x7f0db80ace60 2023-10-10T21:19:05.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0db7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db80ace60 0x7f0db80ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:19:05.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0daffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0db80b0760 0x7f0db80b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:19:05.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0daffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0db80b0760 0x7f0db80b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:36858/0 (socket says 172.21.15.154:36858) 2023-10-10T21:19:05.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0db7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db80ace60 0x7f0db80ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58768/0 (socket says 172.21.15.154:58768) 2023-10-10T21:19:05.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0daffff700 1 -- 172.21.15.154:0/1823591246 learned_addr learned my addr 172.21.15.154:0/1823591246 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:19:05.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.599+0000 7f0db77fe700 1 --1- 172.21.15.154:0/1823591246 >> v1:172.21.15.179:6789/0 conn(0x7f0db8156350 0x7f0db8157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44172/0 (socket says 172.21.15.154:44172) 2023-10-10T21:19:05.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.600+0000 7f0daffff700 1 -- 172.21.15.154:0/1823591246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db80ace60 msgr2=0x7f0db80ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:19:05.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.600+0000 7f0daffff700 1 --2- 172.21.15.154:0/1823591246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db80ace60 0x7f0db80ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.600+0000 7f0daffff700 1 -- 172.21.15.154:0/1823591246 >> v1:172.21.15.179:6789/0 conn(0x7f0db8156350 legacy=0x7f0db8157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:19:05.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.600+0000 7f0daffff700 1 -- 172.21.15.154:0/1823591246 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80af7b0 con 0x7f0db80b0760 2023-10-10T21:19:05.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.600+0000 7f0db7fff700 1 --2- 172.21.15.154:0/1823591246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db80ace60 0x7f0db80ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:19:05.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.600+0000 7f0daffff700 1 --2- 172.21.15.154:0/1823591246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db80b0760 0x7f0db80b0c00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0da00099b0 tx=0x7f0da0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de940753168d4d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:19:05.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.600+0000 7f0db6ffd700 1 -- 172.21.15.154:0/1823591246 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0009ea0 con 0x7f0db80b0760 2023-10-10T21:19:05.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0db6ffd700 1 -- 172.21.15.154:0/1823591246 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000b760 con 0x7f0db80b0760 2023-10-10T21:19:05.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0db6ffd700 1 -- 172.21.15.154:0/1823591246 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000bb20 con 0x7f0db80b0760 2023-10-10T21:19:05.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/1823591246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db80b0760 msgr2=0x7f0db80b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:19:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0dbcb9d700 1 --2- 172.21.15.154:0/1823591246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db80b0760 0x7f0db80b0c00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0da00099b0 tx=0x7f0da0009250 comp rx=0 tx=0).stop 2023-10-10T21:19:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/1823591246 shutdown_connections 2023-10-10T21:19:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0dbcb9d700 1 --2- 172.21.15.154:0/1823591246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db80ace60 0x7f0db80ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0dbcb9d700 1 --2- 172.21.15.154:0/1823591246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db80b0760 0x7f0db80b0c00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/1823591246 >> 172.21.15.154:0/1823591246 conn(0x7f0db8068e20 msgr2=0x7f0db80cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:19:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/1823591246 shutdown_connections 2023-10-10T21:19:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.601+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/1823591246 wait complete. 2023-10-10T21:19:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.603+0000 7f0dbcb9d700 1 Processor -- start 2023-10-10T21:19:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.603+0000 7f0dbcb9d700 1 -- start start 2023-10-10T21:19:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0dbcb9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db80ace60 0x7f0db80c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:19:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0dbcb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db80b0760 0x7f0db815ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:19:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0dbcb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db8156350 0x7f0db80aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:19:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0dbcb9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80cb000 con 0x7f0db80ace60 2023-10-10T21:19:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0dbcb9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80ca3f0 con 0x7f0db80b0760 2023-10-10T21:19:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0dbcb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80ca6d0 con 0x7f0db8156350 2023-10-10T21:19:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0db77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db80ace60 0x7f0db80c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:19:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0db77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db80ace60 0x7f0db80c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39084/0 (socket says 172.21.15.154:39084) 2023-10-10T21:19:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0db77fe700 1 -- 172.21.15.154:0/3691644936 learned_addr learned my addr 172.21.15.154:0/3691644936 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:19:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0daffff700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db80b0760 0x7f0db815ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:19:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0db7fff700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db8156350 0x7f0db80aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:19:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0db77fe700 1 -- 172.21.15.154:0/3691644936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db8156350 msgr2=0x7f0db80aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:19:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0db77fe700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db8156350 0x7f0db80aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0db77fe700 1 -- 172.21.15.154:0/3691644936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db80b0760 msgr2=0x7f0db815ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:19:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0db77fe700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db80b0760 0x7f0db815ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.604+0000 7f0db77fe700 1 -- 172.21.15.154:0/3691644936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0009a20 con 0x7f0db80ace60 2023-10-10T21:19:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.605+0000 7f0db77fe700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db80ace60 0x7f0db80c9870 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c810 tx=0x7f0da8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:19:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.605+0000 7f0daf7fe700 1 -- 172.21.15.154:0/3691644936 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8007300 con 0x7f0db80ace60 2023-10-10T21:19:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.605+0000 7f0daf7fe700 1 -- 172.21.15.154:0/3691644936 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8007460 con 0x7f0db80ace60 2023-10-10T21:19:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.605+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da00094f0 con 0x7f0db80ace60 2023-10-10T21:19:05.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.605+0000 7f0daf7fe700 1 -- 172.21.15.154:0/3691644936 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8004830 con 0x7f0db80ace60 2023-10-10T21:19:05.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.605+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db80cac90 con 0x7f0db80ace60 2023-10-10T21:19:05.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.606+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db804c3c0 con 0x7f0db80ace60 2023-10-10T21:19:05.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.607+0000 7f0daf7fe700 1 -- 172.21.15.154:0/3691644936 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 47) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f0da8004be0 con 0x7f0db80ace60 2023-10-10T21:19:05.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.608+0000 7f0daf7fe700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d98066dd0 0x7f0d98069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:19:05.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.608+0000 7f0daf7fe700 1 -- 172.21.15.154:0/3691644936 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f0da8083990 con 0x7f0db80ace60 2023-10-10T21:19:05.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.608+0000 7f0daffff700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d98066dd0 0x7f0d98069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:19:05.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.608+0000 7f0daffff700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d98066dd0 0x7f0d98069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0da00099b0 tx=0x7f0da0016000 comp rx=0 tx=0).ready entity=mgr.7404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:19:05.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.612+0000 7f0daf7fe700 1 -- 172.21.15.154:0/3691644936 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0da8050ce0 con 0x7f0db80ace60 2023-10-10T21:19:05.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.827+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0db80cb140 con 0x7f0d98066dd0 2023-10-10T21:19:05.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.835+0000 7f0daf7fe700 1 -- 172.21.15.154:0/3691644936 <== mgr.7404 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f0da0000d00 con 0x7f0d98066dd0 2023-10-10T21:19:05.836 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:19:05.836 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:19:05", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-10T21:19:05.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d98066dd0 msgr2=0x7f0d98069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:19:05.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d98066dd0 0x7f0d98069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0da00099b0 tx=0x7f0da0016000 comp rx=0 tx=0).stop 2023-10-10T21:19:05.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db80ace60 msgr2=0x7f0db80c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:19:05.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db80ace60 0x7f0db80c9870 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c810 tx=0x7f0da8007f30 comp rx=0 tx=0).stop 2023-10-10T21:19:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 shutdown_connections 2023-10-10T21:19:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0db8156350 0x7f0db80aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0db80ace60 0x7f0db80c9870 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d98066dd0 0x7f0d98069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 --2- 172.21.15.154:0/3691644936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db80b0760 0x7f0db815ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:19:05.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 >> 172.21.15.154:0/3691644936 conn(0x7f0db8068e20 msgr2=0x7f0db80abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:19:05.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 shutdown_connections 2023-10-10T21:19:05.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:19:05.838+0000 7f0dbcb9d700 1 -- 172.21.15.154:0/3691644936 wait complete. 2023-10-10T21:19:05.857 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:19:05", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-10T21:19:19.650 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:19:19.655 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:19:49.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:19:49.780 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:20:00.400 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:00.398+0000 7f70e7c16700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:00.401 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:00.398+0000 7f70e7c16700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:00.401 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:00.398+0000 7f70e7c16700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:00.401 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:00.398+0000 7f70e7c16700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:00.401 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:00.398+0000 7f70e7c16700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:05.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-10T21:20:06.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.064+0000 7fc09e39d700 1 Processor -- start 2023-10-10T21:20:06.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.064+0000 7fc09e39d700 1 -- start start 2023-10-10T21:20:06.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.065+0000 7fc09e39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc098153480 0x7fc0980ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.065+0000 7fc09e39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc098159dc0 0x7fc098157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.065+0000 7fc09e39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0980aec90 con 0x7fc098153850 2023-10-10T21:20:06.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.065+0000 7fc09e39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09815a480 con 0x7fc098153480 2023-10-10T21:20:06.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.065+0000 7fc09e39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0980afb40 con 0x7fc098159dc0 2023-10-10T21:20:06.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.065+0000 7fc09d39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc098153480 0x7fc0980ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.065+0000 7fc09d39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc098153480 0x7fc0980ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53972/0 (socket says 172.21.15.154:53972) 2023-10-10T21:20:06.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.065+0000 7fc09d39b700 1 -- 172.21.15.154:0/1336484237 learned_addr learned my addr 172.21.15.154:0/1336484237 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:06.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.066+0000 7fc09db9c700 1 --2- 172.21.15.154:0/1336484237 >> v2:172.21.15.179:3300/0 conn(0x7fc098159dc0 0x7fc098157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.066+0000 7fc09d39b700 1 -- 172.21.15.154:0/1336484237 >> v2:172.21.15.179:3300/0 conn(0x7fc098159dc0 msgr2=0x7fc098157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:06.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.066+0000 7fc09d39b700 1 --2- 172.21.15.154:0/1336484237 >> v2:172.21.15.179:3300/0 conn(0x7fc098159dc0 0x7fc098157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.066+0000 7fc09d39b700 1 -- 172.21.15.154:0/1336484237 >> v1:172.21.15.154:6789/0 conn(0x7fc098153850 legacy=0x7fc0981596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.066+0000 7fc09d39b700 1 -- 172.21.15.154:0/1336484237 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980afe20 con 0x7fc098153480 2023-10-10T21:20:06.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.066+0000 7fc09d39b700 1 --2- 172.21.15.154:0/1336484237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098153480 0x7fc0980ae750 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fc098157210 tx=0x7fc094009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf55c257717a9f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:06.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.066+0000 7fc08ffff700 1 -- 172.21.15.154:0/1336484237 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400b860 con 0x7fc098153480 2023-10-10T21:20:06.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.066+0000 7fc08ffff700 1 -- 172.21.15.154:0/1336484237 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09400b9c0 con 0x7fc098153480 2023-10-10T21:20:06.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.066+0000 7fc08ffff700 1 -- 172.21.15.154:0/1336484237 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400bd60 con 0x7fc098153480 2023-10-10T21:20:06.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.067+0000 7fc09e39d700 1 -- 172.21.15.154:0/1336484237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098153480 msgr2=0x7fc0980ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.067+0000 7fc09e39d700 1 --2- 172.21.15.154:0/1336484237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098153480 0x7fc0980ae750 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fc098157210 tx=0x7fc094009250 comp rx=0 tx=0).stop 2023-10-10T21:20:06.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.067+0000 7fc09e39d700 1 -- 172.21.15.154:0/1336484237 shutdown_connections 2023-10-10T21:20:06.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.067+0000 7fc09e39d700 1 --2- 172.21.15.154:0/1336484237 >> v2:172.21.15.179:3300/0 conn(0x7fc098159dc0 0x7fc098157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.067+0000 7fc09e39d700 1 --2- 172.21.15.154:0/1336484237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098153480 0x7fc0980ae750 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.067+0000 7fc09e39d700 1 -- 172.21.15.154:0/1336484237 >> 172.21.15.154:0/1336484237 conn(0x7fc098068e20 msgr2=0x7fc0980cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:06.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.067+0000 7fc09e39d700 1 -- 172.21.15.154:0/1336484237 shutdown_connections 2023-10-10T21:20:06.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.067+0000 7fc09e39d700 1 -- 172.21.15.154:0/1336484237 wait complete. 2023-10-10T21:20:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.069+0000 7fc09e39d700 1 Processor -- start 2023-10-10T21:20:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.069+0000 7fc09e39d700 1 -- start start 2023-10-10T21:20:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09e39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc098153480 0x7fc0981520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09e39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc098153850 0x7fc0981561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09e39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098159dc0 0x7fc098156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09e39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0981699e0 con 0x7fc098159dc0 2023-10-10T21:20:06.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09e39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09816a520 con 0x7fc098153850 2023-10-10T21:20:06.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09e39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09815b5d0 con 0x7fc098153480 2023-10-10T21:20:06.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09db9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098159dc0 0x7fc098156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09db9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098159dc0 0x7fc098156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53988/0 (socket says 172.21.15.154:53988) 2023-10-10T21:20:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09db9c700 1 -- 172.21.15.154:0/4237707258 learned_addr learned my addr 172.21.15.154:0/4237707258 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09cb9a700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc098153850 0x7fc0981561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09d39b700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc098153480 0x7fc0981520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09db9c700 1 -- 172.21.15.154:0/4237707258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc098153480 msgr2=0x7fc0981520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09db9c700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc098153480 0x7fc0981520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09db9c700 1 -- 172.21.15.154:0/4237707258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc098153850 msgr2=0x7fc0981561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09db9c700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc098153850 0x7fc0981561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.070+0000 7fc09db9c700 1 -- 172.21.15.154:0/4237707258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940094f0 con 0x7fc098159dc0 2023-10-10T21:20:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.071+0000 7fc09db9c700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098159dc0 0x7fc098156700 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fc090007f20 tx=0x7fc090009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.071+0000 7fc08d7fa700 1 -- 172.21.15.154:0/4237707258 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000eb90 con 0x7fc098159dc0 2023-10-10T21:20:06.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.071+0000 7fc08d7fa700 1 -- 172.21.15.154:0/4237707258 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09000ed10 con 0x7fc098159dc0 2023-10-10T21:20:06.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.071+0000 7fc08d7fa700 1 -- 172.21.15.154:0/4237707258 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090014670 con 0x7fc098159dc0 2023-10-10T21:20:06.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.071+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09816a9b0 con 0x7fc098159dc0 2023-10-10T21:20:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.071+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc098169ed0 con 0x7fc098159dc0 2023-10-10T21:20:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.072+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09816a6b0 con 0x7fc098159dc0 2023-10-10T21:20:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.073+0000 7fc08d7fa700 1 -- 172.21.15.154:0/4237707258 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 49) v1 ==== 84973+0+0 (secure 0 0 0) 0x7fc090014a20 con 0x7fc098159dc0 2023-10-10T21:20:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.074+0000 7fc08d7fa700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc07c0671c0 0x7fc07c069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.074+0000 7fc08d7fa700 1 -- 172.21.15.154:0/4237707258 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fc0900851b0 con 0x7fc098159dc0 2023-10-10T21:20:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.074+0000 7fc09d39b700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc07c0671c0 0x7fc07c069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.075+0000 7fc09d39b700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc07c0671c0 0x7fc07c069670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc098157210 tx=0x7fc094018000 comp rx=0 tx=0).ready entity=mgr.7404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.078+0000 7fc08d7fa700 1 -- 172.21.15.154:0/4237707258 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc090051e30 con 0x7fc098159dc0 2023-10-10T21:20:06.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.296+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc09804c3c0 con 0x7fc07c0671c0 2023-10-10T21:20:06.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.303+0000 7fc08d7fa700 1 -- 172.21.15.154:0/4237707258 <== mgr.7404 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7fc09804c3c0 con 0x7fc07c0671c0 2023-10-10T21:20:06.305 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:06.305 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:19:05", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-10T21:20:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc07c0671c0 msgr2=0x7fc07c069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc07c0671c0 0x7fc07c069670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc098157210 tx=0x7fc094018000 comp rx=0 tx=0).stop 2023-10-10T21:20:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098159dc0 msgr2=0x7fc098156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098159dc0 0x7fc098156700 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fc090007f20 tx=0x7fc090009800 comp rx=0 tx=0).stop 2023-10-10T21:20:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 shutdown_connections 2023-10-10T21:20:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc098159dc0 0x7fc098156700 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc098153480 0x7fc0981520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fc07c0671c0 0x7fc07c069670 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 --2- 172.21.15.154:0/4237707258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc098153850 0x7fc0981561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 >> 172.21.15.154:0/4237707258 conn(0x7fc098068e20 msgr2=0x7fc0980cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 shutdown_connections 2023-10-10T21:20:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.306+0000 7fc09e39d700 1 -- 172.21.15.154:0/4237707258 wait complete. 2023-10-10T21:20:06.325 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:19:05", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-10T21:20:06.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-10-10T21:20:06.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.513+0000 7f9d70bff700 1 Processor -- start 2023-10-10T21:20:06.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.513+0000 7f9d70bff700 1 -- start start 2023-10-10T21:20:06.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.514+0000 7f9d70bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 0x7f9d6c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.514+0000 7f9d70bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6c0ac030 con 0x7f9d6c069e20 2023-10-10T21:20:06.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.514+0000 7f9d70bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6c0ab820 con 0x7f9d6c0c8490 2023-10-10T21:20:06.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.514+0000 7f9d70bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c06dbb0 con 0x7f9d6c069a50 2023-10-10T21:20:06.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6ad9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9d6c069e20 0x7f9d6c1569b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37186/0 (socket says 172.21.15.154:37186) 2023-10-10T21:20:06.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6ad9d700 1 -- 172.21.15.154:0/1140082663 learned_addr learned my addr 172.21.15.154:0/1140082663 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:06.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6a59c700 1 --2- 172.21.15.154:0/1140082663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 0x7f9d6c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6959a700 1 -- 172.21.15.154:0/1140082663 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419510517 0 0) 0x7f9d64001490 con 0x7f9d6c069e20 2023-10-10T21:20:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6959a700 1 -- 172.21.15.154:0/1140082663 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d54003570 con 0x7f9d6c069e20 2023-10-10T21:20:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6959a700 1 -- 172.21.15.154:0/1140082663 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27105490 0 0) 0x7f9d6c0ab820 con 0x7f9d6c0c8490 2023-10-10T21:20:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6959a700 1 -- 172.21.15.154:0/1140082663 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d64001490 con 0x7f9d6c0c8490 2023-10-10T21:20:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6959a700 1 -- 172.21.15.154:0/1140082663 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 290005821 0 0) 0x7f9d54003570 con 0x7f9d6c069e20 2023-10-10T21:20:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6a59c700 1 -- 172.21.15.154:0/1140082663 >> v1:172.21.15.179:6789/0 conn(0x7f9d6c0c8490 legacy=0x7f9d6c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6a59c700 1 -- 172.21.15.154:0/1140082663 >> v1:172.21.15.154:6789/0 conn(0x7f9d6c069e20 legacy=0x7f9d6c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.515+0000 7f9d6a59c700 1 -- 172.21.15.154:0/1140082663 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c0aba70 con 0x7f9d6c069a50 2023-10-10T21:20:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.516+0000 7f9d6a59c700 1 --2- 172.21.15.154:0/1140082663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 0x7f9d6c0c6ac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009940 tx=0x7f9d5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=186a03084e3294a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.516+0000 7f9d6959a700 1 -- 172.21.15.154:0/1140082663 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64001980 con 0x7f9d6c069a50 2023-10-10T21:20:06.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.516+0000 7f9d6959a700 1 -- 172.21.15.154:0/1140082663 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c011420 con 0x7f9d6c069a50 2023-10-10T21:20:06.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.516+0000 7f9d6959a700 1 -- 172.21.15.154:0/1140082663 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c0117c0 con 0x7f9d6c069a50 2023-10-10T21:20:06.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.517+0000 7f9d70bff700 1 -- 172.21.15.154:0/1140082663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 msgr2=0x7f9d6c0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.517+0000 7f9d70bff700 1 --2- 172.21.15.154:0/1140082663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 0x7f9d6c0c6ac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009940 tx=0x7f9d5c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.517+0000 7f9d70bff700 1 -- 172.21.15.154:0/1140082663 shutdown_connections 2023-10-10T21:20:06.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.517+0000 7f9d70bff700 1 --2- 172.21.15.154:0/1140082663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 0x7f9d6c0c6ac0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.517+0000 7f9d70bff700 1 -- 172.21.15.154:0/1140082663 >> 172.21.15.154:0/1140082663 conn(0x7f9d6c0c8f90 msgr2=0x7f9d6c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:06.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.517+0000 7f9d70bff700 1 -- 172.21.15.154:0/1140082663 shutdown_connections 2023-10-10T21:20:06.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.517+0000 7f9d70bff700 1 -- 172.21.15.154:0/1140082663 wait complete. 2023-10-10T21:20:06.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.518+0000 7f9d70bff700 1 Processor -- start 2023-10-10T21:20:06.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.518+0000 7f9d70bff700 1 -- start start 2023-10-10T21:20:06.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.519+0000 7f9d70bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 0x7f9d6c1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.519+0000 7f9d70bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6c069e20 0x7f9d6c0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.519+0000 7f9d70bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d6c0c8490 0x7f9d6c0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.519+0000 7f9d70bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c0b0200 con 0x7f9d6c069e20 2023-10-10T21:20:06.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.519+0000 7f9d70bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c153b20 con 0x7f9d6c0c8490 2023-10-10T21:20:06.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.519+0000 7f9d70bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c0afed0 con 0x7f9d6c069a50 2023-10-10T21:20:06.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.519+0000 7f9d69d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6c069e20 0x7f9d6c0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d69d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6c069e20 0x7f9d6c0aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53998/0 (socket says 172.21.15.154:53998) 2023-10-10T21:20:06.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d69d9b700 1 -- 172.21.15.154:0/1370675515 learned_addr learned my addr 172.21.15.154:0/1370675515 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:06.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d6a59c700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 0x7f9d6c1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d6ad9d700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d6c0c8490 0x7f9d6c0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d69d9b700 1 -- 172.21.15.154:0/1370675515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 msgr2=0x7f9d6c1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d69d9b700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 0x7f9d6c1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d69d9b700 1 -- 172.21.15.154:0/1370675515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d6c0c8490 msgr2=0x7f9d6c0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d69d9b700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d6c0c8490 0x7f9d6c0c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d69d9b700 1 -- 172.21.15.154:0/1370675515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c009420 con 0x7f9d6c069e20 2023-10-10T21:20:06.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d69d9b700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6c069e20 0x7f9d6c0aa2a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000c790 tx=0x7f9d60007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:06.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d5a7fc700 1 -- 172.21.15.154:0/1370675515 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60010510 con 0x7f9d6c069e20 2023-10-10T21:20:06.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d5a7fc700 1 -- 172.21.15.154:0/1370675515 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d60010670 con 0x7f9d6c069e20 2023-10-10T21:20:06.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c0aac60 con 0x7f9d6c069e20 2023-10-10T21:20:06.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.520+0000 7f9d5a7fc700 1 -- 172.21.15.154:0/1370675515 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60010a30 con 0x7f9d6c069e20 2023-10-10T21:20:06.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.521+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6c0ab220 con 0x7f9d6c069e20 2023-10-10T21:20:06.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.521+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6c0b03b0 con 0x7f9d6c069e20 2023-10-10T21:20:06.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.522+0000 7f9d5a7fc700 1 -- 172.21.15.154:0/1370675515 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 49) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f9d6001b3b0 con 0x7f9d6c069e20 2023-10-10T21:20:06.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.523+0000 7f9d5a7fc700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d4c0671c0 0x7f9d4c069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:06.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.523+0000 7f9d5a7fc700 1 -- 172.21.15.154:0/1370675515 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f9d600844c0 con 0x7f9d6c069e20 2023-10-10T21:20:06.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.523+0000 7f9d6a59c700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d4c0671c0 0x7f9d4c069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:06.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.524+0000 7f9d6a59c700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d4c0671c0 0x7f9d4c069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009860 tx=0x7f9d5c016000 comp rx=0 tx=0).ready entity=mgr.7404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:06.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.527+0000 7f9d5a7fc700 1 -- 172.21.15.154:0/1370675515 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d6c0b03b0 con 0x7f9d6c069e20 2023-10-10T21:20:06.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.741+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 --> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d6c0718b0 con 0x7f9d4c0671c0 2023-10-10T21:20:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.809+0000 7f9d5a7fc700 1 -- 172.21.15.154:0/1370675515 <== mgr.7404 v2:172.21.15.154:6834/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f9d6c0718b0 con 0x7f9d4c0671c0 2023-10-10T21:20:06.811 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /bad-path 2023-10-10T21:20:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d4c0671c0 msgr2=0x7f9d4c069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d4c0671c0 0x7f9d4c069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009860 tx=0x7f9d5c016000 comp rx=0 tx=0).stop 2023-10-10T21:20:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6c069e20 msgr2=0x7f9d6c0aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6c069e20 0x7f9d6c0aa2a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000c790 tx=0x7f9d60007e10 comp rx=0 tx=0).stop 2023-10-10T21:20:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 shutdown_connections 2023-10-10T21:20:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f9d4c0671c0 0x7f9d4c069670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d6c0c8490 0x7f9d6c0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d6c069a50 0x7f9d6c1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 --2- 172.21.15.154:0/1370675515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6c069e20 0x7f9d6c0aa2a0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 >> 172.21.15.154:0/1370675515 conn(0x7f9d6c0c8f90 msgr2=0x7f9d6c0ac710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.811+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 shutdown_connections 2023-10-10T21:20:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:06.812+0000 7f9d70bff700 1 -- 172.21.15.154:0/1370675515 wait complete. 2023-10-10T21:20:06.831 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-10-10T21:20:06.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T21:20:07.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.015+0000 7f5eb7fff700 1 Processor -- start 2023-10-10T21:20:07.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.015+0000 7f5eb7fff700 1 -- start start 2023-10-10T21:20:07.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.016+0000 7f5eb7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb81407e0 0x7f5eb806a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.016+0000 7f5eb7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5eb806dc00 0x7f5eb806a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.016+0000 7f5eb7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb80c6820 con 0x7f5eb8140bb0 2023-10-10T21:20:07.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.016+0000 7f5eb7fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb80c6de0 con 0x7f5eb806dc00 2023-10-10T21:20:07.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.016+0000 7f5eb7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8141270 con 0x7f5eb81407e0 2023-10-10T21:20:07.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5eb806dc00 0x7f5eb806a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5eb806dc00 0x7f5eb806a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54008/0 (socket says 172.21.15.154:54008) 2023-10-10T21:20:07.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb77fe700 1 -- 172.21.15.154:0/2577083098 learned_addr learned my addr 172.21.15.154:0/2577083098 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:07.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb6ffd700 1 --2- 172.21.15.154:0/2577083098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb81407e0 0x7f5eb806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb77fe700 1 -- 172.21.15.154:0/2577083098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb81407e0 msgr2=0x7f5eb806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:07.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb77fe700 1 --2- 172.21.15.154:0/2577083098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb81407e0 0x7f5eb806a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb77fe700 1 -- 172.21.15.154:0/2577083098 >> v1:172.21.15.179:6789/0 conn(0x7f5eb8140bb0 legacy=0x7f5eb806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb77fe700 1 -- 172.21.15.154:0/2577083098 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb806acf0 con 0x7f5eb806dc00 2023-10-10T21:20:07.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb77fe700 1 --2- 172.21.15.154:0/2577083098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb806dc00 0x7f5eb806a6c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009f20 tx=0x7f5eb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b360a0bdcc32761c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:07.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.017+0000 7f5eb67fc700 1 -- 172.21.15.154:0/2577083098 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000e070 con 0x7f5eb806dc00 2023-10-10T21:20:07.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb67fc700 1 -- 172.21.15.154:0/2577083098 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb000ba80 con 0x7f5eb806dc00 2023-10-10T21:20:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb67fc700 1 -- 172.21.15.154:0/2577083098 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb00092e0 con 0x7f5eb806dc00 2023-10-10T21:20:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb7fff700 1 -- 172.21.15.154:0/2577083098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb806dc00 msgr2=0x7f5eb806a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb7fff700 1 --2- 172.21.15.154:0/2577083098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb806dc00 0x7f5eb806a6c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009f20 tx=0x7f5eb0009840 comp rx=0 tx=0).stop 2023-10-10T21:20:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb7fff700 1 -- 172.21.15.154:0/2577083098 shutdown_connections 2023-10-10T21:20:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb7fff700 1 --2- 172.21.15.154:0/2577083098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb806dc00 0x7f5eb806a6c0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb7fff700 1 --2- 172.21.15.154:0/2577083098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb81407e0 0x7f5eb806a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb7fff700 1 -- 172.21.15.154:0/2577083098 >> 172.21.15.154:0/2577083098 conn(0x7f5eb80cc1e0 msgr2=0x7f5eb80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:07.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb7fff700 1 -- 172.21.15.154:0/2577083098 shutdown_connections 2023-10-10T21:20:07.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.018+0000 7f5eb7fff700 1 -- 172.21.15.154:0/2577083098 wait complete. 2023-10-10T21:20:07.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.020+0000 7f5eb7fff700 1 Processor -- start 2023-10-10T21:20:07.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.020+0000 7f5eb7fff700 1 -- start start 2023-10-10T21:20:07.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eb7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb806dc00 0x7f5eb813b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eb7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb81407e0 0x7f5eb80a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eb7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb8140bb0 0x7f5eb80b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eb7fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8167ae0 con 0x7f5eb81407e0 2023-10-10T21:20:07.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eb7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8167d80 con 0x7f5eb806dc00 2023-10-10T21:20:07.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eb7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80ae510 con 0x7f5eb8140bb0 2023-10-10T21:20:07.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb81407e0 0x7f5eb80a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb81407e0 0x7f5eb80a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54014/0 (socket says 172.21.15.154:54014) 2023-10-10T21:20:07.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eaffff700 1 -- 172.21.15.154:0/1069402267 learned_addr learned my addr 172.21.15.154:0/1069402267 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:07.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eb77fe700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb8140bb0 0x7f5eb80b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eb6ffd700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb806dc00 0x7f5eb813b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eaffff700 1 -- 172.21.15.154:0/1069402267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb8140bb0 msgr2=0x7f5eb80b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eaffff700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb8140bb0 0x7f5eb80b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eaffff700 1 -- 172.21.15.154:0/1069402267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb806dc00 msgr2=0x7f5eb813b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eaffff700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb806dc00 0x7f5eb813b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eaffff700 1 -- 172.21.15.154:0/1069402267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0009ae0 con 0x7f5eb81407e0 2023-10-10T21:20:07.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.021+0000 7f5eb6ffd700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb806dc00 0x7f5eb813b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:07.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.022+0000 7f5eaffff700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb81407e0 0x7f5eb80a5ed0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c590 tx=0x7f5ea0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:07.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.022+0000 7f5eaeffd700 1 -- 172.21.15.154:0/1069402267 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0011590 con 0x7f5eb81407e0 2023-10-10T21:20:07.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.022+0000 7f5eaeffd700 1 -- 172.21.15.154:0/1069402267 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea0011710 con 0x7f5eb81407e0 2023-10-10T21:20:07.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.022+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb813bc30 con 0x7f5eb81407e0 2023-10-10T21:20:07.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.022+0000 7f5eaeffd700 1 -- 172.21.15.154:0/1069402267 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0011ad0 con 0x7f5eb81407e0 2023-10-10T21:20:07.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.022+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb80a6970 con 0x7f5eb81407e0 2023-10-10T21:20:07.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.023+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb8167ef0 con 0x7f5eb81407e0 2023-10-10T21:20:07.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.024+0000 7f5eaeffd700 1 -- 172.21.15.154:0/1069402267 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 49) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f5ea001a360 con 0x7f5eb81407e0 2023-10-10T21:20:07.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.025+0000 7f5eaeffd700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e980671c0 0x7f5e98069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.025+0000 7f5eaeffd700 1 -- 172.21.15.154:0/1069402267 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f5ea0083ab0 con 0x7f5eb81407e0 2023-10-10T21:20:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.025+0000 7f5eb6ffd700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e980671c0 0x7f5e98069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.025+0000 7f5eb6ffd700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e980671c0 0x7f5e98069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8006fd0 tx=0x7f5ea8008040 comp rx=0 tx=0).ready entity=mgr.7404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.029+0000 7f5eaeffd700 1 -- 172.21.15.154:0/1069402267 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5eb8167ef0 con 0x7f5eb81407e0 2023-10-10T21:20:07.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.272+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f5eb8167ef0 con 0x7f5eb81407e0 2023-10-10T21:20:07.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.415+0000 7f5eaeffd700 1 -- 172.21.15.154:0/1069402267 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f5ea0050ba0 con 0x7f5eb81407e0 2023-10-10T21:20:07.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.416+0000 7f5eaeffd700 1 -- 172.21.15.154:0/1069402267 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v50) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5ea0049720 con 0x7f5eb81407e0 2023-10-10T21:20:07.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e980671c0 msgr2=0x7f5e98069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e980671c0 0x7f5e98069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8006fd0 tx=0x7f5ea8008040 comp rx=0 tx=0).stop 2023-10-10T21:20:07.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb81407e0 msgr2=0x7f5eb80a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb81407e0 0x7f5eb80a5ed0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c590 tx=0x7f5ea0007f50 comp rx=0 tx=0).stop 2023-10-10T21:20:07.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 shutdown_connections 2023-10-10T21:20:07.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eb8140bb0 0x7f5eb80b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e980671c0 0x7f5e98069670 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eb806dc00 0x7f5eb813b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 --2- 172.21.15.154:0/1069402267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb81407e0 0x7f5eb80a5ed0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 >> 172.21.15.154:0/1069402267 conn(0x7f5eb80cc1e0 msgr2=0x7f5eb80c7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 shutdown_connections 2023-10-10T21:20:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.419+0000 7f5eb7fff700 1 -- 172.21.15.154:0/1069402267 wait complete. 2023-10-10T21:20:07.439 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:20:07.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:20:07.524 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:20:07.606 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:20:07.607 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T21:20:07.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:07.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T21:20:07.688 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:20:07.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:20:07.689 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T21:20:07.728 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:20:07.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.956+0000 7fbf8499d700 1 Processor -- start 2023-10-10T21:20:07.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.957+0000 7fbf8499d700 1 -- start start 2023-10-10T21:20:07.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.958+0000 7fbf8499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf801597f0 0x7fbf800b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.958+0000 7fbf8499d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf800b11d0 con 0x7fbf80159420 2023-10-10T21:20:07.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.958+0000 7fbf8499d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf800b14b0 con 0x7fbf8015d230 2023-10-10T21:20:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.958+0000 7fbf8499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800b1790 con 0x7fbf801597f0 2023-10-10T21:20:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.958+0000 7fbf7f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbf80159420 0x7fbf800b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37204/0 (socket says 172.21.15.154:37204) 2023-10-10T21:20:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.958+0000 7fbf7f7fe700 1 -- 172.21.15.154:0/2519322431 learned_addr learned my addr 172.21.15.154:0/2519322431 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.958+0000 7fbf7effd700 1 --2- 172.21.15.154:0/2519322431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf801597f0 0x7fbf800b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/2519322431 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40417219 0 0) 0x7fbf800b11d0 con 0x7fbf80159420 2023-10-10T21:20:07.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/2519322431 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf68003570 con 0x7fbf80159420 2023-10-10T21:20:07.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/2519322431 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580791415 0 0) 0x7fbf800b14b0 con 0x7fbf8015d230 2023-10-10T21:20:07.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7effd700 1 -- 172.21.15.154:0/2519322431 >> v1:172.21.15.179:6789/0 conn(0x7fbf8015d230 legacy=0x7fbf800b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7effd700 1 -- 172.21.15.154:0/2519322431 >> v1:172.21.15.154:6789/0 conn(0x7fbf80159420 legacy=0x7fbf800b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7effd700 1 -- 172.21.15.154:0/2519322431 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800b1a70 con 0x7fbf801597f0 2023-10-10T21:20:07.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7effd700 1 --2- 172.21.15.154:0/2519322431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf801597f0 0x7fbf800b2270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009910 tx=0x7fbf740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a4276c939ffdfbf server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:07.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/2519322431 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400b680 con 0x7fbf801597f0 2023-10-10T21:20:07.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/2519322431 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7400b7e0 con 0x7fbf801597f0 2023-10-10T21:20:07.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.959+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/2519322431 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400bba0 con 0x7fbf801597f0 2023-10-10T21:20:07.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.960+0000 7fbf8499d700 1 -- 172.21.15.154:0/2519322431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf801597f0 msgr2=0x7fbf800b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.960+0000 7fbf8499d700 1 --2- 172.21.15.154:0/2519322431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf801597f0 0x7fbf800b2270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009910 tx=0x7fbf740091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.960+0000 7fbf8499d700 1 -- 172.21.15.154:0/2519322431 shutdown_connections 2023-10-10T21:20:07.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.960+0000 7fbf8499d700 1 --2- 172.21.15.154:0/2519322431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf801597f0 0x7fbf800b2270 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.960+0000 7fbf8499d700 1 -- 172.21.15.154:0/2519322431 >> 172.21.15.154:0/2519322431 conn(0x7fbf800d0660 msgr2=0x7fbf800d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:07.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.960+0000 7fbf8499d700 1 -- 172.21.15.154:0/2519322431 shutdown_connections 2023-10-10T21:20:07.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.960+0000 7fbf8499d700 1 -- 172.21.15.154:0/2519322431 wait complete. 2023-10-10T21:20:07.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.962+0000 7fbf8499d700 1 Processor -- start 2023-10-10T21:20:07.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.962+0000 7fbf8499d700 1 -- start start 2023-10-10T21:20:07.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf8499d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf80159420 0x7fbf8014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf8499d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf801597f0 0x7fbf80155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf8499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8015d230 0x7fbf801561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf8499d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf801554e0 con 0x7fbf80159420 2023-10-10T21:20:07.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf8499d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8015a110 con 0x7fbf801597f0 2023-10-10T21:20:07.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf8499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf80154f20 con 0x7fbf8015d230 2023-10-10T21:20:07.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf7f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf80159420 0x7fbf8014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf7effd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf801597f0 0x7fbf80155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf7f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf80159420 0x7fbf8014f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54044/0 (socket says 172.21.15.154:54044) 2023-10-10T21:20:07.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf7f7fe700 1 -- 172.21.15.154:0/4127707105 learned_addr learned my addr 172.21.15.154:0/4127707105 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:07.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf7ffff700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8015d230 0x7fbf801561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:07.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf7f7fe700 1 -- 172.21.15.154:0/4127707105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8015d230 msgr2=0x7fbf801561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf7f7fe700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8015d230 0x7fbf801561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf7f7fe700 1 -- 172.21.15.154:0/4127707105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf801597f0 msgr2=0x7fbf80155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:07.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.963+0000 7fbf7f7fe700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf801597f0 0x7fbf80155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:07.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.964+0000 7fbf7f7fe700 1 -- 172.21.15.154:0/4127707105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf74009420 con 0x7fbf80159420 2023-10-10T21:20:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.964+0000 7fbf7effd700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf801597f0 0x7fbf80155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.964+0000 7fbf7f7fe700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf80159420 0x7fbf8014f510 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fbf700011e0 tx=0x7fbf70007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.964+0000 7fbf677fe700 1 -- 172.21.15.154:0/4127707105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70005b30 con 0x7fbf80159420 2023-10-10T21:20:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.964+0000 7fbf677fe700 1 -- 172.21.15.154:0/4127707105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf70005c90 con 0x7fbf80159420 2023-10-10T21:20:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.964+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf80155200 con 0x7fbf80159420 2023-10-10T21:20:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.964+0000 7fbf677fe700 1 -- 172.21.15.154:0/4127707105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70007300 con 0x7fbf80159420 2023-10-10T21:20:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.964+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8014fa50 con 0x7fbf80159420 2023-10-10T21:20:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.965+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf80159bc0 con 0x7fbf80159420 2023-10-10T21:20:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.966+0000 7fbf677fe700 1 -- 172.21.15.154:0/4127707105 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fbf70007670 con 0x7fbf80159420 2023-10-10T21:20:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.967+0000 7fbf677fe700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c067170 0x7fbf6c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.967+0000 7fbf677fe700 1 -- 172.21.15.154:0/4127707105 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fbf70084090 con 0x7fbf80159420 2023-10-10T21:20:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.967+0000 7fbf7effd700 1 -- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c067170 msgr2=0x7fbf6c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.967+0000 7fbf7effd700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c067170 0x7fbf6c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:07.972+0000 7fbf677fe700 1 -- 172.21.15.154:0/4127707105 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf70050c40 con 0x7fbf80159420 2023-10-10T21:20:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.168+0000 7fbf7effd700 1 -- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c067170 msgr2=0x7fbf6c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.168+0000 7fbf7effd700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c067170 0x7fbf6c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:08.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.213+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf8004c3c0 con 0x7fbf80159420 2023-10-10T21:20:08.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.213+0000 7fbf677fe700 1 -- 172.21.15.154:0/4127707105 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fbf70017090 con 0x7fbf80159420 2023-10-10T21:20:08.215 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:08.215 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1983002927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1983002927},{"type":"v1","addr":"172.21.15.179:6835","nonce":1983002927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3483729269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3483729269},{"type":"v1","addr":"172.21.15.179:6834","nonce":3483729269}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3602154448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3602154448},{"type":"v1","addr":"172.21.15.154:6837","nonce":3602154448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:43.589800+0000","modified":"2023-10-10T21:18:47.153053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/2335601961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2335601961},{"type":"v1","addr":"172.21.15.154:6835","nonce":2335601961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-10T21:20:08.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c067170 msgr2=0x7fbf6c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:08.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c067170 0x7fbf6c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf80159420 msgr2=0x7fbf8014f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf80159420 0x7fbf8014f510 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fbf700011e0 tx=0x7fbf70007df0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 shutdown_connections 2023-10-10T21:20:08.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8015d230 0x7fbf801561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf80159420 0x7fbf8014f510 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c067170 0x7fbf6c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 --2- 172.21.15.154:0/4127707105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf801597f0 0x7fbf80155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 >> 172.21.15.154:0/4127707105 conn(0x7fbf800d0660 msgr2=0x7fbf800ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:08.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 shutdown_connections 2023-10-10T21:20:08.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.216+0000 7fbf8499d700 1 -- 172.21.15.154:0/4127707105 wait complete. 2023-10-10T21:20:08.221 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 45 2023-10-10T21:20:08.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:20:08.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.425+0000 7fdac959d700 1 Processor -- start 2023-10-10T21:20:08.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.425+0000 7fdac959d700 1 -- start start 2023-10-10T21:20:08.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.427+0000 7fdac959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac40c8830 0x7fdac4164800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.427+0000 7fdac959d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac40b1410 con 0x7fdac40c6c60 2023-10-10T21:20:08.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.427+0000 7fdac959d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac4063230 con 0x7fdac41595a0 2023-10-10T21:20:08.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.427+0000 7fdac959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40b2b90 con 0x7fdac40c8830 2023-10-10T21:20:08.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.427+0000 7fdac37fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdac40c6c60 0x7fdac40c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37214/0 (socket says 172.21.15.154:37214) 2023-10-10T21:20:08.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.427+0000 7fdac37fe700 1 -- 172.21.15.154:0/4033104824 learned_addr learned my addr 172.21.15.154:0/4033104824 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:08.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.427+0000 7fdac8d9c700 1 --2- 172.21.15.154:0/4033104824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac40c8830 0x7fdac4164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:08.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.427+0000 7fdac2ffd700 1 -- 172.21.15.154:0/4033104824 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822603678 0 0) 0x7fdac40b1410 con 0x7fdac40c6c60 2023-10-10T21:20:08.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.427+0000 7fdac2ffd700 1 -- 172.21.15.154:0/4033104824 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaac003570 con 0x7fdac40c6c60 2023-10-10T21:20:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.428+0000 7fdac2ffd700 1 -- 172.21.15.154:0/4033104824 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026856604 0 0) 0x7fdac4063230 con 0x7fdac41595a0 2023-10-10T21:20:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.428+0000 7fdac2ffd700 1 -- 172.21.15.154:0/4033104824 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac40b1410 con 0x7fdac41595a0 2023-10-10T21:20:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.428+0000 7fdac8d9c700 1 -- 172.21.15.154:0/4033104824 >> v1:172.21.15.179:6789/0 conn(0x7fdac41595a0 legacy=0x7fdac40b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.428+0000 7fdac8d9c700 1 -- 172.21.15.154:0/4033104824 >> v1:172.21.15.154:6789/0 conn(0x7fdac40c6c60 legacy=0x7fdac40c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.428+0000 7fdac8d9c700 1 -- 172.21.15.154:0/4033104824 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40634f0 con 0x7fdac40c8830 2023-10-10T21:20:08.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.428+0000 7fdac8d9c700 1 --2- 172.21.15.154:0/4033104824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac40c8830 0x7fdac4164800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009e90 tx=0x7fdabc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b58f832eeba3572 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:08.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.428+0000 7fdac2ffd700 1 -- 172.21.15.154:0/4033104824 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00e070 con 0x7fdac40c8830 2023-10-10T21:20:08.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.428+0000 7fdac2ffd700 1 -- 172.21.15.154:0/4033104824 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc00bb80 con 0x7fdac40c8830 2023-10-10T21:20:08.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.428+0000 7fdac2ffd700 1 -- 172.21.15.154:0/4033104824 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc012430 con 0x7fdac40c8830 2023-10-10T21:20:08.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.429+0000 7fdac959d700 1 -- 172.21.15.154:0/4033104824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac40c8830 msgr2=0x7fdac4164800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.429+0000 7fdac959d700 1 --2- 172.21.15.154:0/4033104824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac40c8830 0x7fdac4164800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009e90 tx=0x7fdabc009780 comp rx=0 tx=0).stop 2023-10-10T21:20:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.429+0000 7fdac959d700 1 -- 172.21.15.154:0/4033104824 shutdown_connections 2023-10-10T21:20:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.429+0000 7fdac959d700 1 --2- 172.21.15.154:0/4033104824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac40c8830 0x7fdac4164800 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.429+0000 7fdac959d700 1 -- 172.21.15.154:0/4033104824 >> 172.21.15.154:0/4033104824 conn(0x7fdac406ddb0 msgr2=0x7fdac406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.429+0000 7fdac959d700 1 -- 172.21.15.154:0/4033104824 shutdown_connections 2023-10-10T21:20:08.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.429+0000 7fdac959d700 1 -- 172.21.15.154:0/4033104824 wait complete. 2023-10-10T21:20:08.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.430+0000 7fdac959d700 1 Processor -- start 2023-10-10T21:20:08.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.431+0000 7fdac959d700 1 -- start start 2023-10-10T21:20:08.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.431+0000 7fdac959d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdac40c6c60 0x7fdac41404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.431+0000 7fdac959d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac40c8830 0x7fdac4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac41595a0 0x7fdac40cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac959d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4169f70 con 0x7fdac40c6c60 2023-10-10T21:20:08.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac959d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac416a250 con 0x7fdac40c8830 2023-10-10T21:20:08.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac416a530 con 0x7fdac41595a0 2023-10-10T21:20:08.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdac40c6c60 0x7fdac41404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:08.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdac40c6c60 0x7fdac41404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54052/0 (socket says 172.21.15.154:54052) 2023-10-10T21:20:08.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac3fff700 1 -- 172.21.15.154:0/1397545742 learned_addr learned my addr 172.21.15.154:0/1397545742 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:08.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac37fe700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac40c8830 0x7fdac4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:08.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac8d9c700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac41595a0 0x7fdac40cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:08.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac3fff700 1 -- 172.21.15.154:0/1397545742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac41595a0 msgr2=0x7fdac40cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac3fff700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac41595a0 0x7fdac40cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac3fff700 1 -- 172.21.15.154:0/1397545742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac40c8830 msgr2=0x7fdac4151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac3fff700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac40c8830 0x7fdac4151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac3fff700 1 -- 172.21.15.154:0/1397545742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc009a20 con 0x7fdac40c6c60 2023-10-10T21:20:08.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac8d9c700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac41595a0 0x7fdac40cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:08.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.432+0000 7fdac3fff700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdac40c6c60 0x7fdac41404a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fdab400c580 tx=0x7fdab4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:08.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.433+0000 7fdaabfff700 1 -- 172.21.15.154:0/1397545742 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4010510 con 0x7fdac40c6c60 2023-10-10T21:20:08.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.433+0000 7fdaabfff700 1 -- 172.21.15.154:0/1397545742 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab4010670 con 0x7fdac40c6c60 2023-10-10T21:20:08.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.433+0000 7fdaabfff700 1 -- 172.21.15.154:0/1397545742 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4010a30 con 0x7fdac40c6c60 2023-10-10T21:20:08.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.433+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac416a810 con 0x7fdac40c6c60 2023-10-10T21:20:08.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.433+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac41409e0 con 0x7fdac40c6c60 2023-10-10T21:20:08.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.434+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac416ad30 con 0x7fdac40c6c60 2023-10-10T21:20:08.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.435+0000 7fdaabfff700 1 -- 172.21.15.154:0/1397545742 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fdab401b400 con 0x7fdac40c6c60 2023-10-10T21:20:08.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.436+0000 7fdaabfff700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fdab0067170 0x7fdab0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.436+0000 7fdaabfff700 1 -- 172.21.15.154:0/1397545742 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fdab4084890 con 0x7fdac40c6c60 2023-10-10T21:20:08.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.436+0000 7fdac37fe700 1 -- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fdab0067170 msgr2=0x7fdab0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:08.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.436+0000 7fdac37fe700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fdab0067170 0x7fdab0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:08.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.440+0000 7fdaabfff700 1 -- 172.21.15.154:0/1397545742 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdab4051510 con 0x7fdac40c6c60 2023-10-10T21:20:08.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.637+0000 7fdac37fe700 1 -- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fdab0067170 msgr2=0x7fdab0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:08.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.637+0000 7fdac37fe700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fdab0067170 0x7fdab0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.642+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdac404c3c0 con 0x7fdac40c6c60 2023-10-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.643+0000 7fdaabfff700 1 -- 172.21.15.154:0/1397545742 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16477 (secure 0 0 0) 0x7fdab4054b30 con 0x7fdac40c6c60 2023-10-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":112,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:20:05.388577+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:41.726498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:42.567446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/85496":"2023-10-11T21:19:04.287290+0000","172.21.15.154:6834/85496":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/3617467829":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/1080071568":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/2988501796":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/2592465931":"2023-10-11T21:19:04.287290+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fdab0067170 msgr2=0x7fdab0069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fdab0067170 0x7fdab0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdac40c6c60 msgr2=0x7fdac41404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdac40c6c60 0x7fdac41404a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fdab400c580 tx=0x7fdab4007e10 comp rx=0 tx=0).stop 2023-10-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 shutdown_connections 2023-10-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac41595a0 0x7fdac40cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdac40c6c60 0x7fdac41404a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7fdab0067170 0x7fdab0069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 --2- 172.21.15.154:0/1397545742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac40c8830 0x7fdac4151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 >> 172.21.15.154:0/1397545742 conn(0x7fdac406ddb0 msgr2=0x7fdac40c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:08.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 shutdown_connections 2023-10-10T21:20:08.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.646+0000 7fdac959d700 1 -- 172.21.15.154:0/1397545742 wait complete. 2023-10-10T21:20:08.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:18:41.726498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:18:42.567446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:20:08.666 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:20:08.690 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:08.688+0000 7f29fb632180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:20:08.759 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:08.758+0000 7f49b3a84180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:20:08.852 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:08.850+0000 7f29fb632180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:20:08.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.860+0000 7f001eb9d700 1 Processor -- start 2023-10-10T21:20:08.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.860+0000 7f001eb9d700 1 -- start start 2023-10-10T21:20:08.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.861+0000 7f001eb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00180ae7e0 0x7f00180c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.861+0000 7f001eb9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001806ebd0 con 0x7f00180cb1a0 2023-10-10T21:20:08.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.861+0000 7f001eb9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001815aa70 con 0x7f001806f060 2023-10-10T21:20:08.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.861+0000 7f001eb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001815b2e0 con 0x7f00180ae7e0 2023-10-10T21:20:08.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.862+0000 7f001db9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f00180cb1a0 0x7f001815a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37224/0 (socket says 172.21.15.154:37224) 2023-10-10T21:20:08.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.862+0000 7f001db9b700 1 -- 172.21.15.154:0/2274202962 learned_addr learned my addr 172.21.15.154:0/2274202962 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:08.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.862+0000 7f001e39c700 1 --2- 172.21.15.154:0/2274202962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00180ae7e0 0x7f00180c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:08.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.862+0000 7f001cb99700 1 -- 172.21.15.154:0/2274202962 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194035664 0 0) 0x7f001806ebd0 con 0x7f00180cb1a0 2023-10-10T21:20:08.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.862+0000 7f001cb99700 1 -- 172.21.15.154:0/2274202962 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0004003570 con 0x7f00180cb1a0 2023-10-10T21:20:08.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.862+0000 7f001e39c700 1 -- 172.21.15.154:0/2274202962 >> v1:172.21.15.179:6789/0 conn(0x7f001806f060 legacy=0x7f00180ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.862+0000 7f001cb99700 1 -- 172.21.15.154:0/2274202962 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400570170 0 0) 0x7f001815aa70 con 0x7f001806f060 2023-10-10T21:20:08.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.862+0000 7f001e39c700 1 -- 172.21.15.154:0/2274202962 >> v1:172.21.15.154:6789/0 conn(0x7f00180cb1a0 legacy=0x7f001815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.862+0000 7f001e39c700 1 -- 172.21.15.154:0/2274202962 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001815ad20 con 0x7f00180ae7e0 2023-10-10T21:20:08.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.863+0000 7f001e39c700 1 --2- 172.21.15.154:0/2274202962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00180ae7e0 0x7f00180c9db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0010009e90 tx=0x7f0010009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316b538bb4c73ed0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:08.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.863+0000 7f001cb99700 1 -- 172.21.15.154:0/2274202962 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000e070 con 0x7f00180ae7e0 2023-10-10T21:20:08.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.863+0000 7f001cb99700 1 -- 172.21.15.154:0/2274202962 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001000bcc0 con 0x7f00180ae7e0 2023-10-10T21:20:08.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.863+0000 7f001cb99700 1 -- 172.21.15.154:0/2274202962 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010012430 con 0x7f00180ae7e0 2023-10-10T21:20:08.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.863+0000 7f001eb9d700 1 -- 172.21.15.154:0/2274202962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00180ae7e0 msgr2=0x7f00180c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.863+0000 7f001eb9d700 1 --2- 172.21.15.154:0/2274202962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00180ae7e0 0x7f00180c9db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0010009e90 tx=0x7f0010009780 comp rx=0 tx=0).stop 2023-10-10T21:20:08.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.864+0000 7f001eb9d700 1 -- 172.21.15.154:0/2274202962 shutdown_connections 2023-10-10T21:20:08.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.864+0000 7f001eb9d700 1 --2- 172.21.15.154:0/2274202962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00180ae7e0 0x7f00180c9db0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.864+0000 7f001eb9d700 1 -- 172.21.15.154:0/2274202962 >> 172.21.15.154:0/2274202962 conn(0x7f00180cc1e0 msgr2=0x7f00180cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:08.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.864+0000 7f001eb9d700 1 -- 172.21.15.154:0/2274202962 shutdown_connections 2023-10-10T21:20:08.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.864+0000 7f001eb9d700 1 -- 172.21.15.154:0/2274202962 wait complete. 2023-10-10T21:20:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.865+0000 7f001eb9d700 1 Processor -- start 2023-10-10T21:20:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.866+0000 7f001eb9d700 1 -- start start 2023-10-10T21:20:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.866+0000 7f001eb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001806f060 0x7f001815e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.866+0000 7f001eb9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00180ae7e0 0x7f0018155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.866+0000 7f001eb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00180cb1a0 0x7f0018158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.866+0000 7f001eb9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00180af770 con 0x7f00180ae7e0 2023-10-10T21:20:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.866+0000 7f001eb9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001815c640 con 0x7f00180cb1a0 2023-10-10T21:20:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.866+0000 7f001eb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001815c920 con 0x7f001806f060 2023-10-10T21:20:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001d39a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00180ae7e0 0x7f0018155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001db9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001806f060 0x7f001815e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001d39a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00180ae7e0 0x7f0018155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54068/0 (socket says 172.21.15.154:54068) 2023-10-10T21:20:08.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001d39a700 1 -- 172.21.15.154:0/2754911607 learned_addr learned my addr 172.21.15.154:0/2754911607 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:08.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001e39c700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00180cb1a0 0x7f0018158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:08.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001d39a700 1 -- 172.21.15.154:0/2754911607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001806f060 msgr2=0x7f001815e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001d39a700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001806f060 0x7f001815e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001d39a700 1 -- 172.21.15.154:0/2754911607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00180cb1a0 msgr2=0x7f0018158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:08.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001d39a700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00180cb1a0 0x7f0018158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:08.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001d39a700 1 -- 172.21.15.154:0/2754911607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010009a20 con 0x7f00180ae7e0 2023-10-10T21:20:08.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.867+0000 7f001db9b700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001806f060 0x7f001815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:08.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.868+0000 7f001d39a700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00180ae7e0 0x7f0018155140 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f000800c7c0 tx=0x7f0008007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.868+0000 7f000dffb700 1 -- 172.21.15.154:0/2754911607 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008011590 con 0x7f00180ae7e0 2023-10-10T21:20:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.868+0000 7f000dffb700 1 -- 172.21.15.154:0/2754911607 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00080116f0 con 0x7f00180ae7e0 2023-10-10T21:20:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.868+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00180af120 con 0x7f00180ae7e0 2023-10-10T21:20:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.868+0000 7f000dffb700 1 -- 172.21.15.154:0/2754911607 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008011ab0 con 0x7f00180ae7e0 2023-10-10T21:20:08.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.868+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0018155680 con 0x7f00180ae7e0 2023-10-10T21:20:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.869+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00180aef80 con 0x7f00180ae7e0 2023-10-10T21:20:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.871+0000 7f000dffb700 1 -- 172.21.15.154:0/2754911607 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f000801b3b0 con 0x7f00180ae7e0 2023-10-10T21:20:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.872+0000 7f000dffb700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efffc067170 0x7efffc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.872+0000 7f001db9b700 1 -- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efffc067170 msgr2=0x7efffc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:08.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.872+0000 7f000dffb700 1 -- 172.21.15.154:0/2754911607 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f0008084290 con 0x7f00180ae7e0 2023-10-10T21:20:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.872+0000 7f001db9b700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efffc067170 0x7efffc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:08.875+0000 7f000dffb700 1 -- 172.21.15.154:0/2754911607 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0008050f90 con 0x7f00180ae7e0 2023-10-10T21:20:08.932 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:08.931+0000 7f49b3a84180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:20:08.938 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:08.937+0000 7f29fb632180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:20:09.020 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:09.019+0000 7f49b3a84180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:20:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.073+0000 7f001db9b700 1 -- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efffc067170 msgr2=0x7efffc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.073+0000 7f001db9b700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efffc067170 0x7efffc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.074+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00180aef80 con 0x7f00180ae7e0 2023-10-10T21:20:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.075+0000 7f000dffb700 1 -- 172.21.15.154:0/2754911607 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00180aef80 con 0x7f00180ae7e0 2023-10-10T21:20:09.076 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.077+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efffc067170 msgr2=0x7efffc069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.077+0000 7f001eb9d700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efffc067170 0x7efffc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.077+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00180ae7e0 msgr2=0x7f0018155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.077+0000 7f001eb9d700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00180ae7e0 0x7f0018155140 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f000800c7c0 tx=0x7f0008007da0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.077+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 shutdown_connections 2023-10-10T21:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.077+0000 7f001eb9d700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7efffc067170 0x7efffc069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.077+0000 7f001eb9d700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00180cb1a0 0x7f0018158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.077+0000 7f001eb9d700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001806f060 0x7f001815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.077+0000 7f001eb9d700 1 --2- 172.21.15.154:0/2754911607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00180ae7e0 0x7f0018155140 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.078+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 >> 172.21.15.154:0/2754911607 conn(0x7f00180cc1e0 msgr2=0x7f0018069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.078+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 shutdown_connections 2023-10-10T21:20:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.078+0000 7f001eb9d700 1 -- 172.21.15.154:0/2754911607 wait complete. 2023-10-10T21:20:09.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:20:09.161 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:09.160+0000 7f29fb632180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:20:09.256 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:09.254+0000 7f49b3a84180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:20:09.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.288+0000 7ff49f59e700 1 Processor -- start 2023-10-10T21:20:09.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.288+0000 7ff49f59e700 1 -- start start 2023-10-10T21:20:09.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.289+0000 7ff49f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff4a0159a60 0x7ff4a00c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.289+0000 7ff49f59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff4a00ccc00 0x7ff4a0069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.289+0000 7ff49f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a006a020 0x7ff4a00cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.289+0000 7ff49f59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a006dfc0 con 0x7ff4a00ccc00 2023-10-10T21:20:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.289+0000 7ff49f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a00c9cb0 con 0x7ff4a0159a60 2023-10-10T21:20:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.289+0000 7ff49f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00c9f30 con 0x7ff4a006a020 2023-10-10T21:20:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff4a00ccc00 0x7ff4a0069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff4a00ccc00 0x7ff4a0069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54082/0 (socket says 172.21.15.154:54082) 2023-10-10T21:20:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49dd9b700 1 -- 172.21.15.154:0/1723415448 learned_addr learned my addr 172.21.15.154:0/1723415448 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49ed9d700 1 --2- 172.21.15.154:0/1723415448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a006a020 0x7ff4a00cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49e59c700 1 --2- 172.21.15.154:0/1723415448 >> v2:172.21.15.179:3300/0 conn(0x7ff4a0159a60 0x7ff4a00c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49dd9b700 1 -- 172.21.15.154:0/1723415448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a006a020 msgr2=0x7ff4a00cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49dd9b700 1 --2- 172.21.15.154:0/1723415448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a006a020 0x7ff4a00cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49dd9b700 1 -- 172.21.15.154:0/1723415448 >> v2:172.21.15.179:3300/0 conn(0x7ff4a0159a60 msgr2=0x7ff4a00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49dd9b700 1 --2- 172.21.15.154:0/1723415448 >> v2:172.21.15.179:3300/0 conn(0x7ff4a0159a60 0x7ff4a00c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49dd9b700 1 -- 172.21.15.154:0/1723415448 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a00ca470 con 0x7ff4a00ccc00 2023-10-10T21:20:09.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.290+0000 7ff49dd9b700 1 --2- 172.21.15.154:0/1723415448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4a00ccc00 0x7ff4a0069ae0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7ff4a006e510 tx=0x7ff494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969402d94440855f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49d59a700 1 -- 172.21.15.154:0/1723415448 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49400b6d0 con 0x7ff4a00ccc00 2023-10-10T21:20:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49d59a700 1 -- 172.21.15.154:0/1723415448 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49400b830 con 0x7ff4a00ccc00 2023-10-10T21:20:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49d59a700 1 -- 172.21.15.154:0/1723415448 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49400bbf0 con 0x7ff4a00ccc00 2023-10-10T21:20:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49f59e700 1 -- 172.21.15.154:0/1723415448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4a00ccc00 msgr2=0x7ff4a0069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49f59e700 1 --2- 172.21.15.154:0/1723415448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4a00ccc00 0x7ff4a0069ae0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7ff4a006e510 tx=0x7ff494009250 comp rx=0 tx=0).stop 2023-10-10T21:20:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49f59e700 1 -- 172.21.15.154:0/1723415448 shutdown_connections 2023-10-10T21:20:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49f59e700 1 --2- 172.21.15.154:0/1723415448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a006a020 0x7ff4a00cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49f59e700 1 --2- 172.21.15.154:0/1723415448 >> v2:172.21.15.179:3300/0 conn(0x7ff4a0159a60 0x7ff4a00c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49f59e700 1 --2- 172.21.15.154:0/1723415448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4a00ccc00 0x7ff4a0069ae0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49f59e700 1 -- 172.21.15.154:0/1723415448 >> 172.21.15.154:0/1723415448 conn(0x7ff4a006baa0 msgr2=0x7ff4a006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49f59e700 1 -- 172.21.15.154:0/1723415448 shutdown_connections 2023-10-10T21:20:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.291+0000 7ff49f59e700 1 -- 172.21.15.154:0/1723415448 wait complete. 2023-10-10T21:20:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.293+0000 7ff49f59e700 1 Processor -- start 2023-10-10T21:20:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.293+0000 7ff49f59e700 1 -- start start 2023-10-10T21:20:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a006a020 0x7ff4a01553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a00ccc00 0x7ff4a00b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4a0159a60 0x7ff4a0152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49f59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a0155c20 con 0x7ff4a0159a60 2023-10-10T21:20:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00c6210 con 0x7ff4a006a020 2023-10-10T21:20:09.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00c58e0 con 0x7ff4a00ccc00 2023-10-10T21:20:09.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49e59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a006a020 0x7ff4a01553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49e59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a006a020 0x7ff4a01553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:35910/0 (socket says 172.21.15.154:35910) 2023-10-10T21:20:09.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49e59c700 1 -- 172.21.15.154:0/753180267 learned_addr learned my addr 172.21.15.154:0/753180267 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:09.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49ed9d700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4a0159a60 0x7ff4a0152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.294+0000 7ff49dd9b700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a00ccc00 0x7ff4a00b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff49e59c700 1 -- 172.21.15.154:0/753180267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a00ccc00 msgr2=0x7ff4a00b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff49e59c700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a00ccc00 0x7ff4a00b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff49e59c700 1 -- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4a0159a60 msgr2=0x7ff4a0152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff49e59c700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4a0159a60 0x7ff4a0152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff49e59c700 1 -- 172.21.15.154:0/753180267 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940094f0 con 0x7ff4a006a020 2023-10-10T21:20:09.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff49e59c700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a006a020 0x7ff4a01553f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff49000e930 tx=0x7ff4900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:09.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff48e7fc700 1 -- 172.21.15.154:0/753180267 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490013680 con 0x7ff4a006a020 2023-10-10T21:20:09.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff48e7fc700 1 -- 172.21.15.154:0/753180267 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4900137e0 con 0x7ff4a006a020 2023-10-10T21:20:09.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a00c5bc0 con 0x7ff4a006a020 2023-10-10T21:20:09.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff48e7fc700 1 -- 172.21.15.154:0/753180267 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490013ba0 con 0x7ff4a006a020 2023-10-10T21:20:09.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.295+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a0155930 con 0x7ff4a006a020 2023-10-10T21:20:09.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.296+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a00c64f0 con 0x7ff4a006a020 2023-10-10T21:20:09.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.297+0000 7ff48e7fc700 1 -- 172.21.15.154:0/753180267 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7ff49000c3e0 con 0x7ff4a006a020 2023-10-10T21:20:09.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.298+0000 7ff48e7fc700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff480067170 0x7ff480069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.298+0000 7ff48e7fc700 1 -- 172.21.15.154:0/753180267 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7ff490084c70 con 0x7ff4a006a020 2023-10-10T21:20:09.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.299+0000 7ff49dd9b700 1 -- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff480067170 msgr2=0x7ff480069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:09.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.299+0000 7ff49dd9b700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff480067170 0x7ff480069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:09.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.302+0000 7ff48e7fc700 1 -- 172.21.15.154:0/753180267 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4900518f0 con 0x7ff4a006a020 2023-10-10T21:20:09.337 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:09.336+0000 7f29fb632180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:20:09.430 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:09.428+0000 7f29fb632180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:20:09.442 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:09.441+0000 7f49b3a84180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:20:09.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.500+0000 7ff49dd9b700 1 -- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff480067170 msgr2=0x7ff480069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:09.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.500+0000 7ff49dd9b700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff480067170 0x7ff480069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:09.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.503+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4a00ca130 con 0x7ff4a006a020 2023-10-10T21:20:09.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.503+0000 7ff48e7fc700 1 -- 172.21.15.154:0/753180267 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff490054f10 con 0x7ff4a006a020 2023-10-10T21:20:09.505 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:20:09.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff480067170 msgr2=0x7ff480069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff480067170 0x7ff480069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a006a020 msgr2=0x7ff4a01553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a006a020 0x7ff4a01553f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff49000e930 tx=0x7ff4900091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 shutdown_connections 2023-10-10T21:20:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4a0159a60 0x7ff4a0152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7ff480067170 0x7ff480069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a006a020 0x7ff4a01553f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 --2- 172.21.15.154:0/753180267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4a00ccc00 0x7ff4a00b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 >> 172.21.15.154:0/753180267 conn(0x7ff4a006baa0 msgr2=0x7ff4a00cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:09.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 shutdown_connections 2023-10-10T21:20:09.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.506+0000 7ff49f59e700 1 -- 172.21.15.154:0/753180267 wait complete. 2023-10-10T21:20:09.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:20:09.539 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:09.538+0000 7f49b3a84180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:20:09.592 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:09.591+0000 7f29fb632180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:20:09.692 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:09.690+0000 7f29fb632180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:20:09.711 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:09.710+0000 7f49b3a84180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:20:09.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.719+0000 7f5eb179d700 1 Processor -- start 2023-10-10T21:20:09.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.719+0000 7f5eb179d700 1 -- start start 2023-10-10T21:20:09.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.720+0000 7f5eb179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 0x7f5eac0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.720+0000 7f5eb179d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac0cfb00 con 0x7f5eac0b16d0 2023-10-10T21:20:09.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.720+0000 7f5eb179d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac15e060 con 0x7f5eac0b1b40 2023-10-10T21:20:09.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.720+0000 7f5eb179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0b5c40 con 0x7f5eac0b4e70 2023-10-10T21:20:09.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.720+0000 7f5eab7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5eac0b16d0 0x7f5eac15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37230/0 (socket says 172.21.15.154:37230) 2023-10-10T21:20:09.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.720+0000 7f5eab7fe700 1 -- 172.21.15.154:0/1640365888 learned_addr learned my addr 172.21.15.154:0/1640365888 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:09.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.720+0000 7f5eabfff700 1 --2- 172.21.15.154:0/1640365888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 0x7f5eac0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.721+0000 7f5eaaffd700 1 -- 172.21.15.154:0/1640365888 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016945755 0 0) 0x7f5eac0cfb00 con 0x7f5eac0b16d0 2023-10-10T21:20:09.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.721+0000 7f5eaaffd700 1 -- 172.21.15.154:0/1640365888 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e94003570 con 0x7f5eac0b16d0 2023-10-10T21:20:09.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.721+0000 7f5eaaffd700 1 -- 172.21.15.154:0/1640365888 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709254323 0 0) 0x7f5eac15e060 con 0x7f5eac0b1b40 2023-10-10T21:20:09.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.721+0000 7f5eaaffd700 1 -- 172.21.15.154:0/1640365888 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eac0cfb00 con 0x7f5eac0b1b40 2023-10-10T21:20:09.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.721+0000 7f5eabfff700 1 -- 172.21.15.154:0/1640365888 >> v1:172.21.15.179:6789/0 conn(0x7f5eac0b1b40 legacy=0x7f5eac15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.721+0000 7f5eabfff700 1 -- 172.21.15.154:0/1640365888 >> v1:172.21.15.154:6789/0 conn(0x7f5eac0b16d0 legacy=0x7f5eac15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.721+0000 7f5eabfff700 1 -- 172.21.15.154:0/1640365888 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac0b5f20 con 0x7f5eac0b4e70 2023-10-10T21:20:09.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.721+0000 7f5eabfff700 1 --2- 172.21.15.154:0/1640365888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 0x7f5eac0ccff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009910 tx=0x7f5e9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcf6b7eedf744db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:09.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eaaffd700 1 -- 172.21.15.154:0/1640365888 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c011630 con 0x7f5eac0b4e70 2023-10-10T21:20:09.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eaaffd700 1 -- 172.21.15.154:0/1640365888 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c011790 con 0x7f5eac0b4e70 2023-10-10T21:20:09.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eaaffd700 1 -- 172.21.15.154:0/1640365888 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c011b30 con 0x7f5eac0b4e70 2023-10-10T21:20:09.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eb179d700 1 -- 172.21.15.154:0/1640365888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 msgr2=0x7f5eac0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eb179d700 1 --2- 172.21.15.154:0/1640365888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 0x7f5eac0ccff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009910 tx=0x7f5e9c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eb179d700 1 -- 172.21.15.154:0/1640365888 shutdown_connections 2023-10-10T21:20:09.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eb179d700 1 --2- 172.21.15.154:0/1640365888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 0x7f5eac0ccff0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eb179d700 1 -- 172.21.15.154:0/1640365888 >> 172.21.15.154:0/1640365888 conn(0x7f5eac0d10c0 msgr2=0x7f5eac0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:09.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eb179d700 1 -- 172.21.15.154:0/1640365888 shutdown_connections 2023-10-10T21:20:09.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.722+0000 7f5eb179d700 1 -- 172.21.15.154:0/1640365888 wait complete. 2023-10-10T21:20:09.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.724+0000 7f5eb179d700 1 Processor -- start 2023-10-10T21:20:09.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.724+0000 7f5eb179d700 1 -- start start 2023-10-10T21:20:09.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eb179d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac0b16d0 0x7f5eac15cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eb179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eac0b1b40 0x7f5eac148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eb179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 0x7f5eac1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eb179d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac16a730 con 0x7f5eac0b16d0 2023-10-10T21:20:09.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eb179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac1498e0 con 0x7f5eac0b1b40 2023-10-10T21:20:09.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eb179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac169e40 con 0x7f5eac0b4e70 2023-10-10T21:20:09.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eabfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac0b16d0 0x7f5eac15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eabfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac0b16d0 0x7f5eac15cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54104/0 (socket says 172.21.15.154:54104) 2023-10-10T21:20:09.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eabfff700 1 -- 172.21.15.154:0/2117208331 learned_addr learned my addr 172.21.15.154:0/2117208331 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:09.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eab7fe700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eac0b1b40 0x7f5eac148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eb0f9c700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 0x7f5eac1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:09.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eabfff700 1 -- 172.21.15.154:0/2117208331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 msgr2=0x7f5eac1493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eabfff700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 0x7f5eac1493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eabfff700 1 -- 172.21.15.154:0/2117208331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eac0b1b40 msgr2=0x7f5eac148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eabfff700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eac0b1b40 0x7f5eac148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.725+0000 7f5eabfff700 1 -- 172.21.15.154:0/2117208331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c009420 con 0x7f5eac0b16d0 2023-10-10T21:20:09.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.726+0000 7f5eab7fe700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eac0b1b40 0x7f5eac148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:09.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.726+0000 7f5eabfff700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac0b16d0 0x7f5eac15cb90 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5eac070dd0 tx=0x7f5e9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:09.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.726+0000 7f5e93fff700 1 -- 172.21.15.154:0/2117208331 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c01f070 con 0x7f5eac0b16d0 2023-10-10T21:20:09.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.726+0000 7f5e93fff700 1 -- 172.21.15.154:0/2117208331 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c002f70 con 0x7f5eac0b16d0 2023-10-10T21:20:09.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.726+0000 7f5eb179d700 1 -- 172.21.15.154:0/2117208331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac16a0e0 con 0x7f5eac0b16d0 2023-10-10T21:20:09.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.726+0000 7f5e93fff700 1 -- 172.21.15.154:0/2117208331 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c011b30 con 0x7f5eac0b16d0 2023-10-10T21:20:09.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.726+0000 7f5eb179d700 1 -- 172.21.15.154:0/2117208331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac14cda0 con 0x7f5eac0b16d0 2023-10-10T21:20:09.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.727+0000 7f5e91ffb700 1 -- 172.21.15.154:0/2117208331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac088990 con 0x7f5eac0b16d0 2023-10-10T21:20:09.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.729+0000 7f5e93fff700 1 -- 172.21.15.154:0/2117208331 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f5e9c0193b0 con 0x7f5eac0b16d0 2023-10-10T21:20:09.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.729+0000 7f5e93fff700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e98067170 0x7f5e98069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:09.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.730+0000 7f5eab7fe700 1 -- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e98067170 msgr2=0x7f5e98069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:09.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.730+0000 7f5e93fff700 1 -- 172.21.15.154:0/2117208331 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f5e9c086270 con 0x7f5eac0b16d0 2023-10-10T21:20:09.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.730+0000 7f5eab7fe700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e98067170 0x7f5e98069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:09.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.732+0000 7f5e93fff700 1 -- 172.21.15.154:0/2117208331 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e9c052ea0 con 0x7f5eac0b16d0 2023-10-10T21:20:09.818 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:09.817+0000 7f49b3a84180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:20:09.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.931+0000 7f5eab7fe700 1 -- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e98067170 msgr2=0x7f5e98069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:09.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.931+0000 7f5eab7fe700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e98067170 0x7f5e98069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:09.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.932+0000 7f5e91ffb700 1 -- 172.21.15.154:0/2117208331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5eac04bb80 con 0x7f5eac0b16d0 2023-10-10T21:20:09.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.932+0000 7f5e93fff700 1 -- 172.21.15.154:0/2117208331 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e9c0280a0 con 0x7f5eac0b16d0 2023-10-10T21:20:09.934 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:20:09.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.934+0000 7f5e91ffb700 1 -- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e98067170 msgr2=0x7f5e98069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:09.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.934+0000 7f5e91ffb700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e98067170 0x7f5e98069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.934+0000 7f5e91ffb700 1 -- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac0b16d0 msgr2=0x7f5eac15cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:09.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.934+0000 7f5e91ffb700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac0b16d0 0x7f5eac15cb90 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5eac070dd0 tx=0x7f5e9c017000 comp rx=0 tx=0).stop 2023-10-10T21:20:09.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.935+0000 7f5e91ffb700 1 -- 172.21.15.154:0/2117208331 shutdown_connections 2023-10-10T21:20:09.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.935+0000 7f5e91ffb700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5eac0b4e70 0x7f5eac1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.935+0000 7f5e91ffb700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac0b16d0 0x7f5eac15cb90 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.935+0000 7f5e91ffb700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5e98067170 0x7f5e98069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.935+0000 7f5e91ffb700 1 --2- 172.21.15.154:0/2117208331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5eac0b1b40 0x7f5eac148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:09.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.935+0000 7f5e91ffb700 1 -- 172.21.15.154:0/2117208331 >> 172.21.15.154:0/2117208331 conn(0x7f5eac0d10c0 msgr2=0x7f5eac15da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:09.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.935+0000 7f5e91ffb700 1 -- 172.21.15.154:0/2117208331 shutdown_connections 2023-10-10T21:20:09.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:09.935+0000 7f5e91ffb700 1 -- 172.21.15.154:0/2117208331 wait complete. 2023-10-10T21:20:09.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:20:10.179 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:10.177+0000 7f29fb632180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:20:10.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.185+0000 7f207739d700 1 Processor -- start 2023-10-10T21:20:10.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.185+0000 7f207739d700 1 -- start start 2023-10-10T21:20:10.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.186+0000 7f207739d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 0x7f207015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.186+0000 7f207739d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20700b2980 con 0x7f20701597f0 2023-10-10T21:20:10.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.186+0000 7f207739d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207015dbb0 con 0x7f2070159420 2023-10-10T21:20:10.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.186+0000 7f207739d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700b11d0 con 0x7f207015d230 2023-10-10T21:20:10.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.186+0000 7f2075b9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f20701597f0 0x7f20700b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37244/0 (socket says 172.21.15.154:37244) 2023-10-10T21:20:10.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.186+0000 7f2075b9a700 1 -- 172.21.15.154:0/3525579182 learned_addr learned my addr 172.21.15.154:0/3525579182 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:10.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.186+0000 7f2076b9c700 1 --2- 172.21.15.154:0/3525579182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 0x7f207015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.187+0000 7f2075399700 1 -- 172.21.15.154:0/3525579182 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039786725 0 0) 0x7f20700b2980 con 0x7f20701597f0 2023-10-10T21:20:10.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.187+0000 7f2075399700 1 -- 172.21.15.154:0/3525579182 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f205c003570 con 0x7f20701597f0 2023-10-10T21:20:10.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.187+0000 7f2075399700 1 -- 172.21.15.154:0/3525579182 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905784929 0 0) 0x7f207015dbb0 con 0x7f2070159420 2023-10-10T21:20:10.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.187+0000 7f2075399700 1 -- 172.21.15.154:0/3525579182 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20700b2980 con 0x7f2070159420 2023-10-10T21:20:10.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.187+0000 7f2076b9c700 1 -- 172.21.15.154:0/3525579182 >> v1:172.21.15.179:6789/0 conn(0x7f2070159420 legacy=0x7f20700b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.187+0000 7f2076b9c700 1 -- 172.21.15.154:0/3525579182 >> v1:172.21.15.154:6789/0 conn(0x7f20701597f0 legacy=0x7f20700b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.187+0000 7f2076b9c700 1 -- 172.21.15.154:0/3525579182 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20700b14b0 con 0x7f207015d230 2023-10-10T21:20:10.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.187+0000 7f2076b9c700 1 --2- 172.21.15.154:0/3525579182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 0x7f207015d670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2068009e90 tx=0x7f2068009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3a4d07d8457e65c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:10.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f2075399700 1 -- 172.21.15.154:0/3525579182 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206800e070 con 0x7f207015d230 2023-10-10T21:20:10.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f2075399700 1 -- 172.21.15.154:0/3525579182 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206800bb80 con 0x7f207015d230 2023-10-10T21:20:10.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f2075399700 1 -- 172.21.15.154:0/3525579182 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068012430 con 0x7f207015d230 2023-10-10T21:20:10.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f207739d700 1 -- 172.21.15.154:0/3525579182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 msgr2=0x7f207015d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f207739d700 1 --2- 172.21.15.154:0/3525579182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 0x7f207015d670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2068009e90 tx=0x7f2068009780 comp rx=0 tx=0).stop 2023-10-10T21:20:10.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f207739d700 1 -- 172.21.15.154:0/3525579182 shutdown_connections 2023-10-10T21:20:10.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f207739d700 1 --2- 172.21.15.154:0/3525579182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 0x7f207015d670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f207739d700 1 -- 172.21.15.154:0/3525579182 >> 172.21.15.154:0/3525579182 conn(0x7f20700d0660 msgr2=0x7f20700d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:10.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f207739d700 1 -- 172.21.15.154:0/3525579182 shutdown_connections 2023-10-10T21:20:10.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.188+0000 7f207739d700 1 -- 172.21.15.154:0/3525579182 wait complete. 2023-10-10T21:20:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.190+0000 7f207739d700 1 Processor -- start 2023-10-10T21:20:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.190+0000 7f207739d700 1 -- start start 2023-10-10T21:20:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f207739d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2070159420 0x7f20701697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f207739d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20701597f0 0x7f207015b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f207739d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 0x7f20700b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f207739d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207015b890 con 0x7f20701597f0 2023-10-10T21:20:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f207739d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20701551a0 con 0x7f2070159420 2023-10-10T21:20:10.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f207739d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2070169e60 con 0x7f207015d230 2023-10-10T21:20:10.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f2075b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20701597f0 0x7f207015b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f2075b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20701597f0 0x7f207015b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54110/0 (socket says 172.21.15.154:54110) 2023-10-10T21:20:10.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f2075b9a700 1 -- 172.21.15.154:0/870014042 learned_addr learned my addr 172.21.15.154:0/870014042 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:10.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f207639b700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2070159420 0x7f20701697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f2076b9c700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 0x7f20700b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f2075b9a700 1 -- 172.21.15.154:0/870014042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 msgr2=0x7f20700b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f2075b9a700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 0x7f20700b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f2075b9a700 1 -- 172.21.15.154:0/870014042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2070159420 msgr2=0x7f20701697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f2075b9a700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2070159420 0x7f20701697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.191+0000 7f2075b9a700 1 -- 172.21.15.154:0/870014042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2068009a20 con 0x7f20701597f0 2023-10-10T21:20:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.192+0000 7f2075b9a700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20701597f0 0x7f207015b000 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f206000c790 tx=0x7f2060007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.192+0000 7f20667fc700 1 -- 172.21.15.154:0/870014042 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060005b30 con 0x7f20701597f0 2023-10-10T21:20:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.192+0000 7f20667fc700 1 -- 172.21.15.154:0/870014042 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060005c90 con 0x7f20701597f0 2023-10-10T21:20:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.192+0000 7f20667fc700 1 -- 172.21.15.154:0/870014042 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060007320 con 0x7f20701597f0 2023-10-10T21:20:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.192+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207016a140 con 0x7f20701597f0 2023-10-10T21:20:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.192+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207016a700 con 0x7f20701597f0 2023-10-10T21:20:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.193+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207015b650 con 0x7f20701597f0 2023-10-10T21:20:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.194+0000 7f20667fc700 1 -- 172.21.15.154:0/870014042 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f206001b3b0 con 0x7f20701597f0 2023-10-10T21:20:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.195+0000 7f20667fc700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2054067170 0x7f2054069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.195+0000 7f20667fc700 1 -- 172.21.15.154:0/870014042 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f20600840d0 con 0x7f20701597f0 2023-10-10T21:20:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.195+0000 7f207639b700 1 -- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2054067170 msgr2=0x7f2054069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.195+0000 7f207639b700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2054067170 0x7f2054069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.199+0000 7f20667fc700 1 -- 172.21.15.154:0/870014042 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2060050d50 con 0x7f20701597f0 2023-10-10T21:20:10.274 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:10.272+0000 7f29fb632180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:20:10.328 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:10.327+0000 7f49b3a84180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:20:10.363 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:10.361+0000 7f29fb632180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:20:10.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.396+0000 7f207639b700 1 -- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2054067170 msgr2=0x7f2054069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:10.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.396+0000 7f207639b700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2054067170 0x7f2054069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:10.429 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:10.427+0000 7f49b3a84180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:20:10.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.448+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f207004c3c0 con 0x7f20701597f0 2023-10-10T21:20:10.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.448+0000 7f20667fc700 1 -- 172.21.15.154:0/870014042 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f2060017090 con 0x7f20701597f0 2023-10-10T21:20:10.450 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:10.450 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1983002927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1983002927},{"type":"v1","addr":"172.21.15.179:6835","nonce":1983002927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3483729269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3483729269},{"type":"v1","addr":"172.21.15.179:6834","nonce":3483729269}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3602154448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3602154448},{"type":"v1","addr":"172.21.15.154:6837","nonce":3602154448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:43.589800+0000","modified":"2023-10-10T21:18:47.153053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/2335601961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2335601961},{"type":"v1","addr":"172.21.15.154:6835","nonce":2335601961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-10T21:20:10.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2054067170 msgr2=0x7f2054069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:10.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2054067170 0x7f2054069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20701597f0 msgr2=0x7f207015b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20701597f0 0x7f207015b000 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f206000c790 tx=0x7f2060007e20 comp rx=0 tx=0).stop 2023-10-10T21:20:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 shutdown_connections 2023-10-10T21:20:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f207015d230 0x7f20700b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f2054067170 0x7f2054069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2070159420 0x7f20701697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 --2- 172.21.15.154:0/870014042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20701597f0 0x7f207015b000 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 >> 172.21.15.154:0/870014042 conn(0x7f20700d0660 msgr2=0x7f2070157190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 shutdown_connections 2023-10-10T21:20:10.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.451+0000 7f207739d700 1 -- 172.21.15.154:0/870014042 wait complete. 2023-10-10T21:20:10.455 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 45 2023-10-10T21:20:10.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:20:10.525 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:10.524+0000 7f49b3a84180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:20:10.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.656+0000 7f10a759e700 1 Processor -- start 2023-10-10T21:20:10.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.656+0000 7f10a759e700 1 -- start start 2023-10-10T21:20:10.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a759e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f10a81595a0 0x7f10a80b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a80c6c60 0x7f10a80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10a80b1de0 0x7f10a80c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a759e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a80b2b90 con 0x7f10a80b1de0 2023-10-10T21:20:10.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a759e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a80b1410 con 0x7f10a81595a0 2023-10-10T21:20:10.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8063230 con 0x7f10a80c6c60 2023-10-10T21:20:10.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a6d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10a80b1de0 0x7f10a80c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a6d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10a80b1de0 0x7f10a80c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54116/0 (socket says 172.21.15.154:54116) 2023-10-10T21:20:10.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a6d9d700 1 -- 172.21.15.154:0/2987251316 learned_addr learned my addr 172.21.15.154:0/2987251316 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:10.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a659c700 1 --2- 172.21.15.154:0/2987251316 >> v2:172.21.15.179:3300/0 conn(0x7f10a81595a0 0x7f10a80b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a5d9b700 1 --2- 172.21.15.154:0/2987251316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a80c6c60 0x7f10a80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a6d9d700 1 -- 172.21.15.154:0/2987251316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a80c6c60 msgr2=0x7f10a80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:10.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.658+0000 7f10a6d9d700 1 --2- 172.21.15.154:0/2987251316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a80c6c60 0x7f10a80c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.659+0000 7f10a6d9d700 1 -- 172.21.15.154:0/2987251316 >> v2:172.21.15.179:3300/0 conn(0x7f10a81595a0 msgr2=0x7f10a80b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:10.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.659+0000 7f10a6d9d700 1 --2- 172.21.15.154:0/2987251316 >> v2:172.21.15.179:3300/0 conn(0x7f10a81595a0 0x7f10a80b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.659+0000 7f10a6d9d700 1 -- 172.21.15.154:0/2987251316 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a80634f0 con 0x7f10a80b1de0 2023-10-10T21:20:10.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.659+0000 7f10a6d9d700 1 --2- 172.21.15.154:0/2987251316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 0x7f10a80c8660 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f10a80c8d10 tx=0x7f10a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52be93f870d04ace server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:10.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.659+0000 7f10a559a700 1 -- 172.21.15.154:0/2987251316 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a000e070 con 0x7f10a80b1de0 2023-10-10T21:20:10.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.659+0000 7f10a559a700 1 -- 172.21.15.154:0/2987251316 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a000b970 con 0x7f10a80b1de0 2023-10-10T21:20:10.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.659+0000 7f10a559a700 1 -- 172.21.15.154:0/2987251316 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00092e0 con 0x7f10a80b1de0 2023-10-10T21:20:10.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.660+0000 7f10a759e700 1 -- 172.21.15.154:0/2987251316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 msgr2=0x7f10a80c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.660+0000 7f10a759e700 1 --2- 172.21.15.154:0/2987251316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 0x7f10a80c8660 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f10a80c8d10 tx=0x7f10a0009840 comp rx=0 tx=0).stop 2023-10-10T21:20:10.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.660+0000 7f10a759e700 1 -- 172.21.15.154:0/2987251316 shutdown_connections 2023-10-10T21:20:10.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.660+0000 7f10a759e700 1 --2- 172.21.15.154:0/2987251316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 0x7f10a80c8660 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.660+0000 7f10a759e700 1 --2- 172.21.15.154:0/2987251316 >> v2:172.21.15.179:3300/0 conn(0x7f10a81595a0 0x7f10a80b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.660+0000 7f10a759e700 1 --2- 172.21.15.154:0/2987251316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a80c6c60 0x7f10a80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.660+0000 7f10a759e700 1 -- 172.21.15.154:0/2987251316 >> 172.21.15.154:0/2987251316 conn(0x7f10a806ddb0 msgr2=0x7f10a806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:10.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.660+0000 7f10a759e700 1 -- 172.21.15.154:0/2987251316 shutdown_connections 2023-10-10T21:20:10.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.660+0000 7f10a759e700 1 -- 172.21.15.154:0/2987251316 wait complete. 2023-10-10T21:20:10.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.662+0000 7f10a759e700 1 Processor -- start 2023-10-10T21:20:10.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.662+0000 7f10a759e700 1 -- start start 2023-10-10T21:20:10.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 0x7f10a81457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a80c6c60 0x7f10a806e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a81595a0 0x7f10a806e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8145cf0 con 0x7f10a80b1de0 2023-10-10T21:20:10.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8169970 con 0x7f10a80c6c60 2023-10-10T21:20:10.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a816a4e0 con 0x7f10a81595a0 2023-10-10T21:20:10.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 0x7f10a81457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 0x7f10a81457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54132/0 (socket says 172.21.15.154:54132) 2023-10-10T21:20:10.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a659c700 1 -- 172.21.15.154:0/1700932619 learned_addr learned my addr 172.21.15.154:0/1700932619 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:10.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a5d9b700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a80c6c60 0x7f10a806e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a6d9d700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a81595a0 0x7f10a806e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:10.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a659c700 1 -- 172.21.15.154:0/1700932619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a81595a0 msgr2=0x7f10a806e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a659c700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a81595a0 0x7f10a806e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a659c700 1 -- 172.21.15.154:0/1700932619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a80c6c60 msgr2=0x7f10a806e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a659c700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a80c6c60 0x7f10a806e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.664+0000 7f10a659c700 1 -- 172.21.15.154:0/1700932619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0009ae0 con 0x7f10a80b1de0 2023-10-10T21:20:10.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.665+0000 7f10a659c700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 0x7f10a81457b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f109800e930 tx=0x7f10980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:10.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.665+0000 7f10967fc700 1 -- 172.21.15.154:0/1700932619 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098013680 con 0x7f10a80b1de0 2023-10-10T21:20:10.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.665+0000 7f10967fc700 1 -- 172.21.15.154:0/1700932619 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10980137e0 con 0x7f10a80b1de0 2023-10-10T21:20:10.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.665+0000 7f10967fc700 1 -- 172.21.15.154:0/1700932619 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098013b80 con 0x7f10a80b1de0 2023-10-10T21:20:10.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.665+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a8152170 con 0x7f10a80b1de0 2023-10-10T21:20:10.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.665+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a8169c30 con 0x7f10a80b1de0 2023-10-10T21:20:10.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.666+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a804c3c0 con 0x7f10a80b1de0 2023-10-10T21:20:10.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.667+0000 7f10967fc700 1 -- 172.21.15.154:0/1700932619 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f10980253d0 con 0x7f10a80b1de0 2023-10-10T21:20:10.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.668+0000 7f10967fc700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1088067170 0x7f1088069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:10.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.668+0000 7f10967fc700 1 -- 172.21.15.154:0/1700932619 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f10980853b0 con 0x7f10a80b1de0 2023-10-10T21:20:10.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.668+0000 7f10a5d9b700 1 -- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1088067170 msgr2=0x7f1088069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:10.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.668+0000 7f10a5d9b700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1088067170 0x7f1088069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:10.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.671+0000 7f10967fc700 1 -- 172.21.15.154:0/1700932619 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10980520b0 con 0x7f10a80b1de0 2023-10-10T21:20:10.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.866+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10a80637d0 con 0x7f10a80b1de0 2023-10-10T21:20:10.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.867+0000 7f10967fc700 1 -- 172.21.15.154:0/1700932619 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16477 (secure 0 0 0) 0x7f10980556d0 con 0x7f10a80b1de0 2023-10-10T21:20:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:10.869 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":112,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:20:05.388577+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:41.726498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:42.567446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/85496":"2023-10-11T21:19:04.287290+0000","172.21.15.154:6834/85496":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/3617467829":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/1080071568":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/2988501796":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/2592465931":"2023-10-11T21:19:04.287290+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:20:10.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.869+0000 7f10a5d9b700 1 -- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1088067170 msgr2=0x7f1088069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:10.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.869+0000 7f10a5d9b700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1088067170 0x7f1088069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:10.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1088067170 msgr2=0x7f1088069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:10.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1088067170 0x7f1088069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 msgr2=0x7f10a81457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:10.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 0x7f10a81457b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f109800e930 tx=0x7f10980091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 shutdown_connections 2023-10-10T21:20:10.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a81595a0 0x7f10a806e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a80b1de0 0x7f10a81457b0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1088067170 0x7f1088069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 --2- 172.21.15.154:0/1700932619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a80c6c60 0x7f10a806e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:10.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 >> 172.21.15.154:0/1700932619 conn(0x7f10a806ddb0 msgr2=0x7f10a80c8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:10.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 shutdown_connections 2023-10-10T21:20:10.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:10.870+0000 7f10a759e700 1 -- 172.21.15.154:0/1700932619 wait complete. 2023-10-10T21:20:10.890 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T21:20:10.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:20:10.985 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:10.983+0000 7f29fb632180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:20:11.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.100+0000 7f12e939d700 1 Processor -- start 2023-10-10T21:20:11.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.100+0000 7f12e939d700 1 -- start start 2023-10-10T21:20:11.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.102+0000 7f12e939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415daa0 0x7f12e406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.103+0000 7f12e939d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12e415de70 0x7f12e40c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.103+0000 7f12e939d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e406e8c0 con 0x7f12e40696c0 2023-10-10T21:20:11.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.103+0000 7f12e939d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e40ca740 con 0x7f12e415de70 2023-10-10T21:20:11.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.103+0000 7f12e939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e406e5e0 con 0x7f12e415daa0 2023-10-10T21:20:11.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.103+0000 7f12e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415daa0 0x7f12e406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.103+0000 7f12e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415daa0 0x7f12e406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:60132/0 (socket says 172.21.15.154:60132) 2023-10-10T21:20:11.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.103+0000 7f12e3fff700 1 -- 172.21.15.154:0/327744829 learned_addr learned my addr 172.21.15.154:0/327744829 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:11.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.103+0000 7f12e37fe700 1 --2- 172.21.15.154:0/327744829 >> v2:172.21.15.154:3300/0 conn(0x7f12e415de70 0x7f12e40c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.104+0000 7f12e3fff700 1 -- 172.21.15.154:0/327744829 >> v2:172.21.15.154:3300/0 conn(0x7f12e415de70 msgr2=0x7f12e40c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:11.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.104+0000 7f12e3fff700 1 --2- 172.21.15.154:0/327744829 >> v2:172.21.15.154:3300/0 conn(0x7f12e415de70 0x7f12e40c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.104+0000 7f12e3fff700 1 -- 172.21.15.154:0/327744829 >> v1:172.21.15.179:6789/0 conn(0x7f12e40696c0 legacy=0x7f12e406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.104+0000 7f12e3fff700 1 -- 172.21.15.154:0/327744829 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e40ca0f0 con 0x7f12e415daa0 2023-10-10T21:20:11.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.104+0000 7f12e3fff700 1 --2- 172.21.15.154:0/327744829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415daa0 0x7f12e406e000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0099b0 tx=0x7f12dc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e323fc489283c195 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:11.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.104+0000 7f12e2ffd700 1 -- 172.21.15.154:0/327744829 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00b860 con 0x7f12e415daa0 2023-10-10T21:20:11.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.104+0000 7f12e2ffd700 1 -- 172.21.15.154:0/327744829 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00b9c0 con 0x7f12e415daa0 2023-10-10T21:20:11.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.104+0000 7f12e2ffd700 1 -- 172.21.15.154:0/327744829 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00bd60 con 0x7f12e415daa0 2023-10-10T21:20:11.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.105+0000 7f12e939d700 1 -- 172.21.15.154:0/327744829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415daa0 msgr2=0x7f12e406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.105+0000 7f12e939d700 1 --2- 172.21.15.154:0/327744829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415daa0 0x7f12e406e000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0099b0 tx=0x7f12dc009250 comp rx=0 tx=0).stop 2023-10-10T21:20:11.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.105+0000 7f12e939d700 1 -- 172.21.15.154:0/327744829 shutdown_connections 2023-10-10T21:20:11.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.105+0000 7f12e939d700 1 --2- 172.21.15.154:0/327744829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415daa0 0x7f12e406e000 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.105+0000 7f12e939d700 1 --2- 172.21.15.154:0/327744829 >> v2:172.21.15.154:3300/0 conn(0x7f12e415de70 0x7f12e40c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.105+0000 7f12e939d700 1 -- 172.21.15.154:0/327744829 >> 172.21.15.154:0/327744829 conn(0x7f12e40cc1f0 msgr2=0x7f12e40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:11.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.105+0000 7f12e939d700 1 -- 172.21.15.154:0/327744829 shutdown_connections 2023-10-10T21:20:11.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.105+0000 7f12e939d700 1 -- 172.21.15.154:0/327744829 wait complete. 2023-10-10T21:20:11.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.108+0000 7f12e939d700 1 Processor -- start 2023-10-10T21:20:11.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.108+0000 7f12e939d700 1 -- start start 2023-10-10T21:20:11.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e939d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12e40696c0 0x7f12e4187630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e939d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e415daa0 0x7f12e40b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415de70 0x7f12e4147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e939d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4149300 con 0x7f12e40696c0 2023-10-10T21:20:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e939d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4148fb0 con 0x7f12e415daa0 2023-10-10T21:20:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e41481e0 con 0x7f12e415de70 2023-10-10T21:20:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e37fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e415daa0 0x7f12e40b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12e40696c0 0x7f12e4187630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e37fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e415daa0 0x7f12e40b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:35956/0 (socket says 172.21.15.154:35956) 2023-10-10T21:20:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e37fe700 1 -- 172.21.15.154:0/722143911 learned_addr learned my addr 172.21.15.154:0/722143911 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.110+0000 7f12e8b9c700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415de70 0x7f12e4147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.111+0000 7f12e37fe700 1 -- 172.21.15.154:0/722143911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415de70 msgr2=0x7f12e4147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.111+0000 7f12e37fe700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415de70 0x7f12e4147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.111+0000 7f12e37fe700 1 -- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12e40696c0 msgr2=0x7f12e4187630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.111+0000 7f12e37fe700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12e40696c0 0x7f12e4187630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.111+0000 7f12e37fe700 1 -- 172.21.15.154:0/722143911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0094f0 con 0x7f12e415daa0 2023-10-10T21:20:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.112+0000 7f12e37fe700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e415daa0 0x7f12e40b13e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00e160 tx=0x7f12cc009900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.112+0000 7f12dbfff700 1 -- 172.21.15.154:0/722143911 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00ecf0 con 0x7f12e415daa0 2023-10-10T21:20:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.112+0000 7f12dbfff700 1 -- 172.21.15.154:0/722143911 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc00ee50 con 0x7f12e415daa0 2023-10-10T21:20:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.112+0000 7f12dbfff700 1 -- 172.21.15.154:0/722143911 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc014670 con 0x7f12e415daa0 2023-10-10T21:20:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.112+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e41484c0 con 0x7f12e415daa0 2023-10-10T21:20:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.112+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e4147330 con 0x7f12e415daa0 2023-10-10T21:20:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.114+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e404c3c0 con 0x7f12e415daa0 2023-10-10T21:20:11.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.114+0000 7f12dbfff700 1 -- 172.21.15.154:0/722143911 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f12cc0149e0 con 0x7f12e415daa0 2023-10-10T21:20:11.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.115+0000 7f12dbfff700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f12c40672c0 0x7f12c4069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.115+0000 7f12dbfff700 1 -- 172.21.15.154:0/722143911 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f12cc085260 con 0x7f12e415daa0 2023-10-10T21:20:11.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.115+0000 7f12e3fff700 1 -- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f12c40672c0 msgr2=0x7f12c4069770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:11.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.115+0000 7f12e3fff700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f12c40672c0 0x7f12c4069770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.119+0000 7f12dbfff700 1 -- 172.21.15.154:0/722143911 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12cc051f60 con 0x7f12e415daa0 2023-10-10T21:20:11.160 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:11.159+0000 7f29fb632180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:20:11.179 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:11.178+0000 7f49b3a84180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:20:11.256 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:11.254+0000 7f29fb632180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:20:11.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.316+0000 7f12e3fff700 1 -- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f12c40672c0 msgr2=0x7f12c4069770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:11.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.316+0000 7f12e3fff700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f12c40672c0 0x7f12c4069770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:11.357 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:11.356+0000 7f49b3a84180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:20:11.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.362+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12e40ca3d0 con 0x7f12e415daa0 2023-10-10T21:20:11.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.363+0000 7f12dbfff700 1 -- 172.21.15.154:0/722143911 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f12cc055580 con 0x7f12e415daa0 2023-10-10T21:20:11.364 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:11.365 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1983002927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1983002927},{"type":"v1","addr":"172.21.15.179:6835","nonce":1983002927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3483729269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3483729269},{"type":"v1","addr":"172.21.15.179:6834","nonce":3483729269}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3602154448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3602154448},{"type":"v1","addr":"172.21.15.154:6837","nonce":3602154448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:43.589800+0000","modified":"2023-10-10T21:18:47.153053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/2335601961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2335601961},{"type":"v1","addr":"172.21.15.154:6835","nonce":2335601961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-10T21:20:11.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f12c40672c0 msgr2=0x7f12c4069770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:11.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f12c40672c0 0x7f12c4069770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e415daa0 msgr2=0x7f12e40b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e415daa0 0x7f12e40b13e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00e160 tx=0x7f12cc009900 comp rx=0 tx=0).stop 2023-10-10T21:20:11.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 shutdown_connections 2023-10-10T21:20:11.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e415de70 0x7f12e4147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12e40696c0 0x7f12e4187630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f12c40672c0 0x7f12c4069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 --2- 172.21.15.154:0/722143911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e415daa0 0x7f12e40b13e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.365+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 >> 172.21.15.154:0/722143911 conn(0x7f12e40cc1f0 msgr2=0x7f12e40c1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:11.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.366+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 shutdown_connections 2023-10-10T21:20:11.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.366+0000 7f12e939d700 1 -- 172.21.15.154:0/722143911 wait complete. 2023-10-10T21:20:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 45 2023-10-10T21:20:11.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:20:11.461 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:11.460+0000 7f49b3a84180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:20:11.551 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:11.549+0000 7f29fb632180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:20:11.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.570+0000 7f1ea7fff700 1 Processor -- start 2023-10-10T21:20:11.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.570+0000 7f1ea7fff700 1 -- start start 2023-10-10T21:20:11.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.571+0000 7f1ea7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ea8159420 0x7f1ea80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.571+0000 7f1ea7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea81597f0 0x7f1ea80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.571+0000 7f1ea7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea80b11d0 con 0x7f1ea815d230 2023-10-10T21:20:11.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea80b14b0 con 0x7f1ea8159420 2023-10-10T21:20:11.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80b1790 con 0x7f1ea81597f0 2023-10-10T21:20:11.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea6ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ea8159420 0x7f1ea80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea67fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea81597f0 0x7f1ea80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea77fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1ea815d230 0x7f1ea80b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:51536/0 (socket says 172.21.15.154:51536) 2023-10-10T21:20:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea77fe700 1 -- 172.21.15.154:0/3206493192 learned_addr learned my addr 172.21.15.154:0/3206493192 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea5ffb700 1 -- 172.21.15.154:0/3206493192 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082588711 0 0) 0x7f1ea80b11d0 con 0x7f1ea815d230 2023-10-10T21:20:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea6ffd700 1 -- 172.21.15.154:0/3206493192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea81597f0 msgr2=0x7f1ea80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea6ffd700 1 --2- 172.21.15.154:0/3206493192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea81597f0 0x7f1ea80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea6ffd700 1 -- 172.21.15.154:0/3206493192 >> v1:172.21.15.179:6789/0 conn(0x7f1ea815d230 legacy=0x7f1ea80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.572+0000 7f1ea6ffd700 1 -- 172.21.15.154:0/3206493192 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80b1a70 con 0x7f1ea8159420 2023-10-10T21:20:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.573+0000 7f1ea6ffd700 1 --2- 172.21.15.154:0/3206493192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea8159420 0x7f1ea80b5f40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1e980098e0 tx=0x7f1e980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d2f2ce6f3d524b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:11.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.573+0000 7f1ea5ffb700 1 -- 172.21.15.154:0/3206493192 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9800b640 con 0x7f1ea8159420 2023-10-10T21:20:11.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.573+0000 7f1ea5ffb700 1 -- 172.21.15.154:0/3206493192 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9800b7a0 con 0x7f1ea8159420 2023-10-10T21:20:11.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.573+0000 7f1ea5ffb700 1 -- 172.21.15.154:0/3206493192 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9800bb40 con 0x7f1ea8159420 2023-10-10T21:20:11.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.574+0000 7f1ea7fff700 1 -- 172.21.15.154:0/3206493192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea8159420 msgr2=0x7f1ea80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.574+0000 7f1ea7fff700 1 --2- 172.21.15.154:0/3206493192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea8159420 0x7f1ea80b5f40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1e980098e0 tx=0x7f1e980091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.574+0000 7f1ea7fff700 1 -- 172.21.15.154:0/3206493192 shutdown_connections 2023-10-10T21:20:11.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.574+0000 7f1ea7fff700 1 --2- 172.21.15.154:0/3206493192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea8159420 0x7f1ea80b5f40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.574+0000 7f1ea7fff700 1 --2- 172.21.15.154:0/3206493192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea81597f0 0x7f1ea80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.574+0000 7f1ea7fff700 1 -- 172.21.15.154:0/3206493192 >> 172.21.15.154:0/3206493192 conn(0x7f1ea80d0660 msgr2=0x7f1ea80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:11.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.574+0000 7f1ea7fff700 1 -- 172.21.15.154:0/3206493192 shutdown_connections 2023-10-10T21:20:11.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.574+0000 7f1ea7fff700 1 -- 172.21.15.154:0/3206493192 wait complete. 2023-10-10T21:20:11.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.575+0000 7f1ea7fff700 1 Processor -- start 2023-10-10T21:20:11.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.576+0000 7f1ea7fff700 1 -- start start 2023-10-10T21:20:11.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.576+0000 7f1ea7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea8159420 0x7f1ea80cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.576+0000 7f1ea7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea81597f0 0x7f1ea816d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea815d230 0x7f1ea8158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea7fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea816dc10 con 0x7f1ea815d230 2023-10-10T21:20:11.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80ca590 con 0x7f1ea81597f0 2023-10-10T21:20:11.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80ca870 con 0x7f1ea8159420 2023-10-10T21:20:11.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea815d230 0x7f1ea8158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea6ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea8159420 0x7f1ea80cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea67fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea81597f0 0x7f1ea816d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:11.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea6ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea8159420 0x7f1ea80cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:60168/0 (socket says 172.21.15.154:60168) 2023-10-10T21:20:11.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea6ffd700 1 -- 172.21.15.154:0/933981991 learned_addr learned my addr 172.21.15.154:0/933981991 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:11.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea67fc700 1 -- 172.21.15.154:0/933981991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea8159420 msgr2=0x7f1ea80cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea67fc700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea8159420 0x7f1ea80cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea67fc700 1 -- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea815d230 msgr2=0x7f1ea8158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea67fc700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea815d230 0x7f1ea8158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.577+0000 7f1ea67fc700 1 -- 172.21.15.154:0/933981991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e98009420 con 0x7f1ea81597f0 2023-10-10T21:20:11.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.578+0000 7f1ea67fc700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea81597f0 0x7f1ea816d6d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00ea80 tx=0x7f1e9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:11.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.578+0000 7f1e8effd700 1 -- 172.21.15.154:0/933981991 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00eec0 con 0x7f1ea81597f0 2023-10-10T21:20:11.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.578+0000 7f1e8effd700 1 -- 172.21.15.154:0/933981991 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c00c7f0 con 0x7f1ea81597f0 2023-10-10T21:20:11.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.578+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea80cab50 con 0x7f1ea81597f0 2023-10-10T21:20:11.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.578+0000 7f1e8effd700 1 -- 172.21.15.154:0/933981991 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00cb70 con 0x7f1ea81597f0 2023-10-10T21:20:11.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.578+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea80cb110 con 0x7f1ea81597f0 2023-10-10T21:20:11.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.579+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea80b0d40 con 0x7f1ea81597f0 2023-10-10T21:20:11.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.580+0000 7f1e8effd700 1 -- 172.21.15.154:0/933981991 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f1e9c013470 con 0x7f1ea81597f0 2023-10-10T21:20:11.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.581+0000 7f1e8effd700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1e94067170 0x7f1e94069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:11.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.581+0000 7f1e8effd700 1 -- 172.21.15.154:0/933981991 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f1e9c084db0 con 0x7f1ea81597f0 2023-10-10T21:20:11.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.581+0000 7f1ea6ffd700 1 -- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1e94067170 msgr2=0x7f1e94069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:11.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.581+0000 7f1ea6ffd700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1e94067170 0x7f1e94069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:11.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.585+0000 7f1e8effd700 1 -- 172.21.15.154:0/933981991 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e9c089070 con 0x7f1ea81597f0 2023-10-10T21:20:11.648 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:11.647+0000 7f29fb632180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:20:11.762 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:11.760+0000 7f49b3a84180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:20:11.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.782+0000 7f1ea6ffd700 1 -- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1e94067170 msgr2=0x7f1e94069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:11.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.782+0000 7f1ea6ffd700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1e94067170 0x7f1e94069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:11.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.822+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ea804c3c0 con 0x7f1ea81597f0 2023-10-10T21:20:11.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.823+0000 7f1e8effd700 1 -- 172.21.15.154:0/933981991 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f1e9c051a30 con 0x7f1ea81597f0 2023-10-10T21:20:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:11.824 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1983002927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1983002927},{"type":"v1","addr":"172.21.15.179:6835","nonce":1983002927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3483729269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3483729269},{"type":"v1","addr":"172.21.15.179:6834","nonce":3483729269}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3602154448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3602154448},{"type":"v1","addr":"172.21.15.154:6837","nonce":3602154448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:18:43.589800+0000","modified":"2023-10-10T21:18:47.153053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/2335601961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2335601961},{"type":"v1","addr":"172.21.15.154:6835","nonce":2335601961}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-10T21:20:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1e94067170 msgr2=0x7f1e94069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1e94067170 0x7f1e94069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea81597f0 msgr2=0x7f1ea816d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea81597f0 0x7f1ea816d6d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00ea80 tx=0x7f1e9c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 shutdown_connections 2023-10-10T21:20:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea815d230 0x7f1ea8158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ea8159420 0x7f1ea80cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1e94067170 0x7f1e94069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 --2- 172.21.15.154:0/933981991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ea81597f0 0x7f1ea816d6d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 >> 172.21.15.154:0/933981991 conn(0x7f1ea80d0660 msgr2=0x7f1ea80698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 shutdown_connections 2023-10-10T21:20:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:11.825+0000 7f1ea7fff700 1 -- 172.21.15.154:0/933981991 wait complete. 2023-10-10T21:20:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 45 2023-10-10T21:20:11.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:20:11.863 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:11.862+0000 7f49b3a84180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:20:12.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.031+0000 7f5288d9d700 1 Processor -- start 2023-10-10T21:20:12.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.032+0000 7f5288d9d700 1 -- start start 2023-10-10T21:20:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.033+0000 7f5288d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52841593b0 0x7f5284159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.033+0000 7f5288d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52840b1e50 0x7f52840b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.033+0000 7f5288d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52840b6570 con 0x7f52840ceaa0 2023-10-10T21:20:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.033+0000 7f5288d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52840cfe20 con 0x7f52840b1e50 2023-10-10T21:20:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.033+0000 7f5288d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52840cf210 con 0x7f52841593b0 2023-10-10T21:20:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.033+0000 7f5283fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52840b1e50 0x7f52840b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.033+0000 7f5283fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52840b1e50 0x7f52840b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54158/0 (socket says 172.21.15.154:54158) 2023-10-10T21:20:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.033+0000 7f5283fff700 1 -- 172.21.15.154:0/1666638083 learned_addr learned my addr 172.21.15.154:0/1666638083 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.033+0000 7f52837fe700 1 --2- 172.21.15.154:0/1666638083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52841593b0 0x7f5284159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.034+0000 7f5283fff700 1 -- 172.21.15.154:0/1666638083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52841593b0 msgr2=0x7f5284159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:12.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.034+0000 7f5283fff700 1 --2- 172.21.15.154:0/1666638083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52841593b0 0x7f5284159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.034+0000 7f5283fff700 1 -- 172.21.15.154:0/1666638083 >> v1:172.21.15.179:6789/0 conn(0x7f52840ceaa0 legacy=0x7f52840b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.034+0000 7f5283fff700 1 -- 172.21.15.154:0/1666638083 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840cf4f0 con 0x7f52840b1e50 2023-10-10T21:20:12.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.034+0000 7f52827fc700 1 -- 172.21.15.154:0/1666638083 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462697432 0 0) 0x7f5278001110 con 0x7f52840ceaa0 2023-10-10T21:20:12.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.034+0000 7f5283fff700 1 --2- 172.21.15.154:0/1666638083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 0x7f52840b6030 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f527c009f20 tx=0x7f527c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43665c81dcee4daa server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:12.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.034+0000 7f52827fc700 1 -- 172.21.15.154:0/1666638083 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00e070 con 0x7f52840b1e50 2023-10-10T21:20:12.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.034+0000 7f52827fc700 1 -- 172.21.15.154:0/1666638083 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c00b9d0 con 0x7f52840b1e50 2023-10-10T21:20:12.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.034+0000 7f52827fc700 1 -- 172.21.15.154:0/1666638083 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c0092e0 con 0x7f52840b1e50 2023-10-10T21:20:12.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.035+0000 7f5288d9d700 1 -- 172.21.15.154:0/1666638083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 msgr2=0x7f52840b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.035+0000 7f5288d9d700 1 --2- 172.21.15.154:0/1666638083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 0x7f52840b6030 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f527c009f20 tx=0x7f527c009840 comp rx=0 tx=0).stop 2023-10-10T21:20:12.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.035+0000 7f5288d9d700 1 -- 172.21.15.154:0/1666638083 shutdown_connections 2023-10-10T21:20:12.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.035+0000 7f5288d9d700 1 --2- 172.21.15.154:0/1666638083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 0x7f52840b6030 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.035+0000 7f5288d9d700 1 --2- 172.21.15.154:0/1666638083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52841593b0 0x7f5284159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.035+0000 7f5288d9d700 1 -- 172.21.15.154:0/1666638083 >> 172.21.15.154:0/1666638083 conn(0x7f52840d1130 msgr2=0x7f52840b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:12.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.035+0000 7f5288d9d700 1 -- 172.21.15.154:0/1666638083 shutdown_connections 2023-10-10T21:20:12.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.035+0000 7f5288d9d700 1 -- 172.21.15.154:0/1666638083 wait complete. 2023-10-10T21:20:12.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.036+0000 7f5288d9d700 1 Processor -- start 2023-10-10T21:20:12.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.037+0000 7f5288d9d700 1 -- start start 2023-10-10T21:20:12.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.037+0000 7f5288d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 0x7f52841565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.037+0000 7f5288d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52840ceaa0 0x7f5284169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f5288d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52841593b0 0x7f52840b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f5288d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528416a3b0 con 0x7f52840b1e50 2023-10-10T21:20:12.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f5288d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528416ae80 con 0x7f52841593b0 2023-10-10T21:20:12.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f5288d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528406a190 con 0x7f52840ceaa0 2023-10-10T21:20:12.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f52837fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 0x7f52841565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f52837fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 0x7f52841565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54160/0 (socket says 172.21.15.154:54160) 2023-10-10T21:20:12.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f52837fe700 1 -- 172.21.15.154:0/3003234997 learned_addr learned my addr 172.21.15.154:0/3003234997 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:12.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f5282ffd700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52840ceaa0 0x7f5284169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f5283fff700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52841593b0 0x7f52840b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f52837fe700 1 -- 172.21.15.154:0/3003234997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52840ceaa0 msgr2=0x7f5284169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f52837fe700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52840ceaa0 0x7f5284169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f52837fe700 1 -- 172.21.15.154:0/3003234997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52841593b0 msgr2=0x7f52840b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f52837fe700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52841593b0 0x7f52840b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f52837fe700 1 -- 172.21.15.154:0/3003234997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c009ae0 con 0x7f52840b1e50 2023-10-10T21:20:12.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.038+0000 7f52837fe700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 0x7f52841565a0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f527400e930 tx=0x7f52740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:12.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.039+0000 7f526b7fe700 1 -- 172.21.15.154:0/3003234997 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274013680 con 0x7f52840b1e50 2023-10-10T21:20:12.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.039+0000 7f526b7fe700 1 -- 172.21.15.154:0/3003234997 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740137e0 con 0x7f52840b1e50 2023-10-10T21:20:12.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.039+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528416a5e0 con 0x7f52840b1e50 2023-10-10T21:20:12.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.039+0000 7f526b7fe700 1 -- 172.21.15.154:0/3003234997 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274013b80 con 0x7f52840b1e50 2023-10-10T21:20:12.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.039+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528416aba0 con 0x7f52840b1e50 2023-10-10T21:20:12.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.040+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528404c3c0 con 0x7f52840b1e50 2023-10-10T21:20:12.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.041+0000 7f526b7fe700 1 -- 172.21.15.154:0/3003234997 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f527400c3e0 con 0x7f52840b1e50 2023-10-10T21:20:12.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.041+0000 7f526b7fe700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5270067170 0x7f5270069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.042+0000 7f526b7fe700 1 -- 172.21.15.154:0/3003234997 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f5274084c30 con 0x7f52840b1e50 2023-10-10T21:20:12.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.042+0000 7f5282ffd700 1 -- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5270067170 msgr2=0x7f5270069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:12.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.042+0000 7f5282ffd700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5270067170 0x7f5270069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:12.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.046+0000 7f526b7fe700 1 -- 172.21.15.154:0/3003234997 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52740518f0 con 0x7f52840b1e50 2023-10-10T21:20:12.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.243+0000 7f5282ffd700 1 -- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5270067170 msgr2=0x7f5270069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:12.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.243+0000 7f5282ffd700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5270067170 0x7f5270069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:12.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.251+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52840cf7d0 con 0x7f52840b1e50 2023-10-10T21:20:12.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.252+0000 7f526b7fe700 1 -- 172.21.15.154:0/3003234997 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16477 (secure 0 0 0) 0x7f5274054f10 con 0x7f52840b1e50 2023-10-10T21:20:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:12.254 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":112,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:20:05.388577+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:18:41.726498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-10T21:18:42.567446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/85496":"2023-10-11T21:19:04.287290+0000","172.21.15.154:6834/85496":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/3617467829":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/1080071568":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/2988501796":"2023-10-11T21:19:04.287290+0000","172.21.15.154:0/2592465931":"2023-10-11T21:19:04.287290+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:20:12.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5270067170 msgr2=0x7f5270069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:12.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5270067170 0x7f5270069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 msgr2=0x7f52841565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 0x7f52841565a0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f527400e930 tx=0x7f52740091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 shutdown_connections 2023-10-10T21:20:12.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f5270067170 0x7f5270069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52841593b0 0x7f52840b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840b1e50 0x7f52841565a0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 --2- 172.21.15.154:0/3003234997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52840ceaa0 0x7f5284169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 >> 172.21.15.154:0/3003234997 conn(0x7f52840d1130 msgr2=0x7f52840b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:12.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 shutdown_connections 2023-10-10T21:20:12.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.255+0000 7f5288d9d700 1 -- 172.21.15.154:0/3003234997 wait complete. 2023-10-10T21:20:12.275 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T21:20:12.347 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:12.345+0000 7f29fb632180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:20:12.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.504+0000 7f1c7dd9d700 1 Processor -- start 2023-10-10T21:20:12.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.504+0000 7f1c7dd9d700 1 -- start start 2023-10-10T21:20:12.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.505+0000 7f1c7dd9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1c78159420 0x7f1c780b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.505+0000 7f1c7dd9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c781597f0 0x7f1c780b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.505+0000 7f1c7dd9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780b11d0 con 0x7f1c7815d230 2023-10-10T21:20:12.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c7dd9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c780b14b0 con 0x7f1c781597f0 2023-10-10T21:20:12.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c7dd9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c780b1790 con 0x7f1c78159420 2023-10-10T21:20:12.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c77fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c781597f0 0x7f1c780b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c77fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c781597f0 0x7f1c780b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54172/0 (socket says 172.21.15.154:54172) 2023-10-10T21:20:12.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c77fff700 1 -- 172.21.15.154:0/2289872645 learned_addr learned my addr 172.21.15.154:0/2289872645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:12.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c7cd9b700 1 --2- 172.21.15.154:0/2289872645 >> v2:172.21.15.179:3300/0 conn(0x7f1c78159420 0x7f1c780b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c77fff700 1 -- 172.21.15.154:0/2289872645 >> v2:172.21.15.179:3300/0 conn(0x7f1c78159420 msgr2=0x7f1c780b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:12.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c77fff700 1 --2- 172.21.15.154:0/2289872645 >> v2:172.21.15.179:3300/0 conn(0x7f1c78159420 0x7f1c780b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c77fff700 1 -- 172.21.15.154:0/2289872645 >> v1:172.21.15.179:6789/0 conn(0x7f1c7815d230 legacy=0x7f1c7815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.506+0000 7f1c77fff700 1 -- 172.21.15.154:0/2289872645 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780b1a70 con 0x7f1c781597f0 2023-10-10T21:20:12.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.507+0000 7f1c77fff700 1 --2- 172.21.15.154:0/2289872645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c781597f0 0x7f1c780b2270 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1c780b2f20 tx=0x7f1c64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0e7ea747021a6a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:12.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.507+0000 7f1c777fe700 1 -- 172.21.15.154:0/2289872645 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64009e70 con 0x7f1c781597f0 2023-10-10T21:20:12.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.507+0000 7f1c777fe700 1 -- 172.21.15.154:0/2289872645 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6400b860 con 0x7f1c781597f0 2023-10-10T21:20:12.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.507+0000 7f1c777fe700 1 -- 172.21.15.154:0/2289872645 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400bc00 con 0x7f1c781597f0 2023-10-10T21:20:12.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.508+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2289872645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c781597f0 msgr2=0x7f1c780b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.508+0000 7f1c7dd9d700 1 --2- 172.21.15.154:0/2289872645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c781597f0 0x7f1c780b2270 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1c780b2f20 tx=0x7f1c64009250 comp rx=0 tx=0).stop 2023-10-10T21:20:12.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.508+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2289872645 shutdown_connections 2023-10-10T21:20:12.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.508+0000 7f1c7dd9d700 1 --2- 172.21.15.154:0/2289872645 >> v2:172.21.15.179:3300/0 conn(0x7f1c78159420 0x7f1c780b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.508+0000 7f1c7dd9d700 1 --2- 172.21.15.154:0/2289872645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c781597f0 0x7f1c780b2270 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.508+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2289872645 >> 172.21.15.154:0/2289872645 conn(0x7f1c780d0660 msgr2=0x7f1c780d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:12.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.508+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2289872645 shutdown_connections 2023-10-10T21:20:12.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.508+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2289872645 wait complete. 2023-10-10T21:20:12.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.509+0000 7f1c7dd9d700 1 Processor -- start 2023-10-10T21:20:12.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.509+0000 7f1c7dd9d700 1 -- start start 2023-10-10T21:20:12.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.510+0000 7f1c7dd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c78159420 0x7f1c781543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.510+0000 7f1c7dd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c781597f0 0x7f1c780c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.510+0000 7f1c7dd9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c7815d230 0x7f1c780b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.510+0000 7f1c7dd9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780c5d70 con 0x7f1c7815d230 2023-10-10T21:20:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.510+0000 7f1c7dd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780c6050 con 0x7f1c78159420 2023-10-10T21:20:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.510+0000 7f1c7dd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780c6330 con 0x7f1c781597f0 2023-10-10T21:20:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7d59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c7815d230 0x7f1c780b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c77fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c781597f0 0x7f1c780c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7d59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c7815d230 0x7f1c780b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54174/0 (socket says 172.21.15.154:54174) 2023-10-10T21:20:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7d59c700 1 -- 172.21.15.154:0/2778047281 learned_addr learned my addr 172.21.15.154:0/2778047281 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7cd9b700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c78159420 0x7f1c781543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7d59c700 1 -- 172.21.15.154:0/2778047281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c781597f0 msgr2=0x7f1c780c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7d59c700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c781597f0 0x7f1c780c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7d59c700 1 -- 172.21.15.154:0/2778047281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c78159420 msgr2=0x7f1c781543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7d59c700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c78159420 0x7f1c781543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7d59c700 1 -- 172.21.15.154:0/2778047281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c640094f0 con 0x7f1c7815d230 2023-10-10T21:20:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c7d59c700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c7815d230 0x7f1c780b2170 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000c810 tx=0x7f1c70001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.511+0000 7f1c74ff9700 1 -- 172.21.15.154:0/2778047281 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70012630 con 0x7f1c7815d230 2023-10-10T21:20:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.512+0000 7f1c74ff9700 1 -- 172.21.15.154:0/2778047281 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c700127b0 con 0x7f1c7815d230 2023-10-10T21:20:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.512+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c780c6610 con 0x7f1c7815d230 2023-10-10T21:20:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.512+0000 7f1c74ff9700 1 -- 172.21.15.154:0/2778047281 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70012b70 con 0x7f1c7815d230 2023-10-10T21:20:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.512+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c78154910 con 0x7f1c7815d230 2023-10-10T21:20:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.513+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7804c3c0 con 0x7f1c7815d230 2023-10-10T21:20:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.514+0000 7f1c74ff9700 1 -- 172.21.15.154:0/2778047281 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f1c70003030 con 0x7f1c7815d230 2023-10-10T21:20:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.514+0000 7f1c74ff9700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c5c067170 0x7f1c5c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.515+0000 7f1c74ff9700 1 -- 172.21.15.154:0/2778047281 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f1c70084990 con 0x7f1c7815d230 2023-10-10T21:20:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.515+0000 7f1c7cd9b700 1 -- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c5c067170 msgr2=0x7f1c5c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.515+0000 7f1c7cd9b700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c5c067170 0x7f1c5c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.518+0000 7f1c74ff9700 1 -- 172.21.15.154:0/2778047281 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c700516b0 con 0x7f1c7815d230 2023-10-10T21:20:12.611 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:12.609+0000 7f49b3a84180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:20:12.638 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:12.636+0000 7f29fb632180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:20:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.716+0000 7f1c7cd9b700 1 -- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c5c067170 msgr2=0x7f1c5c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6834/85496 2023-10-10T21:20:12.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.716+0000 7f1c7cd9b700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c5c067170 0x7f1c5c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:12.730 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:12.729+0000 7f29fb632180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:20:12.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.759+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1c780b1d50 con 0x7f1c7815d230 2023-10-10T21:20:12.761 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T21:20:12.760+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T21:20:12.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.765+0000 7f1c74ff9700 1 -- 172.21.15.154:0/2778047281 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1c70054cd0 con 0x7f1c7815d230 2023-10-10T21:20:12.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c5c067170 msgr2=0x7f1c5c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:12.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c5c067170 0x7f1c5c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c7815d230 msgr2=0x7f1c780b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c7815d230 0x7f1c780b2170 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000c810 tx=0x7f1c70001650 comp rx=0 tx=0).stop 2023-10-10T21:20:12.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 shutdown_connections 2023-10-10T21:20:12.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c7815d230 0x7f1c780b2170 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f1c5c067170 0x7f1c5c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c78159420 0x7f1c781543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 --2- 172.21.15.154:0/2778047281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c781597f0 0x7f1c780c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 >> 172.21.15.154:0/2778047281 conn(0x7f1c780d0660 msgr2=0x7f1c781553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:12.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 shutdown_connections 2023-10-10T21:20:12.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.768+0000 7f1c7dd9d700 1 -- 172.21.15.154:0/2778047281 wait complete. 2023-10-10T21:20:12.772 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T21:20:12.775 INFO:tasks.ceph.mds.c.smithi154.stderr: -5358> 2023-10-10T21:18:49.098+0000 7f3dc49f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:20:12.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T21:20:12.822 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:20:12.887 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:12.886+0000 7f29fb632180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:20:12.910 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:12.909+0000 7f49b3a84180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:20:12.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.982+0000 7f47d159d700 1 Processor -- start 2023-10-10T21:20:12.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.982+0000 7f47d159d700 1 -- start start 2023-10-10T21:20:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.983+0000 7f47d159d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc0b4e70 0x7f47cc0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.983+0000 7f47d159d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47cc0b16d0 0x7f47cc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.983+0000 7f47d159d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0b2080 con 0x7f47cc15d240 2023-10-10T21:20:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.983+0000 7f47d159d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc0cfb00 con 0x7f47cc0b16d0 2023-10-10T21:20:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.983+0000 7f47d159d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b5c40 con 0x7f47cc0b4e70 2023-10-10T21:20:12.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47cb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47cc0b16d0 0x7f47cc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47d0d9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f47cc15d240 0x7f47cc15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37268/0 (socket says 172.21.15.154:37268) 2023-10-10T21:20:12.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47d0d9c700 1 -- 172.21.15.154:0/630547702 learned_addr learned my addr 172.21.15.154:0/630547702 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:12.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47cbfff700 1 --2- 172.21.15.154:0/630547702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc0b4e70 0x7f47cc0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47caffd700 1 -- 172.21.15.154:0/630547702 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720703977 0 0) 0x7f47cc0b2080 con 0x7f47cc15d240 2023-10-10T21:20:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47caffd700 1 -- 172.21.15.154:0/630547702 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b4003570 con 0x7f47cc15d240 2023-10-10T21:20:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47cb7fe700 1 -- 172.21.15.154:0/630547702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc0b4e70 msgr2=0x7f47cc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47cb7fe700 1 --2- 172.21.15.154:0/630547702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc0b4e70 0x7f47cc0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47cb7fe700 1 -- 172.21.15.154:0/630547702 >> v1:172.21.15.154:6789/0 conn(0x7f47cc15d240 legacy=0x7f47cc15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47cb7fe700 1 -- 172.21.15.154:0/630547702 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0b5f20 con 0x7f47cc0b16d0 2023-10-10T21:20:12.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47cbfff700 1 --2- 172.21.15.154:0/630547702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc0b4e70 0x7f47cc0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:12.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.984+0000 7f47cb7fe700 1 --2- 172.21.15.154:0/630547702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 0x7f47cc0b1b40 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f47c00098e0 tx=0x7f47c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d75c64108a549 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:12.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.985+0000 7f47caffd700 1 -- 172.21.15.154:0/630547702 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0011630 con 0x7f47cc0b16d0 2023-10-10T21:20:12.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.985+0000 7f47caffd700 1 -- 172.21.15.154:0/630547702 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c0011790 con 0x7f47cc0b16d0 2023-10-10T21:20:12.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.985+0000 7f47caffd700 1 -- 172.21.15.154:0/630547702 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0011b30 con 0x7f47cc0b16d0 2023-10-10T21:20:12.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.985+0000 7f47d159d700 1 -- 172.21.15.154:0/630547702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 msgr2=0x7f47cc0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.985+0000 7f47d159d700 1 --2- 172.21.15.154:0/630547702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 0x7f47cc0b1b40 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f47c00098e0 tx=0x7f47c00091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.985+0000 7f47d159d700 1 -- 172.21.15.154:0/630547702 shutdown_connections 2023-10-10T21:20:12.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.985+0000 7f47d159d700 1 --2- 172.21.15.154:0/630547702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc0b4e70 0x7f47cc0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.985+0000 7f47d159d700 1 --2- 172.21.15.154:0/630547702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 0x7f47cc0b1b40 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.985+0000 7f47d159d700 1 -- 172.21.15.154:0/630547702 >> 172.21.15.154:0/630547702 conn(0x7f47cc0d10c0 msgr2=0x7f47cc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:12.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.986+0000 7f47d159d700 1 -- 172.21.15.154:0/630547702 shutdown_connections 2023-10-10T21:20:12.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.986+0000 7f47d159d700 1 -- 172.21.15.154:0/630547702 wait complete. 2023-10-10T21:20:12.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.988+0000 7f47d159d700 1 Processor -- start 2023-10-10T21:20:12.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.988+0000 7f47d159d700 1 -- start start 2023-10-10T21:20:12.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.989+0000 7f47d159d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 0x7f47cc145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.989+0000 7f47d159d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47cc0b4e70 0x7f47cc0c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.989+0000 7f47d159d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc15d240 0x7f47cc15e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:12.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.989+0000 7f47d159d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc146150 con 0x7f47cc0b16d0 2023-10-10T21:20:12.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47d159d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0c67d0 con 0x7f47cc0b4e70 2023-10-10T21:20:12.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47d159d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0c6ab0 con 0x7f47cc15d240 2023-10-10T21:20:12.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47cbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 0x7f47cc145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47cbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 0x7f47cc145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54200/0 (socket says 172.21.15.154:54200) 2023-10-10T21:20:12.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47cbfff700 1 -- 172.21.15.154:0/3712140027 learned_addr learned my addr 172.21.15.154:0/3712140027 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:12.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47cb7fe700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47cc0b4e70 0x7f47cc0c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47d0d9c700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc15d240 0x7f47cc15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:12.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47cbfff700 1 -- 172.21.15.154:0/3712140027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc15d240 msgr2=0x7f47cc15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47cbfff700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc15d240 0x7f47cc15e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47cbfff700 1 -- 172.21.15.154:0/3712140027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47cc0b4e70 msgr2=0x7f47cc0c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:12.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47cbfff700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47cc0b4e70 0x7f47cc0c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:12.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.990+0000 7f47cbfff700 1 -- 172.21.15.154:0/3712140027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc009420 con 0x7f47cc0b16d0 2023-10-10T21:20:12.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.991+0000 7f47cbfff700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 0x7f47cc145c10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00ec80 tx=0x7f47bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:12.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.991+0000 7f47b3fff700 1 -- 172.21.15.154:0/3712140027 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00c920 con 0x7f47cc0b16d0 2023-10-10T21:20:12.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.991+0000 7f47b3fff700 1 -- 172.21.15.154:0/3712140027 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc00ca80 con 0x7f47cc0b16d0 2023-10-10T21:20:12.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.991+0000 7f47b3fff700 1 -- 172.21.15.154:0/3712140027 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00ce00 con 0x7f47cc0b16d0 2023-10-10T21:20:12.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.991+0000 7f47d159d700 1 -- 172.21.15.154:0/3712140027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c0009420 con 0x7f47cc0b16d0 2023-10-10T21:20:12.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.991+0000 7f47d159d700 1 -- 172.21.15.154:0/3712140027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc0c7070 con 0x7f47cc0b16d0 2023-10-10T21:20:12.999 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:12.991+0000 7f29fb632180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:20:13.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.992+0000 7f47d159d700 1 -- 172.21.15.154:0/3712140027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc088990 con 0x7f47cc0b16d0 2023-10-10T21:20:13.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.993+0000 7f47b3fff700 1 -- 172.21.15.154:0/3712140027 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f47bc013680 con 0x7f47cc0b16d0 2023-10-10T21:20:13.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.993+0000 7f47b3fff700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 0x7f47b8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:13.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.994+0000 7f47b3fff700 1 -- 172.21.15.154:0/3712140027 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f47bc085340 con 0x7f47cc0b16d0 2023-10-10T21:20:13.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.994+0000 7f47cb7fe700 -1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 0x7f47b8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.994+0000 7f47cb7fe700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 0x7f47b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:12.998+0000 7f47b3fff700 1 -- 172.21.15.154:0/3712140027 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47bc051f60 con 0x7f47cc0b16d0 2023-10-10T21:20:13.013 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:13.012+0000 7f49b3a84180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:20:13.180 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:13.179+0000 7f29fb632180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:20:13.184 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:13.183+0000 7f49b3a84180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:20:13.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.195+0000 7f47cb7fe700 -1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 0x7f47b8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.195+0000 7f47cb7fe700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 0x7f47b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:13.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.257+0000 7f47d159d700 1 -- 172.21.15.154:0/3712140027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f47cc0cd4c0 con 0x7f47cc0b16d0 2023-10-10T21:20:13.272 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:13.271+0000 7f29fb632180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:20:13.290 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:13.289+0000 7f49b3a84180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:20:13.363 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:13.362+0000 7f29fb632180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:20:13.458 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:13.456+0000 7f29fb632180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:20:13.461 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:13.459+0000 7f29f11fb700 -1 --2- 172.21.15.179:0/87727 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x563fb7dac000 0x563fb7db2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.480 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:13.479+0000 7f49b3a84180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:20:13.572 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:13.571+0000 7f49b3a84180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:20:13.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.596+0000 7f47cb7fe700 -1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 0x7f47b8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.596+0000 7f47cb7fe700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 0x7f47b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:20:13.662 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:13.660+0000 7f29f11fb700 -1 --2- 172.21.15.179:0/87727 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x563fb7dac000 0x563fb7db2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.664 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:13.663+0000 7f49b3a84180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:20:13.683 INFO:tasks.ceph.mon.c.smithi179.stderr:2023-10-10T21:20:13.682+0000 7faccebed700 -1 --2- 172.21.15.179:0/87726 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x5628f5aebc00 0x5628f5c0f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.684 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T21:20:13.683+0000 7f71217ed700 -1 --2- 172.21.15.154:0/85495 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x55c17f537000 0x55c18087a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.684 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-10T21:20:13.682+0000 7fd2a29fd700 -1 --2- [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x55c663fce800 0x55c668ff2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.685 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-10-10T21:20:13.683+0000 7fe607dfc700 -1 --2- [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x562faa088800 0x562fa9cf8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.685 INFO:tasks.ceph.mon.b.smithi179.stderr:2023-10-10T21:20:13.682+0000 7fe83d1f9700 -1 --2- 172.21.15.179:0/87725 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x564d08273c00 0x564d09388000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.686 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-10-10T21:20:13.683+0000 7effd15fd700 -1 --2- [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x55cfd29e8c00 0x55cfcbac7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.686 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-10T21:20:13.682+0000 7fd17cbfd700 -1 --2- [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x55ce1fc89400 0x55ce24afb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.687 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-10-10T21:20:13.683+0000 7f4b0f1fd700 -1 --2- [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x559643308800 0x559637a14680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.687 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-10T21:20:13.683+0000 7fe64f1fc700 -1 --2- [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x55a8a5162c00 0x55a8aa339700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.688 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-10-10T21:20:13.684+0000 7f596bdfd700 -1 --2- [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x55d0961bf400 0x55d09aa68100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.688 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-10T21:20:13.683+0000 7f74451fb700 -1 --2- [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x564b9839cc00 0x564b9179e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.688 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-10-10T21:20:13.685+0000 7f89f67fc700 -1 --2- [v2:172.21.15.154:6833/3602154448,v1:172.21.15.154:6837/3602154448] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x557a8dd53800 0x557a8d115080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.689 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-10-10T21:20:13.684+0000 7f16f17fc700 -1 --2- [v2:172.21.15.179:6832/3483729269,v1:172.21.15.179:6834/3483729269] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x55d3cafdb800 0x55d3ca39d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.689 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-10-10T21:20:13.685+0000 7f6bffffc700 -1 --2- [v2:172.21.15.179:6833/1983002927,v1:172.21.15.179:6835/1983002927] >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x5639f2f47800 0x5639f230d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.759 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:13.758+0000 7f49b3a84180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:20:13.761 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:13.760+0000 7f49a93fb700 -1 --2- 172.21.15.154:0/85496 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x55ca641b0000 0x55ca641b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:20:13.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.770+0000 7f47b3fff700 1 -- 172.21.15.154:0/3712140027 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 51) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f47bc052330 con 0x7f47cc0b16d0 2023-10-10T21:20:13.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.770+0000 7f47b3fff700 1 -- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 msgr2=0x7f47b8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:13.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.770+0000 7f47b3fff700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 0x7f47b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:13.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.776+0000 7f47b3fff700 1 -- 172.21.15.154:0/3712140027 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) v1 ==== 104+0+0 (secure 0 0 0) 0x7f47bc06f430 con 0x7f47cc0b16d0 2023-10-10T21:20:13.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.779+0000 7f47d159d700 1 -- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 msgr2=0x7f47cc145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:13.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.779+0000 7f47d159d700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 0x7f47cc145c10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00ec80 tx=0x7f47bc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:13.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.780+0000 7f47d159d700 1 -- 172.21.15.154:0/3712140027 shutdown_connections 2023-10-10T21:20:13.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.780+0000 7f47d159d700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47cc15d240 0x7f47cc15e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:13.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.780+0000 7f47d159d700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47cc0b16d0 0x7f47cc145c10 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:13.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.780+0000 7f47d159d700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.154:6834/85496,v1:172.21.15.154:6836/85496] conn(0x7f47b8067170 0x7f47b8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:13.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.780+0000 7f47d159d700 1 --2- 172.21.15.154:0/3712140027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47cc0b4e70 0x7f47cc0c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:13.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.780+0000 7f47d159d700 1 -- 172.21.15.154:0/3712140027 >> 172.21.15.154:0/3712140027 conn(0x7f47cc0d10c0 msgr2=0x7f47cc0ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:13.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.780+0000 7f47d159d700 1 -- 172.21.15.154:0/3712140027 shutdown_connections 2023-10-10T21:20:13.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:13.780+0000 7f47d159d700 1 -- 172.21.15.154:0/3712140027 wait complete. 2023-10-10T21:20:13.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T21:20:14.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.027+0000 7f5e4c5ff700 1 Processor -- start 2023-10-10T21:20:14.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.027+0000 7f5e4c5ff700 1 -- start start 2023-10-10T21:20:14.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.028+0000 7f5e4c5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5e440c8490 0x7f5e440c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.028+0000 7f5e4c5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440ac030 con 0x7f5e44069a50 2023-10-10T21:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e4c5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440ab820 con 0x7f5e44069e20 2023-10-10T21:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e4c5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4406dbb0 con 0x7f5e440c8490 2023-10-10T21:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e4a39b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5e44069a50 0x7f5e4415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37274/0 (socket says 172.21.15.154:37274) 2023-10-10T21:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e4a39b700 1 -- 172.21.15.154:0/1576810769 learned_addr learned my addr 172.21.15.154:0/1576810769 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e49b9a700 1 --2- 172.21.15.154:0/1576810769 >> v2:172.21.15.179:3300/0 conn(0x7f5e440c8490 0x7f5e440c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e49399700 1 -- 172.21.15.154:0/1576810769 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773873418 0 0) 0x7f5e40001110 con 0x7f5e44069a50 2023-10-10T21:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e49399700 1 -- 172.21.15.154:0/1576810769 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30003570 con 0x7f5e44069a50 2023-10-10T21:20:14.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e49b9a700 1 -- 172.21.15.154:0/1576810769 >> v1:172.21.15.179:6789/0 conn(0x7f5e44069e20 legacy=0x7f5e441569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:14.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e49b9a700 1 -- 172.21.15.154:0/1576810769 >> v1:172.21.15.154:6789/0 conn(0x7f5e44069a50 legacy=0x7f5e4415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:14.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.029+0000 7f5e49b9a700 1 -- 172.21.15.154:0/1576810769 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440aba70 con 0x7f5e440c8490 2023-10-10T21:20:14.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.030+0000 7f5e49b9a700 1 --2- 172.21.15.154:0/1576810769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e440c8490 0x7f5e440c6ac0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5e340098e0 tx=0x7f5e340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4439913b2df678a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:14.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.030+0000 7f5e49399700 1 -- 172.21.15.154:0/1576810769 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400b640 con 0x7f5e440c8490 2023-10-10T21:20:14.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.030+0000 7f5e49399700 1 -- 172.21.15.154:0/1576810769 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400b7a0 con 0x7f5e440c8490 2023-10-10T21:20:14.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.030+0000 7f5e49399700 1 -- 172.21.15.154:0/1576810769 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400bb40 con 0x7f5e440c8490 2023-10-10T21:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.030+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/1576810769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e440c8490 msgr2=0x7f5e440c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.030+0000 7f5e4c5ff700 1 --2- 172.21.15.154:0/1576810769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e440c8490 0x7f5e440c6ac0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5e340098e0 tx=0x7f5e340091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.031+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/1576810769 shutdown_connections 2023-10-10T21:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.031+0000 7f5e4c5ff700 1 --2- 172.21.15.154:0/1576810769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e440c8490 0x7f5e440c6ac0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.031+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/1576810769 >> 172.21.15.154:0/1576810769 conn(0x7f5e440c8f90 msgr2=0x7f5e440c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.031+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/1576810769 shutdown_connections 2023-10-10T21:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.031+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/1576810769 wait complete. 2023-10-10T21:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.032+0000 7f5e4c5ff700 1 Processor -- start 2023-10-10T21:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.032+0000 7f5e4c5ff700 1 -- start start 2023-10-10T21:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4c5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e44069a50 0x7f5e44154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e44069e20 0x7f5e440c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4c5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e440c8490 0x7f5e440c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4c5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440b0210 con 0x7f5e44069a50 2023-10-10T21:20:14.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4c5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440af600 con 0x7f5e440c8490 2023-10-10T21:20:14.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440af8e0 con 0x7f5e44069e20 2023-10-10T21:20:14.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4a39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e44069a50 0x7f5e44154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:14.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4a39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e44069a50 0x7f5e44154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54282/0 (socket says 172.21.15.154:54282) 2023-10-10T21:20:14.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4a39b700 1 -- 172.21.15.154:0/704318642 learned_addr learned my addr 172.21.15.154:0/704318642 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:14.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e49b9a700 1 --2- 172.21.15.154:0/704318642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e44069e20 0x7f5e440c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:14.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.033+0000 7f5e4ab9c700 1 --2- 172.21.15.154:0/704318642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e440c8490 0x7f5e440c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:14.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e4a39b700 1 -- 172.21.15.154:0/704318642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e44069e20 msgr2=0x7f5e440c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:14.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e4a39b700 1 --2- 172.21.15.154:0/704318642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e44069e20 0x7f5e440c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:14.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e4a39b700 1 -- 172.21.15.154:0/704318642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e440c8490 msgr2=0x7f5e440c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:14.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e4a39b700 1 --2- 172.21.15.154:0/704318642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e440c8490 0x7f5e440c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:14.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e4a39b700 1 -- 172.21.15.154:0/704318642 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009420 con 0x7f5e44069a50 2023-10-10T21:20:14.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e4a39b700 1 --2- 172.21.15.154:0/704318642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e44069a50 0x7f5e44154be0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c590 tx=0x7f5e40007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:14.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e3a7fc700 1 -- 172.21.15.154:0/704318642 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40005b30 con 0x7f5e44069a50 2023-10-10T21:20:14.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e3a7fc700 1 -- 172.21.15.154:0/704318642 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40005cb0 con 0x7f5e44069a50 2023-10-10T21:20:14.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/704318642 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e440afbc0 con 0x7f5e44069a50 2023-10-10T21:20:14.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e3a7fc700 1 -- 172.21.15.154:0/704318642 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40007320 con 0x7f5e44069a50 2023-10-10T21:20:14.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.034+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/704318642 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e44155120 con 0x7f5e44069a50 2023-10-10T21:20:14.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.035+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/704318642 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e440718b0 con 0x7f5e44069a50 2023-10-10T21:20:14.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.036+0000 7f5e3a7fc700 1 -- 172.21.15.154:0/704318642 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 51) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f5e4001b3b0 con 0x7f5e44069a50 2023-10-10T21:20:14.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.037+0000 7f5e3a7fc700 1 -- 172.21.15.154:0/704318642 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f5e40083860 con 0x7f5e44069a50 2023-10-10T21:20:14.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.041+0000 7f5e3a7fc700 1 -- 172.21.15.154:0/704318642 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e40050930 con 0x7f5e44069a50 2023-10-10T21:20:14.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.233+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/704318642 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5e440ac030 con 0x7f5e44069a50 2023-10-10T21:20:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.779+0000 7f5e3a7fc700 1 -- 172.21.15.154:0/704318642 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5e440ac030 con 0x7f5e44069a50 2023-10-10T21:20:14.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.784+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/704318642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e44069a50 msgr2=0x7f5e44154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:14.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.784+0000 7f5e4c5ff700 1 --2- 172.21.15.154:0/704318642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e44069a50 0x7f5e44154be0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c590 tx=0x7f5e40007c70 comp rx=0 tx=0).stop 2023-10-10T21:20:14.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.784+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/704318642 shutdown_connections 2023-10-10T21:20:14.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.784+0000 7f5e4c5ff700 1 --2- 172.21.15.154:0/704318642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e440c8490 0x7f5e440c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:14.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.784+0000 7f5e4c5ff700 1 --2- 172.21.15.154:0/704318642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e44069a50 0x7f5e44154be0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:14.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.784+0000 7f5e4c5ff700 1 --2- 172.21.15.154:0/704318642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e44069e20 0x7f5e440c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:14.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.784+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/704318642 >> 172.21.15.154:0/704318642 conn(0x7f5e440c8f90 msgr2=0x7f5e440cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:14.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.784+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/704318642 shutdown_connections 2023-10-10T21:20:14.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.784+0000 7f5e4c5ff700 1 -- 172.21.15.154:0/704318642 wait complete. 2023-10-10T21:20:14.787 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T21:20:14.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T21:20:14.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.998+0000 7feb9dd9d700 1 Processor -- start 2023-10-10T21:20:14.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.998+0000 7feb9dd9d700 1 -- start start 2023-10-10T21:20:15.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.999+0000 7feb9dd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb980ac0e0 0x7feb980afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:15.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.999+0000 7feb9dd9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb9806f0b0 0x7feb9815d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:15.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.999+0000 7feb9dd9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9806e510 con 0x7feb981597d0 2023-10-10T21:20:15.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.999+0000 7feb9dd9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb98069180 con 0x7feb9806f0b0 2023-10-10T21:20:15.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.999+0000 7feb9dd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9806dec0 con 0x7feb980ac0e0 2023-10-10T21:20:15.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:14.999+0000 7feb9d59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb9806f0b0 0x7feb9815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:15.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb9d59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb9806f0b0 0x7feb9815d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54294/0 (socket says 172.21.15.154:54294) 2023-10-10T21:20:15.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb9d59c700 1 -- 172.21.15.154:0/573699844 learned_addr learned my addr 172.21.15.154:0/573699844 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:15.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb97fff700 1 --2- 172.21.15.154:0/573699844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb980ac0e0 0x7feb980afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:15.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb9d59c700 1 -- 172.21.15.154:0/573699844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb980ac0e0 msgr2=0x7feb980afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:15.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb9d59c700 1 --2- 172.21.15.154:0/573699844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb980ac0e0 0x7feb980afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:15.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb9d59c700 1 -- 172.21.15.154:0/573699844 >> v1:172.21.15.179:6789/0 conn(0x7feb981597d0 legacy=0x7feb9806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:15.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb9d59c700 1 -- 172.21.15.154:0/573699844 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9806e1a0 con 0x7feb9806f0b0 2023-10-10T21:20:15.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb9d59c700 1 --2- 172.21.15.154:0/573699844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 0x7feb9815d440 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7feb90009f20 tx=0x7feb90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ce8215e845f0f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:15.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb977fe700 1 -- 172.21.15.154:0/573699844 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000e070 con 0x7feb9806f0b0 2023-10-10T21:20:15.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb977fe700 1 -- 172.21.15.154:0/573699844 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9000b9d0 con 0x7feb9806f0b0 2023-10-10T21:20:15.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.000+0000 7feb977fe700 1 -- 172.21.15.154:0/573699844 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900092e0 con 0x7feb9806f0b0 2023-10-10T21:20:15.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.001+0000 7feb9dd9d700 1 -- 172.21.15.154:0/573699844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 msgr2=0x7feb9815d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:15.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.001+0000 7feb9dd9d700 1 --2- 172.21.15.154:0/573699844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 0x7feb9815d440 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7feb90009f20 tx=0x7feb90009840 comp rx=0 tx=0).stop 2023-10-10T21:20:15.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.001+0000 7feb9dd9d700 1 -- 172.21.15.154:0/573699844 shutdown_connections 2023-10-10T21:20:15.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.001+0000 7feb9dd9d700 1 --2- 172.21.15.154:0/573699844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 0x7feb9815d440 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:15.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.001+0000 7feb9dd9d700 1 --2- 172.21.15.154:0/573699844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb980ac0e0 0x7feb980afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:15.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.001+0000 7feb9dd9d700 1 -- 172.21.15.154:0/573699844 >> 172.21.15.154:0/573699844 conn(0x7feb9806adf0 msgr2=0x7feb980ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:15.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.001+0000 7feb9dd9d700 1 -- 172.21.15.154:0/573699844 shutdown_connections 2023-10-10T21:20:15.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.001+0000 7feb9dd9d700 1 -- 172.21.15.154:0/573699844 wait complete. 2023-10-10T21:20:15.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.003+0000 7feb9dd9d700 1 Processor -- start 2023-10-10T21:20:15.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.003+0000 7feb9dd9d700 1 -- start start 2023-10-10T21:20:15.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.003+0000 7feb9dd9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 0x7feb98153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:15.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9dd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb981597d0 0x7feb98151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:15.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9dd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981585a0 0x7feb98155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:15.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9dd9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98152160 con 0x7feb9806f0b0 2023-10-10T21:20:15.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9dd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98154ca0 con 0x7feb981597d0 2023-10-10T21:20:15.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9dd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb98158da0 con 0x7feb981585a0 2023-10-10T21:20:15.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9cd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 0x7feb98153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:15.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9cd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 0x7feb98153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54296/0 (socket says 172.21.15.154:54296) 2023-10-10T21:20:15.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9cd9b700 1 -- 172.21.15.154:0/3534739010 learned_addr learned my addr 172.21.15.154:0/3534739010 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:15.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb97fff700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb981597d0 0x7feb98151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:15.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9cd9b700 1 -- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981585a0 msgr2=0x7feb98155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:15.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9d59c700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981585a0 0x7feb98155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:15.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9cd9b700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981585a0 0x7feb98155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:15.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9cd9b700 1 -- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb981597d0 msgr2=0x7feb98151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:15.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9cd9b700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb981597d0 0x7feb98151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:15.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9cd9b700 1 -- 172.21.15.154:0/3534739010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009ae0 con 0x7feb9806f0b0 2023-10-10T21:20:15.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb97fff700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb981597d0 0x7feb98151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:15.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9d59c700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981585a0 0x7feb98155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:15.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.004+0000 7feb9cd9b700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 0x7feb98153be0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c4e0 tx=0x7feb8c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:15.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.005+0000 7feb94ff9700 1 -- 172.21.15.154:0/3534739010 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011590 con 0x7feb9806f0b0 2023-10-10T21:20:15.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.005+0000 7feb94ff9700 1 -- 172.21.15.154:0/3534739010 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c011710 con 0x7feb9806f0b0 2023-10-10T21:20:15.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.005+0000 7feb94ff9700 1 -- 172.21.15.154:0/3534739010 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011ad0 con 0x7feb9806f0b0 2023-10-10T21:20:15.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.005+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb98154370 con 0x7feb9806f0b0 2023-10-10T21:20:15.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.005+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb98154930 con 0x7feb9806f0b0 2023-10-10T21:20:15.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.006+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9804c3c0 con 0x7feb9806f0b0 2023-10-10T21:20:15.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.007+0000 7feb94ff9700 1 -- 172.21.15.154:0/3534739010 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 52) v1 ==== 84578+0+0 (secure 0 0 0) 0x7feb8c01b3b0 con 0x7feb9806f0b0 2023-10-10T21:20:15.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.007+0000 7feb94ff9700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7feb7c066d80 0x7feb7c069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:15.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.008+0000 7feb94ff9700 1 -- 172.21.15.154:0/3534739010 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6405+0+0 (secure 0 0 0) 0x7feb8c0839f0 con 0x7feb9806f0b0 2023-10-10T21:20:15.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.008+0000 7feb97fff700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7feb7c066d80 0x7feb7c069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:15.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.008+0000 7feb97fff700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7feb7c066d80 0x7feb7c069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb84006f00 tx=0x7feb84008040 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:15.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.012+0000 7feb94ff9700 1 -- 172.21.15.154:0/3534739010 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb8c050b80 con 0x7feb9806f0b0 2023-10-10T21:20:15.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:15.212+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feb980cd4a0 con 0x7feb9806f0b0 2023-10-10T21:20:16.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.117+0000 7feb94ff9700 1 -- 172.21.15.154:0/3534739010 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) v1 ==== 169+0+0 (secure 0 0 0) 0x7feb980cd4a0 con 0x7feb9806f0b0 2023-10-10T21:20:16.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7feb7c066d80 msgr2=0x7feb7c069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7feb7c066d80 0x7feb7c069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb84006f00 tx=0x7feb84008040 comp rx=0 tx=0).stop 2023-10-10T21:20:16.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 msgr2=0x7feb98153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 0x7feb98153be0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c4e0 tx=0x7feb8c00c8a0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 shutdown_connections 2023-10-10T21:20:16.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7feb7c066d80 0x7feb7c069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981585a0 0x7feb98155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb9806f0b0 0x7feb98153be0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 --2- 172.21.15.154:0/3534739010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb981597d0 0x7feb98151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 >> 172.21.15.154:0/3534739010 conn(0x7feb9806adf0 msgr2=0x7feb980afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:16.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 shutdown_connections 2023-10-10T21:20:16.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.121+0000 7feb9dd9d700 1 -- 172.21.15.154:0/3534739010 wait complete. 2023-10-10T21:20:16.126 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T21:20:16.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T21:20:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.335+0000 7f2918d9d700 1 Processor -- start 2023-10-10T21:20:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.335+0000 7f2918d9d700 1 -- start start 2023-10-10T21:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.336+0000 7f2918d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2914159a10 0x7f29140ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.336+0000 7f2918d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29140aac80 0x7f291415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.336+0000 7f2918d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291415aa30 con 0x7f29140c81e0 2023-10-10T21:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.336+0000 7f2918d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29140caee0 con 0x7f29140aac80 2023-10-10T21:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.336+0000 7f2918d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29140c7db0 con 0x7f2914159a10 2023-10-10T21:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.337+0000 7f2913fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29140aac80 0x7f291415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.337+0000 7f2913fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29140aac80 0x7f291415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37820/0 (socket says 172.21.15.154:37820) 2023-10-10T21:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.337+0000 7f2913fff700 1 -- 172.21.15.154:0/3424106574 learned_addr learned my addr 172.21.15.154:0/3424106574 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.337+0000 7f29137fe700 1 --2- 172.21.15.154:0/3424106574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2914159a10 0x7f29140ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.337+0000 7f2913fff700 1 -- 172.21.15.154:0/3424106574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2914159a10 msgr2=0x7f29140ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.337+0000 7f2913fff700 1 --2- 172.21.15.154:0/3424106574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2914159a10 0x7f29140ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.337+0000 7f2913fff700 1 -- 172.21.15.154:0/3424106574 >> v1:172.21.15.179:6789/0 conn(0x7f29140c81e0 legacy=0x7f2914159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.337+0000 7f2913fff700 1 -- 172.21.15.154:0/3424106574 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29140c89a0 con 0x7f29140aac80 2023-10-10T21:20:16.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.337+0000 7f2913fff700 1 --2- 172.21.15.154:0/3424106574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 0x7f291415a4f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f290c009f20 tx=0x7f290c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4da4dfcbd066cf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:16.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f29127fc700 1 -- 172.21.15.154:0/3424106574 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c00e070 con 0x7f29140aac80 2023-10-10T21:20:16.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f29127fc700 1 -- 172.21.15.154:0/3424106574 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c00ba40 con 0x7f29140aac80 2023-10-10T21:20:16.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f29127fc700 1 -- 172.21.15.154:0/3424106574 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c0092e0 con 0x7f29140aac80 2023-10-10T21:20:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f2918d9d700 1 -- 172.21.15.154:0/3424106574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 msgr2=0x7f291415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f2918d9d700 1 --2- 172.21.15.154:0/3424106574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 0x7f291415a4f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f290c009f20 tx=0x7f290c009840 comp rx=0 tx=0).stop 2023-10-10T21:20:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f2918d9d700 1 -- 172.21.15.154:0/3424106574 shutdown_connections 2023-10-10T21:20:16.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f2918d9d700 1 --2- 172.21.15.154:0/3424106574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 0x7f291415a4f0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f2918d9d700 1 --2- 172.21.15.154:0/3424106574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2914159a10 0x7f29140ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f2918d9d700 1 -- 172.21.15.154:0/3424106574 >> 172.21.15.154:0/3424106574 conn(0x7f29140cc1e0 msgr2=0x7f29140cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:16.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f2918d9d700 1 -- 172.21.15.154:0/3424106574 shutdown_connections 2023-10-10T21:20:16.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.338+0000 7f2918d9d700 1 -- 172.21.15.154:0/3424106574 wait complete. 2023-10-10T21:20:16.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.340+0000 7f2918d9d700 1 Processor -- start 2023-10-10T21:20:16.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.340+0000 7f2918d9d700 1 -- start start 2023-10-10T21:20:16.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f2918d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 0x7f2914151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f2918d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29140c81e0 0x7f29140ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f2918d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2914159a10 0x7f29140aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f2918d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291406f2b0 con 0x7f29140aac80 2023-10-10T21:20:16.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f2918d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29140c5320 con 0x7f2914159a10 2023-10-10T21:20:16.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f2918d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29140c4710 con 0x7f29140c81e0 2023-10-10T21:20:16.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f29137fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 0x7f2914151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f29137fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 0x7f2914151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37832/0 (socket says 172.21.15.154:37832) 2023-10-10T21:20:16.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f29137fe700 1 -- 172.21.15.154:0/3743754529 learned_addr learned my addr 172.21.15.154:0/3743754529 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:16.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f29137fe700 1 -- 172.21.15.154:0/3743754529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29140c81e0 msgr2=0x7f29140ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f29137fe700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29140c81e0 0x7f29140ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f29137fe700 1 -- 172.21.15.154:0/3743754529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2914159a10 msgr2=0x7f29140aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f2913fff700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2914159a10 0x7f29140aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f29137fe700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2914159a10 0x7f29140aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f29137fe700 1 -- 172.21.15.154:0/3743754529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c009ae0 con 0x7f29140aac80 2023-10-10T21:20:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.341+0000 7f2913fff700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2914159a10 0x7f29140aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.342+0000 7f29137fe700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 0x7f2914151660 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f290400d860 tx=0x7f2904008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.342+0000 7f28fb7fe700 1 -- 172.21.15.154:0/3743754529 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904009610 con 0x7f29140aac80 2023-10-10T21:20:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.342+0000 7f28fb7fe700 1 -- 172.21.15.154:0/3743754529 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2904009770 con 0x7f29140aac80 2023-10-10T21:20:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.342+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29140c49f0 con 0x7f29140aac80 2023-10-10T21:20:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.342+0000 7f28fb7fe700 1 -- 172.21.15.154:0/3743754529 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904009b30 con 0x7f29140aac80 2023-10-10T21:20:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.342+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29140c4fb0 con 0x7f29140aac80 2023-10-10T21:20:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.343+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291406c450 con 0x7f29140aac80 2023-10-10T21:20:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.344+0000 7f28fb7fe700 1 -- 172.21.15.154:0/3743754529 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f290401e460 con 0x7f29140aac80 2023-10-10T21:20:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.345+0000 7f28fb7fe700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2900066f30 0x7f29000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.345+0000 7f28fb7fe700 1 -- 172.21.15.154:0/3743754529 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f2904084cd0 con 0x7f29140aac80 2023-10-10T21:20:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.345+0000 7f2912ffd700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2900066f30 0x7f29000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.346+0000 7f2912ffd700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2900066f30 0x7f29000693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2908007fd0 tx=0x7f2908007b20 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.350+0000 7f28fb7fe700 1 -- 172.21.15.154:0/3743754529 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2904051dc0 con 0x7f29140aac80 2023-10-10T21:20:16.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.541+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f29140c7510 con 0x7f29140aac80 2023-10-10T21:20:16.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.545+0000 7f28fb7fe700 1 -- 172.21.15.154:0/3743754529 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f29040553e0 con 0x7f29140aac80 2023-10-10T21:20:16.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.547+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2900066f30 msgr2=0x7f29000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.547+0000 7f2918d9d700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2900066f30 0x7f29000693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2908007fd0 tx=0x7f2908007b20 comp rx=0 tx=0).stop 2023-10-10T21:20:16.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.547+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 msgr2=0x7f2914151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.548+0000 7f2918d9d700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 0x7f2914151660 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f290400d860 tx=0x7f2904008040 comp rx=0 tx=0).stop 2023-10-10T21:20:16.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.548+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 shutdown_connections 2023-10-10T21:20:16.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.548+0000 7f2918d9d700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2914159a10 0x7f29140aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.548+0000 7f2918d9d700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29140aac80 0x7f2914151660 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.548+0000 7f2918d9d700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2900066f30 0x7f29000693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.548+0000 7f2918d9d700 1 --2- 172.21.15.154:0/3743754529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29140c81e0 0x7f29140ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.548+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 >> 172.21.15.154:0/3743754529 conn(0x7f29140cc1e0 msgr2=0x7f2914153300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:16.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.548+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 shutdown_connections 2023-10-10T21:20:16.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.548+0000 7f2918d9d700 1 -- 172.21.15.154:0/3743754529 wait complete. 2023-10-10T21:20:16.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T21:20:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.750+0000 7faa491ff700 1 Processor -- start 2023-10-10T21:20:16.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.750+0000 7faa491ff700 1 -- start start 2023-10-10T21:20:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.751+0000 7faa491ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 0x7faa440c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.751+0000 7faa491ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa440b0a70 0x7faa440c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.751+0000 7faa491ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa440af2f0 con 0x7faa4415ac80 2023-10-10T21:20:16.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.751+0000 7faa491ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa440af5d0 con 0x7faa440b0a70 2023-10-10T21:20:16.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.751+0000 7faa491ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa440c8660 con 0x7faa44069e80 2023-10-10T21:20:16.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa4359e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa440b0a70 0x7faa440c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa4359e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa440b0a70 0x7faa440c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37842/0 (socket says 172.21.15.154:37842) 2023-10-10T21:20:16.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa4359e700 1 -- 172.21.15.154:0/677542686 learned_addr learned my addr 172.21.15.154:0/677542686 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:16.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa42d9d700 1 --1- 172.21.15.154:0/677542686 >> v1:172.21.15.154:6789/0 conn(0x7faa4415ac80 0x7faa44069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35806/0 (socket says 172.21.15.154:35806) 2023-10-10T21:20:16.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa4259c700 1 --2- 172.21.15.154:0/677542686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 0x7faa440c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa4359e700 1 -- 172.21.15.154:0/677542686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 msgr2=0x7faa440c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:16.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa4359e700 1 --2- 172.21.15.154:0/677542686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 0x7faa440c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa4359e700 1 -- 172.21.15.154:0/677542686 >> v1:172.21.15.154:6789/0 conn(0x7faa4415ac80 legacy=0x7faa44069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa4359e700 1 -- 172.21.15.154:0/677542686 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa440c8940 con 0x7faa440b0a70 2023-10-10T21:20:16.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.752+0000 7faa4359e700 1 --2- 172.21.15.154:0/677542686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 0x7faa440c70b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009f20 tx=0x7faa3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971f327625d9a050 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:16.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa41d9b700 1 -- 172.21.15.154:0/677542686 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00e070 con 0x7faa440b0a70 2023-10-10T21:20:16.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa41d9b700 1 -- 172.21.15.154:0/677542686 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c00ba80 con 0x7faa440b0a70 2023-10-10T21:20:16.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa41d9b700 1 -- 172.21.15.154:0/677542686 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0092e0 con 0x7faa440b0a70 2023-10-10T21:20:16.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa491ff700 1 -- 172.21.15.154:0/677542686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 msgr2=0x7faa440c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa491ff700 1 --2- 172.21.15.154:0/677542686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 0x7faa440c70b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009f20 tx=0x7faa3c009840 comp rx=0 tx=0).stop 2023-10-10T21:20:16.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa491ff700 1 -- 172.21.15.154:0/677542686 shutdown_connections 2023-10-10T21:20:16.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa491ff700 1 --2- 172.21.15.154:0/677542686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 0x7faa440c70b0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa491ff700 1 --2- 172.21.15.154:0/677542686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 0x7faa440c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa491ff700 1 -- 172.21.15.154:0/677542686 >> 172.21.15.154:0/677542686 conn(0x7faa44068e10 msgr2=0x7faa440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:16.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa491ff700 1 -- 172.21.15.154:0/677542686 shutdown_connections 2023-10-10T21:20:16.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.753+0000 7faa491ff700 1 -- 172.21.15.154:0/677542686 wait complete. 2023-10-10T21:20:16.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.755+0000 7faa491ff700 1 Processor -- start 2023-10-10T21:20:16.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.755+0000 7faa491ff700 1 -- start start 2023-10-10T21:20:16.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa491ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 0x7faa440cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa491ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 0x7faa4414af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa491ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4415ac80 0x7faa44158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa491ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4415b050 con 0x7faa440b0a70 2023-10-10T21:20:16.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa491ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa440cb890 con 0x7faa4415ac80 2023-10-10T21:20:16.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa491ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa440ca6c0 con 0x7faa44069e80 2023-10-10T21:20:16.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa4259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 0x7faa4414af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa4259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 0x7faa4414af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37850/0 (socket says 172.21.15.154:37850) 2023-10-10T21:20:16.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa4259c700 1 -- 172.21.15.154:0/1574210829 learned_addr learned my addr 172.21.15.154:0/1574210829 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:16.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa42d9d700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 0x7faa440cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa4359e700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4415ac80 0x7faa44158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa4259c700 1 -- 172.21.15.154:0/1574210829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 msgr2=0x7faa440cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa4259c700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 0x7faa440cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa4259c700 1 -- 172.21.15.154:0/1574210829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4415ac80 msgr2=0x7faa44158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa4259c700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4415ac80 0x7faa44158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa4259c700 1 -- 172.21.15.154:0/1574210829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009ae0 con 0x7faa440b0a70 2023-10-10T21:20:16.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.756+0000 7faa42d9d700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 0x7faa440cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:16.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.757+0000 7faa4259c700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 0x7faa4414af10 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d860 tx=0x7faa38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:16.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.757+0000 7faa2affd700 1 -- 172.21.15.154:0/1574210829 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38018070 con 0x7faa440b0a70 2023-10-10T21:20:16.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.757+0000 7faa2affd700 1 -- 172.21.15.154:0/1574210829 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa380125f0 con 0x7faa440b0a70 2023-10-10T21:20:16.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.757+0000 7faa2affd700 1 -- 172.21.15.154:0/1574210829 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380129b0 con 0x7faa440b0a70 2023-10-10T21:20:16.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.757+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa440ca9a0 con 0x7faa440b0a70 2023-10-10T21:20:16.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.757+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa440caf60 con 0x7faa440b0a70 2023-10-10T21:20:16.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.758+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4415b200 con 0x7faa440b0a70 2023-10-10T21:20:16.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.759+0000 7faa2affd700 1 -- 172.21.15.154:0/1574210829 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa38012d20 con 0x7faa440b0a70 2023-10-10T21:20:16.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.760+0000 7faa2affd700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7faa30066f30 0x7faa300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:16.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.760+0000 7faa2affd700 1 -- 172.21.15.154:0/1574210829 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5933+0+0 (secure 0 0 0) 0x7faa38084980 con 0x7faa440b0a70 2023-10-10T21:20:16.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.760+0000 7faa42d9d700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7faa30066f30 0x7faa300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:16.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.761+0000 7faa42d9d700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7faa30066f30 0x7faa300693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa34007fd0 tx=0x7faa34007e30 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:16.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.764+0000 7faa2affd700 1 -- 172.21.15.154:0/1574210829 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa4415b200 con 0x7faa440b0a70 2023-10-10T21:20:16.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.956+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7faa4415b200 con 0x7faa440b0a70 2023-10-10T21:20:16.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.962+0000 7faa2affd700 1 -- 172.21.15.154:0/1574210829 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v38) v1 ==== 115+0+0 (secure 0 0 0) 0x7faa4415b200 con 0x7faa440b0a70 2023-10-10T21:20:16.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7faa30066f30 msgr2=0x7faa300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7faa30066f30 0x7faa300693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa34007fd0 tx=0x7faa34007e30 comp rx=0 tx=0).stop 2023-10-10T21:20:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 msgr2=0x7faa4414af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 0x7faa4414af10 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d860 tx=0x7faa38008040 comp rx=0 tx=0).stop 2023-10-10T21:20:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 shutdown_connections 2023-10-10T21:20:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4415ac80 0x7faa44158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7faa30066f30 0x7faa300693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa44069e80 0x7faa440cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 --2- 172.21.15.154:0/1574210829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa440b0a70 0x7faa4414af10 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:16.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 >> 172.21.15.154:0/1574210829 conn(0x7faa44068e10 msgr2=0x7faa44156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:16.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 shutdown_connections 2023-10-10T21:20:16.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:16.965+0000 7faa491ff700 1 -- 172.21.15.154:0/1574210829 wait complete. 2023-10-10T21:20:16.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T21:20:17.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.165+0000 7f1abbfff700 1 Processor -- start 2023-10-10T21:20:17.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.165+0000 7f1abbfff700 1 -- start start 2023-10-10T21:20:17.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.166+0000 7f1abbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ab40c83f0 0x7f1ab40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.166+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab41568e0 0x7f1ab40ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.166+0000 7f1abbfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab415b0d0 con 0x7f1ab40ccee0 2023-10-10T21:20:17.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1abbfff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab40c7a60 con 0x7f1ab40c83f0 2023-10-10T21:20:17.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1abbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab415a4c0 con 0x7f1ab41568e0 2023-10-10T21:20:17.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1ab9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ab40c83f0 0x7f1ab40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:17.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1ab959a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1ab40ccee0 0x7f1ab41561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35812/0 (socket says 172.21.15.154:35812) 2023-10-10T21:20:17.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1ab959a700 1 -- 172.21.15.154:0/2843950715 learned_addr learned my addr 172.21.15.154:0/2843950715 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:17.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1aba59c700 1 --2- 172.21.15.154:0/2843950715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab41568e0 0x7f1ab40ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:17.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1ab9d9b700 1 -- 172.21.15.154:0/2843950715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab41568e0 msgr2=0x7f1ab40ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:17.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1ab9d9b700 1 --2- 172.21.15.154:0/2843950715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab41568e0 0x7f1ab40ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1ab9d9b700 1 -- 172.21.15.154:0/2843950715 >> v1:172.21.15.154:6789/0 conn(0x7f1ab40ccee0 legacy=0x7f1ab41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1ab8d99700 1 -- 172.21.15.154:0/2843950715 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484502704 0 0) 0x7f1ab415b0d0 con 0x7f1ab40ccee0 2023-10-10T21:20:17.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.167+0000 7f1ab9d9b700 1 -- 172.21.15.154:0/2843950715 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab415a7a0 con 0x7f1ab40c83f0 2023-10-10T21:20:17.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1ab9d9b700 1 --2- 172.21.15.154:0/2843950715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 0x7f1ab40c7520 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00098e0 tx=0x7f1ab00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765f795012aec2ca server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:17.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1ab8d99700 1 -- 172.21.15.154:0/2843950715 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0009e80 con 0x7f1ab40c83f0 2023-10-10T21:20:17.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1ab8d99700 1 -- 172.21.15.154:0/2843950715 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab000b860 con 0x7f1ab40c83f0 2023-10-10T21:20:17.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1ab8d99700 1 -- 172.21.15.154:0/2843950715 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000bbe0 con 0x7f1ab40c83f0 2023-10-10T21:20:17.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1abbfff700 1 -- 172.21.15.154:0/2843950715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 msgr2=0x7f1ab40c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1abbfff700 1 --2- 172.21.15.154:0/2843950715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 0x7f1ab40c7520 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00098e0 tx=0x7f1ab00091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1abbfff700 1 -- 172.21.15.154:0/2843950715 shutdown_connections 2023-10-10T21:20:17.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1abbfff700 1 --2- 172.21.15.154:0/2843950715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab41568e0 0x7f1ab40ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1abbfff700 1 --2- 172.21.15.154:0/2843950715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 0x7f1ab40c7520 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1abbfff700 1 -- 172.21.15.154:0/2843950715 >> 172.21.15.154:0/2843950715 conn(0x7f1ab4068e10 msgr2=0x7f1ab40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:17.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1abbfff700 1 -- 172.21.15.154:0/2843950715 shutdown_connections 2023-10-10T21:20:17.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.168+0000 7f1abbfff700 1 -- 172.21.15.154:0/2843950715 wait complete. 2023-10-10T21:20:17.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.170+0000 7f1abbfff700 1 Processor -- start 2023-10-10T21:20:17.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.170+0000 7f1abbfff700 1 -- start start 2023-10-10T21:20:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 0x7f1ab414a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab40ccee0 0x7f1ab414de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab41568e0 0x7f1ab40c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1abbfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab414a9a0 con 0x7f1ab40c83f0 2023-10-10T21:20:17.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1abbfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab414a690 con 0x7f1ab40ccee0 2023-10-10T21:20:17.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1abbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab414f0d0 con 0x7f1ab41568e0 2023-10-10T21:20:17.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1ab9d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 0x7f1ab414a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:17.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1ab9d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 0x7f1ab414a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37864/0 (socket says 172.21.15.154:37864) 2023-10-10T21:20:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1ab9d9b700 1 -- 172.21.15.154:0/2249605420 learned_addr learned my addr 172.21.15.154:0/2249605420 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1ab9d9b700 1 -- 172.21.15.154:0/2249605420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab41568e0 msgr2=0x7f1ab40c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1ab9d9b700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab41568e0 0x7f1ab40c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1ab9d9b700 1 -- 172.21.15.154:0/2249605420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab40ccee0 msgr2=0x7f1ab414de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1ab9d9b700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab40ccee0 0x7f1ab414de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.171+0000 7f1ab9d9b700 1 -- 172.21.15.154:0/2249605420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0009420 con 0x7f1ab40c83f0 2023-10-10T21:20:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.172+0000 7f1ab9d9b700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 0x7f1ab414a150 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4063d40 tx=0x7f1ab0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.172+0000 7f1aa9ffb700 1 -- 172.21.15.154:0/2249605420 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000bbe0 con 0x7f1ab40c83f0 2023-10-10T21:20:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.172+0000 7f1aa9ffb700 1 -- 172.21.15.154:0/2249605420 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab0011420 con 0x7f1ab40c83f0 2023-10-10T21:20:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.172+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab414e830 con 0x7f1ab40c83f0 2023-10-10T21:20:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.172+0000 7f1aa9ffb700 1 -- 172.21.15.154:0/2249605420 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0011800 con 0x7f1ab40c83f0 2023-10-10T21:20:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.172+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab414edf0 con 0x7f1ab40c83f0 2023-10-10T21:20:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.173+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab404c3c0 con 0x7f1ab40c83f0 2023-10-10T21:20:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.174+0000 7f1aa9ffb700 1 -- 172.21.15.154:0/2249605420 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ab0011bf0 con 0x7f1ab40c83f0 2023-10-10T21:20:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.175+0000 7f1aa9ffb700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1a98066f30 0x7f1a980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.175+0000 7f1aa9ffb700 1 -- 172.21.15.154:0/2249605420 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f1ab00860a0 con 0x7f1ab40c83f0 2023-10-10T21:20:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.175+0000 7f1ab959a700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1a98066f30 0x7f1a980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.176+0000 7f1ab959a700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1a98066f30 0x7f1a980693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40011e0 tx=0x7f1aa40079d0 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.179+0000 7f1aa9ffb700 1 -- 172.21.15.154:0/2249605420 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ab0053230 con 0x7f1ab40c83f0 2023-10-10T21:20:17.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.369+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f1ab415aa80 con 0x7f1ab40c83f0 2023-10-10T21:20:17.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.374+0000 7f1aa9ffb700 1 -- 172.21.15.154:0/2249605420 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v39) v1 ==== 120+0+0 (secure 0 0 0) 0x7f1ab0056850 con 0x7f1ab40c83f0 2023-10-10T21:20:17.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.376+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1a98066f30 msgr2=0x7f1a980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.376+0000 7f1abbfff700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1a98066f30 0x7f1a980693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40011e0 tx=0x7f1aa40079d0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 msgr2=0x7f1ab414a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 0x7f1ab414a150 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4063d40 tx=0x7f1ab0017000 comp rx=0 tx=0).stop 2023-10-10T21:20:17.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 shutdown_connections 2023-10-10T21:20:17.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1a98066f30 0x7f1a980693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ab41568e0 0x7f1ab40c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab40c83f0 0x7f1ab414a150 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 --2- 172.21.15.154:0/2249605420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ab40ccee0 0x7f1ab414de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 >> 172.21.15.154:0/2249605420 conn(0x7f1ab4068e10 msgr2=0x7f1ab40c2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:17.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 shutdown_connections 2023-10-10T21:20:17.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.377+0000 7f1abbfff700 1 -- 172.21.15.154:0/2249605420 wait complete. 2023-10-10T21:20:17.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-10T21:20:17.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.585+0000 7f0f08fff700 1 Processor -- start 2023-10-10T21:20:17.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.585+0000 7f0f08fff700 1 -- start start 2023-10-10T21:20:17.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0f08fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f041578b0 0x7f0f04155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0f08fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f040ad930 con 0x7f0f04155c10 2023-10-10T21:20:17.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0f08fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f040acd20 con 0x7f0f040af2f0 2023-10-10T21:20:17.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0f08fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040ad000 con 0x7f0f041578b0 2023-10-10T21:20:17.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0efbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f041578b0 0x7f0f04155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:17.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0efbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f041578b0 0x7f0f04155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37880/0 (socket says 172.21.15.154:37880) 2023-10-10T21:20:17.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0efbfff700 1 -- 172.21.15.154:0/2247532280 learned_addr learned my addr 172.21.15.154:0/2247532280 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0efbfff700 1 -- 172.21.15.154:0/2247532280 >> v1:172.21.15.179:6789/0 conn(0x7f0f040af2f0 legacy=0x7f0f040af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0efbfff700 1 -- 172.21.15.154:0/2247532280 >> v1:172.21.15.154:6789/0 conn(0x7f0f04155c10 legacy=0x7f0f040ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0efbfff700 1 -- 172.21.15.154:0/2247532280 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040ad2e0 con 0x7f0f041578b0 2023-10-10T21:20:17.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.587+0000 7f0f01d9b700 1 -- 172.21.15.154:0/2247532280 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76609663 0 0) 0x7f0f040ad930 con 0x7f0f04155c10 2023-10-10T21:20:17.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.588+0000 7f0efbfff700 1 --2- 172.21.15.154:0/2247532280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 0x7f0f04155fe0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0099b0 tx=0x7f0eec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8523e4b5dc0415 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:17.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.588+0000 7f0f01d9b700 1 -- 172.21.15.154:0/2247532280 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00b820 con 0x7f0f041578b0 2023-10-10T21:20:17.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.588+0000 7f0f01d9b700 1 -- 172.21.15.154:0/2247532280 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec00b980 con 0x7f0f041578b0 2023-10-10T21:20:17.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.588+0000 7f0f01d9b700 1 -- 172.21.15.154:0/2247532280 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00bd20 con 0x7f0f041578b0 2023-10-10T21:20:17.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.588+0000 7f0f08fff700 1 -- 172.21.15.154:0/2247532280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 msgr2=0x7f0f04155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.588+0000 7f0f08fff700 1 --2- 172.21.15.154:0/2247532280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 0x7f0f04155fe0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0099b0 tx=0x7f0eec009250 comp rx=0 tx=0).stop 2023-10-10T21:20:17.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.589+0000 7f0f08fff700 1 -- 172.21.15.154:0/2247532280 shutdown_connections 2023-10-10T21:20:17.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.589+0000 7f0f08fff700 1 --2- 172.21.15.154:0/2247532280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 0x7f0f04155fe0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.589+0000 7f0f08fff700 1 -- 172.21.15.154:0/2247532280 >> 172.21.15.154:0/2247532280 conn(0x7f0f0406a320 msgr2=0x7f0f040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:17.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.589+0000 7f0f08fff700 1 -- 172.21.15.154:0/2247532280 shutdown_connections 2023-10-10T21:20:17.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.589+0000 7f0f08fff700 1 -- 172.21.15.154:0/2247532280 wait complete. 2023-10-10T21:20:17.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.590+0000 7f0f08fff700 1 Processor -- start 2023-10-10T21:20:17.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.590+0000 7f0f08fff700 1 -- start start 2023-10-10T21:20:17.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.591+0000 7f0f08fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f040af2f0 0x7f0f0415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.591+0000 7f0f08fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f04155c10 0x7f0f0415b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.591+0000 7f0f08fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 0x7f0f04150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.591+0000 7f0f08fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0414d7f0 con 0x7f0f041578b0 2023-10-10T21:20:17.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.591+0000 7f0f08fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04150cc0 con 0x7f0f04155c10 2023-10-10T21:20:17.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.591+0000 7f0f08fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415b2c0 con 0x7f0f040af2f0 2023-10-10T21:20:17.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.591+0000 7f0f02d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 0x7f0f04150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:17.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.591+0000 7f0f02d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 0x7f0f04150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37896/0 (socket says 172.21.15.154:37896) 2023-10-10T21:20:17.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.591+0000 7f0f02d9d700 1 -- 172.21.15.154:0/1182654347 learned_addr learned my addr 172.21.15.154:0/1182654347 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:17.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0efbfff700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f04155c10 0x7f0f0415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:17.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f0259c700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f040af2f0 0x7f0f0415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:17.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f02d9d700 1 -- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f040af2f0 msgr2=0x7f0f0415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f02d9d700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f040af2f0 0x7f0f0415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f02d9d700 1 -- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f04155c10 msgr2=0x7f0f0415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:17.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f02d9d700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f04155c10 0x7f0f0415b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:17.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f02d9d700 1 -- 172.21.15.154:0/1182654347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0094f0 con 0x7f0f041578b0 2023-10-10T21:20:17.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f0259c700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f040af2f0 0x7f0f0415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:17.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0efbfff700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f04155c10 0x7f0f0415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:17.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f02d9d700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 0x7f0f04150780 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c960 tx=0x7f0efc0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:17.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0efa7fc700 1 -- 172.21.15.154:0/1182654347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00cea0 con 0x7f0f041578b0 2023-10-10T21:20:17.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0efa7fc700 1 -- 172.21.15.154:0/1182654347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc00a830 con 0x7f0f041578b0 2023-10-10T21:20:17.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0415a6b0 con 0x7f0f041578b0 2023-10-10T21:20:17.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0efa7fc700 1 -- 172.21.15.154:0/1182654347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00abf0 con 0x7f0f041578b0 2023-10-10T21:20:17.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.592+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0415ac70 con 0x7f0f041578b0 2023-10-10T21:20:17.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.593+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0404c3c0 con 0x7f0f041578b0 2023-10-10T21:20:17.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.594+0000 7f0efa7fc700 1 -- 172.21.15.154:0/1182654347 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0efc012420 con 0x7f0f041578b0 2023-10-10T21:20:17.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.595+0000 7f0efa7fc700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ee4066f30 0x7f0ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:17.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.595+0000 7f0efa7fc700 1 -- 172.21.15.154:0/1182654347 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f0efc084b00 con 0x7f0f041578b0 2023-10-10T21:20:17.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.595+0000 7f0f0259c700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ee4066f30 0x7f0ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:17.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.596+0000 7f0f0259c700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ee4066f30 0x7f0ee40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40011e0 tx=0x7f0ef4009040 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:17.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.599+0000 7f0efa7fc700 1 -- 172.21.15.154:0/1182654347 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0efc051c90 con 0x7f0f041578b0 2023-10-10T21:20:17.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:17.868+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f0f040ad5c0 con 0x7f0f041578b0 2023-10-10T21:20:18.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.794+0000 7f0efa7fc700 1 -- 172.21.15.154:0/1182654347 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v679) v1 ==== 183+0+0 (secure 0 0 0) 0x7f0efc0160f0 con 0x7f0f041578b0 2023-10-10T21:20:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ee4066f30 msgr2=0x7f0ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:18.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ee4066f30 0x7f0ee40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40011e0 tx=0x7f0ef4009040 comp rx=0 tx=0).stop 2023-10-10T21:20:18.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 msgr2=0x7f0f04150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:18.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 0x7f0f04150780 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c960 tx=0x7f0efc0026e0 comp rx=0 tx=0).stop 2023-10-10T21:20:18.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 shutdown_connections 2023-10-10T21:20:18.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f041578b0 0x7f0f04150780 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0ee4066f30 0x7f0ee40693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f040af2f0 0x7f0f0415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 --2- 172.21.15.154:0/1182654347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f04155c10 0x7f0f0415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 >> 172.21.15.154:0/1182654347 conn(0x7f0f0406a320 msgr2=0x7f0f04154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 shutdown_connections 2023-10-10T21:20:18.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:18.797+0000 7f0f08fff700 1 -- 172.21.15.154:0/1182654347 wait complete. 2023-10-10T21:20:18.820 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2023-10-10T21:20:18.820 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-10-10T21:20:18.821 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T21:20:18.821 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-10T21:20:19.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.006+0000 7f5543fff700 1 Processor -- start 2023-10-10T21:20:19.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.007+0000 7f5543fff700 1 -- start start 2023-10-10T21:20:19.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5543fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5544156310 0x7f55440c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:19.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5543fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55440ae710 0x7f55440c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:19.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5543fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55440ca860 con 0x7f55441566e0 2023-10-10T21:20:19.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5543fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55440cab40 con 0x7f5544156310 2023-10-10T21:20:19.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5543fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55440cae20 con 0x7f55440ae710 2023-10-10T21:20:19.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5542ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5544156310 0x7f55440c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:19.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5542ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5544156310 0x7f55440c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37910/0 (socket says 172.21.15.154:37910) 2023-10-10T21:20:19.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5542ffd700 1 -- 172.21.15.154:0/258312082 learned_addr learned my addr 172.21.15.154:0/258312082 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:19.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f55437fe700 1 --2- 172.21.15.154:0/258312082 >> v2:172.21.15.179:3300/0 conn(0x7f55440ae710 0x7f55440c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:19.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5542ffd700 1 -- 172.21.15.154:0/258312082 >> v2:172.21.15.179:3300/0 conn(0x7f55440ae710 msgr2=0x7f55440c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:19.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.008+0000 7f5542ffd700 1 --2- 172.21.15.154:0/258312082 >> v2:172.21.15.179:3300/0 conn(0x7f55440ae710 0x7f55440c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:19.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.009+0000 7f5542ffd700 1 -- 172.21.15.154:0/258312082 >> v1:172.21.15.179:6789/0 conn(0x7f55441566e0 legacy=0x7f55440ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:19.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.009+0000 7f5542ffd700 1 -- 172.21.15.154:0/258312082 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440cb100 con 0x7f5544156310 2023-10-10T21:20:19.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.009+0000 7f55437fe700 1 --2- 172.21.15.154:0/258312082 >> v2:172.21.15.179:3300/0 conn(0x7f55440ae710 0x7f55440c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:19.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.009+0000 7f5542ffd700 1 --2- 172.21.15.154:0/258312082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 0x7f55440c9dc0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f55440addc0 tx=0x7f5534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103380cf09cd7b1b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:19.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.009+0000 7f5541ffb700 1 -- 172.21.15.154:0/258312082 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400b820 con 0x7f5544156310 2023-10-10T21:20:19.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.009+0000 7f5541ffb700 1 -- 172.21.15.154:0/258312082 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553400b980 con 0x7f5544156310 2023-10-10T21:20:19.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.009+0000 7f5541ffb700 1 -- 172.21.15.154:0/258312082 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400bd20 con 0x7f5544156310 2023-10-10T21:20:19.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.010+0000 7f5543fff700 1 -- 172.21.15.154:0/258312082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 msgr2=0x7f55440c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:19.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.010+0000 7f5543fff700 1 --2- 172.21.15.154:0/258312082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 0x7f55440c9dc0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f55440addc0 tx=0x7f5534009250 comp rx=0 tx=0).stop 2023-10-10T21:20:19.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.010+0000 7f5543fff700 1 -- 172.21.15.154:0/258312082 shutdown_connections 2023-10-10T21:20:19.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.010+0000 7f5543fff700 1 --2- 172.21.15.154:0/258312082 >> v2:172.21.15.179:3300/0 conn(0x7f55440ae710 0x7f55440c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:19.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.010+0000 7f5543fff700 1 --2- 172.21.15.154:0/258312082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 0x7f55440c9dc0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:19.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.010+0000 7f5543fff700 1 -- 172.21.15.154:0/258312082 >> 172.21.15.154:0/258312082 conn(0x7f55440cc1f0 msgr2=0x7f55440cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:19.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.010+0000 7f5543fff700 1 -- 172.21.15.154:0/258312082 shutdown_connections 2023-10-10T21:20:19.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.010+0000 7f5543fff700 1 -- 172.21.15.154:0/258312082 wait complete. 2023-10-10T21:20:19.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.011+0000 7f5543fff700 1 Processor -- start 2023-10-10T21:20:19.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.011+0000 7f5543fff700 1 -- start start 2023-10-10T21:20:19.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.012+0000 7f5543fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55440ae710 0x7f5544143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:19.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.012+0000 7f5543fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 0x7f554415eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:19.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.012+0000 7f5543fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55441566e0 0x7f55440c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:19.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.012+0000 7f5543fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c4d70 con 0x7f5544156310 2023-10-10T21:20:19.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.012+0000 7f5543fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c4160 con 0x7f55441566e0 2023-10-10T21:20:19.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.012+0000 7f5543fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c4440 con 0x7f55440ae710 2023-10-10T21:20:19.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 0x7f554415eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:19.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 0x7f554415eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37924/0 (socket says 172.21.15.154:37924) 2023-10-10T21:20:19.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55427fc700 1 -- 172.21.15.154:0/838434789 learned_addr learned my addr 172.21.15.154:0/838434789 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:19.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f5542ffd700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55440ae710 0x7f5544143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:19.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55437fe700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55441566e0 0x7f55440c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:19.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55427fc700 1 -- 172.21.15.154:0/838434789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55440ae710 msgr2=0x7f5544143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:19.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55427fc700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55440ae710 0x7f5544143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:19.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55427fc700 1 -- 172.21.15.154:0/838434789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55441566e0 msgr2=0x7f55440c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:19.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55427fc700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55441566e0 0x7f55440c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:19.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55427fc700 1 -- 172.21.15.154:0/838434789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55340094f0 con 0x7f5544156310 2023-10-10T21:20:19.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f55427fc700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 0x7f554415eed0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f553800c590 tx=0x7f5538007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:19.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f552affd700 1 -- 172.21.15.154:0/838434789 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538011590 con 0x7f5544156310 2023-10-10T21:20:19.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f552affd700 1 -- 172.21.15.154:0/838434789 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5538011730 con 0x7f5544156310 2023-10-10T21:20:19.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.013+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55440c4720 con 0x7f5544156310 2023-10-10T21:20:19.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.014+0000 7f552affd700 1 -- 172.21.15.154:0/838434789 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538011af0 con 0x7f5544156310 2023-10-10T21:20:19.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.014+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5544144160 con 0x7f5544156310 2023-10-10T21:20:19.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.015+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55440c4f20 con 0x7f5544156310 2023-10-10T21:20:19.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.016+0000 7f552affd700 1 -- 172.21.15.154:0/838434789 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f553801c460 con 0x7f5544156310 2023-10-10T21:20:19.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.016+0000 7f552affd700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5530066f30 0x7f55300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:19.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.016+0000 7f552affd700 1 -- 172.21.15.154:0/838434789 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f55380843c0 con 0x7f5544156310 2023-10-10T21:20:19.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.017+0000 7f5542ffd700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5530066f30 0x7f55300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:19.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.017+0000 7f5542ffd700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5530066f30 0x7f55300693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f55440addc0 tx=0x7f5534016000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:19.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.020+0000 7f552affd700 1 -- 172.21.15.154:0/838434789 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55440c4f20 con 0x7f5544156310 2023-10-10T21:20:19.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.288+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f554404c3c0 con 0x7f5544156310 2023-10-10T21:20:19.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.798+0000 7f552affd700 1 -- 172.21.15.154:0/838434789 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v680) v1 ==== 151+0+0 (secure 0 0 0) 0x7f5538051550 con 0x7f5544156310 2023-10-10T21:20:19.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.801+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5530066f30 msgr2=0x7f55300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:19.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.801+0000 7f5543fff700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5530066f30 0x7f55300693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f55440addc0 tx=0x7f5534016000 comp rx=0 tx=0).stop 2023-10-10T21:20:19.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.801+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 msgr2=0x7f554415eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:19.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.801+0000 7f5543fff700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 0x7f554415eed0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f553800c590 tx=0x7f5538007f30 comp rx=0 tx=0).stop 2023-10-10T21:20:19.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.801+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 shutdown_connections 2023-10-10T21:20:19.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.801+0000 7f5543fff700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55441566e0 0x7f55440c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:19.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.801+0000 7f5543fff700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5530066f30 0x7f55300693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:19.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.802+0000 7f5543fff700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55440ae710 0x7f5544143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:19.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.802+0000 7f5543fff700 1 --2- 172.21.15.154:0/838434789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5544156310 0x7f554415eed0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:19.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.802+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 >> 172.21.15.154:0/838434789 conn(0x7f55440cc1f0 msgr2=0x7f55440c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:19.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.802+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 shutdown_connections 2023-10-10T21:20:19.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:19.802+0000 7f5543fff700 1 -- 172.21.15.154:0/838434789 wait complete. 2023-10-10T21:20:19.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T21:20:19.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:20:19.891 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:20:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.013+0000 7f84049ff700 1 Processor -- start 2023-10-10T21:20:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.013+0000 7f84049ff700 1 -- start start 2023-10-10T21:20:20.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.014+0000 7f84049ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84000c83f0 0x7f84000c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.014+0000 7f84049ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 0x7f84000ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.014+0000 7f84049ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840015b0d0 con 0x7f84000ccee0 2023-10-10T21:20:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.014+0000 7f84049ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000c7a60 con 0x7f84000c83f0 2023-10-10T21:20:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.014+0000 7f84049ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840015a4c0 con 0x7f84001568e0 2023-10-10T21:20:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.014+0000 7f83fe59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84000c83f0 0x7f84000c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.014+0000 7f83fe59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84000c83f0 0x7f84000c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37932/0 (socket says 172.21.15.154:37932) 2023-10-10T21:20:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.014+0000 7f83fe59c700 1 -- 172.21.15.154:0/1247393298 learned_addr learned my addr 172.21.15.154:0/1247393298 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.014+0000 7f83fdd9b700 1 --1- 172.21.15.154:0/1247393298 >> v1:172.21.15.154:6789/0 conn(0x7f84000ccee0 0x7f84001561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35836/0 (socket says 172.21.15.154:35836) 2023-10-10T21:20:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fed9d700 1 --2- 172.21.15.154:0/1247393298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 0x7f84000ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fe59c700 1 -- 172.21.15.154:0/1247393298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 msgr2=0x7f84000ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fe59c700 1 --2- 172.21.15.154:0/1247393298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 0x7f84000ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fe59c700 1 -- 172.21.15.154:0/1247393298 >> v1:172.21.15.154:6789/0 conn(0x7f84000ccee0 legacy=0x7f84001561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fe59c700 1 -- 172.21.15.154:0/1247393298 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840015a7a0 con 0x7f84000c83f0 2023-10-10T21:20:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fd59a700 1 -- 172.21.15.154:0/1247393298 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153250748 0 0) 0x7f840015b0d0 con 0x7f84000ccee0 2023-10-10T21:20:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fe59c700 1 --2- 172.21.15.154:0/1247393298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 0x7f84000c7520 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f83f00099b0 tx=0x7f83f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12aed4135d0f9cf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:20.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fd59a700 1 -- 172.21.15.154:0/1247393298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000b860 con 0x7f84000c83f0 2023-10-10T21:20:20.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fd59a700 1 -- 172.21.15.154:0/1247393298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f000b9c0 con 0x7f84000c83f0 2023-10-10T21:20:20.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.015+0000 7f83fd59a700 1 -- 172.21.15.154:0/1247393298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000bd60 con 0x7f84000c83f0 2023-10-10T21:20:20.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.016+0000 7f84049ff700 1 -- 172.21.15.154:0/1247393298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 msgr2=0x7f84000c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.016+0000 7f84049ff700 1 --2- 172.21.15.154:0/1247393298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 0x7f84000c7520 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f83f00099b0 tx=0x7f83f0009250 comp rx=0 tx=0).stop 2023-10-10T21:20:20.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.016+0000 7f84049ff700 1 -- 172.21.15.154:0/1247393298 shutdown_connections 2023-10-10T21:20:20.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.016+0000 7f84049ff700 1 --2- 172.21.15.154:0/1247393298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 0x7f84000ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.016+0000 7f84049ff700 1 --2- 172.21.15.154:0/1247393298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 0x7f84000c7520 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.016+0000 7f84049ff700 1 -- 172.21.15.154:0/1247393298 >> 172.21.15.154:0/1247393298 conn(0x7f8400068e10 msgr2=0x7f84000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:20.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.016+0000 7f84049ff700 1 -- 172.21.15.154:0/1247393298 shutdown_connections 2023-10-10T21:20:20.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.016+0000 7f84049ff700 1 -- 172.21.15.154:0/1247393298 wait complete. 2023-10-10T21:20:20.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.017+0000 7f84049ff700 1 Processor -- start 2023-10-10T21:20:20.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.018+0000 7f84049ff700 1 -- start start 2023-10-10T21:20:20.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.018+0000 7f84049ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 0x7f840014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.018+0000 7f84049ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84000ccee0 0x7f8400154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f84049ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 0x7f8400155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f84049ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84001547c0 con 0x7f84000c83f0 2023-10-10T21:20:20.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f84049ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8400153bb0 con 0x7f84000ccee0 2023-10-10T21:20:20.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f84049ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8400153e90 con 0x7f84001568e0 2023-10-10T21:20:20.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fe59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 0x7f840014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fe59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 0x7f840014f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37946/0 (socket says 172.21.15.154:37946) 2023-10-10T21:20:20.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fe59c700 1 -- 172.21.15.154:0/559936154 learned_addr learned my addr 172.21.15.154:0/559936154 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:20.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fed9d700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 0x7f8400155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fdd9b700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84000ccee0 0x7f8400154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fe59c700 1 -- 172.21.15.154:0/559936154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 msgr2=0x7f8400155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fe59c700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 0x7f8400155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fe59c700 1 -- 172.21.15.154:0/559936154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84000ccee0 msgr2=0x7f8400154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fe59c700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84000ccee0 0x7f8400154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fe59c700 1 -- 172.21.15.154:0/559936154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f00094f0 con 0x7f84000c83f0 2023-10-10T21:20:20.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fdd9b700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84000ccee0 0x7f8400154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:20.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.019+0000 7f83fe59c700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 0x7f840014f110 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f8400063d40 tx=0x7f83f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:20.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.020+0000 7f83ee7fc700 1 -- 172.21.15.154:0/559936154 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0011e20 con 0x7f84000c83f0 2023-10-10T21:20:20.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.020+0000 7f83ee7fc700 1 -- 172.21.15.154:0/559936154 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0024440 con 0x7f84000c83f0 2023-10-10T21:20:20.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.020+0000 7f83ee7fc700 1 -- 172.21.15.154:0/559936154 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0024800 con 0x7f84000c83f0 2023-10-10T21:20:20.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.020+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8400154170 con 0x7f84000c83f0 2023-10-10T21:20:20.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.020+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8400153840 con 0x7f84000c83f0 2023-10-10T21:20:20.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.021+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840004c3c0 con 0x7f84000c83f0 2023-10-10T21:20:20.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.022+0000 7f83ee7fc700 1 -- 172.21.15.154:0/559936154 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83f001a420 con 0x7f84000c83f0 2023-10-10T21:20:20.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.022+0000 7f83ee7fc700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f83e0066f30 0x7f83e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.022+0000 7f83ee7fc700 1 -- 172.21.15.154:0/559936154 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f83f00865a0 con 0x7f84000c83f0 2023-10-10T21:20:20.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.023+0000 7f83fdd9b700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f83e0066f30 0x7f83e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.023+0000 7f83fdd9b700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f83e0066f30 0x7f83e00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8400151460 tx=0x7f83f4007c90 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:20.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.027+0000 7f83ee7fc700 1 -- 172.21.15.154:0/559936154 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83f0053690 con 0x7f84000c83f0 2023-10-10T21:20:20.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.221+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f840015aa80 con 0x7f84000c83f0 2023-10-10T21:20:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.225+0000 7f83ee7fc700 1 -- 172.21.15.154:0/559936154 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f83f0056cb0 con 0x7f84000c83f0 2023-10-10T21:20:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f83e0066f30 msgr2=0x7f83e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f83e0066f30 0x7f83e00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8400151460 tx=0x7f83f4007c90 comp rx=0 tx=0).stop 2023-10-10T21:20:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 msgr2=0x7f840014f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 0x7f840014f110 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f8400063d40 tx=0x7f83f0017000 comp rx=0 tx=0).stop 2023-10-10T21:20:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 shutdown_connections 2023-10-10T21:20:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f83e0066f30 0x7f83e00693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84001568e0 0x7f8400155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84000c83f0 0x7f840014f110 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 --2- 172.21.15.154:0/559936154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84000ccee0 0x7f8400154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 >> 172.21.15.154:0/559936154 conn(0x7f8400068e10 msgr2=0x7f84000cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 shutdown_connections 2023-10-10T21:20:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.228+0000 7f84049ff700 1 -- 172.21.15.154:0/559936154 wait complete. 2023-10-10T21:20:20.246 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:20:20.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:20:20.366 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:20:20.453 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:20:20.454 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T21:20:20.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:20:20.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.635+0000 7f1269dff700 1 Processor -- start 2023-10-10T21:20:20.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.635+0000 7f1269dff700 1 -- start start 2023-10-10T21:20:20.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.636+0000 7f1269dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12640b0a10 0x7f1264155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.636+0000 7f1269dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12640ad930 con 0x7f1264155c10 2023-10-10T21:20:20.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.636+0000 7f1269dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12640acd20 con 0x7f12641578b0 2023-10-10T21:20:20.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.636+0000 7f1269dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12640ad000 con 0x7f12640b0a10 2023-10-10T21:20:20.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.637+0000 7f1263fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12640b0a10 0x7f1264155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.637+0000 7f12637fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1264155c10 0x7f12640ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35844/0 (socket says 172.21.15.154:35844) 2023-10-10T21:20:20.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.637+0000 7f1263fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12640b0a10 0x7f1264155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37954/0 (socket says 172.21.15.154:37954) 2023-10-10T21:20:20.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.637+0000 7f12637fe700 1 -- 172.21.15.154:0/943562084 learned_addr learned my addr 172.21.15.154:0/943562084 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:20.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.637+0000 7f12627fc700 1 -- 172.21.15.154:0/943562084 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127668725 0 0) 0x7f12640ad930 con 0x7f1264155c10 2023-10-10T21:20:20.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.637+0000 7f12627fc700 1 -- 172.21.15.154:0/943562084 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f124c003570 con 0x7f1264155c10 2023-10-10T21:20:20.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.637+0000 7f1263fff700 1 -- 172.21.15.154:0/943562084 >> v1:172.21.15.179:6789/0 conn(0x7f12641578b0 legacy=0x7f12640af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.637+0000 7f1263fff700 1 -- 172.21.15.154:0/943562084 >> v1:172.21.15.154:6789/0 conn(0x7f1264155c10 legacy=0x7f12640ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.637+0000 7f1263fff700 1 -- 172.21.15.154:0/943562084 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12640ad2e0 con 0x7f12640b0a10 2023-10-10T21:20:20.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f1263fff700 1 --2- 172.21.15.154:0/943562084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12640b0a10 0x7f1264155fe0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f125c00d0d0 tx=0x7f125c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680636ee3fe95dbe server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:20.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f12627fc700 1 -- 172.21.15.154:0/943562084 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c010070 con 0x7f12640b0a10 2023-10-10T21:20:20.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f12627fc700 1 -- 172.21.15.154:0/943562084 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c00db30 con 0x7f12640b0a10 2023-10-10T21:20:20.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f12627fc700 1 -- 172.21.15.154:0/943562084 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c016400 con 0x7f12640b0a10 2023-10-10T21:20:20.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f1269dff700 1 -- 172.21.15.154:0/943562084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12640b0a10 msgr2=0x7f1264155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f1269dff700 1 --2- 172.21.15.154:0/943562084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12640b0a10 0x7f1264155fe0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f125c00d0d0 tx=0x7f125c00b990 comp rx=0 tx=0).stop 2023-10-10T21:20:20.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f1269dff700 1 -- 172.21.15.154:0/943562084 shutdown_connections 2023-10-10T21:20:20.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f1269dff700 1 --2- 172.21.15.154:0/943562084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12640b0a10 0x7f1264155fe0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f1269dff700 1 -- 172.21.15.154:0/943562084 >> 172.21.15.154:0/943562084 conn(0x7f126406a320 msgr2=0x7f12640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:20.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f1269dff700 1 -- 172.21.15.154:0/943562084 shutdown_connections 2023-10-10T21:20:20.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.638+0000 7f1269dff700 1 -- 172.21.15.154:0/943562084 wait complete. 2023-10-10T21:20:20.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.640+0000 7f1269dff700 1 Processor -- start 2023-10-10T21:20:20.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.640+0000 7f1269dff700 1 -- start start 2023-10-10T21:20:20.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1269dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12640b0a10 0x7f1264158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1269dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264155c10 0x7f12641503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1269dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12641578b0 0x7f126416a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1269dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126415bc70 con 0x7f12641578b0 2023-10-10T21:20:20.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1269dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126415b410 con 0x7f1264155c10 2023-10-10T21:20:20.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1269dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1264159330 con 0x7f12640b0a10 2023-10-10T21:20:20.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1263fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12641578b0 0x7f126416a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1263fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12641578b0 0x7f126416a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37968/0 (socket says 172.21.15.154:37968) 2023-10-10T21:20:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1263fff700 1 -- 172.21.15.154:0/3837571334 learned_addr learned my addr 172.21.15.154:0/3837571334 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f12637fe700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12640b0a10 0x7f1264158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.641+0000 7f1262ffd700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264155c10 0x7f12641503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f1263fff700 1 -- 172.21.15.154:0/3837571334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12640b0a10 msgr2=0x7f1264158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f1263fff700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12640b0a10 0x7f1264158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f1263fff700 1 -- 172.21.15.154:0/3837571334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264155c10 msgr2=0x7f12641503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f1263fff700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264155c10 0x7f12641503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f1263fff700 1 -- 172.21.15.154:0/3837571334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c00bc30 con 0x7f12641578b0 2023-10-10T21:20:20.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f12637fe700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12640b0a10 0x7f1264158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:20.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f1263fff700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12641578b0 0x7f126416a0f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f125c00bc00 tx=0x7f125c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:20.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f124b7fe700 1 -- 172.21.15.154:0/3837571334 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c009720 con 0x7f12641578b0 2023-10-10T21:20:20.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f124b7fe700 1 -- 172.21.15.154:0/3837571334 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c0098a0 con 0x7f12641578b0 2023-10-10T21:20:20.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f124b7fe700 1 -- 172.21.15.154:0/3837571334 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c009c60 con 0x7f12641578b0 2023-10-10T21:20:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126415b6b0 con 0x7f12641578b0 2023-10-10T21:20:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.642+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12641596f0 con 0x7f12641578b0 2023-10-10T21:20:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.643+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1264159550 con 0x7f12641578b0 2023-10-10T21:20:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.644+0000 7f124b7fe700 1 -- 172.21.15.154:0/3837571334 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f125c003040 con 0x7f12641578b0 2023-10-10T21:20:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.645+0000 7f124b7fe700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1250066f30 0x7f12500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.645+0000 7f124b7fe700 1 -- 172.21.15.154:0/3837571334 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f125c023030 con 0x7f12641578b0 2023-10-10T21:20:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.645+0000 7f12637fe700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1250066f30 0x7f12500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:20.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.646+0000 7f12637fe700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1250066f30 0x7f12500693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12540058d0 tx=0x7f1254009040 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:20.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.650+0000 7f124b7fe700 1 -- 172.21.15.154:0/3837571334 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1264159550 con 0x7f12641578b0 2023-10-10T21:20:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.881+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1264159550 con 0x7f12641578b0 2023-10-10T21:20:20.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.882+0000 7f124b7fe700 1 -- 172.21.15.154:0/3837571334 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f1264159550 con 0x7f12641578b0 2023-10-10T21:20:20.884 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:20.884 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1983002927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1983002927},{"type":"v1","addr":"172.21.15.179:6835","nonce":1983002927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6452,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1579008439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1579008439},{"type":"v1","addr":"172.21.15.154:6834","nonce":1579008439}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3483729269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3483729269},{"type":"v1","addr":"172.21.15.179:6834","nonce":3483729269}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3602154448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3602154448},{"type":"v1","addr":"172.21.15.154:6837","nonce":3602154448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[]} 2023-10-10T21:20:20.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1250066f30 msgr2=0x7f12500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1250066f30 0x7f12500693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12540058d0 tx=0x7f1254009040 comp rx=0 tx=0).stop 2023-10-10T21:20:20.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12641578b0 msgr2=0x7f126416a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:20.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12641578b0 0x7f126416a0f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f125c00bc00 tx=0x7f125c01c000 comp rx=0 tx=0).stop 2023-10-10T21:20:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 shutdown_connections 2023-10-10T21:20:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12641578b0 0x7f126416a0f0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f1250066f30 0x7f12500693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12640b0a10 0x7f1264158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 --2- 172.21.15.154:0/3837571334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264155c10 0x7f12641503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 >> 172.21.15.154:0/3837571334 conn(0x7f126406a320 msgr2=0x7f126415eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:20.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 shutdown_connections 2023-10-10T21:20:20.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:20.884+0000 7f1269dff700 1 -- 172.21.15.154:0/3837571334 wait complete. 2023-10-10T21:20:20.890 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 47 2023-10-10T21:20:20.904 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T21:20:20.904 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T21:20:20.905 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T21:20:20.905 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:20:20.905 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T21:20:20.905 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T21:20:20.906 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T21:20:20.906 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:20:20.906 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T21:20:20.907 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T21:20:20.907 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T21:20:20.907 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:20:20.907 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T21:20:20.908 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T21:20:20.908 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T21:20:20.909 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:20:20.918 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T21:20:20.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T21:20:20.921 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T21:20:20.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T21:20:20.924 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T21:20:20.924 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T21:20:20.925 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T21:20:20.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T21:20:20.965 INFO:tasks.ceph.mds.a:Started 2023-10-10T21:20:20.966 DEBUG:teuthology.parallel:result is None 2023-10-10T21:20:20.969 INFO:tasks.ceph.mds.c:Started 2023-10-10T21:20:20.969 DEBUG:teuthology.parallel:result is None 2023-10-10T21:20:20.970 INFO:tasks.ceph.mds.b:Started 2023-10-10T21:20:20.971 DEBUG:teuthology.parallel:result is None 2023-10-10T21:20:20.973 INFO:tasks.ceph.mds.d:Started 2023-10-10T21:20:20.973 DEBUG:teuthology.parallel:result is None 2023-10-10T21:20:20.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T21:20:21.101 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:20:21.102 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:20:21.111 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:20:21.112 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T21:20:21.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.168+0000 7fc67a5ff700 1 Processor -- start 2023-10-10T21:20:21.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.168+0000 7fc67a5ff700 1 -- start start 2023-10-10T21:20:21.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.169+0000 7fc67a5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc674159890 0x7fc67415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.169+0000 7fc67a5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc674069560 0x7fc6740699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.169+0000 7fc67a5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc674069ee0 con 0x7fc674159c60 2023-10-10T21:20:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.169+0000 7fc67a5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67415a160 con 0x7fc674159890 2023-10-10T21:20:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.169+0000 7fc67a5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6740d13a0 con 0x7fc674069560 2023-10-10T21:20:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.169+0000 7fc673fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc674159890 0x7fc67415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:21.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc673fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc674159890 0x7fc67415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38000/0 (socket says 172.21.15.154:38000) 2023-10-10T21:20:21.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc6737fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc674159c60 0x7fc67415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35856/0 (socket says 172.21.15.154:35856) 2023-10-10T21:20:21.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc673fff700 1 -- 172.21.15.154:0/149275426 learned_addr learned my addr 172.21.15.154:0/149275426 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:21.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc678b9c700 1 --2- 172.21.15.154:0/149275426 >> v2:172.21.15.179:3300/0 conn(0x7fc674069560 0x7fc6740699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc673fff700 1 -- 172.21.15.154:0/149275426 >> v2:172.21.15.179:3300/0 conn(0x7fc674069560 msgr2=0x7fc6740699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc673fff700 1 --2- 172.21.15.154:0/149275426 >> v2:172.21.15.179:3300/0 conn(0x7fc674069560 0x7fc6740699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc673fff700 1 -- 172.21.15.154:0/149275426 >> v1:172.21.15.154:6789/0 conn(0x7fc674159c60 legacy=0x7fc67415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc673fff700 1 -- 172.21.15.154:0/149275426 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67415e140 con 0x7fc674159890 2023-10-10T21:20:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc672ffd700 1 -- 172.21.15.154:0/149275426 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622509562 0 0) 0x7fc674069ee0 con 0x7fc674159c60 2023-10-10T21:20:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc678b9c700 1 --2- 172.21.15.154:0/149275426 >> v2:172.21.15.179:3300/0 conn(0x7fc674069560 0x7fc6740699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc673fff700 1 --2- 172.21.15.154:0/149275426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674159890 0x7fc67415abd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc67406a890 tx=0x7fc664009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a032fe57e6e6fd4e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.170+0000 7fc672ffd700 1 -- 172.21.15.154:0/149275426 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400b860 con 0x7fc674159890 2023-10-10T21:20:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc672ffd700 1 -- 172.21.15.154:0/149275426 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66400b9c0 con 0x7fc674159890 2023-10-10T21:20:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc672ffd700 1 -- 172.21.15.154:0/149275426 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400bd60 con 0x7fc674159890 2023-10-10T21:20:21.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc67a5ff700 1 -- 172.21.15.154:0/149275426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674159890 msgr2=0x7fc67415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:21.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc67a5ff700 1 --2- 172.21.15.154:0/149275426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674159890 0x7fc67415abd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc67406a890 tx=0x7fc664009250 comp rx=0 tx=0).stop 2023-10-10T21:20:21.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc67a5ff700 1 -- 172.21.15.154:0/149275426 shutdown_connections 2023-10-10T21:20:21.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc67a5ff700 1 --2- 172.21.15.154:0/149275426 >> v2:172.21.15.179:3300/0 conn(0x7fc674069560 0x7fc6740699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:21.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc67a5ff700 1 --2- 172.21.15.154:0/149275426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674159890 0x7fc67415abd0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:21.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc67a5ff700 1 -- 172.21.15.154:0/149275426 >> 172.21.15.154:0/149275426 conn(0x7fc674068e20 msgr2=0x7fc6740d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:21.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc67a5ff700 1 -- 172.21.15.154:0/149275426 shutdown_connections 2023-10-10T21:20:21.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.171+0000 7fc67a5ff700 1 -- 172.21.15.154:0/149275426 wait complete. 2023-10-10T21:20:21.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.173+0000 7fc67a5ff700 1 Processor -- start 2023-10-10T21:20:21.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.173+0000 7fc67a5ff700 1 -- start start 2023-10-10T21:20:21.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc67a5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674069560 0x7fc6741524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:21.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc67a5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc674159890 0x7fc6740c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:21.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc67a5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674159c60 0x7fc6740cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:21.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc67a5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6740b4630 con 0x7fc674069560 2023-10-10T21:20:21.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc67a5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6740b3a20 con 0x7fc674159c60 2023-10-10T21:20:21.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc67a5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6740b3d00 con 0x7fc674159890 2023-10-10T21:20:21.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc673fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674069560 0x7fc6741524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:21.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc673fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674069560 0x7fc6741524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38006/0 (socket says 172.21.15.154:38006) 2023-10-10T21:20:21.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc673fff700 1 -- 172.21.15.154:0/1819606274 learned_addr learned my addr 172.21.15.154:0/1819606274 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:21.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc6737fe700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc674159890 0x7fc6740c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:21.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc678b9c700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674159c60 0x7fc6740cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:21.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc673fff700 1 -- 172.21.15.154:0/1819606274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc674159890 msgr2=0x7fc6740c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:21.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc673fff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc674159890 0x7fc6740c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:21.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc673fff700 1 -- 172.21.15.154:0/1819606274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674159c60 msgr2=0x7fc6740cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:21.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc673fff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674159c60 0x7fc6740cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:21.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.174+0000 7fc673fff700 1 -- 172.21.15.154:0/1819606274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640094f0 con 0x7fc674069560 2023-10-10T21:20:21.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.175+0000 7fc673fff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674069560 0x7fc6741524d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc664009290 tx=0x7fc664017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:21.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.175+0000 7fc65bfff700 1 -- 172.21.15.154:0/1819606274 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664026450 con 0x7fc674069560 2023-10-10T21:20:21.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.175+0000 7fc65bfff700 1 -- 172.21.15.154:0/1819606274 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6640265b0 con 0x7fc674069560 2023-10-10T21:20:21.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.175+0000 7fc65bfff700 1 -- 172.21.15.154:0/1819606274 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664026970 con 0x7fc674069560 2023-10-10T21:20:21.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.175+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6740b3fe0 con 0x7fc674069560 2023-10-10T21:20:21.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.175+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6740c83a0 con 0x7fc674069560 2023-10-10T21:20:21.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.176+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67404c3c0 con 0x7fc674069560 2023-10-10T21:20:21.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.177+0000 7fc65bfff700 1 -- 172.21.15.154:0/1819606274 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc66401a420 con 0x7fc674069560 2023-10-10T21:20:21.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.178+0000 7fc65bfff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc660066f30 0x7fc6600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:21.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.178+0000 7fc65bfff700 1 -- 172.21.15.154:0/1819606274 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5933+0+0 (secure 0 0 0) 0x7fc6640864b0 con 0x7fc674069560 2023-10-10T21:20:21.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.178+0000 7fc6737fe700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc660066f30 0x7fc6600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:21.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.178+0000 7fc6737fe700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc660066f30 0x7fc6600693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc668007fd0 tx=0x7fc668007e10 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:21.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.182+0000 7fc65bfff700 1 -- 172.21.15.154:0/1819606274 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6640536d0 con 0x7fc674069560 2023-10-10T21:20:21.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.387+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc6740cbd20 con 0x7fc674069560 2023-10-10T21:20:21.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.810+0000 7fc65bfff700 1 -- 172.21.15.154:0/1819606274 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v118) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc664056cf0 con 0x7fc674069560 2023-10-10T21:20:21.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc660066f30 msgr2=0x7fc6600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:21.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc660066f30 0x7fc6600693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc668007fd0 tx=0x7fc668007e10 comp rx=0 tx=0).stop 2023-10-10T21:20:21.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674069560 msgr2=0x7fc6741524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:21.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674069560 0x7fc6741524d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc664009290 tx=0x7fc664017000 comp rx=0 tx=0).stop 2023-10-10T21:20:21.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 shutdown_connections 2023-10-10T21:20:21.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674159c60 0x7fc6740cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc674069560 0x7fc6741524d0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc660066f30 0x7fc6600693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 --2- 172.21.15.154:0/1819606274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc674159890 0x7fc6740c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 >> 172.21.15.154:0/1819606274 conn(0x7fc674068e20 msgr2=0x7fc6740b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 shutdown_connections 2023-10-10T21:20:21.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:21.813+0000 7fc67a5ff700 1 -- 172.21.15.154:0/1819606274 wait complete. 2023-10-10T21:20:21.817 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T21:20:21.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T21:20:22.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.014+0000 7fbca7fff700 1 Processor -- start 2023-10-10T21:20:22.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.015+0000 7fbca7fff700 1 -- start start 2023-10-10T21:20:22.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.016+0000 7fbca7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbca01579f0 0x7fbca0162530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.016+0000 7fbca7fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca00cb300 con 0x7fbca00b1850 2023-10-10T21:20:22.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.016+0000 7fbca7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca00cb5e0 con 0x7fbca00b1c20 2023-10-10T21:20:22.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.016+0000 7fbca7fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca006fc30 con 0x7fbca01579f0 2023-10-10T21:20:22.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.016+0000 7fbca659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbca01579f0 0x7fbca0162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.016+0000 7fbca5d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbca00b1850 0x7fbca00ae680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35858/0 (socket says 172.21.15.154:35858) 2023-10-10T21:20:22.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.016+0000 7fbca659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbca01579f0 0x7fbca0162530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38012/0 (socket says 172.21.15.154:38012) 2023-10-10T21:20:22.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.016+0000 7fbca5d9b700 1 -- 172.21.15.154:0/3534341265 learned_addr learned my addr 172.21.15.154:0/3534341265 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:22.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.017+0000 7fbca659c700 1 -- 172.21.15.154:0/3534341265 >> v1:172.21.15.179:6789/0 conn(0x7fbca00b1c20 legacy=0x7fbca01572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.017+0000 7fbca659c700 1 -- 172.21.15.154:0/3534341265 >> v1:172.21.15.154:6789/0 conn(0x7fbca00b1850 legacy=0x7fbca00ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.017+0000 7fbca659c700 1 -- 172.21.15.154:0/3534341265 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca00cb8c0 con 0x7fbca01579f0 2023-10-10T21:20:22.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.017+0000 7fbca4d99700 1 -- 172.21.15.154:0/3534341265 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345057800 0 0) 0x7fbca00cb300 con 0x7fbca00b1850 2023-10-10T21:20:22.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.017+0000 7fbca659c700 1 --2- 172.21.15.154:0/3534341265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 0x7fbca0162530 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009e60 tx=0x7fbc98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce25cef06fd646f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:22.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.017+0000 7fbca4d99700 1 -- 172.21.15.154:0/3534341265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800e070 con 0x7fbca01579f0 2023-10-10T21:20:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.017+0000 7fbca4d99700 1 -- 172.21.15.154:0/3534341265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9800bc30 con 0x7fbca01579f0 2023-10-10T21:20:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.017+0000 7fbca4d99700 1 -- 172.21.15.154:0/3534341265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98012430 con 0x7fbca01579f0 2023-10-10T21:20:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.018+0000 7fbca7fff700 1 -- 172.21.15.154:0/3534341265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 msgr2=0x7fbca0162530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.018+0000 7fbca7fff700 1 --2- 172.21.15.154:0/3534341265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 0x7fbca0162530 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009e60 tx=0x7fbc98009780 comp rx=0 tx=0).stop 2023-10-10T21:20:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.018+0000 7fbca7fff700 1 -- 172.21.15.154:0/3534341265 shutdown_connections 2023-10-10T21:20:22.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.018+0000 7fbca7fff700 1 --2- 172.21.15.154:0/3534341265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 0x7fbca0162530 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.018+0000 7fbca7fff700 1 -- 172.21.15.154:0/3534341265 >> 172.21.15.154:0/3534341265 conn(0x7fbca006a320 msgr2=0x7fbca00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:22.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.018+0000 7fbca7fff700 1 -- 172.21.15.154:0/3534341265 shutdown_connections 2023-10-10T21:20:22.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.018+0000 7fbca7fff700 1 -- 172.21.15.154:0/3534341265 wait complete. 2023-10-10T21:20:22.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.019+0000 7fbca7fff700 1 Processor -- start 2023-10-10T21:20:22.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.019+0000 7fbca7fff700 1 -- start start 2023-10-10T21:20:22.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.020+0000 7fbca7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca00b1850 0x7fbca014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.020+0000 7fbca7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbca00b1c20 0x7fbca015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.020+0000 7fbca7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 0x7fbca014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.020+0000 7fbca7fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca00cc260 con 0x7fbca01579f0 2023-10-10T21:20:22.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.020+0000 7fbca7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0150fa0 con 0x7fbca00b1850 2023-10-10T21:20:22.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.020+0000 7fbca7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0150390 con 0x7fbca00b1c20 2023-10-10T21:20:22.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbca659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 0x7fbca014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbca659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 0x7fbca014bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38026/0 (socket says 172.21.15.154:38026) 2023-10-10T21:20:22.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbca659c700 1 -- 172.21.15.154:0/569308705 learned_addr learned my addr 172.21.15.154:0/569308705 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:22.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbca659c700 1 -- 172.21.15.154:0/569308705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbca00b1c20 msgr2=0x7fbca015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbca659c700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbca00b1c20 0x7fbca015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbca659c700 1 -- 172.21.15.154:0/569308705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca00b1850 msgr2=0x7fbca014fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbca659c700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca00b1850 0x7fbca014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbca659c700 1 -- 172.21.15.154:0/569308705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc98009a20 con 0x7fbca01579f0 2023-10-10T21:20:22.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbca659c700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 0x7fbca014bf20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fbc98013000 tx=0x7fbc98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:22.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.021+0000 7fbc95ffb700 1 -- 172.21.15.154:0/569308705 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9801b630 con 0x7fbca01579f0 2023-10-10T21:20:22.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.022+0000 7fbc95ffb700 1 -- 172.21.15.154:0/569308705 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9801b790 con 0x7fbca01579f0 2023-10-10T21:20:22.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.022+0000 7fbc95ffb700 1 -- 172.21.15.154:0/569308705 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9801bb10 con 0x7fbca01579f0 2023-10-10T21:20:22.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.022+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca0150670 con 0x7fbca01579f0 2023-10-10T21:20:22.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.022+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca0150c30 con 0x7fbca01579f0 2023-10-10T21:20:22.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.023+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca004c3c0 con 0x7fbca01579f0 2023-10-10T21:20:22.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.023+0000 7fbc95ffb700 1 -- 172.21.15.154:0/569308705 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc9801c400 con 0x7fbca01579f0 2023-10-10T21:20:22.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.025+0000 7fbc95ffb700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbc84066f30 0x7fbc840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.025+0000 7fbc95ffb700 1 -- 172.21.15.154:0/569308705 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fbc98086350 con 0x7fbca01579f0 2023-10-10T21:20:22.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.025+0000 7fbca5d9b700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbc84066f30 0x7fbc840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.026+0000 7fbca5d9b700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbc84066f30 0x7fbc840693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0011e0 tx=0x7fbc9c0079d0 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:22.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.029+0000 7fbc95ffb700 1 -- 172.21.15.154:0/569308705 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc980537a0 con 0x7fbca01579f0 2023-10-10T21:20:22.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.293+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbca0151160 con 0x7fbca01579f0 2023-10-10T21:20:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.293+0000 7fbc95ffb700 1 -- 172.21.15.154:0/569308705 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbc98056dc0 con 0x7fbca01579f0 2023-10-10T21:20:22.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:22.296 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:20:22.296 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T21:20:22.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.297 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T21:20:22.297 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T21:20:22.297 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.297 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:20:22.298 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:20:22.298 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:20:22.298 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.298 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.299 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T21:20:22.299 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T21:20:22.299 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.300 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:20:22.300 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:20:22.300 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:20:22.300 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.301 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.302 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T21:20:22.302 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T21:20:22.303 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.303 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:20:22.303 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:20:22.304 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:20:22.304 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T21:20:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T21:20:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:20:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:20:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:20:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T21:20:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T21:20:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:20:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:20:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.312 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T21:20:22.312 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T21:20:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:20:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:20:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T21:20:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T21:20:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:20:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:20:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T21:20:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T21:20:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:20:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:20:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T21:20:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T21:20:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:20:22.320 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:20:22.320 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.321 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T21:20:22.321 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T21:20:22.321 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.321 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:20:22.322 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:20:22.322 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.322 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.323 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T21:20:22.323 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T21:20:22.323 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.323 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:20:22.323 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:20:22.324 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.324 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T21:20:22.325 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T21:20:22.325 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.325 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:20:22.325 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:20:22.325 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.326 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T21:20:22.326 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T21:20:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:20:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T21:20:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T21:20:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T21:20:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T21:20:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:20:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:20:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:20:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:20:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T21:20:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T21:20:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:20:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:20:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:20:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:20:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T21:20:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T21:20:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:20:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:20:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:20:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:20:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T21:20:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T21:20:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:20:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:20:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:20:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T21:20:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T21:20:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:20:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:20:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:20:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T21:20:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T21:20:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:20:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:20:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:20:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:20:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T21:20:22.341 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:20:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbc84066f30 msgr2=0x7fbc840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbc84066f30 0x7fbc840693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0011e0 tx=0x7fbc9c0079d0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 msgr2=0x7fbca014bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 0x7fbca014bf20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fbc98013000 tx=0x7fbc98019000 comp rx=0 tx=0).stop 2023-10-10T21:20:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 shutdown_connections 2023-10-10T21:20:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbca01579f0 0x7fbca014bf20 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca00b1850 0x7fbca014fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbc84066f30 0x7fbc840693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 --2- 172.21.15.154:0/569308705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbca00b1c20 0x7fbca015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 >> 172.21.15.154:0/569308705 conn(0x7fbca006a320 msgr2=0x7fbca00acc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 shutdown_connections 2023-10-10T21:20:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.296+0000 7fbca7fff700 1 -- 172.21.15.154:0/569308705 wait complete. 2023-10-10T21:20:22.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:20:22.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.527+0000 7f2f4b59e700 1 Processor -- start 2023-10-10T21:20:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.527+0000 7f2f4b59e700 1 -- start start 2023-10-10T21:20:22.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.528+0000 7f2f4b59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2f4c156310 0x7f2f4c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.528+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 0x7f2f4c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.528+0000 7f2f4b59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c0ca860 con 0x7f2f4c1566e0 2023-10-10T21:20:22.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.528+0000 7f2f4b59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0cab40 con 0x7f2f4c156310 2023-10-10T21:20:22.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.528+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0cae20 con 0x7f2f4c0ae710 2023-10-10T21:20:22.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f41d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2f4c1566e0 0x7f2f4c0ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35860/0 (socket says 172.21.15.154:35860) 2023-10-10T21:20:22.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f41d9b700 1 -- 172.21.15.154:0/3751199784 learned_addr learned my addr 172.21.15.154:0/3751199784 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:22.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f4a59c700 1 --2- 172.21.15.154:0/3751199784 >> v2:172.21.15.179:3300/0 conn(0x7f2f4c156310 0x7f2f4c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f4ad9d700 1 --2- 172.21.15.154:0/3751199784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 0x7f2f4c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f49d9b700 1 -- 172.21.15.154:0/3751199784 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305320552 0 0) 0x7f2f4c0ca860 con 0x7f2f4c1566e0 2023-10-10T21:20:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f49d9b700 1 -- 172.21.15.154:0/3751199784 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f38003570 con 0x7f2f4c1566e0 2023-10-10T21:20:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f4a59c700 1 -- 172.21.15.154:0/3751199784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 msgr2=0x7f2f4c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f4a59c700 1 --2- 172.21.15.154:0/3751199784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 0x7f2f4c0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f4a59c700 1 -- 172.21.15.154:0/3751199784 >> v1:172.21.15.154:6789/0 conn(0x7f2f4c1566e0 legacy=0x7f2f4c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.529+0000 7f2f49d9b700 1 -- 172.21.15.154:0/3751199784 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948993877 0 0) 0x7f2f38003570 con 0x7f2f4c1566e0 2023-10-10T21:20:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.530+0000 7f2f4a59c700 1 -- 172.21.15.154:0/3751199784 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0cb100 con 0x7f2f4c156310 2023-10-10T21:20:22.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.530+0000 7f2f4ad9d700 1 --2- 172.21.15.154:0/3751199784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 0x7f2f4c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:22.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.530+0000 7f2f4a59c700 1 --2- 172.21.15.154:0/3751199784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f4c156310 0x7f2f4c0c9dc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0098e0 tx=0x7f2f3c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=995239a5e54704cc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:22.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.530+0000 7f2f49d9b700 1 -- 172.21.15.154:0/3751199784 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c011630 con 0x7f2f4c156310 2023-10-10T21:20:22.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.530+0000 7f2f49d9b700 1 -- 172.21.15.154:0/3751199784 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c011790 con 0x7f2f4c156310 2023-10-10T21:20:22.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.530+0000 7f2f49d9b700 1 -- 172.21.15.154:0/3751199784 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c011b30 con 0x7f2f4c156310 2023-10-10T21:20:22.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.531+0000 7f2f4b59e700 1 -- 172.21.15.154:0/3751199784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f4c156310 msgr2=0x7f2f4c0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.531+0000 7f2f4b59e700 1 --2- 172.21.15.154:0/3751199784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f4c156310 0x7f2f4c0c9dc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0098e0 tx=0x7f2f3c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.531+0000 7f2f4b59e700 1 -- 172.21.15.154:0/3751199784 shutdown_connections 2023-10-10T21:20:22.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.531+0000 7f2f4b59e700 1 --2- 172.21.15.154:0/3751199784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 0x7f2f4c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.531+0000 7f2f4b59e700 1 --2- 172.21.15.154:0/3751199784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f4c156310 0x7f2f4c0c9dc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.531+0000 7f2f4b59e700 1 -- 172.21.15.154:0/3751199784 >> 172.21.15.154:0/3751199784 conn(0x7f2f4c0cc1f0 msgr2=0x7f2f4c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:22.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.531+0000 7f2f4b59e700 1 -- 172.21.15.154:0/3751199784 shutdown_connections 2023-10-10T21:20:22.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.531+0000 7f2f4b59e700 1 -- 172.21.15.154:0/3751199784 wait complete. 2023-10-10T21:20:22.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.532+0000 7f2f4b59e700 1 Processor -- start 2023-10-10T21:20:22.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.532+0000 7f2f4b59e700 1 -- start start 2023-10-10T21:20:22.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.533+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 0x7f2f4c146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.533+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f4c156310 0x7f2f4c0c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.533+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f4c1566e0 0x7f2f4c0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.533+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0c8470 con 0x7f2f4c156310 2023-10-10T21:20:22.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.533+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0c3460 con 0x7f2f4c1566e0 2023-10-10T21:20:22.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.533+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0c7bd0 con 0x7f2f4c0ae710 2023-10-10T21:20:22.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f41d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f4c156310 0x7f2f4c0c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f41d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f4c156310 0x7f2f4c0c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38034/0 (socket says 172.21.15.154:38034) 2023-10-10T21:20:22.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f41d9b700 1 -- 172.21.15.154:0/301599234 learned_addr learned my addr 172.21.15.154:0/301599234 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:22.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f4a59c700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 0x7f2f4c146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f4ad9d700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f4c1566e0 0x7f2f4c0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f41d9b700 1 -- 172.21.15.154:0/301599234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 msgr2=0x7f2f4c146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f41d9b700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 0x7f2f4c146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f41d9b700 1 -- 172.21.15.154:0/301599234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f4c1566e0 msgr2=0x7f2f4c0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f41d9b700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f4c1566e0 0x7f2f4c0c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f41d9b700 1 -- 172.21.15.154:0/301599234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44009a20 con 0x7f2f4c156310 2023-10-10T21:20:22.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f41d9b700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f4c156310 0x7f2f4c0c70a0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c590 tx=0x7f2f34007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:22.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f42ffd700 1 -- 172.21.15.154:0/301599234 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34004be0 con 0x7f2f4c156310 2023-10-10T21:20:22.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f42ffd700 1 -- 172.21.15.154:0/301599234 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f34004d40 con 0x7f2f4c156310 2023-10-10T21:20:22.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c009420 con 0x7f2f4c156310 2023-10-10T21:20:22.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.534+0000 7f2f42ffd700 1 -- 172.21.15.154:0/301599234 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340073a0 con 0x7f2f4c156310 2023-10-10T21:20:22.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.535+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c0c8190 con 0x7f2f4c156310 2023-10-10T21:20:22.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.535+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c0c3610 con 0x7f2f4c156310 2023-10-10T21:20:22.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.536+0000 7f2f42ffd700 1 -- 172.21.15.154:0/301599234 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f34014420 con 0x7f2f4c156310 2023-10-10T21:20:22.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.537+0000 7f2f42ffd700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2f2c066f30 0x7f2f2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.537+0000 7f2f42ffd700 1 -- 172.21.15.154:0/301599234 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f2f340841c0 con 0x7f2f4c156310 2023-10-10T21:20:22.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.537+0000 7f2f4a59c700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2f2c066f30 0x7f2f2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.538+0000 7f2f4a59c700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2f2c066f30 0x7f2f2c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0091e0 tx=0x7f2f3c017000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:22.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.541+0000 7f2f42ffd700 1 -- 172.21.15.154:0/301599234 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f4c0c3610 con 0x7f2f4c156310 2023-10-10T21:20:22.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.733+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f4c0c35d0 con 0x7f2f4c156310 2023-10-10T21:20:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.734+0000 7f2f42ffd700 1 -- 172.21.15.154:0/301599234 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+12787 (secure 0 0 0) 0x7f2f34051620 con 0x7f2f4c156310 2023-10-10T21:20:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:22.736 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":120,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:20:21.820486+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:20:22.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.736+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2f2c066f30 msgr2=0x7f2f2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.736+0000 7f2f4b59e700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2f2c066f30 0x7f2f2c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0091e0 tx=0x7f2f3c017000 comp rx=0 tx=0).stop 2023-10-10T21:20:22.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f4c156310 msgr2=0x7f2f4c0c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f4c156310 0x7f2f4c0c70a0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c590 tx=0x7f2f34007dc0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 shutdown_connections 2023-10-10T21:20:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f4c1566e0 0x7f2f4c0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2f2c066f30 0x7f2f2c0693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f4c0ae710 0x7f2f4c146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 --2- 172.21.15.154:0/301599234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f4c156310 0x7f2f4c0c70a0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 >> 172.21.15.154:0/301599234 conn(0x7f2f4c0cc1f0 msgr2=0x7f2f4c0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:22.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 shutdown_connections 2023-10-10T21:20:22.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.737+0000 7f2f4b59e700 1 -- 172.21.15.154:0/301599234 wait complete. 2023-10-10T21:20:22.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T21:20:22.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:20:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.943+0000 7fc523fff700 1 Processor -- start 2023-10-10T21:20:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.943+0000 7fc523fff700 1 -- start start 2023-10-10T21:20:22.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.944+0000 7fc523fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5240b4e70 0x7fc5240ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.944+0000 7fc523fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b16d0 0x7fc5240b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.944+0000 7fc523fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc52415d240 0x7fc52415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.944+0000 7fc523fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5240b2080 con 0x7fc5240b4e70 2023-10-10T21:20:22.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.944+0000 7fc523fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5240cfb00 con 0x7fc52415d240 2023-10-10T21:20:22.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.944+0000 7fc523fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240b5c40 con 0x7fc5240b16d0 2023-10-10T21:20:22.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.944+0000 7fc522ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5240b4e70 0x7fc5240ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.944+0000 7fc522ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5240b4e70 0x7fc5240ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38036/0 (socket says 172.21.15.154:38036) 2023-10-10T21:20:22.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.944+0000 7fc522ffd700 1 -- 172.21.15.154:0/946485498 learned_addr learned my addr 172.21.15.154:0/946485498 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:22.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc5227fc700 1 --2- 172.21.15.154:0/946485498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b16d0 0x7fc5240b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc5237fe700 1 --2- 172.21.15.154:0/946485498 >> v2:172.21.15.179:3300/0 conn(0x7fc52415d240 0x7fc52415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc522ffd700 1 -- 172.21.15.154:0/946485498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b16d0 msgr2=0x7fc5240b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc522ffd700 1 --2- 172.21.15.154:0/946485498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b16d0 0x7fc5240b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc522ffd700 1 -- 172.21.15.154:0/946485498 >> v2:172.21.15.179:3300/0 conn(0x7fc52415d240 msgr2=0x7fc52415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:22.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc522ffd700 1 --2- 172.21.15.154:0/946485498 >> v2:172.21.15.179:3300/0 conn(0x7fc52415d240 0x7fc52415d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc522ffd700 1 -- 172.21.15.154:0/946485498 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240b5f20 con 0x7fc5240b4e70 2023-10-10T21:20:22.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc522ffd700 1 --2- 172.21.15.154:0/946485498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240b4e70 0x7fc5240ccff0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc52415d180 tx=0x7fc514009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3244eb18cc3a7717 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:22.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc521ffb700 1 -- 172.21.15.154:0/946485498 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400b860 con 0x7fc5240b4e70 2023-10-10T21:20:22.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc521ffb700 1 -- 172.21.15.154:0/946485498 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51400b9c0 con 0x7fc5240b4e70 2023-10-10T21:20:22.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.945+0000 7fc521ffb700 1 -- 172.21.15.154:0/946485498 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400bd60 con 0x7fc5240b4e70 2023-10-10T21:20:22.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.946+0000 7fc523fff700 1 -- 172.21.15.154:0/946485498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240b4e70 msgr2=0x7fc5240ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.946+0000 7fc523fff700 1 --2- 172.21.15.154:0/946485498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240b4e70 0x7fc5240ccff0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc52415d180 tx=0x7fc514009250 comp rx=0 tx=0).stop 2023-10-10T21:20:22.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.946+0000 7fc523fff700 1 -- 172.21.15.154:0/946485498 shutdown_connections 2023-10-10T21:20:22.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.946+0000 7fc523fff700 1 --2- 172.21.15.154:0/946485498 >> v2:172.21.15.179:3300/0 conn(0x7fc52415d240 0x7fc52415d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.946+0000 7fc523fff700 1 --2- 172.21.15.154:0/946485498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240b4e70 0x7fc5240ccff0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.946+0000 7fc523fff700 1 --2- 172.21.15.154:0/946485498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b16d0 0x7fc5240b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.946+0000 7fc523fff700 1 -- 172.21.15.154:0/946485498 >> 172.21.15.154:0/946485498 conn(0x7fc5240d10c0 msgr2=0x7fc5240affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.946+0000 7fc523fff700 1 -- 172.21.15.154:0/946485498 shutdown_connections 2023-10-10T21:20:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.946+0000 7fc523fff700 1 -- 172.21.15.154:0/946485498 wait complete. 2023-10-10T21:20:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.947+0000 7fc523fff700 1 Processor -- start 2023-10-10T21:20:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.948+0000 7fc523fff700 1 -- start start 2023-10-10T21:20:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.948+0000 7fc523fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5240b16d0 0x7fc524156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.948+0000 7fc523fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b4e70 0x7fc52415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc523fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52415d240 0x7fc52416d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc523fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52415db60 con 0x7fc52415d240 2023-10-10T21:20:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc523fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52416e320 con 0x7fc5240b16d0 2023-10-10T21:20:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc523fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc524157260 con 0x7fc5240b4e70 2023-10-10T21:20:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5237fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52415d240 0x7fc52416d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5237fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52415d240 0x7fc52416d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38048/0 (socket says 172.21.15.154:38048) 2023-10-10T21:20:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5237fe700 1 -- 172.21.15.154:0/1961965021 learned_addr learned my addr 172.21.15.154:0/1961965021 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc522ffd700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5240b16d0 0x7fc524156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5227fc700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b4e70 0x7fc52415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5237fe700 1 -- 172.21.15.154:0/1961965021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b4e70 msgr2=0x7fc52415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5237fe700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b4e70 0x7fc52415dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5237fe700 1 -- 172.21.15.154:0/1961965021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5240b16d0 msgr2=0x7fc524156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:22.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5237fe700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5240b16d0 0x7fc524156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:22.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5237fe700 1 -- 172.21.15.154:0/1961965021 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140094f0 con 0x7fc52415d240 2023-10-10T21:20:22.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.949+0000 7fc5237fe700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52415d240 0x7fc52416d480 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009fa0 tx=0x7fc51c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:22.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.950+0000 7fc50affd700 1 -- 172.21.15.154:0/1961965021 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00ed20 con 0x7fc52415d240 2023-10-10T21:20:22.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.950+0000 7fc50affd700 1 -- 172.21.15.154:0/1961965021 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c00ee80 con 0x7fc52415d240 2023-10-10T21:20:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.950+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52416dd60 con 0x7fc52415d240 2023-10-10T21:20:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.950+0000 7fc50affd700 1 -- 172.21.15.154:0/1961965021 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c014670 con 0x7fc52415d240 2023-10-10T21:20:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.950+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52415d7f0 con 0x7fc52415d240 2023-10-10T21:20:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.951+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52415dd10 con 0x7fc52415d240 2023-10-10T21:20:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.952+0000 7fc50affd700 1 -- 172.21.15.154:0/1961965021 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc51c0149e0 con 0x7fc52415d240 2023-10-10T21:20:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.953+0000 7fc50affd700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc510066f30 0x7fc5100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.953+0000 7fc50affd700 1 -- 172.21.15.154:0/1961965021 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fc51c084b00 con 0x7fc52415d240 2023-10-10T21:20:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.953+0000 7fc522ffd700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc510066f30 0x7fc5100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.953+0000 7fc522ffd700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc510066f30 0x7fc5100693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc52415d180 tx=0x7fc514017000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:22.957+0000 7fc50affd700 1 -- 172.21.15.154:0/1961965021 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc52415dd10 con 0x7fc52415d240 2023-10-10T21:20:23.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.146+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc52415dd10 con 0x7fc52415d240 2023-10-10T21:20:23.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.146+0000 7fc50affd700 1 -- 172.21.15.154:0/1961965021 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc52415dd10 con 0x7fc52415d240 2023-10-10T21:20:23.148 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:20:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc510066f30 msgr2=0x7fc5100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc510066f30 0x7fc5100693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc52415d180 tx=0x7fc514017000 comp rx=0 tx=0).stop 2023-10-10T21:20:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52415d240 msgr2=0x7fc52416d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52415d240 0x7fc52416d480 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009fa0 tx=0x7fc51c009900 comp rx=0 tx=0).stop 2023-10-10T21:20:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 shutdown_connections 2023-10-10T21:20:23.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52415d240 0x7fc52416d480 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5240b16d0 0x7fc524156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fc510066f30 0x7fc5100693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 --2- 172.21.15.154:0/1961965021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5240b4e70 0x7fc52415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 >> 172.21.15.154:0/1961965021 conn(0x7fc5240d10c0 msgr2=0x7fc5240692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:23.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 shutdown_connections 2023-10-10T21:20:23.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.149+0000 7fc523fff700 1 -- 172.21.15.154:0/1961965021 wait complete. 2023-10-10T21:20:23.168 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T21:20:23.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.349+0000 7f7c9e7ff700 1 Processor -- start 2023-10-10T21:20:23.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.349+0000 7f7c9e7ff700 1 -- start start 2023-10-10T21:20:23.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.350+0000 7f7c9e7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c980cbf30 0x7f7c980ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.350+0000 7f7c9e7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c980ccf90 0x7f7c980b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.350+0000 7f7c9e7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c980cc300 con 0x7f7c9815a270 2023-10-10T21:20:23.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.350+0000 7f7c9e7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c98156bf0 con 0x7f7c980cbf30 2023-10-10T21:20:23.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.350+0000 7f7c9e7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980ae950 con 0x7f7c980ccf90 2023-10-10T21:20:23.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c97fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c980cbf30 0x7f7c980ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:23.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c97fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c980cbf30 0x7f7c980ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38050/0 (socket says 172.21.15.154:38050) 2023-10-10T21:20:23.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c97fff700 1 -- 172.21.15.154:0/702165089 learned_addr learned my addr 172.21.15.154:0/702165089 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:23.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c97fff700 1 -- 172.21.15.154:0/702165089 >> v2:172.21.15.179:3300/0 conn(0x7f7c980ccf90 msgr2=0x7f7c980b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:23.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c97fff700 1 --2- 172.21.15.154:0/702165089 >> v2:172.21.15.179:3300/0 conn(0x7f7c980ccf90 0x7f7c980b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c97fff700 1 -- 172.21.15.154:0/702165089 >> v1:172.21.15.179:6789/0 conn(0x7f7c9815a270 legacy=0x7f7c980c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:23.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c97fff700 1 -- 172.21.15.154:0/702165089 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980ad370 con 0x7f7c980cbf30 2023-10-10T21:20:23.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c97fff700 1 --2- 172.21.15.154:0/702165089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 0x7f7c980ae410 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7c9806d670 tx=0x7f7c88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533c5b3df22475e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:23.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c96ffd700 1 -- 172.21.15.154:0/702165089 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800b7e0 con 0x7f7c980cbf30 2023-10-10T21:20:23.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c96ffd700 1 -- 172.21.15.154:0/702165089 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8800b940 con 0x7f7c980cbf30 2023-10-10T21:20:23.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.351+0000 7f7c96ffd700 1 -- 172.21.15.154:0/702165089 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800bce0 con 0x7f7c980cbf30 2023-10-10T21:20:23.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.352+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/702165089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 msgr2=0x7f7c980ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.352+0000 7f7c9e7ff700 1 --2- 172.21.15.154:0/702165089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 0x7f7c980ae410 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7c9806d670 tx=0x7f7c88009250 comp rx=0 tx=0).stop 2023-10-10T21:20:23.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.352+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/702165089 shutdown_connections 2023-10-10T21:20:23.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.352+0000 7f7c9e7ff700 1 --2- 172.21.15.154:0/702165089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 0x7f7c980ae410 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.352+0000 7f7c9e7ff700 1 --2- 172.21.15.154:0/702165089 >> v2:172.21.15.179:3300/0 conn(0x7f7c980ccf90 0x7f7c980b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.352+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/702165089 >> 172.21.15.154:0/702165089 conn(0x7f7c9806a320 msgr2=0x7f7c980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:23.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.352+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/702165089 shutdown_connections 2023-10-10T21:20:23.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.352+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/702165089 wait complete. 2023-10-10T21:20:23.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.353+0000 7f7c9e7ff700 1 Processor -- start 2023-10-10T21:20:23.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.354+0000 7f7c9e7ff700 1 -- start start 2023-10-10T21:20:23.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.354+0000 7f7c9e7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 0x7f7c980c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.354+0000 7f7c9e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c980ccf90 0x7f7c980c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.354+0000 7f7c9e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c9815a270 0x7f7c980a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c9e7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980aa790 con 0x7f7c980cbf30 2023-10-10T21:20:23.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c9e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980aaa70 con 0x7f7c9815a270 2023-10-10T21:20:23.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c9e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980aad50 con 0x7f7c980ccf90 2023-10-10T21:20:23.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c97fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 0x7f7c980c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:23.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c97fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 0x7f7c980c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38052/0 (socket says 172.21.15.154:38052) 2023-10-10T21:20:23.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c97fff700 1 -- 172.21.15.154:0/3810317278 learned_addr learned my addr 172.21.15.154:0/3810317278 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:23.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c97fff700 1 -- 172.21.15.154:0/3810317278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c980ccf90 msgr2=0x7f7c980c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c97fff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c980ccf90 0x7f7c980c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c97fff700 1 -- 172.21.15.154:0/3810317278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c9815a270 msgr2=0x7f7c980a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c97fff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c9815a270 0x7f7c980a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c97fff700 1 -- 172.21.15.154:0/3810317278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c880094f0 con 0x7f7c980cbf30 2023-10-10T21:20:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c97fff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 0x7f7c980c89b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7c880090b0 tx=0x7f7c88016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.355+0000 7f7c7ffff700 1 -- 172.21.15.154:0/3810317278 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88011ea0 con 0x7f7c980cbf30 2023-10-10T21:20:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.356+0000 7f7c7ffff700 1 -- 172.21.15.154:0/3810317278 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8801f070 con 0x7f7c980cbf30 2023-10-10T21:20:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.356+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c980ab030 con 0x7f7c980cbf30 2023-10-10T21:20:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.356+0000 7f7c7ffff700 1 -- 172.21.15.154:0/3810317278 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8801a8c0 con 0x7f7c980cbf30 2023-10-10T21:20:23.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.356+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c980aa480 con 0x7f7c980cbf30 2023-10-10T21:20:23.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.357+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c980ab550 con 0x7f7c980cbf30 2023-10-10T21:20:23.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.358+0000 7f7c7ffff700 1 -- 172.21.15.154:0/3810317278 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c8801ac70 con 0x7f7c980cbf30 2023-10-10T21:20:23.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.358+0000 7f7c7ffff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c84066f30 0x7f7c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.358+0000 7f7c7ffff700 1 -- 172.21.15.154:0/3810317278 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f7c88021070 con 0x7f7c980cbf30 2023-10-10T21:20:23.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.359+0000 7f7c977fe700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c84066f30 0x7f7c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:23.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.359+0000 7f7c977fe700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c84066f30 0x7f7c840693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c006fd0 tx=0x7f7c8c006db0 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:23.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.363+0000 7f7c7ffff700 1 -- 172.21.15.154:0/3810317278 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c980ab550 con 0x7f7c980cbf30 2023-10-10T21:20:23.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.557+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7c980ab550 con 0x7f7c980cbf30 2023-10-10T21:20:23.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.558+0000 7f7c7ffff700 1 -- 172.21.15.154:0/3810317278 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v120) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7c980ab550 con 0x7f7c980cbf30 2023-10-10T21:20:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:23.559 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:20:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T21:20:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T21:20:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:23.560 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:20:23.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c84066f30 msgr2=0x7f7c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c84066f30 0x7f7c840693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c006fd0 tx=0x7f7c8c006db0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 msgr2=0x7f7c980c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 0x7f7c980c89b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7c880090b0 tx=0x7f7c88016000 comp rx=0 tx=0).stop 2023-10-10T21:20:23.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 shutdown_connections 2023-10-10T21:20:23.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c9815a270 0x7f7c980a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c980cbf30 0x7f7c980c89b0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7c84066f30 0x7f7c840693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 --2- 172.21.15.154:0/3810317278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c980ccf90 0x7f7c980c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 >> 172.21.15.154:0/3810317278 conn(0x7f7c9806a320 msgr2=0x7f7c980cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:23.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 shutdown_connections 2023-10-10T21:20:23.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.560+0000 7f7c9e7ff700 1 -- 172.21.15.154:0/3810317278 wait complete. 2023-10-10T21:20:23.579 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T21:20:23.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T21:20:23.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.765+0000 7f7825f9d700 1 Processor -- start 2023-10-10T21:20:23.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.765+0000 7f7825f9d700 1 -- start start 2023-10-10T21:20:23.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.766+0000 7f7825f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f782015b050 0x7f78200ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.766+0000 7f7825f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f78200cc8d0 0x7f782015b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.766+0000 7f7825f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7820157a50 con 0x7f782015b960 2023-10-10T21:20:23.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.766+0000 7f7825f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78201591b0 con 0x7f782015b050 2023-10-10T21:20:23.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.766+0000 7f7825f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78200ca9e0 con 0x7f78200cc8d0 2023-10-10T21:20:23.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.766+0000 7f7824f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f782015b050 0x7f78200ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:23.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.766+0000 7f7824f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f782015b050 0x7f78200ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38060/0 (socket says 172.21.15.154:38060) 2023-10-10T21:20:23.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.766+0000 7f7824f9b700 1 -- 172.21.15.154:0/1266133983 learned_addr learned my addr 172.21.15.154:0/1266133983 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:23.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f781ffff700 1 --2- 172.21.15.154:0/1266133983 >> v2:172.21.15.179:3300/0 conn(0x7f78200cc8d0 0x7f782015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:23.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f7824f9b700 1 -- 172.21.15.154:0/1266133983 >> v2:172.21.15.179:3300/0 conn(0x7f78200cc8d0 msgr2=0x7f782015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:23.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f7824f9b700 1 --2- 172.21.15.154:0/1266133983 >> v2:172.21.15.179:3300/0 conn(0x7f78200cc8d0 0x7f782015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f7824f9b700 1 -- 172.21.15.154:0/1266133983 >> v1:172.21.15.179:6789/0 conn(0x7f782015b960 legacy=0x7f7820157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:23.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f7824f9b700 1 -- 172.21.15.154:0/1266133983 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200cacc0 con 0x7f782015b050 2023-10-10T21:20:23.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f781ffff700 1 --2- 172.21.15.154:0/1266133983 >> v2:172.21.15.179:3300/0 conn(0x7f78200cc8d0 0x7f782015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:23.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f7824f9b700 1 --2- 172.21.15.154:0/1266133983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 0x7f78200ca100 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f782006fdd0 tx=0x7f7814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fca03219039e65 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:23.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f781f7fe700 1 -- 172.21.15.154:0/1266133983 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400b820 con 0x7f782015b050 2023-10-10T21:20:23.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f781f7fe700 1 -- 172.21.15.154:0/1266133983 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400b980 con 0x7f782015b050 2023-10-10T21:20:23.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.767+0000 7f781f7fe700 1 -- 172.21.15.154:0/1266133983 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400bd20 con 0x7f782015b050 2023-10-10T21:20:23.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.768+0000 7f7825f9d700 1 -- 172.21.15.154:0/1266133983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 msgr2=0x7f78200ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.768+0000 7f7825f9d700 1 --2- 172.21.15.154:0/1266133983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 0x7f78200ca100 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f782006fdd0 tx=0x7f7814009250 comp rx=0 tx=0).stop 2023-10-10T21:20:23.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.768+0000 7f7825f9d700 1 -- 172.21.15.154:0/1266133983 shutdown_connections 2023-10-10T21:20:23.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.768+0000 7f7825f9d700 1 --2- 172.21.15.154:0/1266133983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 0x7f78200ca100 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.768+0000 7f7825f9d700 1 --2- 172.21.15.154:0/1266133983 >> v2:172.21.15.179:3300/0 conn(0x7f78200cc8d0 0x7f782015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.768+0000 7f7825f9d700 1 -- 172.21.15.154:0/1266133983 >> 172.21.15.154:0/1266133983 conn(0x7f7820068e20 msgr2=0x7f78200cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:23.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.768+0000 7f7825f9d700 1 -- 172.21.15.154:0/1266133983 shutdown_connections 2023-10-10T21:20:23.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.768+0000 7f7825f9d700 1 -- 172.21.15.154:0/1266133983 wait complete. 2023-10-10T21:20:23.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.769+0000 7f7825f9d700 1 Processor -- start 2023-10-10T21:20:23.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.770+0000 7f7825f9d700 1 -- start start 2023-10-10T21:20:23.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.770+0000 7f7825f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78200cc8d0 0x7f78200a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.770+0000 7f7825f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 0x7f782014ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.770+0000 7f7825f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f782015b960 0x7f78200a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.770+0000 7f7825f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78200a8690 con 0x7f782015b050 2023-10-10T21:20:23.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.770+0000 7f7825f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78200a6820 con 0x7f78200cc8d0 2023-10-10T21:20:23.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.770+0000 7f7825f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782016ab30 con 0x7f782015b960 2023-10-10T21:20:23.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f781ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 0x7f782014ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:23.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f781ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 0x7f782014ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38076/0 (socket says 172.21.15.154:38076) 2023-10-10T21:20:23.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f781ffff700 1 -- 172.21.15.154:0/3983876762 learned_addr learned my addr 172.21.15.154:0/3983876762 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:23.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f7824f9b700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78200cc8d0 0x7f78200a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f782579c700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f782015b960 0x7f78200a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f781ffff700 1 -- 172.21.15.154:0/3983876762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f782015b960 msgr2=0x7f78200a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f781ffff700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f782015b960 0x7f78200a6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f781ffff700 1 -- 172.21.15.154:0/3983876762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78200cc8d0 msgr2=0x7f78200a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f781ffff700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78200cc8d0 0x7f78200a62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f781ffff700 1 -- 172.21.15.154:0/3983876762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78140094f0 con 0x7f782015b050 2023-10-10T21:20:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.771+0000 7f781ffff700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 0x7f782014ac60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f780c00c880 tx=0x7f780c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.772+0000 7f781cff9700 1 -- 172.21.15.154:0/3983876762 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c011600 con 0x7f782015b050 2023-10-10T21:20:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.772+0000 7f781cff9700 1 -- 172.21.15.154:0/3983876762 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c011760 con 0x7f782015b050 2023-10-10T21:20:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.772+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78200a5e50 con 0x7f782015b050 2023-10-10T21:20:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.772+0000 7f781cff9700 1 -- 172.21.15.154:0/3983876762 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c011b00 con 0x7f782015b050 2023-10-10T21:20:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.772+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78200a5ae0 con 0x7f782015b050 2023-10-10T21:20:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.773+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78200a5fe0 con 0x7f782015b050 2023-10-10T21:20:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.774+0000 7f781cff9700 1 -- 172.21.15.154:0/3983876762 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f780c018350 con 0x7f782015b050 2023-10-10T21:20:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.775+0000 7f781cff9700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7804066f30 0x7f78040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.775+0000 7f781cff9700 1 -- 172.21.15.154:0/3983876762 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f780c0841c0 con 0x7f782015b050 2023-10-10T21:20:23.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.775+0000 7f7824f9b700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7804066f30 0x7f78040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:23.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.775+0000 7f7824f9b700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7804066f30 0x7f78040693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f782006fdd0 tx=0x7f7814016000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:23.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.779+0000 7f781cff9700 1 -- 172.21.15.154:0/3983876762 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f780c051560 con 0x7f782015b050 2023-10-10T21:20:23.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:23.973+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f782004c3c0 con 0x7f782015b050 2023-10-10T21:20:24.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.827+0000 7f781cff9700 1 -- 172.21.15.154:0/3983876762 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v121) v1 ==== 138+0+0 (secure 0 0 0) 0x7f780c054b80 con 0x7f782015b050 2023-10-10T21:20:24.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.832+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7804066f30 msgr2=0x7f78040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:24.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.832+0000 7f7825f9d700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7804066f30 0x7f78040693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f782006fdd0 tx=0x7f7814016000 comp rx=0 tx=0).stop 2023-10-10T21:20:24.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.832+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 msgr2=0x7f782014ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:24.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.832+0000 7f7825f9d700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 0x7f782014ac60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f780c00c880 tx=0x7f780c008040 comp rx=0 tx=0).stop 2023-10-10T21:20:24.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.833+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 shutdown_connections 2023-10-10T21:20:24.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.833+0000 7f7825f9d700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f7804066f30 0x7f78040693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:24.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.833+0000 7f7825f9d700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f782015b960 0x7f78200a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:24.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.833+0000 7f7825f9d700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78200cc8d0 0x7f78200a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:24.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.834+0000 7f7825f9d700 1 --2- 172.21.15.154:0/3983876762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015b050 0x7f782014ac60 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:24.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.834+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 >> 172.21.15.154:0/3983876762 conn(0x7f7820068e20 msgr2=0x7f7820154760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:24.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.834+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 shutdown_connections 2023-10-10T21:20:24.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:24.834+0000 7f7825f9d700 1 -- 172.21.15.154:0/3983876762 wait complete. 2023-10-10T21:20:24.839 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T21:20:24.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T21:20:25.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.050+0000 7f02b93ff700 1 Processor -- start 2023-10-10T21:20:25.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.050+0000 7f02b93ff700 1 -- start start 2023-10-10T21:20:25.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.051+0000 7f02b93ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02b4159950 0x7f02b40cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:25.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.051+0000 7f02b93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b40af320 0x7f02b4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:25.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.051+0000 7f02b93ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02b4069aa0 0x7f02b415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:25.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.051+0000 7f02b93ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b4069f20 con 0x7f02b4159950 2023-10-10T21:20:25.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.051+0000 7f02b93ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b40ce380 con 0x7f02b4069aa0 2023-10-10T21:20:25.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.051+0000 7f02b93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40cec20 con 0x7f02b40af320 2023-10-10T21:20:25.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.051+0000 7f02b2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02b4159950 0x7f02b40cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:25.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.051+0000 7f02b2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02b4159950 0x7f02b40cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38090/0 (socket says 172.21.15.154:38090) 2023-10-10T21:20:25.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.051+0000 7f02b2ffd700 1 -- 172.21.15.154:0/1496430548 learned_addr learned my addr 172.21.15.154:0/1496430548 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:25.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b27fc700 1 --2- 172.21.15.154:0/1496430548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b40af320 0x7f02b4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:25.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b37fe700 1 --2- 172.21.15.154:0/1496430548 >> v2:172.21.15.179:3300/0 conn(0x7f02b4069aa0 0x7f02b415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:25.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b2ffd700 1 -- 172.21.15.154:0/1496430548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b40af320 msgr2=0x7f02b4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:25.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b2ffd700 1 --2- 172.21.15.154:0/1496430548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b40af320 0x7f02b4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b2ffd700 1 -- 172.21.15.154:0/1496430548 >> v2:172.21.15.179:3300/0 conn(0x7f02b4069aa0 msgr2=0x7f02b415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:25.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b2ffd700 1 --2- 172.21.15.154:0/1496430548 >> v2:172.21.15.179:3300/0 conn(0x7f02b4069aa0 0x7f02b415d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b2ffd700 1 -- 172.21.15.154:0/1496430548 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b40afa90 con 0x7f02b4159950 2023-10-10T21:20:25.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b27fc700 1 --2- 172.21.15.154:0/1496430548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b40af320 0x7f02b4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:25.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b2ffd700 1 --2- 172.21.15.154:0/1496430548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b4159950 0x7f02b40cbb90 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f02b40d0760 tx=0x7f02a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd788e9c15dc14a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:25.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b1ffb700 1 -- 172.21.15.154:0/1496430548 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400b860 con 0x7f02b4159950 2023-10-10T21:20:25.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b1ffb700 1 -- 172.21.15.154:0/1496430548 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a400b9c0 con 0x7f02b4159950 2023-10-10T21:20:25.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.052+0000 7f02b1ffb700 1 -- 172.21.15.154:0/1496430548 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400bd60 con 0x7f02b4159950 2023-10-10T21:20:25.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.053+0000 7f02b93ff700 1 -- 172.21.15.154:0/1496430548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b4159950 msgr2=0x7f02b40cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:25.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.053+0000 7f02b93ff700 1 --2- 172.21.15.154:0/1496430548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b4159950 0x7f02b40cbb90 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f02b40d0760 tx=0x7f02a4009250 comp rx=0 tx=0).stop 2023-10-10T21:20:25.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.053+0000 7f02b93ff700 1 -- 172.21.15.154:0/1496430548 shutdown_connections 2023-10-10T21:20:25.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.053+0000 7f02b93ff700 1 --2- 172.21.15.154:0/1496430548 >> v2:172.21.15.179:3300/0 conn(0x7f02b4069aa0 0x7f02b415d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.053+0000 7f02b93ff700 1 --2- 172.21.15.154:0/1496430548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b4159950 0x7f02b40cbb90 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.053+0000 7f02b93ff700 1 --2- 172.21.15.154:0/1496430548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b40af320 0x7f02b4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.053+0000 7f02b93ff700 1 -- 172.21.15.154:0/1496430548 >> 172.21.15.154:0/1496430548 conn(0x7f02b4068e00 msgr2=0x7f02b40d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:25.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.053+0000 7f02b93ff700 1 -- 172.21.15.154:0/1496430548 shutdown_connections 2023-10-10T21:20:25.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.053+0000 7f02b93ff700 1 -- 172.21.15.154:0/1496430548 wait complete. 2023-10-10T21:20:25.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.054+0000 7f02b93ff700 1 Processor -- start 2023-10-10T21:20:25.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.055+0000 7f02b93ff700 1 -- start start 2023-10-10T21:20:25.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.055+0000 7f02b93ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b4069aa0 0x7f02b415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:25.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.055+0000 7f02b93ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40af320 0x7f02b40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:25.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.055+0000 7f02b93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b4159950 0x7f02b415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:25.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b93ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40ca210 con 0x7f02b40af320 2023-10-10T21:20:25.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b93ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40b3fb0 con 0x7f02b4069aa0 2023-10-10T21:20:25.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40b3680 con 0x7f02b4159950 2023-10-10T21:20:25.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40af320 0x7f02b40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:25.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40af320 0x7f02b40c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38102/0 (socket says 172.21.15.154:38102) 2023-10-10T21:20:25.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b27fc700 1 -- 172.21.15.154:0/97989537 learned_addr learned my addr 172.21.15.154:0/97989537 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:25.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b37fe700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b4159950 0x7f02b415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:25.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b2ffd700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b4069aa0 0x7f02b415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:25.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b27fc700 1 -- 172.21.15.154:0/97989537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b4159950 msgr2=0x7f02b415e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:25.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b27fc700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b4159950 0x7f02b415e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b27fc700 1 -- 172.21.15.154:0/97989537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b4069aa0 msgr2=0x7f02b415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:25.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b27fc700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b4069aa0 0x7f02b415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b27fc700 1 -- 172.21.15.154:0/97989537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40094f0 con 0x7f02b40af320 2023-10-10T21:20:25.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b2ffd700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b4069aa0 0x7f02b415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:25.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.056+0000 7f02b27fc700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40af320 0x7f02b40c98f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e900 tx=0x7f02a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:25.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.057+0000 7f029affd700 1 -- 172.21.15.154:0/97989537 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800eea0 con 0x7f02b40af320 2023-10-10T21:20:25.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.057+0000 7f029affd700 1 -- 172.21.15.154:0/97989537 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800c5e0 con 0x7f02b40af320 2023-10-10T21:20:25.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.057+0000 7f029affd700 1 -- 172.21.15.154:0/97989537 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800c980 con 0x7f02b40af320 2023-10-10T21:20:25.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.057+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b40b3960 con 0x7f02b40af320 2023-10-10T21:20:25.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.057+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b415c6f0 con 0x7f02b40af320 2023-10-10T21:20:25.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.058+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b40718b0 con 0x7f02b40af320 2023-10-10T21:20:25.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.059+0000 7f029affd700 1 -- 172.21.15.154:0/97989537 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02a800cd30 con 0x7f02b40af320 2023-10-10T21:20:25.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.060+0000 7f029affd700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f02a0066f30 0x7f02a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:25.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.060+0000 7f029affd700 1 -- 172.21.15.154:0/97989537 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f02a80847b0 con 0x7f02b40af320 2023-10-10T21:20:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.061+0000 7f02b2ffd700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f02a0066f30 0x7f02a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.061+0000 7f02b2ffd700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f02a0066f30 0x7f02a00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02b40d0760 tx=0x7f02a4017000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:25.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.064+0000 7f029affd700 1 -- 172.21.15.154:0/97989537 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02a8055470 con 0x7f02b40af320 2023-10-10T21:20:25.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.256+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f02b40ce5d0 con 0x7f02b40af320 2023-10-10T21:20:25.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.832+0000 7f029affd700 1 -- 172.21.15.154:0/97989537 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v122) v1 ==== 170+0+0 (secure 0 0 0) 0x7f02a80200d0 con 0x7f02b40af320 2023-10-10T21:20:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.838+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f02a0066f30 msgr2=0x7f02a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.838+0000 7f02b93ff700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f02a0066f30 0x7f02a00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02b40d0760 tx=0x7f02a4017000 comp rx=0 tx=0).stop 2023-10-10T21:20:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.838+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40af320 msgr2=0x7f02b40c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.838+0000 7f02b93ff700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40af320 0x7f02b40c98f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e900 tx=0x7f02a8008040 comp rx=0 tx=0).stop 2023-10-10T21:20:25.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.844+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 shutdown_connections 2023-10-10T21:20:25.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.844+0000 7f02b93ff700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f02a0066f30 0x7f02a00693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.844+0000 7f02b93ff700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02b4159950 0x7f02b415e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.844+0000 7f02b93ff700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02b4069aa0 0x7f02b415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.844+0000 7f02b93ff700 1 --2- 172.21.15.154:0/97989537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40af320 0x7f02b40c98f0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.844+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 >> 172.21.15.154:0/97989537 conn(0x7f02b4068e00 msgr2=0x7f02b4155470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.846+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 shutdown_connections 2023-10-10T21:20:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:25.847+0000 7f02b93ff700 1 -- 172.21.15.154:0/97989537 wait complete. 2023-10-10T21:20:25.854 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T21:20:25.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T21:20:26.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.058+0000 7f5309bff700 1 Processor -- start 2023-10-10T21:20:26.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.058+0000 7f5309bff700 1 -- start start 2023-10-10T21:20:26.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.059+0000 7f5309bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5304155eb0 0x7f530406e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:26.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.059+0000 7f5309bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 0x7f53040ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:26.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.059+0000 7f5309bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530406eb90 con 0x7f53040c70b0 2023-10-10T21:20:26.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.059+0000 7f5309bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530406ee70 con 0x7f5304155eb0 2023-10-10T21:20:26.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.059+0000 7f5309bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530406f150 con 0x7f5304069e80 2023-10-10T21:20:26.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f53037fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5304155eb0 0x7f530406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:26.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f53037fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5304155eb0 0x7f530406e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33260/0 (socket says 172.21.15.154:33260) 2023-10-10T21:20:26.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f53037fe700 1 -- 172.21.15.154:0/3562346136 learned_addr learned my addr 172.21.15.154:0/3562346136 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:26.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f5302ffd700 1 --1- 172.21.15.154:0/3562346136 >> v1:172.21.15.154:6789/0 conn(0x7f53040c70b0 0x7f5304069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43144/0 (socket says 172.21.15.154:43144) 2023-10-10T21:20:26.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f5303fff700 1 --2- 172.21.15.154:0/3562346136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 0x7f53040ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:26.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f53027fc700 1 -- 172.21.15.154:0/3562346136 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891306467 0 0) 0x7f530406eb90 con 0x7f53040c70b0 2023-10-10T21:20:26.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f53027fc700 1 -- 172.21.15.154:0/3562346136 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ec003570 con 0x7f53040c70b0 2023-10-10T21:20:26.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f53037fe700 1 -- 172.21.15.154:0/3562346136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 msgr2=0x7f53040ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:26.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f53037fe700 1 --2- 172.21.15.154:0/3562346136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 0x7f53040ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:26.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f53037fe700 1 -- 172.21.15.154:0/3562346136 >> v1:172.21.15.154:6789/0 conn(0x7f53040c70b0 legacy=0x7f5304069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:26.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f53037fe700 1 -- 172.21.15.154:0/3562346136 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530406f430 con 0x7f5304155eb0 2023-10-10T21:20:26.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.060+0000 7f5303fff700 1 --2- 172.21.15.154:0/3562346136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 0x7f53040ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:26.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f53037fe700 1 --2- 172.21.15.154:0/3562346136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 0x7f530406e240 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f52f40099b0 tx=0x7f52f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5484753e3686804 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:26.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f53027fc700 1 -- 172.21.15.154:0/3562346136 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4009ea0 con 0x7f5304155eb0 2023-10-10T21:20:26.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f53027fc700 1 -- 172.21.15.154:0/3562346136 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f400b860 con 0x7f5304155eb0 2023-10-10T21:20:26.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f53027fc700 1 -- 172.21.15.154:0/3562346136 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f400bbe0 con 0x7f5304155eb0 2023-10-10T21:20:26.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f5309bff700 1 -- 172.21.15.154:0/3562346136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 msgr2=0x7f530406e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:26.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f5309bff700 1 --2- 172.21.15.154:0/3562346136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 0x7f530406e240 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f52f40099b0 tx=0x7f52f4009250 comp rx=0 tx=0).stop 2023-10-10T21:20:26.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f5309bff700 1 -- 172.21.15.154:0/3562346136 shutdown_connections 2023-10-10T21:20:26.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f5309bff700 1 --2- 172.21.15.154:0/3562346136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 0x7f53040ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:26.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f5309bff700 1 --2- 172.21.15.154:0/3562346136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 0x7f530406e240 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:26.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.061+0000 7f5309bff700 1 -- 172.21.15.154:0/3562346136 >> 172.21.15.154:0/3562346136 conn(0x7f5304068e10 msgr2=0x7f53040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:26.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.062+0000 7f5309bff700 1 -- 172.21.15.154:0/3562346136 shutdown_connections 2023-10-10T21:20:26.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.062+0000 7f5309bff700 1 -- 172.21.15.154:0/3562346136 wait complete. 2023-10-10T21:20:26.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.063+0000 7f5309bff700 1 Processor -- start 2023-10-10T21:20:26.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.063+0000 7f5309bff700 1 -- start start 2023-10-10T21:20:26.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5309bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 0x7f530416abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:26.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5309bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53040c70b0 0x7f53040c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:26.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5309bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 0x7f53040c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:26.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5309bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530416b120 con 0x7f5304155eb0 2023-10-10T21:20:26.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5309bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53040abb20 con 0x7f53040c70b0 2023-10-10T21:20:26.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5309bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530415f3e0 con 0x7f5304069e80 2023-10-10T21:20:26.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5303fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 0x7f53040c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:26.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5303fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 0x7f53040c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33266/0 (socket says 172.21.15.154:33266) 2023-10-10T21:20:26.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5303fff700 1 -- 172.21.15.154:0/3330431702 learned_addr learned my addr 172.21.15.154:0/3330431702 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f53037fe700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 0x7f530416abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.064+0000 7f5302ffd700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53040c70b0 0x7f53040c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f5303fff700 1 -- 172.21.15.154:0/3330431702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 msgr2=0x7f530416abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f5303fff700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 0x7f530416abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f5303fff700 1 -- 172.21.15.154:0/3330431702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53040c70b0 msgr2=0x7f53040c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:26.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f5303fff700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53040c70b0 0x7f53040c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:26.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f5303fff700 1 -- 172.21.15.154:0/3330431702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40094f0 con 0x7f5304155eb0 2023-10-10T21:20:26.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f5303fff700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 0x7f53040c5c00 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00d150 tx=0x7f52fc009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:26.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f52eb7fe700 1 -- 172.21.15.154:0/3330431702 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc00dc90 con 0x7f5304155eb0 2023-10-10T21:20:26.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f52eb7fe700 1 -- 172.21.15.154:0/3330431702 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc00f040 con 0x7f5304155eb0 2023-10-10T21:20:26.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f52eb7fe700 1 -- 172.21.15.154:0/3330431702 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc015690 con 0x7f5304155eb0 2023-10-10T21:20:26.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53040abde0 con 0x7f5304155eb0 2023-10-10T21:20:26.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.065+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53040ac3a0 con 0x7f5304155eb0 2023-10-10T21:20:26.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.066+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530404c3c0 con 0x7f5304155eb0 2023-10-10T21:20:26.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.067+0000 7f52eb7fe700 1 -- 172.21.15.154:0/3330431702 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52fc01e3b0 con 0x7f5304155eb0 2023-10-10T21:20:26.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.068+0000 7f52eb7fe700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f52f0066f30 0x7f52f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:26.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.068+0000 7f52eb7fe700 1 -- 172.21.15.154:0/3330431702 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f52fc084b70 con 0x7f5304155eb0 2023-10-10T21:20:26.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.068+0000 7f53037fe700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f52f0066f30 0x7f52f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:26.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.069+0000 7f53037fe700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f52f0066f30 0x7f52f00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f52f40099b0 tx=0x7f52f4017000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:26.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.073+0000 7f52eb7fe700 1 -- 172.21.15.154:0/3330431702 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52fc051c20 con 0x7f5304155eb0 2023-10-10T21:20:26.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:26.307+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5304156280 con 0x7f5304155eb0 2023-10-10T21:20:27.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.118+0000 7f52eb7fe700 1 -- 172.21.15.154:0/3330431702 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v50) v1 ==== 174+0+0 (secure 0 0 0) 0x7f52fc01a0c0 con 0x7f5304155eb0 2023-10-10T21:20:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.121+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f52f0066f30 msgr2=0x7f52f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.121+0000 7f5309bff700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f52f0066f30 0x7f52f00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f52f40099b0 tx=0x7f52f4017000 comp rx=0 tx=0).stop 2023-10-10T21:20:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.121+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 msgr2=0x7f53040c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.121+0000 7f5309bff700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 0x7f53040c5c00 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00d150 tx=0x7f52fc009a50 comp rx=0 tx=0).stop 2023-10-10T21:20:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.122+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 shutdown_connections 2023-10-10T21:20:27.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.122+0000 7f5309bff700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5304155eb0 0x7f53040c5c00 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.122+0000 7f5309bff700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f52f0066f30 0x7f52f00693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.122+0000 7f5309bff700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5304069e80 0x7f530416abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.122+0000 7f5309bff700 1 --2- 172.21.15.154:0/3330431702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53040c70b0 0x7f53040c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.122+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 >> 172.21.15.154:0/3330431702 conn(0x7f5304068e10 msgr2=0x7f5304154cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.122+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 shutdown_connections 2023-10-10T21:20:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.122+0000 7f5309bff700 1 -- 172.21.15.154:0/3330431702 wait complete. 2023-10-10T21:20:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 14 and data pool 15 2023-10-10T21:20:27.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:20:27.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.332+0000 7f9cbb9ff700 1 Processor -- start 2023-10-10T21:20:27.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.333+0000 7f9cbb9ff700 1 -- start start 2023-10-10T21:20:27.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cbb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb415ae00 0x7f9cb40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cbb9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cb4099bb0 0x7f9cb40b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cbb9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb406a280 con 0x7f9cb40b1570 2023-10-10T21:20:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cbb9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb40c8c30 con 0x7f9cb4099bb0 2023-10-10T21:20:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cbb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40c8950 con 0x7f9cb415ae00 2023-10-10T21:20:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cb9f9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cb4099bb0 0x7f9cb40b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cb979b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9cb40b1570 0x7f9cb415a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43150/0 (socket says 172.21.15.154:43150) 2023-10-10T21:20:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cb979b700 1 -- 172.21.15.154:0/1000098315 learned_addr learned my addr 172.21.15.154:0/1000098315 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:27.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cb8f9a700 1 --2- 172.21.15.154:0/1000098315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb415ae00 0x7f9cb40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cabfff700 1 -- 172.21.15.154:0/1000098315 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244222986 0 0) 0x7f9cb406a280 con 0x7f9cb40b1570 2023-10-10T21:20:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cb9f9c700 1 -- 172.21.15.154:0/1000098315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb415ae00 msgr2=0x7f9cb40c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cb9f9c700 1 --2- 172.21.15.154:0/1000098315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb415ae00 0x7f9cb40c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cb9f9c700 1 -- 172.21.15.154:0/1000098315 >> v1:172.21.15.154:6789/0 conn(0x7f9cb40b1570 legacy=0x7f9cb415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.334+0000 7f9cb9f9c700 1 -- 172.21.15.154:0/1000098315 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4069c30 con 0x7f9cb4099bb0 2023-10-10T21:20:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.335+0000 7f9cb9f9c700 1 --2- 172.21.15.154:0/1000098315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 0x7f9cb40b1940 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009e60 tx=0x7f9cac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fac53d4d6be4e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.335+0000 7f9cabfff700 1 -- 172.21.15.154:0/1000098315 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00e070 con 0x7f9cb4099bb0 2023-10-10T21:20:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.335+0000 7f9cabfff700 1 -- 172.21.15.154:0/1000098315 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac00bc30 con 0x7f9cb4099bb0 2023-10-10T21:20:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.335+0000 7f9cabfff700 1 -- 172.21.15.154:0/1000098315 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac012430 con 0x7f9cb4099bb0 2023-10-10T21:20:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.335+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/1000098315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 msgr2=0x7f9cb40b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.335+0000 7f9cbb9ff700 1 --2- 172.21.15.154:0/1000098315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 0x7f9cb40b1940 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009e60 tx=0x7f9cac009780 comp rx=0 tx=0).stop 2023-10-10T21:20:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.336+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/1000098315 shutdown_connections 2023-10-10T21:20:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.336+0000 7f9cbb9ff700 1 --2- 172.21.15.154:0/1000098315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 0x7f9cb40b1940 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.336+0000 7f9cbb9ff700 1 --2- 172.21.15.154:0/1000098315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb415ae00 0x7f9cb40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.336+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/1000098315 >> 172.21.15.154:0/1000098315 conn(0x7f9cb406d5a0 msgr2=0x7f9cb4068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.336+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/1000098315 shutdown_connections 2023-10-10T21:20:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.336+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/1000098315 wait complete. 2023-10-10T21:20:27.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.337+0000 7f9cbb9ff700 1 Processor -- start 2023-10-10T21:20:27.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.337+0000 7f9cbb9ff700 1 -- start start 2023-10-10T21:20:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cbb9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 0x7f9cb416a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cbb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb40b1570 0x7f9cb41571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cbb9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb415ae00 0x7f9cb406d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cbb9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb415d020 con 0x7f9cb4099bb0 2023-10-10T21:20:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cbb9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb415c410 con 0x7f9cb415ae00 2023-10-10T21:20:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cbb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb415c6f0 con 0x7f9cb40b1570 2023-10-10T21:20:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cb979b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 0x7f9cb416a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cb979b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 0x7f9cb416a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33286/0 (socket says 172.21.15.154:33286) 2023-10-10T21:20:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cb979b700 1 -- 172.21.15.154:0/2144590780 learned_addr learned my addr 172.21.15.154:0/2144590780 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:27.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cb8f9a700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb40b1570 0x7f9cb41571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.338+0000 7f9cb9f9c700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb415ae00 0x7f9cb406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cb979b700 1 -- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb40b1570 msgr2=0x7f9cb41571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cb979b700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb40b1570 0x7f9cb41571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cb979b700 1 -- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb415ae00 msgr2=0x7f9cb406d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cb979b700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb415ae00 0x7f9cb406d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cb979b700 1 -- 172.21.15.154:0/2144590780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac009a20 con 0x7f9cb4099bb0 2023-10-10T21:20:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cb8f9a700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb40b1570 0x7f9cb41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cb9f9c700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb415ae00 0x7f9cb406d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cb979b700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 0x7f9cb416a1d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c7e0 tx=0x7f9cb0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:27.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9ca97fa700 1 -- 172.21.15.154:0/2144590780 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0005b30 con 0x7f9cb4099bb0 2023-10-10T21:20:27.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb415c9d0 con 0x7f9cb4099bb0 2023-10-10T21:20:27.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9ca97fa700 1 -- 172.21.15.154:0/2144590780 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0005c90 con 0x7f9cb4099bb0 2023-10-10T21:20:27.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9ca97fa700 1 -- 172.21.15.154:0/2144590780 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0007300 con 0x7f9cb4099bb0 2023-10-10T21:20:27.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.339+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb416a710 con 0x7f9cb4099bb0 2023-10-10T21:20:27.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.340+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb415d300 con 0x7f9cb4099bb0 2023-10-10T21:20:27.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.341+0000 7f9ca97fa700 1 -- 172.21.15.154:0/2144590780 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cb001b400 con 0x7f9cb4099bb0 2023-10-10T21:20:27.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.342+0000 7f9ca97fa700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9c98066f30 0x7f9c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.342+0000 7f9ca97fa700 1 -- 172.21.15.154:0/2144590780 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f9cb00842e0 con 0x7f9cb4099bb0 2023-10-10T21:20:27.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.342+0000 7f9cb8f9a700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9c98066f30 0x7f9c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.343+0000 7f9cb8f9a700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9c98066f30 0x7f9c980693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cb416dcf0 tx=0x7f9ca4008040 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:27.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.346+0000 7f9ca97fa700 1 -- 172.21.15.154:0/2144590780 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cb0051320 con 0x7f9cb4099bb0 2023-10-10T21:20:27.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.538+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cb404c3c0 con 0x7f9cb4099bb0 2023-10-10T21:20:27.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.539+0000 7f9ca97fa700 1 -- 172.21.15.154:0/2144590780 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16020 (secure 0 0 0) 0x7f9cb0054940 con 0x7f9cb4099bb0 2023-10-10T21:20:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:27.541 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":123,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:20:26.309274+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:20:24.012206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-10T21:20:25.295138+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:20:27.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.541+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9c98066f30 msgr2=0x7f9c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.541+0000 7f9cbb9ff700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9c98066f30 0x7f9c980693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cb416dcf0 tx=0x7f9ca4008040 comp rx=0 tx=0).stop 2023-10-10T21:20:27.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.541+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 msgr2=0x7f9cb416a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.541+0000 7f9cbb9ff700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 0x7f9cb416a1d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c7e0 tx=0x7f9cb0007df0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.542+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 shutdown_connections 2023-10-10T21:20:27.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.542+0000 7f9cbb9ff700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cb415ae00 0x7f9cb406d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.542+0000 7f9cbb9ff700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4099bb0 0x7f9cb416a1d0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.542+0000 7f9cbb9ff700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9c98066f30 0x7f9c980693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.542+0000 7f9cbb9ff700 1 --2- 172.21.15.154:0/2144590780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cb40b1570 0x7f9cb41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.542+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 >> 172.21.15.154:0/2144590780 conn(0x7f9cb406d5a0 msgr2=0x7f9cb40adda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:27.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.542+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 shutdown_connections 2023-10-10T21:20:27.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.542+0000 7f9cbb9ff700 1 -- 172.21.15.154:0/2144590780 wait complete. 2023-10-10T21:20:27.561 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:20:27.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.741+0000 7f05f45ff700 1 Processor -- start 2023-10-10T21:20:27.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.741+0000 7f05f45ff700 1 -- start start 2023-10-10T21:20:27.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 0x7f05ec155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f45ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f05ec0ac230 0x7f05ec0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f45ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec0ad930 con 0x7f05ec1568a0 2023-10-10T21:20:27.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f45ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec0acd20 con 0x7f05ec0ac230 2023-10-10T21:20:27.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0ad000 con 0x7f05ec155c10 2023-10-10T21:20:27.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f1b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f05ec0ac230 0x7f05ec0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f2b9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f05ec1568a0 0x7f05ec156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43162/0 (socket says 172.21.15.154:43162) 2023-10-10T21:20:27.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f1b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f05ec0ac230 0x7f05ec0ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33300/0 (socket says 172.21.15.154:33300) 2023-10-10T21:20:27.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f2b9c700 1 -- 172.21.15.154:0/3751732129 learned_addr learned my addr 172.21.15.154:0/3751732129 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:27.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.743+0000 7f05f239b700 1 --2- 172.21.15.154:0/3751732129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 0x7f05ec155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.744+0000 7f05f1399700 1 -- 172.21.15.154:0/3751732129 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932141433 0 0) 0x7f05ec0ad930 con 0x7f05ec1568a0 2023-10-10T21:20:27.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.744+0000 7f05f1b9a700 1 -- 172.21.15.154:0/3751732129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 msgr2=0x7f05ec155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:27.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.744+0000 7f05f1b9a700 1 --2- 172.21.15.154:0/3751732129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 0x7f05ec155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.744+0000 7f05f1b9a700 1 -- 172.21.15.154:0/3751732129 >> v1:172.21.15.154:6789/0 conn(0x7f05ec1568a0 legacy=0x7f05ec156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.744+0000 7f05f1b9a700 1 -- 172.21.15.154:0/3751732129 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec0ad2e0 con 0x7f05ec0ac230 2023-10-10T21:20:27.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.744+0000 7f05f1b9a700 1 --2- 172.21.15.154:0/3751732129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec0ac230 0x7f05ec0ac6a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00bbc0 tx=0x7f05dc00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d015161ff06e2b2e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:27.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.744+0000 7f05f1399700 1 -- 172.21.15.154:0/3751732129 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc00dae0 con 0x7f05ec0ac230 2023-10-10T21:20:27.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.744+0000 7f05f1399700 1 -- 172.21.15.154:0/3751732129 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc00dc40 con 0x7f05ec0ac230 2023-10-10T21:20:27.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.744+0000 7f05f1399700 1 -- 172.21.15.154:0/3751732129 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc019480 con 0x7f05ec0ac230 2023-10-10T21:20:27.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.745+0000 7f05f45ff700 1 -- 172.21.15.154:0/3751732129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec0ac230 msgr2=0x7f05ec0ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.745+0000 7f05f45ff700 1 --2- 172.21.15.154:0/3751732129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec0ac230 0x7f05ec0ac6a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00bbc0 tx=0x7f05dc00b430 comp rx=0 tx=0).stop 2023-10-10T21:20:27.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.745+0000 7f05f45ff700 1 -- 172.21.15.154:0/3751732129 shutdown_connections 2023-10-10T21:20:27.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.745+0000 7f05f45ff700 1 --2- 172.21.15.154:0/3751732129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 0x7f05ec155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.745+0000 7f05f45ff700 1 --2- 172.21.15.154:0/3751732129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec0ac230 0x7f05ec0ac6a0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.745+0000 7f05f45ff700 1 -- 172.21.15.154:0/3751732129 >> 172.21.15.154:0/3751732129 conn(0x7f05ec06a320 msgr2=0x7f05ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:27.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.745+0000 7f05f45ff700 1 -- 172.21.15.154:0/3751732129 shutdown_connections 2023-10-10T21:20:27.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.745+0000 7f05f45ff700 1 -- 172.21.15.154:0/3751732129 wait complete. 2023-10-10T21:20:27.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.746+0000 7f05f45ff700 1 Processor -- start 2023-10-10T21:20:27.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.746+0000 7f05f45ff700 1 -- start start 2023-10-10T21:20:27.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.747+0000 7f05f45ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05ec0ac230 0x7f05ec0c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.747+0000 7f05f45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 0x7f05ec0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.747+0000 7f05f45ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec1568a0 0x7f05ec169e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.747+0000 7f05f45ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0cd0d0 con 0x7f05ec1568a0 2023-10-10T21:20:27.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.747+0000 7f05f45ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0cb210 con 0x7f05ec0ac230 2023-10-10T21:20:27.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.747+0000 7f05f45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0ca600 con 0x7f05ec155c10 2023-10-10T21:20:27.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f2b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec1568a0 0x7f05ec169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f2b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec1568a0 0x7f05ec169e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33302/0 (socket says 172.21.15.154:33302) 2023-10-10T21:20:27.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f2b9c700 1 -- 172.21.15.154:0/1789424491 learned_addr learned my addr 172.21.15.154:0/1789424491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:27.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f239b700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05ec0ac230 0x7f05ec0c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f1b9a700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 0x7f05ec0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f2b9c700 1 -- 172.21.15.154:0/1789424491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 msgr2=0x7f05ec0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f2b9c700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 0x7f05ec0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f2b9c700 1 -- 172.21.15.154:0/1789424491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05ec0ac230 msgr2=0x7f05ec0c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f2b9c700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05ec0ac230 0x7f05ec0c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f2b9c700 1 -- 172.21.15.154:0/1789424491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc00b6d0 con 0x7f05ec1568a0 2023-10-10T21:20:27.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.748+0000 7f05f2b9c700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec1568a0 0x7f05ec169e80 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f05e400cc10 tx=0x7f05e4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:27.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.749+0000 7f05e27fc700 1 -- 172.21.15.154:0/1789424491 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e400a930 con 0x7f05ec1568a0 2023-10-10T21:20:27.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.749+0000 7f05e27fc700 1 -- 172.21.15.154:0/1789424491 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e400aab0 con 0x7f05ec1568a0 2023-10-10T21:20:27.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.749+0000 7f05e27fc700 1 -- 172.21.15.154:0/1789424491 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e400ae70 con 0x7f05ec1568a0 2023-10-10T21:20:27.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.749+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ec0ca8e0 con 0x7f05ec1568a0 2023-10-10T21:20:27.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.749+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec0caea0 con 0x7f05ec1568a0 2023-10-10T21:20:27.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.750+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec0cb380 con 0x7f05ec1568a0 2023-10-10T21:20:27.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.751+0000 7f05e27fc700 1 -- 172.21.15.154:0/1789424491 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05e4007300 con 0x7f05ec1568a0 2023-10-10T21:20:27.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.752+0000 7f05e27fc700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f05d0066f30 0x7f05d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:27.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.752+0000 7f05e27fc700 1 -- 172.21.15.154:0/1789424491 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f05e4084be0 con 0x7f05ec1568a0 2023-10-10T21:20:27.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.752+0000 7f05f239b700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f05d0066f30 0x7f05d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:27.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.752+0000 7f05f239b700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f05d0066f30 0x7f05d00693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009d40 tx=0x7f05e8008040 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:27.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.756+0000 7f05e27fc700 1 -- 172.21.15.154:0/1789424491 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05e4051c10 con 0x7f05ec1568a0 2023-10-10T21:20:27.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.949+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05ec04c3c0 con 0x7f05ec1568a0 2023-10-10T21:20:27.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.950+0000 7f05e27fc700 1 -- 172.21.15.154:0/1789424491 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16007 (secure 0 0 0) 0x7f05e4055230 con 0x7f05ec1568a0 2023-10-10T21:20:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:27.952 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":124,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:20:27.842584+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:20:24.012206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-10T21:20:25.295138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:20:27.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f05d0066f30 msgr2=0x7f05d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f05d0066f30 0x7f05d00693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009d40 tx=0x7f05e8008040 comp rx=0 tx=0).stop 2023-10-10T21:20:27.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec1568a0 msgr2=0x7f05ec169e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:27.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec1568a0 0x7f05ec169e80 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f05e400cc10 tx=0x7f05e4001970 comp rx=0 tx=0).stop 2023-10-10T21:20:27.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 shutdown_connections 2023-10-10T21:20:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05ec1568a0 0x7f05ec169e80 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05ec0ac230 0x7f05ec0c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f05d0066f30 0x7f05d00693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 --2- 172.21.15.154:0/1789424491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05ec155c10 0x7f05ec0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 >> 172.21.15.154:0/1789424491 conn(0x7f05ec06a320 msgr2=0x7f05ec06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 shutdown_connections 2023-10-10T21:20:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:27.953+0000 7f05f45ff700 1 -- 172.21.15.154:0/1789424491 wait complete. 2023-10-10T21:20:27.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T21:20:28.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.160+0000 7f9b577ff700 1 Processor -- start 2023-10-10T21:20:28.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.160+0000 7f9b577ff700 1 -- start start 2023-10-10T21:20:28.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b577ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b500c83f0 0x7f9b500c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:28.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b577ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b500ccee0 0x7f9b501561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:28.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b577ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5015b0d0 con 0x7f9b500c87c0 2023-10-10T21:20:28.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b577ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b500c7a60 con 0x7f9b500c83f0 2023-10-10T21:20:28.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b577ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5015a4c0 con 0x7f9b500ccee0 2023-10-10T21:20:28.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b5559b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b500c83f0 0x7f9b500c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:28.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b5559b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b500c83f0 0x7f9b500c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33312/0 (socket says 172.21.15.154:33312) 2023-10-10T21:20:28.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b5559b700 1 -- 172.21.15.154:0/404300444 learned_addr learned my addr 172.21.15.154:0/404300444 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:28.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b54d9a700 1 --2- 172.21.15.154:0/404300444 >> v2:172.21.15.179:3300/0 conn(0x7f9b500ccee0 0x7f9b501561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:28.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b5559b700 1 -- 172.21.15.154:0/404300444 >> v2:172.21.15.179:3300/0 conn(0x7f9b500ccee0 msgr2=0x7f9b501561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:28.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b5559b700 1 --2- 172.21.15.154:0/404300444 >> v2:172.21.15.179:3300/0 conn(0x7f9b500ccee0 0x7f9b501561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:28.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b5559b700 1 -- 172.21.15.154:0/404300444 >> v1:172.21.15.179:6789/0 conn(0x7f9b500c87c0 legacy=0x7f9b5006eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:28.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.162+0000 7f9b5559b700 1 -- 172.21.15.154:0/404300444 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5015a7a0 con 0x7f9b500c83f0 2023-10-10T21:20:28.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.163+0000 7f9b5559b700 1 --2- 172.21.15.154:0/404300444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c83f0 0x7f9b500c7520 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f9b500c7eb0 tx=0x7f9b4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2238c0e8ef1f631b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:28.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.163+0000 7f9b47fff700 1 -- 172.21.15.154:0/404300444 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00b820 con 0x7f9b500c83f0 2023-10-10T21:20:28.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.163+0000 7f9b47fff700 1 -- 172.21.15.154:0/404300444 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c00b980 con 0x7f9b500c83f0 2023-10-10T21:20:28.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.163+0000 7f9b47fff700 1 -- 172.21.15.154:0/404300444 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00bd20 con 0x7f9b500c83f0 2023-10-10T21:20:28.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.163+0000 7f9b577ff700 1 -- 172.21.15.154:0/404300444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c83f0 msgr2=0x7f9b500c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:28.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.163+0000 7f9b577ff700 1 --2- 172.21.15.154:0/404300444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c83f0 0x7f9b500c7520 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f9b500c7eb0 tx=0x7f9b4c009250 comp rx=0 tx=0).stop 2023-10-10T21:20:28.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.164+0000 7f9b577ff700 1 -- 172.21.15.154:0/404300444 shutdown_connections 2023-10-10T21:20:28.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.164+0000 7f9b577ff700 1 --2- 172.21.15.154:0/404300444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c83f0 0x7f9b500c7520 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:28.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.164+0000 7f9b577ff700 1 --2- 172.21.15.154:0/404300444 >> v2:172.21.15.179:3300/0 conn(0x7f9b500ccee0 0x7f9b501561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:28.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.164+0000 7f9b577ff700 1 -- 172.21.15.154:0/404300444 >> 172.21.15.154:0/404300444 conn(0x7f9b50068e10 msgr2=0x7f9b500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:28.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.164+0000 7f9b577ff700 1 -- 172.21.15.154:0/404300444 shutdown_connections 2023-10-10T21:20:28.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.164+0000 7f9b577ff700 1 -- 172.21.15.154:0/404300444 wait complete. 2023-10-10T21:20:28.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.165+0000 7f9b577ff700 1 Processor -- start 2023-10-10T21:20:28.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.165+0000 7f9b577ff700 1 -- start start 2023-10-10T21:20:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.166+0000 7f9b577ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b500c83f0 0x7f9b50147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.166+0000 7f9b577ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c87c0 0x7f9b500b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.166+0000 7f9b577ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b500ccee0 0x7f9b5016b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.166+0000 7f9b577ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b50148cc0 con 0x7f9b500c87c0 2023-10-10T21:20:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.166+0000 7f9b577ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501480f0 con 0x7f9b500c83f0 2023-10-10T21:20:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.166+0000 7f9b577ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b50147db0 con 0x7f9b500ccee0 2023-10-10T21:20:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.166+0000 7f9b54d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c87c0 0x7f9b500b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.166+0000 7f9b54d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c87c0 0x7f9b500b15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33322/0 (socket says 172.21.15.154:33322) 2023-10-10T21:20:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.166+0000 7f9b54d9a700 1 -- 172.21.15.154:0/1591294717 learned_addr learned my addr 172.21.15.154:0/1591294717 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b54d9a700 1 -- 172.21.15.154:0/1591294717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b500ccee0 msgr2=0x7f9b5016b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b54d9a700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b500ccee0 0x7f9b5016b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b54d9a700 1 -- 172.21.15.154:0/1591294717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b500c83f0 msgr2=0x7f9b50147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b54d9a700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b500c83f0 0x7f9b50147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b54d9a700 1 -- 172.21.15.154:0/1591294717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0094f0 con 0x7f9b500c87c0 2023-10-10T21:20:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b54d9a700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c87c0 0x7f9b500b15a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000d890 tx=0x7f9b40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b457fa700 1 -- 172.21.15.154:0/1591294717 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b400125f0 con 0x7f9b500c87c0 2023-10-10T21:20:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b457fa700 1 -- 172.21.15.154:0/1591294717 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b40012770 con 0x7f9b500c87c0 2023-10-10T21:20:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b50148390 con 0x7f9b500c87c0 2023-10-10T21:20:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b457fa700 1 -- 172.21.15.154:0/1591294717 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40012b30 con 0x7f9b500c87c0 2023-10-10T21:20:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.167+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b50148950 con 0x7f9b500c87c0 2023-10-10T21:20:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.168+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5004c3c0 con 0x7f9b500c87c0 2023-10-10T21:20:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.169+0000 7f9b457fa700 1 -- 172.21.15.154:0/1591294717 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b4001e460 con 0x7f9b500c87c0 2023-10-10T21:20:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.170+0000 7f9b457fa700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9b34066f30 0x7f9b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.170+0000 7f9b457fa700 1 -- 172.21.15.154:0/1591294717 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f9b40084ea0 con 0x7f9b500c87c0 2023-10-10T21:20:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.170+0000 7f9b5559b700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9b34066f30 0x7f9b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.171+0000 7f9b5559b700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9b34066f30 0x7f9b340693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b500c7eb0 tx=0x7f9b4c016000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.174+0000 7f9b457fa700 1 -- 172.21.15.154:0/1591294717 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b40051ee0 con 0x7f9b500c87c0 2023-10-10T21:20:28.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:28.408+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9b500cbd90 con 0x7f9b500c87c0 2023-10-10T21:20:29.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.132+0000 7f9b457fa700 1 -- 172.21.15.154:0/1591294717 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9b40055500 con 0x7f9b500c87c0 2023-10-10T21:20:29.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9b34066f30 msgr2=0x7f9b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:29.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9b34066f30 0x7f9b340693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b500c7eb0 tx=0x7f9b4c016000 comp rx=0 tx=0).stop 2023-10-10T21:20:29.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c87c0 msgr2=0x7f9b500b15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:29.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c87c0 0x7f9b500b15a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000d890 tx=0x7f9b40008040 comp rx=0 tx=0).stop 2023-10-10T21:20:29.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 shutdown_connections 2023-10-10T21:20:29.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f9b34066f30 0x7f9b340693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b500ccee0 0x7f9b5016b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b500c83f0 0x7f9b50147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 --2- 172.21.15.154:0/1591294717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b500c87c0 0x7f9b500b15a0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 >> 172.21.15.154:0/1591294717 conn(0x7f9b50068e10 msgr2=0x7f9b500c6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:29.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 shutdown_connections 2023-10-10T21:20:29.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.135+0000 7f9b577ff700 1 -- 172.21.15.154:0/1591294717 wait complete. 2023-10-10T21:20:29.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T21:20:29.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.344+0000 7fd8355ff700 1 Processor -- start 2023-10-10T21:20:29.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.345+0000 7fd8355ff700 1 -- start start 2023-10-10T21:20:29.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.346+0000 7fd8355ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd8300ccee0 0x7fd8301561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:29.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.346+0000 7fd8355ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83015b0d0 con 0x7fd8300c83f0 2023-10-10T21:20:29.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.346+0000 7fd8355ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83015a4c0 con 0x7fd8300c87c0 2023-10-10T21:20:29.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.346+0000 7fd8355ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83015a7a0 con 0x7fd8300ccee0 2023-10-10T21:20:29.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.346+0000 7fd82effd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd8300c83f0 0x7fd8300c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43168/0 (socket says 172.21.15.154:43168) 2023-10-10T21:20:29.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.346+0000 7fd82effd700 1 -- 172.21.15.154:0/384024148 learned_addr learned my addr 172.21.15.154:0/384024148 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:29.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.346+0000 7fd827fff700 1 --2- 172.21.15.154:0/384024148 >> v2:172.21.15.179:3300/0 conn(0x7fd8300ccee0 0x7fd8301561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:29.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.346+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448555362 0 0) 0x7fd83015b0d0 con 0x7fd8300c83f0 2023-10-10T21:20:29.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.346+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd81c003570 con 0x7fd8300c83f0 2023-10-10T21:20:29.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3004349851 0 0) 0x7fd81c003570 con 0x7fd8300c83f0 2023-10-10T21:20:29.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 >> v2:172.21.15.179:3300/0 conn(0x7fd8300ccee0 msgr2=0x7fd8301561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:29.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 --2- 172.21.15.154:0/384024148 >> v2:172.21.15.179:3300/0 conn(0x7fd8300ccee0 0x7fd8301561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 >> v1:172.21.15.179:6789/0 conn(0x7fd8300c87c0 legacy=0x7fd8300ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:29.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83015aa80 con 0x7fd8300c83f0 2023-10-10T21:20:29.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fd820001470 con 0x7fd8300c83f0 2023-10-10T21:20:29.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 >> v1:172.21.15.154:6789/0 conn(0x7fd8300c83f0 legacy=0x7fd8300c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:29.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c003ab0 0x7fd81c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:29.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81c004810 0x7fd81c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:29.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81c005210 0x7fd81c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:29.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83015a7a0 con 0x7fd81c004810 2023-10-10T21:20:29.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c00c130 con 0x7fd81c003ab0 2023-10-10T21:20:29.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c00c2f0 con 0x7fd81c005210 2023-10-10T21:20:29.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd827fff700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81c004810 0x7fd81c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:29.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82effd700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c003ab0 0x7fd81c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:29.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.347+0000 7fd82f7fe700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81c005210 0x7fd81c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:29.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd827fff700 1 -- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81c005210 msgr2=0x7fd81c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:29.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd827fff700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81c005210 0x7fd81c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd827fff700 1 -- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c003ab0 msgr2=0x7fd81c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:29.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd827fff700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c003ab0 0x7fd81c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd827fff700 1 -- 172.21.15.154:0/384024148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c003570 con 0x7fd81c004810 2023-10-10T21:20:29.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd82f7fe700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81c005210 0x7fd81c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:29.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd82effd700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c003ab0 0x7fd81c003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:29.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd82f7fe700 1 -- 172.21.15.154:0/384024148 reap_dead start 2023-10-10T21:20:29.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd827fff700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81c004810 0x7fd81c004c80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd818009c00 tx=0x7fd8180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a51a73ca4305459 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:29.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81800e710 con 0x7fd81c004810 2023-10-10T21:20:29.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81800e870 con 0x7fd81c004810 2023-10-10T21:20:29.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.348+0000 7fd82e7fc700 1 -- 172.21.15.154:0/384024148 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81800ec30 con 0x7fd81c004810 2023-10-10T21:20:29.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.349+0000 7fd8355ff700 1 -- 172.21.15.154:0/384024148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81c004810 msgr2=0x7fd81c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:29.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.349+0000 7fd8355ff700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81c004810 0x7fd81c004c80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd818009c00 tx=0x7fd8180091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.349+0000 7fd8355ff700 1 -- 172.21.15.154:0/384024148 shutdown_connections 2023-10-10T21:20:29.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.349+0000 7fd8355ff700 1 --2- 172.21.15.154:0/384024148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81c004810 0x7fd81c004c80 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.349+0000 7fd8355ff700 1 -- 172.21.15.154:0/384024148 >> 172.21.15.154:0/384024148 conn(0x7fd830068e10 msgr2=0x7fd8300cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:29.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.349+0000 7fd8355ff700 1 -- 172.21.15.154:0/384024148 shutdown_connections 2023-10-10T21:20:29.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.349+0000 7fd8355ff700 1 -- 172.21.15.154:0/384024148 wait complete. 2023-10-10T21:20:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.350+0000 7fd8355ff700 1 Processor -- start 2023-10-10T21:20:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.350+0000 7fd8355ff700 1 -- start start 2023-10-10T21:20:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.351+0000 7fd8355ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c004810 0x7fd8300c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.351+0000 7fd8355ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd830145560 0x7fd830163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.351+0000 7fd8355ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8300c6b30 0x7fd8300c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.351+0000 7fd8355ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300c74e0 con 0x7fd8300c6b30 2023-10-10T21:20:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.351+0000 7fd8355ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300c6700 con 0x7fd81c004810 2023-10-10T21:20:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.351+0000 7fd8355ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8301437e0 con 0x7fd830145560 2023-10-10T21:20:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8300c6b30 0x7fd8300c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8300c6b30 0x7fd8300c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33338/0 (socket says 172.21.15.154:33338) 2023-10-10T21:20:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82f7fe700 1 -- 172.21.15.154:0/697089958 learned_addr learned my addr 172.21.15.154:0/697089958 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82effd700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c004810 0x7fd8300c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd827fff700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd830145560 0x7fd830163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82f7fe700 1 -- 172.21.15.154:0/697089958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd830145560 msgr2=0x7fd830163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82f7fe700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd830145560 0x7fd830163eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82f7fe700 1 -- 172.21.15.154:0/697089958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c004810 msgr2=0x7fd8300c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82f7fe700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c004810 0x7fd8300c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82f7fe700 1 -- 172.21.15.154:0/697089958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300c44e0 con 0x7fd8300c6b30 2023-10-10T21:20:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd82f7fe700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8300c6b30 0x7fd8300c6fa0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd8300cd2b0 tx=0x7fd828009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.352+0000 7fd826ffd700 1 -- 172.21.15.154:0/697089958 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828012590 con 0x7fd8300c6b30 2023-10-10T21:20:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.353+0000 7fd826ffd700 1 -- 172.21.15.154:0/697089958 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8280126f0 con 0x7fd8300c6b30 2023-10-10T21:20:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.353+0000 7fd826ffd700 1 -- 172.21.15.154:0/697089958 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828012ab0 con 0x7fd8300c6b30 2023-10-10T21:20:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.353+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8301643f0 con 0x7fd8300c6b30 2023-10-10T21:20:29.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.353+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8300c5dd0 con 0x7fd8300c6b30 2023-10-10T21:20:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.354+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83004c3c0 con 0x7fd8300c6b30 2023-10-10T21:20:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.355+0000 7fd826ffd700 1 -- 172.21.15.154:0/697089958 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd828003030 con 0x7fd8300c6b30 2023-10-10T21:20:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.355+0000 7fd826ffd700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd810066f30 0x7fd8100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.356+0000 7fd826ffd700 1 -- 172.21.15.154:0/697089958 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fd828084520 con 0x7fd8300c6b30 2023-10-10T21:20:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.356+0000 7fd82effd700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd810066f30 0x7fd8100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.356+0000 7fd82effd700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd810066f30 0x7fd8100693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd820000fd0 tx=0x7fd820007040 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.360+0000 7fd826ffd700 1 -- 172.21.15.154:0/697089958 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd828051600 con 0x7fd8300c6b30 2023-10-10T21:20:29.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:29.596+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd8300cbd90 con 0x7fd8300c6b30 2023-10-10T21:20:30.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.137+0000 7fd826ffd700 1 -- 172.21.15.154:0/697089958 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd828054c20 con 0x7fd8300c6b30 2023-10-10T21:20:30.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.140+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd810066f30 msgr2=0x7fd8100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.140+0000 7fd8355ff700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd810066f30 0x7fd8100693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd820000fd0 tx=0x7fd820007040 comp rx=0 tx=0).stop 2023-10-10T21:20:30.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.140+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8300c6b30 msgr2=0x7fd8300c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.140+0000 7fd8355ff700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8300c6b30 0x7fd8300c6fa0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd8300cd2b0 tx=0x7fd828009040 comp rx=0 tx=0).stop 2023-10-10T21:20:30.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.140+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 shutdown_connections 2023-10-10T21:20:30.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.140+0000 7fd8355ff700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8300c6b30 0x7fd8300c6fa0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.140+0000 7fd8355ff700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd81c004810 0x7fd8300c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.141+0000 7fd8355ff700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd810066f30 0x7fd8100693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.141+0000 7fd8355ff700 1 --2- 172.21.15.154:0/697089958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd830145560 0x7fd830163eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.141+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 >> 172.21.15.154:0/697089958 conn(0x7fd830068e10 msgr2=0x7fd8300c2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:30.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.141+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 shutdown_connections 2023-10-10T21:20:30.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.141+0000 7fd8355ff700 1 -- 172.21.15.154:0/697089958 wait complete. 2023-10-10T21:20:30.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:20:30.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.344+0000 7fdaec99d700 1 Processor -- start 2023-10-10T21:20:30.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.344+0000 7fdaec99d700 1 -- start start 2023-10-10T21:20:30.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.345+0000 7fdaec99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdae8159420 0x7fdae80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.345+0000 7fdaec99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdae81597f0 0x7fdae80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.345+0000 7fdaec99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae80b11d0 con 0x7fdae815d230 2023-10-10T21:20:30.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.345+0000 7fdaec99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80b14b0 con 0x7fdae8159420 2023-10-10T21:20:30.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.345+0000 7fdaec99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80b1790 con 0x7fdae81597f0 2023-10-10T21:20:30.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae7fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdae815d230 0x7fdae80b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43180/0 (socket says 172.21.15.154:43180) 2023-10-10T21:20:30.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae7fff700 1 -- 172.21.15.154:0/1428621572 learned_addr learned my addr 172.21.15.154:0/1428621572 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:30.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae77fe700 1 --2- 172.21.15.154:0/1428621572 >> v2:172.21.15.179:3300/0 conn(0x7fdae8159420 0x7fdae80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae6ffd700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdae81597f0 0x7fdae80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196863981 0 0) 0x7fdae80b11d0 con 0x7fdae815d230 2023-10-10T21:20:30.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdad0003570 con 0x7fdae815d230 2023-10-10T21:20:30.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2650442593 0 0) 0x7fdad0003570 con 0x7fdae815d230 2023-10-10T21:20:30.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdae81597f0 msgr2=0x7fdae80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:30.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae67fc700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdae81597f0 0x7fdae80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 >> v2:172.21.15.179:3300/0 conn(0x7fdae8159420 msgr2=0x7fdae80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:30.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae67fc700 1 --2- 172.21.15.154:0/1428621572 >> v2:172.21.15.179:3300/0 conn(0x7fdae8159420 0x7fdae80b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80b1a70 con 0x7fdae815d230 2023-10-10T21:20:30.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.346+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fdae00017f0 con 0x7fdae815d230 2023-10-10T21:20:30.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 >> v1:172.21.15.154:6789/0 conn(0x7fdae815d230 legacy=0x7fdae80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae67fc700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdad0003ae0 0x7fdad0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae67fc700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdae81597f0 0x7fdad0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae67fc700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdad0004d50 0x7fdad00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80b14b0 con 0x7fdad0003ae0 2023-10-10T21:20:30.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80b1790 con 0x7fdad0004d50 2023-10-10T21:20:30.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad000bb10 con 0x7fdae81597f0 2023-10-10T21:20:30.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae77fe700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdad0003ae0 0x7fdad0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae6ffd700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdae81597f0 0x7fdad0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae7fff700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdad0004d50 0x7fdad00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae77fe700 1 -- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdae81597f0 msgr2=0x7fdad0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:30.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae77fe700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdae81597f0 0x7fdad0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae77fe700 1 -- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdad0004d50 msgr2=0x7fdad00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:30.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae77fe700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdad0004d50 0x7fdad00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.347+0000 7fdae77fe700 1 -- 172.21.15.154:0/1428621572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad0003570 con 0x7fdad0003ae0 2023-10-10T21:20:30.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.348+0000 7fdae77fe700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdad0003ae0 0x7fdad0003ef0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009c30 tx=0x7fdad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe6802acc38c875 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:30.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.348+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800e710 con 0x7fdad0003ae0 2023-10-10T21:20:30.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.348+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad800e870 con 0x7fdad0003ae0 2023-10-10T21:20:30.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.348+0000 7fdae67fc700 1 -- 172.21.15.154:0/1428621572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800ec30 con 0x7fdad0003ae0 2023-10-10T21:20:30.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.348+0000 7fdaec99d700 1 -- 172.21.15.154:0/1428621572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdad0003ae0 msgr2=0x7fdad0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.348+0000 7fdaec99d700 1 --2- 172.21.15.154:0/1428621572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdad0003ae0 0x7fdad0003ef0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009c30 tx=0x7fdad80091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.348+0000 7fdae7fff700 1 -- 172.21.15.154:0/1428621572 reap_dead start 2023-10-10T21:20:30.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.348+0000 7fdaec99d700 1 -- 172.21.15.154:0/1428621572 shutdown_connections 2023-10-10T21:20:30.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.348+0000 7fdaec99d700 1 -- 172.21.15.154:0/1428621572 >> 172.21.15.154:0/1428621572 conn(0x7fdae80d0660 msgr2=0x7fdae80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:30.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.349+0000 7fdaec99d700 1 -- 172.21.15.154:0/1428621572 shutdown_connections 2023-10-10T21:20:30.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.349+0000 7fdaec99d700 1 -- 172.21.15.154:0/1428621572 wait complete. 2023-10-10T21:20:30.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.350+0000 7fdaec99d700 1 Processor -- start 2023-10-10T21:20:30.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.350+0000 7fdaec99d700 1 -- start start 2023-10-10T21:20:30.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdaec99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdad0003ae0 0x7fdae8145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdaec99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdae815c4b0 0x7fdae8150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdaec99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae8069360 0x7fdae80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdaec99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae8069d10 con 0x7fdae8069360 2023-10-10T21:20:30.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdaec99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae815b410 con 0x7fdae815c4b0 2023-10-10T21:20:30.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdaec99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae815b6f0 con 0x7fdad0003ae0 2023-10-10T21:20:30.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdae7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae8069360 0x7fdae80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdae7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae8069360 0x7fdae80697d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33344/0 (socket says 172.21.15.154:33344) 2023-10-10T21:20:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdae7fff700 1 -- 172.21.15.154:0/1057635156 learned_addr learned my addr 172.21.15.154:0/1057635156 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdae6ffd700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdae815c4b0 0x7fdae8150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.351+0000 7fdae77fe700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdad0003ae0 0x7fdae8145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdae7fff700 1 -- 172.21.15.154:0/1057635156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdad0003ae0 msgr2=0x7fdae8145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdae7fff700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdad0003ae0 0x7fdae8145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdae7fff700 1 -- 172.21.15.154:0/1057635156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdae815c4b0 msgr2=0x7fdae8150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdae7fff700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdae815c4b0 0x7fdae8150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdae7fff700 1 -- 172.21.15.154:0/1057635156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae815b9d0 con 0x7fdae8069360 2023-10-10T21:20:30.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdae7fff700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae8069360 0x7fdae80697d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdae00013d0 tx=0x7fdae0002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:30.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdacf7fe700 1 -- 172.21.15.154:0/1057635156 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000ac70 con 0x7fdae8069360 2023-10-10T21:20:30.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdacf7fe700 1 -- 172.21.15.154:0/1057635156 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000adf0 con 0x7fdae8069360 2023-10-10T21:20:30.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdacf7fe700 1 -- 172.21.15.154:0/1057635156 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0013640 con 0x7fdae8069360 2023-10-10T21:20:30.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae815bcb0 con 0x7fdae8069360 2023-10-10T21:20:30.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.352+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae815c920 con 0x7fdae8069360 2023-10-10T21:20:30.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.353+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae804c3c0 con 0x7fdae8069360 2023-10-10T21:20:30.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.354+0000 7fdacf7fe700 1 -- 172.21.15.154:0/1057635156 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdae00139b0 con 0x7fdae8069360 2023-10-10T21:20:30.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.355+0000 7fdacf7fe700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdad4066f30 0x7fdad40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.355+0000 7fdacf7fe700 1 -- 172.21.15.154:0/1057635156 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fdae0085110 con 0x7fdae8069360 2023-10-10T21:20:30.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.355+0000 7fdae77fe700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdad4066f30 0x7fdad40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.356+0000 7fdae77fe700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdad4066f30 0x7fdad40693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdad80099c0 tx=0x7fdad801a000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:30.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.359+0000 7fdacf7fe700 1 -- 172.21.15.154:0/1057635156 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdae0052150 con 0x7fdae8069360 2023-10-10T21:20:30.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.589+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdae80b1d50 con 0x7fdae8069360 2023-10-10T21:20:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.590+0000 7fdacf7fe700 1 -- 172.21.15.154:0/1057635156 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fdae0055770 con 0x7fdae8069360 2023-10-10T21:20:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:30.592 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/909044943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":909044943},{"type":"v1","addr":"172.21.15.154:6834","nonce":909044943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/4163308288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":4163308288},{"type":"v1","addr":"172.21.15.179:6834","nonce":4163308288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7330,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3673994181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3673994181},{"type":"v1","addr":"172.21.15.179:6835","nonce":3673994181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:20:26.309607+0000","modified":"2023-10-10T21:20:30.131493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7677},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7677":{"gid":7677,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1893020718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1893020718},{"type":"v1","addr":"172.21.15.154:6837","nonce":1893020718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-10T21:20:30.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdad4066f30 msgr2=0x7fdad40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdad4066f30 0x7fdad40693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdad80099c0 tx=0x7fdad801a000 comp rx=0 tx=0).stop 2023-10-10T21:20:30.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae8069360 msgr2=0x7fdae80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae8069360 0x7fdae80697d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdae00013d0 tx=0x7fdae0002140 comp rx=0 tx=0).stop 2023-10-10T21:20:30.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 shutdown_connections 2023-10-10T21:20:30.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdae8069360 0x7fdae80697d0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdad4066f30 0x7fdad40693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdad0003ae0 0x7fdae8145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 --2- 172.21.15.154:0/1057635156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdae815c4b0 0x7fdae8150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.592+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 >> 172.21.15.154:0/1057635156 conn(0x7fdae80d0660 msgr2=0x7fdae80b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:30.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.593+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 shutdown_connections 2023-10-10T21:20:30.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.593+0000 7fdaec99d700 1 -- 172.21.15.154:0/1057635156 wait complete. 2023-10-10T21:20:30.596 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 54 2023-10-10T21:20:30.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:20:30.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.793+0000 7f60da3ff700 1 Processor -- start 2023-10-10T21:20:30.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.793+0000 7f60da3ff700 1 -- start start 2023-10-10T21:20:30.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.795+0000 7f60da3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60d40b1420 0x7f60d40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.795+0000 7f60da3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ccf90 0x7f60d40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.795+0000 7f60da3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d40cc300 con 0x7f60d40cbf30 2023-10-10T21:20:30.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.795+0000 7f60da3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d4156bf0 con 0x7f60d40b1420 2023-10-10T21:20:30.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.795+0000 7f60da3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d40ae950 con 0x7f60d40ccf90 2023-10-10T21:20:30.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.795+0000 7f60cbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60d40b1420 0x7f60d40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.795+0000 7f60cbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60d40b1420 0x7f60d40ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33352/0 (socket says 172.21.15.154:33352) 2023-10-10T21:20:30.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.795+0000 7f60cbfff700 1 -- 172.21.15.154:0/1439435572 learned_addr learned my addr 172.21.15.154:0/1439435572 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:30.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.795+0000 7f60d899c700 1 --2- 172.21.15.154:0/1439435572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ccf90 0x7f60d40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.796+0000 7f60cbfff700 1 -- 172.21.15.154:0/1439435572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ccf90 msgr2=0x7f60d40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:30.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.796+0000 7f60cbfff700 1 --2- 172.21.15.154:0/1439435572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ccf90 0x7f60d40c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.796+0000 7f60cbfff700 1 -- 172.21.15.154:0/1439435572 >> v1:172.21.15.179:6789/0 conn(0x7f60d40cbf30 legacy=0x7f60d40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.796+0000 7f60cbfff700 1 -- 172.21.15.154:0/1439435572 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40ad370 con 0x7f60d40b1420 2023-10-10T21:20:30.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.796+0000 7f60d899c700 1 --2- 172.21.15.154:0/1439435572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ccf90 0x7f60d40c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:30.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.796+0000 7f60cbfff700 1 --2- 172.21.15.154:0/1439435572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40b1420 0x7f60d40ae410 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00bc80 tx=0x7f60bc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8554c6a2ef782e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:30.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.796+0000 7f60d37fe700 1 -- 172.21.15.154:0/1439435572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00be90 con 0x7f60d40b1420 2023-10-10T21:20:30.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.796+0000 7f60d37fe700 1 -- 172.21.15.154:0/1439435572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc00ddc0 con 0x7f60d40b1420 2023-10-10T21:20:30.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.796+0000 7f60d37fe700 1 -- 172.21.15.154:0/1439435572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0196b0 con 0x7f60d40b1420 2023-10-10T21:20:30.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.797+0000 7f60da3ff700 1 -- 172.21.15.154:0/1439435572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40b1420 msgr2=0x7f60d40ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.797+0000 7f60da3ff700 1 --2- 172.21.15.154:0/1439435572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40b1420 0x7f60d40ae410 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00bc80 tx=0x7f60bc00b4f0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.797+0000 7f60da3ff700 1 -- 172.21.15.154:0/1439435572 shutdown_connections 2023-10-10T21:20:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.797+0000 7f60da3ff700 1 --2- 172.21.15.154:0/1439435572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ccf90 0x7f60d40c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.797+0000 7f60da3ff700 1 --2- 172.21.15.154:0/1439435572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40b1420 0x7f60d40ae410 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.797+0000 7f60da3ff700 1 -- 172.21.15.154:0/1439435572 >> 172.21.15.154:0/1439435572 conn(0x7f60d406a320 msgr2=0x7f60d40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.797+0000 7f60da3ff700 1 -- 172.21.15.154:0/1439435572 shutdown_connections 2023-10-10T21:20:30.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.797+0000 7f60da3ff700 1 -- 172.21.15.154:0/1439435572 wait complete. 2023-10-10T21:20:30.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.798+0000 7f60da3ff700 1 Processor -- start 2023-10-10T21:20:30.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.798+0000 7f60da3ff700 1 -- start start 2023-10-10T21:20:30.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.799+0000 7f60da3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d40b1420 0x7f60d414a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.799+0000 7f60da3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40cbf30 0x7f60d416b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.799+0000 7f60da3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40ccf90 0x7f60d4169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.799+0000 7f60da3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d416b630 con 0x7f60d40ccf90 2023-10-10T21:20:30.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.799+0000 7f60da3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d40c1770 con 0x7f60d40b1420 2023-10-10T21:20:30.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.799+0000 7f60da3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d416aec0 con 0x7f60d40cbf30 2023-10-10T21:20:30.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40ccf90 0x7f60d4169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40ccf90 0x7f60d4169f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33362/0 (socket says 172.21.15.154:33362) 2023-10-10T21:20:30.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d899c700 1 -- 172.21.15.154:0/1248928048 learned_addr learned my addr 172.21.15.154:0/1248928048 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:30.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60cbfff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40cbf30 0x7f60d416b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d3fff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d40b1420 0x7f60d414a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d899c700 1 -- 172.21.15.154:0/1248928048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40cbf30 msgr2=0x7f60d416b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d899c700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40cbf30 0x7f60d416b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d899c700 1 -- 172.21.15.154:0/1248928048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d40b1420 msgr2=0x7f60d414a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:30.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d899c700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d40b1420 0x7f60d414a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:30.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d899c700 1 -- 172.21.15.154:0/1248928048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc00b790 con 0x7f60d40ccf90 2023-10-10T21:20:30.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d899c700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40ccf90 0x7f60d4169f90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009fc0 tx=0x7f60cc0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:30.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d0ff9700 1 -- 172.21.15.154:0/1248928048 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00dd40 con 0x7f60d40ccf90 2023-10-10T21:20:30.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.800+0000 7f60d0ff9700 1 -- 172.21.15.154:0/1248928048 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc00f040 con 0x7f60d40ccf90 2023-10-10T21:20:30.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.801+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d416a900 con 0x7f60d40ccf90 2023-10-10T21:20:30.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.801+0000 7f60d0ff9700 1 -- 172.21.15.154:0/1248928048 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc015690 con 0x7f60d40ccf90 2023-10-10T21:20:30.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.801+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d40c1400 con 0x7f60d40ccf90 2023-10-10T21:20:30.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.802+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d404c3c0 con 0x7f60d40ccf90 2023-10-10T21:20:30.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.802+0000 7f60d0ff9700 1 -- 172.21.15.154:0/1248928048 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60cc01e3b0 con 0x7f60d40ccf90 2023-10-10T21:20:30.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.803+0000 7f60d0ff9700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f60b4066f30 0x7f60b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:30.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.804+0000 7f60d0ff9700 1 -- 172.21.15.154:0/1248928048 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f60cc084cb0 con 0x7f60d40ccf90 2023-10-10T21:20:30.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.804+0000 7f60d3fff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f60b4066f30 0x7f60b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:30.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.804+0000 7f60d3fff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f60b4066f30 0x7f60b40693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60c40037c0 tx=0x7f60c4009040 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:30.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.807+0000 7f60d0ff9700 1 -- 172.21.15.154:0/1248928048 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60cc051cf0 con 0x7f60d40ccf90 2023-10-10T21:20:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.998+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60d40ad650 con 0x7f60d40ccf90 2023-10-10T21:20:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:30.999+0000 7f60d0ff9700 1 -- 172.21.15.154:0/1248928048 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16007 (secure 0 0 0) 0x7f60cc01a090 con 0x7f60d40ccf90 2023-10-10T21:20:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:31.001 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":124,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:20:27.842584+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:20:24.012206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-10T21:20:25.295138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:20:31.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.001+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f60b4066f30 msgr2=0x7f60b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.001+0000 7f60da3ff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f60b4066f30 0x7f60b40693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60c40037c0 tx=0x7f60c4009040 comp rx=0 tx=0).stop 2023-10-10T21:20:31.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40ccf90 msgr2=0x7f60d4169f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40ccf90 0x7f60d4169f90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009fc0 tx=0x7f60cc0099b0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 shutdown_connections 2023-10-10T21:20:31.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d40ccf90 0x7f60d4169f90 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d40b1420 0x7f60d414a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f60b4066f30 0x7f60b40693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 --2- 172.21.15.154:0/1248928048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40cbf30 0x7f60d416b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 >> 172.21.15.154:0/1248928048 conn(0x7f60d406a320 msgr2=0x7f60d40caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:31.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 shutdown_connections 2023-10-10T21:20:31.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.002+0000 7f60da3ff700 1 -- 172.21.15.154:0/1248928048 wait complete. 2023-10-10T21:20:31.021 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T21:20:31.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:20:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.204+0000 7f65eaf9d700 1 Processor -- start 2023-10-10T21:20:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.204+0000 7f65eaf9d700 1 -- start start 2023-10-10T21:20:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65eaf9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65e4150180 0x7f65e4157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65eaf9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f65e40c7410 0x7f65e4069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65eaf9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e406e2a0 con 0x7f65e4150550 2023-10-10T21:20:31.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65eaf9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e406b2e0 con 0x7f65e4150180 2023-10-10T21:20:31.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65eaf9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e40c78e0 con 0x7f65e40c7410 2023-10-10T21:20:31.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65e9f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65e4150180 0x7f65e4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65e9f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65e4150180 0x7f65e4157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33372/0 (socket says 172.21.15.154:33372) 2023-10-10T21:20:31.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65e9f9b700 1 -- 172.21.15.154:0/3229998540 learned_addr learned my addr 172.21.15.154:0/3229998540 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:31.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65e979a700 1 --1- 172.21.15.154:0/3229998540 >> v1:172.21.15.154:6789/0 conn(0x7f65e4150550 0x7f65e40c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43194/0 (socket says 172.21.15.154:43194) 2023-10-10T21:20:31.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65ea79c700 1 --2- 172.21.15.154:0/3229998540 >> v2:172.21.15.179:3300/0 conn(0x7f65e40c7410 0x7f65e4069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65e9f9b700 1 -- 172.21.15.154:0/3229998540 >> v2:172.21.15.179:3300/0 conn(0x7f65e40c7410 msgr2=0x7f65e4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:31.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65e9f9b700 1 --2- 172.21.15.154:0/3229998540 >> v2:172.21.15.179:3300/0 conn(0x7f65e40c7410 0x7f65e4069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65e9f9b700 1 -- 172.21.15.154:0/3229998540 >> v1:172.21.15.154:6789/0 conn(0x7f65e4150550 legacy=0x7f65e40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65e9f9b700 1 -- 172.21.15.154:0/3229998540 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40c7bc0 con 0x7f65e4150180 2023-10-10T21:20:31.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.206+0000 7f65e8f99700 1 -- 172.21.15.154:0/3229998540 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613947035 0 0) 0x7f65e406e2a0 con 0x7f65e4150550 2023-10-10T21:20:31.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.207+0000 7f65e9f9b700 1 --2- 172.21.15.154:0/3229998540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 0x7f65e4157770 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f65e4156270 tx=0x7f65e000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d412657eb997af server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.207+0000 7f65e8f99700 1 -- 172.21.15.154:0/3229998540 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000b750 con 0x7f65e4150180 2023-10-10T21:20:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.207+0000 7f65e8f99700 1 -- 172.21.15.154:0/3229998540 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e000b8b0 con 0x7f65e4150180 2023-10-10T21:20:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.207+0000 7f65e8f99700 1 -- 172.21.15.154:0/3229998540 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000bc50 con 0x7f65e4150180 2023-10-10T21:20:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.207+0000 7f65eaf9d700 1 -- 172.21.15.154:0/3229998540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 msgr2=0x7f65e4157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.207+0000 7f65eaf9d700 1 --2- 172.21.15.154:0/3229998540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 0x7f65e4157770 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f65e4156270 tx=0x7f65e000a330 comp rx=0 tx=0).stop 2023-10-10T21:20:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.208+0000 7f65eaf9d700 1 -- 172.21.15.154:0/3229998540 shutdown_connections 2023-10-10T21:20:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.208+0000 7f65eaf9d700 1 --2- 172.21.15.154:0/3229998540 >> v2:172.21.15.179:3300/0 conn(0x7f65e40c7410 0x7f65e4069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.208+0000 7f65eaf9d700 1 --2- 172.21.15.154:0/3229998540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 0x7f65e4157770 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.208+0000 7f65eaf9d700 1 -- 172.21.15.154:0/3229998540 >> 172.21.15.154:0/3229998540 conn(0x7f65e40cc1f0 msgr2=0x7f65e40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.208+0000 7f65eaf9d700 1 -- 172.21.15.154:0/3229998540 shutdown_connections 2023-10-10T21:20:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.208+0000 7f65eaf9d700 1 -- 172.21.15.154:0/3229998540 wait complete. 2023-10-10T21:20:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.209+0000 7f65eaf9d700 1 Processor -- start 2023-10-10T21:20:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.209+0000 7f65eaf9d700 1 -- start start 2023-10-10T21:20:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65eaf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e40c7410 0x7f65e414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65eaf9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 0x7f65e40b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65eaf9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4150550 0x7f65e40c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65eaf9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e416b010 con 0x7f65e4150180 2023-10-10T21:20:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65eaf9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40aca80 con 0x7f65e4150550 2023-10-10T21:20:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65eaf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40ad320 con 0x7f65e40c7410 2023-10-10T21:20:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65e979a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 0x7f65e40b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65e979a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 0x7f65e40b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33384/0 (socket says 172.21.15.154:33384) 2023-10-10T21:20:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65e979a700 1 -- 172.21.15.154:0/2661528855 learned_addr learned my addr 172.21.15.154:0/2661528855 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65ea79c700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4150550 0x7f65e40c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.210+0000 7f65e9f9b700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e40c7410 0x7f65e414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65e979a700 1 -- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e40c7410 msgr2=0x7f65e414a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65e979a700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e40c7410 0x7f65e414a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65e979a700 1 -- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4150550 msgr2=0x7f65e40c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65e979a700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4150550 0x7f65e40c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65e979a700 1 -- 172.21.15.154:0/2661528855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e000a590 con 0x7f65e4150180 2023-10-10T21:20:31.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65ea79c700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4150550 0x7f65e40c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:31.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65e9f9b700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e40c7410 0x7f65e414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:31.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65e979a700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 0x7f65e40b0720 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f65d400c810 tx=0x7f65d4007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:31.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65d9ffb700 1 -- 172.21.15.154:0/2661528855 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d40063d0 con 0x7f65e4150180 2023-10-10T21:20:31.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65d9ffb700 1 -- 172.21.15.154:0/2661528855 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d4006530 con 0x7f65e4150180 2023-10-10T21:20:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65d9ffb700 1 -- 172.21.15.154:0/2661528855 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4004a60 con 0x7f65e4150180 2023-10-10T21:20:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e40b1070 con 0x7f65e4150180 2023-10-10T21:20:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.211+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e40acfb0 con 0x7f65e4150180 2023-10-10T21:20:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.212+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e40c3170 con 0x7f65e4150180 2023-10-10T21:20:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.213+0000 7f65d9ffb700 1 -- 172.21.15.154:0/2661528855 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65d401b400 con 0x7f65e4150180 2023-10-10T21:20:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.214+0000 7f65d9ffb700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f65c8066f30 0x7f65c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.214+0000 7f65d9ffb700 1 -- 172.21.15.154:0/2661528855 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f65d4084240 con 0x7f65e4150180 2023-10-10T21:20:31.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.214+0000 7f65e9f9b700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f65c8066f30 0x7f65c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.215+0000 7f65e9f9b700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f65c8066f30 0x7f65c80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65e4156270 tx=0x7f65e0019000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:31.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.218+0000 7f65d9ffb700 1 -- 172.21.15.154:0/2661528855 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65d4051300 con 0x7f65e4150180 2023-10-10T21:20:31.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.406+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 --> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65e40ad490 con 0x7f65c8066f30 2023-10-10T21:20:31.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.416+0000 7f65d9ffb700 1 -- 172.21.15.154:0/2661528855 <== mgr.6383 v2:172.21.15.154:6835/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274252 (secure 0 0 0) 0x7f65e40ad490 con 0x7f65c8066f30 2023-10-10T21:20:31.421 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f65c8066f30 msgr2=0x7f65c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f65c8066f30 0x7f65c80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65e4156270 tx=0x7f65e0019000 comp rx=0 tx=0).stop 2023-10-10T21:20:31.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 msgr2=0x7f65e40b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 0x7f65e40b0720 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f65d400c810 tx=0x7f65d4007de0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 shutdown_connections 2023-10-10T21:20:31.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4150550 0x7f65e40c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f65c8066f30 0x7f65c80693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e40c7410 0x7f65e414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 --2- 172.21.15.154:0/2661528855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4150180 0x7f65e40b0720 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 >> 172.21.15.154:0/2661528855 conn(0x7f65e40cc1f0 msgr2=0x7f65e4158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 shutdown_connections 2023-10-10T21:20:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.420+0000 7f65eaf9d700 1 -- 172.21.15.154:0/2661528855 wait complete. 2023-10-10T21:20:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:20:31.439 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-10T21:20:29.785995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2440168,"kb_used_data":12712,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752534552,"statfs":{"total":773094113280,"available":770595381248,"internally_reserved":0,"allocated":13017088,"data_stored":6933160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.959307"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:25.826219+0000","last_change":"2023-10-10T21:20:25.826219+0000","last_active":"2023-10-10T21:20:25.826219+0000","last_peered":"2023-10-10T21:20:25.826219+0000","last_clean":"2023-10-10T21:20:25.826219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:25.826219+0000","last_undegraded":"2023-10-10T21:20:25.826219+0000","last_fullsized":"2023-10-10T21:20:25.826219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:20:24.819481+0000","last_change":"2023-10-10T21:20:24.819481+0000","last_active":"2023-10-10T21:20:24.819481+0000","last_peered":"2023-10-10T21:20:24.819481+0000","last_clean":"2023-10-10T21:20:24.819481+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:20:24.819481+0000","last_undegraded":"2023-10-10T21:20:24.819481+0000","last_fullsized":"2023-10-10T21:20:24.819481+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"114'227","reported_seq":638,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-10-10T21:20:17.063219+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:20:17.063219+0000","last_peered":"2023-10-10T21:20:17.063219+0000","last_clean":"2023-10-10T21:20:17.063219+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:20:17.063219+0000","last_undegraded":"2023-10-10T21:20:17.063219+0000","last_fullsized":"2023-10-10T21:20:17.063219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542360,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303408,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068432,"statfs":{"total":96636764160,"available":96326074368,"internally_reserved":0,"allocated":2072576,"data_stored":1309421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65600000000000003,"15min":0.69299999999999995},"min":{"1min":0.44800000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.1859999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68000000000000005,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.495}]},{"osd":1,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68200000000000005,"15min":0.71499999999999997},"min":{"1min":0.50800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.68100000000000005}]},{"osd":2,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.58199999999999996,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.62},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":1.012,"5min":1.012,"15min":1.2929999999999999},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:19:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.73799999999999999},"min":{"1min":0.48499999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81000000000000005,"5min":1.1539999999999999,"15min":1.2669999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.016,"5min":1.016,"15min":1.4139999999999999},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86099999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67000000000000004,"15min":0.67500000000000004},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.41099999999999998},"max":{"1min":0.85499999999999998,"5min":1.212,"15min":1.212},"last":0.92200000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0029999999999999,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.58299999999999996,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":0.995,"5min":1.264,"15min":1.264},"last":0.86799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542359,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302828,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069012,"statfs":{"total":96636764160,"available":96326668288,"internally_reserved":0,"allocated":1478656,"data_stored":719053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65700000000000003,"15min":0.69299999999999995},"min":{"1min":0.47099999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.0189999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.70099999999999996},"min":{"1min":0.40400000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.1040000000000001},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.60499999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97699999999999998,"5min":1.0129999999999999,"15min":1.03},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.98699999999999999,"15min":1.073},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65900000000000003,"15min":0.69399999999999995},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90000000000000002,"5min":0.95399999999999996,"15min":0.98199999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69699999999999995,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54200000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.47499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0309999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.48699999999999999,"15min":0.48199999999999998},"max":{"1min":0.94999999999999996,"5min":1.042,"15min":1.042},"last":0.621}]},{"osd":4,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.87,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38900000000000001},"max":{"1min":0.81799999999999995,"5min":0.86499999999999999,"15min":0.97199999999999998},"last":0.40699999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65500000000000003,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.94399999999999995,"15min":1.022},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65700000000000003,"15min":0.65800000000000003},"min":{"1min":0.40300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.47099999999999997,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.80400000000000005,"5min":0.94499999999999995,"15min":1.0629999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.71899999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46400000000000002},"max":{"1min":0.83999999999999997,"5min":1.002,"15min":1.0289999999999999},"last":0.64000000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542359,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302828,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069012,"statfs":{"total":96636764160,"available":96326668288,"internally_reserved":0,"allocated":1478656,"data_stored":719053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.53800000000000003,"15min":0.48699999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.69999999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.61299999999999999,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":0.71599999999999997,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.498}]},{"osd":2,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":2.254,"15min":2.254},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51900000000000002,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.57999999999999996},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69799999999999995,"5min":0.999,"15min":0.999},"last":0.52900000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98999999999999999,"5min":4.806,"15min":4.806},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.75900000000000001},"min":{"1min":0.53500000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":6.968,"15min":6.968},"last":0.626},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.87,"15min":0.82499999999999996},"min":{"1min":0.55900000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93500000000000005,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.58599999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77600000000000002,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0620000000000001,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80800000000000005,"15min":0.83599999999999997},"min":{"1min":0.61699999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.78100000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.84799999999999998,"15min":0.80900000000000005},"min":{"1min":0.54100000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.014,"5min":12.026,"15min":12.026},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.80800000000000005,"15min":0.81799999999999995},"min":{"1min":0.58699999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.006,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.80900000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542361,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299312,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072528,"statfs":{"total":96636764160,"available":96330268672,"internally_reserved":0,"allocated":2072576,"data_stored":1309421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47499999999999998,"15min":0.48299999999999998},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.28799999999999998},"max":{"1min":0.624,"5min":0.74399999999999999,"15min":0.752},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.505,"15min":0.52200000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.875,"5min":0.879,"15min":0.91800000000000004},"last":0.53600000000000003}]},{"osd":2,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.52500000000000002},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.68799999999999994,"5min":0.72699999999999998,"15min":0.82099999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.56200000000000006},"min":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63}]},{"osd":3,"last update":"Tue Oct 10 21:19:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.30399999999999999},"max":{"1min":0.69099999999999995,"5min":0.85999999999999999,"15min":0.90300000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57899999999999996,"15min":0.60499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40300000000000002},"max":{"1min":0.78100000000000003,"5min":0.81599999999999995,"15min":0.874},"last":0.56399999999999995}]},{"osd":4,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.74099999999999999,"15min":0.78000000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.04,"5min":1.0660000000000001,"15min":1.1080000000000001},"last":1.03},{"interface":"front","average":{"1min":0.755,"5min":0.72299999999999998,"15min":0.76400000000000001},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.47699999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.1879999999999999},"last":0.83699999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.748,"15min":0.79300000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.2190000000000001},"last":1.075},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.75,"15min":0.78400000000000003},"min":{"1min":0.60499999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99399999999999999,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.94099999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79300000000000004,"15min":0.82599999999999996},"min":{"1min":0.61699999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":1.008},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.79800000000000004,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.143},"last":0.98399999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.77600000000000002,"15min":0.81499999999999995},"min":{"1min":0.59599999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.109,"5min":1.139,"15min":1.169},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77600000000000002,"15min":0.82399999999999995},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.165},"last":1.0549999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542361,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311020,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060820,"statfs":{"total":96636764160,"available":96318279680,"internally_reserved":0,"allocated":1478656,"data_stored":719053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44600000000000001,"15min":0.46100000000000002},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.61699999999999999,"5min":0.75,"15min":0.95699999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.50800000000000001},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71499999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.41899999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28699999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.437},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.53800000000000003},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66100000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.75},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.94799999999999995,"5min":1.157,"15min":1.3109999999999999},"last":0.62},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.57899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":1.26,"15min":1.26},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75600000000000001,"15min":0.78500000000000003},"min":{"1min":0.54900000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.03,"5min":2.21,"15min":2.21},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.745,"15min":0.77300000000000002},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96499999999999997,"5min":1.165,"15min":1.268},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.754,"15min":0.80500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.008,"5min":1.0509999999999999,"15min":1.3080000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.58699999999999997,"5min":0.504,"15min":0.504},"max":{"1min":1.042,"5min":1.345,"15min":1.345},"last":0.69899999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76000000000000001,"15min":0.79800000000000004},"min":{"1min":0.55200000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.016,"5min":1.716,"15min":1.716},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.747,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96299999999999997,"5min":1.006,"15min":1.2330000000000001},"last":0.68400000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509656,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306924,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064916,"statfs":{"total":96636764160,"available":96322473984,"internally_reserved":0,"allocated":1478656,"data_stored":719053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.27900000000000003},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.83099999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.496},"min":{"1min":0.33600000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66200000000000003,"5min":0.77000000000000002,"15min":0.84399999999999997},"last":0.373}]},{"osd":1,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.496},"min":{"1min":0.317,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":0.68300000000000005,"5min":0.87,"15min":0.87},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.52900000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48399999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.58299999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.92200000000000004},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.745,"15min":0.77100000000000002},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1200000000000001,"15min":1.3440000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.78600000000000003},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.433},"max":{"1min":1.012,"5min":1.1339999999999999,"15min":1.246},"last":0.57799999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.58999999999999997,"5min":0.54900000000000004,"15min":0.503},"max":{"1min":0.90300000000000002,"5min":1.21,"15min":1.262},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.621,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":0.91300000000000003,"5min":1.2250000000000001,"15min":1.228},"last":0.625}]},{"osd":6,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.79000000000000004},"min":{"1min":0.64700000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93999999999999995,"5min":1.081,"15min":1.27},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78300000000000003,"15min":0.80200000000000005},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92000000000000004,"5min":1.0780000000000001,"15min":1.224},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79100000000000004},"min":{"1min":0.57199999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":0.96399999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79100000000000004,"15min":0.81999999999999995},"min":{"1min":0.67100000000000004,"5min":0.501,"15min":0.501},"max":{"1min":0.97699999999999998,"5min":1.228,"15min":1.3200000000000001},"last":0.68000000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542361,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311020,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060820,"statfs":{"total":96636764160,"available":96318279680,"internally_reserved":0,"allocated":1478656,"data_stored":719053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65400000000000003,"15min":0.69399999999999995},"min":{"1min":0.56299999999999994,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.871,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.318,"15min":0.318},"max":{"1min":0.87,"5min":1.121,"15min":1.5029999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71999999999999997,"15min":0.747},"min":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1859999999999999,"15min":1.47},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81599999999999995,"5min":1.155,"15min":1.155},"last":0.48499999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70799999999999996,"15min":0.748},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":1.002,"15min":1.536},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68799999999999994,"15min":0.70999999999999996},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":0.90300000000000002,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.45700000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.745},"min":{"1min":0.55400000000000005,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93500000000000005,"5min":1.2330000000000001,"15min":1.397},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68899999999999995,"15min":0.71999999999999997},"min":{"1min":0.60899999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85099999999999998,"5min":1.0800000000000001,"15min":1.385},"last":0.52500000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.621,"15min":0.625},"min":{"1min":0.436,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85499999999999998,"5min":1,"15min":1.196},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65800000000000003,"15min":0.66100000000000003},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78200000000000003,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.216},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70999999999999996,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.88500000000000001,"5min":1.006,"15min":1.2390000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69099999999999995,"15min":0.68600000000000005},"min":{"1min":0.47699999999999998,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.84699999999999998,"5min":1.034,"15min":1.4139999999999999},"last":0.57899999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542359,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302828,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069012,"statfs":{"total":96636764160,"available":96326668288,"internally_reserved":0,"allocated":1478656,"data_stored":719053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.68700000000000006},"min":{"1min":0.42399999999999999,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.91600000000000004,"15min":0.95399999999999996},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66800000000000004,"15min":0.70899999999999996},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.89100000000000001,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65800000000000003,"15min":0.68400000000000005},"min":{"1min":0.48399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.97299999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66300000000000003,"15min":0.71099999999999997},"min":{"1min":0.48199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.018},"last":0.89800000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66700000000000004,"15min":0.70699999999999996},"min":{"1min":0.51600000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68300000000000005,"15min":0.71099999999999997},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.72299999999999998},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0720000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70699999999999996,"15min":0.74399999999999999},"min":{"1min":0.51400000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.044},"last":0.63700000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.59499999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2110000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.64500000000000002,"15min":0.63200000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95099999999999996,"5min":1.496,"15min":1.496},"last":0.58699999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.46000000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.626},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.97799999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.51600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:20:31.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:20:31.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.660+0000 7ffbcd7ff700 1 Processor -- start 2023-10-10T21:20:31.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.660+0000 7ffbcd7ff700 1 -- start start 2023-10-10T21:20:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.661+0000 7ffbcd7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffbc806c0a0 0x7ffbc80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.661+0000 7ffbcd7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffbc815df50 0x7ffbc815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.661+0000 7ffbcd7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc815d7e0 con 0x7ffbc806bcd0 2023-10-10T21:20:31.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.661+0000 7ffbcd7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc815dac0 con 0x7ffbc806c0a0 2023-10-10T21:20:31.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.661+0000 7ffbcd7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc815aa30 con 0x7ffbc815df50 2023-10-10T21:20:31.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffbc806c0a0 0x7ffbc80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffbc806c0a0 0x7ffbc80caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33388/0 (socket says 172.21.15.154:33388) 2023-10-10T21:20:31.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc67fc700 1 -- 172.21.15.154:0/459876456 learned_addr learned my addr 172.21.15.154:0/459876456 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:31.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc77fe700 1 --2- 172.21.15.154:0/459876456 >> v2:172.21.15.179:3300/0 conn(0x7ffbc815df50 0x7ffbc815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc67fc700 1 -- 172.21.15.154:0/459876456 >> v2:172.21.15.179:3300/0 conn(0x7ffbc815df50 msgr2=0x7ffbc815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:31.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc67fc700 1 --2- 172.21.15.154:0/459876456 >> v2:172.21.15.179:3300/0 conn(0x7ffbc815df50 0x7ffbc815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc67fc700 1 -- 172.21.15.154:0/459876456 >> v1:172.21.15.179:6789/0 conn(0x7ffbc806bcd0 legacy=0x7ffbc815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc67fc700 1 -- 172.21.15.154:0/459876456 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc815ad10 con 0x7ffbc806c0a0 2023-10-10T21:20:31.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc5ffb700 1 -- 172.21.15.154:0/459876456 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819096426 0 0) 0x7ffbc815d7e0 con 0x7ffbc806bcd0 2023-10-10T21:20:31.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.662+0000 7ffbc67fc700 1 --2- 172.21.15.154:0/459876456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc806c0a0 0x7ffbc80caa90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ffbc815d720 tx=0x7ffbbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1ad6778781e3f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:31.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbc5ffb700 1 -- 172.21.15.154:0/459876456 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc009e70 con 0x7ffbc806c0a0 2023-10-10T21:20:31.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbc5ffb700 1 -- 172.21.15.154:0/459876456 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc00b860 con 0x7ffbc806c0a0 2023-10-10T21:20:31.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbc5ffb700 1 -- 172.21.15.154:0/459876456 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc00bc20 con 0x7ffbc806c0a0 2023-10-10T21:20:31.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/459876456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc806c0a0 msgr2=0x7ffbc80caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbcd7ff700 1 --2- 172.21.15.154:0/459876456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc806c0a0 0x7ffbc80caa90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ffbc815d720 tx=0x7ffbbc009250 comp rx=0 tx=0).stop 2023-10-10T21:20:31.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/459876456 shutdown_connections 2023-10-10T21:20:31.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbcd7ff700 1 --2- 172.21.15.154:0/459876456 >> v2:172.21.15.179:3300/0 conn(0x7ffbc815df50 0x7ffbc815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbcd7ff700 1 --2- 172.21.15.154:0/459876456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc806c0a0 0x7ffbc80caa90 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/459876456 >> 172.21.15.154:0/459876456 conn(0x7ffbc80ce600 msgr2=0x7ffbc80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:31.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/459876456 shutdown_connections 2023-10-10T21:20:31.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.663+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/459876456 wait complete. 2023-10-10T21:20:31.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.665+0000 7ffbcd7ff700 1 Processor -- start 2023-10-10T21:20:31.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.665+0000 7ffbcd7ff700 1 -- start start 2023-10-10T21:20:31.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbcd7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc806bcd0 0x7ffbc8148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbcd7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc806c0a0 0x7ffbc80c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbcd7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc815df50 0x7ffbc80c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbcd7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8148880 con 0x7ffbc815df50 2023-10-10T21:20:31.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbcd7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc814a700 con 0x7ffbc806c0a0 2023-10-10T21:20:31.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbcd7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc814a9a0 con 0x7ffbc806bcd0 2023-10-10T21:20:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbc77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc815df50 0x7ffbc80c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbc77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc815df50 0x7ffbc80c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33402/0 (socket says 172.21.15.154:33402) 2023-10-10T21:20:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbc77fe700 1 -- 172.21.15.154:0/4187989757 learned_addr learned my addr 172.21.15.154:0/4187989757 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbc67fc700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc806c0a0 0x7ffbc80c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.666+0000 7ffbc6ffd700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc806bcd0 0x7ffbc8148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbc77fe700 1 -- 172.21.15.154:0/4187989757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc806bcd0 msgr2=0x7ffbc8148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbc77fe700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc806bcd0 0x7ffbc8148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbc77fe700 1 -- 172.21.15.154:0/4187989757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc806c0a0 msgr2=0x7ffbc80c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbc77fe700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc806c0a0 0x7ffbc80c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbc77fe700 1 -- 172.21.15.154:0/4187989757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0094f0 con 0x7ffbc815df50 2023-10-10T21:20:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbc77fe700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc815df50 0x7ffbc80c6ca0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009df0 tx=0x7ffbc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbaeffd700 1 -- 172.21.15.154:0/4187989757 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000cb30 con 0x7ffbc815df50 2023-10-10T21:20:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbaeffd700 1 -- 172.21.15.154:0/4187989757 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000f040 con 0x7ffbc815df50 2023-10-10T21:20:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc814ac80 con 0x7ffbc815df50 2023-10-10T21:20:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbaeffd700 1 -- 172.21.15.154:0/4187989757 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0014480 con 0x7ffbc815df50 2023-10-10T21:20:31.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.667+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc814b240 con 0x7ffbc815df50 2023-10-10T21:20:31.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.668+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc804c3c0 con 0x7ffbc815df50 2023-10-10T21:20:31.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.669+0000 7ffbaeffd700 1 -- 172.21.15.154:0/4187989757 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbc00147f0 con 0x7ffbc815df50 2023-10-10T21:20:31.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.670+0000 7ffbaeffd700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ffbb4066f30 0x7ffbb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:31.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.670+0000 7ffbaeffd700 1 -- 172.21.15.154:0/4187989757 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ffbc0085330 con 0x7ffbc815df50 2023-10-10T21:20:31.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.670+0000 7ffbc6ffd700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ffbb4066f30 0x7ffbb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:31.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.671+0000 7ffbc6ffd700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ffbb4066f30 0x7ffbb40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8003960 tx=0x7ffbb8007ea0 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:31.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.674+0000 7ffbaeffd700 1 -- 172.21.15.154:0/4187989757 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbc0052370 con 0x7ffbc815df50 2023-10-10T21:20:31.809 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-10-10T21:20:31.808+0000 7fef3adf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:20:31.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.861+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 --> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffbc815aff0 con 0x7ffbb4066f30 2023-10-10T21:20:31.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.870+0000 7ffbaeffd700 1 -- 172.21.15.154:0/4187989757 <== mgr.6383 v2:172.21.15.154:6835/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289389 (secure 0 0 0) 0x7ffbc815aff0 con 0x7ffbb4066f30 2023-10-10T21:20:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:31.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ffbb4066f30 msgr2=0x7ffbb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ffbb4066f30 0x7ffbb40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8003960 tx=0x7ffbb8007ea0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc815df50 msgr2=0x7ffbc80c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:31.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc815df50 0x7ffbc80c6ca0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009df0 tx=0x7ffbc000b040 comp rx=0 tx=0).stop 2023-10-10T21:20:31.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 shutdown_connections 2023-10-10T21:20:31.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbc815df50 0x7ffbc80c6ca0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ffbb4066f30 0x7ffbb40693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc806bcd0 0x7ffbc8148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 --2- 172.21.15.154:0/4187989757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc806c0a0 0x7ffbc80c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:31.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 >> 172.21.15.154:0/4187989757 conn(0x7ffbc80ce600 msgr2=0x7ffbc80c4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:31.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 shutdown_connections 2023-10-10T21:20:31.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:31.874+0000 7ffbcd7ff700 1 -- 172.21.15.154:0/4187989757 wait complete. 2023-10-10T21:20:31.881 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:20:31.892 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:20:31.786328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448796,"kb_used_data":13148,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752525924,"statfs":{"total":773094113280,"available":770586546176,"internally_reserved":0,"allocated":13463552,"data_stored":7144588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001231"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.859145+0000","last_change":"2023-10-10T21:20:26.856852+0000","last_active":"2023-10-10T21:20:26.859145+0000","last_peered":"2023-10-10T21:20:26.859145+0000","last_clean":"2023-10-10T21:20:26.859145+0000","last_became_active":"2023-10-10T21:20:26.855712+0000","last_became_peered":"2023-10-10T21:20:26.855712+0000","last_unstale":"2023-10-10T21:20:26.859145+0000","last_undegraded":"2023-10-10T21:20:26.859145+0000","last_fullsized":"2023-10-10T21:20:26.859145+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:18:02.067936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.858242+0000","last_change":"2023-10-10T21:20:26.856619+0000","last_active":"2023-10-10T21:20:26.858242+0000","last_peered":"2023-10-10T21:20:26.858242+0000","last_clean":"2023-10-10T21:20:26.858242+0000","last_became_active":"2023-10-10T21:20:26.856346+0000","last_became_peered":"2023-10-10T21:20:26.856346+0000","last_unstale":"2023-10-10T21:20:26.858242+0000","last_undegraded":"2023-10-10T21:20:26.858242+0000","last_fullsized":"2023-10-10T21:20:26.858242+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:05:10.070110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.859030+0000","last_change":"2023-10-10T21:20:26.856874+0000","last_active":"2023-10-10T21:20:26.859030+0000","last_peered":"2023-10-10T21:20:26.859030+0000","last_clean":"2023-10-10T21:20:26.859030+0000","last_became_active":"2023-10-10T21:20:26.856602+0000","last_became_peered":"2023-10-10T21:20:26.856602+0000","last_unstale":"2023-10-10T21:20:26.859030+0000","last_undegraded":"2023-10-10T21:20:26.859030+0000","last_fullsized":"2023-10-10T21:20:26.859030+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:46:28.983855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.867953+0000","last_change":"2023-10-10T21:20:26.865135+0000","last_active":"2023-10-10T21:20:26.867953+0000","last_peered":"2023-10-10T21:20:26.867953+0000","last_clean":"2023-10-10T21:20:26.867953+0000","last_became_active":"2023-10-10T21:20:26.864857+0000","last_became_peered":"2023-10-10T21:20:26.864857+0000","last_unstale":"2023-10-10T21:20:26.867953+0000","last_undegraded":"2023-10-10T21:20:26.867953+0000","last_fullsized":"2023-10-10T21:20:26.867953+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:16:43.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868238+0000","last_change":"2023-10-10T21:20:26.864384+0000","last_active":"2023-10-10T21:20:26.868238+0000","last_peered":"2023-10-10T21:20:26.868238+0000","last_clean":"2023-10-10T21:20:26.868238+0000","last_became_active":"2023-10-10T21:20:26.863995+0000","last_became_peered":"2023-10-10T21:20:26.863995+0000","last_unstale":"2023-10-10T21:20:26.868238+0000","last_undegraded":"2023-10-10T21:20:26.868238+0000","last_fullsized":"2023-10-10T21:20:26.868238+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:14:33.093696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.870329+0000","last_change":"2023-10-10T21:20:26.868047+0000","last_active":"2023-10-10T21:20:26.870329+0000","last_peered":"2023-10-10T21:20:26.870329+0000","last_clean":"2023-10-10T21:20:26.870329+0000","last_became_active":"2023-10-10T21:20:26.867782+0000","last_became_peered":"2023-10-10T21:20:26.867782+0000","last_unstale":"2023-10-10T21:20:26.870329+0000","last_undegraded":"2023-10-10T21:20:26.870329+0000","last_fullsized":"2023-10-10T21:20:26.870329+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:14:53.624048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868429+0000","last_change":"2023-10-10T21:20:26.864284+0000","last_active":"2023-10-10T21:20:26.868429+0000","last_peered":"2023-10-10T21:20:26.868429+0000","last_clean":"2023-10-10T21:20:26.868429+0000","last_became_active":"2023-10-10T21:20:26.863996+0000","last_became_peered":"2023-10-10T21:20:26.863996+0000","last_unstale":"2023-10-10T21:20:26.868429+0000","last_undegraded":"2023-10-10T21:20:26.868429+0000","last_fullsized":"2023-10-10T21:20:26.868429+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:22.810370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.865683+0000","last_change":"2023-10-10T21:20:26.864198+0000","last_active":"2023-10-10T21:20:26.865683+0000","last_peered":"2023-10-10T21:20:26.865683+0000","last_clean":"2023-10-10T21:20:26.865683+0000","last_became_active":"2023-10-10T21:20:26.863936+0000","last_became_peered":"2023-10-10T21:20:26.863936+0000","last_unstale":"2023-10-10T21:20:26.865683+0000","last_undegraded":"2023-10-10T21:20:26.865683+0000","last_fullsized":"2023-10-10T21:20:26.865683+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:54:41.513989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.871637+0000","last_change":"2023-10-10T21:20:26.868945+0000","last_active":"2023-10-10T21:20:26.871637+0000","last_peered":"2023-10-10T21:20:26.871637+0000","last_clean":"2023-10-10T21:20:26.871637+0000","last_became_active":"2023-10-10T21:20:26.868561+0000","last_became_peered":"2023-10-10T21:20:26.868561+0000","last_unstale":"2023-10-10T21:20:26.871637+0000","last_undegraded":"2023-10-10T21:20:26.871637+0000","last_fullsized":"2023-10-10T21:20:26.871637+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:40:00.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.859924+0000","last_change":"2023-10-10T21:20:26.853860+0000","last_active":"2023-10-10T21:20:26.859924+0000","last_peered":"2023-10-10T21:20:26.859924+0000","last_clean":"2023-10-10T21:20:26.859924+0000","last_became_active":"2023-10-10T21:20:26.853575+0000","last_became_peered":"2023-10-10T21:20:26.853575+0000","last_unstale":"2023-10-10T21:20:26.859924+0000","last_undegraded":"2023-10-10T21:20:26.859924+0000","last_fullsized":"2023-10-10T21:20:26.859924+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:14:53.624048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.871002+0000","last_change":"2023-10-10T21:20:26.869198+0000","last_active":"2023-10-10T21:20:26.871002+0000","last_peered":"2023-10-10T21:20:26.871002+0000","last_clean":"2023-10-10T21:20:26.871002+0000","last_became_active":"2023-10-10T21:20:26.868947+0000","last_became_peered":"2023-10-10T21:20:26.868947+0000","last_unstale":"2023-10-10T21:20:26.871002+0000","last_undegraded":"2023-10-10T21:20:26.871002+0000","last_fullsized":"2023-10-10T21:20:26.871002+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:32.009477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.870634+0000","last_change":"2023-10-10T21:20:26.862992+0000","last_active":"2023-10-10T21:20:26.870634+0000","last_peered":"2023-10-10T21:20:26.870634+0000","last_clean":"2023-10-10T21:20:26.870634+0000","last_became_active":"2023-10-10T21:20:26.861749+0000","last_became_peered":"2023-10-10T21:20:26.861749+0000","last_unstale":"2023-10-10T21:20:26.870634+0000","last_undegraded":"2023-10-10T21:20:26.870634+0000","last_fullsized":"2023-10-10T21:20:26.870634+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:59:48.872747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.867627+0000","last_change":"2023-10-10T21:20:26.862220+0000","last_active":"2023-10-10T21:20:26.867627+0000","last_peered":"2023-10-10T21:20:26.867627+0000","last_clean":"2023-10-10T21:20:26.867627+0000","last_became_active":"2023-10-10T21:20:26.861957+0000","last_became_peered":"2023-10-10T21:20:26.861957+0000","last_unstale":"2023-10-10T21:20:26.867627+0000","last_undegraded":"2023-10-10T21:20:26.867627+0000","last_fullsized":"2023-10-10T21:20:26.867627+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:03:18.480938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.862662+0000","last_change":"2023-10-10T21:20:26.858522+0000","last_active":"2023-10-10T21:20:26.862662+0000","last_peered":"2023-10-10T21:20:26.862662+0000","last_clean":"2023-10-10T21:20:26.862662+0000","last_became_active":"2023-10-10T21:20:26.858258+0000","last_became_peered":"2023-10-10T21:20:26.858258+0000","last_unstale":"2023-10-10T21:20:26.862662+0000","last_undegraded":"2023-10-10T21:20:26.862662+0000","last_fullsized":"2023-10-10T21:20:26.862662+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:24:37.881745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.867654+0000","last_change":"2023-10-10T21:20:26.862557+0000","last_active":"2023-10-10T21:20:26.867654+0000","last_peered":"2023-10-10T21:20:26.867654+0000","last_clean":"2023-10-10T21:20:26.867654+0000","last_became_active":"2023-10-10T21:20:26.862319+0000","last_became_peered":"2023-10-10T21:20:26.862319+0000","last_unstale":"2023-10-10T21:20:26.867654+0000","last_undegraded":"2023-10-10T21:20:26.867654+0000","last_fullsized":"2023-10-10T21:20:26.867654+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:38:03.489780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868545+0000","last_change":"2023-10-10T21:20:26.864303+0000","last_active":"2023-10-10T21:20:26.868545+0000","last_peered":"2023-10-10T21:20:26.868545+0000","last_clean":"2023-10-10T21:20:26.868545+0000","last_became_active":"2023-10-10T21:20:26.863977+0000","last_became_peered":"2023-10-10T21:20:26.863977+0000","last_unstale":"2023-10-10T21:20:26.868545+0000","last_undegraded":"2023-10-10T21:20:26.868545+0000","last_fullsized":"2023-10-10T21:20:26.868545+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:46:26.454124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.871403+0000","last_change":"2023-10-10T21:20:26.867197+0000","last_active":"2023-10-10T21:20:26.871403+0000","last_peered":"2023-10-10T21:20:26.871403+0000","last_clean":"2023-10-10T21:20:26.871403+0000","last_became_active":"2023-10-10T21:20:26.866118+0000","last_became_peered":"2023-10-10T21:20:26.866118+0000","last_unstale":"2023-10-10T21:20:26.871403+0000","last_undegraded":"2023-10-10T21:20:26.871403+0000","last_fullsized":"2023-10-10T21:20:26.871403+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:30:11.809576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868135+0000","last_change":"2023-10-10T21:20:26.865516+0000","last_active":"2023-10-10T21:20:26.868135+0000","last_peered":"2023-10-10T21:20:26.868135+0000","last_clean":"2023-10-10T21:20:26.868135+0000","last_became_active":"2023-10-10T21:20:26.865228+0000","last_became_peered":"2023-10-10T21:20:26.865228+0000","last_unstale":"2023-10-10T21:20:26.868135+0000","last_undegraded":"2023-10-10T21:20:26.868135+0000","last_fullsized":"2023-10-10T21:20:26.868135+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:38:10.321527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.862658+0000","last_change":"2023-10-10T21:20:26.859249+0000","last_active":"2023-10-10T21:20:26.862658+0000","last_peered":"2023-10-10T21:20:26.862658+0000","last_clean":"2023-10-10T21:20:26.862658+0000","last_became_active":"2023-10-10T21:20:26.858947+0000","last_became_peered":"2023-10-10T21:20:26.858947+0000","last_unstale":"2023-10-10T21:20:26.862658+0000","last_undegraded":"2023-10-10T21:20:26.862658+0000","last_fullsized":"2023-10-10T21:20:26.862658+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:45:21.321100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.870817+0000","last_change":"2023-10-10T21:20:26.865431+0000","last_active":"2023-10-10T21:20:26.870817+0000","last_peered":"2023-10-10T21:20:26.870817+0000","last_clean":"2023-10-10T21:20:26.870817+0000","last_became_active":"2023-10-10T21:20:26.864984+0000","last_became_peered":"2023-10-10T21:20:26.864984+0000","last_unstale":"2023-10-10T21:20:26.870817+0000","last_undegraded":"2023-10-10T21:20:26.870817+0000","last_fullsized":"2023-10-10T21:20:26.870817+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:50:02.705214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.862762+0000","last_change":"2023-10-10T21:20:26.861175+0000","last_active":"2023-10-10T21:20:26.862762+0000","last_peered":"2023-10-10T21:20:26.862762+0000","last_clean":"2023-10-10T21:20:26.862762+0000","last_became_active":"2023-10-10T21:20:26.859543+0000","last_became_peered":"2023-10-10T21:20:26.859543+0000","last_unstale":"2023-10-10T21:20:26.862762+0000","last_undegraded":"2023-10-10T21:20:26.862762+0000","last_fullsized":"2023-10-10T21:20:26.862762+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:43:31.488069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.859037+0000","last_change":"2023-10-10T21:20:26.857015+0000","last_active":"2023-10-10T21:20:26.859037+0000","last_peered":"2023-10-10T21:20:26.859037+0000","last_clean":"2023-10-10T21:20:26.859037+0000","last_became_active":"2023-10-10T21:20:26.856714+0000","last_became_peered":"2023-10-10T21:20:26.856714+0000","last_unstale":"2023-10-10T21:20:26.859037+0000","last_undegraded":"2023-10-10T21:20:26.859037+0000","last_fullsized":"2023-10-10T21:20:26.859037+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:40:00.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.857702+0000","last_change":"2023-10-10T21:20:26.855312+0000","last_active":"2023-10-10T21:20:26.857702+0000","last_peered":"2023-10-10T21:20:26.857702+0000","last_clean":"2023-10-10T21:20:26.857702+0000","last_became_active":"2023-10-10T21:20:26.855051+0000","last_became_peered":"2023-10-10T21:20:26.855051+0000","last_unstale":"2023-10-10T21:20:26.857702+0000","last_undegraded":"2023-10-10T21:20:26.857702+0000","last_fullsized":"2023-10-10T21:20:26.857702+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:32.009477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868566+0000","last_change":"2023-10-10T21:20:26.866161+0000","last_active":"2023-10-10T21:20:26.868566+0000","last_peered":"2023-10-10T21:20:26.868566+0000","last_clean":"2023-10-10T21:20:26.868566+0000","last_became_active":"2023-10-10T21:20:26.865835+0000","last_became_peered":"2023-10-10T21:20:26.865835+0000","last_unstale":"2023-10-10T21:20:26.868566+0000","last_undegraded":"2023-10-10T21:20:26.868566+0000","last_fullsized":"2023-10-10T21:20:26.868566+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:14:33.093696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.853260+0000","last_change":"2023-10-10T21:20:26.850391+0000","last_active":"2023-10-10T21:20:26.853260+0000","last_peered":"2023-10-10T21:20:26.853260+0000","last_clean":"2023-10-10T21:20:26.853260+0000","last_became_active":"2023-10-10T21:20:26.850096+0000","last_became_peered":"2023-10-10T21:20:26.850096+0000","last_unstale":"2023-10-10T21:20:26.853260+0000","last_undegraded":"2023-10-10T21:20:26.853260+0000","last_fullsized":"2023-10-10T21:20:26.853260+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:40:00.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.856192+0000","last_change":"2023-10-10T21:20:26.853505+0000","last_active":"2023-10-10T21:20:26.856192+0000","last_peered":"2023-10-10T21:20:26.856192+0000","last_clean":"2023-10-10T21:20:26.856192+0000","last_became_active":"2023-10-10T21:20:26.853250+0000","last_became_peered":"2023-10-10T21:20:26.853250+0000","last_unstale":"2023-10-10T21:20:26.856192+0000","last_undegraded":"2023-10-10T21:20:26.856192+0000","last_fullsized":"2023-10-10T21:20:26.856192+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:50.124901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868550+0000","last_change":"2023-10-10T21:20:26.865026+0000","last_active":"2023-10-10T21:20:26.868550+0000","last_peered":"2023-10-10T21:20:26.868550+0000","last_clean":"2023-10-10T21:20:26.868550+0000","last_became_active":"2023-10-10T21:20:26.864772+0000","last_became_peered":"2023-10-10T21:20:26.864772+0000","last_unstale":"2023-10-10T21:20:26.868550+0000","last_undegraded":"2023-10-10T21:20:26.868550+0000","last_fullsized":"2023-10-10T21:20:26.868550+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:50.124901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.867540+0000","last_change":"2023-10-10T21:20:26.862299+0000","last_active":"2023-10-10T21:20:26.867540+0000","last_peered":"2023-10-10T21:20:26.867540+0000","last_clean":"2023-10-10T21:20:26.867540+0000","last_became_active":"2023-10-10T21:20:26.862028+0000","last_became_peered":"2023-10-10T21:20:26.862028+0000","last_unstale":"2023-10-10T21:20:26.867540+0000","last_undegraded":"2023-10-10T21:20:26.867540+0000","last_fullsized":"2023-10-10T21:20:26.867540+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:50.124901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.854385+0000","last_change":"2023-10-10T21:20:26.853488+0000","last_active":"2023-10-10T21:20:26.854385+0000","last_peered":"2023-10-10T21:20:26.854385+0000","last_clean":"2023-10-10T21:20:26.854385+0000","last_became_active":"2023-10-10T21:20:26.853206+0000","last_became_peered":"2023-10-10T21:20:26.853206+0000","last_unstale":"2023-10-10T21:20:26.854385+0000","last_undegraded":"2023-10-10T21:20:26.854385+0000","last_fullsized":"2023-10-10T21:20:26.854385+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:46:26.454124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.869843+0000","last_change":"2023-10-10T21:20:26.864366+0000","last_active":"2023-10-10T21:20:26.869843+0000","last_peered":"2023-10-10T21:20:26.869843+0000","last_clean":"2023-10-10T21:20:26.869843+0000","last_became_active":"2023-10-10T21:20:26.863369+0000","last_became_peered":"2023-10-10T21:20:26.863369+0000","last_unstale":"2023-10-10T21:20:26.869843+0000","last_undegraded":"2023-10-10T21:20:26.869843+0000","last_fullsized":"2023-10-10T21:20:26.869843+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:05:53.585613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868819+0000","last_change":"2023-10-10T21:20:26.866406+0000","last_active":"2023-10-10T21:20:26.868819+0000","last_peered":"2023-10-10T21:20:26.868819+0000","last_clean":"2023-10-10T21:20:26.868819+0000","last_became_active":"2023-10-10T21:20:26.866130+0000","last_became_peered":"2023-10-10T21:20:26.866130+0000","last_unstale":"2023-10-10T21:20:26.868819+0000","last_undegraded":"2023-10-10T21:20:26.868819+0000","last_fullsized":"2023-10-10T21:20:26.868819+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:44:01.710076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.858761+0000","last_change":"2023-10-10T21:20:26.854785+0000","last_active":"2023-10-10T21:20:26.858761+0000","last_peered":"2023-10-10T21:20:26.858761+0000","last_clean":"2023-10-10T21:20:26.858761+0000","last_became_active":"2023-10-10T21:20:26.854372+0000","last_became_peered":"2023-10-10T21:20:26.854372+0000","last_unstale":"2023-10-10T21:20:26.858761+0000","last_undegraded":"2023-10-10T21:20:26.858761+0000","last_fullsized":"2023-10-10T21:20:26.858761+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:51:16.273837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.869500+0000","last_change":"2023-10-10T21:20:26.863532+0000","last_active":"2023-10-10T21:20:26.869500+0000","last_peered":"2023-10-10T21:20:26.869500+0000","last_clean":"2023-10-10T21:20:26.869500+0000","last_became_active":"2023-10-10T21:20:26.863232+0000","last_became_peered":"2023-10-10T21:20:26.863232+0000","last_unstale":"2023-10-10T21:20:26.869500+0000","last_undegraded":"2023-10-10T21:20:26.869500+0000","last_fullsized":"2023-10-10T21:20:26.869500+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:34.169433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"123'4","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.129701+0000","last_change":"2023-10-10T21:20:25.849038+0000","last_active":"2023-10-10T21:20:27.129701+0000","last_peered":"2023-10-10T21:20:27.129701+0000","last_clean":"2023-10-10T21:20:27.129701+0000","last_became_active":"2023-10-10T21:20:25.845997+0000","last_became_peered":"2023-10-10T21:20:25.845997+0000","last_unstale":"2023-10-10T21:20:27.129701+0000","last_undegraded":"2023-10-10T21:20:27.129701+0000","last_fullsized":"2023-10-10T21:20:27.129701+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:04:10.174953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868165+0000","last_change":"2023-10-10T21:20:26.865352+0000","last_active":"2023-10-10T21:20:26.868165+0000","last_peered":"2023-10-10T21:20:26.868165+0000","last_clean":"2023-10-10T21:20:26.868165+0000","last_became_active":"2023-10-10T21:20:26.865091+0000","last_became_peered":"2023-10-10T21:20:26.865091+0000","last_unstale":"2023-10-10T21:20:26.868165+0000","last_undegraded":"2023-10-10T21:20:26.868165+0000","last_fullsized":"2023-10-10T21:20:26.868165+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:02.186283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.129691+0000","last_change":"2023-10-10T21:20:25.851501+0000","last_active":"2023-10-10T21:20:27.129691+0000","last_peered":"2023-10-10T21:20:27.129691+0000","last_clean":"2023-10-10T21:20:27.129691+0000","last_became_active":"2023-10-10T21:20:25.851223+0000","last_became_peered":"2023-10-10T21:20:25.851223+0000","last_unstale":"2023-10-10T21:20:27.129691+0000","last_undegraded":"2023-10-10T21:20:27.129691+0000","last_fullsized":"2023-10-10T21:20:27.129691+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:57.798955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.865472+0000","last_change":"2023-10-10T21:20:26.862303+0000","last_active":"2023-10-10T21:20:26.865472+0000","last_peered":"2023-10-10T21:20:26.865472+0000","last_clean":"2023-10-10T21:20:26.865472+0000","last_became_active":"2023-10-10T21:20:26.862066+0000","last_became_peered":"2023-10-10T21:20:26.862066+0000","last_unstale":"2023-10-10T21:20:26.865472+0000","last_undegraded":"2023-10-10T21:20:26.865472+0000","last_fullsized":"2023-10-10T21:20:26.865472+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:49:41.881083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.128643+0000","last_change":"2023-10-10T21:20:25.851369+0000","last_active":"2023-10-10T21:20:27.128643+0000","last_peered":"2023-10-10T21:20:27.128643+0000","last_clean":"2023-10-10T21:20:27.128643+0000","last_became_active":"2023-10-10T21:20:25.849307+0000","last_became_peered":"2023-10-10T21:20:25.849307+0000","last_unstale":"2023-10-10T21:20:27.128643+0000","last_undegraded":"2023-10-10T21:20:27.128643+0000","last_fullsized":"2023-10-10T21:20:27.128643+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:52:48.429177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.871237+0000","last_change":"2023-10-10T21:20:26.865242+0000","last_active":"2023-10-10T21:20:26.871237+0000","last_peered":"2023-10-10T21:20:26.871237+0000","last_clean":"2023-10-10T21:20:26.871237+0000","last_became_active":"2023-10-10T21:20:26.861654+0000","last_became_peered":"2023-10-10T21:20:26.861654+0000","last_unstale":"2023-10-10T21:20:26.871237+0000","last_undegraded":"2023-10-10T21:20:26.871237+0000","last_fullsized":"2023-10-10T21:20:26.871237+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:22.810370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.128803+0000","last_change":"2023-10-10T21:20:25.843127+0000","last_active":"2023-10-10T21:20:27.128803+0000","last_peered":"2023-10-10T21:20:27.128803+0000","last_clean":"2023-10-10T21:20:27.128803+0000","last_became_active":"2023-10-10T21:20:25.842860+0000","last_became_peered":"2023-10-10T21:20:25.842860+0000","last_unstale":"2023-10-10T21:20:27.128803+0000","last_undegraded":"2023-10-10T21:20:27.128803+0000","last_fullsized":"2023-10-10T21:20:27.128803+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:48:32.343888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.867113+0000","last_change":"2023-10-10T21:20:26.862774+0000","last_active":"2023-10-10T21:20:26.867113+0000","last_peered":"2023-10-10T21:20:26.867113+0000","last_clean":"2023-10-10T21:20:26.867113+0000","last_became_active":"2023-10-10T21:20:26.862489+0000","last_became_peered":"2023-10-10T21:20:26.862489+0000","last_unstale":"2023-10-10T21:20:26.867113+0000","last_undegraded":"2023-10-10T21:20:26.867113+0000","last_fullsized":"2023-10-10T21:20:26.867113+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:58:55.130502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.129907+0000","last_change":"2023-10-10T21:20:25.850680+0000","last_active":"2023-10-10T21:20:27.129907+0000","last_peered":"2023-10-10T21:20:27.129907+0000","last_clean":"2023-10-10T21:20:27.129907+0000","last_became_active":"2023-10-10T21:20:25.850428+0000","last_became_peered":"2023-10-10T21:20:25.850428+0000","last_unstale":"2023-10-10T21:20:27.129907+0000","last_undegraded":"2023-10-10T21:20:27.129907+0000","last_fullsized":"2023-10-10T21:20:27.129907+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:56:12.580026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.867109+0000","last_change":"2023-10-10T21:20:26.862734+0000","last_active":"2023-10-10T21:20:26.867109+0000","last_peered":"2023-10-10T21:20:26.867109+0000","last_clean":"2023-10-10T21:20:26.867109+0000","last_became_active":"2023-10-10T21:20:26.862383+0000","last_became_peered":"2023-10-10T21:20:26.862383+0000","last_unstale":"2023-10-10T21:20:26.867109+0000","last_undegraded":"2023-10-10T21:20:26.867109+0000","last_fullsized":"2023-10-10T21:20:26.867109+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:50:02.705214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.129601+0000","last_change":"2023-10-10T21:20:25.848677+0000","last_active":"2023-10-10T21:20:27.129601+0000","last_peered":"2023-10-10T21:20:27.129601+0000","last_clean":"2023-10-10T21:20:27.129601+0000","last_became_active":"2023-10-10T21:20:25.848392+0000","last_became_peered":"2023-10-10T21:20:25.848392+0000","last_unstale":"2023-10-10T21:20:27.129601+0000","last_undegraded":"2023-10-10T21:20:27.129601+0000","last_fullsized":"2023-10-10T21:20:27.129601+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:10:51.360732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.862076+0000","last_change":"2023-10-10T21:20:26.858775+0000","last_active":"2023-10-10T21:20:26.862076+0000","last_peered":"2023-10-10T21:20:26.862076+0000","last_clean":"2023-10-10T21:20:26.862076+0000","last_became_active":"2023-10-10T21:20:26.858458+0000","last_became_peered":"2023-10-10T21:20:26.858458+0000","last_unstale":"2023-10-10T21:20:26.862076+0000","last_undegraded":"2023-10-10T21:20:26.862076+0000","last_fullsized":"2023-10-10T21:20:26.862076+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:17.069072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.847551+0000","last_change":"2023-10-10T21:20:25.854589+0000","last_active":"2023-10-10T21:20:26.847551+0000","last_peered":"2023-10-10T21:20:26.847551+0000","last_clean":"2023-10-10T21:20:26.847551+0000","last_became_active":"2023-10-10T21:20:25.854349+0000","last_became_peered":"2023-10-10T21:20:25.854349+0000","last_unstale":"2023-10-10T21:20:26.847551+0000","last_undegraded":"2023-10-10T21:20:26.847551+0000","last_fullsized":"2023-10-10T21:20:26.847551+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:52:48.429177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.870731+0000","last_change":"2023-10-10T21:20:26.860893+0000","last_active":"2023-10-10T21:20:26.870731+0000","last_peered":"2023-10-10T21:20:26.870731+0000","last_clean":"2023-10-10T21:20:26.870731+0000","last_became_active":"2023-10-10T21:20:26.860592+0000","last_became_peered":"2023-10-10T21:20:26.860592+0000","last_unstale":"2023-10-10T21:20:26.870731+0000","last_undegraded":"2023-10-10T21:20:26.870731+0000","last_fullsized":"2023-10-10T21:20:26.870731+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:33:17.584693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.850685+0000","last_change":"2023-10-10T21:20:25.853387+0000","last_active":"2023-10-10T21:20:26.850685+0000","last_peered":"2023-10-10T21:20:26.850685+0000","last_clean":"2023-10-10T21:20:26.850685+0000","last_became_active":"2023-10-10T21:20:25.853122+0000","last_became_peered":"2023-10-10T21:20:25.853122+0000","last_unstale":"2023-10-10T21:20:26.850685+0000","last_undegraded":"2023-10-10T21:20:26.850685+0000","last_fullsized":"2023-10-10T21:20:26.850685+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:33:19.607670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.871431+0000","last_change":"2023-10-10T21:20:26.867971+0000","last_active":"2023-10-10T21:20:26.871431+0000","last_peered":"2023-10-10T21:20:26.871431+0000","last_clean":"2023-10-10T21:20:26.871431+0000","last_became_active":"2023-10-10T21:20:26.867591+0000","last_became_peered":"2023-10-10T21:20:26.867591+0000","last_unstale":"2023-10-10T21:20:26.871431+0000","last_undegraded":"2023-10-10T21:20:26.871431+0000","last_fullsized":"2023-10-10T21:20:26.871431+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:22.810370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.851523+0000","last_change":"2023-10-10T21:20:25.852529+0000","last_active":"2023-10-10T21:20:26.851523+0000","last_peered":"2023-10-10T21:20:26.851523+0000","last_clean":"2023-10-10T21:20:26.851523+0000","last_became_active":"2023-10-10T21:20:25.852289+0000","last_became_peered":"2023-10-10T21:20:25.852289+0000","last_unstale":"2023-10-10T21:20:26.851523+0000","last_undegraded":"2023-10-10T21:20:26.851523+0000","last_fullsized":"2023-10-10T21:20:26.851523+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:04:26.648906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.870669+0000","last_change":"2023-10-10T21:20:26.863917+0000","last_active":"2023-10-10T21:20:26.870669+0000","last_peered":"2023-10-10T21:20:26.870669+0000","last_clean":"2023-10-10T21:20:26.870669+0000","last_became_active":"2023-10-10T21:20:26.863440+0000","last_became_peered":"2023-10-10T21:20:26.863440+0000","last_unstale":"2023-10-10T21:20:26.870669+0000","last_undegraded":"2023-10-10T21:20:26.870669+0000","last_fullsized":"2023-10-10T21:20:26.870669+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:14:53.624048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.859563+0000","last_change":"2023-10-10T21:20:25.855971+0000","last_active":"2023-10-10T21:20:26.859563+0000","last_peered":"2023-10-10T21:20:26.859563+0000","last_clean":"2023-10-10T21:20:26.859563+0000","last_became_active":"2023-10-10T21:20:25.855710+0000","last_became_peered":"2023-10-10T21:20:25.855710+0000","last_unstale":"2023-10-10T21:20:26.859563+0000","last_undegraded":"2023-10-10T21:20:26.859563+0000","last_fullsized":"2023-10-10T21:20:26.859563+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:41:46.136403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.853839+0000","last_change":"2023-10-10T21:20:26.852232+0000","last_active":"2023-10-10T21:20:26.853839+0000","last_peered":"2023-10-10T21:20:26.853839+0000","last_clean":"2023-10-10T21:20:26.853839+0000","last_became_active":"2023-10-10T21:20:26.851927+0000","last_became_peered":"2023-10-10T21:20:26.851927+0000","last_unstale":"2023-10-10T21:20:26.853839+0000","last_undegraded":"2023-10-10T21:20:26.853839+0000","last_fullsized":"2023-10-10T21:20:26.853839+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:55:32.923181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"123'3","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.128586+0000","last_change":"2023-10-10T21:20:25.851898+0000","last_active":"2023-10-10T21:20:27.128586+0000","last_peered":"2023-10-10T21:20:27.128586+0000","last_clean":"2023-10-10T21:20:27.128586+0000","last_became_active":"2023-10-10T21:20:25.851341+0000","last_became_peered":"2023-10-10T21:20:25.851341+0000","last_unstale":"2023-10-10T21:20:27.128586+0000","last_undegraded":"2023-10-10T21:20:27.128586+0000","last_fullsized":"2023-10-10T21:20:27.128586+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:17.035622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868568+0000","last_change":"2023-10-10T21:20:26.865541+0000","last_active":"2023-10-10T21:20:26.868568+0000","last_peered":"2023-10-10T21:20:26.868568+0000","last_clean":"2023-10-10T21:20:26.868568+0000","last_became_active":"2023-10-10T21:20:26.865280+0000","last_became_peered":"2023-10-10T21:20:26.865280+0000","last_unstale":"2023-10-10T21:20:26.868568+0000","last_undegraded":"2023-10-10T21:20:26.868568+0000","last_fullsized":"2023-10-10T21:20:26.868568+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:40:00.592449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"123'6","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.134427+0000","last_change":"2023-10-10T21:20:25.850196+0000","last_active":"2023-10-10T21:20:27.134427+0000","last_peered":"2023-10-10T21:20:27.134427+0000","last_clean":"2023-10-10T21:20:27.134427+0000","last_became_active":"2023-10-10T21:20:25.849856+0000","last_became_peered":"2023-10-10T21:20:25.849856+0000","last_unstale":"2023-10-10T21:20:27.134427+0000","last_undegraded":"2023-10-10T21:20:27.134427+0000","last_fullsized":"2023-10-10T21:20:27.134427+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:57.798955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.874109+0000","last_change":"2023-10-10T21:20:26.870427+0000","last_active":"2023-10-10T21:20:26.874109+0000","last_peered":"2023-10-10T21:20:26.874109+0000","last_clean":"2023-10-10T21:20:26.874109+0000","last_became_active":"2023-10-10T21:20:26.870152+0000","last_became_peered":"2023-10-10T21:20:26.870152+0000","last_unstale":"2023-10-10T21:20:26.874109+0000","last_undegraded":"2023-10-10T21:20:26.874109+0000","last_fullsized":"2023-10-10T21:20:26.874109+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:20:56.048225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.129073+0000","last_change":"2023-10-10T21:20:25.847723+0000","last_active":"2023-10-10T21:20:27.129073+0000","last_peered":"2023-10-10T21:20:27.129073+0000","last_clean":"2023-10-10T21:20:27.129073+0000","last_became_active":"2023-10-10T21:20:25.847463+0000","last_became_peered":"2023-10-10T21:20:25.847463+0000","last_unstale":"2023-10-10T21:20:27.129073+0000","last_undegraded":"2023-10-10T21:20:27.129073+0000","last_fullsized":"2023-10-10T21:20:27.129073+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:04:20.592939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.864288+0000","last_change":"2023-10-10T21:20:26.860897+0000","last_active":"2023-10-10T21:20:26.864288+0000","last_peered":"2023-10-10T21:20:26.864288+0000","last_clean":"2023-10-10T21:20:26.864288+0000","last_became_active":"2023-10-10T21:20:26.860617+0000","last_became_peered":"2023-10-10T21:20:26.860617+0000","last_unstale":"2023-10-10T21:20:26.864288+0000","last_undegraded":"2023-10-10T21:20:26.864288+0000","last_fullsized":"2023-10-10T21:20:26.864288+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:42:08.955745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.851964+0000","last_change":"2023-10-10T21:20:25.849592+0000","last_active":"2023-10-10T21:20:26.851964+0000","last_peered":"2023-10-10T21:20:26.851964+0000","last_clean":"2023-10-10T21:20:26.851964+0000","last_became_active":"2023-10-10T21:20:25.849306+0000","last_became_peered":"2023-10-10T21:20:25.849306+0000","last_unstale":"2023-10-10T21:20:26.851964+0000","last_undegraded":"2023-10-10T21:20:26.851964+0000","last_fullsized":"2023-10-10T21:20:26.851964+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:58:13.053536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.870710+0000","last_change":"2023-10-10T21:20:26.864452+0000","last_active":"2023-10-10T21:20:26.870710+0000","last_peered":"2023-10-10T21:20:26.870710+0000","last_clean":"2023-10-10T21:20:26.870710+0000","last_became_active":"2023-10-10T21:20:26.863225+0000","last_became_peered":"2023-10-10T21:20:26.863225+0000","last_unstale":"2023-10-10T21:20:26.870710+0000","last_undegraded":"2023-10-10T21:20:26.870710+0000","last_fullsized":"2023-10-10T21:20:26.870710+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:55:32.923181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.857664+0000","last_change":"2023-10-10T21:20:25.846058+0000","last_active":"2023-10-10T21:20:26.857664+0000","last_peered":"2023-10-10T21:20:26.857664+0000","last_clean":"2023-10-10T21:20:26.857664+0000","last_became_active":"2023-10-10T21:20:25.842033+0000","last_became_peered":"2023-10-10T21:20:25.842033+0000","last_unstale":"2023-10-10T21:20:26.857664+0000","last_undegraded":"2023-10-10T21:20:26.857664+0000","last_fullsized":"2023-10-10T21:20:26.857664+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:17.035622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.869896+0000","last_change":"2023-10-10T21:20:26.864196+0000","last_active":"2023-10-10T21:20:26.869896+0000","last_peered":"2023-10-10T21:20:26.869896+0000","last_clean":"2023-10-10T21:20:26.869896+0000","last_became_active":"2023-10-10T21:20:26.863796+0000","last_became_peered":"2023-10-10T21:20:26.863796+0000","last_unstale":"2023-10-10T21:20:26.869896+0000","last_undegraded":"2023-10-10T21:20:26.869896+0000","last_fullsized":"2023-10-10T21:20:26.869896+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:49:01.785368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"123'8","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.131007+0000","last_change":"2023-10-10T21:20:25.845188+0000","last_active":"2023-10-10T21:20:27.131007+0000","last_peered":"2023-10-10T21:20:27.131007+0000","last_clean":"2023-10-10T21:20:27.131007+0000","last_became_active":"2023-10-10T21:20:25.844950+0000","last_became_peered":"2023-10-10T21:20:25.844950+0000","last_unstale":"2023-10-10T21:20:27.131007+0000","last_undegraded":"2023-10-10T21:20:27.131007+0000","last_fullsized":"2023-10-10T21:20:27.131007+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:55.232277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868301+0000","last_change":"2023-10-10T21:20:26.862549+0000","last_active":"2023-10-10T21:20:26.868301+0000","last_peered":"2023-10-10T21:20:26.868301+0000","last_clean":"2023-10-10T21:20:26.868301+0000","last_became_active":"2023-10-10T21:20:26.861631+0000","last_became_peered":"2023-10-10T21:20:26.861631+0000","last_unstale":"2023-10-10T21:20:26.868301+0000","last_undegraded":"2023-10-10T21:20:26.868301+0000","last_fullsized":"2023-10-10T21:20:26.868301+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:44:22.810370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.128602+0000","last_change":"2023-10-10T21:20:25.848492+0000","last_active":"2023-10-10T21:20:27.128602+0000","last_peered":"2023-10-10T21:20:27.128602+0000","last_clean":"2023-10-10T21:20:27.128602+0000","last_became_active":"2023-10-10T21:20:25.847498+0000","last_became_peered":"2023-10-10T21:20:25.847498+0000","last_unstale":"2023-10-10T21:20:27.128602+0000","last_undegraded":"2023-10-10T21:20:27.128602+0000","last_fullsized":"2023-10-10T21:20:27.128602+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:23:32.374333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.854193+0000","last_change":"2023-10-10T21:20:26.852236+0000","last_active":"2023-10-10T21:20:26.854193+0000","last_peered":"2023-10-10T21:20:26.854193+0000","last_clean":"2023-10-10T21:20:26.854193+0000","last_became_active":"2023-10-10T21:20:26.851965+0000","last_became_peered":"2023-10-10T21:20:26.851965+0000","last_unstale":"2023-10-10T21:20:26.854193+0000","last_undegraded":"2023-10-10T21:20:26.854193+0000","last_fullsized":"2023-10-10T21:20:26.854193+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:47:15.358672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.128715+0000","last_change":"2023-10-10T21:20:25.845714+0000","last_active":"2023-10-10T21:20:27.128715+0000","last_peered":"2023-10-10T21:20:27.128715+0000","last_clean":"2023-10-10T21:20:27.128715+0000","last_became_active":"2023-10-10T21:20:25.845425+0000","last_became_peered":"2023-10-10T21:20:25.845425+0000","last_unstale":"2023-10-10T21:20:27.128715+0000","last_undegraded":"2023-10-10T21:20:27.128715+0000","last_fullsized":"2023-10-10T21:20:27.128715+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:57.798955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.874077+0000","last_change":"2023-10-10T21:20:26.871980+0000","last_active":"2023-10-10T21:20:26.874077+0000","last_peered":"2023-10-10T21:20:26.874077+0000","last_clean":"2023-10-10T21:20:26.874077+0000","last_became_active":"2023-10-10T21:20:26.871642+0000","last_became_peered":"2023-10-10T21:20:26.871642+0000","last_unstale":"2023-10-10T21:20:26.874077+0000","last_undegraded":"2023-10-10T21:20:26.874077+0000","last_fullsized":"2023-10-10T21:20:26.874077+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:38:28.859197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.844577+0000","last_change":"2023-10-10T21:20:25.843693+0000","last_active":"2023-10-10T21:20:26.844577+0000","last_peered":"2023-10-10T21:20:26.844577+0000","last_clean":"2023-10-10T21:20:26.844577+0000","last_became_active":"2023-10-10T21:20:25.843442+0000","last_became_peered":"2023-10-10T21:20:25.843442+0000","last_unstale":"2023-10-10T21:20:26.844577+0000","last_undegraded":"2023-10-10T21:20:26.844577+0000","last_fullsized":"2023-10-10T21:20:26.844577+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:17.035622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868219+0000","last_change":"2023-10-10T21:20:26.862551+0000","last_active":"2023-10-10T21:20:26.868219+0000","last_peered":"2023-10-10T21:20:26.868219+0000","last_clean":"2023-10-10T21:20:26.868219+0000","last_became_active":"2023-10-10T21:20:26.862298+0000","last_became_peered":"2023-10-10T21:20:26.862298+0000","last_unstale":"2023-10-10T21:20:26.868219+0000","last_undegraded":"2023-10-10T21:20:26.868219+0000","last_fullsized":"2023-10-10T21:20:26.868219+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:11:06.313586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.129888+0000","last_change":"2023-10-10T21:20:25.851197+0000","last_active":"2023-10-10T21:20:27.129888+0000","last_peered":"2023-10-10T21:20:27.129888+0000","last_clean":"2023-10-10T21:20:27.129888+0000","last_became_active":"2023-10-10T21:20:25.849325+0000","last_became_peered":"2023-10-10T21:20:25.849325+0000","last_unstale":"2023-10-10T21:20:27.129888+0000","last_undegraded":"2023-10-10T21:20:27.129888+0000","last_fullsized":"2023-10-10T21:20:27.129888+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:37:14.652377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.861968+0000","last_change":"2023-10-10T21:20:26.858717+0000","last_active":"2023-10-10T21:20:26.861968+0000","last_peered":"2023-10-10T21:20:26.861968+0000","last_clean":"2023-10-10T21:20:26.861968+0000","last_became_active":"2023-10-10T21:20:26.858333+0000","last_became_peered":"2023-10-10T21:20:26.858333+0000","last_unstale":"2023-10-10T21:20:26.861968+0000","last_undegraded":"2023-10-10T21:20:26.861968+0000","last_fullsized":"2023-10-10T21:20:26.861968+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:53:53.625708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.849123+0000","last_change":"2023-10-10T21:20:25.848932+0000","last_active":"2023-10-10T21:20:26.849123+0000","last_peered":"2023-10-10T21:20:26.849123+0000","last_clean":"2023-10-10T21:20:26.849123+0000","last_became_active":"2023-10-10T21:20:25.848610+0000","last_became_peered":"2023-10-10T21:20:25.848610+0000","last_unstale":"2023-10-10T21:20:26.849123+0000","last_undegraded":"2023-10-10T21:20:26.849123+0000","last_fullsized":"2023-10-10T21:20:26.849123+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:04:58.757084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.869858+0000","last_change":"2023-10-10T21:20:26.866715+0000","last_active":"2023-10-10T21:20:26.869858+0000","last_peered":"2023-10-10T21:20:26.869858+0000","last_clean":"2023-10-10T21:20:26.869858+0000","last_became_active":"2023-10-10T21:20:26.866472+0000","last_became_peered":"2023-10-10T21:20:26.866472+0000","last_unstale":"2023-10-10T21:20:26.869858+0000","last_undegraded":"2023-10-10T21:20:26.869858+0000","last_fullsized":"2023-10-10T21:20:26.869858+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:18.994492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.848985+0000","last_change":"2023-10-10T21:20:25.850123+0000","last_active":"2023-10-10T21:20:26.848985+0000","last_peered":"2023-10-10T21:20:26.848985+0000","last_clean":"2023-10-10T21:20:26.848985+0000","last_became_active":"2023-10-10T21:20:25.849846+0000","last_became_peered":"2023-10-10T21:20:25.849846+0000","last_unstale":"2023-10-10T21:20:26.848985+0000","last_undegraded":"2023-10-10T21:20:26.848985+0000","last_fullsized":"2023-10-10T21:20:26.848985+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:02:00.858835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.853999+0000","last_change":"2023-10-10T21:20:26.851285+0000","last_active":"2023-10-10T21:20:26.853999+0000","last_peered":"2023-10-10T21:20:26.853999+0000","last_clean":"2023-10-10T21:20:26.853999+0000","last_became_active":"2023-10-10T21:20:26.851020+0000","last_became_peered":"2023-10-10T21:20:26.851020+0000","last_unstale":"2023-10-10T21:20:26.853999+0000","last_undegraded":"2023-10-10T21:20:26.853999+0000","last_fullsized":"2023-10-10T21:20:26.853999+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:50:02.705214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.844368+0000","last_change":"2023-10-10T21:20:25.848245+0000","last_active":"2023-10-10T21:20:26.844368+0000","last_peered":"2023-10-10T21:20:26.844368+0000","last_clean":"2023-10-10T21:20:26.844368+0000","last_became_active":"2023-10-10T21:20:25.848000+0000","last_became_peered":"2023-10-10T21:20:25.848000+0000","last_unstale":"2023-10-10T21:20:26.844368+0000","last_undegraded":"2023-10-10T21:20:26.844368+0000","last_fullsized":"2023-10-10T21:20:26.844368+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:10.231541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.858259+0000","last_change":"2023-10-10T21:20:26.857085+0000","last_active":"2023-10-10T21:20:26.858259+0000","last_peered":"2023-10-10T21:20:26.858259+0000","last_clean":"2023-10-10T21:20:26.858259+0000","last_became_active":"2023-10-10T21:20:26.856408+0000","last_became_peered":"2023-10-10T21:20:26.856408+0000","last_unstale":"2023-10-10T21:20:26.858259+0000","last_undegraded":"2023-10-10T21:20:26.858259+0000","last_fullsized":"2023-10-10T21:20:26.858259+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:50:02.705214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.127564+0000","last_change":"2023-10-10T21:20:25.841694+0000","last_active":"2023-10-10T21:20:27.127564+0000","last_peered":"2023-10-10T21:20:27.127564+0000","last_clean":"2023-10-10T21:20:27.127564+0000","last_became_active":"2023-10-10T21:20:25.841438+0000","last_became_peered":"2023-10-10T21:20:25.841438+0000","last_unstale":"2023-10-10T21:20:27.127564+0000","last_undegraded":"2023-10-10T21:20:27.127564+0000","last_fullsized":"2023-10-10T21:20:27.127564+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:04.537456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.865451+0000","last_change":"2023-10-10T21:20:26.861687+0000","last_active":"2023-10-10T21:20:26.865451+0000","last_peered":"2023-10-10T21:20:26.865451+0000","last_clean":"2023-10-10T21:20:26.865451+0000","last_became_active":"2023-10-10T21:20:26.861390+0000","last_became_peered":"2023-10-10T21:20:26.861390+0000","last_unstale":"2023-10-10T21:20:26.865451+0000","last_undegraded":"2023-10-10T21:20:26.865451+0000","last_fullsized":"2023-10-10T21:20:26.865451+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:31:35.330091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.845446+0000","last_change":"2023-10-10T21:20:25.851016+0000","last_active":"2023-10-10T21:20:26.845446+0000","last_peered":"2023-10-10T21:20:26.845446+0000","last_clean":"2023-10-10T21:20:26.845446+0000","last_became_active":"2023-10-10T21:20:25.849746+0000","last_became_peered":"2023-10-10T21:20:25.849746+0000","last_unstale":"2023-10-10T21:20:26.845446+0000","last_undegraded":"2023-10-10T21:20:26.845446+0000","last_fullsized":"2023-10-10T21:20:26.845446+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:57.798955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.858823+0000","last_change":"2023-10-10T21:20:26.855008+0000","last_active":"2023-10-10T21:20:26.858823+0000","last_peered":"2023-10-10T21:20:26.858823+0000","last_clean":"2023-10-10T21:20:26.858823+0000","last_became_active":"2023-10-10T21:20:26.854487+0000","last_became_peered":"2023-10-10T21:20:26.854487+0000","last_unstale":"2023-10-10T21:20:26.858823+0000","last_undegraded":"2023-10-10T21:20:26.858823+0000","last_fullsized":"2023-10-10T21:20:26.858823+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:43.517751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.844699+0000","last_change":"2023-10-10T21:20:25.840879+0000","last_active":"2023-10-10T21:20:26.844699+0000","last_peered":"2023-10-10T21:20:26.844699+0000","last_clean":"2023-10-10T21:20:26.844699+0000","last_became_active":"2023-10-10T21:20:25.840633+0000","last_became_peered":"2023-10-10T21:20:25.840633+0000","last_unstale":"2023-10-10T21:20:26.844699+0000","last_undegraded":"2023-10-10T21:20:26.844699+0000","last_fullsized":"2023-10-10T21:20:26.844699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:03:57.933049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868261+0000","last_change":"2023-10-10T21:20:26.861212+0000","last_active":"2023-10-10T21:20:26.868261+0000","last_peered":"2023-10-10T21:20:26.868261+0000","last_clean":"2023-10-10T21:20:26.868261+0000","last_became_active":"2023-10-10T21:20:26.860927+0000","last_became_peered":"2023-10-10T21:20:26.860927+0000","last_unstale":"2023-10-10T21:20:26.868261+0000","last_undegraded":"2023-10-10T21:20:26.868261+0000","last_fullsized":"2023-10-10T21:20:26.868261+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:38:28.859197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.847432+0000","last_change":"2023-10-10T21:20:25.847191+0000","last_active":"2023-10-10T21:20:26.847432+0000","last_peered":"2023-10-10T21:20:26.847432+0000","last_clean":"2023-10-10T21:20:26.847432+0000","last_became_active":"2023-10-10T21:20:25.846940+0000","last_became_peered":"2023-10-10T21:20:25.846940+0000","last_unstale":"2023-10-10T21:20:26.847432+0000","last_undegraded":"2023-10-10T21:20:26.847432+0000","last_fullsized":"2023-10-10T21:20:26.847432+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:23:32.374333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.869863+0000","last_change":"2023-10-10T21:20:26.864179+0000","last_active":"2023-10-10T21:20:26.869863+0000","last_peered":"2023-10-10T21:20:26.869863+0000","last_clean":"2023-10-10T21:20:26.869863+0000","last_became_active":"2023-10-10T21:20:26.863899+0000","last_became_peered":"2023-10-10T21:20:26.863899+0000","last_unstale":"2023-10-10T21:20:26.869863+0000","last_undegraded":"2023-10-10T21:20:26.869863+0000","last_fullsized":"2023-10-10T21:20:26.869863+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:37:09.531585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.844860+0000","last_change":"2023-10-10T21:20:25.851988+0000","last_active":"2023-10-10T21:20:26.844860+0000","last_peered":"2023-10-10T21:20:26.844860+0000","last_clean":"2023-10-10T21:20:26.844860+0000","last_became_active":"2023-10-10T21:20:25.851615+0000","last_became_peered":"2023-10-10T21:20:25.851615+0000","last_unstale":"2023-10-10T21:20:26.844860+0000","last_undegraded":"2023-10-10T21:20:26.844860+0000","last_fullsized":"2023-10-10T21:20:26.844860+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:00.165148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.870720+0000","last_change":"2023-10-10T21:20:26.864850+0000","last_active":"2023-10-10T21:20:26.870720+0000","last_peered":"2023-10-10T21:20:26.870720+0000","last_clean":"2023-10-10T21:20:26.870720+0000","last_became_active":"2023-10-10T21:20:26.864562+0000","last_became_peered":"2023-10-10T21:20:26.864562+0000","last_unstale":"2023-10-10T21:20:26.870720+0000","last_undegraded":"2023-10-10T21:20:26.870720+0000","last_fullsized":"2023-10-10T21:20:26.870720+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:14:33.093696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.846306+0000","last_change":"2023-10-10T21:20:25.848135+0000","last_active":"2023-10-10T21:20:26.846306+0000","last_peered":"2023-10-10T21:20:26.846306+0000","last_clean":"2023-10-10T21:20:26.846306+0000","last_became_active":"2023-10-10T21:20:25.847883+0000","last_became_peered":"2023-10-10T21:20:25.847883+0000","last_unstale":"2023-10-10T21:20:26.846306+0000","last_undegraded":"2023-10-10T21:20:26.846306+0000","last_fullsized":"2023-10-10T21:20:26.846306+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:17.035622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868207+0000","last_change":"2023-10-10T21:20:26.862409+0000","last_active":"2023-10-10T21:20:26.868207+0000","last_peered":"2023-10-10T21:20:26.868207+0000","last_clean":"2023-10-10T21:20:26.868207+0000","last_became_active":"2023-10-10T21:20:26.862139+0000","last_became_peered":"2023-10-10T21:20:26.862139+0000","last_unstale":"2023-10-10T21:20:26.868207+0000","last_undegraded":"2023-10-10T21:20:26.868207+0000","last_fullsized":"2023-10-10T21:20:26.868207+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:25.227984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.860057+0000","last_change":"2023-10-10T21:20:25.854764+0000","last_active":"2023-10-10T21:20:26.860057+0000","last_peered":"2023-10-10T21:20:26.860057+0000","last_clean":"2023-10-10T21:20:26.860057+0000","last_became_active":"2023-10-10T21:20:25.854485+0000","last_became_peered":"2023-10-10T21:20:25.854485+0000","last_unstale":"2023-10-10T21:20:26.860057+0000","last_undegraded":"2023-10-10T21:20:26.860057+0000","last_fullsized":"2023-10-10T21:20:26.860057+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:10.403465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.868213+0000","last_change":"2023-10-10T21:20:26.863650+0000","last_active":"2023-10-10T21:20:26.868213+0000","last_peered":"2023-10-10T21:20:26.868213+0000","last_clean":"2023-10-10T21:20:26.868213+0000","last_became_active":"2023-10-10T21:20:26.863383+0000","last_became_peered":"2023-10-10T21:20:26.863383+0000","last_unstale":"2023-10-10T21:20:26.868213+0000","last_undegraded":"2023-10-10T21:20:26.868213+0000","last_fullsized":"2023-10-10T21:20:26.868213+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:32.009477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.853100+0000","last_change":"2023-10-10T21:20:25.849857+0000","last_active":"2023-10-10T21:20:26.853100+0000","last_peered":"2023-10-10T21:20:26.853100+0000","last_clean":"2023-10-10T21:20:26.853100+0000","last_became_active":"2023-10-10T21:20:25.849583+0000","last_became_peered":"2023-10-10T21:20:25.849583+0000","last_unstale":"2023-10-10T21:20:26.853100+0000","last_undegraded":"2023-10-10T21:20:26.853100+0000","last_fullsized":"2023-10-10T21:20:26.853100+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:15.990188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.869975+0000","last_change":"2023-10-10T21:20:26.868042+0000","last_active":"2023-10-10T21:20:26.869975+0000","last_peered":"2023-10-10T21:20:26.869975+0000","last_clean":"2023-10-10T21:20:26.869975+0000","last_became_active":"2023-10-10T21:20:26.867762+0000","last_became_peered":"2023-10-10T21:20:26.867762+0000","last_unstale":"2023-10-10T21:20:26.869975+0000","last_undegraded":"2023-10-10T21:20:26.869975+0000","last_fullsized":"2023-10-10T21:20:26.869975+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:25.826219+0000","last_clean_scrub_stamp":"2023-10-10T21:20:25.826219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:32.367614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:27.127729+0000","last_change":"2023-10-10T21:20:25.855650+0000","last_active":"2023-10-10T21:20:27.127729+0000","last_peered":"2023-10-10T21:20:27.127729+0000","last_clean":"2023-10-10T21:20:27.127729+0000","last_became_active":"2023-10-10T21:20:25.855422+0000","last_became_peered":"2023-10-10T21:20:25.855422+0000","last_unstale":"2023-10-10T21:20:27.127729+0000","last_undegraded":"2023-10-10T21:20:27.127729+0000","last_fullsized":"2023-10-10T21:20:27.127729+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:20:24.819481+0000","last_clean_scrub_stamp":"2023-10-10T21:20:24.819481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:52:48.429177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"114'227","reported_seq":642,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-10T21:20:26.859229+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:20:26.859229+0000","last_peered":"2023-10-10T21:20:26.859229+0000","last_clean":"2023-10-10T21:20:26.859229+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:20:26.859229+0000","last_undegraded":"2023-10-10T21:20:26.859229+0000","last_fullsized":"2023-10-10T21:20:26.859229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542361,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307560,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064280,"statfs":{"total":96636764160,"available":96321822720,"internally_reserved":0,"allocated":2129920,"data_stored":1336220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65600000000000003,"15min":0.69299999999999995},"min":{"1min":0.44800000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.1859999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68000000000000005,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68200000000000005,"15min":0.71499999999999997},"min":{"1min":0.50800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.745}]},{"osd":2,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.58199999999999996,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":1.012,"5min":1.012,"15min":1.2929999999999999},"last":0.67200000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:19:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.73799999999999999},"min":{"1min":0.48499999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81000000000000005,"5min":1.1539999999999999,"15min":1.2669999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.016,"5min":1.016,"15min":1.4139999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86099999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67000000000000004,"15min":0.67500000000000004},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.41099999999999998},"max":{"1min":0.85499999999999998,"5min":1.212,"15min":1.212},"last":0.83499999999999996}]},{"osd":6,"last update":"Tue Oct 10 21:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0029999999999999,"5min":1.0169999999999999,"15min":1.0980000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.58299999999999996,"5min":0.51300000000000001,"15min":0.5},"max":{"1min":0.995,"5min":1.264,"15min":1.264},"last":0.85899999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542360,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1536000,"data_stored":746364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65700000000000003,"15min":0.69299999999999995},"min":{"1min":0.47099999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.0189999999999999},"last":1.012},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.70099999999999996},"min":{"1min":0.40400000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.1040000000000001},"last":1.097}]},{"osd":1,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.60499999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97699999999999998,"5min":1.0129999999999999,"15min":1.03},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.378},"max":{"1min":0.93200000000000005,"5min":0.98699999999999999,"15min":1.073},"last":1.0249999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65900000000000003,"15min":0.69399999999999995},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90000000000000002,"5min":0.95399999999999996,"15min":0.98199999999999998},"last":1.052},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69699999999999995,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.95199999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.47499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0309999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.48699999999999999,"15min":0.48199999999999998},"max":{"1min":0.94999999999999996,"5min":1.042,"15min":1.042},"last":0.90000000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.87,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38900000000000001},"max":{"1min":0.81799999999999995,"5min":0.86499999999999999,"15min":0.97199999999999998},"last":0.86599999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65500000000000003,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.94399999999999995,"15min":1.022},"last":1.085},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65700000000000003,"15min":0.65800000000000003},"min":{"1min":0.40300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1.125}]},{"osd":7,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.47099999999999997,"5min":0.44800000000000001,"15min":0.435},"max":{"1min":0.80400000000000005,"5min":0.94499999999999995,"15min":1.0629999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.71899999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46400000000000002},"max":{"1min":0.83999999999999997,"5min":1.002,"15min":1.0289999999999999},"last":0.998}]}]},{"osd":1,"up_from":14,"seq":60129542360,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302876,"kb_used_data":1492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068964,"statfs":{"total":96636764160,"available":96326619136,"internally_reserved":0,"allocated":1527808,"data_stored":745740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.53800000000000003,"15min":0.48699999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.69999999999999996,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.61299999999999999,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.27000000000000002,"15min":0.23000000000000001},"max":{"1min":0.71599999999999997,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.34499999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.51200000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":2.254,"15min":2.254},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51900000000000002,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.57999999999999996},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69799999999999995,"5min":0.999,"15min":0.999},"last":0.47099999999999997}]},{"osd":4,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98999999999999999,"5min":4.806,"15min":4.806},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.75900000000000001},"min":{"1min":0.53500000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.872}]},{"osd":5,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":6.968,"15min":6.968},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.87,"15min":0.82499999999999996},"min":{"1min":0.55900000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93500000000000005,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77600000000000002,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0620000000000001,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80800000000000005,"15min":0.83599999999999997},"min":{"1min":0.61699999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.038,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.82499999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:19:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.84799999999999998,"15min":0.80900000000000005},"min":{"1min":0.54100000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.014,"5min":12.026,"15min":12.026},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.80800000000000005,"15min":0.81799999999999995},"min":{"1min":0.58699999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.006,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.65800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542362,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299364,"kb_used_data":2076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072476,"statfs":{"total":96636764160,"available":96330215424,"internally_reserved":0,"allocated":2125824,"data_stored":1336662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47499999999999998,"15min":0.48299999999999998},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.28799999999999998},"max":{"1min":0.624,"5min":0.74399999999999999,"15min":0.752},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.505,"15min":0.52200000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.875,"5min":0.879,"15min":0.91800000000000004},"last":0.48999999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.52500000000000002},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.68799999999999994,"5min":0.72699999999999998,"15min":0.82099999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.56200000000000006},"min":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:19:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.30399999999999999},"max":{"1min":0.69099999999999995,"5min":0.85999999999999999,"15min":0.90300000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57899999999999996,"15min":0.60499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40300000000000002},"max":{"1min":0.78100000000000003,"5min":0.81599999999999995,"15min":0.874},"last":0.66700000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.74099999999999999,"15min":0.78000000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.04,"5min":1.0660000000000001,"15min":1.1080000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.72299999999999998,"15min":0.76400000000000001},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.47699999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.1879999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.748,"15min":0.79300000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.2190000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.75,"15min":0.78400000000000003},"min":{"1min":0.60499999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99399999999999999,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79300000000000004,"15min":0.82599999999999996},"min":{"1min":0.61699999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.79800000000000004,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.143},"last":0.59699999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.77600000000000002,"15min":0.81499999999999995},"min":{"1min":0.59599999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.109,"5min":1.139,"15min":1.169},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77600000000000002,"15min":0.82399999999999995},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.165},"last":0.69999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542362,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311060,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060780,"statfs":{"total":96636764160,"available":96318238720,"internally_reserved":0,"allocated":1519616,"data_stored":739094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44600000000000001,"15min":0.46100000000000002},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.61699999999999999,"5min":0.75,"15min":0.95699999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.50800000000000001},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71499999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.39300000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28699999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.53800000000000003},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.45800000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.56299999999999994},"min":{"1min":0.46000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":0.82199999999999995,"15min":0.88800000000000001},"last":0.433},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66100000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.75},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.94799999999999995,"5min":1.157,"15min":1.3109999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.57899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":1.26,"15min":1.26},"last":0.79700000000000004}]},{"osd":5,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75600000000000001,"15min":0.78500000000000003},"min":{"1min":0.54900000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.03,"5min":2.21,"15min":2.21},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.745,"15min":0.77300000000000002},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96499999999999997,"5min":1.165,"15min":1.268},"last":0.73499999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.754,"15min":0.80500000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.008,"5min":1.0509999999999999,"15min":1.3080000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.58699999999999997,"5min":0.504,"15min":0.504},"max":{"1min":1.042,"5min":1.345,"15min":1.345},"last":0.76300000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76000000000000001,"15min":0.79800000000000004},"min":{"1min":0.55200000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.016,"5min":1.716,"15min":1.716},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.747,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96299999999999997,"5min":1.006,"15min":1.2330000000000001},"last":0.748}]}]},{"osd":3,"up_from":15,"seq":64424509657,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306988,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064852,"statfs":{"total":96636764160,"available":96322408448,"internally_reserved":0,"allocated":1544192,"data_stored":747298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.27900000000000003},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.83099999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.496},"min":{"1min":0.33600000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66200000000000003,"5min":0.77000000000000002,"15min":0.84399999999999997},"last":0.47199999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.496},"min":{"1min":0.317,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":0.68300000000000005,"5min":0.87,"15min":0.87},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.52900000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.49099999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.58299999999999996},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.92200000000000004},"last":0.52200000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.745,"15min":0.77100000000000002},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1200000000000001,"15min":1.3440000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.78600000000000003},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.433},"max":{"1min":1.012,"5min":1.1339999999999999,"15min":1.246},"last":0.86199999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.58999999999999997,"5min":0.54900000000000004,"15min":0.503},"max":{"1min":0.90300000000000002,"5min":1.21,"15min":1.262},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.621,"5min":0.52300000000000002,"15min":0.48699999999999999},"max":{"1min":0.91300000000000003,"5min":1.2250000000000001,"15min":1.228},"last":0.752}]},{"osd":6,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.79000000000000004},"min":{"1min":0.64700000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93999999999999995,"5min":1.081,"15min":1.27},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78300000000000003,"15min":0.80200000000000005},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92000000000000004,"5min":1.0780000000000001,"15min":1.224},"last":0.77000000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:19:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79100000000000004},"min":{"1min":0.57199999999999995,"5min":0.53000000000000003,"15min":0.45500000000000002},"max":{"1min":0.96399999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79100000000000004,"15min":0.81999999999999995},"min":{"1min":0.67100000000000004,"5min":0.501,"15min":0.501},"max":{"1min":0.97699999999999998,"5min":1.228,"15min":1.3200000000000001},"last":0.88700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542362,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311088,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060752,"statfs":{"total":96636764160,"available":96318210048,"internally_reserved":0,"allocated":1548288,"data_stored":747400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65400000000000003,"15min":0.69399999999999995},"min":{"1min":0.56299999999999994,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.871,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.318,"15min":0.318},"max":{"1min":0.87,"5min":1.121,"15min":1.5029999999999999},"last":0.75700000000000001}]},{"osd":1,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71999999999999997,"15min":0.747},"min":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1859999999999999,"15min":1.47},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81599999999999995,"5min":1.155,"15min":1.155},"last":0.92300000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70799999999999996,"15min":0.748},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":1.002,"15min":1.536},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68799999999999994,"15min":0.70999999999999996},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":0.90300000000000002,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.90900000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.745},"min":{"1min":0.55400000000000005,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93500000000000005,"5min":1.2330000000000001,"15min":1.397},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68899999999999995,"15min":0.71999999999999997},"min":{"1min":0.60899999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85099999999999998,"5min":1.0800000000000001,"15min":1.385},"last":1.0009999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.93999999999999995},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.621,"15min":0.625},"min":{"1min":0.436,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85499999999999998,"5min":1,"15min":1.196},"last":0.96299999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65800000000000003,"15min":0.66100000000000003},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78200000000000003,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.874},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.216},"last":0.82399999999999995}]},{"osd":7,"last update":"Tue Oct 10 21:19:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70999999999999996,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.88500000000000001,"5min":1.006,"15min":1.2390000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69099999999999995,"15min":0.68600000000000005},"min":{"1min":0.47699999999999998,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.84699999999999998,"5min":1.034,"15min":1.4139999999999999},"last":0.77700000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542360,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":1531904,"data_stored":745810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.68700000000000006},"min":{"1min":0.42399999999999999,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.91600000000000004,"15min":0.95399999999999996},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66800000000000004,"15min":0.70899999999999996},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.40000000000000002},"max":{"1min":0.89100000000000001,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.72099999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65800000000000003,"15min":0.68400000000000005},"min":{"1min":0.48399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.97299999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66300000000000003,"15min":0.71099999999999997},"min":{"1min":0.48199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.018},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66700000000000004,"15min":0.70699999999999996},"min":{"1min":0.51600000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.748},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68300000000000005,"15min":0.71099999999999997},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.72299999999999998},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0720000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70699999999999996,"15min":0.74399999999999999},"min":{"1min":0.51400000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.044},"last":0.68700000000000006}]},{"osd":4,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.59499999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2110000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.64500000000000002,"15min":0.63200000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95099999999999996,"5min":1.496,"15min":1.496},"last":0.52100000000000002}]},{"osd":6,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.46000000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.51600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:20:31.900 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T21:20:31.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T21:20:32.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.120+0000 7fa1e319d700 1 Processor -- start 2023-10-10T21:20:32.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.121+0000 7fa1e319d700 1 -- start start 2023-10-10T21:20:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e319d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa1dc1563b0 0x7fa1dc0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e319d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 0x7fa1dc0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e319d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc0cbe50 con 0x7fa1dc156780 2023-10-10T21:20:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e319d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc0cb370 con 0x7fa1dc1563b0 2023-10-10T21:20:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e319d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0cb650 con 0x7fa1dc0ae9c0 2023-10-10T21:20:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e199a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa1dc156780 0x7fa1dc0ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43208/0 (socket says 172.21.15.154:43208) 2023-10-10T21:20:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e199a700 1 -- 172.21.15.154:0/2342481069 learned_addr learned my addr 172.21.15.154:0/2342481069 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e219b700 1 --2- 172.21.15.154:0/2342481069 >> v2:172.21.15.179:3300/0 conn(0x7fa1dc1563b0 0x7fa1dc0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e299c700 1 --2- 172.21.15.154:0/2342481069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 0x7fa1dc0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.122+0000 7fa1e1199700 1 -- 172.21.15.154:0/2342481069 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751154526 0 0) 0x7fa1dc0cbe50 con 0x7fa1dc156780 2023-10-10T21:20:32.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.123+0000 7fa1e1199700 1 -- 172.21.15.154:0/2342481069 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c8003570 con 0x7fa1dc156780 2023-10-10T21:20:32.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.123+0000 7fa1e219b700 1 -- 172.21.15.154:0/2342481069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 msgr2=0x7fa1dc0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:32.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.123+0000 7fa1e219b700 1 --2- 172.21.15.154:0/2342481069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 0x7fa1dc0cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.123+0000 7fa1e219b700 1 -- 172.21.15.154:0/2342481069 >> v1:172.21.15.154:6789/0 conn(0x7fa1dc156780 legacy=0x7fa1dc0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.123+0000 7fa1e219b700 1 -- 172.21.15.154:0/2342481069 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0c6860 con 0x7fa1dc1563b0 2023-10-10T21:20:32.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.123+0000 7fa1e219b700 1 --2- 172.21.15.154:0/2342481069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1dc1563b0 0x7fa1dc0ca7d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80098e0 tx=0x7fa1d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32ee43a4a57d7297 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:32.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.123+0000 7fa1e1199700 1 -- 172.21.15.154:0/2342481069 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8011630 con 0x7fa1dc1563b0 2023-10-10T21:20:32.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.123+0000 7fa1e1199700 1 -- 172.21.15.154:0/2342481069 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d8011790 con 0x7fa1dc1563b0 2023-10-10T21:20:32.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.123+0000 7fa1e1199700 1 -- 172.21.15.154:0/2342481069 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8011b30 con 0x7fa1dc1563b0 2023-10-10T21:20:32.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.124+0000 7fa1e319d700 1 -- 172.21.15.154:0/2342481069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1dc1563b0 msgr2=0x7fa1dc0ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.124+0000 7fa1e319d700 1 --2- 172.21.15.154:0/2342481069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1dc1563b0 0x7fa1dc0ca7d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80098e0 tx=0x7fa1d80091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.124+0000 7fa1e319d700 1 -- 172.21.15.154:0/2342481069 shutdown_connections 2023-10-10T21:20:32.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.124+0000 7fa1e319d700 1 --2- 172.21.15.154:0/2342481069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 0x7fa1dc0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.124+0000 7fa1e319d700 1 --2- 172.21.15.154:0/2342481069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1dc1563b0 0x7fa1dc0ca7d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.124+0000 7fa1e319d700 1 -- 172.21.15.154:0/2342481069 >> 172.21.15.154:0/2342481069 conn(0x7fa1dc068e20 msgr2=0x7fa1dc0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:32.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.124+0000 7fa1e319d700 1 -- 172.21.15.154:0/2342481069 shutdown_connections 2023-10-10T21:20:32.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.124+0000 7fa1e319d700 1 -- 172.21.15.154:0/2342481069 wait complete. 2023-10-10T21:20:32.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.125+0000 7fa1e319d700 1 Processor -- start 2023-10-10T21:20:32.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.126+0000 7fa1e319d700 1 -- start start 2023-10-10T21:20:32.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.126+0000 7fa1e319d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 0x7fa1dc14aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.126+0000 7fa1e319d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1dc1563b0 0x7fa1dc0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e319d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc156780 0x7fa1dc169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e319d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0c5c70 con 0x7fa1dc156780 2023-10-10T21:20:32.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e319d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc16a790 con 0x7fa1dc1563b0 2023-10-10T21:20:32.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e319d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0c5060 con 0x7fa1dc0ae9c0 2023-10-10T21:20:32.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e299c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc156780 0x7fa1dc169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e299c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc156780 0x7fa1dc169900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33404/0 (socket says 172.21.15.154:33404) 2023-10-10T21:20:32.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e299c700 1 -- 172.21.15.154:0/738474378 learned_addr learned my addr 172.21.15.154:0/738474378 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:32.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e219b700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 0x7fa1dc14aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e199a700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1dc1563b0 0x7fa1dc0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e299c700 1 -- 172.21.15.154:0/738474378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 msgr2=0x7fa1dc14aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e299c700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 0x7fa1dc14aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e299c700 1 -- 172.21.15.154:0/738474378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1dc1563b0 msgr2=0x7fa1dc0b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e299c700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1dc1563b0 0x7fa1dc0b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e299c700 1 -- 172.21.15.154:0/738474378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d8009420 con 0x7fa1dc156780 2023-10-10T21:20:32.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.127+0000 7fa1e299c700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc156780 0x7fa1dc169900 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009ec0 tx=0x7fa1d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:32.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.128+0000 7fa1d27fc700 1 -- 172.21.15.154:0/738474378 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400cc20 con 0x7fa1dc156780 2023-10-10T21:20:32.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.128+0000 7fa1d27fc700 1 -- 172.21.15.154:0/738474378 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d400f040 con 0x7fa1dc156780 2023-10-10T21:20:32.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.128+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc0c5340 con 0x7fa1dc156780 2023-10-10T21:20:32.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.128+0000 7fa1d27fc700 1 -- 172.21.15.154:0/738474378 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4014480 con 0x7fa1dc156780 2023-10-10T21:20:32.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.128+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc0c5900 con 0x7fa1dc156780 2023-10-10T21:20:32.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.129+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc0c5e20 con 0x7fa1dc156780 2023-10-10T21:20:32.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.130+0000 7fa1d27fc700 1 -- 172.21.15.154:0/738474378 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1d4014810 con 0x7fa1dc156780 2023-10-10T21:20:32.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.130+0000 7fa1d27fc700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fa1c0066f30 0x7fa1c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.131+0000 7fa1d27fc700 1 -- 172.21.15.154:0/738474378 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa1d4085520 con 0x7fa1dc156780 2023-10-10T21:20:32.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.131+0000 7fa1e219b700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fa1c0066f30 0x7fa1c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.131+0000 7fa1e219b700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fa1c0066f30 0x7fa1c00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80091e0 tx=0x7fa1d8017000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:32.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.135+0000 7fa1d27fc700 1 -- 172.21.15.154:0/738474378 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1dc0c5e20 con 0x7fa1dc156780 2023-10-10T21:20:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.401+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa1dc04c3c0 con 0x7fa1dc156780 2023-10-10T21:20:32.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.405+0000 7fa1d27fc700 1 -- 172.21.15.154:0/738474378 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa1d4055ff0 con 0x7fa1dc156780 2023-10-10T21:20:32.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fa1c0066f30 msgr2=0x7fa1c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fa1c0066f30 0x7fa1c00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80091e0 tx=0x7fa1d8017000 comp rx=0 tx=0).stop 2023-10-10T21:20:32.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc156780 msgr2=0x7fa1dc169900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc156780 0x7fa1dc169900 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009ec0 tx=0x7fa1d400b040 comp rx=0 tx=0).stop 2023-10-10T21:20:32.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 shutdown_connections 2023-10-10T21:20:32.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1dc156780 0x7fa1dc169900 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fa1c0066f30 0x7fa1c00693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1dc0ae9c0 0x7fa1dc14aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 --2- 172.21.15.154:0/738474378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1dc1563b0 0x7fa1dc0b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 >> 172.21.15.154:0/738474378 conn(0x7fa1dc068e20 msgr2=0x7fa1dc14f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 shutdown_connections 2023-10-10T21:20:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.408+0000 7fa1e319d700 1 -- 172.21.15.154:0/738474378 wait complete. 2023-10-10T21:20:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T21:20:32.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:20:32.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.618+0000 7fadfb9ff700 1 Processor -- start 2023-10-10T21:20:32.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.618+0000 7fadfb9ff700 1 -- start start 2023-10-10T21:20:32.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.619+0000 7fadfb9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadf40b1850 0x7fadf40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.619+0000 7fadfb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf41579f0 0x7fadf40abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.619+0000 7fadfb9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf40cb300 con 0x7fadf40ae680 2023-10-10T21:20:32.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadfb9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf406fc30 con 0x7fadf40b1850 2023-10-10T21:20:32.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadfb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40cc260 con 0x7fadf41579f0 2023-10-10T21:20:32.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadf979b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadf40b1850 0x7fadf40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadf979b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadf40b1850 0x7fadf40b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33406/0 (socket says 172.21.15.154:33406) 2023-10-10T21:20:32.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadf979b700 1 -- 172.21.15.154:0/1133146347 learned_addr learned my addr 172.21.15.154:0/1133146347 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:32.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadf8f9a700 1 --1- 172.21.15.154:0/1133146347 >> v1:172.21.15.154:6789/0 conn(0x7fadf40ae680 0x7fadf41572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43222/0 (socket says 172.21.15.154:43222) 2023-10-10T21:20:32.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadf9f9c700 1 --2- 172.21.15.154:0/1133146347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf41579f0 0x7fadf40abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadf979b700 1 -- 172.21.15.154:0/1133146347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf41579f0 msgr2=0x7fadf40abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:32.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadf979b700 1 --2- 172.21.15.154:0/1133146347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf41579f0 0x7fadf40abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadf979b700 1 -- 172.21.15.154:0/1133146347 >> v1:172.21.15.154:6789/0 conn(0x7fadf40ae680 legacy=0x7fadf41572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadf979b700 1 -- 172.21.15.154:0/1133146347 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf40cb5e0 con 0x7fadf40b1850 2023-10-10T21:20:32.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.620+0000 7fadebfff700 1 -- 172.21.15.154:0/1133146347 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718299084 0 0) 0x7fadf40cb300 con 0x7fadf40ae680 2023-10-10T21:20:32.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadf979b700 1 --2- 172.21.15.154:0/1133146347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf40b1850 0x7fadf40b1c20 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fadf00099e0 tx=0x7fadf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3e4250a5f11aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:32.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadebfff700 1 -- 172.21.15.154:0/1133146347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000b820 con 0x7fadf40b1850 2023-10-10T21:20:32.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadebfff700 1 -- 172.21.15.154:0/1133146347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000b980 con 0x7fadf40b1850 2023-10-10T21:20:32.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadebfff700 1 -- 172.21.15.154:0/1133146347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000bd20 con 0x7fadf40b1850 2023-10-10T21:20:32.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadfb9ff700 1 -- 172.21.15.154:0/1133146347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf40b1850 msgr2=0x7fadf40b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadfb9ff700 1 --2- 172.21.15.154:0/1133146347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf40b1850 0x7fadf40b1c20 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fadf00099e0 tx=0x7fadf0009250 comp rx=0 tx=0).stop 2023-10-10T21:20:32.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadfb9ff700 1 -- 172.21.15.154:0/1133146347 shutdown_connections 2023-10-10T21:20:32.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadfb9ff700 1 --2- 172.21.15.154:0/1133146347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf41579f0 0x7fadf40abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadfb9ff700 1 --2- 172.21.15.154:0/1133146347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf40b1850 0x7fadf40b1c20 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadfb9ff700 1 -- 172.21.15.154:0/1133146347 >> 172.21.15.154:0/1133146347 conn(0x7fadf406a320 msgr2=0x7fadf40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:32.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.621+0000 7fadfb9ff700 1 -- 172.21.15.154:0/1133146347 shutdown_connections 2023-10-10T21:20:32.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.622+0000 7fadfb9ff700 1 -- 172.21.15.154:0/1133146347 wait complete. 2023-10-10T21:20:32.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.623+0000 7fadfb9ff700 1 Processor -- start 2023-10-10T21:20:32.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.623+0000 7fadfb9ff700 1 -- start start 2023-10-10T21:20:32.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadfb9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadf40ae680 0x7fadf4154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadfb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf40b1850 0x7fadf415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadfb9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf41579f0 0x7fadf415ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadfb9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf415a9d0 con 0x7fadf41579f0 2023-10-10T21:20:32.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadfb9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf415a540 con 0x7fadf40ae680 2023-10-10T21:20:32.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadfb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4159930 con 0x7fadf40b1850 2023-10-10T21:20:32.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadf9f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf41579f0 0x7fadf415ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadf9f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf41579f0 0x7fadf415ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33414/0 (socket says 172.21.15.154:33414) 2023-10-10T21:20:32.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadf9f9c700 1 -- 172.21.15.154:0/2282789513 learned_addr learned my addr 172.21.15.154:0/2282789513 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:32.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadf9f9c700 1 -- 172.21.15.154:0/2282789513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf40b1850 msgr2=0x7fadf415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadf9f9c700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf40b1850 0x7fadf415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadf9f9c700 1 -- 172.21.15.154:0/2282789513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadf40ae680 msgr2=0x7fadf4154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadf9f9c700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadf40ae680 0x7fadf4154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.624+0000 7fadf9f9c700 1 -- 172.21.15.154:0/2282789513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00094f0 con 0x7fadf41579f0 2023-10-10T21:20:32.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.625+0000 7fadf9f9c700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf41579f0 0x7fadf415ede0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fadec007f20 tx=0x7fadec009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:32.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.625+0000 7fade97fa700 1 -- 172.21.15.154:0/2282789513 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec00eca0 con 0x7fadf41579f0 2023-10-10T21:20:32.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.625+0000 7fade97fa700 1 -- 172.21.15.154:0/2282789513 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec00ee20 con 0x7fadf41579f0 2023-10-10T21:20:32.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.625+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf4159c10 con 0x7fadf41579f0 2023-10-10T21:20:32.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.625+0000 7fade97fa700 1 -- 172.21.15.154:0/2282789513 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec014670 con 0x7fadf41579f0 2023-10-10T21:20:32.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.625+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf415a1d0 con 0x7fadf41579f0 2023-10-10T21:20:32.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.626+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf404c3c0 con 0x7fadf41579f0 2023-10-10T21:20:32.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.627+0000 7fade97fa700 1 -- 172.21.15.154:0/2282789513 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadec0149e0 con 0x7fadf41579f0 2023-10-10T21:20:32.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.628+0000 7fade97fa700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fadd8066f30 0x7fadd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:32.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.628+0000 7fade97fa700 1 -- 172.21.15.154:0/2282789513 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fadec084e70 con 0x7fadf41579f0 2023-10-10T21:20:32.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.628+0000 7fadf979b700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fadd8066f30 0x7fadd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:32.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.628+0000 7fadf979b700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fadd8066f30 0x7fadd80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fadf00099e0 tx=0x7fadf0017000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:32.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.632+0000 7fade97fa700 1 -- 172.21.15.154:0/2282789513 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadec051eb0 con 0x7fadf41579f0 2023-10-10T21:20:32.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.867+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadf415a6b0 con 0x7fadf41579f0 2023-10-10T21:20:32.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.868+0000 7fade97fa700 1 -- 172.21.15.154:0/2282789513 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fadec0554d0 con 0x7fadf41579f0 2023-10-10T21:20:32.885 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:32.885 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/909044943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":909044943},{"type":"v1","addr":"172.21.15.154:6834","nonce":909044943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/4163308288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":4163308288},{"type":"v1","addr":"172.21.15.179:6834","nonce":4163308288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7330,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3673994181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3673994181},{"type":"v1","addr":"172.21.15.179:6835","nonce":3673994181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:20:26.309607+0000","modified":"2023-10-10T21:20:30.131493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7677},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7677":{"gid":7677,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1893020718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1893020718},{"type":"v1","addr":"172.21.15.154:6837","nonce":1893020718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-10T21:20:32.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fadd8066f30 msgr2=0x7fadd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fadd8066f30 0x7fadd80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fadf00099e0 tx=0x7fadf0017000 comp rx=0 tx=0).stop 2023-10-10T21:20:32.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf41579f0 msgr2=0x7fadf415ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:32.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf41579f0 0x7fadf415ede0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fadec007f20 tx=0x7fadec009860 comp rx=0 tx=0).stop 2023-10-10T21:20:32.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 shutdown_connections 2023-10-10T21:20:32.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf41579f0 0x7fadf415ede0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadf40ae680 0x7fadf4154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fadd8066f30 0x7fadd80693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 --2- 172.21.15.154:0/2282789513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadf40b1850 0x7fadf415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 >> 172.21.15.154:0/2282789513 conn(0x7fadf406a320 msgr2=0x7fadf4156300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 shutdown_connections 2023-10-10T21:20:32.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:32.870+0000 7fadfb9ff700 1 -- 172.21.15.154:0/2282789513 wait complete. 2023-10-10T21:20:32.891 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 54 2023-10-10T21:20:33.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T21:20:26.309607+0000', 'modified': '2023-10-10T21:20:30.131493+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7677}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7677': {'gid': 7677, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6837/1893020718', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6833', 'nonce': 1893020718}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1893020718}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T21:20:33.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T21:20:33.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-10T21:20:33.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.480+0000 7fe61e9ff700 1 Processor -- start 2023-10-10T21:20:33.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.480+0000 7fe61e9ff700 1 -- start start 2023-10-10T21:20:33.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.481+0000 7fe61e9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe618069560 0x7fe6180699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.481+0000 7fe61e9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe618069ee0 con 0x7fe618159c60 2023-10-10T21:20:33.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.481+0000 7fe61e9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61815a160 con 0x7fe618159890 2023-10-10T21:20:33.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.481+0000 7fe61e9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6180d13a0 con 0x7fe618069560 2023-10-10T21:20:33.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.481+0000 7fe6177fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe618159c60 0x7fe61815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43224/0 (socket says 172.21.15.154:43224) 2023-10-10T21:20:33.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.481+0000 7fe6177fe700 1 -- 172.21.15.154:0/67123191 learned_addr learned my addr 172.21.15.154:0/67123191 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:33.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654119973 0 0) 0x7fe618069ee0 con 0x7fe618159c60 2023-10-10T21:20:33.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/67123191 >> v2:172.21.15.179:3300/0 conn(0x7fe618069560 0x7fe6180699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe600003570 con 0x7fe618159c60 2023-10-10T21:20:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1376408526 0 0) 0x7fe600003570 con 0x7fe618159c60 2023-10-10T21:20:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 >> v2:172.21.15.179:3300/0 conn(0x7fe618069560 msgr2=0x7fe6180699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 --2- 172.21.15.154:0/67123191 >> v2:172.21.15.179:3300/0 conn(0x7fe618069560 0x7fe6180699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 >> v1:172.21.15.179:6789/0 conn(0x7fe618159890 legacy=0x7fe61815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61815e140 con 0x7fe618159c60 2023-10-10T21:20:33.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fe60c001470 con 0x7fe618159c60 2023-10-10T21:20:33.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 >> v1:172.21.15.154:6789/0 conn(0x7fe618159c60 legacy=0x7fe61815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe600003a60 0x7fe600003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600004810 0x7fe600004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6000051c0 0x7fe60000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6180d13a0 con 0x7fe600003a60 2023-10-10T21:20:33.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60000c0d0 con 0x7fe6000051c0 2023-10-10T21:20:33.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.482+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60000c290 con 0x7fe600004810 2023-10-10T21:20:33.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe617fff700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe600003a60 0x7fe600003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6000051c0 0x7fe60000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe6177fe700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600004810 0x7fe600004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe617fff700 1 -- 172.21.15.154:0/67123191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600004810 msgr2=0x7fe600004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe617fff700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600004810 0x7fe600004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe617fff700 1 -- 172.21.15.154:0/67123191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6000051c0 msgr2=0x7fe60000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe617fff700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6000051c0 0x7fe60000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe617fff700 1 -- 172.21.15.154:0/67123191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600003570 con 0x7fe600003a60 2023-10-10T21:20:33.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6000051c0 0x7fe60000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe61cf9c700 1 -- 172.21.15.154:0/67123191 reap_dead start 2023-10-10T21:20:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.483+0000 7fe617fff700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe600003a60 0x7fe600003e70 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe6080018b0 tx=0x7fe608007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21b598d5abec3d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608012420 con 0x7fe600003a60 2023-10-10T21:20:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6080125a0 con 0x7fe600003a60 2023-10-10T21:20:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe616ffd700 1 -- 172.21.15.154:0/67123191 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608012960 con 0x7fe600003a60 2023-10-10T21:20:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe61e9ff700 1 -- 172.21.15.154:0/67123191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe600003a60 msgr2=0x7fe600003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe61e9ff700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe600003a60 0x7fe600003e70 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe6080018b0 tx=0x7fe608007d30 comp rx=0 tx=0).stop 2023-10-10T21:20:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe61e9ff700 1 -- 172.21.15.154:0/67123191 shutdown_connections 2023-10-10T21:20:33.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe61e9ff700 1 --2- 172.21.15.154:0/67123191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe600003a60 0x7fe600003e70 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe61e9ff700 1 -- 172.21.15.154:0/67123191 >> 172.21.15.154:0/67123191 conn(0x7fe618068e20 msgr2=0x7fe6180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:33.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe61e9ff700 1 -- 172.21.15.154:0/67123191 shutdown_connections 2023-10-10T21:20:33.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.484+0000 7fe61e9ff700 1 -- 172.21.15.154:0/67123191 wait complete. 2023-10-10T21:20:33.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.486+0000 7fe61e9ff700 1 Processor -- start 2023-10-10T21:20:33.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.486+0000 7fe61e9ff700 1 -- start start 2023-10-10T21:20:33.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe61e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600003a60 0x7fe61814c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe61e9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe618155cc0 0x7fe6180b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe61e9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6180b5e90 0x7fe618151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe61e9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe618152c10 con 0x7fe618155cc0 2023-10-10T21:20:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe61e9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6180ce2a0 con 0x7fe6180b5e90 2023-10-10T21:20:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe61e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61814cab0 con 0x7fe600003a60 2023-10-10T21:20:33.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe6177fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe618155cc0 0x7fe6180b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe6177fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe618155cc0 0x7fe6180b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33434/0 (socket says 172.21.15.154:33434) 2023-10-10T21:20:33.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe6177fe700 1 -- 172.21.15.154:0/1827730022 learned_addr learned my addr 172.21.15.154:0/1827730022 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:33.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe617fff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600003a60 0x7fe61814c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6180b5e90 0x7fe618151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe6177fe700 1 -- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600003a60 msgr2=0x7fe61814c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe6177fe700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600003a60 0x7fe61814c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe6177fe700 1 -- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6180b5e90 msgr2=0x7fe618151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe6177fe700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6180b5e90 0x7fe618151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe6177fe700 1 -- 172.21.15.154:0/1827730022 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe618152930 con 0x7fe618155cc0 2023-10-10T21:20:33.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe617fff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600003a60 0x7fe61814c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:33.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.487+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6180b5e90 0x7fe618151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:33.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.488+0000 7fe6177fe700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe618155cc0 0x7fe6180b5950 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fe60c007420 tx=0x7fe60c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.488+0000 7fe5fffff700 1 -- 172.21.15.154:0/1827730022 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00f8d0 con 0x7fe618155cc0 2023-10-10T21:20:33.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.488+0000 7fe5fffff700 1 -- 172.21.15.154:0/1827730022 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c00fa30 con 0x7fe618155cc0 2023-10-10T21:20:33.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.488+0000 7fe61e9ff700 1 -- 172.21.15.154:0/1827730022 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6180cdc50 con 0x7fe618155cc0 2023-10-10T21:20:33.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.488+0000 7fe5fffff700 1 -- 172.21.15.154:0/1827730022 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00fdf0 con 0x7fe618155cc0 2023-10-10T21:20:33.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.488+0000 7fe61e9ff700 1 -- 172.21.15.154:0/1827730022 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6180b6330 con 0x7fe618155cc0 2023-10-10T21:20:33.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.490+0000 7fe5fffff700 1 -- 172.21.15.154:0/1827730022 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe60c0135c0 con 0x7fe618155cc0 2023-10-10T21:20:33.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.491+0000 7fe5fffff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fe604066f30 0x7fe6040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.491+0000 7fe5fffff700 1 -- 172.21.15.154:0/1827730022 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe60c084530 con 0x7fe618155cc0 2023-10-10T21:20:33.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.491+0000 7fe617fff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fe604066f30 0x7fe6040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.492+0000 7fe617fff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fe604066f30 0x7fe6040693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe608001690 tx=0x7fe608015000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.493+0000 7fe62d152b80 1 Processor -- start 2023-10-10T21:20:33.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.493+0000 7fe62d152b80 1 -- start start 2023-10-10T21:20:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 0x55f0a15f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a161da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a15f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe62d152b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a154ba70 con 0x55f0a161df60 2023-10-10T21:20:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe62d152b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a1549270 con 0x55f0a163ed00 2023-10-10T21:20:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe62d152b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0a1545060 con 0x55f0a15f4a50 2023-10-10T21:20:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe61cf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a15f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe61cf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a15f0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33448/0 (socket says 172.21.15.154:33448) 2023-10-10T21:20:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe61cf9c700 1 -- 172.21.15.154:0/3899450486 learned_addr learned my addr 172.21.15.154:0/3899450486 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe6177fe700 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a161da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe617fff700 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 0x55f0a15f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe61cf9c700 1 -- 172.21.15.154:0/3899450486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 msgr2=0x55f0a15f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 0x55f0a15f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe61cf9c700 1 -- 172.21.15.154:0/3899450486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 msgr2=0x55f0a161da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a161da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe61cf9c700 1 -- 172.21.15.154:0/3899450486 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0a13df270 con 0x55f0a161df60 2023-10-10T21:20:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.494+0000 7fe6177fe700 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a161da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.495+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a15f0cf0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fe6100094d0 tx=0x7fe61000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80db9bf9a04e1257 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.495+0000 7fe5fd7fa700 1 -- 172.21.15.154:0/3899450486 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61001e070 con 0x55f0a161df60 2023-10-10T21:20:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.495+0000 7fe5fd7fa700 1 -- 172.21.15.154:0/3899450486 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61000f040 con 0x55f0a161df60 2023-10-10T21:20:33.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.495+0000 7fe5fd7fa700 1 -- 172.21.15.154:0/3899450486 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000e040 con 0x55f0a161df60 2023-10-10T21:20:33.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.495+0000 7fe62d152b80 1 -- 172.21.15.154:0/3899450486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 msgr2=0x55f0a15f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.495+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a15f0cf0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fe6100094d0 tx=0x7fe61000b040 comp rx=0 tx=0).stop 2023-10-10T21:20:33.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.496+0000 7fe62d152b80 1 -- 172.21.15.154:0/3899450486 shutdown_connections 2023-10-10T21:20:33.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.496+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a15f0cf0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.496+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 0x55f0a15f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.496+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3899450486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a161da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.496+0000 7fe62d152b80 1 -- 172.21.15.154:0/3899450486 >> 172.21.15.154:0/3899450486 conn(0x55f0a15f6370 msgr2=0x55f0a15f6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:33.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.496+0000 7fe62d152b80 1 -- 172.21.15.154:0/3899450486 shutdown_connections 2023-10-10T21:20:33.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.496+0000 7fe62d152b80 1 -- 172.21.15.154:0/3899450486 wait complete. 2023-10-10T21:20:33.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.496+0000 7fe62d152b80 1 -- start start 2023-10-10T21:20:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.497+0000 7fe62d152b80 1 Processor -- start 2023-10-10T21:20:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a161a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 0x55f0a1624840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a163b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe62d152b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a14f0890 con 0x55f0a15f4a50 2023-10-10T21:20:33.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe62d152b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a150bea0 con 0x55f0a163ed00 2023-10-10T21:20:33.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe62d152b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0a13c7e30 con 0x55f0a161df60 2023-10-10T21:20:33.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe62d152b80 10 client.0 _ll_register_callbacks cb 0x55f0a15b8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:20:33.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe617fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a161a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe617fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a161a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33452/0 (socket says 172.21.15.154:33452) 2023-10-10T21:20:33.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe617fff700 1 -- 172.21.15.154:0/1124270134 learned_addr learned my addr 172.21.15.154:0/1124270134 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:33.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe617fff700 1 -- 172.21.15.154:0/1124270134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 msgr2=0x55f0a1624840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe617fff700 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 0x55f0a1624840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe617fff700 1 -- 172.21.15.154:0/1124270134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 msgr2=0x55f0a163b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe617fff700 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a163b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe617fff700 1 -- 172.21.15.154:0/1124270134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6100132b0 con 0x55f0a15f4a50 2023-10-10T21:20:33.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe617fff700 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a161a370 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe608002000 tx=0x7fe608022070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd47c979b31a271 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.498+0000 7fe5f67fc700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:20:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe5f67fc700 1 -- 172.21.15.154:0/1124270134 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608006820 con 0x55f0a15f4a50 2023-10-10T21:20:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe5f67fc700 1 -- 172.21.15.154:0/1124270134 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe608006980 con 0x55f0a15f4a50 2023-10-10T21:20:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe62d152b80 1 -- 172.21.15.154:0/1124270134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0a15e9b70 con 0x55f0a15f4a50 2023-10-10T21:20:33.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe5f67fc700 1 -- 172.21.15.154:0/1124270134 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe608006d50 con 0x55f0a15f4a50 2023-10-10T21:20:33.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe62d152b80 10 client.7833 fetch_fsmap learned FSMap version 54 2023-10-10T21:20:33.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe62d152b80 1 -- 172.21.15.154:0/1124270134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55f0a1381fe0 con 0x55f0a15f4a50 2023-10-10T21:20:33.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe5f67fc700 1 -- 172.21.15.154:0/1124270134 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60803b070 con 0x55f0a15f4a50 2023-10-10T21:20:33.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe5f67fc700 1 -- 172.21.15.154:0/1124270134 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe608007020 con 0x55f0a15f4a50 2023-10-10T21:20:33.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe62d152b80 10 client.7833 fetch_fsmap finished waiting for FSMap version 54 2023-10-10T21:20:33.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe62d152b80 10 client.7833 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-10T21:20:33.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe62d152b80 20 client.7833 populate_metadata read hostname 'smithi154' 2023-10-10T21:20:33.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe62d152b80 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] conn(0x55f0a163e060 0x55f0a163e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe62d152b80 4 client.7833 mds_command: new command op to 7677 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T21:20:33.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.499+0000 7fe62d152b80 1 -- 172.21.15.154:0/1124270134 --> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0a15c6aa0 con 0x55f0a163e060 2023-10-10T21:20:33.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.500+0000 7fe6177fe700 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] conn(0x55f0a163e060 0x55f0a163e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.500+0000 7fe5f67fc700 10 client.7833 ms_handle_connect on v2:172.21.15.154:6833/1893020718 2023-10-10T21:20:33.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.500+0000 7fe6177fe700 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] conn(0x55f0a163e060 0x55f0a163e430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=977f7ed288c2c74a server_cookie=36a934f9e305f9a2 in_seq=0 out_seq=0 2023-10-10T21:20:33.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe5f67fc700 1 -- 172.21.15.154:0/1124270134 <== mds.0 v2:172.21.15.154:6833/1893020718 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f0a15c6aa0 con 0x55f0a163e060 2023-10-10T21:20:33.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe5f67fc700 10 client.7833 handle_command_reply: tid=0 2023-10-10T21:20:33.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 client.7833 shutdown 2023-10-10T21:20:33.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 -- 172.21.15.154:0/1124270134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 msgr2=0x55f0a161a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a161a370 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe608002000 tx=0x7fe608022070 comp rx=0 tx=0).stop 2023-10-10T21:20:33.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 -- 172.21.15.154:0/1124270134 shutdown_connections 2023-10-10T21:20:33.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] conn(0x55f0a163e060 0x55f0a163e430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a163b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a161a370 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe5f67fc700 0 client.7833 ms_handle_reset on v2:172.21.15.154:6833/1893020718 2023-10-10T21:20:33.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 --2- 172.21.15.154:0/1124270134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 0x55f0a1624840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 -- 172.21.15.154:0/1124270134 >> 172.21.15.154:0/1124270134 conn(0x55f0a15f6370 msgr2=0x55f0a163a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 -- 172.21.15.154:0/1124270134 shutdown_connections 2023-10-10T21:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 1 -- 172.21.15.154:0/1124270134 wait complete. 2023-10-10T21:20:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.501+0000 7fe62d152b80 20 client.7833 trim_cache size 0 max 16384 2023-10-10T21:20:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.518+0000 7fe62d152b80 1 Processor -- start 2023-10-10T21:20:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.518+0000 7fe62d152b80 1 -- start start 2023-10-10T21:20:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.519+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a1624640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.519+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 0x55f0a15f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.519+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a15f5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.519+0000 7fe62d152b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a1619d90 con 0x55f0a15f4a50 2023-10-10T21:20:33.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.519+0000 7fe62d152b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a15f3ff0 con 0x55f0a163ed00 2023-10-10T21:20:33.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.519+0000 7fe62d152b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0a15cd410 con 0x55f0a161df60 2023-10-10T21:20:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.519+0000 7fe617fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a1624640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.519+0000 7fe617fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a1624640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33468/0 (socket says 172.21.15.154:33468) 2023-10-10T21:20:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.519+0000 7fe617fff700 1 -- 172.21.15.154:0/2699061969 learned_addr learned my addr 172.21.15.154:0/2699061969 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a15f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe6177fe700 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 0x55f0a15f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe617fff700 1 -- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 msgr2=0x55f0a15f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe617fff700 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 0x55f0a15f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe617fff700 1 -- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 msgr2=0x55f0a15f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe617fff700 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a15f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe617fff700 1 -- 172.21.15.154:0/2699061969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0a1513780 con 0x55f0a15f4a50 2023-10-10T21:20:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a15f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe6177fe700 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 0x55f0a15f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:20:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe617fff700 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a1624640 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fe608007c40 tx=0x7fe60802d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6382bdffab0658ac server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe5fdffb700 1 -- 172.21.15.154:0/2699061969 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608006820 con 0x55f0a15f4a50 2023-10-10T21:20:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe5fdffb700 1 -- 172.21.15.154:0/2699061969 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60803b070 con 0x55f0a15f4a50 2023-10-10T21:20:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.520+0000 7fe5fdffb700 1 -- 172.21.15.154:0/2699061969 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080069a0 con 0x55f0a15f4a50 2023-10-10T21:20:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 -- 172.21.15.154:0/2699061969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 msgr2=0x55f0a1624640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a1624640 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fe608007c40 tx=0x7fe60802d070 comp rx=0 tx=0).stop 2023-10-10T21:20:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 -- 172.21.15.154:0/2699061969 shutdown_connections 2023-10-10T21:20:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a15f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a15f4a50 0x55f0a1624640 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 --2- 172.21.15.154:0/2699061969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a161df60 0x55f0a15f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 -- 172.21.15.154:0/2699061969 >> 172.21.15.154:0/2699061969 conn(0x55f0a15f6370 msgr2=0x55f0a163c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 -- 172.21.15.154:0/2699061969 shutdown_connections 2023-10-10T21:20:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 -- 172.21.15.154:0/2699061969 wait complete. 2023-10-10T21:20:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.521+0000 7fe62d152b80 1 -- start start 2023-10-10T21:20:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.522+0000 7fe62d152b80 1 Processor -- start 2023-10-10T21:20:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.522+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 0x55f0a16a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.522+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a1634c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe62d152b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a1635170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe62d152b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a165b080 con 0x55f0a161df60 2023-10-10T21:20:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe62d152b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a1649260 con 0x55f0a163ed00 2023-10-10T21:20:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe62d152b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0a16a0ce0 con 0x55f0a15f4a50 2023-10-10T21:20:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe62d152b80 10 client.0 _ll_register_callbacks cb 0x55f0a15b8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:20:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe6177fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a1634c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe6177fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a1634c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33470/0 (socket says 172.21.15.154:33470) 2023-10-10T21:20:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe6177fe700 1 -- 172.21.15.154:0/3625348599 learned_addr learned my addr 172.21.15.154:0/3625348599 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe617fff700 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 0x55f0a16a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a1635170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe6177fe700 1 -- 172.21.15.154:0/3625348599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 msgr2=0x55f0a16a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe6177fe700 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 0x55f0a16a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe6177fe700 1 -- 172.21.15.154:0/3625348599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 msgr2=0x55f0a1635170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe6177fe700 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a1635170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe6177fe700 1 -- 172.21.15.154:0/3625348599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe608039040 con 0x55f0a161df60 2023-10-10T21:20:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe61cf9c700 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a1635170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe6177fe700 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a1634c30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe60c082850 tx=0x7fe60c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3c1d76cc757c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.523+0000 7fe5f67fc700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:20:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe5f67fc700 1 -- 172.21.15.154:0/3625348599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c058480 con 0x55f0a161df60 2023-10-10T21:20:33.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe5f67fc700 1 -- 172.21.15.154:0/3625348599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe60c05c1d0 con 0x55f0a161df60 2023-10-10T21:20:33.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe62d152b80 1 -- 172.21.15.154:0/3625348599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe6180c5b60 con 0x55f0a161df60 2023-10-10T21:20:33.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe5f67fc700 1 -- 172.21.15.154:0/3625348599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe60c0840b0 con 0x55f0a161df60 2023-10-10T21:20:33.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe62d152b80 10 client.7839 fetch_fsmap learned FSMap version 54 2023-10-10T21:20:33.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe62d152b80 1 -- 172.21.15.154:0/3625348599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55f0a14fa470 con 0x55f0a161df60 2023-10-10T21:20:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe5f67fc700 1 -- 172.21.15.154:0/3625348599 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c060020 con 0x55f0a161df60 2023-10-10T21:20:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe5f67fc700 1 -- 172.21.15.154:0/3625348599 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe60c055490 con 0x55f0a161df60 2023-10-10T21:20:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe62d152b80 10 client.7839 fetch_fsmap finished waiting for FSMap version 54 2023-10-10T21:20:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe62d152b80 10 client.7839 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-10T21:20:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe62d152b80 20 client.7839 populate_metadata read hostname 'smithi154' 2023-10-10T21:20:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] conn(0x55f0a1649cd0 0x55f0a164a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe62d152b80 4 client.7839 mds_command: new command op to 7677 tid=0[{"prefix": "status"}] 2023-10-10T21:20:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe62d152b80 1 -- 172.21.15.154:0/3625348599 --> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fe61000f040 con 0x55f0a1649cd0 2023-10-10T21:20:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.524+0000 7fe617fff700 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] conn(0x55f0a1649cd0 0x55f0a164a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe5f67fc700 10 client.7839 ms_handle_connect on v2:172.21.15.154:6833/1893020718 2023-10-10T21:20:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe617fff700 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] conn(0x55f0a1649cd0 0x55f0a164a0a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95c81352adbb742d server_cookie=2dc0e437ee8b526b in_seq=0 out_seq=0 2023-10-10T21:20:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe5f67fc700 1 -- 172.21.15.154:0/3625348599 <== mds.0 v2:172.21.15.154:6833/1893020718 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7fe61000f040 con 0x55f0a1649cd0 2023-10-10T21:20:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe5f67fc700 10 client.7839 handle_command_reply: tid=0 2023-10-10T21:20:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 client.7839 shutdown 2023-10-10T21:20:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 -- 172.21.15.154:0/3625348599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 msgr2=0x55f0a1634c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a1634c30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe60c082850 tx=0x7fe60c009040 comp rx=0 tx=0).stop 2023-10-10T21:20:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 -- 172.21.15.154:0/3625348599 shutdown_connections 2023-10-10T21:20:33.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.154:6833/1893020718,v1:172.21.15.154:6837/1893020718] conn(0x55f0a1649cd0 0x55f0a164a0a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0a163ed00 0x55f0a1635170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f0a15f4a50 0x55f0a16a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe5f67fc700 0 client.7839 ms_handle_reset on v2:172.21.15.154:6833/1893020718 2023-10-10T21:20:33.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 --2- 172.21.15.154:0/3625348599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0a161df60 0x55f0a1634c30 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 -- 172.21.15.154:0/3625348599 >> 172.21.15.154:0/3625348599 conn(0x55f0a15f6370 msgr2=0x55f0a15f4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 -- 172.21.15.154:0/3625348599 shutdown_connections 2023-10-10T21:20:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.525+0000 7fe62d152b80 1 -- 172.21.15.154:0/3625348599 wait complete. 2023-10-10T21:20:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe62d152b80 20 client.7839 trim_cache size 0 max 16384 2023-10-10T21:20:33.564 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:20:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T21:20:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T21:20:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 7677, 2023-10-10T21:20:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T21:20:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T21:20:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T21:20:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 6.4088788619999999, 2023-10-10T21:20:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 54, 2023-10-10T21:20:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 124, 2023-10-10T21:20:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 124, 2023-10-10T21:20:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 12.420593755000001 2023-10-10T21:20:33.566 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:20:33.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 -- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fe604066f30 msgr2=0x7fe6040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fe604066f30 0x7fe6040693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe608001690 tx=0x7fe608015000 comp rx=0 tx=0).stop 2023-10-10T21:20:33.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 -- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe618155cc0 msgr2=0x7fe6180b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe618155cc0 0x7fe6180b5950 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fe60c007420 tx=0x7fe60c001e50 comp rx=0 tx=0).stop 2023-10-10T21:20:33.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 -- 172.21.15.154:0/1827730022 shutdown_connections 2023-10-10T21:20:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6180b5e90 0x7fe618151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fe604066f30 0x7fe6040693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe600003a60 0x7fe61814c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 --2- 172.21.15.154:0/1827730022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe618155cc0 0x7fe6180b5950 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 -- 172.21.15.154:0/1827730022 >> 172.21.15.154:0/1827730022 conn(0x7fe618068e20 msgr2=0x7fe61815ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:33.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 -- 172.21.15.154:0/1827730022 shutdown_connections 2023-10-10T21:20:33.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.526+0000 7fe61e9ff700 1 -- 172.21.15.154:0/1827730022 wait complete. 2023-10-10T21:20:33.570 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:20:33.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.751+0000 7facaadff700 1 Processor -- start 2023-10-10T21:20:33.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.751+0000 7facaadff700 1 -- start start 2023-10-10T21:20:33.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7facaadff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faca40b0a10 0x7faca4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7facaadff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca40ad930 con 0x7faca41578b0 2023-10-10T21:20:33.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7facaadff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca40acd20 con 0x7faca4155c10 2023-10-10T21:20:33.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7facaadff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca40ad000 con 0x7faca40b0a10 2023-10-10T21:20:33.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7faca3fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faca41578b0 0x7faca40af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43236/0 (socket says 172.21.15.154:43236) 2023-10-10T21:20:33.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7faca3fff700 1 -- 172.21.15.154:0/108817055 learned_addr learned my addr 172.21.15.154:0/108817055 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:33.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7faca939c700 1 --2- 172.21.15.154:0/108817055 >> v2:172.21.15.154:3300/0 conn(0x7faca40b0a10 0x7faca4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7faca37fe700 1 -- 172.21.15.154:0/108817055 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380132422 0 0) 0x7faca40ad930 con 0x7faca41578b0 2023-10-10T21:20:33.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7faca37fe700 1 -- 172.21.15.154:0/108817055 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac94003570 con 0x7faca41578b0 2023-10-10T21:20:33.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7faca939c700 1 -- 172.21.15.154:0/108817055 >> v1:172.21.15.179:6789/0 conn(0x7faca4155c10 legacy=0x7faca40ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7faca939c700 1 -- 172.21.15.154:0/108817055 >> v1:172.21.15.154:6789/0 conn(0x7faca41578b0 legacy=0x7faca40af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.753+0000 7faca939c700 1 -- 172.21.15.154:0/108817055 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40ad2e0 con 0x7faca40b0a10 2023-10-10T21:20:33.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.754+0000 7faca939c700 1 --2- 172.21.15.154:0/108817055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 0x7faca4155fe0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00af70 tx=0x7fac9c00a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02cbcbd71869b3e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.754+0000 7faca37fe700 1 -- 172.21.15.154:0/108817055 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00f070 con 0x7faca40b0a10 2023-10-10T21:20:33.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.754+0000 7faca37fe700 1 -- 172.21.15.154:0/108817055 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c00a2e0 con 0x7faca40b0a10 2023-10-10T21:20:33.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.754+0000 7faca37fe700 1 -- 172.21.15.154:0/108817055 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00cc70 con 0x7faca40b0a10 2023-10-10T21:20:33.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.755+0000 7facaadff700 1 -- 172.21.15.154:0/108817055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 msgr2=0x7faca4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.755+0000 7facaadff700 1 --2- 172.21.15.154:0/108817055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 0x7faca4155fe0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00af70 tx=0x7fac9c00a890 comp rx=0 tx=0).stop 2023-10-10T21:20:33.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.755+0000 7facaadff700 1 -- 172.21.15.154:0/108817055 shutdown_connections 2023-10-10T21:20:33.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.755+0000 7facaadff700 1 --2- 172.21.15.154:0/108817055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 0x7faca4155fe0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.755+0000 7facaadff700 1 -- 172.21.15.154:0/108817055 >> 172.21.15.154:0/108817055 conn(0x7faca406a320 msgr2=0x7faca40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:33.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.755+0000 7facaadff700 1 -- 172.21.15.154:0/108817055 shutdown_connections 2023-10-10T21:20:33.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.755+0000 7facaadff700 1 -- 172.21.15.154:0/108817055 wait complete. 2023-10-10T21:20:33.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.756+0000 7facaadff700 1 Processor -- start 2023-10-10T21:20:33.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.756+0000 7facaadff700 1 -- start start 2023-10-10T21:20:33.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.757+0000 7facaadff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 0x7faca406f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.757+0000 7facaadff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faca4155c10 0x7faca416c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.757+0000 7facaadff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faca41578b0 0x7faca415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.757+0000 7facaadff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca406f950 con 0x7faca40b0a10 2023-10-10T21:20:33.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.757+0000 7facaadff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca406e980 con 0x7faca4155c10 2023-10-10T21:20:33.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.757+0000 7facaadff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca4068d40 con 0x7faca41578b0 2023-10-10T21:20:33.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.757+0000 7faca8b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 0x7faca406f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca8b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 0x7faca406f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33480/0 (socket says 172.21.15.154:33480) 2023-10-10T21:20:33.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca8b9b700 1 -- 172.21.15.154:0/3972209076 learned_addr learned my addr 172.21.15.154:0/3972209076 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:33.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca8b9b700 1 -- 172.21.15.154:0/3972209076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faca41578b0 msgr2=0x7faca415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca8b9b700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faca41578b0 0x7faca415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca8b9b700 1 -- 172.21.15.154:0/3972209076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faca4155c10 msgr2=0x7faca416c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:33.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca8b9b700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faca4155c10 0x7faca416c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:33.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca8b9b700 1 -- 172.21.15.154:0/3972209076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c00ab30 con 0x7faca40b0a10 2023-10-10T21:20:33.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca8b9b700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 0x7faca406f410 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c590 tx=0x7fac9800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca0ff9700 1 -- 172.21.15.154:0/3972209076 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac98011590 con 0x7faca40b0a10 2023-10-10T21:20:33.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca0ff9700 1 -- 172.21.15.154:0/3972209076 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac980116f0 con 0x7faca40b0a10 2023-10-10T21:20:33.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca406dd70 con 0x7faca40b0a10 2023-10-10T21:20:33.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7faca0ff9700 1 -- 172.21.15.154:0/3972209076 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac98011ab0 con 0x7faca40b0a10 2023-10-10T21:20:33.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.758+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca406e330 con 0x7faca40b0a10 2023-10-10T21:20:33.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.759+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca404c3c0 con 0x7faca40b0a10 2023-10-10T21:20:33.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.760+0000 7faca0ff9700 1 -- 172.21.15.154:0/3972209076 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac9801b3b0 con 0x7faca40b0a10 2023-10-10T21:20:33.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.761+0000 7faca0ff9700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fac88066f30 0x7fac880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:33.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.761+0000 7faca0ff9700 1 -- 172.21.15.154:0/3972209076 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fac98083cf0 con 0x7faca40b0a10 2023-10-10T21:20:33.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.761+0000 7faca3fff700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fac88066f30 0x7fac880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:33.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.762+0000 7faca3fff700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fac88066f30 0x7fac880693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac900058d0 tx=0x7fac900079d0 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:33.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:33.765+0000 7faca0ff9700 1 -- 172.21.15.154:0/3972209076 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac98050d30 con 0x7faca40b0a10 2023-10-10T21:20:34.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.007+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faca40ad5c0 con 0x7faca40b0a10 2023-10-10T21:20:34.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.008+0000 7faca0ff9700 1 -- 172.21.15.154:0/3972209076 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7fac98017070 con 0x7faca40b0a10 2023-10-10T21:20:34.010 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:20:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fac88066f30 msgr2=0x7fac880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fac88066f30 0x7fac880693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac900058d0 tx=0x7fac900079d0 comp rx=0 tx=0).stop 2023-10-10T21:20:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 msgr2=0x7faca406f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 0x7faca406f410 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c590 tx=0x7fac9800c950 comp rx=0 tx=0).stop 2023-10-10T21:20:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 shutdown_connections 2023-10-10T21:20:34.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fac88066f30 0x7fac880693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:34.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faca41578b0 0x7faca415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:34.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faca40b0a10 0x7faca406f410 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:34.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 --2- 172.21.15.154:0/3972209076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faca4155c10 0x7faca416c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:34.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.010+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 >> 172.21.15.154:0/3972209076 conn(0x7faca406a320 msgr2=0x7faca40b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:34.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.011+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 shutdown_connections 2023-10-10T21:20:34.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:34.011+0000 7facaadff700 1 -- 172.21.15.154:0/3972209076 wait complete. 2023-10-10T21:20:34.030 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T21:20:34.031 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:20:34.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T21:20:34.031 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T21:20:34.032 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T21:20:34.032 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T21:20:34.033 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T21:20:34.033 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:20:34.034 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:20:34.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:20:34.035 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T21:20:34.073 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:20:34.074 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:20:34.074 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:20:34.074 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:20:34.075 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:20:34.075 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:20:34.075 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:20:34.076 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:20:34.076 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T21:20:34.076 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:20:34.077 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:20:34.077 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T21:20:34.077 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:20:34.078 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:20:34.078 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:20:34.079 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:20:34.079 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:20:34.079 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 41180sec preferred_lft 41180sec 2023-10-10T21:20:34.080 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T21:20:34.080 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:20:34.080 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:20:34.081 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:20:34.081 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T21:20:34.081 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:20:34.082 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T21:20:34.082 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:20:34.082 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:20:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T21:20:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T21:20:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:20:34.084 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:20:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T21:20:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T21:20:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:20:34.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:20:34.086 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:20:34.181 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T21:20:34.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:20:34.185 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T21:20:34.226 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T21:20:34.227 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:20:34.227 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:20:34.227 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:20:34.227 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:20:34.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:20:34.228 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:20:34.229 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:20:34.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:20:34.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:20:34.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:20:34.231 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:20:34.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:20:34.429 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:20:34.471 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T21:20:34.471 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T21:20:34.472 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:20:34.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:20:34.473 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T21:20:34.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:20:34.581 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T21:20:34.620 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:20:34.622 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:20:34.622 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:20:34.699 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:20:34.699 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:20:34.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:20:34.836 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:20:34.836 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:20:34.836 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:20:34.853 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:20:34.853 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:20:34.853 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:20:34.854 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:20:34.854 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:20:34.874 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:20:34.874 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:20:34.875 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:20:34.875 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:20:34.875 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:20:34.875 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:20:34.876 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:20:34.876 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:20:34.878 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:20:34.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:20:34.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:20:34.944 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T21:20:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.130+0000 7fbf907ff700 1 Processor -- start 2023-10-10T21:20:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.130+0000 7fbf907ff700 1 -- start start 2023-10-10T21:20:35.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf907ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf880cbf30 0x7fbf880ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf907ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 0x7fbf880b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf907ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf880cc300 con 0x7fbf8815a270 2023-10-10T21:20:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf907ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf88156bf0 con 0x7fbf880cbf30 2023-10-10T21:20:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf907ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880ae950 con 0x7fbf880ccf90 2023-10-10T21:20:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf8e59b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf880cbf30 0x7fbf880ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf8ed9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbf8815a270 0x7fbf880c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43252/0 (socket says 172.21.15.154:43252) 2023-10-10T21:20:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf8ed9c700 1 -- 172.21.15.154:0/4017681544 learned_addr learned my addr 172.21.15.154:0/4017681544 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf8dd9a700 1 --2- 172.21.15.154:0/4017681544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 0x7fbf880b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf8e59b700 1 -- 172.21.15.154:0/4017681544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 msgr2=0x7fbf880b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf8e59b700 1 --2- 172.21.15.154:0/4017681544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 0x7fbf880b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf8e59b700 1 -- 172.21.15.154:0/4017681544 >> v1:172.21.15.154:6789/0 conn(0x7fbf8815a270 legacy=0x7fbf880c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf8e59b700 1 -- 172.21.15.154:0/4017681544 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf880ad370 con 0x7fbf880cbf30 2023-10-10T21:20:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.132+0000 7fbf8d599700 1 -- 172.21.15.154:0/4017681544 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114345093 0 0) 0x7fbf880cc300 con 0x7fbf8815a270 2023-10-10T21:20:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.133+0000 7fbf8e59b700 1 --2- 172.21.15.154:0/4017681544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 0x7fbf880ae410 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009910 tx=0x7fbf840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3e02abcf4e8f35 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.133+0000 7fbf8d599700 1 -- 172.21.15.154:0/4017681544 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400b820 con 0x7fbf880cbf30 2023-10-10T21:20:35.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.133+0000 7fbf8d599700 1 -- 172.21.15.154:0/4017681544 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8400b980 con 0x7fbf880cbf30 2023-10-10T21:20:35.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.133+0000 7fbf8d599700 1 -- 172.21.15.154:0/4017681544 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400bd20 con 0x7fbf880cbf30 2023-10-10T21:20:35.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.133+0000 7fbf907ff700 1 -- 172.21.15.154:0/4017681544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 msgr2=0x7fbf880ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.133+0000 7fbf907ff700 1 --2- 172.21.15.154:0/4017681544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 0x7fbf880ae410 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009910 tx=0x7fbf840091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.133+0000 7fbf907ff700 1 -- 172.21.15.154:0/4017681544 shutdown_connections 2023-10-10T21:20:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.134+0000 7fbf907ff700 1 --2- 172.21.15.154:0/4017681544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 0x7fbf880ae410 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.134+0000 7fbf907ff700 1 --2- 172.21.15.154:0/4017681544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 0x7fbf880b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.134+0000 7fbf907ff700 1 -- 172.21.15.154:0/4017681544 >> 172.21.15.154:0/4017681544 conn(0x7fbf8806a320 msgr2=0x7fbf880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.134+0000 7fbf907ff700 1 -- 172.21.15.154:0/4017681544 shutdown_connections 2023-10-10T21:20:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.134+0000 7fbf907ff700 1 -- 172.21.15.154:0/4017681544 wait complete. 2023-10-10T21:20:35.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.135+0000 7fbf907ff700 1 Processor -- start 2023-10-10T21:20:35.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.135+0000 7fbf907ff700 1 -- start start 2023-10-10T21:20:35.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf907ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 0x7fbf8814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf907ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 0x7fbf880c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf907ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8815a270 0x7fbf880a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf907ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8814c620 con 0x7fbf880cbf30 2023-10-10T21:20:35.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf907ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880c7d80 con 0x7fbf8815a270 2023-10-10T21:20:35.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf907ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880c7170 con 0x7fbf880ccf90 2023-10-10T21:20:35.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf8e59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 0x7fbf8814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf8e59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 0x7fbf8814c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33498/0 (socket says 172.21.15.154:33498) 2023-10-10T21:20:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf8e59b700 1 -- 172.21.15.154:0/3239988632 learned_addr learned my addr 172.21.15.154:0/3239988632 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf8ed9c700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8815a270 0x7fbf880a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.136+0000 7fbf8dd9a700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 0x7fbf880c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf8e59b700 1 -- 172.21.15.154:0/3239988632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 msgr2=0x7fbf880c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf8e59b700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 0x7fbf880c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf8e59b700 1 -- 172.21.15.154:0/3239988632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8815a270 msgr2=0x7fbf880a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf8e59b700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8815a270 0x7fbf880a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf8e59b700 1 -- 172.21.15.154:0/3239988632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84009420 con 0x7fbf880cbf30 2023-10-10T21:20:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf8ed9c700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8815a270 0x7fbf880a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:20:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf8e59b700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 0x7fbf8814c0e0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400b3c0 tx=0x7fbf84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/3239988632 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84024440 con 0x7fbf880cbf30 2023-10-10T21:20:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/3239988632 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf840245c0 con 0x7fbf880cbf30 2023-10-10T21:20:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/3239988632 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84024980 con 0x7fbf880cbf30 2023-10-10T21:20:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf880c7450 con 0x7fbf880cbf30 2023-10-10T21:20:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.137+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf880c7a10 con 0x7fbf880cbf30 2023-10-10T21:20:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.138+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8804c3c0 con 0x7fbf880cbf30 2023-10-10T21:20:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.139+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/3239988632 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf8401a420 con 0x7fbf880cbf30 2023-10-10T21:20:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.141+0000 7fbf7e7fc700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c066f30 0x7fbf6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.141+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/3239988632 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fbf840864f0 con 0x7fbf880cbf30 2023-10-10T21:20:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.141+0000 7fbf8dd9a700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c066f30 0x7fbf6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.141+0000 7fbf8dd9a700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c066f30 0x7fbf6c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf880b0a30 tx=0x7fbf78008040 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.145+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/3239988632 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf84053530 con 0x7fbf880cbf30 2023-10-10T21:20:35.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.365+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 --> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf880c7ec0 con 0x7fbf6c066f30 2023-10-10T21:20:35.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.366+0000 7fbf7e7fc700 1 -- 172.21.15.154:0/3239988632 <== mgr.6383 v2:172.21.15.154:6835/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fbf7800f6e0 con 0x7fbf6c066f30 2023-10-10T21:20:35.368 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:20:35.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:20:35.368 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T21:20:35.368 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:20:35.368 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:20:35.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.368+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c066f30 msgr2=0x7fbf6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.368+0000 7fbf907ff700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c066f30 0x7fbf6c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf880b0a30 tx=0x7fbf78008040 comp rx=0 tx=0).stop 2023-10-10T21:20:35.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 msgr2=0x7fbf8814c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 0x7fbf8814c0e0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400b3c0 tx=0x7fbf84017000 comp rx=0 tx=0).stop 2023-10-10T21:20:35.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 shutdown_connections 2023-10-10T21:20:35.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8815a270 0x7fbf880a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf880cbf30 0x7fbf8814c0e0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fbf6c066f30 0x7fbf6c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 --2- 172.21.15.154:0/3239988632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf880ccf90 0x7fbf880c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 >> 172.21.15.154:0/3239988632 conn(0x7fbf8806a320 msgr2=0x7fbf8806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:35.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 shutdown_connections 2023-10-10T21:20:35.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.369+0000 7fbf907ff700 1 -- 172.21.15.154:0/3239988632 wait complete. 2023-10-10T21:20:35.387 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T21:20:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.570+0000 7fdb5e1ff700 1 Processor -- start 2023-10-10T21:20:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.570+0000 7fdb5e1ff700 1 -- start start 2023-10-10T21:20:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.571+0000 7fdb5e1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdb58155eb0 0x7fdb5806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.571+0000 7fdb5e1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5806eb90 con 0x7fdb58069e80 2023-10-10T21:20:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.571+0000 7fdb5e1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5806ee70 con 0x7fdb580c70b0 2023-10-10T21:20:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.571+0000 7fdb5e1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5806f150 con 0x7fdb58155eb0 2023-10-10T21:20:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb57fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdb58069e80 0x7fdb580ca4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43262/0 (socket says 172.21.15.154:43262) 2023-10-10T21:20:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb57fff700 1 -- 172.21.15.154:0/669318663 learned_addr learned my addr 172.21.15.154:0/669318663 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb577fe700 1 --2- 172.21.15.154:0/669318663 >> v2:172.21.15.179:3300/0 conn(0x7fdb58155eb0 0x7fdb5806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb567fc700 1 -- 172.21.15.154:0/669318663 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367830516 0 0) 0x7fdb5806eb90 con 0x7fdb58069e80 2023-10-10T21:20:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb567fc700 1 -- 172.21.15.154:0/669318663 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb40004680 con 0x7fdb58069e80 2023-10-10T21:20:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb567fc700 1 -- 172.21.15.154:0/669318663 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747595992 0 0) 0x7fdb5806ee70 con 0x7fdb580c70b0 2023-10-10T21:20:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb567fc700 1 -- 172.21.15.154:0/669318663 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb5806eb90 con 0x7fdb580c70b0 2023-10-10T21:20:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb577fe700 1 -- 172.21.15.154:0/669318663 >> v1:172.21.15.179:6789/0 conn(0x7fdb580c70b0 legacy=0x7fdb58069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb577fe700 1 -- 172.21.15.154:0/669318663 >> v1:172.21.15.154:6789/0 conn(0x7fdb58069e80 legacy=0x7fdb580ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.572+0000 7fdb577fe700 1 -- 172.21.15.154:0/669318663 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5806f430 con 0x7fdb58155eb0 2023-10-10T21:20:35.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.573+0000 7fdb577fe700 1 --2- 172.21.15.154:0/669318663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb58155eb0 0x7fdb5806e240 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdb480098e0 tx=0x7fdb480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa7b49887e47ee06 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:35.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.573+0000 7fdb567fc700 1 -- 172.21.15.154:0/669318663 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48011630 con 0x7fdb58155eb0 2023-10-10T21:20:35.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.573+0000 7fdb567fc700 1 -- 172.21.15.154:0/669318663 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48011790 con 0x7fdb58155eb0 2023-10-10T21:20:35.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.573+0000 7fdb567fc700 1 -- 172.21.15.154:0/669318663 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48011b30 con 0x7fdb58155eb0 2023-10-10T21:20:35.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.574+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/669318663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb58155eb0 msgr2=0x7fdb5806e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.574+0000 7fdb5e1ff700 1 --2- 172.21.15.154:0/669318663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb58155eb0 0x7fdb5806e240 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdb480098e0 tx=0x7fdb480091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.574+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/669318663 shutdown_connections 2023-10-10T21:20:35.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.574+0000 7fdb5e1ff700 1 --2- 172.21.15.154:0/669318663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb58155eb0 0x7fdb5806e240 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.574+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/669318663 >> 172.21.15.154:0/669318663 conn(0x7fdb58068e10 msgr2=0x7fdb580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.574+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/669318663 shutdown_connections 2023-10-10T21:20:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.574+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/669318663 wait complete. 2023-10-10T21:20:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.575+0000 7fdb5e1ff700 1 Processor -- start 2023-10-10T21:20:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.575+0000 7fdb5e1ff700 1 -- start start 2023-10-10T21:20:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.576+0000 7fdb5e1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb58069e80 0x7fdb580c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.576+0000 7fdb5e1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb580c70b0 0x7fdb5815cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.576+0000 7fdb5e1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb58155eb0 0x7fdb5815ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.576+0000 7fdb5e1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5815cff0 con 0x7fdb58155eb0 2023-10-10T21:20:35.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.576+0000 7fdb5e1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580c3c10 con 0x7fdb58069e80 2023-10-10T21:20:35.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.576+0000 7fdb5e1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580c3ef0 con 0x7fdb580c70b0 2023-10-10T21:20:35.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.576+0000 7fdb57fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb58155eb0 0x7fdb5815ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.576+0000 7fdb57fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb58155eb0 0x7fdb5815ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33506/0 (socket says 172.21.15.154:33506) 2023-10-10T21:20:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.576+0000 7fdb57fff700 1 -- 172.21.15.154:0/540432614 learned_addr learned my addr 172.21.15.154:0/540432614 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb577fe700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb58069e80 0x7fdb580c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb56ffd700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb580c70b0 0x7fdb5815cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb57fff700 1 -- 172.21.15.154:0/540432614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb580c70b0 msgr2=0x7fdb5815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb57fff700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb580c70b0 0x7fdb5815cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb57fff700 1 -- 172.21.15.154:0/540432614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb58069e80 msgr2=0x7fdb580c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb57fff700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb58069e80 0x7fdb580c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb57fff700 1 -- 172.21.15.154:0/540432614 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48009420 con 0x7fdb58155eb0 2023-10-10T21:20:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb57fff700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb58155eb0 0x7fdb5815ddc0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fdb50001460 tx=0x7fdb50001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb3f7fe700 1 -- 172.21.15.154:0/540432614 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000a870 con 0x7fdb58155eb0 2023-10-10T21:20:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb3f7fe700 1 -- 172.21.15.154:0/540432614 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5000a9f0 con 0x7fdb58155eb0 2023-10-10T21:20:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb3f7fe700 1 -- 172.21.15.154:0/540432614 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000adb0 con 0x7fdb58155eb0 2023-10-10T21:20:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.577+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb580c41d0 con 0x7fdb58155eb0 2023-10-10T21:20:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.578+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb580c4790 con 0x7fdb58155eb0 2023-10-10T21:20:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.578+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5804c3c0 con 0x7fdb58155eb0 2023-10-10T21:20:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.579+0000 7fdb3f7fe700 1 -- 172.21.15.154:0/540432614 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb50007300 con 0x7fdb58155eb0 2023-10-10T21:20:35.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.580+0000 7fdb3f7fe700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdb44066f30 0x7fdb440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:35.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.580+0000 7fdb3f7fe700 1 -- 172.21.15.154:0/540432614 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fdb50084a40 con 0x7fdb58155eb0 2023-10-10T21:20:35.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.581+0000 7fdb577fe700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdb44066f30 0x7fdb440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:35.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.581+0000 7fdb577fe700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdb44066f30 0x7fdb440693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb480093f0 tx=0x7fdb48017000 comp rx=0 tx=0).ready entity=mgr.6383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:35.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.585+0000 7fdb3f7fe700 1 -- 172.21.15.154:0/540432614 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb50051b00 con 0x7fdb58155eb0 2023-10-10T21:20:35.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:35.831+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fdb58156280 con 0x7fdb58155eb0 2023-10-10T21:20:36.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.168+0000 7fdb3f7fe700 1 -- 172.21.15.154:0/540432614 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 54) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fdb50051ed0 con 0x7fdb58155eb0 2023-10-10T21:20:36.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.169+0000 7fdb3f7fe700 1 -- 172.21.15.154:0/540432614 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v54) v1 ==== 92+0+0 (secure 0 0 0) 0x7fdb5005c9b0 con 0x7fdb58155eb0 2023-10-10T21:20:36.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdb44066f30 msgr2=0x7fdb440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdb44066f30 0x7fdb440693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb480093f0 tx=0x7fdb48017000 comp rx=0 tx=0).stop 2023-10-10T21:20:36.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb58155eb0 msgr2=0x7fdb5815ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb58155eb0 0x7fdb5815ddc0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fdb50001460 tx=0x7fdb50001a60 comp rx=0 tx=0).stop 2023-10-10T21:20:36.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 shutdown_connections 2023-10-10T21:20:36.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb58155eb0 0x7fdb5815ddc0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb58069e80 0x7fdb580c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fdb44066f30 0x7fdb440693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 --2- 172.21.15.154:0/540432614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb580c70b0 0x7fdb5815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 >> 172.21.15.154:0/540432614 conn(0x7fdb58068e10 msgr2=0x7fdb580adb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:36.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 shutdown_connections 2023-10-10T21:20:36.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.172+0000 7fdb5e1ff700 1 -- 172.21.15.154:0/540432614 wait complete. 2023-10-10T21:20:36.191 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T21:20:36.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.387+0000 7f39d6f9d700 1 Processor -- start 2023-10-10T21:20:36.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.387+0000 7f39d6f9d700 1 -- start start 2023-10-10T21:20:36.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d6f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f39d00b4e70 0x7f39d00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d6f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39d00b16d0 0x7f39d00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d6f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 0x7f39d015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d6f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d00b2080 con 0x7f39d00b16d0 2023-10-10T21:20:36.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d6f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d00cfb00 con 0x7f39d00b4e70 2023-10-10T21:20:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d6f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00b5c40 con 0x7f39d015d240 2023-10-10T21:20:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d579a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39d00b16d0 0x7f39d00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d5f9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f39d00b4e70 0x7f39d00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d679c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 0x7f39d015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d579a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39d00b16d0 0x7f39d00b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46468/0 (socket says 172.21.15.154:46468) 2023-10-10T21:20:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.388+0000 7f39d579a700 1 -- 172.21.15.154:0/507704345 learned_addr learned my addr 172.21.15.154:0/507704345 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:36.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.389+0000 7f39d5f9b700 1 -- 172.21.15.154:0/507704345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 msgr2=0x7f39d015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:36.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.389+0000 7f39d5f9b700 1 --2- 172.21.15.154:0/507704345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 0x7f39d015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.389+0000 7f39d5f9b700 1 -- 172.21.15.154:0/507704345 >> v2:172.21.15.154:3300/0 conn(0x7f39d00b16d0 msgr2=0x7f39d00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:36.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.389+0000 7f39d5f9b700 1 --2- 172.21.15.154:0/507704345 >> v2:172.21.15.154:3300/0 conn(0x7f39d00b16d0 0x7f39d00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.389+0000 7f39d5f9b700 1 -- 172.21.15.154:0/507704345 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00b5f20 con 0x7f39d00b4e70 2023-10-10T21:20:36.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.389+0000 7f39d579a700 1 --2- 172.21.15.154:0/507704345 >> v2:172.21.15.154:3300/0 conn(0x7f39d00b16d0 0x7f39d00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.389+0000 7f39d5f9b700 1 --2- 172.21.15.154:0/507704345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 0x7f39d00ccff0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f39d0064910 tx=0x7f39cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c05d58265f1a42ca server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.389+0000 7f39d4f99700 1 -- 172.21.15.154:0/507704345 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc011630 con 0x7f39d00b4e70 2023-10-10T21:20:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d4f99700 1 -- 172.21.15.154:0/507704345 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc0117b0 con 0x7f39d00b4e70 2023-10-10T21:20:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d4f99700 1 -- 172.21.15.154:0/507704345 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc011b70 con 0x7f39d00b4e70 2023-10-10T21:20:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d6f9d700 1 -- 172.21.15.154:0/507704345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 msgr2=0x7f39d00ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/507704345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 0x7f39d00ccff0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f39d0064910 tx=0x7f39cc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d6f9d700 1 -- 172.21.15.154:0/507704345 shutdown_connections 2023-10-10T21:20:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/507704345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 0x7f39d015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/507704345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 0x7f39d00ccff0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/507704345 >> v2:172.21.15.154:3300/0 conn(0x7f39d00b16d0 0x7f39d00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d6f9d700 1 -- 172.21.15.154:0/507704345 >> 172.21.15.154:0/507704345 conn(0x7f39d00d10c0 msgr2=0x7f39d00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d6f9d700 1 -- 172.21.15.154:0/507704345 shutdown_connections 2023-10-10T21:20:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.390+0000 7f39d6f9d700 1 -- 172.21.15.154:0/507704345 wait complete. 2023-10-10T21:20:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.392+0000 7f39d6f9d700 1 Processor -- start 2023-10-10T21:20:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.392+0000 7f39d6f9d700 1 -- start start 2023-10-10T21:20:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d6f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d00b16d0 0x7f39d014bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d6f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 0x7f39d00cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d6f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 0x7f39d015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d6f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00c6360 con 0x7f39d00b16d0 2023-10-10T21:20:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d6f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00c6640 con 0x7f39d00b4e70 2023-10-10T21:20:36.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d6f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00c6920 con 0x7f39d015d240 2023-10-10T21:20:36.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d5f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d00b16d0 0x7f39d014bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d5f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d00b16d0 0x7f39d014bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46474/0 (socket says 172.21.15.154:46474) 2023-10-10T21:20:36.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d5f9b700 1 -- 172.21.15.154:0/918989826 learned_addr learned my addr 172.21.15.154:0/918989826 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:36.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d579a700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 0x7f39d00cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d679c700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 0x7f39d015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.393+0000 7f39d5f9b700 1 -- 172.21.15.154:0/918989826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 msgr2=0x7f39d015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39d5f9b700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 0x7f39d015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39d5f9b700 1 -- 172.21.15.154:0/918989826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 msgr2=0x7f39d00cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39d5f9b700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 0x7f39d00cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39d5f9b700 1 -- 172.21.15.154:0/918989826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c00094f0 con 0x7f39d00b16d0 2023-10-10T21:20:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39d579a700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 0x7f39d00cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39d5f9b700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d00b16d0 0x7f39d014bfd0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f39cc013000 tx=0x7f39cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39c5ffb700 1 -- 172.21.15.154:0/918989826 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc01f070 con 0x7f39d00b16d0 2023-10-10T21:20:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39c5ffb700 1 -- 172.21.15.154:0/918989826 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc011920 con 0x7f39d00b16d0 2023-10-10T21:20:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39c5ffb700 1 -- 172.21.15.154:0/918989826 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc023410 con 0x7f39d00b16d0 2023-10-10T21:20:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc009420 con 0x7f39d00b16d0 2023-10-10T21:20:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.394+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d00c6ee0 con 0x7f39d00b16d0 2023-10-10T21:20:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.395+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d0088990 con 0x7f39d00b16d0 2023-10-10T21:20:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.396+0000 7f39c5ffb700 1 -- 172.21.15.154:0/918989826 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 54) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f39cc02c440 con 0x7f39d00b16d0 2023-10-10T21:20:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.397+0000 7f39c5ffb700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f39b4066fb0 0x7f39b4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.397+0000 7f39d579a700 1 -- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f39b4066fb0 msgr2=0x7f39b4069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:20:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.397+0000 7f39c5ffb700 1 -- 172.21.15.154:0/918989826 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f39cc0858c0 con 0x7f39d00b16d0 2023-10-10T21:20:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.397+0000 7f39d579a700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f39b4066fb0 0x7f39b4069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:36.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.401+0000 7f39c5ffb700 1 -- 172.21.15.154:0/918989826 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39cc052960 con 0x7f39d00b16d0 2023-10-10T21:20:36.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.598+0000 7f39d579a700 1 -- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f39b4066fb0 msgr2=0x7f39b4069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:20:36.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.598+0000 7f39d579a700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f39b4066fb0 0x7f39b4069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:36.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.601+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f39d004bb80 con 0x7f39d00b16d0 2023-10-10T21:20:36.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.606+0000 7f39c5ffb700 1 -- 172.21.15.154:0/918989826 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f39cc055f80 con 0x7f39d00b16d0 2023-10-10T21:20:36.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f39b4066fb0 msgr2=0x7f39b4069460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:36.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f39b4066fb0 0x7f39b4069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d00b16d0 msgr2=0x7f39d014bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d00b16d0 0x7f39d014bfd0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f39cc013000 tx=0x7f39cc017000 comp rx=0 tx=0).stop 2023-10-10T21:20:36.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 shutdown_connections 2023-10-10T21:20:36.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f39b4066fb0 0x7f39b4069460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d015d240 0x7f39d015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d00b16d0 0x7f39d014bfd0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 --2- 172.21.15.154:0/918989826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d00b4e70 0x7f39d00cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 >> 172.21.15.154:0/918989826 conn(0x7f39d00d10c0 msgr2=0x7f39d015c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:36.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 shutdown_connections 2023-10-10T21:20:36.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.609+0000 7f39d6f9d700 1 -- 172.21.15.154:0/918989826 wait complete. 2023-10-10T21:20:36.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T21:20:36.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.817+0000 7f6f6ef9d700 1 Processor -- start 2023-10-10T21:20:36.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.818+0000 7f6f6ef9d700 1 -- start start 2023-10-10T21:20:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.819+0000 7f6f6ef9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f6815a3b0 0x7f6f6815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.819+0000 7f6f6ef9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f680aea70 con 0x7f6f680aef00 2023-10-10T21:20:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.819+0000 7f6f6ef9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6815dad0 con 0x7f6f6806e470 2023-10-10T21:20:36.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.819+0000 7f6f6ef9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680ae480 con 0x7f6f6815a3b0 2023-10-10T21:20:36.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.819+0000 7f6f6d79a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6f680aef00 0x7f6f6815d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57518/0 (socket says 172.21.15.154:57518) 2023-10-10T21:20:36.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.819+0000 7f6f6d79a700 1 -- 172.21.15.154:0/310556073 learned_addr learned my addr 172.21.15.154:0/310556073 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:36.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.819+0000 7f6f6df9b700 1 --2- 172.21.15.154:0/310556073 >> v2:172.21.15.179:3300/0 conn(0x7f6f6815a3b0 0x7f6f6815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6cf99700 1 -- 172.21.15.154:0/310556073 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854837237 0 0) 0x7f6f680aea70 con 0x7f6f680aef00 2023-10-10T21:20:36.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6cf99700 1 -- 172.21.15.154:0/310556073 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f54003570 con 0x7f6f680aef00 2023-10-10T21:20:36.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6cf99700 1 -- 172.21.15.154:0/310556073 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546250302 0 0) 0x7f6f6815dad0 con 0x7f6f6806e470 2023-10-10T21:20:36.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6cf99700 1 -- 172.21.15.154:0/310556073 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f680aea70 con 0x7f6f6806e470 2023-10-10T21:20:36.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6df9b700 1 -- 172.21.15.154:0/310556073 >> v1:172.21.15.179:6789/0 conn(0x7f6f6806e470 legacy=0x7f6f680c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6df9b700 1 -- 172.21.15.154:0/310556073 >> v1:172.21.15.154:6789/0 conn(0x7f6f680aef00 legacy=0x7f6f6815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6df9b700 1 -- 172.21.15.154:0/310556073 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6815acc0 con 0x7f6f6815a3b0 2023-10-10T21:20:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6df9b700 1 --2- 172.21.15.154:0/310556073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6815a3b0 0x7f6f6815a780 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6f640098e0 tx=0x7f6f640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbc1627bfb4f5dbf server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6cf99700 1 -- 172.21.15.154:0/310556073 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64011630 con 0x7f6f6815a3b0 2023-10-10T21:20:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6cf99700 1 -- 172.21.15.154:0/310556073 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64011790 con 0x7f6f6815a3b0 2023-10-10T21:20:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.820+0000 7f6f6cf99700 1 -- 172.21.15.154:0/310556073 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64011b30 con 0x7f6f6815a3b0 2023-10-10T21:20:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.821+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/310556073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6815a3b0 msgr2=0x7f6f6815a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.821+0000 7f6f6ef9d700 1 --2- 172.21.15.154:0/310556073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6815a3b0 0x7f6f6815a780 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6f640098e0 tx=0x7f6f640091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.821+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/310556073 shutdown_connections 2023-10-10T21:20:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.821+0000 7f6f6ef9d700 1 --2- 172.21.15.154:0/310556073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6815a3b0 0x7f6f6815a780 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.821+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/310556073 >> 172.21.15.154:0/310556073 conn(0x7f6f680c9f70 msgr2=0x7f6f6806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.821+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/310556073 shutdown_connections 2023-10-10T21:20:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.821+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/310556073 wait complete. 2023-10-10T21:20:36.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.823+0000 7f6f6ef9d700 1 Processor -- start 2023-10-10T21:20:36.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.823+0000 7f6f6ef9d700 1 -- start start 2023-10-10T21:20:36.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6ef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6806e470 0x7f6f680cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6ef9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f680aef00 0x7f6f681512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6ef9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6815a3b0 0x7f6f68151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6ef9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68151d40 con 0x7f6f680aef00 2023-10-10T21:20:36.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6ef9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68157c60 con 0x7f6f6815a3b0 2023-10-10T21:20:36.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6ef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68157f40 con 0x7f6f6806e470 2023-10-10T21:20:36.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6d79a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f680aef00 0x7f6f681512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6df9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6806e470 0x7f6f680cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6d79a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f680aef00 0x7f6f681512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46476/0 (socket says 172.21.15.154:46476) 2023-10-10T21:20:36.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6d79a700 1 -- 172.21.15.154:0/3555766765 learned_addr learned my addr 172.21.15.154:0/3555766765 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:36.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.824+0000 7f6f6e79c700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6815a3b0 0x7f6f68151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:36.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f6d79a700 1 -- 172.21.15.154:0/3555766765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6806e470 msgr2=0x7f6f680cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f6d79a700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6806e470 0x7f6f680cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f6d79a700 1 -- 172.21.15.154:0/3555766765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6815a3b0 msgr2=0x7f6f68151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:36.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f6d79a700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6815a3b0 0x7f6f68151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:36.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f6d79a700 1 -- 172.21.15.154:0/3555766765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f64009420 con 0x7f6f680aef00 2023-10-10T21:20:36.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f6d79a700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f680aef00 0x7f6f681512c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800c790 tx=0x7f6f58007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:36.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f5dffb700 1 -- 172.21.15.154:0/3555766765 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58005b30 con 0x7f6f680aef00 2023-10-10T21:20:36.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f5dffb700 1 -- 172.21.15.154:0/3555766765 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58005cd0 con 0x7f6f680aef00 2023-10-10T21:20:36.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f68158220 con 0x7f6f680aef00 2023-10-10T21:20:36.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f5dffb700 1 -- 172.21.15.154:0/3555766765 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58007320 con 0x7f6f680aef00 2023-10-10T21:20:36.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.825+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f681587e0 con 0x7f6f680aef00 2023-10-10T21:20:36.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.826+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6806cfa0 con 0x7f6f680aef00 2023-10-10T21:20:36.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.827+0000 7f6f5dffb700 1 -- 172.21.15.154:0/3555766765 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 54) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6f58012400 con 0x7f6f680aef00 2023-10-10T21:20:36.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.828+0000 7f6f5dffb700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f6f4c066f80 0x7f6f4c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:36.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.829+0000 7f6f6df9b700 1 -- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f6f4c066f80 msgr2=0x7f6f4c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:20:36.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.829+0000 7f6f5dffb700 1 -- 172.21.15.154:0/3555766765 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6f58083bb0 con 0x7f6f680aef00 2023-10-10T21:20:36.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.829+0000 7f6f6df9b700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f6f4c066f80 0x7f6f4c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:36.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:36.833+0000 7f6f5dffb700 1 -- 172.21.15.154:0/3555766765 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f58050d40 con 0x7f6f680aef00 2023-10-10T21:20:37.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.030+0000 7f6f6df9b700 1 -- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f6f4c066f80 msgr2=0x7f6f4c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:20:37.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.030+0000 7f6f6df9b700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f6f4c066f80 0x7f6f4c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:37.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.033+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f6f6815dd30 con 0x7f6f680aef00 2023-10-10T21:20:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.039+0000 7f6f5dffb700 1 -- 172.21.15.154:0/3555766765 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6f58017020 con 0x7f6f680aef00 2023-10-10T21:20:37.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f6f4c066f80 msgr2=0x7f6f4c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f6f4c066f80 0x7f6f4c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f680aef00 msgr2=0x7f6f681512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f680aef00 0x7f6f681512c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800c790 tx=0x7f6f58007e80 comp rx=0 tx=0).stop 2023-10-10T21:20:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 shutdown_connections 2023-10-10T21:20:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6815a3b0 0x7f6f68151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f6f4c066f80 0x7f6f4c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6806e470 0x7f6f680cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 --2- 172.21.15.154:0/3555766765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f680aef00 0x7f6f681512c0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 >> 172.21.15.154:0/3555766765 conn(0x7f6f680c9f70 msgr2=0x7f6f680704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 shutdown_connections 2023-10-10T21:20:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.042+0000 7f6f6ef9d700 1 -- 172.21.15.154:0/3555766765 wait complete. 2023-10-10T21:20:37.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:37.063 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-10T21:20:37.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-10T21:20:37.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.336+0000 7f549139d700 1 Processor -- start 2023-10-10T21:20:37.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.337+0000 7f549139d700 1 -- start start 2023-10-10T21:20:37.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f549139d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f548c0cb560 0x7f548c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:37.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f549139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:37.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f549139d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c159db0 con 0x7f548c0cc970 2023-10-10T21:20:37.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f549139d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c06aa30 con 0x7f548c0cb560 2023-10-10T21:20:37.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f549139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0cce10 con 0x7f548c069ec0 2023-10-10T21:20:37.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f5490b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:37.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f548bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f548c0cb560 0x7f548c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:37.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f5490b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c15ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:53562/0 (socket says 172.21.15.154:53562) 2023-10-10T21:20:37.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f548bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f548c0cb560 0x7f548c0cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:41888/0 (socket says 172.21.15.154:41888) 2023-10-10T21:20:37.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f5490b9c700 1 -- 172.21.15.154:0/2092446834 learned_addr learned my addr 172.21.15.154:0/2092446834 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:37.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.338+0000 7f548b7fe700 1 --1- 172.21.15.154:0/2092446834 >> v1:172.21.15.179:6789/0 conn(0x7f548c0cc970 0x7f548c0697b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44022/0 (socket says 172.21.15.154:44022) 2023-10-10T21:20:37.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.339+0000 7f5490b9c700 1 -- 172.21.15.154:0/2092446834 >> v2:172.21.15.179:3300/0 conn(0x7f548c0cb560 msgr2=0x7f548c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:37.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.339+0000 7f5490b9c700 1 --2- 172.21.15.154:0/2092446834 >> v2:172.21.15.179:3300/0 conn(0x7f548c0cb560 0x7f548c0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.339+0000 7f5490b9c700 1 -- 172.21.15.154:0/2092446834 >> v1:172.21.15.179:6789/0 conn(0x7f548c0cc970 legacy=0x7f548c0697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:37.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.339+0000 7f5490b9c700 1 -- 172.21.15.154:0/2092446834 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c06a470 con 0x7f548c069ec0 2023-10-10T21:20:37.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.339+0000 7f5490b9c700 1 --2- 172.21.15.154:0/2092446834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c15ba60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5484009f50 tx=0x7f5484009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca213fdc714dab10 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:37.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.339+0000 7f548affd700 1 -- 172.21.15.154:0/2092446834 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400e070 con 0x7f548c069ec0 2023-10-10T21:20:37.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.339+0000 7f548affd700 1 -- 172.21.15.154:0/2092446834 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548400b9c0 con 0x7f548c069ec0 2023-10-10T21:20:37.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.339+0000 7f548affd700 1 -- 172.21.15.154:0/2092446834 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54840092e0 con 0x7f548c069ec0 2023-10-10T21:20:37.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.340+0000 7f549139d700 1 -- 172.21.15.154:0/2092446834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 msgr2=0x7f548c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:37.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.340+0000 7f549139d700 1 --2- 172.21.15.154:0/2092446834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c15ba60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5484009f50 tx=0x7f5484009840 comp rx=0 tx=0).stop 2023-10-10T21:20:37.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.340+0000 7f549139d700 1 -- 172.21.15.154:0/2092446834 shutdown_connections 2023-10-10T21:20:37.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.340+0000 7f549139d700 1 --2- 172.21.15.154:0/2092446834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c15ba60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.340+0000 7f549139d700 1 --2- 172.21.15.154:0/2092446834 >> v2:172.21.15.179:3300/0 conn(0x7f548c0cb560 0x7f548c0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.340+0000 7f549139d700 1 -- 172.21.15.154:0/2092446834 >> 172.21.15.154:0/2092446834 conn(0x7f548c06baf0 msgr2=0x7f548c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:37.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.340+0000 7f549139d700 1 -- 172.21.15.154:0/2092446834 shutdown_connections 2023-10-10T21:20:37.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.340+0000 7f549139d700 1 -- 172.21.15.154:0/2092446834 wait complete. 2023-10-10T21:20:37.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.341+0000 7f549139d700 1 Processor -- start 2023-10-10T21:20:37.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.341+0000 7f549139d700 1 -- start start 2023-10-10T21:20:37.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.342+0000 7f549139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c0c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.342+0000 7f549139d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548c0cb560 0x7f548c0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.342+0000 7f549139d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f548c0cc970 0x7f548c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.342+0000 7f549139d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0c6b60 con 0x7f548c0cb560 2023-10-10T21:20:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.342+0000 7f549139d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0c5f50 con 0x7f548c0cc970 2023-10-10T21:20:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.342+0000 7f549139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0c6230 con 0x7f548c069ec0 2023-10-10T21:20:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548c0cb560 0x7f548c0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c0c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f5490b9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f548c0cc970 0x7f548c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c0c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:53570/0 (socket says 172.21.15.154:53570) 2023-10-10T21:20:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548bfff700 1 -- 172.21.15.154:0/1962222910 learned_addr learned my addr 172.21.15.154:0/1962222910 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548c0cb560 0x7f548c0c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46488/0 (socket says 172.21.15.154:46488) 2023-10-10T21:20:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548bfff700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f548c0cc970 msgr2=0x7f548c0c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:37.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548bfff700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f548c0cc970 0x7f548c0c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548bfff700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548c0cb560 msgr2=0x7f548c0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:37.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548bfff700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548c0cb560 0x7f548c0c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:37.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548bfff700 1 -- 172.21.15.154:0/1962222910 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484009ae0 con 0x7f548c069ec0 2023-10-10T21:20:37.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f5490b9c700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f548c0cc970 0x7f548c0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:37.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548b7fe700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548c0cb560 0x7f548c0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:37.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.343+0000 7f548bfff700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c0c5700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f547c00ec80 tx=0x7f547c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:37.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.344+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00c850 con 0x7f548c069ec0 2023-10-10T21:20:37.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.344+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c00c9b0 con 0x7f548c069ec0 2023-10-10T21:20:37.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.344+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c0c6510 con 0x7f548c069ec0 2023-10-10T21:20:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.344+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00cd50 con 0x7f548c069ec0 2023-10-10T21:20:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.344+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c0c5c40 con 0x7f548c069ec0 2023-10-10T21:20:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.345+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c0c6e40 con 0x7f548c069ec0 2023-10-10T21:20:37.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.347+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 54) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f547c013680 con 0x7f548c069ec0 2023-10-10T21:20:37.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.348+0000 7f5473fff700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f5478069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:37.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.348+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f547c084980 con 0x7f548c069ec0 2023-10-10T21:20:37.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.348+0000 7f548b7fe700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 msgr2=0x7f5478069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:20:37.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.348+0000 7f548b7fe700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f5478069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:20:37.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.352+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f547c051a60 con 0x7f548c069ec0 2023-10-10T21:20:37.440 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:37.440+0000 7ff89a79c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:20:37.523 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:37.520+0000 7fba8c290180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:20:37.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.549+0000 7f548b7fe700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 msgr2=0x7f5478069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:20:37.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.549+0000 7f548b7fe700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f5478069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:20:37.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.578+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 --> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f548c04c3c0 con 0x7f5478066f80 2023-10-10T21:20:37.602 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:37.601+0000 7ff89a79c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:20:37.688 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:37.687+0000 7ff89a79c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:20:37.692 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:37.690+0000 7fba8c290180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:20:37.778 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:37.776+0000 7fba8c290180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:20:37.912 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:37.912+0000 7ff89a79c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:20:37.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.950+0000 7f548b7fe700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 msgr2=0x7f5478069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:20:37.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:37.950+0000 7f548b7fe700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f5478069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:20:38.005 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:38.003+0000 7fba8c290180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:20:38.090 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:38.089+0000 7ff89a79c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:20:38.182 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:38.181+0000 7ff89a79c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:20:38.182 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:38.180+0000 7fba8c290180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:20:38.274 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:38.272+0000 7fba8c290180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:20:38.343 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:38.343+0000 7ff89a79c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:20:38.437 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:38.435+0000 7fba8c290180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:20:38.444 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:38.444+0000 7ff89a79c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:20:38.539 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:38.537+0000 7fba8c290180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:20:38.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:38.751+0000 7f548b7fe700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 msgr2=0x7f5478069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:20:38.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:38.751+0000 7f548b7fe700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f5478069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T21:20:38.928 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:38.928+0000 7ff89a79c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:20:39.022 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:39.021+0000 7ff89a79c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:20:39.028 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:39.026+0000 7fba8c290180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:20:39.112 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:39.112+0000 7ff89a79c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:20:39.123 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:39.120+0000 7fba8c290180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:20:39.213 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:39.211+0000 7fba8c290180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:20:39.733 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:39.732+0000 7ff89a79c180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:20:39.842 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:39.841+0000 7fba8c290180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:20:39.905 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:39.904+0000 7ff89a79c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:20:39.999 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:39.999+0000 7ff89a79c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:20:40.016 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:40.015+0000 7fba8c290180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:20:40.112 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:40.111+0000 7fba8c290180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:20:40.294 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:40.293+0000 7ff89a79c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:20:40.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:40.353+0000 7f548b7fe700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 msgr2=0x7f5478069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:40.353+0000 7f548b7fe700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f5478069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T21:20:40.390 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:40.389+0000 7ff89a79c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:20:40.411 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:40.410+0000 7fba8c290180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:20:40.508 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:40.507+0000 7fba8c290180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:20:41.085 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:41.085+0000 7ff89a79c180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:20:41.214 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:41.213+0000 7fba8c290180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:20:41.373 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:41.372+0000 7ff89a79c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:20:41.465 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:41.465+0000 7ff89a79c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:20:41.504 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:41.503+0000 7fba8c290180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:20:41.598 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:41.596+0000 7fba8c290180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:20:41.618 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:41.618+0000 7ff89a79c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:20:41.722 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:41.722+0000 7ff89a79c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:20:41.753 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:41.751+0000 7fba8c290180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:20:41.861 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:41.860+0000 7fba8c290180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:20:41.911 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:41.911+0000 7ff89a79c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:20:42.003 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:42.002+0000 7ff89a79c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:20:42.054 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.053+0000 7fba8c290180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:20:42.094 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:42.093+0000 7ff89a79c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:20:42.148 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.147+0000 7fba8c290180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:20:42.188 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:20:42.188+0000 7ff89a79c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:20:42.241 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.240+0000 7fba8c290180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:20:42.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:42.247+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mgrmap(e 55) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f547c051e30 con 0x7f548c069ec0 2023-10-10T21:20:42.339 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.338+0000 7fba8c290180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:20:42.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:42.351+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mgrmap(e 56) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f547c055980 con 0x7f548c069ec0 2023-10-10T21:20:42.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:42.351+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 msgr2=0x7f5478069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:20:42.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:42.351+0000 7f5473fff700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f5478069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:42.475 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fba01577700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:42.475 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fba01577700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:42.475 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fba01577700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:42.476 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fba01577700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:42.476 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fba01577700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:42.476 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fb9fe571700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:42.476 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fb9fe571700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:42.476 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fb9fe571700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:42.477 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fb9fe571700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:42.477 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:20:42.473+0000 7fb9fe571700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:20:43.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.355+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mon.2 v2:172.21.15.179:3301/0 9 ==== mgrmap(e 57) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f547c058600 con 0x7f548c069ec0 2023-10-10T21:20:43.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.356+0000 7f5473fff700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f54780693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:43.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.356+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 --> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f548c04c3c0 con 0x7f5478066f80 2023-10-10T21:20:43.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.358+0000 7f548b7fe700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f54780693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:43.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.361+0000 7f548b7fe700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f54780693b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f548c06b750 tx=0x7f5480007eb0 comp rx=0 tx=0).ready entity=mgr.7878 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.423+0000 7f5473fff700 1 -- 172.21.15.154:0/1962222910 <== mgr.7878 v2:172.21.15.154:6835/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f548c04c3c0 con 0x7f5478066f80 2023-10-10T21:20:43.425 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path snap_test_dir1 2023-10-10T21:20:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.425+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 msgr2=0x7f54780693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.425+0000 7f549139d700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f54780693b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f548c06b750 tx=0x7f5480007eb0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.425+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 msgr2=0x7f548c0c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.425+0000 7f549139d700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c0c5700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f547c00ec80 tx=0x7f547c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.426+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 shutdown_connections 2023-10-10T21:20:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.426+0000 7f549139d700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f548c0cc970 0x7f548c0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.426+0000 7f549139d700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5478066f80 0x7f54780693b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.426+0000 7f549139d700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f548c069ec0 0x7f548c0c5700 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.426+0000 7f549139d700 1 --2- 172.21.15.154:0/1962222910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548c0cb560 0x7f548c0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.426+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 >> 172.21.15.154:0/1962222910 conn(0x7f548c06baf0 msgr2=0x7f548c0c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.426+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 shutdown_connections 2023-10-10T21:20:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.426+0000 7f549139d700 1 -- 172.21.15.154:0/1962222910 wait complete. 2023-10-10T21:20:43.446 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-10T21:20:43.446 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-10-21_21_00 in ~17s... 2023-10-10T21:20:43.447 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-10T21:20:43.448 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-10T21:20:43.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.634+0000 7f2ade79d700 1 Processor -- start 2023-10-10T21:20:43.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.635+0000 7f2ade79d700 1 -- start start 2023-10-10T21:20:43.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.636+0000 7f2ade79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad8156350 0x7f2ad8157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:43.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.636+0000 7f2ade79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ad80b0760 0x7f2ad80b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:43.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.636+0000 7f2ade79d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad80b1110 con 0x7f2ad8159f20 2023-10-10T21:20:43.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.636+0000 7f2ade79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad80b0570 con 0x7f2ad80b0760 2023-10-10T21:20:43.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.636+0000 7f2ade79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad81578b0 con 0x7f2ad8156350 2023-10-10T21:20:43.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2adcf9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ad80b0760 0x7f2ad80b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:43.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2add79b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad8156350 0x7f2ad8157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:43.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2addf9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2ad8159f20 0x7f2ad815a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44036/0 (socket says 172.21.15.154:44036) 2023-10-10T21:20:43.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2addf9c700 1 -- 172.21.15.154:0/2814296024 learned_addr learned my addr 172.21.15.154:0/2814296024 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:20:43.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2adcf9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ad80b0760 0x7f2ad80b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:42032/0 (socket says 172.21.15.154:42032) 2023-10-10T21:20:43.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2acffff700 1 -- 172.21.15.154:0/2814296024 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061800813 0 0) 0x7f2ad80b1110 con 0x7f2ad8159f20 2023-10-10T21:20:43.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2acffff700 1 -- 172.21.15.154:0/2814296024 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac4003570 con 0x7f2ad8159f20 2023-10-10T21:20:43.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2add79b700 1 -- 172.21.15.154:0/2814296024 >> v2:172.21.15.179:3300/0 conn(0x7f2ad80b0760 msgr2=0x7f2ad80b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:20:43.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2add79b700 1 --2- 172.21.15.154:0/2814296024 >> v2:172.21.15.179:3300/0 conn(0x7f2ad80b0760 0x7f2ad80b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2add79b700 1 -- 172.21.15.154:0/2814296024 >> v1:172.21.15.179:6789/0 conn(0x7f2ad8159f20 legacy=0x7f2ad815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:43.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2add79b700 1 -- 172.21.15.154:0/2814296024 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80af4d0 con 0x7f2ad8156350 2023-10-10T21:20:43.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2adcf9a700 1 --2- 172.21.15.154:0/2814296024 >> v2:172.21.15.179:3300/0 conn(0x7f2ad80b0760 0x7f2ad80b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:20:43.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.637+0000 7f2add79b700 1 --2- 172.21.15.154:0/2814296024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad8156350 0x7f2ad8157370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40098e0 tx=0x7f2ad40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6184b08116d9049 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:43.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2acffff700 1 -- 172.21.15.154:0/2814296024 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400f6b0 con 0x7f2ad8156350 2023-10-10T21:20:43.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2acffff700 1 -- 172.21.15.154:0/2814296024 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad400f810 con 0x7f2ad8156350 2023-10-10T21:20:43.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2acffff700 1 -- 172.21.15.154:0/2814296024 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400fbb0 con 0x7f2ad8156350 2023-10-10T21:20:43.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2ade79d700 1 -- 172.21.15.154:0/2814296024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad8156350 msgr2=0x7f2ad8157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:43.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2ade79d700 1 --2- 172.21.15.154:0/2814296024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad8156350 0x7f2ad8157370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40098e0 tx=0x7f2ad40091a0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2ade79d700 1 -- 172.21.15.154:0/2814296024 shutdown_connections 2023-10-10T21:20:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2ade79d700 1 --2- 172.21.15.154:0/2814296024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad8156350 0x7f2ad8157370 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2ade79d700 1 --2- 172.21.15.154:0/2814296024 >> v2:172.21.15.179:3300/0 conn(0x7f2ad80b0760 0x7f2ad80b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2ade79d700 1 -- 172.21.15.154:0/2814296024 >> 172.21.15.154:0/2814296024 conn(0x7f2ad8068e20 msgr2=0x7f2ad80cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2ade79d700 1 -- 172.21.15.154:0/2814296024 shutdown_connections 2023-10-10T21:20:43.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.638+0000 7f2ade79d700 1 -- 172.21.15.154:0/2814296024 wait complete. 2023-10-10T21:20:43.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.640+0000 7f2ade79d700 1 Processor -- start 2023-10-10T21:20:43.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.640+0000 7f2ade79d700 1 -- start start 2023-10-10T21:20:43.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2ade79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad80b0760 0x7f2ad806df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:43.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2ade79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad8156350 0x7f2ad814ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:43.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2ade79d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8159f20 0x7f2ad80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:43.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2ade79d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80adce0 con 0x7f2ad8159f20 2023-10-10T21:20:43.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2ade79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80c9960 con 0x7f2ad8156350 2023-10-10T21:20:43.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2ade79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad806e730 con 0x7f2ad80b0760 2023-10-10T21:20:43.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2addf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8159f20 0x7f2ad80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:43.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2addf9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8159f20 0x7f2ad80acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46644/0 (socket says 172.21.15.154:46644) 2023-10-10T21:20:43.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2addf9c700 1 -- 172.21.15.154:0/3602368843 learned_addr learned my addr 172.21.15.154:0/3602368843 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:20:43.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2adcf9a700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad8156350 0x7f2ad814ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:43.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.641+0000 7f2add79b700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad80b0760 0x7f2ad806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:43.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2addf9c700 1 -- 172.21.15.154:0/3602368843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad80b0760 msgr2=0x7f2ad806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:43.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2addf9c700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad80b0760 0x7f2ad806df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2addf9c700 1 -- 172.21.15.154:0/3602368843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad8156350 msgr2=0x7f2ad814ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:43.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2addf9c700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad8156350 0x7f2ad814ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2addf9c700 1 -- 172.21.15.154:0/3602368843 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8009420 con 0x7f2ad8159f20 2023-10-10T21:20:43.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2addf9c700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8159f20 0x7f2ad80acdb0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000cca0 tx=0x7f2ad0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:43.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2acd7fa700 1 -- 172.21.15.154:0/3602368843 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000a8d0 con 0x7f2ad8159f20 2023-10-10T21:20:43.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2acd7fa700 1 -- 172.21.15.154:0/3602368843 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad000aa30 con 0x7f2ad8159f20 2023-10-10T21:20:43.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad4009420 con 0x7f2ad8159f20 2023-10-10T21:20:43.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2acd7fa700 1 -- 172.21.15.154:0/3602368843 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000adb0 con 0x7f2ad8159f20 2023-10-10T21:20:43.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.642+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad80c9be0 con 0x7f2ad8159f20 2023-10-10T21:20:43.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.643+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad80c9e00 con 0x7f2ad8159f20 2023-10-10T21:20:43.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.644+0000 7f2acd7fa700 1 -- 172.21.15.154:0/3602368843 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 57) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f2ad0007300 con 0x7f2ad8159f20 2023-10-10T21:20:43.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.645+0000 7f2acd7fa700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2abc066dd0 0x7f2abc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:20:43.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.645+0000 7f2acd7fa700 1 -- 172.21.15.154:0/3602368843 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f2ad0084850 con 0x7f2ad8159f20 2023-10-10T21:20:43.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.645+0000 7f2add79b700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2abc066dd0 0x7f2abc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:20:43.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.646+0000 7f2add79b700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2abc066dd0 0x7f2abc069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40093f0 tx=0x7f2ad4019000 comp rx=0 tx=0).ready entity=mgr.7878 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:20:43.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.649+0000 7f2acd7fa700 1 -- 172.21.15.154:0/3602368843 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ad0051b60 con 0x7f2ad8159f20 2023-10-10T21:20:43.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.863+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 --> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ad806eb80 con 0x7f2abc066dd0 2023-10-10T21:20:43.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.871+0000 7f2acd7fa700 1 -- 172.21.15.154:0/3602368843 <== mgr.7878 v2:172.21.15.154:6835/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f2ad806eb80 con 0x7f2abc066dd0 2023-10-10T21:20:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:20:43.872 INFO:teuthology.orchestra.run.smithi154.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-10T21:20:43.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2abc066dd0 msgr2=0x7f2abc069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:43.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2abc066dd0 0x7f2abc069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40093f0 tx=0x7f2ad4019000 comp rx=0 tx=0).stop 2023-10-10T21:20:43.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8159f20 msgr2=0x7f2ad80acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:20:43.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8159f20 0x7f2ad80acdb0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000cca0 tx=0x7f2ad0001ae0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 shutdown_connections 2023-10-10T21:20:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8159f20 0x7f2ad80acdb0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2abc066dd0 0x7f2abc069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad80b0760 0x7f2ad806df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 --2- 172.21.15.154:0/3602368843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad8156350 0x7f2ad814ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:20:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 >> 172.21.15.154:0/3602368843 conn(0x7f2ad8068e20 msgr2=0x7f2ad8070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:20:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.873+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 shutdown_connections 2023-10-10T21:20:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:20:43.874+0000 7f2ade79d700 1 -- 172.21.15.154:0/3602368843 wait complete. 2023-10-10T21:20:43.893 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-10T21:20:43.893 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-10-10T21:20:43.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:43.894 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:43.933 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:43.933 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:43.933 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:44.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:44.935 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:44.977 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:44.978 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:44.978 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:45.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:45.980 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:46.023 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:46.023 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:46.024 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:47.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:47.025 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:47.068 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:47.069 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:47.069 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:48.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:48.071 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:48.114 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:48.114 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:48.115 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:49.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:49.116 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:49.160 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:49.160 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:49.160 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:50.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:20:50.007 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:20:50.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:50.162 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:50.203 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:50.204 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:50.205 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:51.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:51.207 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:51.251 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:51.251 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:51.252 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:52.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:52.253 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:52.297 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:52.297 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:52.297 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:53.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:53.299 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:53.342 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:53.343 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:53.343 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:54.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:54.345 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:54.389 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:54.389 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:54.390 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:55.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:55.391 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:55.435 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:55.435 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:55.435 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:56.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:56.437 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:56.481 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:56.481 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:56.482 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:57.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:57.483 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:57.526 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:57.527 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:57.527 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:58.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:58.529 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:58.572 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:58.573 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:58.573 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:20:59.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:20:59.575 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:20:59.618 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T21:20:59.619 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T21:20:59.619 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:21:00.436 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:00.434+0000 7fb9f0d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:00.436 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:00.434+0000 7fb9f0d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:00.436 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:00.434+0000 7fb9f0d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:00.436 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:00.434+0000 7fb9f0d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:00.437 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:00.434+0000 7fb9f0d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:00.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:21:00.621 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:21:00.662 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_21_00_UTC 2023-10-10T21:21:00.663 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-21_21_00_UTC'} 2023-10-10T21:21:00.663 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-10-21_21_00_UTC'} 2023-10-10T21:21:00.663 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T21:21:00.664 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-10-21_21_00_UTC'] 2023-10-10T21:21:00.664 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696972843.4467995, now = 1696972860.6643994, timo = 17 2023-10-10T21:21:01.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-10T21:21:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.860+0000 7fb0d47ff700 1 Processor -- start 2023-10-10T21:21:01.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.860+0000 7fb0d47ff700 1 -- start start 2023-10-10T21:21:01.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.861+0000 7fb0d47ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0cc069a50 0x7fb0cc0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:01.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d47ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc069e20 0x7fb0cc1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:01.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d47ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0cc0ac030 con 0x7fb0cc0c8490 2023-10-10T21:21:01.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d47ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc0ab820 con 0x7fb0cc069a50 2023-10-10T21:21:01.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d47ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc06dbb0 con 0x7fb0cc069e20 2023-10-10T21:21:01.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d259b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0cc069a50 0x7fb0cc0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:01.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d259b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0cc069a50 0x7fb0cc0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47838/0 (socket says 172.21.15.154:47838) 2023-10-10T21:21:01.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d259b700 1 -- 172.21.15.154:0/3310162128 learned_addr learned my addr 172.21.15.154:0/3310162128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:01.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d259b700 1 -- 172.21.15.154:0/3310162128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc069e20 msgr2=0x7fb0cc1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:01.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d2d9c700 1 --2- 172.21.15.154:0/3310162128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc069e20 0x7fb0cc1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:01.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d259b700 1 --2- 172.21.15.154:0/3310162128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc069e20 0x7fb0cc1569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:01.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d259b700 1 -- 172.21.15.154:0/3310162128 >> v1:172.21.15.179:6789/0 conn(0x7fb0cc0c8490 legacy=0x7fb0cc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:01.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d259b700 1 -- 172.21.15.154:0/3310162128 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0aba70 con 0x7fb0cc069a50 2023-10-10T21:21:01.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.862+0000 7fb0d2d9c700 1 --2- 172.21.15.154:0/3310162128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc069e20 0x7fb0cc1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:01.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d259b700 1 --2- 172.21.15.154:0/3310162128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069a50 0x7fb0cc0c6ac0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80099b0 tx=0x7fb0c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbbf56b06ec7b25 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:01.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d1599700 1 -- 172.21.15.154:0/3310162128 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800b820 con 0x7fb0cc069a50 2023-10-10T21:21:01.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d1599700 1 -- 172.21.15.154:0/3310162128 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c800b980 con 0x7fb0cc069a50 2023-10-10T21:21:01.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d1599700 1 -- 172.21.15.154:0/3310162128 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800bd20 con 0x7fb0cc069a50 2023-10-10T21:21:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3310162128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069a50 msgr2=0x7fb0cc0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d47ff700 1 --2- 172.21.15.154:0/3310162128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069a50 0x7fb0cc0c6ac0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80099b0 tx=0x7fb0c8009250 comp rx=0 tx=0).stop 2023-10-10T21:21:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3310162128 shutdown_connections 2023-10-10T21:21:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d47ff700 1 --2- 172.21.15.154:0/3310162128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc069e20 0x7fb0cc1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d47ff700 1 --2- 172.21.15.154:0/3310162128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069a50 0x7fb0cc0c6ac0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.863+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3310162128 >> 172.21.15.154:0/3310162128 conn(0x7fb0cc0c8f90 msgr2=0x7fb0cc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.864+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3310162128 shutdown_connections 2023-10-10T21:21:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.864+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3310162128 wait complete. 2023-10-10T21:21:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.865+0000 7fb0d47ff700 1 Processor -- start 2023-10-10T21:21:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.865+0000 7fb0d47ff700 1 -- start start 2023-10-10T21:21:01.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d47ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0cc069a50 0x7fb0cc0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:01.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d47ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069e20 0x7fb0cc14a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:01.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d47ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc0c8490 0x7fb0cc0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:01.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d47ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc0c1c70 con 0x7fb0cc069e20 2023-10-10T21:21:01.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d47ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc0c1060 con 0x7fb0cc069a50 2023-10-10T21:21:01.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d47ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc0c1340 con 0x7fb0cc0c8490 2023-10-10T21:21:01.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d1d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069e20 0x7fb0cc14a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:01.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d1d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069e20 0x7fb0cc14a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47854/0 (socket says 172.21.15.154:47854) 2023-10-10T21:21:01.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d1d9a700 1 -- 172.21.15.154:0/3579344806 learned_addr learned my addr 172.21.15.154:0/3579344806 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:01.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d259b700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0cc069a50 0x7fb0cc0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.866+0000 7fb0d2d9c700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc0c8490 0x7fb0cc0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0d1d9a700 1 -- 172.21.15.154:0/3579344806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc0c8490 msgr2=0x7fb0cc0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0d1d9a700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc0c8490 0x7fb0cc0c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0d1d9a700 1 -- 172.21.15.154:0/3579344806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0cc069a50 msgr2=0x7fb0cc0c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0d1d9a700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0cc069a50 0x7fb0cc0c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0d1d9a700 1 -- 172.21.15.154:0/3579344806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80094f0 con 0x7fb0cc069e20 2023-10-10T21:21:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0d2d9c700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc0c8490 0x7fb0cc0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0d1d9a700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069e20 0x7fb0cc14a880 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c5d0 tx=0x7fb0bc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0c27fc700 1 -- 172.21.15.154:0/3579344806 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc011590 con 0x7fb0cc069e20 2023-10-10T21:21:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0c27fc700 1 -- 172.21.15.154:0/3579344806 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc011710 con 0x7fb0cc069e20 2023-10-10T21:21:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0c27fc700 1 -- 172.21.15.154:0/3579344806 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc011ad0 con 0x7fb0cc069e20 2023-10-10T21:21:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc0c1620 con 0x7fb0cc069e20 2023-10-10T21:21:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.867+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc0c6d30 con 0x7fb0cc069e20 2023-10-10T21:21:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.868+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc0c1e20 con 0x7fb0cc069e20 2023-10-10T21:21:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.869+0000 7fb0c27fc700 1 -- 172.21.15.154:0/3579344806 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 58) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fb0bc01c460 con 0x7fb0cc069e20 2023-10-10T21:21:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.870+0000 7fb0c27fc700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0b0067130 0x7fb0b00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.870+0000 7fb0c27fc700 1 -- 172.21.15.154:0/3579344806 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fb0bc084830 con 0x7fb0cc069e20 2023-10-10T21:21:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.870+0000 7fb0d259b700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0b0067130 0x7fb0b00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.871+0000 7fb0d259b700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0b0067130 0x7fb0b00695e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80099b0 tx=0x7fb0c8016000 comp rx=0 tx=0).ready entity=mgr.7878 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:01.874+0000 7fb0c27fc700 1 -- 172.21.15.154:0/3579344806 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0cc0c1e20 con 0x7fb0cc069e20 2023-10-10T21:21:02.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.090+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 --> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0cc0718b0 con 0x7fb0b0067130 2023-10-10T21:21:02.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.154+0000 7fb0c27fc700 1 -- 172.21.15.154:0/3579344806 <== mgr.7878 v2:172.21.15.154:6835/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb0cc0718b0 con 0x7fb0b0067130 2023-10-10T21:21:02.156 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path snap_test_dir1 2023-10-10T21:21:02.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0b0067130 msgr2=0x7fb0b00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:02.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0b0067130 0x7fb0b00695e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80099b0 tx=0x7fb0c8016000 comp rx=0 tx=0).stop 2023-10-10T21:21:02.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069e20 msgr2=0x7fb0cc14a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:02.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069e20 0x7fb0cc14a880 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c5d0 tx=0x7fb0bc007f60 comp rx=0 tx=0).stop 2023-10-10T21:21:02.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 shutdown_connections 2023-10-10T21:21:02.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb0b0067130 0x7fb0b00695e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:02.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0cc0c8490 0x7fb0cc0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:02.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0cc069a50 0x7fb0cc0c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:02.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 --2- 172.21.15.154:0/3579344806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc069e20 0x7fb0cc14a880 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:02.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 >> 172.21.15.154:0/3579344806 conn(0x7fb0cc0c8f90 msgr2=0x7fb0cc0ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:02.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 shutdown_connections 2023-10-10T21:21:02.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.157+0000 7fb0d47ff700 1 -- 172.21.15.154:0/3579344806 wait complete. 2023-10-10T21:21:02.176 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-10T21:21:02.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:21:02.177 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T21:21:02.214 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_21_00_UTC 2023-10-10T21:21:02.216 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_21_00_UTC 2023-10-10T21:21:02.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:21:02.216 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_21_00_UTC) 2023-10-10T21:21:02.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:21:02.299 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-10T21:21:02.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T21:21:02.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.601+0000 7fd76c3ff700 1 Processor -- start 2023-10-10T21:21:02.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.601+0000 7fd76c3ff700 1 -- start start 2023-10-10T21:21:02.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.603+0000 7fd76c3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7640ccee0 0x7fd7641561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:02.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.603+0000 7fd76c3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76415b0d0 con 0x7fd7640c87c0 2023-10-10T21:21:02.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.603+0000 7fd76c3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76415a4c0 con 0x7fd7640c83f0 2023-10-10T21:21:02.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.603+0000 7fd76c3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76415a7a0 con 0x7fd7640ccee0 2023-10-10T21:21:02.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.603+0000 7fd76a99c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd7640c87c0 0x7fd7640ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41938/0 (socket says 172.21.15.154:41938) 2023-10-10T21:21:02.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.603+0000 7fd76a99c700 1 -- 172.21.15.154:0/3657184810 learned_addr learned my addr 172.21.15.154:0/3657184810 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:02.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.603+0000 7fd76999a700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7640ccee0 0x7fd7641561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:02.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.603+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040708829 0 0) 0x7fd76415b0d0 con 0x7fd7640c87c0 2023-10-10T21:21:02.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.603+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd750003570 con 0x7fd7640c87c0 2023-10-10T21:21:02.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2543812750 0 0) 0x7fd750003570 con 0x7fd7640c87c0 2023-10-10T21:21:02.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7640ccee0 msgr2=0x7fd7641561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:02.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7640ccee0 0x7fd7641561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:02.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 >> v1:172.21.15.179:6789/0 conn(0x7fd7640c83f0 legacy=0x7fd7640c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:02.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76415aa80 con 0x7fd7640c87c0 2023-10-10T21:21:02.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fd75c0017f0 con 0x7fd7640c87c0 2023-10-10T21:21:02.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 >> v1:172.21.15.154:6789/0 conn(0x7fd7640c87c0 legacy=0x7fd7640ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:02.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd750003a90 0x7fd750003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:02.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7640ccee0 0x7fd750004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:02.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd750004d50 0x7fd7500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:02.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76415a7a0 con 0x7fd750003a90 2023-10-10T21:21:02.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75000bb10 con 0x7fd750004d50 2023-10-10T21:21:02.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75000bcd0 con 0x7fd7640ccee0 2023-10-10T21:21:02.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd76a19b700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd750003a90 0x7fd750003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:02.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd76999a700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7640ccee0 0x7fd750004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:02.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.604+0000 7fd76a99c700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd750004d50 0x7fd7500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:02.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd76a19b700 1 -- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7640ccee0 msgr2=0x7fd750004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:02.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd76a19b700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7640ccee0 0x7fd750004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:02.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd76a19b700 1 -- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd750004d50 msgr2=0x7fd7500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:02.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd76a19b700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd750004d50 0x7fd7500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:02.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd76a19b700 1 -- 172.21.15.154:0/3657184810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750003570 con 0x7fd750003a90 2023-10-10T21:21:02.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd76a99c700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd750004d50 0x7fd7500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:02.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd76a19b700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd750003a90 0x7fd750003e60 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd7600014b0 tx=0x7fd760007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae6c807df134e27 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:02.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76000c5d0 con 0x7fd750003a90 2023-10-10T21:21:02.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76000c750 con 0x7fd750003a90 2023-10-10T21:21:02.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd769199700 1 -- 172.21.15.154:0/3657184810 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76000cb10 con 0x7fd750003a90 2023-10-10T21:21:02.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.605+0000 7fd76c3ff700 1 -- 172.21.15.154:0/3657184810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd750003a90 msgr2=0x7fd750003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:02.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.606+0000 7fd76c3ff700 1 --2- 172.21.15.154:0/3657184810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd750003a90 0x7fd750003e60 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd7600014b0 tx=0x7fd760007d30 comp rx=0 tx=0).stop 2023-10-10T21:21:02.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.606+0000 7fd76a99c700 1 -- 172.21.15.154:0/3657184810 reap_dead start 2023-10-10T21:21:02.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.606+0000 7fd76c3ff700 1 -- 172.21.15.154:0/3657184810 shutdown_connections 2023-10-10T21:21:02.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.606+0000 7fd76c3ff700 1 -- 172.21.15.154:0/3657184810 >> 172.21.15.154:0/3657184810 conn(0x7fd764068e10 msgr2=0x7fd7640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:02.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.606+0000 7fd76c3ff700 1 -- 172.21.15.154:0/3657184810 shutdown_connections 2023-10-10T21:21:02.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.606+0000 7fd76c3ff700 1 -- 172.21.15.154:0/3657184810 wait complete. 2023-10-10T21:21:02.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.607+0000 7fd76c3ff700 1 Processor -- start 2023-10-10T21:21:02.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.607+0000 7fd76c3ff700 1 -- start start 2023-10-10T21:21:02.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76c3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd750003a90 0x7fd76414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:02.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76c3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7640c6170 0x7fd764152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:02.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76c3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd764154140 0x7fd7640b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:02.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76c3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76414fff0 con 0x7fd7640c6170 2023-10-10T21:21:02.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76c3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641530a0 con 0x7fd764154140 2023-10-10T21:21:02.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76c3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd764153380 con 0x7fd750003a90 2023-10-10T21:21:02.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76999a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7640c6170 0x7fd764152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:02.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76999a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7640c6170 0x7fd764152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47874/0 (socket says 172.21.15.154:47874) 2023-10-10T21:21:02.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76999a700 1 -- 172.21.15.154:0/1330511105 learned_addr learned my addr 172.21.15.154:0/1330511105 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:02.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76a19b700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd750003a90 0x7fd76414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:02.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.608+0000 7fd76a99c700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd764154140 0x7fd7640b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:02.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd76999a700 1 -- 172.21.15.154:0/1330511105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd750003a90 msgr2=0x7fd76414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:02.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd76999a700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd750003a90 0x7fd76414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:02.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd76999a700 1 -- 172.21.15.154:0/1330511105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd764154140 msgr2=0x7fd7640b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:02.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd76999a700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd764154140 0x7fd7640b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:02.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd76999a700 1 -- 172.21.15.154:0/1330511105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764153660 con 0x7fd7640c6170 2023-10-10T21:21:02.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd76999a700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7640c6170 0x7fd764152850 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd754011d40 tx=0x7fd7540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:02.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd75a7fc700 1 -- 172.21.15.154:0/1330511105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400fac0 con 0x7fd7640c6170 2023-10-10T21:21:02.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd75a7fc700 1 -- 172.21.15.154:0/1330511105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400fc20 con 0x7fd7640c6170 2023-10-10T21:21:02.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764153940 con 0x7fd7640c6170 2023-10-10T21:21:02.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd75a7fc700 1 -- 172.21.15.154:0/1330511105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754014440 con 0x7fd7640c6170 2023-10-10T21:21:02.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.609+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd764152d90 con 0x7fd7640c6170 2023-10-10T21:21:02.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.610+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76404c3c0 con 0x7fd7640c6170 2023-10-10T21:21:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.611+0000 7fd75a7fc700 1 -- 172.21.15.154:0/1330511105 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 58) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fd754014870 con 0x7fd7640c6170 2023-10-10T21:21:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.612+0000 7fd75a7fc700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd748067130 0x7fd7480695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:02.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.612+0000 7fd75a7fc700 1 -- 172.21.15.154:0/1330511105 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fd754018030 con 0x7fd7640c6170 2023-10-10T21:21:02.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.612+0000 7fd76a19b700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd748067130 0x7fd7480695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:02.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.613+0000 7fd76a19b700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd748067130 0x7fd7480695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd760000fd0 tx=0x7fd760017000 comp rx=0 tx=0).ready entity=mgr.7878 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:02.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.616+0000 7fd75a7fc700 1 -- 172.21.15.154:0/1330511105 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd754052310 con 0x7fd7640c6170 2023-10-10T21:21:02.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:02.858+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fd764153f90 con 0x7fd7640c6170 2023-10-10T21:21:03.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.159+0000 7fd75a7fc700 1 -- 172.21.15.154:0/1330511105 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fd7540526e0 con 0x7fd7640c6170 2023-10-10T21:21:03.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.160+0000 7fd75a7fc700 1 -- 172.21.15.154:0/1330511105 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v59) v1 ==== 93+0+0 (secure 0 0 0) 0x7fd754052310 con 0x7fd7640c6170 2023-10-10T21:21:03.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd748067130 msgr2=0x7fd7480695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:03.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd748067130 0x7fd7480695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd760000fd0 tx=0x7fd760017000 comp rx=0 tx=0).stop 2023-10-10T21:21:03.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7640c6170 msgr2=0x7fd764152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:03.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7640c6170 0x7fd764152850 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd754011d40 tx=0x7fd7540091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 shutdown_connections 2023-10-10T21:21:03.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd764154140 0x7fd7640b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fd748067130 0x7fd7480695e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd750003a90 0x7fd76414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 --2- 172.21.15.154:0/1330511105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7640c6170 0x7fd764152850 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.162+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 >> 172.21.15.154:0/1330511105 conn(0x7fd764068e10 msgr2=0x7fd7640c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:03.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.163+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 shutdown_connections 2023-10-10T21:21:03.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.163+0000 7fd76c3ff700 1 -- 172.21.15.154:0/1330511105 wait complete. 2023-10-10T21:21:03.183 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:21:03.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:21:03.279 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:21:03.360 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:21:03.361 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T21:21:03.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:21:03.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T21:21:03.456 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T21:21:03.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:21:03.457 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T21:21:03.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:21:03.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.729+0000 7f520df9d700 1 Processor -- start 2023-10-10T21:21:03.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.729+0000 7f520df9d700 1 -- start start 2023-10-10T21:21:03.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.730+0000 7f520df9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f520806a660 0x7f5208157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:03.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.730+0000 7f520df9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520806e2a0 con 0x7f5208150180 2023-10-10T21:21:03.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.730+0000 7f520df9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520806b2e0 con 0x7f5208150550 2023-10-10T21:21:03.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.730+0000 7f520df9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52080c78e0 con 0x7f520806a660 2023-10-10T21:21:03.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f520cf9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5208150180 0x7f52080c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41946/0 (socket says 172.21.15.154:41946) 2023-10-10T21:21:03.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f520cf9b700 1 -- 172.21.15.154:0/1551930822 learned_addr learned my addr 172.21.15.154:0/1551930822 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:03.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f520d79c700 1 --2- 172.21.15.154:0/1551930822 >> v2:172.21.15.179:3300/0 conn(0x7f520806a660 0x7f5208157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:03.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f52077fe700 1 -- 172.21.15.154:0/1551930822 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767355924 0 0) 0x7f520806e2a0 con 0x7f5208150180 2023-10-10T21:21:03.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f52077fe700 1 -- 172.21.15.154:0/1551930822 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f8003570 con 0x7f5208150180 2023-10-10T21:21:03.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f52077fe700 1 -- 172.21.15.154:0/1551930822 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304898535 0 0) 0x7f520806b2e0 con 0x7f5208150550 2023-10-10T21:21:03.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f52077fe700 1 -- 172.21.15.154:0/1551930822 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f520806e2a0 con 0x7f5208150550 2023-10-10T21:21:03.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f520d79c700 1 -- 172.21.15.154:0/1551930822 >> v1:172.21.15.179:6789/0 conn(0x7f5208150550 legacy=0x7f5208069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:03.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f520d79c700 1 -- 172.21.15.154:0/1551930822 >> v1:172.21.15.154:6789/0 conn(0x7f5208150180 legacy=0x7f52080c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:03.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.731+0000 7f520d79c700 1 -- 172.21.15.154:0/1551930822 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080c7bc0 con 0x7f520806a660 2023-10-10T21:21:03.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.732+0000 7f520d79c700 1 --2- 172.21.15.154:0/1551930822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520806a660 0x7f5208157770 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5200009e90 tx=0x7f5200009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a5cb0c98d429370 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:03.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.732+0000 7f52077fe700 1 -- 172.21.15.154:0/1551930822 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520000e070 con 0x7f520806a660 2023-10-10T21:21:03.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.732+0000 7f52077fe700 1 -- 172.21.15.154:0/1551930822 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520000bb90 con 0x7f520806a660 2023-10-10T21:21:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.732+0000 7f52077fe700 1 -- 172.21.15.154:0/1551930822 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200012430 con 0x7f520806a660 2023-10-10T21:21:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.733+0000 7f520df9d700 1 -- 172.21.15.154:0/1551930822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520806a660 msgr2=0x7f5208157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.733+0000 7f520df9d700 1 --2- 172.21.15.154:0/1551930822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520806a660 0x7f5208157770 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5200009e90 tx=0x7f5200009780 comp rx=0 tx=0).stop 2023-10-10T21:21:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.733+0000 7f520df9d700 1 -- 172.21.15.154:0/1551930822 shutdown_connections 2023-10-10T21:21:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.733+0000 7f520df9d700 1 --2- 172.21.15.154:0/1551930822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520806a660 0x7f5208157770 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.733+0000 7f520df9d700 1 -- 172.21.15.154:0/1551930822 >> 172.21.15.154:0/1551930822 conn(0x7f52080cc1f0 msgr2=0x7f52080cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.733+0000 7f520df9d700 1 -- 172.21.15.154:0/1551930822 shutdown_connections 2023-10-10T21:21:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.733+0000 7f520df9d700 1 -- 172.21.15.154:0/1551930822 wait complete. 2023-10-10T21:21:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.734+0000 7f520df9d700 1 Processor -- start 2023-10-10T21:21:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.735+0000 7f520df9d700 1 -- start start 2023-10-10T21:21:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.735+0000 7f520df9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f520806a660 0x7f52080c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.735+0000 7f520df9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5208150180 0x7f520813c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:03.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.735+0000 7f520df9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5208150550 0x7f520813c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520df9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520813bb50 con 0x7f520806a660 2023-10-10T21:21:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520df9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52080ad060 con 0x7f5208150550 2023-10-10T21:21:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520df9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52080ac560 con 0x7f5208150180 2023-10-10T21:21:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520cf9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f520806a660 0x7f52080c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:03.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520cf9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f520806a660 0x7f52080c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47896/0 (socket says 172.21.15.154:47896) 2023-10-10T21:21:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520cf9b700 1 -- 172.21.15.154:0/2066665837 learned_addr learned my addr 172.21.15.154:0/2066665837 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f5207fff700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5208150180 0x7f520813c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520d79c700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5208150550 0x7f520813c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520cf9b700 1 -- 172.21.15.154:0/2066665837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5208150180 msgr2=0x7f520813c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520cf9b700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5208150180 0x7f520813c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520cf9b700 1 -- 172.21.15.154:0/2066665837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5208150550 msgr2=0x7f520813c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:03.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520cf9b700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5208150550 0x7f520813c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520cf9b700 1 -- 172.21.15.154:0/2066665837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200009a20 con 0x7f520806a660 2023-10-10T21:21:03.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.736+0000 7f520cf9b700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f520806a660 0x7f52080c32a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c790 tx=0x7f51fc007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:03.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.737+0000 7f5204ff9700 1 -- 172.21.15.154:0/2066665837 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc005b30 con 0x7f520806a660 2023-10-10T21:21:03.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.737+0000 7f5204ff9700 1 -- 172.21.15.154:0/2066665837 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc005c90 con 0x7f520806a660 2023-10-10T21:21:03.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.737+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52080ac840 con 0x7f520806a660 2023-10-10T21:21:03.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.737+0000 7f5204ff9700 1 -- 172.21.15.154:0/2066665837 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc007300 con 0x7f520806a660 2023-10-10T21:21:03.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.737+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52080acb20 con 0x7f520806a660 2023-10-10T21:21:03.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.738+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520804c3c0 con 0x7f520806a660 2023-10-10T21:21:03.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.739+0000 7f5204ff9700 1 -- 172.21.15.154:0/2066665837 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f51fc01b3b0 con 0x7f520806a660 2023-10-10T21:21:03.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.740+0000 7f5204ff9700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f51ec067170 0x7f51ec069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:03.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.740+0000 7f5207fff700 1 -- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f51ec067170 msgr2=0x7f51ec069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:03.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.740+0000 7f5204ff9700 1 -- 172.21.15.154:0/2066665837 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f51fc084000 con 0x7f520806a660 2023-10-10T21:21:03.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.740+0000 7f5207fff700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f51ec067170 0x7f51ec069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:03.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.744+0000 7f5204ff9700 1 -- 172.21.15.154:0/2066665837 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51fc050d50 con 0x7f520806a660 2023-10-10T21:21:03.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.941+0000 7f5207fff700 1 -- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f51ec067170 msgr2=0x7f51ec069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:03.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.941+0000 7f5207fff700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f51ec067170 0x7f51ec069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:03.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.989+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f520806ada0 con 0x7f520806a660 2023-10-10T21:21:03.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.990+0000 7f5204ff9700 1 -- 172.21.15.154:0/2066665837 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f51fc017090 con 0x7f520806a660 2023-10-10T21:21:03.992 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:03.992 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/909044943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":909044943},{"type":"v1","addr":"172.21.15.154:6834","nonce":909044943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/4163308288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":4163308288},{"type":"v1","addr":"172.21.15.179:6834","nonce":4163308288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7330,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3673994181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3673994181},{"type":"v1","addr":"172.21.15.179:6835","nonce":3673994181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:20:26.309607+0000","modified":"2023-10-10T21:20:30.131493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7677},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7677":{"gid":7677,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1893020718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1893020718},{"type":"v1","addr":"172.21.15.154:6837","nonce":1893020718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-10T21:21:03.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f51ec067170 msgr2=0x7f51ec069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:03.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f51ec067170 0x7f51ec069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f520806a660 msgr2=0x7f52080c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:03.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f520806a660 0x7f52080c32a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c790 tx=0x7f51fc007ea0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 shutdown_connections 2023-10-10T21:21:03.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5208150550 0x7f520813c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f520806a660 0x7f52080c32a0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f51ec067170 0x7f51ec069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 --2- 172.21.15.154:0/2066665837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5208150180 0x7f520813c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:03.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 >> 172.21.15.154:0/2066665837 conn(0x7f52080cc1f0 msgr2=0x7f5208143750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:03.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 shutdown_connections 2023-10-10T21:21:03.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:03.993+0000 7f520df9d700 1 -- 172.21.15.154:0/2066665837 wait complete. 2023-10-10T21:21:03.998 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 54 2023-10-10T21:21:04.014 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:21:04.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.205+0000 7f2e2ef9d700 1 Processor -- start 2023-10-10T21:21:04.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.205+0000 7f2e2ef9d700 1 -- start start 2023-10-10T21:21:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.206+0000 7f2e2ef9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2e281566e0 0x7f2e280ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.206+0000 7f2e2ef9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e280cb900 0x7f2e280ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.206+0000 7f2e2ef9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e280ca860 con 0x7f2e28156310 2023-10-10T21:21:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.206+0000 7f2e2ef9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e280cab40 con 0x7f2e280cb900 2023-10-10T21:21:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.206+0000 7f2e2ef9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e280cae20 con 0x7f2e281566e0 2023-10-10T21:21:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.206+0000 7f2e2df9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2e28156310 0x7f2e280c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41958/0 (socket says 172.21.15.154:41958) 2023-10-10T21:21:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.206+0000 7f2e2df9b700 1 -- 172.21.15.154:0/1616392656 learned_addr learned my addr 172.21.15.154:0/1616392656 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:04.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.207+0000 7f2e2d79a700 1 --2- 172.21.15.154:0/1616392656 >> v2:172.21.15.179:3300/0 conn(0x7f2e281566e0 0x7f2e280ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.207+0000 7f2e2e79c700 1 --2- 172.21.15.154:0/1616392656 >> v2:172.21.15.154:3300/0 conn(0x7f2e280cb900 0x7f2e280ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.207+0000 7f2e2cf99700 1 -- 172.21.15.154:0/1616392656 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030883767 0 0) 0x7f2e280ca860 con 0x7f2e28156310 2023-10-10T21:21:04.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.207+0000 7f2e2cf99700 1 -- 172.21.15.154:0/1616392656 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e14003570 con 0x7f2e28156310 2023-10-10T21:21:04.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.207+0000 7f2e2d79a700 1 -- 172.21.15.154:0/1616392656 >> v2:172.21.15.154:3300/0 conn(0x7f2e280cb900 msgr2=0x7f2e280ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.207+0000 7f2e2d79a700 1 --2- 172.21.15.154:0/1616392656 >> v2:172.21.15.154:3300/0 conn(0x7f2e280cb900 0x7f2e280ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.207+0000 7f2e2d79a700 1 -- 172.21.15.154:0/1616392656 >> v1:172.21.15.154:6789/0 conn(0x7f2e28156310 legacy=0x7f2e280c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.207+0000 7f2e2d79a700 1 -- 172.21.15.154:0/1616392656 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e280cb100 con 0x7f2e281566e0 2023-10-10T21:21:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.208+0000 7f2e2d79a700 1 --2- 172.21.15.154:0/1616392656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e281566e0 0x7f2e280ae000 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2e2806c000 tx=0x7f2e180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5ecfe599cacbe4b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.208+0000 7f2e2cf99700 1 -- 172.21.15.154:0/1616392656 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18011630 con 0x7f2e281566e0 2023-10-10T21:21:04.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.208+0000 7f2e2cf99700 1 -- 172.21.15.154:0/1616392656 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e180117b0 con 0x7f2e281566e0 2023-10-10T21:21:04.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.208+0000 7f2e2cf99700 1 -- 172.21.15.154:0/1616392656 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18011b70 con 0x7f2e281566e0 2023-10-10T21:21:04.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.208+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/1616392656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e281566e0 msgr2=0x7f2e280ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.208+0000 7f2e2ef9d700 1 --2- 172.21.15.154:0/1616392656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e281566e0 0x7f2e280ae000 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2e2806c000 tx=0x7f2e180091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.209+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/1616392656 shutdown_connections 2023-10-10T21:21:04.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.209+0000 7f2e2ef9d700 1 --2- 172.21.15.154:0/1616392656 >> v2:172.21.15.154:3300/0 conn(0x7f2e280cb900 0x7f2e280ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.209+0000 7f2e2ef9d700 1 --2- 172.21.15.154:0/1616392656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e281566e0 0x7f2e280ae000 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.209+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/1616392656 >> 172.21.15.154:0/1616392656 conn(0x7f2e280cc1f0 msgr2=0x7f2e280cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:04.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.209+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/1616392656 shutdown_connections 2023-10-10T21:21:04.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.209+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/1616392656 wait complete. 2023-10-10T21:21:04.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.210+0000 7f2e2ef9d700 1 Processor -- start 2023-10-10T21:21:04.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.210+0000 7f2e2ef9d700 1 -- start start 2023-10-10T21:21:04.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.211+0000 7f2e2ef9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280cb900 0x7f2e28146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.211+0000 7f2e2ef9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e28156310 0x7f2e281699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.211+0000 7f2e2ef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e281566e0 0x7f2e280b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.211+0000 7f2e2ef9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2814baf0 con 0x7f2e280cb900 2023-10-10T21:21:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.211+0000 7f2e2ef9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2814bdd0 con 0x7f2e28156310 2023-10-10T21:21:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.211+0000 7f2e2ef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2814c0b0 con 0x7f2e281566e0 2023-10-10T21:21:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.211+0000 7f2e2df9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280cb900 0x7f2e28146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.211+0000 7f2e2df9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280cb900 0x7f2e28146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47920/0 (socket says 172.21.15.154:47920) 2023-10-10T21:21:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.211+0000 7f2e2df9b700 1 -- 172.21.15.154:0/208163273 learned_addr learned my addr 172.21.15.154:0/208163273 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e2d79a700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e28156310 0x7f2e281699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e2e79c700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e281566e0 0x7f2e280b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e2df9b700 1 -- 172.21.15.154:0/208163273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e281566e0 msgr2=0x7f2e280b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e2df9b700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e281566e0 0x7f2e280b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e2df9b700 1 -- 172.21.15.154:0/208163273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e28156310 msgr2=0x7f2e281699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e2df9b700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e28156310 0x7f2e281699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e2df9b700 1 -- 172.21.15.154:0/208163273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18009420 con 0x7f2e280cb900 2023-10-10T21:21:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e2df9b700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280cb900 0x7f2e28146da0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c7c0 tx=0x7f2e24007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e1dffb700 1 -- 172.21.15.154:0/208163273 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24005cd0 con 0x7f2e280cb900 2023-10-10T21:21:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e1dffb700 1 -- 172.21.15.154:0/208163273 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24005e30 con 0x7f2e280cb900 2023-10-10T21:21:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2814c390 con 0x7f2e280cb900 2023-10-10T21:21:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.212+0000 7f2e1dffb700 1 -- 172.21.15.154:0/208163273 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24007320 con 0x7f2e280cb900 2023-10-10T21:21:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.213+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e281472e0 con 0x7f2e280cb900 2023-10-10T21:21:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.214+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2814c8b0 con 0x7f2e280cb900 2023-10-10T21:21:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.214+0000 7f2e1dffb700 1 -- 172.21.15.154:0/208163273 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2e2401b3b0 con 0x7f2e280cb900 2023-10-10T21:21:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.215+0000 7f2e1dffb700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2e0c067170 0x7f2e0c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.215+0000 7f2e1dffb700 1 -- 172.21.15.154:0/208163273 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f2e24084300 con 0x7f2e280cb900 2023-10-10T21:21:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.215+0000 7f2e2d79a700 1 -- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2e0c067170 msgr2=0x7f2e0c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.215+0000 7f2e2d79a700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2e0c067170 0x7f2e0c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:04.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.219+0000 7f2e1dffb700 1 -- 172.21.15.154:0/208163273 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e2814c8b0 con 0x7f2e280cb900 2023-10-10T21:21:04.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.416+0000 7f2e2d79a700 1 -- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2e0c067170 msgr2=0x7f2e0c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:04.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.416+0000 7f2e2d79a700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2e0c067170 0x7f2e0c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:04.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.419+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e2814c8b0 con 0x7f2e280cb900 2023-10-10T21:21:04.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.420+0000 7f2e1dffb700 1 -- 172.21.15.154:0/208163273 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16379 (secure 0 0 0) 0x7f2e2814c8b0 con 0x7f2e280cb900 2023-10-10T21:21:04.421 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:04.421 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":125,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:20:42.341252+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:20:24.012206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-10T21:20:25.295138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/85496":"2023-10-11T21:20:42.341220+0000","172.21.15.154:6835/85496":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/2400849625":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/889786049":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/2836122027":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/3165266294":"2023-10-11T21:20:42.341220+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:21:04.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2e0c067170 msgr2=0x7f2e0c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:04.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2e0c067170 0x7f2e0c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280cb900 msgr2=0x7f2e28146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280cb900 0x7f2e28146da0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c7c0 tx=0x7f2e24007e00 comp rx=0 tx=0).stop 2023-10-10T21:21:04.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 shutdown_connections 2023-10-10T21:21:04.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2e0c067170 0x7f2e0c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e281566e0 0x7f2e280b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280cb900 0x7f2e28146da0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 --2- 172.21.15.154:0/208163273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e28156310 0x7f2e281699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.422+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 >> 172.21.15.154:0/208163273 conn(0x7f2e280cc1f0 msgr2=0x7f2e28151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:04.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.423+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 shutdown_connections 2023-10-10T21:21:04.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.423+0000 7f2e2ef9d700 1 -- 172.21.15.154:0/208163273 wait complete. 2023-10-10T21:21:04.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:20:24.012206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:20:25.295138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T21:21:04.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:21:04.448 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:04.446+0000 7fb1ca86a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:21:04.496 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:04.495+0000 7f2cfb680180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:21:04.612 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:04.611+0000 7fb1ca86a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:21:04.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.635+0000 7f0d5539d700 1 Processor -- start 2023-10-10T21:21:04.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.635+0000 7f0d5539d700 1 -- start start 2023-10-10T21:21:04.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.636+0000 7f0d5539d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0d500b16d0 0x7f0d500b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.636+0000 7f0d5539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b33b0 0x7f0d500b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.636+0000 7f0d5539d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d500b2080 con 0x7f0d500b4e70 2023-10-10T21:21:04.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.636+0000 7f0d5539d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d500cfb00 con 0x7f0d500b16d0 2023-10-10T21:21:04.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.636+0000 7f0d5539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500b5c40 con 0x7f0d500b33b0 2023-10-10T21:21:04.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d4ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0d500b4e70 0x7f0d500ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41974/0 (socket says 172.21.15.154:41974) 2023-10-10T21:21:04.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d4ffff700 1 -- 172.21.15.154:0/386329644 learned_addr learned my addr 172.21.15.154:0/386329644 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:04.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d54b9c700 1 --2- 172.21.15.154:0/386329644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b33b0 0x7f0d500b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d4f7fe700 1 --2- 172.21.15.154:0/386329644 >> v2:172.21.15.179:3300/0 conn(0x7f0d500b16d0 0x7f0d500b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d4effd700 1 -- 172.21.15.154:0/386329644 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310366263 0 0) 0x7f0d500b2080 con 0x7f0d500b4e70 2023-10-10T21:21:04.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d4effd700 1 -- 172.21.15.154:0/386329644 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d38003570 con 0x7f0d500b4e70 2023-10-10T21:21:04.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d4f7fe700 1 -- 172.21.15.154:0/386329644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b33b0 msgr2=0x7f0d500b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:04.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d4f7fe700 1 --2- 172.21.15.154:0/386329644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b33b0 0x7f0d500b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d4f7fe700 1 -- 172.21.15.154:0/386329644 >> v1:172.21.15.154:6789/0 conn(0x7f0d500b4e70 legacy=0x7f0d500ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.637+0000 7f0d4f7fe700 1 -- 172.21.15.154:0/386329644 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d500b5f20 con 0x7f0d500b16d0 2023-10-10T21:21:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d4f7fe700 1 --2- 172.21.15.154:0/386329644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b16d0 0x7f0d500b1b40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0d440098e0 tx=0x7f0d440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34f49c447aacf2eb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d4effd700 1 -- 172.21.15.154:0/386329644 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44011630 con 0x7f0d500b16d0 2023-10-10T21:21:04.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d4effd700 1 -- 172.21.15.154:0/386329644 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44011790 con 0x7f0d500b16d0 2023-10-10T21:21:04.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d4effd700 1 -- 172.21.15.154:0/386329644 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44011b30 con 0x7f0d500b16d0 2023-10-10T21:21:04.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d5539d700 1 -- 172.21.15.154:0/386329644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b16d0 msgr2=0x7f0d500b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d5539d700 1 --2- 172.21.15.154:0/386329644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b16d0 0x7f0d500b1b40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0d440098e0 tx=0x7f0d440091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d5539d700 1 -- 172.21.15.154:0/386329644 shutdown_connections 2023-10-10T21:21:04.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d5539d700 1 --2- 172.21.15.154:0/386329644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b33b0 0x7f0d500b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d5539d700 1 --2- 172.21.15.154:0/386329644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b16d0 0x7f0d500b1b40 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.638+0000 7f0d5539d700 1 -- 172.21.15.154:0/386329644 >> 172.21.15.154:0/386329644 conn(0x7f0d500d10c0 msgr2=0x7f0d500affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:04.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.639+0000 7f0d5539d700 1 -- 172.21.15.154:0/386329644 shutdown_connections 2023-10-10T21:21:04.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.639+0000 7f0d5539d700 1 -- 172.21.15.154:0/386329644 wait complete. 2023-10-10T21:21:04.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.640+0000 7f0d5539d700 1 Processor -- start 2023-10-10T21:21:04.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.640+0000 7f0d5539d700 1 -- start start 2023-10-10T21:21:04.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d5539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b16d0 0x7f0d500c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d5539d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d500b33b0 0x7f0d50157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d5539d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b4e70 0x7f0d5016ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d5539d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50169bb0 con 0x7f0d500b33b0 2023-10-10T21:21:04.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d5539d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50157c90 con 0x7f0d500b4e70 2023-10-10T21:21:04.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d5539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500cc300 con 0x7f0d500b16d0 2023-10-10T21:21:04.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d4f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d500b33b0 0x7f0d50157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d4f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d500b33b0 0x7f0d50157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47922/0 (socket says 172.21.15.154:47922) 2023-10-10T21:21:04.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d4ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b16d0 0x7f0d500c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d54b9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b4e70 0x7f0d5016ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:04.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.641+0000 7f0d4f7fe700 1 -- 172.21.15.154:0/2899287347 learned_addr learned my addr 172.21.15.154:0/2899287347 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:04.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d4f7fe700 1 -- 172.21.15.154:0/2899287347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b16d0 msgr2=0x7f0d500c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d4f7fe700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b16d0 0x7f0d500c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d4f7fe700 1 -- 172.21.15.154:0/2899287347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b4e70 msgr2=0x7f0d5016ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d4f7fe700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b4e70 0x7f0d5016ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d4f7fe700 1 -- 172.21.15.154:0/2899287347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44009420 con 0x7f0d500b33b0 2023-10-10T21:21:04.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d54b9c700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b4e70 0x7f0d5016ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:04.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d4f7fe700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d500b33b0 0x7f0d50157750 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009ed0 tx=0x7f0d44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:04.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d37fff700 1 -- 172.21.15.154:0/2899287347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44000d10 con 0x7f0d500b33b0 2023-10-10T21:21:04.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d37fff700 1 -- 172.21.15.154:0/2899287347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44011b10 con 0x7f0d500b33b0 2023-10-10T21:21:04.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d37fff700 1 -- 172.21.15.154:0/2899287347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44025620 con 0x7f0d500b33b0 2023-10-10T21:21:04.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.642+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d500ca240 con 0x7f0d500b33b0 2023-10-10T21:21:04.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.643+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d500ca800 con 0x7f0d500b33b0 2023-10-10T21:21:04.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.644+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d500ca9f0 con 0x7f0d500b33b0 2023-10-10T21:21:04.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.644+0000 7f0d37fff700 1 -- 172.21.15.154:0/2899287347 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f0d44025a50 con 0x7f0d500b33b0 2023-10-10T21:21:04.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.645+0000 7f0d37fff700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d3c067170 0x7f0d3c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:04.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.645+0000 7f0d37fff700 1 -- 172.21.15.154:0/2899287347 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f0d440861f0 con 0x7f0d500b33b0 2023-10-10T21:21:04.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.645+0000 7f0d4ffff700 1 -- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d3c067170 msgr2=0x7f0d3c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:04.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.645+0000 7f0d4ffff700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d3c067170 0x7f0d3c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:04.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.649+0000 7f0d37fff700 1 -- 172.21.15.154:0/2899287347 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d44052ea0 con 0x7f0d500b33b0 2023-10-10T21:21:04.677 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:04.676+0000 7f2cfb680180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:21:04.699 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:04.697+0000 7fb1ca86a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:21:04.770 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:04.767+0000 7f2cfb680180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:21:04.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.846+0000 7f0d4ffff700 1 -- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d3c067170 msgr2=0x7f0d3c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:04.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.846+0000 7f0d4ffff700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d3c067170 0x7f0d3c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:04.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.867+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d5004bb80 con 0x7f0d500b33b0 2023-10-10T21:21:04.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.868+0000 7f0d37fff700 1 -- 172.21.15.154:0/2899287347 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d440564c0 con 0x7f0d500b33b0 2023-10-10T21:21:04.869 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:21:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d3c067170 msgr2=0x7f0d3c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d3c067170 0x7f0d3c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d500b33b0 msgr2=0x7f0d50157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d500b33b0 0x7f0d50157750 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009ed0 tx=0x7f0d44017000 comp rx=0 tx=0).stop 2023-10-10T21:21:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 shutdown_connections 2023-10-10T21:21:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d500b4e70 0x7f0d5016ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0d3c067170 0x7f0d3c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d500b16d0 0x7f0d500c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 --2- 172.21.15.154:0/2899287347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d500b33b0 0x7f0d50157750 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 >> 172.21.15.154:0/2899287347 conn(0x7f0d500d10c0 msgr2=0x7f0d50069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 shutdown_connections 2023-10-10T21:21:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:04.870+0000 7f0d5539d700 1 -- 172.21.15.154:0/2899287347 wait complete. 2023-10-10T21:21:04.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T21:21:04.924 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:04.922+0000 7fb1ca86a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:21:05.003 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:05.002+0000 7f2cfb680180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:21:05.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.079+0000 7ff805d9d700 1 Processor -- start 2023-10-10T21:21:05.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.079+0000 7ff805d9d700 1 -- start start 2023-10-10T21:21:05.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.081+0000 7ff805d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b16d0 0x7ff8000b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.081+0000 7ff805d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8000b33b0 0x7ff8000b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.081+0000 7ff805d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000b2080 con 0x7ff8000b4e70 2023-10-10T21:21:05.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.081+0000 7ff805d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8000cfb00 con 0x7ff8000b33b0 2023-10-10T21:21:05.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.081+0000 7ff805d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000b5c40 con 0x7ff8000b16d0 2023-10-10T21:21:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.081+0000 7ff80559c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8000b33b0 0x7ff8000b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.081+0000 7ff7fffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b16d0 0x7ff8000b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.081+0000 7ff804d9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff8000b4e70 0x7ff8000ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:50332/0 (socket says 172.21.15.154:50332) 2023-10-10T21:21:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.081+0000 7ff804d9b700 1 -- 172.21.15.154:0/3981672684 learned_addr learned my addr 172.21.15.154:0/3981672684 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.082+0000 7ff7fffff700 1 -- 172.21.15.154:0/3981672684 >> v2:172.21.15.154:3300/0 conn(0x7ff8000b33b0 msgr2=0x7ff8000b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.082+0000 7ff7fffff700 1 --2- 172.21.15.154:0/3981672684 >> v2:172.21.15.154:3300/0 conn(0x7ff8000b33b0 0x7ff8000b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.082+0000 7ff7fffff700 1 -- 172.21.15.154:0/3981672684 >> v1:172.21.15.179:6789/0 conn(0x7ff8000b4e70 legacy=0x7ff8000ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.082+0000 7ff7fffff700 1 -- 172.21.15.154:0/3981672684 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000b5f20 con 0x7ff8000b16d0 2023-10-10T21:21:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.082+0000 7ff7fffff700 1 --2- 172.21.15.154:0/3981672684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b16d0 0x7ff8000b1b40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0098e0 tx=0x7ff7ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10f4c888295fe25b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.082+0000 7ff7ff7fe700 1 -- 172.21.15.154:0/3981672684 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec00b640 con 0x7ff8000b16d0 2023-10-10T21:21:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.082+0000 7ff7ff7fe700 1 -- 172.21.15.154:0/3981672684 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec00b7a0 con 0x7ff8000b16d0 2023-10-10T21:21:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.082+0000 7ff7ff7fe700 1 -- 172.21.15.154:0/3981672684 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec00bb40 con 0x7ff8000b16d0 2023-10-10T21:21:05.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.083+0000 7ff805d9d700 1 -- 172.21.15.154:0/3981672684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b16d0 msgr2=0x7ff8000b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.083+0000 7ff805d9d700 1 --2- 172.21.15.154:0/3981672684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b16d0 0x7ff8000b1b40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0098e0 tx=0x7ff7ec0091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.083+0000 7ff805d9d700 1 -- 172.21.15.154:0/3981672684 shutdown_connections 2023-10-10T21:21:05.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.083+0000 7ff805d9d700 1 --2- 172.21.15.154:0/3981672684 >> v2:172.21.15.154:3300/0 conn(0x7ff8000b33b0 0x7ff8000b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.083+0000 7ff805d9d700 1 --2- 172.21.15.154:0/3981672684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b16d0 0x7ff8000b1b40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.083+0000 7ff805d9d700 1 -- 172.21.15.154:0/3981672684 >> 172.21.15.154:0/3981672684 conn(0x7ff8000d10c0 msgr2=0x7ff8000affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:05.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.083+0000 7ff805d9d700 1 -- 172.21.15.154:0/3981672684 shutdown_connections 2023-10-10T21:21:05.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.083+0000 7ff805d9d700 1 -- 172.21.15.154:0/3981672684 wait complete. 2023-10-10T21:21:05.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.084+0000 7ff805d9d700 1 Processor -- start 2023-10-10T21:21:05.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.085+0000 7ff805d9d700 1 -- start start 2023-10-10T21:21:05.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.085+0000 7ff805d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8000b16d0 0x7ff8000cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff805d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b33b0 0x7ff800158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff805d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8000b4e70 0x7ff8000c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff805d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000ca710 con 0x7ff8000b16d0 2023-10-10T21:21:05.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff805d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c8c70 con 0x7ff8000b4e70 2023-10-10T21:21:05.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff805d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c8060 con 0x7ff8000b33b0 2023-10-10T21:21:05.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff804d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8000b16d0 0x7ff8000cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff804d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8000b16d0 0x7ff8000cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47952/0 (socket says 172.21.15.154:47952) 2023-10-10T21:21:05.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff804d9b700 1 -- 172.21.15.154:0/4653072 learned_addr learned my addr 172.21.15.154:0/4653072 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:05.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff80559c700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8000b4e70 0x7ff8000c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff7fffff700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b33b0 0x7ff800158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff804d9b700 1 -- 172.21.15.154:0/4653072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b33b0 msgr2=0x7ff800158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff804d9b700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b33b0 0x7ff800158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff804d9b700 1 -- 172.21.15.154:0/4653072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8000b4e70 msgr2=0x7ff8000c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff804d9b700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8000b4e70 0x7ff8000c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.086+0000 7ff804d9b700 1 -- 172.21.15.154:0/4653072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec009420 con 0x7ff8000b16d0 2023-10-10T21:21:05.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.087+0000 7ff804d9b700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8000b16d0 0x7ff8000cc590 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c7c0 tx=0x7ff7f4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:05.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.087+0000 7ff7fcff9700 1 -- 172.21.15.154:0/4653072 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4005b30 con 0x7ff8000b16d0 2023-10-10T21:21:05.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.087+0000 7ff7fcff9700 1 -- 172.21.15.154:0/4653072 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f4005c90 con 0x7ff8000b16d0 2023-10-10T21:21:05.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.087+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8000c8340 con 0x7ff8000b16d0 2023-10-10T21:21:05.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.087+0000 7ff7fcff9700 1 -- 172.21.15.154:0/4653072 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4004a80 con 0x7ff8000b16d0 2023-10-10T21:21:05.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.087+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8000c8900 con 0x7ff8000b16d0 2023-10-10T21:21:05.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.088+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff800088990 con 0x7ff8000b16d0 2023-10-10T21:21:05.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.090+0000 7ff7fcff9700 1 -- 172.21.15.154:0/4653072 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7ff7f40070d0 con 0x7ff8000b16d0 2023-10-10T21:21:05.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.091+0000 7ff7fcff9700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ff7e4067140 0x7ff7e40695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.091+0000 7ff7fcff9700 1 -- 172.21.15.154:0/4653072 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6355+0+0 (secure 0 0 0) 0x7ff7f4083e60 con 0x7ff8000b16d0 2023-10-10T21:21:05.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.091+0000 7ff7fffff700 1 -- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ff7e4067140 msgr2=0x7ff7e40695f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:05.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.091+0000 7ff7fffff700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ff7e4067140 0x7ff7e40695f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:05.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.095+0000 7ff7fcff9700 1 -- 172.21.15.154:0/4653072 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7f4050bb0 con 0x7ff8000b16d0 2023-10-10T21:21:05.102 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:05.101+0000 7fb1ca86a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:21:05.190 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:05.189+0000 7f2cfb680180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:21:05.196 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:05.195+0000 7fb1ca86a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:21:05.285 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:05.284+0000 7f2cfb680180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:21:05.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.292+0000 7ff7fffff700 1 -- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ff7e4067140 msgr2=0x7ff7e40695f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:05.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.292+0000 7ff7fffff700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ff7e4067140 0x7ff7e40695f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:05.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.296+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff80004bb80 con 0x7ff8000b16d0 2023-10-10T21:21:05.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.297+0000 7ff7fcff9700 1 -- 172.21.15.154:0/4653072 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7f40541d0 con 0x7ff8000b16d0 2023-10-10T21:21:05.298 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T21:21:05.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.299+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ff7e4067140 msgr2=0x7ff7e40695f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:05.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.299+0000 7ff805d9d700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ff7e4067140 0x7ff7e40695f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.299+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8000b16d0 msgr2=0x7ff8000cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.300+0000 7ff805d9d700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8000b16d0 0x7ff8000cc590 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c7c0 tx=0x7ff7f4007f70 comp rx=0 tx=0).stop 2023-10-10T21:21:05.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.300+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 shutdown_connections 2023-10-10T21:21:05.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.300+0000 7ff805d9d700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8000b4e70 0x7ff8000c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.300+0000 7ff805d9d700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8000b16d0 0x7ff8000cc590 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.300+0000 7ff805d9d700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7ff7e4067140 0x7ff7e40695f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.300+0000 7ff805d9d700 1 --2- 172.21.15.154:0/4653072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8000b33b0 0x7ff800158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.300+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 >> 172.21.15.154:0/4653072 conn(0x7ff8000d10c0 msgr2=0x7ff800069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:05.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.300+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 shutdown_connections 2023-10-10T21:21:05.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.300+0000 7ff805d9d700 1 -- 172.21.15.154:0/4653072 wait complete. 2023-10-10T21:21:05.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T21:21:05.359 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:05.358+0000 7fb1ca86a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:21:05.457 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:05.456+0000 7f2cfb680180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:21:05.460 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:05.459+0000 7fb1ca86a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:21:05.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.511+0000 7f5243fff700 1 Processor -- start 2023-10-10T21:21:05.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.511+0000 7f5243fff700 1 -- start start 2023-10-10T21:21:05.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.512+0000 7f5243fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440cb1a0 0x7f524415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.512+0000 7f5243fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52440ae0d0 0x7f52440ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.512+0000 7f5243fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524406ebd0 con 0x7f524415a8a0 2023-10-10T21:21:05.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.512+0000 7f5243fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524415b2e0 con 0x7f52440ae0d0 2023-10-10T21:21:05.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.512+0000 7f5243fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440aea50 con 0x7f52440cb1a0 2023-10-10T21:21:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.513+0000 7f5242ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440cb1a0 0x7f524415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.512+0000 7f52437fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52440ae0d0 0x7f52440ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.513+0000 7f5242ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440cb1a0 0x7f524415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:54418/0 (socket says 172.21.15.154:54418) 2023-10-10T21:21:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.513+0000 7f5242ffd700 1 -- 172.21.15.154:0/3024039852 learned_addr learned my addr 172.21.15.154:0/3024039852 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.513+0000 7f5242ffd700 1 -- 172.21.15.154:0/3024039852 >> v2:172.21.15.154:3300/0 conn(0x7f52440ae0d0 msgr2=0x7f52440ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.513+0000 7f5242ffd700 1 --2- 172.21.15.154:0/3024039852 >> v2:172.21.15.154:3300/0 conn(0x7f52440ae0d0 0x7f52440ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.513+0000 7f5242ffd700 1 -- 172.21.15.154:0/3024039852 >> v1:172.21.15.154:6789/0 conn(0x7f524415a8a0 legacy=0x7f524406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.513+0000 7f5242ffd700 1 -- 172.21.15.154:0/3024039852 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524415ad20 con 0x7f52440cb1a0 2023-10-10T21:21:05.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.513+0000 7f5242ffd700 1 --2- 172.21.15.154:0/3024039852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440cb1a0 0x7f524415a360 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f52340099b0 tx=0x7f5234009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=847d68b9f8d9c736 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:05.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5241ffb700 1 -- 172.21.15.154:0/3024039852 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234009ea0 con 0x7f52440cb1a0 2023-10-10T21:21:05.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5241ffb700 1 -- 172.21.15.154:0/3024039852 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523400b8f0 con 0x7f52440cb1a0 2023-10-10T21:21:05.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5241ffb700 1 -- 172.21.15.154:0/3024039852 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400bc90 con 0x7f52440cb1a0 2023-10-10T21:21:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5243fff700 1 -- 172.21.15.154:0/3024039852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440cb1a0 msgr2=0x7f524415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5243fff700 1 --2- 172.21.15.154:0/3024039852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440cb1a0 0x7f524415a360 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f52340099b0 tx=0x7f5234009250 comp rx=0 tx=0).stop 2023-10-10T21:21:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5243fff700 1 -- 172.21.15.154:0/3024039852 shutdown_connections 2023-10-10T21:21:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5243fff700 1 --2- 172.21.15.154:0/3024039852 >> v2:172.21.15.154:3300/0 conn(0x7f52440ae0d0 0x7f52440ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5243fff700 1 --2- 172.21.15.154:0/3024039852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440cb1a0 0x7f524415a360 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5243fff700 1 -- 172.21.15.154:0/3024039852 >> 172.21.15.154:0/3024039852 conn(0x7f52440cc1e0 msgr2=0x7f52440cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:05.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5243fff700 1 -- 172.21.15.154:0/3024039852 shutdown_connections 2023-10-10T21:21:05.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.514+0000 7f5243fff700 1 -- 172.21.15.154:0/3024039852 wait complete. 2023-10-10T21:21:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.516+0000 7f5243fff700 1 Processor -- start 2023-10-10T21:21:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.516+0000 7f5243fff700 1 -- start start 2023-10-10T21:21:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f5243fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440ae0d0 0x7f5244169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f5243fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52440cb1a0 0x7f5244157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f5243fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440c5c50 0x7f524416ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f5243fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5244155670 con 0x7f52440cb1a0 2023-10-10T21:21:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f5243fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440c3290 con 0x7f52440c5c50 2023-10-10T21:21:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f5243fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524416a2b0 con 0x7f52440ae0d0 2023-10-10T21:21:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f52427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52440cb1a0 0x7f5244157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f52427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52440cb1a0 0x7f5244157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47968/0 (socket says 172.21.15.154:47968) 2023-10-10T21:21:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f52427fc700 1 -- 172.21.15.154:0/3225386362 learned_addr learned my addr 172.21.15.154:0/3225386362 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f5242ffd700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440ae0d0 0x7f5244169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.517+0000 7f52437fe700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440c5c50 0x7f524416ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f52427fc700 1 -- 172.21.15.154:0/3225386362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440ae0d0 msgr2=0x7f5244169d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f52427fc700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440ae0d0 0x7f5244169d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f52427fc700 1 -- 172.21.15.154:0/3225386362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440c5c50 msgr2=0x7f524416ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f52427fc700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440c5c50 0x7f524416ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f52427fc700 1 -- 172.21.15.154:0/3225386362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340094f0 con 0x7f52440cb1a0 2023-10-10T21:21:05.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f52427fc700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52440cb1a0 0x7f5244157770 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f523800c510 tx=0x7f523800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:05.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f522affd700 1 -- 172.21.15.154:0/3225386362 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238011590 con 0x7f52440cb1a0 2023-10-10T21:21:05.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f522affd700 1 -- 172.21.15.154:0/3225386362 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238011710 con 0x7f52440cb1a0 2023-10-10T21:21:05.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5244157cb0 con 0x7f52440cb1a0 2023-10-10T21:21:05.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f522affd700 1 -- 172.21.15.154:0/3225386362 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238011ad0 con 0x7f52440cb1a0 2023-10-10T21:21:05.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.518+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440c34e0 con 0x7f52440cb1a0 2023-10-10T21:21:05.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.519+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524406c450 con 0x7f52440cb1a0 2023-10-10T21:21:05.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.520+0000 7f522affd700 1 -- 172.21.15.154:0/3225386362 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f523801b3b0 con 0x7f52440cb1a0 2023-10-10T21:21:05.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.521+0000 7f522affd700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5230067170 0x7f5230069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.521+0000 7f522affd700 1 -- 172.21.15.154:0/3225386362 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f5238083ee0 con 0x7f52440cb1a0 2023-10-10T21:21:05.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.521+0000 7f5242ffd700 1 -- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5230067170 msgr2=0x7f5230069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:05.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.521+0000 7f5242ffd700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5230067170 0x7f5230069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:05.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.526+0000 7f522affd700 1 -- 172.21.15.154:0/3225386362 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5238050c30 con 0x7f52440cb1a0 2023-10-10T21:21:05.563 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:05.562+0000 7f2cfb680180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:21:05.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.722+0000 7f5242ffd700 1 -- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5230067170 msgr2=0x7f5230069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:05.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.722+0000 7f5242ffd700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5230067170 0x7f5230069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:05.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.725+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f524415b000 con 0x7f52440cb1a0 2023-10-10T21:21:05.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.726+0000 7f522affd700 1 -- 172.21.15.154:0/3225386362 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5238017070 con 0x7f52440cb1a0 2023-10-10T21:21:05.727 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T21:21:05.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5230067170 msgr2=0x7f5230069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:05.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5230067170 0x7f5230069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52440cb1a0 msgr2=0x7f5244157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52440cb1a0 0x7f5244157770 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f523800c510 tx=0x7f523800c820 comp rx=0 tx=0).stop 2023-10-10T21:21:05.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 shutdown_connections 2023-10-10T21:21:05.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440c5c50 0x7f524416ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5230067170 0x7f5230069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52440ae0d0 0x7f5244169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 --2- 172.21.15.154:0/3225386362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52440cb1a0 0x7f5244157770 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 >> 172.21.15.154:0/3225386362 conn(0x7f52440cc1e0 msgr2=0x7f52440c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:05.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 shutdown_connections 2023-10-10T21:21:05.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.728+0000 7f5243fff700 1 -- 172.21.15.154:0/3225386362 wait complete. 2023-10-10T21:21:05.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:21:05.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.939+0000 7f522759e700 1 Processor -- start 2023-10-10T21:21:05.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.939+0000 7f522759e700 1 -- start start 2023-10-10T21:21:05.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.940+0000 7f522759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5228159420 0x7f52280b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 0x7f522815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522759e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52280b2980 con 0x7f52281597f0 2023-10-10T21:21:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522759e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522815dbb0 con 0x7f5228159420 2023-10-10T21:21:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280b11d0 con 0x7f522815d230 2023-10-10T21:21:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5228159420 0x7f52280b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5228159420 0x7f52280b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50748/0 (socket says 172.21.15.154:50748) 2023-10-10T21:21:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522659c700 1 -- 172.21.15.154:0/803493032 learned_addr learned my addr 172.21.15.154:0/803493032 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:05.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f5226d9d700 1 --2- 172.21.15.154:0/803493032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 0x7f522815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522659c700 1 -- 172.21.15.154:0/803493032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 msgr2=0x7f522815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522659c700 1 --2- 172.21.15.154:0/803493032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 0x7f522815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522659c700 1 -- 172.21.15.154:0/803493032 >> v1:172.21.15.154:6789/0 conn(0x7f52281597f0 legacy=0x7f52280b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.941+0000 7f522659c700 1 -- 172.21.15.154:0/803493032 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280b14b0 con 0x7f5228159420 2023-10-10T21:21:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.942+0000 7f522659c700 1 --2- 172.21.15.154:0/803493032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 0x7f52280b5f40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f52180099b0 tx=0x7f5218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c52deb3381df4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.942+0000 7f522559a700 1 -- 172.21.15.154:0/803493032 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218009ea0 con 0x7f5228159420 2023-10-10T21:21:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.942+0000 7f522559a700 1 -- 172.21.15.154:0/803493032 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521800b860 con 0x7f5228159420 2023-10-10T21:21:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.942+0000 7f522559a700 1 -- 172.21.15.154:0/803493032 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800bc00 con 0x7f5228159420 2023-10-10T21:21:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.943+0000 7f522759e700 1 -- 172.21.15.154:0/803493032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 msgr2=0x7f52280b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.943+0000 7f522759e700 1 --2- 172.21.15.154:0/803493032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 0x7f52280b5f40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f52180099b0 tx=0x7f5218009250 comp rx=0 tx=0).stop 2023-10-10T21:21:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.943+0000 7f522759e700 1 -- 172.21.15.154:0/803493032 shutdown_connections 2023-10-10T21:21:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.943+0000 7f522759e700 1 --2- 172.21.15.154:0/803493032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 0x7f522815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.943+0000 7f522759e700 1 --2- 172.21.15.154:0/803493032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 0x7f52280b5f40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.943+0000 7f522759e700 1 -- 172.21.15.154:0/803493032 >> 172.21.15.154:0/803493032 conn(0x7f52280d0660 msgr2=0x7f52280d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.943+0000 7f522759e700 1 -- 172.21.15.154:0/803493032 shutdown_connections 2023-10-10T21:21:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.943+0000 7f522759e700 1 -- 172.21.15.154:0/803493032 wait complete. 2023-10-10T21:21:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.944+0000 7f522759e700 1 Processor -- start 2023-10-10T21:21:05.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.944+0000 7f522759e700 1 -- start start 2023-10-10T21:21:05.949 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:05.947+0000 7fb1ca86a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:21:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.945+0000 7f522759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 0x7f52281551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.945+0000 7f522759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52281597f0 0x7f52280cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.945+0000 7f522759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 0x7f52280cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.945+0000 7f522759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c6ba0 con 0x7f5228159420 2023-10-10T21:21:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.945+0000 7f522759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c9ba0 con 0x7f52281597f0 2023-10-10T21:21:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.945+0000 7f522759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c9870 con 0x7f522815d230 2023-10-10T21:21:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.945+0000 7f522659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 0x7f52281551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f522659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 0x7f52281551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50750/0 (socket says 172.21.15.154:50750) 2023-10-10T21:21:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f522659c700 1 -- 172.21.15.154:0/308512975 learned_addr learned my addr 172.21.15.154:0/308512975 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f5226d9d700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 0x7f52280cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f5225d9b700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52281597f0 0x7f52280cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:05.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f522659c700 1 -- 172.21.15.154:0/308512975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 msgr2=0x7f52280cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f522659c700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 0x7f52280cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f522659c700 1 -- 172.21.15.154:0/308512975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52281597f0 msgr2=0x7f52280cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:05.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f522659c700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52281597f0 0x7f52280cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f522659c700 1 -- 172.21.15.154:0/308512975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52180094f0 con 0x7f5228159420 2023-10-10T21:21:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f5225d9b700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52281597f0 0x7f52280cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f522659c700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 0x7f52281551e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f5218006fd0 tx=0x7f5218017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.946+0000 7f52167fc700 1 -- 172.21.15.154:0/308512975 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218000d10 con 0x7f5228159420 2023-10-10T21:21:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.947+0000 7f52167fc700 1 -- 172.21.15.154:0/308512975 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521800bbe0 con 0x7f5228159420 2023-10-10T21:21:05.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.947+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52280c6300 con 0x7f5228159420 2023-10-10T21:21:05.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.947+0000 7f52167fc700 1 -- 172.21.15.154:0/308512975 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218011670 con 0x7f5228159420 2023-10-10T21:21:05.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.947+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52280c68c0 con 0x7f5228159420 2023-10-10T21:21:05.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.948+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522804c3c0 con 0x7f5228159420 2023-10-10T21:21:05.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.949+0000 7f52167fc700 1 -- 172.21.15.154:0/308512975 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f5218011aa0 con 0x7f5228159420 2023-10-10T21:21:05.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.950+0000 7f52167fc700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5208067170 0x7f5208069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:05.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.950+0000 7f52167fc700 1 -- 172.21.15.154:0/308512975 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f52180863a0 con 0x7f5228159420 2023-10-10T21:21:05.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.950+0000 7f5225d9b700 1 -- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5208067170 msgr2=0x7f5208069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:05.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.950+0000 7f5225d9b700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5208067170 0x7f5208069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:05.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:05.954+0000 7f52167fc700 1 -- 172.21.15.154:0/308512975 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52180530f0 con 0x7f5228159420 2023-10-10T21:21:06.044 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:06.042+0000 7fb1ca86a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:21:06.090 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:06.089+0000 7f2cfb680180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:21:06.133 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:06.131+0000 7fb1ca86a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:21:06.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.151+0000 7f5225d9b700 1 -- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5208067170 msgr2=0x7f5208069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:06.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.151+0000 7f5225d9b700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5208067170 0x7f5208069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:06.191 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:06.190+0000 7f2cfb680180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:21:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.225+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52280b1790 con 0x7f5228159420 2023-10-10T21:21:06.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.225+0000 7f52167fc700 1 -- 172.21.15.154:0/308512975 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f5218056710 con 0x7f5228159420 2023-10-10T21:21:06.227 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:06.227 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/909044943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":909044943},{"type":"v1","addr":"172.21.15.154:6834","nonce":909044943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/4163308288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":4163308288},{"type":"v1","addr":"172.21.15.179:6834","nonce":4163308288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7330,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3673994181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3673994181},{"type":"v1","addr":"172.21.15.179:6835","nonce":3673994181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:20:26.309607+0000","modified":"2023-10-10T21:20:30.131493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7677},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7677":{"gid":7677,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1893020718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1893020718},{"type":"v1","addr":"172.21.15.154:6837","nonce":1893020718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-10T21:21:06.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5208067170 msgr2=0x7f5208069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:06.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5208067170 0x7f5208069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 msgr2=0x7f52281551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 0x7f52281551e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f5218006fd0 tx=0x7f5218017000 comp rx=0 tx=0).stop 2023-10-10T21:21:06.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 shutdown_connections 2023-10-10T21:21:06.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f5208067170 0x7f5208069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522815d230 0x7f52280cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5228159420 0x7f52281551e0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 --2- 172.21.15.154:0/308512975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52281597f0 0x7f52280cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 >> 172.21.15.154:0/308512975 conn(0x7f52280d0660 msgr2=0x7f5228156000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:06.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 shutdown_connections 2023-10-10T21:21:06.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.228+0000 7f522759e700 1 -- 172.21.15.154:0/308512975 wait complete. 2023-10-10T21:21:06.232 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 54 2023-10-10T21:21:06.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:21:06.290 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:06.289+0000 7f2cfb680180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:21:06.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.439+0000 7effc17ff700 1 Processor -- start 2023-10-10T21:21:06.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.439+0000 7effc17ff700 1 -- start start 2023-10-10T21:21:06.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.440+0000 7effc17ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7effbc0cbf30 0x7effbc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.440+0000 7effc17ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effbc0ccf90 0x7effbc0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.440+0000 7effc17ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc0cc300 con 0x7effbc15a270 2023-10-10T21:21:06.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.440+0000 7effc17ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc156bf0 con 0x7effbc0ccf90 2023-10-10T21:21:06.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.440+0000 7effc17ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc0ae950 con 0x7effbc0cbf30 2023-10-10T21:21:06.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effba7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effbc0ccf90 0x7effbc0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effbaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7effbc0cbf30 0x7effbc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effbaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7effbc0cbf30 0x7effbc0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:47336/0 (socket says 172.21.15.154:47336) 2023-10-10T21:21:06.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effba7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effbc0ccf90 0x7effbc0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50766/0 (socket says 172.21.15.154:50766) 2023-10-10T21:21:06.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effbaffd700 1 -- 172.21.15.154:0/4072771498 learned_addr learned my addr 172.21.15.154:0/4072771498 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:06.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effbb7fe700 1 --1- 172.21.15.154:0/4072771498 >> v1:172.21.15.154:6789/0 conn(0x7effbc15a270 0x7effbc0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58474/0 (socket says 172.21.15.154:58474) 2023-10-10T21:21:06.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effba7fc700 1 -- 172.21.15.154:0/4072771498 >> v2:172.21.15.179:3300/0 conn(0x7effbc0cbf30 msgr2=0x7effbc0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:06.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effba7fc700 1 --2- 172.21.15.154:0/4072771498 >> v2:172.21.15.179:3300/0 conn(0x7effbc0cbf30 0x7effbc0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effba7fc700 1 -- 172.21.15.154:0/4072771498 >> v1:172.21.15.154:6789/0 conn(0x7effbc15a270 legacy=0x7effbc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effba7fc700 1 -- 172.21.15.154:0/4072771498 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0ad370 con 0x7effbc0ccf90 2023-10-10T21:21:06.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.441+0000 7effba7fc700 1 --2- 172.21.15.154:0/4072771498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 0x7effbc0b0d10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7effbc063d40 tx=0x7effb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff8a7e47bcad7ff server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:06.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effb9ffb700 1 -- 172.21.15.154:0/4072771498 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0011630 con 0x7effbc0ccf90 2023-10-10T21:21:06.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effb9ffb700 1 -- 172.21.15.154:0/4072771498 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0011790 con 0x7effbc0ccf90 2023-10-10T21:21:06.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effb9ffb700 1 -- 172.21.15.154:0/4072771498 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0011b30 con 0x7effbc0ccf90 2023-10-10T21:21:06.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effc17ff700 1 -- 172.21.15.154:0/4072771498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 msgr2=0x7effbc0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effc17ff700 1 --2- 172.21.15.154:0/4072771498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 0x7effbc0b0d10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7effbc063d40 tx=0x7effb00091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effc17ff700 1 -- 172.21.15.154:0/4072771498 shutdown_connections 2023-10-10T21:21:06.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effc17ff700 1 --2- 172.21.15.154:0/4072771498 >> v2:172.21.15.179:3300/0 conn(0x7effbc0cbf30 0x7effbc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effc17ff700 1 --2- 172.21.15.154:0/4072771498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 0x7effbc0b0d10 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effc17ff700 1 -- 172.21.15.154:0/4072771498 >> 172.21.15.154:0/4072771498 conn(0x7effbc06a320 msgr2=0x7effbc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:06.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.442+0000 7effc17ff700 1 -- 172.21.15.154:0/4072771498 shutdown_connections 2023-10-10T21:21:06.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.443+0000 7effc17ff700 1 -- 172.21.15.154:0/4072771498 wait complete. 2023-10-10T21:21:06.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.444+0000 7effc17ff700 1 Processor -- start 2023-10-10T21:21:06.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.444+0000 7effc17ff700 1 -- start start 2023-10-10T21:21:06.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effc17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effbc0cbf30 0x7effbc06dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effc17ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 0x7effbc0c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effc17ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effbc15a270 0x7effbc0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effc17ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0c8010 con 0x7effbc0ccf90 2023-10-10T21:21:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effc17ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc16b400 con 0x7effbc15a270 2023-10-10T21:21:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effc17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc16b650 con 0x7effbc0cbf30 2023-10-10T21:21:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effba7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 0x7effbc0c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effba7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 0x7effbc0c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50778/0 (socket says 172.21.15.154:50778) 2023-10-10T21:21:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effba7fc700 1 -- 172.21.15.154:0/1372152486 learned_addr learned my addr 172.21.15.154:0/1372152486 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effbaffd700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effbc0cbf30 0x7effbc06dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.445+0000 7effbb7fe700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effbc15a270 0x7effbc0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effba7fc700 1 -- 172.21.15.154:0/1372152486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effbc0cbf30 msgr2=0x7effbc06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effba7fc700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effbc0cbf30 0x7effbc06dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effba7fc700 1 -- 172.21.15.154:0/1372152486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effbc15a270 msgr2=0x7effbc0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effba7fc700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effbc15a270 0x7effbc0c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effba7fc700 1 -- 172.21.15.154:0/1372152486 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009420 con 0x7effbc0ccf90 2023-10-10T21:21:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effbb7fe700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effbc15a270 0x7effbc0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:06.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effba7fc700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 0x7effbc0c7590 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7effb00091e0 tx=0x7effb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:06.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effa2ffd700 1 -- 172.21.15.154:0/1372152486 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb001bb60 con 0x7effbc0ccf90 2023-10-10T21:21:06.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effa2ffd700 1 -- 172.21.15.154:0/1372152486 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb001bce0 con 0x7effbc0ccf90 2023-10-10T21:21:06.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effa2ffd700 1 -- 172.21.15.154:0/1372152486 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0025670 con 0x7effbc0ccf90 2023-10-10T21:21:06.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc16b930 con 0x7effbc0ccf90 2023-10-10T21:21:06.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.446+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc16bef0 con 0x7effbc0ccf90 2023-10-10T21:21:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.448+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc155ab0 con 0x7effbc0ccf90 2023-10-10T21:21:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.448+0000 7effa2ffd700 1 -- 172.21.15.154:0/1372152486 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7effb0023070 con 0x7effbc0ccf90 2023-10-10T21:21:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.449+0000 7effa2ffd700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7effa8067170 0x7effa8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.449+0000 7effa2ffd700 1 -- 172.21.15.154:0/1372152486 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6411+0+0 (secure 0 0 0) 0x7effb0086150 con 0x7effbc0ccf90 2023-10-10T21:21:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.450+0000 7effbaffd700 1 -- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7effa8067170 msgr2=0x7effa8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.450+0000 7effbaffd700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7effa8067170 0x7effa8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.453+0000 7effa2ffd700 1 -- 172.21.15.154:0/1372152486 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effb0052dd0 con 0x7effbc0ccf90 2023-10-10T21:21:06.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.651+0000 7effbaffd700 1 -- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7effa8067170 msgr2=0x7effa8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:06.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.651+0000 7effbaffd700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7effa8067170 0x7effa8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:06.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.654+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effbc04c3c0 con 0x7effbc0ccf90 2023-10-10T21:21:06.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.655+0000 7effa2ffd700 1 -- 172.21.15.154:0/1372152486 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16491 (secure 0 0 0) 0x7effb00563f0 con 0x7effbc0ccf90 2023-10-10T21:21:06.656 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:06.657 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":126,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:21:06.155223+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:20:24.012206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-10T21:20:25.295138+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":126,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/85496":"2023-10-11T21:20:42.341220+0000","172.21.15.154:6835/85496":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/2400849625":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/889786049":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/2836122027":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/3165266294":"2023-10-11T21:20:42.341220+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:21:06.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7effa8067170 msgr2=0x7effa8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:06.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7effa8067170 0x7effa8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 msgr2=0x7effbc0c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 0x7effbc0c7590 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7effb00091e0 tx=0x7effb0017000 comp rx=0 tx=0).stop 2023-10-10T21:21:06.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 shutdown_connections 2023-10-10T21:21:06.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effbc15a270 0x7effbc0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7effa8067170 0x7effa8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effbc0cbf30 0x7effbc06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 --2- 172.21.15.154:0/1372152486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effbc0ccf90 0x7effbc0c7590 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 >> 172.21.15.154:0/1372152486 conn(0x7effbc06a320 msgr2=0x7effbc155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:06.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 shutdown_connections 2023-10-10T21:21:06.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.657+0000 7effc17ff700 1 -- 172.21.15.154:0/1372152486 wait complete. 2023-10-10T21:21:06.676 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T21:21:06.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:21:06.766 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:06.765+0000 7fb1ca86a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:21:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.935+0000 7f0b0979d700 1 Processor -- start 2023-10-10T21:21:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.935+0000 7f0b0979d700 1 -- start start 2023-10-10T21:21:06.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.936+0000 7f0b0979d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b040c6c60 0x7f0b040c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.936+0000 7f0b0979d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0406e8c0 0x7f0b040c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.936+0000 7f0b0979d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b040b1410 con 0x7f0b041595a0 2023-10-10T21:21:06.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.936+0000 7f0b0979d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b040b2b90 con 0x7f0b040c6c60 2023-10-10T21:21:06.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.936+0000 7f0b0979d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b04063230 con 0x7f0b0406e8c0 2023-10-10T21:21:06.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b037fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b040c6c60 0x7f0b040c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b08f9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0406e8c0 0x7f0b040c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b03fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f0b041595a0 0x7f0b040b18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:47916/0 (socket says 172.21.15.154:47916) 2023-10-10T21:21:06.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b03fff700 1 -- 172.21.15.154:0/1404600313 learned_addr learned my addr 172.21.15.154:0/1404600313 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:06.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b08f9c700 1 -- 172.21.15.154:0/1404600313 >> v2:172.21.15.154:3300/0 conn(0x7f0b040c6c60 msgr2=0x7f0b040c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:06.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b08f9c700 1 --2- 172.21.15.154:0/1404600313 >> v2:172.21.15.154:3300/0 conn(0x7f0b040c6c60 0x7f0b040c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b02ffd700 1 -- 172.21.15.154:0/1404600313 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198643537 0 0) 0x7f0b040b1410 con 0x7f0b041595a0 2023-10-10T21:21:06.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b08f9c700 1 -- 172.21.15.154:0/1404600313 >> v1:172.21.15.179:6789/0 conn(0x7f0b041595a0 legacy=0x7f0b040b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b08f9c700 1 -- 172.21.15.154:0/1404600313 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b040634f0 con 0x7f0b0406e8c0 2023-10-10T21:21:06.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b037fe700 1 --2- 172.21.15.154:0/1404600313 >> v2:172.21.15.154:3300/0 conn(0x7f0b040c6c60 0x7f0b040c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:06.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.937+0000 7f0b08f9c700 1 --2- 172.21.15.154:0/1404600313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0406e8c0 0x7f0b040c8660 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009e60 tx=0x7f0afc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0584c19e87ab3b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:06.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.938+0000 7f0b02ffd700 1 -- 172.21.15.154:0/1404600313 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc00e070 con 0x7f0b0406e8c0 2023-10-10T21:21:06.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.938+0000 7f0b02ffd700 1 -- 172.21.15.154:0/1404600313 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc00bb60 con 0x7f0b0406e8c0 2023-10-10T21:21:06.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.938+0000 7f0b02ffd700 1 -- 172.21.15.154:0/1404600313 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc012430 con 0x7f0b0406e8c0 2023-10-10T21:21:06.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.938+0000 7f0b0979d700 1 -- 172.21.15.154:0/1404600313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0406e8c0 msgr2=0x7f0b040c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.938+0000 7f0b0979d700 1 --2- 172.21.15.154:0/1404600313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0406e8c0 0x7f0b040c8660 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009e60 tx=0x7f0afc009780 comp rx=0 tx=0).stop 2023-10-10T21:21:06.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.939+0000 7f0b0979d700 1 -- 172.21.15.154:0/1404600313 shutdown_connections 2023-10-10T21:21:06.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.939+0000 7f0b0979d700 1 --2- 172.21.15.154:0/1404600313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0406e8c0 0x7f0b040c8660 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.939+0000 7f0b0979d700 1 --2- 172.21.15.154:0/1404600313 >> v2:172.21.15.154:3300/0 conn(0x7f0b040c6c60 0x7f0b040c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.939+0000 7f0b0979d700 1 -- 172.21.15.154:0/1404600313 >> 172.21.15.154:0/1404600313 conn(0x7f0b0406ddb0 msgr2=0x7f0b0406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.939+0000 7f0b0979d700 1 -- 172.21.15.154:0/1404600313 shutdown_connections 2023-10-10T21:21:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.939+0000 7f0b0979d700 1 -- 172.21.15.154:0/1404600313 wait complete. 2023-10-10T21:21:06.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.941+0000 7f0b0979d700 1 Processor -- start 2023-10-10T21:21:06.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.941+0000 7f0b0979d700 1 -- start start 2023-10-10T21:21:06.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b0979d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0406e8c0 0x7f0b0413d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b0979d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040c6c60 0x7f0b0415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b0979d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b041595a0 0x7f0b0415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b0979d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0413dac0 con 0x7f0b041595a0 2023-10-10T21:21:06.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b0979d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0413e420 con 0x7f0b0406e8c0 2023-10-10T21:21:06.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b0979d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040c1d70 con 0x7f0b040c6c60 2023-10-10T21:21:06.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b08f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b041595a0 0x7f0b0415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b03fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0406e8c0 0x7f0b0413d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b08f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b041595a0 0x7f0b0415b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50796/0 (socket says 172.21.15.154:50796) 2023-10-10T21:21:06.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b08f9c700 1 -- 172.21.15.154:0/508395991 learned_addr learned my addr 172.21.15.154:0/508395991 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:06.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.943+0000 7f0b037fe700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040c6c60 0x7f0b0415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:06.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0b08f9c700 1 -- 172.21.15.154:0/508395991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040c6c60 msgr2=0x7f0b0415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0b08f9c700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040c6c60 0x7f0b0415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0b08f9c700 1 -- 172.21.15.154:0/508395991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0406e8c0 msgr2=0x7f0b0413d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:06.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0b08f9c700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0406e8c0 0x7f0b0413d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:06.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0b08f9c700 1 -- 172.21.15.154:0/508395991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af8009420 con 0x7f0b041595a0 2023-10-10T21:21:06.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0b08f9c700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b041595a0 0x7f0b0415b1b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0b0415d3c0 tx=0x7f0afc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:06.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0aebfff700 1 -- 172.21.15.154:0/508395991 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc012ea0 con 0x7f0b041595a0 2023-10-10T21:21:06.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0aebfff700 1 -- 172.21.15.154:0/508395991 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc027470 con 0x7f0b041595a0 2023-10-10T21:21:06.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0aebfff700 1 -- 172.21.15.154:0/508395991 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc027830 con 0x7f0b041595a0 2023-10-10T21:21:06.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc009a20 con 0x7f0b041595a0 2023-10-10T21:21:06.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.944+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0413ddd0 con 0x7f0b041595a0 2023-10-10T21:21:06.951 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:06.945+0000 7fb1ca86a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:21:06.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.945+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0404c3c0 con 0x7f0b041595a0 2023-10-10T21:21:06.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.946+0000 7f0aebfff700 1 -- 172.21.15.154:0/508395991 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f0afc024070 con 0x7f0b041595a0 2023-10-10T21:21:06.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.947+0000 7f0aebfff700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0af0067170 0x7f0af0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:06.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.947+0000 7f0aebfff700 1 -- 172.21.15.154:0/508395991 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f0afc087250 con 0x7f0b041595a0 2023-10-10T21:21:06.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.947+0000 7f0b03fff700 1 -- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0af0067170 msgr2=0x7f0af0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:06.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.947+0000 7f0b03fff700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0af0067170 0x7f0af0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:06.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:06.951+0000 7f0aebfff700 1 -- 172.21.15.154:0/508395991 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0afc053ed0 con 0x7f0b041595a0 2023-10-10T21:21:06.989 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:06.988+0000 7f2cfb680180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:21:07.043 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:07.041+0000 7fb1ca86a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:21:07.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.148+0000 7f0b03fff700 1 -- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0af0067170 msgr2=0x7f0af0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:07.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.148+0000 7f0b03fff700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0af0067170 0x7f0af0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:07.167 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:07.166+0000 7f2cfb680180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:21:07.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.198+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b040637d0 con 0x7f0b041595a0 2023-10-10T21:21:07.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.198+0000 7f0aebfff700 1 -- 172.21.15.154:0/508395991 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f0afc0574f0 con 0x7f0b041595a0 2023-10-10T21:21:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:07.200 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/909044943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":909044943},{"type":"v1","addr":"172.21.15.154:6834","nonce":909044943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/4163308288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":4163308288},{"type":"v1","addr":"172.21.15.179:6834","nonce":4163308288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7330,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3673994181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3673994181},{"type":"v1","addr":"172.21.15.179:6835","nonce":3673994181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:20:26.309607+0000","modified":"2023-10-10T21:20:30.131493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7677},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7677":{"gid":7677,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1893020718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1893020718},{"type":"v1","addr":"172.21.15.154:6837","nonce":1893020718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-10T21:21:07.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0af0067170 msgr2=0x7f0af0069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:07.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0af0067170 0x7f0af0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b041595a0 msgr2=0x7f0b0415b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b041595a0 0x7f0b0415b1b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0b0415d3c0 tx=0x7f0afc019000 comp rx=0 tx=0).stop 2023-10-10T21:21:07.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 shutdown_connections 2023-10-10T21:21:07.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b041595a0 0x7f0b0415b1b0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0406e8c0 0x7f0b0413d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f0af0067170 0x7f0af0069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 --2- 172.21.15.154:0/508395991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040c6c60 0x7f0b0415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 >> 172.21.15.154:0/508395991 conn(0x7f0b0406ddb0 msgr2=0x7f0b040c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:07.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 shutdown_connections 2023-10-10T21:21:07.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.201+0000 7f0b0979d700 1 -- 172.21.15.154:0/508395991 wait complete. 2023-10-10T21:21:07.205 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 54 2023-10-10T21:21:07.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:21:07.270 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:07.269+0000 7f2cfb680180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:21:07.338 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:07.337+0000 7fb1ca86a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:21:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.411+0000 7fb5031ff700 1 Processor -- start 2023-10-10T21:21:07.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.411+0000 7fb5031ff700 1 -- start start 2023-10-10T21:21:07.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.412+0000 7fb5031ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc0b1c20 0x7fb4fc1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.412+0000 7fb5031ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4fc157820 0x7fb4fc0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.412+0000 7fb5031ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc157c80 con 0x7fb4fc0b1850 2023-10-10T21:21:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.412+0000 7fb5031ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4fc06fc30 con 0x7fb4fc157820 2023-10-10T21:21:07.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.412+0000 7fb5031ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0cc260 con 0x7fb4fc0b1c20 2023-10-10T21:21:07.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.412+0000 7fb500f9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb4fc0b1850 0x7fb4fc0ae680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58482/0 (socket says 172.21.15.154:58482) 2023-10-10T21:21:07.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.412+0000 7fb500f9b700 1 -- 172.21.15.154:0/662845261 learned_addr learned my addr 172.21.15.154:0/662845261 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:07.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb50179c700 1 --2- 172.21.15.154:0/662845261 >> v2:172.21.15.154:3300/0 conn(0x7fb4fc157820 0x7fb4fc0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:07.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb4fbfff700 1 --2- 172.21.15.154:0/662845261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc0b1c20 0x7fb4fc1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:07.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb4fb7fe700 1 -- 172.21.15.154:0/662845261 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152920719 0 0) 0x7fb4fc157c80 con 0x7fb4fc0b1850 2023-10-10T21:21:07.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb4fb7fe700 1 -- 172.21.15.154:0/662845261 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4ec003570 con 0x7fb4fc0b1850 2023-10-10T21:21:07.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb50179c700 1 -- 172.21.15.154:0/662845261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc0b1c20 msgr2=0x7fb4fc1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:07.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb50179c700 1 --2- 172.21.15.154:0/662845261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc0b1c20 0x7fb4fc1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb50179c700 1 -- 172.21.15.154:0/662845261 >> v1:172.21.15.154:6789/0 conn(0x7fb4fc0b1850 legacy=0x7fb4fc0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb50179c700 1 -- 172.21.15.154:0/662845261 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0cb300 con 0x7fb4fc157820 2023-10-10T21:21:07.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb4fbfff700 1 --2- 172.21.15.154:0/662845261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc0b1c20 0x7fb4fc1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:07.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.413+0000 7fb50179c700 1 --2- 172.21.15.154:0/662845261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc157820 0x7fb4fc0abf60 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009e60 tx=0x7fb4f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5957a7d1ae385af2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:07.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.414+0000 7fb4fb7fe700 1 -- 172.21.15.154:0/662845261 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400e070 con 0x7fb4fc157820 2023-10-10T21:21:07.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.414+0000 7fb4fb7fe700 1 -- 172.21.15.154:0/662845261 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f400bab0 con 0x7fb4fc157820 2023-10-10T21:21:07.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.414+0000 7fb4fb7fe700 1 -- 172.21.15.154:0/662845261 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400be30 con 0x7fb4fc157820 2023-10-10T21:21:07.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.414+0000 7fb5031ff700 1 -- 172.21.15.154:0/662845261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc157820 msgr2=0x7fb4fc0abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.414+0000 7fb5031ff700 1 --2- 172.21.15.154:0/662845261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc157820 0x7fb4fc0abf60 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009e60 tx=0x7fb4f4009780 comp rx=0 tx=0).stop 2023-10-10T21:21:07.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.415+0000 7fb5031ff700 1 -- 172.21.15.154:0/662845261 shutdown_connections 2023-10-10T21:21:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.415+0000 7fb5031ff700 1 --2- 172.21.15.154:0/662845261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc157820 0x7fb4fc0abf60 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.415+0000 7fb5031ff700 1 --2- 172.21.15.154:0/662845261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc0b1c20 0x7fb4fc1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.415+0000 7fb5031ff700 1 -- 172.21.15.154:0/662845261 >> 172.21.15.154:0/662845261 conn(0x7fb4fc06a320 msgr2=0x7fb4fc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.415+0000 7fb5031ff700 1 -- 172.21.15.154:0/662845261 shutdown_connections 2023-10-10T21:21:07.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.415+0000 7fb5031ff700 1 -- 172.21.15.154:0/662845261 wait complete. 2023-10-10T21:21:07.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.416+0000 7fb5031ff700 1 Processor -- start 2023-10-10T21:21:07.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.416+0000 7fb5031ff700 1 -- start start 2023-10-10T21:21:07.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.417+0000 7fb5031ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc0b1850 0x7fb4fc15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.417+0000 7fb5031ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4fc0b1c20 0x7fb4fc159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.417+0000 7fb5031ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc157820 0x7fb4fc0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.417+0000 7fb5031ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc159b50 con 0x7fb4fc0b1850 2023-10-10T21:21:07.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.417+0000 7fb5031ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc15b760 con 0x7fb4fc0b1c20 2023-10-10T21:21:07.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.417+0000 7fb5031ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc15ba40 con 0x7fb4fc157820 2023-10-10T21:21:07.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb500f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc0b1850 0x7fb4fc15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:07.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb500f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc0b1850 0x7fb4fc15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50806/0 (socket says 172.21.15.154:50806) 2023-10-10T21:21:07.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb500f9b700 1 -- 172.21.15.154:0/960575184 learned_addr learned my addr 172.21.15.154:0/960575184 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:07.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb4fbfff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4fc0b1c20 0x7fb4fc159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:07.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb50179c700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc157820 0x7fb4fc0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:07.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb500f9b700 1 -- 172.21.15.154:0/960575184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc157820 msgr2=0x7fb4fc0a5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb500f9b700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc157820 0x7fb4fc0a5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb500f9b700 1 -- 172.21.15.154:0/960575184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4fc0b1c20 msgr2=0x7fb4fc159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb500f9b700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4fc0b1c20 0x7fb4fc159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb500f9b700 1 -- 172.21.15.154:0/960575184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8009420 con 0x7fb4fc0b1850 2023-10-10T21:21:07.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb4fbfff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4fc0b1c20 0x7fb4fc159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:07.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.418+0000 7fb500f9b700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc0b1850 0x7fb4fc15b080 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00011e0 tx=0x7fb4f0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:07.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.419+0000 7fb4f8ff9700 1 -- 172.21.15.154:0/960575184 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0005b30 con 0x7fb4fc0b1850 2023-10-10T21:21:07.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.419+0000 7fb4f8ff9700 1 -- 172.21.15.154:0/960575184 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f0005c90 con 0x7fb4fc0b1850 2023-10-10T21:21:07.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.419+0000 7fb4f8ff9700 1 -- 172.21.15.154:0/960575184 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0007300 con 0x7fb4fc0b1850 2023-10-10T21:21:07.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.419+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f4009a20 con 0x7fb4fc0b1850 2023-10-10T21:21:07.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.419+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc15c000 con 0x7fb4fc0b1850 2023-10-10T21:21:07.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.420+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc04c3c0 con 0x7fb4fc0b1850 2023-10-10T21:21:07.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.421+0000 7fb4f8ff9700 1 -- 172.21.15.154:0/960575184 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fb4f0007670 con 0x7fb4fc0b1850 2023-10-10T21:21:07.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.422+0000 7fb4f8ff9700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb4e0067170 0x7fb4e0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.422+0000 7fb4f8ff9700 1 -- 172.21.15.154:0/960575184 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fb4f0084030 con 0x7fb4fc0b1850 2023-10-10T21:21:07.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.422+0000 7fb4fbfff700 1 -- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb4e0067170 msgr2=0x7fb4e0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:07.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.422+0000 7fb4fbfff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb4e0067170 0x7fb4e0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:07.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.426+0000 7fb4f8ff9700 1 -- 172.21.15.154:0/960575184 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4f0050c80 con 0x7fb4fc0b1850 2023-10-10T21:21:07.435 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:07.433+0000 7fb1ca86a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:21:07.578 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:07.577+0000 7f2cfb680180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:21:07.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.623+0000 7fb4fbfff700 1 -- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb4e0067170 msgr2=0x7fb4e0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:07.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.623+0000 7fb4fbfff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb4e0067170 0x7fb4e0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.672+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4fc0cb5e0 con 0x7fb4fc0b1850 2023-10-10T21:21:07.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.673+0000 7fb4f8ff9700 1 -- 172.21.15.154:0/960575184 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fb4f0017090 con 0x7fb4fc0b1850 2023-10-10T21:21:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:07.674 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/909044943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":909044943},{"type":"v1","addr":"172.21.15.154:6834","nonce":909044943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/4163308288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":4163308288},{"type":"v1","addr":"172.21.15.179:6834","nonce":4163308288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7330,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3673994181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3673994181},{"type":"v1","addr":"172.21.15.179:6835","nonce":3673994181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:20:26.309607+0000","modified":"2023-10-10T21:20:30.131493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7677},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7677":{"gid":7677,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1893020718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1893020718},{"type":"v1","addr":"172.21.15.154:6837","nonce":1893020718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-10T21:21:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb4e0067170 msgr2=0x7fb4e0069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb4e0067170 0x7fb4e0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc0b1850 msgr2=0x7fb4fc15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc0b1850 0x7fb4fc15b080 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00011e0 tx=0x7fb4f0007df0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 shutdown_connections 2023-10-10T21:21:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7fb4e0067170 0x7fb4e0069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4fc157820 0x7fb4fc0a5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc0b1850 0x7fb4fc15b080 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 --2- 172.21.15.154:0/960575184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4fc0b1c20 0x7fb4fc159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 >> 172.21.15.154:0/960575184 conn(0x7fb4fc06a320 msgr2=0x7fb4fc06e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 shutdown_connections 2023-10-10T21:21:07.679 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:07.675+0000 7f2cfb680180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:21:07.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.675+0000 7fb5031ff700 1 -- 172.21.15.154:0/960575184 wait complete. 2023-10-10T21:21:07.680 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 54 2023-10-10T21:21:07.694 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:21:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.888+0000 7f393a59d700 1 Processor -- start 2023-10-10T21:21:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.888+0000 7f393a59d700 1 -- start start 2023-10-10T21:21:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.889+0000 7f393a59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39340ae710 0x7f39340c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.889+0000 7f393a59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39340ca860 con 0x7f3934156310 2023-10-10T21:21:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.889+0000 7f393a59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39340cab40 con 0x7f39341566e0 2023-10-10T21:21:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.889+0000 7f393a59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39340cae20 con 0x7f39340ae710 2023-10-10T21:21:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f393959b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3934156310 0x7f39340c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58496/0 (socket says 172.21.15.154:58496) 2023-10-10T21:21:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f393959b700 1 -- 172.21.15.154:0/2345445781 learned_addr learned my addr 172.21.15.154:0/2345445781 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f3939d9c700 1 --2- 172.21.15.154:0/2345445781 >> v2:172.21.15.154:3300/0 conn(0x7f39340ae710 0x7f39340c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:07.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f392bfff700 1 -- 172.21.15.154:0/2345445781 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147436844 0 0) 0x7f39340ca860 con 0x7f3934156310 2023-10-10T21:21:07.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f392bfff700 1 -- 172.21.15.154:0/2345445781 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3920003570 con 0x7f3934156310 2023-10-10T21:21:07.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f392bfff700 1 -- 172.21.15.154:0/2345445781 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561287528 0 0) 0x7f39340cab40 con 0x7f39341566e0 2023-10-10T21:21:07.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f392bfff700 1 -- 172.21.15.154:0/2345445781 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39340ca860 con 0x7f39341566e0 2023-10-10T21:21:07.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f3939d9c700 1 -- 172.21.15.154:0/2345445781 >> v1:172.21.15.179:6789/0 conn(0x7f39341566e0 legacy=0x7f39340ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f3939d9c700 1 -- 172.21.15.154:0/2345445781 >> v1:172.21.15.154:6789/0 conn(0x7f3934156310 legacy=0x7f39340c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.890+0000 7f3939d9c700 1 -- 172.21.15.154:0/2345445781 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340cb100 con 0x7f39340ae710 2023-10-10T21:21:07.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.891+0000 7f3939d9c700 1 --2- 172.21.15.154:0/2345445781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39340ae710 0x7f39340c6830 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f392c009e60 tx=0x7f392c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e829e9ea8f89ed server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:07.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.891+0000 7f392bfff700 1 -- 172.21.15.154:0/2345445781 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c00e070 con 0x7f39340ae710 2023-10-10T21:21:07.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.891+0000 7f392bfff700 1 -- 172.21.15.154:0/2345445781 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c00bab0 con 0x7f39340ae710 2023-10-10T21:21:07.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.891+0000 7f392bfff700 1 -- 172.21.15.154:0/2345445781 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c00be70 con 0x7f39340ae710 2023-10-10T21:21:07.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.891+0000 7f393a59d700 1 -- 172.21.15.154:0/2345445781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39340ae710 msgr2=0x7f39340c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.891+0000 7f393a59d700 1 --2- 172.21.15.154:0/2345445781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39340ae710 0x7f39340c6830 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f392c009e60 tx=0x7f392c009780 comp rx=0 tx=0).stop 2023-10-10T21:21:07.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.892+0000 7f393a59d700 1 -- 172.21.15.154:0/2345445781 shutdown_connections 2023-10-10T21:21:07.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.892+0000 7f393a59d700 1 --2- 172.21.15.154:0/2345445781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39340ae710 0x7f39340c6830 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.892+0000 7f393a59d700 1 -- 172.21.15.154:0/2345445781 >> 172.21.15.154:0/2345445781 conn(0x7f39340cc1f0 msgr2=0x7f39340cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:07.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.892+0000 7f393a59d700 1 -- 172.21.15.154:0/2345445781 shutdown_connections 2023-10-10T21:21:07.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.892+0000 7f393a59d700 1 -- 172.21.15.154:0/2345445781 wait complete. 2023-10-10T21:21:07.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.893+0000 7f393a59d700 1 Processor -- start 2023-10-10T21:21:07.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.893+0000 7f393a59d700 1 -- start start 2023-10-10T21:21:07.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f393a59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39340ae710 0x7f393413ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f393a59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3934156310 0x7f3934150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f393a59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39341566e0 0x7f39341512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f393a59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393414fa30 con 0x7f39341566e0 2023-10-10T21:21:07.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f393a59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393413f200 con 0x7f3934156310 2023-10-10T21:21:07.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f393a59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393415c480 con 0x7f39340ae710 2023-10-10T21:21:07.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f3939d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39341566e0 0x7f39341512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:07.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f3939d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39341566e0 0x7f39341512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50812/0 (socket says 172.21.15.154:50812) 2023-10-10T21:21:07.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f3939d9c700 1 -- 172.21.15.154:0/1523438879 learned_addr learned my addr 172.21.15.154:0/1523438879 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:07.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.894+0000 7f393959b700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39340ae710 0x7f393413ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:07.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.895+0000 7f3938d9a700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3934156310 0x7f3934150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:07.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.895+0000 7f3939d9c700 1 -- 172.21.15.154:0/1523438879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39340ae710 msgr2=0x7f393413ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.895+0000 7f3939d9c700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39340ae710 0x7f393413ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.895+0000 7f3939d9c700 1 -- 172.21.15.154:0/1523438879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3934156310 msgr2=0x7f3934150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:07.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.895+0000 7f3939d9c700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3934156310 0x7f3934150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:07.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.895+0000 7f3939d9c700 1 -- 172.21.15.154:0/1523438879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c009a20 con 0x7f39341566e0 2023-10-10T21:21:07.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.895+0000 7f3939d9c700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39341566e0 0x7f39341512d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f392c009460 tx=0x7f392c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:07.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.895+0000 7f39297fa700 1 -- 172.21.15.154:0/1523438879 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c012dd0 con 0x7f39341566e0 2023-10-10T21:21:07.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.896+0000 7f39297fa700 1 -- 172.21.15.154:0/1523438879 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c026480 con 0x7f39341566e0 2023-10-10T21:21:07.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.896+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393415ce20 con 0x7f39341566e0 2023-10-10T21:21:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.896+0000 7f39297fa700 1 -- 172.21.15.154:0/1523438879 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c026840 con 0x7f39341566e0 2023-10-10T21:21:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.896+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393415c1a0 con 0x7f39341566e0 2023-10-10T21:21:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.897+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393415cfb0 con 0x7f39341566e0 2023-10-10T21:21:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.898+0000 7f39297fa700 1 -- 172.21.15.154:0/1523438879 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f392c01c400 con 0x7f39341566e0 2023-10-10T21:21:07.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.899+0000 7f39297fa700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f3918067170 0x7f3918069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:07.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.899+0000 7f39297fa700 1 -- 172.21.15.154:0/1523438879 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f392c086cd0 con 0x7f39341566e0 2023-10-10T21:21:07.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.899+0000 7f393959b700 1 -- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f3918067170 msgr2=0x7f3918069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:07.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.899+0000 7f393959b700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f3918067170 0x7f3918069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:07.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:07.903+0000 7f39297fa700 1 -- 172.21.15.154:0/1523438879 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f392c053840 con 0x7f39341566e0 2023-10-10T21:21:08.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.100+0000 7f393959b700 1 -- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f3918067170 msgr2=0x7f3918069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:08.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.100+0000 7f393959b700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f3918067170 0x7f3918069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:08.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.100+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f393404c3c0 con 0x7f39341566e0 2023-10-10T21:21:08.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.101+0000 7f39297fa700 1 -- 172.21.15.154:0/1523438879 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16491 (secure 0 0 0) 0x7f392c056e60 con 0x7f39341566e0 2023-10-10T21:21:08.103 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:08.103 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":126,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:21:06.155223+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:20:24.012206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-10T21:20:25.295138+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":126,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/85496":"2023-10-11T21:20:42.341220+0000","172.21.15.154:6835/85496":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/2400849625":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/889786049":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/2836122027":"2023-10-11T21:20:42.341220+0000","172.21.15.154:0/3165266294":"2023-10-11T21:20:42.341220+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:21:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.103+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f3918067170 msgr2=0x7f3918069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.103+0000 7f393a59d700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f3918067170 0x7f3918069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.103+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39341566e0 msgr2=0x7f39341512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.103+0000 7f393a59d700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39341566e0 0x7f39341512d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f392c009460 tx=0x7f392c019000 comp rx=0 tx=0).stop 2023-10-10T21:21:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.103+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 shutdown_connections 2023-10-10T21:21:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.103+0000 7f393a59d700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39341566e0 0x7f39341512d0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.103+0000 7f393a59d700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f3918067170 0x7f3918069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.104+0000 7f393a59d700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39340ae710 0x7f393413ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.104+0000 7f393a59d700 1 --2- 172.21.15.154:0/1523438879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3934156310 0x7f3934150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.104+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 >> 172.21.15.154:0/1523438879 conn(0x7f39340cc1f0 msgr2=0x7f3934069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:08.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.104+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 shutdown_connections 2023-10-10T21:21:08.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.104+0000 7f393a59d700 1 -- 172.21.15.154:0/1523438879 wait complete. 2023-10-10T21:21:08.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T21:21:08.141 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:08.140+0000 7fb1ca86a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:21:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.311+0000 7f2be0b9d700 1 Processor -- start 2023-10-10T21:21:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.311+0000 7f2be0b9d700 1 -- start start 2023-10-10T21:21:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.312+0000 7f2be0b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2bdc159420 0x7f2bdc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.312+0000 7f2be0b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc15d230 0x7f2bdc15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.312+0000 7f2be0b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc0b2980 con 0x7f2bdc1597f0 2023-10-10T21:21:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.312+0000 7f2be0b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc15dbb0 con 0x7f2bdc159420 2023-10-10T21:21:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.312+0000 7f2be0b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0b11d0 con 0x7f2bdc15d230 2023-10-10T21:21:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bdaffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2bdc1597f0 0x7f2bdc0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58500/0 (socket says 172.21.15.154:58500) 2023-10-10T21:21:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bdaffd700 1 -- 172.21.15.154:0/1513420946 learned_addr learned my addr 172.21.15.154:0/1513420946 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bdbfff700 1 --2- 172.21.15.154:0/1513420946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc15d230 0x7f2bdc15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bdb7fe700 1 --2- 172.21.15.154:0/1513420946 >> v2:172.21.15.179:3300/0 conn(0x7f2bdc159420 0x7f2bdc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bda7fc700 1 -- 172.21.15.154:0/1513420946 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675651952 0 0) 0x7f2bdc0b2980 con 0x7f2bdc1597f0 2023-10-10T21:21:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bda7fc700 1 -- 172.21.15.154:0/1513420946 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc4003570 con 0x7f2bdc1597f0 2023-10-10T21:21:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bdb7fe700 1 -- 172.21.15.154:0/1513420946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc15d230 msgr2=0x7f2bdc15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bdb7fe700 1 --2- 172.21.15.154:0/1513420946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc15d230 0x7f2bdc15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bdb7fe700 1 -- 172.21.15.154:0/1513420946 >> v1:172.21.15.154:6789/0 conn(0x7f2bdc1597f0 legacy=0x7f2bdc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.313+0000 7f2bdb7fe700 1 -- 172.21.15.154:0/1513420946 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0b14b0 con 0x7f2bdc159420 2023-10-10T21:21:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.314+0000 7f2bdb7fe700 1 --2- 172.21.15.154:0/1513420946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bdc159420 0x7f2bdc0b5f40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098e0 tx=0x7f2bcc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f9608e347ec547f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.314+0000 7f2bda7fc700 1 -- 172.21.15.154:0/1513420946 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc011630 con 0x7f2bdc159420 2023-10-10T21:21:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.314+0000 7f2bda7fc700 1 -- 172.21.15.154:0/1513420946 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc011790 con 0x7f2bdc159420 2023-10-10T21:21:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.314+0000 7f2bda7fc700 1 -- 172.21.15.154:0/1513420946 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc011b30 con 0x7f2bdc159420 2023-10-10T21:21:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.315+0000 7f2be0b9d700 1 -- 172.21.15.154:0/1513420946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bdc159420 msgr2=0x7f2bdc0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.315+0000 7f2be0b9d700 1 --2- 172.21.15.154:0/1513420946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bdc159420 0x7f2bdc0b5f40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098e0 tx=0x7f2bcc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.315+0000 7f2be0b9d700 1 -- 172.21.15.154:0/1513420946 shutdown_connections 2023-10-10T21:21:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.315+0000 7f2be0b9d700 1 --2- 172.21.15.154:0/1513420946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc15d230 0x7f2bdc15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.315+0000 7f2be0b9d700 1 --2- 172.21.15.154:0/1513420946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bdc159420 0x7f2bdc0b5f40 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.315+0000 7f2be0b9d700 1 -- 172.21.15.154:0/1513420946 >> 172.21.15.154:0/1513420946 conn(0x7f2bdc0d0660 msgr2=0x7f2bdc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.315+0000 7f2be0b9d700 1 -- 172.21.15.154:0/1513420946 shutdown_connections 2023-10-10T21:21:08.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.315+0000 7f2be0b9d700 1 -- 172.21.15.154:0/1513420946 wait complete. 2023-10-10T21:21:08.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.316+0000 7f2be0b9d700 1 Processor -- start 2023-10-10T21:21:08.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.316+0000 7f2be0b9d700 1 -- start start 2023-10-10T21:21:08.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.317+0000 7f2be0b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bdc159420 0x7f2bdc0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.317+0000 7f2be0b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc1597f0 0x7f2bdc156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.317+0000 7f2be0b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bdc15d230 0x7f2bdc0cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.317+0000 7f2be0b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0c7ac0 con 0x7f2bdc159420 2023-10-10T21:21:08.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.317+0000 7f2be0b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0cbb20 con 0x7f2bdc15d230 2023-10-10T21:21:08.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.317+0000 7f2be0b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0cb840 con 0x7f2bdc1597f0 2023-10-10T21:21:08.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bdc159420 0x7f2bdc0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bdc159420 0x7f2bdc0c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50818/0 (socket says 172.21.15.154:50818) 2023-10-10T21:21:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdb7fe700 1 -- 172.21.15.154:0/493501901 learned_addr learned my addr 172.21.15.154:0/493501901 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdbfff700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bdc15d230 0x7f2bdc0cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdaffd700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc1597f0 0x7f2bdc156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdb7fe700 1 -- 172.21.15.154:0/493501901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc1597f0 msgr2=0x7f2bdc156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdb7fe700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc1597f0 0x7f2bdc156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdb7fe700 1 -- 172.21.15.154:0/493501901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bdc15d230 msgr2=0x7f2bdc0cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:08.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdb7fe700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bdc15d230 0x7f2bdc0cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdb7fe700 1 -- 172.21.15.154:0/493501901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc009420 con 0x7f2bdc159420 2023-10-10T21:21:08.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdaffd700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc1597f0 0x7f2bdc156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:08.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.318+0000 7f2bdb7fe700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bdc159420 0x7f2bdc0c7580 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc089340 tx=0x7f2bcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:08.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.319+0000 7f2bc37fe700 1 -- 172.21.15.154:0/493501901 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc011b10 con 0x7f2bdc159420 2023-10-10T21:21:08.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.319+0000 7f2bc37fe700 1 -- 172.21.15.154:0/493501901 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc0253f0 con 0x7f2bdc159420 2023-10-10T21:21:08.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.319+0000 7f2bc37fe700 1 -- 172.21.15.154:0/493501901 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0257b0 con 0x7f2bdc159420 2023-10-10T21:21:08.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.319+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc0c5990 con 0x7f2bdc159420 2023-10-10T21:21:08.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.319+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc0c5f50 con 0x7f2bdc159420 2023-10-10T21:21:08.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.320+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc0c6140 con 0x7f2bdc159420 2023-10-10T21:21:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.321+0000 7f2bc37fe700 1 -- 172.21.15.154:0/493501901 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2bcc025ba0 con 0x7f2bdc159420 2023-10-10T21:21:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.322+0000 7f2bc37fe700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2bc8067170 0x7f2bc8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.322+0000 7f2bdaffd700 1 -- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2bc8067170 msgr2=0x7f2bc8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.322+0000 7f2bc37fe700 1 -- 172.21.15.154:0/493501901 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f2bcc086390 con 0x7f2bdc159420 2023-10-10T21:21:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.322+0000 7f2bdaffd700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2bc8067170 0x7f2bc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:08.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.327+0000 7f2bc37fe700 1 -- 172.21.15.154:0/493501901 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bcc0530b0 con 0x7f2bdc159420 2023-10-10T21:21:08.417 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:08.416+0000 7f2cfb680180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:21:08.431 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:08.430+0000 7fb1ca86a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:21:08.523 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:08.522+0000 7fb1ca86a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:21:08.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.524+0000 7f2bdaffd700 1 -- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2bc8067170 msgr2=0x7f2bc8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6835/85496 2023-10-10T21:21:08.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.524+0000 7f2bdaffd700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2bc8067170 0x7f2bc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.570+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2bdc04c3c0 con 0x7f2bdc159420 2023-10-10T21:21:08.572 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T21:21:08.571+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T21:21:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.576+0000 7f2bc37fe700 1 -- 172.21.15.154:0/493501901 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2bcc0566d0 con 0x7f2bdc159420 2023-10-10T21:21:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2bc8067170 msgr2=0x7f2bc8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2bc8067170 0x7f2bc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bdc159420 msgr2=0x7f2bdc0c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bdc159420 0x7f2bdc0c7580 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc089340 tx=0x7f2bcc017000 comp rx=0 tx=0).stop 2023-10-10T21:21:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 shutdown_connections 2023-10-10T21:21:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bdc15d230 0x7f2bdc0cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bdc159420 0x7f2bdc0c7580 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f2bc8067170 0x7f2bc8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 --2- 172.21.15.154:0/493501901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bdc1597f0 0x7f2bdc156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 >> 172.21.15.154:0/493501901 conn(0x7f2bdc0d0660 msgr2=0x7f2bdc068a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 shutdown_connections 2023-10-10T21:21:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.579+0000 7f2be0b9d700 1 -- 172.21.15.154:0/493501901 wait complete. 2023-10-10T21:21:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T21:21:08.585 INFO:tasks.ceph.mds.c.smithi154.stderr: -5061> 2023-10-10T21:20:31.808+0000 7fef3adf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:21:08.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T21:21:08.635 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:21:08.681 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:08.679+0000 7fb1ca86a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:21:08.719 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:08.718+0000 7f2cfb680180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:21:08.784 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:08.783+0000 7fb1ca86a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:21:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.794+0000 7f931579d700 1 Processor -- start 2023-10-10T21:21:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.794+0000 7f931579d700 1 -- start start 2023-10-10T21:21:08.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.795+0000 7f931579d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93100b4e70 0x7f93100ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.795+0000 7f931579d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93100b16d0 0x7f93100b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.795+0000 7f931579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f931015d240 0x7f931015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.795+0000 7f931579d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93100b2080 con 0x7f93100b4e70 2023-10-10T21:21:08.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.795+0000 7f931579d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93100cfb00 con 0x7f93100b16d0 2023-10-10T21:21:08.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.795+0000 7f931579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93100b5c40 con 0x7f931015d240 2023-10-10T21:21:08.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93100b4e70 0x7f93100ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93100b4e70 0x7f93100ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50848/0 (socket says 172.21.15.154:50848) 2023-10-10T21:21:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930ffff700 1 -- 172.21.15.154:0/4213611091 learned_addr learned my addr 172.21.15.154:0/4213611091 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930f7fe700 1 --2- 172.21.15.154:0/4213611091 >> v2:172.21.15.179:3300/0 conn(0x7f93100b16d0 0x7f93100b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f9314f9c700 1 --2- 172.21.15.154:0/4213611091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f931015d240 0x7f931015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930ffff700 1 -- 172.21.15.154:0/4213611091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f931015d240 msgr2=0x7f931015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930ffff700 1 --2- 172.21.15.154:0/4213611091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f931015d240 0x7f931015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930ffff700 1 -- 172.21.15.154:0/4213611091 >> v2:172.21.15.179:3300/0 conn(0x7f93100b16d0 msgr2=0x7f93100b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930ffff700 1 --2- 172.21.15.154:0/4213611091 >> v2:172.21.15.179:3300/0 conn(0x7f93100b16d0 0x7f93100b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930ffff700 1 -- 172.21.15.154:0/4213611091 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93100b5f20 con 0x7f93100b4e70 2023-10-10T21:21:08.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.796+0000 7f930ffff700 1 --2- 172.21.15.154:0/4213611091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93100b4e70 0x7f93100ccff0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f9310089830 tx=0x7f9300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53d5900e84a5673 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:08.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.797+0000 7f930effd700 1 -- 172.21.15.154:0/4213611091 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930000b640 con 0x7f93100b4e70 2023-10-10T21:21:08.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.797+0000 7f930effd700 1 -- 172.21.15.154:0/4213611091 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930000b7a0 con 0x7f93100b4e70 2023-10-10T21:21:08.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.797+0000 7f930effd700 1 -- 172.21.15.154:0/4213611091 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930000bb60 con 0x7f93100b4e70 2023-10-10T21:21:08.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.797+0000 7f931579d700 1 -- 172.21.15.154:0/4213611091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93100b4e70 msgr2=0x7f93100ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:08.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.797+0000 7f931579d700 1 --2- 172.21.15.154:0/4213611091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93100b4e70 0x7f93100ccff0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f9310089830 tx=0x7f9300009250 comp rx=0 tx=0).stop 2023-10-10T21:21:08.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.797+0000 7f931579d700 1 -- 172.21.15.154:0/4213611091 shutdown_connections 2023-10-10T21:21:08.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.797+0000 7f931579d700 1 --2- 172.21.15.154:0/4213611091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f931015d240 0x7f931015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.797+0000 7f931579d700 1 --2- 172.21.15.154:0/4213611091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93100b4e70 0x7f93100ccff0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.797+0000 7f931579d700 1 --2- 172.21.15.154:0/4213611091 >> v2:172.21.15.179:3300/0 conn(0x7f93100b16d0 0x7f93100b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.798+0000 7f931579d700 1 -- 172.21.15.154:0/4213611091 >> 172.21.15.154:0/4213611091 conn(0x7f93100d10c0 msgr2=0x7f93100affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:08.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.798+0000 7f931579d700 1 -- 172.21.15.154:0/4213611091 shutdown_connections 2023-10-10T21:21:08.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.798+0000 7f931579d700 1 -- 172.21.15.154:0/4213611091 wait complete. 2023-10-10T21:21:08.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.799+0000 7f931579d700 1 Processor -- start 2023-10-10T21:21:08.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.799+0000 7f931579d700 1 -- start start 2023-10-10T21:21:08.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f931579d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93100b16d0 0x7f93100c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f931579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93100b4e70 0x7f9310145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f931579d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931015d240 0x7f93100c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f931579d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93100c7f20 con 0x7f931015d240 2023-10-10T21:21:08.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f931579d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93100c7b60 con 0x7f93100b16d0 2023-10-10T21:21:08.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f931579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93100c6940 con 0x7f93100b4e70 2023-10-10T21:21:08.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f9314f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931015d240 0x7f93100c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f930f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93100b4e70 0x7f9310145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f9314f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931015d240 0x7f93100c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50856/0 (socket says 172.21.15.154:50856) 2023-10-10T21:21:08.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f9314f9c700 1 -- 172.21.15.154:0/1616635378 learned_addr learned my addr 172.21.15.154:0/1616635378 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:08.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.800+0000 7f930ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93100b16d0 0x7f93100c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:08.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f9314f9c700 1 -- 172.21.15.154:0/1616635378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93100b4e70 msgr2=0x7f9310145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:08.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f9314f9c700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93100b4e70 0x7f9310145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f9314f9c700 1 -- 172.21.15.154:0/1616635378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93100b16d0 msgr2=0x7f93100c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:08.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f9314f9c700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93100b16d0 0x7f93100c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:08.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f9314f9c700 1 -- 172.21.15.154:0/1616635378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93000094f0 con 0x7f931015d240 2023-10-10T21:21:08.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f9314f9c700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931015d240 0x7f93100c7620 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9308009ec0 tx=0x7f930800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:08.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f92f7fff700 1 -- 172.21.15.154:0/1616635378 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930800cb70 con 0x7f931015d240 2023-10-10T21:21:08.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f92f7fff700 1 -- 172.21.15.154:0/1616635378 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930800f040 con 0x7f931015d240 2023-10-10T21:21:08.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f92f7fff700 1 -- 172.21.15.154:0/1616635378 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308014480 con 0x7f931015d240 2023-10-10T21:21:08.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f931579d700 1 -- 172.21.15.154:0/1616635378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93100c6c20 con 0x7f931015d240 2023-10-10T21:21:08.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.801+0000 7f931579d700 1 -- 172.21.15.154:0/1616635378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93100c71e0 con 0x7f931015d240 2023-10-10T21:21:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.802+0000 7f931579d700 1 -- 172.21.15.154:0/1616635378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9310088990 con 0x7f931015d240 2023-10-10T21:21:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.803+0000 7f92f7fff700 1 -- 172.21.15.154:0/1616635378 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f9308014830 con 0x7f931015d240 2023-10-10T21:21:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.804+0000 7f92f7fff700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 0x7f92fc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.804+0000 7f92f7fff700 1 -- 172.21.15.154:0/1616635378 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6469+0+0 (secure 0 0 0) 0x7f9308085510 con 0x7f931015d240 2023-10-10T21:21:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.805+0000 7f930ffff700 -1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 0x7f92fc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:08.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.805+0000 7f930ffff700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 0x7f92fc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:08.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:08.808+0000 7f92f7fff700 1 -- 172.21.15.154:0/1616635378 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93080520e0 con 0x7f931015d240 2023-10-10T21:21:08.818 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:08.817+0000 7f2cfb680180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:21:08.976 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:08.974+0000 7fb1ca86a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:21:08.979 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:08.978+0000 7f2cfb680180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:21:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.006+0000 7f930ffff700 -1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 0x7f92fc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.006+0000 7f930ffff700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 0x7f92fc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:09.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.054+0000 7f931579d700 1 -- 172.21.15.154:0/1616635378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f93100c8060 con 0x7f931015d240 2023-10-10T21:21:09.067 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:09.066+0000 7fb1ca86a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:21:09.088 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:09.087+0000 7f2cfb680180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:21:09.158 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:09.156+0000 7fb1ca86a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:21:09.253 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:09.251+0000 7fb1ca86a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:21:09.256 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:09.254+0000 7fb1c09fc700 -1 --2- 172.21.15.179:0/87727 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x5579a35cc000 0x5579a35d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.278 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:09.277+0000 7f2cfb680180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:21:09.370 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:09.369+0000 7f2cfb680180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:21:09.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.407+0000 7f930ffff700 -1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 0x7f92fc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.407+0000 7f930ffff700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 0x7f92fc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:21:09.426 INFO:tasks.ceph.mon.c.smithi179.stderr:2023-10-10T21:21:09.425+0000 7faccebed700 -1 --2- 172.21.15.179:0/87726 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x5628f6188400 0x5628f615d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.426 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-10T21:21:09.425+0000 7fe64f1fc700 -1 --2- [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x55a8a485b400 0x55a8aa648680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.427 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-10T21:21:09.425+0000 7fd17cbfd700 -1 --2- [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x55ce1fd4c800 0x55ce24e2ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.427 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-10T21:21:09.425+0000 7fd2a29fd700 -1 --2- [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x55c66429bc00 0x55c660432b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.428 INFO:tasks.ceph.mon.b.smithi179.stderr:2023-10-10T21:21:09.425+0000 7fe8371ed700 -1 --2- 172.21.15.179:0/87725 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x564d09407c00 0x564d09d04c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.428 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-10T21:21:09.425+0000 7f74451fb700 -1 --2- [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x564b9840b000 0x564b8b278680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.429 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-10-10T21:21:09.425+0000 7f596b5fc700 -1 --2- [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x55d0948c5000 0x55d09a92fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.429 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-10-10T21:21:09.425+0000 7fe6085fd700 -1 --2- [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x562fa759fc00 0x562fa327a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.430 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-10-10T21:21:09.425+0000 7effd15fd700 -1 --2- [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x55cfd4aebc00 0x55cfc5792680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.430 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-10-10T21:21:09.425+0000 7f4b0f1fd700 -1 --2- [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x55964338c800 0x559637a14c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.430 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T21:21:09.425+0000 7f7121fee700 -1 --2- 172.21.15.154:0/85495 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x55c17ea31000 0x55c17f6f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.431 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-10-10T21:21:09.428+0000 7f2053bfc700 -1 --2- [v2:172.21.15.154:6832/909044943,v1:172.21.15.154:6834/909044943] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x558f2826d800 0x558f2762f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.431 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-10-10T21:21:09.428+0000 7f13195fc700 -1 --2- [v2:172.21.15.179:6832/4163308288,v1:172.21.15.179:6834/4163308288] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x565109b7d800 0x565108f43080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.432 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-10-10T21:21:09.428+0000 7f39b73fc700 -1 --2- [v2:172.21.15.179:6833/3673994181,v1:172.21.15.179:6835/3673994181] >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x559c0f845800 0x559c0ec0b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.457 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:09.455+0000 7fb1c09fc700 -1 --2- 172.21.15.179:0/87727 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x5579a35cc000 0x5579a35d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.465 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:09.464+0000 7f2cfb680180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:21:09.558 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:09.557+0000 7f2cfb680180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:21:09.560 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:09.559+0000 7f2cf0ffb700 -1 --2- 172.21.15.154:0/85496 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x55f9df1ae000 0x55f9df1b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] is using msgr V1 protocol 2023-10-10T21:21:09.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.569+0000 7f92f7fff700 1 -- 172.21.15.154:0/1616635378 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 60) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f93080524b0 con 0x7f931015d240 2023-10-10T21:21:09.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.569+0000 7f92f7fff700 1 -- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 msgr2=0x7f92fc069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:09.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.569+0000 7f92f7fff700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 0x7f92fc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.576+0000 7f92f7fff700 1 -- 172.21.15.154:0/1616635378 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9308070990 con 0x7f931015d240 2023-10-10T21:21:09.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.578+0000 7f931579d700 1 -- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931015d240 msgr2=0x7f93100c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:09.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.578+0000 7f931579d700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931015d240 0x7f93100c7620 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9308009ec0 tx=0x7f930800b040 comp rx=0 tx=0).stop 2023-10-10T21:21:09.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.579+0000 7f931579d700 1 -- 172.21.15.154:0/1616635378 shutdown_connections 2023-10-10T21:21:09.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.579+0000 7f931579d700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931015d240 0x7f93100c7620 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.579+0000 7f931579d700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93100b16d0 0x7f93100c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.579+0000 7f931579d700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.154:6835/85496,v1:172.21.15.154:6836/85496] conn(0x7f92fc067170 0x7f92fc069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.579+0000 7f931579d700 1 --2- 172.21.15.154:0/1616635378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93100b4e70 0x7f9310145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.579+0000 7f931579d700 1 -- 172.21.15.154:0/1616635378 >> 172.21.15.154:0/1616635378 conn(0x7f93100d10c0 msgr2=0x7f9310068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:09.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.579+0000 7f931579d700 1 -- 172.21.15.154:0/1616635378 shutdown_connections 2023-10-10T21:21:09.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.579+0000 7f931579d700 1 -- 172.21.15.154:0/1616635378 wait complete. 2023-10-10T21:21:09.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T21:21:09.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.830+0000 7f2a5999d700 1 Processor -- start 2023-10-10T21:21:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.830+0000 7f2a5999d700 1 -- start start 2023-10-10T21:21:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.831+0000 7f2a5999d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a540b03c0 0x7f2a540cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.831+0000 7f2a5999d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a540b0790 0x7f2a540b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:09.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.831+0000 7f2a5999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a541591e0 0x7f2a54159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:09.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.831+0000 7f2a5999d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540cfa00 con 0x7f2a540b0790 2023-10-10T21:21:09.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.831+0000 7f2a5999d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540cb580 con 0x7f2a540b03c0 2023-10-10T21:21:09.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.831+0000 7f2a5999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540b2de0 con 0x7f2a541591e0 2023-10-10T21:21:09.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a53fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a540b0790 0x7f2a540b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a53fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a540b0790 0x7f2a540b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50950/0 (socket says 172.21.15.154:50950) 2023-10-10T21:21:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a53fff700 1 -- 172.21.15.154:0/672797547 learned_addr learned my addr 172.21.15.154:0/672797547 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a5899b700 1 --2- 172.21.15.154:0/672797547 >> v2:172.21.15.179:3300/0 conn(0x7f2a540b03c0 0x7f2a540cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a5919c700 1 --2- 172.21.15.154:0/672797547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a541591e0 0x7f2a54159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a53fff700 1 -- 172.21.15.154:0/672797547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a541591e0 msgr2=0x7f2a54159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:09.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a53fff700 1 --2- 172.21.15.154:0/672797547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a541591e0 0x7f2a54159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a53fff700 1 -- 172.21.15.154:0/672797547 >> v2:172.21.15.179:3300/0 conn(0x7f2a540b03c0 msgr2=0x7f2a540cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:09.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a53fff700 1 --2- 172.21.15.154:0/672797547 >> v2:172.21.15.179:3300/0 conn(0x7f2a540b03c0 0x7f2a540cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a53fff700 1 -- 172.21.15.154:0/672797547 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540cf160 con 0x7f2a540b0790 2023-10-10T21:21:09.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a53fff700 1 --2- 172.21.15.154:0/672797547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a540b0790 0x7f2a540b28a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2a400099b0 tx=0x7f2a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5d3f749e6fb538 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.832+0000 7f2a537fe700 1 -- 172.21.15.154:0/672797547 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000b820 con 0x7f2a540b0790 2023-10-10T21:21:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a537fe700 1 -- 172.21.15.154:0/672797547 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4000b980 con 0x7f2a540b0790 2023-10-10T21:21:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a537fe700 1 -- 172.21.15.154:0/672797547 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000bd20 con 0x7f2a540b0790 2023-10-10T21:21:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a5999d700 1 -- 172.21.15.154:0/672797547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a540b0790 msgr2=0x7f2a540b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:09.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a5999d700 1 --2- 172.21.15.154:0/672797547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a540b0790 0x7f2a540b28a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2a400099b0 tx=0x7f2a40009250 comp rx=0 tx=0).stop 2023-10-10T21:21:09.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a5999d700 1 -- 172.21.15.154:0/672797547 shutdown_connections 2023-10-10T21:21:09.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a5999d700 1 --2- 172.21.15.154:0/672797547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a541591e0 0x7f2a54159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a5999d700 1 --2- 172.21.15.154:0/672797547 >> v2:172.21.15.179:3300/0 conn(0x7f2a540b03c0 0x7f2a540cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a5999d700 1 --2- 172.21.15.154:0/672797547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a540b0790 0x7f2a540b28a0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a5999d700 1 -- 172.21.15.154:0/672797547 >> 172.21.15.154:0/672797547 conn(0x7f2a54063230 msgr2=0x7f2a54063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:09.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a5999d700 1 -- 172.21.15.154:0/672797547 shutdown_connections 2023-10-10T21:21:09.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.833+0000 7f2a5999d700 1 -- 172.21.15.154:0/672797547 wait complete. 2023-10-10T21:21:09.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.835+0000 7f2a5999d700 1 Processor -- start 2023-10-10T21:21:09.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.835+0000 7f2a5999d700 1 -- start start 2023-10-10T21:21:09.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a540b03c0 0x7f2a540c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:09.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5999d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a540b0790 0x7f2a54157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:09.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5999d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a541591e0 0x7f2a5416ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:09.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5999d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c3e20 con 0x7f2a541591e0 2023-10-10T21:21:09.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5999d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c4070 con 0x7f2a540b0790 2023-10-10T21:21:09.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c4350 con 0x7f2a540b03c0 2023-10-10T21:21:09.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a541591e0 0x7f2a5416ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:09.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a541591e0 0x7f2a5416ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50960/0 (socket says 172.21.15.154:50960) 2023-10-10T21:21:09.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5919c700 1 -- 172.21.15.154:0/990774907 learned_addr learned my addr 172.21.15.154:0/990774907 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:09.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a53fff700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a540b0790 0x7f2a54157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:09.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5899b700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a540b03c0 0x7f2a540c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:09.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5919c700 1 -- 172.21.15.154:0/990774907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a540b03c0 msgr2=0x7f2a540c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:09.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5919c700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a540b03c0 0x7f2a540c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5919c700 1 -- 172.21.15.154:0/990774907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a540b0790 msgr2=0x7f2a54157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:09.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5919c700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a540b0790 0x7f2a54157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:09.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5919c700 1 -- 172.21.15.154:0/990774907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400094f0 con 0x7f2a541591e0 2023-10-10T21:21:09.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.836+0000 7f2a5899b700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a540b03c0 0x7f2a540c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:09.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.837+0000 7f2a5919c700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a541591e0 0x7f2a5416ac80 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c007f20 tx=0x7f2a4c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:09.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.837+0000 7f2a50ff9700 1 -- 172.21.15.154:0/990774907 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00eca0 con 0x7f2a541591e0 2023-10-10T21:21:09.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.837+0000 7f2a50ff9700 1 -- 172.21.15.154:0/990774907 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00ee20 con 0x7f2a541591e0 2023-10-10T21:21:09.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.837+0000 7f2a5999d700 1 -- 172.21.15.154:0/990774907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a540c4630 con 0x7f2a541591e0 2023-10-10T21:21:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.837+0000 7f2a50ff9700 1 -- 172.21.15.154:0/990774907 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c014670 con 0x7f2a541591e0 2023-10-10T21:21:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.837+0000 7f2a5999d700 1 -- 172.21.15.154:0/990774907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a540c9ae0 con 0x7f2a541591e0 2023-10-10T21:21:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.838+0000 7f2a5999d700 1 -- 172.21.15.154:0/990774907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5404c3c0 con 0x7f2a541591e0 2023-10-10T21:21:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.839+0000 7f2a50ff9700 1 -- 172.21.15.154:0/990774907 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 60) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f2a4c0149e0 con 0x7f2a541591e0 2023-10-10T21:21:09.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.839+0000 7f2a50ff9700 1 -- 172.21.15.154:0/990774907 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a4c084bb0 con 0x7f2a541591e0 2023-10-10T21:21:09.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:09.844+0000 7f2a50ff9700 1 -- 172.21.15.154:0/990774907 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a4c08b080 con 0x7f2a541591e0 2023-10-10T21:21:10.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.033+0000 7f2a5999d700 1 -- 172.21.15.154:0/990774907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2a540cf710 con 0x7f2a541591e0 2023-10-10T21:21:10.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.578+0000 7f2a50ff9700 1 -- 172.21.15.154:0/990774907 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2a4c051d90 con 0x7f2a541591e0 2023-10-10T21:21:10.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.582+0000 7f2a5999d700 1 -- 172.21.15.154:0/990774907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a541591e0 msgr2=0x7f2a5416ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:10.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.582+0000 7f2a5999d700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a541591e0 0x7f2a5416ac80 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c007f20 tx=0x7f2a4c009860 comp rx=0 tx=0).stop 2023-10-10T21:21:10.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.582+0000 7f2a5999d700 1 -- 172.21.15.154:0/990774907 shutdown_connections 2023-10-10T21:21:10.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.582+0000 7f2a5999d700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a541591e0 0x7f2a5416ac80 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:10.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.582+0000 7f2a5999d700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a540b03c0 0x7f2a540c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:10.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.582+0000 7f2a5999d700 1 --2- 172.21.15.154:0/990774907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a540b0790 0x7f2a54157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:10.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.582+0000 7f2a5999d700 1 -- 172.21.15.154:0/990774907 >> 172.21.15.154:0/990774907 conn(0x7f2a54063230 msgr2=0x7f2a54068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:10.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.582+0000 7f2a5999d700 1 -- 172.21.15.154:0/990774907 shutdown_connections 2023-10-10T21:21:10.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.582+0000 7f2a5999d700 1 -- 172.21.15.154:0/990774907 wait complete. 2023-10-10T21:21:10.586 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T21:21:10.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T21:21:10.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.800+0000 7fbf49fff700 1 Processor -- start 2023-10-10T21:21:10.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.800+0000 7fbf49fff700 1 -- start start 2023-10-10T21:21:10.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.801+0000 7fbf49fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf44157740 0x7fbf440adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:10.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.801+0000 7fbf49fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbf44068aa0 0x7fbf4406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:10.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.801+0000 7fbf49fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4406dc20 con 0x7fbf440b2100 2023-10-10T21:21:10.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.801+0000 7fbf49fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440acc00 con 0x7fbf44068aa0 2023-10-10T21:21:10.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.801+0000 7fbf49fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4406d6a0 con 0x7fbf44157740 2023-10-10T21:21:10.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.801+0000 7fbf437fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf44157740 0x7fbf440adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:10.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.801+0000 7fbf42ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbf440b2100 0x7fbf44068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:47946/0 (socket says 172.21.15.154:47946) 2023-10-10T21:21:10.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.801+0000 7fbf42ffd700 1 -- 172.21.15.154:0/1683682721 learned_addr learned my addr 172.21.15.154:0/1683682721 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:10.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.801+0000 7fbf43fff700 1 --2- 172.21.15.154:0/1683682721 >> v2:172.21.15.179:3300/0 conn(0x7fbf44068aa0 0x7fbf4406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:10.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.802+0000 7fbf427fc700 1 -- 172.21.15.154:0/1683682721 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906532234 0 0) 0x7fbf4406dc20 con 0x7fbf440b2100 2023-10-10T21:21:10.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.802+0000 7fbf427fc700 1 -- 172.21.15.154:0/1683682721 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf2c003570 con 0x7fbf440b2100 2023-10-10T21:21:10.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.802+0000 7fbf437fe700 1 -- 172.21.15.154:0/1683682721 >> v2:172.21.15.179:3300/0 conn(0x7fbf44068aa0 msgr2=0x7fbf4406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:10.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.802+0000 7fbf437fe700 1 --2- 172.21.15.154:0/1683682721 >> v2:172.21.15.179:3300/0 conn(0x7fbf44068aa0 0x7fbf4406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:10.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.802+0000 7fbf437fe700 1 -- 172.21.15.154:0/1683682721 >> v1:172.21.15.179:6789/0 conn(0x7fbf440b2100 legacy=0x7fbf44068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:10.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.802+0000 7fbf437fe700 1 -- 172.21.15.154:0/1683682721 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440ae910 con 0x7fbf44157740 2023-10-10T21:21:10.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.802+0000 7fbf43fff700 1 --2- 172.21.15.154:0/1683682721 >> v2:172.21.15.179:3300/0 conn(0x7fbf44068aa0 0x7fbf4406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:10.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.802+0000 7fbf437fe700 1 --2- 172.21.15.154:0/1683682721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf44157740 0x7fbf440adfc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbf340098e0 tx=0x7fbf340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b9ea8752c3ed5e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:10.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf427fc700 1 -- 172.21.15.154:0/1683682721 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34011630 con 0x7fbf44157740 2023-10-10T21:21:10.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf427fc700 1 -- 172.21.15.154:0/1683682721 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34011790 con 0x7fbf44157740 2023-10-10T21:21:10.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf427fc700 1 -- 172.21.15.154:0/1683682721 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34011b30 con 0x7fbf44157740 2023-10-10T21:21:10.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf49fff700 1 -- 172.21.15.154:0/1683682721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf44157740 msgr2=0x7fbf440adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:10.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf49fff700 1 --2- 172.21.15.154:0/1683682721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf44157740 0x7fbf440adfc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbf340098e0 tx=0x7fbf340091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:10.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf49fff700 1 -- 172.21.15.154:0/1683682721 shutdown_connections 2023-10-10T21:21:10.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf49fff700 1 --2- 172.21.15.154:0/1683682721 >> v2:172.21.15.179:3300/0 conn(0x7fbf44068aa0 0x7fbf4406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:10.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf49fff700 1 --2- 172.21.15.154:0/1683682721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf44157740 0x7fbf440adfc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:10.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf49fff700 1 -- 172.21.15.154:0/1683682721 >> 172.21.15.154:0/1683682721 conn(0x7fbf440c8f90 msgr2=0x7fbf440c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:10.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf49fff700 1 -- 172.21.15.154:0/1683682721 shutdown_connections 2023-10-10T21:21:10.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.803+0000 7fbf49fff700 1 -- 172.21.15.154:0/1683682721 wait complete. 2023-10-10T21:21:10.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.805+0000 7fbf49fff700 1 Processor -- start 2023-10-10T21:21:10.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.805+0000 7fbf49fff700 1 -- start start 2023-10-10T21:21:10.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf49fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf44068aa0 0x7fbf440c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:10.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf49fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b2100 0x7fbf441594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:10.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf49fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf44157740 0x7fbf44155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:10.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf49fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440b0250 con 0x7fbf44068aa0 2023-10-10T21:21:10.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf49fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440c3c30 con 0x7fbf44157740 2023-10-10T21:21:10.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf49fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440af640 con 0x7fbf440b2100 2023-10-10T21:21:10.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf44068aa0 0x7fbf440c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:10.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf44068aa0 0x7fbf440c21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50970/0 (socket says 172.21.15.154:50970) 2023-10-10T21:21:10.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf437fe700 1 -- 172.21.15.154:0/209140483 learned_addr learned my addr 172.21.15.154:0/209140483 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:10.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf42ffd700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b2100 0x7fbf441594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:10.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf43fff700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf44157740 0x7fbf44155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:10.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf437fe700 1 -- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b2100 msgr2=0x7fbf441594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:10.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf437fe700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b2100 0x7fbf441594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:10.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf437fe700 1 -- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf44157740 msgr2=0x7fbf44155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:10.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf437fe700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf44157740 0x7fbf44155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:10.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf437fe700 1 -- 172.21.15.154:0/209140483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c009a20 con 0x7fbf44068aa0 2023-10-10T21:21:10.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf42ffd700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b2100 0x7fbf441594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:10.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.806+0000 7fbf43fff700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf44157740 0x7fbf44155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:10.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.807+0000 7fbf437fe700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf44068aa0 0x7fbf440c21a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fbf4406d7e0 tx=0x7fbf34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:10.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.807+0000 7fbf2b7fe700 1 -- 172.21.15.154:0/209140483 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34011900 con 0x7fbf44068aa0 2023-10-10T21:21:10.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.807+0000 7fbf2b7fe700 1 -- 172.21.15.154:0/209140483 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34011a80 con 0x7fbf44068aa0 2023-10-10T21:21:10.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.807+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf34009420 con 0x7fbf44068aa0 2023-10-10T21:21:10.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.807+0000 7fbf2b7fe700 1 -- 172.21.15.154:0/209140483 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34025670 con 0x7fbf44068aa0 2023-10-10T21:21:10.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.807+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf440afc00 con 0x7fbf44068aa0 2023-10-10T21:21:10.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.808+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf440718b0 con 0x7fbf44068aa0 2023-10-10T21:21:10.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.809+0000 7fbf2b7fe700 1 -- 172.21.15.154:0/209140483 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 61) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fbf34023070 con 0x7fbf44068aa0 2023-10-10T21:21:10.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.810+0000 7fbf2b7fe700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf30066d80 0x7fbf30069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:10.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.810+0000 7fbf2b7fe700 1 -- 172.21.15.154:0/209140483 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fbf340858e0 con 0x7fbf44068aa0 2023-10-10T21:21:10.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.810+0000 7fbf42ffd700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf30066d80 0x7fbf30069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:10.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.810+0000 7fbf42ffd700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf30066d80 0x7fbf30069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf38007fd0 tx=0x7fbf38009040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:10.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:10.814+0000 7fbf2b7fe700 1 -- 172.21.15.154:0/209140483 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf34052b60 con 0x7fbf44068aa0 2023-10-10T21:21:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.014+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf440aebf0 con 0x7fbf44068aa0 2023-10-10T21:21:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.598+0000 7fbf2b7fe700 1 -- 172.21.15.154:0/209140483 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf34052f30 con 0x7fbf44068aa0 2023-10-10T21:21:11.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.598+0000 7fbf2b7fe700 1 -- 172.21.15.154:0/209140483 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v130) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbf3407bba0 con 0x7fbf44068aa0 2023-10-10T21:21:11.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.602+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf30066d80 msgr2=0x7fbf30069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:11.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.602+0000 7fbf49fff700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf30066d80 0x7fbf30069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf38007fd0 tx=0x7fbf38009040 comp rx=0 tx=0).stop 2023-10-10T21:21:11.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.602+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf44068aa0 msgr2=0x7fbf440c21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:11.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.602+0000 7fbf49fff700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf44068aa0 0x7fbf440c21a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fbf4406d7e0 tx=0x7fbf34017000 comp rx=0 tx=0).stop 2023-10-10T21:21:11.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.603+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 shutdown_connections 2023-10-10T21:21:11.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.603+0000 7fbf49fff700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf44157740 0x7fbf44155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:11.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.603+0000 7fbf49fff700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf30066d80 0x7fbf30069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:11.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.603+0000 7fbf49fff700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf44068aa0 0x7fbf440c21a0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:11.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.603+0000 7fbf49fff700 1 --2- 172.21.15.154:0/209140483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b2100 0x7fbf441594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:11.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.603+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 >> 172.21.15.154:0/209140483 conn(0x7fbf440c8f90 msgr2=0x7fbf44156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:11.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.603+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 shutdown_connections 2023-10-10T21:21:11.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.603+0000 7fbf49fff700 1 -- 172.21.15.154:0/209140483 wait complete. 2023-10-10T21:21:11.607 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T21:21:11.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T21:21:11.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.806+0000 7f77335ff700 1 Processor -- start 2023-10-10T21:21:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.806+0000 7f77335ff700 1 -- start start 2023-10-10T21:21:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.807+0000 7f77335ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c155eb0 0x7f772c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.807+0000 7f77335ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c06eb90 con 0x7f772c069e80 2023-10-10T21:21:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.807+0000 7f77335ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c06ee70 con 0x7f772c0c70b0 2023-10-10T21:21:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.807+0000 7f77335ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c06f150 con 0x7f772c155eb0 2023-10-10T21:21:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f7731b9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f772c069e80 0x7f772c0ca4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58510/0 (socket says 172.21.15.154:58510) 2023-10-10T21:21:11.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f7731b9c700 1 -- 172.21.15.154:0/1732551879 learned_addr learned my addr 172.21.15.154:0/1732551879 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f773139b700 1 --2- 172.21.15.154:0/1732551879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c155eb0 0x7f772c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f7723fff700 1 -- 172.21.15.154:0/1732551879 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855092992 0 0) 0x7f772c06eb90 con 0x7f772c069e80 2023-10-10T21:21:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f7723fff700 1 -- 172.21.15.154:0/1732551879 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7718003570 con 0x7f772c069e80 2023-10-10T21:21:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f7723fff700 1 -- 172.21.15.154:0/1732551879 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667196963 0 0) 0x7f772c06ee70 con 0x7f772c0c70b0 2023-10-10T21:21:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f7723fff700 1 -- 172.21.15.154:0/1732551879 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f772c06eb90 con 0x7f772c0c70b0 2023-10-10T21:21:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f773139b700 1 -- 172.21.15.154:0/1732551879 >> v1:172.21.15.179:6789/0 conn(0x7f772c0c70b0 legacy=0x7f772c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f773139b700 1 -- 172.21.15.154:0/1732551879 >> v1:172.21.15.154:6789/0 conn(0x7f772c069e80 legacy=0x7f772c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.808+0000 7f773139b700 1 -- 172.21.15.154:0/1732551879 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c06f430 con 0x7f772c155eb0 2023-10-10T21:21:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.809+0000 7f773139b700 1 --2- 172.21.15.154:0/1732551879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c155eb0 0x7f772c06e240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7728009910 tx=0x7f77280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3865f56cfa1075a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.809+0000 7f7723fff700 1 -- 172.21.15.154:0/1732551879 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7728011630 con 0x7f772c155eb0 2023-10-10T21:21:11.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.809+0000 7f7723fff700 1 -- 172.21.15.154:0/1732551879 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7728011790 con 0x7f772c155eb0 2023-10-10T21:21:11.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.809+0000 7f7723fff700 1 -- 172.21.15.154:0/1732551879 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7728011b30 con 0x7f772c155eb0 2023-10-10T21:21:11.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.809+0000 7f77335ff700 1 -- 172.21.15.154:0/1732551879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c155eb0 msgr2=0x7f772c06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:11.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.809+0000 7f77335ff700 1 --2- 172.21.15.154:0/1732551879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c155eb0 0x7f772c06e240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7728009910 tx=0x7f77280091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:11.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.810+0000 7f77335ff700 1 -- 172.21.15.154:0/1732551879 shutdown_connections 2023-10-10T21:21:11.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.810+0000 7f77335ff700 1 --2- 172.21.15.154:0/1732551879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c155eb0 0x7f772c06e240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:11.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.810+0000 7f77335ff700 1 -- 172.21.15.154:0/1732551879 >> 172.21.15.154:0/1732551879 conn(0x7f772c068e10 msgr2=0x7f772c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:11.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.810+0000 7f77335ff700 1 -- 172.21.15.154:0/1732551879 shutdown_connections 2023-10-10T21:21:11.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.810+0000 7f77335ff700 1 -- 172.21.15.154:0/1732551879 wait complete. 2023-10-10T21:21:11.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.811+0000 7f77335ff700 1 Processor -- start 2023-10-10T21:21:11.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.811+0000 7f77335ff700 1 -- start start 2023-10-10T21:21:11.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.812+0000 7f77335ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c069e80 0x7f772c0abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:11.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.812+0000 7f77335ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f772c0c70b0 0x7f772c15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:11.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.812+0000 7f77335ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f772c155eb0 0x7f772c0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:11.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.812+0000 7f77335ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0ac060 con 0x7f772c155eb0 2023-10-10T21:21:11.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.812+0000 7f77335ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0ada70 con 0x7f772c0c70b0 2023-10-10T21:21:11.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.812+0000 7f77335ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0ac270 con 0x7f772c069e80 2023-10-10T21:21:11.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.812+0000 7f7731b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f772c155eb0 0x7f772c0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:11.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.812+0000 7f7731b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f772c155eb0 0x7f772c0c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50972/0 (socket says 172.21.15.154:50972) 2023-10-10T21:21:11.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.812+0000 7f7731b9c700 1 -- 172.21.15.154:0/419515236 learned_addr learned my addr 172.21.15.154:0/419515236 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:11.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f773139b700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c069e80 0x7f772c0abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:11.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f7730b9a700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f772c0c70b0 0x7f772c15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:11.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f7731b9c700 1 -- 172.21.15.154:0/419515236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c069e80 msgr2=0x7f772c0abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:11.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f7731b9c700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c069e80 0x7f772c0abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:11.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f7731b9c700 1 -- 172.21.15.154:0/419515236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f772c0c70b0 msgr2=0x7f772c15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:11.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f7731b9c700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f772c0c70b0 0x7f772c15cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:11.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f7731b9c700 1 -- 172.21.15.154:0/419515236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7728009420 con 0x7f772c155eb0 2023-10-10T21:21:11.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f7731b9c700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f772c155eb0 0x7f772c0c5730 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f7724001460 tx=0x7f7724001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f77217fa700 1 -- 172.21.15.154:0/419515236 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400a8b0 con 0x7f772c155eb0 2023-10-10T21:21:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f77217fa700 1 -- 172.21.15.154:0/419515236 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772400aa30 con 0x7f772c155eb0 2023-10-10T21:21:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c0ac550 con 0x7f772c155eb0 2023-10-10T21:21:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.813+0000 7f77217fa700 1 -- 172.21.15.154:0/419515236 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400adf0 con 0x7f772c155eb0 2023-10-10T21:21:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.814+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c0acb10 con 0x7f772c155eb0 2023-10-10T21:21:11.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.814+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c04c3c0 con 0x7f772c155eb0 2023-10-10T21:21:11.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.815+0000 7f77217fa700 1 -- 172.21.15.154:0/419515236 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7724007300 con 0x7f772c155eb0 2023-10-10T21:21:11.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.816+0000 7f77217fa700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7710066f30 0x7f77100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:11.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.816+0000 7f77217fa700 1 -- 172.21.15.154:0/419515236 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f7724084850 con 0x7f772c155eb0 2023-10-10T21:21:11.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.816+0000 7f773139b700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7710066f30 0x7f77100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:11.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.817+0000 7f773139b700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7710066f30 0x7f77100693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7728009860 tx=0x7f7728017000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:11.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:11.820+0000 7f77217fa700 1 -- 172.21.15.154:0/419515236 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7724051a40 con 0x7f772c155eb0 2023-10-10T21:21:12.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.026+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f772c156280 con 0x7f772c155eb0 2023-10-10T21:21:12.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.030+0000 7f77217fa700 1 -- 172.21.15.154:0/419515236 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7724055060 con 0x7f772c155eb0 2023-10-10T21:21:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7710066f30 msgr2=0x7f77100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7710066f30 0x7f77100693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7728009860 tx=0x7f7728017000 comp rx=0 tx=0).stop 2023-10-10T21:21:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f772c155eb0 msgr2=0x7f772c0c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f772c155eb0 0x7f772c0c5730 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f7724001460 tx=0x7f7724001ac0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 shutdown_connections 2023-10-10T21:21:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7710066f30 0x7f77100693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f772c155eb0 0x7f772c0c5730 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f772c069e80 0x7f772c0abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 --2- 172.21.15.154:0/419515236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f772c0c70b0 0x7f772c15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 >> 172.21.15.154:0/419515236 conn(0x7f772c068e10 msgr2=0x7f772c069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 shutdown_connections 2023-10-10T21:21:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.033+0000 7f77335ff700 1 -- 172.21.15.154:0/419515236 wait complete. 2023-10-10T21:21:12.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T21:21:12.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.234+0000 7f83eabff700 1 Processor -- start 2023-10-10T21:21:12.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.235+0000 7f83eabff700 1 -- start start 2023-10-10T21:21:12.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83eabff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83e4155eb0 0x7f83e406e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83eabff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4069e80 0x7f83e40ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83eabff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e406eb90 con 0x7f83e40c70b0 2023-10-10T21:21:12.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83eabff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e406ee70 con 0x7f83e4155eb0 2023-10-10T21:21:12.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83eabff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e406f150 con 0x7f83e4069e80 2023-10-10T21:21:12.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83e899b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83e4155eb0 0x7f83e406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83e899b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83e4155eb0 0x7f83e406e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50974/0 (socket says 172.21.15.154:50974) 2023-10-10T21:21:12.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83e899b700 1 -- 172.21.15.154:0/43412946 learned_addr learned my addr 172.21.15.154:0/43412946 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:12.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83e919c700 1 --2- 172.21.15.154:0/43412946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4069e80 0x7f83e40ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83e899b700 1 -- 172.21.15.154:0/43412946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4069e80 msgr2=0x7f83e40ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:12.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.236+0000 7f83e899b700 1 --2- 172.21.15.154:0/43412946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4069e80 0x7f83e40ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.237+0000 7f83e899b700 1 -- 172.21.15.154:0/43412946 >> v1:172.21.15.179:6789/0 conn(0x7f83e40c70b0 legacy=0x7f83e4069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.237+0000 7f83e899b700 1 -- 172.21.15.154:0/43412946 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e406f430 con 0x7f83e4155eb0 2023-10-10T21:21:12.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.237+0000 7f83e899b700 1 --2- 172.21.15.154:0/43412946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e4155eb0 0x7f83e406e240 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c0d0 tx=0x7f83e000a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32257514a9be0c29 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:12.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.237+0000 7f83db7fe700 1 -- 172.21.15.154:0/43412946 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e000f070 con 0x7f83e4155eb0 2023-10-10T21:21:12.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.237+0000 7f83db7fe700 1 -- 172.21.15.154:0/43412946 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e000cdf0 con 0x7f83e4155eb0 2023-10-10T21:21:12.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.237+0000 7f83db7fe700 1 -- 172.21.15.154:0/43412946 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e000a320 con 0x7f83e4155eb0 2023-10-10T21:21:12.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.238+0000 7f83eabff700 1 -- 172.21.15.154:0/43412946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e4155eb0 msgr2=0x7f83e406e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.238+0000 7f83eabff700 1 --2- 172.21.15.154:0/43412946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e4155eb0 0x7f83e406e240 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c0d0 tx=0x7f83e000a950 comp rx=0 tx=0).stop 2023-10-10T21:21:12.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.238+0000 7f83eabff700 1 -- 172.21.15.154:0/43412946 shutdown_connections 2023-10-10T21:21:12.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.238+0000 7f83eabff700 1 --2- 172.21.15.154:0/43412946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4069e80 0x7f83e40ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.238+0000 7f83eabff700 1 --2- 172.21.15.154:0/43412946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e4155eb0 0x7f83e406e240 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.238+0000 7f83eabff700 1 -- 172.21.15.154:0/43412946 >> 172.21.15.154:0/43412946 conn(0x7f83e4068e10 msgr2=0x7f83e40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:12.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.238+0000 7f83eabff700 1 -- 172.21.15.154:0/43412946 shutdown_connections 2023-10-10T21:21:12.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.238+0000 7f83eabff700 1 -- 172.21.15.154:0/43412946 wait complete. 2023-10-10T21:21:12.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.239+0000 7f83eabff700 1 Processor -- start 2023-10-10T21:21:12.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.239+0000 7f83eabff700 1 -- start start 2023-10-10T21:21:12.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.240+0000 7f83eabff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83e4069e80 0x7f83e4152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.240+0000 7f83eabff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e40c70b0 0x7f83e4168d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.240+0000 7f83eabff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4155eb0 0x7f83e40a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.240+0000 7f83eabff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40ae170 con 0x7f83e40c70b0 2023-10-10T21:21:12.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.240+0000 7f83eabff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e41692d0 con 0x7f83e4069e80 2023-10-10T21:21:12.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.240+0000 7f83eabff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40a65d0 con 0x7f83e4155eb0 2023-10-10T21:21:12.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.240+0000 7f83dbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e40c70b0 0x7f83e4168d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.240+0000 7f83dbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e40c70b0 0x7f83e4168d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50988/0 (socket says 172.21.15.154:50988) 2023-10-10T21:21:12.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.240+0000 7f83dbfff700 1 -- 172.21.15.154:0/631704354 learned_addr learned my addr 172.21.15.154:0/631704354 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:12.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83e899b700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83e4069e80 0x7f83e4152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83e919c700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4155eb0 0x7f83e40a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83dbfff700 1 -- 172.21.15.154:0/631704354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4155eb0 msgr2=0x7f83e40a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83dbfff700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4155eb0 0x7f83e40a6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83dbfff700 1 -- 172.21.15.154:0/631704354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83e4069e80 msgr2=0x7f83e4152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83dbfff700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83e4069e80 0x7f83e4152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83dbfff700 1 -- 172.21.15.154:0/631704354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e000abf0 con 0x7f83e40c70b0 2023-10-10T21:21:12.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83dbfff700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e40c70b0 0x7f83e4168d90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f83d400c590 tx=0x7f83d400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:12.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83d8ff9700 1 -- 172.21.15.154:0/631704354 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4011590 con 0x7f83e40c70b0 2023-10-10T21:21:12.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83d8ff9700 1 -- 172.21.15.154:0/631704354 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4011710 con 0x7f83e40c70b0 2023-10-10T21:21:12.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e40a59c0 con 0x7f83e40c70b0 2023-10-10T21:21:12.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83d8ff9700 1 -- 172.21.15.154:0/631704354 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4011ad0 con 0x7f83e40c70b0 2023-10-10T21:21:12.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.241+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e40a5f80 con 0x7f83e40c70b0 2023-10-10T21:21:12.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.242+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e40a6780 con 0x7f83e40c70b0 2023-10-10T21:21:12.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.243+0000 7f83d8ff9700 1 -- 172.21.15.154:0/631704354 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83d401b3b0 con 0x7f83e40c70b0 2023-10-10T21:21:12.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.244+0000 7f83d8ff9700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f83d0066f30 0x7f83d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.244+0000 7f83d8ff9700 1 -- 172.21.15.154:0/631704354 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f83d4083a20 con 0x7f83e40c70b0 2023-10-10T21:21:12.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.245+0000 7f83e899b700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f83d0066f30 0x7f83d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.245+0000 7f83e899b700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f83d0066f30 0x7f83d00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83e000a990 tx=0x7f83e0019000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:12.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.248+0000 7f83d8ff9700 1 -- 172.21.15.154:0/631704354 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83e40a6780 con 0x7f83e40c70b0 2023-10-10T21:21:12.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.442+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f83e40a6740 con 0x7f83e40c70b0 2023-10-10T21:21:12.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.448+0000 7f83d8ff9700 1 -- 172.21.15.154:0/631704354 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v44) v1 ==== 115+0+0 (secure 0 0 0) 0x7f83d4017070 con 0x7f83e40c70b0 2023-10-10T21:21:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.450+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f83d0066f30 msgr2=0x7f83d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.450+0000 7f83eabff700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f83d0066f30 0x7f83d00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83e000a990 tx=0x7f83e0019000 comp rx=0 tx=0).stop 2023-10-10T21:21:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.450+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e40c70b0 msgr2=0x7f83e4168d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.450+0000 7f83eabff700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e40c70b0 0x7f83e4168d90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f83d400c590 tx=0x7f83d400c8a0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.451+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 shutdown_connections 2023-10-10T21:21:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.451+0000 7f83eabff700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83e4155eb0 0x7f83e40a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.451+0000 7f83eabff700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83e4069e80 0x7f83e4152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.451+0000 7f83eabff700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f83d0066f30 0x7f83d00693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.451+0000 7f83eabff700 1 --2- 172.21.15.154:0/631704354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83e40c70b0 0x7f83e4168d90 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.451+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 >> 172.21.15.154:0/631704354 conn(0x7f83e4068e10 msgr2=0x7f83e4154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:12.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.451+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 shutdown_connections 2023-10-10T21:21:12.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.451+0000 7f83eabff700 1 -- 172.21.15.154:0/631704354 wait complete. 2023-10-10T21:21:12.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T21:21:12.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.654+0000 7f9fd2b9d700 1 Processor -- start 2023-10-10T21:21:12.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.654+0000 7f9fd2b9d700 1 -- start start 2023-10-10T21:21:12.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.655+0000 7f9fd2b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9fcc0cb1a0 0x7f9fcc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.655+0000 7f9fd2b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc15a8a0 0x7f9fcc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.655+0000 7f9fd2b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc06ebd0 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.655+0000 7f9fd2b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc15b2e0 con 0x7f9fcc0cb1a0 2023-10-10T21:21:12.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.655+0000 7f9fd2b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc15ad20 con 0x7f9fcc15a8a0 2023-10-10T21:21:12.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd239c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9fcc06f5a0 0x7f9fcc0ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58514/0 (socket says 172.21.15.154:58514) 2023-10-10T21:21:12.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd239c700 1 -- 172.21.15.154:0/437252373 learned_addr learned my addr 172.21.15.154:0/437252373 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:12.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd1b9b700 1 --2- 172.21.15.154:0/437252373 >> v2:172.21.15.179:3300/0 conn(0x7f9fcc0cb1a0 0x7f9fcc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd139a700 1 --2- 172.21.15.154:0/437252373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc15a8a0 0x7f9fcc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd0b99700 1 -- 172.21.15.154:0/437252373 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172918394 0 0) 0x7f9fcc06ebd0 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd0b99700 1 -- 172.21.15.154:0/437252373 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb8003570 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd1b9b700 1 -- 172.21.15.154:0/437252373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc15a8a0 msgr2=0x7f9fcc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:12.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd1b9b700 1 --2- 172.21.15.154:0/437252373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc15a8a0 0x7f9fcc06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd1b9b700 1 -- 172.21.15.154:0/437252373 >> v1:172.21.15.154:6789/0 conn(0x7f9fcc06f5a0 legacy=0x7f9fcc0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd0b99700 1 -- 172.21.15.154:0/437252373 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651207083 0 0) 0x7f9fb8003570 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.656+0000 7f9fd1b9b700 1 -- 172.21.15.154:0/437252373 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc15b000 con 0x7f9fcc0cb1a0 2023-10-10T21:21:12.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.657+0000 7f9fd1b9b700 1 --2- 172.21.15.154:0/437252373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fcc0cb1a0 0x7f9fcc15a360 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80098e0 tx=0x7f9fc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7f871f950266885 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:12.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.657+0000 7f9fd0b99700 1 -- 172.21.15.154:0/437252373 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40017f0 con 0x7f9fcc0cb1a0 2023-10-10T21:21:12.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.657+0000 7f9fd0b99700 1 -- 172.21.15.154:0/437252373 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc8011420 con 0x7f9fcc0cb1a0 2023-10-10T21:21:12.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.657+0000 7f9fd0b99700 1 -- 172.21.15.154:0/437252373 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80117c0 con 0x7f9fcc0cb1a0 2023-10-10T21:21:12.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.658+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/437252373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fcc0cb1a0 msgr2=0x7f9fcc15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.658+0000 7f9fd2b9d700 1 --2- 172.21.15.154:0/437252373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fcc0cb1a0 0x7f9fcc15a360 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80098e0 tx=0x7f9fc80091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.658+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/437252373 shutdown_connections 2023-10-10T21:21:12.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.658+0000 7f9fd2b9d700 1 --2- 172.21.15.154:0/437252373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fcc0cb1a0 0x7f9fcc15a360 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.658+0000 7f9fd2b9d700 1 --2- 172.21.15.154:0/437252373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc15a8a0 0x7f9fcc06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.658+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/437252373 >> 172.21.15.154:0/437252373 conn(0x7f9fcc0cc1e0 msgr2=0x7f9fcc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:12.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.658+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/437252373 shutdown_connections 2023-10-10T21:21:12.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.658+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/437252373 wait complete. 2023-10-10T21:21:12.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.659+0000 7f9fd2b9d700 1 Processor -- start 2023-10-10T21:21:12.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.659+0000 7f9fd2b9d700 1 -- start start 2023-10-10T21:21:12.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd2b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fcc06f5a0 0x7f9fcc153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd2b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc0cb1a0 0x7f9fcc0b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd2b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fcc0b1a20 0x7f9fcc15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd2b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc169e60 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd2b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0b1ec0 con 0x7f9fcc0b1a20 2023-10-10T21:21:12.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd2b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc169fc0 con 0x7f9fcc0cb1a0 2023-10-10T21:21:12.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd1b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fcc06f5a0 0x7f9fcc153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd1b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fcc06f5a0 0x7f9fcc153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51002/0 (socket says 172.21.15.154:51002) 2023-10-10T21:21:12.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd1b9b700 1 -- 172.21.15.154:0/1963641617 learned_addr learned my addr 172.21.15.154:0/1963641617 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:12.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd239c700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fcc0b1a20 0x7f9fcc15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.660+0000 7f9fd139a700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc0cb1a0 0x7f9fcc0b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fd1b9b700 1 -- 172.21.15.154:0/1963641617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc0cb1a0 msgr2=0x7f9fcc0b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fd1b9b700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc0cb1a0 0x7f9fcc0b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fd1b9b700 1 -- 172.21.15.154:0/1963641617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fcc0b1a20 msgr2=0x7f9fcc15b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fd1b9b700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fcc0b1a20 0x7f9fcc15b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fd1b9b700 1 -- 172.21.15.154:0/1963641617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8009420 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fd1b9b700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fcc06f5a0 0x7f9fcc153b30 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80093f0 tx=0x7f9fc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:12.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fc1ffb700 1 -- 172.21.15.154:0/1963641617 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc801cb30 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fc1ffb700 1 -- 172.21.15.154:0/1963641617 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc801cc90 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fc1ffb700 1 -- 172.21.15.154:0/1963641617 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc801a660 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.661+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc154070 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.662+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc15c470 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.662+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc06c450 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.663+0000 7f9fc1ffb700 1 -- 172.21.15.154:0/1963641617 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fc801aa10 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.665+0000 7f9fc1ffb700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9fb0066f30 0x7f9fb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:12.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.665+0000 7f9fc1ffb700 1 -- 172.21.15.154:0/1963641617 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f9fc8085f00 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.665+0000 7f9fd139a700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9fb0066f30 0x7f9fb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:12.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.666+0000 7f9fd139a700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9fb0066f30 0x7f9fb00693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc159b20 tx=0x7f9fbc0091a0 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:12.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.669+0000 7f9fc1ffb700 1 -- 172.21.15.154:0/1963641617 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fc8053080 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.858+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f9fcc06e860 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.863+0000 7f9fc1ffb700 1 -- 172.21.15.154:0/1963641617 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v45) v1 ==== 120+0+0 (secure 0 0 0) 0x7f9fc80566a0 con 0x7f9fcc06f5a0 2023-10-10T21:21:12.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9fb0066f30 msgr2=0x7f9fb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9fb0066f30 0x7f9fb00693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc159b20 tx=0x7f9fbc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fcc06f5a0 msgr2=0x7f9fcc153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:12.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fcc06f5a0 0x7f9fcc153b30 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80093f0 tx=0x7f9fc8016000 comp rx=0 tx=0).stop 2023-10-10T21:21:12.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 shutdown_connections 2023-10-10T21:21:12.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fcc0b1a20 0x7f9fcc15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9fb0066f30 0x7f9fb00693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fcc06f5a0 0x7f9fcc153b30 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 --2- 172.21.15.154:0/1963641617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fcc0cb1a0 0x7f9fcc0b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:12.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.865+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 >> 172.21.15.154:0/1963641617 conn(0x7f9fcc0cc1e0 msgr2=0x7f9fcc155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:12.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.866+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 shutdown_connections 2023-10-10T21:21:12.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:12.866+0000 7f9fd2b9d700 1 -- 172.21.15.154:0/1963641617 wait complete. 2023-10-10T21:21:12.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-10T21:21:13.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.067+0000 7fa68119d700 1 Processor -- start 2023-10-10T21:21:13.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.067+0000 7fa68119d700 1 -- start start 2023-10-10T21:21:13.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.069+0000 7fa68119d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c1566e0 0x7fa67c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.069+0000 7fa68119d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c0ca860 con 0x7fa67c0cb900 2023-10-10T21:21:13.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.069+0000 7fa68119d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c0cab40 con 0x7fa67c156310 2023-10-10T21:21:13.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.069+0000 7fa68119d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0cae20 con 0x7fa67c1566e0 2023-10-10T21:21:13.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.069+0000 7fa68099c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa67c0cb900 0x7fa67c0c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58522/0 (socket says 172.21.15.154:58522) 2023-10-10T21:21:13.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.069+0000 7fa68099c700 1 -- 172.21.15.154:0/577150000 learned_addr learned my addr 172.21.15.154:0/577150000 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:13.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.069+0000 7fa67b7fe700 1 --2- 172.21.15.154:0/577150000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c1566e0 0x7fa67c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.069+0000 7fa67affd700 1 -- 172.21.15.154:0/577150000 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649031580 0 0) 0x7fa67c0ca860 con 0x7fa67c0cb900 2023-10-10T21:21:13.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67affd700 1 -- 172.21.15.154:0/577150000 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa664003570 con 0x7fa67c0cb900 2023-10-10T21:21:13.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67affd700 1 -- 172.21.15.154:0/577150000 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878868569 0 0) 0x7fa67c0cab40 con 0x7fa67c156310 2023-10-10T21:21:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67affd700 1 -- 172.21.15.154:0/577150000 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa67c0ca860 con 0x7fa67c156310 2023-10-10T21:21:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67affd700 1 -- 172.21.15.154:0/577150000 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4231074269 0 0) 0x7fa664003570 con 0x7fa67c0cb900 2023-10-10T21:21:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67b7fe700 1 -- 172.21.15.154:0/577150000 >> v1:172.21.15.179:6789/0 conn(0x7fa67c156310 legacy=0x7fa67c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67b7fe700 1 -- 172.21.15.154:0/577150000 >> v1:172.21.15.154:6789/0 conn(0x7fa67c0cb900 legacy=0x7fa67c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67b7fe700 1 -- 172.21.15.154:0/577150000 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0cb100 con 0x7fa67c1566e0 2023-10-10T21:21:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67b7fe700 1 --2- 172.21.15.154:0/577150000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c1566e0 0x7fa67c0ae000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa670009910 tx=0x7fa6700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd17cb56d5f221e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67affd700 1 -- 172.21.15.154:0/577150000 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6740017f0 con 0x7fa67c1566e0 2023-10-10T21:21:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67affd700 1 -- 172.21.15.154:0/577150000 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa670011420 con 0x7fa67c1566e0 2023-10-10T21:21:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.070+0000 7fa67affd700 1 -- 172.21.15.154:0/577150000 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700117c0 con 0x7fa67c1566e0 2023-10-10T21:21:13.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.071+0000 7fa68119d700 1 -- 172.21.15.154:0/577150000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c1566e0 msgr2=0x7fa67c0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.071+0000 7fa68119d700 1 --2- 172.21.15.154:0/577150000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c1566e0 0x7fa67c0ae000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa670009910 tx=0x7fa6700091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.071+0000 7fa68119d700 1 -- 172.21.15.154:0/577150000 shutdown_connections 2023-10-10T21:21:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.071+0000 7fa68119d700 1 --2- 172.21.15.154:0/577150000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c1566e0 0x7fa67c0ae000 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.071+0000 7fa68119d700 1 -- 172.21.15.154:0/577150000 >> 172.21.15.154:0/577150000 conn(0x7fa67c0cc1f0 msgr2=0x7fa67c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.071+0000 7fa68119d700 1 -- 172.21.15.154:0/577150000 shutdown_connections 2023-10-10T21:21:13.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.071+0000 7fa68119d700 1 -- 172.21.15.154:0/577150000 wait complete. 2023-10-10T21:21:13.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.073+0000 7fa68119d700 1 Processor -- start 2023-10-10T21:21:13.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.073+0000 7fa68119d700 1 -- start start 2023-10-10T21:21:13.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68119d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa67c0cb900 0x7fa67c14bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68119d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c156310 0x7fa67c0af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68119d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c1566e0 0x7fa67c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68119d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c150ac0 con 0x7fa67c1566e0 2023-10-10T21:21:13.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68119d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c14ff20 con 0x7fa67c0cb900 2023-10-10T21:21:13.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68119d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c150190 con 0x7fa67c156310 2023-10-10T21:21:13.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68099c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c1566e0 0x7fa67c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68099c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c1566e0 0x7fa67c14f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51010/0 (socket says 172.21.15.154:51010) 2023-10-10T21:21:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68099c700 1 -- 172.21.15.154:0/3040034065 learned_addr learned my addr 172.21.15.154:0/3040034065 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa67bfff700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa67c0cb900 0x7fa67c14bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa67b7fe700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c156310 0x7fa67c0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68099c700 1 -- 172.21.15.154:0/3040034065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c156310 msgr2=0x7fa67c0af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68099c700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c156310 0x7fa67c0af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68099c700 1 -- 172.21.15.154:0/3040034065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa67c0cb900 msgr2=0x7fa67c14bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68099c700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa67c0cb900 0x7fa67c14bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa68099c700 1 -- 172.21.15.154:0/3040034065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670009420 con 0x7fa67c1566e0 2023-10-10T21:21:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.074+0000 7fa67b7fe700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c156310 0x7fa67c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.075+0000 7fa68099c700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c1566e0 0x7fa67c14f310 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa67400cc80 tx=0x7fa674007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.075+0000 7fa663fff700 1 -- 172.21.15.154:0/3040034065 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674004dc0 con 0x7fa67c1566e0 2023-10-10T21:21:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.075+0000 7fa663fff700 1 -- 172.21.15.154:0/3040034065 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67400a710 con 0x7fa67c1566e0 2023-10-10T21:21:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.075+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c150470 con 0x7fa67c1566e0 2023-10-10T21:21:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.075+0000 7fa663fff700 1 -- 172.21.15.154:0/3040034065 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67400aad0 con 0x7fa67c1566e0 2023-10-10T21:21:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.075+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c14c120 con 0x7fa67c1566e0 2023-10-10T21:21:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.076+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c0b1df0 con 0x7fa67c1566e0 2023-10-10T21:21:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.077+0000 7fa663fff700 1 -- 172.21.15.154:0/3040034065 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa674007150 con 0x7fa67c1566e0 2023-10-10T21:21:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.078+0000 7fa663fff700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa668066f30 0x7fa6680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.078+0000 7fa663fff700 1 -- 172.21.15.154:0/3040034065 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5961+0+0 (secure 0 0 0) 0x7fa674084050 con 0x7fa67c1566e0 2023-10-10T21:21:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.078+0000 7fa67bfff700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa668066f30 0x7fa6680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.079+0000 7fa67bfff700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa668066f30 0x7fa6680693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa66c007fd0 tx=0x7fa66c007d50 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:13.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.082+0000 7fa663fff700 1 -- 172.21.15.154:0/3040034065 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa674051240 con 0x7fa67c1566e0 2023-10-10T21:21:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.352+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fa67c06d900 con 0x7fa67c1566e0 2023-10-10T21:21:13.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.599+0000 7fa663fff700 1 -- 172.21.15.154:0/3040034065 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v720) v1 ==== 148+0+0 (secure 0 0 0) 0x7fa674054860 con 0x7fa67c1566e0 2023-10-10T21:21:13.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa668066f30 msgr2=0x7fa6680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa668066f30 0x7fa6680693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa66c007fd0 tx=0x7fa66c007d50 comp rx=0 tx=0).stop 2023-10-10T21:21:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c1566e0 msgr2=0x7fa67c14f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c1566e0 0x7fa67c14f310 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa67400cc80 tx=0x7fa674007d20 comp rx=0 tx=0).stop 2023-10-10T21:21:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 shutdown_connections 2023-10-10T21:21:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa668066f30 0x7fa6680693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c1566e0 0x7fa67c14f310 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa67c0cb900 0x7fa67c14bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 --2- 172.21.15.154:0/3040034065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa67c156310 0x7fa67c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 >> 172.21.15.154:0/3040034065 conn(0x7fa67c0cc1f0 msgr2=0x7fa67c154fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:13.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 shutdown_connections 2023-10-10T21:21:13.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.602+0000 7fa68119d700 1 -- 172.21.15.154:0/3040034065 wait complete. 2023-10-10T21:21:13.622 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-10-10T21:21:13.622 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that number of snaps retained are as per user spec. 2023-10-10T21:21:13.622 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T21:21:13.623 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-10T21:21:13.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.804+0000 7fbea85ff700 1 Processor -- start 2023-10-10T21:21:13.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.805+0000 7fbea85ff700 1 -- start start 2023-10-10T21:21:13.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.806+0000 7fbea85ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbea00ccf90 0x7fbea00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.806+0000 7fbea85ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea00cc300 con 0x7fbea00b1420 2023-10-10T21:21:13.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.806+0000 7fbea85ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea00ad370 con 0x7fbea00cbf30 2023-10-10T21:21:13.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.806+0000 7fbea85ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea0156bf0 con 0x7fbea00ccf90 2023-10-10T21:21:13.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.806+0000 7fbea5b9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbea00b1420 0x7fbea00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58532/0 (socket says 172.21.15.154:58532) 2023-10-10T21:21:13.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.806+0000 7fbea5b9a700 1 -- 172.21.15.154:0/3803711378 learned_addr learned my addr 172.21.15.154:0/3803711378 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:13.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.806+0000 7fbea6b9c700 1 --2- 172.21.15.154:0/3803711378 >> v2:172.21.15.179:3300/0 conn(0x7fbea00ccf90 0x7fbea00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.807+0000 7fbea5399700 1 -- 172.21.15.154:0/3803711378 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238957086 0 0) 0x7fbea00cc300 con 0x7fbea00b1420 2023-10-10T21:21:13.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.807+0000 7fbea5399700 1 -- 172.21.15.154:0/3803711378 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe8c003570 con 0x7fbea00b1420 2023-10-10T21:21:13.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.807+0000 7fbea5399700 1 -- 172.21.15.154:0/3803711378 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146501065 0 0) 0x7fbea00ad370 con 0x7fbea00cbf30 2023-10-10T21:21:13.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.807+0000 7fbea5399700 1 -- 172.21.15.154:0/3803711378 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbea00cc300 con 0x7fbea00cbf30 2023-10-10T21:21:13.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.807+0000 7fbea6b9c700 1 -- 172.21.15.154:0/3803711378 >> v1:172.21.15.179:6789/0 conn(0x7fbea00cbf30 legacy=0x7fbea00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.807+0000 7fbea6b9c700 1 -- 172.21.15.154:0/3803711378 >> v1:172.21.15.154:6789/0 conn(0x7fbea00b1420 legacy=0x7fbea00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.807+0000 7fbea6b9c700 1 -- 172.21.15.154:0/3803711378 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea00ad650 con 0x7fbea00ccf90 2023-10-10T21:21:13.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.807+0000 7fbea6b9c700 1 --2- 172.21.15.154:0/3803711378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00ccf90 0x7fbea00ae410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009e60 tx=0x7fbe98009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3320a4a67bdde09 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:13.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.807+0000 7fbea5399700 1 -- 172.21.15.154:0/3803711378 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800e070 con 0x7fbea00ccf90 2023-10-10T21:21:13.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.808+0000 7fbea5399700 1 -- 172.21.15.154:0/3803711378 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800bab0 con 0x7fbea00ccf90 2023-10-10T21:21:13.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.808+0000 7fbea5399700 1 -- 172.21.15.154:0/3803711378 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800be70 con 0x7fbea00ccf90 2023-10-10T21:21:13.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.808+0000 7fbea85ff700 1 -- 172.21.15.154:0/3803711378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00ccf90 msgr2=0x7fbea00ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.808+0000 7fbea85ff700 1 --2- 172.21.15.154:0/3803711378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00ccf90 0x7fbea00ae410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009e60 tx=0x7fbe98009780 comp rx=0 tx=0).stop 2023-10-10T21:21:13.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.808+0000 7fbea85ff700 1 -- 172.21.15.154:0/3803711378 shutdown_connections 2023-10-10T21:21:13.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.808+0000 7fbea85ff700 1 --2- 172.21.15.154:0/3803711378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00ccf90 0x7fbea00ae410 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.808+0000 7fbea85ff700 1 -- 172.21.15.154:0/3803711378 >> 172.21.15.154:0/3803711378 conn(0x7fbea006a320 msgr2=0x7fbea00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:13.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.808+0000 7fbea85ff700 1 -- 172.21.15.154:0/3803711378 shutdown_connections 2023-10-10T21:21:13.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.808+0000 7fbea85ff700 1 -- 172.21.15.154:0/3803711378 wait complete. 2023-10-10T21:21:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.810+0000 7fbea85ff700 1 Processor -- start 2023-10-10T21:21:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.810+0000 7fbea85ff700 1 -- start start 2023-10-10T21:21:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea85ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbea00b1420 0x7fbea0155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea85ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00cbf30 0x7fbea00c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea85ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbea00ccf90 0x7fbea00a9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea85ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00c73f0 con 0x7fbea00ccf90 2023-10-10T21:21:13.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea85ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00c67e0 con 0x7fbea00cbf30 2023-10-10T21:21:13.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea85ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00c6ac0 con 0x7fbea00b1420 2023-10-10T21:21:13.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea6b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbea00ccf90 0x7fbea00a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea6b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbea00ccf90 0x7fbea00a9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51018/0 (socket says 172.21.15.154:51018) 2023-10-10T21:21:13.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea6b9c700 1 -- 172.21.15.154:0/618867287 learned_addr learned my addr 172.21.15.154:0/618867287 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:13.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea639b700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbea00b1420 0x7fbea0155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea5b9a700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00cbf30 0x7fbea00c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea6b9c700 1 -- 172.21.15.154:0/618867287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbea00b1420 msgr2=0x7fbea0155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea6b9c700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbea00b1420 0x7fbea0155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea6b9c700 1 -- 172.21.15.154:0/618867287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00cbf30 msgr2=0x7fbea00c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:13.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea6b9c700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00cbf30 0x7fbea00c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:13.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea6b9c700 1 -- 172.21.15.154:0/618867287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009a20 con 0x7fbea00ccf90 2023-10-10T21:21:13.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.811+0000 7fbea5b9a700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00cbf30 0x7fbea00c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:13.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.812+0000 7fbea6b9c700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbea00ccf90 0x7fbea00a9320 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fbea0064290 tx=0x7fbe98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:13.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.812+0000 7fbe967fc700 1 -- 172.21.15.154:0/618867287 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98026480 con 0x7fbea00ccf90 2023-10-10T21:21:13.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.812+0000 7fbe967fc700 1 -- 172.21.15.154:0/618867287 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe98026600 con 0x7fbea00ccf90 2023-10-10T21:21:13.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.812+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea00c6da0 con 0x7fbea00ccf90 2023-10-10T21:21:13.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.812+0000 7fbe967fc700 1 -- 172.21.15.154:0/618867287 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980269c0 con 0x7fbea00ccf90 2023-10-10T21:21:13.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.812+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea01560e0 con 0x7fbea00ccf90 2023-10-10T21:21:13.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.813+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea00c75a0 con 0x7fbea00ccf90 2023-10-10T21:21:13.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.814+0000 7fbe967fc700 1 -- 172.21.15.154:0/618867287 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe9801c400 con 0x7fbea00ccf90 2023-10-10T21:21:13.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.815+0000 7fbe967fc700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbe84066fb0 0x7fbe84069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:13.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.815+0000 7fbe967fc700 1 -- 172.21.15.154:0/618867287 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5961+0+0 (secure 0 0 0) 0x7fbe98086950 con 0x7fbea00ccf90 2023-10-10T21:21:13.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.815+0000 7fbea639b700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbe84066fb0 0x7fbe84069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:13.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.816+0000 7fbea639b700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbe84066fb0 0x7fbe84069460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c003870 tx=0x7fbe9c009040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:13.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:13.819+0000 7fbe967fc700 1 -- 172.21.15.154:0/618867287 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbea00c75a0 con 0x7fbea00ccf90 2023-10-10T21:21:14.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.088+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7fbea004c3c0 con 0x7fbea00ccf90 2023-10-10T21:21:14.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.602+0000 7fbe967fc700 1 -- 172.21.15.154:0/618867287 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v721) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbe98053a20 con 0x7fbea00ccf90 2023-10-10T21:21:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbe84066fb0 msgr2=0x7fbe84069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbe84066fb0 0x7fbe84069460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c003870 tx=0x7fbe9c009040 comp rx=0 tx=0).stop 2023-10-10T21:21:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbea00ccf90 msgr2=0x7fbea00a9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbea00ccf90 0x7fbea00a9320 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fbea0064290 tx=0x7fbe98019000 comp rx=0 tx=0).stop 2023-10-10T21:21:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 shutdown_connections 2023-10-10T21:21:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbe84066fb0 0x7fbe84069460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbea00ccf90 0x7fbea00a9320 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbea00b1420 0x7fbea0155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 --2- 172.21.15.154:0/618867287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbea00cbf30 0x7fbea00c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.604+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 >> 172.21.15.154:0/618867287 conn(0x7fbea006a320 msgr2=0x7fbea00b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:14.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.605+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 shutdown_connections 2023-10-10T21:21:14.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.605+0000 7fbea85ff700 1 -- 172.21.15.154:0/618867287 wait complete. 2023-10-10T21:21:14.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T21:21:14.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.808+0000 7f507599d700 1 Processor -- start 2023-10-10T21:21:14.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.808+0000 7f507599d700 1 -- start start 2023-10-10T21:21:14.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.809+0000 7f507599d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50701407e0 0x7f507006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:14.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.809+0000 7f507599d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5070140bb0 0x7f507006a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:14.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.809+0000 7f507599d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f507006d4f0 0x7f507006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:14.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.809+0000 7f507599d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700c6820 con 0x7f507006d4f0 2023-10-10T21:21:14.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.809+0000 7f507599d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700c6de0 con 0x7f5070140bb0 2023-10-10T21:21:14.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.809+0000 7f507599d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507006de70 con 0x7f50701407e0 2023-10-10T21:21:14.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507519c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f507006d4f0 0x7f507006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:14.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507519c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f507006d4f0 0x7f507006d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51032/0 (socket says 172.21.15.154:51032) 2023-10-10T21:21:14.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507519c700 1 -- 172.21.15.154:0/420653291 learned_addr learned my addr 172.21.15.154:0/420653291 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:14.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f506ffff700 1 --2- 172.21.15.154:0/420653291 >> v2:172.21.15.179:3300/0 conn(0x7f5070140bb0 0x7f507006a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:14.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507499b700 1 --2- 172.21.15.154:0/420653291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50701407e0 0x7f507006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:14.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507519c700 1 -- 172.21.15.154:0/420653291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50701407e0 msgr2=0x7f507006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:14.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507519c700 1 --2- 172.21.15.154:0/420653291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50701407e0 0x7f507006a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507519c700 1 -- 172.21.15.154:0/420653291 >> v2:172.21.15.179:3300/0 conn(0x7f5070140bb0 msgr2=0x7f507006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:14.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507519c700 1 --2- 172.21.15.154:0/420653291 >> v2:172.21.15.179:3300/0 conn(0x7f5070140bb0 0x7f507006a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507519c700 1 -- 172.21.15.154:0/420653291 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070141270 con 0x7f507006d4f0 2023-10-10T21:21:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.810+0000 7f507519c700 1 --2- 172.21.15.154:0/420653291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 0x7f507006d930 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f507006d1e0 tx=0x7f5068009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a1c9cb1507f104 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f506f7fe700 1 -- 172.21.15.154:0/420653291 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800e070 con 0x7f507006d4f0 2023-10-10T21:21:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f506f7fe700 1 -- 172.21.15.154:0/420653291 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506800ba20 con 0x7f507006d4f0 2023-10-10T21:21:14.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f506f7fe700 1 -- 172.21.15.154:0/420653291 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680092e0 con 0x7f507006d4f0 2023-10-10T21:21:14.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f507599d700 1 -- 172.21.15.154:0/420653291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 msgr2=0x7f507006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:14.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f507599d700 1 --2- 172.21.15.154:0/420653291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 0x7f507006d930 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f507006d1e0 tx=0x7f5068009840 comp rx=0 tx=0).stop 2023-10-10T21:21:14.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f507599d700 1 -- 172.21.15.154:0/420653291 shutdown_connections 2023-10-10T21:21:14.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f507599d700 1 --2- 172.21.15.154:0/420653291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 0x7f507006d930 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f507599d700 1 --2- 172.21.15.154:0/420653291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50701407e0 0x7f507006a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f507599d700 1 --2- 172.21.15.154:0/420653291 >> v2:172.21.15.179:3300/0 conn(0x7f5070140bb0 0x7f507006a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f507599d700 1 -- 172.21.15.154:0/420653291 >> 172.21.15.154:0/420653291 conn(0x7f50700cc1e0 msgr2=0x7f50700cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:14.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.811+0000 7f507599d700 1 -- 172.21.15.154:0/420653291 shutdown_connections 2023-10-10T21:21:14.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.812+0000 7f507599d700 1 -- 172.21.15.154:0/420653291 wait complete. 2023-10-10T21:21:14.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.813+0000 7f507599d700 1 Processor -- start 2023-10-10T21:21:14.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.813+0000 7f507599d700 1 -- start start 2023-10-10T21:21:14.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f507599d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 0x7f50700c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:14.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f507599d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50701407e0 0x7f507013b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:14.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f507599d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5070140bb0 0x7f507013eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:14.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f507599d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507013bcc0 con 0x7f507006d4f0 2023-10-10T21:21:14.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f507599d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700ae240 con 0x7f50701407e0 2023-10-10T21:21:14.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f507599d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50700ca390 con 0x7f5070140bb0 2023-10-10T21:21:14.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f507499b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 0x7f50700c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:14.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f507499b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 0x7f50700c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51040/0 (socket says 172.21.15.154:51040) 2023-10-10T21:21:14.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f507499b700 1 -- 172.21.15.154:0/4128328684 learned_addr learned my addr 172.21.15.154:0/4128328684 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:14.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.814+0000 7f506ffff700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50701407e0 0x7f507013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:14.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507519c700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5070140bb0 0x7f507013eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:14.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507499b700 1 -- 172.21.15.154:0/4128328684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5070140bb0 msgr2=0x7f507013eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:14.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507499b700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5070140bb0 0x7f507013eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507499b700 1 -- 172.21.15.154:0/4128328684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50701407e0 msgr2=0x7f507013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:14.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507499b700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50701407e0 0x7f507013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:14.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507499b700 1 -- 172.21.15.154:0/4128328684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5068009ae0 con 0x7f507006d4f0 2023-10-10T21:21:14.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507519c700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5070140bb0 0x7f507013eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:14.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507499b700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 0x7f50700c9db0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f506400d890 tx=0x7f5064008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:14.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f506cff9700 1 -- 172.21.15.154:0/4128328684 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640125f0 con 0x7f507006d4f0 2023-10-10T21:21:14.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f506cff9700 1 -- 172.21.15.154:0/4128328684 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064012750 con 0x7f507006d4f0 2023-10-10T21:21:14.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f506cff9700 1 -- 172.21.15.154:0/4128328684 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064012ad0 con 0x7f507006d4f0 2023-10-10T21:21:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50700ca670 con 0x7f507006d4f0 2023-10-10T21:21:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.815+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50700cac30 con 0x7f507006d4f0 2023-10-10T21:21:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.816+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50701697c0 con 0x7f507006d4f0 2023-10-10T21:21:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.817+0000 7f506cff9700 1 -- 172.21.15.154:0/4128328684 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f506401e460 con 0x7f507006d4f0 2023-10-10T21:21:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.818+0000 7f506cff9700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5054066f30 0x7f50540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.819+0000 7f506cff9700 1 -- 172.21.15.154:0/4128328684 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f5064084bb0 con 0x7f507006d4f0 2023-10-10T21:21:14.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.819+0000 7f506ffff700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5054066f30 0x7f50540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:14.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.819+0000 7f506ffff700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5054066f30 0x7f50540693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f50700b07d0 tx=0x7f505c0091a0 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:14.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:14.823+0000 7f506cff9700 1 -- 172.21.15.154:0/4128328684 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5064051d20 con 0x7f507006d4f0 2023-10-10T21:21:15.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.018+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f507006acf0 con 0x7f507006d4f0 2023-10-10T21:21:15.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.022+0000 7f506cff9700 1 -- 172.21.15.154:0/4128328684 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5064055340 con 0x7f507006d4f0 2023-10-10T21:21:15.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.024+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5054066f30 msgr2=0x7f50540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.024+0000 7f507599d700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5054066f30 0x7f50540693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f50700b07d0 tx=0x7f505c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.024+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 msgr2=0x7f50700c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.024+0000 7f507599d700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 0x7f50700c9db0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f506400d890 tx=0x7f5064008040 comp rx=0 tx=0).stop 2023-10-10T21:21:15.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.024+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 shutdown_connections 2023-10-10T21:21:15.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.024+0000 7f507599d700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5070140bb0 0x7f507013eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.024+0000 7f507599d700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5054066f30 0x7f50540693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.024+0000 7f507599d700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f507006d4f0 0x7f50700c9db0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.024+0000 7f507599d700 1 --2- 172.21.15.154:0/4128328684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50701407e0 0x7f507013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.025+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 >> 172.21.15.154:0/4128328684 conn(0x7f50700cc1e0 msgr2=0x7f50700cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:15.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.025+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 shutdown_connections 2023-10-10T21:21:15.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.025+0000 7f507599d700 1 -- 172.21.15.154:0/4128328684 wait complete. 2023-10-10T21:21:15.045 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T21:21:15.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:21:15.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T21:21:15.219 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T21:21:15.219 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T21:21:15.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:21:15.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.402+0000 7f1861b9d700 1 Processor -- start 2023-10-10T21:21:15.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.402+0000 7f1861b9d700 1 -- start start 2023-10-10T21:21:15.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.403+0000 7f1861b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f185c159420 0x7f185c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.403+0000 7f1861b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15d230 0x7f185c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.403+0000 7f1861b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c0b2980 con 0x7f185c1597f0 2023-10-10T21:21:15.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.403+0000 7f1861b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c15dbb0 con 0x7f185c159420 2023-10-10T21:21:15.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.403+0000 7f1861b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0b11d0 con 0x7f185c15d230 2023-10-10T21:21:15.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f186139c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15d230 0x7f185c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f185bfff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f185c1597f0 0x7f185c0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:48012/0 (socket says 172.21.15.154:48012) 2023-10-10T21:21:15.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f185bfff700 1 -- 172.21.15.154:0/1036847693 learned_addr learned my addr 172.21.15.154:0/1036847693 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:15.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f1860b9b700 1 --2- 172.21.15.154:0/1036847693 >> v2:172.21.15.179:3300/0 conn(0x7f185c159420 0x7f185c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f185b7fe700 1 -- 172.21.15.154:0/1036847693 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239265502 0 0) 0x7f185c0b2980 con 0x7f185c1597f0 2023-10-10T21:21:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f185b7fe700 1 -- 172.21.15.154:0/1036847693 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f184c003570 con 0x7f185c1597f0 2023-10-10T21:21:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f186139c700 1 -- 172.21.15.154:0/1036847693 >> v2:172.21.15.179:3300/0 conn(0x7f185c159420 msgr2=0x7f185c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f186139c700 1 --2- 172.21.15.154:0/1036847693 >> v2:172.21.15.179:3300/0 conn(0x7f185c159420 0x7f185c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f186139c700 1 -- 172.21.15.154:0/1036847693 >> v1:172.21.15.179:6789/0 conn(0x7f185c1597f0 legacy=0x7f185c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f186139c700 1 -- 172.21.15.154:0/1036847693 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c0b14b0 con 0x7f185c15d230 2023-10-10T21:21:15.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.404+0000 7f1860b9b700 1 --2- 172.21.15.154:0/1036847693 >> v2:172.21.15.179:3300/0 conn(0x7f185c159420 0x7f185c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:15.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f186139c700 1 --2- 172.21.15.154:0/1036847693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15d230 0x7f185c15d670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1854009e60 tx=0x7f1854009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43a7f1047ee244cc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:15.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f185b7fe700 1 -- 172.21.15.154:0/1036847693 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400e070 con 0x7f185c15d230 2023-10-10T21:21:15.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f185b7fe700 1 -- 172.21.15.154:0/1036847693 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400bab0 con 0x7f185c15d230 2023-10-10T21:21:15.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f185b7fe700 1 -- 172.21.15.154:0/1036847693 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400be30 con 0x7f185c15d230 2023-10-10T21:21:15.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f1861b9d700 1 -- 172.21.15.154:0/1036847693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15d230 msgr2=0x7f185c15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f1861b9d700 1 --2- 172.21.15.154:0/1036847693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15d230 0x7f185c15d670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1854009e60 tx=0x7f1854009780 comp rx=0 tx=0).stop 2023-10-10T21:21:15.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f1861b9d700 1 -- 172.21.15.154:0/1036847693 shutdown_connections 2023-10-10T21:21:15.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f1861b9d700 1 --2- 172.21.15.154:0/1036847693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15d230 0x7f185c15d670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f1861b9d700 1 --2- 172.21.15.154:0/1036847693 >> v2:172.21.15.179:3300/0 conn(0x7f185c159420 0x7f185c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.405+0000 7f1861b9d700 1 -- 172.21.15.154:0/1036847693 >> 172.21.15.154:0/1036847693 conn(0x7f185c0d0660 msgr2=0x7f185c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:15.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.406+0000 7f1861b9d700 1 -- 172.21.15.154:0/1036847693 shutdown_connections 2023-10-10T21:21:15.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.406+0000 7f1861b9d700 1 -- 172.21.15.154:0/1036847693 wait complete. 2023-10-10T21:21:15.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.407+0000 7f1861b9d700 1 Processor -- start 2023-10-10T21:21:15.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.407+0000 7f1861b9d700 1 -- start start 2023-10-10T21:21:15.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f1861b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c159420 0x7f185c0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f1861b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c1597f0 0x7f185c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f1861b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c15d230 0x7f185c0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f1861b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c15c040 con 0x7f185c15d230 2023-10-10T21:21:15.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f1861b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c15bdc0 con 0x7f185c159420 2023-10-10T21:21:15.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f1861b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c169a20 con 0x7f185c1597f0 2023-10-10T21:21:15.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f186139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c15d230 0x7f185c0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f186139c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c15d230 0x7f185c0b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51050/0 (socket says 172.21.15.154:51050) 2023-10-10T21:21:15.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f186139c700 1 -- 172.21.15.154:0/3918692415 learned_addr learned my addr 172.21.15.154:0/3918692415 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:15.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f185bfff700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c1597f0 0x7f185c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.408+0000 7f1860b9b700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c159420 0x7f185c0b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f186139c700 1 -- 172.21.15.154:0/3918692415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c1597f0 msgr2=0x7f185c15b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f186139c700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c1597f0 0x7f185c15b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f186139c700 1 -- 172.21.15.154:0/3918692415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c159420 msgr2=0x7f185c0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f186139c700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c159420 0x7f185c0b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f186139c700 1 -- 172.21.15.154:0/3918692415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850009420 con 0x7f185c15d230 2023-10-10T21:21:15.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f186139c700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c15d230 0x7f185c0b5070 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f185c0b1310 tx=0x7f1854019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:15.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f1858ff9700 1 -- 172.21.15.154:0/3918692415 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854012d60 con 0x7f185c15d230 2023-10-10T21:21:15.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f1858ff9700 1 -- 172.21.15.154:0/3918692415 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854021070 con 0x7f185c15d230 2023-10-10T21:21:15.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f1858ff9700 1 -- 172.21.15.154:0/3918692415 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854026680 con 0x7f185c15d230 2023-10-10T21:21:15.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f1861b9d700 1 -- 172.21.15.154:0/3918692415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1854009a20 con 0x7f185c15d230 2023-10-10T21:21:15.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.409+0000 7f1861b9d700 1 -- 172.21.15.154:0/3918692415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c0c5b60 con 0x7f185c15d230 2023-10-10T21:21:15.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.410+0000 7f18467fc700 1 -- 172.21.15.154:0/3918692415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c169c20 con 0x7f185c15d230 2023-10-10T21:21:15.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.411+0000 7f1858ff9700 1 -- 172.21.15.154:0/3918692415 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1854023030 con 0x7f185c15d230 2023-10-10T21:21:15.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.412+0000 7f1858ff9700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1840066f30 0x7f18400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.412+0000 7f1858ff9700 1 -- 172.21.15.154:0/3918692415 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f18540867e0 con 0x7f185c15d230 2023-10-10T21:21:15.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.412+0000 7f1860b9b700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1840066f30 0x7f18400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.413+0000 7f1860b9b700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1840066f30 0x7f18400693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18500093f0 tx=0x7f1850008040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:15.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.417+0000 7f1858ff9700 1 -- 172.21.15.154:0/3918692415 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f185c169c20 con 0x7f185c15d230 2023-10-10T21:21:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.656+0000 7f18467fc700 1 -- 172.21.15.154:0/3918692415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f185c0ccd50 con 0x7f185c15d230 2023-10-10T21:21:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.656+0000 7f1858ff9700 1 -- 172.21.15.154:0/3918692415 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f18540538b0 con 0x7f185c15d230 2023-10-10T21:21:15.659 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:15.659 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/909044943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":909044943},{"type":"v1","addr":"172.21.15.154:6834","nonce":909044943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/4163308288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":4163308288},{"type":"v1","addr":"172.21.15.179:6834","nonce":4163308288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7330,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3673994181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3673994181},{"type":"v1","addr":"172.21.15.179:6835","nonce":3673994181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":8061,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1261920782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1261920782},{"type":"v1","addr":"172.21.15.154:6835","nonce":1261920782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[]} 2023-10-10T21:21:15.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 -- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1840066f30 msgr2=0x7f18400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1840066f30 0x7f18400693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18500093f0 tx=0x7f1850008040 comp rx=0 tx=0).stop 2023-10-10T21:21:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 -- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c15d230 msgr2=0x7f185c0b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c15d230 0x7f185c0b5070 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f185c0b1310 tx=0x7f1854019000 comp rx=0 tx=0).stop 2023-10-10T21:21:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 -- 172.21.15.154:0/3918692415 shutdown_connections 2023-10-10T21:21:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1840066f30 0x7f18400693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c15d230 0x7f185c0b5070 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c159420 0x7f185c0b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 --2- 172.21.15.154:0/3918692415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c1597f0 0x7f185c15b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 -- 172.21.15.154:0/3918692415 >> 172.21.15.154:0/3918692415 conn(0x7f185c0d0660 msgr2=0x7f185c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 -- 172.21.15.154:0/3918692415 shutdown_connections 2023-10-10T21:21:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.659+0000 7f18467fc700 1 -- 172.21.15.154:0/3918692415 wait complete. 2023-10-10T21:21:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 56 2023-10-10T21:21:15.679 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T21:21:15.679 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T21:21:15.679 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T21:21:15.680 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:21:15.680 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T21:21:15.680 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T21:21:15.680 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T21:21:15.681 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:21:15.681 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T21:21:15.681 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T21:21:15.682 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T21:21:15.682 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:21:15.682 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T21:21:15.682 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T21:21:15.683 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T21:21:15.683 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T21:21:15.693 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T21:21:15.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T21:21:15.694 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T21:21:15.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T21:21:15.699 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T21:21:15.699 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T21:21:15.700 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T21:21:15.700 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T21:21:15.738 INFO:tasks.ceph.mds.a:Started 2023-10-10T21:21:15.739 DEBUG:teuthology.parallel:result is None 2023-10-10T21:21:15.741 INFO:tasks.ceph.mds.c:Started 2023-10-10T21:21:15.741 DEBUG:teuthology.parallel:result is None 2023-10-10T21:21:15.744 INFO:tasks.ceph.mds.b:Started 2023-10-10T21:21:15.744 DEBUG:teuthology.parallel:result is None 2023-10-10T21:21:15.746 INFO:tasks.ceph.mds.d:Started 2023-10-10T21:21:15.747 DEBUG:teuthology.parallel:result is None 2023-10-10T21:21:15.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T21:21:15.874 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T21:21:15.875 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T21:21:15.884 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T21:21:15.884 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T21:21:15.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.943+0000 7fa3fffff700 1 Processor -- start 2023-10-10T21:21:15.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.943+0000 7fa3fffff700 1 -- start start 2023-10-10T21:21:15.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.944+0000 7fa3fffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa40015d230 0x7fa40015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.944+0000 7fa3fffff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4000b2980 con 0x7fa400159420 2023-10-10T21:21:15.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.944+0000 7fa3fffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40015db70 con 0x7fa4001597f0 2023-10-10T21:21:15.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.944+0000 7fa3fffff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4000b11d0 con 0x7fa40015d230 2023-10-10T21:21:15.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.944+0000 7fa3feffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa400159420 0x7fa4000b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49384/0 (socket says 172.21.15.154:49384) 2023-10-10T21:21:15.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.944+0000 7fa3feffd700 1 -- 172.21.15.154:0/504774647 learned_addr learned my addr 172.21.15.154:0/504774647 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:15.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.944+0000 7fa3ff7fe700 1 --2- 172.21.15.154:0/504774647 >> v2:172.21.15.154:3300/0 conn(0x7fa40015d230 0x7fa40015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.945+0000 7fa3fdffb700 1 -- 172.21.15.154:0/504774647 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345692428 0 0) 0x7fa4000b2980 con 0x7fa400159420 2023-10-10T21:21:15.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.945+0000 7fa3fdffb700 1 -- 172.21.15.154:0/504774647 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3e8003570 con 0x7fa400159420 2023-10-10T21:21:15.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.945+0000 7fa3fdffb700 1 -- 172.21.15.154:0/504774647 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736497958 0 0) 0x7fa40015db70 con 0x7fa4001597f0 2023-10-10T21:21:15.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.945+0000 7fa3fdffb700 1 -- 172.21.15.154:0/504774647 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4000b2980 con 0x7fa4001597f0 2023-10-10T21:21:15.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.945+0000 7fa3ff7fe700 1 -- 172.21.15.154:0/504774647 >> v1:172.21.15.179:6789/0 conn(0x7fa4001597f0 legacy=0x7fa4000b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.945+0000 7fa3ff7fe700 1 -- 172.21.15.154:0/504774647 >> v1:172.21.15.154:6789/0 conn(0x7fa400159420 legacy=0x7fa4000b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.945+0000 7fa3ff7fe700 1 -- 172.21.15.154:0/504774647 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4000b14b0 con 0x7fa40015d230 2023-10-10T21:21:15.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.945+0000 7fa3ff7fe700 1 --2- 172.21.15.154:0/504774647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40015d230 0x7fa40015d630 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009e60 tx=0x7fa3f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac8b1eb710f4db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:15.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fdffb700 1 -- 172.21.15.154:0/504774647 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f800e070 con 0x7fa40015d230 2023-10-10T21:21:15.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fdffb700 1 -- 172.21.15.154:0/504774647 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f800bab0 con 0x7fa40015d230 2023-10-10T21:21:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fdffb700 1 -- 172.21.15.154:0/504774647 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f800be70 con 0x7fa40015d230 2023-10-10T21:21:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fffff700 1 -- 172.21.15.154:0/504774647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40015d230 msgr2=0x7fa40015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fffff700 1 --2- 172.21.15.154:0/504774647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40015d230 0x7fa40015d630 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009e60 tx=0x7fa3f8009780 comp rx=0 tx=0).stop 2023-10-10T21:21:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fffff700 1 -- 172.21.15.154:0/504774647 shutdown_connections 2023-10-10T21:21:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fffff700 1 --2- 172.21.15.154:0/504774647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40015d230 0x7fa40015d630 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fffff700 1 -- 172.21.15.154:0/504774647 >> 172.21.15.154:0/504774647 conn(0x7fa4000d0660 msgr2=0x7fa4000d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:15.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fffff700 1 -- 172.21.15.154:0/504774647 shutdown_connections 2023-10-10T21:21:15.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.946+0000 7fa3fffff700 1 -- 172.21.15.154:0/504774647 wait complete. 2023-10-10T21:21:15.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.948+0000 7fa3fffff700 1 Processor -- start 2023-10-10T21:21:15.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.948+0000 7fa3fffff700 1 -- start start 2023-10-10T21:21:15.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa400159420 0x7fa4001694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4001597f0 0x7fa40015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa40015d230 0x7fa4000c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3fffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000c61b0 con 0x7fa400159420 2023-10-10T21:21:15.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3fffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40015c9e0 con 0x7fa4001597f0 2023-10-10T21:21:15.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3fffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000c55a0 con 0x7fa40015d230 2023-10-10T21:21:15.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3feffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa400159420 0x7fa4001694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3feffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa400159420 0x7fa4001694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35478/0 (socket says 172.21.15.154:35478) 2023-10-10T21:21:15.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3feffd700 1 -- 172.21.15.154:0/2060403143 learned_addr learned my addr 172.21.15.154:0/2060403143 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:15.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3feffd700 1 -- 172.21.15.154:0/2060403143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa40015d230 msgr2=0x7fa4000c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3feffd700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa40015d230 0x7fa4000c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3feffd700 1 -- 172.21.15.154:0/2060403143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4001597f0 msgr2=0x7fa40015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:15.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3fe7fc700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4001597f0 0x7fa40015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3feffd700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4001597f0 0x7fa40015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:15.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3feffd700 1 -- 172.21.15.154:0/2060403143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8009a20 con 0x7fa400159420 2023-10-10T21:21:15.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.949+0000 7fa3fe7fc700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4001597f0 0x7fa40015c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:15.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.950+0000 7fa3feffd700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa400159420 0x7fa4001694d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c7c0 tx=0x7fa3f0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:15.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.950+0000 7fa3e6ffd700 1 -- 172.21.15.154:0/2060403143 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0005b30 con 0x7fa400159420 2023-10-10T21:21:15.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.950+0000 7fa3e6ffd700 1 -- 172.21.15.154:0/2060403143 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0005c90 con 0x7fa400159420 2023-10-10T21:21:15.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.950+0000 7fa3e6ffd700 1 -- 172.21.15.154:0/2060403143 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0007300 con 0x7fa400159420 2023-10-10T21:21:15.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.950+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4000c5880 con 0x7fa400159420 2023-10-10T21:21:15.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.950+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4000c5e40 con 0x7fa400159420 2023-10-10T21:21:15.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.951+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4000c6490 con 0x7fa400159420 2023-10-10T21:21:15.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.952+0000 7fa3e6ffd700 1 -- 172.21.15.154:0/2060403143 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3f001b400 con 0x7fa400159420 2023-10-10T21:21:15.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.953+0000 7fa3e6ffd700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3ec066f30 0x7fa3ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:15.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.953+0000 7fa3e6ffd700 1 -- 172.21.15.154:0/2060403143 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5961+0+0 (secure 0 0 0) 0x7fa3f0084190 con 0x7fa400159420 2023-10-10T21:21:15.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.953+0000 7fa3fe7fc700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3ec066f30 0x7fa3ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:15.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.954+0000 7fa3fe7fc700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3ec066f30 0x7fa3ec0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa400156d90 tx=0x7fa3f4009040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:15.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:15.957+0000 7fa3e6ffd700 1 -- 172.21.15.154:0/2060403143 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3f00512e0 con 0x7fa400159420 2023-10-10T21:21:16.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:16.169+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa40015cb20 con 0x7fa400159420 2023-10-10T21:21:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.142+0000 7fa3e6ffd700 1 -- 172.21.15.154:0/2060403143 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v135) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa3f0054900 con 0x7fa400159420 2023-10-10T21:21:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3ec066f30 msgr2=0x7fa3ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3ec066f30 0x7fa3ec0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa400156d90 tx=0x7fa3f4009040 comp rx=0 tx=0).stop 2023-10-10T21:21:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa400159420 msgr2=0x7fa4001694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa400159420 0x7fa4001694d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c7c0 tx=0x7fa3f0007ea0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 shutdown_connections 2023-10-10T21:21:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa40015d230 0x7fa4000c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3ec066f30 0x7fa3ec0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa400159420 0x7fa4001694d0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 --2- 172.21.15.154:0/2060403143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4001597f0 0x7fa40015c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 >> 172.21.15.154:0/2060403143 conn(0x7fa4000d0660 msgr2=0x7fa4000afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 shutdown_connections 2023-10-10T21:21:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.145+0000 7fa3fffff700 1 -- 172.21.15.154:0/2060403143 wait complete. 2023-10-10T21:21:17.150 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T21:21:17.168 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T21:21:17.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.352+0000 7fbbc199d700 1 Processor -- start 2023-10-10T21:21:17.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.352+0000 7fbbc199d700 1 -- start start 2023-10-10T21:21:17.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc199d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbbbc06d950 0x7fbbbc0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc199d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbbbc06dd20 0x7fbbbc0c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc199d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbbc06ae70 con 0x7fbbbc06a0a0 2023-10-10T21:21:17.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc199d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbbc06a540 con 0x7fbbbc06dd20 2023-10-10T21:21:17.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc199d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbbc06a820 con 0x7fbbbc06d950 2023-10-10T21:21:17.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc119c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbbbc06dd20 0x7fbbbc0c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc119c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbbbc06dd20 0x7fbbbc0c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35486/0 (socket says 172.21.15.154:35486) 2023-10-10T21:21:17.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc119c700 1 -- 172.21.15.154:0/4061587396 learned_addr learned my addr 172.21.15.154:0/4061587396 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc099b700 1 --2- 172.21.15.154:0/4061587396 >> v2:172.21.15.179:3300/0 conn(0x7fbbbc06d950 0x7fbbbc0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.354+0000 7fbbc119c700 1 -- 172.21.15.154:0/4061587396 >> v2:172.21.15.179:3300/0 conn(0x7fbbbc06d950 msgr2=0x7fbbbc0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:17.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.355+0000 7fbbc119c700 1 --2- 172.21.15.154:0/4061587396 >> v2:172.21.15.179:3300/0 conn(0x7fbbbc06d950 0x7fbbbc0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.355+0000 7fbbc119c700 1 -- 172.21.15.154:0/4061587396 >> v1:172.21.15.179:6789/0 conn(0x7fbbbc06a0a0 legacy=0x7fbbbc0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:17.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.355+0000 7fbbc119c700 1 -- 172.21.15.154:0/4061587396 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc06ab00 con 0x7fbbbc06dd20 2023-10-10T21:21:17.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.355+0000 7fbbc099b700 1 --2- 172.21.15.154:0/4061587396 >> v2:172.21.15.179:3300/0 conn(0x7fbbbc06d950 0x7fbbbc0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:17.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.355+0000 7fbbc119c700 1 --2- 172.21.15.154:0/4061587396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06dd20 0x7fbbbc0c7320 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0c9c70 tx=0x7fbbb4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7f8003115feb18 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:17.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.355+0000 7fbbbb7fe700 1 -- 172.21.15.154:0/4061587396 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb400e070 con 0x7fbbbc06dd20 2023-10-10T21:21:17.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.355+0000 7fbbbb7fe700 1 -- 172.21.15.154:0/4061587396 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb400ba10 con 0x7fbbbc06dd20 2023-10-10T21:21:17.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.355+0000 7fbbbb7fe700 1 -- 172.21.15.154:0/4061587396 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40092e0 con 0x7fbbbc06dd20 2023-10-10T21:21:17.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.356+0000 7fbbc199d700 1 -- 172.21.15.154:0/4061587396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06dd20 msgr2=0x7fbbbc0c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.356+0000 7fbbc199d700 1 --2- 172.21.15.154:0/4061587396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06dd20 0x7fbbbc0c7320 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0c9c70 tx=0x7fbbb4009840 comp rx=0 tx=0).stop 2023-10-10T21:21:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.356+0000 7fbbc199d700 1 -- 172.21.15.154:0/4061587396 shutdown_connections 2023-10-10T21:21:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.356+0000 7fbbc199d700 1 --2- 172.21.15.154:0/4061587396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06dd20 0x7fbbbc0c7320 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.356+0000 7fbbc199d700 1 --2- 172.21.15.154:0/4061587396 >> v2:172.21.15.179:3300/0 conn(0x7fbbbc06d950 0x7fbbbc0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.356+0000 7fbbc199d700 1 -- 172.21.15.154:0/4061587396 >> 172.21.15.154:0/4061587396 conn(0x7fbbbc0cc1f0 msgr2=0x7fbbbc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.356+0000 7fbbc199d700 1 -- 172.21.15.154:0/4061587396 shutdown_connections 2023-10-10T21:21:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.356+0000 7fbbc199d700 1 -- 172.21.15.154:0/4061587396 wait complete. 2023-10-10T21:21:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.357+0000 7fbbc199d700 1 Processor -- start 2023-10-10T21:21:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.357+0000 7fbbc199d700 1 -- start start 2023-10-10T21:21:17.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbc199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbbc06a0a0 0x7fbbbc15a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbc199d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06d950 0x7fbbbc158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbc199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbbc06dd20 0x7fbbbc158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbc199d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc15ae70 con 0x7fbbbc06d950 2023-10-10T21:21:17.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbc199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc158120 con 0x7fbbbc06a0a0 2023-10-10T21:21:17.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbc199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc157dd0 con 0x7fbbbc06dd20 2023-10-10T21:21:17.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbbbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06d950 0x7fbbbc158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbbbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06d950 0x7fbbbc158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35496/0 (socket says 172.21.15.154:35496) 2023-10-10T21:21:17.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbbbfff700 1 -- 172.21.15.154:0/738599556 learned_addr learned my addr 172.21.15.154:0/738599556 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:17.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.358+0000 7fbbc099b700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbbc06a0a0 0x7fbbbc15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbc119c700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbbc06dd20 0x7fbbbc158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbbbfff700 1 -- 172.21.15.154:0/738599556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbbc06dd20 msgr2=0x7fbbbc158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbbbfff700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbbc06dd20 0x7fbbbc158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbbbfff700 1 -- 172.21.15.154:0/738599556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbbc06a0a0 msgr2=0x7fbbbc15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbbbfff700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbbc06a0a0 0x7fbbbc15a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbbbfff700 1 -- 172.21.15.154:0/738599556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4009ae0 con 0x7fbbbc06d950 2023-10-10T21:21:17.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbbbfff700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06d950 0x7fbbbc158540 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fbba800c600 tx=0x7fbba8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:17.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbb8ff9700 1 -- 172.21.15.154:0/738599556 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8011590 con 0x7fbbbc06d950 2023-10-10T21:21:17.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbb8ff9700 1 -- 172.21.15.154:0/738599556 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba8011710 con 0x7fbbbc06d950 2023-10-10T21:21:17.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbbc0c3de0 con 0x7fbbbc06d950 2023-10-10T21:21:17.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbb8ff9700 1 -- 172.21.15.154:0/738599556 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8011ad0 con 0x7fbbbc06d950 2023-10-10T21:21:17.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.359+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbbc15a6c0 con 0x7fbbbc06d950 2023-10-10T21:21:17.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.360+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbbc04c3c0 con 0x7fbbbc06d950 2023-10-10T21:21:17.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.361+0000 7fbbb8ff9700 1 -- 172.21.15.154:0/738599556 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbba801c460 con 0x7fbbbc06d950 2023-10-10T21:21:17.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.362+0000 7fbbb8ff9700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbba0066f30 0x7fbba00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.362+0000 7fbbb8ff9700 1 -- 172.21.15.154:0/738599556 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5273+0+0 (secure 0 0 0) 0x7fbba80840d0 con 0x7fbbbc06d950 2023-10-10T21:21:17.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.362+0000 7fbbc099b700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbba0066f30 0x7fbba00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.363+0000 7fbbc099b700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbba0066f30 0x7fbba00693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000adc0 tx=0x7fbbb0006f90 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:17.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.366+0000 7fbbb8ff9700 1 -- 172.21.15.154:0/738599556 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbba8051450 con 0x7fbbbc06d950 2023-10-10T21:21:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.632+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbbbc0c4280 con 0x7fbbbc06d950 2023-10-10T21:21:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.632+0000 7fbbb8ff9700 1 -- 172.21.15.154:0/738599556 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbba8054a70 con 0x7fbbbc06d950 2023-10-10T21:21:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:17.634 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:21:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T21:21:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T21:21:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T21:21:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:21:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:21:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:21:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T21:21:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T21:21:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:21:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:21:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:21:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T21:21:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T21:21:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:21:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:21:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:21:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T21:21:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T21:21:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:21:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:21:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:21:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T21:21:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T21:21:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:21:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:21:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T21:21:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T21:21:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:21:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:21:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T21:21:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T21:21:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:21:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:21:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T21:21:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T21:21:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:21:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:21:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T21:21:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T21:21:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:21:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:21:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T21:21:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T21:21:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:21:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:21:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T21:21:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T21:21:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:21:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:21:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T21:21:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T21:21:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T21:21:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T21:21:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T21:21:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T21:21:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:21:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T21:21:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T21:21:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T21:21:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T21:21:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:21:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:21:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:21:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:21:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T21:21:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T21:21:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:21:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:21:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:21:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:21:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T21:21:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T21:21:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T21:21:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T21:21:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T21:21:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T21:21:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T21:21:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T21:21:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:21:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T21:21:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T21:21:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T21:21:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T21:21:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:21:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:21:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T21:21:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T21:21:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T21:21:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T21:21:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T21:21:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T21:21:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T21:21:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T21:21:17.671 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:21:17.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbba0066f30 msgr2=0x7fbba00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbba0066f30 0x7fbba00693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000adc0 tx=0x7fbbb0006f90 comp rx=0 tx=0).stop 2023-10-10T21:21:17.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06d950 msgr2=0x7fbbbc158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06d950 0x7fbbbc158540 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fbba800c600 tx=0x7fbba8007f60 comp rx=0 tx=0).stop 2023-10-10T21:21:17.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 shutdown_connections 2023-10-10T21:21:17.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbbc06dd20 0x7fbbbc158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbbc06a0a0 0x7fbbbc15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbba0066f30 0x7fbba00693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 --2- 172.21.15.154:0/738599556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbbc06d950 0x7fbbbc158540 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 >> 172.21.15.154:0/738599556 conn(0x7fbbbc0cc1f0 msgr2=0x7fbbbc0cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:17.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 shutdown_connections 2023-10-10T21:21:17.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.635+0000 7fbbc199d700 1 -- 172.21.15.154:0/738599556 wait complete. 2023-10-10T21:21:17.675 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:21:17.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.855+0000 7f745e79d700 1 Processor -- start 2023-10-10T21:21:17.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.855+0000 7f745e79d700 1 -- start start 2023-10-10T21:21:17.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.856+0000 7f745e79d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7458068aa0 0x7f74580b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.856+0000 7f745e79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74580b0a00 0x7f745815d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.856+0000 7f745e79d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745815a980 con 0x7f7458157270 2023-10-10T21:21:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.856+0000 7f745e79d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745815a050 con 0x7f7458068aa0 2023-10-10T21:21:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.856+0000 7f745e79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745815a330 con 0x7f74580b0a00 2023-10-10T21:21:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.857+0000 7f745cf9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7458068aa0 0x7f74580b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.857+0000 7f745cf9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7458068aa0 0x7f74580b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35504/0 (socket says 172.21.15.154:35504) 2023-10-10T21:21:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.857+0000 7f745cf9a700 1 -- 172.21.15.154:0/3662603108 learned_addr learned my addr 172.21.15.154:0/3662603108 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.857+0000 7f745df9c700 1 --2- 172.21.15.154:0/3662603108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74580b0a00 0x7f745815d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.857+0000 7f745cf9a700 1 -- 172.21.15.154:0/3662603108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74580b0a00 msgr2=0x7f745815d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:17.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.857+0000 7f745cf9a700 1 --2- 172.21.15.154:0/3662603108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74580b0a00 0x7f745815d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.857+0000 7f745cf9a700 1 -- 172.21.15.154:0/3662603108 >> v1:172.21.15.179:6789/0 conn(0x7f7458157270 legacy=0x7f7458068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.857+0000 7f745cf9a700 1 -- 172.21.15.154:0/3662603108 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745815a610 con 0x7f7458068aa0 2023-10-10T21:21:17.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.857+0000 7f745cf9a700 1 --2- 172.21.15.154:0/3662603108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7458068aa0 0x7f74580b04c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f74480099b0 tx=0x7f7448009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1f874c2d5ab825 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:17.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f744ffff700 1 -- 172.21.15.154:0/3662603108 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448009ea0 con 0x7f7458068aa0 2023-10-10T21:21:17.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f744ffff700 1 -- 172.21.15.154:0/3662603108 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744800b860 con 0x7f7458068aa0 2023-10-10T21:21:17.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f744ffff700 1 -- 172.21.15.154:0/3662603108 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800bc00 con 0x7f7458068aa0 2023-10-10T21:21:17.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f745e79d700 1 -- 172.21.15.154:0/3662603108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7458068aa0 msgr2=0x7f74580b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f745e79d700 1 --2- 172.21.15.154:0/3662603108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7458068aa0 0x7f74580b04c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f74480099b0 tx=0x7f7448009250 comp rx=0 tx=0).stop 2023-10-10T21:21:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f745e79d700 1 -- 172.21.15.154:0/3662603108 shutdown_connections 2023-10-10T21:21:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f745e79d700 1 --2- 172.21.15.154:0/3662603108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74580b0a00 0x7f745815d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f745e79d700 1 --2- 172.21.15.154:0/3662603108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7458068aa0 0x7f74580b04c0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f745e79d700 1 -- 172.21.15.154:0/3662603108 >> 172.21.15.154:0/3662603108 conn(0x7f74580cd310 msgr2=0x7f74580cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f745e79d700 1 -- 172.21.15.154:0/3662603108 shutdown_connections 2023-10-10T21:21:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.858+0000 7f745e79d700 1 -- 172.21.15.154:0/3662603108 wait complete. 2023-10-10T21:21:17.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.860+0000 7f745e79d700 1 Processor -- start 2023-10-10T21:21:17.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.860+0000 7f745e79d700 1 -- start start 2023-10-10T21:21:17.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745e79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7458068aa0 0x7f74580c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745e79d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74580b0a00 0x7f7458150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745e79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7458157270 0x7f74580c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745e79d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74580c4380 con 0x7f74580b0a00 2023-10-10T21:21:17.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745e79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74580c25f0 con 0x7f7458157270 2023-10-10T21:21:17.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745e79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7458152eb0 con 0x7f7458068aa0 2023-10-10T21:21:17.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745cf9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74580b0a00 0x7f7458150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745cf9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74580b0a00 0x7f7458150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35514/0 (socket says 172.21.15.154:35514) 2023-10-10T21:21:17.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745cf9a700 1 -- 172.21.15.154:0/389148824 learned_addr learned my addr 172.21.15.154:0/389148824 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:17.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745d79b700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7458068aa0 0x7f74580c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745df9c700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7458157270 0x7f74580c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745cf9a700 1 -- 172.21.15.154:0/389148824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7458068aa0 msgr2=0x7f74580c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745cf9a700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7458068aa0 0x7f74580c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745cf9a700 1 -- 172.21.15.154:0/389148824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7458157270 msgr2=0x7f74580c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:17.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745cf9a700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7458157270 0x7f74580c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:17.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.861+0000 7f745cf9a700 1 -- 172.21.15.154:0/389148824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480094f0 con 0x7f74580b0a00 2023-10-10T21:21:17.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.862+0000 7f745cf9a700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74580b0a00 0x7f7458150fa0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f7448006fd0 tx=0x7f7448017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:17.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.862+0000 7f744d7fa700 1 -- 172.21.15.154:0/389148824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448000d10 con 0x7f74580b0a00 2023-10-10T21:21:17.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.862+0000 7f744d7fa700 1 -- 172.21.15.154:0/389148824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744800bbe0 con 0x7f74580b0a00 2023-10-10T21:21:17.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.862+0000 7f744d7fa700 1 -- 172.21.15.154:0/389148824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448011670 con 0x7f74580b0a00 2023-10-10T21:21:17.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.862+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7458155af0 con 0x7f74580b0a00 2023-10-10T21:21:17.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.862+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74581560b0 con 0x7f74580b0a00 2023-10-10T21:21:17.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.863+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7458153080 con 0x7f74580b0a00 2023-10-10T21:21:17.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.864+0000 7f744d7fa700 1 -- 172.21.15.154:0/389148824 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7448011aa0 con 0x7f74580b0a00 2023-10-10T21:21:17.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.865+0000 7f744d7fa700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f743c066f30 0x7f743c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:17.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.865+0000 7f744d7fa700 1 -- 172.21.15.154:0/389148824 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f7448085cb0 con 0x7f74580b0a00 2023-10-10T21:21:17.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.865+0000 7f745d79b700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f743c066f30 0x7f743c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:17.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.866+0000 7f745d79b700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f743c066f30 0x7f743c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74540039e0 tx=0x7f7454007ec0 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:17.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:17.869+0000 7f744d7fa700 1 -- 172.21.15.154:0/389148824 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7448053030 con 0x7f74580b0a00 2023-10-10T21:21:18.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.061+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74580b0e80 con 0x7f74580b0a00 2023-10-10T21:21:18.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.062+0000 7f744d7fa700 1 -- 172.21.15.154:0/389148824 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+12832 (secure 0 0 0) 0x7f7448056650 con 0x7f74580b0a00 2023-10-10T21:21:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:18.064 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":135,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:21:17.139070+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:21:18.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f743c066f30 msgr2=0x7f743c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f743c066f30 0x7f743c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74540039e0 tx=0x7f7454007ec0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74580b0a00 msgr2=0x7f7458150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74580b0a00 0x7f7458150fa0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f7448006fd0 tx=0x7f7448017000 comp rx=0 tx=0).stop 2023-10-10T21:21:18.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 shutdown_connections 2023-10-10T21:21:18.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7458157270 0x7f74580c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7458068aa0 0x7f74580c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f743c066f30 0x7f743c0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 --2- 172.21.15.154:0/389148824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74580b0a00 0x7f7458150fa0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 >> 172.21.15.154:0/389148824 conn(0x7f74580cd310 msgr2=0x7f745806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:18.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 shutdown_connections 2023-10-10T21:21:18.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.065+0000 7f745e79d700 1 -- 172.21.15.154:0/389148824 wait complete. 2023-10-10T21:21:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T21:21:18.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T21:21:18.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.271+0000 7f708d79d700 1 Processor -- start 2023-10-10T21:21:18.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.271+0000 7f708d79d700 1 -- start start 2023-10-10T21:21:18.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.273+0000 7f708d79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f708806a710 0x7f7088160e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.273+0000 7f708d79d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708806e150 con 0x7f70880c9db0 2023-10-10T21:21:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.273+0000 7f708d79d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70880c7800 con 0x7f7088153900 2023-10-10T21:21:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.273+0000 7f708d79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70880c7610 con 0x7f708806a710 2023-10-10T21:21:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.273+0000 7f707ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f70880c9db0 0x7f708806a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49392/0 (socket says 172.21.15.154:49392) 2023-10-10T21:21:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.273+0000 7f707ffff700 1 -- 172.21.15.154:0/3839858721 learned_addr learned my addr 172.21.15.154:0/3839858721 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:18.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.273+0000 7f708cf9c700 1 --2- 172.21.15.154:0/3839858721 >> v2:172.21.15.179:3300/0 conn(0x7f708806a710 0x7f7088160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:18.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f70877fe700 1 -- 172.21.15.154:0/3839858721 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266696512 0 0) 0x7f708806e150 con 0x7f70880c9db0 2023-10-10T21:21:18.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f70877fe700 1 -- 172.21.15.154:0/3839858721 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7074003570 con 0x7f70880c9db0 2023-10-10T21:21:18.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f70877fe700 1 -- 172.21.15.154:0/3839858721 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380962459 0 0) 0x7f70880c7800 con 0x7f7088153900 2023-10-10T21:21:18.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f70877fe700 1 -- 172.21.15.154:0/3839858721 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f708806e150 con 0x7f7088153900 2023-10-10T21:21:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f70877fe700 1 -- 172.21.15.154:0/3839858721 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2803532857 0 0) 0x7f7074003570 con 0x7f70880c9db0 2023-10-10T21:21:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f708cf9c700 1 -- 172.21.15.154:0/3839858721 >> v1:172.21.15.179:6789/0 conn(0x7f7088153900 legacy=0x7f70880c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f708cf9c700 1 -- 172.21.15.154:0/3839858721 >> v1:172.21.15.154:6789/0 conn(0x7f70880c9db0 legacy=0x7f708806a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f708cf9c700 1 -- 172.21.15.154:0/3839858721 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880c7ae0 con 0x7f708806a710 2023-10-10T21:21:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f708cf9c700 1 --2- 172.21.15.154:0/3839858721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 0x7f7088160e70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f708000af70 tx=0x7f708000a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab7445960f3db04 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f70877fe700 1 -- 172.21.15.154:0/3839858721 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708000f070 con 0x7f708806a710 2023-10-10T21:21:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f70877fe700 1 -- 172.21.15.154:0/3839858721 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708000a0d0 con 0x7f708806a710 2023-10-10T21:21:18.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.274+0000 7f70877fe700 1 -- 172.21.15.154:0/3839858721 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070001470 con 0x7f708806a710 2023-10-10T21:21:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.275+0000 7f708d79d700 1 -- 172.21.15.154:0/3839858721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 msgr2=0x7f7088160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.275+0000 7f708d79d700 1 --2- 172.21.15.154:0/3839858721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 0x7f7088160e70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f708000af70 tx=0x7f708000a890 comp rx=0 tx=0).stop 2023-10-10T21:21:18.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.275+0000 7f708d79d700 1 -- 172.21.15.154:0/3839858721 shutdown_connections 2023-10-10T21:21:18.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.275+0000 7f708d79d700 1 --2- 172.21.15.154:0/3839858721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 0x7f7088160e70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.275+0000 7f708d79d700 1 -- 172.21.15.154:0/3839858721 >> 172.21.15.154:0/3839858721 conn(0x7f70880cc1e0 msgr2=0x7f70880cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:18.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.275+0000 7f708d79d700 1 -- 172.21.15.154:0/3839858721 shutdown_connections 2023-10-10T21:21:18.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.275+0000 7f708d79d700 1 -- 172.21.15.154:0/3839858721 wait complete. 2023-10-10T21:21:18.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.276+0000 7f708d79d700 1 Processor -- start 2023-10-10T21:21:18.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.277+0000 7f708d79d700 1 -- start start 2023-10-10T21:21:18.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.277+0000 7f708d79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 0x7f708816aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.277+0000 7f708d79d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70880c9db0 0x7f708816cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.277+0000 7f708d79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7088153900 0x7f708816d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.277+0000 7f708d79d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7088157b10 con 0x7f70880c9db0 2023-10-10T21:21:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.277+0000 7f708d79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7088156f00 con 0x7f708806a710 2023-10-10T21:21:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.277+0000 7f708d79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70881571e0 con 0x7f7088153900 2023-10-10T21:21:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f707ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70880c9db0 0x7f708816cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f707ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70880c9db0 0x7f708816cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35524/0 (socket says 172.21.15.154:35524) 2023-10-10T21:21:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f707ffff700 1 -- 172.21.15.154:0/3663947940 learned_addr learned my addr 172.21.15.154:0/3663947940 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f708cf9c700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7088153900 0x7f708816d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f707ffff700 1 -- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7088153900 msgr2=0x7f708816d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f7087fff700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 0x7f708816aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f707ffff700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7088153900 0x7f708816d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f707ffff700 1 -- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 msgr2=0x7f708816aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f707ffff700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 0x7f708816aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f707ffff700 1 -- 172.21.15.154:0/3663947940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708000ab30 con 0x7f70880c9db0 2023-10-10T21:21:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f708cf9c700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7088153900 0x7f708816d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f7087fff700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 0x7f708816aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:18.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.278+0000 7f707ffff700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70880c9db0 0x7f708816cf10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f707000c910 tx=0x7f70700019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:18.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.279+0000 7f7084ff9700 1 -- 172.21.15.154:0/3663947940 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000ce50 con 0x7f70880c9db0 2023-10-10T21:21:18.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.279+0000 7f7084ff9700 1 -- 172.21.15.154:0/3663947940 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7070005b30 con 0x7f70880c9db0 2023-10-10T21:21:18.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.279+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70881574c0 con 0x7f70880c9db0 2023-10-10T21:21:18.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.279+0000 7f7084ff9700 1 -- 172.21.15.154:0/3663947940 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70700070f0 con 0x7f70880c9db0 2023-10-10T21:21:18.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.279+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708816b020 con 0x7f70880c9db0 2023-10-10T21:21:18.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.280+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708816b2a0 con 0x7f70880c9db0 2023-10-10T21:21:18.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.281+0000 7f7084ff9700 1 -- 172.21.15.154:0/3663947940 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7070007460 con 0x7f70880c9db0 2023-10-10T21:21:18.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.282+0000 7f7084ff9700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7068066f30 0x7f70680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.282+0000 7f7084ff9700 1 -- 172.21.15.154:0/3663947940 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f7070084100 con 0x7f70880c9db0 2023-10-10T21:21:18.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.282+0000 7f7087fff700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7068066f30 0x7f70680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:18.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.282+0000 7f7087fff700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7068066f30 0x7f70680693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7078007fd0 tx=0x7f7078009040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:18.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.285+0000 7f7084ff9700 1 -- 172.21.15.154:0/3663947940 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70700515a0 con 0x7f70880c9db0 2023-10-10T21:21:18.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.478+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70880c7dc0 con 0x7f70880c9db0 2023-10-10T21:21:18.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.478+0000 7f7084ff9700 1 -- 172.21.15.154:0/3663947940 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7070054bc0 con 0x7f70880c9db0 2023-10-10T21:21:18.480 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T21:21:18.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7068066f30 msgr2=0x7f70680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7068066f30 0x7f70680693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7078007fd0 tx=0x7f7078009040 comp rx=0 tx=0).stop 2023-10-10T21:21:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70880c9db0 msgr2=0x7f708816cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70880c9db0 0x7f708816cf10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f707000c910 tx=0x7f70700019d0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 shutdown_connections 2023-10-10T21:21:18.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7088153900 0x7f708816d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f708806a710 0x7f708816aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7068066f30 0x7f70680693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 --2- 172.21.15.154:0/3663947940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70880c9db0 0x7f708816cf10 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 >> 172.21.15.154:0/3663947940 conn(0x7f70880cc1e0 msgr2=0x7f70880c6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:18.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 shutdown_connections 2023-10-10T21:21:18.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.481+0000 7f708d79d700 1 -- 172.21.15.154:0/3663947940 wait complete. 2023-10-10T21:21:18.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T21:21:18.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.684+0000 7f40551ff700 1 Processor -- start 2023-10-10T21:21:18.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.684+0000 7f40551ff700 1 -- start start 2023-10-10T21:21:18.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.685+0000 7f40551ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4050155c10 0x7f4050155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.685+0000 7f40551ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40500acac0 con 0x7f40500ac6d0 2023-10-10T21:21:18.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.686+0000 7f40551ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40500ad930 con 0x7f40500ac230 2023-10-10T21:21:18.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.686+0000 7f40551ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40500acd20 con 0x7f4050155c10 2023-10-10T21:21:18.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.686+0000 7f404ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4050155c10 0x7f4050155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:18.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.686+0000 7f404f59e700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f40500ac6d0 0x7f40500b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49400/0 (socket says 172.21.15.154:49400) 2023-10-10T21:21:18.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.686+0000 7f404f59e700 1 -- 172.21.15.154:0/1571507750 learned_addr learned my addr 172.21.15.154:0/1571507750 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:18.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.686+0000 7f404ed9d700 1 -- 172.21.15.154:0/1571507750 >> v1:172.21.15.179:6789/0 conn(0x7f40500ac230 legacy=0x7f40501568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.686+0000 7f404ed9d700 1 -- 172.21.15.154:0/1571507750 >> v1:172.21.15.154:6789/0 conn(0x7f40500ac6d0 legacy=0x7f40500b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.686+0000 7f404ed9d700 1 -- 172.21.15.154:0/1571507750 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40500ad000 con 0x7f4050155c10 2023-10-10T21:21:18.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.686+0000 7f404ed9d700 1 --2- 172.21.15.154:0/1571507750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 0x7f4050155fe0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f40400098e0 tx=0x7f40400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e611d1f51f9acdf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:18.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.687+0000 7f404dd9b700 1 -- 172.21.15.154:0/1571507750 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040009e80 con 0x7f4050155c10 2023-10-10T21:21:18.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.687+0000 7f404dd9b700 1 -- 172.21.15.154:0/1571507750 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404000b860 con 0x7f4050155c10 2023-10-10T21:21:18.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.687+0000 7f404dd9b700 1 -- 172.21.15.154:0/1571507750 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404000bbe0 con 0x7f4050155c10 2023-10-10T21:21:18.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.687+0000 7f40551ff700 1 -- 172.21.15.154:0/1571507750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 msgr2=0x7f4050155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.687+0000 7f40551ff700 1 --2- 172.21.15.154:0/1571507750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 0x7f4050155fe0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f40400098e0 tx=0x7f40400091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.687+0000 7f40551ff700 1 -- 172.21.15.154:0/1571507750 shutdown_connections 2023-10-10T21:21:18.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.687+0000 7f40551ff700 1 --2- 172.21.15.154:0/1571507750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 0x7f4050155fe0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.687+0000 7f40551ff700 1 -- 172.21.15.154:0/1571507750 >> 172.21.15.154:0/1571507750 conn(0x7f405006a320 msgr2=0x7f40500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:18.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.688+0000 7f40551ff700 1 -- 172.21.15.154:0/1571507750 shutdown_connections 2023-10-10T21:21:18.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.688+0000 7f40551ff700 1 -- 172.21.15.154:0/1571507750 wait complete. 2023-10-10T21:21:18.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.689+0000 7f40551ff700 1 Processor -- start 2023-10-10T21:21:18.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.689+0000 7f40551ff700 1 -- start start 2023-10-10T21:21:18.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.690+0000 7f40551ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40500ac230 0x7f40500cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.690+0000 7f40551ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40500ac6d0 0x7f40501517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.690+0000 7f40551ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 0x7f4050151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.690+0000 7f40551ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40501526f0 con 0x7f4050155c10 2023-10-10T21:21:18.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.690+0000 7f40551ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40500c89d0 con 0x7f40500ac230 2023-10-10T21:21:18.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.690+0000 7f40551ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40500c7dc0 con 0x7f40500ac6d0 2023-10-10T21:21:18.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.690+0000 7f404f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 0x7f4050151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:18.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.690+0000 7f404f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 0x7f4050151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35552/0 (socket says 172.21.15.154:35552) 2023-10-10T21:21:18.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.690+0000 7f404f59e700 1 -- 172.21.15.154:0/557338768 learned_addr learned my addr 172.21.15.154:0/557338768 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:18.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f404f59e700 1 -- 172.21.15.154:0/557338768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40500ac6d0 msgr2=0x7f40501517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f404f59e700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40500ac6d0 0x7f40501517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f404f59e700 1 -- 172.21.15.154:0/557338768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40500ac230 msgr2=0x7f40500cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f404f59e700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40500ac230 0x7f40500cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f404f59e700 1 -- 172.21.15.154:0/557338768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040009420 con 0x7f4050155c10 2023-10-10T21:21:18.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f404f59e700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 0x7f4050151d20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f404800cc40 tx=0x7f4048001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:18.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f4036ffd700 1 -- 172.21.15.154:0/557338768 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404800a9c0 con 0x7f4050155c10 2023-10-10T21:21:18.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f4036ffd700 1 -- 172.21.15.154:0/557338768 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404800ab20 con 0x7f4050155c10 2023-10-10T21:21:18.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f4036ffd700 1 -- 172.21.15.154:0/557338768 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480070f0 con 0x7f4050155c10 2023-10-10T21:21:18.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40500c80a0 con 0x7f4050155c10 2023-10-10T21:21:18.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.691+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40500c8660 con 0x7f4050155c10 2023-10-10T21:21:18.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.693+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405004c3c0 con 0x7f4050155c10 2023-10-10T21:21:18.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.693+0000 7f4036ffd700 1 -- 172.21.15.154:0/557338768 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40480074e0 con 0x7f4050155c10 2023-10-10T21:21:18.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.694+0000 7f4036ffd700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f403c066f30 0x7f403c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:18.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.694+0000 7f4036ffd700 1 -- 172.21.15.154:0/557338768 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f4048084770 con 0x7f4050155c10 2023-10-10T21:21:18.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.694+0000 7f404ed9d700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f403c066f30 0x7f403c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:18.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.695+0000 7f404ed9d700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f403c066f30 0x7f403c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f40400091e0 tx=0x7f4040017000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:18.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.698+0000 7f4036ffd700 1 -- 172.21.15.154:0/557338768 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4048051c10 con 0x7f4050155c10 2023-10-10T21:21:18.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.894+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f40500c2740 con 0x7f4050155c10 2023-10-10T21:21:18.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.895+0000 7f4036ffd700 1 -- 172.21.15.154:0/557338768 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v135) v1 ==== 84+0+65 (secure 0 0 0) 0x7f40500c2740 con 0x7f4050155c10 2023-10-10T21:21:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:18.897 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:21:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T21:21:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T21:21:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:18.898 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:21:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f403c066f30 msgr2=0x7f403c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f403c066f30 0x7f403c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f40400091e0 tx=0x7f4040017000 comp rx=0 tx=0).stop 2023-10-10T21:21:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 msgr2=0x7f4050151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:18.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 0x7f4050151d20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f404800cc40 tx=0x7f4048001a50 comp rx=0 tx=0).stop 2023-10-10T21:21:18.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 shutdown_connections 2023-10-10T21:21:18.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f403c066f30 0x7f403c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4050155c10 0x7f4050151d20 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40500ac230 0x7f40500cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 --2- 172.21.15.154:0/557338768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40500ac6d0 0x7f40501517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:18.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 >> 172.21.15.154:0/557338768 conn(0x7f405006a320 msgr2=0x7f4050153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:18.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 shutdown_connections 2023-10-10T21:21:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:18.897+0000 7f40551ff700 1 -- 172.21.15.154:0/557338768 wait complete. 2023-10-10T21:21:18.917 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T21:21:18.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T21:21:19.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.104+0000 7f88a17ff700 1 Processor -- start 2023-10-10T21:21:19.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.104+0000 7f88a17ff700 1 -- start start 2023-10-10T21:21:19.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f88a17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c162510 0x7f889c0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f88a17ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c0c75e0 con 0x7f889c068390 2023-10-10T21:21:19.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f88a17ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c0c78c0 con 0x7f889c0bf470 2023-10-10T21:21:19.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f88a17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0c7ba0 con 0x7f889c162510 2023-10-10T21:21:19.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f889b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f889c068390 0x7f889c0af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49414/0 (socket says 172.21.15.154:49414) 2023-10-10T21:21:19.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f889b7fe700 1 -- 172.21.15.154:0/2261229309 learned_addr learned my addr 172.21.15.154:0/2261229309 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:19.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f8893fff700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c162510 0x7f889c0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652866633 0 0) 0x7f889c0c75e0 con 0x7f889c068390 2023-10-10T21:21:19.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8888003570 con 0x7f889c068390 2023-10-10T21:21:19.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.106+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 318734815 0 0) 0x7f8888003570 con 0x7f889c068390 2023-10-10T21:21:19.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c162510 msgr2=0x7f889c0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:19.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c162510 0x7f889c0c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 >> v1:172.21.15.179:6789/0 conn(0x7f889c0bf470 legacy=0x7f889c0bf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0c7e80 con 0x7f889c068390 2023-10-10T21:21:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f88940017f0 con 0x7f889c068390 2023-10-10T21:21:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 >> v1:172.21.15.154:6789/0 conn(0x7f889c068390 legacy=0x7f889c0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8888003a90 0x7f8888003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f8888004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c162510 0x7f88880051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0c7ba0 con 0x7f8888004810 2023-10-10T21:21:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888800bb60 con 0x7f8888003a90 2023-10-10T21:21:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888800bd20 con 0x7f889c162510 2023-10-10T21:21:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f8893fff700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f8888004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889affd700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8888003a90 0x7f8888003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f889b7fe700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c162510 0x7f88880051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f8893fff700 1 -- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c162510 msgr2=0x7f88880051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:19.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f8893fff700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c162510 0x7f88880051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f8893fff700 1 -- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8888003a90 msgr2=0x7f8888003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:19.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f8893fff700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8888003a90 0x7f8888003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.107+0000 7f8893fff700 1 -- 172.21.15.154:0/2261229309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888003570 con 0x7f8888004810 2023-10-10T21:21:19.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.108+0000 7f8893fff700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f8888004c80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f8884009c00 tx=0x7f88840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae6d75c06f217ae server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:19.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.108+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888400e710 con 0x7f8888004810 2023-10-10T21:21:19.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.108+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888400e870 con 0x7f8888004810 2023-10-10T21:21:19.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.108+0000 7f889a7fc700 1 -- 172.21.15.154:0/2261229309 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888400ec30 con 0x7f8888004810 2023-10-10T21:21:19.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.108+0000 7f88a17ff700 1 -- 172.21.15.154:0/2261229309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 msgr2=0x7f8888004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.108+0000 7f88a17ff700 1 --2- 172.21.15.154:0/2261229309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f8888004c80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f8884009c00 tx=0x7f88840091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.108+0000 7f889b7fe700 1 -- 172.21.15.154:0/2261229309 reap_dead start 2023-10-10T21:21:19.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.109+0000 7f88a17ff700 1 -- 172.21.15.154:0/2261229309 shutdown_connections 2023-10-10T21:21:19.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.109+0000 7f88a17ff700 1 -- 172.21.15.154:0/2261229309 >> 172.21.15.154:0/2261229309 conn(0x7f889c0c8f90 msgr2=0x7f889c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:19.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.109+0000 7f88a17ff700 1 -- 172.21.15.154:0/2261229309 shutdown_connections 2023-10-10T21:21:19.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.109+0000 7f88a17ff700 1 -- 172.21.15.154:0/2261229309 wait complete. 2023-10-10T21:21:19.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.110+0000 7f88a17ff700 1 Processor -- start 2023-10-10T21:21:19.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.110+0000 7f88a17ff700 1 -- start start 2023-10-10T21:21:19.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f88a17ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f889c0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f88a17ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f889c15cf00 0x7f889c0c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f88a17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c0c20d0 0x7f889c0c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f88a17ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0c2ab0 con 0x7f8888004810 2023-10-10T21:21:19.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f88a17ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0c4650 con 0x7f889c15cf00 2023-10-10T21:21:19.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f88a17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0afca0 con 0x7f889c0c20d0 2023-10-10T21:21:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f889affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f889c0c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f889affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f889c0c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35572/0 (socket says 172.21.15.154:35572) 2023-10-10T21:21:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f889affd700 1 -- 172.21.15.154:0/155878767 learned_addr learned my addr 172.21.15.154:0/155878767 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f8893fff700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f889c15cf00 0x7f889c0c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.111+0000 7f889b7fe700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c0c20d0 0x7f889c0c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f889affd700 1 -- 172.21.15.154:0/155878767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c0c20d0 msgr2=0x7f889c0c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f889affd700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c0c20d0 0x7f889c0c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f889affd700 1 -- 172.21.15.154:0/155878767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f889c15cf00 msgr2=0x7f889c0c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f889affd700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f889c15cf00 0x7f889c0c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f889affd700 1 -- 172.21.15.154:0/155878767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c15d370 con 0x7f8888004810 2023-10-10T21:21:19.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f889affd700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f889c0c5120 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f888c002950 tx=0x7f888c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:19.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f8892ffd700 1 -- 172.21.15.154:0/155878767 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c00f870 con 0x7f8888004810 2023-10-10T21:21:19.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f8892ffd700 1 -- 172.21.15.154:0/155878767 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c00f9d0 con 0x7f8888004810 2023-10-10T21:21:19.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c0af370 con 0x7f8888004810 2023-10-10T21:21:19.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f8892ffd700 1 -- 172.21.15.154:0/155878767 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c00fd90 con 0x7f8888004810 2023-10-10T21:21:19.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.112+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c0af930 con 0x7f8888004810 2023-10-10T21:21:19.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.113+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c0718b0 con 0x7f8888004810 2023-10-10T21:21:19.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.114+0000 7f8892ffd700 1 -- 172.21.15.154:0/155878767 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f888c013600 con 0x7f8888004810 2023-10-10T21:21:19.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.115+0000 7f8892ffd700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f887c066f30 0x7f887c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.115+0000 7f8892ffd700 1 -- 172.21.15.154:0/155878767 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f888c084860 con 0x7f8888004810 2023-10-10T21:21:19.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.115+0000 7f8893fff700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f887c066f30 0x7f887c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.116+0000 7f8893fff700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f887c066f30 0x7f887c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88840091e0 tx=0x7f888401a000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:19.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.119+0000 7f8892ffd700 1 -- 172.21.15.154:0/155878767 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f888c051c80 con 0x7f8888004810 2023-10-10T21:21:19.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.310+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f889c0c8160 con 0x7f8888004810 2023-10-10T21:21:19.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.628+0000 7f8892ffd700 1 -- 172.21.15.154:0/155878767 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v136) v1 ==== 138+0+0 (secure 0 0 0) 0x7f888c0552a0 con 0x7f8888004810 2023-10-10T21:21:19.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.635+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f887c066f30 msgr2=0x7f887c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.635+0000 7f88a17ff700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f887c066f30 0x7f887c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88840091e0 tx=0x7f888401a000 comp rx=0 tx=0).stop 2023-10-10T21:21:19.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.635+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 msgr2=0x7f889c0c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.635+0000 7f88a17ff700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f889c0c5120 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f888c002950 tx=0x7f888c007d30 comp rx=0 tx=0).stop 2023-10-10T21:21:19.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.636+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 shutdown_connections 2023-10-10T21:21:19.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.636+0000 7f88a17ff700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f889c0c20d0 0x7f889c0c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.636+0000 7f88a17ff700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f887c066f30 0x7f887c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.636+0000 7f88a17ff700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8888004810 0x7f889c0c5120 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.636+0000 7f88a17ff700 1 --2- 172.21.15.154:0/155878767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f889c15cf00 0x7f889c0c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.636+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 >> 172.21.15.154:0/155878767 conn(0x7f889c0c8f90 msgr2=0x7f889c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:19.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.636+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 shutdown_connections 2023-10-10T21:21:19.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.636+0000 7f88a17ff700 1 -- 172.21.15.154:0/155878767 wait complete. 2023-10-10T21:21:19.640 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T21:21:19.655 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T21:21:19.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.860+0000 7fe2273ff700 1 Processor -- start 2023-10-10T21:21:19.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.860+0000 7fe2273ff700 1 -- start start 2023-10-10T21:21:19.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.861+0000 7fe2273ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe220157630 0x7fe220158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.861+0000 7fe2273ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe220157a00 0x7fe2200abd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.861+0000 7fe2273ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe220158590 con 0x7fe2200ac290 2023-10-10T21:21:19.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.861+0000 7fe2273ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe220157f80 con 0x7fe220157630 2023-10-10T21:21:19.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.861+0000 7fe2273ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2200ac7a0 con 0x7fe220157a00 2023-10-10T21:21:19.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.861+0000 7fe22599c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe2200ac290 0x7fe220068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49428/0 (socket says 172.21.15.154:49428) 2023-10-10T21:21:19.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.862+0000 7fe22599c700 1 -- 172.21.15.154:0/321836097 learned_addr learned my addr 172.21.15.154:0/321836097 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:19.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.862+0000 7fe22519b700 1 --2- 172.21.15.154:0/321836097 >> v2:172.21.15.154:3300/0 conn(0x7fe220157630 0x7fe220158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.862+0000 7fe22499a700 1 --2- 172.21.15.154:0/321836097 >> v2:172.21.15.179:3300/0 conn(0x7fe220157a00 0x7fe2200abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.862+0000 7fe22519b700 1 -- 172.21.15.154:0/321836097 >> v2:172.21.15.179:3300/0 conn(0x7fe220157a00 msgr2=0x7fe2200abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:19.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.862+0000 7fe22519b700 1 --2- 172.21.15.154:0/321836097 >> v2:172.21.15.179:3300/0 conn(0x7fe220157a00 0x7fe2200abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.862+0000 7fe22519b700 1 -- 172.21.15.154:0/321836097 >> v1:172.21.15.154:6789/0 conn(0x7fe2200ac290 legacy=0x7fe220068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.862+0000 7fe22519b700 1 -- 172.21.15.154:0/321836097 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220158220 con 0x7fe220157630 2023-10-10T21:21:19.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.862+0000 7fe22519b700 1 --2- 172.21.15.154:0/321836097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220157630 0x7fe220158a20 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fe2200c8cf0 tx=0x7fe21c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b233d9e20dee0f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:19.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.862+0000 7fe217fff700 1 -- 172.21.15.154:0/321836097 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00b6b0 con 0x7fe220157630 2023-10-10T21:21:19.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe217fff700 1 -- 172.21.15.154:0/321836097 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c00b810 con 0x7fe220157630 2023-10-10T21:21:19.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe217fff700 1 -- 172.21.15.154:0/321836097 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00bbb0 con 0x7fe220157630 2023-10-10T21:21:19.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe2273ff700 1 -- 172.21.15.154:0/321836097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220157630 msgr2=0x7fe220158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe2273ff700 1 --2- 172.21.15.154:0/321836097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220157630 0x7fe220158a20 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fe2200c8cf0 tx=0x7fe21c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe2273ff700 1 -- 172.21.15.154:0/321836097 shutdown_connections 2023-10-10T21:21:19.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe2273ff700 1 --2- 172.21.15.154:0/321836097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe220157630 0x7fe220158a20 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe2273ff700 1 --2- 172.21.15.154:0/321836097 >> v2:172.21.15.179:3300/0 conn(0x7fe220157a00 0x7fe2200abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe2273ff700 1 -- 172.21.15.154:0/321836097 >> 172.21.15.154:0/321836097 conn(0x7fe2200cc540 msgr2=0x7fe2200cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:19.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe2273ff700 1 -- 172.21.15.154:0/321836097 shutdown_connections 2023-10-10T21:21:19.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.863+0000 7fe2273ff700 1 -- 172.21.15.154:0/321836097 wait complete. 2023-10-10T21:21:19.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.865+0000 7fe2273ff700 1 Processor -- start 2023-10-10T21:21:19.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.865+0000 7fe2273ff700 1 -- start start 2023-10-10T21:21:19.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe2273ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200ac290 0x7fe22014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe2273ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe220157630 0x7fe2200afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe2273ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe220157a00 0x7fe2200c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe2273ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22014dfa0 con 0x7fe2200ac290 2023-10-10T21:21:19.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe2273ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200b0210 con 0x7fe220157630 2023-10-10T21:21:19.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe2273ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe220159f70 con 0x7fe220157a00 2023-10-10T21:21:19.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22519b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200ac290 0x7fe22014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22519b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200ac290 0x7fe22014da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35592/0 (socket says 172.21.15.154:35592) 2023-10-10T21:21:19.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22519b700 1 -- 172.21.15.154:0/502607887 learned_addr learned my addr 172.21.15.154:0/502607887 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:19.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22599c700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe220157a00 0x7fe2200c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22499a700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe220157630 0x7fe2200afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22519b700 1 -- 172.21.15.154:0/502607887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe220157a00 msgr2=0x7fe2200c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22519b700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe220157a00 0x7fe2200c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22519b700 1 -- 172.21.15.154:0/502607887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe220157630 msgr2=0x7fe2200afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:19.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22519b700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe220157630 0x7fe2200afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:19.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.866+0000 7fe22519b700 1 -- 172.21.15.154:0/502607887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c009420 con 0x7fe2200ac290 2023-10-10T21:21:19.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.867+0000 7fe22519b700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200ac290 0x7fe22014da60 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fe22006a9e0 tx=0x7fe21c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:19.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.867+0000 7fe2157fa700 1 -- 172.21.15.154:0/502607887 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c011420 con 0x7fe2200ac290 2023-10-10T21:21:19.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.867+0000 7fe2157fa700 1 -- 172.21.15.154:0/502607887 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c011580 con 0x7fe2200ac290 2023-10-10T21:21:19.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.867+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2201682c0 con 0x7fe2200ac290 2023-10-10T21:21:19.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.867+0000 7fe2157fa700 1 -- 172.21.15.154:0/502607887 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c011940 con 0x7fe2200ac290 2023-10-10T21:21:19.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.867+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe220168880 con 0x7fe2200ac290 2023-10-10T21:21:19.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.868+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2200718b0 con 0x7fe2200ac290 2023-10-10T21:21:19.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.869+0000 7fe2157fa700 1 -- 172.21.15.154:0/502607887 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe21c011d30 con 0x7fe2200ac290 2023-10-10T21:21:19.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.870+0000 7fe2157fa700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe204066f30 0x7fe2040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:19.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.870+0000 7fe2157fa700 1 -- 172.21.15.154:0/502607887 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5643+0+0 (secure 0 0 0) 0x7fe21c086310 con 0x7fe2200ac290 2023-10-10T21:21:19.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.870+0000 7fe22499a700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe204066f30 0x7fe2040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:19.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.871+0000 7fe22499a700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe204066f30 0x7fe2040693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2200b05b0 tx=0x7fe210008040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:19.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:19.874+0000 7fe2157fa700 1 -- 172.21.15.154:0/502607887 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe21c0535a0 con 0x7fe2200ac290 2023-10-10T21:21:20.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.064+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe2200aca80 con 0x7fe2200ac290 2023-10-10T21:21:20.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:21:20.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:21:20.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.630+0000 7fe2157fa700 1 -- 172.21.15.154:0/502607887 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v137) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe21c056bc0 con 0x7fe2200ac290 2023-10-10T21:21:20.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.640+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe204066f30 msgr2=0x7fe2040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:20.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.640+0000 7fe2273ff700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe204066f30 0x7fe2040693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2200b05b0 tx=0x7fe210008040 comp rx=0 tx=0).stop 2023-10-10T21:21:20.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.640+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200ac290 msgr2=0x7fe22014da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:20.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.640+0000 7fe2273ff700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200ac290 0x7fe22014da60 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fe22006a9e0 tx=0x7fe21c017000 comp rx=0 tx=0).stop 2023-10-10T21:21:20.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.644+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 shutdown_connections 2023-10-10T21:21:20.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.644+0000 7fe2273ff700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe220157a00 0x7fe2200c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:20.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.644+0000 7fe2273ff700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe204066f30 0x7fe2040693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:20.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.644+0000 7fe2273ff700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2200ac290 0x7fe22014da60 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:20.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.644+0000 7fe2273ff700 1 --2- 172.21.15.154:0/502607887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe220157630 0x7fe2200afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:20.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.644+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 >> 172.21.15.154:0/502607887 conn(0x7fe2200cc540 msgr2=0x7fe2200ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:20.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.646+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 shutdown_connections 2023-10-10T21:21:20.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.647+0000 7fe2273ff700 1 -- 172.21.15.154:0/502607887 wait complete. 2023-10-10T21:21:20.653 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T21:21:20.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T21:21:20.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.857+0000 7f32cbfff700 1 Processor -- start 2023-10-10T21:21:20.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.858+0000 7f32cbfff700 1 -- start start 2023-10-10T21:21:20.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.859+0000 7f32cbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32cc159a10 0x7f32cc0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.859+0000 7f32cbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32cc0aac80 0x7f32cc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.859+0000 7f32cbfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32cc15aa30 con 0x7f32cc0c81e0 2023-10-10T21:21:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.859+0000 7f32cbfff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32cc0caee0 con 0x7f32cc0aac80 2023-10-10T21:21:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.859+0000 7f32cbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc0c7db0 con 0x7f32cc159a10 2023-10-10T21:21:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.859+0000 7f32cb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32cc0aac80 0x7f32cc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.859+0000 7f32ca7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f32cc0c81e0 0x7f32cc159de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49438/0 (socket says 172.21.15.154:49438) 2023-10-10T21:21:20.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.859+0000 7f32ca7fc700 1 -- 172.21.15.154:0/1978089260 learned_addr learned my addr 172.21.15.154:0/1978089260 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:20.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.859+0000 7f32caffd700 1 --2- 172.21.15.154:0/1978089260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32cc159a10 0x7f32cc0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.860+0000 7f32cb7fe700 1 -- 172.21.15.154:0/1978089260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32cc159a10 msgr2=0x7f32cc0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.860+0000 7f32cb7fe700 1 --2- 172.21.15.154:0/1978089260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32cc159a10 0x7f32cc0ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.860+0000 7f32cb7fe700 1 -- 172.21.15.154:0/1978089260 >> v1:172.21.15.154:6789/0 conn(0x7f32cc0c81e0 legacy=0x7f32cc159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.860+0000 7f32cb7fe700 1 -- 172.21.15.154:0/1978089260 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0c89a0 con 0x7f32cc0aac80 2023-10-10T21:21:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.860+0000 7f32c9ffb700 1 -- 172.21.15.154:0/1978089260 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724823411 0 0) 0x7f32cc15aa30 con 0x7f32cc0c81e0 2023-10-10T21:21:20.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.860+0000 7f32cb7fe700 1 --2- 172.21.15.154:0/1978089260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc0aac80 0x7f32cc15a4f0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009e60 tx=0x7f32c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d384171bbc056b8c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:20.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.860+0000 7f32c9ffb700 1 -- 172.21.15.154:0/1978089260 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c400e070 con 0x7f32cc0aac80 2023-10-10T21:21:20.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.860+0000 7f32c9ffb700 1 -- 172.21.15.154:0/1978089260 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c400bb60 con 0x7f32cc0aac80 2023-10-10T21:21:20.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.860+0000 7f32c9ffb700 1 -- 172.21.15.154:0/1978089260 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4012430 con 0x7f32cc0aac80 2023-10-10T21:21:20.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.861+0000 7f32cbfff700 1 -- 172.21.15.154:0/1978089260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc0aac80 msgr2=0x7f32cc15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:20.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.861+0000 7f32cbfff700 1 --2- 172.21.15.154:0/1978089260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc0aac80 0x7f32cc15a4f0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009e60 tx=0x7f32c4009780 comp rx=0 tx=0).stop 2023-10-10T21:21:20.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.861+0000 7f32cbfff700 1 -- 172.21.15.154:0/1978089260 shutdown_connections 2023-10-10T21:21:20.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.861+0000 7f32cbfff700 1 --2- 172.21.15.154:0/1978089260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc0aac80 0x7f32cc15a4f0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:20.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.861+0000 7f32cbfff700 1 --2- 172.21.15.154:0/1978089260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32cc159a10 0x7f32cc0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:20.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.861+0000 7f32cbfff700 1 -- 172.21.15.154:0/1978089260 >> 172.21.15.154:0/1978089260 conn(0x7f32cc0cc1e0 msgr2=0x7f32cc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.861+0000 7f32cbfff700 1 -- 172.21.15.154:0/1978089260 shutdown_connections 2023-10-10T21:21:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.861+0000 7f32cbfff700 1 -- 172.21.15.154:0/1978089260 wait complete. 2023-10-10T21:21:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.862+0000 7f32cbfff700 1 Processor -- start 2023-10-10T21:21:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.863+0000 7f32cbfff700 1 -- start start 2023-10-10T21:21:20.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.863+0000 7f32cbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32cc0aac80 0x7f32cc155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:20.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.863+0000 7f32cbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32cc0c81e0 0x7f32cc158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.863+0000 7f32cbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc159a10 0x7f32cc1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.863+0000 7f32cbfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc158ca0 con 0x7f32cc159a10 2023-10-10T21:21:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.863+0000 7f32cbfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc0ac660 con 0x7f32cc0c81e0 2023-10-10T21:21:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.863+0000 7f32cbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc16d960 con 0x7f32cc0aac80 2023-10-10T21:21:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.864+0000 7f32cb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc159a10 0x7f32cc1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.864+0000 7f32cb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc159a10 0x7f32cc1508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35616/0 (socket says 172.21.15.154:35616) 2023-10-10T21:21:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.864+0000 7f32cb7fe700 1 -- 172.21.15.154:0/261186010 learned_addr learned my addr 172.21.15.154:0/261186010 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.864+0000 7f32cb7fe700 1 -- 172.21.15.154:0/261186010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32cc0aac80 msgr2=0x7f32cc155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.864+0000 7f32cb7fe700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32cc0aac80 0x7f32cc155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.864+0000 7f32cb7fe700 1 -- 172.21.15.154:0/261186010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32cc0c81e0 msgr2=0x7f32cc158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.864+0000 7f32cb7fe700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32cc0c81e0 0x7f32cc158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.864+0000 7f32cb7fe700 1 -- 172.21.15.154:0/261186010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c4009a20 con 0x7f32cc159a10 2023-10-10T21:21:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.864+0000 7f32cb7fe700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc159a10 0x7f32cc1508d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f32cc06ce80 tx=0x7f32c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:20.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.865+0000 7f32b2ffd700 1 -- 172.21.15.154:0/261186010 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4027470 con 0x7f32cc159a10 2023-10-10T21:21:20.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.865+0000 7f32b2ffd700 1 -- 172.21.15.154:0/261186010 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c4027610 con 0x7f32cc159a10 2023-10-10T21:21:20.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.865+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32cc158eb0 con 0x7f32cc159a10 2023-10-10T21:21:20.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.865+0000 7f32b2ffd700 1 -- 172.21.15.154:0/261186010 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c40279d0 con 0x7f32cc159a10 2023-10-10T21:21:20.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.865+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc16d5f0 con 0x7f32cc159a10 2023-10-10T21:21:20.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.866+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32cc06c450 con 0x7f32cc159a10 2023-10-10T21:21:20.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.867+0000 7f32b2ffd700 1 -- 172.21.15.154:0/261186010 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32c4024070 con 0x7f32cc159a10 2023-10-10T21:21:20.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.868+0000 7f32b2ffd700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32b8066f30 0x7f32b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:20.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.868+0000 7f32b2ffd700 1 -- 172.21.15.154:0/261186010 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f32c4087530 con 0x7f32cc159a10 2023-10-10T21:21:20.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.868+0000 7f32caffd700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32b8066f30 0x7f32b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:20.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.869+0000 7f32caffd700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32b8066f30 0x7f32b80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009b10 tx=0x7f32bc0091a0 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:20.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:20.871+0000 7f32b2ffd700 1 -- 172.21.15.154:0/261186010 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32c40546e0 con 0x7f32cc159a10 2023-10-10T21:21:21.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.105+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f32cc0c7510 con 0x7f32cc159a10 2023-10-10T21:21:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.654+0000 7f32b2ffd700 1 -- 172.21.15.154:0/261186010 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v58) v1 ==== 174+0+0 (secure 0 0 0) 0x7f32c4057d00 con 0x7f32cc159a10 2023-10-10T21:21:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.666+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32b8066f30 msgr2=0x7f32b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.666+0000 7f32cbfff700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32b8066f30 0x7f32b80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009b10 tx=0x7f32bc0091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.666+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc159a10 msgr2=0x7f32cc1508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.666+0000 7f32cbfff700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc159a10 0x7f32cc1508d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f32cc06ce80 tx=0x7f32c4019000 comp rx=0 tx=0).stop 2023-10-10T21:21:21.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.671+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 shutdown_connections 2023-10-10T21:21:21.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.671+0000 7f32cbfff700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32b8066f30 0x7f32b80693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.671+0000 7f32cbfff700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc159a10 0x7f32cc1508d0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.671+0000 7f32cbfff700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32cc0aac80 0x7f32cc155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.671+0000 7f32cbfff700 1 --2- 172.21.15.154:0/261186010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32cc0c81e0 0x7f32cc158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.671+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 >> 172.21.15.154:0/261186010 conn(0x7f32cc0cc1e0 msgr2=0x7f32cc152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:21.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.673+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 shutdown_connections 2023-10-10T21:21:21.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.673+0000 7f32cbfff700 1 -- 172.21.15.154:0/261186010 wait complete. 2023-10-10T21:21:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 16 and data pool 17 2023-10-10T21:21:21.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:21:21.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.877+0000 7ff01659d700 1 Processor -- start 2023-10-10T21:21:21.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.877+0000 7ff01659d700 1 -- start start 2023-10-10T21:21:21.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.878+0000 7ff01659d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff010150550 0x7ff010157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:21.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.878+0000 7ff01659d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01006e2a0 con 0x7ff010150180 2023-10-10T21:21:21.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.878+0000 7ff01659d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01006b2e0 con 0x7ff0100c7410 2023-10-10T21:21:21.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.878+0000 7ff01659d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0100c78e0 con 0x7ff010150550 2023-10-10T21:21:21.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.878+0000 7ff01559b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff010150180 0x7ff0100c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49450/0 (socket says 172.21.15.154:49450) 2023-10-10T21:21:21.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.878+0000 7ff01559b700 1 -- 172.21.15.154:0/3431858739 learned_addr learned my addr 172.21.15.154:0/3431858739 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:21.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff014d9a700 1 --2- 172.21.15.154:0/3431858739 >> v2:172.21.15.179:3300/0 conn(0x7ff010150550 0x7ff010157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:21.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965770557 0 0) 0x7ff01006e2a0 con 0x7ff010150180 2023-10-10T21:21:21.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feffc003570 con 0x7ff010150180 2023-10-10T21:21:21.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 140652716 0 0) 0x7feffc003570 con 0x7ff010150180 2023-10-10T21:21:21.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 >> v2:172.21.15.179:3300/0 conn(0x7ff010150550 msgr2=0x7ff010157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 --2- 172.21.15.154:0/3431858739 >> v2:172.21.15.179:3300/0 conn(0x7ff010150550 0x7ff010157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 >> v1:172.21.15.179:6789/0 conn(0x7ff0100c7410 legacy=0x7ff010069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100c7bc0 con 0x7ff010150180 2023-10-10T21:21:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7ff00c001470 con 0x7ff010150180 2023-10-10T21:21:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 >> v1:172.21.15.154:6789/0 conn(0x7ff010150180 legacy=0x7ff0100c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:21.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7feffc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:21.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feffc004810 0x7feffc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:21.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feffc005210 0x7feffc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:21.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100c78e0 con 0x7feffc003ab0 2023-10-10T21:21:21.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc00c130 con 0x7feffc005210 2023-10-10T21:21:21.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.879+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc00c2f0 con 0x7feffc004810 2023-10-10T21:21:21.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff01559b700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7feffc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:21.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff015d9c700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feffc005210 0x7feffc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:21.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff014d9a700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feffc004810 0x7feffc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:21.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff01559b700 1 -- 172.21.15.154:0/3431858739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feffc004810 msgr2=0x7feffc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:21.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff01559b700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feffc004810 0x7feffc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff01559b700 1 -- 172.21.15.154:0/3431858739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feffc005210 msgr2=0x7feffc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:21.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff01559b700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feffc005210 0x7feffc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff015d9c700 1 -- 172.21.15.154:0/3431858739 reap_dead start 2023-10-10T21:21:21.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff01559b700 1 -- 172.21.15.154:0/3431858739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc003570 con 0x7feffc003ab0 2023-10-10T21:21:21.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.880+0000 7ff01559b700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7feffc003ec0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c2d0 tx=0x7ff00c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b8887a5d2e7ef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:21.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00cba0 con 0x7feffc003ab0 2023-10-10T21:21:21.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c00cd20 con 0x7feffc003ab0 2023-10-10T21:21:21.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff007fff700 1 -- 172.21.15.154:0/3431858739 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c005b70 con 0x7feffc003ab0 2023-10-10T21:21:21.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff01659d700 1 -- 172.21.15.154:0/3431858739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 msgr2=0x7feffc003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:21.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff01659d700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7feffc003ec0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c2d0 tx=0x7ff00c001d80 comp rx=0 tx=0).stop 2023-10-10T21:21:21.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff01659d700 1 -- 172.21.15.154:0/3431858739 shutdown_connections 2023-10-10T21:21:21.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff01659d700 1 --2- 172.21.15.154:0/3431858739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7feffc003ec0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff01659d700 1 -- 172.21.15.154:0/3431858739 >> 172.21.15.154:0/3431858739 conn(0x7ff0100cc1f0 msgr2=0x7ff0100cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:21.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff01659d700 1 -- 172.21.15.154:0/3431858739 shutdown_connections 2023-10-10T21:21:21.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.881+0000 7ff01659d700 1 -- 172.21.15.154:0/3431858739 wait complete. 2023-10-10T21:21:21.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.883+0000 7ff01659d700 1 Processor -- start 2023-10-10T21:21:21.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.883+0000 7ff01659d700 1 -- start start 2023-10-10T21:21:21.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01659d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7ff01016d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:21.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0100c0f90 0x7ff010169160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:21.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01659d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff010158490 0x7ff010154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:21.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01659d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100b0820 con 0x7feffc003ab0 2023-10-10T21:21:21.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01659d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100c1750 con 0x7ff010158490 2023-10-10T21:21:21.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100c1a30 con 0x7ff0100c0f90 2023-10-10T21:21:21.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01559b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7ff01016d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:21.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01559b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7ff01016d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35634/0 (socket says 172.21.15.154:35634) 2023-10-10T21:21:21.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01559b700 1 -- 172.21.15.154:0/1796305710 learned_addr learned my addr 172.21.15.154:0/1796305710 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:21.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01559b700 1 -- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0100c0f90 msgr2=0x7ff010169160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:21.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff015d9c700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff010158490 0x7ff010154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:21.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff014d9a700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0100c0f90 0x7ff010169160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:21.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01559b700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0100c0f90 0x7ff010169160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01559b700 1 -- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff010158490 msgr2=0x7ff010154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:21.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01559b700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff010158490 0x7ff010154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:21.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff01559b700 1 -- 172.21.15.154:0/1796305710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100c1d10 con 0x7feffc003ab0 2023-10-10T21:21:21.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff015d9c700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff010158490 0x7ff010154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:21.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.884+0000 7ff014d9a700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0100c0f90 0x7ff010169160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:21.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.885+0000 7ff01559b700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7ff01016d940 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c8c0 tx=0x7ff00c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:21.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.885+0000 7ff0057fa700 1 -- 172.21.15.154:0/1796305710 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c022070 con 0x7feffc003ab0 2023-10-10T21:21:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.885+0000 7ff0057fa700 1 -- 172.21.15.154:0/1796305710 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c000bc0 con 0x7feffc003ab0 2023-10-10T21:21:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.885+0000 7ff0057fa700 1 -- 172.21.15.154:0/1796305710 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c007320 con 0x7feffc003ab0 2023-10-10T21:21:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.885+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0101696a0 con 0x7feffc003ab0 2023-10-10T21:21:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.885+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff010158900 con 0x7feffc003ab0 2023-10-10T21:21:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.886+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0100b0a90 con 0x7feffc003ab0 2023-10-10T21:21:21.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.887+0000 7ff0057fa700 1 -- 172.21.15.154:0/1796305710 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff00c01e430 con 0x7feffc003ab0 2023-10-10T21:21:21.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.888+0000 7ff0057fa700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7feff4066f30 0x7feff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:21.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.888+0000 7ff0057fa700 1 -- 172.21.15.154:0/1796305710 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6125+0+0 (secure 0 0 0) 0x7ff00c085a50 con 0x7feffc003ab0 2023-10-10T21:21:21.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.888+0000 7ff014d9a700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7feff4066f30 0x7feff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:21.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.888+0000 7ff014d9a700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7feff4066f30 0x7feff40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff000006dc0 tx=0x7ff000008040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:21.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:21.892+0000 7ff0057fa700 1 -- 172.21.15.154:0/1796305710 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff00c052b20 con 0x7feffc003ab0 2023-10-10T21:21:22.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.084+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0100b0a90 con 0x7feffc003ab0 2023-10-10T21:21:22.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.085+0000 7ff0057fa700 1 -- 172.21.15.154:0/1796305710 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16065 (secure 0 0 0) 0x7ff00c017070 con 0x7feffc003ab0 2023-10-10T21:21:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:22.086 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":138,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:21:21.106962+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:21:19.349593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-10T21:21:20.103524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:21:22.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7feff4066f30 msgr2=0x7feff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7feff4066f30 0x7feff40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff000006dc0 tx=0x7ff000008040 comp rx=0 tx=0).stop 2023-10-10T21:21:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 msgr2=0x7ff01016d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7ff01016d940 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c8c0 tx=0x7ff00c015000 comp rx=0 tx=0).stop 2023-10-10T21:21:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 shutdown_connections 2023-10-10T21:21:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff010158490 0x7ff010154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7feff4066f30 0x7feff40693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feffc003ab0 0x7ff01016d940 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 --2- 172.21.15.154:0/1796305710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0100c0f90 0x7ff010169160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 >> 172.21.15.154:0/1796305710 conn(0x7ff0100cc1f0 msgr2=0x7ff0100adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 shutdown_connections 2023-10-10T21:21:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.087+0000 7ff01659d700 1 -- 172.21.15.154:0/1796305710 wait complete. 2023-10-10T21:21:22.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:21:22.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.287+0000 7fc0fe39d700 1 Processor -- start 2023-10-10T21:21:22.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.287+0000 7fc0fe39d700 1 -- start start 2023-10-10T21:21:22.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.288+0000 7fc0fe39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0f8159420 0x7fc0f80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.288+0000 7fc0fe39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc0f815d230 0x7fc0f815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.288+0000 7fc0fe39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80b2980 con 0x7fc0f81597f0 2023-10-10T21:21:22.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.288+0000 7fc0fe39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f815db70 con 0x7fc0f8159420 2023-10-10T21:21:22.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.288+0000 7fc0fe39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f80b11d0 con 0x7fc0f815d230 2023-10-10T21:21:22.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0fd39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0f8159420 0x7fc0f80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0fcb9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc0f81597f0 0x7fc0f80b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49452/0 (socket says 172.21.15.154:49452) 2023-10-10T21:21:22.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0fcb9a700 1 -- 172.21.15.154:0/107184993 learned_addr learned my addr 172.21.15.154:0/107184993 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:22.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0fdb9c700 1 --2- 172.21.15.154:0/107184993 >> v2:172.21.15.179:3300/0 conn(0x7fc0f815d230 0x7fc0f815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0fd39b700 1 -- 172.21.15.154:0/107184993 >> v2:172.21.15.179:3300/0 conn(0x7fc0f815d230 msgr2=0x7fc0f815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:22.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0fd39b700 1 --2- 172.21.15.154:0/107184993 >> v2:172.21.15.179:3300/0 conn(0x7fc0f815d230 0x7fc0f815d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0fd39b700 1 -- 172.21.15.154:0/107184993 >> v1:172.21.15.154:6789/0 conn(0x7fc0f81597f0 legacy=0x7fc0f80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0fd39b700 1 -- 172.21.15.154:0/107184993 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80b14b0 con 0x7fc0f8159420 2023-10-10T21:21:22.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0effff700 1 -- 172.21.15.154:0/107184993 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960807746 0 0) 0x7fc0f80b2980 con 0x7fc0f81597f0 2023-10-10T21:21:22.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.289+0000 7fc0fd39b700 1 --2- 172.21.15.154:0/107184993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 0x7fc0f80b5f40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fc0f815d170 tx=0x7fc0f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c53f551c6d84f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:22.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0effff700 1 -- 172.21.15.154:0/107184993 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400b6b0 con 0x7fc0f8159420 2023-10-10T21:21:22.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0effff700 1 -- 172.21.15.154:0/107184993 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f400b810 con 0x7fc0f8159420 2023-10-10T21:21:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0effff700 1 -- 172.21.15.154:0/107184993 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400bbb0 con 0x7fc0f8159420 2023-10-10T21:21:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0fe39d700 1 -- 172.21.15.154:0/107184993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 msgr2=0x7fc0f80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0fe39d700 1 --2- 172.21.15.154:0/107184993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 0x7fc0f80b5f40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fc0f815d170 tx=0x7fc0f40091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0fe39d700 1 -- 172.21.15.154:0/107184993 shutdown_connections 2023-10-10T21:21:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0fe39d700 1 --2- 172.21.15.154:0/107184993 >> v2:172.21.15.179:3300/0 conn(0x7fc0f815d230 0x7fc0f815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0fe39d700 1 --2- 172.21.15.154:0/107184993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 0x7fc0f80b5f40 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0fe39d700 1 -- 172.21.15.154:0/107184993 >> 172.21.15.154:0/107184993 conn(0x7fc0f80d0660 msgr2=0x7fc0f80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:22.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0fe39d700 1 -- 172.21.15.154:0/107184993 shutdown_connections 2023-10-10T21:21:22.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.290+0000 7fc0fe39d700 1 -- 172.21.15.154:0/107184993 wait complete. 2023-10-10T21:21:22.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.292+0000 7fc0fe39d700 1 Processor -- start 2023-10-10T21:21:22.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.292+0000 7fc0fe39d700 1 -- start start 2023-10-10T21:21:22.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fe39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 0x7fc0f81550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fe39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f81597f0 0x7fc0f80c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fe39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f815d230 0x7fc0f80c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fe39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8160000 con 0x7fc0f8159420 2023-10-10T21:21:22.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fe39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f81555f0 con 0x7fc0f815d230 2023-10-10T21:21:22.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fe39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f815f3f0 con 0x7fc0f81597f0 2023-10-10T21:21:22.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fd39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 0x7fc0f81550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fd39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 0x7fc0f81550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35654/0 (socket says 172.21.15.154:35654) 2023-10-10T21:21:22.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fd39b700 1 -- 172.21.15.154:0/1318950453 learned_addr learned my addr 172.21.15.154:0/1318950453 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:22.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fd39b700 1 -- 172.21.15.154:0/1318950453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f81597f0 msgr2=0x7fc0f80c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fd39b700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f81597f0 0x7fc0f80c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fd39b700 1 -- 172.21.15.154:0/1318950453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f815d230 msgr2=0x7fc0f80c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fd39b700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f815d230 0x7fc0f80c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.293+0000 7fc0fd39b700 1 -- 172.21.15.154:0/1318950453 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4009420 con 0x7fc0f8159420 2023-10-10T21:21:22.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.294+0000 7fc0fd39b700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 0x7fc0f81550b0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8089340 tx=0x7fc0f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:22.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.294+0000 7fc0ed7fa700 1 -- 172.21.15.154:0/1318950453 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4011420 con 0x7fc0f8159420 2023-10-10T21:21:22.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.294+0000 7fc0ed7fa700 1 -- 172.21.15.154:0/1318950453 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f4011580 con 0x7fc0f8159420 2023-10-10T21:21:22.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.294+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f815f6d0 con 0x7fc0f8159420 2023-10-10T21:21:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.294+0000 7fc0ed7fa700 1 -- 172.21.15.154:0/1318950453 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4011940 con 0x7fc0f8159420 2023-10-10T21:21:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.294+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f815fc90 con 0x7fc0f8159420 2023-10-10T21:21:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.295+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f8160370 con 0x7fc0f8159420 2023-10-10T21:21:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.296+0000 7fc0ed7fa700 1 -- 172.21.15.154:0/1318950453 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0f4011d30 con 0x7fc0f8159420 2023-10-10T21:21:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.297+0000 7fc0ed7fa700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0dc066f30 0x7fc0dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.297+0000 7fc0ed7fa700 1 -- 172.21.15.154:0/1318950453 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fc0f4086130 con 0x7fc0f8159420 2023-10-10T21:21:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.297+0000 7fc0fcb9a700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0dc066f30 0x7fc0dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.298+0000 7fc0fcb9a700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0dc066f30 0x7fc0dc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80011e0 tx=0x7fc0e80079d0 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.301+0000 7fc0ed7fa700 1 -- 172.21.15.154:0/1318950453 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0f4053200 con 0x7fc0f8159420 2023-10-10T21:21:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.492+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0f804c3c0 con 0x7fc0f8159420 2023-10-10T21:21:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.493+0000 7fc0ed7fa700 1 -- 172.21.15.154:0/1318950453 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16065 (secure 0 0 0) 0x7fc0f4056820 con 0x7fc0f8159420 2023-10-10T21:21:22.494 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:22.495 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":138,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:21:21.106962+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:21:19.349593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-10T21:21:20.103524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:21:22.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.495+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0dc066f30 msgr2=0x7fc0dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.495+0000 7fc0fe39d700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0dc066f30 0x7fc0dc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80011e0 tx=0x7fc0e80079d0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.495+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 msgr2=0x7fc0f81550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.495+0000 7fc0fe39d700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 0x7fc0f81550b0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8089340 tx=0x7fc0f4017000 comp rx=0 tx=0).stop 2023-10-10T21:21:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.496+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 shutdown_connections 2023-10-10T21:21:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.496+0000 7fc0fe39d700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f815d230 0x7fc0f80c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.496+0000 7fc0fe39d700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0dc066f30 0x7fc0dc0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.496+0000 7fc0fe39d700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8159420 0x7fc0f81550b0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.496+0000 7fc0fe39d700 1 --2- 172.21.15.154:0/1318950453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f81597f0 0x7fc0f80c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.496+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 >> 172.21.15.154:0/1318950453 conn(0x7fc0f80d0660 msgr2=0x7fc0f8155880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.496+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 shutdown_connections 2023-10-10T21:21:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.496+0000 7fc0fe39d700 1 -- 172.21.15.154:0/1318950453 wait complete. 2023-10-10T21:21:22.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T21:21:22.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.704+0000 7f9cf8d9d700 1 Processor -- start 2023-10-10T21:21:22.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.704+0000 7f9cf8d9d700 1 -- start start 2023-10-10T21:21:22.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.705+0000 7f9cf8d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cf4140bb0 0x7f9cf406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.705+0000 7f9cf8d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9cf406da30 0x7f9cf40c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.705+0000 7f9cf8d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf40c6820 con 0x7f9cf41407e0 2023-10-10T21:21:22.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.705+0000 7f9cf8d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf406deb0 con 0x7f9cf4140bb0 2023-10-10T21:21:22.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.705+0000 7f9cf8d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf40c6de0 con 0x7f9cf406da30 2023-10-10T21:21:22.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.705+0000 7f9cf2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cf4140bb0 0x7f9cf406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.705+0000 7f9cf2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cf4140bb0 0x7f9cf406d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35670/0 (socket says 172.21.15.154:35670) 2023-10-10T21:21:22.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.705+0000 7f9cf2ffd700 1 -- 172.21.15.154:0/3296470916 learned_addr learned my addr 172.21.15.154:0/3296470916 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.706+0000 7f9cf3fff700 1 --2- 172.21.15.154:0/3296470916 >> v2:172.21.15.179:3300/0 conn(0x7f9cf406da30 0x7f9cf40c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.706+0000 7f9cf2ffd700 1 -- 172.21.15.154:0/3296470916 >> v2:172.21.15.179:3300/0 conn(0x7f9cf406da30 msgr2=0x7f9cf40c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.706+0000 7f9cf2ffd700 1 --2- 172.21.15.154:0/3296470916 >> v2:172.21.15.179:3300/0 conn(0x7f9cf406da30 0x7f9cf40c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.706+0000 7f9cf2ffd700 1 -- 172.21.15.154:0/3296470916 >> v1:172.21.15.179:6789/0 conn(0x7f9cf41407e0 legacy=0x7f9cf406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.706+0000 7f9cf2ffd700 1 -- 172.21.15.154:0/3296470916 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4141270 con 0x7f9cf4140bb0 2023-10-10T21:21:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.706+0000 7f9cf2ffd700 1 --2- 172.21.15.154:0/3296470916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf4140bb0 0x7f9cf406d4f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40aed40 tx=0x7f9ce8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fd51a03400c921 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.706+0000 7f9cf27fc700 1 -- 172.21.15.154:0/3296470916 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800b860 con 0x7f9cf4140bb0 2023-10-10T21:21:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.706+0000 7f9cf27fc700 1 -- 172.21.15.154:0/3296470916 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce800b9c0 con 0x7f9cf4140bb0 2023-10-10T21:21:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.706+0000 7f9cf27fc700 1 -- 172.21.15.154:0/3296470916 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800bd60 con 0x7f9cf4140bb0 2023-10-10T21:21:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.707+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/3296470916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf4140bb0 msgr2=0x7f9cf406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.707+0000 7f9cf8d9d700 1 --2- 172.21.15.154:0/3296470916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf4140bb0 0x7f9cf406d4f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40aed40 tx=0x7f9ce8009250 comp rx=0 tx=0).stop 2023-10-10T21:21:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.707+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/3296470916 shutdown_connections 2023-10-10T21:21:22.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.707+0000 7f9cf8d9d700 1 --2- 172.21.15.154:0/3296470916 >> v2:172.21.15.179:3300/0 conn(0x7f9cf406da30 0x7f9cf40c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.707+0000 7f9cf8d9d700 1 --2- 172.21.15.154:0/3296470916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf4140bb0 0x7f9cf406d4f0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.707+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/3296470916 >> 172.21.15.154:0/3296470916 conn(0x7f9cf40cc1e0 msgr2=0x7f9cf40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:22.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.707+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/3296470916 shutdown_connections 2023-10-10T21:21:22.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.707+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/3296470916 wait complete. 2023-10-10T21:21:22.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.708+0000 7f9cf8d9d700 1 Processor -- start 2023-10-10T21:21:22.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.709+0000 7f9cf8d9d700 1 -- start start 2023-10-10T21:21:22.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.709+0000 7f9cf8d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf406da30 0x7f9cf4130480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.709+0000 7f9cf8d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cf41407e0 0x7f9cf41309c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf8d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cf4140bb0 0x7f9cf416d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf8d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40cb6f0 con 0x7f9cf406da30 2023-10-10T21:21:22.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf8d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf416b1b0 con 0x7f9cf41407e0 2023-10-10T21:21:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf8d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40cb130 con 0x7f9cf4140bb0 2023-10-10T21:21:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf406da30 0x7f9cf4130480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf406da30 0x7f9cf4130480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35682/0 (socket says 172.21.15.154:35682) 2023-10-10T21:21:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf37fe700 1 -- 172.21.15.154:0/695613660 learned_addr learned my addr 172.21.15.154:0/695613660 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf3fff700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cf4140bb0 0x7f9cf416d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf2ffd700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cf41407e0 0x7f9cf41309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf37fe700 1 -- 172.21.15.154:0/695613660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cf4140bb0 msgr2=0x7f9cf416d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf37fe700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cf4140bb0 0x7f9cf416d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf37fe700 1 -- 172.21.15.154:0/695613660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cf41407e0 msgr2=0x7f9cf41309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:22.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf37fe700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cf41407e0 0x7f9cf41309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:22.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.710+0000 7f9cf37fe700 1 -- 172.21.15.154:0/695613660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80094f0 con 0x7f9cf406da30 2023-10-10T21:21:22.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.711+0000 7f9cf37fe700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf406da30 0x7f9cf4130480 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c5c0 tx=0x7f9ce400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:22.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.711+0000 7f9cdb7fe700 1 -- 172.21.15.154:0/695613660 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4011590 con 0x7f9cf406da30 2023-10-10T21:21:22.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.711+0000 7f9cdb7fe700 1 -- 172.21.15.154:0/695613660 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4011710 con 0x7f9cf406da30 2023-10-10T21:21:22.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.711+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf40cb410 con 0x7f9cf406da30 2023-10-10T21:21:22.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.711+0000 7f9cdb7fe700 1 -- 172.21.15.154:0/695613660 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4011ad0 con 0x7f9cf406da30 2023-10-10T21:21:22.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.711+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf413f560 con 0x7f9cf406da30 2023-10-10T21:21:22.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.712+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf413f750 con 0x7f9cf406da30 2023-10-10T21:21:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.713+0000 7f9cdb7fe700 1 -- 172.21.15.154:0/695613660 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ce401b3b0 con 0x7f9cf406da30 2023-10-10T21:21:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.714+0000 7f9cdb7fe700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.714+0000 7f9cdb7fe700 1 -- 172.21.15.154:0/695613660 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f9ce4083cb0 con 0x7f9cf406da30 2023-10-10T21:21:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.714+0000 7f9cf2ffd700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.714+0000 7f9cf2ffd700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9ce0066f30 0x7f9ce00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40aed40 tx=0x7f9ce8017000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.718+0000 7f9cdb7fe700 1 -- 172.21.15.154:0/695613660 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ce4050d80 con 0x7f9cf406da30 2023-10-10T21:21:22.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:22.953+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9cf406acf0 con 0x7f9cf406da30 2023-10-10T21:21:23.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.663+0000 7f9cdb7fe700 1 -- 172.21.15.154:0/695613660 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9ce4017020 con 0x7f9cf406da30 2023-10-10T21:21:23.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9ce0066f30 msgr2=0x7f9ce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:23.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9ce0066f30 0x7f9ce00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40aed40 tx=0x7f9ce8017000 comp rx=0 tx=0).stop 2023-10-10T21:21:23.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf406da30 msgr2=0x7f9cf4130480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:23.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf406da30 0x7f9cf4130480 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c5c0 tx=0x7f9ce400c980 comp rx=0 tx=0).stop 2023-10-10T21:21:23.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 shutdown_connections 2023-10-10T21:21:23.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cf4140bb0 0x7f9cf416d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:23.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:23.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cf406da30 0x7f9cf4130480 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:23.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 --2- 172.21.15.154:0/695613660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cf41407e0 0x7f9cf41309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:23.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 >> 172.21.15.154:0/695613660 conn(0x7f9cf40cc1e0 msgr2=0x7f9cf40c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:23.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 shutdown_connections 2023-10-10T21:21:23.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.666+0000 7f9cf8d9d700 1 -- 172.21.15.154:0/695613660 wait complete. 2023-10-10T21:21:23.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T21:21:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.870+0000 7f8782fff700 1 Processor -- start 2023-10-10T21:21:23.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.870+0000 7f8782fff700 1 -- start start 2023-10-10T21:21:23.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.871+0000 7f8782fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877c0ccee0 0x7f877c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:23.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.871+0000 7f8782fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c15b0d0 con 0x7f877c0c83f0 2023-10-10T21:21:23.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.871+0000 7f8782fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c15a4c0 con 0x7f877c0c87c0 2023-10-10T21:21:23.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.871+0000 7f8782fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c15a7a0 con 0x7f877c0ccee0 2023-10-10T21:21:23.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f8780d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f877c0c83f0 0x7f877c0c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49462/0 (socket says 172.21.15.154:49462) 2023-10-10T21:21:23.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f8780d9b700 1 -- 172.21.15.154:0/1278085894 learned_addr learned my addr 172.21.15.154:0/1278085894 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:23.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399219626 0 0) 0x7f877c15b0d0 con 0x7f877c0c83f0 2023-10-10T21:21:23.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877bfff700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877c0ccee0 0x7f877c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:23.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f876c003570 con 0x7f877c0c83f0 2023-10-10T21:21:23.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 329788012 0 0) 0x7f876c003570 con 0x7f877c0c83f0 2023-10-10T21:21:23.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877c0ccee0 msgr2=0x7f877c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:23.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877b7fe700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877c0ccee0 0x7f877c1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:23.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 >> v1:172.21.15.179:6789/0 conn(0x7f877c0c87c0 legacy=0x7f877c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:23.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c15aa80 con 0x7f877c0c83f0 2023-10-10T21:21:23.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f8770001470 con 0x7f877c0c83f0 2023-10-10T21:21:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.872+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 >> v1:172.21.15.154:6789/0 conn(0x7f877c0c83f0 legacy=0x7f877c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f877b7fe700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876c003a90 0x7f876c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f877b7fe700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877c0ccee0 0x7f876c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f877b7fe700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f876c004d50 0x7f876c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:23.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c15a7a0 con 0x7f876c004d50 2023-10-10T21:21:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c00bbf0 con 0x7f876c003a90 2023-10-10T21:21:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c00bd80 con 0x7f877c0ccee0 2023-10-10T21:21:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f878159c700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f876c004d50 0x7f876c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f877bfff700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877c0ccee0 0x7f876c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:23.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f8780d9b700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876c003a90 0x7f876c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:23.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f878159c700 1 -- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877c0ccee0 msgr2=0x7f876c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:23.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f878159c700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877c0ccee0 0x7f876c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f878159c700 1 -- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876c003a90 msgr2=0x7f876c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f878159c700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876c003a90 0x7f876c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.873+0000 7f878159c700 1 -- 172.21.15.154:0/1278085894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c003570 con 0x7f876c004d50 2023-10-10T21:21:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f878159c700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f876c004d50 0x7f876c0051c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f8774001ff0 tx=0x7f8774001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333407e86d16fa87 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774001980 con 0x7f876c004d50 2023-10-10T21:21:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877400c8b0 con 0x7f876c004d50 2023-10-10T21:21:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f877b7fe700 1 -- 172.21.15.154:0/1278085894 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400cc50 con 0x7f876c004d50 2023-10-10T21:21:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f8782fff700 1 -- 172.21.15.154:0/1278085894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f876c004d50 msgr2=0x7f876c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f8782fff700 1 --2- 172.21.15.154:0/1278085894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f876c004d50 0x7f876c0051c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f8774001ff0 tx=0x7f8774001670 comp rx=0 tx=0).stop 2023-10-10T21:21:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f878159c700 1 -- 172.21.15.154:0/1278085894 reap_dead start 2023-10-10T21:21:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f8782fff700 1 -- 172.21.15.154:0/1278085894 shutdown_connections 2023-10-10T21:21:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f8782fff700 1 -- 172.21.15.154:0/1278085894 >> 172.21.15.154:0/1278085894 conn(0x7f877c068e10 msgr2=0x7f877c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.874+0000 7f8782fff700 1 -- 172.21.15.154:0/1278085894 shutdown_connections 2023-10-10T21:21:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.875+0000 7f8782fff700 1 -- 172.21.15.154:0/1278085894 wait complete. 2023-10-10T21:21:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.876+0000 7f8782fff700 1 Processor -- start 2023-10-10T21:21:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.876+0000 7f8782fff700 1 -- start start 2023-10-10T21:21:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f8782fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f876c004d50 0x7f877c142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f8782fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c158120 0x7f877c158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f8782fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f877c167ca0 0x7f877c168110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f8782fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c158ad0 con 0x7f877c158120 2023-10-10T21:21:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f8782fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c154190 con 0x7f877c167ca0 2023-10-10T21:21:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f8782fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c153580 con 0x7f876c004d50 2023-10-10T21:21:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f877bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c158120 0x7f877c158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f877bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c158120 0x7f877c158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35704/0 (socket says 172.21.15.154:35704) 2023-10-10T21:21:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f877bfff700 1 -- 172.21.15.154:0/419113972 learned_addr learned my addr 172.21.15.154:0/419113972 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:23.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f878159c700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f877c167ca0 0x7f877c168110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f8780d9b700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f876c004d50 0x7f877c142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f877bfff700 1 -- 172.21.15.154:0/419113972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f876c004d50 msgr2=0x7f877c142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.877+0000 7f877bfff700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f876c004d50 0x7f877c142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f877bfff700 1 -- 172.21.15.154:0/419113972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f877c167ca0 msgr2=0x7f877c168110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:23.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f877bfff700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f877c167ca0 0x7f877c168110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f877bfff700 1 -- 172.21.15.154:0/419113972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c153860 con 0x7f877c158120 2023-10-10T21:21:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f878159c700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f877c167ca0 0x7f877c168110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f877bfff700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c158120 0x7f877c158590 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f8768006ac0 tx=0x7f87680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f8778ff9700 1 -- 172.21.15.154:0/419113972 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800fa10 con 0x7f877c158120 2023-10-10T21:21:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f8778ff9700 1 -- 172.21.15.154:0/419113972 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876800fb70 con 0x7f877c158120 2023-10-10T21:21:23.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f8778ff9700 1 -- 172.21.15.154:0/419113972 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768014440 con 0x7f877c158120 2023-10-10T21:21:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c153b40 con 0x7f877c158120 2023-10-10T21:21:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.878+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c143500 con 0x7f877c158120 2023-10-10T21:21:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.879+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c04c3c0 con 0x7f877c158120 2023-10-10T21:21:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.880+0000 7f8778ff9700 1 -- 172.21.15.154:0/419113972 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8768014830 con 0x7f877c158120 2023-10-10T21:21:23.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.881+0000 7f8778ff9700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8760066f30 0x7f87600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:23.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.881+0000 7f8778ff9700 1 -- 172.21.15.154:0/419113972 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f8768018030 con 0x7f877c158120 2023-10-10T21:21:23.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.881+0000 7f8780d9b700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8760066f30 0x7f87600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:23.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.882+0000 7f8780d9b700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8760066f30 0x7f87600693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87700015a0 tx=0x7f8770009040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:23.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:23.885+0000 7f8778ff9700 1 -- 172.21.15.154:0/419113972 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8768052260 con 0x7f877c158120 2023-10-10T21:21:24.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.125+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f877c15ad60 con 0x7f877c158120 2023-10-10T21:21:24.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.669+0000 7f8778ff9700 1 -- 172.21.15.154:0/419113972 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8768055880 con 0x7f877c158120 2023-10-10T21:21:24.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8760066f30 msgr2=0x7f87600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:24.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8760066f30 0x7f87600693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87700015a0 tx=0x7f8770009040 comp rx=0 tx=0).stop 2023-10-10T21:21:24.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c158120 msgr2=0x7f877c158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:24.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c158120 0x7f877c158590 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f8768006ac0 tx=0x7f87680091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 shutdown_connections 2023-10-10T21:21:24.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f877c167ca0 0x7f877c168110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f876c004d50 0x7f877c142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8760066f30 0x7f87600693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 --2- 172.21.15.154:0/419113972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f877c158120 0x7f877c158590 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 >> 172.21.15.154:0/419113972 conn(0x7f877c068e10 msgr2=0x7f877c151150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:24.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 shutdown_connections 2023-10-10T21:21:24.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.672+0000 7f8782fff700 1 -- 172.21.15.154:0/419113972 wait complete. 2023-10-10T21:21:24.692 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:21:24.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.874+0000 7f79bbfff700 1 Processor -- start 2023-10-10T21:21:24.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.874+0000 7f79bbfff700 1 -- start start 2023-10-10T21:21:24.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.875+0000 7f79bbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79bc1597f0 0x7f79bc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:24.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.875+0000 7f79bbfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79bc0b11d0 con 0x7f79bc159420 2023-10-10T21:21:24.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.875+0000 7f79bbfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79bc0b14b0 con 0x7f79bc15d230 2023-10-10T21:21:24.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.875+0000 7f79bbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0b1790 con 0x7f79bc1597f0 2023-10-10T21:21:24.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.875+0000 7f79baffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f79bc159420 0x7f79bc0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49466/0 (socket says 172.21.15.154:49466) 2023-10-10T21:21:24.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.875+0000 7f79baffd700 1 -- 172.21.15.154:0/4156719166 learned_addr learned my addr 172.21.15.154:0/4156719166 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:24.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79b3fff700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79bc1597f0 0x7f79bc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:24.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896662570 0 0) 0x7f79bc0b11d0 con 0x7f79bc159420 2023-10-10T21:21:24.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79a8003570 con 0x7f79bc159420 2023-10-10T21:21:24.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716301529 0 0) 0x7f79bc0b14b0 con 0x7f79bc15d230 2023-10-10T21:21:24.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79bc0b11d0 con 0x7f79bc15d230 2023-10-10T21:21:24.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2015322317 0 0) 0x7f79a8003570 con 0x7f79bc159420 2023-10-10T21:21:24.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79bc1597f0 msgr2=0x7f79bc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:24.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79bc1597f0 0x7f79bc0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 >> v1:172.21.15.179:6789/0 conn(0x7f79bc15d230 legacy=0x7f79bc0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:24.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc0b1a70 con 0x7f79bc159420 2023-10-10T21:21:24.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f79ac001470 con 0x7f79bc159420 2023-10-10T21:21:24.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 >> v1:172.21.15.154:6789/0 conn(0x7f79bc159420 legacy=0x7f79bc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:24.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79bc1597f0 0x7f79a8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:24.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a8004180 0x7f79a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:24.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a8004d50 0x7f79a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:24.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0b1790 con 0x7f79a8004d50 2023-10-10T21:21:24.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a800bba0 con 0x7f79a8004180 2023-10-10T21:21:24.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a800bd60 con 0x7f79bc1597f0 2023-10-10T21:21:24.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.876+0000 7f79bb7fe700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a8004d50 0x7f79a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:24.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79baffd700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79bc1597f0 0x7f79a8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:24.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79b3fff700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a8004180 0x7f79a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:24.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79bb7fe700 1 -- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79bc1597f0 msgr2=0x7f79a8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:24.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79bb7fe700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79bc1597f0 0x7f79a8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79bb7fe700 1 -- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a8004180 msgr2=0x7f79a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79bb7fe700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79a8004180 0x7f79a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79bb7fe700 1 -- 172.21.15.154:0/4156719166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a8003570 con 0x7f79a8004d50 2023-10-10T21:21:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79bb7fe700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a8004d50 0x7f79a80051c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f79b4002120 tx=0x7f79b40017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5771289c3283c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4001ab0 con 0x7f79a8004d50 2023-10-10T21:21:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b400c980 con 0x7f79a8004d50 2023-10-10T21:21:24.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.877+0000 7f79ba7fc700 1 -- 172.21.15.154:0/4156719166 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b400cd20 con 0x7f79a8004d50 2023-10-10T21:21:24.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.878+0000 7f79bbfff700 1 -- 172.21.15.154:0/4156719166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a8004d50 msgr2=0x7f79a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:24.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.878+0000 7f79bbfff700 1 --2- 172.21.15.154:0/4156719166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a8004d50 0x7f79a80051c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f79b4002120 tx=0x7f79b40017a0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.878+0000 7f79bb7fe700 1 -- 172.21.15.154:0/4156719166 reap_dead start 2023-10-10T21:21:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.878+0000 7f79bbfff700 1 -- 172.21.15.154:0/4156719166 shutdown_connections 2023-10-10T21:21:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.878+0000 7f79bbfff700 1 -- 172.21.15.154:0/4156719166 >> 172.21.15.154:0/4156719166 conn(0x7f79bc0d0660 msgr2=0x7f79bc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.878+0000 7f79bbfff700 1 -- 172.21.15.154:0/4156719166 shutdown_connections 2023-10-10T21:21:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.878+0000 7f79bbfff700 1 -- 172.21.15.154:0/4156719166 wait complete. 2023-10-10T21:21:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.879+0000 7f79bbfff700 1 Processor -- start 2023-10-10T21:21:24.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.879+0000 7f79bbfff700 1 -- start start 2023-10-10T21:21:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.880+0000 7f79bbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79a8004d50 0x7f79bc15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.880+0000 7f79bbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79bc16c370 0x7f79bc16c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.880+0000 7f79bbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79bc153d10 0x7f79bc154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.880+0000 7f79bbfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc16cd20 con 0x7f79bc16c370 2023-10-10T21:21:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.880+0000 7f79bbfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc1549b0 con 0x7f79bc153d10 2023-10-10T21:21:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.880+0000 7f79bbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc154c90 con 0x7f79a8004d50 2023-10-10T21:21:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79bc16c370 0x7f79bc16c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79bc16c370 0x7f79bc16c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35714/0 (socket says 172.21.15.154:35714) 2023-10-10T21:21:24.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b3fff700 1 -- 172.21.15.154:0/1358145840 learned_addr learned my addr 172.21.15.154:0/1358145840 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:24.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79baffd700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79a8004d50 0x7f79bc15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:24.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79bb7fe700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79bc153d10 0x7f79bc154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:24.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b3fff700 1 -- 172.21.15.154:0/1358145840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79a8004d50 msgr2=0x7f79bc15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b3fff700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79a8004d50 0x7f79bc15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b3fff700 1 -- 172.21.15.154:0/1358145840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79bc153d10 msgr2=0x7f79bc154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b3fff700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79bc153d10 0x7f79bc154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b3fff700 1 -- 172.21.15.154:0/1358145840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc154f70 con 0x7f79bc16c370 2023-10-10T21:21:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79bb7fe700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79bc153d10 0x7f79bc154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b3fff700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79bc16c370 0x7f79bc16c7e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f79a4006ac0 tx=0x7f79a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b2ffd700 1 -- 172.21.15.154:0/1358145840 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400f940 con 0x7f79bc16c370 2023-10-10T21:21:24.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.881+0000 7f79b2ffd700 1 -- 172.21.15.154:0/1358145840 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a400faa0 con 0x7f79bc16c370 2023-10-10T21:21:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.882+0000 7f79b2ffd700 1 -- 172.21.15.154:0/1358145840 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400fe20 con 0x7f79bc16c370 2023-10-10T21:21:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.882+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc155250 con 0x7f79bc16c370 2023-10-10T21:21:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.882+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc1546d0 con 0x7f79bc16c370 2023-10-10T21:21:24.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.883+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc04c3c0 con 0x7f79bc16c370 2023-10-10T21:21:24.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.883+0000 7f79b2ffd700 1 -- 172.21.15.154:0/1358145840 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79a4014650 con 0x7f79bc16c370 2023-10-10T21:21:24.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.884+0000 7f79b2ffd700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f799c066f30 0x7f799c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:24.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.884+0000 7f79b2ffd700 1 -- 172.21.15.154:0/1358145840 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f79a4018030 con 0x7f79bc16c370 2023-10-10T21:21:24.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.885+0000 7f79baffd700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f799c066f30 0x7f799c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:24.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.885+0000 7f79baffd700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f799c066f30 0x7f799c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f79ac001200 tx=0x7f79ac001df0 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:24.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:24.888+0000 7f79b2ffd700 1 -- 172.21.15.154:0/1358145840 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79a40521f0 con 0x7f79bc16c370 2023-10-10T21:21:25.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.120+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79bc0b1d50 con 0x7f79bc16c370 2023-10-10T21:21:25.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.121+0000 7f79b2ffd700 1 -- 172.21.15.154:0/1358145840 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f79a4055810 con 0x7f79bc16c370 2023-10-10T21:21:25.123 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:25.124 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/870665959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":870665959},{"type":"v1","addr":"172.21.15.179:6835","nonce":870665959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7723,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/338355165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":338355165},{"type":"v1","addr":"172.21.15.154:6835","nonce":338355165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1799386063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1799386063},{"type":"v1","addr":"172.21.15.179:6834","nonce":1799386063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:21:21.107292+0000","modified":"2023-10-10T21:21:24.662772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/2644092047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2644092047},{"type":"v1","addr":"172.21.15.154:6834","nonce":2644092047}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-10T21:21:25.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f799c066f30 msgr2=0x7f799c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f799c066f30 0x7f799c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f79ac001200 tx=0x7f79ac001df0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79bc16c370 msgr2=0x7f79bc16c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79bc16c370 0x7f79bc16c7e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f79a4006ac0 tx=0x7f79a40091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 shutdown_connections 2023-10-10T21:21:25.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79bc153d10 0x7f79bc154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79a8004d50 0x7f79bc15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f799c066f30 0x7f799c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 --2- 172.21.15.154:0/1358145840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79bc16c370 0x7f79bc16c7e0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.123+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 >> 172.21.15.154:0/1358145840 conn(0x7f79bc0d0660 msgr2=0x7f79bc069780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:25.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.124+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 shutdown_connections 2023-10-10T21:21:25.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.124+0000 7f79bbfff700 1 -- 172.21.15.154:0/1358145840 wait complete. 2023-10-10T21:21:25.131 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 62 2023-10-10T21:21:25.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T21:21:25.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.324+0000 7fbcfcd9d700 1 Processor -- start 2023-10-10T21:21:25.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.324+0000 7fbcfcd9d700 1 -- start start 2023-10-10T21:21:25.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.325+0000 7fbcfcd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf8159420 0x7fbcf80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.325+0000 7fbcfcd9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbcf815d230 0x7fbcf815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.325+0000 7fbcfcd9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf815dbd0 con 0x7fbcf81597f0 2023-10-10T21:21:25.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.325+0000 7fbcfcd9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80b2980 con 0x7fbcf815d230 2023-10-10T21:21:25.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.325+0000 7fbcfcd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80b11d0 con 0x7fbcf8159420 2023-10-10T21:21:25.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.326+0000 7fbcf7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbcf815d230 0x7fbcf815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.326+0000 7fbcf6ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbcf81597f0 0x7fbcf80b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49472/0 (socket says 172.21.15.154:49472) 2023-10-10T21:21:25.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.326+0000 7fbcf6ffd700 1 -- 172.21.15.154:0/2172082395 learned_addr learned my addr 172.21.15.154:0/2172082395 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:25.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.326+0000 7fbcf67fc700 1 -- 172.21.15.154:0/2172082395 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382121957 0 0) 0x7fbcec001110 con 0x7fbcf81597f0 2023-10-10T21:21:25.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.326+0000 7fbcf7fff700 1 -- 172.21.15.154:0/2172082395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf8159420 msgr2=0x7fbcf80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:25.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.326+0000 7fbcf7fff700 1 --2- 172.21.15.154:0/2172082395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf8159420 0x7fbcf80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.326+0000 7fbcf7fff700 1 -- 172.21.15.154:0/2172082395 >> v1:172.21.15.154:6789/0 conn(0x7fbcf81597f0 legacy=0x7fbcf80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.326+0000 7fbcf7fff700 1 -- 172.21.15.154:0/2172082395 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80b14b0 con 0x7fbcf815d230 2023-10-10T21:21:25.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.326+0000 7fbcf7fff700 1 --2- 172.21.15.154:0/2172082395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 0x7fbcf815d690 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009e60 tx=0x7fbcf0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d382106031fd86d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:25.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcf67fc700 1 -- 172.21.15.154:0/2172082395 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000e070 con 0x7fbcf815d230 2023-10-10T21:21:25.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcf67fc700 1 -- 172.21.15.154:0/2172082395 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf000bc30 con 0x7fbcf815d230 2023-10-10T21:21:25.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcf67fc700 1 -- 172.21.15.154:0/2172082395 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0012430 con 0x7fbcf815d230 2023-10-10T21:21:25.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/2172082395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 msgr2=0x7fbcf815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcfcd9d700 1 --2- 172.21.15.154:0/2172082395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 0x7fbcf815d690 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009e60 tx=0x7fbcf0009780 comp rx=0 tx=0).stop 2023-10-10T21:21:25.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/2172082395 shutdown_connections 2023-10-10T21:21:25.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcfcd9d700 1 --2- 172.21.15.154:0/2172082395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 0x7fbcf815d690 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcfcd9d700 1 --2- 172.21.15.154:0/2172082395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf8159420 0x7fbcf80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/2172082395 >> 172.21.15.154:0/2172082395 conn(0x7fbcf80d0660 msgr2=0x7fbcf80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:25.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/2172082395 shutdown_connections 2023-10-10T21:21:25.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.327+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/2172082395 wait complete. 2023-10-10T21:21:25.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.329+0000 7fbcfcd9d700 1 Processor -- start 2023-10-10T21:21:25.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.329+0000 7fbcfcd9d700 1 -- start start 2023-10-10T21:21:25.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcfcd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf8159420 0x7fbcf8150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcfcd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf81597f0 0x7fbcf814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcfcd9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 0x7fbcf8169650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcfcd9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf815bc60 con 0x7fbcf815d230 2023-10-10T21:21:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcfcd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80b63e0 con 0x7fbcf8159420 2023-10-10T21:21:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcfcd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf815b050 con 0x7fbcf81597f0 2023-10-10T21:21:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcf7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 0x7fbcf8169650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcf7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 0x7fbcf8169650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35738/0 (socket says 172.21.15.154:35738) 2023-10-10T21:21:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcf7fff700 1 -- 172.21.15.154:0/1280922211 learned_addr learned my addr 172.21.15.154:0/1280922211 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcf6ffd700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf81597f0 0x7fbcf814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcf77fe700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf8159420 0x7fbcf8150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcf7fff700 1 -- 172.21.15.154:0/1280922211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf81597f0 msgr2=0x7fbcf814f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.330+0000 7fbcf7fff700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf81597f0 0x7fbcf814f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcf7fff700 1 -- 172.21.15.154:0/1280922211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf8159420 msgr2=0x7fbcf8150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcf7fff700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf8159420 0x7fbcf8150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcf7fff700 1 -- 172.21.15.154:0/1280922211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0009a20 con 0x7fbcf815d230 2023-10-10T21:21:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcf77fe700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf8159420 0x7fbcf8150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcf7fff700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 0x7fbcf8169650 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0013000 tx=0x7fbcf0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcdf7fe700 1 -- 172.21.15.154:0/1280922211 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0012e30 con 0x7fbcf815d230 2023-10-10T21:21:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcdf7fe700 1 -- 172.21.15.154:0/1280922211 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf001d630 con 0x7fbcf815d230 2023-10-10T21:21:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf815b330 con 0x7fbcf815d230 2023-10-10T21:21:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcdf7fe700 1 -- 172.21.15.154:0/1280922211 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf001d9f0 con 0x7fbcf815d230 2023-10-10T21:21:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.331+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf815b8f0 con 0x7fbcf815d230 2023-10-10T21:21:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.332+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf815be10 con 0x7fbcf815d230 2023-10-10T21:21:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.333+0000 7fbcdf7fe700 1 -- 172.21.15.154:0/1280922211 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbcf0024070 con 0x7fbcf815d230 2023-10-10T21:21:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.334+0000 7fbcdf7fe700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbce4066f30 0x7fbce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.334+0000 7fbcdf7fe700 1 -- 172.21.15.154:0/1280922211 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fbcf0086fe0 con 0x7fbcf815d230 2023-10-10T21:21:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.334+0000 7fbcf77fe700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbce4066f30 0x7fbce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.335+0000 7fbcf77fe700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbce4066f30 0x7fbce40693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009b10 tx=0x7fbce8008040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.338+0000 7fbcdf7fe700 1 -- 172.21.15.154:0/1280922211 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcf815be10 con 0x7fbcf815d230 2023-10-10T21:21:25.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.530+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcf804c3c0 con 0x7fbcf815d230 2023-10-10T21:21:25.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.531+0000 7fbcdf7fe700 1 -- 172.21.15.154:0/1280922211 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fbcf0054030 con 0x7fbcf815d230 2023-10-10T21:21:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:25.533 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":139,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T21:21:22.650472+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:21:19.349593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-10T21:21:20.103524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T21:21:25.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbce4066f30 msgr2=0x7fbce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbce4066f30 0x7fbce40693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009b10 tx=0x7fbce8008040 comp rx=0 tx=0).stop 2023-10-10T21:21:25.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 msgr2=0x7fbcf8169650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 0x7fbcf8169650 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0013000 tx=0x7fbcf0019000 comp rx=0 tx=0).stop 2023-10-10T21:21:25.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 shutdown_connections 2023-10-10T21:21:25.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbce4066f30 0x7fbce40693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf815d230 0x7fbcf8169650 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf8159420 0x7fbcf8150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 --2- 172.21.15.154:0/1280922211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf81597f0 0x7fbcf814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 >> 172.21.15.154:0/1280922211 conn(0x7fbcf80d0660 msgr2=0x7fbcf8069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:25.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 shutdown_connections 2023-10-10T21:21:25.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.534+0000 7fbcfcd9d700 1 -- 172.21.15.154:0/1280922211 wait complete. 2023-10-10T21:21:25.553 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T21:21:25.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:21:25.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.738+0000 7f4fcbbff700 1 Processor -- start 2023-10-10T21:21:25.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.738+0000 7f4fcbbff700 1 -- start start 2023-10-10T21:21:25.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.739+0000 7f4fcbbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc41578b0 0x7f4fc4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.739+0000 7f4fcbbff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4fc40af2f0 0x7f4fc40af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.739+0000 7f4fcbbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40ad930 con 0x7f4fc4155c10 2023-10-10T21:21:25.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.739+0000 7f4fcbbff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc40b0c60 con 0x7f4fc40af2f0 2023-10-10T21:21:25.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.739+0000 7f4fcbbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40acd20 con 0x7f4fc41578b0 2023-10-10T21:21:25.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fc999b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4fc4155c10 0x7f4fc40ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49474/0 (socket says 172.21.15.154:49474) 2023-10-10T21:21:25.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fc999b700 1 -- 172.21.15.154:0/2214059937 learned_addr learned my addr 172.21.15.154:0/2214059937 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:25.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fca19c700 1 --2- 172.21.15.154:0/2214059937 >> v2:172.21.15.154:3300/0 conn(0x7f4fc40af2f0 0x7f4fc40af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fc919a700 1 --2- 172.21.15.154:0/2214059937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc41578b0 0x7f4fc4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fc8999700 1 -- 172.21.15.154:0/2214059937 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470194278 0 0) 0x7f4fc40ad930 con 0x7f4fc4155c10 2023-10-10T21:21:25.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fc8999700 1 -- 172.21.15.154:0/2214059937 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb0004680 con 0x7f4fc4155c10 2023-10-10T21:21:25.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fca19c700 1 -- 172.21.15.154:0/2214059937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc41578b0 msgr2=0x7f4fc4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:25.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fca19c700 1 --2- 172.21.15.154:0/2214059937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc41578b0 0x7f4fc4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fca19c700 1 -- 172.21.15.154:0/2214059937 >> v1:172.21.15.154:6789/0 conn(0x7f4fc4155c10 legacy=0x7f4fc40ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.740+0000 7f4fca19c700 1 -- 172.21.15.154:0/2214059937 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40ad000 con 0x7f4fc40af2f0 2023-10-10T21:21:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fca19c700 1 --2- 172.21.15.154:0/2214059937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 0x7f4fc40af710 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009e60 tx=0x7f4fbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68e71bda964e9f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fc8999700 1 -- 172.21.15.154:0/2214059937 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00e070 con 0x7f4fc40af2f0 2023-10-10T21:21:25.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fc8999700 1 -- 172.21.15.154:0/2214059937 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc00bab0 con 0x7f4fc40af2f0 2023-10-10T21:21:25.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fc8999700 1 -- 172.21.15.154:0/2214059937 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00be50 con 0x7f4fc40af2f0 2023-10-10T21:21:25.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fcbbff700 1 -- 172.21.15.154:0/2214059937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 msgr2=0x7f4fc40af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fcbbff700 1 --2- 172.21.15.154:0/2214059937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 0x7f4fc40af710 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009e60 tx=0x7f4fbc009780 comp rx=0 tx=0).stop 2023-10-10T21:21:25.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fcbbff700 1 -- 172.21.15.154:0/2214059937 shutdown_connections 2023-10-10T21:21:25.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fcbbff700 1 --2- 172.21.15.154:0/2214059937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 0x7f4fc40af710 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fcbbff700 1 --2- 172.21.15.154:0/2214059937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc41578b0 0x7f4fc4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.741+0000 7f4fcbbff700 1 -- 172.21.15.154:0/2214059937 >> 172.21.15.154:0/2214059937 conn(0x7f4fc406a320 msgr2=0x7f4fc40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:25.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.742+0000 7f4fcbbff700 1 -- 172.21.15.154:0/2214059937 shutdown_connections 2023-10-10T21:21:25.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.742+0000 7f4fcbbff700 1 -- 172.21.15.154:0/2214059937 wait complete. 2023-10-10T21:21:25.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.743+0000 7f4fcbbff700 1 Processor -- start 2023-10-10T21:21:25.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.743+0000 7f4fcbbff700 1 -- start start 2023-10-10T21:21:25.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fcbbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 0x7f4fc4142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fcbbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc4155c10 0x7f4fc4159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fcbbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fc41578b0 0x7f4fc415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fcbbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40c9ae0 con 0x7f4fc40af2f0 2023-10-10T21:21:25.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fcbbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40c91b0 con 0x7f4fc41578b0 2023-10-10T21:21:25.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fcbbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40c9490 con 0x7f4fc4155c10 2023-10-10T21:21:25.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fc999b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 0x7f4fc4142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fc999b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 0x7f4fc4142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35752/0 (socket says 172.21.15.154:35752) 2023-10-10T21:21:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fc999b700 1 -- 172.21.15.154:0/3221111114 learned_addr learned my addr 172.21.15.154:0/3221111114 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fc919a700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc4155c10 0x7f4fc4159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.744+0000 7f4fca19c700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fc41578b0 0x7f4fc415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fc999b700 1 -- 172.21.15.154:0/3221111114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc4155c10 msgr2=0x7f4fc4159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fc999b700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc4155c10 0x7f4fc4159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fc999b700 1 -- 172.21.15.154:0/3221111114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fc41578b0 msgr2=0x7f4fc415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fc999b700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fc41578b0 0x7f4fc415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fc999b700 1 -- 172.21.15.154:0/3221111114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc009a20 con 0x7f4fc40af2f0 2023-10-10T21:21:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fc919a700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc4155c10 0x7f4fc4159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fc999b700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 0x7f4fc4142b70 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00011e0 tx=0x7f4fc0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fb9ffb700 1 -- 172.21.15.154:0/3221111114 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0005b30 con 0x7f4fc40af2f0 2023-10-10T21:21:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fb9ffb700 1 -- 172.21.15.154:0/3221111114 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc0005c90 con 0x7f4fc40af2f0 2023-10-10T21:21:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc40c9770 con 0x7f4fc40af2f0 2023-10-10T21:21:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fb9ffb700 1 -- 172.21.15.154:0/3221111114 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00072e0 con 0x7f4fc40af2f0 2023-10-10T21:21:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.745+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc40a9c00 con 0x7f4fc40af2f0 2023-10-10T21:21:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.746+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc404c3c0 con 0x7f4fc40af2f0 2023-10-10T21:21:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.747+0000 7f4fb9ffb700 1 -- 172.21.15.154:0/3221111114 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fc0007650 con 0x7f4fc40af2f0 2023-10-10T21:21:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.748+0000 7f4fb9ffb700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4fa8066f30 0x7f4fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.748+0000 7f4fb9ffb700 1 -- 172.21.15.154:0/3221111114 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f4fc0083b80 con 0x7f4fc40af2f0 2023-10-10T21:21:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.748+0000 7f4fc919a700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4fa8066f30 0x7f4fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.749+0000 7f4fc919a700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4fa8066f30 0x7f4fa80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4fc416ccd0 tx=0x7f4fb4008040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.752+0000 7f4fb9ffb700 1 -- 172.21.15.154:0/3221111114 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fc004b5a0 con 0x7f4fc40af2f0 2023-10-10T21:21:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.941+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fc40c9c20 con 0x7f4fa8066f30 2023-10-10T21:21:25.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.950+0000 7f4fb9ffb700 1 -- 172.21.15.154:0/3221111114 <== mgr.7968 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278188 (secure 0 0 0) 0x7f4fb4009df0 con 0x7f4fa8066f30 2023-10-10T21:21:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:25.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4fa8066f30 msgr2=0x7f4fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4fa8066f30 0x7f4fa80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4fc416ccd0 tx=0x7f4fb4008040 comp rx=0 tx=0).stop 2023-10-10T21:21:25.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 msgr2=0x7f4fc4142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:25.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 0x7f4fc4142b70 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00011e0 tx=0x7f4fc0007df0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 shutdown_connections 2023-10-10T21:21:25.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fc41578b0 0x7f4fc415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4fa8066f30 0x7f4fa80693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc40af2f0 0x7f4fc4142b70 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 --2- 172.21.15.154:0/3221111114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fc4155c10 0x7f4fc4159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:25.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.954+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 >> 172.21.15.154:0/3221111114 conn(0x7f4fc406a320 msgr2=0x7f4fc4153230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:25.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.955+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 shutdown_connections 2023-10-10T21:21:25.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:25.955+0000 7f4fcbbff700 1 -- 172.21.15.154:0/3221111114 wait complete. 2023-10-10T21:21:25.960 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:21:25.973 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:21:25.581823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454056,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752520664,"statfs":{"total":773094113280,"available":770581159936,"internally_reserved":0,"allocated":14655488,"data_stored":7774328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.955848"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628867+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:42:08.653575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631983+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:07:10.832777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635258+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:02.381417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635483+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:47:44.086230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.629406+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:53:40.974382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631600+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:07:10.142558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628182+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:07:10.832777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633524+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:37:33.069929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635660+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:07:17.115538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.632020+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:44:23.492820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.634245+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:03:02.253930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633009+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:36:30.134488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631353+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:32.025109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633846+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.634951+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:23.799410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.632079+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:26:45.494518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.634957+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:53.848986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633930+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:53.554860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628306+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:58.113017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.630878+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:30:38.764050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635408+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:16:05.567735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.630797+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:49:04.865763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.632059+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:41:06.233657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631581+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:11.716760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633931+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:50:49.328696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631571+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:10.685980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.630969+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:00:11.299614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628813+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:27:26.067263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628200+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635250+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:30:27.078527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631461+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:08:00.005004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628206+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:23.299118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":731,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-10T21:21:17.144329+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:21:17.144329+0000","last_peered":"2023-10-10T21:21:17.144329+0000","last_clean":"2023-10-10T21:21:17.144329+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:21:17.144329+0000","last_undegraded":"2023-10-10T21:21:17.144329+0000","last_fullsized":"2023-10-10T21:21:17.144329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542369,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307704,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064136,"statfs":{"total":96636764160,"available":96321675264,"internally_reserved":0,"allocated":2277376,"data_stored":1414567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":1.052,"15min":1.052},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.441},"max":{"1min":0.91800000000000004,"5min":1.161,"15min":1.161},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90900000000000003,"5min":1.179,"15min":1.179},"last":0.92100000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.439,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.70899999999999996,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.93799999999999994,"5min":1.012,"15min":1.012},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.42199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.61799999999999999},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.36699999999999999},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.48999999999999999,"5min":0.40200000000000002,"15min":0.34599999999999997},"max":{"1min":0.91200000000000003,"5min":1.016,"15min":1.3700000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.41399999999999998,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.036},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.1200000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.54300000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79200000000000004,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.5},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.0109999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36499999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.0189999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.69799999999999995},"min":{"1min":0.48599999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.1040000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.42999999999999999},"max":{"1min":0.98199999999999998,"5min":1.0129999999999999,"15min":1.03},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.75600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.73899999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.68899999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.442},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.016},"last":0.64800000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0309999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.872,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38900000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.68799999999999994}]},{"osd":5,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.629},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70899999999999996,"15min":0.71799999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46400000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.54100000000000004,"15min":0.48799999999999999},"min":{"1min":0.28299999999999997,"5min":0.26200000000000001,"15min":0.24099999999999999},"max":{"1min":0.72899999999999998,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.623,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.48599999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":2.254,"15min":2.254},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.44800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75600000000000001,"5min":0.999,"15min":0.999},"last":0.44700000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.54300000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94699999999999995,"5min":4.806,"15min":4.806},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.42199999999999999},"max":{"1min":0.98099999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.77900000000000003},"min":{"1min":0.48399999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97699999999999998,"5min":6.968,"15min":6.968},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.876,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90700000000000003,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.99399999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":12.026,"15min":12.026},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0329999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.63900000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303608,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068232,"statfs":{"total":96636764160,"available":96325869568,"internally_reserved":0,"allocated":2277376,"data_stored":1414567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.60599999999999998,"5min":0.74399999999999999,"15min":0.752},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.49199999999999999,"15min":0.51600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.879,"15min":0.91800000000000004},"last":0.36199999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.72699999999999998,"15min":0.76700000000000002},"last":0.44},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41799999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.498,"15min":0.51400000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.73299999999999998,"15min":0.90300000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56799999999999995,"15min":0.59899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.81299999999999994,"15min":0.874},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1080000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73699999999999999,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.075,"5min":1.1679999999999999,"15min":1.2190000000000001},"last":0.749},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.018,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.54600000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82099999999999995},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.008,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.59699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.143},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78400000000000003,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.036,"5min":1.139,"15min":1.169},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0549999999999999,"5min":1.097,"15min":1.165},"last":0.626}]}]},{"osd":2,"up_from":14,"seq":60129542370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311220,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060620,"statfs":{"total":96636764160,"available":96318074880,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":0.71799999999999997,"15min":0.95699999999999996},"last":0.316},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48999999999999999,"15min":0.50900000000000001},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.29599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.30599999999999999,"5min":0.28999999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.9099999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.502}]},{"osd":4,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73699999999999999,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0860000000000001,"15min":1.26},"last":0.77900000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.77800000000000002},"min":{"1min":0.54100000000000004,"5min":0.47499999999999998,"15min":0.46200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":2.21},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74199999999999999,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.52000000000000002,"15min":0.48399999999999999},"max":{"1min":1.1000000000000001,"5min":1.125,"15min":1.268},"last":0.76400000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76300000000000001,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.3080000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.54900000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.345,"15min":1.345},"last":0.878}]},{"osd":7,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.087,"5min":1.2290000000000001,"15min":1.716},"last":0.747},{"interface":"front","average":{"1min":0.746,"5min":0.75,"15min":0.79200000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2330000000000001},"last":0.85399999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509665,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.45500000000000002},"min":{"1min":0.316,"5min":0.28000000000000003,"15min":0.27900000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.83099999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59399999999999997,"5min":0.77000000000000002,"15min":0.84399999999999997},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":0.66400000000000003,"5min":0.87,"15min":0.87},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.38400000000000001,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70399999999999996,"5min":0.81000000000000005,"15min":0.92200000000000004},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.42599999999999999},"max":{"1min":0.95099999999999996,"5min":1.1200000000000001,"15min":1.3440000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.433},"max":{"1min":1.03,"5min":1.1339999999999999,"15min":1.246},"last":0.56399999999999995}]},{"osd":5,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.21,"15min":1.21},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.014,"5min":1.165,"15min":1.2250000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0549999999999999,"5min":1.081,"15min":1.27},"last":0.496},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":1.052,"15min":1.224},"last":0.64600000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.117,"15min":1.1319999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.53500000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.98699999999999999,"5min":1.228,"15min":1.228},"last":0.59099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311220,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060620,"statfs":{"total":96636764160,"available":96318074880,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.68700000000000006},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.91000000000000003,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.72399999999999998},"min":{"1min":0.437,"5min":0.318,"15min":0.318},"max":{"1min":0.879,"5min":1.121,"15min":1.5029999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.1859999999999999,"15min":1.47},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":1.155,"15min":1.155},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.50700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0009999999999999,"5min":1.002,"15min":1.536},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":1.2330000000000001,"15min":1.397},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68100000000000005,"15min":0.71499999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0009999999999999,"5min":1.0800000000000001,"15min":1.385},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.93999999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.96299999999999997,"5min":1,"15min":1.196},"last":0.745}]},{"osd":6,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95599999999999996,"5min":1.0149999999999999,"15min":1.216},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.503,"5min":0.377,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":1.006,"15min":1.2390000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.442},"max":{"1min":0.91000000000000003,"5min":1.034,"15min":1.4139999999999999},"last":0.84899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.95399999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.86899999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.97299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70799999999999996},"min":{"1min":0.46999999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94299999999999995,"5min":1.0009999999999999,"15min":1.018},"last":0.625}]},{"osd":2,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.01},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.2909999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.74199999999999999},"min":{"1min":0.57199999999999995,"5min":0.5,"15min":0.48799999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.044},"last":0.72799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92900000000000005,"5min":1.2110000000000001,"15min":1.5900000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":0.95099999999999996,"15min":1.496},"last":0.60199999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99299999999999999,"5min":1.131,"15min":1.131},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.54000000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85799999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.46300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.008,"5min":1.097,"15min":1.097},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0329999999999999,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.89000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:21:25.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:21:26.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.196+0000 7fbf523ff700 1 Processor -- start 2023-10-10T21:21:26.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.196+0000 7fbf523ff700 1 -- start start 2023-10-10T21:21:26.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.198+0000 7fbf523ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbf4c0b0a10 0x7fbf4c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.198+0000 7fbf523ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c0ad930 con 0x7fbf4c1578b0 2023-10-10T21:21:26.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.198+0000 7fbf523ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c0acd20 con 0x7fbf4c155c10 2023-10-10T21:21:26.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.198+0000 7fbf523ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c0ad000 con 0x7fbf4c0b0a10 2023-10-10T21:21:26.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.198+0000 7fbf4b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbf4c1578b0 0x7fbf4c0af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49394/0 (socket says 172.21.15.154:49394) 2023-10-10T21:21:26.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.198+0000 7fbf4b7fe700 1 -- 172.21.15.154:0/323557039 learned_addr learned my addr 172.21.15.154:0/323557039 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:26.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.198+0000 7fbf5099c700 1 --2- 172.21.15.154:0/323557039 >> v2:172.21.15.179:3300/0 conn(0x7fbf4c0b0a10 0x7fbf4c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.198+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925525528 0 0) 0x7fbf4c0ad930 con 0x7fbf4c1578b0 2023-10-10T21:21:26.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.198+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf34003570 con 0x7fbf4c1578b0 2023-10-10T21:21:26.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3335478304 0 0) 0x7fbf34003570 con 0x7fbf4c1578b0 2023-10-10T21:21:26.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 >> v2:172.21.15.179:3300/0 conn(0x7fbf4c0b0a10 msgr2=0x7fbf4c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:26.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 --2- 172.21.15.154:0/323557039 >> v2:172.21.15.179:3300/0 conn(0x7fbf4c0b0a10 0x7fbf4c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 >> v1:172.21.15.179:6789/0 conn(0x7fbf4c155c10 legacy=0x7fbf4c0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0ad2e0 con 0x7fbf4c1578b0 2023-10-10T21:21:26.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fbf40001470 con 0x7fbf4c1578b0 2023-10-10T21:21:26.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 >> v1:172.21.15.154:6789/0 conn(0x7fbf4c1578b0 legacy=0x7fbf4c0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf34003a60 0x7fbf34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf34004810 0x7fbf34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf340051c0 0x7fbf3400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0ad000 con 0x7fbf340051c0 2023-10-10T21:21:26.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3400c0d0 con 0x7fbf34003a60 2023-10-10T21:21:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3400c290 con 0x7fbf34004810 2023-10-10T21:21:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf5099c700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf340051c0 0x7fbf3400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4b7fe700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf34004810 0x7fbf34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.199+0000 7fbf4bfff700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf34003a60 0x7fbf34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf5099c700 1 -- 172.21.15.154:0/323557039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf34004810 msgr2=0x7fbf34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf5099c700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf34004810 0x7fbf34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf5099c700 1 -- 172.21.15.154:0/323557039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf34003a60 msgr2=0x7fbf34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf5099c700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf34003a60 0x7fbf34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf5099c700 1 -- 172.21.15.154:0/323557039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf34003570 con 0x7fbf340051c0 2023-10-10T21:21:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf5099c700 1 -- 172.21.15.154:0/323557039 reap_dead start 2023-10-10T21:21:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf5099c700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf340051c0 0x7fbf3400ba60 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0b0e10 tx=0x7fbf4400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb494d40a5bb6517 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400a0d0 con 0x7fbf340051c0 2023-10-10T21:21:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf44010040 con 0x7fbf340051c0 2023-10-10T21:21:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf4affd700 1 -- 172.21.15.154:0/323557039 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400fbe0 con 0x7fbf340051c0 2023-10-10T21:21:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf523ff700 1 -- 172.21.15.154:0/323557039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf340051c0 msgr2=0x7fbf3400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.200+0000 7fbf523ff700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf340051c0 0x7fbf3400ba60 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0b0e10 tx=0x7fbf4400c040 comp rx=0 tx=0).stop 2023-10-10T21:21:26.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.201+0000 7fbf523ff700 1 -- 172.21.15.154:0/323557039 shutdown_connections 2023-10-10T21:21:26.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.201+0000 7fbf523ff700 1 --2- 172.21.15.154:0/323557039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf340051c0 0x7fbf3400ba60 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.201+0000 7fbf523ff700 1 -- 172.21.15.154:0/323557039 >> 172.21.15.154:0/323557039 conn(0x7fbf4c06a320 msgr2=0x7fbf4c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:26.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.201+0000 7fbf523ff700 1 -- 172.21.15.154:0/323557039 shutdown_connections 2023-10-10T21:21:26.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.201+0000 7fbf523ff700 1 -- 172.21.15.154:0/323557039 wait complete. 2023-10-10T21:21:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.202+0000 7fbf523ff700 1 Processor -- start 2023-10-10T21:21:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.202+0000 7fbf523ff700 1 -- start start 2023-10-10T21:21:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.203+0000 7fbf523ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf340051c0 0x7fbf4c169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.203+0000 7fbf523ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf4c0a98d0 0x7fbf4c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.203+0000 7fbf523ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf4c0cb7a0 0x7fbf4c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.203+0000 7fbf523ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0cc5e0 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.203+0000 7fbf523ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0cc150 con 0x7fbf4c0cb7a0 2023-10-10T21:21:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.203+0000 7fbf523ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0aac30 con 0x7fbf340051c0 2023-10-10T21:21:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.203+0000 7fbf4b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf4c0a98d0 0x7fbf4c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.203+0000 7fbf4b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf4c0a98d0 0x7fbf4c146f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58880/0 (socket says 172.21.15.154:58880) 2023-10-10T21:21:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.203+0000 7fbf4b7fe700 1 -- 172.21.15.154:0/1888060631 learned_addr learned my addr 172.21.15.154:0/1888060631 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf4bfff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf340051c0 0x7fbf4c169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf5099c700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf4c0cb7a0 0x7fbf4c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf4b7fe700 1 -- 172.21.15.154:0/1888060631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf340051c0 msgr2=0x7fbf4c169dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf4b7fe700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf340051c0 0x7fbf4c169dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf4b7fe700 1 -- 172.21.15.154:0/1888060631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf4c0cb7a0 msgr2=0x7fbf4c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf4b7fe700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf4c0cb7a0 0x7fbf4c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf4b7fe700 1 -- 172.21.15.154:0/1888060631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0aa020 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf4b7fe700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf4c0a98d0 0x7fbf4c146f70 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fbf40007370 tx=0x7fbf40001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:26.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf33fff700 1 -- 172.21.15.154:0/1888060631 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000f8d0 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf33fff700 1 -- 172.21.15.154:0/1888060631 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4000fa30 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf33fff700 1 -- 172.21.15.154:0/1888060631 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000fdf0 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.204+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c0aa300 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.205+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c0aa8c0 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.205+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c0adb20 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.207+0000 7fbf33fff700 1 -- 172.21.15.154:0/1888060631 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf400135c0 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.208+0000 7fbf33fff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.208+0000 7fbf33fff700 1 -- 172.21.15.154:0/1888060631 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fbf40084530 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.208+0000 7fbf4bfff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.209+0000 7fbf4bfff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf38066f30 0x7fbf380693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c007e40 tx=0x7fbf3c007d30 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:26.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.212+0000 7fbf33fff700 1 -- 172.21.15.154:0/1888060631 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf40051620 con 0x7fbf4c0a98d0 2023-10-10T21:21:26.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.402+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf4c04c3c0 con 0x7fbf38066f30 2023-10-10T21:21:26.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.410+0000 7fbf33fff700 1 -- 172.21.15.154:0/1888060631 <== mgr.7968 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278188 (secure 0 0 0) 0x7fbf4c04c3c0 con 0x7fbf38066f30 2023-10-10T21:21:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf38066f30 msgr2=0x7fbf380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf38066f30 0x7fbf380693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c007e40 tx=0x7fbf3c007d30 comp rx=0 tx=0).stop 2023-10-10T21:21:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf4c0a98d0 msgr2=0x7fbf4c146f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf4c0a98d0 0x7fbf4c146f70 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fbf40007370 tx=0x7fbf40001e50 comp rx=0 tx=0).stop 2023-10-10T21:21:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 shutdown_connections 2023-10-10T21:21:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf4c0cb7a0 0x7fbf4c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf340051c0 0x7fbf4c169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 --2- 172.21.15.154:0/1888060631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf4c0a98d0 0x7fbf4c146f70 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 >> 172.21.15.154:0/1888060631 conn(0x7fbf4c06a320 msgr2=0x7fbf4c154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 shutdown_connections 2023-10-10T21:21:26.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.414+0000 7fbf523ff700 1 -- 172.21.15.154:0/1888060631 wait complete. 2023-10-10T21:21:26.420 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:21:26.433 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:21:25.581823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454056,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752520664,"statfs":{"total":773094113280,"available":770581159936,"internally_reserved":0,"allocated":14655488,"data_stored":7774328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.955848"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628867+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:42:08.653575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631983+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:07:10.832777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635258+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:02.381417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635483+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:47:44.086230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.629406+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:53:40.974382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631600+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:07:10.142558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628182+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:07:10.832777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633524+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:37:33.069929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635660+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:07:17.115538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.632020+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:44:23.492820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.634245+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:03:02.253930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633009+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:36:30.134488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631353+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:32.025109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633846+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.634951+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:23.799410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.632079+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:26:45.494518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.634957+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:53.848986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633930+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:53.554860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628306+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:58.113017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.630878+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:30:38.764050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635408+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:16:05.567735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.630797+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:49:04.865763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.632059+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:41:06.233657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631581+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:11.716760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633931+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:50:49.328696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631571+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:10.685980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.630969+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:00:11.299614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628813+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:27:26.067263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628200+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635250+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:30:27.078527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631461+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:08:00.005004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628206+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:23.299118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":731,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-10T21:21:17.144329+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:21:17.144329+0000","last_peered":"2023-10-10T21:21:17.144329+0000","last_clean":"2023-10-10T21:21:17.144329+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:21:17.144329+0000","last_undegraded":"2023-10-10T21:21:17.144329+0000","last_fullsized":"2023-10-10T21:21:17.144329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542369,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307704,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064136,"statfs":{"total":96636764160,"available":96321675264,"internally_reserved":0,"allocated":2277376,"data_stored":1414567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":1.052,"15min":1.052},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.441},"max":{"1min":0.91800000000000004,"5min":1.161,"15min":1.161},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90900000000000003,"5min":1.179,"15min":1.179},"last":0.92100000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.439,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.70899999999999996,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.93799999999999994,"5min":1.012,"15min":1.012},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.42199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.61799999999999999},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.36699999999999999},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.48999999999999999,"5min":0.40200000000000002,"15min":0.34599999999999997},"max":{"1min":0.91200000000000003,"5min":1.016,"15min":1.3700000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.41399999999999998,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.036},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.1200000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.54300000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79200000000000004,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.5},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.0109999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36499999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.0189999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.69799999999999995},"min":{"1min":0.48599999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.1040000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.42999999999999999},"max":{"1min":0.98199999999999998,"5min":1.0129999999999999,"15min":1.03},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.75600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.73899999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.68899999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.442},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.016},"last":0.64800000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0309999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.872,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38900000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.68799999999999994}]},{"osd":5,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.629},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70899999999999996,"15min":0.71799999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46400000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.54100000000000004,"15min":0.48799999999999999},"min":{"1min":0.28299999999999997,"5min":0.26200000000000001,"15min":0.24099999999999999},"max":{"1min":0.72899999999999998,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.623,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.48599999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":2.254,"15min":2.254},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.44800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75600000000000001,"5min":0.999,"15min":0.999},"last":0.44700000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.54300000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94699999999999995,"5min":4.806,"15min":4.806},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.42199999999999999},"max":{"1min":0.98099999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.77900000000000003},"min":{"1min":0.48399999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97699999999999998,"5min":6.968,"15min":6.968},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.876,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90700000000000003,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.99399999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":12.026,"15min":12.026},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0329999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.63900000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303608,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068232,"statfs":{"total":96636764160,"available":96325869568,"internally_reserved":0,"allocated":2277376,"data_stored":1414567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.60599999999999998,"5min":0.74399999999999999,"15min":0.752},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.49199999999999999,"15min":0.51600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.879,"15min":0.91800000000000004},"last":0.36199999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.72699999999999998,"15min":0.76700000000000002},"last":0.44},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41799999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.498,"15min":0.51400000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.73299999999999998,"15min":0.90300000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56799999999999995,"15min":0.59899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.81299999999999994,"15min":0.874},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1080000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73699999999999999,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.075,"5min":1.1679999999999999,"15min":1.2190000000000001},"last":0.749},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.018,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.54600000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82099999999999995},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.008,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.59699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.143},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78400000000000003,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.036,"5min":1.139,"15min":1.169},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0549999999999999,"5min":1.097,"15min":1.165},"last":0.626}]}]},{"osd":2,"up_from":14,"seq":60129542370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311220,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060620,"statfs":{"total":96636764160,"available":96318074880,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":0.71799999999999997,"15min":0.95699999999999996},"last":0.316},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48999999999999999,"15min":0.50900000000000001},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.29599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.30599999999999999,"5min":0.28999999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.9099999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.502}]},{"osd":4,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73699999999999999,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0860000000000001,"15min":1.26},"last":0.77900000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.77800000000000002},"min":{"1min":0.54100000000000004,"5min":0.47499999999999998,"15min":0.46200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":2.21},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74199999999999999,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.52000000000000002,"15min":0.48399999999999999},"max":{"1min":1.1000000000000001,"5min":1.125,"15min":1.268},"last":0.76400000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76300000000000001,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.3080000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.54900000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.345,"15min":1.345},"last":0.878}]},{"osd":7,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.087,"5min":1.2290000000000001,"15min":1.716},"last":0.747},{"interface":"front","average":{"1min":0.746,"5min":0.75,"15min":0.79200000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2330000000000001},"last":0.85399999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509665,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.45500000000000002},"min":{"1min":0.316,"5min":0.28000000000000003,"15min":0.27900000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.83099999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59399999999999997,"5min":0.77000000000000002,"15min":0.84399999999999997},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":0.66400000000000003,"5min":0.87,"15min":0.87},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.38400000000000001,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70399999999999996,"5min":0.81000000000000005,"15min":0.92200000000000004},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.42599999999999999},"max":{"1min":0.95099999999999996,"5min":1.1200000000000001,"15min":1.3440000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.433},"max":{"1min":1.03,"5min":1.1339999999999999,"15min":1.246},"last":0.56399999999999995}]},{"osd":5,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.21,"15min":1.21},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.014,"5min":1.165,"15min":1.2250000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0549999999999999,"5min":1.081,"15min":1.27},"last":0.496},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":1.052,"15min":1.224},"last":0.64600000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.117,"15min":1.1319999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.53500000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.98699999999999999,"5min":1.228,"15min":1.228},"last":0.59099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311220,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060620,"statfs":{"total":96636764160,"available":96318074880,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.68700000000000006},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.91000000000000003,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.72399999999999998},"min":{"1min":0.437,"5min":0.318,"15min":0.318},"max":{"1min":0.879,"5min":1.121,"15min":1.5029999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.1859999999999999,"15min":1.47},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":1.155,"15min":1.155},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.50700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0009999999999999,"5min":1.002,"15min":1.536},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":1.2330000000000001,"15min":1.397},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68100000000000005,"15min":0.71499999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0009999999999999,"5min":1.0800000000000001,"15min":1.385},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.93999999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.96299999999999997,"5min":1,"15min":1.196},"last":0.745}]},{"osd":6,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95599999999999996,"5min":1.0149999999999999,"15min":1.216},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.503,"5min":0.377,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":1.006,"15min":1.2390000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.442},"max":{"1min":0.91000000000000003,"5min":1.034,"15min":1.4139999999999999},"last":0.84899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.95399999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.86899999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.97299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70799999999999996},"min":{"1min":0.46999999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94299999999999995,"5min":1.0009999999999999,"15min":1.018},"last":0.625}]},{"osd":2,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.01},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.2909999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.74199999999999999},"min":{"1min":0.57199999999999995,"5min":0.5,"15min":0.48799999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.044},"last":0.72799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92900000000000005,"5min":1.2110000000000001,"15min":1.5900000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":0.95099999999999996,"15min":1.496},"last":0.60199999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99299999999999999,"5min":1.131,"15min":1.131},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.54000000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85799999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.46300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.008,"5min":1.097,"15min":1.097},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0329999999999999,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.89000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:21:26.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:21:26.613 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-10-10T21:21:26.611+0000 7fac8cdf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T21:21:26.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.658+0000 7f445a3ff700 1 Processor -- start 2023-10-10T21:21:26.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.658+0000 7f445a3ff700 1 -- start start 2023-10-10T21:21:26.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.660+0000 7f445a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540b1420 0x7f44540ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.660+0000 7f445a3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44540ccf90 0x7f44540c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.660+0000 7f445a3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44540cc300 con 0x7f44540cbf30 2023-10-10T21:21:26.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.660+0000 7f445a3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4454156bf0 con 0x7f44540ccf90 2023-10-10T21:21:26.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.660+0000 7f445a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540ae950 con 0x7f44540b1420 2023-10-10T21:21:26.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.660+0000 7f445899c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44540ccf90 0x7f44540c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.660+0000 7f445899c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44540ccf90 0x7f44540c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58882/0 (socket says 172.21.15.154:58882) 2023-10-10T21:21:26.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.660+0000 7f445899c700 1 -- 172.21.15.154:0/670454751 learned_addr learned my addr 172.21.15.154:0/670454751 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:26.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.661+0000 7f444bfff700 1 --2- 172.21.15.154:0/670454751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540b1420 0x7f44540ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.661+0000 7f445899c700 1 -- 172.21.15.154:0/670454751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540b1420 msgr2=0x7f44540ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:26.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.661+0000 7f445899c700 1 --2- 172.21.15.154:0/670454751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540b1420 0x7f44540ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.661+0000 7f445899c700 1 -- 172.21.15.154:0/670454751 >> v1:172.21.15.179:6789/0 conn(0x7f44540cbf30 legacy=0x7f44540b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.661+0000 7f445899c700 1 -- 172.21.15.154:0/670454751 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540ad370 con 0x7f44540ccf90 2023-10-10T21:21:26.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.661+0000 7f445899c700 1 --2- 172.21.15.154:0/670454751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540ccf90 0x7f44540c9740 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f444c009f50 tx=0x7f444c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba93ed77a15c500 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:26.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.661+0000 7f44537fe700 1 -- 172.21.15.154:0/670454751 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00e070 con 0x7f44540ccf90 2023-10-10T21:21:26.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.661+0000 7f44537fe700 1 -- 172.21.15.154:0/670454751 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c00ba70 con 0x7f44540ccf90 2023-10-10T21:21:26.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.661+0000 7f44537fe700 1 -- 172.21.15.154:0/670454751 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c0092e0 con 0x7f44540ccf90 2023-10-10T21:21:26.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.662+0000 7f445a3ff700 1 -- 172.21.15.154:0/670454751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540ccf90 msgr2=0x7f44540c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.662+0000 7f445a3ff700 1 --2- 172.21.15.154:0/670454751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540ccf90 0x7f44540c9740 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f444c009f50 tx=0x7f444c009840 comp rx=0 tx=0).stop 2023-10-10T21:21:26.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.662+0000 7f445a3ff700 1 -- 172.21.15.154:0/670454751 shutdown_connections 2023-10-10T21:21:26.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.662+0000 7f445a3ff700 1 --2- 172.21.15.154:0/670454751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540ccf90 0x7f44540c9740 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.662+0000 7f445a3ff700 1 --2- 172.21.15.154:0/670454751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540b1420 0x7f44540ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.662+0000 7f445a3ff700 1 -- 172.21.15.154:0/670454751 >> 172.21.15.154:0/670454751 conn(0x7f445406a320 msgr2=0x7f44540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.662+0000 7f445a3ff700 1 -- 172.21.15.154:0/670454751 shutdown_connections 2023-10-10T21:21:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.662+0000 7f445a3ff700 1 -- 172.21.15.154:0/670454751 wait complete. 2023-10-10T21:21:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.663+0000 7f445a3ff700 1 Processor -- start 2023-10-10T21:21:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.664+0000 7f445a3ff700 1 -- start start 2023-10-10T21:21:26.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.664+0000 7f445a3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540b1420 0x7f44540a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.664+0000 7f445a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540cbf30 0x7f44540ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.664+0000 7f445a3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ccf90 0x7f44540c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.664+0000 7f445a3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540acd00 con 0x7f44540b1420 2023-10-10T21:21:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.664+0000 7f445a3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540aa2d0 con 0x7f44540ccf90 2023-10-10T21:21:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.664+0000 7f445a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540aa5b0 con 0x7f44540cbf30 2023-10-10T21:21:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f4453fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540b1420 0x7f44540a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f4453fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540b1420 0x7f44540a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58892/0 (socket says 172.21.15.154:58892) 2023-10-10T21:21:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f4453fff700 1 -- 172.21.15.154:0/1792906690 learned_addr learned my addr 172.21.15.154:0/1792906690 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f445899c700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ccf90 0x7f44540c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f444bfff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540cbf30 0x7f44540ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f4453fff700 1 -- 172.21.15.154:0/1792906690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540cbf30 msgr2=0x7f44540ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f4453fff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540cbf30 0x7f44540ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f4453fff700 1 -- 172.21.15.154:0/1792906690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ccf90 msgr2=0x7f44540c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f4453fff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ccf90 0x7f44540c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f4453fff700 1 -- 172.21.15.154:0/1792906690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c009ae0 con 0x7f44540b1420 2023-10-10T21:21:26.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f444bfff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540cbf30 0x7f44540ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:26.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.665+0000 7f4453fff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540b1420 0x7f44540a9be0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f444400c590 tx=0x7f444400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:26.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.666+0000 7f4450ff9700 1 -- 172.21.15.154:0/1792906690 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444011590 con 0x7f44540b1420 2023-10-10T21:21:26.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.666+0000 7f4450ff9700 1 -- 172.21.15.154:0/1792906690 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444011710 con 0x7f44540b1420 2023-10-10T21:21:26.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.666+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44540aa890 con 0x7f44540b1420 2023-10-10T21:21:26.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.666+0000 7f4450ff9700 1 -- 172.21.15.154:0/1792906690 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444011ad0 con 0x7f44540b1420 2023-10-10T21:21:26.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.666+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44540aae50 con 0x7f44540b1420 2023-10-10T21:21:26.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.667+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445404c3c0 con 0x7f44540b1420 2023-10-10T21:21:26.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.668+0000 7f4450ff9700 1 -- 172.21.15.154:0/1792906690 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f444401b3b0 con 0x7f44540b1420 2023-10-10T21:21:26.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.668+0000 7f4450ff9700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4434066f30 0x7f44340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:26.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.669+0000 7f4450ff9700 1 -- 172.21.15.154:0/1792906690 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f4444083c80 con 0x7f44540b1420 2023-10-10T21:21:26.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.669+0000 7f444bfff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4434066f30 0x7f44340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:26.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.669+0000 7f444bfff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4434066f30 0x7f44340693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4454156100 tx=0x7f443c008040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:26.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.672+0000 7f4450ff9700 1 -- 172.21.15.154:0/1792906690 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4444050cb0 con 0x7f44540b1420 2023-10-10T21:21:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.862+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44540ad650 con 0x7f4434066f30 2023-10-10T21:21:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.870+0000 7f4450ff9700 1 -- 172.21.15.154:0/1792906690 <== mgr.7968 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278188 (secure 0 0 0) 0x7f44540ad650 con 0x7f4434066f30 2023-10-10T21:21:26.875 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4434066f30 msgr2=0x7f44340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4434066f30 0x7f44340693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4454156100 tx=0x7f443c008040 comp rx=0 tx=0).stop 2023-10-10T21:21:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540b1420 msgr2=0x7f44540a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540b1420 0x7f44540a9be0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f444400c590 tx=0x7f444400c8a0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 shutdown_connections 2023-10-10T21:21:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ccf90 0x7f44540c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4434066f30 0x7f44340693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44540b1420 0x7f44540a9be0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 --2- 172.21.15.154:0/1792906690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44540cbf30 0x7f44540ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.874+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 >> 172.21.15.154:0/1792906690 conn(0x7f445406a320 msgr2=0x7f44540afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.875+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 shutdown_connections 2023-10-10T21:21:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:26.875+0000 7f445a3ff700 1 -- 172.21.15.154:0/1792906690 wait complete. 2023-10-10T21:21:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:21:26.894 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T21:21:25.581823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454056,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752520664,"statfs":{"total":773094113280,"available":770581159936,"internally_reserved":0,"allocated":14655488,"data_stored":7774328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.955848"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628867+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:42:08.653575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631983+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:07:10.832777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635258+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:02.381417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635483+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:47:44.086230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.629406+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:53:40.974382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631600+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:07:10.142558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628182+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:07:10.832777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633524+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:37:33.069929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635660+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:07:17.115538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.632020+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:44:23.492820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.634245+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:03:02.253930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633009+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:36:30.134488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631353+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:32.025109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633846+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.634951+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:23.799410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.632079+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:26:45.494518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.634957+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:53.848986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633930+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:53.554860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628306+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:04:58.113017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.630878+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:30:38.764050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635408+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:16:05.567735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.630797+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:49:04.865763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.632059+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:41:06.233657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631581+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:58:11.716760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.633931+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:50:49.328696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631571+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:10.685980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.630969+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:00:11.299614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628813+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:27:26.067263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628200+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.635250+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:30:27.078527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.631461+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:08:00.005004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T21:21:20.624742+0000","last_change":"2023-10-10T21:21:20.624742+0000","last_active":"2023-10-10T21:21:20.624742+0000","last_peered":"2023-10-10T21:21:20.624742+0000","last_clean":"2023-10-10T21:21:20.624742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:20.624742+0000","last_undegraded":"2023-10-10T21:21:20.624742+0000","last_fullsized":"2023-10-10T21:21:20.624742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T21:21:19.617098+0000","last_change":"2023-10-10T21:21:19.628206+0000","last_active":"2023-10-10T21:21:19.617098+0000","last_peered":"2023-10-10T21:21:19.617098+0000","last_clean":"2023-10-10T21:21:19.617098+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T21:21:19.617098+0000","last_undegraded":"2023-10-10T21:21:19.617098+0000","last_fullsized":"2023-10-10T21:21:19.617098+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:23.299118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":731,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-10-10T21:21:17.144329+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:21:17.144329+0000","last_peered":"2023-10-10T21:21:17.144329+0000","last_clean":"2023-10-10T21:21:17.144329+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:21:17.144329+0000","last_undegraded":"2023-10-10T21:21:17.144329+0000","last_fullsized":"2023-10-10T21:21:17.144329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542369,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307704,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064136,"statfs":{"total":96636764160,"available":96321675264,"internally_reserved":0,"allocated":2277376,"data_stored":1414567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":1.052,"15min":1.052},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.441},"max":{"1min":0.91800000000000004,"5min":1.161,"15min":1.161},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90900000000000003,"5min":1.179,"15min":1.179},"last":0.92100000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.439,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.70899999999999996,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.93799999999999994,"5min":1.012,"15min":1.012},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.42199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.61799999999999999},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.36699999999999999},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.48999999999999999,"5min":0.40200000000000002,"15min":0.34599999999999997},"max":{"1min":0.91200000000000003,"5min":1.016,"15min":1.3700000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.41399999999999998,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.036},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.1200000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.54300000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79200000000000004,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.5},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.0109999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36499999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.0189999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.69799999999999995},"min":{"1min":0.48599999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.1040000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.42999999999999999},"max":{"1min":0.98199999999999998,"5min":1.0129999999999999,"15min":1.03},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.75600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.73899999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.68899999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.442},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.016},"last":0.64800000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0309999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.872,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38900000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.68799999999999994}]},{"osd":5,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.629},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70899999999999996,"15min":0.71799999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46400000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.54100000000000004,"15min":0.48799999999999999},"min":{"1min":0.28299999999999997,"5min":0.26200000000000001,"15min":0.24099999999999999},"max":{"1min":0.72899999999999998,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.623,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.48599999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":2.254,"15min":2.254},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.44800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75600000000000001,"5min":0.999,"15min":0.999},"last":0.44700000000000001}]},{"osd":4,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.54300000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94699999999999995,"5min":4.806,"15min":4.806},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.42199999999999999},"max":{"1min":0.98099999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.77900000000000003},"min":{"1min":0.48399999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97699999999999998,"5min":6.968,"15min":6.968},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.876,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90700000000000003,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.99399999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.72999999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":12.026,"15min":12.026},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0329999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.63900000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303608,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068232,"statfs":{"total":96636764160,"available":96325869568,"internally_reserved":0,"allocated":2277376,"data_stored":1414567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.60599999999999998,"5min":0.74399999999999999,"15min":0.752},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.49199999999999999,"15min":0.51600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.879,"15min":0.91800000000000004},"last":0.36199999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.72699999999999998,"15min":0.76700000000000002},"last":0.44},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41799999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.498,"15min":0.51400000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.73299999999999998,"15min":0.90300000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56799999999999995,"15min":0.59899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.81299999999999994,"15min":0.874},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1080000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73699999999999999,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.075,"5min":1.1679999999999999,"15min":1.2190000000000001},"last":0.749},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.018,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.54600000000000004}]},{"osd":6,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82099999999999995},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.008,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.59699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.143},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78400000000000003,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.036,"5min":1.139,"15min":1.169},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0549999999999999,"5min":1.097,"15min":1.165},"last":0.626}]}]},{"osd":2,"up_from":14,"seq":60129542370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311220,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060620,"statfs":{"total":96636764160,"available":96318074880,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":0.71799999999999997,"15min":0.95699999999999996},"last":0.316},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48999999999999999,"15min":0.50900000000000001},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.29599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.30599999999999999,"5min":0.28999999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.9099999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.502}]},{"osd":4,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73699999999999999,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0860000000000001,"15min":1.26},"last":0.77900000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.77800000000000002},"min":{"1min":0.54100000000000004,"5min":0.47499999999999998,"15min":0.46200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":2.21},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74199999999999999,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.52000000000000002,"15min":0.48399999999999999},"max":{"1min":1.1000000000000001,"5min":1.125,"15min":1.268},"last":0.76400000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76300000000000001,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.3080000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.54900000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.345,"15min":1.345},"last":0.878}]},{"osd":7,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.087,"5min":1.2290000000000001,"15min":1.716},"last":0.747},{"interface":"front","average":{"1min":0.746,"5min":0.75,"15min":0.79200000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2330000000000001},"last":0.85399999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509665,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.45500000000000002},"min":{"1min":0.316,"5min":0.28000000000000003,"15min":0.27900000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.83099999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59399999999999997,"5min":0.77000000000000002,"15min":0.84399999999999997},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":0.66400000000000003,"5min":0.87,"15min":0.87},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.38400000000000001,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70399999999999996,"5min":0.81000000000000005,"15min":0.92200000000000004},"last":0.53700000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.42599999999999999},"max":{"1min":0.95099999999999996,"5min":1.1200000000000001,"15min":1.3440000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.433},"max":{"1min":1.03,"5min":1.1339999999999999,"15min":1.246},"last":0.56399999999999995}]},{"osd":5,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.21,"15min":1.21},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.014,"5min":1.165,"15min":1.2250000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0549999999999999,"5min":1.081,"15min":1.27},"last":0.496},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":1.052,"15min":1.224},"last":0.64600000000000002}]},{"osd":7,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.117,"15min":1.1319999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.53500000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.98699999999999999,"5min":1.228,"15min":1.228},"last":0.59099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311220,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060620,"statfs":{"total":96636764160,"available":96318074880,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.68700000000000006},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.91000000000000003,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.72399999999999998},"min":{"1min":0.437,"5min":0.318,"15min":0.318},"max":{"1min":0.879,"5min":1.121,"15min":1.5029999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.1859999999999999,"15min":1.47},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":1.155,"15min":1.155},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.50700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0009999999999999,"5min":1.002,"15min":1.536},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":1.2330000000000001,"15min":1.397},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68100000000000005,"15min":0.71499999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0009999999999999,"5min":1.0800000000000001,"15min":1.385},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.93999999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.96299999999999997,"5min":1,"15min":1.196},"last":0.745}]},{"osd":6,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95599999999999996,"5min":1.0149999999999999,"15min":1.216},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.503,"5min":0.377,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":1.006,"15min":1.2390000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.442},"max":{"1min":0.91000000000000003,"5min":1.034,"15min":1.4139999999999999},"last":0.84899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1683456,"data_stored":824199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.95399999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.86899999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.97299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70799999999999996},"min":{"1min":0.46999999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94299999999999995,"5min":1.0009999999999999,"15min":1.018},"last":0.625}]},{"osd":2,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.01},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.2909999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.74199999999999999},"min":{"1min":0.57199999999999995,"5min":0.5,"15min":0.48799999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.044},"last":0.72799999999999998}]},{"osd":4,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92900000000000005,"5min":1.2110000000000001,"15min":1.5900000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":0.95099999999999996,"15min":1.496},"last":0.60199999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99299999999999999,"5min":1.131,"15min":1.131},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.54000000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85799999999999998}]},{"osd":7,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.46300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.008,"5min":1.097,"15min":1.097},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0329999999999999,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.89000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:21:26.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2023-10-10T21:21:26.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2023-10-10T21:21:26.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2023-10-10T21:21:26.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2023-10-10T21:21:26.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2023-10-10T21:21:26.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2023-10-10T21:21:26.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2023-10-10T21:21:26.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2023-10-10T21:21:26.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2023-10-10T21:21:26.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2023-10-10T21:21:26.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2023-10-10T21:21:26.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2023-10-10T21:21:26.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2023-10-10T21:21:26.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2023-10-10T21:21:26.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2023-10-10T21:21:26.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2023-10-10T21:21:26.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2023-10-10T21:21:26.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2023-10-10T21:21:26.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2023-10-10T21:21:26.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2023-10-10T21:21:26.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2023-10-10T21:21:26.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2023-10-10T21:21:26.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2023-10-10T21:21:26.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2023-10-10T21:21:26.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2023-10-10T21:21:26.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2023-10-10T21:21:26.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2023-10-10T21:21:26.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2023-10-10T21:21:26.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2023-10-10T21:21:26.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2023-10-10T21:21:26.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2023-10-10T21:21:26.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2023-10-10T21:21:26.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2023-10-10T21:21:26.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-10-10T21:21:26.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.628867+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T21:42:08.653575+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:21:26.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2023-10-10T21:21:26.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-10-10T21:21:26.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.631983+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:07:10.832777+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T21:21:26.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2023-10-10T21:21:26.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-10-10T21:21:26.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.635258+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:39:02.381417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:21:26.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2023-10-10T21:21:26.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-10-10T21:21:26.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.635483+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:47:44.086230+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:21:26.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2023-10-10T21:21:26.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-10-10T21:21:26.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.629406+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T21:53:40.974382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:21:26.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2023-10-10T21:21:26.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-10-10T21:21:26.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.631600+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:07:10.142558+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:21:26.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2023-10-10T21:21:26.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-10-10T21:21:26.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.628182+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:07:10.832777+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:21:26.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2023-10-10T21:21:26.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-10-10T21:21:26.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.633524+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:37:33.069929+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:21:26.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2023-10-10T21:21:26.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-10-10T21:21:26.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.635660+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:07:17.115538+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:21:26.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2023-10-10T21:21:26.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-10-10T21:21:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.632020+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:44:23.492820+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:21:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2023-10-10T21:21:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-10-10T21:21:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.634245+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:03:02.253930+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:21:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2023-10-10T21:21:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-10-10T21:21:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.633009+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:36:30.134488+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:21:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2023-10-10T21:21:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-10-10T21:21:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.631353+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:14:32.025109+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:21:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2023-10-10T21:21:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-10-10T21:21:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.633846+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:21:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2023-10-10T21:21:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-10-10T21:21:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.634951+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:01:23.799410+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:21:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2023-10-10T21:21:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-10-10T21:21:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.632079+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:26:45.494518+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:21:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2023-10-10T21:21:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-10-10T21:21:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.634957+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:41:53.848986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:21:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2023-10-10T21:21:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-10-10T21:21:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.633930+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:01:53.554860+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:21:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2023-10-10T21:21:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-10-10T21:21:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.628306+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:04:58.113017+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:21:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2023-10-10T21:21:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-10-10T21:21:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.630878+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:30:38.764050+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:21:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2023-10-10T21:21:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-10-10T21:21:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.635408+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:16:05.567735+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:21:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2023-10-10T21:21:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-10-10T21:21:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.630797+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:49:04.865763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T21:21:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2023-10-10T21:21:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-10-10T21:21:26.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.632059+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:41:06.233657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:21:26.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2023-10-10T21:21:26.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-10-10T21:21:26.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.631581+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:58:11.716760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:21:26.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2023-10-10T21:21:26.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-10-10T21:21:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.633931+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:50:49.328696+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T21:21:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2023-10-10T21:21:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-10-10T21:21:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.631571+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:23:10.685980+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:21:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2023-10-10T21:21:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-10-10T21:21:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.630969+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:00:11.299614+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T21:21:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2023-10-10T21:21:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-10-10T21:21:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.628813+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:27:26.067263+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:21:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2023-10-10T21:21:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-10-10T21:21:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.628200+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T21:21:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2023-10-10T21:21:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-10-10T21:21:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.635250+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:30:27.078527+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T21:21:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2023-10-10T21:21:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-10-10T21:21:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.631461+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:08:00.005004+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T21:21:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2023-10-10T21:21:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T21:21:20.624742+0000', 'last_change': '2023-10-10T21:21:20.624742+0000', 'last_active': '2023-10-10T21:21:20.624742+0000', 'last_peered': '2023-10-10T21:21:20.624742+0000', 'last_clean': '2023-10-10T21:21:20.624742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:20.624742+0000', 'last_undegraded': '2023-10-10T21:21:20.624742+0000', 'last_fullsized': '2023-10-10T21:21:20.624742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:20.624742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T21:21:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-10-10T21:21:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T21:21:19.617098+0000', 'last_change': '2023-10-10T21:21:19.628206+0000', 'last_active': '2023-10-10T21:21:19.617098+0000', 'last_peered': '2023-10-10T21:21:19.617098+0000', 'last_clean': '2023-10-10T21:21:19.617098+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T21:21:19.617098+0000', 'last_undegraded': '2023-10-10T21:21:19.617098+0000', 'last_fullsized': '2023-10-10T21:21:19.617098+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'last_clean_scrub_stamp': '2023-10-10T21:21:19.617098+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:24:23.299118+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T21:21:26.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T21:21:27.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.158+0000 7f14c679d700 1 Processor -- start 2023-10-10T21:21:27.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.158+0000 7f14c679d700 1 -- start start 2023-10-10T21:21:27.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.159+0000 7f14c679d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14c01559a0 0x7f14c0069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.159+0000 7f14c679d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 0x7f14c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.159+0000 7f14c679d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c00c6810 con 0x7f14c0155d70 2023-10-10T21:21:27.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.159+0000 7f14c679d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c00c7390 con 0x7f14c01559a0 2023-10-10T21:21:27.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.159+0000 7f14c679d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c00c6a60 con 0x7f14c00ac210 2023-10-10T21:21:27.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.159+0000 7f14c579b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14c01559a0 0x7f14c0069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.159+0000 7f14c5f9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f14c0155d70 0x7f14c006deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49402/0 (socket says 172.21.15.154:49402) 2023-10-10T21:21:27.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.159+0000 7f14c5f9c700 1 -- 172.21.15.154:0/4204657655 learned_addr learned my addr 172.21.15.154:0/4204657655 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:27.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.160+0000 7f14c4f9a700 1 --2- 172.21.15.154:0/4204657655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 0x7f14c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.160+0000 7f14c579b700 1 -- 172.21.15.154:0/4204657655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 msgr2=0x7f14c0069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:27.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.160+0000 7f14c579b700 1 --2- 172.21.15.154:0/4204657655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 0x7f14c0069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.160+0000 7f14c579b700 1 -- 172.21.15.154:0/4204657655 >> v1:172.21.15.154:6789/0 conn(0x7f14c0155d70 legacy=0x7f14c006deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.160+0000 7f14c579b700 1 -- 172.21.15.154:0/4204657655 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c00c6d40 con 0x7f14c01559a0 2023-10-10T21:21:27.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.160+0000 7f14c579b700 1 --2- 172.21.15.154:0/4204657655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c01559a0 0x7f14c0069870 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009e90 tx=0x7f14bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb1705e95cc91a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:27.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.160+0000 7f14b7fff700 1 -- 172.21.15.154:0/4204657655 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00e070 con 0x7f14c01559a0 2023-10-10T21:21:27.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.160+0000 7f14b7fff700 1 -- 172.21.15.154:0/4204657655 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc00bbf0 con 0x7f14c01559a0 2023-10-10T21:21:27.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.160+0000 7f14b7fff700 1 -- 172.21.15.154:0/4204657655 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc012430 con 0x7f14c01559a0 2023-10-10T21:21:27.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.161+0000 7f14c679d700 1 -- 172.21.15.154:0/4204657655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c01559a0 msgr2=0x7f14c0069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.161+0000 7f14c679d700 1 --2- 172.21.15.154:0/4204657655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c01559a0 0x7f14c0069870 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009e90 tx=0x7f14bc009780 comp rx=0 tx=0).stop 2023-10-10T21:21:27.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.161+0000 7f14c679d700 1 -- 172.21.15.154:0/4204657655 shutdown_connections 2023-10-10T21:21:27.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.161+0000 7f14c679d700 1 --2- 172.21.15.154:0/4204657655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c01559a0 0x7f14c0069870 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.161+0000 7f14c679d700 1 --2- 172.21.15.154:0/4204657655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 0x7f14c0069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.161+0000 7f14c679d700 1 -- 172.21.15.154:0/4204657655 >> 172.21.15.154:0/4204657655 conn(0x7f14c00ccca0 msgr2=0x7f14c00c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:27.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.161+0000 7f14c679d700 1 -- 172.21.15.154:0/4204657655 shutdown_connections 2023-10-10T21:21:27.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.161+0000 7f14c679d700 1 -- 172.21.15.154:0/4204657655 wait complete. 2023-10-10T21:21:27.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.162+0000 7f14c679d700 1 Processor -- start 2023-10-10T21:21:27.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.163+0000 7f14c679d700 1 -- start start 2023-10-10T21:21:27.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c679d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 0x7f14c00c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c679d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14c01559a0 0x7f14c0143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c679d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0155d70 0x7f14c00c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c679d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c00c8ce0 con 0x7f14c0155d70 2023-10-10T21:21:27.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c679d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c00c8fc0 con 0x7f14c01559a0 2023-10-10T21:21:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c679d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c00c92a0 con 0x7f14c00ac210 2023-10-10T21:21:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c5f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0155d70 0x7f14c00c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c5f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0155d70 0x7f14c00c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58904/0 (socket says 172.21.15.154:58904) 2023-10-10T21:21:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c5f9c700 1 -- 172.21.15.154:0/78174222 learned_addr learned my addr 172.21.15.154:0/78174222 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c579b700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 0x7f14c00c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c4f9a700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14c01559a0 0x7f14c0143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c5f9c700 1 -- 172.21.15.154:0/78174222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 msgr2=0x7f14c00c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c5f9c700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 0x7f14c00c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c5f9c700 1 -- 172.21.15.154:0/78174222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14c01559a0 msgr2=0x7f14c0143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c5f9c700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14c01559a0 0x7f14c0143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c5f9c700 1 -- 172.21.15.154:0/78174222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc009a20 con 0x7f14c0155d70 2023-10-10T21:21:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.164+0000 7f14c5f9c700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0155d70 0x7f14c00c57e0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c560 tx=0x7f14b8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.165+0000 7f14b57fa700 1 -- 172.21.15.154:0/78174222 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8005b30 con 0x7f14c0155d70 2023-10-10T21:21:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.165+0000 7f14b57fa700 1 -- 172.21.15.154:0/78174222 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b8005c90 con 0x7f14c0155d70 2023-10-10T21:21:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.165+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c00c9580 con 0x7f14c0155d70 2023-10-10T21:21:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.165+0000 7f14b57fa700 1 -- 172.21.15.154:0/78174222 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b80072e0 con 0x7f14c0155d70 2023-10-10T21:21:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.165+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c00c5d20 con 0x7f14c0155d70 2023-10-10T21:21:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.166+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c00c9100 con 0x7f14c0155d70 2023-10-10T21:21:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.167+0000 7f14b57fa700 1 -- 172.21.15.154:0/78174222 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14b8007690 con 0x7f14c0155d70 2023-10-10T21:21:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.168+0000 7f14b57fa700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14a4066f30 0x7f14a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.168+0000 7f14b57fa700 1 -- 172.21.15.154:0/78174222 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f14b8083ad0 con 0x7f14c0155d70 2023-10-10T21:21:27.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.168+0000 7f14c579b700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14a4066f30 0x7f14a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.168+0000 7f14c579b700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14a4066f30 0x7f14a40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009fd0 tx=0x7f14bc019000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:27.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.172+0000 7f14b57fa700 1 -- 172.21.15.154:0/78174222 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14b804b5a0 con 0x7f14c0155d70 2023-10-10T21:21:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.438+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f14c00c9aa0 con 0x7f14c0155d70 2023-10-10T21:21:27.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.438+0000 7f14b57fa700 1 -- 172.21.15.154:0/78174222 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1113 (secure 0 0 0) 0x7f14c00c9aa0 con 0x7f14c0155d70 2023-10-10T21:21:27.440 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:27.440 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1172,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":139,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2512953344,"bytes_avail":770581159936,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":62,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8148}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-10T21:20:06.320122+0000","services":{}},"progress_events":{}} 2023-10-10T21:21:27.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14a4066f30 msgr2=0x7f14a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14a4066f30 0x7f14a40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009fd0 tx=0x7f14bc019000 comp rx=0 tx=0).stop 2023-10-10T21:21:27.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0155d70 msgr2=0x7f14c00c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0155d70 0x7f14c00c57e0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c560 tx=0x7f14b8007f60 comp rx=0 tx=0).stop 2023-10-10T21:21:27.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 shutdown_connections 2023-10-10T21:21:27.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14a4066f30 0x7f14a40693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0155d70 0x7f14c00c57e0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14c00ac210 0x7f14c00c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 --2- 172.21.15.154:0/78174222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14c01559a0 0x7f14c0143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 >> 172.21.15.154:0/78174222 conn(0x7f14c00ccca0 msgr2=0x7f14c00acb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:27.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 shutdown_connections 2023-10-10T21:21:27.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.441+0000 7f14c679d700 1 -- 172.21.15.154:0/78174222 wait complete. 2023-10-10T21:21:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T21:21:27.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:21:27.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.642+0000 7f656bbff700 1 Processor -- start 2023-10-10T21:21:27.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.643+0000 7f656bbff700 1 -- start start 2023-10-10T21:21:27.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.644+0000 7f656bbff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65640ccf90 0x7f65640ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.644+0000 7f656bbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65640cc300 con 0x7f65640b1420 2023-10-10T21:21:27.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.644+0000 7f656bbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65640ad370 con 0x7f65640cbf30 2023-10-10T21:21:27.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.644+0000 7f656bbff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6564156bf0 con 0x7f65640ccf90 2023-10-10T21:21:27.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.644+0000 7f656a19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65640ccf90 0x7f65640ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.644+0000 7f656919a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f65640b1420 0x7f65640c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49414/0 (socket says 172.21.15.154:49414) 2023-10-10T21:21:27.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.644+0000 7f656919a700 1 -- 172.21.15.154:0/1857543421 learned_addr learned my addr 172.21.15.154:0/1857543421 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:27.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.645+0000 7f656a19c700 1 -- 172.21.15.154:0/1857543421 >> v1:172.21.15.179:6789/0 conn(0x7f65640cbf30 legacy=0x7f65640b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.645+0000 7f656a19c700 1 -- 172.21.15.154:0/1857543421 >> v1:172.21.15.154:6789/0 conn(0x7f65640b1420 legacy=0x7f65640c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.645+0000 7f656a19c700 1 -- 172.21.15.154:0/1857543421 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640ad650 con 0x7f65640ccf90 2023-10-10T21:21:27.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.645+0000 7f6568999700 1 -- 172.21.15.154:0/1857543421 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321491438 0 0) 0x7f65640cc300 con 0x7f65640b1420 2023-10-10T21:21:27.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.645+0000 7f656a19c700 1 --2- 172.21.15.154:0/1857543421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 0x7f65640ae410 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f655c009e60 tx=0x7f655c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d87c1444152118 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:27.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.645+0000 7f6568999700 1 -- 172.21.15.154:0/1857543421 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c00e070 con 0x7f65640ccf90 2023-10-10T21:21:27.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.645+0000 7f6568999700 1 -- 172.21.15.154:0/1857543421 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c00bc30 con 0x7f65640ccf90 2023-10-10T21:21:27.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.645+0000 7f6568999700 1 -- 172.21.15.154:0/1857543421 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c012430 con 0x7f65640ccf90 2023-10-10T21:21:27.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.646+0000 7f656bbff700 1 -- 172.21.15.154:0/1857543421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 msgr2=0x7f65640ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.646+0000 7f656bbff700 1 --2- 172.21.15.154:0/1857543421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 0x7f65640ae410 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f655c009e60 tx=0x7f655c009780 comp rx=0 tx=0).stop 2023-10-10T21:21:27.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.646+0000 7f656bbff700 1 -- 172.21.15.154:0/1857543421 shutdown_connections 2023-10-10T21:21:27.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.646+0000 7f656bbff700 1 --2- 172.21.15.154:0/1857543421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 0x7f65640ae410 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.646+0000 7f656bbff700 1 -- 172.21.15.154:0/1857543421 >> 172.21.15.154:0/1857543421 conn(0x7f656406a320 msgr2=0x7f65640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:27.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.646+0000 7f656bbff700 1 -- 172.21.15.154:0/1857543421 shutdown_connections 2023-10-10T21:21:27.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.646+0000 7f656bbff700 1 -- 172.21.15.154:0/1857543421 wait complete. 2023-10-10T21:21:27.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.647+0000 7f656bbff700 1 Processor -- start 2023-10-10T21:21:27.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.648+0000 7f656bbff700 1 -- start start 2023-10-10T21:21:27.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.648+0000 7f656bbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65640b1420 0x7f65640a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.648+0000 7f656bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65640cbf30 0x7f65640a7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.648+0000 7f656bbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 0x7f65641554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.648+0000 7f656bbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65640a9d40 con 0x7f65640ccf90 2023-10-10T21:21:27.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.648+0000 7f656bbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65640a8840 con 0x7f65640b1420 2023-10-10T21:21:27.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.648+0000 7f656bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65640a7a60 con 0x7f65640cbf30 2023-10-10T21:21:27.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656a19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 0x7f65641554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656a19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 0x7f65641554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58926/0 (socket says 172.21.15.154:58926) 2023-10-10T21:21:27.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656a19c700 1 -- 172.21.15.154:0/3971026448 learned_addr learned my addr 172.21.15.154:0/3971026448 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:27.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656919a700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65640cbf30 0x7f65640a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656a19c700 1 -- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65640cbf30 msgr2=0x7f65640a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656a19c700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65640cbf30 0x7f65640a7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656a19c700 1 -- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65640b1420 msgr2=0x7f65640a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656999b700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65640b1420 0x7f65640a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656a19c700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65640b1420 0x7f65640a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656a19c700 1 -- 172.21.15.154:0/3971026448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c009a20 con 0x7f65640ccf90 2023-10-10T21:21:27.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656919a700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65640cbf30 0x7f65640a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:27.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656999b700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65640b1420 0x7f65640a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:27.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.649+0000 7f656a19c700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 0x7f65641554f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f6564064290 tx=0x7f655c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:27.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.650+0000 7f6559ffb700 1 -- 172.21.15.154:0/3971026448 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c01b630 con 0x7f65640ccf90 2023-10-10T21:21:27.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.650+0000 7f6559ffb700 1 -- 172.21.15.154:0/3971026448 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c01b790 con 0x7f65640ccf90 2023-10-10T21:21:27.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.650+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65640a7cc0 con 0x7f65640ccf90 2023-10-10T21:21:27.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.650+0000 7f6559ffb700 1 -- 172.21.15.154:0/3971026448 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c01bb50 con 0x7f65640ccf90 2023-10-10T21:21:27.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.650+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65640a8280 con 0x7f65640ccf90 2023-10-10T21:21:27.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.651+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65640a9ed0 con 0x7f65640ccf90 2023-10-10T21:21:27.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.652+0000 7f6559ffb700 1 -- 172.21.15.154:0/3971026448 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f655c003020 con 0x7f65640ccf90 2023-10-10T21:21:27.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.653+0000 7f6559ffb700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6548066f60 0x7f6548069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:27.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.653+0000 7f6559ffb700 1 -- 172.21.15.154:0/3971026448 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f655c086370 con 0x7f65640ccf90 2023-10-10T21:21:27.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.653+0000 7f656999b700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6548066f60 0x7f6548069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:27.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.653+0000 7f656999b700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6548066f60 0x7f6548069410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6560001840 tx=0x7f6560009040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:27.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.657+0000 7f6559ffb700 1 -- 172.21.15.154:0/3971026448 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65640a9ed0 con 0x7f65640ccf90 2023-10-10T21:21:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.844+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65640a9ed0 con 0x7f6548066f60 2023-10-10T21:21:27.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.852+0000 7f6559ffb700 1 -- 172.21.15.154:0/3971026448 <== mgr.7968 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289189 (secure 0 0 0) 0x7f65640a9ed0 con 0x7f6548066f60 2023-10-10T21:21:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:27.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.856+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6548066f60 msgr2=0x7f6548069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.856+0000 7f656bbff700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6548066f60 0x7f6548069410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6560001840 tx=0x7f6560009040 comp rx=0 tx=0).stop 2023-10-10T21:21:27.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.856+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 msgr2=0x7f65641554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:27.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.856+0000 7f656bbff700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 0x7f65641554f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f6564064290 tx=0x7f655c019000 comp rx=0 tx=0).stop 2023-10-10T21:21:27.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.857+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 shutdown_connections 2023-10-10T21:21:27.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.857+0000 7f656bbff700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6548066f60 0x7f6548069410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.857+0000 7f656bbff700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65640ccf90 0x7f65641554f0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.857+0000 7f656bbff700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65640b1420 0x7f65640a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.857+0000 7f656bbff700 1 --2- 172.21.15.154:0/3971026448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65640cbf30 0x7f65640a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:27.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.857+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 >> 172.21.15.154:0/3971026448 conn(0x7f656406a320 msgr2=0x7f656415a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:27.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.857+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 shutdown_connections 2023-10-10T21:21:27.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:27.857+0000 7f656bbff700 1 -- 172.21.15.154:0/3971026448 wait complete. 2023-10-10T21:21:27.862 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:21:27.875 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-10T21:21:27.582237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454408,"kb_used_data":14664,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752520312,"statfs":{"total":773094113280,"available":770580799488,"internally_reserved":0,"allocated":15015936,"data_stored":7943532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.952845"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.672881+0000","last_change":"2023-10-10T21:21:21.664038+0000","last_active":"2023-10-10T21:21:21.672881+0000","last_peered":"2023-10-10T21:21:21.672881+0000","last_clean":"2023-10-10T21:21:21.672881+0000","last_became_active":"2023-10-10T21:21:21.663795+0000","last_became_peered":"2023-10-10T21:21:21.663795+0000","last_unstale":"2023-10-10T21:21:21.672881+0000","last_undegraded":"2023-10-10T21:21:21.672881+0000","last_fullsized":"2023-10-10T21:21:21.672881+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:26:52.774597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665072+0000","last_change":"2023-10-10T21:21:21.659801+0000","last_active":"2023-10-10T21:21:21.665072+0000","last_peered":"2023-10-10T21:21:21.665072+0000","last_clean":"2023-10-10T21:21:21.665072+0000","last_became_active":"2023-10-10T21:21:21.659518+0000","last_became_peered":"2023-10-10T21:21:21.659518+0000","last_unstale":"2023-10-10T21:21:21.665072+0000","last_undegraded":"2023-10-10T21:21:21.665072+0000","last_fullsized":"2023-10-10T21:21:21.665072+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:16:43.317454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671136+0000","last_change":"2023-10-10T21:21:21.667942+0000","last_active":"2023-10-10T21:21:21.671136+0000","last_peered":"2023-10-10T21:21:21.671136+0000","last_clean":"2023-10-10T21:21:21.671136+0000","last_became_active":"2023-10-10T21:21:21.667664+0000","last_became_peered":"2023-10-10T21:21:21.667664+0000","last_unstale":"2023-10-10T21:21:21.671136+0000","last_undegraded":"2023-10-10T21:21:21.671136+0000","last_fullsized":"2023-10-10T21:21:21.671136+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:12.108101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674004+0000","last_change":"2023-10-10T21:21:21.664994+0000","last_active":"2023-10-10T21:21:21.674004+0000","last_peered":"2023-10-10T21:21:21.674004+0000","last_clean":"2023-10-10T21:21:21.674004+0000","last_became_active":"2023-10-10T21:21:21.664396+0000","last_became_peered":"2023-10-10T21:21:21.664396+0000","last_unstale":"2023-10-10T21:21:21.674004+0000","last_undegraded":"2023-10-10T21:21:21.674004+0000","last_fullsized":"2023-10-10T21:21:21.674004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:02:59.345179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.658984+0000","last_change":"2023-10-10T21:21:21.657336+0000","last_active":"2023-10-10T21:21:21.658984+0000","last_peered":"2023-10-10T21:21:21.658984+0000","last_clean":"2023-10-10T21:21:21.658984+0000","last_became_active":"2023-10-10T21:21:21.657092+0000","last_became_peered":"2023-10-10T21:21:21.657092+0000","last_unstale":"2023-10-10T21:21:21.658984+0000","last_undegraded":"2023-10-10T21:21:21.658984+0000","last_fullsized":"2023-10-10T21:21:21.658984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:43:30.649591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668708+0000","last_change":"2023-10-10T21:21:21.665875+0000","last_active":"2023-10-10T21:21:21.668708+0000","last_peered":"2023-10-10T21:21:21.668708+0000","last_clean":"2023-10-10T21:21:21.668708+0000","last_became_active":"2023-10-10T21:21:21.665476+0000","last_became_peered":"2023-10-10T21:21:21.665476+0000","last_unstale":"2023-10-10T21:21:21.668708+0000","last_undegraded":"2023-10-10T21:21:21.668708+0000","last_fullsized":"2023-10-10T21:21:21.668708+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:08.609516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665263+0000","last_change":"2023-10-10T21:21:21.662823+0000","last_active":"2023-10-10T21:21:21.665263+0000","last_peered":"2023-10-10T21:21:21.665263+0000","last_clean":"2023-10-10T21:21:21.665263+0000","last_became_active":"2023-10-10T21:21:21.662577+0000","last_became_peered":"2023-10-10T21:21:21.662577+0000","last_unstale":"2023-10-10T21:21:21.665263+0000","last_undegraded":"2023-10-10T21:21:21.665263+0000","last_fullsized":"2023-10-10T21:21:21.665263+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:27:25.351466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668935+0000","last_change":"2023-10-10T21:21:21.666043+0000","last_active":"2023-10-10T21:21:21.668935+0000","last_peered":"2023-10-10T21:21:21.668935+0000","last_clean":"2023-10-10T21:21:21.668935+0000","last_became_active":"2023-10-10T21:21:21.665765+0000","last_became_peered":"2023-10-10T21:21:21.665765+0000","last_unstale":"2023-10-10T21:21:21.668935+0000","last_undegraded":"2023-10-10T21:21:21.668935+0000","last_fullsized":"2023-10-10T21:21:21.668935+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:29:56.991666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667699+0000","last_change":"2023-10-10T21:21:21.659300+0000","last_active":"2023-10-10T21:21:21.667699+0000","last_peered":"2023-10-10T21:21:21.667699+0000","last_clean":"2023-10-10T21:21:21.667699+0000","last_became_active":"2023-10-10T21:21:21.659068+0000","last_became_peered":"2023-10-10T21:21:21.659068+0000","last_unstale":"2023-10-10T21:21:21.667699+0000","last_undegraded":"2023-10-10T21:21:21.667699+0000","last_fullsized":"2023-10-10T21:21:21.667699+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:58:22.037870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674088+0000","last_change":"2023-10-10T21:21:21.666953+0000","last_active":"2023-10-10T21:21:21.674088+0000","last_peered":"2023-10-10T21:21:21.674088+0000","last_clean":"2023-10-10T21:21:21.674088+0000","last_became_active":"2023-10-10T21:21:21.666679+0000","last_became_peered":"2023-10-10T21:21:21.666679+0000","last_unstale":"2023-10-10T21:21:21.674088+0000","last_undegraded":"2023-10-10T21:21:21.674088+0000","last_fullsized":"2023-10-10T21:21:21.674088+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:53:22.532253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665115+0000","last_change":"2023-10-10T21:21:21.658476+0000","last_active":"2023-10-10T21:21:21.665115+0000","last_peered":"2023-10-10T21:21:21.665115+0000","last_clean":"2023-10-10T21:21:21.665115+0000","last_became_active":"2023-10-10T21:21:21.658196+0000","last_became_peered":"2023-10-10T21:21:21.658196+0000","last_unstale":"2023-10-10T21:21:21.665115+0000","last_undegraded":"2023-10-10T21:21:21.665115+0000","last_fullsized":"2023-10-10T21:21:21.665115+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:17:52.664979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674022+0000","last_change":"2023-10-10T21:21:21.665163+0000","last_active":"2023-10-10T21:21:21.674022+0000","last_peered":"2023-10-10T21:21:21.674022+0000","last_clean":"2023-10-10T21:21:21.674022+0000","last_became_active":"2023-10-10T21:21:21.664743+0000","last_became_peered":"2023-10-10T21:21:21.664743+0000","last_unstale":"2023-10-10T21:21:21.674022+0000","last_undegraded":"2023-10-10T21:21:21.674022+0000","last_fullsized":"2023-10-10T21:21:21.674022+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:11:39.895420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665340+0000","last_change":"2023-10-10T21:21:21.658974+0000","last_active":"2023-10-10T21:21:21.665340+0000","last_peered":"2023-10-10T21:21:21.665340+0000","last_clean":"2023-10-10T21:21:21.665340+0000","last_became_active":"2023-10-10T21:21:21.658726+0000","last_became_peered":"2023-10-10T21:21:21.658726+0000","last_unstale":"2023-10-10T21:21:21.665340+0000","last_undegraded":"2023-10-10T21:21:21.665340+0000","last_fullsized":"2023-10-10T21:21:21.665340+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:02:10.861239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665205+0000","last_change":"2023-10-10T21:21:21.657433+0000","last_active":"2023-10-10T21:21:21.665205+0000","last_peered":"2023-10-10T21:21:21.665205+0000","last_clean":"2023-10-10T21:21:21.665205+0000","last_became_active":"2023-10-10T21:21:21.657136+0000","last_became_peered":"2023-10-10T21:21:21.657136+0000","last_unstale":"2023-10-10T21:21:21.665205+0000","last_undegraded":"2023-10-10T21:21:21.665205+0000","last_fullsized":"2023-10-10T21:21:21.665205+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:03:03.261575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668878+0000","last_change":"2023-10-10T21:21:21.666186+0000","last_active":"2023-10-10T21:21:21.668878+0000","last_peered":"2023-10-10T21:21:21.668878+0000","last_clean":"2023-10-10T21:21:21.668878+0000","last_became_active":"2023-10-10T21:21:21.665695+0000","last_became_peered":"2023-10-10T21:21:21.665695+0000","last_unstale":"2023-10-10T21:21:21.668878+0000","last_undegraded":"2023-10-10T21:21:21.668878+0000","last_fullsized":"2023-10-10T21:21:21.668878+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:43.403922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.673669+0000","last_change":"2023-10-10T21:21:21.659097+0000","last_active":"2023-10-10T21:21:21.673669+0000","last_peered":"2023-10-10T21:21:21.673669+0000","last_clean":"2023-10-10T21:21:21.673669+0000","last_became_active":"2023-10-10T21:21:21.658855+0000","last_became_peered":"2023-10-10T21:21:21.658855+0000","last_unstale":"2023-10-10T21:21:21.673669+0000","last_undegraded":"2023-10-10T21:21:21.673669+0000","last_fullsized":"2023-10-10T21:21:21.673669+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:27:55.174673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671295+0000","last_change":"2023-10-10T21:21:21.669147+0000","last_active":"2023-10-10T21:21:21.671295+0000","last_peered":"2023-10-10T21:21:21.671295+0000","last_clean":"2023-10-10T21:21:21.671295+0000","last_became_active":"2023-10-10T21:21:21.658015+0000","last_became_peered":"2023-10-10T21:21:21.658015+0000","last_unstale":"2023-10-10T21:21:21.671295+0000","last_undegraded":"2023-10-10T21:21:21.671295+0000","last_fullsized":"2023-10-10T21:21:21.671295+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:39.106972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671089+0000","last_change":"2023-10-10T21:21:21.668427+0000","last_active":"2023-10-10T21:21:21.671089+0000","last_peered":"2023-10-10T21:21:21.671089+0000","last_clean":"2023-10-10T21:21:21.671089+0000","last_became_active":"2023-10-10T21:21:21.668104+0000","last_became_peered":"2023-10-10T21:21:21.668104+0000","last_unstale":"2023-10-10T21:21:21.671089+0000","last_undegraded":"2023-10-10T21:21:21.671089+0000","last_fullsized":"2023-10-10T21:21:21.671089+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:58.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668045+0000","last_change":"2023-10-10T21:21:21.662646+0000","last_active":"2023-10-10T21:21:21.668045+0000","last_peered":"2023-10-10T21:21:21.668045+0000","last_clean":"2023-10-10T21:21:21.668045+0000","last_became_active":"2023-10-10T21:21:21.662322+0000","last_became_peered":"2023-10-10T21:21:21.662322+0000","last_unstale":"2023-10-10T21:21:21.668045+0000","last_undegraded":"2023-10-10T21:21:21.668045+0000","last_fullsized":"2023-10-10T21:21:21.668045+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:05.178891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.669946+0000","last_change":"2023-10-10T21:21:21.664290+0000","last_active":"2023-10-10T21:21:21.669946+0000","last_peered":"2023-10-10T21:21:21.669946+0000","last_clean":"2023-10-10T21:21:21.669946+0000","last_became_active":"2023-10-10T21:21:21.663976+0000","last_became_peered":"2023-10-10T21:21:21.663976+0000","last_unstale":"2023-10-10T21:21:21.669946+0000","last_undegraded":"2023-10-10T21:21:21.669946+0000","last_fullsized":"2023-10-10T21:21:21.669946+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:29:56.991666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.670132+0000","last_change":"2023-10-10T21:21:21.665533+0000","last_active":"2023-10-10T21:21:21.670132+0000","last_peered":"2023-10-10T21:21:21.670132+0000","last_clean":"2023-10-10T21:21:21.670132+0000","last_became_active":"2023-10-10T21:21:21.665053+0000","last_became_peered":"2023-10-10T21:21:21.665053+0000","last_unstale":"2023-10-10T21:21:21.670132+0000","last_undegraded":"2023-10-10T21:21:21.670132+0000","last_fullsized":"2023-10-10T21:21:21.670132+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:02:10.861239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668533+0000","last_change":"2023-10-10T21:21:21.659417+0000","last_active":"2023-10-10T21:21:21.668533+0000","last_peered":"2023-10-10T21:21:21.668533+0000","last_clean":"2023-10-10T21:21:21.668533+0000","last_became_active":"2023-10-10T21:21:21.659174+0000","last_became_peered":"2023-10-10T21:21:21.659174+0000","last_unstale":"2023-10-10T21:21:21.668533+0000","last_undegraded":"2023-10-10T21:21:21.668533+0000","last_fullsized":"2023-10-10T21:21:21.668533+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:18:30.235487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665248+0000","last_change":"2023-10-10T21:21:21.655912+0000","last_active":"2023-10-10T21:21:21.665248+0000","last_peered":"2023-10-10T21:21:21.665248+0000","last_clean":"2023-10-10T21:21:21.665248+0000","last_became_active":"2023-10-10T21:21:21.654706+0000","last_became_peered":"2023-10-10T21:21:21.654706+0000","last_unstale":"2023-10-10T21:21:21.665248+0000","last_undegraded":"2023-10-10T21:21:21.665248+0000","last_fullsized":"2023-10-10T21:21:21.665248+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:14:22.263178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668752+0000","last_change":"2023-10-10T21:21:21.658765+0000","last_active":"2023-10-10T21:21:21.668752+0000","last_peered":"2023-10-10T21:21:21.668752+0000","last_clean":"2023-10-10T21:21:21.668752+0000","last_became_active":"2023-10-10T21:21:21.658522+0000","last_became_peered":"2023-10-10T21:21:21.658522+0000","last_unstale":"2023-10-10T21:21:21.668752+0000","last_undegraded":"2023-10-10T21:21:21.668752+0000","last_fullsized":"2023-10-10T21:21:21.668752+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:58:34.129758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.669314+0000","last_change":"2023-10-10T21:21:21.658676+0000","last_active":"2023-10-10T21:21:21.669314+0000","last_peered":"2023-10-10T21:21:21.669314+0000","last_clean":"2023-10-10T21:21:21.669314+0000","last_became_active":"2023-10-10T21:21:21.658410+0000","last_became_peered":"2023-10-10T21:21:21.658410+0000","last_unstale":"2023-10-10T21:21:21.669314+0000","last_undegraded":"2023-10-10T21:21:21.669314+0000","last_fullsized":"2023-10-10T21:21:21.669314+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:05.178891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.669347+0000","last_change":"2023-10-10T21:21:21.653720+0000","last_active":"2023-10-10T21:21:21.669347+0000","last_peered":"2023-10-10T21:21:21.669347+0000","last_clean":"2023-10-10T21:21:21.669347+0000","last_became_active":"2023-10-10T21:21:21.653135+0000","last_became_peered":"2023-10-10T21:21:21.653135+0000","last_unstale":"2023-10-10T21:21:21.669347+0000","last_undegraded":"2023-10-10T21:21:21.669347+0000","last_fullsized":"2023-10-10T21:21:21.669347+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:49:17.195828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677708+0000","last_change":"2023-10-10T21:21:21.673017+0000","last_active":"2023-10-10T21:21:21.677708+0000","last_peered":"2023-10-10T21:21:21.677708+0000","last_clean":"2023-10-10T21:21:21.677708+0000","last_became_active":"2023-10-10T21:21:21.672741+0000","last_became_peered":"2023-10-10T21:21:21.672741+0000","last_unstale":"2023-10-10T21:21:21.677708+0000","last_undegraded":"2023-10-10T21:21:21.677708+0000","last_fullsized":"2023-10-10T21:21:21.677708+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:27:27.074907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.670815+0000","last_change":"2023-10-10T21:21:21.663246+0000","last_active":"2023-10-10T21:21:21.670815+0000","last_peered":"2023-10-10T21:21:21.670815+0000","last_clean":"2023-10-10T21:21:21.670815+0000","last_became_active":"2023-10-10T21:21:21.662994+0000","last_became_peered":"2023-10-10T21:21:21.662994+0000","last_unstale":"2023-10-10T21:21:21.670815+0000","last_undegraded":"2023-10-10T21:21:21.670815+0000","last_fullsized":"2023-10-10T21:21:21.670815+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:36:24.104889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.670119+0000","last_change":"2023-10-10T21:21:21.665292+0000","last_active":"2023-10-10T21:21:21.670119+0000","last_peered":"2023-10-10T21:21:21.670119+0000","last_clean":"2023-10-10T21:21:21.670119+0000","last_became_active":"2023-10-10T21:21:21.664689+0000","last_became_peered":"2023-10-10T21:21:21.664689+0000","last_unstale":"2023-10-10T21:21:21.670119+0000","last_undegraded":"2023-10-10T21:21:21.670119+0000","last_fullsized":"2023-10-10T21:21:21.670119+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:22:48.044157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665230+0000","last_change":"2023-10-10T21:21:21.661596+0000","last_active":"2023-10-10T21:21:21.665230+0000","last_peered":"2023-10-10T21:21:21.665230+0000","last_clean":"2023-10-10T21:21:21.665230+0000","last_became_active":"2023-10-10T21:21:21.660622+0000","last_became_peered":"2023-10-10T21:21:21.660622+0000","last_unstale":"2023-10-10T21:21:21.665230+0000","last_undegraded":"2023-10-10T21:21:21.665230+0000","last_fullsized":"2023-10-10T21:21:21.665230+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:38:34.129236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667721+0000","last_change":"2023-10-10T21:21:21.654048+0000","last_active":"2023-10-10T21:21:21.667721+0000","last_peered":"2023-10-10T21:21:21.667721+0000","last_clean":"2023-10-10T21:21:21.667721+0000","last_became_active":"2023-10-10T21:21:21.653795+0000","last_became_peered":"2023-10-10T21:21:21.653795+0000","last_unstale":"2023-10-10T21:21:21.667721+0000","last_undegraded":"2023-10-10T21:21:21.667721+0000","last_fullsized":"2023-10-10T21:21:21.667721+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:57:52.717837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671474+0000","last_change":"2023-10-10T21:21:21.664756+0000","last_active":"2023-10-10T21:21:21.671474+0000","last_peered":"2023-10-10T21:21:21.671474+0000","last_clean":"2023-10-10T21:21:21.671474+0000","last_became_active":"2023-10-10T21:21:21.664512+0000","last_became_peered":"2023-10-10T21:21:21.664512+0000","last_unstale":"2023-10-10T21:21:21.671474+0000","last_undegraded":"2023-10-10T21:21:21.671474+0000","last_fullsized":"2023-10-10T21:21:21.671474+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:53:41.982027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.666651+0000","last_change":"2023-10-10T21:21:21.661229+0000","last_active":"2023-10-10T21:21:21.666651+0000","last_peered":"2023-10-10T21:21:21.666651+0000","last_clean":"2023-10-10T21:21:21.666651+0000","last_became_active":"2023-10-10T21:21:21.660986+0000","last_became_peered":"2023-10-10T21:21:21.660986+0000","last_unstale":"2023-10-10T21:21:21.666651+0000","last_undegraded":"2023-10-10T21:21:21.666651+0000","last_fullsized":"2023-10-10T21:21:21.666651+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:40:06.114276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674235+0000","last_change":"2023-10-10T21:21:20.646861+0000","last_active":"2023-10-10T21:21:21.674235+0000","last_peered":"2023-10-10T21:21:21.674235+0000","last_clean":"2023-10-10T21:21:21.674235+0000","last_became_active":"2023-10-10T21:21:20.646581+0000","last_became_peered":"2023-10-10T21:21:20.646581+0000","last_unstale":"2023-10-10T21:21:21.674235+0000","last_undegraded":"2023-10-10T21:21:21.674235+0000","last_fullsized":"2023-10-10T21:21:21.674235+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:32:07.192509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667793+0000","last_change":"2023-10-10T21:21:21.664989+0000","last_active":"2023-10-10T21:21:21.667793+0000","last_peered":"2023-10-10T21:21:21.667793+0000","last_clean":"2023-10-10T21:21:21.667793+0000","last_became_active":"2023-10-10T21:21:21.664294+0000","last_became_peered":"2023-10-10T21:21:21.664294+0000","last_unstale":"2023-10-10T21:21:21.667793+0000","last_undegraded":"2023-10-10T21:21:21.667793+0000","last_fullsized":"2023-10-10T21:21:21.667793+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:03:03.261575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677354+0000","last_change":"2023-10-10T21:21:20.647547+0000","last_active":"2023-10-10T21:21:21.677354+0000","last_peered":"2023-10-10T21:21:21.677354+0000","last_clean":"2023-10-10T21:21:21.677354+0000","last_became_active":"2023-10-10T21:21:20.646001+0000","last_became_peered":"2023-10-10T21:21:20.646001+0000","last_unstale":"2023-10-10T21:21:21.677354+0000","last_undegraded":"2023-10-10T21:21:21.677354+0000","last_fullsized":"2023-10-10T21:21:21.677354+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668656+0000","last_change":"2023-10-10T21:21:21.665435+0000","last_active":"2023-10-10T21:21:21.668656+0000","last_peered":"2023-10-10T21:21:21.668656+0000","last_clean":"2023-10-10T21:21:21.668656+0000","last_became_active":"2023-10-10T21:21:21.665149+0000","last_became_peered":"2023-10-10T21:21:21.665149+0000","last_unstale":"2023-10-10T21:21:21.668656+0000","last_undegraded":"2023-10-10T21:21:21.668656+0000","last_fullsized":"2023-10-10T21:21:21.668656+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:16:44.525573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678305+0000","last_change":"2023-10-10T21:21:20.652313+0000","last_active":"2023-10-10T21:21:21.678305+0000","last_peered":"2023-10-10T21:21:21.678305+0000","last_clean":"2023-10-10T21:21:21.678305+0000","last_became_active":"2023-10-10T21:21:20.652070+0000","last_became_peered":"2023-10-10T21:21:20.652070+0000","last_unstale":"2023-10-10T21:21:21.678305+0000","last_undegraded":"2023-10-10T21:21:21.678305+0000","last_fullsized":"2023-10-10T21:21:21.678305+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:25:02.765470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668027+0000","last_change":"2023-10-10T21:21:21.662168+0000","last_active":"2023-10-10T21:21:21.668027+0000","last_peered":"2023-10-10T21:21:21.668027+0000","last_clean":"2023-10-10T21:21:21.668027+0000","last_became_active":"2023-10-10T21:21:21.661886+0000","last_became_peered":"2023-10-10T21:21:21.661886+0000","last_unstale":"2023-10-10T21:21:21.668027+0000","last_undegraded":"2023-10-10T21:21:21.668027+0000","last_fullsized":"2023-10-10T21:21:21.668027+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:14:22.263178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678567+0000","last_change":"2023-10-10T21:21:20.653160+0000","last_active":"2023-10-10T21:21:21.678567+0000","last_peered":"2023-10-10T21:21:21.678567+0000","last_clean":"2023-10-10T21:21:21.678567+0000","last_became_active":"2023-10-10T21:21:20.652763+0000","last_became_peered":"2023-10-10T21:21:20.652763+0000","last_unstale":"2023-10-10T21:21:21.678567+0000","last_undegraded":"2023-10-10T21:21:21.678567+0000","last_fullsized":"2023-10-10T21:21:21.678567+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:56:53.237937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668977+0000","last_change":"2023-10-10T21:21:21.660738+0000","last_active":"2023-10-10T21:21:21.668977+0000","last_peered":"2023-10-10T21:21:21.668977+0000","last_clean":"2023-10-10T21:21:21.668977+0000","last_became_active":"2023-10-10T21:21:21.660447+0000","last_became_peered":"2023-10-10T21:21:21.660447+0000","last_unstale":"2023-10-10T21:21:21.668977+0000","last_undegraded":"2023-10-10T21:21:21.668977+0000","last_fullsized":"2023-10-10T21:21:21.668977+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:26:31.937357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678096+0000","last_change":"2023-10-10T21:21:20.650487+0000","last_active":"2023-10-10T21:21:21.678096+0000","last_peered":"2023-10-10T21:21:21.678096+0000","last_clean":"2023-10-10T21:21:21.678096+0000","last_became_active":"2023-10-10T21:21:20.650242+0000","last_became_peered":"2023-10-10T21:21:20.650242+0000","last_unstale":"2023-10-10T21:21:21.678096+0000","last_undegraded":"2023-10-10T21:21:21.678096+0000","last_fullsized":"2023-10-10T21:21:21.678096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:40:05.106632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665384+0000","last_change":"2023-10-10T21:21:21.656325+0000","last_active":"2023-10-10T21:21:21.665384+0000","last_peered":"2023-10-10T21:21:21.665384+0000","last_clean":"2023-10-10T21:21:21.665384+0000","last_became_active":"2023-10-10T21:21:21.655762+0000","last_became_peered":"2023-10-10T21:21:21.655762+0000","last_unstale":"2023-10-10T21:21:21.665384+0000","last_undegraded":"2023-10-10T21:21:21.665384+0000","last_fullsized":"2023-10-10T21:21:21.665384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:12.108101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677661+0000","last_change":"2023-10-10T21:21:20.646722+0000","last_active":"2023-10-10T21:21:21.677661+0000","last_peered":"2023-10-10T21:21:21.677661+0000","last_clean":"2023-10-10T21:21:21.677661+0000","last_became_active":"2023-10-10T21:21:20.646451+0000","last_became_peered":"2023-10-10T21:21:20.646451+0000","last_unstale":"2023-10-10T21:21:21.677661+0000","last_undegraded":"2023-10-10T21:21:21.677661+0000","last_fullsized":"2023-10-10T21:21:21.677661+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:58.458614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.673704+0000","last_change":"2023-10-10T21:21:21.661179+0000","last_active":"2023-10-10T21:21:21.673704+0000","last_peered":"2023-10-10T21:21:21.673704+0000","last_clean":"2023-10-10T21:21:21.673704+0000","last_became_active":"2023-10-10T21:21:21.660913+0000","last_became_peered":"2023-10-10T21:21:21.660913+0000","last_unstale":"2023-10-10T21:21:21.673704+0000","last_undegraded":"2023-10-10T21:21:21.673704+0000","last_fullsized":"2023-10-10T21:21:21.673704+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:46:31.771453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.648288+0000","last_change":"2023-10-10T21:21:20.643354+0000","last_active":"2023-10-10T21:21:21.648288+0000","last_peered":"2023-10-10T21:21:21.648288+0000","last_clean":"2023-10-10T21:21:21.648288+0000","last_became_active":"2023-10-10T21:21:20.643100+0000","last_became_peered":"2023-10-10T21:21:20.643100+0000","last_unstale":"2023-10-10T21:21:21.648288+0000","last_undegraded":"2023-10-10T21:21:21.648288+0000","last_fullsized":"2023-10-10T21:21:21.648288+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:50:49.328696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665243+0000","last_change":"2023-10-10T21:21:21.662305+0000","last_active":"2023-10-10T21:21:21.665243+0000","last_peered":"2023-10-10T21:21:21.665243+0000","last_clean":"2023-10-10T21:21:21.665243+0000","last_became_active":"2023-10-10T21:21:21.659589+0000","last_became_peered":"2023-10-10T21:21:21.659589+0000","last_unstale":"2023-10-10T21:21:21.665243+0000","last_undegraded":"2023-10-10T21:21:21.665243+0000","last_fullsized":"2023-10-10T21:21:21.665243+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:56:26.749322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.648346+0000","last_change":"2023-10-10T21:21:20.646704+0000","last_active":"2023-10-10T21:21:21.648346+0000","last_peered":"2023-10-10T21:21:21.648346+0000","last_clean":"2023-10-10T21:21:21.648346+0000","last_became_active":"2023-10-10T21:21:20.646134+0000","last_became_peered":"2023-10-10T21:21:20.646134+0000","last_unstale":"2023-10-10T21:21:21.648346+0000","last_undegraded":"2023-10-10T21:21:21.648346+0000","last_fullsized":"2023-10-10T21:21:21.648346+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:49.859463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665182+0000","last_change":"2023-10-10T21:21:21.661167+0000","last_active":"2023-10-10T21:21:21.665182+0000","last_peered":"2023-10-10T21:21:21.665182+0000","last_clean":"2023-10-10T21:21:21.665182+0000","last_became_active":"2023-10-10T21:21:21.660761+0000","last_became_peered":"2023-10-10T21:21:21.660761+0000","last_unstale":"2023-10-10T21:21:21.665182+0000","last_undegraded":"2023-10-10T21:21:21.665182+0000","last_fullsized":"2023-10-10T21:21:21.665182+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:45.896254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646221+0000","last_change":"2023-10-10T21:21:20.651747+0000","last_active":"2023-10-10T21:21:21.646221+0000","last_peered":"2023-10-10T21:21:21.646221+0000","last_clean":"2023-10-10T21:21:21.646221+0000","last_became_active":"2023-10-10T21:21:20.651506+0000","last_became_peered":"2023-10-10T21:21:20.651506+0000","last_unstale":"2023-10-10T21:21:21.646221+0000","last_undegraded":"2023-10-10T21:21:21.646221+0000","last_fullsized":"2023-10-10T21:21:21.646221+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:20:34.051771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.676680+0000","last_change":"2023-10-10T21:21:21.673921+0000","last_active":"2023-10-10T21:21:21.676680+0000","last_peered":"2023-10-10T21:21:21.676680+0000","last_clean":"2023-10-10T21:21:21.676680+0000","last_became_active":"2023-10-10T21:21:21.673631+0000","last_became_peered":"2023-10-10T21:21:21.673631+0000","last_unstale":"2023-10-10T21:21:21.676680+0000","last_undegraded":"2023-10-10T21:21:21.676680+0000","last_fullsized":"2023-10-10T21:21:21.676680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:04:20.723012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.641446+0000","last_change":"2023-10-10T21:21:20.645128+0000","last_active":"2023-10-10T21:21:21.641446+0000","last_peered":"2023-10-10T21:21:21.641446+0000","last_clean":"2023-10-10T21:21:21.641446+0000","last_became_active":"2023-10-10T21:21:20.644873+0000","last_became_peered":"2023-10-10T21:21:20.644873+0000","last_unstale":"2023-10-10T21:21:21.641446+0000","last_undegraded":"2023-10-10T21:21:21.641446+0000","last_fullsized":"2023-10-10T21:21:21.641446+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:00.164312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.670790+0000","last_change":"2023-10-10T21:21:21.662680+0000","last_active":"2023-10-10T21:21:21.670790+0000","last_peered":"2023-10-10T21:21:21.670790+0000","last_clean":"2023-10-10T21:21:21.670790+0000","last_became_active":"2023-10-10T21:21:21.662398+0000","last_became_peered":"2023-10-10T21:21:21.662398+0000","last_unstale":"2023-10-10T21:21:21.670790+0000","last_undegraded":"2023-10-10T21:21:21.670790+0000","last_fullsized":"2023-10-10T21:21:21.670790+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:57:51.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"138'3","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678978+0000","last_change":"2023-10-10T21:21:20.650864+0000","last_active":"2023-10-10T21:21:21.678978+0000","last_peered":"2023-10-10T21:21:21.678978+0000","last_clean":"2023-10-10T21:21:21.678978+0000","last_became_active":"2023-10-10T21:21:20.650554+0000","last_became_peered":"2023-10-10T21:21:20.650554+0000","last_unstale":"2023-10-10T21:21:21.678978+0000","last_undegraded":"2023-10-10T21:21:21.678978+0000","last_fullsized":"2023-10-10T21:21:21.678978+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:11.100456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665343+0000","last_change":"2023-10-10T21:21:21.660428+0000","last_active":"2023-10-10T21:21:21.665343+0000","last_peered":"2023-10-10T21:21:21.665343+0000","last_clean":"2023-10-10T21:21:21.665343+0000","last_became_active":"2023-10-10T21:21:21.658894+0000","last_became_peered":"2023-10-10T21:21:21.658894+0000","last_unstale":"2023-10-10T21:21:21.665343+0000","last_undegraded":"2023-10-10T21:21:21.665343+0000","last_fullsized":"2023-10-10T21:21:21.665343+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:19.377900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"138'6","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.682851+0000","last_change":"2023-10-10T21:21:20.647860+0000","last_active":"2023-10-10T21:21:21.682851+0000","last_peered":"2023-10-10T21:21:21.682851+0000","last_clean":"2023-10-10T21:21:21.682851+0000","last_became_active":"2023-10-10T21:21:20.647650+0000","last_became_peered":"2023-10-10T21:21:20.647650+0000","last_unstale":"2023-10-10T21:21:21.682851+0000","last_undegraded":"2023-10-10T21:21:21.682851+0000","last_fullsized":"2023-10-10T21:21:21.682851+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:04:19.715367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.660657+0000","last_change":"2023-10-10T21:21:21.651368+0000","last_active":"2023-10-10T21:21:21.660657+0000","last_peered":"2023-10-10T21:21:21.660657+0000","last_clean":"2023-10-10T21:21:21.660657+0000","last_became_active":"2023-10-10T21:21:21.651109+0000","last_became_peered":"2023-10-10T21:21:21.651109+0000","last_unstale":"2023-10-10T21:21:21.660657+0000","last_undegraded":"2023-10-10T21:21:21.660657+0000","last_fullsized":"2023-10-10T21:21:21.660657+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:21.277129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671628+0000","last_change":"2023-10-10T21:21:20.647637+0000","last_active":"2023-10-10T21:21:21.671628+0000","last_peered":"2023-10-10T21:21:21.671628+0000","last_clean":"2023-10-10T21:21:21.671628+0000","last_became_active":"2023-10-10T21:21:20.647348+0000","last_became_peered":"2023-10-10T21:21:20.647348+0000","last_unstale":"2023-10-10T21:21:21.671628+0000","last_undegraded":"2023-10-10T21:21:21.671628+0000","last_fullsized":"2023-10-10T21:21:21.671628+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:33:49.109653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668492+0000","last_change":"2023-10-10T21:21:21.657796+0000","last_active":"2023-10-10T21:21:21.668492+0000","last_peered":"2023-10-10T21:21:21.668492+0000","last_clean":"2023-10-10T21:21:21.668492+0000","last_became_active":"2023-10-10T21:21:21.657523+0000","last_became_peered":"2023-10-10T21:21:21.657523+0000","last_unstale":"2023-10-10T21:21:21.668492+0000","last_undegraded":"2023-10-10T21:21:21.668492+0000","last_fullsized":"2023-10-10T21:21:21.668492+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:40:13.907698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.650763+0000","last_change":"2023-10-10T21:21:20.649734+0000","last_active":"2023-10-10T21:21:21.650763+0000","last_peered":"2023-10-10T21:21:21.650763+0000","last_clean":"2023-10-10T21:21:21.650763+0000","last_became_active":"2023-10-10T21:21:20.649521+0000","last_became_peered":"2023-10-10T21:21:20.649521+0000","last_unstale":"2023-10-10T21:21:21.650763+0000","last_undegraded":"2023-10-10T21:21:21.650763+0000","last_fullsized":"2023-10-10T21:21:21.650763+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:10.685980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.659603+0000","last_change":"2023-10-10T21:21:21.650016+0000","last_active":"2023-10-10T21:21:21.659603+0000","last_peered":"2023-10-10T21:21:21.659603+0000","last_clean":"2023-10-10T21:21:21.659603+0000","last_became_active":"2023-10-10T21:21:21.649762+0000","last_became_peered":"2023-10-10T21:21:21.649762+0000","last_unstale":"2023-10-10T21:21:21.659603+0000","last_undegraded":"2023-10-10T21:21:21.659603+0000","last_fullsized":"2023-10-10T21:21:21.659603+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:07.870899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"138'8","reported_seq":18,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.680617+0000","last_change":"2023-10-10T21:21:20.653738+0000","last_active":"2023-10-10T21:21:21.680617+0000","last_peered":"2023-10-10T21:21:21.680617+0000","last_clean":"2023-10-10T21:21:21.680617+0000","last_became_active":"2023-10-10T21:21:20.653430+0000","last_became_peered":"2023-10-10T21:21:20.653430+0000","last_unstale":"2023-10-10T21:21:21.680617+0000","last_undegraded":"2023-10-10T21:21:21.680617+0000","last_fullsized":"2023-10-10T21:21:21.680617+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:29:07.839253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667569+0000","last_change":"2023-10-10T21:21:21.665732+0000","last_active":"2023-10-10T21:21:21.667569+0000","last_peered":"2023-10-10T21:21:21.667569+0000","last_clean":"2023-10-10T21:21:21.667569+0000","last_became_active":"2023-10-10T21:21:21.665498+0000","last_became_peered":"2023-10-10T21:21:21.665498+0000","last_unstale":"2023-10-10T21:21:21.667569+0000","last_undegraded":"2023-10-10T21:21:21.667569+0000","last_fullsized":"2023-10-10T21:21:21.667569+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:02:27.994154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678785+0000","last_change":"2023-10-10T21:21:20.643663+0000","last_active":"2023-10-10T21:21:21.678785+0000","last_peered":"2023-10-10T21:21:21.678785+0000","last_clean":"2023-10-10T21:21:21.678785+0000","last_became_active":"2023-10-10T21:21:20.643393+0000","last_became_peered":"2023-10-10T21:21:20.643393+0000","last_unstale":"2023-10-10T21:21:21.678785+0000","last_undegraded":"2023-10-10T21:21:21.678785+0000","last_fullsized":"2023-10-10T21:21:21.678785+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:09:58.670734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.679169+0000","last_change":"2023-10-10T21:21:21.672120+0000","last_active":"2023-10-10T21:21:21.679169+0000","last_peered":"2023-10-10T21:21:21.679169+0000","last_clean":"2023-10-10T21:21:21.679169+0000","last_became_active":"2023-10-10T21:21:21.671857+0000","last_became_peered":"2023-10-10T21:21:21.671857+0000","last_unstale":"2023-10-10T21:21:21.679169+0000","last_undegraded":"2023-10-10T21:21:21.679169+0000","last_fullsized":"2023-10-10T21:21:21.679169+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:42:09.661219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677884+0000","last_change":"2023-10-10T21:21:20.647897+0000","last_active":"2023-10-10T21:21:21.677884+0000","last_peered":"2023-10-10T21:21:21.677884+0000","last_clean":"2023-10-10T21:21:21.677884+0000","last_became_active":"2023-10-10T21:21:20.647288+0000","last_became_peered":"2023-10-10T21:21:20.647288+0000","last_unstale":"2023-10-10T21:21:21.677884+0000","last_undegraded":"2023-10-10T21:21:21.677884+0000","last_fullsized":"2023-10-10T21:21:21.677884+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:19.260433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674078+0000","last_change":"2023-10-10T21:21:21.669957+0000","last_active":"2023-10-10T21:21:21.674078+0000","last_peered":"2023-10-10T21:21:21.674078+0000","last_clean":"2023-10-10T21:21:21.674078+0000","last_became_active":"2023-10-10T21:21:21.669691+0000","last_became_peered":"2023-10-10T21:21:21.669691+0000","last_unstale":"2023-10-10T21:21:21.674078+0000","last_undegraded":"2023-10-10T21:21:21.674078+0000","last_fullsized":"2023-10-10T21:21:21.674078+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:16:43.317454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671346+0000","last_change":"2023-10-10T21:21:20.643019+0000","last_active":"2023-10-10T21:21:21.671346+0000","last_peered":"2023-10-10T21:21:21.671346+0000","last_clean":"2023-10-10T21:21:21.671346+0000","last_became_active":"2023-10-10T21:21:20.642725+0000","last_became_peered":"2023-10-10T21:21:20.642725+0000","last_unstale":"2023-10-10T21:21:21.671346+0000","last_undegraded":"2023-10-10T21:21:21.671346+0000","last_fullsized":"2023-10-10T21:21:21.671346+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:08:00.005004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668911+0000","last_change":"2023-10-10T21:21:21.666705+0000","last_active":"2023-10-10T21:21:21.668911+0000","last_peered":"2023-10-10T21:21:21.668911+0000","last_clean":"2023-10-10T21:21:21.668911+0000","last_became_active":"2023-10-10T21:21:21.666428+0000","last_became_peered":"2023-10-10T21:21:21.666428+0000","last_unstale":"2023-10-10T21:21:21.668911+0000","last_undegraded":"2023-10-10T21:21:21.668911+0000","last_fullsized":"2023-10-10T21:21:21.668911+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:50.867107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646997+0000","last_change":"2023-10-10T21:21:20.640515+0000","last_active":"2023-10-10T21:21:21.646997+0000","last_peered":"2023-10-10T21:21:21.646997+0000","last_clean":"2023-10-10T21:21:21.646997+0000","last_became_active":"2023-10-10T21:21:20.640217+0000","last_became_peered":"2023-10-10T21:21:20.640217+0000","last_unstale":"2023-10-10T21:21:21.646997+0000","last_undegraded":"2023-10-10T21:21:21.646997+0000","last_fullsized":"2023-10-10T21:21:21.646997+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:16:43.517928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674023+0000","last_change":"2023-10-10T21:21:21.669072+0000","last_active":"2023-10-10T21:21:21.674023+0000","last_peered":"2023-10-10T21:21:21.674023+0000","last_clean":"2023-10-10T21:21:21.674023+0000","last_became_active":"2023-10-10T21:21:21.668811+0000","last_became_peered":"2023-10-10T21:21:21.668811+0000","last_unstale":"2023-10-10T21:21:21.674023+0000","last_undegraded":"2023-10-10T21:21:21.674023+0000","last_fullsized":"2023-10-10T21:21:21.674023+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:39.106972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668257+0000","last_change":"2023-10-10T21:21:20.649352+0000","last_active":"2023-10-10T21:21:21.668257+0000","last_peered":"2023-10-10T21:21:21.668257+0000","last_clean":"2023-10-10T21:21:21.668257+0000","last_became_active":"2023-10-10T21:21:20.649096+0000","last_became_peered":"2023-10-10T21:21:20.649096+0000","last_unstale":"2023-10-10T21:21:21.668257+0000","last_undegraded":"2023-10-10T21:21:21.668257+0000","last_fullsized":"2023-10-10T21:21:21.668257+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:40:24.747387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668117+0000","last_change":"2023-10-10T21:21:21.656600+0000","last_active":"2023-10-10T21:21:21.668117+0000","last_peered":"2023-10-10T21:21:21.668117+0000","last_clean":"2023-10-10T21:21:21.668117+0000","last_became_active":"2023-10-10T21:21:21.656356+0000","last_became_peered":"2023-10-10T21:21:21.656356+0000","last_unstale":"2023-10-10T21:21:21.668117+0000","last_undegraded":"2023-10-10T21:21:21.668117+0000","last_fullsized":"2023-10-10T21:21:21.668117+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:31:05.590991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646055+0000","last_change":"2023-10-10T21:21:20.651727+0000","last_active":"2023-10-10T21:21:21.646055+0000","last_peered":"2023-10-10T21:21:21.646055+0000","last_clean":"2023-10-10T21:21:21.646055+0000","last_became_active":"2023-10-10T21:21:20.651463+0000","last_became_peered":"2023-10-10T21:21:20.651463+0000","last_unstale":"2023-10-10T21:21:21.646055+0000","last_undegraded":"2023-10-10T21:21:21.646055+0000","last_fullsized":"2023-10-10T21:21:21.646055+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:15:24.656623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.664508+0000","last_change":"2023-10-10T21:21:21.658254+0000","last_active":"2023-10-10T21:21:21.664508+0000","last_peered":"2023-10-10T21:21:21.664508+0000","last_clean":"2023-10-10T21:21:21.664508+0000","last_became_active":"2023-10-10T21:21:21.657995+0000","last_became_peered":"2023-10-10T21:21:21.657995+0000","last_unstale":"2023-10-10T21:21:21.664508+0000","last_undegraded":"2023-10-10T21:21:21.664508+0000","last_fullsized":"2023-10-10T21:21:21.664508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:22:48.044157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.649966+0000","last_change":"2023-10-10T21:21:20.648486+0000","last_active":"2023-10-10T21:21:21.649966+0000","last_peered":"2023-10-10T21:21:21.649966+0000","last_clean":"2023-10-10T21:21:21.649966+0000","last_became_active":"2023-10-10T21:21:20.648149+0000","last_became_peered":"2023-10-10T21:21:20.648149+0000","last_unstale":"2023-10-10T21:21:21.649966+0000","last_undegraded":"2023-10-10T21:21:21.649966+0000","last_fullsized":"2023-10-10T21:21:21.649966+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:48:47.712878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.659855+0000","last_change":"2023-10-10T21:21:21.654893+0000","last_active":"2023-10-10T21:21:21.659855+0000","last_peered":"2023-10-10T21:21:21.659855+0000","last_clean":"2023-10-10T21:21:21.659855+0000","last_became_active":"2023-10-10T21:21:21.654615+0000","last_became_peered":"2023-10-10T21:21:21.654615+0000","last_unstale":"2023-10-10T21:21:21.659855+0000","last_undegraded":"2023-10-10T21:21:21.659855+0000","last_fullsized":"2023-10-10T21:21:21.659855+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:57:05.453945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.648438+0000","last_change":"2023-10-10T21:21:20.647425+0000","last_active":"2023-10-10T21:21:21.648438+0000","last_peered":"2023-10-10T21:21:21.648438+0000","last_clean":"2023-10-10T21:21:21.648438+0000","last_became_active":"2023-10-10T21:21:20.646966+0000","last_became_peered":"2023-10-10T21:21:20.646966+0000","last_unstale":"2023-10-10T21:21:21.648438+0000","last_undegraded":"2023-10-10T21:21:21.648438+0000","last_fullsized":"2023-10-10T21:21:21.648438+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.595963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677955+0000","last_change":"2023-10-10T21:21:21.677062+0000","last_active":"2023-10-10T21:21:21.677955+0000","last_peered":"2023-10-10T21:21:21.677955+0000","last_clean":"2023-10-10T21:21:21.677955+0000","last_became_active":"2023-10-10T21:21:21.676715+0000","last_became_peered":"2023-10-10T21:21:21.676715+0000","last_unstale":"2023-10-10T21:21:21.677955+0000","last_undegraded":"2023-10-10T21:21:21.677955+0000","last_fullsized":"2023-10-10T21:21:21.677955+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:16:43.317454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.680744+0000","last_change":"2023-10-10T21:21:20.647062+0000","last_active":"2023-10-10T21:21:21.680744+0000","last_peered":"2023-10-10T21:21:21.680744+0000","last_clean":"2023-10-10T21:21:21.680744+0000","last_became_active":"2023-10-10T21:21:20.646782+0000","last_became_peered":"2023-10-10T21:21:20.646782+0000","last_unstale":"2023-10-10T21:21:21.680744+0000","last_undegraded":"2023-10-10T21:21:21.680744+0000","last_fullsized":"2023-10-10T21:21:21.680744+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:27:14.434102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678125+0000","last_change":"2023-10-10T21:21:21.673037+0000","last_active":"2023-10-10T21:21:21.678125+0000","last_peered":"2023-10-10T21:21:21.678125+0000","last_clean":"2023-10-10T21:21:21.678125+0000","last_became_active":"2023-10-10T21:21:21.672714+0000","last_became_peered":"2023-10-10T21:21:21.672714+0000","last_unstale":"2023-10-10T21:21:21.678125+0000","last_undegraded":"2023-10-10T21:21:21.678125+0000","last_fullsized":"2023-10-10T21:21:21.678125+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:56:01.648955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.650669+0000","last_change":"2023-10-10T21:21:20.644602+0000","last_active":"2023-10-10T21:21:21.650669+0000","last_peered":"2023-10-10T21:21:21.650669+0000","last_clean":"2023-10-10T21:21:21.650669+0000","last_became_active":"2023-10-10T21:21:20.644337+0000","last_became_peered":"2023-10-10T21:21:20.644337+0000","last_unstale":"2023-10-10T21:21:21.650669+0000","last_undegraded":"2023-10-10T21:21:21.650669+0000","last_fullsized":"2023-10-10T21:21:21.650669+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:41:43.454497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674040+0000","last_change":"2023-10-10T21:21:21.666250+0000","last_active":"2023-10-10T21:21:21.674040+0000","last_peered":"2023-10-10T21:21:21.674040+0000","last_clean":"2023-10-10T21:21:21.674040+0000","last_became_active":"2023-10-10T21:21:21.665987+0000","last_became_peered":"2023-10-10T21:21:21.665987+0000","last_unstale":"2023-10-10T21:21:21.674040+0000","last_undegraded":"2023-10-10T21:21:21.674040+0000","last_fullsized":"2023-10-10T21:21:21.674040+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:45.794079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646281+0000","last_change":"2023-10-10T21:21:20.644736+0000","last_active":"2023-10-10T21:21:21.646281+0000","last_peered":"2023-10-10T21:21:21.646281+0000","last_clean":"2023-10-10T21:21:21.646281+0000","last_became_active":"2023-10-10T21:21:20.644412+0000","last_became_peered":"2023-10-10T21:21:20.644412+0000","last_unstale":"2023-10-10T21:21:21.646281+0000","last_undegraded":"2023-10-10T21:21:21.646281+0000","last_fullsized":"2023-10-10T21:21:21.646281+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:16:42.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677939+0000","last_change":"2023-10-10T21:21:21.676903+0000","last_active":"2023-10-10T21:21:21.677939+0000","last_peered":"2023-10-10T21:21:21.677939+0000","last_clean":"2023-10-10T21:21:21.677939+0000","last_became_active":"2023-10-10T21:21:21.676612+0000","last_became_peered":"2023-10-10T21:21:21.676612+0000","last_unstale":"2023-10-10T21:21:21.677939+0000","last_undegraded":"2023-10-10T21:21:21.677939+0000","last_fullsized":"2023-10-10T21:21:21.677939+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:50.867107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.642188+0000","last_change":"2023-10-10T21:21:20.650617+0000","last_active":"2023-10-10T21:21:21.642188+0000","last_peered":"2023-10-10T21:21:21.642188+0000","last_clean":"2023-10-10T21:21:21.642188+0000","last_became_active":"2023-10-10T21:21:20.650368+0000","last_became_peered":"2023-10-10T21:21:20.650368+0000","last_unstale":"2023-10-10T21:21:21.642188+0000","last_undegraded":"2023-10-10T21:21:21.642188+0000","last_fullsized":"2023-10-10T21:21:21.642188+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:20:58.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671129+0000","last_change":"2023-10-10T21:21:21.666780+0000","last_active":"2023-10-10T21:21:21.671129+0000","last_peered":"2023-10-10T21:21:21.671129+0000","last_clean":"2023-10-10T21:21:21.671129+0000","last_became_active":"2023-10-10T21:21:21.663777+0000","last_became_peered":"2023-10-10T21:21:21.663777+0000","last_unstale":"2023-10-10T21:21:21.671129+0000","last_undegraded":"2023-10-10T21:21:21.671129+0000","last_fullsized":"2023-10-10T21:21:21.671129+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:50.867107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646573+0000","last_change":"2023-10-10T21:21:20.641802+0000","last_active":"2023-10-10T21:21:21.646573+0000","last_peered":"2023-10-10T21:21:21.646573+0000","last_clean":"2023-10-10T21:21:21.646573+0000","last_became_active":"2023-10-10T21:21:20.641513+0000","last_became_peered":"2023-10-10T21:21:20.641513+0000","last_unstale":"2023-10-10T21:21:21.646573+0000","last_undegraded":"2023-10-10T21:21:21.646573+0000","last_fullsized":"2023-10-10T21:21:21.646573+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:42.396278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665403+0000","last_change":"2023-10-10T21:21:21.659275+0000","last_active":"2023-10-10T21:21:21.665403+0000","last_peered":"2023-10-10T21:21:21.665403+0000","last_clean":"2023-10-10T21:21:21.665403+0000","last_became_active":"2023-10-10T21:21:21.658933+0000","last_became_peered":"2023-10-10T21:21:21.658933+0000","last_unstale":"2023-10-10T21:21:21.665403+0000","last_undegraded":"2023-10-10T21:21:21.665403+0000","last_fullsized":"2023-10-10T21:21:21.665403+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:48:50.409345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.649138+0000","last_change":"2023-10-10T21:21:20.648724+0000","last_active":"2023-10-10T21:21:21.649138+0000","last_peered":"2023-10-10T21:21:21.649138+0000","last_clean":"2023-10-10T21:21:21.649138+0000","last_became_active":"2023-10-10T21:21:20.648376+0000","last_became_peered":"2023-10-10T21:21:20.648376+0000","last_unstale":"2023-10-10T21:21:21.649138+0000","last_undegraded":"2023-10-10T21:21:21.649138+0000","last_fullsized":"2023-10-10T21:21:21.649138+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:53.554860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.664587+0000","last_change":"2023-10-10T21:21:21.661210+0000","last_active":"2023-10-10T21:21:21.664587+0000","last_peered":"2023-10-10T21:21:21.664587+0000","last_clean":"2023-10-10T21:21:21.664587+0000","last_became_active":"2023-10-10T21:21:21.660881+0000","last_became_peered":"2023-10-10T21:21:21.660881+0000","last_unstale":"2023-10-10T21:21:21.664587+0000","last_undegraded":"2023-10-10T21:21:21.664587+0000","last_fullsized":"2023-10-10T21:21:21.664587+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:58.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.645975+0000","last_change":"2023-10-10T21:21:20.653001+0000","last_active":"2023-10-10T21:21:21.645975+0000","last_peered":"2023-10-10T21:21:21.645975+0000","last_clean":"2023-10-10T21:21:21.645975+0000","last_became_active":"2023-10-10T21:21:20.652701+0000","last_became_peered":"2023-10-10T21:21:20.652701+0000","last_unstale":"2023-10-10T21:21:21.645975+0000","last_undegraded":"2023-10-10T21:21:21.645975+0000","last_fullsized":"2023-10-10T21:21:21.645975+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:16.344968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667742+0000","last_change":"2023-10-10T21:21:21.660425+0000","last_active":"2023-10-10T21:21:21.667742+0000","last_peered":"2023-10-10T21:21:21.667742+0000","last_clean":"2023-10-10T21:21:21.667742+0000","last_became_active":"2023-10-10T21:21:21.660173+0000","last_became_peered":"2023-10-10T21:21:21.660173+0000","last_unstale":"2023-10-10T21:21:21.667742+0000","last_undegraded":"2023-10-10T21:21:21.667742+0000","last_fullsized":"2023-10-10T21:21:21.667742+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:58:19.916639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.648553+0000","last_change":"2023-10-10T21:21:20.647239+0000","last_active":"2023-10-10T21:21:21.648553+0000","last_peered":"2023-10-10T21:21:21.648553+0000","last_clean":"2023-10-10T21:21:21.648553+0000","last_became_active":"2023-10-10T21:21:20.646457+0000","last_became_peered":"2023-10-10T21:21:20.646457+0000","last_unstale":"2023-10-10T21:21:21.648553+0000","last_undegraded":"2023-10-10T21:21:21.648553+0000","last_fullsized":"2023-10-10T21:21:21.648553+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:24:05.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668713+0000","last_change":"2023-10-10T21:21:21.658198+0000","last_active":"2023-10-10T21:21:21.668713+0000","last_peered":"2023-10-10T21:21:21.668713+0000","last_clean":"2023-10-10T21:21:21.668713+0000","last_became_active":"2023-10-10T21:21:21.657945+0000","last_became_peered":"2023-10-10T21:21:21.657945+0000","last_unstale":"2023-10-10T21:21:21.668713+0000","last_undegraded":"2023-10-10T21:21:21.668713+0000","last_fullsized":"2023-10-10T21:21:21.668713+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:24:26.936749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646406+0000","last_change":"2023-10-10T21:21:20.641100+0000","last_active":"2023-10-10T21:21:21.646406+0000","last_peered":"2023-10-10T21:21:21.646406+0000","last_clean":"2023-10-10T21:21:21.646406+0000","last_became_active":"2023-10-10T21:21:20.640853+0000","last_became_peered":"2023-10-10T21:21:20.640853+0000","last_unstale":"2023-10-10T21:21:21.646406+0000","last_undegraded":"2023-10-10T21:21:21.646406+0000","last_fullsized":"2023-10-10T21:21:21.646406+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:07.601872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":734,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.653225+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:21:21.653225+0000","last_peered":"2023-10-10T21:21:21.653225+0000","last_clean":"2023-10-10T21:21:21.653225+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:21:21.653225+0000","last_undegraded":"2023-10-10T21:21:21.653225+0000","last_fullsized":"2023-10-10T21:21:21.653225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542370,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2322432,"data_stored":1435729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":1.052,"15min":1.052},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.441},"max":{"1min":0.91800000000000004,"5min":1.161,"15min":1.161},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90900000000000003,"5min":1.179,"15min":1.179},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.439,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.70899999999999996,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.93799999999999994,"5min":1.012,"15min":1.012},"last":0.67400000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.42199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.61799999999999999},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.36699999999999999},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.48999999999999999,"5min":0.40200000000000002,"15min":0.34599999999999997},"max":{"1min":0.91200000000000003,"5min":1.016,"15min":1.3700000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.41399999999999998,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.75800000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.54300000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79200000000000004,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.5},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.78400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542369,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303068,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068772,"statfs":{"total":96636764160,"available":96326422528,"internally_reserved":0,"allocated":1724416,"data_stored":844843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36499999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.0189999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.69799999999999995},"min":{"1min":0.48599999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.1040000000000001},"last":0.60199999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.42999999999999999},"max":{"1min":0.98199999999999998,"5min":1.0129999999999999,"15min":1.03},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.75600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.67300000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.68899999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.442},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.016},"last":0.61599999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0309999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.042,"15min":1.042},"last":0.76700000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.872,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38900000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.57599999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70899999999999996,"15min":0.71799999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46400000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.64400000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542369,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303072,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068768,"statfs":{"total":96636764160,"available":96326418432,"internally_reserved":0,"allocated":1728512,"data_stored":844897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.54100000000000004,"15min":0.48799999999999999},"min":{"1min":0.28299999999999997,"5min":0.26200000000000001,"15min":0.24099999999999999},"max":{"1min":0.72899999999999998,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.623,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.28399999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":2.254,"15min":2.254},"last":0.308},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.378},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.44800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75600000000000001,"5min":0.999,"15min":0.999},"last":0.39500000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.54300000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94699999999999995,"5min":4.806,"15min":4.806},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.42199999999999999},"max":{"1min":0.98099999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.45500000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.77900000000000003},"min":{"1min":0.48399999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97699999999999998,"5min":6.968,"15min":6.968},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.876,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90700000000000003,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.99399999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":12.026,"15min":12.026},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0329999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.443}]}]},{"osd":0,"up_from":14,"seq":60129542371,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303664,"kb_used_data":2280,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068176,"statfs":{"total":96636764160,"available":96325812224,"internally_reserved":0,"allocated":2334720,"data_stored":1436789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.60599999999999998,"5min":0.74399999999999999,"15min":0.752},"last":0.379},{"interface":"front","average":{"1min":0.437,"5min":0.49199999999999999,"15min":0.51600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.879,"15min":0.91800000000000004},"last":0.49399999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.72699999999999998,"15min":0.76700000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46500000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.498,"15min":0.51400000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.73299999999999998,"15min":0.90300000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56799999999999995,"15min":0.59899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.81299999999999994,"15min":0.874},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1080000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73699999999999999,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.075,"5min":1.1679999999999999,"15min":1.2190000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.018,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82099999999999995},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.008,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.59699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.143},"last":0.99399999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78400000000000003,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.036,"5min":1.139,"15min":1.169},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0549999999999999,"5min":1.097,"15min":1.165},"last":0.97399999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542371,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311256,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060584,"statfs":{"total":96636764160,"available":96318038016,"internally_reserved":0,"allocated":1720320,"data_stored":844773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":0.71799999999999997,"15min":0.95699999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48999999999999999,"15min":0.50900000000000001},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.29599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.30599999999999999,"5min":0.28999999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.504},{"interface":"front","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.9099999999999999},"last":0.40600000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.624},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73699999999999999,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0860000000000001,"15min":1.26},"last":0.72699999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.77800000000000002},"min":{"1min":0.54100000000000004,"5min":0.47499999999999998,"15min":0.46200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":2.21},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74199999999999999,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.52000000000000002,"15min":0.48399999999999999},"max":{"1min":1.1000000000000001,"5min":1.125,"15min":1.268},"last":0.61299999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76300000000000001,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.3080000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.54900000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.345,"15min":1.345},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.087,"5min":1.2290000000000001,"15min":1.716},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.75,"15min":0.79200000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2330000000000001},"last":0.77200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509666,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307176,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064664,"statfs":{"total":96636764160,"available":96322215936,"internally_reserved":0,"allocated":1736704,"data_stored":846379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.45500000000000002},"min":{"1min":0.316,"5min":0.28000000000000003,"15min":0.27900000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.83099999999999996},"last":0.308},{"interface":"front","average":{"1min":0.442,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59399999999999997,"5min":0.77000000000000002,"15min":0.84399999999999997},"last":0.47099999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":0.66400000000000003,"5min":0.87,"15min":0.87},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.38400000000000001,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70399999999999996,"5min":0.81000000000000005,"15min":0.92200000000000004},"last":0.53000000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.42599999999999999},"max":{"1min":0.95099999999999996,"5min":1.1200000000000001,"15min":1.3440000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.433},"max":{"1min":1.03,"5min":1.1339999999999999,"15min":1.246},"last":0.74199999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.21,"15min":1.21},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.014,"5min":1.165,"15min":1.2250000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0549999999999999,"5min":1.081,"15min":1.27},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":1.052,"15min":1.224},"last":0.75600000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.117,"15min":1.1319999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.53500000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.98699999999999999,"5min":1.228,"15min":1.228},"last":0.78100000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542371,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311256,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060584,"statfs":{"total":96636764160,"available":96318038016,"internally_reserved":0,"allocated":1720320,"data_stored":844773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.68700000000000006},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.91000000000000003,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.72399999999999998},"min":{"1min":0.437,"5min":0.318,"15min":0.318},"max":{"1min":0.879,"5min":1.121,"15min":1.5029999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.1859999999999999,"15min":1.47},"last":0.745},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":1.155,"15min":1.155},"last":0.77100000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.50700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0009999999999999,"5min":1.002,"15min":1.536},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":1.2330000000000001,"15min":1.397},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68100000000000005,"15min":0.71499999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0009999999999999,"5min":1.0800000000000001,"15min":1.385},"last":0.58999999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.93999999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.96299999999999997,"5min":1,"15min":1.196},"last":0.60599999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95599999999999996,"5min":1.0149999999999999,"15min":1.216},"last":0.79700000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.503,"5min":0.377,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":1.006,"15min":1.2390000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.442},"max":{"1min":0.91000000000000003,"5min":1.034,"15min":1.4139999999999999},"last":0.68000000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542369,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307168,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064672,"statfs":{"total":96636764160,"available":96322224128,"internally_reserved":0,"allocated":1728512,"data_stored":845349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.95399999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.59299999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.97299999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70799999999999996},"min":{"1min":0.46999999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94299999999999995,"5min":1.0009999999999999,"15min":1.018},"last":0.66200000000000003}]},{"osd":2,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.01},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.2909999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.74199999999999999},"min":{"1min":0.57199999999999995,"5min":0.5,"15min":0.48799999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.044},"last":0.626}]},{"osd":4,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92900000000000005,"5min":1.2110000000000001,"15min":1.5900000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":0.95099999999999996,"15min":1.496},"last":0.498}]},{"osd":6,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99299999999999999,"5min":1.131,"15min":1.131},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.54000000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.46300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.008,"5min":1.097,"15min":1.097},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0329999999999999,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:21:30.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T21:21:31.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.073+0000 7f21de5ff700 1 Processor -- start 2023-10-10T21:21:31.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.073+0000 7f21de5ff700 1 -- start start 2023-10-10T21:21:31.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21de5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21d81578b0 0x7f21d8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21de5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80af2f0 0x7f21d80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21de5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d80ad930 con 0x7f21d8155c10 2023-10-10T21:21:31.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21de5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d80b0c80 con 0x7f21d81578b0 2023-10-10T21:21:31.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21de5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80acd20 con 0x7f21d80af2f0 2023-10-10T21:21:31.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21cffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21d81578b0 0x7f21d8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21cffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21d81578b0 0x7f21d8155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58936/0 (socket says 172.21.15.154:58936) 2023-10-10T21:21:31.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21cffff700 1 -- 172.21.15.154:0/2792988721 learned_addr learned my addr 172.21.15.154:0/2792988721 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21cffff700 1 -- 172.21.15.154:0/2792988721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80af2f0 msgr2=0x7f21d80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21dcb9c700 1 --2- 172.21.15.154:0/2792988721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80af2f0 0x7f21d80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21cffff700 1 --2- 172.21.15.154:0/2792988721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80af2f0 0x7f21d80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21cffff700 1 -- 172.21.15.154:0/2792988721 >> v1:172.21.15.179:6789/0 conn(0x7f21d8155c10 legacy=0x7f21d80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.075+0000 7f21cffff700 1 -- 172.21.15.154:0/2792988721 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80ad000 con 0x7f21d81578b0 2023-10-10T21:21:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.076+0000 7f21dcb9c700 1 --2- 172.21.15.154:0/2792988721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80af2f0 0x7f21d80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.076+0000 7f21cffff700 1 --2- 172.21.15.154:0/2792988721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d81578b0 0x7f21d8155fe0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f21c000bc40 tx=0x7f21c000b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3013ff5421e6f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.076+0000 7f21d77fe700 1 -- 172.21.15.154:0/2792988721 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c000db00 con 0x7f21d81578b0 2023-10-10T21:21:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.076+0000 7f21d77fe700 1 -- 172.21.15.154:0/2792988721 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c000dc60 con 0x7f21d81578b0 2023-10-10T21:21:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.076+0000 7f21d77fe700 1 -- 172.21.15.154:0/2792988721 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0017410 con 0x7f21d81578b0 2023-10-10T21:21:31.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.076+0000 7f21de5ff700 1 -- 172.21.15.154:0/2792988721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d81578b0 msgr2=0x7f21d8155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.076+0000 7f21de5ff700 1 --2- 172.21.15.154:0/2792988721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d81578b0 0x7f21d8155fe0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f21c000bc40 tx=0x7f21c000b4e0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.077+0000 7f21de5ff700 1 -- 172.21.15.154:0/2792988721 shutdown_connections 2023-10-10T21:21:31.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.077+0000 7f21de5ff700 1 --2- 172.21.15.154:0/2792988721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80af2f0 0x7f21d80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.077+0000 7f21de5ff700 1 --2- 172.21.15.154:0/2792988721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d81578b0 0x7f21d8155fe0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.077+0000 7f21de5ff700 1 -- 172.21.15.154:0/2792988721 >> 172.21.15.154:0/2792988721 conn(0x7f21d806a320 msgr2=0x7f21d80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:31.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.077+0000 7f21de5ff700 1 -- 172.21.15.154:0/2792988721 shutdown_connections 2023-10-10T21:21:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.077+0000 7f21de5ff700 1 -- 172.21.15.154:0/2792988721 wait complete. 2023-10-10T21:21:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.078+0000 7f21de5ff700 1 Processor -- start 2023-10-10T21:21:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.078+0000 7f21de5ff700 1 -- start start 2023-10-10T21:21:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.079+0000 7f21de5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d80af2f0 0x7f21d813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.079+0000 7f21de5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d8155c10 0x7f21d8166050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.079+0000 7f21de5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d81578b0 0x7f21d80ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.079+0000 7f21de5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d8167950 con 0x7f21d80af2f0 2023-10-10T21:21:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.079+0000 7f21de5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d8166590 con 0x7f21d8155c10 2023-10-10T21:21:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.079+0000 7f21de5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d8166d40 con 0x7f21d81578b0 2023-10-10T21:21:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.079+0000 7f21d7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d80af2f0 0x7f21d813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.079+0000 7f21d7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d80af2f0 0x7f21d813ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58942/0 (socket says 172.21.15.154:58942) 2023-10-10T21:21:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.079+0000 7f21d7fff700 1 -- 172.21.15.154:0/2376491782 learned_addr learned my addr 172.21.15.154:0/2376491782 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21cffff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d8155c10 0x7f21d8166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21dcb9c700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d81578b0 0x7f21d80ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21d7fff700 1 -- 172.21.15.154:0/2376491782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d81578b0 msgr2=0x7f21d80ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21d7fff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d81578b0 0x7f21d80ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21d7fff700 1 -- 172.21.15.154:0/2376491782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d8155c10 msgr2=0x7f21d8166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21d7fff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d8155c10 0x7f21d8166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21d7fff700 1 -- 172.21.15.154:0/2376491782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c000b780 con 0x7f21d80af2f0 2023-10-10T21:21:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21cffff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d8155c10 0x7f21d8166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:31.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21d7fff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d80af2f0 0x7f21d813ee50 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c5d0 tx=0x7f21c8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:31.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21d4ff9700 1 -- 172.21.15.154:0/2376491782 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8011590 con 0x7f21d80af2f0 2023-10-10T21:21:31.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21d4ff9700 1 -- 172.21.15.154:0/2376491782 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8011710 con 0x7f21d80af2f0 2023-10-10T21:21:31.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d8167020 con 0x7f21d80af2f0 2023-10-10T21:21:31.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.080+0000 7f21d4ff9700 1 -- 172.21.15.154:0/2376491782 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8011ad0 con 0x7f21d80af2f0 2023-10-10T21:21:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.081+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d81675e0 con 0x7f21d80af2f0 2023-10-10T21:21:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.082+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d804c3c0 con 0x7f21d80af2f0 2023-10-10T21:21:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.082+0000 7f21d4ff9700 1 -- 172.21.15.154:0/2376491782 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21c801c460 con 0x7f21d80af2f0 2023-10-10T21:21:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.083+0000 7f21d4ff9700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.083+0000 7f21d4ff9700 1 -- 172.21.15.154:0/2376491782 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f21c8084570 con 0x7f21d80af2f0 2023-10-10T21:21:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.084+0000 7f21cffff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.084+0000 7f21cffff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f21b8066f30 0x7f21b80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21c000b520 tx=0x7f21c0019000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:31.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.088+0000 7f21d4ff9700 1 -- 172.21.15.154:0/2376491782 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21c80515a0 con 0x7f21d80af2f0 2023-10-10T21:21:31.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.276+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21d8167a90 con 0x7f21b8066f30 2023-10-10T21:21:31.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.284+0000 7f21d4ff9700 1 -- 172.21.15.154:0/2376491782 <== mgr.7968 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289189 (secure 0 0 0) 0x7f21c00177c0 con 0x7f21b8066f30 2023-10-10T21:21:31.290 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f21b8066f30 msgr2=0x7f21b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f21b8066f30 0x7f21b80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21c000b520 tx=0x7f21c0019000 comp rx=0 tx=0).stop 2023-10-10T21:21:31.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d80af2f0 msgr2=0x7f21d813ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d80af2f0 0x7f21d813ee50 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c5d0 tx=0x7f21c8007f60 comp rx=0 tx=0).stop 2023-10-10T21:21:31.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 shutdown_connections 2023-10-10T21:21:31.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d81578b0 0x7f21d80ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d80af2f0 0x7f21d813ee50 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 --2- 172.21.15.154:0/2376491782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d8155c10 0x7f21d8166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 >> 172.21.15.154:0/2376491782 conn(0x7f21d806a320 msgr2=0x7f21d806d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:31.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 shutdown_connections 2023-10-10T21:21:31.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.289+0000 7f21de5ff700 1 -- 172.21.15.154:0/2376491782 wait complete. 2023-10-10T21:21:31.295 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T21:21:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-10T21:21:29.582744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454408,"kb_used_data":14664,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752520312,"statfs":{"total":773094113280,"available":770580799488,"internally_reserved":0,"allocated":15015936,"data_stored":7943532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001754"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.672881+0000","last_change":"2023-10-10T21:21:21.664038+0000","last_active":"2023-10-10T21:21:21.672881+0000","last_peered":"2023-10-10T21:21:21.672881+0000","last_clean":"2023-10-10T21:21:21.672881+0000","last_became_active":"2023-10-10T21:21:21.663795+0000","last_became_peered":"2023-10-10T21:21:21.663795+0000","last_unstale":"2023-10-10T21:21:21.672881+0000","last_undegraded":"2023-10-10T21:21:21.672881+0000","last_fullsized":"2023-10-10T21:21:21.672881+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:26:52.774597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665072+0000","last_change":"2023-10-10T21:21:21.659801+0000","last_active":"2023-10-10T21:21:21.665072+0000","last_peered":"2023-10-10T21:21:21.665072+0000","last_clean":"2023-10-10T21:21:21.665072+0000","last_became_active":"2023-10-10T21:21:21.659518+0000","last_became_peered":"2023-10-10T21:21:21.659518+0000","last_unstale":"2023-10-10T21:21:21.665072+0000","last_undegraded":"2023-10-10T21:21:21.665072+0000","last_fullsized":"2023-10-10T21:21:21.665072+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:16:43.317454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671136+0000","last_change":"2023-10-10T21:21:21.667942+0000","last_active":"2023-10-10T21:21:21.671136+0000","last_peered":"2023-10-10T21:21:21.671136+0000","last_clean":"2023-10-10T21:21:21.671136+0000","last_became_active":"2023-10-10T21:21:21.667664+0000","last_became_peered":"2023-10-10T21:21:21.667664+0000","last_unstale":"2023-10-10T21:21:21.671136+0000","last_undegraded":"2023-10-10T21:21:21.671136+0000","last_fullsized":"2023-10-10T21:21:21.671136+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:12.108101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674004+0000","last_change":"2023-10-10T21:21:21.664994+0000","last_active":"2023-10-10T21:21:21.674004+0000","last_peered":"2023-10-10T21:21:21.674004+0000","last_clean":"2023-10-10T21:21:21.674004+0000","last_became_active":"2023-10-10T21:21:21.664396+0000","last_became_peered":"2023-10-10T21:21:21.664396+0000","last_unstale":"2023-10-10T21:21:21.674004+0000","last_undegraded":"2023-10-10T21:21:21.674004+0000","last_fullsized":"2023-10-10T21:21:21.674004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:02:59.345179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.658984+0000","last_change":"2023-10-10T21:21:21.657336+0000","last_active":"2023-10-10T21:21:21.658984+0000","last_peered":"2023-10-10T21:21:21.658984+0000","last_clean":"2023-10-10T21:21:21.658984+0000","last_became_active":"2023-10-10T21:21:21.657092+0000","last_became_peered":"2023-10-10T21:21:21.657092+0000","last_unstale":"2023-10-10T21:21:21.658984+0000","last_undegraded":"2023-10-10T21:21:21.658984+0000","last_fullsized":"2023-10-10T21:21:21.658984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:43:30.649591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668708+0000","last_change":"2023-10-10T21:21:21.665875+0000","last_active":"2023-10-10T21:21:21.668708+0000","last_peered":"2023-10-10T21:21:21.668708+0000","last_clean":"2023-10-10T21:21:21.668708+0000","last_became_active":"2023-10-10T21:21:21.665476+0000","last_became_peered":"2023-10-10T21:21:21.665476+0000","last_unstale":"2023-10-10T21:21:21.668708+0000","last_undegraded":"2023-10-10T21:21:21.668708+0000","last_fullsized":"2023-10-10T21:21:21.668708+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:08.609516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665263+0000","last_change":"2023-10-10T21:21:21.662823+0000","last_active":"2023-10-10T21:21:21.665263+0000","last_peered":"2023-10-10T21:21:21.665263+0000","last_clean":"2023-10-10T21:21:21.665263+0000","last_became_active":"2023-10-10T21:21:21.662577+0000","last_became_peered":"2023-10-10T21:21:21.662577+0000","last_unstale":"2023-10-10T21:21:21.665263+0000","last_undegraded":"2023-10-10T21:21:21.665263+0000","last_fullsized":"2023-10-10T21:21:21.665263+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:27:25.351466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668935+0000","last_change":"2023-10-10T21:21:21.666043+0000","last_active":"2023-10-10T21:21:21.668935+0000","last_peered":"2023-10-10T21:21:21.668935+0000","last_clean":"2023-10-10T21:21:21.668935+0000","last_became_active":"2023-10-10T21:21:21.665765+0000","last_became_peered":"2023-10-10T21:21:21.665765+0000","last_unstale":"2023-10-10T21:21:21.668935+0000","last_undegraded":"2023-10-10T21:21:21.668935+0000","last_fullsized":"2023-10-10T21:21:21.668935+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:29:56.991666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667699+0000","last_change":"2023-10-10T21:21:21.659300+0000","last_active":"2023-10-10T21:21:21.667699+0000","last_peered":"2023-10-10T21:21:21.667699+0000","last_clean":"2023-10-10T21:21:21.667699+0000","last_became_active":"2023-10-10T21:21:21.659068+0000","last_became_peered":"2023-10-10T21:21:21.659068+0000","last_unstale":"2023-10-10T21:21:21.667699+0000","last_undegraded":"2023-10-10T21:21:21.667699+0000","last_fullsized":"2023-10-10T21:21:21.667699+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:58:22.037870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674088+0000","last_change":"2023-10-10T21:21:21.666953+0000","last_active":"2023-10-10T21:21:21.674088+0000","last_peered":"2023-10-10T21:21:21.674088+0000","last_clean":"2023-10-10T21:21:21.674088+0000","last_became_active":"2023-10-10T21:21:21.666679+0000","last_became_peered":"2023-10-10T21:21:21.666679+0000","last_unstale":"2023-10-10T21:21:21.674088+0000","last_undegraded":"2023-10-10T21:21:21.674088+0000","last_fullsized":"2023-10-10T21:21:21.674088+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:53:22.532253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665115+0000","last_change":"2023-10-10T21:21:21.658476+0000","last_active":"2023-10-10T21:21:21.665115+0000","last_peered":"2023-10-10T21:21:21.665115+0000","last_clean":"2023-10-10T21:21:21.665115+0000","last_became_active":"2023-10-10T21:21:21.658196+0000","last_became_peered":"2023-10-10T21:21:21.658196+0000","last_unstale":"2023-10-10T21:21:21.665115+0000","last_undegraded":"2023-10-10T21:21:21.665115+0000","last_fullsized":"2023-10-10T21:21:21.665115+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:17:52.664979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674022+0000","last_change":"2023-10-10T21:21:21.665163+0000","last_active":"2023-10-10T21:21:21.674022+0000","last_peered":"2023-10-10T21:21:21.674022+0000","last_clean":"2023-10-10T21:21:21.674022+0000","last_became_active":"2023-10-10T21:21:21.664743+0000","last_became_peered":"2023-10-10T21:21:21.664743+0000","last_unstale":"2023-10-10T21:21:21.674022+0000","last_undegraded":"2023-10-10T21:21:21.674022+0000","last_fullsized":"2023-10-10T21:21:21.674022+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:11:39.895420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665340+0000","last_change":"2023-10-10T21:21:21.658974+0000","last_active":"2023-10-10T21:21:21.665340+0000","last_peered":"2023-10-10T21:21:21.665340+0000","last_clean":"2023-10-10T21:21:21.665340+0000","last_became_active":"2023-10-10T21:21:21.658726+0000","last_became_peered":"2023-10-10T21:21:21.658726+0000","last_unstale":"2023-10-10T21:21:21.665340+0000","last_undegraded":"2023-10-10T21:21:21.665340+0000","last_fullsized":"2023-10-10T21:21:21.665340+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:02:10.861239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665205+0000","last_change":"2023-10-10T21:21:21.657433+0000","last_active":"2023-10-10T21:21:21.665205+0000","last_peered":"2023-10-10T21:21:21.665205+0000","last_clean":"2023-10-10T21:21:21.665205+0000","last_became_active":"2023-10-10T21:21:21.657136+0000","last_became_peered":"2023-10-10T21:21:21.657136+0000","last_unstale":"2023-10-10T21:21:21.665205+0000","last_undegraded":"2023-10-10T21:21:21.665205+0000","last_fullsized":"2023-10-10T21:21:21.665205+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:03:03.261575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668878+0000","last_change":"2023-10-10T21:21:21.666186+0000","last_active":"2023-10-10T21:21:21.668878+0000","last_peered":"2023-10-10T21:21:21.668878+0000","last_clean":"2023-10-10T21:21:21.668878+0000","last_became_active":"2023-10-10T21:21:21.665695+0000","last_became_peered":"2023-10-10T21:21:21.665695+0000","last_unstale":"2023-10-10T21:21:21.668878+0000","last_undegraded":"2023-10-10T21:21:21.668878+0000","last_fullsized":"2023-10-10T21:21:21.668878+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:43.403922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.673669+0000","last_change":"2023-10-10T21:21:21.659097+0000","last_active":"2023-10-10T21:21:21.673669+0000","last_peered":"2023-10-10T21:21:21.673669+0000","last_clean":"2023-10-10T21:21:21.673669+0000","last_became_active":"2023-10-10T21:21:21.658855+0000","last_became_peered":"2023-10-10T21:21:21.658855+0000","last_unstale":"2023-10-10T21:21:21.673669+0000","last_undegraded":"2023-10-10T21:21:21.673669+0000","last_fullsized":"2023-10-10T21:21:21.673669+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:27:55.174673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671295+0000","last_change":"2023-10-10T21:21:21.669147+0000","last_active":"2023-10-10T21:21:21.671295+0000","last_peered":"2023-10-10T21:21:21.671295+0000","last_clean":"2023-10-10T21:21:21.671295+0000","last_became_active":"2023-10-10T21:21:21.658015+0000","last_became_peered":"2023-10-10T21:21:21.658015+0000","last_unstale":"2023-10-10T21:21:21.671295+0000","last_undegraded":"2023-10-10T21:21:21.671295+0000","last_fullsized":"2023-10-10T21:21:21.671295+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:39.106972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671089+0000","last_change":"2023-10-10T21:21:21.668427+0000","last_active":"2023-10-10T21:21:21.671089+0000","last_peered":"2023-10-10T21:21:21.671089+0000","last_clean":"2023-10-10T21:21:21.671089+0000","last_became_active":"2023-10-10T21:21:21.668104+0000","last_became_peered":"2023-10-10T21:21:21.668104+0000","last_unstale":"2023-10-10T21:21:21.671089+0000","last_undegraded":"2023-10-10T21:21:21.671089+0000","last_fullsized":"2023-10-10T21:21:21.671089+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:58.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668045+0000","last_change":"2023-10-10T21:21:21.662646+0000","last_active":"2023-10-10T21:21:21.668045+0000","last_peered":"2023-10-10T21:21:21.668045+0000","last_clean":"2023-10-10T21:21:21.668045+0000","last_became_active":"2023-10-10T21:21:21.662322+0000","last_became_peered":"2023-10-10T21:21:21.662322+0000","last_unstale":"2023-10-10T21:21:21.668045+0000","last_undegraded":"2023-10-10T21:21:21.668045+0000","last_fullsized":"2023-10-10T21:21:21.668045+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:05.178891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.669946+0000","last_change":"2023-10-10T21:21:21.664290+0000","last_active":"2023-10-10T21:21:21.669946+0000","last_peered":"2023-10-10T21:21:21.669946+0000","last_clean":"2023-10-10T21:21:21.669946+0000","last_became_active":"2023-10-10T21:21:21.663976+0000","last_became_peered":"2023-10-10T21:21:21.663976+0000","last_unstale":"2023-10-10T21:21:21.669946+0000","last_undegraded":"2023-10-10T21:21:21.669946+0000","last_fullsized":"2023-10-10T21:21:21.669946+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:29:56.991666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.670132+0000","last_change":"2023-10-10T21:21:21.665533+0000","last_active":"2023-10-10T21:21:21.670132+0000","last_peered":"2023-10-10T21:21:21.670132+0000","last_clean":"2023-10-10T21:21:21.670132+0000","last_became_active":"2023-10-10T21:21:21.665053+0000","last_became_peered":"2023-10-10T21:21:21.665053+0000","last_unstale":"2023-10-10T21:21:21.670132+0000","last_undegraded":"2023-10-10T21:21:21.670132+0000","last_fullsized":"2023-10-10T21:21:21.670132+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:02:10.861239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668533+0000","last_change":"2023-10-10T21:21:21.659417+0000","last_active":"2023-10-10T21:21:21.668533+0000","last_peered":"2023-10-10T21:21:21.668533+0000","last_clean":"2023-10-10T21:21:21.668533+0000","last_became_active":"2023-10-10T21:21:21.659174+0000","last_became_peered":"2023-10-10T21:21:21.659174+0000","last_unstale":"2023-10-10T21:21:21.668533+0000","last_undegraded":"2023-10-10T21:21:21.668533+0000","last_fullsized":"2023-10-10T21:21:21.668533+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:18:30.235487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665248+0000","last_change":"2023-10-10T21:21:21.655912+0000","last_active":"2023-10-10T21:21:21.665248+0000","last_peered":"2023-10-10T21:21:21.665248+0000","last_clean":"2023-10-10T21:21:21.665248+0000","last_became_active":"2023-10-10T21:21:21.654706+0000","last_became_peered":"2023-10-10T21:21:21.654706+0000","last_unstale":"2023-10-10T21:21:21.665248+0000","last_undegraded":"2023-10-10T21:21:21.665248+0000","last_fullsized":"2023-10-10T21:21:21.665248+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:14:22.263178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668752+0000","last_change":"2023-10-10T21:21:21.658765+0000","last_active":"2023-10-10T21:21:21.668752+0000","last_peered":"2023-10-10T21:21:21.668752+0000","last_clean":"2023-10-10T21:21:21.668752+0000","last_became_active":"2023-10-10T21:21:21.658522+0000","last_became_peered":"2023-10-10T21:21:21.658522+0000","last_unstale":"2023-10-10T21:21:21.668752+0000","last_undegraded":"2023-10-10T21:21:21.668752+0000","last_fullsized":"2023-10-10T21:21:21.668752+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:58:34.129758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.669314+0000","last_change":"2023-10-10T21:21:21.658676+0000","last_active":"2023-10-10T21:21:21.669314+0000","last_peered":"2023-10-10T21:21:21.669314+0000","last_clean":"2023-10-10T21:21:21.669314+0000","last_became_active":"2023-10-10T21:21:21.658410+0000","last_became_peered":"2023-10-10T21:21:21.658410+0000","last_unstale":"2023-10-10T21:21:21.669314+0000","last_undegraded":"2023-10-10T21:21:21.669314+0000","last_fullsized":"2023-10-10T21:21:21.669314+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:05.178891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.669347+0000","last_change":"2023-10-10T21:21:21.653720+0000","last_active":"2023-10-10T21:21:21.669347+0000","last_peered":"2023-10-10T21:21:21.669347+0000","last_clean":"2023-10-10T21:21:21.669347+0000","last_became_active":"2023-10-10T21:21:21.653135+0000","last_became_peered":"2023-10-10T21:21:21.653135+0000","last_unstale":"2023-10-10T21:21:21.669347+0000","last_undegraded":"2023-10-10T21:21:21.669347+0000","last_fullsized":"2023-10-10T21:21:21.669347+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:49:17.195828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677708+0000","last_change":"2023-10-10T21:21:21.673017+0000","last_active":"2023-10-10T21:21:21.677708+0000","last_peered":"2023-10-10T21:21:21.677708+0000","last_clean":"2023-10-10T21:21:21.677708+0000","last_became_active":"2023-10-10T21:21:21.672741+0000","last_became_peered":"2023-10-10T21:21:21.672741+0000","last_unstale":"2023-10-10T21:21:21.677708+0000","last_undegraded":"2023-10-10T21:21:21.677708+0000","last_fullsized":"2023-10-10T21:21:21.677708+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:27:27.074907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.670815+0000","last_change":"2023-10-10T21:21:21.663246+0000","last_active":"2023-10-10T21:21:21.670815+0000","last_peered":"2023-10-10T21:21:21.670815+0000","last_clean":"2023-10-10T21:21:21.670815+0000","last_became_active":"2023-10-10T21:21:21.662994+0000","last_became_peered":"2023-10-10T21:21:21.662994+0000","last_unstale":"2023-10-10T21:21:21.670815+0000","last_undegraded":"2023-10-10T21:21:21.670815+0000","last_fullsized":"2023-10-10T21:21:21.670815+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:36:24.104889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.670119+0000","last_change":"2023-10-10T21:21:21.665292+0000","last_active":"2023-10-10T21:21:21.670119+0000","last_peered":"2023-10-10T21:21:21.670119+0000","last_clean":"2023-10-10T21:21:21.670119+0000","last_became_active":"2023-10-10T21:21:21.664689+0000","last_became_peered":"2023-10-10T21:21:21.664689+0000","last_unstale":"2023-10-10T21:21:21.670119+0000","last_undegraded":"2023-10-10T21:21:21.670119+0000","last_fullsized":"2023-10-10T21:21:21.670119+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:22:48.044157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665230+0000","last_change":"2023-10-10T21:21:21.661596+0000","last_active":"2023-10-10T21:21:21.665230+0000","last_peered":"2023-10-10T21:21:21.665230+0000","last_clean":"2023-10-10T21:21:21.665230+0000","last_became_active":"2023-10-10T21:21:21.660622+0000","last_became_peered":"2023-10-10T21:21:21.660622+0000","last_unstale":"2023-10-10T21:21:21.665230+0000","last_undegraded":"2023-10-10T21:21:21.665230+0000","last_fullsized":"2023-10-10T21:21:21.665230+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:38:34.129236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667721+0000","last_change":"2023-10-10T21:21:21.654048+0000","last_active":"2023-10-10T21:21:21.667721+0000","last_peered":"2023-10-10T21:21:21.667721+0000","last_clean":"2023-10-10T21:21:21.667721+0000","last_became_active":"2023-10-10T21:21:21.653795+0000","last_became_peered":"2023-10-10T21:21:21.653795+0000","last_unstale":"2023-10-10T21:21:21.667721+0000","last_undegraded":"2023-10-10T21:21:21.667721+0000","last_fullsized":"2023-10-10T21:21:21.667721+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:57:52.717837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671474+0000","last_change":"2023-10-10T21:21:21.664756+0000","last_active":"2023-10-10T21:21:21.671474+0000","last_peered":"2023-10-10T21:21:21.671474+0000","last_clean":"2023-10-10T21:21:21.671474+0000","last_became_active":"2023-10-10T21:21:21.664512+0000","last_became_peered":"2023-10-10T21:21:21.664512+0000","last_unstale":"2023-10-10T21:21:21.671474+0000","last_undegraded":"2023-10-10T21:21:21.671474+0000","last_fullsized":"2023-10-10T21:21:21.671474+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:53:41.982027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.666651+0000","last_change":"2023-10-10T21:21:21.661229+0000","last_active":"2023-10-10T21:21:21.666651+0000","last_peered":"2023-10-10T21:21:21.666651+0000","last_clean":"2023-10-10T21:21:21.666651+0000","last_became_active":"2023-10-10T21:21:21.660986+0000","last_became_peered":"2023-10-10T21:21:21.660986+0000","last_unstale":"2023-10-10T21:21:21.666651+0000","last_undegraded":"2023-10-10T21:21:21.666651+0000","last_fullsized":"2023-10-10T21:21:21.666651+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:40:06.114276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674235+0000","last_change":"2023-10-10T21:21:20.646861+0000","last_active":"2023-10-10T21:21:21.674235+0000","last_peered":"2023-10-10T21:21:21.674235+0000","last_clean":"2023-10-10T21:21:21.674235+0000","last_became_active":"2023-10-10T21:21:20.646581+0000","last_became_peered":"2023-10-10T21:21:20.646581+0000","last_unstale":"2023-10-10T21:21:21.674235+0000","last_undegraded":"2023-10-10T21:21:21.674235+0000","last_fullsized":"2023-10-10T21:21:21.674235+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:32:07.192509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667793+0000","last_change":"2023-10-10T21:21:21.664989+0000","last_active":"2023-10-10T21:21:21.667793+0000","last_peered":"2023-10-10T21:21:21.667793+0000","last_clean":"2023-10-10T21:21:21.667793+0000","last_became_active":"2023-10-10T21:21:21.664294+0000","last_became_peered":"2023-10-10T21:21:21.664294+0000","last_unstale":"2023-10-10T21:21:21.667793+0000","last_undegraded":"2023-10-10T21:21:21.667793+0000","last_fullsized":"2023-10-10T21:21:21.667793+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:03:03.261575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677354+0000","last_change":"2023-10-10T21:21:20.647547+0000","last_active":"2023-10-10T21:21:21.677354+0000","last_peered":"2023-10-10T21:21:21.677354+0000","last_clean":"2023-10-10T21:21:21.677354+0000","last_became_active":"2023-10-10T21:21:20.646001+0000","last_became_peered":"2023-10-10T21:21:20.646001+0000","last_unstale":"2023-10-10T21:21:21.677354+0000","last_undegraded":"2023-10-10T21:21:21.677354+0000","last_fullsized":"2023-10-10T21:21:21.677354+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:20:54.418021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668656+0000","last_change":"2023-10-10T21:21:21.665435+0000","last_active":"2023-10-10T21:21:21.668656+0000","last_peered":"2023-10-10T21:21:21.668656+0000","last_clean":"2023-10-10T21:21:21.668656+0000","last_became_active":"2023-10-10T21:21:21.665149+0000","last_became_peered":"2023-10-10T21:21:21.665149+0000","last_unstale":"2023-10-10T21:21:21.668656+0000","last_undegraded":"2023-10-10T21:21:21.668656+0000","last_fullsized":"2023-10-10T21:21:21.668656+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:16:44.525573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678305+0000","last_change":"2023-10-10T21:21:20.652313+0000","last_active":"2023-10-10T21:21:21.678305+0000","last_peered":"2023-10-10T21:21:21.678305+0000","last_clean":"2023-10-10T21:21:21.678305+0000","last_became_active":"2023-10-10T21:21:20.652070+0000","last_became_peered":"2023-10-10T21:21:20.652070+0000","last_unstale":"2023-10-10T21:21:21.678305+0000","last_undegraded":"2023-10-10T21:21:21.678305+0000","last_fullsized":"2023-10-10T21:21:21.678305+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:25:02.765470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668027+0000","last_change":"2023-10-10T21:21:21.662168+0000","last_active":"2023-10-10T21:21:21.668027+0000","last_peered":"2023-10-10T21:21:21.668027+0000","last_clean":"2023-10-10T21:21:21.668027+0000","last_became_active":"2023-10-10T21:21:21.661886+0000","last_became_peered":"2023-10-10T21:21:21.661886+0000","last_unstale":"2023-10-10T21:21:21.668027+0000","last_undegraded":"2023-10-10T21:21:21.668027+0000","last_fullsized":"2023-10-10T21:21:21.668027+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:14:22.263178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678567+0000","last_change":"2023-10-10T21:21:20.653160+0000","last_active":"2023-10-10T21:21:21.678567+0000","last_peered":"2023-10-10T21:21:21.678567+0000","last_clean":"2023-10-10T21:21:21.678567+0000","last_became_active":"2023-10-10T21:21:20.652763+0000","last_became_peered":"2023-10-10T21:21:20.652763+0000","last_unstale":"2023-10-10T21:21:21.678567+0000","last_undegraded":"2023-10-10T21:21:21.678567+0000","last_fullsized":"2023-10-10T21:21:21.678567+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:56:53.237937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668977+0000","last_change":"2023-10-10T21:21:21.660738+0000","last_active":"2023-10-10T21:21:21.668977+0000","last_peered":"2023-10-10T21:21:21.668977+0000","last_clean":"2023-10-10T21:21:21.668977+0000","last_became_active":"2023-10-10T21:21:21.660447+0000","last_became_peered":"2023-10-10T21:21:21.660447+0000","last_unstale":"2023-10-10T21:21:21.668977+0000","last_undegraded":"2023-10-10T21:21:21.668977+0000","last_fullsized":"2023-10-10T21:21:21.668977+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:26:31.937357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678096+0000","last_change":"2023-10-10T21:21:20.650487+0000","last_active":"2023-10-10T21:21:21.678096+0000","last_peered":"2023-10-10T21:21:21.678096+0000","last_clean":"2023-10-10T21:21:21.678096+0000","last_became_active":"2023-10-10T21:21:20.650242+0000","last_became_peered":"2023-10-10T21:21:20.650242+0000","last_unstale":"2023-10-10T21:21:21.678096+0000","last_undegraded":"2023-10-10T21:21:21.678096+0000","last_fullsized":"2023-10-10T21:21:21.678096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:40:05.106632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665384+0000","last_change":"2023-10-10T21:21:21.656325+0000","last_active":"2023-10-10T21:21:21.665384+0000","last_peered":"2023-10-10T21:21:21.665384+0000","last_clean":"2023-10-10T21:21:21.665384+0000","last_became_active":"2023-10-10T21:21:21.655762+0000","last_became_peered":"2023-10-10T21:21:21.655762+0000","last_unstale":"2023-10-10T21:21:21.665384+0000","last_undegraded":"2023-10-10T21:21:21.665384+0000","last_fullsized":"2023-10-10T21:21:21.665384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:12.108101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677661+0000","last_change":"2023-10-10T21:21:20.646722+0000","last_active":"2023-10-10T21:21:21.677661+0000","last_peered":"2023-10-10T21:21:21.677661+0000","last_clean":"2023-10-10T21:21:21.677661+0000","last_became_active":"2023-10-10T21:21:20.646451+0000","last_became_peered":"2023-10-10T21:21:20.646451+0000","last_unstale":"2023-10-10T21:21:21.677661+0000","last_undegraded":"2023-10-10T21:21:21.677661+0000","last_fullsized":"2023-10-10T21:21:21.677661+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:30:58.458614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.673704+0000","last_change":"2023-10-10T21:21:21.661179+0000","last_active":"2023-10-10T21:21:21.673704+0000","last_peered":"2023-10-10T21:21:21.673704+0000","last_clean":"2023-10-10T21:21:21.673704+0000","last_became_active":"2023-10-10T21:21:21.660913+0000","last_became_peered":"2023-10-10T21:21:21.660913+0000","last_unstale":"2023-10-10T21:21:21.673704+0000","last_undegraded":"2023-10-10T21:21:21.673704+0000","last_fullsized":"2023-10-10T21:21:21.673704+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:46:31.771453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.648288+0000","last_change":"2023-10-10T21:21:20.643354+0000","last_active":"2023-10-10T21:21:21.648288+0000","last_peered":"2023-10-10T21:21:21.648288+0000","last_clean":"2023-10-10T21:21:21.648288+0000","last_became_active":"2023-10-10T21:21:20.643100+0000","last_became_peered":"2023-10-10T21:21:20.643100+0000","last_unstale":"2023-10-10T21:21:21.648288+0000","last_undegraded":"2023-10-10T21:21:21.648288+0000","last_fullsized":"2023-10-10T21:21:21.648288+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:50:49.328696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665243+0000","last_change":"2023-10-10T21:21:21.662305+0000","last_active":"2023-10-10T21:21:21.665243+0000","last_peered":"2023-10-10T21:21:21.665243+0000","last_clean":"2023-10-10T21:21:21.665243+0000","last_became_active":"2023-10-10T21:21:21.659589+0000","last_became_peered":"2023-10-10T21:21:21.659589+0000","last_unstale":"2023-10-10T21:21:21.665243+0000","last_undegraded":"2023-10-10T21:21:21.665243+0000","last_fullsized":"2023-10-10T21:21:21.665243+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:56:26.749322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.648346+0000","last_change":"2023-10-10T21:21:20.646704+0000","last_active":"2023-10-10T21:21:21.648346+0000","last_peered":"2023-10-10T21:21:21.648346+0000","last_clean":"2023-10-10T21:21:21.648346+0000","last_became_active":"2023-10-10T21:21:20.646134+0000","last_became_peered":"2023-10-10T21:21:20.646134+0000","last_unstale":"2023-10-10T21:21:21.648346+0000","last_undegraded":"2023-10-10T21:21:21.648346+0000","last_fullsized":"2023-10-10T21:21:21.648346+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:49.859463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665182+0000","last_change":"2023-10-10T21:21:21.661167+0000","last_active":"2023-10-10T21:21:21.665182+0000","last_peered":"2023-10-10T21:21:21.665182+0000","last_clean":"2023-10-10T21:21:21.665182+0000","last_became_active":"2023-10-10T21:21:21.660761+0000","last_became_peered":"2023-10-10T21:21:21.660761+0000","last_unstale":"2023-10-10T21:21:21.665182+0000","last_undegraded":"2023-10-10T21:21:21.665182+0000","last_fullsized":"2023-10-10T21:21:21.665182+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:45.896254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646221+0000","last_change":"2023-10-10T21:21:20.651747+0000","last_active":"2023-10-10T21:21:21.646221+0000","last_peered":"2023-10-10T21:21:21.646221+0000","last_clean":"2023-10-10T21:21:21.646221+0000","last_became_active":"2023-10-10T21:21:20.651506+0000","last_became_peered":"2023-10-10T21:21:20.651506+0000","last_unstale":"2023-10-10T21:21:21.646221+0000","last_undegraded":"2023-10-10T21:21:21.646221+0000","last_fullsized":"2023-10-10T21:21:21.646221+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:20:34.051771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.676680+0000","last_change":"2023-10-10T21:21:21.673921+0000","last_active":"2023-10-10T21:21:21.676680+0000","last_peered":"2023-10-10T21:21:21.676680+0000","last_clean":"2023-10-10T21:21:21.676680+0000","last_became_active":"2023-10-10T21:21:21.673631+0000","last_became_peered":"2023-10-10T21:21:21.673631+0000","last_unstale":"2023-10-10T21:21:21.676680+0000","last_undegraded":"2023-10-10T21:21:21.676680+0000","last_fullsized":"2023-10-10T21:21:21.676680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:04:20.723012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.641446+0000","last_change":"2023-10-10T21:21:20.645128+0000","last_active":"2023-10-10T21:21:21.641446+0000","last_peered":"2023-10-10T21:21:21.641446+0000","last_clean":"2023-10-10T21:21:21.641446+0000","last_became_active":"2023-10-10T21:21:20.644873+0000","last_became_peered":"2023-10-10T21:21:20.644873+0000","last_unstale":"2023-10-10T21:21:21.641446+0000","last_undegraded":"2023-10-10T21:21:21.641446+0000","last_fullsized":"2023-10-10T21:21:21.641446+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:00.164312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.670790+0000","last_change":"2023-10-10T21:21:21.662680+0000","last_active":"2023-10-10T21:21:21.670790+0000","last_peered":"2023-10-10T21:21:21.670790+0000","last_clean":"2023-10-10T21:21:21.670790+0000","last_became_active":"2023-10-10T21:21:21.662398+0000","last_became_peered":"2023-10-10T21:21:21.662398+0000","last_unstale":"2023-10-10T21:21:21.670790+0000","last_undegraded":"2023-10-10T21:21:21.670790+0000","last_fullsized":"2023-10-10T21:21:21.670790+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:57:51.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"138'3","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678978+0000","last_change":"2023-10-10T21:21:20.650864+0000","last_active":"2023-10-10T21:21:21.678978+0000","last_peered":"2023-10-10T21:21:21.678978+0000","last_clean":"2023-10-10T21:21:21.678978+0000","last_became_active":"2023-10-10T21:21:20.650554+0000","last_became_peered":"2023-10-10T21:21:20.650554+0000","last_unstale":"2023-10-10T21:21:21.678978+0000","last_undegraded":"2023-10-10T21:21:21.678978+0000","last_fullsized":"2023-10-10T21:21:21.678978+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:11.100456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665343+0000","last_change":"2023-10-10T21:21:21.660428+0000","last_active":"2023-10-10T21:21:21.665343+0000","last_peered":"2023-10-10T21:21:21.665343+0000","last_clean":"2023-10-10T21:21:21.665343+0000","last_became_active":"2023-10-10T21:21:21.658894+0000","last_became_peered":"2023-10-10T21:21:21.658894+0000","last_unstale":"2023-10-10T21:21:21.665343+0000","last_undegraded":"2023-10-10T21:21:21.665343+0000","last_fullsized":"2023-10-10T21:21:21.665343+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:06:19.377900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"138'6","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.682851+0000","last_change":"2023-10-10T21:21:20.647860+0000","last_active":"2023-10-10T21:21:21.682851+0000","last_peered":"2023-10-10T21:21:21.682851+0000","last_clean":"2023-10-10T21:21:21.682851+0000","last_became_active":"2023-10-10T21:21:20.647650+0000","last_became_peered":"2023-10-10T21:21:20.647650+0000","last_unstale":"2023-10-10T21:21:21.682851+0000","last_undegraded":"2023-10-10T21:21:21.682851+0000","last_fullsized":"2023-10-10T21:21:21.682851+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:04:19.715367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.660657+0000","last_change":"2023-10-10T21:21:21.651368+0000","last_active":"2023-10-10T21:21:21.660657+0000","last_peered":"2023-10-10T21:21:21.660657+0000","last_clean":"2023-10-10T21:21:21.660657+0000","last_became_active":"2023-10-10T21:21:21.651109+0000","last_became_peered":"2023-10-10T21:21:21.651109+0000","last_unstale":"2023-10-10T21:21:21.660657+0000","last_undegraded":"2023-10-10T21:21:21.660657+0000","last_fullsized":"2023-10-10T21:21:21.660657+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:21.277129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671628+0000","last_change":"2023-10-10T21:21:20.647637+0000","last_active":"2023-10-10T21:21:21.671628+0000","last_peered":"2023-10-10T21:21:21.671628+0000","last_clean":"2023-10-10T21:21:21.671628+0000","last_became_active":"2023-10-10T21:21:20.647348+0000","last_became_peered":"2023-10-10T21:21:20.647348+0000","last_unstale":"2023-10-10T21:21:21.671628+0000","last_undegraded":"2023-10-10T21:21:21.671628+0000","last_fullsized":"2023-10-10T21:21:21.671628+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:33:49.109653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668492+0000","last_change":"2023-10-10T21:21:21.657796+0000","last_active":"2023-10-10T21:21:21.668492+0000","last_peered":"2023-10-10T21:21:21.668492+0000","last_clean":"2023-10-10T21:21:21.668492+0000","last_became_active":"2023-10-10T21:21:21.657523+0000","last_became_peered":"2023-10-10T21:21:21.657523+0000","last_unstale":"2023-10-10T21:21:21.668492+0000","last_undegraded":"2023-10-10T21:21:21.668492+0000","last_fullsized":"2023-10-10T21:21:21.668492+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:40:13.907698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.650763+0000","last_change":"2023-10-10T21:21:20.649734+0000","last_active":"2023-10-10T21:21:21.650763+0000","last_peered":"2023-10-10T21:21:21.650763+0000","last_clean":"2023-10-10T21:21:21.650763+0000","last_became_active":"2023-10-10T21:21:20.649521+0000","last_became_peered":"2023-10-10T21:21:20.649521+0000","last_unstale":"2023-10-10T21:21:21.650763+0000","last_undegraded":"2023-10-10T21:21:21.650763+0000","last_fullsized":"2023-10-10T21:21:21.650763+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:10.685980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.659603+0000","last_change":"2023-10-10T21:21:21.650016+0000","last_active":"2023-10-10T21:21:21.659603+0000","last_peered":"2023-10-10T21:21:21.659603+0000","last_clean":"2023-10-10T21:21:21.659603+0000","last_became_active":"2023-10-10T21:21:21.649762+0000","last_became_peered":"2023-10-10T21:21:21.649762+0000","last_unstale":"2023-10-10T21:21:21.659603+0000","last_undegraded":"2023-10-10T21:21:21.659603+0000","last_fullsized":"2023-10-10T21:21:21.659603+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:54:07.870899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"138'8","reported_seq":18,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.680617+0000","last_change":"2023-10-10T21:21:20.653738+0000","last_active":"2023-10-10T21:21:21.680617+0000","last_peered":"2023-10-10T21:21:21.680617+0000","last_clean":"2023-10-10T21:21:21.680617+0000","last_became_active":"2023-10-10T21:21:20.653430+0000","last_became_peered":"2023-10-10T21:21:20.653430+0000","last_unstale":"2023-10-10T21:21:21.680617+0000","last_undegraded":"2023-10-10T21:21:21.680617+0000","last_fullsized":"2023-10-10T21:21:21.680617+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:29:07.839253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667569+0000","last_change":"2023-10-10T21:21:21.665732+0000","last_active":"2023-10-10T21:21:21.667569+0000","last_peered":"2023-10-10T21:21:21.667569+0000","last_clean":"2023-10-10T21:21:21.667569+0000","last_became_active":"2023-10-10T21:21:21.665498+0000","last_became_peered":"2023-10-10T21:21:21.665498+0000","last_unstale":"2023-10-10T21:21:21.667569+0000","last_undegraded":"2023-10-10T21:21:21.667569+0000","last_fullsized":"2023-10-10T21:21:21.667569+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:02:27.994154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678785+0000","last_change":"2023-10-10T21:21:20.643663+0000","last_active":"2023-10-10T21:21:21.678785+0000","last_peered":"2023-10-10T21:21:21.678785+0000","last_clean":"2023-10-10T21:21:21.678785+0000","last_became_active":"2023-10-10T21:21:20.643393+0000","last_became_peered":"2023-10-10T21:21:20.643393+0000","last_unstale":"2023-10-10T21:21:21.678785+0000","last_undegraded":"2023-10-10T21:21:21.678785+0000","last_fullsized":"2023-10-10T21:21:21.678785+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:09:58.670734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.679169+0000","last_change":"2023-10-10T21:21:21.672120+0000","last_active":"2023-10-10T21:21:21.679169+0000","last_peered":"2023-10-10T21:21:21.679169+0000","last_clean":"2023-10-10T21:21:21.679169+0000","last_became_active":"2023-10-10T21:21:21.671857+0000","last_became_peered":"2023-10-10T21:21:21.671857+0000","last_unstale":"2023-10-10T21:21:21.679169+0000","last_undegraded":"2023-10-10T21:21:21.679169+0000","last_fullsized":"2023-10-10T21:21:21.679169+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T21:42:09.661219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677884+0000","last_change":"2023-10-10T21:21:20.647897+0000","last_active":"2023-10-10T21:21:21.677884+0000","last_peered":"2023-10-10T21:21:21.677884+0000","last_clean":"2023-10-10T21:21:21.677884+0000","last_became_active":"2023-10-10T21:21:20.647288+0000","last_became_peered":"2023-10-10T21:21:20.647288+0000","last_unstale":"2023-10-10T21:21:21.677884+0000","last_undegraded":"2023-10-10T21:21:21.677884+0000","last_fullsized":"2023-10-10T21:21:21.677884+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:19.260433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674078+0000","last_change":"2023-10-10T21:21:21.669957+0000","last_active":"2023-10-10T21:21:21.674078+0000","last_peered":"2023-10-10T21:21:21.674078+0000","last_clean":"2023-10-10T21:21:21.674078+0000","last_became_active":"2023-10-10T21:21:21.669691+0000","last_became_peered":"2023-10-10T21:21:21.669691+0000","last_unstale":"2023-10-10T21:21:21.674078+0000","last_undegraded":"2023-10-10T21:21:21.674078+0000","last_fullsized":"2023-10-10T21:21:21.674078+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:16:43.317454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671346+0000","last_change":"2023-10-10T21:21:20.643019+0000","last_active":"2023-10-10T21:21:21.671346+0000","last_peered":"2023-10-10T21:21:21.671346+0000","last_clean":"2023-10-10T21:21:21.671346+0000","last_became_active":"2023-10-10T21:21:20.642725+0000","last_became_peered":"2023-10-10T21:21:20.642725+0000","last_unstale":"2023-10-10T21:21:21.671346+0000","last_undegraded":"2023-10-10T21:21:21.671346+0000","last_fullsized":"2023-10-10T21:21:21.671346+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:08:00.005004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668911+0000","last_change":"2023-10-10T21:21:21.666705+0000","last_active":"2023-10-10T21:21:21.668911+0000","last_peered":"2023-10-10T21:21:21.668911+0000","last_clean":"2023-10-10T21:21:21.668911+0000","last_became_active":"2023-10-10T21:21:21.666428+0000","last_became_peered":"2023-10-10T21:21:21.666428+0000","last_unstale":"2023-10-10T21:21:21.668911+0000","last_undegraded":"2023-10-10T21:21:21.668911+0000","last_fullsized":"2023-10-10T21:21:21.668911+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:50.867107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646997+0000","last_change":"2023-10-10T21:21:20.640515+0000","last_active":"2023-10-10T21:21:21.646997+0000","last_peered":"2023-10-10T21:21:21.646997+0000","last_clean":"2023-10-10T21:21:21.646997+0000","last_became_active":"2023-10-10T21:21:20.640217+0000","last_became_peered":"2023-10-10T21:21:20.640217+0000","last_unstale":"2023-10-10T21:21:21.646997+0000","last_undegraded":"2023-10-10T21:21:21.646997+0000","last_fullsized":"2023-10-10T21:21:21.646997+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:16:43.517928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674023+0000","last_change":"2023-10-10T21:21:21.669072+0000","last_active":"2023-10-10T21:21:21.674023+0000","last_peered":"2023-10-10T21:21:21.674023+0000","last_clean":"2023-10-10T21:21:21.674023+0000","last_became_active":"2023-10-10T21:21:21.668811+0000","last_became_peered":"2023-10-10T21:21:21.668811+0000","last_unstale":"2023-10-10T21:21:21.674023+0000","last_undegraded":"2023-10-10T21:21:21.674023+0000","last_fullsized":"2023-10-10T21:21:21.674023+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:39.106972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668257+0000","last_change":"2023-10-10T21:21:20.649352+0000","last_active":"2023-10-10T21:21:21.668257+0000","last_peered":"2023-10-10T21:21:21.668257+0000","last_clean":"2023-10-10T21:21:21.668257+0000","last_became_active":"2023-10-10T21:21:20.649096+0000","last_became_peered":"2023-10-10T21:21:20.649096+0000","last_unstale":"2023-10-10T21:21:21.668257+0000","last_undegraded":"2023-10-10T21:21:21.668257+0000","last_fullsized":"2023-10-10T21:21:21.668257+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:40:24.747387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668117+0000","last_change":"2023-10-10T21:21:21.656600+0000","last_active":"2023-10-10T21:21:21.668117+0000","last_peered":"2023-10-10T21:21:21.668117+0000","last_clean":"2023-10-10T21:21:21.668117+0000","last_became_active":"2023-10-10T21:21:21.656356+0000","last_became_peered":"2023-10-10T21:21:21.656356+0000","last_unstale":"2023-10-10T21:21:21.668117+0000","last_undegraded":"2023-10-10T21:21:21.668117+0000","last_fullsized":"2023-10-10T21:21:21.668117+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:31:05.590991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646055+0000","last_change":"2023-10-10T21:21:20.651727+0000","last_active":"2023-10-10T21:21:21.646055+0000","last_peered":"2023-10-10T21:21:21.646055+0000","last_clean":"2023-10-10T21:21:21.646055+0000","last_became_active":"2023-10-10T21:21:20.651463+0000","last_became_peered":"2023-10-10T21:21:20.651463+0000","last_unstale":"2023-10-10T21:21:21.646055+0000","last_undegraded":"2023-10-10T21:21:21.646055+0000","last_fullsized":"2023-10-10T21:21:21.646055+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:15:24.656623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.664508+0000","last_change":"2023-10-10T21:21:21.658254+0000","last_active":"2023-10-10T21:21:21.664508+0000","last_peered":"2023-10-10T21:21:21.664508+0000","last_clean":"2023-10-10T21:21:21.664508+0000","last_became_active":"2023-10-10T21:21:21.657995+0000","last_became_peered":"2023-10-10T21:21:21.657995+0000","last_unstale":"2023-10-10T21:21:21.664508+0000","last_undegraded":"2023-10-10T21:21:21.664508+0000","last_fullsized":"2023-10-10T21:21:21.664508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:22:48.044157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.649966+0000","last_change":"2023-10-10T21:21:20.648486+0000","last_active":"2023-10-10T21:21:21.649966+0000","last_peered":"2023-10-10T21:21:21.649966+0000","last_clean":"2023-10-10T21:21:21.649966+0000","last_became_active":"2023-10-10T21:21:20.648149+0000","last_became_peered":"2023-10-10T21:21:20.648149+0000","last_unstale":"2023-10-10T21:21:21.649966+0000","last_undegraded":"2023-10-10T21:21:21.649966+0000","last_fullsized":"2023-10-10T21:21:21.649966+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:48:47.712878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.659855+0000","last_change":"2023-10-10T21:21:21.654893+0000","last_active":"2023-10-10T21:21:21.659855+0000","last_peered":"2023-10-10T21:21:21.659855+0000","last_clean":"2023-10-10T21:21:21.659855+0000","last_became_active":"2023-10-10T21:21:21.654615+0000","last_became_peered":"2023-10-10T21:21:21.654615+0000","last_unstale":"2023-10-10T21:21:21.659855+0000","last_undegraded":"2023-10-10T21:21:21.659855+0000","last_fullsized":"2023-10-10T21:21:21.659855+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:57:05.453945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.648438+0000","last_change":"2023-10-10T21:21:20.647425+0000","last_active":"2023-10-10T21:21:21.648438+0000","last_peered":"2023-10-10T21:21:21.648438+0000","last_clean":"2023-10-10T21:21:21.648438+0000","last_became_active":"2023-10-10T21:21:20.646966+0000","last_became_peered":"2023-10-10T21:21:20.646966+0000","last_unstale":"2023-10-10T21:21:21.648438+0000","last_undegraded":"2023-10-10T21:21:21.648438+0000","last_fullsized":"2023-10-10T21:21:21.648438+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:57.595963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677955+0000","last_change":"2023-10-10T21:21:21.677062+0000","last_active":"2023-10-10T21:21:21.677955+0000","last_peered":"2023-10-10T21:21:21.677955+0000","last_clean":"2023-10-10T21:21:21.677955+0000","last_became_active":"2023-10-10T21:21:21.676715+0000","last_became_peered":"2023-10-10T21:21:21.676715+0000","last_unstale":"2023-10-10T21:21:21.677955+0000","last_undegraded":"2023-10-10T21:21:21.677955+0000","last_fullsized":"2023-10-10T21:21:21.677955+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:16:43.317454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.680744+0000","last_change":"2023-10-10T21:21:20.647062+0000","last_active":"2023-10-10T21:21:21.680744+0000","last_peered":"2023-10-10T21:21:21.680744+0000","last_clean":"2023-10-10T21:21:21.680744+0000","last_became_active":"2023-10-10T21:21:20.646782+0000","last_became_peered":"2023-10-10T21:21:20.646782+0000","last_unstale":"2023-10-10T21:21:21.680744+0000","last_undegraded":"2023-10-10T21:21:21.680744+0000","last_fullsized":"2023-10-10T21:21:21.680744+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:27:14.434102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.678125+0000","last_change":"2023-10-10T21:21:21.673037+0000","last_active":"2023-10-10T21:21:21.678125+0000","last_peered":"2023-10-10T21:21:21.678125+0000","last_clean":"2023-10-10T21:21:21.678125+0000","last_became_active":"2023-10-10T21:21:21.672714+0000","last_became_peered":"2023-10-10T21:21:21.672714+0000","last_unstale":"2023-10-10T21:21:21.678125+0000","last_undegraded":"2023-10-10T21:21:21.678125+0000","last_fullsized":"2023-10-10T21:21:21.678125+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:56:01.648955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.650669+0000","last_change":"2023-10-10T21:21:20.644602+0000","last_active":"2023-10-10T21:21:21.650669+0000","last_peered":"2023-10-10T21:21:21.650669+0000","last_clean":"2023-10-10T21:21:21.650669+0000","last_became_active":"2023-10-10T21:21:20.644337+0000","last_became_peered":"2023-10-10T21:21:20.644337+0000","last_unstale":"2023-10-10T21:21:21.650669+0000","last_undegraded":"2023-10-10T21:21:21.650669+0000","last_fullsized":"2023-10-10T21:21:21.650669+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:41:43.454497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.674040+0000","last_change":"2023-10-10T21:21:21.666250+0000","last_active":"2023-10-10T21:21:21.674040+0000","last_peered":"2023-10-10T21:21:21.674040+0000","last_clean":"2023-10-10T21:21:21.674040+0000","last_became_active":"2023-10-10T21:21:21.665987+0000","last_became_peered":"2023-10-10T21:21:21.665987+0000","last_unstale":"2023-10-10T21:21:21.674040+0000","last_undegraded":"2023-10-10T21:21:21.674040+0000","last_fullsized":"2023-10-10T21:21:21.674040+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:03:45.794079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646281+0000","last_change":"2023-10-10T21:21:20.644736+0000","last_active":"2023-10-10T21:21:21.646281+0000","last_peered":"2023-10-10T21:21:21.646281+0000","last_clean":"2023-10-10T21:21:21.646281+0000","last_became_active":"2023-10-10T21:21:20.644412+0000","last_became_peered":"2023-10-10T21:21:20.644412+0000","last_unstale":"2023-10-10T21:21:21.646281+0000","last_undegraded":"2023-10-10T21:21:21.646281+0000","last_fullsized":"2023-10-10T21:21:21.646281+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:16:42.309809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.677939+0000","last_change":"2023-10-10T21:21:21.676903+0000","last_active":"2023-10-10T21:21:21.677939+0000","last_peered":"2023-10-10T21:21:21.677939+0000","last_clean":"2023-10-10T21:21:21.677939+0000","last_became_active":"2023-10-10T21:21:21.676612+0000","last_became_peered":"2023-10-10T21:21:21.676612+0000","last_unstale":"2023-10-10T21:21:21.677939+0000","last_undegraded":"2023-10-10T21:21:21.677939+0000","last_fullsized":"2023-10-10T21:21:21.677939+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:50.867107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.642188+0000","last_change":"2023-10-10T21:21:20.650617+0000","last_active":"2023-10-10T21:21:21.642188+0000","last_peered":"2023-10-10T21:21:21.642188+0000","last_clean":"2023-10-10T21:21:21.642188+0000","last_became_active":"2023-10-10T21:21:20.650368+0000","last_became_peered":"2023-10-10T21:21:20.650368+0000","last_unstale":"2023-10-10T21:21:21.642188+0000","last_undegraded":"2023-10-10T21:21:21.642188+0000","last_fullsized":"2023-10-10T21:21:21.642188+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:20:58.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.671129+0000","last_change":"2023-10-10T21:21:21.666780+0000","last_active":"2023-10-10T21:21:21.671129+0000","last_peered":"2023-10-10T21:21:21.671129+0000","last_clean":"2023-10-10T21:21:21.671129+0000","last_became_active":"2023-10-10T21:21:21.663777+0000","last_became_peered":"2023-10-10T21:21:21.663777+0000","last_unstale":"2023-10-10T21:21:21.671129+0000","last_undegraded":"2023-10-10T21:21:21.671129+0000","last_fullsized":"2023-10-10T21:21:21.671129+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:50.867107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646573+0000","last_change":"2023-10-10T21:21:20.641802+0000","last_active":"2023-10-10T21:21:21.646573+0000","last_peered":"2023-10-10T21:21:21.646573+0000","last_clean":"2023-10-10T21:21:21.646573+0000","last_became_active":"2023-10-10T21:21:20.641513+0000","last_became_peered":"2023-10-10T21:21:20.641513+0000","last_unstale":"2023-10-10T21:21:21.646573+0000","last_undegraded":"2023-10-10T21:21:21.646573+0000","last_fullsized":"2023-10-10T21:21:21.646573+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:42.396278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.665403+0000","last_change":"2023-10-10T21:21:21.659275+0000","last_active":"2023-10-10T21:21:21.665403+0000","last_peered":"2023-10-10T21:21:21.665403+0000","last_clean":"2023-10-10T21:21:21.665403+0000","last_became_active":"2023-10-10T21:21:21.658933+0000","last_became_peered":"2023-10-10T21:21:21.658933+0000","last_unstale":"2023-10-10T21:21:21.665403+0000","last_undegraded":"2023-10-10T21:21:21.665403+0000","last_fullsized":"2023-10-10T21:21:21.665403+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:48:50.409345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.649138+0000","last_change":"2023-10-10T21:21:20.648724+0000","last_active":"2023-10-10T21:21:21.649138+0000","last_peered":"2023-10-10T21:21:21.649138+0000","last_clean":"2023-10-10T21:21:21.649138+0000","last_became_active":"2023-10-10T21:21:20.648376+0000","last_became_peered":"2023-10-10T21:21:20.648376+0000","last_unstale":"2023-10-10T21:21:21.649138+0000","last_undegraded":"2023-10-10T21:21:21.649138+0000","last_fullsized":"2023-10-10T21:21:21.649138+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:53.554860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.664587+0000","last_change":"2023-10-10T21:21:21.661210+0000","last_active":"2023-10-10T21:21:21.664587+0000","last_peered":"2023-10-10T21:21:21.664587+0000","last_clean":"2023-10-10T21:21:21.664587+0000","last_became_active":"2023-10-10T21:21:21.660881+0000","last_became_peered":"2023-10-10T21:21:21.660881+0000","last_unstale":"2023-10-10T21:21:21.664587+0000","last_undegraded":"2023-10-10T21:21:21.664587+0000","last_fullsized":"2023-10-10T21:21:21.664587+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:59:58.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.645975+0000","last_change":"2023-10-10T21:21:20.653001+0000","last_active":"2023-10-10T21:21:21.645975+0000","last_peered":"2023-10-10T21:21:21.645975+0000","last_clean":"2023-10-10T21:21:21.645975+0000","last_became_active":"2023-10-10T21:21:20.652701+0000","last_became_peered":"2023-10-10T21:21:20.652701+0000","last_unstale":"2023-10-10T21:21:21.645975+0000","last_undegraded":"2023-10-10T21:21:21.645975+0000","last_fullsized":"2023-10-10T21:21:21.645975+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:53:16.344968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.667742+0000","last_change":"2023-10-10T21:21:21.660425+0000","last_active":"2023-10-10T21:21:21.667742+0000","last_peered":"2023-10-10T21:21:21.667742+0000","last_clean":"2023-10-10T21:21:21.667742+0000","last_became_active":"2023-10-10T21:21:21.660173+0000","last_became_peered":"2023-10-10T21:21:21.660173+0000","last_unstale":"2023-10-10T21:21:21.667742+0000","last_undegraded":"2023-10-10T21:21:21.667742+0000","last_fullsized":"2023-10-10T21:21:21.667742+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:58:19.916639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.648553+0000","last_change":"2023-10-10T21:21:20.647239+0000","last_active":"2023-10-10T21:21:21.648553+0000","last_peered":"2023-10-10T21:21:21.648553+0000","last_clean":"2023-10-10T21:21:21.648553+0000","last_became_active":"2023-10-10T21:21:20.646457+0000","last_became_peered":"2023-10-10T21:21:20.646457+0000","last_unstale":"2023-10-10T21:21:21.648553+0000","last_undegraded":"2023-10-10T21:21:21.648553+0000","last_fullsized":"2023-10-10T21:21:21.648553+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:24:05.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.668713+0000","last_change":"2023-10-10T21:21:21.658198+0000","last_active":"2023-10-10T21:21:21.668713+0000","last_peered":"2023-10-10T21:21:21.668713+0000","last_clean":"2023-10-10T21:21:21.668713+0000","last_became_active":"2023-10-10T21:21:21.657945+0000","last_became_peered":"2023-10-10T21:21:21.657945+0000","last_unstale":"2023-10-10T21:21:21.668713+0000","last_undegraded":"2023-10-10T21:21:21.668713+0000","last_fullsized":"2023-10-10T21:21:21.668713+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:20.624742+0000","last_clean_scrub_stamp":"2023-10-10T21:21:20.624742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:24:26.936749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.646406+0000","last_change":"2023-10-10T21:21:20.641100+0000","last_active":"2023-10-10T21:21:21.646406+0000","last_peered":"2023-10-10T21:21:21.646406+0000","last_clean":"2023-10-10T21:21:21.646406+0000","last_became_active":"2023-10-10T21:21:20.640853+0000","last_became_peered":"2023-10-10T21:21:20.640853+0000","last_unstale":"2023-10-10T21:21:21.646406+0000","last_undegraded":"2023-10-10T21:21:21.646406+0000","last_fullsized":"2023-10-10T21:21:21.646406+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:21:19.617098+0000","last_clean_scrub_stamp":"2023-10-10T21:21:19.617098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:08:07.601872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":734,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-10T21:21:21.653225+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T21:21:21.653225+0000","last_peered":"2023-10-10T21:21:21.653225+0000","last_clean":"2023-10-10T21:21:21.653225+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T21:21:21.653225+0000","last_undegraded":"2023-10-10T21:21:21.653225+0000","last_fullsized":"2023-10-10T21:21:21.653225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542370,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2322432,"data_stored":1435729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97699999999999998,"5min":1.052,"15min":1.052},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.441},"max":{"1min":0.91800000000000004,"5min":1.161,"15min":1.161},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90900000000000003,"5min":1.179,"15min":1.179},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.439,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.70899999999999996,"15min":0.71999999999999997},"min":{"1min":0.47599999999999998,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.93799999999999994,"5min":1.012,"15min":1.012},"last":0.67400000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:20:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.42199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":0.877,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.61799999999999999},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.36699999999999999},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.48999999999999999,"5min":0.40200000000000002,"15min":0.34599999999999997},"max":{"1min":0.91200000000000003,"5min":1.016,"15min":1.3700000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.41399999999999998,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.75800000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.54300000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79200000000000004,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.5},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.78400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542369,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303068,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068772,"statfs":{"total":96636764160,"available":96326422528,"internally_reserved":0,"allocated":1724416,"data_stored":844843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36499999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.0189999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.69799999999999995},"min":{"1min":0.48599999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.1040000000000001},"last":0.60199999999999998}]},{"osd":1,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.42999999999999999},"max":{"1min":0.98199999999999998,"5min":1.0129999999999999,"15min":1.03},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.75600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.073},"last":0.67300000000000004}]},{"osd":2,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66600000000000004,"15min":0.68899999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.442},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.016},"last":0.61599999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0309999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.52800000000000002,"5min":0.501,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.042,"15min":1.042},"last":0.76700000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.872,"5min":0.88500000000000001,"15min":1.0369999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38900000000000001},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.57599999999999996}]},{"osd":5,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70899999999999996,"15min":0.71799999999999997},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46400000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.64400000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542369,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303072,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068768,"statfs":{"total":96636764160,"available":96326418432,"internally_reserved":0,"allocated":1728512,"data_stored":844897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.54100000000000004,"15min":0.48799999999999999},"min":{"1min":0.28299999999999997,"5min":0.26200000000000001,"15min":0.24099999999999999},"max":{"1min":0.72899999999999998,"5min":8.0839999999999996,"15min":8.0839999999999996},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.623,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.23000000000000001},"max":{"1min":0.69999999999999996,"5min":13.223000000000001,"15min":13.223000000000001},"last":0.28399999999999997}]},{"osd":2,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":2.254,"15min":2.254},"last":0.308},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.378},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.44800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75600000000000001,"5min":0.999,"15min":0.999},"last":0.39500000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.54300000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94699999999999995,"5min":4.806,"15min":4.806},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.42199999999999999},"max":{"1min":0.98099999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.45500000000000002}]},{"osd":5,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.77900000000000003},"min":{"1min":0.48399999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97699999999999998,"5min":6.968,"15min":6.968},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.876,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90700000000000003,"5min":13.130000000000001,"15min":13.130000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.99399999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Tue Oct 10 21:20:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.81000000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":12.026,"15min":12.026},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0329999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.443}]}]},{"osd":0,"up_from":14,"seq":60129542371,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303664,"kb_used_data":2280,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068176,"statfs":{"total":96636764160,"available":96325812224,"internally_reserved":0,"allocated":2334720,"data_stored":1436789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.60599999999999998,"5min":0.74399999999999999,"15min":0.752},"last":0.379},{"interface":"front","average":{"1min":0.437,"5min":0.49199999999999999,"15min":0.51600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":0.879,"15min":0.91800000000000004},"last":0.49399999999999999}]},{"osd":2,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.72699999999999998,"15min":0.76700000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46500000000000002}]},{"osd":3,"last update":"Tue Oct 10 21:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.498,"15min":0.51400000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.73299999999999998,"15min":0.90300000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56799999999999995,"15min":0.59899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.67600000000000005,"5min":0.81299999999999994,"15min":0.874},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1080000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73699999999999999,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.075,"5min":1.1679999999999999,"15min":1.2190000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.018,"5min":1.0980000000000001,"15min":1.1439999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82099999999999995},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.008,"5min":1.1719999999999999,"15min":1.2090000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.59699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98399999999999999,"5min":1.1339999999999999,"15min":1.143},"last":0.99399999999999999}]},{"osd":7,"last update":"Tue Oct 10 21:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78400000000000003,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.036,"5min":1.139,"15min":1.169},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0549999999999999,"5min":1.097,"15min":1.165},"last":0.97399999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542371,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311256,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060584,"statfs":{"total":96636764160,"available":96318038016,"internally_reserved":0,"allocated":1720320,"data_stored":844773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26200000000000001},"max":{"1min":0.68400000000000005,"5min":0.71799999999999997,"15min":0.95699999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48999999999999999,"15min":0.50900000000000001},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.29599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.30599999999999999,"5min":0.28999999999999998,"15min":0.28699999999999998},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.504},{"interface":"front","average":{"1min":0.497,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":1.9099999999999999},"last":0.40600000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.624},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73699999999999999,"15min":0.77000000000000002},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0860000000000001,"15min":1.26},"last":0.72699999999999998}]},{"osd":5,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.77800000000000002},"min":{"1min":0.54100000000000004,"5min":0.47499999999999998,"15min":0.46200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":2.21},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74199999999999999,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.52000000000000002,"15min":0.48399999999999999},"max":{"1min":1.1000000000000001,"5min":1.125,"15min":1.268},"last":0.61299999999999999}]},{"osd":6,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76300000000000001,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.3080000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.54900000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.345,"15min":1.345},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:20:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.087,"5min":1.2290000000000001,"15min":1.716},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.75,"15min":0.79200000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2330000000000001},"last":0.77200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509666,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307176,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064664,"statfs":{"total":96636764160,"available":96322215936,"internally_reserved":0,"allocated":1736704,"data_stored":846379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.45500000000000002},"min":{"1min":0.316,"5min":0.28000000000000003,"15min":0.27900000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.83099999999999996},"last":0.308},{"interface":"front","average":{"1min":0.442,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59399999999999997,"5min":0.77000000000000002,"15min":0.84399999999999997},"last":0.47099999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.25800000000000001},"max":{"1min":0.66400000000000003,"5min":0.87,"15min":0.87},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.40400000000000003,"5min":0.38400000000000001,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70399999999999996,"5min":0.81000000000000005,"15min":0.92200000000000004},"last":0.53000000000000003}]},{"osd":4,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73899999999999999,"15min":0.76600000000000001},"min":{"1min":0.50700000000000001,"5min":0.48799999999999999,"15min":0.42599999999999999},"max":{"1min":0.95099999999999996,"5min":1.1200000000000001,"15min":1.3440000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.433},"max":{"1min":1.03,"5min":1.1339999999999999,"15min":1.246},"last":0.74199999999999999}]},{"osd":5,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.21,"15min":1.21},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.014,"5min":1.165,"15min":1.2250000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0549999999999999,"5min":1.081,"15min":1.27},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":1.052,"15min":1.224},"last":0.75600000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.117,"15min":1.1319999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.53500000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.98699999999999999,"5min":1.228,"15min":1.228},"last":0.78100000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542371,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311256,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060584,"statfs":{"total":96636764160,"available":96318038016,"internally_reserved":0,"allocated":1720320,"data_stored":844773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65300000000000002,"15min":0.68700000000000006},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.91000000000000003,"5min":0.99399999999999999,"15min":1.1479999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.72399999999999998},"min":{"1min":0.437,"5min":0.318,"15min":0.318},"max":{"1min":0.879,"5min":1.121,"15min":1.5029999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.1859999999999999,"15min":1.47},"last":0.745},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":1.155,"15min":1.155},"last":0.77100000000000002}]},{"osd":2,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.50700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0009999999999999,"5min":1.002,"15min":1.536},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68600000000000005,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.376},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":1.3100000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":1.2330000000000001,"15min":1.397},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68100000000000005,"15min":0.71499999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0009999999999999,"5min":1.0800000000000001,"15min":1.385},"last":0.58999999999999997}]},{"osd":5,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.93999999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.96299999999999997,"5min":1,"15min":1.196},"last":0.60599999999999998}]},{"osd":6,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.99199999999999999,"15min":1.3560000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95599999999999996,"5min":1.0149999999999999,"15min":1.216},"last":0.79700000000000004}]},{"osd":7,"last update":"Tue Oct 10 21:20:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.503,"5min":0.377,"15min":0.377},"max":{"1min":0.96999999999999997,"5min":1.006,"15min":1.2390000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.442},"max":{"1min":0.91000000000000003,"5min":1.034,"15min":1.4139999999999999},"last":0.68000000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542369,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307168,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064672,"statfs":{"total":96636764160,"available":96322224128,"internally_reserved":0,"allocated":1728512,"data_stored":845349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.29799999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.95399999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.59299999999999997}]},{"osd":1,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.97299999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70799999999999996},"min":{"1min":0.46999999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94299999999999995,"5min":1.0009999999999999,"15min":1.018},"last":0.66200000000000003}]},{"osd":2,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.50600000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.01},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.2909999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.74199999999999999},"min":{"1min":0.57199999999999995,"5min":0.5,"15min":0.48799999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.044},"last":0.626}]},{"osd":4,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92900000000000005,"5min":1.2110000000000001,"15min":1.5900000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":0.95099999999999996,"15min":1.496},"last":0.498}]},{"osd":6,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.39800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99299999999999999,"5min":1.131,"15min":1.131},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.54000000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Oct 10 21:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.46300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.008,"5min":1.097,"15min":1.097},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0329999999999999,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T21:21:31.314 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T21:21:31.315 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T21:21:31.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.539+0000 7f95517ff700 1 Processor -- start 2023-10-10T21:21:31.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.539+0000 7f95517ff700 1 -- start start 2023-10-10T21:21:31.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.540+0000 7f95517ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f954c0c85c0 0x7f954c06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.540+0000 7f95517ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 0x7f954c069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.540+0000 7f95517ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0c7bf0 con 0x7f954c156ee0 2023-10-10T21:21:31.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.540+0000 7f95517ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c068aa0 con 0x7f954c0c85c0 2023-10-10T21:21:31.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.540+0000 7f95517ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c156340 con 0x7f954c069890 2023-10-10T21:21:31.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.540+0000 7f954a7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f954c156ee0 0x7f954c068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49418/0 (socket says 172.21.15.154:49418) 2023-10-10T21:21:31.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f954a7fc700 1 -- 172.21.15.154:0/2256399399 learned_addr learned my addr 172.21.15.154:0/2256399399 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:31.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f954affd700 1 --2- 172.21.15.154:0/2256399399 >> v2:172.21.15.179:3300/0 conn(0x7f954c0c85c0 0x7f954c06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f954b7fe700 1 --2- 172.21.15.154:0/2256399399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 0x7f954c069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f9549ffb700 1 -- 172.21.15.154:0/2256399399 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101588913 0 0) 0x7f954c0c7bf0 con 0x7f954c156ee0 2023-10-10T21:21:31.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f9549ffb700 1 -- 172.21.15.154:0/2256399399 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9534003570 con 0x7f954c156ee0 2023-10-10T21:21:31.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f9549ffb700 1 -- 172.21.15.154:0/2256399399 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142955317 0 0) 0x7f9534003570 con 0x7f954c156ee0 2023-10-10T21:21:31.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f954affd700 1 -- 172.21.15.154:0/2256399399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 msgr2=0x7f954c069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:31.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f954affd700 1 --2- 172.21.15.154:0/2256399399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 0x7f954c069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f954affd700 1 -- 172.21.15.154:0/2256399399 >> v1:172.21.15.154:6789/0 conn(0x7f954c156ee0 legacy=0x7f954c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f954affd700 1 -- 172.21.15.154:0/2256399399 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c06a1f0 con 0x7f954c0c85c0 2023-10-10T21:21:31.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.541+0000 7f954b7fe700 1 --2- 172.21.15.154:0/2256399399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 0x7f954c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:31.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.542+0000 7f954affd700 1 --2- 172.21.15.154:0/2256399399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 0x7f954c06d6c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f953c0098e0 tx=0x7f953c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f16b578836d5af15 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:31.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.542+0000 7f9549ffb700 1 -- 172.21.15.154:0/2256399399 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540001470 con 0x7f954c0c85c0 2023-10-10T21:21:31.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.542+0000 7f9549ffb700 1 -- 172.21.15.154:0/2256399399 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c011420 con 0x7f954c0c85c0 2023-10-10T21:21:31.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.542+0000 7f9549ffb700 1 -- 172.21.15.154:0/2256399399 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c0117a0 con 0x7f954c0c85c0 2023-10-10T21:21:31.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.542+0000 7f95517ff700 1 -- 172.21.15.154:0/2256399399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 msgr2=0x7f954c06d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.542+0000 7f95517ff700 1 --2- 172.21.15.154:0/2256399399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 0x7f954c06d6c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f953c0098e0 tx=0x7f953c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.543+0000 7f95517ff700 1 -- 172.21.15.154:0/2256399399 shutdown_connections 2023-10-10T21:21:31.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.543+0000 7f95517ff700 1 --2- 172.21.15.154:0/2256399399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 0x7f954c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.543+0000 7f95517ff700 1 --2- 172.21.15.154:0/2256399399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 0x7f954c06d6c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.543+0000 7f95517ff700 1 -- 172.21.15.154:0/2256399399 >> 172.21.15.154:0/2256399399 conn(0x7f954c0cc540 msgr2=0x7f954c0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:31.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.543+0000 7f95517ff700 1 -- 172.21.15.154:0/2256399399 shutdown_connections 2023-10-10T21:21:31.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.543+0000 7f95517ff700 1 -- 172.21.15.154:0/2256399399 wait complete. 2023-10-10T21:21:31.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.544+0000 7f95517ff700 1 Processor -- start 2023-10-10T21:21:31.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.544+0000 7f95517ff700 1 -- start start 2023-10-10T21:21:31.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f95517ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 0x7f954c160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f95517ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 0x7f954c0bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f95517ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c156ee0 0x7f954c0c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f95517ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c17d0 con 0x7f954c156ee0 2023-10-10T21:21:31.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f95517ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c0730 con 0x7f954c0c85c0 2023-10-10T21:21:31.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f95517ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c0a10 con 0x7f954c069890 2023-10-10T21:21:31.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f954b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c156ee0 0x7f954c0c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f954b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c156ee0 0x7f954c0c0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58948/0 (socket says 172.21.15.154:58948) 2023-10-10T21:21:31.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f954b7fe700 1 -- 172.21.15.154:0/3380865731 learned_addr learned my addr 172.21.15.154:0/3380865731 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:31.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.545+0000 7f954a7fc700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 0x7f954c0bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f954affd700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 0x7f954c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f954b7fe700 1 -- 172.21.15.154:0/3380865731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 msgr2=0x7f954c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f954b7fe700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 0x7f954c160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f954b7fe700 1 -- 172.21.15.154:0/3380865731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 msgr2=0x7f954c0bfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f954b7fe700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 0x7f954c0bfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f954b7fe700 1 -- 172.21.15.154:0/3380865731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544009a20 con 0x7f954c156ee0 2023-10-10T21:21:31.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f954a7fc700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 0x7f954c0bfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:31.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f954b7fe700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c156ee0 0x7f954c0c0090 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9544009fc0 tx=0x7f954400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:31.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f9532ffd700 1 -- 172.21.15.154:0/3380865731 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400cd30 con 0x7f954c156ee0 2023-10-10T21:21:31.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f9532ffd700 1 -- 172.21.15.154:0/3380865731 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954400f040 con 0x7f954c156ee0 2023-10-10T21:21:31.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f9532ffd700 1 -- 172.21.15.154:0/3380865731 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440146d0 con 0x7f954c156ee0 2023-10-10T21:21:31.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953c009420 con 0x7f954c156ee0 2023-10-10T21:21:31.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.546+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c0c0fd0 con 0x7f954c156ee0 2023-10-10T21:21:31.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.547+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c0718b0 con 0x7f954c156ee0 2023-10-10T21:21:31.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.548+0000 7f9532ffd700 1 -- 172.21.15.154:0/3380865731 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9544003020 con 0x7f954c156ee0 2023-10-10T21:21:31.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.549+0000 7f9532ffd700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9538066f30 0x7f95380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:31.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.549+0000 7f9532ffd700 1 -- 172.21.15.154:0/3380865731 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f95440851f0 con 0x7f954c156ee0 2023-10-10T21:21:31.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.550+0000 7f954affd700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9538066f30 0x7f95380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:31.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.550+0000 7f954affd700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9538066f30 0x7f95380693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f953c0091e0 tx=0x7f953c016000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:31.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.553+0000 7f9532ffd700 1 -- 172.21.15.154:0/3380865731 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9544052220 con 0x7f954c156ee0 2023-10-10T21:21:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.827+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f954c068d60 con 0x7f954c156ee0 2023-10-10T21:21:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.831+0000 7f9532ffd700 1 -- 172.21.15.154:0/3380865731 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9544055840 con 0x7f954c156ee0 2023-10-10T21:21:31.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9538066f30 msgr2=0x7f95380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9538066f30 0x7f95380693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f953c0091e0 tx=0x7f953c016000 comp rx=0 tx=0).stop 2023-10-10T21:21:31.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c156ee0 msgr2=0x7f954c0c0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:31.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c156ee0 0x7f954c0c0090 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9544009fc0 tx=0x7f954400b040 comp rx=0 tx=0).stop 2023-10-10T21:21:31.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 shutdown_connections 2023-10-10T21:21:31.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9538066f30 0x7f95380693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c156ee0 0x7f954c0c0090 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f954c069890 0x7f954c160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 --2- 172.21.15.154:0/3380865731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f954c0c85c0 0x7f954c0bfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:31.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 >> 172.21.15.154:0/3380865731 conn(0x7f954c0cc540 msgr2=0x7f954c157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:31.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 shutdown_connections 2023-10-10T21:21:31.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:31.834+0000 7f95517ff700 1 -- 172.21.15.154:0/3380865731 wait complete. 2023-10-10T21:21:31.838 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T21:21:31.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T21:21:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.033+0000 7f18721ff700 1 Processor -- start 2023-10-10T21:21:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.033+0000 7f18721ff700 1 -- start start 2023-10-10T21:21:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.034+0000 7f18721ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f186c06bcd0 0x7f186c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.034+0000 7f18721ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c15d7e0 con 0x7f186c15df50 2023-10-10T21:21:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.034+0000 7f18721ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c15dac0 con 0x7f186c06c0a0 2023-10-10T21:21:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.034+0000 7f18721ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c15aa30 con 0x7f186c06bcd0 2023-10-10T21:21:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.035+0000 7f186bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f186c15df50 0x7f186c0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49428/0 (socket says 172.21.15.154:49428) 2023-10-10T21:21:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.035+0000 7f186bfff700 1 -- 172.21.15.154:0/613159177 learned_addr learned my addr 172.21.15.154:0/613159177 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:32.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.035+0000 7f186b7fe700 1 --2- 172.21.15.154:0/613159177 >> v2:172.21.15.154:3300/0 conn(0x7f186c06bcd0 0x7f186c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.035+0000 7f186a7fc700 1 -- 172.21.15.154:0/613159177 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836157950 0 0) 0x7f186c15d7e0 con 0x7f186c15df50 2023-10-10T21:21:32.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.035+0000 7f186b7fe700 1 -- 172.21.15.154:0/613159177 >> v1:172.21.15.179:6789/0 conn(0x7f186c06c0a0 legacy=0x7f186c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.035+0000 7f186b7fe700 1 -- 172.21.15.154:0/613159177 >> v1:172.21.15.154:6789/0 conn(0x7f186c15df50 legacy=0x7f186c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.035+0000 7f186b7fe700 1 -- 172.21.15.154:0/613159177 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c15ad10 con 0x7f186c06bcd0 2023-10-10T21:21:32.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.035+0000 7f186b7fe700 1 --2- 172.21.15.154:0/613159177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c06bcd0 0x7f186c0caa90 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f185c0098e0 tx=0x7f185c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e03439f98b29fe server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.035+0000 7f186a7fc700 1 -- 172.21.15.154:0/613159177 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c009e80 con 0x7f186c06bcd0 2023-10-10T21:21:32.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.036+0000 7f186a7fc700 1 -- 172.21.15.154:0/613159177 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c00b820 con 0x7f186c06bcd0 2023-10-10T21:21:32.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.036+0000 7f186a7fc700 1 -- 172.21.15.154:0/613159177 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c00bba0 con 0x7f186c06bcd0 2023-10-10T21:21:32.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.036+0000 7f18721ff700 1 -- 172.21.15.154:0/613159177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c06bcd0 msgr2=0x7f186c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.036+0000 7f18721ff700 1 --2- 172.21.15.154:0/613159177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c06bcd0 0x7f186c0caa90 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f185c0098e0 tx=0x7f185c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.036+0000 7f18721ff700 1 -- 172.21.15.154:0/613159177 shutdown_connections 2023-10-10T21:21:32.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.036+0000 7f18721ff700 1 --2- 172.21.15.154:0/613159177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c06bcd0 0x7f186c0caa90 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.036+0000 7f18721ff700 1 -- 172.21.15.154:0/613159177 >> 172.21.15.154:0/613159177 conn(0x7f186c0ce600 msgr2=0x7f186c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:32.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.036+0000 7f18721ff700 1 -- 172.21.15.154:0/613159177 shutdown_connections 2023-10-10T21:21:32.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.036+0000 7f18721ff700 1 -- 172.21.15.154:0/613159177 wait complete. 2023-10-10T21:21:32.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.038+0000 7f18721ff700 1 Processor -- start 2023-10-10T21:21:32.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.038+0000 7f18721ff700 1 -- start start 2023-10-10T21:21:32.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.038+0000 7f18721ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f186c06bcd0 0x7f186c156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f18721ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186c06c0a0 0x7f186c155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f18721ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c15df50 0x7f186c0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f18721ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0c8c90 con 0x7f186c15df50 2023-10-10T21:21:32.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f18721ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0c8680 con 0x7f186c06bcd0 2023-10-10T21:21:32.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f18721ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0b32f0 con 0x7f186c06c0a0 2023-10-10T21:21:32.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c15df50 0x7f186c0c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c15df50 0x7f186c0c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58952/0 (socket says 172.21.15.154:58952) 2023-10-10T21:21:32.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186bfff700 1 -- 172.21.15.154:0/439566607 learned_addr learned my addr 172.21.15.154:0/439566607 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:32.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186b7fe700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f186c06bcd0 0x7f186c156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186bfff700 1 -- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186c06c0a0 msgr2=0x7f186c155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186affd700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186c06c0a0 0x7f186c155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186bfff700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186c06c0a0 0x7f186c155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186bfff700 1 -- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f186c06bcd0 msgr2=0x7f186c156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186bfff700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f186c06bcd0 0x7f186c156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186bfff700 1 -- 172.21.15.154:0/439566607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c009420 con 0x7f186c15df50 2023-10-10T21:21:32.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186b7fe700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f186c06bcd0 0x7f186c156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:32.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186affd700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186c06c0a0 0x7f186c155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:32.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.039+0000 7f186bfff700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c15df50 0x7f186c0c5a60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f186400cbf0 tx=0x7f18640019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.040+0000 7f18537fe700 1 -- 172.21.15.154:0/439566607 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400a9c0 con 0x7f186c15df50 2023-10-10T21:21:32.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.040+0000 7f18537fe700 1 -- 172.21.15.154:0/439566607 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400ab20 con 0x7f186c15df50 2023-10-10T21:21:32.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.040+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c0c8920 con 0x7f186c15df50 2023-10-10T21:21:32.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.040+0000 7f18537fe700 1 -- 172.21.15.154:0/439566607 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640070f0 con 0x7f186c15df50 2023-10-10T21:21:32.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.040+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c1568a0 con 0x7f186c15df50 2023-10-10T21:21:32.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.041+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c0c84e0 con 0x7f186c15df50 2023-10-10T21:21:32.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.042+0000 7f18537fe700 1 -- 172.21.15.154:0/439566607 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1864007520 con 0x7f186c15df50 2023-10-10T21:21:32.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.043+0000 7f18537fe700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1858066f30 0x7f18580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.043+0000 7f18537fe700 1 -- 172.21.15.154:0/439566607 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f1864084b50 con 0x7f186c15df50 2023-10-10T21:21:32.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.043+0000 7f186b7fe700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1858066f30 0x7f18580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.044+0000 7f186b7fe700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1858066f30 0x7f18580693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f186c06d6c0 tx=0x7f185c016000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.047+0000 7f18537fe700 1 -- 172.21.15.154:0/439566607 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f186c0c84e0 con 0x7f186c15df50 2023-10-10T21:21:32.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.281+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f186c0c84e0 con 0x7f186c15df50 2023-10-10T21:21:32.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.282+0000 7f18537fe700 1 -- 172.21.15.154:0/439566607 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f186c0c84e0 con 0x7f186c15df50 2023-10-10T21:21:32.283 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:32.284 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/870665959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":870665959},{"type":"v1","addr":"172.21.15.179:6835","nonce":870665959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7723,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/338355165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":338355165},{"type":"v1","addr":"172.21.15.154:6835","nonce":338355165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1799386063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1799386063},{"type":"v1","addr":"172.21.15.179:6834","nonce":1799386063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:21:21.107292+0000","modified":"2023-10-10T21:21:24.662772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/2644092047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2644092047},{"type":"v1","addr":"172.21.15.154:6834","nonce":2644092047}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-10T21:21:32.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1858066f30 msgr2=0x7f18580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1858066f30 0x7f18580693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f186c06d6c0 tx=0x7f185c016000 comp rx=0 tx=0).stop 2023-10-10T21:21:32.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c15df50 msgr2=0x7f186c0c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c15df50 0x7f186c0c5a60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f186400cbf0 tx=0x7f18640019b0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 shutdown_connections 2023-10-10T21:21:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1858066f30 0x7f18580693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f186c15df50 0x7f186c0c5a60 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f186c06bcd0 0x7f186c156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 --2- 172.21.15.154:0/439566607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186c06c0a0 0x7f186c155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 >> 172.21.15.154:0/439566607 conn(0x7f186c0ce600 msgr2=0x7f186c15bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 shutdown_connections 2023-10-10T21:21:32.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.284+0000 7f18721ff700 1 -- 172.21.15.154:0/439566607 wait complete. 2023-10-10T21:21:32.288 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 62 2023-10-10T21:21:32.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T21:21:21.107292+0000', 'modified': '2023-10-10T21:21:24.662772+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8148}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8148': {'gid': 8148, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6834/2644092047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 2644092047}, {'type': 'v1', 'addr': '172.21.15.154:6834', 'nonce': 2644092047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T21:21:32.706 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T21:21:32.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-10T21:21:32.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.891+0000 7f659099d700 1 Processor -- start 2023-10-10T21:21:32.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.891+0000 7f659099d700 1 -- start start 2023-10-10T21:21:32.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.892+0000 7f659099d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f658c156310 0x7f658c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.892+0000 7f659099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c0ae710 0x7f658c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.892+0000 7f659099d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c0ca860 con 0x7f658c1566e0 2023-10-10T21:21:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.892+0000 7f659099d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c0cab40 con 0x7f658c156310 2023-10-10T21:21:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.892+0000 7f659099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0cae20 con 0x7f658c0ae710 2023-10-10T21:21:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.892+0000 7f658affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f658c1566e0 0x7f658c0ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49436/0 (socket says 172.21.15.154:49436) 2023-10-10T21:21:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.892+0000 7f658affd700 1 -- 172.21.15.154:0/38015127 learned_addr learned my addr 172.21.15.154:0/38015127 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658b7fe700 1 --2- 172.21.15.154:0/38015127 >> v2:172.21.15.179:3300/0 conn(0x7f658c156310 0x7f658c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658bfff700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c0ae710 0x7f658c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676666615 0 0) 0x7f658c0ca860 con 0x7f658c1566e0 2023-10-10T21:21:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6574003570 con 0x7f658c1566e0 2023-10-10T21:21:32.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3442305519 0 0) 0x7f6574003570 con 0x7f658c1566e0 2023-10-10T21:21:32.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c0ae710 msgr2=0x7f658c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c0ae710 0x7f658c0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 >> v2:172.21.15.179:3300/0 conn(0x7f658c156310 msgr2=0x7f658c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 --2- 172.21.15.154:0/38015127 >> v2:172.21.15.179:3300/0 conn(0x7f658c156310 0x7f658c0c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0cb100 con 0x7f658c1566e0 2023-10-10T21:21:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f6580001470 con 0x7f658c1566e0 2023-10-10T21:21:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 >> v1:172.21.15.154:6789/0 conn(0x7f658c1566e0 legacy=0x7f658c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c0ae710 0x7f6574003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6574003fe0 0x7f6574004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574004d50 0x7f65740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0cab40 con 0x7f6574003fe0 2023-10-10T21:21:32.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0cae20 con 0x7f6574004d50 2023-10-10T21:21:32.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.893+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657400ba90 con 0x7f658c0ae710 2023-10-10T21:21:32.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658affd700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6574003fe0 0x7f6574004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658b7fe700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c0ae710 0x7f6574003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658bfff700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574004d50 0x7f65740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658affd700 1 -- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c0ae710 msgr2=0x7f6574003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658affd700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c0ae710 0x7f6574003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658affd700 1 -- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574004d50 msgr2=0x7f65740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658affd700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574004d50 0x7f65740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658affd700 1 -- 172.21.15.154:0/38015127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6574003570 con 0x7f6574003fe0 2023-10-10T21:21:32.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658affd700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6574003fe0 0x7f6574004810 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f658000c390 tx=0x7f6580001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796cb6233aa2958f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000cc00 con 0x7f6574003fe0 2023-10-10T21:21:32.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.894+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000cda0 con 0x7f6574003fe0 2023-10-10T21:21:32.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.895+0000 7f658a7fc700 1 -- 172.21.15.154:0/38015127 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580005b70 con 0x7f6574003fe0 2023-10-10T21:21:32.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.895+0000 7f659099d700 1 -- 172.21.15.154:0/38015127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6574003fe0 msgr2=0x7f6574004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.895+0000 7f659099d700 1 --2- 172.21.15.154:0/38015127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6574003fe0 0x7f6574004810 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f658000c390 tx=0x7f6580001e90 comp rx=0 tx=0).stop 2023-10-10T21:21:32.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.895+0000 7f658bfff700 1 -- 172.21.15.154:0/38015127 reap_dead start 2023-10-10T21:21:32.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.895+0000 7f659099d700 1 -- 172.21.15.154:0/38015127 shutdown_connections 2023-10-10T21:21:32.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.895+0000 7f659099d700 1 -- 172.21.15.154:0/38015127 >> 172.21.15.154:0/38015127 conn(0x7f658c0cc1f0 msgr2=0x7f658c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:32.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.895+0000 7f659099d700 1 -- 172.21.15.154:0/38015127 shutdown_connections 2023-10-10T21:21:32.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.895+0000 7f659099d700 1 -- 172.21.15.154:0/38015127 wait complete. 2023-10-10T21:21:32.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.896+0000 7f659099d700 1 Processor -- start 2023-10-10T21:21:32.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.897+0000 7f659099d700 1 -- start start 2023-10-10T21:21:32.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.897+0000 7f659099d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574003fe0 0x7f658c159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.897+0000 7f659099d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c0c0f90 0x7f658c0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f659099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c1458a0 0x7f658c145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f659099d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c146260 con 0x7f658c0c0f90 2023-10-10T21:21:32.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f659099d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c1420 con 0x7f6574003fe0 2023-10-10T21:21:32.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f659099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c1700 con 0x7f658c1458a0 2023-10-10T21:21:32.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c0c0f90 0x7f658c0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c0c0f90 0x7f658c0afc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58958/0 (socket says 172.21.15.154:58958) 2023-10-10T21:21:32.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658affd700 1 -- 172.21.15.154:0/1661957930 learned_addr learned my addr 172.21.15.154:0/1661957930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:32.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658b7fe700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574003fe0 0x7f658c159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658bfff700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c1458a0 0x7f658c145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658affd700 1 -- 172.21.15.154:0/1661957930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c1458a0 msgr2=0x7f658c145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658affd700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c1458a0 0x7f658c145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658affd700 1 -- 172.21.15.154:0/1661957930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574003fe0 msgr2=0x7f658c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658affd700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574003fe0 0x7f658c159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658affd700 1 -- 172.21.15.154:0/1661957930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0c19e0 con 0x7f658c0c0f90 2023-10-10T21:21:32.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658b7fe700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574003fe0 0x7f658c159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:32.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.898+0000 7f658affd700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c0c0f90 0x7f658c0afc30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f6580011000 tx=0x7f6580015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.899+0000 7f65737fe700 1 -- 172.21.15.154:0/1661957930 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000cc00 con 0x7f658c0c0f90 2023-10-10T21:21:32.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.899+0000 7f65737fe700 1 -- 172.21.15.154:0/1661957930 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800072e0 con 0x7f658c0c0f90 2023-10-10T21:21:32.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.899+0000 7f65737fe700 1 -- 172.21.15.154:0/1661957930 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800076a0 con 0x7f658c0c0f90 2023-10-10T21:21:32.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.899+0000 7f659099d700 1 -- 172.21.15.154:0/1661957930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658c0c1cc0 con 0x7f658c0c0f90 2023-10-10T21:21:32.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.899+0000 7f659099d700 1 -- 172.21.15.154:0/1661957930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c15a290 con 0x7f658c0c0f90 2023-10-10T21:21:32.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.902+0000 7f65737fe700 1 -- 172.21.15.154:0/1661957930 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6580019070 con 0x7f658c0c0f90 2023-10-10T21:21:32.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.902+0000 7f65737fe700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6578066f30 0x7f65780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.902+0000 7f65737fe700 1 -- 172.21.15.154:0/1661957930 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f65800855b0 con 0x7f658c0c0f90 2023-10-10T21:21:32.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.903+0000 7f658b7fe700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6578066f30 0x7f65780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.903+0000 7f658b7fe700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6578066f30 0x7f65780693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f657c006f00 tx=0x7f657c008040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.904+0000 7f65a03b2b80 1 Processor -- start 2023-10-10T21:21:32.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.904+0000 7f65a03b2b80 1 -- start start 2023-10-10T21:21:32.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 0x5594ea9817d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea9a2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 0x5594ea957ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ea8aea70 con 0x5594ea9555f0 2023-10-10T21:21:32.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ea8ac270 con 0x5594ea957b80 2023-10-10T21:21:32.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594ea8a8060 con 0x5594ea9a2480 2023-10-10T21:21:32.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f658affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea9a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f658affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea9a2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58966/0 (socket says 172.21.15.154:58966) 2023-10-10T21:21:32.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f658affd700 1 -- 172.21.15.154:0/1075233806 learned_addr learned my addr 172.21.15.154:0/1075233806 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:32.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f658b7fe700 1 --2- 172.21.15.154:0/1075233806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 0x5594ea9817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.905+0000 7f658bfff700 1 --2- 172.21.15.154:0/1075233806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 0x5594ea957ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.906+0000 7f658affd700 1 -- 172.21.15.154:0/1075233806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 msgr2=0x5594ea9817d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.906+0000 7f658affd700 1 --2- 172.21.15.154:0/1075233806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 0x5594ea9817d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.906+0000 7f658affd700 1 -- 172.21.15.154:0/1075233806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 msgr2=0x5594ea957ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.906+0000 7f658affd700 1 --2- 172.21.15.154:0/1075233806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 0x5594ea957ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.906+0000 7f658affd700 1 -- 172.21.15.154:0/1075233806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594ea742270 con 0x5594ea9555f0 2023-10-10T21:21:32.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.906+0000 7f658affd700 1 --2- 172.21.15.154:0/1075233806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea9a2850 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f65800070a0 tx=0x7f65800837f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79726187a2fa8e22 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.906+0000 7f65717fa700 1 -- 172.21.15.154:0/1075233806 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580055c00 con 0x5594ea9555f0 2023-10-10T21:21:32.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.906+0000 7f65717fa700 1 -- 172.21.15.154:0/1075233806 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800569a0 con 0x5594ea9555f0 2023-10-10T21:21:32.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.906+0000 7f65717fa700 1 -- 172.21.15.154:0/1075233806 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800562a0 con 0x5594ea9555f0 2023-10-10T21:21:32.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.907+0000 7f65a03b2b80 1 -- 172.21.15.154:0/1075233806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 msgr2=0x5594ea9a2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.907+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/1075233806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea9a2850 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f65800070a0 tx=0x7f65800837f0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.907+0000 7f65a03b2b80 1 -- 172.21.15.154:0/1075233806 shutdown_connections 2023-10-10T21:21:32.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.907+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/1075233806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 0x5594ea957ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.907+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/1075233806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 0x5594ea9817d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.907+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/1075233806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea9a2850 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.907+0000 7f65a03b2b80 1 -- 172.21.15.154:0/1075233806 >> 172.21.15.154:0/1075233806 conn(0x5594ea9590c0 msgr2=0x5594ea9598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:32.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.907+0000 7f65a03b2b80 1 -- 172.21.15.154:0/1075233806 shutdown_connections 2023-10-10T21:21:32.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.907+0000 7f65a03b2b80 1 -- 172.21.15.154:0/1075233806 wait complete. 2023-10-10T21:21:32.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.908+0000 7f65a03b2b80 1 -- start start 2023-10-10T21:21:32.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.908+0000 7f65a03b2b80 1 Processor -- start 2023-10-10T21:21:32.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea982600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 0x5594ea99e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 0x5594ea9a1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ea853890 con 0x5594ea9555f0 2023-10-10T21:21:32.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ea86eea0 con 0x5594ea957b80 2023-10-10T21:21:32.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594ea72ae30 con 0x5594ea9a2480 2023-10-10T21:21:32.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f65a03b2b80 10 client.0 _ll_register_callbacks cb 0x5594ea91b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:21:32.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea982600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea982600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58982/0 (socket says 172.21.15.154:58982) 2023-10-10T21:21:32.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658b7fe700 1 -- 172.21.15.154:0/2471336825 learned_addr learned my addr 172.21.15.154:0/2471336825 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:32.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658affd700 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 0x5594ea99e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658bfff700 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 0x5594ea9a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658b7fe700 1 -- 172.21.15.154:0/2471336825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 msgr2=0x5594ea9a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658b7fe700 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 0x5594ea9a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658b7fe700 1 -- 172.21.15.154:0/2471336825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 msgr2=0x5594ea99e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658b7fe700 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 0x5594ea99e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.909+0000 7f658b7fe700 1 -- 172.21.15.154:0/2471336825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c15a290 con 0x5594ea9555f0 2023-10-10T21:21:32.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f658b7fe700 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea982600 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f657c014dd0 tx=0x7f657c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8118afe8f32922ab server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f6569ffb700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:21:32.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f6569ffb700 1 -- 172.21.15.154:0/2471336825 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c01c040 con 0x5594ea9555f0 2023-10-10T21:21:32.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f6569ffb700 1 -- 172.21.15.154:0/2471336825 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f657c0159e0 con 0x5594ea9555f0 2023-10-10T21:21:32.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f65a03b2b80 1 -- 172.21.15.154:0/2471336825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594ea94ccd0 con 0x5594ea9555f0 2023-10-10T21:21:32.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f6569ffb700 1 -- 172.21.15.154:0/2471336825 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f657c014c70 con 0x5594ea9555f0 2023-10-10T21:21:32.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f65a03b2b80 10 client.8337 fetch_fsmap learned FSMap version 62 2023-10-10T21:21:32.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f65a03b2b80 1 -- 172.21.15.154:0/2471336825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x5594ea6e4fe0 con 0x5594ea9555f0 2023-10-10T21:21:32.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f6569ffb700 1 -- 172.21.15.154:0/2471336825 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594ea94ccd0 con 0x5594ea9555f0 2023-10-10T21:21:32.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.910+0000 7f6569ffb700 1 -- 172.21.15.154:0/2471336825 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f657c02e440 con 0x5594ea9555f0 2023-10-10T21:21:32.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.911+0000 7f65a03b2b80 10 client.8337 fetch_fsmap finished waiting for FSMap version 62 2023-10-10T21:21:32.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.911+0000 7f65a03b2b80 10 client.8337 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-10T21:21:32.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.911+0000 7f65a03b2b80 20 client.8337 populate_metadata read hostname 'smithi154' 2023-10-10T21:21:32.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.911+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] conn(0x5594ea99ec20 0x5594ea99eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.911+0000 7f65a03b2b80 4 client.8337 mds_command: new command op to 8148 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T21:21:32.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.911+0000 7f65a03b2b80 1 -- 172.21.15.154:0/2471336825 --> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594ea929aa0 con 0x5594ea99ec20 2023-10-10T21:21:32.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.911+0000 7f658affd700 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] conn(0x5594ea99ec20 0x5594ea99eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.912+0000 7f658affd700 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] conn(0x5594ea99ec20 0x5594ea99eff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11434b156ce00813 server_cookie=fc5a6c40b78c62c7 in_seq=0 out_seq=0 2023-10-10T21:21:32.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.912+0000 7f6569ffb700 10 client.8337 ms_handle_connect on v2:172.21.15.154:6832/2644092047 2023-10-10T21:21:32.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.912+0000 7f6569ffb700 1 -- 172.21.15.154:0/2471336825 <== mds.0 v2:172.21.15.154:6832/2644092047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5594ea929aa0 con 0x5594ea99ec20 2023-10-10T21:21:32.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.912+0000 7f6569ffb700 10 client.8337 handle_command_reply: tid=0 2023-10-10T21:21:32.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.912+0000 7f65a03b2b80 1 client.8337 shutdown 2023-10-10T21:21:32.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 -- 172.21.15.154:0/2471336825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 msgr2=0x5594ea982600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea982600 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f657c014dd0 tx=0x7f657c019000 comp rx=0 tx=0).stop 2023-10-10T21:21:32.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 -- 172.21.15.154:0/2471336825 shutdown_connections 2023-10-10T21:21:32.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] conn(0x5594ea99ec20 0x5594ea99eff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea9a2480 0x5594ea9a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea982600 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f6569ffb700 0 client.8337 ms_handle_reset on v2:172.21.15.154:6832/2644092047 2023-10-10T21:21:32.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/2471336825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea957b80 0x5594ea99e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 -- 172.21.15.154:0/2471336825 >> 172.21.15.154:0/2471336825 conn(0x5594ea9590c0 msgr2=0x5594ea957ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:32.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 -- 172.21.15.154:0/2471336825 shutdown_connections 2023-10-10T21:21:32.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 1 -- 172.21.15.154:0/2471336825 wait complete. 2023-10-10T21:21:32.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.913+0000 7f65a03b2b80 20 client.8337 trim_cache size 0 max 16384 2023-10-10T21:21:32.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.930+0000 7f65a03b2b80 1 Processor -- start 2023-10-10T21:21:32.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.930+0000 7f65a03b2b80 1 -- start start 2023-10-10T21:21:32.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.931+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea99eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.931+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea95b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.931+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9a2480 0x5594ea958120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.931+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ea9579f0 con 0x5594ea9555f0 2023-10-10T21:21:32.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.931+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ea956cc0 con 0x5594ea9a2480 2023-10-10T21:21:32.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.931+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594ea9b0680 con 0x5594ea957b80 2023-10-10T21:21:32.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea99eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea99eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58998/0 (socket says 172.21.15.154:58998) 2023-10-10T21:21:32.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658b7fe700 1 -- 172.21.15.154:0/3473207324 learned_addr learned my addr 172.21.15.154:0/3473207324 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:32.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658bfff700 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9a2480 0x5594ea958120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658affd700 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea95b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658b7fe700 1 -- 172.21.15.154:0/3473207324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 msgr2=0x5594ea95b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658b7fe700 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea95b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658b7fe700 1 -- 172.21.15.154:0/3473207324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9a2480 msgr2=0x5594ea958120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658b7fe700 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9a2480 0x5594ea958120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658b7fe700 1 -- 172.21.15.154:0/3473207324 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594ea876780 con 0x5594ea9555f0 2023-10-10T21:21:32.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658affd700 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea95b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:32.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.932+0000 7f658b7fe700 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea99eff0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f657c009e50 tx=0x7f657c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce4b8a8849d5226 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f6571ffb700 1 -- 172.21.15.154:0/3473207324 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c02e9a0 con 0x5594ea9555f0 2023-10-10T21:21:32.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f6571ffb700 1 -- 172.21.15.154:0/3473207324 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c0159e0 con 0x5594ea9555f0 2023-10-10T21:21:32.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f6571ffb700 1 -- 172.21.15.154:0/3473207324 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c02e440 con 0x5594ea9555f0 2023-10-10T21:21:32.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3473207324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 msgr2=0x5594ea99eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea99eff0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f657c009e50 tx=0x7f657c01e000 comp rx=0 tx=0).stop 2023-10-10T21:21:32.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3473207324 shutdown_connections 2023-10-10T21:21:32.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9a2480 0x5594ea958120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9555f0 0x5594ea99eff0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3473207324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea95b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3473207324 >> 172.21.15.154:0/3473207324 conn(0x5594ea9590c0 msgr2=0x5594ea980e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:32.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3473207324 shutdown_connections 2023-10-10T21:21:32.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.933+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3473207324 wait complete. 2023-10-10T21:21:32.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.934+0000 7f65a03b2b80 1 -- start start 2023-10-10T21:21:32.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.934+0000 7f65a03b2b80 1 Processor -- start 2023-10-10T21:21:32.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9555f0 0x5594ea9fdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea980e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f65a03b2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9a2480 0x5594ea9813d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ea97c100 con 0x5594ea9a2480 2023-10-10T21:21:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ea9a1920 con 0x5594ea9555f0 2023-10-10T21:21:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f65a03b2b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594eaa039e0 con 0x5594ea957b80 2023-10-10T21:21:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f65a03b2b80 10 client.0 _ll_register_callbacks cb 0x5594ea91b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T21:21:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f658bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9a2480 0x5594ea9813d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f658bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9a2480 0x5594ea9813d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59002/0 (socket says 172.21.15.154:59002) 2023-10-10T21:21:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.935+0000 7f658bfff700 1 -- 172.21.15.154:0/3891094153 learned_addr learned my addr 172.21.15.154:0/3891094153 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658b7fe700 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9555f0 0x5594ea9fdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658affd700 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea980e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658bfff700 1 -- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 msgr2=0x5594ea980e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658bfff700 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea980e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658bfff700 1 -- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9555f0 msgr2=0x5594ea9fdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658bfff700 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9555f0 0x5594ea9fdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658bfff700 1 -- 172.21.15.154:0/3891094153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594ea6e4fe0 con 0x5594ea9a2480 2023-10-10T21:21:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658b7fe700 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9555f0 0x5594ea9fdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658affd700 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea980e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:32.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f658bfff700 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9a2480 0x5594ea9813d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f658c0aeb10 tx=0x7f658400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f838b357442d6e8b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f6569ffb700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T21:21:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f6569ffb700 1 -- 172.21.15.154:0/3891094153 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658401d070 con 0x5594ea9a2480 2023-10-10T21:21:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f6569ffb700 1 -- 172.21.15.154:0/3891094153 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f6584016e00 con 0x5594ea9a2480 2023-10-10T21:21:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3891094153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f658c1584f0 con 0x5594ea9a2480 2023-10-10T21:21:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f6569ffb700 1 -- 172.21.15.154:0/3891094153 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f658400e040 con 0x5594ea9a2480 2023-10-10T21:21:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f65a03b2b80 10 client.8343 fetch_fsmap learned FSMap version 62 2023-10-10T21:21:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.936+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3891094153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x5594ea85d470 con 0x5594ea9a2480 2023-10-10T21:21:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.937+0000 7f6569ffb700 1 -- 172.21.15.154:0/3891094153 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c1584f0 con 0x5594ea9a2480 2023-10-10T21:21:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.937+0000 7f6569ffb700 1 -- 172.21.15.154:0/3891094153 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6584018240 con 0x5594ea9a2480 2023-10-10T21:21:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.937+0000 7f65a03b2b80 10 client.8343 fetch_fsmap finished waiting for FSMap version 62 2023-10-10T21:21:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.937+0000 7f65a03b2b80 10 client.8343 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-10T21:21:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.937+0000 7f65a03b2b80 20 client.8343 populate_metadata read hostname 'smithi154' 2023-10-10T21:21:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.937+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] conn(0x5594ea954350 0x5594ea954720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.937+0000 7f65a03b2b80 4 client.8343 mds_command: new command op to 8148 tid=0[{"prefix": "status"}] 2023-10-10T21:21:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.937+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3891094153 --> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f65800569a0 con 0x5594ea954350 2023-10-10T21:21:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.937+0000 7f658b7fe700 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] conn(0x5594ea954350 0x5594ea954720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f658b7fe700 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] conn(0x5594ea954350 0x5594ea954720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee783978742d0d14 server_cookie=be7894ff431ca0ec in_seq=0 out_seq=0 2023-10-10T21:21:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f6569ffb700 10 client.8343 ms_handle_connect on v2:172.21.15.154:6832/2644092047 2023-10-10T21:21:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f6569ffb700 1 -- 172.21.15.154:0/3891094153 <== mds.0 v2:172.21.15.154:6832/2644092047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f65800569a0 con 0x5594ea954350 2023-10-10T21:21:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f6569ffb700 10 client.8343 handle_command_reply: tid=0 2023-10-10T21:21:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 client.8343 shutdown 2023-10-10T21:21:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3891094153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9a2480 msgr2=0x5594ea9813d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9a2480 0x5594ea9813d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f658c0aeb10 tx=0x7f658400b040 comp rx=0 tx=0).stop 2023-10-10T21:21:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3891094153 shutdown_connections 2023-10-10T21:21:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.154:6832/2644092047,v1:172.21.15.154:6834/2644092047] conn(0x5594ea954350 0x5594ea954720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594ea9a2480 0x5594ea9813d0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594ea9555f0 0x5594ea9fdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f6569ffb700 0 client.8343 ms_handle_reset on v2:172.21.15.154:6832/2644092047 2023-10-10T21:21:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 --2- 172.21.15.154:0/3891094153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5594ea957b80 0x5594ea980e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3891094153 >> 172.21.15.154:0/3891094153 conn(0x5594ea9590c0 msgr2=0x5594ea97b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3891094153 shutdown_connections 2023-10-10T21:21:32.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 1 -- 172.21.15.154:0/3891094153 wait complete. 2023-10-10T21:21:32.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.938+0000 7f65a03b2b80 20 client.8343 trim_cache size 0 max 16384 2023-10-10T21:21:32.958 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T21:21:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T21:21:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T21:21:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 8148, 2023-10-10T21:21:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T21:21:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T21:21:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T21:21:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.288024987, 2023-10-10T21:21:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 62, 2023-10-10T21:21:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 139, 2023-10-10T21:21:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 139, 2023-10-10T21:21:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.061019400999999 2023-10-10T21:21:32.961 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T21:21:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 -- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6578066f30 msgr2=0x7f65780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6578066f30 0x7f65780693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f657c006f00 tx=0x7f657c008040 comp rx=0 tx=0).stop 2023-10-10T21:21:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 -- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c0c0f90 msgr2=0x7f658c0afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c0c0f90 0x7f658c0afc30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f6580011000 tx=0x7f6580015000 comp rx=0 tx=0).stop 2023-10-10T21:21:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 -- 172.21.15.154:0/1661957930 shutdown_connections 2023-10-10T21:21:32.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f658c1458a0 0x7f658c145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6574003fe0 0x7f658c159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6578066f30 0x7f65780693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 --2- 172.21.15.154:0/1661957930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c0c0f90 0x7f658c0afc30 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:32.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 -- 172.21.15.154:0/1661957930 >> 172.21.15.154:0/1661957930 conn(0x7f658c0cc1f0 msgr2=0x7f658c0b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:32.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 -- 172.21.15.154:0/1661957930 shutdown_connections 2023-10-10T21:21:32.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:32.939+0000 7f659099d700 1 -- 172.21.15.154:0/1661957930 wait complete. 2023-10-10T21:21:32.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T21:21:33.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.147+0000 7fb0b6bff700 1 Processor -- start 2023-10-10T21:21:33.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.147+0000 7fb0b6bff700 1 -- start start 2023-10-10T21:21:33.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.148+0000 7fb0b6bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0b0155c10 0x7fb0b0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:33.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.148+0000 7fb0b6bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0b00ac230 0x7fb0b00ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:33.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.148+0000 7fb0b6bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 0x7fb0b0156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:33.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.148+0000 7fb0b6bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00ad930 con 0x7fb0b00ac230 2023-10-10T21:21:33.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.148+0000 7fb0b6bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00acd20 con 0x7fb0b0155c10 2023-10-10T21:21:33.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.148+0000 7fb0b6bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00ad000 con 0x7fb0b01568a0 2023-10-10T21:21:33.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0affff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0b00ac230 0x7fb0b00ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:33.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0affff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0b00ac230 0x7fb0b00ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59016/0 (socket says 172.21.15.154:59016) 2023-10-10T21:21:33.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0affff700 1 -- 172.21.15.154:0/351235667 learned_addr learned my addr 172.21.15.154:0/351235667 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:33.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0b499b700 1 --2- 172.21.15.154:0/351235667 >> v2:172.21.15.179:3300/0 conn(0x7fb0b0155c10 0x7fb0b0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0b519c700 1 --2- 172.21.15.154:0/351235667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 0x7fb0b0156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0affff700 1 -- 172.21.15.154:0/351235667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 msgr2=0x7fb0b0156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0affff700 1 --2- 172.21.15.154:0/351235667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 0x7fb0b0156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0affff700 1 -- 172.21.15.154:0/351235667 >> v2:172.21.15.179:3300/0 conn(0x7fb0b0155c10 msgr2=0x7fb0b0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0affff700 1 --2- 172.21.15.154:0/351235667 >> v2:172.21.15.179:3300/0 conn(0x7fb0b0155c10 0x7fb0b0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0affff700 1 -- 172.21.15.154:0/351235667 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00ad2e0 con 0x7fb0b00ac230 2023-10-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0b519c700 1 --2- 172.21.15.154:0/351235667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 0x7fb0b0156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0b499b700 1 --2- 172.21.15.154:0/351235667 >> v2:172.21.15.179:3300/0 conn(0x7fb0b0155c10 0x7fb0b0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.149+0000 7fb0affff700 1 --2- 172.21.15.154:0/351235667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b00ac230 0x7fb0b00ac6d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0063d40 tx=0x7fb09c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0460ccead0567b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:33.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.152+0000 7fb0af7fe700 1 -- 172.21.15.154:0/351235667 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00b860 con 0x7fb0b00ac230 2023-10-10T21:21:33.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.152+0000 7fb0af7fe700 1 -- 172.21.15.154:0/351235667 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00b9c0 con 0x7fb0b00ac230 2023-10-10T21:21:33.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.152+0000 7fb0af7fe700 1 -- 172.21.15.154:0/351235667 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00bd60 con 0x7fb0b00ac230 2023-10-10T21:21:33.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.153+0000 7fb0b6bff700 1 -- 172.21.15.154:0/351235667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b00ac230 msgr2=0x7fb0b00ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.153+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/351235667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b00ac230 0x7fb0b00ac6d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0063d40 tx=0x7fb09c009250 comp rx=0 tx=0).stop 2023-10-10T21:21:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.153+0000 7fb0b6bff700 1 -- 172.21.15.154:0/351235667 shutdown_connections 2023-10-10T21:21:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.153+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/351235667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 0x7fb0b0156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.153+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/351235667 >> v2:172.21.15.179:3300/0 conn(0x7fb0b0155c10 0x7fb0b0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.153+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/351235667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b00ac230 0x7fb0b00ac6d0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.153+0000 7fb0b6bff700 1 -- 172.21.15.154:0/351235667 >> 172.21.15.154:0/351235667 conn(0x7fb0b006a320 msgr2=0x7fb0b00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.153+0000 7fb0b6bff700 1 -- 172.21.15.154:0/351235667 shutdown_connections 2023-10-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.153+0000 7fb0b6bff700 1 -- 172.21.15.154:0/351235667 wait complete. 2023-10-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.154+0000 7fb0b6bff700 1 Processor -- start 2023-10-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.154+0000 7fb0b6bff700 1 -- start start 2023-10-10T21:21:33.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.155+0000 7fb0b6bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b00ac230 0x7fb0b014a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:33.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.155+0000 7fb0b6bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b0155c10 0x7fb0b014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.155+0000 7fb0b6bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 0x7fb0b00a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.155+0000 7fb0b6bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00a6490 con 0x7fb0b0155c10 2023-10-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.155+0000 7fb0b6bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b014ac00 con 0x7fb0b00ac230 2023-10-10T21:21:33.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.155+0000 7fb0b6bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00a5880 con 0x7fb0b01568a0 2023-10-10T21:21:33.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0affff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b0155c10 0x7fb0b014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:33.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0affff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b0155c10 0x7fb0b014ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59024/0 (socket says 172.21.15.154:59024) 2023-10-10T21:21:33.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0affff700 1 -- 172.21.15.154:0/3284510288 learned_addr learned my addr 172.21.15.154:0/3284510288 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:33.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0b499b700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b00ac230 0x7fb0b014a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:33.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0b519c700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 0x7fb0b00a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:33.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0affff700 1 -- 172.21.15.154:0/3284510288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 msgr2=0x7fb0b00a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:33.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0affff700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 0x7fb0b00a8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0affff700 1 -- 172.21.15.154:0/3284510288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b00ac230 msgr2=0x7fb0b014a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:33.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0affff700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b00ac230 0x7fb0b014a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0affff700 1 -- 172.21.15.154:0/3284510288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0094f0 con 0x7fb0b0155c10 2023-10-10T21:21:33.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.156+0000 7fb0affff700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b0155c10 0x7fb0b014ce40 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009290 tx=0x7fb09c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:33.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.157+0000 7fb0acff9700 1 -- 172.21.15.154:0/3284510288 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c011e40 con 0x7fb0b0155c10 2023-10-10T21:21:33.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.157+0000 7fb0acff9700 1 -- 172.21.15.154:0/3284510288 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c01f070 con 0x7fb0b0155c10 2023-10-10T21:21:33.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.157+0000 7fb0acff9700 1 -- 172.21.15.154:0/3284510288 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0266d0 con 0x7fb0b0155c10 2023-10-10T21:21:33.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.157+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b00a5b60 con 0x7fb0b0155c10 2023-10-10T21:21:33.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.157+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b00a6120 con 0x7fb0b0155c10 2023-10-10T21:21:33.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.158+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b004c3c0 con 0x7fb0b0155c10 2023-10-10T21:21:33.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.158+0000 7fb0acff9700 1 -- 172.21.15.154:0/3284510288 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb09c026a40 con 0x7fb0b0155c10 2023-10-10T21:21:33.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.159+0000 7fb0acff9700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb094066f30 0x7fb0940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:33.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.159+0000 7fb0acff9700 1 -- 172.21.15.154:0/3284510288 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fb09c021070 con 0x7fb0b0155c10 2023-10-10T21:21:33.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.160+0000 7fb0b499b700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb094066f30 0x7fb0940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:33.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.160+0000 7fb0b499b700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb094066f30 0x7fb0940693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4006f00 tx=0x7fb0a4008040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:33.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.164+0000 7fb0acff9700 1 -- 172.21.15.154:0/3284510288 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb09c053470 con 0x7fb0b0155c10 2023-10-10T21:21:33.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.396+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0b00a65d0 con 0x7fb0b0155c10 2023-10-10T21:21:33.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.396+0000 7fb0acff9700 1 -- 172.21.15.154:0/3284510288 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb09c056a90 con 0x7fb0b0155c10 2023-10-10T21:21:33.398 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T21:21:33.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.398+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb094066f30 msgr2=0x7fb0940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:33.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.398+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb094066f30 0x7fb0940693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4006f00 tx=0x7fb0a4008040 comp rx=0 tx=0).stop 2023-10-10T21:21:33.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.398+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b0155c10 msgr2=0x7fb0b014ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:33.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.398+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b0155c10 0x7fb0b014ce40 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009290 tx=0x7fb09c017000 comp rx=0 tx=0).stop 2023-10-10T21:21:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.399+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 shutdown_connections 2023-10-10T21:21:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.399+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b01568a0 0x7fb0b00a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.399+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b00ac230 0x7fb0b014a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.399+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb094066f30 0x7fb0940693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.399+0000 7fb0b6bff700 1 --2- 172.21.15.154:0/3284510288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0b0155c10 0x7fb0b014ce40 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:33.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.399+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 >> 172.21.15.154:0/3284510288 conn(0x7fb0b006a320 msgr2=0x7fb0b006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:33.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.399+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 shutdown_connections 2023-10-10T21:21:33.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:33.399+0000 7fb0b6bff700 1 -- 172.21.15.154:0/3284510288 wait complete. 2023-10-10T21:21:33.418 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T21:21:33.418 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T21:21:33.418 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T21:21:33.419 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T21:21:33.419 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T21:21:33.419 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T21:21:33.420 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T21:21:33.420 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T21:21:33.420 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:21:33.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:21:33.421 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T21:21:33.459 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T21:21:33.460 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T21:21:33.460 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T21:21:33.460 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:21:33.460 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T21:21:33.461 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:21:33.461 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:21:33.461 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:21:33.461 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T21:21:33.462 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:21:33.462 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:21:33.462 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T21:21:33.462 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T21:21:33.463 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:21:33.463 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T21:21:33.463 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:21:33.463 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T21:21:33.463 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 41120sec preferred_lft 41120sec 2023-10-10T21:21:33.464 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T21:21:33.464 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:21:33.464 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T21:21:33.464 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T21:21:33.464 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T21:21:33.465 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:21:33.465 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T21:21:33.465 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:21:33.465 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:21:33.466 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T21:21:33.466 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T21:21:33.466 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:21:33.466 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T21:21:33.467 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T21:21:33.467 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T21:21:33.467 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T21:21:33.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:21:33.468 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T21:21:33.559 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T21:21:33.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:21:33.563 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T21:21:33.601 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T21:21:33.602 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T21:21:33.602 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T21:21:33.602 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T21:21:33.602 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T21:21:33.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:21:33.604 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T21:21:33.604 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T21:21:33.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T21:21:33.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T21:21:33.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T21:21:33.606 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T21:21:33.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:21:33.801 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T21:21:33.838 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T21:21:33.838 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T21:21:33.838 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:21:33.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:21:33.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T21:21:33.940 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:21:33.940 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T21:21:33.977 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T21:21:33.978 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T21:21:33.979 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:21:34.054 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T21:21:34.054 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T21:21:34.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:21:34.186 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:21:34.186 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:21:34.186 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:21:34.202 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:21:34.203 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:21:34.203 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:21:34.203 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:21:34.203 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:21:34.222 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T21:21:34.222 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T21:21:34.223 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T21:21:34.223 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T21:21:34.223 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T21:21:34.223 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T21:21:34.224 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T21:21:34.224 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T21:21:34.227 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T21:21:34.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T21:21:34.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T21:21:34.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T21:21:34.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.473+0000 7f78aa1ff700 1 Processor -- start 2023-10-10T21:21:34.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.473+0000 7f78aa1ff700 1 -- start start 2023-10-10T21:21:34.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.474+0000 7f78aa1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78a4155c10 0x7f78a4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78aa1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40acac0 con 0x7f78a40ac230 2023-10-10T21:21:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78aa1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40ad930 con 0x7f78a40ac6d0 2023-10-10T21:21:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78aa1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40acd20 con 0x7f78a4155c10 2023-10-10T21:21:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78a37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78a4155c10 0x7f78a4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78a37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78a4155c10 0x7f78a4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59040/0 (socket says 172.21.15.154:59040) 2023-10-10T21:21:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78a37fe700 1 -- 172.21.15.154:0/907042863 learned_addr learned my addr 172.21.15.154:0/907042863 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78a2ffd700 1 --1- 172.21.15.154:0/907042863 >> v1:172.21.15.154:6789/0 conn(0x7f78a40ac230 0x7f78a41568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49442/0 (socket says 172.21.15.154:49442) 2023-10-10T21:21:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78a37fe700 1 -- 172.21.15.154:0/907042863 >> v1:172.21.15.179:6789/0 conn(0x7f78a40ac6d0 legacy=0x7f78a40b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78a37fe700 1 -- 172.21.15.154:0/907042863 >> v1:172.21.15.154:6789/0 conn(0x7f78a40ac230 legacy=0x7f78a41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78a37fe700 1 -- 172.21.15.154:0/907042863 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40ad000 con 0x7f78a4155c10 2023-10-10T21:21:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.475+0000 7f78a37fe700 1 --2- 172.21.15.154:0/907042863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 0x7f78a4155fe0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f78940099b0 tx=0x7f7894009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d3856d3a6e0aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78a27fc700 1 -- 172.21.15.154:0/907042863 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789400b820 con 0x7f78a4155c10 2023-10-10T21:21:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78a27fc700 1 -- 172.21.15.154:0/907042863 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789400b980 con 0x7f78a4155c10 2023-10-10T21:21:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78a27fc700 1 -- 172.21.15.154:0/907042863 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789400bd20 con 0x7f78a4155c10 2023-10-10T21:21:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78aa1ff700 1 -- 172.21.15.154:0/907042863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 msgr2=0x7f78a4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78aa1ff700 1 --2- 172.21.15.154:0/907042863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 0x7f78a4155fe0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f78940099b0 tx=0x7f7894009250 comp rx=0 tx=0).stop 2023-10-10T21:21:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78aa1ff700 1 -- 172.21.15.154:0/907042863 shutdown_connections 2023-10-10T21:21:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78aa1ff700 1 --2- 172.21.15.154:0/907042863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 0x7f78a4155fe0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78aa1ff700 1 -- 172.21.15.154:0/907042863 >> 172.21.15.154:0/907042863 conn(0x7f78a406a320 msgr2=0x7f78a40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78aa1ff700 1 -- 172.21.15.154:0/907042863 shutdown_connections 2023-10-10T21:21:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.476+0000 7f78aa1ff700 1 -- 172.21.15.154:0/907042863 wait complete. 2023-10-10T21:21:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.478+0000 7f78aa1ff700 1 Processor -- start 2023-10-10T21:21:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.478+0000 7f78aa1ff700 1 -- start start 2023-10-10T21:21:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78aa1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a40ac230 0x7f78a40c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78aa1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a40ac6d0 0x7f78a40c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78aa1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 0x7f78a416b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78aa1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40c4070 con 0x7f78a4155c10 2023-10-10T21:21:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78aa1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40c2550 con 0x7f78a40ac6d0 2023-10-10T21:21:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78aa1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40c1940 con 0x7f78a40ac230 2023-10-10T21:21:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78a3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 0x7f78a416b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78a3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 0x7f78a416b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59042/0 (socket says 172.21.15.154:59042) 2023-10-10T21:21:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78a3fff700 1 -- 172.21.15.154:0/495230647 learned_addr learned my addr 172.21.15.154:0/495230647 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.479+0000 7f78a2ffd700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a40ac6d0 0x7f78a40c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f78a3fff700 1 -- 172.21.15.154:0/495230647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a40ac230 msgr2=0x7f78a40c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f78a3fff700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a40ac230 0x7f78a40c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f78a3fff700 1 -- 172.21.15.154:0/495230647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a40ac6d0 msgr2=0x7f78a40c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f78a3fff700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a40ac6d0 0x7f78a40c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f78a3fff700 1 -- 172.21.15.154:0/495230647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940094f0 con 0x7f78a4155c10 2023-10-10T21:21:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f78a2ffd700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a40ac6d0 0x7f78a40c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T21:21:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f78a3fff700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 0x7f78a416b440 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c930 tx=0x7f789c0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f788b7fe700 1 -- 172.21.15.154:0/495230647 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00ce70 con 0x7f78a4155c10 2023-10-10T21:21:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f788b7fe700 1 -- 172.21.15.154:0/495230647 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00a7e0 con 0x7f78a4155c10 2023-10-10T21:21:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f788b7fe700 1 -- 172.21.15.154:0/495230647 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00aba0 con 0x7f78a4155c10 2023-10-10T21:21:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a40c1c20 con 0x7f78a4155c10 2023-10-10T21:21:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.480+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a40c21e0 con 0x7f78a4155c10 2023-10-10T21:21:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.481+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a404c3c0 con 0x7f78a4155c10 2023-10-10T21:21:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.482+0000 7f788b7fe700 1 -- 172.21.15.154:0/495230647 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f789c012420 con 0x7f78a4155c10 2023-10-10T21:21:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.483+0000 7f788b7fe700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7890066f30 0x7f78900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.483+0000 7f788b7fe700 1 -- 172.21.15.154:0/495230647 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f789c084bb0 con 0x7f78a4155c10 2023-10-10T21:21:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.483+0000 7f78a37fe700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7890066f30 0x7f78900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.484+0000 7f78a37fe700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7890066f30 0x7f78900693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f78940099b0 tx=0x7f7894016000 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.487+0000 7f788b7fe700 1 -- 172.21.15.154:0/495230647 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f789c051c90 con 0x7f78a4155c10 2023-10-10T21:21:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.705+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f78a40ad2e0 con 0x7f7890066f30 2023-10-10T21:21:34.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.707+0000 7f788b7fe700 1 -- 172.21.15.154:0/495230647 <== mgr.7968 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f78a40ad2e0 con 0x7f7890066f30 2023-10-10T21:21:34.708 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T21:21:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T21:21:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T21:21:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T21:21:34.709 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T21:21:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7890066f30 msgr2=0x7f78900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7890066f30 0x7f78900693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f78940099b0 tx=0x7f7894016000 comp rx=0 tx=0).stop 2023-10-10T21:21:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 msgr2=0x7f78a416b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 0x7f78a416b440 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c930 tx=0x7f789c0026e0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 shutdown_connections 2023-10-10T21:21:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7890066f30 0x7f78900693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a4155c10 0x7f78a416b440 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78a40ac230 0x7f78a40c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 --2- 172.21.15.154:0/495230647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78a40ac6d0 0x7f78a40c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 >> 172.21.15.154:0/495230647 conn(0x7f78a406a320 msgr2=0x7f78a40c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.709+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 shutdown_connections 2023-10-10T21:21:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.710+0000 7f78aa1ff700 1 -- 172.21.15.154:0/495230647 wait complete. 2023-10-10T21:21:34.728 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T21:21:34.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.913+0000 7f150bfff700 1 Processor -- start 2023-10-10T21:21:34.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.913+0000 7f150bfff700 1 -- start start 2023-10-10T21:21:34.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.914+0000 7f150bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f150c0b1b40 0x7f150c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.914+0000 7f150bfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c0cfb00 con 0x7f150c0b16d0 2023-10-10T21:21:34.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.914+0000 7f150bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c0b5c40 con 0x7f150c0b4e70 2023-10-10T21:21:34.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.914+0000 7f150bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150c0b5f20 con 0x7f150c0b1b40 2023-10-10T21:21:34.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.914+0000 7f150a7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f150c0b16d0 0x7f150c0b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49450/0 (socket says 172.21.15.154:49450) 2023-10-10T21:21:34.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.914+0000 7f150a7fc700 1 -- 172.21.15.154:0/1362402578 learned_addr learned my addr 172.21.15.154:0/1362402578 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:34.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.915+0000 7f150b7fe700 1 --2- 172.21.15.154:0/1362402578 >> v2:172.21.15.179:3300/0 conn(0x7f150c0b1b40 0x7f150c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:34.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.915+0000 7f1509ffb700 1 -- 172.21.15.154:0/1362402578 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111219651 0 0) 0x7f150c0cfb00 con 0x7f150c0b16d0 2023-10-10T21:21:34.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.915+0000 7f1509ffb700 1 -- 172.21.15.154:0/1362402578 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14f4003570 con 0x7f150c0b16d0 2023-10-10T21:21:34.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.915+0000 7f150b7fe700 1 -- 172.21.15.154:0/1362402578 >> v1:172.21.15.179:6789/0 conn(0x7f150c0b4e70 legacy=0x7f150c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.915+0000 7f150b7fe700 1 -- 172.21.15.154:0/1362402578 >> v1:172.21.15.154:6789/0 conn(0x7f150c0b16d0 legacy=0x7f150c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.915+0000 7f150b7fe700 1 -- 172.21.15.154:0/1362402578 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0b6200 con 0x7f150c0b1b40 2023-10-10T21:21:34.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.915+0000 7f150b7fe700 1 --2- 172.21.15.154:0/1362402578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f150c0b1b40 0x7f150c0b3ac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1504009e60 tx=0x7f1504009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa81c08faf38241 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:34.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f1509ffb700 1 -- 172.21.15.154:0/1362402578 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400e070 con 0x7f150c0b1b40 2023-10-10T21:21:34.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f1509ffb700 1 -- 172.21.15.154:0/1362402578 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150400bb60 con 0x7f150c0b1b40 2023-10-10T21:21:34.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f1509ffb700 1 -- 172.21.15.154:0/1362402578 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504012430 con 0x7f150c0b1b40 2023-10-10T21:21:34.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f150bfff700 1 -- 172.21.15.154:0/1362402578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f150c0b1b40 msgr2=0x7f150c0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f150bfff700 1 --2- 172.21.15.154:0/1362402578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f150c0b1b40 0x7f150c0b3ac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1504009e60 tx=0x7f1504009780 comp rx=0 tx=0).stop 2023-10-10T21:21:34.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f150bfff700 1 -- 172.21.15.154:0/1362402578 shutdown_connections 2023-10-10T21:21:34.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f150bfff700 1 --2- 172.21.15.154:0/1362402578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f150c0b1b40 0x7f150c0b3ac0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f150bfff700 1 -- 172.21.15.154:0/1362402578 >> 172.21.15.154:0/1362402578 conn(0x7f150c0d10c0 msgr2=0x7f150c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:34.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f150bfff700 1 -- 172.21.15.154:0/1362402578 shutdown_connections 2023-10-10T21:21:34.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.916+0000 7f150bfff700 1 -- 172.21.15.154:0/1362402578 wait complete. 2023-10-10T21:21:34.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.918+0000 7f150bfff700 1 Processor -- start 2023-10-10T21:21:34.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.918+0000 7f150bfff700 1 -- start start 2023-10-10T21:21:34.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f150c0b16d0 0x7f150c0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150c0b1b40 0x7f150c169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f150c0b4e70 0x7f150c0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0c9870 con 0x7f150c0b1b40 2023-10-10T21:21:34.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c16b050 con 0x7f150c0b16d0 2023-10-10T21:21:34.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c16a3d0 con 0x7f150c0b4e70 2023-10-10T21:21:34.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150a7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150c0b1b40 0x7f150c169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:34.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150a7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150c0b1b40 0x7f150c169d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59044/0 (socket says 172.21.15.154:59044) 2023-10-10T21:21:34.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150a7fc700 1 -- 172.21.15.154:0/758020209 learned_addr learned my addr 172.21.15.154:0/758020209 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:34.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150affd700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f150c0b16d0 0x7f150c0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:34.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150b7fe700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f150c0b4e70 0x7f150c0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:34.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150a7fc700 1 -- 172.21.15.154:0/758020209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f150c0b4e70 msgr2=0x7f150c0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150a7fc700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f150c0b4e70 0x7f150c0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150a7fc700 1 -- 172.21.15.154:0/758020209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f150c0b16d0 msgr2=0x7f150c0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:34.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150a7fc700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f150c0b16d0 0x7f150c0cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:34.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150a7fc700 1 -- 172.21.15.154:0/758020209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504009a20 con 0x7f150c0b1b40 2023-10-10T21:21:34.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.919+0000 7f150b7fe700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f150c0b4e70 0x7f150c0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T21:21:34.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.920+0000 7f150a7fc700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150c0b1b40 0x7f150c169d90 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f150000c7c0 tx=0x7f1500007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:34.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.920+0000 7f14f2ffd700 1 -- 172.21.15.154:0/758020209 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500005b30 con 0x7f150c0b1b40 2023-10-10T21:21:34.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.920+0000 7f14f2ffd700 1 -- 172.21.15.154:0/758020209 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1500005cb0 con 0x7f150c0b1b40 2023-10-10T21:21:34.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.920+0000 7f14f2ffd700 1 -- 172.21.15.154:0/758020209 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500007320 con 0x7f150c0b1b40 2023-10-10T21:21:34.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.920+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c16a6b0 con 0x7f150c0b1b40 2023-10-10T21:21:34.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.920+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c16ac70 con 0x7f150c0b1b40 2023-10-10T21:21:34.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.921+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c16b1c0 con 0x7f150c0b1b40 2023-10-10T21:21:34.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.922+0000 7f14f2ffd700 1 -- 172.21.15.154:0/758020209 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 62) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1500007690 con 0x7f150c0b1b40 2023-10-10T21:21:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.923+0000 7f14f2ffd700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14f8066f30 0x7f14f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.923+0000 7f14f2ffd700 1 -- 172.21.15.154:0/758020209 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f1500083c20 con 0x7f150c0b1b40 2023-10-10T21:21:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.923+0000 7f150affd700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14f8066f30 0x7f14f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.924+0000 7f150affd700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14f8066f30 0x7f14f80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f150c15ed20 tx=0x7f14fc009040 comp rx=0 tx=0).ready entity=mgr.7968 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:34.927+0000 7f14f2ffd700 1 -- 172.21.15.154:0/758020209 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1500050c50 con 0x7f150c0b1b40 2023-10-10T21:21:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:35.171+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f150c04bb80 con 0x7f150c0b1b40 2023-10-10T21:21:36.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.169+0000 7f14f2ffd700 1 -- 172.21.15.154:0/758020209 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 63) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f1500051020 con 0x7f150c0b1b40 2023-10-10T21:21:36.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.171+0000 7f14f2ffd700 1 -- 172.21.15.154:0/758020209 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v63) v1 ==== 92+0+0 (secure 0 0 0) 0x7f1500054450 con 0x7f150c0b1b40 2023-10-10T21:21:36.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14f8066f30 msgr2=0x7f14f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14f8066f30 0x7f14f80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f150c15ed20 tx=0x7f14fc009040 comp rx=0 tx=0).stop 2023-10-10T21:21:36.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150c0b1b40 msgr2=0x7f150c169d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150c0b1b40 0x7f150c169d90 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f150000c7c0 tx=0x7f1500007e00 comp rx=0 tx=0).stop 2023-10-10T21:21:36.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 shutdown_connections 2023-10-10T21:21:36.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f150c0b4e70 0x7f150c0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f150c0b16d0 0x7f150c0cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f14f8066f30 0x7f14f80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 --2- 172.21.15.154:0/758020209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150c0b1b40 0x7f150c169d90 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 >> 172.21.15.154:0/758020209 conn(0x7f150c0d10c0 msgr2=0x7f150c069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:36.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 shutdown_connections 2023-10-10T21:21:36.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.174+0000 7f150bfff700 1 -- 172.21.15.154:0/758020209 wait complete. 2023-10-10T21:21:36.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T21:21:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.398+0000 7f01d199d700 1 Processor -- start 2023-10-10T21:21:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.398+0000 7f01d199d700 1 -- start start 2023-10-10T21:21:36.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01d199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b16d0 0x7f01cc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01d199d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01cc0b33b0 0x7f01cc0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01d199d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc0b2080 con 0x7f01cc0b4e70 2023-10-10T21:21:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01d199d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc0cfb00 con 0x7f01cc0b33b0 2023-10-10T21:21:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01d199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0b5c40 con 0x7f01cc0b16d0 2023-10-10T21:21:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01d119c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01cc0b33b0 0x7f01cc0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01d119c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01cc0b33b0 0x7f01cc0b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:56952/0 (socket says 172.21.15.154:56952) 2023-10-10T21:21:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01cbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b16d0 0x7f01cc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01d099b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f01cc0b4e70 0x7f01cc0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:55518/0 (socket says 172.21.15.154:55518) 2023-10-10T21:21:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.400+0000 7f01d119c700 1 -- 172.21.15.154:0/4067606138 learned_addr learned my addr 172.21.15.154:0/4067606138 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.401+0000 7f01d119c700 1 -- 172.21.15.154:0/4067606138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b16d0 msgr2=0x7f01cc0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.401+0000 7f01d119c700 1 --2- 172.21.15.154:0/4067606138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b16d0 0x7f01cc0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.401+0000 7f01d119c700 1 -- 172.21.15.154:0/4067606138 >> v1:172.21.15.179:6789/0 conn(0x7f01cc0b4e70 legacy=0x7f01cc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.401+0000 7f01d119c700 1 -- 172.21.15.154:0/4067606138 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0b5f20 con 0x7f01cc0b33b0 2023-10-10T21:21:36.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.401+0000 7f01cb7fe700 1 -- 172.21.15.154:0/4067606138 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184162183 0 0) 0x7f01cc0b2080 con 0x7f01cc0b4e70 2023-10-10T21:21:36.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.401+0000 7f01d119c700 1 --2- 172.21.15.154:0/4067606138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b33b0 0x7f01cc0b3830 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009f20 tx=0x7f01c4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=969dca7fc83e6f0a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:36.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.401+0000 7f01cb7fe700 1 -- 172.21.15.154:0/4067606138 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c400e070 con 0x7f01cc0b33b0 2023-10-10T21:21:36.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.401+0000 7f01cb7fe700 1 -- 172.21.15.154:0/4067606138 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c400b9d0 con 0x7f01cc0b33b0 2023-10-10T21:21:36.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.401+0000 7f01cb7fe700 1 -- 172.21.15.154:0/4067606138 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40092e0 con 0x7f01cc0b33b0 2023-10-10T21:21:36.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.402+0000 7f01d199d700 1 -- 172.21.15.154:0/4067606138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b33b0 msgr2=0x7f01cc0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.402+0000 7f01d199d700 1 --2- 172.21.15.154:0/4067606138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b33b0 0x7f01cc0b3830 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009f20 tx=0x7f01c4009840 comp rx=0 tx=0).stop 2023-10-10T21:21:36.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.402+0000 7f01d199d700 1 -- 172.21.15.154:0/4067606138 shutdown_connections 2023-10-10T21:21:36.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.402+0000 7f01d199d700 1 --2- 172.21.15.154:0/4067606138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b33b0 0x7f01cc0b3830 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.402+0000 7f01d199d700 1 --2- 172.21.15.154:0/4067606138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b16d0 0x7f01cc0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.402+0000 7f01d199d700 1 -- 172.21.15.154:0/4067606138 >> 172.21.15.154:0/4067606138 conn(0x7f01cc0d10c0 msgr2=0x7f01cc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.402+0000 7f01d199d700 1 -- 172.21.15.154:0/4067606138 shutdown_connections 2023-10-10T21:21:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.402+0000 7f01d199d700 1 -- 172.21.15.154:0/4067606138 wait complete. 2023-10-10T21:21:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.403+0000 7f01d199d700 1 Processor -- start 2023-10-10T21:21:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.404+0000 7f01d199d700 1 -- start start 2023-10-10T21:21:36.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.404+0000 7f01d199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b16d0 0x7f01cc162820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.404+0000 7f01d199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b33b0 0x7f01cc06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.404+0000 7f01d199d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc0b4e70 0x7f01cc06f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.404+0000 7f01d199d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc06b6b0 con 0x7f01cc0b4e70 2023-10-10T21:21:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.404+0000 7f01d199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc06c1f0 con 0x7f01cc0b16d0 2023-10-10T21:21:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.404+0000 7f01d199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc06b8c0 con 0x7f01cc0b33b0 2023-10-10T21:21:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d119c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc0b4e70 0x7f01cc06f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d099b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b16d0 0x7f01cc162820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d119c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc0b4e70 0x7f01cc06f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51438/0 (socket says 172.21.15.154:51438) 2023-10-10T21:21:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d119c700 1 -- 172.21.15.154:0/2575195448 learned_addr learned my addr 172.21.15.154:0/2575195448 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01cbfff700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b33b0 0x7f01cc06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d119c700 1 -- 172.21.15.154:0/2575195448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b33b0 msgr2=0x7f01cc06ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d119c700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b33b0 0x7f01cc06ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d119c700 1 -- 172.21.15.154:0/2575195448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b16d0 msgr2=0x7f01cc162820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d119c700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b16d0 0x7f01cc162820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d119c700 1 -- 172.21.15.154:0/2575195448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c4009ae0 con 0x7f01cc0b4e70 2023-10-10T21:21:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d099b700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b16d0 0x7f01cc162820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.405+0000 7f01d119c700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc0b4e70 0x7f01cc06f3a0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f01c400b610 tx=0x7f01c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.406+0000 7f01c8ff9700 1 -- 172.21.15.154:0/2575195448 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4007b40 con 0x7f01cc0b4e70 2023-10-10T21:21:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.406+0000 7f01c8ff9700 1 -- 172.21.15.154:0/2575195448 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c4007ca0 con 0x7f01cc0b4e70 2023-10-10T21:21:36.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.406+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc06bba0 con 0x7f01cc0b4e70 2023-10-10T21:21:36.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.406+0000 7f01c8ff9700 1 -- 172.21.15.154:0/2575195448 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c401d670 con 0x7f01cc0b4e70 2023-10-10T21:21:36.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.406+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc159400 con 0x7f01cc0b4e70 2023-10-10T21:21:36.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.407+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc088990 con 0x7f01cc0b4e70 2023-10-10T21:21:36.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.408+0000 7f01c8ff9700 1 -- 172.21.15.154:0/2575195448 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 63) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f01c4003050 con 0x7f01cc0b4e70 2023-10-10T21:21:36.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.409+0000 7f01c8ff9700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f01b0066f80 0x7f01b0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.409+0000 7f01c8ff9700 1 -- 172.21.15.154:0/2575195448 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f01c4086320 con 0x7f01cc0b4e70 2023-10-10T21:21:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.409+0000 7f01d099b700 1 -- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f01b0066f80 msgr2=0x7f01b0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T21:21:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.409+0000 7f01d099b700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f01b0066f80 0x7f01b0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.413+0000 7f01c8ff9700 1 -- 172.21.15.154:0/2575195448 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01c4053350 con 0x7f01cc0b4e70 2023-10-10T21:21:36.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.610+0000 7f01d099b700 1 -- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f01b0066f80 msgr2=0x7f01b0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T21:21:36.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.610+0000 7f01d099b700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f01b0066f80 0x7f01b0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:36.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.646+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f01cc06c330 con 0x7f01cc0b4e70 2023-10-10T21:21:36.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.651+0000 7f01c8ff9700 1 -- 172.21.15.154:0/2575195448 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f01c4056970 con 0x7f01cc0b4e70 2023-10-10T21:21:36.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.653+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f01b0066f80 msgr2=0x7f01b0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:36.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.653+0000 7f01d199d700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f01b0066f80 0x7f01b0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc0b4e70 msgr2=0x7f01cc06f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc0b4e70 0x7f01cc06f3a0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f01c400b610 tx=0x7f01c4018000 comp rx=0 tx=0).stop 2023-10-10T21:21:36.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 shutdown_connections 2023-10-10T21:21:36.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f01b0066f80 0x7f01b0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01cc0b4e70 0x7f01cc06f3a0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01cc0b16d0 0x7f01cc162820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 --2- 172.21.15.154:0/2575195448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01cc0b33b0 0x7f01cc06ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 >> 172.21.15.154:0/2575195448 conn(0x7f01cc0d10c0 msgr2=0x7f01cc159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:36.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 shutdown_connections 2023-10-10T21:21:36.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.654+0000 7f01d199d700 1 -- 172.21.15.154:0/2575195448 wait complete. 2023-10-10T21:21:36.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T21:21:36.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.861+0000 7fd27f39d700 1 Processor -- start 2023-10-10T21:21:36.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.861+0000 7fd27f39d700 1 -- start start 2023-10-10T21:21:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.862+0000 7fd27f39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2780b4e70 0x7fd2780ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.862+0000 7fd27f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b16d0 0x7fd2780b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.862+0000 7fd27f39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2780b2080 con 0x7fd27815d240 2023-10-10T21:21:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.862+0000 7fd27f39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780cfb00 con 0x7fd2780b4e70 2023-10-10T21:21:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.862+0000 7fd27f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780b5c40 con 0x7fd2780b16d0 2023-10-10T21:21:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27db9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b16d0 0x7fd2780b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27e39b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2780b4e70 0x7fd2780ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27db9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b16d0 0x7fd2780b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58884/0 (socket says 172.21.15.154:58884) 2023-10-10T21:21:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27db9a700 1 -- 172.21.15.154:0/2224781303 learned_addr learned my addr 172.21.15.154:0/2224781303 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27eb9c700 1 --1- 172.21.15.154:0/2224781303 >> v1:172.21.15.179:6789/0 conn(0x7fd27815d240 0x7fd27815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:55528/0 (socket says 172.21.15.154:55528) 2023-10-10T21:21:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27db9a700 1 -- 172.21.15.154:0/2224781303 >> v2:172.21.15.179:3300/0 conn(0x7fd2780b4e70 msgr2=0x7fd2780ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27db9a700 1 --2- 172.21.15.154:0/2224781303 >> v2:172.21.15.179:3300/0 conn(0x7fd2780b4e70 0x7fd2780ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27db9a700 1 -- 172.21.15.154:0/2224781303 >> v1:172.21.15.179:6789/0 conn(0x7fd27815d240 legacy=0x7fd27815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27db9a700 1 -- 172.21.15.154:0/2224781303 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780b5f20 con 0x7fd2780b16d0 2023-10-10T21:21:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27e39b700 1 --2- 172.21.15.154:0/2224781303 >> v2:172.21.15.179:3300/0 conn(0x7fd2780b4e70 0x7fd2780ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.863+0000 7fd27d399700 1 -- 172.21.15.154:0/2224781303 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229354447 0 0) 0x7fd2780b2080 con 0x7fd27815d240 2023-10-10T21:21:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.864+0000 7fd27db9a700 1 --2- 172.21.15.154:0/2224781303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b16d0 0x7fd2780b1b40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2680099b0 tx=0x7fd268009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7755a65fd2e6fa67 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.864+0000 7fd27d399700 1 -- 172.21.15.154:0/2224781303 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268009ea0 con 0x7fd2780b16d0 2023-10-10T21:21:36.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.864+0000 7fd27d399700 1 -- 172.21.15.154:0/2224781303 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26800b860 con 0x7fd2780b16d0 2023-10-10T21:21:36.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.864+0000 7fd27d399700 1 -- 172.21.15.154:0/2224781303 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800bc00 con 0x7fd2780b16d0 2023-10-10T21:21:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.864+0000 7fd27f39d700 1 -- 172.21.15.154:0/2224781303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b16d0 msgr2=0x7fd2780b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.864+0000 7fd27f39d700 1 --2- 172.21.15.154:0/2224781303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b16d0 0x7fd2780b1b40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2680099b0 tx=0x7fd268009250 comp rx=0 tx=0).stop 2023-10-10T21:21:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.865+0000 7fd27f39d700 1 -- 172.21.15.154:0/2224781303 shutdown_connections 2023-10-10T21:21:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.865+0000 7fd27f39d700 1 --2- 172.21.15.154:0/2224781303 >> v2:172.21.15.179:3300/0 conn(0x7fd2780b4e70 0x7fd2780ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.865+0000 7fd27f39d700 1 --2- 172.21.15.154:0/2224781303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b16d0 0x7fd2780b1b40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.865+0000 7fd27f39d700 1 -- 172.21.15.154:0/2224781303 >> 172.21.15.154:0/2224781303 conn(0x7fd2780d10c0 msgr2=0x7fd2780affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.865+0000 7fd27f39d700 1 -- 172.21.15.154:0/2224781303 shutdown_connections 2023-10-10T21:21:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.865+0000 7fd27f39d700 1 -- 172.21.15.154:0/2224781303 wait complete. 2023-10-10T21:21:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.866+0000 7fd27f39d700 1 Processor -- start 2023-10-10T21:21:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.866+0000 7fd27f39d700 1 -- start start 2023-10-10T21:21:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.867+0000 7fd27f39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2780b16d0 0x7fd278169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.867+0000 7fd27f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b4e70 0x7fd27814c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.867+0000 7fd27f39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd27815d240 0x7fd2780cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.867+0000 7fd27f39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27814c680 con 0x7fd27815d240 2023-10-10T21:21:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.867+0000 7fd27f39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27816acd0 con 0x7fd2780b16d0 2023-10-10T21:21:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.867+0000 7fd27f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27816b0b0 con 0x7fd2780b4e70 2023-10-10T21:21:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.867+0000 7fd27eb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd27815d240 0x7fd2780cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.867+0000 7fd27db9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b4e70 0x7fd27814c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.867+0000 7fd27e39b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2780b16d0 0x7fd278169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd27eb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd27815d240 0x7fd2780cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51454/0 (socket says 172.21.15.154:51454) 2023-10-10T21:21:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd27eb9c700 1 -- 172.21.15.154:0/2003003123 learned_addr learned my addr 172.21.15.154:0/2003003123 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd27db9a700 1 -- 172.21.15.154:0/2003003123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2780b16d0 msgr2=0x7fd278169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd27db9a700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2780b16d0 0x7fd278169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd27db9a700 1 -- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd27815d240 msgr2=0x7fd2780cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd27db9a700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd27815d240 0x7fd2780cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd27db9a700 1 -- 172.21.15.154:0/2003003123 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009420 con 0x7fd2780b4e70 2023-10-10T21:21:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd27db9a700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b4e70 0x7fd27814c140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd268013000 tx=0x7fd268017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:36.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd26e7fc700 1 -- 172.21.15.154:0/2003003123 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800bbe0 con 0x7fd2780b4e70 2023-10-10T21:21:36.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.868+0000 7fd26e7fc700 1 -- 172.21.15.154:0/2003003123 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26801be20 con 0x7fd2780b4e70 2023-10-10T21:21:36.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.869+0000 7fd26e7fc700 1 -- 172.21.15.154:0/2003003123 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268026660 con 0x7fd2780b4e70 2023-10-10T21:21:36.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.869+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2680094f0 con 0x7fd2780b4e70 2023-10-10T21:21:36.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.869+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27816a430 con 0x7fd2780b4e70 2023-10-10T21:21:36.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.870+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27816b220 con 0x7fd2780b4e70 2023-10-10T21:21:36.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.871+0000 7fd26e7fc700 1 -- 172.21.15.154:0/2003003123 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 63) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fd268026a90 con 0x7fd2780b4e70 2023-10-10T21:21:36.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.871+0000 7fd26e7fc700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd25c066f80 0x7fd25c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.871+0000 7fd26e7fc700 1 -- 172.21.15.154:0/2003003123 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fd268086060 con 0x7fd2780b4e70 2023-10-10T21:21:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.871+0000 7fd27e39b700 1 -- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd25c066f80 msgr2=0x7fd25c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T21:21:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.871+0000 7fd27e39b700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd25c066f80 0x7fd25c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:36.876+0000 7fd26e7fc700 1 -- 172.21.15.154:0/2003003123 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2680b75a0 con 0x7fd2780b4e70 2023-10-10T21:21:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.071+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fd27804bb80 con 0x7fd2780b4e70 2023-10-10T21:21:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.072+0000 7fd27e39b700 1 -- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd25c066f80 msgr2=0x7fd25c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T21:21:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.072+0000 7fd27e39b700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd25c066f80 0x7fd25c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:37.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.078+0000 7fd26e7fc700 1 -- 172.21.15.154:0/2003003123 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd268053110 con 0x7fd2780b4e70 2023-10-10T21:21:37.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd25c066f80 msgr2=0x7fd25c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:37.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd25c066f80 0x7fd25c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:37.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b4e70 msgr2=0x7fd27814c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:37.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b4e70 0x7fd27814c140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd268013000 tx=0x7fd268017000 comp rx=0 tx=0).stop 2023-10-10T21:21:37.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 shutdown_connections 2023-10-10T21:21:37.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd25c066f80 0x7fd25c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:37.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd27815d240 0x7fd2780cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:37.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2780b16d0 0x7fd278169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:37.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 --2- 172.21.15.154:0/2003003123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2780b4e70 0x7fd27814c140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:37.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 >> 172.21.15.154:0/2003003123 conn(0x7fd2780d10c0 msgr2=0x7fd278158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:37.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.080+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 shutdown_connections 2023-10-10T21:21:37.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.081+0000 7fd27f39d700 1 -- 172.21.15.154:0/2003003123 wait complete. 2023-10-10T21:21:37.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T21:21:37.101 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-10T21:21:37.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-10-10T21:21:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.374+0000 7fb9e299d700 1 Processor -- start 2023-10-10T21:21:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.374+0000 7fb9e299d700 1 -- start start 2023-10-10T21:21:37.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.375+0000 7fb9e299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b03c0 0x7fb9dc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:37.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.375+0000 7fb9e299d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc0cfa00 con 0x7fb9dc0b0790 2023-10-10T21:21:37.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.375+0000 7fb9e299d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc0cb580 con 0x7fb9dc1591e0 2023-10-10T21:21:37.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.375+0000 7fb9e299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0cf160 con 0x7fb9dc0b03c0 2023-10-10T21:21:37.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.375+0000 7fb9e119a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb9dc0b0790 0x7fb9dc0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41764/0 (socket says 172.21.15.154:41764) 2023-10-10T21:21:37.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.375+0000 7fb9e119a700 1 -- 172.21.15.154:0/428613314 learned_addr learned my addr 172.21.15.154:0/428613314 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:37.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.376+0000 7fb9e199b700 1 --2- 172.21.15.154:0/428613314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b03c0 0x7fb9dc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:37.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.376+0000 7fb9e0999700 1 -- 172.21.15.154:0/428613314 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936766634 0 0) 0x7fb9dc0cfa00 con 0x7fb9dc0b0790 2023-10-10T21:21:37.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.376+0000 7fb9e0999700 1 -- 172.21.15.154:0/428613314 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c8003570 con 0x7fb9dc0b0790 2023-10-10T21:21:37.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.376+0000 7fb9e199b700 1 -- 172.21.15.154:0/428613314 >> v1:172.21.15.179:6789/0 conn(0x7fb9dc1591e0 legacy=0x7fb9dc159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:37.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.376+0000 7fb9e0999700 1 -- 172.21.15.154:0/428613314 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502009704 0 0) 0x7fb9dc0cb580 con 0x7fb9dc1591e0 2023-10-10T21:21:37.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.376+0000 7fb9e199b700 1 -- 172.21.15.154:0/428613314 >> v1:172.21.15.154:6789/0 conn(0x7fb9dc0b0790 legacy=0x7fb9dc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:37.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.376+0000 7fb9e199b700 1 -- 172.21.15.154:0/428613314 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0cf440 con 0x7fb9dc0b03c0 2023-10-10T21:21:37.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.376+0000 7fb9e199b700 1 --2- 172.21.15.154:0/428613314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b03c0 0x7fb9dc0cea70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009910 tx=0x7fb9d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57b5895abfc4a5df server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:37.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e0999700 1 -- 172.21.15.154:0/428613314 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800b680 con 0x7fb9dc0b03c0 2023-10-10T21:21:37.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e0999700 1 -- 172.21.15.154:0/428613314 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800b7e0 con 0x7fb9dc0b03c0 2023-10-10T21:21:37.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e0999700 1 -- 172.21.15.154:0/428613314 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800bba0 con 0x7fb9dc0b03c0 2023-10-10T21:21:37.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e299d700 1 -- 172.21.15.154:0/428613314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b03c0 msgr2=0x7fb9dc0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:37.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e299d700 1 --2- 172.21.15.154:0/428613314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b03c0 0x7fb9dc0cea70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009910 tx=0x7fb9d80091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:37.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e299d700 1 -- 172.21.15.154:0/428613314 shutdown_connections 2023-10-10T21:21:37.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e299d700 1 --2- 172.21.15.154:0/428613314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b03c0 0x7fb9dc0cea70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:37.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e299d700 1 -- 172.21.15.154:0/428613314 >> 172.21.15.154:0/428613314 conn(0x7fb9dc063230 msgr2=0x7fb9dc063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:37.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e299d700 1 -- 172.21.15.154:0/428613314 shutdown_connections 2023-10-10T21:21:37.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.377+0000 7fb9e299d700 1 -- 172.21.15.154:0/428613314 wait complete. 2023-10-10T21:21:37.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.379+0000 7fb9e299d700 1 Processor -- start 2023-10-10T21:21:37.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.379+0000 7fb9e299d700 1 -- start start 2023-10-10T21:21:37.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9dc0b03c0 0x7fb9dc16d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:37.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b0790 0x7fb9dc168d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:37.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e299d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9dc1591e0 0x7fb9dc0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:37.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e299d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc155900 con 0x7fb9dc1591e0 2023-10-10T21:21:37.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc154cf0 con 0x7fb9dc0b03c0 2023-10-10T21:21:37.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc154fd0 con 0x7fb9dc0b0790 2023-10-10T21:21:37.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e219c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9dc1591e0 0x7fb9dc0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:37.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e119a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b0790 0x7fb9dc168d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:37.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e119a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b0790 0x7fb9dc168d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58918/0 (socket says 172.21.15.154:58918) 2023-10-10T21:21:37.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e219c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9dc1591e0 0x7fb9dc0d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51460/0 (socket says 172.21.15.154:51460) 2023-10-10T21:21:37.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e199b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9dc0b03c0 0x7fb9dc16d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:37.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.380+0000 7fb9e119a700 1 -- 172.21.15.154:0/3529553533 learned_addr learned my addr 172.21.15.154:0/3529553533 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:37.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9e119a700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9dc0b03c0 msgr2=0x7fb9dc16d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:37.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9e119a700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9dc0b03c0 0x7fb9dc16d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:37.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9e119a700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9dc1591e0 msgr2=0x7fb9dc0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:37.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9e119a700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9dc1591e0 0x7fb9dc0d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:37.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9e119a700 1 -- 172.21.15.154:0/3529553533 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8009420 con 0x7fb9dc0b0790 2023-10-10T21:21:37.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9e219c700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9dc1591e0 0x7fb9dc0d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:37.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9e119a700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b0790 0x7fb9dc168d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0011e0 tx=0x7fb9cc007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:37.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc005b30 con 0x7fb9dc0b0790 2023-10-10T21:21:37.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc005c90 con 0x7fb9dc0b0790 2023-10-10T21:21:37.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc1552b0 con 0x7fb9dc0b0790 2023-10-10T21:21:37.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc007300 con 0x7fb9dc0b0790 2023-10-10T21:21:37.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.381+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc16da50 con 0x7fb9dc0b0790 2023-10-10T21:21:37.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.382+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc04c3c0 con 0x7fb9dc0b0790 2023-10-10T21:21:37.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.383+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 63) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb9cc007670 con 0x7fb9dc0b0790 2023-10-10T21:21:37.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.384+0000 7fb9d1ffb700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:37.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.384+0000 7fb9e199b700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 msgr2=0x7fb9c0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T21:21:37.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.384+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fb9cc083bb0 con 0x7fb9dc0b0790 2023-10-10T21:21:37.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.384+0000 7fb9e199b700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T21:21:37.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.388+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9cc050be0 con 0x7fb9dc0b0790 2023-10-10T21:21:37.457 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:37.457+0000 7f61d6487180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:21:37.551 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:37.550+0000 7f2bd9a55180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T21:21:37.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.585+0000 7fb9e199b700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 msgr2=0x7fb9c0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T21:21:37.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.585+0000 7fb9e199b700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T21:21:37.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.613+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9dc155a70 con 0x7fb9c0066f80 2023-10-10T21:21:37.619 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:37.619+0000 7f61d6487180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:21:37.709 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:37.707+0000 7f61d6487180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:21:37.723 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:37.722+0000 7f2bd9a55180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T21:21:37.810 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:37.809+0000 7f2bd9a55180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T21:21:37.934 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:37.933+0000 7f61d6487180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:21:37.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.986+0000 7fb9e199b700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 msgr2=0x7fb9c0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T21:21:37.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:37.986+0000 7fb9e199b700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T21:21:38.037 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:38.036+0000 7f2bd9a55180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:21:38.111 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:38.110+0000 7f61d6487180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:21:38.203 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:38.201+0000 7f61d6487180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:21:38.215 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:38.214+0000 7f2bd9a55180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T21:21:38.306 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:38.305+0000 7f2bd9a55180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T21:21:38.366 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:38.364+0000 7f61d6487180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:21:38.466 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:38.465+0000 7f61d6487180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:21:38.469 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:38.468+0000 7f2bd9a55180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T21:21:38.570 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:38.569+0000 7f2bd9a55180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T21:21:38.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:38.787+0000 7fb9e199b700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 msgr2=0x7fb9c0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T21:21:38.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:38.787+0000 7fb9e199b700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T21:21:38.948 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:38.947+0000 7f61d6487180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:21:39.042 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:39.041+0000 7f61d6487180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:21:39.060 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:39.059+0000 7f2bd9a55180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T21:21:39.132 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:39.130+0000 7f61d6487180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:21:39.157 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:39.154+0000 7f2bd9a55180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T21:21:39.245 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:39.244+0000 7f2bd9a55180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T21:21:39.755 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:39.754+0000 7f61d6487180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:21:39.872 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:39.871+0000 7f2bd9a55180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T21:21:39.931 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:39.929+0000 7f61d6487180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:21:40.027 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:40.025+0000 7f61d6487180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:21:40.047 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:40.046+0000 7f2bd9a55180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T21:21:40.145 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:40.144+0000 7f2bd9a55180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T21:21:40.321 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:40.320+0000 7f61d6487180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:21:40.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:40.389+0000 7fb9e199b700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 msgr2=0x7fb9c0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T21:21:40.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:40.389+0000 7fb9e199b700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T21:21:40.417 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:40.416+0000 7f61d6487180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:21:40.441 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:40.440+0000 7f2bd9a55180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T21:21:40.538 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:40.537+0000 7f2bd9a55180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T21:21:41.120 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:41.119+0000 7f61d6487180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:21:41.244 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:41.243+0000 7f2bd9a55180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T21:21:41.407 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:41.405+0000 7f61d6487180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:21:41.500 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:41.498+0000 7f61d6487180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:21:41.531 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:41.530+0000 7f2bd9a55180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T21:21:41.626 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:41.624+0000 7f2bd9a55180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T21:21:41.655 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:41.654+0000 7f61d6487180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:21:41.760 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:41.759+0000 7f61d6487180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:21:41.782 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:41.780+0000 7f2bd9a55180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T21:21:41.886 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:41.885+0000 7f2bd9a55180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T21:21:41.950 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:41.949+0000 7f61d6487180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:21:42.042 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:42.041+0000 7f61d6487180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:21:42.078 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.077+0000 7f2bd9a55180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T21:21:42.134 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:42.132+0000 7f61d6487180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:21:42.173 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.171+0000 7f2bd9a55180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T21:21:42.227 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T21:21:42.226+0000 7f61d6487180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:21:42.266 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.265+0000 7f2bd9a55180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T21:21:42.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:42.287+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mgrmap(e 64) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb9cc050fb0 con 0x7fb9dc0b0790 2023-10-10T21:21:42.364 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.363+0000 7f2bd9a55180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T21:21:42.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:42.373+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mgrmap(e 65) v1 ==== 84468+0+0 (secure 0 0 0) 0x7fb9cc05b3b0 con 0x7fb9dc0b0790 2023-10-10T21:21:42.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:42.374+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 msgr2=0x7fb9c0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T21:21:42.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:42.374+0000 7fb9d1ffb700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:42.493 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.491+0000 7f2b4bd31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:42.494 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.491+0000 7f2b4bd31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:42.494 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.491+0000 7f2b4bd31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:42.494 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.491+0000 7f2b4bd31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:42.494 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.491+0000 7f2b4bd31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:42.494 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.492+0000 7f2b4e536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:42.495 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.492+0000 7f2b4e536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:42.495 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.492+0000 7f2b4e536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:42.495 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.492+0000 7f2b4e536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:42.495 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:21:42.492+0000 7f2b4e536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:21:43.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.382+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mon.2 v2:172.21.15.179:3301/0 9 ==== mgrmap(e 66) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fb9cc0554c0 con 0x7fb9dc0b0790 2023-10-10T21:21:43.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.383+0000 7fb9d1ffb700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:43.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.383+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9dc155a70 con 0x7fb9c0066f80 2023-10-10T21:21:43.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.384+0000 7fb9e199b700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:43.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.387+0000 7fb9e199b700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c00693b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80093f0 tx=0x7fb9d8017000 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:43.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.457+0000 7fb9d1ffb700 1 -- 172.21.15.154:0/3529553533 <== mgr.8376 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fb9dc155a70 con 0x7fb9c0066f80 2023-10-10T21:21:43.459 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1 2023-10-10T21:21:43.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 msgr2=0x7fb9c00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:43.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c00693b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80093f0 tx=0x7fb9d8017000 comp rx=0 tx=0).stop 2023-10-10T21:21:43.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b0790 msgr2=0x7fb9dc168d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:43.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b0790 0x7fb9dc168d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0011e0 tx=0x7fb9cc007df0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 shutdown_connections 2023-10-10T21:21:43.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb9c0066f80 0x7fb9c00693b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9dc1591e0 0x7fb9dc0d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9dc0b03c0 0x7fb9dc16d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 --2- 172.21.15.154:0/3529553533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9dc0b0790 0x7fb9dc168d40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 >> 172.21.15.154:0/3529553533 conn(0x7fb9dc063230 msgr2=0x7fb9dc068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:43.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 shutdown_connections 2023-10-10T21:21:43.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.460+0000 7fb9e299d700 1 -- 172.21.15.154:0/3529553533 wait complete. 2023-10-10T21:21:43.480 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-10-10T21:21:43.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-10-10T21:21:43.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.669+0000 7fb08b19d700 1 Processor -- start 2023-10-10T21:21:43.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.669+0000 7fb08b19d700 1 -- start start 2023-10-10T21:21:43.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.670+0000 7fb08b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0840cf480 0x7fb08415d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:43.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.670+0000 7fb08b19d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb08415d760 0x7fb0840b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:43.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.670+0000 7fb08b19d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840b10f0 con 0x7fb0841595d0 2023-10-10T21:21:43.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.670+0000 7fb08b19d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08415dbe0 con 0x7fb08415d760 2023-10-10T21:21:43.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.670+0000 7fb08b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08415e000 con 0x7fb0840cf480 2023-10-10T21:21:43.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.670+0000 7fb08a99c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb08415d760 0x7fb0840b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:43.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.670+0000 7fb08a99c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb08415d760 0x7fb0840b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51590/0 (socket says 172.21.15.154:51590) 2023-10-10T21:21:43.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb08a99c700 1 -- 172.21.15.154:0/2157310480 learned_addr learned my addr 172.21.15.154:0/2157310480 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:43.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb08999a700 1 --2- 172.21.15.154:0/2157310480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0840cf480 0x7fb08415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:43.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb08a99c700 1 -- 172.21.15.154:0/2157310480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0840cf480 msgr2=0x7fb08415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:43.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb08a99c700 1 --2- 172.21.15.154:0/2157310480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0840cf480 0x7fb08415d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb08a99c700 1 -- 172.21.15.154:0/2157310480 >> v1:172.21.15.154:6789/0 conn(0x7fb0841595d0 legacy=0x7fb0840ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb08a99c700 1 -- 172.21.15.154:0/2157310480 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840cf990 con 0x7fb08415d760 2023-10-10T21:21:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb089199700 1 -- 172.21.15.154:0/2157310480 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890972448 0 0) 0x7fb0840b10f0 con 0x7fb0841595d0 2023-10-10T21:21:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb08a99c700 1 --2- 172.21.15.154:0/2157310480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08415d760 0x7fb0840b1580 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009f20 tx=0x7fb07c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8194509a5a206af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:43.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb089199700 1 -- 172.21.15.154:0/2157310480 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00e070 con 0x7fb08415d760 2023-10-10T21:21:43.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb089199700 1 -- 172.21.15.154:0/2157310480 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c00b9d0 con 0x7fb08415d760 2023-10-10T21:21:43.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.671+0000 7fb089199700 1 -- 172.21.15.154:0/2157310480 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0092e0 con 0x7fb08415d760 2023-10-10T21:21:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.672+0000 7fb08b19d700 1 -- 172.21.15.154:0/2157310480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08415d760 msgr2=0x7fb0840b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.672+0000 7fb08b19d700 1 --2- 172.21.15.154:0/2157310480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08415d760 0x7fb0840b1580 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009f20 tx=0x7fb07c009840 comp rx=0 tx=0).stop 2023-10-10T21:21:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.672+0000 7fb08b19d700 1 -- 172.21.15.154:0/2157310480 shutdown_connections 2023-10-10T21:21:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.672+0000 7fb08b19d700 1 --2- 172.21.15.154:0/2157310480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08415d760 0x7fb0840b1580 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.672+0000 7fb08b19d700 1 --2- 172.21.15.154:0/2157310480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0840cf480 0x7fb08415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.672+0000 7fb08b19d700 1 -- 172.21.15.154:0/2157310480 >> 172.21.15.154:0/2157310480 conn(0x7fb0840d05f0 msgr2=0x7fb0840d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:43.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.672+0000 7fb08b19d700 1 -- 172.21.15.154:0/2157310480 shutdown_connections 2023-10-10T21:21:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.672+0000 7fb08b19d700 1 -- 172.21.15.154:0/2157310480 wait complete. 2023-10-10T21:21:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.674+0000 7fb08b19d700 1 Processor -- start 2023-10-10T21:21:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.674+0000 7fb08b19d700 1 -- start start 2023-10-10T21:21:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.674+0000 7fb08b19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cf480 0x7fb084140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08b19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0841595d0 0x7fb084154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08415d760 0x7fb0840d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08b19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb084169c10 con 0x7fb0840cf480 2023-10-10T21:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08b19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb084141100 con 0x7fb0841595d0 2023-10-10T21:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb084156070 con 0x7fb08415d760 2023-10-10T21:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08a19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cf480 0x7fb084140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08a19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cf480 0x7fb084140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51598/0 (socket says 172.21.15.154:51598) 2023-10-10T21:21:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08a19b700 1 -- 172.21.15.154:0/2203070258 learned_addr learned my addr 172.21.15.154:0/2203070258 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08999a700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0841595d0 0x7fb084154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08a99c700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08415d760 0x7fb0840d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:43.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08a19b700 1 -- 172.21.15.154:0/2203070258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08415d760 msgr2=0x7fb0840d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08a19b700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08415d760 0x7fb0840d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08a19b700 1 -- 172.21.15.154:0/2203070258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0841595d0 msgr2=0x7fb084154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08a19b700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0841595d0 0x7fb084154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.675+0000 7fb08a19b700 1 -- 172.21.15.154:0/2203070258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c009ae0 con 0x7fb0840cf480 2023-10-10T21:21:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.676+0000 7fb08a19b700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cf480 0x7fb084140bc0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fb08000c7c0 tx=0x7fb080007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.676+0000 7fb07a7fc700 1 -- 172.21.15.154:0/2203070258 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000f470 con 0x7fb0840cf480 2023-10-10T21:21:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.676+0000 7fb07a7fc700 1 -- 172.21.15.154:0/2203070258 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08000f5d0 con 0x7fb0840cf480 2023-10-10T21:21:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.676+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb084156ed0 con 0x7fb0840cf480 2023-10-10T21:21:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.676+0000 7fb07a7fc700 1 -- 172.21.15.154:0/2203070258 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000f990 con 0x7fb0840cf480 2023-10-10T21:21:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.676+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0841562c0 con 0x7fb0840cf480 2023-10-10T21:21:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.677+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08404c3c0 con 0x7fb0840cf480 2023-10-10T21:21:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.678+0000 7fb07a7fc700 1 -- 172.21.15.154:0/2203070258 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 66) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fb08000fd00 con 0x7fb0840cf480 2023-10-10T21:21:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.679+0000 7fb07a7fc700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb068066dd0 0x7fb068069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:43.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.679+0000 7fb07a7fc700 1 -- 172.21.15.154:0/2203070258 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6383+0+0 (secure 0 0 0) 0x7fb080083a80 con 0x7fb0840cf480 2023-10-10T21:21:43.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.679+0000 7fb08999a700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb068066dd0 0x7fb068069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:43.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.679+0000 7fb08999a700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb068066dd0 0x7fb068069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0841558b0 tx=0x7fb0740091a0 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:43.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.683+0000 7fb07a7fc700 1 -- 172.21.15.154:0/2203070258 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb080050c30 con 0x7fb0840cf480 2023-10-10T21:21:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.897+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0840d03a0 con 0x7fb068066dd0 2023-10-10T21:21:43.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.956+0000 7fb07a7fc700 1 -- 172.21.15.154:0/2203070258 <== mgr.8376 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7fb0840d03a0 con 0x7fb068066dd0 2023-10-10T21:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout:Retention added to path /snap_test_dir1 2023-10-10T21:21:43.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb068066dd0 msgr2=0x7fb068069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:43.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb068066dd0 0x7fb068069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0841558b0 tx=0x7fb0740091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cf480 msgr2=0x7fb084140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:43.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cf480 0x7fb084140bc0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fb08000c7c0 tx=0x7fb080007d80 comp rx=0 tx=0).stop 2023-10-10T21:21:43.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 shutdown_connections 2023-10-10T21:21:43.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08415d760 0x7fb0840d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb068066dd0 0x7fb068069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cf480 0x7fb084140bc0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 --2- 172.21.15.154:0/2203070258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0841595d0 0x7fb084154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 >> 172.21.15.154:0/2203070258 conn(0x7fb0840d05f0 msgr2=0x7fb084068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 shutdown_connections 2023-10-10T21:21:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:43.959+0000 7fb08b19d700 1 -- 172.21.15.154:0/2203070258 wait complete. 2023-10-10T21:21:43.978 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-10-10T21:21:43.978 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-10T21:21:43.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-10-10T21:21:44.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.163+0000 7fe47dfff700 1 Processor -- start 2023-10-10T21:21:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.163+0000 7fe47dfff700 1 -- start start 2023-10-10T21:21:44.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.164+0000 7fe47dfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe4781563b0 0x7fe478156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:44.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.164+0000 7fe47dfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47815a440 0x7fe4780acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:44.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.165+0000 7fe47dfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47815a9b0 con 0x7fe478068890 2023-10-10T21:21:44.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.165+0000 7fe47dfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47815ac90 con 0x7fe4781563b0 2023-10-10T21:21:44.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.165+0000 7fe47dfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47815af70 con 0x7fe47815a440 2023-10-10T21:21:44.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.165+0000 7fe477fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe478068890 0x7fe4780c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41784/0 (socket says 172.21.15.154:41784) 2023-10-10T21:21:44.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.165+0000 7fe477fff700 1 -- 172.21.15.154:0/1642150741 learned_addr learned my addr 172.21.15.154:0/1642150741 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T21:21:44.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.165+0000 7fe4777fe700 1 --2- 172.21.15.154:0/1642150741 >> v2:172.21.15.179:3300/0 conn(0x7fe4781563b0 0x7fe478156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:44.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.165+0000 7fe476ffd700 1 --2- 172.21.15.154:0/1642150741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47815a440 0x7fe4780acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:44.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.165+0000 7fe4767fc700 1 -- 172.21.15.154:0/1642150741 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280381015 0 0) 0x7fe47815a9b0 con 0x7fe478068890 2023-10-10T21:21:44.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.165+0000 7fe4767fc700 1 -- 172.21.15.154:0/1642150741 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe460003570 con 0x7fe478068890 2023-10-10T21:21:44.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.166+0000 7fe4777fe700 1 -- 172.21.15.154:0/1642150741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47815a440 msgr2=0x7fe4780acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T21:21:44.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.166+0000 7fe4777fe700 1 --2- 172.21.15.154:0/1642150741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47815a440 0x7fe4780acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.166+0000 7fe4777fe700 1 -- 172.21.15.154:0/1642150741 >> v1:172.21.15.154:6789/0 conn(0x7fe478068890 legacy=0x7fe4780c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:44.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.166+0000 7fe4777fe700 1 -- 172.21.15.154:0/1642150741 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47815b250 con 0x7fe4781563b0 2023-10-10T21:21:44.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.166+0000 7fe476ffd700 1 --2- 172.21.15.154:0/1642150741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47815a440 0x7fe4780acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T21:21:44.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.166+0000 7fe4777fe700 1 --2- 172.21.15.154:0/1642150741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4781563b0 0x7fe478156780 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe4680098e0 tx=0x7fe4680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da7d2da4368dcfa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:44.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.166+0000 7fe4767fc700 1 -- 172.21.15.154:0/1642150741 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468011630 con 0x7fe4781563b0 2023-10-10T21:21:44.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.166+0000 7fe4767fc700 1 -- 172.21.15.154:0/1642150741 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe468011790 con 0x7fe4781563b0 2023-10-10T21:21:44.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.166+0000 7fe4767fc700 1 -- 172.21.15.154:0/1642150741 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468011b30 con 0x7fe4781563b0 2023-10-10T21:21:44.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.167+0000 7fe47dfff700 1 -- 172.21.15.154:0/1642150741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4781563b0 msgr2=0x7fe478156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:44.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.167+0000 7fe47dfff700 1 --2- 172.21.15.154:0/1642150741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4781563b0 0x7fe478156780 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe4680098e0 tx=0x7fe4680091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.167+0000 7fe47dfff700 1 -- 172.21.15.154:0/1642150741 shutdown_connections 2023-10-10T21:21:44.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.167+0000 7fe47dfff700 1 --2- 172.21.15.154:0/1642150741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4781563b0 0x7fe478156780 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.167+0000 7fe47dfff700 1 --2- 172.21.15.154:0/1642150741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47815a440 0x7fe4780acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.167+0000 7fe47dfff700 1 -- 172.21.15.154:0/1642150741 >> 172.21.15.154:0/1642150741 conn(0x7fe4780c8f90 msgr2=0x7fe4780c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:44.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.167+0000 7fe47dfff700 1 -- 172.21.15.154:0/1642150741 shutdown_connections 2023-10-10T21:21:44.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.167+0000 7fe47dfff700 1 -- 172.21.15.154:0/1642150741 wait complete. 2023-10-10T21:21:44.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.168+0000 7fe47dfff700 1 Processor -- start 2023-10-10T21:21:44.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.168+0000 7fe47dfff700 1 -- start start 2023-10-10T21:21:44.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.169+0000 7fe47dfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe478068890 0x7fe4780b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:44.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.169+0000 7fe47dfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4781563b0 0x7fe47814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:44.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.169+0000 7fe47dfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47815a440 0x7fe4781545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:44.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.169+0000 7fe47dfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47816a490 con 0x7fe4781563b0 2023-10-10T21:21:44.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.169+0000 7fe47dfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47816a180 con 0x7fe47815a440 2023-10-10T21:21:44.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.169+0000 7fe47dfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe478157f20 con 0x7fe478068890 2023-10-10T21:21:44.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe476ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4781563b0 0x7fe47814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:44.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe476ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4781563b0 0x7fe47814a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51612/0 (socket says 172.21.15.154:51612) 2023-10-10T21:21:44.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe476ffd700 1 -- 172.21.15.154:0/2507494365 learned_addr learned my addr 172.21.15.154:0/2507494365 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T21:21:44.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe477fff700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47815a440 0x7fe4781545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:44.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe4777fe700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe478068890 0x7fe4780b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:44.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe476ffd700 1 -- 172.21.15.154:0/2507494365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe478068890 msgr2=0x7fe4780b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:44.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe476ffd700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe478068890 0x7fe4780b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe476ffd700 1 -- 172.21.15.154:0/2507494365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47815a440 msgr2=0x7fe4781545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:44.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe476ffd700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47815a440 0x7fe4781545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe476ffd700 1 -- 172.21.15.154:0/2507494365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009420 con 0x7fe4781563b0 2023-10-10T21:21:44.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe476ffd700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4781563b0 0x7fe47814a8d0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00ec80 tx=0x7fe46c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:44.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe45f7fe700 1 -- 172.21.15.154:0/2507494365 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00c9d0 con 0x7fe4781563b0 2023-10-10T21:21:44.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.170+0000 7fe45f7fe700 1 -- 172.21.15.154:0/2507494365 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c00cb30 con 0x7fe4781563b0 2023-10-10T21:21:44.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.171+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe468009420 con 0x7fe4781563b0 2023-10-10T21:21:44.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.171+0000 7fe45f7fe700 1 -- 172.21.15.154:0/2507494365 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00ceb0 con 0x7fe4781563b0 2023-10-10T21:21:44.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.171+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe478157680 con 0x7fe4781563b0 2023-10-10T21:21:44.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.172+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47816a5d0 con 0x7fe4781563b0 2023-10-10T21:21:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.173+0000 7fe45f7fe700 1 -- 172.21.15.154:0/2507494365 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 66) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fe46c013680 con 0x7fe4781563b0 2023-10-10T21:21:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.173+0000 7fe45f7fe700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe464066dd0 0x7fe464069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T21:21:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.173+0000 7fe45f7fe700 1 -- 172.21.15.154:0/2507494365 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6383+0+0 (secure 0 0 0) 0x7fe46c0849b0 con 0x7fe4781563b0 2023-10-10T21:21:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.174+0000 7fe4777fe700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe464066dd0 0x7fe464069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T21:21:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.174+0000 7fe4777fe700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe464066dd0 0x7fe464069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe4680091e0 tx=0x7fe468017000 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T21:21:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.177+0000 7fe45f7fe700 1 -- 172.21.15.154:0/2507494365 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe47816a5d0 con 0x7fe4781563b0 2023-10-10T21:21:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.386+0000 7fe45f7fe700 1 -- 172.21.15.154:0/2507494365 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 67) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fe46c051f30 con 0x7fe4781563b0 2023-10-10T21:21:44.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.397+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe47816a5d0 con 0x7fe464066dd0 2023-10-10T21:21:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.406+0000 7fe45f7fe700 1 -- 172.21.15.154:0/2507494365 <== mgr.8376 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7fe47816a5d0 con 0x7fe464066dd0 2023-10-10T21:21:44.407 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T21:21:44.408 INFO:teuthology.orchestra.run.smithi154.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-10T21:21:44.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe464066dd0 msgr2=0x7fe464069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:44.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe464066dd0 0x7fe464069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe4680091e0 tx=0x7fe468017000 comp rx=0 tx=0).stop 2023-10-10T21:21:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4781563b0 msgr2=0x7fe47814a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T21:21:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4781563b0 0x7fe47814a8d0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00ec80 tx=0x7fe46c0091a0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 shutdown_connections 2023-10-10T21:21:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47815a440 0x7fe4781545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe478068890 0x7fe4780b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe464066dd0 0x7fe464069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 --2- 172.21.15.154:0/2507494365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4781563b0 0x7fe47814a8d0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T21:21:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 >> 172.21.15.154:0/2507494365 conn(0x7fe4780c8f90 msgr2=0x7fe4780ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T21:21:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.408+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 shutdown_connections 2023-10-10T21:21:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T21:21:44.409+0000 7fe47dfff700 1 -- 172.21.15.154:0/2507494365 wait complete. 2023-10-10T21:21:44.427 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-10T21:21:44.427 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-10-10T21:21:50.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:21:50.254 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:22:00.971 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:22:00.970+0000 7f2b3dd15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:22:00.971 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:22:00.970+0000 7f2b3dd15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:22:00.972 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:22:00.970+0000 7f2b3dd15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:22:00.972 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:22:00.970+0000 7f2b3dd15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:22:00.972 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T21:22:00.970+0000 7f2b3dd15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T21:22:20.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:22:20.366 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:22:50.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:22:50.518 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:23:20.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:23:20.627 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:23:50.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:23:50.754 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:24:20.931 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:24:20.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:24:51.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:24:51.093 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:25:21.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:25:21.206 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:25:51.395 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:25:51.401 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:26:21.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:26:21.522 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:26:51.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:26:51.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:27:21.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:27:21.899 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:27:52.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:27:52.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:28:22.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:28:22.181 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:28:52.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:28:52.363 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:29:22.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:29:22.544 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:29:52.644 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:29:52.650 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:30:22.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:30:22.796 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:30:52.970 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:30:52.976 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:31:23.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:31:23.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:31:53.596 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:31:53.602 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:32:23.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:32:23.782 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:32:53.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:32:53.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:33:24.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:33:24.099 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:33:54.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:33:54.255 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:34:24.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:34:24.435 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:34:54.543 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:34:54.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:35:24.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:35:24.703 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:35:54.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:35:54.865 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:36:25.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:36:25.050 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:36:55.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:36:55.255 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:37:25.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:37:25.363 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:37:55.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:37:55.476 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:38:25.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:38:25.673 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:38:55.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:38:55.845 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:39:26.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:39:26.047 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:39:56.234 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:39:56.240 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:40:26.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:40:26.413 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:40:56.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:40:56.593 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:41:26.692 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:41:26.698 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:41:56.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:41:56.822 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:42:26.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:42:27.005 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:42:57.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:42:57.175 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:43:27.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:43:27.348 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:43:57.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:43:57.537 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:44:27.644 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:44:27.654 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:44:57.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:44:57.840 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:45:28.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:45:28.021 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:45:58.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:45:58.252 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:46:28.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:46:28.431 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:46:58.623 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:46:58.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:47:28.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:47:28.793 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:47:58.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:47:58.892 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:48:29.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:48:29.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:48:59.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:48:59.260 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:49:29.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:49:29.445 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:49:59.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:49:59.617 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:50:29.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:50:29.786 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:50:59.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:50:59.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:51:30.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:51:30.105 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:52:00.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:52:00.311 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:52:30.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:52:30.499 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:53:00.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:53:00.671 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:53:30.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:53:30.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:54:00.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:54:00.875 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:54:31.120 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:54:31.127 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:55:01.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:55:01.229 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:55:31.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:55:31.351 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:56:01.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:56:01.450 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:56:31.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:56:31.546 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:57:01.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:57:01.669 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:57:31.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:57:31.777 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:58:01.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:58:01.883 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:58:32.016 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:58:32.022 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:59:02.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:59:02.212 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:59:32.369 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T21:59:32.375 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:00:02.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:00:02.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:00:32.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:00:32.746 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:01:02.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:01:02.920 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:01:33.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:01:33.058 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:02:03.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:02:03.189 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:02:33.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:02:33.370 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:03:03.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:03:03.560 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:03:33.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:03:33.667 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:04:03.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:04:03.829 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:04:33.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:04:33.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:05:04.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:05:04.133 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:05:34.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:05:34.314 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:06:04.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:06:04.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:06:34.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:06:34.729 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:07:04.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:07:04.924 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:07:35.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:07:35.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:08:05.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:08:05.261 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:08:35.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:08:35.431 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:09:05.613 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:09:05.619 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:09:35.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:09:35.805 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:10:05.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:10:05.989 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:10:36.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:10:36.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:11:06.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:11:06.329 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:11:36.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:11:36.495 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:12:06.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:12:06.685 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:12:36.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:12:36.857 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:13:07.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:13:07.054 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:13:37.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:13:37.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:14:07.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:14:07.359 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:14:37.517 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:14:37.523 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:15:07.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:15:07.733 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:15:37.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:15:37.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:16:08.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:16:08.106 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:16:38.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:16:38.212 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:17:08.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:17:08.336 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:17:16.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:16.430 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:17:16.477 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_23_00_UTC 2023-10-10T22:17:16.477 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_24_00_UTC 2023-10-10T22:17:16.478 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_25_00_UTC 2023-10-10T22:17:16.478 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_26_00_UTC 2023-10-10T22:17:16.478 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_27_00_UTC 2023-10-10T22:17:16.478 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_28_00_UTC 2023-10-10T22:17:16.478 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_29_00_UTC 2023-10-10T22:17:16.479 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_30_00_UTC 2023-10-10T22:17:16.479 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_31_00_UTC 2023-10-10T22:17:16.479 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_32_00_UTC 2023-10-10T22:17:16.479 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_33_00_UTC 2023-10-10T22:17:16.479 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_34_00_UTC 2023-10-10T22:17:16.480 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_35_00_UTC 2023-10-10T22:17:16.480 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_36_00_UTC 2023-10-10T22:17:16.480 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_37_00_UTC 2023-10-10T22:17:16.480 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_38_00_UTC 2023-10-10T22:17:16.480 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_39_00_UTC 2023-10-10T22:17:16.481 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_40_00_UTC 2023-10-10T22:17:16.481 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_41_00_UTC 2023-10-10T22:17:16.481 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_42_00_UTC 2023-10-10T22:17:16.481 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_43_00_UTC 2023-10-10T22:17:16.481 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_44_00_UTC 2023-10-10T22:17:16.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_45_00_UTC 2023-10-10T22:17:16.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_46_00_UTC 2023-10-10T22:17:16.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_47_00_UTC 2023-10-10T22:17:16.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_48_00_UTC 2023-10-10T22:17:16.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_49_00_UTC 2023-10-10T22:17:16.482 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_50_00_UTC 2023-10-10T22:17:16.483 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_51_00_UTC 2023-10-10T22:17:16.483 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_52_00_UTC 2023-10-10T22:17:16.483 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_53_00_UTC 2023-10-10T22:17:16.483 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_54_00_UTC 2023-10-10T22:17:16.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_55_00_UTC 2023-10-10T22:17:16.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_56_00_UTC 2023-10-10T22:17:16.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_57_00_UTC 2023-10-10T22:17:16.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_58_00_UTC 2023-10-10T22:17:16.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_59_00_UTC 2023-10-10T22:17:16.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_00_00_UTC 2023-10-10T22:17:16.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_01_00_UTC 2023-10-10T22:17:16.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_02_00_UTC 2023-10-10T22:17:16.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_03_00_UTC 2023-10-10T22:17:16.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_04_00_UTC 2023-10-10T22:17:16.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_05_00_UTC 2023-10-10T22:17:16.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_06_00_UTC 2023-10-10T22:17:16.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_07_00_UTC 2023-10-10T22:17:16.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_08_00_UTC 2023-10-10T22:17:16.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_09_00_UTC 2023-10-10T22:17:16.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_10_00_UTC 2023-10-10T22:17:16.487 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_11_00_UTC 2023-10-10T22:17:16.487 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_12_00_UTC 2023-10-10T22:17:16.487 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_13_00_UTC 2023-10-10T22:17:16.487 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_14_00_UTC 2023-10-10T22:17:16.487 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_15_00_UTC 2023-10-10T22:17:16.487 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_16_00_UTC 2023-10-10T22:17:16.488 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_17_00_UTC 2023-10-10T22:17:16.489 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-21_23_00_UTC', 'scheduled-2023-10-10-21_24_00_UTC', 'scheduled-2023-10-10-21_25_00_UTC', 'scheduled-2023-10-10-21_26_00_UTC', 'scheduled-2023-10-10-21_27_00_UTC', 'scheduled-2023-10-10-21_28_00_UTC', 'scheduled-2023-10-10-21_29_00_UTC', 'scheduled-2023-10-10-21_30_00_UTC', 'scheduled-2023-10-10-21_31_00_UTC', 'scheduled-2023-10-10-21_32_00_UTC', 'scheduled-2023-10-10-21_33_00_UTC', 'scheduled-2023-10-10-21_34_00_UTC', 'scheduled-2023-10-10-21_35_00_UTC', 'scheduled-2023-10-10-21_36_00_UTC', 'scheduled-2023-10-10-21_37_00_UTC', 'scheduled-2023-10-10-21_38_00_UTC', 'scheduled-2023-10-10-21_39_00_UTC', 'scheduled-2023-10-10-21_40_00_UTC', 'scheduled-2023-10-10-21_41_00_UTC', 'scheduled-2023-10-10-21_42_00_UTC', 'scheduled-2023-10-10-21_43_00_UTC', 'scheduled-2023-10-10-21_44_00_UTC', 'scheduled-2023-10-10-21_45_00_UTC', 'scheduled-2023-10-10-21_46_00_UTC', 'scheduled-2023-10-10-21_47_00_UTC', 'scheduled-2023-10-10-21_48_00_UTC', 'scheduled-2023-10-10-21_49_00_UTC', 'scheduled-2023-10-10-21_50_00_UTC', 'scheduled-2023-10-10-21_51_00_UTC', 'scheduled-2023-10-10-21_52_00_UTC', 'scheduled-2023-10-10-21_53_00_UTC', 'scheduled-2023-10-10-21_54_00_UTC', 'scheduled-2023-10-10-21_55_00_UTC', 'scheduled-2023-10-10-21_56_00_UTC', 'scheduled-2023-10-10-21_57_00_UTC', 'scheduled-2023-10-10-21_58_00_UTC', 'scheduled-2023-10-10-21_59_00_UTC', 'scheduled-2023-10-10-22_00_00_UTC', 'scheduled-2023-10-10-22_01_00_UTC', 'scheduled-2023-10-10-22_02_00_UTC', 'scheduled-2023-10-10-22_03_00_UTC', 'scheduled-2023-10-10-22_04_00_UTC', 'scheduled-2023-10-10-22_05_00_UTC', 'scheduled-2023-10-10-22_06_00_UTC', 'scheduled-2023-10-10-22_07_00_UTC', 'scheduled-2023-10-10-22_08_00_UTC', 'scheduled-2023-10-10-22_09_00_UTC', 'scheduled-2023-10-10-22_10_00_UTC', 'scheduled-2023-10-10-22_11_00_UTC', 'scheduled-2023-10-10-22_12_00_UTC', 'scheduled-2023-10-10-22_13_00_UTC', 'scheduled-2023-10-10-22_14_00_UTC', 'scheduled-2023-10-10-22_15_00_UTC', 'scheduled-2023-10-10-22_16_00_UTC', 'scheduled-2023-10-10-22_17_00_UTC'] 2023-10-10T22:17:16.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-10-10T22:17:16.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.678+0000 7f006e7ff700 1 Processor -- start 2023-10-10T22:17:16.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.678+0000 7f006e7ff700 1 -- start start 2023-10-10T22:17:16.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f006e7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f00681563b0 0x7f0068156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:16.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f006e7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f006815a440 0x7f00680acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:16.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f006e7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006815a9b0 con 0x7f0068068890 2023-10-10T22:17:16.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f006e7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006815ac90 con 0x7f006815a440 2023-10-10T22:17:16.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f006e7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006815af70 con 0x7f00681563b0 2023-10-10T22:17:16.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f00677fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f006815a440 0x7f00680acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:16.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f006cd9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0068068890 0x7f00680c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57404/0 (socket says 172.21.15.154:57404) 2023-10-10T22:17:16.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f006cd9c700 1 -- 172.21.15.154:0/1245958342 learned_addr learned my addr 172.21.15.154:0/1245958342 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:16.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f0067fff700 1 --2- 172.21.15.154:0/1245958342 >> v2:172.21.15.179:3300/0 conn(0x7f00681563b0 0x7f0068156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:16.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f00677fe700 1 -- 172.21.15.154:0/1245958342 >> v2:172.21.15.179:3300/0 conn(0x7f00681563b0 msgr2=0x7f0068156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:16.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f00677fe700 1 --2- 172.21.15.154:0/1245958342 >> v2:172.21.15.179:3300/0 conn(0x7f00681563b0 0x7f0068156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f00677fe700 1 -- 172.21.15.154:0/1245958342 >> v1:172.21.15.154:6789/0 conn(0x7f0068068890 legacy=0x7f00680c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:16.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f00677fe700 1 -- 172.21.15.154:0/1245958342 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006815b250 con 0x7f006815a440 2023-10-10T22:17:16.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.680+0000 7f0066ffd700 1 -- 172.21.15.154:0/1245958342 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938073473 0 0) 0x7f006815a9b0 con 0x7f0068068890 2023-10-10T22:17:16.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.681+0000 7f00677fe700 1 --2- 172.21.15.154:0/1245958342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 0x7f00680acf30 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f006806a9f0 tx=0x7f005c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21d866578517d52 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:16.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.681+0000 7f0066ffd700 1 -- 172.21.15.154:0/1245958342 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c011630 con 0x7f006815a440 2023-10-10T22:17:16.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.681+0000 7f0066ffd700 1 -- 172.21.15.154:0/1245958342 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c011790 con 0x7f006815a440 2023-10-10T22:17:16.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.681+0000 7f0066ffd700 1 -- 172.21.15.154:0/1245958342 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c011b30 con 0x7f006815a440 2023-10-10T22:17:16.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.681+0000 7f006e7ff700 1 -- 172.21.15.154:0/1245958342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 msgr2=0x7f00680acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:16.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.681+0000 7f006e7ff700 1 --2- 172.21.15.154:0/1245958342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 0x7f00680acf30 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f006806a9f0 tx=0x7f005c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.682+0000 7f006e7ff700 1 -- 172.21.15.154:0/1245958342 shutdown_connections 2023-10-10T22:17:16.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.682+0000 7f006e7ff700 1 --2- 172.21.15.154:0/1245958342 >> v2:172.21.15.179:3300/0 conn(0x7f00681563b0 0x7f0068156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.682+0000 7f006e7ff700 1 --2- 172.21.15.154:0/1245958342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 0x7f00680acf30 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.682+0000 7f006e7ff700 1 -- 172.21.15.154:0/1245958342 >> 172.21.15.154:0/1245958342 conn(0x7f00680c8f90 msgr2=0x7f00680c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:16.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.682+0000 7f006e7ff700 1 -- 172.21.15.154:0/1245958342 shutdown_connections 2023-10-10T22:17:16.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.682+0000 7f006e7ff700 1 -- 172.21.15.154:0/1245958342 wait complete. 2023-10-10T22:17:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.683+0000 7f006e7ff700 1 Processor -- start 2023-10-10T22:17:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.683+0000 7f006e7ff700 1 -- start start 2023-10-10T22:17:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.684+0000 7f006e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0068068890 0x7f006814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.684+0000 7f006e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00681563b0 0x7f00680c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.684+0000 7f006e7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 0x7f006806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.684+0000 7f006e7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006814ee20 con 0x7f006815a440 2023-10-10T22:17:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.684+0000 7f006e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680b0cb0 con 0x7f00681563b0 2023-10-10T22:17:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.684+0000 7f006e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680b00a0 con 0x7f0068068890 2023-10-10T22:17:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.684+0000 7f006cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 0x7f006806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f006cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 0x7f006806dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57282/0 (socket says 172.21.15.154:57282) 2023-10-10T22:17:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f006cd9c700 1 -- 172.21.15.154:0/1439829365 learned_addr learned my addr 172.21.15.154:0/1439829365 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:16.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f0067fff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0068068890 0x7f006814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:16.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f00677fe700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00681563b0 0x7f00680c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:16.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f006cd9c700 1 -- 172.21.15.154:0/1439829365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0068068890 msgr2=0x7f006814e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:16.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f006cd9c700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0068068890 0x7f006814e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f006cd9c700 1 -- 172.21.15.154:0/1439829365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00681563b0 msgr2=0x7f00680c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:16.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f006cd9c700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00681563b0 0x7f00680c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f006cd9c700 1 -- 172.21.15.154:0/1439829365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c009420 con 0x7f006815a440 2023-10-10T22:17:16.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f006cd9c700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 0x7f006806dea0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f006000ccc0 tx=0x7f0060001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:16.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f004ffff700 1 -- 172.21.15.154:0/1439829365 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000ab30 con 0x7f006815a440 2023-10-10T22:17:16.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f004ffff700 1 -- 172.21.15.154:0/1439829365 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006000ac90 con 0x7f006815a440 2023-10-10T22:17:16.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00680b0380 con 0x7f006815a440 2023-10-10T22:17:16.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.685+0000 7f004ffff700 1 -- 172.21.15.154:0/1439829365 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060007340 con 0x7f006815a440 2023-10-10T22:17:16.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.686+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00680b0940 con 0x7f006815a440 2023-10-10T22:17:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.686+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00680b0e40 con 0x7f006815a440 2023-10-10T22:17:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.687+0000 7f004ffff700 1 -- 172.21.15.154:0/1439829365 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 69) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f00600076f0 con 0x7f006815a440 2023-10-10T22:17:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.689+0000 7f004ffff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f00540670a0 0x7f0054069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.689+0000 7f004ffff700 1 -- 172.21.15.154:0/1439829365 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f0060084f70 con 0x7f006815a440 2023-10-10T22:17:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.689+0000 7f0067fff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f00540670a0 0x7f0054069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.689+0000 7f0067fff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f00540670a0 0x7f0054069550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f006806dc30 tx=0x7f0058008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.693+0000 7f004ffff700 1 -- 172.21.15.154:0/1439829365 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0060051da0 con 0x7f006815a440 2023-10-10T22:17:16.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.907+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00680718b0 con 0x7f00540670a0 2023-10-10T22:17:16.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.917+0000 7f004ffff700 1 -- 172.21.15.154:0/1439829365 <== mgr.8376 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f00680718b0 con 0x7f00540670a0 2023-10-10T22:17:16.919 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:16.919 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:21:43", "first": "2023-10-10T21:22:00", "last": "2023-10-10T22:17:00", "last_pruned": "2023-10-10T22:17:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-10T22:17:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.919+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f00540670a0 msgr2=0x7f0054069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.919+0000 7f006e7ff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f00540670a0 0x7f0054069550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f006806dc30 tx=0x7f0058008040 comp rx=0 tx=0).stop 2023-10-10T22:17:16.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.919+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 msgr2=0x7f006806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:16.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.919+0000 7f006e7ff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 0x7f006806dea0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f006000ccc0 tx=0x7f0060001a80 comp rx=0 tx=0).stop 2023-10-10T22:17:16.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.919+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 shutdown_connections 2023-10-10T22:17:16.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.920+0000 7f006e7ff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f00540670a0 0x7f0054069550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.920+0000 7f006e7ff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f006815a440 0x7f006806dea0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.920+0000 7f006e7ff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0068068890 0x7f006814e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.920+0000 7f006e7ff700 1 --2- 172.21.15.154:0/1439829365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00681563b0 0x7f00680c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:16.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.920+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 >> 172.21.15.154:0/1439829365 conn(0x7f00680c8f90 msgr2=0x7f0068154330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:16.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.920+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 shutdown_connections 2023-10-10T22:17:16.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:16.920+0000 7f006e7ff700 1 -- 172.21.15.154:0/1439829365 wait complete. 2023-10-10T22:17:16.939 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T21:21:43", "first": "2023-10-10T21:22:00", "last": "2023-10-10T22:17:00", "last_pruned": "2023-10-10T22:17:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-10T22:17:16.941 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T21:21:43', 'first': '2023-10-10T21:22:00', 'last': '2023-10-10T22:17:00', 'last_pruned': '2023-10-10T22:17:00', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-10-10T22:17:16.941 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-10-10T22:17:16.942 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-10-10T22:17:16.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-10-10T22:17:17.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.128+0000 7f4ca639d700 1 Processor -- start 2023-10-10T22:17:17.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.128+0000 7f4ca639d700 1 -- start start 2023-10-10T22:17:17.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.129+0000 7f4ca639d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4ca015d3f0 0x7f4ca01538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:17.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.129+0000 7f4ca639d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca0153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:17.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.129+0000 7f4ca639d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca00c9480 con 0x7f4ca00685e0 2023-10-10T22:17:17.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.129+0000 7f4ca639d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca015ae00 con 0x7f4ca015d3f0 2023-10-10T22:17:17.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.129+0000 7f4ca639d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca015d880 con 0x7f4ca00689b0 2023-10-10T22:17:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.130+0000 7f4ca5b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca0153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.130+0000 7f4ca4b9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4ca015d3f0 0x7f4ca01538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.130+0000 7f4ca539b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4ca00685e0 0x7f4ca015a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:49692/0 (socket says 172.21.15.154:49692) 2023-10-10T22:17:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.130+0000 7f4ca4b9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4ca015d3f0 0x7f4ca01538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:37092/0 (socket says 172.21.15.154:37092) 2023-10-10T22:17:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.130+0000 7f4ca539b700 1 -- 172.21.15.154:0/2786478613 learned_addr learned my addr 172.21.15.154:0/2786478613 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.131+0000 7f4ca4b9a700 1 -- 172.21.15.154:0/2786478613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 msgr2=0x7f4ca0153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.131+0000 7f4ca4b9a700 1 --2- 172.21.15.154:0/2786478613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca0153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.131+0000 7f4ca4b9a700 1 -- 172.21.15.154:0/2786478613 >> v1:172.21.15.179:6789/0 conn(0x7f4ca00685e0 legacy=0x7f4ca015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.131+0000 7f4ca4b9a700 1 -- 172.21.15.154:0/2786478613 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca015db60 con 0x7f4ca015d3f0 2023-10-10T22:17:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.131+0000 7f4ca5b9c700 1 --2- 172.21.15.154:0/2786478613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca0153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.131+0000 7f4c97fff700 1 -- 172.21.15.154:0/2786478613 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867896953 0 0) 0x7f4ca00c9480 con 0x7f4ca00685e0 2023-10-10T22:17:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.131+0000 7f4ca4b9a700 1 --2- 172.21.15.154:0/2786478613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca015d3f0 0x7f4ca01538f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4c900098d0 tx=0x7f4c90009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56bf5737fcf23dc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.131+0000 7f4c97fff700 1 -- 172.21.15.154:0/2786478613 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90005c10 con 0x7f4ca015d3f0 2023-10-10T22:17:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.131+0000 7f4c97fff700 1 -- 172.21.15.154:0/2786478613 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c90005d70 con 0x7f4ca015d3f0 2023-10-10T22:17:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.132+0000 7f4c97fff700 1 -- 172.21.15.154:0/2786478613 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90006280 con 0x7f4ca015d3f0 2023-10-10T22:17:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.132+0000 7f4ca639d700 1 -- 172.21.15.154:0/2786478613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca015d3f0 msgr2=0x7f4ca01538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.132+0000 7f4ca639d700 1 --2- 172.21.15.154:0/2786478613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca015d3f0 0x7f4ca01538f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4c900098d0 tx=0x7f4c90009120 comp rx=0 tx=0).stop 2023-10-10T22:17:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.132+0000 7f4ca639d700 1 -- 172.21.15.154:0/2786478613 shutdown_connections 2023-10-10T22:17:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.132+0000 7f4ca639d700 1 --2- 172.21.15.154:0/2786478613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca0153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.132+0000 7f4ca639d700 1 --2- 172.21.15.154:0/2786478613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca015d3f0 0x7f4ca01538f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.132+0000 7f4ca639d700 1 -- 172.21.15.154:0/2786478613 >> 172.21.15.154:0/2786478613 conn(0x7f4ca006b420 msgr2=0x7f4ca00cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:17.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.132+0000 7f4ca639d700 1 -- 172.21.15.154:0/2786478613 shutdown_connections 2023-10-10T22:17:17.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.132+0000 7f4ca639d700 1 -- 172.21.15.154:0/2786478613 wait complete. 2023-10-10T22:17:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.134+0000 7f4ca639d700 1 Processor -- start 2023-10-10T22:17:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.134+0000 7f4ca639d700 1 -- start start 2023-10-10T22:17:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.134+0000 7f4ca639d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ca00685e0 0x7f4ca00c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca639d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca639d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca015d3f0 0x7f4ca0145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca639d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00b1920 con 0x7f4ca00685e0 2023-10-10T22:17:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca639d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0151510 con 0x7f4ca015d3f0 2023-10-10T22:17:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca639d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00b0d50 con 0x7f4ca00689b0 2023-10-10T22:17:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca539b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ca00685e0 0x7f4ca00c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca539b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ca00685e0 0x7f4ca00c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57284/0 (socket says 172.21.15.154:57284) 2023-10-10T22:17:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca539b700 1 -- 172.21.15.154:0/3552418265 learned_addr learned my addr 172.21.15.154:0/3552418265 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca5b9c700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca015d3f0 0x7f4ca0145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca4b9a700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca539b700 1 -- 172.21.15.154:0/3552418265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 msgr2=0x7f4ca015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca539b700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca539b700 1 -- 172.21.15.154:0/3552418265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca015d3f0 msgr2=0x7f4ca0145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca539b700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca015d3f0 0x7f4ca0145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca539b700 1 -- 172.21.15.154:0/3552418265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c98009a20 con 0x7f4ca00685e0 2023-10-10T22:17:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.135+0000 7f4ca4b9a700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:17.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.136+0000 7f4ca539b700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ca00685e0 0x7f4ca00c44c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c7e0 tx=0x7f4c9c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:17.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.136+0000 7f4c957fa700 1 -- 172.21.15.154:0/3552418265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c005b30 con 0x7f4ca00685e0 2023-10-10T22:17:17.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.136+0000 7f4c957fa700 1 -- 172.21.15.154:0/3552418265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c005c90 con 0x7f4ca00685e0 2023-10-10T22:17:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.136+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c900093c0 con 0x7f4ca00685e0 2023-10-10T22:17:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.136+0000 7f4c957fa700 1 -- 172.21.15.154:0/3552418265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c007300 con 0x7f4ca00685e0 2023-10-10T22:17:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.136+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca00b12d0 con 0x7f4ca00685e0 2023-10-10T22:17:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.137+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca004c3c0 con 0x7f4ca00685e0 2023-10-10T22:17:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.138+0000 7f4c957fa700 1 -- 172.21.15.154:0/3552418265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 69) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f4c9c01b400 con 0x7f4ca00685e0 2023-10-10T22:17:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.139+0000 7f4c957fa700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4c840670a0 0x7f4c84069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.139+0000 7f4c957fa700 1 -- 172.21.15.154:0/3552418265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f4c9c084640 con 0x7f4ca00685e0 2023-10-10T22:17:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.139+0000 7f4ca4b9a700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4c840670a0 0x7f4c84069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.140+0000 7f4ca4b9a700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4c840670a0 0x7f4c84069550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c900098d0 tx=0x7f4c90016000 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.143+0000 7f4c957fa700 1 -- 172.21.15.154:0/3552418265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c9c0513f0 con 0x7f4ca00685e0 2023-10-10T22:17:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.357+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ca00b1a60 con 0x7f4c840670a0 2023-10-10T22:17:17.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.438+0000 7f4c957fa700 1 -- 172.21.15.154:0/3552418265 <== mgr.8376 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7f4c900065f0 con 0x7f4c840670a0 2023-10-10T22:17:17.440 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1 2023-10-10T22:17:17.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4c840670a0 msgr2=0x7f4c84069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:17.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4c840670a0 0x7f4c84069550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c900098d0 tx=0x7f4c90016000 comp rx=0 tx=0).stop 2023-10-10T22:17:17.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ca00685e0 msgr2=0x7f4ca00c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:17.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ca00685e0 0x7f4ca00c44c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c7e0 tx=0x7f4c9c007df0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 shutdown_connections 2023-10-10T22:17:17.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca015d3f0 0x7f4ca0145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4c840670a0 0x7f4c84069550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ca00685e0 0x7f4ca00c44c0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 --2- 172.21.15.154:0/3552418265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ca00689b0 0x7f4ca015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.440+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 >> 172.21.15.154:0/3552418265 conn(0x7f4ca006b420 msgr2=0x7f4ca0151740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.441+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 shutdown_connections 2023-10-10T22:17:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:17.441+0000 7f4ca639d700 1 -- 172.21.15.154:0/3552418265 wait complete. 2023-10-10T22:17:17.459 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-10-10T22:17:17.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:17.460 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:17:17.500 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_23_00_UTC 2023-10-10T22:17:17.500 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_24_00_UTC 2023-10-10T22:17:17.501 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_25_00_UTC 2023-10-10T22:17:17.501 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_26_00_UTC 2023-10-10T22:17:17.501 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_27_00_UTC 2023-10-10T22:17:17.501 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_28_00_UTC 2023-10-10T22:17:17.501 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_29_00_UTC 2023-10-10T22:17:17.502 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_30_00_UTC 2023-10-10T22:17:17.502 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_31_00_UTC 2023-10-10T22:17:17.502 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_32_00_UTC 2023-10-10T22:17:17.502 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_33_00_UTC 2023-10-10T22:17:17.502 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_34_00_UTC 2023-10-10T22:17:17.503 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_35_00_UTC 2023-10-10T22:17:17.503 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_36_00_UTC 2023-10-10T22:17:17.503 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_37_00_UTC 2023-10-10T22:17:17.503 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_38_00_UTC 2023-10-10T22:17:17.503 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_39_00_UTC 2023-10-10T22:17:17.503 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_40_00_UTC 2023-10-10T22:17:17.504 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_41_00_UTC 2023-10-10T22:17:17.504 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_42_00_UTC 2023-10-10T22:17:17.504 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_43_00_UTC 2023-10-10T22:17:17.504 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_44_00_UTC 2023-10-10T22:17:17.504 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_45_00_UTC 2023-10-10T22:17:17.505 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_46_00_UTC 2023-10-10T22:17:17.505 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_47_00_UTC 2023-10-10T22:17:17.505 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_48_00_UTC 2023-10-10T22:17:17.505 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_49_00_UTC 2023-10-10T22:17:17.505 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_50_00_UTC 2023-10-10T22:17:17.506 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_51_00_UTC 2023-10-10T22:17:17.506 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_52_00_UTC 2023-10-10T22:17:17.506 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_53_00_UTC 2023-10-10T22:17:17.506 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_54_00_UTC 2023-10-10T22:17:17.506 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_55_00_UTC 2023-10-10T22:17:17.507 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_56_00_UTC 2023-10-10T22:17:17.507 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_57_00_UTC 2023-10-10T22:17:17.507 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_58_00_UTC 2023-10-10T22:17:17.507 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-21_59_00_UTC 2023-10-10T22:17:17.507 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_00_00_UTC 2023-10-10T22:17:17.507 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_01_00_UTC 2023-10-10T22:17:17.508 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_02_00_UTC 2023-10-10T22:17:17.508 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_03_00_UTC 2023-10-10T22:17:17.508 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_04_00_UTC 2023-10-10T22:17:17.508 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_05_00_UTC 2023-10-10T22:17:17.508 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_06_00_UTC 2023-10-10T22:17:17.509 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_07_00_UTC 2023-10-10T22:17:17.509 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_08_00_UTC 2023-10-10T22:17:17.509 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_09_00_UTC 2023-10-10T22:17:17.509 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_10_00_UTC 2023-10-10T22:17:17.509 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_11_00_UTC 2023-10-10T22:17:17.509 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_12_00_UTC 2023-10-10T22:17:17.510 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_13_00_UTC 2023-10-10T22:17:17.510 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_14_00_UTC 2023-10-10T22:17:17.510 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_15_00_UTC 2023-10-10T22:17:17.510 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_16_00_UTC 2023-10-10T22:17:17.510 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_17_00_UTC 2023-10-10T22:17:17.511 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_23_00_UTC 2023-10-10T22:17:17.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:17.512 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_23_00_UTC) 2023-10-10T22:17:17.596 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_24_00_UTC 2023-10-10T22:17:17.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:17.597 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_24_00_UTC) 2023-10-10T22:17:17.679 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_25_00_UTC 2023-10-10T22:17:17.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:17.680 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_25_00_UTC) 2023-10-10T22:17:17.763 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_26_00_UTC 2023-10-10T22:17:17.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:17.764 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_26_00_UTC) 2023-10-10T22:17:17.846 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_27_00_UTC 2023-10-10T22:17:17.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:17.847 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_27_00_UTC) 2023-10-10T22:17:17.930 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_28_00_UTC 2023-10-10T22:17:17.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:17.931 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_28_00_UTC) 2023-10-10T22:17:18.013 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_29_00_UTC 2023-10-10T22:17:18.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.014 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_29_00_UTC) 2023-10-10T22:17:18.097 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_30_00_UTC 2023-10-10T22:17:18.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.098 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_30_00_UTC) 2023-10-10T22:17:18.180 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_31_00_UTC 2023-10-10T22:17:18.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.181 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_31_00_UTC) 2023-10-10T22:17:18.263 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_32_00_UTC 2023-10-10T22:17:18.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.264 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_32_00_UTC) 2023-10-10T22:17:18.346 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_33_00_UTC 2023-10-10T22:17:18.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.347 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_33_00_UTC) 2023-10-10T22:17:18.429 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_34_00_UTC 2023-10-10T22:17:18.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.430 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_34_00_UTC) 2023-10-10T22:17:18.514 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_35_00_UTC 2023-10-10T22:17:18.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.515 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_35_00_UTC) 2023-10-10T22:17:18.598 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_36_00_UTC 2023-10-10T22:17:18.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.599 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_36_00_UTC) 2023-10-10T22:17:18.681 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_37_00_UTC 2023-10-10T22:17:18.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.682 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_37_00_UTC) 2023-10-10T22:17:18.765 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_38_00_UTC 2023-10-10T22:17:18.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.765 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_38_00_UTC) 2023-10-10T22:17:18.848 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_39_00_UTC 2023-10-10T22:17:18.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.850 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_39_00_UTC) 2023-10-10T22:17:18.931 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_40_00_UTC 2023-10-10T22:17:18.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:18.932 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_40_00_UTC) 2023-10-10T22:17:19.015 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_41_00_UTC 2023-10-10T22:17:19.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.016 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_41_00_UTC) 2023-10-10T22:17:19.098 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_42_00_UTC 2023-10-10T22:17:19.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.099 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_42_00_UTC) 2023-10-10T22:17:19.183 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_43_00_UTC 2023-10-10T22:17:19.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.184 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_43_00_UTC) 2023-10-10T22:17:19.267 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_44_00_UTC 2023-10-10T22:17:19.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.268 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_44_00_UTC) 2023-10-10T22:17:19.351 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_45_00_UTC 2023-10-10T22:17:19.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.352 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_45_00_UTC) 2023-10-10T22:17:19.434 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_46_00_UTC 2023-10-10T22:17:19.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.435 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_46_00_UTC) 2023-10-10T22:17:19.517 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_47_00_UTC 2023-10-10T22:17:19.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.518 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_47_00_UTC) 2023-10-10T22:17:19.602 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_48_00_UTC 2023-10-10T22:17:19.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.603 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_48_00_UTC) 2023-10-10T22:17:19.686 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_49_00_UTC 2023-10-10T22:17:19.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.687 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_49_00_UTC) 2023-10-10T22:17:19.769 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_50_00_UTC 2023-10-10T22:17:19.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.770 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_50_00_UTC) 2023-10-10T22:17:19.852 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_51_00_UTC 2023-10-10T22:17:19.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.853 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_51_00_UTC) 2023-10-10T22:17:19.936 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_52_00_UTC 2023-10-10T22:17:19.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:19.937 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_52_00_UTC) 2023-10-10T22:17:20.020 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_53_00_UTC 2023-10-10T22:17:20.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.021 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_53_00_UTC) 2023-10-10T22:17:20.104 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_54_00_UTC 2023-10-10T22:17:20.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.105 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_54_00_UTC) 2023-10-10T22:17:20.187 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_55_00_UTC 2023-10-10T22:17:20.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.188 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_55_00_UTC) 2023-10-10T22:17:20.270 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_56_00_UTC 2023-10-10T22:17:20.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.271 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_56_00_UTC) 2023-10-10T22:17:20.353 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_57_00_UTC 2023-10-10T22:17:20.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.354 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_57_00_UTC) 2023-10-10T22:17:20.436 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_58_00_UTC 2023-10-10T22:17:20.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.437 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_58_00_UTC) 2023-10-10T22:17:20.519 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-21_59_00_UTC 2023-10-10T22:17:20.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.520 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-21_59_00_UTC) 2023-10-10T22:17:20.602 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_00_00_UTC 2023-10-10T22:17:20.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.603 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_00_00_UTC) 2023-10-10T22:17:20.685 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_01_00_UTC 2023-10-10T22:17:20.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.686 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_01_00_UTC) 2023-10-10T22:17:20.769 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_02_00_UTC 2023-10-10T22:17:20.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.770 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_02_00_UTC) 2023-10-10T22:17:20.852 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_03_00_UTC 2023-10-10T22:17:20.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.853 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_03_00_UTC) 2023-10-10T22:17:20.935 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_04_00_UTC 2023-10-10T22:17:20.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:20.936 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_04_00_UTC) 2023-10-10T22:17:21.019 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_05_00_UTC 2023-10-10T22:17:21.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.019 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_05_00_UTC) 2023-10-10T22:17:21.103 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_06_00_UTC 2023-10-10T22:17:21.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.103 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_06_00_UTC) 2023-10-10T22:17:21.187 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_07_00_UTC 2023-10-10T22:17:21.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.187 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_07_00_UTC) 2023-10-10T22:17:21.271 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_08_00_UTC 2023-10-10T22:17:21.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.272 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_08_00_UTC) 2023-10-10T22:17:21.354 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_09_00_UTC 2023-10-10T22:17:21.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.355 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_09_00_UTC) 2023-10-10T22:17:21.437 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_10_00_UTC 2023-10-10T22:17:21.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.437 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_10_00_UTC) 2023-10-10T22:17:21.520 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_11_00_UTC 2023-10-10T22:17:21.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.521 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_11_00_UTC) 2023-10-10T22:17:21.605 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_12_00_UTC 2023-10-10T22:17:21.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.605 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_12_00_UTC) 2023-10-10T22:17:21.689 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_13_00_UTC 2023-10-10T22:17:21.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.690 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_13_00_UTC) 2023-10-10T22:17:21.773 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_14_00_UTC 2023-10-10T22:17:21.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.774 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_14_00_UTC) 2023-10-10T22:17:21.857 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_15_00_UTC 2023-10-10T22:17:21.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.858 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_15_00_UTC) 2023-10-10T22:17:21.941 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_16_00_UTC 2023-10-10T22:17:21.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:21.941 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_16_00_UTC) 2023-10-10T22:17:22.057 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_17_00_UTC 2023-10-10T22:17:22.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:22.058 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_17_00_UTC) 2023-10-10T22:17:22.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:22.110 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-10T22:17:22.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T22:17:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.387+0000 7fecc7fff700 1 Processor -- start 2023-10-10T22:17:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.387+0000 7fecc7fff700 1 -- start start 2023-10-10T22:17:22.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fecc8153880 0x7fecc81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:22.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecc8153c50 0x7fecc80b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:22.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc80b07d0 0x7fecc8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:22.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc7fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc8158640 con 0x7fecc8153c50 2023-10-10T22:17:22.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc8157a30 con 0x7fecc8153880 2023-10-10T22:17:22.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc8157d10 con 0x7fecc80b07d0 2023-10-10T22:17:22.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecc8153c50 0x7fecc80b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:22.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecc8153c50 0x7fecc80b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57300/0 (socket says 172.21.15.154:57300) 2023-10-10T22:17:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc67fc700 1 -- 172.21.15.154:0/1864688903 learned_addr learned my addr 172.21.15.154:0/1864688903 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc77fe700 1 --2- 172.21.15.154:0/1864688903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc80b07d0 0x7fecc8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc6ffd700 1 --2- 172.21.15.154:0/1864688903 >> v2:172.21.15.179:3300/0 conn(0x7fecc8153880 0x7fecc81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc67fc700 1 -- 172.21.15.154:0/1864688903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc80b07d0 msgr2=0x7fecc8159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc67fc700 1 --2- 172.21.15.154:0/1864688903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc80b07d0 0x7fecc8159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.389+0000 7fecc67fc700 1 -- 172.21.15.154:0/1864688903 >> v2:172.21.15.179:3300/0 conn(0x7fecc8153880 msgr2=0x7fecc81540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.390+0000 7fecc67fc700 1 --2- 172.21.15.154:0/1864688903 >> v2:172.21.15.179:3300/0 conn(0x7fecc8153880 0x7fecc81540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.390+0000 7fecc67fc700 1 -- 172.21.15.154:0/1864688903 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8157ff0 con 0x7fecc8153c50 2023-10-10T22:17:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.390+0000 7fecc67fc700 1 --2- 172.21.15.154:0/1864688903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 0x7fecc80b0290 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fecc806c080 tx=0x7fecbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ef00b442755c90 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:22.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.390+0000 7fecc5ffb700 1 -- 172.21.15.154:0/1864688903 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00b640 con 0x7fecc8153c50 2023-10-10T22:17:22.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.390+0000 7fecc5ffb700 1 -- 172.21.15.154:0/1864688903 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc00b7a0 con 0x7fecc8153c50 2023-10-10T22:17:22.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.390+0000 7fecc5ffb700 1 -- 172.21.15.154:0/1864688903 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00bb60 con 0x7fecc8153c50 2023-10-10T22:17:22.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.391+0000 7fecc7fff700 1 -- 172.21.15.154:0/1864688903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 msgr2=0x7fecc80b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:22.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.391+0000 7fecc7fff700 1 --2- 172.21.15.154:0/1864688903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 0x7fecc80b0290 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fecc806c080 tx=0x7fecbc009250 comp rx=0 tx=0).stop 2023-10-10T22:17:22.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.391+0000 7fecc7fff700 1 -- 172.21.15.154:0/1864688903 shutdown_connections 2023-10-10T22:17:22.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.391+0000 7fecc7fff700 1 --2- 172.21.15.154:0/1864688903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc80b07d0 0x7fecc8159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:22.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.391+0000 7fecc7fff700 1 --2- 172.21.15.154:0/1864688903 >> v2:172.21.15.179:3300/0 conn(0x7fecc8153880 0x7fecc81540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:22.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.391+0000 7fecc7fff700 1 --2- 172.21.15.154:0/1864688903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 0x7fecc80b0290 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:22.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.391+0000 7fecc7fff700 1 -- 172.21.15.154:0/1864688903 >> 172.21.15.154:0/1864688903 conn(0x7fecc8068390 msgr2=0x7fecc8068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:22.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.391+0000 7fecc7fff700 1 -- 172.21.15.154:0/1864688903 shutdown_connections 2023-10-10T22:17:22.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.391+0000 7fecc7fff700 1 -- 172.21.15.154:0/1864688903 wait complete. 2023-10-10T22:17:22.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.392+0000 7fecc7fff700 1 Processor -- start 2023-10-10T22:17:22.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.392+0000 7fecc7fff700 1 -- start start 2023-10-10T22:17:22.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.393+0000 7fecc7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc80b07d0 0x7fecc80c1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:22.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.393+0000 7fecc7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc8153880 0x7fecc8169220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.393+0000 7fecc7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 0x7fecc806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.393+0000 7fecc7fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80c1d70 con 0x7fecc8153c50 2023-10-10T22:17:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.393+0000 7fecc7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc814ec90 con 0x7fecc80b07d0 2023-10-10T22:17:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.393+0000 7fecc7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80c1ff0 con 0x7fecc8153880 2023-10-10T22:17:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.393+0000 7fecc77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 0x7fecc806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:22.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.393+0000 7fecc77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 0x7fecc806d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57314/0 (socket says 172.21.15.154:57314) 2023-10-10T22:17:22.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.393+0000 7fecc77fe700 1 -- 172.21.15.154:0/2314991871 learned_addr learned my addr 172.21.15.154:0/2314991871 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:22.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc67fc700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc8153880 0x7fecc8169220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:22.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc6ffd700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc80b07d0 0x7fecc80c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:22.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc77fe700 1 -- 172.21.15.154:0/2314991871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc8153880 msgr2=0x7fecc8169220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc77fe700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc8153880 0x7fecc8169220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc77fe700 1 -- 172.21.15.154:0/2314991871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc80b07d0 msgr2=0x7fecc80c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc77fe700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc80b07d0 0x7fecc80c1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc77fe700 1 -- 172.21.15.154:0/2314991871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc0094f0 con 0x7fecc8153c50 2023-10-10T22:17:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc77fe700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 0x7fecc806d4f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009ef0 tx=0x7fecc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecaeffd700 1 -- 172.21.15.154:0/2314991871 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc000cc50 con 0x7fecc8153c50 2023-10-10T22:17:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecaeffd700 1 -- 172.21.15.154:0/2314991871 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc000f040 con 0x7fecc8153c50 2023-10-10T22:17:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecaeffd700 1 -- 172.21.15.154:0/2314991871 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0014480 con 0x7fecc8153c50 2023-10-10T22:17:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc814ef30 con 0x7fecc8153c50 2023-10-10T22:17:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.394+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc814f4f0 con 0x7fecc8153c50 2023-10-10T22:17:22.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.396+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc814f6e0 con 0x7fecc8153c50 2023-10-10T22:17:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.396+0000 7fecaeffd700 1 -- 172.21.15.154:0/2314991871 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 69) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fecc0014830 con 0x7fecc8153c50 2023-10-10T22:17:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.397+0000 7fecaeffd700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fecb40670a0 0x7fecb4069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.397+0000 7fecaeffd700 1 -- 172.21.15.154:0/2314991871 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fecc0085900 con 0x7fecc8153c50 2023-10-10T22:17:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.398+0000 7fecc6ffd700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fecb40670a0 0x7fecb4069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.398+0000 7fecc6ffd700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fecb40670a0 0x7fecb4069550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecb80093f0 tx=0x7fecb8008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:22.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.402+0000 7fecaeffd700 1 -- 172.21.15.154:0/2314991871 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecc0052610 con 0x7fecc8153c50 2023-10-10T22:17:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.671+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fecc814e9e0 con 0x7fecc8153c50 2023-10-10T22:17:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.996+0000 7fecaeffd700 1 -- 172.21.15.154:0/2314991871 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fecc0083ad0 con 0x7fecc8153c50 2023-10-10T22:17:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:22.998+0000 7fecaeffd700 1 -- 172.21.15.154:0/2314991871 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v70) v1 ==== 93+0+0 (secure 0 0 0) 0x7fecc0052610 con 0x7fecc8153c50 2023-10-10T22:17:23.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.002+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fecb40670a0 msgr2=0x7fecb4069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:23.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.002+0000 7fecc7fff700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fecb40670a0 0x7fecb4069550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecb80093f0 tx=0x7fecb8008040 comp rx=0 tx=0).stop 2023-10-10T22:17:23.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.002+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 msgr2=0x7fecc806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:23.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.002+0000 7fecc7fff700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 0x7fecc806d4f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009ef0 tx=0x7fecc000b040 comp rx=0 tx=0).stop 2023-10-10T22:17:23.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.002+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 shutdown_connections 2023-10-10T22:17:23.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.002+0000 7fecc7fff700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fecb40670a0 0x7fecb4069550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.002+0000 7fecc7fff700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc8153c50 0x7fecc806d4f0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.002+0000 7fecc7fff700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc80b07d0 0x7fecc80c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.003+0000 7fecc7fff700 1 --2- 172.21.15.154:0/2314991871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecc8153880 0x7fecc8169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.003+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 >> 172.21.15.154:0/2314991871 conn(0x7fecc8068390 msgr2=0x7fecc80cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:23.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.003+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 shutdown_connections 2023-10-10T22:17:23.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.003+0000 7fecc7fff700 1 -- 172.21.15.154:0/2314991871 wait complete. 2023-10-10T22:17:23.036 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T22:17:23.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:17:23.117 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:17:23.203 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T22:17:23.203 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T22:17:23.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:23.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T22:17:23.303 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:17:23.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:17:23.304 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T22:17:23.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:17:23.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.569+0000 7ff1fa79d700 1 Processor -- start 2023-10-10T22:17:23.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.569+0000 7ff1fa79d700 1 -- start start 2023-10-10T22:17:23.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.570+0000 7ff1fa79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff1f4159420 0x7ff1f40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:23.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.570+0000 7ff1fa79d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f40b2980 con 0x7ff1f41597f0 2023-10-10T22:17:23.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.570+0000 7ff1fa79d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f40b11d0 con 0x7ff1f415d230 2023-10-10T22:17:23.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.570+0000 7ff1fa79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f40b14b0 con 0x7ff1f4159420 2023-10-10T22:17:23.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1f8f9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff1f41597f0 0x7ff1f40b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57416/0 (socket says 172.21.15.154:57416) 2023-10-10T22:17:23.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1f8f9a700 1 -- 172.21.15.154:0/3602210470 learned_addr learned my addr 172.21.15.154:0/3602210470 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:23.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1f979b700 1 --2- 172.21.15.154:0/3602210470 >> v2:172.21.15.179:3300/0 conn(0x7ff1f4159420 0x7ff1f40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:23.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1ebfff700 1 -- 172.21.15.154:0/3602210470 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478409272 0 0) 0x7ff1f40b2980 con 0x7ff1f41597f0 2023-10-10T22:17:23.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1ebfff700 1 -- 172.21.15.154:0/3602210470 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e0003570 con 0x7ff1f41597f0 2023-10-10T22:17:23.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1ebfff700 1 -- 172.21.15.154:0/3602210470 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231555421 0 0) 0x7ff1f40b11d0 con 0x7ff1f415d230 2023-10-10T22:17:23.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1ebfff700 1 -- 172.21.15.154:0/3602210470 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f40b2980 con 0x7ff1f415d230 2023-10-10T22:17:23.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1f979b700 1 -- 172.21.15.154:0/3602210470 >> v1:172.21.15.179:6789/0 conn(0x7ff1f415d230 legacy=0x7ff1f415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:23.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1f979b700 1 -- 172.21.15.154:0/3602210470 >> v1:172.21.15.154:6789/0 conn(0x7ff1f41597f0 legacy=0x7ff1f40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:23.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.571+0000 7ff1f979b700 1 -- 172.21.15.154:0/3602210470 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40b1790 con 0x7ff1f4159420 2023-10-10T22:17:23.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.572+0000 7ff1f979b700 1 --2- 172.21.15.154:0/3602210470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f4159420 0x7ff1f40b5f40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00098e0 tx=0x7ff1f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d96059d723d6ae42 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:23.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.572+0000 7ff1ebfff700 1 -- 172.21.15.154:0/3602210470 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0011630 con 0x7ff1f4159420 2023-10-10T22:17:23.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.572+0000 7ff1ebfff700 1 -- 172.21.15.154:0/3602210470 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f0011790 con 0x7ff1f4159420 2023-10-10T22:17:23.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.572+0000 7ff1ebfff700 1 -- 172.21.15.154:0/3602210470 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0011b30 con 0x7ff1f4159420 2023-10-10T22:17:23.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.572+0000 7ff1fa79d700 1 -- 172.21.15.154:0/3602210470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f4159420 msgr2=0x7ff1f40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:23.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.572+0000 7ff1fa79d700 1 --2- 172.21.15.154:0/3602210470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f4159420 0x7ff1f40b5f40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00098e0 tx=0x7ff1f00091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.573+0000 7ff1fa79d700 1 -- 172.21.15.154:0/3602210470 shutdown_connections 2023-10-10T22:17:23.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.573+0000 7ff1fa79d700 1 --2- 172.21.15.154:0/3602210470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f4159420 0x7ff1f40b5f40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.573+0000 7ff1fa79d700 1 -- 172.21.15.154:0/3602210470 >> 172.21.15.154:0/3602210470 conn(0x7ff1f40d0660 msgr2=0x7ff1f40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:23.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.573+0000 7ff1fa79d700 1 -- 172.21.15.154:0/3602210470 shutdown_connections 2023-10-10T22:17:23.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.573+0000 7ff1fa79d700 1 -- 172.21.15.154:0/3602210470 wait complete. 2023-10-10T22:17:23.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.574+0000 7ff1fa79d700 1 Processor -- start 2023-10-10T22:17:23.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.574+0000 7ff1fa79d700 1 -- start start 2023-10-10T22:17:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.575+0000 7ff1fa79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1f4159420 0x7ff1f4155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:23.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.575+0000 7ff1fa79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f41597f0 0x7ff1f40c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:23.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.575+0000 7ff1fa79d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f415d230 0x7ff1f415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:23.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.575+0000 7ff1fa79d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40c7b20 con 0x7ff1f415d230 2023-10-10T22:17:23.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.575+0000 7ff1fa79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40c6f10 con 0x7ff1f41597f0 2023-10-10T22:17:23.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.575+0000 7ff1fa79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40c71f0 con 0x7ff1f4159420 2023-10-10T22:17:23.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f8f9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f41597f0 0x7ff1f40c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:23.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f9f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f415d230 0x7ff1f415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:23.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f979b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1f4159420 0x7ff1f4155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:23.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f8f9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f41597f0 0x7ff1f40c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:37160/0 (socket says 172.21.15.154:37160) 2023-10-10T22:17:23.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f8f9a700 1 -- 172.21.15.154:0/332464566 learned_addr learned my addr 172.21.15.154:0/332464566 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f9f9c700 1 -- 172.21.15.154:0/332464566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1f4159420 msgr2=0x7ff1f4155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f9f9c700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1f4159420 0x7ff1f4155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f9f9c700 1 -- 172.21.15.154:0/332464566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f41597f0 msgr2=0x7ff1f40c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f9f9c700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f41597f0 0x7ff1f40c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f9f9c700 1 -- 172.21.15.154:0/332464566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0009420 con 0x7ff1f415d230 2023-10-10T22:17:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f8f9a700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f41597f0 0x7ff1f40c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.576+0000 7ff1f9f9c700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f415d230 0x7ff1f415e370 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ff1f415dd40 tx=0x7ff1ec002650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.577+0000 7ff1e97fa700 1 -- 172.21.15.154:0/332464566 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec011590 con 0x7ff1f415d230 2023-10-10T22:17:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.577+0000 7ff1e97fa700 1 -- 172.21.15.154:0/332464566 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec011710 con 0x7ff1f415d230 2023-10-10T22:17:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.577+0000 7ff1e97fa700 1 -- 172.21.15.154:0/332464566 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec011ad0 con 0x7ff1f415d230 2023-10-10T22:17:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.577+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f40c74d0 con 0x7ff1f415d230 2023-10-10T22:17:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.577+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f4155ad0 con 0x7ff1f415d230 2023-10-10T22:17:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.578+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f404c3c0 con 0x7ff1f415d230 2023-10-10T22:17:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.580+0000 7ff1e97fa700 1 -- 172.21.15.154:0/332464566 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff1ec01c460 con 0x7ff1f415d230 2023-10-10T22:17:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.580+0000 7ff1e97fa700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff1d8067050 0x7ff1d8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:23.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.581+0000 7ff1e97fa700 1 -- 172.21.15.154:0/332464566 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6529+0+0 (secure 0 0 0) 0x7ff1ec0847e0 con 0x7ff1f415d230 2023-10-10T22:17:23.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.581+0000 7ff1f979b700 1 -- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff1d8067050 msgr2=0x7ff1d8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:23.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.581+0000 7ff1f979b700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff1d8067050 0x7ff1d8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:23.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.585+0000 7ff1e97fa700 1 -- 172.21.15.154:0/332464566 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1ec051600 con 0x7ff1f415d230 2023-10-10T22:17:23.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.782+0000 7ff1f979b700 1 -- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff1d8067050 msgr2=0x7ff1d8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:23.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.782+0000 7ff1f979b700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff1d8067050 0x7ff1d8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:23.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.880+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1f40c7c60 con 0x7ff1f415d230 2023-10-10T22:17:23.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.881+0000 7ff1e97fa700 1 -- 172.21.15.154:0/332464566 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4605 (secure 0 0 0) 0x7ff1ec054c20 con 0x7ff1f415d230 2023-10-10T22:17:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:23.883 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/870665959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":870665959},{"type":"v1","addr":"172.21.15.179:6835","nonce":870665959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7723,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/338355165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":338355165},{"type":"v1","addr":"172.21.15.154:6835","nonce":338355165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1799386063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1799386063},{"type":"v1","addr":"172.21.15.179:6834","nonce":1799386063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:21:21.107292+0000","modified":"2023-10-10T21:21:24.662772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/2644092047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2644092047},{"type":"v1","addr":"172.21.15.154:6834","nonce":2644092047}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-10T22:17:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff1d8067050 msgr2=0x7ff1d8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff1d8067050 0x7ff1d8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f415d230 msgr2=0x7ff1f415e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f415d230 0x7ff1f415e370 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ff1f415dd40 tx=0x7ff1ec002650 comp rx=0 tx=0).stop 2023-10-10T22:17:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 shutdown_connections 2023-10-10T22:17:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff1d8067050 0x7ff1d8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1f415d230 0x7ff1f415e370 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1f4159420 0x7ff1f4155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 --2- 172.21.15.154:0/332464566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1f41597f0 0x7ff1f40c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.883+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 >> 172.21.15.154:0/332464566 conn(0x7ff1f40d0660 msgr2=0x7ff1f4069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.884+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 shutdown_connections 2023-10-10T22:17:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:23.884+0000 7ff1fa79d700 1 -- 172.21.15.154:0/332464566 wait complete. 2023-10-10T22:17:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 62 2023-10-10T22:17:23.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:17:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.098+0000 7ff33759d700 1 Processor -- start 2023-10-10T22:17:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.098+0000 7ff33759d700 1 -- start start 2023-10-10T22:17:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff33759d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff330159420 0x7ff3300b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff33759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33015d230 0x7ff33015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff33759d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3300b2980 con 0x7ff3301597f0 2023-10-10T22:17:24.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff33759d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33015dbb0 con 0x7ff330159420 2023-10-10T22:17:24.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff33759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3300b11d0 con 0x7ff33015d230 2023-10-10T22:17:24.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff335d9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff3301597f0 0x7ff3300b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57426/0 (socket says 172.21.15.154:57426) 2023-10-10T22:17:24.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff335d9a700 1 -- 172.21.15.154:0/1704451230 learned_addr learned my addr 172.21.15.154:0/1704451230 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:24.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff336d9c700 1 --2- 172.21.15.154:0/1704451230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33015d230 0x7ff33015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff33659b700 1 --2- 172.21.15.154:0/1704451230 >> v2:172.21.15.179:3300/0 conn(0x7ff330159420 0x7ff3300b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff335599700 1 -- 172.21.15.154:0/1704451230 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069865085 0 0) 0x7ff3300b2980 con 0x7ff3301597f0 2023-10-10T22:17:24.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.100+0000 7ff335599700 1 -- 172.21.15.154:0/1704451230 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff31c003570 con 0x7ff3301597f0 2023-10-10T22:17:24.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.101+0000 7ff33659b700 1 -- 172.21.15.154:0/1704451230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33015d230 msgr2=0x7ff33015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:24.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.101+0000 7ff33659b700 1 --2- 172.21.15.154:0/1704451230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33015d230 0x7ff33015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.101+0000 7ff33659b700 1 -- 172.21.15.154:0/1704451230 >> v1:172.21.15.154:6789/0 conn(0x7ff3301597f0 legacy=0x7ff3300b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.101+0000 7ff33659b700 1 -- 172.21.15.154:0/1704451230 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3300b14b0 con 0x7ff330159420 2023-10-10T22:17:24.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.101+0000 7ff336d9c700 1 --2- 172.21.15.154:0/1704451230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33015d230 0x7ff33015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:24.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.101+0000 7ff33659b700 1 --2- 172.21.15.154:0/1704451230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff330159420 0x7ff3300b5f40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0098e0 tx=0x7ff32c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392096c8b0952f00 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:24.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.101+0000 7ff335599700 1 -- 172.21.15.154:0/1704451230 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c011630 con 0x7ff330159420 2023-10-10T22:17:24.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.101+0000 7ff335599700 1 -- 172.21.15.154:0/1704451230 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c011790 con 0x7ff330159420 2023-10-10T22:17:24.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.101+0000 7ff335599700 1 -- 172.21.15.154:0/1704451230 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c011b10 con 0x7ff330159420 2023-10-10T22:17:24.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.102+0000 7ff33759d700 1 -- 172.21.15.154:0/1704451230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff330159420 msgr2=0x7ff3300b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.102+0000 7ff33759d700 1 --2- 172.21.15.154:0/1704451230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff330159420 0x7ff3300b5f40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0098e0 tx=0x7ff32c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.102+0000 7ff33759d700 1 -- 172.21.15.154:0/1704451230 shutdown_connections 2023-10-10T22:17:24.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.102+0000 7ff33759d700 1 --2- 172.21.15.154:0/1704451230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff33015d230 0x7ff33015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.102+0000 7ff33759d700 1 --2- 172.21.15.154:0/1704451230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff330159420 0x7ff3300b5f40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.102+0000 7ff33759d700 1 -- 172.21.15.154:0/1704451230 >> 172.21.15.154:0/1704451230 conn(0x7ff3300d0660 msgr2=0x7ff3300d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:24.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.102+0000 7ff33759d700 1 -- 172.21.15.154:0/1704451230 shutdown_connections 2023-10-10T22:17:24.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.102+0000 7ff33759d700 1 -- 172.21.15.154:0/1704451230 wait complete. 2023-10-10T22:17:24.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.103+0000 7ff33759d700 1 Processor -- start 2023-10-10T22:17:24.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.104+0000 7ff33759d700 1 -- start start 2023-10-10T22:17:24.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff33759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff330159420 0x7ff330157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff33759d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3301597f0 0x7ff33016a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff33759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33015d230 0x7ff3300c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff33759d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3300c59d0 con 0x7ff3301597f0 2023-10-10T22:17:24.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff33759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3300c7170 con 0x7ff33015d230 2023-10-10T22:17:24.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff33759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3301578d0 con 0x7ff330159420 2023-10-10T22:17:24.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff335d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3301597f0 0x7ff33016a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff335d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3301597f0 0x7ff33016a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57350/0 (socket says 172.21.15.154:57350) 2023-10-10T22:17:24.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff335d9a700 1 -- 172.21.15.154:0/3829396008 learned_addr learned my addr 172.21.15.154:0/3829396008 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:24.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff336d9c700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33015d230 0x7ff3300c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff33659b700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff330159420 0x7ff330157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff335d9a700 1 -- 172.21.15.154:0/3829396008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff330159420 msgr2=0x7ff330157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff335d9a700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff330159420 0x7ff330157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff335d9a700 1 -- 172.21.15.154:0/3829396008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33015d230 msgr2=0x7ff3300c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff335d9a700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33015d230 0x7ff3300c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff335d9a700 1 -- 172.21.15.154:0/3829396008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff328009a20 con 0x7ff3301597f0 2023-10-10T22:17:24.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.105+0000 7ff335d9a700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3301597f0 0x7ff33016a3d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c7c0 tx=0x7ff320007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:24.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.106+0000 7ff3267fc700 1 -- 172.21.15.154:0/3829396008 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320005c00 con 0x7ff3301597f0 2023-10-10T22:17:24.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.106+0000 7ff3267fc700 1 -- 172.21.15.154:0/3829396008 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff320005d60 con 0x7ff3301597f0 2023-10-10T22:17:24.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.106+0000 7ff3267fc700 1 -- 172.21.15.154:0/3829396008 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3200072e0 con 0x7ff3301597f0 2023-10-10T22:17:24.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.106+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c009420 con 0x7ff3301597f0 2023-10-10T22:17:24.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.106+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3300c6560 con 0x7ff3301597f0 2023-10-10T22:17:24.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.107+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3300c7300 con 0x7ff3301597f0 2023-10-10T22:17:24.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.108+0000 7ff3267fc700 1 -- 172.21.15.154:0/3829396008 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff320007650 con 0x7ff3301597f0 2023-10-10T22:17:24.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.109+0000 7ff3267fc700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff314067080 0x7ff314069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.109+0000 7ff3267fc700 1 -- 172.21.15.154:0/3829396008 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6529+0+0 (secure 0 0 0) 0x7ff320083e00 con 0x7ff3301597f0 2023-10-10T22:17:24.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.109+0000 7ff33659b700 1 -- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff314067080 msgr2=0x7ff314069530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:24.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.109+0000 7ff33659b700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff314067080 0x7ff314069530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:24.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.113+0000 7ff3267fc700 1 -- 172.21.15.154:0/3829396008 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff320050c40 con 0x7ff3301597f0 2023-10-10T22:17:24.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.310+0000 7ff33659b700 1 -- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff314067080 msgr2=0x7ff314069530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:24.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.310+0000 7ff33659b700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff314067080 0x7ff314069530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:24.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.314+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff33004c3c0 con 0x7ff3301597f0 2023-10-10T22:17:24.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.315+0000 7ff3267fc700 1 -- 172.21.15.154:0/3829396008 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+16689 (secure 0 0 0) 0x7ff32006ae60 con 0x7ff3301597f0 2023-10-10T22:17:24.317 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:24.317 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":147,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:17:23.986862+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:21:19.349593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-10T21:21:20.103524+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":147,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.17","mappings":[{"from":0,"to":5}]},{"pgid":"17.1a","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/4186944763":"2023-10-11T21:21:42.366210+0000","172.21.15.154:6837/85496":"2023-10-11T21:21:42.366210+0000","172.21.15.154:6836/85496":"2023-10-11T21:21:42.366210+0000","172.21.15.154:0/1388064849":"2023-10-11T21:21:42.366210+0000","172.21.15.154:0/3956169508":"2023-10-11T21:21:42.366210+0000","172.21.15.154:0/1564590861":"2023-10-11T21:21:42.366210+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":54},{"begin":59,"length":54}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":55,"length":2},{"begin":111,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:17:24.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff314067080 msgr2=0x7ff314069530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:24.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff314067080 0x7ff314069530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3301597f0 msgr2=0x7ff33016a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3301597f0 0x7ff33016a3d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c7c0 tx=0x7ff320007d90 comp rx=0 tx=0).stop 2023-10-10T22:17:24.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 shutdown_connections 2023-10-10T22:17:24.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff33015d230 0x7ff3300c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff330159420 0x7ff330157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff314067080 0x7ff314069530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 --2- 172.21.15.154:0/3829396008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3301597f0 0x7ff33016a3d0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 >> 172.21.15.154:0/3829396008 conn(0x7ff3300d0660 msgr2=0x7ff3300b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 shutdown_connections 2023-10-10T22:17:24.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.317+0000 7ff33759d700 1 -- 172.21.15.154:0/3829396008 wait complete. 2023-10-10T22:17:24.337 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T21:21:19.349593+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T21:21:20.103524+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 112, 'snap_epoch': 147, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T22:17:24.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T22:17:24.351 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:24.350+0000 7f3a54685180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:17:24.443 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:24.442+0000 7f29cd681180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:17:24.515 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:24.513+0000 7f3a54685180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:17:24.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.534+0000 7f937f39d700 1 Processor -- start 2023-10-10T22:17:24.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.534+0000 7f937f39d700 1 -- start start 2023-10-10T22:17:24.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.535+0000 7f937f39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93780b4e70 0x7f93780ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.535+0000 7f937f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b16d0 0x7f93780b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.535+0000 7f937f39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93780b2080 con 0x7f937815d240 2023-10-10T22:17:24.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.535+0000 7f937f39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93780cfb00 con 0x7f93780b4e70 2023-10-10T22:17:24.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.535+0000 7f937f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93780b5c40 con 0x7f93780b16d0 2023-10-10T22:17:24.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.535+0000 7f937eb9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f937815d240 0x7f937815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57440/0 (socket says 172.21.15.154:57440) 2023-10-10T22:17:24.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.535+0000 7f937eb9c700 1 -- 172.21.15.154:0/2667330728 learned_addr learned my addr 172.21.15.154:0/2667330728 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:24.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.535+0000 7f937db9a700 1 --2- 172.21.15.154:0/2667330728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b16d0 0x7f93780b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.535+0000 7f937e39b700 1 --2- 172.21.15.154:0/2667330728 >> v2:172.21.15.179:3300/0 conn(0x7f93780b4e70 0x7f93780ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.536+0000 7f937d399700 1 -- 172.21.15.154:0/2667330728 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740162239 0 0) 0x7f93780b2080 con 0x7f937815d240 2023-10-10T22:17:24.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.536+0000 7f937d399700 1 -- 172.21.15.154:0/2667330728 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9364003570 con 0x7f937815d240 2023-10-10T22:17:24.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.536+0000 7f937db9a700 1 -- 172.21.15.154:0/2667330728 >> v2:172.21.15.179:3300/0 conn(0x7f93780b4e70 msgr2=0x7f93780ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:24.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.536+0000 7f937db9a700 1 --2- 172.21.15.154:0/2667330728 >> v2:172.21.15.179:3300/0 conn(0x7f93780b4e70 0x7f93780ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.536+0000 7f937db9a700 1 -- 172.21.15.154:0/2667330728 >> v1:172.21.15.154:6789/0 conn(0x7f937815d240 legacy=0x7f937815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.536+0000 7f937db9a700 1 -- 172.21.15.154:0/2667330728 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93780b5f20 con 0x7f93780b16d0 2023-10-10T22:17:24.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.536+0000 7f937e39b700 1 --2- 172.21.15.154:0/2667330728 >> v2:172.21.15.179:3300/0 conn(0x7f93780b4e70 0x7f93780ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:24.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.536+0000 7f937db9a700 1 --2- 172.21.15.154:0/2667330728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b16d0 0x7f93780b1b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93680098e0 tx=0x7f93680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcb9ffc9bbac23c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:24.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.536+0000 7f937d399700 1 -- 172.21.15.154:0/2667330728 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368011630 con 0x7f93780b16d0 2023-10-10T22:17:24.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937d399700 1 -- 172.21.15.154:0/2667330728 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9368011790 con 0x7f93780b16d0 2023-10-10T22:17:24.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937d399700 1 -- 172.21.15.154:0/2667330728 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368011b30 con 0x7f93780b16d0 2023-10-10T22:17:24.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937f39d700 1 -- 172.21.15.154:0/2667330728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b16d0 msgr2=0x7f93780b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937f39d700 1 --2- 172.21.15.154:0/2667330728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b16d0 0x7f93780b1b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93680098e0 tx=0x7f93680091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937f39d700 1 -- 172.21.15.154:0/2667330728 shutdown_connections 2023-10-10T22:17:24.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937f39d700 1 --2- 172.21.15.154:0/2667330728 >> v2:172.21.15.179:3300/0 conn(0x7f93780b4e70 0x7f93780ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937f39d700 1 --2- 172.21.15.154:0/2667330728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b16d0 0x7f93780b1b40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937f39d700 1 -- 172.21.15.154:0/2667330728 >> 172.21.15.154:0/2667330728 conn(0x7f93780d10c0 msgr2=0x7f93780affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:24.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937f39d700 1 -- 172.21.15.154:0/2667330728 shutdown_connections 2023-10-10T22:17:24.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.537+0000 7f937f39d700 1 -- 172.21.15.154:0/2667330728 wait complete. 2023-10-10T22:17:24.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.539+0000 7f937f39d700 1 Processor -- start 2023-10-10T22:17:24.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.539+0000 7f937f39d700 1 -- start start 2023-10-10T22:17:24.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937f39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93780b16d0 0x7f9378150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b4e70 0x7f93780c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937f39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f937815d240 0x7f93780c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937f39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780c6ae0 con 0x7f937815d240 2023-10-10T22:17:24.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937f39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780c5ed0 con 0x7f93780b16d0 2023-10-10T22:17:24.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93780c61b0 con 0x7f93780b4e70 2023-10-10T22:17:24.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937eb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f937815d240 0x7f93780c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937eb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f937815d240 0x7f93780c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57356/0 (socket says 172.21.15.154:57356) 2023-10-10T22:17:24.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937eb9c700 1 -- 172.21.15.154:0/1856148659 learned_addr learned my addr 172.21.15.154:0/1856148659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:24.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937e39b700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93780b16d0 0x7f9378150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937db9a700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b4e70 0x7f93780c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937eb9c700 1 -- 172.21.15.154:0/1856148659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b4e70 msgr2=0x7f93780c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937eb9c700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b4e70 0x7f93780c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937eb9c700 1 -- 172.21.15.154:0/1856148659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93780b16d0 msgr2=0x7f9378150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937eb9c700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93780b16d0 0x7f9378150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.540+0000 7f937eb9c700 1 -- 172.21.15.154:0/1856148659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374009420 con 0x7f937815d240 2023-10-10T22:17:24.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.541+0000 7f937eb9c700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f937815d240 0x7f93780c7b90 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9370001460 tx=0x7f9370001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:24.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.541+0000 7f936e7fc700 1 -- 172.21.15.154:0/1856148659 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937000a870 con 0x7f937815d240 2023-10-10T22:17:24.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.541+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9368009420 con 0x7f937815d240 2023-10-10T22:17:24.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.541+0000 7f936e7fc700 1 -- 172.21.15.154:0/1856148659 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937000a9d0 con 0x7f937815d240 2023-10-10T22:17:24.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.541+0000 7f936e7fc700 1 -- 172.21.15.154:0/1856148659 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937000ad50 con 0x7f937815d240 2023-10-10T22:17:24.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.541+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93780c6770 con 0x7f937815d240 2023-10-10T22:17:24.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.542+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93780c6c50 con 0x7f937815d240 2023-10-10T22:17:24.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.543+0000 7f936e7fc700 1 -- 172.21.15.154:0/1856148659 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f9370007300 con 0x7f937815d240 2023-10-10T22:17:24.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.544+0000 7f936e7fc700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f935c067050 0x7f935c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.544+0000 7f936e7fc700 1 -- 172.21.15.154:0/1856148659 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f9370085830 con 0x7f937815d240 2023-10-10T22:17:24.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.544+0000 7f937e39b700 1 -- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f935c067050 msgr2=0x7f935c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:24.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.545+0000 7f937e39b700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f935c067050 0x7f935c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:24.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.548+0000 7f936e7fc700 1 -- 172.21.15.154:0/1856148659 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93700526d0 con 0x7f937815d240 2023-10-10T22:17:24.601 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:24.599+0000 7f3a54685180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:17:24.618 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:24.616+0000 7f29cd681180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:17:24.717 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:24.714+0000 7f29cd681180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:17:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.746+0000 7f937e39b700 1 -- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f935c067050 msgr2=0x7f935c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:24.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.746+0000 7f937e39b700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f935c067050 0x7f935c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:24.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.758+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93780c6e70 con 0x7f937815d240 2023-10-10T22:17:24.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.758+0000 7f936e7fc700 1 -- 172.21.15.154:0/1856148659 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9370055cf0 con 0x7f937815d240 2023-10-10T22:17:24.761 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T22:17:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f935c067050 msgr2=0x7f935c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f935c067050 0x7f935c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f937815d240 msgr2=0x7f93780c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f937815d240 0x7f93780c7b90 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9370001460 tx=0x7f9370001a40 comp rx=0 tx=0).stop 2023-10-10T22:17:24.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 shutdown_connections 2023-10-10T22:17:24.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f935c067050 0x7f935c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f937815d240 0x7f93780c7b90 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93780b16d0 0x7f9378150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 --2- 172.21.15.154:0/1856148659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93780b4e70 0x7f93780c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 >> 172.21.15.154:0/1856148659 conn(0x7f93780d10c0 msgr2=0x7f93780cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:24.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 shutdown_connections 2023-10-10T22:17:24.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.761+0000 7f937f39d700 1 -- 172.21.15.154:0/1856148659 wait complete. 2023-10-10T22:17:24.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T22:17:24.832 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:24.831+0000 7f3a54685180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:17:24.950 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:24.949+0000 7f29cd681180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:17:24.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.971+0000 7f8e4b19d700 1 Processor -- start 2023-10-10T22:17:24.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.971+0000 7f8e4b19d700 1 -- start start 2023-10-10T22:17:24.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.972+0000 7f8e4b19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e440b16d0 0x7f8e440b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.972+0000 7f8e4b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.972+0000 7f8e4b19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e440b2080 con 0x7f8e440b4e70 2023-10-10T22:17:24.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.972+0000 7f8e4b19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e440cfb00 con 0x7f8e440b16d0 2023-10-10T22:17:24.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.972+0000 7f8e4b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e440b5c40 con 0x7f8e440b33b0 2023-10-10T22:17:24.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4a99c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4999a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e440b16d0 0x7f8e440b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4a19b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8e440b4e70 0x7f8e440ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:49724/0 (socket says 172.21.15.154:49724) 2023-10-10T22:17:24.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4a19b700 1 -- 172.21.15.154:0/1859038966 learned_addr learned my addr 172.21.15.154:0/1859038966 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:24.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4999a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e440b16d0 0x7f8e440b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:37202/0 (socket says 172.21.15.154:37202) 2023-10-10T22:17:24.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4a99c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:32892/0 (socket says 172.21.15.154:32892) 2023-10-10T22:17:24.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4999a700 1 -- 172.21.15.154:0/1859038966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 msgr2=0x7f8e440b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:24.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4999a700 1 --2- 172.21.15.154:0/1859038966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4999a700 1 -- 172.21.15.154:0/1859038966 >> v1:172.21.15.179:6789/0 conn(0x7f8e440b4e70 legacy=0x7f8e440ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4999a700 1 -- 172.21.15.154:0/1859038966 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e440b5f20 con 0x7f8e440b16d0 2023-10-10T22:17:24.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e4a99c700 1 --2- 172.21.15.154:0/1859038966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:24.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.973+0000 7f8e49199700 1 -- 172.21.15.154:0/1859038966 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592266050 0 0) 0x7f8e440b2080 con 0x7f8e440b4e70 2023-10-10T22:17:24.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.974+0000 7f8e4999a700 1 --2- 172.21.15.154:0/1859038966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b16d0 0x7f8e440b1b40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8e340098e0 tx=0x7f8e340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d28f5687b6ba03c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:24.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.974+0000 7f8e49199700 1 -- 172.21.15.154:0/1859038966 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400b640 con 0x7f8e440b16d0 2023-10-10T22:17:24.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.974+0000 7f8e49199700 1 -- 172.21.15.154:0/1859038966 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3400b7a0 con 0x7f8e440b16d0 2023-10-10T22:17:24.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.974+0000 7f8e49199700 1 -- 172.21.15.154:0/1859038966 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400bb40 con 0x7f8e440b16d0 2023-10-10T22:17:24.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.974+0000 7f8e4b19d700 1 -- 172.21.15.154:0/1859038966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b16d0 msgr2=0x7f8e440b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.974+0000 7f8e4b19d700 1 --2- 172.21.15.154:0/1859038966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b16d0 0x7f8e440b1b40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8e340098e0 tx=0x7f8e340091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.974+0000 7f8e4b19d700 1 -- 172.21.15.154:0/1859038966 shutdown_connections 2023-10-10T22:17:24.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.974+0000 7f8e4b19d700 1 --2- 172.21.15.154:0/1859038966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.975+0000 7f8e4b19d700 1 --2- 172.21.15.154:0/1859038966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b16d0 0x7f8e440b1b40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.975+0000 7f8e4b19d700 1 -- 172.21.15.154:0/1859038966 >> 172.21.15.154:0/1859038966 conn(0x7f8e440d10c0 msgr2=0x7f8e440affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:24.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.975+0000 7f8e4b19d700 1 -- 172.21.15.154:0/1859038966 shutdown_connections 2023-10-10T22:17:24.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.975+0000 7f8e4b19d700 1 -- 172.21.15.154:0/1859038966 wait complete. 2023-10-10T22:17:24.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.976+0000 7f8e4b19d700 1 Processor -- start 2023-10-10T22:17:24.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.976+0000 7f8e4b19d700 1 -- start start 2023-10-10T22:17:24.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4b19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e440b16d0 0x7f8e440a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4b19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b4e70 0x7f8e440cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4b19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4416af90 con 0x7f8e440b16d0 2023-10-10T22:17:24.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4b19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e440c8720 con 0x7f8e440b4e70 2023-10-10T22:17:24.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e440c8a00 con 0x7f8e440b33b0 2023-10-10T22:17:24.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4a19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e440b16d0 0x7f8e440a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4a19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e440b16d0 0x7f8e440a72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57362/0 (socket says 172.21.15.154:57362) 2023-10-10T22:17:24.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4a19b700 1 -- 172.21.15.154:0/642262777 learned_addr learned my addr 172.21.15.154:0/642262777 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:24.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4a99c700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b4e70 0x7f8e440cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.977+0000 7f8e4999a700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:24.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e4a19b700 1 -- 172.21.15.154:0/642262777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 msgr2=0x7f8e440c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e4a19b700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e4a19b700 1 -- 172.21.15.154:0/642262777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b4e70 msgr2=0x7f8e440cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:24.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e4a19b700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b4e70 0x7f8e440cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:24.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e4a19b700 1 -- 172.21.15.154:0/642262777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009a20 con 0x7f8e440b16d0 2023-10-10T22:17:24.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e4a99c700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b4e70 0x7f8e440cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:24.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e4a19b700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e440b16d0 0x7f8e440a72d0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c7e0 tx=0x7f8e40007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:24.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e3a7fc700 1 -- 172.21.15.154:0/642262777 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40005b30 con 0x7f8e440b16d0 2023-10-10T22:17:24.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e34009420 con 0x7f8e440b16d0 2023-10-10T22:17:24.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e3a7fc700 1 -- 172.21.15.154:0/642262777 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e40005c90 con 0x7f8e440b16d0 2023-10-10T22:17:24.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e3a7fc700 1 -- 172.21.15.154:0/642262777 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40007300 con 0x7f8e440b16d0 2023-10-10T22:17:24.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.978+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e440c8fc0 con 0x7f8e440b16d0 2023-10-10T22:17:24.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.980+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e44088990 con 0x7f8e440b16d0 2023-10-10T22:17:24.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.980+0000 7f8e3a7fc700 1 -- 172.21.15.154:0/642262777 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f8e400076b0 con 0x7f8e440b16d0 2023-10-10T22:17:24.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.981+0000 7f8e3a7fc700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8e28067050 0x7f8e28069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:24.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.981+0000 7f8e3a7fc700 1 -- 172.21.15.154:0/642262777 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f8e40083fc0 con 0x7f8e440b16d0 2023-10-10T22:17:24.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.981+0000 7f8e4999a700 1 -- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8e28067050 msgr2=0x7f8e28069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:24.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.981+0000 7f8e4999a700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8e28067050 0x7f8e28069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:24.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:24.985+0000 7f8e3a7fc700 1 -- 172.21.15.154:0/642262777 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e40050e00 con 0x7f8e440b16d0 2023-10-10T22:17:25.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:25.013+0000 7f3a54685180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:17:25.106 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:25.105+0000 7f3a54685180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:17:25.140 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:25.139+0000 7f29cd681180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:17:25.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.183+0000 7f8e4999a700 1 -- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8e28067050 msgr2=0x7f8e28069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:25.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.183+0000 7f8e4999a700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8e28067050 0x7f8e28069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.186+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e440cf4b0 con 0x7f8e440b16d0 2023-10-10T22:17:25.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.186+0000 7f8e3a7fc700 1 -- 172.21.15.154:0/642262777 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e40017020 con 0x7f8e440b16d0 2023-10-10T22:17:25.188 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T22:17:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8e28067050 msgr2=0x7f8e28069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8e28067050 0x7f8e28069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e440b16d0 msgr2=0x7f8e440a72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e440b16d0 0x7f8e440a72d0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c7e0 tx=0x7f8e40007df0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 shutdown_connections 2023-10-10T22:17:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e440b4e70 0x7f8e440cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8e28067050 0x7f8e28069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e440b16d0 0x7f8e440a72d0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 --2- 172.21.15.154:0/642262777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e440b33b0 0x7f8e440c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 >> 172.21.15.154:0/642262777 conn(0x7f8e440d10c0 msgr2=0x7f8e44068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 shutdown_connections 2023-10-10T22:17:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.189+0000 7f8e4b19d700 1 -- 172.21.15.154:0/642262777 wait complete. 2023-10-10T22:17:25.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T22:17:25.236 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:25.235+0000 7f29cd681180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:17:25.270 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:25.269+0000 7f3a54685180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:17:25.371 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:25.370+0000 7f3a54685180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:17:25.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.399+0000 7fd8ee59d700 1 Processor -- start 2023-10-10T22:17:25.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.399+0000 7fd8ee59d700 1 -- start start 2023-10-10T22:17:25.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8ee59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd8e80b4e70 0x7fd8e80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8ee59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8e80b16d0 0x7fd8e80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8ee59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e80b2080 con 0x7fd8e815d240 2023-10-10T22:17:25.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8ee59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e80cfb00 con 0x7fd8e80b16d0 2023-10-10T22:17:25.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8ee59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e80b5c40 con 0x7fd8e80b4e70 2023-10-10T22:17:25.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8ecd9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8e80b16d0 0x7fd8e80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8edd9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd8e815d240 0x7fd8e815d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57446/0 (socket says 172.21.15.154:57446) 2023-10-10T22:17:25.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8edd9c700 1 -- 172.21.15.154:0/3550875204 learned_addr learned my addr 172.21.15.154:0/3550875204 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:25.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8ecd9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8e80b16d0 0x7fd8e80b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57366/0 (socket says 172.21.15.154:57366) 2023-10-10T22:17:25.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.400+0000 7fd8ed59b700 1 --2- 172.21.15.154:0/3550875204 >> v2:172.21.15.179:3300/0 conn(0x7fd8e80b4e70 0x7fd8e80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.401+0000 7fd8ecd9a700 1 -- 172.21.15.154:0/3550875204 >> v2:172.21.15.179:3300/0 conn(0x7fd8e80b4e70 msgr2=0x7fd8e80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:25.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.401+0000 7fd8ecd9a700 1 --2- 172.21.15.154:0/3550875204 >> v2:172.21.15.179:3300/0 conn(0x7fd8e80b4e70 0x7fd8e80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.401+0000 7fd8ecd9a700 1 -- 172.21.15.154:0/3550875204 >> v1:172.21.15.154:6789/0 conn(0x7fd8e815d240 legacy=0x7fd8e815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:25.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.401+0000 7fd8ecd9a700 1 -- 172.21.15.154:0/3550875204 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80b5f20 con 0x7fd8e80b16d0 2023-10-10T22:17:25.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.401+0000 7fd8dffff700 1 -- 172.21.15.154:0/3550875204 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225354450 0 0) 0x7fd8e80b2080 con 0x7fd8e815d240 2023-10-10T22:17:25.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.401+0000 7fd8ecd9a700 1 --2- 172.21.15.154:0/3550875204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b16d0 0x7fd8e80b1b40 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8064910 tx=0x7fd8d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3867468f27f19f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8dffff700 1 -- 172.21.15.154:0/3550875204 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8011630 con 0x7fd8e80b16d0 2023-10-10T22:17:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8dffff700 1 -- 172.21.15.154:0/3550875204 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d8011790 con 0x7fd8e80b16d0 2023-10-10T22:17:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8dffff700 1 -- 172.21.15.154:0/3550875204 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8011b30 con 0x7fd8e80b16d0 2023-10-10T22:17:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3550875204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b16d0 msgr2=0x7fd8e80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:25.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8ee59d700 1 --2- 172.21.15.154:0/3550875204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b16d0 0x7fd8e80b1b40 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8064910 tx=0x7fd8d80091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3550875204 shutdown_connections 2023-10-10T22:17:25.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8ee59d700 1 --2- 172.21.15.154:0/3550875204 >> v2:172.21.15.179:3300/0 conn(0x7fd8e80b4e70 0x7fd8e80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8ee59d700 1 --2- 172.21.15.154:0/3550875204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b16d0 0x7fd8e80b1b40 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3550875204 >> 172.21.15.154:0/3550875204 conn(0x7fd8e80d10c0 msgr2=0x7fd8e80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:25.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3550875204 shutdown_connections 2023-10-10T22:17:25.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.402+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3550875204 wait complete. 2023-10-10T22:17:25.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.404+0000 7fd8ee59d700 1 Processor -- start 2023-10-10T22:17:25.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.404+0000 7fd8ee59d700 1 -- start start 2023-10-10T22:17:25.409 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:25.404+0000 7f29cd681180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:17:25.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ee59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e80b16d0 0x7fd8e81490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ee59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b4e70 0x7fd8e80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ee59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e815d240 0x7fd8e815e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ee59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80cb690 con 0x7fd8e80b4e70 2023-10-10T22:17:25.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ee59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e816add0 con 0x7fd8e815d240 2023-10-10T22:17:25.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ee59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80c85a0 con 0x7fd8e80b16d0 2023-10-10T22:17:25.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ecd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b4e70 0x7fd8e80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ecd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b4e70 0x7fd8e80ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57382/0 (socket says 172.21.15.154:57382) 2023-10-10T22:17:25.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ecd9a700 1 -- 172.21.15.154:0/3227859456 learned_addr learned my addr 172.21.15.154:0/3227859456 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:25.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8ed59b700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e80b16d0 0x7fd8e81490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.405+0000 7fd8edd9c700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e815d240 0x7fd8e815e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8ecd9a700 1 -- 172.21.15.154:0/3227859456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e80b16d0 msgr2=0x7fd8e81490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:25.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8ecd9a700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e80b16d0 0x7fd8e81490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8ecd9a700 1 -- 172.21.15.154:0/3227859456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e815d240 msgr2=0x7fd8e815e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:25.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8ecd9a700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e815d240 0x7fd8e815e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8ecd9a700 1 -- 172.21.15.154:0/3227859456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8009420 con 0x7fd8e80b4e70 2023-10-10T22:17:25.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8edd9c700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e815d240 0x7fd8e815e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:25.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8ecd9a700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b4e70 0x7fd8e80ca9d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8070dd0 tx=0x7fd8d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:25.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8dd7fa700 1 -- 172.21.15.154:0/3227859456 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8011b10 con 0x7fd8e80b4e70 2023-10-10T22:17:25.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8dd7fa700 1 -- 172.21.15.154:0/3227859456 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d80253f0 con 0x7fd8e80b4e70 2023-10-10T22:17:25.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e80c8e30 con 0x7fd8e80b4e70 2023-10-10T22:17:25.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8dd7fa700 1 -- 172.21.15.154:0/3227859456 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8025790 con 0x7fd8e80b4e70 2023-10-10T22:17:25.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.406+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e80cb3b0 con 0x7fd8e80b4e70 2023-10-10T22:17:25.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.407+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e80c8fc0 con 0x7fd8e80b4e70 2023-10-10T22:17:25.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.408+0000 7fd8dd7fa700 1 -- 172.21.15.154:0/3227859456 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fd8d8025b80 con 0x7fd8e80b4e70 2023-10-10T22:17:25.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.410+0000 7fd8dd7fa700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd8cc067050 0x7fd8cc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.410+0000 7fd8dd7fa700 1 -- 172.21.15.154:0/3227859456 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fd8d80862b0 con 0x7fd8e80b4e70 2023-10-10T22:17:25.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.410+0000 7fd8ed59b700 1 -- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd8cc067050 msgr2=0x7fd8cc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:25.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.410+0000 7fd8ed59b700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd8cc067050 0x7fd8cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:25.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.414+0000 7fd8dd7fa700 1 -- 172.21.15.154:0/3227859456 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8d80530d0 con 0x7fd8e80b4e70 2023-10-10T22:17:25.511 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:25.509+0000 7f29cd681180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:17:25.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.610+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8e804bb80 con 0x7fd8e80b4e70 2023-10-10T22:17:25.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.611+0000 7fd8dd7fa700 1 -- 172.21.15.154:0/3227859456 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8d80566f0 con 0x7fd8e80b4e70 2023-10-10T22:17:25.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.611+0000 7fd8ed59b700 1 -- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd8cc067050 msgr2=0x7fd8cc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:25.613 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T22:17:25.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.611+0000 7fd8ed59b700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd8cc067050 0x7fd8cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:25.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd8cc067050 msgr2=0x7fd8cc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:25.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd8cc067050 0x7fd8cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b4e70 msgr2=0x7fd8e80ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:25.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b4e70 0x7fd8e80ca9d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8070dd0 tx=0x7fd8d8017000 comp rx=0 tx=0).stop 2023-10-10T22:17:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 shutdown_connections 2023-10-10T22:17:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e815d240 0x7fd8e815e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e80b16d0 0x7fd8e81490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd8cc067050 0x7fd8cc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 --2- 172.21.15.154:0/3227859456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8e80b4e70 0x7fd8e80ca9d0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 >> 172.21.15.154:0/3227859456 conn(0x7fd8e80d10c0 msgr2=0x7fd8e8069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:25.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 shutdown_connections 2023-10-10T22:17:25.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.613+0000 7fd8ee59d700 1 -- 172.21.15.154:0/3227859456 wait complete. 2023-10-10T22:17:25.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:17:25.858 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:25.857+0000 7f3a54685180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:17:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.866+0000 7fc30b19d700 1 Processor -- start 2023-10-10T22:17:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.866+0000 7fc30b19d700 1 -- start start 2023-10-10T22:17:25.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.867+0000 7fc30b19d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3041595a0 0x7fc3040b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.867+0000 7fc30b19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc3040c6c60 0x7fc3040c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.867+0000 7fc30b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040b1de0 0x7fc3040c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30b19d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040b2b90 con 0x7fc3041595a0 2023-10-10T22:17:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30b19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040b1410 con 0x7fc3040c6c60 2023-10-10T22:17:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc304063230 con 0x7fc3040b1de0 2023-10-10T22:17:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3041595a0 0x7fc3040b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3041595a0 0x7fc3040b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58106/0 (socket says 172.21.15.154:58106) 2023-10-10T22:17:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a19b700 1 -- 172.21.15.154:0/2348937844 learned_addr learned my addr 172.21.15.154:0/2348937844 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30999a700 1 --2- 172.21.15.154:0/2348937844 >> v2:172.21.15.179:3300/0 conn(0x7fc3040c6c60 0x7fc3040c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a99c700 1 --2- 172.21.15.154:0/2348937844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040b1de0 0x7fc3040c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a19b700 1 -- 172.21.15.154:0/2348937844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040b1de0 msgr2=0x7fc3040c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a19b700 1 --2- 172.21.15.154:0/2348937844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040b1de0 0x7fc3040c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a19b700 1 -- 172.21.15.154:0/2348937844 >> v2:172.21.15.179:3300/0 conn(0x7fc3040c6c60 msgr2=0x7fc3040c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a19b700 1 --2- 172.21.15.154:0/2348937844 >> v2:172.21.15.179:3300/0 conn(0x7fc3040c6c60 0x7fc3040c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a19b700 1 -- 172.21.15.154:0/2348937844 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040634f0 con 0x7fc3041595a0 2023-10-10T22:17:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30999a700 1 --2- 172.21.15.154:0/2348937844 >> v2:172.21.15.179:3300/0 conn(0x7fc3040c6c60 0x7fc3040c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:25.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.868+0000 7fc30a99c700 1 --2- 172.21.15.154:0/2348937844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040b1de0 0x7fc3040c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:25.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.869+0000 7fc30a19b700 1 --2- 172.21.15.154:0/2348937844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3041595a0 0x7fc3040b18a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fc3040b07d0 tx=0x7fc300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e91e13abc96175 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:25.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.869+0000 7fc309199700 1 -- 172.21.15.154:0/2348937844 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30000b860 con 0x7fc3041595a0 2023-10-10T22:17:25.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.869+0000 7fc309199700 1 -- 172.21.15.154:0/2348937844 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30000b9c0 con 0x7fc3041595a0 2023-10-10T22:17:25.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.869+0000 7fc309199700 1 -- 172.21.15.154:0/2348937844 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30000bd60 con 0x7fc3041595a0 2023-10-10T22:17:25.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.869+0000 7fc30b19d700 1 -- 172.21.15.154:0/2348937844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3041595a0 msgr2=0x7fc3040b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:25.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.869+0000 7fc30b19d700 1 --2- 172.21.15.154:0/2348937844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3041595a0 0x7fc3040b18a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fc3040b07d0 tx=0x7fc300009250 comp rx=0 tx=0).stop 2023-10-10T22:17:25.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.870+0000 7fc30b19d700 1 -- 172.21.15.154:0/2348937844 shutdown_connections 2023-10-10T22:17:25.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.870+0000 7fc30b19d700 1 --2- 172.21.15.154:0/2348937844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040b1de0 0x7fc3040c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.870+0000 7fc30b19d700 1 --2- 172.21.15.154:0/2348937844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3041595a0 0x7fc3040b18a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.870+0000 7fc30b19d700 1 --2- 172.21.15.154:0/2348937844 >> v2:172.21.15.179:3300/0 conn(0x7fc3040c6c60 0x7fc3040c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.870+0000 7fc30b19d700 1 -- 172.21.15.154:0/2348937844 >> 172.21.15.154:0/2348937844 conn(0x7fc30406ddb0 msgr2=0x7fc30406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:25.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.870+0000 7fc30b19d700 1 -- 172.21.15.154:0/2348937844 shutdown_connections 2023-10-10T22:17:25.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.870+0000 7fc30b19d700 1 -- 172.21.15.154:0/2348937844 wait complete. 2023-10-10T22:17:25.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.871+0000 7fc30b19d700 1 Processor -- start 2023-10-10T22:17:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.871+0000 7fc30b19d700 1 -- start start 2023-10-10T22:17:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30b19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3040b1de0 0x7fc3040c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040c6c60 0x7fc3040c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30b19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3041595a0 0x7fc3040c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30b19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040c2a40 con 0x7fc3041595a0 2023-10-10T22:17:25.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30b19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040c2f60 con 0x7fc3040b1de0 2023-10-10T22:17:25.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040c3240 con 0x7fc3040c6c60 2023-10-10T22:17:25.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30a19b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3040b1de0 0x7fc3040c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30999a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040c6c60 0x7fc3040c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30a19b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3040b1de0 0x7fc3040c21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:33908/0 (socket says 172.21.15.154:33908) 2023-10-10T22:17:25.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30a19b700 1 -- 172.21.15.154:0/19903638 learned_addr learned my addr 172.21.15.154:0/19903638 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:25.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.872+0000 7fc30a99c700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3041595a0 0x7fc3040c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:25.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc30999a700 1 -- 172.21.15.154:0/19903638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3040b1de0 msgr2=0x7fc3040c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:25.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc30999a700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3040b1de0 0x7fc3040c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc30999a700 1 -- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3041595a0 msgr2=0x7fc3040c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:25.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc30999a700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3041595a0 0x7fc3040c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:25.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc30999a700 1 -- 172.21.15.154:0/19903638 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3000094f0 con 0x7fc3040c6c60 2023-10-10T22:17:25.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc30a19b700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3040b1de0 0x7fc3040c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:25.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc30999a700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040c6c60 0x7fc3040c3d20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400e870 tx=0x7fc2f4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:25.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc2fa7fc700 1 -- 172.21.15.154:0/19903638 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400c070 con 0x7fc3040c6c60 2023-10-10T22:17:25.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc2fa7fc700 1 -- 172.21.15.154:0/19903638 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4013410 con 0x7fc3040c6c60 2023-10-10T22:17:25.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc2fa7fc700 1 -- 172.21.15.154:0/19903638 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40137d0 con 0x7fc3040c6c60 2023-10-10T22:17:25.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.873+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3040c3520 con 0x7fc3040c6c60 2023-10-10T22:17:25.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.874+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3040c26f0 con 0x7fc3040c6c60 2023-10-10T22:17:25.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.875+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30404c3c0 con 0x7fc3040c6c60 2023-10-10T22:17:25.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.876+0000 7fc2fa7fc700 1 -- 172.21.15.154:0/19903638 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fc2f4013b40 con 0x7fc3040c6c60 2023-10-10T22:17:25.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.876+0000 7fc2fa7fc700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc2e8067050 0x7fc2e8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:25.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.876+0000 7fc2fa7fc700 1 -- 172.21.15.154:0/19903638 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fc2f4084720 con 0x7fc3040c6c60 2023-10-10T22:17:25.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.876+0000 7fc30a19b700 1 -- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc2e8067050 msgr2=0x7fc2e8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:25.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.877+0000 7fc30a19b700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc2e8067050 0x7fc2e8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:25.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:25.881+0000 7fc2fa7fc700 1 -- 172.21.15.154:0/19903638 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2f4054e20 con 0x7fc3040c6c60 2023-10-10T22:17:25.955 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:25.954+0000 7f3a54685180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:17:26.026 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:26.024+0000 7f29cd681180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:17:26.049 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:26.048+0000 7f3a54685180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:17:26.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.078+0000 7fc30a19b700 1 -- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc2e8067050 msgr2=0x7fc2e8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.078+0000 7fc30a19b700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc2e8067050 0x7fc2e8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:26.122 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:26.121+0000 7f29cd681180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:17:26.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.126+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3040c3380 con 0x7fc3040c6c60 2023-10-10T22:17:26.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.126+0000 7fc2fa7fc700 1 -- 172.21.15.154:0/19903638 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fc3040c3380 con 0x7fc3040c6c60 2023-10-10T22:17:26.128 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:26.128 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/870665959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":870665959},{"type":"v1","addr":"172.21.15.179:6835","nonce":870665959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7723,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/338355165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":338355165},{"type":"v1","addr":"172.21.15.154:6835","nonce":338355165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1799386063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1799386063},{"type":"v1","addr":"172.21.15.179:6834","nonce":1799386063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:21:21.107292+0000","modified":"2023-10-10T21:21:24.662772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/2644092047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2644092047},{"type":"v1","addr":"172.21.15.154:6834","nonce":2644092047}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-10T22:17:26.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc2e8067050 msgr2=0x7fc2e8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:26.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc2e8067050 0x7fc2e8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040c6c60 msgr2=0x7fc3040c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040c6c60 0x7fc3040c3d20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400e870 tx=0x7fc2f4008040 comp rx=0 tx=0).stop 2023-10-10T22:17:26.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 shutdown_connections 2023-10-10T22:17:26.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc2e8067050 0x7fc2e8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3041595a0 0x7fc3040c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3040b1de0 0x7fc3040c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 --2- 172.21.15.154:0/19903638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3040c6c60 0x7fc3040c3d20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 >> 172.21.15.154:0/19903638 conn(0x7fc30406ddb0 msgr2=0x7fc3041571e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:26.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.129+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 shutdown_connections 2023-10-10T22:17:26.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.130+0000 7fc30b19d700 1 -- 172.21.15.154:0/19903638 wait complete. 2023-10-10T22:17:26.133 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 62 2023-10-10T22:17:26.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:17:26.220 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:26.219+0000 7f29cd681180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:17:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.333+0000 7f649359d700 1 Processor -- start 2023-10-10T22:17:26.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.333+0000 7f649359d700 1 -- start start 2023-10-10T22:17:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.334+0000 7f649359d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f648c156310 0x7f648c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.334+0000 7f649359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 0x7f648c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.334+0000 7f649359d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0ca860 con 0x7f648c1566e0 2023-10-10T22:17:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.334+0000 7f649359d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c0cab40 con 0x7f648c156310 2023-10-10T22:17:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.334+0000 7f649359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0cae20 con 0x7f648c0ae710 2023-10-10T22:17:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.335+0000 7f649259b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f648c156310 0x7f648c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.335+0000 7f649259b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f648c156310 0x7f648c0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58112/0 (socket says 172.21.15.154:58112) 2023-10-10T22:17:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.335+0000 7f649259b700 1 -- 172.21.15.154:0/2676188731 learned_addr learned my addr 172.21.15.154:0/2676188731 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.335+0000 7f6492d9c700 1 --2- 172.21.15.154:0/2676188731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 0x7f648c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.335+0000 7f649259b700 1 -- 172.21.15.154:0/2676188731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 msgr2=0x7f648c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.335+0000 7f649259b700 1 --2- 172.21.15.154:0/2676188731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 0x7f648c0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.335+0000 7f649259b700 1 -- 172.21.15.154:0/2676188731 >> v1:172.21.15.154:6789/0 conn(0x7f648c1566e0 legacy=0x7f648c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.335+0000 7f649259b700 1 -- 172.21.15.154:0/2676188731 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c0cb100 con 0x7f648c156310 2023-10-10T22:17:26.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.335+0000 7f649259b700 1 --2- 172.21.15.154:0/2676188731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c156310 0x7f648c0c9dc0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f64880099b0 tx=0x7f6488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f1d46d459cda4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:26.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f6491599700 1 -- 172.21.15.154:0/2676188731 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488009ea0 con 0x7f648c156310 2023-10-10T22:17:26.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f6491599700 1 -- 172.21.15.154:0/2676188731 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648800b860 con 0x7f648c156310 2023-10-10T22:17:26.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f6491599700 1 -- 172.21.15.154:0/2676188731 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648800bc00 con 0x7f648c156310 2023-10-10T22:17:26.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f649359d700 1 -- 172.21.15.154:0/2676188731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c156310 msgr2=0x7f648c0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f649359d700 1 --2- 172.21.15.154:0/2676188731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c156310 0x7f648c0c9dc0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f64880099b0 tx=0x7f6488009250 comp rx=0 tx=0).stop 2023-10-10T22:17:26.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f649359d700 1 -- 172.21.15.154:0/2676188731 shutdown_connections 2023-10-10T22:17:26.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f649359d700 1 --2- 172.21.15.154:0/2676188731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 0x7f648c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f649359d700 1 --2- 172.21.15.154:0/2676188731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c156310 0x7f648c0c9dc0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f649359d700 1 -- 172.21.15.154:0/2676188731 >> 172.21.15.154:0/2676188731 conn(0x7f648c0cc1f0 msgr2=0x7f648c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:26.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f649359d700 1 -- 172.21.15.154:0/2676188731 shutdown_connections 2023-10-10T22:17:26.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.336+0000 7f649359d700 1 -- 172.21.15.154:0/2676188731 wait complete. 2023-10-10T22:17:26.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.338+0000 7f649359d700 1 Processor -- start 2023-10-10T22:17:26.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.338+0000 7f649359d700 1 -- start start 2023-10-10T22:17:26.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f649359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 0x7f648c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f649359d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f648c156310 0x7f648c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f649359d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c1566e0 0x7f648c0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f649359d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c3fb0 con 0x7f648c1566e0 2023-10-10T22:17:26.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f649359d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15e750 con 0x7f648c156310 2023-10-10T22:17:26.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f649359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15db40 con 0x7f648c0ae710 2023-10-10T22:17:26.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f6492d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c1566e0 0x7f648c0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f6492d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c1566e0 0x7f648c0c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58124/0 (socket says 172.21.15.154:58124) 2023-10-10T22:17:26.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f6492d9c700 1 -- 172.21.15.154:0/16948531 learned_addr learned my addr 172.21.15.154:0/16948531 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f649259b700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 0x7f648c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.339+0000 7f6491d9a700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f648c156310 0x7f648c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f6492d9c700 1 -- 172.21.15.154:0/16948531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 msgr2=0x7f648c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f6492d9c700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 0x7f648c15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f6492d9c700 1 -- 172.21.15.154:0/16948531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f648c156310 msgr2=0x7f648c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f6492d9c700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f648c156310 0x7f648c15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f6492d9c700 1 -- 172.21.15.154:0/16948531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880094f0 con 0x7f648c1566e0 2023-10-10T22:17:26.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f6492d9c700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c1566e0 0x7f648c0c3a70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6484009ef0 tx=0x7f648400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:26.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f64827fc700 1 -- 172.21.15.154:0/16948531 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400cb70 con 0x7f648c1566e0 2023-10-10T22:17:26.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f64827fc700 1 -- 172.21.15.154:0/16948531 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400f040 con 0x7f648c1566e0 2023-10-10T22:17:26.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f64827fc700 1 -- 172.21.15.154:0/16948531 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484014480 con 0x7f648c1566e0 2023-10-10T22:17:26.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c15de20 con 0x7f648c1566e0 2023-10-10T22:17:26.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.340+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c15e3e0 con 0x7f648c1566e0 2023-10-10T22:17:26.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.341+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c15e8c0 con 0x7f648c1566e0 2023-10-10T22:17:26.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.342+0000 7f64827fc700 1 -- 172.21.15.154:0/16948531 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6484014830 con 0x7f648c1566e0 2023-10-10T22:17:26.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.343+0000 7f64827fc700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6470067050 0x7f6470069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.343+0000 7f64827fc700 1 -- 172.21.15.154:0/16948531 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f6484085830 con 0x7f648c1566e0 2023-10-10T22:17:26.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.343+0000 7f649259b700 1 -- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6470067050 msgr2=0x7f6470069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:26.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.343+0000 7f649259b700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6470067050 0x7f6470069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:26.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.351+0000 7f64827fc700 1 -- 172.21.15.154:0/16948531 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64840524a0 con 0x7f648c1566e0 2023-10-10T22:17:26.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.544+0000 7f649259b700 1 -- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6470067050 msgr2=0x7f6470069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:26.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.544+0000 7f649259b700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6470067050 0x7f6470069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:26.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.545+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f648c04c3c0 con 0x7f648c1566e0 2023-10-10T22:17:26.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.546+0000 7f64827fc700 1 -- 172.21.15.154:0/16948531 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f6484055ac0 con 0x7f648c1566e0 2023-10-10T22:17:26.548 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:26.548 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":148,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:17:24.993162+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:21:19.349593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-10T21:21:20.103524+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":148,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.17","mappings":[{"from":0,"to":5}]},{"pgid":"17.1a","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/4186944763":"2023-10-11T21:21:42.366210+0000","172.21.15.154:6837/85496":"2023-10-11T21:21:42.366210+0000","172.21.15.154:6836/85496":"2023-10-11T21:21:42.366210+0000","172.21.15.154:0/1388064849":"2023-10-11T21:21:42.366210+0000","172.21.15.154:0/3956169508":"2023-10-11T21:21:42.366210+0000","172.21.15.154:0/1564590861":"2023-10-11T21:21:42.366210+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:17:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6470067050 msgr2=0x7f6470069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6470067050 0x7f6470069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c1566e0 msgr2=0x7f648c0c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c1566e0 0x7f648c0c3a70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6484009ef0 tx=0x7f648400b040 comp rx=0 tx=0).stop 2023-10-10T22:17:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 shutdown_connections 2023-10-10T22:17:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6470067050 0x7f6470069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648c1566e0 0x7f648c0c3a70 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f648c0ae710 0x7f648c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 --2- 172.21.15.154:0/16948531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f648c156310 0x7f648c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 >> 172.21.15.154:0/16948531 conn(0x7f648c0cc1f0 msgr2=0x7f648c151b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 shutdown_connections 2023-10-10T22:17:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.549+0000 7f649359d700 1 -- 172.21.15.154:0/16948531 wait complete. 2023-10-10T22:17:26.569 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T22:17:26.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:17:26.672 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:26.671+0000 7f3a54685180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:17:26.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.768+0000 7f19a49fe700 1 Processor -- start 2023-10-10T22:17:26.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.768+0000 7f19a49fe700 1 -- start start 2023-10-10T22:17:26.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.770+0000 7f19a49fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19a00ca290 0x7f19a00c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.770+0000 7f19a49fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a00c6f80 0x7f19a0167800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.770+0000 7f19a49fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a0069f10 con 0x7f19a0147550 2023-10-10T22:17:26.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.770+0000 7f19a49fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a00c7400 con 0x7f19a00ca290 2023-10-10T22:17:26.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.770+0000 7f19a49fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a006a1f0 con 0x7f19a00c6f80 2023-10-10T22:17:26.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.771+0000 7f199f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a00c6f80 0x7f19a0167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.771+0000 7f199f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a00c6f80 0x7f19a0167800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:53974/0 (socket says 172.21.15.154:53974) 2023-10-10T22:17:26.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.771+0000 7f199f59e700 1 -- 172.21.15.154:0/2405552119 learned_addr learned my addr 172.21.15.154:0/2405552119 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:26.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.771+0000 7f199ed9d700 1 --1- 172.21.15.154:0/2405552119 >> v1:172.21.15.154:6789/0 conn(0x7f19a0147550 0x7f19a00696c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38808/0 (socket says 172.21.15.154:38808) 2023-10-10T22:17:26.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.771+0000 7f199e59c700 1 --2- 172.21.15.154:0/2405552119 >> v2:172.21.15.154:3300/0 conn(0x7f19a00ca290 0x7f19a00c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.771+0000 7f199f59e700 1 -- 172.21.15.154:0/2405552119 >> v2:172.21.15.154:3300/0 conn(0x7f19a00ca290 msgr2=0x7f19a00c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:26.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.771+0000 7f199f59e700 1 --2- 172.21.15.154:0/2405552119 >> v2:172.21.15.154:3300/0 conn(0x7f19a00ca290 0x7f19a00c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.771+0000 7f199f59e700 1 -- 172.21.15.154:0/2405552119 >> v1:172.21.15.154:6789/0 conn(0x7f19a0147550 legacy=0x7f19a00696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.771+0000 7f199f59e700 1 -- 172.21.15.154:0/2405552119 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a006a4d0 con 0x7f19a00c6f80 2023-10-10T22:17:26.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.772+0000 7f199f59e700 1 --2- 172.21.15.154:0/2405552119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a00c6f80 0x7f19a0167800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1998009f20 tx=0x7f1998009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e2acdef9fc2be91 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:26.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.772+0000 7f199dd9b700 1 -- 172.21.15.154:0/2405552119 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800e070 con 0x7f19a00c6f80 2023-10-10T22:17:26.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.772+0000 7f199dd9b700 1 -- 172.21.15.154:0/2405552119 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199800b9d0 con 0x7f19a00c6f80 2023-10-10T22:17:26.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.772+0000 7f199dd9b700 1 -- 172.21.15.154:0/2405552119 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980092e0 con 0x7f19a00c6f80 2023-10-10T22:17:26.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.773+0000 7f19a49fe700 1 -- 172.21.15.154:0/2405552119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a00c6f80 msgr2=0x7f19a0167800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.773+0000 7f19a49fe700 1 --2- 172.21.15.154:0/2405552119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a00c6f80 0x7f19a0167800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1998009f20 tx=0x7f1998009840 comp rx=0 tx=0).stop 2023-10-10T22:17:26.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.773+0000 7f19a49fe700 1 -- 172.21.15.154:0/2405552119 shutdown_connections 2023-10-10T22:17:26.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.773+0000 7f19a49fe700 1 --2- 172.21.15.154:0/2405552119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a00c6f80 0x7f19a0167800 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.773+0000 7f19a49fe700 1 --2- 172.21.15.154:0/2405552119 >> v2:172.21.15.154:3300/0 conn(0x7f19a00ca290 0x7f19a00c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.773+0000 7f19a49fe700 1 -- 172.21.15.154:0/2405552119 >> 172.21.15.154:0/2405552119 conn(0x7f19a00cc1f0 msgr2=0x7f19a00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:26.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.773+0000 7f19a49fe700 1 -- 172.21.15.154:0/2405552119 shutdown_connections 2023-10-10T22:17:26.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.773+0000 7f19a49fe700 1 -- 172.21.15.154:0/2405552119 wait complete. 2023-10-10T22:17:26.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.776+0000 7f19a49fe700 1 Processor -- start 2023-10-10T22:17:26.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.777+0000 7f19a49fe700 1 -- start start 2023-10-10T22:17:26.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.778+0000 7f19a49fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a00c6f80 0x7f19a00b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.778+0000 7f19a49fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19a00ca290 0x7f19a00c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.779+0000 7f19a49fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a0147550 0x7f19a0165e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.779+0000 7f199ed9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a00c6f80 0x7f19a00b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.779+0000 7f19a49fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00b19f0 con 0x7f19a00ca290 2023-10-10T22:17:26.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.779+0000 7f19a49fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c4be0 con 0x7f19a00c6f80 2023-10-10T22:17:26.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.779+0000 7f19a49fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c6110 con 0x7f19a0147550 2023-10-10T22:17:26.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.779+0000 7f199ed9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a00c6f80 0x7f19a00b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:33926/0 (socket says 172.21.15.154:33926) 2023-10-10T22:17:26.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.779+0000 7f199ed9d700 1 -- 172.21.15.154:0/2910839796 learned_addr learned my addr 172.21.15.154:0/2910839796 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:26.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.779+0000 7f199f59e700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a0147550 0x7f19a0165e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.780+0000 7f199ed9d700 1 -- 172.21.15.154:0/2910839796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a0147550 msgr2=0x7f19a0165e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.780+0000 7f199ed9d700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a0147550 0x7f19a0165e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.780+0000 7f199ed9d700 1 -- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19a00ca290 msgr2=0x7f19a00c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:26.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.780+0000 7f199e59c700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19a00ca290 0x7f19a00c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:26.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.780+0000 7f199ed9d700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19a00ca290 0x7f19a00c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:26.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.780+0000 7f199ed9d700 1 -- 172.21.15.154:0/2910839796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998009ae0 con 0x7f19a00c6f80 2023-10-10T22:17:26.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.780+0000 7f199e59c700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19a00ca290 0x7f19a00c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:26.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.780+0000 7f199ed9d700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a00c6f80 0x7f19a00b13d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f199000c7c0 tx=0x7f1990007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:26.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.780+0000 7f1986ffd700 1 -- 172.21.15.154:0/2910839796 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990005a70 con 0x7f19a00c6f80 2023-10-10T22:17:26.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.781+0000 7f1986ffd700 1 -- 172.21.15.154:0/2910839796 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990005bd0 con 0x7f19a00c6f80 2023-10-10T22:17:26.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.781+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a0166340 con 0x7f19a00c6f80 2023-10-10T22:17:26.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.781+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a00c50f0 con 0x7f19a00c6f80 2023-10-10T22:17:26.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.781+0000 7f1986ffd700 1 -- 172.21.15.154:0/2910839796 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900070f0 con 0x7f19a00c6f80 2023-10-10T22:17:26.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.784+0000 7f1986ffd700 1 -- 172.21.15.154:0/2910839796 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f1990007460 con 0x7f19a00c6f80 2023-10-10T22:17:26.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.786+0000 7f1986ffd700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f198c0671a0 0x7f198c069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:26.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.786+0000 7f1986ffd700 1 -- 172.21.15.154:0/2910839796 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f1990084440 con 0x7f19a00c6f80 2023-10-10T22:17:26.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.786+0000 7f199e59c700 1 -- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f198c0671a0 msgr2=0x7f198c069650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:26.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.786+0000 7f199e59c700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f198c0671a0 0x7f198c069650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:26.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.787+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a004c3c0 con 0x7f19a00c6f80 2023-10-10T22:17:26.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.793+0000 7f1986ffd700 1 -- 172.21.15.154:0/2910839796 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1990054d50 con 0x7f19a00c6f80 2023-10-10T22:17:26.847 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:26.846+0000 7f3a54685180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:17:26.874 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:26.872+0000 7f29cd681180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:17:26.943 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:26.943+0000 7f3a54685180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:17:26.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.987+0000 7f199e59c700 1 -- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f198c0671a0 msgr2=0x7f198c069650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:26.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:26.987+0000 7f199e59c700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f198c0671a0 0x7f198c069650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:27.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.044+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19a00b1f40 con 0x7f19a00c6f80 2023-10-10T22:17:27.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.045+0000 7f1986ffd700 1 -- 172.21.15.154:0/2910839796 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f19900548e0 con 0x7f19a00c6f80 2023-10-10T22:17:27.047 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:27.047 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/870665959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":870665959},{"type":"v1","addr":"172.21.15.179:6835","nonce":870665959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7723,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/338355165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":338355165},{"type":"v1","addr":"172.21.15.154:6835","nonce":338355165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1799386063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1799386063},{"type":"v1","addr":"172.21.15.179:6834","nonce":1799386063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:21:21.107292+0000","modified":"2023-10-10T21:21:24.662772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/2644092047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2644092047},{"type":"v1","addr":"172.21.15.154:6834","nonce":2644092047}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-10T22:17:27.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f198c0671a0 msgr2=0x7f198c069650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:27.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f198c0671a0 0x7f198c069650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a00c6f80 msgr2=0x7f19a00b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a00c6f80 0x7f19a00b13d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f199000c7c0 tx=0x7f1990007f70 comp rx=0 tx=0).stop 2023-10-10T22:17:27.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 shutdown_connections 2023-10-10T22:17:27.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a0147550 0x7f19a0165e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a00c6f80 0x7f19a00b13d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f198c0671a0 0x7f198c069650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 --2- 172.21.15.154:0/2910839796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19a00ca290 0x7f19a00c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 >> 172.21.15.154:0/2910839796 conn(0x7f19a00cc1f0 msgr2=0x7f19a00c1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:27.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 shutdown_connections 2023-10-10T22:17:27.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.048+0000 7f19a49fe700 1 -- 172.21.15.154:0/2910839796 wait complete. 2023-10-10T22:17:27.052 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 62 2023-10-10T22:17:27.053 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:27.051+0000 7f29cd681180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:17:27.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:17:27.155 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:27.154+0000 7f29cd681180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:17:27.240 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:27.239+0000 7f3a54685180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:17:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.253+0000 7ff47d99d700 1 Processor -- start 2023-10-10T22:17:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.253+0000 7ff47d99d700 1 -- start start 2023-10-10T22:17:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.255+0000 7ff47d99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff478159420 0x7ff4780b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.255+0000 7ff47d99d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff4781597f0 0x7ff4780b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.255+0000 7ff47d99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4780b11d0 con 0x7ff47815d230 2023-10-10T22:17:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.255+0000 7ff47d99d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4780b14b0 con 0x7ff4781597f0 2023-10-10T22:17:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.255+0000 7ff47d99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4780b1790 con 0x7ff478159420 2023-10-10T22:17:27.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.255+0000 7ff477fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff4781597f0 0x7ff4780b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:27.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.255+0000 7ff477fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff4781597f0 0x7ff4780b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58164/0 (socket says 172.21.15.154:58164) 2023-10-10T22:17:27.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.255+0000 7ff47c99b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff478159420 0x7ff4780b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:27.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.255+0000 7ff477fff700 1 -- 172.21.15.154:0/3948063002 learned_addr learned my addr 172.21.15.154:0/3948063002 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:27.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.256+0000 7ff477fff700 1 -- 172.21.15.154:0/3948063002 >> v2:172.21.15.179:3300/0 conn(0x7ff478159420 msgr2=0x7ff4780b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:27.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.256+0000 7ff477fff700 1 --2- 172.21.15.154:0/3948063002 >> v2:172.21.15.179:3300/0 conn(0x7ff478159420 0x7ff4780b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.256+0000 7ff477fff700 1 -- 172.21.15.154:0/3948063002 >> v1:172.21.15.154:6789/0 conn(0x7ff47815d230 legacy=0x7ff47815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.256+0000 7ff477fff700 1 -- 172.21.15.154:0/3948063002 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780b1a70 con 0x7ff4781597f0 2023-10-10T22:17:27.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.256+0000 7ff477fff700 1 --2- 172.21.15.154:0/3948063002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 0x7ff4780b2270 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff4780b2f20 tx=0x7ff464009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da26a467554fecad server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:27.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.256+0000 7ff4777fe700 1 -- 172.21.15.154:0/3948063002 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464009e70 con 0x7ff4781597f0 2023-10-10T22:17:27.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.256+0000 7ff4777fe700 1 -- 172.21.15.154:0/3948063002 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400b860 con 0x7ff4781597f0 2023-10-10T22:17:27.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.256+0000 7ff4777fe700 1 -- 172.21.15.154:0/3948063002 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400bc00 con 0x7ff4781597f0 2023-10-10T22:17:27.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.257+0000 7ff47d99d700 1 -- 172.21.15.154:0/3948063002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 msgr2=0x7ff4780b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.257+0000 7ff47d99d700 1 --2- 172.21.15.154:0/3948063002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 0x7ff4780b2270 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff4780b2f20 tx=0x7ff464009250 comp rx=0 tx=0).stop 2023-10-10T22:17:27.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.257+0000 7ff47d99d700 1 -- 172.21.15.154:0/3948063002 shutdown_connections 2023-10-10T22:17:27.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.257+0000 7ff47d99d700 1 --2- 172.21.15.154:0/3948063002 >> v2:172.21.15.179:3300/0 conn(0x7ff478159420 0x7ff4780b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.257+0000 7ff47d99d700 1 --2- 172.21.15.154:0/3948063002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 0x7ff4780b2270 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.257+0000 7ff47d99d700 1 -- 172.21.15.154:0/3948063002 >> 172.21.15.154:0/3948063002 conn(0x7ff4780d0660 msgr2=0x7ff4780d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:27.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.257+0000 7ff47d99d700 1 -- 172.21.15.154:0/3948063002 shutdown_connections 2023-10-10T22:17:27.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.257+0000 7ff47d99d700 1 -- 172.21.15.154:0/3948063002 wait complete. 2023-10-10T22:17:27.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.259+0000 7ff47d99d700 1 Processor -- start 2023-10-10T22:17:27.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.259+0000 7ff47d99d700 1 -- start start 2023-10-10T22:17:27.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff47d99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff478159420 0x7ff478153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff47d99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 0x7ff47816a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff47d99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47815d230 0x7ff4780c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff47d99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47816ad20 con 0x7ff4781597f0 2023-10-10T22:17:27.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff47d99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47816bb80 con 0x7ff478159420 2023-10-10T22:17:27.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff47d99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4781535c0 con 0x7ff47815d230 2023-10-10T22:17:27.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff477fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 0x7ff47816a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:27.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff477fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 0x7ff47816a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58172/0 (socket says 172.21.15.154:58172) 2023-10-10T22:17:27.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff477fff700 1 -- 172.21.15.154:0/3543517298 learned_addr learned my addr 172.21.15.154:0/3543517298 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:27.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff47c99b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff478159420 0x7ff478153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:27.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff47d19c700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47815d230 0x7ff4780c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:27.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff477fff700 1 -- 172.21.15.154:0/3543517298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47815d230 msgr2=0x7ff4780c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff477fff700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47815d230 0x7ff4780c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff477fff700 1 -- 172.21.15.154:0/3543517298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff478159420 msgr2=0x7ff478153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff477fff700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff478159420 0x7ff478153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff477fff700 1 -- 172.21.15.154:0/3543517298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640094f0 con 0x7ff4781597f0 2023-10-10T22:17:27.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.260+0000 7ff47c99b700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff478159420 0x7ff478153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:27.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.261+0000 7ff477fff700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 0x7ff47816a5a0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff478089340 tx=0x7ff464017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:27.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.261+0000 7ff474ff9700 1 -- 172.21.15.154:0/3543517298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400bbe0 con 0x7ff4781597f0 2023-10-10T22:17:27.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.261+0000 7ff474ff9700 1 -- 172.21.15.154:0/3543517298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464011420 con 0x7ff4781597f0 2023-10-10T22:17:27.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.261+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47816aae0 con 0x7ff4781597f0 2023-10-10T22:17:27.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.261+0000 7ff474ff9700 1 -- 172.21.15.154:0/3543517298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640117e0 con 0x7ff4781597f0 2023-10-10T22:17:27.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.261+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47816b250 con 0x7ff4781597f0 2023-10-10T22:17:27.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.262+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47816bcf0 con 0x7ff4781597f0 2023-10-10T22:17:27.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.264+0000 7ff474ff9700 1 -- 172.21.15.154:0/3543517298 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff464011c10 con 0x7ff4781597f0 2023-10-10T22:17:27.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.265+0000 7ff474ff9700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff45c067050 0x7ff45c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.265+0000 7ff474ff9700 1 -- 172.21.15.154:0/3543517298 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7ff4640862c0 con 0x7ff4781597f0 2023-10-10T22:17:27.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.265+0000 7ff47c99b700 1 -- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff45c067050 msgr2=0x7ff45c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:27.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.265+0000 7ff47c99b700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff45c067050 0x7ff45c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:27.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.270+0000 7ff474ff9700 1 -- 172.21.15.154:0/3543517298 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4640530e0 con 0x7ff4781597f0 2023-10-10T22:17:27.337 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:27.337+0000 7f3a54685180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:17:27.460 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:27.458+0000 7f29cd681180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:17:27.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.466+0000 7ff47c99b700 1 -- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff45c067050 msgr2=0x7ff45c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:27.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.466+0000 7ff47c99b700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff45c067050 0x7ff45c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.508+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff47804c3c0 con 0x7ff4781597f0 2023-10-10T22:17:27.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.508+0000 7ff474ff9700 1 -- 172.21.15.154:0/3543517298 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4605 (secure 0 0 0) 0x7ff464056700 con 0x7ff4781597f0 2023-10-10T22:17:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:27.511 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/870665959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":870665959},{"type":"v1","addr":"172.21.15.179:6835","nonce":870665959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7723,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/338355165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":338355165},{"type":"v1","addr":"172.21.15.154:6835","nonce":338355165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1799386063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1799386063},{"type":"v1","addr":"172.21.15.179:6834","nonce":1799386063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T21:21:21.107292+0000","modified":"2023-10-10T21:21:24.662772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/2644092047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2644092047},{"type":"v1","addr":"172.21.15.154:6834","nonce":2644092047}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-10T22:17:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff45c067050 msgr2=0x7ff45c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff45c067050 0x7ff45c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 msgr2=0x7ff47816a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 0x7ff47816a5a0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff478089340 tx=0x7ff464017000 comp rx=0 tx=0).stop 2023-10-10T22:17:27.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 shutdown_connections 2023-10-10T22:17:27.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47815d230 0x7ff4780c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff478159420 0x7ff478153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff45c067050 0x7ff45c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 --2- 172.21.15.154:0/3543517298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4781597f0 0x7ff47816a5a0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 >> 172.21.15.154:0/3543517298 conn(0x7ff4780d0660 msgr2=0x7ff47815d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:27.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 shutdown_connections 2023-10-10T22:17:27.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.511+0000 7ff47d99d700 1 -- 172.21.15.154:0/3543517298 wait complete. 2023-10-10T22:17:27.516 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 62 2023-10-10T22:17:27.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:17:27.564 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:27.562+0000 7f29cd681180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:17:27.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.717+0000 7f472b5ff700 1 Processor -- start 2023-10-10T22:17:27.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.717+0000 7f472b5ff700 1 -- start start 2023-10-10T22:17:27.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.719+0000 7f472b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 0x7f4724155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.719+0000 7f472b5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240acac0 con 0x7f47240ac6a0 2023-10-10T22:17:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.719+0000 7f472b5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240ad930 con 0x7f47240ac230 2023-10-10T22:17:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.719+0000 7f472b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240acd20 con 0x7f4724155c10 2023-10-10T22:17:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.719+0000 7f4729b9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f47240ac6a0 0x7f47240b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38824/0 (socket says 172.21.15.154:38824) 2023-10-10T22:17:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.719+0000 7f4729b9c700 1 -- 172.21.15.154:0/3854828888 learned_addr learned my addr 172.21.15.154:0/3854828888 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.719+0000 7f472939b700 1 --2- 172.21.15.154:0/3854828888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 0x7f4724155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.719+0000 7f471bfff700 1 -- 172.21.15.154:0/3854828888 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027838483 0 0) 0x7f47240acac0 con 0x7f47240ac6a0 2023-10-10T22:17:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f471bfff700 1 -- 172.21.15.154:0/3854828888 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4710003570 con 0x7f47240ac6a0 2023-10-10T22:17:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f471bfff700 1 -- 172.21.15.154:0/3854828888 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412295338 0 0) 0x7f47240ad930 con 0x7f47240ac230 2023-10-10T22:17:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f471bfff700 1 -- 172.21.15.154:0/3854828888 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47240acac0 con 0x7f47240ac230 2023-10-10T22:17:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f471bfff700 1 -- 172.21.15.154:0/3854828888 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 98131222 0 0) 0x7f4710003570 con 0x7f47240ac6a0 2023-10-10T22:17:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f472939b700 1 -- 172.21.15.154:0/3854828888 >> v1:172.21.15.179:6789/0 conn(0x7f47240ac230 legacy=0x7f47241568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f472939b700 1 -- 172.21.15.154:0/3854828888 >> v1:172.21.15.154:6789/0 conn(0x7f47240ac6a0 legacy=0x7f47240b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f472939b700 1 -- 172.21.15.154:0/3854828888 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240ad000 con 0x7f4724155c10 2023-10-10T22:17:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f472939b700 1 --2- 172.21.15.154:0/3854828888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 0x7f4724155fe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f472000aac0 tx=0x7f472000a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19143aba99e6c4c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f471bfff700 1 -- 172.21.15.154:0/3854828888 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0017f0 con 0x7f4724155c10 2023-10-10T22:17:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f471bfff700 1 -- 172.21.15.154:0/3854828888 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000c660 con 0x7f4724155c10 2023-10-10T22:17:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.720+0000 7f471bfff700 1 -- 172.21.15.154:0/3854828888 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000ca00 con 0x7f4724155c10 2023-10-10T22:17:27.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.721+0000 7f472b5ff700 1 -- 172.21.15.154:0/3854828888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 msgr2=0x7f4724155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.721+0000 7f472b5ff700 1 --2- 172.21.15.154:0/3854828888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 0x7f4724155fe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f472000aac0 tx=0x7f472000a330 comp rx=0 tx=0).stop 2023-10-10T22:17:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.721+0000 7f472b5ff700 1 -- 172.21.15.154:0/3854828888 shutdown_connections 2023-10-10T22:17:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.721+0000 7f472b5ff700 1 --2- 172.21.15.154:0/3854828888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 0x7f4724155fe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.721+0000 7f472b5ff700 1 -- 172.21.15.154:0/3854828888 >> 172.21.15.154:0/3854828888 conn(0x7f472406a320 msgr2=0x7f47240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.721+0000 7f472b5ff700 1 -- 172.21.15.154:0/3854828888 shutdown_connections 2023-10-10T22:17:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.721+0000 7f472b5ff700 1 -- 172.21.15.154:0/3854828888 wait complete. 2023-10-10T22:17:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.723+0000 7f472b5ff700 1 Processor -- start 2023-10-10T22:17:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.723+0000 7f472b5ff700 1 -- start start 2023-10-10T22:17:27.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472b5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47240ac230 0x7f472414bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472b5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47240ac6a0 0x7f47240aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 0x7f47240a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472b5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724167850 con 0x7f47240ac230 2023-10-10T22:17:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472b5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240c9ed0 con 0x7f47240ac6a0 2023-10-10T22:17:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240ca1b0 con 0x7f4724155c10 2023-10-10T22:17:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47240ac230 0x7f472414bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47240ac230 0x7f472414bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58174/0 (socket says 172.21.15.154:58174) 2023-10-10T22:17:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472939b700 1 -- 172.21.15.154:0/3934423005 learned_addr learned my addr 172.21.15.154:0/3934423005 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f4728b9a700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47240ac6a0 0x7f47240aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f4729b9c700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 0x7f47240a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472939b700 1 -- 172.21.15.154:0/3934423005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 msgr2=0x7f47240a5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472939b700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 0x7f47240a5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472939b700 1 -- 172.21.15.154:0/3934423005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47240ac6a0 msgr2=0x7f47240aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472939b700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47240ac6a0 0x7f47240aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.724+0000 7f472939b700 1 -- 172.21.15.154:0/3934423005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472000a5d0 con 0x7f47240ac230 2023-10-10T22:17:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.725+0000 7f472939b700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47240ac230 0x7f472414bbf0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f472000a370 tx=0x7f4720019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.725+0000 7f47197fa700 1 -- 172.21.15.154:0/3934423005 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000c9e0 con 0x7f47240ac230 2023-10-10T22:17:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.725+0000 7f47197fa700 1 -- 172.21.15.154:0/3934423005 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000ce40 con 0x7f47240ac230 2023-10-10T22:17:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.725+0000 7f47197fa700 1 -- 172.21.15.154:0/3934423005 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720021680 con 0x7f47240ac230 2023-10-10T22:17:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.725+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240ca490 con 0x7f47240ac230 2023-10-10T22:17:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.725+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47240ab1b0 con 0x7f47240ac230 2023-10-10T22:17:27.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.726+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472404c3c0 con 0x7f47240ac230 2023-10-10T22:17:27.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.727+0000 7f47197fa700 1 -- 172.21.15.154:0/3934423005 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f47200103f0 con 0x7f47240ac230 2023-10-10T22:17:27.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.728+0000 7f47197fa700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4708067050 0x7f4708069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:27.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.728+0000 7f47197fa700 1 -- 172.21.15.154:0/3934423005 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f4720085e10 con 0x7f47240ac230 2023-10-10T22:17:27.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.728+0000 7f4728b9a700 1 -- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4708067050 msgr2=0x7f4708069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:27.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.728+0000 7f4728b9a700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4708067050 0x7f4708069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.733+0000 7f47197fa700 1 -- 172.21.15.154:0/3934423005 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4720089030 con 0x7f47240ac230 2023-10-10T22:17:27.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.928+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47240cb570 con 0x7f47240ac230 2023-10-10T22:17:27.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.929+0000 7f4728b9a700 1 -- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4708067050 msgr2=0x7f4708069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:27.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.929+0000 7f4728b9a700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4708067050 0x7f4708069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:27.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.929+0000 7f47197fa700 1 -- 172.21.15.154:0/3934423005 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f4720026020 con 0x7f47240ac230 2023-10-10T22:17:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:27.932 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":148,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:17:24.993162+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-10T21:21:19.349593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-10T21:21:20.103524+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":148,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.17","mappings":[{"from":0,"to":5}]},{"pgid":"17.1a","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/4186944763":"2023-10-11T21:21:42.366210+0000","172.21.15.154:6837/85496":"2023-10-11T21:21:42.366210+0000","172.21.15.154:6836/85496":"2023-10-11T21:21:42.366210+0000","172.21.15.154:0/1388064849":"2023-10-11T21:21:42.366210+0000","172.21.15.154:0/3956169508":"2023-10-11T21:21:42.366210+0000","172.21.15.154:0/1564590861":"2023-10-11T21:21:42.366210+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:17:27.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4708067050 msgr2=0x7f4708069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:27.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4708067050 0x7f4708069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47240ac230 msgr2=0x7f472414bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:27.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47240ac230 0x7f472414bbf0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f472000a370 tx=0x7f4720019000 comp rx=0 tx=0).stop 2023-10-10T22:17:27.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 shutdown_connections 2023-10-10T22:17:27.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724155c10 0x7f47240a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4708067050 0x7f4708069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47240ac230 0x7f472414bbf0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 --2- 172.21.15.154:0/3934423005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47240ac6a0 0x7f47240aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:27.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.931+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 >> 172.21.15.154:0/3934423005 conn(0x7f472406a320 msgr2=0x7f472406e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:27.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.932+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 shutdown_connections 2023-10-10T22:17:27.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:27.932+0000 7f472b5ff700 1 -- 172.21.15.154:0/3934423005 wait complete. 2023-10-10T22:17:27.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T22:17:28.040 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:28.040+0000 7f3a54685180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:17:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.177+0000 7f6d08f9d700 1 Processor -- start 2023-10-10T22:17:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.177+0000 7f6d08f9d700 1 -- start start 2023-10-10T22:17:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.178+0000 7f6d08f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d040ad870 0x7f6d0406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.178+0000 7f6d08f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d0406bf20 0x7f6d0406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.178+0000 7f6d08f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d040b40f0 con 0x7f6d04142ea0 2023-10-10T22:17:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.178+0000 7f6d08f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0406c3a0 con 0x7f6d040ad870 2023-10-10T22:17:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.178+0000 7f6d08f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d04069640 con 0x7f6d0406bf20 2023-10-10T22:17:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d02ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d040ad870 0x7f6d0406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d02ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d040ad870 0x7f6d0406b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58188/0 (socket says 172.21.15.154:58188) 2023-10-10T22:17:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d02ffd700 1 -- 172.21.15.154:0/618575336 learned_addr learned my addr 172.21.15.154:0/618575336 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d03fff700 1 --2- 172.21.15.154:0/618575336 >> v2:172.21.15.179:3300/0 conn(0x7f6d0406bf20 0x7f6d0406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d02ffd700 1 -- 172.21.15.154:0/618575336 >> v2:172.21.15.179:3300/0 conn(0x7f6d0406bf20 msgr2=0x7f6d0406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d02ffd700 1 --2- 172.21.15.154:0/618575336 >> v2:172.21.15.179:3300/0 conn(0x7f6d0406bf20 0x7f6d0406a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d02ffd700 1 -- 172.21.15.154:0/618575336 >> v1:172.21.15.154:6789/0 conn(0x7f6d04142ea0 legacy=0x7f6d040b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d02ffd700 1 -- 172.21.15.154:0/618575336 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d04069920 con 0x7f6d040ad870 2023-10-10T22:17:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d03fff700 1 --2- 172.21.15.154:0/618575336 >> v2:172.21.15.179:3300/0 conn(0x7f6d0406bf20 0x7f6d0406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.179+0000 7f6d02ffd700 1 --2- 172.21.15.154:0/618575336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040ad870 0x7f6d0406b9e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6d04071330 tx=0x7f6cf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a4e68a2da752ab server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:28.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d027fc700 1 -- 172.21.15.154:0/618575336 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800b860 con 0x7f6d040ad870 2023-10-10T22:17:28.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d027fc700 1 -- 172.21.15.154:0/618575336 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf800b9c0 con 0x7f6d040ad870 2023-10-10T22:17:28.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d027fc700 1 -- 172.21.15.154:0/618575336 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800bd60 con 0x7f6d040ad870 2023-10-10T22:17:28.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d08f9d700 1 -- 172.21.15.154:0/618575336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040ad870 msgr2=0x7f6d0406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d08f9d700 1 --2- 172.21.15.154:0/618575336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040ad870 0x7f6d0406b9e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6d04071330 tx=0x7f6cf8009250 comp rx=0 tx=0).stop 2023-10-10T22:17:28.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d08f9d700 1 -- 172.21.15.154:0/618575336 shutdown_connections 2023-10-10T22:17:28.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d08f9d700 1 --2- 172.21.15.154:0/618575336 >> v2:172.21.15.179:3300/0 conn(0x7f6d0406bf20 0x7f6d0406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d08f9d700 1 --2- 172.21.15.154:0/618575336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040ad870 0x7f6d0406b9e0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d08f9d700 1 -- 172.21.15.154:0/618575336 >> 172.21.15.154:0/618575336 conn(0x7f6d040ce430 msgr2=0x7f6d040ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:28.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d08f9d700 1 -- 172.21.15.154:0/618575336 shutdown_connections 2023-10-10T22:17:28.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.180+0000 7f6d08f9d700 1 -- 172.21.15.154:0/618575336 wait complete. 2023-10-10T22:17:28.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.182+0000 7f6d08f9d700 1 Processor -- start 2023-10-10T22:17:28.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.182+0000 7f6d08f9d700 1 -- start start 2023-10-10T22:17:28.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d08f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0406bf20 0x7f6d040c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d08f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d04142ea0 0x7f6d040c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d08f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040c90e0 0x7f6d0416a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d08f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040ca2b0 con 0x7f6d040c90e0 2023-10-10T22:17:28.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d08f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040c96a0 con 0x7f6d0406bf20 2023-10-10T22:17:28.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d08f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040c9980 con 0x7f6d04142ea0 2023-10-10T22:17:28.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d03fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040c90e0 0x7f6d0416a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:28.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d03fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040c90e0 0x7f6d0416a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58192/0 (socket says 172.21.15.154:58192) 2023-10-10T22:17:28.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d03fff700 1 -- 172.21.15.154:0/1082606031 learned_addr learned my addr 172.21.15.154:0/1082606031 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:28.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d02ffd700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d04142ea0 0x7f6d040c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:28.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.183+0000 7f6d037fe700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0406bf20 0x7f6d040c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:28.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6d03fff700 1 -- 172.21.15.154:0/1082606031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d04142ea0 msgr2=0x7f6d040c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6d03fff700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d04142ea0 0x7f6d040c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6d03fff700 1 -- 172.21.15.154:0/1082606031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0406bf20 msgr2=0x7f6d040c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6d03fff700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0406bf20 0x7f6d040c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6d03fff700 1 -- 172.21.15.154:0/1082606031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf80094f0 con 0x7f6d040c90e0 2023-10-10T22:17:28.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6d03fff700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040c90e0 0x7f6d0416a170 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00d180 tx=0x7f6cfc009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:28.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6ceb7fe700 1 -- 172.21.15.154:0/1082606031 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc00dcc0 con 0x7f6d040c90e0 2023-10-10T22:17:28.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6ceb7fe700 1 -- 172.21.15.154:0/1082606031 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc00f040 con 0x7f6d040c90e0 2023-10-10T22:17:28.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6ceb7fe700 1 -- 172.21.15.154:0/1082606031 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc015690 con 0x7f6d040c90e0 2023-10-10T22:17:28.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d040c9c60 con 0x7f6d040c90e0 2023-10-10T22:17:28.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.184+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0416a6b0 con 0x7f6d040c90e0 2023-10-10T22:17:28.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.185+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0415f180 con 0x7f6d040c90e0 2023-10-10T22:17:28.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.187+0000 7f6ceb7fe700 1 -- 172.21.15.154:0/1082606031 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6cfc01e3b0 con 0x7f6d040c90e0 2023-10-10T22:17:28.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.188+0000 7f6ceb7fe700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6cf0067050 0x7f6cf0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.188+0000 7f6ceb7fe700 1 -- 172.21.15.154:0/1082606031 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f6cfc0854b0 con 0x7f6d040c90e0 2023-10-10T22:17:28.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.188+0000 7f6d037fe700 1 -- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6cf0067050 msgr2=0x7f6cf0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:28.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.188+0000 7f6d037fe700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6cf0067050 0x7f6cf0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:28.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.191+0000 7f6ceb7fe700 1 -- 172.21.15.154:0/1082606031 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cfc0521a0 con 0x7f6d040c90e0 2023-10-10T22:17:28.305 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:28.304+0000 7f29cd681180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:17:28.325 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:28.324+0000 7f3a54685180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:17:28.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.389+0000 7f6d037fe700 1 -- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6cf0067050 msgr2=0x7f6cf0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:28.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.389+0000 7f6d037fe700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6cf0067050 0x7f6cf0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:28.417 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:28.416+0000 7f3a54685180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:17:28.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.429+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6d0404c3c0 con 0x7f6d040c90e0 2023-10-10T22:17:28.431 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T22:17:28.430+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T22:17:28.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.436+0000 7f6ceb7fe700 1 -- 172.21.15.154:0/1082606031 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6cfc0557c0 con 0x7f6d040c90e0 2023-10-10T22:17:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.439+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6cf0067050 msgr2=0x7f6cf0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.439+0000 7f6d08f9d700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6cf0067050 0x7f6cf0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.439+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040c90e0 msgr2=0x7f6d0416a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.439+0000 7f6d08f9d700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040c90e0 0x7f6d0416a170 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00d180 tx=0x7f6cfc009a50 comp rx=0 tx=0).stop 2023-10-10T22:17:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.440+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 shutdown_connections 2023-10-10T22:17:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.440+0000 7f6d08f9d700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6cf0067050 0x7f6cf0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.440+0000 7f6d08f9d700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d040c90e0 0x7f6d0416a170 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.440+0000 7f6d08f9d700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0406bf20 0x7f6d040c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.440+0000 7f6d08f9d700 1 --2- 172.21.15.154:0/1082606031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d04142ea0 0x7f6d040c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.440+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 >> 172.21.15.154:0/1082606031 conn(0x7f6d040ce430 msgr2=0x7f6d0415b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.440+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 shutdown_connections 2023-10-10T22:17:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.440+0000 7f6d08f9d700 1 -- 172.21.15.154:0/1082606031 wait complete. 2023-10-10T22:17:28.444 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T22:17:28.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T22:17:28.499 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T22:17:28.573 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:28.572+0000 7f3a54685180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:17:28.605 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:28.603+0000 7f29cd681180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:17:28.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.656+0000 7f1561b9d700 1 Processor -- start 2023-10-10T22:17:28.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.656+0000 7f1561b9d700 1 -- start start 2023-10-10T22:17:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.657+0000 7f1561b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f155c0b1b40 0x7f155c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.657+0000 7f1561b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c0cfb00 con 0x7f155c0b4e70 2023-10-10T22:17:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.657+0000 7f1561b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c0b5c40 con 0x7f155c0b16d0 2023-10-10T22:17:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.657+0000 7f1561b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c0b5f20 con 0x7f155c0b1b40 2023-10-10T22:17:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.657+0000 7f1560b9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f155c0b4e70 0x7f155c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38850/0 (socket says 172.21.15.154:38850) 2023-10-10T22:17:28.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.657+0000 7f1560b9b700 1 -- 172.21.15.154:0/2633974218 learned_addr learned my addr 172.21.15.154:0/2633974218 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:28.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.657+0000 7f156139c700 1 --2- 172.21.15.154:0/2633974218 >> v2:172.21.15.179:3300/0 conn(0x7f155c0b1b40 0x7f155c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:28.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.658+0000 7f155b7fe700 1 -- 172.21.15.154:0/2633974218 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685184245 0 0) 0x7f155c0cfb00 con 0x7f155c0b4e70 2023-10-10T22:17:28.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.658+0000 7f155b7fe700 1 -- 172.21.15.154:0/2633974218 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f154c003570 con 0x7f155c0b4e70 2023-10-10T22:17:28.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.658+0000 7f155b7fe700 1 -- 172.21.15.154:0/2633974218 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971754693 0 0) 0x7f155c0b5c40 con 0x7f155c0b16d0 2023-10-10T22:17:28.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.658+0000 7f155b7fe700 1 -- 172.21.15.154:0/2633974218 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f155c0cfb00 con 0x7f155c0b16d0 2023-10-10T22:17:28.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.658+0000 7f156139c700 1 -- 172.21.15.154:0/2633974218 >> v1:172.21.15.179:6789/0 conn(0x7f155c0b16d0 legacy=0x7f155c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.658+0000 7f156139c700 1 -- 172.21.15.154:0/2633974218 >> v1:172.21.15.154:6789/0 conn(0x7f155c0b4e70 legacy=0x7f155c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.658+0000 7f156139c700 1 -- 172.21.15.154:0/2633974218 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0b6200 con 0x7f155c0b1b40 2023-10-10T22:17:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.658+0000 7f156139c700 1 --2- 172.21.15.154:0/2633974218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b1b40 0x7f155c0b3ac0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1554009e60 tx=0x7f1554009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97fe016c6a295650 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f155b7fe700 1 -- 172.21.15.154:0/2633974218 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400e070 con 0x7f155c0b1b40 2023-10-10T22:17:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f155b7fe700 1 -- 172.21.15.154:0/2633974218 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155400bab0 con 0x7f155c0b1b40 2023-10-10T22:17:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f155b7fe700 1 -- 172.21.15.154:0/2633974218 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400be30 con 0x7f155c0b1b40 2023-10-10T22:17:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f1561b9d700 1 -- 172.21.15.154:0/2633974218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b1b40 msgr2=0x7f155c0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f1561b9d700 1 --2- 172.21.15.154:0/2633974218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b1b40 0x7f155c0b3ac0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1554009e60 tx=0x7f1554009780 comp rx=0 tx=0).stop 2023-10-10T22:17:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f1561b9d700 1 -- 172.21.15.154:0/2633974218 shutdown_connections 2023-10-10T22:17:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f1561b9d700 1 --2- 172.21.15.154:0/2633974218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b1b40 0x7f155c0b3ac0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f1561b9d700 1 -- 172.21.15.154:0/2633974218 >> 172.21.15.154:0/2633974218 conn(0x7f155c0d10c0 msgr2=0x7f155c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f1561b9d700 1 -- 172.21.15.154:0/2633974218 shutdown_connections 2023-10-10T22:17:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.659+0000 7f1561b9d700 1 -- 172.21.15.154:0/2633974218 wait complete. 2023-10-10T22:17:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.661+0000 7f1561b9d700 1 Processor -- start 2023-10-10T22:17:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.661+0000 7f1561b9d700 1 -- start start 2023-10-10T22:17:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f1561b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b16d0 0x7f155c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f1561b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0b1b40 0x7f155c0c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f1561b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f155c0b4e70 0x7f155c156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f1561b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c16d440 con 0x7f155c0b1b40 2023-10-10T22:17:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f1561b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c16e260 con 0x7f155c0b16d0 2023-10-10T22:17:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f1561b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c16d650 con 0x7f155c0b4e70 2023-10-10T22:17:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f155bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0b1b40 0x7f155c0c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f156139c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f155c0b4e70 0x7f155c156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f1560b9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b16d0 0x7f155c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f156139c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f155c0b4e70 0x7f155c156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:54052/0 (socket says 172.21.15.154:54052) 2023-10-10T22:17:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.662+0000 7f156139c700 1 -- 172.21.15.154:0/2319276849 learned_addr learned my addr 172.21.15.154:0/2319276849 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f156139c700 1 -- 172.21.15.154:0/2319276849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b16d0 msgr2=0x7f155c0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f156139c700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b16d0 0x7f155c0c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f156139c700 1 -- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0b1b40 msgr2=0x7f155c0c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f156139c700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0b1b40 0x7f155c0c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f156139c700 1 -- 172.21.15.154:0/2319276849 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1554009a20 con 0x7f155c0b4e70 2023-10-10T22:17:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f1560b9b700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b16d0 0x7f155c0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f156139c700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f155c0b4e70 0x7f155c156ca0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f155c070dd0 tx=0x7f1554019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f1558ff9700 1 -- 172.21.15.154:0/2319276849 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554007000 con 0x7f155c0b4e70 2023-10-10T22:17:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f1558ff9700 1 -- 172.21.15.154:0/2319276849 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554012d00 con 0x7f155c0b4e70 2023-10-10T22:17:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f1558ff9700 1 -- 172.21.15.154:0/2319276849 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540276c0 con 0x7f155c0b4e70 2023-10-10T22:17:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c16d930 con 0x7f155c0b4e70 2023-10-10T22:17:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.663+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c16def0 con 0x7f155c0b4e70 2023-10-10T22:17:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.664+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c16e3d0 con 0x7f155c0b4e70 2023-10-10T22:17:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.666+0000 7f1558ff9700 1 -- 172.21.15.154:0/2319276849 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 70) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f1554024070 con 0x7f155c0b4e70 2023-10-10T22:17:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.667+0000 7f1558ff9700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 0x7f1540069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.667+0000 7f1558ff9700 1 -- 172.21.15.154:0/2319276849 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6571+0+0 (secure 0 0 0) 0x7f1554086fc0 con 0x7f155c0b4e70 2023-10-10T22:17:28.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.667+0000 7f1560b9b700 1 -- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 msgr2=0x7f1540069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:28.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.667+0000 7f1560b9b700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 0x7f1540069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:28.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.672+0000 7f1558ff9700 1 -- 172.21.15.154:0/2319276849 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1554053d20 con 0x7f155c0b4e70 2023-10-10T22:17:28.680 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:28.679+0000 7f3a54685180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:17:28.707 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:28.705+0000 7f29cd681180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:17:28.868 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:28.866+0000 7f29cd681180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:17:28.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.868+0000 7f1560b9b700 1 -- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 msgr2=0x7f1540069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:28.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.868+0000 7f1560b9b700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 0x7f1540069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:28.870 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:28.870+0000 7f3a54685180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:17:28.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:28.916+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f155c0c5390 con 0x7f155c0b4e70 2023-10-10T22:17:28.963 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:28.962+0000 7f3a54685180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:17:28.975 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:28.974+0000 7f29cd681180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:17:29.055 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:29.055+0000 7f3a54685180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:17:29.148 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:29.147+0000 7f3a54685180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:17:29.165 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:29.164+0000 7f29cd681180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:17:29.258 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:29.256+0000 7f29cd681180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:17:29.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.269+0000 7f1560b9b700 1 -- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 msgr2=0x7f1540069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:29.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.269+0000 7f1560b9b700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 0x7f1540069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T22:17:29.352 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:29.350+0000 7f29cd681180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:17:29.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.436+0000 7f1558ff9700 1 -- 172.21.15.154:0/2319276849 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7f155402c0a0 con 0x7f155c0b4e70 2023-10-10T22:17:29.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 msgr2=0x7f1540069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:29.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 0x7f1540069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f155c0b4e70 msgr2=0x7f155c156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:29.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f155c0b4e70 0x7f155c156ca0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f155c070dd0 tx=0x7f1554019000 comp rx=0 tx=0).stop 2023-10-10T22:17:29.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 shutdown_connections 2023-10-10T22:17:29.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f155c0b4e70 0x7f155c156ca0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f155c0b16d0 0x7f155c0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1540067050 0x7f1540069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 --2- 172.21.15.154:0/2319276849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0b1b40 0x7f155c0c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 >> 172.21.15.154:0/2319276849 conn(0x7f155c0d10c0 msgr2=0x7f155c069a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:29.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 shutdown_connections 2023-10-10T22:17:29.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.439+0000 7f1561b9d700 1 -- 172.21.15.154:0/2319276849 wait complete. 2023-10-10T22:17:29.448 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:29.446+0000 7f29cd681180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:17:29.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T22:17:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.692+0000 7f30063ff700 1 Processor -- start 2023-10-10T22:17:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.693+0000 7f30063ff700 1 -- start start 2023-10-10T22:17:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.694+0000 7f30063ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3000069a50 0x7f30000c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.694+0000 7f30063ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3000069e20 0x7f30001569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.694+0000 7f30063ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30000ac030 con 0x7f30000c8490 2023-10-10T22:17:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.694+0000 7f30063ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30000ab820 con 0x7f3000069a50 2023-10-10T22:17:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.694+0000 7f30063ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300006dbb0 con 0x7f3000069e20 2023-10-10T22:17:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.694+0000 7f2ff7fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f30000c8490 0x7f300015a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38856/0 (socket says 172.21.15.154:38856) 2023-10-10T22:17:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.694+0000 7f2ff7fff700 1 -- 172.21.15.154:0/2231119307 learned_addr learned my addr 172.21.15.154:0/2231119307 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f2ffffff700 1 --2- 172.21.15.154:0/2231119307 >> v2:172.21.15.179:3300/0 conn(0x7f3000069a50 0x7f30000c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f300499c700 1 --2- 172.21.15.154:0/2231119307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3000069e20 0x7f30001569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f2fff7fe700 1 -- 172.21.15.154:0/2231119307 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036720383 0 0) 0x7f2fe8001110 con 0x7f30000c8490 2023-10-10T22:17:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f2fff7fe700 1 -- 172.21.15.154:0/2231119307 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fec003570 con 0x7f30000c8490 2023-10-10T22:17:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f2fff7fe700 1 -- 172.21.15.154:0/2231119307 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3111262023 0 0) 0x7f2fec003570 con 0x7f30000c8490 2023-10-10T22:17:29.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f300499c700 1 -- 172.21.15.154:0/2231119307 >> v2:172.21.15.179:3300/0 conn(0x7f3000069a50 msgr2=0x7f30000c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:29.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f300499c700 1 --2- 172.21.15.154:0/2231119307 >> v2:172.21.15.179:3300/0 conn(0x7f3000069a50 0x7f30000c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f300499c700 1 -- 172.21.15.154:0/2231119307 >> v1:172.21.15.154:6789/0 conn(0x7f30000c8490 legacy=0x7f300015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:29.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f300499c700 1 -- 172.21.15.154:0/2231119307 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000aba70 con 0x7f3000069e20 2023-10-10T22:17:29.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f2ffffff700 1 --2- 172.21.15.154:0/2231119307 >> v2:172.21.15.179:3300/0 conn(0x7f3000069a50 0x7f30000c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:29.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.695+0000 7f300499c700 1 --2- 172.21.15.154:0/2231119307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3000069e20 0x7f30001569b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800af70 tx=0x7f2ff800a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b053119cfa093070 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:29.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f2fff7fe700 1 -- 172.21.15.154:0/2231119307 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff800f070 con 0x7f3000069e20 2023-10-10T22:17:29.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f2fff7fe700 1 -- 172.21.15.154:0/2231119307 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff800a0d0 con 0x7f3000069e20 2023-10-10T22:17:29.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f2fff7fe700 1 -- 172.21.15.154:0/2231119307 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8001600 con 0x7f3000069e20 2023-10-10T22:17:29.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f30063ff700 1 -- 172.21.15.154:0/2231119307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3000069e20 msgr2=0x7f30001569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:29.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f30063ff700 1 --2- 172.21.15.154:0/2231119307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3000069e20 0x7f30001569b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800af70 tx=0x7f2ff800a890 comp rx=0 tx=0).stop 2023-10-10T22:17:29.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f30063ff700 1 -- 172.21.15.154:0/2231119307 shutdown_connections 2023-10-10T22:17:29.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f30063ff700 1 --2- 172.21.15.154:0/2231119307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3000069e20 0x7f30001569b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f30063ff700 1 --2- 172.21.15.154:0/2231119307 >> v2:172.21.15.179:3300/0 conn(0x7f3000069a50 0x7f30000c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f30063ff700 1 -- 172.21.15.154:0/2231119307 >> 172.21.15.154:0/2231119307 conn(0x7f30000c8f90 msgr2=0x7f30000c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:29.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f30063ff700 1 -- 172.21.15.154:0/2231119307 shutdown_connections 2023-10-10T22:17:29.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.696+0000 7f30063ff700 1 -- 172.21.15.154:0/2231119307 wait complete. 2023-10-10T22:17:29.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.698+0000 7f30063ff700 1 Processor -- start 2023-10-10T22:17:29.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.698+0000 7f30063ff700 1 -- start start 2023-10-10T22:17:29.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f30063ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3000069a50 0x7f30001694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:29.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f30063ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3000069e20 0x7f30000af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:29.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f30063ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30000c8490 0x7f30000afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:29.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f30063ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30000b2230 con 0x7f3000069e20 2023-10-10T22:17:29.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f30063ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30000c3050 con 0x7f3000069a50 2023-10-10T22:17:29.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f30063ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3000169a20 con 0x7f30000c8490 2023-10-10T22:17:29.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f2ff7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3000069e20 0x7f30000af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:29.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f2ff7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3000069e20 0x7f30000af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58294/0 (socket says 172.21.15.154:58294) 2023-10-10T22:17:29.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f2ff7fff700 1 -- 172.21.15.154:0/3193768650 learned_addr learned my addr 172.21.15.154:0/3193768650 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:29.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f300499c700 1 --2- 172.21.15.154:0/3193768650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30000c8490 0x7f30000afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:29.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f2ffffff700 1 --2- 172.21.15.154:0/3193768650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3000069a50 0x7f30001694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:29.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f2ff7fff700 1 -- 172.21.15.154:0/3193768650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30000c8490 msgr2=0x7f30000afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:29.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.699+0000 7f2ff7fff700 1 --2- 172.21.15.154:0/3193768650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30000c8490 0x7f30000afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.700+0000 7f2ff7fff700 1 -- 172.21.15.154:0/3193768650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3000069a50 msgr2=0x7f30001694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:29.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.700+0000 7f2ff7fff700 1 --2- 172.21.15.154:0/3193768650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3000069a50 0x7f30001694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:29.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.700+0000 7f2ff7fff700 1 -- 172.21.15.154:0/3193768650 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff0009420 con 0x7f3000069e20 2023-10-10T22:17:29.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.700+0000 7f2ff7fff700 1 --2- 172.21.15.154:0/3193768650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3000069e20 0x7f30000af460 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800cb90 tx=0x7f2fe8001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:29.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.700+0000 7f2ffcff9700 1 -- 172.21.15.154:0/3193768650 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800cea0 con 0x7f3000069e20 2023-10-10T22:17:29.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.700+0000 7f2ffcff9700 1 -- 172.21.15.154:0/3193768650 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8007e90 con 0x7f3000069e20 2023-10-10T22:17:29.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.700+0000 7f2ffcff9700 1 -- 172.21.15.154:0/3193768650 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80075b0 con 0x7f3000069e20 2023-10-10T22:17:29.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.700+0000 7f30063ff700 1 -- 172.21.15.154:0/3193768650 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff800ab30 con 0x7f3000069e20 2023-10-10T22:17:29.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.700+0000 7f30063ff700 1 -- 172.21.15.154:0/3193768650 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30000c2720 con 0x7f3000069e20 2023-10-10T22:17:29.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.701+0000 7f30063ff700 1 -- 172.21.15.154:0/3193768650 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30000718b0 con 0x7f3000069e20 2023-10-10T22:17:29.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.702+0000 7f2ffcff9700 1 -- 172.21.15.154:0/3193768650 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 71) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f2fe8004a40 con 0x7f3000069e20 2023-10-10T22:17:29.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.703+0000 7f2ffcff9700 1 -- 172.21.15.154:0/3193768650 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6829+0+0 (secure 0 0 0) 0x7f2fe8083b80 con 0x7f3000069e20 2023-10-10T22:17:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.707+0000 7f2ffcff9700 1 -- 172.21.15.154:0/3193768650 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fe8050ce0 con 0x7f3000069e20 2023-10-10T22:17:29.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:29.901+0000 7f30063ff700 1 -- 172.21.15.154:0/3193768650 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f30000ac030 con 0x7f3000069e20 2023-10-10T22:17:30.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.456+0000 7f2ffcff9700 1 -- 172.21.15.154:0/3193768650 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v151) v1 ==== 181+0+0 (secure 0 0 0) 0x7f30000ac030 con 0x7f3000069e20 2023-10-10T22:17:30.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.460+0000 7f30063ff700 1 -- 172.21.15.154:0/3193768650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3000069e20 msgr2=0x7f30000af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:30.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.460+0000 7f30063ff700 1 --2- 172.21.15.154:0/3193768650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3000069e20 0x7f30000af460 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800cb90 tx=0x7f2fe8001450 comp rx=0 tx=0).stop 2023-10-10T22:17:30.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.460+0000 7f30063ff700 1 -- 172.21.15.154:0/3193768650 shutdown_connections 2023-10-10T22:17:30.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.460+0000 7f30063ff700 1 --2- 172.21.15.154:0/3193768650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30000c8490 0x7f30000afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.460+0000 7f30063ff700 1 --2- 172.21.15.154:0/3193768650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3000069a50 0x7f30001694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.460+0000 7f30063ff700 1 --2- 172.21.15.154:0/3193768650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3000069e20 0x7f30000af460 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.460+0000 7f30063ff700 1 -- 172.21.15.154:0/3193768650 >> 172.21.15.154:0/3193768650 conn(0x7f30000c8f90 msgr2=0x7f30000caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:30.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.460+0000 7f30063ff700 1 -- 172.21.15.154:0/3193768650 shutdown_connections 2023-10-10T22:17:30.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.460+0000 7f30063ff700 1 -- 172.21.15.154:0/3193768650 wait complete. 2023-10-10T22:17:30.464 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T22:17:30.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T22:17:30.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.677+0000 7fc7725ff700 1 Processor -- start 2023-10-10T22:17:30.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.677+0000 7fc7725ff700 1 -- start start 2023-10-10T22:17:30.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.678+0000 7fc7725ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc76c069a50 0x7fc76c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:30.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.678+0000 7fc7725ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc76c0c8490 0x7fc76c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:30.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.678+0000 7fc7725ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 0x7fc76c06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:30.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.678+0000 7fc7725ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0ac030 con 0x7fc76c069a50 2023-10-10T22:17:30.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc7725ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0ab820 con 0x7fc76c0c8490 2023-10-10T22:17:30.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc7725ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c06dbb0 con 0x7fc76c069e20 2023-10-10T22:17:30.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc76bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc76c069a50 0x7fc76c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:30.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc76bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc76c069a50 0x7fc76c0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58308/0 (socket says 172.21.15.154:58308) 2023-10-10T22:17:30.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc76bfff700 1 -- 172.21.15.154:0/1003666309 learned_addr learned my addr 172.21.15.154:0/1003666309 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:30.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc770b9c700 1 --2- 172.21.15.154:0/1003666309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 0x7fc76c06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:30.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc763fff700 1 --2- 172.21.15.154:0/1003666309 >> v2:172.21.15.179:3300/0 conn(0x7fc76c0c8490 0x7fc76c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:30.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc76bfff700 1 -- 172.21.15.154:0/1003666309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 msgr2=0x7fc76c06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:30.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc76bfff700 1 --2- 172.21.15.154:0/1003666309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 0x7fc76c06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc76bfff700 1 -- 172.21.15.154:0/1003666309 >> v2:172.21.15.179:3300/0 conn(0x7fc76c0c8490 msgr2=0x7fc76c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:30.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc76bfff700 1 --2- 172.21.15.154:0/1003666309 >> v2:172.21.15.179:3300/0 conn(0x7fc76c0c8490 0x7fc76c15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc76bfff700 1 -- 172.21.15.154:0/1003666309 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c15a9d0 con 0x7fc76c069a50 2023-10-10T22:17:30.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc763fff700 1 --2- 172.21.15.154:0/1003666309 >> v2:172.21.15.179:3300/0 conn(0x7fc76c0c8490 0x7fc76c15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:30.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.679+0000 7fc770b9c700 1 --2- 172.21.15.154:0/1003666309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 0x7fc76c06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:30.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.680+0000 7fc76bfff700 1 --2- 172.21.15.154:0/1003666309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 0x7fc76c0c6ac0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc76c06b920 tx=0x7fc75c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cbd39c1c36928 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:30.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.680+0000 7fc76b7fe700 1 -- 172.21.15.154:0/1003666309 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00b820 con 0x7fc76c069a50 2023-10-10T22:17:30.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.680+0000 7fc76b7fe700 1 -- 172.21.15.154:0/1003666309 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c00b980 con 0x7fc76c069a50 2023-10-10T22:17:30.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.680+0000 7fc76b7fe700 1 -- 172.21.15.154:0/1003666309 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00bd20 con 0x7fc76c069a50 2023-10-10T22:17:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.680+0000 7fc7725ff700 1 -- 172.21.15.154:0/1003666309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 msgr2=0x7fc76c0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.680+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1003666309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 0x7fc76c0c6ac0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc76c06b920 tx=0x7fc75c009250 comp rx=0 tx=0).stop 2023-10-10T22:17:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.681+0000 7fc7725ff700 1 -- 172.21.15.154:0/1003666309 shutdown_connections 2023-10-10T22:17:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.681+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1003666309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 0x7fc76c06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.681+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1003666309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 0x7fc76c0c6ac0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.681+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1003666309 >> v2:172.21.15.179:3300/0 conn(0x7fc76c0c8490 0x7fc76c15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.681+0000 7fc7725ff700 1 -- 172.21.15.154:0/1003666309 >> 172.21.15.154:0/1003666309 conn(0x7fc76c0c8f90 msgr2=0x7fc76c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.681+0000 7fc7725ff700 1 -- 172.21.15.154:0/1003666309 shutdown_connections 2023-10-10T22:17:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.681+0000 7fc7725ff700 1 -- 172.21.15.154:0/1003666309 wait complete. 2023-10-10T22:17:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.682+0000 7fc7725ff700 1 Processor -- start 2023-10-10T22:17:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.682+0000 7fc7725ff700 1 -- start start 2023-10-10T22:17:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc7725ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 0x7fc76c16ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc7725ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 0x7fc76c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc7725ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0c8490 0x7fc76c0c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc7725ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c154f20 con 0x7fc76c069a50 2023-10-10T22:17:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc7725ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c16b3b0 con 0x7fc76c0c8490 2023-10-10T22:17:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc7725ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0c0bd0 con 0x7fc76c069e20 2023-10-10T22:17:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc76bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 0x7fc76c16ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc76bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 0x7fc76c16ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58322/0 (socket says 172.21.15.154:58322) 2023-10-10T22:17:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc76bfff700 1 -- 172.21.15.154:0/1866504702 learned_addr learned my addr 172.21.15.154:0/1866504702 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc763fff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 0x7fc76c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.683+0000 7fc770b9c700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0c8490 0x7fc76c0c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc76bfff700 1 -- 172.21.15.154:0/1866504702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 msgr2=0x7fc76c153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc76bfff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 0x7fc76c153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc76bfff700 1 -- 172.21.15.154:0/1866504702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0c8490 msgr2=0x7fc76c0c1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:30.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc76bfff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0c8490 0x7fc76c0c1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:30.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc76bfff700 1 -- 172.21.15.154:0/1866504702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0094f0 con 0x7fc76c069a50 2023-10-10T22:17:30.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc76bfff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 0x7fc76c16ae70 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009290 tx=0x7fc75c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:30.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc768ff9700 1 -- 172.21.15.154:0/1866504702 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011d50 con 0x7fc76c069a50 2023-10-10T22:17:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc768ff9700 1 -- 172.21.15.154:0/1866504702 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c01a450 con 0x7fc76c069a50 2023-10-10T22:17:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c0bffc0 con 0x7fc76c069a50 2023-10-10T22:17:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.684+0000 7fc768ff9700 1 -- 172.21.15.154:0/1866504702 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c01a810 con 0x7fc76c069a50 2023-10-10T22:17:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.685+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c0c0580 con 0x7fc76c069a50 2023-10-10T22:17:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.685+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c0718b0 con 0x7fc76c069a50 2023-10-10T22:17:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.686+0000 7fc768ff9700 1 -- 172.21.15.154:0/1866504702 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 72) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fc75c01ab80 con 0x7fc76c069a50 2023-10-10T22:17:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.687+0000 7fc768ff9700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc74c066d80 0x7fc74c069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.687+0000 7fc768ff9700 1 -- 172.21.15.154:0/1866504702 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6391+0+0 (secure 0 0 0) 0x7fc75c0858d0 con 0x7fc76c069a50 2023-10-10T22:17:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.687+0000 7fc763fff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc74c066d80 0x7fc74c069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.688+0000 7fc763fff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc74c066d80 0x7fc74c069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0c2e50 tx=0x7fc754008040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.692+0000 7fc768ff9700 1 -- 172.21.15.154:0/1866504702 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc75c052b40 con 0x7fc76c069a50 2023-10-10T22:17:30.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:30.883+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc76c0c32a0 con 0x7fc76c069a50 2023-10-10T22:17:31.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.470+0000 7fc768ff9700 1 -- 172.21.15.154:0/1866504702 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v152) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc75c056160 con 0x7fc76c069a50 2023-10-10T22:17:31.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc74c066d80 msgr2=0x7fc74c069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:31.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc74c066d80 0x7fc74c069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0c2e50 tx=0x7fc754008040 comp rx=0 tx=0).stop 2023-10-10T22:17:31.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 msgr2=0x7fc76c16ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:31.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 0x7fc76c16ae70 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009290 tx=0x7fc75c017000 comp rx=0 tx=0).stop 2023-10-10T22:17:31.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 shutdown_connections 2023-10-10T22:17:31.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0c8490 0x7fc76c0c1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc74c066d80 0x7fc74c069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c069a50 0x7fc76c16ae70 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 --2- 172.21.15.154:0/1866504702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c069e20 0x7fc76c153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.474+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 >> 172.21.15.154:0/1866504702 conn(0x7fc76c0c8f90 msgr2=0x7fc76c15a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:31.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.475+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 shutdown_connections 2023-10-10T22:17:31.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.475+0000 7fc7725ff700 1 -- 172.21.15.154:0/1866504702 wait complete. 2023-10-10T22:17:31.479 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T22:17:31.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T22:17:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.690+0000 7f7bbdf9d700 1 Processor -- start 2023-10-10T22:17:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.690+0000 7f7bbdf9d700 1 -- start start 2023-10-10T22:17:31.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.691+0000 7f7bbdf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b4e70 0x7f7bb80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:31.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.691+0000 7f7bbdf9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7bb80b1b40 0x7f7bb815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.691+0000 7f7bbdf9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb80cfb00 con 0x7f7bb80b16d0 2023-10-10T22:17:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.691+0000 7f7bbdf9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb80b5c40 con 0x7f7bb80b1b40 2023-10-10T22:17:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.691+0000 7f7bbdf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80b5f20 con 0x7f7bb80b4e70 2023-10-10T22:17:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbd79c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7bb80b1b40 0x7f7bb815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbcf9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b4e70 0x7f7bb80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbd79c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7bb80b1b40 0x7f7bb815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:34140/0 (socket says 172.21.15.154:34140) 2023-10-10T22:17:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bb7fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7bb80b16d0 0x7f7bb815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:53028/0 (socket says 172.21.15.154:53028) 2023-10-10T22:17:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbd79c700 1 -- 172.21.15.154:0/741778536 learned_addr learned my addr 172.21.15.154:0/741778536 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:31.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbcf9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b4e70 0x7f7bb80ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:54180/0 (socket says 172.21.15.154:54180) 2023-10-10T22:17:31.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbd79c700 1 -- 172.21.15.154:0/741778536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b4e70 msgr2=0x7f7bb80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:31.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbd79c700 1 --2- 172.21.15.154:0/741778536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b4e70 0x7f7bb80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbd79c700 1 -- 172.21.15.154:0/741778536 >> v1:172.21.15.179:6789/0 conn(0x7f7bb80b16d0 legacy=0x7f7bb815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:31.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbd79c700 1 -- 172.21.15.154:0/741778536 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80b6200 con 0x7f7bb80b1b40 2023-10-10T22:17:31.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.692+0000 7f7bbd79c700 1 --2- 172.21.15.154:0/741778536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b1b40 0x7f7bb815d950 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00099b0 tx=0x7f7bb0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e76cf809a875f31 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:31.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bb77fe700 1 -- 172.21.15.154:0/741778536 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0009ea0 con 0x7f7bb80b1b40 2023-10-10T22:17:31.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bb77fe700 1 -- 172.21.15.154:0/741778536 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb000b860 con 0x7f7bb80b1b40 2023-10-10T22:17:31.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bb77fe700 1 -- 172.21.15.154:0/741778536 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000bc00 con 0x7f7bb80b1b40 2023-10-10T22:17:31.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/741778536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b1b40 msgr2=0x7f7bb815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:31.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bbdf9d700 1 --2- 172.21.15.154:0/741778536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b1b40 0x7f7bb815d950 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00099b0 tx=0x7f7bb0009250 comp rx=0 tx=0).stop 2023-10-10T22:17:31.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/741778536 shutdown_connections 2023-10-10T22:17:31.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bbdf9d700 1 --2- 172.21.15.154:0/741778536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b1b40 0x7f7bb815d950 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bbdf9d700 1 --2- 172.21.15.154:0/741778536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b4e70 0x7f7bb80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/741778536 >> 172.21.15.154:0/741778536 conn(0x7f7bb80d10c0 msgr2=0x7f7bb80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:31.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/741778536 shutdown_connections 2023-10-10T22:17:31.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.693+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/741778536 wait complete. 2023-10-10T22:17:31.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.695+0000 7f7bbdf9d700 1 Processor -- start 2023-10-10T22:17:31.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.695+0000 7f7bbdf9d700 1 -- start start 2023-10-10T22:17:31.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbdf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b16d0 0x7f7bb81459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:31.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbdf9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb80b1b40 0x7f7bb80c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:31.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbdf9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b4e70 0x7f7bb80c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:31.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbdf9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81585c0 con 0x7f7bb80b1b40 2023-10-10T22:17:31.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbdf9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80c8e00 con 0x7f7bb80b4e70 2023-10-10T22:17:31.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbdf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80c90e0 con 0x7f7bb80b16d0 2023-10-10T22:17:31.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb80b1b40 0x7f7bb80c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbcf9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b16d0 0x7f7bb81459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbcf9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b16d0 0x7f7bb81459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:54188/0 (socket says 172.21.15.154:54188) 2023-10-10T22:17:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbcf9b700 1 -- 172.21.15.154:0/387469219 learned_addr learned my addr 172.21.15.154:0/387469219 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.696+0000 7f7bbd79c700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b4e70 0x7f7bb80c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bb7fff700 1 -- 172.21.15.154:0/387469219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b16d0 msgr2=0x7f7bb81459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bb7fff700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b16d0 0x7f7bb81459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bb7fff700 1 -- 172.21.15.154:0/387469219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b4e70 msgr2=0x7f7bb80c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bb7fff700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b4e70 0x7f7bb80c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bb7fff700 1 -- 172.21.15.154:0/387469219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb00094f0 con 0x7f7bb80b1b40 2023-10-10T22:17:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bbcf9b700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b16d0 0x7f7bb81459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bbd79c700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b4e70 0x7f7bb80c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bb7fff700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb80b1b40 0x7f7bb80c9ea0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400c590 tx=0x7f7ba4007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bb4ff9700 1 -- 172.21.15.154:0/387469219 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4005a70 con 0x7f7bb80b1b40 2023-10-10T22:17:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bb4ff9700 1 -- 172.21.15.154:0/387469219 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba4005bf0 con 0x7f7bb80b1b40 2023-10-10T22:17:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bb4ff9700 1 -- 172.21.15.154:0/387469219 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40070d0 con 0x7f7bb80b1b40 2023-10-10T22:17:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb80c93c0 con 0x7f7bb80b1b40 2023-10-10T22:17:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.697+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb80c9980 con 0x7f7bb80b1b40 2023-10-10T22:17:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.698+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb8088990 con 0x7f7bb80b1b40 2023-10-10T22:17:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.699+0000 7f7bb4ff9700 1 -- 172.21.15.154:0/387469219 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 72) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f7ba4007480 con 0x7f7bb80b1b40 2023-10-10T22:17:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.700+0000 7f7bb4ff9700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7b9c066d80 0x7f7b9c069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.701+0000 7f7bb4ff9700 1 -- 172.21.15.154:0/387469219 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f7ba40836e0 con 0x7f7bb80b1b40 2023-10-10T22:17:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.701+0000 7f7bbcf9b700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7b9c066d80 0x7f7b9c069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.701+0000 7f7bbcf9b700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7b9c066d80 0x7f7b9c069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0099f0 tx=0x7f7bac00b040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.705+0000 7f7bb4ff9700 1 -- 172.21.15.154:0/387469219 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ba4050a60 con 0x7f7bb80b1b40 2023-10-10T22:17:31.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.897+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7bb804bb80 con 0x7f7bb80b1b40 2023-10-10T22:17:31.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.901+0000 7f7bb4ff9700 1 -- 172.21.15.154:0/387469219 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7ba4054080 con 0x7f7bb80b1b40 2023-10-10T22:17:31.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7b9c066d80 msgr2=0x7f7b9c069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:31.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7b9c066d80 0x7f7b9c069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0099f0 tx=0x7f7bac00b040 comp rx=0 tx=0).stop 2023-10-10T22:17:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb80b1b40 msgr2=0x7f7bb80c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb80b1b40 0x7f7bb80c9ea0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400c590 tx=0x7f7ba4007eb0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 shutdown_connections 2023-10-10T22:17:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bb80b4e70 0x7f7bb80c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bb80b16d0 0x7f7bb81459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7b9c066d80 0x7f7b9c069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 --2- 172.21.15.154:0/387469219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb80b1b40 0x7f7bb80c9ea0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.903+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 >> 172.21.15.154:0/387469219 conn(0x7f7bb80d10c0 msgr2=0x7f7bb8159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.904+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 shutdown_connections 2023-10-10T22:17:31.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:31.904+0000 7f7bbdf9d700 1 -- 172.21.15.154:0/387469219 wait complete. 2023-10-10T22:17:31.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T22:17:32.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.108+0000 7fad7d99d700 1 Processor -- start 2023-10-10T22:17:32.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.109+0000 7fad7d99d700 1 -- start start 2023-10-10T22:17:32.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad7d99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad78153900 0x7fad780c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad7d99d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad780c9db0 0x7fad7806a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad7d99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fad78157130 0x7fad7806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad7d99d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7806e150 con 0x7fad780c9db0 2023-10-10T22:17:32.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad7d99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad780c7800 con 0x7fad78157130 2023-10-10T22:17:32.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad7d99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad780c7ae0 con 0x7fad78153900 2023-10-10T22:17:32.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad77fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad780c9db0 0x7fad7806a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad77fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad780c9db0 0x7fad7806a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58338/0 (socket says 172.21.15.154:58338) 2023-10-10T22:17:32.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad77fff700 1 -- 172.21.15.154:0/116501715 learned_addr learned my addr 172.21.15.154:0/116501715 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:32.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad7d19c700 1 --2- 172.21.15.154:0/116501715 >> v2:172.21.15.179:3300/0 conn(0x7fad78157130 0x7fad7806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad7c99b700 1 --2- 172.21.15.154:0/116501715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad78153900 0x7fad780c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad77fff700 1 -- 172.21.15.154:0/116501715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad78153900 msgr2=0x7fad780c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:32.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad77fff700 1 --2- 172.21.15.154:0/116501715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad78153900 0x7fad780c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad77fff700 1 -- 172.21.15.154:0/116501715 >> v2:172.21.15.179:3300/0 conn(0x7fad78157130 msgr2=0x7fad7806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:32.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad77fff700 1 --2- 172.21.15.154:0/116501715 >> v2:172.21.15.179:3300/0 conn(0x7fad78157130 0x7fad7806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.110+0000 7fad77fff700 1 -- 172.21.15.154:0/116501715 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780c7dc0 con 0x7fad780c9db0 2023-10-10T22:17:32.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.111+0000 7fad77fff700 1 --2- 172.21.15.154:0/116501715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad780c9db0 0x7fad7806a000 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fad7806d1e0 tx=0x7fad64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831cb52396ffd8cb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:32.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.111+0000 7fad777fe700 1 -- 172.21.15.154:0/116501715 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6400b860 con 0x7fad780c9db0 2023-10-10T22:17:32.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.111+0000 7fad777fe700 1 -- 172.21.15.154:0/116501715 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6400b9c0 con 0x7fad780c9db0 2023-10-10T22:17:32.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.111+0000 7fad777fe700 1 -- 172.21.15.154:0/116501715 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6400bd60 con 0x7fad780c9db0 2023-10-10T22:17:32.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.111+0000 7fad7d99d700 1 -- 172.21.15.154:0/116501715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad780c9db0 msgr2=0x7fad7806a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.111+0000 7fad7d99d700 1 --2- 172.21.15.154:0/116501715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad780c9db0 0x7fad7806a000 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fad7806d1e0 tx=0x7fad64009250 comp rx=0 tx=0).stop 2023-10-10T22:17:32.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.112+0000 7fad7d99d700 1 -- 172.21.15.154:0/116501715 shutdown_connections 2023-10-10T22:17:32.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.112+0000 7fad7d99d700 1 --2- 172.21.15.154:0/116501715 >> v2:172.21.15.179:3300/0 conn(0x7fad78157130 0x7fad7806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.112+0000 7fad7d99d700 1 --2- 172.21.15.154:0/116501715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad78153900 0x7fad780c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.112+0000 7fad7d99d700 1 --2- 172.21.15.154:0/116501715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad780c9db0 0x7fad7806a000 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.112+0000 7fad7d99d700 1 -- 172.21.15.154:0/116501715 >> 172.21.15.154:0/116501715 conn(0x7fad780cc1e0 msgr2=0x7fad780cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:32.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.112+0000 7fad7d99d700 1 -- 172.21.15.154:0/116501715 shutdown_connections 2023-10-10T22:17:32.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.112+0000 7fad7d99d700 1 -- 172.21.15.154:0/116501715 wait complete. 2023-10-10T22:17:32.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.113+0000 7fad7d99d700 1 Processor -- start 2023-10-10T22:17:32.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.113+0000 7fad7d99d700 1 -- start start 2023-10-10T22:17:32.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad7d99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad780c9db0 0x7fad780ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad7d99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad78153900 0x7fad7814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad7d99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad78157130 0x7fad7814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad7d99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780af350 con 0x7fad78153900 2023-10-10T22:17:32.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad7d99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780af020 con 0x7fad78157130 2023-10-10T22:17:32.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad7d99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad780acdf0 con 0x7fad780c9db0 2023-10-10T22:17:32.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad77fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad78153900 0x7fad7814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad77fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad78153900 0x7fad7814ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58340/0 (socket says 172.21.15.154:58340) 2023-10-10T22:17:32.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad77fff700 1 -- 172.21.15.154:0/2931781189 learned_addr learned my addr 172.21.15.154:0/2931781189 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:32.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad7d19c700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad78157130 0x7fad7814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.114+0000 7fad7c99b700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad780c9db0 0x7fad780ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad77fff700 1 -- 172.21.15.154:0/2931781189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad780c9db0 msgr2=0x7fad780ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad77fff700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad780c9db0 0x7fad780ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad77fff700 1 -- 172.21.15.154:0/2931781189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad78157130 msgr2=0x7fad7814b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad77fff700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad78157130 0x7fad7814b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad77fff700 1 -- 172.21.15.154:0/2931781189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640094f0 con 0x7fad78153900 2023-10-10T22:17:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad7d19c700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad78157130 0x7fad7814b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:32.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad77fff700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad78153900 0x7fad7814ab00 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fad7806ce80 tx=0x7fad64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad74ff9700 1 -- 172.21.15.154:0/2931781189 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64024440 con 0x7fad78153900 2023-10-10T22:17:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad74ff9700 1 -- 172.21.15.154:0/2931781189 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad640245a0 con 0x7fad78153900 2023-10-10T22:17:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad74ff9700 1 -- 172.21.15.154:0/2931781189 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64024960 con 0x7fad78153900 2023-10-10T22:17:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad780ad0d0 con 0x7fad78153900 2023-10-10T22:17:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.115+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad780ad3b0 con 0x7fad78153900 2023-10-10T22:17:32.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.116+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7806c450 con 0x7fad78153900 2023-10-10T22:17:32.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.117+0000 7fad74ff9700 1 -- 172.21.15.154:0/2931781189 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad6401a420 con 0x7fad78153900 2023-10-10T22:17:32.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.118+0000 7fad74ff9700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.118+0000 7fad74ff9700 1 -- 172.21.15.154:0/2931781189 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5919+0+0 (secure 0 0 0) 0x7fad64086400 con 0x7fad78153900 2023-10-10T22:17:32.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.118+0000 7fad7c99b700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.119+0000 7fad7c99b700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fad5c066f30 0x7fad5c0693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006fd0 tx=0x7fad6c008040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:32.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.122+0000 7fad74ff9700 1 -- 172.21.15.154:0/2931781189 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad64053500 con 0x7fad78153900 2023-10-10T22:17:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.313+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fad7806dd20 con 0x7fad78153900 2023-10-10T22:17:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.317+0000 7fad74ff9700 1 -- 172.21.15.154:0/2931781189 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v50) v1 ==== 115+0+0 (secure 0 0 0) 0x7fad64056b20 con 0x7fad78153900 2023-10-10T22:17:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fad5c066f30 msgr2=0x7fad5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fad5c066f30 0x7fad5c0693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006fd0 tx=0x7fad6c008040 comp rx=0 tx=0).stop 2023-10-10T22:17:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad78153900 msgr2=0x7fad7814ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad78153900 0x7fad7814ab00 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fad7806ce80 tx=0x7fad64017000 comp rx=0 tx=0).stop 2023-10-10T22:17:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 shutdown_connections 2023-10-10T22:17:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad78157130 0x7fad7814b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad780c9db0 0x7fad780ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 --2- 172.21.15.154:0/2931781189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad78153900 0x7fad7814ab00 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 >> 172.21.15.154:0/2931781189 conn(0x7fad780cc1e0 msgr2=0x7fad7814ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:32.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 shutdown_connections 2023-10-10T22:17:32.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.320+0000 7fad7d99d700 1 -- 172.21.15.154:0/2931781189 wait complete. 2023-10-10T22:17:32.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T22:17:32.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.526+0000 7f52b27ff700 1 Processor -- start 2023-10-10T22:17:32.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.527+0000 7f52b27ff700 1 -- start start 2023-10-10T22:17:32.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.528+0000 7f52b27ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52ac1568e0 0x7f52ac1616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.528+0000 7f52b27ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac15b0d0 con 0x7f52ac0c83f0 2023-10-10T22:17:32.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.528+0000 7f52b27ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac15a4c0 con 0x7f52ac0ccee0 2023-10-10T22:17:32.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.528+0000 7f52b27ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac15a7a0 con 0x7f52ac1568e0 2023-10-10T22:17:32.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.528+0000 7f52abfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f52ac0c83f0 0x7f52ac0c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38860/0 (socket says 172.21.15.154:38860) 2023-10-10T22:17:32.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.528+0000 7f52abfff700 1 -- 172.21.15.154:0/3644822776 learned_addr learned my addr 172.21.15.154:0/3644822776 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:32.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.528+0000 7f52b0d9c700 1 --2- 172.21.15.154:0/3644822776 >> v2:172.21.15.179:3300/0 conn(0x7f52ac1568e0 0x7f52ac1616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721813008 0 0) 0x7f52ac15b0d0 con 0x7f52ac0c83f0 2023-10-10T22:17:32.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5294003570 con 0x7f52ac0c83f0 2023-10-10T22:17:32.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221367896 0 0) 0x7f52ac15a4c0 con 0x7f52ac0ccee0 2023-10-10T22:17:32.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ac15b0d0 con 0x7f52ac0ccee0 2023-10-10T22:17:32.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1954576223 0 0) 0x7f5294003570 con 0x7f52ac0c83f0 2023-10-10T22:17:32.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 >> v2:172.21.15.179:3300/0 conn(0x7f52ac1568e0 msgr2=0x7f52ac1616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:32.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 --2- 172.21.15.154:0/3644822776 >> v2:172.21.15.179:3300/0 conn(0x7f52ac1568e0 0x7f52ac1616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 >> v1:172.21.15.179:6789/0 conn(0x7f52ac0ccee0 legacy=0x7f52ac1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac15aa80 con 0x7f52ac0c83f0 2023-10-10T22:17:32.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f529c001470 con 0x7f52ac0c83f0 2023-10-10T22:17:32.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 >> v1:172.21.15.154:6789/0 conn(0x7f52ac0c83f0 legacy=0x7f52ac0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5294003c40 0x7f5294004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f5294004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5294005210 0x7f529400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac15a7a0 con 0x7f5294004810 2023-10-10T22:17:32.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529400e340 con 0x7f5294005210 2023-10-10T22:17:32.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529400e4d0 con 0x7f5294003c40 2023-10-10T22:17:32.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52b0d9c700 1 --2- 172.21.15.154:0/3644822776 >> v2:172.21.15.179:3300/0 conn(0x7f52ac1568e0 0x7f52ac1616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:32.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.529+0000 7f52ab7fe700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f5294004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52abfff700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5294003c40 0x7f5294004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52b0d9c700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5294005210 0x7f529400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52ab7fe700 1 -- 172.21.15.154:0/3644822776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5294003c40 msgr2=0x7f5294004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:32.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52ab7fe700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5294003c40 0x7f5294004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52ab7fe700 1 -- 172.21.15.154:0/3644822776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5294005210 msgr2=0x7f529400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52ab7fe700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5294005210 0x7f529400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52ab7fe700 1 -- 172.21.15.154:0/3644822776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294003570 con 0x7f5294004810 2023-10-10T22:17:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52b0d9c700 1 -- 172.21.15.154:0/3644822776 reap_dead start 2023-10-10T22:17:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52ab7fe700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f5294004c80 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f52a0001a80 tx=0x7f52a0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0fedbc37455033 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:32.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a000c590 con 0x7f5294004810 2023-10-10T22:17:32.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a000c6f0 con 0x7f5294004810 2023-10-10T22:17:32.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.530+0000 7f52aaffd700 1 -- 172.21.15.154:0/3644822776 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a000cab0 con 0x7f5294004810 2023-10-10T22:17:32.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.531+0000 7f52b27ff700 1 -- 172.21.15.154:0/3644822776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 msgr2=0x7f5294004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.531+0000 7f52b27ff700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f5294004c80 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f52a0001a80 tx=0x7f52a0007d30 comp rx=0 tx=0).stop 2023-10-10T22:17:32.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.531+0000 7f52b27ff700 1 -- 172.21.15.154:0/3644822776 shutdown_connections 2023-10-10T22:17:32.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.531+0000 7f52b27ff700 1 --2- 172.21.15.154:0/3644822776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f5294004c80 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.531+0000 7f52b27ff700 1 -- 172.21.15.154:0/3644822776 >> 172.21.15.154:0/3644822776 conn(0x7f52ac068e10 msgr2=0x7f52ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:32.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.531+0000 7f52b27ff700 1 -- 172.21.15.154:0/3644822776 shutdown_connections 2023-10-10T22:17:32.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.531+0000 7f52b27ff700 1 -- 172.21.15.154:0/3644822776 wait complete. 2023-10-10T22:17:32.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.532+0000 7f52b27ff700 1 Processor -- start 2023-10-10T22:17:32.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.533+0000 7f52b27ff700 1 -- start start 2023-10-10T22:17:32.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.533+0000 7f52b27ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f52ac14a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.533+0000 7f52b27ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52ac069770 0x7f52ac069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.533+0000 7f52b27ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52ac150be0 0x7f52ac151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.533+0000 7f52b27ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac169420 con 0x7f5294004810 2023-10-10T22:17:32.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.533+0000 7f52b27ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac06a120 con 0x7f52ac150be0 2023-10-10T22:17:32.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.533+0000 7f52b27ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac1515c0 con 0x7f52ac069770 2023-10-10T22:17:32.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52abfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f52ac14a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52abfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f52ac14a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58350/0 (socket says 172.21.15.154:58350) 2023-10-10T22:17:32.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52abfff700 1 -- 172.21.15.154:0/377877516 learned_addr learned my addr 172.21.15.154:0/377877516 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:32.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52ab7fe700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52ac069770 0x7f52ac069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52abfff700 1 -- 172.21.15.154:0/377877516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52ac069770 msgr2=0x7f52ac069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52abfff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52ac069770 0x7f52ac069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52abfff700 1 -- 172.21.15.154:0/377877516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52ac150be0 msgr2=0x7f52ac151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52abfff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52ac150be0 0x7f52ac151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52abfff700 1 -- 172.21.15.154:0/377877516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac151860 con 0x7f5294004810 2023-10-10T22:17:32.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52abfff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f52ac14a120 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f529c007110 tx=0x7f529c001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:32.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f5293fff700 1 -- 172.21.15.154:0/377877516 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c018030 con 0x7f5294004810 2023-10-10T22:17:32.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f5293fff700 1 -- 172.21.15.154:0/377877516 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c00f670 con 0x7f5294004810 2023-10-10T22:17:32.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f5293fff700 1 -- 172.21.15.154:0/377877516 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00fa30 con 0x7f5294004810 2023-10-10T22:17:32.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.534+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ac151b40 con 0x7f5294004810 2023-10-10T22:17:32.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.535+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac152100 con 0x7f5294004810 2023-10-10T22:17:32.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.536+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac04c3c0 con 0x7f5294004810 2023-10-10T22:17:32.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.536+0000 7f5293fff700 1 -- 172.21.15.154:0/377877516 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f529c01b070 con 0x7f5294004810 2023-10-10T22:17:32.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.537+0000 7f5293fff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5298066f30 0x7f52980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.537+0000 7f5293fff700 1 -- 172.21.15.154:0/377877516 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f529c019070 con 0x7f5294004810 2023-10-10T22:17:32.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.538+0000 7f52ab7fe700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5298066f30 0x7f52980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.538+0000 7f52ab7fe700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5298066f30 0x7f52980693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f52a0001a20 tx=0x7f52a0015000 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:32.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.542+0000 7f5293fff700 1 -- 172.21.15.154:0/377877516 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f529c0515e0 con 0x7f5294004810 2023-10-10T22:17:32.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.734+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f52ac15ad60 con 0x7f5294004810 2023-10-10T22:17:32.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.740+0000 7f5293fff700 1 -- 172.21.15.154:0/377877516 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v51) v1 ==== 120+0+0 (secure 0 0 0) 0x7f529c054c00 con 0x7f5294004810 2023-10-10T22:17:32.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.742+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5298066f30 msgr2=0x7f52980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.742+0000 7f52b27ff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5298066f30 0x7f52980693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f52a0001a20 tx=0x7f52a0015000 comp rx=0 tx=0).stop 2023-10-10T22:17:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.742+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 msgr2=0x7f52ac14a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.742+0000 7f52b27ff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f52ac14a120 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f529c007110 tx=0x7f529c001d20 comp rx=0 tx=0).stop 2023-10-10T22:17:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.743+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 shutdown_connections 2023-10-10T22:17:32.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.743+0000 7f52b27ff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52ac150be0 0x7f52ac151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.743+0000 7f52b27ff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5298066f30 0x7f52980693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.743+0000 7f52b27ff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5294004810 0x7f52ac14a120 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.743+0000 7f52b27ff700 1 --2- 172.21.15.154:0/377877516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52ac069770 0x7f52ac069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.743+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 >> 172.21.15.154:0/377877516 conn(0x7f52ac068e10 msgr2=0x7f52ac14f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:32.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.743+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 shutdown_connections 2023-10-10T22:17:32.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.743+0000 7f52b27ff700 1 -- 172.21.15.154:0/377877516 wait complete. 2023-10-10T22:17:32.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-10T22:17:32.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.945+0000 7ff0975ff700 1 Processor -- start 2023-10-10T22:17:32.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.946+0000 7ff0975ff700 1 -- start start 2023-10-10T22:17:32.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.947+0000 7ff0975ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0900cbf30 0x7ff0900ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.947+0000 7ff0975ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900b1420 0x7ff0900c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.947+0000 7ff0975ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0900cc300 con 0x7ff0900ccf90 2023-10-10T22:17:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.947+0000 7ff0975ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff090156bf0 con 0x7ff0900cbf30 2023-10-10T22:17:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.947+0000 7ff0975ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900ae950 con 0x7ff0900b1420 2023-10-10T22:17:32.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.947+0000 7ff09539b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0900cbf30 0x7ff0900ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.947+0000 7ff09539b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0900cbf30 0x7ff0900ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58364/0 (socket says 172.21.15.154:58364) 2023-10-10T22:17:32.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.947+0000 7ff09539b700 1 -- 172.21.15.154:0/1877123566 learned_addr learned my addr 172.21.15.154:0/1877123566 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.947+0000 7ff095b9c700 1 --2- 172.21.15.154:0/1877123566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900b1420 0x7ff0900c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.948+0000 7ff09539b700 1 -- 172.21.15.154:0/1877123566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900b1420 msgr2=0x7ff0900c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.948+0000 7ff09539b700 1 --2- 172.21.15.154:0/1877123566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900b1420 0x7ff0900c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.948+0000 7ff09539b700 1 -- 172.21.15.154:0/1877123566 >> v1:172.21.15.179:6789/0 conn(0x7ff0900ccf90 legacy=0x7ff0900b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.948+0000 7ff09539b700 1 -- 172.21.15.154:0/1877123566 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900ad370 con 0x7ff0900cbf30 2023-10-10T22:17:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.948+0000 7ff095b9c700 1 --2- 172.21.15.154:0/1877123566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900b1420 0x7ff0900c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.948+0000 7ff09539b700 1 --2- 172.21.15.154:0/1877123566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900cbf30 0x7ff0900ae410 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0099e0 tx=0x7ff08c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94e21ceebe67449 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.948+0000 7ff087fff700 1 -- 172.21.15.154:0/1877123566 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00b7e0 con 0x7ff0900cbf30 2023-10-10T22:17:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.948+0000 7ff087fff700 1 -- 172.21.15.154:0/1877123566 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00b940 con 0x7ff0900cbf30 2023-10-10T22:17:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.948+0000 7ff087fff700 1 -- 172.21.15.154:0/1877123566 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00bce0 con 0x7ff0900cbf30 2023-10-10T22:17:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.949+0000 7ff0975ff700 1 -- 172.21.15.154:0/1877123566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900cbf30 msgr2=0x7ff0900ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.949+0000 7ff0975ff700 1 --2- 172.21.15.154:0/1877123566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900cbf30 0x7ff0900ae410 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0099e0 tx=0x7ff08c009250 comp rx=0 tx=0).stop 2023-10-10T22:17:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.949+0000 7ff0975ff700 1 -- 172.21.15.154:0/1877123566 shutdown_connections 2023-10-10T22:17:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.949+0000 7ff0975ff700 1 --2- 172.21.15.154:0/1877123566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900b1420 0x7ff0900c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.949+0000 7ff0975ff700 1 --2- 172.21.15.154:0/1877123566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900cbf30 0x7ff0900ae410 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.949+0000 7ff0975ff700 1 -- 172.21.15.154:0/1877123566 >> 172.21.15.154:0/1877123566 conn(0x7ff09006a320 msgr2=0x7ff0900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.949+0000 7ff0975ff700 1 -- 172.21.15.154:0/1877123566 shutdown_connections 2023-10-10T22:17:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.949+0000 7ff0975ff700 1 -- 172.21.15.154:0/1877123566 wait complete. 2023-10-10T22:17:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.950+0000 7ff0975ff700 1 Processor -- start 2023-10-10T22:17:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.950+0000 7ff0975ff700 1 -- start start 2023-10-10T22:17:32.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.951+0000 7ff0975ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0900b1420 0x7ff0900aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.951+0000 7ff0975ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900cbf30 0x7ff0900a7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.951+0000 7ff0975ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900ccf90 0x7ff090155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.951+0000 7ff0975ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900aac30 con 0x7ff0900ccf90 2023-10-10T22:17:32.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.951+0000 7ff0975ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900a87c0 con 0x7ff0900b1420 2023-10-10T22:17:32.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.951+0000 7ff0975ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900a8c50 con 0x7ff0900cbf30 2023-10-10T22:17:32.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.951+0000 7ff095b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900ccf90 0x7ff090155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.951+0000 7ff095b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900ccf90 0x7ff090155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58378/0 (socket says 172.21.15.154:58378) 2023-10-10T22:17:32.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.951+0000 7ff095b9c700 1 -- 172.21.15.154:0/1879614090 learned_addr learned my addr 172.21.15.154:0/1879614090 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:32.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff09539b700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0900b1420 0x7ff0900aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff094b9a700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900cbf30 0x7ff0900a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff095b9c700 1 -- 172.21.15.154:0/1879614090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900cbf30 msgr2=0x7ff0900a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff095b9c700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900cbf30 0x7ff0900a7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff095b9c700 1 -- 172.21.15.154:0/1879614090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0900b1420 msgr2=0x7ff0900aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:32.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff095b9c700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0900b1420 0x7ff0900aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:32.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff095b9c700 1 -- 172.21.15.154:0/1879614090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c0094f0 con 0x7ff0900ccf90 2023-10-10T22:17:32.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff094b9a700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900cbf30 0x7ff0900a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:32.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff095b9c700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900ccf90 0x7ff090155b10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7ff08800a380 tx=0x7ff0880078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:32.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff0857fa700 1 -- 172.21.15.154:0/1879614090 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088015440 con 0x7ff0900ccf90 2023-10-10T22:17:32.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff0857fa700 1 -- 172.21.15.154:0/1879614090 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880155c0 con 0x7ff0900ccf90 2023-10-10T22:17:32.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff0857fa700 1 -- 172.21.15.154:0/1879614090 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088015980 con 0x7ff0900ccf90 2023-10-10T22:17:32.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0900a7c10 con 0x7ff0900ccf90 2023-10-10T22:17:32.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.952+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0900a8450 con 0x7ff0900ccf90 2023-10-10T22:17:32.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.953+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09006d170 con 0x7ff0900ccf90 2023-10-10T22:17:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.954+0000 7ff0857fa700 1 -- 172.21.15.154:0/1879614090 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff08800d440 con 0x7ff0900ccf90 2023-10-10T22:17:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.955+0000 7ff0857fa700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff074066f30 0x7ff0740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.955+0000 7ff0857fa700 1 -- 172.21.15.154:0/1879614090 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5919+0+0 (secure 0 0 0) 0x7ff088085150 con 0x7ff0900ccf90 2023-10-10T22:17:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.955+0000 7ff09539b700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff074066f30 0x7ff0740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:32.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.956+0000 7ff09539b700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff074066f30 0x7ff0740693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0099e0 tx=0x7ff08c016000 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:32.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:32.959+0000 7ff0857fa700 1 -- 172.21.15.154:0/1879614090 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff088052250 con 0x7ff0900ccf90 2023-10-10T22:17:33.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.227+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7ff0900a8930 con 0x7ff0900ccf90 2023-10-10T22:17:33.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.480+0000 7ff0857fa700 1 -- 172.21.15.154:0/1879614090 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2428) v1 ==== 178+0+0 (secure 0 0 0) 0x7ff088055870 con 0x7ff0900ccf90 2023-10-10T22:17:33.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff074066f30 msgr2=0x7ff0740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:33.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff074066f30 0x7ff0740693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0099e0 tx=0x7ff08c016000 comp rx=0 tx=0).stop 2023-10-10T22:17:33.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900ccf90 msgr2=0x7ff090155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900ccf90 0x7ff090155b10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7ff08800a380 tx=0x7ff0880078f0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 shutdown_connections 2023-10-10T22:17:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff074066f30 0x7ff0740693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0900ccf90 0x7ff090155b10 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0900b1420 0x7ff0900aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 --2- 172.21.15.154:0/1879614090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0900cbf30 0x7ff0900a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 >> 172.21.15.154:0/1879614090 conn(0x7ff09006a320 msgr2=0x7ff09006e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:33.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 shutdown_connections 2023-10-10T22:17:33.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.482+0000 7ff0975ff700 1 -- 172.21.15.154:0/1879614090 wait complete. 2023-10-10T22:17:33.502 INFO:tasks.cephfs_test_runner:Test that number of snaps retained are as per user spec. ... ok 2023-10-10T22:17:33.502 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-10-10T22:17:33.503 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T22:17:33.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-10T22:17:33.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.683+0000 7f64d4fff700 1 Processor -- start 2023-10-10T22:17:33.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.683+0000 7f64d4fff700 1 -- start start 2023-10-10T22:17:33.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.684+0000 7f64d4fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64d00cbf30 0x7f64d00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:33.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.684+0000 7f64d4fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d00cc300 con 0x7f64d00ccf90 2023-10-10T22:17:33.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.684+0000 7f64d4fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d00ad370 con 0x7f64d00b1420 2023-10-10T22:17:33.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.684+0000 7f64d4fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d0156bf0 con 0x7f64d00cbf30 2023-10-10T22:17:33.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.684+0000 7f64c7fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f64d00ccf90 0x7f64d00b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38870/0 (socket says 172.21.15.154:38870) 2023-10-10T22:17:33.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.684+0000 7f64c7fff700 1 -- 172.21.15.154:0/55737282 learned_addr learned my addr 172.21.15.154:0/55737282 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:33.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64ce59c700 1 --2- 172.21.15.154:0/55737282 >> v2:172.21.15.179:3300/0 conn(0x7f64d00cbf30 0x7f64d00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:33.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660171238 0 0) 0x7f64d00cc300 con 0x7f64d00ccf90 2023-10-10T22:17:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64bc003570 con 0x7f64d00ccf90 2023-10-10T22:17:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371891713 0 0) 0x7f64d00ad370 con 0x7f64d00b1420 2023-10-10T22:17:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d00cc300 con 0x7f64d00b1420 2023-10-10T22:17:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3633994724 0 0) 0x7f64bc003570 con 0x7f64d00ccf90 2023-10-10T22:17:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 >> v2:172.21.15.179:3300/0 conn(0x7f64d00cbf30 msgr2=0x7f64d00ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:33.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 --2- 172.21.15.154:0/55737282 >> v2:172.21.15.179:3300/0 conn(0x7f64d00cbf30 0x7f64d00ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 >> v1:172.21.15.179:6789/0 conn(0x7f64d00b1420 legacy=0x7f64d00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:33.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00ad650 con 0x7f64d00ccf90 2023-10-10T22:17:33.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f64b8001470 con 0x7f64d00ccf90 2023-10-10T22:17:33.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64ce59c700 1 --2- 172.21.15.154:0/55737282 >> v2:172.21.15.179:3300/0 conn(0x7f64d00cbf30 0x7f64d00ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:33.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 >> v1:172.21.15.154:6789/0 conn(0x7f64d00ccf90 legacy=0x7f64d00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:33.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64bc003c40 0x7f64bc004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:33.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64bc004810 0x7f64bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:33.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64bc005210 0x7f64bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:33.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0156bf0 con 0x7f64bc005210 2023-10-10T22:17:33.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc00c130 con 0x7f64bc003c40 2023-10-10T22:17:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.685+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc00c2c0 con 0x7f64bc004810 2023-10-10T22:17:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64ced9d700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64bc005210 0x7f64bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64ced9d700 1 -- 172.21.15.154:0/55737282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64bc004810 msgr2=0x7f64bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64ced9d700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64bc004810 0x7f64bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64ce59c700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64bc003c40 0x7f64bc004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64ced9d700 1 -- 172.21.15.154:0/55737282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64bc003c40 msgr2=0x7f64bc004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64ced9d700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64bc003c40 0x7f64bc004030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64ced9d700 1 -- 172.21.15.154:0/55737282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc003570 con 0x7f64bc005210 2023-10-10T22:17:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64ced9d700 1 -- 172.21.15.154:0/55737282 reap_dead start 2023-10-10T22:17:33.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64ced9d700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64bc005210 0x7f64bc00ba60 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f64c8002150 tx=0x7f64c80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a30b41b1e51062 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:33.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800c940 con 0x7f64bc005210 2023-10-10T22:17:33.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c800caa0 con 0x7f64bc005210 2023-10-10T22:17:33.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.686+0000 7f64cdd9b700 1 -- 172.21.15.154:0/55737282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800cc10 con 0x7f64bc005210 2023-10-10T22:17:33.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.687+0000 7f64d4fff700 1 -- 172.21.15.154:0/55737282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64bc005210 msgr2=0x7f64bc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:33.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.687+0000 7f64d4fff700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64bc005210 0x7f64bc00ba60 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f64c8002150 tx=0x7f64c80017a0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.687+0000 7f64d4fff700 1 -- 172.21.15.154:0/55737282 shutdown_connections 2023-10-10T22:17:33.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.687+0000 7f64d4fff700 1 --2- 172.21.15.154:0/55737282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64bc005210 0x7f64bc00ba60 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.687+0000 7f64d4fff700 1 -- 172.21.15.154:0/55737282 >> 172.21.15.154:0/55737282 conn(0x7f64d006a320 msgr2=0x7f64d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:33.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.687+0000 7f64d4fff700 1 -- 172.21.15.154:0/55737282 shutdown_connections 2023-10-10T22:17:33.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.687+0000 7f64d4fff700 1 -- 172.21.15.154:0/55737282 wait complete. 2023-10-10T22:17:33.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.688+0000 7f64d4fff700 1 Processor -- start 2023-10-10T22:17:33.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.689+0000 7f64d4fff700 1 -- start start 2023-10-10T22:17:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.689+0000 7f64d4fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64bc005210 0x7f64d0145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.689+0000 7f64d4fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64d00c6780 0x7f64d00c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:33.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.689+0000 7f64d4fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d0159cf0 0x7f64d015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:33.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.689+0000 7f64d4fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d015a6a0 con 0x7f64d0159cf0 2023-10-10T22:17:33.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.689+0000 7f64d4fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00c81b0 con 0x7f64d00c6780 2023-10-10T22:17:33.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.689+0000 7f64d4fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0157ba0 con 0x7f64bc005210 2023-10-10T22:17:33.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ced9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d0159cf0 0x7f64d015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:33.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ced9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d0159cf0 0x7f64d015a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58388/0 (socket says 172.21.15.154:58388) 2023-10-10T22:17:33.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ced9d700 1 -- 172.21.15.154:0/2889247946 learned_addr learned my addr 172.21.15.154:0/2889247946 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:33.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ce59c700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64bc005210 0x7f64d0145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:33.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64c7fff700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64d00c6780 0x7f64d00c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:33.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ced9d700 1 -- 172.21.15.154:0/2889247946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64bc005210 msgr2=0x7f64d0145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:33.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ced9d700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64bc005210 0x7f64d0145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ced9d700 1 -- 172.21.15.154:0/2889247946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64d00c6780 msgr2=0x7f64d00c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:33.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ced9d700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64d00c6780 0x7f64d00c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:33.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ced9d700 1 -- 172.21.15.154:0/2889247946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00c7ed0 con 0x7f64d0159cf0 2023-10-10T22:17:33.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64c7fff700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64d00c6780 0x7f64d00c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:33.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.690+0000 7f64ced9d700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d0159cf0 0x7f64d015a160 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f64d00b03d0 tx=0x7f64c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:33.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.691+0000 7f64c67fc700 1 -- 172.21.15.154:0/2889247946 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800cc10 con 0x7f64d0159cf0 2023-10-10T22:17:33.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.691+0000 7f64c67fc700 1 -- 172.21.15.154:0/2889247946 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c8006db0 con 0x7f64d0159cf0 2023-10-10T22:17:33.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.691+0000 7f64c67fc700 1 -- 172.21.15.154:0/2889247946 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800c940 con 0x7f64d0159cf0 2023-10-10T22:17:33.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.691+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d0157550 con 0x7f64d0159cf0 2023-10-10T22:17:33.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.691+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d01464c0 con 0x7f64d0159cf0 2023-10-10T22:17:33.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.692+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d006b980 con 0x7f64d0159cf0 2023-10-10T22:17:33.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.693+0000 7f64c67fc700 1 -- 172.21.15.154:0/2889247946 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64c8019070 con 0x7f64d0159cf0 2023-10-10T22:17:33.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.693+0000 7f64c67fc700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64b0066f30 0x7f64b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:33.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.694+0000 7f64c67fc700 1 -- 172.21.15.154:0/2889247946 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f64c80850f0 con 0x7f64d0159cf0 2023-10-10T22:17:33.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.694+0000 7f64ce59c700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64b0066f30 0x7f64b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:33.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.694+0000 7f64ce59c700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64b0066f30 0x7f64b00693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009170 tx=0x7f64c0008040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:33.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.698+0000 7f64c67fc700 1 -- 172.21.15.154:0/2889247946 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64c8052270 con 0x7f64d0159cf0 2023-10-10T22:17:33.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:33.962+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f64d004c3c0 con 0x7f64d0159cf0 2023-10-10T22:17:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.484+0000 7f64c67fc700 1 -- 172.21.15.154:0/2889247946 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2429) v1 ==== 177+0+0 (secure 0 0 0) 0x7f64c80240f0 con 0x7f64d0159cf0 2023-10-10T22:17:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64b0066f30 msgr2=0x7f64b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64b0066f30 0x7f64b00693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009170 tx=0x7f64c0008040 comp rx=0 tx=0).stop 2023-10-10T22:17:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d0159cf0 msgr2=0x7f64d015a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d0159cf0 0x7f64d015a160 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f64d00b03d0 tx=0x7f64c8015000 comp rx=0 tx=0).stop 2023-10-10T22:17:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 shutdown_connections 2023-10-10T22:17:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64b0066f30 0x7f64b00693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d0159cf0 0x7f64d015a160 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64bc005210 0x7f64d0145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 --2- 172.21.15.154:0/2889247946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64d00c6780 0x7f64d00c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 >> 172.21.15.154:0/2889247946 conn(0x7f64d006a320 msgr2=0x7f64d0155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 shutdown_connections 2023-10-10T22:17:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.486+0000 7f64d4fff700 1 -- 172.21.15.154:0/2889247946 wait complete. 2023-10-10T22:17:34.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T22:17:34.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.692+0000 7fa880bff700 1 Processor -- start 2023-10-10T22:17:34.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.692+0000 7fa880bff700 1 -- start start 2023-10-10T22:17:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.693+0000 7fa880bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa87c155eb0 0x7fa87c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.693+0000 7fa880bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 0x7fa87c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa880bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa87c069cb0 0x7fa87c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa880bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c06a130 con 0x7fa87c155eb0 2023-10-10T22:17:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa880bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c06eb90 con 0x7fa87c069cb0 2023-10-10T22:17:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa880bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c06ee70 con 0x7fa87c0c70b0 2023-10-10T22:17:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa87a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa87c155eb0 0x7fa87c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa87a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa87c155eb0 0x7fa87c06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58402/0 (socket says 172.21.15.154:58402) 2023-10-10T22:17:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa87a59c700 1 -- 172.21.15.154:0/460110376 learned_addr learned my addr 172.21.15.154:0/460110376 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa87ad9d700 1 --2- 172.21.15.154:0/460110376 >> v2:172.21.15.179:3300/0 conn(0x7fa87c069cb0 0x7fa87c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa879d9b700 1 --2- 172.21.15.154:0/460110376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 0x7fa87c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa87a59c700 1 -- 172.21.15.154:0/460110376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 msgr2=0x7fa87c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa87a59c700 1 --2- 172.21.15.154:0/460110376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 0x7fa87c069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa87a59c700 1 -- 172.21.15.154:0/460110376 >> v2:172.21.15.179:3300/0 conn(0x7fa87c069cb0 msgr2=0x7fa87c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa87a59c700 1 --2- 172.21.15.154:0/460110376 >> v2:172.21.15.179:3300/0 conn(0x7fa87c069cb0 0x7fa87c159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.694+0000 7fa87a59c700 1 -- 172.21.15.154:0/460110376 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c06f150 con 0x7fa87c155eb0 2023-10-10T22:17:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa87a59c700 1 --2- 172.21.15.154:0/460110376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c155eb0 0x7fa87c06e240 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0c7740 tx=0x7fa86c00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ce55ea019ee1c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa87959a700 1 -- 172.21.15.154:0/460110376 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00db10 con 0x7fa87c155eb0 2023-10-10T22:17:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa87959a700 1 -- 172.21.15.154:0/460110376 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c00dc70 con 0x7fa87c155eb0 2023-10-10T22:17:34.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa87959a700 1 -- 172.21.15.154:0/460110376 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c017410 con 0x7fa87c155eb0 2023-10-10T22:17:34.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa880bff700 1 -- 172.21.15.154:0/460110376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c155eb0 msgr2=0x7fa87c06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:34.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa880bff700 1 --2- 172.21.15.154:0/460110376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c155eb0 0x7fa87c06e240 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0c7740 tx=0x7fa86c00b4e0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa880bff700 1 -- 172.21.15.154:0/460110376 shutdown_connections 2023-10-10T22:17:34.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa880bff700 1 --2- 172.21.15.154:0/460110376 >> v2:172.21.15.179:3300/0 conn(0x7fa87c069cb0 0x7fa87c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa880bff700 1 --2- 172.21.15.154:0/460110376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c155eb0 0x7fa87c06e240 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa880bff700 1 --2- 172.21.15.154:0/460110376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 0x7fa87c069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.695+0000 7fa880bff700 1 -- 172.21.15.154:0/460110376 >> 172.21.15.154:0/460110376 conn(0x7fa87c068e10 msgr2=0x7fa87c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.696+0000 7fa880bff700 1 -- 172.21.15.154:0/460110376 shutdown_connections 2023-10-10T22:17:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.696+0000 7fa880bff700 1 -- 172.21.15.154:0/460110376 wait complete. 2023-10-10T22:17:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.697+0000 7fa880bff700 1 Processor -- start 2023-10-10T22:17:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.697+0000 7fa880bff700 1 -- start start 2023-10-10T22:17:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa880bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c069cb0 0x7fa87c1440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa880bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 0x7fa87c15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa880bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c155eb0 0x7fa87c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa880bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c15ae80 con 0x7fa87c069cb0 2023-10-10T22:17:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa880bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c15a270 con 0x7fa87c155eb0 2023-10-10T22:17:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa880bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c15a550 con 0x7fa87c0c70b0 2023-10-10T22:17:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa87a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c069cb0 0x7fa87c1440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa87a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c069cb0 0x7fa87c1440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58404/0 (socket says 172.21.15.154:58404) 2023-10-10T22:17:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa87a59c700 1 -- 172.21.15.154:0/696393254 learned_addr learned my addr 172.21.15.154:0/696393254 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa87ad9d700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c155eb0 0x7fa87c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.698+0000 7fa879d9b700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 0x7fa87c15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa87a59c700 1 -- 172.21.15.154:0/696393254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 msgr2=0x7fa87c15b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa87a59c700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 0x7fa87c15b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa87a59c700 1 -- 172.21.15.154:0/696393254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c155eb0 msgr2=0x7fa87c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa87a59c700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c155eb0 0x7fa87c15be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa87a59c700 1 -- 172.21.15.154:0/696393254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c00b780 con 0x7fa87c069cb0 2023-10-10T22:17:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa87a59c700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c069cb0 0x7fa87c1440d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa87c06fe40 tx=0x7fa86c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa86a7fc700 1 -- 172.21.15.154:0/696393254 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c022610 con 0x7fa87c069cb0 2023-10-10T22:17:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa86a7fc700 1 -- 172.21.15.154:0/696393254 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c022770 con 0x7fa87c069cb0 2023-10-10T22:17:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c15a830 con 0x7fa87c069cb0 2023-10-10T22:17:34.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa86a7fc700 1 -- 172.21.15.154:0/696393254 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c022b30 con 0x7fa87c069cb0 2023-10-10T22:17:34.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.699+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c159500 con 0x7fa87c069cb0 2023-10-10T22:17:34.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.700+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c0c8c70 con 0x7fa87c069cb0 2023-10-10T22:17:34.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.701+0000 7fa86a7fc700 1 -- 172.21.15.154:0/696393254 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa86c015070 con 0x7fa87c069cb0 2023-10-10T22:17:34.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.702+0000 7fa86a7fc700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa85c066f30 0x7fa85c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:34.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.702+0000 7fa86a7fc700 1 -- 172.21.15.154:0/696393254 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5919+0+0 (secure 0 0 0) 0x7fa86c088390 con 0x7fa87c069cb0 2023-10-10T22:17:34.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.702+0000 7fa879d9b700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa85c066f30 0x7fa85c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:34.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.703+0000 7fa879d9b700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa85c066f30 0x7fa85c0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa87c168b90 tx=0x7fa870008040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:34.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.706+0000 7fa86a7fc700 1 -- 172.21.15.154:0/696393254 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa86c055530 con 0x7fa87c069cb0 2023-10-10T22:17:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.897+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa87c04c3c0 con 0x7fa87c069cb0 2023-10-10T22:17:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.901+0000 7fa86a7fc700 1 -- 172.21.15.154:0/696393254 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa86c006d50 con 0x7fa87c069cb0 2023-10-10T22:17:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa85c066f30 msgr2=0x7fa85c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:34.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa85c066f30 0x7fa85c0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa87c168b90 tx=0x7fa870008040 comp rx=0 tx=0).stop 2023-10-10T22:17:34.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c069cb0 msgr2=0x7fa87c1440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:34.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c069cb0 0x7fa87c1440d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa87c06fe40 tx=0x7fa86c019000 comp rx=0 tx=0).stop 2023-10-10T22:17:34.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 shutdown_connections 2023-10-10T22:17:34.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa87c155eb0 0x7fa87c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa85c066f30 0x7fa85c0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa87c069cb0 0x7fa87c1440d0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 --2- 172.21.15.154:0/696393254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa87c0c70b0 0x7fa87c15b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:34.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 >> 172.21.15.154:0/696393254 conn(0x7fa87c068e10 msgr2=0x7fa87c0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:34.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 shutdown_connections 2023-10-10T22:17:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:34.904+0000 7fa880bff700 1 -- 172.21.15.154:0/696393254 wait complete. 2023-10-10T22:17:34.923 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T22:17:34.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:17:35.001 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:17:35.087 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T22:17:35.088 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T22:17:35.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:17:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.270+0000 7f13e23ff700 1 Processor -- start 2023-10-10T22:17:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.270+0000 7f13e23ff700 1 -- start start 2023-10-10T22:17:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.271+0000 7f13e23ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f13dc0cbf30 0x7f13dc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.271+0000 7f13e23ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0b1420 0x7f13dc0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.271+0000 7f13e23ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0cc300 con 0x7f13dc0ccf90 2023-10-10T22:17:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.271+0000 7f13e23ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc156bf0 con 0x7f13dc0cbf30 2023-10-10T22:17:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.271+0000 7f13e23ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0ae950 con 0x7f13dc0b1420 2023-10-10T22:17:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.272+0000 7f13dbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f13dc0cbf30 0x7f13dc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.272+0000 7f13e099c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0b1420 0x7f13dc0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.272+0000 7f13dbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f13dc0cbf30 0x7f13dc0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:34268/0 (socket says 172.21.15.154:34268) 2023-10-10T22:17:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.272+0000 7f13dbfff700 1 -- 172.21.15.154:0/1353940887 learned_addr learned my addr 172.21.15.154:0/1353940887 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.272+0000 7f13dbfff700 1 -- 172.21.15.154:0/1353940887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0b1420 msgr2=0x7f13dc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.272+0000 7f13dbfff700 1 --2- 172.21.15.154:0/1353940887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0b1420 0x7f13dc0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.272+0000 7f13dbfff700 1 -- 172.21.15.154:0/1353940887 >> v1:172.21.15.179:6789/0 conn(0x7f13dc0ccf90 legacy=0x7f13dc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.272+0000 7f13dbfff700 1 -- 172.21.15.154:0/1353940887 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0ad370 con 0x7f13dc0cbf30 2023-10-10T22:17:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13dbfff700 1 --2- 172.21.15.154:0/1353940887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13dc0cbf30 0x7f13dc0ae410 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0099e0 tx=0x7f13cc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e243bdb211cbba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13daffd700 1 -- 172.21.15.154:0/1353940887 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc009ed0 con 0x7f13dc0cbf30 2023-10-10T22:17:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13daffd700 1 -- 172.21.15.154:0/1353940887 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc00b760 con 0x7f13dc0cbf30 2023-10-10T22:17:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13daffd700 1 -- 172.21.15.154:0/1353940887 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00bb00 con 0x7f13dc0cbf30 2023-10-10T22:17:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13e23ff700 1 -- 172.21.15.154:0/1353940887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13dc0cbf30 msgr2=0x7f13dc0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13e23ff700 1 --2- 172.21.15.154:0/1353940887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13dc0cbf30 0x7f13dc0ae410 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0099e0 tx=0x7f13cc009250 comp rx=0 tx=0).stop 2023-10-10T22:17:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13e23ff700 1 -- 172.21.15.154:0/1353940887 shutdown_connections 2023-10-10T22:17:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13e23ff700 1 --2- 172.21.15.154:0/1353940887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0b1420 0x7f13dc0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13e23ff700 1 --2- 172.21.15.154:0/1353940887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13dc0cbf30 0x7f13dc0ae410 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.273+0000 7f13e23ff700 1 -- 172.21.15.154:0/1353940887 >> 172.21.15.154:0/1353940887 conn(0x7f13dc06a320 msgr2=0x7f13dc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.274+0000 7f13e23ff700 1 -- 172.21.15.154:0/1353940887 shutdown_connections 2023-10-10T22:17:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.274+0000 7f13e23ff700 1 -- 172.21.15.154:0/1353940887 wait complete. 2023-10-10T22:17:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.275+0000 7f13e23ff700 1 Processor -- start 2023-10-10T22:17:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.275+0000 7f13e23ff700 1 -- start start 2023-10-10T22:17:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13e23ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13dc0b1420 0x7f13dc159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13e23ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13dc0cbf30 0x7f13dc156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13e23ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0ccf90 0x7f13dc153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13e23ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc14b8b0 con 0x7f13dc0b1420 2023-10-10T22:17:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13e23ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc15a110 con 0x7f13dc0cbf30 2023-10-10T22:17:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13e23ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc15a3f0 con 0x7f13dc0ccf90 2023-10-10T22:17:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13dc0b1420 0x7f13dc159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13dc0b1420 0x7f13dc159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58406/0 (socket says 172.21.15.154:58406) 2023-10-10T22:17:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13dbfff700 1 -- 172.21.15.154:0/760673445 learned_addr learned my addr 172.21.15.154:0/760673445 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13e099c700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0ccf90 0x7f13dc153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.276+0000 7f13db7fe700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13dc0cbf30 0x7f13dc156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13dbfff700 1 -- 172.21.15.154:0/760673445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0ccf90 msgr2=0x7f13dc153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13dbfff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0ccf90 0x7f13dc153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13dbfff700 1 -- 172.21.15.154:0/760673445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13dc0cbf30 msgr2=0x7f13dc156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13dbfff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13dc0cbf30 0x7f13dc156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13dbfff700 1 -- 172.21.15.154:0/760673445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc0094f0 con 0x7f13dc0b1420 2023-10-10T22:17:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13dbfff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13dc0b1420 0x7f13dc159b30 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009290 tx=0x7f13cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13c3fff700 1 -- 172.21.15.154:0/760673445 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc011b30 con 0x7f13dc0b1420 2023-10-10T22:17:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13c3fff700 1 -- 172.21.15.154:0/760673445 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc020070 con 0x7f13dc0b1420 2023-10-10T22:17:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc15a6d0 con 0x7f13dc0b1420 2023-10-10T22:17:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.277+0000 7f13c3fff700 1 -- 172.21.15.154:0/760673445 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc01b450 con 0x7f13dc0b1420 2023-10-10T22:17:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.278+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc14d330 con 0x7f13dc0b1420 2023-10-10T22:17:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.278+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc04c3c0 con 0x7f13dc0b1420 2023-10-10T22:17:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.279+0000 7f13c3fff700 1 -- 172.21.15.154:0/760673445 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13cc022030 con 0x7f13dc0b1420 2023-10-10T22:17:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.280+0000 7f13c3fff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f13c8066f30 0x7f13c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.280+0000 7f13c3fff700 1 -- 172.21.15.154:0/760673445 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f13cc086280 con 0x7f13dc0b1420 2023-10-10T22:17:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.280+0000 7f13db7fe700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f13c8066f30 0x7f13c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.281+0000 7f13db7fe700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f13c8066f30 0x7f13c80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f13dc1599f0 tx=0x7f13d0007ea0 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.285+0000 7f13c3fff700 1 -- 172.21.15.154:0/760673445 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13cc053380 con 0x7f13dc0b1420 2023-10-10T22:17:35.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.520+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13dc04c3c0 con 0x7f13dc0b1420 2023-10-10T22:17:35.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.520+0000 7f13c3fff700 1 -- 172.21.15.154:0/760673445 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f13cc0569a0 con 0x7f13dc0b1420 2023-10-10T22:17:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:35.523 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6851,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/870665959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":870665959},{"type":"v1","addr":"172.21.15.179:6835","nonce":870665959}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7723,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/338355165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":338355165},{"type":"v1","addr":"172.21.15.154:6835","nonce":338355165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1799386063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1799386063},{"type":"v1","addr":"172.21.15.179:6834","nonce":1799386063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8050,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3478721628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3478721628},{"type":"v1","addr":"172.21.15.154:6834","nonce":3478721628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[]} 2023-10-10T22:17:35.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.522+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f13c8066f30 msgr2=0x7f13c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.522+0000 7f13e23ff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f13c8066f30 0x7f13c80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f13dc1599f0 tx=0x7f13d0007ea0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.522+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13dc0b1420 msgr2=0x7f13dc159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.522+0000 7f13e23ff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13dc0b1420 0x7f13dc159b30 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009290 tx=0x7f13cc016000 comp rx=0 tx=0).stop 2023-10-10T22:17:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.522+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 shutdown_connections 2023-10-10T22:17:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.522+0000 7f13e23ff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13dc0ccf90 0x7f13dc153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.522+0000 7f13e23ff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f13c8066f30 0x7f13c80693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.522+0000 7f13e23ff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13dc0b1420 0x7f13dc159b30 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.522+0000 7f13e23ff700 1 --2- 172.21.15.154:0/760673445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13dc0cbf30 0x7f13dc156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.523+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 >> 172.21.15.154:0/760673445 conn(0x7f13dc06a320 msgr2=0x7f13dc0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:35.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.523+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 shutdown_connections 2023-10-10T22:17:35.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.523+0000 7f13e23ff700 1 -- 172.21.15.154:0/760673445 wait complete. 2023-10-10T22:17:35.527 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 64 2023-10-10T22:17:35.542 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T22:17:35.543 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T22:17:35.543 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T22:17:35.543 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:17:35.544 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T22:17:35.544 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T22:17:35.544 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T22:17:35.545 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:17:35.545 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T22:17:35.545 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T22:17:35.546 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T22:17:35.546 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:17:35.546 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T22:17:35.546 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T22:17:35.547 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T22:17:35.547 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:17:35.557 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T22:17:35.558 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T22:17:35.561 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T22:17:35.561 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T22:17:35.564 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T22:17:35.564 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T22:17:35.565 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T22:17:35.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T22:17:35.604 INFO:tasks.ceph.mds.a:Started 2023-10-10T22:17:35.605 DEBUG:teuthology.parallel:result is None 2023-10-10T22:17:35.608 INFO:tasks.ceph.mds.c:Started 2023-10-10T22:17:35.609 DEBUG:teuthology.parallel:result is None 2023-10-10T22:17:35.610 INFO:tasks.ceph.mds.b:Started 2023-10-10T22:17:35.610 DEBUG:teuthology.parallel:result is None 2023-10-10T22:17:35.612 INFO:tasks.ceph.mds.d:Started 2023-10-10T22:17:35.613 DEBUG:teuthology.parallel:result is None 2023-10-10T22:17:35.613 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T22:17:35.740 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T22:17:35.741 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T22:17:35.747 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T22:17:35.748 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T22:17:35.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.806+0000 7fb2fbfff700 1 Processor -- start 2023-10-10T22:17:35.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.806+0000 7fb2fbfff700 1 -- start start 2023-10-10T22:17:35.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.807+0000 7fb2fbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2f4159890 0x7fb2f415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.807+0000 7fb2fbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159c60 0x7fb2f415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.807+0000 7fb2fbfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f415a160 con 0x7fb2f415db10 2023-10-10T22:17:35.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.807+0000 7fb2fbfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f40d13a0 con 0x7fb2f4159890 2023-10-10T22:17:35.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.807+0000 7fb2fbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f415e140 con 0x7fb2f4159c60 2023-10-10T22:17:35.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f959a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159c60 0x7fb2f415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f9d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2f4159890 0x7fb2f415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f959a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159c60 0x7fb2f415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:54376/0 (socket says 172.21.15.154:54376) 2023-10-10T22:17:35.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f959a700 1 -- 172.21.15.154:0/2326540021 learned_addr learned my addr 172.21.15.154:0/2326540021 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:35.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2fa59c700 1 --1- 172.21.15.154:0/2326540021 >> v1:172.21.15.179:6789/0 conn(0x7fb2f415db10 0x7fb2f4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:53076/0 (socket says 172.21.15.154:53076) 2023-10-10T22:17:35.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f959a700 1 -- 172.21.15.154:0/2326540021 >> v2:172.21.15.179:3300/0 conn(0x7fb2f4159890 msgr2=0x7fb2f415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:35.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f959a700 1 --2- 172.21.15.154:0/2326540021 >> v2:172.21.15.179:3300/0 conn(0x7fb2f4159890 0x7fb2f415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f959a700 1 -- 172.21.15.154:0/2326540021 >> v1:172.21.15.179:6789/0 conn(0x7fb2f415db10 legacy=0x7fb2f4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f959a700 1 -- 172.21.15.154:0/2326540021 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f415a3d0 con 0x7fb2f4159c60 2023-10-10T22:17:35.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f9d9b700 1 --2- 172.21.15.154:0/2326540021 >> v2:172.21.15.179:3300/0 conn(0x7fb2f4159890 0x7fb2f415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:35.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.808+0000 7fb2f8d99700 1 -- 172.21.15.154:0/2326540021 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121327658 0 0) 0x7fb2f415a160 con 0x7fb2f415db10 2023-10-10T22:17:35.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2f959a700 1 --2- 172.21.15.154:0/2326540021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159c60 0x7fb2f415d5d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40099b0 tx=0x7fb2e4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3cd08e064d4454 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:35.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2f8d99700 1 -- 172.21.15.154:0/2326540021 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4009ea0 con 0x7fb2f4159c60 2023-10-10T22:17:35.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2f8d99700 1 -- 172.21.15.154:0/2326540021 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e400b860 con 0x7fb2f4159c60 2023-10-10T22:17:35.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2f8d99700 1 -- 172.21.15.154:0/2326540021 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400bc00 con 0x7fb2f4159c60 2023-10-10T22:17:35.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2fbfff700 1 -- 172.21.15.154:0/2326540021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159c60 msgr2=0x7fb2f415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2fbfff700 1 --2- 172.21.15.154:0/2326540021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159c60 0x7fb2f415d5d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40099b0 tx=0x7fb2e4009250 comp rx=0 tx=0).stop 2023-10-10T22:17:35.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2fbfff700 1 -- 172.21.15.154:0/2326540021 shutdown_connections 2023-10-10T22:17:35.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2fbfff700 1 --2- 172.21.15.154:0/2326540021 >> v2:172.21.15.179:3300/0 conn(0x7fb2f4159890 0x7fb2f415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2fbfff700 1 --2- 172.21.15.154:0/2326540021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159c60 0x7fb2f415d5d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.809+0000 7fb2fbfff700 1 -- 172.21.15.154:0/2326540021 >> 172.21.15.154:0/2326540021 conn(0x7fb2f4068e20 msgr2=0x7fb2f40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:35.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.810+0000 7fb2fbfff700 1 -- 172.21.15.154:0/2326540021 shutdown_connections 2023-10-10T22:17:35.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.810+0000 7fb2fbfff700 1 -- 172.21.15.154:0/2326540021 wait complete. 2023-10-10T22:17:35.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.811+0000 7fb2fbfff700 1 Processor -- start 2023-10-10T22:17:35.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.811+0000 7fb2fbfff700 1 -- start start 2023-10-10T22:17:35.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2fbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159890 0x7fb2f41524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2fbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2f4159c60 0x7fb2f40b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2fbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f415db10 0x7fb2f4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2fbfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f416aa80 con 0x7fb2f415db10 2023-10-10T22:17:35.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2fbfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f40b41f0 con 0x7fb2f4159c60 2023-10-10T22:17:35.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2fbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f416a430 con 0x7fb2f4159890 2023-10-10T22:17:35.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2fa59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f415db10 0x7fb2f4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2f9d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159890 0x7fb2f41524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2fa59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f415db10 0x7fb2f4154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58440/0 (socket says 172.21.15.154:58440) 2023-10-10T22:17:35.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2f9d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159890 0x7fb2f41524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:54384/0 (socket says 172.21.15.154:54384) 2023-10-10T22:17:35.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2fa59c700 1 -- 172.21.15.154:0/1409036454 learned_addr learned my addr 172.21.15.154:0/1409036454 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:35.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.812+0000 7fb2f959a700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2f4159c60 0x7fb2f40b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2f9d9b700 1 -- 172.21.15.154:0/1409036454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2f4159c60 msgr2=0x7fb2f40b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2f9d9b700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2f4159c60 0x7fb2f40b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2f9d9b700 1 -- 172.21.15.154:0/1409036454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f415db10 msgr2=0x7fb2f4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:35.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2f9d9b700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f415db10 0x7fb2f4154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:35.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2f9d9b700 1 -- 172.21.15.154:0/1409036454 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0009420 con 0x7fb2f4159890 2023-10-10T22:17:35.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2f9d9b700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159890 0x7fb2f41524d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000ec80 tx=0x7fb2f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:35.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2e9ffb700 1 -- 172.21.15.154:0/1409036454 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000c850 con 0x7fb2f4159890 2023-10-10T22:17:35.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2e9ffb700 1 -- 172.21.15.154:0/1409036454 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000c9b0 con 0x7fb2f4159890 2023-10-10T22:17:35.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e40094f0 con 0x7fb2f4159890 2023-10-10T22:17:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2e9ffb700 1 -- 172.21.15.154:0/1409036454 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000cd70 con 0x7fb2f4159890 2023-10-10T22:17:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.813+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f416a110 con 0x7fb2f4159890 2023-10-10T22:17:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.814+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f416ad60 con 0x7fb2f4159890 2023-10-10T22:17:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.815+0000 7fb2e9ffb700 1 -- 172.21.15.154:0/1409036454 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2f0005a00 con 0x7fb2f4159890 2023-10-10T22:17:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.816+0000 7fb2e9ffb700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb2d8066f30 0x7fb2d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:35.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.816+0000 7fb2e9ffb700 1 -- 172.21.15.154:0/1409036454 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5919+0+0 (secure 0 0 0) 0x7fb2f00849b0 con 0x7fb2f4159890 2023-10-10T22:17:35.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.816+0000 7fb2f959a700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb2d8066f30 0x7fb2d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:35.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.817+0000 7fb2f959a700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb2d8066f30 0x7fb2d80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40099b0 tx=0x7fb2e4017000 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:35.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:35.820+0000 7fb2e9ffb700 1 -- 172.21.15.154:0/1409036454 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2f0051bd0 con 0x7fb2f4159890 2023-10-10T22:17:36.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.033+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb2f404c3c0 con 0x7fb2f4159890 2023-10-10T22:17:36.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.966+0000 7fb2e9ffb700 1 -- 172.21.15.154:0/1409036454 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v157) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb2f0021080 con 0x7fb2f4159890 2023-10-10T22:17:36.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb2d8066f30 msgr2=0x7fb2d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:36.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb2d8066f30 0x7fb2d80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40099b0 tx=0x7fb2e4017000 comp rx=0 tx=0).stop 2023-10-10T22:17:36.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159890 msgr2=0x7fb2f41524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:36.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159890 0x7fb2f41524d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000ec80 tx=0x7fb2f00091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:36.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 shutdown_connections 2023-10-10T22:17:36.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb2d8066f30 0x7fb2d80693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:36.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f415db10 0x7fb2f4154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:36.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2f4159890 0x7fb2f41524d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:36.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 --2- 172.21.15.154:0/1409036454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2f4159c60 0x7fb2f40b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:36.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 >> 172.21.15.154:0/1409036454 conn(0x7fb2f4068e20 msgr2=0x7fb2f40d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:36.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 shutdown_connections 2023-10-10T22:17:36.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:36.970+0000 7fb2fbfff700 1 -- 172.21.15.154:0/1409036454 wait complete. 2023-10-10T22:17:36.975 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T22:17:36.993 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T22:17:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.178+0000 7f1a10d9d700 1 Processor -- start 2023-10-10T22:17:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.179+0000 7f1a10d9d700 1 -- start start 2023-10-10T22:17:37.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.180+0000 7f1a10d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a0c06a660 0x7f1a0c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.180+0000 7f1a10d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c06e2a0 con 0x7f1a0c150180 2023-10-10T22:17:37.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.180+0000 7f1a10d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c06b2e0 con 0x7f1a0c150550 2023-10-10T22:17:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.180+0000 7f1a10d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c78e0 con 0x7f1a0c06a660 2023-10-10T22:17:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.180+0000 7f1a0b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1a0c150180 0x7f1a0c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46896/0 (socket says 172.21.15.154:46896) 2023-10-10T22:17:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.180+0000 7f1a0b7fe700 1 -- 172.21.15.154:0/1461011259 learned_addr learned my addr 172.21.15.154:0/1461011259 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.180+0000 7f1a0bfff700 1 --2- 172.21.15.154:0/1461011259 >> v2:172.21.15.154:3300/0 conn(0x7f1a0c06a660 0x7f1a0c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.181+0000 7f1a0a7fc700 1 -- 172.21.15.154:0/1461011259 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075104415 0 0) 0x7f1a0c06e2a0 con 0x7f1a0c150180 2023-10-10T22:17:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.181+0000 7f1a0bfff700 1 -- 172.21.15.154:0/1461011259 >> v1:172.21.15.179:6789/0 conn(0x7f1a0c150550 legacy=0x7f1a0c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.181+0000 7f1a0bfff700 1 -- 172.21.15.154:0/1461011259 >> v1:172.21.15.154:6789/0 conn(0x7f1a0c150180 legacy=0x7f1a0c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.181+0000 7f1a0bfff700 1 -- 172.21.15.154:0/1461011259 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c0c7bc0 con 0x7f1a0c06a660 2023-10-10T22:17:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.181+0000 7f1a0bfff700 1 --2- 172.21.15.154:0/1461011259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c06a660 0x7f1a0c157770 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009e90 tx=0x7f1a04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e0ef2a4f689946 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.181+0000 7f1a0a7fc700 1 -- 172.21.15.154:0/1461011259 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400e070 con 0x7f1a0c06a660 2023-10-10T22:17:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.181+0000 7f1a0a7fc700 1 -- 172.21.15.154:0/1461011259 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0400bbf0 con 0x7f1a0c06a660 2023-10-10T22:17:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.181+0000 7f1a0a7fc700 1 -- 172.21.15.154:0/1461011259 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04012430 con 0x7f1a0c06a660 2023-10-10T22:17:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.182+0000 7f1a10d9d700 1 -- 172.21.15.154:0/1461011259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c06a660 msgr2=0x7f1a0c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.182+0000 7f1a10d9d700 1 --2- 172.21.15.154:0/1461011259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c06a660 0x7f1a0c157770 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009e90 tx=0x7f1a04009780 comp rx=0 tx=0).stop 2023-10-10T22:17:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.182+0000 7f1a10d9d700 1 -- 172.21.15.154:0/1461011259 shutdown_connections 2023-10-10T22:17:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.182+0000 7f1a10d9d700 1 --2- 172.21.15.154:0/1461011259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c06a660 0x7f1a0c157770 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.182+0000 7f1a10d9d700 1 -- 172.21.15.154:0/1461011259 >> 172.21.15.154:0/1461011259 conn(0x7f1a0c0cc1f0 msgr2=0x7f1a0c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.182+0000 7f1a10d9d700 1 -- 172.21.15.154:0/1461011259 shutdown_connections 2023-10-10T22:17:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.182+0000 7f1a10d9d700 1 -- 172.21.15.154:0/1461011259 wait complete. 2023-10-10T22:17:37.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.183+0000 7f1a10d9d700 1 Processor -- start 2023-10-10T22:17:37.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.183+0000 7f1a10d9d700 1 -- start start 2023-10-10T22:17:37.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.184+0000 7f1a10d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c06a660 0x7f1a0c14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.184+0000 7f1a10d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c150180 0x7f1a0c14cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.184+0000 7f1a10d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c150550 0x7f1a0c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.184+0000 7f1a10d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c4770 con 0x7f1a0c150550 2023-10-10T22:17:37.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.184+0000 7f1a10d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0afa60 con 0x7f1a0c06a660 2023-10-10T22:17:37.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.184+0000 7f1a10d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c16bb40 con 0x7f1a0c150180 2023-10-10T22:17:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.184+0000 7f1a0bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c150550 0x7f1a0c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.184+0000 7f1a0bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c150550 0x7f1a0c0c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42736/0 (socket says 172.21.15.154:42736) 2023-10-10T22:17:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.184+0000 7f1a0bfff700 1 -- 172.21.15.154:0/4204414110 learned_addr learned my addr 172.21.15.154:0/4204414110 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a0b7fe700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c06a660 0x7f1a0c14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a0affd700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c150180 0x7f1a0c14cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a0bfff700 1 -- 172.21.15.154:0/4204414110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c150180 msgr2=0x7f1a0c14cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a0bfff700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c150180 0x7f1a0c14cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a0bfff700 1 -- 172.21.15.154:0/4204414110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c06a660 msgr2=0x7f1a0c14ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a0bfff700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c06a660 0x7f1a0c14ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a0bfff700 1 -- 172.21.15.154:0/4204414110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04009a20 con 0x7f1a0c150550 2023-10-10T22:17:37.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a0b7fe700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c06a660 0x7f1a0c14ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:37.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a0bfff700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c150550 0x7f1a0c0c3c60 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f1a040097c0 tx=0x7f1a04019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:37.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f19f37fe700 1 -- 172.21.15.154:0/4204414110 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0401e630 con 0x7f1a0c150550 2023-10-10T22:17:37.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f19f37fe700 1 -- 172.21.15.154:0/4204414110 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0401e7d0 con 0x7f1a0c150550 2023-10-10T22:17:37.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f19f37fe700 1 -- 172.21.15.154:0/4204414110 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0401eb90 con 0x7f1a0c150550 2023-10-10T22:17:37.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.185+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c0af130 con 0x7f1a0c150550 2023-10-10T22:17:37.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.186+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c0af6f0 con 0x7f1a0c150550 2023-10-10T22:17:37.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.187+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c157420 con 0x7f1a0c150550 2023-10-10T22:17:37.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.188+0000 7f19f37fe700 1 -- 172.21.15.154:0/4204414110 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a04024070 con 0x7f1a0c150550 2023-10-10T22:17:37.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.188+0000 7f19f37fe700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f19f8066f30 0x7f19f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.189+0000 7f19f37fe700 1 -- 172.21.15.154:0/4204414110 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f1a04086db0 con 0x7f1a0c150550 2023-10-10T22:17:37.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.189+0000 7f1a0b7fe700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f19f8066f30 0x7f19f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.190+0000 7f1a0b7fe700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f19f8066f30 0x7f19f80693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0011e0 tx=0x7f19fc009040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.193+0000 7f19f37fe700 1 -- 172.21.15.154:0/4204414110 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a0408b070 con 0x7f1a0c150550 2023-10-10T22:17:37.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.458+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1a0c04c3c0 con 0x7f1a0c150550 2023-10-10T22:17:37.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.459+0000 7f19f37fe700 1 -- 172.21.15.154:0/4204414110 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1a04057b90 con 0x7f1a0c150550 2023-10-10T22:17:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:37.462 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:17:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T22:17:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T22:17:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T22:17:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:17:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:17:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:17:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T22:17:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T22:17:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:17:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:17:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:17:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T22:17:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T22:17:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:17:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:17:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:17:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T22:17:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T22:17:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:17:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:17:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:17:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T22:17:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T22:17:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:17:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:17:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T22:17:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T22:17:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:17:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:17:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T22:17:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T22:17:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:17:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:17:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T22:17:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T22:17:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:17:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:17:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T22:17:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T22:17:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:17:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:17:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T22:17:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T22:17:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:17:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:17:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T22:17:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T22:17:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:17:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:17:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T22:17:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T22:17:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:17:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:17:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T22:17:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T22:17:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:17:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T22:17:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T22:17:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T22:17:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T22:17:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:17:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:17:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:17:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:17:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T22:17:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T22:17:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:17:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:17:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:17:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:17:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T22:17:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T22:17:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:17:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:17:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:17:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:17:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T22:17:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T22:17:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:17:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:17:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:17:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T22:17:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T22:17:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:17:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T22:17:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:17:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T22:17:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T22:17:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:17:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:17:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T22:17:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:17:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T22:17:37.502 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:17:37.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f19f8066f30 msgr2=0x7f19f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f19f8066f30 0x7f19f80693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0011e0 tx=0x7f19fc009040 comp rx=0 tx=0).stop 2023-10-10T22:17:37.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c150550 msgr2=0x7f1a0c0c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c150550 0x7f1a0c0c3c60 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f1a040097c0 tx=0x7f1a04019000 comp rx=0 tx=0).stop 2023-10-10T22:17:37.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 shutdown_connections 2023-10-10T22:17:37.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f19f8066f30 0x7f19f80693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0c150550 0x7f1a0c0c3c60 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0c06a660 0x7f1a0c14ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 --2- 172.21.15.154:0/4204414110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a0c150180 0x7f1a0c14cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 >> 172.21.15.154:0/4204414110 conn(0x7f1a0c0cc1f0 msgr2=0x7f1a0c0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:37.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 shutdown_connections 2023-10-10T22:17:37.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.461+0000 7f1a10d9d700 1 -- 172.21.15.154:0/4204414110 wait complete. 2023-10-10T22:17:37.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:17:37.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.686+0000 7fd48599d700 1 Processor -- start 2023-10-10T22:17:37.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.687+0000 7fd48599d700 1 -- start start 2023-10-10T22:17:37.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.688+0000 7fd48599d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd480156310 0x7fd4800c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.688+0000 7fd48599d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd4801566e0 0x7fd4800ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.688+0000 7fd48599d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4800ca860 con 0x7fd4800ca300 2023-10-10T22:17:37.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.688+0000 7fd48599d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4800cab40 con 0x7fd480156310 2023-10-10T22:17:37.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.688+0000 7fd48599d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4800cae20 con 0x7fd4801566e0 2023-10-10T22:17:37.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.688+0000 7fd48519c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd4800ca300 0x7fd4800c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46904/0 (socket says 172.21.15.154:46904) 2023-10-10T22:17:37.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.688+0000 7fd48519c700 1 -- 172.21.15.154:0/2728773521 learned_addr learned my addr 172.21.15.154:0/2728773521 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:37.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.688+0000 7fd48499b700 1 --2- 172.21.15.154:0/2728773521 >> v2:172.21.15.154:3300/0 conn(0x7fd480156310 0x7fd4800c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.688+0000 7fd47ffff700 1 --2- 172.21.15.154:0/2728773521 >> v2:172.21.15.179:3300/0 conn(0x7fd4801566e0 0x7fd4800ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd47f7fe700 1 -- 172.21.15.154:0/2728773521 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381621771 0 0) 0x7fd4800ca860 con 0x7fd4800ca300 2023-10-10T22:17:37.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd47f7fe700 1 -- 172.21.15.154:0/2728773521 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd470003570 con 0x7fd4800ca300 2023-10-10T22:17:37.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd48499b700 1 -- 172.21.15.154:0/2728773521 >> v2:172.21.15.179:3300/0 conn(0x7fd4801566e0 msgr2=0x7fd4800ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:37.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd48499b700 1 --2- 172.21.15.154:0/2728773521 >> v2:172.21.15.179:3300/0 conn(0x7fd4801566e0 0x7fd4800ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd48499b700 1 -- 172.21.15.154:0/2728773521 >> v1:172.21.15.154:6789/0 conn(0x7fd4800ca300 legacy=0x7fd4800c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd48499b700 1 -- 172.21.15.154:0/2728773521 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4800cb100 con 0x7fd480156310 2023-10-10T22:17:37.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd48499b700 1 --2- 172.21.15.154:0/2728773521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 0x7fd4800c9dc0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fd48006c000 tx=0x7fd4740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1daa4a0eb7d85a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:37.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd47f7fe700 1 -- 172.21.15.154:0/2728773521 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474011630 con 0x7fd480156310 2023-10-10T22:17:37.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd47f7fe700 1 -- 172.21.15.154:0/2728773521 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4740117b0 con 0x7fd480156310 2023-10-10T22:17:37.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.689+0000 7fd47f7fe700 1 -- 172.21.15.154:0/2728773521 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474011b70 con 0x7fd480156310 2023-10-10T22:17:37.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.690+0000 7fd48599d700 1 -- 172.21.15.154:0/2728773521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 msgr2=0x7fd4800c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.690+0000 7fd48599d700 1 --2- 172.21.15.154:0/2728773521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 0x7fd4800c9dc0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fd48006c000 tx=0x7fd4740091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.690+0000 7fd48599d700 1 -- 172.21.15.154:0/2728773521 shutdown_connections 2023-10-10T22:17:37.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.690+0000 7fd48599d700 1 --2- 172.21.15.154:0/2728773521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 0x7fd4800c9dc0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.690+0000 7fd48599d700 1 --2- 172.21.15.154:0/2728773521 >> v2:172.21.15.179:3300/0 conn(0x7fd4801566e0 0x7fd4800ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.690+0000 7fd48599d700 1 -- 172.21.15.154:0/2728773521 >> 172.21.15.154:0/2728773521 conn(0x7fd4800cc1f0 msgr2=0x7fd4800cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:37.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.690+0000 7fd48599d700 1 -- 172.21.15.154:0/2728773521 shutdown_connections 2023-10-10T22:17:37.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.690+0000 7fd48599d700 1 -- 172.21.15.154:0/2728773521 wait complete. 2023-10-10T22:17:37.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.691+0000 7fd48599d700 1 Processor -- start 2023-10-10T22:17:37.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.692+0000 7fd48599d700 1 -- start start 2023-10-10T22:17:37.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.692+0000 7fd48599d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800ca300 0x7fd4800c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd48599d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 0x7fd480150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd48599d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4801566e0 0x7fd480151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd48599d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd480151f70 con 0x7fd480156310 2023-10-10T22:17:37.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd48599d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800c7ae0 con 0x7fd4800ca300 2023-10-10T22:17:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd48599d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4801549f0 con 0x7fd4801566e0 2023-10-10T22:17:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 0x7fd480150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 0x7fd480150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42750/0 (socket says 172.21.15.154:42750) 2023-10-10T22:17:37.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd47ffff700 1 -- 172.21.15.154:0/426061691 learned_addr learned my addr 172.21.15.154:0/426061691 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:37.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd48519c700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4801566e0 0x7fd480151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd48499b700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800ca300 0x7fd4800c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd47ffff700 1 -- 172.21.15.154:0/426061691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4801566e0 msgr2=0x7fd480151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd47ffff700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4801566e0 0x7fd480151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd47ffff700 1 -- 172.21.15.154:0/426061691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800ca300 msgr2=0x7fd4800c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd47ffff700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800ca300 0x7fd4800c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd47ffff700 1 -- 172.21.15.154:0/426061691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd474009420 con 0x7fd480156310 2023-10-10T22:17:37.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.693+0000 7fd47ffff700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 0x7fd480150f20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00e930 tx=0x7fd46c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:37.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.694+0000 7fd47cff9700 1 -- 172.21.15.154:0/426061691 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00eed0 con 0x7fd480156310 2023-10-10T22:17:37.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.694+0000 7fd47cff9700 1 -- 172.21.15.154:0/426061691 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c00c850 con 0x7fd480156310 2023-10-10T22:17:37.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.694+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd480154cd0 con 0x7fd480156310 2023-10-10T22:17:37.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.694+0000 7fd47cff9700 1 -- 172.21.15.154:0/426061691 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00cc10 con 0x7fd480156310 2023-10-10T22:17:37.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.694+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd480155290 con 0x7fd480156310 2023-10-10T22:17:37.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.695+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48004c3c0 con 0x7fd480156310 2023-10-10T22:17:37.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.696+0000 7fd47cff9700 1 -- 172.21.15.154:0/426061691 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd46c013470 con 0x7fd480156310 2023-10-10T22:17:37.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.696+0000 7fd47cff9700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd464066f30 0x7fd4640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:37.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.696+0000 7fd47cff9700 1 -- 172.21.15.154:0/426061691 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fd46c0843d0 con 0x7fd480156310 2023-10-10T22:17:37.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.697+0000 7fd48499b700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd464066f30 0x7fd4640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:37.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.697+0000 7fd48499b700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd464066f30 0x7fd4640693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd48006c000 tx=0x7fd474017000 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:37.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.700+0000 7fd47cff9700 1 -- 172.21.15.154:0/426061691 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd46c051720 con 0x7fd480156310 2023-10-10T22:17:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.891+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4800cd0b0 con 0x7fd480156310 2023-10-10T22:17:37.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.892+0000 7fd47cff9700 1 -- 172.21.15.154:0/426061691 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+12903 (secure 0 0 0) 0x7fd46c054d40 con 0x7fd480156310 2023-10-10T22:17:37.896 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:37.896 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":157,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:17:36.962688+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:17:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd464066f30 msgr2=0x7fd4640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd464066f30 0x7fd4640693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd48006c000 tx=0x7fd474017000 comp rx=0 tx=0).stop 2023-10-10T22:17:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 msgr2=0x7fd480150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 0x7fd480150f20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00e930 tx=0x7fd46c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 shutdown_connections 2023-10-10T22:17:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4801566e0 0x7fd480151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800ca300 0x7fd4800c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd464066f30 0x7fd4640693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 --2- 172.21.15.154:0/426061691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd480156310 0x7fd480150f20 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 >> 172.21.15.154:0/426061691 conn(0x7fd4800cc1f0 msgr2=0x7fd4800c2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:37.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 shutdown_connections 2023-10-10T22:17:37.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:37.895+0000 7fd48599d700 1 -- 172.21.15.154:0/426061691 wait complete. 2023-10-10T22:17:37.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T22:17:37.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T22:17:38.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.101+0000 7f047af9d700 1 Processor -- start 2023-10-10T22:17:38.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.102+0000 7f047af9d700 1 -- start start 2023-10-10T22:17:38.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.103+0000 7f047af9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04740cb1a0 0x7f047415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.103+0000 7f047af9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740ae0d0 0x7f04740ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.103+0000 7f047af9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047406ebd0 con 0x7f047415a8a0 2023-10-10T22:17:38.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.103+0000 7f047af9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047415b2e0 con 0x7f04740cb1a0 2023-10-10T22:17:38.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.103+0000 7f047af9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04740aea30 con 0x7f04740ae0d0 2023-10-10T22:17:38.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.103+0000 7f047979a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f047415a8a0 0x7f047406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46912/0 (socket says 172.21.15.154:46912) 2023-10-10T22:17:38.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.103+0000 7f0479f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04740cb1a0 0x7f047415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.103+0000 7f047979a700 1 -- 172.21.15.154:0/1367170737 learned_addr learned my addr 172.21.15.154:0/1367170737 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:38.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.103+0000 7f047a79c700 1 --2- 172.21.15.154:0/1367170737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740ae0d0 0x7f04740ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0478f99700 1 -- 172.21.15.154:0/1367170737 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32266677 0 0) 0x7f047406ebd0 con 0x7f047415a8a0 2023-10-10T22:17:38.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0478f99700 1 -- 172.21.15.154:0/1367170737 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0460003570 con 0x7f047415a8a0 2023-10-10T22:17:38.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0479f9b700 1 -- 172.21.15.154:0/1367170737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740ae0d0 msgr2=0x7f04740ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:38.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0479f9b700 1 --2- 172.21.15.154:0/1367170737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740ae0d0 0x7f04740ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0479f9b700 1 -- 172.21.15.154:0/1367170737 >> v1:172.21.15.154:6789/0 conn(0x7f047415a8a0 legacy=0x7f047406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0479f9b700 1 -- 172.21.15.154:0/1367170737 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047415ad20 con 0x7f04740cb1a0 2023-10-10T22:17:38.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0479f9b700 1 --2- 172.21.15.154:0/1367170737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740cb1a0 0x7f047415a360 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f04700098e0 tx=0x7f04700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2a5c1bbd62572e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:38.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0478f99700 1 -- 172.21.15.154:0/1367170737 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011630 con 0x7f04740cb1a0 2023-10-10T22:17:38.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0478f99700 1 -- 172.21.15.154:0/1367170737 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470011790 con 0x7f04740cb1a0 2023-10-10T22:17:38.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.104+0000 7f0478f99700 1 -- 172.21.15.154:0/1367170737 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011b30 con 0x7f04740cb1a0 2023-10-10T22:17:38.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.105+0000 7f047af9d700 1 -- 172.21.15.154:0/1367170737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740cb1a0 msgr2=0x7f047415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.105+0000 7f047af9d700 1 --2- 172.21.15.154:0/1367170737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740cb1a0 0x7f047415a360 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f04700098e0 tx=0x7f04700091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.105+0000 7f047af9d700 1 -- 172.21.15.154:0/1367170737 shutdown_connections 2023-10-10T22:17:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.105+0000 7f047af9d700 1 --2- 172.21.15.154:0/1367170737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740ae0d0 0x7f04740ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.105+0000 7f047af9d700 1 --2- 172.21.15.154:0/1367170737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740cb1a0 0x7f047415a360 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.105+0000 7f047af9d700 1 -- 172.21.15.154:0/1367170737 >> 172.21.15.154:0/1367170737 conn(0x7f04740cc1e0 msgr2=0x7f04740cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.105+0000 7f047af9d700 1 -- 172.21.15.154:0/1367170737 shutdown_connections 2023-10-10T22:17:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.105+0000 7f047af9d700 1 -- 172.21.15.154:0/1367170737 wait complete. 2023-10-10T22:17:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.106+0000 7f047af9d700 1 Processor -- start 2023-10-10T22:17:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.107+0000 7f047af9d700 1 -- start start 2023-10-10T22:17:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.107+0000 7f047af9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740ae0d0 0x7f0474153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.107+0000 7f047af9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04740cb1a0 0x7f04740c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.107+0000 7f047af9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740c5be0 0x7f0474158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.107+0000 7f047af9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740c6060 con 0x7f04740ae0d0 2023-10-10T22:17:38.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.107+0000 7f047af9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740c3290 con 0x7f04740cb1a0 2023-10-10T22:17:38.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.107+0000 7f047af9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0474157a50 con 0x7f04740c5be0 2023-10-10T22:17:38.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0479f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740ae0d0 0x7f0474153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0479f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740ae0d0 0x7f0474153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42774/0 (socket says 172.21.15.154:42774) 2023-10-10T22:17:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0479f9b700 1 -- 172.21.15.154:0/2012769383 learned_addr learned my addr 172.21.15.154:0/2012769383 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f047979a700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04740cb1a0 0x7f04740c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f047a79c700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740c5be0 0x7f0474158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0479f9b700 1 -- 172.21.15.154:0/2012769383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740c5be0 msgr2=0x7f0474158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0479f9b700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740c5be0 0x7f0474158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0479f9b700 1 -- 172.21.15.154:0/2012769383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04740cb1a0 msgr2=0x7f04740c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0479f9b700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04740cb1a0 0x7f04740c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0479f9b700 1 -- 172.21.15.154:0/2012769383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470009420 con 0x7f04740ae0d0 2023-10-10T22:17:38.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0479f9b700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740ae0d0 0x7f0474153680 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f047406ce80 tx=0x7f0470017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:38.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.108+0000 7f0469ffb700 1 -- 172.21.15.154:0/2012769383 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011b10 con 0x7f04740ae0d0 2023-10-10T22:17:38.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.109+0000 7f0469ffb700 1 -- 172.21.15.154:0/2012769383 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04700253f0 con 0x7f04740ae0d0 2023-10-10T22:17:38.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.109+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0474157d30 con 0x7f04740ae0d0 2023-10-10T22:17:38.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.109+0000 7f0469ffb700 1 -- 172.21.15.154:0/2012769383 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04700257b0 con 0x7f04740ae0d0 2023-10-10T22:17:38.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.109+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04741582f0 con 0x7f04740ae0d0 2023-10-10T22:17:38.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.110+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04741577a0 con 0x7f04740ae0d0 2023-10-10T22:17:38.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.111+0000 7f0469ffb700 1 -- 172.21.15.154:0/2012769383 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0470025b60 con 0x7f04740ae0d0 2023-10-10T22:17:38.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.112+0000 7f0469ffb700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0458066f30 0x7f04580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.112+0000 7f0469ffb700 1 -- 172.21.15.154:0/2012769383 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f0470085d10 con 0x7f04740ae0d0 2023-10-10T22:17:38.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.112+0000 7f047979a700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0458066f30 0x7f04580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.112+0000 7f047979a700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0458066f30 0x7f04580693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f047415a870 tx=0x7f0464009040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:38.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.116+0000 7f0469ffb700 1 -- 172.21.15.154:0/2012769383 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0470053100 con 0x7f04740ae0d0 2023-10-10T22:17:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.307+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f047406c4b0 con 0x7f04740ae0d0 2023-10-10T22:17:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.308+0000 7f0469ffb700 1 -- 172.21.15.154:0/2012769383 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v157) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04700150a0 con 0x7f04740ae0d0 2023-10-10T22:17:38.311 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T22:17:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0458066f30 msgr2=0x7f04580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0458066f30 0x7f04580693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f047415a870 tx=0x7f0464009040 comp rx=0 tx=0).stop 2023-10-10T22:17:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740ae0d0 msgr2=0x7f0474153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740ae0d0 0x7f0474153680 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f047406ce80 tx=0x7f0470017000 comp rx=0 tx=0).stop 2023-10-10T22:17:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 shutdown_connections 2023-10-10T22:17:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04740c5be0 0x7f0474158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0458066f30 0x7f04580693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04740ae0d0 0x7f0474153680 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 --2- 172.21.15.154:0/2012769383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04740cb1a0 0x7f04740c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 >> 172.21.15.154:0/2012769383 conn(0x7f04740cc1e0 msgr2=0x7f047406a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 shutdown_connections 2023-10-10T22:17:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.310+0000 7f047af9d700 1 -- 172.21.15.154:0/2012769383 wait complete. 2023-10-10T22:17:38.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T22:17:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.510+0000 7fc52d59d700 1 Processor -- start 2023-10-10T22:17:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.511+0000 7fc52d59d700 1 -- start start 2023-10-10T22:17:38.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.512+0000 7fc52d59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5281566e0 0x7fc5280ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.512+0000 7fc52d59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5280ca860 con 0x7fc5280cb900 2023-10-10T22:17:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.512+0000 7fc52d59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5280cab40 con 0x7fc528156310 2023-10-10T22:17:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.512+0000 7fc52d59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5280cae20 con 0x7fc5281566e0 2023-10-10T22:17:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.512+0000 7fc5277fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5281566e0 0x7fc5280ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.512+0000 7fc52cd9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc5280cb900 0x7fc5280c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46918/0 (socket says 172.21.15.154:46918) 2023-10-10T22:17:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.512+0000 7fc52cd9c700 1 -- 172.21.15.154:0/1192131241 learned_addr learned my addr 172.21.15.154:0/1192131241 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.513+0000 7fc5277fe700 1 -- 172.21.15.154:0/1192131241 >> v1:172.21.15.179:6789/0 conn(0x7fc528156310 legacy=0x7fc5280c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.513+0000 7fc5277fe700 1 -- 172.21.15.154:0/1192131241 >> v1:172.21.15.154:6789/0 conn(0x7fc5280cb900 legacy=0x7fc5280c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.513+0000 7fc5277fe700 1 -- 172.21.15.154:0/1192131241 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5280cb100 con 0x7fc5281566e0 2023-10-10T22:17:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.513+0000 7fc526ffd700 1 -- 172.21.15.154:0/1192131241 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129439751 0 0) 0x7fc5280ca860 con 0x7fc5280cb900 2023-10-10T22:17:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.513+0000 7fc5277fe700 1 --2- 172.21.15.154:0/1192131241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 0x7fc5280ae000 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0098e0 tx=0x7fc51c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515b881ddb1e0cb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.513+0000 7fc526ffd700 1 -- 172.21.15.154:0/1192131241 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c009e80 con 0x7fc5281566e0 2023-10-10T22:17:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.513+0000 7fc526ffd700 1 -- 172.21.15.154:0/1192131241 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c00b860 con 0x7fc5281566e0 2023-10-10T22:17:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.513+0000 7fc526ffd700 1 -- 172.21.15.154:0/1192131241 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00bbe0 con 0x7fc5281566e0 2023-10-10T22:17:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.514+0000 7fc52d59d700 1 -- 172.21.15.154:0/1192131241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 msgr2=0x7fc5280ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.514+0000 7fc52d59d700 1 --2- 172.21.15.154:0/1192131241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 0x7fc5280ae000 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0098e0 tx=0x7fc51c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.514+0000 7fc52d59d700 1 -- 172.21.15.154:0/1192131241 shutdown_connections 2023-10-10T22:17:38.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.514+0000 7fc52d59d700 1 --2- 172.21.15.154:0/1192131241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 0x7fc5280ae000 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.514+0000 7fc52d59d700 1 -- 172.21.15.154:0/1192131241 >> 172.21.15.154:0/1192131241 conn(0x7fc5280cc1f0 msgr2=0x7fc5280cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:38.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.514+0000 7fc52d59d700 1 -- 172.21.15.154:0/1192131241 shutdown_connections 2023-10-10T22:17:38.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.514+0000 7fc52d59d700 1 -- 172.21.15.154:0/1192131241 wait complete. 2023-10-10T22:17:38.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:17:38.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.515+0000 7fc52d59d700 1 Processor -- start 2023-10-10T22:17:38.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.515+0000 7fc52d59d700 1 -- start start 2023-10-10T22:17:38.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.516+0000 7fc52d59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5280cb900 0x7fc5280b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.516+0000 7fc52d59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc528156310 0x7fc5280b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.516+0000 7fc52d59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 0x7fc528159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.516+0000 7fc52d59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280c6b20 con 0x7fc5281566e0 2023-10-10T22:17:38.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.516+0000 7fc52d59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52815a2b0 con 0x7fc5280cb900 2023-10-10T22:17:38.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.516+0000 7fc52d59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52815a590 con 0x7fc528156310 2023-10-10T22:17:38.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.516+0000 7fc52cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 0x7fc528159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc52cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 0x7fc528159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42790/0 (socket says 172.21.15.154:42790) 2023-10-10T22:17:38.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc52cd9c700 1 -- 172.21.15.154:0/3658683997 learned_addr learned my addr 172.21.15.154:0/3658683997 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:38.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc527fff700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5280cb900 0x7fc5280b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc5277fe700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc528156310 0x7fc5280b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc52cd9c700 1 -- 172.21.15.154:0/3658683997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc528156310 msgr2=0x7fc5280b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc52cd9c700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc528156310 0x7fc5280b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc52cd9c700 1 -- 172.21.15.154:0/3658683997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5280cb900 msgr2=0x7fc5280b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc52cd9c700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5280cb900 0x7fc5280b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc52cd9c700 1 -- 172.21.15.154:0/3658683997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c009420 con 0x7fc5281566e0 2023-10-10T22:17:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc52cd9c700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 0x7fc528159540 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fc52000cbf0 tx=0x7fc5200019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc50ffff700 1 -- 172.21.15.154:0/3658683997 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000a8b0 con 0x7fc5281566e0 2023-10-10T22:17:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc50ffff700 1 -- 172.21.15.154:0/3658683997 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52000aa10 con 0x7fc5281566e0 2023-10-10T22:17:38.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc50ffff700 1 -- 172.21.15.154:0/3658683997 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000add0 con 0x7fc5281566e0 2023-10-10T22:17:38.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.517+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5280c67b0 con 0x7fc5281566e0 2023-10-10T22:17:38.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.518+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5280c32a0 con 0x7fc5281566e0 2023-10-10T22:17:38.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.519+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5280c6c90 con 0x7fc5281566e0 2023-10-10T22:17:38.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.520+0000 7fc50ffff700 1 -- 172.21.15.154:0/3658683997 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc520007300 con 0x7fc5281566e0 2023-10-10T22:17:38.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.520+0000 7fc50ffff700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc514066f30 0x7fc5140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.520+0000 7fc50ffff700 1 -- 172.21.15.154:0/3658683997 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fc5200846c0 con 0x7fc5281566e0 2023-10-10T22:17:38.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.521+0000 7fc527fff700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc514066f30 0x7fc5140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.521+0000 7fc527fff700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc514066f30 0x7fc5140693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc518003a80 tx=0x7fc518007ec0 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:38.532 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:17:38.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.524+0000 7fc50ffff700 1 -- 172.21.15.154:0/3658683997 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc520051a90 con 0x7fc5281566e0 2023-10-10T22:17:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.722+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc52804c3c0 con 0x7fc5281566e0 2023-10-10T22:17:38.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.723+0000 7fc50ffff700 1 -- 172.21.15.154:0/3658683997 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v157) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc5200550b0 con 0x7fc5281566e0 2023-10-10T22:17:38.726 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:38.726 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T22:17:38.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:38.726 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T22:17:38.727 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T22:17:38.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:38.727 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T22:17:38.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc514066f30 msgr2=0x7fc5140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc514066f30 0x7fc5140693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc518003a80 tx=0x7fc518007ec0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 msgr2=0x7fc528159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 0x7fc528159540 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fc52000cbf0 tx=0x7fc5200019b0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 shutdown_connections 2023-10-10T22:17:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc514066f30 0x7fc5140693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5281566e0 0x7fc528159540 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5280cb900 0x7fc5280b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 --2- 172.21.15.154:0/3658683997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc528156310 0x7fc5280b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 >> 172.21.15.154:0/3658683997 conn(0x7fc5280cc1f0 msgr2=0x7fc528151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 shutdown_connections 2023-10-10T22:17:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.725+0000 7fc52d59d700 1 -- 172.21.15.154:0/3658683997 wait complete. 2023-10-10T22:17:38.746 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T22:17:38.746 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T22:17:38.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.929+0000 7f279bfff700 1 Processor -- start 2023-10-10T22:17:38.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.930+0000 7f279bfff700 1 -- start start 2023-10-10T22:17:38.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.931+0000 7f279bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f279c153480 0x7f279c0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.931+0000 7f279bfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c0aec90 con 0x7f279c153850 2023-10-10T22:17:38.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.931+0000 7f279bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c15a480 con 0x7f279c159dc0 2023-10-10T22:17:38.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.931+0000 7f279bfff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c0afb40 con 0x7f279c153480 2023-10-10T22:17:38.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.931+0000 7f279affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f279c153480 0x7f279c0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.931+0000 7f279a7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f279c153850 0x7f279c1596b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46934/0 (socket says 172.21.15.154:46934) 2023-10-10T22:17:38.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.931+0000 7f279a7fc700 1 -- 172.21.15.154:0/3797747641 learned_addr learned my addr 172.21.15.154:0/3797747641 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:38.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.932+0000 7f2799ffb700 1 -- 172.21.15.154:0/3797747641 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075999960 0 0) 0x7f279c0aec90 con 0x7f279c153850 2023-10-10T22:17:38.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.932+0000 7f279affd700 1 -- 172.21.15.154:0/3797747641 >> v1:172.21.15.179:6789/0 conn(0x7f279c159dc0 legacy=0x7f279c157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.932+0000 7f279affd700 1 -- 172.21.15.154:0/3797747641 >> v1:172.21.15.154:6789/0 conn(0x7f279c153850 legacy=0x7f279c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.932+0000 7f279affd700 1 -- 172.21.15.154:0/3797747641 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0afe20 con 0x7f279c153480 2023-10-10T22:17:38.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.932+0000 7f279affd700 1 --2- 172.21.15.154:0/3797747641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 0x7f279c0ae750 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f278c0098e0 tx=0x7f278c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b4fcd3c5b34f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:38.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.932+0000 7f2799ffb700 1 -- 172.21.15.154:0/3797747641 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c009e80 con 0x7f279c153480 2023-10-10T22:17:38.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.932+0000 7f2799ffb700 1 -- 172.21.15.154:0/3797747641 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c00b860 con 0x7f279c153480 2023-10-10T22:17:38.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.932+0000 7f2799ffb700 1 -- 172.21.15.154:0/3797747641 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c00bbe0 con 0x7f279c153480 2023-10-10T22:17:38.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.933+0000 7f279bfff700 1 -- 172.21.15.154:0/3797747641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 msgr2=0x7f279c0ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.933+0000 7f279bfff700 1 --2- 172.21.15.154:0/3797747641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 0x7f279c0ae750 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f278c0098e0 tx=0x7f278c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.933+0000 7f279bfff700 1 -- 172.21.15.154:0/3797747641 shutdown_connections 2023-10-10T22:17:38.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.933+0000 7f279bfff700 1 --2- 172.21.15.154:0/3797747641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 0x7f279c0ae750 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.933+0000 7f279bfff700 1 -- 172.21.15.154:0/3797747641 >> 172.21.15.154:0/3797747641 conn(0x7f279c068e20 msgr2=0x7f279c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:38.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.933+0000 7f279bfff700 1 -- 172.21.15.154:0/3797747641 shutdown_connections 2023-10-10T22:17:38.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.933+0000 7f279bfff700 1 -- 172.21.15.154:0/3797747641 wait complete. 2023-10-10T22:17:38.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.934+0000 7f279bfff700 1 Processor -- start 2023-10-10T22:17:38.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.934+0000 7f279bfff700 1 -- start start 2023-10-10T22:17:38.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.935+0000 7f279bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 0x7f279c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.935+0000 7f279bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c153850 0x7f279c156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.935+0000 7f279bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c159dc0 0x7f279c165c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.935+0000 7f279bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0c1070 con 0x7f279c153480 2023-10-10T22:17:38.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.935+0000 7f279bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0c1350 con 0x7f279c153850 2023-10-10T22:17:38.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.935+0000 7f279bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0c1630 con 0x7f279c159dc0 2023-10-10T22:17:38.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.935+0000 7f279affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 0x7f279c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 0x7f279c06eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42814/0 (socket says 172.21.15.154:42814) 2023-10-10T22:17:38.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279affd700 1 -- 172.21.15.154:0/4194215212 learned_addr learned my addr 172.21.15.154:0/4194215212 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:38.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279affd700 1 -- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c159dc0 msgr2=0x7f279c165c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279a7fc700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c153850 0x7f279c156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279b7fe700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c159dc0 0x7f279c165c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279affd700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c159dc0 0x7f279c165c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279affd700 1 -- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c153850 msgr2=0x7f279c156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:38.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279affd700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c153850 0x7f279c156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:38.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279affd700 1 -- 172.21.15.154:0/4194215212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c009420 con 0x7f279c153480 2023-10-10T22:17:38.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279a7fc700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c153850 0x7f279c156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:38.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279b7fe700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c159dc0 0x7f279c165c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:38.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279affd700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 0x7f279c06eab0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f279c0714a0 tx=0x7f278c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:38.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f2782ffd700 1 -- 172.21.15.154:0/4194215212 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c01f070 con 0x7f279c153480 2023-10-10T22:17:38.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f2782ffd700 1 -- 172.21.15.154:0/4194215212 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c00b9d0 con 0x7f279c153480 2023-10-10T22:17:38.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f2782ffd700 1 -- 172.21.15.154:0/4194215212 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c025670 con 0x7f279c153480 2023-10-10T22:17:38.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.936+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c0c1910 con 0x7f279c153480 2023-10-10T22:17:38.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.937+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c0c1f50 con 0x7f279c153480 2023-10-10T22:17:38.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.937+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c04c3c0 con 0x7f279c153480 2023-10-10T22:17:38.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.939+0000 7f2782ffd700 1 -- 172.21.15.154:0/4194215212 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f278c023070 con 0x7f279c153480 2023-10-10T22:17:38.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.941+0000 7f2782ffd700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2788066f30 0x7f27880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:38.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.941+0000 7f2782ffd700 1 -- 172.21.15.154:0/4194215212 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f278c085eb0 con 0x7f279c153480 2023-10-10T22:17:38.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.941+0000 7f279a7fc700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2788066f30 0x7f27880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:38.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.941+0000 7f279a7fc700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2788066f30 0x7f27880693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f279c163400 tx=0x7f2790009040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:38.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:38.944+0000 7f2782ffd700 1 -- 172.21.15.154:0/4194215212 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f278c053280 con 0x7f279c153480 2023-10-10T22:17:39.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.134+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f279c0b0100 con 0x7f279c153480 2023-10-10T22:17:39.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.497+0000 7f2782ffd700 1 -- 172.21.15.154:0/4194215212 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v158) v1 ==== 138+0+0 (secure 0 0 0) 0x7f278c0568a0 con 0x7f279c153480 2023-10-10T22:17:39.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.501+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2788066f30 msgr2=0x7f27880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:39.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.501+0000 7f279bfff700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2788066f30 0x7f27880693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f279c163400 tx=0x7f2790009040 comp rx=0 tx=0).stop 2023-10-10T22:17:39.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.501+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 msgr2=0x7f279c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:39.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.501+0000 7f279bfff700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 0x7f279c06eab0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f279c0714a0 tx=0x7f278c017000 comp rx=0 tx=0).stop 2023-10-10T22:17:39.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.501+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 shutdown_connections 2023-10-10T22:17:39.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.502+0000 7f279bfff700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c159dc0 0x7f279c165c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:39.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.502+0000 7f279bfff700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2788066f30 0x7f27880693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:39.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.502+0000 7f279bfff700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f279c153480 0x7f279c06eab0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:39.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.502+0000 7f279bfff700 1 --2- 172.21.15.154:0/4194215212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c153850 0x7f279c156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:39.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.502+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 >> 172.21.15.154:0/4194215212 conn(0x7f279c068e20 msgr2=0x7f279c06d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:39.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.502+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 shutdown_connections 2023-10-10T22:17:39.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.503+0000 7f279bfff700 1 -- 172.21.15.154:0/4194215212 wait complete. 2023-10-10T22:17:39.509 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T22:17:39.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T22:17:39.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.714+0000 7fb3523ff700 1 Processor -- start 2023-10-10T22:17:39.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.714+0000 7fb3523ff700 1 -- start start 2023-10-10T22:17:39.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb3523ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c0c85c0 0x7fb34c06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:39.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb3523ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c156340 con 0x7fb34c156ee0 2023-10-10T22:17:39.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb3523ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c0c8990 con 0x7fb34c069fa0 2023-10-10T22:17:39.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb3523ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c06ee20 con 0x7fb34c0c85c0 2023-10-10T22:17:39.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb343fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb34c156ee0 0x7fb34c069890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46936/0 (socket says 172.21.15.154:46936) 2023-10-10T22:17:39.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb343fff700 1 -- 172.21.15.154:0/4008390040 learned_addr learned my addr 172.21.15.154:0/4008390040 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:39.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34bfff700 1 --2- 172.21.15.154:0/4008390040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c0c85c0 0x7fb34c06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:39.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34b7fe700 1 -- 172.21.15.154:0/4008390040 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913543741 0 0) 0x7fb34c156340 con 0x7fb34c156ee0 2023-10-10T22:17:39.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34b7fe700 1 -- 172.21.15.154:0/4008390040 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb338003570 con 0x7fb34c156ee0 2023-10-10T22:17:39.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34b7fe700 1 -- 172.21.15.154:0/4008390040 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728923024 0 0) 0x7fb34c0c8990 con 0x7fb34c069fa0 2023-10-10T22:17:39.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34b7fe700 1 -- 172.21.15.154:0/4008390040 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb34c156340 con 0x7fb34c069fa0 2023-10-10T22:17:39.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34bfff700 1 -- 172.21.15.154:0/4008390040 >> v1:172.21.15.179:6789/0 conn(0x7fb34c069fa0 legacy=0x7fb34c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:39.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34bfff700 1 -- 172.21.15.154:0/4008390040 >> v1:172.21.15.154:6789/0 conn(0x7fb34c156ee0 legacy=0x7fb34c069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:39.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34bfff700 1 -- 172.21.15.154:0/4008390040 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c06dd80 con 0x7fb34c0c85c0 2023-10-10T22:17:39.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34bfff700 1 --2- 172.21.15.154:0/4008390040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c0c85c0 0x7fb34c06d6c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009910 tx=0x7fb33c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa7b964705a28196 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:39.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34b7fe700 1 -- 172.21.15.154:0/4008390040 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c011630 con 0x7fb34c0c85c0 2023-10-10T22:17:39.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34b7fe700 1 -- 172.21.15.154:0/4008390040 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c011790 con 0x7fb34c0c85c0 2023-10-10T22:17:39.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.716+0000 7fb34b7fe700 1 -- 172.21.15.154:0/4008390040 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c011b10 con 0x7fb34c0c85c0 2023-10-10T22:17:39.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.717+0000 7fb3523ff700 1 -- 172.21.15.154:0/4008390040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c0c85c0 msgr2=0x7fb34c06d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:39.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.717+0000 7fb3523ff700 1 --2- 172.21.15.154:0/4008390040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c0c85c0 0x7fb34c06d6c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009910 tx=0x7fb33c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:39.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.717+0000 7fb3523ff700 1 -- 172.21.15.154:0/4008390040 shutdown_connections 2023-10-10T22:17:39.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.717+0000 7fb3523ff700 1 --2- 172.21.15.154:0/4008390040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c0c85c0 0x7fb34c06d6c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:39.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.717+0000 7fb3523ff700 1 -- 172.21.15.154:0/4008390040 >> 172.21.15.154:0/4008390040 conn(0x7fb34c0cc540 msgr2=0x7fb34c0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:39.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.717+0000 7fb3523ff700 1 -- 172.21.15.154:0/4008390040 shutdown_connections 2023-10-10T22:17:39.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.717+0000 7fb3523ff700 1 -- 172.21.15.154:0/4008390040 wait complete. 2023-10-10T22:17:39.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.718+0000 7fb3523ff700 1 Processor -- start 2023-10-10T22:17:39.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.719+0000 7fb3523ff700 1 -- start start 2023-10-10T22:17:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.719+0000 7fb3523ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c069fa0 0x7fb34c1670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.719+0000 7fb3523ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb34c0c85c0 0x7fb34c0c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:39.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.719+0000 7fb3523ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb34c156ee0 0x7fb34c152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:39.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.719+0000 7fb3523ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c7170 con 0x7fb34c0c85c0 2023-10-10T22:17:39.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.719+0000 7fb3523ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c6560 con 0x7fb34c156ee0 2023-10-10T22:17:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.719+0000 7fb3523ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c6840 con 0x7fb34c069fa0 2023-10-10T22:17:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb343fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb34c0c85c0 0x7fb34c0c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb343fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb34c0c85c0 0x7fb34c0c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42826/0 (socket says 172.21.15.154:42826) 2023-10-10T22:17:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb343fff700 1 -- 172.21.15.154:0/3415139516 learned_addr learned my addr 172.21.15.154:0/3415139516 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb34bfff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c069fa0 0x7fb34c1670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb35099c700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb34c156ee0 0x7fb34c152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb343fff700 1 -- 172.21.15.154:0/3415139516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c069fa0 msgr2=0x7fb34c1670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb343fff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c069fa0 0x7fb34c1670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb343fff700 1 -- 172.21.15.154:0/3415139516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb34c156ee0 msgr2=0x7fb34c152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb343fff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb34c156ee0 0x7fb34c152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb343fff700 1 -- 172.21.15.154:0/3415139516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c009420 con 0x7fb34c0c85c0 2023-10-10T22:17:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.720+0000 7fb35099c700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb34c156ee0 0x7fb34c152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.721+0000 7fb343fff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb34c0c85c0 0x7fb34c0c5a80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c790 tx=0x7fb334007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.721+0000 7fb348ff9700 1 -- 172.21.15.154:0/3415139516 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334005c00 con 0x7fb34c0c85c0 2023-10-10T22:17:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.721+0000 7fb348ff9700 1 -- 172.21.15.154:0/3415139516 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb334005d60 con 0x7fb34c0c85c0 2023-10-10T22:17:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.721+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c0c6b20 con 0x7fb34c0c85c0 2023-10-10T22:17:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.721+0000 7fb348ff9700 1 -- 172.21.15.154:0/3415139516 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334007300 con 0x7fb34c0c85c0 2023-10-10T22:17:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.721+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c155730 con 0x7fb34c0c85c0 2023-10-10T22:17:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.722+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c0c7320 con 0x7fb34c0c85c0 2023-10-10T22:17:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.723+0000 7fb348ff9700 1 -- 172.21.15.154:0/3415139516 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb33401b3b0 con 0x7fb34c0c85c0 2023-10-10T22:17:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.724+0000 7fb348ff9700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb32c066f60 0x7fb32c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.724+0000 7fb348ff9700 1 -- 172.21.15.154:0/3415139516 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5687+0+0 (secure 0 0 0) 0x7fb334083b50 con 0x7fb34c0c85c0 2023-10-10T22:17:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.724+0000 7fb34bfff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb32c066f60 0x7fb32c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.725+0000 7fb34bfff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb32c066f60 0x7fb32c069410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009860 tx=0x7fb33c017000 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:39.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.729+0000 7fb348ff9700 1 -- 172.21.15.154:0/3415139516 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb34c0c7320 con 0x7fb34c0c85c0 2023-10-10T22:17:39.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:39.919+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb34c0718b0 con 0x7fb34c0c85c0 2023-10-10T22:17:40.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.504+0000 7fb348ff9700 1 -- 172.21.15.154:0/3415139516 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v159) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb334017070 con 0x7fb34c0c85c0 2023-10-10T22:17:40.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.515+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb32c066f60 msgr2=0x7fb32c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:40.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.515+0000 7fb3523ff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb32c066f60 0x7fb32c069410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009860 tx=0x7fb33c017000 comp rx=0 tx=0).stop 2023-10-10T22:17:40.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.515+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb34c0c85c0 msgr2=0x7fb34c0c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:40.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.515+0000 7fb3523ff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb34c0c85c0 0x7fb34c0c5a80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c790 tx=0x7fb334007ea0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.516+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 shutdown_connections 2023-10-10T22:17:40.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.516+0000 7fb3523ff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb34c156ee0 0x7fb34c152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.516+0000 7fb3523ff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb34c069fa0 0x7fb34c1670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.516+0000 7fb3523ff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb32c066f60 0x7fb32c069410 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009860 tx=0x7fb33c017000 comp rx=0 tx=0).stop 2023-10-10T22:17:40.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.516+0000 7fb3523ff700 1 --2- 172.21.15.154:0/3415139516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb34c0c85c0 0x7fb34c0c5a80 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.516+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 >> 172.21.15.154:0/3415139516 conn(0x7fb34c0cc540 msgr2=0x7fb34c070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:40.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.518+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 shutdown_connections 2023-10-10T22:17:40.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.521+0000 7fb3523ff700 1 -- 172.21.15.154:0/3415139516 wait complete. 2023-10-10T22:17:40.526 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T22:17:40.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T22:17:40.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.728+0000 7f67aa7ff700 1 Processor -- start 2023-10-10T22:17:40.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.728+0000 7f67aa7ff700 1 -- start start 2023-10-10T22:17:40.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67aa7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67a40ccee0 0x7f67a41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:40.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67aa7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f67a40c87c0 0x7f67a4156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:40.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67aa7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a415b0d0 con 0x7f67a40c83f0 2023-10-10T22:17:40.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67aa7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a4156c50 con 0x7f67a40c87c0 2023-10-10T22:17:40.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67aa7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a415a4c0 con 0x7f67a40ccee0 2023-10-10T22:17:40.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67a8d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f67a40c87c0 0x7f67a4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:40.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67a3fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f67a40c83f0 0x7f67a40c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46946/0 (socket says 172.21.15.154:46946) 2023-10-10T22:17:40.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67a3fff700 1 -- 172.21.15.154:0/1804110384 learned_addr learned my addr 172.21.15.154:0/1804110384 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:40.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67a37fe700 1 --2- 172.21.15.154:0/1804110384 >> v2:172.21.15.179:3300/0 conn(0x7f67a40ccee0 0x7f67a41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:40.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67a8d9c700 1 -- 172.21.15.154:0/1804110384 >> v2:172.21.15.179:3300/0 conn(0x7f67a40ccee0 msgr2=0x7f67a41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:40.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67a8d9c700 1 --2- 172.21.15.154:0/1804110384 >> v2:172.21.15.179:3300/0 conn(0x7f67a40ccee0 0x7f67a41561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.730+0000 7f67a8d9c700 1 -- 172.21.15.154:0/1804110384 >> v1:172.21.15.154:6789/0 conn(0x7f67a40c83f0 legacy=0x7f67a40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:40.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.731+0000 7f67a8d9c700 1 -- 172.21.15.154:0/1804110384 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a415a7a0 con 0x7f67a40c87c0 2023-10-10T22:17:40.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.731+0000 7f67a2ffd700 1 -- 172.21.15.154:0/1804110384 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825400839 0 0) 0x7f67a415b0d0 con 0x7f67a40c83f0 2023-10-10T22:17:40.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.731+0000 7f67a8d9c700 1 --2- 172.21.15.154:0/1804110384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40c87c0 0x7f67a4156710 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f67a40c7eb0 tx=0x7f679c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68658bd2a3e8d5ad server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:40.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.731+0000 7f67a2ffd700 1 -- 172.21.15.154:0/1804110384 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c00b6b0 con 0x7f67a40c87c0 2023-10-10T22:17:40.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.731+0000 7f67a2ffd700 1 -- 172.21.15.154:0/1804110384 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c00b810 con 0x7f67a40c87c0 2023-10-10T22:17:40.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.731+0000 7f67a2ffd700 1 -- 172.21.15.154:0/1804110384 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c00bbb0 con 0x7f67a40c87c0 2023-10-10T22:17:40.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.732+0000 7f67aa7ff700 1 -- 172.21.15.154:0/1804110384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40c87c0 msgr2=0x7f67a4156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:40.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.732+0000 7f67aa7ff700 1 --2- 172.21.15.154:0/1804110384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40c87c0 0x7f67a4156710 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f67a40c7eb0 tx=0x7f679c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.732+0000 7f67aa7ff700 1 -- 172.21.15.154:0/1804110384 shutdown_connections 2023-10-10T22:17:40.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.732+0000 7f67aa7ff700 1 --2- 172.21.15.154:0/1804110384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40c87c0 0x7f67a4156710 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.732+0000 7f67aa7ff700 1 --2- 172.21.15.154:0/1804110384 >> v2:172.21.15.179:3300/0 conn(0x7f67a40ccee0 0x7f67a41561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.732+0000 7f67aa7ff700 1 -- 172.21.15.154:0/1804110384 >> 172.21.15.154:0/1804110384 conn(0x7f67a4068e10 msgr2=0x7f67a40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:40.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.732+0000 7f67aa7ff700 1 -- 172.21.15.154:0/1804110384 shutdown_connections 2023-10-10T22:17:40.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.732+0000 7f67aa7ff700 1 -- 172.21.15.154:0/1804110384 wait complete. 2023-10-10T22:17:40.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.733+0000 7f67aa7ff700 1 Processor -- start 2023-10-10T22:17:40.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.733+0000 7f67aa7ff700 1 -- start start 2023-10-10T22:17:40.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.734+0000 7f67aa7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67a40c83f0 0x7f67a4158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:40.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.734+0000 7f67aa7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67a40c87c0 0x7f67a41482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:40.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.734+0000 7f67aa7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40ccee0 0x7f67a40ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:40.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.734+0000 7f67aa7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40b04a0 con 0x7f67a40ccee0 2023-10-10T22:17:40.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.734+0000 7f67aa7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41594a0 con 0x7f67a40c83f0 2023-10-10T22:17:40.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.734+0000 7f67aa7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40af890 con 0x7f67a40c87c0 2023-10-10T22:17:40.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a8d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40ccee0 0x7f67a40ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:40.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a8d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40ccee0 0x7f67a40ca400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42834/0 (socket says 172.21.15.154:42834) 2023-10-10T22:17:40.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a8d9c700 1 -- 172.21.15.154:0/3149315854 learned_addr learned my addr 172.21.15.154:0/3149315854 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:40.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a3fff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67a40c83f0 0x7f67a4158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:40.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a37fe700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67a40c87c0 0x7f67a41482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:40.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a8d9c700 1 -- 172.21.15.154:0/3149315854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67a40c87c0 msgr2=0x7f67a41482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:40.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a8d9c700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67a40c87c0 0x7f67a41482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a8d9c700 1 -- 172.21.15.154:0/3149315854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67a40c83f0 msgr2=0x7f67a4158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:40.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a8d9c700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67a40c83f0 0x7f67a4158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:40.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a8d9c700 1 -- 172.21.15.154:0/3149315854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c009420 con 0x7f67a40ccee0 2023-10-10T22:17:40.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.735+0000 7f67a8d9c700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40ccee0 0x7f67a40ca400 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f679c00b0e0 tx=0x7f679c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:40.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.736+0000 7f678bfff700 1 -- 172.21.15.154:0/3149315854 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c011420 con 0x7f67a40ccee0 2023-10-10T22:17:40.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.736+0000 7f678bfff700 1 -- 172.21.15.154:0/3149315854 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c011580 con 0x7f67a40ccee0 2023-10-10T22:17:40.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.736+0000 7f678bfff700 1 -- 172.21.15.154:0/3149315854 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c011940 con 0x7f67a40ccee0 2023-10-10T22:17:40.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.736+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a40afb70 con 0x7f67a40ccee0 2023-10-10T22:17:40.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.736+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a40b0130 con 0x7f67a40ccee0 2023-10-10T22:17:40.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.737+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a40b0630 con 0x7f67a40ccee0 2023-10-10T22:17:40.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.739+0000 7f678bfff700 1 -- 172.21.15.154:0/3149315854 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f679c011cb0 con 0x7f67a40ccee0 2023-10-10T22:17:40.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.740+0000 7f678bfff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6790066f30 0x7f67900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:40.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.740+0000 7f678bfff700 1 -- 172.21.15.154:0/3149315854 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f679c086a30 con 0x7f67a40ccee0 2023-10-10T22:17:40.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.740+0000 7f67a3fff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6790066f30 0x7f67900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:40.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.741+0000 7f67a3fff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6790066f30 0x7f67900693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6794002250 tx=0x7f6794001a20 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:40.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.743+0000 7f678bfff700 1 -- 172.21.15.154:0/3149315854 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f679c053b50 con 0x7f67a40ccee0 2023-10-10T22:17:40.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:40.980+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f67a404c3c0 con 0x7f67a40ccee0 2023-10-10T22:17:41.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.973+0000 7f678bfff700 1 -- 172.21.15.154:0/3149315854 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7f679c0150c0 con 0x7f67a40ccee0 2023-10-10T22:17:41.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.977+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6790066f30 msgr2=0x7f67900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:41.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.977+0000 7f67aa7ff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6790066f30 0x7f67900693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6794002250 tx=0x7f6794001a20 comp rx=0 tx=0).stop 2023-10-10T22:17:41.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.977+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40ccee0 msgr2=0x7f67a40ca400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:41.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.977+0000 7f67aa7ff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40ccee0 0x7f67a40ca400 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f679c00b0e0 tx=0x7f679c017000 comp rx=0 tx=0).stop 2023-10-10T22:17:41.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.977+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 shutdown_connections 2023-10-10T22:17:41.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.977+0000 7f67aa7ff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6790066f30 0x7f67900693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:41.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.977+0000 7f67aa7ff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a40ccee0 0x7f67a40ca400 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:41.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.977+0000 7f67aa7ff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67a40c83f0 0x7f67a4158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:41.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.977+0000 7f67aa7ff700 1 --2- 172.21.15.154:0/3149315854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67a40c87c0 0x7f67a41482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:41.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.978+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 >> 172.21.15.154:0/3149315854 conn(0x7f67a4068e10 msgr2=0x7f67a40cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:41.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.978+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 shutdown_connections 2023-10-10T22:17:41.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:41.978+0000 7f67aa7ff700 1 -- 172.21.15.154:0/3149315854 wait complete. 2023-10-10T22:17:41.983 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 18 and data pool 19 2023-10-10T22:17:42.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:17:42.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.193+0000 7fac889ff700 1 Processor -- start 2023-10-10T22:17:42.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.193+0000 7fac889ff700 1 -- start start 2023-10-10T22:17:42.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.194+0000 7fac889ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1c20 0x7fac841572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac889ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac84157820 0x7fac840abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac889ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac84157c80 con 0x7fac840b1850 2023-10-10T22:17:42.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac889ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8406fc30 con 0x7fac84157820 2023-10-10T22:17:42.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac889ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac840cc260 con 0x7fac840b1c20 2023-10-10T22:17:42.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac82d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac84157820 0x7fac840abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac82d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac84157820 0x7fac840abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42850/0 (socket says 172.21.15.154:42850) 2023-10-10T22:17:42.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac82d9d700 1 -- 172.21.15.154:0/1941930830 learned_addr learned my addr 172.21.15.154:0/1941930830 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:42.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac81d9b700 1 --2- 172.21.15.154:0/1941930830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1c20 0x7fac841572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac82d9d700 1 -- 172.21.15.154:0/1941930830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1c20 msgr2=0x7fac841572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:42.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac82d9d700 1 --2- 172.21.15.154:0/1941930830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1c20 0x7fac841572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac82d9d700 1 -- 172.21.15.154:0/1941930830 >> v1:172.21.15.179:6789/0 conn(0x7fac840b1850 legacy=0x7fac840ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.195+0000 7fac82d9d700 1 -- 172.21.15.154:0/1941930830 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac840cb300 con 0x7fac84157820 2023-10-10T22:17:42.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac82d9d700 1 --2- 172.21.15.154:0/1941930830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac84157820 0x7fac840abf60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009f20 tx=0x7fac7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290f6dedc3b6fc91 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:42.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac8159a700 1 -- 172.21.15.154:0/1941930830 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00e070 con 0x7fac84157820 2023-10-10T22:17:42.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac8159a700 1 -- 172.21.15.154:0/1941930830 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c00b9d0 con 0x7fac84157820 2023-10-10T22:17:42.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac8159a700 1 -- 172.21.15.154:0/1941930830 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c0092e0 con 0x7fac84157820 2023-10-10T22:17:42.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac889ff700 1 -- 172.21.15.154:0/1941930830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac84157820 msgr2=0x7fac840abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac889ff700 1 --2- 172.21.15.154:0/1941930830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac84157820 0x7fac840abf60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009f20 tx=0x7fac7c009840 comp rx=0 tx=0).stop 2023-10-10T22:17:42.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac889ff700 1 -- 172.21.15.154:0/1941930830 shutdown_connections 2023-10-10T22:17:42.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac889ff700 1 --2- 172.21.15.154:0/1941930830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac84157820 0x7fac840abf60 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac889ff700 1 --2- 172.21.15.154:0/1941930830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1c20 0x7fac841572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.196+0000 7fac889ff700 1 -- 172.21.15.154:0/1941930830 >> 172.21.15.154:0/1941930830 conn(0x7fac8406a320 msgr2=0x7fac840cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:42.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.197+0000 7fac889ff700 1 -- 172.21.15.154:0/1941930830 shutdown_connections 2023-10-10T22:17:42.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.197+0000 7fac889ff700 1 -- 172.21.15.154:0/1941930830 wait complete. 2023-10-10T22:17:42.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.198+0000 7fac889ff700 1 Processor -- start 2023-10-10T22:17:42.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.198+0000 7fac889ff700 1 -- start start 2023-10-10T22:17:42.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac889ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1850 0x7fac8414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac889ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840b1c20 0x7fac8414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac889ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac84157820 0x7fac84151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac889ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8415a170 con 0x7fac840b1c20 2023-10-10T22:17:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac889ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8414cad0 con 0x7fac84157820 2023-10-10T22:17:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac889ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8416b500 con 0x7fac840b1850 2023-10-10T22:17:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac81d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840b1c20 0x7fac8414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac81d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840b1c20 0x7fac8414e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42852/0 (socket says 172.21.15.154:42852) 2023-10-10T22:17:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac81d9b700 1 -- 172.21.15.154:0/465893256 learned_addr learned my addr 172.21.15.154:0/465893256 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:42.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.199+0000 7fac8259c700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1850 0x7fac8414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac82d9d700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac84157820 0x7fac84151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac81d9b700 1 -- 172.21.15.154:0/465893256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1850 msgr2=0x7fac8414b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac81d9b700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1850 0x7fac8414b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac81d9b700 1 -- 172.21.15.154:0/465893256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac84157820 msgr2=0x7fac84151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac81d9b700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac84157820 0x7fac84151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac81d9b700 1 -- 172.21.15.154:0/465893256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c009ae0 con 0x7fac840b1c20 2023-10-10T22:17:42.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac81d9b700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840b1c20 0x7fac8414e8c0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fac7800ec80 tx=0x7fac780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:42.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac727fc700 1 -- 172.21.15.154:0/465893256 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800c850 con 0x7fac840b1c20 2023-10-10T22:17:42.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac727fc700 1 -- 172.21.15.154:0/465893256 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7800c9b0 con 0x7fac840b1c20 2023-10-10T22:17:42.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac727fc700 1 -- 172.21.15.154:0/465893256 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800cd50 con 0x7fac840b1c20 2023-10-10T22:17:42.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.200+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8416b7e0 con 0x7fac840b1c20 2023-10-10T22:17:42.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.201+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8416bda0 con 0x7fac840b1c20 2023-10-10T22:17:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.202+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8404c3c0 con 0x7fac840b1c20 2023-10-10T22:17:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.203+0000 7fac727fc700 1 -- 172.21.15.154:0/465893256 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac78013680 con 0x7fac840b1c20 2023-10-10T22:17:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.204+0000 7fac727fc700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fac64067000 0x7fac640694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.204+0000 7fac727fc700 1 -- 172.21.15.154:0/465893256 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fac78084950 con 0x7fac840b1c20 2023-10-10T22:17:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.204+0000 7fac8259c700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fac64067000 0x7fac640694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.204+0000 7fac8259c700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fac64067000 0x7fac640694b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fac8415c950 tx=0x7fac74009040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.208+0000 7fac727fc700 1 -- 172.21.15.154:0/465893256 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac780519d0 con 0x7fac840b1c20 2023-10-10T22:17:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.401+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac840cb5e0 con 0x7fac840b1c20 2023-10-10T22:17:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.402+0000 7fac727fc700 1 -- 172.21.15.154:0/465893256 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16136 (secure 0 0 0) 0x7fac78054ff0 con 0x7fac840b1c20 2023-10-10T22:17:42.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:42.404 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":160,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:17:40.982042+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:17:39.176673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-10T22:17:39.960878+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:17:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fac64067000 msgr2=0x7fac640694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fac64067000 0x7fac640694b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fac8415c950 tx=0x7fac74009040 comp rx=0 tx=0).stop 2023-10-10T22:17:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840b1c20 msgr2=0x7fac8414e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840b1c20 0x7fac8414e8c0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fac7800ec80 tx=0x7fac780091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 shutdown_connections 2023-10-10T22:17:42.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac84157820 0x7fac84151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac840b1850 0x7fac8414b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fac64067000 0x7fac640694b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 --2- 172.21.15.154:0/465893256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840b1c20 0x7fac8414e8c0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 >> 172.21.15.154:0/465893256 conn(0x7fac8406a320 msgr2=0x7fac840acf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:42.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 shutdown_connections 2023-10-10T22:17:42.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.405+0000 7fac889ff700 1 -- 172.21.15.154:0/465893256 wait complete. 2023-10-10T22:17:42.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:17:42.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.608+0000 7fd9873ff700 1 Processor -- start 2023-10-10T22:17:42.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.608+0000 7fd9873ff700 1 -- start start 2023-10-10T22:17:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.610+0000 7fd9873ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd9801578b0 0x7fd980155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.610+0000 7fd9873ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9800ad930 con 0x7fd980155c10 2023-10-10T22:17:42.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.610+0000 7fd9873ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9800acd20 con 0x7fd9800af2f0 2023-10-10T22:17:42.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.610+0000 7fd9873ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9800ad000 con 0x7fd9801578b0 2023-10-10T22:17:42.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.610+0000 7fd98519b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd980155c10 0x7fd9800ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46952/0 (socket says 172.21.15.154:46952) 2023-10-10T22:17:42.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.610+0000 7fd98519b700 1 -- 172.21.15.154:0/4136719904 learned_addr learned my addr 172.21.15.154:0/4136719904 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:42.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.610+0000 7fd98499a700 1 --2- 172.21.15.154:0/4136719904 >> v2:172.21.15.179:3300/0 conn(0x7fd9801578b0 0x7fd980155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.610+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129913794 0 0) 0x7fd9800ad930 con 0x7fd980155c10 2023-10-10T22:17:42.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.610+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd96c003570 con 0x7fd980155c10 2023-10-10T22:17:42.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3847805504 0 0) 0x7fd96c003570 con 0x7fd980155c10 2023-10-10T22:17:42.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 >> v2:172.21.15.179:3300/0 conn(0x7fd9801578b0 msgr2=0x7fd980155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:42.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 --2- 172.21.15.154:0/4136719904 >> v2:172.21.15.179:3300/0 conn(0x7fd9801578b0 0x7fd980155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 >> v1:172.21.15.179:6789/0 conn(0x7fd9800af2f0 legacy=0x7fd9800af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800ad2e0 con 0x7fd980155c10 2023-10-10T22:17:42.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fd97c001470 con 0x7fd980155c10 2023-10-10T22:17:42.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 >> v1:172.21.15.154:6789/0 conn(0x7fd980155c10 legacy=0x7fd9800ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd96c003a60 0x7fd96c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd96c004810 0x7fd96c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd96c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800ad000 con 0x7fd96c0051c0 2023-10-10T22:17:42.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c00c0b0 con 0x7fd96c003a60 2023-10-10T22:17:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c00e480 con 0x7fd96c004810 2023-10-10T22:17:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd98599c700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd96c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd98519b700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd96c003a60 0x7fd96c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.611+0000 7fd98499a700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd96c004810 0x7fd96c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd98599c700 1 -- 172.21.15.154:0/4136719904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd96c004810 msgr2=0x7fd96c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:42.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd98599c700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd96c004810 0x7fd96c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd98599c700 1 -- 172.21.15.154:0/4136719904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd96c003a60 msgr2=0x7fd96c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:42.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd98599c700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd96c003a60 0x7fd96c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd98599c700 1 -- 172.21.15.154:0/4136719904 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c003570 con 0x7fd96c0051c0 2023-10-10T22:17:42.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd98599c700 1 -- 172.21.15.154:0/4136719904 reap_dead start 2023-10-10T22:17:42.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd98599c700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd96c00ba60 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd9780020a0 tx=0x7fd9780016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393d09f147bc3252 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:42.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9780019e0 con 0x7fd96c0051c0 2023-10-10T22:17:42.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97800c8b0 con 0x7fd96c0051c0 2023-10-10T22:17:42.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.612+0000 7fd977fff700 1 -- 172.21.15.154:0/4136719904 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97800cc50 con 0x7fd96c0051c0 2023-10-10T22:17:42.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.613+0000 7fd9873ff700 1 -- 172.21.15.154:0/4136719904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 msgr2=0x7fd96c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.613+0000 7fd9873ff700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd96c00ba60 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd9780020a0 tx=0x7fd9780016d0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.613+0000 7fd9873ff700 1 -- 172.21.15.154:0/4136719904 shutdown_connections 2023-10-10T22:17:42.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.613+0000 7fd9873ff700 1 --2- 172.21.15.154:0/4136719904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd96c00ba60 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.613+0000 7fd9873ff700 1 -- 172.21.15.154:0/4136719904 >> 172.21.15.154:0/4136719904 conn(0x7fd98006a320 msgr2=0x7fd9800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:42.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.613+0000 7fd9873ff700 1 -- 172.21.15.154:0/4136719904 shutdown_connections 2023-10-10T22:17:42.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.613+0000 7fd9873ff700 1 -- 172.21.15.154:0/4136719904 wait complete. 2023-10-10T22:17:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.614+0000 7fd9873ff700 1 Processor -- start 2023-10-10T22:17:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.614+0000 7fd9873ff700 1 -- start start 2023-10-10T22:17:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.615+0000 7fd9873ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd9800cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.615+0000 7fd9873ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9800a55e0 0x7fd98013ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.615+0000 7fd9873ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd98006e330 0x7fd98006e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.615+0000 7fd9873ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98013fcc0 con 0x7fd96c0051c0 2023-10-10T22:17:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.615+0000 7fd9873ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98006ecf0 con 0x7fd9800a55e0 2023-10-10T22:17:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.615+0000 7fd9873ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd980140ac0 con 0x7fd98006e330 2023-10-10T22:17:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.615+0000 7fd98519b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd9800cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd98519b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd9800cc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42882/0 (socket says 172.21.15.154:42882) 2023-10-10T22:17:42.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd98519b700 1 -- 172.21.15.154:0/3919722575 learned_addr learned my addr 172.21.15.154:0/3919722575 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:42.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd98519b700 1 -- 172.21.15.154:0/3919722575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd98006e330 msgr2=0x7fd98006e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd98519b700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd98006e330 0x7fd98006e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd98519b700 1 -- 172.21.15.154:0/3919722575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9800a55e0 msgr2=0x7fd98013ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd98519b700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9800a55e0 0x7fd98013ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd98519b700 1 -- 172.21.15.154:0/3919722575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800ccf30 con 0x7fd96c0051c0 2023-10-10T22:17:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd98519b700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd9800cc9f0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd97c007390 tx=0x7fd97c001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd9757fa700 1 -- 172.21.15.154:0/3919722575 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00f8d0 con 0x7fd96c0051c0 2023-10-10T22:17:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd9757fa700 1 -- 172.21.15.154:0/3919722575 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c00fa50 con 0x7fd96c0051c0 2023-10-10T22:17:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd9757fa700 1 -- 172.21.15.154:0/3919722575 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00fe10 con 0x7fd96c0051c0 2023-10-10T22:17:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98013efd0 con 0x7fd96c0051c0 2023-10-10T22:17:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.616+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd980140190 con 0x7fd96c0051c0 2023-10-10T22:17:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.617+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98004c3c0 con 0x7fd96c0051c0 2023-10-10T22:17:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.618+0000 7fd9757fa700 1 -- 172.21.15.154:0/3919722575 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd97c0135c0 con 0x7fd96c0051c0 2023-10-10T22:17:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.619+0000 7fd9757fa700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd964066f30 0x7fd9640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.620+0000 7fd9757fa700 1 -- 172.21.15.154:0/3919722575 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fd97c083ff0 con 0x7fd96c0051c0 2023-10-10T22:17:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.620+0000 7fd98499a700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd964066f30 0x7fd9640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.620+0000 7fd98499a700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd964066f30 0x7fd9640693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd970009170 tx=0x7fd9700091a0 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.624+0000 7fd9757fa700 1 -- 172.21.15.154:0/3919722575 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd97c051090 con 0x7fd96c0051c0 2023-10-10T22:17:42.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.815+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9800ad5c0 con 0x7fd96c0051c0 2023-10-10T22:17:42.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.816+0000 7fd9757fa700 1 -- 172.21.15.154:0/3919722575 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+16123 (secure 0 0 0) 0x7fd97c0546b0 con 0x7fd96c0051c0 2023-10-10T22:17:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:42.818 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":161,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:17:42.515637+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:17:39.176673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-10T22:17:39.960878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:17:42.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd964066f30 msgr2=0x7fd9640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd964066f30 0x7fd9640693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd970009170 tx=0x7fd9700091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 msgr2=0x7fd9800cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:42.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd9800cc9f0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd97c007390 tx=0x7fd97c001da0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 shutdown_connections 2023-10-10T22:17:42.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd98006e330 0x7fd98006e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd964066f30 0x7fd9640693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd96c0051c0 0x7fd9800cc9f0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 --2- 172.21.15.154:0/3919722575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9800a55e0 0x7fd98013ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:42.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 >> 172.21.15.154:0/3919722575 conn(0x7fd98006a320 msgr2=0x7fd980153550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:42.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 shutdown_connections 2023-10-10T22:17:42.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:42.818+0000 7fd9873ff700 1 -- 172.21.15.154:0/3919722575 wait complete. 2023-10-10T22:17:42.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T22:17:43.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.024+0000 7f1c9d3ff700 1 Processor -- start 2023-10-10T22:17:43.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.024+0000 7f1c9d3ff700 1 -- start start 2023-10-10T22:17:43.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c9d3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c980c83f0 0x7f1c980c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:43.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c9d3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1c981568e0 0x7f1c980ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:43.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c9d3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9815b0d0 con 0x7f1c980ccee0 2023-10-10T22:17:43.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c9d3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c980c7a60 con 0x7f1c980c83f0 2023-10-10T22:17:43.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c9d3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9815a4c0 con 0x7f1c981568e0 2023-10-10T22:17:43.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c96ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c980c83f0 0x7f1c980c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:43.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c96ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c980c83f0 0x7f1c980c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42892/0 (socket says 172.21.15.154:42892) 2023-10-10T22:17:43.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c96ffd700 1 -- 172.21.15.154:0/3897580019 learned_addr learned my addr 172.21.15.154:0/3897580019 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:43.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c96ffd700 1 -- 172.21.15.154:0/3897580019 >> v2:172.21.15.179:3300/0 conn(0x7f1c981568e0 msgr2=0x7f1c980ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:43.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c96ffd700 1 --2- 172.21.15.154:0/3897580019 >> v2:172.21.15.179:3300/0 conn(0x7f1c981568e0 0x7f1c980ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c96ffd700 1 -- 172.21.15.154:0/3897580019 >> v1:172.21.15.179:6789/0 conn(0x7f1c980ccee0 legacy=0x7f1c981561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:43.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.026+0000 7f1c96ffd700 1 -- 172.21.15.154:0/3897580019 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9815a7a0 con 0x7f1c980c83f0 2023-10-10T22:17:43.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c96ffd700 1 --2- 172.21.15.154:0/3897580019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980c83f0 0x7f1c980c7520 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f1c9806d240 tx=0x7f1c88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397bedf90899f33d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:43.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c967fc700 1 -- 172.21.15.154:0/3897580019 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8800b820 con 0x7f1c980c83f0 2023-10-10T22:17:43.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c967fc700 1 -- 172.21.15.154:0/3897580019 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8800b980 con 0x7f1c980c83f0 2023-10-10T22:17:43.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c967fc700 1 -- 172.21.15.154:0/3897580019 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8800bd20 con 0x7f1c980c83f0 2023-10-10T22:17:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3897580019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980c83f0 msgr2=0x7f1c980c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c9d3ff700 1 --2- 172.21.15.154:0/3897580019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980c83f0 0x7f1c980c7520 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f1c9806d240 tx=0x7f1c88009250 comp rx=0 tx=0).stop 2023-10-10T22:17:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3897580019 shutdown_connections 2023-10-10T22:17:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c9d3ff700 1 --2- 172.21.15.154:0/3897580019 >> v2:172.21.15.179:3300/0 conn(0x7f1c981568e0 0x7f1c980ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c9d3ff700 1 --2- 172.21.15.154:0/3897580019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980c83f0 0x7f1c980c7520 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.027+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3897580019 >> 172.21.15.154:0/3897580019 conn(0x7f1c98068e10 msgr2=0x7f1c980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.028+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3897580019 shutdown_connections 2023-10-10T22:17:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.028+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3897580019 wait complete. 2023-10-10T22:17:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.029+0000 7f1c9d3ff700 1 Processor -- start 2023-10-10T22:17:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.029+0000 7f1c9d3ff700 1 -- start start 2023-10-10T22:17:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c9d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980c83f0 0x7f1c980b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c9d3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccee0 0x7f1c98159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c9d3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c981568e0 0x7f1c980c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c9d3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980c3990 con 0x7f1c980ccee0 2023-10-10T22:17:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c9d3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980b1510 con 0x7f1c981568e0 2023-10-10T22:17:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c9d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c98159b50 con 0x7f1c980c83f0 2023-10-10T22:17:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c8ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccee0 0x7f1c98159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c8ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccee0 0x7f1c98159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42898/0 (socket says 172.21.15.154:42898) 2023-10-10T22:17:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c8ffff700 1 -- 172.21.15.154:0/3754191131 learned_addr learned my addr 172.21.15.154:0/3754191131 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c96ffd700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980c83f0 0x7f1c980b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.030+0000 7f1c977fe700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c981568e0 0x7f1c980c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:43.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c8ffff700 1 -- 172.21.15.154:0/3754191131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980c83f0 msgr2=0x7f1c980b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:43.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c8ffff700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980c83f0 0x7f1c980b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c8ffff700 1 -- 172.21.15.154:0/3754191131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c981568e0 msgr2=0x7f1c980c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:43.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c8ffff700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c981568e0 0x7f1c980c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c8ffff700 1 -- 172.21.15.154:0/3754191131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c880094f0 con 0x7f1c980ccee0 2023-10-10T22:17:43.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c8ffff700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccee0 0x7f1c98159610 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000b630 tx=0x7f1c800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:43.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c8effd700 1 -- 172.21.15.154:0/3754191131 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8000f510 con 0x7f1c980ccee0 2023-10-10T22:17:43.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c8effd700 1 -- 172.21.15.154:0/3754191131 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8000f690 con 0x7f1c980ccee0 2023-10-10T22:17:43.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c8effd700 1 -- 172.21.15.154:0/3754191131 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8000fa50 con 0x7f1c980ccee0 2023-10-10T22:17:43.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c980aff90 con 0x7f1c980ccee0 2023-10-10T22:17:43.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.031+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c980b07d0 con 0x7f1c980ccee0 2023-10-10T22:17:43.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.032+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9804c3c0 con 0x7f1c980ccee0 2023-10-10T22:17:43.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.033+0000 7f1c8effd700 1 -- 172.21.15.154:0/3754191131 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c8001a400 con 0x7f1c980ccee0 2023-10-10T22:17:43.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.034+0000 7f1c8effd700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1c78066f30 0x7f1c780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:43.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.034+0000 7f1c8effd700 1 -- 172.21.15.154:0/3754191131 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f1c800840f0 con 0x7f1c980ccee0 2023-10-10T22:17:43.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.034+0000 7f1c96ffd700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1c78066f30 0x7f1c780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:43.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.035+0000 7f1c96ffd700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1c78066f30 0x7f1c780693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c9806d240 tx=0x7f1c88016000 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:43.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.038+0000 7f1c8effd700 1 -- 172.21.15.154:0/3754191131 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c80051170 con 0x7f1c980ccee0 2023-10-10T22:17:43.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.272+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1c9815aa80 con 0x7f1c980ccee0 2023-10-10T22:17:43.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.986+0000 7f1c8effd700 1 -- 172.21.15.154:0/3754191131 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1c80054790 con 0x7f1c980ccee0 2023-10-10T22:17:43.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1c78066f30 msgr2=0x7f1c780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:43.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1c78066f30 0x7f1c780693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c9806d240 tx=0x7f1c88016000 comp rx=0 tx=0).stop 2023-10-10T22:17:43.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccee0 msgr2=0x7f1c98159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:43.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccee0 0x7f1c98159610 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000b630 tx=0x7f1c800091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 shutdown_connections 2023-10-10T22:17:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c981568e0 0x7f1c980c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c980c83f0 0x7f1c980b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1c78066f30 0x7f1c780693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 --2- 172.21.15.154:0/3754191131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980ccee0 0x7f1c98159610 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:43.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 >> 172.21.15.154:0/3754191131 conn(0x7f1c98068e10 msgr2=0x7f1c9815b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:43.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 shutdown_connections 2023-10-10T22:17:43.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:43.989+0000 7f1c9d3ff700 1 -- 172.21.15.154:0/3754191131 wait complete. 2023-10-10T22:17:44.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T22:17:44.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.194+0000 7f8fb6dff700 1 Processor -- start 2023-10-10T22:17:44.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.194+0000 7f8fb6dff700 1 -- start start 2023-10-10T22:17:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.195+0000 7f8fb6dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8fb00c83f0 0x7f8fb00c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.195+0000 7f8fb6dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8fb00ccee0 0x7f8fb01561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.195+0000 7f8fb6dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb00c87c0 0x7f8fb0156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.195+0000 7f8fb6dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb0156c50 con 0x7f8fb00c83f0 2023-10-10T22:17:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.195+0000 7f8fb6dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb015b0d0 con 0x7f8fb00ccee0 2023-10-10T22:17:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.195+0000 7f8fb6dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00c7a60 con 0x7f8fb00c87c0 2023-10-10T22:17:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8fb4b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8fb00c83f0 0x7f8fb00c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8fb4b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8fb00c83f0 0x7f8fb00c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42908/0 (socket says 172.21.15.154:42908) 2023-10-10T22:17:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8fb4b9b700 1 -- 172.21.15.154:0/3000840324 learned_addr learned my addr 172.21.15.154:0/3000840324 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8fb4b9b700 1 -- 172.21.15.154:0/3000840324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb00c87c0 msgr2=0x7f8fb0156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8fb4b9b700 1 --2- 172.21.15.154:0/3000840324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb00c87c0 0x7f8fb0156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8fb4b9b700 1 -- 172.21.15.154:0/3000840324 >> v2:172.21.15.179:3300/0 conn(0x7f8fb00ccee0 msgr2=0x7f8fb01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8faffff700 1 --2- 172.21.15.154:0/3000840324 >> v2:172.21.15.179:3300/0 conn(0x7f8fb00ccee0 0x7f8fb01561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:44.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8fb4b9b700 1 --2- 172.21.15.154:0/3000840324 >> v2:172.21.15.179:3300/0 conn(0x7f8fb00ccee0 0x7f8fb01561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8fb4b9b700 1 -- 172.21.15.154:0/3000840324 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb015a4c0 con 0x7f8fb00c83f0 2023-10-10T22:17:44.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8faffff700 1 --2- 172.21.15.154:0/3000840324 >> v2:172.21.15.179:3300/0 conn(0x7f8fb00ccee0 0x7f8fb01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:44.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.196+0000 7f8fb4b9b700 1 --2- 172.21.15.154:0/3000840324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 0x7f8fb00c7520 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00c7eb0 tx=0x7f8fa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a2bb2844d3f68 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:44.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8faf7fe700 1 -- 172.21.15.154:0/3000840324 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400b860 con 0x7f8fb00c83f0 2023-10-10T22:17:44.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8faf7fe700 1 -- 172.21.15.154:0/3000840324 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400b9c0 con 0x7f8fb00c83f0 2023-10-10T22:17:44.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8faf7fe700 1 -- 172.21.15.154:0/3000840324 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400bd60 con 0x7f8fb00c83f0 2023-10-10T22:17:44.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8fb6dff700 1 -- 172.21.15.154:0/3000840324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 msgr2=0x7f8fb00c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:44.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/3000840324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 0x7f8fb00c7520 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00c7eb0 tx=0x7f8fa4009250 comp rx=0 tx=0).stop 2023-10-10T22:17:44.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8fb6dff700 1 -- 172.21.15.154:0/3000840324 shutdown_connections 2023-10-10T22:17:44.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/3000840324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb00c87c0 0x7f8fb0156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/3000840324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 0x7f8fb00c7520 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/3000840324 >> v2:172.21.15.179:3300/0 conn(0x7f8fb00ccee0 0x7f8fb01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8fb6dff700 1 -- 172.21.15.154:0/3000840324 >> 172.21.15.154:0/3000840324 conn(0x7f8fb0068e10 msgr2=0x7f8fb00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:44.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.197+0000 7f8fb6dff700 1 -- 172.21.15.154:0/3000840324 shutdown_connections 2023-10-10T22:17:44.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.198+0000 7f8fb6dff700 1 -- 172.21.15.154:0/3000840324 wait complete. 2023-10-10T22:17:44.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.199+0000 7f8fb6dff700 1 Processor -- start 2023-10-10T22:17:44.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.199+0000 7f8fb6dff700 1 -- start start 2023-10-10T22:17:44.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb6dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 0x7f8fb01597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:44.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb6dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb00c87c0 0x7f8fb0156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:44.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb6dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb00ccee0 0x7f8fb00ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:44.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb6dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0159d20 con 0x7f8fb00c83f0 2023-10-10T22:17:44.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb6dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0157690 con 0x7f8fb00ccee0 2023-10-10T22:17:44.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb6dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0157970 con 0x7f8fb00c87c0 2023-10-10T22:17:44.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb4b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 0x7f8fb01597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:44.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb4b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 0x7f8fb01597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42916/0 (socket says 172.21.15.154:42916) 2023-10-10T22:17:44.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb4b9b700 1 -- 172.21.15.154:0/4023906511 learned_addr learned my addr 172.21.15.154:0/4023906511 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:44.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8faffff700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb00c87c0 0x7f8fb0156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:44.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb539c700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb00ccee0 0x7f8fb00ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb4b9b700 1 -- 172.21.15.154:0/4023906511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb00c87c0 msgr2=0x7f8fb0156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.200+0000 7f8fb4b9b700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb00c87c0 0x7f8fb0156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8fb4b9b700 1 -- 172.21.15.154:0/4023906511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb00ccee0 msgr2=0x7f8fb00ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8fb4b9b700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb00ccee0 0x7f8fb00ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8fb4b9b700 1 -- 172.21.15.154:0/4023906511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40094f0 con 0x7f8fb00c83f0 2023-10-10T22:17:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8fb539c700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb00ccee0 0x7f8fb00ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8fb4b9b700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 0x7f8fb01597e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009290 tx=0x7f8fa4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8facff9700 1 -- 172.21.15.154:0/4023906511 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4026480 con 0x7f8fb00c83f0 2023-10-10T22:17:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8facff9700 1 -- 172.21.15.154:0/4023906511 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa401f070 con 0x7f8fb00c83f0 2023-10-10T22:17:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb0157c50 con 0x7f8fb00c83f0 2023-10-10T22:17:44.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8facff9700 1 -- 172.21.15.154:0/4023906511 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4026830 con 0x7f8fb00c83f0 2023-10-10T22:17:44.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.201+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb0158210 con 0x7f8fb00c83f0 2023-10-10T22:17:44.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.202+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb004c3c0 con 0x7f8fb00c83f0 2023-10-10T22:17:44.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.203+0000 7f8facff9700 1 -- 172.21.15.154:0/4023906511 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fa4026ba0 con 0x7f8fb00c83f0 2023-10-10T22:17:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.204+0000 7f8facff9700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8f94066f30 0x7f8f940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.204+0000 7f8facff9700 1 -- 172.21.15.154:0/4023906511 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f8fa4021070 con 0x7f8fb00c83f0 2023-10-10T22:17:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.204+0000 7f8faffff700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8f94066f30 0x7f8f940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.205+0000 7f8faffff700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8f94066f30 0x7f8f940693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c006fd0 tx=0x7f8f9c008040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.208+0000 7f8facff9700 1 -- 172.21.15.154:0/4023906511 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fa4053690 con 0x7f8fb00c83f0 2023-10-10T22:17:44.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.440+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8fb015a7a0 con 0x7f8fb00c83f0 2023-10-10T22:17:44.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.989+0000 7f8facff9700 1 -- 172.21.15.154:0/4023906511 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8fa4056cb0 con 0x7f8fb00c83f0 2023-10-10T22:17:44.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8f94066f30 msgr2=0x7f8f940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:44.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8f94066f30 0x7f8f940693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c006fd0 tx=0x7f8f9c008040 comp rx=0 tx=0).stop 2023-10-10T22:17:44.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 msgr2=0x7f8fb01597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:44.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 0x7f8fb01597e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009290 tx=0x7f8fa4017000 comp rx=0 tx=0).stop 2023-10-10T22:17:44.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 shutdown_connections 2023-10-10T22:17:44.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb00ccee0 0x7f8fb00ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8f94066f30 0x7f8f940693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00c83f0 0x7f8fb01597e0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 --2- 172.21.15.154:0/4023906511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb00c87c0 0x7f8fb0156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:44.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 >> 172.21.15.154:0/4023906511 conn(0x7f8fb0068e10 msgr2=0x7f8fb0151cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:44.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 shutdown_connections 2023-10-10T22:17:44.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:44.992+0000 7f8fb6dff700 1 -- 172.21.15.154:0/4023906511 wait complete. 2023-10-10T22:17:45.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:17:45.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.196+0000 7f8da59ff700 1 Processor -- start 2023-10-10T22:17:45.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.196+0000 7f8da59ff700 1 -- start start 2023-10-10T22:17:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8da59ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8da0155c10 0x7f8da0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8da59ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00acac0 con 0x7f8da00ac230 2023-10-10T22:17:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8da59ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00ad930 con 0x7f8da00ac6d0 2023-10-10T22:17:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8da59ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da00acd20 con 0x7f8da0155c10 2023-10-10T22:17:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8d9e7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8da00ac230 0x7f8da01568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46966/0 (socket says 172.21.15.154:46966) 2023-10-10T22:17:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8d9e7fc700 1 -- 172.21.15.154:0/2750739155 learned_addr learned my addr 172.21.15.154:0/2750739155 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8d9effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8da0155c10 0x7f8da0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8d9dffb700 1 -- 172.21.15.154:0/2750739155 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759698762 0 0) 0x7f8da00acac0 con 0x7f8da00ac230 2023-10-10T22:17:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8d9dffb700 1 -- 172.21.15.154:0/2750739155 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d88003570 con 0x7f8da00ac230 2023-10-10T22:17:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8d9effd700 1 -- 172.21.15.154:0/2750739155 >> v1:172.21.15.179:6789/0 conn(0x7f8da00ac6d0 legacy=0x7f8da00b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8d9effd700 1 -- 172.21.15.154:0/2750739155 >> v1:172.21.15.154:6789/0 conn(0x7f8da00ac230 legacy=0x7f8da01568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.198+0000 7f8d9effd700 1 -- 172.21.15.154:0/2750739155 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da00ad000 con 0x7f8da0155c10 2023-10-10T22:17:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.199+0000 7f8d9effd700 1 --2- 172.21.15.154:0/2750739155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da0155c10 0x7f8da0155fe0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f8d900098e0 tx=0x7f8d900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af7f11bcc0e7a6a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.199+0000 7f8d9dffb700 1 -- 172.21.15.154:0/2750739155 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90011630 con 0x7f8da0155c10 2023-10-10T22:17:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.199+0000 7f8d9dffb700 1 -- 172.21.15.154:0/2750739155 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90011790 con 0x7f8da0155c10 2023-10-10T22:17:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.199+0000 7f8d9dffb700 1 -- 172.21.15.154:0/2750739155 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90011b30 con 0x7f8da0155c10 2023-10-10T22:17:45.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.199+0000 7f8da59ff700 1 -- 172.21.15.154:0/2750739155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da0155c10 msgr2=0x7f8da0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.199+0000 7f8da59ff700 1 --2- 172.21.15.154:0/2750739155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da0155c10 0x7f8da0155fe0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f8d900098e0 tx=0x7f8d900091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.200+0000 7f8da59ff700 1 -- 172.21.15.154:0/2750739155 shutdown_connections 2023-10-10T22:17:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.200+0000 7f8da59ff700 1 --2- 172.21.15.154:0/2750739155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da0155c10 0x7f8da0155fe0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.200+0000 7f8da59ff700 1 -- 172.21.15.154:0/2750739155 >> 172.21.15.154:0/2750739155 conn(0x7f8da006a320 msgr2=0x7f8da00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.200+0000 7f8da59ff700 1 -- 172.21.15.154:0/2750739155 shutdown_connections 2023-10-10T22:17:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.200+0000 7f8da59ff700 1 -- 172.21.15.154:0/2750739155 wait complete. 2023-10-10T22:17:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.201+0000 7f8da59ff700 1 Processor -- start 2023-10-10T22:17:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.201+0000 7f8da59ff700 1 -- start start 2023-10-10T22:17:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8da59ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8da00ac230 0x7f8da006d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8da59ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00ac6d0 0x7f8da006f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8da59ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da0155c10 0x7f8da0158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8da59ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00cb990 con 0x7f8da00ac6d0 2023-10-10T22:17:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8da59ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00cc1c0 con 0x7f8da0155c10 2023-10-10T22:17:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8da59ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da01599c0 con 0x7f8da00ac230 2023-10-10T22:17:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8d9e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00ac6d0 0x7f8da006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8d9e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00ac6d0 0x7f8da006f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42940/0 (socket says 172.21.15.154:42940) 2023-10-10T22:17:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8d9e7fc700 1 -- 172.21.15.154:0/331117531 learned_addr learned my addr 172.21.15.154:0/331117531 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8d9effd700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8da00ac230 0x7f8da006d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.202+0000 7f8d9f7fe700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da0155c10 0x7f8da0158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8d9e7fc700 1 -- 172.21.15.154:0/331117531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8da00ac230 msgr2=0x7f8da006d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8d9e7fc700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8da00ac230 0x7f8da006d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8d9e7fc700 1 -- 172.21.15.154:0/331117531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da0155c10 msgr2=0x7f8da0158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8d9e7fc700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da0155c10 0x7f8da0158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8d9e7fc700 1 -- 172.21.15.154:0/331117531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d90009420 con 0x7f8da00ac6d0 2023-10-10T22:17:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8d9e7fc700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00ac6d0 0x7f8da006f460 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c7c0 tx=0x7f8d94007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8d86ffd700 1 -- 172.21.15.154:0/331117531 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94005b30 con 0x7f8da00ac6d0 2023-10-10T22:17:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8d86ffd700 1 -- 172.21.15.154:0/331117531 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d94005c90 con 0x7f8da00ac6d0 2023-10-10T22:17:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da00cbb70 con 0x7f8da00ac6d0 2023-10-10T22:17:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8d86ffd700 1 -- 172.21.15.154:0/331117531 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94007320 con 0x7f8da00ac6d0 2023-10-10T22:17:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.203+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da0151d10 con 0x7f8da00ac6d0 2023-10-10T22:17:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.204+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da00cc350 con 0x7f8da00ac6d0 2023-10-10T22:17:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.205+0000 7f8d86ffd700 1 -- 172.21.15.154:0/331117531 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d9401b400 con 0x7f8da00ac6d0 2023-10-10T22:17:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.206+0000 7f8d86ffd700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d8c066f30 0x7f8d8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.207+0000 7f8d86ffd700 1 -- 172.21.15.154:0/331117531 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f8d940841a0 con 0x7f8da00ac6d0 2023-10-10T22:17:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.207+0000 7f8d9effd700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d8c066f30 0x7f8d8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.207+0000 7f8d9effd700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d8c066f30 0x7f8d8c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d900091e0 tx=0x7f8d90016000 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.211+0000 7f8d86ffd700 1 -- 172.21.15.154:0/331117531 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d94051220 con 0x7f8da00ac6d0 2023-10-10T22:17:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.443+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8da004c3c0 con 0x7f8da00ac6d0 2023-10-10T22:17:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.444+0000 7f8d86ffd700 1 -- 172.21.15.154:0/331117531 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f8d94054840 con 0x7f8da00ac6d0 2023-10-10T22:17:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:45.446 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7196,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3891554759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3891554759},{"type":"v1","addr":"172.21.15.179:6834","nonce":3891554759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8158,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1858498414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1858498414},{"type":"v1","addr":"172.21.15.154:6835","nonce":1858498414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8161,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3531287783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3531287783},{"type":"v1","addr":"172.21.15.179:6835","nonce":3531287783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:17:40.982384+0000","modified":"2023-10-10T22:17:44.985977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8640":{"gid":8640,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/3925813058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3925813058},{"type":"v1","addr":"172.21.15.154:6834","nonce":3925813058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-10T22:17:45.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d8c066f30 msgr2=0x7f8d8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d8c066f30 0x7f8d8c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d900091e0 tx=0x7f8d90016000 comp rx=0 tx=0).stop 2023-10-10T22:17:45.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00ac6d0 msgr2=0x7f8da006f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00ac6d0 0x7f8da006f460 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c7c0 tx=0x7f8d94007e00 comp rx=0 tx=0).stop 2023-10-10T22:17:45.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 shutdown_connections 2023-10-10T22:17:45.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da0155c10 0x7f8da0158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8da00ac230 0x7f8da006d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d8c066f30 0x7f8d8c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 --2- 172.21.15.154:0/331117531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00ac6d0 0x7f8da006f460 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 >> 172.21.15.154:0/331117531 conn(0x7f8da006a320 msgr2=0x7f8da00b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:45.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 shutdown_connections 2023-10-10T22:17:45.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.446+0000 7f8da59ff700 1 -- 172.21.15.154:0/331117531 wait complete. 2023-10-10T22:17:45.450 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 70 2023-10-10T22:17:45.465 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:17:45.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.649+0000 7f29415ff700 1 Processor -- start 2023-10-10T22:17:45.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.649+0000 7f29415ff700 1 -- start start 2023-10-10T22:17:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.650+0000 7f29415ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f293c06bcd0 0x7f293c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.650+0000 7f29415ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f293c15df50 0x7f293c15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.650+0000 7f29415ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c15d7e0 con 0x7f293c06c0a0 2023-10-10T22:17:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.650+0000 7f29415ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c15dac0 con 0x7f293c15df50 2023-10-10T22:17:45.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.650+0000 7f29415ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c15aa30 con 0x7f293c06bcd0 2023-10-10T22:17:45.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.650+0000 7f293b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f293c15df50 0x7f293c15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.650+0000 7f293a7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f293c06c0a0 0x7f293c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46970/0 (socket says 172.21.15.154:46970) 2023-10-10T22:17:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.650+0000 7f293a7fc700 1 -- 172.21.15.154:0/134310591 learned_addr learned my addr 172.21.15.154:0/134310591 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.650+0000 7f293affd700 1 --2- 172.21.15.154:0/134310591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f293c06bcd0 0x7f293c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.651+0000 7f293b7fe700 1 -- 172.21.15.154:0/134310591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f293c06bcd0 msgr2=0x7f293c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.651+0000 7f293b7fe700 1 --2- 172.21.15.154:0/134310591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f293c06bcd0 0x7f293c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.651+0000 7f293b7fe700 1 -- 172.21.15.154:0/134310591 >> v1:172.21.15.154:6789/0 conn(0x7f293c06c0a0 legacy=0x7f293c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.651+0000 7f293b7fe700 1 -- 172.21.15.154:0/134310591 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c15ad10 con 0x7f293c15df50 2023-10-10T22:17:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.651+0000 7f2939ffb700 1 -- 172.21.15.154:0/134310591 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485442935 0 0) 0x7f293c15d7e0 con 0x7f293c06c0a0 2023-10-10T22:17:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.651+0000 7f293b7fe700 1 --2- 172.21.15.154:0/134310591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c15df50 0x7f293c15e3b0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f2934009e60 tx=0x7f2934009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f9f6e6459a5bc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.651+0000 7f2939ffb700 1 -- 172.21.15.154:0/134310591 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293400e070 con 0x7f293c15df50 2023-10-10T22:17:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.651+0000 7f2939ffb700 1 -- 172.21.15.154:0/134310591 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293400bb60 con 0x7f293c15df50 2023-10-10T22:17:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.651+0000 7f2939ffb700 1 -- 172.21.15.154:0/134310591 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934012430 con 0x7f293c15df50 2023-10-10T22:17:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.652+0000 7f29415ff700 1 -- 172.21.15.154:0/134310591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c15df50 msgr2=0x7f293c15e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.652+0000 7f29415ff700 1 --2- 172.21.15.154:0/134310591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c15df50 0x7f293c15e3b0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f2934009e60 tx=0x7f2934009780 comp rx=0 tx=0).stop 2023-10-10T22:17:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.652+0000 7f29415ff700 1 -- 172.21.15.154:0/134310591 shutdown_connections 2023-10-10T22:17:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.652+0000 7f29415ff700 1 --2- 172.21.15.154:0/134310591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c15df50 0x7f293c15e3b0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.652+0000 7f29415ff700 1 --2- 172.21.15.154:0/134310591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f293c06bcd0 0x7f293c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.652+0000 7f29415ff700 1 -- 172.21.15.154:0/134310591 >> 172.21.15.154:0/134310591 conn(0x7f293c0ce600 msgr2=0x7f293c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.652+0000 7f29415ff700 1 -- 172.21.15.154:0/134310591 shutdown_connections 2023-10-10T22:17:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.652+0000 7f29415ff700 1 -- 172.21.15.154:0/134310591 wait complete. 2023-10-10T22:17:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.653+0000 7f29415ff700 1 Processor -- start 2023-10-10T22:17:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.654+0000 7f29415ff700 1 -- start start 2023-10-10T22:17:45.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.654+0000 7f29415ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c06bcd0 0x7f293c1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.654+0000 7f29415ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f293c06c0a0 0x7f293c154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.654+0000 7f29415ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f293c15df50 0x7f293c1601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.654+0000 7f29415ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c1537e0 con 0x7f293c06bcd0 2023-10-10T22:17:45.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.654+0000 7f29415ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c169b30 con 0x7f293c06c0a0 2023-10-10T22:17:45.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.654+0000 7f29415ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c169e10 con 0x7f293c15df50 2023-10-10T22:17:45.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f293affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c06bcd0 0x7f293c1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:45.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f293affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c06bcd0 0x7f293c1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42966/0 (socket says 172.21.15.154:42966) 2023-10-10T22:17:45.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f293affd700 1 -- 172.21.15.154:0/3931413592 learned_addr learned my addr 172.21.15.154:0/3931413592 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:45.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f293affd700 1 -- 172.21.15.154:0/3931413592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f293c15df50 msgr2=0x7f293c1601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f293affd700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f293c15df50 0x7f293c1601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f293affd700 1 -- 172.21.15.154:0/3931413592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f293c06c0a0 msgr2=0x7f293c154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f293affd700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f293c06c0a0 0x7f293c154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f293affd700 1 -- 172.21.15.154:0/3931413592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934009a20 con 0x7f293c06bcd0 2023-10-10T22:17:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f293affd700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c06bcd0 0x7f293c1532a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f292c00e930 tx=0x7f292c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f2922ffd700 1 -- 172.21.15.154:0/3931413592 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00eed0 con 0x7f293c06bcd0 2023-10-10T22:17:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f2922ffd700 1 -- 172.21.15.154:0/3931413592 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c00c850 con 0x7f293c06bcd0 2023-10-10T22:17:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f2922ffd700 1 -- 172.21.15.154:0/3931413592 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00cbf0 con 0x7f293c06bcd0 2023-10-10T22:17:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.655+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c16a0f0 con 0x7f293c06bcd0 2023-10-10T22:17:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.656+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c16a6b0 con 0x7f293c06bcd0 2023-10-10T22:17:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.657+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293c04c3c0 con 0x7f293c06bcd0 2023-10-10T22:17:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.657+0000 7f2922ffd700 1 -- 172.21.15.154:0/3931413592 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f292c013470 con 0x7f293c06bcd0 2023-10-10T22:17:45.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.659+0000 7f2922ffd700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2928066f30 0x7f29280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:45.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.659+0000 7f2922ffd700 1 -- 172.21.15.154:0/3931413592 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f292c084990 con 0x7f293c06bcd0 2023-10-10T22:17:45.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.659+0000 7f293a7fc700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2928066f30 0x7f29280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:45.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.659+0000 7f293a7fc700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2928066f30 0x7f29280693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f293c069e00 tx=0x7f2930007bd0 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:45.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.662+0000 7f2922ffd700 1 -- 172.21.15.154:0/3931413592 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f292c051990 con 0x7f293c06bcd0 2023-10-10T22:17:45.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.855+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f293c16cf10 con 0x7f293c06bcd0 2023-10-10T22:17:45.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.856+0000 7f2922ffd700 1 -- 172.21.15.154:0/3931413592 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+16123 (secure 0 0 0) 0x7f292c054fb0 con 0x7f293c06bcd0 2023-10-10T22:17:45.858 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:45.858 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":161,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:17:42.515637+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:17:39.176673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-10T22:17:39.960878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:17:45.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.858+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2928066f30 msgr2=0x7f29280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.858+0000 7f29415ff700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2928066f30 0x7f29280693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f293c069e00 tx=0x7f2930007bd0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.858+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c06bcd0 msgr2=0x7f293c1532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:45.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.858+0000 7f29415ff700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c06bcd0 0x7f293c1532a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f292c00e930 tx=0x7f292c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.858+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 shutdown_connections 2023-10-10T22:17:45.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.859+0000 7f29415ff700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f293c15df50 0x7f293c1601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.859+0000 7f29415ff700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2928066f30 0x7f29280693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.859+0000 7f29415ff700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f293c06bcd0 0x7f293c1532a0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.859+0000 7f29415ff700 1 --2- 172.21.15.154:0/3931413592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f293c06c0a0 0x7f293c154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:45.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.859+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 >> 172.21.15.154:0/3931413592 conn(0x7f293c0ce600 msgr2=0x7f293c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:45.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.859+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 shutdown_connections 2023-10-10T22:17:45.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:45.859+0000 7f29415ff700 1 -- 172.21.15.154:0/3931413592 wait complete. 2023-10-10T22:17:45.879 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T22:17:45.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:17:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.063+0000 7f7cf8fff700 1 Processor -- start 2023-10-10T22:17:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.064+0000 7f7cf8fff700 1 -- start start 2023-10-10T22:17:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.065+0000 7f7cf8fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40cbf30 0x7f7cf40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.065+0000 7f7cf8fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cf40b1420 0x7f7cf40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.065+0000 7f7cf8fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40cc300 con 0x7f7cf40ccf90 2023-10-10T22:17:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.065+0000 7f7cf8fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf4156bf0 con 0x7f7cf40b1420 2023-10-10T22:17:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.065+0000 7f7cf8fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40ae950 con 0x7f7cf40cbf30 2023-10-10T22:17:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.065+0000 7f7cf2d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cf40b1420 0x7f7cf40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.065+0000 7f7cf2d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cf40b1420 0x7f7cf40c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56182/0 (socket says 172.21.15.154:56182) 2023-10-10T22:17:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.065+0000 7f7cf2d9d700 1 -- 172.21.15.154:0/2520816688 learned_addr learned my addr 172.21.15.154:0/2520816688 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf259c700 1 --2- 172.21.15.154:0/2520816688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40cbf30 0x7f7cf40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf2d9d700 1 -- 172.21.15.154:0/2520816688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40cbf30 msgr2=0x7f7cf40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf2d9d700 1 --2- 172.21.15.154:0/2520816688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40cbf30 0x7f7cf40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf2d9d700 1 -- 172.21.15.154:0/2520816688 >> v1:172.21.15.179:6789/0 conn(0x7f7cf40ccf90 legacy=0x7f7cf40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf2d9d700 1 -- 172.21.15.154:0/2520816688 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40ad370 con 0x7f7cf40b1420 2023-10-10T22:17:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf259c700 1 --2- 172.21.15.154:0/2520816688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40cbf30 0x7f7cf40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf2d9d700 1 --2- 172.21.15.154:0/2520816688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40b1420 0x7f7cf40c9740 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0099e0 tx=0x7f7cec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e681a824fa894846 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf159a700 1 -- 172.21.15.154:0/2520816688 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00b820 con 0x7f7cf40b1420 2023-10-10T22:17:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf159a700 1 -- 172.21.15.154:0/2520816688 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec00b980 con 0x7f7cf40b1420 2023-10-10T22:17:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.066+0000 7f7cf159a700 1 -- 172.21.15.154:0/2520816688 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00bd20 con 0x7f7cf40b1420 2023-10-10T22:17:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.067+0000 7f7cf8fff700 1 -- 172.21.15.154:0/2520816688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40b1420 msgr2=0x7f7cf40c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.067+0000 7f7cf8fff700 1 --2- 172.21.15.154:0/2520816688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40b1420 0x7f7cf40c9740 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0099e0 tx=0x7f7cec009250 comp rx=0 tx=0).stop 2023-10-10T22:17:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.067+0000 7f7cf8fff700 1 -- 172.21.15.154:0/2520816688 shutdown_connections 2023-10-10T22:17:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.067+0000 7f7cf8fff700 1 --2- 172.21.15.154:0/2520816688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40b1420 0x7f7cf40c9740 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.067+0000 7f7cf8fff700 1 --2- 172.21.15.154:0/2520816688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40cbf30 0x7f7cf40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.067+0000 7f7cf8fff700 1 -- 172.21.15.154:0/2520816688 >> 172.21.15.154:0/2520816688 conn(0x7f7cf406a320 msgr2=0x7f7cf40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.067+0000 7f7cf8fff700 1 -- 172.21.15.154:0/2520816688 shutdown_connections 2023-10-10T22:17:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.067+0000 7f7cf8fff700 1 -- 172.21.15.154:0/2520816688 wait complete. 2023-10-10T22:17:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.068+0000 7f7cf8fff700 1 Processor -- start 2023-10-10T22:17:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.069+0000 7f7cf8fff700 1 -- start start 2023-10-10T22:17:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.069+0000 7f7cf8fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40b1420 0x7f7cf40abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.069+0000 7f7cf8fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40cbf30 0x7f7cf40ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.069+0000 7f7cf8fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40ccf90 0x7f7cf40cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.069+0000 7f7cf8fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4167dd0 con 0x7f7cf40ccf90 2023-10-10T22:17:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.069+0000 7f7cf8fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf41680b0 con 0x7f7cf40cbf30 2023-10-10T22:17:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.069+0000 7f7cf8fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4168390 con 0x7f7cf40b1420 2023-10-10T22:17:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40ccf90 0x7f7cf40cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40ccf90 0x7f7cf40cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56192/0 (socket says 172.21.15.154:56192) 2023-10-10T22:17:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf2d9d700 1 -- 172.21.15.154:0/3144003226 learned_addr learned my addr 172.21.15.154:0/3144003226 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf259c700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40b1420 0x7f7cf40abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf1d9b700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40cbf30 0x7f7cf40ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf2d9d700 1 -- 172.21.15.154:0/3144003226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40b1420 msgr2=0x7f7cf40abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf2d9d700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40b1420 0x7f7cf40abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf2d9d700 1 -- 172.21.15.154:0/3144003226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40cbf30 msgr2=0x7f7cf40ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf2d9d700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40cbf30 0x7f7cf40ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf2d9d700 1 -- 172.21.15.154:0/3144003226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec0094f0 con 0x7f7cf40ccf90 2023-10-10T22:17:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf1d9b700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40cbf30 0x7f7cf40ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7cf2d9d700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40ccf90 0x7f7cf40cac10 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009290 tx=0x7f7cec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.070+0000 7f7ce27fc700 1 -- 172.21.15.154:0/3144003226 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00b820 con 0x7f7cf40ccf90 2023-10-10T22:17:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.071+0000 7f7ce27fc700 1 -- 172.21.15.154:0/3144003226 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec01f070 con 0x7f7cf40ccf90 2023-10-10T22:17:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.071+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf4168670 con 0x7f7cf40ccf90 2023-10-10T22:17:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.071+0000 7f7ce27fc700 1 -- 172.21.15.154:0/3144003226 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec01a870 con 0x7f7cf40ccf90 2023-10-10T22:17:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.071+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf40ac4f0 con 0x7f7cf40ccf90 2023-10-10T22:17:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.072+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4069220 con 0x7f7cf40ccf90 2023-10-10T22:17:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.072+0000 7f7ce27fc700 1 -- 172.21.15.154:0/3144003226 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cec01aca0 con 0x7f7cf40ccf90 2023-10-10T22:17:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.074+0000 7f7ce27fc700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7cd4066f30 0x7f7cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.074+0000 7f7ce27fc700 1 -- 172.21.15.154:0/3144003226 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f7cec021070 con 0x7f7cf40ccf90 2023-10-10T22:17:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.074+0000 7f7cf259c700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7cd4066f30 0x7f7cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.074+0000 7f7cf259c700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7cd4066f30 0x7f7cd40693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7cf406e1b0 tx=0x7f7ce40098f0 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.078+0000 7f7ce27fc700 1 -- 172.21.15.154:0/3144003226 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cec0538b0 con 0x7f7cf40ccf90 2023-10-10T22:17:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.265+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7cf404c3c0 con 0x7f7cd4066f30 2023-10-10T22:17:46.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.275+0000 7f7ce27fc700 1 -- 172.21.15.154:0/3144003226 <== mgr.8481 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278450 (secure 0 0 0) 0x7f7cf404c3c0 con 0x7f7cd4066f30 2023-10-10T22:17:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:46.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.279+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7cd4066f30 msgr2=0x7f7cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.279+0000 7f7cf8fff700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7cd4066f30 0x7f7cd40693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7cf406e1b0 tx=0x7f7ce40098f0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.279+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40ccf90 msgr2=0x7f7cf40cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.279+0000 7f7cf8fff700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40ccf90 0x7f7cf40cac10 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009290 tx=0x7f7cec017000 comp rx=0 tx=0).stop 2023-10-10T22:17:46.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.280+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 shutdown_connections 2023-10-10T22:17:46.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.280+0000 7f7cf8fff700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7cd4066f30 0x7f7cd40693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.280+0000 7f7cf8fff700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf40ccf90 0x7f7cf40cac10 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.280+0000 7f7cf8fff700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf40b1420 0x7f7cf40abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.280+0000 7f7cf8fff700 1 --2- 172.21.15.154:0/3144003226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40cbf30 0x7f7cf40ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.280+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 >> 172.21.15.154:0/3144003226 conn(0x7f7cf406a320 msgr2=0x7f7cf40cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:46.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.280+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 shutdown_connections 2023-10-10T22:17:46.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.280+0000 7f7cf8fff700 1 -- 172.21.15.154:0/3144003226 wait complete. 2023-10-10T22:17:46.285 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:17:46.299 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:17:45.470785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2476712,"kb_used_data":16488,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752498008,"statfs":{"total":773094113280,"available":770557960192,"internally_reserved":0,"allocated":16883712,"data_stored":8956488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.972635"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504277+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:48.848221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500964+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:55:38.718360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504054+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504937+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:34.664679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506391+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:09.099320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.502153+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:50:38.153144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500757+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:44:06.015282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504895+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:08:57.895831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501590+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:14.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501644+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:56:24.078774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500645+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:47:20.874557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503927+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:41:03.639868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504493+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:03:39.401379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506823+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:54:51.637273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503936+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:17:48.894088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500618+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:30.995946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503805+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:38:47.752957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500681+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:37.962050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500999+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:37:13.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500790+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:24.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501669+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:50:55.035123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501579+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:04:39.930601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506670+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:57.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504479+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:38:50.711788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504481+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:13:54.922870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506300+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:12:59.998967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503777+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:52.899573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.505946+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:18:40.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504125+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500659+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:59:28.659658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503801+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:21.528115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504164+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:57.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"150'271","reported_seq":829,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-10T22:17:36.967472+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:17:36.967472+0000","last_peered":"2023-10-10T22:17:36.967472+0000","last_clean":"2023-10-10T22:17:36.967472+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:17:36.967472+0000","last_undegraded":"2023-10-10T22:17:36.967472+0000","last_fullsized":"2023-10-10T22:17:36.967472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2555904,"data_stored":1562337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.42499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48299999999999998},"max":{"1min":0.98399999999999999,"5min":1.008,"15min":1.008},"last":0.69299999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.49099999999999999,"15min":0.47599999999999998},"max":{"1min":0.90900000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.497},"max":{"1min":0.96199999999999997,"5min":0.97099999999999997,"15min":1.0669999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.47399999999999998},"max":{"1min":0.91300000000000003,"5min":0.96299999999999997,"15min":1.0389999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.81100000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.86499999999999999,"5min":0.92500000000000004,"15min":0.95699999999999996},"last":0.877},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94899999999999995},"last":0.93300000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.42999999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.498,"5min":0.442,"15min":0.442},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.98599999999999999},"last":0.95199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":1.153},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.66400000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0129999999999999}]}]},{"osd":6,"up_from":14,"seq":60129543042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.62}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.498},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.55500000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.625},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.75}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.73499999999999999}]}]},{"osd":1,"up_from":14,"seq":60129543042,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307396,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064444,"statfs":{"total":96636764160,"available":96321990656,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.50600000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.441}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.622},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.65800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129543044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1562337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.56299999999999994}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.65300000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.34000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.871,"5min":0.89800000000000002,"15min":0.90800000000000003},"last":0.46800000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.504}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.63300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.435},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.80900000000000005},"last":0.41699999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81100000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.502}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.90000000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58899999999999997}]},{"osd":4,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.355,"15min":1.355},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.1659999999999999,"5min":1.248,"15min":1.248},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.232},"last":0.72499999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2070000000000001,"5min":1.278,"15min":1.278},"last":0.627},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56899999999999995},"max":{"1min":1.1339999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.751}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.69099999999999995}]}]},{"osd":3,"up_from":15,"seq":64424510339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.498},"min":{"1min":0.32100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.36699999999999999,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":0.77900000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.308},"max":{"1min":0.65400000000000003,"5min":0.77200000000000002,"15min":0.77700000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.67500000000000004,"5min":0.78400000000000003,"15min":0.877},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.626,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.63600000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.0269999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.60999999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97799999999999998,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.754}]},{"osd":5,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":0.995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.026,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.61799999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91300000000000003,"5min":1.218,"15min":1.218},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85999999999999999,"15min":0.83999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":1.0229999999999999,"5min":1.177,"15min":1.177},"last":0.90700000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.57099999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98999999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.72499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129543044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96499999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.46200000000000002},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.0629999999999999},"last":1.004}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.99099999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":0.95299999999999996,"15min":1.135},"last":0.72799999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.996},"last":0.85299999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"max":{"1min":0.95399999999999996,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.89600000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.97299999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":1.032}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39100000000000001},"max":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.94799999999999995},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.052,"15min":1.052},"last":0.94199999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":0.94899999999999995,"5min":1.018,"15min":1.0649999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94799999999999995,"15min":1.028},"last":0.96099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.747},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.77900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:17:46.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:17:46.491 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-10-10T22:17:46.490+0000 7f28c6bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T22:17:46.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.520+0000 7f283bdff700 1 Processor -- start 2023-10-10T22:17:46.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.520+0000 7f283bdff700 1 -- start start 2023-10-10T22:17:46.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.521+0000 7f283bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28340cbf30 0x7f28340ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f283bdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f28340b1420 0x7f28340c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f283bdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28340cc300 con 0x7f28340ccf90 2023-10-10T22:17:46.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f283bdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2834156bf0 con 0x7f28340b1420 2023-10-10T22:17:46.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f283bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28340ae950 con 0x7f28340cbf30 2023-10-10T22:17:46.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f283939a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f28340ccf90 0x7f28340b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38840/0 (socket says 172.21.15.154:38840) 2023-10-10T22:17:46.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f283939a700 1 -- 172.21.15.154:0/286795457 learned_addr learned my addr 172.21.15.154:0/286795457 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:46.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794953639 0 0) 0x7f28340cc300 con 0x7f28340ccf90 2023-10-10T22:17:46.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2820003570 con 0x7f28340ccf90 2023-10-10T22:17:46.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f283a39c700 1 --2- 172.21.15.154:0/286795457 >> v2:172.21.15.179:3300/0 conn(0x7f28340b1420 0x7f28340c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.522+0000 7f2839b9b700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28340cbf30 0x7f28340ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 602564032 0 0) 0x7f2820003570 con 0x7f28340ccf90 2023-10-10T22:17:46.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28340cbf30 msgr2=0x7f28340ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:46.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28340cbf30 0x7f28340ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 >> v2:172.21.15.179:3300/0 conn(0x7f28340b1420 msgr2=0x7f28340c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:46.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 --2- 172.21.15.154:0/286795457 >> v2:172.21.15.179:3300/0 conn(0x7f28340b1420 0x7f28340c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28340ad370 con 0x7f28340ccf90 2023-10-10T22:17:46.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f2824001470 con 0x7f28340ccf90 2023-10-10T22:17:46.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 >> v1:172.21.15.154:6789/0 conn(0x7f28340ccf90 legacy=0x7f28340b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2820003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28340cbf30 0x7f2820004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2820004d50 0x7f28200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834156bf0 con 0x7f2820003b10 2023-10-10T22:17:46.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28340ae950 con 0x7f2820004d50 2023-10-10T22:17:46.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282000bb40 con 0x7f28340cbf30 2023-10-10T22:17:46.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2839b9b700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2820003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f283939a700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28340cbf30 0x7f2820004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f283a39c700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2820004d50 0x7f28200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2839b9b700 1 -- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28340cbf30 msgr2=0x7f2820004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2839b9b700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28340cbf30 0x7f2820004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2839b9b700 1 -- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2820004d50 msgr2=0x7f28200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:46.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2839b9b700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2820004d50 0x7f28200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f2839b9b700 1 -- 172.21.15.154:0/286795457 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2820003570 con 0x7f2820003b10 2023-10-10T22:17:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f283a39c700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2820004d50 0x7f28200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.523+0000 7f283939a700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28340cbf30 0x7f2820004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:46.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.524+0000 7f2839b9b700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2820003f20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f2830009c00 tx=0x7f28300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33a706a966db2e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:46.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.524+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283000e6b0 con 0x7f2820003b10 2023-10-10T22:17:46.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.524+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283000e810 con 0x7f2820003b10 2023-10-10T22:17:46.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.524+0000 7f2838b99700 1 -- 172.21.15.154:0/286795457 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283000ebd0 con 0x7f2820003b10 2023-10-10T22:17:46.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.524+0000 7f283bdff700 1 -- 172.21.15.154:0/286795457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 msgr2=0x7f2820003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.524+0000 7f283bdff700 1 --2- 172.21.15.154:0/286795457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2820003f20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f2830009c00 tx=0x7f28300091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.524+0000 7f283a39c700 1 -- 172.21.15.154:0/286795457 reap_dead start 2023-10-10T22:17:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.524+0000 7f283bdff700 1 -- 172.21.15.154:0/286795457 shutdown_connections 2023-10-10T22:17:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.524+0000 7f283bdff700 1 -- 172.21.15.154:0/286795457 >> 172.21.15.154:0/286795457 conn(0x7f283406a320 msgr2=0x7f28340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.525+0000 7f283bdff700 1 -- 172.21.15.154:0/286795457 shutdown_connections 2023-10-10T22:17:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.525+0000 7f283bdff700 1 -- 172.21.15.154:0/286795457 wait complete. 2023-10-10T22:17:46.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.526+0000 7f283bdff700 1 Processor -- start 2023-10-10T22:17:46.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.526+0000 7f283bdff700 1 -- start start 2023-10-10T22:17:46.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f283bdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2834154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f283bdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2834157750 0x7f2834157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f283bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28341592c0 0x7f2834159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f283bdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834159c70 con 0x7f2820003b10 2023-10-10T22:17:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f283bdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28340c5bf0 con 0x7f2834157750 2023-10-10T22:17:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f283bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28340c61b0 con 0x7f28341592c0 2023-10-10T22:17:46.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f2839b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2834154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f2839b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2834154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56206/0 (socket says 172.21.15.154:56206) 2023-10-10T22:17:46.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f2839b9b700 1 -- 172.21.15.154:0/4010828606 learned_addr learned my addr 172.21.15.154:0/4010828606 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:46.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f2839b9b700 1 -- 172.21.15.154:0/4010828606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28341592c0 msgr2=0x7f2834159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f2839b9b700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28341592c0 0x7f2834159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f2839b9b700 1 -- 172.21.15.154:0/4010828606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2834157750 msgr2=0x7f2834157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f2839b9b700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2834157750 0x7f2834157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.527+0000 7f2839b9b700 1 -- 172.21.15.154:0/4010828606 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834155270 con 0x7f2820003b10 2023-10-10T22:17:46.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.528+0000 7f2839b9b700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2834154d30 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f2830013f70 tx=0x7f283001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:46.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.528+0000 7f2829ffb700 1 -- 172.21.15.154:0/4010828606 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830022070 con 0x7f2820003b10 2023-10-10T22:17:46.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.528+0000 7f2829ffb700 1 -- 172.21.15.154:0/4010828606 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283000e980 con 0x7f2820003b10 2023-10-10T22:17:46.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.528+0000 7f2829ffb700 1 -- 172.21.15.154:0/4010828606 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830027470 con 0x7f2820003b10 2023-10-10T22:17:46.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.528+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2834158240 con 0x7f2820003b10 2023-10-10T22:17:46.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.528+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28340c5e40 con 0x7f2820003b10 2023-10-10T22:17:46.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.529+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283404c3c0 con 0x7f2820003b10 2023-10-10T22:17:46.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.530+0000 7f2829ffb700 1 -- 172.21.15.154:0/4010828606 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f283001c450 con 0x7f2820003b10 2023-10-10T22:17:46.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.531+0000 7f2829ffb700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2818066f30 0x7f28180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.531+0000 7f2829ffb700 1 -- 172.21.15.154:0/4010828606 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2830086290 con 0x7f2820003b10 2023-10-10T22:17:46.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.531+0000 7f283939a700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2818066f30 0x7f28180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.532+0000 7f283939a700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2818066f30 0x7f28180693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2824001ed0 tx=0x7f2824001aa0 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.535+0000 7f2829ffb700 1 -- 172.21.15.154:0/4010828606 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2830053330 con 0x7f2820003b10 2023-10-10T22:17:46.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.720+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28340ad650 con 0x7f2818066f30 2023-10-10T22:17:46.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.729+0000 7f2829ffb700 1 -- 172.21.15.154:0/4010828606 <== mgr.8481 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278450 (secure 0 0 0) 0x7f28340ad650 con 0x7f2818066f30 2023-10-10T22:17:46.738 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:46.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2818066f30 msgr2=0x7f28180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2818066f30 0x7f28180693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2824001ed0 tx=0x7f2824001aa0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 msgr2=0x7f2834154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2834154d30 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f2830013f70 tx=0x7f283001a000 comp rx=0 tx=0).stop 2023-10-10T22:17:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 shutdown_connections 2023-10-10T22:17:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28341592c0 0x7f2834159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2818066f30 0x7f28180693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2820003b10 0x7f2834154d30 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 --2- 172.21.15.154:0/4010828606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2834157750 0x7f2834157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 >> 172.21.15.154:0/4010828606 conn(0x7f283406a320 msgr2=0x7f2834155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 shutdown_connections 2023-10-10T22:17:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.733+0000 7f283bdff700 1 -- 172.21.15.154:0/4010828606 wait complete. 2023-10-10T22:17:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:17:46.752 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:17:45.470785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2476712,"kb_used_data":16488,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752498008,"statfs":{"total":773094113280,"available":770557960192,"internally_reserved":0,"allocated":16883712,"data_stored":8956488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.972635"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504277+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:48.848221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500964+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:55:38.718360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504054+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504937+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:34.664679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506391+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:09.099320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.502153+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:50:38.153144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500757+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:44:06.015282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504895+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:08:57.895831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501590+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:14.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501644+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:56:24.078774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500645+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:47:20.874557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503927+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:41:03.639868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504493+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:03:39.401379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506823+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:54:51.637273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503936+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:17:48.894088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500618+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:30.995946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503805+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:38:47.752957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500681+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:37.962050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500999+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:37:13.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500790+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:24.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501669+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:50:55.035123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501579+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:04:39.930601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506670+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:57.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504479+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:38:50.711788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504481+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:13:54.922870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506300+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:12:59.998967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503777+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:52.899573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.505946+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:18:40.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504125+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500659+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:59:28.659658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503801+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:21.528115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504164+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:57.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"150'271","reported_seq":829,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-10T22:17:36.967472+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:17:36.967472+0000","last_peered":"2023-10-10T22:17:36.967472+0000","last_clean":"2023-10-10T22:17:36.967472+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:17:36.967472+0000","last_undegraded":"2023-10-10T22:17:36.967472+0000","last_fullsized":"2023-10-10T22:17:36.967472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2555904,"data_stored":1562337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.42499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48299999999999998},"max":{"1min":0.98399999999999999,"5min":1.008,"15min":1.008},"last":0.69299999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.49099999999999999,"15min":0.47599999999999998},"max":{"1min":0.90900000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.497},"max":{"1min":0.96199999999999997,"5min":0.97099999999999997,"15min":1.0669999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.47399999999999998},"max":{"1min":0.91300000000000003,"5min":0.96299999999999997,"15min":1.0389999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.81100000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.86499999999999999,"5min":0.92500000000000004,"15min":0.95699999999999996},"last":0.877},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94899999999999995},"last":0.93300000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.42999999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.498,"5min":0.442,"15min":0.442},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.98599999999999999},"last":0.95199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":1.153},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.66400000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0129999999999999}]}]},{"osd":6,"up_from":14,"seq":60129543042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.62}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.498},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.55500000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.625},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.75}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.73499999999999999}]}]},{"osd":1,"up_from":14,"seq":60129543042,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307396,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064444,"statfs":{"total":96636764160,"available":96321990656,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.50600000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.441}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.622},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.65800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129543044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1562337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.56299999999999994}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.65300000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.34000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.871,"5min":0.89800000000000002,"15min":0.90800000000000003},"last":0.46800000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.504}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.63300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.435},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.80900000000000005},"last":0.41699999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81100000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.502}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.90000000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58899999999999997}]},{"osd":4,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.355,"15min":1.355},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.1659999999999999,"5min":1.248,"15min":1.248},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.232},"last":0.72499999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2070000000000001,"5min":1.278,"15min":1.278},"last":0.627},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56899999999999995},"max":{"1min":1.1339999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.751}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.69099999999999995}]}]},{"osd":3,"up_from":15,"seq":64424510339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.498},"min":{"1min":0.32100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.36699999999999999,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":0.77900000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.308},"max":{"1min":0.65400000000000003,"5min":0.77200000000000002,"15min":0.77700000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.67500000000000004,"5min":0.78400000000000003,"15min":0.877},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.626,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.63600000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.0269999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.60999999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97799999999999998,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.754}]},{"osd":5,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":0.995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.026,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.61799999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91300000000000003,"5min":1.218,"15min":1.218},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85999999999999999,"15min":0.83999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":1.0229999999999999,"5min":1.177,"15min":1.177},"last":0.90700000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.57099999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98999999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.72499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129543044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96499999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.46200000000000002},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.0629999999999999},"last":1.004}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.99099999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":0.95299999999999996,"15min":1.135},"last":0.72799999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.996},"last":0.85299999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"max":{"1min":0.95399999999999996,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.89600000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.97299999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":1.032}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39100000000000001},"max":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.94799999999999995},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.052,"15min":1.052},"last":0.94199999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":0.94899999999999995,"5min":1.018,"15min":1.0649999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94799999999999995,"15min":1.028},"last":0.96099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.747},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.77900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:17:46.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:17:46.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.973+0000 7f57601ff700 1 Processor -- start 2023-10-10T22:17:46.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.973+0000 7f57601ff700 1 -- start start 2023-10-10T22:17:46.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.974+0000 7f57601ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57580caa90 0x7f57580c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.974+0000 7f57601ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575815d7e0 con 0x7f575806c0a0 2023-10-10T22:17:46.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.975+0000 7f57601ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575815dac0 con 0x7f575806bcd0 2023-10-10T22:17:46.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.975+0000 7f57601ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57580caef0 con 0x7f57580caa90 2023-10-10T22:17:46.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.975+0000 7f575e79c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57580caa90 0x7f57580c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.975+0000 7f575d79a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f575806c0a0 0x7f575815df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38852/0 (socket says 172.21.15.154:38852) 2023-10-10T22:17:46.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.975+0000 7f575d79a700 1 -- 172.21.15.154:0/699471614 learned_addr learned my addr 172.21.15.154:0/699471614 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:46.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.975+0000 7f575e79c700 1 -- 172.21.15.154:0/699471614 >> v1:172.21.15.179:6789/0 conn(0x7f575806bcd0 legacy=0x7f575815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.975+0000 7f575e79c700 1 -- 172.21.15.154:0/699471614 >> v1:172.21.15.154:6789/0 conn(0x7f575806c0a0 legacy=0x7f575815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.975+0000 7f575e79c700 1 -- 172.21.15.154:0/699471614 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575815aa30 con 0x7f57580caa90 2023-10-10T22:17:46.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.975+0000 7f575cf99700 1 -- 172.21.15.154:0/699471614 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414313514 0 0) 0x7f575815d7e0 con 0x7f575806c0a0 2023-10-10T22:17:46.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f575e79c700 1 --2- 172.21.15.154:0/699471614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57580caa90 0x7f57580c8c40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f5750009e60 tx=0x7f5750009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8864c4bf7dd1354e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:46.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f575cf99700 1 -- 172.21.15.154:0/699471614 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575000e070 con 0x7f57580caa90 2023-10-10T22:17:46.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f575cf99700 1 -- 172.21.15.154:0/699471614 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575000bc30 con 0x7f57580caa90 2023-10-10T22:17:46.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f575cf99700 1 -- 172.21.15.154:0/699471614 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750012430 con 0x7f57580caa90 2023-10-10T22:17:46.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f57601ff700 1 -- 172.21.15.154:0/699471614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57580caa90 msgr2=0x7f57580c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f57601ff700 1 --2- 172.21.15.154:0/699471614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57580caa90 0x7f57580c8c40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f5750009e60 tx=0x7f5750009780 comp rx=0 tx=0).stop 2023-10-10T22:17:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f57601ff700 1 -- 172.21.15.154:0/699471614 shutdown_connections 2023-10-10T22:17:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f57601ff700 1 --2- 172.21.15.154:0/699471614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57580caa90 0x7f57580c8c40 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f57601ff700 1 -- 172.21.15.154:0/699471614 >> 172.21.15.154:0/699471614 conn(0x7f57580ce600 msgr2=0x7f57580cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f57601ff700 1 -- 172.21.15.154:0/699471614 shutdown_connections 2023-10-10T22:17:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.976+0000 7f57601ff700 1 -- 172.21.15.154:0/699471614 wait complete. 2023-10-10T22:17:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.978+0000 7f57601ff700 1 Processor -- start 2023-10-10T22:17:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.978+0000 7f57601ff700 1 -- start start 2023-10-10T22:17:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f57601ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f575806bcd0 0x7f5758153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f57601ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575806c0a0 0x7f57580b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f57601ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57580caa90 0x7f57580c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f57601ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581589c0 con 0x7f575806c0a0 2023-10-10T22:17:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f57601ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758157dd0 con 0x7f57580caa90 2023-10-10T22:17:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f57601ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5758158090 con 0x7f575806bcd0 2023-10-10T22:17:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f575d79a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575806c0a0 0x7f57580b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f575d79a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575806c0a0 0x7f57580b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56218/0 (socket says 172.21.15.154:56218) 2023-10-10T22:17:46.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f575d79a700 1 -- 172.21.15.154:0/1089084724 learned_addr learned my addr 172.21.15.154:0/1089084724 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:46.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f575df9b700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f575806bcd0 0x7f5758153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.979+0000 7f575e79c700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57580caa90 0x7f57580c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f575d79a700 1 -- 172.21.15.154:0/1089084724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f575806bcd0 msgr2=0x7f5758153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f575d79a700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f575806bcd0 0x7f5758153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f575d79a700 1 -- 172.21.15.154:0/1089084724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57580caa90 msgr2=0x7f57580c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:46.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f575d79a700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57580caa90 0x7f57580c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:46.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f575d79a700 1 -- 172.21.15.154:0/1089084724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750009a20 con 0x7f575806c0a0 2023-10-10T22:17:46.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f575d79a700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575806c0a0 0x7f57580b2500 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f574800c5b0 tx=0x7f5748001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f574dffb700 1 -- 172.21.15.154:0/1089084724 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748005b30 con 0x7f575806c0a0 2023-10-10T22:17:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f574dffb700 1 -- 172.21.15.154:0/1089084724 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748005c90 con 0x7f575806c0a0 2023-10-10T22:17:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f574dffb700 1 -- 172.21.15.154:0/1089084724 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748007300 con 0x7f575806c0a0 2023-10-10T22:17:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5758158370 con 0x7f575806c0a0 2023-10-10T22:17:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.980+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5758153b60 con 0x7f575806c0a0 2023-10-10T22:17:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.981+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5758158b30 con 0x7f575806c0a0 2023-10-10T22:17:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.982+0000 7f574dffb700 1 -- 172.21.15.154:0/1089084724 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f574801b3b0 con 0x7f575806c0a0 2023-10-10T22:17:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.983+0000 7f574dffb700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f573c066f30 0x7f573c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.983+0000 7f574dffb700 1 -- 172.21.15.154:0/1089084724 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f5748083b30 con 0x7f575806c0a0 2023-10-10T22:17:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.983+0000 7f575df9b700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f573c066f30 0x7f573c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:46.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.984+0000 7f575df9b700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f573c066f30 0x7f573c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f57540039e0 tx=0x7f5754007ec0 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:46.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:46.987+0000 7f574dffb700 1 -- 172.21.15.154:0/1089084724 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5748050bd0 con 0x7f575806c0a0 2023-10-10T22:17:47.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.174+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f575804c3c0 con 0x7f573c066f30 2023-10-10T22:17:47.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.182+0000 7f574dffb700 1 -- 172.21.15.154:0/1089084724 <== mgr.8481 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278450 (secure 0 0 0) 0x7f575804c3c0 con 0x7f573c066f30 2023-10-10T22:17:47.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:47.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f573c066f30 msgr2=0x7f573c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f573c066f30 0x7f573c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f57540039e0 tx=0x7f5754007ec0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575806c0a0 msgr2=0x7f57580b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575806c0a0 0x7f57580b2500 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f574800c5b0 tx=0x7f5748001070 comp rx=0 tx=0).stop 2023-10-10T22:17:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 shutdown_connections 2023-10-10T22:17:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57580caa90 0x7f57580c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f575806bcd0 0x7f5758153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f573c066f30 0x7f573c0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 --2- 172.21.15.154:0/1089084724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575806c0a0 0x7f57580b2500 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.186+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 >> 172.21.15.154:0/1089084724 conn(0x7f57580ce600 msgr2=0x7f575815c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.187+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 shutdown_connections 2023-10-10T22:17:47.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.187+0000 7f57601ff700 1 -- 172.21.15.154:0/1089084724 wait complete. 2023-10-10T22:17:47.192 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:17:47.205 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:17:45.470785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2476712,"kb_used_data":16488,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752498008,"statfs":{"total":773094113280,"available":770557960192,"internally_reserved":0,"allocated":16883712,"data_stored":8956488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.972635"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504277+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:48.848221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500964+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:55:38.718360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504054+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504937+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:00:34.664679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506391+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:05:09.099320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.502153+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:50:38.153144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500757+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:44:06.015282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504895+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:08:57.895831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501590+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:14.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501644+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:56:24.078774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500645+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:47:20.874557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503927+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:41:03.639868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504493+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:03:39.401379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506823+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:54:51.637273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503936+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:17:48.894088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500618+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:30.995946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503805+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:38:47.752957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500681+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:23:37.962050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500999+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:37:13.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500790+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:24.740839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501669+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:50:55.035123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.501579+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:04:39.930601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506670+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:57.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504479+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:38:50.711788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504481+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:13:54.922870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.506300+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:12:59.998967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503777+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:52.899573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.505946+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:18:40.257501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504125+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.500659+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:59:28.659658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.503801+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:21.528115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:17:40.497076+0000","last_change":"2023-10-10T22:17:40.497076+0000","last_active":"2023-10-10T22:17:40.497076+0000","last_peered":"2023-10-10T22:17:40.497076+0000","last_clean":"2023-10-10T22:17:40.497076+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:40.497076+0000","last_undegraded":"2023-10-10T22:17:40.497076+0000","last_fullsized":"2023-10-10T22:17:40.497076+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:17:39.491420+0000","last_change":"2023-10-10T22:17:39.504164+0000","last_active":"2023-10-10T22:17:39.491420+0000","last_peered":"2023-10-10T22:17:39.491420+0000","last_clean":"2023-10-10T22:17:39.491420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:17:39.491420+0000","last_undegraded":"2023-10-10T22:17:39.491420+0000","last_fullsized":"2023-10-10T22:17:39.491420+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:57.981322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"150'271","reported_seq":829,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-10T22:17:36.967472+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:17:36.967472+0000","last_peered":"2023-10-10T22:17:36.967472+0000","last_clean":"2023-10-10T22:17:36.967472+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:17:36.967472+0000","last_undegraded":"2023-10-10T22:17:36.967472+0000","last_fullsized":"2023-10-10T22:17:36.967472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2555904,"data_stored":1562337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.42499999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48299999999999998},"max":{"1min":0.98399999999999999,"5min":1.008,"15min":1.008},"last":0.69299999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.49099999999999999,"15min":0.47599999999999998},"max":{"1min":0.90900000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.497},"max":{"1min":0.96199999999999997,"5min":0.97099999999999997,"15min":1.0669999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.47399999999999998},"max":{"1min":0.91300000000000003,"5min":0.96299999999999997,"15min":1.0389999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.81100000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.86499999999999999,"5min":0.92500000000000004,"15min":0.95699999999999996},"last":0.877},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.94899999999999995},"last":0.93300000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.42999999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.498,"5min":0.442,"15min":0.442},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.98599999999999999},"last":0.95199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":1.153},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.66400000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0129999999999999}]}]},{"osd":6,"up_from":14,"seq":60129543042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.62}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.498},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.55500000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.625},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.75}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.73499999999999999}]}]},{"osd":1,"up_from":14,"seq":60129543042,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307396,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064444,"statfs":{"total":96636764160,"available":96321990656,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.50600000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.441}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.622},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.65800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129543044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1562337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.56299999999999994}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.65300000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.34000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.871,"5min":0.89800000000000002,"15min":0.90800000000000003},"last":0.46800000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.504}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.63300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.435},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.80900000000000005},"last":0.41699999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81100000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.502}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.90000000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58899999999999997}]},{"osd":4,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.355,"15min":1.355},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.1659999999999999,"5min":1.248,"15min":1.248},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.232},"last":0.72499999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2070000000000001,"5min":1.278,"15min":1.278},"last":0.627},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56899999999999995},"max":{"1min":1.1339999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.751}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.69099999999999995}]}]},{"osd":3,"up_from":15,"seq":64424510339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.498},"min":{"1min":0.32100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.36699999999999999,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":0.77900000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.308},"max":{"1min":0.65400000000000003,"5min":0.77200000000000002,"15min":0.77700000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.80500000000000005,"15min":0.875},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.67500000000000004,"5min":0.78400000000000003,"15min":0.877},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.626,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.63600000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.0269999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.60999999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97799999999999998,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.754}]},{"osd":5,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":0.995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.026,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.61799999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91300000000000003,"5min":1.218,"15min":1.218},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85999999999999999,"15min":0.83999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":1.0229999999999999,"5min":1.177,"15min":1.177},"last":0.90700000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.57099999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98999999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.72499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129543044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96499999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.46200000000000002},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.0629999999999999},"last":1.004}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.99099999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":0.95299999999999996,"15min":1.135},"last":0.72799999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.996},"last":0.85299999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"max":{"1min":0.95399999999999996,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.89600000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.97299999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":1.032}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39100000000000001},"max":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.94799999999999995},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.052,"15min":1.052},"last":0.94199999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":0.94899999999999995,"5min":1.018,"15min":1.0649999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94799999999999995,"15min":1.028},"last":0.96099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":1961984,"data_stored":971969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.747},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.77900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:17:47.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3f is not active+clean 2023-10-10T22:17:47.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3e is not active+clean 2023-10-10T22:17:47.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3d is not active+clean 2023-10-10T22:17:47.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3c is not active+clean 2023-10-10T22:17:47.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3b is not active+clean 2023-10-10T22:17:47.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3a is not active+clean 2023-10-10T22:17:47.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.39 is not active+clean 2023-10-10T22:17:47.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.38 is not active+clean 2023-10-10T22:17:47.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.37 is not active+clean 2023-10-10T22:17:47.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.36 is not active+clean 2023-10-10T22:17:47.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.35 is not active+clean 2023-10-10T22:17:47.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.34 is not active+clean 2023-10-10T22:17:47.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.33 is not active+clean 2023-10-10T22:17:47.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.32 is not active+clean 2023-10-10T22:17:47.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.31 is not active+clean 2023-10-10T22:17:47.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.30 is not active+clean 2023-10-10T22:17:47.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2f is not active+clean 2023-10-10T22:17:47.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2e is not active+clean 2023-10-10T22:17:47.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2d is not active+clean 2023-10-10T22:17:47.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2c is not active+clean 2023-10-10T22:17:47.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2b is not active+clean 2023-10-10T22:17:47.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2a is not active+clean 2023-10-10T22:17:47.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.29 is not active+clean 2023-10-10T22:17:47.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.28 is not active+clean 2023-10-10T22:17:47.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.27 is not active+clean 2023-10-10T22:17:47.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.26 is not active+clean 2023-10-10T22:17:47.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.25 is not active+clean 2023-10-10T22:17:47.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.24 is not active+clean 2023-10-10T22:17:47.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.23 is not active+clean 2023-10-10T22:17:47.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.22 is not active+clean 2023-10-10T22:17:47.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.21 is not active+clean 2023-10-10T22:17:47.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.20 is not active+clean 2023-10-10T22:17:47.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1e is not active+clean 2023-10-10T22:17:47.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-10-10T22:17:47.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.504277+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:56:48.848221+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:17:47.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2023-10-10T22:17:47.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-10-10T22:17:47.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.500964+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:55:38.718360+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:17:47.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1c is not active+clean 2023-10-10T22:17:47.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2023-10-10T22:17:47.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.504054+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T22:17:47.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1d is not active+clean 2023-10-10T22:17:47.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-10-10T22:17:47.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.504937+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:00:34.664679+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T22:17:47.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1a is not active+clean 2023-10-10T22:17:47.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-10-10T22:17:47.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.506391+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:05:09.099320+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T22:17:47.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2023-10-10T22:17:47.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-10-10T22:17:47.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.502153+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T07:50:38.153144+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T22:17:47.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2023-10-10T22:17:47.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-10-10T22:17:47.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.500757+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:44:06.015282+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:17:47.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2023-10-10T22:17:47.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-10-10T22:17:47.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.504895+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:08:57.895831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T22:17:47.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.16 is not active+clean 2023-10-10T22:17:47.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-10-10T22:17:47.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.501590+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T09:20:14.082285+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:17:47.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2023-10-10T22:17:47.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-10-10T22:17:47.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.501644+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:56:24.078774+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T22:17:47.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.14 is not active+clean 2023-10-10T22:17:47.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-10-10T22:17:47.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.500645+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:47:20.874557+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:17:47.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.15 is not active+clean 2023-10-10T22:17:47.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-10-10T22:17:47.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.503927+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:41:03.639868+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T22:17:47.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.13 is not active+clean 2023-10-10T22:17:47.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2023-10-10T22:17:47.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.504493+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T09:03:39.401379+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T22:17:47.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2023-10-10T22:17:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-10-10T22:17:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.506823+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:54:51.637273+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T22:17:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2023-10-10T22:17:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-10-10T22:17:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.503936+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:17:48.894088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T22:17:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2023-10-10T22:17:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-10-10T22:17:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.500618+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:29:30.995946+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:17:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2023-10-10T22:17:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2023-10-10T22:17:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.503805+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:38:47.752957+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T22:17:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.c is not active+clean 2023-10-10T22:17:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-10-10T22:17:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.500681+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:23:37.962050+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:17:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2023-10-10T22:17:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-10-10T22:17:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.500999+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T07:37:13.692107+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:17:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.a is not active+clean 2023-10-10T22:17:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-10-10T22:17:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.500790+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:03:24.740839+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:17:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2023-10-10T22:17:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-10-10T22:17:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.501669+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:50:55.035123+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T22:17:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2023-10-10T22:17:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-10-10T22:17:47.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.501579+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T04:04:39.930601+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T22:17:47.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.9 is not active+clean 2023-10-10T22:17:47.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2023-10-10T22:17:47.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.506670+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:16:57.981322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T22:17:47.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2023-10-10T22:17:47.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2023-10-10T22:17:47.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.504479+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:38:50.711788+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T22:17:47.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.7 is not active+clean 2023-10-10T22:17:47.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-10-10T22:17:47.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.504481+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:13:54.922870+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:17:47.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2023-10-10T22:17:47.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-10-10T22:17:47.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.506300+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:12:59.998967+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T22:17:47.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2023-10-10T22:17:47.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2023-10-10T22:17:47.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.503777+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T07:33:52.899573+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T22:17:47.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2 is not active+clean 2023-10-10T22:17:47.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-10-10T22:17:47.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.505946+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:18:40.257501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-10T22:17:47.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2023-10-10T22:17:47.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-10-10T22:17:47.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.504125+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:17:47.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.0 is not active+clean 2023-10-10T22:17:47.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-10-10T22:17:47.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.500659+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T09:59:28.659658+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-10T22:17:47.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2023-10-10T22:17:47.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2023-10-10T22:17:47.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.503801+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:50:21.528115+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-10T22:17:47.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.12 is not active+clean 2023-10-10T22:17:47.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:17:40.497076+0000', 'last_change': '2023-10-10T22:17:40.497076+0000', 'last_active': '2023-10-10T22:17:40.497076+0000', 'last_peered': '2023-10-10T22:17:40.497076+0000', 'last_clean': '2023-10-10T22:17:40.497076+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:40.497076+0000', 'last_undegraded': '2023-10-10T22:17:40.497076+0000', 'last_fullsized': '2023-10-10T22:17:40.497076+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:40.497076+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:17:47.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-10-10T22:17:47.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:17:39.491420+0000', 'last_change': '2023-10-10T22:17:39.504164+0000', 'last_active': '2023-10-10T22:17:39.491420+0000', 'last_peered': '2023-10-10T22:17:39.491420+0000', 'last_clean': '2023-10-10T22:17:39.491420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:17:39.491420+0000', 'last_undegraded': '2023-10-10T22:17:39.491420+0000', 'last_fullsized': '2023-10-10T22:17:39.491420+0000', 'mapping_epoch': 158, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 158, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'last_clean_scrub_stamp': '2023-10-10T22:17:39.491420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:16:57.981322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:17:47.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T22:17:47.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.469+0000 7f0c9b5ff700 1 Processor -- start 2023-10-10T22:17:47.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.469+0000 7f0c9b5ff700 1 -- start start 2023-10-10T22:17:47.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.470+0000 7f0c9b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940ced50 0x7f0c940b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.470+0000 7f0c9b5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0c940ada80 0x7f0c940adec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c9b5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c940ad5f0 con 0x7f0c940b2b80 2023-10-10T22:17:47.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c9b5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9415a060 con 0x7f0c940ada80 2023-10-10T22:17:47.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c9b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940cf310 con 0x7f0c940ced50 2023-10-10T22:17:47.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c98b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940ced50 0x7f0c940b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c9939b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0c940b2b80 0x7f0c940b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38862/0 (socket says 172.21.15.154:38862) 2023-10-10T22:17:47.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c99b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0c940ada80 0x7f0c940adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c9939b700 1 -- 172.21.15.154:0/3085442448 learned_addr learned my addr 172.21.15.154:0/3085442448 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:47.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c99b9c700 1 -- 172.21.15.154:0/3085442448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940ced50 msgr2=0x7f0c940b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:47.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c99b9c700 1 --2- 172.21.15.154:0/3085442448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940ced50 0x7f0c940b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c99b9c700 1 -- 172.21.15.154:0/3085442448 >> v1:172.21.15.154:6789/0 conn(0x7f0c940b2b80 legacy=0x7f0c940b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.471+0000 7f0c99b9c700 1 -- 172.21.15.154:0/3085442448 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940cf5f0 con 0x7f0c940ada80 2023-10-10T22:17:47.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.472+0000 7f0c99b9c700 1 --2- 172.21.15.154:0/3085442448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 0x7f0c940adec0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009e60 tx=0x7f0c8c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7604549c548e4c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:47.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.472+0000 7f0c8bfff700 1 -- 172.21.15.154:0/3085442448 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c00e070 con 0x7f0c940ada80 2023-10-10T22:17:47.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.472+0000 7f0c8bfff700 1 -- 172.21.15.154:0/3085442448 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c00bb60 con 0x7f0c940ada80 2023-10-10T22:17:47.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.472+0000 7f0c8bfff700 1 -- 172.21.15.154:0/3085442448 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c012430 con 0x7f0c940ada80 2023-10-10T22:17:47.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.473+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/3085442448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 msgr2=0x7f0c940adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.473+0000 7f0c9b5ff700 1 --2- 172.21.15.154:0/3085442448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 0x7f0c940adec0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009e60 tx=0x7f0c8c009780 comp rx=0 tx=0).stop 2023-10-10T22:17:47.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.473+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/3085442448 shutdown_connections 2023-10-10T22:17:47.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.473+0000 7f0c9b5ff700 1 --2- 172.21.15.154:0/3085442448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 0x7f0c940adec0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.473+0000 7f0c9b5ff700 1 --2- 172.21.15.154:0/3085442448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940ced50 0x7f0c940b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.473+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/3085442448 >> 172.21.15.154:0/3085442448 conn(0x7f0c940999f0 msgr2=0x7f0c940b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:47.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.473+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/3085442448 shutdown_connections 2023-10-10T22:17:47.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.473+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/3085442448 wait complete. 2023-10-10T22:17:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.474+0000 7f0c9b5ff700 1 Processor -- start 2023-10-10T22:17:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.474+0000 7f0c9b5ff700 1 -- start start 2023-10-10T22:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.475+0000 7f0c9b5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 0x7f0c941570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.475+0000 7f0c9b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940b2b80 0x7f0c940c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.475+0000 7f0c9b5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c940ced50 0x7f0c94068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.475+0000 7f0c9b5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940c7d20 con 0x7f0c940ada80 2023-10-10T22:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.475+0000 7f0c9b5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940c8000 con 0x7f0c940ced50 2023-10-10T22:17:47.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.475+0000 7f0c9b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940c82e0 con 0x7f0c940b2b80 2023-10-10T22:17:47.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.475+0000 7f0c9939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 0x7f0c941570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c9939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 0x7f0c941570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56234/0 (socket says 172.21.15.154:56234) 2023-10-10T22:17:47.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c9939b700 1 -- 172.21.15.154:0/2627858624 learned_addr learned my addr 172.21.15.154:0/2627858624 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:47.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c98b9a700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940b2b80 0x7f0c940c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c99b9c700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c940ced50 0x7f0c94068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c9939b700 1 -- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940b2b80 msgr2=0x7f0c940c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c9939b700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940b2b80 0x7f0c940c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c9939b700 1 -- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c940ced50 msgr2=0x7f0c94068b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c9939b700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c940ced50 0x7f0c94068b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c9939b700 1 -- 172.21.15.154:0/2627858624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c009a20 con 0x7f0c940ada80 2023-10-10T22:17:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c98b9a700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940b2b80 0x7f0c940c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c99b9c700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c940ced50 0x7f0c94068b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c9939b700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 0x7f0c941570a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c7c0 tx=0x7f0c90007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c897fa700 1 -- 172.21.15.154:0/2627858624 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900073d0 con 0x7f0c940ada80 2023-10-10T22:17:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c897fa700 1 -- 172.21.15.154:0/2627858624 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c90007530 con 0x7f0c940ada80 2023-10-10T22:17:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c897fa700 1 -- 172.21.15.154:0/2627858624 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90005a40 con 0x7f0c940ada80 2023-10-10T22:17:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.476+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c940c85c0 con 0x7f0c940ada80 2023-10-10T22:17:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.477+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c941575e0 con 0x7f0c940ada80 2023-10-10T22:17:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.478+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c940b5e30 con 0x7f0c940ada80 2023-10-10T22:17:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.479+0000 7f0c897fa700 1 -- 172.21.15.154:0/2627858624 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c9001b400 con 0x7f0c940ada80 2023-10-10T22:17:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.479+0000 7f0c897fa700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0c78066f30 0x7f0c780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.479+0000 7f0c897fa700 1 -- 172.21.15.154:0/2627858624 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f0c90084170 con 0x7f0c940ada80 2023-10-10T22:17:47.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.480+0000 7f0c98b9a700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0c78066f30 0x7f0c780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.480+0000 7f0c98b9a700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0c78066f30 0x7f0c780693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c84006f00 tx=0x7f0c84008040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:47.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.483+0000 7f0c897fa700 1 -- 172.21.15.154:0/2627858624 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c90051290 con 0x7f0c940ada80 2023-10-10T22:17:47.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.751+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0c94063c90 con 0x7f0c940ada80 2023-10-10T22:17:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.751+0000 7f0c897fa700 1 -- 172.21.15.154:0/2627858624 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1114 (secure 0 0 0) 0x7f0c900548b0 con 0x7f0c940ada80 2023-10-10T22:17:47.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:47.753 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4552,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":161,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2536153088,"bytes_avail":770557960192,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":70,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8640}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-10T22:07:45.140524+0000","services":{}},"progress_events":{}} 2023-10-10T22:17:47.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.753+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0c78066f30 msgr2=0x7f0c780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0c78066f30 0x7f0c780693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c84006f00 tx=0x7f0c84008040 comp rx=0 tx=0).stop 2023-10-10T22:17:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 msgr2=0x7f0c941570a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 0x7f0c941570a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c7c0 tx=0x7f0c90007de0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 shutdown_connections 2023-10-10T22:17:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c940ced50 0x7f0c94068b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0c78066f30 0x7f0c780693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c940ada80 0x7f0c941570a0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 --2- 172.21.15.154:0/2627858624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c940b2b80 0x7f0c940c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 >> 172.21.15.154:0/2627858624 conn(0x7f0c940999f0 msgr2=0x7f0c940b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 shutdown_connections 2023-10-10T22:17:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.754+0000 7f0c9b5ff700 1 -- 172.21.15.154:0/2627858624 wait complete. 2023-10-10T22:17:47.773 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T22:17:47.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:17:47.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.955+0000 7f74b6dff700 1 Processor -- start 2023-10-10T22:17:47.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.955+0000 7f74b6dff700 1 -- start start 2023-10-10T22:17:47.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.956+0000 7f74b6dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f74b00cbf30 0x7f74b00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.956+0000 7f74b6dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00ccf90 0x7f74b00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.956+0000 7f74b6dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00cc300 con 0x7f74b015a270 2023-10-10T22:17:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.956+0000 7f74b6dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b0156bf0 con 0x7f74b00cbf30 2023-10-10T22:17:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.956+0000 7f74b6dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00ae950 con 0x7f74b00ccf90 2023-10-10T22:17:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.957+0000 7f74affff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00ccf90 0x7f74b00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.957+0000 7f74b4b9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f74b00cbf30 0x7f74b00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.957+0000 7f74b539c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f74b015a270 0x7f74b00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:49680/0 (socket says 172.21.15.154:49680) 2023-10-10T22:17:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.957+0000 7f74b539c700 1 -- 172.21.15.154:0/2326224059 learned_addr learned my addr 172.21.15.154:0/2326224059 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74b4b9b700 1 -- 172.21.15.154:0/2326224059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00ccf90 msgr2=0x7f74b00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74b4b9b700 1 --2- 172.21.15.154:0/2326224059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00ccf90 0x7f74b00b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74b4b9b700 1 -- 172.21.15.154:0/2326224059 >> v1:172.21.15.179:6789/0 conn(0x7f74b015a270 legacy=0x7f74b00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74b4b9b700 1 -- 172.21.15.154:0/2326224059 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b00ad370 con 0x7f74b00cbf30 2023-10-10T22:17:47.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74affff700 1 --2- 172.21.15.154:0/2326224059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00ccf90 0x7f74b00b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:47.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74af7fe700 1 -- 172.21.15.154:0/2326224059 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175013761 0 0) 0x7f74b00cc300 con 0x7f74b015a270 2023-10-10T22:17:47.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74b4b9b700 1 --2- 172.21.15.154:0/2326224059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 0x7f74b00ae410 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009910 tx=0x7f74a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=457f19c6a0ef54c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:47.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74af7fe700 1 -- 172.21.15.154:0/2326224059 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a400b640 con 0x7f74b00cbf30 2023-10-10T22:17:47.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74af7fe700 1 -- 172.21.15.154:0/2326224059 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a400b7a0 con 0x7f74b00cbf30 2023-10-10T22:17:47.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.958+0000 7f74af7fe700 1 -- 172.21.15.154:0/2326224059 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a400bb60 con 0x7f74b00cbf30 2023-10-10T22:17:47.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.959+0000 7f74b6dff700 1 -- 172.21.15.154:0/2326224059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 msgr2=0x7f74b00ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.959+0000 7f74b6dff700 1 --2- 172.21.15.154:0/2326224059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 0x7f74b00ae410 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009910 tx=0x7f74a40091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.959+0000 7f74b6dff700 1 -- 172.21.15.154:0/2326224059 shutdown_connections 2023-10-10T22:17:47.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.959+0000 7f74b6dff700 1 --2- 172.21.15.154:0/2326224059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 0x7f74b00ae410 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.959+0000 7f74b6dff700 1 --2- 172.21.15.154:0/2326224059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b00ccf90 0x7f74b00b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.959+0000 7f74b6dff700 1 -- 172.21.15.154:0/2326224059 >> 172.21.15.154:0/2326224059 conn(0x7f74b006a320 msgr2=0x7f74b00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:47.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.959+0000 7f74b6dff700 1 -- 172.21.15.154:0/2326224059 shutdown_connections 2023-10-10T22:17:47.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.959+0000 7f74b6dff700 1 -- 172.21.15.154:0/2326224059 wait complete. 2023-10-10T22:17:47.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.960+0000 7f74b6dff700 1 Processor -- start 2023-10-10T22:17:47.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.960+0000 7f74b6dff700 1 -- start start 2023-10-10T22:17:47.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.961+0000 7f74b6dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 0x7f74b014d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.961+0000 7f74b6dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b00ccf90 0x7f74b0156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.961+0000 7f74b6dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b015a270 0x7f74b00a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.961+0000 7f74b6dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b0154600 con 0x7f74b00ccf90 2023-10-10T22:17:47.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.961+0000 7f74b6dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b006ef40 con 0x7f74b00cbf30 2023-10-10T22:17:47.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.961+0000 7f74b6dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00a55f0 con 0x7f74b015a270 2023-10-10T22:17:47.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74affff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b00ccf90 0x7f74b0156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74affff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b00ccf90 0x7f74b0156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56248/0 (socket says 172.21.15.154:56248) 2023-10-10T22:17:47.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74affff700 1 -- 172.21.15.154:0/2190558903 learned_addr learned my addr 172.21.15.154:0/2190558903 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:47.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74b4b9b700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 0x7f74b014d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74b539c700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b015a270 0x7f74b00a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74affff700 1 -- 172.21.15.154:0/2190558903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b015a270 msgr2=0x7f74b00a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74affff700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b015a270 0x7f74b00a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74affff700 1 -- 172.21.15.154:0/2190558903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 msgr2=0x7f74b014d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:47.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74affff700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 0x7f74b014d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:47.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74affff700 1 -- 172.21.15.154:0/2190558903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c009420 con 0x7f74b00ccf90 2023-10-10T22:17:47.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74b4b9b700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 0x7f74b014d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:17:47.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.962+0000 7f74affff700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b00ccf90 0x7f74b0156d30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f749c00ec80 tx=0x7f749c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:47.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.963+0000 7f74acff9700 1 -- 172.21.15.154:0/2190558903 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00c9d0 con 0x7f74b00ccf90 2023-10-10T22:17:47.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.963+0000 7f74acff9700 1 -- 172.21.15.154:0/2190558903 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c00cb30 con 0x7f74b00ccf90 2023-10-10T22:17:47.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.963+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a4009420 con 0x7f74b00ccf90 2023-10-10T22:17:47.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.963+0000 7f74acff9700 1 -- 172.21.15.154:0/2190558903 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00ceb0 con 0x7f74b00ccf90 2023-10-10T22:17:47.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.963+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b00a5940 con 0x7f74b00ccf90 2023-10-10T22:17:47.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.964+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b00a5730 con 0x7f74b00ccf90 2023-10-10T22:17:47.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.965+0000 7f74acff9700 1 -- 172.21.15.154:0/2190558903 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f749c013680 con 0x7f74b00ccf90 2023-10-10T22:17:47.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.966+0000 7f74acff9700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7494066f30 0x7f74940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:47.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.966+0000 7f74acff9700 1 -- 172.21.15.154:0/2190558903 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f749c084ef0 con 0x7f74b00ccf90 2023-10-10T22:17:47.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.966+0000 7f74b4b9b700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7494066f30 0x7f74940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:47.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.967+0000 7f74b4b9b700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7494066f30 0x7f74940693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009860 tx=0x7f74a4017000 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:47.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:47.970+0000 7f74acff9700 1 -- 172.21.15.154:0/2190558903 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f749c051f90 con 0x7f74b00ccf90 2023-10-10T22:17:48.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.159+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74b004c3c0 con 0x7f7494066f30 2023-10-10T22:17:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.169+0000 7f74acff9700 1 -- 172.21.15.154:0/2190558903 <== mgr.8481 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289538 (secure 0 0 0) 0x7f74b004c3c0 con 0x7f7494066f30 2023-10-10T22:17:48.174 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:48.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7494066f30 msgr2=0x7f74940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:48.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7494066f30 0x7f74940693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009860 tx=0x7f74a4017000 comp rx=0 tx=0).stop 2023-10-10T22:17:48.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b00ccf90 msgr2=0x7f74b0156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:48.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b00ccf90 0x7f74b0156d30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f749c00ec80 tx=0x7f749c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:48.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 shutdown_connections 2023-10-10T22:17:48.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74b015a270 0x7f74b00a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:48.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74b00cbf30 0x7f74b014d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7494066f30 0x7f74940693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 --2- 172.21.15.154:0/2190558903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b00ccf90 0x7f74b0156d30 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 >> 172.21.15.154:0/2190558903 conn(0x7f74b006a320 msgr2=0x7f74b00c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 shutdown_connections 2023-10-10T22:17:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:48.173+0000 7f74b6dff700 1 -- 172.21.15.154:0/2190558903 wait complete. 2023-10-10T22:17:48.179 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:17:48.192 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-10T22:17:47.471097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":483,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2477064,"kb_used_data":16840,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752497656,"statfs":{"total":773094113280,"available":770557599744,"internally_reserved":0,"allocated":17244160,"data_stored":9126748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.968739"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.531966+0000","last_change":"2023-10-10T22:17:41.530493+0000","last_active":"2023-10-10T22:17:41.531966+0000","last_peered":"2023-10-10T22:17:41.531966+0000","last_clean":"2023-10-10T22:17:41.531966+0000","last_became_active":"2023-10-10T22:17:41.530235+0000","last_became_peered":"2023-10-10T22:17:41.530235+0000","last_unstale":"2023-10-10T22:17:41.531966+0000","last_undegraded":"2023-10-10T22:17:41.531966+0000","last_fullsized":"2023-10-10T22:17:41.531966+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:24.719789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540551+0000","last_change":"2023-10-10T22:17:41.538049+0000","last_active":"2023-10-10T22:17:41.540551+0000","last_peered":"2023-10-10T22:17:41.540551+0000","last_clean":"2023-10-10T22:17:41.540551+0000","last_became_active":"2023-10-10T22:17:41.537748+0000","last_became_peered":"2023-10-10T22:17:41.537748+0000","last_unstale":"2023-10-10T22:17:41.540551+0000","last_undegraded":"2023-10-10T22:17:41.540551+0000","last_fullsized":"2023-10-10T22:17:41.540551+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:29:05.558529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548476+0000","last_change":"2023-10-10T22:17:41.544553+0000","last_active":"2023-10-10T22:17:41.548476+0000","last_peered":"2023-10-10T22:17:41.548476+0000","last_clean":"2023-10-10T22:17:41.548476+0000","last_became_active":"2023-10-10T22:17:41.544256+0000","last_became_peered":"2023-10-10T22:17:41.544256+0000","last_unstale":"2023-10-10T22:17:41.548476+0000","last_undegraded":"2023-10-10T22:17:41.548476+0000","last_fullsized":"2023-10-10T22:17:41.548476+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:10:49.360798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540057+0000","last_change":"2023-10-10T22:17:41.537068+0000","last_active":"2023-10-10T22:17:41.540057+0000","last_peered":"2023-10-10T22:17:41.540057+0000","last_clean":"2023-10-10T22:17:41.540057+0000","last_became_active":"2023-10-10T22:17:41.536820+0000","last_became_peered":"2023-10-10T22:17:41.536820+0000","last_unstale":"2023-10-10T22:17:41.540057+0000","last_undegraded":"2023-10-10T22:17:41.540057+0000","last_fullsized":"2023-10-10T22:17:41.540057+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:56:19.393778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.544051+0000","last_change":"2023-10-10T22:17:41.542581+0000","last_active":"2023-10-10T22:17:41.544051+0000","last_peered":"2023-10-10T22:17:41.544051+0000","last_clean":"2023-10-10T22:17:41.544051+0000","last_became_active":"2023-10-10T22:17:41.542309+0000","last_became_peered":"2023-10-10T22:17:41.542309+0000","last_unstale":"2023-10-10T22:17:41.544051+0000","last_undegraded":"2023-10-10T22:17:41.544051+0000","last_fullsized":"2023-10-10T22:17:41.544051+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:36:56.976437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.537378+0000","last_change":"2023-10-10T22:17:41.533556+0000","last_active":"2023-10-10T22:17:41.537378+0000","last_peered":"2023-10-10T22:17:41.537378+0000","last_clean":"2023-10-10T22:17:41.537378+0000","last_became_active":"2023-10-10T22:17:41.533286+0000","last_became_peered":"2023-10-10T22:17:41.533286+0000","last_unstale":"2023-10-10T22:17:41.537378+0000","last_undegraded":"2023-10-10T22:17:41.537378+0000","last_fullsized":"2023-10-10T22:17:41.537378+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:53.905230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541920+0000","last_change":"2023-10-10T22:17:41.539971+0000","last_active":"2023-10-10T22:17:41.541920+0000","last_peered":"2023-10-10T22:17:41.541920+0000","last_clean":"2023-10-10T22:17:41.541920+0000","last_became_active":"2023-10-10T22:17:41.539736+0000","last_became_peered":"2023-10-10T22:17:41.539736+0000","last_unstale":"2023-10-10T22:17:41.541920+0000","last_undegraded":"2023-10-10T22:17:41.541920+0000","last_fullsized":"2023-10-10T22:17:41.541920+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:49.853877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.544816+0000","last_change":"2023-10-10T22:17:41.540815+0000","last_active":"2023-10-10T22:17:41.544816+0000","last_peered":"2023-10-10T22:17:41.544816+0000","last_clean":"2023-10-10T22:17:41.544816+0000","last_became_active":"2023-10-10T22:17:41.540538+0000","last_became_peered":"2023-10-10T22:17:41.540538+0000","last_unstale":"2023-10-10T22:17:41.544816+0000","last_undegraded":"2023-10-10T22:17:41.544816+0000","last_fullsized":"2023-10-10T22:17:41.544816+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:30.867094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548362+0000","last_change":"2023-10-10T22:17:41.543736+0000","last_active":"2023-10-10T22:17:41.548362+0000","last_peered":"2023-10-10T22:17:41.548362+0000","last_clean":"2023-10-10T22:17:41.548362+0000","last_became_active":"2023-10-10T22:17:41.543422+0000","last_became_peered":"2023-10-10T22:17:41.543422+0000","last_unstale":"2023-10-10T22:17:41.548362+0000","last_undegraded":"2023-10-10T22:17:41.548362+0000","last_fullsized":"2023-10-10T22:17:41.548362+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:09.353574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542224+0000","last_change":"2023-10-10T22:17:41.538079+0000","last_active":"2023-10-10T22:17:41.542224+0000","last_peered":"2023-10-10T22:17:41.542224+0000","last_clean":"2023-10-10T22:17:41.542224+0000","last_became_active":"2023-10-10T22:17:41.537862+0000","last_became_peered":"2023-10-10T22:17:41.537862+0000","last_unstale":"2023-10-10T22:17:41.542224+0000","last_undegraded":"2023-10-10T22:17:41.542224+0000","last_fullsized":"2023-10-10T22:17:41.542224+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:02:21.807733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.533830+0000","last_change":"2023-10-10T22:17:41.529328+0000","last_active":"2023-10-10T22:17:41.533830+0000","last_peered":"2023-10-10T22:17:41.533830+0000","last_clean":"2023-10-10T22:17:41.533830+0000","last_became_active":"2023-10-10T22:17:41.529071+0000","last_became_peered":"2023-10-10T22:17:41.529071+0000","last_unstale":"2023-10-10T22:17:41.533830+0000","last_undegraded":"2023-10-10T22:17:41.533830+0000","last_fullsized":"2023-10-10T22:17:41.533830+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:11:30.561209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548291+0000","last_change":"2023-10-10T22:17:41.543597+0000","last_active":"2023-10-10T22:17:41.548291+0000","last_peered":"2023-10-10T22:17:41.548291+0000","last_clean":"2023-10-10T22:17:41.548291+0000","last_became_active":"2023-10-10T22:17:41.541134+0000","last_became_peered":"2023-10-10T22:17:41.541134+0000","last_unstale":"2023-10-10T22:17:41.548291+0000","last_undegraded":"2023-10-10T22:17:41.548291+0000","last_fullsized":"2023-10-10T22:17:41.548291+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.790081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532794+0000","last_change":"2023-10-10T22:17:41.530840+0000","last_active":"2023-10-10T22:17:41.532794+0000","last_peered":"2023-10-10T22:17:41.532794+0000","last_clean":"2023-10-10T22:17:41.532794+0000","last_became_active":"2023-10-10T22:17:41.530477+0000","last_became_peered":"2023-10-10T22:17:41.530477+0000","last_unstale":"2023-10-10T22:17:41.532794+0000","last_undegraded":"2023-10-10T22:17:41.532794+0000","last_fullsized":"2023-10-10T22:17:41.532794+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:13:59.310305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.535724+0000","last_change":"2023-10-10T22:17:41.533690+0000","last_active":"2023-10-10T22:17:41.535724+0000","last_peered":"2023-10-10T22:17:41.535724+0000","last_clean":"2023-10-10T22:17:41.535724+0000","last_became_active":"2023-10-10T22:17:41.533420+0000","last_became_peered":"2023-10-10T22:17:41.533420+0000","last_unstale":"2023-10-10T22:17:41.535724+0000","last_undegraded":"2023-10-10T22:17:41.535724+0000","last_fullsized":"2023-10-10T22:17:41.535724+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:26:59.996772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541755+0000","last_change":"2023-10-10T22:17:41.539487+0000","last_active":"2023-10-10T22:17:41.541755+0000","last_peered":"2023-10-10T22:17:41.541755+0000","last_clean":"2023-10-10T22:17:41.541755+0000","last_became_active":"2023-10-10T22:17:41.539158+0000","last_became_peered":"2023-10-10T22:17:41.539158+0000","last_unstale":"2023-10-10T22:17:41.541755+0000","last_undegraded":"2023-10-10T22:17:41.541755+0000","last_fullsized":"2023-10-10T22:17:41.541755+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:45:13.933778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.533844+0000","last_change":"2023-10-10T22:17:41.530171+0000","last_active":"2023-10-10T22:17:41.533844+0000","last_peered":"2023-10-10T22:17:41.533844+0000","last_clean":"2023-10-10T22:17:41.533844+0000","last_became_active":"2023-10-10T22:17:41.529910+0000","last_became_peered":"2023-10-10T22:17:41.529910+0000","last_unstale":"2023-10-10T22:17:41.533844+0000","last_undegraded":"2023-10-10T22:17:41.533844+0000","last_fullsized":"2023-10-10T22:17:41.533844+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:58:02.888057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540889+0000","last_change":"2023-10-10T22:17:41.535490+0000","last_active":"2023-10-10T22:17:41.540889+0000","last_peered":"2023-10-10T22:17:41.540889+0000","last_clean":"2023-10-10T22:17:41.540889+0000","last_became_active":"2023-10-10T22:17:41.535147+0000","last_became_peered":"2023-10-10T22:17:41.535147+0000","last_unstale":"2023-10-10T22:17:41.540889+0000","last_undegraded":"2023-10-10T22:17:41.540889+0000","last_fullsized":"2023-10-10T22:17:41.540889+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:22.533771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532002+0000","last_change":"2023-10-10T22:17:41.529016+0000","last_active":"2023-10-10T22:17:41.532002+0000","last_peered":"2023-10-10T22:17:41.532002+0000","last_clean":"2023-10-10T22:17:41.532002+0000","last_became_active":"2023-10-10T22:17:41.528727+0000","last_became_peered":"2023-10-10T22:17:41.528727+0000","last_unstale":"2023-10-10T22:17:41.532002+0000","last_undegraded":"2023-10-10T22:17:41.532002+0000","last_fullsized":"2023-10-10T22:17:41.532002+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:49.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.530222+0000","last_change":"2023-10-10T22:17:41.527792+0000","last_active":"2023-10-10T22:17:41.530222+0000","last_peered":"2023-10-10T22:17:41.530222+0000","last_clean":"2023-10-10T22:17:41.530222+0000","last_became_active":"2023-10-10T22:17:41.527507+0000","last_became_peered":"2023-10-10T22:17:41.527507+0000","last_unstale":"2023-10-10T22:17:41.530222+0000","last_undegraded":"2023-10-10T22:17:41.530222+0000","last_fullsized":"2023-10-10T22:17:41.530222+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:05:32.090579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532268+0000","last_change":"2023-10-10T22:17:41.530276+0000","last_active":"2023-10-10T22:17:41.532268+0000","last_peered":"2023-10-10T22:17:41.532268+0000","last_clean":"2023-10-10T22:17:41.532268+0000","last_became_active":"2023-10-10T22:17:41.529392+0000","last_became_peered":"2023-10-10T22:17:41.529392+0000","last_unstale":"2023-10-10T22:17:41.532268+0000","last_undegraded":"2023-10-10T22:17:41.532268+0000","last_fullsized":"2023-10-10T22:17:41.532268+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:34:33.635001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547488+0000","last_change":"2023-10-10T22:17:41.544635+0000","last_active":"2023-10-10T22:17:41.547488+0000","last_peered":"2023-10-10T22:17:41.547488+0000","last_clean":"2023-10-10T22:17:41.547488+0000","last_became_active":"2023-10-10T22:17:41.544336+0000","last_became_peered":"2023-10-10T22:17:41.544336+0000","last_unstale":"2023-10-10T22:17:41.547488+0000","last_undegraded":"2023-10-10T22:17:41.547488+0000","last_fullsized":"2023-10-10T22:17:41.547488+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:09:21.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532705+0000","last_change":"2023-10-10T22:17:41.530376+0000","last_active":"2023-10-10T22:17:41.532705+0000","last_peered":"2023-10-10T22:17:41.532705+0000","last_clean":"2023-10-10T22:17:41.532705+0000","last_became_active":"2023-10-10T22:17:41.530081+0000","last_became_peered":"2023-10-10T22:17:41.530081+0000","last_unstale":"2023-10-10T22:17:41.532705+0000","last_undegraded":"2023-10-10T22:17:41.532705+0000","last_fullsized":"2023-10-10T22:17:41.532705+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:01:41.323483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548054+0000","last_change":"2023-10-10T22:17:41.542993+0000","last_active":"2023-10-10T22:17:41.548054+0000","last_peered":"2023-10-10T22:17:41.548054+0000","last_clean":"2023-10-10T22:17:41.548054+0000","last_became_active":"2023-10-10T22:17:41.542713+0000","last_became_peered":"2023-10-10T22:17:41.542713+0000","last_unstale":"2023-10-10T22:17:41.548054+0000","last_undegraded":"2023-10-10T22:17:41.548054+0000","last_fullsized":"2023-10-10T22:17:41.548054+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:13:55.928526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.530373+0000","last_change":"2023-10-10T22:17:41.527841+0000","last_active":"2023-10-10T22:17:41.530373+0000","last_peered":"2023-10-10T22:17:41.530373+0000","last_clean":"2023-10-10T22:17:41.530373+0000","last_became_active":"2023-10-10T22:17:41.526489+0000","last_became_peered":"2023-10-10T22:17:41.526489+0000","last_unstale":"2023-10-10T22:17:41.530373+0000","last_undegraded":"2023-10-10T22:17:41.530373+0000","last_fullsized":"2023-10-10T22:17:41.530373+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:50:13.629731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542256+0000","last_change":"2023-10-10T22:17:41.538163+0000","last_active":"2023-10-10T22:17:41.542256+0000","last_peered":"2023-10-10T22:17:41.542256+0000","last_clean":"2023-10-10T22:17:41.542256+0000","last_became_active":"2023-10-10T22:17:41.537868+0000","last_became_peered":"2023-10-10T22:17:41.537868+0000","last_unstale":"2023-10-10T22:17:41.542256+0000","last_undegraded":"2023-10-10T22:17:41.542256+0000","last_fullsized":"2023-10-10T22:17:41.542256+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:00:45.578845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.533902+0000","last_change":"2023-10-10T22:17:41.532125+0000","last_active":"2023-10-10T22:17:41.533902+0000","last_peered":"2023-10-10T22:17:41.533902+0000","last_clean":"2023-10-10T22:17:41.533902+0000","last_became_active":"2023-10-10T22:17:41.531829+0000","last_became_peered":"2023-10-10T22:17:41.531829+0000","last_unstale":"2023-10-10T22:17:41.533902+0000","last_undegraded":"2023-10-10T22:17:41.533902+0000","last_fullsized":"2023-10-10T22:17:41.533902+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:46:05.278586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532118+0000","last_change":"2023-10-10T22:17:41.531206+0000","last_active":"2023-10-10T22:17:41.532118+0000","last_peered":"2023-10-10T22:17:41.532118+0000","last_clean":"2023-10-10T22:17:41.532118+0000","last_became_active":"2023-10-10T22:17:41.530738+0000","last_became_peered":"2023-10-10T22:17:41.530738+0000","last_unstale":"2023-10-10T22:17:41.532118+0000","last_undegraded":"2023-10-10T22:17:41.532118+0000","last_fullsized":"2023-10-10T22:17:41.532118+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:45:34.893282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539537+0000","last_change":"2023-10-10T22:17:41.530526+0000","last_active":"2023-10-10T22:17:41.539537+0000","last_peered":"2023-10-10T22:17:41.539537+0000","last_clean":"2023-10-10T22:17:41.539537+0000","last_became_active":"2023-10-10T22:17:41.530237+0000","last_became_peered":"2023-10-10T22:17:41.530237+0000","last_unstale":"2023-10-10T22:17:41.539537+0000","last_undegraded":"2023-10-10T22:17:41.539537+0000","last_fullsized":"2023-10-10T22:17:41.539537+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:16.163238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541673+0000","last_change":"2023-10-10T22:17:41.539233+0000","last_active":"2023-10-10T22:17:41.541673+0000","last_peered":"2023-10-10T22:17:41.541673+0000","last_clean":"2023-10-10T22:17:41.541673+0000","last_became_active":"2023-10-10T22:17:41.538972+0000","last_became_peered":"2023-10-10T22:17:41.538972+0000","last_unstale":"2023-10-10T22:17:41.541673+0000","last_undegraded":"2023-10-10T22:17:41.541673+0000","last_fullsized":"2023-10-10T22:17:41.541673+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:45:22.564420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542329+0000","last_change":"2023-10-10T22:17:41.539989+0000","last_active":"2023-10-10T22:17:41.542329+0000","last_peered":"2023-10-10T22:17:41.542329+0000","last_clean":"2023-10-10T22:17:41.542329+0000","last_became_active":"2023-10-10T22:17:41.539689+0000","last_became_peered":"2023-10-10T22:17:41.539689+0000","last_unstale":"2023-10-10T22:17:41.542329+0000","last_undegraded":"2023-10-10T22:17:41.542329+0000","last_fullsized":"2023-10-10T22:17:41.542329+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:30.434471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.543979+0000","last_change":"2023-10-10T22:17:41.540777+0000","last_active":"2023-10-10T22:17:41.543979+0000","last_peered":"2023-10-10T22:17:41.543979+0000","last_clean":"2023-10-10T22:17:41.543979+0000","last_became_active":"2023-10-10T22:17:41.540513+0000","last_became_peered":"2023-10-10T22:17:41.540513+0000","last_unstale":"2023-10-10T22:17:41.543979+0000","last_undegraded":"2023-10-10T22:17:41.543979+0000","last_fullsized":"2023-10-10T22:17:41.543979+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:05.414135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541005+0000","last_change":"2023-10-10T22:17:41.536849+0000","last_active":"2023-10-10T22:17:41.541005+0000","last_peered":"2023-10-10T22:17:41.541005+0000","last_clean":"2023-10-10T22:17:41.541005+0000","last_became_active":"2023-10-10T22:17:41.535973+0000","last_became_peered":"2023-10-10T22:17:41.535973+0000","last_unstale":"2023-10-10T22:17:41.541005+0000","last_undegraded":"2023-10-10T22:17:41.541005+0000","last_fullsized":"2023-10-10T22:17:41.541005+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:38:48.758613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.529385+0000","last_change":"2023-10-10T22:17:41.527561+0000","last_active":"2023-10-10T22:17:41.529385+0000","last_peered":"2023-10-10T22:17:41.529385+0000","last_clean":"2023-10-10T22:17:41.529385+0000","last_became_active":"2023-10-10T22:17:41.526669+0000","last_became_peered":"2023-10-10T22:17:41.526669+0000","last_unstale":"2023-10-10T22:17:41.529385+0000","last_undegraded":"2023-10-10T22:17:41.529385+0000","last_fullsized":"2023-10-10T22:17:41.529385+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:25:30.978397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"160'4","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.987748+0000","last_change":"2023-10-10T22:17:40.521516+0000","last_active":"2023-10-10T22:17:41.987748+0000","last_peered":"2023-10-10T22:17:41.987748+0000","last_clean":"2023-10-10T22:17:41.987748+0000","last_became_active":"2023-10-10T22:17:40.521209+0000","last_became_peered":"2023-10-10T22:17:40.521209+0000","last_unstale":"2023-10-10T22:17:41.987748+0000","last_undegraded":"2023-10-10T22:17:41.987748+0000","last_fullsized":"2023-10-10T22:17:41.987748+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:08.347918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.544927+0000","last_change":"2023-10-10T22:17:41.541813+0000","last_active":"2023-10-10T22:17:41.544927+0000","last_peered":"2023-10-10T22:17:41.544927+0000","last_clean":"2023-10-10T22:17:41.544927+0000","last_became_active":"2023-10-10T22:17:41.541557+0000","last_became_peered":"2023-10-10T22:17:41.541557+0000","last_unstale":"2023-10-10T22:17:41.544927+0000","last_undegraded":"2023-10-10T22:17:41.544927+0000","last_fullsized":"2023-10-10T22:17:41.544927+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:02:23.359264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.985098+0000","last_change":"2023-10-10T22:17:40.525121+0000","last_active":"2023-10-10T22:17:41.985098+0000","last_peered":"2023-10-10T22:17:41.985098+0000","last_clean":"2023-10-10T22:17:41.985098+0000","last_became_active":"2023-10-10T22:17:40.524744+0000","last_became_peered":"2023-10-10T22:17:40.524744+0000","last_unstale":"2023-10-10T22:17:41.985098+0000","last_undegraded":"2023-10-10T22:17:41.985098+0000","last_fullsized":"2023-10-10T22:17:41.985098+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:38:47.752957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547462+0000","last_change":"2023-10-10T22:17:41.543714+0000","last_active":"2023-10-10T22:17:41.547462+0000","last_peered":"2023-10-10T22:17:41.547462+0000","last_clean":"2023-10-10T22:17:41.547462+0000","last_became_active":"2023-10-10T22:17:41.543401+0000","last_became_peered":"2023-10-10T22:17:41.543401+0000","last_unstale":"2023-10-10T22:17:41.547462+0000","last_undegraded":"2023-10-10T22:17:41.547462+0000","last_fullsized":"2023-10-10T22:17:41.547462+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:56:31.177125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.988040+0000","last_change":"2023-10-10T22:17:40.520121+0000","last_active":"2023-10-10T22:17:41.988040+0000","last_peered":"2023-10-10T22:17:41.988040+0000","last_clean":"2023-10-10T22:17:41.988040+0000","last_became_active":"2023-10-10T22:17:40.519856+0000","last_became_peered":"2023-10-10T22:17:40.519856+0000","last_unstale":"2023-10-10T22:17:41.988040+0000","last_undegraded":"2023-10-10T22:17:41.988040+0000","last_fullsized":"2023-10-10T22:17:41.988040+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:48.848221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539052+0000","last_change":"2023-10-10T22:17:41.537816+0000","last_active":"2023-10-10T22:17:41.539052+0000","last_peered":"2023-10-10T22:17:41.539052+0000","last_clean":"2023-10-10T22:17:41.539052+0000","last_became_active":"2023-10-10T22:17:41.537413+0000","last_became_peered":"2023-10-10T22:17:41.537413+0000","last_unstale":"2023-10-10T22:17:41.539052+0000","last_undegraded":"2023-10-10T22:17:41.539052+0000","last_fullsized":"2023-10-10T22:17:41.539052+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:19:20.573974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.985348+0000","last_change":"2023-10-10T22:17:40.525803+0000","last_active":"2023-10-10T22:17:41.985348+0000","last_peered":"2023-10-10T22:17:41.985348+0000","last_clean":"2023-10-10T22:17:41.985348+0000","last_became_active":"2023-10-10T22:17:40.525551+0000","last_became_peered":"2023-10-10T22:17:40.525551+0000","last_unstale":"2023-10-10T22:17:41.985348+0000","last_undegraded":"2023-10-10T22:17:41.985348+0000","last_fullsized":"2023-10-10T22:17:41.985348+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:37:24.923020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.531146+0000","last_change":"2023-10-10T22:17:41.528145+0000","last_active":"2023-10-10T22:17:41.531146+0000","last_peered":"2023-10-10T22:17:41.531146+0000","last_clean":"2023-10-10T22:17:41.531146+0000","last_became_active":"2023-10-10T22:17:41.527876+0000","last_became_peered":"2023-10-10T22:17:41.527876+0000","last_unstale":"2023-10-10T22:17:41.531146+0000","last_undegraded":"2023-10-10T22:17:41.531146+0000","last_fullsized":"2023-10-10T22:17:41.531146+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:03:25.095890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.988089+0000","last_change":"2023-10-10T22:17:40.523083+0000","last_active":"2023-10-10T22:17:41.988089+0000","last_peered":"2023-10-10T22:17:41.988089+0000","last_clean":"2023-10-10T22:17:41.988089+0000","last_became_active":"2023-10-10T22:17:40.522804+0000","last_became_peered":"2023-10-10T22:17:40.522804+0000","last_unstale":"2023-10-10T22:17:41.988089+0000","last_undegraded":"2023-10-10T22:17:41.988089+0000","last_fullsized":"2023-10-10T22:17:41.988089+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:19:40.576438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540954+0000","last_change":"2023-10-10T22:17:41.536099+0000","last_active":"2023-10-10T22:17:41.540954+0000","last_peered":"2023-10-10T22:17:41.540954+0000","last_clean":"2023-10-10T22:17:41.540954+0000","last_became_active":"2023-10-10T22:17:41.535753+0000","last_became_peered":"2023-10-10T22:17:41.535753+0000","last_unstale":"2023-10-10T22:17:41.540954+0000","last_undegraded":"2023-10-10T22:17:41.540954+0000","last_fullsized":"2023-10-10T22:17:41.540954+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:30.867094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.987751+0000","last_change":"2023-10-10T22:17:40.518844+0000","last_active":"2023-10-10T22:17:41.987751+0000","last_peered":"2023-10-10T22:17:41.987751+0000","last_clean":"2023-10-10T22:17:41.987751+0000","last_became_active":"2023-10-10T22:17:40.518596+0000","last_became_peered":"2023-10-10T22:17:40.518596+0000","last_unstale":"2023-10-10T22:17:41.987751+0000","last_undegraded":"2023-10-10T22:17:41.987751+0000","last_fullsized":"2023-10-10T22:17:41.987751+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:10:08.155250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540908+0000","last_change":"2023-10-10T22:17:41.538916+0000","last_active":"2023-10-10T22:17:41.540908+0000","last_peered":"2023-10-10T22:17:41.540908+0000","last_clean":"2023-10-10T22:17:41.540908+0000","last_became_active":"2023-10-10T22:17:41.538660+0000","last_became_peered":"2023-10-10T22:17:41.538660+0000","last_unstale":"2023-10-10T22:17:41.540908+0000","last_undegraded":"2023-10-10T22:17:41.540908+0000","last_fullsized":"2023-10-10T22:17:41.540908+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:58.986978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.524705+0000","last_change":"2023-10-10T22:17:40.520243+0000","last_active":"2023-10-10T22:17:41.524705+0000","last_peered":"2023-10-10T22:17:41.524705+0000","last_clean":"2023-10-10T22:17:41.524705+0000","last_became_active":"2023-10-10T22:17:40.519962+0000","last_became_peered":"2023-10-10T22:17:40.519962+0000","last_unstale":"2023-10-10T22:17:41.524705+0000","last_undegraded":"2023-10-10T22:17:41.524705+0000","last_fullsized":"2023-10-10T22:17:41.524705+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:41:03.639868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.534350+0000","last_change":"2023-10-10T22:17:41.531558+0000","last_active":"2023-10-10T22:17:41.534350+0000","last_peered":"2023-10-10T22:17:41.534350+0000","last_clean":"2023-10-10T22:17:41.534350+0000","last_became_active":"2023-10-10T22:17:41.531301+0000","last_became_peered":"2023-10-10T22:17:41.531301+0000","last_unstale":"2023-10-10T22:17:41.534350+0000","last_undegraded":"2023-10-10T22:17:41.534350+0000","last_fullsized":"2023-10-10T22:17:41.534350+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:35:41.592341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.524254+0000","last_change":"2023-10-10T22:17:40.521793+0000","last_active":"2023-10-10T22:17:41.524254+0000","last_peered":"2023-10-10T22:17:41.524254+0000","last_clean":"2023-10-10T22:17:41.524254+0000","last_became_active":"2023-10-10T22:17:40.521545+0000","last_became_peered":"2023-10-10T22:17:40.521545+0000","last_unstale":"2023-10-10T22:17:41.524254+0000","last_undegraded":"2023-10-10T22:17:41.524254+0000","last_fullsized":"2023-10-10T22:17:41.524254+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:11.877300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.537911+0000","last_change":"2023-10-10T22:17:41.531558+0000","last_active":"2023-10-10T22:17:41.537911+0000","last_peered":"2023-10-10T22:17:41.537911+0000","last_clean":"2023-10-10T22:17:41.537911+0000","last_became_active":"2023-10-10T22:17:41.531311+0000","last_became_peered":"2023-10-10T22:17:41.531311+0000","last_unstale":"2023-10-10T22:17:41.537911+0000","last_undegraded":"2023-10-10T22:17:41.537911+0000","last_fullsized":"2023-10-10T22:17:41.537911+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:23:02.704929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.524578+0000","last_change":"2023-10-10T22:17:40.522177+0000","last_active":"2023-10-10T22:17:41.524578+0000","last_peered":"2023-10-10T22:17:41.524578+0000","last_clean":"2023-10-10T22:17:41.524578+0000","last_became_active":"2023-10-10T22:17:40.521826+0000","last_became_peered":"2023-10-10T22:17:40.521826+0000","last_unstale":"2023-10-10T22:17:41.524578+0000","last_undegraded":"2023-10-10T22:17:41.524578+0000","last_fullsized":"2023-10-10T22:17:41.524578+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:21.528115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539459+0000","last_change":"2023-10-10T22:17:41.531273+0000","last_active":"2023-10-10T22:17:41.539459+0000","last_peered":"2023-10-10T22:17:41.539459+0000","last_clean":"2023-10-10T22:17:41.539459+0000","last_became_active":"2023-10-10T22:17:41.531013+0000","last_became_peered":"2023-10-10T22:17:41.531013+0000","last_unstale":"2023-10-10T22:17:41.539459+0000","last_undegraded":"2023-10-10T22:17:41.539459+0000","last_fullsized":"2023-10-10T22:17:41.539459+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:02:23.359264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.521820+0000","last_change":"2023-10-10T22:17:40.521006+0000","last_active":"2023-10-10T22:17:41.521820+0000","last_peered":"2023-10-10T22:17:41.521820+0000","last_clean":"2023-10-10T22:17:41.521820+0000","last_became_active":"2023-10-10T22:17:40.520753+0000","last_became_peered":"2023-10-10T22:17:40.520753+0000","last_unstale":"2023-10-10T22:17:41.521820+0000","last_undegraded":"2023-10-10T22:17:41.521820+0000","last_fullsized":"2023-10-10T22:17:41.521820+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:12:04.193860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.543944+0000","last_change":"2023-10-10T22:17:41.542191+0000","last_active":"2023-10-10T22:17:41.543944+0000","last_peered":"2023-10-10T22:17:41.543944+0000","last_clean":"2023-10-10T22:17:41.543944+0000","last_became_active":"2023-10-10T22:17:41.541587+0000","last_became_peered":"2023-10-10T22:17:41.541587+0000","last_unstale":"2023-10-10T22:17:41.543944+0000","last_undegraded":"2023-10-10T22:17:41.543944+0000","last_fullsized":"2023-10-10T22:17:41.543944+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:55:06.582810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"160'3","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.988333+0000","last_change":"2023-10-10T22:17:40.524213+0000","last_active":"2023-10-10T22:17:41.988333+0000","last_peered":"2023-10-10T22:17:41.988333+0000","last_clean":"2023-10-10T22:17:41.988333+0000","last_became_active":"2023-10-10T22:17:40.523960+0000","last_became_peered":"2023-10-10T22:17:40.523960+0000","last_unstale":"2023-10-10T22:17:41.988333+0000","last_undegraded":"2023-10-10T22:17:41.988333+0000","last_fullsized":"2023-10-10T22:17:41.988333+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:32:13.728451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547610+0000","last_change":"2023-10-10T22:17:41.544498+0000","last_active":"2023-10-10T22:17:41.547610+0000","last_peered":"2023-10-10T22:17:41.547610+0000","last_clean":"2023-10-10T22:17:41.547610+0000","last_became_active":"2023-10-10T22:17:41.544200+0000","last_became_peered":"2023-10-10T22:17:41.544200+0000","last_unstale":"2023-10-10T22:17:41.547610+0000","last_undegraded":"2023-10-10T22:17:41.547610+0000","last_fullsized":"2023-10-10T22:17:41.547610+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:23.210371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"160'6","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.990244+0000","last_change":"2023-10-10T22:17:40.524679+0000","last_active":"2023-10-10T22:17:41.990244+0000","last_peered":"2023-10-10T22:17:41.990244+0000","last_clean":"2023-10-10T22:17:41.990244+0000","last_became_active":"2023-10-10T22:17:40.523808+0000","last_became_peered":"2023-10-10T22:17:40.523808+0000","last_unstale":"2023-10-10T22:17:41.990244+0000","last_undegraded":"2023-10-10T22:17:41.990244+0000","last_fullsized":"2023-10-10T22:17:41.990244+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:30.995946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539779+0000","last_change":"2023-10-10T22:17:41.532702+0000","last_active":"2023-10-10T22:17:41.539779+0000","last_peered":"2023-10-10T22:17:41.539779+0000","last_clean":"2023-10-10T22:17:41.539779+0000","last_became_active":"2023-10-10T22:17:41.532437+0000","last_became_peered":"2023-10-10T22:17:41.532437+0000","last_unstale":"2023-10-10T22:17:41.539779+0000","last_undegraded":"2023-10-10T22:17:41.539779+0000","last_fullsized":"2023-10-10T22:17:41.539779+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:57:06.196867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.525100+0000","last_change":"2023-10-10T22:17:40.509758+0000","last_active":"2023-10-10T22:17:41.525100+0000","last_peered":"2023-10-10T22:17:41.525100+0000","last_clean":"2023-10-10T22:17:41.525100+0000","last_became_active":"2023-10-10T22:17:40.509489+0000","last_became_peered":"2023-10-10T22:17:40.509489+0000","last_unstale":"2023-10-10T22:17:41.525100+0000","last_undegraded":"2023-10-10T22:17:41.525100+0000","last_fullsized":"2023-10-10T22:17:41.525100+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:36:32.351547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542280+0000","last_change":"2023-10-10T22:17:41.539435+0000","last_active":"2023-10-10T22:17:41.542280+0000","last_peered":"2023-10-10T22:17:41.542280+0000","last_clean":"2023-10-10T22:17:41.542280+0000","last_became_active":"2023-10-10T22:17:41.539193+0000","last_became_peered":"2023-10-10T22:17:41.539193+0000","last_unstale":"2023-10-10T22:17:41.542280+0000","last_undegraded":"2023-10-10T22:17:41.542280+0000","last_fullsized":"2023-10-10T22:17:41.542280+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:19:19.668199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.524218+0000","last_change":"2023-10-10T22:17:40.522528+0000","last_active":"2023-10-10T22:17:41.524218+0000","last_peered":"2023-10-10T22:17:41.524218+0000","last_clean":"2023-10-10T22:17:41.524218+0000","last_became_active":"2023-10-10T22:17:40.522263+0000","last_became_peered":"2023-10-10T22:17:40.522263+0000","last_unstale":"2023-10-10T22:17:41.524218+0000","last_undegraded":"2023-10-10T22:17:41.524218+0000","last_fullsized":"2023-10-10T22:17:41.524218+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:51:15.733557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548032+0000","last_change":"2023-10-10T22:17:41.542384+0000","last_active":"2023-10-10T22:17:41.548032+0000","last_peered":"2023-10-10T22:17:41.548032+0000","last_clean":"2023-10-10T22:17:41.548032+0000","last_became_active":"2023-10-10T22:17:41.541978+0000","last_became_peered":"2023-10-10T22:17:41.541978+0000","last_unstale":"2023-10-10T22:17:41.548032+0000","last_undegraded":"2023-10-10T22:17:41.548032+0000","last_fullsized":"2023-10-10T22:17:41.548032+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:49.853877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"160'8","reported_seq":18,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.990057+0000","last_change":"2023-10-10T22:17:40.523440+0000","last_active":"2023-10-10T22:17:41.990057+0000","last_peered":"2023-10-10T22:17:41.990057+0000","last_clean":"2023-10-10T22:17:41.990057+0000","last_became_active":"2023-10-10T22:17:40.523088+0000","last_became_peered":"2023-10-10T22:17:40.523088+0000","last_unstale":"2023-10-10T22:17:41.990057+0000","last_undegraded":"2023-10-10T22:17:41.990057+0000","last_fullsized":"2023-10-10T22:17:41.990057+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:37:34.589773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548089+0000","last_change":"2023-10-10T22:17:41.542952+0000","last_active":"2023-10-10T22:17:41.548089+0000","last_peered":"2023-10-10T22:17:41.548089+0000","last_clean":"2023-10-10T22:17:41.548089+0000","last_became_active":"2023-10-10T22:17:41.542637+0000","last_became_peered":"2023-10-10T22:17:41.542637+0000","last_unstale":"2023-10-10T22:17:41.548089+0000","last_undegraded":"2023-10-10T22:17:41.548089+0000","last_fullsized":"2023-10-10T22:17:41.548089+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:16.163238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.987452+0000","last_change":"2023-10-10T22:17:40.523071+0000","last_active":"2023-10-10T22:17:41.987452+0000","last_peered":"2023-10-10T22:17:41.987452+0000","last_clean":"2023-10-10T22:17:41.987452+0000","last_became_active":"2023-10-10T22:17:40.522791+0000","last_became_peered":"2023-10-10T22:17:40.522791+0000","last_unstale":"2023-10-10T22:17:41.987452+0000","last_undegraded":"2023-10-10T22:17:41.987452+0000","last_fullsized":"2023-10-10T22:17:41.987452+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:52.899573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539488+0000","last_change":"2023-10-10T22:17:41.532456+0000","last_active":"2023-10-10T22:17:41.539488+0000","last_peered":"2023-10-10T22:17:41.539488+0000","last_clean":"2023-10-10T22:17:41.539488+0000","last_became_active":"2023-10-10T22:17:41.532174+0000","last_became_peered":"2023-10-10T22:17:41.532174+0000","last_unstale":"2023-10-10T22:17:41.539488+0000","last_undegraded":"2023-10-10T22:17:41.539488+0000","last_fullsized":"2023-10-10T22:17:41.539488+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:50:06.005830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.984498+0000","last_change":"2023-10-10T22:17:40.522075+0000","last_active":"2023-10-10T22:17:41.984498+0000","last_peered":"2023-10-10T22:17:41.984498+0000","last_clean":"2023-10-10T22:17:41.984498+0000","last_became_active":"2023-10-10T22:17:40.521812+0000","last_became_peered":"2023-10-10T22:17:40.521812+0000","last_unstale":"2023-10-10T22:17:41.984498+0000","last_undegraded":"2023-10-10T22:17:41.984498+0000","last_fullsized":"2023-10-10T22:17:41.984498+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:13:54.922870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.533938+0000","last_change":"2023-10-10T22:17:41.531597+0000","last_active":"2023-10-10T22:17:41.533938+0000","last_peered":"2023-10-10T22:17:41.533938+0000","last_clean":"2023-10-10T22:17:41.533938+0000","last_became_active":"2023-10-10T22:17:41.531352+0000","last_became_peered":"2023-10-10T22:17:41.531352+0000","last_unstale":"2023-10-10T22:17:41.533938+0000","last_undegraded":"2023-10-10T22:17:41.533938+0000","last_fullsized":"2023-10-10T22:17:41.533938+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:41:18.864886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.988200+0000","last_change":"2023-10-10T22:17:40.512759+0000","last_active":"2023-10-10T22:17:41.988200+0000","last_peered":"2023-10-10T22:17:41.988200+0000","last_clean":"2023-10-10T22:17:41.988200+0000","last_became_active":"2023-10-10T22:17:40.512487+0000","last_became_peered":"2023-10-10T22:17:40.512487+0000","last_unstale":"2023-10-10T22:17:41.988200+0000","last_undegraded":"2023-10-10T22:17:41.988200+0000","last_fullsized":"2023-10-10T22:17:41.988200+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:16:52.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.535155+0000","last_change":"2023-10-10T22:17:41.532137+0000","last_active":"2023-10-10T22:17:41.535155+0000","last_peered":"2023-10-10T22:17:41.535155+0000","last_clean":"2023-10-10T22:17:41.535155+0000","last_became_active":"2023-10-10T22:17:41.531846+0000","last_became_peered":"2023-10-10T22:17:41.531846+0000","last_unstale":"2023-10-10T22:17:41.535155+0000","last_undegraded":"2023-10-10T22:17:41.535155+0000","last_fullsized":"2023-10-10T22:17:41.535155+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:12:00.731788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.523682+0000","last_change":"2023-10-10T22:17:40.525643+0000","last_active":"2023-10-10T22:17:41.523682+0000","last_peered":"2023-10-10T22:17:41.523682+0000","last_clean":"2023-10-10T22:17:41.523682+0000","last_became_active":"2023-10-10T22:17:40.525350+0000","last_became_peered":"2023-10-10T22:17:40.525350+0000","last_unstale":"2023-10-10T22:17:41.523682+0000","last_undegraded":"2023-10-10T22:17:41.523682+0000","last_fullsized":"2023-10-10T22:17:41.523682+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.531371+0000","last_change":"2023-10-10T22:17:41.528891+0000","last_active":"2023-10-10T22:17:41.531371+0000","last_peered":"2023-10-10T22:17:41.531371+0000","last_clean":"2023-10-10T22:17:41.531371+0000","last_became_active":"2023-10-10T22:17:41.528576+0000","last_became_peered":"2023-10-10T22:17:41.528576+0000","last_unstale":"2023-10-10T22:17:41.531371+0000","last_undegraded":"2023-10-10T22:17:41.531371+0000","last_fullsized":"2023-10-10T22:17:41.531371+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:08:47.066388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.985717+0000","last_change":"2023-10-10T22:17:40.521890+0000","last_active":"2023-10-10T22:17:41.985717+0000","last_peered":"2023-10-10T22:17:41.985717+0000","last_clean":"2023-10-10T22:17:41.985717+0000","last_became_active":"2023-10-10T22:17:40.521630+0000","last_became_peered":"2023-10-10T22:17:40.521630+0000","last_unstale":"2023-10-10T22:17:41.985717+0000","last_undegraded":"2023-10-10T22:17:41.985717+0000","last_fullsized":"2023-10-10T22:17:41.985717+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:54:06.442299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541888+0000","last_change":"2023-10-10T22:17:41.539922+0000","last_active":"2023-10-10T22:17:41.541888+0000","last_peered":"2023-10-10T22:17:41.541888+0000","last_clean":"2023-10-10T22:17:41.541888+0000","last_became_active":"2023-10-10T22:17:41.539624+0000","last_became_peered":"2023-10-10T22:17:41.539624+0000","last_unstale":"2023-10-10T22:17:41.541888+0000","last_undegraded":"2023-10-10T22:17:41.541888+0000","last_fullsized":"2023-10-10T22:17:41.541888+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:58.986978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.521150+0000","last_change":"2023-10-10T22:17:40.520441+0000","last_active":"2023-10-10T22:17:41.521150+0000","last_peered":"2023-10-10T22:17:41.521150+0000","last_clean":"2023-10-10T22:17:41.521150+0000","last_became_active":"2023-10-10T22:17:40.520143+0000","last_became_peered":"2023-10-10T22:17:40.520143+0000","last_unstale":"2023-10-10T22:17:41.521150+0000","last_undegraded":"2023-10-10T22:17:41.521150+0000","last_fullsized":"2023-10-10T22:17:41.521150+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:22.881283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.535758+0000","last_change":"2023-10-10T22:17:41.534246+0000","last_active":"2023-10-10T22:17:41.535758+0000","last_peered":"2023-10-10T22:17:41.535758+0000","last_clean":"2023-10-10T22:17:41.535758+0000","last_became_active":"2023-10-10T22:17:41.533984+0000","last_became_peered":"2023-10-10T22:17:41.533984+0000","last_unstale":"2023-10-10T22:17:41.535758+0000","last_undegraded":"2023-10-10T22:17:41.535758+0000","last_fullsized":"2023-10-10T22:17:41.535758+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:53.066259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.520887+0000","last_change":"2023-10-10T22:17:40.517616+0000","last_active":"2023-10-10T22:17:41.520887+0000","last_peered":"2023-10-10T22:17:41.520887+0000","last_clean":"2023-10-10T22:17:41.520887+0000","last_became_active":"2023-10-10T22:17:40.517355+0000","last_became_peered":"2023-10-10T22:17:40.517355+0000","last_unstale":"2023-10-10T22:17:41.520887+0000","last_undegraded":"2023-10-10T22:17:41.520887+0000","last_fullsized":"2023-10-10T22:17:41.520887+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:01:17.177395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547417+0000","last_change":"2023-10-10T22:17:41.543255+0000","last_active":"2023-10-10T22:17:41.547417+0000","last_peered":"2023-10-10T22:17:41.547417+0000","last_clean":"2023-10-10T22:17:41.547417+0000","last_became_active":"2023-10-10T22:17:41.542952+0000","last_became_peered":"2023-10-10T22:17:41.542952+0000","last_unstale":"2023-10-10T22:17:41.547417+0000","last_undegraded":"2023-10-10T22:17:41.547417+0000","last_fullsized":"2023-10-10T22:17:41.547417+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:21.347014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.517589+0000","last_change":"2023-10-10T22:17:40.523553+0000","last_active":"2023-10-10T22:17:41.517589+0000","last_peered":"2023-10-10T22:17:41.517589+0000","last_clean":"2023-10-10T22:17:41.517589+0000","last_became_active":"2023-10-10T22:17:40.523310+0000","last_became_peered":"2023-10-10T22:17:40.523310+0000","last_unstale":"2023-10-10T22:17:41.517589+0000","last_undegraded":"2023-10-10T22:17:41.517589+0000","last_fullsized":"2023-10-10T22:17:41.517589+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:15.157582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.536545+0000","last_change":"2023-10-10T22:17:41.528224+0000","last_active":"2023-10-10T22:17:41.536545+0000","last_peered":"2023-10-10T22:17:41.536545+0000","last_clean":"2023-10-10T22:17:41.536545+0000","last_became_active":"2023-10-10T22:17:41.527921+0000","last_became_peered":"2023-10-10T22:17:41.527921+0000","last_unstale":"2023-10-10T22:17:41.536545+0000","last_undegraded":"2023-10-10T22:17:41.536545+0000","last_fullsized":"2023-10-10T22:17:41.536545+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:13:55.928526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.984377+0000","last_change":"2023-10-10T22:17:40.520688+0000","last_active":"2023-10-10T22:17:41.984377+0000","last_peered":"2023-10-10T22:17:41.984377+0000","last_clean":"2023-10-10T22:17:41.984377+0000","last_became_active":"2023-10-10T22:17:40.520220+0000","last_became_peered":"2023-10-10T22:17:40.520220+0000","last_unstale":"2023-10-10T22:17:41.984377+0000","last_undegraded":"2023-10-10T22:17:41.984377+0000","last_fullsized":"2023-10-10T22:17:41.984377+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:32:50.667379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541771+0000","last_change":"2023-10-10T22:17:41.539400+0000","last_active":"2023-10-10T22:17:41.541771+0000","last_peered":"2023-10-10T22:17:41.541771+0000","last_clean":"2023-10-10T22:17:41.541771+0000","last_became_active":"2023-10-10T22:17:41.539123+0000","last_became_peered":"2023-10-10T22:17:41.539123+0000","last_unstale":"2023-10-10T22:17:41.541771+0000","last_undegraded":"2023-10-10T22:17:41.541771+0000","last_fullsized":"2023-10-10T22:17:41.541771+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:30:11.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.531653+0000","last_change":"2023-10-10T22:17:40.522095+0000","last_active":"2023-10-10T22:17:41.531653+0000","last_peered":"2023-10-10T22:17:41.531653+0000","last_clean":"2023-10-10T22:17:41.531653+0000","last_became_active":"2023-10-10T22:17:40.521022+0000","last_became_peered":"2023-10-10T22:17:40.521022+0000","last_unstale":"2023-10-10T22:17:41.531653+0000","last_undegraded":"2023-10-10T22:17:41.531653+0000","last_fullsized":"2023-10-10T22:17:41.531653+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:15.157582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540507+0000","last_change":"2023-10-10T22:17:41.537591+0000","last_active":"2023-10-10T22:17:41.540507+0000","last_peered":"2023-10-10T22:17:41.540507+0000","last_clean":"2023-10-10T22:17:41.540507+0000","last_became_active":"2023-10-10T22:17:41.537342+0000","last_became_peered":"2023-10-10T22:17:41.537342+0000","last_unstale":"2023-10-10T22:17:41.540507+0000","last_undegraded":"2023-10-10T22:17:41.540507+0000","last_fullsized":"2023-10-10T22:17:41.540507+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:48.830379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.525943+0000","last_change":"2023-10-10T22:17:40.521243+0000","last_active":"2023-10-10T22:17:41.525943+0000","last_peered":"2023-10-10T22:17:41.525943+0000","last_clean":"2023-10-10T22:17:41.525943+0000","last_became_active":"2023-10-10T22:17:40.520975+0000","last_became_peered":"2023-10-10T22:17:40.520975+0000","last_unstale":"2023-10-10T22:17:41.525943+0000","last_undegraded":"2023-10-10T22:17:41.525943+0000","last_fullsized":"2023-10-10T22:17:41.525943+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:26.541318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.537435+0000","last_change":"2023-10-10T22:17:41.532549+0000","last_active":"2023-10-10T22:17:41.537435+0000","last_peered":"2023-10-10T22:17:41.537435+0000","last_clean":"2023-10-10T22:17:41.537435+0000","last_became_active":"2023-10-10T22:17:41.532277+0000","last_became_peered":"2023-10-10T22:17:41.532277+0000","last_unstale":"2023-10-10T22:17:41.537435+0000","last_undegraded":"2023-10-10T22:17:41.537435+0000","last_fullsized":"2023-10-10T22:17:41.537435+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:55:39.724016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.517953+0000","last_change":"2023-10-10T22:17:40.521143+0000","last_active":"2023-10-10T22:17:41.517953+0000","last_peered":"2023-10-10T22:17:41.517953+0000","last_clean":"2023-10-10T22:17:41.517953+0000","last_became_active":"2023-10-10T22:17:40.520794+0000","last_became_peered":"2023-10-10T22:17:40.520794+0000","last_unstale":"2023-10-10T22:17:41.517953+0000","last_undegraded":"2023-10-10T22:17:41.517953+0000","last_fullsized":"2023-10-10T22:17:41.517953+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:08.347918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547420+0000","last_change":"2023-10-10T22:17:41.543884+0000","last_active":"2023-10-10T22:17:41.547420+0000","last_peered":"2023-10-10T22:17:41.547420+0000","last_clean":"2023-10-10T22:17:41.547420+0000","last_became_active":"2023-10-10T22:17:41.543430+0000","last_became_peered":"2023-10-10T22:17:41.543430+0000","last_unstale":"2023-10-10T22:17:41.547420+0000","last_undegraded":"2023-10-10T22:17:41.547420+0000","last_fullsized":"2023-10-10T22:17:41.547420+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:55:47.524833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.525298+0000","last_change":"2023-10-10T22:17:40.525282+0000","last_active":"2023-10-10T22:17:41.525298+0000","last_peered":"2023-10-10T22:17:41.525298+0000","last_clean":"2023-10-10T22:17:41.525298+0000","last_became_active":"2023-10-10T22:17:40.524016+0000","last_became_peered":"2023-10-10T22:17:40.524016+0000","last_unstale":"2023-10-10T22:17:41.525298+0000","last_undegraded":"2023-10-10T22:17:41.525298+0000","last_fullsized":"2023-10-10T22:17:41.525298+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:04:40.331834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541191+0000","last_change":"2023-10-10T22:17:41.535503+0000","last_active":"2023-10-10T22:17:41.541191+0000","last_peered":"2023-10-10T22:17:41.541191+0000","last_clean":"2023-10-10T22:17:41.541191+0000","last_became_active":"2023-10-10T22:17:41.535227+0000","last_became_peered":"2023-10-10T22:17:41.535227+0000","last_unstale":"2023-10-10T22:17:41.541191+0000","last_undegraded":"2023-10-10T22:17:41.541191+0000","last_fullsized":"2023-10-10T22:17:41.541191+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:10:49.360798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532221+0000","last_change":"2023-10-10T22:17:40.524342+0000","last_active":"2023-10-10T22:17:41.532221+0000","last_peered":"2023-10-10T22:17:41.532221+0000","last_clean":"2023-10-10T22:17:41.532221+0000","last_became_active":"2023-10-10T22:17:40.524089+0000","last_became_peered":"2023-10-10T22:17:40.524089+0000","last_unstale":"2023-10-10T22:17:41.532221+0000","last_undegraded":"2023-10-10T22:17:41.532221+0000","last_fullsized":"2023-10-10T22:17:41.532221+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:02:22.353608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542382+0000","last_change":"2023-10-10T22:17:41.540873+0000","last_active":"2023-10-10T22:17:41.542382+0000","last_peered":"2023-10-10T22:17:41.542382+0000","last_clean":"2023-10-10T22:17:41.542382+0000","last_became_active":"2023-10-10T22:17:41.540591+0000","last_became_peered":"2023-10-10T22:17:41.540591+0000","last_unstale":"2023-10-10T22:17:41.542382+0000","last_undegraded":"2023-10-10T22:17:41.542382+0000","last_fullsized":"2023-10-10T22:17:41.542382+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:11:20.331680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.521023+0000","last_change":"2023-10-10T22:17:40.521685+0000","last_active":"2023-10-10T22:17:41.521023+0000","last_peered":"2023-10-10T22:17:41.521023+0000","last_clean":"2023-10-10T22:17:41.521023+0000","last_became_active":"2023-10-10T22:17:40.521403+0000","last_became_peered":"2023-10-10T22:17:40.521403+0000","last_unstale":"2023-10-10T22:17:41.521023+0000","last_undegraded":"2023-10-10T22:17:41.521023+0000","last_fullsized":"2023-10-10T22:17:41.521023+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:57.324274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540425+0000","last_change":"2023-10-10T22:17:41.537089+0000","last_active":"2023-10-10T22:17:41.540425+0000","last_peered":"2023-10-10T22:17:41.540425+0000","last_clean":"2023-10-10T22:17:41.540425+0000","last_became_active":"2023-10-10T22:17:41.536809+0000","last_became_peered":"2023-10-10T22:17:41.536809+0000","last_unstale":"2023-10-10T22:17:41.540425+0000","last_undegraded":"2023-10-10T22:17:41.540425+0000","last_fullsized":"2023-10-10T22:17:41.540425+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:09:52.300199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.518088+0000","last_change":"2023-10-10T22:17:40.512133+0000","last_active":"2023-10-10T22:17:41.518088+0000","last_peered":"2023-10-10T22:17:41.518088+0000","last_clean":"2023-10-10T22:17:41.518088+0000","last_became_active":"2023-10-10T22:17:40.511757+0000","last_became_peered":"2023-10-10T22:17:40.511757+0000","last_unstale":"2023-10-10T22:17:41.518088+0000","last_undegraded":"2023-10-10T22:17:41.518088+0000","last_fullsized":"2023-10-10T22:17:41.518088+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:09.784424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547399+0000","last_change":"2023-10-10T22:17:41.543703+0000","last_active":"2023-10-10T22:17:41.547399+0000","last_peered":"2023-10-10T22:17:41.547399+0000","last_clean":"2023-10-10T22:17:41.547399+0000","last_became_active":"2023-10-10T22:17:41.543020+0000","last_became_peered":"2023-10-10T22:17:41.543020+0000","last_unstale":"2023-10-10T22:17:41.547399+0000","last_undegraded":"2023-10-10T22:17:41.547399+0000","last_fullsized":"2023-10-10T22:17:41.547399+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:57:41.173655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.987573+0000","last_change":"2023-10-10T22:17:40.521489+0000","last_active":"2023-10-10T22:17:41.987573+0000","last_peered":"2023-10-10T22:17:41.987573+0000","last_clean":"2023-10-10T22:17:41.987573+0000","last_became_active":"2023-10-10T22:17:40.521155+0000","last_became_peered":"2023-10-10T22:17:40.521155+0000","last_unstale":"2023-10-10T22:17:41.987573+0000","last_undegraded":"2023-10-10T22:17:41.987573+0000","last_fullsized":"2023-10-10T22:17:41.987573+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:09.784424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"150'271","reported_seq":832,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.531439+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:17:41.531439+0000","last_peered":"2023-10-10T22:17:41.531439+0000","last_clean":"2023-10-10T22:17:41.531439+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:17:41.531439+0000","last_undegraded":"2023-10-10T22:17:41.531439+0000","last_fullsized":"2023-10-10T22:17:41.531439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543044,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308036,"kb_used_data":2556,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063804,"statfs":{"total":96636764160,"available":96321335296,"internally_reserved":0,"allocated":2617344,"data_stored":1585189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96999999999999997,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.497},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73599999999999999,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.56499999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.98699999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88500000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.75900000000000001,"15min":0.754},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.624}]},{"osd":4,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.95699999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.94899999999999995},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85899999999999999,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.442},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.66700000000000004}]},{"osd":6,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0289999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69299999999999995}]}]},{"osd":6,"up_from":14,"seq":60129543043,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311540,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060300,"statfs":{"total":96636764160,"available":96317747200,"internally_reserved":0,"allocated":2011136,"data_stored":994211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.88},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.84199999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.92400000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.0189999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.81899999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.74299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129543043,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307432,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064408,"statfs":{"total":96636764160,"available":96321953792,"internally_reserved":0,"allocated":1998848,"data_stored":992675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.36299999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.38700000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.44},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.43099999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.755},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.84299999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.746},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.80600000000000005}]}]},{"osd":0,"up_from":14,"seq":60129543045,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303916,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067924,"statfs":{"total":96636764160,"available":96325554176,"internally_reserved":0,"allocated":2592768,"data_stored":1583043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.436},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.29099999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.44700000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.34000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.871,"5min":0.89800000000000002,"15min":0.90800000000000003},"last":0.505}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.754}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.77400000000000002}]}]},{"osd":2,"up_from":14,"seq":60129543045,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311536,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060304,"statfs":{"total":96636764160,"available":96317751296,"internally_reserved":0,"allocated":2007040,"data_stored":993263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.80900000000000005},"last":0.71399999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81100000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.90000000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.355,"15min":1.355},"last":0.79200000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.1659999999999999,"5min":1.248,"15min":1.248},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.232},"last":0.64800000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2070000000000001,"5min":1.278,"15min":1.278},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56899999999999995},"max":{"1min":1.1339999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.872},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88700000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510340,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311536,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060304,"statfs":{"total":96636764160,"available":96317751296,"internally_reserved":0,"allocated":2007040,"data_stored":992835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.81999999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.66500000000000004,"5min":0.748,"15min":0.77900000000000003},"last":0.502}]},{"osd":1,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.875},"last":0.47199999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.877},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.51700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93799999999999994,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.95899999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.624,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0389999999999999,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":1.006}]},{"osd":6,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.63600000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.079,"5min":1.218,"15min":1.218},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.63300000000000001,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.177,"15min":1.177},"last":0.80000000000000004}]},{"osd":7,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.81899999999999995}]}]},{"osd":4,"up_from":14,"seq":60129543045,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311532,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060308,"statfs":{"total":96636764160,"available":96317755392,"internally_reserved":0,"allocated":2002944,"data_stored":992745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96499999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.46200000000000002},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.99099999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":0.95299999999999996,"15min":1.135},"last":0.71299999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.996},"last":0.73099999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"max":{"1min":0.95399999999999996,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.79900000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.97299999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.73999999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39100000000000001},"max":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.94799999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.052,"15min":1.052},"last":0.754}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":0.94899999999999995,"5min":1.018,"15min":1.0649999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94799999999999995,"15min":1.028},"last":0.77100000000000002}]}]},{"osd":5,"up_from":14,"seq":60129543043,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311536,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060304,"statfs":{"total":96636764160,"available":96317751296,"internally_reserved":0,"allocated":2007040,"data_stored":992787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.626},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.93899999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:17:51.200 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:17:51.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.391+0000 7f1b69bff700 1 Processor -- start 2023-10-10T22:17:51.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.391+0000 7f1b69bff700 1 -- start start 2023-10-10T22:17:51.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.392+0000 7f1b69bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 0x7f1b640ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.392+0000 7f1b69bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1b640ccf90 0x7f1b640b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.392+0000 7f1b69bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640cc300 con 0x7f1b6415a270 2023-10-10T22:17:51.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.392+0000 7f1b69bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b64156bf0 con 0x7f1b640ccf90 2023-10-10T22:17:51.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.392+0000 7f1b69bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640ae950 con 0x7f1b640cbf30 2023-10-10T22:17:51.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b63fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1b6415a270 0x7f1b640c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38864/0 (socket says 172.21.15.154:38864) 2023-10-10T22:17:51.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b63fff700 1 -- 172.21.15.154:0/2186797486 learned_addr learned my addr 172.21.15.154:0/2186797486 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b62ffd700 1 --2- 172.21.15.154:0/2186797486 >> v2:172.21.15.179:3300/0 conn(0x7f1b640ccf90 0x7f1b640b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b637fe700 1 --2- 172.21.15.154:0/2186797486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 0x7f1b640ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b627fc700 1 -- 172.21.15.154:0/2186797486 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059230044 0 0) 0x7f1b640cc300 con 0x7f1b6415a270 2023-10-10T22:17:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b627fc700 1 -- 172.21.15.154:0/2186797486 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b4c003570 con 0x7f1b6415a270 2023-10-10T22:17:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b627fc700 1 -- 172.21.15.154:0/2186797486 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3230642989 0 0) 0x7f1b4c003570 con 0x7f1b6415a270 2023-10-10T22:17:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b62ffd700 1 -- 172.21.15.154:0/2186797486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 msgr2=0x7f1b640ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b62ffd700 1 --2- 172.21.15.154:0/2186797486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 0x7f1b640ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b62ffd700 1 -- 172.21.15.154:0/2186797486 >> v1:172.21.15.154:6789/0 conn(0x7f1b6415a270 legacy=0x7f1b640c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.393+0000 7f1b62ffd700 1 -- 172.21.15.154:0/2186797486 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640ad370 con 0x7f1b640ccf90 2023-10-10T22:17:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.394+0000 7f1b62ffd700 1 --2- 172.21.15.154:0/2186797486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 0x7f1b640b0d10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009910 tx=0x7f1b580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71ce7d130fb29d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.394+0000 7f1b627fc700 1 -- 172.21.15.154:0/2186797486 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0017f0 con 0x7f1b640ccf90 2023-10-10T22:17:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.394+0000 7f1b627fc700 1 -- 172.21.15.154:0/2186797486 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58011420 con 0x7f1b640ccf90 2023-10-10T22:17:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.394+0000 7f1b627fc700 1 -- 172.21.15.154:0/2186797486 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580117a0 con 0x7f1b640ccf90 2023-10-10T22:17:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.395+0000 7f1b69bff700 1 -- 172.21.15.154:0/2186797486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 msgr2=0x7f1b640b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.395+0000 7f1b69bff700 1 --2- 172.21.15.154:0/2186797486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 0x7f1b640b0d10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009910 tx=0x7f1b580091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.395+0000 7f1b69bff700 1 -- 172.21.15.154:0/2186797486 shutdown_connections 2023-10-10T22:17:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.395+0000 7f1b69bff700 1 --2- 172.21.15.154:0/2186797486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 0x7f1b640ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.395+0000 7f1b69bff700 1 --2- 172.21.15.154:0/2186797486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 0x7f1b640b0d10 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.395+0000 7f1b69bff700 1 -- 172.21.15.154:0/2186797486 >> 172.21.15.154:0/2186797486 conn(0x7f1b6406a320 msgr2=0x7f1b640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:51.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.395+0000 7f1b69bff700 1 -- 172.21.15.154:0/2186797486 shutdown_connections 2023-10-10T22:17:51.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.395+0000 7f1b69bff700 1 -- 172.21.15.154:0/2186797486 wait complete. 2023-10-10T22:17:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.396+0000 7f1b69bff700 1 Processor -- start 2023-10-10T22:17:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.397+0000 7f1b69bff700 1 -- start start 2023-10-10T22:17:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.397+0000 7f1b69bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 0x7f1b6406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.397+0000 7f1b69bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 0x7f1b64158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.397+0000 7f1b69bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b6415a270 0x7f1b64156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.397+0000 7f1b69bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64155c10 con 0x7f1b6415a270 2023-10-10T22:17:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.397+0000 7f1b69bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64155ef0 con 0x7f1b640ccf90 2023-10-10T22:17:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.397+0000 7f1b69bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641561d0 con 0x7f1b640cbf30 2023-10-10T22:17:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b63fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b6415a270 0x7f1b64156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b63fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b6415a270 0x7f1b64156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56256/0 (socket says 172.21.15.154:56256) 2023-10-10T22:17:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b63fff700 1 -- 172.21.15.154:0/871543695 learned_addr learned my addr 172.21.15.154:0/871543695 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b62ffd700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 0x7f1b64158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b637fe700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 0x7f1b6406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b63fff700 1 -- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 msgr2=0x7f1b6406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b63fff700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 0x7f1b6406ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b63fff700 1 -- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 msgr2=0x7f1b64158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b63fff700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 0x7f1b64158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b63fff700 1 -- 172.21.15.154:0/871543695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b58009420 con 0x7f1b6415a270 2023-10-10T22:17:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b62ffd700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 0x7f1b64158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b637fe700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 0x7f1b6406ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.398+0000 7f1b63fff700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b6415a270 0x7f1b64156d30 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00cc10 tx=0x7f1b5c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.399+0000 7f1b4b7fe700 1 -- 172.21.15.154:0/871543695 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c004dc0 con 0x7f1b6415a270 2023-10-10T22:17:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.399+0000 7f1b4b7fe700 1 -- 172.21.15.154:0/871543695 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00a670 con 0x7f1b6415a270 2023-10-10T22:17:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.399+0000 7f1b4b7fe700 1 -- 172.21.15.154:0/871543695 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00aa30 con 0x7f1b6415a270 2023-10-10T22:17:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.399+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b641564b0 con 0x7f1b6415a270 2023-10-10T22:17:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.399+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6406f1a0 con 0x7f1b6415a270 2023-10-10T22:17:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.400+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6404c3c0 con 0x7f1b6415a270 2023-10-10T22:17:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.401+0000 7f1b4b7fe700 1 -- 172.21.15.154:0/871543695 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b5c007150 con 0x7f1b6415a270 2023-10-10T22:17:51.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.401+0000 7f1b4b7fe700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b50066f30 0x7f1b500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.401+0000 7f1b4b7fe700 1 -- 172.21.15.154:0/871543695 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f1b5c083f00 con 0x7f1b6415a270 2023-10-10T22:17:51.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.402+0000 7f1b637fe700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b50066f30 0x7f1b500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.402+0000 7f1b637fe700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b50066f30 0x7f1b500693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b54006f00 tx=0x7f1b54008040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:51.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.406+0000 7f1b4b7fe700 1 -- 172.21.15.154:0/871543695 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b5c050f80 con 0x7f1b6415a270 2023-10-10T22:17:51.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.596+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b6406f8a0 con 0x7f1b50066f30 2023-10-10T22:17:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.605+0000 7f1b4b7fe700 1 -- 172.21.15.154:0/871543695 <== mgr.8481 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289497 (secure 0 0 0) 0x7f1b6406f8a0 con 0x7f1b50066f30 2023-10-10T22:17:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b50066f30 msgr2=0x7f1b500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b50066f30 0x7f1b500693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b54006f00 tx=0x7f1b54008040 comp rx=0 tx=0).stop 2023-10-10T22:17:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b6415a270 msgr2=0x7f1b64156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b6415a270 0x7f1b64156d30 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00cc10 tx=0x7f1b5c007c70 comp rx=0 tx=0).stop 2023-10-10T22:17:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 shutdown_connections 2023-10-10T22:17:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b50066f30 0x7f1b500693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b6415a270 0x7f1b64156d30 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b640cbf30 0x7f1b6406ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 --2- 172.21.15.154:0/871543695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b640ccf90 0x7f1b64158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 >> 172.21.15.154:0/871543695 conn(0x7f1b6406a320 msgr2=0x7f1b64150ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:51.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.609+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 shutdown_connections 2023-10-10T22:17:51.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.610+0000 7f1b69bff700 1 -- 172.21.15.154:0/871543695 wait complete. 2023-10-10T22:17:51.615 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:17:51.628 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-10T22:17:51.472137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2477064,"kb_used_data":16840,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752497656,"statfs":{"total":773094113280,"available":770557599744,"internally_reserved":0,"allocated":17244160,"data_stored":9126748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.953751"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.531966+0000","last_change":"2023-10-10T22:17:41.530493+0000","last_active":"2023-10-10T22:17:41.531966+0000","last_peered":"2023-10-10T22:17:41.531966+0000","last_clean":"2023-10-10T22:17:41.531966+0000","last_became_active":"2023-10-10T22:17:41.530235+0000","last_became_peered":"2023-10-10T22:17:41.530235+0000","last_unstale":"2023-10-10T22:17:41.531966+0000","last_undegraded":"2023-10-10T22:17:41.531966+0000","last_fullsized":"2023-10-10T22:17:41.531966+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:35:24.719789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540551+0000","last_change":"2023-10-10T22:17:41.538049+0000","last_active":"2023-10-10T22:17:41.540551+0000","last_peered":"2023-10-10T22:17:41.540551+0000","last_clean":"2023-10-10T22:17:41.540551+0000","last_became_active":"2023-10-10T22:17:41.537748+0000","last_became_peered":"2023-10-10T22:17:41.537748+0000","last_unstale":"2023-10-10T22:17:41.540551+0000","last_undegraded":"2023-10-10T22:17:41.540551+0000","last_fullsized":"2023-10-10T22:17:41.540551+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:29:05.558529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548476+0000","last_change":"2023-10-10T22:17:41.544553+0000","last_active":"2023-10-10T22:17:41.548476+0000","last_peered":"2023-10-10T22:17:41.548476+0000","last_clean":"2023-10-10T22:17:41.548476+0000","last_became_active":"2023-10-10T22:17:41.544256+0000","last_became_peered":"2023-10-10T22:17:41.544256+0000","last_unstale":"2023-10-10T22:17:41.548476+0000","last_undegraded":"2023-10-10T22:17:41.548476+0000","last_fullsized":"2023-10-10T22:17:41.548476+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:10:49.360798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540057+0000","last_change":"2023-10-10T22:17:41.537068+0000","last_active":"2023-10-10T22:17:41.540057+0000","last_peered":"2023-10-10T22:17:41.540057+0000","last_clean":"2023-10-10T22:17:41.540057+0000","last_became_active":"2023-10-10T22:17:41.536820+0000","last_became_peered":"2023-10-10T22:17:41.536820+0000","last_unstale":"2023-10-10T22:17:41.540057+0000","last_undegraded":"2023-10-10T22:17:41.540057+0000","last_fullsized":"2023-10-10T22:17:41.540057+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:56:19.393778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.544051+0000","last_change":"2023-10-10T22:17:41.542581+0000","last_active":"2023-10-10T22:17:41.544051+0000","last_peered":"2023-10-10T22:17:41.544051+0000","last_clean":"2023-10-10T22:17:41.544051+0000","last_became_active":"2023-10-10T22:17:41.542309+0000","last_became_peered":"2023-10-10T22:17:41.542309+0000","last_unstale":"2023-10-10T22:17:41.544051+0000","last_undegraded":"2023-10-10T22:17:41.544051+0000","last_fullsized":"2023-10-10T22:17:41.544051+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:36:56.976437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.537378+0000","last_change":"2023-10-10T22:17:41.533556+0000","last_active":"2023-10-10T22:17:41.537378+0000","last_peered":"2023-10-10T22:17:41.537378+0000","last_clean":"2023-10-10T22:17:41.537378+0000","last_became_active":"2023-10-10T22:17:41.533286+0000","last_became_peered":"2023-10-10T22:17:41.533286+0000","last_unstale":"2023-10-10T22:17:41.537378+0000","last_undegraded":"2023-10-10T22:17:41.537378+0000","last_fullsized":"2023-10-10T22:17:41.537378+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:53.905230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541920+0000","last_change":"2023-10-10T22:17:41.539971+0000","last_active":"2023-10-10T22:17:41.541920+0000","last_peered":"2023-10-10T22:17:41.541920+0000","last_clean":"2023-10-10T22:17:41.541920+0000","last_became_active":"2023-10-10T22:17:41.539736+0000","last_became_peered":"2023-10-10T22:17:41.539736+0000","last_unstale":"2023-10-10T22:17:41.541920+0000","last_undegraded":"2023-10-10T22:17:41.541920+0000","last_fullsized":"2023-10-10T22:17:41.541920+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:49.853877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.544816+0000","last_change":"2023-10-10T22:17:41.540815+0000","last_active":"2023-10-10T22:17:41.544816+0000","last_peered":"2023-10-10T22:17:41.544816+0000","last_clean":"2023-10-10T22:17:41.544816+0000","last_became_active":"2023-10-10T22:17:41.540538+0000","last_became_peered":"2023-10-10T22:17:41.540538+0000","last_unstale":"2023-10-10T22:17:41.544816+0000","last_undegraded":"2023-10-10T22:17:41.544816+0000","last_fullsized":"2023-10-10T22:17:41.544816+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:30.867094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548362+0000","last_change":"2023-10-10T22:17:41.543736+0000","last_active":"2023-10-10T22:17:41.548362+0000","last_peered":"2023-10-10T22:17:41.548362+0000","last_clean":"2023-10-10T22:17:41.548362+0000","last_became_active":"2023-10-10T22:17:41.543422+0000","last_became_peered":"2023-10-10T22:17:41.543422+0000","last_unstale":"2023-10-10T22:17:41.548362+0000","last_undegraded":"2023-10-10T22:17:41.548362+0000","last_fullsized":"2023-10-10T22:17:41.548362+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:09.353574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542224+0000","last_change":"2023-10-10T22:17:41.538079+0000","last_active":"2023-10-10T22:17:41.542224+0000","last_peered":"2023-10-10T22:17:41.542224+0000","last_clean":"2023-10-10T22:17:41.542224+0000","last_became_active":"2023-10-10T22:17:41.537862+0000","last_became_peered":"2023-10-10T22:17:41.537862+0000","last_unstale":"2023-10-10T22:17:41.542224+0000","last_undegraded":"2023-10-10T22:17:41.542224+0000","last_fullsized":"2023-10-10T22:17:41.542224+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:02:21.807733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.533830+0000","last_change":"2023-10-10T22:17:41.529328+0000","last_active":"2023-10-10T22:17:41.533830+0000","last_peered":"2023-10-10T22:17:41.533830+0000","last_clean":"2023-10-10T22:17:41.533830+0000","last_became_active":"2023-10-10T22:17:41.529071+0000","last_became_peered":"2023-10-10T22:17:41.529071+0000","last_unstale":"2023-10-10T22:17:41.533830+0000","last_undegraded":"2023-10-10T22:17:41.533830+0000","last_fullsized":"2023-10-10T22:17:41.533830+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:11:30.561209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548291+0000","last_change":"2023-10-10T22:17:41.543597+0000","last_active":"2023-10-10T22:17:41.548291+0000","last_peered":"2023-10-10T22:17:41.548291+0000","last_clean":"2023-10-10T22:17:41.548291+0000","last_became_active":"2023-10-10T22:17:41.541134+0000","last_became_peered":"2023-10-10T22:17:41.541134+0000","last_unstale":"2023-10-10T22:17:41.548291+0000","last_undegraded":"2023-10-10T22:17:41.548291+0000","last_fullsized":"2023-10-10T22:17:41.548291+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:10.790081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532794+0000","last_change":"2023-10-10T22:17:41.530840+0000","last_active":"2023-10-10T22:17:41.532794+0000","last_peered":"2023-10-10T22:17:41.532794+0000","last_clean":"2023-10-10T22:17:41.532794+0000","last_became_active":"2023-10-10T22:17:41.530477+0000","last_became_peered":"2023-10-10T22:17:41.530477+0000","last_unstale":"2023-10-10T22:17:41.532794+0000","last_undegraded":"2023-10-10T22:17:41.532794+0000","last_fullsized":"2023-10-10T22:17:41.532794+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:13:59.310305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.535724+0000","last_change":"2023-10-10T22:17:41.533690+0000","last_active":"2023-10-10T22:17:41.535724+0000","last_peered":"2023-10-10T22:17:41.535724+0000","last_clean":"2023-10-10T22:17:41.535724+0000","last_became_active":"2023-10-10T22:17:41.533420+0000","last_became_peered":"2023-10-10T22:17:41.533420+0000","last_unstale":"2023-10-10T22:17:41.535724+0000","last_undegraded":"2023-10-10T22:17:41.535724+0000","last_fullsized":"2023-10-10T22:17:41.535724+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:26:59.996772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541755+0000","last_change":"2023-10-10T22:17:41.539487+0000","last_active":"2023-10-10T22:17:41.541755+0000","last_peered":"2023-10-10T22:17:41.541755+0000","last_clean":"2023-10-10T22:17:41.541755+0000","last_became_active":"2023-10-10T22:17:41.539158+0000","last_became_peered":"2023-10-10T22:17:41.539158+0000","last_unstale":"2023-10-10T22:17:41.541755+0000","last_undegraded":"2023-10-10T22:17:41.541755+0000","last_fullsized":"2023-10-10T22:17:41.541755+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:45:13.933778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.533844+0000","last_change":"2023-10-10T22:17:41.530171+0000","last_active":"2023-10-10T22:17:41.533844+0000","last_peered":"2023-10-10T22:17:41.533844+0000","last_clean":"2023-10-10T22:17:41.533844+0000","last_became_active":"2023-10-10T22:17:41.529910+0000","last_became_peered":"2023-10-10T22:17:41.529910+0000","last_unstale":"2023-10-10T22:17:41.533844+0000","last_undegraded":"2023-10-10T22:17:41.533844+0000","last_fullsized":"2023-10-10T22:17:41.533844+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:58:02.888057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540889+0000","last_change":"2023-10-10T22:17:41.535490+0000","last_active":"2023-10-10T22:17:41.540889+0000","last_peered":"2023-10-10T22:17:41.540889+0000","last_clean":"2023-10-10T22:17:41.540889+0000","last_became_active":"2023-10-10T22:17:41.535147+0000","last_became_peered":"2023-10-10T22:17:41.535147+0000","last_unstale":"2023-10-10T22:17:41.540889+0000","last_undegraded":"2023-10-10T22:17:41.540889+0000","last_fullsized":"2023-10-10T22:17:41.540889+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:22.533771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532002+0000","last_change":"2023-10-10T22:17:41.529016+0000","last_active":"2023-10-10T22:17:41.532002+0000","last_peered":"2023-10-10T22:17:41.532002+0000","last_clean":"2023-10-10T22:17:41.532002+0000","last_became_active":"2023-10-10T22:17:41.528727+0000","last_became_peered":"2023-10-10T22:17:41.528727+0000","last_unstale":"2023-10-10T22:17:41.532002+0000","last_undegraded":"2023-10-10T22:17:41.532002+0000","last_fullsized":"2023-10-10T22:17:41.532002+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:49.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.530222+0000","last_change":"2023-10-10T22:17:41.527792+0000","last_active":"2023-10-10T22:17:41.530222+0000","last_peered":"2023-10-10T22:17:41.530222+0000","last_clean":"2023-10-10T22:17:41.530222+0000","last_became_active":"2023-10-10T22:17:41.527507+0000","last_became_peered":"2023-10-10T22:17:41.527507+0000","last_unstale":"2023-10-10T22:17:41.530222+0000","last_undegraded":"2023-10-10T22:17:41.530222+0000","last_fullsized":"2023-10-10T22:17:41.530222+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:05:32.090579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532268+0000","last_change":"2023-10-10T22:17:41.530276+0000","last_active":"2023-10-10T22:17:41.532268+0000","last_peered":"2023-10-10T22:17:41.532268+0000","last_clean":"2023-10-10T22:17:41.532268+0000","last_became_active":"2023-10-10T22:17:41.529392+0000","last_became_peered":"2023-10-10T22:17:41.529392+0000","last_unstale":"2023-10-10T22:17:41.532268+0000","last_undegraded":"2023-10-10T22:17:41.532268+0000","last_fullsized":"2023-10-10T22:17:41.532268+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:34:33.635001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547488+0000","last_change":"2023-10-10T22:17:41.544635+0000","last_active":"2023-10-10T22:17:41.547488+0000","last_peered":"2023-10-10T22:17:41.547488+0000","last_clean":"2023-10-10T22:17:41.547488+0000","last_became_active":"2023-10-10T22:17:41.544336+0000","last_became_peered":"2023-10-10T22:17:41.544336+0000","last_unstale":"2023-10-10T22:17:41.547488+0000","last_undegraded":"2023-10-10T22:17:41.547488+0000","last_fullsized":"2023-10-10T22:17:41.547488+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:09:21.333392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532705+0000","last_change":"2023-10-10T22:17:41.530376+0000","last_active":"2023-10-10T22:17:41.532705+0000","last_peered":"2023-10-10T22:17:41.532705+0000","last_clean":"2023-10-10T22:17:41.532705+0000","last_became_active":"2023-10-10T22:17:41.530081+0000","last_became_peered":"2023-10-10T22:17:41.530081+0000","last_unstale":"2023-10-10T22:17:41.532705+0000","last_undegraded":"2023-10-10T22:17:41.532705+0000","last_fullsized":"2023-10-10T22:17:41.532705+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:01:41.323483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548054+0000","last_change":"2023-10-10T22:17:41.542993+0000","last_active":"2023-10-10T22:17:41.548054+0000","last_peered":"2023-10-10T22:17:41.548054+0000","last_clean":"2023-10-10T22:17:41.548054+0000","last_became_active":"2023-10-10T22:17:41.542713+0000","last_became_peered":"2023-10-10T22:17:41.542713+0000","last_unstale":"2023-10-10T22:17:41.548054+0000","last_undegraded":"2023-10-10T22:17:41.548054+0000","last_fullsized":"2023-10-10T22:17:41.548054+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:13:55.928526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.530373+0000","last_change":"2023-10-10T22:17:41.527841+0000","last_active":"2023-10-10T22:17:41.530373+0000","last_peered":"2023-10-10T22:17:41.530373+0000","last_clean":"2023-10-10T22:17:41.530373+0000","last_became_active":"2023-10-10T22:17:41.526489+0000","last_became_peered":"2023-10-10T22:17:41.526489+0000","last_unstale":"2023-10-10T22:17:41.530373+0000","last_undegraded":"2023-10-10T22:17:41.530373+0000","last_fullsized":"2023-10-10T22:17:41.530373+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:50:13.629731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542256+0000","last_change":"2023-10-10T22:17:41.538163+0000","last_active":"2023-10-10T22:17:41.542256+0000","last_peered":"2023-10-10T22:17:41.542256+0000","last_clean":"2023-10-10T22:17:41.542256+0000","last_became_active":"2023-10-10T22:17:41.537868+0000","last_became_peered":"2023-10-10T22:17:41.537868+0000","last_unstale":"2023-10-10T22:17:41.542256+0000","last_undegraded":"2023-10-10T22:17:41.542256+0000","last_fullsized":"2023-10-10T22:17:41.542256+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:00:45.578845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.533902+0000","last_change":"2023-10-10T22:17:41.532125+0000","last_active":"2023-10-10T22:17:41.533902+0000","last_peered":"2023-10-10T22:17:41.533902+0000","last_clean":"2023-10-10T22:17:41.533902+0000","last_became_active":"2023-10-10T22:17:41.531829+0000","last_became_peered":"2023-10-10T22:17:41.531829+0000","last_unstale":"2023-10-10T22:17:41.533902+0000","last_undegraded":"2023-10-10T22:17:41.533902+0000","last_fullsized":"2023-10-10T22:17:41.533902+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:46:05.278586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532118+0000","last_change":"2023-10-10T22:17:41.531206+0000","last_active":"2023-10-10T22:17:41.532118+0000","last_peered":"2023-10-10T22:17:41.532118+0000","last_clean":"2023-10-10T22:17:41.532118+0000","last_became_active":"2023-10-10T22:17:41.530738+0000","last_became_peered":"2023-10-10T22:17:41.530738+0000","last_unstale":"2023-10-10T22:17:41.532118+0000","last_undegraded":"2023-10-10T22:17:41.532118+0000","last_fullsized":"2023-10-10T22:17:41.532118+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:45:34.893282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539537+0000","last_change":"2023-10-10T22:17:41.530526+0000","last_active":"2023-10-10T22:17:41.539537+0000","last_peered":"2023-10-10T22:17:41.539537+0000","last_clean":"2023-10-10T22:17:41.539537+0000","last_became_active":"2023-10-10T22:17:41.530237+0000","last_became_peered":"2023-10-10T22:17:41.530237+0000","last_unstale":"2023-10-10T22:17:41.539537+0000","last_undegraded":"2023-10-10T22:17:41.539537+0000","last_fullsized":"2023-10-10T22:17:41.539537+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:16.163238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541673+0000","last_change":"2023-10-10T22:17:41.539233+0000","last_active":"2023-10-10T22:17:41.541673+0000","last_peered":"2023-10-10T22:17:41.541673+0000","last_clean":"2023-10-10T22:17:41.541673+0000","last_became_active":"2023-10-10T22:17:41.538972+0000","last_became_peered":"2023-10-10T22:17:41.538972+0000","last_unstale":"2023-10-10T22:17:41.541673+0000","last_undegraded":"2023-10-10T22:17:41.541673+0000","last_fullsized":"2023-10-10T22:17:41.541673+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:45:22.564420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542329+0000","last_change":"2023-10-10T22:17:41.539989+0000","last_active":"2023-10-10T22:17:41.542329+0000","last_peered":"2023-10-10T22:17:41.542329+0000","last_clean":"2023-10-10T22:17:41.542329+0000","last_became_active":"2023-10-10T22:17:41.539689+0000","last_became_peered":"2023-10-10T22:17:41.539689+0000","last_unstale":"2023-10-10T22:17:41.542329+0000","last_undegraded":"2023-10-10T22:17:41.542329+0000","last_fullsized":"2023-10-10T22:17:41.542329+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:30.434471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.543979+0000","last_change":"2023-10-10T22:17:41.540777+0000","last_active":"2023-10-10T22:17:41.543979+0000","last_peered":"2023-10-10T22:17:41.543979+0000","last_clean":"2023-10-10T22:17:41.543979+0000","last_became_active":"2023-10-10T22:17:41.540513+0000","last_became_peered":"2023-10-10T22:17:41.540513+0000","last_unstale":"2023-10-10T22:17:41.543979+0000","last_undegraded":"2023-10-10T22:17:41.543979+0000","last_fullsized":"2023-10-10T22:17:41.543979+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:11:05.414135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541005+0000","last_change":"2023-10-10T22:17:41.536849+0000","last_active":"2023-10-10T22:17:41.541005+0000","last_peered":"2023-10-10T22:17:41.541005+0000","last_clean":"2023-10-10T22:17:41.541005+0000","last_became_active":"2023-10-10T22:17:41.535973+0000","last_became_peered":"2023-10-10T22:17:41.535973+0000","last_unstale":"2023-10-10T22:17:41.541005+0000","last_undegraded":"2023-10-10T22:17:41.541005+0000","last_fullsized":"2023-10-10T22:17:41.541005+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:38:48.758613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.529385+0000","last_change":"2023-10-10T22:17:41.527561+0000","last_active":"2023-10-10T22:17:41.529385+0000","last_peered":"2023-10-10T22:17:41.529385+0000","last_clean":"2023-10-10T22:17:41.529385+0000","last_became_active":"2023-10-10T22:17:41.526669+0000","last_became_peered":"2023-10-10T22:17:41.526669+0000","last_unstale":"2023-10-10T22:17:41.529385+0000","last_undegraded":"2023-10-10T22:17:41.529385+0000","last_fullsized":"2023-10-10T22:17:41.529385+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:25:30.978397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"160'4","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.987748+0000","last_change":"2023-10-10T22:17:40.521516+0000","last_active":"2023-10-10T22:17:41.987748+0000","last_peered":"2023-10-10T22:17:41.987748+0000","last_clean":"2023-10-10T22:17:41.987748+0000","last_became_active":"2023-10-10T22:17:40.521209+0000","last_became_peered":"2023-10-10T22:17:40.521209+0000","last_unstale":"2023-10-10T22:17:41.987748+0000","last_undegraded":"2023-10-10T22:17:41.987748+0000","last_fullsized":"2023-10-10T22:17:41.987748+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:08.347918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.544927+0000","last_change":"2023-10-10T22:17:41.541813+0000","last_active":"2023-10-10T22:17:41.544927+0000","last_peered":"2023-10-10T22:17:41.544927+0000","last_clean":"2023-10-10T22:17:41.544927+0000","last_became_active":"2023-10-10T22:17:41.541557+0000","last_became_peered":"2023-10-10T22:17:41.541557+0000","last_unstale":"2023-10-10T22:17:41.544927+0000","last_undegraded":"2023-10-10T22:17:41.544927+0000","last_fullsized":"2023-10-10T22:17:41.544927+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:02:23.359264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.985098+0000","last_change":"2023-10-10T22:17:40.525121+0000","last_active":"2023-10-10T22:17:41.985098+0000","last_peered":"2023-10-10T22:17:41.985098+0000","last_clean":"2023-10-10T22:17:41.985098+0000","last_became_active":"2023-10-10T22:17:40.524744+0000","last_became_peered":"2023-10-10T22:17:40.524744+0000","last_unstale":"2023-10-10T22:17:41.985098+0000","last_undegraded":"2023-10-10T22:17:41.985098+0000","last_fullsized":"2023-10-10T22:17:41.985098+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:38:47.752957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547462+0000","last_change":"2023-10-10T22:17:41.543714+0000","last_active":"2023-10-10T22:17:41.547462+0000","last_peered":"2023-10-10T22:17:41.547462+0000","last_clean":"2023-10-10T22:17:41.547462+0000","last_became_active":"2023-10-10T22:17:41.543401+0000","last_became_peered":"2023-10-10T22:17:41.543401+0000","last_unstale":"2023-10-10T22:17:41.547462+0000","last_undegraded":"2023-10-10T22:17:41.547462+0000","last_fullsized":"2023-10-10T22:17:41.547462+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:56:31.177125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.988040+0000","last_change":"2023-10-10T22:17:40.520121+0000","last_active":"2023-10-10T22:17:41.988040+0000","last_peered":"2023-10-10T22:17:41.988040+0000","last_clean":"2023-10-10T22:17:41.988040+0000","last_became_active":"2023-10-10T22:17:40.519856+0000","last_became_peered":"2023-10-10T22:17:40.519856+0000","last_unstale":"2023-10-10T22:17:41.988040+0000","last_undegraded":"2023-10-10T22:17:41.988040+0000","last_fullsized":"2023-10-10T22:17:41.988040+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:48.848221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539052+0000","last_change":"2023-10-10T22:17:41.537816+0000","last_active":"2023-10-10T22:17:41.539052+0000","last_peered":"2023-10-10T22:17:41.539052+0000","last_clean":"2023-10-10T22:17:41.539052+0000","last_became_active":"2023-10-10T22:17:41.537413+0000","last_became_peered":"2023-10-10T22:17:41.537413+0000","last_unstale":"2023-10-10T22:17:41.539052+0000","last_undegraded":"2023-10-10T22:17:41.539052+0000","last_fullsized":"2023-10-10T22:17:41.539052+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:19:20.573974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.985348+0000","last_change":"2023-10-10T22:17:40.525803+0000","last_active":"2023-10-10T22:17:41.985348+0000","last_peered":"2023-10-10T22:17:41.985348+0000","last_clean":"2023-10-10T22:17:41.985348+0000","last_became_active":"2023-10-10T22:17:40.525551+0000","last_became_peered":"2023-10-10T22:17:40.525551+0000","last_unstale":"2023-10-10T22:17:41.985348+0000","last_undegraded":"2023-10-10T22:17:41.985348+0000","last_fullsized":"2023-10-10T22:17:41.985348+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:37:24.923020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.531146+0000","last_change":"2023-10-10T22:17:41.528145+0000","last_active":"2023-10-10T22:17:41.531146+0000","last_peered":"2023-10-10T22:17:41.531146+0000","last_clean":"2023-10-10T22:17:41.531146+0000","last_became_active":"2023-10-10T22:17:41.527876+0000","last_became_peered":"2023-10-10T22:17:41.527876+0000","last_unstale":"2023-10-10T22:17:41.531146+0000","last_undegraded":"2023-10-10T22:17:41.531146+0000","last_fullsized":"2023-10-10T22:17:41.531146+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:03:25.095890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.988089+0000","last_change":"2023-10-10T22:17:40.523083+0000","last_active":"2023-10-10T22:17:41.988089+0000","last_peered":"2023-10-10T22:17:41.988089+0000","last_clean":"2023-10-10T22:17:41.988089+0000","last_became_active":"2023-10-10T22:17:40.522804+0000","last_became_peered":"2023-10-10T22:17:40.522804+0000","last_unstale":"2023-10-10T22:17:41.988089+0000","last_undegraded":"2023-10-10T22:17:41.988089+0000","last_fullsized":"2023-10-10T22:17:41.988089+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:19:40.576438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540954+0000","last_change":"2023-10-10T22:17:41.536099+0000","last_active":"2023-10-10T22:17:41.540954+0000","last_peered":"2023-10-10T22:17:41.540954+0000","last_clean":"2023-10-10T22:17:41.540954+0000","last_became_active":"2023-10-10T22:17:41.535753+0000","last_became_peered":"2023-10-10T22:17:41.535753+0000","last_unstale":"2023-10-10T22:17:41.540954+0000","last_undegraded":"2023-10-10T22:17:41.540954+0000","last_fullsized":"2023-10-10T22:17:41.540954+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:30.867094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.987751+0000","last_change":"2023-10-10T22:17:40.518844+0000","last_active":"2023-10-10T22:17:41.987751+0000","last_peered":"2023-10-10T22:17:41.987751+0000","last_clean":"2023-10-10T22:17:41.987751+0000","last_became_active":"2023-10-10T22:17:40.518596+0000","last_became_peered":"2023-10-10T22:17:40.518596+0000","last_unstale":"2023-10-10T22:17:41.987751+0000","last_undegraded":"2023-10-10T22:17:41.987751+0000","last_fullsized":"2023-10-10T22:17:41.987751+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:10:08.155250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540908+0000","last_change":"2023-10-10T22:17:41.538916+0000","last_active":"2023-10-10T22:17:41.540908+0000","last_peered":"2023-10-10T22:17:41.540908+0000","last_clean":"2023-10-10T22:17:41.540908+0000","last_became_active":"2023-10-10T22:17:41.538660+0000","last_became_peered":"2023-10-10T22:17:41.538660+0000","last_unstale":"2023-10-10T22:17:41.540908+0000","last_undegraded":"2023-10-10T22:17:41.540908+0000","last_fullsized":"2023-10-10T22:17:41.540908+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:58.986978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.524705+0000","last_change":"2023-10-10T22:17:40.520243+0000","last_active":"2023-10-10T22:17:41.524705+0000","last_peered":"2023-10-10T22:17:41.524705+0000","last_clean":"2023-10-10T22:17:41.524705+0000","last_became_active":"2023-10-10T22:17:40.519962+0000","last_became_peered":"2023-10-10T22:17:40.519962+0000","last_unstale":"2023-10-10T22:17:41.524705+0000","last_undegraded":"2023-10-10T22:17:41.524705+0000","last_fullsized":"2023-10-10T22:17:41.524705+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:41:03.639868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.534350+0000","last_change":"2023-10-10T22:17:41.531558+0000","last_active":"2023-10-10T22:17:41.534350+0000","last_peered":"2023-10-10T22:17:41.534350+0000","last_clean":"2023-10-10T22:17:41.534350+0000","last_became_active":"2023-10-10T22:17:41.531301+0000","last_became_peered":"2023-10-10T22:17:41.531301+0000","last_unstale":"2023-10-10T22:17:41.534350+0000","last_undegraded":"2023-10-10T22:17:41.534350+0000","last_fullsized":"2023-10-10T22:17:41.534350+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:35:41.592341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.524254+0000","last_change":"2023-10-10T22:17:40.521793+0000","last_active":"2023-10-10T22:17:41.524254+0000","last_peered":"2023-10-10T22:17:41.524254+0000","last_clean":"2023-10-10T22:17:41.524254+0000","last_became_active":"2023-10-10T22:17:40.521545+0000","last_became_peered":"2023-10-10T22:17:40.521545+0000","last_unstale":"2023-10-10T22:17:41.524254+0000","last_undegraded":"2023-10-10T22:17:41.524254+0000","last_fullsized":"2023-10-10T22:17:41.524254+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:11.877300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.537911+0000","last_change":"2023-10-10T22:17:41.531558+0000","last_active":"2023-10-10T22:17:41.537911+0000","last_peered":"2023-10-10T22:17:41.537911+0000","last_clean":"2023-10-10T22:17:41.537911+0000","last_became_active":"2023-10-10T22:17:41.531311+0000","last_became_peered":"2023-10-10T22:17:41.531311+0000","last_unstale":"2023-10-10T22:17:41.537911+0000","last_undegraded":"2023-10-10T22:17:41.537911+0000","last_fullsized":"2023-10-10T22:17:41.537911+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:23:02.704929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.524578+0000","last_change":"2023-10-10T22:17:40.522177+0000","last_active":"2023-10-10T22:17:41.524578+0000","last_peered":"2023-10-10T22:17:41.524578+0000","last_clean":"2023-10-10T22:17:41.524578+0000","last_became_active":"2023-10-10T22:17:40.521826+0000","last_became_peered":"2023-10-10T22:17:40.521826+0000","last_unstale":"2023-10-10T22:17:41.524578+0000","last_undegraded":"2023-10-10T22:17:41.524578+0000","last_fullsized":"2023-10-10T22:17:41.524578+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:21.528115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539459+0000","last_change":"2023-10-10T22:17:41.531273+0000","last_active":"2023-10-10T22:17:41.539459+0000","last_peered":"2023-10-10T22:17:41.539459+0000","last_clean":"2023-10-10T22:17:41.539459+0000","last_became_active":"2023-10-10T22:17:41.531013+0000","last_became_peered":"2023-10-10T22:17:41.531013+0000","last_unstale":"2023-10-10T22:17:41.539459+0000","last_undegraded":"2023-10-10T22:17:41.539459+0000","last_fullsized":"2023-10-10T22:17:41.539459+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:02:23.359264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.521820+0000","last_change":"2023-10-10T22:17:40.521006+0000","last_active":"2023-10-10T22:17:41.521820+0000","last_peered":"2023-10-10T22:17:41.521820+0000","last_clean":"2023-10-10T22:17:41.521820+0000","last_became_active":"2023-10-10T22:17:40.520753+0000","last_became_peered":"2023-10-10T22:17:40.520753+0000","last_unstale":"2023-10-10T22:17:41.521820+0000","last_undegraded":"2023-10-10T22:17:41.521820+0000","last_fullsized":"2023-10-10T22:17:41.521820+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:12:04.193860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.543944+0000","last_change":"2023-10-10T22:17:41.542191+0000","last_active":"2023-10-10T22:17:41.543944+0000","last_peered":"2023-10-10T22:17:41.543944+0000","last_clean":"2023-10-10T22:17:41.543944+0000","last_became_active":"2023-10-10T22:17:41.541587+0000","last_became_peered":"2023-10-10T22:17:41.541587+0000","last_unstale":"2023-10-10T22:17:41.543944+0000","last_undegraded":"2023-10-10T22:17:41.543944+0000","last_fullsized":"2023-10-10T22:17:41.543944+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:55:06.582810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"160'3","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.988333+0000","last_change":"2023-10-10T22:17:40.524213+0000","last_active":"2023-10-10T22:17:41.988333+0000","last_peered":"2023-10-10T22:17:41.988333+0000","last_clean":"2023-10-10T22:17:41.988333+0000","last_became_active":"2023-10-10T22:17:40.523960+0000","last_became_peered":"2023-10-10T22:17:40.523960+0000","last_unstale":"2023-10-10T22:17:41.988333+0000","last_undegraded":"2023-10-10T22:17:41.988333+0000","last_fullsized":"2023-10-10T22:17:41.988333+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:32:13.728451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547610+0000","last_change":"2023-10-10T22:17:41.544498+0000","last_active":"2023-10-10T22:17:41.547610+0000","last_peered":"2023-10-10T22:17:41.547610+0000","last_clean":"2023-10-10T22:17:41.547610+0000","last_became_active":"2023-10-10T22:17:41.544200+0000","last_became_peered":"2023-10-10T22:17:41.544200+0000","last_unstale":"2023-10-10T22:17:41.547610+0000","last_undegraded":"2023-10-10T22:17:41.547610+0000","last_fullsized":"2023-10-10T22:17:41.547610+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:23.210371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"160'6","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.990244+0000","last_change":"2023-10-10T22:17:40.524679+0000","last_active":"2023-10-10T22:17:41.990244+0000","last_peered":"2023-10-10T22:17:41.990244+0000","last_clean":"2023-10-10T22:17:41.990244+0000","last_became_active":"2023-10-10T22:17:40.523808+0000","last_became_peered":"2023-10-10T22:17:40.523808+0000","last_unstale":"2023-10-10T22:17:41.990244+0000","last_undegraded":"2023-10-10T22:17:41.990244+0000","last_fullsized":"2023-10-10T22:17:41.990244+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:30.995946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539779+0000","last_change":"2023-10-10T22:17:41.532702+0000","last_active":"2023-10-10T22:17:41.539779+0000","last_peered":"2023-10-10T22:17:41.539779+0000","last_clean":"2023-10-10T22:17:41.539779+0000","last_became_active":"2023-10-10T22:17:41.532437+0000","last_became_peered":"2023-10-10T22:17:41.532437+0000","last_unstale":"2023-10-10T22:17:41.539779+0000","last_undegraded":"2023-10-10T22:17:41.539779+0000","last_fullsized":"2023-10-10T22:17:41.539779+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:57:06.196867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.525100+0000","last_change":"2023-10-10T22:17:40.509758+0000","last_active":"2023-10-10T22:17:41.525100+0000","last_peered":"2023-10-10T22:17:41.525100+0000","last_clean":"2023-10-10T22:17:41.525100+0000","last_became_active":"2023-10-10T22:17:40.509489+0000","last_became_peered":"2023-10-10T22:17:40.509489+0000","last_unstale":"2023-10-10T22:17:41.525100+0000","last_undegraded":"2023-10-10T22:17:41.525100+0000","last_fullsized":"2023-10-10T22:17:41.525100+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:36:32.351547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542280+0000","last_change":"2023-10-10T22:17:41.539435+0000","last_active":"2023-10-10T22:17:41.542280+0000","last_peered":"2023-10-10T22:17:41.542280+0000","last_clean":"2023-10-10T22:17:41.542280+0000","last_became_active":"2023-10-10T22:17:41.539193+0000","last_became_peered":"2023-10-10T22:17:41.539193+0000","last_unstale":"2023-10-10T22:17:41.542280+0000","last_undegraded":"2023-10-10T22:17:41.542280+0000","last_fullsized":"2023-10-10T22:17:41.542280+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:19:19.668199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.524218+0000","last_change":"2023-10-10T22:17:40.522528+0000","last_active":"2023-10-10T22:17:41.524218+0000","last_peered":"2023-10-10T22:17:41.524218+0000","last_clean":"2023-10-10T22:17:41.524218+0000","last_became_active":"2023-10-10T22:17:40.522263+0000","last_became_peered":"2023-10-10T22:17:40.522263+0000","last_unstale":"2023-10-10T22:17:41.524218+0000","last_undegraded":"2023-10-10T22:17:41.524218+0000","last_fullsized":"2023-10-10T22:17:41.524218+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:51:15.733557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548032+0000","last_change":"2023-10-10T22:17:41.542384+0000","last_active":"2023-10-10T22:17:41.548032+0000","last_peered":"2023-10-10T22:17:41.548032+0000","last_clean":"2023-10-10T22:17:41.548032+0000","last_became_active":"2023-10-10T22:17:41.541978+0000","last_became_peered":"2023-10-10T22:17:41.541978+0000","last_unstale":"2023-10-10T22:17:41.548032+0000","last_undegraded":"2023-10-10T22:17:41.548032+0000","last_fullsized":"2023-10-10T22:17:41.548032+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:49.853877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"160'8","reported_seq":18,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.990057+0000","last_change":"2023-10-10T22:17:40.523440+0000","last_active":"2023-10-10T22:17:41.990057+0000","last_peered":"2023-10-10T22:17:41.990057+0000","last_clean":"2023-10-10T22:17:41.990057+0000","last_became_active":"2023-10-10T22:17:40.523088+0000","last_became_peered":"2023-10-10T22:17:40.523088+0000","last_unstale":"2023-10-10T22:17:41.990057+0000","last_undegraded":"2023-10-10T22:17:41.990057+0000","last_fullsized":"2023-10-10T22:17:41.990057+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:37:34.589773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.548089+0000","last_change":"2023-10-10T22:17:41.542952+0000","last_active":"2023-10-10T22:17:41.548089+0000","last_peered":"2023-10-10T22:17:41.548089+0000","last_clean":"2023-10-10T22:17:41.548089+0000","last_became_active":"2023-10-10T22:17:41.542637+0000","last_became_peered":"2023-10-10T22:17:41.542637+0000","last_unstale":"2023-10-10T22:17:41.548089+0000","last_undegraded":"2023-10-10T22:17:41.548089+0000","last_fullsized":"2023-10-10T22:17:41.548089+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:16.163238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.987452+0000","last_change":"2023-10-10T22:17:40.523071+0000","last_active":"2023-10-10T22:17:41.987452+0000","last_peered":"2023-10-10T22:17:41.987452+0000","last_clean":"2023-10-10T22:17:41.987452+0000","last_became_active":"2023-10-10T22:17:40.522791+0000","last_became_peered":"2023-10-10T22:17:40.522791+0000","last_unstale":"2023-10-10T22:17:41.987452+0000","last_undegraded":"2023-10-10T22:17:41.987452+0000","last_fullsized":"2023-10-10T22:17:41.987452+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:33:52.899573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.539488+0000","last_change":"2023-10-10T22:17:41.532456+0000","last_active":"2023-10-10T22:17:41.539488+0000","last_peered":"2023-10-10T22:17:41.539488+0000","last_clean":"2023-10-10T22:17:41.539488+0000","last_became_active":"2023-10-10T22:17:41.532174+0000","last_became_peered":"2023-10-10T22:17:41.532174+0000","last_unstale":"2023-10-10T22:17:41.539488+0000","last_undegraded":"2023-10-10T22:17:41.539488+0000","last_fullsized":"2023-10-10T22:17:41.539488+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:50:06.005830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.984498+0000","last_change":"2023-10-10T22:17:40.522075+0000","last_active":"2023-10-10T22:17:41.984498+0000","last_peered":"2023-10-10T22:17:41.984498+0000","last_clean":"2023-10-10T22:17:41.984498+0000","last_became_active":"2023-10-10T22:17:40.521812+0000","last_became_peered":"2023-10-10T22:17:40.521812+0000","last_unstale":"2023-10-10T22:17:41.984498+0000","last_undegraded":"2023-10-10T22:17:41.984498+0000","last_fullsized":"2023-10-10T22:17:41.984498+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:13:54.922870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.533938+0000","last_change":"2023-10-10T22:17:41.531597+0000","last_active":"2023-10-10T22:17:41.533938+0000","last_peered":"2023-10-10T22:17:41.533938+0000","last_clean":"2023-10-10T22:17:41.533938+0000","last_became_active":"2023-10-10T22:17:41.531352+0000","last_became_peered":"2023-10-10T22:17:41.531352+0000","last_unstale":"2023-10-10T22:17:41.533938+0000","last_undegraded":"2023-10-10T22:17:41.533938+0000","last_fullsized":"2023-10-10T22:17:41.533938+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:41:18.864886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"160'1","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.988200+0000","last_change":"2023-10-10T22:17:40.512759+0000","last_active":"2023-10-10T22:17:41.988200+0000","last_peered":"2023-10-10T22:17:41.988200+0000","last_clean":"2023-10-10T22:17:41.988200+0000","last_became_active":"2023-10-10T22:17:40.512487+0000","last_became_peered":"2023-10-10T22:17:40.512487+0000","last_unstale":"2023-10-10T22:17:41.988200+0000","last_undegraded":"2023-10-10T22:17:41.988200+0000","last_fullsized":"2023-10-10T22:17:41.988200+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:16:52.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.535155+0000","last_change":"2023-10-10T22:17:41.532137+0000","last_active":"2023-10-10T22:17:41.535155+0000","last_peered":"2023-10-10T22:17:41.535155+0000","last_clean":"2023-10-10T22:17:41.535155+0000","last_became_active":"2023-10-10T22:17:41.531846+0000","last_became_peered":"2023-10-10T22:17:41.531846+0000","last_unstale":"2023-10-10T22:17:41.535155+0000","last_undegraded":"2023-10-10T22:17:41.535155+0000","last_fullsized":"2023-10-10T22:17:41.535155+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:12:00.731788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.523682+0000","last_change":"2023-10-10T22:17:40.525643+0000","last_active":"2023-10-10T22:17:41.523682+0000","last_peered":"2023-10-10T22:17:41.523682+0000","last_clean":"2023-10-10T22:17:41.523682+0000","last_became_active":"2023-10-10T22:17:40.525350+0000","last_became_peered":"2023-10-10T22:17:40.525350+0000","last_unstale":"2023-10-10T22:17:41.523682+0000","last_undegraded":"2023-10-10T22:17:41.523682+0000","last_fullsized":"2023-10-10T22:17:41.523682+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:02:29.861438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.531371+0000","last_change":"2023-10-10T22:17:41.528891+0000","last_active":"2023-10-10T22:17:41.531371+0000","last_peered":"2023-10-10T22:17:41.531371+0000","last_clean":"2023-10-10T22:17:41.531371+0000","last_became_active":"2023-10-10T22:17:41.528576+0000","last_became_peered":"2023-10-10T22:17:41.528576+0000","last_unstale":"2023-10-10T22:17:41.531371+0000","last_undegraded":"2023-10-10T22:17:41.531371+0000","last_fullsized":"2023-10-10T22:17:41.531371+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:08:47.066388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.985717+0000","last_change":"2023-10-10T22:17:40.521890+0000","last_active":"2023-10-10T22:17:41.985717+0000","last_peered":"2023-10-10T22:17:41.985717+0000","last_clean":"2023-10-10T22:17:41.985717+0000","last_became_active":"2023-10-10T22:17:40.521630+0000","last_became_peered":"2023-10-10T22:17:40.521630+0000","last_unstale":"2023-10-10T22:17:41.985717+0000","last_undegraded":"2023-10-10T22:17:41.985717+0000","last_fullsized":"2023-10-10T22:17:41.985717+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:54:06.442299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541888+0000","last_change":"2023-10-10T22:17:41.539922+0000","last_active":"2023-10-10T22:17:41.541888+0000","last_peered":"2023-10-10T22:17:41.541888+0000","last_clean":"2023-10-10T22:17:41.541888+0000","last_became_active":"2023-10-10T22:17:41.539624+0000","last_became_peered":"2023-10-10T22:17:41.539624+0000","last_unstale":"2023-10-10T22:17:41.541888+0000","last_undegraded":"2023-10-10T22:17:41.541888+0000","last_fullsized":"2023-10-10T22:17:41.541888+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:58.986978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.521150+0000","last_change":"2023-10-10T22:17:40.520441+0000","last_active":"2023-10-10T22:17:41.521150+0000","last_peered":"2023-10-10T22:17:41.521150+0000","last_clean":"2023-10-10T22:17:41.521150+0000","last_became_active":"2023-10-10T22:17:40.520143+0000","last_became_peered":"2023-10-10T22:17:40.520143+0000","last_unstale":"2023-10-10T22:17:41.521150+0000","last_undegraded":"2023-10-10T22:17:41.521150+0000","last_fullsized":"2023-10-10T22:17:41.521150+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:37:22.881283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.535758+0000","last_change":"2023-10-10T22:17:41.534246+0000","last_active":"2023-10-10T22:17:41.535758+0000","last_peered":"2023-10-10T22:17:41.535758+0000","last_clean":"2023-10-10T22:17:41.535758+0000","last_became_active":"2023-10-10T22:17:41.533984+0000","last_became_peered":"2023-10-10T22:17:41.533984+0000","last_unstale":"2023-10-10T22:17:41.535758+0000","last_undegraded":"2023-10-10T22:17:41.535758+0000","last_fullsized":"2023-10-10T22:17:41.535758+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:10:53.066259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.520887+0000","last_change":"2023-10-10T22:17:40.517616+0000","last_active":"2023-10-10T22:17:41.520887+0000","last_peered":"2023-10-10T22:17:41.520887+0000","last_clean":"2023-10-10T22:17:41.520887+0000","last_became_active":"2023-10-10T22:17:40.517355+0000","last_became_peered":"2023-10-10T22:17:40.517355+0000","last_unstale":"2023-10-10T22:17:41.520887+0000","last_undegraded":"2023-10-10T22:17:41.520887+0000","last_fullsized":"2023-10-10T22:17:41.520887+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:01:17.177395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547417+0000","last_change":"2023-10-10T22:17:41.543255+0000","last_active":"2023-10-10T22:17:41.547417+0000","last_peered":"2023-10-10T22:17:41.547417+0000","last_clean":"2023-10-10T22:17:41.547417+0000","last_became_active":"2023-10-10T22:17:41.542952+0000","last_became_peered":"2023-10-10T22:17:41.542952+0000","last_unstale":"2023-10-10T22:17:41.547417+0000","last_undegraded":"2023-10-10T22:17:41.547417+0000","last_fullsized":"2023-10-10T22:17:41.547417+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:21.347014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.517589+0000","last_change":"2023-10-10T22:17:40.523553+0000","last_active":"2023-10-10T22:17:41.517589+0000","last_peered":"2023-10-10T22:17:41.517589+0000","last_clean":"2023-10-10T22:17:41.517589+0000","last_became_active":"2023-10-10T22:17:40.523310+0000","last_became_peered":"2023-10-10T22:17:40.523310+0000","last_unstale":"2023-10-10T22:17:41.517589+0000","last_undegraded":"2023-10-10T22:17:41.517589+0000","last_fullsized":"2023-10-10T22:17:41.517589+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:15.157582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.536545+0000","last_change":"2023-10-10T22:17:41.528224+0000","last_active":"2023-10-10T22:17:41.536545+0000","last_peered":"2023-10-10T22:17:41.536545+0000","last_clean":"2023-10-10T22:17:41.536545+0000","last_became_active":"2023-10-10T22:17:41.527921+0000","last_became_peered":"2023-10-10T22:17:41.527921+0000","last_unstale":"2023-10-10T22:17:41.536545+0000","last_undegraded":"2023-10-10T22:17:41.536545+0000","last_fullsized":"2023-10-10T22:17:41.536545+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:13:55.928526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.984377+0000","last_change":"2023-10-10T22:17:40.520688+0000","last_active":"2023-10-10T22:17:41.984377+0000","last_peered":"2023-10-10T22:17:41.984377+0000","last_clean":"2023-10-10T22:17:41.984377+0000","last_became_active":"2023-10-10T22:17:40.520220+0000","last_became_peered":"2023-10-10T22:17:40.520220+0000","last_unstale":"2023-10-10T22:17:41.984377+0000","last_undegraded":"2023-10-10T22:17:41.984377+0000","last_fullsized":"2023-10-10T22:17:41.984377+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:32:50.667379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541771+0000","last_change":"2023-10-10T22:17:41.539400+0000","last_active":"2023-10-10T22:17:41.541771+0000","last_peered":"2023-10-10T22:17:41.541771+0000","last_clean":"2023-10-10T22:17:41.541771+0000","last_became_active":"2023-10-10T22:17:41.539123+0000","last_became_peered":"2023-10-10T22:17:41.539123+0000","last_unstale":"2023-10-10T22:17:41.541771+0000","last_undegraded":"2023-10-10T22:17:41.541771+0000","last_fullsized":"2023-10-10T22:17:41.541771+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:30:11.433678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-10T22:17:42.670577+0000","last_change":"2023-10-10T22:17:40.522095+0000","last_active":"2023-10-10T22:17:42.670577+0000","last_peered":"2023-10-10T22:17:42.670577+0000","last_clean":"2023-10-10T22:17:42.670577+0000","last_became_active":"2023-10-10T22:17:40.521022+0000","last_became_peered":"2023-10-10T22:17:40.521022+0000","last_unstale":"2023-10-10T22:17:42.670577+0000","last_undegraded":"2023-10-10T22:17:42.670577+0000","last_fullsized":"2023-10-10T22:17:42.670577+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:15.157582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540507+0000","last_change":"2023-10-10T22:17:41.537591+0000","last_active":"2023-10-10T22:17:41.540507+0000","last_peered":"2023-10-10T22:17:41.540507+0000","last_clean":"2023-10-10T22:17:41.540507+0000","last_became_active":"2023-10-10T22:17:41.537342+0000","last_became_peered":"2023-10-10T22:17:41.537342+0000","last_unstale":"2023-10-10T22:17:41.540507+0000","last_undegraded":"2023-10-10T22:17:41.540507+0000","last_fullsized":"2023-10-10T22:17:41.540507+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:29:48.830379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.525943+0000","last_change":"2023-10-10T22:17:40.521243+0000","last_active":"2023-10-10T22:17:41.525943+0000","last_peered":"2023-10-10T22:17:41.525943+0000","last_clean":"2023-10-10T22:17:41.525943+0000","last_became_active":"2023-10-10T22:17:40.520975+0000","last_became_peered":"2023-10-10T22:17:40.520975+0000","last_unstale":"2023-10-10T22:17:41.525943+0000","last_undegraded":"2023-10-10T22:17:41.525943+0000","last_fullsized":"2023-10-10T22:17:41.525943+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:59:26.541318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.537435+0000","last_change":"2023-10-10T22:17:41.532549+0000","last_active":"2023-10-10T22:17:41.537435+0000","last_peered":"2023-10-10T22:17:41.537435+0000","last_clean":"2023-10-10T22:17:41.537435+0000","last_became_active":"2023-10-10T22:17:41.532277+0000","last_became_peered":"2023-10-10T22:17:41.532277+0000","last_unstale":"2023-10-10T22:17:41.537435+0000","last_undegraded":"2023-10-10T22:17:41.537435+0000","last_fullsized":"2023-10-10T22:17:41.537435+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:55:39.724016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.517953+0000","last_change":"2023-10-10T22:17:40.521143+0000","last_active":"2023-10-10T22:17:41.517953+0000","last_peered":"2023-10-10T22:17:41.517953+0000","last_clean":"2023-10-10T22:17:41.517953+0000","last_became_active":"2023-10-10T22:17:40.520794+0000","last_became_peered":"2023-10-10T22:17:40.520794+0000","last_unstale":"2023-10-10T22:17:41.517953+0000","last_undegraded":"2023-10-10T22:17:41.517953+0000","last_fullsized":"2023-10-10T22:17:41.517953+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:08.347918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547420+0000","last_change":"2023-10-10T22:17:41.543884+0000","last_active":"2023-10-10T22:17:41.547420+0000","last_peered":"2023-10-10T22:17:41.547420+0000","last_clean":"2023-10-10T22:17:41.547420+0000","last_became_active":"2023-10-10T22:17:41.543430+0000","last_became_peered":"2023-10-10T22:17:41.543430+0000","last_unstale":"2023-10-10T22:17:41.547420+0000","last_undegraded":"2023-10-10T22:17:41.547420+0000","last_fullsized":"2023-10-10T22:17:41.547420+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:55:47.524833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.525298+0000","last_change":"2023-10-10T22:17:40.525282+0000","last_active":"2023-10-10T22:17:41.525298+0000","last_peered":"2023-10-10T22:17:41.525298+0000","last_clean":"2023-10-10T22:17:41.525298+0000","last_became_active":"2023-10-10T22:17:40.524016+0000","last_became_peered":"2023-10-10T22:17:40.524016+0000","last_unstale":"2023-10-10T22:17:41.525298+0000","last_undegraded":"2023-10-10T22:17:41.525298+0000","last_fullsized":"2023-10-10T22:17:41.525298+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:04:40.331834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.541191+0000","last_change":"2023-10-10T22:17:41.535503+0000","last_active":"2023-10-10T22:17:41.541191+0000","last_peered":"2023-10-10T22:17:41.541191+0000","last_clean":"2023-10-10T22:17:41.541191+0000","last_became_active":"2023-10-10T22:17:41.535227+0000","last_became_peered":"2023-10-10T22:17:41.535227+0000","last_unstale":"2023-10-10T22:17:41.541191+0000","last_undegraded":"2023-10-10T22:17:41.541191+0000","last_fullsized":"2023-10-10T22:17:41.541191+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:10:49.360798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.532221+0000","last_change":"2023-10-10T22:17:40.524342+0000","last_active":"2023-10-10T22:17:41.532221+0000","last_peered":"2023-10-10T22:17:41.532221+0000","last_clean":"2023-10-10T22:17:41.532221+0000","last_became_active":"2023-10-10T22:17:40.524089+0000","last_became_peered":"2023-10-10T22:17:40.524089+0000","last_unstale":"2023-10-10T22:17:41.532221+0000","last_undegraded":"2023-10-10T22:17:41.532221+0000","last_fullsized":"2023-10-10T22:17:41.532221+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:02:22.353608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.542382+0000","last_change":"2023-10-10T22:17:41.540873+0000","last_active":"2023-10-10T22:17:41.542382+0000","last_peered":"2023-10-10T22:17:41.542382+0000","last_clean":"2023-10-10T22:17:41.542382+0000","last_became_active":"2023-10-10T22:17:41.540591+0000","last_became_peered":"2023-10-10T22:17:41.540591+0000","last_unstale":"2023-10-10T22:17:41.542382+0000","last_undegraded":"2023-10-10T22:17:41.542382+0000","last_fullsized":"2023-10-10T22:17:41.542382+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:11:20.331680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.521023+0000","last_change":"2023-10-10T22:17:40.521685+0000","last_active":"2023-10-10T22:17:41.521023+0000","last_peered":"2023-10-10T22:17:41.521023+0000","last_clean":"2023-10-10T22:17:41.521023+0000","last_became_active":"2023-10-10T22:17:40.521403+0000","last_became_peered":"2023-10-10T22:17:40.521403+0000","last_unstale":"2023-10-10T22:17:41.521023+0000","last_undegraded":"2023-10-10T22:17:41.521023+0000","last_fullsized":"2023-10-10T22:17:41.521023+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:57.324274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.540425+0000","last_change":"2023-10-10T22:17:41.537089+0000","last_active":"2023-10-10T22:17:41.540425+0000","last_peered":"2023-10-10T22:17:41.540425+0000","last_clean":"2023-10-10T22:17:41.540425+0000","last_became_active":"2023-10-10T22:17:41.536809+0000","last_became_peered":"2023-10-10T22:17:41.536809+0000","last_unstale":"2023-10-10T22:17:41.540425+0000","last_undegraded":"2023-10-10T22:17:41.540425+0000","last_fullsized":"2023-10-10T22:17:41.540425+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:09:52.300199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.518088+0000","last_change":"2023-10-10T22:17:40.512133+0000","last_active":"2023-10-10T22:17:41.518088+0000","last_peered":"2023-10-10T22:17:41.518088+0000","last_clean":"2023-10-10T22:17:41.518088+0000","last_became_active":"2023-10-10T22:17:40.511757+0000","last_became_peered":"2023-10-10T22:17:40.511757+0000","last_unstale":"2023-10-10T22:17:41.518088+0000","last_undegraded":"2023-10-10T22:17:41.518088+0000","last_fullsized":"2023-10-10T22:17:41.518088+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:09.784424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.547399+0000","last_change":"2023-10-10T22:17:41.543703+0000","last_active":"2023-10-10T22:17:41.547399+0000","last_peered":"2023-10-10T22:17:41.547399+0000","last_clean":"2023-10-10T22:17:41.547399+0000","last_became_active":"2023-10-10T22:17:41.543020+0000","last_became_peered":"2023-10-10T22:17:41.543020+0000","last_unstale":"2023-10-10T22:17:41.547399+0000","last_undegraded":"2023-10-10T22:17:41.547399+0000","last_fullsized":"2023-10-10T22:17:41.547399+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:40.497076+0000","last_clean_scrub_stamp":"2023-10-10T22:17:40.497076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:57:41.173655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"160'2","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.987573+0000","last_change":"2023-10-10T22:17:40.521489+0000","last_active":"2023-10-10T22:17:41.987573+0000","last_peered":"2023-10-10T22:17:41.987573+0000","last_clean":"2023-10-10T22:17:41.987573+0000","last_became_active":"2023-10-10T22:17:40.521155+0000","last_became_peered":"2023-10-10T22:17:40.521155+0000","last_unstale":"2023-10-10T22:17:41.987573+0000","last_undegraded":"2023-10-10T22:17:41.987573+0000","last_fullsized":"2023-10-10T22:17:41.987573+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:17:39.491420+0000","last_clean_scrub_stamp":"2023-10-10T22:17:39.491420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:09:09.784424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"150'271","reported_seq":832,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-10T22:17:41.531439+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:17:41.531439+0000","last_peered":"2023-10-10T22:17:41.531439+0000","last_clean":"2023-10-10T22:17:41.531439+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:17:41.531439+0000","last_undegraded":"2023-10-10T22:17:41.531439+0000","last_fullsized":"2023-10-10T22:17:41.531439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543045,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308036,"kb_used_data":2556,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063804,"statfs":{"total":96636764160,"available":96321335296,"internally_reserved":0,"allocated":2617344,"data_stored":1585189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96999999999999997,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73599999999999999,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.98699999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88500000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.90300000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.754},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.92900000000000005}]},{"osd":3,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.75900000000000001,"15min":0.754},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.96499999999999997}]},{"osd":4,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.95699999999999996},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.94899999999999995},"last":0.84099999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85899999999999999,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":1.006},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.442},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.95099999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0289999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0640000000000001}]}]},{"osd":6,"up_from":14,"seq":60129543044,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311540,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060300,"statfs":{"total":96636764160,"available":96317747200,"internally_reserved":0,"allocated":2011136,"data_stored":994211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.92200000000000004}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.72399999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.75900000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.87},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.67800000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.90800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129543044,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307432,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064408,"statfs":{"total":96636764160,"available":96321953792,"internally_reserved":0,"allocated":1998848,"data_stored":992675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.52200000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.58899999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.64700000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.57599999999999996}]}]},{"osd":0,"up_from":14,"seq":60129543046,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303916,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067924,"statfs":{"total":96636764160,"available":96325554176,"internally_reserved":0,"allocated":2592768,"data_stored":1583043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.57999999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.34000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.871,"5min":0.89800000000000002,"15min":0.90800000000000003},"last":0.504}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.627}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.72299999999999998}]}]},{"osd":2,"up_from":14,"seq":60129543046,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311536,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060304,"statfs":{"total":96636764160,"available":96317751296,"internally_reserved":0,"allocated":2007040,"data_stored":993263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.80900000000000005},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81100000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67200000000000004}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.90000000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.355,"15min":1.355},"last":0.85299999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.1659999999999999,"5min":1.248,"15min":1.248},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.232},"last":0.871}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2070000000000001,"5min":1.278,"15min":1.278},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56899999999999995},"max":{"1min":1.1339999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.93899999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.89600000000000002}]}]},{"osd":3,"up_from":15,"seq":64424510341,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311536,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060304,"statfs":{"total":96636764160,"available":96317751296,"internally_reserved":0,"allocated":2007040,"data_stored":992835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.81999999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.66500000000000004,"5min":0.748,"15min":0.77900000000000003},"last":0.40999999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.875},"last":0.39300000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.877},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.433}]},{"osd":4,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93799999999999994,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.624,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0389999999999999,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.63600000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.079,"5min":1.218,"15min":1.218},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.63300000000000001,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.177,"15min":1.177},"last":0.63900000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.55600000000000005}]}]},{"osd":4,"up_from":14,"seq":60129543046,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311532,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060308,"statfs":{"total":96636764160,"available":96317755392,"internally_reserved":0,"allocated":2002944,"data_stored":992745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96499999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.46200000000000002},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.0629999999999999},"last":0.95799999999999996}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.99099999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":0.95299999999999996,"15min":1.135},"last":0.88}]},{"osd":2,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.996},"last":0.90600000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"max":{"1min":0.95399999999999996,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.83399999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.97299999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39100000000000001},"max":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.94799999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.052,"15min":1.052},"last":0.75600000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":0.94899999999999995,"5min":1.018,"15min":1.0649999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94799999999999995,"15min":1.028},"last":0.77400000000000002}]}]},{"osd":5,"up_from":14,"seq":60129543044,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311536,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060304,"statfs":{"total":96636764160,"available":96317751296,"internally_reserved":0,"allocated":2007040,"data_stored":992787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.745}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.91200000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81799999999999995}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.95399999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.97399999999999998}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.92800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:17:51.671 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T22:17:51.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T22:17:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.861+0000 7f1b5f3ff700 1 Processor -- start 2023-10-10T22:17:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.861+0000 7f1b5f3ff700 1 -- start start 2023-10-10T22:17:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5f3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b58157a00 0x7f1b58158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5f3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1b58068390 0x7f1b580687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5f3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b58158590 con 0x7f1b58157630 2023-10-10T22:17:51.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5f3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b58068cf0 con 0x7f1b58157a00 2023-10-10T22:17:51.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5f3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b58157f80 con 0x7f1b58068390 2023-10-10T22:17:51.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5c99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b58157a00 0x7f1b58158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5c99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b58157a00 0x7f1b58158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56258/0 (socket says 172.21.15.154:56258) 2023-10-10T22:17:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5c99a700 1 -- 172.21.15.154:0/3581462567 learned_addr learned my addr 172.21.15.154:0/3581462567 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5d99c700 1 --2- 172.21.15.154:0/3581462567 >> v2:172.21.15.179:3300/0 conn(0x7f1b58068390 0x7f1b580687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5c99a700 1 -- 172.21.15.154:0/3581462567 >> v2:172.21.15.179:3300/0 conn(0x7f1b58068390 msgr2=0x7f1b580687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:51.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5c99a700 1 --2- 172.21.15.154:0/3581462567 >> v2:172.21.15.179:3300/0 conn(0x7f1b58068390 0x7f1b580687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5c99a700 1 -- 172.21.15.154:0/3581462567 >> v1:172.21.15.179:6789/0 conn(0x7f1b58157630 legacy=0x7f1b580abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.863+0000 7f1b5c99a700 1 -- 172.21.15.154:0/3581462567 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580ac7a0 con 0x7f1b58157a00 2023-10-10T22:17:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.864+0000 7f1b5c99a700 1 --2- 172.21.15.154:0/3581462567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58157a00 0x7f1b58158a20 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b1990 tx=0x7f1b48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f60ffcf14f236db server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.864+0000 7f1b4ffff700 1 -- 172.21.15.154:0/3581462567 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800b860 con 0x7f1b58157a00 2023-10-10T22:17:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.864+0000 7f1b4ffff700 1 -- 172.21.15.154:0/3581462567 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4800b9c0 con 0x7f1b58157a00 2023-10-10T22:17:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.864+0000 7f1b4ffff700 1 -- 172.21.15.154:0/3581462567 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800bd60 con 0x7f1b58157a00 2023-10-10T22:17:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.864+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/3581462567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58157a00 msgr2=0x7f1b58158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.864+0000 7f1b5f3ff700 1 --2- 172.21.15.154:0/3581462567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58157a00 0x7f1b58158a20 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b1990 tx=0x7f1b48009250 comp rx=0 tx=0).stop 2023-10-10T22:17:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.865+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/3581462567 shutdown_connections 2023-10-10T22:17:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.865+0000 7f1b5f3ff700 1 --2- 172.21.15.154:0/3581462567 >> v2:172.21.15.179:3300/0 conn(0x7f1b58068390 0x7f1b580687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.865+0000 7f1b5f3ff700 1 --2- 172.21.15.154:0/3581462567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58157a00 0x7f1b58158a20 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.865+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/3581462567 >> 172.21.15.154:0/3581462567 conn(0x7f1b580cc540 msgr2=0x7f1b580cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.865+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/3581462567 shutdown_connections 2023-10-10T22:17:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.865+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/3581462567 wait complete. 2023-10-10T22:17:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.866+0000 7f1b5f3ff700 1 Processor -- start 2023-10-10T22:17:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.866+0000 7f1b5f3ff700 1 -- start start 2023-10-10T22:17:51.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5f3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58068390 0x7f1b580c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5f3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b58157630 0x7f1b580b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5f3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b58157a00 0x7f1b580b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5f3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58169270 con 0x7f1b58068390 2023-10-10T22:17:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5f3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580c3d40 con 0x7f1b58157630 2023-10-10T22:17:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5f3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58168f90 con 0x7f1b58157a00 2023-10-10T22:17:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5d19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58068390 0x7f1b580c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5d19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58068390 0x7f1b580c29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56266/0 (socket says 172.21.15.154:56266) 2023-10-10T22:17:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5d19b700 1 -- 172.21.15.154:0/1241779246 learned_addr learned my addr 172.21.15.154:0/1241779246 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.867+0000 7f1b5c99a700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b58157630 0x7f1b580b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5d19b700 1 -- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b58157a00 msgr2=0x7f1b580b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5d99c700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b58157a00 0x7f1b580b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5d19b700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b58157a00 0x7f1b580b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5d19b700 1 -- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b58157630 msgr2=0x7f1b580b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5d19b700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b58157630 0x7f1b580b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5d19b700 1 -- 172.21.15.154:0/1241779246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b480094f0 con 0x7f1b58068390 2023-10-10T22:17:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5c99a700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b58157630 0x7f1b580b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5d99c700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b58157a00 0x7f1b580b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:51.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5d19b700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58068390 0x7f1b580c29e0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c590 tx=0x7f1b5400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:51.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b4d7fa700 1 -- 172.21.15.154:0/1241779246 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54011590 con 0x7f1b58068390 2023-10-10T22:17:51.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b4d7fa700 1 -- 172.21.15.154:0/1241779246 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b540116f0 con 0x7f1b58068390 2023-10-10T22:17:51.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b580c36f0 con 0x7f1b58068390 2023-10-10T22:17:51.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b4d7fa700 1 -- 172.21.15.154:0/1241779246 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54011ab0 con 0x7f1b58068390 2023-10-10T22:17:51.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.868+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580c41d0 con 0x7f1b58068390 2023-10-10T22:17:51.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.869+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b580c3550 con 0x7f1b58068390 2023-10-10T22:17:51.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.870+0000 7f1b4d7fa700 1 -- 172.21.15.154:0/1241779246 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b5401b3b0 con 0x7f1b58068390 2023-10-10T22:17:51.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.871+0000 7f1b4d7fa700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b3c066f30 0x7f1b3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:51.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.871+0000 7f1b4d7fa700 1 -- 172.21.15.154:0/1241779246 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f1b54083d50 con 0x7f1b58068390 2023-10-10T22:17:51.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.871+0000 7f1b5c99a700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b3c066f30 0x7f1b3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.872+0000 7f1b5c99a700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b3c066f30 0x7f1b3c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b1990 tx=0x7f1b48017000 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:51.875+0000 7f1b4d7fa700 1 -- 172.21.15.154:0/1241779246 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b580c3550 con 0x7f1b58068390 2023-10-10T22:17:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.145+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1b580c3550 con 0x7f1b58068390 2023-10-10T22:17:52.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.151+0000 7f1b4d7fa700 1 -- 172.21.15.154:0/1241779246 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v42) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1b580c3550 con 0x7f1b58068390 2023-10-10T22:17:52.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b3c066f30 msgr2=0x7f1b3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:52.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b3c066f30 0x7f1b3c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b1990 tx=0x7f1b48017000 comp rx=0 tx=0).stop 2023-10-10T22:17:52.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58068390 msgr2=0x7f1b580c29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58068390 0x7f1b580c29e0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c590 tx=0x7f1b5400c950 comp rx=0 tx=0).stop 2023-10-10T22:17:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 shutdown_connections 2023-10-10T22:17:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b58157a00 0x7f1b580b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1b3c066f30 0x7f1b3c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b58068390 0x7f1b580c29e0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 --2- 172.21.15.154:0/1241779246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b58157630 0x7f1b580b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 >> 172.21.15.154:0/1241779246 conn(0x7f1b580cc540 msgr2=0x7f1b58155660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:52.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 shutdown_connections 2023-10-10T22:17:52.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.153+0000 7f1b5f3ff700 1 -- 172.21.15.154:0/1241779246 wait complete. 2023-10-10T22:17:52.158 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T22:17:52.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:17:52.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.353+0000 7f9bf8bff700 1 Processor -- start 2023-10-10T22:17:52.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.353+0000 7f9bf8bff700 1 -- start start 2023-10-10T22:17:52.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.354+0000 7f9bf8bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bf4068550 0x7f9bf4068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:52.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.354+0000 7f9bf8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf415e010 0x7f9bf406f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:52.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.354+0000 7f9bf8bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf406ec70 con 0x7f9bf406f640 2023-10-10T22:17:52.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.354+0000 7f9bf8bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40b3430 con 0x7f9bf4068550 2023-10-10T22:17:52.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.354+0000 7f9bf8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b2e70 con 0x7f9bf415e010 2023-10-10T22:17:52.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf2d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9bf406f640 0x7f9bf406a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38874/0 (socket says 172.21.15.154:38874) 2023-10-10T22:17:52.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf2d9d700 1 -- 172.21.15.154:0/1154674838 learned_addr learned my addr 172.21.15.154:0/1154674838 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:52.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf259c700 1 --2- 172.21.15.154:0/1154674838 >> v2:172.21.15.179:3300/0 conn(0x7f9bf4068550 0x7f9bf4068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:52.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf1d9b700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf415e010 0x7f9bf406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:52.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34714517 0 0) 0x7f9bf406ec70 con 0x7f9bf406f640 2023-10-10T22:17:52.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bdc003570 con 0x7f9bf406f640 2023-10-10T22:17:52.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2123556535 0 0) 0x7f9bdc003570 con 0x7f9bf406f640 2023-10-10T22:17:52.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf415e010 msgr2=0x7f9bf406f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:52.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf415e010 0x7f9bf406f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 >> v2:172.21.15.179:3300/0 conn(0x7f9bf4068550 msgr2=0x7f9bf4068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:52.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 --2- 172.21.15.154:0/1154674838 >> v2:172.21.15.179:3300/0 conn(0x7f9bf4068550 0x7f9bf4068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40b3150 con 0x7f9bf406f640 2023-10-10T22:17:52.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f9bec0017f0 con 0x7f9bf406f640 2023-10-10T22:17:52.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.355+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 >> v1:172.21.15.154:6789/0 conn(0x7f9bf406f640 legacy=0x7f9bf406a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:52.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf159a700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf415e010 0x7f9bdc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:52.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf159a700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bdc003fe0 0x7f9bdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:52.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf159a700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc004d50 0x7f9bdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:52.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b2e70 con 0x7f9bdc004d50 2023-10-10T22:17:52.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc00ba60 con 0x7f9bdc003fe0 2023-10-10T22:17:52.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc00bbd0 con 0x7f9bf415e010 2023-10-10T22:17:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf2d9d700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc004d50 0x7f9bdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf259c700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf415e010 0x7f9bdc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf1d9b700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bdc003fe0 0x7f9bdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf2d9d700 1 -- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf415e010 msgr2=0x7f9bdc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:52.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf2d9d700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf415e010 0x7f9bdc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf2d9d700 1 -- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bdc003fe0 msgr2=0x7f9bdc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:52.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf2d9d700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bdc003fe0 0x7f9bdc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf2d9d700 1 -- 172.21.15.154:0/1154674838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc003570 con 0x7f9bdc004d50 2023-10-10T22:17:52.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.356+0000 7f9bf2d9d700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc004d50 0x7f9bdc0051c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00a970 tx=0x7f9bf4068e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6be2e248499c2df server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:52.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0070d0 con 0x7f9bdc004d50 2023-10-10T22:17:52.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec007270 con 0x7f9bdc004d50 2023-10-10T22:17:52.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf159a700 1 -- 172.21.15.154:0/1154674838 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec007630 con 0x7f9bdc004d50 2023-10-10T22:17:52.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf8bff700 1 -- 172.21.15.154:0/1154674838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc004d50 msgr2=0x7f9bdc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:52.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf8bff700 1 --2- 172.21.15.154:0/1154674838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc004d50 0x7f9bdc0051c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00a970 tx=0x7f9bf4068e60 comp rx=0 tx=0).stop 2023-10-10T22:17:52.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf2d9d700 1 -- 172.21.15.154:0/1154674838 reap_dead start 2023-10-10T22:17:52.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf8bff700 1 -- 172.21.15.154:0/1154674838 shutdown_connections 2023-10-10T22:17:52.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf8bff700 1 -- 172.21.15.154:0/1154674838 >> 172.21.15.154:0/1154674838 conn(0x7f9bf40cd480 msgr2=0x7f9bf40cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:52.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf8bff700 1 -- 172.21.15.154:0/1154674838 shutdown_connections 2023-10-10T22:17:52.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.357+0000 7f9bf8bff700 1 -- 172.21.15.154:0/1154674838 wait complete. 2023-10-10T22:17:52.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.359+0000 7f9bf8bff700 1 Processor -- start 2023-10-10T22:17:52.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.359+0000 7f9bf8bff700 1 -- start start 2023-10-10T22:17:52.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bdc004d50 0x7f9bf416a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:52.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf8bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4159ef0 0x7f9bf414c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:52.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf415c1f0 0x7f9bf415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:52.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf8bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf415b690 con 0x7f9bf4159ef0 2023-10-10T22:17:52.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf414c650 con 0x7f9bf415c1f0 2023-10-10T22:17:52.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf415cba0 con 0x7f9bdc004d50 2023-10-10T22:17:52.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4159ef0 0x7f9bf414c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:52.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4159ef0 0x7f9bf414c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56286/0 (socket says 172.21.15.154:56286) 2023-10-10T22:17:52.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf1d9b700 1 -- 172.21.15.154:0/374990618 learned_addr learned my addr 172.21.15.154:0/374990618 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:52.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf259c700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bdc004d50 0x7f9bf416a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:52.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf2d9d700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf415c1f0 0x7f9bf415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:52.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf1d9b700 1 -- 172.21.15.154:0/374990618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bdc004d50 msgr2=0x7f9bf416a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:52.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf1d9b700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bdc004d50 0x7f9bf416a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf1d9b700 1 -- 172.21.15.154:0/374990618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf415c1f0 msgr2=0x7f9bf415c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:52.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf1d9b700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf415c1f0 0x7f9bf415c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.360+0000 7f9bf1d9b700 1 -- 172.21.15.154:0/374990618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf415b200 con 0x7f9bf4159ef0 2023-10-10T22:17:52.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.361+0000 7f9bf1d9b700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4159ef0 0x7f9bf414c110 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f9be8011b10 tx=0x7f9be80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:52.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.361+0000 7f9be27fc700 1 -- 172.21.15.154:0/374990618 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be800f9f0 con 0x7f9bf4159ef0 2023-10-10T22:17:52.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.361+0000 7f9be27fc700 1 -- 172.21.15.154:0/374990618 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be800fb50 con 0x7f9bf4159ef0 2023-10-10T22:17:52.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.361+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf415a360 con 0x7f9bf4159ef0 2023-10-10T22:17:52.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.361+0000 7f9be27fc700 1 -- 172.21.15.154:0/374990618 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be800fed0 con 0x7f9bf4159ef0 2023-10-10T22:17:52.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.361+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf415a8d0 con 0x7f9bf4159ef0 2023-10-10T22:17:52.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.362+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf415b390 con 0x7f9bf4159ef0 2023-10-10T22:17:52.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.363+0000 7f9be27fc700 1 -- 172.21.15.154:0/374990618 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9be8014650 con 0x7f9bf4159ef0 2023-10-10T22:17:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.364+0000 7f9be27fc700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9bd4066f30 0x7f9bd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.364+0000 7f9be27fc700 1 -- 172.21.15.154:0/374990618 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f9be8018030 con 0x7f9bf4159ef0 2023-10-10T22:17:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.364+0000 7f9bf259c700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9bd4066f30 0x7f9bd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.364+0000 7f9bf259c700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9bd4066f30 0x7f9bd40693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9be4006ed0 tx=0x7f9be4008040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.368+0000 7f9be27fc700 1 -- 172.21.15.154:0/374990618 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9be8052260 con 0x7f9bf4159ef0 2023-10-10T22:17:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.602+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bf404c3c0 con 0x7f9bf4159ef0 2023-10-10T22:17:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.603+0000 7f9be27fc700 1 -- 172.21.15.154:0/374990618 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f9be8055880 con 0x7f9bf4159ef0 2023-10-10T22:17:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:17:52.605 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7196,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3891554759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3891554759},{"type":"v1","addr":"172.21.15.179:6834","nonce":3891554759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8158,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1858498414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1858498414},{"type":"v1","addr":"172.21.15.154:6835","nonce":1858498414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8161,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3531287783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3531287783},{"type":"v1","addr":"172.21.15.179:6835","nonce":3531287783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:17:40.982384+0000","modified":"2023-10-10T22:17:44.985977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8640":{"gid":8640,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/3925813058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3925813058},{"type":"v1","addr":"172.21.15.154:6834","nonce":3925813058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-10T22:17:52.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9bd4066f30 msgr2=0x7f9bd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:52.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9bd4066f30 0x7f9bd40693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9be4006ed0 tx=0x7f9be4008040 comp rx=0 tx=0).stop 2023-10-10T22:17:52.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4159ef0 msgr2=0x7f9bf414c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:52.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4159ef0 0x7f9bf414c110 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f9be8011b10 tx=0x7f9be80091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 shutdown_connections 2023-10-10T22:17:52.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf415c1f0 0x7f9bf415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bdc004d50 0x7f9bf416a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9bd4066f30 0x7f9bd40693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 --2- 172.21.15.154:0/374990618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4159ef0 0x7f9bf414c110 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:52.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 >> 172.21.15.154:0/374990618 conn(0x7f9bf40cd480 msgr2=0x7f9bf41588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:52.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 shutdown_connections 2023-10-10T22:17:52.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:52.605+0000 7f9bf8bff700 1 -- 172.21.15.154:0/374990618 wait complete. 2023-10-10T22:17:52.609 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 70 2023-10-10T22:17:53.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T22:17:40.982384+0000', 'modified': '2023-10-10T22:17:44.985977+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8640}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8640': {'gid': 8640, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6834/3925813058', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 3925813058}, {'type': 'v1', 'addr': '172.21.15.154:6834', 'nonce': 3925813058}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T22:17:53.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T22:17:53.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-10T22:17:53.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.213+0000 7efc56fff700 1 Processor -- start 2023-10-10T22:17:53.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.213+0000 7efc56fff700 1 -- start start 2023-10-10T22:17:53.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc56fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500b1420 0x7efc500ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc56fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc500ccf90 0x7efc500c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc56fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc500cc300 con 0x7efc500cbf30 2023-10-10T22:17:53.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc56fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc50156bf0 con 0x7efc500ccf90 2023-10-10T22:17:53.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc56fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500ae950 con 0x7efc500b1420 2023-10-10T22:17:53.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc5559c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc500ccf90 0x7efc500c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc54d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efc500cbf30 0x7efc500b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38876/0 (socket says 172.21.15.154:38876) 2023-10-10T22:17:53.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc54d9b700 1 -- 172.21.15.154:0/2001337166 learned_addr learned my addr 172.21.15.154:0/2001337166 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:53.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc4ffff700 1 --2- 172.21.15.154:0/2001337166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500b1420 0x7efc500ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc5559c700 1 -- 172.21.15.154:0/2001337166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500b1420 msgr2=0x7efc500ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc5559c700 1 --2- 172.21.15.154:0/2001337166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500b1420 0x7efc500ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc4f7fe700 1 -- 172.21.15.154:0/2001337166 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561916238 0 0) 0x7efc500cc300 con 0x7efc500cbf30 2023-10-10T22:17:53.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc5559c700 1 -- 172.21.15.154:0/2001337166 >> v1:172.21.15.154:6789/0 conn(0x7efc500cbf30 legacy=0x7efc500b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.215+0000 7efc5559c700 1 -- 172.21.15.154:0/2001337166 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500ad370 con 0x7efc500ccf90 2023-10-10T22:17:53.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.216+0000 7efc5559c700 1 --2- 172.21.15.154:0/2001337166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500ccf90 0x7efc500c9740 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7efc48009e90 tx=0x7efc48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a71e8920ef09f0a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.216+0000 7efc4f7fe700 1 -- 172.21.15.154:0/2001337166 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4800e070 con 0x7efc500ccf90 2023-10-10T22:17:53.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.216+0000 7efc4f7fe700 1 -- 172.21.15.154:0/2001337166 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4800bbf0 con 0x7efc500ccf90 2023-10-10T22:17:53.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.216+0000 7efc4f7fe700 1 -- 172.21.15.154:0/2001337166 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48012430 con 0x7efc500ccf90 2023-10-10T22:17:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.216+0000 7efc56fff700 1 -- 172.21.15.154:0/2001337166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500ccf90 msgr2=0x7efc500c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.216+0000 7efc56fff700 1 --2- 172.21.15.154:0/2001337166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500ccf90 0x7efc500c9740 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7efc48009e90 tx=0x7efc48009780 comp rx=0 tx=0).stop 2023-10-10T22:17:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.217+0000 7efc56fff700 1 -- 172.21.15.154:0/2001337166 shutdown_connections 2023-10-10T22:17:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.217+0000 7efc56fff700 1 --2- 172.21.15.154:0/2001337166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500ccf90 0x7efc500c9740 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.217+0000 7efc56fff700 1 --2- 172.21.15.154:0/2001337166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500b1420 0x7efc500ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.217+0000 7efc56fff700 1 -- 172.21.15.154:0/2001337166 >> 172.21.15.154:0/2001337166 conn(0x7efc5006a320 msgr2=0x7efc500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.217+0000 7efc56fff700 1 -- 172.21.15.154:0/2001337166 shutdown_connections 2023-10-10T22:17:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.217+0000 7efc56fff700 1 -- 172.21.15.154:0/2001337166 wait complete. 2023-10-10T22:17:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.218+0000 7efc56fff700 1 Processor -- start 2023-10-10T22:17:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.218+0000 7efc56fff700 1 -- start start 2023-10-10T22:17:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.219+0000 7efc56fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc500b1420 0x7efc50169190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.219+0000 7efc56fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500cbf30 0x7efc50146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.219+0000 7efc56fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500ccf90 0x7efc5016acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.219+0000 7efc56fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5016aac0 con 0x7efc500cbf30 2023-10-10T22:17:53.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.219+0000 7efc56fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc50169a20 con 0x7efc500b1420 2023-10-10T22:17:53.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.219+0000 7efc56fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc50169d00 con 0x7efc500ccf90 2023-10-10T22:17:53.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.219+0000 7efc4ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500cbf30 0x7efc50146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.219+0000 7efc4ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500cbf30 0x7efc50146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56308/0 (socket says 172.21.15.154:56308) 2023-10-10T22:17:53.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4ffff700 1 -- 172.21.15.154:0/3441756507 learned_addr learned my addr 172.21.15.154:0/3441756507 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc54d9b700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc500b1420 0x7efc50169190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc5559c700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500ccf90 0x7efc5016acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4ffff700 1 -- 172.21.15.154:0/3441756507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500ccf90 msgr2=0x7efc5016acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4ffff700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500ccf90 0x7efc5016acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4ffff700 1 -- 172.21.15.154:0/3441756507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc500b1420 msgr2=0x7efc50169190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4ffff700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc500b1420 0x7efc50169190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4ffff700 1 -- 172.21.15.154:0/3441756507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48009a20 con 0x7efc500cbf30 2023-10-10T22:17:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4ffff700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500cbf30 0x7efc50146ed0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00d890 tx=0x7efc3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4cff9700 1 -- 172.21.15.154:0/3441756507 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0125f0 con 0x7efc500cbf30 2023-10-10T22:17:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4cff9700 1 -- 172.21.15.154:0/3441756507 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c012750 con 0x7efc500cbf30 2023-10-10T22:17:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc4cff9700 1 -- 172.21.15.154:0/3441756507 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c012af0 con 0x7efc500cbf30 2023-10-10T22:17:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.220+0000 7efc56fff700 1 -- 172.21.15.154:0/3441756507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc50169fe0 con 0x7efc500cbf30 2023-10-10T22:17:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.221+0000 7efc56fff700 1 -- 172.21.15.154:0/3441756507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5016a5a0 con 0x7efc500cbf30 2023-10-10T22:17:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.223+0000 7efc4cff9700 1 -- 172.21.15.154:0/3441756507 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc3c01e460 con 0x7efc500cbf30 2023-10-10T22:17:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.223+0000 7efc4cff9700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7efc34066f30 0x7efc340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.223+0000 7efc4cff9700 1 -- 172.21.15.154:0/3441756507 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7efc3c084cd0 con 0x7efc500cbf30 2023-10-10T22:17:53.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.224+0000 7efc54d9b700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7efc34066f30 0x7efc340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.224+0000 7efc54d9b700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7efc34066f30 0x7efc340693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc44007fd0 tx=0x7efc44007d30 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.225+0000 7efc6564cb80 1 Processor -- start 2023-10-10T22:17:53.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.225+0000 7efc6564cb80 1 -- start start 2023-10-10T22:17:53.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.226+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacd6050 0x55eceacd6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.226+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55eceacac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.226+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceacad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.226+0000 7efc6564cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eceac03a70 con 0x55eceacadf80 2023-10-10T22:17:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.226+0000 7efc6564cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eceac01270 con 0x55eceacacdc0 2023-10-10T22:17:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.226+0000 7efc6564cb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eceabfd060 con 0x55eceacd6050 2023-10-10T22:17:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.226+0000 7efc4ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55eceacac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc4ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55eceacac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56310/0 (socket says 172.21.15.154:56310) 2023-10-10T22:17:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc4ffff700 1 -- 172.21.15.154:0/698145440 learned_addr learned my addr 172.21.15.154:0/698145440 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc5559c700 1 --2- 172.21.15.154:0/698145440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceacad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc4ffff700 1 -- 172.21.15.154:0/698145440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacd6050 msgr2=0x55eceacd6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc4ffff700 1 --2- 172.21.15.154:0/698145440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacd6050 0x55eceacd6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc4ffff700 1 -- 172.21.15.154:0/698145440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 msgr2=0x55eceacad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc4ffff700 1 --2- 172.21.15.154:0/698145440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceacad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc4ffff700 1 -- 172.21.15.154:0/698145440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eceaa97270 con 0x55eceacadf80 2023-10-10T22:17:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc5559c700 1 --2- 172.21.15.154:0/698145440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceacad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc4ffff700 1 --2- 172.21.15.154:0/698145440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55eceacac880 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7efc3c014040 tx=0x7efc3c082ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9918542bb41d414d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc39ffb700 1 -- 172.21.15.154:0/698145440 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c058be0 con 0x55eceacadf80 2023-10-10T22:17:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc39ffb700 1 -- 172.21.15.154:0/698145440 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c05c930 con 0x55eceacadf80 2023-10-10T22:17:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.227+0000 7efc39ffb700 1 -- 172.21.15.154:0/698145440 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c053ad0 con 0x55eceacadf80 2023-10-10T22:17:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.228+0000 7efc6564cb80 1 -- 172.21.15.154:0/698145440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 msgr2=0x55eceacac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.228+0000 7efc6564cb80 1 --2- 172.21.15.154:0/698145440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55eceacac880 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7efc3c014040 tx=0x7efc3c082ee0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.228+0000 7efc6564cb80 1 -- 172.21.15.154:0/698145440 shutdown_connections 2023-10-10T22:17:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.228+0000 7efc6564cb80 1 --2- 172.21.15.154:0/698145440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceacad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.228+0000 7efc6564cb80 1 --2- 172.21.15.154:0/698145440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacd6050 0x55eceacd6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.228+0000 7efc6564cb80 1 --2- 172.21.15.154:0/698145440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55eceacac880 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.228+0000 7efc6564cb80 1 -- 172.21.15.154:0/698145440 >> 172.21.15.154:0/698145440 conn(0x55eceacae370 msgr2=0x55eceacae740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.228+0000 7efc6564cb80 1 -- 172.21.15.154:0/698145440 shutdown_connections 2023-10-10T22:17:53.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.228+0000 7efc6564cb80 1 -- 172.21.15.154:0/698145440 wait complete. 2023-10-10T22:17:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.229+0000 7efc6564cb80 1 -- start start 2023-10-10T22:17:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.229+0000 7efc6564cb80 1 Processor -- start 2023-10-10T22:17:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceaced2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacadf80 0x55ecead078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacd6050 0x55eceacdb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc6564cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eceaba8890 con 0x55eceacd6050 2023-10-10T22:17:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc6564cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eceabc3ea0 con 0x55eceacacdc0 2023-10-10T22:17:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc6564cb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eceaa7fe30 con 0x55eceacadf80 2023-10-10T22:17:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc6564cb80 10 client.0 _ll_register_callbacks cb 0x55eceac70110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T22:17:53.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc5559c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacd6050 0x55eceacdb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc5559c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacd6050 0x55eceacdb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56316/0 (socket says 172.21.15.154:56316) 2023-10-10T22:17:53.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc5559c700 1 -- 172.21.15.154:0/804421434 learned_addr learned my addr 172.21.15.154:0/804421434 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:53.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc5559c700 1 -- 172.21.15.154:0/804421434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacadf80 msgr2=0x55ecead078a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.230+0000 7efc5559c700 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacadf80 0x55ecead078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc5559c700 1 -- 172.21.15.154:0/804421434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 msgr2=0x55eceaced2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc54d9b700 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceaced2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc5559c700 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceaced2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc5559c700 1 -- 172.21.15.154:0/804421434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5016a5a0 con 0x55eceacd6050 2023-10-10T22:17:53.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc54d9b700 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceaced2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:17:53.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc5559c700 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacd6050 0x55eceacdb920 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7efc4800b6c0 tx=0x7efc48019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e107a0edf6f50e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc2effd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T22:17:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc2effd700 1 -- 172.21.15.154:0/804421434 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48023070 con 0x55eceacd6050 2023-10-10T22:17:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc6564cb80 1 -- 172.21.15.154:0/804421434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eceaca1b70 con 0x55eceacd6050 2023-10-10T22:17:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc2effd700 1 -- 172.21.15.154:0/804421434 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7efc4801e630 con 0x55eceacd6050 2023-10-10T22:17:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc2effd700 1 -- 172.21.15.154:0/804421434 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc4801ea00 con 0x55eceacd6050 2023-10-10T22:17:53.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc6564cb80 10 client.8820 fetch_fsmap learned FSMap version 70 2023-10-10T22:17:53.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.231+0000 7efc6564cb80 1 -- 172.21.15.154:0/804421434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55eceaa39fe0 con 0x55eceacd6050 2023-10-10T22:17:53.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc2effd700 1 -- 172.21.15.154:0/804421434 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eceaca1b70 con 0x55eceacd6050 2023-10-10T22:17:53.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc2effd700 1 -- 172.21.15.154:0/804421434 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efc4801eb60 con 0x55eceacd6050 2023-10-10T22:17:53.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc6564cb80 10 client.8820 fetch_fsmap finished waiting for FSMap version 70 2023-10-10T22:17:53.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc6564cb80 10 client.8820 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-10T22:17:53.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc6564cb80 20 client.8820 populate_metadata read hostname 'smithi154' 2023-10-10T22:17:53.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc6564cb80 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] conn(0x55eceacdbe60 0x55eceacd9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc6564cb80 4 client.8820 mds_command: new command op to 8640 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T22:17:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc6564cb80 1 -- 172.21.15.154:0/804421434 --> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eceac7eaa0 con 0x55eceacdbe60 2023-10-10T22:17:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc54d9b700 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] conn(0x55eceacdbe60 0x55eceacd9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc54d9b700 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] conn(0x55eceacdbe60 0x55eceacd9180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=589b59e51be98cae server_cookie=2bbf08a866a76a61 in_seq=0 out_seq=0 2023-10-10T22:17:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.232+0000 7efc2effd700 10 client.8820 ms_handle_connect on v2:172.21.15.154:6832/3925813058 2023-10-10T22:17:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc2effd700 1 -- 172.21.15.154:0/804421434 <== mds.0 v2:172.21.15.154:6832/3925813058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55eceac7eaa0 con 0x55eceacdbe60 2023-10-10T22:17:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc2effd700 10 client.8820 handle_command_reply: tid=0 2023-10-10T22:17:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc6564cb80 1 client.8820 shutdown 2023-10-10T22:17:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc6564cb80 1 -- 172.21.15.154:0/804421434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacd6050 msgr2=0x55eceacdb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc6564cb80 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacd6050 0x55eceacdb920 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7efc4800b6c0 tx=0x7efc48019000 comp rx=0 tx=0).stop 2023-10-10T22:17:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc6564cb80 1 -- 172.21.15.154:0/804421434 shutdown_connections 2023-10-10T22:17:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc6564cb80 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] conn(0x55eceacdbe60 0x55eceacd9180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc6564cb80 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacd6050 0x55eceacdb920 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc6564cb80 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceaced2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc6564cb80 1 --2- 172.21.15.154:0/804421434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacadf80 0x55ecead078a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.233+0000 7efc6564cb80 1 -- 172.21.15.154:0/804421434 >> 172.21.15.154:0/804421434 conn(0x55eceacae370 msgr2=0x55eceaca7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.234+0000 7efc2effd700 0 client.8820 ms_handle_reset on v2:172.21.15.154:6832/3925813058 2023-10-10T22:17:53.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.234+0000 7efc6564cb80 1 -- 172.21.15.154:0/804421434 shutdown_connections 2023-10-10T22:17:53.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.234+0000 7efc6564cb80 1 -- 172.21.15.154:0/804421434 wait complete. 2023-10-10T22:17:53.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.234+0000 7efc6564cb80 20 client.8820 trim_cache size 0 max 16384 2023-10-10T22:17:53.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.251+0000 7efc6564cb80 1 Processor -- start 2023-10-10T22:17:53.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.251+0000 7efc6564cb80 1 -- start start 2023-10-10T22:17:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceaca7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead06390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacd6050 0x55ecead068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc6564cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eceaced370 con 0x55eceacadf80 2023-10-10T22:17:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc6564cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eceacdade0 con 0x55eceacacdc0 2023-10-10T22:17:53.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc6564cb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eceac8c510 con 0x55eceacd6050 2023-10-10T22:17:53.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc4ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead06390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc4ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead06390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56328/0 (socket says 172.21.15.154:56328) 2023-10-10T22:17:53.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc4ffff700 1 -- 172.21.15.154:0/2710355083 learned_addr learned my addr 172.21.15.154:0/2710355083 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:53.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc54d9b700 1 --2- 172.21.15.154:0/2710355083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceaca7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc5559c700 1 --2- 172.21.15.154:0/2710355083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacd6050 0x55ecead068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc4ffff700 1 -- 172.21.15.154:0/2710355083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacd6050 msgr2=0x55ecead068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc4ffff700 1 --2- 172.21.15.154:0/2710355083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacd6050 0x55ecead068d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc4ffff700 1 -- 172.21.15.154:0/2710355083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 msgr2=0x55eceaca7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc4ffff700 1 --2- 172.21.15.154:0/2710355083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceaca7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc4ffff700 1 -- 172.21.15.154:0/2710355083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eceabcb780 con 0x55eceacadf80 2023-10-10T22:17:53.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.252+0000 7efc4ffff700 1 --2- 172.21.15.154:0/2710355083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead06390 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7efc3c055ff0 tx=0x7efc3c06c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df54bd506b626057 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc3a7fc700 1 -- 172.21.15.154:0/2710355083 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c058be0 con 0x55eceacadf80 2023-10-10T22:17:53.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc3a7fc700 1 -- 172.21.15.154:0/2710355083 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c053ad0 con 0x55eceacadf80 2023-10-10T22:17:53.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc3a7fc700 1 -- 172.21.15.154:0/2710355083 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c012c50 con 0x55eceacadf80 2023-10-10T22:17:53.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc6564cb80 1 -- 172.21.15.154:0/2710355083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 msgr2=0x55ecead06390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc6564cb80 1 --2- 172.21.15.154:0/2710355083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead06390 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7efc3c055ff0 tx=0x7efc3c06c000 comp rx=0 tx=0).stop 2023-10-10T22:17:53.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc6564cb80 1 -- 172.21.15.154:0/2710355083 shutdown_connections 2023-10-10T22:17:53.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc6564cb80 1 --2- 172.21.15.154:0/2710355083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacd6050 0x55ecead068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc6564cb80 1 --2- 172.21.15.154:0/2710355083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacacdc0 0x55eceaca7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc6564cb80 1 --2- 172.21.15.154:0/2710355083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead06390 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc6564cb80 1 -- 172.21.15.154:0/2710355083 >> 172.21.15.154:0/2710355083 conn(0x55eceacae370 msgr2=0x55eceacad5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:53.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc6564cb80 1 -- 172.21.15.154:0/2710355083 shutdown_connections 2023-10-10T22:17:53.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.253+0000 7efc6564cb80 1 -- 172.21.15.154:0/2710355083 wait complete. 2023-10-10T22:17:53.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.254+0000 7efc6564cb80 1 -- start start 2023-10-10T22:17:53.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.254+0000 7efc6564cb80 1 Processor -- start 2023-10-10T22:17:53.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacacdc0 0x55eceacf3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead5cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc6564cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacd6050 0x55ecead5d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc6564cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecead06390 con 0x55eceacadf80 2023-10-10T22:17:53.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc6564cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecead065a0 con 0x55eceacd6050 2023-10-10T22:17:53.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc6564cb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ecead06880 con 0x55eceacacdc0 2023-10-10T22:17:53.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc6564cb80 10 client.0 _ll_register_callbacks cb 0x55eceac70110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T22:17:53.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc4ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead5cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc4ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead5cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56342/0 (socket says 172.21.15.154:56342) 2023-10-10T22:17:53.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc4ffff700 1 -- 172.21.15.154:0/996268714 learned_addr learned my addr 172.21.15.154:0/996268714 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:53.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.255+0000 7efc54d9b700 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacacdc0 0x55eceacf3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc5559c700 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacd6050 0x55ecead5d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc4ffff700 1 -- 172.21.15.154:0/996268714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacacdc0 msgr2=0x55eceacf3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc4ffff700 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacacdc0 0x55eceacf3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc4ffff700 1 -- 172.21.15.154:0/996268714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacd6050 msgr2=0x55ecead5d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc4ffff700 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacd6050 0x55ecead5d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc4ffff700 1 -- 172.21.15.154:0/996268714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eceaa97270 con 0x55eceacadf80 2023-10-10T22:17:53.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc4ffff700 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead5cd50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7efc3c055920 tx=0x7efc3c07f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5638e2640bcd86 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc2effd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T22:17:53.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc2effd700 1 -- 172.21.15.154:0/996268714 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c058be0 con 0x55eceacadf80 2023-10-10T22:17:53.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc2effd700 1 -- 172.21.15.154:0/996268714 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7efc3c055090 con 0x55eceacadf80 2023-10-10T22:17:53.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc6564cb80 1 -- 172.21.15.154:0/996268714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc50168550 con 0x55eceacadf80 2023-10-10T22:17:53.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.256+0000 7efc2effd700 1 -- 172.21.15.154:0/996268714 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc3c066ee0 con 0x55eceacadf80 2023-10-10T22:17:53.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc6564cb80 10 client.8826 fetch_fsmap learned FSMap version 70 2023-10-10T22:17:53.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc6564cb80 1 -- 172.21.15.154:0/996268714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55eceabb2470 con 0x55eceacadf80 2023-10-10T22:17:53.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc2effd700 1 -- 172.21.15.154:0/996268714 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc50168550 con 0x55eceacadf80 2023-10-10T22:17:53.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc2effd700 1 -- 172.21.15.154:0/996268714 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efc3c05c4a0 con 0x55eceacadf80 2023-10-10T22:17:53.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc6564cb80 10 client.8826 fetch_fsmap finished waiting for FSMap version 70 2023-10-10T22:17:53.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc6564cb80 10 client.8826 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-10T22:17:53.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc6564cb80 20 client.8826 populate_metadata read hostname 'smithi154' 2023-10-10T22:17:53.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc6564cb80 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] conn(0x55eceaca8b90 0x55eceaca8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc6564cb80 4 client.8826 mds_command: new command op to 8640 tid=0[{"prefix": "status"}] 2023-10-10T22:17:53.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc6564cb80 1 -- 172.21.15.154:0/996268714 --> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7efc3c05c930 con 0x55eceaca8b90 2023-10-10T22:17:53.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.257+0000 7efc54d9b700 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] conn(0x55eceaca8b90 0x55eceaca8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc2effd700 10 client.8826 ms_handle_connect on v2:172.21.15.154:6832/3925813058 2023-10-10T22:17:53.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc54d9b700 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] conn(0x55eceaca8b90 0x55eceaca8f60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2163f6e3ce6533f server_cookie=50f8c65bb56b829a in_seq=0 out_seq=0 2023-10-10T22:17:53.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc2effd700 1 -- 172.21.15.154:0/996268714 <== mds.0 v2:172.21.15.154:6832/3925813058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7efc3c05c930 con 0x55eceaca8b90 2023-10-10T22:17:53.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc2effd700 10 client.8826 handle_command_reply: tid=0 2023-10-10T22:17:53.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 client.8826 shutdown 2023-10-10T22:17:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 -- 172.21.15.154:0/996268714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 msgr2=0x55ecead5cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead5cd50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7efc3c055920 tx=0x7efc3c07f040 comp rx=0 tx=0).stop 2023-10-10T22:17:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 -- 172.21.15.154:0/996268714 shutdown_connections 2023-10-10T22:17:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.154:6832/3925813058,v1:172.21.15.154:6834/3925813058] conn(0x55eceaca8b90 0x55eceaca8f60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eceacd6050 0x55ecead5d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eceacacdc0 0x55eceacf3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 --2- 172.21.15.154:0/996268714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eceacadf80 0x55ecead5cd50 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc2effd700 0 client.8826 ms_handle_reset on v2:172.21.15.154:6832/3925813058 2023-10-10T22:17:53.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 -- 172.21.15.154:0/996268714 >> 172.21.15.154:0/996268714 conn(0x55eceacae370 msgr2=0x55eceaca54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:53.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 -- 172.21.15.154:0/996268714 shutdown_connections 2023-10-10T22:17:53.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 1 -- 172.21.15.154:0/996268714 wait complete. 2023-10-10T22:17:53.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.258+0000 7efc6564cb80 20 client.8826 trim_cache size 0 max 16384 2023-10-10T22:17:53.277 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:17:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T22:17:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T22:17:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 8640, 2023-10-10T22:17:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T22:17:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T22:17:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T22:17:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.285661222, 2023-10-10T22:17:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 70, 2023-10-10T22:17:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 161, 2023-10-10T22:17:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 161, 2023-10-10T22:17:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.515666552999999 2023-10-10T22:17:53.279 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:17:53.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 -- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7efc34066f30 msgr2=0x7efc340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7efc34066f30 0x7efc340693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc44007fd0 tx=0x7efc44007d30 comp rx=0 tx=0).stop 2023-10-10T22:17:53.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 -- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500cbf30 msgr2=0x7efc50146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500cbf30 0x7efc50146ed0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00d890 tx=0x7efc3c008040 comp rx=0 tx=0).stop 2023-10-10T22:17:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 -- 172.21.15.154:0/3441756507 shutdown_connections 2023-10-10T22:17:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc500ccf90 0x7efc5016acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc500b1420 0x7efc50169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7efc34066f30 0x7efc340693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 --2- 172.21.15.154:0/3441756507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc500cbf30 0x7efc50146ed0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 -- 172.21.15.154:0/3441756507 >> 172.21.15.154:0/3441756507 conn(0x7efc5006a320 msgr2=0x7efc5006e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 -- 172.21.15.154:0/3441756507 shutdown_connections 2023-10-10T22:17:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.259+0000 7efc56fff700 1 -- 172.21.15.154:0/3441756507 wait complete. 2023-10-10T22:17:53.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T22:17:53.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.466+0000 7f87f37ff700 1 Processor -- start 2023-10-10T22:17:53.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.466+0000 7f87f37ff700 1 -- start start 2023-10-10T22:17:53.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.467+0000 7f87f37ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87ec155c10 0x7f87ec155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.467+0000 7f87f37ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87ec0ac230 0x7f87ec0ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.467+0000 7f87f37ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec0ad930 con 0x7f87ec1568a0 2023-10-10T22:17:53.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.467+0000 7f87f37ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec0acd20 con 0x7f87ec155c10 2023-10-10T22:17:53.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.467+0000 7f87f37ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec0ad000 con 0x7f87ec0ac230 2023-10-10T22:17:53.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87f159b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87ec155c10 0x7f87ec155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87f1d9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f87ec1568a0 0x7f87ec156c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38884/0 (socket says 172.21.15.154:38884) 2023-10-10T22:17:53.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87f1d9c700 1 -- 172.21.15.154:0/2257384158 learned_addr learned my addr 172.21.15.154:0/2257384158 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:53.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87f0d9a700 1 --2- 172.21.15.154:0/2257384158 >> v2:172.21.15.179:3300/0 conn(0x7f87ec0ac230 0x7f87ec0ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87f159b700 1 -- 172.21.15.154:0/2257384158 >> v2:172.21.15.179:3300/0 conn(0x7f87ec0ac230 msgr2=0x7f87ec0ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:53.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87f159b700 1 --2- 172.21.15.154:0/2257384158 >> v2:172.21.15.179:3300/0 conn(0x7f87ec0ac230 0x7f87ec0ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87f159b700 1 -- 172.21.15.154:0/2257384158 >> v1:172.21.15.154:6789/0 conn(0x7f87ec1568a0 legacy=0x7f87ec156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87f159b700 1 -- 172.21.15.154:0/2257384158 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0ad2e0 con 0x7f87ec155c10 2023-10-10T22:17:53.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87e3fff700 1 -- 172.21.15.154:0/2257384158 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968869201 0 0) 0x7f87ec0ad930 con 0x7f87ec1568a0 2023-10-10T22:17:53.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.468+0000 7f87f159b700 1 --2- 172.21.15.154:0/2257384158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec155c10 0x7f87ec155fe0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f87ec065bb0 tx=0x7f87e800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4071dd65e536388a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87e3fff700 1 -- 172.21.15.154:0/2257384158 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800c970 con 0x7f87ec155c10 2023-10-10T22:17:53.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87e3fff700 1 -- 172.21.15.154:0/2257384158 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e800cad0 con 0x7f87ec155c10 2023-10-10T22:17:53.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87e3fff700 1 -- 172.21.15.154:0/2257384158 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800ce70 con 0x7f87ec155c10 2023-10-10T22:17:53.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87f37ff700 1 -- 172.21.15.154:0/2257384158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec155c10 msgr2=0x7f87ec155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87f37ff700 1 --2- 172.21.15.154:0/2257384158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec155c10 0x7f87ec155fe0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f87ec065bb0 tx=0x7f87e800a330 comp rx=0 tx=0).stop 2023-10-10T22:17:53.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87f37ff700 1 -- 172.21.15.154:0/2257384158 shutdown_connections 2023-10-10T22:17:53.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87f37ff700 1 --2- 172.21.15.154:0/2257384158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec155c10 0x7f87ec155fe0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87f37ff700 1 --2- 172.21.15.154:0/2257384158 >> v2:172.21.15.179:3300/0 conn(0x7f87ec0ac230 0x7f87ec0ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87f37ff700 1 -- 172.21.15.154:0/2257384158 >> 172.21.15.154:0/2257384158 conn(0x7f87ec06a320 msgr2=0x7f87ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:53.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87f37ff700 1 -- 172.21.15.154:0/2257384158 shutdown_connections 2023-10-10T22:17:53.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.469+0000 7f87f37ff700 1 -- 172.21.15.154:0/2257384158 wait complete. 2023-10-10T22:17:53.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.471+0000 7f87f37ff700 1 Processor -- start 2023-10-10T22:17:53.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.471+0000 7f87f37ff700 1 -- start start 2023-10-10T22:17:53.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f37ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0ac230 0x7f87ec1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f37ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec155c10 0x7f87ec149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f37ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ec1568a0 0x7f87ec169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f37ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec13fa90 con 0x7f87ec0ac230 2023-10-10T22:17:53.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f37ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec16b0f0 con 0x7f87ec155c10 2023-10-10T22:17:53.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f37ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec16b670 con 0x7f87ec1568a0 2023-10-10T22:17:53.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f159b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0ac230 0x7f87ec1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f159b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0ac230 0x7f87ec1496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56360/0 (socket says 172.21.15.154:56360) 2023-10-10T22:17:53.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f159b700 1 -- 172.21.15.154:0/3676267057 learned_addr learned my addr 172.21.15.154:0/3676267057 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:53.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f0d9a700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec155c10 0x7f87ec149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f1d9c700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ec1568a0 0x7f87ec169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f159b700 1 -- 172.21.15.154:0/3676267057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ec1568a0 msgr2=0x7f87ec169ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f159b700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ec1568a0 0x7f87ec169ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f159b700 1 -- 172.21.15.154:0/3676267057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec155c10 msgr2=0x7f87ec149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f159b700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec155c10 0x7f87ec149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.472+0000 7f87f159b700 1 -- 172.21.15.154:0/3676267057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e800a5d0 con 0x7f87ec0ac230 2023-10-10T22:17:53.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.473+0000 7f87f159b700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0ac230 0x7f87ec1496a0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f87e800a5a0 tx=0x7f87e801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.473+0000 7f87e17fa700 1 -- 172.21.15.154:0/3676267057 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8019e90 con 0x7f87ec0ac230 2023-10-10T22:17:53.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.473+0000 7f87e17fa700 1 -- 172.21.15.154:0/3676267057 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8010600 con 0x7f87ec0ac230 2023-10-10T22:17:53.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.473+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec14a440 con 0x7f87ec0ac230 2023-10-10T22:17:53.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.473+0000 7f87e17fa700 1 -- 172.21.15.154:0/3676267057 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e80109c0 con 0x7f87ec0ac230 2023-10-10T22:17:53.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.473+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec16b300 con 0x7f87ec0ac230 2023-10-10T22:17:53.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.474+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec04c3c0 con 0x7f87ec0ac230 2023-10-10T22:17:53.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.475+0000 7f87e17fa700 1 -- 172.21.15.154:0/3676267057 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87e8010d30 con 0x7f87ec0ac230 2023-10-10T22:17:53.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.476+0000 7f87e17fa700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f87d0066f30 0x7f87d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:53.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.476+0000 7f87e17fa700 1 -- 172.21.15.154:0/3676267057 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f87e8086350 con 0x7f87ec0ac230 2023-10-10T22:17:53.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.476+0000 7f87f0d9a700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f87d0066f30 0x7f87d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:53.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.477+0000 7f87f0d9a700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f87d0066f30 0x7f87d00693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87ec06fcf0 tx=0x7f87dc008040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:53.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.480+0000 7f87e17fa700 1 -- 172.21.15.154:0/3676267057 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87e8053350 con 0x7f87ec0ac230 2023-10-10T22:17:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.714+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f87ec0ad5c0 con 0x7f87ec0ac230 2023-10-10T22:17:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.715+0000 7f87e17fa700 1 -- 172.21.15.154:0/3676267057 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7f87e8056970 con 0x7f87ec0ac230 2023-10-10T22:17:53.717 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T22:17:53.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f87d0066f30 msgr2=0x7f87d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f87d0066f30 0x7f87d00693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87ec06fcf0 tx=0x7f87dc008040 comp rx=0 tx=0).stop 2023-10-10T22:17:53.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0ac230 msgr2=0x7f87ec1496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:53.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0ac230 0x7f87ec1496a0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f87e800a5a0 tx=0x7f87e801a000 comp rx=0 tx=0).stop 2023-10-10T22:17:53.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 shutdown_connections 2023-10-10T22:17:53.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87ec1568a0 0x7f87ec169ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f87d0066f30 0x7f87d00693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0ac230 0x7f87ec1496a0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 --2- 172.21.15.154:0/3676267057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec155c10 0x7f87ec149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:53.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 >> 172.21.15.154:0/3676267057 conn(0x7f87ec06a320 msgr2=0x7f87ec06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:53.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 shutdown_connections 2023-10-10T22:17:53.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:53.717+0000 7f87f37ff700 1 -- 172.21.15.154:0/3676267057 wait complete. 2023-10-10T22:17:53.736 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T22:17:53.736 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T22:17:53.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T22:17:53.737 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T22:17:53.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T22:17:53.737 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T22:17:53.738 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T22:17:53.738 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T22:17:53.738 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:17:53.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:17:53.739 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T22:17:53.777 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T22:17:53.777 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T22:17:53.777 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T22:17:53.778 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:17:53.778 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T22:17:53.778 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:17:53.778 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:17:53.779 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:17:53.779 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T22:17:53.779 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:17:53.779 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:17:53.779 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T22:17:53.780 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:17:53.782 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:17:53.782 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T22:17:53.782 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:17:53.782 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T22:17:53.782 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 37740sec preferred_lft 37740sec 2023-10-10T22:17:53.783 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T22:17:53.783 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:17:53.783 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T22:17:53.783 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:17:53.783 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T22:17:53.784 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:17:53.784 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T22:17:53.784 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:17:53.784 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T22:17:53.785 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T22:17:53.785 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T22:17:53.785 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:17:53.785 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T22:17:53.785 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T22:17:53.786 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T22:17:53.786 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:17:53.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:17:53.787 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T22:17:53.876 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T22:17:53.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:17:53.880 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T22:17:53.919 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T22:17:53.919 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T22:17:53.919 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T22:17:53.919 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T22:17:53.919 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T22:17:53.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:17:53.921 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T22:17:53.921 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T22:17:53.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T22:17:53.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T22:17:53.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T22:17:53.923 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T22:17:54.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:17:54.118 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T22:17:54.155 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T22:17:54.155 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T22:17:54.156 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:17:54.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:17:54.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T22:17:54.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T22:17:54.258 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T22:17:54.295 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:17:54.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T22:17:54.296 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T22:17:54.371 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T22:17:54.372 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T22:17:54.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:17:54.502 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:17:54.503 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:17:54.503 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:17:54.519 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:17:54.520 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:17:54.520 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:17:54.520 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T22:17:54.520 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T22:17:54.540 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:17:54.541 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:17:54.541 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:17:54.541 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T22:17:54.541 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T22:17:54.542 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T22:17:54.542 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T22:17:54.542 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T22:17:54.545 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T22:17:54.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:17:54.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T22:17:54.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T22:17:54.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.791+0000 7f196e7ff700 1 Processor -- start 2023-10-10T22:17:54.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.791+0000 7f196e7ff700 1 -- start start 2023-10-10T22:17:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.792+0000 7f196e7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19680b1420 0x7f19680ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.792+0000 7f196e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680ccf90 0x7f19680c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.792+0000 7f196e7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19680cc300 con 0x7f19680cbf30 2023-10-10T22:17:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.792+0000 7f196e7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1968156bf0 con 0x7f19680b1420 2023-10-10T22:17:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.792+0000 7f196e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19680ae950 con 0x7f19680ccf90 2023-10-10T22:17:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.793+0000 7f196cd9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680ccf90 0x7f19680c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.793+0000 7f19677fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19680b1420 0x7f19680ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.793+0000 7f196cd9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680ccf90 0x7f19680c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:49838/0 (socket says 172.21.15.154:49838) 2023-10-10T22:17:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.793+0000 7f196cd9c700 1 -- 172.21.15.154:0/1597279547 learned_addr learned my addr 172.21.15.154:0/1597279547 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.793+0000 7f1967fff700 1 --1- 172.21.15.154:0/1597279547 >> v1:172.21.15.179:6789/0 conn(0x7f19680cbf30 0x7f19680b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:49710/0 (socket says 172.21.15.154:49710) 2023-10-10T22:17:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.793+0000 7f196cd9c700 1 -- 172.21.15.154:0/1597279547 >> v2:172.21.15.179:3300/0 conn(0x7f19680b1420 msgr2=0x7f19680ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:54.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.793+0000 7f196cd9c700 1 --2- 172.21.15.154:0/1597279547 >> v2:172.21.15.179:3300/0 conn(0x7f19680b1420 0x7f19680ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:54.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.793+0000 7f196cd9c700 1 -- 172.21.15.154:0/1597279547 >> v1:172.21.15.179:6789/0 conn(0x7f19680cbf30 legacy=0x7f19680b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:54.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.793+0000 7f196cd9c700 1 -- 172.21.15.154:0/1597279547 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19680ad370 con 0x7f19680ccf90 2023-10-10T22:17:54.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.794+0000 7f196cd9c700 1 --2- 172.21.15.154:0/1597279547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680ccf90 0x7f19680c9740 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1960009f20 tx=0x7f1960009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53ecb078e0ba4aa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:54.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.794+0000 7f1966ffd700 1 -- 172.21.15.154:0/1597279547 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196000e070 con 0x7f19680ccf90 2023-10-10T22:17:54.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.794+0000 7f1966ffd700 1 -- 172.21.15.154:0/1597279547 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196000b9d0 con 0x7f19680ccf90 2023-10-10T22:17:54.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.794+0000 7f1966ffd700 1 -- 172.21.15.154:0/1597279547 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600092e0 con 0x7f19680ccf90 2023-10-10T22:17:54.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.794+0000 7f196e7ff700 1 -- 172.21.15.154:0/1597279547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680ccf90 msgr2=0x7f19680c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:54.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.795+0000 7f196e7ff700 1 --2- 172.21.15.154:0/1597279547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680ccf90 0x7f19680c9740 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1960009f20 tx=0x7f1960009840 comp rx=0 tx=0).stop 2023-10-10T22:17:54.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.795+0000 7f196e7ff700 1 -- 172.21.15.154:0/1597279547 shutdown_connections 2023-10-10T22:17:54.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.795+0000 7f196e7ff700 1 --2- 172.21.15.154:0/1597279547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680ccf90 0x7f19680c9740 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:54.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.795+0000 7f196e7ff700 1 --2- 172.21.15.154:0/1597279547 >> v2:172.21.15.179:3300/0 conn(0x7f19680b1420 0x7f19680ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:54.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.795+0000 7f196e7ff700 1 -- 172.21.15.154:0/1597279547 >> 172.21.15.154:0/1597279547 conn(0x7f196806a320 msgr2=0x7f19680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:54.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.795+0000 7f196e7ff700 1 -- 172.21.15.154:0/1597279547 shutdown_connections 2023-10-10T22:17:54.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.795+0000 7f196e7ff700 1 -- 172.21.15.154:0/1597279547 wait complete. 2023-10-10T22:17:54.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.796+0000 7f196e7ff700 1 Processor -- start 2023-10-10T22:17:54.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.796+0000 7f196e7ff700 1 -- start start 2023-10-10T22:17:54.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.797+0000 7f196e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680b1420 0x7f1968159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:54.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.797+0000 7f196e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19680cbf30 0x7f1968159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:54.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.797+0000 7f196e7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19680ccf90 0x7f196815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:54.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.797+0000 7f196e7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19681517a0 con 0x7f19680ccf90 2023-10-10T22:17:54.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.797+0000 7f196e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19681592e0 con 0x7f19680cbf30 2023-10-10T22:17:54.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.797+0000 7f196e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19681589f0 con 0x7f19680b1420 2023-10-10T22:17:54.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.797+0000 7f196cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19680ccf90 0x7f196815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:54.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f196cd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19680ccf90 0x7f196815a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56372/0 (socket says 172.21.15.154:56372) 2023-10-10T22:17:54.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f196cd9c700 1 -- 172.21.15.154:0/981903539 learned_addr learned my addr 172.21.15.154:0/981903539 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:54.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f1967fff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680b1420 0x7f1968159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f19677fe700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19680cbf30 0x7f1968159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f196cd9c700 1 -- 172.21.15.154:0/981903539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680b1420 msgr2=0x7f1968159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f196cd9c700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680b1420 0x7f1968159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f196cd9c700 1 -- 172.21.15.154:0/981903539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19680cbf30 msgr2=0x7f1968159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:54.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f196cd9c700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19680cbf30 0x7f1968159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:54.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f196cd9c700 1 -- 172.21.15.154:0/981903539 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1960009ae0 con 0x7f19680ccf90 2023-10-10T22:17:54.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f196cd9c700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19680ccf90 0x7f196815a1f0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f196000b610 tx=0x7f1960018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:54.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.798+0000 7f194ffff700 1 -- 172.21.15.154:0/981903539 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960008b10 con 0x7f19680ccf90 2023-10-10T22:17:54.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.799+0000 7f194ffff700 1 -- 172.21.15.154:0/981903539 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1960008cb0 con 0x7f19680ccf90 2023-10-10T22:17:54.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.799+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1968158c90 con 0x7f19680ccf90 2023-10-10T22:17:54.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.799+0000 7f194ffff700 1 -- 172.21.15.154:0/981903539 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600256b0 con 0x7f19680ccf90 2023-10-10T22:17:54.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.799+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19680c2fb0 con 0x7f19680ccf90 2023-10-10T22:17:54.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.800+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196804c3c0 con 0x7f19680ccf90 2023-10-10T22:17:54.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.801+0000 7f194ffff700 1 -- 172.21.15.154:0/981903539 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1960003040 con 0x7f19680ccf90 2023-10-10T22:17:54.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.801+0000 7f194ffff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1954066f30 0x7f19540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:54.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.802+0000 7f194ffff700 1 -- 172.21.15.154:0/981903539 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f1960086260 con 0x7f19680ccf90 2023-10-10T22:17:54.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.802+0000 7f1967fff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1954066f30 0x7f19540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:54.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.802+0000 7f1967fff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1954066f30 0x7f19540693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1958004fd0 tx=0x7f1958007eb0 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:54.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:54.806+0000 7f194ffff700 1 -- 172.21.15.154:0/981903539 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1960053300 con 0x7f19680ccf90 2023-10-10T22:17:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.026+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f19680ad650 con 0x7f1954066f30 2023-10-10T22:17:55.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.028+0000 7f194ffff700 1 -- 172.21.15.154:0/981903539 <== mgr.8481 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f19680ad650 con 0x7f1954066f30 2023-10-10T22:17:55.030 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T22:17:55.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:17:55.030 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T22:17:55.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:17:55.031 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T22:17:55.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.030+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1954066f30 msgr2=0x7f19540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.030+0000 7f196e7ff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1954066f30 0x7f19540693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1958004fd0 tx=0x7f1958007eb0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.030+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19680ccf90 msgr2=0x7f196815a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.030+0000 7f196e7ff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19680ccf90 0x7f196815a1f0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f196000b610 tx=0x7f1960018000 comp rx=0 tx=0).stop 2023-10-10T22:17:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.031+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 shutdown_connections 2023-10-10T22:17:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.031+0000 7f196e7ff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f1954066f30 0x7f19540693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.031+0000 7f196e7ff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19680ccf90 0x7f196815a1f0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.031+0000 7f196e7ff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19680b1420 0x7f1968159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.031+0000 7f196e7ff700 1 --2- 172.21.15.154:0/981903539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19680cbf30 0x7f1968159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.031+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 >> 172.21.15.154:0/981903539 conn(0x7f196806a320 msgr2=0x7f19680caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:55.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.031+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 shutdown_connections 2023-10-10T22:17:55.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.031+0000 7f196e7ff700 1 -- 172.21.15.154:0/981903539 wait complete. 2023-10-10T22:17:55.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T22:17:55.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.240+0000 7f080619d700 1 Processor -- start 2023-10-10T22:17:55.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.241+0000 7f080619d700 1 -- start start 2023-10-10T22:17:55.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.242+0000 7f080619d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0800140bb0 0x7f080006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:55.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.242+0000 7f080619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080006da30 0x7f08000c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:55.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.242+0000 7f080619d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08000c6820 con 0x7f08001407e0 2023-10-10T22:17:55.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.242+0000 7f080619d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080006deb0 con 0x7f0800140bb0 2023-10-10T22:17:55.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.242+0000 7f080619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08000c6de0 con 0x7f080006da30 2023-10-10T22:17:55.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080499a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0800140bb0 0x7f080006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:55.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080599c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080006da30 0x7f08000c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:55.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080519b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f08001407e0 0x7f080006a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:49726/0 (socket says 172.21.15.154:49726) 2023-10-10T22:17:55.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080519b700 1 -- 172.21.15.154:0/13274528 learned_addr learned my addr 172.21.15.154:0/13274528 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:55.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f07f7fff700 1 -- 172.21.15.154:0/13274528 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468726660 0 0) 0x7f08000c6820 con 0x7f08001407e0 2023-10-10T22:17:55.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f07f7fff700 1 -- 172.21.15.154:0/13274528 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ec003570 con 0x7f08001407e0 2023-10-10T22:17:55.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080499a700 1 -- 172.21.15.154:0/13274528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080006da30 msgr2=0x7f08000c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:55.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080499a700 1 --2- 172.21.15.154:0/13274528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080006da30 0x7f08000c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080499a700 1 -- 172.21.15.154:0/13274528 >> v1:172.21.15.179:6789/0 conn(0x7f08001407e0 legacy=0x7f080006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:55.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080499a700 1 -- 172.21.15.154:0/13274528 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800141270 con 0x7f0800140bb0 2023-10-10T22:17:55.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080599c700 1 --2- 172.21.15.154:0/13274528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080006da30 0x7f08000c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:55.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.243+0000 7f080499a700 1 --2- 172.21.15.154:0/13274528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0800140bb0 0x7f080006d4f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f07f00098e0 tx=0x7f07f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff25ad57889bfb4b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:55.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f07f7fff700 1 -- 172.21.15.154:0/13274528 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011630 con 0x7f0800140bb0 2023-10-10T22:17:55.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f07f7fff700 1 -- 172.21.15.154:0/13274528 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0011790 con 0x7f0800140bb0 2023-10-10T22:17:55.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f07f7fff700 1 -- 172.21.15.154:0/13274528 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011b30 con 0x7f0800140bb0 2023-10-10T22:17:55.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f080619d700 1 -- 172.21.15.154:0/13274528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0800140bb0 msgr2=0x7f080006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:55.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f080619d700 1 --2- 172.21.15.154:0/13274528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0800140bb0 0x7f080006d4f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f07f00098e0 tx=0x7f07f00091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f080619d700 1 -- 172.21.15.154:0/13274528 shutdown_connections 2023-10-10T22:17:55.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f080619d700 1 --2- 172.21.15.154:0/13274528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080006da30 0x7f08000c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f080619d700 1 --2- 172.21.15.154:0/13274528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0800140bb0 0x7f080006d4f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f080619d700 1 -- 172.21.15.154:0/13274528 >> 172.21.15.154:0/13274528 conn(0x7f08000cc1e0 msgr2=0x7f08000cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:55.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f080619d700 1 -- 172.21.15.154:0/13274528 shutdown_connections 2023-10-10T22:17:55.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.244+0000 7f080619d700 1 -- 172.21.15.154:0/13274528 wait complete. 2023-10-10T22:17:55.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.246+0000 7f080619d700 1 Processor -- start 2023-10-10T22:17:55.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.246+0000 7f080619d700 1 -- start start 2023-10-10T22:17:55.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080619d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080006da30 0x7f080013c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:55.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08001407e0 0x7f080013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:55.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080619d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0800140bb0 0x7f080016a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:55.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080619d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080015e4a0 con 0x7f0800140bb0 2023-10-10T22:17:55.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080619d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080013eda0 con 0x7f080006da30 2023-10-10T22:17:55.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080013e190 con 0x7f08001407e0 2023-10-10T22:17:55.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080599c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0800140bb0 0x7f080016a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:55.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080599c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0800140bb0 0x7f080016a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56378/0 (socket says 172.21.15.154:56378) 2023-10-10T22:17:55.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080599c700 1 -- 172.21.15.154:0/1015319667 learned_addr learned my addr 172.21.15.154:0/1015319667 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:55.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080519b700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080006da30 0x7f080013c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:55.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.247+0000 7f080499a700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08001407e0 0x7f080013f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:55.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f080599c700 1 -- 172.21.15.154:0/1015319667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08001407e0 msgr2=0x7f080013f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:55.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f080599c700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08001407e0 0x7f080013f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f080599c700 1 -- 172.21.15.154:0/1015319667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080006da30 msgr2=0x7f080013c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:55.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f080599c700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080006da30 0x7f080013c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:55.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f080599c700 1 -- 172.21.15.154:0/1015319667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f8009a20 con 0x7f0800140bb0 2023-10-10T22:17:55.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f080519b700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080006da30 0x7f080013c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:55.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f080599c700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0800140bb0 0x7f080016a230 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009fc0 tx=0x7f07f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:55.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f07f57fa700 1 -- 172.21.15.154:0/1015319667 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800cbd0 con 0x7f0800140bb0 2023-10-10T22:17:55.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f07f57fa700 1 -- 172.21.15.154:0/1015319667 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f800f040 con 0x7f0800140bb0 2023-10-10T22:17:55.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f07f57fa700 1 -- 172.21.15.154:0/1015319667 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8014480 con 0x7f0800140bb0 2023-10-10T22:17:55.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.248+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f0009420 con 0x7f0800140bb0 2023-10-10T22:17:55.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.249+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080013e750 con 0x7f0800140bb0 2023-10-10T22:17:55.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.249+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080013ef10 con 0x7f0800140bb0 2023-10-10T22:17:55.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.250+0000 7f07f57fa700 1 -- 172.21.15.154:0/1015319667 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 73) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07f8003020 con 0x7f0800140bb0 2023-10-10T22:17:55.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.251+0000 7f07f57fa700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f07e4066f30 0x7f07e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:55.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.251+0000 7f07f57fa700 1 -- 172.21.15.154:0/1015319667 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f07f8085020 con 0x7f0800140bb0 2023-10-10T22:17:55.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.252+0000 7f080519b700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f07e4066f30 0x7f07e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:55.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.252+0000 7f080519b700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f07e4066f30 0x7f07e40693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07fc007fd0 tx=0x7f07fc009040 comp rx=0 tx=0).ready entity=mgr.8481 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:55.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.255+0000 7f07f57fa700 1 -- 172.21.15.154:0/1015319667 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07f80520c0 con 0x7f0800140bb0 2023-10-10T22:17:55.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:55.513+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f080006acf0 con 0x7f0800140bb0 2023-10-10T22:17:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.033+0000 7f07f57fa700 1 -- 172.21.15.154:0/1015319667 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 74) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f07f8052490 con 0x7f0800140bb0 2023-10-10T22:17:56.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.035+0000 7f07f57fa700 1 -- 172.21.15.154:0/1015319667 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v74) v1 ==== 92+0+0 (secure 0 0 0) 0x7f07f80520c0 con 0x7f0800140bb0 2023-10-10T22:17:56.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f07e4066f30 msgr2=0x7f07e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f07e4066f30 0x7f07e40693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07fc007fd0 tx=0x7f07fc009040 comp rx=0 tx=0).stop 2023-10-10T22:17:56.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0800140bb0 msgr2=0x7f080016a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0800140bb0 0x7f080016a230 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009fc0 tx=0x7f07f800b040 comp rx=0 tx=0).stop 2023-10-10T22:17:56.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 shutdown_connections 2023-10-10T22:17:56.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f07e4066f30 0x7f07e40693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0800140bb0 0x7f080016a230 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080006da30 0x7f080013c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 --2- 172.21.15.154:0/1015319667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08001407e0 0x7f080013f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 >> 172.21.15.154:0/1015319667 conn(0x7f08000cc1e0 msgr2=0x7f08000c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:56.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 shutdown_connections 2023-10-10T22:17:56.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.038+0000 7f080619d700 1 -- 172.21.15.154:0/1015319667 wait complete. 2023-10-10T22:17:56.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T22:17:56.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.272+0000 7f32ca39d700 1 Processor -- start 2023-10-10T22:17:56.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.272+0000 7f32ca39d700 1 -- start start 2023-10-10T22:17:56.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.273+0000 7f32ca39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b16d0 0x7f32c40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.273+0000 7f32ca39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c40b2080 con 0x7f32c40b4e70 2023-10-10T22:17:56.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.273+0000 7f32ca39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c40cfb00 con 0x7f32c40b33b0 2023-10-10T22:17:56.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.273+0000 7f32ca39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40b5c40 con 0x7f32c40b16d0 2023-10-10T22:17:56.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32c939b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f32c40b4e70 0x7f32c40ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34832/0 (socket says 172.21.15.154:34832) 2023-10-10T22:17:56.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32c939b700 1 -- 172.21.15.154:0/92968986 learned_addr learned my addr 172.21.15.154:0/92968986 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:17:56.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32c8b9a700 1 --2- 172.21.15.154:0/92968986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b16d0 0x7f32c40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32bbfff700 1 -- 172.21.15.154:0/92968986 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207083866 0 0) 0x7f32c40b2080 con 0x7f32c40b4e70 2023-10-10T22:17:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32bbfff700 1 -- 172.21.15.154:0/92968986 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b0003570 con 0x7f32c40b4e70 2023-10-10T22:17:56.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32bbfff700 1 -- 172.21.15.154:0/92968986 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784497190 0 0) 0x7f32c40cfb00 con 0x7f32c40b33b0 2023-10-10T22:17:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32bbfff700 1 -- 172.21.15.154:0/92968986 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c40b2080 con 0x7f32c40b33b0 2023-10-10T22:17:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32bbfff700 1 -- 172.21.15.154:0/92968986 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3618366288 0 0) 0x7f32b0003570 con 0x7f32c40b4e70 2023-10-10T22:17:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32c8b9a700 1 -- 172.21.15.154:0/92968986 >> v1:172.21.15.179:6789/0 conn(0x7f32c40b33b0 legacy=0x7f32c40b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32c8b9a700 1 -- 172.21.15.154:0/92968986 >> v1:172.21.15.154:6789/0 conn(0x7f32c40b4e70 legacy=0x7f32c40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.274+0000 7f32c8b9a700 1 -- 172.21.15.154:0/92968986 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40b5f20 con 0x7f32c40b16d0 2023-10-10T22:17:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.275+0000 7f32c8b9a700 1 --2- 172.21.15.154:0/92968986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b16d0 0x7f32c40b1b40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009910 tx=0x7f32b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1b8b0ae41cfd5f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.275+0000 7f32bbfff700 1 -- 172.21.15.154:0/92968986 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0001470 con 0x7f32c40b16d0 2023-10-10T22:17:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.275+0000 7f32bbfff700 1 -- 172.21.15.154:0/92968986 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b4011420 con 0x7f32c40b16d0 2023-10-10T22:17:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.275+0000 7f32bbfff700 1 -- 172.21.15.154:0/92968986 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40117c0 con 0x7f32c40b16d0 2023-10-10T22:17:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.276+0000 7f32ca39d700 1 -- 172.21.15.154:0/92968986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b16d0 msgr2=0x7f32c40b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.276+0000 7f32ca39d700 1 --2- 172.21.15.154:0/92968986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b16d0 0x7f32c40b1b40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009910 tx=0x7f32b40091a0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.276+0000 7f32ca39d700 1 -- 172.21.15.154:0/92968986 shutdown_connections 2023-10-10T22:17:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.276+0000 7f32ca39d700 1 --2- 172.21.15.154:0/92968986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b16d0 0x7f32c40b1b40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.276+0000 7f32ca39d700 1 -- 172.21.15.154:0/92968986 >> 172.21.15.154:0/92968986 conn(0x7f32c40d10c0 msgr2=0x7f32c40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.276+0000 7f32ca39d700 1 -- 172.21.15.154:0/92968986 shutdown_connections 2023-10-10T22:17:56.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.276+0000 7f32ca39d700 1 -- 172.21.15.154:0/92968986 wait complete. 2023-10-10T22:17:56.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.278+0000 7f32ca39d700 1 Processor -- start 2023-10-10T22:17:56.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.278+0000 7f32ca39d700 1 -- start start 2023-10-10T22:17:56.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.279+0000 7f32ca39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40b16d0 0x7f32c4154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.279+0000 7f32ca39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b33b0 0x7f32c40c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.279+0000 7f32ca39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32c40b4e70 0x7f32c415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32ca39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40c7a20 con 0x7f32c40b16d0 2023-10-10T22:17:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32ca39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40c6e10 con 0x7f32c40b4e70 2023-10-10T22:17:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32ca39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40c70f0 con 0x7f32c40b33b0 2023-10-10T22:17:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40b16d0 0x7f32c4154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40b16d0 0x7f32c4154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35312/0 (socket says 172.21.15.154:35312) 2023-10-10T22:17:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c939b700 1 -- 172.21.15.154:0/3239604209 learned_addr learned my addr 172.21.15.154:0/3239604209 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c8b9a700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b33b0 0x7f32c40c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c9b9c700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32c40b4e70 0x7f32c415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c939b700 1 -- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b33b0 msgr2=0x7f32c40c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c939b700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b33b0 0x7f32c40c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c939b700 1 -- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32c40b4e70 msgr2=0x7f32c415c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c939b700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32c40b4e70 0x7f32c415c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c939b700 1 -- 172.21.15.154:0/3239604209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b4009420 con 0x7f32c40b16d0 2023-10-10T22:17:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c8b9a700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b33b0 0x7f32c40c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.280+0000 7f32c9b9c700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32c40b4e70 0x7f32c415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:56.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.281+0000 7f32c939b700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40b16d0 0x7f32c4154da0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c7f0 tx=0x7f32c0001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:56.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.281+0000 7f32b97fa700 1 -- 172.21.15.154:0/3239604209 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0007360 con 0x7f32c40b16d0 2023-10-10T22:17:56.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.281+0000 7f32b97fa700 1 -- 172.21.15.154:0/3239604209 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c0007500 con 0x7f32c40b16d0 2023-10-10T22:17:56.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.281+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c40c73d0 con 0x7f32c40b16d0 2023-10-10T22:17:56.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.281+0000 7f32b97fa700 1 -- 172.21.15.154:0/3239604209 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0004a80 con 0x7f32c40b16d0 2023-10-10T22:17:56.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.281+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c41552e0 con 0x7f32c40b16d0 2023-10-10T22:17:56.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.282+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c40c7d00 con 0x7f32c40b16d0 2023-10-10T22:17:56.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.283+0000 7f32b97fa700 1 -- 172.21.15.154:0/3239604209 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 74) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f32c001c3b0 con 0x7f32c40b16d0 2023-10-10T22:17:56.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.284+0000 7f32b97fa700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32a8066f80 0x7f32a8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.284+0000 7f32b97fa700 1 -- 172.21.15.154:0/3239604209 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f32c0083ce0 con 0x7f32c40b16d0 2023-10-10T22:17:56.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.284+0000 7f32c8b9a700 1 -- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32a8066f80 msgr2=0x7f32a8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:56.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.284+0000 7f32c8b9a700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32a8066f80 0x7f32a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:56.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.292+0000 7f32b97fa700 1 -- 172.21.15.154:0/3239604209 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32c004c5a0 con 0x7f32c40b16d0 2023-10-10T22:17:56.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.485+0000 7f32c8b9a700 1 -- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32a8066f80 msgr2=0x7f32a8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:56.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.485+0000 7f32c8b9a700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32a8066f80 0x7f32a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.549+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f32c40af920 con 0x7f32c40b16d0 2023-10-10T22:17:56.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.554+0000 7f32b97fa700 1 -- 172.21.15.154:0/3239604209 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f32c0018020 con 0x7f32c40b16d0 2023-10-10T22:17:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32a8066f80 msgr2=0x7f32a8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32a8066f80 0x7f32a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40b16d0 msgr2=0x7f32c4154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40b16d0 0x7f32c4154da0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c7f0 tx=0x7f32c0001a10 comp rx=0 tx=0).stop 2023-10-10T22:17:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 shutdown_connections 2023-10-10T22:17:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32c40b4e70 0x7f32c415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f32a8066f80 0x7f32a8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40b16d0 0x7f32c4154da0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 --2- 172.21.15.154:0/3239604209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32c40b33b0 0x7f32c40c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 >> 172.21.15.154:0/3239604209 conn(0x7f32c40d10c0 msgr2=0x7f32c40cede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 shutdown_connections 2023-10-10T22:17:56.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.558+0000 7f32ca39d700 1 -- 172.21.15.154:0/3239604209 wait complete. 2023-10-10T22:17:56.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T22:17:56.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.772+0000 7f714cdff700 1 Processor -- start 2023-10-10T22:17:56.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.772+0000 7f714cdff700 1 -- start start 2023-10-10T22:17:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.774+0000 7f714cdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7148156490 0x7f71480c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.774+0000 7f714cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71480ccee0 0x7f71480c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.774+0000 7f714cdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71480c7a70 con 0x7f7148156860 2023-10-10T22:17:56.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.774+0000 7f714cdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714815a450 con 0x7f7148156490 2023-10-10T22:17:56.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.774+0000 7f714cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714815a730 con 0x7f71480ccee0 2023-10-10T22:17:56.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f7145d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71480ccee0 0x7f71480c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:56.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f714659c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7148156490 0x7f71480c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:56.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f7145d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71480ccee0 0x7f71480c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:46686/0 (socket says 172.21.15.154:46686) 2023-10-10T22:17:56.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f7146d9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7148156860 0x7f714806eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:39278/0 (socket says 172.21.15.154:39278) 2023-10-10T22:17:56.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f7145d9b700 1 -- 172.21.15.154:0/1652619205 learned_addr learned my addr 172.21.15.154:0/1652619205 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:56.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f7145d9b700 1 -- 172.21.15.154:0/1652619205 >> v2:172.21.15.179:3300/0 conn(0x7f7148156490 msgr2=0x7f71480c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:56.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f7145d9b700 1 --2- 172.21.15.154:0/1652619205 >> v2:172.21.15.179:3300/0 conn(0x7f7148156490 0x7f71480c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f7145d9b700 1 -- 172.21.15.154:0/1652619205 >> v1:172.21.15.179:6789/0 conn(0x7f7148156860 legacy=0x7f714806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f7145d9b700 1 -- 172.21.15.154:0/1652619205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714815aa10 con 0x7f71480ccee0 2023-10-10T22:17:56.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.775+0000 7f714659c700 1 --2- 172.21.15.154:0/1652619205 >> v2:172.21.15.179:3300/0 conn(0x7f7148156490 0x7f71480c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:56.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.776+0000 7f7145d9b700 1 --2- 172.21.15.154:0/1652619205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71480ccee0 0x7f71480c81a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71480c7c00 tx=0x7f713c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ef57770ef17837 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:56.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.776+0000 7f714559a700 1 -- 172.21.15.154:0/1652619205 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c009e70 con 0x7f71480ccee0 2023-10-10T22:17:56.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.776+0000 7f714559a700 1 -- 172.21.15.154:0/1652619205 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c00b860 con 0x7f71480ccee0 2023-10-10T22:17:56.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.776+0000 7f714559a700 1 -- 172.21.15.154:0/1652619205 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00bc20 con 0x7f71480ccee0 2023-10-10T22:17:56.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.776+0000 7f714cdff700 1 -- 172.21.15.154:0/1652619205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71480ccee0 msgr2=0x7f71480c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.776+0000 7f714cdff700 1 --2- 172.21.15.154:0/1652619205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71480ccee0 0x7f71480c81a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71480c7c00 tx=0x7f713c009250 comp rx=0 tx=0).stop 2023-10-10T22:17:56.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.777+0000 7f714cdff700 1 -- 172.21.15.154:0/1652619205 shutdown_connections 2023-10-10T22:17:56.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.777+0000 7f714cdff700 1 --2- 172.21.15.154:0/1652619205 >> v2:172.21.15.179:3300/0 conn(0x7f7148156490 0x7f71480c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.777+0000 7f714cdff700 1 --2- 172.21.15.154:0/1652619205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71480ccee0 0x7f71480c81a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.777+0000 7f714cdff700 1 -- 172.21.15.154:0/1652619205 >> 172.21.15.154:0/1652619205 conn(0x7f7148068e10 msgr2=0x7f71480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:56.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.777+0000 7f714cdff700 1 -- 172.21.15.154:0/1652619205 shutdown_connections 2023-10-10T22:17:56.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.777+0000 7f714cdff700 1 -- 172.21.15.154:0/1652619205 wait complete. 2023-10-10T22:17:56.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.778+0000 7f714cdff700 1 Processor -- start 2023-10-10T22:17:56.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.778+0000 7f714cdff700 1 -- start start 2023-10-10T22:17:56.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.779+0000 7f714cdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71480ccee0 0x7f714816e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.779+0000 7f714cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7148156490 0x7f71480ab970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.779+0000 7f714cdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7148156860 0x7f7148069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.779+0000 7f714cdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714816d890 con 0x7f7148156860 2023-10-10T22:17:56.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.779+0000 7f714cdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71480ac8b0 con 0x7f71480ccee0 2023-10-10T22:17:56.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.779+0000 7f714cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71480ac2f0 con 0x7f7148156490 2023-10-10T22:17:56.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.779+0000 7f714659c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71480ccee0 0x7f714816e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:56.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.779+0000 7f714659c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71480ccee0 0x7f714816e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:43918/0 (socket says 172.21.15.154:43918) 2023-10-10T22:17:56.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.779+0000 7f714659c700 1 -- 172.21.15.154:0/652129464 learned_addr learned my addr 172.21.15.154:0/652129464 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:56.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.780+0000 7f7146d9d700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7148156860 0x7f7148069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:56.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.780+0000 7f7145d9b700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7148156490 0x7f71480ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:56.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.780+0000 7f7145d9b700 1 -- 172.21.15.154:0/652129464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71480ccee0 msgr2=0x7f714816e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.780+0000 7f7145d9b700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71480ccee0 0x7f714816e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.780+0000 7f7145d9b700 1 -- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7148156860 msgr2=0x7f7148069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.780+0000 7f7145d9b700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7148156860 0x7f7148069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.780+0000 7f7145d9b700 1 -- 172.21.15.154:0/652129464 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7138009420 con 0x7f7148156490 2023-10-10T22:17:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.780+0000 7f714659c700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71480ccee0 0x7f714816e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:56.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.780+0000 7f7145d9b700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7148156490 0x7f71480ab970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f714806d240 tx=0x7f713c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:56.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.781+0000 7f71367fc700 1 -- 172.21.15.154:0/652129464 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c011a60 con 0x7f7148156490 2023-10-10T22:17:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.781+0000 7f71367fc700 1 -- 172.21.15.154:0/652129464 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c020070 con 0x7f7148156490 2023-10-10T22:17:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.781+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0094f0 con 0x7f7148156490 2023-10-10T22:17:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.781+0000 7f71367fc700 1 -- 172.21.15.154:0/652129464 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c011e50 con 0x7f7148156490 2023-10-10T22:17:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.781+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714816db30 con 0x7f7148156490 2023-10-10T22:17:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.782+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714816dd20 con 0x7f7148156490 2023-10-10T22:17:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.783+0000 7f71367fc700 1 -- 172.21.15.154:0/652129464 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 74) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f713c022030 con 0x7f7148156490 2023-10-10T22:17:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.783+0000 7f71367fc700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7128066f80 0x7f7128069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.784+0000 7f71367fc700 1 -- 172.21.15.154:0/652129464 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f713c0865a0 con 0x7f7148156490 2023-10-10T22:17:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.784+0000 7f714659c700 1 -- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7128066f80 msgr2=0x7f7128069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.784+0000 7f714659c700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7128066f80 0x7f7128069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.788+0000 7f71367fc700 1 -- 172.21.15.154:0/652129464 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f713c0535a0 con 0x7f7148156490 2023-10-10T22:17:56.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.985+0000 7f714659c700 1 -- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7128066f80 msgr2=0x7f7128069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:56.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.985+0000 7f714659c700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7128066f80 0x7f7128069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:56.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.991+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f714804c3c0 con 0x7f7148156490 2023-10-10T22:17:56.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.996+0000 7f71367fc700 1 -- 172.21.15.154:0/652129464 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7f713c056bc0 con 0x7f7148156490 2023-10-10T22:17:57.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7128066f80 msgr2=0x7f7128069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:17:57.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7128066f80 0x7f7128069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7148156490 msgr2=0x7f71480ab970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:57.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7148156490 0x7f71480ab970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f714806d240 tx=0x7f713c016000 comp rx=0 tx=0).stop 2023-10-10T22:17:57.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 shutdown_connections 2023-10-10T22:17:57.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7128066f80 0x7f7128069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7148156860 0x7f7148069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71480ccee0 0x7f714816e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 --2- 172.21.15.154:0/652129464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7148156490 0x7f71480ab970 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 >> 172.21.15.154:0/652129464 conn(0x7f7148068e10 msgr2=0x7f71480ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:57.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 shutdown_connections 2023-10-10T22:17:57.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:56.999+0000 7f714cdff700 1 -- 172.21.15.154:0/652129464 wait complete. 2023-10-10T22:17:57.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:17:57.020 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-10T22:17:57.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-10-10T22:17:57.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.295+0000 7f07705ff700 1 Processor -- start 2023-10-10T22:17:57.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.295+0000 7f07705ff700 1 -- start start 2023-10-10T22:17:57.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.296+0000 7f07705ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0768155360 0x7f07680b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:57.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.296+0000 7f07705ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07680ced30 0x7f07680cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:57.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.296+0000 7f07705ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076815c320 con 0x7f07680b40f0 2023-10-10T22:17:57.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.296+0000 7f07705ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07680b4590 con 0x7f0768155360 2023-10-10T22:17:57.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.296+0000 7f07705ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076815b710 con 0x7f07680ced30 2023-10-10T22:17:57.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.297+0000 7f076e39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0768155360 0x7f07680b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:57.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.297+0000 7f076e39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0768155360 0x7f07680b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35330/0 (socket says 172.21.15.154:35330) 2023-10-10T22:17:57.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.297+0000 7f076e39b700 1 -- 172.21.15.154:0/2507798501 learned_addr learned my addr 172.21.15.154:0/2507798501 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:57.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.297+0000 7f076eb9c700 1 --2- 172.21.15.154:0/2507798501 >> v2:172.21.15.179:3300/0 conn(0x7f07680ced30 0x7f07680cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:57.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.297+0000 7f076e39b700 1 -- 172.21.15.154:0/2507798501 >> v2:172.21.15.179:3300/0 conn(0x7f07680ced30 msgr2=0x7f07680cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:17:57.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.297+0000 7f076e39b700 1 --2- 172.21.15.154:0/2507798501 >> v2:172.21.15.179:3300/0 conn(0x7f07680ced30 0x7f07680cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.297+0000 7f076e39b700 1 -- 172.21.15.154:0/2507798501 >> v1:172.21.15.154:6789/0 conn(0x7f07680b40f0 legacy=0x7f07680ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:57.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.297+0000 7f076e39b700 1 -- 172.21.15.154:0/2507798501 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076815b9f0 con 0x7f0768155360 2023-10-10T22:17:57.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.297+0000 7f076eb9c700 1 --2- 172.21.15.154:0/2507798501 >> v2:172.21.15.179:3300/0 conn(0x7f07680ced30 0x7f07680cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:17:57.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.298+0000 7f076e39b700 1 --2- 172.21.15.154:0/2507798501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0768155360 0x7f07680b3bb0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f076806f720 tx=0x7f0764009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4032614bd65b0ac5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:57.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.298+0000 7f076d399700 1 -- 172.21.15.154:0/2507798501 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764009e70 con 0x7f0768155360 2023-10-10T22:17:57.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.298+0000 7f076d399700 1 -- 172.21.15.154:0/2507798501 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400b860 con 0x7f0768155360 2023-10-10T22:17:57.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.298+0000 7f076d399700 1 -- 172.21.15.154:0/2507798501 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400bc00 con 0x7f0768155360 2023-10-10T22:17:57.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.299+0000 7f07705ff700 1 -- 172.21.15.154:0/2507798501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0768155360 msgr2=0x7f07680b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:57.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.299+0000 7f07705ff700 1 --2- 172.21.15.154:0/2507798501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0768155360 0x7f07680b3bb0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f076806f720 tx=0x7f0764009250 comp rx=0 tx=0).stop 2023-10-10T22:17:57.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.299+0000 7f07705ff700 1 -- 172.21.15.154:0/2507798501 shutdown_connections 2023-10-10T22:17:57.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.299+0000 7f07705ff700 1 --2- 172.21.15.154:0/2507798501 >> v2:172.21.15.179:3300/0 conn(0x7f07680ced30 0x7f07680cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.299+0000 7f07705ff700 1 --2- 172.21.15.154:0/2507798501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0768155360 0x7f07680b3bb0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.299+0000 7f07705ff700 1 -- 172.21.15.154:0/2507798501 >> 172.21.15.154:0/2507798501 conn(0x7f076806baf0 msgr2=0x7f076806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:17:57.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.299+0000 7f07705ff700 1 -- 172.21.15.154:0/2507798501 shutdown_connections 2023-10-10T22:17:57.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.299+0000 7f07705ff700 1 -- 172.21.15.154:0/2507798501 wait complete. 2023-10-10T22:17:57.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.300+0000 7f07705ff700 1 Processor -- start 2023-10-10T22:17:57.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.300+0000 7f07705ff700 1 -- start start 2023-10-10T22:17:57.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.301+0000 7f07705ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07680b40f0 0x7f0768153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:57.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.301+0000 7f07705ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07680ced30 0x7f0768154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:57.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.301+0000 7f07705ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0768155360 0x7f07680c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:57.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.301+0000 7f07705ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681680e0 con 0x7f0768155360 2023-10-10T22:17:57.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.301+0000 7f07705ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076816b810 con 0x7f07680b40f0 2023-10-10T22:17:57.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.301+0000 7f07705ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076816b510 con 0x7f07680ced30 2023-10-10T22:17:57.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076e39b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07680b40f0 0x7f0768153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:57.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076eb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0768155360 0x7f07680c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:57.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076e39b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07680b40f0 0x7f0768153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:43934/0 (socket says 172.21.15.154:43934) 2023-10-10T22:17:57.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076e39b700 1 -- 172.21.15.154:0/3945175954 learned_addr learned my addr 172.21.15.154:0/3945175954 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:17:57.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076db9a700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07680ced30 0x7f0768154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:17:57.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076e39b700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07680ced30 msgr2=0x7f0768154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:57.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076e39b700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07680ced30 0x7f0768154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076e39b700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0768155360 msgr2=0x7f07680c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:17:57.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076e39b700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0768155360 0x7f07680c3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:17:57.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076e39b700 1 -- 172.21.15.154:0/3945175954 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760009a20 con 0x7f07680b40f0 2023-10-10T22:17:57.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.302+0000 7f076e39b700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07680b40f0 0x7f0768153c00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0764006fd0 tx=0x7f0764017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:17:57.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.303+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400b9d0 con 0x7f07680b40f0 2023-10-10T22:17:57.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.303+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400bb30 con 0x7f07680b40f0 2023-10-10T22:17:57.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.303+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764025670 con 0x7f07680b40f0 2023-10-10T22:17:57.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.303+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07640094f0 con 0x7f07680b40f0 2023-10-10T22:17:57.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.303+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076816a900 con 0x7f07680b40f0 2023-10-10T22:17:57.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.304+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07680718b0 con 0x7f07680b40f0 2023-10-10T22:17:57.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.305+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 74) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f0764023070 con 0x7f07680b40f0 2023-10-10T22:17:57.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.306+0000 7f075e7fc700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:17:57.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.306+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f0764085b30 con 0x7f07680b40f0 2023-10-10T22:17:57.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.306+0000 7f076db9a700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 msgr2=0x7f074c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:57.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.306+0000 7f076db9a700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:17:57.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.310+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0764052bf0 con 0x7f07680b40f0 2023-10-10T22:17:57.316 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:57.314+0000 7f3e525a8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:17:57.470 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:57.469+0000 7fefab673180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:17:57.480 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:57.479+0000 7f3e525a8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:17:57.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.507+0000 7f076db9a700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 msgr2=0x7f074c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:57.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.507+0000 7f076db9a700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:17:57.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.543+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f076815bcd0 con 0x7f074c066f80 2023-10-10T22:17:57.570 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:57.568+0000 7f3e525a8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:17:57.642 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:57.641+0000 7fefab673180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:17:57.729 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:57.727+0000 7fefab673180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:17:57.794 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:57.793+0000 7f3e525a8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:17:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.908+0000 7f076db9a700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 msgr2=0x7f074c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:57.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:57.908+0000 7f076db9a700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T22:17:57.956 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:57.954+0000 7fefab673180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:17:57.970 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:57.968+0000 7f3e525a8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:17:58.062 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:58.060+0000 7f3e525a8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:17:58.134 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:58.133+0000 7fefab673180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:17:58.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:58.224+0000 7f3e525a8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:17:58.227 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:58.226+0000 7fefab673180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:17:58.325 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:58.324+0000 7f3e525a8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:17:58.389 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:58.388+0000 7fefab673180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:17:58.490 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:58.488+0000 7fefab673180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:17:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:58.709+0000 7f076db9a700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 msgr2=0x7f074c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:17:58.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:17:58.709+0000 7f076db9a700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T22:17:58.809 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:58.807+0000 7f3e525a8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:17:58.902 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:58.900+0000 7f3e525a8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:17:58.978 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:58.976+0000 7fefab673180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:17:58.990 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:58.989+0000 7f3e525a8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:17:59.072 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:59.071+0000 7fefab673180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:17:59.165 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:59.163+0000 7fefab673180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:17:59.608 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:59.606+0000 7f3e525a8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:17:59.781 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:59.779+0000 7f3e525a8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:17:59.789 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:59.787+0000 7fefab673180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:17:59.877 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:17:59.875+0000 7f3e525a8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:17:59.962 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:17:59.961+0000 7fefab673180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:18:00.060 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:00.058+0000 7fefab673180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:18:00.171 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:00.169+0000 7f3e525a8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:18:00.267 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:00.265+0000 7f3e525a8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:18:00.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:00.311+0000 7f076db9a700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 msgr2=0x7f074c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:00.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:00.311+0000 7f076db9a700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T22:18:00.357 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:00.355+0000 7fefab673180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:18:00.453 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:00.452+0000 7fefab673180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:18:00.965 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:00.964+0000 7f3e525a8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:18:01.164 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:01.162+0000 7fefab673180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:18:01.253 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:01.251+0000 7f3e525a8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:18:01.343 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:01.342+0000 7f3e525a8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:18:01.449 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:01.448+0000 7fefab673180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:18:01.496 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:01.494+0000 7f3e525a8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:18:01.543 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:01.542+0000 7fefab673180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:18:01.600 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:01.599+0000 7f3e525a8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:18:01.698 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:01.696+0000 7fefab673180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:18:01.789 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:01.787+0000 7f3e525a8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:18:01.802 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:01.801+0000 7fefab673180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:18:01.880 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:01.879+0000 7f3e525a8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:18:01.972 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:01.970+0000 7f3e525a8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:18:01.994 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:01.992+0000 7fefab673180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:18:02.065 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:02.063+0000 7f3e525a8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:18:02.087 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.086+0000 7fefab673180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:18:02.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:02.127+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mgrmap(e 75) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f0764052fc0 con 0x7f07680b40f0 2023-10-10T22:18:02.185 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.182+0000 7fefab673180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:18:02.278 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.277+0000 7fefab673180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:18:02.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:02.290+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mon.1 v2:172.21.15.179:3300/0 8 ==== mgrmap(e 76) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f076402e3f0 con 0x7f07680b40f0 2023-10-10T22:18:02.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:02.290+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 msgr2=0x7f074c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:02.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:02.290+0000 7f075e7fc700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:02.408 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef1d1b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:02.408 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef1d1b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:02.408 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef1d1b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:02.409 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef1d1b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:02.409 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef1d1b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:02.409 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef209b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:02.409 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef209b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:02.409 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef209b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:02.410 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef209b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:02.410 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:02.406+0000 7fef209b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:03.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.294+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mon.1 v2:172.21.15.179:3300/0 9 ==== mgrmap(e 77) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f0764053890 con 0x7f07680b40f0 2023-10-10T22:18:03.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.294+0000 7f075e7fc700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:03.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.295+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f076815bcd0 con 0x7f074c066f80 2023-10-10T22:18:03.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.296+0000 7f076db9a700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:03.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.299+0000 7f076db9a700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c0693b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f07680ca400 tx=0x7f0758007ec0 comp rx=0 tx=0).ready entity=mgr.8850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:03.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.369+0000 7f075e7fc700 1 -- 172.21.15.154:0/3945175954 <== mgr.8850 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f076815bcd0 con 0x7f074c066f80 2023-10-10T22:18:03.371 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path snap_test_dir1 2023-10-10T22:18:03.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 msgr2=0x7f074c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:03.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c0693b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f07680ca400 tx=0x7f0758007ec0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07680b40f0 msgr2=0x7f0768153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:03.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07680b40f0 0x7f0768153c00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0764006fd0 tx=0x7f0764017000 comp rx=0 tx=0).stop 2023-10-10T22:18:03.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 shutdown_connections 2023-10-10T22:18:03.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f074c066f80 0x7f074c0693b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0768155360 0x7f07680c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07680b40f0 0x7f0768153c00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 --2- 172.21.15.154:0/3945175954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07680ced30 0x7f0768154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 >> 172.21.15.154:0/3945175954 conn(0x7f076806baf0 msgr2=0x7f076814eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:03.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 shutdown_connections 2023-10-10T22:18:03.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.372+0000 7f07705ff700 1 -- 172.21.15.154:0/3945175954 wait complete. 2023-10-10T22:18:03.394 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-10T22:18:03.394 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-10T22:18:03.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.580+0000 7fa7eb3ff700 1 Processor -- start 2023-10-10T22:18:03.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.580+0000 7fa7eb3ff700 1 -- start start 2023-10-10T22:18:03.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7eb3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069a50 0x7fa7e40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7eb3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7e4069e20 0x7fa7e41569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7eb3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e40ac030 con 0x7fa7e40c8490 2023-10-10T22:18:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7eb3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e40ab820 con 0x7fa7e4069e20 2023-10-10T22:18:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7eb3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e406dbb0 con 0x7fa7e4069a50 2023-10-10T22:18:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e999c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7e4069e20 0x7fa7e41569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e899a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa7e40c8490 0x7fa7e415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34856/0 (socket says 172.21.15.154:34856) 2023-10-10T22:18:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e899a700 1 -- 172.21.15.154:0/4001430474 learned_addr learned my addr 172.21.15.154:0/4001430474 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e999c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7e4069e20 0x7fa7e41569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35468/0 (socket says 172.21.15.154:35468) 2023-10-10T22:18:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e919b700 1 --2- 172.21.15.154:0/4001430474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069a50 0x7fa7e40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e999c700 1 -- 172.21.15.154:0/4001430474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069a50 msgr2=0x7fa7e40c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e999c700 1 --2- 172.21.15.154:0/4001430474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069a50 0x7fa7e40c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e999c700 1 -- 172.21.15.154:0/4001430474 >> v1:172.21.15.154:6789/0 conn(0x7fa7e40c8490 legacy=0x7fa7e415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e999c700 1 -- 172.21.15.154:0/4001430474 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e40aba70 con 0x7fa7e4069e20 2023-10-10T22:18:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7e919b700 1 --2- 172.21.15.154:0/4001430474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069a50 0x7fa7e40c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.582+0000 7fa7dbfff700 1 -- 172.21.15.154:0/4001430474 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707122711 0 0) 0x7fa7d4001110 con 0x7fa7e40c8490 2023-10-10T22:18:03.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.583+0000 7fa7e999c700 1 --2- 172.21.15.154:0/4001430474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e4069e20 0x7fa7e41569b0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009e90 tx=0x7fa7dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9bdb3a5c3e0509 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:03.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.583+0000 7fa7dbfff700 1 -- 172.21.15.154:0/4001430474 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00e070 con 0x7fa7e4069e20 2023-10-10T22:18:03.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.583+0000 7fa7dbfff700 1 -- 172.21.15.154:0/4001430474 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc00bbf0 con 0x7fa7e4069e20 2023-10-10T22:18:03.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.583+0000 7fa7dbfff700 1 -- 172.21.15.154:0/4001430474 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc012430 con 0x7fa7e4069e20 2023-10-10T22:18:03.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.583+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/4001430474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e4069e20 msgr2=0x7fa7e41569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:03.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.583+0000 7fa7eb3ff700 1 --2- 172.21.15.154:0/4001430474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e4069e20 0x7fa7e41569b0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009e90 tx=0x7fa7dc009780 comp rx=0 tx=0).stop 2023-10-10T22:18:03.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.584+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/4001430474 shutdown_connections 2023-10-10T22:18:03.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.584+0000 7fa7eb3ff700 1 --2- 172.21.15.154:0/4001430474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e4069e20 0x7fa7e41569b0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.584+0000 7fa7eb3ff700 1 --2- 172.21.15.154:0/4001430474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069a50 0x7fa7e40c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.584+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/4001430474 >> 172.21.15.154:0/4001430474 conn(0x7fa7e40c8f90 msgr2=0x7fa7e40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:03.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.584+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/4001430474 shutdown_connections 2023-10-10T22:18:03.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.584+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/4001430474 wait complete. 2023-10-10T22:18:03.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.585+0000 7fa7eb3ff700 1 Processor -- start 2023-10-10T22:18:03.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.585+0000 7fa7eb3ff700 1 -- start start 2023-10-10T22:18:03.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.586+0000 7fa7eb3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7e4069a50 0x7fa7e416aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:03.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.586+0000 7fa7eb3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069e20 0x7fa7e40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:03.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.586+0000 7fa7eb3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e40c8490 0x7fa7e416cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:03.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.586+0000 7fa7eb3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40aa8f0 con 0x7fa7e40c8490 2023-10-10T22:18:03.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.586+0000 7fa7eb3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40a9e20 con 0x7fa7e4069a50 2023-10-10T22:18:03.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.586+0000 7fa7eb3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40c4730 con 0x7fa7e4069e20 2023-10-10T22:18:03.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.586+0000 7fa7e999c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e40c8490 0x7fa7e416cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:03.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.586+0000 7fa7e999c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e40c8490 0x7fa7e416cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35478/0 (socket says 172.21.15.154:35478) 2023-10-10T22:18:03.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.586+0000 7fa7e999c700 1 -- 172.21.15.154:0/2654581814 learned_addr learned my addr 172.21.15.154:0/2654581814 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:03.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7e899a700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069e20 0x7fa7e40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:03.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7e919b700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7e4069a50 0x7fa7e416aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:03.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7e999c700 1 -- 172.21.15.154:0/2654581814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069e20 msgr2=0x7fa7e40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:03.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7e999c700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069e20 0x7fa7e40a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7e999c700 1 -- 172.21.15.154:0/2654581814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7e4069a50 msgr2=0x7fa7e416aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:03.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7e999c700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7e4069a50 0x7fa7e416aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7e999c700 1 -- 172.21.15.154:0/2654581814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc009a20 con 0x7fa7e40c8490 2023-10-10T22:18:03.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7e999c700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e40c8490 0x7fa7e416cc10 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40cc0b0 tx=0x7fa7dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:03.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7d97fa700 1 -- 172.21.15.154:0/2654581814 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc01d700 con 0x7fa7e40c8490 2023-10-10T22:18:03.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7d97fa700 1 -- 172.21.15.154:0/2654581814 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc01d880 con 0x7fa7e40c8490 2023-10-10T22:18:03.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e40aa050 con 0x7fa7e40c8490 2023-10-10T22:18:03.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7d97fa700 1 -- 172.21.15.154:0/2654581814 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc01dc40 con 0x7fa7e40c8490 2023-10-10T22:18:03.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.587+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e40aa610 con 0x7fa7e40c8490 2023-10-10T22:18:03.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.588+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e40c4500 con 0x7fa7e40c8490 2023-10-10T22:18:03.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.589+0000 7fa7d97fa700 1 -- 172.21.15.154:0/2654581814 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 77) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fa7dc024070 con 0x7fa7e40c8490 2023-10-10T22:18:03.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.590+0000 7fa7d97fa700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa7c8066dd0 0x7fa7c8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:03.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.590+0000 7fa7d97fa700 1 -- 172.21.15.154:0/2654581814 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fa7dc086fd0 con 0x7fa7e40c8490 2023-10-10T22:18:03.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.590+0000 7fa7e919b700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa7c8066dd0 0x7fa7c8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:03.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.591+0000 7fa7e919b700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa7c8066dd0 0x7fa7c8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0006fd0 tx=0x7fa7e0008040 comp rx=0 tx=0).ready entity=mgr.8850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:03.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.595+0000 7fa7d97fa700 1 -- 172.21.15.154:0/2654581814 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7e40c4500 con 0x7fa7e40c8490 2023-10-10T22:18:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.808+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7e40c4500 con 0x7fa7c8066dd0 2023-10-10T22:18:03.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.886+0000 7fa7d97fa700 1 -- 172.21.15.154:0/2654581814 <== mgr.8850 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa7e40c4500 con 0x7fa7c8066dd0 2023-10-10T22:18:03.888 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path snap_test_dir1 2023-10-10T22:18:03.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa7c8066dd0 msgr2=0x7fa7c8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:03.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa7c8066dd0 0x7fa7c8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0006fd0 tx=0x7fa7e0008040 comp rx=0 tx=0).stop 2023-10-10T22:18:03.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e40c8490 msgr2=0x7fa7e416cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:03.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e40c8490 0x7fa7e416cc10 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40cc0b0 tx=0x7fa7dc019000 comp rx=0 tx=0).stop 2023-10-10T22:18:03.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 shutdown_connections 2023-10-10T22:18:03.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa7c8066dd0 0x7fa7c8069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e40c8490 0x7fa7e416cc10 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7e4069a50 0x7fa7e416aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 --2- 172.21.15.154:0/2654581814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7e4069e20 0x7fa7e40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:03.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 >> 172.21.15.154:0/2654581814 conn(0x7fa7e40c8f90 msgr2=0x7fa7e40cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:03.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 shutdown_connections 2023-10-10T22:18:03.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:03.888+0000 7fa7eb3ff700 1 -- 172.21.15.154:0/2654581814 wait complete. 2023-10-10T22:18:03.908 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-10T22:18:03.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-10T22:18:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.094+0000 7f6423fff700 1 Processor -- start 2023-10-10T22:18:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.095+0000 7f6423fff700 1 -- start start 2023-10-10T22:18:04.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.096+0000 7f6423fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 0x7f64240ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.096+0000 7f6423fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64240cc8d0 0x7f642415b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.096+0000 7f6423fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6424157a50 con 0x7f642415b960 2023-10-10T22:18:04.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.096+0000 7f6423fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64241591b0 con 0x7f64240cc8d0 2023-10-10T22:18:04.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.096+0000 7f6423fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64240ca9e0 con 0x7f642415b050 2023-10-10T22:18:04.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.096+0000 7f64227fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64240cc8d0 0x7f642415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.096+0000 7f64227fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64240cc8d0 0x7f642415b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35486/0 (socket says 172.21.15.154:35486) 2023-10-10T22:18:04.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.096+0000 7f64227fc700 1 -- 172.21.15.154:0/704111634 learned_addr learned my addr 172.21.15.154:0/704111634 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:04.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.096+0000 7f6422ffd700 1 --2- 172.21.15.154:0/704111634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 0x7f64240ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.097+0000 7f64227fc700 1 -- 172.21.15.154:0/704111634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 msgr2=0x7f64240ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:04.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.097+0000 7f64227fc700 1 --2- 172.21.15.154:0/704111634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 0x7f64240ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.097+0000 7f64227fc700 1 -- 172.21.15.154:0/704111634 >> v1:172.21.15.179:6789/0 conn(0x7f642415b960 legacy=0x7f6424157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:04.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.097+0000 7f64227fc700 1 -- 172.21.15.154:0/704111634 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64240cacc0 con 0x7f64240cc8d0 2023-10-10T22:18:04.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.097+0000 7f64227fc700 1 --2- 172.21.15.154:0/704111634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64240cc8d0 0x7f642415b420 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f64180099b0 tx=0x7f6418009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ad17754f0b535 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:04.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.097+0000 7f6421ffb700 1 -- 172.21.15.154:0/704111634 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418009ea0 con 0x7f64240cc8d0 2023-10-10T22:18:04.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.097+0000 7f6421ffb700 1 -- 172.21.15.154:0/704111634 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641800b860 con 0x7f64240cc8d0 2023-10-10T22:18:04.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.097+0000 7f6421ffb700 1 -- 172.21.15.154:0/704111634 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800bc00 con 0x7f64240cc8d0 2023-10-10T22:18:04.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.098+0000 7f6423fff700 1 -- 172.21.15.154:0/704111634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64240cc8d0 msgr2=0x7f642415b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:04.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.098+0000 7f6423fff700 1 --2- 172.21.15.154:0/704111634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64240cc8d0 0x7f642415b420 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f64180099b0 tx=0x7f6418009250 comp rx=0 tx=0).stop 2023-10-10T22:18:04.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.098+0000 7f6423fff700 1 -- 172.21.15.154:0/704111634 shutdown_connections 2023-10-10T22:18:04.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.098+0000 7f6423fff700 1 --2- 172.21.15.154:0/704111634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 0x7f64240ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.098+0000 7f6423fff700 1 --2- 172.21.15.154:0/704111634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64240cc8d0 0x7f642415b420 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.098+0000 7f6423fff700 1 -- 172.21.15.154:0/704111634 >> 172.21.15.154:0/704111634 conn(0x7f6424068e20 msgr2=0x7f64240cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:04.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.098+0000 7f6423fff700 1 -- 172.21.15.154:0/704111634 shutdown_connections 2023-10-10T22:18:04.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.098+0000 7f6423fff700 1 -- 172.21.15.154:0/704111634 wait complete. 2023-10-10T22:18:04.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.099+0000 7f6423fff700 1 Processor -- start 2023-10-10T22:18:04.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.099+0000 7f6423fff700 1 -- start start 2023-10-10T22:18:04.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.100+0000 7f6423fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64240cc8d0 0x7f642416a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.100+0000 7f6423fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 0x7f64240c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.100+0000 7f6423fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f642415b960 0x7f64240c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.100+0000 7f6423fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64240a7730 con 0x7f64240cc8d0 2023-10-10T22:18:04.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.100+0000 7f6423fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64240afee0 con 0x7f642415b960 2023-10-10T22:18:04.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.100+0000 7f6423fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64240b01c0 con 0x7f642415b050 2023-10-10T22:18:04.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.100+0000 7f6422ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64240cc8d0 0x7f642416a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f6422ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64240cc8d0 0x7f642416a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35488/0 (socket says 172.21.15.154:35488) 2023-10-10T22:18:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f6422ffd700 1 -- 172.21.15.154:0/744270033 learned_addr learned my addr 172.21.15.154:0/744270033 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f64227fc700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 0x7f64240c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f6422ffd700 1 -- 172.21.15.154:0/744270033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 msgr2=0x7f64240c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f64237fe700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f642415b960 0x7f64240c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f6422ffd700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 0x7f64240c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f6422ffd700 1 -- 172.21.15.154:0/744270033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f642415b960 msgr2=0x7f64240c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f6422ffd700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f642415b960 0x7f64240c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f6422ffd700 1 -- 172.21.15.154:0/744270033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180094f0 con 0x7f64240cc8d0 2023-10-10T22:18:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f64227fc700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f642415b050 0x7f64240c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f64237fe700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f642415b960 0x7f64240c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f6422ffd700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64240cc8d0 0x7f642416a7b0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f641400ec80 tx=0x7f64140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f640affd700 1 -- 172.21.15.154:0/744270033 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641400c9d0 con 0x7f64240cc8d0 2023-10-10T22:18:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f640affd700 1 -- 172.21.15.154:0/744270033 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641400cb30 con 0x7f64240cc8d0 2023-10-10T22:18:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f640affd700 1 -- 172.21.15.154:0/744270033 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414013470 con 0x7f64240cc8d0 2023-10-10T22:18:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.101+0000 7f6423fff700 1 -- 172.21.15.154:0/744270033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64240b04a0 con 0x7f64240cc8d0 2023-10-10T22:18:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.102+0000 7f6423fff700 1 -- 172.21.15.154:0/744270033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642416acf0 con 0x7f64240cc8d0 2023-10-10T22:18:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.103+0000 7f6423fff700 1 -- 172.21.15.154:0/744270033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642404c3c0 con 0x7f64240cc8d0 2023-10-10T22:18:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.104+0000 7f640affd700 1 -- 172.21.15.154:0/744270033 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 77) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f6414013820 con 0x7f64240cc8d0 2023-10-10T22:18:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.105+0000 7f640affd700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6410066dd0 0x7f6410069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.105+0000 7f640affd700 1 -- 172.21.15.154:0/744270033 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f64140848e0 con 0x7f64240cc8d0 2023-10-10T22:18:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.105+0000 7f64227fc700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6410066dd0 0x7f6410069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.105+0000 7f64227fc700 1 --2- 172.21.15.154:0/744270033 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6410066dd0 0x7f6410069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f64180099b0 tx=0x7f6418017000 comp rx=0 tx=0).ready entity=mgr.8850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.108+0000 7f640affd700 1 -- 172.21.15.154:0/744270033 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6414051af0 con 0x7f64240cc8d0 2023-10-10T22:18:04.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.302+0000 7f640affd700 1 -- 172.21.15.154:0/744270033 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 78) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f6414051ec0 con 0x7f64240cc8d0 2023-10-10T22:18:04.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.331+0000 7f6423fff700 1 -- 172.21.15.154:0/744270033 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f64240cafa0 con 0x7f6410066dd0 2023-10-10T22:18:04.341 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:04.340+0000 7fef279c5700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-10T22:18:04.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.340+0000 7f640affd700 1 -- 172.21.15.154:0/744270033 <== mgr.8850 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f64240cafa0 con 0x7f6410066dd0 2023-10-10T22:18:04.343 INFO:teuthology.orchestra.run.smithi154.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-10T22:18:04.351 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-10T22:18:04.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:18:04.352 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-10T22:18:04.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T22:18:04.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.618+0000 7fc0dafff700 1 Processor -- start 2023-10-10T22:18:04.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.618+0000 7fc0dafff700 1 -- start start 2023-10-10T22:18:04.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0dafff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc0d40c83f0 0x7fc0d40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0dafff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0d40ccee0 0x7fc0d41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0dafff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40c87c0 0x7fc0d4156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0dafff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d4156c50 con 0x7fc0d40ccee0 2023-10-10T22:18:04.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0dafff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d415b0d0 con 0x7fc0d40c83f0 2023-10-10T22:18:04.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0dafff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d40c7a60 con 0x7fc0d40c87c0 2023-10-10T22:18:04.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0cbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0d40ccee0 0x7fc0d41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0cbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0d40ccee0 0x7fc0d41561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35494/0 (socket says 172.21.15.154:35494) 2023-10-10T22:18:04.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0cbfff700 1 -- 172.21.15.154:0/397436677 learned_addr learned my addr 172.21.15.154:0/397436677 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:04.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0d8d9b700 1 --2- 172.21.15.154:0/397436677 >> v2:172.21.15.179:3300/0 conn(0x7fc0d40c83f0 0x7fc0d40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.620+0000 7fc0d959c700 1 --2- 172.21.15.154:0/397436677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40c87c0 0x7fc0d4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0cbfff700 1 -- 172.21.15.154:0/397436677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40c87c0 msgr2=0x7fc0d4156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0cbfff700 1 --2- 172.21.15.154:0/397436677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40c87c0 0x7fc0d4156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0cbfff700 1 -- 172.21.15.154:0/397436677 >> v2:172.21.15.179:3300/0 conn(0x7fc0d40c83f0 msgr2=0x7fc0d40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0cbfff700 1 --2- 172.21.15.154:0/397436677 >> v2:172.21.15.179:3300/0 conn(0x7fc0d40c83f0 0x7fc0d40c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0cbfff700 1 -- 172.21.15.154:0/397436677 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d415a4c0 con 0x7fc0d40ccee0 2023-10-10T22:18:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0d959c700 1 --2- 172.21.15.154:0/397436677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40c87c0 0x7fc0d4156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:04.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0cbfff700 1 --2- 172.21.15.154:0/397436677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40ccee0 0x7fc0d41561d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40c9fd0 tx=0x7fc0c400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53624b87e711c971 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:04.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0cb7fe700 1 -- 172.21.15.154:0/397436677 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400dba0 con 0x7fc0d40ccee0 2023-10-10T22:18:04.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0cb7fe700 1 -- 172.21.15.154:0/397436677 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c400dd00 con 0x7fc0d40ccee0 2023-10-10T22:18:04.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.621+0000 7fc0cb7fe700 1 -- 172.21.15.154:0/397436677 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40196d0 con 0x7fc0d40ccee0 2023-10-10T22:18:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.622+0000 7fc0dafff700 1 -- 172.21.15.154:0/397436677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40ccee0 msgr2=0x7fc0d41561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.622+0000 7fc0dafff700 1 --2- 172.21.15.154:0/397436677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40ccee0 0x7fc0d41561d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40c9fd0 tx=0x7fc0c400b4f0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.622+0000 7fc0dafff700 1 -- 172.21.15.154:0/397436677 shutdown_connections 2023-10-10T22:18:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.622+0000 7fc0dafff700 1 --2- 172.21.15.154:0/397436677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40c87c0 0x7fc0d4156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.622+0000 7fc0dafff700 1 --2- 172.21.15.154:0/397436677 >> v2:172.21.15.179:3300/0 conn(0x7fc0d40c83f0 0x7fc0d40c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.622+0000 7fc0dafff700 1 --2- 172.21.15.154:0/397436677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40ccee0 0x7fc0d41561d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.622+0000 7fc0dafff700 1 -- 172.21.15.154:0/397436677 >> 172.21.15.154:0/397436677 conn(0x7fc0d4068e10 msgr2=0x7fc0d40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.622+0000 7fc0dafff700 1 -- 172.21.15.154:0/397436677 shutdown_connections 2023-10-10T22:18:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.622+0000 7fc0dafff700 1 -- 172.21.15.154:0/397436677 wait complete. 2023-10-10T22:18:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.623+0000 7fc0dafff700 1 Processor -- start 2023-10-10T22:18:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.623+0000 7fc0dafff700 1 -- start start 2023-10-10T22:18:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.624+0000 7fc0dafff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d40c83f0 0x7fc0d4144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.624+0000 7fc0dafff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40c87c0 0x7fc0d4150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.624+0000 7fc0dafff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40ccee0 0x7fc0d4150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.624+0000 7fc0dafff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d40b16d0 con 0x7fc0d40c87c0 2023-10-10T22:18:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.624+0000 7fc0dafff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d41446c0 con 0x7fc0d40c83f0 2023-10-10T22:18:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.624+0000 7fc0dafff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d40b1b60 con 0x7fc0d40ccee0 2023-10-10T22:18:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.624+0000 7fc0cbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40c87c0 0x7fc0d4150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.624+0000 7fc0cbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40c87c0 0x7fc0d4150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35500/0 (socket says 172.21.15.154:35500) 2023-10-10T22:18:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.624+0000 7fc0cbfff700 1 -- 172.21.15.154:0/2383475757 learned_addr learned my addr 172.21.15.154:0/2383475757 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0d959c700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40ccee0 0x7fc0d4150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0d8d9b700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d40c83f0 0x7fc0d4144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0cbfff700 1 -- 172.21.15.154:0/2383475757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40ccee0 msgr2=0x7fc0d4150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0cbfff700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40ccee0 0x7fc0d4150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0cbfff700 1 -- 172.21.15.154:0/2383475757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d40c83f0 msgr2=0x7fc0d4144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0cbfff700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d40c83f0 0x7fc0d4144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0cbfff700 1 -- 172.21.15.154:0/2383475757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c400b790 con 0x7fc0d40c87c0 2023-10-10T22:18:04.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0d8d9b700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d40c83f0 0x7fc0d4144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:04.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0cbfff700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40c87c0 0x7fc0d4150850 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4006fd0 tx=0x7fc0c401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:04.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0c8ff9700 1 -- 172.21.15.154:0/2383475757 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4010680 con 0x7fc0d40c87c0 2023-10-10T22:18:04.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0c8ff9700 1 -- 172.21.15.154:0/2383475757 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c4010800 con 0x7fc0d40c87c0 2023-10-10T22:18:04.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0c8ff9700 1 -- 172.21.15.154:0/2383475757 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4010bc0 con 0x7fc0d40c87c0 2023-10-10T22:18:04.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.625+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d40b0b00 con 0x7fc0d40c87c0 2023-10-10T22:18:04.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.626+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d40b1080 con 0x7fc0d40c87c0 2023-10-10T22:18:04.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.627+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d40b1840 con 0x7fc0d40c87c0 2023-10-10T22:18:04.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.628+0000 7fc0c8ff9700 1 -- 172.21.15.154:0/2383475757 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 78) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fc0c4023070 con 0x7fc0d40c87c0 2023-10-10T22:18:04.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.628+0000 7fc0c8ff9700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0c0067130 0x7fc0c00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:04.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.628+0000 7fc0c8ff9700 1 -- 172.21.15.154:0/2383475757 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fc0c4014070 con 0x7fc0d40c87c0 2023-10-10T22:18:04.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.629+0000 7fc0d8d9b700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0c0067130 0x7fc0c00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:04.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.629+0000 7fc0d8d9b700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0c0067130 0x7fc0c00695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00076c0 tx=0x7fc0d000b040 comp rx=0 tx=0).ready entity=mgr.8850 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:04.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.632+0000 7fc0c8ff9700 1 -- 172.21.15.154:0/2383475757 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0c4055db0 con 0x7fc0d40c87c0 2023-10-10T22:18:04.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:04.881+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fc0d404c3c0 con 0x7fc0d40c87c0 2023-10-10T22:18:05.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.309+0000 7fc0c8ff9700 1 -- 172.21.15.154:0/2383475757 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc0c4056180 con 0x7fc0d40c87c0 2023-10-10T22:18:05.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.310+0000 7fc0c8ff9700 1 -- 172.21.15.154:0/2383475757 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v79) v1 ==== 93+0+0 (secure 0 0 0) 0x7fc0c4059840 con 0x7fc0d40c87c0 2023-10-10T22:18:05.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.313+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0c0067130 msgr2=0x7fc0c00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:05.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.313+0000 7fc0dafff700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0c0067130 0x7fc0c00695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00076c0 tx=0x7fc0d000b040 comp rx=0 tx=0).stop 2023-10-10T22:18:05.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.313+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40c87c0 msgr2=0x7fc0d4150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:05.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.313+0000 7fc0dafff700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40c87c0 0x7fc0d4150850 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4006fd0 tx=0x7fc0c401b000 comp rx=0 tx=0).stop 2023-10-10T22:18:05.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.313+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 shutdown_connections 2023-10-10T22:18:05.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.313+0000 7fc0dafff700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40ccee0 0x7fc0d4150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:05.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.313+0000 7fc0dafff700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d40c83f0 0x7fc0d4144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:05.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.313+0000 7fc0dafff700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc0c0067130 0x7fc0c00695e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:05.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.313+0000 7fc0dafff700 1 --2- 172.21.15.154:0/2383475757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0d40c87c0 0x7fc0d4150850 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:05.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.314+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 >> 172.21.15.154:0/2383475757 conn(0x7fc0d4068e10 msgr2=0x7fc0d4151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:05.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.314+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 shutdown_connections 2023-10-10T22:18:05.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.314+0000 7fc0dafff700 1 -- 172.21.15.154:0/2383475757 wait complete. 2023-10-10T22:18:05.341 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T22:18:05.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:18:05.431 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:18:05.513 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T22:18:05.514 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T22:18:05.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:18:05.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T22:18:05.609 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:18:05.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:18:05.610 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T22:18:05.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:18:05.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.873+0000 7fd997fff700 1 Processor -- start 2023-10-10T22:18:05.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.873+0000 7fd997fff700 1 -- start start 2023-10-10T22:18:05.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.875+0000 7fd997fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd998156310 0x7fd9980c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:05.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.875+0000 7fd997fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9980ca860 con 0x7fd9980ae710 2023-10-10T22:18:05.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.875+0000 7fd997fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9980cab40 con 0x7fd9981566e0 2023-10-10T22:18:05.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.875+0000 7fd997fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9980cae20 con 0x7fd998156310 2023-10-10T22:18:05.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.875+0000 7fd9977fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd9980ae710 0x7fd9980c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52920/0 (socket says 172.21.15.154:52920) 2023-10-10T22:18:05.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.875+0000 7fd9977fe700 1 -- 172.21.15.154:0/3086256225 learned_addr learned my addr 172.21.15.154:0/3086256225 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:05.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.875+0000 7fd996ffd700 1 --2- 172.21.15.154:0/3086256225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd998156310 0x7fd9980c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:05.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd995ffb700 1 -- 172.21.15.154:0/3086256225 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695049149 0 0) 0x7fd9980ca860 con 0x7fd9980ae710 2023-10-10T22:18:05.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd995ffb700 1 -- 172.21.15.154:0/3086256225 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd980003570 con 0x7fd9980ae710 2023-10-10T22:18:05.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd995ffb700 1 -- 172.21.15.154:0/3086256225 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085546418 0 0) 0x7fd9980cab40 con 0x7fd9981566e0 2023-10-10T22:18:05.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd996ffd700 1 -- 172.21.15.154:0/3086256225 >> v1:172.21.15.179:6789/0 conn(0x7fd9981566e0 legacy=0x7fd9980ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:05.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd996ffd700 1 -- 172.21.15.154:0/3086256225 >> v1:172.21.15.154:6789/0 conn(0x7fd9980ae710 legacy=0x7fd9980c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:05.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd996ffd700 1 -- 172.21.15.154:0/3086256225 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980cb100 con 0x7fd998156310 2023-10-10T22:18:05.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd996ffd700 1 --2- 172.21.15.154:0/3086256225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd998156310 0x7fd9980c9dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd988009910 tx=0x7fd9880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a2af025094dbcc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:05.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd995ffb700 1 -- 172.21.15.154:0/3086256225 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800b680 con 0x7fd998156310 2023-10-10T22:18:05.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd995ffb700 1 -- 172.21.15.154:0/3086256225 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98800b7e0 con 0x7fd998156310 2023-10-10T22:18:05.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.876+0000 7fd995ffb700 1 -- 172.21.15.154:0/3086256225 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800bba0 con 0x7fd998156310 2023-10-10T22:18:05.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.877+0000 7fd997fff700 1 -- 172.21.15.154:0/3086256225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd998156310 msgr2=0x7fd9980c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:05.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.877+0000 7fd997fff700 1 --2- 172.21.15.154:0/3086256225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd998156310 0x7fd9980c9dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd988009910 tx=0x7fd9880091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:05.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.877+0000 7fd997fff700 1 -- 172.21.15.154:0/3086256225 shutdown_connections 2023-10-10T22:18:05.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.877+0000 7fd997fff700 1 --2- 172.21.15.154:0/3086256225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd998156310 0x7fd9980c9dc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:05.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.877+0000 7fd997fff700 1 -- 172.21.15.154:0/3086256225 >> 172.21.15.154:0/3086256225 conn(0x7fd9980cc1f0 msgr2=0x7fd9980cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:05.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.877+0000 7fd997fff700 1 -- 172.21.15.154:0/3086256225 shutdown_connections 2023-10-10T22:18:05.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.877+0000 7fd997fff700 1 -- 172.21.15.154:0/3086256225 wait complete. 2023-10-10T22:18:05.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.878+0000 7fd997fff700 1 Processor -- start 2023-10-10T22:18:05.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.879+0000 7fd997fff700 1 -- start start 2023-10-10T22:18:05.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.879+0000 7fd997fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9980ae710 0x7fd9980c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:05.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.879+0000 7fd997fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd998156310 0x7fd998169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:05.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.879+0000 7fd997fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9981566e0 0x7fd998151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:05.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.879+0000 7fd997fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99816ad20 con 0x7fd9981566e0 2023-10-10T22:18:05.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.879+0000 7fd997fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd998157d80 con 0x7fd998156310 2023-10-10T22:18:05.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.879+0000 7fd997fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99816a220 con 0x7fd9980ae710 2023-10-10T22:18:05.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9977fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9981566e0 0x7fd998151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:05.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9977fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9981566e0 0x7fd998151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47786/0 (socket says 172.21.15.154:47786) 2023-10-10T22:18:05.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd996ffd700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9980ae710 0x7fd9980c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:05.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9977fe700 1 -- 172.21.15.154:0/2100914848 learned_addr learned my addr 172.21.15.154:0/2100914848 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:05.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9967fc700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd998156310 0x7fd998169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:05.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9977fe700 1 -- 172.21.15.154:0/2100914848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9980ae710 msgr2=0x7fd9980c2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:05.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9977fe700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9980ae710 0x7fd9980c2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:05.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9977fe700 1 -- 172.21.15.154:0/2100914848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd998156310 msgr2=0x7fd998169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:05.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9977fe700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd998156310 0x7fd998169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:05.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9977fe700 1 -- 172.21.15.154:0/2100914848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd988009420 con 0x7fd9981566e0 2023-10-10T22:18:05.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd996ffd700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9980ae710 0x7fd9980c2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:05.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.880+0000 7fd9977fe700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9981566e0 0x7fd998151090 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fd99000cc40 tx=0x7fd990001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:05.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.881+0000 7fd97effd700 1 -- 172.21.15.154:0/2100914848 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99000a8b0 con 0x7fd9981566e0 2023-10-10T22:18:05.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.881+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99816a480 con 0x7fd9981566e0 2023-10-10T22:18:05.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.881+0000 7fd97effd700 1 -- 172.21.15.154:0/2100914848 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99000aa10 con 0x7fd9981566e0 2023-10-10T22:18:05.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.881+0000 7fd97effd700 1 -- 172.21.15.154:0/2100914848 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99000ad90 con 0x7fd9981566e0 2023-10-10T22:18:05.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.881+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99816aa40 con 0x7fd9981566e0 2023-10-10T22:18:05.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.882+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99804c3c0 con 0x7fd9981566e0 2023-10-10T22:18:05.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.883+0000 7fd97effd700 1 -- 172.21.15.154:0/2100914848 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fd990007300 con 0x7fd9981566e0 2023-10-10T22:18:05.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.884+0000 7fd97effd700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd9840670e0 0x7fd984069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:05.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.884+0000 7fd97effd700 1 -- 172.21.15.154:0/2100914848 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd990084f60 con 0x7fd9981566e0 2023-10-10T22:18:05.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.884+0000 7fd996ffd700 1 -- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd9840670e0 msgr2=0x7fd984069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:05.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.884+0000 7fd996ffd700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd9840670e0 0x7fd984069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:05.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:05.891+0000 7fd97effd700 1 -- 172.21.15.154:0/2100914848 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd990051be0 con 0x7fd9981566e0 2023-10-10T22:18:06.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.085+0000 7fd996ffd700 1 -- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd9840670e0 msgr2=0x7fd984069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:06.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.085+0000 7fd996ffd700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd9840670e0 0x7fd984069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.135+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd998157ec0 con 0x7fd9981566e0 2023-10-10T22:18:06.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.135+0000 7fd97effd700 1 -- 172.21.15.154:0/2100914848 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fd990055200 con 0x7fd9981566e0 2023-10-10T22:18:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:06.138 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7196,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3891554759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3891554759},{"type":"v1","addr":"172.21.15.179:6834","nonce":3891554759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8158,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1858498414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1858498414},{"type":"v1","addr":"172.21.15.154:6835","nonce":1858498414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8161,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3531287783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3531287783},{"type":"v1","addr":"172.21.15.179:6835","nonce":3531287783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:17:40.982384+0000","modified":"2023-10-10T22:17:44.985977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8640":{"gid":8640,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/3925813058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3925813058},{"type":"v1","addr":"172.21.15.154:6834","nonce":3925813058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-10T22:18:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd9840670e0 msgr2=0x7fd984069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd9840670e0 0x7fd984069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9981566e0 msgr2=0x7fd998151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9981566e0 0x7fd998151090 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fd99000cc40 tx=0x7fd990001aa0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 shutdown_connections 2023-10-10T22:18:06.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd9840670e0 0x7fd984069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9981566e0 0x7fd998151090 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9980ae710 0x7fd9980c2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 --2- 172.21.15.154:0/2100914848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd998156310 0x7fd998169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 >> 172.21.15.154:0/2100914848 conn(0x7fd9980cc1f0 msgr2=0x7fd9980b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:06.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 shutdown_connections 2023-10-10T22:18:06.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.138+0000 7fd997fff700 1 -- 172.21.15.154:0/2100914848 wait complete. 2023-10-10T22:18:06.142 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 70 2023-10-10T22:18:06.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:18:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.345+0000 7fee9339d700 1 Processor -- start 2023-10-10T22:18:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.345+0000 7fee9339d700 1 -- start start 2023-10-10T22:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee9339d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee8c1597f0 0x7fee8c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee9339d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee8c15d230 0x7fee8c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee9339d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8c15db70 con 0x7fee8c159420 2023-10-10T22:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee9339d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c0b11d0 con 0x7fee8c15d230 2023-10-10T22:18:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee9339d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c0b14b0 con 0x7fee8c1597f0 2023-10-10T22:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee92b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee8c15d230 0x7fee8c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee92b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee8c15d230 0x7fee8c15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47792/0 (socket says 172.21.15.154:47792) 2023-10-10T22:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee92b9c700 1 -- 172.21.15.154:0/1733669390 learned_addr learned my addr 172.21.15.154:0/1733669390 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee9239b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fee8c159420 0x7fee8c0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52928/0 (socket says 172.21.15.154:52928) 2023-10-10T22:18:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee91b9a700 1 --2- 172.21.15.154:0/1733669390 >> v2:172.21.15.179:3300/0 conn(0x7fee8c1597f0 0x7fee8c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee92b9c700 1 -- 172.21.15.154:0/1733669390 >> v2:172.21.15.179:3300/0 conn(0x7fee8c1597f0 msgr2=0x7fee8c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:06.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee92b9c700 1 --2- 172.21.15.154:0/1733669390 >> v2:172.21.15.179:3300/0 conn(0x7fee8c1597f0 0x7fee8c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee92b9c700 1 -- 172.21.15.154:0/1733669390 >> v1:172.21.15.154:6789/0 conn(0x7fee8c159420 legacy=0x7fee8c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.347+0000 7fee92b9c700 1 -- 172.21.15.154:0/1733669390 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c0b1790 con 0x7fee8c15d230 2023-10-10T22:18:06.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.348+0000 7fee92b9c700 1 --2- 172.21.15.154:0/1733669390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c15d230 0x7fee8c15d630 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fee8c089750 tx=0x7fee84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f2307f8ed4f846 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:06.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.348+0000 7fee91399700 1 -- 172.21.15.154:0/1733669390 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400e070 con 0x7fee8c15d230 2023-10-10T22:18:06.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.348+0000 7fee91399700 1 -- 172.21.15.154:0/1733669390 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8400ba20 con 0x7fee8c15d230 2023-10-10T22:18:06.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.348+0000 7fee91399700 1 -- 172.21.15.154:0/1733669390 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee840092e0 con 0x7fee8c15d230 2023-10-10T22:18:06.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.349+0000 7fee9339d700 1 -- 172.21.15.154:0/1733669390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c15d230 msgr2=0x7fee8c15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.349+0000 7fee9339d700 1 --2- 172.21.15.154:0/1733669390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c15d230 0x7fee8c15d630 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fee8c089750 tx=0x7fee84009840 comp rx=0 tx=0).stop 2023-10-10T22:18:06.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.349+0000 7fee9339d700 1 -- 172.21.15.154:0/1733669390 shutdown_connections 2023-10-10T22:18:06.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.349+0000 7fee9339d700 1 --2- 172.21.15.154:0/1733669390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c15d230 0x7fee8c15d630 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.349+0000 7fee9339d700 1 --2- 172.21.15.154:0/1733669390 >> v2:172.21.15.179:3300/0 conn(0x7fee8c1597f0 0x7fee8c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.349+0000 7fee9339d700 1 -- 172.21.15.154:0/1733669390 >> 172.21.15.154:0/1733669390 conn(0x7fee8c0d0660 msgr2=0x7fee8c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:06.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.349+0000 7fee9339d700 1 -- 172.21.15.154:0/1733669390 shutdown_connections 2023-10-10T22:18:06.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.349+0000 7fee9339d700 1 -- 172.21.15.154:0/1733669390 wait complete. 2023-10-10T22:18:06.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.350+0000 7fee9339d700 1 Processor -- start 2023-10-10T22:18:06.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.350+0000 7fee9339d700 1 -- start start 2023-10-10T22:18:06.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.351+0000 7fee9339d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c159420 0x7fee8c15c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.351+0000 7fee9339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c1597f0 0x7fee8c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.351+0000 7fee9339d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8c15d230 0x7fee8c153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.351+0000 7fee9339d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c15b650 con 0x7fee8c159420 2023-10-10T22:18:06.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.351+0000 7fee9339d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c15b090 con 0x7fee8c15d230 2023-10-10T22:18:06.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.351+0000 7fee9339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c15b370 con 0x7fee8c1597f0 2023-10-10T22:18:06.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.351+0000 7fee9239b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c159420 0x7fee8c15c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee92b9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8c15d230 0x7fee8c153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee9239b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c159420 0x7fee8c15c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47800/0 (socket says 172.21.15.154:47800) 2023-10-10T22:18:06.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee9239b700 1 -- 172.21.15.154:0/2695116451 learned_addr learned my addr 172.21.15.154:0/2695116451 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:06.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee91b9a700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c1597f0 0x7fee8c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee9239b700 1 -- 172.21.15.154:0/2695116451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c1597f0 msgr2=0x7fee8c15a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee9239b700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c1597f0 0x7fee8c15a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee9239b700 1 -- 172.21.15.154:0/2695116451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8c15d230 msgr2=0x7fee8c153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee9239b700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8c15d230 0x7fee8c153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee9239b700 1 -- 172.21.15.154:0/2695116451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84009ae0 con 0x7fee8c159420 2023-10-10T22:18:06.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee92b9c700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8c15d230 0x7fee8c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:06.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.352+0000 7fee9239b700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c159420 0x7fee8c15c940 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fee8800c7c0 tx=0x7fee88007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:06.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.353+0000 7fee827fc700 1 -- 172.21.15.154:0/2695116451 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88005a70 con 0x7fee8c159420 2023-10-10T22:18:06.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.353+0000 7fee827fc700 1 -- 172.21.15.154:0/2695116451 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee88005bf0 con 0x7fee8c159420 2023-10-10T22:18:06.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.353+0000 7fee827fc700 1 -- 172.21.15.154:0/2695116451 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee880070d0 con 0x7fee8c159420 2023-10-10T22:18:06.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.353+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8c0c55a0 con 0x7fee8c159420 2023-10-10T22:18:06.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.353+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8c0c7430 con 0x7fee8c159420 2023-10-10T22:18:06.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.354+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8c0c5400 con 0x7fee8c159420 2023-10-10T22:18:06.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.355+0000 7fee827fc700 1 -- 172.21.15.154:0/2695116451 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fee88007480 con 0x7fee8c159420 2023-10-10T22:18:06.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.356+0000 7fee827fc700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fee700670e0 0x7fee70069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.357+0000 7fee91b9a700 1 -- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fee700670e0 msgr2=0x7fee70069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:06.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.357+0000 7fee827fc700 1 -- 172.21.15.154:0/2695116451 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fee880841c0 con 0x7fee8c159420 2023-10-10T22:18:06.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.357+0000 7fee91b9a700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fee700670e0 0x7fee70069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:06.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.360+0000 7fee827fc700 1 -- 172.21.15.154:0/2695116451 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee88050ec0 con 0x7fee8c159420 2023-10-10T22:18:06.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.558+0000 7fee91b9a700 1 -- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fee700670e0 msgr2=0x7fee70069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:06.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.558+0000 7fee91b9a700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fee700670e0 0x7fee70069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:06.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.559+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee8c0c5400 con 0x7fee8c159420 2023-10-10T22:18:06.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.560+0000 7fee827fc700 1 -- 172.21.15.154:0/2695116451 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16496 (secure 0 0 0) 0x7fee8c0c5400 con 0x7fee8c159420 2023-10-10T22:18:06.562 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:06.562 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":162,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:18:02.279765+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:17:39.176673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-10T22:17:39.960878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/85496":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/4143885227":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/2029064094":"2023-10-11T22:18:02.279727+0000","172.21.15.154:6836/85496":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/2883016605":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/1006008362":"2023-10-11T22:18:02.279727+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:18:06.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fee700670e0 msgr2=0x7fee70069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:06.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fee700670e0 0x7fee70069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c159420 msgr2=0x7fee8c15c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c159420 0x7fee8c15c940 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fee8800c7c0 tx=0x7fee88007f70 comp rx=0 tx=0).stop 2023-10-10T22:18:06.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 shutdown_connections 2023-10-10T22:18:06.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8c15d230 0x7fee8c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fee700670e0 0x7fee70069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee8c159420 0x7fee8c15c940 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 --2- 172.21.15.154:0/2695116451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c1597f0 0x7fee8c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.562+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 >> 172.21.15.154:0/2695116451 conn(0x7fee8c0d0660 msgr2=0x7fee8c0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:06.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.563+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 shutdown_connections 2023-10-10T22:18:06.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.563+0000 7fee9339d700 1 -- 172.21.15.154:0/2695116451 wait complete. 2023-10-10T22:18:06.583 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T22:17:39.176673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T22:17:39.960878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T22:18:06.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T22:18:06.599 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:06.597+0000 7f0f0597d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:18:06.669 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:06.667+0000 7f386c4ca180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:18:06.761 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:06.759+0000 7f0f0597d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:18:06.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.774+0000 7f64109fe700 1 Processor -- start 2023-10-10T22:18:06.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.774+0000 7f64109fe700 1 -- start start 2023-10-10T22:18:06.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.775+0000 7f64109fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f640c0b4e70 0x7f640c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f64109fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f640c0b1b40 0x7f640c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f64109fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c0cfb00 con 0x7f640c0b16d0 2023-10-10T22:18:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f64109fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c0b5c40 con 0x7f640c0b1b40 2023-10-10T22:18:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f64109fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c0b5f20 con 0x7f640c0b4e70 2023-10-10T22:18:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f640b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f640c0b1b40 0x7f640c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f640b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f640c0b1b40 0x7f640c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47802/0 (socket says 172.21.15.154:47802) 2023-10-10T22:18:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f640b59e700 1 -- 172.21.15.154:0/3614164516 learned_addr learned my addr 172.21.15.154:0/3614164516 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f640ad9d700 1 --2- 172.21.15.154:0/3614164516 >> v2:172.21.15.179:3300/0 conn(0x7f640c0b4e70 0x7f640c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f640b59e700 1 -- 172.21.15.154:0/3614164516 >> v2:172.21.15.179:3300/0 conn(0x7f640c0b4e70 msgr2=0x7f640c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f640b59e700 1 --2- 172.21.15.154:0/3614164516 >> v2:172.21.15.179:3300/0 conn(0x7f640c0b4e70 0x7f640c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f640b59e700 1 -- 172.21.15.154:0/3614164516 >> v1:172.21.15.179:6789/0 conn(0x7f640c0b16d0 legacy=0x7f640c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f640b59e700 1 -- 172.21.15.154:0/3614164516 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c0b6200 con 0x7f640c0b1b40 2023-10-10T22:18:06.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.776+0000 7f6409d9b700 1 -- 172.21.15.154:0/3614164516 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833889984 0 0) 0x7f640c0cfb00 con 0x7f640c0b16d0 2023-10-10T22:18:06.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.777+0000 7f640b59e700 1 --2- 172.21.15.154:0/3614164516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b1b40 0x7f640c15d950 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f640c064910 tx=0x7f6404009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fe9b1904f8f537 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:06.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.777+0000 7f6409d9b700 1 -- 172.21.15.154:0/3614164516 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640400e070 con 0x7f640c0b1b40 2023-10-10T22:18:06.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.777+0000 7f6409d9b700 1 -- 172.21.15.154:0/3614164516 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640400ba20 con 0x7f640c0b1b40 2023-10-10T22:18:06.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.777+0000 7f6409d9b700 1 -- 172.21.15.154:0/3614164516 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64040092e0 con 0x7f640c0b1b40 2023-10-10T22:18:06.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.778+0000 7f64109fe700 1 -- 172.21.15.154:0/3614164516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b1b40 msgr2=0x7f640c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.778+0000 7f64109fe700 1 --2- 172.21.15.154:0/3614164516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b1b40 0x7f640c15d950 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f640c064910 tx=0x7f6404009840 comp rx=0 tx=0).stop 2023-10-10T22:18:06.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.778+0000 7f64109fe700 1 -- 172.21.15.154:0/3614164516 shutdown_connections 2023-10-10T22:18:06.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.778+0000 7f64109fe700 1 --2- 172.21.15.154:0/3614164516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b1b40 0x7f640c15d950 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.778+0000 7f64109fe700 1 --2- 172.21.15.154:0/3614164516 >> v2:172.21.15.179:3300/0 conn(0x7f640c0b4e70 0x7f640c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.778+0000 7f64109fe700 1 -- 172.21.15.154:0/3614164516 >> 172.21.15.154:0/3614164516 conn(0x7f640c0d10c0 msgr2=0x7f640c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:06.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.778+0000 7f64109fe700 1 -- 172.21.15.154:0/3614164516 shutdown_connections 2023-10-10T22:18:06.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.778+0000 7f64109fe700 1 -- 172.21.15.154:0/3614164516 wait complete. 2023-10-10T22:18:06.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.779+0000 7f64109fe700 1 Processor -- start 2023-10-10T22:18:06.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.779+0000 7f64109fe700 1 -- start start 2023-10-10T22:18:06.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.780+0000 7f64109fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f640c0b16d0 0x7f640c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.780+0000 7f64109fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f640c0b1b40 0x7f640c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.780+0000 7f64109fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b4e70 0x7f640c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.780+0000 7f64109fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c158810 con 0x7f640c0b4e70 2023-10-10T22:18:06.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.780+0000 7f64109fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0c9030 con 0x7f640c0b1b40 2023-10-10T22:18:06.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.780+0000 7f64109fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0c6bf0 con 0x7f640c0b16d0 2023-10-10T22:18:06.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.780+0000 7f640b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b4e70 0x7f640c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.780+0000 7f640b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b4e70 0x7f640c0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47806/0 (socket says 172.21.15.154:47806) 2023-10-10T22:18:06.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.780+0000 7f640b59e700 1 -- 172.21.15.154:0/2290990710 learned_addr learned my addr 172.21.15.154:0/2290990710 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:06.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.781+0000 7f640a59c700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f640c0b1b40 0x7f640c0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.781+0000 7f640ad9d700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f640c0b16d0 0x7f640c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:06.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.781+0000 7f640b59e700 1 -- 172.21.15.154:0/2290990710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f640c0b16d0 msgr2=0x7f640c145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.781+0000 7f640b59e700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f640c0b16d0 0x7f640c145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.781+0000 7f640b59e700 1 -- 172.21.15.154:0/2290990710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f640c0b1b40 msgr2=0x7f640c0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.781+0000 7f640b59e700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f640c0b1b40 0x7f640c0ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.781+0000 7f640b59e700 1 -- 172.21.15.154:0/2290990710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404009ae0 con 0x7f640c0b4e70 2023-10-10T22:18:06.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.781+0000 7f640b59e700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b4e70 0x7f640c0caca0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f6404009880 tx=0x7f6404018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:06.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.781+0000 7f63f2ffd700 1 -- 172.21.15.154:0/2290990710 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404008a80 con 0x7f640c0b4e70 2023-10-10T22:18:06.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.782+0000 7f63f2ffd700 1 -- 172.21.15.154:0/2290990710 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6404008c00 con 0x7f640c0b4e70 2023-10-10T22:18:06.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.782+0000 7f63f2ffd700 1 -- 172.21.15.154:0/2290990710 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404026460 con 0x7f640c0b4e70 2023-10-10T22:18:06.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.782+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c0c8700 con 0x7f640c0b4e70 2023-10-10T22:18:06.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.782+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c0c8cc0 con 0x7f640c0b4e70 2023-10-10T22:18:06.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.783+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c088990 con 0x7f640c0b4e70 2023-10-10T22:18:06.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.784+0000 7f63f2ffd700 1 -- 172.21.15.154:0/2290990710 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f6404003040 con 0x7f640c0b4e70 2023-10-10T22:18:06.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.785+0000 7f63f2ffd700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f63f80670e0 0x7f63f8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:06.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.785+0000 7f63f2ffd700 1 -- 172.21.15.154:0/2290990710 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f6404086b20 con 0x7f640c0b4e70 2023-10-10T22:18:06.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.785+0000 7f640ad9d700 1 -- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f63f80670e0 msgr2=0x7f63f8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:06.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.785+0000 7f640ad9d700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f63f80670e0 0x7f63f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:06.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.789+0000 7f63f2ffd700 1 -- 172.21.15.154:0/2290990710 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6404053740 con 0x7f640c0b4e70 2023-10-10T22:18:06.842 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:06.840+0000 7f386c4ca180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:18:06.847 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:06.845+0000 7f0f0597d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:18:06.931 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:06.930+0000 7f386c4ca180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:18:06.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.986+0000 7f640ad9d700 1 -- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f63f80670e0 msgr2=0x7f63f8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:06.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.986+0000 7f640ad9d700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f63f80670e0 0x7f63f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.988+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f640c15ce20 con 0x7f640c0b4e70 2023-10-10T22:18:06.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.989+0000 7f63f2ffd700 1 -- 172.21.15.154:0/2290990710 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7f640402b020 con 0x7f640c0b4e70 2023-10-10T22:18:06.991 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T22:18:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f63f80670e0 msgr2=0x7f63f8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f63f80670e0 0x7f63f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b4e70 msgr2=0x7f640c0caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b4e70 0x7f640c0caca0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f6404009880 tx=0x7f6404018000 comp rx=0 tx=0).stop 2023-10-10T22:18:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 shutdown_connections 2023-10-10T22:18:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f63f80670e0 0x7f63f8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0b4e70 0x7f640c0caca0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f640c0b16d0 0x7f640c145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 --2- 172.21.15.154:0/2290990710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f640c0b1b40 0x7f640c0ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 >> 172.21.15.154:0/2290990710 conn(0x7f640c0d10c0 msgr2=0x7f640c15c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 shutdown_connections 2023-10-10T22:18:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:06.992+0000 7f64109fe700 1 -- 172.21.15.154:0/2290990710 wait complete. 2023-10-10T22:18:07.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T22:18:07.071 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:07.070+0000 7f0f0597d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:18:07.168 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:07.167+0000 7f386c4ca180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:18:07.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.202+0000 7f0dcffff700 1 Processor -- start 2023-10-10T22:18:07.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.203+0000 7f0dcffff700 1 -- start start 2023-10-10T22:18:07.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dcffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0dd00cc600 0x7f0dd00b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cc9d0 0x7f0dd015d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dcffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0dd00cd0f0 0x7f0dd015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dcffff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd0150b50 con 0x7f0dd00cc600 2023-10-10T22:18:07.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dcffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd00cede0 con 0x7f0dd00cd0f0 2023-10-10T22:18:07.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dcffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00b2260 con 0x7f0dd00cc9d0 2023-10-10T22:18:07.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dceffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0dd00cc600 0x7f0dd00b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dceffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0dd00cc600 0x7f0dd00b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47812/0 (socket says 172.21.15.154:47812) 2023-10-10T22:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dceffd700 1 -- 172.21.15.154:0/1715945141 learned_addr learned my addr 172.21.15.154:0/1715945141 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dcf7fe700 1 --2- 172.21.15.154:0/1715945141 >> v2:172.21.15.179:3300/0 conn(0x7f0dd00cd0f0 0x7f0dd015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.204+0000 7f0dce7fc700 1 --2- 172.21.15.154:0/1715945141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cc9d0 0x7f0dd015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.205+0000 7f0dceffd700 1 -- 172.21.15.154:0/1715945141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cc9d0 msgr2=0x7f0dd015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:07.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.205+0000 7f0dceffd700 1 --2- 172.21.15.154:0/1715945141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cc9d0 0x7f0dd015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.205+0000 7f0dceffd700 1 -- 172.21.15.154:0/1715945141 >> v2:172.21.15.179:3300/0 conn(0x7f0dd00cd0f0 msgr2=0x7f0dd015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:07.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.205+0000 7f0dceffd700 1 --2- 172.21.15.154:0/1715945141 >> v2:172.21.15.179:3300/0 conn(0x7f0dd00cd0f0 0x7f0dd015d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.205+0000 7f0dceffd700 1 -- 172.21.15.154:0/1715945141 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00b2540 con 0x7f0dd00cc600 2023-10-10T22:18:07.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.205+0000 7f0dceffd700 1 --2- 172.21.15.154:0/1715945141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 0x7f0dd00b1a10 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00b3800 tx=0x7f0dc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c1253f9fe6a802 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:07.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.205+0000 7f0dcdffb700 1 -- 172.21.15.154:0/1715945141 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000b640 con 0x7f0dd00cc600 2023-10-10T22:18:07.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.205+0000 7f0dcdffb700 1 -- 172.21.15.154:0/1715945141 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000b7a0 con 0x7f0dd00cc600 2023-10-10T22:18:07.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.205+0000 7f0dcdffb700 1 -- 172.21.15.154:0/1715945141 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000bb60 con 0x7f0dd00cc600 2023-10-10T22:18:07.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.206+0000 7f0dcffff700 1 -- 172.21.15.154:0/1715945141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 msgr2=0x7f0dd00b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:07.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.206+0000 7f0dcffff700 1 --2- 172.21.15.154:0/1715945141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 0x7f0dd00b1a10 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00b3800 tx=0x7f0dc0009250 comp rx=0 tx=0).stop 2023-10-10T22:18:07.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.206+0000 7f0dcffff700 1 -- 172.21.15.154:0/1715945141 shutdown_connections 2023-10-10T22:18:07.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.206+0000 7f0dcffff700 1 --2- 172.21.15.154:0/1715945141 >> v2:172.21.15.179:3300/0 conn(0x7f0dd00cd0f0 0x7f0dd015d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.206+0000 7f0dcffff700 1 --2- 172.21.15.154:0/1715945141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 0x7f0dd00b1a10 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.206+0000 7f0dcffff700 1 --2- 172.21.15.154:0/1715945141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cc9d0 0x7f0dd015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.206+0000 7f0dcffff700 1 -- 172.21.15.154:0/1715945141 >> 172.21.15.154:0/1715945141 conn(0x7f0dd00d0630 msgr2=0x7f0dd00d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:07.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.206+0000 7f0dcffff700 1 -- 172.21.15.154:0/1715945141 shutdown_connections 2023-10-10T22:18:07.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.206+0000 7f0dcffff700 1 -- 172.21.15.154:0/1715945141 wait complete. 2023-10-10T22:18:07.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.208+0000 7f0dcffff700 1 Processor -- start 2023-10-10T22:18:07.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.208+0000 7f0dcffff700 1 -- start start 2023-10-10T22:18:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 0x7f0dd0169f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dd00cc9d0 0x7f0dd016cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cd0f0 0x7f0dd00cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dcffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00c9cb0 con 0x7f0dd00cc600 2023-10-10T22:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dcffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00c90a0 con 0x7f0dd00cc9d0 2023-10-10T22:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dcffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00c9380 con 0x7f0dd00cd0f0 2023-10-10T22:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dceffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 0x7f0dd0169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dceffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 0x7f0dd0169f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47818/0 (socket says 172.21.15.154:47818) 2023-10-10T22:18:07.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dceffd700 1 -- 172.21.15.154:0/2134024979 learned_addr learned my addr 172.21.15.154:0/2134024979 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dcf7fe700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cd0f0 0x7f0dd00cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dce7fc700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dd00cc9d0 0x7f0dd016cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dceffd700 1 -- 172.21.15.154:0/2134024979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cd0f0 msgr2=0x7f0dd00cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dceffd700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cd0f0 0x7f0dd00cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dceffd700 1 -- 172.21.15.154:0/2134024979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dd00cc9d0 msgr2=0x7f0dd016cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dceffd700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dd00cc9d0 0x7f0dd016cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dceffd700 1 -- 172.21.15.154:0/2134024979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00094f0 con 0x7f0dd00cc600 2023-10-10T22:18:07.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dce7fc700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dd00cc9d0 0x7f0dd016cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:07.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.209+0000 7f0dceffd700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 0x7f0dd0169f50 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0071390 tx=0x7f0dc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:07.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.210+0000 7f0db6ffd700 1 -- 172.21.15.154:0/2134024979 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0000d10 con 0x7f0dd00cc600 2023-10-10T22:18:07.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.210+0000 7f0db6ffd700 1 -- 172.21.15.154:0/2134024979 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000bb20 con 0x7f0dd00cc600 2023-10-10T22:18:07.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.210+0000 7f0db6ffd700 1 -- 172.21.15.154:0/2134024979 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0011670 con 0x7f0dd00cc600 2023-10-10T22:18:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.210+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd00c9660 con 0x7f0dd00cc600 2023-10-10T22:18:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.210+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd016d190 con 0x7f0dd00cc600 2023-10-10T22:18:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.211+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd00889d0 con 0x7f0dd00cc600 2023-10-10T22:18:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.213+0000 7f0db6ffd700 1 -- 172.21.15.154:0/2134024979 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0dc00119e0 con 0x7f0dd00cc600 2023-10-10T22:18:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.214+0000 7f0db6ffd700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0dbc0670e0 0x7f0dbc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.214+0000 7f0db6ffd700 1 -- 172.21.15.154:0/2134024979 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f0dc0086350 con 0x7f0dd00cc600 2023-10-10T22:18:07.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.214+0000 7f0dce7fc700 1 -- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0dbc0670e0 msgr2=0x7f0dbc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:07.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.214+0000 7f0dce7fc700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0dbc0670e0 0x7f0dbc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:07.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.218+0000 7f0db6ffd700 1 -- 172.21.15.154:0/2134024979 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dc0052fd0 con 0x7f0dd00cc600 2023-10-10T22:18:07.249 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:07.248+0000 7f0f0597d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:18:07.343 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:07.341+0000 7f0f0597d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:18:07.353 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:07.352+0000 7f386c4ca180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:18:07.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.415+0000 7f0dce7fc700 1 -- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0dbc0670e0 msgr2=0x7f0dbc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:07.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.415+0000 7f0dce7fc700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0dbc0670e0 0x7f0dbc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:07.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.417+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0dd00b2820 con 0x7f0dd00cc600 2023-10-10T22:18:07.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.418+0000 7f0db6ffd700 1 -- 172.21.15.154:0/2134024979 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0dc00565f0 con 0x7f0dd00cc600 2023-10-10T22:18:07.419 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T22:18:07.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0dbc0670e0 msgr2=0x7f0dbc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:07.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0dbc0670e0 0x7f0dbc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 msgr2=0x7f0dd0169f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 0x7f0dd0169f50 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0071390 tx=0x7f0dc0017000 comp rx=0 tx=0).stop 2023-10-10T22:18:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 shutdown_connections 2023-10-10T22:18:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dd00cd0f0 0x7f0dd00cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0dbc0670e0 0x7f0dbc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd00cc600 0x7f0dd0169f50 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 --2- 172.21.15.154:0/2134024979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dd00cc9d0 0x7f0dd016cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 >> 172.21.15.154:0/2134024979 conn(0x7f0dd00d0630 msgr2=0x7f0dd014dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:07.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 shutdown_connections 2023-10-10T22:18:07.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.420+0000 7f0dcffff700 1 -- 172.21.15.154:0/2134024979 wait complete. 2023-10-10T22:18:07.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T22:18:07.447 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:07.446+0000 7f386c4ca180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:18:07.505 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:07.503+0000 7f0f0597d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:18:07.606 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:07.604+0000 7f0f0597d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:18:07.619 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:07.617+0000 7f386c4ca180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:18:07.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.633+0000 7f484bfff700 1 Processor -- start 2023-10-10T22:18:07.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.633+0000 7f484bfff700 1 -- start start 2023-10-10T22:18:07.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.634+0000 7f484bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 0x7f484c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.634+0000 7f484bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f484c0b1b40 0x7f484c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.634+0000 7f484bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484c0cfb00 con 0x7f484c0b16d0 2023-10-10T22:18:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.634+0000 7f484bfff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484c0b5c40 con 0x7f484c0b1b40 2023-10-10T22:18:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.634+0000 7f484bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0b5f20 con 0x7f484c0b4e70 2023-10-10T22:18:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f484b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f484c0b1b40 0x7f484c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f484b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f484c0b1b40 0x7f484c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47832/0 (socket says 172.21.15.154:47832) 2023-10-10T22:18:07.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f484b7fe700 1 -- 172.21.15.154:0/1508753552 learned_addr learned my addr 172.21.15.154:0/1508753552 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:07.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f484affd700 1 --2- 172.21.15.154:0/1508753552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 0x7f484c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f484b7fe700 1 -- 172.21.15.154:0/1508753552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 msgr2=0x7f484c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:07.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f484b7fe700 1 --2- 172.21.15.154:0/1508753552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 0x7f484c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f484b7fe700 1 -- 172.21.15.154:0/1508753552 >> v1:172.21.15.179:6789/0 conn(0x7f484c0b16d0 legacy=0x7f484c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:07.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f4849ffb700 1 -- 172.21.15.154:0/1508753552 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810903353 0 0) 0x7f484c0cfb00 con 0x7f484c0b16d0 2023-10-10T22:18:07.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f484b7fe700 1 -- 172.21.15.154:0/1508753552 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0b6200 con 0x7f484c0b1b40 2023-10-10T22:18:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.635+0000 7f484b7fe700 1 --2- 172.21.15.154:0/1508753552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b1b40 0x7f484c15d950 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f4844009f20 tx=0x7f4844009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2260c205759750 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f4849ffb700 1 -- 172.21.15.154:0/1508753552 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400e070 con 0x7f484c0b1b40 2023-10-10T22:18:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f4849ffb700 1 -- 172.21.15.154:0/1508753552 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400b9d0 con 0x7f484c0b1b40 2023-10-10T22:18:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f4849ffb700 1 -- 172.21.15.154:0/1508753552 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440092e0 con 0x7f484c0b1b40 2023-10-10T22:18:07.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f484bfff700 1 -- 172.21.15.154:0/1508753552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b1b40 msgr2=0x7f484c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:07.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f484bfff700 1 --2- 172.21.15.154:0/1508753552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b1b40 0x7f484c15d950 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f4844009f20 tx=0x7f4844009840 comp rx=0 tx=0).stop 2023-10-10T22:18:07.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f484bfff700 1 -- 172.21.15.154:0/1508753552 shutdown_connections 2023-10-10T22:18:07.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f484bfff700 1 --2- 172.21.15.154:0/1508753552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b1b40 0x7f484c15d950 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f484bfff700 1 --2- 172.21.15.154:0/1508753552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 0x7f484c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f484bfff700 1 -- 172.21.15.154:0/1508753552 >> 172.21.15.154:0/1508753552 conn(0x7f484c0d10c0 msgr2=0x7f484c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:07.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.636+0000 7f484bfff700 1 -- 172.21.15.154:0/1508753552 shutdown_connections 2023-10-10T22:18:07.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.637+0000 7f484bfff700 1 -- 172.21.15.154:0/1508753552 wait complete. 2023-10-10T22:18:07.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.638+0000 7f484bfff700 1 Processor -- start 2023-10-10T22:18:07.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.638+0000 7f484bfff700 1 -- start start 2023-10-10T22:18:07.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b16d0 0x7f484c0af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f484c0b1b40 0x7f484c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 0x7f484c0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0af5a0 con 0x7f484c0b16d0 2023-10-10T22:18:07.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0c9e10 con 0x7f484c0b1b40 2023-10-10T22:18:07.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0ca0f0 con 0x7f484c0b4e70 2023-10-10T22:18:07.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b16d0 0x7f484c0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f484c0b1b40 0x7f484c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b16d0 0x7f484c0af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47838/0 (socket says 172.21.15.154:47838) 2023-10-10T22:18:07.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484affd700 1 -- 172.21.15.154:0/1036426223 learned_addr learned my addr 172.21.15.154:0/1036426223 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:07.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.639+0000 7f484b7fe700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 0x7f484c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:07.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f484affd700 1 -- 172.21.15.154:0/1036426223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 msgr2=0x7f484c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f484affd700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 0x7f484c0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f484affd700 1 -- 172.21.15.154:0/1036426223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f484c0b1b40 msgr2=0x7f484c0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f484affd700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f484c0b1b40 0x7f484c0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f484affd700 1 -- 172.21.15.154:0/1036426223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844009ae0 con 0x7f484c0b16d0 2023-10-10T22:18:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f484a7fc700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f484c0b1b40 0x7f484c0c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f484affd700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b16d0 0x7f484c0af060 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f483c00e930 tx=0x7f483c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f4832ffd700 1 -- 172.21.15.154:0/1036426223 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c013680 con 0x7f484c0b16d0 2023-10-10T22:18:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f4832ffd700 1 -- 172.21.15.154:0/1036426223 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c0137e0 con 0x7f484c0b16d0 2023-10-10T22:18:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f4832ffd700 1 -- 172.21.15.154:0/1036426223 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c013b80 con 0x7f484c0b16d0 2023-10-10T22:18:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c0ca3d0 con 0x7f484c0b16d0 2023-10-10T22:18:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.640+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c0c7ea0 con 0x7f484c0b16d0 2023-10-10T22:18:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.641+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484c0c8390 con 0x7f484c0b16d0 2023-10-10T22:18:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.642+0000 7f4832ffd700 1 -- 172.21.15.154:0/1036426223 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f483c00c3e0 con 0x7f484c0b16d0 2023-10-10T22:18:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.643+0000 7f4832ffd700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f48380670e0 0x7f4838069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.643+0000 7f4832ffd700 1 -- 172.21.15.154:0/1036426223 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f483c084ba0 con 0x7f484c0b16d0 2023-10-10T22:18:07.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.644+0000 7f484a7fc700 1 -- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f48380670e0 msgr2=0x7f4838069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:07.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.644+0000 7f484a7fc700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f48380670e0 0x7f4838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:07.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.647+0000 7f4832ffd700 1 -- 172.21.15.154:0/1036426223 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f483c0518c0 con 0x7f484c0b16d0 2023-10-10T22:18:07.725 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:07.723+0000 7f386c4ca180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:18:07.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.844+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f484c0b1510 con 0x7f484c0b16d0 2023-10-10T22:18:07.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.844+0000 7f4832ffd700 1 -- 172.21.15.154:0/1036426223 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+11 (secure 0 0 0) 0x7f483c054ee0 con 0x7f484c0b16d0 2023-10-10T22:18:07.846 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T22:18:07.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.845+0000 7f484a7fc700 1 -- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f48380670e0 msgr2=0x7f4838069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:07.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.845+0000 7f484a7fc700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f48380670e0 0x7f4838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:07.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f48380670e0 msgr2=0x7f4838069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:07.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f48380670e0 0x7f4838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b16d0 msgr2=0x7f484c0af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:07.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b16d0 0x7f484c0af060 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f483c00e930 tx=0x7f483c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 shutdown_connections 2023-10-10T22:18:07.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f484c0b4e70 0x7f484c0ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f48380670e0 0x7f4838069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c0b16d0 0x7f484c0af060 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 --2- 172.21.15.154:0/1036426223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f484c0b1b40 0x7f484c0c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:07.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 >> 172.21.15.154:0/1036426223 conn(0x7f484c0d10c0 msgr2=0x7f484c0b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:07.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 shutdown_connections 2023-10-10T22:18:07.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:07.847+0000 7f484bfff700 1 -- 172.21.15.154:0/1036426223 wait complete. 2023-10-10T22:18:07.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:18:08.090 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:08.089+0000 7f0f0597d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:18:08.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.096+0000 7fa40f59e700 1 Processor -- start 2023-10-10T22:18:08.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.097+0000 7fa40f59e700 1 -- start start 2023-10-10T22:18:08.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.098+0000 7fa40f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa4101597f0 0x7fa4100b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.098+0000 7fa40f59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa41015d230 0x7fa41015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.098+0000 7fa40f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41015db70 con 0x7fa410159420 2023-10-10T22:18:08.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.098+0000 7fa40f59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4100b11d0 con 0x7fa41015d230 2023-10-10T22:18:08.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.098+0000 7fa40f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4100b14b0 con 0x7fa4101597f0 2023-10-10T22:18:08.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.098+0000 7fa40ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa41015d230 0x7fa41015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.098+0000 7fa40ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa41015d230 0x7fa41015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47844/0 (socket says 172.21.15.154:47844) 2023-10-10T22:18:08.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.098+0000 7fa40ed9d700 1 -- 172.21.15.154:0/427600054 learned_addr learned my addr 172.21.15.154:0/427600054 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:08.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.098+0000 7fa40dd9b700 1 --2- 172.21.15.154:0/427600054 >> v2:172.21.15.179:3300/0 conn(0x7fa4101597f0 0x7fa4100b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40d59a700 1 -- 172.21.15.154:0/427600054 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297265996 0 0) 0x7fa41015db70 con 0x7fa410159420 2023-10-10T22:18:08.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40ed9d700 1 -- 172.21.15.154:0/427600054 >> v2:172.21.15.179:3300/0 conn(0x7fa4101597f0 msgr2=0x7fa4100b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:08.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40ed9d700 1 --2- 172.21.15.154:0/427600054 >> v2:172.21.15.179:3300/0 conn(0x7fa4101597f0 0x7fa4100b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40ed9d700 1 -- 172.21.15.154:0/427600054 >> v1:172.21.15.179:6789/0 conn(0x7fa410159420 legacy=0x7fa4100b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40ed9d700 1 -- 172.21.15.154:0/427600054 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100b1790 con 0x7fa41015d230 2023-10-10T22:18:08.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40dd9b700 1 --2- 172.21.15.154:0/427600054 >> v2:172.21.15.179:3300/0 conn(0x7fa4101597f0 0x7fa4100b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:08.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40ed9d700 1 --2- 172.21.15.154:0/427600054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa41015d230 0x7fa41015d630 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fa410089750 tx=0x7fa408009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9926a51f0bad0099 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:08.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40d59a700 1 -- 172.21.15.154:0/427600054 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800e070 con 0x7fa41015d230 2023-10-10T22:18:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40d59a700 1 -- 172.21.15.154:0/427600054 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40800ba20 con 0x7fa41015d230 2023-10-10T22:18:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.099+0000 7fa40d59a700 1 -- 172.21.15.154:0/427600054 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4080092e0 con 0x7fa41015d230 2023-10-10T22:18:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.100+0000 7fa40f59e700 1 -- 172.21.15.154:0/427600054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa41015d230 msgr2=0x7fa41015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.100+0000 7fa40f59e700 1 --2- 172.21.15.154:0/427600054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa41015d230 0x7fa41015d630 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fa410089750 tx=0x7fa408009840 comp rx=0 tx=0).stop 2023-10-10T22:18:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.100+0000 7fa40f59e700 1 -- 172.21.15.154:0/427600054 shutdown_connections 2023-10-10T22:18:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.100+0000 7fa40f59e700 1 --2- 172.21.15.154:0/427600054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa41015d230 0x7fa41015d630 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.100+0000 7fa40f59e700 1 --2- 172.21.15.154:0/427600054 >> v2:172.21.15.179:3300/0 conn(0x7fa4101597f0 0x7fa4100b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.100+0000 7fa40f59e700 1 -- 172.21.15.154:0/427600054 >> 172.21.15.154:0/427600054 conn(0x7fa4100d0660 msgr2=0x7fa4100d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.100+0000 7fa40f59e700 1 -- 172.21.15.154:0/427600054 shutdown_connections 2023-10-10T22:18:08.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.100+0000 7fa40f59e700 1 -- 172.21.15.154:0/427600054 wait complete. 2023-10-10T22:18:08.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.101+0000 7fa40f59e700 1 Processor -- start 2023-10-10T22:18:08.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.102+0000 7fa40f59e700 1 -- start start 2023-10-10T22:18:08.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.102+0000 7fa40f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa410159420 0x7fa410153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.102+0000 7fa40f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4101597f0 0x7fa410068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.102+0000 7fa40f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa41015d230 0x7fa4100690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.102+0000 7fa40f59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41016d760 con 0x7fa4101597f0 2023-10-10T22:18:08.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.102+0000 7fa40f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa410154440 con 0x7fa41015d230 2023-10-10T22:18:08.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41016cb50 con 0x7fa410159420 2023-10-10T22:18:08.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4101597f0 0x7fa410068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4101597f0 0x7fa410068b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47854/0 (socket says 172.21.15.154:47854) 2023-10-10T22:18:08.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40dd9b700 1 -- 172.21.15.154:0/3807135699 learned_addr learned my addr 172.21.15.154:0/3807135699 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:08.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40ed9d700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa41015d230 0x7fa4100690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40e59c700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa410159420 0x7fa410153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40dd9b700 1 -- 172.21.15.154:0/3807135699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa410159420 msgr2=0x7fa410153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40dd9b700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa410159420 0x7fa410153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40dd9b700 1 -- 172.21.15.154:0/3807135699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa41015d230 msgr2=0x7fa4100690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40dd9b700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa41015d230 0x7fa4100690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40dd9b700 1 -- 172.21.15.154:0/3807135699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009420 con 0x7fa4101597f0 2023-10-10T22:18:08.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.103+0000 7fa40ed9d700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa41015d230 0x7fa4100690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:08.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.104+0000 7fa40dd9b700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4101597f0 0x7fa410068b60 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa40400ec80 tx=0x7fa4040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:08.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.104+0000 7fa3fe7fc700 1 -- 172.21.15.154:0/3807135699 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400c850 con 0x7fa4101597f0 2023-10-10T22:18:08.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.104+0000 7fa3fe7fc700 1 -- 172.21.15.154:0/3807135699 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400c9b0 con 0x7fa4101597f0 2023-10-10T22:18:08.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.104+0000 7fa3fe7fc700 1 -- 172.21.15.154:0/3807135699 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400cd50 con 0x7fa4101597f0 2023-10-10T22:18:08.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.104+0000 7fa40f59e700 1 -- 172.21.15.154:0/3807135699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa408009ae0 con 0x7fa4101597f0 2023-10-10T22:18:08.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.104+0000 7fa40f59e700 1 -- 172.21.15.154:0/3807135699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41016d110 con 0x7fa4101597f0 2023-10-10T22:18:08.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.105+0000 7fa3effff700 1 -- 172.21.15.154:0/3807135699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41016d8d0 con 0x7fa4101597f0 2023-10-10T22:18:08.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.106+0000 7fa3fe7fc700 1 -- 172.21.15.154:0/3807135699 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa404013680 con 0x7fa4101597f0 2023-10-10T22:18:08.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.107+0000 7fa3fe7fc700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3f00670e0 0x7fa3f0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.107+0000 7fa3fe7fc700 1 -- 172.21.15.154:0/3807135699 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fa404084ee0 con 0x7fa4101597f0 2023-10-10T22:18:08.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.107+0000 7fa40e59c700 1 -- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3f00670e0 msgr2=0x7fa3f0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:08.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.107+0000 7fa40e59c700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3f00670e0 0x7fa3f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:08.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.111+0000 7fa3fe7fc700 1 -- 172.21.15.154:0/3807135699 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa404051c00 con 0x7fa4101597f0 2023-10-10T22:18:08.184 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:08.183+0000 7f0f0597d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:18:08.236 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:08.234+0000 7f386c4ca180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:18:08.274 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:08.272+0000 7f0f0597d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:18:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.308+0000 7fa40e59c700 1 -- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3f00670e0 msgr2=0x7fa3f0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.308+0000 7fa40e59c700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3f00670e0 0x7fa3f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:08.334 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:08.332+0000 7f386c4ca180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:18:08.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.353+0000 7fa3effff700 1 -- 172.21.15.154:0/3807135699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa41004c3c0 con 0x7fa4101597f0 2023-10-10T22:18:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.353+0000 7fa3fe7fc700 1 -- 172.21.15.154:0/3807135699 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fa404055220 con 0x7fa4101597f0 2023-10-10T22:18:08.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:08.356 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7196,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3891554759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3891554759},{"type":"v1","addr":"172.21.15.179:6834","nonce":3891554759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8158,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1858498414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1858498414},{"type":"v1","addr":"172.21.15.154:6835","nonce":1858498414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8161,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3531287783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3531287783},{"type":"v1","addr":"172.21.15.179:6835","nonce":3531287783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:17:40.982384+0000","modified":"2023-10-10T22:17:44.985977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8640":{"gid":8640,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/3925813058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3925813058},{"type":"v1","addr":"172.21.15.154:6834","nonce":3925813058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-10T22:18:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 -- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3f00670e0 msgr2=0x7fa3f0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3f00670e0 0x7fa3f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 -- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4101597f0 msgr2=0x7fa410068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4101597f0 0x7fa410068b60 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa40400ec80 tx=0x7fa4040091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 -- 172.21.15.154:0/3807135699 shutdown_connections 2023-10-10T22:18:08.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa41015d230 0x7fa4100690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa410159420 0x7fa410153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa3f00670e0 0x7fa3f0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 --2- 172.21.15.154:0/3807135699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4101597f0 0x7fa410068b60 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 -- 172.21.15.154:0/3807135699 >> 172.21.15.154:0/3807135699 conn(0x7fa4100d0660 msgr2=0x7fa4100ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:08.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 -- 172.21.15.154:0/3807135699 shutdown_connections 2023-10-10T22:18:08.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.356+0000 7fa3effff700 1 -- 172.21.15.154:0/3807135699 wait complete. 2023-10-10T22:18:08.361 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 70 2023-10-10T22:18:08.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:18:08.431 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:08.429+0000 7f386c4ca180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:18:08.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.562+0000 7f153139d700 1 Processor -- start 2023-10-10T22:18:08.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.562+0000 7f153139d700 1 -- start start 2023-10-10T22:18:08.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.564+0000 7f153139d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f152c156310 0x7f152c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.564+0000 7f153139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 0x7f152c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f153139d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c0ca860 con 0x7f152c1566e0 2023-10-10T22:18:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f153139d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c0cab40 con 0x7f152c156310 2023-10-10T22:18:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f153139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0cae20 con 0x7f152c0ae710 2023-10-10T22:18:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f152bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f152c156310 0x7f152c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f152bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f152c156310 0x7f152c0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47870/0 (socket says 172.21.15.154:47870) 2023-10-10T22:18:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f152bfff700 1 -- 172.21.15.154:0/424447291 learned_addr learned my addr 172.21.15.154:0/424447291 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f152b7fe700 1 --1- 172.21.15.154:0/424447291 >> v1:172.21.15.154:6789/0 conn(0x7f152c1566e0 0x7f152c0ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52942/0 (socket says 172.21.15.154:52942) 2023-10-10T22:18:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f1530b9c700 1 --2- 172.21.15.154:0/424447291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 0x7f152c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f152bfff700 1 -- 172.21.15.154:0/424447291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 msgr2=0x7f152c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f152bfff700 1 --2- 172.21.15.154:0/424447291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 0x7f152c0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f152bfff700 1 -- 172.21.15.154:0/424447291 >> v1:172.21.15.154:6789/0 conn(0x7f152c1566e0 legacy=0x7f152c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f152bfff700 1 -- 172.21.15.154:0/424447291 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0cb100 con 0x7f152c156310 2023-10-10T22:18:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.565+0000 7f152affd700 1 -- 172.21.15.154:0/424447291 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228584968 0 0) 0x7f152c0ca860 con 0x7f152c1566e0 2023-10-10T22:18:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.566+0000 7f152bfff700 1 --2- 172.21.15.154:0/424447291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c156310 0x7f152c0c9dc0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f151c0099b0 tx=0x7f151c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13851740bf5f5177 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:08.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.566+0000 7f152affd700 1 -- 172.21.15.154:0/424447291 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c009ea0 con 0x7f152c156310 2023-10-10T22:18:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.566+0000 7f152affd700 1 -- 172.21.15.154:0/424447291 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00b860 con 0x7f152c156310 2023-10-10T22:18:08.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.566+0000 7f152affd700 1 -- 172.21.15.154:0/424447291 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00bc00 con 0x7f152c156310 2023-10-10T22:18:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.567+0000 7f153139d700 1 -- 172.21.15.154:0/424447291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c156310 msgr2=0x7f152c0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.567+0000 7f153139d700 1 --2- 172.21.15.154:0/424447291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c156310 0x7f152c0c9dc0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f151c0099b0 tx=0x7f151c009250 comp rx=0 tx=0).stop 2023-10-10T22:18:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.567+0000 7f153139d700 1 -- 172.21.15.154:0/424447291 shutdown_connections 2023-10-10T22:18:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.567+0000 7f153139d700 1 --2- 172.21.15.154:0/424447291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 0x7f152c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.567+0000 7f153139d700 1 --2- 172.21.15.154:0/424447291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c156310 0x7f152c0c9dc0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.567+0000 7f153139d700 1 -- 172.21.15.154:0/424447291 >> 172.21.15.154:0/424447291 conn(0x7f152c0cc1f0 msgr2=0x7f152c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.567+0000 7f153139d700 1 -- 172.21.15.154:0/424447291 shutdown_connections 2023-10-10T22:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.567+0000 7f153139d700 1 -- 172.21.15.154:0/424447291 wait complete. 2023-10-10T22:18:08.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.569+0000 7f153139d700 1 Processor -- start 2023-10-10T22:18:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.569+0000 7f153139d700 1 -- start start 2023-10-10T22:18:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f153139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 0x7f152c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f153139d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f152c156310 0x7f152c144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f153139d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c1566e0 0x7f152c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f153139d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0c4010 con 0x7f152c1566e0 2023-10-10T22:18:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f153139d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0c33d0 con 0x7f152c156310 2023-10-10T22:18:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f153139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0c3670 con 0x7f152c0ae710 2023-10-10T22:18:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f1530b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c1566e0 0x7f152c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f1530b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c1566e0 0x7f152c15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47874/0 (socket says 172.21.15.154:47874) 2023-10-10T22:18:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f1530b9c700 1 -- 172.21.15.154:0/1726680064 learned_addr learned my addr 172.21.15.154:0/1726680064 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f152b7fe700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f152c156310 0x7f152c144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.571+0000 7f152bfff700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 0x7f152c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f1530b9c700 1 -- 172.21.15.154:0/1726680064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 msgr2=0x7f152c0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f1530b9c700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 0x7f152c0c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f1530b9c700 1 -- 172.21.15.154:0/1726680064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f152c156310 msgr2=0x7f152c144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f1530b9c700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f152c156310 0x7f152c144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f1530b9c700 1 -- 172.21.15.154:0/1726680064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c0094f0 con 0x7f152c1566e0 2023-10-10T22:18:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f1530b9c700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c1566e0 0x7f152c15a870 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1524009ef0 tx=0x7f152400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f1513fff700 1 -- 172.21.15.154:0/1726680064 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400cb70 con 0x7f152c1566e0 2023-10-10T22:18:08.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f1513fff700 1 -- 172.21.15.154:0/1726680064 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152400f040 con 0x7f152c1566e0 2023-10-10T22:18:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c0c3950 con 0x7f152c1566e0 2023-10-10T22:18:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f1513fff700 1 -- 172.21.15.154:0/1726680064 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524014480 con 0x7f152c1566e0 2023-10-10T22:18:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.572+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c1450b0 con 0x7f152c1566e0 2023-10-10T22:18:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.574+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c1452d0 con 0x7f152c1566e0 2023-10-10T22:18:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.574+0000 7f1513fff700 1 -- 172.21.15.154:0/1726680064 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f15240147f0 con 0x7f152c1566e0 2023-10-10T22:18:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.575+0000 7f1513fff700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f15180670e0 0x7f1518069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.575+0000 7f1513fff700 1 -- 172.21.15.154:0/1726680064 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f15240858b0 con 0x7f152c1566e0 2023-10-10T22:18:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.575+0000 7f152bfff700 1 -- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f15180670e0 msgr2=0x7f1518069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:08.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.575+0000 7f152bfff700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f15180670e0 0x7f1518069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:08.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.579+0000 7f1513fff700 1 -- 172.21.15.154:0/1726680064 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1524052420 con 0x7f152c1566e0 2023-10-10T22:18:08.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:18:08.668 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:18:08.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.776+0000 7f152bfff700 1 -- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f15180670e0 msgr2=0x7f1518069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:08.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.776+0000 7f152bfff700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f15180670e0 0x7f1518069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:08.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.781+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f152c0c4150 con 0x7f152c1566e0 2023-10-10T22:18:08.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.782+0000 7f1513fff700 1 -- 172.21.15.154:0/1726680064 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16496 (secure 0 0 0) 0x7f152c0c4150 con 0x7f152c1566e0 2023-10-10T22:18:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:08.784 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":162,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:18:02.279765+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:17:39.176673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-10T22:17:39.960878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/85496":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/4143885227":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/2029064094":"2023-10-11T22:18:02.279727+0000","172.21.15.154:6836/85496":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/2883016605":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/1006008362":"2023-10-11T22:18:02.279727+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:18:08.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f15180670e0 msgr2=0x7f1518069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:08.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f15180670e0 0x7f1518069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c1566e0 msgr2=0x7f152c15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:08.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c1566e0 0x7f152c15a870 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1524009ef0 tx=0x7f152400b040 comp rx=0 tx=0).stop 2023-10-10T22:18:08.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 shutdown_connections 2023-10-10T22:18:08.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f15180670e0 0x7f1518069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f152c1566e0 0x7f152c15a870 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f152c0ae710 0x7f152c0c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 --2- 172.21.15.154:0/1726680064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f152c156310 0x7f152c144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:08.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 >> 172.21.15.154:0/1726680064 conn(0x7f152c0cc1f0 msgr2=0x7f152c0c2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:08.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 shutdown_connections 2023-10-10T22:18:08.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:08.785+0000 7f153139d700 1 -- 172.21.15.154:0/1726680064 wait complete. 2023-10-10T22:18:08.805 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T22:18:08.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:18:08.903 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:08.901+0000 7f0f0597d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:18:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.059+0000 7f147b59e700 1 Processor -- start 2023-10-10T22:18:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.059+0000 7f147b59e700 1 -- start start 2023-10-10T22:18:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.060+0000 7f147b59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f147c1597f0 0x7f147c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.060+0000 7f147b59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0b11d0 con 0x7f147c159420 2023-10-10T22:18:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.060+0000 7f147b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0b14b0 con 0x7f147c15d230 2023-10-10T22:18:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.060+0000 7f147b59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c0b1790 con 0x7f147c1597f0 2023-10-10T22:18:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f147a59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f147c159420 0x7f147c0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52956/0 (socket says 172.21.15.154:52956) 2023-10-10T22:18:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f147a59c700 1 -- 172.21.15.154:0/4116974506 learned_addr learned my addr 172.21.15.154:0/4116974506 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f1479d9b700 1 --2- 172.21.15.154:0/4116974506 >> v2:172.21.15.179:3300/0 conn(0x7f147c1597f0 0x7f147c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f147959a700 1 -- 172.21.15.154:0/4116974506 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083571788 0 0) 0x7f147c0b11d0 con 0x7f147c159420 2023-10-10T22:18:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f147959a700 1 -- 172.21.15.154:0/4116974506 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1464003570 con 0x7f147c159420 2023-10-10T22:18:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f147959a700 1 -- 172.21.15.154:0/4116974506 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675874025 0 0) 0x7f147c0b14b0 con 0x7f147c15d230 2023-10-10T22:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f147959a700 1 -- 172.21.15.154:0/4116974506 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f147c0b11d0 con 0x7f147c15d230 2023-10-10T22:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f1479d9b700 1 -- 172.21.15.154:0/4116974506 >> v1:172.21.15.179:6789/0 conn(0x7f147c15d230 legacy=0x7f147c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f1479d9b700 1 -- 172.21.15.154:0/4116974506 >> v1:172.21.15.154:6789/0 conn(0x7f147c159420 legacy=0x7f147c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.061+0000 7f1479d9b700 1 -- 172.21.15.154:0/4116974506 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c0b1a70 con 0x7f147c1597f0 2023-10-10T22:18:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.062+0000 7f1479d9b700 1 --2- 172.21.15.154:0/4116974506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c1597f0 0x7f147c0b2270 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f14700098e0 tx=0x7f14700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2f54ba6e0a16a18 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.062+0000 7f147959a700 1 -- 172.21.15.154:0/4116974506 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470011630 con 0x7f147c1597f0 2023-10-10T22:18:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.062+0000 7f147959a700 1 -- 172.21.15.154:0/4116974506 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470011790 con 0x7f147c1597f0 2023-10-10T22:18:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.062+0000 7f147959a700 1 -- 172.21.15.154:0/4116974506 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470011b30 con 0x7f147c1597f0 2023-10-10T22:18:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.062+0000 7f147b59e700 1 -- 172.21.15.154:0/4116974506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c1597f0 msgr2=0x7f147c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.062+0000 7f147b59e700 1 --2- 172.21.15.154:0/4116974506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c1597f0 0x7f147c0b2270 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f14700098e0 tx=0x7f14700091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.063+0000 7f147b59e700 1 -- 172.21.15.154:0/4116974506 shutdown_connections 2023-10-10T22:18:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.063+0000 7f147b59e700 1 --2- 172.21.15.154:0/4116974506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c1597f0 0x7f147c0b2270 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.063+0000 7f147b59e700 1 -- 172.21.15.154:0/4116974506 >> 172.21.15.154:0/4116974506 conn(0x7f147c0d0660 msgr2=0x7f147c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.063+0000 7f147b59e700 1 -- 172.21.15.154:0/4116974506 shutdown_connections 2023-10-10T22:18:09.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.063+0000 7f147b59e700 1 -- 172.21.15.154:0/4116974506 wait complete. 2023-10-10T22:18:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.064+0000 7f147b59e700 1 Processor -- start 2023-10-10T22:18:09.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.064+0000 7f147b59e700 1 -- start start 2023-10-10T22:18:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.065+0000 7f147b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c159420 0x7f147c15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.065+0000 7f147b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147c1597f0 0x7f147c0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.065+0000 7f147b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c15d230 0x7f147c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.065+0000 7f147b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1697a0 con 0x7f147c1597f0 2023-10-10T22:18:09.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.065+0000 7f147b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c5b00 con 0x7f147c15d230 2023-10-10T22:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.065+0000 7f147b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c5de0 con 0x7f147c159420 2023-10-10T22:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.065+0000 7f1479d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147c1597f0 0x7f147c0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f147a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c159420 0x7f147c15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f1479d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147c1597f0 0x7f147c0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47888/0 (socket says 172.21.15.154:47888) 2023-10-10T22:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f1479d9b700 1 -- 172.21.15.154:0/1286791044 learned_addr learned my addr 172.21.15.154:0/1286791044 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f147ad9d700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c15d230 0x7f147c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f1479d9b700 1 -- 172.21.15.154:0/1286791044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c159420 msgr2=0x7f147c15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f1479d9b700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c159420 0x7f147c15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f1479d9b700 1 -- 172.21.15.154:0/1286791044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c15d230 msgr2=0x7f147c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f1479d9b700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c15d230 0x7f147c1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f1479d9b700 1 -- 172.21.15.154:0/1286791044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470009420 con 0x7f147c1597f0 2023-10-10T22:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.066+0000 7f1479d9b700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147c1597f0 0x7f147c0c5400 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1470013000 tx=0x7f1470017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.067+0000 7f146a7fc700 1 -- 172.21.15.154:0/1286791044 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147001f070 con 0x7f147c1597f0 2023-10-10T22:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.067+0000 7f146a7fc700 1 -- 172.21.15.154:0/1286791044 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470000bc0 con 0x7f147c1597f0 2023-10-10T22:18:09.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.067+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c0c60c0 con 0x7f147c1597f0 2023-10-10T22:18:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.067+0000 7f146a7fc700 1 -- 172.21.15.154:0/1286791044 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470025420 con 0x7f147c1597f0 2023-10-10T22:18:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.067+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c154800 con 0x7f147c1597f0 2023-10-10T22:18:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.068+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c169910 con 0x7f147c1597f0 2023-10-10T22:18:09.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.070+0000 7f146a7fc700 1 -- 172.21.15.154:0/1286791044 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1470023070 con 0x7f147c1597f0 2023-10-10T22:18:09.077 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:09.075+0000 7f0f0597d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:18:09.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.071+0000 7f146a7fc700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f145c0670e0 0x7f145c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.071+0000 7f146a7fc700 1 -- 172.21.15.154:0/1286791044 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1470085ea0 con 0x7f147c1597f0 2023-10-10T22:18:09.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.071+0000 7f147a59c700 1 -- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f145c0670e0 msgr2=0x7f145c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:09.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.071+0000 7f147a59c700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f145c0670e0 0x7f145c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:09.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.075+0000 7f146a7fc700 1 -- 172.21.15.154:0/1286791044 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1470052b20 con 0x7f147c1597f0 2023-10-10T22:18:09.095 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:09.093+0000 7f386c4ca180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:18:09.172 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:09.170+0000 7f0f0597d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:18:09.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.272+0000 7f147a59c700 1 -- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f145c0670e0 msgr2=0x7f145c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:09.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.272+0000 7f147a59c700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f145c0670e0 0x7f145c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:09.274 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:09.272+0000 7f386c4ca180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:18:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.320+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f147c04c3c0 con 0x7f147c1597f0 2023-10-10T22:18:09.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.321+0000 7f146a7fc700 1 -- 172.21.15.154:0/1286791044 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f147002a090 con 0x7f147c1597f0 2023-10-10T22:18:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:09.323 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7196,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3891554759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3891554759},{"type":"v1","addr":"172.21.15.179:6834","nonce":3891554759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8158,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1858498414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1858498414},{"type":"v1","addr":"172.21.15.154:6835","nonce":1858498414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8161,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3531287783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3531287783},{"type":"v1","addr":"172.21.15.179:6835","nonce":3531287783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:17:40.982384+0000","modified":"2023-10-10T22:17:44.985977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8640":{"gid":8640,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/3925813058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3925813058},{"type":"v1","addr":"172.21.15.154:6834","nonce":3925813058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-10T22:18:09.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f145c0670e0 msgr2=0x7f145c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:09.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f145c0670e0 0x7f145c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147c1597f0 msgr2=0x7f147c0c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147c1597f0 0x7f147c0c5400 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1470013000 tx=0x7f1470017000 comp rx=0 tx=0).stop 2023-10-10T22:18:09.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 shutdown_connections 2023-10-10T22:18:09.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c15d230 0x7f147c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c159420 0x7f147c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f145c0670e0 0x7f145c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 --2- 172.21.15.154:0/1286791044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147c1597f0 0x7f147c0c5400 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 >> 172.21.15.154:0/1286791044 conn(0x7f147c0d0660 msgr2=0x7f147c0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:09.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 shutdown_connections 2023-10-10T22:18:09.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.323+0000 7f147b59e700 1 -- 172.21.15.154:0/1286791044 wait complete. 2023-10-10T22:18:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 70 2023-10-10T22:18:09.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:18:09.376 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:09.374+0000 7f386c4ca180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:18:09.468 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:09.466+0000 7f0f0597d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:18:09.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.533+0000 7f352a99d700 1 Processor -- start 2023-10-10T22:18:09.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.533+0000 7f352a99d700 1 -- start start 2023-10-10T22:18:09.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35241595a0 0x7f35240b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 0x7f35240c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a99d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35240b1de0 0x7f35240c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a99d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35240b2b90 con 0x7f35240b1de0 2023-10-10T22:18:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35240b1410 con 0x7f35241595a0 2023-10-10T22:18:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3524063230 con 0x7f35240c6c60 2023-10-10T22:18:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35240b1de0 0x7f35240c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35240b1de0 0x7f35240c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47894/0 (socket says 172.21.15.154:47894) 2023-10-10T22:18:09.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a19c700 1 -- 172.21.15.154:0/807437617 learned_addr learned my addr 172.21.15.154:0/807437617 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:09.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352999b700 1 --2- 172.21.15.154:0/807437617 >> v2:172.21.15.179:3300/0 conn(0x7f35241595a0 0x7f35240b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352919a700 1 --2- 172.21.15.154:0/807437617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 0x7f35240c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a19c700 1 -- 172.21.15.154:0/807437617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 msgr2=0x7f35240c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:09.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a19c700 1 --2- 172.21.15.154:0/807437617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 0x7f35240c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a19c700 1 -- 172.21.15.154:0/807437617 >> v2:172.21.15.179:3300/0 conn(0x7f35241595a0 msgr2=0x7f35240b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:09.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a19c700 1 --2- 172.21.15.154:0/807437617 >> v2:172.21.15.179:3300/0 conn(0x7f35241595a0 0x7f35240b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.535+0000 7f352a19c700 1 -- 172.21.15.154:0/807437617 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35240634f0 con 0x7f35240b1de0 2023-10-10T22:18:09.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.536+0000 7f352a19c700 1 --2- 172.21.15.154:0/807437617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35240b1de0 0x7f35240c8660 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f35240c8d10 tx=0x7f351c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacbfc77e12b2f7c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:09.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.536+0000 7f3528999700 1 -- 172.21.15.154:0/807437617 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c00e070 con 0x7f35240b1de0 2023-10-10T22:18:09.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.536+0000 7f3528999700 1 -- 172.21.15.154:0/807437617 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c00b970 con 0x7f35240b1de0 2023-10-10T22:18:09.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.536+0000 7f3528999700 1 -- 172.21.15.154:0/807437617 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0092e0 con 0x7f35240b1de0 2023-10-10T22:18:09.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.537+0000 7f352a99d700 1 -- 172.21.15.154:0/807437617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35240b1de0 msgr2=0x7f35240c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.537+0000 7f352a99d700 1 --2- 172.21.15.154:0/807437617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35240b1de0 0x7f35240c8660 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f35240c8d10 tx=0x7f351c009840 comp rx=0 tx=0).stop 2023-10-10T22:18:09.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.537+0000 7f352a99d700 1 -- 172.21.15.154:0/807437617 shutdown_connections 2023-10-10T22:18:09.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.537+0000 7f352a99d700 1 --2- 172.21.15.154:0/807437617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35240b1de0 0x7f35240c8660 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.537+0000 7f352a99d700 1 --2- 172.21.15.154:0/807437617 >> v2:172.21.15.179:3300/0 conn(0x7f35241595a0 0x7f35240b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.537+0000 7f352a99d700 1 --2- 172.21.15.154:0/807437617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 0x7f35240c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.537+0000 7f352a99d700 1 -- 172.21.15.154:0/807437617 >> 172.21.15.154:0/807437617 conn(0x7f352406ddb0 msgr2=0x7f352406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:09.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.537+0000 7f352a99d700 1 -- 172.21.15.154:0/807437617 shutdown_connections 2023-10-10T22:18:09.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.537+0000 7f352a99d700 1 -- 172.21.15.154:0/807437617 wait complete. 2023-10-10T22:18:09.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.538+0000 7f352a99d700 1 Processor -- start 2023-10-10T22:18:09.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.539+0000 7f352a99d700 1 -- start start 2023-10-10T22:18:09.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.539+0000 7f352a99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35240b1de0 0x7f352413c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.539+0000 7f352a99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 0x7f3524151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352a99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35241595a0 0x7f35240cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352a99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524150370 con 0x7f35241595a0 2023-10-10T22:18:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352a99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524159970 con 0x7f35240b1de0 2023-10-10T22:18:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352a99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352414f510 con 0x7f35240c6c60 2023-10-10T22:18:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352a19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35241595a0 0x7f35240cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352a19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35241595a0 0x7f35240cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47906/0 (socket says 172.21.15.154:47906) 2023-10-10T22:18:09.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352999b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35240b1de0 0x7f352413c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352a19c700 1 -- 172.21.15.154:0/2506543622 learned_addr learned my addr 172.21.15.154:0/2506543622 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:09.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352919a700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 0x7f3524151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:09.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352999b700 1 -- 172.21.15.154:0/2506543622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 msgr2=0x7f3524151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352999b700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 0x7f3524151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352999b700 1 -- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35241595a0 msgr2=0x7f35240cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352999b700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35241595a0 0x7f35240cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352999b700 1 -- 172.21.15.154:0/2506543622 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c009ae0 con 0x7f35240b1de0 2023-10-10T22:18:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.540+0000 7f352a19c700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35241595a0 0x7f35240cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:09.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.541+0000 7f352999b700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35240b1de0 0x7f352413c920 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f352000e900 tx=0x7f35200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.541+0000 7f3519ffb700 1 -- 172.21.15.154:0/2506543622 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520013680 con 0x7f35240b1de0 2023-10-10T22:18:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.541+0000 7f3519ffb700 1 -- 172.21.15.154:0/2506543622 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35200137e0 con 0x7f35240b1de0 2023-10-10T22:18:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.541+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352413ce60 con 0x7f35240b1de0 2023-10-10T22:18:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.541+0000 7f3519ffb700 1 -- 172.21.15.154:0/2506543622 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520013ba0 con 0x7f35240b1de0 2023-10-10T22:18:09.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.541+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352414f760 con 0x7f35240b1de0 2023-10-10T22:18:09.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.542+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352404c3c0 con 0x7f35240b1de0 2023-10-10T22:18:09.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.543+0000 7f3519ffb700 1 -- 172.21.15.154:0/2506543622 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f35200123d0 con 0x7f35240b1de0 2023-10-10T22:18:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.544+0000 7f3519ffb700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f35080670e0 0x7f3508069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.544+0000 7f3519ffb700 1 -- 172.21.15.154:0/2506543622 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f3520084b80 con 0x7f35240b1de0 2023-10-10T22:18:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.544+0000 7f352919a700 1 -- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f35080670e0 msgr2=0x7f3508069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.544+0000 7f352919a700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f35080670e0 0x7f3508069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:09.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.549+0000 7f3519ffb700 1 -- 172.21.15.154:0/2506543622 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35200518a0 con 0x7f35240b1de0 2023-10-10T22:18:09.564 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:09.562+0000 7f0f0597d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:18:09.687 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:09.685+0000 7f386c4ca180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:18:09.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.745+0000 7f352919a700 1 -- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f35080670e0 msgr2=0x7f3508069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:09.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.745+0000 7f352919a700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f35080670e0 0x7f3508069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:09.786 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:09.785+0000 7f386c4ca180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:18:09.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.792+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35240c91b0 con 0x7f35240b1de0 2023-10-10T22:18:09.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.793+0000 7f3519ffb700 1 -- 172.21.15.154:0/2506543622 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f3520021090 con 0x7f35240b1de0 2023-10-10T22:18:09.794 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:09.794 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7196,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3891554759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3891554759},{"type":"v1","addr":"172.21.15.179:6834","nonce":3891554759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8158,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1858498414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1858498414},{"type":"v1","addr":"172.21.15.154:6835","nonce":1858498414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8161,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3531287783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3531287783},{"type":"v1","addr":"172.21.15.179:6835","nonce":3531287783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:17:40.982384+0000","modified":"2023-10-10T22:17:44.985977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8640":{"gid":8640,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6834/3925813058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3925813058},{"type":"v1","addr":"172.21.15.154:6834","nonce":3925813058}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-10T22:18:09.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f35080670e0 msgr2=0x7f3508069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:09.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f35080670e0 0x7f3508069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35240b1de0 msgr2=0x7f352413c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:09.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35240b1de0 0x7f352413c920 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f352000e900 tx=0x7f35200091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 shutdown_connections 2023-10-10T22:18:09.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f35080670e0 0x7f3508069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35241595a0 0x7f35240cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35240b1de0 0x7f352413c920 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 --2- 172.21.15.154:0/2506543622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35240c6c60 0x7f3524151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:09.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 >> 172.21.15.154:0/2506543622 conn(0x7f352406ddb0 msgr2=0x7f3524157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:09.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 shutdown_connections 2023-10-10T22:18:09.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:09.795+0000 7f352a99d700 1 -- 172.21.15.154:0/2506543622 wait complete. 2023-10-10T22:18:09.801 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 70 2023-10-10T22:18:09.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:18:10.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.042+0000 7f0e189fe700 1 Processor -- start 2023-10-10T22:18:10.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.042+0000 7f0e189fe700 1 -- start start 2023-10-10T22:18:10.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e189fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e14159420 0x7f0e140b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e189fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0e1415d230 0x7f0e1415d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e189fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1415dbd0 con 0x7f0e141597f0 2023-10-10T22:18:10.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e189fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e140b2980 con 0x7f0e1415d230 2023-10-10T22:18:10.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e189fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140b11d0 con 0x7f0e14159420 2023-10-10T22:18:10.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e1259c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0e141597f0 0x7f0e140b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52966/0 (socket says 172.21.15.154:52966) 2023-10-10T22:18:10.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e1259c700 1 -- 172.21.15.154:0/3250681073 learned_addr learned my addr 172.21.15.154:0/3250681073 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:10.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e1359e700 1 --2- 172.21.15.154:0/3250681073 >> v2:172.21.15.179:3300/0 conn(0x7f0e1415d230 0x7f0e1415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e12d9d700 1 --2- 172.21.15.154:0/3250681073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e14159420 0x7f0e140b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e11d9b700 1 -- 172.21.15.154:0/3250681073 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210110847 0 0) 0x7f0e08001110 con 0x7f0e141597f0 2023-10-10T22:18:10.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.044+0000 7f0e11d9b700 1 -- 172.21.15.154:0/3250681073 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dfc003570 con 0x7f0e141597f0 2023-10-10T22:18:10.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.045+0000 7f0e1359e700 1 -- 172.21.15.154:0/3250681073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e14159420 msgr2=0x7f0e140b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:10.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.045+0000 7f0e1359e700 1 --2- 172.21.15.154:0/3250681073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e14159420 0x7f0e140b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.045+0000 7f0e1359e700 1 -- 172.21.15.154:0/3250681073 >> v1:172.21.15.154:6789/0 conn(0x7f0e141597f0 legacy=0x7f0e140b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.045+0000 7f0e1359e700 1 -- 172.21.15.154:0/3250681073 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140b14b0 con 0x7f0e1415d230 2023-10-10T22:18:10.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.045+0000 7f0e12d9d700 1 --2- 172.21.15.154:0/3250681073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e14159420 0x7f0e140b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:10.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.045+0000 7f0e1359e700 1 --2- 172.21.15.154:0/3250681073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e1415d230 0x7f0e1415d690 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009e60 tx=0x7f0e0c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d5c7052ca34575b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:10.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.045+0000 7f0e11d9b700 1 -- 172.21.15.154:0/3250681073 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c00e070 con 0x7f0e1415d230 2023-10-10T22:18:10.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e11d9b700 1 -- 172.21.15.154:0/3250681073 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c00bab0 con 0x7f0e1415d230 2023-10-10T22:18:10.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e11d9b700 1 -- 172.21.15.154:0/3250681073 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c00be70 con 0x7f0e1415d230 2023-10-10T22:18:10.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e189fe700 1 -- 172.21.15.154:0/3250681073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e1415d230 msgr2=0x7f0e1415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e189fe700 1 --2- 172.21.15.154:0/3250681073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e1415d230 0x7f0e1415d690 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009e60 tx=0x7f0e0c009780 comp rx=0 tx=0).stop 2023-10-10T22:18:10.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e189fe700 1 -- 172.21.15.154:0/3250681073 shutdown_connections 2023-10-10T22:18:10.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e189fe700 1 --2- 172.21.15.154:0/3250681073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e1415d230 0x7f0e1415d690 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e189fe700 1 --2- 172.21.15.154:0/3250681073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e14159420 0x7f0e140b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e189fe700 1 -- 172.21.15.154:0/3250681073 >> 172.21.15.154:0/3250681073 conn(0x7f0e140d0660 msgr2=0x7f0e140d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:10.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e189fe700 1 -- 172.21.15.154:0/3250681073 shutdown_connections 2023-10-10T22:18:10.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.046+0000 7f0e189fe700 1 -- 172.21.15.154:0/3250681073 wait complete. 2023-10-10T22:18:10.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.048+0000 7f0e189fe700 1 Processor -- start 2023-10-10T22:18:10.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.048+0000 7f0e189fe700 1 -- start start 2023-10-10T22:18:10.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e189fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14159420 0x7f0e140b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e189fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e141597f0 0x7f0e14159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e189fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e1415d230 0x7f0e1415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e189fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1415ac00 con 0x7f0e14159420 2023-10-10T22:18:10.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e189fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1415a6e0 con 0x7f0e141597f0 2023-10-10T22:18:10.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e189fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1415b580 con 0x7f0e1415d230 2023-10-10T22:18:10.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e12d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14159420 0x7f0e140b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e12d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14159420 0x7f0e140b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47912/0 (socket says 172.21.15.154:47912) 2023-10-10T22:18:10.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e12d9d700 1 -- 172.21.15.154:0/2589441770 learned_addr learned my addr 172.21.15.154:0/2589441770 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:10.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e1259c700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e141597f0 0x7f0e14159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e1359e700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e1415d230 0x7f0e1415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e12d9d700 1 -- 172.21.15.154:0/2589441770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e1415d230 msgr2=0x7f0e1415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e12d9d700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e1415d230 0x7f0e1415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e12d9d700 1 -- 172.21.15.154:0/2589441770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e141597f0 msgr2=0x7f0e14159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e12d9d700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e141597f0 0x7f0e14159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.049+0000 7f0e12d9d700 1 -- 172.21.15.154:0/2589441770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04009420 con 0x7f0e14159420 2023-10-10T22:18:10.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.050+0000 7f0e12d9d700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14159420 0x7f0e140b5580 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400ec80 tx=0x7f0e040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:10.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.050+0000 7f0dfaffd700 1 -- 172.21.15.154:0/2589441770 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0400c920 con 0x7f0e14159420 2023-10-10T22:18:10.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.050+0000 7f0dfaffd700 1 -- 172.21.15.154:0/2589441770 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0400ca80 con 0x7f0e14159420 2023-10-10T22:18:10.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.050+0000 7f0dfaffd700 1 -- 172.21.15.154:0/2589441770 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0400ce00 con 0x7f0e14159420 2023-10-10T22:18:10.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.050+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0c009a20 con 0x7f0e14159420 2023-10-10T22:18:10.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.050+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1415af30 con 0x7f0e14159420 2023-10-10T22:18:10.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.051+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1404c3c0 con 0x7f0e14159420 2023-10-10T22:18:10.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.052+0000 7f0dfaffd700 1 -- 172.21.15.154:0/2589441770 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0e04013680 con 0x7f0e14159420 2023-10-10T22:18:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.053+0000 7f0dfaffd700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0e000670e0 0x7f0e00069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.053+0000 7f0dfaffd700 1 -- 172.21.15.154:0/2589441770 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f0e04084f70 con 0x7f0e14159420 2023-10-10T22:18:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.053+0000 7f0e1259c700 1 -- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0e000670e0 msgr2=0x7f0e00069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:10.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.053+0000 7f0e1259c700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0e000670e0 0x7f0e00069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:10.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.057+0000 7f0dfaffd700 1 -- 172.21.15.154:0/2589441770 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e04051bf0 con 0x7f0e14159420 2023-10-10T22:18:10.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.254+0000 7f0e1259c700 1 -- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0e000670e0 msgr2=0x7f0e00069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:10.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.254+0000 7f0e1259c700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0e000670e0 0x7f0e00069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:10.266 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:10.265+0000 7f0f0597d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:18:10.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.272+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e140b1790 con 0x7f0e14159420 2023-10-10T22:18:10.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.274+0000 7f0dfaffd700 1 -- 172.21.15.154:0/2589441770 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16496 (secure 0 0 0) 0x7f0e04055210 con 0x7f0e14159420 2023-10-10T22:18:10.276 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:10.276 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":162,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:18:02.279765+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:17:39.176673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-10T22:17:39.960878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/85496":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/4143885227":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/2029064094":"2023-10-11T22:18:02.279727+0000","172.21.15.154:6836/85496":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/2883016605":"2023-10-11T22:18:02.279727+0000","172.21.15.154:0/1006008362":"2023-10-11T22:18:02.279727+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:18:10.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0e000670e0 msgr2=0x7f0e00069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:10.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0e000670e0 0x7f0e00069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14159420 msgr2=0x7f0e140b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14159420 0x7f0e140b5580 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400ec80 tx=0x7f0e040091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 shutdown_connections 2023-10-10T22:18:10.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e1415d230 0x7f0e1415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0e000670e0 0x7f0e00069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14159420 0x7f0e140b5580 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 --2- 172.21.15.154:0/2589441770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e141597f0 0x7f0e14159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 >> 172.21.15.154:0/2589441770 conn(0x7f0e140d0660 msgr2=0x7f0e140d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:10.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 shutdown_connections 2023-10-10T22:18:10.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.276+0000 7f0e189fe700 1 -- 172.21.15.154:0/2589441770 wait complete. 2023-10-10T22:18:10.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T22:18:10.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.483+0000 7f8d13fff700 1 Processor -- start 2023-10-10T22:18:10.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.483+0000 7f8d13fff700 1 -- start start 2023-10-10T22:18:10.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.484+0000 7f8d13fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8d14142ea0 0x7f8d140b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.484+0000 7f8d13fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d140ad870 0x7f8d1406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.484+0000 7f8d13fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d140b3b70 0x7f8d1406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.484+0000 7f8d13fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d140b40f0 con 0x7f8d140b3b70 2023-10-10T22:18:10.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.484+0000 7f8d13fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d14069640 con 0x7f8d14142ea0 2023-10-10T22:18:10.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.484+0000 7f8d13fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14069920 con 0x7f8d140ad870 2023-10-10T22:18:10.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.484+0000 7f8d137fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d140b3b70 0x7f8d1406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.484+0000 7f8d137fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d140b3b70 0x7f8d1406bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47926/0 (socket says 172.21.15.154:47926) 2023-10-10T22:18:10.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.484+0000 7f8d137fe700 1 -- 172.21.15.154:0/4215205073 learned_addr learned my addr 172.21.15.154:0/4215205073 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:10.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.485+0000 7f8d12ffd700 1 --2- 172.21.15.154:0/4215205073 >> v2:172.21.15.179:3300/0 conn(0x7f8d14142ea0 0x7f8d140b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.485+0000 7f8d127fc700 1 --2- 172.21.15.154:0/4215205073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d140ad870 0x7f8d1406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.485+0000 7f8d137fe700 1 -- 172.21.15.154:0/4215205073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d140ad870 msgr2=0x7f8d1406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.485+0000 7f8d137fe700 1 --2- 172.21.15.154:0/4215205073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d140ad870 0x7f8d1406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.485+0000 7f8d137fe700 1 -- 172.21.15.154:0/4215205073 >> v2:172.21.15.179:3300/0 conn(0x7f8d14142ea0 msgr2=0x7f8d140b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.485+0000 7f8d137fe700 1 --2- 172.21.15.154:0/4215205073 >> v2:172.21.15.179:3300/0 conn(0x7f8d14142ea0 0x7f8d140b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.485+0000 7f8d137fe700 1 -- 172.21.15.154:0/4215205073 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14069c00 con 0x7f8d140b3b70 2023-10-10T22:18:10.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.485+0000 7f8d137fe700 1 --2- 172.21.15.154:0/4215205073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 0x7f8d1406bf20 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f8d14071240 tx=0x7f8d0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70936e9a7c38c3e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:10.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d11ffb700 1 -- 172.21.15.154:0/4215205073 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00e070 con 0x7f8d140b3b70 2023-10-10T22:18:10.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d11ffb700 1 -- 172.21.15.154:0/4215205073 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c00b970 con 0x7f8d140b3b70 2023-10-10T22:18:10.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d11ffb700 1 -- 172.21.15.154:0/4215205073 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0092e0 con 0x7f8d140b3b70 2023-10-10T22:18:10.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d13fff700 1 -- 172.21.15.154:0/4215205073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 msgr2=0x7f8d1406bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d13fff700 1 --2- 172.21.15.154:0/4215205073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 0x7f8d1406bf20 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f8d14071240 tx=0x7f8d0c009840 comp rx=0 tx=0).stop 2023-10-10T22:18:10.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d13fff700 1 -- 172.21.15.154:0/4215205073 shutdown_connections 2023-10-10T22:18:10.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d13fff700 1 --2- 172.21.15.154:0/4215205073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 0x7f8d1406bf20 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d13fff700 1 --2- 172.21.15.154:0/4215205073 >> v2:172.21.15.179:3300/0 conn(0x7f8d14142ea0 0x7f8d140b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d13fff700 1 --2- 172.21.15.154:0/4215205073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d140ad870 0x7f8d1406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d13fff700 1 -- 172.21.15.154:0/4215205073 >> 172.21.15.154:0/4215205073 conn(0x7f8d140ce430 msgr2=0x7f8d140ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:10.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d13fff700 1 -- 172.21.15.154:0/4215205073 shutdown_connections 2023-10-10T22:18:10.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.486+0000 7f8d13fff700 1 -- 172.21.15.154:0/4215205073 wait complete. 2023-10-10T22:18:10.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.488+0000 7f8d13fff700 1 Processor -- start 2023-10-10T22:18:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.488+0000 7f8d13fff700 1 -- start start 2023-10-10T22:18:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d13fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 0x7f8d1416d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d13fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d14142ea0 0x7f8d141316c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d13fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d14131c00 0x7f8d140ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d13fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14132d50 con 0x7f8d140b3b70 2023-10-10T22:18:10.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d13fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14132140 con 0x7f8d14131c00 2023-10-10T22:18:10.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d13fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14132420 con 0x7f8d14142ea0 2023-10-10T22:18:10.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 0x7f8d1416d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 0x7f8d1416d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47932/0 (socket says 172.21.15.154:47932) 2023-10-10T22:18:10.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d12ffd700 1 -- 172.21.15.154:0/2079244615 learned_addr learned my addr 172.21.15.154:0/2079244615 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:10.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d127fc700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d14142ea0 0x7f8d141316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.489+0000 7f8d137fe700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d14131c00 0x7f8d140ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8d12ffd700 1 -- 172.21.15.154:0/2079244615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d14142ea0 msgr2=0x7f8d141316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8d12ffd700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d14142ea0 0x7f8d141316c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8d12ffd700 1 -- 172.21.15.154:0/2079244615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d14131c00 msgr2=0x7f8d140ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8d12ffd700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d14131c00 0x7f8d140ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8d12ffd700 1 -- 172.21.15.154:0/2079244615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c009ae0 con 0x7f8d140b3b70 2023-10-10T22:18:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8d12ffd700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 0x7f8d1416d3b0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400e930 tx=0x7f8d040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8cfaffd700 1 -- 172.21.15.154:0/2079244615 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04013680 con 0x7f8d140b3b70 2023-10-10T22:18:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8cfaffd700 1 -- 172.21.15.154:0/2079244615 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d040137e0 con 0x7f8d140b3b70 2023-10-10T22:18:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8cfaffd700 1 -- 172.21.15.154:0/2079244615 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04013b80 con 0x7f8d140b3b70 2023-10-10T22:18:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d14132700 con 0x7f8d140b3b70 2023-10-10T22:18:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.490+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d141404c0 con 0x7f8d140b3b70 2023-10-10T22:18:10.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.491+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1406c260 con 0x7f8d140b3b70 2023-10-10T22:18:10.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.493+0000 7f8cfaffd700 1 -- 172.21.15.154:0/2079244615 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f8d0400c3e0 con 0x7f8d140b3b70 2023-10-10T22:18:10.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.495+0000 7f8cfaffd700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d000670e0 0x7f8d00069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.495+0000 7f8d127fc700 1 -- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d000670e0 msgr2=0x7f8d00069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.495+0000 7f8cfaffd700 1 -- 172.21.15.154:0/2079244615 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f8d04084c40 con 0x7f8d140b3b70 2023-10-10T22:18:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.495+0000 7f8d127fc700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d000670e0 0x7f8d00069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.499+0000 7f8cfaffd700 1 -- 172.21.15.154:0/2079244615 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d040518c0 con 0x7f8d140b3b70 2023-10-10T22:18:10.551 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:10.549+0000 7f386c4ca180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:18:10.555 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:10.554+0000 7f0f0597d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:18:10.648 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:10.647+0000 7f0f0597d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:18:10.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.696+0000 7f8d127fc700 1 -- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d000670e0 msgr2=0x7f8d00069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:10.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.696+0000 7f8d127fc700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d000670e0 0x7f8d00069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:10.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.746+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8d1404c3c0 con 0x7f8d140b3b70 2023-10-10T22:18:10.748 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T22:18:10.746+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T22:18:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.752+0000 7f8cfaffd700 1 -- 172.21.15.154:0/2079244615 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8d04054ee0 con 0x7f8d140b3b70 2023-10-10T22:18:10.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.755+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d000670e0 msgr2=0x7f8d00069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:10.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.755+0000 7f8d13fff700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d000670e0 0x7f8d00069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.755+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 msgr2=0x7f8d1416d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.755+0000 7f8d13fff700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 0x7f8d1416d3b0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400e930 tx=0x7f8d040091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.756+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 shutdown_connections 2023-10-10T22:18:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.756+0000 7f8d13fff700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d14131c00 0x7f8d140ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.756+0000 7f8d13fff700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8d000670e0 0x7f8d00069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.756+0000 7f8d13fff700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d140b3b70 0x7f8d1416d3b0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.756+0000 7f8d13fff700 1 --2- 172.21.15.154:0/2079244615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d14142ea0 0x7f8d141316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.756+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 >> 172.21.15.154:0/2079244615 conn(0x7f8d140ce430 msgr2=0x7f8d14141e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:10.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.756+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 shutdown_connections 2023-10-10T22:18:10.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.756+0000 7f8d13fff700 1 -- 172.21.15.154:0/2079244615 wait complete. 2023-10-10T22:18:10.762 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T22:18:10.762 INFO:tasks.ceph.mds.c.smithi154.stderr: -2389> 2023-10-10T22:17:46.490+0000 7f28c6bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T22:18:10.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T22:18:10.805 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:10.805+0000 7f0f0597d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:18:10.811 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T22:18:10.855 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:10.854+0000 7f386c4ca180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:18:10.914 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:10.913+0000 7f0f0597d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:18:10.954 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:10.952+0000 7f386c4ca180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:18:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.976+0000 7fbe0b1ff700 1 Processor -- start 2023-10-10T22:18:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.977+0000 7fbe0b1ff700 1 -- start start 2023-10-10T22:18:10.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.978+0000 7fbe0b1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe04159c60 0x7fbe0415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.978+0000 7fbe0b1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0415a160 con 0x7fbe0415db10 2023-10-10T22:18:10.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.978+0000 7fbe0b1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe040d13a0 con 0x7fbe04159890 2023-10-10T22:18:10.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.978+0000 7fbe0b1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0415df50 con 0x7fbe04159c60 2023-10-10T22:18:10.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.978+0000 7fbe03fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe04159c60 0x7fbe0415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.978+0000 7fbe03fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe04159c60 0x7fbe0415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47968/0 (socket says 172.21.15.154:47968) 2023-10-10T22:18:10.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.978+0000 7fbe08f9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbe04159890 0x7fbe0415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:43652/0 (socket says 172.21.15.154:43652) 2023-10-10T22:18:10.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.978+0000 7fbe0979c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbe0415db10 0x7fbe04069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52988/0 (socket says 172.21.15.154:52988) 2023-10-10T22:18:10.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.978+0000 7fbe08f9b700 1 -- 172.21.15.154:0/752520588 learned_addr learned my addr 172.21.15.154:0/752520588 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.979+0000 7fbe03fff700 1 -- 172.21.15.154:0/752520588 >> v1:172.21.15.179:6789/0 conn(0x7fbe04159890 legacy=0x7fbe0415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.979+0000 7fbe037fe700 1 -- 172.21.15.154:0/752520588 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310208705 0 0) 0x7fbe040d13a0 con 0x7fbe04159890 2023-10-10T22:18:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.979+0000 7fbe03fff700 1 -- 172.21.15.154:0/752520588 >> v1:172.21.15.154:6789/0 conn(0x7fbe0415db10 legacy=0x7fbe04069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.979+0000 7fbe03fff700 1 -- 172.21.15.154:0/752520588 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0415e140 con 0x7fbe04159c60 2023-10-10T22:18:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.979+0000 7fbe03fff700 1 --2- 172.21.15.154:0/752520588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159c60 0x7fbe0415d5d0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00098e0 tx=0x7fbdf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453088a8d5f707c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.979+0000 7fbe037fe700 1 -- 172.21.15.154:0/752520588 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0009e80 con 0x7fbe04159c60 2023-10-10T22:18:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.979+0000 7fbe037fe700 1 -- 172.21.15.154:0/752520588 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf000b760 con 0x7fbe04159c60 2023-10-10T22:18:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.979+0000 7fbe037fe700 1 -- 172.21.15.154:0/752520588 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf000bae0 con 0x7fbe04159c60 2023-10-10T22:18:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.980+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/752520588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159c60 msgr2=0x7fbe0415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.980+0000 7fbe0b1ff700 1 --2- 172.21.15.154:0/752520588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159c60 0x7fbe0415d5d0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00098e0 tx=0x7fbdf00091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.980+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/752520588 shutdown_connections 2023-10-10T22:18:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.980+0000 7fbe0b1ff700 1 --2- 172.21.15.154:0/752520588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159c60 0x7fbe0415d5d0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.980+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/752520588 >> 172.21.15.154:0/752520588 conn(0x7fbe04068e20 msgr2=0x7fbe040d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:10.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.980+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/752520588 shutdown_connections 2023-10-10T22:18:10.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.980+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/752520588 wait complete. 2023-10-10T22:18:10.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.981+0000 7fbe0b1ff700 1 Processor -- start 2023-10-10T22:18:10.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.981+0000 7fbe0b1ff700 1 -- start start 2023-10-10T22:18:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.982+0000 7fbe0b1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159890 0x7fbe040cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.982+0000 7fbe0b1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe04159c60 0x7fbe04140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.982+0000 7fbe0b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415db10 0x7fbe04140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.982+0000 7fbe0b1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0416adc0 con 0x7fbe04159890 2023-10-10T22:18:10.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.982+0000 7fbe0b1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0416e300 con 0x7fbe04159c60 2023-10-10T22:18:10.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.982+0000 7fbe0b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0416a000 con 0x7fbe0415db10 2023-10-10T22:18:10.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe08f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159890 0x7fbe040cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe0979c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415db10 0x7fbe04140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe08f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159890 0x7fbe040cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47982/0 (socket says 172.21.15.154:47982) 2023-10-10T22:18:10.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe08f9b700 1 -- 172.21.15.154:0/1713869418 learned_addr learned my addr 172.21.15.154:0/1713869418 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:10.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe03fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe04159c60 0x7fbe04140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:10.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe0979c700 1 -- 172.21.15.154:0/1713869418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe04159c60 msgr2=0x7fbe04140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe0979c700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe04159c60 0x7fbe04140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe0979c700 1 -- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159890 msgr2=0x7fbe040cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:10.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe0979c700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159890 0x7fbe040cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:10.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe0979c700 1 -- 172.21.15.154:0/1713869418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0009420 con 0x7fbe0415db10 2023-10-10T22:18:10.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe08f9b700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159890 0x7fbe040cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:10.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.983+0000 7fbe0979c700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415db10 0x7fbe04140e80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00cd50 tx=0x7fbdfc001b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:10.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.984+0000 7fbe00ff9700 1 -- 172.21.15.154:0/1713869418 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc005df0 con 0x7fbe0415db10 2023-10-10T22:18:10.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.984+0000 7fbe00ff9700 1 -- 172.21.15.154:0/1713869418 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc00a870 con 0x7fbe0415db10 2023-10-10T22:18:10.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.984+0000 7fbe00ff9700 1 -- 172.21.15.154:0/1713869418 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc00ac30 con 0x7fbe0415db10 2023-10-10T22:18:10.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.984+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/1713869418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0416a2e0 con 0x7fbe0415db10 2023-10-10T22:18:10.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.984+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/1713869418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0416a8a0 con 0x7fbe0415db10 2023-10-10T22:18:10.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.985+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/1713869418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0416aac0 con 0x7fbe0415db10 2023-10-10T22:18:10.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.986+0000 7fbe00ff9700 1 -- 172.21.15.154:0/1713869418 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fbdfc007300 con 0x7fbe0415db10 2023-10-10T22:18:10.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.987+0000 7fbe00ff9700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 0x7fbde8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:10.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.987+0000 7fbe00ff9700 1 -- 172.21.15.154:0/1713869418 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6513+0+0 (secure 0 0 0) 0x7fbdfc085080 con 0x7fbe0415db10 2023-10-10T22:18:10.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.987+0000 7fbe08f9b700 1 -- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 msgr2=0x7fbde8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:10.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.987+0000 7fbe08f9b700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 0x7fbde8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:10.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:10.990+0000 7fbe00ff9700 1 -- 172.21.15.154:0/1713869418 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdfc051da0 con 0x7fbe0415db10 2023-10-10T22:18:11.106 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:11.105+0000 7f0f0597d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:18:11.119 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:11.118+0000 7f386c4ca180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:18:11.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.188+0000 7fbe08f9b700 1 -- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 msgr2=0x7fbde8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:11.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.188+0000 7fbe08f9b700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 0x7fbde8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:11.197 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:11.197+0000 7f0f0597d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:18:11.227 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:11.226+0000 7f386c4ca180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:18:11.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.237+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/1713869418 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbe0416a140 con 0x7fbe0415db10 2023-10-10T22:18:11.289 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:11.288+0000 7f0f0597d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:18:11.384 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:11.384+0000 7f0f0597d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:18:11.419 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:11.418+0000 7f386c4ca180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:18:11.513 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:11.511+0000 7f386c4ca180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:18:11.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.589+0000 7fbe08f9b700 1 -- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 msgr2=0x7fbde8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.589+0000 7fbe08f9b700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 0x7fbde8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T22:18:11.607 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:11.606+0000 7f386c4ca180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:18:11.702 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:11.701+0000 7f386c4ca180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:18:11.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.715+0000 7fbe00ff9700 1 -- 172.21.15.154:0/1713869418 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mgrmap(e 80) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fbdfc052170 con 0x7fbe0415db10 2023-10-10T22:18:11.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.716+0000 7fbe00ff9700 1 -- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 msgr2=0x7fbde8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:11.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.716+0000 7fbe00ff9700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 0x7fbde8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:11.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.756+0000 7fbe00ff9700 1 -- 172.21.15.154:0/1713869418 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbdfc060ec0 con 0x7fbe0415db10 2023-10-10T22:18:11.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/1713869418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415db10 msgr2=0x7fbe04140e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:11.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415db10 0x7fbe04140e80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00cd50 tx=0x7fbdfc001b10 comp rx=0 tx=0).stop 2023-10-10T22:18:11.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/1713869418 shutdown_connections 2023-10-10T22:18:11.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415db10 0x7fbe04140e80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:11.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fbde80670e0 0x7fbde8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:11.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe04159890 0x7fbe040cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:11.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 --2- 172.21.15.154:0/1713869418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe04159c60 0x7fbe04140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:11.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/1713869418 >> 172.21.15.154:0/1713869418 conn(0x7fbe04068e20 msgr2=0x7fbe04153180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:11.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/1713869418 shutdown_connections 2023-10-10T22:18:11.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:11.759+0000 7fbe0b1ff700 1 -- 172.21.15.154:0/1713869418 wait complete. 2023-10-10T22:18:11.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T22:18:12.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.009+0000 7f24451ff700 1 Processor -- start 2023-10-10T22:18:12.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.009+0000 7f24451ff700 1 -- start start 2023-10-10T22:18:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.010+0000 7f24451ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2440157740 0x7f24400adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.010+0000 7f24451ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24400b2100 0x7f2440068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f24451ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244006dc20 con 0x7f24400688d0 2023-10-10T22:18:12.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f24451ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24400acc00 con 0x7f24400b2100 2023-10-10T22:18:12.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f24451ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244006d6a0 con 0x7f2440157740 2023-10-10T22:18:12.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f2437fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24400b2100 0x7f2440068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f2437fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24400b2100 0x7f2440068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48076/0 (socket says 172.21.15.154:48076) 2023-10-10T22:18:12.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f2437fff700 1 -- 172.21.15.154:0/1827979809 learned_addr learned my addr 172.21.15.154:0/1827979809 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:12.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f243f59e700 1 --1- 172.21.15.154:0/1827979809 >> v1:172.21.15.154:6789/0 conn(0x7f24400688d0 0x7f2440069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52992/0 (socket says 172.21.15.154:52992) 2023-10-10T22:18:12.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f243ed9d700 1 --2- 172.21.15.154:0/1827979809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2440157740 0x7f24400adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f2437fff700 1 -- 172.21.15.154:0/1827979809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2440157740 msgr2=0x7f24400adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:12.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f2437fff700 1 --2- 172.21.15.154:0/1827979809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2440157740 0x7f24400adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f2437fff700 1 -- 172.21.15.154:0/1827979809 >> v1:172.21.15.154:6789/0 conn(0x7f24400688d0 legacy=0x7f2440069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f2437fff700 1 -- 172.21.15.154:0/1827979809 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400ae910 con 0x7f24400b2100 2023-10-10T22:18:12.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.011+0000 7f243ed9d700 1 --2- 172.21.15.154:0/1827979809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2440157740 0x7f24400adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:12.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f2437fff700 1 --2- 172.21.15.154:0/1827979809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b2100 0x7f2440068390 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f24280099b0 tx=0x7f2428009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c9e5b970eb10a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:12.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f243e59c700 1 -- 172.21.15.154:0/1827979809 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242800b860 con 0x7f24400b2100 2023-10-10T22:18:12.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f243e59c700 1 -- 172.21.15.154:0/1827979809 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242800b9c0 con 0x7f24400b2100 2023-10-10T22:18:12.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f243e59c700 1 -- 172.21.15.154:0/1827979809 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242800bd60 con 0x7f24400b2100 2023-10-10T22:18:12.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f24451ff700 1 -- 172.21.15.154:0/1827979809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b2100 msgr2=0x7f2440068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f24451ff700 1 --2- 172.21.15.154:0/1827979809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b2100 0x7f2440068390 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f24280099b0 tx=0x7f2428009250 comp rx=0 tx=0).stop 2023-10-10T22:18:12.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f24451ff700 1 -- 172.21.15.154:0/1827979809 shutdown_connections 2023-10-10T22:18:12.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f24451ff700 1 --2- 172.21.15.154:0/1827979809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2440157740 0x7f24400adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f24451ff700 1 --2- 172.21.15.154:0/1827979809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400b2100 0x7f2440068390 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f24451ff700 1 -- 172.21.15.154:0/1827979809 >> 172.21.15.154:0/1827979809 conn(0x7f24400c8f90 msgr2=0x7f24400c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:12.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f24451ff700 1 -- 172.21.15.154:0/1827979809 shutdown_connections 2023-10-10T22:18:12.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.012+0000 7f24451ff700 1 -- 172.21.15.154:0/1827979809 wait complete. 2023-10-10T22:18:12.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.014+0000 7f24451ff700 1 Processor -- start 2023-10-10T22:18:12.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.014+0000 7f24451ff700 1 -- start start 2023-10-10T22:18:12.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f24451ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400688d0 0x7f24400c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f24451ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b2100 0x7f24400c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f24451ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440157740 0x7f2440148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f24451ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400c6870 con 0x7f24400688d0 2023-10-10T22:18:12.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f24451ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2440168610 con 0x7f2440157740 2023-10-10T22:18:12.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f24451ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2440148ea0 con 0x7f24400b2100 2023-10-10T22:18:12.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f243ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400688d0 0x7f24400c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f243ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400688d0 0x7f24400c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48082/0 (socket says 172.21.15.154:48082) 2023-10-10T22:18:12.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f243ed9d700 1 -- 172.21.15.154:0/598384150 learned_addr learned my addr 172.21.15.154:0/598384150 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:12.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f2437fff700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b2100 0x7f24400c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f243f59e700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440157740 0x7f2440148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f243ed9d700 1 -- 172.21.15.154:0/598384150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b2100 msgr2=0x7f24400c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f243ed9d700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b2100 0x7f24400c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f243ed9d700 1 -- 172.21.15.154:0/598384150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440157740 msgr2=0x7f2440148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f243ed9d700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440157740 0x7f2440148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.015+0000 7f243ed9d700 1 -- 172.21.15.154:0/598384150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24280094f0 con 0x7f24400688d0 2023-10-10T22:18:12.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.016+0000 7f243ed9d700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400688d0 0x7f24400c3530 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f243000e900 tx=0x7f2430008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:12.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.016+0000 7f2436ffd700 1 -- 172.21.15.154:0/598384150 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430013410 con 0x7f24400688d0 2023-10-10T22:18:12.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.016+0000 7f2436ffd700 1 -- 172.21.15.154:0/598384150 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430013570 con 0x7f24400688d0 2023-10-10T22:18:12.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.016+0000 7f2436ffd700 1 -- 172.21.15.154:0/598384150 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430013910 con 0x7f24400688d0 2023-10-10T22:18:12.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.016+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24400c3c30 con 0x7f24400688d0 2023-10-10T22:18:12.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.016+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24401682a0 con 0x7f24400688d0 2023-10-10T22:18:12.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.017+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24400718b0 con 0x7f24400688d0 2023-10-10T22:18:12.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.018+0000 7f2436ffd700 1 -- 172.21.15.154:0/598384150 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 80) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f2430013cc0 con 0x7f24400688d0 2023-10-10T22:18:12.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.019+0000 7f2436ffd700 1 -- 172.21.15.154:0/598384150 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6814+0+0 (secure 0 0 0) 0x7f24300842e0 con 0x7f24400688d0 2023-10-10T22:18:12.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.023+0000 7f2436ffd700 1 -- 172.21.15.154:0/598384150 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2430051200 con 0x7f24400688d0 2023-10-10T22:18:12.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.216+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f24400678d0 con 0x7f24400688d0 2023-10-10T22:18:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.715+0000 7f2436ffd700 1 -- 172.21.15.154:0/598384150 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 81) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f2430050e80 con 0x7f24400688d0 2023-10-10T22:18:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.716+0000 7f2436ffd700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f242006cad0 0x7f242006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.717+0000 7f2437fff700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f242006cad0 0x7f242006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.720+0000 7f2437fff700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f242006cad0 0x7f242006eeb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f24280099b0 tx=0x7f2428017000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:12.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.756+0000 7f2436ffd700 1 -- 172.21.15.154:0/598384150 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v165) v1 ==== 181+0+0 (secure 0 0 0) 0x7f243006f750 con 0x7f24400688d0 2023-10-10T22:18:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.759+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f242006cad0 msgr2=0x7f242006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.759+0000 7f24451ff700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f242006cad0 0x7f242006eeb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f24280099b0 tx=0x7f2428017000 comp rx=0 tx=0).stop 2023-10-10T22:18:12.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.759+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400688d0 msgr2=0x7f24400c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.759+0000 7f24451ff700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400688d0 0x7f24400c3530 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f243000e900 tx=0x7f2430008040 comp rx=0 tx=0).stop 2023-10-10T22:18:12.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.759+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 shutdown_connections 2023-10-10T22:18:12.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.759+0000 7f24451ff700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2440157740 0x7f2440148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.759+0000 7f24451ff700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f242006cad0 0x7f242006eeb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.760+0000 7f24451ff700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24400688d0 0x7f24400c3530 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.760+0000 7f24451ff700 1 --2- 172.21.15.154:0/598384150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24400b2100 0x7f24400c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.760+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 >> 172.21.15.154:0/598384150 conn(0x7f24400c8f90 msgr2=0x7f2440156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.760+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 shutdown_connections 2023-10-10T22:18:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.760+0000 7f24451ff700 1 -- 172.21.15.154:0/598384150 wait complete. 2023-10-10T22:18:12.764 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T22:18:12.779 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T22:18:12.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.972+0000 7f5ff65ff700 1 Processor -- start 2023-10-10T22:18:12.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.972+0000 7f5ff65ff700 1 -- start start 2023-10-10T22:18:12.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5ff65ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ff0069a50 0x7f5ff00c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5ff65ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff00ac030 con 0x7f5ff00c8490 2023-10-10T22:18:12.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5ff65ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff00ab820 con 0x7f5ff0069e20 2023-10-10T22:18:12.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5ff65ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff006dbb0 con 0x7f5ff0069a50 2023-10-10T22:18:12.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5feffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ff0069a50 0x7f5ff00c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5feffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ff0069a50 0x7f5ff00c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48092/0 (socket says 172.21.15.154:48092) 2023-10-10T22:18:12.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5fe7fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5ff00c8490 0x7f5ff015a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53002/0 (socket says 172.21.15.154:53002) 2023-10-10T22:18:12.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5feffff700 1 -- 172.21.15.154:0/4052616404 learned_addr learned my addr 172.21.15.154:0/4052616404 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:12.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5feffff700 1 -- 172.21.15.154:0/4052616404 >> v1:172.21.15.179:6789/0 conn(0x7f5ff0069e20 legacy=0x7f5ff01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:12.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5feffff700 1 -- 172.21.15.154:0/4052616404 >> v1:172.21.15.154:6789/0 conn(0x7f5ff00c8490 legacy=0x7f5ff015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.974+0000 7f5feffff700 1 -- 172.21.15.154:0/4052616404 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00aba70 con 0x7f5ff0069a50 2023-10-10T22:18:12.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.975+0000 7f5feffff700 1 --2- 172.21.15.154:0/4052616404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 0x7f5ff00c6ac0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00099b0 tx=0x7f5fe0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7844a8e9e64a5540 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:12.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.975+0000 7f5fef7fe700 1 -- 172.21.15.154:0/4052616404 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000b860 con 0x7f5ff0069a50 2023-10-10T22:18:12.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.975+0000 7f5fef7fe700 1 -- 172.21.15.154:0/4052616404 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe000b9c0 con 0x7f5ff0069a50 2023-10-10T22:18:12.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.975+0000 7f5fef7fe700 1 -- 172.21.15.154:0/4052616404 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000bd60 con 0x7f5ff0069a50 2023-10-10T22:18:12.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.975+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4052616404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 msgr2=0x7f5ff00c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.975+0000 7f5ff65ff700 1 --2- 172.21.15.154:0/4052616404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 0x7f5ff00c6ac0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00099b0 tx=0x7f5fe0009250 comp rx=0 tx=0).stop 2023-10-10T22:18:12.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.976+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4052616404 shutdown_connections 2023-10-10T22:18:12.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.976+0000 7f5ff65ff700 1 --2- 172.21.15.154:0/4052616404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 0x7f5ff00c6ac0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.976+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4052616404 >> 172.21.15.154:0/4052616404 conn(0x7f5ff00c8f90 msgr2=0x7f5ff00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:12.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.976+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4052616404 shutdown_connections 2023-10-10T22:18:12.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.976+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4052616404 wait complete. 2023-10-10T22:18:12.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.977+0000 7f5ff65ff700 1 Processor -- start 2023-10-10T22:18:12.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.977+0000 7f5ff65ff700 1 -- start start 2023-10-10T22:18:12.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.978+0000 7f5ff65ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 0x7f5ff0154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.978+0000 7f5ff65ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff0069e20 0x7f5ff00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.978+0000 7f5ff65ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff00c8490 0x7f5ff00adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.978+0000 7f5ff65ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff016e620 con 0x7f5ff0069a50 2023-10-10T22:18:12.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.978+0000 7f5ff65ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00b16b0 con 0x7f5ff00c8490 2023-10-10T22:18:12.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.978+0000 7f5ff65ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00b0dc0 con 0x7f5ff0069e20 2023-10-10T22:18:12.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.978+0000 7f5feffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 0x7f5ff0154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.978+0000 7f5feffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 0x7f5ff0154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48104/0 (socket says 172.21.15.154:48104) 2023-10-10T22:18:12.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.978+0000 7f5feffff700 1 -- 172.21.15.154:0/4022709497 learned_addr learned my addr 172.21.15.154:0/4022709497 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:12.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5ff4b9c700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff00c8490 0x7f5ff00adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5fe7fff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff0069e20 0x7f5ff00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5feffff700 1 -- 172.21.15.154:0/4022709497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff0069e20 msgr2=0x7f5ff00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5feffff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff0069e20 0x7f5ff00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5feffff700 1 -- 172.21.15.154:0/4022709497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff00c8490 msgr2=0x7f5ff00adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:12.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5feffff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff00c8490 0x7f5ff00adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:12.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5feffff700 1 -- 172.21.15.154:0/4022709497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00094f0 con 0x7f5ff0069a50 2023-10-10T22:18:12.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5feffff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 0x7f5ff0154610 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00cc0b0 tx=0x7f5fe0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:12.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5fecff9700 1 -- 172.21.15.154:0/4022709497 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0011ea0 con 0x7f5ff0069a50 2023-10-10T22:18:12.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5fecff9700 1 -- 172.21.15.154:0/4022709497 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe001a630 con 0x7f5ff0069a50 2023-10-10T22:18:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5fecff9700 1 -- 172.21.15.154:0/4022709497 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe001a9d0 con 0x7f5ff0069a50 2023-10-10T22:18:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.979+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff016e340 con 0x7f5ff0069a50 2023-10-10T22:18:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.980+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff00b1340 con 0x7f5ff0069a50 2023-10-10T22:18:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.980+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff00aea20 con 0x7f5ff0069a50 2023-10-10T22:18:12.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.981+0000 7f5fecff9700 1 -- 172.21.15.154:0/4022709497 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 81) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f5fe002d440 con 0x7f5ff0069a50 2023-10-10T22:18:12.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.982+0000 7f5fecff9700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5fd0066d80 0x7f5fd0069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:12.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.982+0000 7f5fecff9700 1 -- 172.21.15.154:0/4022709497 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6376+0+0 (secure 0 0 0) 0x7f5fe0085f80 con 0x7f5ff0069a50 2023-10-10T22:18:12.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.982+0000 7f5fe7fff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5fd0066d80 0x7f5fd0069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:12.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.983+0000 7f5fe7fff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5fd0066d80 0x7f5fd0069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8007fd0 tx=0x7f5fd8007d70 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:12.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:12.986+0000 7f5fecff9700 1 -- 172.21.15.154:0/4022709497 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fe0053130 con 0x7f5ff0069a50 2023-10-10T22:18:13.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.185+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ff00b1990 con 0x7f5ff0069a50 2023-10-10T22:18:13.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.761+0000 7f5fecff9700 1 -- 172.21.15.154:0/4022709497 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fe0053500 con 0x7f5ff0069a50 2023-10-10T22:18:13.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.765+0000 7f5fecff9700 1 -- 172.21.15.154:0/4022709497 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v166) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5fe0053130 con 0x7f5ff0069a50 2023-10-10T22:18:13.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5fd0066d80 msgr2=0x7f5fd0069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:13.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5fd0066d80 0x7f5fd0069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8007fd0 tx=0x7f5fd8007d70 comp rx=0 tx=0).stop 2023-10-10T22:18:13.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 msgr2=0x7f5ff0154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:13.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 0x7f5ff0154610 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00cc0b0 tx=0x7f5fe0017000 comp rx=0 tx=0).stop 2023-10-10T22:18:13.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 shutdown_connections 2023-10-10T22:18:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff00c8490 0x7f5ff00adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5fd0066d80 0x7f5fd0069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ff0069a50 0x7f5ff0154610 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 --2- 172.21.15.154:0/4022709497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff0069e20 0x7f5ff00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 >> 172.21.15.154:0/4022709497 conn(0x7f5ff00c8f90 msgr2=0x7f5ff00cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:13.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 shutdown_connections 2023-10-10T22:18:13.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.769+0000 7f5ff65ff700 1 -- 172.21.15.154:0/4022709497 wait complete. 2023-10-10T22:18:13.773 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T22:18:13.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T22:18:13.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.974+0000 7f7f7699d700 1 Processor -- start 2023-10-10T22:18:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.974+0000 7f7f7699d700 1 -- start start 2023-10-10T22:18:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.975+0000 7f7f7699d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f7015a3b0 0x7f7f7015a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.975+0000 7f7f7699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f700aef00 0x7f7f7015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.975+0000 7f7f7699d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f700aea70 con 0x7f7f7006e470 2023-10-10T22:18:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.975+0000 7f7f7699d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f700ae480 con 0x7f7f7015a3b0 2023-10-10T22:18:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.975+0000 7f7f7699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7015acc0 con 0x7f7f700aef00 2023-10-10T22:18:13.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.975+0000 7f7f7599b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f7015a3b0 0x7f7f7015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:13.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.975+0000 7f7f7599b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f7015a3b0 0x7f7f7015a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48114/0 (socket says 172.21.15.154:48114) 2023-10-10T22:18:13.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.975+0000 7f7f7599b700 1 -- 172.21.15.154:0/1795432021 learned_addr learned my addr 172.21.15.154:0/1795432021 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:13.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f7519a700 1 --2- 172.21.15.154:0/1795432021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f700aef00 0x7f7f7015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:13.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f7599b700 1 -- 172.21.15.154:0/1795432021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f700aef00 msgr2=0x7f7f7015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:13.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f7599b700 1 --2- 172.21.15.154:0/1795432021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f700aef00 0x7f7f7015d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:13.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f7599b700 1 -- 172.21.15.154:0/1795432021 >> v1:172.21.15.154:6789/0 conn(0x7f7f7006e470 legacy=0x7f7f700c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:13.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f7599b700 1 -- 172.21.15.154:0/1795432021 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7015dd30 con 0x7f7f7015a3b0 2023-10-10T22:18:13.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f74999700 1 -- 172.21.15.154:0/1795432021 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013962305 0 0) 0x7f7f700aea70 con 0x7f7f7006e470 2023-10-10T22:18:13.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f7599b700 1 --2- 172.21.15.154:0/1795432021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7015a3b0 0x7f7f7015a780 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0099b0 tx=0x7f7f6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524ca2c1017129ce server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:13.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f74999700 1 -- 172.21.15.154:0/1795432021 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00b860 con 0x7f7f7015a3b0 2023-10-10T22:18:13.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f74999700 1 -- 172.21.15.154:0/1795432021 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c00b9c0 con 0x7f7f7015a3b0 2023-10-10T22:18:13.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.976+0000 7f7f74999700 1 -- 172.21.15.154:0/1795432021 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00bd60 con 0x7f7f7015a3b0 2023-10-10T22:18:13.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.977+0000 7f7f7699d700 1 -- 172.21.15.154:0/1795432021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7015a3b0 msgr2=0x7f7f7015a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:13.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.977+0000 7f7f7699d700 1 --2- 172.21.15.154:0/1795432021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7015a3b0 0x7f7f7015a780 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0099b0 tx=0x7f7f6c009250 comp rx=0 tx=0).stop 2023-10-10T22:18:13.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.977+0000 7f7f7699d700 1 -- 172.21.15.154:0/1795432021 shutdown_connections 2023-10-10T22:18:13.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.977+0000 7f7f7699d700 1 --2- 172.21.15.154:0/1795432021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7015a3b0 0x7f7f7015a780 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:13.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.977+0000 7f7f7699d700 1 --2- 172.21.15.154:0/1795432021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f700aef00 0x7f7f7015d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:13.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.977+0000 7f7f7699d700 1 -- 172.21.15.154:0/1795432021 >> 172.21.15.154:0/1795432021 conn(0x7f7f700c9f70 msgr2=0x7f7f7006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:13.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.977+0000 7f7f7699d700 1 -- 172.21.15.154:0/1795432021 shutdown_connections 2023-10-10T22:18:13.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.977+0000 7f7f7699d700 1 -- 172.21.15.154:0/1795432021 wait complete. 2023-10-10T22:18:13.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.978+0000 7f7f7699d700 1 Processor -- start 2023-10-10T22:18:13.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.979+0000 7f7f7699d700 1 -- start start 2023-10-10T22:18:13.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.979+0000 7f7f7699d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7006e470 0x7f7f701464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:13.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.979+0000 7f7f7699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f700aef00 0x7f7f700b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:13.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.979+0000 7f7f7699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f7015a3b0 0x7f7f70153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:13.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.979+0000 7f7f7699d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f701519f0 con 0x7f7f7006e470 2023-10-10T22:18:13.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.979+0000 7f7f7699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70146a10 con 0x7f7f7015a3b0 2023-10-10T22:18:13.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.979+0000 7f7f7699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700c3e50 con 0x7f7f700aef00 2023-10-10T22:18:13.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.980+0000 7f7f7599b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7006e470 0x7f7f701464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:13.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.980+0000 7f7f7599b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7006e470 0x7f7f701464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48120/0 (socket says 172.21.15.154:48120) 2023-10-10T22:18:13.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.980+0000 7f7f7599b700 1 -- 172.21.15.154:0/2996440026 learned_addr learned my addr 172.21.15.154:0/2996440026 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:13.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.980+0000 7f7f7599b700 1 -- 172.21.15.154:0/2996440026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f700aef00 msgr2=0x7f7f700b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:13.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.980+0000 7f7f7599b700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f700aef00 0x7f7f700b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:13.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.980+0000 7f7f7599b700 1 -- 172.21.15.154:0/2996440026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f7015a3b0 msgr2=0x7f7f70153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:13.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.980+0000 7f7f7599b700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f7015a3b0 0x7f7f70153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:13.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.980+0000 7f7f7599b700 1 -- 172.21.15.154:0/2996440026 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0094f0 con 0x7f7f7006e470 2023-10-10T22:18:13.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.980+0000 7f7f7599b700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7006e470 0x7f7f701464d0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009fd0 tx=0x7f7f6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:13.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.981+0000 7f7f65ffb700 1 -- 172.21.15.154:0/2996440026 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c024440 con 0x7f7f7006e470 2023-10-10T22:18:13.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.981+0000 7f7f65ffb700 1 -- 172.21.15.154:0/2996440026 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c0245a0 con 0x7f7f7006e470 2023-10-10T22:18:13.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.981+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f700c4130 con 0x7f7f7006e470 2023-10-10T22:18:13.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.981+0000 7f7f65ffb700 1 -- 172.21.15.154:0/2996440026 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c024940 con 0x7f7f7006e470 2023-10-10T22:18:13.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.981+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f700c46f0 con 0x7f7f7006e470 2023-10-10T22:18:13.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.982+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7006cfa0 con 0x7f7f7006e470 2023-10-10T22:18:13.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.983+0000 7f7f65ffb700 1 -- 172.21.15.154:0/2996440026 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f6c01a420 con 0x7f7f7006e470 2023-10-10T22:18:13.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.984+0000 7f7f65ffb700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7f54066f30 0x7f7f540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:13.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.984+0000 7f7f65ffb700 1 -- 172.21.15.154:0/2996440026 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7f6c086440 con 0x7f7f7006e470 2023-10-10T22:18:13.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.984+0000 7f7f7519a700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7f54066f30 0x7f7f540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:13.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.985+0000 7f7f7519a700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7f54066f30 0x7f7f540693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f700c6dd0 tx=0x7f7f60008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:13.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:13.989+0000 7f7f65ffb700 1 -- 172.21.15.154:0/2996440026 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f6c053510 con 0x7f7f7006e470 2023-10-10T22:18:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.185+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7f7015e010 con 0x7f7f7006e470 2023-10-10T22:18:14.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.189+0000 7f7f65ffb700 1 -- 172.21.15.154:0/2996440026 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7f6c056b30 con 0x7f7f7006e470 2023-10-10T22:18:14.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7f54066f30 msgr2=0x7f7f540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7f54066f30 0x7f7f540693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f700c6dd0 tx=0x7f7f60008040 comp rx=0 tx=0).stop 2023-10-10T22:18:14.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7006e470 msgr2=0x7f7f701464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7006e470 0x7f7f701464d0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009fd0 tx=0x7f7f6c017000 comp rx=0 tx=0).stop 2023-10-10T22:18:14.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 shutdown_connections 2023-10-10T22:18:14.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f7015a3b0 0x7f7f70153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7f54066f30 0x7f7f540693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7006e470 0x7f7f701464d0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 --2- 172.21.15.154:0/2996440026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f700aef00 0x7f7f700b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 >> 172.21.15.154:0/2996440026 conn(0x7f7f700c9f70 msgr2=0x7f7f7015b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:14.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 shutdown_connections 2023-10-10T22:18:14.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.192+0000 7f7f7699d700 1 -- 172.21.15.154:0/2996440026 wait complete. 2023-10-10T22:18:14.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T22:18:14.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.393+0000 7ff2499ff700 1 Processor -- start 2023-10-10T22:18:14.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.393+0000 7ff2499ff700 1 -- start start 2023-10-10T22:18:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff2499ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff24415ac80 0x7ff244069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff2499ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2440af2f0 con 0x7ff244069cb0 2023-10-10T22:18:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff2499ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2440af5d0 con 0x7ff24415b050 2023-10-10T22:18:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff2499ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24406a0f0 con 0x7ff24415ac80 2023-10-10T22:18:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff2437fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff244069cb0 0x7ff2440c7b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53012/0 (socket says 172.21.15.154:53012) 2023-10-10T22:18:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff2437fe700 1 -- 172.21.15.154:0/1658367132 learned_addr learned my addr 172.21.15.154:0/1658367132 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff242ffd700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff24415ac80 0x7ff244069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253380514 0 0) 0x7ff2440af2f0 con 0x7ff244069cb0 2023-10-10T22:18:14.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff22c003570 con 0x7ff244069cb0 2023-10-10T22:18:14.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.395+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920847701 0 0) 0x7ff2440af5d0 con 0x7ff24415b050 2023-10-10T22:18:14.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2440af2f0 con 0x7ff24415b050 2023-10-10T22:18:14.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 651030245 0 0) 0x7ff22c003570 con 0x7ff244069cb0 2023-10-10T22:18:14.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff24415ac80 msgr2=0x7ff244069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:14.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff24415ac80 0x7ff244069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 >> v1:172.21.15.179:6789/0 conn(0x7ff24415b050 legacy=0x7ff2440afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2440c8660 con 0x7ff244069cb0 2023-10-10T22:18:14.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7ff23c0017f0 con 0x7ff244069cb0 2023-10-10T22:18:14.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 >> v1:172.21.15.154:6789/0 conn(0x7ff244069cb0 legacy=0x7ff2440c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c003c20 0x7ff22c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c004810 0x7ff22c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff24415ac80 0x7ff22c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24406a0f0 con 0x7ff22c003c20 2023-10-10T22:18:14.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c00bb40 con 0x7ff22c004810 2023-10-10T22:18:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c00bd00 con 0x7ff24415ac80 2023-10-10T22:18:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff242ffd700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c003c20 0x7ff22c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff2437fe700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff24415ac80 0x7ff22c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff2427fc700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c004810 0x7ff22c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff242ffd700 1 -- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff24415ac80 msgr2=0x7ff22c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.396+0000 7ff242ffd700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff24415ac80 0x7ff22c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff242ffd700 1 -- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c004810 msgr2=0x7ff22c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff242ffd700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c004810 0x7ff22c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff242ffd700 1 -- 172.21.15.154:0/1658367132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c003570 con 0x7ff22c003c20 2023-10-10T22:18:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff2427fc700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c004810 0x7ff22c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff242ffd700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c003c20 0x7ff22c004010 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7ff234009c00 tx=0x7ff2340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808598cc03d0de58 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23400e710 con 0x7ff22c003c20 2023-10-10T22:18:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23400e870 con 0x7ff22c003c20 2023-10-10T22:18:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff241ffb700 1 -- 172.21.15.154:0/1658367132 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23400ec30 con 0x7ff22c003c20 2023-10-10T22:18:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff2499ff700 1 -- 172.21.15.154:0/1658367132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c003c20 msgr2=0x7ff22c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.397+0000 7ff2499ff700 1 --2- 172.21.15.154:0/1658367132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c003c20 0x7ff22c004010 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7ff234009c00 tx=0x7ff2340091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.398+0000 7ff2437fe700 1 -- 172.21.15.154:0/1658367132 reap_dead start 2023-10-10T22:18:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.398+0000 7ff2499ff700 1 -- 172.21.15.154:0/1658367132 shutdown_connections 2023-10-10T22:18:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.398+0000 7ff2499ff700 1 -- 172.21.15.154:0/1658367132 >> 172.21.15.154:0/1658367132 conn(0x7ff244068e10 msgr2=0x7ff2440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.398+0000 7ff2499ff700 1 -- 172.21.15.154:0/1658367132 shutdown_connections 2023-10-10T22:18:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.398+0000 7ff2499ff700 1 -- 172.21.15.154:0/1658367132 wait complete. 2023-10-10T22:18:14.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.399+0000 7ff2499ff700 1 Processor -- start 2023-10-10T22:18:14.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.399+0000 7ff2499ff700 1 -- start start 2023-10-10T22:18:14.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.400+0000 7ff2499ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c003c20 0x7ff244156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.400+0000 7ff2499ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2440ac3b0 0x7ff2440ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.400+0000 7ff2499ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2440ad710 0x7ff2440c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.400+0000 7ff2499ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440c6800 con 0x7ff2440ac3b0 2023-10-10T22:18:14.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.400+0000 7ff2499ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440c5bf0 con 0x7ff22c003c20 2023-10-10T22:18:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.400+0000 7ff2499ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440c5ed0 con 0x7ff2440ad710 2023-10-10T22:18:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.400+0000 7ff2427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2440ac3b0 0x7ff2440ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.400+0000 7ff2427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2440ac3b0 0x7ff2440ad1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48138/0 (socket says 172.21.15.154:48138) 2023-10-10T22:18:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.400+0000 7ff2427fc700 1 -- 172.21.15.154:0/3872505604 learned_addr learned my addr 172.21.15.154:0/3872505604 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff242ffd700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c003c20 0x7ff244156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff2437fe700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2440ad710 0x7ff2440c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff2427fc700 1 -- 172.21.15.154:0/3872505604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2440ad710 msgr2=0x7ff2440c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff2427fc700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2440ad710 0x7ff2440c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff2427fc700 1 -- 172.21.15.154:0/3872505604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c003c20 msgr2=0x7ff244156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff2427fc700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c003c20 0x7ff244156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff2427fc700 1 -- 172.21.15.154:0/3872505604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2440c61b0 con 0x7ff2440ac3b0 2023-10-10T22:18:14.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff2437fe700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2440ad710 0x7ff2440c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:14.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff2427fc700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2440ac3b0 0x7ff2440ad1d0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff23800e840 tx=0x7ff238009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:14.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff22affd700 1 -- 172.21.15.154:0/3872505604 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238006820 con 0x7ff2440ac3b0 2023-10-10T22:18:14.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff22affd700 1 -- 172.21.15.154:0/3872505604 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff238006980 con 0x7ff2440ac3b0 2023-10-10T22:18:14.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff22affd700 1 -- 172.21.15.154:0/3872505604 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238006d20 con 0x7ff2440ac3b0 2023-10-10T22:18:14.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.401+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2440c6490 con 0x7ff2440ac3b0 2023-10-10T22:18:14.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.402+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2440c41c0 con 0x7ff2440ac3b0 2023-10-10T22:18:14.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.402+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24404c3c0 con 0x7ff2440ac3b0 2023-10-10T22:18:14.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.403+0000 7ff22affd700 1 -- 172.21.15.154:0/3872505604 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff238007240 con 0x7ff2440ac3b0 2023-10-10T22:18:14.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.405+0000 7ff22affd700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff230066f30 0x7ff2300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.405+0000 7ff22affd700 1 -- 172.21.15.154:0/3872505604 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ff238084570 con 0x7ff2440ac3b0 2023-10-10T22:18:14.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.405+0000 7ff242ffd700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff230066f30 0x7ff2300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.406+0000 7ff242ffd700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff230066f30 0x7ff2300693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff2340091e0 tx=0x7ff23401a000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:14.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.409+0000 7ff22affd700 1 -- 172.21.15.154:0/3872505604 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2380516e0 con 0x7ff2440ac3b0 2023-10-10T22:18:14.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.598+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7ff2440c83a0 con 0x7ff2440ac3b0 2023-10-10T22:18:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.606+0000 7ff22affd700 1 -- 172.21.15.154:0/3872505604 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v56) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff238054d00 con 0x7ff2440ac3b0 2023-10-10T22:18:14.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.608+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff230066f30 msgr2=0x7ff2300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.608+0000 7ff2499ff700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff230066f30 0x7ff2300693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff2340091e0 tx=0x7ff23401a000 comp rx=0 tx=0).stop 2023-10-10T22:18:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.608+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2440ac3b0 msgr2=0x7ff2440ad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.608+0000 7ff2499ff700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2440ac3b0 0x7ff2440ad1d0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff23800e840 tx=0x7ff238009040 comp rx=0 tx=0).stop 2023-10-10T22:18:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.609+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 shutdown_connections 2023-10-10T22:18:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.609+0000 7ff2499ff700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2440ad710 0x7ff2440c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.609+0000 7ff2499ff700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff22c003c20 0x7ff244156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.609+0000 7ff2499ff700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff230066f30 0x7ff2300693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.609+0000 7ff2499ff700 1 --2- 172.21.15.154:0/3872505604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2440ac3b0 0x7ff2440ad1d0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.609+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 >> 172.21.15.154:0/3872505604 conn(0x7ff244068e10 msgr2=0x7ff2440c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.609+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 shutdown_connections 2023-10-10T22:18:14.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.609+0000 7ff2499ff700 1 -- 172.21.15.154:0/3872505604 wait complete. 2023-10-10T22:18:14.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T22:18:14.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.812+0000 7fe5857ff700 1 Processor -- start 2023-10-10T22:18:14.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.812+0000 7fe5857ff700 1 -- start start 2023-10-10T22:18:14.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.814+0000 7fe5857ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5800ccee0 0x7fe5801561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.814+0000 7fe5857ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58015b0d0 con 0x7fe5800c87c0 2023-10-10T22:18:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.814+0000 7fe5857ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58015a4c0 con 0x7fe5800c83f0 2023-10-10T22:18:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.814+0000 7fe5857ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58015a7a0 con 0x7fe5800ccee0 2023-10-10T22:18:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.814+0000 7fe577fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5800ccee0 0x7fe5801561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.814+0000 7fe577fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5800ccee0 0x7fe5801561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48144/0 (socket says 172.21.15.154:48144) 2023-10-10T22:18:14.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.814+0000 7fe577fff700 1 -- 172.21.15.154:0/2691002811 learned_addr learned my addr 172.21.15.154:0/2691002811 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:14.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.814+0000 7fe57f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe5800c87c0 0x7fe5800ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53022/0 (socket says 172.21.15.154:53022) 2023-10-10T22:18:14.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.814+0000 7fe57e7fc700 1 -- 172.21.15.154:0/2691002811 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044541092 0 0) 0x7fe58015b0d0 con 0x7fe5800c87c0 2023-10-10T22:18:14.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.815+0000 7fe57e7fc700 1 -- 172.21.15.154:0/2691002811 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe56c003570 con 0x7fe5800c87c0 2023-10-10T22:18:14.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.815+0000 7fe57e7fc700 1 -- 172.21.15.154:0/2691002811 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587820235 0 0) 0x7fe58015a4c0 con 0x7fe5800c83f0 2023-10-10T22:18:14.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.815+0000 7fe577fff700 1 -- 172.21.15.154:0/2691002811 >> v1:172.21.15.179:6789/0 conn(0x7fe5800c83f0 legacy=0x7fe5800c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.815+0000 7fe577fff700 1 -- 172.21.15.154:0/2691002811 >> v1:172.21.15.154:6789/0 conn(0x7fe5800c87c0 legacy=0x7fe5800ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.815+0000 7fe577fff700 1 -- 172.21.15.154:0/2691002811 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58015aa80 con 0x7fe5800ccee0 2023-10-10T22:18:14.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.815+0000 7fe577fff700 1 --2- 172.21.15.154:0/2691002811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 0x7fe5801561d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fe5680099b0 tx=0x7fe568009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b7aa7f175a15f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:14.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.815+0000 7fe57e7fc700 1 -- 172.21.15.154:0/2691002811 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568009ea0 con 0x7fe5800ccee0 2023-10-10T22:18:14.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.815+0000 7fe57e7fc700 1 -- 172.21.15.154:0/2691002811 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800b860 con 0x7fe5800ccee0 2023-10-10T22:18:14.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.815+0000 7fe57e7fc700 1 -- 172.21.15.154:0/2691002811 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800bc00 con 0x7fe5800ccee0 2023-10-10T22:18:14.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.816+0000 7fe5857ff700 1 -- 172.21.15.154:0/2691002811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 msgr2=0x7fe5801561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.816+0000 7fe5857ff700 1 --2- 172.21.15.154:0/2691002811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 0x7fe5801561d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fe5680099b0 tx=0x7fe568009250 comp rx=0 tx=0).stop 2023-10-10T22:18:14.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.816+0000 7fe5857ff700 1 -- 172.21.15.154:0/2691002811 shutdown_connections 2023-10-10T22:18:14.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.816+0000 7fe5857ff700 1 --2- 172.21.15.154:0/2691002811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 0x7fe5801561d0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.816+0000 7fe5857ff700 1 -- 172.21.15.154:0/2691002811 >> 172.21.15.154:0/2691002811 conn(0x7fe580068e10 msgr2=0x7fe5800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:14.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.816+0000 7fe5857ff700 1 -- 172.21.15.154:0/2691002811 shutdown_connections 2023-10-10T22:18:14.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.816+0000 7fe5857ff700 1 -- 172.21.15.154:0/2691002811 wait complete. 2023-10-10T22:18:14.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.817+0000 7fe5857ff700 1 Processor -- start 2023-10-10T22:18:14.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.817+0000 7fe5857ff700 1 -- start start 2023-10-10T22:18:14.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.818+0000 7fe5857ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5800c83f0 0x7fe58013fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.818+0000 7fe5857ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5800c87c0 0x7fe580159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.818+0000 7fe5857ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 0x7fe5800ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.818+0000 7fe5857ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800c5560 con 0x7fe5800ccee0 2023-10-10T22:18:14.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.818+0000 7fe5857ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800c63c0 con 0x7fe5800c87c0 2023-10-10T22:18:14.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.818+0000 7fe5857ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800c6850 con 0x7fe5800c83f0 2023-10-10T22:18:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.818+0000 7fe57f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 0x7fe5800ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.818+0000 7fe57f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 0x7fe5800ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48148/0 (socket says 172.21.15.154:48148) 2023-10-10T22:18:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.818+0000 7fe57f7fe700 1 -- 172.21.15.154:0/4222234685 learned_addr learned my addr 172.21.15.154:0/4222234685 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe57effd700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5800c83f0 0x7fe58013fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe577fff700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5800c87c0 0x7fe580159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe57f7fe700 1 -- 172.21.15.154:0/4222234685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5800c83f0 msgr2=0x7fe58013fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe57f7fe700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5800c83f0 0x7fe58013fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe57f7fe700 1 -- 172.21.15.154:0/4222234685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5800c87c0 msgr2=0x7fe580159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:14.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe57f7fe700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5800c87c0 0x7fe580159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:14.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe57f7fe700 1 -- 172.21.15.154:0/4222234685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680094f0 con 0x7fe5800ccee0 2023-10-10T22:18:14.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe57f7fe700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 0x7fe5800ca5c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe57800cd30 tx=0x7fe578001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:14.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe576ffd700 1 -- 172.21.15.154:0/4222234685 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800ce90 con 0x7fe5800ccee0 2023-10-10T22:18:14.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe576ffd700 1 -- 172.21.15.154:0/4222234685 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe578005df0 con 0x7fe5800ccee0 2023-10-10T22:18:14.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.819+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5800c57b0 con 0x7fe5800ccee0 2023-10-10T22:18:14.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.820+0000 7fe576ffd700 1 -- 172.21.15.154:0/4222234685 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800aac0 con 0x7fe5800ccee0 2023-10-10T22:18:14.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.820+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5800c5d70 con 0x7fe5800ccee0 2023-10-10T22:18:14.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.820+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580064d80 con 0x7fe5800ccee0 2023-10-10T22:18:14.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.821+0000 7fe576ffd700 1 -- 172.21.15.154:0/4222234685 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5780070f0 con 0x7fe5800ccee0 2023-10-10T22:18:14.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.822+0000 7fe576ffd700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe560066f30 0x7fe5600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:14.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.822+0000 7fe576ffd700 1 -- 172.21.15.154:0/4222234685 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe578084800 con 0x7fe5800ccee0 2023-10-10T22:18:14.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.822+0000 7fe57effd700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe560066f30 0x7fe5600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:14.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.823+0000 7fe57effd700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe560066f30 0x7fe5600693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe5700039f0 tx=0x7fe570007ec0 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:14.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:14.826+0000 7fe576ffd700 1 -- 172.21.15.154:0/4222234685 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe578051950 con 0x7fe5800ccee0 2023-10-10T22:18:15.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.016+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe5800c6530 con 0x7fe5800ccee0 2023-10-10T22:18:15.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.020+0000 7fe576ffd700 1 -- 172.21.15.154:0/4222234685 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v57) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe578054f70 con 0x7fe5800ccee0 2023-10-10T22:18:15.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe560066f30 msgr2=0x7fe5600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe560066f30 0x7fe5600693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe5700039f0 tx=0x7fe570007ec0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 msgr2=0x7fe5800ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 0x7fe5800ca5c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe57800cd30 tx=0x7fe578001b60 comp rx=0 tx=0).stop 2023-10-10T22:18:15.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 shutdown_connections 2023-10-10T22:18:15.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe560066f30 0x7fe5600693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5800ccee0 0x7fe5800ca5c0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5800c83f0 0x7fe58013fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 --2- 172.21.15.154:0/4222234685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5800c87c0 0x7fe580159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 >> 172.21.15.154:0/4222234685 conn(0x7fe580068e10 msgr2=0x7fe580150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:15.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 shutdown_connections 2023-10-10T22:18:15.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.023+0000 7fe5857ff700 1 -- 172.21.15.154:0/4222234685 wait complete. 2023-10-10T22:18:15.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-10T22:18:15.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.231+0000 7f634919d700 1 Processor -- start 2023-10-10T22:18:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.231+0000 7f634919d700 1 -- start start 2023-10-10T22:18:15.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f634919d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6344156310 0x7f63440c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f634919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63441566e0 0x7f63440ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f634919d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63440ca300 0x7f63440ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f634919d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440ca860 con 0x7f6344156310 2023-10-10T22:18:15.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f634919d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440cab40 con 0x7f63440ca300 2023-10-10T22:18:15.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f634919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63440cae20 con 0x7f63441566e0 2023-10-10T22:18:15.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f6343fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6344156310 0x7f63440c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f6343fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6344156310 0x7f63440c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48160/0 (socket says 172.21.15.154:48160) 2023-10-10T22:18:15.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f6343fff700 1 -- 172.21.15.154:0/1771050352 learned_addr learned my addr 172.21.15.154:0/1771050352 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:15.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f63437fe700 1 --2- 172.21.15.154:0/1771050352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63441566e0 0x7f63440ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.233+0000 7f634899c700 1 --2- 172.21.15.154:0/1771050352 >> v2:172.21.15.179:3300/0 conn(0x7f63440ca300 0x7f63440ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.234+0000 7f6343fff700 1 -- 172.21.15.154:0/1771050352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63441566e0 msgr2=0x7f63440ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:15.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.234+0000 7f6343fff700 1 --2- 172.21.15.154:0/1771050352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63441566e0 0x7f63440ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.234+0000 7f6343fff700 1 -- 172.21.15.154:0/1771050352 >> v2:172.21.15.179:3300/0 conn(0x7f63440ca300 msgr2=0x7f63440ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:15.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.234+0000 7f6343fff700 1 --2- 172.21.15.154:0/1771050352 >> v2:172.21.15.179:3300/0 conn(0x7f63440ca300 0x7f63440ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.234+0000 7f6343fff700 1 -- 172.21.15.154:0/1771050352 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440cb100 con 0x7f6344156310 2023-10-10T22:18:15.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.234+0000 7f6343fff700 1 --2- 172.21.15.154:0/1771050352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6344156310 0x7f63440c9dc0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f634406f970 tx=0x7f6334009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7214442fd8c20323 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:15.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.234+0000 7f6342ffd700 1 -- 172.21.15.154:0/1771050352 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400b640 con 0x7f6344156310 2023-10-10T22:18:15.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.234+0000 7f6342ffd700 1 -- 172.21.15.154:0/1771050352 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633400b7a0 con 0x7f6344156310 2023-10-10T22:18:15.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.234+0000 7f6342ffd700 1 -- 172.21.15.154:0/1771050352 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400bb60 con 0x7f6344156310 2023-10-10T22:18:15.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.235+0000 7f634919d700 1 -- 172.21.15.154:0/1771050352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6344156310 msgr2=0x7f63440c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.235+0000 7f634919d700 1 --2- 172.21.15.154:0/1771050352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6344156310 0x7f63440c9dc0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f634406f970 tx=0x7f6334009250 comp rx=0 tx=0).stop 2023-10-10T22:18:15.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.235+0000 7f634919d700 1 -- 172.21.15.154:0/1771050352 shutdown_connections 2023-10-10T22:18:15.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.235+0000 7f634919d700 1 --2- 172.21.15.154:0/1771050352 >> v2:172.21.15.179:3300/0 conn(0x7f63440ca300 0x7f63440ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.235+0000 7f634919d700 1 --2- 172.21.15.154:0/1771050352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6344156310 0x7f63440c9dc0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.235+0000 7f634919d700 1 --2- 172.21.15.154:0/1771050352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63441566e0 0x7f63440ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.235+0000 7f634919d700 1 -- 172.21.15.154:0/1771050352 >> 172.21.15.154:0/1771050352 conn(0x7f63440cc1f0 msgr2=0x7f63440cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:15.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.235+0000 7f634919d700 1 -- 172.21.15.154:0/1771050352 shutdown_connections 2023-10-10T22:18:15.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.235+0000 7f634919d700 1 -- 172.21.15.154:0/1771050352 wait complete. 2023-10-10T22:18:15.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.236+0000 7f634919d700 1 Processor -- start 2023-10-10T22:18:15.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.236+0000 7f634919d700 1 -- start start 2023-10-10T22:18:15.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.237+0000 7f634919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63440ca300 0x7f634413ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.237+0000 7f634919d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6344156310 0x7f6344157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.237+0000 7f634919d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63441566e0 0x7f6344158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.237+0000 7f634919d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344153f50 con 0x7f63441566e0 2023-10-10T22:18:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.237+0000 7f634919d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634415cf40 con 0x7f6344156310 2023-10-10T22:18:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.237+0000 7f634919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634415cc60 con 0x7f63440ca300 2023-10-10T22:18:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f634899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63441566e0 0x7f6344158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f63437fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6344156310 0x7f6344157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f634899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63441566e0 0x7f6344158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48170/0 (socket says 172.21.15.154:48170) 2023-10-10T22:18:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f634899c700 1 -- 172.21.15.154:0/1245048836 learned_addr learned my addr 172.21.15.154:0/1245048836 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f6343fff700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63440ca300 0x7f634413ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f634899c700 1 -- 172.21.15.154:0/1245048836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63440ca300 msgr2=0x7f634413ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f634899c700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63440ca300 0x7f634413ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f634899c700 1 -- 172.21.15.154:0/1245048836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6344156310 msgr2=0x7f6344157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f634899c700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6344156310 0x7f6344157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f634899c700 1 -- 172.21.15.154:0/1245048836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340094f0 con 0x7f63441566e0 2023-10-10T22:18:15.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f634899c700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63441566e0 0x7f6344158090 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f633c009df0 tx=0x7f633c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:15.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.238+0000 7f632bfff700 1 -- 172.21.15.154:0/1245048836 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00caa0 con 0x7f63441566e0 2023-10-10T22:18:15.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.239+0000 7f632bfff700 1 -- 172.21.15.154:0/1245048836 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c00f040 con 0x7f63441566e0 2023-10-10T22:18:15.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.239+0000 7f632bfff700 1 -- 172.21.15.154:0/1245048836 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00ce70 con 0x7f63441566e0 2023-10-10T22:18:15.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.239+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6344154180 con 0x7f63441566e0 2023-10-10T22:18:15.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.239+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6344154740 con 0x7f63441566e0 2023-10-10T22:18:15.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.240+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634404c3c0 con 0x7f63441566e0 2023-10-10T22:18:15.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.240+0000 7f632bfff700 1 -- 172.21.15.154:0/1245048836 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f633c014690 con 0x7f63441566e0 2023-10-10T22:18:15.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.241+0000 7f632bfff700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6330066f30 0x7f63300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.241+0000 7f632bfff700 1 -- 172.21.15.154:0/1245048836 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f633c085190 con 0x7f63441566e0 2023-10-10T22:18:15.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.242+0000 7f6343fff700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6330066f30 0x7f63300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.242+0000 7f6343fff700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6330066f30 0x7f63300693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f634406f970 tx=0x7f6334017000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.245+0000 7f632bfff700 1 -- 172.21.15.154:0/1245048836 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f633c055cf0 con 0x7f63441566e0 2023-10-10T22:18:15.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.511+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f63440cd0b0 con 0x7f63441566e0 2023-10-10T22:18:15.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.761+0000 7f632bfff700 1 -- 172.21.15.154:0/1245048836 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2464) v1 ==== 174+0+0 (secure 0 0 0) 0x7f633c055880 con 0x7f63441566e0 2023-10-10T22:18:15.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6330066f30 msgr2=0x7f63300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6330066f30 0x7f63300693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f634406f970 tx=0x7f6334017000 comp rx=0 tx=0).stop 2023-10-10T22:18:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63441566e0 msgr2=0x7f6344158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63441566e0 0x7f6344158090 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f633c009df0 tx=0x7f633c00b040 comp rx=0 tx=0).stop 2023-10-10T22:18:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 shutdown_connections 2023-10-10T22:18:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f6330066f30 0x7f63300693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63441566e0 0x7f6344158090 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63440ca300 0x7f634413ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 --2- 172.21.15.154:0/1245048836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6344156310 0x7f6344157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 >> 172.21.15.154:0/1245048836 conn(0x7f63440cc1f0 msgr2=0x7f63440aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 shutdown_connections 2023-10-10T22:18:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.764+0000 7f634919d700 1 -- 172.21.15.154:0/1245048836 wait complete. 2023-10-10T22:18:15.785 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-10-10T22:18:15.786 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-10-10T22:18:15.787 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T22:18:15.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-10T22:18:15.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.968+0000 7ff141b9d700 1 Processor -- start 2023-10-10T22:18:15.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.968+0000 7ff141b9d700 1 -- start start 2023-10-10T22:18:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.969+0000 7ff141b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff13c157770 0x7ff13c150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.969+0000 7ff141b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c06e2a0 con 0x7ff13c0c6d00 2023-10-10T22:18:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.969+0000 7ff141b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c157b40 con 0x7ff13c0c7150 2023-10-10T22:18:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.969+0000 7ff141b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c06b2e0 con 0x7ff13c157770 2023-10-10T22:18:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.969+0000 7ff140b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff13c157770 0x7ff13c150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.969+0000 7ff140b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff13c157770 0x7ff13c150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54302/0 (socket says 172.21.15.154:54302) 2023-10-10T22:18:15.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.969+0000 7ff140b9b700 1 -- 172.21.15.154:0/298337327 learned_addr learned my addr 172.21.15.154:0/298337327 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:15.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.970+0000 7ff140b9b700 1 -- 172.21.15.154:0/298337327 >> v1:172.21.15.179:6789/0 conn(0x7ff13c0c7150 legacy=0x7ff13c06ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.970+0000 7ff140b9b700 1 -- 172.21.15.154:0/298337327 >> v1:172.21.15.154:6789/0 conn(0x7ff13c0c6d00 legacy=0x7ff13c06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.970+0000 7ff140b9b700 1 -- 172.21.15.154:0/298337327 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0c78e0 con 0x7ff13c157770 2023-10-10T22:18:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.970+0000 7ff140b9b700 1 --2- 172.21.15.154:0/298337327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c157770 0x7ff13c150180 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7ff1300099b0 tx=0x7ff130009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996a2121a7a462bd server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.970+0000 7ff13b7fe700 1 -- 172.21.15.154:0/298337327 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13000b860 con 0x7ff13c157770 2023-10-10T22:18:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.970+0000 7ff13b7fe700 1 -- 172.21.15.154:0/298337327 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13000b9c0 con 0x7ff13c157770 2023-10-10T22:18:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.970+0000 7ff13b7fe700 1 -- 172.21.15.154:0/298337327 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13000bd60 con 0x7ff13c157770 2023-10-10T22:18:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.971+0000 7ff141b9d700 1 -- 172.21.15.154:0/298337327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c157770 msgr2=0x7ff13c150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.971+0000 7ff141b9d700 1 --2- 172.21.15.154:0/298337327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c157770 0x7ff13c150180 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7ff1300099b0 tx=0x7ff130009250 comp rx=0 tx=0).stop 2023-10-10T22:18:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.971+0000 7ff141b9d700 1 -- 172.21.15.154:0/298337327 shutdown_connections 2023-10-10T22:18:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.971+0000 7ff141b9d700 1 --2- 172.21.15.154:0/298337327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c157770 0x7ff13c150180 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.971+0000 7ff141b9d700 1 -- 172.21.15.154:0/298337327 >> 172.21.15.154:0/298337327 conn(0x7ff13c0cc1f0 msgr2=0x7ff13c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.971+0000 7ff141b9d700 1 -- 172.21.15.154:0/298337327 shutdown_connections 2023-10-10T22:18:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.971+0000 7ff141b9d700 1 -- 172.21.15.154:0/298337327 wait complete. 2023-10-10T22:18:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.973+0000 7ff141b9d700 1 Processor -- start 2023-10-10T22:18:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.974+0000 7ff141b9d700 1 -- start start 2023-10-10T22:18:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.974+0000 7ff141b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff13c0c6d00 0x7ff13c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.974+0000 7ff141b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c0c7150 0x7ff13c14b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.974+0000 7ff141b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13c157770 0x7ff13c0c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.974+0000 7ff141b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0b0a10 con 0x7ff13c0c7150 2023-10-10T22:18:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.974+0000 7ff141b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0b0c80 con 0x7ff13c157770 2023-10-10T22:18:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.974+0000 7ff141b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0b0f60 con 0x7ff13c0c6d00 2023-10-10T22:18:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff13bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c0c7150 0x7ff13c14b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff13bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c0c7150 0x7ff13c14b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54308/0 (socket says 172.21.15.154:54308) 2023-10-10T22:18:15.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff13bfff700 1 -- 172.21.15.154:0/2866965123 learned_addr learned my addr 172.21.15.154:0/2866965123 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:15.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff140b9b700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff13c0c6d00 0x7ff13c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff14139c700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13c157770 0x7ff13c0c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff13bfff700 1 -- 172.21.15.154:0/2866965123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff13c0c6d00 msgr2=0x7ff13c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff13bfff700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff13c0c6d00 0x7ff13c14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff13bfff700 1 -- 172.21.15.154:0/2866965123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13c157770 msgr2=0x7ff13c0c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff13bfff700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13c157770 0x7ff13c0c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff13bfff700 1 -- 172.21.15.154:0/2866965123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1300094f0 con 0x7ff13c0c7150 2023-10-10T22:18:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.975+0000 7ff13bfff700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c0c7150 0x7ff13c14b780 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c4e0 tx=0x7ff12800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.976+0000 7ff138ff9700 1 -- 172.21.15.154:0/2866965123 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128011590 con 0x7ff13c0c7150 2023-10-10T22:18:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.976+0000 7ff138ff9700 1 -- 172.21.15.154:0/2866965123 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff128011710 con 0x7ff13c0c7150 2023-10-10T22:18:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.976+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c0b1240 con 0x7ff13c0c7150 2023-10-10T22:18:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.976+0000 7ff138ff9700 1 -- 172.21.15.154:0/2866965123 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128011ad0 con 0x7ff13c0c7150 2023-10-10T22:18:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.976+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c14b3e0 con 0x7ff13c0c7150 2023-10-10T22:18:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.977+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c0b1760 con 0x7ff13c0c7150 2023-10-10T22:18:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.978+0000 7ff138ff9700 1 -- 172.21.15.154:0/2866965123 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff12801b3b0 con 0x7ff13c0c7150 2023-10-10T22:18:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.979+0000 7ff138ff9700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff120066f30 0x7ff1200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.979+0000 7ff138ff9700 1 -- 172.21.15.154:0/2866965123 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ff1280839f0 con 0x7ff13c0c7150 2023-10-10T22:18:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.979+0000 7ff140b9b700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff120066f30 0x7ff1200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.979+0000 7ff140b9b700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff120066f30 0x7ff1200693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff1300099b0 tx=0x7ff130017000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:15.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:15.983+0000 7ff138ff9700 1 -- 172.21.15.154:0/2866965123 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff13c0b1760 con 0x7ff13c0c7150 2023-10-10T22:18:16.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.249+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7ff13c0b1760 con 0x7ff13c0c7150 2023-10-10T22:18:16.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.763+0000 7ff138ff9700 1 -- 172.21.15.154:0/2866965123 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2465) v1 ==== 168+0+0 (secure 0 0 0) 0x7ff13c0b1760 con 0x7ff13c0c7150 2023-10-10T22:18:16.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.765+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff120066f30 msgr2=0x7ff1200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:16.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.765+0000 7ff141b9d700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff120066f30 0x7ff1200693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff1300099b0 tx=0x7ff130017000 comp rx=0 tx=0).stop 2023-10-10T22:18:16.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.765+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c0c7150 msgr2=0x7ff13c14b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:16.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.765+0000 7ff141b9d700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c0c7150 0x7ff13c14b780 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c4e0 tx=0x7ff12800c7f0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.766+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 shutdown_connections 2023-10-10T22:18:16.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.766+0000 7ff141b9d700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13c157770 0x7ff13c0c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.766+0000 7ff141b9d700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff13c0c6d00 0x7ff13c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.766+0000 7ff141b9d700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff120066f30 0x7ff1200693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.766+0000 7ff141b9d700 1 --2- 172.21.15.154:0/2866965123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff13c0c7150 0x7ff13c14b780 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.766+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 >> 172.21.15.154:0/2866965123 conn(0x7ff13c0cc1f0 msgr2=0x7ff13c0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:16.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.766+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 shutdown_connections 2023-10-10T22:18:16.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.766+0000 7ff141b9d700 1 -- 172.21.15.154:0/2866965123 wait complete. 2023-10-10T22:18:16.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T22:18:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.969+0000 7f41501ff700 1 Processor -- start 2023-10-10T22:18:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.969+0000 7f41501ff700 1 -- start start 2023-10-10T22:18:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f41501ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148155eb0 0x7f414806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:16.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f41501ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41480c70b0 0x7f4148069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:16.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f41501ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414806eb90 con 0x7f4148069cb0 2023-10-10T22:18:16.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f41501ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414806a130 con 0x7f41480c70b0 2023-10-10T22:18:16.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f41501ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41480cd350 con 0x7f4148155eb0 2023-10-10T22:18:16.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414e79c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4148069cb0 0x7f41480ccc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42686/0 (socket says 172.21.15.154:42686) 2023-10-10T22:18:16.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414e79c700 1 -- 172.21.15.154:0/1006136036 learned_addr learned my addr 172.21.15.154:0/1006136036 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:16.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414d79a700 1 --2- 172.21.15.154:0/1006136036 >> v2:172.21.15.179:3300/0 conn(0x7f41480c70b0 0x7f4148069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:16.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414df9b700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148155eb0 0x7f414806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:16.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362135142 0 0) 0x7f414806eb90 con 0x7f4148069cb0 2023-10-10T22:18:16.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4134005780 con 0x7f4148069cb0 2023-10-10T22:18:16.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1978123404 0 0) 0x7f4134005780 con 0x7f4148069cb0 2023-10-10T22:18:16.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148155eb0 msgr2=0x7f414806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:16.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148155eb0 0x7f414806e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 >> v2:172.21.15.179:3300/0 conn(0x7f41480c70b0 msgr2=0x7f4148069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 --2- 172.21.15.154:0/1006136036 >> v2:172.21.15.179:3300/0 conn(0x7f41480c70b0 0x7f4148069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414806ee70 con 0x7f4148069cb0 2023-10-10T22:18:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f41400017f0 con 0x7f4148069cb0 2023-10-10T22:18:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414d79a700 1 --2- 172.21.15.154:0/1006136036 >> v2:172.21.15.179:3300/0 conn(0x7f41480c70b0 0x7f4148069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414df9b700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148155eb0 0x7f414806e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 >> v1:172.21.15.154:6789/0 conn(0x7f4148069cb0 legacy=0x7f41480ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148155eb0 0x7f4134005ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41340061e0 0x7f4134006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41340073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414806a130 con 0x7f4134006f60 2023-10-10T22:18:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480cd350 con 0x7f41340061e0 2023-10-10T22:18:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413400dca0 con 0x7f4148155eb0 2023-10-10T22:18:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414e79c700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41340073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414d79a700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41340061e0 0x7f4134006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.972+0000 7f414df9b700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148155eb0 0x7f4134005ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414e79c700 1 -- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148155eb0 msgr2=0x7f4134005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414e79c700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148155eb0 0x7f4134005ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414e79c700 1 -- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41340061e0 msgr2=0x7f4134006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414e79c700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41340061e0 0x7f4134006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414e79c700 1 -- 172.21.15.154:0/1006136036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4144009420 con 0x7f4134006f60 2023-10-10T22:18:16.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414e79c700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41340073d0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f414000a930 tx=0x7f41400021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e6619afa8c357f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:16.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400070d0 con 0x7f4134006f60 2023-10-10T22:18:16.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140007230 con 0x7f4134006f60 2023-10-10T22:18:16.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414cf99700 1 -- 172.21.15.154:0/1006136036 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400075d0 con 0x7f4134006f60 2023-10-10T22:18:16.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f41501ff700 1 -- 172.21.15.154:0/1006136036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 msgr2=0x7f41340073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:16.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f41501ff700 1 --2- 172.21.15.154:0/1006136036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41340073d0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f414000a930 tx=0x7f41400021d0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.973+0000 7f414e79c700 1 -- 172.21.15.154:0/1006136036 reap_dead start 2023-10-10T22:18:16.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.974+0000 7f41501ff700 1 -- 172.21.15.154:0/1006136036 shutdown_connections 2023-10-10T22:18:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.974+0000 7f41501ff700 1 -- 172.21.15.154:0/1006136036 >> 172.21.15.154:0/1006136036 conn(0x7f4148068e10 msgr2=0x7f41480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.974+0000 7f41501ff700 1 -- 172.21.15.154:0/1006136036 shutdown_connections 2023-10-10T22:18:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.974+0000 7f41501ff700 1 -- 172.21.15.154:0/1006136036 wait complete. 2023-10-10T22:18:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.975+0000 7f41501ff700 1 Processor -- start 2023-10-10T22:18:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.975+0000 7f41501ff700 1 -- start start 2023-10-10T22:18:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f41501ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41480ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f41501ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148145f80 0x7f41480b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f41501ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41480b1820 0x7f41480c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f41501ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480b1cc0 con 0x7f4134006f60 2023-10-10T22:18:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f41501ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4148152b50 con 0x7f41480b1820 2023-10-10T22:18:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f41501ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41480abb20 con 0x7f4148145f80 2023-10-10T22:18:16.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f414df9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41480ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:16.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f414df9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41480ac850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54314/0 (socket says 172.21.15.154:54314) 2023-10-10T22:18:16.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f414df9b700 1 -- 172.21.15.154:0/734772282 learned_addr learned my addr 172.21.15.154:0/734772282 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:16.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f414d79a700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148145f80 0x7f41480b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:16.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.976+0000 7f414e79c700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41480b1820 0x7f41480c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:16.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f414df9b700 1 -- 172.21.15.154:0/734772282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148145f80 msgr2=0x7f41480b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:16.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f414df9b700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148145f80 0x7f41480b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f414df9b700 1 -- 172.21.15.154:0/734772282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41480b1820 msgr2=0x7f41480c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:16.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f414df9b700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41480b1820 0x7f41480c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:16.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f414df9b700 1 -- 172.21.15.154:0/734772282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480ac3c0 con 0x7f4134006f60 2023-10-10T22:18:16.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f414df9b700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41480ac850 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f4144011d70 tx=0x7f41440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:16.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f413dffb700 1 -- 172.21.15.154:0/734772282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144011e70 con 0x7f4134006f60 2023-10-10T22:18:16.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f413dffb700 1 -- 172.21.15.154:0/734772282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414400fc20 con 0x7f4134006f60 2023-10-10T22:18:16.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f413dffb700 1 -- 172.21.15.154:0/734772282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414401d480 con 0x7f4134006f60 2023-10-10T22:18:16.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41480c5200 con 0x7f4134006f60 2023-10-10T22:18:16.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.977+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41480ac050 con 0x7f4134006f60 2023-10-10T22:18:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.978+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414804c3c0 con 0x7f4134006f60 2023-10-10T22:18:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.979+0000 7f413dffb700 1 -- 172.21.15.154:0/734772282 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f414401d830 con 0x7f4134006f60 2023-10-10T22:18:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.980+0000 7f413dffb700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f412c066fb0 0x7f412c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.980+0000 7f413dffb700 1 -- 172.21.15.154:0/734772282 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f4144018070 con 0x7f4134006f60 2023-10-10T22:18:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.980+0000 7f414d79a700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f412c066fb0 0x7f412c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:17.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.981+0000 7f414d79a700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f412c066fb0 0x7f412c069460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f41480c23c0 tx=0x7f41380091a0 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:17.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:16.985+0000 7f413dffb700 1 -- 172.21.15.154:0/734772282 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41440525e0 con 0x7f4134006f60 2023-10-10T22:18:17.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.175+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f414806f150 con 0x7f4134006f60 2023-10-10T22:18:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.180+0000 7f413dffb700 1 -- 172.21.15.154:0/734772282 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4144055c00 con 0x7f4134006f60 2023-10-10T22:18:17.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f412c066fb0 msgr2=0x7f412c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:17.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f412c066fb0 0x7f412c069460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f41480c23c0 tx=0x7f41380091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 msgr2=0x7f41480ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:17.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41480ac850 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f4144011d70 tx=0x7f41440091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 shutdown_connections 2023-10-10T22:18:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41480b1820 0x7f41480c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f412c066fb0 0x7f412c069460 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4134006f60 0x7f41480ac850 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 --2- 172.21.15.154:0/734772282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4148145f80 0x7f41480b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 >> 172.21.15.154:0/734772282 conn(0x7f4148068e10 msgr2=0x7f41480c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:17.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 shutdown_connections 2023-10-10T22:18:17.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.183+0000 7f41501ff700 1 -- 172.21.15.154:0/734772282 wait complete. 2023-10-10T22:18:17.203 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T22:18:17.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:18:17.283 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:18:17.364 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T22:18:17.365 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T22:18:17.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:18:17.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.548+0000 7f844d9ff700 1 Processor -- start 2023-10-10T22:18:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.548+0000 7f844d9ff700 1 -- start start 2023-10-10T22:18:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.549+0000 7f844d9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f84480cbf30 0x7f84480ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.549+0000 7f844d9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84480cc300 con 0x7f84480b1420 2023-10-10T22:18:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.549+0000 7f844d9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84480ad370 con 0x7f84480ccf90 2023-10-10T22:18:17.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.549+0000 7f844d9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8448156bf0 con 0x7f84480cbf30 2023-10-10T22:18:17.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f84477fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f84480b1420 0x7f84480c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42702/0 (socket says 172.21.15.154:42702) 2023-10-10T22:18:17.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f84477fe700 1 -- 172.21.15.154:0/3692593222 learned_addr learned my addr 172.21.15.154:0/3692593222 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101478521 0 0) 0x7f84480cc300 con 0x7f84480b1420 2023-10-10T22:18:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8430003570 con 0x7f84480b1420 2023-10-10T22:18:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8446ffd700 1 --2- 172.21.15.154:0/3692593222 >> v2:172.21.15.179:3300/0 conn(0x7f84480cbf30 0x7f84480ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032569311 0 0) 0x7f8430003570 con 0x7f84480b1420 2023-10-10T22:18:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 >> v2:172.21.15.179:3300/0 conn(0x7f84480cbf30 msgr2=0x7f84480ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 --2- 172.21.15.154:0/3692593222 >> v2:172.21.15.179:3300/0 conn(0x7f84480cbf30 0x7f84480ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 >> v1:172.21.15.179:6789/0 conn(0x7f84480ccf90 legacy=0x7f84480b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84480ad650 con 0x7f84480b1420 2023-10-10T22:18:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f84400017f0 con 0x7f84480b1420 2023-10-10T22:18:17.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8446ffd700 1 --2- 172.21.15.154:0/3692593222 >> v2:172.21.15.179:3300/0 conn(0x7f84480cbf30 0x7f84480ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:17.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 >> v1:172.21.15.154:6789/0 conn(0x7f84480b1420 legacy=0x7f84480c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:17.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.550+0000 7f8445ffb700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8430003a60 0x7f8430003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:17.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f8445ffb700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8430004810 0x7f8430004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:17.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f8445ffb700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84300052e0 0x7f843000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:17.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8448156bf0 con 0x7f8430004810 2023-10-10T22:18:17.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843000c190 con 0x7f84300052e0 2023-10-10T22:18:17.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843000c350 con 0x7f8430003a60 2023-10-10T22:18:17.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f84467fc700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8430004810 0x7f8430004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:17.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f84477fe700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84300052e0 0x7f843000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:17.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f8446ffd700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8430003a60 0x7f8430003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:17.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f84467fc700 1 -- 172.21.15.154:0/3692593222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8430003a60 msgr2=0x7f8430003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:17.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f84467fc700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8430003a60 0x7f8430003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f84467fc700 1 -- 172.21.15.154:0/3692593222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84300052e0 msgr2=0x7f843000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:17.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f84467fc700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84300052e0 0x7f843000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f84477fe700 1 -- 172.21.15.154:0/3692593222 reap_dead start 2023-10-10T22:18:17.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.551+0000 7f84467fc700 1 -- 172.21.15.154:0/3692593222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430003570 con 0x7f8430004810 2023-10-10T22:18:17.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f84467fc700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8430004810 0x7f8430004c80 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f843c0018b0 tx=0x7f843c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a4d7db261d79e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:17.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c012420 con 0x7f8430004810 2023-10-10T22:18:17.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c0125a0 con 0x7f8430004810 2023-10-10T22:18:17.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f8445ffb700 1 -- 172.21.15.154:0/3692593222 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c012960 con 0x7f8430004810 2023-10-10T22:18:17.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f844d9ff700 1 -- 172.21.15.154:0/3692593222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8430004810 msgr2=0x7f8430004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:17.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f844d9ff700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8430004810 0x7f8430004c80 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f843c0018b0 tx=0x7f843c007d30 comp rx=0 tx=0).stop 2023-10-10T22:18:17.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f844d9ff700 1 -- 172.21.15.154:0/3692593222 shutdown_connections 2023-10-10T22:18:17.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f844d9ff700 1 --2- 172.21.15.154:0/3692593222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8430004810 0x7f8430004c80 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f844d9ff700 1 -- 172.21.15.154:0/3692593222 >> 172.21.15.154:0/3692593222 conn(0x7f844806a320 msgr2=0x7f84480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f844d9ff700 1 -- 172.21.15.154:0/3692593222 shutdown_connections 2023-10-10T22:18:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.552+0000 7f844d9ff700 1 -- 172.21.15.154:0/3692593222 wait complete. 2023-10-10T22:18:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.554+0000 7f844d9ff700 1 Processor -- start 2023-10-10T22:18:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.554+0000 7f844d9ff700 1 -- start start 2023-10-10T22:18:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f844d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8430004810 0x7f8448155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f844d9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8448157800 0x7f84480c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f844d9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84480c9f90 0x7f84480ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f844d9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84480c5a20 con 0x7f8448157800 2023-10-10T22:18:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f844d9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84480ca970 con 0x7f84480c9f90 2023-10-10T22:18:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f844d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84480c8680 con 0x7f8430004810 2023-10-10T22:18:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f84467fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8448157800 0x7f84480c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:17.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f84467fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8448157800 0x7f84480c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54332/0 (socket says 172.21.15.154:54332) 2023-10-10T22:18:17.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f84467fc700 1 -- 172.21.15.154:0/4102608656 learned_addr learned my addr 172.21.15.154:0/4102608656 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:17.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f84477fe700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84480c9f90 0x7f84480ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:17.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f8446ffd700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8430004810 0x7f8448155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:17.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f84467fc700 1 -- 172.21.15.154:0/4102608656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8430004810 msgr2=0x7f8448155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f84467fc700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8430004810 0x7f8448155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f84467fc700 1 -- 172.21.15.154:0/4102608656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84480c9f90 msgr2=0x7f84480ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.555+0000 7f84467fc700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84480c9f90 0x7f84480ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.556+0000 7f84467fc700 1 -- 172.21.15.154:0/4102608656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448158190 con 0x7f8448157800 2023-10-10T22:18:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.556+0000 7f84467fc700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8448157800 0x7f84480c60a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c3f0 tx=0x7f843c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.556+0000 7f842effd700 1 -- 172.21.15.154:0/4102608656 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c001200 con 0x7f8448157800 2023-10-10T22:18:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.556+0000 7f842effd700 1 -- 172.21.15.154:0/4102608656 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c012cd0 con 0x7f8448157800 2023-10-10T22:18:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.556+0000 7f842effd700 1 -- 172.21.15.154:0/4102608656 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c012940 con 0x7f8448157800 2023-10-10T22:18:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.556+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8448157c90 con 0x7f8448157800 2023-10-10T22:18:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.556+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84480c8bb0 con 0x7f8448157800 2023-10-10T22:18:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.557+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8448158320 con 0x7f8448157800 2023-10-10T22:18:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.558+0000 7f842effd700 1 -- 172.21.15.154:0/4102608656 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f843c01f620 con 0x7f8448157800 2023-10-10T22:18:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.560+0000 7f842effd700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8434066f30 0x7f84340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.560+0000 7f842effd700 1 -- 172.21.15.154:0/4102608656 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f843c086090 con 0x7f8448157800 2023-10-10T22:18:17.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.560+0000 7f8446ffd700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8434066f30 0x7f84340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:17.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.561+0000 7f8446ffd700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8434066f30 0x7f84340693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8448061160 tx=0x7f8438008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:17.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.564+0000 7f842effd700 1 -- 172.21.15.154:0/4102608656 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f843c053160 con 0x7f8448157800 2023-10-10T22:18:17.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.801+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f844804c3c0 con 0x7f8448157800 2023-10-10T22:18:17.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.801+0000 7f842effd700 1 -- 172.21.15.154:0/4102608656 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f843c023090 con 0x7f8448157800 2023-10-10T22:18:17.803 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:17.804 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7196,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3891554759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3891554759},{"type":"v1","addr":"172.21.15.179:6834","nonce":3891554759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8158,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1858498414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1858498414},{"type":"v1","addr":"172.21.15.154:6835","nonce":1858498414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8161,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3531287783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3531287783},{"type":"v1","addr":"172.21.15.179:6835","nonce":3531287783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/2644021917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2644021917},{"type":"v1","addr":"172.21.15.154:6834","nonce":2644021917}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[]} 2023-10-10T22:18:17.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8434066f30 msgr2=0x7f84340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:17.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8434066f30 0x7f84340693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8448061160 tx=0x7f8438008040 comp rx=0 tx=0).stop 2023-10-10T22:18:17.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8448157800 msgr2=0x7f84480c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:17.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8448157800 0x7f84480c60a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c3f0 tx=0x7f843c015000 comp rx=0 tx=0).stop 2023-10-10T22:18:17.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 shutdown_connections 2023-10-10T22:18:17.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84480c9f90 0x7f84480ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8430004810 0x7f8448155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8434066f30 0x7f84340693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 --2- 172.21.15.154:0/4102608656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8448157800 0x7f84480c60a0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:17.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 >> 172.21.15.154:0/4102608656 conn(0x7f844806a320 msgr2=0x7f8448068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:17.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 shutdown_connections 2023-10-10T22:18:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:17.804+0000 7f844d9ff700 1 -- 172.21.15.154:0/4102608656 wait complete. 2023-10-10T22:18:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 72 2023-10-10T22:18:17.823 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T22:18:17.824 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T22:18:17.824 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T22:18:17.824 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:18:17.825 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T22:18:17.825 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T22:18:17.825 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T22:18:17.825 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:18:17.826 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T22:18:17.826 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T22:18:17.826 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T22:18:17.827 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:18:17.827 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T22:18:17.827 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T22:18:17.827 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T22:18:17.828 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:18:17.838 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T22:18:17.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T22:18:17.839 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T22:18:17.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T22:18:17.844 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T22:18:17.844 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T22:18:17.845 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T22:18:17.846 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T22:18:17.883 INFO:tasks.ceph.mds.a:Started 2023-10-10T22:18:17.884 DEBUG:teuthology.parallel:result is None 2023-10-10T22:18:17.886 INFO:tasks.ceph.mds.c:Started 2023-10-10T22:18:17.886 DEBUG:teuthology.parallel:result is None 2023-10-10T22:18:17.889 INFO:tasks.ceph.mds.b:Started 2023-10-10T22:18:17.889 DEBUG:teuthology.parallel:result is None 2023-10-10T22:18:17.892 INFO:tasks.ceph.mds.d:Started 2023-10-10T22:18:17.892 DEBUG:teuthology.parallel:result is None 2023-10-10T22:18:17.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T22:18:18.019 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T22:18:18.019 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T22:18:18.030 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T22:18:18.030 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T22:18:18.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-10T22:18:18.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-10T22:18:18.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-10T22:18:18.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.086+0000 7f3a4a1ff700 1 Processor -- start 2023-10-10T22:18:18.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.086+0000 7f3a4a1ff700 1 -- start start 2023-10-10T22:18:18.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.087+0000 7f3a4a1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a440cbf30 0x7f3a440ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:18.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.087+0000 7f3a4a1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a440cc300 con 0x7f3a440b1420 2023-10-10T22:18:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.087+0000 7f3a4a1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a440ad370 con 0x7f3a440ccf90 2023-10-10T22:18:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.087+0000 7f3a4a1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a44156bf0 con 0x7f3a440cbf30 2023-10-10T22:18:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.088+0000 7f3a437fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a440cbf30 0x7f3a440ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.088+0000 7f3a43fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3a440b1420 0x7f3a440c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42714/0 (socket says 172.21.15.154:42714) 2023-10-10T22:18:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.088+0000 7f3a43fff700 1 -- 172.21.15.154:0/2542506761 learned_addr learned my addr 172.21.15.154:0/2542506761 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.088+0000 7f3a427fc700 1 -- 172.21.15.154:0/2542506761 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019146710 0 0) 0x7f3a440cc300 con 0x7f3a440b1420 2023-10-10T22:18:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.088+0000 7f3a427fc700 1 -- 172.21.15.154:0/2542506761 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a2c003570 con 0x7f3a440b1420 2023-10-10T22:18:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.088+0000 7f3a437fe700 1 -- 172.21.15.154:0/2542506761 >> v1:172.21.15.179:6789/0 conn(0x7f3a440ccf90 legacy=0x7f3a440b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.088+0000 7f3a437fe700 1 -- 172.21.15.154:0/2542506761 >> v1:172.21.15.154:6789/0 conn(0x7f3a440b1420 legacy=0x7f3a440c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.088+0000 7f3a437fe700 1 -- 172.21.15.154:0/2542506761 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440ad650 con 0x7f3a440cbf30 2023-10-10T22:18:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.089+0000 7f3a437fe700 1 --2- 172.21.15.154:0/2542506761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440cbf30 0x7f3a440ae410 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f3a340098e0 tx=0x7f3a340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20798b2c155a6354 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.089+0000 7f3a427fc700 1 -- 172.21.15.154:0/2542506761 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400f6b0 con 0x7f3a440cbf30 2023-10-10T22:18:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.089+0000 7f3a427fc700 1 -- 172.21.15.154:0/2542506761 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3400f810 con 0x7f3a440cbf30 2023-10-10T22:18:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.089+0000 7f3a427fc700 1 -- 172.21.15.154:0/2542506761 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400fbb0 con 0x7f3a440cbf30 2023-10-10T22:18:18.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.089+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/2542506761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440cbf30 msgr2=0x7f3a440ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:18.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.089+0000 7f3a4a1ff700 1 --2- 172.21.15.154:0/2542506761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440cbf30 0x7f3a440ae410 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f3a340098e0 tx=0x7f3a340091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:18.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.089+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/2542506761 shutdown_connections 2023-10-10T22:18:18.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.089+0000 7f3a4a1ff700 1 --2- 172.21.15.154:0/2542506761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440cbf30 0x7f3a440ae410 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:18.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.089+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/2542506761 >> 172.21.15.154:0/2542506761 conn(0x7f3a4406a320 msgr2=0x7f3a440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:18.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.090+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/2542506761 shutdown_connections 2023-10-10T22:18:18.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.090+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/2542506761 wait complete. 2023-10-10T22:18:18.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.091+0000 7f3a4a1ff700 1 Processor -- start 2023-10-10T22:18:18.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.091+0000 7f3a4a1ff700 1 -- start start 2023-10-10T22:18:18.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a4a1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440b1420 0x7f3a440c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:18.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a4a1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a440cbf30 0x7f3a44149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:18.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a4a1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a440ccf90 0x7f3a44155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:18.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a4a1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440c2210 con 0x7f3a440b1420 2023-10-10T22:18:18.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a4a1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440c24f0 con 0x7f3a440cbf30 2023-10-10T22:18:18.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a4a1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440c27d0 con 0x7f3a440ccf90 2023-10-10T22:18:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440b1420 0x7f3a440c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440b1420 0x7f3a440c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54386/0 (socket says 172.21.15.154:54386) 2023-10-10T22:18:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a437fe700 1 -- 172.21.15.154:0/3071678416 learned_addr learned my addr 172.21.15.154:0/3071678416 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a43fff700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a440ccf90 0x7f3a44155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.092+0000 7f3a42ffd700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a440cbf30 0x7f3a44149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a437fe700 1 -- 172.21.15.154:0/3071678416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a440ccf90 msgr2=0x7f3a44155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a437fe700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a440ccf90 0x7f3a44155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a437fe700 1 -- 172.21.15.154:0/3071678416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a440cbf30 msgr2=0x7f3a44149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a437fe700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a440cbf30 0x7f3a44149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a437fe700 1 -- 172.21.15.154:0/3071678416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34009420 con 0x7f3a440b1420 2023-10-10T22:18:18.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a437fe700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440b1420 0x7f3a440c3c50 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f3a340093f0 tx=0x7f3a34019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:18.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a2b7fe700 1 -- 172.21.15.154:0/3071678416 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400f980 con 0x7f3a440b1420 2023-10-10T22:18:18.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a2b7fe700 1 -- 172.21.15.154:0/3071678416 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3400fae0 con 0x7f3a440b1420 2023-10-10T22:18:18.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a2b7fe700 1 -- 172.21.15.154:0/3071678416 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340106c0 con 0x7f3a440b1420 2023-10-10T22:18:18.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.093+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a440c2ab0 con 0x7f3a440b1420 2023-10-10T22:18:18.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.094+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a440c4190 con 0x7f3a440b1420 2023-10-10T22:18:18.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.094+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a440c2fd0 con 0x7f3a440b1420 2023-10-10T22:18:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.095+0000 7f3a2b7fe700 1 -- 172.21.15.154:0/3071678416 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a340183e0 con 0x7f3a440b1420 2023-10-10T22:18:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.097+0000 7f3a2b7fe700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f3a30066f30 0x7f3a300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.097+0000 7f3a2b7fe700 1 -- 172.21.15.154:0/3071678416 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3a34014070 con 0x7f3a440b1420 2023-10-10T22:18:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.097+0000 7f3a42ffd700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f3a30066f30 0x7f3a300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.097+0000 7f3a42ffd700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f3a30066f30 0x7f3a300693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3a440ac480 tx=0x7f3a38007ec0 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.101+0000 7f3a2b7fe700 1 -- 172.21.15.154:0/3071678416 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a440c2fd0 con 0x7f3a440b1420 2023-10-10T22:18:18.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:18.314+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3a440c2fd0 con 0x7f3a440b1420 2023-10-10T22:18:19.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.203+0000 7f3a2b7fe700 1 -- 172.21.15.154:0/3071678416 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v171) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3a440c2fd0 con 0x7f3a440b1420 2023-10-10T22:18:19.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f3a30066f30 msgr2=0x7f3a300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f3a30066f30 0x7f3a300693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3a440ac480 tx=0x7f3a38007ec0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440b1420 msgr2=0x7f3a440c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440b1420 0x7f3a440c3c50 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f3a340093f0 tx=0x7f3a34019000 comp rx=0 tx=0).stop 2023-10-10T22:18:19.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 shutdown_connections 2023-10-10T22:18:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a440ccf90 0x7f3a44155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f3a30066f30 0x7f3a300693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a440b1420 0x7f3a440c3c50 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 --2- 172.21.15.154:0/3071678416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a440cbf30 0x7f3a44149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 >> 172.21.15.154:0/3071678416 conn(0x7f3a4406a320 msgr2=0x7f3a440c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:19.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 shutdown_connections 2023-10-10T22:18:19.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.206+0000 7f3a4a1ff700 1 -- 172.21.15.154:0/3071678416 wait complete. 2023-10-10T22:18:19.210 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T22:18:19.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T22:18:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.413+0000 7fd34e5ff700 1 Processor -- start 2023-10-10T22:18:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.413+0000 7fd34e5ff700 1 -- start start 2023-10-10T22:18:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.414+0000 7fd34e5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3480b0a10 0x7fd348155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.414+0000 7fd34e5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3480ad930 con 0x7fd3481578b0 2023-10-10T22:18:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.414+0000 7fd34e5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3480acd20 con 0x7fd348155c10 2023-10-10T22:18:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.414+0000 7fd34e5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480ad000 con 0x7fd3480b0a10 2023-10-10T22:18:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.415+0000 7fd34cb9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3480b0a10 0x7fd348155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.415+0000 7fd34cb9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3480b0a10 0x7fd348155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54396/0 (socket says 172.21.15.154:54396) 2023-10-10T22:18:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.415+0000 7fd34cb9c700 1 -- 172.21.15.154:0/1630536922 learned_addr learned my addr 172.21.15.154:0/1630536922 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.415+0000 7fd3477fe700 1 --1- 172.21.15.154:0/1630536922 >> v1:172.21.15.154:6789/0 conn(0x7fd3481578b0 0x7fd3480af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42726/0 (socket says 172.21.15.154:42726) 2023-10-10T22:18:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.415+0000 7fd34cb9c700 1 -- 172.21.15.154:0/1630536922 >> v1:172.21.15.179:6789/0 conn(0x7fd348155c10 legacy=0x7fd3480ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.415+0000 7fd34cb9c700 1 -- 172.21.15.154:0/1630536922 >> v1:172.21.15.154:6789/0 conn(0x7fd3481578b0 legacy=0x7fd3480af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.415+0000 7fd34cb9c700 1 -- 172.21.15.154:0/1630536922 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480ad2e0 con 0x7fd3480b0a10 2023-10-10T22:18:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.415+0000 7fd346ffd700 1 -- 172.21.15.154:0/1630536922 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119526184 0 0) 0x7fd3480ad930 con 0x7fd3481578b0 2023-10-10T22:18:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.415+0000 7fd34cb9c700 1 --2- 172.21.15.154:0/1630536922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 0x7fd348155fe0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd340009f20 tx=0x7fd340009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a49665888bc9c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd346ffd700 1 -- 172.21.15.154:0/1630536922 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34000e070 con 0x7fd3480b0a10 2023-10-10T22:18:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd346ffd700 1 -- 172.21.15.154:0/1630536922 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34000ba80 con 0x7fd3480b0a10 2023-10-10T22:18:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd346ffd700 1 -- 172.21.15.154:0/1630536922 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400092e0 con 0x7fd3480b0a10 2023-10-10T22:18:19.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd34e5ff700 1 -- 172.21.15.154:0/1630536922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 msgr2=0x7fd348155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd34e5ff700 1 --2- 172.21.15.154:0/1630536922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 0x7fd348155fe0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd340009f20 tx=0x7fd340009840 comp rx=0 tx=0).stop 2023-10-10T22:18:19.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd34e5ff700 1 -- 172.21.15.154:0/1630536922 shutdown_connections 2023-10-10T22:18:19.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd34e5ff700 1 --2- 172.21.15.154:0/1630536922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 0x7fd348155fe0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd34e5ff700 1 -- 172.21.15.154:0/1630536922 >> 172.21.15.154:0/1630536922 conn(0x7fd34806a320 msgr2=0x7fd3480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:19.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd34e5ff700 1 -- 172.21.15.154:0/1630536922 shutdown_connections 2023-10-10T22:18:19.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.416+0000 7fd34e5ff700 1 -- 172.21.15.154:0/1630536922 wait complete. 2023-10-10T22:18:19.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.418+0000 7fd34e5ff700 1 Processor -- start 2023-10-10T22:18:19.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.418+0000 7fd34e5ff700 1 -- start start 2023-10-10T22:18:19.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd34e5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 0x7fd3481427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd34e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd348155c10 0x7fd3480a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd34e5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3481578b0 0x7fd348159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd34e5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34815ab70 con 0x7fd3480b0a10 2023-10-10T22:18:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd34e5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd348159f60 con 0x7fd3481578b0 2023-10-10T22:18:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd34e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34815a240 con 0x7fd348155c10 2023-10-10T22:18:19.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd347fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 0x7fd3481427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd347fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 0x7fd3481427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54402/0 (socket says 172.21.15.154:54402) 2023-10-10T22:18:19.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd347fff700 1 -- 172.21.15.154:0/3742322130 learned_addr learned my addr 172.21.15.154:0/3742322130 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:19.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd347fff700 1 -- 172.21.15.154:0/3742322130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd348155c10 msgr2=0x7fd3480a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd347fff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd348155c10 0x7fd3480a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd347fff700 1 -- 172.21.15.154:0/3742322130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3481578b0 msgr2=0x7fd348159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd347fff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3481578b0 0x7fd348159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.419+0000 7fd347fff700 1 -- 172.21.15.154:0/3742322130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd340009ae0 con 0x7fd3480b0a10 2023-10-10T22:18:19.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.420+0000 7fd347fff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 0x7fd3481427e0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd33800c590 tx=0x7fd33800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:19.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.420+0000 7fd32ffff700 1 -- 172.21.15.154:0/3742322130 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338011590 con 0x7fd3480b0a10 2023-10-10T22:18:19.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.420+0000 7fd32ffff700 1 -- 172.21.15.154:0/3742322130 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3380116f0 con 0x7fd3480b0a10 2023-10-10T22:18:19.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.420+0000 7fd32ffff700 1 -- 172.21.15.154:0/3742322130 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338011ab0 con 0x7fd3480b0a10 2023-10-10T22:18:19.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.420+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34815a520 con 0x7fd3480b0a10 2023-10-10T22:18:19.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.420+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd348151b90 con 0x7fd3480b0a10 2023-10-10T22:18:19.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.421+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34804c3c0 con 0x7fd3480b0a10 2023-10-10T22:18:19.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.422+0000 7fd32ffff700 1 -- 172.21.15.154:0/3742322130 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd33801b3b0 con 0x7fd3480b0a10 2023-10-10T22:18:19.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.423+0000 7fd32ffff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd334066f30 0x7fd3340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.423+0000 7fd32ffff700 1 -- 172.21.15.154:0/3742322130 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fd338083960 con 0x7fd3480b0a10 2023-10-10T22:18:19.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.423+0000 7fd3477fe700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd334066f30 0x7fd3340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.423+0000 7fd3477fe700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd334066f30 0x7fd3340693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd33c000c00 tx=0x7fd33c007b50 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:19.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.427+0000 7fd32ffff700 1 -- 172.21.15.154:0/3742322130 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd338050d50 con 0x7fd3480b0a10 2023-10-10T22:18:19.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.691+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd3480ad5c0 con 0x7fd3480b0a10 2023-10-10T22:18:19.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.691+0000 7fd32ffff700 1 -- 172.21.15.154:0/3742322130 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v43) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd338017020 con 0x7fd3480b0a10 2023-10-10T22:18:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:19.694 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:18:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T22:18:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T22:18:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T22:18:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:18:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:18:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:18:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T22:18:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T22:18:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:18:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:18:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:18:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T22:18:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T22:18:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:18:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:18:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:18:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T22:18:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T22:18:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:18:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:18:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:18:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T22:18:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T22:18:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:18:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:18:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T22:18:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T22:18:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:18:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:18:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T22:18:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T22:18:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:18:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:18:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T22:18:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T22:18:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:18:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:18:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T22:18:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T22:18:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:18:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:18:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T22:18:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T22:18:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:18:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:18:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T22:18:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T22:18:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:18:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:18:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T22:18:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T22:18:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:18:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:18:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T22:18:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T22:18:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:18:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T22:18:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T22:18:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T22:18:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T22:18:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:18:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:18:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:18:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:18:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T22:18:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T22:18:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:18:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:18:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:18:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:18:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T22:18:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T22:18:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:18:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:18:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:18:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:18:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T22:18:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T22:18:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:18:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:18:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:18:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T22:18:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T22:18:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:18:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T22:18:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:18:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T22:18:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T22:18:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:18:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:18:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T22:18:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:18:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T22:18:19.729 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd334066f30 msgr2=0x7fd3340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd334066f30 0x7fd3340693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd33c000c00 tx=0x7fd33c007b50 comp rx=0 tx=0).stop 2023-10-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 msgr2=0x7fd3481427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 0x7fd3481427e0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd33800c590 tx=0x7fd33800c950 comp rx=0 tx=0).stop 2023-10-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 shutdown_connections 2023-10-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3481578b0 0x7fd348159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fd334066f30 0x7fd3340693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480b0a10 0x7fd3481427e0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 --2- 172.21.15.154:0/3742322130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd348155c10 0x7fd3480a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 >> 172.21.15.154:0/3742322130 conn(0x7fd34806a320 msgr2=0x7fd348153670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 shutdown_connections 2023-10-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.694+0000 7fd34e5ff700 1 -- 172.21.15.154:0/3742322130 wait complete. 2023-10-10T22:18:19.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:18:19.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.913+0000 7f7cef59d700 1 Processor -- start 2023-10-10T22:18:19.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.914+0000 7f7cef59d700 1 -- start start 2023-10-10T22:18:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cef59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ce8150180 0x7f7ce8157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cef59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ce8150550 0x7f7ce80c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cef59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce80c7240 0x7f7ce8069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cef59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce80c76a0 con 0x7f7ce8150180 2023-10-10T22:18:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cef59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce806e2a0 con 0x7f7ce8150550 2023-10-10T22:18:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cef59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce806b2e0 con 0x7f7ce80c7240 2023-10-10T22:18:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cee59b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ce8150180 0x7f7ce8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cee59b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ce8150180 0x7f7ce8157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54414/0 (socket says 172.21.15.154:54414) 2023-10-10T22:18:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cee59b700 1 -- 172.21.15.154:0/2322960077 learned_addr learned my addr 172.21.15.154:0/2322960077 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7ceed9c700 1 --2- 172.21.15.154:0/2322960077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce80c7240 0x7f7ce8069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cedd9a700 1 --2- 172.21.15.154:0/2322960077 >> v2:172.21.15.179:3300/0 conn(0x7f7ce8150550 0x7f7ce80c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cee59b700 1 -- 172.21.15.154:0/2322960077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce80c7240 msgr2=0x7f7ce8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.915+0000 7f7cee59b700 1 --2- 172.21.15.154:0/2322960077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce80c7240 0x7f7ce8069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7cee59b700 1 -- 172.21.15.154:0/2322960077 >> v2:172.21.15.179:3300/0 conn(0x7f7ce8150550 msgr2=0x7f7ce80c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7cee59b700 1 --2- 172.21.15.154:0/2322960077 >> v2:172.21.15.179:3300/0 conn(0x7f7ce8150550 0x7f7ce80c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7cee59b700 1 -- 172.21.15.154:0/2322960077 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce80c78e0 con 0x7f7ce8150180 2023-10-10T22:18:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7cedd9a700 1 --2- 172.21.15.154:0/2322960077 >> v2:172.21.15.179:3300/0 conn(0x7f7ce8150550 0x7f7ce80c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7cee59b700 1 --2- 172.21.15.154:0/2322960077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce8150180 0x7f7ce8157770 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f7ce806d1e0 tx=0x7f7ce4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8911a98dac3ad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7ced599700 1 -- 172.21.15.154:0/2322960077 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400b860 con 0x7f7ce8150180 2023-10-10T22:18:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7ced599700 1 -- 172.21.15.154:0/2322960077 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce400b9c0 con 0x7f7ce8150180 2023-10-10T22:18:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7ced599700 1 -- 172.21.15.154:0/2322960077 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400bd60 con 0x7f7ce8150180 2023-10-10T22:18:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7cef59d700 1 -- 172.21.15.154:0/2322960077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce8150180 msgr2=0x7f7ce8157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.916+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2322960077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce8150180 0x7f7ce8157770 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f7ce806d1e0 tx=0x7f7ce4009250 comp rx=0 tx=0).stop 2023-10-10T22:18:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.917+0000 7f7cef59d700 1 -- 172.21.15.154:0/2322960077 shutdown_connections 2023-10-10T22:18:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.917+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2322960077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce80c7240 0x7f7ce8069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.917+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2322960077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce8150180 0x7f7ce8157770 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.917+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2322960077 >> v2:172.21.15.179:3300/0 conn(0x7f7ce8150550 0x7f7ce80c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.917+0000 7f7cef59d700 1 -- 172.21.15.154:0/2322960077 >> 172.21.15.154:0/2322960077 conn(0x7f7ce80cc1f0 msgr2=0x7f7ce80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.917+0000 7f7cef59d700 1 -- 172.21.15.154:0/2322960077 shutdown_connections 2023-10-10T22:18:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.917+0000 7f7cef59d700 1 -- 172.21.15.154:0/2322960077 wait complete. 2023-10-10T22:18:19.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.918+0000 7f7cef59d700 1 Processor -- start 2023-10-10T22:18:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.918+0000 7f7cef59d700 1 -- start start 2023-10-10T22:18:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.919+0000 7f7cef59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce80c7240 0x7f7ce80ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.919+0000 7f7cef59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ce8150180 0x7f7ce81699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.919+0000 7f7cef59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce8150550 0x7f7ce8147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.919+0000 7f7cef59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce816d2f0 con 0x7f7ce80c7240 2023-10-10T22:18:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.919+0000 7f7cef59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce816d5d0 con 0x7f7ce8150180 2023-10-10T22:18:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.919+0000 7f7cef59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce816d8b0 con 0x7f7ce8150550 2023-10-10T22:18:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cee59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce80c7240 0x7f7ce80ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cee59b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce80c7240 0x7f7ce80ada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54422/0 (socket says 172.21.15.154:54422) 2023-10-10T22:18:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cee59b700 1 -- 172.21.15.154:0/2396861589 learned_addr learned my addr 172.21.15.154:0/2396861589 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:19.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cedd9a700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ce8150180 0x7f7ce81699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7ceed9c700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce8150550 0x7f7ce8147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cee59b700 1 -- 172.21.15.154:0/2396861589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce8150550 msgr2=0x7f7ce8147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cee59b700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce8150550 0x7f7ce8147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cee59b700 1 -- 172.21.15.154:0/2396861589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ce8150180 msgr2=0x7f7ce81699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cee59b700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ce8150180 0x7f7ce81699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cee59b700 1 -- 172.21.15.154:0/2396861589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce40094f0 con 0x7f7ce80c7240 2023-10-10T22:18:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cee59b700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce80c7240 0x7f7ce80ada10 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f7ce806fe40 tx=0x7f7ce4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.920+0000 7f7cde7fc700 1 -- 172.21.15.154:0/2396861589 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4024440 con 0x7f7ce80c7240 2023-10-10T22:18:19.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.921+0000 7f7cde7fc700 1 -- 172.21.15.154:0/2396861589 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce40245a0 con 0x7f7ce80c7240 2023-10-10T22:18:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.921+0000 7f7cde7fc700 1 -- 172.21.15.154:0/2396861589 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4024960 con 0x7f7ce80c7240 2023-10-10T22:18:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.921+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce816db90 con 0x7f7ce80c7240 2023-10-10T22:18:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.921+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce816cf80 con 0x7f7ce80c7240 2023-10-10T22:18:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.922+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce804c3c0 con 0x7f7ce80c7240 2023-10-10T22:18:19.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.922+0000 7f7cde7fc700 1 -- 172.21.15.154:0/2396861589 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ce401a420 con 0x7f7ce80c7240 2023-10-10T22:18:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.923+0000 7f7cde7fc700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7ccc066f30 0x7f7ccc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.923+0000 7f7cde7fc700 1 -- 172.21.15.154:0/2396861589 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f7ce4086200 con 0x7f7ce80c7240 2023-10-10T22:18:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.923+0000 7f7cedd9a700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7ccc066f30 0x7f7ccc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:19.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.924+0000 7f7cedd9a700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7ccc066f30 0x7f7ccc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8006fd0 tx=0x7f7cd8008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:19.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:19.927+0000 7f7cde7fc700 1 -- 172.21.15.154:0/2396861589 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ce4053670 con 0x7f7ce80c7240 2023-10-10T22:18:20.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.121+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ce80c94f0 con 0x7f7ce80c7240 2023-10-10T22:18:20.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.122+0000 7f7cde7fc700 1 -- 172.21.15.154:0/2396861589 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+12903 (secure 0 0 0) 0x7f7ce4056c90 con 0x7f7ce80c7240 2023-10-10T22:18:20.123 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:20.124 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":171,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:18:19.195001+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:18:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7ccc066f30 msgr2=0x7f7ccc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7ccc066f30 0x7f7ccc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8006fd0 tx=0x7f7cd8008040 comp rx=0 tx=0).stop 2023-10-10T22:18:20.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce80c7240 msgr2=0x7f7ce80ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce80c7240 0x7f7ce80ada10 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f7ce806fe40 tx=0x7f7ce4017000 comp rx=0 tx=0).stop 2023-10-10T22:18:20.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 shutdown_connections 2023-10-10T22:18:20.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ce8150550 0x7f7ce8147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7ccc066f30 0x7f7ccc0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ce80c7240 0x7f7ce80ada10 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 --2- 172.21.15.154:0/2396861589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ce8150180 0x7f7ce81699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.124+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 >> 172.21.15.154:0/2396861589 conn(0x7f7ce80cc1f0 msgr2=0x7f7ce8156230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:20.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.125+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 shutdown_connections 2023-10-10T22:18:20.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.125+0000 7f7cef59d700 1 -- 172.21.15.154:0/2396861589 wait complete. 2023-10-10T22:18:20.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T22:18:20.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T22:18:20.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.329+0000 7fb4843ff700 1 Processor -- start 2023-10-10T22:18:20.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.329+0000 7fb4843ff700 1 -- start start 2023-10-10T22:18:20.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.330+0000 7fb4843ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb47c06a9c0 0x7fb47c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.330+0000 7fb4843ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c0ac450 con 0x7fb47c06b160 2023-10-10T22:18:20.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.330+0000 7fb4843ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c069d00 con 0x7fb47c0637d0 2023-10-10T22:18:20.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.330+0000 7fb4843ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c0693d0 con 0x7fb47c06a9c0 2023-10-10T22:18:20.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.330+0000 7fb48219b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb47c06b160 0x7fb47c068cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42734/0 (socket says 172.21.15.154:42734) 2023-10-10T22:18:20.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb48219b700 1 -- 172.21.15.154:0/2666495010 learned_addr learned my addr 172.21.15.154:0/2666495010 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:20.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb48299c700 1 --2- 172.21.15.154:0/2666495010 >> v2:172.21.15.154:3300/0 conn(0x7fb47c06a9c0 0x7fb47c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb481199700 1 -- 172.21.15.154:0/2666495010 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957318925 0 0) 0x7fb47c0ac450 con 0x7fb47c06b160 2023-10-10T22:18:20.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb481199700 1 -- 172.21.15.154:0/2666495010 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb468003570 con 0x7fb47c06b160 2023-10-10T22:18:20.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb48299c700 1 -- 172.21.15.154:0/2666495010 >> v1:172.21.15.179:6789/0 conn(0x7fb47c0637d0 legacy=0x7fb47c06a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb48299c700 1 -- 172.21.15.154:0/2666495010 >> v1:172.21.15.154:6789/0 conn(0x7fb47c06b160 legacy=0x7fb47c068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb48299c700 1 -- 172.21.15.154:0/2666495010 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c068830 con 0x7fb47c06a9c0 2023-10-10T22:18:20.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb48299c700 1 --2- 172.21.15.154:0/2666495010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 0x7fb47c06b530 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fb474009e60 tx=0x7fb474009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1270be3d05f08933 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:20.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb481199700 1 -- 172.21.15.154:0/2666495010 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400e070 con 0x7fb47c06a9c0 2023-10-10T22:18:20.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.331+0000 7fb481199700 1 -- 172.21.15.154:0/2666495010 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47400bb60 con 0x7fb47c06a9c0 2023-10-10T22:18:20.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.332+0000 7fb481199700 1 -- 172.21.15.154:0/2666495010 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474012430 con 0x7fb47c06a9c0 2023-10-10T22:18:20.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.332+0000 7fb4843ff700 1 -- 172.21.15.154:0/2666495010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 msgr2=0x7fb47c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.332+0000 7fb4843ff700 1 --2- 172.21.15.154:0/2666495010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 0x7fb47c06b530 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fb474009e60 tx=0x7fb474009780 comp rx=0 tx=0).stop 2023-10-10T22:18:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.332+0000 7fb4843ff700 1 -- 172.21.15.154:0/2666495010 shutdown_connections 2023-10-10T22:18:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.332+0000 7fb4843ff700 1 --2- 172.21.15.154:0/2666495010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 0x7fb47c06b530 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.332+0000 7fb4843ff700 1 -- 172.21.15.154:0/2666495010 >> 172.21.15.154:0/2666495010 conn(0x7fb47c06ded0 msgr2=0x7fb47c06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.332+0000 7fb4843ff700 1 -- 172.21.15.154:0/2666495010 shutdown_connections 2023-10-10T22:18:20.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.332+0000 7fb4843ff700 1 -- 172.21.15.154:0/2666495010 wait complete. 2023-10-10T22:18:20.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.334+0000 7fb4843ff700 1 Processor -- start 2023-10-10T22:18:20.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.334+0000 7fb4843ff700 1 -- start start 2023-10-10T22:18:20.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.334+0000 7fb4843ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c0637d0 0x7fb47c1475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.334+0000 7fb4843ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 0x7fb47c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb4843ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c06b160 0x7fb47c1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb4843ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0b1bc0 con 0x7fb47c06a9c0 2023-10-10T22:18:20.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb4843ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c159070 con 0x7fb47c06b160 2023-10-10T22:18:20.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb4843ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c159350 con 0x7fb47c0637d0 2023-10-10T22:18:20.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48199a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 0x7fb47c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48199a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 0x7fb47c1584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54430/0 (socket says 172.21.15.154:54430) 2023-10-10T22:18:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48199a700 1 -- 172.21.15.154:0/1827164570 learned_addr learned my addr 172.21.15.154:0/1827164570 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48299c700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c06b160 0x7fb47c1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48219b700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c0637d0 0x7fb47c1475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48199a700 1 -- 172.21.15.154:0/1827164570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c0637d0 msgr2=0x7fb47c1475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48199a700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c0637d0 0x7fb47c1475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48199a700 1 -- 172.21.15.154:0/1827164570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c06b160 msgr2=0x7fb47c1589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48199a700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c06b160 0x7fb47c1589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48199a700 1 -- 172.21.15.154:0/1827164570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474009a20 con 0x7fb47c06a9c0 2023-10-10T22:18:20.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.335+0000 7fb48199a700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 0x7fb47c1584b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c4e0 tx=0x7fb46c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.336+0000 7fb4727fc700 1 -- 172.21.15.154:0/1827164570 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c011590 con 0x7fb47c06a9c0 2023-10-10T22:18:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.336+0000 7fb4727fc700 1 -- 172.21.15.154:0/1827164570 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c011710 con 0x7fb47c06a9c0 2023-10-10T22:18:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.336+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c159630 con 0x7fb47c06a9c0 2023-10-10T22:18:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.336+0000 7fb4727fc700 1 -- 172.21.15.154:0/1827164570 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c011ad0 con 0x7fb47c06a9c0 2023-10-10T22:18:20.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.336+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c159bf0 con 0x7fb47c06a9c0 2023-10-10T22:18:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.337+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47c1697a0 con 0x7fb47c06a9c0 2023-10-10T22:18:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.338+0000 7fb4727fc700 1 -- 172.21.15.154:0/1827164570 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb46c01b3b0 con 0x7fb47c06a9c0 2023-10-10T22:18:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.338+0000 7fb4727fc700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb460066f30 0x7fb4600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.339+0000 7fb4727fc700 1 -- 172.21.15.154:0/1827164570 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fb46c083860 con 0x7fb47c06a9c0 2023-10-10T22:18:20.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.339+0000 7fb48219b700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb460066f30 0x7fb4600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.339+0000 7fb48219b700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb460066f30 0x7fb4600693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0c1bf0 tx=0x7fb478009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:20.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.342+0000 7fb4727fc700 1 -- 172.21.15.154:0/1827164570 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb46c050bb0 con 0x7fb47c06a9c0 2023-10-10T22:18:20.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.533+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb47c04c3c0 con 0x7fb47c06a9c0 2023-10-10T22:18:20.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.533+0000 7fb4727fc700 1 -- 172.21.15.154:0/1827164570 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v171) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb46c017020 con 0x7fb47c06a9c0 2023-10-10T22:18:20.536 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T22:18:20.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb460066f30 msgr2=0x7fb4600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb460066f30 0x7fb4600693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0c1bf0 tx=0x7fb478009040 comp rx=0 tx=0).stop 2023-10-10T22:18:20.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 msgr2=0x7fb47c1584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 0x7fb47c1584b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c4e0 tx=0x7fb46c00c7f0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 shutdown_connections 2023-10-10T22:18:20.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c06b160 0x7fb47c1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c0637d0 0x7fb47c1475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fb460066f30 0x7fb4600693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 --2- 172.21.15.154:0/1827164570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb47c06a9c0 0x7fb47c1584b0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 >> 172.21.15.154:0/1827164570 conn(0x7fb47c06ded0 msgr2=0x7fb47c06e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:20.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 shutdown_connections 2023-10-10T22:18:20.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.536+0000 7fb4843ff700 1 -- 172.21.15.154:0/1827164570 wait complete. 2023-10-10T22:18:20.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T22:18:20.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.737+0000 7f2c59fff700 1 Processor -- start 2023-10-10T22:18:20.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.737+0000 7f2c59fff700 1 -- start start 2023-10-10T22:18:20.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.738+0000 7f2c59fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2c540cbf30 0x7f2c540ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.738+0000 7f2c59fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c540ccf90 0x7f2c540b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.738+0000 7f2c59fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c540cc300 con 0x7f2c5415a270 2023-10-10T22:18:20.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.738+0000 7f2c59fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c54156bf0 con 0x7f2c540cbf30 2023-10-10T22:18:20.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.738+0000 7f2c59fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540ae950 con 0x7f2c540ccf90 2023-10-10T22:18:20.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c52ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c540ccf90 0x7f2c540b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c537fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2c540cbf30 0x7f2c540ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c52ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c540ccf90 0x7f2c540b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:43678/0 (socket says 172.21.15.154:43678) 2023-10-10T22:18:20.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c52ffd700 1 -- 172.21.15.154:0/3880615302 learned_addr learned my addr 172.21.15.154:0/3880615302 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:20.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c53fff700 1 --1- 172.21.15.154:0/3880615302 >> v1:172.21.15.179:6789/0 conn(0x7f2c5415a270 0x7f2c540c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:51282/0 (socket says 172.21.15.154:51282) 2023-10-10T22:18:20.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c537fe700 1 -- 172.21.15.154:0/3880615302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c540ccf90 msgr2=0x7f2c540b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:20.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c537fe700 1 --2- 172.21.15.154:0/3880615302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c540ccf90 0x7f2c540b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c537fe700 1 -- 172.21.15.154:0/3880615302 >> v1:172.21.15.179:6789/0 conn(0x7f2c5415a270 legacy=0x7f2c540c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c537fe700 1 -- 172.21.15.154:0/3880615302 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c540ad370 con 0x7f2c540cbf30 2023-10-10T22:18:20.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.739+0000 7f2c527fc700 1 -- 172.21.15.154:0/3880615302 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852973443 0 0) 0x7f2c540cc300 con 0x7f2c5415a270 2023-10-10T22:18:20.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c537fe700 1 --2- 172.21.15.154:0/3880615302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c540cbf30 0x7f2c540ae410 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009910 tx=0x7f2c440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c03bb256200988 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:20.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c527fc700 1 -- 172.21.15.154:0/3880615302 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400b640 con 0x7f2c540cbf30 2023-10-10T22:18:20.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c527fc700 1 -- 172.21.15.154:0/3880615302 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400b7a0 con 0x7f2c540cbf30 2023-10-10T22:18:20.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c527fc700 1 -- 172.21.15.154:0/3880615302 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400bb60 con 0x7f2c540cbf30 2023-10-10T22:18:20.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c59fff700 1 -- 172.21.15.154:0/3880615302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c540cbf30 msgr2=0x7f2c540ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c59fff700 1 --2- 172.21.15.154:0/3880615302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c540cbf30 0x7f2c540ae410 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009910 tx=0x7f2c440091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c59fff700 1 -- 172.21.15.154:0/3880615302 shutdown_connections 2023-10-10T22:18:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c59fff700 1 --2- 172.21.15.154:0/3880615302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c540cbf30 0x7f2c540ae410 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c59fff700 1 --2- 172.21.15.154:0/3880615302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c540ccf90 0x7f2c540b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.740+0000 7f2c59fff700 1 -- 172.21.15.154:0/3880615302 >> 172.21.15.154:0/3880615302 conn(0x7f2c5406a320 msgr2=0x7f2c540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.741+0000 7f2c59fff700 1 -- 172.21.15.154:0/3880615302 shutdown_connections 2023-10-10T22:18:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.741+0000 7f2c59fff700 1 -- 172.21.15.154:0/3880615302 wait complete. 2023-10-10T22:18:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.742+0000 7f2c59fff700 1 Processor -- start 2023-10-10T22:18:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.742+0000 7f2c59fff700 1 -- start start 2023-10-10T22:18:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c59fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c540cbf30 0x7f2c540a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c59fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c540ccf90 0x7f2c540a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c59fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c5415a270 0x7f2c54157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c59fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54156dd0 con 0x7f2c540cbf30 2023-10-10T22:18:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c59fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54157070 con 0x7f2c540ccf90 2023-10-10T22:18:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c59fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54157350 con 0x7f2c5415a270 2023-10-10T22:18:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c537fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c540cbf30 0x7f2c540a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c537fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c540cbf30 0x7f2c540a77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54440/0 (socket says 172.21.15.154:54440) 2023-10-10T22:18:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c537fe700 1 -- 172.21.15.154:0/1058711627 learned_addr learned my addr 172.21.15.154:0/1058711627 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c52ffd700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c540ccf90 0x7f2c540a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.743+0000 7f2c53fff700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c5415a270 0x7f2c54157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c537fe700 1 -- 172.21.15.154:0/1058711627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c5415a270 msgr2=0x7f2c54157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c537fe700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c5415a270 0x7f2c54157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c537fe700 1 -- 172.21.15.154:0/1058711627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c540ccf90 msgr2=0x7f2c540a9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c537fe700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c540ccf90 0x7f2c540a9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c537fe700 1 -- 172.21.15.154:0/1058711627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44009420 con 0x7f2c540cbf30 2023-10-10T22:18:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c537fe700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c540cbf30 0x7f2c540a77f0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009fb0 tx=0x7f2c44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:20.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/1058711627 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4401f070 con 0x7f2c540cbf30 2023-10-10T22:18:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/1058711627 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400bb20 con 0x7f2c540cbf30 2023-10-10T22:18:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c54157630 con 0x7f2c540cbf30 2023-10-10T22:18:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/1058711627 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44011650 con 0x7f2c540cbf30 2023-10-10T22:18:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.744+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c541525f0 con 0x7f2c540cbf30 2023-10-10T22:18:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.745+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5404c3c0 con 0x7f2c540cbf30 2023-10-10T22:18:20.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.746+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/1058711627 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c44011a00 con 0x7f2c540cbf30 2023-10-10T22:18:20.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.747+0000 7f2c3b7fe700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2c40066f30 0x7f2c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:20.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.747+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/1058711627 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f2c440857d0 con 0x7f2c540cbf30 2023-10-10T22:18:20.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.747+0000 7f2c52ffd700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2c40066f30 0x7f2c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:20.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.748+0000 7f2c52ffd700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2c40066f30 0x7f2c400693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c54069010 tx=0x7f2c48009250 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:20.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.751+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/1058711627 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c44052c40 con 0x7f2c540cbf30 2023-10-10T22:18:20.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.945+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2c5406f8a0 con 0x7f2c540cbf30 2023-10-10T22:18:20.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.945+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/1058711627 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v171) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2c44015020 con 0x7f2c540cbf30 2023-10-10T22:18:20.947 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:20.947 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T22:18:20.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:20.948 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T22:18:20.948 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T22:18:20.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:20.948 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T22:18:20.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2c40066f30 msgr2=0x7f2c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2c40066f30 0x7f2c400693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c54069010 tx=0x7f2c48009250 comp rx=0 tx=0).stop 2023-10-10T22:18:20.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c540cbf30 msgr2=0x7f2c540a77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:20.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c540cbf30 0x7f2c540a77f0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009fb0 tx=0x7f2c44017000 comp rx=0 tx=0).stop 2023-10-10T22:18:20.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 shutdown_connections 2023-10-10T22:18:20.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c5415a270 0x7f2c54157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2c40066f30 0x7f2c400693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c540cbf30 0x7f2c540a77f0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 --2- 172.21.15.154:0/1058711627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c540ccf90 0x7f2c540a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:20.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 >> 172.21.15.154:0/1058711627 conn(0x7f2c5406a320 msgr2=0x7f2c5406f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:20.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 shutdown_connections 2023-10-10T22:18:20.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:20.948+0000 7f2c59fff700 1 -- 172.21.15.154:0/1058711627 wait complete. 2023-10-10T22:18:20.967 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T22:18:20.968 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T22:18:21.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.153+0000 7fa59a9ff700 1 Processor -- start 2023-10-10T22:18:21.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.153+0000 7fa59a9ff700 1 -- start start 2023-10-10T22:18:21.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.154+0000 7fa59a9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594069a50 0x7fa594156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:21.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.154+0000 7fa59a9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5940ac030 con 0x7fa5940c8490 2023-10-10T22:18:21.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa59a9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5940ab820 con 0x7fa5940c6ac0 2023-10-10T22:18:21.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa59a9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa594068aa0 con 0x7fa594069a50 2023-10-10T22:18:21.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa593fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa5940c8490 0x7fa59415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42746/0 (socket says 172.21.15.154:42746) 2023-10-10T22:18:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa593fff700 1 -- 172.21.15.154:0/421410986 learned_addr learned my addr 172.21.15.154:0/421410986 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa598f9c700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594069a50 0x7fa594156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269306079 0 0) 0x7fa584001490 con 0x7fa5940c8490 2023-10-10T22:18:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa57c003570 con 0x7fa5940c8490 2023-10-10T22:18:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578868529 0 0) 0x7fa5940ab820 con 0x7fa5940c6ac0 2023-10-10T22:18:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa584001490 con 0x7fa5940c6ac0 2023-10-10T22:18:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.155+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2410514316 0 0) 0x7fa57c003570 con 0x7fa5940c8490 2023-10-10T22:18:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594069a50 msgr2=0x7fa594156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594069a50 0x7fa594156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 >> v1:172.21.15.179:6789/0 conn(0x7fa5940c6ac0 legacy=0x7fa594068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59406dbb0 con 0x7fa5940c8490 2023-10-10T22:18:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fa584001980 con 0x7fa5940c8490 2023-10-10T22:18:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 >> v1:172.21.15.154:6789/0 conn(0x7fa5940c8490 legacy=0x7fa59415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594069a50 0x7fa57c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c004180 0x7fa57c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa57c004d50 0x7fa57c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594068aa0 con 0x7fa57c004180 2023-10-10T22:18:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c00bba0 con 0x7fa57c004d50 2023-10-10T22:18:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c00bd60 con 0x7fa594069a50 2023-10-10T22:18:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa5937fe700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c004180 0x7fa57c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa593fff700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594069a50 0x7fa57c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:21.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa598f9c700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa57c004d50 0x7fa57c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:21.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa5937fe700 1 -- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594069a50 msgr2=0x7fa57c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:21.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa5937fe700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa594069a50 0x7fa57c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa5937fe700 1 -- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa57c004d50 msgr2=0x7fa57c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:21.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa5937fe700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa57c004d50 0x7fa57c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.156+0000 7fa5937fe700 1 -- 172.21.15.154:0/421410986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c003570 con 0x7fa57c004180 2023-10-10T22:18:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa5937fe700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c004180 0x7fa57c004810 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fa588001a10 tx=0x7fa588007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8a7e6c7cba72de server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58800c5d0 con 0x7fa57c004180 2023-10-10T22:18:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58800c730 con 0x7fa57c004180 2023-10-10T22:18:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa592ffd700 1 -- 172.21.15.154:0/421410986 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58800cad0 con 0x7fa57c004180 2023-10-10T22:18:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa59a9ff700 1 -- 172.21.15.154:0/421410986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c004180 msgr2=0x7fa57c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa59a9ff700 1 --2- 172.21.15.154:0/421410986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c004180 0x7fa57c004810 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fa588001a10 tx=0x7fa588007d30 comp rx=0 tx=0).stop 2023-10-10T22:18:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa598f9c700 1 -- 172.21.15.154:0/421410986 reap_dead start 2023-10-10T22:18:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa59a9ff700 1 -- 172.21.15.154:0/421410986 shutdown_connections 2023-10-10T22:18:21.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa59a9ff700 1 -- 172.21.15.154:0/421410986 >> 172.21.15.154:0/421410986 conn(0x7fa5940c8f90 msgr2=0x7fa5940c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:21.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa59a9ff700 1 -- 172.21.15.154:0/421410986 shutdown_connections 2023-10-10T22:18:21.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.157+0000 7fa59a9ff700 1 -- 172.21.15.154:0/421410986 wait complete. 2023-10-10T22:18:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.159+0000 7fa59a9ff700 1 Processor -- start 2023-10-10T22:18:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.159+0000 7fa59a9ff700 1 -- start start 2023-10-10T22:18:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa59a9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa57c004180 0x7fa5940ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:21.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa59a9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa59414ece0 0x7fa5940c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:21.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa59a9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5940c3530 0x7fa5940c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:21.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa59a9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940c3f10 con 0x7fa5940c3530 2023-10-10T22:18:21.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa59a9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940acc10 con 0x7fa57c004180 2023-10-10T22:18:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa59a9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940ada50 con 0x7fa59414ece0 2023-10-10T22:18:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa598f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5940c3530 0x7fa5940c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa598f9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5940c3530 0x7fa5940c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54458/0 (socket says 172.21.15.154:54458) 2023-10-10T22:18:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa598f9c700 1 -- 172.21.15.154:0/209275117 learned_addr learned my addr 172.21.15.154:0/209275117 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:21.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa593fff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa57c004180 0x7fa5940ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa5937fe700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa59414ece0 0x7fa5940c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa598f9c700 1 -- 172.21.15.154:0/209275117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa59414ece0 msgr2=0x7fa5940c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa598f9c700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa59414ece0 0x7fa5940c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa598f9c700 1 -- 172.21.15.154:0/209275117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa57c004180 msgr2=0x7fa5940ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:21.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa598f9c700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa57c004180 0x7fa5940ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.160+0000 7fa598f9c700 1 -- 172.21.15.154:0/209275117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5940ace40 con 0x7fa5940c3530 2023-10-10T22:18:21.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.161+0000 7fa598f9c700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5940c3530 0x7fa5940c39d0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa58c011970 tx=0x7fa58c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:21.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.161+0000 7fa57bfff700 1 -- 172.21.15.154:0/209275117 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c011ed0 con 0x7fa5940c3530 2023-10-10T22:18:21.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.161+0000 7fa57bfff700 1 -- 172.21.15.154:0/209275117 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c00f940 con 0x7fa5940c3530 2023-10-10T22:18:21.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.161+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5940ad120 con 0x7fa5940c3530 2023-10-10T22:18:21.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.161+0000 7fa57bfff700 1 -- 172.21.15.154:0/209275117 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c00fce0 con 0x7fa5940c3530 2023-10-10T22:18:21.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.161+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5940ad6e0 con 0x7fa5940c3530 2023-10-10T22:18:21.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.162+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5940718b0 con 0x7fa5940c3530 2023-10-10T22:18:21.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.163+0000 7fa57bfff700 1 -- 172.21.15.154:0/209275117 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa58c014650 con 0x7fa5940c3530 2023-10-10T22:18:21.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.164+0000 7fa57bfff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa580066f30 0x7fa5800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:21.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.164+0000 7fa57bfff700 1 -- 172.21.15.154:0/209275117 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fa58c084860 con 0x7fa5940c3530 2023-10-10T22:18:21.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.164+0000 7fa593fff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa580066f30 0x7fa5800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:21.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.164+0000 7fa593fff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa580066f30 0x7fa5800693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5840011d0 tx=0x7fa584006040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:21.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.168+0000 7fa57bfff700 1 -- 172.21.15.154:0/209275117 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa58c051cd0 con 0x7fa5940c3530 2023-10-10T22:18:21.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.361+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa5940adb90 con 0x7fa5940c3530 2023-10-10T22:18:21.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.980+0000 7fa57bfff700 1 -- 172.21.15.154:0/209275117 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v172) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa58c0220b0 con 0x7fa5940c3530 2023-10-10T22:18:21.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa580066f30 msgr2=0x7fa5800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:21.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa580066f30 0x7fa5800693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5840011d0 tx=0x7fa584006040 comp rx=0 tx=0).stop 2023-10-10T22:18:21.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5940c3530 msgr2=0x7fa5940c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:21.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5940c3530 0x7fa5940c39d0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa58c011970 tx=0x7fa58c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 shutdown_connections 2023-10-10T22:18:21.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa580066f30 0x7fa5800693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5940c3530 0x7fa5940c39d0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa57c004180 0x7fa5940ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 --2- 172.21.15.154:0/209275117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa59414ece0 0x7fa5940c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:21.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 >> 172.21.15.154:0/209275117 conn(0x7fa5940c8f90 msgr2=0x7fa59406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:21.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 shutdown_connections 2023-10-10T22:18:21.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:21.984+0000 7fa59a9ff700 1 -- 172.21.15.154:0/209275117 wait complete. 2023-10-10T22:18:21.990 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T22:18:22.008 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T22:18:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.196+0000 7f8b4a7ff700 1 Processor -- start 2023-10-10T22:18:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.197+0000 7f8b4a7ff700 1 -- start start 2023-10-10T22:18:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.198+0000 7f8b4a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b44068aa0 0x7f8b440c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.198+0000 7f8b4a7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4415a6f0 con 0x7f8b441569f0 2023-10-10T22:18:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.198+0000 7f8b4a7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4415a9d0 con 0x7f8b44156620 2023-10-10T22:18:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.198+0000 7f8b4a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440c8d30 con 0x7f8b44068aa0 2023-10-10T22:18:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.198+0000 7f8b3bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8b441569f0 0x7f8b44068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42762/0 (socket says 172.21.15.154:42762) 2023-10-10T22:18:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.198+0000 7f8b3bfff700 1 -- 172.21.15.154:0/2015274399 learned_addr learned my addr 172.21.15.154:0/2015274399 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.198+0000 7f8b48d9c700 1 --2- 172.21.15.154:0/2015274399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b44068aa0 0x7f8b440c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.199+0000 7f8b437fe700 1 -- 172.21.15.154:0/2015274399 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823045346 0 0) 0x7f8b4415a6f0 con 0x7f8b441569f0 2023-10-10T22:18:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.199+0000 7f8b437fe700 1 -- 172.21.15.154:0/2015274399 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b30003570 con 0x7f8b441569f0 2023-10-10T22:18:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.199+0000 7f8b437fe700 1 -- 172.21.15.154:0/2015274399 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026562402 0 0) 0x7f8b4415a9d0 con 0x7f8b44156620 2023-10-10T22:18:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.199+0000 7f8b437fe700 1 -- 172.21.15.154:0/2015274399 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b4415a6f0 con 0x7f8b44156620 2023-10-10T22:18:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.199+0000 7f8b48d9c700 1 -- 172.21.15.154:0/2015274399 >> v1:172.21.15.179:6789/0 conn(0x7f8b44156620 legacy=0x7f8b440ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.199+0000 7f8b48d9c700 1 -- 172.21.15.154:0/2015274399 >> v1:172.21.15.154:6789/0 conn(0x7f8b441569f0 legacy=0x7f8b44068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.199+0000 7f8b437fe700 1 -- 172.21.15.154:0/2015274399 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1673930552 0 0) 0x7f8b30003570 con 0x7f8b441569f0 2023-10-10T22:18:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.199+0000 7f8b48d9c700 1 -- 172.21.15.154:0/2015274399 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4415acb0 con 0x7f8b44068aa0 2023-10-10T22:18:22.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.199+0000 7f8b48d9c700 1 --2- 172.21.15.154:0/2015274399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b44068aa0 0x7f8b440c87f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009e90 tx=0x7f8b3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28a66e4f6a8f3e7a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:22.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b437fe700 1 -- 172.21.15.154:0/2015274399 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00e070 con 0x7f8b44068aa0 2023-10-10T22:18:22.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b437fe700 1 -- 172.21.15.154:0/2015274399 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c00b870 con 0x7f8b44068aa0 2023-10-10T22:18:22.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b437fe700 1 -- 172.21.15.154:0/2015274399 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c001470 con 0x7f8b44068aa0 2023-10-10T22:18:22.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/2015274399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b44068aa0 msgr2=0x7f8b440c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:22.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b4a7ff700 1 --2- 172.21.15.154:0/2015274399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b44068aa0 0x7f8b440c87f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009e90 tx=0x7f8b3c009780 comp rx=0 tx=0).stop 2023-10-10T22:18:22.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/2015274399 shutdown_connections 2023-10-10T22:18:22.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b4a7ff700 1 --2- 172.21.15.154:0/2015274399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b44068aa0 0x7f8b440c87f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:22.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/2015274399 >> 172.21.15.154:0/2015274399 conn(0x7f8b440cc540 msgr2=0x7f8b440cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/2015274399 shutdown_connections 2023-10-10T22:18:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.200+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/2015274399 wait complete. 2023-10-10T22:18:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.202+0000 7f8b4a7ff700 1 Processor -- start 2023-10-10T22:18:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.202+0000 7f8b4a7ff700 1 -- start start 2023-10-10T22:18:22.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b4a7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b44068aa0 0x7f8b440aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:22.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b4a7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b44156620 0x7f8b44155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:22.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b4a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b441569f0 0x7f8b44158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:22.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b4a7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440c1ad0 con 0x7f8b44068aa0 2023-10-10T22:18:22.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b4a7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440bff70 con 0x7f8b44156620 2023-10-10T22:18:22.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b4a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440c1c60 con 0x7f8b441569f0 2023-10-10T22:18:22.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b43fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b44068aa0 0x7f8b440aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:22.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b43fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b44068aa0 0x7f8b440aa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54462/0 (socket says 172.21.15.154:54462) 2023-10-10T22:18:22.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b43fff700 1 -- 172.21.15.154:0/646351750 learned_addr learned my addr 172.21.15.154:0/646351750 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:22.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b48d9c700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b441569f0 0x7f8b44158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:22.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b3bfff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b44156620 0x7f8b44155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:22.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b43fff700 1 -- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b441569f0 msgr2=0x7f8b44158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:22.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b43fff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b441569f0 0x7f8b44158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:22.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b43fff700 1 -- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b44156620 msgr2=0x7f8b44155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:22.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b43fff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b44156620 0x7f8b44155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:22.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b43fff700 1 -- 172.21.15.154:0/646351750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c009a20 con 0x7f8b44068aa0 2023-10-10T22:18:22.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b48d9c700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b441569f0 0x7f8b44158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:22.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.203+0000 7f8b3bfff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b44156620 0x7f8b44155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:22.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.204+0000 7f8b43fff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b44068aa0 0x7f8b440aa640 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c7f0 tx=0x7f8b34007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:22.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.204+0000 7f8b40ff9700 1 -- 172.21.15.154:0/646351750 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34016070 con 0x7f8b44068aa0 2023-10-10T22:18:22.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.204+0000 7f8b40ff9700 1 -- 172.21.15.154:0/646351750 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b34011680 con 0x7f8b44068aa0 2023-10-10T22:18:22.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.204+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b440abac0 con 0x7f8b44068aa0 2023-10-10T22:18:22.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.204+0000 7f8b40ff9700 1 -- 172.21.15.154:0/646351750 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34011a20 con 0x7f8b44068aa0 2023-10-10T22:18:22.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.204+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b440c04a0 con 0x7f8b44068aa0 2023-10-10T22:18:22.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.205+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b440718b0 con 0x7f8b44068aa0 2023-10-10T22:18:22.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.206+0000 7f8b40ff9700 1 -- 172.21.15.154:0/646351750 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b34012440 con 0x7f8b44068aa0 2023-10-10T22:18:22.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.207+0000 7f8b40ff9700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8b24066f30 0x7f8b240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:22.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.207+0000 7f8b40ff9700 1 -- 172.21.15.154:0/646351750 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5687+0+0 (secure 0 0 0) 0x7f8b34084300 con 0x7f8b44068aa0 2023-10-10T22:18:22.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.207+0000 7f8b3bfff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8b24066f30 0x7f8b240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:22.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.208+0000 7f8b3bfff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8b24066f30 0x7f8b240693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c001ed0 tx=0x7f8b2c009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:22.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.211+0000 7f8b40ff9700 1 -- 172.21.15.154:0/646351750 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b34051580 con 0x7f8b44068aa0 2023-10-10T22:18:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.404+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8b440c7bc0 con 0x7f8b44068aa0 2023-10-10T22:18:22.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.987+0000 7f8b40ff9700 1 -- 172.21.15.154:0/646351750 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v173) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8b34054ba0 con 0x7f8b44068aa0 2023-10-10T22:18:22.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.996+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8b24066f30 msgr2=0x7f8b240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:22.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.996+0000 7f8b4a7ff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8b24066f30 0x7f8b240693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c001ed0 tx=0x7f8b2c009040 comp rx=0 tx=0).stop 2023-10-10T22:18:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.996+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b44068aa0 msgr2=0x7f8b440aa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.996+0000 7f8b4a7ff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b44068aa0 0x7f8b440aa640 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c7f0 tx=0x7f8b34007dd0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.997+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 shutdown_connections 2023-10-10T22:18:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.997+0000 7f8b4a7ff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b441569f0 0x7f8b44158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.997+0000 7f8b4a7ff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f8b24066f30 0x7f8b240693e0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c001ed0 tx=0x7f8b2c009040 comp rx=0 tx=0).stop 2023-10-10T22:18:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.997+0000 7f8b4a7ff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b44068aa0 0x7f8b440aa640 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.997+0000 7f8b4a7ff700 1 --2- 172.21.15.154:0/646351750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b44156620 0x7f8b44155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:22.997+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 >> 172.21.15.154:0/646351750 conn(0x7f8b440cc540 msgr2=0x7f8b440c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:23.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.002+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 shutdown_connections 2023-10-10T22:18:23.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.005+0000 7f8b4a7ff700 1 -- 172.21.15.154:0/646351750 wait complete. 2023-10-10T22:18:23.010 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T22:18:23.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T22:18:23.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.213+0000 7ff12b9ff700 1 Processor -- start 2023-10-10T22:18:23.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.213+0000 7ff12b9ff700 1 -- start start 2023-10-10T22:18:23.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff12b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240c83f0 0x7ff1240c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:23.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff12b9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff1240ccee0 0x7ff1241561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:23.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff12b9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff1240c87c0 0x7ff124156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:23.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff12b9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff124156c50 con 0x7ff1240ccee0 2023-10-10T22:18:23.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff12b9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12415b0d0 con 0x7ff1240c87c0 2023-10-10T22:18:23.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff12b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240c7a60 con 0x7ff1240c83f0 2023-10-10T22:18:23.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff128f9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff1240ccee0 0x7ff1241561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:23.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff128f9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff1240ccee0 0x7ff1241561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54464/0 (socket says 172.21.15.154:54464) 2023-10-10T22:18:23.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff128f9a700 1 -- 172.21.15.154:0/1673255959 learned_addr learned my addr 172.21.15.154:0/1673255959 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:23.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff12979b700 1 --2- 172.21.15.154:0/1673255959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240c83f0 0x7ff1240c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:23.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff129f9c700 1 --2- 172.21.15.154:0/1673255959 >> v2:172.21.15.179:3300/0 conn(0x7ff1240c87c0 0x7ff124156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:23.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff128f9a700 1 -- 172.21.15.154:0/1673255959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240c83f0 msgr2=0x7ff1240c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:23.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff128f9a700 1 --2- 172.21.15.154:0/1673255959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240c83f0 0x7ff1240c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff128f9a700 1 -- 172.21.15.154:0/1673255959 >> v2:172.21.15.179:3300/0 conn(0x7ff1240c87c0 msgr2=0x7ff124156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:23.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff128f9a700 1 --2- 172.21.15.154:0/1673255959 >> v2:172.21.15.179:3300/0 conn(0x7ff1240c87c0 0x7ff124156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.215+0000 7ff128f9a700 1 -- 172.21.15.154:0/1673255959 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12415a4c0 con 0x7ff1240ccee0 2023-10-10T22:18:23.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff128f9a700 1 --2- 172.21.15.154:0/1673255959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240ccee0 0x7ff1241561d0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cc340 tx=0x7ff114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db2b7f389cb68a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:23.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff11bfff700 1 -- 172.21.15.154:0/1673255959 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11400b860 con 0x7ff1240ccee0 2023-10-10T22:18:23.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff11bfff700 1 -- 172.21.15.154:0/1673255959 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11400b9c0 con 0x7ff1240ccee0 2023-10-10T22:18:23.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff11bfff700 1 -- 172.21.15.154:0/1673255959 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11400bd60 con 0x7ff1240ccee0 2023-10-10T22:18:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff12b9ff700 1 -- 172.21.15.154:0/1673255959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240ccee0 msgr2=0x7ff1241561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/1673255959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240ccee0 0x7ff1241561d0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cc340 tx=0x7ff114009250 comp rx=0 tx=0).stop 2023-10-10T22:18:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff12b9ff700 1 -- 172.21.15.154:0/1673255959 shutdown_connections 2023-10-10T22:18:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/1673255959 >> v2:172.21.15.179:3300/0 conn(0x7ff1240c87c0 0x7ff124156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/1673255959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240c83f0 0x7ff1240c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/1673255959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240ccee0 0x7ff1241561d0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.216+0000 7ff12b9ff700 1 -- 172.21.15.154:0/1673255959 >> 172.21.15.154:0/1673255959 conn(0x7ff124068e10 msgr2=0x7ff1240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.217+0000 7ff12b9ff700 1 -- 172.21.15.154:0/1673255959 shutdown_connections 2023-10-10T22:18:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.217+0000 7ff12b9ff700 1 -- 172.21.15.154:0/1673255959 wait complete. 2023-10-10T22:18:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.218+0000 7ff12b9ff700 1 Processor -- start 2023-10-10T22:18:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.218+0000 7ff12b9ff700 1 -- start start 2023-10-10T22:18:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff12b9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240c83f0 0x7ff12415f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff12b9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1240c87c0 0x7ff12414d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff12b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240ccee0 0x7ff124152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff12b9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff124160680 con 0x7ff1240c83f0 2023-10-10T22:18:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff12b9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240c4c00 con 0x7ff1240c87c0 2023-10-10T22:18:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff12b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1241600c0 con 0x7ff1240ccee0 2023-10-10T22:18:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff12979b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240c83f0 0x7ff12415f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff12979b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240c83f0 0x7ff12415f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54478/0 (socket says 172.21.15.154:54478) 2023-10-10T22:18:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff12979b700 1 -- 172.21.15.154:0/3705949159 learned_addr learned my addr 172.21.15.154:0/3705949159 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff128f9a700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1240c87c0 0x7ff12414d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.219+0000 7ff129f9c700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240ccee0 0x7ff124152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff12979b700 1 -- 172.21.15.154:0/3705949159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240ccee0 msgr2=0x7ff124152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff12979b700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240ccee0 0x7ff124152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff12979b700 1 -- 172.21.15.154:0/3705949159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1240c87c0 msgr2=0x7ff12414d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:23.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff12979b700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1240c87c0 0x7ff12414d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:23.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff12979b700 1 -- 172.21.15.154:0/3705949159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140094f0 con 0x7ff1240c83f0 2023-10-10T22:18:23.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff12979b700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240c83f0 0x7ff12415f7c0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7ff12000d8c0 tx=0x7ff120008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:23.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff1197fa700 1 -- 172.21.15.154:0/3705949159 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200125f0 con 0x7ff1240c83f0 2023-10-10T22:18:23.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff1197fa700 1 -- 172.21.15.154:0/3705949159 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120012770 con 0x7ff1240c83f0 2023-10-10T22:18:23.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1241603a0 con 0x7ff1240c83f0 2023-10-10T22:18:23.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff1197fa700 1 -- 172.21.15.154:0/3705949159 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120012b30 con 0x7ff1240c83f0 2023-10-10T22:18:23.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.220+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12415fd00 con 0x7ff1240c83f0 2023-10-10T22:18:23.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.221+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12404c3c0 con 0x7ff1240c83f0 2023-10-10T22:18:23.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.223+0000 7ff1197fa700 1 -- 172.21.15.154:0/3705949159 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff12001e460 con 0x7ff1240c83f0 2023-10-10T22:18:23.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.223+0000 7ff1197fa700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff108066f30 0x7ff1080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:23.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.224+0000 7ff1197fa700 1 -- 172.21.15.154:0/3705949159 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff1200856b0 con 0x7ff1240c83f0 2023-10-10T22:18:23.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.224+0000 7ff128f9a700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff108066f30 0x7ff1080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:23.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.224+0000 7ff128f9a700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff108066f30 0x7ff1080693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cc340 tx=0x7ff114017000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:23.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.227+0000 7ff1197fa700 1 -- 172.21.15.154:0/3705949159 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1200528e0 con 0x7ff1240c83f0 2023-10-10T22:18:23.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:23.463+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff12415a7a0 con 0x7ff1240c83f0 2023-10-10T22:18:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.016+0000 7ff1197fa700 1 -- 172.21.15.154:0/3705949159 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v74) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff120055f00 con 0x7ff1240c83f0 2023-10-10T22:18:24.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.022+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff108066f30 msgr2=0x7ff1080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.022+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff108066f30 0x7ff1080693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cc340 tx=0x7ff114017000 comp rx=0 tx=0).stop 2023-10-10T22:18:24.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.022+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240c83f0 msgr2=0x7ff12415f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.022+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240c83f0 0x7ff12415f7c0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7ff12000d8c0 tx=0x7ff120008040 comp rx=0 tx=0).stop 2023-10-10T22:18:24.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.024+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 shutdown_connections 2023-10-10T22:18:24.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.024+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1240ccee0 0x7ff124152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.024+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff108066f30 0x7ff1080693e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cc340 tx=0x7ff114017000 comp rx=0 tx=0).stop 2023-10-10T22:18:24.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.024+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1240c83f0 0x7ff12415f7c0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.024+0000 7ff12b9ff700 1 --2- 172.21.15.154:0/3705949159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1240c87c0 0x7ff12414d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.024+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 >> 172.21.15.154:0/3705949159 conn(0x7ff124068e10 msgr2=0x7ff1240cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:24.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.030+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 shutdown_connections 2023-10-10T22:18:24.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.030+0000 7ff12b9ff700 1 -- 172.21.15.154:0/3705949159 wait complete. 2023-10-10T22:18:24.034 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 20 and data pool 21 2023-10-10T22:18:24.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:18:24.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.235+0000 7f03bafff700 1 Processor -- start 2023-10-10T22:18:24.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.235+0000 7f03bafff700 1 -- start start 2023-10-10T22:18:24.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.236+0000 7f03bafff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03b4155c10 0x7f03b4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.236+0000 7f03bafff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.236+0000 7f03bafff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b40ad930 con 0x7f03b41568a0 2023-10-10T22:18:24.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.236+0000 7f03bafff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b40acd20 con 0x7f03b4155c10 2023-10-10T22:18:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.236+0000 7f03bafff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40ad000 con 0x7f03b40ac230 2023-10-10T22:18:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b8d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03b4155c10 0x7f03b4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b8d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03b4155c10 0x7f03b4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:57112/0 (socket says 172.21.15.154:57112) 2023-10-10T22:18:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b959c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f03b41568a0 0x7f03b4156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:51312/0 (socket says 172.21.15.154:51312) 2023-10-10T22:18:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b8d9b700 1 -- 172.21.15.154:0/585225994 learned_addr learned my addr 172.21.15.154:0/585225994 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:43764/0 (socket says 172.21.15.154:43764) 2023-10-10T22:18:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b8d9b700 1 -- 172.21.15.154:0/585225994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 msgr2=0x7f03b40ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:24.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b8d9b700 1 --2- 172.21.15.154:0/585225994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b8d9b700 1 -- 172.21.15.154:0/585225994 >> v1:172.21.15.179:6789/0 conn(0x7f03b41568a0 legacy=0x7f03b4156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b8d9b700 1 -- 172.21.15.154:0/585225994 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40ad2e0 con 0x7f03b4155c10 2023-10-10T22:18:24.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b3fff700 1 --2- 172.21.15.154:0/585225994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:24.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.237+0000 7f03b37fe700 1 -- 172.21.15.154:0/585225994 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732474119 0 0) 0x7f03b40ad930 con 0x7f03b41568a0 2023-10-10T22:18:24.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.238+0000 7f03b8d9b700 1 --2- 172.21.15.154:0/585225994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03b4155c10 0x7f03b4155fe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f03a80099b0 tx=0x7f03a8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=618b51747cf5d57a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:24.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.238+0000 7f03b37fe700 1 -- 172.21.15.154:0/585225994 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8009ea0 con 0x7f03b4155c10 2023-10-10T22:18:24.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.238+0000 7f03b37fe700 1 -- 172.21.15.154:0/585225994 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a800b860 con 0x7f03b4155c10 2023-10-10T22:18:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.238+0000 7f03b37fe700 1 -- 172.21.15.154:0/585225994 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a800bc00 con 0x7f03b4155c10 2023-10-10T22:18:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.238+0000 7f03bafff700 1 -- 172.21.15.154:0/585225994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03b4155c10 msgr2=0x7f03b4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.238+0000 7f03bafff700 1 --2- 172.21.15.154:0/585225994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03b4155c10 0x7f03b4155fe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f03a80099b0 tx=0x7f03a8009250 comp rx=0 tx=0).stop 2023-10-10T22:18:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.239+0000 7f03bafff700 1 -- 172.21.15.154:0/585225994 shutdown_connections 2023-10-10T22:18:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.239+0000 7f03bafff700 1 --2- 172.21.15.154:0/585225994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03b4155c10 0x7f03b4155fe0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.239+0000 7f03bafff700 1 --2- 172.21.15.154:0/585225994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.239+0000 7f03bafff700 1 -- 172.21.15.154:0/585225994 >> 172.21.15.154:0/585225994 conn(0x7f03b406a320 msgr2=0x7f03b40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.239+0000 7f03bafff700 1 -- 172.21.15.154:0/585225994 shutdown_connections 2023-10-10T22:18:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.239+0000 7f03bafff700 1 -- 172.21.15.154:0/585225994 wait complete. 2023-10-10T22:18:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.240+0000 7f03bafff700 1 Processor -- start 2023-10-10T22:18:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.240+0000 7f03bafff700 1 -- start start 2023-10-10T22:18:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03bafff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03bafff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b4155c10 0x7f03b40cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03bafff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03b41568a0 0x7f03b416b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03bafff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b4140ab0 con 0x7f03b4155c10 2023-10-10T22:18:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03bafff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b413f0c0 con 0x7f03b41568a0 2023-10-10T22:18:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03bafff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b413ff30 con 0x7f03b40ac230 2023-10-10T22:18:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b4155c10 0x7f03b40cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b4155c10 0x7f03b40cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54488/0 (socket says 172.21.15.154:54488) 2023-10-10T22:18:24.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03b3fff700 1 -- 172.21.15.154:0/4289970673 learned_addr learned my addr 172.21.15.154:0/4289970673 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:24.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.241+0000 7f03b8d9b700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b959c700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03b41568a0 0x7f03b416b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b3fff700 1 -- 172.21.15.154:0/4289970673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 msgr2=0x7f03b40cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b3fff700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b3fff700 1 -- 172.21.15.154:0/4289970673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03b41568a0 msgr2=0x7f03b416b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b3fff700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03b41568a0 0x7f03b416b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b3fff700 1 -- 172.21.15.154:0/4289970673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0009420 con 0x7f03b4155c10 2023-10-10T22:18:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b3fff700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b4155c10 0x7f03b40cb7b0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f03a000ecb0 tx=0x7f03a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b0ff9700 1 -- 172.21.15.154:0/4289970673 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000c8c0 con 0x7f03b4155c10 2023-10-10T22:18:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b0ff9700 1 -- 172.21.15.154:0/4289970673 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000ca20 con 0x7f03b4155c10 2023-10-10T22:18:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03b0ff9700 1 -- 172.21.15.154:0/4289970673 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000cda0 con 0x7f03b4155c10 2023-10-10T22:18:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.242+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a80094f0 con 0x7f03b4155c10 2023-10-10T22:18:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.243+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b4140460 con 0x7f03b4155c10 2023-10-10T22:18:24.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.244+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b4140c60 con 0x7f03b4155c10 2023-10-10T22:18:24.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.244+0000 7f03b0ff9700 1 -- 172.21.15.154:0/4289970673 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03a0013680 con 0x7f03b4155c10 2023-10-10T22:18:24.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.245+0000 7f03b0ff9700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0398066f30 0x7f03980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.245+0000 7f03b0ff9700 1 -- 172.21.15.154:0/4289970673 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f03a0084a40 con 0x7f03b4155c10 2023-10-10T22:18:24.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.246+0000 7f03b8d9b700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0398066f30 0x7f03980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.246+0000 7f03b8d9b700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0398066f30 0x7f03980693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03a80099b0 tx=0x7f03a8017000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:24.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.249+0000 7f03b0ff9700 1 -- 172.21.15.154:0/4289970673 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03b4140c60 con 0x7f03b4155c10 2023-10-10T22:18:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.442+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03b4140c60 con 0x7f03b4155c10 2023-10-10T22:18:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.443+0000 7f03b0ff9700 1 -- 172.21.15.154:0/4289970673 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+16136 (secure 0 0 0) 0x7f03b4140c60 con 0x7f03b4155c10 2023-10-10T22:18:24.445 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:24.445 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":174,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:18:23.464887+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:18:21.404071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-10T22:18:22.445408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:18:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.445+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0398066f30 msgr2=0x7f03980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0398066f30 0x7f03980693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03a80099b0 tx=0x7f03a8017000 comp rx=0 tx=0).stop 2023-10-10T22:18:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b4155c10 msgr2=0x7f03b40cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b4155c10 0x7f03b40cb7b0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f03a000ecb0 tx=0x7f03a00091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 shutdown_connections 2023-10-10T22:18:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03b41568a0 0x7f03b416b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03b40ac230 0x7f03b40cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f0398066f30 0x7f03980693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 --2- 172.21.15.154:0/4289970673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03b4155c10 0x7f03b40cb7b0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 >> 172.21.15.154:0/4289970673 conn(0x7f03b406a320 msgr2=0x7f03b414c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:24.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 shutdown_connections 2023-10-10T22:18:24.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.446+0000 7f03bafff700 1 -- 172.21.15.154:0/4289970673 wait complete. 2023-10-10T22:18:24.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:18:24.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.645+0000 7fef9a19d700 1 Processor -- start 2023-10-10T22:18:24.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.646+0000 7fef9a19d700 1 -- start start 2023-10-10T22:18:24.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.647+0000 7fef9a19d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef9406d950 0x7fef940c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.647+0000 7fef9a19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 0x7fef940c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.647+0000 7fef9a19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9406ae70 con 0x7fef9406a0a0 2023-10-10T22:18:24.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.647+0000 7fef9a19d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9406a540 con 0x7fef9406d950 2023-10-10T22:18:24.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.647+0000 7fef9a19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9406a820 con 0x7fef9406dd20 2023-10-10T22:18:24.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.647+0000 7fef9919b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef9406d950 0x7fef940c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.647+0000 7fef9919b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef9406d950 0x7fef940c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54504/0 (socket says 172.21.15.154:54504) 2023-10-10T22:18:24.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.647+0000 7fef9919b700 1 -- 172.21.15.154:0/1583277319 learned_addr learned my addr 172.21.15.154:0/1583277319 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:24.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.648+0000 7fef9999c700 1 --2- 172.21.15.154:0/1583277319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 0x7fef940c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.648+0000 7fef9919b700 1 -- 172.21.15.154:0/1583277319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 msgr2=0x7fef940c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:24.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.648+0000 7fef9919b700 1 --2- 172.21.15.154:0/1583277319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 0x7fef940c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.648+0000 7fef9919b700 1 -- 172.21.15.154:0/1583277319 >> v1:172.21.15.179:6789/0 conn(0x7fef9406a0a0 legacy=0x7fef940c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.648+0000 7fef9919b700 1 -- 172.21.15.154:0/1583277319 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9406ab00 con 0x7fef9406d950 2023-10-10T22:18:24.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.648+0000 7fef9919b700 1 --2- 172.21.15.154:0/1583277319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406d950 0x7fef940c8350 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fef900099b0 tx=0x7fef90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250f91f4ae30f77d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:24.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.648+0000 7fef8bfff700 1 -- 172.21.15.154:0/1583277319 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9000b860 con 0x7fef9406d950 2023-10-10T22:18:24.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.648+0000 7fef8bfff700 1 -- 172.21.15.154:0/1583277319 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9000b9c0 con 0x7fef9406d950 2023-10-10T22:18:24.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.648+0000 7fef8bfff700 1 -- 172.21.15.154:0/1583277319 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9000bd60 con 0x7fef9406d950 2023-10-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.649+0000 7fef9a19d700 1 -- 172.21.15.154:0/1583277319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406d950 msgr2=0x7fef940c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.649+0000 7fef9a19d700 1 --2- 172.21.15.154:0/1583277319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406d950 0x7fef940c8350 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fef900099b0 tx=0x7fef90009250 comp rx=0 tx=0).stop 2023-10-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.649+0000 7fef9a19d700 1 -- 172.21.15.154:0/1583277319 shutdown_connections 2023-10-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.649+0000 7fef9a19d700 1 --2- 172.21.15.154:0/1583277319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 0x7fef940c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.649+0000 7fef9a19d700 1 --2- 172.21.15.154:0/1583277319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406d950 0x7fef940c8350 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.649+0000 7fef9a19d700 1 -- 172.21.15.154:0/1583277319 >> 172.21.15.154:0/1583277319 conn(0x7fef940cc1f0 msgr2=0x7fef940cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.649+0000 7fef9a19d700 1 -- 172.21.15.154:0/1583277319 shutdown_connections 2023-10-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.649+0000 7fef9a19d700 1 -- 172.21.15.154:0/1583277319 wait complete. 2023-10-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.650+0000 7fef9a19d700 1 Processor -- start 2023-10-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.650+0000 7fef9a19d700 1 -- start start 2023-10-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.651+0000 7fef9a19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406a0a0 0x7fef94145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.651+0000 7fef9a19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef9406d950 0x7fef9415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.651+0000 7fef9a19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 0x7fef9415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.651+0000 7fef9a19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef940c4310 con 0x7fef9406a0a0 2023-10-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.651+0000 7fef9a19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef940c45f0 con 0x7fef9406d950 2023-10-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.651+0000 7fef9a19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef940c48d0 con 0x7fef9406dd20 2023-10-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9919b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406a0a0 0x7fef94145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9919b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406a0a0 0x7fef94145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54512/0 (socket says 172.21.15.154:54512) 2023-10-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9919b700 1 -- 172.21.15.154:0/3234262091 learned_addr learned my addr 172.21.15.154:0/3234262091 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9999c700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 0x7fef9415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9899a700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef9406d950 0x7fef9415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9919b700 1 -- 172.21.15.154:0/3234262091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 msgr2=0x7fef9415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9919b700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 0x7fef9415cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9919b700 1 -- 172.21.15.154:0/3234262091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef9406d950 msgr2=0x7fef9415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9919b700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef9406d950 0x7fef9415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9919b700 1 -- 172.21.15.154:0/3234262091 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef900094f0 con 0x7fef9406a0a0 2023-10-10T22:18:24.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9899a700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef9406d950 0x7fef9415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:24.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9919b700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406a0a0 0x7fef94145b10 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fef9406fe40 tx=0x7fef90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:24.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef897fa700 1 -- 172.21.15.154:0/3234262091 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90024440 con 0x7fef9406a0a0 2023-10-10T22:18:24.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef897fa700 1 -- 172.21.15.154:0/3234262091 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef900245c0 con 0x7fef9406a0a0 2023-10-10T22:18:24.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef940c4bb0 con 0x7fef9406a0a0 2023-10-10T22:18:24.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.652+0000 7fef897fa700 1 -- 172.21.15.154:0/3234262091 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90024980 con 0x7fef9406a0a0 2023-10-10T22:18:24.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.653+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef94146050 con 0x7fef9406a0a0 2023-10-10T22:18:24.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.653+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef94146240 con 0x7fef9406a0a0 2023-10-10T22:18:24.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.655+0000 7fef897fa700 1 -- 172.21.15.154:0/3234262091 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef9001a420 con 0x7fef9406a0a0 2023-10-10T22:18:24.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.655+0000 7fef897fa700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fef78066f30 0x7fef780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:24.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.655+0000 7fef897fa700 1 -- 172.21.15.154:0/3234262091 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fef90086570 con 0x7fef9406a0a0 2023-10-10T22:18:24.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.656+0000 7fef9899a700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fef78066f30 0x7fef780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:24.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.656+0000 7fef9899a700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fef78066f30 0x7fef780693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fef94157890 tx=0x7fef84009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:24.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.660+0000 7fef897fa700 1 -- 172.21.15.154:0/3234262091 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef94146240 con 0x7fef9406a0a0 2023-10-10T22:18:24.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-10T22:18:24.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-10T22:18:24.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-10T22:18:24.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.852+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef94146240 con 0x7fef9406a0a0 2023-10-10T22:18:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.853+0000 7fef897fa700 1 -- 172.21.15.154:0/3234262091 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+16136 (secure 0 0 0) 0x7fef94146240 con 0x7fef9406a0a0 2023-10-10T22:18:24.855 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:24.855 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":174,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:18:23.464887+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:18:21.404071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-10T22:18:22.445408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:18:24.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.855+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fef78066f30 msgr2=0x7fef780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.855+0000 7fef9a19d700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fef78066f30 0x7fef780693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fef94157890 tx=0x7fef84009040 comp rx=0 tx=0).stop 2023-10-10T22:18:24.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.855+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406a0a0 msgr2=0x7fef94145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:24.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.855+0000 7fef9a19d700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406a0a0 0x7fef94145b10 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fef9406fe40 tx=0x7fef90017000 comp rx=0 tx=0).stop 2023-10-10T22:18:24.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.856+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 shutdown_connections 2023-10-10T22:18:24.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.856+0000 7fef9a19d700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef9406dd20 0x7fef9415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.856+0000 7fef9a19d700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fef78066f30 0x7fef780693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.856+0000 7fef9a19d700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef9406a0a0 0x7fef94145b10 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.856+0000 7fef9a19d700 1 --2- 172.21.15.154:0/3234262091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef9406d950 0x7fef9415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:24.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.856+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 >> 172.21.15.154:0/3234262091 conn(0x7fef940cc1f0 msgr2=0x7fef941561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:24.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.856+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 shutdown_connections 2023-10-10T22:18:24.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:24.856+0000 7fef9a19d700 1 -- 172.21.15.154:0/3234262091 wait complete. 2023-10-10T22:18:24.876 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T22:18:25.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.062+0000 7f450b59e700 1 Processor -- start 2023-10-10T22:18:25.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.063+0000 7f450b59e700 1 -- start start 2023-10-10T22:18:25.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.064+0000 7f450b59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f450c06f060 0x7f450c0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:25.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.064+0000 7f450b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c06f4b0 0x7f450c0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:25.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.064+0000 7f450b59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c06ebd0 con 0x7f450c0cb1a0 2023-10-10T22:18:25.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.064+0000 7f450b59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c15b2e0 con 0x7f450c06f060 2023-10-10T22:18:25.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.064+0000 7f450b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c15aa70 con 0x7f450c06f4b0 2023-10-10T22:18:25.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.064+0000 7f450a59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f450c0cb1a0 0x7f450c15a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42766/0 (socket says 172.21.15.154:42766) 2023-10-10T22:18:25.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.064+0000 7f450a59c700 1 -- 172.21.15.154:0/3698096570 learned_addr learned my addr 172.21.15.154:0/3698096570 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:25.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.064+0000 7f450ad9d700 1 --2- 172.21.15.154:0/3698096570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c06f4b0 0x7f450c0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:25.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.064+0000 7f4509d9b700 1 --2- 172.21.15.154:0/3698096570 >> v2:172.21.15.179:3300/0 conn(0x7f450c06f060 0x7f450c0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:25.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.065+0000 7f450959a700 1 -- 172.21.15.154:0/3698096570 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997832714 0 0) 0x7f450c06ebd0 con 0x7f450c0cb1a0 2023-10-10T22:18:25.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.065+0000 7f450959a700 1 -- 172.21.15.154:0/3698096570 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f4005780 con 0x7f450c0cb1a0 2023-10-10T22:18:25.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.065+0000 7f4509d9b700 1 -- 172.21.15.154:0/3698096570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c06f4b0 msgr2=0x7f450c0ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:25.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.065+0000 7f4509d9b700 1 --2- 172.21.15.154:0/3698096570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c06f4b0 0x7f450c0ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:25.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.065+0000 7f4509d9b700 1 -- 172.21.15.154:0/3698096570 >> v1:172.21.15.154:6789/0 conn(0x7f450c0cb1a0 legacy=0x7f450c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:25.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.065+0000 7f4509d9b700 1 -- 172.21.15.154:0/3698096570 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c15ad20 con 0x7f450c06f060 2023-10-10T22:18:25.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.065+0000 7f450ad9d700 1 --2- 172.21.15.154:0/3698096570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c06f4b0 0x7f450c0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:25.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.065+0000 7f4509d9b700 1 --2- 172.21.15.154:0/3698096570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f450c06f060 0x7f450c0ae0d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f45000098e0 tx=0x7f45000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8182ee6defdd448a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:25.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450959a700 1 -- 172.21.15.154:0/3698096570 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500011630 con 0x7f450c06f060 2023-10-10T22:18:25.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450959a700 1 -- 172.21.15.154:0/3698096570 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4500011790 con 0x7f450c06f060 2023-10-10T22:18:25.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450959a700 1 -- 172.21.15.154:0/3698096570 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500011b10 con 0x7f450c06f060 2023-10-10T22:18:25.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450b59e700 1 -- 172.21.15.154:0/3698096570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f450c06f060 msgr2=0x7f450c0ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:25.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450b59e700 1 --2- 172.21.15.154:0/3698096570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f450c06f060 0x7f450c0ae0d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f45000098e0 tx=0x7f45000091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:25.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450b59e700 1 -- 172.21.15.154:0/3698096570 shutdown_connections 2023-10-10T22:18:25.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450b59e700 1 --2- 172.21.15.154:0/3698096570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c06f4b0 0x7f450c0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:25.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450b59e700 1 --2- 172.21.15.154:0/3698096570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f450c06f060 0x7f450c0ae0d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:25.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450b59e700 1 -- 172.21.15.154:0/3698096570 >> 172.21.15.154:0/3698096570 conn(0x7f450c0cc1e0 msgr2=0x7f450c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:25.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450b59e700 1 -- 172.21.15.154:0/3698096570 shutdown_connections 2023-10-10T22:18:25.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.066+0000 7f450b59e700 1 -- 172.21.15.154:0/3698096570 wait complete. 2023-10-10T22:18:25.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.068+0000 7f450b59e700 1 Processor -- start 2023-10-10T22:18:25.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.068+0000 7f450b59e700 1 -- start start 2023-10-10T22:18:25.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f450b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f450c06f060 0x7f450c0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:25.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f450b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f450c06f4b0 0x7f450c1667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:25.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f450b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c0cb1a0 0x7f450c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:25.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f450b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0c3920 con 0x7f450c06f4b0 2023-10-10T22:18:25.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f450b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c166d00 con 0x7f450c06f060 2023-10-10T22:18:25.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f450b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c152620 con 0x7f450c0cb1a0 2023-10-10T22:18:25.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f4509d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f450c06f4b0 0x7f450c1667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f4509d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f450c06f4b0 0x7f450c1667c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54528/0 (socket says 172.21.15.154:54528) 2023-10-10T22:18:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f4509d9b700 1 -- 172.21.15.154:0/415564070 learned_addr learned my addr 172.21.15.154:0/415564070 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f450a59c700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f450c06f060 0x7f450c0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f450ad9d700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c0cb1a0 0x7f450c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f4509d9b700 1 -- 172.21.15.154:0/415564070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c0cb1a0 msgr2=0x7f450c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:25.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f4509d9b700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c0cb1a0 0x7f450c14dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:25.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f4509d9b700 1 -- 172.21.15.154:0/415564070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f450c06f060 msgr2=0x7f450c0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:25.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f4509d9b700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f450c06f060 0x7f450c0c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:25.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.069+0000 7f4509d9b700 1 -- 172.21.15.154:0/415564070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504009420 con 0x7f450c06f4b0 2023-10-10T22:18:25.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.070+0000 7f4509d9b700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f450c06f4b0 0x7f450c1667c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f450c06ce80 tx=0x7f4500017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:25.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.070+0000 7f44fa7fc700 1 -- 172.21.15.154:0/415564070 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500011b10 con 0x7f450c06f4b0 2023-10-10T22:18:25.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.070+0000 7f44fa7fc700 1 -- 172.21.15.154:0/415564070 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450001a430 con 0x7f450c06f4b0 2023-10-10T22:18:25.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.070+0000 7f44fa7fc700 1 -- 172.21.15.154:0/415564070 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450001a7f0 con 0x7f450c06f4b0 2023-10-10T22:18:25.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.070+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4500009420 con 0x7f450c06f4b0 2023-10-10T22:18:25.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.070+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c0c52e0 con 0x7f450c06f4b0 2023-10-10T22:18:25.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.071+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c06c450 con 0x7f450c06f4b0 2023-10-10T22:18:25.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.072+0000 7f44fa7fc700 1 -- 172.21.15.154:0/415564070 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f450001aba0 con 0x7f450c06f4b0 2023-10-10T22:18:25.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.073+0000 7f44fa7fc700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f44ec066f30 0x7f44ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:25.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.073+0000 7f44fa7fc700 1 -- 172.21.15.154:0/415564070 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f4500085d10 con 0x7f450c06f4b0 2023-10-10T22:18:25.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.073+0000 7f450a59c700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f44ec066f30 0x7f44ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:25.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.074+0000 7f450a59c700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f44ec066f30 0x7f44ec0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44fc005c50 tx=0x7f44fc009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:25.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.078+0000 7f44fa7fc700 1 -- 172.21.15.154:0/415564070 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4500052db0 con 0x7f450c06f4b0 2023-10-10T22:18:25.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:25.315+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f450c15b000 con 0x7f450c06f4b0 2023-10-10T22:18:26.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.021+0000 7f44fa7fc700 1 -- 172.21.15.154:0/415564070 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f45000150b0 con 0x7f450c06f4b0 2023-10-10T22:18:26.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f44ec066f30 msgr2=0x7f44ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:26.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f44ec066f30 0x7f44ec0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44fc005c50 tx=0x7f44fc009040 comp rx=0 tx=0).stop 2023-10-10T22:18:26.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f450c06f4b0 msgr2=0x7f450c1667c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:26.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f450c06f4b0 0x7f450c1667c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f450c06ce80 tx=0x7f4500017000 comp rx=0 tx=0).stop 2023-10-10T22:18:26.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 shutdown_connections 2023-10-10T22:18:26.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f450c0cb1a0 0x7f450c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:26.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f450c06f060 0x7f450c0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:26.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f44ec066f30 0x7f44ec0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:26.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 --2- 172.21.15.154:0/415564070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f450c06f4b0 0x7f450c1667c0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:26.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 >> 172.21.15.154:0/415564070 conn(0x7f450c0cc1e0 msgr2=0x7f450c0c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:26.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 shutdown_connections 2023-10-10T22:18:26.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.024+0000 7f450b59e700 1 -- 172.21.15.154:0/415564070 wait complete. 2023-10-10T22:18:26.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T22:18:26.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.230+0000 7f2eb759e700 1 Processor -- start 2023-10-10T22:18:26.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.230+0000 7f2eb759e700 1 -- start start 2023-10-10T22:18:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.231+0000 7f2eb759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb81540c0 0x7f2eb8153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.231+0000 7f2eb759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2eb806a7f0 0x7f2eb80b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.231+0000 7f2eb759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb8158640 con 0x7f2eb80b07d0 2023-10-10T22:18:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.231+0000 7f2eb759e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb8154490 con 0x7f2eb806a7f0 2023-10-10T22:18:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.231+0000 7f2eb759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8157a30 con 0x7f2eb81540c0 2023-10-10T22:18:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eaffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2eb806a7f0 0x7f2eb80b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eaffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2eb806a7f0 0x7f2eb80b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40456/0 (socket says 172.21.15.154:40456) 2023-10-10T22:18:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eaffff700 1 -- 172.21.15.154:0/2450164601 learned_addr learned my addr 172.21.15.154:0/2450164601 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eb659c700 1 --2- 172.21.15.154:0/2450164601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb81540c0 0x7f2eb8153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eaffff700 1 -- 172.21.15.154:0/2450164601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb81540c0 msgr2=0x7f2eb8153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eaffff700 1 --2- 172.21.15.154:0/2450164601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb81540c0 0x7f2eb8153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eaffff700 1 -- 172.21.15.154:0/2450164601 >> v1:172.21.15.179:6789/0 conn(0x7f2eb80b07d0 legacy=0x7f2eb8159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eaffff700 1 -- 172.21.15.154:0/2450164601 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8157d10 con 0x7f2eb806a7f0 2023-10-10T22:18:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eb659c700 1 --2- 172.21.15.154:0/2450164601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb81540c0 0x7f2eb8153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.232+0000 7f2eaffff700 1 --2- 172.21.15.154:0/2450164601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb806a7f0 0x7f2eb80b0290 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00099b0 tx=0x7f2ea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47e1bee14c2994f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb5d9b700 1 -- 172.21.15.154:0/2450164601 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000b820 con 0x7f2eb806a7f0 2023-10-10T22:18:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb5d9b700 1 -- 172.21.15.154:0/2450164601 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea000b980 con 0x7f2eb806a7f0 2023-10-10T22:18:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb5d9b700 1 -- 172.21.15.154:0/2450164601 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000bd20 con 0x7f2eb806a7f0 2023-10-10T22:18:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb759e700 1 -- 172.21.15.154:0/2450164601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb806a7f0 msgr2=0x7f2eb80b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb759e700 1 --2- 172.21.15.154:0/2450164601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb806a7f0 0x7f2eb80b0290 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00099b0 tx=0x7f2ea0009250 comp rx=0 tx=0).stop 2023-10-10T22:18:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb759e700 1 -- 172.21.15.154:0/2450164601 shutdown_connections 2023-10-10T22:18:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb759e700 1 --2- 172.21.15.154:0/2450164601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb81540c0 0x7f2eb8153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb759e700 1 --2- 172.21.15.154:0/2450164601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb806a7f0 0x7f2eb80b0290 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb759e700 1 -- 172.21.15.154:0/2450164601 >> 172.21.15.154:0/2450164601 conn(0x7f2eb8068390 msgr2=0x7f2eb8068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb759e700 1 -- 172.21.15.154:0/2450164601 shutdown_connections 2023-10-10T22:18:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.233+0000 7f2eb759e700 1 -- 172.21.15.154:0/2450164601 wait complete. 2023-10-10T22:18:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.235+0000 7f2eb759e700 1 Processor -- start 2023-10-10T22:18:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.235+0000 7f2eb759e700 1 -- start start 2023-10-10T22:18:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb806a7f0 0x7f2eb8158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb80b07d0 0x7f2eb81516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb81540c0 0x7f2eb815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb815bcb0 con 0x7f2eb81540c0 2023-10-10T22:18:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb815bf70 con 0x7f2eb806a7f0 2023-10-10T22:18:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb815c250 con 0x7f2eb80b07d0 2023-10-10T22:18:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb81540c0 0x7f2eb815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb81540c0 0x7f2eb815a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40460/0 (socket says 172.21.15.154:40460) 2023-10-10T22:18:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb6d9d700 1 -- 172.21.15.154:0/934993346 learned_addr learned my addr 172.21.15.154:0/934993346 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb659c700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb806a7f0 0x7f2eb8158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eaffff700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb80b07d0 0x7f2eb81516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb6d9d700 1 -- 172.21.15.154:0/934993346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb80b07d0 msgr2=0x7f2eb81516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb6d9d700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb80b07d0 0x7f2eb81516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb6d9d700 1 -- 172.21.15.154:0/934993346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb806a7f0 msgr2=0x7f2eb8158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.236+0000 7f2eb6d9d700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb806a7f0 0x7f2eb8158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.237+0000 7f2eb6d9d700 1 -- 172.21.15.154:0/934993346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea00094f0 con 0x7f2eb81540c0 2023-10-10T22:18:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.237+0000 7f2eb6d9d700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb81540c0 0x7f2eb815a020 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c890 tx=0x7f2eb00026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.237+0000 7f2eae7fc700 1 -- 172.21.15.154:0/934993346 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0012630 con 0x7f2eb81540c0 2023-10-10T22:18:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.237+0000 7f2eae7fc700 1 -- 172.21.15.154:0/934993346 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb0012790 con 0x7f2eb81540c0 2023-10-10T22:18:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.237+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb815c530 con 0x7f2eb81540c0 2023-10-10T22:18:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.237+0000 7f2eae7fc700 1 -- 172.21.15.154:0/934993346 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0012b50 con 0x7f2eb81540c0 2023-10-10T22:18:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.237+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb8151be0 con 0x7f2eb81540c0 2023-10-10T22:18:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.238+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb806c450 con 0x7f2eb81540c0 2023-10-10T22:18:26.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.239+0000 7f2eae7fc700 1 -- 172.21.15.154:0/934993346 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2eb000a420 con 0x7f2eb81540c0 2023-10-10T22:18:26.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.240+0000 7f2eae7fc700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2e98066fb0 0x7f2e98069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:26.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.240+0000 7f2eae7fc700 1 -- 172.21.15.154:0/934993346 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2eb0084b80 con 0x7f2eb81540c0 2023-10-10T22:18:26.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.240+0000 7f2eb659c700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2e98066fb0 0x7f2e98069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:26.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.241+0000 7f2eb659c700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2e98066fb0 0x7f2e98069460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8006fd0 tx=0x7f2ea8008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:26.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.244+0000 7f2eae7fc700 1 -- 172.21.15.154:0/934993346 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2eb0051b80 con 0x7f2eb81540c0 2023-10-10T22:18:26.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:26.478+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2eb815c0b0 con 0x7f2eb81540c0 2023-10-10T22:18:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.027+0000 7f2eae7fc700 1 -- 172.21.15.154:0/934993346 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2eb815c0b0 con 0x7f2eb81540c0 2023-10-10T22:18:27.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2e98066fb0 msgr2=0x7f2e98069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2e98066fb0 0x7f2e98069460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8006fd0 tx=0x7f2ea8008040 comp rx=0 tx=0).stop 2023-10-10T22:18:27.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb81540c0 msgr2=0x7f2eb815a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb81540c0 0x7f2eb815a020 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c890 tx=0x7f2eb00026a0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 shutdown_connections 2023-10-10T22:18:27.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2e98066fb0 0x7f2e98069460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb81540c0 0x7f2eb815a020 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb806a7f0 0x7f2eb8158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 --2- 172.21.15.154:0/934993346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2eb80b07d0 0x7f2eb81516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 >> 172.21.15.154:0/934993346 conn(0x7f2eb8068390 msgr2=0x7f2eb81546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 shutdown_connections 2023-10-10T22:18:27.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.030+0000 7f2eb759e700 1 -- 172.21.15.154:0/934993346 wait complete. 2023-10-10T22:18:27.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:18:27.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.235+0000 7ff71239d700 1 Processor -- start 2023-10-10T22:18:27.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.235+0000 7ff71239d700 1 -- start start 2023-10-10T22:18:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71239d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff70c157270 0x7ff70c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71239d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff70c0688d0 0x7ff70c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71239d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70c15a980 con 0x7ff70c0b0a00 2023-10-10T22:18:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71239d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c15e310 con 0x7ff70c157270 2023-10-10T22:18:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71239d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c068d50 con 0x7ff70c0688d0 2023-10-10T22:18:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71139b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff70c157270 0x7ff70c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71139b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff70c157270 0x7ff70c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40472/0 (socket says 172.21.15.154:40472) 2023-10-10T22:18:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71139b700 1 -- 172.21.15.154:0/2955183365 learned_addr learned my addr 172.21.15.154:0/2955183365 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff711b9c700 1 --1- 172.21.15.154:0/2955183365 >> v1:172.21.15.154:6789/0 conn(0x7ff70c0b0a00 0x7ff70c06a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54068/0 (socket says 172.21.15.154:54068) 2023-10-10T22:18:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff710b9a700 1 --2- 172.21.15.154:0/2955183365 >> v2:172.21.15.179:3300/0 conn(0x7ff70c0688d0 0x7ff70c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71139b700 1 -- 172.21.15.154:0/2955183365 >> v2:172.21.15.179:3300/0 conn(0x7ff70c0688d0 msgr2=0x7ff70c0b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71139b700 1 --2- 172.21.15.154:0/2955183365 >> v2:172.21.15.179:3300/0 conn(0x7ff70c0688d0 0x7ff70c0b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.237+0000 7ff71139b700 1 -- 172.21.15.154:0/2955183365 >> v1:172.21.15.154:6789/0 conn(0x7ff70c0b0a00 legacy=0x7ff70c06a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.238+0000 7ff71139b700 1 -- 172.21.15.154:0/2955183365 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c15a050 con 0x7ff70c157270 2023-10-10T22:18:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.238+0000 7ff703fff700 1 -- 172.21.15.154:0/2955183365 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377438731 0 0) 0x7ff70c15a980 con 0x7ff70c0b0a00 2023-10-10T22:18:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.238+0000 7ff71139b700 1 --2- 172.21.15.154:0/2955183365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c157270 0x7ff70c068390 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff70c06ed40 tx=0x7ff708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2f74abfa6f8012 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.238+0000 7ff703fff700 1 -- 172.21.15.154:0/2955183365 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70800b820 con 0x7ff70c157270 2023-10-10T22:18:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.238+0000 7ff703fff700 1 -- 172.21.15.154:0/2955183365 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70800b980 con 0x7ff70c157270 2023-10-10T22:18:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.238+0000 7ff703fff700 1 -- 172.21.15.154:0/2955183365 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70800bd20 con 0x7ff70c157270 2023-10-10T22:18:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.238+0000 7ff71239d700 1 -- 172.21.15.154:0/2955183365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c157270 msgr2=0x7ff70c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.238+0000 7ff71239d700 1 --2- 172.21.15.154:0/2955183365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c157270 0x7ff70c068390 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff70c06ed40 tx=0x7ff708009250 comp rx=0 tx=0).stop 2023-10-10T22:18:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.239+0000 7ff71239d700 1 -- 172.21.15.154:0/2955183365 shutdown_connections 2023-10-10T22:18:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.239+0000 7ff71239d700 1 --2- 172.21.15.154:0/2955183365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c157270 0x7ff70c068390 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.239+0000 7ff71239d700 1 --2- 172.21.15.154:0/2955183365 >> v2:172.21.15.179:3300/0 conn(0x7ff70c0688d0 0x7ff70c0b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.239+0000 7ff71239d700 1 -- 172.21.15.154:0/2955183365 >> 172.21.15.154:0/2955183365 conn(0x7ff70c0cd310 msgr2=0x7ff70c0cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.239+0000 7ff71239d700 1 -- 172.21.15.154:0/2955183365 shutdown_connections 2023-10-10T22:18:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.239+0000 7ff71239d700 1 -- 172.21.15.154:0/2955183365 wait complete. 2023-10-10T22:18:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.240+0000 7ff71239d700 1 Processor -- start 2023-10-10T22:18:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.240+0000 7ff71239d700 1 -- start start 2023-10-10T22:18:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.241+0000 7ff71239d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff70c0688d0 0x7ff70c15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.241+0000 7ff71239d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c0b0a00 0x7ff70c0ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.241+0000 7ff71239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70c157270 0x7ff70c149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.241+0000 7ff71239d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c14a2c0 con 0x7ff70c0b0a00 2023-10-10T22:18:27.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.241+0000 7ff71239d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c149990 con 0x7ff70c0688d0 2023-10-10T22:18:27.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.241+0000 7ff71239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c149c70 con 0x7ff70c157270 2023-10-10T22:18:27.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.241+0000 7ff710b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c0b0a00 0x7ff70c0ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.241+0000 7ff710b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c0b0a00 0x7ff70c0ae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40488/0 (socket says 172.21.15.154:40488) 2023-10-10T22:18:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.241+0000 7ff710b9a700 1 -- 172.21.15.154:0/739956155 learned_addr learned my addr 172.21.15.154:0/739956155 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff71139b700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff70c0688d0 0x7ff70c15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff711b9c700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70c157270 0x7ff70c149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff710b9a700 1 -- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70c157270 msgr2=0x7ff70c149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff710b9a700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70c157270 0x7ff70c149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff710b9a700 1 -- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff70c0688d0 msgr2=0x7ff70c15bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff710b9a700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff70c0688d0 0x7ff70c15bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff710b9a700 1 -- 172.21.15.154:0/739956155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7080094f0 con 0x7ff70c0b0a00 2023-10-10T22:18:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff71139b700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff70c0688d0 0x7ff70c15bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff711b9c700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70c157270 0x7ff70c149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff710b9a700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c0b0a00 0x7ff70c0ae240 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00d890 tx=0x7ff6fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff7017fa700 1 -- 172.21.15.154:0/739956155 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00b600 con 0x7ff70c0b0a00 2023-10-10T22:18:27.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff7017fa700 1 -- 172.21.15.154:0/739956155 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00b760 con 0x7ff70c0b0a00 2023-10-10T22:18:27.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70c149f50 con 0x7ff70c0b0a00 2023-10-10T22:18:27.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff7017fa700 1 -- 172.21.15.154:0/739956155 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00bae0 con 0x7ff70c0b0a00 2023-10-10T22:18:27.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.242+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70c15c7f0 con 0x7ff70c0b0a00 2023-10-10T22:18:27.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.243+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70c14a470 con 0x7ff70c0b0a00 2023-10-10T22:18:27.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.244+0000 7ff7017fa700 1 -- 172.21.15.154:0/739956155 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6fc01e460 con 0x7ff70c0b0a00 2023-10-10T22:18:27.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.245+0000 7ff7017fa700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff6f0066f30 0x7ff6f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.245+0000 7ff7017fa700 1 -- 172.21.15.154:0/739956155 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7ff6fc084de0 con 0x7ff70c0b0a00 2023-10-10T22:18:27.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.245+0000 7ff71139b700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff6f0066f30 0x7ff6f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.246+0000 7ff71139b700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff6f0066f30 0x7ff6f00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff70c06ed40 tx=0x7ff708017000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:27.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.249+0000 7ff7017fa700 1 -- 172.21.15.154:0/739956155 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff70c14a470 con 0x7ff70c0b0a00 2023-10-10T22:18:27.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.548+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff70c04c3c0 con 0x7ff70c0b0a00 2023-10-10T22:18:27.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.549+0000 7ff7017fa700 1 -- 172.21.15.154:0/739956155 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4613 (secure 0 0 0) 0x7ff6fc051e80 con 0x7ff70c0b0a00 2023-10-10T22:18:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:27.551 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3140311410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3140311410},{"type":"v1","addr":"172.21.15.179:6835","nonce":3140311410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2649941331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2649941331},{"type":"v1","addr":"172.21.15.179:6834","nonce":2649941331}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3061056526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3061056526},{"type":"v1","addr":"172.21.15.154:6834","nonce":3061056526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:18:23.465253+0000","modified":"2023-10-10T22:18:27.020551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9138":{"gid":9138,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3697556207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3697556207},{"type":"v1","addr":"172.21.15.154:6835","nonce":3697556207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-10T22:18:27.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff6f0066f30 msgr2=0x7ff6f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff6f0066f30 0x7ff6f00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff70c06ed40 tx=0x7ff708017000 comp rx=0 tx=0).stop 2023-10-10T22:18:27.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c0b0a00 msgr2=0x7ff70c0ae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c0b0a00 0x7ff70c0ae240 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00d890 tx=0x7ff6fc008040 comp rx=0 tx=0).stop 2023-10-10T22:18:27.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 shutdown_connections 2023-10-10T22:18:27.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff70c157270 0x7ff70c149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff70c0688d0 0x7ff70c15bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff6f0066f30 0x7ff6f00693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 --2- 172.21.15.154:0/739956155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70c0b0a00 0x7ff70c0ae240 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.551+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 >> 172.21.15.154:0/739956155 conn(0x7ff70c0cd310 msgr2=0x7ff70c157640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:27.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.552+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 shutdown_connections 2023-10-10T22:18:27.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.552+0000 7ff71239d700 1 -- 172.21.15.154:0/739956155 wait complete. 2023-10-10T22:18:27.556 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 78 2023-10-10T22:18:27.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:18:27.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.754+0000 7f935b39d700 1 Processor -- start 2023-10-10T22:18:27.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.754+0000 7f935b39d700 1 -- start start 2023-10-10T22:18:27.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.755+0000 7f935b39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354150180 0x7f9354157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.755+0000 7f935b39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9354150550 0x7f93540c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.755+0000 7f935b39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935406e2a0 con 0x7f93540c7240 2023-10-10T22:18:27.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.755+0000 7f935b39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93540c76e0 con 0x7f9354150550 2023-10-10T22:18:27.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.755+0000 7f935b39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935406b2e0 con 0x7f9354150180 2023-10-10T22:18:27.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f935ab9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f93540c7240 0x7f9354069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54074/0 (socket says 172.21.15.154:54074) 2023-10-10T22:18:27.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f935ab9c700 1 -- 172.21.15.154:0/333802224 learned_addr learned my addr 172.21.15.154:0/333802224 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:27.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359b9a700 1 --2- 172.21.15.154:0/333802224 >> v2:172.21.15.179:3300/0 conn(0x7f9354150550 0x7f93540c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f935a39b700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354150180 0x7f9354157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290835613 0 0) 0x7f935406e2a0 con 0x7f93540c7240 2023-10-10T22:18:27.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9340003570 con 0x7f93540c7240 2023-10-10T22:18:27.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4117081513 0 0) 0x7f9340003570 con 0x7f93540c7240 2023-10-10T22:18:27.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354150180 msgr2=0x7f9354157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:27.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354150180 0x7f9354157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 >> v2:172.21.15.179:3300/0 conn(0x7f9354150550 msgr2=0x7f93540c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 --2- 172.21.15.154:0/333802224 >> v2:172.21.15.179:3300/0 conn(0x7f9354150550 0x7f93540c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93540c78e0 con 0x7f93540c7240 2023-10-10T22:18:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f934c0017f0 con 0x7f93540c7240 2023-10-10T22:18:27.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.756+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 >> v1:172.21.15.154:6789/0 conn(0x7f93540c7240 legacy=0x7f9354069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f9359399700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340003ae0 0x7f9340003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f9359399700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354150180 0x7f9340004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f9359399700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9340004d50 0x7f93400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93540c76e0 con 0x7f9340004d50 2023-10-10T22:18:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935406b2e0 con 0x7f9340003ae0 2023-10-10T22:18:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934000bb10 con 0x7f9354150180 2023-10-10T22:18:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f935ab9c700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9340004d50 0x7f93400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f9359b9a700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354150180 0x7f9340004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f935a39b700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340003ae0 0x7f9340003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f935ab9c700 1 -- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354150180 msgr2=0x7f9340004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f935ab9c700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354150180 0x7f9340004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f935ab9c700 1 -- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340003ae0 msgr2=0x7f9340003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:27.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f935ab9c700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340003ae0 0x7f9340003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.757+0000 7f935ab9c700 1 -- 172.21.15.154:0/333802224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340003570 con 0x7f9340004d50 2023-10-10T22:18:27.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f935ab9c700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9340004d50 0x7f93400051c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f934c00a8c0 tx=0x7f935406e210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddc8d6ffe2192a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:27.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c0070f0 con 0x7f9340004d50 2023-10-10T22:18:27.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c007250 con 0x7f9340004d50 2023-10-10T22:18:27.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f9359399700 1 -- 172.21.15.154:0/333802224 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c007610 con 0x7f9340004d50 2023-10-10T22:18:27.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f935b39d700 1 -- 172.21.15.154:0/333802224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9340004d50 msgr2=0x7f93400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f935b39d700 1 --2- 172.21.15.154:0/333802224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9340004d50 0x7f93400051c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f934c00a8c0 tx=0x7f935406e210 comp rx=0 tx=0).stop 2023-10-10T22:18:27.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f935ab9c700 1 -- 172.21.15.154:0/333802224 reap_dead start 2023-10-10T22:18:27.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f935b39d700 1 -- 172.21.15.154:0/333802224 shutdown_connections 2023-10-10T22:18:27.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f935b39d700 1 -- 172.21.15.154:0/333802224 >> 172.21.15.154:0/333802224 conn(0x7f93540cc1f0 msgr2=0x7f93540cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:27.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f935b39d700 1 -- 172.21.15.154:0/333802224 shutdown_connections 2023-10-10T22:18:27.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.758+0000 7f935b39d700 1 -- 172.21.15.154:0/333802224 wait complete. 2023-10-10T22:18:27.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.760+0000 7f935b39d700 1 Processor -- start 2023-10-10T22:18:27.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.760+0000 7f935b39d700 1 -- start start 2023-10-10T22:18:27.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f935b39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340004d50 0x7f9354146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f935b39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93540aef90 0x7f93540ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f935b39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354169db0 0x7f935416a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f935b39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935416ae40 con 0x7f93540aef90 2023-10-10T22:18:27.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f935b39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9354147450 con 0x7f9340004d50 2023-10-10T22:18:27.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f935b39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93540ad3d0 con 0x7f9354169db0 2023-10-10T22:18:27.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f9359b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93540aef90 0x7f93540ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f9359b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93540aef90 0x7f93540ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40510/0 (socket says 172.21.15.154:40510) 2023-10-10T22:18:27.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f9359b9a700 1 -- 172.21.15.154:0/1462133196 learned_addr learned my addr 172.21.15.154:0/1462133196 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:27.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f935ab9c700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354169db0 0x7f935416a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f935a39b700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340004d50 0x7f9354146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f9359b9a700 1 -- 172.21.15.154:0/1462133196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354169db0 msgr2=0x7f935416a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f9359b9a700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354169db0 0x7f935416a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f9359b9a700 1 -- 172.21.15.154:0/1462133196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340004d50 msgr2=0x7f9354146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f9359b9a700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340004d50 0x7f9354146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f9359b9a700 1 -- 172.21.15.154:0/1462133196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935416ab60 con 0x7f93540aef90 2023-10-10T22:18:27.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.761+0000 7f935a39b700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340004d50 0x7f9354146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:27.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.762+0000 7f9359b9a700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93540aef90 0x7f93540ace90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f9344006ac0 tx=0x7f93440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:27.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.762+0000 7f934a7fc700 1 -- 172.21.15.154:0/1462133196 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934400fa10 con 0x7f93540aef90 2023-10-10T22:18:27.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.762+0000 7f934a7fc700 1 -- 172.21.15.154:0/1462133196 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934400fb70 con 0x7f93540aef90 2023-10-10T22:18:27.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.762+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93540b13b0 con 0x7f93540aef90 2023-10-10T22:18:27.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.762+0000 7f934a7fc700 1 -- 172.21.15.154:0/1462133196 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344014440 con 0x7f93540aef90 2023-10-10T22:18:27.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.762+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9354146b70 con 0x7f93540aef90 2023-10-10T22:18:27.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.763+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93540b18d0 con 0x7f93540aef90 2023-10-10T22:18:27.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.764+0000 7f934a7fc700 1 -- 172.21.15.154:0/1462133196 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9344014830 con 0x7f93540aef90 2023-10-10T22:18:27.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.765+0000 7f934a7fc700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9338066f30 0x7f93380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:27.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.765+0000 7f934a7fc700 1 -- 172.21.15.154:0/1462133196 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f9344018030 con 0x7f93540aef90 2023-10-10T22:18:27.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.765+0000 7f935a39b700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9338066f30 0x7f93380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:27.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.766+0000 7f935a39b700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9338066f30 0x7f93380693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93540ae6f0 tx=0x7f9350008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:27.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.769+0000 7f934a7fc700 1 -- 172.21.15.154:0/1462133196 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93540b18d0 con 0x7f93540aef90 2023-10-10T22:18:27.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.961+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93540b18d0 con 0x7f93540aef90 2023-10-10T22:18:27.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.962+0000 7f934a7fc700 1 -- 172.21.15.154:0/1462133196 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16123 (secure 0 0 0) 0x7f93540b18d0 con 0x7f93540aef90 2023-10-10T22:18:27.964 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:27.964 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":175,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:18:25.008782+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:18:21.404071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-10T22:18:22.445408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:18:27.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9338066f30 msgr2=0x7f93380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9338066f30 0x7f93380693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93540ae6f0 tx=0x7f9350008040 comp rx=0 tx=0).stop 2023-10-10T22:18:27.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93540aef90 msgr2=0x7f93540ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:27.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93540aef90 0x7f93540ace90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f9344006ac0 tx=0x7f93440091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 shutdown_connections 2023-10-10T22:18:27.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9354169db0 0x7f935416a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340004d50 0x7f9354146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f9338066f30 0x7f93380693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 --2- 172.21.15.154:0/1462133196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93540aef90 0x7f93540ace90 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:27.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 >> 172.21.15.154:0/1462133196 conn(0x7f93540cc1f0 msgr2=0x7f93540696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:27.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 shutdown_connections 2023-10-10T22:18:27.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:27.965+0000 7f935b39d700 1 -- 172.21.15.154:0/1462133196 wait complete. 2023-10-10T22:18:27.984 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T22:18:27.985 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:18:28.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.169+0000 7fc5e93ff700 1 Processor -- start 2023-10-10T22:18:28.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.169+0000 7fc5e93ff700 1 -- start start 2023-10-10T22:18:28.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.170+0000 7fc5e93ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc5e40cbf30 0x7fc5e40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.170+0000 7fc5e93ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5e40ccf90 0x7fc5e40b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.170+0000 7fc5e93ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e40cc300 con 0x7fc5e415a270 2023-10-10T22:18:28.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.170+0000 7fc5e93ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e4156bf0 con 0x7fc5e40ccf90 2023-10-10T22:18:28.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.170+0000 7fc5e93ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e40ae950 con 0x7fc5e40cbf30 2023-10-10T22:18:28.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e27fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5e40ccf90 0x7fc5e40b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e27fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5e40ccf90 0x7fc5e40b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40512/0 (socket says 172.21.15.154:40512) 2023-10-10T22:18:28.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e27fc700 1 -- 172.21.15.154:0/24569381 learned_addr learned my addr 172.21.15.154:0/24569381 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:28.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e2ffd700 1 --2- 172.21.15.154:0/24569381 >> v2:172.21.15.179:3300/0 conn(0x7fc5e40cbf30 0x7fc5e40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e27fc700 1 -- 172.21.15.154:0/24569381 >> v2:172.21.15.179:3300/0 conn(0x7fc5e40cbf30 msgr2=0x7fc5e40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:28.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e27fc700 1 --2- 172.21.15.154:0/24569381 >> v2:172.21.15.179:3300/0 conn(0x7fc5e40cbf30 0x7fc5e40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e27fc700 1 -- 172.21.15.154:0/24569381 >> v1:172.21.15.179:6789/0 conn(0x7fc5e415a270 legacy=0x7fc5e40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e27fc700 1 -- 172.21.15.154:0/24569381 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40ad370 con 0x7fc5e40ccf90 2023-10-10T22:18:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e27fc700 1 --2- 172.21.15.154:0/24569381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 0x7fc5e40b0d10 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4063d40 tx=0x7fc5d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b4e3276a8a4dab server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.171+0000 7fc5e1ffb700 1 -- 172.21.15.154:0/24569381 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800b820 con 0x7fc5e40ccf90 2023-10-10T22:18:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e1ffb700 1 -- 172.21.15.154:0/24569381 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d800b980 con 0x7fc5e40ccf90 2023-10-10T22:18:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e1ffb700 1 -- 172.21.15.154:0/24569381 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800bd20 con 0x7fc5e40ccf90 2023-10-10T22:18:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e93ff700 1 -- 172.21.15.154:0/24569381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 msgr2=0x7fc5e40b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e93ff700 1 --2- 172.21.15.154:0/24569381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 0x7fc5e40b0d10 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4063d40 tx=0x7fc5d8009250 comp rx=0 tx=0).stop 2023-10-10T22:18:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e93ff700 1 -- 172.21.15.154:0/24569381 shutdown_connections 2023-10-10T22:18:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e93ff700 1 --2- 172.21.15.154:0/24569381 >> v2:172.21.15.179:3300/0 conn(0x7fc5e40cbf30 0x7fc5e40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e93ff700 1 --2- 172.21.15.154:0/24569381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 0x7fc5e40b0d10 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e93ff700 1 -- 172.21.15.154:0/24569381 >> 172.21.15.154:0/24569381 conn(0x7fc5e406a320 msgr2=0x7fc5e40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e93ff700 1 -- 172.21.15.154:0/24569381 shutdown_connections 2023-10-10T22:18:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.172+0000 7fc5e93ff700 1 -- 172.21.15.154:0/24569381 wait complete. 2023-10-10T22:18:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.174+0000 7fc5e93ff700 1 Processor -- start 2023-10-10T22:18:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.174+0000 7fc5e93ff700 1 -- start start 2023-10-10T22:18:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e40cbf30 0x7fc5e4152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e93ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 0x7fc5e40aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e93ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e415a270 0x7fc5e40ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e93ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e41528b0 con 0x7fc5e40ccf90 2023-10-10T22:18:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e93ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4157560 con 0x7fc5e415a270 2023-10-10T22:18:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e40aac50 con 0x7fc5e40cbf30 2023-10-10T22:18:28.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 0x7fc5e40aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 0x7fc5e40aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40524/0 (socket says 172.21.15.154:40524) 2023-10-10T22:18:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e27fc700 1 -- 172.21.15.154:0/3599979189 learned_addr learned my addr 172.21.15.154:0/3599979189 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e2ffd700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e40cbf30 0x7fc5e4152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.175+0000 7fc5e37fe700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e415a270 0x7fc5e40ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5e27fc700 1 -- 172.21.15.154:0/3599979189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e40cbf30 msgr2=0x7fc5e4152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5e27fc700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e40cbf30 0x7fc5e4152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5e27fc700 1 -- 172.21.15.154:0/3599979189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e415a270 msgr2=0x7fc5e40ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5e27fc700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e415a270 0x7fc5e40ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5e27fc700 1 -- 172.21.15.154:0/3599979189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d80094f0 con 0x7fc5e40ccf90 2023-10-10T22:18:28.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5e37fe700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e415a270 0x7fc5e40ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:28.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5e27fc700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 0x7fc5e40aa290 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80094c0 tx=0x7fc5d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:28.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5caffd700 1 -- 172.21.15.154:0/3599979189 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800bd00 con 0x7fc5e40ccf90 2023-10-10T22:18:28.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5caffd700 1 -- 172.21.15.154:0/3599979189 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d8024440 con 0x7fc5e40ccf90 2023-10-10T22:18:28.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e4156f10 con 0x7fc5e40ccf90 2023-10-10T22:18:28.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5caffd700 1 -- 172.21.15.154:0/3599979189 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80247e0 con 0x7fc5e40ccf90 2023-10-10T22:18:28.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.176+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e40c7f50 con 0x7fc5e40ccf90 2023-10-10T22:18:28.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.177+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e4156d70 con 0x7fc5e40ccf90 2023-10-10T22:18:28.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.178+0000 7fc5caffd700 1 -- 172.21.15.154:0/3599979189 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5d802d440 con 0x7fc5e40ccf90 2023-10-10T22:18:28.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.179+0000 7fc5caffd700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc5d0066f30 0x7fc5d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.179+0000 7fc5caffd700 1 -- 172.21.15.154:0/3599979189 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fc5d8086220 con 0x7fc5e40ccf90 2023-10-10T22:18:28.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.179+0000 7fc5e2ffd700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc5d0066f30 0x7fc5d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.180+0000 7fc5e2ffd700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc5d0066f30 0x7fc5d00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4006fd0 tx=0x7fc5d4008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:28.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.183+0000 7fc5caffd700 1 -- 172.21.15.154:0/3599979189 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5e4156d70 con 0x7fc5e40ccf90 2023-10-10T22:18:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.368+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc5e4156d70 con 0x7fc5d0066f30 2023-10-10T22:18:28.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.379+0000 7fc5caffd700 1 -- 172.21.15.154:0/3599979189 <== mgr.8940 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282712 (secure 0 0 0) 0x7fc5e4156d70 con 0x7fc5d0066f30 2023-10-10T22:18:28.384 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:28.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc5d0066f30 msgr2=0x7fc5d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc5d0066f30 0x7fc5d00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4006fd0 tx=0x7fc5d4008040 comp rx=0 tx=0).stop 2023-10-10T22:18:28.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 msgr2=0x7fc5e40aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 0x7fc5e40aa290 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80094c0 tx=0x7fc5d8017000 comp rx=0 tx=0).stop 2023-10-10T22:18:28.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 shutdown_connections 2023-10-10T22:18:28.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e415a270 0x7fc5e40ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e40cbf30 0x7fc5e4152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fc5d0066f30 0x7fc5d00693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 --2- 172.21.15.154:0/3599979189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e40ccf90 0x7fc5e40aa290 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 >> 172.21.15.154:0/3599979189 conn(0x7fc5e406a320 msgr2=0x7fc5e4068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:28.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 shutdown_connections 2023-10-10T22:18:28.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.383+0000 7fc5e93ff700 1 -- 172.21.15.154:0/3599979189 wait complete. 2023-10-10T22:18:28.389 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:18:28.402 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:18:27.725109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":489,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2478240,"kb_used_data":18016,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752496480,"statfs":{"total":773094113280,"available":770556395520,"internally_reserved":0,"allocated":18448384,"data_stored":9752759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.745001"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021876+0000","last_change":"2023-10-10T22:18:24.019023+0000","last_active":"2023-10-10T22:18:24.021876+0000","last_peered":"2023-10-10T22:18:24.021876+0000","last_clean":"2023-10-10T22:18:24.021876+0000","last_became_active":"2023-10-10T22:18:24.018737+0000","last_became_peered":"2023-10-10T22:18:24.018737+0000","last_unstale":"2023-10-10T22:18:24.021876+0000","last_undegraded":"2023-10-10T22:18:24.021876+0000","last_fullsized":"2023-10-10T22:18:24.021876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:57.526292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030348+0000","last_change":"2023-10-10T22:18:24.017068+0000","last_active":"2023-10-10T22:18:24.030348+0000","last_peered":"2023-10-10T22:18:24.030348+0000","last_clean":"2023-10-10T22:18:24.030348+0000","last_became_active":"2023-10-10T22:18:24.016811+0000","last_became_peered":"2023-10-10T22:18:24.016811+0000","last_unstale":"2023-10-10T22:18:24.030348+0000","last_undegraded":"2023-10-10T22:18:24.030348+0000","last_fullsized":"2023-10-10T22:18:24.030348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:25.109025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.033056+0000","last_change":"2023-10-10T22:18:24.028207+0000","last_active":"2023-10-10T22:18:24.033056+0000","last_peered":"2023-10-10T22:18:24.033056+0000","last_clean":"2023-10-10T22:18:24.033056+0000","last_became_active":"2023-10-10T22:18:24.027960+0000","last_became_peered":"2023-10-10T22:18:24.027960+0000","last_unstale":"2023-10-10T22:18:24.033056+0000","last_undegraded":"2023-10-10T22:18:24.033056+0000","last_fullsized":"2023-10-10T22:18:24.033056+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:45:32.609233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022006+0000","last_change":"2023-10-10T22:18:24.014367+0000","last_active":"2023-10-10T22:18:24.022006+0000","last_peered":"2023-10-10T22:18:24.022006+0000","last_clean":"2023-10-10T22:18:24.022006+0000","last_became_active":"2023-10-10T22:18:24.014089+0000","last_became_peered":"2023-10-10T22:18:24.014089+0000","last_unstale":"2023-10-10T22:18:24.022006+0000","last_undegraded":"2023-10-10T22:18:24.022006+0000","last_fullsized":"2023-10-10T22:18:24.022006+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:55:05.545484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022327+0000","last_change":"2023-10-10T22:18:24.019997+0000","last_active":"2023-10-10T22:18:24.022327+0000","last_peered":"2023-10-10T22:18:24.022327+0000","last_clean":"2023-10-10T22:18:24.022327+0000","last_became_active":"2023-10-10T22:18:24.019623+0000","last_became_peered":"2023-10-10T22:18:24.019623+0000","last_unstale":"2023-10-10T22:18:24.022327+0000","last_undegraded":"2023-10-10T22:18:24.022327+0000","last_fullsized":"2023-10-10T22:18:24.022327+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:34:34.643756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029552+0000","last_change":"2023-10-10T22:18:24.012307+0000","last_active":"2023-10-10T22:18:24.029552+0000","last_peered":"2023-10-10T22:18:24.029552+0000","last_clean":"2023-10-10T22:18:24.029552+0000","last_became_active":"2023-10-10T22:18:24.012048+0000","last_became_peered":"2023-10-10T22:18:24.012048+0000","last_unstale":"2023-10-10T22:18:24.029552+0000","last_undegraded":"2023-10-10T22:18:24.029552+0000","last_fullsized":"2023-10-10T22:18:24.029552+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:52:27.774330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021544+0000","last_change":"2023-10-10T22:18:24.020520+0000","last_active":"2023-10-10T22:18:24.021544+0000","last_peered":"2023-10-10T22:18:24.021544+0000","last_clean":"2023-10-10T22:18:24.021544+0000","last_became_active":"2023-10-10T22:18:24.019865+0000","last_became_peered":"2023-10-10T22:18:24.019865+0000","last_unstale":"2023-10-10T22:18:24.021544+0000","last_undegraded":"2023-10-10T22:18:24.021544+0000","last_fullsized":"2023-10-10T22:18:24.021544+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:40.234186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.020613+0000","last_change":"2023-10-10T22:18:24.016131+0000","last_active":"2023-10-10T22:18:24.020613+0000","last_peered":"2023-10-10T22:18:24.020613+0000","last_clean":"2023-10-10T22:18:24.020613+0000","last_became_active":"2023-10-10T22:18:24.015862+0000","last_became_peered":"2023-10-10T22:18:24.015862+0000","last_unstale":"2023-10-10T22:18:24.020613+0000","last_undegraded":"2023-10-10T22:18:24.020613+0000","last_fullsized":"2023-10-10T22:18:24.020613+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:06.996520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022295+0000","last_change":"2023-10-10T22:18:24.020650+0000","last_active":"2023-10-10T22:18:24.022295+0000","last_peered":"2023-10-10T22:18:24.022295+0000","last_clean":"2023-10-10T22:18:24.022295+0000","last_became_active":"2023-10-10T22:18:24.020281+0000","last_became_peered":"2023-10-10T22:18:24.020281+0000","last_unstale":"2023-10-10T22:18:24.022295+0000","last_undegraded":"2023-10-10T22:18:24.022295+0000","last_fullsized":"2023-10-10T22:18:24.022295+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:21.748391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030201+0000","last_change":"2023-10-10T22:18:24.026148+0000","last_active":"2023-10-10T22:18:24.030201+0000","last_peered":"2023-10-10T22:18:24.030201+0000","last_clean":"2023-10-10T22:18:24.030201+0000","last_became_active":"2023-10-10T22:18:24.025843+0000","last_became_peered":"2023-10-10T22:18:24.025843+0000","last_unstale":"2023-10-10T22:18:24.030201+0000","last_undegraded":"2023-10-10T22:18:24.030201+0000","last_fullsized":"2023-10-10T22:18:24.030201+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:52:39.870836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.032827+0000","last_change":"2023-10-10T22:18:24.028969+0000","last_active":"2023-10-10T22:18:24.032827+0000","last_peered":"2023-10-10T22:18:24.032827+0000","last_clean":"2023-10-10T22:18:24.032827+0000","last_became_active":"2023-10-10T22:18:24.028680+0000","last_became_peered":"2023-10-10T22:18:24.028680+0000","last_unstale":"2023-10-10T22:18:24.032827+0000","last_undegraded":"2023-10-10T22:18:24.032827+0000","last_fullsized":"2023-10-10T22:18:24.032827+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:52:06.319920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029522+0000","last_change":"2023-10-10T22:18:24.019584+0000","last_active":"2023-10-10T22:18:24.029522+0000","last_peered":"2023-10-10T22:18:24.029522+0000","last_clean":"2023-10-10T22:18:24.029522+0000","last_became_active":"2023-10-10T22:18:24.017476+0000","last_became_peered":"2023-10-10T22:18:24.017476+0000","last_unstale":"2023-10-10T22:18:24.029522+0000","last_undegraded":"2023-10-10T22:18:24.029522+0000","last_fullsized":"2023-10-10T22:18:24.029522+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:09:57.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.989830+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:52:38.865973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029570+0000","last_change":"2023-10-10T22:18:24.016367+0000","last_active":"2023-10-10T22:18:24.029570+0000","last_peered":"2023-10-10T22:18:24.029570+0000","last_clean":"2023-10-10T22:18:24.029570+0000","last_became_active":"2023-10-10T22:18:24.016118+0000","last_became_peered":"2023-10-10T22:18:24.016118+0000","last_unstale":"2023-10-10T22:18:24.029570+0000","last_undegraded":"2023-10-10T22:18:24.029570+0000","last_fullsized":"2023-10-10T22:18:24.029570+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:29.994955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035344+0000","last_change":"2023-10-10T22:18:23.006424+0000","last_active":"2023-10-10T22:18:24.035344+0000","last_peered":"2023-10-10T22:18:24.035344+0000","last_clean":"2023-10-10T22:18:24.035344+0000","last_became_active":"2023-10-10T22:18:23.006146+0000","last_became_peered":"2023-10-10T22:18:23.006146+0000","last_unstale":"2023-10-10T22:18:24.035344+0000","last_undegraded":"2023-10-10T22:18:24.035344+0000","last_fullsized":"2023-10-10T22:18:24.035344+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:39.951998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021913+0000","last_change":"2023-10-10T22:18:24.020427+0000","last_active":"2023-10-10T22:18:24.021913+0000","last_peered":"2023-10-10T22:18:24.021913+0000","last_clean":"2023-10-10T22:18:24.021913+0000","last_became_active":"2023-10-10T22:18:24.020140+0000","last_became_peered":"2023-10-10T22:18:24.020140+0000","last_unstale":"2023-10-10T22:18:24.021913+0000","last_undegraded":"2023-10-10T22:18:24.021913+0000","last_fullsized":"2023-10-10T22:18:24.021913+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:14.720634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.983479+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:57:31.661736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.984490+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:36:10.302964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035793+0000","last_change":"2023-10-10T22:18:24.031358+0000","last_active":"2023-10-10T22:18:24.035793+0000","last_peered":"2023-10-10T22:18:24.035793+0000","last_clean":"2023-10-10T22:18:24.035793+0000","last_became_active":"2023-10-10T22:18:24.031085+0000","last_became_peered":"2023-10-10T22:18:24.031085+0000","last_unstale":"2023-10-10T22:18:24.035793+0000","last_undegraded":"2023-10-10T22:18:24.035793+0000","last_fullsized":"2023-10-10T22:18:24.035793+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:51:17.136910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.986162+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:47.262548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.982994+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:56.547744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029515+0000","last_change":"2023-10-10T22:18:24.015761+0000","last_active":"2023-10-10T22:18:24.029515+0000","last_peered":"2023-10-10T22:18:24.029515+0000","last_clean":"2023-10-10T22:18:24.029515+0000","last_became_active":"2023-10-10T22:18:24.015075+0000","last_became_peered":"2023-10-10T22:18:24.015075+0000","last_unstale":"2023-10-10T22:18:24.029515+0000","last_undegraded":"2023-10-10T22:18:24.029515+0000","last_fullsized":"2023-10-10T22:18:24.029515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:55.727284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987098+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:23.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.982989+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:00.678897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006101+0000","last_change":"2023-10-10T22:18:22.997265+0000","last_active":"2023-10-10T22:18:24.006101+0000","last_peered":"2023-10-10T22:18:24.006101+0000","last_clean":"2023-10-10T22:18:24.006101+0000","last_became_active":"2023-10-10T22:18:22.996999+0000","last_became_peered":"2023-10-10T22:18:22.996999+0000","last_unstale":"2023-10-10T22:18:24.006101+0000","last_undegraded":"2023-10-10T22:18:24.006101+0000","last_fullsized":"2023-10-10T22:18:24.006101+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:58.664586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988811+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:13:29.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"174'6","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038970+0000","last_change":"2023-10-10T22:18:23.008997+0000","last_active":"2023-10-10T22:18:24.038970+0000","last_peered":"2023-10-10T22:18:24.038970+0000","last_clean":"2023-10-10T22:18:24.038970+0000","last_became_active":"2023-10-10T22:18:23.008717+0000","last_became_peered":"2023-10-10T22:18:23.008717+0000","last_unstale":"2023-10-10T22:18:24.038970+0000","last_undegraded":"2023-10-10T22:18:24.038970+0000","last_fullsized":"2023-10-10T22:18:24.038970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:19.281968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988875+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:34.483848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029217+0000","last_change":"2023-10-10T22:18:24.012250+0000","last_active":"2023-10-10T22:18:24.029217+0000","last_peered":"2023-10-10T22:18:24.029217+0000","last_clean":"2023-10-10T22:18:24.029217+0000","last_became_active":"2023-10-10T22:18:24.011986+0000","last_became_peered":"2023-10-10T22:18:24.011986+0000","last_unstale":"2023-10-10T22:18:24.029217+0000","last_undegraded":"2023-10-10T22:18:24.029217+0000","last_fullsized":"2023-10-10T22:18:24.029217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:27.651167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987812+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:43:08.740102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007796+0000","last_change":"2023-10-10T22:18:23.002556+0000","last_active":"2023-10-10T22:18:24.007796+0000","last_peered":"2023-10-10T22:18:24.007796+0000","last_clean":"2023-10-10T22:18:24.007796+0000","last_became_active":"2023-10-10T22:18:23.002306+0000","last_became_peered":"2023-10-10T22:18:23.002306+0000","last_unstale":"2023-10-10T22:18:24.007796+0000","last_undegraded":"2023-10-10T22:18:24.007796+0000","last_fullsized":"2023-10-10T22:18:24.007796+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:49.082978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.986143+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:34.560549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.983002+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:24.173465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037976+0000","last_change":"2023-10-10T22:18:22.999052+0000","last_active":"2023-10-10T22:18:24.037976+0000","last_peered":"2023-10-10T22:18:24.037976+0000","last_clean":"2023-10-10T22:18:24.037976+0000","last_became_active":"2023-10-10T22:18:22.998752+0000","last_became_peered":"2023-10-10T22:18:22.998752+0000","last_unstale":"2023-10-10T22:18:24.037976+0000","last_undegraded":"2023-10-10T22:18:24.037976+0000","last_fullsized":"2023-10-10T22:18:24.037976+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:09:57.607286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987080+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:57:51.131125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030462+0000","last_change":"2023-10-10T22:18:24.027463+0000","last_active":"2023-10-10T22:18:24.030462+0000","last_peered":"2023-10-10T22:18:24.030462+0000","last_clean":"2023-10-10T22:18:24.030462+0000","last_became_active":"2023-10-10T22:18:24.026739+0000","last_became_peered":"2023-10-10T22:18:24.026739+0000","last_unstale":"2023-10-10T22:18:24.030462+0000","last_undegraded":"2023-10-10T22:18:24.030462+0000","last_fullsized":"2023-10-10T22:18:24.030462+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:49.709794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006316+0000","last_change":"2023-10-10T22:18:22.997547+0000","last_active":"2023-10-10T22:18:24.006316+0000","last_peered":"2023-10-10T22:18:24.006316+0000","last_clean":"2023-10-10T22:18:24.006316+0000","last_became_active":"2023-10-10T22:18:22.997230+0000","last_became_peered":"2023-10-10T22:18:22.997230+0000","last_unstale":"2023-10-10T22:18:24.006316+0000","last_undegraded":"2023-10-10T22:18:24.006316+0000","last_fullsized":"2023-10-10T22:18:24.006316+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:04.255819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.036668+0000","last_change":"2023-10-10T22:18:23.007021+0000","last_active":"2023-10-10T22:18:24.036668+0000","last_peered":"2023-10-10T22:18:24.036668+0000","last_clean":"2023-10-10T22:18:24.036668+0000","last_became_active":"2023-10-10T22:18:23.006762+0000","last_became_peered":"2023-10-10T22:18:23.006762+0000","last_unstale":"2023-10-10T22:18:24.036668+0000","last_undegraded":"2023-10-10T22:18:24.036668+0000","last_fullsized":"2023-10-10T22:18:24.036668+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:53.980487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015732+0000","last_change":"2023-10-10T22:18:24.013096+0000","last_active":"2023-10-10T22:18:24.015732+0000","last_peered":"2023-10-10T22:18:24.015732+0000","last_clean":"2023-10-10T22:18:24.015732+0000","last_became_active":"2023-10-10T22:18:24.012822+0000","last_became_peered":"2023-10-10T22:18:24.012822+0000","last_unstale":"2023-10-10T22:18:24.015732+0000","last_undegraded":"2023-10-10T22:18:24.015732+0000","last_fullsized":"2023-10-10T22:18:24.015732+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:03.558293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988334+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:04.727296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987943+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:16.307393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021064+0000","last_change":"2023-10-10T22:18:24.013716+0000","last_active":"2023-10-10T22:18:24.021064+0000","last_peered":"2023-10-10T22:18:24.021064+0000","last_clean":"2023-10-10T22:18:24.021064+0000","last_became_active":"2023-10-10T22:18:24.013464+0000","last_became_peered":"2023-10-10T22:18:24.013464+0000","last_unstale":"2023-10-10T22:18:24.021064+0000","last_undegraded":"2023-10-10T22:18:24.021064+0000","last_fullsized":"2023-10-10T22:18:24.021064+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:58:24.854295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987357+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:58.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987995+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:03:09.791488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007390+0000","last_change":"2023-10-10T22:18:23.010529+0000","last_active":"2023-10-10T22:18:24.007390+0000","last_peered":"2023-10-10T22:18:24.007390+0000","last_clean":"2023-10-10T22:18:24.007390+0000","last_became_active":"2023-10-10T22:18:23.010238+0000","last_became_peered":"2023-10-10T22:18:23.010238+0000","last_unstale":"2023-10-10T22:18:24.007390+0000","last_undegraded":"2023-10-10T22:18:24.007390+0000","last_fullsized":"2023-10-10T22:18:24.007390+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:03:31.945185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035831+0000","last_change":"2023-10-10T22:18:24.030198+0000","last_active":"2023-10-10T22:18:24.035831+0000","last_peered":"2023-10-10T22:18:24.035831+0000","last_clean":"2023-10-10T22:18:24.035831+0000","last_became_active":"2023-10-10T22:18:24.029858+0000","last_became_peered":"2023-10-10T22:18:24.029858+0000","last_unstale":"2023-10-10T22:18:24.035831+0000","last_undegraded":"2023-10-10T22:18:24.035831+0000","last_fullsized":"2023-10-10T22:18:24.035831+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:30:38.352705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007039+0000","last_change":"2023-10-10T22:18:23.005193+0000","last_active":"2023-10-10T22:18:24.007039+0000","last_peered":"2023-10-10T22:18:24.007039+0000","last_clean":"2023-10-10T22:18:24.007039+0000","last_became_active":"2023-10-10T22:18:23.004949+0000","last_became_peered":"2023-10-10T22:18:23.004949+0000","last_unstale":"2023-10-10T22:18:24.007039+0000","last_undegraded":"2023-10-10T22:18:24.007039+0000","last_fullsized":"2023-10-10T22:18:24.007039+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:15.477452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021561+0000","last_change":"2023-10-10T22:18:24.020567+0000","last_active":"2023-10-10T22:18:24.021561+0000","last_peered":"2023-10-10T22:18:24.021561+0000","last_clean":"2023-10-10T22:18:24.021561+0000","last_became_active":"2023-10-10T22:18:24.020253+0000","last_became_peered":"2023-10-10T22:18:24.020253+0000","last_unstale":"2023-10-10T22:18:24.021561+0000","last_undegraded":"2023-10-10T22:18:24.021561+0000","last_fullsized":"2023-10-10T22:18:24.021561+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:41.929204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005299+0000","last_change":"2023-10-10T22:18:23.001514+0000","last_active":"2023-10-10T22:18:24.005299+0000","last_peered":"2023-10-10T22:18:24.005299+0000","last_clean":"2023-10-10T22:18:24.005299+0000","last_became_active":"2023-10-10T22:18:23.001080+0000","last_became_peered":"2023-10-10T22:18:23.001080+0000","last_unstale":"2023-10-10T22:18:24.005299+0000","last_undegraded":"2023-10-10T22:18:24.005299+0000","last_fullsized":"2023-10-10T22:18:24.005299+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:02:46.155762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.002043+0000","last_change":"2023-10-10T22:18:23.008013+0000","last_active":"2023-10-10T22:18:24.002043+0000","last_peered":"2023-10-10T22:18:24.002043+0000","last_clean":"2023-10-10T22:18:24.002043+0000","last_became_active":"2023-10-10T22:18:23.007704+0000","last_became_peered":"2023-10-10T22:18:23.007704+0000","last_unstale":"2023-10-10T22:18:24.002043+0000","last_undegraded":"2023-10-10T22:18:24.002043+0000","last_fullsized":"2023-10-10T22:18:24.002043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:55:32.131373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988896+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:58:23.849431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987434+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:18:54.181470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005479+0000","last_change":"2023-10-10T22:18:23.006900+0000","last_active":"2023-10-10T22:18:24.005479+0000","last_peered":"2023-10-10T22:18:24.005479+0000","last_clean":"2023-10-10T22:18:24.005479+0000","last_became_active":"2023-10-10T22:18:23.006595+0000","last_became_peered":"2023-10-10T22:18:23.006595+0000","last_unstale":"2023-10-10T22:18:24.005479+0000","last_undegraded":"2023-10-10T22:18:24.005479+0000","last_fullsized":"2023-10-10T22:18:24.005479+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:37.566532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021933+0000","last_change":"2023-10-10T22:18:24.015171+0000","last_active":"2023-10-10T22:18:24.021933+0000","last_peered":"2023-10-10T22:18:24.021933+0000","last_clean":"2023-10-10T22:18:24.021933+0000","last_became_active":"2023-10-10T22:18:24.014398+0000","last_became_peered":"2023-10-10T22:18:24.014398+0000","last_unstale":"2023-10-10T22:18:24.021933+0000","last_undegraded":"2023-10-10T22:18:24.021933+0000","last_fullsized":"2023-10-10T22:18:24.021933+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:13:30.183999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988102+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:56.547744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"164'293","reported_seq":919,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-10T22:18:19.558272+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:18:19.558272+0000","last_peered":"2023-10-10T22:18:19.558272+0000","last_clean":"2023-10-10T22:18:19.558272+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:18:19.558272+0000","last_undegraded":"2023-10-10T22:18:19.558272+0000","last_fullsized":"2023-10-10T22:18:19.558272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543050,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308140,"kb_used_data":2660,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063700,"statfs":{"total":96636764160,"available":96321228800,"internally_reserved":0,"allocated":2723840,"data_stored":1648344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96999999999999997,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73599999999999999,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.628}]},{"osd":1,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.98699999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88500000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.75900000000000001,"15min":0.754},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.95699999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.94899999999999995},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85899999999999999,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.442},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.83699999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0289999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.86899999999999999}]}]},{"osd":6,"up_from":14,"seq":60129543049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.57399999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.628}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.46200000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.52100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543050,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307612,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064228,"statfs":{"total":96636764160,"available":96321769472,"internally_reserved":0,"allocated":2183168,"data_stored":1085505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.622}]}]},{"osd":0,"up_from":14,"seq":60129543052,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304108,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067732,"statfs":{"total":96636764160,"available":96325357568,"internally_reserved":0,"allocated":2789376,"data_stored":1676889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.56000000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74299999999999999,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.90800000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.84599999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.86099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543051,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.504},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.80900000000000005},"last":0.42399999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81100000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.90000000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.355,"15min":1.355},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.1659999999999999,"5min":1.248,"15min":1.248},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.232},"last":0.66700000000000004}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2070000000000001,"5min":1.278,"15min":1.278},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56899999999999995},"max":{"1min":1.1339999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.83399999999999996}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311708,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060132,"statfs":{"total":96636764160,"available":96317575168,"internally_reserved":0,"allocated":2183168,"data_stored":1085041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.81999999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.66500000000000004,"5min":0.748,"15min":0.77900000000000003},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.875},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.877},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.499}]},{"osd":4,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93799999999999994,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.624,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0389999999999999,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.63600000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.079,"5min":1.218,"15min":1.218},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.63300000000000001,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.177,"15min":1.177},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129543051,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96499999999999997},"last":0.751},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.46200000000000002},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.0629999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.99099999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":0.95299999999999996,"15min":1.135},"last":0.78500000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.996},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"max":{"1min":0.95399999999999996,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.79900000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.97299999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39100000000000001},"max":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.94799999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.052,"15min":1.052},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":0.94899999999999995,"5min":1.018,"15min":1.0649999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94799999999999995,"15min":1.028},"last":0.72099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.78600000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.879}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:18:28.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:18:28.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.623+0000 7fe97899d700 1 Processor -- start 2023-10-10T22:18:28.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.623+0000 7fe97899d700 1 -- start start 2023-10-10T22:18:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.624+0000 7fe97899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe974150550 0x7fe974157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.624+0000 7fe97899d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97406e2a0 con 0x7fe9740c7410 2023-10-10T22:18:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.624+0000 7fe97899d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97406b2e0 con 0x7fe974150180 2023-10-10T22:18:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.624+0000 7fe97899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740c78e0 con 0x7fe974150550 2023-10-10T22:18:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.624+0000 7fe973fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe9740c7410 0x7fe974069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54086/0 (socket says 172.21.15.154:54086) 2023-10-10T22:18:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe973fff700 1 -- 172.21.15.154:0/2080062244 learned_addr learned my addr 172.21.15.154:0/2080062244 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe972ffd700 1 --2- 172.21.15.154:0/2080062244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe974150550 0x7fe974157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe9727fc700 1 -- 172.21.15.154:0/2080062244 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826003744 0 0) 0x7fe97406e2a0 con 0x7fe9740c7410 2023-10-10T22:18:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe9727fc700 1 -- 172.21.15.154:0/2080062244 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe95c003570 con 0x7fe9740c7410 2023-10-10T22:18:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe9727fc700 1 -- 172.21.15.154:0/2080062244 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811111372 0 0) 0x7fe97406b2e0 con 0x7fe974150180 2023-10-10T22:18:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe9727fc700 1 -- 172.21.15.154:0/2080062244 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe97406e2a0 con 0x7fe974150180 2023-10-10T22:18:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe972ffd700 1 -- 172.21.15.154:0/2080062244 >> v1:172.21.15.179:6789/0 conn(0x7fe974150180 legacy=0x7fe9740c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe972ffd700 1 -- 172.21.15.154:0/2080062244 >> v1:172.21.15.154:6789/0 conn(0x7fe9740c7410 legacy=0x7fe974069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe972ffd700 1 -- 172.21.15.154:0/2080062244 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9740c7bc0 con 0x7fe974150550 2023-10-10T22:18:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.625+0000 7fe972ffd700 1 --2- 172.21.15.154:0/2080062244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe974150550 0x7fe974157770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe96800aaf0 tx=0x7fe96800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75f333ca0bcf179f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe9727fc700 1 -- 172.21.15.154:0/2080062244 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800c930 con 0x7fe974150550 2023-10-10T22:18:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe9727fc700 1 -- 172.21.15.154:0/2080062244 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96800ca90 con 0x7fe974150550 2023-10-10T22:18:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe9727fc700 1 -- 172.21.15.154:0/2080062244 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800ce10 con 0x7fe974150550 2023-10-10T22:18:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe97899d700 1 -- 172.21.15.154:0/2080062244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe974150550 msgr2=0x7fe974157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe97899d700 1 --2- 172.21.15.154:0/2080062244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe974150550 0x7fe974157770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe96800aaf0 tx=0x7fe96800a330 comp rx=0 tx=0).stop 2023-10-10T22:18:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe97899d700 1 -- 172.21.15.154:0/2080062244 shutdown_connections 2023-10-10T22:18:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe97899d700 1 --2- 172.21.15.154:0/2080062244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe974150550 0x7fe974157770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe97899d700 1 -- 172.21.15.154:0/2080062244 >> 172.21.15.154:0/2080062244 conn(0x7fe9740cc1f0 msgr2=0x7fe9740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe97899d700 1 -- 172.21.15.154:0/2080062244 shutdown_connections 2023-10-10T22:18:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.626+0000 7fe97899d700 1 -- 172.21.15.154:0/2080062244 wait complete. 2023-10-10T22:18:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.628+0000 7fe97899d700 1 Processor -- start 2023-10-10T22:18:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.628+0000 7fe97899d700 1 -- start start 2023-10-10T22:18:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe97899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9740c7410 0x7fe97414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe97899d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe974150180 0x7fe9740c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe97899d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe974150550 0x7fe97415ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe97899d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97414af10 con 0x7fe974150180 2023-10-10T22:18:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe97899d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740c37e0 con 0x7fe974150550 2023-10-10T22:18:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe97899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740af180 con 0x7fe9740c7410 2023-10-10T22:18:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe972ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe974150180 0x7fe9740c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe972ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe974150180 0x7fe9740c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40528/0 (socket says 172.21.15.154:40528) 2023-10-10T22:18:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe972ffd700 1 -- 172.21.15.154:0/3761715493 learned_addr learned my addr 172.21.15.154:0/3761715493 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe9737fe700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9740c7410 0x7fe97414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.629+0000 7fe973fff700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe974150550 0x7fe97415ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe972ffd700 1 -- 172.21.15.154:0/3761715493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9740c7410 msgr2=0x7fe97414a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe972ffd700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9740c7410 0x7fe97414a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe972ffd700 1 -- 172.21.15.154:0/3761715493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe974150550 msgr2=0x7fe97415ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe972ffd700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe974150550 0x7fe97415ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe972ffd700 1 -- 172.21.15.154:0/3761715493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96800a5d0 con 0x7fe974150180 2023-10-10T22:18:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe973fff700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe974150550 0x7fe97415ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe972ffd700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe974150180 0x7fe9740c32a0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c4d0 tx=0x7fe96801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:28.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe95b7fe700 1 -- 172.21.15.154:0/3761715493 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96801c040 con 0x7fe974150180 2023-10-10T22:18:28.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9740c5b80 con 0x7fe974150180 2023-10-10T22:18:28.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe95b7fe700 1 -- 172.21.15.154:0/3761715493 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe968021470 con 0x7fe974150180 2023-10-10T22:18:28.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe95b7fe700 1 -- 172.21.15.154:0/3761715493 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800ce10 con 0x7fe974150180 2023-10-10T22:18:28.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.630+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9740c6140 con 0x7fe974150180 2023-10-10T22:18:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.631+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9740af310 con 0x7fe974150180 2023-10-10T22:18:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.632+0000 7fe95b7fe700 1 -- 172.21.15.154:0/3761715493 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe968021a80 con 0x7fe974150180 2023-10-10T22:18:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.633+0000 7fe95b7fe700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.633+0000 7fe95b7fe700 1 -- 172.21.15.154:0/3761715493 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fe968085d40 con 0x7fe974150180 2023-10-10T22:18:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.633+0000 7fe9737fe700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.634+0000 7fe9737fe700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9740c3170 tx=0x7fe964007d30 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.637+0000 7fe95b7fe700 1 -- 172.21.15.154:0/3761715493 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe968052e90 con 0x7fe974150180 2023-10-10T22:18:28.779 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-10-10T22:18:28.777+0000 7f8ccc5f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T22:18:28.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.825+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe97404c3c0 con 0x7fe960066f30 2023-10-10T22:18:28.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.833+0000 7fe95b7fe700 1 -- 172.21.15.154:0/3761715493 <== mgr.8940 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282712 (secure 0 0 0) 0x7fe97404c3c0 con 0x7fe960066f30 2023-10-10T22:18:28.840 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:28.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe960066f30 msgr2=0x7fe9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9740c3170 tx=0x7fe964007d30 comp rx=0 tx=0).stop 2023-10-10T22:18:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe974150180 msgr2=0x7fe9740c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe974150180 0x7fe9740c32a0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c4d0 tx=0x7fe96801a000 comp rx=0 tx=0).stop 2023-10-10T22:18:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 shutdown_connections 2023-10-10T22:18:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe974150550 0x7fe97415ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9740c7410 0x7fe97414a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 --2- 172.21.15.154:0/3761715493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe974150180 0x7fe9740c32a0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:28.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 >> 172.21.15.154:0/3761715493 conn(0x7fe9740cc1f0 msgr2=0x7fe974157b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:28.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 shutdown_connections 2023-10-10T22:18:28.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:28.837+0000 7fe97899d700 1 -- 172.21.15.154:0/3761715493 wait complete. 2023-10-10T22:18:28.844 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:18:28.856 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:18:27.725109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":489,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2478240,"kb_used_data":18016,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752496480,"statfs":{"total":773094113280,"available":770556395520,"internally_reserved":0,"allocated":18448384,"data_stored":9752759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.745001"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021876+0000","last_change":"2023-10-10T22:18:24.019023+0000","last_active":"2023-10-10T22:18:24.021876+0000","last_peered":"2023-10-10T22:18:24.021876+0000","last_clean":"2023-10-10T22:18:24.021876+0000","last_became_active":"2023-10-10T22:18:24.018737+0000","last_became_peered":"2023-10-10T22:18:24.018737+0000","last_unstale":"2023-10-10T22:18:24.021876+0000","last_undegraded":"2023-10-10T22:18:24.021876+0000","last_fullsized":"2023-10-10T22:18:24.021876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:57.526292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030348+0000","last_change":"2023-10-10T22:18:24.017068+0000","last_active":"2023-10-10T22:18:24.030348+0000","last_peered":"2023-10-10T22:18:24.030348+0000","last_clean":"2023-10-10T22:18:24.030348+0000","last_became_active":"2023-10-10T22:18:24.016811+0000","last_became_peered":"2023-10-10T22:18:24.016811+0000","last_unstale":"2023-10-10T22:18:24.030348+0000","last_undegraded":"2023-10-10T22:18:24.030348+0000","last_fullsized":"2023-10-10T22:18:24.030348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:25.109025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.033056+0000","last_change":"2023-10-10T22:18:24.028207+0000","last_active":"2023-10-10T22:18:24.033056+0000","last_peered":"2023-10-10T22:18:24.033056+0000","last_clean":"2023-10-10T22:18:24.033056+0000","last_became_active":"2023-10-10T22:18:24.027960+0000","last_became_peered":"2023-10-10T22:18:24.027960+0000","last_unstale":"2023-10-10T22:18:24.033056+0000","last_undegraded":"2023-10-10T22:18:24.033056+0000","last_fullsized":"2023-10-10T22:18:24.033056+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:45:32.609233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022006+0000","last_change":"2023-10-10T22:18:24.014367+0000","last_active":"2023-10-10T22:18:24.022006+0000","last_peered":"2023-10-10T22:18:24.022006+0000","last_clean":"2023-10-10T22:18:24.022006+0000","last_became_active":"2023-10-10T22:18:24.014089+0000","last_became_peered":"2023-10-10T22:18:24.014089+0000","last_unstale":"2023-10-10T22:18:24.022006+0000","last_undegraded":"2023-10-10T22:18:24.022006+0000","last_fullsized":"2023-10-10T22:18:24.022006+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:55:05.545484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022327+0000","last_change":"2023-10-10T22:18:24.019997+0000","last_active":"2023-10-10T22:18:24.022327+0000","last_peered":"2023-10-10T22:18:24.022327+0000","last_clean":"2023-10-10T22:18:24.022327+0000","last_became_active":"2023-10-10T22:18:24.019623+0000","last_became_peered":"2023-10-10T22:18:24.019623+0000","last_unstale":"2023-10-10T22:18:24.022327+0000","last_undegraded":"2023-10-10T22:18:24.022327+0000","last_fullsized":"2023-10-10T22:18:24.022327+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:34:34.643756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029552+0000","last_change":"2023-10-10T22:18:24.012307+0000","last_active":"2023-10-10T22:18:24.029552+0000","last_peered":"2023-10-10T22:18:24.029552+0000","last_clean":"2023-10-10T22:18:24.029552+0000","last_became_active":"2023-10-10T22:18:24.012048+0000","last_became_peered":"2023-10-10T22:18:24.012048+0000","last_unstale":"2023-10-10T22:18:24.029552+0000","last_undegraded":"2023-10-10T22:18:24.029552+0000","last_fullsized":"2023-10-10T22:18:24.029552+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:52:27.774330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021544+0000","last_change":"2023-10-10T22:18:24.020520+0000","last_active":"2023-10-10T22:18:24.021544+0000","last_peered":"2023-10-10T22:18:24.021544+0000","last_clean":"2023-10-10T22:18:24.021544+0000","last_became_active":"2023-10-10T22:18:24.019865+0000","last_became_peered":"2023-10-10T22:18:24.019865+0000","last_unstale":"2023-10-10T22:18:24.021544+0000","last_undegraded":"2023-10-10T22:18:24.021544+0000","last_fullsized":"2023-10-10T22:18:24.021544+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:40.234186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.020613+0000","last_change":"2023-10-10T22:18:24.016131+0000","last_active":"2023-10-10T22:18:24.020613+0000","last_peered":"2023-10-10T22:18:24.020613+0000","last_clean":"2023-10-10T22:18:24.020613+0000","last_became_active":"2023-10-10T22:18:24.015862+0000","last_became_peered":"2023-10-10T22:18:24.015862+0000","last_unstale":"2023-10-10T22:18:24.020613+0000","last_undegraded":"2023-10-10T22:18:24.020613+0000","last_fullsized":"2023-10-10T22:18:24.020613+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:06.996520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022295+0000","last_change":"2023-10-10T22:18:24.020650+0000","last_active":"2023-10-10T22:18:24.022295+0000","last_peered":"2023-10-10T22:18:24.022295+0000","last_clean":"2023-10-10T22:18:24.022295+0000","last_became_active":"2023-10-10T22:18:24.020281+0000","last_became_peered":"2023-10-10T22:18:24.020281+0000","last_unstale":"2023-10-10T22:18:24.022295+0000","last_undegraded":"2023-10-10T22:18:24.022295+0000","last_fullsized":"2023-10-10T22:18:24.022295+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:21.748391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030201+0000","last_change":"2023-10-10T22:18:24.026148+0000","last_active":"2023-10-10T22:18:24.030201+0000","last_peered":"2023-10-10T22:18:24.030201+0000","last_clean":"2023-10-10T22:18:24.030201+0000","last_became_active":"2023-10-10T22:18:24.025843+0000","last_became_peered":"2023-10-10T22:18:24.025843+0000","last_unstale":"2023-10-10T22:18:24.030201+0000","last_undegraded":"2023-10-10T22:18:24.030201+0000","last_fullsized":"2023-10-10T22:18:24.030201+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:52:39.870836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.032827+0000","last_change":"2023-10-10T22:18:24.028969+0000","last_active":"2023-10-10T22:18:24.032827+0000","last_peered":"2023-10-10T22:18:24.032827+0000","last_clean":"2023-10-10T22:18:24.032827+0000","last_became_active":"2023-10-10T22:18:24.028680+0000","last_became_peered":"2023-10-10T22:18:24.028680+0000","last_unstale":"2023-10-10T22:18:24.032827+0000","last_undegraded":"2023-10-10T22:18:24.032827+0000","last_fullsized":"2023-10-10T22:18:24.032827+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:52:06.319920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029522+0000","last_change":"2023-10-10T22:18:24.019584+0000","last_active":"2023-10-10T22:18:24.029522+0000","last_peered":"2023-10-10T22:18:24.029522+0000","last_clean":"2023-10-10T22:18:24.029522+0000","last_became_active":"2023-10-10T22:18:24.017476+0000","last_became_peered":"2023-10-10T22:18:24.017476+0000","last_unstale":"2023-10-10T22:18:24.029522+0000","last_undegraded":"2023-10-10T22:18:24.029522+0000","last_fullsized":"2023-10-10T22:18:24.029522+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:09:57.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.989830+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:52:38.865973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029570+0000","last_change":"2023-10-10T22:18:24.016367+0000","last_active":"2023-10-10T22:18:24.029570+0000","last_peered":"2023-10-10T22:18:24.029570+0000","last_clean":"2023-10-10T22:18:24.029570+0000","last_became_active":"2023-10-10T22:18:24.016118+0000","last_became_peered":"2023-10-10T22:18:24.016118+0000","last_unstale":"2023-10-10T22:18:24.029570+0000","last_undegraded":"2023-10-10T22:18:24.029570+0000","last_fullsized":"2023-10-10T22:18:24.029570+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:29.994955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035344+0000","last_change":"2023-10-10T22:18:23.006424+0000","last_active":"2023-10-10T22:18:24.035344+0000","last_peered":"2023-10-10T22:18:24.035344+0000","last_clean":"2023-10-10T22:18:24.035344+0000","last_became_active":"2023-10-10T22:18:23.006146+0000","last_became_peered":"2023-10-10T22:18:23.006146+0000","last_unstale":"2023-10-10T22:18:24.035344+0000","last_undegraded":"2023-10-10T22:18:24.035344+0000","last_fullsized":"2023-10-10T22:18:24.035344+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:39.951998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021913+0000","last_change":"2023-10-10T22:18:24.020427+0000","last_active":"2023-10-10T22:18:24.021913+0000","last_peered":"2023-10-10T22:18:24.021913+0000","last_clean":"2023-10-10T22:18:24.021913+0000","last_became_active":"2023-10-10T22:18:24.020140+0000","last_became_peered":"2023-10-10T22:18:24.020140+0000","last_unstale":"2023-10-10T22:18:24.021913+0000","last_undegraded":"2023-10-10T22:18:24.021913+0000","last_fullsized":"2023-10-10T22:18:24.021913+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:14.720634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.983479+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:57:31.661736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.984490+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:36:10.302964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035793+0000","last_change":"2023-10-10T22:18:24.031358+0000","last_active":"2023-10-10T22:18:24.035793+0000","last_peered":"2023-10-10T22:18:24.035793+0000","last_clean":"2023-10-10T22:18:24.035793+0000","last_became_active":"2023-10-10T22:18:24.031085+0000","last_became_peered":"2023-10-10T22:18:24.031085+0000","last_unstale":"2023-10-10T22:18:24.035793+0000","last_undegraded":"2023-10-10T22:18:24.035793+0000","last_fullsized":"2023-10-10T22:18:24.035793+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:51:17.136910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.986162+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:47.262548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.982994+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:56.547744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029515+0000","last_change":"2023-10-10T22:18:24.015761+0000","last_active":"2023-10-10T22:18:24.029515+0000","last_peered":"2023-10-10T22:18:24.029515+0000","last_clean":"2023-10-10T22:18:24.029515+0000","last_became_active":"2023-10-10T22:18:24.015075+0000","last_became_peered":"2023-10-10T22:18:24.015075+0000","last_unstale":"2023-10-10T22:18:24.029515+0000","last_undegraded":"2023-10-10T22:18:24.029515+0000","last_fullsized":"2023-10-10T22:18:24.029515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:55.727284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987098+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:23.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.982989+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:00.678897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006101+0000","last_change":"2023-10-10T22:18:22.997265+0000","last_active":"2023-10-10T22:18:24.006101+0000","last_peered":"2023-10-10T22:18:24.006101+0000","last_clean":"2023-10-10T22:18:24.006101+0000","last_became_active":"2023-10-10T22:18:22.996999+0000","last_became_peered":"2023-10-10T22:18:22.996999+0000","last_unstale":"2023-10-10T22:18:24.006101+0000","last_undegraded":"2023-10-10T22:18:24.006101+0000","last_fullsized":"2023-10-10T22:18:24.006101+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:58.664586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988811+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:13:29.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"174'6","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038970+0000","last_change":"2023-10-10T22:18:23.008997+0000","last_active":"2023-10-10T22:18:24.038970+0000","last_peered":"2023-10-10T22:18:24.038970+0000","last_clean":"2023-10-10T22:18:24.038970+0000","last_became_active":"2023-10-10T22:18:23.008717+0000","last_became_peered":"2023-10-10T22:18:23.008717+0000","last_unstale":"2023-10-10T22:18:24.038970+0000","last_undegraded":"2023-10-10T22:18:24.038970+0000","last_fullsized":"2023-10-10T22:18:24.038970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:19.281968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988875+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:34.483848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029217+0000","last_change":"2023-10-10T22:18:24.012250+0000","last_active":"2023-10-10T22:18:24.029217+0000","last_peered":"2023-10-10T22:18:24.029217+0000","last_clean":"2023-10-10T22:18:24.029217+0000","last_became_active":"2023-10-10T22:18:24.011986+0000","last_became_peered":"2023-10-10T22:18:24.011986+0000","last_unstale":"2023-10-10T22:18:24.029217+0000","last_undegraded":"2023-10-10T22:18:24.029217+0000","last_fullsized":"2023-10-10T22:18:24.029217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:27.651167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987812+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:43:08.740102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007796+0000","last_change":"2023-10-10T22:18:23.002556+0000","last_active":"2023-10-10T22:18:24.007796+0000","last_peered":"2023-10-10T22:18:24.007796+0000","last_clean":"2023-10-10T22:18:24.007796+0000","last_became_active":"2023-10-10T22:18:23.002306+0000","last_became_peered":"2023-10-10T22:18:23.002306+0000","last_unstale":"2023-10-10T22:18:24.007796+0000","last_undegraded":"2023-10-10T22:18:24.007796+0000","last_fullsized":"2023-10-10T22:18:24.007796+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:49.082978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.986143+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:34.560549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.983002+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:24.173465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037976+0000","last_change":"2023-10-10T22:18:22.999052+0000","last_active":"2023-10-10T22:18:24.037976+0000","last_peered":"2023-10-10T22:18:24.037976+0000","last_clean":"2023-10-10T22:18:24.037976+0000","last_became_active":"2023-10-10T22:18:22.998752+0000","last_became_peered":"2023-10-10T22:18:22.998752+0000","last_unstale":"2023-10-10T22:18:24.037976+0000","last_undegraded":"2023-10-10T22:18:24.037976+0000","last_fullsized":"2023-10-10T22:18:24.037976+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:09:57.607286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987080+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:57:51.131125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030462+0000","last_change":"2023-10-10T22:18:24.027463+0000","last_active":"2023-10-10T22:18:24.030462+0000","last_peered":"2023-10-10T22:18:24.030462+0000","last_clean":"2023-10-10T22:18:24.030462+0000","last_became_active":"2023-10-10T22:18:24.026739+0000","last_became_peered":"2023-10-10T22:18:24.026739+0000","last_unstale":"2023-10-10T22:18:24.030462+0000","last_undegraded":"2023-10-10T22:18:24.030462+0000","last_fullsized":"2023-10-10T22:18:24.030462+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:49.709794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006316+0000","last_change":"2023-10-10T22:18:22.997547+0000","last_active":"2023-10-10T22:18:24.006316+0000","last_peered":"2023-10-10T22:18:24.006316+0000","last_clean":"2023-10-10T22:18:24.006316+0000","last_became_active":"2023-10-10T22:18:22.997230+0000","last_became_peered":"2023-10-10T22:18:22.997230+0000","last_unstale":"2023-10-10T22:18:24.006316+0000","last_undegraded":"2023-10-10T22:18:24.006316+0000","last_fullsized":"2023-10-10T22:18:24.006316+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:04.255819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.036668+0000","last_change":"2023-10-10T22:18:23.007021+0000","last_active":"2023-10-10T22:18:24.036668+0000","last_peered":"2023-10-10T22:18:24.036668+0000","last_clean":"2023-10-10T22:18:24.036668+0000","last_became_active":"2023-10-10T22:18:23.006762+0000","last_became_peered":"2023-10-10T22:18:23.006762+0000","last_unstale":"2023-10-10T22:18:24.036668+0000","last_undegraded":"2023-10-10T22:18:24.036668+0000","last_fullsized":"2023-10-10T22:18:24.036668+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:53.980487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015732+0000","last_change":"2023-10-10T22:18:24.013096+0000","last_active":"2023-10-10T22:18:24.015732+0000","last_peered":"2023-10-10T22:18:24.015732+0000","last_clean":"2023-10-10T22:18:24.015732+0000","last_became_active":"2023-10-10T22:18:24.012822+0000","last_became_peered":"2023-10-10T22:18:24.012822+0000","last_unstale":"2023-10-10T22:18:24.015732+0000","last_undegraded":"2023-10-10T22:18:24.015732+0000","last_fullsized":"2023-10-10T22:18:24.015732+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:03.558293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988334+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:04.727296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987943+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:16.307393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021064+0000","last_change":"2023-10-10T22:18:24.013716+0000","last_active":"2023-10-10T22:18:24.021064+0000","last_peered":"2023-10-10T22:18:24.021064+0000","last_clean":"2023-10-10T22:18:24.021064+0000","last_became_active":"2023-10-10T22:18:24.013464+0000","last_became_peered":"2023-10-10T22:18:24.013464+0000","last_unstale":"2023-10-10T22:18:24.021064+0000","last_undegraded":"2023-10-10T22:18:24.021064+0000","last_fullsized":"2023-10-10T22:18:24.021064+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:58:24.854295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987357+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:58.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987995+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:03:09.791488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007390+0000","last_change":"2023-10-10T22:18:23.010529+0000","last_active":"2023-10-10T22:18:24.007390+0000","last_peered":"2023-10-10T22:18:24.007390+0000","last_clean":"2023-10-10T22:18:24.007390+0000","last_became_active":"2023-10-10T22:18:23.010238+0000","last_became_peered":"2023-10-10T22:18:23.010238+0000","last_unstale":"2023-10-10T22:18:24.007390+0000","last_undegraded":"2023-10-10T22:18:24.007390+0000","last_fullsized":"2023-10-10T22:18:24.007390+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:03:31.945185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035831+0000","last_change":"2023-10-10T22:18:24.030198+0000","last_active":"2023-10-10T22:18:24.035831+0000","last_peered":"2023-10-10T22:18:24.035831+0000","last_clean":"2023-10-10T22:18:24.035831+0000","last_became_active":"2023-10-10T22:18:24.029858+0000","last_became_peered":"2023-10-10T22:18:24.029858+0000","last_unstale":"2023-10-10T22:18:24.035831+0000","last_undegraded":"2023-10-10T22:18:24.035831+0000","last_fullsized":"2023-10-10T22:18:24.035831+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:30:38.352705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007039+0000","last_change":"2023-10-10T22:18:23.005193+0000","last_active":"2023-10-10T22:18:24.007039+0000","last_peered":"2023-10-10T22:18:24.007039+0000","last_clean":"2023-10-10T22:18:24.007039+0000","last_became_active":"2023-10-10T22:18:23.004949+0000","last_became_peered":"2023-10-10T22:18:23.004949+0000","last_unstale":"2023-10-10T22:18:24.007039+0000","last_undegraded":"2023-10-10T22:18:24.007039+0000","last_fullsized":"2023-10-10T22:18:24.007039+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:15.477452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021561+0000","last_change":"2023-10-10T22:18:24.020567+0000","last_active":"2023-10-10T22:18:24.021561+0000","last_peered":"2023-10-10T22:18:24.021561+0000","last_clean":"2023-10-10T22:18:24.021561+0000","last_became_active":"2023-10-10T22:18:24.020253+0000","last_became_peered":"2023-10-10T22:18:24.020253+0000","last_unstale":"2023-10-10T22:18:24.021561+0000","last_undegraded":"2023-10-10T22:18:24.021561+0000","last_fullsized":"2023-10-10T22:18:24.021561+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:41.929204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005299+0000","last_change":"2023-10-10T22:18:23.001514+0000","last_active":"2023-10-10T22:18:24.005299+0000","last_peered":"2023-10-10T22:18:24.005299+0000","last_clean":"2023-10-10T22:18:24.005299+0000","last_became_active":"2023-10-10T22:18:23.001080+0000","last_became_peered":"2023-10-10T22:18:23.001080+0000","last_unstale":"2023-10-10T22:18:24.005299+0000","last_undegraded":"2023-10-10T22:18:24.005299+0000","last_fullsized":"2023-10-10T22:18:24.005299+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:02:46.155762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.002043+0000","last_change":"2023-10-10T22:18:23.008013+0000","last_active":"2023-10-10T22:18:24.002043+0000","last_peered":"2023-10-10T22:18:24.002043+0000","last_clean":"2023-10-10T22:18:24.002043+0000","last_became_active":"2023-10-10T22:18:23.007704+0000","last_became_peered":"2023-10-10T22:18:23.007704+0000","last_unstale":"2023-10-10T22:18:24.002043+0000","last_undegraded":"2023-10-10T22:18:24.002043+0000","last_fullsized":"2023-10-10T22:18:24.002043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:55:32.131373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988896+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:58:23.849431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987434+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:18:54.181470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005479+0000","last_change":"2023-10-10T22:18:23.006900+0000","last_active":"2023-10-10T22:18:24.005479+0000","last_peered":"2023-10-10T22:18:24.005479+0000","last_clean":"2023-10-10T22:18:24.005479+0000","last_became_active":"2023-10-10T22:18:23.006595+0000","last_became_peered":"2023-10-10T22:18:23.006595+0000","last_unstale":"2023-10-10T22:18:24.005479+0000","last_undegraded":"2023-10-10T22:18:24.005479+0000","last_fullsized":"2023-10-10T22:18:24.005479+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:37.566532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021933+0000","last_change":"2023-10-10T22:18:24.015171+0000","last_active":"2023-10-10T22:18:24.021933+0000","last_peered":"2023-10-10T22:18:24.021933+0000","last_clean":"2023-10-10T22:18:24.021933+0000","last_became_active":"2023-10-10T22:18:24.014398+0000","last_became_peered":"2023-10-10T22:18:24.014398+0000","last_unstale":"2023-10-10T22:18:24.021933+0000","last_undegraded":"2023-10-10T22:18:24.021933+0000","last_fullsized":"2023-10-10T22:18:24.021933+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:13:30.183999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988102+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:56.547744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"164'293","reported_seq":919,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-10T22:18:19.558272+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:18:19.558272+0000","last_peered":"2023-10-10T22:18:19.558272+0000","last_clean":"2023-10-10T22:18:19.558272+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:18:19.558272+0000","last_undegraded":"2023-10-10T22:18:19.558272+0000","last_fullsized":"2023-10-10T22:18:19.558272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543050,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308140,"kb_used_data":2660,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063700,"statfs":{"total":96636764160,"available":96321228800,"internally_reserved":0,"allocated":2723840,"data_stored":1648344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96999999999999997,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73599999999999999,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.628}]},{"osd":1,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.98699999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88500000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.75900000000000001,"15min":0.754},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.95699999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.94899999999999995},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85899999999999999,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.442},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.83699999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0289999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.86899999999999999}]}]},{"osd":6,"up_from":14,"seq":60129543049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.57399999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.628}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.46200000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.52100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543050,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307612,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064228,"statfs":{"total":96636764160,"available":96321769472,"internally_reserved":0,"allocated":2183168,"data_stored":1085505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.622}]}]},{"osd":0,"up_from":14,"seq":60129543052,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304108,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067732,"statfs":{"total":96636764160,"available":96325357568,"internally_reserved":0,"allocated":2789376,"data_stored":1676889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.56000000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74299999999999999,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.90800000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.84599999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.86099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543051,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.504},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.80900000000000005},"last":0.42399999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81100000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.90000000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.355,"15min":1.355},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.1659999999999999,"5min":1.248,"15min":1.248},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.232},"last":0.66700000000000004}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2070000000000001,"5min":1.278,"15min":1.278},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56899999999999995},"max":{"1min":1.1339999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.83399999999999996}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311708,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060132,"statfs":{"total":96636764160,"available":96317575168,"internally_reserved":0,"allocated":2183168,"data_stored":1085041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.81999999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.66500000000000004,"5min":0.748,"15min":0.77900000000000003},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.875},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.877},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.499}]},{"osd":4,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93799999999999994,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.624,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0389999999999999,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.63600000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.079,"5min":1.218,"15min":1.218},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.63300000000000001,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.177,"15min":1.177},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129543051,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96499999999999997},"last":0.751},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.46200000000000002},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.0629999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.99099999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":0.95299999999999996,"15min":1.135},"last":0.78500000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.996},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"max":{"1min":0.95399999999999996,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.79900000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.97299999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39100000000000001},"max":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.94799999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.052,"15min":1.052},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":0.94899999999999995,"5min":1.018,"15min":1.0649999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94799999999999995,"15min":1.028},"last":0.72099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.78600000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.879}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:18:28.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:18:29.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.079+0000 7f64fe7ff700 1 Processor -- start 2023-10-10T22:18:29.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.079+0000 7f64fe7ff700 1 -- start start 2023-10-10T22:18:29.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.080+0000 7f64fe7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 0x7f64f80b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.080+0000 7f64fe7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80b0c80 con 0x7f64f80cd010 2023-10-10T22:18:29.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.080+0000 7f64fe7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80ad930 con 0x7f64f80ccc40 2023-10-10T22:18:29.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.080+0000 7f64fe7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80acd20 con 0x7f64f80b0300 2023-10-10T22:18:29.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.081+0000 7f64f77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f64f80cd010 0x7f64f80ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54088/0 (socket says 172.21.15.154:54088) 2023-10-10T22:18:29.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.081+0000 7f64f77fe700 1 -- 172.21.15.154:0/1541235675 learned_addr learned my addr 172.21.15.154:0/1541235675 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:29.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.081+0000 7f64fcd9c700 1 --2- 172.21.15.154:0/1541235675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 0x7f64f80b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.081+0000 7f64f6ffd700 1 -- 172.21.15.154:0/1541235675 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162057344 0 0) 0x7f64f80b0c80 con 0x7f64f80cd010 2023-10-10T22:18:29.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.081+0000 7f64f6ffd700 1 -- 172.21.15.154:0/1541235675 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e0003570 con 0x7f64f80cd010 2023-10-10T22:18:29.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.081+0000 7f64f6ffd700 1 -- 172.21.15.154:0/1541235675 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785622955 0 0) 0x7f64f80ad930 con 0x7f64f80ccc40 2023-10-10T22:18:29.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.081+0000 7f64f6ffd700 1 -- 172.21.15.154:0/1541235675 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f80b0c80 con 0x7f64f80ccc40 2023-10-10T22:18:29.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.081+0000 7f64f6ffd700 1 -- 172.21.15.154:0/1541235675 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 169633455 0 0) 0x7f64e0003570 con 0x7f64f80cd010 2023-10-10T22:18:29.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.081+0000 7f64fcd9c700 1 -- 172.21.15.154:0/1541235675 >> v1:172.21.15.179:6789/0 conn(0x7f64f80ccc40 legacy=0x7f64f8155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.082+0000 7f64fcd9c700 1 -- 172.21.15.154:0/1541235675 >> v1:172.21.15.154:6789/0 conn(0x7f64f80cd010 legacy=0x7f64f80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.082+0000 7f64fcd9c700 1 -- 172.21.15.154:0/1541235675 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80ad000 con 0x7f64f80b0300 2023-10-10T22:18:29.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.082+0000 7f64fcd9c700 1 --2- 172.21.15.154:0/1541235675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 0x7f64f80b0740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009e90 tx=0x7f64f0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab96d78049e38832 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:29.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.082+0000 7f64f6ffd700 1 -- 172.21.15.154:0/1541235675 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f000e070 con 0x7f64f80b0300 2023-10-10T22:18:29.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.082+0000 7f64f6ffd700 1 -- 172.21.15.154:0/1541235675 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f000b870 con 0x7f64f80b0300 2023-10-10T22:18:29.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.082+0000 7f64f6ffd700 1 -- 172.21.15.154:0/1541235675 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec001470 con 0x7f64f80b0300 2023-10-10T22:18:29.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.083+0000 7f64fe7ff700 1 -- 172.21.15.154:0/1541235675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 msgr2=0x7f64f80b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.083+0000 7f64fe7ff700 1 --2- 172.21.15.154:0/1541235675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 0x7f64f80b0740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009e90 tx=0x7f64f0009780 comp rx=0 tx=0).stop 2023-10-10T22:18:29.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.083+0000 7f64fe7ff700 1 -- 172.21.15.154:0/1541235675 shutdown_connections 2023-10-10T22:18:29.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.083+0000 7f64fe7ff700 1 --2- 172.21.15.154:0/1541235675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 0x7f64f80b0740 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.083+0000 7f64fe7ff700 1 -- 172.21.15.154:0/1541235675 >> 172.21.15.154:0/1541235675 conn(0x7f64f806a320 msgr2=0x7f64f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:29.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.083+0000 7f64fe7ff700 1 -- 172.21.15.154:0/1541235675 shutdown_connections 2023-10-10T22:18:29.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.083+0000 7f64fe7ff700 1 -- 172.21.15.154:0/1541235675 wait complete. 2023-10-10T22:18:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.084+0000 7f64fe7ff700 1 Processor -- start 2023-10-10T22:18:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.084+0000 7f64fe7ff700 1 -- start start 2023-10-10T22:18:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.085+0000 7f64fe7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 0x7f64f8157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.085+0000 7f64fe7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f80ccc40 0x7f64f80ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.085+0000 7f64fe7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f80cd010 0x7f64f80c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.085+0000 7f64fe7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80cba00 con 0x7f64f80cd010 2023-10-10T22:18:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.085+0000 7f64fe7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80caba0 con 0x7f64f80ccc40 2023-10-10T22:18:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.085+0000 7f64fe7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80cca10 con 0x7f64f80b0300 2023-10-10T22:18:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.085+0000 7f64fcd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f80cd010 0x7f64f80c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.085+0000 7f64fcd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f80cd010 0x7f64f80c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40530/0 (socket says 172.21.15.154:40530) 2023-10-10T22:18:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.085+0000 7f64fcd9c700 1 -- 172.21.15.154:0/2739424372 learned_addr learned my addr 172.21.15.154:0/2739424372 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64f7fff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 0x7f64f8157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64f77fe700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f80ccc40 0x7f64f80ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64fcd9c700 1 -- 172.21.15.154:0/2739424372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 msgr2=0x7f64f8157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64fcd9c700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 0x7f64f8157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64fcd9c700 1 -- 172.21.15.154:0/2739424372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f80ccc40 msgr2=0x7f64f80ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64fcd9c700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f80ccc40 0x7f64f80ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64fcd9c700 1 -- 172.21.15.154:0/2739424372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0009a20 con 0x7f64f80cd010 2023-10-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64fcd9c700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f80cd010 0x7f64f80c9030 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f64f80ae0f0 tx=0x7f64f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:29.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64dffff700 1 -- 172.21.15.154:0/2739424372 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0012bb0 con 0x7f64f80cd010 2023-10-10T22:18:29.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64dffff700 1 -- 172.21.15.154:0/2739424372 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0012d30 con 0x7f64f80cd010 2023-10-10T22:18:29.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64dffff700 1 -- 172.21.15.154:0/2739424372 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0012ea0 con 0x7f64f80cd010 2023-10-10T22:18:29.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.086+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f80cbc50 con 0x7f64f80cd010 2023-10-10T22:18:29.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.087+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f80cc210 con 0x7f64f80cd010 2023-10-10T22:18:29.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.088+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f804c3c0 con 0x7f64f80cd010 2023-10-10T22:18:29.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.088+0000 7f64dffff700 1 -- 172.21.15.154:0/2739424372 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64f001e8f0 con 0x7f64f80cd010 2023-10-10T22:18:29.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.089+0000 7f64dffff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64e4066f30 0x7f64e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.089+0000 7f64dffff700 1 -- 172.21.15.154:0/2739424372 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f64f0086b30 con 0x7f64f80cd010 2023-10-10T22:18:29.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.089+0000 7f64f7fff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64e4066f30 0x7f64e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.090+0000 7f64f7fff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64e4066f30 0x7f64e40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64e8007fd0 tx=0x7f64e8007d50 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:29.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.094+0000 7f64dffff700 1 -- 172.21.15.154:0/2739424372 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64f0053bd0 con 0x7f64f80cd010 2023-10-10T22:18:29.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.282+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64f80ad2e0 con 0x7f64e4066f30 2023-10-10T22:18:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.290+0000 7f64dffff700 1 -- 172.21.15.154:0/2739424372 <== mgr.8940 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282712 (secure 0 0 0) 0x7f64f80ad2e0 con 0x7f64e4066f30 2023-10-10T22:18:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:29.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64e4066f30 msgr2=0x7f64e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64e4066f30 0x7f64e40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64e8007fd0 tx=0x7f64e8007d50 comp rx=0 tx=0).stop 2023-10-10T22:18:29.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f80cd010 msgr2=0x7f64f80c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f80cd010 0x7f64f80c9030 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f64f80ae0f0 tx=0x7f64f0017000 comp rx=0 tx=0).stop 2023-10-10T22:18:29.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 shutdown_connections 2023-10-10T22:18:29.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f64e4066f30 0x7f64e40693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64f80cd010 0x7f64f80c9030 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f80b0300 0x7f64f8157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 --2- 172.21.15.154:0/2739424372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f80ccc40 0x7f64f80ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 >> 172.21.15.154:0/2739424372 conn(0x7f64f806a320 msgr2=0x7f64f81549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:29.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 shutdown_connections 2023-10-10T22:18:29.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.294+0000 7f64fe7ff700 1 -- 172.21.15.154:0/2739424372 wait complete. 2023-10-10T22:18:29.300 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:18:29.313 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:18:27.725109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":489,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2478240,"kb_used_data":18016,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752496480,"statfs":{"total":773094113280,"available":770556395520,"internally_reserved":0,"allocated":18448384,"data_stored":9752759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.745001"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021876+0000","last_change":"2023-10-10T22:18:24.019023+0000","last_active":"2023-10-10T22:18:24.021876+0000","last_peered":"2023-10-10T22:18:24.021876+0000","last_clean":"2023-10-10T22:18:24.021876+0000","last_became_active":"2023-10-10T22:18:24.018737+0000","last_became_peered":"2023-10-10T22:18:24.018737+0000","last_unstale":"2023-10-10T22:18:24.021876+0000","last_undegraded":"2023-10-10T22:18:24.021876+0000","last_fullsized":"2023-10-10T22:18:24.021876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:57.526292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030348+0000","last_change":"2023-10-10T22:18:24.017068+0000","last_active":"2023-10-10T22:18:24.030348+0000","last_peered":"2023-10-10T22:18:24.030348+0000","last_clean":"2023-10-10T22:18:24.030348+0000","last_became_active":"2023-10-10T22:18:24.016811+0000","last_became_peered":"2023-10-10T22:18:24.016811+0000","last_unstale":"2023-10-10T22:18:24.030348+0000","last_undegraded":"2023-10-10T22:18:24.030348+0000","last_fullsized":"2023-10-10T22:18:24.030348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:25.109025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.033056+0000","last_change":"2023-10-10T22:18:24.028207+0000","last_active":"2023-10-10T22:18:24.033056+0000","last_peered":"2023-10-10T22:18:24.033056+0000","last_clean":"2023-10-10T22:18:24.033056+0000","last_became_active":"2023-10-10T22:18:24.027960+0000","last_became_peered":"2023-10-10T22:18:24.027960+0000","last_unstale":"2023-10-10T22:18:24.033056+0000","last_undegraded":"2023-10-10T22:18:24.033056+0000","last_fullsized":"2023-10-10T22:18:24.033056+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:45:32.609233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022006+0000","last_change":"2023-10-10T22:18:24.014367+0000","last_active":"2023-10-10T22:18:24.022006+0000","last_peered":"2023-10-10T22:18:24.022006+0000","last_clean":"2023-10-10T22:18:24.022006+0000","last_became_active":"2023-10-10T22:18:24.014089+0000","last_became_peered":"2023-10-10T22:18:24.014089+0000","last_unstale":"2023-10-10T22:18:24.022006+0000","last_undegraded":"2023-10-10T22:18:24.022006+0000","last_fullsized":"2023-10-10T22:18:24.022006+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:55:05.545484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022327+0000","last_change":"2023-10-10T22:18:24.019997+0000","last_active":"2023-10-10T22:18:24.022327+0000","last_peered":"2023-10-10T22:18:24.022327+0000","last_clean":"2023-10-10T22:18:24.022327+0000","last_became_active":"2023-10-10T22:18:24.019623+0000","last_became_peered":"2023-10-10T22:18:24.019623+0000","last_unstale":"2023-10-10T22:18:24.022327+0000","last_undegraded":"2023-10-10T22:18:24.022327+0000","last_fullsized":"2023-10-10T22:18:24.022327+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:34:34.643756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029552+0000","last_change":"2023-10-10T22:18:24.012307+0000","last_active":"2023-10-10T22:18:24.029552+0000","last_peered":"2023-10-10T22:18:24.029552+0000","last_clean":"2023-10-10T22:18:24.029552+0000","last_became_active":"2023-10-10T22:18:24.012048+0000","last_became_peered":"2023-10-10T22:18:24.012048+0000","last_unstale":"2023-10-10T22:18:24.029552+0000","last_undegraded":"2023-10-10T22:18:24.029552+0000","last_fullsized":"2023-10-10T22:18:24.029552+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:52:27.774330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021544+0000","last_change":"2023-10-10T22:18:24.020520+0000","last_active":"2023-10-10T22:18:24.021544+0000","last_peered":"2023-10-10T22:18:24.021544+0000","last_clean":"2023-10-10T22:18:24.021544+0000","last_became_active":"2023-10-10T22:18:24.019865+0000","last_became_peered":"2023-10-10T22:18:24.019865+0000","last_unstale":"2023-10-10T22:18:24.021544+0000","last_undegraded":"2023-10-10T22:18:24.021544+0000","last_fullsized":"2023-10-10T22:18:24.021544+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:40.234186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.020613+0000","last_change":"2023-10-10T22:18:24.016131+0000","last_active":"2023-10-10T22:18:24.020613+0000","last_peered":"2023-10-10T22:18:24.020613+0000","last_clean":"2023-10-10T22:18:24.020613+0000","last_became_active":"2023-10-10T22:18:24.015862+0000","last_became_peered":"2023-10-10T22:18:24.015862+0000","last_unstale":"2023-10-10T22:18:24.020613+0000","last_undegraded":"2023-10-10T22:18:24.020613+0000","last_fullsized":"2023-10-10T22:18:24.020613+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:06.996520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022295+0000","last_change":"2023-10-10T22:18:24.020650+0000","last_active":"2023-10-10T22:18:24.022295+0000","last_peered":"2023-10-10T22:18:24.022295+0000","last_clean":"2023-10-10T22:18:24.022295+0000","last_became_active":"2023-10-10T22:18:24.020281+0000","last_became_peered":"2023-10-10T22:18:24.020281+0000","last_unstale":"2023-10-10T22:18:24.022295+0000","last_undegraded":"2023-10-10T22:18:24.022295+0000","last_fullsized":"2023-10-10T22:18:24.022295+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:21.748391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030201+0000","last_change":"2023-10-10T22:18:24.026148+0000","last_active":"2023-10-10T22:18:24.030201+0000","last_peered":"2023-10-10T22:18:24.030201+0000","last_clean":"2023-10-10T22:18:24.030201+0000","last_became_active":"2023-10-10T22:18:24.025843+0000","last_became_peered":"2023-10-10T22:18:24.025843+0000","last_unstale":"2023-10-10T22:18:24.030201+0000","last_undegraded":"2023-10-10T22:18:24.030201+0000","last_fullsized":"2023-10-10T22:18:24.030201+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:52:39.870836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.032827+0000","last_change":"2023-10-10T22:18:24.028969+0000","last_active":"2023-10-10T22:18:24.032827+0000","last_peered":"2023-10-10T22:18:24.032827+0000","last_clean":"2023-10-10T22:18:24.032827+0000","last_became_active":"2023-10-10T22:18:24.028680+0000","last_became_peered":"2023-10-10T22:18:24.028680+0000","last_unstale":"2023-10-10T22:18:24.032827+0000","last_undegraded":"2023-10-10T22:18:24.032827+0000","last_fullsized":"2023-10-10T22:18:24.032827+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:52:06.319920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029522+0000","last_change":"2023-10-10T22:18:24.019584+0000","last_active":"2023-10-10T22:18:24.029522+0000","last_peered":"2023-10-10T22:18:24.029522+0000","last_clean":"2023-10-10T22:18:24.029522+0000","last_became_active":"2023-10-10T22:18:24.017476+0000","last_became_peered":"2023-10-10T22:18:24.017476+0000","last_unstale":"2023-10-10T22:18:24.029522+0000","last_undegraded":"2023-10-10T22:18:24.029522+0000","last_fullsized":"2023-10-10T22:18:24.029522+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:09:57.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.989830+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:52:38.865973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029570+0000","last_change":"2023-10-10T22:18:24.016367+0000","last_active":"2023-10-10T22:18:24.029570+0000","last_peered":"2023-10-10T22:18:24.029570+0000","last_clean":"2023-10-10T22:18:24.029570+0000","last_became_active":"2023-10-10T22:18:24.016118+0000","last_became_peered":"2023-10-10T22:18:24.016118+0000","last_unstale":"2023-10-10T22:18:24.029570+0000","last_undegraded":"2023-10-10T22:18:24.029570+0000","last_fullsized":"2023-10-10T22:18:24.029570+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:29.994955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035344+0000","last_change":"2023-10-10T22:18:23.006424+0000","last_active":"2023-10-10T22:18:24.035344+0000","last_peered":"2023-10-10T22:18:24.035344+0000","last_clean":"2023-10-10T22:18:24.035344+0000","last_became_active":"2023-10-10T22:18:23.006146+0000","last_became_peered":"2023-10-10T22:18:23.006146+0000","last_unstale":"2023-10-10T22:18:24.035344+0000","last_undegraded":"2023-10-10T22:18:24.035344+0000","last_fullsized":"2023-10-10T22:18:24.035344+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:39.951998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021913+0000","last_change":"2023-10-10T22:18:24.020427+0000","last_active":"2023-10-10T22:18:24.021913+0000","last_peered":"2023-10-10T22:18:24.021913+0000","last_clean":"2023-10-10T22:18:24.021913+0000","last_became_active":"2023-10-10T22:18:24.020140+0000","last_became_peered":"2023-10-10T22:18:24.020140+0000","last_unstale":"2023-10-10T22:18:24.021913+0000","last_undegraded":"2023-10-10T22:18:24.021913+0000","last_fullsized":"2023-10-10T22:18:24.021913+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:14.720634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.983479+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:57:31.661736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.984490+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:36:10.302964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035793+0000","last_change":"2023-10-10T22:18:24.031358+0000","last_active":"2023-10-10T22:18:24.035793+0000","last_peered":"2023-10-10T22:18:24.035793+0000","last_clean":"2023-10-10T22:18:24.035793+0000","last_became_active":"2023-10-10T22:18:24.031085+0000","last_became_peered":"2023-10-10T22:18:24.031085+0000","last_unstale":"2023-10-10T22:18:24.035793+0000","last_undegraded":"2023-10-10T22:18:24.035793+0000","last_fullsized":"2023-10-10T22:18:24.035793+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:51:17.136910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.986162+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:08:47.262548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.982994+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:56.547744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029515+0000","last_change":"2023-10-10T22:18:24.015761+0000","last_active":"2023-10-10T22:18:24.029515+0000","last_peered":"2023-10-10T22:18:24.029515+0000","last_clean":"2023-10-10T22:18:24.029515+0000","last_became_active":"2023-10-10T22:18:24.015075+0000","last_became_peered":"2023-10-10T22:18:24.015075+0000","last_unstale":"2023-10-10T22:18:24.029515+0000","last_undegraded":"2023-10-10T22:18:24.029515+0000","last_fullsized":"2023-10-10T22:18:24.029515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:55.727284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987098+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:06:23.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.982989+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:00.678897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006101+0000","last_change":"2023-10-10T22:18:22.997265+0000","last_active":"2023-10-10T22:18:24.006101+0000","last_peered":"2023-10-10T22:18:24.006101+0000","last_clean":"2023-10-10T22:18:24.006101+0000","last_became_active":"2023-10-10T22:18:22.996999+0000","last_became_peered":"2023-10-10T22:18:22.996999+0000","last_unstale":"2023-10-10T22:18:24.006101+0000","last_undegraded":"2023-10-10T22:18:24.006101+0000","last_fullsized":"2023-10-10T22:18:24.006101+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:58.664586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988811+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:13:29.179135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"174'6","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038970+0000","last_change":"2023-10-10T22:18:23.008997+0000","last_active":"2023-10-10T22:18:24.038970+0000","last_peered":"2023-10-10T22:18:24.038970+0000","last_clean":"2023-10-10T22:18:24.038970+0000","last_became_active":"2023-10-10T22:18:23.008717+0000","last_became_peered":"2023-10-10T22:18:23.008717+0000","last_unstale":"2023-10-10T22:18:24.038970+0000","last_undegraded":"2023-10-10T22:18:24.038970+0000","last_fullsized":"2023-10-10T22:18:24.038970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:19.281968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988875+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:34.483848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029217+0000","last_change":"2023-10-10T22:18:24.012250+0000","last_active":"2023-10-10T22:18:24.029217+0000","last_peered":"2023-10-10T22:18:24.029217+0000","last_clean":"2023-10-10T22:18:24.029217+0000","last_became_active":"2023-10-10T22:18:24.011986+0000","last_became_peered":"2023-10-10T22:18:24.011986+0000","last_unstale":"2023-10-10T22:18:24.029217+0000","last_undegraded":"2023-10-10T22:18:24.029217+0000","last_fullsized":"2023-10-10T22:18:24.029217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:27.651167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987812+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:43:08.740102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007796+0000","last_change":"2023-10-10T22:18:23.002556+0000","last_active":"2023-10-10T22:18:24.007796+0000","last_peered":"2023-10-10T22:18:24.007796+0000","last_clean":"2023-10-10T22:18:24.007796+0000","last_became_active":"2023-10-10T22:18:23.002306+0000","last_became_peered":"2023-10-10T22:18:23.002306+0000","last_unstale":"2023-10-10T22:18:24.007796+0000","last_undegraded":"2023-10-10T22:18:24.007796+0000","last_fullsized":"2023-10-10T22:18:24.007796+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:49.082978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.986143+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:53:34.560549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.983002+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:24.173465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037976+0000","last_change":"2023-10-10T22:18:22.999052+0000","last_active":"2023-10-10T22:18:24.037976+0000","last_peered":"2023-10-10T22:18:24.037976+0000","last_clean":"2023-10-10T22:18:24.037976+0000","last_became_active":"2023-10-10T22:18:22.998752+0000","last_became_peered":"2023-10-10T22:18:22.998752+0000","last_unstale":"2023-10-10T22:18:24.037976+0000","last_undegraded":"2023-10-10T22:18:24.037976+0000","last_fullsized":"2023-10-10T22:18:24.037976+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:09:57.607286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987080+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:57:51.131125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030462+0000","last_change":"2023-10-10T22:18:24.027463+0000","last_active":"2023-10-10T22:18:24.030462+0000","last_peered":"2023-10-10T22:18:24.030462+0000","last_clean":"2023-10-10T22:18:24.030462+0000","last_became_active":"2023-10-10T22:18:24.026739+0000","last_became_peered":"2023-10-10T22:18:24.026739+0000","last_unstale":"2023-10-10T22:18:24.030462+0000","last_undegraded":"2023-10-10T22:18:24.030462+0000","last_fullsized":"2023-10-10T22:18:24.030462+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:49.709794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006316+0000","last_change":"2023-10-10T22:18:22.997547+0000","last_active":"2023-10-10T22:18:24.006316+0000","last_peered":"2023-10-10T22:18:24.006316+0000","last_clean":"2023-10-10T22:18:24.006316+0000","last_became_active":"2023-10-10T22:18:22.997230+0000","last_became_peered":"2023-10-10T22:18:22.997230+0000","last_unstale":"2023-10-10T22:18:24.006316+0000","last_undegraded":"2023-10-10T22:18:24.006316+0000","last_fullsized":"2023-10-10T22:18:24.006316+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:04.255819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.036668+0000","last_change":"2023-10-10T22:18:23.007021+0000","last_active":"2023-10-10T22:18:24.036668+0000","last_peered":"2023-10-10T22:18:24.036668+0000","last_clean":"2023-10-10T22:18:24.036668+0000","last_became_active":"2023-10-10T22:18:23.006762+0000","last_became_peered":"2023-10-10T22:18:23.006762+0000","last_unstale":"2023-10-10T22:18:24.036668+0000","last_undegraded":"2023-10-10T22:18:24.036668+0000","last_fullsized":"2023-10-10T22:18:24.036668+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:53.980487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015732+0000","last_change":"2023-10-10T22:18:24.013096+0000","last_active":"2023-10-10T22:18:24.015732+0000","last_peered":"2023-10-10T22:18:24.015732+0000","last_clean":"2023-10-10T22:18:24.015732+0000","last_became_active":"2023-10-10T22:18:24.012822+0000","last_became_peered":"2023-10-10T22:18:24.012822+0000","last_unstale":"2023-10-10T22:18:24.015732+0000","last_undegraded":"2023-10-10T22:18:24.015732+0000","last_fullsized":"2023-10-10T22:18:24.015732+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:03.558293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988334+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:04.727296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987943+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:16.307393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021064+0000","last_change":"2023-10-10T22:18:24.013716+0000","last_active":"2023-10-10T22:18:24.021064+0000","last_peered":"2023-10-10T22:18:24.021064+0000","last_clean":"2023-10-10T22:18:24.021064+0000","last_became_active":"2023-10-10T22:18:24.013464+0000","last_became_peered":"2023-10-10T22:18:24.013464+0000","last_unstale":"2023-10-10T22:18:24.021064+0000","last_undegraded":"2023-10-10T22:18:24.021064+0000","last_fullsized":"2023-10-10T22:18:24.021064+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:58:24.854295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987357+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:58.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987995+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:03:09.791488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007390+0000","last_change":"2023-10-10T22:18:23.010529+0000","last_active":"2023-10-10T22:18:24.007390+0000","last_peered":"2023-10-10T22:18:24.007390+0000","last_clean":"2023-10-10T22:18:24.007390+0000","last_became_active":"2023-10-10T22:18:23.010238+0000","last_became_peered":"2023-10-10T22:18:23.010238+0000","last_unstale":"2023-10-10T22:18:24.007390+0000","last_undegraded":"2023-10-10T22:18:24.007390+0000","last_fullsized":"2023-10-10T22:18:24.007390+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:03:31.945185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035831+0000","last_change":"2023-10-10T22:18:24.030198+0000","last_active":"2023-10-10T22:18:24.035831+0000","last_peered":"2023-10-10T22:18:24.035831+0000","last_clean":"2023-10-10T22:18:24.035831+0000","last_became_active":"2023-10-10T22:18:24.029858+0000","last_became_peered":"2023-10-10T22:18:24.029858+0000","last_unstale":"2023-10-10T22:18:24.035831+0000","last_undegraded":"2023-10-10T22:18:24.035831+0000","last_fullsized":"2023-10-10T22:18:24.035831+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:30:38.352705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007039+0000","last_change":"2023-10-10T22:18:23.005193+0000","last_active":"2023-10-10T22:18:24.007039+0000","last_peered":"2023-10-10T22:18:24.007039+0000","last_clean":"2023-10-10T22:18:24.007039+0000","last_became_active":"2023-10-10T22:18:23.004949+0000","last_became_peered":"2023-10-10T22:18:23.004949+0000","last_unstale":"2023-10-10T22:18:24.007039+0000","last_undegraded":"2023-10-10T22:18:24.007039+0000","last_fullsized":"2023-10-10T22:18:24.007039+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:15.477452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021561+0000","last_change":"2023-10-10T22:18:24.020567+0000","last_active":"2023-10-10T22:18:24.021561+0000","last_peered":"2023-10-10T22:18:24.021561+0000","last_clean":"2023-10-10T22:18:24.021561+0000","last_became_active":"2023-10-10T22:18:24.020253+0000","last_became_peered":"2023-10-10T22:18:24.020253+0000","last_unstale":"2023-10-10T22:18:24.021561+0000","last_undegraded":"2023-10-10T22:18:24.021561+0000","last_fullsized":"2023-10-10T22:18:24.021561+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:41.929204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005299+0000","last_change":"2023-10-10T22:18:23.001514+0000","last_active":"2023-10-10T22:18:24.005299+0000","last_peered":"2023-10-10T22:18:24.005299+0000","last_clean":"2023-10-10T22:18:24.005299+0000","last_became_active":"2023-10-10T22:18:23.001080+0000","last_became_peered":"2023-10-10T22:18:23.001080+0000","last_unstale":"2023-10-10T22:18:24.005299+0000","last_undegraded":"2023-10-10T22:18:24.005299+0000","last_fullsized":"2023-10-10T22:18:24.005299+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:02:46.155762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.002043+0000","last_change":"2023-10-10T22:18:23.008013+0000","last_active":"2023-10-10T22:18:24.002043+0000","last_peered":"2023-10-10T22:18:24.002043+0000","last_clean":"2023-10-10T22:18:24.002043+0000","last_became_active":"2023-10-10T22:18:23.007704+0000","last_became_peered":"2023-10-10T22:18:23.007704+0000","last_unstale":"2023-10-10T22:18:24.002043+0000","last_undegraded":"2023-10-10T22:18:24.002043+0000","last_fullsized":"2023-10-10T22:18:24.002043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:55:32.131373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988896+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:58:23.849431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.987434+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:18:54.181470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:18:22.979742+0000","last_change":"2023-10-10T22:18:22.979742+0000","last_active":"2023-10-10T22:18:22.979742+0000","last_peered":"2023-10-10T22:18:22.979742+0000","last_clean":"2023-10-10T22:18:22.979742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:22.979742+0000","last_undegraded":"2023-10-10T22:18:22.979742+0000","last_fullsized":"2023-10-10T22:18:22.979742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005479+0000","last_change":"2023-10-10T22:18:23.006900+0000","last_active":"2023-10-10T22:18:24.005479+0000","last_peered":"2023-10-10T22:18:24.005479+0000","last_clean":"2023-10-10T22:18:24.005479+0000","last_became_active":"2023-10-10T22:18:23.006595+0000","last_became_peered":"2023-10-10T22:18:23.006595+0000","last_unstale":"2023-10-10T22:18:24.005479+0000","last_undegraded":"2023-10-10T22:18:24.005479+0000","last_fullsized":"2023-10-10T22:18:24.005479+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:37.566532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021933+0000","last_change":"2023-10-10T22:18:24.015171+0000","last_active":"2023-10-10T22:18:24.021933+0000","last_peered":"2023-10-10T22:18:24.021933+0000","last_clean":"2023-10-10T22:18:24.021933+0000","last_became_active":"2023-10-10T22:18:24.014398+0000","last_became_peered":"2023-10-10T22:18:24.014398+0000","last_unstale":"2023-10-10T22:18:24.021933+0000","last_undegraded":"2023-10-10T22:18:24.021933+0000","last_fullsized":"2023-10-10T22:18:24.021933+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:13:30.183999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:18:21.974879+0000","last_change":"2023-10-10T22:18:21.988102+0000","last_active":"2023-10-10T22:18:21.974879+0000","last_peered":"2023-10-10T22:18:21.974879+0000","last_clean":"2023-10-10T22:18:21.974879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:18:21.974879+0000","last_undegraded":"2023-10-10T22:18:21.974879+0000","last_fullsized":"2023-10-10T22:18:21.974879+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:38:56.547744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"164'293","reported_seq":919,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-10T22:18:19.558272+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:18:19.558272+0000","last_peered":"2023-10-10T22:18:19.558272+0000","last_clean":"2023-10-10T22:18:19.558272+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:18:19.558272+0000","last_undegraded":"2023-10-10T22:18:19.558272+0000","last_fullsized":"2023-10-10T22:18:19.558272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543050,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308140,"kb_used_data":2660,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063700,"statfs":{"total":96636764160,"available":96321228800,"internally_reserved":0,"allocated":2723840,"data_stored":1648344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96999999999999997,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73599999999999999,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.628}]},{"osd":1,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.98699999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88500000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.75900000000000001,"15min":0.754},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.95699999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.94899999999999995},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85899999999999999,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.442},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.83699999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0289999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.86899999999999999}]}]},{"osd":6,"up_from":14,"seq":60129543049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.57399999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.628}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.46200000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.52100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543050,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307612,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064228,"statfs":{"total":96636764160,"available":96321769472,"internally_reserved":0,"allocated":2183168,"data_stored":1085505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.622}]}]},{"osd":0,"up_from":14,"seq":60129543052,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304108,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067732,"statfs":{"total":96636764160,"available":96325357568,"internally_reserved":0,"allocated":2789376,"data_stored":1676889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.56000000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74299999999999999,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.90800000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.84599999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.86099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543051,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.504},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.80900000000000005},"last":0.42399999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81100000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.90000000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.355,"15min":1.355},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.1659999999999999,"5min":1.248,"15min":1.248},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.65300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.232},"last":0.66700000000000004}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2070000000000001,"5min":1.278,"15min":1.278},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56899999999999995},"max":{"1min":1.1339999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82799999999999996,"15min":0.82299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.83399999999999996}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311708,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060132,"statfs":{"total":96636764160,"available":96317575168,"internally_reserved":0,"allocated":2183168,"data_stored":1085041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.81999999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.66500000000000004,"5min":0.748,"15min":0.77900000000000003},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.875},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.877},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.499}]},{"osd":4,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93799999999999994,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.624,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0389999999999999,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.63600000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.079,"5min":1.218,"15min":1.218},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.63300000000000001,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.177,"15min":1.177},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129543051,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.93600000000000005,"15min":0.96499999999999997},"last":0.751},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.46200000000000002},"max":{"1min":0.91400000000000003,"5min":1.036,"15min":1.0629999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.99099999999999999,"5min":1.002,"15min":1.1879999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":0.95299999999999996,"15min":1.135},"last":0.78500000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.996},"last":0.60899999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"max":{"1min":0.95399999999999996,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.79900000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.97299999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39100000000000001},"max":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.94799999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.052,"15min":1.052},"last":0.83799999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":0.94899999999999995,"5min":1.018,"15min":1.0649999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.94799999999999995,"15min":1.028},"last":0.72099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311668,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060172,"statfs":{"total":96636764160,"available":96317616128,"internally_reserved":0,"allocated":2142208,"data_stored":1064245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.78600000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.879}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:18:29.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3d is not active+clean 2023-10-10T22:18:29.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3c is not active+clean 2023-10-10T22:18:29.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3b is not active+clean 2023-10-10T22:18:29.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.36 is not active+clean 2023-10-10T22:18:29.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.34 is not active+clean 2023-10-10T22:18:29.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.33 is not active+clean 2023-10-10T22:18:29.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.32 is not active+clean 2023-10-10T22:18:29.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.31 is not active+clean 2023-10-10T22:18:29.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.30 is not active+clean 2023-10-10T22:18:29.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2f is not active+clean 2023-10-10T22:18:29.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2e is not active+clean 2023-10-10T22:18:29.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2c is not active+clean 2023-10-10T22:18:29.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2b is not active+clean 2023-10-10T22:18:29.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2a is not active+clean 2023-10-10T22:18:29.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.29 is not active+clean 2023-10-10T22:18:29.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.28 is not active+clean 2023-10-10T22:18:29.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.27 is not active+clean 2023-10-10T22:18:29.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.25 is not active+clean 2023-10-10T22:18:29.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.22 is not active+clean 2023-10-10T22:18:29.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.20 is not active+clean 2023-10-10T22:18:29.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-10-10T22:18:29.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-10-10T22:18:29.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.989830+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:52:38.865973+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:18:29.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-10-10T22:18:29.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.983479+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:57:31.661736+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:18:29.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-10-10T22:18:29.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-10-10T22:18:29.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.984490+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:36:10.302964+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:18:29.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-10-10T22:18:29.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.986162+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:08:47.262548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T22:18:29.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-10-10T22:18:29.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-10-10T22:18:29.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.982994+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:38:56.547744+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:18:29.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-10-10T22:18:29.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.987098+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:06:23.514848+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T22:18:29.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-10-10T22:18:29.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-10-10T22:18:29.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.982989+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:52:00.678897+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:18:29.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-10-10T22:18:29.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-10-10T22:18:29.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-10-10T22:18:29.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.988811+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:13:29.179135+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:18:29.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2023-10-10T22:18:29.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-10-10T22:18:29.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-10-10T22:18:29.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.988875+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T09:20:34.483848+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T22:18:29.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-10-10T22:18:29.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.987812+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:43:08.740102+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T22:18:29.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-10-10T22:18:29.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-10-10T22:18:29.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-10-10T22:18:29.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.986143+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:53:34.560549+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T22:18:29.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-10-10T22:18:29.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-10-10T22:18:29.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.983002+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:37:24.173465+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:18:29.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.f is not active+clean 2023-10-10T22:18:29.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-10-10T22:18:29.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-10-10T22:18:29.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.987080+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T07:57:51.131125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-10T22:18:29.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-10-10T22:18:29.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-10-10T22:18:29.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.988334+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:31:04.727296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:18:29.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-10-10T22:18:29.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-10-10T22:18:29.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.987943+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:43:16.307393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:18:29.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-10-10T22:18:29.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.987357+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T03:57:58.769815+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T22:18:29.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-10-10T22:18:29.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-10-10T22:18:29.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.987995+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T07:03:09.791488+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:18:29.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-10-10T22:18:29.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2023-10-10T22:18:29.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-10-10T22:18:29.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-10-10T22:18:29.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.988896+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T09:58:23.849431+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:18:29.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-10-10T22:18:29.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-10-10T22:18:29.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.987434+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T06:18:54.181470+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T22:18:29.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-10-10T22:18:29.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:18:22.979742+0000', 'last_change': '2023-10-10T22:18:22.979742+0000', 'last_active': '2023-10-10T22:18:22.979742+0000', 'last_peered': '2023-10-10T22:18:22.979742+0000', 'last_clean': '2023-10-10T22:18:22.979742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:22.979742+0000', 'last_undegraded': '2023-10-10T22:18:22.979742+0000', 'last_fullsized': '2023-10-10T22:18:22.979742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:22.979742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:18:29.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-10-10T22:18:29.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:18:21.974879+0000', 'last_change': '2023-10-10T22:18:21.988102+0000', 'last_active': '2023-10-10T22:18:21.974879+0000', 'last_peered': '2023-10-10T22:18:21.974879+0000', 'last_clean': '2023-10-10T22:18:21.974879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:18:21.974879+0000', 'last_undegraded': '2023-10-10T22:18:21.974879+0000', 'last_fullsized': '2023-10-10T22:18:21.974879+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'last_clean_scrub_stamp': '2023-10-10T22:18:21.974879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:38:56.547744+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T22:18:29.371 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T22:18:29.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.552+0000 7f5f8579d700 1 Processor -- start 2023-10-10T22:18:29.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.552+0000 7f5f8579d700 1 -- start start 2023-10-10T22:18:29.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.553+0000 7f5f8579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801567b0 0x7f5f8006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.553+0000 7f5f8579d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f80156c20 con 0x7f5f8006ece0 2023-10-10T22:18:29.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.553+0000 7f5f8579d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f80157780 con 0x7f5f801563e0 2023-10-10T22:18:29.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.553+0000 7f5f8579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8006f160 con 0x7f5f801567b0 2023-10-10T22:18:29.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.553+0000 7f5f84f9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5f8006ece0 0x7f5f800c6810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54092/0 (socket says 172.21.15.154:54092) 2023-10-10T22:18:29.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f84f9c700 1 -- 172.21.15.154:0/896459568 learned_addr learned my addr 172.21.15.154:0/896459568 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:29.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f7f7fe700 1 --2- 172.21.15.154:0/896459568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801567b0 0x7f5f8006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f7effd700 1 -- 172.21.15.154:0/896459568 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567057435 0 0) 0x7f5f80156c20 con 0x7f5f8006ece0 2023-10-10T22:18:29.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f7effd700 1 -- 172.21.15.154:0/896459568 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f68003570 con 0x7f5f8006ece0 2023-10-10T22:18:29.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f7effd700 1 -- 172.21.15.154:0/896459568 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395609030 0 0) 0x7f5f80157780 con 0x7f5f801563e0 2023-10-10T22:18:29.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f7effd700 1 -- 172.21.15.154:0/896459568 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f80156c20 con 0x7f5f801563e0 2023-10-10T22:18:29.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f7f7fe700 1 -- 172.21.15.154:0/896459568 >> v1:172.21.15.179:6789/0 conn(0x7f5f801563e0 legacy=0x7f5f800c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f7f7fe700 1 -- 172.21.15.154:0/896459568 >> v1:172.21.15.154:6789/0 conn(0x7f5f8006ece0 legacy=0x7f5f800c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f7f7fe700 1 -- 172.21.15.154:0/896459568 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80156e50 con 0x7f5f801567b0 2023-10-10T22:18:29.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.554+0000 7f5f7f7fe700 1 --2- 172.21.15.154:0/896459568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801567b0 0x7f5f8006e7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009910 tx=0x7f5f740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc631c91ec486ac1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:29.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.555+0000 7f5f7effd700 1 -- 172.21.15.154:0/896459568 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74011630 con 0x7f5f801567b0 2023-10-10T22:18:29.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.555+0000 7f5f7effd700 1 -- 172.21.15.154:0/896459568 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74011790 con 0x7f5f801567b0 2023-10-10T22:18:29.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.555+0000 7f5f7effd700 1 -- 172.21.15.154:0/896459568 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74011b10 con 0x7f5f801567b0 2023-10-10T22:18:29.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.555+0000 7f5f8579d700 1 -- 172.21.15.154:0/896459568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801567b0 msgr2=0x7f5f8006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.555+0000 7f5f8579d700 1 --2- 172.21.15.154:0/896459568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801567b0 0x7f5f8006e7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009910 tx=0x7f5f740091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.556+0000 7f5f8579d700 1 -- 172.21.15.154:0/896459568 shutdown_connections 2023-10-10T22:18:29.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.556+0000 7f5f8579d700 1 --2- 172.21.15.154:0/896459568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801567b0 0x7f5f8006e7a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.556+0000 7f5f8579d700 1 -- 172.21.15.154:0/896459568 >> 172.21.15.154:0/896459568 conn(0x7f5f800ccca0 msgr2=0x7f5f800c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:29.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.556+0000 7f5f8579d700 1 -- 172.21.15.154:0/896459568 shutdown_connections 2023-10-10T22:18:29.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.556+0000 7f5f8579d700 1 -- 172.21.15.154:0/896459568 wait complete. 2023-10-10T22:18:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.557+0000 7f5f8579d700 1 Processor -- start 2023-10-10T22:18:29.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.557+0000 7f5f8579d700 1 -- start start 2023-10-10T22:18:29.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.558+0000 7f5f8579d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f8006ece0 0x7f5f8016dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.558+0000 7f5f8579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801563e0 0x7f5f80069f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.558+0000 7f5f8579d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f801567b0 0x7f5f80166d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.558+0000 7f5f8579d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8016ad80 con 0x7f5f8006ece0 2023-10-10T22:18:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.558+0000 7f5f8579d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8016e2a0 con 0x7f5f801567b0 2023-10-10T22:18:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.558+0000 7f5f8579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800c6960 con 0x7f5f801563e0 2023-10-10T22:18:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.558+0000 7f5f7ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f8006ece0 0x7f5f8016dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.558+0000 7f5f7ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f8006ece0 0x7f5f8016dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40540/0 (socket says 172.21.15.154:40540) 2023-10-10T22:18:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.558+0000 7f5f7ffff700 1 -- 172.21.15.154:0/3010346352 learned_addr learned my addr 172.21.15.154:0/3010346352 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f84f9c700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f801567b0 0x7f5f80166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f7f7fe700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801563e0 0x7f5f80069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f7ffff700 1 -- 172.21.15.154:0/3010346352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801563e0 msgr2=0x7f5f80069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f7ffff700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801563e0 0x7f5f80069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f7ffff700 1 -- 172.21.15.154:0/3010346352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f801567b0 msgr2=0x7f5f80166d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f7ffff700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f801567b0 0x7f5f80166d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f7ffff700 1 -- 172.21.15.154:0/3010346352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009420 con 0x7f5f8006ece0 2023-10-10T22:18:29.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f7f7fe700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801563e0 0x7f5f80069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:29.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f7ffff700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f8006ece0 0x7f5f8016dd60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c790 tx=0x7f5f70007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:29.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f67fff700 1 -- 172.21.15.154:0/3010346352 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70010510 con 0x7f5f8006ece0 2023-10-10T22:18:29.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f67fff700 1 -- 172.21.15.154:0/3010346352 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70010670 con 0x7f5f8006ece0 2023-10-10T22:18:29.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8016a170 con 0x7f5f8006ece0 2023-10-10T22:18:29.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.559+0000 7f5f67fff700 1 -- 172.21.15.154:0/3010346352 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70010a30 con 0x7f5f8006ece0 2023-10-10T22:18:29.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.560+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8016a730 con 0x7f5f8006ece0 2023-10-10T22:18:29.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.561+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8004c3c0 con 0x7f5f8006ece0 2023-10-10T22:18:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.562+0000 7f5f67fff700 1 -- 172.21.15.154:0/3010346352 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f7001b3b0 con 0x7f5f8006ece0 2023-10-10T22:18:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.562+0000 7f5f67fff700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5f6c066f30 0x7f5f6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.562+0000 7f5f67fff700 1 -- 172.21.15.154:0/3010346352 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f5f70084060 con 0x7f5f8006ece0 2023-10-10T22:18:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.563+0000 7f5f7f7fe700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5f6c066f30 0x7f5f6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.563+0000 7f5f7f7fe700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5f6c066f30 0x7f5f6c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009860 tx=0x7f5f74017000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.566+0000 7f5f67fff700 1 -- 172.21.15.154:0/3010346352 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f70051060 con 0x7f5f8006ece0 2023-10-10T22:18:29.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.835+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5f800bf6e0 con 0x7f5f8006ece0 2023-10-10T22:18:29.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.835+0000 7f5f67fff700 1 -- 172.21.15.154:0/3010346352 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1180 (secure 0 0 0) 0x7f5f70017080 con 0x7f5f8006ece0 2023-10-10T22:18:29.837 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:29.838 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4594,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":175,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":41},{"state_name":"active+clean","count":36},{"state_name":"creating+peering","count":20}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":591904,"bytes_used":2537717760,"bytes_avail":770556395520,"bytes_total":773094113280,"unknown_pgs_ratio":0.42268040776252747,"inactive_pgs_ratio":0.20618556439876556,"write_bytes_sec":534,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":78,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9138}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-10T22:07:45.140524+0000","services":{}},"progress_events":{}} 2023-10-10T22:18:29.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5f6c066f30 msgr2=0x7f5f6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5f6c066f30 0x7f5f6c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009860 tx=0x7f5f74017000 comp rx=0 tx=0).stop 2023-10-10T22:18:29.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f8006ece0 msgr2=0x7f5f8016dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:29.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f8006ece0 0x7f5f8016dd60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c790 tx=0x7f5f70007e10 comp rx=0 tx=0).stop 2023-10-10T22:18:29.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 shutdown_connections 2023-10-10T22:18:29.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f801567b0 0x7f5f80166d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f5f6c066f30 0x7f5f6c0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f8006ece0 0x7f5f8016dd60 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 --2- 172.21.15.154:0/3010346352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f801563e0 0x7f5f80069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:29.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 >> 172.21.15.154:0/3010346352 conn(0x7f5f800ccca0 msgr2=0x7f5f80159f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:29.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 shutdown_connections 2023-10-10T22:18:29.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:29.838+0000 7f5f8579d700 1 -- 172.21.15.154:0/3010346352 wait complete. 2023-10-10T22:18:29.857 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T22:18:29.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:18:30.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.040+0000 7fac149fe700 1 Processor -- start 2023-10-10T22:18:30.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.040+0000 7fac149fe700 1 -- start start 2023-10-10T22:18:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.042+0000 7fac149fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac10150180 0x7fac10157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.042+0000 7fac149fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac100c7410 0x7fac10069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.042+0000 7fac149fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1006e2a0 con 0x7fac10150550 2023-10-10T22:18:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.042+0000 7fac149fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1006b2e0 con 0x7fac100c7410 2023-10-10T22:18:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.042+0000 7fac149fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac100c78e0 con 0x7fac10150180 2023-10-10T22:18:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.043+0000 7fac0f59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac100c7410 0x7fac10069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.043+0000 7fac0ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac10150180 0x7fac10157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:30.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.043+0000 7fac0f59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac100c7410 0x7fac10069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40548/0 (socket says 172.21.15.154:40548) 2023-10-10T22:18:30.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.043+0000 7fac0f59e700 1 -- 172.21.15.154:0/310970876 learned_addr learned my addr 172.21.15.154:0/310970876 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:30.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.043+0000 7fac0f59e700 1 -- 172.21.15.154:0/310970876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac10150180 msgr2=0x7fac10157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:30.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.043+0000 7fac0f59e700 1 --2- 172.21.15.154:0/310970876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac10150180 0x7fac10157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.043+0000 7fac0f59e700 1 -- 172.21.15.154:0/310970876 >> v1:172.21.15.179:6789/0 conn(0x7fac10150550 legacy=0x7fac100c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:30.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.043+0000 7fac0f59e700 1 -- 172.21.15.154:0/310970876 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac100c7bc0 con 0x7fac100c7410 2023-10-10T22:18:30.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.043+0000 7fac0f59e700 1 --2- 172.21.15.154:0/310970876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac100c7410 0x7fac10069f50 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fac08009f20 tx=0x7fac08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916b1d3ad8ee04c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:30.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac0dd9b700 1 -- 172.21.15.154:0/310970876 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800e070 con 0x7fac100c7410 2023-10-10T22:18:30.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac0dd9b700 1 -- 172.21.15.154:0/310970876 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800b9d0 con 0x7fac100c7410 2023-10-10T22:18:30.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac0dd9b700 1 -- 172.21.15.154:0/310970876 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac080092e0 con 0x7fac100c7410 2023-10-10T22:18:30.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac149fe700 1 -- 172.21.15.154:0/310970876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac100c7410 msgr2=0x7fac10069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:30.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac149fe700 1 --2- 172.21.15.154:0/310970876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac100c7410 0x7fac10069f50 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fac08009f20 tx=0x7fac08009840 comp rx=0 tx=0).stop 2023-10-10T22:18:30.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac149fe700 1 -- 172.21.15.154:0/310970876 shutdown_connections 2023-10-10T22:18:30.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac149fe700 1 --2- 172.21.15.154:0/310970876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac100c7410 0x7fac10069f50 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac149fe700 1 --2- 172.21.15.154:0/310970876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac10150180 0x7fac10157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac149fe700 1 -- 172.21.15.154:0/310970876 >> 172.21.15.154:0/310970876 conn(0x7fac100cc1f0 msgr2=0x7fac100cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac149fe700 1 -- 172.21.15.154:0/310970876 shutdown_connections 2023-10-10T22:18:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.044+0000 7fac149fe700 1 -- 172.21.15.154:0/310970876 wait complete. 2023-10-10T22:18:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.046+0000 7fac149fe700 1 Processor -- start 2023-10-10T22:18:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.046+0000 7fac149fe700 1 -- start start 2023-10-10T22:18:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac149fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac100c7410 0x7fac100b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac149fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac10150180 0x7fac1013e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac149fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac10150550 0x7fac10144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac149fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac100b1ea0 con 0x7fac10150550 2023-10-10T22:18:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac149fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac100c9bc0 con 0x7fac10150180 2023-10-10T22:18:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac149fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1013e9b0 con 0x7fac100c7410 2023-10-10T22:18:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac0f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac10150550 0x7fac10144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac0ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac100c7410 0x7fac100b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac0f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac10150550 0x7fac10144ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40560/0 (socket says 172.21.15.154:40560) 2023-10-10T22:18:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac0f59e700 1 -- 172.21.15.154:0/2523776721 learned_addr learned my addr 172.21.15.154:0/2523776721 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.047+0000 7fac0e59c700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac10150180 0x7fac1013e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fac0f59e700 1 -- 172.21.15.154:0/2523776721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac100c7410 msgr2=0x7fac100b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fac0f59e700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac100c7410 0x7fac100b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fac0f59e700 1 -- 172.21.15.154:0/2523776721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac10150180 msgr2=0x7fac1013e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fac0f59e700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac10150180 0x7fac1013e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fac0f59e700 1 -- 172.21.15.154:0/2523776721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08009ae0 con 0x7fac10150550 2023-10-10T22:18:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fac0f59e700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac10150550 0x7fac10144ce0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fac1006fe40 tx=0x7fac08018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fabf6ffd700 1 -- 172.21.15.154:0/2523776721 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08008ad0 con 0x7fac10150550 2023-10-10T22:18:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fabf6ffd700 1 -- 172.21.15.154:0/2523776721 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac08008c30 con 0x7fac10150550 2023-10-10T22:18:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac100c8fb0 con 0x7fac10150550 2023-10-10T22:18:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fabf6ffd700 1 -- 172.21.15.154:0/2523776721 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08025460 con 0x7fac10150550 2023-10-10T22:18:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.048+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac100c9570 con 0x7fac10150550 2023-10-10T22:18:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.049+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1004c3c0 con 0x7fac10150550 2023-10-10T22:18:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.050+0000 7fabf6ffd700 1 -- 172.21.15.154:0/2523776721 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac08003040 con 0x7fac10150550 2023-10-10T22:18:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.051+0000 7fabf6ffd700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fabfc066f00 0x7fabfc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.051+0000 7fabf6ffd700 1 -- 172.21.15.154:0/2523776721 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fac08086620 con 0x7fac10150550 2023-10-10T22:18:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.051+0000 7fac0ed9d700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fabfc066f00 0x7fabfc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:30.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.052+0000 7fac0ed9d700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fabfc066f00 0x7fabfc0693b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac100cbee0 tx=0x7fac000091a0 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:30.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.055+0000 7fabf6ffd700 1 -- 172.21.15.154:0/2523776721 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac08053620 con 0x7fac10150550 2023-10-10T22:18:30.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.243+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac1006ada0 con 0x7fabfc066f00 2023-10-10T22:18:30.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.252+0000 7fabf6ffd700 1 -- 172.21.15.154:0/2523776721 <== mgr.8940 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289338 (secure 0 0 0) 0x7fac1006ada0 con 0x7fabfc066f00 2023-10-10T22:18:30.257 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:30.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fabfc066f00 msgr2=0x7fabfc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:30.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fabfc066f00 0x7fabfc0693b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac100cbee0 tx=0x7fac000091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac10150550 msgr2=0x7fac10144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac10150550 0x7fac10144ce0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fac1006fe40 tx=0x7fac08018000 comp rx=0 tx=0).stop 2023-10-10T22:18:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 shutdown_connections 2023-10-10T22:18:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fabfc066f00 0x7fabfc0693b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac10150550 0x7fac10144ce0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac100c7410 0x7fac100b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 --2- 172.21.15.154:0/2523776721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac10150180 0x7fac1013e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:30.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 >> 172.21.15.154:0/2523776721 conn(0x7fac100cc1f0 msgr2=0x7fac10158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:30.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 shutdown_connections 2023-10-10T22:18:30.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:30.256+0000 7fac149fe700 1 -- 172.21.15.154:0/2523776721 wait complete. 2023-10-10T22:18:30.262 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:18:30.275 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-10T22:18:29.725493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2478472,"kb_used_data":18248,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752496248,"statfs":{"total":773094113280,"available":770556157952,"internally_reserved":0,"allocated":18685952,"data_stored":9864956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.741602"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021876+0000","last_change":"2023-10-10T22:18:24.019023+0000","last_active":"2023-10-10T22:18:24.021876+0000","last_peered":"2023-10-10T22:18:24.021876+0000","last_clean":"2023-10-10T22:18:24.021876+0000","last_became_active":"2023-10-10T22:18:24.018737+0000","last_became_peered":"2023-10-10T22:18:24.018737+0000","last_unstale":"2023-10-10T22:18:24.021876+0000","last_undegraded":"2023-10-10T22:18:24.021876+0000","last_fullsized":"2023-10-10T22:18:24.021876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:57.526292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030348+0000","last_change":"2023-10-10T22:18:24.017068+0000","last_active":"2023-10-10T22:18:24.030348+0000","last_peered":"2023-10-10T22:18:24.030348+0000","last_clean":"2023-10-10T22:18:24.030348+0000","last_became_active":"2023-10-10T22:18:24.016811+0000","last_became_peered":"2023-10-10T22:18:24.016811+0000","last_unstale":"2023-10-10T22:18:24.030348+0000","last_undegraded":"2023-10-10T22:18:24.030348+0000","last_fullsized":"2023-10-10T22:18:24.030348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:25.109025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037943+0000","last_change":"2023-10-10T22:18:24.034548+0000","last_active":"2023-10-10T22:18:24.037943+0000","last_peered":"2023-10-10T22:18:24.037943+0000","last_clean":"2023-10-10T22:18:24.037943+0000","last_became_active":"2023-10-10T22:18:24.034276+0000","last_became_peered":"2023-10-10T22:18:24.034276+0000","last_unstale":"2023-10-10T22:18:24.037943+0000","last_undegraded":"2023-10-10T22:18:24.037943+0000","last_fullsized":"2023-10-10T22:18:24.037943+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:20.286832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031476+0000","last_change":"2023-10-10T22:18:24.026534+0000","last_active":"2023-10-10T22:18:24.031476+0000","last_peered":"2023-10-10T22:18:24.031476+0000","last_clean":"2023-10-10T22:18:24.031476+0000","last_became_active":"2023-10-10T22:18:24.026277+0000","last_became_peered":"2023-10-10T22:18:24.026277+0000","last_unstale":"2023-10-10T22:18:24.031476+0000","last_undegraded":"2023-10-10T22:18:24.031476+0000","last_fullsized":"2023-10-10T22:18:24.031476+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:20.286832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.019920+0000","last_change":"2023-10-10T22:18:24.017070+0000","last_active":"2023-10-10T22:18:24.019920+0000","last_peered":"2023-10-10T22:18:24.019920+0000","last_clean":"2023-10-10T22:18:24.019920+0000","last_became_active":"2023-10-10T22:18:24.016794+0000","last_became_peered":"2023-10-10T22:18:24.016794+0000","last_unstale":"2023-10-10T22:18:24.019920+0000","last_undegraded":"2023-10-10T22:18:24.019920+0000","last_fullsized":"2023-10-10T22:18:24.019920+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:17.312256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.033056+0000","last_change":"2023-10-10T22:18:24.028207+0000","last_active":"2023-10-10T22:18:24.033056+0000","last_peered":"2023-10-10T22:18:24.033056+0000","last_clean":"2023-10-10T22:18:24.033056+0000","last_became_active":"2023-10-10T22:18:24.027960+0000","last_became_peered":"2023-10-10T22:18:24.027960+0000","last_unstale":"2023-10-10T22:18:24.033056+0000","last_undegraded":"2023-10-10T22:18:24.033056+0000","last_fullsized":"2023-10-10T22:18:24.033056+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:45:32.609233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022006+0000","last_change":"2023-10-10T22:18:24.014367+0000","last_active":"2023-10-10T22:18:24.022006+0000","last_peered":"2023-10-10T22:18:24.022006+0000","last_clean":"2023-10-10T22:18:24.022006+0000","last_became_active":"2023-10-10T22:18:24.014089+0000","last_became_peered":"2023-10-10T22:18:24.014089+0000","last_unstale":"2023-10-10T22:18:24.022006+0000","last_undegraded":"2023-10-10T22:18:24.022006+0000","last_fullsized":"2023-10-10T22:18:24.022006+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:55:05.545484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022327+0000","last_change":"2023-10-10T22:18:24.019997+0000","last_active":"2023-10-10T22:18:24.022327+0000","last_peered":"2023-10-10T22:18:24.022327+0000","last_clean":"2023-10-10T22:18:24.022327+0000","last_became_active":"2023-10-10T22:18:24.019623+0000","last_became_peered":"2023-10-10T22:18:24.019623+0000","last_unstale":"2023-10-10T22:18:24.022327+0000","last_undegraded":"2023-10-10T22:18:24.022327+0000","last_fullsized":"2023-10-10T22:18:24.022327+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:34:34.643756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029552+0000","last_change":"2023-10-10T22:18:24.012307+0000","last_active":"2023-10-10T22:18:24.029552+0000","last_peered":"2023-10-10T22:18:24.029552+0000","last_clean":"2023-10-10T22:18:24.029552+0000","last_became_active":"2023-10-10T22:18:24.012048+0000","last_became_peered":"2023-10-10T22:18:24.012048+0000","last_unstale":"2023-10-10T22:18:24.029552+0000","last_undegraded":"2023-10-10T22:18:24.029552+0000","last_fullsized":"2023-10-10T22:18:24.029552+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:52:27.774330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035115+0000","last_change":"2023-10-10T22:18:24.030000+0000","last_active":"2023-10-10T22:18:24.035115+0000","last_peered":"2023-10-10T22:18:24.035115+0000","last_clean":"2023-10-10T22:18:24.035115+0000","last_became_active":"2023-10-10T22:18:24.029737+0000","last_became_peered":"2023-10-10T22:18:24.029737+0000","last_unstale":"2023-10-10T22:18:24.035115+0000","last_undegraded":"2023-10-10T22:18:24.035115+0000","last_fullsized":"2023-10-10T22:18:24.035115+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:25.798391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021544+0000","last_change":"2023-10-10T22:18:24.020520+0000","last_active":"2023-10-10T22:18:24.021544+0000","last_peered":"2023-10-10T22:18:24.021544+0000","last_clean":"2023-10-10T22:18:24.021544+0000","last_became_active":"2023-10-10T22:18:24.019865+0000","last_became_peered":"2023-10-10T22:18:24.019865+0000","last_unstale":"2023-10-10T22:18:24.021544+0000","last_undegraded":"2023-10-10T22:18:24.021544+0000","last_fullsized":"2023-10-10T22:18:24.021544+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:40.234186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035922+0000","last_change":"2023-10-10T22:18:24.029625+0000","last_active":"2023-10-10T22:18:24.035922+0000","last_peered":"2023-10-10T22:18:24.035922+0000","last_clean":"2023-10-10T22:18:24.035922+0000","last_became_active":"2023-10-10T22:18:24.029347+0000","last_became_peered":"2023-10-10T22:18:24.029347+0000","last_unstale":"2023-10-10T22:18:24.035922+0000","last_undegraded":"2023-10-10T22:18:24.035922+0000","last_fullsized":"2023-10-10T22:18:24.035922+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:41:31.465876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.019899+0000","last_change":"2023-10-10T22:18:24.017057+0000","last_active":"2023-10-10T22:18:24.019899+0000","last_peered":"2023-10-10T22:18:24.019899+0000","last_clean":"2023-10-10T22:18:24.019899+0000","last_became_active":"2023-10-10T22:18:24.016762+0000","last_became_peered":"2023-10-10T22:18:24.016762+0000","last_unstale":"2023-10-10T22:18:24.019899+0000","last_undegraded":"2023-10-10T22:18:24.019899+0000","last_fullsized":"2023-10-10T22:18:24.019899+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:04:39.002108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.028575+0000","last_change":"2023-10-10T22:18:24.025262+0000","last_active":"2023-10-10T22:18:24.028575+0000","last_peered":"2023-10-10T22:18:24.028575+0000","last_clean":"2023-10-10T22:18:24.028575+0000","last_became_active":"2023-10-10T22:18:24.024484+0000","last_became_peered":"2023-10-10T22:18:24.024484+0000","last_unstale":"2023-10-10T22:18:24.028575+0000","last_undegraded":"2023-10-10T22:18:24.028575+0000","last_fullsized":"2023-10-10T22:18:24.028575+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:33:08.622818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.026704+0000","last_change":"2023-10-10T22:18:24.022561+0000","last_active":"2023-10-10T22:18:24.026704+0000","last_peered":"2023-10-10T22:18:24.026704+0000","last_clean":"2023-10-10T22:18:24.026704+0000","last_became_active":"2023-10-10T22:18:24.022195+0000","last_became_peered":"2023-10-10T22:18:24.022195+0000","last_unstale":"2023-10-10T22:18:24.026704+0000","last_undegraded":"2023-10-10T22:18:24.026704+0000","last_fullsized":"2023-10-10T22:18:24.026704+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:37:11.679932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015417+0000","last_change":"2023-10-10T22:18:24.013442+0000","last_active":"2023-10-10T22:18:24.015417+0000","last_peered":"2023-10-10T22:18:24.015417+0000","last_clean":"2023-10-10T22:18:24.015417+0000","last_became_active":"2023-10-10T22:18:24.013181+0000","last_became_peered":"2023-10-10T22:18:24.013181+0000","last_unstale":"2023-10-10T22:18:24.015417+0000","last_undegraded":"2023-10-10T22:18:24.015417+0000","last_fullsized":"2023-10-10T22:18:24.015417+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:37:48.927861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031945+0000","last_change":"2023-10-10T22:18:24.027476+0000","last_active":"2023-10-10T22:18:24.031945+0000","last_peered":"2023-10-10T22:18:24.031945+0000","last_clean":"2023-10-10T22:18:24.031945+0000","last_became_active":"2023-10-10T22:18:24.027123+0000","last_became_peered":"2023-10-10T22:18:24.027123+0000","last_unstale":"2023-10-10T22:18:24.031945+0000","last_undegraded":"2023-10-10T22:18:24.031945+0000","last_fullsized":"2023-10-10T22:18:24.031945+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:39:26.706568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037735+0000","last_change":"2023-10-10T22:18:24.031527+0000","last_active":"2023-10-10T22:18:24.037735+0000","last_peered":"2023-10-10T22:18:24.037735+0000","last_clean":"2023-10-10T22:18:24.037735+0000","last_became_active":"2023-10-10T22:18:24.031231+0000","last_became_peered":"2023-10-10T22:18:24.031231+0000","last_unstale":"2023-10-10T22:18:24.037735+0000","last_undegraded":"2023-10-10T22:18:24.037735+0000","last_fullsized":"2023-10-10T22:18:24.037735+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:07:12.027703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.020613+0000","last_change":"2023-10-10T22:18:24.016131+0000","last_active":"2023-10-10T22:18:24.020613+0000","last_peered":"2023-10-10T22:18:24.020613+0000","last_clean":"2023-10-10T22:18:24.020613+0000","last_became_active":"2023-10-10T22:18:24.015862+0000","last_became_peered":"2023-10-10T22:18:24.015862+0000","last_unstale":"2023-10-10T22:18:24.020613+0000","last_undegraded":"2023-10-10T22:18:24.020613+0000","last_fullsized":"2023-10-10T22:18:24.020613+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:06.996520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037117+0000","last_change":"2023-10-10T22:18:24.031254+0000","last_active":"2023-10-10T22:18:24.037117+0000","last_peered":"2023-10-10T22:18:24.037117+0000","last_clean":"2023-10-10T22:18:24.037117+0000","last_became_active":"2023-10-10T22:18:24.030943+0000","last_became_peered":"2023-10-10T22:18:24.030943+0000","last_unstale":"2023-10-10T22:18:24.037117+0000","last_undegraded":"2023-10-10T22:18:24.037117+0000","last_fullsized":"2023-10-10T22:18:24.037117+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:21:51.295846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.032029+0000","last_change":"2023-10-10T22:18:24.028005+0000","last_active":"2023-10-10T22:18:24.032029+0000","last_peered":"2023-10-10T22:18:24.032029+0000","last_clean":"2023-10-10T22:18:24.032029+0000","last_became_active":"2023-10-10T22:18:24.027742+0000","last_became_peered":"2023-10-10T22:18:24.027742+0000","last_unstale":"2023-10-10T22:18:24.032029+0000","last_undegraded":"2023-10-10T22:18:24.032029+0000","last_fullsized":"2023-10-10T22:18:24.032029+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:21:22.813027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.036843+0000","last_change":"2023-10-10T22:18:24.032801+0000","last_active":"2023-10-10T22:18:24.036843+0000","last_peered":"2023-10-10T22:18:24.036843+0000","last_clean":"2023-10-10T22:18:24.036843+0000","last_became_active":"2023-10-10T22:18:24.032538+0000","last_became_peered":"2023-10-10T22:18:24.032538+0000","last_unstale":"2023-10-10T22:18:24.036843+0000","last_undegraded":"2023-10-10T22:18:24.036843+0000","last_fullsized":"2023-10-10T22:18:24.036843+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:07:14.186774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.025888+0000","last_change":"2023-10-10T22:18:24.020699+0000","last_active":"2023-10-10T22:18:24.025888+0000","last_peered":"2023-10-10T22:18:24.025888+0000","last_clean":"2023-10-10T22:18:24.025888+0000","last_became_active":"2023-10-10T22:18:24.020415+0000","last_became_peered":"2023-10-10T22:18:24.020415+0000","last_unstale":"2023-10-10T22:18:24.025888+0000","last_undegraded":"2023-10-10T22:18:24.025888+0000","last_fullsized":"2023-10-10T22:18:24.025888+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:54.985351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035087+0000","last_change":"2023-10-10T22:18:24.029760+0000","last_active":"2023-10-10T22:18:24.035087+0000","last_peered":"2023-10-10T22:18:24.035087+0000","last_clean":"2023-10-10T22:18:24.035087+0000","last_became_active":"2023-10-10T22:18:24.029394+0000","last_became_peered":"2023-10-10T22:18:24.029394+0000","last_unstale":"2023-10-10T22:18:24.035087+0000","last_undegraded":"2023-10-10T22:18:24.035087+0000","last_fullsized":"2023-10-10T22:18:24.035087+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:00:01.523458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015895+0000","last_change":"2023-10-10T22:18:24.013617+0000","last_active":"2023-10-10T22:18:24.015895+0000","last_peered":"2023-10-10T22:18:24.015895+0000","last_clean":"2023-10-10T22:18:24.015895+0000","last_became_active":"2023-10-10T22:18:24.013355+0000","last_became_peered":"2023-10-10T22:18:24.013355+0000","last_unstale":"2023-10-10T22:18:24.015895+0000","last_undegraded":"2023-10-10T22:18:24.015895+0000","last_fullsized":"2023-10-10T22:18:24.015895+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:14.066926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022295+0000","last_change":"2023-10-10T22:18:24.020650+0000","last_active":"2023-10-10T22:18:24.022295+0000","last_peered":"2023-10-10T22:18:24.022295+0000","last_clean":"2023-10-10T22:18:24.022295+0000","last_became_active":"2023-10-10T22:18:24.020281+0000","last_became_peered":"2023-10-10T22:18:24.020281+0000","last_unstale":"2023-10-10T22:18:24.022295+0000","last_undegraded":"2023-10-10T22:18:24.022295+0000","last_fullsized":"2023-10-10T22:18:24.022295+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:21.748391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021306+0000","last_change":"2023-10-10T22:18:24.015713+0000","last_active":"2023-10-10T22:18:24.021306+0000","last_peered":"2023-10-10T22:18:24.021306+0000","last_clean":"2023-10-10T22:18:24.021306+0000","last_became_active":"2023-10-10T22:18:24.015460+0000","last_became_peered":"2023-10-10T22:18:24.015460+0000","last_unstale":"2023-10-10T22:18:24.021306+0000","last_undegraded":"2023-10-10T22:18:24.021306+0000","last_fullsized":"2023-10-10T22:18:24.021306+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:29:10.929467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030201+0000","last_change":"2023-10-10T22:18:24.026148+0000","last_active":"2023-10-10T22:18:24.030201+0000","last_peered":"2023-10-10T22:18:24.030201+0000","last_clean":"2023-10-10T22:18:24.030201+0000","last_became_active":"2023-10-10T22:18:24.025843+0000","last_became_peered":"2023-10-10T22:18:24.025843+0000","last_unstale":"2023-10-10T22:18:24.030201+0000","last_undegraded":"2023-10-10T22:18:24.030201+0000","last_fullsized":"2023-10-10T22:18:24.030201+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:52:39.870836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.032827+0000","last_change":"2023-10-10T22:18:24.028969+0000","last_active":"2023-10-10T22:18:24.032827+0000","last_peered":"2023-10-10T22:18:24.032827+0000","last_clean":"2023-10-10T22:18:24.032827+0000","last_became_active":"2023-10-10T22:18:24.028680+0000","last_became_peered":"2023-10-10T22:18:24.028680+0000","last_unstale":"2023-10-10T22:18:24.032827+0000","last_undegraded":"2023-10-10T22:18:24.032827+0000","last_fullsized":"2023-10-10T22:18:24.032827+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:52:06.319920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.020901+0000","last_change":"2023-10-10T22:18:24.019275+0000","last_active":"2023-10-10T22:18:24.020901+0000","last_peered":"2023-10-10T22:18:24.020901+0000","last_clean":"2023-10-10T22:18:24.020901+0000","last_became_active":"2023-10-10T22:18:24.018462+0000","last_became_peered":"2023-10-10T22:18:24.018462+0000","last_unstale":"2023-10-10T22:18:24.020901+0000","last_undegraded":"2023-10-10T22:18:24.020901+0000","last_fullsized":"2023-10-10T22:18:24.020901+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:55:33.136236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029522+0000","last_change":"2023-10-10T22:18:24.019584+0000","last_active":"2023-10-10T22:18:24.029522+0000","last_peered":"2023-10-10T22:18:24.029522+0000","last_clean":"2023-10-10T22:18:24.029522+0000","last_became_active":"2023-10-10T22:18:24.017476+0000","last_became_peered":"2023-10-10T22:18:24.017476+0000","last_unstale":"2023-10-10T22:18:24.029522+0000","last_undegraded":"2023-10-10T22:18:24.029522+0000","last_fullsized":"2023-10-10T22:18:24.029522+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:09:57.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022637+0000","last_change":"2023-10-10T22:18:24.016466+0000","last_active":"2023-10-10T22:18:24.022637+0000","last_peered":"2023-10-10T22:18:24.022637+0000","last_clean":"2023-10-10T22:18:24.022637+0000","last_became_active":"2023-10-10T22:18:24.016215+0000","last_became_peered":"2023-10-10T22:18:24.016215+0000","last_unstale":"2023-10-10T22:18:24.022637+0000","last_undegraded":"2023-10-10T22:18:24.022637+0000","last_fullsized":"2023-10-10T22:18:24.022637+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:13:32.552411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035187+0000","last_change":"2023-10-10T22:18:24.033665+0000","last_active":"2023-10-10T22:18:24.035187+0000","last_peered":"2023-10-10T22:18:24.035187+0000","last_clean":"2023-10-10T22:18:24.035187+0000","last_became_active":"2023-10-10T22:18:24.033294+0000","last_became_peered":"2023-10-10T22:18:24.033294+0000","last_unstale":"2023-10-10T22:18:24.035187+0000","last_undegraded":"2023-10-10T22:18:24.035187+0000","last_fullsized":"2023-10-10T22:18:24.035187+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:33.002648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"174'4","reported_seq":14,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.040674+0000","last_change":"2023-10-10T22:18:23.010525+0000","last_active":"2023-10-10T22:18:24.040674+0000","last_peered":"2023-10-10T22:18:24.040674+0000","last_clean":"2023-10-10T22:18:24.040674+0000","last_became_active":"2023-10-10T22:18:23.010172+0000","last_became_peered":"2023-10-10T22:18:23.010172+0000","last_unstale":"2023-10-10T22:18:24.040674+0000","last_undegraded":"2023-10-10T22:18:24.040674+0000","last_fullsized":"2023-10-10T22:18:24.040674+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:32:34.760021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029570+0000","last_change":"2023-10-10T22:18:24.016367+0000","last_active":"2023-10-10T22:18:24.029570+0000","last_peered":"2023-10-10T22:18:24.029570+0000","last_clean":"2023-10-10T22:18:24.029570+0000","last_became_active":"2023-10-10T22:18:24.016118+0000","last_became_peered":"2023-10-10T22:18:24.016118+0000","last_unstale":"2023-10-10T22:18:24.029570+0000","last_undegraded":"2023-10-10T22:18:24.029570+0000","last_fullsized":"2023-10-10T22:18:24.029570+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:29.994955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035344+0000","last_change":"2023-10-10T22:18:23.006424+0000","last_active":"2023-10-10T22:18:24.035344+0000","last_peered":"2023-10-10T22:18:24.035344+0000","last_clean":"2023-10-10T22:18:24.035344+0000","last_became_active":"2023-10-10T22:18:23.006146+0000","last_became_peered":"2023-10-10T22:18:23.006146+0000","last_unstale":"2023-10-10T22:18:24.035344+0000","last_undegraded":"2023-10-10T22:18:24.035344+0000","last_fullsized":"2023-10-10T22:18:24.035344+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:39.951998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021913+0000","last_change":"2023-10-10T22:18:24.020427+0000","last_active":"2023-10-10T22:18:24.021913+0000","last_peered":"2023-10-10T22:18:24.021913+0000","last_clean":"2023-10-10T22:18:24.021913+0000","last_became_active":"2023-10-10T22:18:24.020140+0000","last_became_peered":"2023-10-10T22:18:24.020140+0000","last_unstale":"2023-10-10T22:18:24.021913+0000","last_undegraded":"2023-10-10T22:18:24.021913+0000","last_fullsized":"2023-10-10T22:18:24.021913+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:14.720634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037464+0000","last_change":"2023-10-10T22:18:23.004658+0000","last_active":"2023-10-10T22:18:24.037464+0000","last_peered":"2023-10-10T22:18:24.037464+0000","last_clean":"2023-10-10T22:18:24.037464+0000","last_became_active":"2023-10-10T22:18:23.004213+0000","last_became_peered":"2023-10-10T22:18:23.004213+0000","last_unstale":"2023-10-10T22:18:24.037464+0000","last_undegraded":"2023-10-10T22:18:24.037464+0000","last_fullsized":"2023-10-10T22:18:24.037464+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:58.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037677+0000","last_change":"2023-10-10T22:18:24.035969+0000","last_active":"2023-10-10T22:18:24.037677+0000","last_peered":"2023-10-10T22:18:24.037677+0000","last_clean":"2023-10-10T22:18:24.037677+0000","last_became_active":"2023-10-10T22:18:24.035321+0000","last_became_peered":"2023-10-10T22:18:24.035321+0000","last_unstale":"2023-10-10T22:18:24.037677+0000","last_undegraded":"2023-10-10T22:18:24.037677+0000","last_fullsized":"2023-10-10T22:18:24.037677+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:38.889979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037018+0000","last_change":"2023-10-10T22:18:23.003193+0000","last_active":"2023-10-10T22:18:24.037018+0000","last_peered":"2023-10-10T22:18:24.037018+0000","last_clean":"2023-10-10T22:18:24.037018+0000","last_became_active":"2023-10-10T22:18:23.002834+0000","last_became_peered":"2023-10-10T22:18:23.002834+0000","last_unstale":"2023-10-10T22:18:24.037018+0000","last_undegraded":"2023-10-10T22:18:24.037018+0000","last_fullsized":"2023-10-10T22:18:24.037018+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:34.483848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035793+0000","last_change":"2023-10-10T22:18:24.031358+0000","last_active":"2023-10-10T22:18:24.035793+0000","last_peered":"2023-10-10T22:18:24.035793+0000","last_clean":"2023-10-10T22:18:24.035793+0000","last_became_active":"2023-10-10T22:18:24.031085+0000","last_became_peered":"2023-10-10T22:18:24.031085+0000","last_unstale":"2023-10-10T22:18:24.035793+0000","last_undegraded":"2023-10-10T22:18:24.035793+0000","last_fullsized":"2023-10-10T22:18:24.035793+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:51:17.136910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.032677+0000","last_change":"2023-10-10T22:18:23.002658+0000","last_active":"2023-10-10T22:18:24.032677+0000","last_peered":"2023-10-10T22:18:24.032677+0000","last_clean":"2023-10-10T22:18:24.032677+0000","last_became_active":"2023-10-10T22:18:23.002380+0000","last_became_peered":"2023-10-10T22:18:23.002380+0000","last_unstale":"2023-10-10T22:18:24.032677+0000","last_undegraded":"2023-10-10T22:18:24.032677+0000","last_fullsized":"2023-10-10T22:18:24.032677+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:32:25.630358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.025933+0000","last_change":"2023-10-10T22:18:24.020288+0000","last_active":"2023-10-10T22:18:24.025933+0000","last_peered":"2023-10-10T22:18:24.025933+0000","last_clean":"2023-10-10T22:18:24.025933+0000","last_became_active":"2023-10-10T22:18:24.020017+0000","last_became_peered":"2023-10-10T22:18:24.020017+0000","last_unstale":"2023-10-10T22:18:24.025933+0000","last_undegraded":"2023-10-10T22:18:24.025933+0000","last_fullsized":"2023-10-10T22:18:24.025933+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:54.390729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.036931+0000","last_change":"2023-10-10T22:18:23.009218+0000","last_active":"2023-10-10T22:18:24.036931+0000","last_peered":"2023-10-10T22:18:24.036931+0000","last_clean":"2023-10-10T22:18:24.036931+0000","last_became_active":"2023-10-10T22:18:23.008516+0000","last_became_peered":"2023-10-10T22:18:23.008516+0000","last_unstale":"2023-10-10T22:18:24.036931+0000","last_undegraded":"2023-10-10T22:18:24.036931+0000","last_fullsized":"2023-10-10T22:18:24.036931+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:33.216584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029515+0000","last_change":"2023-10-10T22:18:24.015761+0000","last_active":"2023-10-10T22:18:24.029515+0000","last_peered":"2023-10-10T22:18:24.029515+0000","last_clean":"2023-10-10T22:18:24.029515+0000","last_became_active":"2023-10-10T22:18:24.015075+0000","last_became_peered":"2023-10-10T22:18:24.015075+0000","last_unstale":"2023-10-10T22:18:24.029515+0000","last_undegraded":"2023-10-10T22:18:24.029515+0000","last_fullsized":"2023-10-10T22:18:24.029515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:55.727284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007704+0000","last_change":"2023-10-10T22:18:23.001824+0000","last_active":"2023-10-10T22:18:24.007704+0000","last_peered":"2023-10-10T22:18:24.007704+0000","last_clean":"2023-10-10T22:18:24.007704+0000","last_became_active":"2023-10-10T22:18:23.001560+0000","last_became_peered":"2023-10-10T22:18:23.001560+0000","last_unstale":"2023-10-10T22:18:24.007704+0000","last_undegraded":"2023-10-10T22:18:24.007704+0000","last_fullsized":"2023-10-10T22:18:24.007704+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:45.905808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.014307+0000","last_change":"2023-10-10T22:18:24.012668+0000","last_active":"2023-10-10T22:18:24.014307+0000","last_peered":"2023-10-10T22:18:24.014307+0000","last_clean":"2023-10-10T22:18:24.014307+0000","last_became_active":"2023-10-10T22:18:24.012393+0000","last_became_peered":"2023-10-10T22:18:24.012393+0000","last_unstale":"2023-10-10T22:18:24.014307+0000","last_undegraded":"2023-10-10T22:18:24.014307+0000","last_fullsized":"2023-10-10T22:18:24.014307+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:54.985351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007984+0000","last_change":"2023-10-10T22:18:23.005180+0000","last_active":"2023-10-10T22:18:24.007984+0000","last_peered":"2023-10-10T22:18:24.007984+0000","last_clean":"2023-10-10T22:18:24.007984+0000","last_became_active":"2023-10-10T22:18:23.004563+0000","last_became_peered":"2023-10-10T22:18:23.004563+0000","last_unstale":"2023-10-10T22:18:24.007984+0000","last_undegraded":"2023-10-10T22:18:24.007984+0000","last_fullsized":"2023-10-10T22:18:24.007984+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:18:54.181470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.018979+0000","last_change":"2023-10-10T22:18:24.015510+0000","last_active":"2023-10-10T22:18:24.018979+0000","last_peered":"2023-10-10T22:18:24.018979+0000","last_clean":"2023-10-10T22:18:24.018979+0000","last_became_active":"2023-10-10T22:18:24.014861+0000","last_became_peered":"2023-10-10T22:18:24.014861+0000","last_unstale":"2023-10-10T22:18:24.018979+0000","last_undegraded":"2023-10-10T22:18:24.018979+0000","last_fullsized":"2023-10-10T22:18:24.018979+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:07:12.027703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006101+0000","last_change":"2023-10-10T22:18:22.997265+0000","last_active":"2023-10-10T22:18:24.006101+0000","last_peered":"2023-10-10T22:18:24.006101+0000","last_clean":"2023-10-10T22:18:24.006101+0000","last_became_active":"2023-10-10T22:18:22.996999+0000","last_became_peered":"2023-10-10T22:18:22.996999+0000","last_unstale":"2023-10-10T22:18:24.006101+0000","last_undegraded":"2023-10-10T22:18:24.006101+0000","last_fullsized":"2023-10-10T22:18:24.006101+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:58.664586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035554+0000","last_change":"2023-10-10T22:18:24.029475+0000","last_active":"2023-10-10T22:18:24.035554+0000","last_peered":"2023-10-10T22:18:24.035554+0000","last_clean":"2023-10-10T22:18:24.035554+0000","last_became_active":"2023-10-10T22:18:24.028901+0000","last_became_peered":"2023-10-10T22:18:24.028901+0000","last_unstale":"2023-10-10T22:18:24.035554+0000","last_undegraded":"2023-10-10T22:18:24.035554+0000","last_fullsized":"2023-10-10T22:18:24.035554+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:40:10.841002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.020021+0000","last_change":"2023-10-10T22:18:23.012833+0000","last_active":"2023-10-10T22:18:24.020021+0000","last_peered":"2023-10-10T22:18:24.020021+0000","last_clean":"2023-10-10T22:18:24.020021+0000","last_became_active":"2023-10-10T22:18:23.012570+0000","last_became_peered":"2023-10-10T22:18:23.012570+0000","last_unstale":"2023-10-10T22:18:24.020021+0000","last_undegraded":"2023-10-10T22:18:24.020021+0000","last_fullsized":"2023-10-10T22:18:24.020021+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:32:15.660909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.024233+0000","last_change":"2023-10-10T22:18:24.019853+0000","last_active":"2023-10-10T22:18:24.024233+0000","last_peered":"2023-10-10T22:18:24.024233+0000","last_clean":"2023-10-10T22:18:24.024233+0000","last_became_active":"2023-10-10T22:18:24.019581+0000","last_became_peered":"2023-10-10T22:18:24.019581+0000","last_unstale":"2023-10-10T22:18:24.024233+0000","last_undegraded":"2023-10-10T22:18:24.024233+0000","last_fullsized":"2023-10-10T22:18:24.024233+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:12:03.286676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"174'6","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038970+0000","last_change":"2023-10-10T22:18:23.008997+0000","last_active":"2023-10-10T22:18:24.038970+0000","last_peered":"2023-10-10T22:18:24.038970+0000","last_clean":"2023-10-10T22:18:24.038970+0000","last_became_active":"2023-10-10T22:18:23.008717+0000","last_became_peered":"2023-10-10T22:18:23.008717+0000","last_unstale":"2023-10-10T22:18:24.038970+0000","last_undegraded":"2023-10-10T22:18:24.038970+0000","last_fullsized":"2023-10-10T22:18:24.038970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:19.281968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031979+0000","last_change":"2023-10-10T22:18:24.025224+0000","last_active":"2023-10-10T22:18:24.031979+0000","last_peered":"2023-10-10T22:18:24.031979+0000","last_clean":"2023-10-10T22:18:24.031979+0000","last_became_active":"2023-10-10T22:18:24.024936+0000","last_became_peered":"2023-10-10T22:18:24.024936+0000","last_unstale":"2023-10-10T22:18:24.031979+0000","last_undegraded":"2023-10-10T22:18:24.031979+0000","last_fullsized":"2023-10-10T22:18:24.031979+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:42.765707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038217+0000","last_change":"2023-10-10T22:18:23.004357+0000","last_active":"2023-10-10T22:18:24.038217+0000","last_peered":"2023-10-10T22:18:24.038217+0000","last_clean":"2023-10-10T22:18:24.038217+0000","last_became_active":"2023-10-10T22:18:23.004099+0000","last_became_peered":"2023-10-10T22:18:23.004099+0000","last_unstale":"2023-10-10T22:18:24.038217+0000","last_undegraded":"2023-10-10T22:18:24.038217+0000","last_fullsized":"2023-10-10T22:18:24.038217+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:42:05.456605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029217+0000","last_change":"2023-10-10T22:18:24.012250+0000","last_active":"2023-10-10T22:18:24.029217+0000","last_peered":"2023-10-10T22:18:24.029217+0000","last_clean":"2023-10-10T22:18:24.029217+0000","last_became_active":"2023-10-10T22:18:24.011986+0000","last_became_peered":"2023-10-10T22:18:24.011986+0000","last_unstale":"2023-10-10T22:18:24.029217+0000","last_undegraded":"2023-10-10T22:18:24.029217+0000","last_fullsized":"2023-10-10T22:18:24.029217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:27.651167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015821+0000","last_change":"2023-10-10T22:18:23.002464+0000","last_active":"2023-10-10T22:18:24.015821+0000","last_peered":"2023-10-10T22:18:24.015821+0000","last_clean":"2023-10-10T22:18:24.015821+0000","last_became_active":"2023-10-10T22:18:23.002089+0000","last_became_peered":"2023-10-10T22:18:23.002089+0000","last_unstale":"2023-10-10T22:18:24.015821+0000","last_undegraded":"2023-10-10T22:18:24.015821+0000","last_fullsized":"2023-10-10T22:18:24.015821+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:24.173465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.028591+0000","last_change":"2023-10-10T22:18:24.024615+0000","last_active":"2023-10-10T22:18:24.028591+0000","last_peered":"2023-10-10T22:18:24.028591+0000","last_clean":"2023-10-10T22:18:24.028591+0000","last_became_active":"2023-10-10T22:18:24.024341+0000","last_became_peered":"2023-10-10T22:18:24.024341+0000","last_unstale":"2023-10-10T22:18:24.028591+0000","last_undegraded":"2023-10-10T22:18:24.028591+0000","last_fullsized":"2023-10-10T22:18:24.028591+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:03:10.796352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007796+0000","last_change":"2023-10-10T22:18:23.002556+0000","last_active":"2023-10-10T22:18:24.007796+0000","last_peered":"2023-10-10T22:18:24.007796+0000","last_clean":"2023-10-10T22:18:24.007796+0000","last_became_active":"2023-10-10T22:18:23.002306+0000","last_became_peered":"2023-10-10T22:18:23.002306+0000","last_unstale":"2023-10-10T22:18:24.007796+0000","last_undegraded":"2023-10-10T22:18:24.007796+0000","last_fullsized":"2023-10-10T22:18:24.007796+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:49.082978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.025943+0000","last_change":"2023-10-10T22:18:24.020082+0000","last_active":"2023-10-10T22:18:24.025943+0000","last_peered":"2023-10-10T22:18:24.025943+0000","last_clean":"2023-10-10T22:18:24.025943+0000","last_became_active":"2023-10-10T22:18:24.019783+0000","last_became_peered":"2023-10-10T22:18:24.019783+0000","last_unstale":"2023-10-10T22:18:24.025943+0000","last_undegraded":"2023-10-10T22:18:24.025943+0000","last_fullsized":"2023-10-10T22:18:24.025943+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:04:39.002108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"174'8","reported_seq":18,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038874+0000","last_change":"2023-10-10T22:18:23.006747+0000","last_active":"2023-10-10T22:18:24.038874+0000","last_peered":"2023-10-10T22:18:24.038874+0000","last_clean":"2023-10-10T22:18:24.038874+0000","last_became_active":"2023-10-10T22:18:23.006494+0000","last_became_peered":"2023-10-10T22:18:23.006494+0000","last_unstale":"2023-10-10T22:18:24.038874+0000","last_undegraded":"2023-10-10T22:18:24.038874+0000","last_fullsized":"2023-10-10T22:18:24.038874+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:34.934750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035132+0000","last_change":"2023-10-10T22:18:24.030518+0000","last_active":"2023-10-10T22:18:24.035132+0000","last_peered":"2023-10-10T22:18:24.035132+0000","last_clean":"2023-10-10T22:18:24.035132+0000","last_became_active":"2023-10-10T22:18:24.030251+0000","last_became_peered":"2023-10-10T22:18:24.030251+0000","last_unstale":"2023-10-10T22:18:24.035132+0000","last_undegraded":"2023-10-10T22:18:24.035132+0000","last_fullsized":"2023-10-10T22:18:24.035132+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:52:53.593440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038130+0000","last_change":"2023-10-10T22:18:23.004396+0000","last_active":"2023-10-10T22:18:24.038130+0000","last_peered":"2023-10-10T22:18:24.038130+0000","last_clean":"2023-10-10T22:18:24.038130+0000","last_became_active":"2023-10-10T22:18:23.004119+0000","last_became_peered":"2023-10-10T22:18:23.004119+0000","last_unstale":"2023-10-10T22:18:24.038130+0000","last_undegraded":"2023-10-10T22:18:24.038130+0000","last_fullsized":"2023-10-10T22:18:24.038130+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:43:26.287613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021439+0000","last_change":"2023-10-10T22:18:24.017656+0000","last_active":"2023-10-10T22:18:24.021439+0000","last_peered":"2023-10-10T22:18:24.021439+0000","last_clean":"2023-10-10T22:18:24.021439+0000","last_became_active":"2023-10-10T22:18:24.017387+0000","last_became_peered":"2023-10-10T22:18:24.017387+0000","last_unstale":"2023-10-10T22:18:24.021439+0000","last_undegraded":"2023-10-10T22:18:24.021439+0000","last_fullsized":"2023-10-10T22:18:24.021439+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:08:59.566825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037976+0000","last_change":"2023-10-10T22:18:22.999052+0000","last_active":"2023-10-10T22:18:24.037976+0000","last_peered":"2023-10-10T22:18:24.037976+0000","last_clean":"2023-10-10T22:18:24.037976+0000","last_became_active":"2023-10-10T22:18:22.998752+0000","last_became_peered":"2023-10-10T22:18:22.998752+0000","last_unstale":"2023-10-10T22:18:24.037976+0000","last_undegraded":"2023-10-10T22:18:24.037976+0000","last_fullsized":"2023-10-10T22:18:24.037976+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:09:57.607286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031508+0000","last_change":"2023-10-10T22:18:24.024961+0000","last_active":"2023-10-10T22:18:24.031508+0000","last_peered":"2023-10-10T22:18:24.031508+0000","last_clean":"2023-10-10T22:18:24.031508+0000","last_became_active":"2023-10-10T22:18:24.024683+0000","last_became_peered":"2023-10-10T22:18:24.024683+0000","last_unstale":"2023-10-10T22:18:24.031508+0000","last_undegraded":"2023-10-10T22:18:24.031508+0000","last_fullsized":"2023-10-10T22:18:24.031508+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:54.985351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035634+0000","last_change":"2023-10-10T22:18:23.005971+0000","last_active":"2023-10-10T22:18:24.035634+0000","last_peered":"2023-10-10T22:18:24.035634+0000","last_clean":"2023-10-10T22:18:24.035634+0000","last_became_active":"2023-10-10T22:18:23.005716+0000","last_became_peered":"2023-10-10T22:18:23.005716+0000","last_unstale":"2023-10-10T22:18:24.035634+0000","last_undegraded":"2023-10-10T22:18:24.035634+0000","last_fullsized":"2023-10-10T22:18:24.035634+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:26:15.912615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030462+0000","last_change":"2023-10-10T22:18:24.027463+0000","last_active":"2023-10-10T22:18:24.030462+0000","last_peered":"2023-10-10T22:18:24.030462+0000","last_clean":"2023-10-10T22:18:24.030462+0000","last_became_active":"2023-10-10T22:18:24.026739+0000","last_became_peered":"2023-10-10T22:18:24.026739+0000","last_unstale":"2023-10-10T22:18:24.030462+0000","last_undegraded":"2023-10-10T22:18:24.030462+0000","last_fullsized":"2023-10-10T22:18:24.030462+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:49.709794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006316+0000","last_change":"2023-10-10T22:18:22.997547+0000","last_active":"2023-10-10T22:18:24.006316+0000","last_peered":"2023-10-10T22:18:24.006316+0000","last_clean":"2023-10-10T22:18:24.006316+0000","last_became_active":"2023-10-10T22:18:22.997230+0000","last_became_peered":"2023-10-10T22:18:22.997230+0000","last_unstale":"2023-10-10T22:18:24.006316+0000","last_undegraded":"2023-10-10T22:18:24.006316+0000","last_fullsized":"2023-10-10T22:18:24.006316+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:04.255819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.019406+0000","last_change":"2023-10-10T22:18:24.013058+0000","last_active":"2023-10-10T22:18:24.019406+0000","last_peered":"2023-10-10T22:18:24.019406+0000","last_clean":"2023-10-10T22:18:24.019406+0000","last_became_active":"2023-10-10T22:18:24.012778+0000","last_became_peered":"2023-10-10T22:18:24.012778+0000","last_unstale":"2023-10-10T22:18:24.019406+0000","last_undegraded":"2023-10-10T22:18:24.019406+0000","last_fullsized":"2023-10-10T22:18:24.019406+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:11.645193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.036668+0000","last_change":"2023-10-10T22:18:23.007021+0000","last_active":"2023-10-10T22:18:24.036668+0000","last_peered":"2023-10-10T22:18:24.036668+0000","last_clean":"2023-10-10T22:18:24.036668+0000","last_became_active":"2023-10-10T22:18:23.006762+0000","last_became_peered":"2023-10-10T22:18:23.006762+0000","last_unstale":"2023-10-10T22:18:24.036668+0000","last_undegraded":"2023-10-10T22:18:24.036668+0000","last_fullsized":"2023-10-10T22:18:24.036668+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:53.980487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015732+0000","last_change":"2023-10-10T22:18:24.013096+0000","last_active":"2023-10-10T22:18:24.015732+0000","last_peered":"2023-10-10T22:18:24.015732+0000","last_clean":"2023-10-10T22:18:24.015732+0000","last_became_active":"2023-10-10T22:18:24.012822+0000","last_became_peered":"2023-10-10T22:18:24.012822+0000","last_unstale":"2023-10-10T22:18:24.015732+0000","last_undegraded":"2023-10-10T22:18:24.015732+0000","last_fullsized":"2023-10-10T22:18:24.015732+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:03.558293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.019811+0000","last_change":"2023-10-10T22:18:23.007715+0000","last_active":"2023-10-10T22:18:24.019811+0000","last_peered":"2023-10-10T22:18:24.019811+0000","last_clean":"2023-10-10T22:18:24.019811+0000","last_became_active":"2023-10-10T22:18:23.007444+0000","last_became_peered":"2023-10-10T22:18:23.007444+0000","last_unstale":"2023-10-10T22:18:24.019811+0000","last_undegraded":"2023-10-10T22:18:24.019811+0000","last_fullsized":"2023-10-10T22:18:24.019811+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:02.553429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.023097+0000","last_change":"2023-10-10T22:18:24.019506+0000","last_active":"2023-10-10T22:18:24.023097+0000","last_peered":"2023-10-10T22:18:24.023097+0000","last_clean":"2023-10-10T22:18:24.023097+0000","last_became_active":"2023-10-10T22:18:24.019038+0000","last_became_peered":"2023-10-10T22:18:24.019038+0000","last_unstale":"2023-10-10T22:18:24.023097+0000","last_undegraded":"2023-10-10T22:18:24.023097+0000","last_fullsized":"2023-10-10T22:18:24.023097+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:42.765707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015794+0000","last_change":"2023-10-10T22:18:23.009956+0000","last_active":"2023-10-10T22:18:24.015794+0000","last_peered":"2023-10-10T22:18:24.015794+0000","last_clean":"2023-10-10T22:18:24.015794+0000","last_became_active":"2023-10-10T22:18:23.009689+0000","last_became_peered":"2023-10-10T22:18:23.009689+0000","last_unstale":"2023-10-10T22:18:24.015794+0000","last_undegraded":"2023-10-10T22:18:24.015794+0000","last_fullsized":"2023-10-10T22:18:24.015794+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:55:04.540620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021064+0000","last_change":"2023-10-10T22:18:24.013716+0000","last_active":"2023-10-10T22:18:24.021064+0000","last_peered":"2023-10-10T22:18:24.021064+0000","last_clean":"2023-10-10T22:18:24.021064+0000","last_became_active":"2023-10-10T22:18:24.013464+0000","last_became_peered":"2023-10-10T22:18:24.013464+0000","last_unstale":"2023-10-10T22:18:24.021064+0000","last_undegraded":"2023-10-10T22:18:24.021064+0000","last_fullsized":"2023-10-10T22:18:24.021064+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:58:24.854295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015240+0000","last_change":"2023-10-10T22:18:23.000295+0000","last_active":"2023-10-10T22:18:24.015240+0000","last_peered":"2023-10-10T22:18:24.015240+0000","last_clean":"2023-10-10T22:18:24.015240+0000","last_became_active":"2023-10-10T22:18:23.000023+0000","last_became_peered":"2023-10-10T22:18:23.000023+0000","last_unstale":"2023-10-10T22:18:24.015240+0000","last_undegraded":"2023-10-10T22:18:24.015240+0000","last_fullsized":"2023-10-10T22:18:24.015240+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:43:26.287613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.018999+0000","last_change":"2023-10-10T22:18:24.015676+0000","last_active":"2023-10-10T22:18:24.018999+0000","last_peered":"2023-10-10T22:18:24.018999+0000","last_clean":"2023-10-10T22:18:24.018999+0000","last_became_active":"2023-10-10T22:18:24.015226+0000","last_became_peered":"2023-10-10T22:18:24.015226+0000","last_unstale":"2023-10-10T22:18:24.018999+0000","last_undegraded":"2023-10-10T22:18:24.018999+0000","last_fullsized":"2023-10-10T22:18:24.018999+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:05.732160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.039581+0000","last_change":"2023-10-10T22:18:23.010858+0000","last_active":"2023-10-10T22:18:24.039581+0000","last_peered":"2023-10-10T22:18:24.039581+0000","last_clean":"2023-10-10T22:18:24.039581+0000","last_became_active":"2023-10-10T22:18:23.010570+0000","last_became_peered":"2023-10-10T22:18:23.010570+0000","last_unstale":"2023-10-10T22:18:24.039581+0000","last_undegraded":"2023-10-10T22:18:24.039581+0000","last_fullsized":"2023-10-10T22:18:24.039581+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:12:52.868686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031471+0000","last_change":"2023-10-10T22:18:24.021215+0000","last_active":"2023-10-10T22:18:24.031471+0000","last_peered":"2023-10-10T22:18:24.031471+0000","last_clean":"2023-10-10T22:18:24.031471+0000","last_became_active":"2023-10-10T22:18:24.020937+0000","last_became_peered":"2023-10-10T22:18:24.020937+0000","last_unstale":"2023-10-10T22:18:24.031471+0000","last_undegraded":"2023-10-10T22:18:24.031471+0000","last_fullsized":"2023-10-10T22:18:24.031471+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:17.312256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007390+0000","last_change":"2023-10-10T22:18:23.010529+0000","last_active":"2023-10-10T22:18:24.007390+0000","last_peered":"2023-10-10T22:18:24.007390+0000","last_clean":"2023-10-10T22:18:24.007390+0000","last_became_active":"2023-10-10T22:18:23.010238+0000","last_became_peered":"2023-10-10T22:18:23.010238+0000","last_unstale":"2023-10-10T22:18:24.007390+0000","last_undegraded":"2023-10-10T22:18:24.007390+0000","last_fullsized":"2023-10-10T22:18:24.007390+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:03:31.945185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035831+0000","last_change":"2023-10-10T22:18:24.030198+0000","last_active":"2023-10-10T22:18:24.035831+0000","last_peered":"2023-10-10T22:18:24.035831+0000","last_clean":"2023-10-10T22:18:24.035831+0000","last_became_active":"2023-10-10T22:18:24.029858+0000","last_became_peered":"2023-10-10T22:18:24.029858+0000","last_unstale":"2023-10-10T22:18:24.035831+0000","last_undegraded":"2023-10-10T22:18:24.035831+0000","last_fullsized":"2023-10-10T22:18:24.035831+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:30:38.352705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007039+0000","last_change":"2023-10-10T22:18:23.005193+0000","last_active":"2023-10-10T22:18:24.007039+0000","last_peered":"2023-10-10T22:18:24.007039+0000","last_clean":"2023-10-10T22:18:24.007039+0000","last_became_active":"2023-10-10T22:18:23.004949+0000","last_became_peered":"2023-10-10T22:18:23.004949+0000","last_unstale":"2023-10-10T22:18:24.007039+0000","last_undegraded":"2023-10-10T22:18:24.007039+0000","last_fullsized":"2023-10-10T22:18:24.007039+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:15.477452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021561+0000","last_change":"2023-10-10T22:18:24.020567+0000","last_active":"2023-10-10T22:18:24.021561+0000","last_peered":"2023-10-10T22:18:24.021561+0000","last_clean":"2023-10-10T22:18:24.021561+0000","last_became_active":"2023-10-10T22:18:24.020253+0000","last_became_peered":"2023-10-10T22:18:24.020253+0000","last_unstale":"2023-10-10T22:18:24.021561+0000","last_undegraded":"2023-10-10T22:18:24.021561+0000","last_fullsized":"2023-10-10T22:18:24.021561+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:41.929204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005299+0000","last_change":"2023-10-10T22:18:23.001514+0000","last_active":"2023-10-10T22:18:24.005299+0000","last_peered":"2023-10-10T22:18:24.005299+0000","last_clean":"2023-10-10T22:18:24.005299+0000","last_became_active":"2023-10-10T22:18:23.001080+0000","last_became_peered":"2023-10-10T22:18:23.001080+0000","last_unstale":"2023-10-10T22:18:24.005299+0000","last_undegraded":"2023-10-10T22:18:24.005299+0000","last_fullsized":"2023-10-10T22:18:24.005299+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:02:46.155762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.024006+0000","last_change":"2023-10-10T22:18:24.021309+0000","last_active":"2023-10-10T22:18:24.024006+0000","last_peered":"2023-10-10T22:18:24.024006+0000","last_clean":"2023-10-10T22:18:24.024006+0000","last_became_active":"2023-10-10T22:18:24.021063+0000","last_became_peered":"2023-10-10T22:18:24.021063+0000","last_unstale":"2023-10-10T22:18:24.024006+0000","last_undegraded":"2023-10-10T22:18:24.024006+0000","last_fullsized":"2023-10-10T22:18:24.024006+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:05:53.554877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.002043+0000","last_change":"2023-10-10T22:18:23.008013+0000","last_active":"2023-10-10T22:18:24.002043+0000","last_peered":"2023-10-10T22:18:24.002043+0000","last_clean":"2023-10-10T22:18:24.002043+0000","last_became_active":"2023-10-10T22:18:23.007704+0000","last_became_peered":"2023-10-10T22:18:23.007704+0000","last_unstale":"2023-10-10T22:18:24.002043+0000","last_undegraded":"2023-10-10T22:18:24.002043+0000","last_fullsized":"2023-10-10T22:18:24.002043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:55:32.131373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031735+0000","last_change":"2023-10-10T22:18:24.026860+0000","last_active":"2023-10-10T22:18:24.031735+0000","last_peered":"2023-10-10T22:18:24.031735+0000","last_clean":"2023-10-10T22:18:24.031735+0000","last_became_active":"2023-10-10T22:18:24.026588+0000","last_became_peered":"2023-10-10T22:18:24.026588+0000","last_unstale":"2023-10-10T22:18:24.031735+0000","last_undegraded":"2023-10-10T22:18:24.031735+0000","last_fullsized":"2023-10-10T22:18:24.031735+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:20.286832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.018970+0000","last_change":"2023-10-10T22:18:23.010859+0000","last_active":"2023-10-10T22:18:24.018970+0000","last_peered":"2023-10-10T22:18:24.018970+0000","last_clean":"2023-10-10T22:18:24.018970+0000","last_became_active":"2023-10-10T22:18:23.010594+0000","last_became_peered":"2023-10-10T22:18:23.010594+0000","last_unstale":"2023-10-10T22:18:24.018970+0000","last_undegraded":"2023-10-10T22:18:24.018970+0000","last_fullsized":"2023-10-10T22:18:24.018970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:15:05.377655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030251+0000","last_change":"2023-10-10T22:18:24.023510+0000","last_active":"2023-10-10T22:18:24.030251+0000","last_peered":"2023-10-10T22:18:24.030251+0000","last_clean":"2023-10-10T22:18:24.030251+0000","last_became_active":"2023-10-10T22:18:24.023244+0000","last_became_peered":"2023-10-10T22:18:24.023244+0000","last_unstale":"2023-10-10T22:18:24.030251+0000","last_undegraded":"2023-10-10T22:18:24.030251+0000","last_fullsized":"2023-10-10T22:18:24.030251+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:05:49.841998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015379+0000","last_change":"2023-10-10T22:18:23.005033+0000","last_active":"2023-10-10T22:18:24.015379+0000","last_peered":"2023-10-10T22:18:24.015379+0000","last_clean":"2023-10-10T22:18:24.015379+0000","last_became_active":"2023-10-10T22:18:23.004786+0000","last_became_peered":"2023-10-10T22:18:23.004786+0000","last_unstale":"2023-10-10T22:18:24.015379+0000","last_undegraded":"2023-10-10T22:18:24.015379+0000","last_fullsized":"2023-10-10T22:18:24.015379+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:33.216584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.016266+0000","last_change":"2023-10-10T22:18:24.014439+0000","last_active":"2023-10-10T22:18:24.016266+0000","last_peered":"2023-10-10T22:18:24.016266+0000","last_clean":"2023-10-10T22:18:24.016266+0000","last_became_active":"2023-10-10T22:18:24.014105+0000","last_became_peered":"2023-10-10T22:18:24.014105+0000","last_unstale":"2023-10-10T22:18:24.016266+0000","last_undegraded":"2023-10-10T22:18:24.016266+0000","last_fullsized":"2023-10-10T22:18:24.016266+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:42.765707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005479+0000","last_change":"2023-10-10T22:18:23.006900+0000","last_active":"2023-10-10T22:18:24.005479+0000","last_peered":"2023-10-10T22:18:24.005479+0000","last_clean":"2023-10-10T22:18:24.005479+0000","last_became_active":"2023-10-10T22:18:23.006595+0000","last_became_peered":"2023-10-10T22:18:23.006595+0000","last_unstale":"2023-10-10T22:18:24.005479+0000","last_undegraded":"2023-10-10T22:18:24.005479+0000","last_fullsized":"2023-10-10T22:18:24.005479+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:37.566532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021933+0000","last_change":"2023-10-10T22:18:24.015171+0000","last_active":"2023-10-10T22:18:24.021933+0000","last_peered":"2023-10-10T22:18:24.021933+0000","last_clean":"2023-10-10T22:18:24.021933+0000","last_became_active":"2023-10-10T22:18:24.014398+0000","last_became_peered":"2023-10-10T22:18:24.014398+0000","last_unstale":"2023-10-10T22:18:24.021933+0000","last_undegraded":"2023-10-10T22:18:24.021933+0000","last_fullsized":"2023-10-10T22:18:24.021933+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:13:30.183999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"174'3","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038723+0000","last_change":"2023-10-10T22:18:23.001099+0000","last_active":"2023-10-10T22:18:24.038723+0000","last_peered":"2023-10-10T22:18:24.038723+0000","last_clean":"2023-10-10T22:18:24.038723+0000","last_became_active":"2023-10-10T22:18:23.000827+0000","last_became_peered":"2023-10-10T22:18:23.000827+0000","last_unstale":"2023-10-10T22:18:24.038723+0000","last_undegraded":"2023-10-10T22:18:24.038723+0000","last_fullsized":"2023-10-10T22:18:24.038723+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:16:16.967758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"164'293","reported_seq":922,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.016534+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:18:24.016534+0000","last_peered":"2023-10-10T22:18:24.016534+0000","last_clean":"2023-10-10T22:18:24.016534+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:18:24.016534+0000","last_undegraded":"2023-10-10T22:18:24.016534+0000","last_fullsized":"2023-10-10T22:18:24.016534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543051,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308196,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063644,"statfs":{"total":96636764160,"available":96321171456,"internally_reserved":0,"allocated":2781184,"data_stored":1675943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96999999999999997,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73599999999999999,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.77600000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.98699999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88500000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.871},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.75900000000000001,"15min":0.754},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.95699999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.94899999999999995},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85899999999999999,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.442},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.62}]},{"osd":6,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0289999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66900000000000004}]}]},{"osd":6,"up_from":14,"seq":60129543050,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311716,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060124,"statfs":{"total":96636764160,"available":96317566976,"internally_reserved":0,"allocated":2191360,"data_stored":1085097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.63},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.755},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.69199999999999995}]}]},{"osd":1,"up_from":14,"seq":60129543050,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307612,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064228,"statfs":{"total":96636764160,"available":96321769472,"internally_reserved":0,"allocated":2183168,"data_stored":1085505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.622}]}]},{"osd":0,"up_from":14,"seq":60129543052,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304108,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067732,"statfs":{"total":96636764160,"available":96325357568,"internally_reserved":0,"allocated":2789376,"data_stored":1676889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.56000000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74299999999999999,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.90800000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.84599999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.86099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543052,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311720,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060120,"statfs":{"total":96636764160,"available":96317562880,"internally_reserved":0,"allocated":2195456,"data_stored":1086557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32600000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55600000000000005,"15min":0.56999999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67200000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.498},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.65400000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.85299999999999998,"5min":1.355,"15min":1.355},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83699999999999997,"5min":1.248,"15min":1.248},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.871,"5min":1.1359999999999999,"15min":1.232},"last":0.77200000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.82799999999999996,"5min":1.278,"15min":1.278},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.78400000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.82499999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.91300000000000003,"5min":1.355,"15min":1.355},"last":0.82299999999999995}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311708,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060132,"statfs":{"total":96636764160,"available":96317575168,"internally_reserved":0,"allocated":2183168,"data_stored":1085041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.81999999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.66500000000000004,"5min":0.748,"15min":0.77900000000000003},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.875},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.877},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.499}]},{"osd":4,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93799999999999994,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.624,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0389999999999999,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.63600000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.079,"5min":1.218,"15min":1.218},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.63300000000000001,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.177,"15min":1.177},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129543052,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311704,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060136,"statfs":{"total":96636764160,"available":96317579264,"internally_reserved":0,"allocated":2179072,"data_stored":1084951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.89400000000000002,"15min":0.96499999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71999999999999997,"15min":0.74199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.53200000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72399999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.97199999999999998,"5min":1.002,"15min":1.1879999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.69599999999999995,"15min":0.71299999999999997},"min":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.135},"last":0.71899999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.46200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.51200000000000001,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.996},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":0.93200000000000005,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":0.89600000000000002,"5min":1,"15min":1},"last":0.74099999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.40500000000000003,"5min":0.38200000000000001,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.879,"15min":0.97299999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64800000000000002,"15min":0.629},"min":{"1min":0.443,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.82599999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48299999999999998,"5min":0.42999999999999999,"15min":0.40200000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94799999999999995},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":1.052,"15min":1.052},"last":0.63600000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70799999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.028},"last":0.69899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129543050,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311708,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060132,"statfs":{"total":96636764160,"available":96317575168,"internally_reserved":0,"allocated":2183168,"data_stored":1084973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.505}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.752},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.73799999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80700000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:18:33.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:18:33.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.473+0000 7f2aa5b9d700 1 Processor -- start 2023-10-10T22:18:33.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.473+0000 7f2aa5b9d700 1 -- start start 2023-10-10T22:18:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.474+0000 7f2aa5b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aa015d230 0x7f2aa015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.474+0000 7f2aa5b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa00b2980 con 0x7f2aa01597f0 2023-10-10T22:18:33.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.474+0000 7f2aa5b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa015db70 con 0x7f2aa0159420 2023-10-10T22:18:33.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.474+0000 7f2aa5b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00b11d0 con 0x7f2aa015d230 2023-10-10T22:18:33.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.474+0000 7f2aa539c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aa015d230 0x7f2aa015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:33.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2aa539c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aa015d230 0x7f2aa015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40564/0 (socket says 172.21.15.154:40564) 2023-10-10T22:18:33.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2aa539c700 1 -- 172.21.15.154:0/1122439841 learned_addr learned my addr 172.21.15.154:0/1122439841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:33.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2a9ffff700 1 --1- 172.21.15.154:0/1122439841 >> v1:172.21.15.154:6789/0 conn(0x7f2aa01597f0 0x7f2aa00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54102/0 (socket says 172.21.15.154:54102) 2023-10-10T22:18:33.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2aa539c700 1 -- 172.21.15.154:0/1122439841 >> v1:172.21.15.179:6789/0 conn(0x7f2aa0159420 legacy=0x7f2aa00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2aa539c700 1 -- 172.21.15.154:0/1122439841 >> v1:172.21.15.154:6789/0 conn(0x7f2aa01597f0 legacy=0x7f2aa00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2aa539c700 1 -- 172.21.15.154:0/1122439841 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00b14b0 con 0x7f2aa015d230 2023-10-10T22:18:33.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2aa539c700 1 --2- 172.21.15.154:0/1122439841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 0x7f2aa015d630 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009f20 tx=0x7f2a98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5df6e2be7f92477 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:33.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2a9f7fe700 1 -- 172.21.15.154:0/1122439841 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800e070 con 0x7f2aa015d230 2023-10-10T22:18:33.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2a9f7fe700 1 -- 172.21.15.154:0/1122439841 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9800ba80 con 0x7f2aa015d230 2023-10-10T22:18:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.475+0000 7f2a9f7fe700 1 -- 172.21.15.154:0/1122439841 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a980092e0 con 0x7f2aa015d230 2023-10-10T22:18:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.476+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/1122439841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 msgr2=0x7f2aa015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.476+0000 7f2aa5b9d700 1 --2- 172.21.15.154:0/1122439841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 0x7f2aa015d630 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009f20 tx=0x7f2a98009840 comp rx=0 tx=0).stop 2023-10-10T22:18:33.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.476+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/1122439841 shutdown_connections 2023-10-10T22:18:33.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.476+0000 7f2aa5b9d700 1 --2- 172.21.15.154:0/1122439841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 0x7f2aa015d630 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.476+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/1122439841 >> 172.21.15.154:0/1122439841 conn(0x7f2aa00d0660 msgr2=0x7f2aa00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:33.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.476+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/1122439841 shutdown_connections 2023-10-10T22:18:33.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.476+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/1122439841 wait complete. 2023-10-10T22:18:33.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.478+0000 7f2aa5b9d700 1 Processor -- start 2023-10-10T22:18:33.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.478+0000 7f2aa5b9d700 1 -- start start 2023-10-10T22:18:33.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa5b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aa0159420 0x7f2aa0154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa5b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aa01597f0 0x7f2aa00c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa5b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 0x7f2aa00c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa5b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00c7bf0 con 0x7f2aa015d230 2023-10-10T22:18:33.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa5b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00c7ed0 con 0x7f2aa0159420 2023-10-10T22:18:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa5b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00c5970 con 0x7f2aa01597f0 2023-10-10T22:18:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa539c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 0x7f2aa00c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa539c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 0x7f2aa00c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40574/0 (socket says 172.21.15.154:40574) 2023-10-10T22:18:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa539c700 1 -- 172.21.15.154:0/2511943706 learned_addr learned my addr 172.21.15.154:0/2511943706 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa539c700 1 -- 172.21.15.154:0/2511943706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aa01597f0 msgr2=0x7f2aa00c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa539c700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aa01597f0 0x7f2aa00c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa539c700 1 -- 172.21.15.154:0/2511943706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aa0159420 msgr2=0x7f2aa0154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa4b9b700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aa0159420 0x7f2aa0154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:33.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa539c700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aa0159420 0x7f2aa0154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa539c700 1 -- 172.21.15.154:0/2511943706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98009ae0 con 0x7f2aa015d230 2023-10-10T22:18:33.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.479+0000 7f2aa4b9b700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aa0159420 0x7f2aa0154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:33.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.480+0000 7f2aa539c700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 0x7f2aa00c6170 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0089340 tx=0x7f2a98018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:33.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.480+0000 7f2a9cff9700 1 -- 172.21.15.154:0/2511943706 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a98008e40 con 0x7f2aa015d230 2023-10-10T22:18:33.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.480+0000 7f2a9cff9700 1 -- 172.21.15.154:0/2511943706 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9801c410 con 0x7f2aa015d230 2023-10-10T22:18:33.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.480+0000 7f2a9cff9700 1 -- 172.21.15.154:0/2511943706 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9801c7d0 con 0x7f2aa015d230 2023-10-10T22:18:33.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.480+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa00c5c50 con 0x7f2aa015d230 2023-10-10T22:18:33.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.480+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa00c81b0 con 0x7f2aa015d230 2023-10-10T22:18:33.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.481+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa00c57c0 con 0x7f2aa015d230 2023-10-10T22:18:33.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.482+0000 7f2a9cff9700 1 -- 172.21.15.154:0/2511943706 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a98003040 con 0x7f2aa015d230 2023-10-10T22:18:33.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.483+0000 7f2a9cff9700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2a84066f30 0x7f2a840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.483+0000 7f2a9cff9700 1 -- 172.21.15.154:0/2511943706 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2a98086360 con 0x7f2aa015d230 2023-10-10T22:18:33.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.483+0000 7f2aa4b9b700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2a84066f30 0x7f2a840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:33.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.484+0000 7f2aa4b9b700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2a84066f30 0x7f2a840693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2a94001840 tx=0x7f2a94009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:33.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.486+0000 7f2a9cff9700 1 -- 172.21.15.154:0/2511943706 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a980533e0 con 0x7f2aa015d230 2023-10-10T22:18:33.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.673+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2aa00c8040 con 0x7f2a84066f30 2023-10-10T22:18:33.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.681+0000 7f2a9cff9700 1 -- 172.21.15.154:0/2511943706 <== mgr.8940 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289338 (secure 0 0 0) 0x7f2aa00c8040 con 0x7f2a84066f30 2023-10-10T22:18:33.686 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:33.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2a84066f30 msgr2=0x7f2a840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2a84066f30 0x7f2a840693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2a94001840 tx=0x7f2a94009040 comp rx=0 tx=0).stop 2023-10-10T22:18:33.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 msgr2=0x7f2aa00c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 0x7f2aa00c6170 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0089340 tx=0x7f2a98018000 comp rx=0 tx=0).stop 2023-10-10T22:18:33.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 shutdown_connections 2023-10-10T22:18:33.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2a84066f30 0x7f2a840693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa015d230 0x7f2aa00c6170 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aa0159420 0x7f2aa0154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 --2- 172.21.15.154:0/2511943706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aa01597f0 0x7f2aa00c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 >> 172.21.15.154:0/2511943706 conn(0x7f2aa00d0660 msgr2=0x7f2aa00d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 shutdown_connections 2023-10-10T22:18:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.685+0000 7f2aa5b9d700 1 -- 172.21.15.154:0/2511943706 wait complete. 2023-10-10T22:18:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:18:33.705 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-10T22:18:31.726024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2478472,"kb_used_data":18248,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752496248,"statfs":{"total":773094113280,"available":770556157952,"internally_reserved":0,"allocated":18685952,"data_stored":9864956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001861"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021876+0000","last_change":"2023-10-10T22:18:24.019023+0000","last_active":"2023-10-10T22:18:24.021876+0000","last_peered":"2023-10-10T22:18:24.021876+0000","last_clean":"2023-10-10T22:18:24.021876+0000","last_became_active":"2023-10-10T22:18:24.018737+0000","last_became_peered":"2023-10-10T22:18:24.018737+0000","last_unstale":"2023-10-10T22:18:24.021876+0000","last_undegraded":"2023-10-10T22:18:24.021876+0000","last_fullsized":"2023-10-10T22:18:24.021876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:38:57.526292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030348+0000","last_change":"2023-10-10T22:18:24.017068+0000","last_active":"2023-10-10T22:18:24.030348+0000","last_peered":"2023-10-10T22:18:24.030348+0000","last_clean":"2023-10-10T22:18:24.030348+0000","last_became_active":"2023-10-10T22:18:24.016811+0000","last_became_peered":"2023-10-10T22:18:24.016811+0000","last_unstale":"2023-10-10T22:18:24.030348+0000","last_undegraded":"2023-10-10T22:18:24.030348+0000","last_fullsized":"2023-10-10T22:18:24.030348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:25.109025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037943+0000","last_change":"2023-10-10T22:18:24.034548+0000","last_active":"2023-10-10T22:18:24.037943+0000","last_peered":"2023-10-10T22:18:24.037943+0000","last_clean":"2023-10-10T22:18:24.037943+0000","last_became_active":"2023-10-10T22:18:24.034276+0000","last_became_peered":"2023-10-10T22:18:24.034276+0000","last_unstale":"2023-10-10T22:18:24.037943+0000","last_undegraded":"2023-10-10T22:18:24.037943+0000","last_fullsized":"2023-10-10T22:18:24.037943+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:20.286832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031476+0000","last_change":"2023-10-10T22:18:24.026534+0000","last_active":"2023-10-10T22:18:24.031476+0000","last_peered":"2023-10-10T22:18:24.031476+0000","last_clean":"2023-10-10T22:18:24.031476+0000","last_became_active":"2023-10-10T22:18:24.026277+0000","last_became_peered":"2023-10-10T22:18:24.026277+0000","last_unstale":"2023-10-10T22:18:24.031476+0000","last_undegraded":"2023-10-10T22:18:24.031476+0000","last_fullsized":"2023-10-10T22:18:24.031476+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:20.286832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.019920+0000","last_change":"2023-10-10T22:18:24.017070+0000","last_active":"2023-10-10T22:18:24.019920+0000","last_peered":"2023-10-10T22:18:24.019920+0000","last_clean":"2023-10-10T22:18:24.019920+0000","last_became_active":"2023-10-10T22:18:24.016794+0000","last_became_peered":"2023-10-10T22:18:24.016794+0000","last_unstale":"2023-10-10T22:18:24.019920+0000","last_undegraded":"2023-10-10T22:18:24.019920+0000","last_fullsized":"2023-10-10T22:18:24.019920+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:17.312256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.033056+0000","last_change":"2023-10-10T22:18:24.028207+0000","last_active":"2023-10-10T22:18:24.033056+0000","last_peered":"2023-10-10T22:18:24.033056+0000","last_clean":"2023-10-10T22:18:24.033056+0000","last_became_active":"2023-10-10T22:18:24.027960+0000","last_became_peered":"2023-10-10T22:18:24.027960+0000","last_unstale":"2023-10-10T22:18:24.033056+0000","last_undegraded":"2023-10-10T22:18:24.033056+0000","last_fullsized":"2023-10-10T22:18:24.033056+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:45:32.609233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022006+0000","last_change":"2023-10-10T22:18:24.014367+0000","last_active":"2023-10-10T22:18:24.022006+0000","last_peered":"2023-10-10T22:18:24.022006+0000","last_clean":"2023-10-10T22:18:24.022006+0000","last_became_active":"2023-10-10T22:18:24.014089+0000","last_became_peered":"2023-10-10T22:18:24.014089+0000","last_unstale":"2023-10-10T22:18:24.022006+0000","last_undegraded":"2023-10-10T22:18:24.022006+0000","last_fullsized":"2023-10-10T22:18:24.022006+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:55:05.545484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022327+0000","last_change":"2023-10-10T22:18:24.019997+0000","last_active":"2023-10-10T22:18:24.022327+0000","last_peered":"2023-10-10T22:18:24.022327+0000","last_clean":"2023-10-10T22:18:24.022327+0000","last_became_active":"2023-10-10T22:18:24.019623+0000","last_became_peered":"2023-10-10T22:18:24.019623+0000","last_unstale":"2023-10-10T22:18:24.022327+0000","last_undegraded":"2023-10-10T22:18:24.022327+0000","last_fullsized":"2023-10-10T22:18:24.022327+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:34:34.643756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029552+0000","last_change":"2023-10-10T22:18:24.012307+0000","last_active":"2023-10-10T22:18:24.029552+0000","last_peered":"2023-10-10T22:18:24.029552+0000","last_clean":"2023-10-10T22:18:24.029552+0000","last_became_active":"2023-10-10T22:18:24.012048+0000","last_became_peered":"2023-10-10T22:18:24.012048+0000","last_unstale":"2023-10-10T22:18:24.029552+0000","last_undegraded":"2023-10-10T22:18:24.029552+0000","last_fullsized":"2023-10-10T22:18:24.029552+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:52:27.774330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035115+0000","last_change":"2023-10-10T22:18:24.030000+0000","last_active":"2023-10-10T22:18:24.035115+0000","last_peered":"2023-10-10T22:18:24.035115+0000","last_clean":"2023-10-10T22:18:24.035115+0000","last_became_active":"2023-10-10T22:18:24.029737+0000","last_became_peered":"2023-10-10T22:18:24.029737+0000","last_unstale":"2023-10-10T22:18:24.035115+0000","last_undegraded":"2023-10-10T22:18:24.035115+0000","last_fullsized":"2023-10-10T22:18:24.035115+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:25.798391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021544+0000","last_change":"2023-10-10T22:18:24.020520+0000","last_active":"2023-10-10T22:18:24.021544+0000","last_peered":"2023-10-10T22:18:24.021544+0000","last_clean":"2023-10-10T22:18:24.021544+0000","last_became_active":"2023-10-10T22:18:24.019865+0000","last_became_peered":"2023-10-10T22:18:24.019865+0000","last_unstale":"2023-10-10T22:18:24.021544+0000","last_undegraded":"2023-10-10T22:18:24.021544+0000","last_fullsized":"2023-10-10T22:18:24.021544+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:40.234186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035922+0000","last_change":"2023-10-10T22:18:24.029625+0000","last_active":"2023-10-10T22:18:24.035922+0000","last_peered":"2023-10-10T22:18:24.035922+0000","last_clean":"2023-10-10T22:18:24.035922+0000","last_became_active":"2023-10-10T22:18:24.029347+0000","last_became_peered":"2023-10-10T22:18:24.029347+0000","last_unstale":"2023-10-10T22:18:24.035922+0000","last_undegraded":"2023-10-10T22:18:24.035922+0000","last_fullsized":"2023-10-10T22:18:24.035922+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:41:31.465876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.019899+0000","last_change":"2023-10-10T22:18:24.017057+0000","last_active":"2023-10-10T22:18:24.019899+0000","last_peered":"2023-10-10T22:18:24.019899+0000","last_clean":"2023-10-10T22:18:24.019899+0000","last_became_active":"2023-10-10T22:18:24.016762+0000","last_became_peered":"2023-10-10T22:18:24.016762+0000","last_unstale":"2023-10-10T22:18:24.019899+0000","last_undegraded":"2023-10-10T22:18:24.019899+0000","last_fullsized":"2023-10-10T22:18:24.019899+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:04:39.002108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.028575+0000","last_change":"2023-10-10T22:18:24.025262+0000","last_active":"2023-10-10T22:18:24.028575+0000","last_peered":"2023-10-10T22:18:24.028575+0000","last_clean":"2023-10-10T22:18:24.028575+0000","last_became_active":"2023-10-10T22:18:24.024484+0000","last_became_peered":"2023-10-10T22:18:24.024484+0000","last_unstale":"2023-10-10T22:18:24.028575+0000","last_undegraded":"2023-10-10T22:18:24.028575+0000","last_fullsized":"2023-10-10T22:18:24.028575+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:33:08.622818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.026704+0000","last_change":"2023-10-10T22:18:24.022561+0000","last_active":"2023-10-10T22:18:24.026704+0000","last_peered":"2023-10-10T22:18:24.026704+0000","last_clean":"2023-10-10T22:18:24.026704+0000","last_became_active":"2023-10-10T22:18:24.022195+0000","last_became_peered":"2023-10-10T22:18:24.022195+0000","last_unstale":"2023-10-10T22:18:24.026704+0000","last_undegraded":"2023-10-10T22:18:24.026704+0000","last_fullsized":"2023-10-10T22:18:24.026704+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:37:11.679932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015417+0000","last_change":"2023-10-10T22:18:24.013442+0000","last_active":"2023-10-10T22:18:24.015417+0000","last_peered":"2023-10-10T22:18:24.015417+0000","last_clean":"2023-10-10T22:18:24.015417+0000","last_became_active":"2023-10-10T22:18:24.013181+0000","last_became_peered":"2023-10-10T22:18:24.013181+0000","last_unstale":"2023-10-10T22:18:24.015417+0000","last_undegraded":"2023-10-10T22:18:24.015417+0000","last_fullsized":"2023-10-10T22:18:24.015417+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:37:48.927861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031945+0000","last_change":"2023-10-10T22:18:24.027476+0000","last_active":"2023-10-10T22:18:24.031945+0000","last_peered":"2023-10-10T22:18:24.031945+0000","last_clean":"2023-10-10T22:18:24.031945+0000","last_became_active":"2023-10-10T22:18:24.027123+0000","last_became_peered":"2023-10-10T22:18:24.027123+0000","last_unstale":"2023-10-10T22:18:24.031945+0000","last_undegraded":"2023-10-10T22:18:24.031945+0000","last_fullsized":"2023-10-10T22:18:24.031945+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:39:26.706568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037735+0000","last_change":"2023-10-10T22:18:24.031527+0000","last_active":"2023-10-10T22:18:24.037735+0000","last_peered":"2023-10-10T22:18:24.037735+0000","last_clean":"2023-10-10T22:18:24.037735+0000","last_became_active":"2023-10-10T22:18:24.031231+0000","last_became_peered":"2023-10-10T22:18:24.031231+0000","last_unstale":"2023-10-10T22:18:24.037735+0000","last_undegraded":"2023-10-10T22:18:24.037735+0000","last_fullsized":"2023-10-10T22:18:24.037735+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:07:12.027703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.020613+0000","last_change":"2023-10-10T22:18:24.016131+0000","last_active":"2023-10-10T22:18:24.020613+0000","last_peered":"2023-10-10T22:18:24.020613+0000","last_clean":"2023-10-10T22:18:24.020613+0000","last_became_active":"2023-10-10T22:18:24.015862+0000","last_became_peered":"2023-10-10T22:18:24.015862+0000","last_unstale":"2023-10-10T22:18:24.020613+0000","last_undegraded":"2023-10-10T22:18:24.020613+0000","last_fullsized":"2023-10-10T22:18:24.020613+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:06.996520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037117+0000","last_change":"2023-10-10T22:18:24.031254+0000","last_active":"2023-10-10T22:18:24.037117+0000","last_peered":"2023-10-10T22:18:24.037117+0000","last_clean":"2023-10-10T22:18:24.037117+0000","last_became_active":"2023-10-10T22:18:24.030943+0000","last_became_peered":"2023-10-10T22:18:24.030943+0000","last_unstale":"2023-10-10T22:18:24.037117+0000","last_undegraded":"2023-10-10T22:18:24.037117+0000","last_fullsized":"2023-10-10T22:18:24.037117+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:21:51.295846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.032029+0000","last_change":"2023-10-10T22:18:24.028005+0000","last_active":"2023-10-10T22:18:24.032029+0000","last_peered":"2023-10-10T22:18:24.032029+0000","last_clean":"2023-10-10T22:18:24.032029+0000","last_became_active":"2023-10-10T22:18:24.027742+0000","last_became_peered":"2023-10-10T22:18:24.027742+0000","last_unstale":"2023-10-10T22:18:24.032029+0000","last_undegraded":"2023-10-10T22:18:24.032029+0000","last_fullsized":"2023-10-10T22:18:24.032029+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:21:22.813027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.036843+0000","last_change":"2023-10-10T22:18:24.032801+0000","last_active":"2023-10-10T22:18:24.036843+0000","last_peered":"2023-10-10T22:18:24.036843+0000","last_clean":"2023-10-10T22:18:24.036843+0000","last_became_active":"2023-10-10T22:18:24.032538+0000","last_became_peered":"2023-10-10T22:18:24.032538+0000","last_unstale":"2023-10-10T22:18:24.036843+0000","last_undegraded":"2023-10-10T22:18:24.036843+0000","last_fullsized":"2023-10-10T22:18:24.036843+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:07:14.186774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.025888+0000","last_change":"2023-10-10T22:18:24.020699+0000","last_active":"2023-10-10T22:18:24.025888+0000","last_peered":"2023-10-10T22:18:24.025888+0000","last_clean":"2023-10-10T22:18:24.025888+0000","last_became_active":"2023-10-10T22:18:24.020415+0000","last_became_peered":"2023-10-10T22:18:24.020415+0000","last_unstale":"2023-10-10T22:18:24.025888+0000","last_undegraded":"2023-10-10T22:18:24.025888+0000","last_fullsized":"2023-10-10T22:18:24.025888+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:54.985351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035087+0000","last_change":"2023-10-10T22:18:24.029760+0000","last_active":"2023-10-10T22:18:24.035087+0000","last_peered":"2023-10-10T22:18:24.035087+0000","last_clean":"2023-10-10T22:18:24.035087+0000","last_became_active":"2023-10-10T22:18:24.029394+0000","last_became_peered":"2023-10-10T22:18:24.029394+0000","last_unstale":"2023-10-10T22:18:24.035087+0000","last_undegraded":"2023-10-10T22:18:24.035087+0000","last_fullsized":"2023-10-10T22:18:24.035087+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:00:01.523458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015895+0000","last_change":"2023-10-10T22:18:24.013617+0000","last_active":"2023-10-10T22:18:24.015895+0000","last_peered":"2023-10-10T22:18:24.015895+0000","last_clean":"2023-10-10T22:18:24.015895+0000","last_became_active":"2023-10-10T22:18:24.013355+0000","last_became_peered":"2023-10-10T22:18:24.013355+0000","last_unstale":"2023-10-10T22:18:24.015895+0000","last_undegraded":"2023-10-10T22:18:24.015895+0000","last_fullsized":"2023-10-10T22:18:24.015895+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:14.066926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022295+0000","last_change":"2023-10-10T22:18:24.020650+0000","last_active":"2023-10-10T22:18:24.022295+0000","last_peered":"2023-10-10T22:18:24.022295+0000","last_clean":"2023-10-10T22:18:24.022295+0000","last_became_active":"2023-10-10T22:18:24.020281+0000","last_became_peered":"2023-10-10T22:18:24.020281+0000","last_unstale":"2023-10-10T22:18:24.022295+0000","last_undegraded":"2023-10-10T22:18:24.022295+0000","last_fullsized":"2023-10-10T22:18:24.022295+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:21.748391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021306+0000","last_change":"2023-10-10T22:18:24.015713+0000","last_active":"2023-10-10T22:18:24.021306+0000","last_peered":"2023-10-10T22:18:24.021306+0000","last_clean":"2023-10-10T22:18:24.021306+0000","last_became_active":"2023-10-10T22:18:24.015460+0000","last_became_peered":"2023-10-10T22:18:24.015460+0000","last_unstale":"2023-10-10T22:18:24.021306+0000","last_undegraded":"2023-10-10T22:18:24.021306+0000","last_fullsized":"2023-10-10T22:18:24.021306+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:29:10.929467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030201+0000","last_change":"2023-10-10T22:18:24.026148+0000","last_active":"2023-10-10T22:18:24.030201+0000","last_peered":"2023-10-10T22:18:24.030201+0000","last_clean":"2023-10-10T22:18:24.030201+0000","last_became_active":"2023-10-10T22:18:24.025843+0000","last_became_peered":"2023-10-10T22:18:24.025843+0000","last_unstale":"2023-10-10T22:18:24.030201+0000","last_undegraded":"2023-10-10T22:18:24.030201+0000","last_fullsized":"2023-10-10T22:18:24.030201+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:52:39.870836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.032827+0000","last_change":"2023-10-10T22:18:24.028969+0000","last_active":"2023-10-10T22:18:24.032827+0000","last_peered":"2023-10-10T22:18:24.032827+0000","last_clean":"2023-10-10T22:18:24.032827+0000","last_became_active":"2023-10-10T22:18:24.028680+0000","last_became_peered":"2023-10-10T22:18:24.028680+0000","last_unstale":"2023-10-10T22:18:24.032827+0000","last_undegraded":"2023-10-10T22:18:24.032827+0000","last_fullsized":"2023-10-10T22:18:24.032827+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:52:06.319920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.020901+0000","last_change":"2023-10-10T22:18:24.019275+0000","last_active":"2023-10-10T22:18:24.020901+0000","last_peered":"2023-10-10T22:18:24.020901+0000","last_clean":"2023-10-10T22:18:24.020901+0000","last_became_active":"2023-10-10T22:18:24.018462+0000","last_became_peered":"2023-10-10T22:18:24.018462+0000","last_unstale":"2023-10-10T22:18:24.020901+0000","last_undegraded":"2023-10-10T22:18:24.020901+0000","last_fullsized":"2023-10-10T22:18:24.020901+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:55:33.136236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029522+0000","last_change":"2023-10-10T22:18:24.019584+0000","last_active":"2023-10-10T22:18:24.029522+0000","last_peered":"2023-10-10T22:18:24.029522+0000","last_clean":"2023-10-10T22:18:24.029522+0000","last_became_active":"2023-10-10T22:18:24.017476+0000","last_became_peered":"2023-10-10T22:18:24.017476+0000","last_unstale":"2023-10-10T22:18:24.029522+0000","last_undegraded":"2023-10-10T22:18:24.029522+0000","last_fullsized":"2023-10-10T22:18:24.029522+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:09:57.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.022637+0000","last_change":"2023-10-10T22:18:24.016466+0000","last_active":"2023-10-10T22:18:24.022637+0000","last_peered":"2023-10-10T22:18:24.022637+0000","last_clean":"2023-10-10T22:18:24.022637+0000","last_became_active":"2023-10-10T22:18:24.016215+0000","last_became_peered":"2023-10-10T22:18:24.016215+0000","last_unstale":"2023-10-10T22:18:24.022637+0000","last_undegraded":"2023-10-10T22:18:24.022637+0000","last_fullsized":"2023-10-10T22:18:24.022637+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:13:32.552411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035187+0000","last_change":"2023-10-10T22:18:24.033665+0000","last_active":"2023-10-10T22:18:24.035187+0000","last_peered":"2023-10-10T22:18:24.035187+0000","last_clean":"2023-10-10T22:18:24.035187+0000","last_became_active":"2023-10-10T22:18:24.033294+0000","last_became_peered":"2023-10-10T22:18:24.033294+0000","last_unstale":"2023-10-10T22:18:24.035187+0000","last_undegraded":"2023-10-10T22:18:24.035187+0000","last_fullsized":"2023-10-10T22:18:24.035187+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:01:33.002648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"174'4","reported_seq":14,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.040674+0000","last_change":"2023-10-10T22:18:23.010525+0000","last_active":"2023-10-10T22:18:24.040674+0000","last_peered":"2023-10-10T22:18:24.040674+0000","last_clean":"2023-10-10T22:18:24.040674+0000","last_became_active":"2023-10-10T22:18:23.010172+0000","last_became_peered":"2023-10-10T22:18:23.010172+0000","last_unstale":"2023-10-10T22:18:24.040674+0000","last_undegraded":"2023-10-10T22:18:24.040674+0000","last_fullsized":"2023-10-10T22:18:24.040674+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:32:34.760021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029570+0000","last_change":"2023-10-10T22:18:24.016367+0000","last_active":"2023-10-10T22:18:24.029570+0000","last_peered":"2023-10-10T22:18:24.029570+0000","last_clean":"2023-10-10T22:18:24.029570+0000","last_became_active":"2023-10-10T22:18:24.016118+0000","last_became_peered":"2023-10-10T22:18:24.016118+0000","last_unstale":"2023-10-10T22:18:24.029570+0000","last_undegraded":"2023-10-10T22:18:24.029570+0000","last_fullsized":"2023-10-10T22:18:24.029570+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:29.994955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035344+0000","last_change":"2023-10-10T22:18:23.006424+0000","last_active":"2023-10-10T22:18:24.035344+0000","last_peered":"2023-10-10T22:18:24.035344+0000","last_clean":"2023-10-10T22:18:24.035344+0000","last_became_active":"2023-10-10T22:18:23.006146+0000","last_became_peered":"2023-10-10T22:18:23.006146+0000","last_unstale":"2023-10-10T22:18:24.035344+0000","last_undegraded":"2023-10-10T22:18:24.035344+0000","last_fullsized":"2023-10-10T22:18:24.035344+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:39.951998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021913+0000","last_change":"2023-10-10T22:18:24.020427+0000","last_active":"2023-10-10T22:18:24.021913+0000","last_peered":"2023-10-10T22:18:24.021913+0000","last_clean":"2023-10-10T22:18:24.021913+0000","last_became_active":"2023-10-10T22:18:24.020140+0000","last_became_peered":"2023-10-10T22:18:24.020140+0000","last_unstale":"2023-10-10T22:18:24.021913+0000","last_undegraded":"2023-10-10T22:18:24.021913+0000","last_fullsized":"2023-10-10T22:18:24.021913+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:14.720634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037464+0000","last_change":"2023-10-10T22:18:23.004658+0000","last_active":"2023-10-10T22:18:24.037464+0000","last_peered":"2023-10-10T22:18:24.037464+0000","last_clean":"2023-10-10T22:18:24.037464+0000","last_became_active":"2023-10-10T22:18:23.004213+0000","last_became_peered":"2023-10-10T22:18:23.004213+0000","last_unstale":"2023-10-10T22:18:24.037464+0000","last_undegraded":"2023-10-10T22:18:24.037464+0000","last_fullsized":"2023-10-10T22:18:24.037464+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:57:58.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037677+0000","last_change":"2023-10-10T22:18:24.035969+0000","last_active":"2023-10-10T22:18:24.037677+0000","last_peered":"2023-10-10T22:18:24.037677+0000","last_clean":"2023-10-10T22:18:24.037677+0000","last_became_active":"2023-10-10T22:18:24.035321+0000","last_became_peered":"2023-10-10T22:18:24.035321+0000","last_unstale":"2023-10-10T22:18:24.037677+0000","last_undegraded":"2023-10-10T22:18:24.037677+0000","last_fullsized":"2023-10-10T22:18:24.037677+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:54:38.889979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037018+0000","last_change":"2023-10-10T22:18:23.003193+0000","last_active":"2023-10-10T22:18:24.037018+0000","last_peered":"2023-10-10T22:18:24.037018+0000","last_clean":"2023-10-10T22:18:24.037018+0000","last_became_active":"2023-10-10T22:18:23.002834+0000","last_became_peered":"2023-10-10T22:18:23.002834+0000","last_unstale":"2023-10-10T22:18:24.037018+0000","last_undegraded":"2023-10-10T22:18:24.037018+0000","last_fullsized":"2023-10-10T22:18:24.037018+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:20:34.483848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035793+0000","last_change":"2023-10-10T22:18:24.031358+0000","last_active":"2023-10-10T22:18:24.035793+0000","last_peered":"2023-10-10T22:18:24.035793+0000","last_clean":"2023-10-10T22:18:24.035793+0000","last_became_active":"2023-10-10T22:18:24.031085+0000","last_became_peered":"2023-10-10T22:18:24.031085+0000","last_unstale":"2023-10-10T22:18:24.035793+0000","last_undegraded":"2023-10-10T22:18:24.035793+0000","last_fullsized":"2023-10-10T22:18:24.035793+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:51:17.136910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.032677+0000","last_change":"2023-10-10T22:18:23.002658+0000","last_active":"2023-10-10T22:18:24.032677+0000","last_peered":"2023-10-10T22:18:24.032677+0000","last_clean":"2023-10-10T22:18:24.032677+0000","last_became_active":"2023-10-10T22:18:23.002380+0000","last_became_peered":"2023-10-10T22:18:23.002380+0000","last_unstale":"2023-10-10T22:18:24.032677+0000","last_undegraded":"2023-10-10T22:18:24.032677+0000","last_fullsized":"2023-10-10T22:18:24.032677+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:32:25.630358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.025933+0000","last_change":"2023-10-10T22:18:24.020288+0000","last_active":"2023-10-10T22:18:24.025933+0000","last_peered":"2023-10-10T22:18:24.025933+0000","last_clean":"2023-10-10T22:18:24.025933+0000","last_became_active":"2023-10-10T22:18:24.020017+0000","last_became_peered":"2023-10-10T22:18:24.020017+0000","last_unstale":"2023-10-10T22:18:24.025933+0000","last_undegraded":"2023-10-10T22:18:24.025933+0000","last_fullsized":"2023-10-10T22:18:24.025933+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:20:54.390729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.036931+0000","last_change":"2023-10-10T22:18:23.009218+0000","last_active":"2023-10-10T22:18:24.036931+0000","last_peered":"2023-10-10T22:18:24.036931+0000","last_clean":"2023-10-10T22:18:24.036931+0000","last_became_active":"2023-10-10T22:18:23.008516+0000","last_became_peered":"2023-10-10T22:18:23.008516+0000","last_unstale":"2023-10-10T22:18:24.036931+0000","last_undegraded":"2023-10-10T22:18:24.036931+0000","last_fullsized":"2023-10-10T22:18:24.036931+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:33.216584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029515+0000","last_change":"2023-10-10T22:18:24.015761+0000","last_active":"2023-10-10T22:18:24.029515+0000","last_peered":"2023-10-10T22:18:24.029515+0000","last_clean":"2023-10-10T22:18:24.029515+0000","last_became_active":"2023-10-10T22:18:24.015075+0000","last_became_peered":"2023-10-10T22:18:24.015075+0000","last_unstale":"2023-10-10T22:18:24.029515+0000","last_undegraded":"2023-10-10T22:18:24.029515+0000","last_fullsized":"2023-10-10T22:18:24.029515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:55.727284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007704+0000","last_change":"2023-10-10T22:18:23.001824+0000","last_active":"2023-10-10T22:18:24.007704+0000","last_peered":"2023-10-10T22:18:24.007704+0000","last_clean":"2023-10-10T22:18:24.007704+0000","last_became_active":"2023-10-10T22:18:23.001560+0000","last_became_peered":"2023-10-10T22:18:23.001560+0000","last_unstale":"2023-10-10T22:18:24.007704+0000","last_undegraded":"2023-10-10T22:18:24.007704+0000","last_fullsized":"2023-10-10T22:18:24.007704+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:46:45.905808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.014307+0000","last_change":"2023-10-10T22:18:24.012668+0000","last_active":"2023-10-10T22:18:24.014307+0000","last_peered":"2023-10-10T22:18:24.014307+0000","last_clean":"2023-10-10T22:18:24.014307+0000","last_became_active":"2023-10-10T22:18:24.012393+0000","last_became_peered":"2023-10-10T22:18:24.012393+0000","last_unstale":"2023-10-10T22:18:24.014307+0000","last_undegraded":"2023-10-10T22:18:24.014307+0000","last_fullsized":"2023-10-10T22:18:24.014307+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:54.985351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007984+0000","last_change":"2023-10-10T22:18:23.005180+0000","last_active":"2023-10-10T22:18:24.007984+0000","last_peered":"2023-10-10T22:18:24.007984+0000","last_clean":"2023-10-10T22:18:24.007984+0000","last_became_active":"2023-10-10T22:18:23.004563+0000","last_became_peered":"2023-10-10T22:18:23.004563+0000","last_unstale":"2023-10-10T22:18:24.007984+0000","last_undegraded":"2023-10-10T22:18:24.007984+0000","last_fullsized":"2023-10-10T22:18:24.007984+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:18:54.181470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.018979+0000","last_change":"2023-10-10T22:18:24.015510+0000","last_active":"2023-10-10T22:18:24.018979+0000","last_peered":"2023-10-10T22:18:24.018979+0000","last_clean":"2023-10-10T22:18:24.018979+0000","last_became_active":"2023-10-10T22:18:24.014861+0000","last_became_peered":"2023-10-10T22:18:24.014861+0000","last_unstale":"2023-10-10T22:18:24.018979+0000","last_undegraded":"2023-10-10T22:18:24.018979+0000","last_fullsized":"2023-10-10T22:18:24.018979+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:07:12.027703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006101+0000","last_change":"2023-10-10T22:18:22.997265+0000","last_active":"2023-10-10T22:18:24.006101+0000","last_peered":"2023-10-10T22:18:24.006101+0000","last_clean":"2023-10-10T22:18:24.006101+0000","last_became_active":"2023-10-10T22:18:22.996999+0000","last_became_peered":"2023-10-10T22:18:22.996999+0000","last_unstale":"2023-10-10T22:18:24.006101+0000","last_undegraded":"2023-10-10T22:18:24.006101+0000","last_fullsized":"2023-10-10T22:18:24.006101+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:50:58.664586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035554+0000","last_change":"2023-10-10T22:18:24.029475+0000","last_active":"2023-10-10T22:18:24.035554+0000","last_peered":"2023-10-10T22:18:24.035554+0000","last_clean":"2023-10-10T22:18:24.035554+0000","last_became_active":"2023-10-10T22:18:24.028901+0000","last_became_peered":"2023-10-10T22:18:24.028901+0000","last_unstale":"2023-10-10T22:18:24.035554+0000","last_undegraded":"2023-10-10T22:18:24.035554+0000","last_fullsized":"2023-10-10T22:18:24.035554+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:40:10.841002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.020021+0000","last_change":"2023-10-10T22:18:23.012833+0000","last_active":"2023-10-10T22:18:24.020021+0000","last_peered":"2023-10-10T22:18:24.020021+0000","last_clean":"2023-10-10T22:18:24.020021+0000","last_became_active":"2023-10-10T22:18:23.012570+0000","last_became_peered":"2023-10-10T22:18:23.012570+0000","last_unstale":"2023-10-10T22:18:24.020021+0000","last_undegraded":"2023-10-10T22:18:24.020021+0000","last_fullsized":"2023-10-10T22:18:24.020021+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:32:15.660909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.024233+0000","last_change":"2023-10-10T22:18:24.019853+0000","last_active":"2023-10-10T22:18:24.024233+0000","last_peered":"2023-10-10T22:18:24.024233+0000","last_clean":"2023-10-10T22:18:24.024233+0000","last_became_active":"2023-10-10T22:18:24.019581+0000","last_became_peered":"2023-10-10T22:18:24.019581+0000","last_unstale":"2023-10-10T22:18:24.024233+0000","last_undegraded":"2023-10-10T22:18:24.024233+0000","last_fullsized":"2023-10-10T22:18:24.024233+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:12:03.286676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"174'6","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038970+0000","last_change":"2023-10-10T22:18:23.008997+0000","last_active":"2023-10-10T22:18:24.038970+0000","last_peered":"2023-10-10T22:18:24.038970+0000","last_clean":"2023-10-10T22:18:24.038970+0000","last_became_active":"2023-10-10T22:18:23.008717+0000","last_became_peered":"2023-10-10T22:18:23.008717+0000","last_unstale":"2023-10-10T22:18:24.038970+0000","last_undegraded":"2023-10-10T22:18:24.038970+0000","last_fullsized":"2023-10-10T22:18:24.038970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:19.281968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031979+0000","last_change":"2023-10-10T22:18:24.025224+0000","last_active":"2023-10-10T22:18:24.031979+0000","last_peered":"2023-10-10T22:18:24.031979+0000","last_clean":"2023-10-10T22:18:24.031979+0000","last_became_active":"2023-10-10T22:18:24.024936+0000","last_became_peered":"2023-10-10T22:18:24.024936+0000","last_unstale":"2023-10-10T22:18:24.031979+0000","last_undegraded":"2023-10-10T22:18:24.031979+0000","last_fullsized":"2023-10-10T22:18:24.031979+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:42.765707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038217+0000","last_change":"2023-10-10T22:18:23.004357+0000","last_active":"2023-10-10T22:18:24.038217+0000","last_peered":"2023-10-10T22:18:24.038217+0000","last_clean":"2023-10-10T22:18:24.038217+0000","last_became_active":"2023-10-10T22:18:23.004099+0000","last_became_peered":"2023-10-10T22:18:23.004099+0000","last_unstale":"2023-10-10T22:18:24.038217+0000","last_undegraded":"2023-10-10T22:18:24.038217+0000","last_fullsized":"2023-10-10T22:18:24.038217+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:42:05.456605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.029217+0000","last_change":"2023-10-10T22:18:24.012250+0000","last_active":"2023-10-10T22:18:24.029217+0000","last_peered":"2023-10-10T22:18:24.029217+0000","last_clean":"2023-10-10T22:18:24.029217+0000","last_became_active":"2023-10-10T22:18:24.011986+0000","last_became_peered":"2023-10-10T22:18:24.011986+0000","last_unstale":"2023-10-10T22:18:24.029217+0000","last_undegraded":"2023-10-10T22:18:24.029217+0000","last_fullsized":"2023-10-10T22:18:24.029217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:55:27.651167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015821+0000","last_change":"2023-10-10T22:18:23.002464+0000","last_active":"2023-10-10T22:18:24.015821+0000","last_peered":"2023-10-10T22:18:24.015821+0000","last_clean":"2023-10-10T22:18:24.015821+0000","last_became_active":"2023-10-10T22:18:23.002089+0000","last_became_peered":"2023-10-10T22:18:23.002089+0000","last_unstale":"2023-10-10T22:18:24.015821+0000","last_undegraded":"2023-10-10T22:18:24.015821+0000","last_fullsized":"2023-10-10T22:18:24.015821+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:24.173465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.028591+0000","last_change":"2023-10-10T22:18:24.024615+0000","last_active":"2023-10-10T22:18:24.028591+0000","last_peered":"2023-10-10T22:18:24.028591+0000","last_clean":"2023-10-10T22:18:24.028591+0000","last_became_active":"2023-10-10T22:18:24.024341+0000","last_became_peered":"2023-10-10T22:18:24.024341+0000","last_unstale":"2023-10-10T22:18:24.028591+0000","last_undegraded":"2023-10-10T22:18:24.028591+0000","last_fullsized":"2023-10-10T22:18:24.028591+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:03:10.796352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007796+0000","last_change":"2023-10-10T22:18:23.002556+0000","last_active":"2023-10-10T22:18:24.007796+0000","last_peered":"2023-10-10T22:18:24.007796+0000","last_clean":"2023-10-10T22:18:24.007796+0000","last_became_active":"2023-10-10T22:18:23.002306+0000","last_became_peered":"2023-10-10T22:18:23.002306+0000","last_unstale":"2023-10-10T22:18:24.007796+0000","last_undegraded":"2023-10-10T22:18:24.007796+0000","last_fullsized":"2023-10-10T22:18:24.007796+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:49.082978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.025943+0000","last_change":"2023-10-10T22:18:24.020082+0000","last_active":"2023-10-10T22:18:24.025943+0000","last_peered":"2023-10-10T22:18:24.025943+0000","last_clean":"2023-10-10T22:18:24.025943+0000","last_became_active":"2023-10-10T22:18:24.019783+0000","last_became_peered":"2023-10-10T22:18:24.019783+0000","last_unstale":"2023-10-10T22:18:24.025943+0000","last_undegraded":"2023-10-10T22:18:24.025943+0000","last_fullsized":"2023-10-10T22:18:24.025943+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:04:39.002108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"174'8","reported_seq":18,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038874+0000","last_change":"2023-10-10T22:18:23.006747+0000","last_active":"2023-10-10T22:18:24.038874+0000","last_peered":"2023-10-10T22:18:24.038874+0000","last_clean":"2023-10-10T22:18:24.038874+0000","last_became_active":"2023-10-10T22:18:23.006494+0000","last_became_peered":"2023-10-10T22:18:23.006494+0000","last_unstale":"2023-10-10T22:18:24.038874+0000","last_undegraded":"2023-10-10T22:18:24.038874+0000","last_fullsized":"2023-10-10T22:18:24.038874+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:08:34.934750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035132+0000","last_change":"2023-10-10T22:18:24.030518+0000","last_active":"2023-10-10T22:18:24.035132+0000","last_peered":"2023-10-10T22:18:24.035132+0000","last_clean":"2023-10-10T22:18:24.035132+0000","last_became_active":"2023-10-10T22:18:24.030251+0000","last_became_peered":"2023-10-10T22:18:24.030251+0000","last_unstale":"2023-10-10T22:18:24.035132+0000","last_undegraded":"2023-10-10T22:18:24.035132+0000","last_fullsized":"2023-10-10T22:18:24.035132+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:52:53.593440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038130+0000","last_change":"2023-10-10T22:18:23.004396+0000","last_active":"2023-10-10T22:18:24.038130+0000","last_peered":"2023-10-10T22:18:24.038130+0000","last_clean":"2023-10-10T22:18:24.038130+0000","last_became_active":"2023-10-10T22:18:23.004119+0000","last_became_peered":"2023-10-10T22:18:23.004119+0000","last_unstale":"2023-10-10T22:18:24.038130+0000","last_undegraded":"2023-10-10T22:18:24.038130+0000","last_fullsized":"2023-10-10T22:18:24.038130+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:43:26.287613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021439+0000","last_change":"2023-10-10T22:18:24.017656+0000","last_active":"2023-10-10T22:18:24.021439+0000","last_peered":"2023-10-10T22:18:24.021439+0000","last_clean":"2023-10-10T22:18:24.021439+0000","last_became_active":"2023-10-10T22:18:24.017387+0000","last_became_peered":"2023-10-10T22:18:24.017387+0000","last_unstale":"2023-10-10T22:18:24.021439+0000","last_undegraded":"2023-10-10T22:18:24.021439+0000","last_fullsized":"2023-10-10T22:18:24.021439+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:08:59.566825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.037976+0000","last_change":"2023-10-10T22:18:22.999052+0000","last_active":"2023-10-10T22:18:24.037976+0000","last_peered":"2023-10-10T22:18:24.037976+0000","last_clean":"2023-10-10T22:18:24.037976+0000","last_became_active":"2023-10-10T22:18:22.998752+0000","last_became_peered":"2023-10-10T22:18:22.998752+0000","last_unstale":"2023-10-10T22:18:24.037976+0000","last_undegraded":"2023-10-10T22:18:24.037976+0000","last_fullsized":"2023-10-10T22:18:24.037976+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:09:57.607286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031508+0000","last_change":"2023-10-10T22:18:24.024961+0000","last_active":"2023-10-10T22:18:24.031508+0000","last_peered":"2023-10-10T22:18:24.031508+0000","last_clean":"2023-10-10T22:18:24.031508+0000","last_became_active":"2023-10-10T22:18:24.024683+0000","last_became_peered":"2023-10-10T22:18:24.024683+0000","last_unstale":"2023-10-10T22:18:24.031508+0000","last_undegraded":"2023-10-10T22:18:24.031508+0000","last_fullsized":"2023-10-10T22:18:24.031508+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:54.985351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035634+0000","last_change":"2023-10-10T22:18:23.005971+0000","last_active":"2023-10-10T22:18:24.035634+0000","last_peered":"2023-10-10T22:18:24.035634+0000","last_clean":"2023-10-10T22:18:24.035634+0000","last_became_active":"2023-10-10T22:18:23.005716+0000","last_became_peered":"2023-10-10T22:18:23.005716+0000","last_unstale":"2023-10-10T22:18:24.035634+0000","last_undegraded":"2023-10-10T22:18:24.035634+0000","last_fullsized":"2023-10-10T22:18:24.035634+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:26:15.912615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030462+0000","last_change":"2023-10-10T22:18:24.027463+0000","last_active":"2023-10-10T22:18:24.030462+0000","last_peered":"2023-10-10T22:18:24.030462+0000","last_clean":"2023-10-10T22:18:24.030462+0000","last_became_active":"2023-10-10T22:18:24.026739+0000","last_became_peered":"2023-10-10T22:18:24.026739+0000","last_unstale":"2023-10-10T22:18:24.030462+0000","last_undegraded":"2023-10-10T22:18:24.030462+0000","last_fullsized":"2023-10-10T22:18:24.030462+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:49.709794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.006316+0000","last_change":"2023-10-10T22:18:22.997547+0000","last_active":"2023-10-10T22:18:24.006316+0000","last_peered":"2023-10-10T22:18:24.006316+0000","last_clean":"2023-10-10T22:18:24.006316+0000","last_became_active":"2023-10-10T22:18:22.997230+0000","last_became_peered":"2023-10-10T22:18:22.997230+0000","last_unstale":"2023-10-10T22:18:24.006316+0000","last_undegraded":"2023-10-10T22:18:24.006316+0000","last_fullsized":"2023-10-10T22:18:24.006316+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:04.255819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.019406+0000","last_change":"2023-10-10T22:18:24.013058+0000","last_active":"2023-10-10T22:18:24.019406+0000","last_peered":"2023-10-10T22:18:24.019406+0000","last_clean":"2023-10-10T22:18:24.019406+0000","last_became_active":"2023-10-10T22:18:24.012778+0000","last_became_peered":"2023-10-10T22:18:24.012778+0000","last_unstale":"2023-10-10T22:18:24.019406+0000","last_undegraded":"2023-10-10T22:18:24.019406+0000","last_fullsized":"2023-10-10T22:18:24.019406+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:17:11.645193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.036668+0000","last_change":"2023-10-10T22:18:23.007021+0000","last_active":"2023-10-10T22:18:24.036668+0000","last_peered":"2023-10-10T22:18:24.036668+0000","last_clean":"2023-10-10T22:18:24.036668+0000","last_became_active":"2023-10-10T22:18:23.006762+0000","last_became_peered":"2023-10-10T22:18:23.006762+0000","last_unstale":"2023-10-10T22:18:24.036668+0000","last_undegraded":"2023-10-10T22:18:24.036668+0000","last_fullsized":"2023-10-10T22:18:24.036668+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:50:53.980487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015732+0000","last_change":"2023-10-10T22:18:24.013096+0000","last_active":"2023-10-10T22:18:24.015732+0000","last_peered":"2023-10-10T22:18:24.015732+0000","last_clean":"2023-10-10T22:18:24.015732+0000","last_became_active":"2023-10-10T22:18:24.012822+0000","last_became_peered":"2023-10-10T22:18:24.012822+0000","last_unstale":"2023-10-10T22:18:24.015732+0000","last_undegraded":"2023-10-10T22:18:24.015732+0000","last_fullsized":"2023-10-10T22:18:24.015732+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:03.558293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.019811+0000","last_change":"2023-10-10T22:18:23.007715+0000","last_active":"2023-10-10T22:18:24.019811+0000","last_peered":"2023-10-10T22:18:24.019811+0000","last_clean":"2023-10-10T22:18:24.019811+0000","last_became_active":"2023-10-10T22:18:23.007444+0000","last_became_peered":"2023-10-10T22:18:23.007444+0000","last_unstale":"2023-10-10T22:18:24.019811+0000","last_undegraded":"2023-10-10T22:18:24.019811+0000","last_fullsized":"2023-10-10T22:18:24.019811+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:32:02.553429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.023097+0000","last_change":"2023-10-10T22:18:24.019506+0000","last_active":"2023-10-10T22:18:24.023097+0000","last_peered":"2023-10-10T22:18:24.023097+0000","last_clean":"2023-10-10T22:18:24.023097+0000","last_became_active":"2023-10-10T22:18:24.019038+0000","last_became_peered":"2023-10-10T22:18:24.019038+0000","last_unstale":"2023-10-10T22:18:24.023097+0000","last_undegraded":"2023-10-10T22:18:24.023097+0000","last_fullsized":"2023-10-10T22:18:24.023097+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:42.765707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015794+0000","last_change":"2023-10-10T22:18:23.009956+0000","last_active":"2023-10-10T22:18:24.015794+0000","last_peered":"2023-10-10T22:18:24.015794+0000","last_clean":"2023-10-10T22:18:24.015794+0000","last_became_active":"2023-10-10T22:18:23.009689+0000","last_became_peered":"2023-10-10T22:18:23.009689+0000","last_unstale":"2023-10-10T22:18:24.015794+0000","last_undegraded":"2023-10-10T22:18:24.015794+0000","last_fullsized":"2023-10-10T22:18:24.015794+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:55:04.540620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021064+0000","last_change":"2023-10-10T22:18:24.013716+0000","last_active":"2023-10-10T22:18:24.021064+0000","last_peered":"2023-10-10T22:18:24.021064+0000","last_clean":"2023-10-10T22:18:24.021064+0000","last_became_active":"2023-10-10T22:18:24.013464+0000","last_became_peered":"2023-10-10T22:18:24.013464+0000","last_unstale":"2023-10-10T22:18:24.021064+0000","last_undegraded":"2023-10-10T22:18:24.021064+0000","last_fullsized":"2023-10-10T22:18:24.021064+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:58:24.854295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015240+0000","last_change":"2023-10-10T22:18:23.000295+0000","last_active":"2023-10-10T22:18:24.015240+0000","last_peered":"2023-10-10T22:18:24.015240+0000","last_clean":"2023-10-10T22:18:24.015240+0000","last_became_active":"2023-10-10T22:18:23.000023+0000","last_became_peered":"2023-10-10T22:18:23.000023+0000","last_unstale":"2023-10-10T22:18:24.015240+0000","last_undegraded":"2023-10-10T22:18:24.015240+0000","last_fullsized":"2023-10-10T22:18:24.015240+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:43:26.287613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.018999+0000","last_change":"2023-10-10T22:18:24.015676+0000","last_active":"2023-10-10T22:18:24.018999+0000","last_peered":"2023-10-10T22:18:24.018999+0000","last_clean":"2023-10-10T22:18:24.018999+0000","last_became_active":"2023-10-10T22:18:24.015226+0000","last_became_peered":"2023-10-10T22:18:24.015226+0000","last_unstale":"2023-10-10T22:18:24.018999+0000","last_undegraded":"2023-10-10T22:18:24.018999+0000","last_fullsized":"2023-10-10T22:18:24.018999+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:31:05.732160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.039581+0000","last_change":"2023-10-10T22:18:23.010858+0000","last_active":"2023-10-10T22:18:24.039581+0000","last_peered":"2023-10-10T22:18:24.039581+0000","last_clean":"2023-10-10T22:18:24.039581+0000","last_became_active":"2023-10-10T22:18:23.010570+0000","last_became_peered":"2023-10-10T22:18:23.010570+0000","last_unstale":"2023-10-10T22:18:24.039581+0000","last_undegraded":"2023-10-10T22:18:24.039581+0000","last_fullsized":"2023-10-10T22:18:24.039581+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:12:52.868686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031471+0000","last_change":"2023-10-10T22:18:24.021215+0000","last_active":"2023-10-10T22:18:24.031471+0000","last_peered":"2023-10-10T22:18:24.031471+0000","last_clean":"2023-10-10T22:18:24.031471+0000","last_became_active":"2023-10-10T22:18:24.020937+0000","last_became_peered":"2023-10-10T22:18:24.020937+0000","last_unstale":"2023-10-10T22:18:24.031471+0000","last_undegraded":"2023-10-10T22:18:24.031471+0000","last_fullsized":"2023-10-10T22:18:24.031471+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:17.312256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007390+0000","last_change":"2023-10-10T22:18:23.010529+0000","last_active":"2023-10-10T22:18:24.007390+0000","last_peered":"2023-10-10T22:18:24.007390+0000","last_clean":"2023-10-10T22:18:24.007390+0000","last_became_active":"2023-10-10T22:18:23.010238+0000","last_became_peered":"2023-10-10T22:18:23.010238+0000","last_unstale":"2023-10-10T22:18:24.007390+0000","last_undegraded":"2023-10-10T22:18:24.007390+0000","last_fullsized":"2023-10-10T22:18:24.007390+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:03:31.945185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.035831+0000","last_change":"2023-10-10T22:18:24.030198+0000","last_active":"2023-10-10T22:18:24.035831+0000","last_peered":"2023-10-10T22:18:24.035831+0000","last_clean":"2023-10-10T22:18:24.035831+0000","last_became_active":"2023-10-10T22:18:24.029858+0000","last_became_peered":"2023-10-10T22:18:24.029858+0000","last_unstale":"2023-10-10T22:18:24.035831+0000","last_undegraded":"2023-10-10T22:18:24.035831+0000","last_fullsized":"2023-10-10T22:18:24.035831+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:30:38.352705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.007039+0000","last_change":"2023-10-10T22:18:23.005193+0000","last_active":"2023-10-10T22:18:24.007039+0000","last_peered":"2023-10-10T22:18:24.007039+0000","last_clean":"2023-10-10T22:18:24.007039+0000","last_became_active":"2023-10-10T22:18:23.004949+0000","last_became_peered":"2023-10-10T22:18:23.004949+0000","last_unstale":"2023-10-10T22:18:24.007039+0000","last_undegraded":"2023-10-10T22:18:24.007039+0000","last_fullsized":"2023-10-10T22:18:24.007039+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:15.477452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021561+0000","last_change":"2023-10-10T22:18:24.020567+0000","last_active":"2023-10-10T22:18:24.021561+0000","last_peered":"2023-10-10T22:18:24.021561+0000","last_clean":"2023-10-10T22:18:24.021561+0000","last_became_active":"2023-10-10T22:18:24.020253+0000","last_became_peered":"2023-10-10T22:18:24.020253+0000","last_unstale":"2023-10-10T22:18:24.021561+0000","last_undegraded":"2023-10-10T22:18:24.021561+0000","last_fullsized":"2023-10-10T22:18:24.021561+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:41.929204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005299+0000","last_change":"2023-10-10T22:18:23.001514+0000","last_active":"2023-10-10T22:18:24.005299+0000","last_peered":"2023-10-10T22:18:24.005299+0000","last_clean":"2023-10-10T22:18:24.005299+0000","last_became_active":"2023-10-10T22:18:23.001080+0000","last_became_peered":"2023-10-10T22:18:23.001080+0000","last_unstale":"2023-10-10T22:18:24.005299+0000","last_undegraded":"2023-10-10T22:18:24.005299+0000","last_fullsized":"2023-10-10T22:18:24.005299+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:02:46.155762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.024006+0000","last_change":"2023-10-10T22:18:24.021309+0000","last_active":"2023-10-10T22:18:24.024006+0000","last_peered":"2023-10-10T22:18:24.024006+0000","last_clean":"2023-10-10T22:18:24.024006+0000","last_became_active":"2023-10-10T22:18:24.021063+0000","last_became_peered":"2023-10-10T22:18:24.021063+0000","last_unstale":"2023-10-10T22:18:24.024006+0000","last_undegraded":"2023-10-10T22:18:24.024006+0000","last_fullsized":"2023-10-10T22:18:24.024006+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:05:53.554877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.002043+0000","last_change":"2023-10-10T22:18:23.008013+0000","last_active":"2023-10-10T22:18:24.002043+0000","last_peered":"2023-10-10T22:18:24.002043+0000","last_clean":"2023-10-10T22:18:24.002043+0000","last_became_active":"2023-10-10T22:18:23.007704+0000","last_became_peered":"2023-10-10T22:18:23.007704+0000","last_unstale":"2023-10-10T22:18:24.002043+0000","last_undegraded":"2023-10-10T22:18:24.002043+0000","last_fullsized":"2023-10-10T22:18:24.002043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:55:32.131373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.031735+0000","last_change":"2023-10-10T22:18:24.026860+0000","last_active":"2023-10-10T22:18:24.031735+0000","last_peered":"2023-10-10T22:18:24.031735+0000","last_clean":"2023-10-10T22:18:24.031735+0000","last_became_active":"2023-10-10T22:18:24.026588+0000","last_became_peered":"2023-10-10T22:18:24.026588+0000","last_unstale":"2023-10-10T22:18:24.031735+0000","last_undegraded":"2023-10-10T22:18:24.031735+0000","last_fullsized":"2023-10-10T22:18:24.031735+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:49:20.286832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.018970+0000","last_change":"2023-10-10T22:18:23.010859+0000","last_active":"2023-10-10T22:18:24.018970+0000","last_peered":"2023-10-10T22:18:24.018970+0000","last_clean":"2023-10-10T22:18:24.018970+0000","last_became_active":"2023-10-10T22:18:23.010594+0000","last_became_peered":"2023-10-10T22:18:23.010594+0000","last_unstale":"2023-10-10T22:18:24.018970+0000","last_undegraded":"2023-10-10T22:18:24.018970+0000","last_fullsized":"2023-10-10T22:18:24.018970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:15:05.377655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.030251+0000","last_change":"2023-10-10T22:18:24.023510+0000","last_active":"2023-10-10T22:18:24.030251+0000","last_peered":"2023-10-10T22:18:24.030251+0000","last_clean":"2023-10-10T22:18:24.030251+0000","last_became_active":"2023-10-10T22:18:24.023244+0000","last_became_peered":"2023-10-10T22:18:24.023244+0000","last_unstale":"2023-10-10T22:18:24.030251+0000","last_undegraded":"2023-10-10T22:18:24.030251+0000","last_fullsized":"2023-10-10T22:18:24.030251+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:05:49.841998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.015379+0000","last_change":"2023-10-10T22:18:23.005033+0000","last_active":"2023-10-10T22:18:24.015379+0000","last_peered":"2023-10-10T22:18:24.015379+0000","last_clean":"2023-10-10T22:18:24.015379+0000","last_became_active":"2023-10-10T22:18:23.004786+0000","last_became_peered":"2023-10-10T22:18:23.004786+0000","last_unstale":"2023-10-10T22:18:24.015379+0000","last_undegraded":"2023-10-10T22:18:24.015379+0000","last_fullsized":"2023-10-10T22:18:24.015379+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:16:33.216584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.016266+0000","last_change":"2023-10-10T22:18:24.014439+0000","last_active":"2023-10-10T22:18:24.016266+0000","last_peered":"2023-10-10T22:18:24.016266+0000","last_clean":"2023-10-10T22:18:24.016266+0000","last_became_active":"2023-10-10T22:18:24.014105+0000","last_became_peered":"2023-10-10T22:18:24.014105+0000","last_unstale":"2023-10-10T22:18:24.016266+0000","last_undegraded":"2023-10-10T22:18:24.016266+0000","last_fullsized":"2023-10-10T22:18:24.016266+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:22:42.765707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.005479+0000","last_change":"2023-10-10T22:18:23.006900+0000","last_active":"2023-10-10T22:18:24.005479+0000","last_peered":"2023-10-10T22:18:24.005479+0000","last_clean":"2023-10-10T22:18:24.005479+0000","last_became_active":"2023-10-10T22:18:23.006595+0000","last_became_peered":"2023-10-10T22:18:23.006595+0000","last_unstale":"2023-10-10T22:18:24.005479+0000","last_undegraded":"2023-10-10T22:18:24.005479+0000","last_fullsized":"2023-10-10T22:18:24.005479+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:46:37.566532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.021933+0000","last_change":"2023-10-10T22:18:24.015171+0000","last_active":"2023-10-10T22:18:24.021933+0000","last_peered":"2023-10-10T22:18:24.021933+0000","last_clean":"2023-10-10T22:18:24.021933+0000","last_became_active":"2023-10-10T22:18:24.014398+0000","last_became_peered":"2023-10-10T22:18:24.014398+0000","last_unstale":"2023-10-10T22:18:24.021933+0000","last_undegraded":"2023-10-10T22:18:24.021933+0000","last_fullsized":"2023-10-10T22:18:24.021933+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:22.979742+0000","last_clean_scrub_stamp":"2023-10-10T22:18:22.979742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:13:30.183999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"174'3","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.038723+0000","last_change":"2023-10-10T22:18:23.001099+0000","last_active":"2023-10-10T22:18:24.038723+0000","last_peered":"2023-10-10T22:18:24.038723+0000","last_clean":"2023-10-10T22:18:24.038723+0000","last_became_active":"2023-10-10T22:18:23.000827+0000","last_became_peered":"2023-10-10T22:18:23.000827+0000","last_unstale":"2023-10-10T22:18:24.038723+0000","last_undegraded":"2023-10-10T22:18:24.038723+0000","last_fullsized":"2023-10-10T22:18:24.038723+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:18:21.974879+0000","last_clean_scrub_stamp":"2023-10-10T22:18:21.974879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:16:16.967758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"164'293","reported_seq":922,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-10T22:18:24.016534+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:18:24.016534+0000","last_peered":"2023-10-10T22:18:24.016534+0000","last_clean":"2023-10-10T22:18:24.016534+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:18:24.016534+0000","last_undegraded":"2023-10-10T22:18:24.016534+0000","last_fullsized":"2023-10-10T22:18:24.016534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543051,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308196,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063644,"statfs":{"total":96636764160,"available":96321171456,"internally_reserved":0,"allocated":2781184,"data_stored":1675943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96999999999999997,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73599999999999999,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.77600000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.98699999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52300000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88500000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.871},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.47399999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.75900000000000001,"15min":0.754},"min":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.95699999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.94899999999999995},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85899999999999999,"5min":0.94699999999999995,"15min":0.95799999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.442},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.62}]},{"osd":6,"last update":"Tue Oct 10 22:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0289999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66900000000000004}]}]},{"osd":6,"up_from":14,"seq":60129543050,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311716,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060124,"statfs":{"total":96636764160,"available":96317566976,"internally_reserved":0,"allocated":2191360,"data_stored":1085097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":1.0029999999999999,"15min":1.048},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.314},"max":{"1min":0.91600000000000004,"5min":0.995,"15min":0.995},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.38800000000000001},"max":{"1min":0.98299999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.55700000000000005},"max":{"1min":0.94899999999999995,"5min":1.046,"15min":1.046},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.63},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91100000000000003,"15min":1.0760000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":0.96199999999999997,"15min":0.98999999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.94599999999999995,"15min":1.0249999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.48899999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91500000000000004,"5min":0.93200000000000005,"15min":0.97099999999999997},"last":0.755},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.0029999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.99099999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.079},"last":0.69199999999999995}]}]},{"osd":1,"up_from":14,"seq":60129543050,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307612,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064228,"statfs":{"total":96636764160,"available":96321769472,"internally_reserved":0,"allocated":2183168,"data_stored":1085505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29399999999999998},"max":{"1min":0.77400000000000002,"5min":0.83099999999999996,"15min":2.5550000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.1819999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.34699999999999998},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.86199999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.91900000000000004},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":1.3420000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":1.0600000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.266,"15min":1.651},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.2629999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.153,"5min":1.216,"15min":1.51},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.077,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.52300000000000002},"max":{"1min":1.169,"5min":1.236,"15min":1.4259999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.478},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.401},"last":0.622}]}]},{"osd":0,"up_from":14,"seq":60129543052,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304108,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067732,"statfs":{"total":96636764160,"available":96325357568,"internally_reserved":0,"allocated":2789376,"data_stored":1676889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":1.0900000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.81599999999999995,"15min":0.83299999999999996},"last":0.56000000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.36299999999999999},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":1.2789999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.95199999999999996},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74299999999999999,"5min":0.84099999999999997,"15min":0.98299999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.90800000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0369999999999999,"5min":1.343,"15min":1.343},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.03,"5min":1.218,"15min":1.3560000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0660000000000001,"5min":1.165,"15min":1.4099999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1479999999999999,"15min":1.4399999999999999},"last":0.84599999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.083,"5min":1.1399999999999999,"15min":1.4279999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.054,"5min":1.3180000000000001,"15min":1.4630000000000001},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.04,"5min":1.1060000000000001,"15min":1.278},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.61599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1000000000000001,"5min":1.25,"15min":1.51},"last":0.86099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543052,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311720,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060120,"statfs":{"total":96636764160,"available":96317562880,"internally_reserved":0,"allocated":2195456,"data_stored":1086557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32600000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55600000000000005,"15min":0.56999999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67200000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.498},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.65400000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.85299999999999998,"5min":1.355,"15min":1.355},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83699999999999997,"5min":1.248,"15min":1.248},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.871,"5min":1.1359999999999999,"15min":1.232},"last":0.77200000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.82799999999999996,"5min":1.278,"15min":1.278},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.78400000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.82499999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.91300000000000003,"5min":1.355,"15min":1.355},"last":0.82299999999999995}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311708,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060132,"statfs":{"total":96636764160,"available":96317575168,"internally_reserved":0,"allocated":2183168,"data_stored":1085041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.81999999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.66500000000000004,"5min":0.748,"15min":0.77900000000000003},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.875},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"max":{"1min":0.69099999999999995,"5min":0.78400000000000003,"15min":0.877},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.95099999999999996},"last":0.499}]},{"osd":4,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93799999999999994,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.624,"5min":0.55700000000000005,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56299999999999994,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0389999999999999,"5min":1.1779999999999999,"15min":1.3169999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.63600000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.079,"5min":1.218,"15min":1.218},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.63300000000000001,"5min":0.58099999999999996,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.177,"15min":1.177},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81299999999999994,"15min":0.82699999999999996},"min":{"1min":0.60799999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83999999999999997,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129543052,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311704,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060136,"statfs":{"total":96636764160,"available":96317579264,"internally_reserved":0,"allocated":2179072,"data_stored":1084951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.89400000000000002,"15min":0.96499999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71999999999999997,"15min":0.74199999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.53200000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72399999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.49399999999999999,"15min":0.48199999999999998},"max":{"1min":0.97199999999999998,"5min":1.002,"15min":1.1879999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.69599999999999995,"15min":0.71299999999999997},"min":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.135},"last":0.71899999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.46200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.98599999999999999,"5min":1.024,"15min":1.0289999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.51200000000000001,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.996},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":0.93200000000000005,"5min":0.98099999999999998,"15min":1.0109999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.46100000000000002},"max":{"1min":0.89600000000000002,"5min":1,"15min":1},"last":0.74099999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.40500000000000003,"5min":0.38200000000000001,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.879,"15min":0.97299999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64800000000000002,"15min":0.629},"min":{"1min":0.443,"5min":0.42599999999999999,"15min":0.40600000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.82599999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48299999999999998,"5min":0.42999999999999999,"15min":0.40200000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94799999999999995},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":1.052,"15min":1.052},"last":0.63600000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70799999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.46200000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.028},"last":0.69899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129543050,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311708,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060132,"statfs":{"total":96636764160,"available":96317575168,"internally_reserved":0,"allocated":2183168,"data_stored":1084973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.59899999999999998,"5min":0.46400000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.505}]},{"osd":1,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.008,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.752},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.438,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.73799999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":1.034,"5min":1.044,"15min":1.0840000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80700000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.0760000000000001,"15min":1.113},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":1.052,"5min":1.083,"15min":1.3540000000000001},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:18:33.711 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T22:18:33.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T22:18:33.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.933+0000 7f287bdff700 1 Processor -- start 2023-10-10T22:18:33.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.933+0000 7f287bdff700 1 -- start start 2023-10-10T22:18:33.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.934+0000 7f287bdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2874159950 0x7f28740cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.934+0000 7f287bdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740ce380 con 0x7f2874069c70 2023-10-10T22:18:33.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.934+0000 7f287bdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740cec20 con 0x7f28740af320 2023-10-10T22:18:33.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.934+0000 7f287bdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28740afa90 con 0x7f2874159950 2023-10-10T22:18:33.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.935+0000 7f287a39c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2874069c70 0x7f28740cf0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54116/0 (socket says 172.21.15.154:54116) 2023-10-10T22:18:33.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.935+0000 7f287a39c700 1 -- 172.21.15.154:0/2821710354 learned_addr learned my addr 172.21.15.154:0/2821710354 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:33.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.935+0000 7f2879b9b700 1 --2- 172.21.15.154:0/2821710354 >> v2:172.21.15.179:3300/0 conn(0x7f2874159950 0x7f28740cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:33.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.935+0000 7f2878b99700 1 -- 172.21.15.154:0/2821710354 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367641784 0 0) 0x7f28740ce380 con 0x7f2874069c70 2023-10-10T22:18:33.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.935+0000 7f2878b99700 1 -- 172.21.15.154:0/2821710354 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2860003570 con 0x7f2874069c70 2023-10-10T22:18:33.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.935+0000 7f2879b9b700 1 -- 172.21.15.154:0/2821710354 >> v1:172.21.15.179:6789/0 conn(0x7f28740af320 legacy=0x7f2874069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.935+0000 7f2878b99700 1 -- 172.21.15.154:0/2821710354 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128722675 0 0) 0x7f28740cec20 con 0x7f28740af320 2023-10-10T22:18:33.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.935+0000 7f2879b9b700 1 -- 172.21.15.154:0/2821710354 >> v1:172.21.15.154:6789/0 conn(0x7f2874069c70 legacy=0x7f28740cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.935+0000 7f2879b9b700 1 -- 172.21.15.154:0/2821710354 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28740ce5d0 con 0x7f2874159950 2023-10-10T22:18:33.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.936+0000 7f2879b9b700 1 --2- 172.21.15.154:0/2821710354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2874159950 0x7f28740cbb90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f28700098e0 tx=0x7f28700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1ac3c95dee69d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:33.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.936+0000 7f2878b99700 1 -- 172.21.15.154:0/2821710354 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0017f0 con 0x7f2874159950 2023-10-10T22:18:33.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.936+0000 7f2878b99700 1 -- 172.21.15.154:0/2821710354 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2870011420 con 0x7f2874159950 2023-10-10T22:18:33.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.936+0000 7f2878b99700 1 -- 172.21.15.154:0/2821710354 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28700117a0 con 0x7f2874159950 2023-10-10T22:18:33.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.936+0000 7f287bdff700 1 -- 172.21.15.154:0/2821710354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2874159950 msgr2=0x7f28740cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.936+0000 7f287bdff700 1 --2- 172.21.15.154:0/2821710354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2874159950 0x7f28740cbb90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f28700098e0 tx=0x7f28700091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.937+0000 7f287bdff700 1 -- 172.21.15.154:0/2821710354 shutdown_connections 2023-10-10T22:18:33.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.937+0000 7f287bdff700 1 --2- 172.21.15.154:0/2821710354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2874159950 0x7f28740cbb90 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.937+0000 7f287bdff700 1 -- 172.21.15.154:0/2821710354 >> 172.21.15.154:0/2821710354 conn(0x7f2874068e00 msgr2=0x7f28740d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:33.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.937+0000 7f287bdff700 1 -- 172.21.15.154:0/2821710354 shutdown_connections 2023-10-10T22:18:33.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.937+0000 7f287bdff700 1 -- 172.21.15.154:0/2821710354 wait complete. 2023-10-10T22:18:33.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.938+0000 7f287bdff700 1 Processor -- start 2023-10-10T22:18:33.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.938+0000 7f287bdff700 1 -- start start 2023-10-10T22:18:33.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.939+0000 7f287bdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874069c70 0x7f287416c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.939+0000 7f287bdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28740af320 0x7f2874159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.939+0000 7f287bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2874159950 0x7f2874169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.939+0000 7f287bdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740b21f0 con 0x7f2874069c70 2023-10-10T22:18:33.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.939+0000 7f287bdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740b24d0 con 0x7f28740af320 2023-10-10T22:18:33.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.939+0000 7f287bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28740b27b0 con 0x7f2874159950 2023-10-10T22:18:33.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.939+0000 7f2879b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874069c70 0x7f287416c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:33.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.939+0000 7f2879b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874069c70 0x7f287416c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40578/0 (socket says 172.21.15.154:40578) 2023-10-10T22:18:33.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.939+0000 7f2879b9b700 1 -- 172.21.15.154:0/231858223 learned_addr learned my addr 172.21.15.154:0/231858223 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:33.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f2879b9b700 1 -- 172.21.15.154:0/231858223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2874159950 msgr2=0x7f2874169d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f287939a700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28740af320 0x7f2874159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:33.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f2879b9b700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2874159950 0x7f2874169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f2879b9b700 1 -- 172.21.15.154:0/231858223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28740af320 msgr2=0x7f2874159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:33.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f2879b9b700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28740af320 0x7f2874159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:33.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f2879b9b700 1 -- 172.21.15.154:0/231858223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2870009420 con 0x7f2874069c70 2023-10-10T22:18:33.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f287939a700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28740af320 0x7f2874159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:33.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f2879b9b700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874069c70 0x7f287416c9d0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f28700091e0 tx=0x7f2870017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:33.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f2869ffb700 1 -- 172.21.15.154:0/231858223 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870010c20 con 0x7f2874069c70 2023-10-10T22:18:33.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f2869ffb700 1 -- 172.21.15.154:0/231858223 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2870010d80 con 0x7f2874069c70 2023-10-10T22:18:33.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f2869ffb700 1 -- 172.21.15.154:0/231858223 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287001c670 con 0x7f2874069c70 2023-10-10T22:18:33.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28740b2a90 con 0x7f2874069c70 2023-10-10T22:18:33.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.940+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287416cf10 con 0x7f2874069c70 2023-10-10T22:18:33.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.941+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28740b2610 con 0x7f2874069c70 2023-10-10T22:18:33.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.942+0000 7f2869ffb700 1 -- 172.21.15.154:0/231858223 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f287001caa0 con 0x7f2874069c70 2023-10-10T22:18:33.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.943+0000 7f2869ffb700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2858066f30 0x7f28580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:33.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.943+0000 7f2869ffb700 1 -- 172.21.15.154:0/231858223 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2870085ff0 con 0x7f2874069c70 2023-10-10T22:18:33.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.943+0000 7f287939a700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2858066f30 0x7f28580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:33.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.944+0000 7f287939a700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2858066f30 0x7f28580693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28640011e0 tx=0x7f2864009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:33.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:33.947+0000 7f2869ffb700 1 -- 172.21.15.154:0/231858223 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28740b2610 con 0x7f2874069c70 2023-10-10T22:18:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.218+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f28740b2610 con 0x7f2874069c70 2023-10-10T22:18:34.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.222+0000 7f2869ffb700 1 -- 172.21.15.154:0/231858223 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v44) v1 ==== 190+0+0 (secure 0 0 0) 0x7f28740b2610 con 0x7f2874069c70 2023-10-10T22:18:34.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2858066f30 msgr2=0x7f28580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:34.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2858066f30 0x7f28580693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28640011e0 tx=0x7f2864009040 comp rx=0 tx=0).stop 2023-10-10T22:18:34.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874069c70 msgr2=0x7f287416c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:34.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874069c70 0x7f287416c9d0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f28700091e0 tx=0x7f2870017000 comp rx=0 tx=0).stop 2023-10-10T22:18:34.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 shutdown_connections 2023-10-10T22:18:34.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2874159950 0x7f2874169d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2858066f30 0x7f28580693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874069c70 0x7f287416c9d0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 --2- 172.21.15.154:0/231858223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28740af320 0x7f2874159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 >> 172.21.15.154:0/231858223 conn(0x7f2874068e00 msgr2=0x7f28740cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:34.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 shutdown_connections 2023-10-10T22:18:34.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.225+0000 7f287bdff700 1 -- 172.21.15.154:0/231858223 wait complete. 2023-10-10T22:18:34.229 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T22:18:34.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:18:34.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.425+0000 7f4119fff700 1 Processor -- start 2023-10-10T22:18:34.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.425+0000 7f4119fff700 1 -- start start 2023-10-10T22:18:34.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.426+0000 7f4119fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4114159890 0x7f411415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:34.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.426+0000 7f4119fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4114159c60 0x7f411415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.426+0000 7f4119fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411415db10 0x7f4114069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.426+0000 7f4119fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411415df50 con 0x7f4114159890 2023-10-10T22:18:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.426+0000 7f4119fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411415a160 con 0x7f4114159c60 2023-10-10T22:18:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.426+0000 7f4119fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41140d13a0 con 0x7f411415db10 2023-10-10T22:18:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.426+0000 7f41137fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4114159890 0x7f411415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41137fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4114159890 0x7f411415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40580/0 (socket says 172.21.15.154:40580) 2023-10-10T22:18:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41137fe700 1 -- 172.21.15.154:0/2548252933 learned_addr learned my addr 172.21.15.154:0/2548252933 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41137fe700 1 -- 172.21.15.154:0/2548252933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411415db10 msgr2=0x7f4114069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41137fe700 1 --2- 172.21.15.154:0/2548252933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411415db10 0x7f4114069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41137fe700 1 -- 172.21.15.154:0/2548252933 >> v2:172.21.15.179:3300/0 conn(0x7f4114159c60 msgr2=0x7f411415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41137fe700 1 --2- 172.21.15.154:0/2548252933 >> v2:172.21.15.179:3300/0 conn(0x7f4114159c60 0x7f411415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41137fe700 1 -- 172.21.15.154:0/2548252933 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411415e140 con 0x7f4114159890 2023-10-10T22:18:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41137fe700 1 --2- 172.21.15.154:0/2548252933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159890 0x7f411415abd0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f41140b67f0 tx=0x7f4104009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c89557bc683deb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:34.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41127fc700 1 -- 172.21.15.154:0/2548252933 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410400b860 con 0x7f4114159890 2023-10-10T22:18:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41127fc700 1 -- 172.21.15.154:0/2548252933 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410400b9c0 con 0x7f4114159890 2023-10-10T22:18:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.427+0000 7f41127fc700 1 -- 172.21.15.154:0/2548252933 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410400bd60 con 0x7f4114159890 2023-10-10T22:18:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.428+0000 7f4119fff700 1 -- 172.21.15.154:0/2548252933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159890 msgr2=0x7f411415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.428+0000 7f4119fff700 1 --2- 172.21.15.154:0/2548252933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159890 0x7f411415abd0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f41140b67f0 tx=0x7f4104009250 comp rx=0 tx=0).stop 2023-10-10T22:18:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.428+0000 7f4119fff700 1 -- 172.21.15.154:0/2548252933 shutdown_connections 2023-10-10T22:18:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.428+0000 7f4119fff700 1 --2- 172.21.15.154:0/2548252933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411415db10 0x7f4114069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.428+0000 7f4119fff700 1 --2- 172.21.15.154:0/2548252933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159890 0x7f411415abd0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.428+0000 7f4119fff700 1 --2- 172.21.15.154:0/2548252933 >> v2:172.21.15.179:3300/0 conn(0x7f4114159c60 0x7f411415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.428+0000 7f4119fff700 1 -- 172.21.15.154:0/2548252933 >> 172.21.15.154:0/2548252933 conn(0x7f4114068e20 msgr2=0x7f41140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.428+0000 7f4119fff700 1 -- 172.21.15.154:0/2548252933 shutdown_connections 2023-10-10T22:18:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.428+0000 7f4119fff700 1 -- 172.21.15.154:0/2548252933 wait complete. 2023-10-10T22:18:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.429+0000 7f4119fff700 1 Processor -- start 2023-10-10T22:18:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.430+0000 7f4119fff700 1 -- start start 2023-10-10T22:18:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.430+0000 7f4119fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4114159890 0x7f4114142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.430+0000 7f4119fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159c60 0x7f41140b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.430+0000 7f4119fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411415db10 0x7f411416d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.430+0000 7f4119fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140b4140 con 0x7f4114159c60 2023-10-10T22:18:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.430+0000 7f4119fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140b5f80 con 0x7f4114159890 2023-10-10T22:18:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.430+0000 7f4119fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41140b6260 con 0x7f411415db10 2023-10-10T22:18:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4112ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159c60 0x7f41140b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f41137fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4114159890 0x7f4114142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4112ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159c60 0x7f41140b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40594/0 (socket says 172.21.15.154:40594) 2023-10-10T22:18:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4112ffd700 1 -- 172.21.15.154:0/2067367001 learned_addr learned my addr 172.21.15.154:0/2067367001 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4113fff700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411415db10 0x7f411416d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4112ffd700 1 -- 172.21.15.154:0/2067367001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411415db10 msgr2=0x7f411416d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4112ffd700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411415db10 0x7f411416d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4112ffd700 1 -- 172.21.15.154:0/2067367001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4114159890 msgr2=0x7f4114142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4112ffd700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4114159890 0x7f4114142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4112ffd700 1 -- 172.21.15.154:0/2067367001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040094f0 con 0x7f4114159c60 2023-10-10T22:18:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.431+0000 7f4112ffd700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159c60 0x7f41140b3590 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f410800b810 tx=0x7f4108009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.432+0000 7f40fb7fe700 1 -- 172.21.15.154:0/2067367001 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800f510 con 0x7f4114159c60 2023-10-10T22:18:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.432+0000 7f40fb7fe700 1 -- 172.21.15.154:0/2067367001 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410800f690 con 0x7f4114159c60 2023-10-10T22:18:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.432+0000 7f40fb7fe700 1 -- 172.21.15.154:0/2067367001 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800fa50 con 0x7f4114159c60 2023-10-10T22:18:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.432+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41140b3dd0 con 0x7f4114159c60 2023-10-10T22:18:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.432+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41140b3ad0 con 0x7f4114159c60 2023-10-10T22:18:34.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.433+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411404c3c0 con 0x7f4114159c60 2023-10-10T22:18:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.434+0000 7f40fb7fe700 1 -- 172.21.15.154:0/2067367001 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f410801a400 con 0x7f4114159c60 2023-10-10T22:18:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.434+0000 7f40fb7fe700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4100066f30 0x7f41000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.434+0000 7f40fb7fe700 1 -- 172.21.15.154:0/2067367001 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f41080842d0 con 0x7f4114159c60 2023-10-10T22:18:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.435+0000 7f41137fe700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4100066f30 0x7f41000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.435+0000 7f41137fe700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4100066f30 0x7f41000693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41140b67f0 tx=0x7f4104017000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.438+0000 7f40fb7fe700 1 -- 172.21.15.154:0/2067367001 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4108051350 con 0x7f4114159c60 2023-10-10T22:18:34.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.669+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41140b4280 con 0x7f4114159c60 2023-10-10T22:18:34.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.670+0000 7f40fb7fe700 1 -- 172.21.15.154:0/2067367001 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4613 (secure 0 0 0) 0x7f4108054970 con 0x7f4114159c60 2023-10-10T22:18:34.672 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:18:34.672 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3140311410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3140311410},{"type":"v1","addr":"172.21.15.179:6835","nonce":3140311410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2649941331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2649941331},{"type":"v1","addr":"172.21.15.179:6834","nonce":2649941331}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3061056526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3061056526},{"type":"v1","addr":"172.21.15.154:6834","nonce":3061056526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:18:23.465253+0000","modified":"2023-10-10T22:18:27.020551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9138":{"gid":9138,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3697556207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3697556207},{"type":"v1","addr":"172.21.15.154:6835","nonce":3697556207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-10T22:18:34.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.672+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4100066f30 msgr2=0x7f41000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.672+0000 7f4119fff700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4100066f30 0x7f41000693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41140b67f0 tx=0x7f4104017000 comp rx=0 tx=0).stop 2023-10-10T22:18:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.672+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159c60 msgr2=0x7f41140b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.672+0000 7f4119fff700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159c60 0x7f41140b3590 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f410800b810 tx=0x7f4108009250 comp rx=0 tx=0).stop 2023-10-10T22:18:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.672+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 shutdown_connections 2023-10-10T22:18:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.672+0000 7f4119fff700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f411415db10 0x7f411416d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.672+0000 7f4119fff700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4114159890 0x7f4114142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.672+0000 7f4119fff700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4100066f30 0x7f41000693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.673+0000 7f4119fff700 1 --2- 172.21.15.154:0/2067367001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4114159c60 0x7f41140b3590 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.673+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 >> 172.21.15.154:0/2067367001 conn(0x7f4114068e20 msgr2=0x7f41140cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:34.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.673+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 shutdown_connections 2023-10-10T22:18:34.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:34.673+0000 7f4119fff700 1 -- 172.21.15.154:0/2067367001 wait complete. 2023-10-10T22:18:34.677 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 78 2023-10-10T22:18:35.094 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T22:18:23.465253+0000', 'modified': '2023-10-10T22:18:27.020551+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9138': {'gid': 9138, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6835/3697556207', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6833', 'nonce': 3697556207}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 3697556207}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T22:18:35.095 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T22:18:35.095 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-10T22:18:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.276+0000 7ff28b59e700 1 Processor -- start 2023-10-10T22:18:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.276+0000 7ff28b59e700 1 -- start start 2023-10-10T22:18:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.277+0000 7ff28b59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff28c06d950 0x7ff28c0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.277+0000 7ff28b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff28c06a0a0 0x7ff28c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.277+0000 7ff28b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 0x7ff28c0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.277+0000 7ff28b59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c06ae70 con 0x7ff28c06a0a0 2023-10-10T22:18:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.277+0000 7ff28b59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c06a540 con 0x7ff28c06d950 2023-10-10T22:18:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.277+0000 7ff28b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c06a820 con 0x7ff28c06dd20 2023-10-10T22:18:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.277+0000 7ff289d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff28c06a0a0 0x7ff28c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff289d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff28c06a0a0 0x7ff28c0c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40606/0 (socket says 172.21.15.154:40606) 2023-10-10T22:18:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff289d9b700 1 -- 172.21.15.154:0/1003500194 learned_addr learned my addr 172.21.15.154:0/1003500194 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff28a59c700 1 --2- 172.21.15.154:0/1003500194 >> v2:172.21.15.179:3300/0 conn(0x7ff28c06d950 0x7ff28c0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/1003500194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 0x7ff28c0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff289d9b700 1 -- 172.21.15.154:0/1003500194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 msgr2=0x7ff28c0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff289d9b700 1 --2- 172.21.15.154:0/1003500194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 0x7ff28c0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff289d9b700 1 -- 172.21.15.154:0/1003500194 >> v2:172.21.15.179:3300/0 conn(0x7ff28c06d950 msgr2=0x7ff28c0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff289d9b700 1 --2- 172.21.15.154:0/1003500194 >> v2:172.21.15.179:3300/0 conn(0x7ff28c06d950 0x7ff28c0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff289d9b700 1 -- 172.21.15.154:0/1003500194 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c06ab00 con 0x7ff28c06a0a0 2023-10-10T22:18:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff289d9b700 1 --2- 172.21.15.154:0/1003500194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06a0a0 0x7ff28c0c6c10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0c9c70 tx=0x7ff280009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc1c6d16ec2743f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.278+0000 7ff28959a700 1 -- 172.21.15.154:0/1003500194 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28000b640 con 0x7ff28c06a0a0 2023-10-10T22:18:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28959a700 1 -- 172.21.15.154:0/1003500194 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28000b7a0 con 0x7ff28c06a0a0 2023-10-10T22:18:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28959a700 1 -- 172.21.15.154:0/1003500194 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28000bb60 con 0x7ff28c06a0a0 2023-10-10T22:18:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28b59e700 1 -- 172.21.15.154:0/1003500194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06a0a0 msgr2=0x7ff28c0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28b59e700 1 --2- 172.21.15.154:0/1003500194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06a0a0 0x7ff28c0c6c10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0c9c70 tx=0x7ff280009250 comp rx=0 tx=0).stop 2023-10-10T22:18:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28b59e700 1 -- 172.21.15.154:0/1003500194 shutdown_connections 2023-10-10T22:18:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28b59e700 1 --2- 172.21.15.154:0/1003500194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 0x7ff28c0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28b59e700 1 --2- 172.21.15.154:0/1003500194 >> v2:172.21.15.179:3300/0 conn(0x7ff28c06d950 0x7ff28c0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28b59e700 1 --2- 172.21.15.154:0/1003500194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06a0a0 0x7ff28c0c6c10 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28b59e700 1 -- 172.21.15.154:0/1003500194 >> 172.21.15.154:0/1003500194 conn(0x7ff28c0cc1f0 msgr2=0x7ff28c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28b59e700 1 -- 172.21.15.154:0/1003500194 shutdown_connections 2023-10-10T22:18:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.279+0000 7ff28b59e700 1 -- 172.21.15.154:0/1003500194 wait complete. 2023-10-10T22:18:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.281+0000 7ff28b59e700 1 Processor -- start 2023-10-10T22:18:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.281+0000 7ff28b59e700 1 -- start start 2023-10-10T22:18:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff28b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff28c06a0a0 0x7ff28c0c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff28b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06d950 0x7ff28c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff28b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 0x7ff28c150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff28b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c150570 con 0x7ff28c06d950 2023-10-10T22:18:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff28b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c150840 con 0x7ff28c06a0a0 2023-10-10T22:18:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff28b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c150b20 con 0x7ff28c06dd20 2023-10-10T22:18:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff289d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06d950 0x7ff28c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff289d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06d950 0x7ff28c1518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40620/0 (socket says 172.21.15.154:40620) 2023-10-10T22:18:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff289d9b700 1 -- 172.21.15.154:0/4077937683 learned_addr learned my addr 172.21.15.154:0/4077937683 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff28a59c700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff28c06a0a0 0x7ff28c0c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 0x7ff28c150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff289d9b700 1 -- 172.21.15.154:0/4077937683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 msgr2=0x7ff28c150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff289d9b700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 0x7ff28c150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff289d9b700 1 -- 172.21.15.154:0/4077937683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff28c06a0a0 msgr2=0x7ff28c0c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff289d9b700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff28c06a0a0 0x7ff28c0c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff289d9b700 1 -- 172.21.15.154:0/4077937683 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800094f0 con 0x7ff28c06d950 2023-10-10T22:18:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.282+0000 7ff289d9b700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06d950 0x7ff28c1518e0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff28c06fe40 tx=0x7ff280017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.283+0000 7ff27a7fc700 1 -- 172.21.15.154:0/4077937683 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280000d10 con 0x7ff28c06d950 2023-10-10T22:18:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.283+0000 7ff27a7fc700 1 -- 172.21.15.154:0/4077937683 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28000bb20 con 0x7ff28c06d950 2023-10-10T22:18:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.283+0000 7ff27a7fc700 1 -- 172.21.15.154:0/4077937683 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280011670 con 0x7ff28c06d950 2023-10-10T22:18:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.283+0000 7ff28b59e700 1 -- 172.21.15.154:0/4077937683 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c150e00 con 0x7ff28c06d950 2023-10-10T22:18:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.283+0000 7ff28b59e700 1 -- 172.21.15.154:0/4077937683 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c1513c0 con 0x7ff28c06d950 2023-10-10T22:18:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.285+0000 7ff27a7fc700 1 -- 172.21.15.154:0/4077937683 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2800119e0 con 0x7ff28c06d950 2023-10-10T22:18:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.286+0000 7ff27a7fc700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff26c066f30 0x7ff26c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.286+0000 7ff27a7fc700 1 -- 172.21.15.154:0/4077937683 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7ff280086070 con 0x7ff28c06d950 2023-10-10T22:18:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.286+0000 7ff28a59c700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff26c066f30 0x7ff26c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.287+0000 7ff28a59c700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff26c066f30 0x7ff26c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009d40 tx=0x7ff27c008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.288+0000 7ff29f4bdb80 1 Processor -- start 2023-10-10T22:18:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.288+0000 7ff29f4bdb80 1 -- start start 2023-10-10T22:18:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1c2480 0x559d2f1a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1755f0 0x559d2f1c2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f177b80 0x559d2f177ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2f0cea70 con 0x559d2f177b80 2023-10-10T22:18:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2f0cc270 con 0x559d2f1755f0 2023-10-10T22:18:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d2f0c8060 con 0x559d2f1c2480 2023-10-10T22:18:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff28ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f177b80 0x559d2f177ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff289d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1755f0 0x559d2f1c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff28ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f177b80 0x559d2f177ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40634/0 (socket says 172.21.15.154:40634) 2023-10-10T22:18:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff289d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1755f0 0x559d2f1c2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:56378/0 (socket says 172.21.15.154:56378) 2023-10-10T22:18:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.289+0000 7ff28ad9d700 1 -- 172.21.15.154:0/1683769419 learned_addr learned my addr 172.21.15.154:0/1683769419 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff28a59c700 1 --2- 172.21.15.154:0/1683769419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1c2480 0x559d2f1a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff28ad9d700 1 -- 172.21.15.154:0/1683769419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1c2480 msgr2=0x559d2f1a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/1683769419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1c2480 0x559d2f1a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff28ad9d700 1 -- 172.21.15.154:0/1683769419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1755f0 msgr2=0x559d2f1c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/1683769419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1755f0 0x559d2f1c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff28ad9d700 1 -- 172.21.15.154:0/1683769419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d2ef62270 con 0x559d2f177b80 2023-10-10T22:18:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff289d9b700 1 --2- 172.21.15.154:0/1683769419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1755f0 0x559d2f1c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/1683769419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f177b80 0x559d2f177ff0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff2840074b0 tx=0x7ff28400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9075af92fadf5937 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff26b7fe700 1 -- 172.21.15.154:0/1683769419 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28400e030 con 0x559d2f177b80 2023-10-10T22:18:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff26b7fe700 1 -- 172.21.15.154:0/1683769419 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2840153f0 con 0x559d2f177b80 2023-10-10T22:18:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.290+0000 7ff26b7fe700 1 -- 172.21.15.154:0/1683769419 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284015790 con 0x559d2f177b80 2023-10-10T22:18:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.291+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1683769419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f177b80 msgr2=0x559d2f177ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.291+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1683769419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f177b80 0x559d2f177ff0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff2840074b0 tx=0x7ff28400b040 comp rx=0 tx=0).stop 2023-10-10T22:18:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.291+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1683769419 shutdown_connections 2023-10-10T22:18:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.291+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1683769419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f177b80 0x559d2f177ff0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.291+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1683769419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1c2480 0x559d2f1a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.291+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1683769419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1755f0 0x559d2f1c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.291+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1683769419 >> 172.21.15.154:0/1683769419 conn(0x559d2f1790c0 msgr2=0x559d2f1798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.291+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1683769419 shutdown_connections 2023-10-10T22:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.291+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1683769419 wait complete. 2023-10-10T22:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.292+0000 7ff29f4bdb80 1 -- start start 2023-10-10T22:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.292+0000 7ff29f4bdb80 1 Processor -- start 2023-10-10T22:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 0x559d2f19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 0x559d2f1ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f1c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2f073890 con 0x559d2f1c2480 2023-10-10T22:18:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2f08eea0 con 0x559d2f177b80 2023-10-10T22:18:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d2ef4ae30 con 0x559d2f1755f0 2023-10-10T22:18:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff29f4bdb80 10 client.0 _ll_register_callbacks cb 0x559d2f13b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T22:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f1c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f1c1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40640/0 (socket says 172.21.15.154:40640) 2023-10-10T22:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28ad9d700 1 -- 172.21.15.154:0/1122639424 learned_addr learned my addr 172.21.15.154:0/1122639424 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff289d9b700 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 0x559d2f1ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28a59c700 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 0x559d2f19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28ad9d700 1 -- 172.21.15.154:0/1122639424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 msgr2=0x559d2f19bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 0x559d2f19bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28ad9d700 1 -- 172.21.15.154:0/1122639424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 msgr2=0x559d2f1ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 0x559d2f1ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28ad9d700 1 -- 172.21.15.154:0/1122639424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c1513c0 con 0x559d2f1c2480 2023-10-10T22:18:35.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.293+0000 7ff28a59c700 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 0x559d2f19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.294+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f1c1670 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7ff284007aa0 tx=0x7ff28401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869fd167325c9268 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.294+0000 7ff268ff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T22:18:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.294+0000 7ff268ff9700 1 -- 172.21.15.154:0/1122639424 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28400e040 con 0x559d2f1c2480 2023-10-10T22:18:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.294+0000 7ff268ff9700 1 -- 172.21.15.154:0/1122639424 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7ff28400f070 con 0x559d2f1c2480 2023-10-10T22:18:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.294+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1122639424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d2f16ccd0 con 0x559d2f1c2480 2023-10-10T22:18:35.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.294+0000 7ff268ff9700 1 -- 172.21.15.154:0/1122639424 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff28401e840 con 0x559d2f1c2480 2023-10-10T22:18:35.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.294+0000 7ff29f4bdb80 10 client.9303 fetch_fsmap learned FSMap version 78 2023-10-10T22:18:35.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.294+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1122639424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x7ff284009e70 con 0x559d2f1c2480 2023-10-10T22:18:35.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.294+0000 7ff268ff9700 1 -- 172.21.15.154:0/1122639424 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d2f16ccd0 con 0x559d2f1c2480 2023-10-10T22:18:35.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff268ff9700 1 -- 172.21.15.154:0/1122639424 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff284014070 con 0x559d2f1c2480 2023-10-10T22:18:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff29f4bdb80 10 client.9303 fetch_fsmap finished waiting for FSMap version 78 2023-10-10T22:18:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff29f4bdb80 10 client.9303 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-10T22:18:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff29f4bdb80 20 client.9303 populate_metadata read hostname 'smithi154' 2023-10-10T22:18:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] conn(0x559d2f1a7490 0x559d2f1a7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff29f4bdb80 4 client.9303 mds_command: new command op to 9138 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T22:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1122639424 --> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d2f149aa0 con 0x559d2f1a7490 2023-10-10T22:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff28a59c700 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] conn(0x559d2f1a7490 0x559d2f1a7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff268ff9700 10 client.9303 ms_handle_connect on v2:172.21.15.154:6833/3697556207 2023-10-10T22:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.295+0000 7ff28a59c700 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] conn(0x559d2f1a7490 0x559d2f1a7860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ceab68c77441005 server_cookie=e2bade0329a37092 in_seq=0 out_seq=0 2023-10-10T22:18:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff268ff9700 1 -- 172.21.15.154:0/1122639424 <== mds.0 v2:172.21.15.154:6833/3697556207 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559d2f149aa0 con 0x559d2f1a7490 2023-10-10T22:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff268ff9700 10 client.9303 handle_command_reply: tid=0 2023-10-10T22:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff29f4bdb80 1 client.9303 shutdown 2023-10-10T22:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1122639424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 msgr2=0x559d2f1c1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f1c1670 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7ff284007aa0 tx=0x7ff28401b000 comp rx=0 tx=0).stop 2023-10-10T22:18:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1122639424 shutdown_connections 2023-10-10T22:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] conn(0x559d2f1a7490 0x559d2f1a7860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f1c1670 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 0x559d2f19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff268ff9700 0 client.9303 ms_handle_reset on v2:172.21.15.154:6833/3697556207 2023-10-10T22:18:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/1122639424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 0x559d2f1ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.296+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1122639424 >> 172.21.15.154:0/1122639424 conn(0x559d2f1790c0 msgr2=0x559d2f16ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.297+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1122639424 shutdown_connections 2023-10-10T22:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.297+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/1122639424 wait complete. 2023-10-10T22:18:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.297+0000 7ff29f4bdb80 20 client.9303 trim_cache size 0 max 16384 2023-10-10T22:18:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.314+0000 7ff29f4bdb80 1 Processor -- start 2023-10-10T22:18:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.314+0000 7ff29f4bdb80 1 -- start start 2023-10-10T22:18:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 0x559d2f174a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 0x559d2f174fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2f1a3920 con 0x559d2f1c2480 2023-10-10T22:18:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2f1a4c70 con 0x559d2f177b80 2023-10-10T22:18:35.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d2f1a78f0 con 0x559d2f1755f0 2023-10-10T22:18:35.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40644/0 (socket says 172.21.15.154:40644) 2023-10-10T22:18:35.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28ad9d700 1 -- 172.21.15.154:0/2310107394 learned_addr learned my addr 172.21.15.154:0/2310107394 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:35.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28a59c700 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 0x559d2f174a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff289d9b700 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 0x559d2f174fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28ad9d700 1 -- 172.21.15.154:0/2310107394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 msgr2=0x559d2f174a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 0x559d2f174a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28ad9d700 1 -- 172.21.15.154:0/2310107394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 msgr2=0x559d2f174fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 0x559d2f174fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28ad9d700 1 -- 172.21.15.154:0/2310107394 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d2ef04fe0 con 0x559d2f1c2480 2023-10-10T22:18:35.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff289d9b700 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 0x559d2f174fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:35.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.315+0000 7ff28ad9d700 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f19ad20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7ff284015d30 tx=0x7ff284021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67974b4b5d44d72e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff26bfff700 1 -- 172.21.15.154:0/2310107394 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28401e8c0 con 0x559d2f1c2480 2023-10-10T22:18:35.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff26bfff700 1 -- 172.21.15.154:0/2310107394 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff284007d60 con 0x559d2f1c2480 2023-10-10T22:18:35.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff26bfff700 1 -- 172.21.15.154:0/2310107394 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28401ea70 con 0x559d2f1c2480 2023-10-10T22:18:35.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/2310107394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 msgr2=0x559d2f19ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f19ad20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7ff284015d30 tx=0x7ff284021040 comp rx=0 tx=0).stop 2023-10-10T22:18:35.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/2310107394 shutdown_connections 2023-10-10T22:18:35.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1c2480 0x559d2f19ad20 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f1755f0 0x559d2f174a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/2310107394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f177b80 0x559d2f174fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/2310107394 >> 172.21.15.154:0/2310107394 conn(0x559d2f1790c0 msgr2=0x559d2f1a4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:35.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/2310107394 shutdown_connections 2023-10-10T22:18:35.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.316+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/2310107394 wait complete. 2023-10-10T22:18:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.317+0000 7ff29f4bdb80 1 -- start start 2023-10-10T22:18:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.317+0000 7ff29f4bdb80 1 Processor -- start 2023-10-10T22:18:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1755f0 0x559d2f16ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f177b80 0x559d2f16ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff29f4bdb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1c2480 0x559d2f1d7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2f1d8000 con 0x559d2f1755f0 2023-10-10T22:18:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2f1e0870 con 0x559d2f1c2480 2023-10-10T22:18:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff29f4bdb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d2f1e0ac0 con 0x559d2f177b80 2023-10-10T22:18:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff29f4bdb80 10 client.0 _ll_register_callbacks cb 0x559d2f13b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T22:18:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff28a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1755f0 0x559d2f16ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff28a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1755f0 0x559d2f16ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40660/0 (socket says 172.21.15.154:40660) 2023-10-10T22:18:35.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff28a59c700 1 -- 172.21.15.154:0/461422587 learned_addr learned my addr 172.21.15.154:0/461422587 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:35.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff289d9b700 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f177b80 0x559d2f16ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff28a59c700 1 -- 172.21.15.154:0/461422587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f177b80 msgr2=0x559d2f16ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff28a59c700 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f177b80 0x559d2f16ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff28a59c700 1 -- 172.21.15.154:0/461422587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1c2480 msgr2=0x559d2f1d7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.318+0000 7ff28a59c700 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1c2480 0x559d2f1d7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff28a59c700 1 -- 172.21.15.154:0/461422587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff284009e70 con 0x559d2f1755f0 2023-10-10T22:18:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff28a59c700 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1755f0 0x559d2f16ea40 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009fd0 tx=0x7ff27c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd899b5ad44efda server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff268ff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T22:18:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff268ff9700 1 -- 172.21.15.154:0/461422587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c028040 con 0x559d2f1755f0 2023-10-10T22:18:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff268ff9700 1 -- 172.21.15.154:0/461422587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7ff27c015e10 con 0x559d2f1755f0 2023-10-10T22:18:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/461422587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff28c16a690 con 0x559d2f1755f0 2023-10-10T22:18:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff268ff9700 1 -- 172.21.15.154:0/461422587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff27c02c830 con 0x559d2f1755f0 2023-10-10T22:18:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff29f4bdb80 10 client.9309 fetch_fsmap learned FSMap version 78 2023-10-10T22:18:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/461422587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x559d2f096780 con 0x559d2f1755f0 2023-10-10T22:18:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.319+0000 7ff268ff9700 1 -- 172.21.15.154:0/461422587 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c16a690 con 0x559d2f1755f0 2023-10-10T22:18:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff268ff9700 1 -- 172.21.15.154:0/461422587 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff27c032020 con 0x559d2f1755f0 2023-10-10T22:18:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff29f4bdb80 10 client.9309 fetch_fsmap finished waiting for FSMap version 78 2023-10-10T22:18:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff29f4bdb80 10 client.9309 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-10T22:18:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff29f4bdb80 20 client.9309 populate_metadata read hostname 'smithi154' 2023-10-10T22:18:35.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] conn(0x559d2f1d7720 0x559d2f19ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff29f4bdb80 4 client.9309 mds_command: new command op to 9138 tid=0[{"prefix": "status"}] 2023-10-10T22:18:35.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/461422587 --> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff2840153f0 con 0x559d2f1d7720 2023-10-10T22:18:35.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff289d9b700 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] conn(0x559d2f1d7720 0x559d2f19ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff289d9b700 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] conn(0x559d2f1d7720 0x559d2f19ff50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4fdec752169f5d8 server_cookie=10f8eb10483db755 in_seq=0 out_seq=0 2023-10-10T22:18:35.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff268ff9700 10 client.9309 ms_handle_connect on v2:172.21.15.154:6833/3697556207 2023-10-10T22:18:35.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff268ff9700 1 -- 172.21.15.154:0/461422587 <== mds.0 v2:172.21.15.154:6833/3697556207 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7ff2840153f0 con 0x559d2f1d7720 2023-10-10T22:18:35.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.320+0000 7ff268ff9700 10 client.9309 handle_command_reply: tid=0 2023-10-10T22:18:35.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 client.9309 shutdown 2023-10-10T22:18:35.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/461422587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1755f0 msgr2=0x559d2f16ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1755f0 0x559d2f16ea40 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009fd0 tx=0x7ff27c018000 comp rx=0 tx=0).stop 2023-10-10T22:18:35.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/461422587 shutdown_connections 2023-10-10T22:18:35.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.154:6833/3697556207,v1:172.21.15.154:6835/3697556207] conn(0x559d2f1d7720 0x559d2f19ff50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559d2f1c2480 0x559d2f1d7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2f1755f0 0x559d2f16ea40 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff268ff9700 0 client.9309 ms_handle_reset on v2:172.21.15.154:6833/3697556207 2023-10-10T22:18:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 --2- 172.21.15.154:0/461422587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559d2f177b80 0x559d2f16ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/461422587 >> 172.21.15.154:0/461422587 conn(0x559d2f1790c0 msgr2=0x559d2f1a5060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/461422587 shutdown_connections 2023-10-10T22:18:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 1 -- 172.21.15.154:0/461422587 wait complete. 2023-10-10T22:18:35.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.321+0000 7ff29f4bdb80 20 client.9309 trim_cache size 0 max 16384 2023-10-10T22:18:35.342 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:18:35.342 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T22:18:35.342 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T22:18:35.343 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 9138, 2023-10-10T22:18:35.343 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T22:18:35.343 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T22:18:35.343 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T22:18:35.343 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.311995446999999, 2023-10-10T22:18:35.344 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 78, 2023-10-10T22:18:35.344 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 175, 2023-10-10T22:18:35.344 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 175, 2023-10-10T22:18:35.345 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.297241382999999 2023-10-10T22:18:35.345 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:18:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 -- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff26c066f30 msgr2=0x7ff26c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff26c066f30 0x7ff26c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009d40 tx=0x7ff27c008040 comp rx=0 tx=0).stop 2023-10-10T22:18:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 -- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06d950 msgr2=0x7ff28c1518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06d950 0x7ff28c1518e0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff28c06fe40 tx=0x7ff280017000 comp rx=0 tx=0).stop 2023-10-10T22:18:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 -- 172.21.15.154:0/4077937683 shutdown_connections 2023-10-10T22:18:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff28c06dd20 0x7ff28c150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff28c06a0a0 0x7ff28c0c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff26c066f30 0x7ff26c0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 --2- 172.21.15.154:0/4077937683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff28c06d950 0x7ff28c1518e0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 -- 172.21.15.154:0/4077937683 >> 172.21.15.154:0/4077937683 conn(0x7ff28c0cc1f0 msgr2=0x7ff28c0cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 -- 172.21.15.154:0/4077937683 shutdown_connections 2023-10-10T22:18:35.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.322+0000 7ff28b59e700 1 -- 172.21.15.154:0/4077937683 wait complete. 2023-10-10T22:18:35.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T22:18:35.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.529+0000 7f2f02d9d700 1 Processor -- start 2023-10-10T22:18:35.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.529+0000 7f2f02d9d700 1 -- start start 2023-10-10T22:18:35.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.530+0000 7f2f02d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc1597f0 0x7f2efc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.530+0000 7f2f02d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0b11d0 con 0x7f2efc15d230 2023-10-10T22:18:35.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.530+0000 7f2f02d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0b14b0 con 0x7f2efc159420 2023-10-10T22:18:35.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.530+0000 7f2f02d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0b1790 con 0x7f2efc1597f0 2023-10-10T22:18:35.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.530+0000 7f2f0259c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2efc15d230 0x7f2efc0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54124/0 (socket says 172.21.15.154:54124) 2023-10-10T22:18:35.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f0259c700 1 -- 172.21.15.154:0/2172109897 learned_addr learned my addr 172.21.15.154:0/2172109897 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:35.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f01d9b700 1 --1- 172.21.15.154:0/2172109897 >> v1:172.21.15.179:6789/0 conn(0x7f2efc159420 0x7f2efc0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:55826/0 (socket says 172.21.15.154:55826) 2023-10-10T22:18:35.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f0159a700 1 --2- 172.21.15.154:0/2172109897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc1597f0 0x7f2efc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f00d99700 1 -- 172.21.15.154:0/2172109897 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723461349 0 0) 0x7f2efc0b14b0 con 0x7f2efc159420 2023-10-10T22:18:35.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f00d99700 1 -- 172.21.15.154:0/2172109897 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee8003570 con 0x7f2efc159420 2023-10-10T22:18:35.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f00d99700 1 -- 172.21.15.154:0/2172109897 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578447406 0 0) 0x7f2efc0b11d0 con 0x7f2efc15d230 2023-10-10T22:18:35.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f0159a700 1 -- 172.21.15.154:0/2172109897 >> v1:172.21.15.179:6789/0 conn(0x7f2efc159420 legacy=0x7f2efc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f0159a700 1 -- 172.21.15.154:0/2172109897 >> v1:172.21.15.154:6789/0 conn(0x7f2efc15d230 legacy=0x7f2efc0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f0159a700 1 -- 172.21.15.154:0/2172109897 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0b1a70 con 0x7f2efc1597f0 2023-10-10T22:18:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.531+0000 7f2f0159a700 1 --2- 172.21.15.154:0/2172109897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc1597f0 0x7f2efc0b2270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009910 tx=0x7f2eec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58de4ffcf332f7e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f00d99700 1 -- 172.21.15.154:0/2172109897 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00b680 con 0x7f2efc1597f0 2023-10-10T22:18:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f00d99700 1 -- 172.21.15.154:0/2172109897 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec00b7e0 con 0x7f2efc1597f0 2023-10-10T22:18:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f00d99700 1 -- 172.21.15.154:0/2172109897 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00bba0 con 0x7f2efc1597f0 2023-10-10T22:18:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2172109897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc1597f0 msgr2=0x7f2efc0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f02d9d700 1 --2- 172.21.15.154:0/2172109897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc1597f0 0x7f2efc0b2270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009910 tx=0x7f2eec0091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2172109897 shutdown_connections 2023-10-10T22:18:35.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f02d9d700 1 --2- 172.21.15.154:0/2172109897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc1597f0 0x7f2efc0b2270 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2172109897 >> 172.21.15.154:0/2172109897 conn(0x7f2efc0d0660 msgr2=0x7f2efc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:35.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2172109897 shutdown_connections 2023-10-10T22:18:35.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.532+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2172109897 wait complete. 2023-10-10T22:18:35.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.534+0000 7f2f02d9d700 1 Processor -- start 2023-10-10T22:18:35.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.534+0000 7f2f02d9d700 1 -- start start 2023-10-10T22:18:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f02d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2efc159420 0x7f2efc15b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f02d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1597f0 0x7f2efc154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f02d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc15d230 0x7f2efc14bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f02d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc15f1e0 con 0x7f2efc1597f0 2023-10-10T22:18:35.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f02d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc15f4c0 con 0x7f2efc159420 2023-10-10T22:18:35.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f02d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc15f7a0 con 0x7f2efc15d230 2023-10-10T22:18:35.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f0159a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1597f0 0x7f2efc154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f0159a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1597f0 0x7f2efc154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40666/0 (socket says 172.21.15.154:40666) 2023-10-10T22:18:35.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f0159a700 1 -- 172.21.15.154:0/2741194560 learned_addr learned my addr 172.21.15.154:0/2741194560 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:35.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f01d9b700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2efc159420 0x7f2efc15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f0259c700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc15d230 0x7f2efc14bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f0159a700 1 -- 172.21.15.154:0/2741194560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc15d230 msgr2=0x7f2efc14bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f0159a700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc15d230 0x7f2efc14bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f0159a700 1 -- 172.21.15.154:0/2741194560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2efc159420 msgr2=0x7f2efc15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f0159a700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2efc159420 0x7f2efc15b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.535+0000 7f2f0159a700 1 -- 172.21.15.154:0/2741194560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec009420 con 0x7f2efc1597f0 2023-10-10T22:18:35.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.536+0000 7f2f0159a700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1597f0 0x7f2efc154290 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f2efc089340 tx=0x7f2eec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.536+0000 7f2ef1ffb700 1 -- 172.21.15.154:0/2741194560 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00bb60 con 0x7f2efc1597f0 2023-10-10T22:18:35.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.536+0000 7f2ef1ffb700 1 -- 172.21.15.154:0/2741194560 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec027450 con 0x7f2efc1597f0 2023-10-10T22:18:35.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.536+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc15fa80 con 0x7f2efc1597f0 2023-10-10T22:18:35.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.536+0000 7f2ef1ffb700 1 -- 172.21.15.154:0/2741194560 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0277f0 con 0x7f2efc1597f0 2023-10-10T22:18:35.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.536+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc15b660 con 0x7f2efc1597f0 2023-10-10T22:18:35.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.537+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc15ffa0 con 0x7f2efc1597f0 2023-10-10T22:18:35.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.538+0000 7f2ef1ffb700 1 -- 172.21.15.154:0/2741194560 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2eec01a430 con 0x7f2efc1597f0 2023-10-10T22:18:35.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.539+0000 7f2ef1ffb700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2ee0066f30 0x7f2ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:35.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.539+0000 7f2ef1ffb700 1 -- 172.21.15.154:0/2741194560 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2eec0867b0 con 0x7f2efc1597f0 2023-10-10T22:18:35.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.539+0000 7f2f01d9b700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2ee0066f30 0x7f2ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:35.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.540+0000 7f2f01d9b700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2ee0066f30 0x7f2ee00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8002100 tx=0x7f2ef8000f40 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:35.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.543+0000 7f2ef1ffb700 1 -- 172.21.15.154:0/2741194560 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2efc15ffa0 con 0x7f2efc1597f0 2023-10-10T22:18:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.777+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2efc15ffa0 con 0x7f2efc1597f0 2023-10-10T22:18:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.778+0000 7f2ef1ffb700 1 -- 172.21.15.154:0/2741194560 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2efc15ffa0 con 0x7f2efc1597f0 2023-10-10T22:18:35.780 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T22:18:35.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2ee0066f30 msgr2=0x7f2ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2ee0066f30 0x7f2ee00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8002100 tx=0x7f2ef8000f40 comp rx=0 tx=0).stop 2023-10-10T22:18:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1597f0 msgr2=0x7f2efc154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1597f0 0x7f2efc154290 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f2efc089340 tx=0x7f2eec017000 comp rx=0 tx=0).stop 2023-10-10T22:18:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 shutdown_connections 2023-10-10T22:18:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2efc15d230 0x7f2efc14bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2efc159420 0x7f2efc15b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2ee0066f30 0x7f2ee00693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 --2- 172.21.15.154:0/2741194560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1597f0 0x7f2efc154290 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.780+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 >> 172.21.15.154:0/2741194560 conn(0x7f2efc0d0660 msgr2=0x7f2efc155880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.781+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 shutdown_connections 2023-10-10T22:18:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:35.781+0000 7f2f02d9d700 1 -- 172.21.15.154:0/2741194560 wait complete. 2023-10-10T22:18:35.799 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T22:18:35.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T22:18:35.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T22:18:35.801 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T22:18:35.801 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T22:18:35.801 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T22:18:35.801 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T22:18:35.802 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T22:18:35.802 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:18:35.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:18:35.803 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T22:18:35.840 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T22:18:35.841 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T22:18:35.841 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T22:18:35.841 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:18:35.841 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T22:18:35.842 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:18:35.842 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:18:35.842 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:18:35.842 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T22:18:35.842 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:18:35.843 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:18:35.843 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T22:18:35.843 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:18:35.843 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:18:35.843 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T22:18:35.844 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:18:35.844 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T22:18:35.844 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 37698sec preferred_lft 37698sec 2023-10-10T22:18:35.844 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T22:18:35.844 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:18:35.844 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T22:18:35.845 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:18:35.845 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T22:18:35.845 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:18:35.845 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T22:18:35.845 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:18:35.846 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T22:18:35.846 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T22:18:35.846 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T22:18:35.846 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:18:35.846 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T22:18:35.846 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T22:18:35.847 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T22:18:35.847 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:18:35.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:18:35.848 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T22:18:35.940 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T22:18:35.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:18:35.944 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T22:18:35.984 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T22:18:35.984 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T22:18:35.985 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T22:18:35.985 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T22:18:35.985 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T22:18:35.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:18:35.986 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T22:18:35.986 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T22:18:35.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T22:18:35.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T22:18:35.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T22:18:35.988 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T22:18:36.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:18:36.182 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T22:18:36.219 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T22:18:36.219 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T22:18:36.220 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:18:36.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:18:36.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T22:18:36.321 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T22:18:36.321 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T22:18:36.358 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:18:36.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T22:18:36.359 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T22:18:36.434 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T22:18:36.434 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T22:18:36.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:18:36.564 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:18:36.564 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:18:36.565 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:18:36.581 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:18:36.581 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:18:36.581 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:18:36.581 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T22:18:36.582 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T22:18:36.601 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:18:36.601 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:18:36.602 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:18:36.602 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T22:18:36.602 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T22:18:36.602 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T22:18:36.602 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T22:18:36.603 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T22:18:36.607 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T22:18:36.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:18:36.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T22:18:36.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T22:18:36.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.853+0000 7f2dedd9d700 1 Processor -- start 2023-10-10T22:18:36.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.853+0000 7f2dedd9d700 1 -- start start 2023-10-10T22:18:36.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2dedd9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2de8150550 0x7f2de8157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:36.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2dedd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80c7410 0x7f2de8069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:36.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2dedd9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de806e2a0 con 0x7f2de8150180 2023-10-10T22:18:36.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2dedd9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de806b2e0 con 0x7f2de8150550 2023-10-10T22:18:36.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2dedd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80c78e0 con 0x7f2de80c7410 2023-10-10T22:18:36.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2decd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2de8150180 0x7f2de80c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43316/0 (socket says 172.21.15.154:43316) 2023-10-10T22:18:36.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2decd9b700 1 -- 172.21.15.154:0/1207246917 learned_addr learned my addr 172.21.15.154:0/1207246917 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:36.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2ded59c700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80c7410 0x7f2de8069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2de7fff700 1 --2- 172.21.15.154:0/1207246917 >> v2:172.21.15.179:3300/0 conn(0x7f2de8150550 0x7f2de8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094458216 0 0) 0x7f2de806e2a0 con 0x7f2de8150180 2023-10-10T22:18:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.855+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd8004680 con 0x7f2de8150180 2023-10-10T22:18:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1104620644 0 0) 0x7f2dd8004680 con 0x7f2de8150180 2023-10-10T22:18:36.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80c7410 msgr2=0x7f2de8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:36.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80c7410 0x7f2de8069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:36.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 >> v2:172.21.15.179:3300/0 conn(0x7f2de8150550 msgr2=0x7f2de8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:36.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 --2- 172.21.15.154:0/1207246917 >> v2:172.21.15.179:3300/0 conn(0x7f2de8150550 0x7f2de8157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:36.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80c7bc0 con 0x7f2de8150180 2023-10-10T22:18:36.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f2ddc001470 con 0x7f2de8150180 2023-10-10T22:18:36.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 >> v1:172.21.15.154:6789/0 conn(0x7f2de8150180 legacy=0x7f2de80c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:36.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2dd8004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:36.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80c7410 0x7f2dd8005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:36.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dd8005e60 0x7f2dd80062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:36.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de806b2e0 con 0x7f2dd8004b70 2023-10-10T22:18:36.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80c78e0 con 0x7f2dd8005e60 2023-10-10T22:18:36.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd8003490 con 0x7f2de80c7410 2023-10-10T22:18:36.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2decd9b700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2dd8004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2ded59c700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dd8005e60 0x7f2dd80062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.856+0000 7f2de7fff700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80c7410 0x7f2dd8005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2decd9b700 1 -- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80c7410 msgr2=0x7f2dd8005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2decd9b700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80c7410 0x7f2dd8005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2decd9b700 1 -- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dd8005e60 msgr2=0x7f2dd80062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2decd9b700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dd8005e60 0x7f2dd80062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2decd9b700 1 -- 172.21.15.154:0/1207246917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd8004680 con 0x7f2dd8004b70 2023-10-10T22:18:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2decd9b700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2dd8004f80 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00c3c0 tx=0x7f2ddc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a209232083a07c4b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00cc30 con 0x7f2dd8004b70 2023-10-10T22:18:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00cdb0 con 0x7f2dd8004b70 2023-10-10T22:18:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2de77fe700 1 -- 172.21.15.154:0/1207246917 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc005b70 con 0x7f2dd8004b70 2023-10-10T22:18:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2dedd9d700 1 -- 172.21.15.154:0/1207246917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 msgr2=0x7f2dd8004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.857+0000 7f2dedd9d700 1 --2- 172.21.15.154:0/1207246917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2dd8004f80 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00c3c0 tx=0x7f2ddc001e90 comp rx=0 tx=0).stop 2023-10-10T22:18:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.858+0000 7f2ded59c700 1 -- 172.21.15.154:0/1207246917 reap_dead start 2023-10-10T22:18:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.858+0000 7f2dedd9d700 1 -- 172.21.15.154:0/1207246917 shutdown_connections 2023-10-10T22:18:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.858+0000 7f2dedd9d700 1 -- 172.21.15.154:0/1207246917 >> 172.21.15.154:0/1207246917 conn(0x7f2de80cc1f0 msgr2=0x7f2de80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.858+0000 7f2dedd9d700 1 -- 172.21.15.154:0/1207246917 shutdown_connections 2023-10-10T22:18:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.858+0000 7f2dedd9d700 1 -- 172.21.15.154:0/1207246917 wait complete. 2023-10-10T22:18:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.859+0000 7f2dedd9d700 1 Processor -- start 2023-10-10T22:18:36.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.859+0000 7f2dedd9d700 1 -- start start 2023-10-10T22:18:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.860+0000 7f2dedd9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2de81697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.860+0000 7f2dedd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80af340 0x7f2de8149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.860+0000 7f2dedd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de814aac0 0x7f2de814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.860+0000 7f2dedd9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de8169cf0 con 0x7f2dd8004b70 2023-10-10T22:18:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.860+0000 7f2dedd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de814b450 con 0x7f2de814aac0 2023-10-10T22:18:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.860+0000 7f2dedd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80b1ba0 con 0x7f2de80af340 2023-10-10T22:18:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.860+0000 7f2decd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2de81697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.860+0000 7f2decd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2de81697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43098/0 (socket says 172.21.15.154:43098) 2023-10-10T22:18:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.860+0000 7f2decd9b700 1 -- 172.21.15.154:0/2432438233 learned_addr learned my addr 172.21.15.154:0/2432438233 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2ded59c700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de814aac0 0x7f2de814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2de7fff700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80af340 0x7f2de8149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2decd9b700 1 -- 172.21.15.154:0/2432438233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80af340 msgr2=0x7f2de8149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2decd9b700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80af340 0x7f2de8149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2decd9b700 1 -- 172.21.15.154:0/2432438233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de814aac0 msgr2=0x7f2de814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2decd9b700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de814aac0 0x7f2de814af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2decd9b700 1 -- 172.21.15.154:0/2432438233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80af7b0 con 0x7f2dd8004b70 2023-10-10T22:18:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2ded59c700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de814aac0 0x7f2de814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:18:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2decd9b700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2de81697b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8005840 tx=0x7f2ddc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2de4ff9700 1 -- 172.21.15.154:0/2432438233 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00cc30 con 0x7f2dd8004b70 2023-10-10T22:18:36.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2de4ff9700 1 -- 172.21.15.154:0/2432438233 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00c9e0 con 0x7f2dd8004b70 2023-10-10T22:18:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de80afa90 con 0x7f2dd8004b70 2023-10-10T22:18:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.861+0000 7f2de4ff9700 1 -- 172.21.15.154:0/2432438233 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0074f0 con 0x7f2dd8004b70 2023-10-10T22:18:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.862+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de80b0050 con 0x7f2dd8004b70 2023-10-10T22:18:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.862+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de804c3c0 con 0x7f2dd8004b70 2023-10-10T22:18:36.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.863+0000 7f2de4ff9700 1 -- 172.21.15.154:0/2432438233 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ddc019030 con 0x7f2dd8004b70 2023-10-10T22:18:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.864+0000 7f2de4ff9700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2dcc066f30 0x7f2dcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.864+0000 7f2de4ff9700 1 -- 172.21.15.154:0/2432438233 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2ddc085a00 con 0x7f2dd8004b70 2023-10-10T22:18:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.864+0000 7f2de7fff700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2dcc066f30 0x7f2dcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.865+0000 7f2de7fff700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2dcc066f30 0x7f2dcc0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4006f00 tx=0x7f2dd4008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:36.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:36.869+0000 7f2de4ff9700 1 -- 172.21.15.154:0/2432438233 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ddc052a00 con 0x7f2dd8004b70 2023-10-10T22:18:37.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.092+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2de8169cf0 con 0x7f2dcc066f30 2023-10-10T22:18:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.093+0000 7f2de4ff9700 1 -- 172.21.15.154:0/2432438233 <== mgr.8940 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2de8169cf0 con 0x7f2dcc066f30 2023-10-10T22:18:37.095 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T22:18:37.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:18:37.096 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T22:18:37.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:18:37.096 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T22:18:37.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2dcc066f30 msgr2=0x7f2dcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2dcc066f30 0x7f2dcc0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4006f00 tx=0x7f2dd4008040 comp rx=0 tx=0).stop 2023-10-10T22:18:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 msgr2=0x7f2de81697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2de81697b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8005840 tx=0x7f2ddc015000 comp rx=0 tx=0).stop 2023-10-10T22:18:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 shutdown_connections 2023-10-10T22:18:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de814aac0 0x7f2de814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f2dcc066f30 0x7f2dcc0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd8004b70 0x7f2de81697b0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 --2- 172.21.15.154:0/2432438233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de80af340 0x7f2de8149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 >> 172.21.15.154:0/2432438233 conn(0x7f2de80cc1f0 msgr2=0x7f2de80c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 shutdown_connections 2023-10-10T22:18:37.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.096+0000 7f2dedd9d700 1 -- 172.21.15.154:0/2432438233 wait complete. 2023-10-10T22:18:37.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T22:18:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.298+0000 7f71fe19d700 1 Processor -- start 2023-10-10T22:18:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.298+0000 7f71fe19d700 1 -- start start 2023-10-10T22:18:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.299+0000 7f71fe19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 0x7f71f806a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.299+0000 7f71fe19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f71f8157130 0x7f71f806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.299+0000 7f71fe19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f806e150 con 0x7f71f8153900 2023-10-10T22:18:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.299+0000 7f71fe19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f80c7610 con 0x7f71f8157130 2023-10-10T22:18:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.299+0000 7f71fe19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80c7800 con 0x7f71f80c9db0 2023-10-10T22:18:37.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71fc99a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 0x7f71f806a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:37.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71fd19b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f71f8153900 0x7f71f80c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:48854/0 (socket says 172.21.15.154:48854) 2023-10-10T22:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71fd99c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f71f8157130 0x7f71f806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71fd19b700 1 -- 172.21.15.154:0/359280653 learned_addr learned my addr 172.21.15.154:0/359280653 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71effff700 1 -- 172.21.15.154:0/359280653 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329414057 0 0) 0x7f71f806e150 con 0x7f71f8153900 2023-10-10T22:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71effff700 1 -- 172.21.15.154:0/359280653 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e4003570 con 0x7f71f8153900 2023-10-10T22:18:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71fc99a700 1 -- 172.21.15.154:0/359280653 >> v2:172.21.15.179:3300/0 conn(0x7f71f8157130 msgr2=0x7f71f806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71fc99a700 1 --2- 172.21.15.154:0/359280653 >> v2:172.21.15.179:3300/0 conn(0x7f71f8157130 0x7f71f806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71fc99a700 1 -- 172.21.15.154:0/359280653 >> v1:172.21.15.179:6789/0 conn(0x7f71f8153900 legacy=0x7f71f80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71fc99a700 1 -- 172.21.15.154:0/359280653 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80c7ae0 con 0x7f71f80c9db0 2023-10-10T22:18:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.300+0000 7f71fd99c700 1 --2- 172.21.15.154:0/359280653 >> v2:172.21.15.179:3300/0 conn(0x7f71f8157130 0x7f71f806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.301+0000 7f71fc99a700 1 --2- 172.21.15.154:0/359280653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 0x7f71f806a000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f71e80098e0 tx=0x7f71e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c14afd9d3f91a20 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.301+0000 7f71effff700 1 -- 172.21.15.154:0/359280653 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8010600 con 0x7f71f80c9db0 2023-10-10T22:18:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.301+0000 7f71effff700 1 -- 172.21.15.154:0/359280653 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8010760 con 0x7f71f80c9db0 2023-10-10T22:18:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.301+0000 7f71effff700 1 -- 172.21.15.154:0/359280653 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8010b00 con 0x7f71f80c9db0 2023-10-10T22:18:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.301+0000 7f71fe19d700 1 -- 172.21.15.154:0/359280653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 msgr2=0x7f71f806a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.301+0000 7f71fe19d700 1 --2- 172.21.15.154:0/359280653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 0x7f71f806a000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f71e80098e0 tx=0x7f71e80091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.301+0000 7f71fe19d700 1 -- 172.21.15.154:0/359280653 shutdown_connections 2023-10-10T22:18:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.302+0000 7f71fe19d700 1 --2- 172.21.15.154:0/359280653 >> v2:172.21.15.179:3300/0 conn(0x7f71f8157130 0x7f71f806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.302+0000 7f71fe19d700 1 --2- 172.21.15.154:0/359280653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 0x7f71f806a000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.302+0000 7f71fe19d700 1 -- 172.21.15.154:0/359280653 >> 172.21.15.154:0/359280653 conn(0x7f71f80cc1e0 msgr2=0x7f71f80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.302+0000 7f71fe19d700 1 -- 172.21.15.154:0/359280653 shutdown_connections 2023-10-10T22:18:37.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.302+0000 7f71fe19d700 1 -- 172.21.15.154:0/359280653 wait complete. 2023-10-10T22:18:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.303+0000 7f71fe19d700 1 Processor -- start 2023-10-10T22:18:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.303+0000 7f71fe19d700 1 -- start start 2023-10-10T22:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.304+0000 7f71fe19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 0x7f71f80af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.304+0000 7f71fe19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71f8153900 0x7f71f80b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.304+0000 7f71fe19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8157130 0x7f71f8151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.304+0000 7f71fe19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80c4bf0 con 0x7f71f8157130 2023-10-10T22:18:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.304+0000 7f71fe19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80b1fe0 con 0x7f71f8153900 2023-10-10T22:18:37.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.304+0000 7f71fe19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80aff50 con 0x7f71f80c9db0 2023-10-10T22:18:37.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.304+0000 7f71fd99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8157130 0x7f71f8151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:37.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.304+0000 7f71fd99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8157130 0x7f71f8151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43100/0 (socket says 172.21.15.154:43100) 2023-10-10T22:18:37.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.304+0000 7f71fd99c700 1 -- 172.21.15.154:0/1627463533 learned_addr learned my addr 172.21.15.154:0/1627463533 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:37.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fc99a700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71f8153900 0x7f71f80b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fd19b700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 0x7f71f80af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fd99c700 1 -- 172.21.15.154:0/1627463533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 msgr2=0x7f71f80af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fd99c700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 0x7f71f80af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fd99c700 1 -- 172.21.15.154:0/1627463533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71f8153900 msgr2=0x7f71f80b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fd99c700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71f8153900 0x7f71f80b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fd99c700 1 -- 172.21.15.154:0/1627463533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0009a20 con 0x7f71f8157130 2023-10-10T22:18:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fd99c700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8157130 0x7f71f8151110 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009f20 tx=0x7f71f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71ed7fa700 1 -- 172.21.15.154:0/1627463533 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f000cbd0 con 0x7f71f8157130 2023-10-10T22:18:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71ed7fa700 1 -- 172.21.15.154:0/1627463533 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f000f040 con 0x7f71f8157130 2023-10-10T22:18:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71ed7fa700 1 -- 172.21.15.154:0/1627463533 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0014480 con 0x7f71f8157130 2023-10-10T22:18:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e8009420 con 0x7f71f8157130 2023-10-10T22:18:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.305+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f80b0510 con 0x7f71f8157130 2023-10-10T22:18:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.307+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f80c49c0 con 0x7f71f8157130 2023-10-10T22:18:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.307+0000 7f71ed7fa700 1 -- 172.21.15.154:0/1627463533 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 82) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71f0003020 con 0x7f71f8157130 2023-10-10T22:18:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.308+0000 7f71ed7fa700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f71dc066f30 0x7f71dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.308+0000 7f71ed7fa700 1 -- 172.21.15.154:0/1627463533 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f71f0085020 con 0x7f71f8157130 2023-10-10T22:18:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.308+0000 7f71fd19b700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f71dc066f30 0x7f71dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.309+0000 7f71fd19b700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f71dc066f30 0x7f71dc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71f40058d0 tx=0x7f71f4009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.312+0000 7f71ed7fa700 1 -- 172.21.15.154:0/1627463533 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71f80c49c0 con 0x7f71f8157130 2023-10-10T22:18:37.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:37.560+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f71f80c49c0 con 0x7f71f8157130 2023-10-10T22:18:38.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.070+0000 7f71ed7fa700 1 -- 172.21.15.154:0/1627463533 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 83) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f71f0052490 con 0x7f71f8157130 2023-10-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.071+0000 7f71ed7fa700 1 -- 172.21.15.154:0/1627463533 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v83) v1 ==== 92+0+0 (secure 0 0 0) 0x7f71f00558c0 con 0x7f71f8157130 2023-10-10T22:18:38.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f71dc066f30 msgr2=0x7f71dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f71dc066f30 0x7f71dc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71f40058d0 tx=0x7f71f4009040 comp rx=0 tx=0).stop 2023-10-10T22:18:38.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8157130 msgr2=0x7f71f8151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8157130 0x7f71f8151110 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009f20 tx=0x7f71f000b040 comp rx=0 tx=0).stop 2023-10-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 shutdown_connections 2023-10-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f71dc066f30 0x7f71dc0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8157130 0x7f71f8151110 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71f80c9db0 0x7f71f80af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 --2- 172.21.15.154:0/1627463533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71f8153900 0x7f71f80b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 >> 172.21.15.154:0/1627463533 conn(0x7f71f80cc1e0 msgr2=0x7f71f80c1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 shutdown_connections 2023-10-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.074+0000 7f71fe19d700 1 -- 172.21.15.154:0/1627463533 wait complete. 2023-10-10T22:18:38.104 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T22:18:38.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.295+0000 7f7497fff700 1 Processor -- start 2023-10-10T22:18:38.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.295+0000 7f7497fff700 1 -- start start 2023-10-10T22:18:38.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.296+0000 7f7497fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7490159c60 0x7f749015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.296+0000 7f7497fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f749015db10 0x7f7490069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f7497fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749015a160 con 0x7f7490159890 2023-10-10T22:18:38.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f7497fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749015df50 con 0x7f749015db10 2023-10-10T22:18:38.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f7497fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74900d13a0 con 0x7f7490159c60 2023-10-10T22:18:38.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f749659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f749015db10 0x7f7490069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f749659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f749015db10 0x7f7490069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43122/0 (socket says 172.21.15.154:43122) 2023-10-10T22:18:38.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f749659c700 1 -- 172.21.15.154:0/1485321930 learned_addr learned my addr 172.21.15.154:0/1485321930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:38.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f749559a700 1 --2- 172.21.15.154:0/1485321930 >> v2:172.21.15.179:3300/0 conn(0x7f7490159c60 0x7f749015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f749659c700 1 -- 172.21.15.154:0/1485321930 >> v2:172.21.15.179:3300/0 conn(0x7f7490159c60 msgr2=0x7f749015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:38.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f749659c700 1 --2- 172.21.15.154:0/1485321930 >> v2:172.21.15.179:3300/0 conn(0x7f7490159c60 0x7f749015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f749659c700 1 -- 172.21.15.154:0/1485321930 >> v1:172.21.15.179:6789/0 conn(0x7f7490159890 legacy=0x7f749015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.297+0000 7f749659c700 1 -- 172.21.15.154:0/1485321930 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749015e140 con 0x7f749015db10 2023-10-10T22:18:38.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.298+0000 7f749659c700 1 --2- 172.21.15.154:0/1485321930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749015db10 0x7f7490069560 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f74900b67f0 tx=0x7f7488009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ebfa1d0133ce9b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.298+0000 7f7494d99700 1 -- 172.21.15.154:0/1485321930 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748800e070 con 0x7f749015db10 2023-10-10T22:18:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.298+0000 7f7494d99700 1 -- 172.21.15.154:0/1485321930 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748800ba20 con 0x7f749015db10 2023-10-10T22:18:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.298+0000 7f7494d99700 1 -- 172.21.15.154:0/1485321930 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74880092e0 con 0x7f749015db10 2023-10-10T22:18:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.298+0000 7f7497fff700 1 -- 172.21.15.154:0/1485321930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749015db10 msgr2=0x7f7490069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.298+0000 7f7497fff700 1 --2- 172.21.15.154:0/1485321930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749015db10 0x7f7490069560 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f74900b67f0 tx=0x7f7488009840 comp rx=0 tx=0).stop 2023-10-10T22:18:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.299+0000 7f7497fff700 1 -- 172.21.15.154:0/1485321930 shutdown_connections 2023-10-10T22:18:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.299+0000 7f7497fff700 1 --2- 172.21.15.154:0/1485321930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749015db10 0x7f7490069560 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.299+0000 7f7497fff700 1 --2- 172.21.15.154:0/1485321930 >> v2:172.21.15.179:3300/0 conn(0x7f7490159c60 0x7f749015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.299+0000 7f7497fff700 1 -- 172.21.15.154:0/1485321930 >> 172.21.15.154:0/1485321930 conn(0x7f7490068e20 msgr2=0x7f74900d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.299+0000 7f7497fff700 1 -- 172.21.15.154:0/1485321930 shutdown_connections 2023-10-10T22:18:38.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.299+0000 7f7497fff700 1 -- 172.21.15.154:0/1485321930 wait complete. 2023-10-10T22:18:38.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.300+0000 7f7497fff700 1 Processor -- start 2023-10-10T22:18:38.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.300+0000 7f7497fff700 1 -- start start 2023-10-10T22:18:38.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.301+0000 7f7497fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490159890 0x7f74900cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.301+0000 7f7497fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7490159c60 0x7f749015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.301+0000 7f7497fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749015db10 0x7f749015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.301+0000 7f7497fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900c64f0 con 0x7f7490159890 2023-10-10T22:18:38.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.301+0000 7f7497fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900cd600 con 0x7f7490159c60 2023-10-10T22:18:38.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.301+0000 7f7497fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74900c5730 con 0x7f749015db10 2023-10-10T22:18:38.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7495d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490159890 0x7f74900cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f749559a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7490159c60 0x7f749015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7495d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490159890 0x7f74900cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43124/0 (socket says 172.21.15.154:43124) 2023-10-10T22:18:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7495d9b700 1 -- 172.21.15.154:0/1536545347 learned_addr learned my addr 172.21.15.154:0/1536545347 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f749659c700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749015db10 0x7f749015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7495d9b700 1 -- 172.21.15.154:0/1536545347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749015db10 msgr2=0x7f749015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7495d9b700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749015db10 0x7f749015fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7495d9b700 1 -- 172.21.15.154:0/1536545347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7490159c60 msgr2=0x7f749015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7495d9b700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7490159c60 0x7f749015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7495d9b700 1 -- 172.21.15.154:0/1536545347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488009ae0 con 0x7f7490159890 2023-10-10T22:18:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f749659c700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749015db10 0x7f749015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7495d9b700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490159890 0x7f74900cd0c0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f748c00c590 tx=0x7f748c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.302+0000 7f7485ffb700 1 -- 172.21.15.154:0/1536545347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c011590 con 0x7f7490159890 2023-10-10T22:18:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.303+0000 7f7485ffb700 1 -- 172.21.15.154:0/1536545347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c011710 con 0x7f7490159890 2023-10-10T22:18:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.303+0000 7f7485ffb700 1 -- 172.21.15.154:0/1536545347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c011ad0 con 0x7f7490159890 2023-10-10T22:18:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.303+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74900c5a10 con 0x7f7490159890 2023-10-10T22:18:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.303+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74900c5fd0 con 0x7f7490159890 2023-10-10T22:18:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.304+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749004c3c0 con 0x7f7490159890 2023-10-10T22:18:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.305+0000 7f7485ffb700 1 -- 172.21.15.154:0/1536545347 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 83) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f748c01b3b0 con 0x7f7490159890 2023-10-10T22:18:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.305+0000 7f7485ffb700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7474066f80 0x7f7474069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.306+0000 7f7485ffb700 1 -- 172.21.15.154:0/1536545347 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f748c083cc0 con 0x7f7490159890 2023-10-10T22:18:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.306+0000 7f749559a700 1 -- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7474066f80 msgr2=0x7f7474069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.306+0000 7f749559a700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7474066f80 0x7f7474069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.310+0000 7f7485ffb700 1 -- 172.21.15.154:0/1536545347 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f748c08a080 con 0x7f7490159890 2023-10-10T22:18:38.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.507+0000 7f749559a700 1 -- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7474066f80 msgr2=0x7f7474069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:38.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.507+0000 7f749559a700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7474066f80 0x7f7474069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.511+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f749006a5b0 con 0x7f7490159890 2023-10-10T22:18:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.515+0000 7f7485ffb700 1 -- 172.21.15.154:0/1536545347 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f748c017070 con 0x7f7490159890 2023-10-10T22:18:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7474066f80 msgr2=0x7f7474069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7474066f80 0x7f7474069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490159890 msgr2=0x7f74900cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490159890 0x7f74900cd0c0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f748c00c590 tx=0x7f748c00c8a0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 shutdown_connections 2023-10-10T22:18:38.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749015db10 0x7f749015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f7474066f80 0x7f7474069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490159890 0x7f74900cd0c0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 --2- 172.21.15.154:0/1536545347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7490159c60 0x7f749015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 >> 172.21.15.154:0/1536545347 conn(0x7f7490068e20 msgr2=0x7f7490154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:38.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 shutdown_connections 2023-10-10T22:18:38.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.518+0000 7f7497fff700 1 -- 172.21.15.154:0/1536545347 wait complete. 2023-10-10T22:18:38.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T22:18:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.729+0000 7fa33999d700 1 Processor -- start 2023-10-10T22:18:38.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.729+0000 7fa33999d700 1 -- start start 2023-10-10T22:18:38.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.730+0000 7fa33999d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa334159a60 0x7fa3340c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.730+0000 7fa33999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340cb230 0x7fa3340cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.730+0000 7fa33999d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3340c9cb0 con 0x7fa3340ccc00 2023-10-10T22:18:38.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.730+0000 7fa33999d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3340cbbd0 con 0x7fa334159a60 2023-10-10T22:18:38.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.730+0000 7fa33999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33406dfc0 con 0x7fa3340cb230 2023-10-10T22:18:38.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.731+0000 7fa33919c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340cb230 0x7fa3340cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.731+0000 7fa33899b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa334159a60 0x7fa3340c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.731+0000 7fa33919c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340cb230 0x7fa3340cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:57588/0 (socket says 172.21.15.154:57588) 2023-10-10T22:18:38.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.731+0000 7fa33919c700 1 -- 172.21.15.154:0/3688958973 learned_addr learned my addr 172.21.15.154:0/3688958973 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:38.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.731+0000 7fa33919c700 1 -- 172.21.15.154:0/3688958973 >> v2:172.21.15.179:3300/0 conn(0x7fa334159a60 msgr2=0x7fa3340c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:38.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.731+0000 7fa33919c700 1 --2- 172.21.15.154:0/3688958973 >> v2:172.21.15.179:3300/0 conn(0x7fa334159a60 0x7fa3340c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.731+0000 7fa33919c700 1 -- 172.21.15.154:0/3688958973 >> v1:172.21.15.179:6789/0 conn(0x7fa3340ccc00 legacy=0x7fa334069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.731+0000 7fa33919c700 1 -- 172.21.15.154:0/3688958973 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3340c9f30 con 0x7fa3340cb230 2023-10-10T22:18:38.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.731+0000 7fa33919c700 1 --2- 172.21.15.154:0/3688958973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340cb230 0x7fa3340cb690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009f20 tx=0x7fa32c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3128f7eaacb55f02 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:38.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa3337fe700 1 -- 172.21.15.154:0/3688958973 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00e070 con 0x7fa3340cb230 2023-10-10T22:18:38.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa3337fe700 1 -- 172.21.15.154:0/3688958973 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c00ba60 con 0x7fa3340cb230 2023-10-10T22:18:38.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa3337fe700 1 -- 172.21.15.154:0/3688958973 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0092e0 con 0x7fa3340cb230 2023-10-10T22:18:38.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa33999d700 1 -- 172.21.15.154:0/3688958973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340cb230 msgr2=0x7fa3340cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa33999d700 1 --2- 172.21.15.154:0/3688958973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340cb230 0x7fa3340cb690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009f20 tx=0x7fa32c009840 comp rx=0 tx=0).stop 2023-10-10T22:18:38.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa33999d700 1 -- 172.21.15.154:0/3688958973 shutdown_connections 2023-10-10T22:18:38.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa33999d700 1 --2- 172.21.15.154:0/3688958973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340cb230 0x7fa3340cb690 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa33999d700 1 --2- 172.21.15.154:0/3688958973 >> v2:172.21.15.179:3300/0 conn(0x7fa334159a60 0x7fa3340c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa33999d700 1 -- 172.21.15.154:0/3688958973 >> 172.21.15.154:0/3688958973 conn(0x7fa33406baa0 msgr2=0x7fa33406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:38.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.732+0000 7fa33999d700 1 -- 172.21.15.154:0/3688958973 shutdown_connections 2023-10-10T22:18:38.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.733+0000 7fa33999d700 1 -- 172.21.15.154:0/3688958973 wait complete. 2023-10-10T22:18:38.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.734+0000 7fa33999d700 1 Processor -- start 2023-10-10T22:18:38.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.734+0000 7fa33999d700 1 -- start start 2023-10-10T22:18:38.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.735+0000 7fa33999d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3340cb230 0x7fa33416a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.735+0000 7fa33999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340ccc00 0x7fa3341533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.735+0000 7fa33999d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334159a60 0x7fa33415e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.735+0000 7fa33999d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33415f100 con 0x7fa334159a60 2023-10-10T22:18:38.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.735+0000 7fa33999d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33415f3e0 con 0x7fa3340cb230 2023-10-10T22:18:38.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.735+0000 7fa33999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33415f6c0 con 0x7fa3340ccc00 2023-10-10T22:18:38.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334159a60 0x7fa33415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334159a60 0x7fa33415e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43128/0 (socket says 172.21.15.154:43128) 2023-10-10T22:18:38.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33919c700 1 -- 172.21.15.154:0/195652767 learned_addr learned my addr 172.21.15.154:0/195652767 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:38.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33899b700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3340cb230 0x7fa33416a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa333fff700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340ccc00 0x7fa3341533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:38.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33919c700 1 -- 172.21.15.154:0/195652767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340ccc00 msgr2=0x7fa3341533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33919c700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340ccc00 0x7fa3341533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33919c700 1 -- 172.21.15.154:0/195652767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3340cb230 msgr2=0x7fa33416a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33919c700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3340cb230 0x7fa33416a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33919c700 1 -- 172.21.15.154:0/195652767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c009ae0 con 0x7fa334159a60 2023-10-10T22:18:38.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.736+0000 7fa33919c700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334159a60 0x7fa33415e890 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00b610 tx=0x7fa32c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:38.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.737+0000 7fa330ff9700 1 -- 172.21.15.154:0/195652767 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0032f0 con 0x7fa334159a60 2023-10-10T22:18:38.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.737+0000 7fa330ff9700 1 -- 172.21.15.154:0/195652767 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c008d90 con 0x7fa334159a60 2023-10-10T22:18:38.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.737+0000 7fa330ff9700 1 -- 172.21.15.154:0/195652767 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0266b0 con 0x7fa334159a60 2023-10-10T22:18:38.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.737+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33415f9a0 con 0x7fa334159a60 2023-10-10T22:18:38.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.737+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33415edd0 con 0x7fa334159a60 2023-10-10T22:18:38.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.738+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3340b14c0 con 0x7fa334159a60 2023-10-10T22:18:38.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.739+0000 7fa330ff9700 1 -- 172.21.15.154:0/195652767 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 83) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fa32c003040 con 0x7fa334159a60 2023-10-10T22:18:38.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.740+0000 7fa330ff9700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa318066f80 0x7fa318069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:38.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.740+0000 7fa330ff9700 1 -- 172.21.15.154:0/195652767 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fa32c086410 con 0x7fa334159a60 2023-10-10T22:18:38.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.740+0000 7fa33899b700 1 -- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa318066f80 msgr2=0x7fa318069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:38.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.740+0000 7fa33899b700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa318066f80 0x7fa318069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:38.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.744+0000 7fa330ff9700 1 -- 172.21.15.154:0/195652767 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3340b14c0 con 0x7fa334159a60 2023-10-10T22:18:38.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:18:38.913 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:18:38.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.941+0000 7fa33899b700 1 -- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa318066f80 msgr2=0x7fa318069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:38.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.941+0000 7fa33899b700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa318066f80 0x7fa318069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:38.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.943+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fa3340b14c0 con 0x7fa334159a60 2023-10-10T22:18:38.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.947+0000 7fa330ff9700 1 -- 172.21.15.154:0/195652767 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa3340b14c0 con 0x7fa334159a60 2023-10-10T22:18:38.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa318066f80 msgr2=0x7fa318069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:38.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa318066f80 0x7fa318069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334159a60 msgr2=0x7fa33415e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:38.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334159a60 0x7fa33415e890 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00b610 tx=0x7fa32c018000 comp rx=0 tx=0).stop 2023-10-10T22:18:38.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 shutdown_connections 2023-10-10T22:18:38.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fa318066f80 0x7fa318069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334159a60 0x7fa33415e890 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3340cb230 0x7fa33416a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 --2- 172.21.15.154:0/195652767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3340ccc00 0x7fa3341533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:38.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 >> 172.21.15.154:0/195652767 conn(0x7fa33406baa0 msgr2=0x7fa334158c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:38.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 shutdown_connections 2023-10-10T22:18:38.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:38.950+0000 7fa33999d700 1 -- 172.21.15.154:0/195652767 wait complete. 2023-10-10T22:18:38.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:18:38.971 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-10T22:18:39.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:18:39.089 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-10-10T22:18:39.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-10T22:18:39.363 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:39.361+0000 7fdefd7a6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:18:39.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.400+0000 7f18d539d700 1 Processor -- start 2023-10-10T22:18:39.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.400+0000 7f18d539d700 1 -- start start 2023-10-10T22:18:39.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.401+0000 7f18d539d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18d0156350 0x7f18d0157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:39.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.401+0000 7f18d539d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18d00b0760 0x7f18d00b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:39.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.401+0000 7f18d539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 0x7f18d015a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:39.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.401+0000 7f18d539d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d00b1140 con 0x7f18d00b0760 2023-10-10T22:18:39.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.401+0000 7f18d539d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d00b0570 con 0x7f18d0156350 2023-10-10T22:18:39.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.401+0000 7f18d539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d01578b0 con 0x7f18d0159f20 2023-10-10T22:18:39.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18cf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18d00b0760 0x7f18d00b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:39.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18d4b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 0x7f18d015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:39.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18cffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18d0156350 0x7f18d0157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:39.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18cf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18d00b0760 0x7f18d00b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43142/0 (socket says 172.21.15.154:43142) 2023-10-10T22:18:39.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18cf7fe700 1 -- 172.21.15.154:0/2382115548 learned_addr learned my addr 172.21.15.154:0/2382115548 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18cffff700 1 -- 172.21.15.154:0/2382115548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 msgr2=0x7f18d015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18cffff700 1 --2- 172.21.15.154:0/2382115548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 0x7f18d015a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:39.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18cffff700 1 -- 172.21.15.154:0/2382115548 >> v2:172.21.15.154:3300/0 conn(0x7f18d00b0760 msgr2=0x7f18d00b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:39.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18cffff700 1 --2- 172.21.15.154:0/2382115548 >> v2:172.21.15.154:3300/0 conn(0x7f18d00b0760 0x7f18d00b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:39.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.402+0000 7f18cffff700 1 -- 172.21.15.154:0/2382115548 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00af4d0 con 0x7f18d0156350 2023-10-10T22:18:39.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.403+0000 7f18cffff700 1 --2- 172.21.15.154:0/2382115548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 0x7f18d0157370 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f18d0065950 tx=0x7f18c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9de324225f2886f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:39.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.403+0000 7f18ceffd700 1 -- 172.21.15.154:0/2382115548 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0011630 con 0x7f18d0156350 2023-10-10T22:18:39.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.403+0000 7f18ceffd700 1 -- 172.21.15.154:0/2382115548 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c00117b0 con 0x7f18d0156350 2023-10-10T22:18:39.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.403+0000 7f18ceffd700 1 -- 172.21.15.154:0/2382115548 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0011b70 con 0x7f18d0156350 2023-10-10T22:18:39.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.403+0000 7f18d539d700 1 -- 172.21.15.154:0/2382115548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 msgr2=0x7f18d0157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:39.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.403+0000 7f18d539d700 1 --2- 172.21.15.154:0/2382115548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 0x7f18d0157370 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f18d0065950 tx=0x7f18c00091a0 comp rx=0 tx=0).stop 2023-10-10T22:18:39.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.404+0000 7f18d539d700 1 -- 172.21.15.154:0/2382115548 shutdown_connections 2023-10-10T22:18:39.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.404+0000 7f18d539d700 1 --2- 172.21.15.154:0/2382115548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 0x7f18d015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:39.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.404+0000 7f18d539d700 1 --2- 172.21.15.154:0/2382115548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 0x7f18d0157370 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:39.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.404+0000 7f18d539d700 1 --2- 172.21.15.154:0/2382115548 >> v2:172.21.15.154:3300/0 conn(0x7f18d00b0760 0x7f18d00b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:39.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.404+0000 7f18d539d700 1 -- 172.21.15.154:0/2382115548 >> 172.21.15.154:0/2382115548 conn(0x7f18d0068e20 msgr2=0x7f18d00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:39.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.404+0000 7f18d539d700 1 -- 172.21.15.154:0/2382115548 shutdown_connections 2023-10-10T22:18:39.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.404+0000 7f18d539d700 1 -- 172.21.15.154:0/2382115548 wait complete. 2023-10-10T22:18:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.405+0000 7f18d539d700 1 Processor -- start 2023-10-10T22:18:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.405+0000 7f18d539d700 1 -- start start 2023-10-10T22:18:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.406+0000 7f18d539d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18d00b0760 0x7f18d00ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.406+0000 7f18d539d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 0x7f18d014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.406+0000 7f18d539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 0x7f18d014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.406+0000 7f18d539d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d0153510 con 0x7f18d00b0760 2023-10-10T22:18:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.406+0000 7f18d539d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00cb760 con 0x7f18d0156350 2023-10-10T22:18:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.406+0000 7f18d539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00cab50 con 0x7f18d0159f20 2023-10-10T22:18:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.406+0000 7f18cffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18d00b0760 0x7f18d00ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18cffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18d00b0760 0x7f18d00ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43144/0 (socket says 172.21.15.154:43144) 2023-10-10T22:18:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18cffff700 1 -- 172.21.15.154:0/1901644395 learned_addr learned my addr 172.21.15.154:0/1901644395 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18cf7fe700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 0x7f18d014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18d4b9c700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 0x7f18d014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18d4b9c700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 msgr2=0x7f18d014df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:39.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18d4b9c700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 0x7f18d014df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:39.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18d4b9c700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18d00b0760 msgr2=0x7f18d00ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:39.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18d4b9c700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18d00b0760 0x7f18d00ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:39.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18d4b9c700 1 -- 172.21.15.154:0/1901644395 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c0009420 con 0x7f18d0159f20 2023-10-10T22:18:39.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18cf7fe700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 0x7f18d014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:39.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18cffff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18d00b0760 0x7f18d00ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:18:39.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.407+0000 7f18d4b9c700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 0x7f18d014e470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f18c800ecc0 tx=0x7f18c800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:39.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.408+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800c8c0 con 0x7f18d0159f20 2023-10-10T22:18:39.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.408+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800f040 con 0x7f18d0159f20 2023-10-10T22:18:39.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.408+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d00cae30 con 0x7f18d0159f20 2023-10-10T22:18:39.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.408+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800cc90 con 0x7f18d0159f20 2023-10-10T22:18:39.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.408+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d00cb3f0 con 0x7f18d0159f20 2023-10-10T22:18:39.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.409+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d00cb910 con 0x7f18d0159f20 2023-10-10T22:18:39.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.410+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 83) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f18c8014690 con 0x7f18d0159f20 2023-10-10T22:18:39.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.410+0000 7f18b7fff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:39.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.410+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f18c80851d0 con 0x7f18d0159f20 2023-10-10T22:18:39.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.411+0000 7f18cffff700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 msgr2=0x7f18bc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:39.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.411+0000 7f18cffff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:18:39.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.414+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18d00cb910 con 0x7f18d0159f20 2023-10-10T22:18:39.432 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:39.431+0000 7f7172a8f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:18:39.528 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:39.526+0000 7fdefd7a6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:18:39.607 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:39.605+0000 7f7172a8f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:18:39.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.612+0000 7f18cffff700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 msgr2=0x7f18bc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:39.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.612+0000 7f18cffff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:18:39.614 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:39.612+0000 7fdefd7a6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:18:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:39.655+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f18d00cb8d0 con 0x7f18bc066f80 2023-10-10T22:18:39.695 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:39.693+0000 7f7172a8f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:18:39.838 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:39.837+0000 7fdefd7a6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:18:39.919 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:39.918+0000 7f7172a8f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:18:40.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:40.013+0000 7f18cffff700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 msgr2=0x7f18bc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:40.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:40.013+0000 7f18cffff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T22:18:40.016 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:40.015+0000 7fdefd7a6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:18:40.102 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:40.101+0000 7f7172a8f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:18:40.113 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:40.111+0000 7fdefd7a6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:18:40.194 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:40.193+0000 7f7172a8f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:18:40.276 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:40.274+0000 7fdefd7a6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:18:40.357 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:40.355+0000 7f7172a8f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:18:40.375 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:40.373+0000 7fdefd7a6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:18:40.457 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:40.455+0000 7f7172a8f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:18:40.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:40.814+0000 7f18cffff700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 msgr2=0x7f18bc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:40.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:40.814+0000 7f18cffff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T22:18:40.856 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:40.855+0000 7fdefd7a6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:18:40.944 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:40.943+0000 7f7172a8f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:18:40.949 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:40.948+0000 7fdefd7a6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:18:41.040 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:41.038+0000 7f7172a8f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:18:41.041 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:41.040+0000 7fdefd7a6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:18:41.131 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:41.129+0000 7f7172a8f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:18:41.663 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:41.661+0000 7fdefd7a6180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:18:41.756 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:41.755+0000 7f7172a8f180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:18:41.836 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:41.835+0000 7fdefd7a6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:18:41.930 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:41.928+0000 7f7172a8f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:18:41.957 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:41.931+0000 7fdefd7a6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:18:42.027 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:42.025+0000 7f7172a8f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:18:42.229 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:42.227+0000 7fdefd7a6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:18:42.323 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:42.321+0000 7f7172a8f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:18:42.325 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:42.323+0000 7fdefd7a6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:18:42.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:42.416+0000 7f18cffff700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 msgr2=0x7f18bc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/85496 2023-10-10T22:18:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:42.416+0000 7f18cffff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T22:18:42.419 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:42.418+0000 7f7172a8f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:18:43.026 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:43.024+0000 7fdefd7a6180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:18:43.125 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:43.124+0000 7f7172a8f180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:18:43.314 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:43.312+0000 7fdefd7a6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:18:43.408 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:43.406+0000 7fdefd7a6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:18:43.412 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:43.411+0000 7f7172a8f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:18:43.506 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:43.505+0000 7f7172a8f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:18:43.562 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:43.560+0000 7fdefd7a6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:18:43.660 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:43.658+0000 7f7172a8f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:18:43.665 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:43.663+0000 7fdefd7a6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:18:43.766 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:43.764+0000 7f7172a8f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:18:43.854 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:43.853+0000 7fdefd7a6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:18:43.946 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:43.944+0000 7fdefd7a6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:18:43.958 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:43.956+0000 7f7172a8f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:18:44.039 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:44.037+0000 7fdefd7a6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:18:44.052 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.050+0000 7f7172a8f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:18:44.134 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:18:44.132+0000 7fdefd7a6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:18:44.144 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.143+0000 7f7172a8f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:18:44.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:44.193+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mgrmap(e 84) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f18c80525a0 con 0x7f18d0159f20 2023-10-10T22:18:44.242 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.241+0000 7f7172a8f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:18:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:44.252+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mgrmap(e 85) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f18c8024300 con 0x7f18d0159f20 2023-10-10T22:18:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:44.252+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 msgr2=0x7f18bc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:18:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:44.252+0000 7f18b7fff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:44.374 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e4df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:44.374 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e4df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:44.374 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e4df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:44.374 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e4df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:44.375 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e4df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:44.375 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e7df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:44.375 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e7df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:44.375 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e7df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:44.375 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e7df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:44.376 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:18:44.371+0000 7f70e7df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:18:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.258+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mon.2 v2:172.21.15.179:3301/0 9 ==== mgrmap(e 86) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f18c8052e70 con 0x7f18d0159f20 2023-10-10T22:18:45.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.258+0000 7f18b7fff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:45.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.258+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f18d00cb8d0 con 0x7f18bc066f80 2023-10-10T22:18:45.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.260+0000 7f18cffff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:45.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.264+0000 7f18cffff700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc0693b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18c00093c0 tx=0x7f18c0017000 comp rx=0 tx=0).ready entity=mgr.9339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.325+0000 7f18b7fff700 1 -- 172.21.15.154:0/1901644395 <== mgr.9339 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f18d00cb8d0 con 0x7f18bc066f80 2023-10-10T22:18:45.327 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-10-10T22:18:45.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.327+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 msgr2=0x7f18bc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:45.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.327+0000 7f18d539d700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc0693b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18c00093c0 tx=0x7f18c0017000 comp rx=0 tx=0).stop 2023-10-10T22:18:45.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.327+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 msgr2=0x7f18d014e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:45.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.327+0000 7f18d539d700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 0x7f18d014e470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f18c800ecc0 tx=0x7f18c800b040 comp rx=0 tx=0).stop 2023-10-10T22:18:45.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.328+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 shutdown_connections 2023-10-10T22:18:45.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.328+0000 7f18d539d700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18d0159f20 0x7f18d014e470 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.328+0000 7f18d539d700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f18bc066f80 0x7f18bc0693b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.328+0000 7f18d539d700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18d00b0760 0x7f18d00ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.328+0000 7f18d539d700 1 --2- 172.21.15.154:0/1901644395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18d0156350 0x7f18d014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.328+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 >> 172.21.15.154:0/1901644395 conn(0x7f18d0068e20 msgr2=0x7f18d00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:45.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.328+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 shutdown_connections 2023-10-10T22:18:45.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.328+0000 7f18d539d700 1 -- 172.21.15.154:0/1901644395 wait complete. 2023-10-10T22:18:45.347 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-10-10T22:18:45.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-10T22:18:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.534+0000 7fddc17ff700 1 Processor -- start 2023-10-10T22:18:45.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.534+0000 7fddc17ff700 1 -- start start 2023-10-10T22:18:45.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.535+0000 7fddc17ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddbc0c8490 0x7fddbc0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:45.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.535+0000 7fddc17ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fddbc15a490 0x7fddbc068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:45.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddc17ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddbc0ac030 con 0x7fddbc069a50 2023-10-10T22:18:45.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddc17ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddbc0ab820 con 0x7fddbc0c8490 2023-10-10T22:18:45.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddc17ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddbc06dbb0 con 0x7fddbc15a490 2023-10-10T22:18:45.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddbaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddbc0c8490 0x7fddbc0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:45.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddbaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddbc0c8490 0x7fddbc0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43280/0 (socket says 172.21.15.154:43280) 2023-10-10T22:18:45.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddbb7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fddbc069a50 0x7fddbc156ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43328/0 (socket says 172.21.15.154:43328) 2023-10-10T22:18:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddbaffd700 1 -- 172.21.15.154:0/2790229917 learned_addr learned my addr 172.21.15.154:0/2790229917 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddba7fc700 1 --2- 172.21.15.154:0/2790229917 >> v2:172.21.15.179:3300/0 conn(0x7fddbc15a490 0x7fddbc068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddbaffd700 1 -- 172.21.15.154:0/2790229917 >> v2:172.21.15.179:3300/0 conn(0x7fddbc15a490 msgr2=0x7fddbc068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:18:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddbaffd700 1 --2- 172.21.15.154:0/2790229917 >> v2:172.21.15.179:3300/0 conn(0x7fddbc15a490 0x7fddbc068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddbaffd700 1 -- 172.21.15.154:0/2790229917 >> v1:172.21.15.154:6789/0 conn(0x7fddbc069a50 legacy=0x7fddbc156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddbaffd700 1 -- 172.21.15.154:0/2790229917 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc0aba70 con 0x7fddbc0c8490 2023-10-10T22:18:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.536+0000 7fddb9ffb700 1 -- 172.21.15.154:0/2790229917 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847085148 0 0) 0x7fddb4001490 con 0x7fddbc069a50 2023-10-10T22:18:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddbaffd700 1 --2- 172.21.15.154:0/2790229917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc0c8490 0x7fddbc0c6ac0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fddbc06b920 tx=0x7fddac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ed17e0c7c3d4eb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:45.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddb9ffb700 1 -- 172.21.15.154:0/2790229917 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac00b860 con 0x7fddbc0c8490 2023-10-10T22:18:45.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddb9ffb700 1 -- 172.21.15.154:0/2790229917 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac00b9c0 con 0x7fddbc0c8490 2023-10-10T22:18:45.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddb9ffb700 1 -- 172.21.15.154:0/2790229917 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac00bd60 con 0x7fddbc0c8490 2023-10-10T22:18:45.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddc17ff700 1 -- 172.21.15.154:0/2790229917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc0c8490 msgr2=0x7fddbc0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:45.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddc17ff700 1 --2- 172.21.15.154:0/2790229917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc0c8490 0x7fddbc0c6ac0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fddbc06b920 tx=0x7fddac009250 comp rx=0 tx=0).stop 2023-10-10T22:18:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddc17ff700 1 -- 172.21.15.154:0/2790229917 shutdown_connections 2023-10-10T22:18:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddc17ff700 1 --2- 172.21.15.154:0/2790229917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc0c8490 0x7fddbc0c6ac0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddc17ff700 1 --2- 172.21.15.154:0/2790229917 >> v2:172.21.15.179:3300/0 conn(0x7fddbc15a490 0x7fddbc068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddc17ff700 1 -- 172.21.15.154:0/2790229917 >> 172.21.15.154:0/2790229917 conn(0x7fddbc0c8f90 msgr2=0x7fddbc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:45.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddc17ff700 1 -- 172.21.15.154:0/2790229917 shutdown_connections 2023-10-10T22:18:45.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.537+0000 7fddc17ff700 1 -- 172.21.15.154:0/2790229917 wait complete. 2023-10-10T22:18:45.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.539+0000 7fddc17ff700 1 Processor -- start 2023-10-10T22:18:45.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.539+0000 7fddc17ff700 1 -- start start 2023-10-10T22:18:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddc17ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc069a50 0x7fddbc154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddc17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0c8490 0x7fddbc0aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddc17ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc15a490 0x7fddbc0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:45.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddc17ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc154dd0 con 0x7fddbc15a490 2023-10-10T22:18:45.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddc17ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0b0990 con 0x7fddbc069a50 2023-10-10T22:18:45.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddc17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0a9d50 con 0x7fddbc0c8490 2023-10-10T22:18:45.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddbb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc15a490 0x7fddbc0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:45.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddbb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc15a490 0x7fddbc0ad370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43290/0 (socket says 172.21.15.154:43290) 2023-10-10T22:18:45.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2884759170 learned_addr learned my addr 172.21.15.154:0/2884759170 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:18:45.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddbaffd700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc069a50 0x7fddbc154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:45.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.540+0000 7fddba7fc700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0c8490 0x7fddbc0aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:45.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2884759170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0c8490 msgr2=0x7fddbc0aad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:45.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fddbb7fe700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0c8490 0x7fddbc0aad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2884759170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc069a50 msgr2=0x7fddbc154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fddbb7fe700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc069a50 0x7fddbc154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2884759170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0094f0 con 0x7fddbc15a490 2023-10-10T22:18:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fddbaffd700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc069a50 0x7fddbc154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:18:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fddbb7fe700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc15a490 0x7fddbc0ad370 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fddb400ccf0 tx=0x7fddb4001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fdda2ffd700 1 -- 172.21.15.154:0/2884759170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb400ce30 con 0x7fddbc15a490 2023-10-10T22:18:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fdda2ffd700 1 -- 172.21.15.154:0/2884759170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4005df0 con 0x7fddbc15a490 2023-10-10T22:18:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fdda2ffd700 1 -- 172.21.15.154:0/2884759170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb400ab70 con 0x7fddbc15a490 2023-10-10T22:18:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc0aa030 con 0x7fddbc15a490 2023-10-10T22:18:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.541+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc0aa5f0 con 0x7fddbc15a490 2023-10-10T22:18:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.542+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc0aa810 con 0x7fddbc15a490 2023-10-10T22:18:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.543+0000 7fdda2ffd700 1 -- 172.21.15.154:0/2884759170 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 86) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fddb40070f0 con 0x7fddbc15a490 2023-10-10T22:18:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.544+0000 7fdda2ffd700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fdda8066dd0 0x7fdda8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:18:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.544+0000 7fdda2ffd700 1 -- 172.21.15.154:0/2884759170 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fddb4084590 con 0x7fddbc15a490 2023-10-10T22:18:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.545+0000 7fddbaffd700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fdda8066dd0 0x7fdda8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:18:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.545+0000 7fddbaffd700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fdda8066dd0 0x7fdda8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fddbc06b920 tx=0x7fddac017000 comp rx=0 tx=0).ready entity=mgr.9339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:18:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.549+0000 7fdda2ffd700 1 -- 172.21.15.154:0/2884759170 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddb4051790 con 0x7fddbc15a490 2023-10-10T22:18:45.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.766+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fddbc0718b0 con 0x7fdda8066dd0 2023-10-10T22:18:45.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.812+0000 7fdda2ffd700 1 -- 172.21.15.154:0/2884759170 <== mgr.9339 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7fddbc0718b0 con 0x7fdda8066dd0 2023-10-10T22:18:45.814 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-10-10T22:18:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fdda8066dd0 msgr2=0x7fdda8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fdda8066dd0 0x7fdda8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fddbc06b920 tx=0x7fddac017000 comp rx=0 tx=0).stop 2023-10-10T22:18:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc15a490 msgr2=0x7fddbc0ad370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:18:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc15a490 0x7fddbc0ad370 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fddb400ccf0 tx=0x7fddb4001a70 comp rx=0 tx=0).stop 2023-10-10T22:18:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 shutdown_connections 2023-10-10T22:18:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7fdda8066dd0 0x7fdda8069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddbc15a490 0x7fddbc0ad370 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc069a50 0x7fddbc154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 --2- 172.21.15.154:0/2884759170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0c8490 0x7fddbc0aad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:18:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 >> 172.21.15.154:0/2884759170 conn(0x7fddbc0c8f90 msgr2=0x7fddbc068470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:18:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 shutdown_connections 2023-10-10T22:18:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:18:45.814+0000 7fddc17ff700 1 -- 172.21.15.154:0/2884759170 wait complete. 2023-10-10T22:18:45.833 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-10-10T22:19:00.826 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:19:00.824+0000 7f70d6dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:19:00.827 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:19:00.824+0000 7f70d6dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:19:00.827 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:19:00.824+0000 7f70d6dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:19:00.827 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:19:00.824+0000 7f70d6dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:19:00.827 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:19:00.824+0000 7f70d6dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:19:09.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:19:09.178 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:19:39.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:19:39.285 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:20:09.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:20:09.458 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:20:39.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:20:39.633 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:21:09.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:21:09.820 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:21:40.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:21:40.018 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:22:10.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:22:10.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:22:40.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:22:40.531 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:23:10.630 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:23:10.636 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:23:40.845 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:23:40.850 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:24:11.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:24:11.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:24:41.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:24:41.201 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:25:11.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:25:11.302 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:25:41.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:25:41.492 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:26:11.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:26:11.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:26:41.698 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:26:41.704 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:27:11.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:27:11.819 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:27:41.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:27:41.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:28:12.018 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:28:12.024 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:28:42.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:28:42.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:29:12.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:29:12.293 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:29:15.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:29:15.835 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-10T22:29:15.879 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_19_00_UTC 2023-10-10T22:29:15.879 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_20_00_UTC 2023-10-10T22:29:15.879 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_21_00_UTC 2023-10-10T22:29:15.880 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_22_00_UTC 2023-10-10T22:29:15.880 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_23_00_UTC 2023-10-10T22:29:15.880 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_24_00_UTC 2023-10-10T22:29:15.880 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_25_00_UTC 2023-10-10T22:29:15.881 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_26_00_UTC 2023-10-10T22:29:15.881 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_27_00_UTC 2023-10-10T22:29:15.881 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_28_00_UTC 2023-10-10T22:29:15.881 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_29_00_UTC 2023-10-10T22:29:15.882 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-22_19_00_UTC', 'scheduled-2023-10-10-22_20_00_UTC', 'scheduled-2023-10-10-22_21_00_UTC', 'scheduled-2023-10-10-22_22_00_UTC', 'scheduled-2023-10-10-22_23_00_UTC', 'scheduled-2023-10-10-22_24_00_UTC', 'scheduled-2023-10-10-22_25_00_UTC', 'scheduled-2023-10-10-22_26_00_UTC', 'scheduled-2023-10-10-22_27_00_UTC', 'scheduled-2023-10-10-22_28_00_UTC', 'scheduled-2023-10-10-22_29_00_UTC'] 2023-10-10T22:29:15.883 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-10T22:29:16.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.115+0000 7ff9ebfff700 1 Processor -- start 2023-10-10T22:29:16.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.115+0000 7ff9ebfff700 1 -- start start 2023-10-10T22:29:16.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.116+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec1597d0 0x7ff9ec0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.116+0000 7ff9ebfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9ec06f0b0 0x7ff9ec15d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.116+0000 7ff9ebfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec06e510 con 0x7ff9ec0ac0e0 2023-10-10T22:29:16.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.116+0000 7ff9ebfff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec069180 con 0x7ff9ec06f0b0 2023-10-10T22:29:16.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.116+0000 7ff9ebfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec06dec0 con 0x7ff9ec1597d0 2023-10-10T22:29:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.116+0000 7ff9eb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9ec06f0b0 0x7ff9ec15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.116+0000 7ff9ea7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff9ec0ac0e0 0x7ff9ec06e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54128/0 (socket says 172.21.15.154:54128) 2023-10-10T22:29:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9ea7fc700 1 -- 172.21.15.154:0/3874395708 learned_addr learned my addr 172.21.15.154:0/3874395708 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:29:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9eaffd700 1 --2- 172.21.15.154:0/3874395708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec1597d0 0x7ff9ec0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9eb7fe700 1 -- 172.21.15.154:0/3874395708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec1597d0 msgr2=0x7ff9ec0afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:29:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9eb7fe700 1 --2- 172.21.15.154:0/3874395708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec1597d0 0x7ff9ec0afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9eb7fe700 1 -- 172.21.15.154:0/3874395708 >> v1:172.21.15.154:6789/0 conn(0x7ff9ec0ac0e0 legacy=0x7ff9ec06e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9eb7fe700 1 -- 172.21.15.154:0/3874395708 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec06e1a0 con 0x7ff9ec06f0b0 2023-10-10T22:29:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9e9ffb700 1 -- 172.21.15.154:0/3874395708 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494675482 0 0) 0x7ff9ec06e510 con 0x7ff9ec0ac0e0 2023-10-10T22:29:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9eb7fe700 1 --2- 172.21.15.154:0/3874395708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec06f0b0 0x7ff9ec15d440 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009e60 tx=0x7ff9e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ea1ea7f95e8452 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:29:16.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9e9ffb700 1 -- 172.21.15.154:0/3874395708 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400e070 con 0x7ff9ec06f0b0 2023-10-10T22:29:16.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9e9ffb700 1 -- 172.21.15.154:0/3874395708 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e400bc30 con 0x7ff9ec06f0b0 2023-10-10T22:29:16.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.117+0000 7ff9e9ffb700 1 -- 172.21.15.154:0/3874395708 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4012430 con 0x7ff9ec06f0b0 2023-10-10T22:29:16.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.118+0000 7ff9ebfff700 1 -- 172.21.15.154:0/3874395708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec06f0b0 msgr2=0x7ff9ec15d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.118+0000 7ff9ebfff700 1 --2- 172.21.15.154:0/3874395708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec06f0b0 0x7ff9ec15d440 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009e60 tx=0x7ff9e4009780 comp rx=0 tx=0).stop 2023-10-10T22:29:16.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.118+0000 7ff9ebfff700 1 -- 172.21.15.154:0/3874395708 shutdown_connections 2023-10-10T22:29:16.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.118+0000 7ff9ebfff700 1 --2- 172.21.15.154:0/3874395708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec06f0b0 0x7ff9ec15d440 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.118+0000 7ff9ebfff700 1 --2- 172.21.15.154:0/3874395708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec1597d0 0x7ff9ec0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.118+0000 7ff9ebfff700 1 -- 172.21.15.154:0/3874395708 >> 172.21.15.154:0/3874395708 conn(0x7ff9ec06adf0 msgr2=0x7ff9ec0ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:29:16.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.118+0000 7ff9ebfff700 1 -- 172.21.15.154:0/3874395708 shutdown_connections 2023-10-10T22:29:16.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.118+0000 7ff9ebfff700 1 -- 172.21.15.154:0/3874395708 wait complete. 2023-10-10T22:29:16.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.120+0000 7ff9ebfff700 1 Processor -- start 2023-10-10T22:29:16.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.120+0000 7ff9ebfff700 1 -- start start 2023-10-10T22:29:16.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec06f0b0 0x7ff9ec144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec1597d0 0x7ff9ec16ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9ec16d390 0x7ff9ec0c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ebfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c3290 con 0x7ff9ec1597d0 2023-10-10T22:29:16.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ebfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec16d7e0 con 0x7ff9ec16d390 2023-10-10T22:29:16.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ebfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c2680 con 0x7ff9ec06f0b0 2023-10-10T22:29:16.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ea7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec1597d0 0x7ff9ec16ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ea7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec1597d0 0x7ff9ec16ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55540/0 (socket says 172.21.15.154:55540) 2023-10-10T22:29:16.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ea7fc700 1 -- 172.21.15.154:0/401858641 learned_addr learned my addr 172.21.15.154:0/401858641 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:29:16.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9eaffd700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec06f0b0 0x7ff9ec144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9eb7fe700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9ec16d390 0x7ff9ec0c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ea7fc700 1 -- 172.21.15.154:0/401858641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec06f0b0 msgr2=0x7ff9ec144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ea7fc700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec06f0b0 0x7ff9ec144590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ea7fc700 1 -- 172.21.15.154:0/401858641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9ec16d390 msgr2=0x7ff9ec0c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ea7fc700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9ec16d390 0x7ff9ec0c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.121+0000 7ff9ea7fc700 1 -- 172.21.15.154:0/401858641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e4009a20 con 0x7ff9ec1597d0 2023-10-10T22:29:16.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.122+0000 7ff9ea7fc700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec1597d0 0x7ff9ec16ce50 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c7e0 tx=0x7ff9e0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:29:16.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.122+0000 7ff9d2ffd700 1 -- 172.21.15.154:0/401858641 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0005b30 con 0x7ff9ec1597d0 2023-10-10T22:29:16.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.122+0000 7ff9d2ffd700 1 -- 172.21.15.154:0/401858641 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0005c90 con 0x7ff9ec1597d0 2023-10-10T22:29:16.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.122+0000 7ff9d2ffd700 1 -- 172.21.15.154:0/401858641 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0007300 con 0x7ff9ec1597d0 2023-10-10T22:29:16.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.122+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec0c2960 con 0x7ff9ec1597d0 2023-10-10T22:29:16.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.122+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec0c2f20 con 0x7ff9ec1597d0 2023-10-10T22:29:16.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.123+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec04c3c0 con 0x7ff9ec1597d0 2023-10-10T22:29:16.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.124+0000 7ff9d2ffd700 1 -- 172.21.15.154:0/401858641 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 89) v1 ==== 84871+0+0 (secure 0 0 0) 0x7ff9e00076b0 con 0x7ff9ec1597d0 2023-10-10T22:29:16.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.125+0000 7ff9d2ffd700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff9d80670a0 0x7ff9d8069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.125+0000 7ff9d2ffd700 1 -- 172.21.15.154:0/401858641 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6456+0+0 (secure 0 0 0) 0x7ff9e0083fe0 con 0x7ff9ec1597d0 2023-10-10T22:29:16.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.125+0000 7ff9eaffd700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff9d80670a0 0x7ff9d8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.126+0000 7ff9eaffd700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff9d80670a0 0x7ff9d8069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc006fd0 tx=0x7ff9dc008040 comp rx=0 tx=0).ready entity=mgr.9339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:29:16.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.129+0000 7ff9d2ffd700 1 -- 172.21.15.154:0/401858641 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9e0050dd0 con 0x7ff9ec1597d0 2023-10-10T22:29:16.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.347+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 --> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9ec0cd4a0 con 0x7ff9d80670a0 2023-10-10T22:29:16.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.356+0000 7ff9d2ffd700 1 -- 172.21.15.154:0/401858641 <== mgr.9339 v2:172.21.15.154:6836/85496 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7ff9ec0cd4a0 con 0x7ff9d80670a0 2023-10-10T22:29:16.358 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:29:16.358 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T22:18:45", "first": "2023-10-10T22:19:00", "last": "2023-10-10T22:29:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-10T22:29:16.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff9d80670a0 msgr2=0x7ff9d8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff9d80670a0 0x7ff9d8069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc006fd0 tx=0x7ff9dc008040 comp rx=0 tx=0).stop 2023-10-10T22:29:16.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec1597d0 msgr2=0x7ff9ec16ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec1597d0 0x7ff9ec16ce50 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c7e0 tx=0x7ff9e0007df0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 shutdown_connections 2023-10-10T22:29:16.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9ec16d390 0x7ff9ec0c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9ec06f0b0 0x7ff9ec144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7ff9d80670a0 0x7ff9d8069550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 --2- 172.21.15.154:0/401858641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ec1597d0 0x7ff9ec16ce50 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 >> 172.21.15.154:0/401858641 conn(0x7ff9ec06adf0 msgr2=0x7ff9ec158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:29:16.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 shutdown_connections 2023-10-10T22:29:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.358+0000 7ff9ebfff700 1 -- 172.21.15.154:0/401858641 wait complete. 2023-10-10T22:29:16.377 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T22:18:45", "first": "2023-10-10T22:19:00", "last": "2023-10-10T22:29:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-10T22:29:16.377 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T22:18:45', 'first': '2023-10-10T22:19:00', 'last': '2023-10-10T22:29:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-10-10T22:29:16.377 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-10T22:29:16.378 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-10T22:29:16.378 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-10T22:29:16.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.560+0000 7f4e09f9d700 1 Processor -- start 2023-10-10T22:29:16.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.560+0000 7f4e09f9d700 1 -- start start 2023-10-10T22:29:16.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.561+0000 7f4e09f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e04150180 0x7f4e04157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.561+0000 7f4e09f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e04150550 0x7f4e040c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.561+0000 7f4e09f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0406e2a0 con 0x7f4e040c7240 2023-10-10T22:29:16.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.561+0000 7f4e09f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0406b2e0 con 0x7f4e04150180 2023-10-10T22:29:16.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e09f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e040c7680 con 0x7f4e04150550 2023-10-10T22:29:16.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e08f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e04150180 0x7f4e04157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e08f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e04150180 0x7f4e04157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55554/0 (socket says 172.21.15.154:55554) 2023-10-10T22:29:16.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e08f9b700 1 -- 172.21.15.154:0/1737287586 learned_addr learned my addr 172.21.15.154:0/1737287586 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:29:16.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e0979c700 1 --1- 172.21.15.154:0/1737287586 >> v1:172.21.15.154:6789/0 conn(0x7f4e040c7240 0x7f4e04069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54140/0 (socket says 172.21.15.154:54140) 2023-10-10T22:29:16.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e03fff700 1 --2- 172.21.15.154:0/1737287586 >> v2:172.21.15.179:3300/0 conn(0x7f4e04150550 0x7f4e040c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e08f9b700 1 -- 172.21.15.154:0/1737287586 >> v2:172.21.15.179:3300/0 conn(0x7f4e04150550 msgr2=0x7f4e040c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:29:16.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e08f9b700 1 --2- 172.21.15.154:0/1737287586 >> v2:172.21.15.179:3300/0 conn(0x7f4e04150550 0x7f4e040c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e08f9b700 1 -- 172.21.15.154:0/1737287586 >> v1:172.21.15.154:6789/0 conn(0x7f4e040c7240 legacy=0x7f4e04069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e08f9b700 1 -- 172.21.15.154:0/1737287586 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040c78e0 con 0x7f4e04150180 2023-10-10T22:29:16.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e03fff700 1 --2- 172.21.15.154:0/1737287586 >> v2:172.21.15.179:3300/0 conn(0x7f4e04150550 0x7f4e040c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:29:16.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.562+0000 7f4e037fe700 1 -- 172.21.15.154:0/1737287586 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139327595 0 0) 0x7f4e0406e2a0 con 0x7f4e040c7240 2023-10-10T22:29:16.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e08f9b700 1 --2- 172.21.15.154:0/1737287586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 0x7f4e04157770 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f4e0406d1e0 tx=0x7f4df8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc8f43b7d12c281 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:29:16.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e037fe700 1 -- 172.21.15.154:0/1737287586 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800b860 con 0x7f4e04150180 2023-10-10T22:29:16.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e037fe700 1 -- 172.21.15.154:0/1737287586 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800b9c0 con 0x7f4e04150180 2023-10-10T22:29:16.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e037fe700 1 -- 172.21.15.154:0/1737287586 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800bd60 con 0x7f4e04150180 2023-10-10T22:29:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1737287586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 msgr2=0x7f4e04157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e09f9d700 1 --2- 172.21.15.154:0/1737287586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 0x7f4e04157770 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f4e0406d1e0 tx=0x7f4df8009250 comp rx=0 tx=0).stop 2023-10-10T22:29:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1737287586 shutdown_connections 2023-10-10T22:29:16.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e09f9d700 1 --2- 172.21.15.154:0/1737287586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 0x7f4e04157770 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e09f9d700 1 --2- 172.21.15.154:0/1737287586 >> v2:172.21.15.179:3300/0 conn(0x7f4e04150550 0x7f4e040c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1737287586 >> 172.21.15.154:0/1737287586 conn(0x7f4e040cc1f0 msgr2=0x7f4e040cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:29:16.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1737287586 shutdown_connections 2023-10-10T22:29:16.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.563+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1737287586 wait complete. 2023-10-10T22:29:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.565+0000 7f4e09f9d700 1 Processor -- start 2023-10-10T22:29:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.565+0000 7f4e09f9d700 1 -- start start 2023-10-10T22:29:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e09f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e040c7240 0x7f4e040b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e09f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 0x7f4e0414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e09f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e04150550 0x7f4e0414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e09f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0414e210 con 0x7f4e04150180 2023-10-10T22:29:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e09f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e040ad3c0 con 0x7f4e04150550 2023-10-10T22:29:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e09f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0414e470 con 0x7f4e040c7240 2023-10-10T22:29:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e03fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 0x7f4e0414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e03fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 0x7f4e0414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55562/0 (socket says 172.21.15.154:55562) 2023-10-10T22:29:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e03fff700 1 -- 172.21.15.154:0/1403919266 learned_addr learned my addr 172.21.15.154:0/1403919266 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:29:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e08f9b700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e040c7240 0x7f4e040b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e03fff700 1 -- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e040c7240 msgr2=0x7f4e040b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e0979c700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e04150550 0x7f4e0414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e03fff700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e040c7240 0x7f4e040b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e03fff700 1 -- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e04150550 msgr2=0x7f4e0414dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.566+0000 7f4e03fff700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e04150550 0x7f4e0414dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.567+0000 7f4e03fff700 1 -- 172.21.15.154:0/1403919266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80094f0 con 0x7f4e04150180 2023-10-10T22:29:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.567+0000 7f4e08f9b700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e040c7240 0x7f4e040b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:29:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.567+0000 7f4e0979c700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e04150550 0x7f4e0414dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:29:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.567+0000 7f4e03fff700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 0x7f4e0414d790 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f4df000d860 tx=0x7f4df0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:29:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.567+0000 7f4e00ff9700 1 -- 172.21.15.154:0/1403919266 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df00125f0 con 0x7f4e04150180 2023-10-10T22:29:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.567+0000 7f4e00ff9700 1 -- 172.21.15.154:0/1403919266 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0012750 con 0x7f4e04150180 2023-10-10T22:29:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.567+0000 7f4e00ff9700 1 -- 172.21.15.154:0/1403919266 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0012ad0 con 0x7f4e04150180 2023-10-10T22:29:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.567+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0414e750 con 0x7f4e04150180 2023-10-10T22:29:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.567+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0414ed10 con 0x7f4e04150180 2023-10-10T22:29:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.568+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0404c3c0 con 0x7f4e04150180 2023-10-10T22:29:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.569+0000 7f4e00ff9700 1 -- 172.21.15.154:0/1403919266 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 89) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f4df0014430 con 0x7f4e04150180 2023-10-10T22:29:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.570+0000 7f4e00ff9700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4de80670a0 0x7f4de8069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:29:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.570+0000 7f4e00ff9700 1 -- 172.21.15.154:0/1403919266 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f4df0084e50 con 0x7f4e04150180 2023-10-10T22:29:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.570+0000 7f4e08f9b700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4de80670a0 0x7f4de8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:29:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.571+0000 7f4e08f9b700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4de80670a0 0x7f4de8069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e0406d1e0 tx=0x7f4df8017000 comp rx=0 tx=0).ready entity=mgr.9339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:29:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.574+0000 7f4e00ff9700 1 -- 172.21.15.154:0/1403919266 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4df0055750 con 0x7f4e04150180 2023-10-10T22:29:16.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.821+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4e040cbfa0 con 0x7f4e04150180 2023-10-10T22:29:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.824+0000 7f4e00ff9700 1 -- 172.21.15.154:0/1403919266 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v89) v1 ==== 74+0+163913 (secure 0 0 0) 0x7f4df00552e0 con 0x7f4e04150180 2023-10-10T22:29:16.828 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:29:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4de80670a0 msgr2=0x7f4de8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4de80670a0 0x7f4de8069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e0406d1e0 tx=0x7f4df8017000 comp rx=0 tx=0).stop 2023-10-10T22:29:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 msgr2=0x7f4e0414d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:29:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 0x7f4e0414d790 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f4df000d860 tx=0x7f4df0008040 comp rx=0 tx=0).stop 2023-10-10T22:29:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 shutdown_connections 2023-10-10T22:29:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e04150550 0x7f4e0414dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e040c7240 0x7f4e040b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:6836/85496,v1:172.21.15.154:6837/85496] conn(0x7f4de80670a0 0x7f4de8069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 --2- 172.21.15.154:0/1403919266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e04150180 0x7f4e0414d790 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:29:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 >> 172.21.15.154:0/1403919266 conn(0x7f4e040cc1f0 msgr2=0x7f4e040cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:29:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 shutdown_connections 2023-10-10T22:29:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:29:16.828+0000 7f4e09f9d700 1 -- 172.21.15.154:0/1403919266 wait complete. 2023-10-10T22:29:16.846 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":89,"active_gid":9339,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":85496},{"type":"v1","addr":"172.21.15.154:6837","nonce":85496}]},"active_addr":"172.21.15.154:6837/85496","active_change":"2023-10-10T22:18:44.244283+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":7646,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":176,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2315091237}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2413918626}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":498340340}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3925921356}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":343743971}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2303751617}]}]} 2023-10-10T22:29:16.851 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-10-10T22:29:16.851 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-10T22:29:16.851 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-10-10T22:29:16.852 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-10T22:29:16.852 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:29:16.920 INFO:tasks.ceph.mgr.y:Stopped 2023-10-10T22:29:16.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-10T22:29:16.925 INFO:tasks.ceph.mgr.y:Started 2023-10-10T22:29:18.252 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:18.250+0000 7fe7d390b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:29:18.416 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:18.415+0000 7fe7d390b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:29:18.502 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:18.500+0000 7fe7d390b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:29:18.728 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:18.727+0000 7fe7d390b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:29:18.907 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:18.905+0000 7fe7d390b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:29:19.000 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:18.998+0000 7fe7d390b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:29:19.163 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:19.161+0000 7fe7d390b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:29:19.265 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:19.263+0000 7fe7d390b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:29:19.760 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:19.759+0000 7fe7d390b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:29:19.856 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:19.855+0000 7fe7d390b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:29:19.948 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:19.947+0000 7fe7d390b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:29:20.581 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:20.579+0000 7fe7d390b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:29:20.755 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:20.754+0000 7fe7d390b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:29:20.853 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:20.851+0000 7fe7d390b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:29:21.148 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:21.147+0000 7fe7d390b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:29:21.245 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:21.244+0000 7fe7d390b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:29:21.956 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:21.955+0000 7fe7d390b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:29:22.245 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:22.244+0000 7fe7d390b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:29:22.339 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:22.337+0000 7fe7d390b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:29:22.495 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:22.493+0000 7fe7d390b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:29:22.601 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:22.599+0000 7fe7d390b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:29:22.791 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:22.790+0000 7fe7d390b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:29:22.885 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:22.884+0000 7fe7d390b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:29:22.979 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:22.977+0000 7fe7d390b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:29:23.074 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.072+0000 7fe7d390b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:29:23.233 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.231+0000 7fe744c2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:23.234 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.231+0000 7fe744c2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:23.234 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.232+0000 7fe744c2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:23.234 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.232+0000 7fe744c2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:23.234 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.232+0000 7fe744c2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:23.235 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.232+0000 7fe748436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:23.235 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.232+0000 7fe748436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:23.235 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.232+0000 7fe748436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:23.235 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.232+0000 7fe748436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:23.235 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:29:23.232+0000 7fe748436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:29:42.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:29:42.431 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:30:00.229 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:30:00.228+0000 7fe750446700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:30:00.229 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:30:00.228+0000 7fe750446700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:30:00.230 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:30:00.228+0000 7fe750446700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:30:00.230 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:30:00.228+0000 7fe750446700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:30:00.230 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:30:00.228+0000 7fe750446700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:30:12.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:30:12.612 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:30:42.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:30:42.783 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:31:13.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:31:13.038 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:31:43.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:31:43.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:32:13.294 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:32:13.300 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:32:43.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:32:43.537 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:33:13.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:33:13.679 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:33:43.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:33:43.870 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:34:14.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:34:14.058 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:34:16.927 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-10T22:34:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.123+0000 7f567ebff700 1 Processor -- start 2023-10-10T22:34:17.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.124+0000 7f567ebff700 1 -- start start 2023-10-10T22:34:17.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.125+0000 7f567ebff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5678069a50 0x7f56780c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.125+0000 7f567ebff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56780ac030 con 0x7f5678069e20 2023-10-10T22:34:17.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.125+0000 7f567ebff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56780ab820 con 0x7f56780c8490 2023-10-10T22:34:17.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.125+0000 7f567ebff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567806dbb0 con 0x7f5678069a50 2023-10-10T22:34:17.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.125+0000 7f567d19c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5678069e20 0x7f56781569b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46956/0 (socket says 172.21.15.154:46956) 2023-10-10T22:34:17.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.125+0000 7f567d19c700 1 -- 172.21.15.154:0/2014991080 learned_addr learned my addr 172.21.15.154:0/2014991080 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:17.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.125+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676599741 0 0) 0x7f5670001110 con 0x7f5678069e20 2023-10-10T22:34:17.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.125+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5660003570 con 0x7f5678069e20 2023-10-10T22:34:17.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.125+0000 7f567c99b700 1 --2- 172.21.15.154:0/2014991080 >> v2:172.21.15.179:3300/0 conn(0x7f5678069a50 0x7f56780c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389218757 0 0) 0x7f5660003570 con 0x7f5678069e20 2023-10-10T22:34:17.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 >> v2:172.21.15.179:3300/0 conn(0x7f5678069a50 msgr2=0x7f56780c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:17.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 --2- 172.21.15.154:0/2014991080 >> v2:172.21.15.179:3300/0 conn(0x7f5678069a50 0x7f56780c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 >> v1:172.21.15.179:6789/0 conn(0x7f56780c8490 legacy=0x7f567815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780aba70 con 0x7f5678069e20 2023-10-10T22:34:17.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f5670001600 con 0x7f5678069e20 2023-10-10T22:34:17.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f567c99b700 1 --2- 172.21.15.154:0/2014991080 >> v2:172.21.15.179:3300/0 conn(0x7f5678069a50 0x7f56780c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:17.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 >> v1:172.21.15.154:6789/0 conn(0x7f5678069e20 legacy=0x7f56781569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660003a60 0x7f5660003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5660004810 0x7f5660004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f566000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567806dbb0 con 0x7f56600052e0 2023-10-10T22:34:17.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566000e440 con 0x7f5660004810 2023-10-10T22:34:17.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566000e600 con 0x7f5660003a60 2023-10-10T22:34:17.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f567d19c700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f566000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f567c99b700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660003a60 0x7f5660003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.126+0000 7f566ffff700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5660004810 0x7f5660004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f567d19c700 1 -- 172.21.15.154:0/2014991080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660003a60 msgr2=0x7f5660003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f567d19c700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5660003a60 0x7f5660003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f567d19c700 1 -- 172.21.15.154:0/2014991080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5660004810 msgr2=0x7f5660004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f567d19c700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5660004810 0x7f5660004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f567d19c700 1 -- 172.21.15.154:0/2014991080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5660003570 con 0x7f56600052e0 2023-10-10T22:34:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f567d19c700 1 -- 172.21.15.154:0/2014991080 reap_dead start 2023-10-10T22:34:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f567d19c700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f566000dc70 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f567000c5f0 tx=0x7f567806dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d1599f2d629cd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567000cdf0 con 0x7f56600052e0 2023-10-10T22:34:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5670005920 con 0x7f56600052e0 2023-10-10T22:34:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.127+0000 7f566f7fe700 1 -- 172.21.15.154:0/2014991080 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670005ce0 con 0x7f56600052e0 2023-10-10T22:34:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.128+0000 7f567ebff700 1 -- 172.21.15.154:0/2014991080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 msgr2=0x7f566000dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.128+0000 7f567ebff700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f566000dc70 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f567000c5f0 tx=0x7f567806dcf0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.128+0000 7f567ebff700 1 -- 172.21.15.154:0/2014991080 shutdown_connections 2023-10-10T22:34:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.128+0000 7f567ebff700 1 --2- 172.21.15.154:0/2014991080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f566000dc70 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.128+0000 7f567ebff700 1 -- 172.21.15.154:0/2014991080 >> 172.21.15.154:0/2014991080 conn(0x7f56780c8f90 msgr2=0x7f56780c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.128+0000 7f567ebff700 1 -- 172.21.15.154:0/2014991080 shutdown_connections 2023-10-10T22:34:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.128+0000 7f567ebff700 1 -- 172.21.15.154:0/2014991080 wait complete. 2023-10-10T22:34:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.129+0000 7f567ebff700 1 Processor -- start 2023-10-10T22:34:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.129+0000 7f567ebff700 1 -- start start 2023-10-10T22:34:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.130+0000 7f567ebff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f56780afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.130+0000 7f567ebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56781590d0 0x7f5678152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.130+0000 7f567ebff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56780c0830 0x7f56780c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.130+0000 7f567ebff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780a98e0 con 0x7f56600052e0 2023-10-10T22:34:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.130+0000 7f567ebff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780a9b30 con 0x7f56780c0830 2023-10-10T22:34:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.130+0000 7f567ebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56780a9e10 con 0x7f56781590d0 2023-10-10T22:34:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.130+0000 7f567c99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f56780afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.130+0000 7f567c99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f56780afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52870/0 (socket says 172.21.15.154:52870) 2023-10-10T22:34:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.130+0000 7f567c99b700 1 -- 172.21.15.154:0/1958203222 learned_addr learned my addr 172.21.15.154:0/1958203222 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f566ffff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56781590d0 0x7f5678152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f567d19c700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56780c0830 0x7f56780c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f567c99b700 1 -- 172.21.15.154:0/1958203222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56781590d0 msgr2=0x7f5678152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f567c99b700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56781590d0 0x7f5678152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f567c99b700 1 -- 172.21.15.154:0/1958203222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56780c0830 msgr2=0x7f56780c0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f567c99b700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56780c0830 0x7f56780c0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f567c99b700 1 -- 172.21.15.154:0/1958203222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780aa0f0 con 0x7f56600052e0 2023-10-10T22:34:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f566ffff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56781590d0 0x7f5678152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:17.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f567c99b700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f56780afc90 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f5674010160 tx=0x7f56740097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f566cff9700 1 -- 172.21.15.154:0/1958203222 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674010e00 con 0x7f56600052e0 2023-10-10T22:34:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f566cff9700 1 -- 172.21.15.154:0/1958203222 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5674017430 con 0x7f56600052e0 2023-10-10T22:34:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f566cff9700 1 -- 172.21.15.154:0/1958203222 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740177d0 con 0x7f56600052e0 2023-10-10T22:34:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.131+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56780aa3d0 con 0x7f56600052e0 2023-10-10T22:34:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.132+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5678153200 con 0x7f56600052e0 2023-10-10T22:34:17.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.132+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5678153390 con 0x7f56600052e0 2023-10-10T22:34:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.133+0000 7f566cff9700 1 -- 172.21.15.154:0/1958203222 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 94) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f5674017b80 con 0x7f56600052e0 2023-10-10T22:34:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.134+0000 7f566cff9700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f56640670a0 0x7f5664069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.134+0000 7f566cff9700 1 -- 172.21.15.154:0/1958203222 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f5674085b50 con 0x7f56600052e0 2023-10-10T22:34:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.134+0000 7f566ffff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f56640670a0 0x7f5664069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.135+0000 7f566ffff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f56640670a0 0x7f5664069550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5668007e40 tx=0x7f5668009040 comp rx=0 tx=0).ready entity=mgr.9435 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:17.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.139+0000 7f566cff9700 1 -- 172.21.15.154:0/1958203222 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5674052820 con 0x7f56600052e0 2023-10-10T22:34:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.355+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f56780718b0 con 0x7f56640670a0 2023-10-10T22:34:17.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.422+0000 7f566cff9700 1 -- 172.21.15.154:0/1958203222 <== mgr.9435 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f56780718b0 con 0x7f56640670a0 2023-10-10T22:34:17.424 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-10T22:34:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f56640670a0 msgr2=0x7f5664069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f56640670a0 0x7f5664069550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5668007e40 tx=0x7f5668009040 comp rx=0 tx=0).stop 2023-10-10T22:34:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 msgr2=0x7f56780afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f56780afc90 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f5674010160 tx=0x7f56740097d0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 shutdown_connections 2023-10-10T22:34:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f56640670a0 0x7f5664069550 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56780c0830 0x7f56780c0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56600052e0 0x7f56780afc90 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 --2- 172.21.15.154:0/1958203222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56781590d0 0x7f5678152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 >> 172.21.15.154:0/1958203222 conn(0x7f56780c8f90 msgr2=0x7f56780adf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:17.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 shutdown_connections 2023-10-10T22:34:17.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.425+0000 7f567ebff700 1 -- 172.21.15.154:0/1958203222 wait complete. 2023-10-10T22:34:17.444 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-10T22:34:17.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:17.445 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-10T22:34:17.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_19_00_UTC 2023-10-10T22:34:17.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_20_00_UTC 2023-10-10T22:34:17.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_21_00_UTC 2023-10-10T22:34:17.484 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_22_00_UTC 2023-10-10T22:34:17.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_23_00_UTC 2023-10-10T22:34:17.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_24_00_UTC 2023-10-10T22:34:17.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_25_00_UTC 2023-10-10T22:34:17.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_26_00_UTC 2023-10-10T22:34:17.485 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_27_00_UTC 2023-10-10T22:34:17.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_28_00_UTC 2023-10-10T22:34:17.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_29_00_UTC 2023-10-10T22:34:17.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_30_00_UTC 2023-10-10T22:34:17.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_31_00_UTC 2023-10-10T22:34:17.486 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_32_00_UTC 2023-10-10T22:34:17.487 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_33_00_UTC 2023-10-10T22:34:17.487 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_34_00_UTC 2023-10-10T22:34:17.488 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-10-22_19_00_UTC', 'scheduled-2023-10-10-22_20_00_UTC', 'scheduled-2023-10-10-22_21_00_UTC', 'scheduled-2023-10-10-22_22_00_UTC', 'scheduled-2023-10-10-22_23_00_UTC', 'scheduled-2023-10-10-22_24_00_UTC', 'scheduled-2023-10-10-22_25_00_UTC', 'scheduled-2023-10-10-22_26_00_UTC', 'scheduled-2023-10-10-22_27_00_UTC', 'scheduled-2023-10-10-22_28_00_UTC', 'scheduled-2023-10-10-22_29_00_UTC', 'scheduled-2023-10-10-22_30_00_UTC', 'scheduled-2023-10-10-22_31_00_UTC', 'scheduled-2023-10-10-22_32_00_UTC', 'scheduled-2023-10-10-22_33_00_UTC', 'scheduled-2023-10-10-22_34_00_UTC'] 2023-10-10T22:34:17.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-10T22:34:17.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.714+0000 7f4556bff700 1 Processor -- start 2023-10-10T22:34:17.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.714+0000 7f4556bff700 1 -- start start 2023-10-10T22:34:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.715+0000 7f4556bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4550157740 0x7f45500adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.715+0000 7f4556bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4550068aa0 0x7f455006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.715+0000 7f4556bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455006dc20 con 0x7f45500b2100 2023-10-10T22:34:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.715+0000 7f4556bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45500acc00 con 0x7f4550068aa0 2023-10-10T22:34:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.715+0000 7f4556bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455006d6a0 con 0x7f4550157740 2023-10-10T22:34:17.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.715+0000 7f454ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f45500b2100 0x7f4550068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46958/0 (socket says 172.21.15.154:46958) 2023-10-10T22:34:17.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.715+0000 7f454ffff700 1 -- 172.21.15.154:0/3359274323 learned_addr learned my addr 172.21.15.154:0/3359274323 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:17.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.715+0000 7f455519c700 1 --2- 172.21.15.154:0/3359274323 >> v2:172.21.15.154:3300/0 conn(0x7f4550068aa0 0x7f455006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f455499b700 1 --2- 172.21.15.154:0/3359274323 >> v2:172.21.15.179:3300/0 conn(0x7f4550157740 0x7f45500adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f455519c700 1 -- 172.21.15.154:0/3359274323 >> v2:172.21.15.179:3300/0 conn(0x7f4550157740 msgr2=0x7f45500adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:17.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f455519c700 1 --2- 172.21.15.154:0/3359274323 >> v2:172.21.15.179:3300/0 conn(0x7f4550157740 0x7f45500adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f455519c700 1 -- 172.21.15.154:0/3359274323 >> v1:172.21.15.154:6789/0 conn(0x7f45500b2100 legacy=0x7f4550068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f455519c700 1 -- 172.21.15.154:0/3359274323 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500ae910 con 0x7f4550068aa0 2023-10-10T22:34:17.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f455499b700 1 --2- 172.21.15.154:0/3359274323 >> v2:172.21.15.179:3300/0 conn(0x7f4550157740 0x7f45500adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:17.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f455519c700 1 --2- 172.21.15.154:0/3359274323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4550068aa0 0x7f455006e0b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f45500abfa0 tx=0x7f4548009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e156ace4810e38 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:17.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f454f7fe700 1 -- 172.21.15.154:0/3359274323 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454800e070 con 0x7f4550068aa0 2023-10-10T22:34:17.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f454f7fe700 1 -- 172.21.15.154:0/3359274323 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454800bb60 con 0x7f4550068aa0 2023-10-10T22:34:17.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.716+0000 7f454f7fe700 1 -- 172.21.15.154:0/3359274323 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548012430 con 0x7f4550068aa0 2023-10-10T22:34:17.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.717+0000 7f4556bff700 1 -- 172.21.15.154:0/3359274323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4550068aa0 msgr2=0x7f455006e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.717+0000 7f4556bff700 1 --2- 172.21.15.154:0/3359274323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4550068aa0 0x7f455006e0b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f45500abfa0 tx=0x7f4548009780 comp rx=0 tx=0).stop 2023-10-10T22:34:17.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.717+0000 7f4556bff700 1 -- 172.21.15.154:0/3359274323 shutdown_connections 2023-10-10T22:34:17.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.717+0000 7f4556bff700 1 --2- 172.21.15.154:0/3359274323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4550068aa0 0x7f455006e0b0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.717+0000 7f4556bff700 1 --2- 172.21.15.154:0/3359274323 >> v2:172.21.15.179:3300/0 conn(0x7f4550157740 0x7f45500adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.717+0000 7f4556bff700 1 -- 172.21.15.154:0/3359274323 >> 172.21.15.154:0/3359274323 conn(0x7f45500c8f90 msgr2=0x7f45500c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:17.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.717+0000 7f4556bff700 1 -- 172.21.15.154:0/3359274323 shutdown_connections 2023-10-10T22:34:17.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.717+0000 7f4556bff700 1 -- 172.21.15.154:0/3359274323 wait complete. 2023-10-10T22:34:17.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.719+0000 7f4556bff700 1 Processor -- start 2023-10-10T22:34:17.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.719+0000 7f4556bff700 1 -- start start 2023-10-10T22:34:17.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f4556bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4550068aa0 0x7f455015f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f4556bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45500b2100 0x7f455015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f4556bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550157740 0x7f455015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f4556bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4550159da0 con 0x7f45500b2100 2023-10-10T22:34:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f4556bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4550159190 con 0x7f4550157740 2023-10-10T22:34:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f4556bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4550159470 con 0x7f4550068aa0 2023-10-10T22:34:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f454ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45500b2100 0x7f455015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f454ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45500b2100 0x7f455015ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52878/0 (socket says 172.21.15.154:52878) 2023-10-10T22:34:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f454ffff700 1 -- 172.21.15.154:0/4091173584 learned_addr learned my addr 172.21.15.154:0/4091173584 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f455499b700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4550068aa0 0x7f455015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f455519c700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550157740 0x7f455015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f454ffff700 1 -- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4550068aa0 msgr2=0x7f455015f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f454ffff700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4550068aa0 0x7f455015f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f454ffff700 1 -- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550157740 msgr2=0x7f455015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f454ffff700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550157740 0x7f455015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f454ffff700 1 -- 172.21.15.154:0/4091173584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544009420 con 0x7f45500b2100 2023-10-10T22:34:17.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f455499b700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4550068aa0 0x7f455015f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.720+0000 7f455519c700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550157740 0x7f455015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.721+0000 7f454ffff700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45500b2100 0x7f455015ad90 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f453c00c7c0 tx=0x7f453c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.721+0000 7f454cff9700 1 -- 172.21.15.154:0/4091173584 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c005b30 con 0x7f45500b2100 2023-10-10T22:34:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.721+0000 7f454cff9700 1 -- 172.21.15.154:0/4091173584 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c005cb0 con 0x7f45500b2100 2023-10-10T22:34:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.721+0000 7f454cff9700 1 -- 172.21.15.154:0/4091173584 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c004a80 con 0x7f45500b2100 2023-10-10T22:34:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.721+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4548009a20 con 0x7f45500b2100 2023-10-10T22:34:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.721+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4550159a30 con 0x7f45500b2100 2023-10-10T22:34:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.722+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45500718b0 con 0x7f45500b2100 2023-10-10T22:34:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.723+0000 7f454cff9700 1 -- 172.21.15.154:0/4091173584 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 94) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f453c0070f0 con 0x7f45500b2100 2023-10-10T22:34:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.724+0000 7f454cff9700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f45340670a0 0x7f4534069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.724+0000 7f454cff9700 1 -- 172.21.15.154:0/4091173584 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f453c083fe0 con 0x7f45500b2100 2023-10-10T22:34:17.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.724+0000 7f455499b700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f45340670a0 0x7f4534069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:17.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.725+0000 7f455499b700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f45340670a0 0x7f4534069550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45440093f0 tx=0x7f4544008040 comp rx=0 tx=0).ready entity=mgr.9435 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:17.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.728+0000 7f454cff9700 1 -- 172.21.15.154:0/4091173584 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f453c050d70 con 0x7f45500b2100 2023-10-10T22:34:17.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.943+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45500aebf0 con 0x7f45340670a0 2023-10-10T22:34:17.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.951+0000 7f454cff9700 1 -- 172.21.15.154:0/4091173584 <== mgr.9435 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f45500aebf0 con 0x7f45340670a0 2023-10-10T22:34:17.953 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:17.953 INFO:teuthology.orchestra.run.smithi154.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T22:18:45", "first": "2023-10-10T22:19:00", "last": "2023-10-10T22:34:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-10T22:34:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f45340670a0 msgr2=0x7f4534069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f45340670a0 0x7f4534069550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45440093f0 tx=0x7f4544008040 comp rx=0 tx=0).stop 2023-10-10T22:34:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45500b2100 msgr2=0x7f455015ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:17.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45500b2100 0x7f455015ad90 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f453c00c7c0 tx=0x7f453c007f70 comp rx=0 tx=0).stop 2023-10-10T22:34:17.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 shutdown_connections 2023-10-10T22:34:17.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f45340670a0 0x7f4534069550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550157740 0x7f455015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4550068aa0 0x7f455015f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 --2- 172.21.15.154:0/4091173584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45500b2100 0x7f455015ad90 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:17.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 >> 172.21.15.154:0/4091173584 conn(0x7f45500c8f90 msgr2=0x7f45500b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:17.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 shutdown_connections 2023-10-10T22:34:17.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:17.954+0000 7f4556bff700 1 -- 172.21.15.154:0/4091173584 wait complete. 2023-10-10T22:34:17.973 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-10T00:00:00", "created": "2023-10-10T22:18:45", "first": "2023-10-10T22:19:00", "last": "2023-10-10T22:34:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-10T22:34:17.974 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-10T00:00:00', 'created': '2023-10-10T22:18:45', 'first': '2023-10-10T22:19:00', 'last': '2023-10-10T22:34:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-10-10T22:34:17.974 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-10-10T22:34:17.974 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-10-10T22:34:17.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-10T22:34:18.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.161+0000 7fbb0d39d700 1 Processor -- start 2023-10-10T22:34:18.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.162+0000 7fbb0d39d700 1 -- start start 2023-10-10T22:34:18.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb0d39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbb08156350 0x7fbb08157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:18.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb0d39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb080b0760 0x7fbb080b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:18.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb0d39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08159f20 0x7fbb0815a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:18.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb0d39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb080b1140 con 0x7fbb080b0760 2023-10-10T22:34:18.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb0d39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb080b0570 con 0x7fbb08156350 2023-10-10T22:34:18.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb0d39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb081578b0 con 0x7fbb08159f20 2023-10-10T22:34:18.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb077fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb080b0760 0x7fbb080b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:18.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb077fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb080b0760 0x7fbb080b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52894/0 (socket says 172.21.15.154:52894) 2023-10-10T22:34:18.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb077fe700 1 -- 172.21.15.154:0/2302858252 learned_addr learned my addr 172.21.15.154:0/2302858252 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:18.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb07fff700 1 --2- 172.21.15.154:0/2302858252 >> v2:172.21.15.179:3300/0 conn(0x7fbb08156350 0x7fbb08157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:18.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.163+0000 7fbb0cb9c700 1 --2- 172.21.15.154:0/2302858252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08159f20 0x7fbb0815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:18.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb077fe700 1 -- 172.21.15.154:0/2302858252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08159f20 msgr2=0x7fbb0815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:18.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb077fe700 1 --2- 172.21.15.154:0/2302858252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08159f20 0x7fbb0815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb077fe700 1 -- 172.21.15.154:0/2302858252 >> v2:172.21.15.179:3300/0 conn(0x7fbb08156350 msgr2=0x7fbb08157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:18.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb077fe700 1 --2- 172.21.15.154:0/2302858252 >> v2:172.21.15.179:3300/0 conn(0x7fbb08156350 0x7fbb08157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb077fe700 1 -- 172.21.15.154:0/2302858252 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080af4d0 con 0x7fbb080b0760 2023-10-10T22:34:18.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb0cb9c700 1 --2- 172.21.15.154:0/2302858252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08159f20 0x7fbb0815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:18.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb07fff700 1 --2- 172.21.15.154:0/2302858252 >> v2:172.21.15.179:3300/0 conn(0x7fbb08156350 0x7fbb08157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:18.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb077fe700 1 --2- 172.21.15.154:0/2302858252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb080b0760 0x7fbb080b0c00 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fbb08065950 tx=0x7fbafc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90439f444e0e76d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:18.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb06ffd700 1 -- 172.21.15.154:0/2302858252 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc00b860 con 0x7fbb080b0760 2023-10-10T22:34:18.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb06ffd700 1 -- 172.21.15.154:0/2302858252 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc00b9c0 con 0x7fbb080b0760 2023-10-10T22:34:18.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.164+0000 7fbb06ffd700 1 -- 172.21.15.154:0/2302858252 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc00bd60 con 0x7fbb080b0760 2023-10-10T22:34:18.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.165+0000 7fbb0d39d700 1 -- 172.21.15.154:0/2302858252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb080b0760 msgr2=0x7fbb080b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:18.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.165+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/2302858252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb080b0760 0x7fbb080b0c00 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fbb08065950 tx=0x7fbafc009250 comp rx=0 tx=0).stop 2023-10-10T22:34:18.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.165+0000 7fbb0d39d700 1 -- 172.21.15.154:0/2302858252 shutdown_connections 2023-10-10T22:34:18.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.165+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/2302858252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08159f20 0x7fbb0815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.165+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/2302858252 >> v2:172.21.15.179:3300/0 conn(0x7fbb08156350 0x7fbb08157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.165+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/2302858252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb080b0760 0x7fbb080b0c00 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.165+0000 7fbb0d39d700 1 -- 172.21.15.154:0/2302858252 >> 172.21.15.154:0/2302858252 conn(0x7fbb08068e20 msgr2=0x7fbb080cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:18.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.165+0000 7fbb0d39d700 1 -- 172.21.15.154:0/2302858252 shutdown_connections 2023-10-10T22:34:18.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.165+0000 7fbb0d39d700 1 -- 172.21.15.154:0/2302858252 wait complete. 2023-10-10T22:34:18.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.166+0000 7fbb0d39d700 1 Processor -- start 2023-10-10T22:34:18.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.166+0000 7fbb0d39d700 1 -- start start 2023-10-10T22:34:18.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.167+0000 7fbb0d39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb080b0760 0x7fbb080ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:18.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.167+0000 7fbb0d39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08156350 0x7fbb0814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:18.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.167+0000 7fbb0d39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb08159f20 0x7fbb080ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:18.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.167+0000 7fbb0d39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080ae3c0 con 0x7fbb08159f20 2023-10-10T22:34:18.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.167+0000 7fbb0d39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080acde0 con 0x7fbb080b0760 2023-10-10T22:34:18.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.167+0000 7fbb0d39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080ad0c0 con 0x7fbb08156350 2023-10-10T22:34:18.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0cb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb08159f20 0x7fbb080ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:18.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0cb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb08159f20 0x7fbb080ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52904/0 (socket says 172.21.15.154:52904) 2023-10-10T22:34:18.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0cb9c700 1 -- 172.21.15.154:0/4162508558 learned_addr learned my addr 172.21.15.154:0/4162508558 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:18.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb07fff700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb080b0760 0x7fbb080ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:18.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb077fe700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08156350 0x7fbb0814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:18.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0cb9c700 1 -- 172.21.15.154:0/4162508558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08156350 msgr2=0x7fbb0814fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:18.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0cb9c700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08156350 0x7fbb0814fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0cb9c700 1 -- 172.21.15.154:0/4162508558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb080b0760 msgr2=0x7fbb080ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:18.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0cb9c700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb080b0760 0x7fbb080ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0cb9c700 1 -- 172.21.15.154:0/4162508558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc0094f0 con 0x7fbb08159f20 2023-10-10T22:34:18.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0cb9c700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb08159f20 0x7fbb080ade80 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000d0d0 tx=0x7fbb000099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:18.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbaeffff700 1 -- 172.21.15.154:0/4162508558 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000dcc0 con 0x7fbb08159f20 2023-10-10T22:34:18.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbaeffff700 1 -- 172.21.15.154:0/4162508558 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0000f040 con 0x7fbb08159f20 2023-10-10T22:34:18.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb080ad3a0 con 0x7fbb08159f20 2023-10-10T22:34:18.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.168+0000 7fbaeffff700 1 -- 172.21.15.154:0/4162508558 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00015670 con 0x7fbb08159f20 2023-10-10T22:34:18.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.169+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb080ad960 con 0x7fbb08159f20 2023-10-10T22:34:18.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.170+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0806be00 con 0x7fbb08159f20 2023-10-10T22:34:18.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.170+0000 7fbaeffff700 1 -- 172.21.15.154:0/4162508558 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 94) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fbb0001e3b0 con 0x7fbb08159f20 2023-10-10T22:34:18.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.172+0000 7fbaeffff700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbaf40670a0 0x7fbaf4069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:18.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.172+0000 7fbaeffff700 1 -- 172.21.15.154:0/4162508558 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7fbb000851a0 con 0x7fbb08159f20 2023-10-10T22:34:18.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.172+0000 7fbb07fff700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbaf40670a0 0x7fbaf4069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:18.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.172+0000 7fbb07fff700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbaf40670a0 0x7fbaf4069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb080ab670 tx=0x7fbaf8008040 comp rx=0 tx=0).ready entity=mgr.9435 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:18.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.176+0000 7fbaeffff700 1 -- 172.21.15.154:0/4162508558 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb00051d60 con 0x7fbb08159f20 2023-10-10T22:34:18.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.390+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb0804c3c0 con 0x7fbaf40670a0 2023-10-10T22:34:18.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.452+0000 7fbaeffff700 1 -- 172.21.15.154:0/4162508558 <== mgr.9435 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fbb0804c3c0 con 0x7fbaf40670a0 2023-10-10T22:34:18.453 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-10-10T22:34:18.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbaf40670a0 msgr2=0x7fbaf4069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:18.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbaf40670a0 0x7fbaf4069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb080ab670 tx=0x7fbaf8008040 comp rx=0 tx=0).stop 2023-10-10T22:34:18.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb08159f20 msgr2=0x7fbb080ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:18.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb08159f20 0x7fbb080ade80 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000d0d0 tx=0x7fbb000099d0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 shutdown_connections 2023-10-10T22:34:18.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbaf40670a0 0x7fbaf4069550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb08159f20 0x7fbb080ade80 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb080b0760 0x7fbb080ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 --2- 172.21.15.154:0/4162508558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb08156350 0x7fbb0814fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:18.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 >> 172.21.15.154:0/4162508558 conn(0x7fbb08068e20 msgr2=0x7fbb08151c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:18.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 shutdown_connections 2023-10-10T22:34:18.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:18.454+0000 7fbb0d39d700 1 -- 172.21.15.154:0/4162508558 wait complete. 2023-10-10T22:34:18.473 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-10-10T22:34:18.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:18.474 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-10T22:34:18.512 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_19_00_UTC 2023-10-10T22:34:18.512 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_20_00_UTC 2023-10-10T22:34:18.512 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_21_00_UTC 2023-10-10T22:34:18.512 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_22_00_UTC 2023-10-10T22:34:18.513 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_23_00_UTC 2023-10-10T22:34:18.513 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_24_00_UTC 2023-10-10T22:34:18.513 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_25_00_UTC 2023-10-10T22:34:18.513 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_26_00_UTC 2023-10-10T22:34:18.513 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_27_00_UTC 2023-10-10T22:34:18.514 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_28_00_UTC 2023-10-10T22:34:18.514 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_29_00_UTC 2023-10-10T22:34:18.514 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_30_00_UTC 2023-10-10T22:34:18.514 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_31_00_UTC 2023-10-10T22:34:18.514 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_32_00_UTC 2023-10-10T22:34:18.515 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_33_00_UTC 2023-10-10T22:34:18.515 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_34_00_UTC 2023-10-10T22:34:18.516 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_19_00_UTC 2023-10-10T22:34:18.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:18.517 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_19_00_UTC) 2023-10-10T22:34:18.599 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_20_00_UTC 2023-10-10T22:34:18.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:18.599 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_20_00_UTC) 2023-10-10T22:34:18.681 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_21_00_UTC 2023-10-10T22:34:18.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:18.682 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_21_00_UTC) 2023-10-10T22:34:18.763 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_22_00_UTC 2023-10-10T22:34:18.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:18.764 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_22_00_UTC) 2023-10-10T22:34:18.846 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_23_00_UTC 2023-10-10T22:34:18.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:18.847 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_23_00_UTC) 2023-10-10T22:34:18.929 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_24_00_UTC 2023-10-10T22:34:18.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:18.930 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_24_00_UTC) 2023-10-10T22:34:19.011 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_25_00_UTC 2023-10-10T22:34:19.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.012 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_25_00_UTC) 2023-10-10T22:34:19.093 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_26_00_UTC 2023-10-10T22:34:19.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.094 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_26_00_UTC) 2023-10-10T22:34:19.176 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_27_00_UTC 2023-10-10T22:34:19.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.177 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_27_00_UTC) 2023-10-10T22:34:19.258 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_28_00_UTC 2023-10-10T22:34:19.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.259 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_28_00_UTC) 2023-10-10T22:34:19.340 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_29_00_UTC 2023-10-10T22:34:19.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.341 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_29_00_UTC) 2023-10-10T22:34:19.423 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_30_00_UTC 2023-10-10T22:34:19.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.424 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_30_00_UTC) 2023-10-10T22:34:19.505 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_31_00_UTC 2023-10-10T22:34:19.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.507 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_31_00_UTC) 2023-10-10T22:34:19.588 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_32_00_UTC 2023-10-10T22:34:19.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.589 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_32_00_UTC) 2023-10-10T22:34:19.670 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_33_00_UTC 2023-10-10T22:34:19.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.671 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_33_00_UTC) 2023-10-10T22:34:19.754 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_34_00_UTC 2023-10-10T22:34:19.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.755 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-10-22_34_00_UTC) 2023-10-10T22:34:19.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:19.837 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-10-10T22:34:19.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T22:34:20.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.139+0000 7f6fb19ff700 1 Processor -- start 2023-10-10T22:34:20.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.139+0000 7f6fb19ff700 1 -- start start 2023-10-10T22:34:20.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.140+0000 7f6fb19ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fac0c83f0 0x7f6fac0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.140+0000 7f6fb19ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6fac0ccee0 0x7f6fac1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.140+0000 7f6fb19ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac15b0d0 con 0x7f6fac0c87c0 2023-10-10T22:34:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.140+0000 7f6fb19ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac0c7a60 con 0x7f6fac0c83f0 2023-10-10T22:34:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.140+0000 7f6fb19ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac15a4c0 con 0x7f6fac0ccee0 2023-10-10T22:34:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.141+0000 7f6faaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fac0c83f0 0x7f6fac0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.141+0000 7f6faaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fac0c83f0 0x7f6fac0c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52914/0 (socket says 172.21.15.154:52914) 2023-10-10T22:34:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.141+0000 7f6faaffd700 1 -- 172.21.15.154:0/1621399686 learned_addr learned my addr 172.21.15.154:0/1621399686 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.141+0000 7f6faa7fc700 1 --2- 172.21.15.154:0/1621399686 >> v2:172.21.15.179:3300/0 conn(0x7f6fac0ccee0 0x7f6fac1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.141+0000 7f6faaffd700 1 -- 172.21.15.154:0/1621399686 >> v2:172.21.15.179:3300/0 conn(0x7f6fac0ccee0 msgr2=0x7f6fac1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.141+0000 7f6faaffd700 1 --2- 172.21.15.154:0/1621399686 >> v2:172.21.15.179:3300/0 conn(0x7f6fac0ccee0 0x7f6fac1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.141+0000 7f6faaffd700 1 -- 172.21.15.154:0/1621399686 >> v1:172.21.15.179:6789/0 conn(0x7f6fac0c87c0 legacy=0x7f6fac06eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.141+0000 7f6faaffd700 1 -- 172.21.15.154:0/1621399686 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac15a7a0 con 0x7f6fac0c83f0 2023-10-10T22:34:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.141+0000 7f6faaffd700 1 --2- 172.21.15.154:0/1621399686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0c83f0 0x7f6fac0c7520 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0c7eb0 tx=0x7f6f9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72eb819bbb680938 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:20.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fa9ffb700 1 -- 172.21.15.154:0/1621399686 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00b860 con 0x7f6fac0c83f0 2023-10-10T22:34:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fa9ffb700 1 -- 172.21.15.154:0/1621399686 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00b9c0 con 0x7f6fac0c83f0 2023-10-10T22:34:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fa9ffb700 1 -- 172.21.15.154:0/1621399686 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00bd60 con 0x7f6fac0c83f0 2023-10-10T22:34:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fb19ff700 1 -- 172.21.15.154:0/1621399686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0c83f0 msgr2=0x7f6fac0c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fb19ff700 1 --2- 172.21.15.154:0/1621399686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0c83f0 0x7f6fac0c7520 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0c7eb0 tx=0x7f6f9c009250 comp rx=0 tx=0).stop 2023-10-10T22:34:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fb19ff700 1 -- 172.21.15.154:0/1621399686 shutdown_connections 2023-10-10T22:34:20.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fb19ff700 1 --2- 172.21.15.154:0/1621399686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0c83f0 0x7f6fac0c7520 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:20.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fb19ff700 1 --2- 172.21.15.154:0/1621399686 >> v2:172.21.15.179:3300/0 conn(0x7f6fac0ccee0 0x7f6fac1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:20.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fb19ff700 1 -- 172.21.15.154:0/1621399686 >> 172.21.15.154:0/1621399686 conn(0x7f6fac068e10 msgr2=0x7f6fac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:20.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fb19ff700 1 -- 172.21.15.154:0/1621399686 shutdown_connections 2023-10-10T22:34:20.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.142+0000 7f6fb19ff700 1 -- 172.21.15.154:0/1621399686 wait complete. 2023-10-10T22:34:20.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.144+0000 7f6fb19ff700 1 Processor -- start 2023-10-10T22:34:20.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.144+0000 7f6fb19ff700 1 -- start start 2023-10-10T22:34:20.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6fb19ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fac0c83f0 0x7f6fac151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:20.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6fb19ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fac0c87c0 0x7f6fac0c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:20.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6fb19ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0ccee0 0x7f6fac0c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:20.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6fb19ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac1597b0 con 0x7f6fac0ccee0 2023-10-10T22:34:20.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6fb19ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac154050 con 0x7f6fac0c87c0 2023-10-10T22:34:20.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6fb19ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac1591f0 con 0x7f6fac0c83f0 2023-10-10T22:34:20.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6fab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0ccee0 0x7f6fac0c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:20.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6fab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0ccee0 0x7f6fac0c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52930/0 (socket says 172.21.15.154:52930) 2023-10-10T22:34:20.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6fab7fe700 1 -- 172.21.15.154:0/828164511 learned_addr learned my addr 172.21.15.154:0/828164511 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6faaffd700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fac0c83f0 0x7f6fac151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.145+0000 7f6faa7fc700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fac0c87c0 0x7f6fac0c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6fab7fe700 1 -- 172.21.15.154:0/828164511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fac0c83f0 msgr2=0x7f6fac151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6fab7fe700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fac0c83f0 0x7f6fac151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6fab7fe700 1 -- 172.21.15.154:0/828164511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fac0c87c0 msgr2=0x7f6fac0c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6fab7fe700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fac0c87c0 0x7f6fac0c6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6fab7fe700 1 -- 172.21.15.154:0/828164511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c0094f0 con 0x7f6fac0ccee0 2023-10-10T22:34:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6faa7fc700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fac0c87c0 0x7f6fac0c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6fab7fe700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0ccee0 0x7f6fac0c7090 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400c8e0 tx=0x7f6fa4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6f92ffd700 1 -- 172.21.15.154:0/828164511 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4012630 con 0x7f6fac0ccee0 2023-10-10T22:34:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6f92ffd700 1 -- 172.21.15.154:0/828164511 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa4012790 con 0x7f6fac0ccee0 2023-10-10T22:34:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6f92ffd700 1 -- 172.21.15.154:0/828164511 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4012b50 con 0x7f6fac0ccee0 2023-10-10T22:34:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fac1594d0 con 0x7f6fac0ccee0 2023-10-10T22:34:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.146+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac151ab0 con 0x7f6fac0ccee0 2023-10-10T22:34:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.147+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fac1541c0 con 0x7f6fac0ccee0 2023-10-10T22:34:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.148+0000 7f6f92ffd700 1 -- 172.21.15.154:0/828164511 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 94) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f6fa400a3b0 con 0x7f6fac0ccee0 2023-10-10T22:34:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.149+0000 7f6f92ffd700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f980670a0 0x7f6f98069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.149+0000 7f6f92ffd700 1 -- 172.21.15.154:0/828164511 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f6fa4084e70 con 0x7f6fac0ccee0 2023-10-10T22:34:20.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.149+0000 7f6faaffd700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f980670a0 0x7f6f98069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:20.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.150+0000 7f6faaffd700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f980670a0 0x7f6f98069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0c7eb0 tx=0x7f6f9c017000 comp rx=0 tx=0).ready entity=mgr.9435 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:20.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.153+0000 7f6f92ffd700 1 -- 172.21.15.154:0/828164511 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fa4051b40 con 0x7f6fac0ccee0 2023-10-10T22:34:20.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.397+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f6fac04c3c0 con 0x7f6fac0ccee0 2023-10-10T22:34:20.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.730+0000 7f6f92ffd700 1 -- 172.21.15.154:0/828164511 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6fa4051f10 con 0x7f6fac0ccee0 2023-10-10T22:34:20.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.731+0000 7f6f92ffd700 1 -- 172.21.15.154:0/828164511 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v95) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6fa4051b40 con 0x7f6fac0ccee0 2023-10-10T22:34:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f980670a0 msgr2=0x7f6f98069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f980670a0 0x7f6f98069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0c7eb0 tx=0x7f6f9c017000 comp rx=0 tx=0).stop 2023-10-10T22:34:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0ccee0 msgr2=0x7f6fac0c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0ccee0 0x7f6fac0c7090 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400c8e0 tx=0x7f6fa4001710 comp rx=0 tx=0).stop 2023-10-10T22:34:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 shutdown_connections 2023-10-10T22:34:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f980670a0 0x7f6f98069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac0ccee0 0x7f6fac0c7090 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fac0c83f0 0x7f6fac151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 --2- 172.21.15.154:0/828164511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fac0c87c0 0x7f6fac0c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 >> 172.21.15.154:0/828164511 conn(0x7f6fac068e10 msgr2=0x7f6fac151e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 shutdown_connections 2023-10-10T22:34:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:20.733+0000 7f6fb19ff700 1 -- 172.21.15.154:0/828164511 wait complete. 2023-10-10T22:34:20.754 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T22:34:20.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:34:20.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:34:20.912 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T22:34:20.913 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T22:34:20.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:20.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T22:34:21.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:34:21.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:34:21.005 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T22:34:21.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:34:21.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.279+0000 7f312cd9d700 1 Processor -- start 2023-10-10T22:34:21.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.279+0000 7f312cd9d700 1 -- start start 2023-10-10T22:34:21.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.280+0000 7f312cd9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31281566e0 0x7f31280ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.280+0000 7f312cd9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31280ca860 con 0x7f31280cb900 2023-10-10T22:34:21.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.280+0000 7f312cd9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31280cab40 con 0x7f3128156310 2023-10-10T22:34:21.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.280+0000 7f312cd9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31280cae20 con 0x7f31281566e0 2023-10-10T22:34:21.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f3127fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f31280cb900 0x7f31280c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46974/0 (socket says 172.21.15.154:46974) 2023-10-10T22:34:21.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f3127fff700 1 -- 172.21.15.154:0/2491436852 learned_addr learned my addr 172.21.15.154:0/2491436852 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:21.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f3126ffd700 1 --2- 172.21.15.154:0/2491436852 >> v2:172.21.15.179:3300/0 conn(0x7f31281566e0 0x7f31280ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:21.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f31267fc700 1 -- 172.21.15.154:0/2491436852 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288375754 0 0) 0x7f31280cab40 con 0x7f3128156310 2023-10-10T22:34:21.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f31267fc700 1 -- 172.21.15.154:0/2491436852 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3110003570 con 0x7f3128156310 2023-10-10T22:34:21.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f31267fc700 1 -- 172.21.15.154:0/2491436852 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368036884 0 0) 0x7f31280ca860 con 0x7f31280cb900 2023-10-10T22:34:21.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f31267fc700 1 -- 172.21.15.154:0/2491436852 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31280cab40 con 0x7f31280cb900 2023-10-10T22:34:21.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f3126ffd700 1 -- 172.21.15.154:0/2491436852 >> v1:172.21.15.179:6789/0 conn(0x7f3128156310 legacy=0x7f31280c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f3126ffd700 1 -- 172.21.15.154:0/2491436852 >> v1:172.21.15.154:6789/0 conn(0x7f31280cb900 legacy=0x7f31280c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.281+0000 7f3126ffd700 1 -- 172.21.15.154:0/2491436852 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31280cb100 con 0x7f31281566e0 2023-10-10T22:34:21.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.282+0000 7f3126ffd700 1 --2- 172.21.15.154:0/2491436852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31281566e0 0x7f31280ae000 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f311c0098e0 tx=0x7f311c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b04970bf89ef57df server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:21.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.282+0000 7f31267fc700 1 -- 172.21.15.154:0/2491436852 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c011630 con 0x7f31281566e0 2023-10-10T22:34:21.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.282+0000 7f31267fc700 1 -- 172.21.15.154:0/2491436852 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311c011790 con 0x7f31281566e0 2023-10-10T22:34:21.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.282+0000 7f31267fc700 1 -- 172.21.15.154:0/2491436852 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c011b30 con 0x7f31281566e0 2023-10-10T22:34:21.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.283+0000 7f312cd9d700 1 -- 172.21.15.154:0/2491436852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31281566e0 msgr2=0x7f31280ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.283+0000 7f312cd9d700 1 --2- 172.21.15.154:0/2491436852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31281566e0 0x7f31280ae000 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f311c0098e0 tx=0x7f311c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.283+0000 7f312cd9d700 1 -- 172.21.15.154:0/2491436852 shutdown_connections 2023-10-10T22:34:21.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.283+0000 7f312cd9d700 1 --2- 172.21.15.154:0/2491436852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31281566e0 0x7f31280ae000 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.283+0000 7f312cd9d700 1 -- 172.21.15.154:0/2491436852 >> 172.21.15.154:0/2491436852 conn(0x7f31280cc1f0 msgr2=0x7f31280cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:21.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.283+0000 7f312cd9d700 1 -- 172.21.15.154:0/2491436852 shutdown_connections 2023-10-10T22:34:21.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.283+0000 7f312cd9d700 1 -- 172.21.15.154:0/2491436852 wait complete. 2023-10-10T22:34:21.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.284+0000 7f312cd9d700 1 Processor -- start 2023-10-10T22:34:21.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.284+0000 7f312cd9d700 1 -- start start 2023-10-10T22:34:21.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.285+0000 7f312cd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31280cb900 0x7f3128149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.285+0000 7f312cd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3128156310 0x7f312815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.285+0000 7f312cd9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31281566e0 0x7f312815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.285+0000 7f312cd9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3128160120 con 0x7f31281566e0 2023-10-10T22:34:21.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.285+0000 7f312cd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312815f2c0 con 0x7f3128156310 2023-10-10T22:34:21.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.285+0000 7f312cd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312815f5a0 con 0x7f31280cb900 2023-10-10T22:34:21.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.285+0000 7f3127fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31281566e0 0x7f312815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:21.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3126ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3128156310 0x7f312815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:21.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3127fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31281566e0 0x7f312815cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52958/0 (socket says 172.21.15.154:52958) 2023-10-10T22:34:21.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3127fff700 1 -- 172.21.15.154:0/1635044737 learned_addr learned my addr 172.21.15.154:0/1635044737 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:21.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f31277fe700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31280cb900 0x7f3128149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:21.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3127fff700 1 -- 172.21.15.154:0/1635044737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31280cb900 msgr2=0x7f3128149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3127fff700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31280cb900 0x7f3128149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3127fff700 1 -- 172.21.15.154:0/1635044737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3128156310 msgr2=0x7f312815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3127fff700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3128156310 0x7f312815c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3127fff700 1 -- 172.21.15.154:0/1635044737 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c009420 con 0x7f31281566e0 2023-10-10T22:34:21.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3126ffd700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3128156310 0x7f312815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:21.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f31277fe700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31280cb900 0x7f3128149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:21.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.286+0000 7f3127fff700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31281566e0 0x7f312815cd00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f312000cbc0 tx=0x7f31200019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:21.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.287+0000 7f310f7fe700 1 -- 172.21.15.154:0/1635044737 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000a7e0 con 0x7f31281566e0 2023-10-10T22:34:21.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.287+0000 7f310f7fe700 1 -- 172.21.15.154:0/1635044737 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312000a940 con 0x7f31281566e0 2023-10-10T22:34:21.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.287+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312815f880 con 0x7f31281566e0 2023-10-10T22:34:21.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.287+0000 7f310f7fe700 1 -- 172.21.15.154:0/1635044737 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000ad00 con 0x7f31281566e0 2023-10-10T22:34:21.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.287+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312815fe40 con 0x7f31281566e0 2023-10-10T22:34:21.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.288+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31280c4300 con 0x7f31281566e0 2023-10-10T22:34:21.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.289+0000 7f310f7fe700 1 -- 172.21.15.154:0/1635044737 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f3120007300 con 0x7f31281566e0 2023-10-10T22:34:21.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.289+0000 7f310f7fe700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3114067050 0x7f3114069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.290+0000 7f310f7fe700 1 -- 172.21.15.154:0/1635044737 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f3120084d60 con 0x7f31281566e0 2023-10-10T22:34:21.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.290+0000 7f31277fe700 1 -- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3114067050 msgr2=0x7f3114069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:21.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.290+0000 7f31277fe700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3114067050 0x7f3114069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:21.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.296+0000 7f310f7fe700 1 -- 172.21.15.154:0/1635044737 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31280c4300 con 0x7f31281566e0 2023-10-10T22:34:21.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.491+0000 7f31277fe700 1 -- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3114067050 msgr2=0x7f3114069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:21.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.491+0000 7f31277fe700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3114067050 0x7f3114069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:21.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.540+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31280c4300 con 0x7f31281566e0 2023-10-10T22:34:21.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.541+0000 7f310f7fe700 1 -- 172.21.15.154:0/1635044737 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4613 (secure 0 0 0) 0x7f31280c4300 con 0x7f31281566e0 2023-10-10T22:34:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:21.544 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3140311410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3140311410},{"type":"v1","addr":"172.21.15.179:6835","nonce":3140311410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2649941331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2649941331},{"type":"v1","addr":"172.21.15.179:6834","nonce":2649941331}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3061056526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3061056526},{"type":"v1","addr":"172.21.15.154:6834","nonce":3061056526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:18:23.465253+0000","modified":"2023-10-10T22:18:27.020551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9138":{"gid":9138,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3697556207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3697556207},{"type":"v1","addr":"172.21.15.154:6835","nonce":3697556207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-10T22:34:21.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.543+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3114067050 msgr2=0x7f3114069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:21.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.543+0000 7f312cd9d700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3114067050 0x7f3114069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.543+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31281566e0 msgr2=0x7f312815cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.543+0000 7f312cd9d700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31281566e0 0x7f312815cd00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f312000cbc0 tx=0x7f31200019f0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.544+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 shutdown_connections 2023-10-10T22:34:21.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.544+0000 7f312cd9d700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3114067050 0x7f3114069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.544+0000 7f312cd9d700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31281566e0 0x7f312815cd00 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.544+0000 7f312cd9d700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31280cb900 0x7f3128149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.544+0000 7f312cd9d700 1 --2- 172.21.15.154:0/1635044737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3128156310 0x7f312815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.544+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 >> 172.21.15.154:0/1635044737 conn(0x7f31280cc1f0 msgr2=0x7f31280b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:21.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.544+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 shutdown_connections 2023-10-10T22:34:21.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.544+0000 7f312cd9d700 1 -- 172.21.15.154:0/1635044737 wait complete. 2023-10-10T22:34:21.549 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 78 2023-10-10T22:34:21.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:34:21.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.753+0000 7f156af9d700 1 Processor -- start 2023-10-10T22:34:21.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.753+0000 7f156af9d700 1 -- start start 2023-10-10T22:34:21.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f156af9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15640ad870 0x7f156406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f156af9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f156406bf20 0x7f156406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f156af9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156406c350 con 0x7f1564142ea0 2023-10-10T22:34:21.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f156af9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15640b40f0 con 0x7f156406bf20 2023-10-10T22:34:21.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f156af9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1564069640 con 0x7f15640ad870 2023-10-10T22:34:21.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f1569f9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1564142ea0 0x7f15640b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46990/0 (socket says 172.21.15.154:46990) 2023-10-10T22:34:21.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f1569f9b700 1 -- 172.21.15.154:0/4149508037 learned_addr learned my addr 172.21.15.154:0/4149508037 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:21.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f156a79c700 1 --2- 172.21.15.154:0/4149508037 >> v2:172.21.15.179:3300/0 conn(0x7f156406bf20 0x7f156406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:21.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f156979a700 1 --2- 172.21.15.154:0/4149508037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15640ad870 0x7f156406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:21.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.755+0000 7f1568f99700 1 -- 172.21.15.154:0/4149508037 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121417985 0 0) 0x7f156406c350 con 0x7f1564142ea0 2023-10-10T22:34:21.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.756+0000 7f1568f99700 1 -- 172.21.15.154:0/4149508037 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1550003570 con 0x7f1564142ea0 2023-10-10T22:34:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.756+0000 7f156a79c700 1 -- 172.21.15.154:0/4149508037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15640ad870 msgr2=0x7f156406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.756+0000 7f156a79c700 1 --2- 172.21.15.154:0/4149508037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15640ad870 0x7f156406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.756+0000 7f156a79c700 1 -- 172.21.15.154:0/4149508037 >> v1:172.21.15.154:6789/0 conn(0x7f1564142ea0 legacy=0x7f15640b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.756+0000 7f156a79c700 1 -- 172.21.15.154:0/4149508037 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564069920 con 0x7f156406bf20 2023-10-10T22:34:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.756+0000 7f156a79c700 1 --2- 172.21.15.154:0/4149508037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156406bf20 0x7f156406a120 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f155c009e60 tx=0x7f155c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b21baeb7a70130 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:21.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.756+0000 7f1568f99700 1 -- 172.21.15.154:0/4149508037 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c00e070 con 0x7f156406bf20 2023-10-10T22:34:21.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.756+0000 7f1568f99700 1 -- 172.21.15.154:0/4149508037 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c00bab0 con 0x7f156406bf20 2023-10-10T22:34:21.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.756+0000 7f1568f99700 1 -- 172.21.15.154:0/4149508037 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c00be70 con 0x7f156406bf20 2023-10-10T22:34:21.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.757+0000 7f156af9d700 1 -- 172.21.15.154:0/4149508037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156406bf20 msgr2=0x7f156406a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.757+0000 7f156af9d700 1 --2- 172.21.15.154:0/4149508037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156406bf20 0x7f156406a120 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f155c009e60 tx=0x7f155c009780 comp rx=0 tx=0).stop 2023-10-10T22:34:21.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.757+0000 7f156af9d700 1 -- 172.21.15.154:0/4149508037 shutdown_connections 2023-10-10T22:34:21.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.757+0000 7f156af9d700 1 --2- 172.21.15.154:0/4149508037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156406bf20 0x7f156406a120 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.757+0000 7f156af9d700 1 --2- 172.21.15.154:0/4149508037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15640ad870 0x7f156406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.757+0000 7f156af9d700 1 -- 172.21.15.154:0/4149508037 >> 172.21.15.154:0/4149508037 conn(0x7f15640ce430 msgr2=0x7f15640ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:21.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.757+0000 7f156af9d700 1 -- 172.21.15.154:0/4149508037 shutdown_connections 2023-10-10T22:34:21.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.757+0000 7f156af9d700 1 -- 172.21.15.154:0/4149508037 wait complete. 2023-10-10T22:34:21.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.758+0000 7f156af9d700 1 Processor -- start 2023-10-10T22:34:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.759+0000 7f156af9d700 1 -- start start 2023-10-10T22:34:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.759+0000 7f156af9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156406bf20 0x7f1564158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.759+0000 7f156af9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564142ea0 0x7f156406a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.759+0000 7f156af9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156406ad90 0x7f1564169c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.759+0000 7f156af9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156406b230 con 0x7f1564142ea0 2023-10-10T22:34:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.759+0000 7f156af9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156416ab90 con 0x7f156406ad90 2023-10-10T22:34:21.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.759+0000 7f156af9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15640c8f80 con 0x7f156406bf20 2023-10-10T22:34:21.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f156979a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564142ea0 0x7f156406a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:21.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f1569f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156406bf20 0x7f1564158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:21.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f156979a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564142ea0 0x7f156406a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52966/0 (socket says 172.21.15.154:52966) 2023-10-10T22:34:21.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f156979a700 1 -- 172.21.15.154:0/1074975998 learned_addr learned my addr 172.21.15.154:0/1074975998 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:21.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f1569f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156406bf20 0x7f1564158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:52400/0 (socket says 172.21.15.154:52400) 2023-10-10T22:34:21.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f156a79c700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156406ad90 0x7f1564169c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:21.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f156979a700 1 -- 172.21.15.154:0/1074975998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156406bf20 msgr2=0x7f1564158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f156979a700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156406bf20 0x7f1564158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f156979a700 1 -- 172.21.15.154:0/1074975998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156406ad90 msgr2=0x7f1564169c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f156979a700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156406ad90 0x7f1564169c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.760+0000 7f156979a700 1 -- 172.21.15.154:0/1074975998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c009a20 con 0x7f1564142ea0 2023-10-10T22:34:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.761+0000 7f156979a700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564142ea0 0x7f156406a850 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f155400ec80 tx=0x7f15540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.761+0000 7f1559ffb700 1 -- 172.21.15.154:0/1074975998 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400c850 con 0x7f1564142ea0 2023-10-10T22:34:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.761+0000 7f1559ffb700 1 -- 172.21.15.154:0/1074975998 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155400c9b0 con 0x7f1564142ea0 2023-10-10T22:34:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.761+0000 7f1559ffb700 1 -- 172.21.15.154:0/1074975998 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400cd50 con 0x7f1564142ea0 2023-10-10T22:34:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.761+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15641592e0 con 0x7f1564142ea0 2023-10-10T22:34:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.761+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156416a8b0 con 0x7f1564142ea0 2023-10-10T22:34:21.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.762+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156404c3c0 con 0x7f1564142ea0 2023-10-10T22:34:21.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.763+0000 7f1559ffb700 1 -- 172.21.15.154:0/1074975998 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f1554013680 con 0x7f1564142ea0 2023-10-10T22:34:21.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.764+0000 7f1559ffb700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1548067120 0x7f15480695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:21.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.764+0000 7f1559ffb700 1 -- 172.21.15.154:0/1074975998 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f1554084d20 con 0x7f1564142ea0 2023-10-10T22:34:21.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.764+0000 7f1569f9b700 1 -- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1548067120 msgr2=0x7f15480695d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:21.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.764+0000 7f1569f9b700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1548067120 0x7f15480695d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:21.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.768+0000 7f1559ffb700 1 -- 172.21.15.154:0/1074975998 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1554051a70 con 0x7f1564142ea0 2023-10-10T22:34:21.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.965+0000 7f1569f9b700 1 -- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1548067120 msgr2=0x7f15480695d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:21.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.965+0000 7f1569f9b700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1548067120 0x7f15480695d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:21.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.969+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15640c90c0 con 0x7f1564142ea0 2023-10-10T22:34:21.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.970+0000 7f1559ffb700 1 -- 172.21.15.154:0/1074975998 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+16921 (secure 0 0 0) 0x7f1554055090 con 0x7f1564142ea0 2023-10-10T22:34:21.973 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:21.973 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":179,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:29:23.075334+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:18:21.404071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-10T22:18:22.445408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.2b","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/498340340":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/343743971":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/3925921356":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/2315091237":"2023-10-11T22:29:23.075298+0000","172.21.15.154:6837/85496":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/2413918626":"2023-10-11T22:29:23.075298+0000","172.21.15.154:6836/85496":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/227322610":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/2303751617":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/3605187556":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/2055186398":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/1018803754":"2023-10-11T22:18:44.244130+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:34:21.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1548067120 msgr2=0x7f15480695d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:21.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1548067120 0x7f15480695d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564142ea0 msgr2=0x7f156406a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:21.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564142ea0 0x7f156406a850 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f155400ec80 tx=0x7f15540091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 shutdown_connections 2023-10-10T22:34:21.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1548067120 0x7f15480695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f156406ad90 0x7f1564169c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f156406bf20 0x7f1564158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 --2- 172.21.15.154:0/1074975998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564142ea0 0x7f156406a850 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:21.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 >> 172.21.15.154:0/1074975998 conn(0x7f15640ce430 msgr2=0x7f15640cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:21.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 shutdown_connections 2023-10-10T22:34:21.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:21.973+0000 7f156af9d700 1 -- 172.21.15.154:0/1074975998 wait complete. 2023-10-10T22:34:21.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T22:18:21.404071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T22:18:22.445408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T22:34:21.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T22:34:22.011 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:22.010+0000 7f3597687180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:34:22.095 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:22.092+0000 7fe8c8164180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:34:22.175 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:22.173+0000 7f3597687180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:34:22.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.183+0000 7f5eef59e700 1 Processor -- start 2023-10-10T22:34:22.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.183+0000 7f5eef59e700 1 -- start start 2023-10-10T22:34:22.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.185+0000 7f5eef59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b16d0 0x7f5ef00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.185+0000 7f5eef59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ef00b33b0 0x7f5ef00b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.185+0000 7f5eef59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef00b2080 con 0x7f5ef00b4e70 2023-10-10T22:34:22.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.185+0000 7f5eef59e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef00cfb00 con 0x7f5ef00b33b0 2023-10-10T22:34:22.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.185+0000 7f5eef59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00b5c40 con 0x7f5ef00b16d0 2023-10-10T22:34:22.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.185+0000 7f5eee59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5ef00b4e70 0x7f5ef00ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47002/0 (socket says 172.21.15.154:47002) 2023-10-10T22:34:22.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.185+0000 7f5eee59c700 1 -- 172.21.15.154:0/564168562 learned_addr learned my addr 172.21.15.154:0/564168562 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:22.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.185+0000 7f5eedd9b700 1 --2- 172.21.15.154:0/564168562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b16d0 0x7f5ef00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.185+0000 7f5eeed9d700 1 --2- 172.21.15.154:0/564168562 >> v2:172.21.15.154:3300/0 conn(0x7f5ef00b33b0 0x7f5ef00b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eed59a700 1 -- 172.21.15.154:0/564168562 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610552944 0 0) 0x7f5ef00b2080 con 0x7f5ef00b4e70 2023-10-10T22:34:22.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eed59a700 1 -- 172.21.15.154:0/564168562 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed8003570 con 0x7f5ef00b4e70 2023-10-10T22:34:22.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eeed9d700 1 -- 172.21.15.154:0/564168562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b16d0 msgr2=0x7f5ef00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:22.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eeed9d700 1 --2- 172.21.15.154:0/564168562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b16d0 0x7f5ef00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eeed9d700 1 -- 172.21.15.154:0/564168562 >> v1:172.21.15.154:6789/0 conn(0x7f5ef00b4e70 legacy=0x7f5ef00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eeed9d700 1 -- 172.21.15.154:0/564168562 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00b5f20 con 0x7f5ef00b33b0 2023-10-10T22:34:22.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eedd9b700 1 --2- 172.21.15.154:0/564168562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b16d0 0x7f5ef00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:22.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eeed9d700 1 --2- 172.21.15.154:0/564168562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b33b0 0x7f5ef00b3830 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009e60 tx=0x7f5ee8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5864948d06c7ce server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:22.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eed59a700 1 -- 172.21.15.154:0/564168562 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800e070 con 0x7f5ef00b33b0 2023-10-10T22:34:22.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eed59a700 1 -- 172.21.15.154:0/564168562 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee800bab0 con 0x7f5ef00b33b0 2023-10-10T22:34:22.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.186+0000 7f5eed59a700 1 -- 172.21.15.154:0/564168562 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800be50 con 0x7f5ef00b33b0 2023-10-10T22:34:22.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.187+0000 7f5eef59e700 1 -- 172.21.15.154:0/564168562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b33b0 msgr2=0x7f5ef00b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.187+0000 7f5eef59e700 1 --2- 172.21.15.154:0/564168562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b33b0 0x7f5ef00b3830 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009e60 tx=0x7f5ee8009780 comp rx=0 tx=0).stop 2023-10-10T22:34:22.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.187+0000 7f5eef59e700 1 -- 172.21.15.154:0/564168562 shutdown_connections 2023-10-10T22:34:22.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.187+0000 7f5eef59e700 1 --2- 172.21.15.154:0/564168562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b33b0 0x7f5ef00b3830 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.187+0000 7f5eef59e700 1 --2- 172.21.15.154:0/564168562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b16d0 0x7f5ef00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.187+0000 7f5eef59e700 1 -- 172.21.15.154:0/564168562 >> 172.21.15.154:0/564168562 conn(0x7f5ef00d10c0 msgr2=0x7f5ef00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:22.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.187+0000 7f5eef59e700 1 -- 172.21.15.154:0/564168562 shutdown_connections 2023-10-10T22:34:22.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.187+0000 7f5eef59e700 1 -- 172.21.15.154:0/564168562 wait complete. 2023-10-10T22:34:22.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.188+0000 7f5eef59e700 1 Processor -- start 2023-10-10T22:34:22.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.189+0000 7f5eef59e700 1 -- start start 2023-10-10T22:34:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.189+0000 7f5eef59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b16d0 0x7f5ef00c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.189+0000 7f5eef59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b33b0 0x7f5ef00ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.189+0000 7f5eef59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef00b4e70 0x7f5ef00c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.189+0000 7f5eef59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00c8220 con 0x7f5ef00b16d0 2023-10-10T22:34:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.189+0000 7f5eef59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00c8500 con 0x7f5ef00b4e70 2023-10-10T22:34:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eef59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00c87e0 con 0x7f5ef00b33b0 2023-10-10T22:34:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eee59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b16d0 0x7f5ef00c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eee59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b16d0 0x7f5ef00c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52984/0 (socket says 172.21.15.154:52984) 2023-10-10T22:34:22.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eee59c700 1 -- 172.21.15.154:0/2760723427 learned_addr learned my addr 172.21.15.154:0/2760723427 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:22.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eedd9b700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b33b0 0x7f5ef00ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eeed9d700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef00b4e70 0x7f5ef00c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eee59c700 1 -- 172.21.15.154:0/2760723427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b33b0 msgr2=0x7f5ef00ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eee59c700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b33b0 0x7f5ef00ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eee59c700 1 -- 172.21.15.154:0/2760723427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef00b4e70 msgr2=0x7f5ef00c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eee59c700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef00b4e70 0x7f5ef00c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eee59c700 1 -- 172.21.15.154:0/2760723427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee4009420 con 0x7f5ef00b16d0 2023-10-10T22:34:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eeed9d700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef00b4e70 0x7f5ef00c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.190+0000 7f5eee59c700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b16d0 0x7f5ef00c7b80 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000c590 tx=0x7f5ee0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:22.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.191+0000 7f5ede7fc700 1 -- 172.21.15.154:0/2760723427 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0005cd0 con 0x7f5ef00b16d0 2023-10-10T22:34:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.191+0000 7f5ede7fc700 1 -- 172.21.15.154:0/2760723427 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee0005e50 con 0x7f5ef00b16d0 2023-10-10T22:34:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.191+0000 7f5ede7fc700 1 -- 172.21.15.154:0/2760723427 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0007320 con 0x7f5ef00b16d0 2023-10-10T22:34:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.191+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee8009a20 con 0x7f5ef00b16d0 2023-10-10T22:34:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.191+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef00c8da0 con 0x7f5ef00b16d0 2023-10-10T22:34:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.192+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef0088990 con 0x7f5ef00b16d0 2023-10-10T22:34:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.193+0000 7f5ede7fc700 1 -- 172.21.15.154:0/2760723427 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f5ee001b3b0 con 0x7f5ef00b16d0 2023-10-10T22:34:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.194+0000 7f5ede7fc700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ed0067050 0x7f5ed0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.194+0000 7f5ede7fc700 1 -- 172.21.15.154:0/2760723427 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f5ee0084230 con 0x7f5ef00b16d0 2023-10-10T22:34:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.194+0000 7f5eedd9b700 1 -- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ed0067050 msgr2=0x7f5ed0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.194+0000 7f5eedd9b700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ed0067050 0x7f5ed0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.198+0000 7f5ede7fc700 1 -- 172.21.15.154:0/2760723427 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ee0050f00 con 0x7f5ef00b16d0 2023-10-10T22:34:22.261 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:22.260+0000 7f3597687180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:34:22.268 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:22.266+0000 7fe8c8164180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:34:22.357 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:22.355+0000 7fe8c8164180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:34:22.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.395+0000 7f5eedd9b700 1 -- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ed0067050 msgr2=0x7f5ed0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:22.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.395+0000 7f5eedd9b700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ed0067050 0x7f5ed0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:22.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.397+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ef004bb80 con 0x7f5ef00b16d0 2023-10-10T22:34:22.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.397+0000 7f5ede7fc700 1 -- 172.21.15.154:0/2760723427 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ee0054520 con 0x7f5ef00b16d0 2023-10-10T22:34:22.400 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T22:34:22.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ed0067050 msgr2=0x7f5ed0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ed0067050 0x7f5ed0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b16d0 msgr2=0x7f5ef00c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b16d0 0x7f5ef00c7b80 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000c590 tx=0x7f5ee0007e00 comp rx=0 tx=0).stop 2023-10-10T22:34:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 shutdown_connections 2023-10-10T22:34:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ed0067050 0x7f5ed0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ef00b4e70 0x7f5ef00c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ef00b16d0 0x7f5ef00c7b80 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 --2- 172.21.15.154:0/2760723427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ef00b33b0 0x7f5ef00ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 >> 172.21.15.154:0/2760723427 conn(0x7f5ef00d10c0 msgr2=0x7f5ef015f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 shutdown_connections 2023-10-10T22:34:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.400+0000 7f5eef59e700 1 -- 172.21.15.154:0/2760723427 wait complete. 2023-10-10T22:34:22.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T22:34:22.485 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:22.484+0000 7f3597687180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:34:22.595 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:22.592+0000 7fe8c8164180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:34:22.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.611+0000 7f577b59e700 1 Processor -- start 2023-10-10T22:34:22.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.611+0000 7f577b59e700 1 -- start start 2023-10-10T22:34:22.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.612+0000 7f577b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c06e470 0x7f577c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.612+0000 7f577b59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577c0aea70 con 0x7f577c0aef00 2023-10-10T22:34:22.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.612+0000 7f577b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577c15dad0 con 0x7f577c15a3b0 2023-10-10T22:34:22.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.612+0000 7f577b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c06ee30 con 0x7f577c06e470 2023-10-10T22:34:22.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.612+0000 7f5779d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f577c0aef00 0x7f577c15d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47012/0 (socket says 172.21.15.154:47012) 2023-10-10T22:34:22.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.612+0000 7f5779d9b700 1 -- 172.21.15.154:0/4107143827 learned_addr learned my addr 172.21.15.154:0/4107143827 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:22.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577ad9d700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c06e470 0x7f577c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748015201 0 0) 0x7f577c0aea70 con 0x7f577c0aef00 2023-10-10T22:34:22.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5764003570 con 0x7f577c0aef00 2023-10-10T22:34:22.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195694996 0 0) 0x7f577c15dad0 con 0x7f577c15a3b0 2023-10-10T22:34:22.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f577c0aea70 con 0x7f577c15a3b0 2023-10-10T22:34:22.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2626782162 0 0) 0x7f5764003570 con 0x7f577c0aef00 2023-10-10T22:34:22.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c06e470 msgr2=0x7f577c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:22.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c06e470 0x7f577c06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 >> v1:172.21.15.179:6789/0 conn(0x7f577c15a3b0 legacy=0x7f577c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c0ae480 con 0x7f577c0aef00 2023-10-10T22:34:22.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f5770001470 con 0x7f577c0aef00 2023-10-10T22:34:22.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577ad9d700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c06e470 0x7f577c06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:22.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 >> v1:172.21.15.154:6789/0 conn(0x7f577c0aef00 legacy=0x7f577c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 0x7f5764004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c06e470 0x7f5764004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5764004d50 0x7f57640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c06ee30 con 0x7f5764003c20 2023-10-10T22:34:22.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576400bba0 con 0x7f5764004d50 2023-10-10T22:34:22.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.613+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576400bd60 con 0x7f577c06e470 2023-10-10T22:34:22.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f577a59c700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 0x7f5764004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f577ad9d700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5764004d50 0x7f57640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f5779d9b700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c06e470 0x7f5764004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f577a59c700 1 -- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c06e470 msgr2=0x7f5764004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:22.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f577a59c700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c06e470 0x7f5764004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f577a59c700 1 -- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5764004d50 msgr2=0x7f57640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:22.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f577a59c700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5764004d50 0x7f57640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f577a59c700 1 -- 172.21.15.154:0/4107143827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5774009a20 con 0x7f5764003c20 2023-10-10T22:34:22.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f577ad9d700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5764004d50 0x7f57640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:22.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.614+0000 7f577a59c700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 0x7f5764004030 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f576c001a10 tx=0x7f576c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604db93f1c44743d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:22.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00c5d0 con 0x7f5764003c20 2023-10-10T22:34:22.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00c730 con 0x7f5764003c20 2023-10-10T22:34:22.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577959a700 1 -- 172.21.15.154:0/4107143827 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00cad0 con 0x7f5764003c20 2023-10-10T22:34:22.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577b59e700 1 -- 172.21.15.154:0/4107143827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 msgr2=0x7f5764004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577b59e700 1 --2- 172.21.15.154:0/4107143827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 0x7f5764004030 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f576c001a10 tx=0x7f576c007d30 comp rx=0 tx=0).stop 2023-10-10T22:34:22.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577ad9d700 1 -- 172.21.15.154:0/4107143827 reap_dead start 2023-10-10T22:34:22.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577b59e700 1 -- 172.21.15.154:0/4107143827 shutdown_connections 2023-10-10T22:34:22.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577b59e700 1 -- 172.21.15.154:0/4107143827 >> 172.21.15.154:0/4107143827 conn(0x7f577c0c9f70 msgr2=0x7f577c06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:22.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577b59e700 1 -- 172.21.15.154:0/4107143827 shutdown_connections 2023-10-10T22:34:22.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.615+0000 7f577b59e700 1 -- 172.21.15.154:0/4107143827 wait complete. 2023-10-10T22:34:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.617+0000 7f577b59e700 1 Processor -- start 2023-10-10T22:34:22.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.617+0000 7f577b59e700 1 -- start start 2023-10-10T22:34:22.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f577b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 0x7f577c154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f577b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c152590 0x7f577c151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f577b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cb4f0 0x7f577c0cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f577b59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c155150 con 0x7f5764003c20 2023-10-10T22:34:22.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f577b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c152e90 con 0x7f577c0cb4f0 2023-10-10T22:34:22.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f577b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c0cbe80 con 0x7f577c152590 2023-10-10T22:34:22.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f577a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 0x7f577c154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f5779d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c152590 0x7f577c151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f577ad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cb4f0 0x7f577c0cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:22.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f5779d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c152590 0x7f577c151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:52446/0 (socket says 172.21.15.154:52446) 2023-10-10T22:34:22.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.618+0000 7f5779d9b700 1 -- 172.21.15.154:0/3081340210 learned_addr learned my addr 172.21.15.154:0/3081340210 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:22.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f5779d9b700 1 -- 172.21.15.154:0/3081340210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cb4f0 msgr2=0x7f577c0cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f5779d9b700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cb4f0 0x7f577c0cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f5779d9b700 1 -- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 msgr2=0x7f577c154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f5779d9b700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 0x7f577c154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f5779d9b700 1 -- 172.21.15.154:0/3081340210 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c0c48b0 con 0x7f577c152590 2023-10-10T22:34:22.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f5779d9b700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c152590 0x7f577c151ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5770001ed0 tx=0x7f577c0ae9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:22.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f576a7fc700 1 -- 172.21.15.154:0/3081340210 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770010520 con 0x7f577c152590 2023-10-10T22:34:22.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f576a7fc700 1 -- 172.21.15.154:0/3081340210 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57700106a0 con 0x7f577c152590 2023-10-10T22:34:22.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c0c4b50 con 0x7f577c152590 2023-10-10T22:34:22.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f576a7fc700 1 -- 172.21.15.154:0/3081340210 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770010a60 con 0x7f577c152590 2023-10-10T22:34:22.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.619+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c0c5190 con 0x7f577c152590 2023-10-10T22:34:22.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.620+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c0c53b0 con 0x7f577c152590 2023-10-10T22:34:22.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.621+0000 7f576a7fc700 1 -- 172.21.15.154:0/3081340210 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f577001d3b0 con 0x7f577c152590 2023-10-10T22:34:22.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.622+0000 7f576a7fc700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f575c067050 0x7f575c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:22.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.622+0000 7f577a59c700 1 -- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f575c067050 msgr2=0x7f575c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:22.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.622+0000 7f576a7fc700 1 -- 172.21.15.154:0/3081340210 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f5770084450 con 0x7f577c152590 2023-10-10T22:34:22.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.622+0000 7f577a59c700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f575c067050 0x7f575c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:22.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.626+0000 7f576a7fc700 1 -- 172.21.15.154:0/3081340210 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5770051120 con 0x7f577c152590 2023-10-10T22:34:22.663 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:22.662+0000 7f3597687180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:34:22.757 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:22.755+0000 7f3597687180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:34:22.781 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:22.779+0000 7fe8c8164180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:34:22.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.823+0000 7f577a59c700 1 -- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f575c067050 msgr2=0x7f575c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:22.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.823+0000 7f577a59c700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f575c067050 0x7f575c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.826+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f577c15dd30 con 0x7f577c152590 2023-10-10T22:34:22.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.827+0000 7f576a7fc700 1 -- 172.21.15.154:0/3081340210 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v179) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5770054740 con 0x7f577c152590 2023-10-10T22:34:22.829 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T22:34:22.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f575c067050 msgr2=0x7f575c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:22.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f575c067050 0x7f575c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c152590 msgr2=0x7f577c151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:22.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c152590 0x7f577c151ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5770001ed0 tx=0x7f577c0ae9e0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 shutdown_connections 2023-10-10T22:34:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f575c067050 0x7f575c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cb4f0 0x7f577c0cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5764003c20 0x7f577c154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 --2- 172.21.15.154:0/3081340210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c152590 0x7f577c151ca0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 >> 172.21.15.154:0/3081340210 conn(0x7f577c0c9f70 msgr2=0x7f577c1532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 shutdown_connections 2023-10-10T22:34:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:22.829+0000 7f577b59e700 1 -- 172.21.15.154:0/3081340210 wait complete. 2023-10-10T22:34:22.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T22:34:22.881 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:22.879+0000 7fe8c8164180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:34:22.918 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:22.916+0000 7f3597687180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:34:23.018 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:23.016+0000 7f3597687180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:34:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.041+0000 7fde9e99d700 1 Processor -- start 2023-10-10T22:34:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.041+0000 7fde9e99d700 1 -- start start 2023-10-10T22:34:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.043+0000 7fde9e99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fde980b1b40 0x7fde980b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.043+0000 7fde9e99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980cfb00 con 0x7fde980b4e70 2023-10-10T22:34:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.043+0000 7fde9e99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980b5c40 con 0x7fde980b16d0 2023-10-10T22:34:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.043+0000 7fde9e99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde980b5f20 con 0x7fde980b1b40 2023-10-10T22:34:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.043+0000 7fde9d99b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fde980b4e70 0x7fde980ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47018/0 (socket says 172.21.15.154:47018) 2023-10-10T22:34:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.043+0000 7fde9d99b700 1 -- 172.21.15.154:0/230519695 learned_addr learned my addr 172.21.15.154:0/230519695 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:23.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.043+0000 7fde9e19c700 1 --2- 172.21.15.154:0/230519695 >> v2:172.21.15.179:3300/0 conn(0x7fde980b1b40 0x7fde980b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.044+0000 7fde9c999700 1 -- 172.21.15.154:0/230519695 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180149818 0 0) 0x7fde980cfb00 con 0x7fde980b4e70 2023-10-10T22:34:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.044+0000 7fde9c999700 1 -- 172.21.15.154:0/230519695 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde84003570 con 0x7fde980b4e70 2023-10-10T22:34:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.044+0000 7fde9e19c700 1 -- 172.21.15.154:0/230519695 >> v1:172.21.15.179:6789/0 conn(0x7fde980b16d0 legacy=0x7fde980b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.044+0000 7fde9e19c700 1 -- 172.21.15.154:0/230519695 >> v1:172.21.15.154:6789/0 conn(0x7fde980b4e70 legacy=0x7fde980ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.044+0000 7fde9e19c700 1 -- 172.21.15.154:0/230519695 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980b6200 con 0x7fde980b1b40 2023-10-10T22:34:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.044+0000 7fde9e19c700 1 --2- 172.21.15.154:0/230519695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 0x7fde980b3ac0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fde90009e60 tx=0x7fde90009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f8f7916eaa7bd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.044+0000 7fde9c999700 1 -- 172.21.15.154:0/230519695 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9000e070 con 0x7fde980b1b40 2023-10-10T22:34:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.045+0000 7fde9c999700 1 -- 172.21.15.154:0/230519695 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9000bb60 con 0x7fde980b1b40 2023-10-10T22:34:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.045+0000 7fde9c999700 1 -- 172.21.15.154:0/230519695 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90012430 con 0x7fde980b1b40 2023-10-10T22:34:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.045+0000 7fde9e99d700 1 -- 172.21.15.154:0/230519695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 msgr2=0x7fde980b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.045+0000 7fde9e99d700 1 --2- 172.21.15.154:0/230519695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 0x7fde980b3ac0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fde90009e60 tx=0x7fde90009780 comp rx=0 tx=0).stop 2023-10-10T22:34:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.045+0000 7fde9e99d700 1 -- 172.21.15.154:0/230519695 shutdown_connections 2023-10-10T22:34:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.045+0000 7fde9e99d700 1 --2- 172.21.15.154:0/230519695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 0x7fde980b3ac0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.045+0000 7fde9e99d700 1 -- 172.21.15.154:0/230519695 >> 172.21.15.154:0/230519695 conn(0x7fde980d10c0 msgr2=0x7fde980affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.045+0000 7fde9e99d700 1 -- 172.21.15.154:0/230519695 shutdown_connections 2023-10-10T22:34:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.045+0000 7fde9e99d700 1 -- 172.21.15.154:0/230519695 wait complete. 2023-10-10T22:34:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.047+0000 7fde9e99d700 1 Processor -- start 2023-10-10T22:34:23.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.047+0000 7fde9e99d700 1 -- start start 2023-10-10T22:34:23.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9e99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde980b16d0 0x7fde980c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9e99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 0x7fde980cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9e99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde980b4e70 0x7fde98169c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9e99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980cb230 con 0x7fde980b4e70 2023-10-10T22:34:23.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9e99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9816ac40 con 0x7fde980b1b40 2023-10-10T22:34:23.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9e99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c9da0 con 0x7fde980b16d0 2023-10-10T22:34:23.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9e19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde980b4e70 0x7fde98169c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:23.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9d19a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 0x7fde980cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:23.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9d99b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde980b16d0 0x7fde980c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:23.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9e19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde980b4e70 0x7fde98169c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53016/0 (socket says 172.21.15.154:53016) 2023-10-10T22:34:23.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.048+0000 7fde9e19c700 1 -- 172.21.15.154:0/1363113497 learned_addr learned my addr 172.21.15.154:0/1363113497 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:23.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde9d19a700 1 -- 172.21.15.154:0/1363113497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde980b16d0 msgr2=0x7fde980c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde9d19a700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde980b16d0 0x7fde980c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde9d19a700 1 -- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde980b4e70 msgr2=0x7fde98169c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde9d19a700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde980b4e70 0x7fde98169c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde9d19a700 1 -- 172.21.15.154:0/1363113497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90009a20 con 0x7fde980b1b40 2023-10-10T22:34:23.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde9d19a700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 0x7fde980cbc60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c5c0 tx=0x7fde88007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:23.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde8dffb700 1 -- 172.21.15.154:0/1363113497 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88011590 con 0x7fde980b1b40 2023-10-10T22:34:23.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde8dffb700 1 -- 172.21.15.154:0/1363113497 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde88011710 con 0x7fde980b1b40 2023-10-10T22:34:23.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde8dffb700 1 -- 172.21.15.154:0/1363113497 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88011ad0 con 0x7fde980b1b40 2023-10-10T22:34:23.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.049+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9816a960 con 0x7fde980b1b40 2023-10-10T22:34:23.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.050+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde980cb740 con 0x7fde980b1b40 2023-10-10T22:34:23.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.051+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde980cb960 con 0x7fde980b1b40 2023-10-10T22:34:23.058 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:23.052+0000 7fe8c8164180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:34:23.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.052+0000 7fde8dffb700 1 -- 172.21.15.154:0/1363113497 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fde8801b3b0 con 0x7fde980b1b40 2023-10-10T22:34:23.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.053+0000 7fde8dffb700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fde7c067050 0x7fde7c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.053+0000 7fde8dffb700 1 -- 172.21.15.154:0/1363113497 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7fde88083e00 con 0x7fde980b1b40 2023-10-10T22:34:23.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.053+0000 7fde9d99b700 1 -- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fde7c067050 msgr2=0x7fde7c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:23.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.053+0000 7fde9d99b700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fde7c067050 0x7fde7c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:23.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.058+0000 7fde8dffb700 1 -- 172.21.15.154:0/1363113497 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde88050b70 con 0x7fde980b1b40 2023-10-10T22:34:23.160 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:23.157+0000 7fe8c8164180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:34:23.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.254+0000 7fde9d99b700 1 -- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fde7c067050 msgr2=0x7fde7c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:23.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.254+0000 7fde9d99b700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fde7c067050 0x7fde7c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:23.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.258+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde9816a6e0 con 0x7fde980b1b40 2023-10-10T22:34:23.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.259+0000 7fde8dffb700 1 -- 172.21.15.154:0/1363113497 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v179) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde88017070 con 0x7fde980b1b40 2023-10-10T22:34:23.262 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T22:34:23.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fde7c067050 msgr2=0x7fde7c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fde7c067050 0x7fde7c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 msgr2=0x7fde980cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 0x7fde980cbc60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c5c0 tx=0x7fde88007ec0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 shutdown_connections 2023-10-10T22:34:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fde7c067050 0x7fde7c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde980b4e70 0x7fde98169c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde980b16d0 0x7fde980c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 --2- 172.21.15.154:0/1363113497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde980b1b40 0x7fde980cbc60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.261+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 >> 172.21.15.154:0/1363113497 conn(0x7fde980d10c0 msgr2=0x7fde981590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:23.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.262+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 shutdown_connections 2023-10-10T22:34:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.262+0000 7fde9e99d700 1 -- 172.21.15.154:0/1363113497 wait complete. 2023-10-10T22:34:23.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:34:23.501 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:23.500+0000 7f3597687180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:34:23.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.508+0000 7fd6de5ff700 1 Processor -- start 2023-10-10T22:34:23.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.509+0000 7fd6de5ff700 1 -- start start 2023-10-10T22:34:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6de5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6d80cbf30 0x7fd6d80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6de5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d80ccf90 0x7fd6d80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6de5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80cc300 con 0x7fd6d815a270 2023-10-10T22:34:23.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6de5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d8156bf0 con 0x7fd6d80cbf30 2023-10-10T22:34:23.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6de5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80ae950 con 0x7fd6d80ccf90 2023-10-10T22:34:23.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6d7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6d80cbf30 0x7fd6d80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:23.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6d77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d80ccf90 0x7fd6d80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:23.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6d77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d80ccf90 0x7fd6d80b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:52464/0 (socket says 172.21.15.154:52464) 2023-10-10T22:34:23.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6d7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6d80cbf30 0x7fd6d80ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53022/0 (socket says 172.21.15.154:53022) 2023-10-10T22:34:23.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.510+0000 7fd6d77fe700 1 -- 172.21.15.154:0/3361568756 learned_addr learned my addr 172.21.15.154:0/3361568756 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:23.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.511+0000 7fd6d77fe700 1 -- 172.21.15.154:0/3361568756 >> v2:172.21.15.154:3300/0 conn(0x7fd6d80cbf30 msgr2=0x7fd6d80ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:23.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.511+0000 7fd6d77fe700 1 --2- 172.21.15.154:0/3361568756 >> v2:172.21.15.154:3300/0 conn(0x7fd6d80cbf30 0x7fd6d80ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.511+0000 7fd6d77fe700 1 -- 172.21.15.154:0/3361568756 >> v1:172.21.15.154:6789/0 conn(0x7fd6d815a270 legacy=0x7fd6d80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.511+0000 7fd6d77fe700 1 -- 172.21.15.154:0/3361568756 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80ad370 con 0x7fd6d80ccf90 2023-10-10T22:34:23.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.511+0000 7fd6d7fff700 1 --2- 172.21.15.154:0/3361568756 >> v2:172.21.15.154:3300/0 conn(0x7fd6d80cbf30 0x7fd6d80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:23.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.511+0000 7fd6d77fe700 1 --2- 172.21.15.154:0/3361568756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d80ccf90 0x7fd6d80b0d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0099b0 tx=0x7fd6cc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a00f18effe227519 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:23.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.511+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/3361568756 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc009ea0 con 0x7fd6d80ccf90 2023-10-10T22:34:23.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.511+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/3361568756 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc00b860 con 0x7fd6d80ccf90 2023-10-10T22:34:23.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.511+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/3361568756 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00bc00 con 0x7fd6d80ccf90 2023-10-10T22:34:23.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.512+0000 7fd6de5ff700 1 -- 172.21.15.154:0/3361568756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d80ccf90 msgr2=0x7fd6d80b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.512+0000 7fd6de5ff700 1 --2- 172.21.15.154:0/3361568756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d80ccf90 0x7fd6d80b0d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0099b0 tx=0x7fd6cc009250 comp rx=0 tx=0).stop 2023-10-10T22:34:23.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.512+0000 7fd6de5ff700 1 -- 172.21.15.154:0/3361568756 shutdown_connections 2023-10-10T22:34:23.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.512+0000 7fd6de5ff700 1 --2- 172.21.15.154:0/3361568756 >> v2:172.21.15.154:3300/0 conn(0x7fd6d80cbf30 0x7fd6d80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.512+0000 7fd6de5ff700 1 --2- 172.21.15.154:0/3361568756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d80ccf90 0x7fd6d80b0d10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.512+0000 7fd6de5ff700 1 -- 172.21.15.154:0/3361568756 >> 172.21.15.154:0/3361568756 conn(0x7fd6d806a320 msgr2=0x7fd6d80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:23.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.512+0000 7fd6de5ff700 1 -- 172.21.15.154:0/3361568756 shutdown_connections 2023-10-10T22:34:23.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.512+0000 7fd6de5ff700 1 -- 172.21.15.154:0/3361568756 wait complete. 2023-10-10T22:34:23.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.513+0000 7fd6de5ff700 1 Processor -- start 2023-10-10T22:34:23.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.514+0000 7fd6de5ff700 1 -- start start 2023-10-10T22:34:23.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.514+0000 7fd6de5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d80cbf30 0x7fd6d8158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.514+0000 7fd6de5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6d80ccf90 0x7fd6d814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.514+0000 7fd6de5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d815a270 0x7fd6d814d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.514+0000 7fd6de5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d814d470 con 0x7fd6d80cbf30 2023-10-10T22:34:23.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.514+0000 7fd6de5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8155b80 con 0x7fd6d80ccf90 2023-10-10T22:34:23.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6de5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8155e60 con 0x7fd6d815a270 2023-10-10T22:34:23.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d80cbf30 0x7fd6d8158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:23.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d80cbf30 0x7fd6d8158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53028/0 (socket says 172.21.15.154:53028) 2023-10-10T22:34:23.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d7fff700 1 -- 172.21.15.154:0/863468416 learned_addr learned my addr 172.21.15.154:0/863468416 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:23.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d77fe700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6d80ccf90 0x7fd6d814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:23.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6dcb9c700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d815a270 0x7fd6d814d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:23.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d7fff700 1 -- 172.21.15.154:0/863468416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d815a270 msgr2=0x7fd6d814d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d7fff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d815a270 0x7fd6d814d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d7fff700 1 -- 172.21.15.154:0/863468416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6d80ccf90 msgr2=0x7fd6d814fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d7fff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6d80ccf90 0x7fd6d814fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d7fff700 1 -- 172.21.15.154:0/863468416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8009420 con 0x7fd6d80cbf30 2023-10-10T22:34:23.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.515+0000 7fd6d7fff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d80cbf30 0x7fd6d8158950 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800ec80 tx=0x7fd6c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:23.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.516+0000 7fd6bffff700 1 -- 172.21.15.154:0/863468416 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800c920 con 0x7fd6d80cbf30 2023-10-10T22:34:23.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.516+0000 7fd6bffff700 1 -- 172.21.15.154:0/863468416 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c800ca80 con 0x7fd6d80cbf30 2023-10-10T22:34:23.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.516+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc0094f0 con 0x7fd6d80cbf30 2023-10-10T22:34:23.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.516+0000 7fd6bffff700 1 -- 172.21.15.154:0/863468416 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800ce00 con 0x7fd6d80cbf30 2023-10-10T22:34:23.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.516+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d8156420 con 0x7fd6d80cbf30 2023-10-10T22:34:23.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.517+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d804c3c0 con 0x7fd6d80cbf30 2023-10-10T22:34:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.518+0000 7fd6bffff700 1 -- 172.21.15.154:0/863468416 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fd6c8013680 con 0x7fd6d80cbf30 2023-10-10T22:34:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.519+0000 7fd6bffff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd6c4067050 0x7fd6c4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.520+0000 7fd6d77fe700 1 -- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd6c4067050 msgr2=0x7fd6c4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.520+0000 7fd6bffff700 1 -- 172.21.15.154:0/863468416 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6714+0+0 (secure 0 0 0) 0x7fd6c8084f20 con 0x7fd6d80cbf30 2023-10-10T22:34:23.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.520+0000 7fd6d77fe700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd6c4067050 0x7fd6c4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:23.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.523+0000 7fd6bffff700 1 -- 172.21.15.154:0/863468416 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6c8051bf0 con 0x7fd6d80cbf30 2023-10-10T22:34:23.596 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:23.594+0000 7f3597687180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:34:23.667 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:23.665+0000 7fe8c8164180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:34:23.685 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:23.684+0000 7f3597687180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:34:23.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.721+0000 7fd6d77fe700 1 -- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd6c4067050 msgr2=0x7fd6c4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:23.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.721+0000 7fd6d77fe700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd6c4067050 0x7fd6c4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:23.777 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:23.775+0000 7fe8c8164180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:34:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.779+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6d806f8a0 con 0x7fd6d80cbf30 2023-10-10T22:34:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.779+0000 7fd6bffff700 1 -- 172.21.15.154:0/863468416 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4613 (secure 0 0 0) 0x7fd6c8055210 con 0x7fd6d80cbf30 2023-10-10T22:34:23.782 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:23.782 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3140311410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3140311410},{"type":"v1","addr":"172.21.15.179:6835","nonce":3140311410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2649941331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2649941331},{"type":"v1","addr":"172.21.15.179:6834","nonce":2649941331}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3061056526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3061056526},{"type":"v1","addr":"172.21.15.154:6834","nonce":3061056526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:18:23.465253+0000","modified":"2023-10-10T22:18:27.020551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9138":{"gid":9138,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3697556207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3697556207},{"type":"v1","addr":"172.21.15.154:6835","nonce":3697556207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-10T22:34:23.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd6c4067050 msgr2=0x7fd6c4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:23.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd6c4067050 0x7fd6c4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d80cbf30 msgr2=0x7fd6d8158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:23.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d80cbf30 0x7fd6d8158950 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800ec80 tx=0x7fd6c80091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 shutdown_connections 2023-10-10T22:34:23.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd6c4067050 0x7fd6c4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6d815a270 0x7fd6d814d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6d80cbf30 0x7fd6d8158950 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 --2- 172.21.15.154:0/863468416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6d80ccf90 0x7fd6d814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:23.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 >> 172.21.15.154:0/863468416 conn(0x7fd6d806a320 msgr2=0x7fd6d81593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:23.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 shutdown_connections 2023-10-10T22:34:23.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:23.782+0000 7fd6de5ff700 1 -- 172.21.15.154:0/863468416 wait complete. 2023-10-10T22:34:23.789 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 78 2023-10-10T22:34:23.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:34:23.879 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:23.877+0000 7fe8c8164180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:34:24.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.022+0000 7f72f299d700 1 Processor -- start 2023-10-10T22:34:24.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.022+0000 7f72f299d700 1 -- start start 2023-10-10T22:34:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.024+0000 7f72f299d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f72ec1597f0 0x7f72ec0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.024+0000 7f72f299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.024+0000 7f72f299d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ec15dbb0 con 0x7f72ec159420 2023-10-10T22:34:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.024+0000 7f72f299d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec0b11d0 con 0x7f72ec1597f0 2023-10-10T22:34:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.024+0000 7f72f299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0b14b0 con 0x7f72ec15d230 2023-10-10T22:34:24.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f199b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f72ec159420 0x7f72ec0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47028/0 (socket says 172.21.15.154:47028) 2023-10-10T22:34:24.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f199b700 1 -- 172.21.15.154:0/2572108244 learned_addr learned my addr 172.21.15.154:0/2572108244 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:24.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f119a700 1 --2- 172.21.15.154:0/2572108244 >> v2:172.21.15.179:3300/0 conn(0x7f72ec1597f0 0x7f72ec0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:24.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f219c700 1 --2- 172.21.15.154:0/2572108244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:24.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f0999700 1 -- 172.21.15.154:0/2572108244 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919130692 0 0) 0x7f72ec15dbb0 con 0x7f72ec159420 2023-10-10T22:34:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f0999700 1 -- 172.21.15.154:0/2572108244 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d8003570 con 0x7f72ec159420 2023-10-10T22:34:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f219c700 1 -- 172.21.15.154:0/2572108244 >> v2:172.21.15.179:3300/0 conn(0x7f72ec1597f0 msgr2=0x7f72ec0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f219c700 1 --2- 172.21.15.154:0/2572108244 >> v2:172.21.15.179:3300/0 conn(0x7f72ec1597f0 0x7f72ec0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f219c700 1 -- 172.21.15.154:0/2572108244 >> v1:172.21.15.154:6789/0 conn(0x7f72ec159420 legacy=0x7f72ec0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f219c700 1 -- 172.21.15.154:0/2572108244 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec0b1790 con 0x7f72ec15d230 2023-10-10T22:34:24.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.025+0000 7f72f119a700 1 --2- 172.21.15.154:0/2572108244 >> v2:172.21.15.179:3300/0 conn(0x7f72ec1597f0 0x7f72ec0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:24.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.026+0000 7f72f219c700 1 --2- 172.21.15.154:0/2572108244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15d670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009e60 tx=0x7f72e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef02fd749e93a87a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:24.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.026+0000 7f72f0999700 1 -- 172.21.15.154:0/2572108244 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e400e070 con 0x7f72ec15d230 2023-10-10T22:34:24.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.026+0000 7f72f0999700 1 -- 172.21.15.154:0/2572108244 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e400bab0 con 0x7f72ec15d230 2023-10-10T22:34:24.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.026+0000 7f72f0999700 1 -- 172.21.15.154:0/2572108244 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e400be70 con 0x7f72ec15d230 2023-10-10T22:34:24.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.027+0000 7f72f299d700 1 -- 172.21.15.154:0/2572108244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 msgr2=0x7f72ec15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:24.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.027+0000 7f72f299d700 1 --2- 172.21.15.154:0/2572108244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15d670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009e60 tx=0x7f72e4009780 comp rx=0 tx=0).stop 2023-10-10T22:34:24.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.027+0000 7f72f299d700 1 -- 172.21.15.154:0/2572108244 shutdown_connections 2023-10-10T22:34:24.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.027+0000 7f72f299d700 1 --2- 172.21.15.154:0/2572108244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15d670 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.027+0000 7f72f299d700 1 --2- 172.21.15.154:0/2572108244 >> v2:172.21.15.179:3300/0 conn(0x7f72ec1597f0 0x7f72ec0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.027+0000 7f72f299d700 1 -- 172.21.15.154:0/2572108244 >> 172.21.15.154:0/2572108244 conn(0x7f72ec0d0660 msgr2=0x7f72ec0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:24.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.027+0000 7f72f299d700 1 -- 172.21.15.154:0/2572108244 shutdown_connections 2023-10-10T22:34:24.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.027+0000 7f72f299d700 1 -- 172.21.15.154:0/2572108244 wait complete. 2023-10-10T22:34:24.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.029+0000 7f72f299d700 1 Processor -- start 2023-10-10T22:34:24.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.029+0000 7f72f299d700 1 -- start start 2023-10-10T22:34:24.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f299d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72ec159420 0x7f72ec0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72ec1597f0 0x7f72ec156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f299d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec15aa50 con 0x7f72ec159420 2023-10-10T22:34:24.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec159e40 con 0x7f72ec1597f0 2023-10-10T22:34:24.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec15a120 con 0x7f72ec15d230 2023-10-10T22:34:24.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72ec159420 0x7f72ec0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:24.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72ec159420 0x7f72ec0c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53032/0 (socket says 172.21.15.154:53032) 2023-10-10T22:34:24.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f199b700 1 -- 172.21.15.154:0/2874269399 learned_addr learned my addr 172.21.15.154:0/2874269399 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:24.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f219c700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:24.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.031+0000 7f72f119a700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72ec1597f0 0x7f72ec156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:24.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72f219c700 1 -- 172.21.15.154:0/2874269399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72ec1597f0 msgr2=0x7f72ec156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:24.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72f219c700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72ec1597f0 0x7f72ec156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72f219c700 1 -- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72ec159420 msgr2=0x7f72ec0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:24.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72f219c700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72ec159420 0x7f72ec0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72f219c700 1 -- 172.21.15.154:0/2874269399 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc009420 con 0x7f72ec15d230 2023-10-10T22:34:24.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72f199b700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72ec159420 0x7f72ec0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:24.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72f219c700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15aee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f72e4016000 tx=0x7f72e4019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:24.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72e1ffb700 1 -- 172.21.15.154:0/2874269399 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4012e10 con 0x7f72ec15d230 2023-10-10T22:34:24.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72e1ffb700 1 -- 172.21.15.154:0/2874269399 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e4027470 con 0x7f72ec15d230 2023-10-10T22:34:24.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72e1ffb700 1 -- 172.21.15.154:0/2874269399 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4027830 con 0x7f72ec15d230 2023-10-10T22:34:24.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.032+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e4009a20 con 0x7f72ec15d230 2023-10-10T22:34:24.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.033+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec15a6e0 con 0x7f72ec15d230 2023-10-10T22:34:24.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.033+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec15abc0 con 0x7f72ec15d230 2023-10-10T22:34:24.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.034+0000 7f72e1ffb700 1 -- 172.21.15.154:0/2874269399 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f72e4024070 con 0x7f72ec15d230 2023-10-10T22:34:24.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.035+0000 7f72e1ffb700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f72d0067050 0x7f72d0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.035+0000 7f72e1ffb700 1 -- 172.21.15.154:0/2874269399 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f72e4087130 con 0x7f72ec15d230 2023-10-10T22:34:24.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.035+0000 7f72f199b700 1 -- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f72d0067050 msgr2=0x7f72d0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:24.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.035+0000 7f72f199b700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f72d0067050 0x7f72d0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:24.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.039+0000 7f72e1ffb700 1 -- 172.21.15.154:0/2874269399 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72e4053dc0 con 0x7f72ec15d230 2023-10-10T22:34:24.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.237+0000 7f72f199b700 1 -- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f72d0067050 msgr2=0x7f72d0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:24.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.237+0000 7f72f199b700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f72d0067050 0x7f72d0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.253+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72ec04c3c0 con 0x7f72ec15d230 2023-10-10T22:34:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.255+0000 7f72e1ffb700 1 -- 172.21.15.154:0/2874269399 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f72e40573e0 con 0x7f72ec15d230 2023-10-10T22:34:24.256 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:24.257 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":180,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:34:23.737408+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:18:21.404071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-10T22:18:22.445408+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":180,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.2b","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/498340340":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/343743971":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/3925921356":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/2315091237":"2023-10-11T22:29:23.075298+0000","172.21.15.154:6837/85496":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/2413918626":"2023-10-11T22:29:23.075298+0000","172.21.15.154:6836/85496":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/227322610":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/2303751617":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/3605187556":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/2055186398":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/1018803754":"2023-10-11T22:18:44.244130+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:34:24.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f72d0067050 msgr2=0x7f72d0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:24.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f72d0067050 0x7f72d0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 msgr2=0x7f72ec15aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:24.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15aee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f72e4016000 tx=0x7f72e4019000 comp rx=0 tx=0).stop 2023-10-10T22:34:24.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 shutdown_connections 2023-10-10T22:34:24.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f72d0067050 0x7f72d0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72ec15d230 0x7f72ec15aee0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72ec159420 0x7f72ec0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 --2- 172.21.15.154:0/2874269399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72ec1597f0 0x7f72ec156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 >> 172.21.15.154:0/2874269399 conn(0x7f72ec0d0660 msgr2=0x7f72ec0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:24.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 shutdown_connections 2023-10-10T22:34:24.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.257+0000 7f72f299d700 1 -- 172.21.15.154:0/2874269399 wait complete. 2023-10-10T22:34:24.278 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T22:34:24.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:34:24.389 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:24.387+0000 7f3597687180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:34:24.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.486+0000 7f58effff700 1 Processor -- start 2023-10-10T22:34:24.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.487+0000 7f58effff700 1 -- start start 2023-10-10T22:34:24.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.489+0000 7f58effff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58f0156af0 0x7f58f00c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.489+0000 7f58effff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58f00c7610 0x7f58f00ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.489+0000 7f58effff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f00c7a30 con 0x7f58f0155720 2023-10-10T22:34:24.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.489+0000 7f58effff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f006dd20 con 0x7f58f00c7610 2023-10-10T22:34:24.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.489+0000 7f58effff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f006e000 con 0x7f58f0156af0 2023-10-10T22:34:24.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.489+0000 7f58ee7fc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58f0156af0 0x7f58f00c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:24.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.489+0000 7f58eeffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f58f0155720 0x7f58f006f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:37658/0 (socket says 172.21.15.154:37658) 2023-10-10T22:34:24.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.489+0000 7f58eeffd700 1 -- 172.21.15.154:0/3288061421 learned_addr learned my addr 172.21.15.154:0/3288061421 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:24.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.489+0000 7f58ef7fe700 1 --2- 172.21.15.154:0/3288061421 >> v2:172.21.15.154:3300/0 conn(0x7f58f00c7610 0x7f58f00ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:24.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.490+0000 7f58edffb700 1 -- 172.21.15.154:0/3288061421 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359753040 0 0) 0x7f58f00c7a30 con 0x7f58f0155720 2023-10-10T22:34:24.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.490+0000 7f58edffb700 1 -- 172.21.15.154:0/3288061421 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d8003570 con 0x7f58f0155720 2023-10-10T22:34:24.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.490+0000 7f58ee7fc700 1 -- 172.21.15.154:0/3288061421 >> v2:172.21.15.154:3300/0 conn(0x7f58f00c7610 msgr2=0x7f58f00ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:24.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.490+0000 7f58ee7fc700 1 --2- 172.21.15.154:0/3288061421 >> v2:172.21.15.154:3300/0 conn(0x7f58f00c7610 0x7f58f00ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.490+0000 7f58ee7fc700 1 -- 172.21.15.154:0/3288061421 >> v1:172.21.15.179:6789/0 conn(0x7f58f0155720 legacy=0x7f58f006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:24.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.490+0000 7f58ee7fc700 1 -- 172.21.15.154:0/3288061421 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f006e2e0 con 0x7f58f0156af0 2023-10-10T22:34:24.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.490+0000 7f58ee7fc700 1 --2- 172.21.15.154:0/3288061421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f0156af0 0x7f58f00c70d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f58f00c7d20 tx=0x7f58e400a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8b6a1d1999c69d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:24.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.491+0000 7f58edffb700 1 -- 172.21.15.154:0/3288061421 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400c970 con 0x7f58f0156af0 2023-10-10T22:34:24.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.491+0000 7f58edffb700 1 -- 172.21.15.154:0/3288061421 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e400cad0 con 0x7f58f0156af0 2023-10-10T22:34:24.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.491+0000 7f58edffb700 1 -- 172.21.15.154:0/3288061421 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400ce50 con 0x7f58f0156af0 2023-10-10T22:34:24.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.492+0000 7f58effff700 1 -- 172.21.15.154:0/3288061421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f0156af0 msgr2=0x7f58f00c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:24.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.492+0000 7f58effff700 1 --2- 172.21.15.154:0/3288061421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f0156af0 0x7f58f00c70d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f58f00c7d20 tx=0x7f58e400a330 comp rx=0 tx=0).stop 2023-10-10T22:34:24.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.492+0000 7f58effff700 1 -- 172.21.15.154:0/3288061421 shutdown_connections 2023-10-10T22:34:24.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.492+0000 7f58effff700 1 --2- 172.21.15.154:0/3288061421 >> v2:172.21.15.154:3300/0 conn(0x7f58f00c7610 0x7f58f00ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.492+0000 7f58effff700 1 --2- 172.21.15.154:0/3288061421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f0156af0 0x7f58f00c70d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.492+0000 7f58effff700 1 -- 172.21.15.154:0/3288061421 >> 172.21.15.154:0/3288061421 conn(0x7f58f00cc1f0 msgr2=0x7f58f00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:24.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.492+0000 7f58effff700 1 -- 172.21.15.154:0/3288061421 shutdown_connections 2023-10-10T22:34:24.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.492+0000 7f58effff700 1 -- 172.21.15.154:0/3288061421 wait complete. 2023-10-10T22:34:24.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.495+0000 7f58effff700 1 Processor -- start 2023-10-10T22:34:24.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.495+0000 7f58effff700 1 -- start start 2023-10-10T22:34:24.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.496+0000 7f58effff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f00c7610 0x7f58f00c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.496+0000 7f58effff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58f0155720 0x7f58f015e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.497+0000 7f58eeffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f00c7610 0x7f58f00c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:24.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.497+0000 7f58eeffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f00c7610 0x7f58f00c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:44816/0 (socket says 172.21.15.154:44816) 2023-10-10T22:34:24.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.497+0000 7f58ee7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58f0155720 0x7f58f015e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:24.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.497+0000 7f58ee7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58f0155720 0x7f58f015e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53042/0 (socket says 172.21.15.154:53042) 2023-10-10T22:34:24.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.497+0000 7f58eeffd700 1 -- 172.21.15.154:0/3385792602 learned_addr learned my addr 172.21.15.154:0/3385792602 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:24.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.497+0000 7f58effff700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f0156af0 0x7f58f0153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.497+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f015ec20 con 0x7f58f0155720 2023-10-10T22:34:24.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.497+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f015ef00 con 0x7f58f00c7610 2023-10-10T22:34:24.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.497+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f015f1e0 con 0x7f58f0156af0 2023-10-10T22:34:24.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.498+0000 7f58eeffd700 1 -- 172.21.15.154:0/3385792602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f0156af0 msgr2=0x7f58f0153560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:24.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.498+0000 7f58eeffd700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f0156af0 0x7f58f0153560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.498+0000 7f58eeffd700 1 -- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58f0155720 msgr2=0x7f58f015e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:24.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.498+0000 7f58eeffd700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58f0155720 0x7f58f015e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.498+0000 7f58eeffd700 1 -- 172.21.15.154:0/3385792602 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e400a5d0 con 0x7f58f00c7610 2023-10-10T22:34:24.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.498+0000 7f58ee7fc700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58f0155720 0x7f58f015e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:24.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.499+0000 7f58eeffd700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f00c7610 0x7f58f00c34f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58e000c980 tx=0x7f58e000a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:24.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.499+0000 7f58d6ffd700 1 -- 172.21.15.154:0/3385792602 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e000ce10 con 0x7f58f00c7610 2023-10-10T22:34:24.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.499+0000 7f58d6ffd700 1 -- 172.21.15.154:0/3385792602 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e0007940 con 0x7f58f00c7610 2023-10-10T22:34:24.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.499+0000 7f58d6ffd700 1 -- 172.21.15.154:0/3385792602 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0007cc0 con 0x7f58f00c7610 2023-10-10T22:34:24.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.499+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f015f4c0 con 0x7f58f00c7610 2023-10-10T22:34:24.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.499+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f00c63a0 con 0x7f58f00c7610 2023-10-10T22:34:24.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.502+0000 7f58d6ffd700 1 -- 172.21.15.154:0/3385792602 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f58e000f450 con 0x7f58f00c7610 2023-10-10T22:34:24.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.503+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f015f960 con 0x7f58f00c7610 2023-10-10T22:34:24.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.504+0000 7f58d6ffd700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f58dc067050 0x7f58dc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:24.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.504+0000 7f58d6ffd700 1 -- 172.21.15.154:0/3385792602 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f58e0013070 con 0x7f58f00c7610 2023-10-10T22:34:24.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.504+0000 7f58ee7fc700 1 -- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f58dc067050 msgr2=0x7f58dc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:24.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.505+0000 7f58ee7fc700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f58dc067050 0x7f58dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:24.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.509+0000 7f58d6ffd700 1 -- 172.21.15.154:0/3385792602 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58e0055a60 con 0x7f58f00c7610 2023-10-10T22:34:24.579 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:24.577+0000 7f3597687180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:34:24.626 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:24.625+0000 7fe8c8164180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:34:24.686 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:24.684+0000 7f3597687180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:34:24.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.706+0000 7f58ee7fc700 1 -- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f58dc067050 msgr2=0x7f58dc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:24.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.706+0000 7f58ee7fc700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f58dc067050 0x7f58dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:24.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.797+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58f015f040 con 0x7f58f00c7610 2023-10-10T22:34:24.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.798+0000 7f58d6ffd700 1 -- 172.21.15.154:0/3385792602 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4613 (secure 0 0 0) 0x7f58f015f040 con 0x7f58f00c7610 2023-10-10T22:34:24.799 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:24.799 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3140311410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3140311410},{"type":"v1","addr":"172.21.15.179:6835","nonce":3140311410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2649941331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2649941331},{"type":"v1","addr":"172.21.15.179:6834","nonce":2649941331}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3061056526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3061056526},{"type":"v1","addr":"172.21.15.154:6834","nonce":3061056526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:18:23.465253+0000","modified":"2023-10-10T22:18:27.020551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9138":{"gid":9138,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3697556207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3697556207},{"type":"v1","addr":"172.21.15.154:6835","nonce":3697556207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-10T22:34:24.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f58dc067050 msgr2=0x7f58dc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:24.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f58dc067050 0x7f58dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f00c7610 msgr2=0x7f58f00c34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:24.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f00c7610 0x7f58f00c34f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58e000c980 tx=0x7f58e000a2e0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 shutdown_connections 2023-10-10T22:34:24.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f58dc067050 0x7f58dc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f0156af0 0x7f58f0153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f00c7610 0x7f58f00c34f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 --2- 172.21.15.154:0/3385792602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58f0155720 0x7f58f015e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:24.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 >> 172.21.15.154:0/3385792602 conn(0x7f58f00cc1f0 msgr2=0x7f58f0160f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:24.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 shutdown_connections 2023-10-10T22:34:24.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:24.800+0000 7f58effff700 1 -- 172.21.15.154:0/3385792602 wait complete. 2023-10-10T22:34:24.805 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 78 2023-10-10T22:34:24.820 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:34:24.825 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:24.822+0000 7fe8c8164180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:34:24.926 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:24.925+0000 7fe8c8164180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:34:24.980 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:24.979+0000 7f3597687180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:34:25.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.005+0000 7f62bf59e700 1 Processor -- start 2023-10-10T22:34:25.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.005+0000 7f62bf59e700 1 -- start start 2023-10-10T22:34:25.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bf59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c00b02a0 0x7f62c015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bf59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c006ae70 con 0x7f62c006a0a0 2023-10-10T22:34:25.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bf59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c00c8a60 con 0x7f62c006d950 2023-10-10T22:34:25.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bf59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c006a540 con 0x7f62c00b02a0 2023-10-10T22:34:25.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bdd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f62c006a0a0 0x7f62c015b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47042/0 (socket says 172.21.15.154:47042) 2023-10-10T22:34:25.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bdd9b700 1 -- 172.21.15.154:0/1017637918 learned_addr learned my addr 172.21.15.154:0/1017637918 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:25.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bed9d700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c00b02a0 0x7f62c015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646252272 0 0) 0x7f62c006ae70 con 0x7f62c006a0a0 2023-10-10T22:34:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a8003570 con 0x7f62c006a0a0 2023-10-10T22:34:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.007+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568343528 0 0) 0x7f62c00c8a60 con 0x7f62c006d950 2023-10-10T22:34:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c006ae70 con 0x7f62c006d950 2023-10-10T22:34:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3740642379 0 0) 0x7f62a8003570 con 0x7f62c006a0a0 2023-10-10T22:34:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c00b02a0 msgr2=0x7f62c015bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c00b02a0 0x7f62c015bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 >> v1:172.21.15.179:6789/0 conn(0x7f62c006d950 legacy=0x7f62c00c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c006a820 con 0x7f62c006a0a0 2023-10-10T22:34:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f62b4001470 con 0x7f62c006a0a0 2023-10-10T22:34:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 >> v1:172.21.15.154:6789/0 conn(0x7f62c006a0a0 legacy=0x7f62c015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a8003c20 0x7f62a8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 0x7f62a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a80051c0 0x7f62a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c006a540 con 0x7f62a80051c0 2023-10-10T22:34:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a800c080 con 0x7f62a8003c20 2023-10-10T22:34:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a800c240 con 0x7f62a8004810 2023-10-10T22:34:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bed9d700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c00b02a0 0x7f62c015bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62be59c700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a8003c20 0x7f62a8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bdd9b700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 0x7f62a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.008+0000 7f62bed9d700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a80051c0 0x7f62a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62bdd9b700 1 -- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a8003c20 msgr2=0x7f62a8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62bdd9b700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a8003c20 0x7f62a8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62bdd9b700 1 -- 172.21.15.154:0/1017637918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a80051c0 msgr2=0x7f62a800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:25.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62bdd9b700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a80051c0 0x7f62a800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62bdd9b700 1 -- 172.21.15.154:0/1017637918 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a8003570 con 0x7f62a8004810 2023-10-10T22:34:25.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62be59c700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a8003c20 0x7f62a8004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:25.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62bdd9b700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 0x7f62a8004c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c210 tx=0x7f62b4001d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=950a5edde38d6a98 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4001d90 con 0x7f62a8004810 2023-10-10T22:34:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400cc10 con 0x7f62a8004810 2023-10-10T22:34:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.009+0000 7f62bd59a700 1 -- 172.21.15.154:0/1017637918 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4005920 con 0x7f62a8004810 2023-10-10T22:34:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.010+0000 7f62bf59e700 1 -- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 msgr2=0x7f62a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.010+0000 7f62bf59e700 1 --2- 172.21.15.154:0/1017637918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 0x7f62a8004c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c210 tx=0x7f62b4001d20 comp rx=0 tx=0).stop 2023-10-10T22:34:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.010+0000 7f62bed9d700 1 -- 172.21.15.154:0/1017637918 reap_dead start 2023-10-10T22:34:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.010+0000 7f62bf59e700 1 -- 172.21.15.154:0/1017637918 shutdown_connections 2023-10-10T22:34:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.010+0000 7f62bf59e700 1 -- 172.21.15.154:0/1017637918 >> 172.21.15.154:0/1017637918 conn(0x7f62c00cc1f0 msgr2=0x7f62c00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.010+0000 7f62bf59e700 1 -- 172.21.15.154:0/1017637918 shutdown_connections 2023-10-10T22:34:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.010+0000 7f62bf59e700 1 -- 172.21.15.154:0/1017637918 wait complete. 2023-10-10T22:34:25.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.011+0000 7f62bf59e700 1 Processor -- start 2023-10-10T22:34:25.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.012+0000 7f62bf59e700 1 -- start start 2023-10-10T22:34:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.012+0000 7f62bf59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 0x7f62c0151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.012+0000 7f62bf59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62c0159c60 0x7f62c0168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.012+0000 7f62bf59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c0167fc0 0x7f62c0156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.012+0000 7f62bf59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0159620 con 0x7f62c0159c60 2023-10-10T22:34:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.012+0000 7f62bf59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00c3b40 con 0x7f62c0167fc0 2023-10-10T22:34:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.012+0000 7f62bf59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c015a160 con 0x7f62a8004810 2023-10-10T22:34:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bdd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62c0159c60 0x7f62c0168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bdd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62c0159c60 0x7f62c0168720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53048/0 (socket says 172.21.15.154:53048) 2023-10-10T22:34:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bdd9b700 1 -- 172.21.15.154:0/2427185225 learned_addr learned my addr 172.21.15.154:0/2427185225 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62be59c700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 0x7f62c0151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bed9d700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c0167fc0 0x7f62c0156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bdd9b700 1 -- 172.21.15.154:0/2427185225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 msgr2=0x7f62c0151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bdd9b700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 0x7f62c0151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bdd9b700 1 -- 172.21.15.154:0/2427185225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c0167fc0 msgr2=0x7f62c0156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bdd9b700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c0167fc0 0x7f62c0156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bdd9b700 1 -- 172.21.15.154:0/2427185225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c015a440 con 0x7f62c0159c60 2023-10-10T22:34:25.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.013+0000 7f62bdd9b700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62c0159c60 0x7f62c0168720 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c800 tx=0x7f62b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:25.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.014+0000 7f62ae7fc700 1 -- 172.21.15.154:0/2427185225 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4005c90 con 0x7f62c0159c60 2023-10-10T22:34:25.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.014+0000 7f62ae7fc700 1 -- 172.21.15.154:0/2427185225 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b4005df0 con 0x7f62c0159c60 2023-10-10T22:34:25.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.014+0000 7f62ae7fc700 1 -- 172.21.15.154:0/2427185225 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4007320 con 0x7f62c0159c60 2023-10-10T22:34:25.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.014+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c015a720 con 0x7f62c0159c60 2023-10-10T22:34:25.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.014+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c0168410 con 0x7f62c0159c60 2023-10-10T22:34:25.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.015+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c00c3cb0 con 0x7f62c0159c60 2023-10-10T22:34:25.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.016+0000 7f62ae7fc700 1 -- 172.21.15.154:0/2427185225 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f62b4019030 con 0x7f62c0159c60 2023-10-10T22:34:25.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.016+0000 7f62ae7fc700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f62a0067050 0x7f62a0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.017+0000 7f62ae7fc700 1 -- 172.21.15.154:0/2427185225 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f62b4085ec0 con 0x7f62c0159c60 2023-10-10T22:34:25.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.017+0000 7f62be59c700 1 -- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f62a0067050 msgr2=0x7f62a0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:25.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.017+0000 7f62be59c700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f62a0067050 0x7f62a0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.021+0000 7f62ae7fc700 1 -- 172.21.15.154:0/2427185225 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62b4052b50 con 0x7f62c0159c60 2023-10-10T22:34:25.077 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:25.075+0000 7f3597687180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:34:25.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.218+0000 7f62be59c700 1 -- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f62a0067050 msgr2=0x7f62a0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:25.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.218+0000 7f62be59c700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f62a0067050 0x7f62a0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:25.244 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:25.243+0000 7fe8c8164180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:34:25.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.279+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62c004c3c0 con 0x7f62c0159c60 2023-10-10T22:34:25.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.280+0000 7f62ae7fc700 1 -- 172.21.15.154:0/2427185225 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4613 (secure 0 0 0) 0x7f62b4056170 con 0x7f62c0159c60 2023-10-10T22:34:25.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:25.282 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3140311410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3140311410},{"type":"v1","addr":"172.21.15.179:6835","nonce":3140311410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2649941331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2649941331},{"type":"v1","addr":"172.21.15.179:6834","nonce":2649941331}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3061056526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3061056526},{"type":"v1","addr":"172.21.15.154:6834","nonce":3061056526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:18:23.465253+0000","modified":"2023-10-10T22:18:27.020551+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9138":{"gid":9138,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3697556207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3697556207},{"type":"v1","addr":"172.21.15.154:6835","nonce":3697556207}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-10T22:34:25.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.282+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f62a0067050 msgr2=0x7f62a0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:25.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.282+0000 7f62bf59e700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f62a0067050 0x7f62a0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.282+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62c0159c60 msgr2=0x7f62c0168720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.282+0000 7f62bf59e700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62c0159c60 0x7f62c0168720 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c800 tx=0x7f62b4015000 comp rx=0 tx=0).stop 2023-10-10T22:34:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.282+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 shutdown_connections 2023-10-10T22:34:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.282+0000 7f62bf59e700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f62a0067050 0x7f62a0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.283+0000 7f62bf59e700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c0167fc0 0x7f62c0156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.283+0000 7f62bf59e700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a8004810 0x7f62c0151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.283+0000 7f62bf59e700 1 --2- 172.21.15.154:0/2427185225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62c0159c60 0x7f62c0168720 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.283+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 >> 172.21.15.154:0/2427185225 conn(0x7f62c00cc1f0 msgr2=0x7f62c00c8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:25.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.283+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 shutdown_connections 2023-10-10T22:34:25.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.283+0000 7f62bf59e700 1 -- 172.21.15.154:0/2427185225 wait complete. 2023-10-10T22:34:25.287 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 78 2023-10-10T22:34:25.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:34:25.347 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:25.345+0000 7fe8c8164180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:34:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.489+0000 7f3f0bfff700 1 Processor -- start 2023-10-10T22:34:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.489+0000 7f3f0bfff700 1 -- start start 2023-10-10T22:34:25.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.490+0000 7f3f0bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f0c06d950 0x7f3f0c0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.490+0000 7f3f0bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c06a0a0 0x7f3f0c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.490+0000 7f3f0bfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c06ae70 con 0x7f3f0c06dd20 2023-10-10T22:34:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.490+0000 7f3f0bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c06a540 con 0x7f3f0c06d950 2023-10-10T22:34:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f0bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c06a820 con 0x7f3f0c06a0a0 2023-10-10T22:34:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f0b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3f0c06dd20 0x7f3f0c0c7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47048/0 (socket says 172.21.15.154:47048) 2023-10-10T22:34:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f0b7fe700 1 -- 172.21.15.154:0/3319465565 learned_addr learned my addr 172.21.15.154:0/3319465565 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f0affd700 1 --2- 172.21.15.154:0/3319465565 >> v2:172.21.15.179:3300/0 conn(0x7f3f0c06d950 0x7f3f0c0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f0a7fc700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c06a0a0 0x7f3f0c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796820464 0 0) 0x7f3f0c06ae70 con 0x7f3f0c06dd20 2023-10-10T22:34:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef4003570 con 0x7f3f0c06dd20 2023-10-10T22:34:25.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4234192136 0 0) 0x7f3ef4003570 con 0x7f3f0c06dd20 2023-10-10T22:34:25.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c06a0a0 msgr2=0x7f3f0c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:25.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.491+0000 7f3f09ffb700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c06a0a0 0x7f3f0c0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 >> v2:172.21.15.179:3300/0 conn(0x7f3f0c06d950 msgr2=0x7f3f0c0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:25.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 --2- 172.21.15.154:0/3319465565 >> v2:172.21.15.179:3300/0 conn(0x7f3f0c06d950 0x7f3f0c0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c06ab00 con 0x7f3f0c06dd20 2023-10-10T22:34:25.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f3f040017f0 con 0x7f3f0c06dd20 2023-10-10T22:34:25.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 >> v1:172.21.15.154:6789/0 conn(0x7f3f0c06dd20 legacy=0x7f3f0c0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c06a0a0 0x7f3ef4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4003fe0 0x7f3ef4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef4004d50 0x7f3ef40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c06a540 con 0x7f3ef4003fe0 2023-10-10T22:34:25.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c06a820 con 0x7f3ef4004d50 2023-10-10T22:34:25.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef400ba90 con 0x7f3f0c06a0a0 2023-10-10T22:34:25.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f0affd700 1 --2- 172.21.15.154:0/3319465565 >> v2:172.21.15.179:3300/0 conn(0x7f3f0c06d950 0x7f3f0c0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:25.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f0a7fc700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4003fe0 0x7f3ef4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f0b7fe700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef4004d50 0x7f3ef40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f0affd700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c06a0a0 0x7f3ef4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f0a7fc700 1 -- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c06a0a0 msgr2=0x7f3ef4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:25.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f0a7fc700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c06a0a0 0x7f3ef4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f0a7fc700 1 -- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef4004d50 msgr2=0x7f3ef40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:25.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.492+0000 7f3f0a7fc700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef4004d50 0x7f3ef40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.493+0000 7f3f0a7fc700 1 -- 172.21.15.154:0/3319465565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef4003570 con 0x7f3ef4003fe0 2023-10-10T22:34:25.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.493+0000 7f3f0a7fc700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4003fe0 0x7f3ef4004810 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009c00 tx=0x7f3f000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22efd285d20dd239 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:25.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.493+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000e6b0 con 0x7f3ef4003fe0 2023-10-10T22:34:25.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.493+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000e810 con 0x7f3ef4003fe0 2023-10-10T22:34:25.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.493+0000 7f3f09ffb700 1 -- 172.21.15.154:0/3319465565 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000ebd0 con 0x7f3ef4003fe0 2023-10-10T22:34:25.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.494+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3319465565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4003fe0 msgr2=0x7f3ef4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.494+0000 7f3f0bfff700 1 --2- 172.21.15.154:0/3319465565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4003fe0 0x7f3ef4004810 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009c00 tx=0x7f3f000091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.494+0000 7f3f0b7fe700 1 -- 172.21.15.154:0/3319465565 reap_dead start 2023-10-10T22:34:25.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.494+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3319465565 shutdown_connections 2023-10-10T22:34:25.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.494+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3319465565 >> 172.21.15.154:0/3319465565 conn(0x7f3f0c0cc1f0 msgr2=0x7f3f0c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:25.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.494+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3319465565 shutdown_connections 2023-10-10T22:34:25.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.494+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3319465565 wait complete. 2023-10-10T22:34:25.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.495+0000 7f3f0bfff700 1 Processor -- start 2023-10-10T22:34:25.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.495+0000 7f3f0bfff700 1 -- start start 2023-10-10T22:34:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.496+0000 7f3f0bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef4003fe0 0x7f3f0c0b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.496+0000 7f3f0bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c169e20 0x7f3f0c16dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.496+0000 7f3f0bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c153930 0x7f3f0c0c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.496+0000 7f3f0bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c16a290 con 0x7f3f0c153930 2023-10-10T22:34:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.496+0000 7f3f0bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0af190 con 0x7f3ef4003fe0 2023-10-10T22:34:25.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.496+0000 7f3f0bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0afa30 con 0x7f3f0c169e20 2023-10-10T22:34:25.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c153930 0x7f3f0c0c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0a7fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c169e20 0x7f3f0c16dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c153930 0x7f3f0c0c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53058/0 (socket says 172.21.15.154:53058) 2023-10-10T22:34:25.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0b7fe700 1 -- 172.21.15.154:0/3200452973 learned_addr learned my addr 172.21.15.154:0/3200452973 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:25.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0affd700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef4003fe0 0x7f3f0c0b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0b7fe700 1 -- 172.21.15.154:0/3200452973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c169e20 msgr2=0x7f3f0c16dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0b7fe700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c169e20 0x7f3f0c16dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0b7fe700 1 -- 172.21.15.154:0/3200452973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef4003fe0 msgr2=0x7f3f0c0b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0b7fe700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef4003fe0 0x7f3f0c0b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0b7fe700 1 -- 172.21.15.154:0/3200452973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c16e2a0 con 0x7f3f0c153930 2023-10-10T22:34:25.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0a7fc700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c169e20 0x7f3f0c16dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:25.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.497+0000 7f3f0b7fe700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c153930 0x7f3f0c0c4de0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f3f04000f80 tx=0x7f3f04002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:25.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.498+0000 7f3ef2ffd700 1 -- 172.21.15.154:0/3200452973 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400acd0 con 0x7f3f0c153930 2023-10-10T22:34:25.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.498+0000 7f3ef2ffd700 1 -- 172.21.15.154:0/3200452973 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0400ae50 con 0x7f3f0c153930 2023-10-10T22:34:25.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.498+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c0b1ee0 con 0x7f3f0c153930 2023-10-10T22:34:25.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.498+0000 7f3ef2ffd700 1 -- 172.21.15.154:0/3200452973 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04013640 con 0x7f3f0c153930 2023-10-10T22:34:25.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.498+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c0af6c0 con 0x7f3f0c153930 2023-10-10T22:34:25.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.499+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c06ee60 con 0x7f3f0c153930 2023-10-10T22:34:25.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.501+0000 7f3ef2ffd700 1 -- 172.21.15.154:0/3200452973 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f3f040139b0 con 0x7f3f0c153930 2023-10-10T22:34:25.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.502+0000 7f3ef2ffd700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3ef8067050 0x7f3ef8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.502+0000 7f3f0affd700 1 -- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3ef8067050 msgr2=0x7f3ef8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:25.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.502+0000 7f3ef2ffd700 1 -- 172.21.15.154:0/3200452973 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f3f040853f0 con 0x7f3f0c153930 2023-10-10T22:34:25.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.502+0000 7f3f0affd700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3ef8067050 0x7f3ef8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:25.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.507+0000 7f3ef2ffd700 1 -- 172.21.15.154:0/3200452973 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f04052080 con 0x7f3f0c153930 2023-10-10T22:34:25.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.703+0000 7f3f0affd700 1 -- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3ef8067050 msgr2=0x7f3ef8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:25.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.703+0000 7f3f0affd700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3ef8067050 0x7f3ef8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.708+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f0c0afba0 con 0x7f3f0c153930 2023-10-10T22:34:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.709+0000 7f3ef2ffd700 1 -- 172.21.15.154:0/3200452973 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f3f040556a0 con 0x7f3f0c153930 2023-10-10T22:34:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:25.711 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":180,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:34:23.737408+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:18:21.404071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-10T22:18:22.445408+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":180,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.2b","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/498340340":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/343743971":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/3925921356":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/2315091237":"2023-10-11T22:29:23.075298+0000","172.21.15.154:6837/85496":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/2413918626":"2023-10-11T22:29:23.075298+0000","172.21.15.154:6836/85496":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/227322610":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/2303751617":"2023-10-11T22:29:23.075298+0000","172.21.15.154:0/3605187556":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/2055186398":"2023-10-11T22:18:44.244130+0000","172.21.15.154:0/1018803754":"2023-10-11T22:18:44.244130+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:34:25.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3ef8067050 msgr2=0x7f3ef8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:25.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3ef8067050 0x7f3ef8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c153930 msgr2=0x7f3f0c0c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c153930 0x7f3f0c0c4de0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f3f04000f80 tx=0x7f3f04002210 comp rx=0 tx=0).stop 2023-10-10T22:34:25.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 shutdown_connections 2023-10-10T22:34:25.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3ef8067050 0x7f3ef8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c153930 0x7f3f0c0c4de0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef4003fe0 0x7f3f0c0b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 --2- 172.21.15.154:0/3200452973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c169e20 0x7f3f0c16dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 >> 172.21.15.154:0/3200452973 conn(0x7f3f0c0cc1f0 msgr2=0x7f3f0c0cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:25.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 shutdown_connections 2023-10-10T22:34:25.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.712+0000 7f3f0bfff700 1 -- 172.21.15.154:0/3200452973 wait complete. 2023-10-10T22:34:25.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T22:34:25.780 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:25.779+0000 7f3597687180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:34:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.970+0000 7f19ca99d700 1 Processor -- start 2023-10-10T22:34:25.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.970+0000 7f19ca99d700 1 -- start start 2023-10-10T22:34:25.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.971+0000 7f19ca99d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19c4142ea0 0x7f19c40b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.971+0000 7f19ca99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19c406c0f0 0x7f19c406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.971+0000 7f19ca99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c40b40f0 con 0x7f19c40ad870 2023-10-10T22:34:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.971+0000 7f19ca99d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c4069640 con 0x7f19c4142ea0 2023-10-10T22:34:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.971+0000 7f19ca99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c4069920 con 0x7f19c406c0f0 2023-10-10T22:34:25.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.972+0000 7f19c999b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19c4142ea0 0x7f19c40b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.972+0000 7f19c999b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19c4142ea0 0x7f19c40b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49682/0 (socket says 172.21.15.154:49682) 2023-10-10T22:34:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.972+0000 7f19c999b700 1 -- 172.21.15.154:0/4080430708 learned_addr learned my addr 172.21.15.154:0/4080430708 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.972+0000 7f19ca19c700 1 --2- 172.21.15.154:0/4080430708 >> v2:172.21.15.179:3300/0 conn(0x7f19c406c0f0 0x7f19c406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.972+0000 7f19c919a700 1 --1- 172.21.15.154:0/4080430708 >> v1:172.21.15.154:6789/0 conn(0x7f19c40ad870 0x7f19c406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59300/0 (socket says 172.21.15.154:59300) 2023-10-10T22:34:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.972+0000 7f19c999b700 1 -- 172.21.15.154:0/4080430708 >> v2:172.21.15.179:3300/0 conn(0x7f19c406c0f0 msgr2=0x7f19c406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:25.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.972+0000 7f19c999b700 1 --2- 172.21.15.154:0/4080430708 >> v2:172.21.15.179:3300/0 conn(0x7f19c406c0f0 0x7f19c406a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.972+0000 7f19c999b700 1 -- 172.21.15.154:0/4080430708 >> v1:172.21.15.154:6789/0 conn(0x7f19c40ad870 legacy=0x7f19c406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.972+0000 7f19c999b700 1 -- 172.21.15.154:0/4080430708 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c4069c00 con 0x7f19c4142ea0 2023-10-10T22:34:25.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.973+0000 7f19c999b700 1 --2- 172.21.15.154:0/4080430708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c4142ea0 0x7f19c40b3630 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f19c4071330 tx=0x7f19c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9b307344a934fc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:25.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.973+0000 7f19c8999700 1 -- 172.21.15.154:0/4080430708 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0009e70 con 0x7f19c4142ea0 2023-10-10T22:34:25.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.973+0000 7f19c8999700 1 -- 172.21.15.154:0/4080430708 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c000b860 con 0x7f19c4142ea0 2023-10-10T22:34:25.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.973+0000 7f19c8999700 1 -- 172.21.15.154:0/4080430708 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000bc00 con 0x7f19c4142ea0 2023-10-10T22:34:25.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.973+0000 7f19ca99d700 1 -- 172.21.15.154:0/4080430708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c4142ea0 msgr2=0x7f19c40b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.973+0000 7f19ca99d700 1 --2- 172.21.15.154:0/4080430708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c4142ea0 0x7f19c40b3630 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f19c4071330 tx=0x7f19c0009250 comp rx=0 tx=0).stop 2023-10-10T22:34:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.974+0000 7f19ca99d700 1 -- 172.21.15.154:0/4080430708 shutdown_connections 2023-10-10T22:34:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.974+0000 7f19ca99d700 1 --2- 172.21.15.154:0/4080430708 >> v2:172.21.15.179:3300/0 conn(0x7f19c406c0f0 0x7f19c406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.974+0000 7f19ca99d700 1 --2- 172.21.15.154:0/4080430708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c4142ea0 0x7f19c40b3630 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.974+0000 7f19ca99d700 1 -- 172.21.15.154:0/4080430708 >> 172.21.15.154:0/4080430708 conn(0x7f19c40ce430 msgr2=0x7f19c40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.974+0000 7f19ca99d700 1 -- 172.21.15.154:0/4080430708 shutdown_connections 2023-10-10T22:34:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.974+0000 7f19ca99d700 1 -- 172.21.15.154:0/4080430708 wait complete. 2023-10-10T22:34:25.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.975+0000 7f19ca99d700 1 Processor -- start 2023-10-10T22:34:25.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.975+0000 7f19ca99d700 1 -- start start 2023-10-10T22:34:25.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19ca99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406c0f0 0x7f19c415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19ca99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19c4142ea0 0x7f19c415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19ca99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19c4140150 0x7f19c4158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19ca99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40c75e0 con 0x7f19c406c0f0 2023-10-10T22:34:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19ca99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40c78c0 con 0x7f19c4140150 2023-10-10T22:34:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19ca99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40c7ba0 con 0x7f19c4142ea0 2023-10-10T22:34:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19c999b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406c0f0 0x7f19c415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19c999b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406c0f0 0x7f19c415ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49696/0 (socket says 172.21.15.154:49696) 2023-10-10T22:34:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19c999b700 1 -- 172.21.15.154:0/1697427463 learned_addr learned my addr 172.21.15.154:0/1697427463 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19ca19c700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19c4140150 0x7f19c4158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.976+0000 7f19c919a700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19c4142ea0 0x7f19c415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.977+0000 7f19c999b700 1 -- 172.21.15.154:0/1697427463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19c4142ea0 msgr2=0x7f19c415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.977+0000 7f19c999b700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19c4142ea0 0x7f19c415a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.977+0000 7f19c999b700 1 -- 172.21.15.154:0/1697427463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19c4140150 msgr2=0x7f19c4158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.977+0000 7f19c999b700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19c4140150 0x7f19c4158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.977+0000 7f19c999b700 1 -- 172.21.15.154:0/1697427463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00094f0 con 0x7f19c406c0f0 2023-10-10T22:34:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.977+0000 7f19ca19c700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19c4140150 0x7f19c4158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.977+0000 7f19c999b700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406c0f0 0x7f19c415ebd0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f19c406f0d0 tx=0x7f19c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:25.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.977+0000 7f19b9ffb700 1 -- 172.21.15.154:0/1697427463 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000bbe0 con 0x7f19c406c0f0 2023-10-10T22:34:25.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.978+0000 7f19b9ffb700 1 -- 172.21.15.154:0/1697427463 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c0011420 con 0x7f19c406c0f0 2023-10-10T22:34:25.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.978+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c40c7e80 con 0x7f19c406c0f0 2023-10-10T22:34:25.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.978+0000 7f19b9ffb700 1 -- 172.21.15.154:0/1697427463 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00117e0 con 0x7f19c406c0f0 2023-10-10T22:34:25.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.978+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c415f110 con 0x7f19c406c0f0 2023-10-10T22:34:25.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.979+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c40c83a0 con 0x7f19c406c0f0 2023-10-10T22:34:25.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.980+0000 7f19b9ffb700 1 -- 172.21.15.154:0/1697427463 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f19c0011c10 con 0x7f19c406c0f0 2023-10-10T22:34:25.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.981+0000 7f19b9ffb700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f19a8067050 0x7f19a8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:25.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.981+0000 7f19b9ffb700 1 -- 172.21.15.154:0/1697427463 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f19c0086340 con 0x7f19c406c0f0 2023-10-10T22:34:25.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.981+0000 7f19c919a700 1 -- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f19a8067050 msgr2=0x7f19a8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:25.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.981+0000 7f19c919a700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f19a8067050 0x7f19a8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:25.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:25.986+0000 7f19b9ffb700 1 -- 172.21.15.154:0/1697427463 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19c40c83a0 con 0x7f19c406c0f0 2023-10-10T22:34:26.068 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:26.066+0000 7f3597687180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:34:26.103 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:26.102+0000 7fe8c8164180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:34:26.161 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:26.159+0000 7f3597687180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:34:26.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.182+0000 7f19c919a700 1 -- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f19a8067050 msgr2=0x7f19a8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:26.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.182+0000 7f19c919a700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f19a8067050 0x7f19a8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:26.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.229+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f19c40c83a0 con 0x7f19c406c0f0 2023-10-10T22:34:26.231 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T22:34:26.230+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T22:34:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.239+0000 7f19b9ffb700 1 -- 172.21.15.154:0/1697427463 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7f19c40c83a0 con 0x7f19c406c0f0 2023-10-10T22:34:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f19a8067050 msgr2=0x7f19a8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f19a8067050 0x7f19a8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406c0f0 msgr2=0x7f19c415ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406c0f0 0x7f19c415ebd0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f19c406f0d0 tx=0x7f19c0017000 comp rx=0 tx=0).stop 2023-10-10T22:34:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 shutdown_connections 2023-10-10T22:34:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f19a8067050 0x7f19a8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19c4140150 0x7f19c4158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406c0f0 0x7f19c415ebd0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 --2- 172.21.15.154:0/1697427463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19c4142ea0 0x7f19c415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 >> 172.21.15.154:0/1697427463 conn(0x7f19c40ce430 msgr2=0x7f19c41420a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 shutdown_connections 2023-10-10T22:34:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.242+0000 7f19ca99d700 1 -- 172.21.15.154:0/1697427463 wait complete. 2023-10-10T22:34:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T22:34:26.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T22:34:26.299 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T22:34:26.319 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:26.317+0000 7f3597687180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:34:26.407 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:26.406+0000 7fe8c8164180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:34:26.425 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:26.424+0000 7f3597687180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:34:26.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.453+0000 7efffaf9d700 1 Processor -- start 2023-10-10T22:34:26.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.453+0000 7efffaf9d700 1 -- start start 2023-10-10T22:34:26.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.455+0000 7efffaf9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efff40b4e70 0x7efff40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:26.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.455+0000 7efffaf9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efff40b1b40 0x7efff415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:26.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.455+0000 7efffaf9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff40cfb00 con 0x7efff40b16d0 2023-10-10T22:34:26.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.455+0000 7efffaf9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff40b5c40 con 0x7efff40b4e70 2023-10-10T22:34:26.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.455+0000 7efffaf9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff40b5f20 con 0x7efff40b1b40 2023-10-10T22:34:26.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.455+0000 7efff9f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efff40b4e70 0x7efff40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:26.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.455+0000 7efff9f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efff40b4e70 0x7efff40ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49730/0 (socket says 172.21.15.154:49730) 2023-10-10T22:34:26.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.455+0000 7efff9f9b700 1 -- 172.21.15.154:0/2386370635 learned_addr learned my addr 172.21.15.154:0/2386370635 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:26.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.455+0000 7efffa79c700 1 --2- 172.21.15.154:0/2386370635 >> v2:172.21.15.179:3300/0 conn(0x7efff40b1b40 0x7efff415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:26.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.456+0000 7efff9f9b700 1 -- 172.21.15.154:0/2386370635 >> v2:172.21.15.179:3300/0 conn(0x7efff40b1b40 msgr2=0x7efff415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:26.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.456+0000 7efff9f9b700 1 --2- 172.21.15.154:0/2386370635 >> v2:172.21.15.179:3300/0 conn(0x7efff40b1b40 0x7efff415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.456+0000 7efff9f9b700 1 -- 172.21.15.154:0/2386370635 >> v1:172.21.15.179:6789/0 conn(0x7efff40b16d0 legacy=0x7efff415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.456+0000 7efff9f9b700 1 -- 172.21.15.154:0/2386370635 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40b6200 con 0x7efff40b4e70 2023-10-10T22:34:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.456+0000 7efff9f9b700 1 --2- 172.21.15.154:0/2386370635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b4e70 0x7efff40ccff0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7efff4071380 tx=0x7efff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163797e7decdf981 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:26.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.456+0000 7efff8f99700 1 -- 172.21.15.154:0/2386370635 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0009e70 con 0x7efff40b4e70 2023-10-10T22:34:26.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.456+0000 7efff8f99700 1 -- 172.21.15.154:0/2386370635 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff000b860 con 0x7efff40b4e70 2023-10-10T22:34:26.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.456+0000 7efff8f99700 1 -- 172.21.15.154:0/2386370635 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000bc00 con 0x7efff40b4e70 2023-10-10T22:34:26.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.457+0000 7efffaf9d700 1 -- 172.21.15.154:0/2386370635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b4e70 msgr2=0x7efff40ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:26.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.457+0000 7efffaf9d700 1 --2- 172.21.15.154:0/2386370635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b4e70 0x7efff40ccff0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7efff4071380 tx=0x7efff0009250 comp rx=0 tx=0).stop 2023-10-10T22:34:26.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.457+0000 7efffaf9d700 1 -- 172.21.15.154:0/2386370635 shutdown_connections 2023-10-10T22:34:26.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.457+0000 7efffaf9d700 1 --2- 172.21.15.154:0/2386370635 >> v2:172.21.15.179:3300/0 conn(0x7efff40b1b40 0x7efff415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.457+0000 7efffaf9d700 1 --2- 172.21.15.154:0/2386370635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b4e70 0x7efff40ccff0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.457+0000 7efffaf9d700 1 -- 172.21.15.154:0/2386370635 >> 172.21.15.154:0/2386370635 conn(0x7efff40d10c0 msgr2=0x7efff40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:26.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.457+0000 7efffaf9d700 1 -- 172.21.15.154:0/2386370635 shutdown_connections 2023-10-10T22:34:26.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.457+0000 7efffaf9d700 1 -- 172.21.15.154:0/2386370635 wait complete. 2023-10-10T22:34:26.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.458+0000 7efffaf9d700 1 Processor -- start 2023-10-10T22:34:26.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.459+0000 7efffaf9d700 1 -- start start 2023-10-10T22:34:26.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.459+0000 7efffaf9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff40b16d0 0x7efff415e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:26.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.459+0000 7efffaf9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b1b40 0x7efff415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:26.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efffaf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff40b4e70 0x7efff40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:26.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efffaf9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff415a2c0 con 0x7efff40b1b40 2023-10-10T22:34:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efffaf9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff4158640 con 0x7efff40b16d0 2023-10-10T22:34:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efffaf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff4159ce0 con 0x7efff40b4e70 2023-10-10T22:34:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff979a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b1b40 0x7efff415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff9f9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff40b16d0 0x7efff415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efffa79c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff40b4e70 0x7efff40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:26.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff9f9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff40b16d0 0x7efff415e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:39156/0 (socket says 172.21.15.154:39156) 2023-10-10T22:34:26.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff9f9b700 1 -- 172.21.15.154:0/2580977287 learned_addr learned my addr 172.21.15.154:0/2580977287 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:26.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff979a700 1 -- 172.21.15.154:0/2580977287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff40b4e70 msgr2=0x7efff40cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:26.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff979a700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff40b4e70 0x7efff40cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff979a700 1 -- 172.21.15.154:0/2580977287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff40b16d0 msgr2=0x7efff415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:26.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff979a700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff40b16d0 0x7efff415e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:26.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff979a700 1 -- 172.21.15.154:0/2580977287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00094f0 con 0x7efff40b1b40 2023-10-10T22:34:26.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.460+0000 7efff9f9b700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff40b16d0 0x7efff415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:26.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.461+0000 7efff979a700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b1b40 0x7efff415a750 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7effe400c5c0 tx=0x7effe4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:26.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.461+0000 7effe9ffb700 1 -- 172.21.15.154:0/2580977287 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4011590 con 0x7efff40b1b40 2023-10-10T22:34:26.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.461+0000 7effe9ffb700 1 -- 172.21.15.154:0/2580977287 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe4011710 con 0x7efff40b1b40 2023-10-10T22:34:26.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.461+0000 7effe9ffb700 1 -- 172.21.15.154:0/2580977287 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4011ad0 con 0x7efff40b1b40 2023-10-10T22:34:26.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.461+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff41608b0 con 0x7efff40b1b40 2023-10-10T22:34:26.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.461+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff4160b90 con 0x7efff40b1b40 2023-10-10T22:34:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.462+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff415a470 con 0x7efff40b1b40 2023-10-10T22:34:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.464+0000 7effe9ffb700 1 -- 172.21.15.154:0/2580977287 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 95) v1 ==== 84854+0+0 (secure 0 0 0) 0x7effe401b3b0 con 0x7efff40b1b40 2023-10-10T22:34:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.465+0000 7effe9ffb700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 0x7effd8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.465+0000 7effe9ffb700 1 -- 172.21.15.154:0/2580977287 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6828+0+0 (secure 0 0 0) 0x7effe4083e70 con 0x7efff40b1b40 2023-10-10T22:34:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.465+0000 7efff9f9b700 1 -- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 msgr2=0x7effd8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.465+0000 7efff9f9b700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 0x7effd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:26.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.473+0000 7effe9ffb700 1 -- 172.21.15.154:0/2580977287 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efff415a470 con 0x7efff40b1b40 2023-10-10T22:34:26.510 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:26.508+0000 7fe8c8164180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:34:26.617 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:26.615+0000 7f3597687180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:34:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.666+0000 7efff9f9b700 1 -- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 msgr2=0x7effd8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:26.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.666+0000 7efff9f9b700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 0x7effd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:26.671 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:26.670+0000 7fe8c8164180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:34:26.710 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:26.708+0000 7f3597687180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:34:26.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:26.718+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efff415a400 con 0x7efff40b1b40 2023-10-10T22:34:26.781 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:26.779+0000 7fe8c8164180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:34:26.802 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:26.800+0000 7f3597687180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:34:26.896 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:26.894+0000 7f3597687180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:34:26.973 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:26.972+0000 7fe8c8164180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:34:27.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.067+0000 7efff9f9b700 1 -- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 msgr2=0x7effd8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:27.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.067+0000 7efff9f9b700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 0x7effd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T22:34:27.069 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:27.068+0000 7fe8c8164180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:34:27.164 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:27.162+0000 7fe8c8164180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:34:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.239+0000 7effe9ffb700 1 -- 172.21.15.154:0/2580977287 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7effe4017020 con 0x7efff40b1b40 2023-10-10T22:34:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 msgr2=0x7effd8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 0x7effd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b1b40 msgr2=0x7efff415a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b1b40 0x7efff415a750 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7effe400c5c0 tx=0x7effe4007ec0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 shutdown_connections 2023-10-10T22:34:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7effd8067050 0x7effd8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff40b4e70 0x7efff40cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff40b16d0 0x7efff415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 --2- 172.21.15.154:0/2580977287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efff40b1b40 0x7efff415a750 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 >> 172.21.15.154:0/2580977287 conn(0x7efff40d10c0 msgr2=0x7efff40b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 shutdown_connections 2023-10-10T22:34:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.242+0000 7efffaf9d700 1 -- 172.21.15.154:0/2580977287 wait complete. 2023-10-10T22:34:27.264 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:27.262+0000 7fe8c8164180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:34:27.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T22:34:27.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.497+0000 7f6d1a99d700 1 Processor -- start 2023-10-10T22:34:27.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.498+0000 7f6d1a99d700 1 -- start start 2023-10-10T22:34:27.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1a99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14156350 0x7f6d14157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:27.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1a99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d140b0760 0x7f6d140b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:27.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1a99d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d14159f20 0x7f6d1415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:27.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1a99d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d140b1110 con 0x7f6d14159f20 2023-10-10T22:34:27.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1a99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d140b0570 con 0x7f6d140b0760 2023-10-10T22:34:27.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1a99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d141578b0 con 0x7f6d14156350 2023-10-10T22:34:27.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1a19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d14159f20 0x7f6d1415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:27.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1a19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d14159f20 0x7f6d1415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49838/0 (socket says 172.21.15.154:49838) 2023-10-10T22:34:27.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1a19c700 1 -- 172.21.15.154:0/1089872080 learned_addr learned my addr 172.21.15.154:0/1089872080 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:27.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1999b700 1 --2- 172.21.15.154:0/1089872080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14156350 0x7f6d14157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:27.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.499+0000 7f6d1919a700 1 --2- 172.21.15.154:0/1089872080 >> v2:172.21.15.179:3300/0 conn(0x7f6d140b0760 0x7f6d140b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:27.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d1a19c700 1 -- 172.21.15.154:0/1089872080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14156350 msgr2=0x7f6d14157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:27.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d1a19c700 1 --2- 172.21.15.154:0/1089872080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14156350 0x7f6d14157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d1a19c700 1 -- 172.21.15.154:0/1089872080 >> v2:172.21.15.179:3300/0 conn(0x7f6d140b0760 msgr2=0x7f6d140b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:27.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d1a19c700 1 --2- 172.21.15.154:0/1089872080 >> v2:172.21.15.179:3300/0 conn(0x7f6d140b0760 0x7f6d140b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d1a19c700 1 -- 172.21.15.154:0/1089872080 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d140af4d0 con 0x7f6d14159f20 2023-10-10T22:34:27.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d1919a700 1 --2- 172.21.15.154:0/1089872080 >> v2:172.21.15.179:3300/0 conn(0x7f6d140b0760 0x7f6d140b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:27.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d1a19c700 1 --2- 172.21.15.154:0/1089872080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14159f20 0x7f6d1415a360 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f6d14070f40 tx=0x7f6d0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9b83fb8d7f92e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:27.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d18999700 1 -- 172.21.15.154:0/1089872080 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c009e70 con 0x7f6d14159f20 2023-10-10T22:34:27.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d18999700 1 -- 172.21.15.154:0/1089872080 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0c00b860 con 0x7f6d14159f20 2023-10-10T22:34:27.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.500+0000 7f6d18999700 1 -- 172.21.15.154:0/1089872080 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c00bc00 con 0x7f6d14159f20 2023-10-10T22:34:27.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.501+0000 7f6d1a99d700 1 -- 172.21.15.154:0/1089872080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14159f20 msgr2=0x7f6d1415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:27.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.501+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/1089872080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14159f20 0x7f6d1415a360 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f6d14070f40 tx=0x7f6d0c009250 comp rx=0 tx=0).stop 2023-10-10T22:34:27.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.501+0000 7f6d1a99d700 1 -- 172.21.15.154:0/1089872080 shutdown_connections 2023-10-10T22:34:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.501+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/1089872080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14159f20 0x7f6d1415a360 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.501+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/1089872080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14156350 0x7f6d14157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.501+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/1089872080 >> v2:172.21.15.179:3300/0 conn(0x7f6d140b0760 0x7f6d140b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.501+0000 7f6d1a99d700 1 -- 172.21.15.154:0/1089872080 >> 172.21.15.154:0/1089872080 conn(0x7f6d14068e20 msgr2=0x7f6d140cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.501+0000 7f6d1a99d700 1 -- 172.21.15.154:0/1089872080 shutdown_connections 2023-10-10T22:34:27.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.501+0000 7f6d1a99d700 1 -- 172.21.15.154:0/1089872080 wait complete. 2023-10-10T22:34:27.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.502+0000 7f6d1a99d700 1 Processor -- start 2023-10-10T22:34:27.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.502+0000 7f6d1a99d700 1 -- start start 2023-10-10T22:34:27.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.503+0000 7f6d1a99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d140b0760 0x7f6d14150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:27.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.503+0000 7f6d1a99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14156350 0x7f6d140c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:27.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.503+0000 7f6d1a99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14159f20 0x7f6d140c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:27.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.503+0000 7f6d1a99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140ca500 con 0x7f6d14156350 2023-10-10T22:34:27.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.503+0000 7f6d1a99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140caff0 con 0x7f6d140b0760 2023-10-10T22:34:27.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.503+0000 7f6d1a99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140ca750 con 0x7f6d14159f20 2023-10-10T22:34:27.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1919a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14156350 0x7f6d140c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:27.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1919a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14156350 0x7f6d140c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49848/0 (socket says 172.21.15.154:49848) 2023-10-10T22:34:27.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1919a700 1 -- 172.21.15.154:0/771640549 learned_addr learned my addr 172.21.15.154:0/771640549 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:27.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1999b700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d140b0760 0x7f6d14150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:27.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1a19c700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14159f20 0x7f6d140c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:27.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1919a700 1 -- 172.21.15.154:0/771640549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14159f20 msgr2=0x7f6d140c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1919a700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14159f20 0x7f6d140c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1919a700 1 -- 172.21.15.154:0/771640549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d140b0760 msgr2=0x7f6d14150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1919a700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d140b0760 0x7f6d14150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1919a700 1 -- 172.21.15.154:0/771640549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0094f0 con 0x7f6d14156350 2023-10-10T22:34:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d1919a700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14156350 0x7f6d140c9a80 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d860 tx=0x7f6d04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:27.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.504+0000 7f6d09ffb700 1 -- 172.21.15.154:0/771640549 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040125f0 con 0x7f6d14156350 2023-10-10T22:34:27.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.505+0000 7f6d09ffb700 1 -- 172.21.15.154:0/771640549 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d04012750 con 0x7f6d14156350 2023-10-10T22:34:27.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.505+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d140caa30 con 0x7f6d14156350 2023-10-10T22:34:27.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.505+0000 7f6d09ffb700 1 -- 172.21.15.154:0/771640549 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04012af0 con 0x7f6d14156350 2023-10-10T22:34:27.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.505+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d14169800 con 0x7f6d14156350 2023-10-10T22:34:27.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.506+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1404c3c0 con 0x7f6d14156350 2023-10-10T22:34:27.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.507+0000 7f6d09ffb700 1 -- 172.21.15.154:0/771640549 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 97) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f6d04013480 con 0x7f6d14156350 2023-10-10T22:34:27.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.508+0000 7f6d09ffb700 1 -- 172.21.15.154:0/771640549 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7172+0+0 (secure 0 0 0) 0x7f6d040847a0 con 0x7f6d14156350 2023-10-10T22:34:27.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.512+0000 7f6d09ffb700 1 -- 172.21.15.154:0/771640549 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d04051810 con 0x7f6d14156350 2023-10-10T22:34:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:27.703+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d140af7b0 con 0x7f6d14156350 2023-10-10T22:34:28.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.278+0000 7f6d09ffb700 1 -- 172.21.15.154:0/771640549 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 98) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f6d040512c0 con 0x7f6d14156350 2023-10-10T22:34:28.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.278+0000 7f6d09ffb700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6cf806ce80 0x7f6cf806f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.279+0000 7f6d1999b700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6cf806ce80 0x7f6cf806f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.281+0000 7f6d1999b700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6cf806ce80 0x7f6cf806f260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009fd0 tx=0x7f6d1000b040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.288+0000 7f6d09ffb700 1 -- 172.21.15.154:0/771640549 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v183) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6d04070a40 con 0x7f6d14156350 2023-10-10T22:34:28.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.292+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6cf806ce80 msgr2=0x7f6cf806f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:28.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.292+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6cf806ce80 0x7f6cf806f260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009fd0 tx=0x7f6d1000b040 comp rx=0 tx=0).stop 2023-10-10T22:34:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.292+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14156350 msgr2=0x7f6d140c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.292+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14156350 0x7f6d140c9a80 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d860 tx=0x7f6d04008040 comp rx=0 tx=0).stop 2023-10-10T22:34:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.293+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 shutdown_connections 2023-10-10T22:34:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.293+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6cf806ce80 0x7f6cf806f260 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.293+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d14159f20 0x7f6d140c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.293+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d140b0760 0x7f6d14150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.293+0000 7f6d1a99d700 1 --2- 172.21.15.154:0/771640549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d14156350 0x7f6d140c9a80 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.293+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 >> 172.21.15.154:0/771640549 conn(0x7f6d14068e20 msgr2=0x7f6d14153c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.293+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 shutdown_connections 2023-10-10T22:34:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.293+0000 7f6d1a99d700 1 -- 172.21.15.154:0/771640549 wait complete. 2023-10-10T22:34:28.297 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T22:34:28.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T22:34:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.497+0000 7f44dd5ff700 1 Processor -- start 2023-10-10T22:34:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.498+0000 7f44dd5ff700 1 -- start start 2023-10-10T22:34:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44dd5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d81563b0 0x7f44d8156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44dd5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f44d815a440 0x7f44d80acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44dd5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d815a9b0 con 0x7f44d8068890 2023-10-10T22:34:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44dd5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d815ac90 con 0x7f44d815a440 2023-10-10T22:34:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44dd5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d815af70 con 0x7f44d81563b0 2023-10-10T22:34:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44d77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f44d8068890 0x7f44d80c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59312/0 (socket says 172.21.15.154:59312) 2023-10-10T22:34:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44d77fe700 1 -- 172.21.15.154:0/637336177 learned_addr learned my addr 172.21.15.154:0/637336177 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44d67fc700 1 --2- 172.21.15.154:0/637336177 >> v2:172.21.15.179:3300/0 conn(0x7f44d815a440 0x7f44d80acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625283535 0 0) 0x7f44d815a9b0 con 0x7f44d8068890 2023-10-10T22:34:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44d6ffd700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d81563b0 0x7f44d8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.499+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c0003570 con 0x7f44d8068890 2023-10-10T22:34:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1083010497 0 0) 0x7f44c0003570 con 0x7f44d8068890 2023-10-10T22:34:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d81563b0 msgr2=0x7f44d8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d81563b0 0x7f44d8156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 >> v2:172.21.15.179:3300/0 conn(0x7f44d815a440 msgr2=0x7f44d80acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 --2- 172.21.15.154:0/637336177 >> v2:172.21.15.179:3300/0 conn(0x7f44d815a440 0x7f44d80acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d815b250 con 0x7f44d8068890 2023-10-10T22:34:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f44d0001470 con 0x7f44d8068890 2023-10-10T22:34:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 >> v1:172.21.15.154:6789/0 conn(0x7f44d8068890 legacy=0x7f44d80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c0003ae0 0x7f44c0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d81563b0 0x7f44c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c0004d50 0x7f44c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d815ac90 con 0x7f44c0004d50 2023-10-10T22:34:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d815af70 con 0x7f44c0003ae0 2023-10-10T22:34:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c000bb10 con 0x7f44d81563b0 2023-10-10T22:34:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d77fe700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c0004d50 0x7f44c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d67fc700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d81563b0 0x7f44c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d6ffd700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c0003ae0 0x7f44c0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.500+0000 7f44d77fe700 1 -- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d81563b0 msgr2=0x7f44c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44d77fe700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d81563b0 0x7f44c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44d77fe700 1 -- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c0003ae0 msgr2=0x7f44c0003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44d77fe700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c0003ae0 0x7f44c0003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44d77fe700 1 -- 172.21.15.154:0/637336177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c0003570 con 0x7f44c0004d50 2023-10-10T22:34:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44d77fe700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c0004d50 0x7f44c00051c0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f44d000c300 tx=0x7f44d0001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46443fc93c622a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000cb90 con 0x7f44c0004d50 2023-10-10T22:34:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d000ccf0 con 0x7f44c0004d50 2023-10-10T22:34:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44d5ffb700 1 -- 172.21.15.154:0/637336177 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0005b70 con 0x7f44c0004d50 2023-10-10T22:34:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44dd5ff700 1 -- 172.21.15.154:0/637336177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c0004d50 msgr2=0x7f44c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44dd5ff700 1 --2- 172.21.15.154:0/637336177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c0004d50 0x7f44c00051c0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f44d000c300 tx=0x7f44d0001dc0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.501+0000 7f44d77fe700 1 -- 172.21.15.154:0/637336177 reap_dead start 2023-10-10T22:34:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.502+0000 7f44dd5ff700 1 -- 172.21.15.154:0/637336177 shutdown_connections 2023-10-10T22:34:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.502+0000 7f44dd5ff700 1 -- 172.21.15.154:0/637336177 >> 172.21.15.154:0/637336177 conn(0x7f44d80c8f90 msgr2=0x7f44d80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.502+0000 7f44dd5ff700 1 -- 172.21.15.154:0/637336177 shutdown_connections 2023-10-10T22:34:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.502+0000 7f44dd5ff700 1 -- 172.21.15.154:0/637336177 wait complete. 2023-10-10T22:34:28.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.503+0000 7f44dd5ff700 1 Processor -- start 2023-10-10T22:34:28.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.503+0000 7f44dd5ff700 1 -- start start 2023-10-10T22:34:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44dd5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c0004d50 0x7f44d814cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44dd5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d80b04f0 0x7f44d80aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44dd5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44d80aac40 0x7f44d80ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44dd5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d814d2c0 con 0x7f44d80aac40 2023-10-10T22:34:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44dd5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d8151cb0 con 0x7f44c0004d50 2023-10-10T22:34:28.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44dd5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80ab5f0 con 0x7f44d80b04f0 2023-10-10T22:34:28.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44d80aac40 0x7f44d80ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44d80aac40 0x7f44d80ab0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49874/0 (socket says 172.21.15.154:49874) 2023-10-10T22:34:28.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44d77fe700 1 -- 172.21.15.154:0/3319508363 learned_addr learned my addr 172.21.15.154:0/3319508363 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44d67fc700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d80b04f0 0x7f44d80aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.504+0000 7f44d6ffd700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c0004d50 0x7f44d814cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44d77fe700 1 -- 172.21.15.154:0/3319508363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d80b04f0 msgr2=0x7f44d80aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44d77fe700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d80b04f0 0x7f44d80aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44d77fe700 1 -- 172.21.15.154:0/3319508363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c0004d50 msgr2=0x7f44d814cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44d77fe700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c0004d50 0x7f44d814cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:28.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44d77fe700 1 -- 172.21.15.154:0/3319508363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d80b1670 con 0x7f44d80aac40 2023-10-10T22:34:28.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44d77fe700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44d80aac40 0x7f44d80ab0b0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f44d0015040 tx=0x7f44d0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:28.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44beffd700 1 -- 172.21.15.154:0/3319508363 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000cb90 con 0x7f44d80aac40 2023-10-10T22:34:28.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44beffd700 1 -- 172.21.15.154:0/3319508363 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d000ce60 con 0x7f44d80aac40 2023-10-10T22:34:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44beffd700 1 -- 172.21.15.154:0/3319508363 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0007300 con 0x7f44d80aac40 2023-10-10T22:34:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d80aa7e0 con 0x7f44d80aac40 2023-10-10T22:34:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.505+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d80b0a60 con 0x7f44d80aac40 2023-10-10T22:34:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.506+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d80b1800 con 0x7f44d80aac40 2023-10-10T22:34:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.507+0000 7f44beffd700 1 -- 172.21.15.154:0/3319508363 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 98) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f44d0028460 con 0x7f44d80aac40 2023-10-10T22:34:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.508+0000 7f44beffd700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44c4066e00 0x7f44c40692b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:28.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.508+0000 7f44beffd700 1 -- 172.21.15.154:0/3319508363 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6734+0+0 (secure 0 0 0) 0x7f44d0085b70 con 0x7f44d80aac40 2023-10-10T22:34:28.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.509+0000 7f44d6ffd700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44c4066e00 0x7f44c40692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:28.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.509+0000 7f44d6ffd700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44c4066e00 0x7f44c40692b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f44c80094d0 tx=0x7f44c800b040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:28.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.512+0000 7f44beffd700 1 -- 172.21.15.154:0/3319508363 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44d0052bc0 con 0x7f44d80aac40 2023-10-10T22:34:28.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:28.707+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f44d80718b0 con 0x7f44d80aac40 2023-10-10T22:34:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.289+0000 7f44beffd700 1 -- 172.21.15.154:0/3319508363 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v184) v1 ==== 169+0+0 (secure 0 0 0) 0x7f44d00170d0 con 0x7f44d80aac40 2023-10-10T22:34:29.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.292+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44c4066e00 msgr2=0x7f44c40692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.292+0000 7f44dd5ff700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44c4066e00 0x7f44c40692b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f44c80094d0 tx=0x7f44c800b040 comp rx=0 tx=0).stop 2023-10-10T22:34:29.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44d80aac40 msgr2=0x7f44d80ab0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44d80aac40 0x7f44d80ab0b0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f44d0015040 tx=0x7f44d0012000 comp rx=0 tx=0).stop 2023-10-10T22:34:29.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 shutdown_connections 2023-10-10T22:34:29.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44c4066e00 0x7f44c40692b0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f44c80094d0 tx=0x7f44c800b040 comp rx=0 tx=0).stop 2023-10-10T22:34:29.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44d80aac40 0x7f44d80ab0b0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c0004d50 0x7f44d814cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 --2- 172.21.15.154:0/3319508363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44d80b04f0 0x7f44d80aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 >> 172.21.15.154:0/3319508363 conn(0x7f44d80c8f90 msgr2=0x7f44d8153810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:29.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 shutdown_connections 2023-10-10T22:34:29.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.293+0000 7f44dd5ff700 1 -- 172.21.15.154:0/3319508363 wait complete. 2023-10-10T22:34:29.297 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T22:34:29.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T22:34:29.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.504+0000 7f6d6f59e700 1 Processor -- start 2023-10-10T22:34:29.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.505+0000 7f6d6f59e700 1 -- start start 2023-10-10T22:34:29.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.506+0000 7f6d6f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d700cb1a0 0x7f6d7015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.506+0000 7f6d6f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d7015a8a0 0x7f6d7006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.506+0000 7f6d6f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7006ebd0 con 0x7f6d7006f5a0 2023-10-10T22:34:29.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.506+0000 7f6d6f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7015b2e0 con 0x7f6d700cb1a0 2023-10-10T22:34:29.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.506+0000 7f6d6f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7015ad20 con 0x7f6d7015a8a0 2023-10-10T22:34:29.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6e59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d700cb1a0 0x7f6d7015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6dd9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d7015a8a0 0x7f6d7006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6e59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d700cb1a0 0x7f6d7015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:39244/0 (socket says 172.21.15.154:39244) 2023-10-10T22:34:29.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6dd9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d7015a8a0 0x7f6d7006f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:55962/0 (socket says 172.21.15.154:55962) 2023-10-10T22:34:29.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6e59c700 1 -- 172.21.15.154:0/530255843 learned_addr learned my addr 172.21.15.154:0/530255843 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:29.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6dd9b700 1 -- 172.21.15.154:0/530255843 >> v2:172.21.15.179:3300/0 conn(0x7f6d700cb1a0 msgr2=0x7f6d7015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:29.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6dd9b700 1 --2- 172.21.15.154:0/530255843 >> v2:172.21.15.179:3300/0 conn(0x7f6d700cb1a0 0x7f6d7015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6dd9b700 1 -- 172.21.15.154:0/530255843 >> v1:172.21.15.179:6789/0 conn(0x7f6d7006f5a0 legacy=0x7f6d700ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6dd9b700 1 -- 172.21.15.154:0/530255843 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7015b000 con 0x7f6d7015a8a0 2023-10-10T22:34:29.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6e59c700 1 --2- 172.21.15.154:0/530255843 >> v2:172.21.15.179:3300/0 conn(0x7f6d700cb1a0 0x7f6d7015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:29.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6d59a700 1 -- 172.21.15.154:0/530255843 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906070893 0 0) 0x7f6d7006ebd0 con 0x7f6d7006f5a0 2023-10-10T22:34:29.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.507+0000 7f6d6dd9b700 1 --2- 172.21.15.154:0/530255843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d7015a8a0 0x7f6d7006f060 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400bb90 tx=0x7f6d6400b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f53148d91889e75e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:29.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6d59a700 1 -- 172.21.15.154:0/530255843 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400dbd0 con 0x7f6d7015a8a0 2023-10-10T22:34:29.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6d59a700 1 -- 172.21.15.154:0/530255843 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6400dd30 con 0x7f6d7015a8a0 2023-10-10T22:34:29.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6d59a700 1 -- 172.21.15.154:0/530255843 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400dea0 con 0x7f6d7015a8a0 2023-10-10T22:34:29.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6f59e700 1 -- 172.21.15.154:0/530255843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d7015a8a0 msgr2=0x7f6d7006f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6f59e700 1 --2- 172.21.15.154:0/530255843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d7015a8a0 0x7f6d7006f060 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400bb90 tx=0x7f6d6400b430 comp rx=0 tx=0).stop 2023-10-10T22:34:29.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6f59e700 1 -- 172.21.15.154:0/530255843 shutdown_connections 2023-10-10T22:34:29.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6f59e700 1 --2- 172.21.15.154:0/530255843 >> v2:172.21.15.179:3300/0 conn(0x7f6d700cb1a0 0x7f6d7015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6f59e700 1 --2- 172.21.15.154:0/530255843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d7015a8a0 0x7f6d7006f060 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6f59e700 1 -- 172.21.15.154:0/530255843 >> 172.21.15.154:0/530255843 conn(0x7f6d700cc1e0 msgr2=0x7f6d700cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:29.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6f59e700 1 -- 172.21.15.154:0/530255843 shutdown_connections 2023-10-10T22:34:29.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.508+0000 7f6d6f59e700 1 -- 172.21.15.154:0/530255843 wait complete. 2023-10-10T22:34:29.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.510+0000 7f6d6f59e700 1 Processor -- start 2023-10-10T22:34:29.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.510+0000 7f6d6f59e700 1 -- start start 2023-10-10T22:34:29.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d7006f5a0 0x7f6d701503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d700cb1a0 0x7f6d70169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d701508e0 0x7f6d700c1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6f59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d701556d0 con 0x7f6d700cb1a0 2023-10-10T22:34:29.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700c1bc0 con 0x7f6d7006f5a0 2023-10-10T22:34:29.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700c1ea0 con 0x7f6d701508e0 2023-10-10T22:34:29.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d700cb1a0 0x7f6d70169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d700cb1a0 0x7f6d70169de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49884/0 (socket says 172.21.15.154:49884) 2023-10-10T22:34:29.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6dd9b700 1 -- 172.21.15.154:0/682443132 learned_addr learned my addr 172.21.15.154:0/682443132 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:29.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6e59c700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d7006f5a0 0x7f6d701503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6ed9d700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d701508e0 0x7f6d700c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6dd9b700 1 -- 172.21.15.154:0/682443132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d701508e0 msgr2=0x7f6d700c1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6dd9b700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d701508e0 0x7f6d700c1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6dd9b700 1 -- 172.21.15.154:0/682443132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d7006f5a0 msgr2=0x7f6d701503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6dd9b700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d7006f5a0 0x7f6d701503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6dd9b700 1 -- 172.21.15.154:0/682443132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600094f0 con 0x7f6d700cb1a0 2023-10-10T22:34:29.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.511+0000 7f6d6ed9d700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d701508e0 0x7f6d700c1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:29.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.512+0000 7f6d6dd9b700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d700cb1a0 0x7f6d70169de0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400bfd0 tx=0x7f6d6401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:29.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.512+0000 7f6d5e7fc700 1 -- 172.21.15.154:0/682443132 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64010640 con 0x7f6d700cb1a0 2023-10-10T22:34:29.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.512+0000 7f6d5e7fc700 1 -- 172.21.15.154:0/682443132 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d640107e0 con 0x7f6d700cb1a0 2023-10-10T22:34:29.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.512+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6400b6d0 con 0x7f6d700cb1a0 2023-10-10T22:34:29.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.512+0000 7f6d5e7fc700 1 -- 172.21.15.154:0/682443132 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64010ba0 con 0x7f6d700cb1a0 2023-10-10T22:34:29.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.512+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d700c2180 con 0x7f6d700cb1a0 2023-10-10T22:34:29.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.513+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7006c450 con 0x7f6d700cb1a0 2023-10-10T22:34:29.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.514+0000 7f6d5e7fc700 1 -- 172.21.15.154:0/682443132 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d6402d440 con 0x7f6d700cb1a0 2023-10-10T22:34:29.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.515+0000 7f6d5e7fc700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6d50066f30 0x7f6d500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.515+0000 7f6d5e7fc700 1 -- 172.21.15.154:0/682443132 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f6d64020070 con 0x7f6d700cb1a0 2023-10-10T22:34:29.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.515+0000 7f6d6e59c700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6d50066f30 0x7f6d500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.516+0000 7f6d6e59c700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6d50066f30 0x7f6d500693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6d60006fd0 tx=0x7f6d60008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:29.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.519+0000 7f6d5e7fc700 1 -- 172.21.15.154:0/682443132 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d64053800 con 0x7f6d700cb1a0 2023-10-10T22:34:29.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.710+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6d70155810 con 0x7f6d700cb1a0 2023-10-10T22:34:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.714+0000 7f6d5e7fc700 1 -- 172.21.15.154:0/682443132 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6d64056e20 con 0x7f6d700cb1a0 2023-10-10T22:34:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6d50066f30 msgr2=0x7f6d500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6d50066f30 0x7f6d500693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6d60006fd0 tx=0x7f6d60008040 comp rx=0 tx=0).stop 2023-10-10T22:34:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d700cb1a0 msgr2=0x7f6d70169de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d700cb1a0 0x7f6d70169de0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400bfd0 tx=0x7f6d6401b000 comp rx=0 tx=0).stop 2023-10-10T22:34:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 shutdown_connections 2023-10-10T22:34:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6d50066f30 0x7f6d500693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d701508e0 0x7f6d700c1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d7006f5a0 0x7f6d701503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 --2- 172.21.15.154:0/682443132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d700cb1a0 0x7f6d70169de0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 >> 172.21.15.154:0/682443132 conn(0x7f6d700cc1e0 msgr2=0x7f6d70152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:29.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 shutdown_connections 2023-10-10T22:34:29.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.717+0000 7f6d6f59e700 1 -- 172.21.15.154:0/682443132 wait complete. 2023-10-10T22:34:29.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T22:34:29.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.918+0000 7f17aa3ff700 1 Processor -- start 2023-10-10T22:34:29.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.918+0000 7f17aa3ff700 1 -- start start 2023-10-10T22:34:29.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.919+0000 7f17aa3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17a406bcd0 0x7f17a40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.919+0000 7f17aa3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406c0a0 0x7f17a415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.919+0000 7f17aa3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a415d7e0 con 0x7f17a415df50 2023-10-10T22:34:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.919+0000 7f17aa3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a415dac0 con 0x7f17a406bcd0 2023-10-10T22:34:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.919+0000 7f17aa3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a415aa30 con 0x7f17a406c0a0 2023-10-10T22:34:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17a406bcd0 0x7f17a40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a899c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f17a415df50 0x7f17a40c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59314/0 (socket says 172.21.15.154:59314) 2023-10-10T22:34:29.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17a406bcd0 0x7f17a40caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49892/0 (socket says 172.21.15.154:49892) 2023-10-10T22:34:29.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a899c700 1 -- 172.21.15.154:0/3120925580 learned_addr learned my addr 172.21.15.154:0/3120925580 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:29.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a37fe700 1 --2- 172.21.15.154:0/3120925580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406c0a0 0x7f17a415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a3fff700 1 -- 172.21.15.154:0/3120925580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406c0a0 msgr2=0x7f17a415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:29.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a3fff700 1 --2- 172.21.15.154:0/3120925580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406c0a0 0x7f17a415a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a3fff700 1 -- 172.21.15.154:0/3120925580 >> v1:172.21.15.154:6789/0 conn(0x7f17a415df50 legacy=0x7f17a40c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a3fff700 1 -- 172.21.15.154:0/3120925580 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a415ad10 con 0x7f17a406bcd0 2023-10-10T22:34:29.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a2ffd700 1 -- 172.21.15.154:0/3120925580 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521047707 0 0) 0x7f17a415d7e0 con 0x7f17a415df50 2023-10-10T22:34:29.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a37fe700 1 --2- 172.21.15.154:0/3120925580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406c0a0 0x7f17a415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.920+0000 7f17a3fff700 1 --2- 172.21.15.154:0/3120925580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a406bcd0 0x7f17a40caa90 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f17940098e0 tx=0x7f17940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bed39bc373c22b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17a2ffd700 1 -- 172.21.15.154:0/3120925580 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794009e80 con 0x7f17a406bcd0 2023-10-10T22:34:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17a2ffd700 1 -- 172.21.15.154:0/3120925580 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400b860 con 0x7f17a406bcd0 2023-10-10T22:34:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17a2ffd700 1 -- 172.21.15.154:0/3120925580 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400bbe0 con 0x7f17a406bcd0 2023-10-10T22:34:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17aa3ff700 1 -- 172.21.15.154:0/3120925580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a406bcd0 msgr2=0x7f17a40caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17aa3ff700 1 --2- 172.21.15.154:0/3120925580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a406bcd0 0x7f17a40caa90 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f17940098e0 tx=0x7f17940091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17aa3ff700 1 -- 172.21.15.154:0/3120925580 shutdown_connections 2023-10-10T22:34:29.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17aa3ff700 1 --2- 172.21.15.154:0/3120925580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a406bcd0 0x7f17a40caa90 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17aa3ff700 1 --2- 172.21.15.154:0/3120925580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406c0a0 0x7f17a415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17aa3ff700 1 -- 172.21.15.154:0/3120925580 >> 172.21.15.154:0/3120925580 conn(0x7f17a40ce600 msgr2=0x7f17a40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17aa3ff700 1 -- 172.21.15.154:0/3120925580 shutdown_connections 2023-10-10T22:34:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.921+0000 7f17aa3ff700 1 -- 172.21.15.154:0/3120925580 wait complete. 2023-10-10T22:34:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.923+0000 7f17aa3ff700 1 Processor -- start 2023-10-10T22:34:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.923+0000 7f17aa3ff700 1 -- start start 2023-10-10T22:34:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17aa3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406bcd0 0x7f17a40b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17aa3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17a406c0a0 0x7f17a40b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17aa3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a415df50 0x7f17a416a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17aa3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a406acf0 con 0x7f17a415df50 2023-10-10T22:34:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17aa3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4169a60 con 0x7f17a406c0a0 2023-10-10T22:34:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17aa3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a406a7c0 con 0x7f17a406bcd0 2023-10-10T22:34:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17a899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a415df50 0x7f17a416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17a899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a415df50 0x7f17a416a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49904/0 (socket says 172.21.15.154:49904) 2023-10-10T22:34:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17a899c700 1 -- 172.21.15.154:0/1957238728 learned_addr learned my addr 172.21.15.154:0/1957238728 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17a3fff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406bcd0 0x7f17a40b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17a37fe700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17a406c0a0 0x7f17a40b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17a899c700 1 -- 172.21.15.154:0/1957238728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406bcd0 msgr2=0x7f17a40b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17a899c700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406bcd0 0x7f17a40b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17a899c700 1 -- 172.21.15.154:0/1957238728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17a406c0a0 msgr2=0x7f17a40b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.924+0000 7f17a899c700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17a406c0a0 0x7f17a40b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.925+0000 7f17a899c700 1 -- 172.21.15.154:0/1957238728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794009420 con 0x7f17a415df50 2023-10-10T22:34:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.925+0000 7f17a37fe700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17a406c0a0 0x7f17a40b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:29.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.925+0000 7f17a899c700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a415df50 0x7f17a416a470 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f179c00cc90 tx=0x7f179c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:29.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.925+0000 7f178bfff700 1 -- 172.21.15.154:0/1957238728 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00cea0 con 0x7f17a415df50 2023-10-10T22:34:29.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.925+0000 7f178bfff700 1 -- 172.21.15.154:0/1957238728 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c00ab30 con 0x7f17a415df50 2023-10-10T22:34:29.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.925+0000 7f178bfff700 1 -- 172.21.15.154:0/1957238728 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c0070f0 con 0x7f17a415df50 2023-10-10T22:34:29.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.925+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a4169fe0 con 0x7f17a415df50 2023-10-10T22:34:29.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.925+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a406aa90 con 0x7f17a415df50 2023-10-10T22:34:29.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.926+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a404c3c0 con 0x7f17a415df50 2023-10-10T22:34:29.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.927+0000 7f178bfff700 1 -- 172.21.15.154:0/1957238728 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f179c0074a0 con 0x7f17a415df50 2023-10-10T22:34:29.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.928+0000 7f178bfff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1790066f00 0x7f17900693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:29.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.928+0000 7f178bfff700 1 -- 172.21.15.154:0/1957238728 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f179c084bb0 con 0x7f17a415df50 2023-10-10T22:34:29.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.928+0000 7f17a3fff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1790066f00 0x7f17900693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:29.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.929+0000 7f17a3fff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1790066f00 0x7f17900693b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17a41552b0 tx=0x7f1794017000 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:29.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:29.932+0000 7f178bfff700 1 -- 172.21.15.154:0/1957238728 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f179c051c50 con 0x7f17a415df50 2023-10-10T22:34:30.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.122+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f17a415aff0 con 0x7f17a415df50 2023-10-10T22:34:30.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.126+0000 7f178bfff700 1 -- 172.21.15.154:0/1957238728 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v62) v1 ==== 115+0+0 (secure 0 0 0) 0x7f179c055270 con 0x7f17a415df50 2023-10-10T22:34:30.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1790066f00 msgr2=0x7f17900693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1790066f00 0x7f17900693b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17a41552b0 tx=0x7f1794017000 comp rx=0 tx=0).stop 2023-10-10T22:34:30.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a415df50 msgr2=0x7f17a416a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a415df50 0x7f17a416a470 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f179c00cc90 tx=0x7f179c001a20 comp rx=0 tx=0).stop 2023-10-10T22:34:30.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 shutdown_connections 2023-10-10T22:34:30.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1790066f00 0x7f17900693b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17a415df50 0x7f17a416a470 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17a406bcd0 0x7f17a40b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 --2- 172.21.15.154:0/1957238728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17a406c0a0 0x7f17a40b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 >> 172.21.15.154:0/1957238728 conn(0x7f17a40ce600 msgr2=0x7f17a415bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:30.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 shutdown_connections 2023-10-10T22:34:30.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.129+0000 7f17aa3ff700 1 -- 172.21.15.154:0/1957238728 wait complete. 2023-10-10T22:34:30.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T22:34:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.333+0000 7fccc9b9d700 1 Processor -- start 2023-10-10T22:34:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.333+0000 7fccc9b9d700 1 -- start start 2023-10-10T22:34:30.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.334+0000 7fccc9b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fccc40b4e70 0x7fccc40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.334+0000 7fccc9b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fccc40b16d0 0x7fccc40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.334+0000 7fccc9b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc40b2080 con 0x7fccc415d240 2023-10-10T22:34:30.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.334+0000 7fccc9b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc40cfb00 con 0x7fccc40b4e70 2023-10-10T22:34:30.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.334+0000 7fccc9b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc40b5c40 con 0x7fccc40b16d0 2023-10-10T22:34:30.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.334+0000 7fccc8b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fccc40b4e70 0x7fccc40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.334+0000 7fccc8b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fccc40b4e70 0x7fccc40ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49908/0 (socket says 172.21.15.154:49908) 2023-10-10T22:34:30.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.334+0000 7fccc8b9b700 1 -- 172.21.15.154:0/1252211706 learned_addr learned my addr 172.21.15.154:0/1252211706 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:30.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.334+0000 7fccc939c700 1 --1- 172.21.15.154:0/1252211706 >> v1:172.21.15.154:6789/0 conn(0x7fccc415d240 0x7fccc415d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59322/0 (socket says 172.21.15.154:59322) 2023-10-10T22:34:30.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc3fff700 1 --2- 172.21.15.154:0/1252211706 >> v2:172.21.15.179:3300/0 conn(0x7fccc40b16d0 0x7fccc40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc8b9b700 1 -- 172.21.15.154:0/1252211706 >> v2:172.21.15.179:3300/0 conn(0x7fccc40b16d0 msgr2=0x7fccc40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:30.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc8b9b700 1 --2- 172.21.15.154:0/1252211706 >> v2:172.21.15.179:3300/0 conn(0x7fccc40b16d0 0x7fccc40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc8b9b700 1 -- 172.21.15.154:0/1252211706 >> v1:172.21.15.154:6789/0 conn(0x7fccc415d240 legacy=0x7fccc415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc8b9b700 1 -- 172.21.15.154:0/1252211706 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40b5f20 con 0x7fccc40b4e70 2023-10-10T22:34:30.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc37fe700 1 -- 172.21.15.154:0/1252211706 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628801526 0 0) 0x7fccc40b2080 con 0x7fccc415d240 2023-10-10T22:34:30.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc8b9b700 1 --2- 172.21.15.154:0/1252211706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 0x7fccc40ccff0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fccc4089830 tx=0x7fccb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a2115f3bbf577f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:30.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc37fe700 1 -- 172.21.15.154:0/1252211706 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800e070 con 0x7fccc40b4e70 2023-10-10T22:34:30.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc37fe700 1 -- 172.21.15.154:0/1252211706 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb800ba50 con 0x7fccc40b4e70 2023-10-10T22:34:30.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.335+0000 7fccc37fe700 1 -- 172.21.15.154:0/1252211706 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb80092e0 con 0x7fccc40b4e70 2023-10-10T22:34:30.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.336+0000 7fccc9b9d700 1 -- 172.21.15.154:0/1252211706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 msgr2=0x7fccc40ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.336+0000 7fccc9b9d700 1 --2- 172.21.15.154:0/1252211706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 0x7fccc40ccff0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fccc4089830 tx=0x7fccb8009840 comp rx=0 tx=0).stop 2023-10-10T22:34:30.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.336+0000 7fccc9b9d700 1 -- 172.21.15.154:0/1252211706 shutdown_connections 2023-10-10T22:34:30.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.336+0000 7fccc9b9d700 1 --2- 172.21.15.154:0/1252211706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 0x7fccc40ccff0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.336+0000 7fccc9b9d700 1 --2- 172.21.15.154:0/1252211706 >> v2:172.21.15.179:3300/0 conn(0x7fccc40b16d0 0x7fccc40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.336+0000 7fccc9b9d700 1 -- 172.21.15.154:0/1252211706 >> 172.21.15.154:0/1252211706 conn(0x7fccc40d10c0 msgr2=0x7fccc40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:30.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.336+0000 7fccc9b9d700 1 -- 172.21.15.154:0/1252211706 shutdown_connections 2023-10-10T22:34:30.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.336+0000 7fccc9b9d700 1 -- 172.21.15.154:0/1252211706 wait complete. 2023-10-10T22:34:30.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.337+0000 7fccc9b9d700 1 Processor -- start 2023-10-10T22:34:30.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.338+0000 7fccc9b9d700 1 -- start start 2023-10-10T22:34:30.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.338+0000 7fccc9b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc40b16d0 0x7fccc40c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc9b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 0x7fccc4157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc9b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccc415d240 0x7fccc4158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc9b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40c71f0 con 0x7fccc40b4e70 2023-10-10T22:34:30.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc9b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40c78e0 con 0x7fccc40b16d0 2023-10-10T22:34:30.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc9b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40c8720 con 0x7fccc415d240 2023-10-10T22:34:30.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 0x7fccc4157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 0x7fccc4157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49922/0 (socket says 172.21.15.154:49922) 2023-10-10T22:34:30.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc3fff700 1 -- 172.21.15.154:0/74926339 learned_addr learned my addr 172.21.15.154:0/74926339 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:30.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc3fff700 1 -- 172.21.15.154:0/74926339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccc415d240 msgr2=0x7fccc4158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc8b9b700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc40b16d0 0x7fccc40c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc3fff700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccc415d240 0x7fccc4158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc3fff700 1 -- 172.21.15.154:0/74926339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc40b16d0 msgr2=0x7fccc40c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc3fff700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc40b16d0 0x7fccc40c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc3fff700 1 -- 172.21.15.154:0/74926339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8009ae0 con 0x7fccc40b4e70 2023-10-10T22:34:30.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc8b9b700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc40b16d0 0x7fccc40c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:30.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.339+0000 7fccc3fff700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 0x7fccc4157de0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fccb000d890 tx=0x7fccb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:30.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.340+0000 7fccc0ff9700 1 -- 172.21.15.154:0/74926339 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb00125f0 con 0x7fccc40b4e70 2023-10-10T22:34:30.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.340+0000 7fccc0ff9700 1 -- 172.21.15.154:0/74926339 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0012770 con 0x7fccc40b4e70 2023-10-10T22:34:30.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.340+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc40c8bb0 con 0x7fccc40b4e70 2023-10-10T22:34:30.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.340+0000 7fccc0ff9700 1 -- 172.21.15.154:0/74926339 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0012b30 con 0x7fccc40b4e70 2023-10-10T22:34:30.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.340+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc40c7df0 con 0x7fccc40b4e70 2023-10-10T22:34:30.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.341+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc4088990 con 0x7fccc40b4e70 2023-10-10T22:34:30.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.342+0000 7fccc0ff9700 1 -- 172.21.15.154:0/74926339 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccb001e460 con 0x7fccc40b4e70 2023-10-10T22:34:30.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.342+0000 7fccc0ff9700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcca8066f30 0x7fcca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.342+0000 7fccc0ff9700 1 -- 172.21.15.154:0/74926339 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6291+0+0 (secure 0 0 0) 0x7fccb0084ee0 con 0x7fccc40b4e70 2023-10-10T22:34:30.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.343+0000 7fccc8b9b700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcca8066f30 0x7fcca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.343+0000 7fccc8b9b700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcca8066f30 0x7fcca80693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fccc406a460 tx=0x7fccb8018000 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:30.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.346+0000 7fccc0ff9700 1 -- 172.21.15.154:0/74926339 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccb0051e60 con 0x7fccc40b4e70 2023-10-10T22:34:30.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.539+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fccc40c8860 con 0x7fccc40b4e70 2023-10-10T22:34:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.545+0000 7fccc0ff9700 1 -- 172.21.15.154:0/74926339 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v63) v1 ==== 120+0+0 (secure 0 0 0) 0x7fccb0055480 con 0x7fccc40b4e70 2023-10-10T22:34:30.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.547+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcca8066f30 msgr2=0x7fcca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.547+0000 7fccc9b9d700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcca8066f30 0x7fcca80693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fccc406a460 tx=0x7fccb8018000 comp rx=0 tx=0).stop 2023-10-10T22:34:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.547+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 msgr2=0x7fccc4157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.547+0000 7fccc9b9d700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 0x7fccc4157de0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fccb000d890 tx=0x7fccb0008040 comp rx=0 tx=0).stop 2023-10-10T22:34:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.547+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 shutdown_connections 2023-10-10T22:34:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.547+0000 7fccc9b9d700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcca8066f30 0x7fcca80693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.548+0000 7fccc9b9d700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccc415d240 0x7fccc4158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.548+0000 7fccc9b9d700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc40b16d0 0x7fccc40c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.548+0000 7fccc9b9d700 1 --2- 172.21.15.154:0/74926339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc40b4e70 0x7fccc4157de0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.548+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 >> 172.21.15.154:0/74926339 conn(0x7fccc40d10c0 msgr2=0x7fccc4069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:30.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.548+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 shutdown_connections 2023-10-10T22:34:30.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.548+0000 7fccc9b9d700 1 -- 172.21.15.154:0/74926339 wait complete. 2023-10-10T22:34:30.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-10T22:34:30.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.749+0000 7f03c63ff700 1 Processor -- start 2023-10-10T22:34:30.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.749+0000 7f03c63ff700 1 -- start start 2023-10-10T22:34:30.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.750+0000 7f03c63ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03c00caa90 0x7f03c00c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.750+0000 7f03c63ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c015d7e0 con 0x7f03c006bcd0 2023-10-10T22:34:30.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.750+0000 7f03c63ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c015dac0 con 0x7f03c006c0a0 2023-10-10T22:34:30.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.750+0000 7f03c63ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00caef0 con 0x7f03c00caa90 2023-10-10T22:34:30.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.751+0000 7f03bffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f03c006bcd0 0x7f03c015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59338/0 (socket says 172.21.15.154:59338) 2023-10-10T22:34:30.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.751+0000 7f03bffff700 1 -- 172.21.15.154:0/1564988886 learned_addr learned my addr 172.21.15.154:0/1564988886 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:30.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.751+0000 7f03c499c700 1 --2- 172.21.15.154:0/1564988886 >> v2:172.21.15.179:3300/0 conn(0x7f03c00caa90 0x7f03c00c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.751+0000 7f03beffd700 1 -- 172.21.15.154:0/1564988886 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560642612 0 0) 0x7f03c015d7e0 con 0x7f03c006bcd0 2023-10-10T22:34:30.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.751+0000 7f03beffd700 1 -- 172.21.15.154:0/1564988886 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03a8003570 con 0x7f03c006bcd0 2023-10-10T22:34:30.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.751+0000 7f03c499c700 1 -- 172.21.15.154:0/1564988886 >> v1:172.21.15.179:6789/0 conn(0x7f03c006c0a0 legacy=0x7f03c015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.751+0000 7f03beffd700 1 -- 172.21.15.154:0/1564988886 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1115902329 0 0) 0x7f03a8003570 con 0x7f03c006bcd0 2023-10-10T22:34:30.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.751+0000 7f03c499c700 1 -- 172.21.15.154:0/1564988886 >> v1:172.21.15.154:6789/0 conn(0x7f03c006bcd0 legacy=0x7f03c015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.751+0000 7f03c499c700 1 -- 172.21.15.154:0/1564988886 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c015aa30 con 0x7f03c00caa90 2023-10-10T22:34:30.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.752+0000 7f03c499c700 1 --2- 172.21.15.154:0/1564988886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00caa90 0x7f03c00c8c40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009e60 tx=0x7f03b8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e71efa71ab851d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:30.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.752+0000 7f03beffd700 1 -- 172.21.15.154:0/1564988886 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b800e070 con 0x7f03c00caa90 2023-10-10T22:34:30.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.752+0000 7f03beffd700 1 -- 172.21.15.154:0/1564988886 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b800b850 con 0x7f03c00caa90 2023-10-10T22:34:30.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.752+0000 7f03beffd700 1 -- 172.21.15.154:0/1564988886 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0001470 con 0x7f03c00caa90 2023-10-10T22:34:30.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.752+0000 7f03c63ff700 1 -- 172.21.15.154:0/1564988886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00caa90 msgr2=0x7f03c00c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.752+0000 7f03c63ff700 1 --2- 172.21.15.154:0/1564988886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00caa90 0x7f03c00c8c40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009e60 tx=0x7f03b8009780 comp rx=0 tx=0).stop 2023-10-10T22:34:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.752+0000 7f03c63ff700 1 -- 172.21.15.154:0/1564988886 shutdown_connections 2023-10-10T22:34:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.752+0000 7f03c63ff700 1 --2- 172.21.15.154:0/1564988886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00caa90 0x7f03c00c8c40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.752+0000 7f03c63ff700 1 -- 172.21.15.154:0/1564988886 >> 172.21.15.154:0/1564988886 conn(0x7f03c00ce600 msgr2=0x7f03c00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.753+0000 7f03c63ff700 1 -- 172.21.15.154:0/1564988886 shutdown_connections 2023-10-10T22:34:30.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.753+0000 7f03c63ff700 1 -- 172.21.15.154:0/1564988886 wait complete. 2023-10-10T22:34:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.754+0000 7f03c63ff700 1 Processor -- start 2023-10-10T22:34:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.754+0000 7f03c63ff700 1 -- start start 2023-10-10T22:34:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03c63ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006bcd0 0x7f03c014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03c63ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c006c0a0 0x7f03c0155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03c63ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00caa90 0x7f03c0156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03c63ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01505a0 con 0x7f03c006bcd0 2023-10-10T22:34:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03c63ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00b2e50 con 0x7f03c006c0a0 2023-10-10T22:34:30.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03c63ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c014ff90 con 0x7f03c00caa90 2023-10-10T22:34:30.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03bffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006bcd0 0x7f03c014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03bffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006bcd0 0x7f03c014f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49924/0 (socket says 172.21.15.154:49924) 2023-10-10T22:34:30.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03bffff700 1 -- 172.21.15.154:0/4137053127 learned_addr learned my addr 172.21.15.154:0/4137053127 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:30.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03bf7fe700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c006c0a0 0x7f03c0155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03bffff700 1 -- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00caa90 msgr2=0x7f03c0156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03c499c700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00caa90 0x7f03c0156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.755+0000 7f03bffff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00caa90 0x7f03c0156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03bffff700 1 -- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c006c0a0 msgr2=0x7f03c0155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:30.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03bffff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c006c0a0 0x7f03c0155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:30.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03bffff700 1 -- 172.21.15.154:0/4137053127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8009a20 con 0x7f03c006bcd0 2023-10-10T22:34:30.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03bf7fe700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c006c0a0 0x7f03c0155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:30.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03c499c700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00caa90 0x7f03c0156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:30.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03bffff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006bcd0 0x7f03c014f340 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f03b000c7f0 tx=0x7f03b0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:30.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03a7fff700 1 -- 172.21.15.154:0/4137053127 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0007360 con 0x7f03c006bcd0 2023-10-10T22:34:30.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03a7fff700 1 -- 172.21.15.154:0/4137053127 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b00074e0 con 0x7f03c006bcd0 2023-10-10T22:34:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03a7fff700 1 -- 172.21.15.154:0/4137053127 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0004830 con 0x7f03c006bcd0 2023-10-10T22:34:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c00b2b70 con 0x7f03c006bcd0 2023-10-10T22:34:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.756+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c014f880 con 0x7f03c006bcd0 2023-10-10T22:34:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.757+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c004c3c0 con 0x7f03c006bcd0 2023-10-10T22:34:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.758+0000 7f03a7fff700 1 -- 172.21.15.154:0/4137053127 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03b0004c40 con 0x7f03c006bcd0 2023-10-10T22:34:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.759+0000 7f03a7fff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f03ac066f30 0x7f03ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.759+0000 7f03a7fff700 1 -- 172.21.15.154:0/4137053127 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f03b0083be0 con 0x7f03c006bcd0 2023-10-10T22:34:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.759+0000 7f03bf7fe700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f03ac066f30 0x7f03ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:30.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.760+0000 7f03bf7fe700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f03ac066f30 0x7f03ac0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f03c00c9c30 tx=0x7f03b4009040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:30.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:30.763+0000 7f03a7fff700 1 -- 172.21.15.154:0/4137053127 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03b0050be0 con 0x7f03c006bcd0 2023-10-10T22:34:31.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.027+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f03c015ad10 con 0x7f03c006bcd0 2023-10-10T22:34:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.295+0000 7f03a7fff700 1 -- 172.21.15.154:0/4137053127 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2968) v1 ==== 165+0+0 (secure 0 0 0) 0x7f03b0018020 con 0x7f03c006bcd0 2023-10-10T22:34:31.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.297+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f03ac066f30 msgr2=0x7f03ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:31.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.297+0000 7f03c63ff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f03ac066f30 0x7f03ac0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f03c00c9c30 tx=0x7f03b4009040 comp rx=0 tx=0).stop 2023-10-10T22:34:31.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.297+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006bcd0 msgr2=0x7f03c014f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:31.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.297+0000 7f03c63ff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006bcd0 0x7f03c014f340 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f03b000c7f0 tx=0x7f03b0001a00 comp rx=0 tx=0).stop 2023-10-10T22:34:31.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.298+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 shutdown_connections 2023-10-10T22:34:31.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.298+0000 7f03c63ff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f03ac066f30 0x7f03ac0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.298+0000 7f03c63ff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00caa90 0x7f03c0156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.298+0000 7f03c63ff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006bcd0 0x7f03c014f340 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.298+0000 7f03c63ff700 1 --2- 172.21.15.154:0/4137053127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c006c0a0 0x7f03c0155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.298+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 >> 172.21.15.154:0/4137053127 conn(0x7f03c00ce600 msgr2=0x7f03c0158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.298+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 shutdown_connections 2023-10-10T22:34:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.298+0000 7f03c63ff700 1 -- 172.21.15.154:0/4137053127 wait complete. 2023-10-10T22:34:31.317 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-10-10T22:34:31.318 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-10-10T22:34:31.318 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-10T22:34:31.318 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-10T22:34:31.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.501+0000 7f40a4bff700 1 Processor -- start 2023-10-10T22:34:31.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.502+0000 7f40a4bff700 1 -- start start 2023-10-10T22:34:31.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f40a4bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f40a00cbf30 0x7f40a00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:31.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f40a4bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00ccf90 0x7f40a00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:31.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f40a4bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a00cc300 con 0x7f40a015a270 2023-10-10T22:34:31.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f40a4bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a0156bf0 con 0x7f40a00cbf30 2023-10-10T22:34:31.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f40a4bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00ae950 con 0x7f40a00ccf90 2023-10-10T22:34:31.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f409ed9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f40a015a270 0x7f40a00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59354/0 (socket says 172.21.15.154:59354) 2023-10-10T22:34:31.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f409ed9d700 1 -- 172.21.15.154:0/367992023 learned_addr learned my addr 172.21.15.154:0/367992023 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:31.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f409dd9b700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00ccf90 0x7f40a00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:31.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f409e59c700 1 --2- 172.21.15.154:0/367992023 >> v2:172.21.15.179:3300/0 conn(0x7f40a00cbf30 0x7f40a00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:31.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.503+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227555322 0 0) 0x7f40a00cc300 con 0x7f40a015a270 2023-10-10T22:34:31.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4088003570 con 0x7f40a015a270 2023-10-10T22:34:31.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 997717066 0 0) 0x7f4088003570 con 0x7f40a015a270 2023-10-10T22:34:31.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00ccf90 msgr2=0x7f40a00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:31.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00ccf90 0x7f40a00b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 >> v2:172.21.15.179:3300/0 conn(0x7f40a00cbf30 msgr2=0x7f40a00ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:31.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 --2- 172.21.15.154:0/367992023 >> v2:172.21.15.179:3300/0 conn(0x7f40a00cbf30 0x7f40a00ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a00ad370 con 0x7f40a015a270 2023-10-10T22:34:31.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f4098001470 con 0x7f40a015a270 2023-10-10T22:34:31.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 >> v1:172.21.15.154:6789/0 conn(0x7f40a015a270 legacy=0x7f40a00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:31.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f4088003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4088004810 0x7f4088004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00ccf90 0x7f40880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0156bf0 con 0x7f4088003b10 2023-10-10T22:34:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00ae950 con 0x7f4088004810 2023-10-10T22:34:31.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408800dda0 con 0x7f40a00ccf90 2023-10-10T22:34:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409e59c700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f4088003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409dd9b700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4088004810 0x7f4088004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409ed9d700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00ccf90 0x7f40880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409e59c700 1 -- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00ccf90 msgr2=0x7f40880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:31.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409e59c700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00ccf90 0x7f40880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409e59c700 1 -- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4088004810 msgr2=0x7f4088004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409e59c700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4088004810 0x7f4088004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.504+0000 7f409e59c700 1 -- 172.21.15.154:0/367992023 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088003570 con 0x7f4088003b10 2023-10-10T22:34:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.505+0000 7f409dd9b700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4088004810 0x7f4088004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.505+0000 7f409ed9d700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00ccf90 0x7f40880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.505+0000 7f409e59c700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f4088003f20 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f409000e210 tx=0x7f409000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9555ad24055a42 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.505+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409000eac0 con 0x7f4088003b10 2023-10-10T22:34:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.505+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409000f040 con 0x7f4088003b10 2023-10-10T22:34:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.505+0000 7f409d59a700 1 -- 172.21.15.154:0/367992023 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409000ee70 con 0x7f4088003b10 2023-10-10T22:34:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.505+0000 7f40a4bff700 1 -- 172.21.15.154:0/367992023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 msgr2=0x7f4088003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.505+0000 7f40a4bff700 1 --2- 172.21.15.154:0/367992023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f4088003f20 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f409000e210 tx=0x7f409000b040 comp rx=0 tx=0).stop 2023-10-10T22:34:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.505+0000 7f409ed9d700 1 -- 172.21.15.154:0/367992023 reap_dead start 2023-10-10T22:34:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.506+0000 7f40a4bff700 1 -- 172.21.15.154:0/367992023 shutdown_connections 2023-10-10T22:34:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.506+0000 7f40a4bff700 1 -- 172.21.15.154:0/367992023 >> 172.21.15.154:0/367992023 conn(0x7f40a006a320 msgr2=0x7f40a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.506+0000 7f40a4bff700 1 -- 172.21.15.154:0/367992023 shutdown_connections 2023-10-10T22:34:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.506+0000 7f40a4bff700 1 -- 172.21.15.154:0/367992023 wait complete. 2023-10-10T22:34:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.507+0000 7f40a4bff700 1 Processor -- start 2023-10-10T22:34:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.507+0000 7f40a4bff700 1 -- start start 2023-10-10T22:34:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.508+0000 7f40a4bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f40a0156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.508+0000 7f40a4bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00abd20 0x7f40a016a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.508+0000 7f40a4bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40a00c56e0 0x7f40a00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:31.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.508+0000 7f40a4bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00c8dd0 con 0x7f4088003b10 2023-10-10T22:34:31.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.508+0000 7f40a4bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00c60c0 con 0x7f40a00c56e0 2023-10-10T22:34:31.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.508+0000 7f40a4bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00c8940 con 0x7f40a00abd20 2023-10-10T22:34:31.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.508+0000 7f409e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f40a0156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:31.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.508+0000 7f409e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f40a0156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49942/0 (socket says 172.21.15.154:49942) 2023-10-10T22:34:31.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.508+0000 7f409e59c700 1 -- 172.21.15.154:0/2200492381 learned_addr learned my addr 172.21.15.154:0/2200492381 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f409e59c700 1 -- 172.21.15.154:0/2200492381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00abd20 msgr2=0x7f40a016a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f409e59c700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00abd20 0x7f40a016a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f409e59c700 1 -- 172.21.15.154:0/2200492381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40a00c56e0 msgr2=0x7f40a00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f409e59c700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40a00c56e0 0x7f40a00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f409e59c700 1 -- 172.21.15.154:0/2200492381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a016ab50 con 0x7f4088003b10 2023-10-10T22:34:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f409e59c700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f40a0156320 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f4088004770 tx=0x7f409001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f408e7fc700 1 -- 172.21.15.154:0/2200492381 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090029450 con 0x7f4088003b10 2023-10-10T22:34:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f408e7fc700 1 -- 172.21.15.154:0/2200492381 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40900295b0 con 0x7f4088003b10 2023-10-10T22:34:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a00c7d30 con 0x7f4088003b10 2023-10-10T22:34:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f408e7fc700 1 -- 172.21.15.154:0/2200492381 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900299b0 con 0x7f4088003b10 2023-10-10T22:34:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.509+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a00c82f0 con 0x7f4088003b10 2023-10-10T22:34:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.510+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a006c0e0 con 0x7f4088003b10 2023-10-10T22:34:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.511+0000 7f408e7fc700 1 -- 172.21.15.154:0/2200492381 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4090003040 con 0x7f4088003b10 2023-10-10T22:34:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.512+0000 7f408e7fc700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4080066f30 0x7f40800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.512+0000 7f408e7fc700 1 -- 172.21.15.154:0/2200492381 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f4090086b60 con 0x7f4088003b10 2023-10-10T22:34:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.512+0000 7f409dd9b700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4080066f30 0x7f40800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:31.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.513+0000 7f409dd9b700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4080066f30 0x7f40800693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40a0156860 tx=0x7f4094008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:31.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.517+0000 7f408e7fc700 1 -- 172.21.15.154:0/2200492381 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4090053ae0 con 0x7f4088003b10 2023-10-10T22:34:31.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:31.785+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f40a004c3c0 con 0x7f4088003b10 2023-10-10T22:34:32.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.296+0000 7f408e7fc700 1 -- 172.21.15.154:0/2200492381 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2969) v1 ==== 166+0+0 (secure 0 0 0) 0x7f4090057100 con 0x7f4088003b10 2023-10-10T22:34:32.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4080066f30 msgr2=0x7f40800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:32.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4080066f30 0x7f40800693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40a0156860 tx=0x7f4094008040 comp rx=0 tx=0).stop 2023-10-10T22:34:32.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 msgr2=0x7f40a0156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:32.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f40a0156320 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f4088004770 tx=0x7f409001a000 comp rx=0 tx=0).stop 2023-10-10T22:34:32.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 shutdown_connections 2023-10-10T22:34:32.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4080066f30 0x7f40800693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40a00c56e0 0x7f40a00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4088003b10 0x7f40a0156320 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 --2- 172.21.15.154:0/2200492381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40a00abd20 0x7f40a016a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 >> 172.21.15.154:0/2200492381 conn(0x7f40a006a320 msgr2=0x7f40a00caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 shutdown_connections 2023-10-10T22:34:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.299+0000 7f40a4bff700 1 -- 172.21.15.154:0/2200492381 wait complete. 2023-10-10T22:34:32.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T22:34:32.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.502+0000 7f35cf39d700 1 Processor -- start 2023-10-10T22:34:32.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.502+0000 7f35cf39d700 1 -- start start 2023-10-10T22:34:32.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.503+0000 7f35cf39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35c8153900 0x7f35c80c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:32.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.503+0000 7f35cf39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c806a710 0x7f35c806e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:32.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.503+0000 7f35cf39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c806e150 con 0x7f35c80c9db0 2023-10-10T22:34:32.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.503+0000 7f35cf39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c80c7800 con 0x7f35c8153900 2023-10-10T22:34:32.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.503+0000 7f35cf39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80c7ae0 con 0x7f35c806a710 2023-10-10T22:34:32.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.503+0000 7f35ce39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35c8153900 0x7f35c80c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:32.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.503+0000 7f35ce39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35c8153900 0x7f35c80c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49954/0 (socket says 172.21.15.154:49954) 2023-10-10T22:34:32.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.504+0000 7f35ce39b700 1 -- 172.21.15.154:0/888262917 learned_addr learned my addr 172.21.15.154:0/888262917 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:32.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.503+0000 7f35ceb9c700 1 --2- 172.21.15.154:0/888262917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c806a710 0x7f35c806e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:32.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.504+0000 7f35cd399700 1 -- 172.21.15.154:0/888262917 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926309852 0 0) 0x7f35c806e150 con 0x7f35c80c9db0 2023-10-10T22:34:32.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.504+0000 7f35ce39b700 1 -- 172.21.15.154:0/888262917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c806a710 msgr2=0x7f35c806e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:32.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.504+0000 7f35ce39b700 1 --2- 172.21.15.154:0/888262917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c806a710 0x7f35c806e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.504+0000 7f35ce39b700 1 -- 172.21.15.154:0/888262917 >> v1:172.21.15.179:6789/0 conn(0x7f35c80c9db0 legacy=0x7f35c806a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:32.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.504+0000 7f35ce39b700 1 -- 172.21.15.154:0/888262917 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c80c7dc0 con 0x7f35c8153900 2023-10-10T22:34:32.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.504+0000 7f35ce39b700 1 --2- 172.21.15.154:0/888262917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c8153900 0x7f35c80c6f00 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f35c40099b0 tx=0x7f35c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd3da221be06d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:32.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.504+0000 7f35cd399700 1 -- 172.21.15.154:0/888262917 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4009ea0 con 0x7f35c8153900 2023-10-10T22:34:32.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cd399700 1 -- 172.21.15.154:0/888262917 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c400b860 con 0x7f35c8153900 2023-10-10T22:34:32.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cd399700 1 -- 172.21.15.154:0/888262917 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c400bc00 con 0x7f35c8153900 2023-10-10T22:34:32.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cf39d700 1 -- 172.21.15.154:0/888262917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c8153900 msgr2=0x7f35c80c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:32.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cf39d700 1 --2- 172.21.15.154:0/888262917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c8153900 0x7f35c80c6f00 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f35c40099b0 tx=0x7f35c4009250 comp rx=0 tx=0).stop 2023-10-10T22:34:32.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cf39d700 1 -- 172.21.15.154:0/888262917 shutdown_connections 2023-10-10T22:34:32.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cf39d700 1 --2- 172.21.15.154:0/888262917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c806a710 0x7f35c806e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cf39d700 1 --2- 172.21.15.154:0/888262917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c8153900 0x7f35c80c6f00 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cf39d700 1 -- 172.21.15.154:0/888262917 >> 172.21.15.154:0/888262917 conn(0x7f35c80cc1e0 msgr2=0x7f35c80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:32.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cf39d700 1 -- 172.21.15.154:0/888262917 shutdown_connections 2023-10-10T22:34:32.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.505+0000 7f35cf39d700 1 -- 172.21.15.154:0/888262917 wait complete. 2023-10-10T22:34:32.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.506+0000 7f35cf39d700 1 Processor -- start 2023-10-10T22:34:32.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.507+0000 7f35cf39d700 1 -- start start 2023-10-10T22:34:32.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.507+0000 7f35cf39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c806a710 0x7f35c8144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:32.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.507+0000 7f35cf39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c80c9db0 0x7f35c80c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:32.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35cf39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c8153900 0x7f35c80adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:32.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35cf39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80c57a0 con 0x7f35c806a710 2023-10-10T22:34:32.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35cf39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c816bd50 con 0x7f35c80c9db0 2023-10-10T22:34:32.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35cf39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c81453e0 con 0x7f35c8153900 2023-10-10T22:34:32.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35ce39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c806a710 0x7f35c8144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:32.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35ce39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c806a710 0x7f35c8144ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49964/0 (socket says 172.21.15.154:49964) 2023-10-10T22:34:32.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35ce39b700 1 -- 172.21.15.154:0/1751613176 learned_addr learned my addr 172.21.15.154:0/1751613176 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35ce39b700 1 -- 172.21.15.154:0/1751613176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c8153900 msgr2=0x7f35c80adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35ce39b700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c8153900 0x7f35c80adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35ce39b700 1 -- 172.21.15.154:0/1751613176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c80c9db0 msgr2=0x7f35c80c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35ce39b700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c80c9db0 0x7f35c80c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35ce39b700 1 -- 172.21.15.154:0/1751613176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40094f0 con 0x7f35c806a710 2023-10-10T22:34:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.508+0000 7f35ce39b700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c806a710 0x7f35c8144ea0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f35c4006fd0 tx=0x7f35c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.509+0000 7f35be7fc700 1 -- 172.21.15.154:0/1751613176 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c400b9d0 con 0x7f35c806a710 2023-10-10T22:34:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.509+0000 7f35be7fc700 1 -- 172.21.15.154:0/1751613176 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c400bb30 con 0x7f35c806a710 2023-10-10T22:34:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.509+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c80c54c0 con 0x7f35c806a710 2023-10-10T22:34:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.509+0000 7f35be7fc700 1 -- 172.21.15.154:0/1751613176 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4025670 con 0x7f35c806a710 2023-10-10T22:34:32.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.509+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c816b9e0 con 0x7f35c806a710 2023-10-10T22:34:32.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.510+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c816b560 con 0x7f35c806a710 2023-10-10T22:34:32.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.511+0000 7f35be7fc700 1 -- 172.21.15.154:0/1751613176 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35c4023070 con 0x7f35c806a710 2023-10-10T22:34:32.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.512+0000 7f35be7fc700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35ac066f30 0x7f35ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:32.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.512+0000 7f35be7fc700 1 -- 172.21.15.154:0/1751613176 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f35c4085da0 con 0x7f35c806a710 2023-10-10T22:34:32.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.512+0000 7f35cdb9a700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35ac066f30 0x7f35ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:32.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.513+0000 7f35cdb9a700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35ac066f30 0x7f35ac0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35c80b1f80 tx=0x7f35b80079b0 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:32.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.516+0000 7f35be7fc700 1 -- 172.21.15.154:0/1751613176 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35c816b560 con 0x7f35c806a710 2023-10-10T22:34:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.707+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f35c816b560 con 0x7f35c806a710 2023-10-10T22:34:32.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.711+0000 7f35be7fc700 1 -- 172.21.15.154:0/1751613176 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f35c816b560 con 0x7f35c806a710 2023-10-10T22:34:32.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35ac066f30 msgr2=0x7f35ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:32.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35ac066f30 0x7f35ac0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35c80b1f80 tx=0x7f35b80079b0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c806a710 msgr2=0x7f35c8144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:32.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c806a710 0x7f35c8144ea0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f35c4006fd0 tx=0x7f35c4017000 comp rx=0 tx=0).stop 2023-10-10T22:34:32.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 shutdown_connections 2023-10-10T22:34:32.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35ac066f30 0x7f35ac0693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35c8153900 0x7f35c80adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c806a710 0x7f35c8144ea0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 --2- 172.21.15.154:0/1751613176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35c80c9db0 0x7f35c80c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:32.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 >> 172.21.15.154:0/1751613176 conn(0x7f35c80cc1e0 msgr2=0x7f35c80ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:32.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.713+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 shutdown_connections 2023-10-10T22:34:32.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:32.714+0000 7f35cf39d700 1 -- 172.21.15.154:0/1751613176 wait complete. 2023-10-10T22:34:32.732 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T22:34:32.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:34:32.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:34:32.897 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T22:34:32.898 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T22:34:32.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:34:33.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.078+0000 7f34c5b9d700 1 Processor -- start 2023-10-10T22:34:33.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.079+0000 7f34c5b9d700 1 -- start start 2023-10-10T22:34:33.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34c5b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34c0156310 0x7f34c00c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34c5b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c01566e0 0x7f34c00ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34c5b9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c00ca860 con 0x7f34c00ca300 2023-10-10T22:34:33.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34c5b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c00cab40 con 0x7f34c0156310 2023-10-10T22:34:33.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34c5b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00cae20 con 0x7f34c01566e0 2023-10-10T22:34:33.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34c4b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34c0156310 0x7f34c00c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34c539c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f34c00ca300 0x7f34c00c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59360/0 (socket says 172.21.15.154:59360) 2023-10-10T22:34:33.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34c4b9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34c0156310 0x7f34c00c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49980/0 (socket says 172.21.15.154:49980) 2023-10-10T22:34:33.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34c539c700 1 -- 172.21.15.154:0/3623368986 learned_addr learned my addr 172.21.15.154:0/3623368986 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:33.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.080+0000 7f34bffff700 1 --2- 172.21.15.154:0/3623368986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c01566e0 0x7f34c00ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.081+0000 7f34c4b9b700 1 -- 172.21.15.154:0/3623368986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c01566e0 msgr2=0x7f34c00ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:33.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.081+0000 7f34c4b9b700 1 --2- 172.21.15.154:0/3623368986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c01566e0 0x7f34c00ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.081+0000 7f34c4b9b700 1 -- 172.21.15.154:0/3623368986 >> v1:172.21.15.154:6789/0 conn(0x7f34c00ca300 legacy=0x7f34c00c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:33.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.081+0000 7f34c4b9b700 1 -- 172.21.15.154:0/3623368986 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c00cb100 con 0x7f34c0156310 2023-10-10T22:34:33.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.081+0000 7f34c4b9b700 1 --2- 172.21.15.154:0/3623368986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c0156310 0x7f34c00c9dc0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f34b400bb90 tx=0x7f34b400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ca55274014997 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:33.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.081+0000 7f34bf7fe700 1 -- 172.21.15.154:0/3623368986 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b400dba0 con 0x7f34c0156310 2023-10-10T22:34:33.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.081+0000 7f34bf7fe700 1 -- 172.21.15.154:0/3623368986 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b400dd00 con 0x7f34c0156310 2023-10-10T22:34:33.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.081+0000 7f34bf7fe700 1 -- 172.21.15.154:0/3623368986 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b40196b0 con 0x7f34c0156310 2023-10-10T22:34:33.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.082+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3623368986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c0156310 msgr2=0x7f34c00c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:33.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.082+0000 7f34c5b9d700 1 --2- 172.21.15.154:0/3623368986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c0156310 0x7f34c00c9dc0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f34b400bb90 tx=0x7f34b400b430 comp rx=0 tx=0).stop 2023-10-10T22:34:33.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.082+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3623368986 shutdown_connections 2023-10-10T22:34:33.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.082+0000 7f34c5b9d700 1 --2- 172.21.15.154:0/3623368986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c0156310 0x7f34c00c9dc0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.082+0000 7f34c5b9d700 1 --2- 172.21.15.154:0/3623368986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c01566e0 0x7f34c00ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.082+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3623368986 >> 172.21.15.154:0/3623368986 conn(0x7f34c00cc1f0 msgr2=0x7f34c00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:33.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.082+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3623368986 shutdown_connections 2023-10-10T22:34:33.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.082+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3623368986 wait complete. 2023-10-10T22:34:33.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.083+0000 7f34c5b9d700 1 Processor -- start 2023-10-10T22:34:33.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.083+0000 7f34c5b9d700 1 -- start start 2023-10-10T22:34:33.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.084+0000 7f34c5b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00ca300 0x7f34c0142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.084+0000 7f34c5b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c0156310 0x7f34c0143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.084+0000 7f34c5b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c01566e0 0x7f34c0143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.084+0000 7f34c5b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c013f540 con 0x7f34c01566e0 2023-10-10T22:34:33.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.084+0000 7f34c5b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c013f820 con 0x7f34c00ca300 2023-10-10T22:34:33.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.084+0000 7f34c5b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c013fb00 con 0x7f34c0156310 2023-10-10T22:34:33.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c539c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c01566e0 0x7f34c0143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c539c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c01566e0 0x7f34c0143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49982/0 (socket says 172.21.15.154:49982) 2023-10-10T22:34:33.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c539c700 1 -- 172.21.15.154:0/3884333181 learned_addr learned my addr 172.21.15.154:0/3884333181 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:33.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34bffff700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c0156310 0x7f34c0143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c4b9b700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00ca300 0x7f34c0142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c539c700 1 -- 172.21.15.154:0/3884333181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c0156310 msgr2=0x7f34c0143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:33.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c539c700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c0156310 0x7f34c0143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c539c700 1 -- 172.21.15.154:0/3884333181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00ca300 msgr2=0x7f34c0142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:33.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c539c700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00ca300 0x7f34c0142f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c539c700 1 -- 172.21.15.154:0/3884333181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b400b6d0 con 0x7f34c01566e0 2023-10-10T22:34:33.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.085+0000 7f34c539c700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c01566e0 0x7f34c0143990 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f34b800cbc0 tx=0x7f34b80019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:33.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.086+0000 7f34bcff9700 1 -- 172.21.15.154:0/3884333181 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b800a7e0 con 0x7f34c01566e0 2023-10-10T22:34:33.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.086+0000 7f34bcff9700 1 -- 172.21.15.154:0/3884333181 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b800a940 con 0x7f34c01566e0 2023-10-10T22:34:33.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.086+0000 7f34bcff9700 1 -- 172.21.15.154:0/3884333181 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b800acc0 con 0x7f34c01566e0 2023-10-10T22:34:33.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.086+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c013fde0 con 0x7f34c01566e0 2023-10-10T22:34:33.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.086+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c01405e0 con 0x7f34c01566e0 2023-10-10T22:34:33.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.087+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c013f960 con 0x7f34c01566e0 2023-10-10T22:34:33.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.088+0000 7f34bcff9700 1 -- 172.21.15.154:0/3884333181 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34b8007300 con 0x7f34c01566e0 2023-10-10T22:34:33.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.088+0000 7f34bcff9700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f34a4066f30 0x7f34a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.089+0000 7f34bcff9700 1 -- 172.21.15.154:0/3884333181 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f34b8084a40 con 0x7f34c01566e0 2023-10-10T22:34:33.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.089+0000 7f34c4b9b700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f34a4066f30 0x7f34a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.089+0000 7f34c4b9b700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f34a4066f30 0x7f34a40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b6a0 tx=0x7f34b401b000 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:33.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.092+0000 7f34bcff9700 1 -- 172.21.15.154:0/3884333181 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34c013f960 con 0x7f34c01566e0 2023-10-10T22:34:33.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.326+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34c0140300 con 0x7f34c01566e0 2023-10-10T22:34:33.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.326+0000 7f34bcff9700 1 -- 172.21.15.154:0/3884333181 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f34c0140300 con 0x7f34c01566e0 2023-10-10T22:34:33.328 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:33.329 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3140311410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3140311410},{"type":"v1","addr":"172.21.15.179:6835","nonce":3140311410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7841,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1911384741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1911384741},{"type":"v1","addr":"172.21.15.154:6835","nonce":1911384741}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2649941331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2649941331},{"type":"v1","addr":"172.21.15.179:6834","nonce":2649941331}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9135,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3061056526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3061056526},{"type":"v1","addr":"172.21.15.154:6834","nonce":3061056526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[]} 2023-10-10T22:34:33.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f34a4066f30 msgr2=0x7f34a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:33.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f34a4066f30 0x7f34a40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b6a0 tx=0x7f34b401b000 comp rx=0 tx=0).stop 2023-10-10T22:34:33.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c01566e0 msgr2=0x7f34c0143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:33.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c01566e0 0x7f34c0143990 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f34b800cbc0 tx=0x7f34b80019c0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 shutdown_connections 2023-10-10T22:34:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f34a4066f30 0x7f34a40693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34c01566e0 0x7f34c0143990 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00ca300 0x7f34c0142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 --2- 172.21.15.154:0/3884333181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c0156310 0x7f34c0143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 >> 172.21.15.154:0/3884333181 conn(0x7f34c00cc1f0 msgr2=0x7f34c00c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 shutdown_connections 2023-10-10T22:34:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.329+0000 7f34c5b9d700 1 -- 172.21.15.154:0/3884333181 wait complete. 2023-10-10T22:34:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 80 2023-10-10T22:34:33.348 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T22:34:33.348 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T22:34:33.348 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T22:34:33.349 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:34:33.349 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T22:34:33.349 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T22:34:33.350 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T22:34:33.350 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:34:33.350 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T22:34:33.350 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T22:34:33.351 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T22:34:33.351 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:34:33.351 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T22:34:33.351 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T22:34:33.352 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T22:34:33.352 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:34:33.362 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T22:34:33.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T22:34:33.364 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T22:34:33.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T22:34:33.368 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T22:34:33.369 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T22:34:33.370 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T22:34:33.370 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T22:34:33.408 INFO:tasks.ceph.mds.a:Started 2023-10-10T22:34:33.409 DEBUG:teuthology.parallel:result is None 2023-10-10T22:34:33.412 INFO:tasks.ceph.mds.c:Started 2023-10-10T22:34:33.412 DEBUG:teuthology.parallel:result is None 2023-10-10T22:34:33.413 INFO:tasks.ceph.mds.b:Started 2023-10-10T22:34:33.415 DEBUG:teuthology.parallel:result is None 2023-10-10T22:34:33.417 INFO:tasks.ceph.mds.d:Started 2023-10-10T22:34:33.418 DEBUG:teuthology.parallel:result is None 2023-10-10T22:34:33.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T22:34:33.545 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T22:34:33.550 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T22:34:33.552 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T22:34:33.552 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T22:34:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.612+0000 7f89ccbff700 1 Processor -- start 2023-10-10T22:34:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.612+0000 7f89ccbff700 1 -- start start 2023-10-10T22:34:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89ccbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f89c80cbf30 0x7f89c80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89ccbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 0x7f89c80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89ccbff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89c815a270 0x7f89c80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89ccbff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c8156bf0 con 0x7f89c815a270 2023-10-10T22:34:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89ccbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c80ae950 con 0x7f89c80cbf30 2023-10-10T22:34:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89ccbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80cc300 con 0x7f89c80ccf90 2023-10-10T22:34:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c6d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89c815a270 0x7f89c80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c6d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89c815a270 0x7f89c80b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50014/0 (socket says 172.21.15.154:50014) 2023-10-10T22:34:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c6d9d700 1 -- 172.21.15.154:0/1215600943 learned_addr learned my addr 172.21.15.154:0/1215600943 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:33.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c659c700 1 --2- 172.21.15.154:0/1215600943 >> v2:172.21.15.179:3300/0 conn(0x7f89c80cbf30 0x7f89c80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89bffff700 1 --2- 172.21.15.154:0/1215600943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 0x7f89c80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c6d9d700 1 -- 172.21.15.154:0/1215600943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 msgr2=0x7f89c80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:33.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c6d9d700 1 --2- 172.21.15.154:0/1215600943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 0x7f89c80b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c6d9d700 1 -- 172.21.15.154:0/1215600943 >> v2:172.21.15.179:3300/0 conn(0x7f89c80cbf30 msgr2=0x7f89c80ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:33.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c6d9d700 1 --2- 172.21.15.154:0/1215600943 >> v2:172.21.15.179:3300/0 conn(0x7f89c80cbf30 0x7f89c80ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c6d9d700 1 -- 172.21.15.154:0/1215600943 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c80ad370 con 0x7f89c815a270 2023-10-10T22:34:33.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.614+0000 7f89c659c700 1 --2- 172.21.15.154:0/1215600943 >> v2:172.21.15.179:3300/0 conn(0x7f89c80cbf30 0x7f89c80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:33.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89c6d9d700 1 --2- 172.21.15.154:0/1215600943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 0x7f89c80b1250 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f89c8063d40 tx=0x7f89c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabb0163ebc803c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:33.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89c5d9b700 1 -- 172.21.15.154:0/1215600943 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000e070 con 0x7f89c815a270 2023-10-10T22:34:33.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89c5d9b700 1 -- 172.21.15.154:0/1215600943 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000b990 con 0x7f89c815a270 2023-10-10T22:34:33.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89c5d9b700 1 -- 172.21.15.154:0/1215600943 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00092e0 con 0x7f89c815a270 2023-10-10T22:34:33.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89ccbff700 1 -- 172.21.15.154:0/1215600943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 msgr2=0x7f89c80b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:33.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1215600943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 0x7f89c80b1250 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f89c8063d40 tx=0x7f89c0009840 comp rx=0 tx=0).stop 2023-10-10T22:34:33.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89ccbff700 1 -- 172.21.15.154:0/1215600943 shutdown_connections 2023-10-10T22:34:33.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1215600943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 0x7f89c80b1250 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1215600943 >> v2:172.21.15.179:3300/0 conn(0x7f89c80cbf30 0x7f89c80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1215600943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 0x7f89c80b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.615+0000 7f89ccbff700 1 -- 172.21.15.154:0/1215600943 >> 172.21.15.154:0/1215600943 conn(0x7f89c806a320 msgr2=0x7f89c80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:33.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.616+0000 7f89ccbff700 1 -- 172.21.15.154:0/1215600943 shutdown_connections 2023-10-10T22:34:33.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.616+0000 7f89ccbff700 1 -- 172.21.15.154:0/1215600943 wait complete. 2023-10-10T22:34:33.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.617+0000 7f89ccbff700 1 Processor -- start 2023-10-10T22:34:33.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.617+0000 7f89ccbff700 1 -- start start 2023-10-10T22:34:33.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89ccbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c80cbf30 0x7f89c8152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89ccbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 0x7f89c80aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89ccbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 0x7f89c80ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89ccbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c8153340 con 0x7f89c815a270 2023-10-10T22:34:33.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89ccbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80ab5c0 con 0x7f89c80cbf30 2023-10-10T22:34:33.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89ccbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80ab880 con 0x7f89c80ccf90 2023-10-10T22:34:33.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89c6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 0x7f89c80ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89c6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 0x7f89c80ab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50026/0 (socket says 172.21.15.154:50026) 2023-10-10T22:34:33.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89c6d9d700 1 -- 172.21.15.154:0/1422641965 learned_addr learned my addr 172.21.15.154:0/1422641965 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:33.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89c659c700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c80cbf30 0x7f89c8152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.618+0000 7f89bffff700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 0x7f89c80aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89c6d9d700 1 -- 172.21.15.154:0/1422641965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 msgr2=0x7f89c80aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:33.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89c6d9d700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 0x7f89c80aab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89c6d9d700 1 -- 172.21.15.154:0/1422641965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c80cbf30 msgr2=0x7f89c8152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:33.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89c6d9d700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c80cbf30 0x7f89c8152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:33.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89c6d9d700 1 -- 172.21.15.154:0/1422641965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0009ae0 con 0x7f89c815a270 2023-10-10T22:34:33.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89c659c700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c80cbf30 0x7f89c8152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:33.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89c6d9d700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 0x7f89c80ab080 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f89c8064290 tx=0x7f89c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:33.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89be7fc700 1 -- 172.21.15.154:0/1422641965 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0008ad0 con 0x7f89c815a270 2023-10-10T22:34:33.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89be7fc700 1 -- 172.21.15.154:0/1422641965 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c0008c50 con 0x7f89c815a270 2023-10-10T22:34:33.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c80abb60 con 0x7f89c815a270 2023-10-10T22:34:33.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89be7fc700 1 -- 172.21.15.154:0/1422641965 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0026460 con 0x7f89c815a270 2023-10-10T22:34:33.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.619+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c80ac120 con 0x7f89c815a270 2023-10-10T22:34:33.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.620+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c8140e60 con 0x7f89c815a270 2023-10-10T22:34:33.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.621+0000 7f89be7fc700 1 -- 172.21.15.154:0/1422641965 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89c0003040 con 0x7f89c815a270 2023-10-10T22:34:33.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.622+0000 7f89be7fc700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f89a8066f30 0x7f89a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:33.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.622+0000 7f89be7fc700 1 -- 172.21.15.154:0/1422641965 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f89c0086350 con 0x7f89c815a270 2023-10-10T22:34:33.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.622+0000 7f89c659c700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f89a8066f30 0x7f89a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:33.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.623+0000 7f89c659c700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f89a8066f30 0x7f89a80693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89b8006f00 tx=0x7f89b8008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:33.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.626+0000 7f89be7fc700 1 -- 172.21.15.154:0/1422641965 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89c8140e60 con 0x7f89c815a270 2023-10-10T22:34:33.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:33.842+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f89c8140e60 con 0x7f89c815a270 2023-10-10T22:34:34.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.742+0000 7f89be7fc700 1 -- 172.21.15.154:0/1422641965 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v189) v1 ==== 97+0+0 (secure 0 0 0) 0x7f89c8140e60 con 0x7f89c815a270 2023-10-10T22:34:34.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.745+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f89a8066f30 msgr2=0x7f89a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:34.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.745+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f89a8066f30 0x7f89a80693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89b8006f00 tx=0x7f89b8008040 comp rx=0 tx=0).stop 2023-10-10T22:34:34.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.745+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 msgr2=0x7f89c80ab080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:34.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.745+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 0x7f89c80ab080 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f89c8064290 tx=0x7f89c0018000 comp rx=0 tx=0).stop 2023-10-10T22:34:34.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.745+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 shutdown_connections 2023-10-10T22:34:34.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.745+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f89a8066f30 0x7f89a80693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:34.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.745+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89c815a270 0x7f89c80ab080 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:34.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.745+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c80cbf30 0x7f89c8152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:34.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.745+0000 7f89ccbff700 1 --2- 172.21.15.154:0/1422641965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c80ccf90 0x7f89c80aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:34.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.746+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 >> 172.21.15.154:0/1422641965 conn(0x7f89c806a320 msgr2=0x7f89c80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:34.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.746+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 shutdown_connections 2023-10-10T22:34:34.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.746+0000 7f89ccbff700 1 -- 172.21.15.154:0/1422641965 wait complete. 2023-10-10T22:34:34.750 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T22:34:34.767 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T22:34:34.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.952+0000 7f66123ff700 1 Processor -- start 2023-10-10T22:34:34.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.952+0000 7f66123ff700 1 -- start start 2023-10-10T22:34:34.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.953+0000 7f66123ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 0x7f660c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:34.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f66123ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f660c0b0010 0x7f660c15df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:34.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f66123ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c0b0750 con 0x7f660c0b2140 2023-10-10T22:34:34.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f66123ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c0aca70 con 0x7f660c0b0010 2023-10-10T22:34:34.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f66123ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0acd50 con 0x7f660c0afc40 2023-10-10T22:34:34.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f661099c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f660c0b0010 0x7f660c15df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:34.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f661099c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f660c0b0010 0x7f660c15df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50028/0 (socket says 172.21.15.154:50028) 2023-10-10T22:34:34.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f661099c700 1 -- 172.21.15.154:0/673598885 learned_addr learned my addr 172.21.15.154:0/673598885 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:34.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f660bfff700 1 --2- 172.21.15.154:0/673598885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 0x7f660c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:34.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f661099c700 1 -- 172.21.15.154:0/673598885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 msgr2=0x7f660c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:34.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f661099c700 1 --2- 172.21.15.154:0/673598885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 0x7f660c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:34.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f661099c700 1 -- 172.21.15.154:0/673598885 >> v1:172.21.15.179:6789/0 conn(0x7f660c0b2140 legacy=0x7f660c15d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:34.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.954+0000 7f661099c700 1 -- 172.21.15.154:0/673598885 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c0ad030 con 0x7f660c0b0010 2023-10-10T22:34:34.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.955+0000 7f661099c700 1 --2- 172.21.15.154:0/673598885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b0010 0x7f660c15df60 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f6604009f20 tx=0x7f6604009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2d87efc5bcf23c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:34.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.955+0000 7f660affd700 1 -- 172.21.15.154:0/673598885 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400e070 con 0x7f660c0b0010 2023-10-10T22:34:34.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.955+0000 7f660affd700 1 -- 172.21.15.154:0/673598885 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660400ba80 con 0x7f660c0b0010 2023-10-10T22:34:34.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.955+0000 7f660affd700 1 -- 172.21.15.154:0/673598885 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040092e0 con 0x7f660c0b0010 2023-10-10T22:34:34.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.955+0000 7f66123ff700 1 -- 172.21.15.154:0/673598885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b0010 msgr2=0x7f660c15df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:34.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.955+0000 7f66123ff700 1 --2- 172.21.15.154:0/673598885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b0010 0x7f660c15df60 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f6604009f20 tx=0x7f6604009840 comp rx=0 tx=0).stop 2023-10-10T22:34:34.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.956+0000 7f66123ff700 1 -- 172.21.15.154:0/673598885 shutdown_connections 2023-10-10T22:34:34.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.956+0000 7f66123ff700 1 --2- 172.21.15.154:0/673598885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b0010 0x7f660c15df60 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:34.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.956+0000 7f66123ff700 1 --2- 172.21.15.154:0/673598885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 0x7f660c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:34.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.956+0000 7f66123ff700 1 -- 172.21.15.154:0/673598885 >> 172.21.15.154:0/673598885 conn(0x7f660c06a320 msgr2=0x7f660c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:34.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.956+0000 7f66123ff700 1 -- 172.21.15.154:0/673598885 shutdown_connections 2023-10-10T22:34:34.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.956+0000 7f66123ff700 1 -- 172.21.15.154:0/673598885 wait complete. 2023-10-10T22:34:34.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.957+0000 7f66123ff700 1 Processor -- start 2023-10-10T22:34:34.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.957+0000 7f66123ff700 1 -- start start 2023-10-10T22:34:34.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f66123ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 0x7f660c1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:34.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f66123ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660c0b0010 0x7f660c16e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:34.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f66123ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b2140 0x7f660c0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:34.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f66123ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c155030 con 0x7f660c0b2140 2023-10-10T22:34:34.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f66123ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c154700 con 0x7f660c0b0010 2023-10-10T22:34:34.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f66123ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c1549e0 con 0x7f660c0afc40 2023-10-10T22:34:34.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f661099c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b2140 0x7f660c0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:34.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f661099c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b2140 0x7f660c0cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50042/0 (socket says 172.21.15.154:50042) 2023-10-10T22:34:34.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f661099c700 1 -- 172.21.15.154:0/4288542467 learned_addr learned my addr 172.21.15.154:0/4288542467 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:34.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f660b7fe700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660c0b0010 0x7f660c16e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:34.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.958+0000 7f660bfff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 0x7f660c1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:34.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f661099c700 1 -- 172.21.15.154:0/4288542467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 msgr2=0x7f660c1519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:34.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f661099c700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 0x7f660c1519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:34.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f661099c700 1 -- 172.21.15.154:0/4288542467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660c0b0010 msgr2=0x7f660c16e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f661099c700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660c0b0010 0x7f660c16e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f661099c700 1 -- 172.21.15.154:0/4288542467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604009ae0 con 0x7f660c0b2140 2023-10-10T22:34:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f661099c700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b2140 0x7f660c0cc810 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f660400b6c0 tx=0x7f6604018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f65f3fff700 1 -- 172.21.15.154:0/4288542467 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040032f0 con 0x7f660c0b2140 2023-10-10T22:34:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f65f3fff700 1 -- 172.21.15.154:0/4288542467 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6604008d20 con 0x7f660c0b2140 2023-10-10T22:34:34.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f65f3fff700 1 -- 172.21.15.154:0/4288542467 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604026670 con 0x7f660c0b2140 2023-10-10T22:34:34.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.959+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c154cc0 con 0x7f660c0b2140 2023-10-10T22:34:34.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.960+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c16e5a0 con 0x7f660c0b2140 2023-10-10T22:34:34.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.961+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c04c3c0 con 0x7f660c0b2140 2023-10-10T22:34:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.961+0000 7f65f3fff700 1 -- 172.21.15.154:0/4288542467 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6604003040 con 0x7f660c0b2140 2023-10-10T22:34:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.963+0000 7f65f3fff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f65f8066f30 0x7f65f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.963+0000 7f65f3fff700 1 -- 172.21.15.154:0/4288542467 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5345+0+0 (secure 0 0 0) 0x7f66040863a0 con 0x7f660c0b2140 2023-10-10T22:34:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.963+0000 7f660bfff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f65f8066f30 0x7f65f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.964+0000 7f660bfff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f65f8066f30 0x7f65f80693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f65fc006fd0 tx=0x7f65fc008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:34.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:34.967+0000 7f65f3fff700 1 -- 172.21.15.154:0/4288542467 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66040536d0 con 0x7f660c0b2140 2023-10-10T22:34:35.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.233+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f660c155170 con 0x7f660c0b2140 2023-10-10T22:34:35.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.233+0000 7f65f3fff700 1 -- 172.21.15.154:0/4288542467 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v50) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6604056cf0 con 0x7f660c0b2140 2023-10-10T22:34:35.235 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:35.236 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:34:35.236 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T22:34:35.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.236 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T22:34:35.236 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T22:34:35.237 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.237 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:34:35.237 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:34:35.237 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:34:35.238 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.238 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T22:34:35.239 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T22:34:35.239 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.239 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:34:35.239 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:34:35.240 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:34:35.240 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.240 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.241 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T22:34:35.241 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T22:34:35.241 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.241 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:34:35.241 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:34:35.242 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:34:35.242 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.242 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.243 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T22:34:35.243 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T22:34:35.243 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.243 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:34:35.244 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:34:35.244 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:34:35.244 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.245 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T22:34:35.245 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T22:34:35.245 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.245 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:34:35.246 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:34:35.246 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.247 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T22:34:35.247 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T22:34:35.247 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.247 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:34:35.248 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:34:35.248 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.248 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.249 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T22:34:35.249 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T22:34:35.249 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.249 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:34:35.250 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:34:35.250 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.251 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T22:34:35.251 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T22:34:35.251 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.251 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:34:35.252 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:34:35.252 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.252 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.253 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T22:34:35.253 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T22:34:35.253 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.253 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:34:35.254 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:34:35.254 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.255 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T22:34:35.255 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T22:34:35.255 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.255 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:34:35.256 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:34:35.256 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.256 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.257 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T22:34:35.257 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T22:34:35.257 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.257 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:34:35.257 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:34:35.258 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.258 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T22:34:35.259 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T22:34:35.259 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.259 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:34:35.259 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:34:35.260 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.260 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.260 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T22:34:35.261 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T22:34:35.261 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.261 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:34:35.261 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T22:34:35.261 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T22:34:35.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.262 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T22:34:35.263 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T22:34:35.263 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.263 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:34:35.263 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:34:35.263 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:34:35.264 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:34:35.264 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.264 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T22:34:35.265 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T22:34:35.265 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.265 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:34:35.265 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:34:35.265 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:34:35.266 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:34:35.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.266 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T22:34:35.267 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T22:34:35.267 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.267 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:34:35.267 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:34:35.268 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:34:35.268 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:34:35.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.269 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T22:34:35.269 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T22:34:35.269 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.269 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:34:35.269 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:34:35.270 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:34:35.270 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.270 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.271 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T22:34:35.271 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T22:34:35.271 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.271 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:34:35.272 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T22:34:35.272 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.272 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:34:35.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:35.273 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T22:34:35.273 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T22:34:35.273 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:34:35.273 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:34:35.273 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T22:34:35.274 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:34:35.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:35.274 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T22:34:35.274 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:34:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f65f8066f30 msgr2=0x7f65f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f65f8066f30 0x7f65f80693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f65fc006fd0 tx=0x7f65fc008040 comp rx=0 tx=0).stop 2023-10-10T22:34:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b2140 msgr2=0x7f660c0cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b2140 0x7f660c0cc810 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f660400b6c0 tx=0x7f6604018000 comp rx=0 tx=0).stop 2023-10-10T22:34:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 shutdown_connections 2023-10-10T22:34:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f65f8066f30 0x7f65f80693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f660c0b2140 0x7f660c0cc810 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660c0afc40 0x7f660c1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 --2- 172.21.15.154:0/4288542467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660c0b0010 0x7f660c16e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 >> 172.21.15.154:0/4288542467 conn(0x7f660c06a320 msgr2=0x7f660c15b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 shutdown_connections 2023-10-10T22:34:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.236+0000 7f66123ff700 1 -- 172.21.15.154:0/4288542467 wait complete. 2023-10-10T22:34:35.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:34:35.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.462+0000 7fb95edff700 1 Processor -- start 2023-10-10T22:34:35.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.462+0000 7fb95edff700 1 -- start start 2023-10-10T22:34:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95edff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9580cbf30 0x7fb9580ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580b1420 0x7fb9580c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95edff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9580cc300 con 0x7fb9580ccf90 2023-10-10T22:34:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95edff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb958156bf0 con 0x7fb9580cbf30 2023-10-10T22:34:35.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580ae950 con 0x7fb9580b1420 2023-10-10T22:34:35.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95cb9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9580cbf30 0x7fb9580ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb957fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb9580ccf90 0x7fb9580b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59378/0 (socket says 172.21.15.154:59378) 2023-10-10T22:34:35.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb957fff700 1 -- 172.21.15.154:0/3971974587 learned_addr learned my addr 172.21.15.154:0/3971974587 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:35.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95d39c700 1 --2- 172.21.15.154:0/3971974587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580b1420 0x7fb9580c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95cb9b700 1 -- 172.21.15.154:0/3971974587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580b1420 msgr2=0x7fb9580c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:35.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95cb9b700 1 --2- 172.21.15.154:0/3971974587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580b1420 0x7fb9580c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb95cb9b700 1 -- 172.21.15.154:0/3971974587 >> v1:172.21.15.154:6789/0 conn(0x7fb9580ccf90 legacy=0x7fb9580b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.465+0000 7fb95cb9b700 1 -- 172.21.15.154:0/3971974587 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580ad370 con 0x7fb9580cbf30 2023-10-10T22:34:35.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.464+0000 7fb9577fe700 1 -- 172.21.15.154:0/3971974587 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192902811 0 0) 0x7fb9580cc300 con 0x7fb9580ccf90 2023-10-10T22:34:35.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.465+0000 7fb95cb9b700 1 --2- 172.21.15.154:0/3971974587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580cbf30 0x7fb9580ae410 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009910 tx=0x7fb94c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d4d891e45c6aff server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:35.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.465+0000 7fb9577fe700 1 -- 172.21.15.154:0/3971974587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00b820 con 0x7fb9580cbf30 2023-10-10T22:34:35.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.465+0000 7fb9577fe700 1 -- 172.21.15.154:0/3971974587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c00b980 con 0x7fb9580cbf30 2023-10-10T22:34:35.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.465+0000 7fb9577fe700 1 -- 172.21.15.154:0/3971974587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00bd20 con 0x7fb9580cbf30 2023-10-10T22:34:35.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.465+0000 7fb95edff700 1 -- 172.21.15.154:0/3971974587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580cbf30 msgr2=0x7fb9580ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.465+0000 7fb95edff700 1 --2- 172.21.15.154:0/3971974587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580cbf30 0x7fb9580ae410 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009910 tx=0x7fb94c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.466+0000 7fb95edff700 1 -- 172.21.15.154:0/3971974587 shutdown_connections 2023-10-10T22:34:35.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.466+0000 7fb95edff700 1 --2- 172.21.15.154:0/3971974587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580b1420 0x7fb9580c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.466+0000 7fb95edff700 1 --2- 172.21.15.154:0/3971974587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580cbf30 0x7fb9580ae410 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.466+0000 7fb95edff700 1 -- 172.21.15.154:0/3971974587 >> 172.21.15.154:0/3971974587 conn(0x7fb95806a320 msgr2=0x7fb9580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:35.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.466+0000 7fb95edff700 1 -- 172.21.15.154:0/3971974587 shutdown_connections 2023-10-10T22:34:35.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.466+0000 7fb95edff700 1 -- 172.21.15.154:0/3971974587 wait complete. 2023-10-10T22:34:35.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.467+0000 7fb95edff700 1 Processor -- start 2023-10-10T22:34:35.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.467+0000 7fb95edff700 1 -- start start 2023-10-10T22:34:35.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.468+0000 7fb95edff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580b1420 0x7fb9580c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.468+0000 7fb95edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9580cbf30 0x7fb9580a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.468+0000 7fb95edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580ccf90 0x7fb95816a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.468+0000 7fb95edff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580a9040 con 0x7fb9580b1420 2023-10-10T22:34:35.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.468+0000 7fb95edff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb958157740 con 0x7fb9580cbf30 2023-10-10T22:34:35.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.468+0000 7fb95edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb958155ea0 con 0x7fb9580ccf90 2023-10-10T22:34:35.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.468+0000 7fb95cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580b1420 0x7fb9580c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.468+0000 7fb95cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580b1420 0x7fb9580c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50054/0 (socket says 172.21.15.154:50054) 2023-10-10T22:34:35.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.468+0000 7fb95cb9b700 1 -- 172.21.15.154:0/2633972883 learned_addr learned my addr 172.21.15.154:0/2633972883 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:35.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb957fff700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9580cbf30 0x7fb9580a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb95d39c700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580ccf90 0x7fb95816a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb95cb9b700 1 -- 172.21.15.154:0/2633972883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580ccf90 msgr2=0x7fb95816a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb95cb9b700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580ccf90 0x7fb95816a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb95cb9b700 1 -- 172.21.15.154:0/2633972883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9580cbf30 msgr2=0x7fb9580a89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb95cb9b700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9580cbf30 0x7fb9580a89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb95cb9b700 1 -- 172.21.15.154:0/2633972883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c009420 con 0x7fb9580b1420 2023-10-10T22:34:35.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb95cb9b700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580b1420 0x7fb9580c8960 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b3c0 tx=0x7fb94c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:35.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb954ff9700 1 -- 172.21.15.154:0/2633972883 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00b820 con 0x7fb9580b1420 2023-10-10T22:34:35.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb954ff9700 1 -- 172.21.15.154:0/2633972883 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c011e10 con 0x7fb9580b1420 2023-10-10T22:34:35.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb958157950 con 0x7fb9580b1420 2023-10-10T22:34:35.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb954ff9700 1 -- 172.21.15.154:0/2633972883 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c024690 con 0x7fb9580b1420 2023-10-10T22:34:35.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.469+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb958157ce0 con 0x7fb9580b1420 2023-10-10T22:34:35.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.471+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95804c3c0 con 0x7fb9580b1420 2023-10-10T22:34:35.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.471+0000 7fb954ff9700 1 -- 172.21.15.154:0/2633972883 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb94c02d440 con 0x7fb9580b1420 2023-10-10T22:34:35.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.472+0000 7fb954ff9700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb93c066f60 0x7fb93c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.472+0000 7fb954ff9700 1 -- 172.21.15.154:0/2633972883 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5345+0+0 (secure 0 0 0) 0x7fb94c085e80 con 0x7fb9580b1420 2023-10-10T22:34:35.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.472+0000 7fb957fff700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb93c066f60 0x7fb93c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.473+0000 7fb957fff700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb93c066f60 0x7fb93c069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb944007160 tx=0x7fb944007f50 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:35.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.476+0000 7fb954ff9700 1 -- 172.21.15.154:0/2633972883 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb94c0531b0 con 0x7fb9580b1420 2023-10-10T22:34:35.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.668+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9580ad650 con 0x7fb9580b1420 2023-10-10T22:34:35.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.669+0000 7fb954ff9700 1 -- 172.21.15.154:0/2633972883 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+12949 (secure 0 0 0) 0x7fb94c0567d0 con 0x7fb9580b1420 2023-10-10T22:34:35.671 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:35.671 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":189,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:34:34.735252+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:34:35.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb93c066f60 msgr2=0x7fb93c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb93c066f60 0x7fb93c069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb944007160 tx=0x7fb944007f50 comp rx=0 tx=0).stop 2023-10-10T22:34:35.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580b1420 msgr2=0x7fb9580c8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580b1420 0x7fb9580c8960 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b3c0 tx=0x7fb94c017000 comp rx=0 tx=0).stop 2023-10-10T22:34:35.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 shutdown_connections 2023-10-10T22:34:35.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb93c066f60 0x7fb93c069410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9580ccf90 0x7fb95816a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9580b1420 0x7fb9580c8960 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 --2- 172.21.15.154:0/2633972883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9580cbf30 0x7fb9580a89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 >> 172.21.15.154:0/2633972883 conn(0x7fb95806a320 msgr2=0x7fb95806d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:35.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 shutdown_connections 2023-10-10T22:34:35.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.672+0000 7fb95edff700 1 -- 172.21.15.154:0/2633972883 wait complete. 2023-10-10T22:34:35.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T22:34:35.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T22:34:35.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.878+0000 7f7b4f39d700 1 Processor -- start 2023-10-10T22:34:35.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.879+0000 7f7b4f39d700 1 -- start start 2023-10-10T22:34:35.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.880+0000 7f7b4f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480ae7e0 0x7f7b480c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.880+0000 7f7b4f39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4806ebd0 con 0x7f7b4806f060 2023-10-10T22:34:35.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.880+0000 7f7b4f39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4815aa70 con 0x7f7b480cb1a0 2023-10-10T22:34:35.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.880+0000 7f7b4f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4815b2e0 con 0x7f7b480ae7e0 2023-10-10T22:34:35.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.880+0000 7f7b4db9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7b4806f060 0x7f7b480ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33212/0 (socket says 172.21.15.154:33212) 2023-10-10T22:34:35.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.880+0000 7f7b4db9a700 1 -- 172.21.15.154:0/3493570403 learned_addr learned my addr 172.21.15.154:0/3493570403 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:35.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533000466 0 0) 0x7f7b4806ebd0 con 0x7f7b4806f060 2023-10-10T22:34:35.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b34003570 con 0x7f7b4806f060 2023-10-10T22:34:35.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4eb9c700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480ae7e0 0x7f7b480c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 403262280 0 0) 0x7f7b34003570 con 0x7f7b4806f060 2023-10-10T22:34:35.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480ae7e0 msgr2=0x7f7b480c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:35.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480ae7e0 0x7f7b480c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 >> v1:172.21.15.179:6789/0 conn(0x7f7b480cb1a0 legacy=0x7f7b4815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4815ad20 con 0x7f7b4806f060 2023-10-10T22:34:35.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f7b38001470 con 0x7f7b4806f060 2023-10-10T22:34:35.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 >> v1:172.21.15.154:6789/0 conn(0x7f7b4806f060 legacy=0x7f7b480ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34003a90 0x7f7b34003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480ae7e0 0x7f7b34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b34004da0 0x7f7b340051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4815b2e0 con 0x7f7b34004da0 2023-10-10T22:34:35.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3400de30 con 0x7f7b34003a90 2023-10-10T22:34:35.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3400dff0 con 0x7f7b480ae7e0 2023-10-10T22:34:35.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4eb9c700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b34004da0 0x7f7b340051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4db9a700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480ae7e0 0x7f7b34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.881+0000 7f7b4e39b700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34003a90 0x7f7b34003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.882+0000 7f7b4eb9c700 1 -- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480ae7e0 msgr2=0x7f7b34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:35.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.882+0000 7f7b4eb9c700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480ae7e0 0x7f7b34004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.882+0000 7f7b4eb9c700 1 -- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34003a90 msgr2=0x7f7b34003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:35.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.882+0000 7f7b4eb9c700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34003a90 0x7f7b34003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.882+0000 7f7b4eb9c700 1 -- 172.21.15.154:0/3493570403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34003570 con 0x7f7b34004da0 2023-10-10T22:34:35.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.882+0000 7f7b4eb9c700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b34004da0 0x7f7b340051f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f7b4806d5a0 tx=0x7f7b40009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128c98a04ebe9493 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:35.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.882+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40009a40 con 0x7f7b34004da0 2023-10-10T22:34:35.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.882+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40007c90 con 0x7f7b34004da0 2023-10-10T22:34:35.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.882+0000 7f7b4d399700 1 -- 172.21.15.154:0/3493570403 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40014630 con 0x7f7b34004da0 2023-10-10T22:34:35.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.883+0000 7f7b4f39d700 1 -- 172.21.15.154:0/3493570403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b34004da0 msgr2=0x7f7b340051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.883+0000 7f7b4f39d700 1 --2- 172.21.15.154:0/3493570403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b34004da0 0x7f7b340051f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f7b4806d5a0 tx=0x7f7b40009710 comp rx=0 tx=0).stop 2023-10-10T22:34:35.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.883+0000 7f7b4eb9c700 1 -- 172.21.15.154:0/3493570403 reap_dead start 2023-10-10T22:34:35.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.883+0000 7f7b4f39d700 1 -- 172.21.15.154:0/3493570403 shutdown_connections 2023-10-10T22:34:35.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.883+0000 7f7b4f39d700 1 -- 172.21.15.154:0/3493570403 >> 172.21.15.154:0/3493570403 conn(0x7f7b480cc1e0 msgr2=0x7f7b480cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:35.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.883+0000 7f7b4f39d700 1 -- 172.21.15.154:0/3493570403 shutdown_connections 2023-10-10T22:34:35.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.883+0000 7f7b4f39d700 1 -- 172.21.15.154:0/3493570403 wait complete. 2023-10-10T22:34:35.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.884+0000 7f7b4f39d700 1 Processor -- start 2023-10-10T22:34:35.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.884+0000 7f7b4f39d700 1 -- start start 2023-10-10T22:34:35.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.885+0000 7f7b4f39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34004da0 0x7f7b48150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.885+0000 7f7b4f39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b480b0f20 0x7f7b4814e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.885+0000 7f7b4f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480c18b0 0x7f7b480c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.885+0000 7f7b4f39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480c2290 con 0x7f7b480b0f20 2023-10-10T22:34:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.885+0000 7f7b4f39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b481579d0 con 0x7f7b34004da0 2023-10-10T22:34:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.885+0000 7f7b4f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48151310 con 0x7f7b480c18b0 2023-10-10T22:34:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.885+0000 7f7b4db9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b480b0f20 0x7f7b4814e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4db9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b480b0f20 0x7f7b4814e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56828/0 (socket says 172.21.15.154:56828) 2023-10-10T22:34:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4db9a700 1 -- 172.21.15.154:0/105421699 learned_addr learned my addr 172.21.15.154:0/105421699 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4e39b700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34004da0 0x7f7b48150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4eb9c700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480c18b0 0x7f7b480c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4db9a700 1 -- 172.21.15.154:0/105421699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480c18b0 msgr2=0x7f7b480c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4db9a700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480c18b0 0x7f7b480c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4db9a700 1 -- 172.21.15.154:0/105421699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34004da0 msgr2=0x7f7b48150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:35.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4db9a700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34004da0 0x7f7b48150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:35.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4db9a700 1 -- 172.21.15.154:0/105421699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b481515f0 con 0x7f7b480b0f20 2023-10-10T22:34:35.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4e39b700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34004da0 0x7f7b48150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:35.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4db9a700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b480b0f20 0x7f7b4814e040 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f7b38007370 tx=0x7f7b38001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:35.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b3e7fc700 1 -- 172.21.15.154:0/105421699 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38018030 con 0x7f7b480b0f20 2023-10-10T22:34:35.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b3e7fc700 1 -- 172.21.15.154:0/105421699 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3800f870 con 0x7f7b480b0f20 2023-10-10T22:34:35.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b3e7fc700 1 -- 172.21.15.154:0/105421699 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800fc30 con 0x7f7b480b0f20 2023-10-10T22:34:35.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b481518d0 con 0x7f7b480b0f20 2023-10-10T22:34:35.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.886+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b48151020 con 0x7f7b480b0f20 2023-10-10T22:34:35.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.887+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b481574c0 con 0x7f7b480b0f20 2023-10-10T22:34:35.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.888+0000 7f7b3e7fc700 1 -- 172.21.15.154:0/105421699 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b3801b070 con 0x7f7b480b0f20 2023-10-10T22:34:35.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.889+0000 7f7b3e7fc700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7b2c066f30 0x7f7b2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:35.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.889+0000 7f7b3e7fc700 1 -- 172.21.15.154:0/105421699 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5345+0+0 (secure 0 0 0) 0x7f7b38019070 con 0x7f7b480b0f20 2023-10-10T22:34:35.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.889+0000 7f7b4e39b700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7b2c066f30 0x7f7b2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:35.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.890+0000 7f7b4e39b700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7b2c066f30 0x7f7b2c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7b44007e40 tx=0x7f7b44009040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:35.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:35.893+0000 7f7b3e7fc700 1 -- 172.21.15.154:0/105421699 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b481574c0 con 0x7f7b480b0f20 2023-10-10T22:34:36.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.084+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b481574c0 con 0x7f7b480b0f20 2023-10-10T22:34:36.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.085+0000 7f7b3e7fc700 1 -- 172.21.15.154:0/105421699 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v189) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b481574c0 con 0x7f7b480b0f20 2023-10-10T22:34:36.087 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T22:34:36.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7b2c066f30 msgr2=0x7f7b2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7b2c066f30 0x7f7b2c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7b44007e40 tx=0x7f7b44009040 comp rx=0 tx=0).stop 2023-10-10T22:34:36.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b480b0f20 msgr2=0x7f7b4814e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b480b0f20 0x7f7b4814e040 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f7b38007370 tx=0x7f7b38001e50 comp rx=0 tx=0).stop 2023-10-10T22:34:36.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 shutdown_connections 2023-10-10T22:34:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7b2c066f30 0x7f7b2c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b480c18b0 0x7f7b480c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b34004da0 0x7f7b48150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 --2- 172.21.15.154:0/105421699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b480b0f20 0x7f7b4814e040 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 >> 172.21.15.154:0/105421699 conn(0x7f7b480cc1e0 msgr2=0x7f7b481537d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:36.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 shutdown_connections 2023-10-10T22:34:36.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.087+0000 7f7b4f39d700 1 -- 172.21.15.154:0/105421699 wait complete. 2023-10-10T22:34:36.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T22:34:36.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.289+0000 7fd1b0dff700 1 Processor -- start 2023-10-10T22:34:36.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.289+0000 7fd1b0dff700 1 -- start start 2023-10-10T22:34:36.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.290+0000 7fd1b0dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1ac0cbf30 0x7fd1ac0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.290+0000 7fd1b0dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1ac0b1420 0x7fd1ac0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.290+0000 7fd1b0dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0cc300 con 0x7fd1ac0ccf90 2023-10-10T22:34:36.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.290+0000 7fd1b0dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac156bf0 con 0x7fd1ac0cbf30 2023-10-10T22:34:36.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.290+0000 7fd1b0dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ae950 con 0x7fd1ac0b1420 2023-10-10T22:34:36.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.291+0000 7fd1aa59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1ac0cbf30 0x7fd1ac0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.291+0000 7fd1aa59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1ac0cbf30 0x7fd1ac0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56830/0 (socket says 172.21.15.154:56830) 2023-10-10T22:34:36.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.291+0000 7fd1aa59c700 1 -- 172.21.15.154:0/1766573866 learned_addr learned my addr 172.21.15.154:0/1766573866 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:36.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.291+0000 7fd1aad9d700 1 --2- 172.21.15.154:0/1766573866 >> v2:172.21.15.179:3300/0 conn(0x7fd1ac0b1420 0x7fd1ac0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.291+0000 7fd1aa59c700 1 -- 172.21.15.154:0/1766573866 >> v2:172.21.15.179:3300/0 conn(0x7fd1ac0b1420 msgr2=0x7fd1ac0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.291+0000 7fd1aa59c700 1 --2- 172.21.15.154:0/1766573866 >> v2:172.21.15.179:3300/0 conn(0x7fd1ac0b1420 0x7fd1ac0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.291+0000 7fd1aa59c700 1 -- 172.21.15.154:0/1766573866 >> v1:172.21.15.179:6789/0 conn(0x7fd1ac0ccf90 legacy=0x7fd1ac0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.291+0000 7fd1aa59c700 1 -- 172.21.15.154:0/1766573866 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0ad370 con 0x7fd1ac0cbf30 2023-10-10T22:34:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.291+0000 7fd1aa59c700 1 --2- 172.21.15.154:0/1766573866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0cbf30 0x7fd1ac0ae410 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b19e0 tx=0x7fd19c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702f7020b41b56c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1a959a700 1 -- 172.21.15.154:0/1766573866 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c009ea0 con 0x7fd1ac0cbf30 2023-10-10T22:34:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1a959a700 1 -- 172.21.15.154:0/1766573866 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c00b820 con 0x7fd1ac0cbf30 2023-10-10T22:34:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1a959a700 1 -- 172.21.15.154:0/1766573866 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00bbc0 con 0x7fd1ac0cbf30 2023-10-10T22:34:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1766573866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0cbf30 msgr2=0x7fd1ac0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1b0dff700 1 --2- 172.21.15.154:0/1766573866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0cbf30 0x7fd1ac0ae410 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b19e0 tx=0x7fd19c009250 comp rx=0 tx=0).stop 2023-10-10T22:34:36.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1766573866 shutdown_connections 2023-10-10T22:34:36.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1b0dff700 1 --2- 172.21.15.154:0/1766573866 >> v2:172.21.15.179:3300/0 conn(0x7fd1ac0b1420 0x7fd1ac0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1b0dff700 1 --2- 172.21.15.154:0/1766573866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0cbf30 0x7fd1ac0ae410 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1766573866 >> 172.21.15.154:0/1766573866 conn(0x7fd1ac06a320 msgr2=0x7fd1ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:36.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1766573866 shutdown_connections 2023-10-10T22:34:36.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.292+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1766573866 wait complete. 2023-10-10T22:34:36.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.294+0000 7fd1b0dff700 1 Processor -- start 2023-10-10T22:34:36.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.294+0000 7fd1b0dff700 1 -- start start 2023-10-10T22:34:36.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1b0dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0b1420 0x7fd1ac159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1b0dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ac0cbf30 0x7fd1ac146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1b0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ac0ccf90 0x7fd1ac0a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1b0dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0a96f0 con 0x7fd1ac0b1420 2023-10-10T22:34:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1b0dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac158e70 con 0x7fd1ac0cbf30 2023-10-10T22:34:36.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1b0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac159150 con 0x7fd1ac0ccf90 2023-10-10T22:34:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1aa59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0b1420 0x7fd1ac159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1aa59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0b1420 0x7fd1ac159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56844/0 (socket says 172.21.15.154:56844) 2023-10-10T22:34:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1aa59c700 1 -- 172.21.15.154:0/1383413765 learned_addr learned my addr 172.21.15.154:0/1383413765 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1aad9d700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ac0ccf90 0x7fd1ac0a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1a9d9b700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ac0cbf30 0x7fd1ac146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1aa59c700 1 -- 172.21.15.154:0/1383413765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ac0ccf90 msgr2=0x7fd1ac0a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1aa59c700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ac0ccf90 0x7fd1ac0a76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1aa59c700 1 -- 172.21.15.154:0/1383413765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ac0cbf30 msgr2=0x7fd1ac146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1aa59c700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ac0cbf30 0x7fd1ac146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1aa59c700 1 -- 172.21.15.154:0/1383413765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0094f0 con 0x7fd1ac0b1420 2023-10-10T22:34:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.295+0000 7fd1a9d9b700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ac0cbf30 0x7fd1ac146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.296+0000 7fd1aa59c700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0b1420 0x7fd1ac159da0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0094c0 tx=0x7fd19c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.296+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1383413765 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00bba0 con 0x7fd1ac0b1420 2023-10-10T22:34:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.296+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1383413765 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c011420 con 0x7fd1ac0b1420 2023-10-10T22:34:36.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.296+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1383413765 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0117e0 con 0x7fd1ac0b1420 2023-10-10T22:34:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.296+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac159430 con 0x7fd1ac0b1420 2023-10-10T22:34:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.296+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac15a2e0 con 0x7fd1ac0b1420 2023-10-10T22:34:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.297+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac0a9830 con 0x7fd1ac0b1420 2023-10-10T22:34:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.298+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1383413765 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd19c011bd0 con 0x7fd1ac0b1420 2023-10-10T22:34:36.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.299+0000 7fd19a7fc700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd18c066f30 0x7fd18c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.299+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1383413765 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5345+0+0 (secure 0 0 0) 0x7fd19c085d10 con 0x7fd1ac0b1420 2023-10-10T22:34:36.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.299+0000 7fd1a9d9b700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd18c066f30 0x7fd18c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.299+0000 7fd1a9d9b700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd18c066f30 0x7fd18c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac156560 tx=0x7fd1a0009040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:36.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.303+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1383413765 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd19c0530e0 con 0x7fd1ac0b1420 2023-10-10T22:34:36.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.497+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd1ac04c3c0 con 0x7fd1ac0b1420 2023-10-10T22:34:36.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.497+0000 7fd19a7fc700 1 -- 172.21.15.154:0/1383413765 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v189) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd19c015090 con 0x7fd1ac0b1420 2023-10-10T22:34:36.500 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:36.501 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T22:34:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:36.501 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T22:34:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T22:34:36.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:36.502 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T22:34:36.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd18c066f30 msgr2=0x7fd18c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd18c066f30 0x7fd18c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac156560 tx=0x7fd1a0009040 comp rx=0 tx=0).stop 2023-10-10T22:34:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0b1420 msgr2=0x7fd1ac159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0b1420 0x7fd1ac159da0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0094c0 tx=0x7fd19c017000 comp rx=0 tx=0).stop 2023-10-10T22:34:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 shutdown_connections 2023-10-10T22:34:36.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd18c066f30 0x7fd18c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ac0ccf90 0x7fd1ac0a76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1ac0b1420 0x7fd1ac159da0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 --2- 172.21.15.154:0/1383413765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ac0cbf30 0x7fd1ac146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 >> 172.21.15.154:0/1383413765 conn(0x7fd1ac06a320 msgr2=0x7fd1ac0c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:36.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 shutdown_connections 2023-10-10T22:34:36.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.500+0000 7fd1b0dff700 1 -- 172.21.15.154:0/1383413765 wait complete. 2023-10-10T22:34:36.519 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T22:34:36.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T22:34:36.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.705+0000 7f13b49fe700 1 Processor -- start 2023-10-10T22:34:36.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.705+0000 7f13b49fe700 1 -- start start 2023-10-10T22:34:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.706+0000 7f13b49fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0153850 0x7f13b01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.706+0000 7f13b49fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13b0159bf0 0x7f13b0157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.706+0000 7f13b49fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b015a050 con 0x7f13b0153480 2023-10-10T22:34:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.706+0000 7f13b49fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b015a480 con 0x7f13b0159bf0 2023-10-10T22:34:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.706+0000 7f13b49fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00afb40 con 0x7f13b0153850 2023-10-10T22:34:36.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.706+0000 7f13af59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13b0159bf0 0x7f13b0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.706+0000 7f13af59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13b0159bf0 0x7f13b0157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56852/0 (socket says 172.21.15.154:56852) 2023-10-10T22:34:36.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.706+0000 7f13af59e700 1 -- 172.21.15.154:0/951308706 learned_addr learned my addr 172.21.15.154:0/951308706 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:36.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.707+0000 7f13ae59c700 1 --2- 172.21.15.154:0/951308706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0153850 0x7f13b01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.707+0000 7f13af59e700 1 -- 172.21.15.154:0/951308706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0153850 msgr2=0x7f13b01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:36.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.707+0000 7f13af59e700 1 --2- 172.21.15.154:0/951308706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0153850 0x7f13b01596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.707+0000 7f13af59e700 1 -- 172.21.15.154:0/951308706 >> v1:172.21.15.179:6789/0 conn(0x7f13b0153480 legacy=0x7f13b00ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.707+0000 7f13af59e700 1 -- 172.21.15.154:0/951308706 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00afe20 con 0x7f13b0159bf0 2023-10-10T22:34:36.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.707+0000 7f13af59e700 1 --2- 172.21.15.154:0/951308706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0159bf0 0x7f13b0157280 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009f20 tx=0x7f13a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e40a379b27ae66 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:36.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.707+0000 7f13add9b700 1 -- 172.21.15.154:0/951308706 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800e070 con 0x7f13b0159bf0 2023-10-10T22:34:36.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.707+0000 7f13add9b700 1 -- 172.21.15.154:0/951308706 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a800b9d0 con 0x7f13b0159bf0 2023-10-10T22:34:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.707+0000 7f13add9b700 1 -- 172.21.15.154:0/951308706 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80092e0 con 0x7f13b0159bf0 2023-10-10T22:34:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.708+0000 7f13b49fe700 1 -- 172.21.15.154:0/951308706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0159bf0 msgr2=0x7f13b0157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.708+0000 7f13b49fe700 1 --2- 172.21.15.154:0/951308706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0159bf0 0x7f13b0157280 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009f20 tx=0x7f13a8009840 comp rx=0 tx=0).stop 2023-10-10T22:34:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.708+0000 7f13b49fe700 1 -- 172.21.15.154:0/951308706 shutdown_connections 2023-10-10T22:34:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.708+0000 7f13b49fe700 1 --2- 172.21.15.154:0/951308706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0159bf0 0x7f13b0157280 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.708+0000 7f13b49fe700 1 --2- 172.21.15.154:0/951308706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0153850 0x7f13b01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.708+0000 7f13b49fe700 1 -- 172.21.15.154:0/951308706 >> 172.21.15.154:0/951308706 conn(0x7f13b0068e20 msgr2=0x7f13b00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:36.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.708+0000 7f13b49fe700 1 -- 172.21.15.154:0/951308706 shutdown_connections 2023-10-10T22:34:36.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.708+0000 7f13b49fe700 1 -- 172.21.15.154:0/951308706 wait complete. 2023-10-10T22:34:36.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.710+0000 7f13b49fe700 1 Processor -- start 2023-10-10T22:34:36.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.710+0000 7f13b49fe700 1 -- start start 2023-10-10T22:34:36.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13b49fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0153480 0x7f13b014ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13b49fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0153850 0x7f13b01677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13b49fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0159bf0 0x7f13b006e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13b49fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b014f9c0 con 0x7f13b0153480 2023-10-10T22:34:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13b49fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b014edb0 con 0x7f13b0153850 2023-10-10T22:34:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13b49fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b014f090 con 0x7f13b0159bf0 2023-10-10T22:34:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13aed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0153480 0x7f13b014ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13aed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0153480 0x7f13b014ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56866/0 (socket says 172.21.15.154:56866) 2023-10-10T22:34:36.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13aed9d700 1 -- 172.21.15.154:0/54035129 learned_addr learned my addr 172.21.15.154:0/54035129 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:36.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13af59e700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0159bf0 0x7f13b006e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13ae59c700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0153850 0x7f13b01677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13aed9d700 1 -- 172.21.15.154:0/54035129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0159bf0 msgr2=0x7f13b006e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13aed9d700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0159bf0 0x7f13b006e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13aed9d700 1 -- 172.21.15.154:0/54035129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0153850 msgr2=0x7f13b01677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:36.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13aed9d700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0153850 0x7f13b01677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:36.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.711+0000 7f13aed9d700 1 -- 172.21.15.154:0/54035129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a8009ae0 con 0x7f13b0153480 2023-10-10T22:34:36.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.712+0000 7f13aed9d700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0153480 0x7f13b014ce90 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c590 tx=0x7f13a000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:36.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.712+0000 7f1396ffd700 1 -- 172.21.15.154:0/54035129 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0011590 con 0x7f13b0153480 2023-10-10T22:34:36.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.712+0000 7f1396ffd700 1 -- 172.21.15.154:0/54035129 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a00116f0 con 0x7f13b0153480 2023-10-10T22:34:36.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.712+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b014f370 con 0x7f13b0153480 2023-10-10T22:34:36.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.712+0000 7f1396ffd700 1 -- 172.21.15.154:0/54035129 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0011ab0 con 0x7f13b0153480 2023-10-10T22:34:36.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.712+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b014d3d0 con 0x7f13b0153480 2023-10-10T22:34:36.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.713+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b014f810 con 0x7f13b0153480 2023-10-10T22:34:36.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.714+0000 7f1396ffd700 1 -- 172.21.15.154:0/54035129 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13a001b3b0 con 0x7f13b0153480 2023-10-10T22:34:36.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.715+0000 7f1396ffd700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f139c066f30 0x7f139c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:36.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.715+0000 7f1396ffd700 1 -- 172.21.15.154:0/54035129 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5345+0+0 (secure 0 0 0) 0x7f13a00837e0 con 0x7f13b0153480 2023-10-10T22:34:36.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.715+0000 7f13ae59c700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f139c066f30 0x7f139c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:36.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.716+0000 7f13ae59c700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f139c066f30 0x7f139c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13b0153ca0 tx=0x7f13a4008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:36.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.719+0000 7f1396ffd700 1 -- 172.21.15.154:0/54035129 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13a0050bb0 con 0x7f13b0153480 2023-10-10T22:34:36.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:36.910+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f13b015a050 con 0x7f13b0153480 2023-10-10T22:34:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.326+0000 7f1396ffd700 1 -- 172.21.15.154:0/54035129 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v190) v1 ==== 138+0+0 (secure 0 0 0) 0x7f13b015a050 con 0x7f13b0153480 2023-10-10T22:34:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f139c066f30 msgr2=0x7f139c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f139c066f30 0x7f139c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13b0153ca0 tx=0x7f13a4008040 comp rx=0 tx=0).stop 2023-10-10T22:34:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0153480 msgr2=0x7f13b014ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0153480 0x7f13b014ce90 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c590 tx=0x7f13a000c950 comp rx=0 tx=0).stop 2023-10-10T22:34:37.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 shutdown_connections 2023-10-10T22:34:37.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f139c066f30 0x7f139c0693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:37.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13b0159bf0 0x7f13b006e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:37.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b0153480 0x7f13b014ce90 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:37.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 --2- 172.21.15.154:0/54035129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0153850 0x7f13b01677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:37.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 >> 172.21.15.154:0/54035129 conn(0x7f13b0068e20 msgr2=0x7f13b006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:37.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 shutdown_connections 2023-10-10T22:34:37.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.332+0000 7f13b49fe700 1 -- 172.21.15.154:0/54035129 wait complete. 2023-10-10T22:34:37.336 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T22:34:37.351 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T22:34:37.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.541+0000 7f1bdbbff700 1 Processor -- start 2023-10-10T22:34:37.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.541+0000 7f1bdbbff700 1 -- start start 2023-10-10T22:34:37.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.542+0000 7f1bdbbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd40c85c0 0x7f1bd406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:37.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.542+0000 7f1bdbbff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bd4069fa0 0x7f1bd40c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:37.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.542+0000 7f1bdbbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd4156340 con 0x7f1bd4156ee0 2023-10-10T22:34:37.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.542+0000 7f1bdbbff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd40c8990 con 0x7f1bd4069fa0 2023-10-10T22:34:37.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.542+0000 7f1bdbbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd406ee20 con 0x7f1bd40c85c0 2023-10-10T22:34:37.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.543+0000 7f1bda19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bd4069fa0 0x7f1bd40c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:37.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.543+0000 7f1bd919a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1bd4156ee0 0x7f1bd4069890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33218/0 (socket says 172.21.15.154:33218) 2023-10-10T22:34:37.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.543+0000 7f1bd919a700 1 -- 172.21.15.154:0/2784934579 learned_addr learned my addr 172.21.15.154:0/2784934579 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:37.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.543+0000 7f1bd999b700 1 --2- 172.21.15.154:0/2784934579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd40c85c0 0x7f1bd406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:37.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.543+0000 7f1bda19c700 1 -- 172.21.15.154:0/2784934579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd40c85c0 msgr2=0x7f1bd406d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:37.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.543+0000 7f1bda19c700 1 --2- 172.21.15.154:0/2784934579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd40c85c0 0x7f1bd406d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:37.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.543+0000 7f1bda19c700 1 -- 172.21.15.154:0/2784934579 >> v1:172.21.15.154:6789/0 conn(0x7f1bd4156ee0 legacy=0x7f1bd4069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:37.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.543+0000 7f1bda19c700 1 -- 172.21.15.154:0/2784934579 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd406dd80 con 0x7f1bd4069fa0 2023-10-10T22:34:37.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.543+0000 7f1bda19c700 1 --2- 172.21.15.154:0/2784934579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4069fa0 0x7f1bd40c6ae0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009e60 tx=0x7f1bcc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae992becd9d8c10 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:37.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bd8999700 1 -- 172.21.15.154:0/2784934579 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00e070 con 0x7f1bd4069fa0 2023-10-10T22:34:37.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bd8999700 1 -- 172.21.15.154:0/2784934579 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc00bb60 con 0x7f1bd4069fa0 2023-10-10T22:34:37.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bd8999700 1 -- 172.21.15.154:0/2784934579 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc012430 con 0x7f1bd4069fa0 2023-10-10T22:34:37.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bdbbff700 1 -- 172.21.15.154:0/2784934579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4069fa0 msgr2=0x7f1bd40c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bdbbff700 1 --2- 172.21.15.154:0/2784934579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4069fa0 0x7f1bd40c6ae0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009e60 tx=0x7f1bcc009780 comp rx=0 tx=0).stop 2023-10-10T22:34:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bdbbff700 1 -- 172.21.15.154:0/2784934579 shutdown_connections 2023-10-10T22:34:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bdbbff700 1 --2- 172.21.15.154:0/2784934579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4069fa0 0x7f1bd40c6ae0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bdbbff700 1 --2- 172.21.15.154:0/2784934579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd40c85c0 0x7f1bd406d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bdbbff700 1 -- 172.21.15.154:0/2784934579 >> 172.21.15.154:0/2784934579 conn(0x7f1bd40cc540 msgr2=0x7f1bd40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.544+0000 7f1bdbbff700 1 -- 172.21.15.154:0/2784934579 shutdown_connections 2023-10-10T22:34:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.545+0000 7f1bdbbff700 1 -- 172.21.15.154:0/2784934579 wait complete. 2023-10-10T22:34:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.546+0000 7f1bdbbff700 1 Processor -- start 2023-10-10T22:34:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.546+0000 7f1bdbbff700 1 -- start start 2023-10-10T22:34:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bdbbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd4069fa0 0x7f1bd41575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bdbbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bd40c85c0 0x7f1bd41426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bdbbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4156ee0 0x7f1bd4142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bdbbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4168de0 con 0x7f1bd4156ee0 2023-10-10T22:34:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bdbbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4169960 con 0x7f1bd40c85c0 2023-10-10T22:34:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bdbbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40c4970 con 0x7f1bd4069fa0 2023-10-10T22:34:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bda19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4156ee0 0x7f1bd4142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:37.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bda19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4156ee0 0x7f1bd4142c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56886/0 (socket says 172.21.15.154:56886) 2023-10-10T22:34:37.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bda19c700 1 -- 172.21.15.154:0/1648621183 learned_addr learned my addr 172.21.15.154:0/1648621183 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:37.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bd919a700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bd40c85c0 0x7f1bd41426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:37.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.547+0000 7f1bd999b700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd4069fa0 0x7f1bd41575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:37.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bda19c700 1 -- 172.21.15.154:0/1648621183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd4069fa0 msgr2=0x7f1bd41575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bda19c700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd4069fa0 0x7f1bd41575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bda19c700 1 -- 172.21.15.154:0/1648621183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bd40c85c0 msgr2=0x7f1bd41426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bda19c700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bd40c85c0 0x7f1bd41426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bda19c700 1 -- 172.21.15.154:0/1648621183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc009a20 con 0x7f1bd4156ee0 2023-10-10T22:34:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bda19c700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4156ee0 0x7f1bd4142c30 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f1bd406bc30 tx=0x7f1bcc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bc9ffb700 1 -- 172.21.15.154:0/1648621183 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc027470 con 0x7f1bd4156ee0 2023-10-10T22:34:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bc9ffb700 1 -- 172.21.15.154:0/1648621183 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0275f0 con 0x7f1bd4156ee0 2023-10-10T22:34:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd4169030 con 0x7f1bd4156ee0 2023-10-10T22:34:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bc9ffb700 1 -- 172.21.15.154:0/1648621183 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0279b0 con 0x7f1bd4156ee0 2023-10-10T22:34:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.548+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd4169670 con 0x7f1bd4156ee0 2023-10-10T22:34:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.549+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd41431d0 con 0x7f1bd4156ee0 2023-10-10T22:34:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.550+0000 7f1bc9ffb700 1 -- 172.21.15.154:0/1648621183 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bcc024070 con 0x7f1bd4156ee0 2023-10-10T22:34:37.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.551+0000 7f1bc9ffb700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1bb8066f30 0x7f1bb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:37.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.551+0000 7f1bc9ffb700 1 -- 172.21.15.154:0/1648621183 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5715+0+0 (secure 0 0 0) 0x7f1bcc086ff0 con 0x7f1bd4156ee0 2023-10-10T22:34:37.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.551+0000 7f1bd999b700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1bb8066f30 0x7f1bb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:37.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.552+0000 7f1bd999b700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1bb8066f30 0x7f1bb80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009d40 tx=0x7f1bd0008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:37.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.556+0000 7f1bc9ffb700 1 -- 172.21.15.154:0/1648621183 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bcc0b85a0 con 0x7f1bd4156ee0 2023-10-10T22:34:37.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:37.747+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1bd40718b0 con 0x7f1bd4156ee0 2023-10-10T22:34:38.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.326+0000 7f1bc9ffb700 1 -- 172.21.15.154:0/1648621183 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v191) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1bcc0541d0 con 0x7f1bd4156ee0 2023-10-10T22:34:38.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.333+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1bb8066f30 msgr2=0x7f1bb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:38.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.334+0000 7f1bdbbff700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1bb8066f30 0x7f1bb80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009d40 tx=0x7f1bd0008040 comp rx=0 tx=0).stop 2023-10-10T22:34:38.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.334+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4156ee0 msgr2=0x7f1bd4142c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:38.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.334+0000 7f1bdbbff700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4156ee0 0x7f1bd4142c30 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f1bd406bc30 tx=0x7f1bcc019000 comp rx=0 tx=0).stop 2023-10-10T22:34:38.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.335+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 shutdown_connections 2023-10-10T22:34:38.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.335+0000 7f1bdbbff700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1bb8066f30 0x7f1bb80693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:38.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.335+0000 7f1bdbbff700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bd4156ee0 0x7f1bd4142c30 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:38.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.335+0000 7f1bdbbff700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bd4069fa0 0x7f1bd41575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:38.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.335+0000 7f1bdbbff700 1 --2- 172.21.15.154:0/1648621183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bd40c85c0 0x7f1bd41426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:38.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.336+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 >> 172.21.15.154:0/1648621183 conn(0x7f1bd40cc540 msgr2=0x7f1bd40cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:38.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.336+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 shutdown_connections 2023-10-10T22:34:38.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.338+0000 7f1bdbbff700 1 -- 172.21.15.154:0/1648621183 wait complete. 2023-10-10T22:34:38.344 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T22:34:38.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T22:34:38.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.550+0000 7f82dfdff700 1 Processor -- start 2023-10-10T22:34:38.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.550+0000 7f82dfdff700 1 -- start start 2023-10-10T22:34:38.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82dfdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82d80aca80 0x7f82d806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:38.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82dfdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82d80c83c0 0x7f82d80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:38.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82dfdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d806bdb0 con 0x7f82d8069d60 2023-10-10T22:34:38.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82dfdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d80cb370 con 0x7f82d80c83c0 2023-10-10T22:34:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82dfdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d8159f60 con 0x7f82d80aca80 2023-10-10T22:34:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82de39c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82d80c83c0 0x7f82d80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82de39c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82d80c83c0 0x7f82d80cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56902/0 (socket says 172.21.15.154:56902) 2023-10-10T22:34:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82de39c700 1 -- 172.21.15.154:0/3145706714 learned_addr learned my addr 172.21.15.154:0/3145706714 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82ddb9b700 1 --2- 172.21.15.154:0/3145706714 >> v2:172.21.15.179:3300/0 conn(0x7f82d80aca80 0x7f82d806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:38.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82de39c700 1 -- 172.21.15.154:0/3145706714 >> v2:172.21.15.179:3300/0 conn(0x7f82d80aca80 msgr2=0x7f82d806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:38.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.552+0000 7f82de39c700 1 --2- 172.21.15.154:0/3145706714 >> v2:172.21.15.179:3300/0 conn(0x7f82d80aca80 0x7f82d806aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:38.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.553+0000 7f82de39c700 1 -- 172.21.15.154:0/3145706714 >> v1:172.21.15.179:6789/0 conn(0x7f82d8069d60 legacy=0x7f82d80c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:38.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.553+0000 7f82de39c700 1 -- 172.21.15.154:0/3145706714 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d806b510 con 0x7f82d80c83c0 2023-10-10T22:34:38.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.553+0000 7f82de39c700 1 --2- 172.21.15.154:0/3145706714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d80c83c0 0x7f82d80cb800 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f82d806e570 tx=0x7f82d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bdf0b3fb171bc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.553+0000 7f82dcb99700 1 -- 172.21.15.154:0/3145706714 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000e070 con 0x7f82d80c83c0 2023-10-10T22:34:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.553+0000 7f82dcb99700 1 -- 172.21.15.154:0/3145706714 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d000ba50 con 0x7f82d80c83c0 2023-10-10T22:34:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.553+0000 7f82dcb99700 1 -- 172.21.15.154:0/3145706714 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00092e0 con 0x7f82d80c83c0 2023-10-10T22:34:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.554+0000 7f82dfdff700 1 -- 172.21.15.154:0/3145706714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d80c83c0 msgr2=0x7f82d80cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.554+0000 7f82dfdff700 1 --2- 172.21.15.154:0/3145706714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d80c83c0 0x7f82d80cb800 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f82d806e570 tx=0x7f82d0009840 comp rx=0 tx=0).stop 2023-10-10T22:34:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.554+0000 7f82dfdff700 1 -- 172.21.15.154:0/3145706714 shutdown_connections 2023-10-10T22:34:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.554+0000 7f82dfdff700 1 --2- 172.21.15.154:0/3145706714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d80c83c0 0x7f82d80cb800 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.554+0000 7f82dfdff700 1 --2- 172.21.15.154:0/3145706714 >> v2:172.21.15.179:3300/0 conn(0x7f82d80aca80 0x7f82d806aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.554+0000 7f82dfdff700 1 -- 172.21.15.154:0/3145706714 >> 172.21.15.154:0/3145706714 conn(0x7f82d80cd670 msgr2=0x7f82d80cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.554+0000 7f82dfdff700 1 -- 172.21.15.154:0/3145706714 shutdown_connections 2023-10-10T22:34:38.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.554+0000 7f82dfdff700 1 -- 172.21.15.154:0/3145706714 wait complete. 2023-10-10T22:34:38.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.555+0000 7f82dfdff700 1 Processor -- start 2023-10-10T22:34:38.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.555+0000 7f82dfdff700 1 -- start start 2023-10-10T22:34:38.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.556+0000 7f82dfdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d8069d60 0x7f82d815ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:38.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.556+0000 7f82dfdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d80aca80 0x7f82d80b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:38.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.556+0000 7f82dfdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d80c83c0 0x7f82d8157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:38.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.556+0000 7f82dfdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80af5e0 con 0x7f82d8069d60 2023-10-10T22:34:38.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.556+0000 7f82dfdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80aed20 con 0x7f82d80aca80 2023-10-10T22:34:38.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.556+0000 7f82dfdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d81605d0 con 0x7f82d80c83c0 2023-10-10T22:34:38.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.556+0000 7f82ddb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d8069d60 0x7f82d815ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82ddb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d8069d60 0x7f82d815ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56908/0 (socket says 172.21.15.154:56908) 2023-10-10T22:34:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82ddb9b700 1 -- 172.21.15.154:0/1876496951 learned_addr learned my addr 172.21.15.154:0/1876496951 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82dd39a700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d80aca80 0x7f82d80b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82de39c700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d80c83c0 0x7f82d8157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82ddb9b700 1 -- 172.21.15.154:0/1876496951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d80c83c0 msgr2=0x7f82d8157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82ddb9b700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d80c83c0 0x7f82d8157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82ddb9b700 1 -- 172.21.15.154:0/1876496951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d80aca80 msgr2=0x7f82d80b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82ddb9b700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d80aca80 0x7f82d80b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82ddb9b700 1 -- 172.21.15.154:0/1876496951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0009ae0 con 0x7f82d8069d60 2023-10-10T22:34:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82de39c700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d80c83c0 0x7f82d8157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82ddb9b700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d8069d60 0x7f82d815ff30 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f82d400d8c0 tx=0x7f82d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82cdffb700 1 -- 172.21.15.154:0/1876496951 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4018070 con 0x7f82d8069d60 2023-10-10T22:34:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82cdffb700 1 -- 172.21.15.154:0/1876496951 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4005a00 con 0x7f82d8069d60 2023-10-10T22:34:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d80aef90 con 0x7f82d8069d60 2023-10-10T22:34:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.557+0000 7f82cdffb700 1 -- 172.21.15.154:0/1876496951 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4005dc0 con 0x7f82d8069d60 2023-10-10T22:34:38.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.558+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d80b3420 con 0x7f82d8069d60 2023-10-10T22:34:38.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.558+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d804c3c0 con 0x7f82d8069d60 2023-10-10T22:34:38.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.560+0000 7f82cdffb700 1 -- 172.21.15.154:0/1876496951 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82d4012800 con 0x7f82d8069d60 2023-10-10T22:34:38.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.561+0000 7f82cdffb700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f82bc066f30 0x7f82bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:38.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.561+0000 7f82cdffb700 1 -- 172.21.15.154:0/1876496951 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f82d40852d0 con 0x7f82d8069d60 2023-10-10T22:34:38.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.561+0000 7f82dd39a700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f82bc066f30 0x7f82bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:38.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.562+0000 7f82dd39a700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f82bc066f30 0x7f82bc0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82d80b1d30 tx=0x7f82c8007ec0 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:38.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.565+0000 7f82cdffb700 1 -- 172.21.15.154:0/1876496951 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82d4052430 con 0x7f82d8069d60 2023-10-10T22:34:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:38.798+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f82d806b7f0 con 0x7f82d8069d60 2023-10-10T22:34:39.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.349+0000 7f82cdffb700 1 -- 172.21.15.154:0/1876496951 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v82) v1 ==== 174+0+0 (secure 0 0 0) 0x7f82d4055a50 con 0x7f82d8069d60 2023-10-10T22:34:39.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.356+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f82bc066f30 msgr2=0x7f82bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.356+0000 7f82dfdff700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f82bc066f30 0x7f82bc0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82d80b1d30 tx=0x7f82c8007ec0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.356+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d8069d60 msgr2=0x7f82d815ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.356+0000 7f82dfdff700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d8069d60 0x7f82d815ff30 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f82d400d8c0 tx=0x7f82d4008040 comp rx=0 tx=0).stop 2023-10-10T22:34:39.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.357+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 shutdown_connections 2023-10-10T22:34:39.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.357+0000 7f82dfdff700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f82bc066f30 0x7f82bc0693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.357+0000 7f82dfdff700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d80c83c0 0x7f82d8157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.357+0000 7f82dfdff700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d8069d60 0x7f82d815ff30 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.357+0000 7f82dfdff700 1 --2- 172.21.15.154:0/1876496951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d80aca80 0x7f82d80b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.357+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 >> 172.21.15.154:0/1876496951 conn(0x7f82d80cd670 msgr2=0x7f82d80c3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.360+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 shutdown_connections 2023-10-10T22:34:39.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.361+0000 7f82dfdff700 1 -- 172.21.15.154:0/1876496951 wait complete. 2023-10-10T22:34:39.365 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 22 and data pool 23 2023-10-10T22:34:39.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:34:39.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.565+0000 7f87f13ff700 1 Processor -- start 2023-10-10T22:34:39.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.565+0000 7f87f13ff700 1 -- start start 2023-10-10T22:34:39.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.567+0000 7f87f13ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87ec0b0300 0x7f87ec0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.567+0000 7f87f13ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec0b0c80 con 0x7f87ec0cd010 2023-10-10T22:34:39.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.567+0000 7f87f13ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec0ad930 con 0x7f87ec0ccc40 2023-10-10T22:34:39.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.567+0000 7f87f13ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec0acd20 con 0x7f87ec0b0300 2023-10-10T22:34:39.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.567+0000 7f87e3fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f87ec0cd010 0x7f87ec0ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33232/0 (socket says 172.21.15.154:33232) 2023-10-10T22:34:39.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.567+0000 7f87e3fff700 1 -- 172.21.15.154:0/1638161200 learned_addr learned my addr 172.21.15.154:0/1638161200 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:39.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.567+0000 7f87eb7fe700 1 --2- 172.21.15.154:0/1638161200 >> v2:172.21.15.179:3300/0 conn(0x7f87ec0b0300 0x7f87ec0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.567+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386499728 0 0) 0x7f87ec0b0c80 con 0x7f87ec0cd010 2023-10-10T22:34:39.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.567+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87d8003570 con 0x7f87ec0cd010 2023-10-10T22:34:39.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604315354 0 0) 0x7f87d8003570 con 0x7f87ec0cd010 2023-10-10T22:34:39.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 >> v2:172.21.15.179:3300/0 conn(0x7f87ec0b0300 msgr2=0x7f87ec0b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:39.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 --2- 172.21.15.154:0/1638161200 >> v2:172.21.15.179:3300/0 conn(0x7f87ec0b0300 0x7f87ec0b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 >> v1:172.21.15.179:6789/0 conn(0x7f87ec0ccc40 legacy=0x7f87ec155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0ad000 con 0x7f87ec0cd010 2023-10-10T22:34:39.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f87d4001470 con 0x7f87ec0cd010 2023-10-10T22:34:39.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 >> v1:172.21.15.154:6789/0 conn(0x7f87ec0cd010 legacy=0x7f87ec0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8003a60 0x7f87d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87d8004810 0x7f87d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d80051c0 0x7f87d800dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0acd20 con 0x7f87d8003a60 2023-10-10T22:34:39.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d800e2e0 con 0x7f87d80051c0 2023-10-10T22:34:39.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d800e4a0 con 0x7f87d8004810 2023-10-10T22:34:39.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87eaffd700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8003a60 0x7f87d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87eb7fe700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d80051c0 0x7f87d800dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87e3fff700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87d8004810 0x7f87d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87eaffd700 1 -- 172.21.15.154:0/1638161200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87d8004810 msgr2=0x7f87d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:39.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87eaffd700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87d8004810 0x7f87d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87eaffd700 1 -- 172.21.15.154:0/1638161200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d80051c0 msgr2=0x7f87d800dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:39.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87eaffd700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d80051c0 0x7f87d800dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87eaffd700 1 -- 172.21.15.154:0/1638161200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d8003570 con 0x7f87d8003a60 2023-10-10T22:34:39.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.568+0000 7f87eb7fe700 1 -- 172.21.15.154:0/1638161200 reap_dead start 2023-10-10T22:34:39.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.569+0000 7f87eaffd700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8003a60 0x7f87d8003e70 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0018b0 tx=0x7f87dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edd9edcb45c18bb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:39.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.569+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc012420 con 0x7f87d8003a60 2023-10-10T22:34:39.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.569+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc0125a0 con 0x7f87d8003a60 2023-10-10T22:34:39.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.569+0000 7f87ea7fc700 1 -- 172.21.15.154:0/1638161200 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc012960 con 0x7f87d8003a60 2023-10-10T22:34:39.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.569+0000 7f87f13ff700 1 -- 172.21.15.154:0/1638161200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8003a60 msgr2=0x7f87d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.569+0000 7f87f13ff700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8003a60 0x7f87d8003e70 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0018b0 tx=0x7f87dc007d30 comp rx=0 tx=0).stop 2023-10-10T22:34:39.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.570+0000 7f87f13ff700 1 -- 172.21.15.154:0/1638161200 shutdown_connections 2023-10-10T22:34:39.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.570+0000 7f87f13ff700 1 --2- 172.21.15.154:0/1638161200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d8003a60 0x7f87d8003e70 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.570+0000 7f87f13ff700 1 -- 172.21.15.154:0/1638161200 >> 172.21.15.154:0/1638161200 conn(0x7f87ec06a320 msgr2=0x7f87ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:39.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.570+0000 7f87f13ff700 1 -- 172.21.15.154:0/1638161200 shutdown_connections 2023-10-10T22:34:39.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.570+0000 7f87f13ff700 1 -- 172.21.15.154:0/1638161200 wait complete. 2023-10-10T22:34:39.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.571+0000 7f87f13ff700 1 Processor -- start 2023-10-10T22:34:39.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.571+0000 7f87f13ff700 1 -- start start 2023-10-10T22:34:39.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87f13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87d8003a60 0x7f87ec0a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87f13ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0aae80 0x7f87ec1656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87f13ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec165c00 0x7f87ec166080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87f13ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0c8390 con 0x7f87ec0aae80 2023-10-10T22:34:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87f13ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1665c0 con 0x7f87ec165c00 2023-10-10T22:34:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87f13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0a8f30 con 0x7f87d8003a60 2023-10-10T22:34:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87e3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0aae80 0x7f87ec1656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87e3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0aae80 0x7f87ec1656c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56924/0 (socket says 172.21.15.154:56924) 2023-10-10T22:34:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87e3fff700 1 -- 172.21.15.154:0/2290476645 learned_addr learned my addr 172.21.15.154:0/2290476645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87eaffd700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87d8003a60 0x7f87ec0a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.572+0000 7f87eb7fe700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec165c00 0x7f87ec166080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87e3fff700 1 -- 172.21.15.154:0/2290476645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87d8003a60 msgr2=0x7f87ec0a8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87e3fff700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87d8003a60 0x7f87ec0a8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87e3fff700 1 -- 172.21.15.154:0/2290476645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec165c00 msgr2=0x7f87ec166080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87e3fff700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec165c00 0x7f87ec166080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87e3fff700 1 -- 172.21.15.154:0/2290476645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0a9210 con 0x7f87ec0aae80 2023-10-10T22:34:39.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87eb7fe700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec165c00 0x7f87ec166080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:39.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87e3fff700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0aae80 0x7f87ec1656c0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f87d400ebc0 tx=0x7f87d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:39.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87e2ffd700 1 -- 172.21.15.154:0/2290476645 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4001d40 con 0x7f87ec0aae80 2023-10-10T22:34:39.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87e2ffd700 1 -- 172.21.15.154:0/2290476645 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400c760 con 0x7f87ec0aae80 2023-10-10T22:34:39.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87e2ffd700 1 -- 172.21.15.154:0/2290476645 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400cb20 con 0x7f87ec0aae80 2023-10-10T22:34:39.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec0a94f0 con 0x7f87ec0aae80 2023-10-10T22:34:39.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.573+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec0a8b70 con 0x7f87ec0aae80 2023-10-10T22:34:39.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.574+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec0a54c0 con 0x7f87ec0aae80 2023-10-10T22:34:39.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.575+0000 7f87e2ffd700 1 -- 172.21.15.154:0/2290476645 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87d401d460 con 0x7f87ec0aae80 2023-10-10T22:34:39.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.576+0000 7f87e2ffd700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f87cc066fb0 0x7f87cc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.576+0000 7f87e2ffd700 1 -- 172.21.15.154:0/2290476645 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f87d40846d0 con 0x7f87ec0aae80 2023-10-10T22:34:39.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.576+0000 7f87eaffd700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f87cc066fb0 0x7f87cc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.577+0000 7f87eaffd700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f87cc066fb0 0x7f87cc069460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f87dc001010 tx=0x7f87dc015000 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:39.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.580+0000 7f87e2ffd700 1 -- 172.21.15.154:0/2290476645 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87ec0a54c0 con 0x7f87ec0aae80 2023-10-10T22:34:39.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.772+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87ec0a58a0 con 0x7f87ec0aae80 2023-10-10T22:34:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.773+0000 7f87e2ffd700 1 -- 172.21.15.154:0/2290476645 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+16182 (secure 0 0 0) 0x7f87ec0a58a0 con 0x7f87ec0aae80 2023-10-10T22:34:39.775 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:39.775 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":192,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:34:38.799577+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:34:36.953199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-10T22:34:37.789582+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:34:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f87cc066fb0 msgr2=0x7f87cc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f87cc066fb0 0x7f87cc069460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f87dc001010 tx=0x7f87dc015000 comp rx=0 tx=0).stop 2023-10-10T22:34:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0aae80 msgr2=0x7f87ec1656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0aae80 0x7f87ec1656c0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f87d400ebc0 tx=0x7f87d4000bc0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 shutdown_connections 2023-10-10T22:34:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f87cc066fb0 0x7f87cc069460 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87ec165c00 0x7f87ec166080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87d8003a60 0x7f87ec0a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 --2- 172.21.15.154:0/2290476645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87ec0aae80 0x7f87ec1656c0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 >> 172.21.15.154:0/2290476645 conn(0x7f87ec06a320 msgr2=0x7f87ec06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:39.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 shutdown_connections 2023-10-10T22:34:39.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.776+0000 7f87f13ff700 1 -- 172.21.15.154:0/2290476645 wait complete. 2023-10-10T22:34:39.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:34:39.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.976+0000 7f52641ff700 1 Processor -- start 2023-10-10T22:34:39.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.976+0000 7f52641ff700 1 -- start start 2023-10-10T22:34:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f52641ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f525c0b1420 0x7f525c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f52641ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f52641ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525c0cc300 con 0x7f525c0cbf30 2023-10-10T22:34:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f52641ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525c156bf0 con 0x7f525c0b1420 2023-10-10T22:34:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f52641ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0ae950 con 0x7f525c0ccf90 2023-10-10T22:34:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f526179a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f525c0b1420 0x7f525c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f5261f9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f525c0cbf30 0x7f525c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33236/0 (socket says 172.21.15.154:33236) 2023-10-10T22:34:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f5261f9b700 1 -- 172.21.15.154:0/3905675010 learned_addr learned my addr 172.21.15.154:0/3905675010 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:39.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f526179a700 1 -- 172.21.15.154:0/3905675010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 msgr2=0x7f525c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:39.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f526279c700 1 --2- 172.21.15.154:0/3905675010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f5260f99700 1 -- 172.21.15.154:0/3905675010 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290541365 0 0) 0x7f525c0cc300 con 0x7f525c0cbf30 2023-10-10T22:34:39.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f526179a700 1 --2- 172.21.15.154:0/3905675010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f526179a700 1 -- 172.21.15.154:0/3905675010 >> v1:172.21.15.154:6789/0 conn(0x7f525c0cbf30 legacy=0x7f525c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f526179a700 1 -- 172.21.15.154:0/3905675010 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c0ad370 con 0x7f525c0b1420 2023-10-10T22:34:39.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.978+0000 7f526279c700 1 --2- 172.21.15.154:0/3905675010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:39.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.979+0000 7f526179a700 1 --2- 172.21.15.154:0/3905675010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0b1420 0x7f525c0ae410 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f524c009910 tx=0x7f524c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4234bb002045ed server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:39.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.979+0000 7f5260f99700 1 -- 172.21.15.154:0/3905675010 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c00b820 con 0x7f525c0b1420 2023-10-10T22:34:39.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.979+0000 7f5260f99700 1 -- 172.21.15.154:0/3905675010 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c00b980 con 0x7f525c0b1420 2023-10-10T22:34:39.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.979+0000 7f5260f99700 1 -- 172.21.15.154:0/3905675010 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c00bd20 con 0x7f525c0b1420 2023-10-10T22:34:39.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.979+0000 7f52641ff700 1 -- 172.21.15.154:0/3905675010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0b1420 msgr2=0x7f525c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.979+0000 7f52641ff700 1 --2- 172.21.15.154:0/3905675010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0b1420 0x7f525c0ae410 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f524c009910 tx=0x7f524c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.980+0000 7f52641ff700 1 -- 172.21.15.154:0/3905675010 shutdown_connections 2023-10-10T22:34:39.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.980+0000 7f52641ff700 1 --2- 172.21.15.154:0/3905675010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.980+0000 7f52641ff700 1 --2- 172.21.15.154:0/3905675010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0b1420 0x7f525c0ae410 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.980+0000 7f52641ff700 1 -- 172.21.15.154:0/3905675010 >> 172.21.15.154:0/3905675010 conn(0x7f525c06a320 msgr2=0x7f525c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:39.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.980+0000 7f52641ff700 1 -- 172.21.15.154:0/3905675010 shutdown_connections 2023-10-10T22:34:39.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.980+0000 7f52641ff700 1 -- 172.21.15.154:0/3905675010 wait complete. 2023-10-10T22:34:39.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.981+0000 7f52641ff700 1 Processor -- start 2023-10-10T22:34:39.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.981+0000 7f52641ff700 1 -- start start 2023-10-10T22:34:39.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.982+0000 7f52641ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525c0b1420 0x7f525c16dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.982+0000 7f52641ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0cbf30 0x7f525c06e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.982+0000 7f52641ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.982+0000 7f52641ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c16e120 con 0x7f525c0cbf30 2023-10-10T22:34:39.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.982+0000 7f52641ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0c12d0 con 0x7f525c0b1420 2023-10-10T22:34:39.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.982+0000 7f52641ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0c1590 con 0x7f525c0ccf90 2023-10-10T22:34:39.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.982+0000 7f526179a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0cbf30 0x7f525c06e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.982+0000 7f526179a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0cbf30 0x7f525c06e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56954/0 (socket says 172.21.15.154:56954) 2023-10-10T22:34:39.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.982+0000 7f526179a700 1 -- 172.21.15.154:0/3788346699 learned_addr learned my addr 172.21.15.154:0/3788346699 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:39.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f526279c700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f5261f9b700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525c0b1420 0x7f525c16dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f526179a700 1 -- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 msgr2=0x7f525c06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f526179a700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f526179a700 1 -- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525c0b1420 msgr2=0x7f525c16dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:39.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f526179a700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525c0b1420 0x7f525c16dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:39.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f526179a700 1 -- 172.21.15.154:0/3788346699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c009420 con 0x7f525c0cbf30 2023-10-10T22:34:39.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f5261f9b700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525c0b1420 0x7f525c16dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:39.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f526279c700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:39.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f526179a700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0cbf30 0x7f525c06e860 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f525c064290 tx=0x7f524c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:39.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f5251ffb700 1 -- 172.21.15.154:0/3788346699 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c024440 con 0x7f525c0cbf30 2023-10-10T22:34:39.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f5251ffb700 1 -- 172.21.15.154:0/3788346699 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c0245e0 con 0x7f525c0cbf30 2023-10-10T22:34:39.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c0c1870 con 0x7f525c0cbf30 2023-10-10T22:34:39.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f5251ffb700 1 -- 172.21.15.154:0/3788346699 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c0249a0 con 0x7f525c0cbf30 2023-10-10T22:34:39.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.983+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c0c1e30 con 0x7f525c0cbf30 2023-10-10T22:34:39.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.984+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c04c3c0 con 0x7f525c0cbf30 2023-10-10T22:34:39.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.985+0000 7f5251ffb700 1 -- 172.21.15.154:0/3788346699 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f524c024d50 con 0x7f525c0cbf30 2023-10-10T22:34:39.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.986+0000 7f5251ffb700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5240066f30 0x7f52400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.986+0000 7f5251ffb700 1 -- 172.21.15.154:0/3788346699 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f524c086400 con 0x7f525c0cbf30 2023-10-10T22:34:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.986+0000 7f5261f9b700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5240066f30 0x7f52400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.987+0000 7f5261f9b700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5240066f30 0x7f52400693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f52580018d0 tx=0x7f5258009040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:39.990+0000 7f5251ffb700 1 -- 172.21.15.154:0/3788346699 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f524c053480 con 0x7f525c0cbf30 2023-10-10T22:34:40.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.183+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f525c0ad650 con 0x7f525c0cbf30 2023-10-10T22:34:40.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.184+0000 7f5251ffb700 1 -- 172.21.15.154:0/3788346699 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+16182 (secure 0 0 0) 0x7f524c02b340 con 0x7f525c0cbf30 2023-10-10T22:34:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:40.186 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":192,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:34:38.799577+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:34:36.953199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-10T22:34:37.789582+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:34:40.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.186+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5240066f30 msgr2=0x7f52400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:40.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.186+0000 7f52641ff700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5240066f30 0x7f52400693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f52580018d0 tx=0x7f5258009040 comp rx=0 tx=0).stop 2023-10-10T22:34:40.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.186+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0cbf30 msgr2=0x7f525c06e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:40.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.186+0000 7f52641ff700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0cbf30 0x7f525c06e860 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f525c064290 tx=0x7f524c017000 comp rx=0 tx=0).stop 2023-10-10T22:34:40.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.186+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 shutdown_connections 2023-10-10T22:34:40.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.186+0000 7f52641ff700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5240066f30 0x7f52400693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:40.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.186+0000 7f52641ff700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f525c0ccf90 0x7f525c06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:40.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.186+0000 7f52641ff700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525c0b1420 0x7f525c16dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:40.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.186+0000 7f52641ff700 1 --2- 172.21.15.154:0/3788346699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0cbf30 0x7f525c06e860 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:40.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.187+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 >> 172.21.15.154:0/3788346699 conn(0x7f525c06a320 msgr2=0x7f525c0c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:40.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.187+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 shutdown_connections 2023-10-10T22:34:40.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.187+0000 7f52641ff700 1 -- 172.21.15.154:0/3788346699 wait complete. 2023-10-10T22:34:40.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T22:34:40.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.394+0000 7f48c0d9d700 1 Processor -- start 2023-10-10T22:34:40.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.394+0000 7f48c0d9d700 1 -- start start 2023-10-10T22:34:40.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.395+0000 7f48c0d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc069770 0x7f48bc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:40.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.395+0000 7f48c0d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc06e150 con 0x7f48bc0c9db0 2023-10-10T22:34:40.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.395+0000 7f48c0d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0c7800 con 0x7f48bc157130 2023-10-10T22:34:40.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.395+0000 7f48c0d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0c7610 con 0x7f48bc069770 2023-10-10T22:34:40.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48bb7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f48bc0c9db0 0x7f48bc153900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33240/0 (socket says 172.21.15.154:33240) 2023-10-10T22:34:40.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48bb7fe700 1 -- 172.21.15.154:0/1880220353 learned_addr learned my addr 172.21.15.154:0/1880220353 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:40.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165272426 0 0) 0x7f48bc06e150 con 0x7f48bc0c9db0 2023-10-10T22:34:40.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a4003570 con 0x7f48bc0c9db0 2023-10-10T22:34:40.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48bbfff700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc069770 0x7f48bc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:40.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4177416571 0 0) 0x7f48a4003570 con 0x7f48bc0c9db0 2023-10-10T22:34:40.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc069770 msgr2=0x7f48bc069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:40.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc069770 0x7f48bc069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:40.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 >> v1:172.21.15.179:6789/0 conn(0x7f48bc157130 legacy=0x7f48bc0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:40.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0c7ae0 con 0x7f48bc0c9db0 2023-10-10T22:34:40.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f48ac001470 con 0x7f48bc0c9db0 2023-10-10T22:34:40.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 >> v1:172.21.15.154:6789/0 conn(0x7f48bc0c9db0 legacy=0x7f48bc153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:40.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a4003a90 0x7f48a4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:40.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48a4004810 0x7f48a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:40.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc069770 0x7f48a4005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:40.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a400bc20 con 0x7f48a4003a90 2023-10-10T22:34:40.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a400bd90 con 0x7f48a4004810 2023-10-10T22:34:40.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.396+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a400bf50 con 0x7f48bc069770 2023-10-10T22:34:40.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.397+0000 7f48bb7fe700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a4003a90 0x7f48a4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:40.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.397+0000 7f48bbfff700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc069770 0x7f48a4005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:40.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.397+0000 7f48baffd700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48a4004810 0x7f48a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.397+0000 7f48bb7fe700 1 -- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc069770 msgr2=0x7f48a4005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.397+0000 7f48bb7fe700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc069770 0x7f48a4005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.397+0000 7f48bb7fe700 1 -- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48a4004810 msgr2=0x7f48a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.397+0000 7f48bb7fe700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48a4004810 0x7f48a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.397+0000 7f48bb7fe700 1 -- 172.21.15.154:0/1880220353 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4003570 con 0x7f48a4003a90 2023-10-10T22:34:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.397+0000 7f48bb7fe700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a4003a90 0x7f48a4003ea0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007cc0 tx=0x7f48ac001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39265acb258d1f3f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00cc30 con 0x7f48a4003a90 2023-10-10T22:34:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00cd90 con 0x7f48a4003a90 2023-10-10T22:34:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48ba7fc700 1 -- 172.21.15.154:0/1880220353 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac005b50 con 0x7f48a4003a90 2023-10-10T22:34:40.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48c0d9d700 1 -- 172.21.15.154:0/1880220353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a4003a90 msgr2=0x7f48a4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:40.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48c0d9d700 1 --2- 172.21.15.154:0/1880220353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a4003a90 0x7f48a4003ea0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007cc0 tx=0x7f48ac001e50 comp rx=0 tx=0).stop 2023-10-10T22:34:40.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48bbfff700 1 -- 172.21.15.154:0/1880220353 reap_dead start 2023-10-10T22:34:40.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48c0d9d700 1 -- 172.21.15.154:0/1880220353 shutdown_connections 2023-10-10T22:34:40.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48c0d9d700 1 -- 172.21.15.154:0/1880220353 >> 172.21.15.154:0/1880220353 conn(0x7f48bc0cc1e0 msgr2=0x7f48bc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:40.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48c0d9d700 1 -- 172.21.15.154:0/1880220353 shutdown_connections 2023-10-10T22:34:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.398+0000 7f48c0d9d700 1 -- 172.21.15.154:0/1880220353 wait complete. 2023-10-10T22:34:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.400+0000 7f48c0d9d700 1 Processor -- start 2023-10-10T22:34:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.400+0000 7f48c0d9d700 1 -- start start 2023-10-10T22:34:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48c0d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48a4003a90 0x7f48bc1694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48c0d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48bc0aa290 0x7f48bc1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48c0d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc157b20 0x7f48bc0abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48c0d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0afa50 con 0x7f48bc0aa290 2023-10-10T22:34:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48c0d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1518c0 con 0x7f48a4003a90 2023-10-10T22:34:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48c0d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc157f90 con 0x7f48bc157b20 2023-10-10T22:34:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48baffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48bc0aa290 0x7f48bc1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48baffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48bc0aa290 0x7f48bc1575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56964/0 (socket says 172.21.15.154:56964) 2023-10-10T22:34:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48baffd700 1 -- 172.21.15.154:0/2298174482 learned_addr learned my addr 172.21.15.154:0/2298174482 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48bbfff700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc157b20 0x7f48bc0abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48bb7fe700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48a4003a90 0x7f48bc1694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48baffd700 1 -- 172.21.15.154:0/2298174482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc157b20 msgr2=0x7f48bc0abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48baffd700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc157b20 0x7f48bc0abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48baffd700 1 -- 172.21.15.154:0/2298174482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48a4003a90 msgr2=0x7f48bc1694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48baffd700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48a4003a90 0x7f48bc1694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.401+0000 7f48baffd700 1 -- 172.21.15.154:0/2298174482 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0aa700 con 0x7f48bc0aa290 2023-10-10T22:34:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.402+0000 7f48baffd700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48bc0aa290 0x7f48bc1575e0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f48b0002a30 tx=0x7f48b0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.402+0000 7f48a37fe700 1 -- 172.21.15.154:0/2298174482 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b000f870 con 0x7f48bc0aa290 2023-10-10T22:34:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.402+0000 7f48a37fe700 1 -- 172.21.15.154:0/2298174482 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b000f9d0 con 0x7f48bc0aa290 2023-10-10T22:34:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.402+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc0ad540 con 0x7f48bc0aa290 2023-10-10T22:34:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.402+0000 7f48a37fe700 1 -- 172.21.15.154:0/2298174482 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b000fd70 con 0x7f48bc0aa290 2023-10-10T22:34:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.402+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc0adb00 con 0x7f48bc0aa290 2023-10-10T22:34:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.403+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc0af820 con 0x7f48bc0aa290 2023-10-10T22:34:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.404+0000 7f48a37fe700 1 -- 172.21.15.154:0/2298174482 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48b0013600 con 0x7f48bc0aa290 2023-10-10T22:34:40.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.405+0000 7f48a37fe700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f48a8066f30 0x7f48a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.405+0000 7f48a37fe700 1 -- 172.21.15.154:0/2298174482 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f48b0084cb0 con 0x7f48bc0aa290 2023-10-10T22:34:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.405+0000 7f48bb7fe700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f48a8066f30 0x7f48a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.406+0000 7f48bb7fe700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f48a8066f30 0x7f48a80693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48ac001ed0 tx=0x7f48ac017000 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.409+0000 7f48a37fe700 1 -- 172.21.15.154:0/2298174482 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48bc0af820 con 0x7f48bc0aa290 2023-10-10T22:34:40.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:40.645+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f48bc0af820 con 0x7f48bc0aa290 2023-10-10T22:34:41.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.367+0000 7f48a37fe700 1 -- 172.21.15.154:0/2298174482 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) v1 ==== 118+0+0 (secure 0 0 0) 0x7f48bc0af820 con 0x7f48bc0aa290 2023-10-10T22:34:41.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f48a8066f30 msgr2=0x7f48a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:41.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f48a8066f30 0x7f48a80693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48ac001ed0 tx=0x7f48ac017000 comp rx=0 tx=0).stop 2023-10-10T22:34:41.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48bc0aa290 msgr2=0x7f48bc1575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:41.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48bc0aa290 0x7f48bc1575e0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f48b0002a30 tx=0x7f48b0007d30 comp rx=0 tx=0).stop 2023-10-10T22:34:41.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 shutdown_connections 2023-10-10T22:34:41.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f48a8066f30 0x7f48a80693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48bc157b20 0x7f48bc0abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48a4003a90 0x7f48bc1694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 --2- 172.21.15.154:0/2298174482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48bc0aa290 0x7f48bc1575e0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 >> 172.21.15.154:0/2298174482 conn(0x7f48bc0cc1e0 msgr2=0x7f48bc0c1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:41.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 shutdown_connections 2023-10-10T22:34:41.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.370+0000 7f48c0d9d700 1 -- 172.21.15.154:0/2298174482 wait complete. 2023-10-10T22:34:41.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T22:34:41.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.578+0000 7f17057ff700 1 Processor -- start 2023-10-10T22:34:41.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.578+0000 7f17057ff700 1 -- start start 2023-10-10T22:34:41.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.579+0000 7f17057ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f17000c70b0 0x7f1700069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:41.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.579+0000 7f17057ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700069cb0 0x7f17000ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:41.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.579+0000 7f17057ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170006e950 con 0x7f1700155eb0 2023-10-10T22:34:41.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.579+0000 7f17057ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170006a130 con 0x7f17000c70b0 2023-10-10T22:34:41.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f17057ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170006eb90 con 0x7f1700069cb0 2023-10-10T22:34:41.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16feffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1700155eb0 0x7f170006e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33250/0 (socket says 172.21.15.154:33250) 2023-10-10T22:34:41.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16feffd700 1 -- 172.21.15.154:0/625250838 learned_addr learned my addr 172.21.15.154:0/625250838 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:41.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fe7fc700 1 --2- 172.21.15.154:0/625250838 >> v2:172.21.15.179:3300/0 conn(0x7f17000c70b0 0x7f1700069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:41.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16ff7fe700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700069cb0 0x7f17000ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:41.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380812724 0 0) 0x7f16f0001110 con 0x7f1700155eb0 2023-10-10T22:34:41.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e8003570 con 0x7f1700155eb0 2023-10-10T22:34:41.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187075713 0 0) 0x7f16e8003570 con 0x7f1700155eb0 2023-10-10T22:34:41.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700069cb0 msgr2=0x7f17000ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:41.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700069cb0 0x7f17000ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 >> v2:172.21.15.179:3300/0 conn(0x7f17000c70b0 msgr2=0x7f1700069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:41.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 --2- 172.21.15.154:0/625250838 >> v2:172.21.15.179:3300/0 conn(0x7f17000c70b0 0x7f1700069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170006ee70 con 0x7f1700155eb0 2023-10-10T22:34:41.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f16f0001600 con 0x7f1700155eb0 2023-10-10T22:34:41.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.580+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 >> v1:172.21.15.154:6789/0 conn(0x7f1700155eb0 legacy=0x7f170006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:41.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16fdffb700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8003a60 0x7f16e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:41.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16fdffb700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700069cb0 0x7f16e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:41.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16fdffb700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16e8004d50 0x7f16e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:41.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170006a130 con 0x7f16e8004d50 2023-10-10T22:34:41.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170006eb90 con 0x7f16e8003a60 2023-10-10T22:34:41.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e800ba60 con 0x7f1700069cb0 2023-10-10T22:34:41.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16ff7fe700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16e8004d50 0x7f16e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:41.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16fe7fc700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700069cb0 0x7f16e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:41.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16feffd700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8003a60 0x7f16e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:41.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16ff7fe700 1 -- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700069cb0 msgr2=0x7f16e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:41.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16ff7fe700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700069cb0 0x7f16e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16ff7fe700 1 -- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8003a60 msgr2=0x7f16e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:41.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16ff7fe700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8003a60 0x7f16e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16ff7fe700 1 -- 172.21.15.154:0/625250838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8003570 con 0x7f16e8004d50 2023-10-10T22:34:41.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.581+0000 7f16ff7fe700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16e8004d50 0x7f16e80051c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009fc0 tx=0x7f16f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664952a8167f8dba server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:41.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800ea30 con 0x7f16e8004d50 2023-10-10T22:34:41.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800f040 con 0x7f16e8004d50 2023-10-10T22:34:41.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f16fdffb700 1 -- 172.21.15.154:0/625250838 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800ede0 con 0x7f16e8004d50 2023-10-10T22:34:41.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f17057ff700 1 -- 172.21.15.154:0/625250838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16e8004d50 msgr2=0x7f16e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:41.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f17057ff700 1 --2- 172.21.15.154:0/625250838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16e8004d50 0x7f16e80051c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009fc0 tx=0x7f16f800b040 comp rx=0 tx=0).stop 2023-10-10T22:34:41.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f16ff7fe700 1 -- 172.21.15.154:0/625250838 reap_dead start 2023-10-10T22:34:41.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f17057ff700 1 -- 172.21.15.154:0/625250838 shutdown_connections 2023-10-10T22:34:41.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f17057ff700 1 -- 172.21.15.154:0/625250838 >> 172.21.15.154:0/625250838 conn(0x7f1700068e10 msgr2=0x7f17000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:41.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f17057ff700 1 -- 172.21.15.154:0/625250838 shutdown_connections 2023-10-10T22:34:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.582+0000 7f17057ff700 1 -- 172.21.15.154:0/625250838 wait complete. 2023-10-10T22:34:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.584+0000 7f17057ff700 1 Processor -- start 2023-10-10T22:34:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.584+0000 7f17057ff700 1 -- start start 2023-10-10T22:34:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f17057ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8004d50 0x7f17000c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f17057ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17000c4df0 0x7f1700147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f17057ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700154090 0x7f17000adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f17057ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c6910 con 0x7f17000c4df0 2023-10-10T22:34:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f17057ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c5f40 con 0x7f16e8004d50 2023-10-10T22:34:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f17057ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c5650 con 0x7f1700154090 2023-10-10T22:34:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16fe7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17000c4df0 0x7f1700147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:41.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16fe7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17000c4df0 0x7f1700147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56978/0 (socket says 172.21.15.154:56978) 2023-10-10T22:34:41.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16fe7fc700 1 -- 172.21.15.154:0/2312486281 learned_addr learned my addr 172.21.15.154:0/2312486281 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:41.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16ff7fe700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700154090 0x7f17000adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:41.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16feffd700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8004d50 0x7f17000c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:41.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16fe7fc700 1 -- 172.21.15.154:0/2312486281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700154090 msgr2=0x7f17000adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:41.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16fe7fc700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700154090 0x7f17000adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16fe7fc700 1 -- 172.21.15.154:0/2312486281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8004d50 msgr2=0x7f17000c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:41.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16fe7fc700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8004d50 0x7f17000c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:41.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16fe7fc700 1 -- 172.21.15.154:0/2312486281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17000c58f0 con 0x7f17000c4df0 2023-10-10T22:34:41.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.585+0000 7f16fe7fc700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17000c4df0 0x7f1700147e50 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f16f4006ac0 tx=0x7f16f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:41.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.586+0000 7f16e6ffd700 1 -- 172.21.15.154:0/2312486281 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400fa10 con 0x7f17000c4df0 2023-10-10T22:34:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.586+0000 7f16e6ffd700 1 -- 172.21.15.154:0/2312486281 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f400fb70 con 0x7f17000c4df0 2023-10-10T22:34:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.586+0000 7f16e6ffd700 1 -- 172.21.15.154:0/2312486281 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4014440 con 0x7f17000c4df0 2023-10-10T22:34:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.586+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17000c5bd0 con 0x7f17000c4df0 2023-10-10T22:34:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.586+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1700148390 con 0x7f17000c4df0 2023-10-10T22:34:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.587+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170004c3c0 con 0x7f17000c4df0 2023-10-10T22:34:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.588+0000 7f16e6ffd700 1 -- 172.21.15.154:0/2312486281 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16f4014830 con 0x7f17000c4df0 2023-10-10T22:34:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.589+0000 7f16e6ffd700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f16ec066f30 0x7f16ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.589+0000 7f16e6ffd700 1 -- 172.21.15.154:0/2312486281 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f16f4018030 con 0x7f17000c4df0 2023-10-10T22:34:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.589+0000 7f16feffd700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f16ec066f30 0x7f16ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.590+0000 7f16feffd700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f16ec066f30 0x7f16ec0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f16f0001ed0 tx=0x7f16f0009040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.593+0000 7f16e6ffd700 1 -- 172.21.15.154:0/2312486281 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16f4052250 con 0x7f17000c4df0 2023-10-10T22:34:41.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:41.829+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f17000c5d60 con 0x7f17000c4df0 2023-10-10T22:34:42.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.369+0000 7f16e6ffd700 1 -- 172.21.15.154:0/2312486281 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) v1 ==== 122+0+0 (secure 0 0 0) 0x7f16f4055870 con 0x7f17000c4df0 2023-10-10T22:34:42.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f16ec066f30 msgr2=0x7f16ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:42.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f16ec066f30 0x7f16ec0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f16f0001ed0 tx=0x7f16f0009040 comp rx=0 tx=0).stop 2023-10-10T22:34:42.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17000c4df0 msgr2=0x7f1700147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:42.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17000c4df0 0x7f1700147e50 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f16f4006ac0 tx=0x7f16f40091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 shutdown_connections 2023-10-10T22:34:42.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f16ec066f30 0x7f16ec0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700154090 0x7f17000adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8004d50 0x7f17000c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 --2- 172.21.15.154:0/2312486281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17000c4df0 0x7f1700147e50 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.372+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 >> 172.21.15.154:0/2312486281 conn(0x7f1700068e10 msgr2=0x7f1700154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:42.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.373+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 shutdown_connections 2023-10-10T22:34:42.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.373+0000 7f17057ff700 1 -- 172.21.15.154:0/2312486281 wait complete. 2023-10-10T22:34:42.394 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:34:42.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.578+0000 7f2384dff700 1 Processor -- start 2023-10-10T22:34:42.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.579+0000 7f2384dff700 1 -- start start 2023-10-10T22:34:42.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.580+0000 7f2384dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23800cbf30 0x7f23800ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:42.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.580+0000 7f2384dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f23800ccf90 0x7f23800b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:42.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.580+0000 7f2384dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23800cc300 con 0x7f238015a270 2023-10-10T22:34:42.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.580+0000 7f2384dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2380156bf0 con 0x7f23800cbf30 2023-10-10T22:34:42.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.580+0000 7f2384dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23800ae950 con 0x7f23800ccf90 2023-10-10T22:34:42.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.580+0000 7f237e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23800cbf30 0x7f23800ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:42.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.580+0000 7f237e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23800cbf30 0x7f23800ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56988/0 (socket says 172.21.15.154:56988) 2023-10-10T22:34:42.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.580+0000 7f237e59c700 1 -- 172.21.15.154:0/2588654838 learned_addr learned my addr 172.21.15.154:0/2588654838 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:42.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.580+0000 7f237dd9b700 1 --2- 172.21.15.154:0/2588654838 >> v2:172.21.15.179:3300/0 conn(0x7f23800ccf90 0x7f23800b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:42.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.581+0000 7f237e59c700 1 -- 172.21.15.154:0/2588654838 >> v2:172.21.15.179:3300/0 conn(0x7f23800ccf90 msgr2=0x7f23800b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:42.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.581+0000 7f237e59c700 1 --2- 172.21.15.154:0/2588654838 >> v2:172.21.15.179:3300/0 conn(0x7f23800ccf90 0x7f23800b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.581+0000 7f237e59c700 1 -- 172.21.15.154:0/2588654838 >> v1:172.21.15.179:6789/0 conn(0x7f238015a270 legacy=0x7f23800c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:42.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.581+0000 7f237e59c700 1 -- 172.21.15.154:0/2588654838 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23800ad370 con 0x7f23800cbf30 2023-10-10T22:34:42.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.581+0000 7f237e59c700 1 --2- 172.21.15.154:0/2588654838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 0x7f23800ae410 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f238006d670 tx=0x7f2370009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ada980fdf00e44b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:42.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.581+0000 7f237d59a700 1 -- 172.21.15.154:0/2588654838 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000b7e0 con 0x7f23800cbf30 2023-10-10T22:34:42.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.581+0000 7f237d59a700 1 -- 172.21.15.154:0/2588654838 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237000b940 con 0x7f23800cbf30 2023-10-10T22:34:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.581+0000 7f237d59a700 1 -- 172.21.15.154:0/2588654838 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000bce0 con 0x7f23800cbf30 2023-10-10T22:34:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.582+0000 7f2384dff700 1 -- 172.21.15.154:0/2588654838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 msgr2=0x7f23800ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.582+0000 7f2384dff700 1 --2- 172.21.15.154:0/2588654838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 0x7f23800ae410 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f238006d670 tx=0x7f2370009250 comp rx=0 tx=0).stop 2023-10-10T22:34:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.582+0000 7f2384dff700 1 -- 172.21.15.154:0/2588654838 shutdown_connections 2023-10-10T22:34:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.582+0000 7f2384dff700 1 --2- 172.21.15.154:0/2588654838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 0x7f23800ae410 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.582+0000 7f2384dff700 1 --2- 172.21.15.154:0/2588654838 >> v2:172.21.15.179:3300/0 conn(0x7f23800ccf90 0x7f23800b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.582+0000 7f2384dff700 1 -- 172.21.15.154:0/2588654838 >> 172.21.15.154:0/2588654838 conn(0x7f238006a320 msgr2=0x7f23800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.582+0000 7f2384dff700 1 -- 172.21.15.154:0/2588654838 shutdown_connections 2023-10-10T22:34:42.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.582+0000 7f2384dff700 1 -- 172.21.15.154:0/2588654838 wait complete. 2023-10-10T22:34:42.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.583+0000 7f2384dff700 1 Processor -- start 2023-10-10T22:34:42.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.583+0000 7f2384dff700 1 -- start start 2023-10-10T22:34:42.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.584+0000 7f2384dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 0x7f2380156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:42.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.584+0000 7f2384dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23800ccf90 0x7f2380169fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:42.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.584+0000 7f2384dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238015a270 0x7f2380158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:42.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.584+0000 7f2384dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238015c020 con 0x7f23800cbf30 2023-10-10T22:34:42.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.584+0000 7f2384dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238015f2a0 con 0x7f238015a270 2023-10-10T22:34:42.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.584+0000 7f2384dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238015c270 con 0x7f23800ccf90 2023-10-10T22:34:42.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 0x7f2380156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:42.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 0x7f2380156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56998/0 (socket says 172.21.15.154:56998) 2023-10-10T22:34:42.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237e59c700 1 -- 172.21.15.154:0/3547440220 learned_addr learned my addr 172.21.15.154:0/3547440220 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:42.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237dd9b700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23800ccf90 0x7f2380169fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:42.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237ed9d700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238015a270 0x7f2380158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:42.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237e59c700 1 -- 172.21.15.154:0/3547440220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23800ccf90 msgr2=0x7f2380169fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:42.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237e59c700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23800ccf90 0x7f2380169fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237e59c700 1 -- 172.21.15.154:0/3547440220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238015a270 msgr2=0x7f2380158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:42.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237e59c700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238015a270 0x7f2380158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237e59c700 1 -- 172.21.15.154:0/3547440220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700094f0 con 0x7f23800cbf30 2023-10-10T22:34:42.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237ed9d700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238015a270 0x7f2380158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:42.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.585+0000 7f237e59c700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 0x7f2380156060 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f23700030c0 tx=0x7f2370016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:42.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.586+0000 7f236e7fc700 1 -- 172.21.15.154:0/3547440220 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370006bc0 con 0x7f23800cbf30 2023-10-10T22:34:42.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.586+0000 7f236e7fc700 1 -- 172.21.15.154:0/3547440220 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370020070 con 0x7f23800cbf30 2023-10-10T22:34:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.586+0000 7f236e7fc700 1 -- 172.21.15.154:0/3547440220 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237001b450 con 0x7f23800cbf30 2023-10-10T22:34:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.586+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238015c550 con 0x7f23800cbf30 2023-10-10T22:34:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.586+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23801565a0 con 0x7f23800cbf30 2023-10-10T22:34:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.587+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238015ca70 con 0x7f23800cbf30 2023-10-10T22:34:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.588+0000 7f236e7fc700 1 -- 172.21.15.154:0/3547440220 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2370022030 con 0x7f23800cbf30 2023-10-10T22:34:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.589+0000 7f236e7fc700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2360066f30 0x7f23600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.589+0000 7f236e7fc700 1 -- 172.21.15.154:0/3547440220 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f2370086560 con 0x7f23800cbf30 2023-10-10T22:34:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.589+0000 7f237dd9b700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2360066f30 0x7f23600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.589+0000 7f237dd9b700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2360066f30 0x7f23600693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2380158ff0 tx=0x7f2374008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.592+0000 7f236e7fc700 1 -- 172.21.15.154:0/3547440220 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2370053540 con 0x7f23800cbf30 2023-10-10T22:34:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.824+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f238015ca70 con 0x7f23800cbf30 2023-10-10T22:34:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.824+0000 7f236e7fc700 1 -- 172.21.15.154:0/3547440220 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f2370056b60 con 0x7f23800cbf30 2023-10-10T22:34:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:42.826 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/331320161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":331320161},{"type":"v1","addr":"172.21.15.154:6833","nonce":331320161}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/595493420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":595493420},{"type":"v1","addr":"172.21.15.179:6835","nonce":595493420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1656759292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1656759292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1656759292}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:34:38.799966+0000","modified":"2023-10-10T22:34:42.366478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/3472664042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3472664042},{"type":"v1","addr":"172.21.15.179:6834","nonce":3472664042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-10T22:34:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2360066f30 msgr2=0x7f23600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2360066f30 0x7f23600693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2380158ff0 tx=0x7f2374008040 comp rx=0 tx=0).stop 2023-10-10T22:34:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 msgr2=0x7f2380156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 0x7f2380156060 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f23700030c0 tx=0x7f2370016000 comp rx=0 tx=0).stop 2023-10-10T22:34:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 shutdown_connections 2023-10-10T22:34:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2360066f30 0x7f23600693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238015a270 0x7f2380158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23800cbf30 0x7f2380156060 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 --2- 172.21.15.154:0/3547440220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23800ccf90 0x7f2380169fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 >> 172.21.15.154:0/3547440220 conn(0x7f238006a320 msgr2=0x7f23800c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 shutdown_connections 2023-10-10T22:34:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:42.827+0000 7f2384dff700 1 -- 172.21.15.154:0/3547440220 wait complete. 2023-10-10T22:34:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 86 2023-10-10T22:34:42.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:34:43.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.028+0000 7f5bad9ff700 1 Processor -- start 2023-10-10T22:34:43.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.028+0000 7f5bad9ff700 1 -- start start 2023-10-10T22:34:43.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.029+0000 7f5bad9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ba80cbf30 0x7f5ba80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.029+0000 7f5bad9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.029+0000 7f5bad9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba80cc300 con 0x7f5ba80ccf90 2023-10-10T22:34:43.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.029+0000 7f5bad9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba8156bf0 con 0x7f5ba80cbf30 2023-10-10T22:34:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.029+0000 7f5bad9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80ae950 con 0x7f5ba80b1420 2023-10-10T22:34:43.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba6ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ba80cbf30 0x7f5ba80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba80c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba80c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:37232/0 (socket says 172.21.15.154:37232) 2023-10-10T22:34:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba77fe700 1 -- 172.21.15.154:0/2531804252 learned_addr learned my addr 172.21.15.154:0/2531804252 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba6ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ba80cbf30 0x7f5ba80ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52798/0 (socket says 172.21.15.154:52798) 2023-10-10T22:34:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba77fe700 1 -- 172.21.15.154:0/2531804252 >> v2:172.21.15.179:3300/0 conn(0x7f5ba80cbf30 msgr2=0x7f5ba80ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba77fe700 1 --2- 172.21.15.154:0/2531804252 >> v2:172.21.15.179:3300/0 conn(0x7f5ba80cbf30 0x7f5ba80ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba77fe700 1 -- 172.21.15.154:0/2531804252 >> v1:172.21.15.179:6789/0 conn(0x7f5ba80ccf90 legacy=0x7f5ba80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba77fe700 1 -- 172.21.15.154:0/2531804252 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80ad370 con 0x7f5ba80b1420 2023-10-10T22:34:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.030+0000 7f5ba6ffd700 1 --2- 172.21.15.154:0/2531804252 >> v2:172.21.15.179:3300/0 conn(0x7f5ba80cbf30 0x7f5ba80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.031+0000 7f5ba77fe700 1 --2- 172.21.15.154:0/2531804252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba80c9740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009f20 tx=0x7f5ba0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c48047ed71e6ad34 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.031+0000 7f5ba5ffb700 1 -- 172.21.15.154:0/2531804252 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000e070 con 0x7f5ba80b1420 2023-10-10T22:34:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.031+0000 7f5ba5ffb700 1 -- 172.21.15.154:0/2531804252 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba000b9d0 con 0x7f5ba80b1420 2023-10-10T22:34:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.031+0000 7f5ba5ffb700 1 -- 172.21.15.154:0/2531804252 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00092e0 con 0x7f5ba80b1420 2023-10-10T22:34:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.031+0000 7f5bad9ff700 1 -- 172.21.15.154:0/2531804252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 msgr2=0x7f5ba80c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.032+0000 7f5bad9ff700 1 --2- 172.21.15.154:0/2531804252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba80c9740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009f20 tx=0x7f5ba0009840 comp rx=0 tx=0).stop 2023-10-10T22:34:43.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.032+0000 7f5bad9ff700 1 -- 172.21.15.154:0/2531804252 shutdown_connections 2023-10-10T22:34:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.032+0000 7f5bad9ff700 1 --2- 172.21.15.154:0/2531804252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba80c9740 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.032+0000 7f5bad9ff700 1 --2- 172.21.15.154:0/2531804252 >> v2:172.21.15.179:3300/0 conn(0x7f5ba80cbf30 0x7f5ba80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.032+0000 7f5bad9ff700 1 -- 172.21.15.154:0/2531804252 >> 172.21.15.154:0/2531804252 conn(0x7f5ba806a320 msgr2=0x7f5ba80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.032+0000 7f5bad9ff700 1 -- 172.21.15.154:0/2531804252 shutdown_connections 2023-10-10T22:34:43.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.032+0000 7f5bad9ff700 1 -- 172.21.15.154:0/2531804252 wait complete. 2023-10-10T22:34:43.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.033+0000 7f5bad9ff700 1 Processor -- start 2023-10-10T22:34:43.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.033+0000 7f5bad9ff700 1 -- start start 2023-10-10T22:34:43.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.034+0000 7f5bad9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba8152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.034+0000 7f5bad9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba80cbf30 0x7f5ba8151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.034+0000 7f5bad9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba80ccf90 0x7f5ba8152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.034+0000 7f5bad9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8151730 con 0x7f5ba80ccf90 2023-10-10T22:34:43.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.034+0000 7f5bad9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81554d0 con 0x7f5ba80cbf30 2023-10-10T22:34:43.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.034+0000 7f5bad9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8152d70 con 0x7f5ba80b1420 2023-10-10T22:34:43.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.034+0000 7f5ba77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba80ccf90 0x7f5ba8152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba80ccf90 0x7f5ba8152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57000/0 (socket says 172.21.15.154:57000) 2023-10-10T22:34:43.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba77fe700 1 -- 172.21.15.154:0/72119302 learned_addr learned my addr 172.21.15.154:0/72119302 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:43.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba6ffd700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba8152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba67fc700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba80cbf30 0x7f5ba8151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba77fe700 1 -- 172.21.15.154:0/72119302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 msgr2=0x7f5ba8152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba77fe700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba8152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba77fe700 1 -- 172.21.15.154:0/72119302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba80cbf30 msgr2=0x7f5ba8151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba77fe700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba80cbf30 0x7f5ba8151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba77fe700 1 -- 172.21.15.154:0/72119302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98009420 con 0x7f5ba80ccf90 2023-10-10T22:34:43.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5ba77fe700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba80ccf90 0x7f5ba8152100 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0012000 tx=0x7f5ba0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:43.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.035+0000 7f5b8effd700 1 -- 172.21.15.154:0/72119302 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0008c70 con 0x7f5ba80ccf90 2023-10-10T22:34:43.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.036+0000 7f5b8effd700 1 -- 172.21.15.154:0/72119302 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba0008df0 con 0x7f5ba80ccf90 2023-10-10T22:34:43.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.036+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba0009ae0 con 0x7f5ba80ccf90 2023-10-10T22:34:43.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.036+0000 7f5b8effd700 1 -- 172.21.15.154:0/72119302 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00266b0 con 0x7f5ba80ccf90 2023-10-10T22:34:43.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.036+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba8155a50 con 0x7f5ba80ccf90 2023-10-10T22:34:43.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.037+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba81518a0 con 0x7f5ba80ccf90 2023-10-10T22:34:43.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.038+0000 7f5b8effd700 1 -- 172.21.15.154:0/72119302 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ba0003040 con 0x7f5ba80ccf90 2023-10-10T22:34:43.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.039+0000 7f5b8effd700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5b94066f30 0x7f5b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.039+0000 7f5b8effd700 1 -- 172.21.15.154:0/72119302 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f5ba00867d0 con 0x7f5ba80ccf90 2023-10-10T22:34:43.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.039+0000 7f5ba6ffd700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5b94066f30 0x7f5b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.039+0000 7f5ba6ffd700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5b94066f30 0x7f5b940693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b980093f0 tx=0x7f5b98008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:43.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.043+0000 7f5b8effd700 1 -- 172.21.15.154:0/72119302 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ba00537b0 con 0x7f5ba80ccf90 2023-10-10T22:34:43.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.233+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ba804c3c0 con 0x7f5ba80ccf90 2023-10-10T22:34:43.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.234+0000 7f5b8effd700 1 -- 172.21.15.154:0/72119302 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+16169 (secure 0 0 0) 0x7f5ba0056dd0 con 0x7f5ba80ccf90 2023-10-10T22:34:43.235 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:43.236 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":193,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:34:40.344440+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:34:36.953199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-10T22:34:37.789582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:34:43.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5b94066f30 msgr2=0x7f5b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5b94066f30 0x7f5b940693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b980093f0 tx=0x7f5b98008040 comp rx=0 tx=0).stop 2023-10-10T22:34:43.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba80ccf90 msgr2=0x7f5ba8152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba80ccf90 0x7f5ba8152100 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0012000 tx=0x7f5ba0018000 comp rx=0 tx=0).stop 2023-10-10T22:34:43.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 shutdown_connections 2023-10-10T22:34:43.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5b94066f30 0x7f5b940693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba80ccf90 0x7f5ba8152100 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ba80b1420 0x7f5ba8152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 --2- 172.21.15.154:0/72119302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ba80cbf30 0x7f5ba8151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.236+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 >> 172.21.15.154:0/72119302 conn(0x7f5ba806a320 msgr2=0x7f5ba8155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:43.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.237+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 shutdown_connections 2023-10-10T22:34:43.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.237+0000 7f5bad9ff700 1 -- 172.21.15.154:0/72119302 wait complete. 2023-10-10T22:34:43.256 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T22:34:43.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:34:43.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.440+0000 7f8a46d9d700 1 Processor -- start 2023-10-10T22:34:43.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.440+0000 7f8a46d9d700 1 -- start start 2023-10-10T22:34:43.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.441+0000 7f8a46d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 0x7f8a400c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.441+0000 7f8a46d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8a401566e0 0x7f8a400ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.441+0000 7f8a46d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a400ca860 con 0x7f8a400ca300 2023-10-10T22:34:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.441+0000 7f8a46d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a400cab40 con 0x7f8a401566e0 2023-10-10T22:34:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.441+0000 7f8a46d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400cae20 con 0x7f8a40156310 2023-10-10T22:34:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.441+0000 7f8a4659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8a400ca300 0x7f8a400c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33260/0 (socket says 172.21.15.154:33260) 2023-10-10T22:34:43.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.441+0000 7f8a4659c700 1 -- 172.21.15.154:0/3466779130 learned_addr learned my addr 172.21.15.154:0/3466779130 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a45d9b700 1 --2- 172.21.15.154:0/3466779130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 0x7f8a400c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.441+0000 7f8a4559a700 1 --2- 172.21.15.154:0/3466779130 >> v2:172.21.15.179:3300/0 conn(0x7f8a401566e0 0x7f8a400ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a44d99700 1 -- 172.21.15.154:0/3466779130 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724010125 0 0) 0x7f8a400ca860 con 0x7f8a400ca300 2023-10-10T22:34:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a44d99700 1 -- 172.21.15.154:0/3466779130 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a2c003570 con 0x7f8a400ca300 2023-10-10T22:34:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a45d9b700 1 -- 172.21.15.154:0/3466779130 >> v2:172.21.15.179:3300/0 conn(0x7f8a401566e0 msgr2=0x7f8a400ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a45d9b700 1 --2- 172.21.15.154:0/3466779130 >> v2:172.21.15.179:3300/0 conn(0x7f8a401566e0 0x7f8a400ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a45d9b700 1 -- 172.21.15.154:0/3466779130 >> v1:172.21.15.154:6789/0 conn(0x7f8a400ca300 legacy=0x7f8a400c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a45d9b700 1 -- 172.21.15.154:0/3466779130 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400cb100 con 0x7f8a40156310 2023-10-10T22:34:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a4559a700 1 --2- 172.21.15.154:0/3466779130 >> v2:172.21.15.179:3300/0 conn(0x7f8a401566e0 0x7f8a400ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:43.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a45d9b700 1 --2- 172.21.15.154:0/3466779130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 0x7f8a400c9dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0098e0 tx=0x7f8a3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c852719e17ffa6c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:43.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.442+0000 7f8a44d99700 1 -- 172.21.15.154:0/3466779130 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c011630 con 0x7f8a40156310 2023-10-10T22:34:43.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a44d99700 1 -- 172.21.15.154:0/3466779130 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c011790 con 0x7f8a40156310 2023-10-10T22:34:43.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a44d99700 1 -- 172.21.15.154:0/3466779130 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c011b30 con 0x7f8a40156310 2023-10-10T22:34:43.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a46d9d700 1 -- 172.21.15.154:0/3466779130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 msgr2=0x7f8a400c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a46d9d700 1 --2- 172.21.15.154:0/3466779130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 0x7f8a400c9dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0098e0 tx=0x7f8a3c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a46d9d700 1 -- 172.21.15.154:0/3466779130 shutdown_connections 2023-10-10T22:34:43.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a46d9d700 1 --2- 172.21.15.154:0/3466779130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 0x7f8a400c9dc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a46d9d700 1 --2- 172.21.15.154:0/3466779130 >> v2:172.21.15.179:3300/0 conn(0x7f8a401566e0 0x7f8a400ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a46d9d700 1 -- 172.21.15.154:0/3466779130 >> 172.21.15.154:0/3466779130 conn(0x7f8a400cc1f0 msgr2=0x7f8a400cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:43.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a46d9d700 1 -- 172.21.15.154:0/3466779130 shutdown_connections 2023-10-10T22:34:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.443+0000 7f8a46d9d700 1 -- 172.21.15.154:0/3466779130 wait complete. 2023-10-10T22:34:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.445+0000 7f8a46d9d700 1 Processor -- start 2023-10-10T22:34:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.445+0000 7f8a46d9d700 1 -- start start 2023-10-10T22:34:43.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a46d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a400ca300 0x7f8a40154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a46d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 0x7f8a400c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a46d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a401566e0 0x7f8a40159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a46d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40157570 con 0x7f8a400ca300 2023-10-10T22:34:43.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a46d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40154c60 con 0x7f8a401566e0 2023-10-10T22:34:43.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a46d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40154f40 con 0x7f8a40156310 2023-10-10T22:34:43.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a45d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a400ca300 0x7f8a40154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a45d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a400ca300 0x7f8a40154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57012/0 (socket says 172.21.15.154:57012) 2023-10-10T22:34:43.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a45d9b700 1 -- 172.21.15.154:0/886871734 learned_addr learned my addr 172.21.15.154:0/886871734 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:43.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a45d9b700 1 -- 172.21.15.154:0/886871734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 msgr2=0x7f8a400c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a45d9b700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 0x7f8a400c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a45d9b700 1 -- 172.21.15.154:0/886871734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a401566e0 msgr2=0x7f8a40159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a45d9b700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a401566e0 0x7f8a40159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a45d9b700 1 -- 172.21.15.154:0/886871734 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30009420 con 0x7f8a400ca300 2023-10-10T22:34:43.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.446+0000 7f8a45d9b700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a400ca300 0x7f8a40154360 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f8a400caf60 tx=0x7f8a3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:43.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.447+0000 7f8a35ffb700 1 -- 172.21.15.154:0/886871734 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c011b10 con 0x7f8a400ca300 2023-10-10T22:34:43.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.447+0000 7f8a35ffb700 1 -- 172.21.15.154:0/886871734 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c026450 con 0x7f8a400ca300 2023-10-10T22:34:43.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.447+0000 7f8a35ffb700 1 -- 172.21.15.154:0/886871734 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c0267d0 con 0x7f8a400ca300 2023-10-10T22:34:43.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.447+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c009420 con 0x7f8a400ca300 2023-10-10T22:34:43.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.447+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a401577c0 con 0x7f8a400ca300 2023-10-10T22:34:43.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.448+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a401579e0 con 0x7f8a400ca300 2023-10-10T22:34:43.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.449+0000 7f8a35ffb700 1 -- 172.21.15.154:0/886871734 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a3c026bc0 con 0x7f8a400ca300 2023-10-10T22:34:43.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.449+0000 7f8a35ffb700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a24066f30 0x7f8a240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.450+0000 7f8a35ffb700 1 -- 172.21.15.154:0/886871734 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f8a3c086120 con 0x7f8a400ca300 2023-10-10T22:34:43.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.450+0000 7f8a4559a700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a24066f30 0x7f8a240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.450+0000 7f8a4559a700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a24066f30 0x7f8a240693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a40151500 tx=0x7f8a300091a0 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:43.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.454+0000 7f8a35ffb700 1 -- 172.21.15.154:0/886871734 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a3c0531a0 con 0x7f8a400ca300 2023-10-10T22:34:43.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.639+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a4004c3c0 con 0x7f8a24066f30 2023-10-10T22:34:43.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.649+0000 7f8a35ffb700 1 -- 172.21.15.154:0/886871734 <== mgr.8884 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285724 (secure 0 0 0) 0x7f8a4004c3c0 con 0x7f8a24066f30 2023-10-10T22:34:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:43.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a24066f30 msgr2=0x7f8a240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a24066f30 0x7f8a240693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a40151500 tx=0x7f8a300091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a400ca300 msgr2=0x7f8a40154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a400ca300 0x7f8a40154360 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f8a400caf60 tx=0x7f8a3c017000 comp rx=0 tx=0).stop 2023-10-10T22:34:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 shutdown_connections 2023-10-10T22:34:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a24066f30 0x7f8a240693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a401566e0 0x7f8a40159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a400ca300 0x7f8a40154360 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 --2- 172.21.15.154:0/886871734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a40156310 0x7f8a400c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 >> 172.21.15.154:0/886871734 conn(0x7f8a400cc1f0 msgr2=0x7f8a4006a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:43.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 shutdown_connections 2023-10-10T22:34:43.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.653+0000 7f8a46d9d700 1 -- 172.21.15.154:0/886871734 wait complete. 2023-10-10T22:34:43.662 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:34:43.672 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:34:43.287274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590492,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":556,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2504684,"kb_used_data":19884,"kb_used_omap":0,"kb_used_meta":2484736,"kb_avail":752470036,"statfs":{"total":773094113280,"available":770529316864,"internally_reserved":0,"allocated":20361216,"data_stored":10784354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2544369664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.965011"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364010+0000","last_change":"2023-10-10T22:34:39.362613+0000","last_active":"2023-10-10T22:34:39.364010+0000","last_peered":"2023-10-10T22:34:39.364010+0000","last_clean":"2023-10-10T22:34:39.364010+0000","last_became_active":"2023-10-10T22:34:39.362347+0000","last_became_peered":"2023-10-10T22:34:39.362347+0000","last_unstale":"2023-10-10T22:34:39.364010+0000","last_undegraded":"2023-10-10T22:34:39.364010+0000","last_fullsized":"2023-10-10T22:34:39.364010+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:18.718129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360244+0000","last_change":"2023-10-10T22:34:39.356895+0000","last_active":"2023-10-10T22:34:39.360244+0000","last_peered":"2023-10-10T22:34:39.360244+0000","last_clean":"2023-10-10T22:34:39.360244+0000","last_became_active":"2023-10-10T22:34:39.356597+0000","last_became_peered":"2023-10-10T22:34:39.356597+0000","last_unstale":"2023-10-10T22:34:39.360244+0000","last_undegraded":"2023-10-10T22:34:39.360244+0000","last_fullsized":"2023-10-10T22:34:39.360244+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:44.349327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363231+0000","last_change":"2023-10-10T22:34:39.356523+0000","last_active":"2023-10-10T22:34:39.363231+0000","last_peered":"2023-10-10T22:34:39.363231+0000","last_clean":"2023-10-10T22:34:39.363231+0000","last_became_active":"2023-10-10T22:34:39.356258+0000","last_became_peered":"2023-10-10T22:34:39.356258+0000","last_unstale":"2023-10-10T22:34:39.363231+0000","last_undegraded":"2023-10-10T22:34:39.363231+0000","last_fullsized":"2023-10-10T22:34:39.363231+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:59.029344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362547+0000","last_change":"2023-10-10T22:34:39.356644+0000","last_active":"2023-10-10T22:34:39.362547+0000","last_peered":"2023-10-10T22:34:39.362547+0000","last_clean":"2023-10-10T22:34:39.362547+0000","last_became_active":"2023-10-10T22:34:39.356377+0000","last_became_peered":"2023-10-10T22:34:39.356377+0000","last_unstale":"2023-10-10T22:34:39.362547+0000","last_undegraded":"2023-10-10T22:34:39.362547+0000","last_fullsized":"2023-10-10T22:34:39.362547+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:05.239388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353594+0000","last_change":"2023-10-10T22:34:39.344550+0000","last_active":"2023-10-10T22:34:39.353594+0000","last_peered":"2023-10-10T22:34:39.353594+0000","last_clean":"2023-10-10T22:34:39.353594+0000","last_became_active":"2023-10-10T22:34:39.344094+0000","last_became_peered":"2023-10-10T22:34:39.344094+0000","last_unstale":"2023-10-10T22:34:39.353594+0000","last_undegraded":"2023-10-10T22:34:39.353594+0000","last_fullsized":"2023-10-10T22:34:39.353594+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:59.777710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361095+0000","last_change":"2023-10-10T22:34:39.355546+0000","last_active":"2023-10-10T22:34:39.361095+0000","last_peered":"2023-10-10T22:34:39.361095+0000","last_clean":"2023-10-10T22:34:39.361095+0000","last_became_active":"2023-10-10T22:34:39.355276+0000","last_became_peered":"2023-10-10T22:34:39.355276+0000","last_unstale":"2023-10-10T22:34:39.361095+0000","last_undegraded":"2023-10-10T22:34:39.361095+0000","last_fullsized":"2023-10-10T22:34:39.361095+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365540+0000","last_change":"2023-10-10T22:34:39.363192+0000","last_active":"2023-10-10T22:34:39.365540+0000","last_peered":"2023-10-10T22:34:39.365540+0000","last_clean":"2023-10-10T22:34:39.365540+0000","last_became_active":"2023-10-10T22:34:39.362823+0000","last_became_peered":"2023-10-10T22:34:39.362823+0000","last_unstale":"2023-10-10T22:34:39.365540+0000","last_undegraded":"2023-10-10T22:34:39.365540+0000","last_fullsized":"2023-10-10T22:34:39.365540+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:48:08.525393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361246+0000","last_change":"2023-10-10T22:34:39.355002+0000","last_active":"2023-10-10T22:34:39.361246+0000","last_peered":"2023-10-10T22:34:39.361246+0000","last_clean":"2023-10-10T22:34:39.361246+0000","last_became_active":"2023-10-10T22:34:39.354741+0000","last_became_peered":"2023-10-10T22:34:39.354741+0000","last_unstale":"2023-10-10T22:34:39.361246+0000","last_undegraded":"2023-10-10T22:34:39.361246+0000","last_fullsized":"2023-10-10T22:34:39.361246+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:28.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364399+0000","last_change":"2023-10-10T22:34:39.361870+0000","last_active":"2023-10-10T22:34:39.364399+0000","last_peered":"2023-10-10T22:34:39.364399+0000","last_clean":"2023-10-10T22:34:39.364399+0000","last_became_active":"2023-10-10T22:34:39.361578+0000","last_became_peered":"2023-10-10T22:34:39.361578+0000","last_unstale":"2023-10-10T22:34:39.364399+0000","last_undegraded":"2023-10-10T22:34:39.364399+0000","last_fullsized":"2023-10-10T22:34:39.364399+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363974+0000","last_change":"2023-10-10T22:34:39.361997+0000","last_active":"2023-10-10T22:34:39.363974+0000","last_peered":"2023-10-10T22:34:39.363974+0000","last_clean":"2023-10-10T22:34:39.363974+0000","last_became_active":"2023-10-10T22:34:39.361723+0000","last_became_peered":"2023-10-10T22:34:39.361723+0000","last_unstale":"2023-10-10T22:34:39.363974+0000","last_undegraded":"2023-10-10T22:34:39.363974+0000","last_fullsized":"2023-10-10T22:34:39.363974+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:00.318138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363752+0000","last_change":"2023-10-10T22:34:39.361019+0000","last_active":"2023-10-10T22:34:39.363752+0000","last_peered":"2023-10-10T22:34:39.363752+0000","last_clean":"2023-10-10T22:34:39.363752+0000","last_became_active":"2023-10-10T22:34:39.360680+0000","last_became_peered":"2023-10-10T22:34:39.360680+0000","last_unstale":"2023-10-10T22:34:39.363752+0000","last_undegraded":"2023-10-10T22:34:39.363752+0000","last_fullsized":"2023-10-10T22:34:39.363752+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:59.049929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371642+0000","last_change":"2023-10-10T22:34:39.367948+0000","last_active":"2023-10-10T22:34:39.371642+0000","last_peered":"2023-10-10T22:34:39.371642+0000","last_clean":"2023-10-10T22:34:39.371642+0000","last_became_active":"2023-10-10T22:34:39.367661+0000","last_became_peered":"2023-10-10T22:34:39.367661+0000","last_unstale":"2023-10-10T22:34:39.371642+0000","last_undegraded":"2023-10-10T22:34:39.371642+0000","last_fullsized":"2023-10-10T22:34:39.371642+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:19:56.969395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354986+0000","last_change":"2023-10-10T22:34:39.349734+0000","last_active":"2023-10-10T22:34:39.354986+0000","last_peered":"2023-10-10T22:34:39.354986+0000","last_clean":"2023-10-10T22:34:39.354986+0000","last_became_active":"2023-10-10T22:34:39.349477+0000","last_became_peered":"2023-10-10T22:34:39.349477+0000","last_unstale":"2023-10-10T22:34:39.354986+0000","last_undegraded":"2023-10-10T22:34:39.354986+0000","last_fullsized":"2023-10-10T22:34:39.354986+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:28:23.607097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362726+0000","last_change":"2023-10-10T22:34:39.356873+0000","last_active":"2023-10-10T22:34:39.362726+0000","last_peered":"2023-10-10T22:34:39.362726+0000","last_clean":"2023-10-10T22:34:39.362726+0000","last_became_active":"2023-10-10T22:34:39.356605+0000","last_became_peered":"2023-10-10T22:34:39.356605+0000","last_unstale":"2023-10-10T22:34:39.362726+0000","last_undegraded":"2023-10-10T22:34:39.362726+0000","last_fullsized":"2023-10-10T22:34:39.362726+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:10:21.161733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371750+0000","last_change":"2023-10-10T22:34:39.366653+0000","last_active":"2023-10-10T22:34:39.371750+0000","last_peered":"2023-10-10T22:34:39.371750+0000","last_clean":"2023-10-10T22:34:39.371750+0000","last_became_active":"2023-10-10T22:34:39.366379+0000","last_became_peered":"2023-10-10T22:34:39.366379+0000","last_unstale":"2023-10-10T22:34:39.371750+0000","last_undegraded":"2023-10-10T22:34:39.371750+0000","last_fullsized":"2023-10-10T22:34:39.371750+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:25.485943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363189+0000","last_change":"2023-10-10T22:34:39.357319+0000","last_active":"2023-10-10T22:34:39.363189+0000","last_peered":"2023-10-10T22:34:39.363189+0000","last_clean":"2023-10-10T22:34:39.363189+0000","last_became_active":"2023-10-10T22:34:39.357063+0000","last_became_peered":"2023-10-10T22:34:39.357063+0000","last_unstale":"2023-10-10T22:34:39.363189+0000","last_undegraded":"2023-10-10T22:34:39.363189+0000","last_fullsized":"2023-10-10T22:34:39.363189+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368483+0000","last_change":"2023-10-10T22:34:39.364358+0000","last_active":"2023-10-10T22:34:39.368483+0000","last_peered":"2023-10-10T22:34:39.368483+0000","last_clean":"2023-10-10T22:34:39.368483+0000","last_became_active":"2023-10-10T22:34:39.364086+0000","last_became_peered":"2023-10-10T22:34:39.364086+0000","last_unstale":"2023-10-10T22:34:39.368483+0000","last_undegraded":"2023-10-10T22:34:39.368483+0000","last_fullsized":"2023-10-10T22:34:39.368483+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.318360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375388+0000","last_change":"2023-10-10T22:34:39.372148+0000","last_active":"2023-10-10T22:34:39.375388+0000","last_peered":"2023-10-10T22:34:39.375388+0000","last_clean":"2023-10-10T22:34:39.375388+0000","last_became_active":"2023-10-10T22:34:39.371878+0000","last_became_peered":"2023-10-10T22:34:39.371878+0000","last_unstale":"2023-10-10T22:34:39.375388+0000","last_undegraded":"2023-10-10T22:34:39.375388+0000","last_fullsized":"2023-10-10T22:34:39.375388+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359634+0000","last_change":"2023-10-10T22:34:39.353087+0000","last_active":"2023-10-10T22:34:39.359634+0000","last_peered":"2023-10-10T22:34:39.359634+0000","last_clean":"2023-10-10T22:34:39.359634+0000","last_became_active":"2023-10-10T22:34:39.352790+0000","last_became_peered":"2023-10-10T22:34:39.352790+0000","last_unstale":"2023-10-10T22:34:39.359634+0000","last_undegraded":"2023-10-10T22:34:39.359634+0000","last_fullsized":"2023-10-10T22:34:39.359634+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354084+0000","last_change":"2023-10-10T22:34:39.349571+0000","last_active":"2023-10-10T22:34:39.354084+0000","last_peered":"2023-10-10T22:34:39.354084+0000","last_clean":"2023-10-10T22:34:39.354084+0000","last_became_active":"2023-10-10T22:34:39.349303+0000","last_became_peered":"2023-10-10T22:34:39.349303+0000","last_unstale":"2023-10-10T22:34:39.354084+0000","last_undegraded":"2023-10-10T22:34:39.354084+0000","last_fullsized":"2023-10-10T22:34:39.354084+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:11:21.737863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354911+0000","last_change":"2023-10-10T22:34:39.350004+0000","last_active":"2023-10-10T22:34:39.354911+0000","last_peered":"2023-10-10T22:34:39.354911+0000","last_clean":"2023-10-10T22:34:39.354911+0000","last_became_active":"2023-10-10T22:34:39.349724+0000","last_became_peered":"2023-10-10T22:34:39.349724+0000","last_unstale":"2023-10-10T22:34:39.354911+0000","last_undegraded":"2023-10-10T22:34:39.354911+0000","last_fullsized":"2023-10-10T22:34:39.354911+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:53.460636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359615+0000","last_change":"2023-10-10T22:34:39.352813+0000","last_active":"2023-10-10T22:34:39.359615+0000","last_peered":"2023-10-10T22:34:39.359615+0000","last_clean":"2023-10-10T22:34:39.359615+0000","last_became_active":"2023-10-10T22:34:39.352547+0000","last_became_peered":"2023-10-10T22:34:39.352547+0000","last_unstale":"2023-10-10T22:34:39.359615+0000","last_undegraded":"2023-10-10T22:34:39.359615+0000","last_fullsized":"2023-10-10T22:34:39.359615+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.328258+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:27.899402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.324848+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:39:42.835006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365604+0000","last_change":"2023-10-10T22:34:39.362882+0000","last_active":"2023-10-10T22:34:39.365604+0000","last_peered":"2023-10-10T22:34:39.365604+0000","last_clean":"2023-10-10T22:34:39.365604+0000","last_became_active":"2023-10-10T22:34:39.361990+0000","last_became_peered":"2023-10-10T22:34:39.361990+0000","last_unstale":"2023-10-10T22:34:39.365604+0000","last_undegraded":"2023-10-10T22:34:39.365604+0000","last_fullsized":"2023-10-10T22:34:39.365604+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:53.148543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371483+0000","last_change":"2023-10-10T22:34:38.347538+0000","last_active":"2023-10-10T22:34:39.371483+0000","last_peered":"2023-10-10T22:34:39.371483+0000","last_clean":"2023-10-10T22:34:39.371483+0000","last_became_active":"2023-10-10T22:34:38.347315+0000","last_became_peered":"2023-10-10T22:34:38.347315+0000","last_unstale":"2023-10-10T22:34:39.371483+0000","last_undegraded":"2023-10-10T22:34:39.371483+0000","last_fullsized":"2023-10-10T22:34:39.371483+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:05.186977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.377096+0000","last_change":"2023-10-10T22:34:38.345977+0000","last_active":"2023-10-10T22:34:39.377096+0000","last_peered":"2023-10-10T22:34:39.377096+0000","last_clean":"2023-10-10T22:34:39.377096+0000","last_became_active":"2023-10-10T22:34:38.345697+0000","last_became_peered":"2023-10-10T22:34:38.345697+0000","last_unstale":"2023-10-10T22:34:39.377096+0000","last_undegraded":"2023-10-10T22:34:39.377096+0000","last_fullsized":"2023-10-10T22:34:39.377096+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:23:33.450441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355599+0000","last_change":"2023-10-10T22:34:39.348763+0000","last_active":"2023-10-10T22:34:39.355599+0000","last_peered":"2023-10-10T22:34:39.355599+0000","last_clean":"2023-10-10T22:34:39.355599+0000","last_became_active":"2023-10-10T22:34:39.348522+0000","last_became_peered":"2023-10-10T22:34:39.348522+0000","last_unstale":"2023-10-10T22:34:39.355599+0000","last_undegraded":"2023-10-10T22:34:39.355599+0000","last_fullsized":"2023-10-10T22:34:39.355599+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:04:16.976709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323289+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361660+0000","last_change":"2023-10-10T22:34:39.354944+0000","last_active":"2023-10-10T22:34:39.361660+0000","last_peered":"2023-10-10T22:34:39.361660+0000","last_clean":"2023-10-10T22:34:39.361660+0000","last_became_active":"2023-10-10T22:34:39.354688+0000","last_became_peered":"2023-10-10T22:34:39.354688+0000","last_unstale":"2023-10-10T22:34:39.361660+0000","last_undegraded":"2023-10-10T22:34:39.361660+0000","last_fullsized":"2023-10-10T22:34:39.361660+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:39.385854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371725+0000","last_change":"2023-10-10T22:34:38.345988+0000","last_active":"2023-10-10T22:34:39.371725+0000","last_peered":"2023-10-10T22:34:39.371725+0000","last_clean":"2023-10-10T22:34:39.371725+0000","last_became_active":"2023-10-10T22:34:38.345712+0000","last_became_peered":"2023-10-10T22:34:38.345712+0000","last_unstale":"2023-10-10T22:34:39.371725+0000","last_undegraded":"2023-10-10T22:34:39.371725+0000","last_fullsized":"2023-10-10T22:34:39.371725+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:24.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360699+0000","last_change":"2023-10-10T22:34:39.359133+0000","last_active":"2023-10-10T22:34:39.360699+0000","last_peered":"2023-10-10T22:34:39.360699+0000","last_clean":"2023-10-10T22:34:39.360699+0000","last_became_active":"2023-10-10T22:34:39.358861+0000","last_became_peered":"2023-10-10T22:34:39.358861+0000","last_unstale":"2023-10-10T22:34:39.360699+0000","last_undegraded":"2023-10-10T22:34:39.360699+0000","last_fullsized":"2023-10-10T22:34:39.360699+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:08.544990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.345113+0000","last_change":"2023-10-10T22:34:38.343671+0000","last_active":"2023-10-10T22:34:39.345113+0000","last_peered":"2023-10-10T22:34:39.345113+0000","last_clean":"2023-10-10T22:34:39.345113+0000","last_became_active":"2023-10-10T22:34:38.343422+0000","last_became_peered":"2023-10-10T22:34:38.343422+0000","last_unstale":"2023-10-10T22:34:39.345113+0000","last_undegraded":"2023-10-10T22:34:39.345113+0000","last_fullsized":"2023-10-10T22:34:39.345113+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:30.755114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363268+0000","last_change":"2023-10-10T22:34:39.358093+0000","last_active":"2023-10-10T22:34:39.363268+0000","last_peered":"2023-10-10T22:34:39.363268+0000","last_clean":"2023-10-10T22:34:39.363268+0000","last_became_active":"2023-10-10T22:34:39.357668+0000","last_became_peered":"2023-10-10T22:34:39.357668+0000","last_unstale":"2023-10-10T22:34:39.363268+0000","last_undegraded":"2023-10-10T22:34:39.363268+0000","last_fullsized":"2023-10-10T22:34:39.363268+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:57:19.780519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.337760+0000","last_change":"2023-10-10T22:34:38.347221+0000","last_active":"2023-10-10T22:34:39.337760+0000","last_peered":"2023-10-10T22:34:39.337760+0000","last_clean":"2023-10-10T22:34:39.337760+0000","last_became_active":"2023-10-10T22:34:38.346540+0000","last_became_peered":"2023-10-10T22:34:38.346540+0000","last_unstale":"2023-10-10T22:34:39.337760+0000","last_undegraded":"2023-10-10T22:34:39.337760+0000","last_fullsized":"2023-10-10T22:34:39.337760+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364110+0000","last_change":"2023-10-10T22:34:39.359054+0000","last_active":"2023-10-10T22:34:39.364110+0000","last_peered":"2023-10-10T22:34:39.364110+0000","last_clean":"2023-10-10T22:34:39.364110+0000","last_became_active":"2023-10-10T22:34:39.358728+0000","last_became_peered":"2023-10-10T22:34:39.358728+0000","last_unstale":"2023-10-10T22:34:39.364110+0000","last_undegraded":"2023-10-10T22:34:39.364110+0000","last_fullsized":"2023-10-10T22:34:39.364110+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:46:24.561755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.344344+0000","last_change":"2023-10-10T22:34:38.351309+0000","last_active":"2023-10-10T22:34:39.344344+0000","last_peered":"2023-10-10T22:34:39.344344+0000","last_clean":"2023-10-10T22:34:39.344344+0000","last_became_active":"2023-10-10T22:34:38.350974+0000","last_became_peered":"2023-10-10T22:34:38.350974+0000","last_unstale":"2023-10-10T22:34:39.344344+0000","last_undegraded":"2023-10-10T22:34:39.344344+0000","last_fullsized":"2023-10-10T22:34:39.344344+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:19.823507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364415+0000","last_change":"2023-10-10T22:34:39.359454+0000","last_active":"2023-10-10T22:34:39.364415+0000","last_peered":"2023-10-10T22:34:39.364415+0000","last_clean":"2023-10-10T22:34:39.364415+0000","last_became_active":"2023-10-10T22:34:39.359114+0000","last_became_peered":"2023-10-10T22:34:39.359114+0000","last_unstale":"2023-10-10T22:34:39.364415+0000","last_undegraded":"2023-10-10T22:34:39.364415+0000","last_fullsized":"2023-10-10T22:34:39.364415+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:34:24.445318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"192'3","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375047+0000","last_change":"2023-10-10T22:34:38.343325+0000","last_active":"2023-10-10T22:34:39.375047+0000","last_peered":"2023-10-10T22:34:39.375047+0000","last_clean":"2023-10-10T22:34:39.375047+0000","last_became_active":"2023-10-10T22:34:38.343010+0000","last_became_peered":"2023-10-10T22:34:38.343010+0000","last_unstale":"2023-10-10T22:34:39.375047+0000","last_undegraded":"2023-10-10T22:34:39.375047+0000","last_fullsized":"2023-10-10T22:34:39.375047+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:10.998587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323407+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:37:05.900792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354988+0000","last_change":"2023-10-10T22:34:39.351683+0000","last_active":"2023-10-10T22:34:39.354988+0000","last_peered":"2023-10-10T22:34:39.354988+0000","last_clean":"2023-10-10T22:34:39.354988+0000","last_became_active":"2023-10-10T22:34:39.351408+0000","last_became_peered":"2023-10-10T22:34:39.351408+0000","last_unstale":"2023-10-10T22:34:39.354988+0000","last_undegraded":"2023-10-10T22:34:39.354988+0000","last_fullsized":"2023-10-10T22:34:39.354988+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:52:56.113061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.372204+0000","last_change":"2023-10-10T22:34:38.346608+0000","last_active":"2023-10-10T22:34:39.372204+0000","last_peered":"2023-10-10T22:34:39.372204+0000","last_clean":"2023-10-10T22:34:39.372204+0000","last_became_active":"2023-10-10T22:34:38.346322+0000","last_became_peered":"2023-10-10T22:34:38.346322+0000","last_unstale":"2023-10-10T22:34:39.372204+0000","last_undegraded":"2023-10-10T22:34:39.372204+0000","last_fullsized":"2023-10-10T22:34:39.372204+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:32.171397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363254+0000","last_change":"2023-10-10T22:34:39.360965+0000","last_active":"2023-10-10T22:34:39.363254+0000","last_peered":"2023-10-10T22:34:39.363254+0000","last_clean":"2023-10-10T22:34:39.363254+0000","last_became_active":"2023-10-10T22:34:39.360596+0000","last_became_peered":"2023-10-10T22:34:39.360596+0000","last_unstale":"2023-10-10T22:34:39.363254+0000","last_undegraded":"2023-10-10T22:34:39.363254+0000","last_fullsized":"2023-10-10T22:34:39.363254+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:35:17.534324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.343088+0000","last_change":"2023-10-10T22:34:38.342951+0000","last_active":"2023-10-10T22:34:39.343088+0000","last_peered":"2023-10-10T22:34:39.343088+0000","last_clean":"2023-10-10T22:34:39.343088+0000","last_became_active":"2023-10-10T22:34:38.342633+0000","last_became_peered":"2023-10-10T22:34:38.342633+0000","last_unstale":"2023-10-10T22:34:39.343088+0000","last_undegraded":"2023-10-10T22:34:39.343088+0000","last_fullsized":"2023-10-10T22:34:39.343088+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:40.630602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368257+0000","last_change":"2023-10-10T22:34:39.363723+0000","last_active":"2023-10-10T22:34:39.368257+0000","last_peered":"2023-10-10T22:34:39.368257+0000","last_clean":"2023-10-10T22:34:39.368257+0000","last_became_active":"2023-10-10T22:34:39.362357+0000","last_became_peered":"2023-10-10T22:34:39.362357+0000","last_unstale":"2023-10-10T22:34:39.368257+0000","last_undegraded":"2023-10-10T22:34:39.368257+0000","last_fullsized":"2023-10-10T22:34:39.368257+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:05.154179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341334+0000","last_change":"2023-10-10T22:34:38.348455+0000","last_active":"2023-10-10T22:34:39.341334+0000","last_peered":"2023-10-10T22:34:39.341334+0000","last_clean":"2023-10-10T22:34:39.341334+0000","last_became_active":"2023-10-10T22:34:38.348238+0000","last_became_peered":"2023-10-10T22:34:38.348238+0000","last_unstale":"2023-10-10T22:34:39.341334+0000","last_undegraded":"2023-10-10T22:34:39.341334+0000","last_fullsized":"2023-10-10T22:34:39.341334+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:39.834725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323946+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:26:27.815289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357821+0000","last_change":"2023-10-10T22:34:39.351873+0000","last_active":"2023-10-10T22:34:39.357821+0000","last_peered":"2023-10-10T22:34:39.357821+0000","last_clean":"2023-10-10T22:34:39.357821+0000","last_became_active":"2023-10-10T22:34:39.351061+0000","last_became_peered":"2023-10-10T22:34:39.351061+0000","last_unstale":"2023-10-10T22:34:39.357821+0000","last_undegraded":"2023-10-10T22:34:39.357821+0000","last_fullsized":"2023-10-10T22:34:39.357821+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:04.376717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323205+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:39:42.835006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354935+0000","last_change":"2023-10-10T22:34:39.351667+0000","last_active":"2023-10-10T22:34:39.354935+0000","last_peered":"2023-10-10T22:34:39.354935+0000","last_clean":"2023-10-10T22:34:39.354935+0000","last_became_active":"2023-10-10T22:34:39.351393+0000","last_became_peered":"2023-10-10T22:34:39.351393+0000","last_unstale":"2023-10-10T22:34:39.354935+0000","last_undegraded":"2023-10-10T22:34:39.354935+0000","last_fullsized":"2023-10-10T22:34:39.354935+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:47.675306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323993+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:19.851014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360151+0000","last_change":"2023-10-10T22:34:39.355355+0000","last_active":"2023-10-10T22:34:39.360151+0000","last_peered":"2023-10-10T22:34:39.360151+0000","last_clean":"2023-10-10T22:34:39.360151+0000","last_became_active":"2023-10-10T22:34:39.354553+0000","last_became_peered":"2023-10-10T22:34:39.354553+0000","last_unstale":"2023-10-10T22:34:39.360151+0000","last_undegraded":"2023-10-10T22:34:39.360151+0000","last_fullsized":"2023-10-10T22:34:39.360151+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:05:43.000916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.327729+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:58.021154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355582+0000","last_change":"2023-10-10T22:34:39.350476+0000","last_active":"2023-10-10T22:34:39.355582+0000","last_peered":"2023-10-10T22:34:39.355582+0000","last_clean":"2023-10-10T22:34:39.355582+0000","last_became_active":"2023-10-10T22:34:39.350220+0000","last_became_peered":"2023-10-10T22:34:39.350220+0000","last_unstale":"2023-10-10T22:34:39.355582+0000","last_undegraded":"2023-10-10T22:34:39.355582+0000","last_fullsized":"2023-10-10T22:34:39.355582+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:43.202754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.327684+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:40.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371650+0000","last_change":"2023-10-10T22:34:38.349149+0000","last_active":"2023-10-10T22:34:39.371650+0000","last_peered":"2023-10-10T22:34:39.371650+0000","last_clean":"2023-10-10T22:34:39.371650+0000","last_became_active":"2023-10-10T22:34:38.348826+0000","last_became_peered":"2023-10-10T22:34:38.348826+0000","last_unstale":"2023-10-10T22:34:39.371650+0000","last_undegraded":"2023-10-10T22:34:39.371650+0000","last_fullsized":"2023-10-10T22:34:39.371650+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:46:04.840202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363236+0000","last_change":"2023-10-10T22:34:39.359963+0000","last_active":"2023-10-10T22:34:39.363236+0000","last_peered":"2023-10-10T22:34:39.363236+0000","last_clean":"2023-10-10T22:34:39.363236+0000","last_became_active":"2023-10-10T22:34:39.359619+0000","last_became_peered":"2023-10-10T22:34:39.359619+0000","last_unstale":"2023-10-10T22:34:39.363236+0000","last_undegraded":"2023-10-10T22:34:39.363236+0000","last_fullsized":"2023-10-10T22:34:39.363236+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:53.222053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.328262+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:23.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341438+0000","last_change":"2023-10-10T22:34:38.351131+0000","last_active":"2023-10-10T22:34:39.341438+0000","last_peered":"2023-10-10T22:34:39.341438+0000","last_clean":"2023-10-10T22:34:39.341438+0000","last_became_active":"2023-10-10T22:34:38.350834+0000","last_became_peered":"2023-10-10T22:34:38.350834+0000","last_unstale":"2023-10-10T22:34:39.341438+0000","last_undegraded":"2023-10-10T22:34:39.341438+0000","last_fullsized":"2023-10-10T22:34:39.341438+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:39:55.430063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368472+0000","last_change":"2023-10-10T22:34:39.364264+0000","last_active":"2023-10-10T22:34:39.368472+0000","last_peered":"2023-10-10T22:34:39.368472+0000","last_clean":"2023-10-10T22:34:39.368472+0000","last_became_active":"2023-10-10T22:34:39.364001+0000","last_became_peered":"2023-10-10T22:34:39.364001+0000","last_unstale":"2023-10-10T22:34:39.368472+0000","last_undegraded":"2023-10-10T22:34:39.368472+0000","last_fullsized":"2023-10-10T22:34:39.368472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:13.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.327785+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:33.423030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364340+0000","last_change":"2023-10-10T22:34:39.359432+0000","last_active":"2023-10-10T22:34:39.364340+0000","last_peered":"2023-10-10T22:34:39.364340+0000","last_clean":"2023-10-10T22:34:39.364340+0000","last_became_active":"2023-10-10T22:34:39.358785+0000","last_became_peered":"2023-10-10T22:34:39.358785+0000","last_unstale":"2023-10-10T22:34:39.364340+0000","last_undegraded":"2023-10-10T22:34:39.364340+0000","last_fullsized":"2023-10-10T22:34:39.364340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:12:04.760644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371647+0000","last_change":"2023-10-10T22:34:38.348511+0000","last_active":"2023-10-10T22:34:39.371647+0000","last_peered":"2023-10-10T22:34:39.371647+0000","last_clean":"2023-10-10T22:34:39.371647+0000","last_became_active":"2023-10-10T22:34:38.348207+0000","last_became_peered":"2023-10-10T22:34:38.348207+0000","last_unstale":"2023-10-10T22:34:39.371647+0000","last_undegraded":"2023-10-10T22:34:39.371647+0000","last_fullsized":"2023-10-10T22:34:39.371647+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:58:44.571683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361003+0000","last_change":"2023-10-10T22:34:39.355266+0000","last_active":"2023-10-10T22:34:39.361003+0000","last_peered":"2023-10-10T22:34:39.361003+0000","last_clean":"2023-10-10T22:34:39.361003+0000","last_became_active":"2023-10-10T22:34:39.355008+0000","last_became_peered":"2023-10-10T22:34:39.355008+0000","last_unstale":"2023-10-10T22:34:39.361003+0000","last_undegraded":"2023-10-10T22:34:39.361003+0000","last_fullsized":"2023-10-10T22:34:39.361003+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323285+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:23:02.934919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357626+0000","last_change":"2023-10-10T22:34:39.352912+0000","last_active":"2023-10-10T22:34:39.357626+0000","last_peered":"2023-10-10T22:34:39.357626+0000","last_clean":"2023-10-10T22:34:39.357626+0000","last_became_active":"2023-10-10T22:34:39.352659+0000","last_became_peered":"2023-10-10T22:34:39.352659+0000","last_unstale":"2023-10-10T22:34:39.357626+0000","last_undegraded":"2023-10-10T22:34:39.357626+0000","last_fullsized":"2023-10-10T22:34:39.357626+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:28:55.854343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355884+0000","last_change":"2023-10-10T22:34:38.343062+0000","last_active":"2023-10-10T22:34:39.355884+0000","last_peered":"2023-10-10T22:34:39.355884+0000","last_clean":"2023-10-10T22:34:39.355884+0000","last_became_active":"2023-10-10T22:34:38.342785+0000","last_became_peered":"2023-10-10T22:34:38.342785+0000","last_unstale":"2023-10-10T22:34:39.355884+0000","last_undegraded":"2023-10-10T22:34:39.355884+0000","last_fullsized":"2023-10-10T22:34:39.355884+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:37:29.658776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365464+0000","last_change":"2023-10-10T22:34:39.362657+0000","last_active":"2023-10-10T22:34:39.365464+0000","last_peered":"2023-10-10T22:34:39.365464+0000","last_clean":"2023-10-10T22:34:39.365464+0000","last_became_active":"2023-10-10T22:34:39.362380+0000","last_became_peered":"2023-10-10T22:34:39.362380+0000","last_unstale":"2023-10-10T22:34:39.365464+0000","last_undegraded":"2023-10-10T22:34:39.365464+0000","last_fullsized":"2023-10-10T22:34:39.365464+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:57:18.834083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.342952+0000","last_change":"2023-10-10T22:34:38.347549+0000","last_active":"2023-10-10T22:34:39.342952+0000","last_peered":"2023-10-10T22:34:39.342952+0000","last_clean":"2023-10-10T22:34:39.342952+0000","last_became_active":"2023-10-10T22:34:38.347295+0000","last_became_peered":"2023-10-10T22:34:38.347295+0000","last_unstale":"2023-10-10T22:34:39.342952+0000","last_undegraded":"2023-10-10T22:34:39.342952+0000","last_fullsized":"2023-10-10T22:34:39.342952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:18:33.343928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354970+0000","last_change":"2023-10-10T22:34:39.348743+0000","last_active":"2023-10-10T22:34:39.354970+0000","last_peered":"2023-10-10T22:34:39.354970+0000","last_clean":"2023-10-10T22:34:39.354970+0000","last_became_active":"2023-10-10T22:34:39.348482+0000","last_became_peered":"2023-10-10T22:34:39.348482+0000","last_unstale":"2023-10-10T22:34:39.354970+0000","last_undegraded":"2023-10-10T22:34:39.354970+0000","last_fullsized":"2023-10-10T22:34:39.354970+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:05.835271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.324483+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:37:59.805558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341151+0000","last_change":"2023-10-10T22:34:38.340111+0000","last_active":"2023-10-10T22:34:39.341151+0000","last_peered":"2023-10-10T22:34:39.341151+0000","last_clean":"2023-10-10T22:34:39.341151+0000","last_became_active":"2023-10-10T22:34:38.339803+0000","last_became_peered":"2023-10-10T22:34:38.339803+0000","last_unstale":"2023-10-10T22:34:39.341151+0000","last_undegraded":"2023-10-10T22:34:39.341151+0000","last_fullsized":"2023-10-10T22:34:39.341151+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:54:34.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363484+0000","last_change":"2023-10-10T22:34:39.360326+0000","last_active":"2023-10-10T22:34:39.363484+0000","last_peered":"2023-10-10T22:34:39.363484+0000","last_clean":"2023-10-10T22:34:39.363484+0000","last_became_active":"2023-10-10T22:34:39.360073+0000","last_became_peered":"2023-10-10T22:34:39.360073+0000","last_unstale":"2023-10-10T22:34:39.363484+0000","last_undegraded":"2023-10-10T22:34:39.363484+0000","last_fullsized":"2023-10-10T22:34:39.363484+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353042+0000","last_change":"2023-10-10T22:34:38.344691+0000","last_active":"2023-10-10T22:34:39.353042+0000","last_peered":"2023-10-10T22:34:39.353042+0000","last_clean":"2023-10-10T22:34:39.353042+0000","last_became_active":"2023-10-10T22:34:38.344440+0000","last_became_peered":"2023-10-10T22:34:38.344440+0000","last_unstale":"2023-10-10T22:34:39.353042+0000","last_undegraded":"2023-10-10T22:34:39.353042+0000","last_fullsized":"2023-10-10T22:34:39.353042+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:35:50.647239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323205+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:03.368527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364424+0000","last_change":"2023-10-10T22:34:39.359593+0000","last_active":"2023-10-10T22:34:39.364424+0000","last_peered":"2023-10-10T22:34:39.364424+0000","last_clean":"2023-10-10T22:34:39.364424+0000","last_became_active":"2023-10-10T22:34:39.359168+0000","last_became_peered":"2023-10-10T22:34:39.359168+0000","last_unstale":"2023-10-10T22:34:39.364424+0000","last_undegraded":"2023-10-10T22:34:39.364424+0000","last_fullsized":"2023-10-10T22:34:39.364424+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:58.046132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323234+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:04.145989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"182'326","reported_seq":1052,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-10T22:34:36.010192+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:34:36.010192+0000","last_peered":"2023-10-10T22:34:36.010192+0000","last_clean":"2023-10-10T22:34:36.010192+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:34:36.010192+0000","last_undegraded":"2023-10-10T22:34:36.010192+0000","last_fullsized":"2023-10-10T22:34:36.010192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":90,"acting":90,"num_store_stats":5},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":124,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543243,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312472,"kb_used_data":2896,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059368,"statfs":{"total":96636764160,"available":96316792832,"internally_reserved":0,"allocated":2965504,"data_stored":1777804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.57099999999999995,"5min":0.44500000000000001,"15min":0.36699999999999999},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.026},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.35399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.081},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.60199999999999998,"5min":0.47699999999999998,"15min":0.44700000000000001},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.46600000000000003},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":1.095},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.66000000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92700000000000005,"5min":0.96699999999999997,"15min":1},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.44400000000000001},"max":{"1min":0.91300000000000003,"5min":0.95899999999999996,"15min":0.97599999999999998},"last":0.627}]},{"osd":3,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.63800000000000001,"5min":0.47699999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":0.99099999999999999,"15min":1.0009999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.625,"5min":0.502,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.97399999999999998},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.079,"15min":1.079},"last":0.76100000000000001}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":1.125,"15min":1.125},"last":0.78500000000000003}]}]},{"osd":5,"up_from":14,"seq":60129543242,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315988,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055852,"statfs":{"total":96636764160,"available":96313192448,"internally_reserved":0,"allocated":2371584,"data_stored":1187436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":0.96699999999999997,"15min":1.006},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.39700000000000002},"max":{"1min":0.90100000000000002,"5min":0.997,"15min":0.997},"last":0.62}]},{"osd":1,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.63600000000000001,"5min":0.48499999999999999,"15min":0.371},"max":{"1min":0.90600000000000003,"5min":0.94499999999999995,"15min":1.01},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":1.014,"15min":1.0349999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.44800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.038},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.42299999999999999},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.93600000000000005},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.51700000000000002,"15min":0.48099999999999998},"max":{"1min":0.81499999999999995,"5min":0.97899999999999998,"15min":1.0569999999999999},"last":0.753},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.64800000000000002,"5min":0.55700000000000005,"15min":0.48499999999999999},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":1.0289999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.95799999999999996,"15min":0.98699999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":0.91200000000000003,"15min":1.01},"last":0.72499999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.53300000000000003,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.95299999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.435},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":1.032},"last":0.70799999999999996}]},{"osd":7,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.41799999999999998},"max":{"1min":0.89500000000000002,"5min":0.98999999999999999,"15min":1},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.67400000000000004}]}]},{"osd":1,"up_from":14,"seq":60129543243,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307836,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064004,"statfs":{"total":96636764160,"available":96321540096,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.96299999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82999999999999996,"5min":0.88,"15min":1.179},"last":0.69199999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.82099999999999995,"5min":0.878,"15min":1.0820000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.0489999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.82499999999999996,"15min":1.2150000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.123},"last":0.51700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81299999999999994,"15min":0.81399999999999995},"min":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.54700000000000004},"max":{"1min":1.0329999999999999,"5min":1.0489999999999999,"15min":1.29},"last":1.038},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":1.095,"15min":1.258},"last":0.86499999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1599999999999999,"15min":1.2609999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82299999999999995,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.61599999999999999,"15min":0.56999999999999995},"max":{"1min":1.026,"5min":1.1279999999999999,"15min":1.258},"last":0.95799999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.628,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":1.0940000000000001,"5min":1.1279999999999999,"15min":1.2869999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.877,"15min":0.871},"min":{"1min":0.70299999999999996,"5min":0.69199999999999995,"15min":0.628},"max":{"1min":1.069,"5min":1.175,"15min":1.3100000000000001},"last":0.99399999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.155,"15min":1.2450000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84899999999999998,"15min":0.84799999999999998},"min":{"1min":0.66900000000000004,"5min":0.621,"15min":0.53900000000000003},"max":{"1min":1.024,"5min":1.1120000000000001,"15min":1.226},"last":0.88600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543245,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308412,"kb_used_data":2932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063428,"statfs":{"total":96636764160,"available":96320950272,"internally_reserved":0,"allocated":3002368,"data_stored":1798594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.73699999999999999,"15min":0.85299999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.63600000000000001,"5min":0.73299999999999998,"15min":0.96599999999999997},"last":0.626},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81599999999999995,"15min":1.0249999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.64500000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.41199999999999998},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.89800000000000002},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53300000000000003},"max":{"1min":0.95899999999999996,"5min":1.0860000000000001,"15min":1.3340000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96799999999999997,"5min":1.0600000000000001,"15min":1.165},"last":1.056}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.59599999999999997,"5min":0.59399999999999997,"15min":0.53300000000000003},"max":{"1min":0.98699999999999999,"5min":1.079,"15min":1.214},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.629,"5min":0.627,"15min":0.56899999999999995},"max":{"1min":1.0069999999999999,"5min":1.0609999999999999,"15min":1.3089999999999999},"last":1.01}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.874},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":1.0700000000000001,"15min":1.377},"last":1.165},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.875,"15min":0.88200000000000001},"min":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.55200000000000005},"max":{"1min":1.014,"5min":1.123,"15min":1.427},"last":1.0680000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85099999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.56699999999999995},"max":{"1min":0.92900000000000005,"5min":1.0780000000000001,"15min":1.2689999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.153,"15min":1.1899999999999999},"last":0.97799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129543245,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.65300000000000002,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.442,"5min":0.317,"15min":0.31},"max":{"1min":0.70899999999999996,"5min":0.73799999999999999,"15min":0.89500000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.41299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67800000000000005,"5min":0.79700000000000004,"15min":0.80700000000000005},"last":0.432},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.38700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.52400000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.745,"5min":0.80300000000000005,"15min":0.97599999999999998},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.98499999999999999,"5min":1.1679999999999999,"15min":1.288},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.58399999999999996,"5min":0.47399999999999998,"15min":0.41599999999999998},"max":{"1min":0.96799999999999997,"5min":1.149,"15min":1.325},"last":0.71699999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.57799999999999996,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51500000000000001},"max":{"1min":1.147,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84399999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.67500000000000004,"5min":0.58799999999999997,"15min":0.53700000000000003},"max":{"1min":1.147,"5min":1.147,"15min":1.2689999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.625,"5min":0.60399999999999998,"15min":0.54300000000000004},"max":{"1min":1.167,"5min":1.26,"15min":1.26},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.1279999999999999,"5min":1.218,"15min":1.3129999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.65800000000000003,"5min":0.59199999999999997,"15min":0.54500000000000004},"max":{"1min":1.0700000000000001,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":15,"seq":64424510540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311932,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059908,"statfs":{"total":96636764160,"available":96317345792,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76700000000000002,"15min":0.79800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.435}]},{"osd":1,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.39400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32900000000000001},"max":{"1min":0.79500000000000004,"5min":0.84699999999999998,"15min":0.86899999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.38100000000000001,"15min":0.33800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97999999999999998,"5min":0.99399999999999999,"15min":0.998},"last":0.67100000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.242,"15min":1.2769999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.501},"max":{"1min":1.089,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.65700000000000003,"5min":0.56799999999999995,"15min":0.52900000000000003},"max":{"1min":1.0680000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.79500000000000004},"min":{"1min":0.66700000000000004,"5min":0.54600000000000004,"15min":0.5},"max":{"1min":1.0089999999999999,"5min":1.1379999999999999,"15min":1.383},"last":0.83199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.53000000000000003},"max":{"1min":1.0189999999999999,"5min":1.222,"15min":1.222},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.66800000000000004,"5min":0.58999999999999997,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.212,"15min":1.212},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.63200000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.194},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84299999999999997,"15min":0.84199999999999997},"min":{"1min":0.66800000000000004,"5min":0.629,"15min":0.56699999999999995},"max":{"1min":1.0920000000000001,"5min":1.226,"15min":1.2490000000000001},"last":0.65700000000000003}]}]},{"osd":6,"up_from":14,"seq":60129543243,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44400000000000001},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.56200000000000006,"5min":0.52800000000000002,"15min":0.46300000000000002},"max":{"1min":1.0049999999999999,"5min":1.04,"15min":1.0680000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.627,"5min":0.57999999999999996,"15min":0.47499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0920000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77400000000000002,"15min":0.78900000000000003},"min":{"1min":0.64700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.05,"5min":1.05,"15min":1.129},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.441},"max":{"1min":1.034,"5min":1.034,"15min":1.1200000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.48799999999999999},"max":{"1min":0.98599999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.502,"5min":0.502,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.51500000000000001},"max":{"1min":0.97399999999999998,"5min":1.0249999999999999,"15min":1.071},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":1,"15min":1},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":0.95899999999999996,"15min":0.98999999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.68000000000000005},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.996,"5min":1.006,"15min":1.046},"last":0.872},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95399999999999996,"5min":0.99199999999999999,"15min":1.1479999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.54000000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":1.008},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0880000000000001},"last":0.89900000000000002}]}]},{"osd":4,"up_from":14,"seq":60129543244,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315988,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055852,"statfs":{"total":96636764160,"available":96313192448,"internally_reserved":0,"allocated":2371584,"data_stored":1187436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":0.92400000000000004,"5min":1.0660000000000001,"15min":1.087},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.59699999999999998,"5min":0.47599999999999998,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.64700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.0609999999999999,"15min":1.1220000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46000000000000002},"max":{"1min":0.89000000000000001,"5min":1.018,"15min":1.0509999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58699999999999997,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.996,"5min":1.04,"15min":1.073},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.62,"5min":0.505,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":1.0369999999999999,"15min":1.089},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.4079999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74299999999999999,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0229999999999999,"15min":1.282},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73499999999999999,"5min":0.94099999999999995,"15min":1.6539999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":0.84299999999999997,"5min":1.0900000000000001,"15min":1.5169999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.143},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.57899999999999996,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":1.0569999999999999,"15min":1.1990000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48599999999999999,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":1.21,"15min":1.21},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.48199999999999998,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.0980000000000001,"15min":1.361},"last":0.83299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:34:43.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:34:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.894+0000 7f14689ff700 1 Processor -- start 2023-10-10T22:34:43.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.894+0000 7f14689ff700 1 -- start start 2023-10-10T22:34:43.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.895+0000 7f14689ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640cbf30 0x7f14640ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.895+0000 7f14689ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f14640b1420 0x7f14640c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.895+0000 7f14689ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14640cc300 con 0x7f14640ccf90 2023-10-10T22:34:43.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.895+0000 7f14689ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1464156bf0 con 0x7f14640b1420 2023-10-10T22:34:43.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.895+0000 7f14689ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14640ae950 con 0x7f14640cbf30 2023-10-10T22:34:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f146259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640cbf30 0x7f14640ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f1462d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f14640b1420 0x7f14640c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f1462d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f14640b1420 0x7f14640c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:52848/0 (socket says 172.21.15.154:52848) 2023-10-10T22:34:43.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f146259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640cbf30 0x7f14640ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:37266/0 (socket says 172.21.15.154:37266) 2023-10-10T22:34:43.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f1462d9d700 1 -- 172.21.15.154:0/1171615774 learned_addr learned my addr 172.21.15.154:0/1171615774 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:43.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f1462d9d700 1 -- 172.21.15.154:0/1171615774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640cbf30 msgr2=0x7f14640ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:43.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f1462d9d700 1 --2- 172.21.15.154:0/1171615774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640cbf30 0x7f14640ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f1462d9d700 1 -- 172.21.15.154:0/1171615774 >> v1:172.21.15.179:6789/0 conn(0x7f14640ccf90 legacy=0x7f14640b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f1462d9d700 1 -- 172.21.15.154:0/1171615774 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14640ad370 con 0x7f14640b1420 2023-10-10T22:34:43.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.896+0000 7f146259c700 1 --2- 172.21.15.154:0/1171615774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640cbf30 0x7f14640ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:43.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.897+0000 7f1462d9d700 1 --2- 172.21.15.154:0/1171615774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 0x7f14640c9740 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f145c009f50 tx=0x7f145c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=744fae3e6534191e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:43.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.897+0000 7f146159a700 1 -- 172.21.15.154:0/1171615774 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c00e070 con 0x7f14640b1420 2023-10-10T22:34:43.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.897+0000 7f146159a700 1 -- 172.21.15.154:0/1171615774 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c00b9c0 con 0x7f14640b1420 2023-10-10T22:34:43.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.897+0000 7f146159a700 1 -- 172.21.15.154:0/1171615774 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c0092e0 con 0x7f14640b1420 2023-10-10T22:34:43.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.897+0000 7f14689ff700 1 -- 172.21.15.154:0/1171615774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 msgr2=0x7f14640c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.897+0000 7f14689ff700 1 --2- 172.21.15.154:0/1171615774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 0x7f14640c9740 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f145c009f50 tx=0x7f145c009840 comp rx=0 tx=0).stop 2023-10-10T22:34:43.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.898+0000 7f14689ff700 1 -- 172.21.15.154:0/1171615774 shutdown_connections 2023-10-10T22:34:43.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.898+0000 7f14689ff700 1 --2- 172.21.15.154:0/1171615774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 0x7f14640c9740 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.898+0000 7f14689ff700 1 --2- 172.21.15.154:0/1171615774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640cbf30 0x7f14640ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.898+0000 7f14689ff700 1 -- 172.21.15.154:0/1171615774 >> 172.21.15.154:0/1171615774 conn(0x7f146406a320 msgr2=0x7f14640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:43.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.898+0000 7f14689ff700 1 -- 172.21.15.154:0/1171615774 shutdown_connections 2023-10-10T22:34:43.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.898+0000 7f14689ff700 1 -- 172.21.15.154:0/1171615774 wait complete. 2023-10-10T22:34:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.899+0000 7f14689ff700 1 Processor -- start 2023-10-10T22:34:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.899+0000 7f14689ff700 1 -- start start 2023-10-10T22:34:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.900+0000 7f14689ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 0x7f14640c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.900+0000 7f14689ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14640cbf30 0x7f146415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.900+0000 7f14689ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640ccf90 0x7f14641416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.900+0000 7f14689ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14640c2490 con 0x7f14640cbf30 2023-10-10T22:34:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.900+0000 7f14689ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14640c1ac0 con 0x7f14640b1420 2023-10-10T22:34:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.900+0000 7f14689ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146416b010 con 0x7f14640ccf90 2023-10-10T22:34:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.900+0000 7f1461d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14640cbf30 0x7f146415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.900+0000 7f1461d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14640cbf30 0x7f146415b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57020/0 (socket says 172.21.15.154:57020) 2023-10-10T22:34:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.900+0000 7f1461d9b700 1 -- 172.21.15.154:0/4060553555 learned_addr learned my addr 172.21.15.154:0/4060553555 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f146259c700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 0x7f14640c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f1462d9d700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640ccf90 0x7f14641416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f146259c700 1 -- 172.21.15.154:0/4060553555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640ccf90 msgr2=0x7f14641416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f146259c700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640ccf90 0x7f14641416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f146259c700 1 -- 172.21.15.154:0/4060553555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14640cbf30 msgr2=0x7f146415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f146259c700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14640cbf30 0x7f146415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f146259c700 1 -- 172.21.15.154:0/4060553555 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145400b6d0 con 0x7f14640b1420 2023-10-10T22:34:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f146259c700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 0x7f14640c1f50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f145400ee40 tx=0x7f145400b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f14527fc700 1 -- 172.21.15.154:0/4060553555 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145400ee70 con 0x7f14640b1420 2023-10-10T22:34:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f14527fc700 1 -- 172.21.15.154:0/4060553555 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145400dd30 con 0x7f14640b1420 2023-10-10T22:34:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.901+0000 7f14527fc700 1 -- 172.21.15.154:0/4060553555 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145400dea0 con 0x7f14640b1420 2023-10-10T22:34:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.902+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c009ae0 con 0x7f14640b1420 2023-10-10T22:34:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.902+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14640c1750 con 0x7f14640b1420 2023-10-10T22:34:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.902+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14640c12d0 con 0x7f14640b1420 2023-10-10T22:34:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.904+0000 7f14527fc700 1 -- 172.21.15.154:0/4060553555 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1454010920 con 0x7f14640b1420 2023-10-10T22:34:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.904+0000 7f14527fc700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1444066f30 0x7f14440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.904+0000 7f14527fc700 1 -- 172.21.15.154:0/4060553555 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f1454084de0 con 0x7f14640b1420 2023-10-10T22:34:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.905+0000 7f1461d9b700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1444066f30 0x7f14440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.905+0000 7f1461d9b700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1444066f30 0x7f14440693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f14580078a0 tx=0x7f1458007830 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:43.909+0000 7f14527fc700 1 -- 172.21.15.154:0/4060553555 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14640c12d0 con 0x7f14640b1420 2023-10-10T22:34:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.093+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14640c1c00 con 0x7f1444066f30 2023-10-10T22:34:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.101+0000 7f14527fc700 1 -- 172.21.15.154:0/4060553555 <== mgr.8884 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285724 (secure 0 0 0) 0x7f1458002760 con 0x7f1444066f30 2023-10-10T22:34:44.106 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:44.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1444066f30 msgr2=0x7f14440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1444066f30 0x7f14440693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f14580078a0 tx=0x7f1458007830 comp rx=0 tx=0).stop 2023-10-10T22:34:44.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 msgr2=0x7f14640c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 0x7f14640c1f50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f145400ee40 tx=0x7f145400b430 comp rx=0 tx=0).stop 2023-10-10T22:34:44.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 shutdown_connections 2023-10-10T22:34:44.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1444066f30 0x7f14440693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14640ccf90 0x7f14641416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14640b1420 0x7f14640c1f50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 --2- 172.21.15.154:0/4060553555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14640cbf30 0x7f146415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 >> 172.21.15.154:0/4060553555 conn(0x7f146406a320 msgr2=0x7f14640c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 shutdown_connections 2023-10-10T22:34:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.106+0000 7f14689ff700 1 -- 172.21.15.154:0/4060553555 wait complete. 2023-10-10T22:34:44.112 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:34:44.125 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:34:43.287274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590492,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":556,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2504684,"kb_used_data":19884,"kb_used_omap":0,"kb_used_meta":2484736,"kb_avail":752470036,"statfs":{"total":773094113280,"available":770529316864,"internally_reserved":0,"allocated":20361216,"data_stored":10784354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2544369664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.965011"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364010+0000","last_change":"2023-10-10T22:34:39.362613+0000","last_active":"2023-10-10T22:34:39.364010+0000","last_peered":"2023-10-10T22:34:39.364010+0000","last_clean":"2023-10-10T22:34:39.364010+0000","last_became_active":"2023-10-10T22:34:39.362347+0000","last_became_peered":"2023-10-10T22:34:39.362347+0000","last_unstale":"2023-10-10T22:34:39.364010+0000","last_undegraded":"2023-10-10T22:34:39.364010+0000","last_fullsized":"2023-10-10T22:34:39.364010+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:18.718129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360244+0000","last_change":"2023-10-10T22:34:39.356895+0000","last_active":"2023-10-10T22:34:39.360244+0000","last_peered":"2023-10-10T22:34:39.360244+0000","last_clean":"2023-10-10T22:34:39.360244+0000","last_became_active":"2023-10-10T22:34:39.356597+0000","last_became_peered":"2023-10-10T22:34:39.356597+0000","last_unstale":"2023-10-10T22:34:39.360244+0000","last_undegraded":"2023-10-10T22:34:39.360244+0000","last_fullsized":"2023-10-10T22:34:39.360244+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:44.349327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363231+0000","last_change":"2023-10-10T22:34:39.356523+0000","last_active":"2023-10-10T22:34:39.363231+0000","last_peered":"2023-10-10T22:34:39.363231+0000","last_clean":"2023-10-10T22:34:39.363231+0000","last_became_active":"2023-10-10T22:34:39.356258+0000","last_became_peered":"2023-10-10T22:34:39.356258+0000","last_unstale":"2023-10-10T22:34:39.363231+0000","last_undegraded":"2023-10-10T22:34:39.363231+0000","last_fullsized":"2023-10-10T22:34:39.363231+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:59.029344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362547+0000","last_change":"2023-10-10T22:34:39.356644+0000","last_active":"2023-10-10T22:34:39.362547+0000","last_peered":"2023-10-10T22:34:39.362547+0000","last_clean":"2023-10-10T22:34:39.362547+0000","last_became_active":"2023-10-10T22:34:39.356377+0000","last_became_peered":"2023-10-10T22:34:39.356377+0000","last_unstale":"2023-10-10T22:34:39.362547+0000","last_undegraded":"2023-10-10T22:34:39.362547+0000","last_fullsized":"2023-10-10T22:34:39.362547+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:05.239388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353594+0000","last_change":"2023-10-10T22:34:39.344550+0000","last_active":"2023-10-10T22:34:39.353594+0000","last_peered":"2023-10-10T22:34:39.353594+0000","last_clean":"2023-10-10T22:34:39.353594+0000","last_became_active":"2023-10-10T22:34:39.344094+0000","last_became_peered":"2023-10-10T22:34:39.344094+0000","last_unstale":"2023-10-10T22:34:39.353594+0000","last_undegraded":"2023-10-10T22:34:39.353594+0000","last_fullsized":"2023-10-10T22:34:39.353594+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:59.777710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361095+0000","last_change":"2023-10-10T22:34:39.355546+0000","last_active":"2023-10-10T22:34:39.361095+0000","last_peered":"2023-10-10T22:34:39.361095+0000","last_clean":"2023-10-10T22:34:39.361095+0000","last_became_active":"2023-10-10T22:34:39.355276+0000","last_became_peered":"2023-10-10T22:34:39.355276+0000","last_unstale":"2023-10-10T22:34:39.361095+0000","last_undegraded":"2023-10-10T22:34:39.361095+0000","last_fullsized":"2023-10-10T22:34:39.361095+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365540+0000","last_change":"2023-10-10T22:34:39.363192+0000","last_active":"2023-10-10T22:34:39.365540+0000","last_peered":"2023-10-10T22:34:39.365540+0000","last_clean":"2023-10-10T22:34:39.365540+0000","last_became_active":"2023-10-10T22:34:39.362823+0000","last_became_peered":"2023-10-10T22:34:39.362823+0000","last_unstale":"2023-10-10T22:34:39.365540+0000","last_undegraded":"2023-10-10T22:34:39.365540+0000","last_fullsized":"2023-10-10T22:34:39.365540+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:48:08.525393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361246+0000","last_change":"2023-10-10T22:34:39.355002+0000","last_active":"2023-10-10T22:34:39.361246+0000","last_peered":"2023-10-10T22:34:39.361246+0000","last_clean":"2023-10-10T22:34:39.361246+0000","last_became_active":"2023-10-10T22:34:39.354741+0000","last_became_peered":"2023-10-10T22:34:39.354741+0000","last_unstale":"2023-10-10T22:34:39.361246+0000","last_undegraded":"2023-10-10T22:34:39.361246+0000","last_fullsized":"2023-10-10T22:34:39.361246+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:28.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364399+0000","last_change":"2023-10-10T22:34:39.361870+0000","last_active":"2023-10-10T22:34:39.364399+0000","last_peered":"2023-10-10T22:34:39.364399+0000","last_clean":"2023-10-10T22:34:39.364399+0000","last_became_active":"2023-10-10T22:34:39.361578+0000","last_became_peered":"2023-10-10T22:34:39.361578+0000","last_unstale":"2023-10-10T22:34:39.364399+0000","last_undegraded":"2023-10-10T22:34:39.364399+0000","last_fullsized":"2023-10-10T22:34:39.364399+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363974+0000","last_change":"2023-10-10T22:34:39.361997+0000","last_active":"2023-10-10T22:34:39.363974+0000","last_peered":"2023-10-10T22:34:39.363974+0000","last_clean":"2023-10-10T22:34:39.363974+0000","last_became_active":"2023-10-10T22:34:39.361723+0000","last_became_peered":"2023-10-10T22:34:39.361723+0000","last_unstale":"2023-10-10T22:34:39.363974+0000","last_undegraded":"2023-10-10T22:34:39.363974+0000","last_fullsized":"2023-10-10T22:34:39.363974+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:00.318138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363752+0000","last_change":"2023-10-10T22:34:39.361019+0000","last_active":"2023-10-10T22:34:39.363752+0000","last_peered":"2023-10-10T22:34:39.363752+0000","last_clean":"2023-10-10T22:34:39.363752+0000","last_became_active":"2023-10-10T22:34:39.360680+0000","last_became_peered":"2023-10-10T22:34:39.360680+0000","last_unstale":"2023-10-10T22:34:39.363752+0000","last_undegraded":"2023-10-10T22:34:39.363752+0000","last_fullsized":"2023-10-10T22:34:39.363752+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:59.049929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371642+0000","last_change":"2023-10-10T22:34:39.367948+0000","last_active":"2023-10-10T22:34:39.371642+0000","last_peered":"2023-10-10T22:34:39.371642+0000","last_clean":"2023-10-10T22:34:39.371642+0000","last_became_active":"2023-10-10T22:34:39.367661+0000","last_became_peered":"2023-10-10T22:34:39.367661+0000","last_unstale":"2023-10-10T22:34:39.371642+0000","last_undegraded":"2023-10-10T22:34:39.371642+0000","last_fullsized":"2023-10-10T22:34:39.371642+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:19:56.969395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354986+0000","last_change":"2023-10-10T22:34:39.349734+0000","last_active":"2023-10-10T22:34:39.354986+0000","last_peered":"2023-10-10T22:34:39.354986+0000","last_clean":"2023-10-10T22:34:39.354986+0000","last_became_active":"2023-10-10T22:34:39.349477+0000","last_became_peered":"2023-10-10T22:34:39.349477+0000","last_unstale":"2023-10-10T22:34:39.354986+0000","last_undegraded":"2023-10-10T22:34:39.354986+0000","last_fullsized":"2023-10-10T22:34:39.354986+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:28:23.607097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362726+0000","last_change":"2023-10-10T22:34:39.356873+0000","last_active":"2023-10-10T22:34:39.362726+0000","last_peered":"2023-10-10T22:34:39.362726+0000","last_clean":"2023-10-10T22:34:39.362726+0000","last_became_active":"2023-10-10T22:34:39.356605+0000","last_became_peered":"2023-10-10T22:34:39.356605+0000","last_unstale":"2023-10-10T22:34:39.362726+0000","last_undegraded":"2023-10-10T22:34:39.362726+0000","last_fullsized":"2023-10-10T22:34:39.362726+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:10:21.161733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371750+0000","last_change":"2023-10-10T22:34:39.366653+0000","last_active":"2023-10-10T22:34:39.371750+0000","last_peered":"2023-10-10T22:34:39.371750+0000","last_clean":"2023-10-10T22:34:39.371750+0000","last_became_active":"2023-10-10T22:34:39.366379+0000","last_became_peered":"2023-10-10T22:34:39.366379+0000","last_unstale":"2023-10-10T22:34:39.371750+0000","last_undegraded":"2023-10-10T22:34:39.371750+0000","last_fullsized":"2023-10-10T22:34:39.371750+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:25.485943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363189+0000","last_change":"2023-10-10T22:34:39.357319+0000","last_active":"2023-10-10T22:34:39.363189+0000","last_peered":"2023-10-10T22:34:39.363189+0000","last_clean":"2023-10-10T22:34:39.363189+0000","last_became_active":"2023-10-10T22:34:39.357063+0000","last_became_peered":"2023-10-10T22:34:39.357063+0000","last_unstale":"2023-10-10T22:34:39.363189+0000","last_undegraded":"2023-10-10T22:34:39.363189+0000","last_fullsized":"2023-10-10T22:34:39.363189+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368483+0000","last_change":"2023-10-10T22:34:39.364358+0000","last_active":"2023-10-10T22:34:39.368483+0000","last_peered":"2023-10-10T22:34:39.368483+0000","last_clean":"2023-10-10T22:34:39.368483+0000","last_became_active":"2023-10-10T22:34:39.364086+0000","last_became_peered":"2023-10-10T22:34:39.364086+0000","last_unstale":"2023-10-10T22:34:39.368483+0000","last_undegraded":"2023-10-10T22:34:39.368483+0000","last_fullsized":"2023-10-10T22:34:39.368483+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.318360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375388+0000","last_change":"2023-10-10T22:34:39.372148+0000","last_active":"2023-10-10T22:34:39.375388+0000","last_peered":"2023-10-10T22:34:39.375388+0000","last_clean":"2023-10-10T22:34:39.375388+0000","last_became_active":"2023-10-10T22:34:39.371878+0000","last_became_peered":"2023-10-10T22:34:39.371878+0000","last_unstale":"2023-10-10T22:34:39.375388+0000","last_undegraded":"2023-10-10T22:34:39.375388+0000","last_fullsized":"2023-10-10T22:34:39.375388+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359634+0000","last_change":"2023-10-10T22:34:39.353087+0000","last_active":"2023-10-10T22:34:39.359634+0000","last_peered":"2023-10-10T22:34:39.359634+0000","last_clean":"2023-10-10T22:34:39.359634+0000","last_became_active":"2023-10-10T22:34:39.352790+0000","last_became_peered":"2023-10-10T22:34:39.352790+0000","last_unstale":"2023-10-10T22:34:39.359634+0000","last_undegraded":"2023-10-10T22:34:39.359634+0000","last_fullsized":"2023-10-10T22:34:39.359634+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354084+0000","last_change":"2023-10-10T22:34:39.349571+0000","last_active":"2023-10-10T22:34:39.354084+0000","last_peered":"2023-10-10T22:34:39.354084+0000","last_clean":"2023-10-10T22:34:39.354084+0000","last_became_active":"2023-10-10T22:34:39.349303+0000","last_became_peered":"2023-10-10T22:34:39.349303+0000","last_unstale":"2023-10-10T22:34:39.354084+0000","last_undegraded":"2023-10-10T22:34:39.354084+0000","last_fullsized":"2023-10-10T22:34:39.354084+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:11:21.737863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354911+0000","last_change":"2023-10-10T22:34:39.350004+0000","last_active":"2023-10-10T22:34:39.354911+0000","last_peered":"2023-10-10T22:34:39.354911+0000","last_clean":"2023-10-10T22:34:39.354911+0000","last_became_active":"2023-10-10T22:34:39.349724+0000","last_became_peered":"2023-10-10T22:34:39.349724+0000","last_unstale":"2023-10-10T22:34:39.354911+0000","last_undegraded":"2023-10-10T22:34:39.354911+0000","last_fullsized":"2023-10-10T22:34:39.354911+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:53.460636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359615+0000","last_change":"2023-10-10T22:34:39.352813+0000","last_active":"2023-10-10T22:34:39.359615+0000","last_peered":"2023-10-10T22:34:39.359615+0000","last_clean":"2023-10-10T22:34:39.359615+0000","last_became_active":"2023-10-10T22:34:39.352547+0000","last_became_peered":"2023-10-10T22:34:39.352547+0000","last_unstale":"2023-10-10T22:34:39.359615+0000","last_undegraded":"2023-10-10T22:34:39.359615+0000","last_fullsized":"2023-10-10T22:34:39.359615+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.328258+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:27.899402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.324848+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:39:42.835006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365604+0000","last_change":"2023-10-10T22:34:39.362882+0000","last_active":"2023-10-10T22:34:39.365604+0000","last_peered":"2023-10-10T22:34:39.365604+0000","last_clean":"2023-10-10T22:34:39.365604+0000","last_became_active":"2023-10-10T22:34:39.361990+0000","last_became_peered":"2023-10-10T22:34:39.361990+0000","last_unstale":"2023-10-10T22:34:39.365604+0000","last_undegraded":"2023-10-10T22:34:39.365604+0000","last_fullsized":"2023-10-10T22:34:39.365604+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:53.148543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371483+0000","last_change":"2023-10-10T22:34:38.347538+0000","last_active":"2023-10-10T22:34:39.371483+0000","last_peered":"2023-10-10T22:34:39.371483+0000","last_clean":"2023-10-10T22:34:39.371483+0000","last_became_active":"2023-10-10T22:34:38.347315+0000","last_became_peered":"2023-10-10T22:34:38.347315+0000","last_unstale":"2023-10-10T22:34:39.371483+0000","last_undegraded":"2023-10-10T22:34:39.371483+0000","last_fullsized":"2023-10-10T22:34:39.371483+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:05.186977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.377096+0000","last_change":"2023-10-10T22:34:38.345977+0000","last_active":"2023-10-10T22:34:39.377096+0000","last_peered":"2023-10-10T22:34:39.377096+0000","last_clean":"2023-10-10T22:34:39.377096+0000","last_became_active":"2023-10-10T22:34:38.345697+0000","last_became_peered":"2023-10-10T22:34:38.345697+0000","last_unstale":"2023-10-10T22:34:39.377096+0000","last_undegraded":"2023-10-10T22:34:39.377096+0000","last_fullsized":"2023-10-10T22:34:39.377096+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:23:33.450441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355599+0000","last_change":"2023-10-10T22:34:39.348763+0000","last_active":"2023-10-10T22:34:39.355599+0000","last_peered":"2023-10-10T22:34:39.355599+0000","last_clean":"2023-10-10T22:34:39.355599+0000","last_became_active":"2023-10-10T22:34:39.348522+0000","last_became_peered":"2023-10-10T22:34:39.348522+0000","last_unstale":"2023-10-10T22:34:39.355599+0000","last_undegraded":"2023-10-10T22:34:39.355599+0000","last_fullsized":"2023-10-10T22:34:39.355599+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:04:16.976709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323289+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361660+0000","last_change":"2023-10-10T22:34:39.354944+0000","last_active":"2023-10-10T22:34:39.361660+0000","last_peered":"2023-10-10T22:34:39.361660+0000","last_clean":"2023-10-10T22:34:39.361660+0000","last_became_active":"2023-10-10T22:34:39.354688+0000","last_became_peered":"2023-10-10T22:34:39.354688+0000","last_unstale":"2023-10-10T22:34:39.361660+0000","last_undegraded":"2023-10-10T22:34:39.361660+0000","last_fullsized":"2023-10-10T22:34:39.361660+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:39.385854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371725+0000","last_change":"2023-10-10T22:34:38.345988+0000","last_active":"2023-10-10T22:34:39.371725+0000","last_peered":"2023-10-10T22:34:39.371725+0000","last_clean":"2023-10-10T22:34:39.371725+0000","last_became_active":"2023-10-10T22:34:38.345712+0000","last_became_peered":"2023-10-10T22:34:38.345712+0000","last_unstale":"2023-10-10T22:34:39.371725+0000","last_undegraded":"2023-10-10T22:34:39.371725+0000","last_fullsized":"2023-10-10T22:34:39.371725+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:24.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360699+0000","last_change":"2023-10-10T22:34:39.359133+0000","last_active":"2023-10-10T22:34:39.360699+0000","last_peered":"2023-10-10T22:34:39.360699+0000","last_clean":"2023-10-10T22:34:39.360699+0000","last_became_active":"2023-10-10T22:34:39.358861+0000","last_became_peered":"2023-10-10T22:34:39.358861+0000","last_unstale":"2023-10-10T22:34:39.360699+0000","last_undegraded":"2023-10-10T22:34:39.360699+0000","last_fullsized":"2023-10-10T22:34:39.360699+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:08.544990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.345113+0000","last_change":"2023-10-10T22:34:38.343671+0000","last_active":"2023-10-10T22:34:39.345113+0000","last_peered":"2023-10-10T22:34:39.345113+0000","last_clean":"2023-10-10T22:34:39.345113+0000","last_became_active":"2023-10-10T22:34:38.343422+0000","last_became_peered":"2023-10-10T22:34:38.343422+0000","last_unstale":"2023-10-10T22:34:39.345113+0000","last_undegraded":"2023-10-10T22:34:39.345113+0000","last_fullsized":"2023-10-10T22:34:39.345113+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:30.755114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363268+0000","last_change":"2023-10-10T22:34:39.358093+0000","last_active":"2023-10-10T22:34:39.363268+0000","last_peered":"2023-10-10T22:34:39.363268+0000","last_clean":"2023-10-10T22:34:39.363268+0000","last_became_active":"2023-10-10T22:34:39.357668+0000","last_became_peered":"2023-10-10T22:34:39.357668+0000","last_unstale":"2023-10-10T22:34:39.363268+0000","last_undegraded":"2023-10-10T22:34:39.363268+0000","last_fullsized":"2023-10-10T22:34:39.363268+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:57:19.780519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.337760+0000","last_change":"2023-10-10T22:34:38.347221+0000","last_active":"2023-10-10T22:34:39.337760+0000","last_peered":"2023-10-10T22:34:39.337760+0000","last_clean":"2023-10-10T22:34:39.337760+0000","last_became_active":"2023-10-10T22:34:38.346540+0000","last_became_peered":"2023-10-10T22:34:38.346540+0000","last_unstale":"2023-10-10T22:34:39.337760+0000","last_undegraded":"2023-10-10T22:34:39.337760+0000","last_fullsized":"2023-10-10T22:34:39.337760+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364110+0000","last_change":"2023-10-10T22:34:39.359054+0000","last_active":"2023-10-10T22:34:39.364110+0000","last_peered":"2023-10-10T22:34:39.364110+0000","last_clean":"2023-10-10T22:34:39.364110+0000","last_became_active":"2023-10-10T22:34:39.358728+0000","last_became_peered":"2023-10-10T22:34:39.358728+0000","last_unstale":"2023-10-10T22:34:39.364110+0000","last_undegraded":"2023-10-10T22:34:39.364110+0000","last_fullsized":"2023-10-10T22:34:39.364110+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:46:24.561755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.344344+0000","last_change":"2023-10-10T22:34:38.351309+0000","last_active":"2023-10-10T22:34:39.344344+0000","last_peered":"2023-10-10T22:34:39.344344+0000","last_clean":"2023-10-10T22:34:39.344344+0000","last_became_active":"2023-10-10T22:34:38.350974+0000","last_became_peered":"2023-10-10T22:34:38.350974+0000","last_unstale":"2023-10-10T22:34:39.344344+0000","last_undegraded":"2023-10-10T22:34:39.344344+0000","last_fullsized":"2023-10-10T22:34:39.344344+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:19.823507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364415+0000","last_change":"2023-10-10T22:34:39.359454+0000","last_active":"2023-10-10T22:34:39.364415+0000","last_peered":"2023-10-10T22:34:39.364415+0000","last_clean":"2023-10-10T22:34:39.364415+0000","last_became_active":"2023-10-10T22:34:39.359114+0000","last_became_peered":"2023-10-10T22:34:39.359114+0000","last_unstale":"2023-10-10T22:34:39.364415+0000","last_undegraded":"2023-10-10T22:34:39.364415+0000","last_fullsized":"2023-10-10T22:34:39.364415+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:34:24.445318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"192'3","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375047+0000","last_change":"2023-10-10T22:34:38.343325+0000","last_active":"2023-10-10T22:34:39.375047+0000","last_peered":"2023-10-10T22:34:39.375047+0000","last_clean":"2023-10-10T22:34:39.375047+0000","last_became_active":"2023-10-10T22:34:38.343010+0000","last_became_peered":"2023-10-10T22:34:38.343010+0000","last_unstale":"2023-10-10T22:34:39.375047+0000","last_undegraded":"2023-10-10T22:34:39.375047+0000","last_fullsized":"2023-10-10T22:34:39.375047+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:10.998587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323407+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:37:05.900792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354988+0000","last_change":"2023-10-10T22:34:39.351683+0000","last_active":"2023-10-10T22:34:39.354988+0000","last_peered":"2023-10-10T22:34:39.354988+0000","last_clean":"2023-10-10T22:34:39.354988+0000","last_became_active":"2023-10-10T22:34:39.351408+0000","last_became_peered":"2023-10-10T22:34:39.351408+0000","last_unstale":"2023-10-10T22:34:39.354988+0000","last_undegraded":"2023-10-10T22:34:39.354988+0000","last_fullsized":"2023-10-10T22:34:39.354988+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:52:56.113061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.372204+0000","last_change":"2023-10-10T22:34:38.346608+0000","last_active":"2023-10-10T22:34:39.372204+0000","last_peered":"2023-10-10T22:34:39.372204+0000","last_clean":"2023-10-10T22:34:39.372204+0000","last_became_active":"2023-10-10T22:34:38.346322+0000","last_became_peered":"2023-10-10T22:34:38.346322+0000","last_unstale":"2023-10-10T22:34:39.372204+0000","last_undegraded":"2023-10-10T22:34:39.372204+0000","last_fullsized":"2023-10-10T22:34:39.372204+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:32.171397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363254+0000","last_change":"2023-10-10T22:34:39.360965+0000","last_active":"2023-10-10T22:34:39.363254+0000","last_peered":"2023-10-10T22:34:39.363254+0000","last_clean":"2023-10-10T22:34:39.363254+0000","last_became_active":"2023-10-10T22:34:39.360596+0000","last_became_peered":"2023-10-10T22:34:39.360596+0000","last_unstale":"2023-10-10T22:34:39.363254+0000","last_undegraded":"2023-10-10T22:34:39.363254+0000","last_fullsized":"2023-10-10T22:34:39.363254+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:35:17.534324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.343088+0000","last_change":"2023-10-10T22:34:38.342951+0000","last_active":"2023-10-10T22:34:39.343088+0000","last_peered":"2023-10-10T22:34:39.343088+0000","last_clean":"2023-10-10T22:34:39.343088+0000","last_became_active":"2023-10-10T22:34:38.342633+0000","last_became_peered":"2023-10-10T22:34:38.342633+0000","last_unstale":"2023-10-10T22:34:39.343088+0000","last_undegraded":"2023-10-10T22:34:39.343088+0000","last_fullsized":"2023-10-10T22:34:39.343088+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:40.630602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368257+0000","last_change":"2023-10-10T22:34:39.363723+0000","last_active":"2023-10-10T22:34:39.368257+0000","last_peered":"2023-10-10T22:34:39.368257+0000","last_clean":"2023-10-10T22:34:39.368257+0000","last_became_active":"2023-10-10T22:34:39.362357+0000","last_became_peered":"2023-10-10T22:34:39.362357+0000","last_unstale":"2023-10-10T22:34:39.368257+0000","last_undegraded":"2023-10-10T22:34:39.368257+0000","last_fullsized":"2023-10-10T22:34:39.368257+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:05.154179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341334+0000","last_change":"2023-10-10T22:34:38.348455+0000","last_active":"2023-10-10T22:34:39.341334+0000","last_peered":"2023-10-10T22:34:39.341334+0000","last_clean":"2023-10-10T22:34:39.341334+0000","last_became_active":"2023-10-10T22:34:38.348238+0000","last_became_peered":"2023-10-10T22:34:38.348238+0000","last_unstale":"2023-10-10T22:34:39.341334+0000","last_undegraded":"2023-10-10T22:34:39.341334+0000","last_fullsized":"2023-10-10T22:34:39.341334+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:39.834725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323946+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:26:27.815289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357821+0000","last_change":"2023-10-10T22:34:39.351873+0000","last_active":"2023-10-10T22:34:39.357821+0000","last_peered":"2023-10-10T22:34:39.357821+0000","last_clean":"2023-10-10T22:34:39.357821+0000","last_became_active":"2023-10-10T22:34:39.351061+0000","last_became_peered":"2023-10-10T22:34:39.351061+0000","last_unstale":"2023-10-10T22:34:39.357821+0000","last_undegraded":"2023-10-10T22:34:39.357821+0000","last_fullsized":"2023-10-10T22:34:39.357821+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:04.376717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323205+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:39:42.835006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354935+0000","last_change":"2023-10-10T22:34:39.351667+0000","last_active":"2023-10-10T22:34:39.354935+0000","last_peered":"2023-10-10T22:34:39.354935+0000","last_clean":"2023-10-10T22:34:39.354935+0000","last_became_active":"2023-10-10T22:34:39.351393+0000","last_became_peered":"2023-10-10T22:34:39.351393+0000","last_unstale":"2023-10-10T22:34:39.354935+0000","last_undegraded":"2023-10-10T22:34:39.354935+0000","last_fullsized":"2023-10-10T22:34:39.354935+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:47.675306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323993+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:19.851014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360151+0000","last_change":"2023-10-10T22:34:39.355355+0000","last_active":"2023-10-10T22:34:39.360151+0000","last_peered":"2023-10-10T22:34:39.360151+0000","last_clean":"2023-10-10T22:34:39.360151+0000","last_became_active":"2023-10-10T22:34:39.354553+0000","last_became_peered":"2023-10-10T22:34:39.354553+0000","last_unstale":"2023-10-10T22:34:39.360151+0000","last_undegraded":"2023-10-10T22:34:39.360151+0000","last_fullsized":"2023-10-10T22:34:39.360151+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:05:43.000916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.327729+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:58.021154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355582+0000","last_change":"2023-10-10T22:34:39.350476+0000","last_active":"2023-10-10T22:34:39.355582+0000","last_peered":"2023-10-10T22:34:39.355582+0000","last_clean":"2023-10-10T22:34:39.355582+0000","last_became_active":"2023-10-10T22:34:39.350220+0000","last_became_peered":"2023-10-10T22:34:39.350220+0000","last_unstale":"2023-10-10T22:34:39.355582+0000","last_undegraded":"2023-10-10T22:34:39.355582+0000","last_fullsized":"2023-10-10T22:34:39.355582+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:43.202754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.327684+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:40.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371650+0000","last_change":"2023-10-10T22:34:38.349149+0000","last_active":"2023-10-10T22:34:39.371650+0000","last_peered":"2023-10-10T22:34:39.371650+0000","last_clean":"2023-10-10T22:34:39.371650+0000","last_became_active":"2023-10-10T22:34:38.348826+0000","last_became_peered":"2023-10-10T22:34:38.348826+0000","last_unstale":"2023-10-10T22:34:39.371650+0000","last_undegraded":"2023-10-10T22:34:39.371650+0000","last_fullsized":"2023-10-10T22:34:39.371650+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:46:04.840202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363236+0000","last_change":"2023-10-10T22:34:39.359963+0000","last_active":"2023-10-10T22:34:39.363236+0000","last_peered":"2023-10-10T22:34:39.363236+0000","last_clean":"2023-10-10T22:34:39.363236+0000","last_became_active":"2023-10-10T22:34:39.359619+0000","last_became_peered":"2023-10-10T22:34:39.359619+0000","last_unstale":"2023-10-10T22:34:39.363236+0000","last_undegraded":"2023-10-10T22:34:39.363236+0000","last_fullsized":"2023-10-10T22:34:39.363236+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:53.222053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.328262+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:23.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341438+0000","last_change":"2023-10-10T22:34:38.351131+0000","last_active":"2023-10-10T22:34:39.341438+0000","last_peered":"2023-10-10T22:34:39.341438+0000","last_clean":"2023-10-10T22:34:39.341438+0000","last_became_active":"2023-10-10T22:34:38.350834+0000","last_became_peered":"2023-10-10T22:34:38.350834+0000","last_unstale":"2023-10-10T22:34:39.341438+0000","last_undegraded":"2023-10-10T22:34:39.341438+0000","last_fullsized":"2023-10-10T22:34:39.341438+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:39:55.430063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368472+0000","last_change":"2023-10-10T22:34:39.364264+0000","last_active":"2023-10-10T22:34:39.368472+0000","last_peered":"2023-10-10T22:34:39.368472+0000","last_clean":"2023-10-10T22:34:39.368472+0000","last_became_active":"2023-10-10T22:34:39.364001+0000","last_became_peered":"2023-10-10T22:34:39.364001+0000","last_unstale":"2023-10-10T22:34:39.368472+0000","last_undegraded":"2023-10-10T22:34:39.368472+0000","last_fullsized":"2023-10-10T22:34:39.368472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:13.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.327785+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:33.423030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364340+0000","last_change":"2023-10-10T22:34:39.359432+0000","last_active":"2023-10-10T22:34:39.364340+0000","last_peered":"2023-10-10T22:34:39.364340+0000","last_clean":"2023-10-10T22:34:39.364340+0000","last_became_active":"2023-10-10T22:34:39.358785+0000","last_became_peered":"2023-10-10T22:34:39.358785+0000","last_unstale":"2023-10-10T22:34:39.364340+0000","last_undegraded":"2023-10-10T22:34:39.364340+0000","last_fullsized":"2023-10-10T22:34:39.364340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:12:04.760644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371647+0000","last_change":"2023-10-10T22:34:38.348511+0000","last_active":"2023-10-10T22:34:39.371647+0000","last_peered":"2023-10-10T22:34:39.371647+0000","last_clean":"2023-10-10T22:34:39.371647+0000","last_became_active":"2023-10-10T22:34:38.348207+0000","last_became_peered":"2023-10-10T22:34:38.348207+0000","last_unstale":"2023-10-10T22:34:39.371647+0000","last_undegraded":"2023-10-10T22:34:39.371647+0000","last_fullsized":"2023-10-10T22:34:39.371647+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:58:44.571683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361003+0000","last_change":"2023-10-10T22:34:39.355266+0000","last_active":"2023-10-10T22:34:39.361003+0000","last_peered":"2023-10-10T22:34:39.361003+0000","last_clean":"2023-10-10T22:34:39.361003+0000","last_became_active":"2023-10-10T22:34:39.355008+0000","last_became_peered":"2023-10-10T22:34:39.355008+0000","last_unstale":"2023-10-10T22:34:39.361003+0000","last_undegraded":"2023-10-10T22:34:39.361003+0000","last_fullsized":"2023-10-10T22:34:39.361003+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323285+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:23:02.934919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357626+0000","last_change":"2023-10-10T22:34:39.352912+0000","last_active":"2023-10-10T22:34:39.357626+0000","last_peered":"2023-10-10T22:34:39.357626+0000","last_clean":"2023-10-10T22:34:39.357626+0000","last_became_active":"2023-10-10T22:34:39.352659+0000","last_became_peered":"2023-10-10T22:34:39.352659+0000","last_unstale":"2023-10-10T22:34:39.357626+0000","last_undegraded":"2023-10-10T22:34:39.357626+0000","last_fullsized":"2023-10-10T22:34:39.357626+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:28:55.854343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355884+0000","last_change":"2023-10-10T22:34:38.343062+0000","last_active":"2023-10-10T22:34:39.355884+0000","last_peered":"2023-10-10T22:34:39.355884+0000","last_clean":"2023-10-10T22:34:39.355884+0000","last_became_active":"2023-10-10T22:34:38.342785+0000","last_became_peered":"2023-10-10T22:34:38.342785+0000","last_unstale":"2023-10-10T22:34:39.355884+0000","last_undegraded":"2023-10-10T22:34:39.355884+0000","last_fullsized":"2023-10-10T22:34:39.355884+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:37:29.658776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365464+0000","last_change":"2023-10-10T22:34:39.362657+0000","last_active":"2023-10-10T22:34:39.365464+0000","last_peered":"2023-10-10T22:34:39.365464+0000","last_clean":"2023-10-10T22:34:39.365464+0000","last_became_active":"2023-10-10T22:34:39.362380+0000","last_became_peered":"2023-10-10T22:34:39.362380+0000","last_unstale":"2023-10-10T22:34:39.365464+0000","last_undegraded":"2023-10-10T22:34:39.365464+0000","last_fullsized":"2023-10-10T22:34:39.365464+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:57:18.834083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.342952+0000","last_change":"2023-10-10T22:34:38.347549+0000","last_active":"2023-10-10T22:34:39.342952+0000","last_peered":"2023-10-10T22:34:39.342952+0000","last_clean":"2023-10-10T22:34:39.342952+0000","last_became_active":"2023-10-10T22:34:38.347295+0000","last_became_peered":"2023-10-10T22:34:38.347295+0000","last_unstale":"2023-10-10T22:34:39.342952+0000","last_undegraded":"2023-10-10T22:34:39.342952+0000","last_fullsized":"2023-10-10T22:34:39.342952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:18:33.343928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354970+0000","last_change":"2023-10-10T22:34:39.348743+0000","last_active":"2023-10-10T22:34:39.354970+0000","last_peered":"2023-10-10T22:34:39.354970+0000","last_clean":"2023-10-10T22:34:39.354970+0000","last_became_active":"2023-10-10T22:34:39.348482+0000","last_became_peered":"2023-10-10T22:34:39.348482+0000","last_unstale":"2023-10-10T22:34:39.354970+0000","last_undegraded":"2023-10-10T22:34:39.354970+0000","last_fullsized":"2023-10-10T22:34:39.354970+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:05.835271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.324483+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:37:59.805558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341151+0000","last_change":"2023-10-10T22:34:38.340111+0000","last_active":"2023-10-10T22:34:39.341151+0000","last_peered":"2023-10-10T22:34:39.341151+0000","last_clean":"2023-10-10T22:34:39.341151+0000","last_became_active":"2023-10-10T22:34:38.339803+0000","last_became_peered":"2023-10-10T22:34:38.339803+0000","last_unstale":"2023-10-10T22:34:39.341151+0000","last_undegraded":"2023-10-10T22:34:39.341151+0000","last_fullsized":"2023-10-10T22:34:39.341151+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:54:34.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363484+0000","last_change":"2023-10-10T22:34:39.360326+0000","last_active":"2023-10-10T22:34:39.363484+0000","last_peered":"2023-10-10T22:34:39.363484+0000","last_clean":"2023-10-10T22:34:39.363484+0000","last_became_active":"2023-10-10T22:34:39.360073+0000","last_became_peered":"2023-10-10T22:34:39.360073+0000","last_unstale":"2023-10-10T22:34:39.363484+0000","last_undegraded":"2023-10-10T22:34:39.363484+0000","last_fullsized":"2023-10-10T22:34:39.363484+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353042+0000","last_change":"2023-10-10T22:34:38.344691+0000","last_active":"2023-10-10T22:34:39.353042+0000","last_peered":"2023-10-10T22:34:39.353042+0000","last_clean":"2023-10-10T22:34:39.353042+0000","last_became_active":"2023-10-10T22:34:38.344440+0000","last_became_peered":"2023-10-10T22:34:38.344440+0000","last_unstale":"2023-10-10T22:34:39.353042+0000","last_undegraded":"2023-10-10T22:34:39.353042+0000","last_fullsized":"2023-10-10T22:34:39.353042+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:35:50.647239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323205+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:03.368527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364424+0000","last_change":"2023-10-10T22:34:39.359593+0000","last_active":"2023-10-10T22:34:39.364424+0000","last_peered":"2023-10-10T22:34:39.364424+0000","last_clean":"2023-10-10T22:34:39.364424+0000","last_became_active":"2023-10-10T22:34:39.359168+0000","last_became_peered":"2023-10-10T22:34:39.359168+0000","last_unstale":"2023-10-10T22:34:39.364424+0000","last_undegraded":"2023-10-10T22:34:39.364424+0000","last_fullsized":"2023-10-10T22:34:39.364424+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:58.046132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323234+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:04.145989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"182'326","reported_seq":1052,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-10T22:34:36.010192+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:34:36.010192+0000","last_peered":"2023-10-10T22:34:36.010192+0000","last_clean":"2023-10-10T22:34:36.010192+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:34:36.010192+0000","last_undegraded":"2023-10-10T22:34:36.010192+0000","last_fullsized":"2023-10-10T22:34:36.010192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":90,"acting":90,"num_store_stats":5},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":124,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543243,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312472,"kb_used_data":2896,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059368,"statfs":{"total":96636764160,"available":96316792832,"internally_reserved":0,"allocated":2965504,"data_stored":1777804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.57099999999999995,"5min":0.44500000000000001,"15min":0.36699999999999999},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.026},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.35399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.081},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.60199999999999998,"5min":0.47699999999999998,"15min":0.44700000000000001},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.46600000000000003},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":1.095},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.66000000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92700000000000005,"5min":0.96699999999999997,"15min":1},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.44400000000000001},"max":{"1min":0.91300000000000003,"5min":0.95899999999999996,"15min":0.97599999999999998},"last":0.627}]},{"osd":3,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.63800000000000001,"5min":0.47699999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":0.99099999999999999,"15min":1.0009999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.625,"5min":0.502,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.97399999999999998},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.079,"15min":1.079},"last":0.76100000000000001}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":1.125,"15min":1.125},"last":0.78500000000000003}]}]},{"osd":5,"up_from":14,"seq":60129543242,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315988,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055852,"statfs":{"total":96636764160,"available":96313192448,"internally_reserved":0,"allocated":2371584,"data_stored":1187436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":0.96699999999999997,"15min":1.006},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.39700000000000002},"max":{"1min":0.90100000000000002,"5min":0.997,"15min":0.997},"last":0.62}]},{"osd":1,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.63600000000000001,"5min":0.48499999999999999,"15min":0.371},"max":{"1min":0.90600000000000003,"5min":0.94499999999999995,"15min":1.01},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":1.014,"15min":1.0349999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.44800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.038},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.42299999999999999},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.93600000000000005},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.51700000000000002,"15min":0.48099999999999998},"max":{"1min":0.81499999999999995,"5min":0.97899999999999998,"15min":1.0569999999999999},"last":0.753},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.64800000000000002,"5min":0.55700000000000005,"15min":0.48499999999999999},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":1.0289999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.95799999999999996,"15min":0.98699999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":0.91200000000000003,"15min":1.01},"last":0.72499999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.53300000000000003,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.95299999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.435},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":1.032},"last":0.70799999999999996}]},{"osd":7,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.41799999999999998},"max":{"1min":0.89500000000000002,"5min":0.98999999999999999,"15min":1},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.67400000000000004}]}]},{"osd":1,"up_from":14,"seq":60129543243,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307836,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064004,"statfs":{"total":96636764160,"available":96321540096,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.96299999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82999999999999996,"5min":0.88,"15min":1.179},"last":0.69199999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.82099999999999995,"5min":0.878,"15min":1.0820000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.0489999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.82499999999999996,"15min":1.2150000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.123},"last":0.51700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81299999999999994,"15min":0.81399999999999995},"min":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.54700000000000004},"max":{"1min":1.0329999999999999,"5min":1.0489999999999999,"15min":1.29},"last":1.038},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":1.095,"15min":1.258},"last":0.86499999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1599999999999999,"15min":1.2609999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82299999999999995,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.61599999999999999,"15min":0.56999999999999995},"max":{"1min":1.026,"5min":1.1279999999999999,"15min":1.258},"last":0.95799999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.628,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":1.0940000000000001,"5min":1.1279999999999999,"15min":1.2869999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.877,"15min":0.871},"min":{"1min":0.70299999999999996,"5min":0.69199999999999995,"15min":0.628},"max":{"1min":1.069,"5min":1.175,"15min":1.3100000000000001},"last":0.99399999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.155,"15min":1.2450000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84899999999999998,"15min":0.84799999999999998},"min":{"1min":0.66900000000000004,"5min":0.621,"15min":0.53900000000000003},"max":{"1min":1.024,"5min":1.1120000000000001,"15min":1.226},"last":0.88600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543245,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308412,"kb_used_data":2932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063428,"statfs":{"total":96636764160,"available":96320950272,"internally_reserved":0,"allocated":3002368,"data_stored":1798594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.73699999999999999,"15min":0.85299999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.63600000000000001,"5min":0.73299999999999998,"15min":0.96599999999999997},"last":0.626},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81599999999999995,"15min":1.0249999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.64500000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.41199999999999998},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.89800000000000002},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53300000000000003},"max":{"1min":0.95899999999999996,"5min":1.0860000000000001,"15min":1.3340000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96799999999999997,"5min":1.0600000000000001,"15min":1.165},"last":1.056}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.59599999999999997,"5min":0.59399999999999997,"15min":0.53300000000000003},"max":{"1min":0.98699999999999999,"5min":1.079,"15min":1.214},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.629,"5min":0.627,"15min":0.56899999999999995},"max":{"1min":1.0069999999999999,"5min":1.0609999999999999,"15min":1.3089999999999999},"last":1.01}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.874},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":1.0700000000000001,"15min":1.377},"last":1.165},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.875,"15min":0.88200000000000001},"min":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.55200000000000005},"max":{"1min":1.014,"5min":1.123,"15min":1.427},"last":1.0680000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85099999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.56699999999999995},"max":{"1min":0.92900000000000005,"5min":1.0780000000000001,"15min":1.2689999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.153,"15min":1.1899999999999999},"last":0.97799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129543245,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.65300000000000002,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.442,"5min":0.317,"15min":0.31},"max":{"1min":0.70899999999999996,"5min":0.73799999999999999,"15min":0.89500000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.41299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67800000000000005,"5min":0.79700000000000004,"15min":0.80700000000000005},"last":0.432},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.38700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.52400000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.745,"5min":0.80300000000000005,"15min":0.97599999999999998},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.98499999999999999,"5min":1.1679999999999999,"15min":1.288},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.58399999999999996,"5min":0.47399999999999998,"15min":0.41599999999999998},"max":{"1min":0.96799999999999997,"5min":1.149,"15min":1.325},"last":0.71699999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.57799999999999996,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51500000000000001},"max":{"1min":1.147,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84399999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.67500000000000004,"5min":0.58799999999999997,"15min":0.53700000000000003},"max":{"1min":1.147,"5min":1.147,"15min":1.2689999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.625,"5min":0.60399999999999998,"15min":0.54300000000000004},"max":{"1min":1.167,"5min":1.26,"15min":1.26},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.1279999999999999,"5min":1.218,"15min":1.3129999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.65800000000000003,"5min":0.59199999999999997,"15min":0.54500000000000004},"max":{"1min":1.0700000000000001,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":15,"seq":64424510540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311932,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059908,"statfs":{"total":96636764160,"available":96317345792,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76700000000000002,"15min":0.79800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.435}]},{"osd":1,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.39400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32900000000000001},"max":{"1min":0.79500000000000004,"5min":0.84699999999999998,"15min":0.86899999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.38100000000000001,"15min":0.33800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97999999999999998,"5min":0.99399999999999999,"15min":0.998},"last":0.67100000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.242,"15min":1.2769999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.501},"max":{"1min":1.089,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.65700000000000003,"5min":0.56799999999999995,"15min":0.52900000000000003},"max":{"1min":1.0680000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.79500000000000004},"min":{"1min":0.66700000000000004,"5min":0.54600000000000004,"15min":0.5},"max":{"1min":1.0089999999999999,"5min":1.1379999999999999,"15min":1.383},"last":0.83199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.53000000000000003},"max":{"1min":1.0189999999999999,"5min":1.222,"15min":1.222},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.66800000000000004,"5min":0.58999999999999997,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.212,"15min":1.212},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.63200000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.194},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84299999999999997,"15min":0.84199999999999997},"min":{"1min":0.66800000000000004,"5min":0.629,"15min":0.56699999999999995},"max":{"1min":1.0920000000000001,"5min":1.226,"15min":1.2490000000000001},"last":0.65700000000000003}]}]},{"osd":6,"up_from":14,"seq":60129543243,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44400000000000001},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.56200000000000006,"5min":0.52800000000000002,"15min":0.46300000000000002},"max":{"1min":1.0049999999999999,"5min":1.04,"15min":1.0680000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.627,"5min":0.57999999999999996,"15min":0.47499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0920000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77400000000000002,"15min":0.78900000000000003},"min":{"1min":0.64700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.05,"5min":1.05,"15min":1.129},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.441},"max":{"1min":1.034,"5min":1.034,"15min":1.1200000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.48799999999999999},"max":{"1min":0.98599999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.502,"5min":0.502,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.51500000000000001},"max":{"1min":0.97399999999999998,"5min":1.0249999999999999,"15min":1.071},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":1,"15min":1},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":0.95899999999999996,"15min":0.98999999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.68000000000000005},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.996,"5min":1.006,"15min":1.046},"last":0.872},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95399999999999996,"5min":0.99199999999999999,"15min":1.1479999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.54000000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":1.008},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0880000000000001},"last":0.89900000000000002}]}]},{"osd":4,"up_from":14,"seq":60129543244,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315988,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055852,"statfs":{"total":96636764160,"available":96313192448,"internally_reserved":0,"allocated":2371584,"data_stored":1187436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":0.92400000000000004,"5min":1.0660000000000001,"15min":1.087},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.59699999999999998,"5min":0.47599999999999998,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.64700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.0609999999999999,"15min":1.1220000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46000000000000002},"max":{"1min":0.89000000000000001,"5min":1.018,"15min":1.0509999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58699999999999997,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.996,"5min":1.04,"15min":1.073},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.62,"5min":0.505,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":1.0369999999999999,"15min":1.089},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.4079999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74299999999999999,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0229999999999999,"15min":1.282},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73499999999999999,"5min":0.94099999999999995,"15min":1.6539999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":0.84299999999999997,"5min":1.0900000000000001,"15min":1.5169999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.143},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.57899999999999996,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":1.0569999999999999,"15min":1.1990000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48599999999999999,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":1.21,"15min":1.21},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.48199999999999998,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.0980000000000001,"15min":1.361},"last":0.83299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:34:44.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:34:44.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:34:44.254 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:34:44.313 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-10-10T22:34:44.312+0000 7f64979f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T22:34:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.352+0000 7f400bfff700 1 Processor -- start 2023-10-10T22:34:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.352+0000 7f400bfff700 1 -- start start 2023-10-10T22:34:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.353+0000 7f400bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f400c1593b0 0x7f400c159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.353+0000 7f400bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 0x7f400c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.353+0000 7f400bfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400c0b6570 con 0x7f400c0ceaa0 2023-10-10T22:34:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.353+0000 7f400bfff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c0cfe20 con 0x7f400c1593b0 2023-10-10T22:34:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.353+0000 7f400bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0cf210 con 0x7f400c0b1e50 2023-10-10T22:34:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.353+0000 7f4003fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f400c0ceaa0 0x7f400c0b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33262/0 (socket says 172.21.15.154:33262) 2023-10-10T22:34:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.353+0000 7f4003fff700 1 -- 172.21.15.154:0/1151333171 learned_addr learned my addr 172.21.15.154:0/1151333171 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.353+0000 7f400affd700 1 --2- 172.21.15.154:0/1151333171 >> v2:172.21.15.154:3300/0 conn(0x7f400c1593b0 0x7f400c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.354+0000 7f400b7fe700 1 --2- 172.21.15.154:0/1151333171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 0x7f400c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.354+0000 7f400a7fc700 1 -- 172.21.15.154:0/1151333171 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308342658 0 0) 0x7f3ff4001110 con 0x7f400c0ceaa0 2023-10-10T22:34:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.354+0000 7f400a7fc700 1 -- 172.21.15.154:0/1151333171 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff8003570 con 0x7f400c0ceaa0 2023-10-10T22:34:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.354+0000 7f400affd700 1 -- 172.21.15.154:0/1151333171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 msgr2=0x7f400c0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.354+0000 7f400affd700 1 --2- 172.21.15.154:0/1151333171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 0x7f400c0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.354+0000 7f400affd700 1 -- 172.21.15.154:0/1151333171 >> v1:172.21.15.154:6789/0 conn(0x7f400c0ceaa0 legacy=0x7f400c0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.354+0000 7f400affd700 1 -- 172.21.15.154:0/1151333171 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0cf4f0 con 0x7f400c1593b0 2023-10-10T22:34:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.354+0000 7f400affd700 1 --2- 172.21.15.154:0/1151333171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 0x7f400c159780 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0098e0 tx=0x7f3ffc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440eec1d4f2463ca server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400a7fc700 1 -- 172.21.15.154:0/1151333171 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc011630 con 0x7f400c1593b0 2023-10-10T22:34:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400a7fc700 1 -- 172.21.15.154:0/1151333171 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc011790 con 0x7f400c1593b0 2023-10-10T22:34:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400a7fc700 1 -- 172.21.15.154:0/1151333171 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc011b10 con 0x7f400c1593b0 2023-10-10T22:34:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400bfff700 1 -- 172.21.15.154:0/1151333171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 msgr2=0x7f400c159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400bfff700 1 --2- 172.21.15.154:0/1151333171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 0x7f400c159780 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0098e0 tx=0x7f3ffc0091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400bfff700 1 -- 172.21.15.154:0/1151333171 shutdown_connections 2023-10-10T22:34:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400bfff700 1 --2- 172.21.15.154:0/1151333171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 0x7f400c0b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400bfff700 1 --2- 172.21.15.154:0/1151333171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 0x7f400c159780 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400bfff700 1 -- 172.21.15.154:0/1151333171 >> 172.21.15.154:0/1151333171 conn(0x7f400c0d1130 msgr2=0x7f400c0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400bfff700 1 -- 172.21.15.154:0/1151333171 shutdown_connections 2023-10-10T22:34:44.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.355+0000 7f400bfff700 1 -- 172.21.15.154:0/1151333171 wait complete. 2023-10-10T22:34:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.357+0000 7f400bfff700 1 Processor -- start 2023-10-10T22:34:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.357+0000 7f400bfff700 1 -- start start 2023-10-10T22:34:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 0x7f400c0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c0ceaa0 0x7f400c0c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 0x7f400c0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400bfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0c83b0 con 0x7f400c1593b0 2023-10-10T22:34:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0c7df0 con 0x7f400c0ceaa0 2023-10-10T22:34:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0c80d0 con 0x7f400c0b1e50 2023-10-10T22:34:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 0x7f400c0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 0x7f400c0c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57050/0 (socket says 172.21.15.154:57050) 2023-10-10T22:34:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400b7fe700 1 -- 172.21.15.154:0/691265085 learned_addr learned my addr 172.21.15.154:0/691265085 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400affd700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 0x7f400c0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f4003fff700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c0ceaa0 0x7f400c0c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400b7fe700 1 -- 172.21.15.154:0/691265085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 msgr2=0x7f400c0b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400b7fe700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 0x7f400c0b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400b7fe700 1 -- 172.21.15.154:0/691265085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c0ceaa0 msgr2=0x7f400c0c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400b7fe700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c0ceaa0 0x7f400c0c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.358+0000 7f400b7fe700 1 -- 172.21.15.154:0/691265085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc009420 con 0x7f400c1593b0 2023-10-10T22:34:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.359+0000 7f400b7fe700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 0x7f400c0c7350 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f4004009ec0 tx=0x7f400400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.359+0000 7f4002ffd700 1 -- 172.21.15.154:0/691265085 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400cb70 con 0x7f400c1593b0 2023-10-10T22:34:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.359+0000 7f4002ffd700 1 -- 172.21.15.154:0/691265085 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400400f040 con 0x7f400c1593b0 2023-10-10T22:34:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.359+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c0c5530 con 0x7f400c1593b0 2023-10-10T22:34:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.359+0000 7f4002ffd700 1 -- 172.21.15.154:0/691265085 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004014480 con 0x7f400c1593b0 2023-10-10T22:34:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.359+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c16d8b0 con 0x7f400c1593b0 2023-10-10T22:34:44.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.360+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400c0c5a50 con 0x7f400c1593b0 2023-10-10T22:34:44.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.361+0000 7f4002ffd700 1 -- 172.21.15.154:0/691265085 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4004014830 con 0x7f400c1593b0 2023-10-10T22:34:44.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.362+0000 7f4002ffd700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fec066f30 0x7f3fec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.362+0000 7f4002ffd700 1 -- 172.21.15.154:0/691265085 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f40040852e0 con 0x7f400c1593b0 2023-10-10T22:34:44.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.362+0000 7f400affd700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fec066f30 0x7f3fec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.363+0000 7f400affd700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fec066f30 0x7f3fec0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0091e0 tx=0x7f3ffc017000 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:44.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.366+0000 7f4002ffd700 1 -- 172.21.15.154:0/691265085 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4004052360 con 0x7f400c1593b0 2023-10-10T22:34:44.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.556+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f400c04c3c0 con 0x7f3fec066f30 2023-10-10T22:34:44.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.564+0000 7f4002ffd700 1 -- 172.21.15.154:0/691265085 <== mgr.8884 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285724 (secure 0 0 0) 0x7f400c04c3c0 con 0x7f3fec066f30 2023-10-10T22:34:44.569 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:44.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fec066f30 msgr2=0x7f3fec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fec066f30 0x7f3fec0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0091e0 tx=0x7f3ffc017000 comp rx=0 tx=0).stop 2023-10-10T22:34:44.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 msgr2=0x7f400c0c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 0x7f400c0c7350 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f4004009ec0 tx=0x7f400400b040 comp rx=0 tx=0).stop 2023-10-10T22:34:44.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 shutdown_connections 2023-10-10T22:34:44.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fec066f30 0x7f3fec0693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f400c1593b0 0x7f400c0c7350 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c0b1e50 0x7f400c0b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 --2- 172.21.15.154:0/691265085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c0ceaa0 0x7f400c0c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.568+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 >> 172.21.15.154:0/691265085 conn(0x7f400c0d1130 msgr2=0x7f400c069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.569+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 shutdown_connections 2023-10-10T22:34:44.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.569+0000 7f400bfff700 1 -- 172.21.15.154:0/691265085 wait complete. 2023-10-10T22:34:44.574 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:34:44.587 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:34:43.287274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590492,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":556,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2504684,"kb_used_data":19884,"kb_used_omap":0,"kb_used_meta":2484736,"kb_avail":752470036,"statfs":{"total":773094113280,"available":770529316864,"internally_reserved":0,"allocated":20361216,"data_stored":10784354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2544369664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.965011"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364010+0000","last_change":"2023-10-10T22:34:39.362613+0000","last_active":"2023-10-10T22:34:39.364010+0000","last_peered":"2023-10-10T22:34:39.364010+0000","last_clean":"2023-10-10T22:34:39.364010+0000","last_became_active":"2023-10-10T22:34:39.362347+0000","last_became_peered":"2023-10-10T22:34:39.362347+0000","last_unstale":"2023-10-10T22:34:39.364010+0000","last_undegraded":"2023-10-10T22:34:39.364010+0000","last_fullsized":"2023-10-10T22:34:39.364010+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:18.718129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360244+0000","last_change":"2023-10-10T22:34:39.356895+0000","last_active":"2023-10-10T22:34:39.360244+0000","last_peered":"2023-10-10T22:34:39.360244+0000","last_clean":"2023-10-10T22:34:39.360244+0000","last_became_active":"2023-10-10T22:34:39.356597+0000","last_became_peered":"2023-10-10T22:34:39.356597+0000","last_unstale":"2023-10-10T22:34:39.360244+0000","last_undegraded":"2023-10-10T22:34:39.360244+0000","last_fullsized":"2023-10-10T22:34:39.360244+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:44.349327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363231+0000","last_change":"2023-10-10T22:34:39.356523+0000","last_active":"2023-10-10T22:34:39.363231+0000","last_peered":"2023-10-10T22:34:39.363231+0000","last_clean":"2023-10-10T22:34:39.363231+0000","last_became_active":"2023-10-10T22:34:39.356258+0000","last_became_peered":"2023-10-10T22:34:39.356258+0000","last_unstale":"2023-10-10T22:34:39.363231+0000","last_undegraded":"2023-10-10T22:34:39.363231+0000","last_fullsized":"2023-10-10T22:34:39.363231+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:59.029344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362547+0000","last_change":"2023-10-10T22:34:39.356644+0000","last_active":"2023-10-10T22:34:39.362547+0000","last_peered":"2023-10-10T22:34:39.362547+0000","last_clean":"2023-10-10T22:34:39.362547+0000","last_became_active":"2023-10-10T22:34:39.356377+0000","last_became_peered":"2023-10-10T22:34:39.356377+0000","last_unstale":"2023-10-10T22:34:39.362547+0000","last_undegraded":"2023-10-10T22:34:39.362547+0000","last_fullsized":"2023-10-10T22:34:39.362547+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:05.239388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353594+0000","last_change":"2023-10-10T22:34:39.344550+0000","last_active":"2023-10-10T22:34:39.353594+0000","last_peered":"2023-10-10T22:34:39.353594+0000","last_clean":"2023-10-10T22:34:39.353594+0000","last_became_active":"2023-10-10T22:34:39.344094+0000","last_became_peered":"2023-10-10T22:34:39.344094+0000","last_unstale":"2023-10-10T22:34:39.353594+0000","last_undegraded":"2023-10-10T22:34:39.353594+0000","last_fullsized":"2023-10-10T22:34:39.353594+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:59.777710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361095+0000","last_change":"2023-10-10T22:34:39.355546+0000","last_active":"2023-10-10T22:34:39.361095+0000","last_peered":"2023-10-10T22:34:39.361095+0000","last_clean":"2023-10-10T22:34:39.361095+0000","last_became_active":"2023-10-10T22:34:39.355276+0000","last_became_peered":"2023-10-10T22:34:39.355276+0000","last_unstale":"2023-10-10T22:34:39.361095+0000","last_undegraded":"2023-10-10T22:34:39.361095+0000","last_fullsized":"2023-10-10T22:34:39.361095+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365540+0000","last_change":"2023-10-10T22:34:39.363192+0000","last_active":"2023-10-10T22:34:39.365540+0000","last_peered":"2023-10-10T22:34:39.365540+0000","last_clean":"2023-10-10T22:34:39.365540+0000","last_became_active":"2023-10-10T22:34:39.362823+0000","last_became_peered":"2023-10-10T22:34:39.362823+0000","last_unstale":"2023-10-10T22:34:39.365540+0000","last_undegraded":"2023-10-10T22:34:39.365540+0000","last_fullsized":"2023-10-10T22:34:39.365540+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:48:08.525393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361246+0000","last_change":"2023-10-10T22:34:39.355002+0000","last_active":"2023-10-10T22:34:39.361246+0000","last_peered":"2023-10-10T22:34:39.361246+0000","last_clean":"2023-10-10T22:34:39.361246+0000","last_became_active":"2023-10-10T22:34:39.354741+0000","last_became_peered":"2023-10-10T22:34:39.354741+0000","last_unstale":"2023-10-10T22:34:39.361246+0000","last_undegraded":"2023-10-10T22:34:39.361246+0000","last_fullsized":"2023-10-10T22:34:39.361246+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:28.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364399+0000","last_change":"2023-10-10T22:34:39.361870+0000","last_active":"2023-10-10T22:34:39.364399+0000","last_peered":"2023-10-10T22:34:39.364399+0000","last_clean":"2023-10-10T22:34:39.364399+0000","last_became_active":"2023-10-10T22:34:39.361578+0000","last_became_peered":"2023-10-10T22:34:39.361578+0000","last_unstale":"2023-10-10T22:34:39.364399+0000","last_undegraded":"2023-10-10T22:34:39.364399+0000","last_fullsized":"2023-10-10T22:34:39.364399+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363974+0000","last_change":"2023-10-10T22:34:39.361997+0000","last_active":"2023-10-10T22:34:39.363974+0000","last_peered":"2023-10-10T22:34:39.363974+0000","last_clean":"2023-10-10T22:34:39.363974+0000","last_became_active":"2023-10-10T22:34:39.361723+0000","last_became_peered":"2023-10-10T22:34:39.361723+0000","last_unstale":"2023-10-10T22:34:39.363974+0000","last_undegraded":"2023-10-10T22:34:39.363974+0000","last_fullsized":"2023-10-10T22:34:39.363974+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:00.318138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363752+0000","last_change":"2023-10-10T22:34:39.361019+0000","last_active":"2023-10-10T22:34:39.363752+0000","last_peered":"2023-10-10T22:34:39.363752+0000","last_clean":"2023-10-10T22:34:39.363752+0000","last_became_active":"2023-10-10T22:34:39.360680+0000","last_became_peered":"2023-10-10T22:34:39.360680+0000","last_unstale":"2023-10-10T22:34:39.363752+0000","last_undegraded":"2023-10-10T22:34:39.363752+0000","last_fullsized":"2023-10-10T22:34:39.363752+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:59.049929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371642+0000","last_change":"2023-10-10T22:34:39.367948+0000","last_active":"2023-10-10T22:34:39.371642+0000","last_peered":"2023-10-10T22:34:39.371642+0000","last_clean":"2023-10-10T22:34:39.371642+0000","last_became_active":"2023-10-10T22:34:39.367661+0000","last_became_peered":"2023-10-10T22:34:39.367661+0000","last_unstale":"2023-10-10T22:34:39.371642+0000","last_undegraded":"2023-10-10T22:34:39.371642+0000","last_fullsized":"2023-10-10T22:34:39.371642+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:19:56.969395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354986+0000","last_change":"2023-10-10T22:34:39.349734+0000","last_active":"2023-10-10T22:34:39.354986+0000","last_peered":"2023-10-10T22:34:39.354986+0000","last_clean":"2023-10-10T22:34:39.354986+0000","last_became_active":"2023-10-10T22:34:39.349477+0000","last_became_peered":"2023-10-10T22:34:39.349477+0000","last_unstale":"2023-10-10T22:34:39.354986+0000","last_undegraded":"2023-10-10T22:34:39.354986+0000","last_fullsized":"2023-10-10T22:34:39.354986+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:28:23.607097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362726+0000","last_change":"2023-10-10T22:34:39.356873+0000","last_active":"2023-10-10T22:34:39.362726+0000","last_peered":"2023-10-10T22:34:39.362726+0000","last_clean":"2023-10-10T22:34:39.362726+0000","last_became_active":"2023-10-10T22:34:39.356605+0000","last_became_peered":"2023-10-10T22:34:39.356605+0000","last_unstale":"2023-10-10T22:34:39.362726+0000","last_undegraded":"2023-10-10T22:34:39.362726+0000","last_fullsized":"2023-10-10T22:34:39.362726+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:10:21.161733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371750+0000","last_change":"2023-10-10T22:34:39.366653+0000","last_active":"2023-10-10T22:34:39.371750+0000","last_peered":"2023-10-10T22:34:39.371750+0000","last_clean":"2023-10-10T22:34:39.371750+0000","last_became_active":"2023-10-10T22:34:39.366379+0000","last_became_peered":"2023-10-10T22:34:39.366379+0000","last_unstale":"2023-10-10T22:34:39.371750+0000","last_undegraded":"2023-10-10T22:34:39.371750+0000","last_fullsized":"2023-10-10T22:34:39.371750+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:25.485943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363189+0000","last_change":"2023-10-10T22:34:39.357319+0000","last_active":"2023-10-10T22:34:39.363189+0000","last_peered":"2023-10-10T22:34:39.363189+0000","last_clean":"2023-10-10T22:34:39.363189+0000","last_became_active":"2023-10-10T22:34:39.357063+0000","last_became_peered":"2023-10-10T22:34:39.357063+0000","last_unstale":"2023-10-10T22:34:39.363189+0000","last_undegraded":"2023-10-10T22:34:39.363189+0000","last_fullsized":"2023-10-10T22:34:39.363189+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368483+0000","last_change":"2023-10-10T22:34:39.364358+0000","last_active":"2023-10-10T22:34:39.368483+0000","last_peered":"2023-10-10T22:34:39.368483+0000","last_clean":"2023-10-10T22:34:39.368483+0000","last_became_active":"2023-10-10T22:34:39.364086+0000","last_became_peered":"2023-10-10T22:34:39.364086+0000","last_unstale":"2023-10-10T22:34:39.368483+0000","last_undegraded":"2023-10-10T22:34:39.368483+0000","last_fullsized":"2023-10-10T22:34:39.368483+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.318360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375388+0000","last_change":"2023-10-10T22:34:39.372148+0000","last_active":"2023-10-10T22:34:39.375388+0000","last_peered":"2023-10-10T22:34:39.375388+0000","last_clean":"2023-10-10T22:34:39.375388+0000","last_became_active":"2023-10-10T22:34:39.371878+0000","last_became_peered":"2023-10-10T22:34:39.371878+0000","last_unstale":"2023-10-10T22:34:39.375388+0000","last_undegraded":"2023-10-10T22:34:39.375388+0000","last_fullsized":"2023-10-10T22:34:39.375388+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359634+0000","last_change":"2023-10-10T22:34:39.353087+0000","last_active":"2023-10-10T22:34:39.359634+0000","last_peered":"2023-10-10T22:34:39.359634+0000","last_clean":"2023-10-10T22:34:39.359634+0000","last_became_active":"2023-10-10T22:34:39.352790+0000","last_became_peered":"2023-10-10T22:34:39.352790+0000","last_unstale":"2023-10-10T22:34:39.359634+0000","last_undegraded":"2023-10-10T22:34:39.359634+0000","last_fullsized":"2023-10-10T22:34:39.359634+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354084+0000","last_change":"2023-10-10T22:34:39.349571+0000","last_active":"2023-10-10T22:34:39.354084+0000","last_peered":"2023-10-10T22:34:39.354084+0000","last_clean":"2023-10-10T22:34:39.354084+0000","last_became_active":"2023-10-10T22:34:39.349303+0000","last_became_peered":"2023-10-10T22:34:39.349303+0000","last_unstale":"2023-10-10T22:34:39.354084+0000","last_undegraded":"2023-10-10T22:34:39.354084+0000","last_fullsized":"2023-10-10T22:34:39.354084+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:11:21.737863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354911+0000","last_change":"2023-10-10T22:34:39.350004+0000","last_active":"2023-10-10T22:34:39.354911+0000","last_peered":"2023-10-10T22:34:39.354911+0000","last_clean":"2023-10-10T22:34:39.354911+0000","last_became_active":"2023-10-10T22:34:39.349724+0000","last_became_peered":"2023-10-10T22:34:39.349724+0000","last_unstale":"2023-10-10T22:34:39.354911+0000","last_undegraded":"2023-10-10T22:34:39.354911+0000","last_fullsized":"2023-10-10T22:34:39.354911+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:53.460636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359615+0000","last_change":"2023-10-10T22:34:39.352813+0000","last_active":"2023-10-10T22:34:39.359615+0000","last_peered":"2023-10-10T22:34:39.359615+0000","last_clean":"2023-10-10T22:34:39.359615+0000","last_became_active":"2023-10-10T22:34:39.352547+0000","last_became_peered":"2023-10-10T22:34:39.352547+0000","last_unstale":"2023-10-10T22:34:39.359615+0000","last_undegraded":"2023-10-10T22:34:39.359615+0000","last_fullsized":"2023-10-10T22:34:39.359615+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.328258+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:27.899402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.324848+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:39:42.835006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365604+0000","last_change":"2023-10-10T22:34:39.362882+0000","last_active":"2023-10-10T22:34:39.365604+0000","last_peered":"2023-10-10T22:34:39.365604+0000","last_clean":"2023-10-10T22:34:39.365604+0000","last_became_active":"2023-10-10T22:34:39.361990+0000","last_became_peered":"2023-10-10T22:34:39.361990+0000","last_unstale":"2023-10-10T22:34:39.365604+0000","last_undegraded":"2023-10-10T22:34:39.365604+0000","last_fullsized":"2023-10-10T22:34:39.365604+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:53.148543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371483+0000","last_change":"2023-10-10T22:34:38.347538+0000","last_active":"2023-10-10T22:34:39.371483+0000","last_peered":"2023-10-10T22:34:39.371483+0000","last_clean":"2023-10-10T22:34:39.371483+0000","last_became_active":"2023-10-10T22:34:38.347315+0000","last_became_peered":"2023-10-10T22:34:38.347315+0000","last_unstale":"2023-10-10T22:34:39.371483+0000","last_undegraded":"2023-10-10T22:34:39.371483+0000","last_fullsized":"2023-10-10T22:34:39.371483+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:05.186977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.377096+0000","last_change":"2023-10-10T22:34:38.345977+0000","last_active":"2023-10-10T22:34:39.377096+0000","last_peered":"2023-10-10T22:34:39.377096+0000","last_clean":"2023-10-10T22:34:39.377096+0000","last_became_active":"2023-10-10T22:34:38.345697+0000","last_became_peered":"2023-10-10T22:34:38.345697+0000","last_unstale":"2023-10-10T22:34:39.377096+0000","last_undegraded":"2023-10-10T22:34:39.377096+0000","last_fullsized":"2023-10-10T22:34:39.377096+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:23:33.450441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355599+0000","last_change":"2023-10-10T22:34:39.348763+0000","last_active":"2023-10-10T22:34:39.355599+0000","last_peered":"2023-10-10T22:34:39.355599+0000","last_clean":"2023-10-10T22:34:39.355599+0000","last_became_active":"2023-10-10T22:34:39.348522+0000","last_became_peered":"2023-10-10T22:34:39.348522+0000","last_unstale":"2023-10-10T22:34:39.355599+0000","last_undegraded":"2023-10-10T22:34:39.355599+0000","last_fullsized":"2023-10-10T22:34:39.355599+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:04:16.976709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323289+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361660+0000","last_change":"2023-10-10T22:34:39.354944+0000","last_active":"2023-10-10T22:34:39.361660+0000","last_peered":"2023-10-10T22:34:39.361660+0000","last_clean":"2023-10-10T22:34:39.361660+0000","last_became_active":"2023-10-10T22:34:39.354688+0000","last_became_peered":"2023-10-10T22:34:39.354688+0000","last_unstale":"2023-10-10T22:34:39.361660+0000","last_undegraded":"2023-10-10T22:34:39.361660+0000","last_fullsized":"2023-10-10T22:34:39.361660+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:39.385854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371725+0000","last_change":"2023-10-10T22:34:38.345988+0000","last_active":"2023-10-10T22:34:39.371725+0000","last_peered":"2023-10-10T22:34:39.371725+0000","last_clean":"2023-10-10T22:34:39.371725+0000","last_became_active":"2023-10-10T22:34:38.345712+0000","last_became_peered":"2023-10-10T22:34:38.345712+0000","last_unstale":"2023-10-10T22:34:39.371725+0000","last_undegraded":"2023-10-10T22:34:39.371725+0000","last_fullsized":"2023-10-10T22:34:39.371725+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:24.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360699+0000","last_change":"2023-10-10T22:34:39.359133+0000","last_active":"2023-10-10T22:34:39.360699+0000","last_peered":"2023-10-10T22:34:39.360699+0000","last_clean":"2023-10-10T22:34:39.360699+0000","last_became_active":"2023-10-10T22:34:39.358861+0000","last_became_peered":"2023-10-10T22:34:39.358861+0000","last_unstale":"2023-10-10T22:34:39.360699+0000","last_undegraded":"2023-10-10T22:34:39.360699+0000","last_fullsized":"2023-10-10T22:34:39.360699+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:08.544990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.345113+0000","last_change":"2023-10-10T22:34:38.343671+0000","last_active":"2023-10-10T22:34:39.345113+0000","last_peered":"2023-10-10T22:34:39.345113+0000","last_clean":"2023-10-10T22:34:39.345113+0000","last_became_active":"2023-10-10T22:34:38.343422+0000","last_became_peered":"2023-10-10T22:34:38.343422+0000","last_unstale":"2023-10-10T22:34:39.345113+0000","last_undegraded":"2023-10-10T22:34:39.345113+0000","last_fullsized":"2023-10-10T22:34:39.345113+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:30.755114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363268+0000","last_change":"2023-10-10T22:34:39.358093+0000","last_active":"2023-10-10T22:34:39.363268+0000","last_peered":"2023-10-10T22:34:39.363268+0000","last_clean":"2023-10-10T22:34:39.363268+0000","last_became_active":"2023-10-10T22:34:39.357668+0000","last_became_peered":"2023-10-10T22:34:39.357668+0000","last_unstale":"2023-10-10T22:34:39.363268+0000","last_undegraded":"2023-10-10T22:34:39.363268+0000","last_fullsized":"2023-10-10T22:34:39.363268+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:57:19.780519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.337760+0000","last_change":"2023-10-10T22:34:38.347221+0000","last_active":"2023-10-10T22:34:39.337760+0000","last_peered":"2023-10-10T22:34:39.337760+0000","last_clean":"2023-10-10T22:34:39.337760+0000","last_became_active":"2023-10-10T22:34:38.346540+0000","last_became_peered":"2023-10-10T22:34:38.346540+0000","last_unstale":"2023-10-10T22:34:39.337760+0000","last_undegraded":"2023-10-10T22:34:39.337760+0000","last_fullsized":"2023-10-10T22:34:39.337760+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364110+0000","last_change":"2023-10-10T22:34:39.359054+0000","last_active":"2023-10-10T22:34:39.364110+0000","last_peered":"2023-10-10T22:34:39.364110+0000","last_clean":"2023-10-10T22:34:39.364110+0000","last_became_active":"2023-10-10T22:34:39.358728+0000","last_became_peered":"2023-10-10T22:34:39.358728+0000","last_unstale":"2023-10-10T22:34:39.364110+0000","last_undegraded":"2023-10-10T22:34:39.364110+0000","last_fullsized":"2023-10-10T22:34:39.364110+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:46:24.561755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.344344+0000","last_change":"2023-10-10T22:34:38.351309+0000","last_active":"2023-10-10T22:34:39.344344+0000","last_peered":"2023-10-10T22:34:39.344344+0000","last_clean":"2023-10-10T22:34:39.344344+0000","last_became_active":"2023-10-10T22:34:38.350974+0000","last_became_peered":"2023-10-10T22:34:38.350974+0000","last_unstale":"2023-10-10T22:34:39.344344+0000","last_undegraded":"2023-10-10T22:34:39.344344+0000","last_fullsized":"2023-10-10T22:34:39.344344+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:19.823507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364415+0000","last_change":"2023-10-10T22:34:39.359454+0000","last_active":"2023-10-10T22:34:39.364415+0000","last_peered":"2023-10-10T22:34:39.364415+0000","last_clean":"2023-10-10T22:34:39.364415+0000","last_became_active":"2023-10-10T22:34:39.359114+0000","last_became_peered":"2023-10-10T22:34:39.359114+0000","last_unstale":"2023-10-10T22:34:39.364415+0000","last_undegraded":"2023-10-10T22:34:39.364415+0000","last_fullsized":"2023-10-10T22:34:39.364415+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:34:24.445318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"192'3","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375047+0000","last_change":"2023-10-10T22:34:38.343325+0000","last_active":"2023-10-10T22:34:39.375047+0000","last_peered":"2023-10-10T22:34:39.375047+0000","last_clean":"2023-10-10T22:34:39.375047+0000","last_became_active":"2023-10-10T22:34:38.343010+0000","last_became_peered":"2023-10-10T22:34:38.343010+0000","last_unstale":"2023-10-10T22:34:39.375047+0000","last_undegraded":"2023-10-10T22:34:39.375047+0000","last_fullsized":"2023-10-10T22:34:39.375047+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:10.998587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323407+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:37:05.900792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354988+0000","last_change":"2023-10-10T22:34:39.351683+0000","last_active":"2023-10-10T22:34:39.354988+0000","last_peered":"2023-10-10T22:34:39.354988+0000","last_clean":"2023-10-10T22:34:39.354988+0000","last_became_active":"2023-10-10T22:34:39.351408+0000","last_became_peered":"2023-10-10T22:34:39.351408+0000","last_unstale":"2023-10-10T22:34:39.354988+0000","last_undegraded":"2023-10-10T22:34:39.354988+0000","last_fullsized":"2023-10-10T22:34:39.354988+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:52:56.113061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.372204+0000","last_change":"2023-10-10T22:34:38.346608+0000","last_active":"2023-10-10T22:34:39.372204+0000","last_peered":"2023-10-10T22:34:39.372204+0000","last_clean":"2023-10-10T22:34:39.372204+0000","last_became_active":"2023-10-10T22:34:38.346322+0000","last_became_peered":"2023-10-10T22:34:38.346322+0000","last_unstale":"2023-10-10T22:34:39.372204+0000","last_undegraded":"2023-10-10T22:34:39.372204+0000","last_fullsized":"2023-10-10T22:34:39.372204+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:32.171397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363254+0000","last_change":"2023-10-10T22:34:39.360965+0000","last_active":"2023-10-10T22:34:39.363254+0000","last_peered":"2023-10-10T22:34:39.363254+0000","last_clean":"2023-10-10T22:34:39.363254+0000","last_became_active":"2023-10-10T22:34:39.360596+0000","last_became_peered":"2023-10-10T22:34:39.360596+0000","last_unstale":"2023-10-10T22:34:39.363254+0000","last_undegraded":"2023-10-10T22:34:39.363254+0000","last_fullsized":"2023-10-10T22:34:39.363254+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:35:17.534324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.343088+0000","last_change":"2023-10-10T22:34:38.342951+0000","last_active":"2023-10-10T22:34:39.343088+0000","last_peered":"2023-10-10T22:34:39.343088+0000","last_clean":"2023-10-10T22:34:39.343088+0000","last_became_active":"2023-10-10T22:34:38.342633+0000","last_became_peered":"2023-10-10T22:34:38.342633+0000","last_unstale":"2023-10-10T22:34:39.343088+0000","last_undegraded":"2023-10-10T22:34:39.343088+0000","last_fullsized":"2023-10-10T22:34:39.343088+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:40.630602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368257+0000","last_change":"2023-10-10T22:34:39.363723+0000","last_active":"2023-10-10T22:34:39.368257+0000","last_peered":"2023-10-10T22:34:39.368257+0000","last_clean":"2023-10-10T22:34:39.368257+0000","last_became_active":"2023-10-10T22:34:39.362357+0000","last_became_peered":"2023-10-10T22:34:39.362357+0000","last_unstale":"2023-10-10T22:34:39.368257+0000","last_undegraded":"2023-10-10T22:34:39.368257+0000","last_fullsized":"2023-10-10T22:34:39.368257+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:05.154179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341334+0000","last_change":"2023-10-10T22:34:38.348455+0000","last_active":"2023-10-10T22:34:39.341334+0000","last_peered":"2023-10-10T22:34:39.341334+0000","last_clean":"2023-10-10T22:34:39.341334+0000","last_became_active":"2023-10-10T22:34:38.348238+0000","last_became_peered":"2023-10-10T22:34:38.348238+0000","last_unstale":"2023-10-10T22:34:39.341334+0000","last_undegraded":"2023-10-10T22:34:39.341334+0000","last_fullsized":"2023-10-10T22:34:39.341334+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:39.834725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323946+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:26:27.815289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357821+0000","last_change":"2023-10-10T22:34:39.351873+0000","last_active":"2023-10-10T22:34:39.357821+0000","last_peered":"2023-10-10T22:34:39.357821+0000","last_clean":"2023-10-10T22:34:39.357821+0000","last_became_active":"2023-10-10T22:34:39.351061+0000","last_became_peered":"2023-10-10T22:34:39.351061+0000","last_unstale":"2023-10-10T22:34:39.357821+0000","last_undegraded":"2023-10-10T22:34:39.357821+0000","last_fullsized":"2023-10-10T22:34:39.357821+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:04.376717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323205+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:39:42.835006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354935+0000","last_change":"2023-10-10T22:34:39.351667+0000","last_active":"2023-10-10T22:34:39.354935+0000","last_peered":"2023-10-10T22:34:39.354935+0000","last_clean":"2023-10-10T22:34:39.354935+0000","last_became_active":"2023-10-10T22:34:39.351393+0000","last_became_peered":"2023-10-10T22:34:39.351393+0000","last_unstale":"2023-10-10T22:34:39.354935+0000","last_undegraded":"2023-10-10T22:34:39.354935+0000","last_fullsized":"2023-10-10T22:34:39.354935+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:47.675306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323993+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:19.851014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360151+0000","last_change":"2023-10-10T22:34:39.355355+0000","last_active":"2023-10-10T22:34:39.360151+0000","last_peered":"2023-10-10T22:34:39.360151+0000","last_clean":"2023-10-10T22:34:39.360151+0000","last_became_active":"2023-10-10T22:34:39.354553+0000","last_became_peered":"2023-10-10T22:34:39.354553+0000","last_unstale":"2023-10-10T22:34:39.360151+0000","last_undegraded":"2023-10-10T22:34:39.360151+0000","last_fullsized":"2023-10-10T22:34:39.360151+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:05:43.000916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.327729+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:58.021154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355582+0000","last_change":"2023-10-10T22:34:39.350476+0000","last_active":"2023-10-10T22:34:39.355582+0000","last_peered":"2023-10-10T22:34:39.355582+0000","last_clean":"2023-10-10T22:34:39.355582+0000","last_became_active":"2023-10-10T22:34:39.350220+0000","last_became_peered":"2023-10-10T22:34:39.350220+0000","last_unstale":"2023-10-10T22:34:39.355582+0000","last_undegraded":"2023-10-10T22:34:39.355582+0000","last_fullsized":"2023-10-10T22:34:39.355582+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:43.202754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.327684+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:40.204139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371650+0000","last_change":"2023-10-10T22:34:38.349149+0000","last_active":"2023-10-10T22:34:39.371650+0000","last_peered":"2023-10-10T22:34:39.371650+0000","last_clean":"2023-10-10T22:34:39.371650+0000","last_became_active":"2023-10-10T22:34:38.348826+0000","last_became_peered":"2023-10-10T22:34:38.348826+0000","last_unstale":"2023-10-10T22:34:39.371650+0000","last_undegraded":"2023-10-10T22:34:39.371650+0000","last_fullsized":"2023-10-10T22:34:39.371650+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:46:04.840202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363236+0000","last_change":"2023-10-10T22:34:39.359963+0000","last_active":"2023-10-10T22:34:39.363236+0000","last_peered":"2023-10-10T22:34:39.363236+0000","last_clean":"2023-10-10T22:34:39.363236+0000","last_became_active":"2023-10-10T22:34:39.359619+0000","last_became_peered":"2023-10-10T22:34:39.359619+0000","last_unstale":"2023-10-10T22:34:39.363236+0000","last_undegraded":"2023-10-10T22:34:39.363236+0000","last_fullsized":"2023-10-10T22:34:39.363236+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:53.222053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.328262+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:28:23.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341438+0000","last_change":"2023-10-10T22:34:38.351131+0000","last_active":"2023-10-10T22:34:39.341438+0000","last_peered":"2023-10-10T22:34:39.341438+0000","last_clean":"2023-10-10T22:34:39.341438+0000","last_became_active":"2023-10-10T22:34:38.350834+0000","last_became_peered":"2023-10-10T22:34:38.350834+0000","last_unstale":"2023-10-10T22:34:39.341438+0000","last_undegraded":"2023-10-10T22:34:39.341438+0000","last_fullsized":"2023-10-10T22:34:39.341438+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:39:55.430063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368472+0000","last_change":"2023-10-10T22:34:39.364264+0000","last_active":"2023-10-10T22:34:39.368472+0000","last_peered":"2023-10-10T22:34:39.368472+0000","last_clean":"2023-10-10T22:34:39.368472+0000","last_became_active":"2023-10-10T22:34:39.364001+0000","last_became_peered":"2023-10-10T22:34:39.364001+0000","last_unstale":"2023-10-10T22:34:39.368472+0000","last_undegraded":"2023-10-10T22:34:39.368472+0000","last_fullsized":"2023-10-10T22:34:39.368472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:13.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.327785+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:33.423030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364340+0000","last_change":"2023-10-10T22:34:39.359432+0000","last_active":"2023-10-10T22:34:39.364340+0000","last_peered":"2023-10-10T22:34:39.364340+0000","last_clean":"2023-10-10T22:34:39.364340+0000","last_became_active":"2023-10-10T22:34:39.358785+0000","last_became_peered":"2023-10-10T22:34:39.358785+0000","last_unstale":"2023-10-10T22:34:39.364340+0000","last_undegraded":"2023-10-10T22:34:39.364340+0000","last_fullsized":"2023-10-10T22:34:39.364340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:12:04.760644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371647+0000","last_change":"2023-10-10T22:34:38.348511+0000","last_active":"2023-10-10T22:34:39.371647+0000","last_peered":"2023-10-10T22:34:39.371647+0000","last_clean":"2023-10-10T22:34:39.371647+0000","last_became_active":"2023-10-10T22:34:38.348207+0000","last_became_peered":"2023-10-10T22:34:38.348207+0000","last_unstale":"2023-10-10T22:34:39.371647+0000","last_undegraded":"2023-10-10T22:34:39.371647+0000","last_fullsized":"2023-10-10T22:34:39.371647+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:58:44.571683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361003+0000","last_change":"2023-10-10T22:34:39.355266+0000","last_active":"2023-10-10T22:34:39.361003+0000","last_peered":"2023-10-10T22:34:39.361003+0000","last_clean":"2023-10-10T22:34:39.361003+0000","last_became_active":"2023-10-10T22:34:39.355008+0000","last_became_peered":"2023-10-10T22:34:39.355008+0000","last_unstale":"2023-10-10T22:34:39.361003+0000","last_undegraded":"2023-10-10T22:34:39.361003+0000","last_fullsized":"2023-10-10T22:34:39.361003+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323285+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:23:02.934919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357626+0000","last_change":"2023-10-10T22:34:39.352912+0000","last_active":"2023-10-10T22:34:39.357626+0000","last_peered":"2023-10-10T22:34:39.357626+0000","last_clean":"2023-10-10T22:34:39.357626+0000","last_became_active":"2023-10-10T22:34:39.352659+0000","last_became_peered":"2023-10-10T22:34:39.352659+0000","last_unstale":"2023-10-10T22:34:39.357626+0000","last_undegraded":"2023-10-10T22:34:39.357626+0000","last_fullsized":"2023-10-10T22:34:39.357626+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:28:55.854343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355884+0000","last_change":"2023-10-10T22:34:38.343062+0000","last_active":"2023-10-10T22:34:39.355884+0000","last_peered":"2023-10-10T22:34:39.355884+0000","last_clean":"2023-10-10T22:34:39.355884+0000","last_became_active":"2023-10-10T22:34:38.342785+0000","last_became_peered":"2023-10-10T22:34:38.342785+0000","last_unstale":"2023-10-10T22:34:39.355884+0000","last_undegraded":"2023-10-10T22:34:39.355884+0000","last_fullsized":"2023-10-10T22:34:39.355884+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:37:29.658776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365464+0000","last_change":"2023-10-10T22:34:39.362657+0000","last_active":"2023-10-10T22:34:39.365464+0000","last_peered":"2023-10-10T22:34:39.365464+0000","last_clean":"2023-10-10T22:34:39.365464+0000","last_became_active":"2023-10-10T22:34:39.362380+0000","last_became_peered":"2023-10-10T22:34:39.362380+0000","last_unstale":"2023-10-10T22:34:39.365464+0000","last_undegraded":"2023-10-10T22:34:39.365464+0000","last_fullsized":"2023-10-10T22:34:39.365464+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:57:18.834083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.342952+0000","last_change":"2023-10-10T22:34:38.347549+0000","last_active":"2023-10-10T22:34:39.342952+0000","last_peered":"2023-10-10T22:34:39.342952+0000","last_clean":"2023-10-10T22:34:39.342952+0000","last_became_active":"2023-10-10T22:34:38.347295+0000","last_became_peered":"2023-10-10T22:34:38.347295+0000","last_unstale":"2023-10-10T22:34:39.342952+0000","last_undegraded":"2023-10-10T22:34:39.342952+0000","last_fullsized":"2023-10-10T22:34:39.342952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:18:33.343928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354970+0000","last_change":"2023-10-10T22:34:39.348743+0000","last_active":"2023-10-10T22:34:39.354970+0000","last_peered":"2023-10-10T22:34:39.354970+0000","last_clean":"2023-10-10T22:34:39.354970+0000","last_became_active":"2023-10-10T22:34:39.348482+0000","last_became_peered":"2023-10-10T22:34:39.348482+0000","last_unstale":"2023-10-10T22:34:39.354970+0000","last_undegraded":"2023-10-10T22:34:39.354970+0000","last_fullsized":"2023-10-10T22:34:39.354970+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:05.835271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.324483+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:37:59.805558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341151+0000","last_change":"2023-10-10T22:34:38.340111+0000","last_active":"2023-10-10T22:34:39.341151+0000","last_peered":"2023-10-10T22:34:39.341151+0000","last_clean":"2023-10-10T22:34:39.341151+0000","last_became_active":"2023-10-10T22:34:38.339803+0000","last_became_peered":"2023-10-10T22:34:38.339803+0000","last_unstale":"2023-10-10T22:34:39.341151+0000","last_undegraded":"2023-10-10T22:34:39.341151+0000","last_fullsized":"2023-10-10T22:34:39.341151+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:54:34.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363484+0000","last_change":"2023-10-10T22:34:39.360326+0000","last_active":"2023-10-10T22:34:39.363484+0000","last_peered":"2023-10-10T22:34:39.363484+0000","last_clean":"2023-10-10T22:34:39.363484+0000","last_became_active":"2023-10-10T22:34:39.360073+0000","last_became_peered":"2023-10-10T22:34:39.360073+0000","last_unstale":"2023-10-10T22:34:39.363484+0000","last_undegraded":"2023-10-10T22:34:39.363484+0000","last_fullsized":"2023-10-10T22:34:39.363484+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353042+0000","last_change":"2023-10-10T22:34:38.344691+0000","last_active":"2023-10-10T22:34:39.353042+0000","last_peered":"2023-10-10T22:34:39.353042+0000","last_clean":"2023-10-10T22:34:39.353042+0000","last_became_active":"2023-10-10T22:34:38.344440+0000","last_became_peered":"2023-10-10T22:34:38.344440+0000","last_unstale":"2023-10-10T22:34:39.353042+0000","last_undegraded":"2023-10-10T22:34:39.353042+0000","last_fullsized":"2023-10-10T22:34:39.353042+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:35:50.647239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:34:38.319548+0000","last_change":"2023-10-10T22:34:38.319548+0000","last_active":"2023-10-10T22:34:38.319548+0000","last_peered":"2023-10-10T22:34:38.319548+0000","last_clean":"2023-10-10T22:34:38.319548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:38.319548+0000","last_undegraded":"2023-10-10T22:34:38.319548+0000","last_fullsized":"2023-10-10T22:34:38.319548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323205+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:03.368527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364424+0000","last_change":"2023-10-10T22:34:39.359593+0000","last_active":"2023-10-10T22:34:39.364424+0000","last_peered":"2023-10-10T22:34:39.364424+0000","last_clean":"2023-10-10T22:34:39.364424+0000","last_became_active":"2023-10-10T22:34:39.359168+0000","last_became_peered":"2023-10-10T22:34:39.359168+0000","last_unstale":"2023-10-10T22:34:39.364424+0000","last_undegraded":"2023-10-10T22:34:39.364424+0000","last_fullsized":"2023-10-10T22:34:39.364424+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:58.046132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:34:37.311358+0000","last_change":"2023-10-10T22:34:37.323234+0000","last_active":"2023-10-10T22:34:37.311358+0000","last_peered":"2023-10-10T22:34:37.311358+0000","last_clean":"2023-10-10T22:34:37.311358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:34:37.311358+0000","last_undegraded":"2023-10-10T22:34:37.311358+0000","last_fullsized":"2023-10-10T22:34:37.311358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:04.145989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"182'326","reported_seq":1052,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-10T22:34:36.010192+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:34:36.010192+0000","last_peered":"2023-10-10T22:34:36.010192+0000","last_clean":"2023-10-10T22:34:36.010192+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:34:36.010192+0000","last_undegraded":"2023-10-10T22:34:36.010192+0000","last_fullsized":"2023-10-10T22:34:36.010192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":90,"acting":90,"num_store_stats":5},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":124,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543243,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312472,"kb_used_data":2896,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059368,"statfs":{"total":96636764160,"available":96316792832,"internally_reserved":0,"allocated":2965504,"data_stored":1777804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.57099999999999995,"5min":0.44500000000000001,"15min":0.36699999999999999},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.026},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.35399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.081},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.60199999999999998,"5min":0.47699999999999998,"15min":0.44700000000000001},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.46600000000000003},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":1.095},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.66000000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92700000000000005,"5min":0.96699999999999997,"15min":1},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.44400000000000001},"max":{"1min":0.91300000000000003,"5min":0.95899999999999996,"15min":0.97599999999999998},"last":0.627}]},{"osd":3,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.63800000000000001,"5min":0.47699999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":0.99099999999999999,"15min":1.0009999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.625,"5min":0.502,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.97399999999999998},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.079,"15min":1.079},"last":0.76100000000000001}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":1.125,"15min":1.125},"last":0.78500000000000003}]}]},{"osd":5,"up_from":14,"seq":60129543242,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315988,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055852,"statfs":{"total":96636764160,"available":96313192448,"internally_reserved":0,"allocated":2371584,"data_stored":1187436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":0.96699999999999997,"15min":1.006},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.39700000000000002},"max":{"1min":0.90100000000000002,"5min":0.997,"15min":0.997},"last":0.62}]},{"osd":1,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.63600000000000001,"5min":0.48499999999999999,"15min":0.371},"max":{"1min":0.90600000000000003,"5min":0.94499999999999995,"15min":1.01},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":1.014,"15min":1.0349999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.44800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.038},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.42299999999999999},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.93600000000000005},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.51700000000000002,"15min":0.48099999999999998},"max":{"1min":0.81499999999999995,"5min":0.97899999999999998,"15min":1.0569999999999999},"last":0.753},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.64800000000000002,"5min":0.55700000000000005,"15min":0.48499999999999999},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":1.0289999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.95799999999999996,"15min":0.98699999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":0.91200000000000003,"15min":1.01},"last":0.72499999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.53300000000000003,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.95299999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.435},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":1.032},"last":0.70799999999999996}]},{"osd":7,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.41799999999999998},"max":{"1min":0.89500000000000002,"5min":0.98999999999999999,"15min":1},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.67400000000000004}]}]},{"osd":1,"up_from":14,"seq":60129543243,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307836,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064004,"statfs":{"total":96636764160,"available":96321540096,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.96299999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82999999999999996,"5min":0.88,"15min":1.179},"last":0.69199999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.82099999999999995,"5min":0.878,"15min":1.0820000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.0489999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.82499999999999996,"15min":1.2150000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.123},"last":0.51700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81299999999999994,"15min":0.81399999999999995},"min":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.54700000000000004},"max":{"1min":1.0329999999999999,"5min":1.0489999999999999,"15min":1.29},"last":1.038},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":1.095,"15min":1.258},"last":0.86499999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1599999999999999,"15min":1.2609999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82299999999999995,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.61599999999999999,"15min":0.56999999999999995},"max":{"1min":1.026,"5min":1.1279999999999999,"15min":1.258},"last":0.95799999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.628,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":1.0940000000000001,"5min":1.1279999999999999,"15min":1.2869999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.877,"15min":0.871},"min":{"1min":0.70299999999999996,"5min":0.69199999999999995,"15min":0.628},"max":{"1min":1.069,"5min":1.175,"15min":1.3100000000000001},"last":0.99399999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.155,"15min":1.2450000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84899999999999998,"15min":0.84799999999999998},"min":{"1min":0.66900000000000004,"5min":0.621,"15min":0.53900000000000003},"max":{"1min":1.024,"5min":1.1120000000000001,"15min":1.226},"last":0.88600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543245,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308412,"kb_used_data":2932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063428,"statfs":{"total":96636764160,"available":96320950272,"internally_reserved":0,"allocated":3002368,"data_stored":1798594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.73699999999999999,"15min":0.85299999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.63600000000000001,"5min":0.73299999999999998,"15min":0.96599999999999997},"last":0.626},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81599999999999995,"15min":1.0249999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.64500000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.41199999999999998},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.89800000000000002},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53300000000000003},"max":{"1min":0.95899999999999996,"5min":1.0860000000000001,"15min":1.3340000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96799999999999997,"5min":1.0600000000000001,"15min":1.165},"last":1.056}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.59599999999999997,"5min":0.59399999999999997,"15min":0.53300000000000003},"max":{"1min":0.98699999999999999,"5min":1.079,"15min":1.214},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.629,"5min":0.627,"15min":0.56899999999999995},"max":{"1min":1.0069999999999999,"5min":1.0609999999999999,"15min":1.3089999999999999},"last":1.01}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.874},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":1.0700000000000001,"15min":1.377},"last":1.165},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.875,"15min":0.88200000000000001},"min":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.55200000000000005},"max":{"1min":1.014,"5min":1.123,"15min":1.427},"last":1.0680000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85099999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.56699999999999995},"max":{"1min":0.92900000000000005,"5min":1.0780000000000001,"15min":1.2689999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.153,"15min":1.1899999999999999},"last":0.97799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129543245,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.65300000000000002,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.442,"5min":0.317,"15min":0.31},"max":{"1min":0.70899999999999996,"5min":0.73799999999999999,"15min":0.89500000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.41299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67800000000000005,"5min":0.79700000000000004,"15min":0.80700000000000005},"last":0.432},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.38700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.52400000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.745,"5min":0.80300000000000005,"15min":0.97599999999999998},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.98499999999999999,"5min":1.1679999999999999,"15min":1.288},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.58399999999999996,"5min":0.47399999999999998,"15min":0.41599999999999998},"max":{"1min":0.96799999999999997,"5min":1.149,"15min":1.325},"last":0.71699999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.57799999999999996,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51500000000000001},"max":{"1min":1.147,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84399999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.67500000000000004,"5min":0.58799999999999997,"15min":0.53700000000000003},"max":{"1min":1.147,"5min":1.147,"15min":1.2689999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.625,"5min":0.60399999999999998,"15min":0.54300000000000004},"max":{"1min":1.167,"5min":1.26,"15min":1.26},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.1279999999999999,"5min":1.218,"15min":1.3129999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.65800000000000003,"5min":0.59199999999999997,"15min":0.54500000000000004},"max":{"1min":1.0700000000000001,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":15,"seq":64424510540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311932,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059908,"statfs":{"total":96636764160,"available":96317345792,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76700000000000002,"15min":0.79800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.435}]},{"osd":1,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.39400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32900000000000001},"max":{"1min":0.79500000000000004,"5min":0.84699999999999998,"15min":0.86899999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.38100000000000001,"15min":0.33800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97999999999999998,"5min":0.99399999999999999,"15min":0.998},"last":0.67100000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.242,"15min":1.2769999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.501},"max":{"1min":1.089,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.65700000000000003,"5min":0.56799999999999995,"15min":0.52900000000000003},"max":{"1min":1.0680000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.79500000000000004},"min":{"1min":0.66700000000000004,"5min":0.54600000000000004,"15min":0.5},"max":{"1min":1.0089999999999999,"5min":1.1379999999999999,"15min":1.383},"last":0.83199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.53000000000000003},"max":{"1min":1.0189999999999999,"5min":1.222,"15min":1.222},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.66800000000000004,"5min":0.58999999999999997,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.212,"15min":1.212},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.63200000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.194},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84299999999999997,"15min":0.84199999999999997},"min":{"1min":0.66800000000000004,"5min":0.629,"15min":0.56699999999999995},"max":{"1min":1.0920000000000001,"5min":1.226,"15min":1.2490000000000001},"last":0.65700000000000003}]}]},{"osd":6,"up_from":14,"seq":60129543243,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44400000000000001},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.56200000000000006,"5min":0.52800000000000002,"15min":0.46300000000000002},"max":{"1min":1.0049999999999999,"5min":1.04,"15min":1.0680000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.627,"5min":0.57999999999999996,"15min":0.47499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0920000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77400000000000002,"15min":0.78900000000000003},"min":{"1min":0.64700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.05,"5min":1.05,"15min":1.129},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.441},"max":{"1min":1.034,"5min":1.034,"15min":1.1200000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.48799999999999999},"max":{"1min":0.98599999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.502,"5min":0.502,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.51500000000000001},"max":{"1min":0.97399999999999998,"5min":1.0249999999999999,"15min":1.071},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":1,"15min":1},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":0.95899999999999996,"15min":0.98999999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.68000000000000005},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.996,"5min":1.006,"15min":1.046},"last":0.872},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95399999999999996,"5min":0.99199999999999999,"15min":1.1479999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.54000000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":1.008},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0880000000000001},"last":0.89900000000000002}]}]},{"osd":4,"up_from":14,"seq":60129543244,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315988,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055852,"statfs":{"total":96636764160,"available":96313192448,"internally_reserved":0,"allocated":2371584,"data_stored":1187436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":0.92400000000000004,"5min":1.0660000000000001,"15min":1.087},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.59699999999999998,"5min":0.47599999999999998,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.64700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.0609999999999999,"15min":1.1220000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46000000000000002},"max":{"1min":0.89000000000000001,"5min":1.018,"15min":1.0509999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58699999999999997,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.996,"5min":1.04,"15min":1.073},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.62,"5min":0.505,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":1.0369999999999999,"15min":1.089},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.4079999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74299999999999999,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0229999999999999,"15min":1.282},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73499999999999999,"5min":0.94099999999999995,"15min":1.6539999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":0.84299999999999997,"5min":1.0900000000000001,"15min":1.5169999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.143},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.57899999999999996,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":1.0569999999999999,"15min":1.1990000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48599999999999999,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":1.21,"15min":1.21},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.48199999999999998,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.0980000000000001,"15min":1.361},"last":0.83299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:34:44.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3f is not active+clean 2023-10-10T22:34:44.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3d is not active+clean 2023-10-10T22:34:44.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.33 is not active+clean 2023-10-10T22:34:44.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.596 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.32 is not active+clean 2023-10-10T22:34:44.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.31 is not active+clean 2023-10-10T22:34:44.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2c is not active+clean 2023-10-10T22:34:44.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.27 is not active+clean 2023-10-10T22:34:44.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.25 is not active+clean 2023-10-10T22:34:44.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.23 is not active+clean 2023-10-10T22:34:44.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.22 is not active+clean 2023-10-10T22:34:44.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.21 is not active+clean 2023-10-10T22:34:44.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-10-10T22:34:44.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.328258+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T10:05:27.899402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:34:44.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1f is not active+clean 2023-10-10T22:34:44.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-10-10T22:34:44.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.324848+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:39:42.835006+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:34:44.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2023-10-10T22:34:44.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-10-10T22:34:44.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.323289+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:34:44.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.15 is not active+clean 2023-10-10T22:34:44.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-10-10T22:34:44.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.323407+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T00:37:05.900792+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:34:44.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2023-10-10T22:34:44.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-10-10T22:34:44.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.323946+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:26:27.815289+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:34:44.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-10-10T22:34:44.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.323205+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:39:42.835006+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:34:44.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-10-10T22:34:44.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.323993+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T07:01:19.851014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:34:44.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-10-10T22:34:44.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.327729+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:39:58.021154+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:34:44.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-10-10T22:34:44.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.327684+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T02:44:40.204139+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:34:44.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2023-10-10T22:34:44.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-10-10T22:34:44.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.328262+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T23:28:23.644695+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:34:44.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.8 is not active+clean 2023-10-10T22:34:44.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-10-10T22:34:44.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.327785+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:10:33.423030+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-10T22:34:44.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-10-10T22:34:44.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.323285+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T10:23:02.934919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-10T22:34:44.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-10-10T22:34:44.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.324483+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:37:59.805558+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:34:44.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3 is not active+clean 2023-10-10T22:34:44.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2023-10-10T22:34:44.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:34:38.319548+0000', 'last_change': '2023-10-10T22:34:38.319548+0000', 'last_active': '2023-10-10T22:34:38.319548+0000', 'last_peered': '2023-10-10T22:34:38.319548+0000', 'last_clean': '2023-10-10T22:34:38.319548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:38.319548+0000', 'last_undegraded': '2023-10-10T22:34:38.319548+0000', 'last_fullsized': '2023-10-10T22:34:38.319548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:38.319548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:34:44.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-10-10T22:34:44.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.323205+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T01:20:03.368527+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:34:44.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-10-10T22:34:44.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:34:37.311358+0000', 'last_change': '2023-10-10T22:34:37.323234+0000', 'last_active': '2023-10-10T22:34:37.311358+0000', 'last_peered': '2023-10-10T22:34:37.311358+0000', 'last_clean': '2023-10-10T22:34:37.311358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:34:37.311358+0000', 'last_undegraded': '2023-10-10T22:34:37.311358+0000', 'last_fullsized': '2023-10-10T22:34:37.311358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'last_clean_scrub_stamp': '2023-10-10T22:34:37.311358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T08:09:04.145989+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-10T22:34:44.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T22:34:44.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.809+0000 7f9c281ff700 1 Processor -- start 2023-10-10T22:34:44.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.809+0000 7f9c281ff700 1 -- start start 2023-10-10T22:34:44.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.810+0000 7f9c281ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9c20157770 0x7f9c20157b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.810+0000 7f9c281ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c200b1600 0x7f9c200b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c281ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c200acdd0 con 0x7f9c200abd30 2023-10-10T22:34:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c281ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c200b1fb0 con 0x7f9c20157770 2023-10-10T22:34:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c281ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c200ac1c0 con 0x7f9c200b1600 2023-10-10T22:34:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c25f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9c20157770 0x7f9c20157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c25f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9c20157770 0x7f9c20157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57060/0 (socket says 172.21.15.154:57060) 2023-10-10T22:34:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c25f9b700 1 -- 172.21.15.154:0/3081984974 learned_addr learned my addr 172.21.15.154:0/3081984974 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c2679c700 1 --2- 172.21.15.154:0/3081984974 >> v2:172.21.15.179:3300/0 conn(0x7f9c200b1600 0x7f9c200b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c25f9b700 1 -- 172.21.15.154:0/3081984974 >> v2:172.21.15.179:3300/0 conn(0x7f9c200b1600 msgr2=0x7f9c200b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c25f9b700 1 --2- 172.21.15.154:0/3081984974 >> v2:172.21.15.179:3300/0 conn(0x7f9c200b1600 0x7f9c200b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c25f9b700 1 -- 172.21.15.154:0/3081984974 >> v1:172.21.15.179:6789/0 conn(0x7f9c200abd30 legacy=0x7f9c200cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c25f9b700 1 -- 172.21.15.154:0/3081984974 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c200ac4a0 con 0x7f9c20157770 2023-10-10T22:34:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.811+0000 7f9c2679c700 1 --2- 172.21.15.154:0/3081984974 >> v2:172.21.15.179:3300/0 conn(0x7f9c200b1600 0x7f9c200b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c25f9b700 1 --2- 172.21.15.154:0/3081984974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c20157770 0x7f9c20157b40 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f9c20069570 tx=0x7f9c1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb87825e6cf639 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c24f99700 1 -- 172.21.15.154:0/3081984974 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00b820 con 0x7f9c20157770 2023-10-10T22:34:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c24f99700 1 -- 172.21.15.154:0/3081984974 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c00b980 con 0x7f9c20157770 2023-10-10T22:34:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c24f99700 1 -- 172.21.15.154:0/3081984974 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00bd20 con 0x7f9c20157770 2023-10-10T22:34:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c281ff700 1 -- 172.21.15.154:0/3081984974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c20157770 msgr2=0x7f9c20157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c281ff700 1 --2- 172.21.15.154:0/3081984974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c20157770 0x7f9c20157b40 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f9c20069570 tx=0x7f9c1c009250 comp rx=0 tx=0).stop 2023-10-10T22:34:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c281ff700 1 -- 172.21.15.154:0/3081984974 shutdown_connections 2023-10-10T22:34:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c281ff700 1 --2- 172.21.15.154:0/3081984974 >> v2:172.21.15.179:3300/0 conn(0x7f9c200b1600 0x7f9c200b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c281ff700 1 --2- 172.21.15.154:0/3081984974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c20157770 0x7f9c20157b40 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.812+0000 7f9c281ff700 1 -- 172.21.15.154:0/3081984974 >> 172.21.15.154:0/3081984974 conn(0x7f9c2006a310 msgr2=0x7f9c200cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.813+0000 7f9c281ff700 1 -- 172.21.15.154:0/3081984974 shutdown_connections 2023-10-10T22:34:44.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.813+0000 7f9c281ff700 1 -- 172.21.15.154:0/3081984974 wait complete. 2023-10-10T22:34:44.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.814+0000 7f9c281ff700 1 Processor -- start 2023-10-10T22:34:44.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.814+0000 7f9c281ff700 1 -- start start 2023-10-10T22:34:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c281ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c200abd30 0x7f9c200afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c281ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c200b1600 0x7f9c20151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c281ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c20157770 0x7f9c20152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c281ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200b1430 con 0x7f9c200abd30 2023-10-10T22:34:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c281ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200afa40 con 0x7f9c20157770 2023-10-10T22:34:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c281ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200a8090 con 0x7f9c200b1600 2023-10-10T22:34:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c25f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c200abd30 0x7f9c200afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c25f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c200abd30 0x7f9c200afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57070/0 (socket says 172.21.15.154:57070) 2023-10-10T22:34:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c25f9b700 1 -- 172.21.15.154:0/2322843485 learned_addr learned my addr 172.21.15.154:0/2322843485 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:44.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c2679c700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c20157770 0x7f9c20152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c2579a700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c200b1600 0x7f9c20151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.815+0000 7f9c25f9b700 1 -- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c200b1600 msgr2=0x7f9c20151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c25f9b700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c200b1600 0x7f9c20151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c25f9b700 1 -- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c20157770 msgr2=0x7f9c20152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:44.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c25f9b700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c20157770 0x7f9c20152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:44.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c25f9b700 1 -- 172.21.15.154:0/2322843485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c0094f0 con 0x7f9c200abd30 2023-10-10T22:34:44.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c2679c700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c20157770 0x7f9c20152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:44.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c2579a700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c200b1600 0x7f9c20151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:44.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c25f9b700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c200abd30 0x7f9c200afed0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009290 tx=0x7f9c1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:44.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c15ffb700 1 -- 172.21.15.154:0/2322843485 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c011e60 con 0x7f9c200abd30 2023-10-10T22:34:44.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c15ffb700 1 -- 172.21.15.154:0/2322843485 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c020070 con 0x7f9c200abd30 2023-10-10T22:34:44.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c200a8370 con 0x7f9c200abd30 2023-10-10T22:34:44.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c15ffb700 1 -- 172.21.15.154:0/2322843485 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c01b680 con 0x7f9c200abd30 2023-10-10T22:34:44.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.816+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c200af6d0 con 0x7f9c200abd30 2023-10-10T22:34:44.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.817+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c200afd20 con 0x7f9c200abd30 2023-10-10T22:34:44.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.818+0000 7f9c15ffb700 1 -- 172.21.15.154:0/2322843485 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c1c022030 con 0x7f9c200abd30 2023-10-10T22:34:44.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.819+0000 7f9c15ffb700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c04066f30 0x7f9c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:44.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.819+0000 7f9c15ffb700 1 -- 172.21.15.154:0/2322843485 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f9c1c0866f0 con 0x7f9c200abd30 2023-10-10T22:34:44.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.819+0000 7f9c2579a700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c04066f30 0x7f9c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:44.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.820+0000 7f9c2579a700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c04066f30 0x7f9c040693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c20160910 tx=0x7f9c10009040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:44.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:44.823+0000 7f9c15ffb700 1 -- 172.21.15.154:0/2322843485 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c1c053770 con 0x7f9c200abd30 2023-10-10T22:34:45.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.089+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9c200afd20 con 0x7f9c200abd30 2023-10-10T22:34:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.089+0000 7f9c15ffb700 1 -- 172.21.15.154:0/2322843485 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1182 (secure 0 0 0) 0x7f9c1c056d90 con 0x7f9c200abd30 2023-10-10T22:34:45.091 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:45.091 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5570,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":193,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":63},{"state_name":"unknown","count":19},{"state_name":"creating+peering","count":15}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":590492,"bytes_used":2564796416,"bytes_avail":770529316864,"bytes_total":773094113280,"unknown_pgs_ratio":0.19587628543376923,"inactive_pgs_ratio":0.15463916957378387,"write_bytes_sec":1201,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":86,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"b","status":"up:active","gid":9711}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-10-10T22:30:25.112044+0000","services":{}},"progress_events":{}} 2023-10-10T22:34:45.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c04066f30 msgr2=0x7f9c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:45.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c04066f30 0x7f9c040693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c20160910 tx=0x7f9c10009040 comp rx=0 tx=0).stop 2023-10-10T22:34:45.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c200abd30 msgr2=0x7f9c200afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:45.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c200abd30 0x7f9c200afed0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009290 tx=0x7f9c1c016000 comp rx=0 tx=0).stop 2023-10-10T22:34:45.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 shutdown_connections 2023-10-10T22:34:45.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c04066f30 0x7f9c040693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c20157770 0x7f9c20152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c200abd30 0x7f9c200afed0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 --2- 172.21.15.154:0/2322843485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c200b1600 0x7f9c20151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 >> 172.21.15.154:0/2322843485 conn(0x7f9c2006a310 msgr2=0x7f9c200ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 shutdown_connections 2023-10-10T22:34:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.092+0000 7f9c281ff700 1 -- 172.21.15.154:0/2322843485 wait complete. 2023-10-10T22:34:45.111 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T22:34:45.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:34:45.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.293+0000 7fd3923ff700 1 Processor -- start 2023-10-10T22:34:45.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.293+0000 7fd3923ff700 1 -- start start 2023-10-10T22:34:45.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd3923ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd38c0b1c20 0x7fd38c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:45.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd3923ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd38c157820 0x7fd38c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:45.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd3923ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38c157c60 con 0x7fd38c0b1850 2023-10-10T22:34:45.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd3923ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c06fc30 con 0x7fd38c157820 2023-10-10T22:34:45.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd3923ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c0cc260 con 0x7fd38c0b1c20 2023-10-10T22:34:45.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd39099c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd38c157820 0x7fd38c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:45.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd39099c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd38c157820 0x7fd38c0abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57076/0 (socket says 172.21.15.154:57076) 2023-10-10T22:34:45.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd39099c700 1 -- 172.21.15.154:0/2450613969 learned_addr learned my addr 172.21.15.154:0/2450613969 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:45.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd38b7fe700 1 --2- 172.21.15.154:0/2450613969 >> v2:172.21.15.179:3300/0 conn(0x7fd38c0b1c20 0x7fd38c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:45.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd39099c700 1 -- 172.21.15.154:0/2450613969 >> v2:172.21.15.179:3300/0 conn(0x7fd38c0b1c20 msgr2=0x7fd38c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:45.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.295+0000 7fd39099c700 1 --2- 172.21.15.154:0/2450613969 >> v2:172.21.15.179:3300/0 conn(0x7fd38c0b1c20 0x7fd38c1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.296+0000 7fd39099c700 1 -- 172.21.15.154:0/2450613969 >> v1:172.21.15.179:6789/0 conn(0x7fd38c0b1850 legacy=0x7fd38c0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:45.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.296+0000 7fd39099c700 1 -- 172.21.15.154:0/2450613969 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c0cb300 con 0x7fd38c157820 2023-10-10T22:34:45.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.296+0000 7fd39099c700 1 --2- 172.21.15.154:0/2450613969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c157820 0x7fd38c0abf60 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fd38c06d340 tx=0x7fd384009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8368d14f1f6a402c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:45.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.296+0000 7fd38affd700 1 -- 172.21.15.154:0/2450613969 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400e070 con 0x7fd38c157820 2023-10-10T22:34:45.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.296+0000 7fd38affd700 1 -- 172.21.15.154:0/2450613969 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38400ba20 con 0x7fd38c157820 2023-10-10T22:34:45.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.296+0000 7fd38affd700 1 -- 172.21.15.154:0/2450613969 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840092e0 con 0x7fd38c157820 2023-10-10T22:34:45.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.296+0000 7fd3923ff700 1 -- 172.21.15.154:0/2450613969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c157820 msgr2=0x7fd38c0abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:45.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.296+0000 7fd3923ff700 1 --2- 172.21.15.154:0/2450613969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c157820 0x7fd38c0abf60 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fd38c06d340 tx=0x7fd384009840 comp rx=0 tx=0).stop 2023-10-10T22:34:45.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.297+0000 7fd3923ff700 1 -- 172.21.15.154:0/2450613969 shutdown_connections 2023-10-10T22:34:45.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.297+0000 7fd3923ff700 1 --2- 172.21.15.154:0/2450613969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c157820 0x7fd38c0abf60 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.297+0000 7fd3923ff700 1 --2- 172.21.15.154:0/2450613969 >> v2:172.21.15.179:3300/0 conn(0x7fd38c0b1c20 0x7fd38c1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.297+0000 7fd3923ff700 1 -- 172.21.15.154:0/2450613969 >> 172.21.15.154:0/2450613969 conn(0x7fd38c06a320 msgr2=0x7fd38c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:45.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.297+0000 7fd3923ff700 1 -- 172.21.15.154:0/2450613969 shutdown_connections 2023-10-10T22:34:45.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.297+0000 7fd3923ff700 1 -- 172.21.15.154:0/2450613969 wait complete. 2023-10-10T22:34:45.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.298+0000 7fd3923ff700 1 Processor -- start 2023-10-10T22:34:45.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.298+0000 7fd3923ff700 1 -- start start 2023-10-10T22:34:45.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.299+0000 7fd3923ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c0b1850 0x7fd38c14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:45.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.299+0000 7fd3923ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd38c0b1c20 0x7fd38c14c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:45.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.299+0000 7fd3923ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd38c157820 0x7fd38c13da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:45.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.299+0000 7fd3923ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c156050 con 0x7fd38c0b1850 2023-10-10T22:34:45.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.299+0000 7fd3923ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c14df10 con 0x7fd38c0b1c20 2023-10-10T22:34:45.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.299+0000 7fd3923ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c14d300 con 0x7fd38c157820 2023-10-10T22:34:45.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.299+0000 7fd38bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c0b1850 0x7fd38c14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:45.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.299+0000 7fd38bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c0b1850 0x7fd38c14f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57080/0 (socket says 172.21.15.154:57080) 2023-10-10T22:34:45.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.299+0000 7fd38bfff700 1 -- 172.21.15.154:0/762524638 learned_addr learned my addr 172.21.15.154:0/762524638 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:45.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd38bfff700 1 -- 172.21.15.154:0/762524638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd38c157820 msgr2=0x7fd38c13da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:45.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd38bfff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd38c157820 0x7fd38c13da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd38bfff700 1 -- 172.21.15.154:0/762524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd38c0b1c20 msgr2=0x7fd38c14c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:45.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd38b7fe700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd38c0b1c20 0x7fd38c14c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:45.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd38bfff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd38c0b1c20 0x7fd38c14c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd38bfff700 1 -- 172.21.15.154:0/762524638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384009ae0 con 0x7fd38c0b1850 2023-10-10T22:34:45.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd38b7fe700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd38c0b1c20 0x7fd38c14c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:45.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd38bfff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c0b1850 0x7fd38c14f4f0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00c590 tx=0x7fd37c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:45.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd373fff700 1 -- 172.21.15.154:0/762524638 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011590 con 0x7fd38c0b1850 2023-10-10T22:34:45.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd373fff700 1 -- 172.21.15.154:0/762524638 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c0116f0 con 0x7fd38c0b1850 2023-10-10T22:34:45.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c14d5e0 con 0x7fd38c0b1850 2023-10-10T22:34:45.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd373fff700 1 -- 172.21.15.154:0/762524638 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011ab0 con 0x7fd38c0b1850 2023-10-10T22:34:45.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.300+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38c14d970 con 0x7fd38c0b1850 2023-10-10T22:34:45.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.301+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38c14e1f0 con 0x7fd38c0b1850 2023-10-10T22:34:45.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.302+0000 7fd373fff700 1 -- 172.21.15.154:0/762524638 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd37c01b3b0 con 0x7fd38c0b1850 2023-10-10T22:34:45.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.303+0000 7fd373fff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd378066f30 0x7fd3780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:45.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.303+0000 7fd373fff700 1 -- 172.21.15.154:0/762524638 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fd37c083cd0 con 0x7fd38c0b1850 2023-10-10T22:34:45.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.303+0000 7fd38b7fe700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd378066f30 0x7fd3780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:45.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.304+0000 7fd38b7fe700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd378066f30 0x7fd3780693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd380006f00 tx=0x7fd380008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:45.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.307+0000 7fd373fff700 1 -- 172.21.15.154:0/762524638 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd37c050d50 con 0x7fd38c0b1850 2023-10-10T22:34:45.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.501+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd38c04c3c0 con 0x7fd378066f30 2023-10-10T22:34:45.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.509+0000 7fd373fff700 1 -- 172.21.15.154:0/762524638 <== mgr.8884 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289367 (secure 0 0 0) 0x7fd38c04c3c0 con 0x7fd378066f30 2023-10-10T22:34:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:45.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.513+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd378066f30 msgr2=0x7fd3780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:45.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.513+0000 7fd3923ff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd378066f30 0x7fd3780693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd380006f00 tx=0x7fd380008040 comp rx=0 tx=0).stop 2023-10-10T22:34:45.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.513+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c0b1850 msgr2=0x7fd38c14f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:45.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.513+0000 7fd3923ff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c0b1850 0x7fd38c14f4f0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00c590 tx=0x7fd37c00c950 comp rx=0 tx=0).stop 2023-10-10T22:34:45.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.514+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 shutdown_connections 2023-10-10T22:34:45.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.514+0000 7fd3923ff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd378066f30 0x7fd3780693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.514+0000 7fd3923ff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd38c157820 0x7fd38c13da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.514+0000 7fd3923ff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd38c0b1850 0x7fd38c14f4f0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.514+0000 7fd3923ff700 1 --2- 172.21.15.154:0/762524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd38c0b1c20 0x7fd38c14c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.514+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 >> 172.21.15.154:0/762524638 conn(0x7fd38c06a320 msgr2=0x7fd38c0abe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.514+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 shutdown_connections 2023-10-10T22:34:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:45.514+0000 7fd3923ff700 1 -- 172.21.15.154:0/762524638 wait complete. 2023-10-10T22:34:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:34:45.532 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-10T22:34:45.287703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2504840,"kb_used_data":20040,"kb_used_omap":0,"kb_used_meta":2484736,"kb_avail":752469880,"statfs":{"total":773094113280,"available":770529157120,"internally_reserved":0,"allocated":20520960,"data_stored":10851156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2544369664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.964180"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.376861+0000","last_change":"2023-10-10T22:34:39.371536+0000","last_active":"2023-10-10T22:34:39.376861+0000","last_peered":"2023-10-10T22:34:39.376861+0000","last_clean":"2023-10-10T22:34:39.376861+0000","last_became_active":"2023-10-10T22:34:39.371216+0000","last_became_peered":"2023-10-10T22:34:39.371216+0000","last_unstale":"2023-10-10T22:34:39.376861+0000","last_undegraded":"2023-10-10T22:34:39.376861+0000","last_fullsized":"2023-10-10T22:34:39.376861+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:24.190436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364010+0000","last_change":"2023-10-10T22:34:39.362613+0000","last_active":"2023-10-10T22:34:39.364010+0000","last_peered":"2023-10-10T22:34:39.364010+0000","last_clean":"2023-10-10T22:34:39.364010+0000","last_became_active":"2023-10-10T22:34:39.362347+0000","last_became_peered":"2023-10-10T22:34:39.362347+0000","last_unstale":"2023-10-10T22:34:39.364010+0000","last_undegraded":"2023-10-10T22:34:39.364010+0000","last_fullsized":"2023-10-10T22:34:39.364010+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:18.718129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365927+0000","last_change":"2023-10-10T22:34:39.356744+0000","last_active":"2023-10-10T22:34:39.365927+0000","last_peered":"2023-10-10T22:34:39.365927+0000","last_clean":"2023-10-10T22:34:39.365927+0000","last_became_active":"2023-10-10T22:34:39.356463+0000","last_became_peered":"2023-10-10T22:34:39.356463+0000","last_unstale":"2023-10-10T22:34:39.365927+0000","last_undegraded":"2023-10-10T22:34:39.365927+0000","last_fullsized":"2023-10-10T22:34:39.365927+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360244+0000","last_change":"2023-10-10T22:34:39.356895+0000","last_active":"2023-10-10T22:34:39.360244+0000","last_peered":"2023-10-10T22:34:39.360244+0000","last_clean":"2023-10-10T22:34:39.360244+0000","last_became_active":"2023-10-10T22:34:39.356597+0000","last_became_peered":"2023-10-10T22:34:39.356597+0000","last_unstale":"2023-10-10T22:34:39.360244+0000","last_undegraded":"2023-10-10T22:34:39.360244+0000","last_fullsized":"2023-10-10T22:34:39.360244+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:44.349327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363231+0000","last_change":"2023-10-10T22:34:39.356523+0000","last_active":"2023-10-10T22:34:39.363231+0000","last_peered":"2023-10-10T22:34:39.363231+0000","last_clean":"2023-10-10T22:34:39.363231+0000","last_became_active":"2023-10-10T22:34:39.356258+0000","last_became_peered":"2023-10-10T22:34:39.356258+0000","last_unstale":"2023-10-10T22:34:39.363231+0000","last_undegraded":"2023-10-10T22:34:39.363231+0000","last_fullsized":"2023-10-10T22:34:39.363231+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:59.029344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362547+0000","last_change":"2023-10-10T22:34:39.356644+0000","last_active":"2023-10-10T22:34:39.362547+0000","last_peered":"2023-10-10T22:34:39.362547+0000","last_clean":"2023-10-10T22:34:39.362547+0000","last_became_active":"2023-10-10T22:34:39.356377+0000","last_became_peered":"2023-10-10T22:34:39.356377+0000","last_unstale":"2023-10-10T22:34:39.362547+0000","last_undegraded":"2023-10-10T22:34:39.362547+0000","last_fullsized":"2023-10-10T22:34:39.362547+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:05.239388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353594+0000","last_change":"2023-10-10T22:34:39.344550+0000","last_active":"2023-10-10T22:34:39.353594+0000","last_peered":"2023-10-10T22:34:39.353594+0000","last_clean":"2023-10-10T22:34:39.353594+0000","last_became_active":"2023-10-10T22:34:39.344094+0000","last_became_peered":"2023-10-10T22:34:39.344094+0000","last_unstale":"2023-10-10T22:34:39.353594+0000","last_undegraded":"2023-10-10T22:34:39.353594+0000","last_fullsized":"2023-10-10T22:34:39.353594+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:59.777710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361095+0000","last_change":"2023-10-10T22:34:39.355546+0000","last_active":"2023-10-10T22:34:39.361095+0000","last_peered":"2023-10-10T22:34:39.361095+0000","last_clean":"2023-10-10T22:34:39.361095+0000","last_became_active":"2023-10-10T22:34:39.355276+0000","last_became_peered":"2023-10-10T22:34:39.355276+0000","last_unstale":"2023-10-10T22:34:39.361095+0000","last_undegraded":"2023-10-10T22:34:39.361095+0000","last_fullsized":"2023-10-10T22:34:39.361095+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365540+0000","last_change":"2023-10-10T22:34:39.363192+0000","last_active":"2023-10-10T22:34:39.365540+0000","last_peered":"2023-10-10T22:34:39.365540+0000","last_clean":"2023-10-10T22:34:39.365540+0000","last_became_active":"2023-10-10T22:34:39.362823+0000","last_became_peered":"2023-10-10T22:34:39.362823+0000","last_unstale":"2023-10-10T22:34:39.365540+0000","last_undegraded":"2023-10-10T22:34:39.365540+0000","last_fullsized":"2023-10-10T22:34:39.365540+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:48:08.525393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361246+0000","last_change":"2023-10-10T22:34:39.355002+0000","last_active":"2023-10-10T22:34:39.361246+0000","last_peered":"2023-10-10T22:34:39.361246+0000","last_clean":"2023-10-10T22:34:39.361246+0000","last_became_active":"2023-10-10T22:34:39.354741+0000","last_became_peered":"2023-10-10T22:34:39.354741+0000","last_unstale":"2023-10-10T22:34:39.361246+0000","last_undegraded":"2023-10-10T22:34:39.361246+0000","last_fullsized":"2023-10-10T22:34:39.361246+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:28.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364399+0000","last_change":"2023-10-10T22:34:39.361870+0000","last_active":"2023-10-10T22:34:39.364399+0000","last_peered":"2023-10-10T22:34:39.364399+0000","last_clean":"2023-10-10T22:34:39.364399+0000","last_became_active":"2023-10-10T22:34:39.361578+0000","last_became_peered":"2023-10-10T22:34:39.361578+0000","last_unstale":"2023-10-10T22:34:39.364399+0000","last_undegraded":"2023-10-10T22:34:39.364399+0000","last_fullsized":"2023-10-10T22:34:39.364399+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363974+0000","last_change":"2023-10-10T22:34:39.361997+0000","last_active":"2023-10-10T22:34:39.363974+0000","last_peered":"2023-10-10T22:34:39.363974+0000","last_clean":"2023-10-10T22:34:39.363974+0000","last_became_active":"2023-10-10T22:34:39.361723+0000","last_became_peered":"2023-10-10T22:34:39.361723+0000","last_unstale":"2023-10-10T22:34:39.363974+0000","last_undegraded":"2023-10-10T22:34:39.363974+0000","last_fullsized":"2023-10-10T22:34:39.363974+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:00.318138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370237+0000","last_change":"2023-10-10T22:34:39.357855+0000","last_active":"2023-10-10T22:34:39.370237+0000","last_peered":"2023-10-10T22:34:39.370237+0000","last_clean":"2023-10-10T22:34:39.370237+0000","last_became_active":"2023-10-10T22:34:39.356362+0000","last_became_peered":"2023-10-10T22:34:39.356362+0000","last_unstale":"2023-10-10T22:34:39.370237+0000","last_undegraded":"2023-10-10T22:34:39.370237+0000","last_fullsized":"2023-10-10T22:34:39.370237+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368587+0000","last_change":"2023-10-10T22:34:39.357340+0000","last_active":"2023-10-10T22:34:39.368587+0000","last_peered":"2023-10-10T22:34:39.368587+0000","last_clean":"2023-10-10T22:34:39.368587+0000","last_became_active":"2023-10-10T22:34:39.357038+0000","last_became_peered":"2023-10-10T22:34:39.357038+0000","last_unstale":"2023-10-10T22:34:39.368587+0000","last_undegraded":"2023-10-10T22:34:39.368587+0000","last_fullsized":"2023-10-10T22:34:39.368587+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:18.718129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363970+0000","last_change":"2023-10-10T22:34:39.360873+0000","last_active":"2023-10-10T22:34:39.363970+0000","last_peered":"2023-10-10T22:34:39.363970+0000","last_clean":"2023-10-10T22:34:39.363970+0000","last_became_active":"2023-10-10T22:34:39.360580+0000","last_became_peered":"2023-10-10T22:34:39.360580+0000","last_unstale":"2023-10-10T22:34:39.363970+0000","last_undegraded":"2023-10-10T22:34:39.363970+0000","last_fullsized":"2023-10-10T22:34:39.363970+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:27:55.699495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363752+0000","last_change":"2023-10-10T22:34:39.361019+0000","last_active":"2023-10-10T22:34:39.363752+0000","last_peered":"2023-10-10T22:34:39.363752+0000","last_clean":"2023-10-10T22:34:39.363752+0000","last_became_active":"2023-10-10T22:34:39.360680+0000","last_became_peered":"2023-10-10T22:34:39.360680+0000","last_unstale":"2023-10-10T22:34:39.363752+0000","last_undegraded":"2023-10-10T22:34:39.363752+0000","last_fullsized":"2023-10-10T22:34:39.363752+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:59.049929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371642+0000","last_change":"2023-10-10T22:34:39.367948+0000","last_active":"2023-10-10T22:34:39.371642+0000","last_peered":"2023-10-10T22:34:39.371642+0000","last_clean":"2023-10-10T22:34:39.371642+0000","last_became_active":"2023-10-10T22:34:39.367661+0000","last_became_peered":"2023-10-10T22:34:39.367661+0000","last_unstale":"2023-10-10T22:34:39.371642+0000","last_undegraded":"2023-10-10T22:34:39.371642+0000","last_fullsized":"2023-10-10T22:34:39.371642+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:19:56.969395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354986+0000","last_change":"2023-10-10T22:34:39.349734+0000","last_active":"2023-10-10T22:34:39.354986+0000","last_peered":"2023-10-10T22:34:39.354986+0000","last_clean":"2023-10-10T22:34:39.354986+0000","last_became_active":"2023-10-10T22:34:39.349477+0000","last_became_peered":"2023-10-10T22:34:39.349477+0000","last_unstale":"2023-10-10T22:34:39.354986+0000","last_undegraded":"2023-10-10T22:34:39.354986+0000","last_fullsized":"2023-10-10T22:34:39.354986+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:28:23.607097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362726+0000","last_change":"2023-10-10T22:34:39.356873+0000","last_active":"2023-10-10T22:34:39.362726+0000","last_peered":"2023-10-10T22:34:39.362726+0000","last_clean":"2023-10-10T22:34:39.362726+0000","last_became_active":"2023-10-10T22:34:39.356605+0000","last_became_peered":"2023-10-10T22:34:39.356605+0000","last_unstale":"2023-10-10T22:34:39.362726+0000","last_undegraded":"2023-10-10T22:34:39.362726+0000","last_fullsized":"2023-10-10T22:34:39.362726+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:10:21.161733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370219+0000","last_change":"2023-10-10T22:34:39.362351+0000","last_active":"2023-10-10T22:34:39.370219+0000","last_peered":"2023-10-10T22:34:39.370219+0000","last_clean":"2023-10-10T22:34:39.370219+0000","last_became_active":"2023-10-10T22:34:39.362063+0000","last_became_peered":"2023-10-10T22:34:39.362063+0000","last_unstale":"2023-10-10T22:34:39.370219+0000","last_undegraded":"2023-10-10T22:34:39.370219+0000","last_fullsized":"2023-10-10T22:34:39.370219+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:28.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371750+0000","last_change":"2023-10-10T22:34:39.366653+0000","last_active":"2023-10-10T22:34:39.371750+0000","last_peered":"2023-10-10T22:34:39.371750+0000","last_clean":"2023-10-10T22:34:39.371750+0000","last_became_active":"2023-10-10T22:34:39.366379+0000","last_became_peered":"2023-10-10T22:34:39.366379+0000","last_unstale":"2023-10-10T22:34:39.371750+0000","last_undegraded":"2023-10-10T22:34:39.371750+0000","last_fullsized":"2023-10-10T22:34:39.371750+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:25.485943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363189+0000","last_change":"2023-10-10T22:34:39.357319+0000","last_active":"2023-10-10T22:34:39.363189+0000","last_peered":"2023-10-10T22:34:39.363189+0000","last_clean":"2023-10-10T22:34:39.363189+0000","last_became_active":"2023-10-10T22:34:39.357063+0000","last_became_peered":"2023-10-10T22:34:39.357063+0000","last_unstale":"2023-10-10T22:34:39.363189+0000","last_undegraded":"2023-10-10T22:34:39.363189+0000","last_fullsized":"2023-10-10T22:34:39.363189+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368483+0000","last_change":"2023-10-10T22:34:39.364358+0000","last_active":"2023-10-10T22:34:39.368483+0000","last_peered":"2023-10-10T22:34:39.368483+0000","last_clean":"2023-10-10T22:34:39.368483+0000","last_became_active":"2023-10-10T22:34:39.364086+0000","last_became_peered":"2023-10-10T22:34:39.364086+0000","last_unstale":"2023-10-10T22:34:39.368483+0000","last_undegraded":"2023-10-10T22:34:39.368483+0000","last_fullsized":"2023-10-10T22:34:39.368483+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.318360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375388+0000","last_change":"2023-10-10T22:34:39.372148+0000","last_active":"2023-10-10T22:34:39.375388+0000","last_peered":"2023-10-10T22:34:39.375388+0000","last_clean":"2023-10-10T22:34:39.375388+0000","last_became_active":"2023-10-10T22:34:39.371878+0000","last_became_peered":"2023-10-10T22:34:39.371878+0000","last_unstale":"2023-10-10T22:34:39.375388+0000","last_undegraded":"2023-10-10T22:34:39.375388+0000","last_fullsized":"2023-10-10T22:34:39.375388+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370013+0000","last_change":"2023-10-10T22:34:39.357985+0000","last_active":"2023-10-10T22:34:39.370013+0000","last_peered":"2023-10-10T22:34:39.370013+0000","last_clean":"2023-10-10T22:34:39.370013+0000","last_became_active":"2023-10-10T22:34:39.357717+0000","last_became_peered":"2023-10-10T22:34:39.357717+0000","last_unstale":"2023-10-10T22:34:39.370013+0000","last_undegraded":"2023-10-10T22:34:39.370013+0000","last_fullsized":"2023-10-10T22:34:39.370013+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:00.318138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359634+0000","last_change":"2023-10-10T22:34:39.353087+0000","last_active":"2023-10-10T22:34:39.359634+0000","last_peered":"2023-10-10T22:34:39.359634+0000","last_clean":"2023-10-10T22:34:39.359634+0000","last_became_active":"2023-10-10T22:34:39.352790+0000","last_became_peered":"2023-10-10T22:34:39.352790+0000","last_unstale":"2023-10-10T22:34:39.359634+0000","last_undegraded":"2023-10-10T22:34:39.359634+0000","last_fullsized":"2023-10-10T22:34:39.359634+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365899+0000","last_change":"2023-10-10T22:34:39.354335+0000","last_active":"2023-10-10T22:34:39.365899+0000","last_peered":"2023-10-10T22:34:39.365899+0000","last_clean":"2023-10-10T22:34:39.365899+0000","last_became_active":"2023-10-10T22:34:39.353930+0000","last_became_peered":"2023-10-10T22:34:39.353930+0000","last_unstale":"2023-10-10T22:34:39.365899+0000","last_undegraded":"2023-10-10T22:34:39.365899+0000","last_fullsized":"2023-10-10T22:34:39.365899+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:41.212329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354084+0000","last_change":"2023-10-10T22:34:39.349571+0000","last_active":"2023-10-10T22:34:39.354084+0000","last_peered":"2023-10-10T22:34:39.354084+0000","last_clean":"2023-10-10T22:34:39.354084+0000","last_became_active":"2023-10-10T22:34:39.349303+0000","last_became_peered":"2023-10-10T22:34:39.349303+0000","last_unstale":"2023-10-10T22:34:39.354084+0000","last_undegraded":"2023-10-10T22:34:39.354084+0000","last_fullsized":"2023-10-10T22:34:39.354084+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:11:21.737863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.369776+0000","last_change":"2023-10-10T22:34:39.357615+0000","last_active":"2023-10-10T22:34:39.369776+0000","last_peered":"2023-10-10T22:34:39.369776+0000","last_clean":"2023-10-10T22:34:39.369776+0000","last_became_active":"2023-10-10T22:34:39.353984+0000","last_became_peered":"2023-10-10T22:34:39.353984+0000","last_unstale":"2023-10-10T22:34:39.369776+0000","last_undegraded":"2023-10-10T22:34:39.369776+0000","last_fullsized":"2023-10-10T22:34:39.369776+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:59.029344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361232+0000","last_change":"2023-10-10T22:34:39.357021+0000","last_active":"2023-10-10T22:34:39.361232+0000","last_peered":"2023-10-10T22:34:39.361232+0000","last_clean":"2023-10-10T22:34:39.361232+0000","last_became_active":"2023-10-10T22:34:39.356690+0000","last_became_peered":"2023-10-10T22:34:39.356690+0000","last_unstale":"2023-10-10T22:34:39.361232+0000","last_undegraded":"2023-10-10T22:34:39.361232+0000","last_fullsized":"2023-10-10T22:34:39.361232+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:34:33.940317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.349466+0000","last_change":"2023-10-10T22:34:39.343755+0000","last_active":"2023-10-10T22:34:39.349466+0000","last_peered":"2023-10-10T22:34:39.349466+0000","last_clean":"2023-10-10T22:34:39.349466+0000","last_became_active":"2023-10-10T22:34:39.343439+0000","last_became_peered":"2023-10-10T22:34:39.343439+0000","last_unstale":"2023-10-10T22:34:39.349466+0000","last_undegraded":"2023-10-10T22:34:39.349466+0000","last_fullsized":"2023-10-10T22:34:39.349466+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:59.777710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354911+0000","last_change":"2023-10-10T22:34:39.350004+0000","last_active":"2023-10-10T22:34:39.354911+0000","last_peered":"2023-10-10T22:34:39.354911+0000","last_clean":"2023-10-10T22:34:39.354911+0000","last_became_active":"2023-10-10T22:34:39.349724+0000","last_became_peered":"2023-10-10T22:34:39.349724+0000","last_unstale":"2023-10-10T22:34:39.354911+0000","last_undegraded":"2023-10-10T22:34:39.354911+0000","last_fullsized":"2023-10-10T22:34:39.354911+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:53.460636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359615+0000","last_change":"2023-10-10T22:34:39.352813+0000","last_active":"2023-10-10T22:34:39.359615+0000","last_peered":"2023-10-10T22:34:39.359615+0000","last_clean":"2023-10-10T22:34:39.359615+0000","last_became_active":"2023-10-10T22:34:39.352547+0000","last_became_peered":"2023-10-10T22:34:39.352547+0000","last_unstale":"2023-10-10T22:34:39.359615+0000","last_undegraded":"2023-10-10T22:34:39.359615+0000","last_fullsized":"2023-10-10T22:34:39.359615+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"192'4","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.379232+0000","last_change":"2023-10-10T22:34:38.351568+0000","last_active":"2023-10-10T22:34:39.379232+0000","last_peered":"2023-10-10T22:34:39.379232+0000","last_clean":"2023-10-10T22:34:39.379232+0000","last_became_active":"2023-10-10T22:34:38.351225+0000","last_became_peered":"2023-10-10T22:34:38.351225+0000","last_unstale":"2023-10-10T22:34:39.379232+0000","last_undegraded":"2023-10-10T22:34:39.379232+0000","last_fullsized":"2023-10-10T22:34:39.379232+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:37:15.962665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355748+0000","last_change":"2023-10-10T22:34:39.354214+0000","last_active":"2023-10-10T22:34:39.355748+0000","last_peered":"2023-10-10T22:34:39.355748+0000","last_clean":"2023-10-10T22:34:39.355748+0000","last_became_active":"2023-10-10T22:34:39.353954+0000","last_became_peered":"2023-10-10T22:34:39.353954+0000","last_unstale":"2023-10-10T22:34:39.355748+0000","last_undegraded":"2023-10-10T22:34:39.355748+0000","last_fullsized":"2023-10-10T22:34:39.355748+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:43.202754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.369351+0000","last_change":"2023-10-10T22:34:38.347744+0000","last_active":"2023-10-10T22:34:39.369351+0000","last_peered":"2023-10-10T22:34:39.369351+0000","last_clean":"2023-10-10T22:34:39.369351+0000","last_became_active":"2023-10-10T22:34:38.347475+0000","last_became_peered":"2023-10-10T22:34:38.347475+0000","last_unstale":"2023-10-10T22:34:39.369351+0000","last_undegraded":"2023-10-10T22:34:39.369351+0000","last_fullsized":"2023-10-10T22:34:39.369351+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:00.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365604+0000","last_change":"2023-10-10T22:34:39.362882+0000","last_active":"2023-10-10T22:34:39.365604+0000","last_peered":"2023-10-10T22:34:39.365604+0000","last_clean":"2023-10-10T22:34:39.365604+0000","last_became_active":"2023-10-10T22:34:39.361990+0000","last_became_peered":"2023-10-10T22:34:39.361990+0000","last_unstale":"2023-10-10T22:34:39.365604+0000","last_undegraded":"2023-10-10T22:34:39.365604+0000","last_fullsized":"2023-10-10T22:34:39.365604+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:53.148543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371483+0000","last_change":"2023-10-10T22:34:38.347538+0000","last_active":"2023-10-10T22:34:39.371483+0000","last_peered":"2023-10-10T22:34:39.371483+0000","last_clean":"2023-10-10T22:34:39.371483+0000","last_became_active":"2023-10-10T22:34:38.347315+0000","last_became_peered":"2023-10-10T22:34:38.347315+0000","last_unstale":"2023-10-10T22:34:39.371483+0000","last_undegraded":"2023-10-10T22:34:39.371483+0000","last_fullsized":"2023-10-10T22:34:39.371483+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:05.186977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370061+0000","last_change":"2023-10-10T22:34:39.361299+0000","last_active":"2023-10-10T22:34:39.370061+0000","last_peered":"2023-10-10T22:34:39.370061+0000","last_clean":"2023-10-10T22:34:39.370061+0000","last_became_active":"2023-10-10T22:34:39.356707+0000","last_became_peered":"2023-10-10T22:34:39.356707+0000","last_unstale":"2023-10-10T22:34:39.370061+0000","last_undegraded":"2023-10-10T22:34:39.370061+0000","last_fullsized":"2023-10-10T22:34:39.370061+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:34.431220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.377096+0000","last_change":"2023-10-10T22:34:38.345977+0000","last_active":"2023-10-10T22:34:39.377096+0000","last_peered":"2023-10-10T22:34:39.377096+0000","last_clean":"2023-10-10T22:34:39.377096+0000","last_became_active":"2023-10-10T22:34:38.345697+0000","last_became_peered":"2023-10-10T22:34:38.345697+0000","last_unstale":"2023-10-10T22:34:39.377096+0000","last_undegraded":"2023-10-10T22:34:39.377096+0000","last_fullsized":"2023-10-10T22:34:39.377096+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:23:33.450441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355599+0000","last_change":"2023-10-10T22:34:39.348763+0000","last_active":"2023-10-10T22:34:39.355599+0000","last_peered":"2023-10-10T22:34:39.355599+0000","last_clean":"2023-10-10T22:34:39.355599+0000","last_became_active":"2023-10-10T22:34:39.348522+0000","last_became_peered":"2023-10-10T22:34:39.348522+0000","last_unstale":"2023-10-10T22:34:39.355599+0000","last_undegraded":"2023-10-10T22:34:39.355599+0000","last_fullsized":"2023-10-10T22:34:39.355599+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:04:16.976709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.374639+0000","last_change":"2023-10-10T22:34:38.342385+0000","last_active":"2023-10-10T22:34:39.374639+0000","last_peered":"2023-10-10T22:34:39.374639+0000","last_clean":"2023-10-10T22:34:39.374639+0000","last_became_active":"2023-10-10T22:34:38.342066+0000","last_became_peered":"2023-10-10T22:34:38.342066+0000","last_unstale":"2023-10-10T22:34:39.374639+0000","last_undegraded":"2023-10-10T22:34:39.374639+0000","last_fullsized":"2023-10-10T22:34:39.374639+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:00.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361660+0000","last_change":"2023-10-10T22:34:39.354944+0000","last_active":"2023-10-10T22:34:39.361660+0000","last_peered":"2023-10-10T22:34:39.361660+0000","last_clean":"2023-10-10T22:34:39.361660+0000","last_became_active":"2023-10-10T22:34:39.354688+0000","last_became_peered":"2023-10-10T22:34:39.354688+0000","last_unstale":"2023-10-10T22:34:39.361660+0000","last_undegraded":"2023-10-10T22:34:39.361660+0000","last_fullsized":"2023-10-10T22:34:39.361660+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:39.385854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371725+0000","last_change":"2023-10-10T22:34:38.345988+0000","last_active":"2023-10-10T22:34:39.371725+0000","last_peered":"2023-10-10T22:34:39.371725+0000","last_clean":"2023-10-10T22:34:39.371725+0000","last_became_active":"2023-10-10T22:34:38.345712+0000","last_became_peered":"2023-10-10T22:34:38.345712+0000","last_unstale":"2023-10-10T22:34:39.371725+0000","last_undegraded":"2023-10-10T22:34:39.371725+0000","last_fullsized":"2023-10-10T22:34:39.371725+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:24.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360699+0000","last_change":"2023-10-10T22:34:39.359133+0000","last_active":"2023-10-10T22:34:39.360699+0000","last_peered":"2023-10-10T22:34:39.360699+0000","last_clean":"2023-10-10T22:34:39.360699+0000","last_became_active":"2023-10-10T22:34:39.358861+0000","last_became_peered":"2023-10-10T22:34:39.358861+0000","last_unstale":"2023-10-10T22:34:39.360699+0000","last_undegraded":"2023-10-10T22:34:39.360699+0000","last_fullsized":"2023-10-10T22:34:39.360699+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:08.544990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.345113+0000","last_change":"2023-10-10T22:34:38.343671+0000","last_active":"2023-10-10T22:34:39.345113+0000","last_peered":"2023-10-10T22:34:39.345113+0000","last_clean":"2023-10-10T22:34:39.345113+0000","last_became_active":"2023-10-10T22:34:38.343422+0000","last_became_peered":"2023-10-10T22:34:38.343422+0000","last_unstale":"2023-10-10T22:34:39.345113+0000","last_undegraded":"2023-10-10T22:34:39.345113+0000","last_fullsized":"2023-10-10T22:34:39.345113+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:30.755114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363268+0000","last_change":"2023-10-10T22:34:39.358093+0000","last_active":"2023-10-10T22:34:39.363268+0000","last_peered":"2023-10-10T22:34:39.363268+0000","last_clean":"2023-10-10T22:34:39.363268+0000","last_became_active":"2023-10-10T22:34:39.357668+0000","last_became_peered":"2023-10-10T22:34:39.357668+0000","last_unstale":"2023-10-10T22:34:39.363268+0000","last_undegraded":"2023-10-10T22:34:39.363268+0000","last_fullsized":"2023-10-10T22:34:39.363268+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:57:19.780519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.337760+0000","last_change":"2023-10-10T22:34:38.347221+0000","last_active":"2023-10-10T22:34:39.337760+0000","last_peered":"2023-10-10T22:34:39.337760+0000","last_clean":"2023-10-10T22:34:39.337760+0000","last_became_active":"2023-10-10T22:34:38.346540+0000","last_became_peered":"2023-10-10T22:34:38.346540+0000","last_unstale":"2023-10-10T22:34:39.337760+0000","last_undegraded":"2023-10-10T22:34:39.337760+0000","last_fullsized":"2023-10-10T22:34:39.337760+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364110+0000","last_change":"2023-10-10T22:34:39.359054+0000","last_active":"2023-10-10T22:34:39.364110+0000","last_peered":"2023-10-10T22:34:39.364110+0000","last_clean":"2023-10-10T22:34:39.364110+0000","last_became_active":"2023-10-10T22:34:39.358728+0000","last_became_peered":"2023-10-10T22:34:39.358728+0000","last_unstale":"2023-10-10T22:34:39.364110+0000","last_undegraded":"2023-10-10T22:34:39.364110+0000","last_fullsized":"2023-10-10T22:34:39.364110+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:46:24.561755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.344344+0000","last_change":"2023-10-10T22:34:38.351309+0000","last_active":"2023-10-10T22:34:39.344344+0000","last_peered":"2023-10-10T22:34:39.344344+0000","last_clean":"2023-10-10T22:34:39.344344+0000","last_became_active":"2023-10-10T22:34:38.350974+0000","last_became_peered":"2023-10-10T22:34:38.350974+0000","last_unstale":"2023-10-10T22:34:39.344344+0000","last_undegraded":"2023-10-10T22:34:39.344344+0000","last_fullsized":"2023-10-10T22:34:39.344344+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:19.823507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364415+0000","last_change":"2023-10-10T22:34:39.359454+0000","last_active":"2023-10-10T22:34:39.364415+0000","last_peered":"2023-10-10T22:34:39.364415+0000","last_clean":"2023-10-10T22:34:39.364415+0000","last_became_active":"2023-10-10T22:34:39.359114+0000","last_became_peered":"2023-10-10T22:34:39.359114+0000","last_unstale":"2023-10-10T22:34:39.364415+0000","last_undegraded":"2023-10-10T22:34:39.364415+0000","last_fullsized":"2023-10-10T22:34:39.364415+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:34:24.445318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"192'3","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375047+0000","last_change":"2023-10-10T22:34:38.343325+0000","last_active":"2023-10-10T22:34:39.375047+0000","last_peered":"2023-10-10T22:34:39.375047+0000","last_clean":"2023-10-10T22:34:39.375047+0000","last_became_active":"2023-10-10T22:34:38.343010+0000","last_became_peered":"2023-10-10T22:34:38.343010+0000","last_unstale":"2023-10-10T22:34:39.375047+0000","last_undegraded":"2023-10-10T22:34:39.375047+0000","last_fullsized":"2023-10-10T22:34:39.375047+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:10.998587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.367477+0000","last_change":"2023-10-10T22:34:39.360642+0000","last_active":"2023-10-10T22:34:39.367477+0000","last_peered":"2023-10-10T22:34:39.367477+0000","last_clean":"2023-10-10T22:34:39.367477+0000","last_became_active":"2023-10-10T22:34:39.359917+0000","last_became_peered":"2023-10-10T22:34:39.359917+0000","last_unstale":"2023-10-10T22:34:39.367477+0000","last_undegraded":"2023-10-10T22:34:39.367477+0000","last_fullsized":"2023-10-10T22:34:39.367477+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:04:16.976709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"192'6","reported_seq":16,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.379286+0000","last_change":"2023-10-10T22:34:38.345651+0000","last_active":"2023-10-10T22:34:39.379286+0000","last_peered":"2023-10-10T22:34:39.379286+0000","last_clean":"2023-10-10T22:34:39.379286+0000","last_became_active":"2023-10-10T22:34:38.345375+0000","last_became_peered":"2023-10-10T22:34:38.345375+0000","last_unstale":"2023-10-10T22:34:39.379286+0000","last_undegraded":"2023-10-10T22:34:39.379286+0000","last_fullsized":"2023-10-10T22:34:39.379286+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:46:54.508176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354988+0000","last_change":"2023-10-10T22:34:39.351683+0000","last_active":"2023-10-10T22:34:39.354988+0000","last_peered":"2023-10-10T22:34:39.354988+0000","last_clean":"2023-10-10T22:34:39.354988+0000","last_became_active":"2023-10-10T22:34:39.351408+0000","last_became_peered":"2023-10-10T22:34:39.351408+0000","last_unstale":"2023-10-10T22:34:39.354988+0000","last_undegraded":"2023-10-10T22:34:39.354988+0000","last_fullsized":"2023-10-10T22:34:39.354988+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:52:56.113061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.372204+0000","last_change":"2023-10-10T22:34:38.346608+0000","last_active":"2023-10-10T22:34:39.372204+0000","last_peered":"2023-10-10T22:34:39.372204+0000","last_clean":"2023-10-10T22:34:39.372204+0000","last_became_active":"2023-10-10T22:34:38.346322+0000","last_became_peered":"2023-10-10T22:34:38.346322+0000","last_unstale":"2023-10-10T22:34:39.372204+0000","last_undegraded":"2023-10-10T22:34:39.372204+0000","last_fullsized":"2023-10-10T22:34:39.372204+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:32.171397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363254+0000","last_change":"2023-10-10T22:34:39.360965+0000","last_active":"2023-10-10T22:34:39.363254+0000","last_peered":"2023-10-10T22:34:39.363254+0000","last_clean":"2023-10-10T22:34:39.363254+0000","last_became_active":"2023-10-10T22:34:39.360596+0000","last_became_peered":"2023-10-10T22:34:39.360596+0000","last_unstale":"2023-10-10T22:34:39.363254+0000","last_undegraded":"2023-10-10T22:34:39.363254+0000","last_fullsized":"2023-10-10T22:34:39.363254+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:35:17.534324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.343088+0000","last_change":"2023-10-10T22:34:38.342951+0000","last_active":"2023-10-10T22:34:39.343088+0000","last_peered":"2023-10-10T22:34:39.343088+0000","last_clean":"2023-10-10T22:34:39.343088+0000","last_became_active":"2023-10-10T22:34:38.342633+0000","last_became_peered":"2023-10-10T22:34:38.342633+0000","last_unstale":"2023-10-10T22:34:39.343088+0000","last_undegraded":"2023-10-10T22:34:39.343088+0000","last_fullsized":"2023-10-10T22:34:39.343088+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:40.630602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368257+0000","last_change":"2023-10-10T22:34:39.363723+0000","last_active":"2023-10-10T22:34:39.368257+0000","last_peered":"2023-10-10T22:34:39.368257+0000","last_clean":"2023-10-10T22:34:39.368257+0000","last_became_active":"2023-10-10T22:34:39.362357+0000","last_became_peered":"2023-10-10T22:34:39.362357+0000","last_unstale":"2023-10-10T22:34:39.368257+0000","last_undegraded":"2023-10-10T22:34:39.368257+0000","last_fullsized":"2023-10-10T22:34:39.368257+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:05.154179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341334+0000","last_change":"2023-10-10T22:34:38.348455+0000","last_active":"2023-10-10T22:34:39.341334+0000","last_peered":"2023-10-10T22:34:39.341334+0000","last_clean":"2023-10-10T22:34:39.341334+0000","last_became_active":"2023-10-10T22:34:38.348238+0000","last_became_peered":"2023-10-10T22:34:38.348238+0000","last_unstale":"2023-10-10T22:34:39.341334+0000","last_undegraded":"2023-10-10T22:34:39.341334+0000","last_fullsized":"2023-10-10T22:34:39.341334+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:39.834725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370251+0000","last_change":"2023-10-10T22:34:39.360344+0000","last_active":"2023-10-10T22:34:39.370251+0000","last_peered":"2023-10-10T22:34:39.370251+0000","last_clean":"2023-10-10T22:34:39.370251+0000","last_became_active":"2023-10-10T22:34:39.358400+0000","last_became_peered":"2023-10-10T22:34:39.358400+0000","last_unstale":"2023-10-10T22:34:39.370251+0000","last_undegraded":"2023-10-10T22:34:39.370251+0000","last_fullsized":"2023-10-10T22:34:39.370251+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:59.049929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"192'8","reported_seq":18,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.377912+0000","last_change":"2023-10-10T22:34:38.344325+0000","last_active":"2023-10-10T22:34:39.377912+0000","last_peered":"2023-10-10T22:34:39.377912+0000","last_clean":"2023-10-10T22:34:39.377912+0000","last_became_active":"2023-10-10T22:34:38.344062+0000","last_became_peered":"2023-10-10T22:34:38.344062+0000","last_unstale":"2023-10-10T22:34:39.377912+0000","last_undegraded":"2023-10-10T22:34:39.377912+0000","last_fullsized":"2023-10-10T22:34:39.377912+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:32:11.540091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357821+0000","last_change":"2023-10-10T22:34:39.351873+0000","last_active":"2023-10-10T22:34:39.357821+0000","last_peered":"2023-10-10T22:34:39.357821+0000","last_clean":"2023-10-10T22:34:39.357821+0000","last_became_active":"2023-10-10T22:34:39.351061+0000","last_became_peered":"2023-10-10T22:34:39.351061+0000","last_unstale":"2023-10-10T22:34:39.357821+0000","last_undegraded":"2023-10-10T22:34:39.357821+0000","last_fullsized":"2023-10-10T22:34:39.357821+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:04.376717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375658+0000","last_change":"2023-10-10T22:34:38.349029+0000","last_active":"2023-10-10T22:34:39.375658+0000","last_peered":"2023-10-10T22:34:39.375658+0000","last_clean":"2023-10-10T22:34:39.375658+0000","last_became_active":"2023-10-10T22:34:38.348764+0000","last_became_peered":"2023-10-10T22:34:38.348764+0000","last_unstale":"2023-10-10T22:34:39.375658+0000","last_undegraded":"2023-10-10T22:34:39.375658+0000","last_fullsized":"2023-10-10T22:34:39.375658+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:02.879495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354935+0000","last_change":"2023-10-10T22:34:39.351667+0000","last_active":"2023-10-10T22:34:39.354935+0000","last_peered":"2023-10-10T22:34:39.354935+0000","last_clean":"2023-10-10T22:34:39.354935+0000","last_became_active":"2023-10-10T22:34:39.351393+0000","last_became_peered":"2023-10-10T22:34:39.351393+0000","last_unstale":"2023-10-10T22:34:39.354935+0000","last_undegraded":"2023-10-10T22:34:39.354935+0000","last_fullsized":"2023-10-10T22:34:39.354935+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:47.675306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.374078+0000","last_change":"2023-10-10T22:34:38.347383+0000","last_active":"2023-10-10T22:34:39.374078+0000","last_peered":"2023-10-10T22:34:39.374078+0000","last_clean":"2023-10-10T22:34:39.374078+0000","last_became_active":"2023-10-10T22:34:38.347124+0000","last_became_peered":"2023-10-10T22:34:38.347124+0000","last_unstale":"2023-10-10T22:34:39.374078+0000","last_undegraded":"2023-10-10T22:34:39.374078+0000","last_fullsized":"2023-10-10T22:34:39.374078+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:46:54.508176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360151+0000","last_change":"2023-10-10T22:34:39.355355+0000","last_active":"2023-10-10T22:34:39.360151+0000","last_peered":"2023-10-10T22:34:39.360151+0000","last_clean":"2023-10-10T22:34:39.360151+0000","last_became_active":"2023-10-10T22:34:39.354553+0000","last_became_peered":"2023-10-10T22:34:39.354553+0000","last_unstale":"2023-10-10T22:34:39.360151+0000","last_undegraded":"2023-10-10T22:34:39.360151+0000","last_fullsized":"2023-10-10T22:34:39.360151+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:05:43.000916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.376906+0000","last_change":"2023-10-10T22:34:38.339744+0000","last_active":"2023-10-10T22:34:39.376906+0000","last_peered":"2023-10-10T22:34:39.376906+0000","last_clean":"2023-10-10T22:34:39.376906+0000","last_became_active":"2023-10-10T22:34:38.339358+0000","last_became_peered":"2023-10-10T22:34:38.339358+0000","last_unstale":"2023-10-10T22:34:39.376906+0000","last_undegraded":"2023-10-10T22:34:39.376906+0000","last_fullsized":"2023-10-10T22:34:39.376906+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:36:46.689485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355582+0000","last_change":"2023-10-10T22:34:39.350476+0000","last_active":"2023-10-10T22:34:39.355582+0000","last_peered":"2023-10-10T22:34:39.355582+0000","last_clean":"2023-10-10T22:34:39.355582+0000","last_became_active":"2023-10-10T22:34:39.350220+0000","last_became_peered":"2023-10-10T22:34:39.350220+0000","last_unstale":"2023-10-10T22:34:39.355582+0000","last_undegraded":"2023-10-10T22:34:39.355582+0000","last_fullsized":"2023-10-10T22:34:39.355582+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:43.202754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.349047+0000","last_change":"2023-10-10T22:34:38.344777+0000","last_active":"2023-10-10T22:34:39.349047+0000","last_peered":"2023-10-10T22:34:39.349047+0000","last_clean":"2023-10-10T22:34:39.349047+0000","last_became_active":"2023-10-10T22:34:38.344520+0000","last_became_peered":"2023-10-10T22:34:38.344520+0000","last_unstale":"2023-10-10T22:34:39.349047+0000","last_undegraded":"2023-10-10T22:34:39.349047+0000","last_fullsized":"2023-10-10T22:34:39.349047+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:46.904028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365646+0000","last_change":"2023-10-10T22:34:39.349337+0000","last_active":"2023-10-10T22:34:39.365646+0000","last_peered":"2023-10-10T22:34:39.365646+0000","last_clean":"2023-10-10T22:34:39.365646+0000","last_became_active":"2023-10-10T22:34:39.349064+0000","last_became_peered":"2023-10-10T22:34:39.349064+0000","last_unstale":"2023-10-10T22:34:39.365646+0000","last_undegraded":"2023-10-10T22:34:39.365646+0000","last_fullsized":"2023-10-10T22:34:39.365646+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371650+0000","last_change":"2023-10-10T22:34:38.349149+0000","last_active":"2023-10-10T22:34:39.371650+0000","last_peered":"2023-10-10T22:34:39.371650+0000","last_clean":"2023-10-10T22:34:39.371650+0000","last_became_active":"2023-10-10T22:34:38.348826+0000","last_became_peered":"2023-10-10T22:34:38.348826+0000","last_unstale":"2023-10-10T22:34:39.371650+0000","last_undegraded":"2023-10-10T22:34:39.371650+0000","last_fullsized":"2023-10-10T22:34:39.371650+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:46:04.840202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363236+0000","last_change":"2023-10-10T22:34:39.359963+0000","last_active":"2023-10-10T22:34:39.363236+0000","last_peered":"2023-10-10T22:34:39.363236+0000","last_clean":"2023-10-10T22:34:39.363236+0000","last_became_active":"2023-10-10T22:34:39.359619+0000","last_became_peered":"2023-10-10T22:34:39.359619+0000","last_unstale":"2023-10-10T22:34:39.363236+0000","last_undegraded":"2023-10-10T22:34:39.363236+0000","last_fullsized":"2023-10-10T22:34:39.363236+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:53.222053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.347027+0000","last_change":"2023-10-10T22:34:38.346034+0000","last_active":"2023-10-10T22:34:39.347027+0000","last_peered":"2023-10-10T22:34:39.347027+0000","last_clean":"2023-10-10T22:34:39.347027+0000","last_became_active":"2023-10-10T22:34:38.345794+0000","last_became_peered":"2023-10-10T22:34:38.345794+0000","last_unstale":"2023-10-10T22:34:39.347027+0000","last_undegraded":"2023-10-10T22:34:39.347027+0000","last_fullsized":"2023-10-10T22:34:39.347027+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:49:33.159463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361628+0000","last_change":"2023-10-10T22:34:39.359562+0000","last_active":"2023-10-10T22:34:39.361628+0000","last_peered":"2023-10-10T22:34:39.361628+0000","last_clean":"2023-10-10T22:34:39.361628+0000","last_became_active":"2023-10-10T22:34:39.359252+0000","last_became_peered":"2023-10-10T22:34:39.359252+0000","last_unstale":"2023-10-10T22:34:39.361628+0000","last_undegraded":"2023-10-10T22:34:39.361628+0000","last_fullsized":"2023-10-10T22:34:39.361628+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:26:49.254502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341438+0000","last_change":"2023-10-10T22:34:38.351131+0000","last_active":"2023-10-10T22:34:39.341438+0000","last_peered":"2023-10-10T22:34:39.341438+0000","last_clean":"2023-10-10T22:34:39.341438+0000","last_became_active":"2023-10-10T22:34:38.350834+0000","last_became_peered":"2023-10-10T22:34:38.350834+0000","last_unstale":"2023-10-10T22:34:39.341438+0000","last_undegraded":"2023-10-10T22:34:39.341438+0000","last_fullsized":"2023-10-10T22:34:39.341438+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:39:55.430063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368472+0000","last_change":"2023-10-10T22:34:39.364264+0000","last_active":"2023-10-10T22:34:39.368472+0000","last_peered":"2023-10-10T22:34:39.368472+0000","last_clean":"2023-10-10T22:34:39.368472+0000","last_became_active":"2023-10-10T22:34:39.364001+0000","last_became_peered":"2023-10-10T22:34:39.364001+0000","last_unstale":"2023-10-10T22:34:39.368472+0000","last_undegraded":"2023-10-10T22:34:39.368472+0000","last_fullsized":"2023-10-10T22:34:39.368472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:13.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.348552+0000","last_change":"2023-10-10T22:34:38.345484+0000","last_active":"2023-10-10T22:34:39.348552+0000","last_peered":"2023-10-10T22:34:39.348552+0000","last_clean":"2023-10-10T22:34:39.348552+0000","last_became_active":"2023-10-10T22:34:38.345163+0000","last_became_peered":"2023-10-10T22:34:38.345163+0000","last_unstale":"2023-10-10T22:34:39.348552+0000","last_undegraded":"2023-10-10T22:34:39.348552+0000","last_fullsized":"2023-10-10T22:34:39.348552+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:28:21.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364340+0000","last_change":"2023-10-10T22:34:39.359432+0000","last_active":"2023-10-10T22:34:39.364340+0000","last_peered":"2023-10-10T22:34:39.364340+0000","last_clean":"2023-10-10T22:34:39.364340+0000","last_became_active":"2023-10-10T22:34:39.358785+0000","last_became_peered":"2023-10-10T22:34:39.358785+0000","last_unstale":"2023-10-10T22:34:39.364340+0000","last_undegraded":"2023-10-10T22:34:39.364340+0000","last_fullsized":"2023-10-10T22:34:39.364340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:12:04.760644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371647+0000","last_change":"2023-10-10T22:34:38.348511+0000","last_active":"2023-10-10T22:34:39.371647+0000","last_peered":"2023-10-10T22:34:39.371647+0000","last_clean":"2023-10-10T22:34:39.371647+0000","last_became_active":"2023-10-10T22:34:38.348207+0000","last_became_peered":"2023-10-10T22:34:38.348207+0000","last_unstale":"2023-10-10T22:34:39.371647+0000","last_undegraded":"2023-10-10T22:34:39.371647+0000","last_fullsized":"2023-10-10T22:34:39.371647+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:58:44.571683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361003+0000","last_change":"2023-10-10T22:34:39.355266+0000","last_active":"2023-10-10T22:34:39.361003+0000","last_peered":"2023-10-10T22:34:39.361003+0000","last_clean":"2023-10-10T22:34:39.361003+0000","last_became_active":"2023-10-10T22:34:39.355008+0000","last_became_peered":"2023-10-10T22:34:39.355008+0000","last_unstale":"2023-10-10T22:34:39.361003+0000","last_undegraded":"2023-10-10T22:34:39.361003+0000","last_fullsized":"2023-10-10T22:34:39.361003+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.340569+0000","last_change":"2023-10-10T22:34:38.346683+0000","last_active":"2023-10-10T22:34:39.340569+0000","last_peered":"2023-10-10T22:34:39.340569+0000","last_clean":"2023-10-10T22:34:39.340569+0000","last_became_active":"2023-10-10T22:34:38.346422+0000","last_became_peered":"2023-10-10T22:34:38.346422+0000","last_unstale":"2023-10-10T22:34:39.340569+0000","last_undegraded":"2023-10-10T22:34:39.340569+0000","last_fullsized":"2023-10-10T22:34:39.340569+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:32:11.540091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357626+0000","last_change":"2023-10-10T22:34:39.352912+0000","last_active":"2023-10-10T22:34:39.357626+0000","last_peered":"2023-10-10T22:34:39.357626+0000","last_clean":"2023-10-10T22:34:39.357626+0000","last_became_active":"2023-10-10T22:34:39.352659+0000","last_became_peered":"2023-10-10T22:34:39.352659+0000","last_unstale":"2023-10-10T22:34:39.357626+0000","last_undegraded":"2023-10-10T22:34:39.357626+0000","last_fullsized":"2023-10-10T22:34:39.357626+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:28:55.854343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355884+0000","last_change":"2023-10-10T22:34:38.343062+0000","last_active":"2023-10-10T22:34:39.355884+0000","last_peered":"2023-10-10T22:34:39.355884+0000","last_clean":"2023-10-10T22:34:39.355884+0000","last_became_active":"2023-10-10T22:34:38.342785+0000","last_became_peered":"2023-10-10T22:34:38.342785+0000","last_unstale":"2023-10-10T22:34:39.355884+0000","last_undegraded":"2023-10-10T22:34:39.355884+0000","last_fullsized":"2023-10-10T22:34:39.355884+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:37:29.658776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365464+0000","last_change":"2023-10-10T22:34:39.362657+0000","last_active":"2023-10-10T22:34:39.365464+0000","last_peered":"2023-10-10T22:34:39.365464+0000","last_clean":"2023-10-10T22:34:39.365464+0000","last_became_active":"2023-10-10T22:34:39.362380+0000","last_became_peered":"2023-10-10T22:34:39.362380+0000","last_unstale":"2023-10-10T22:34:39.365464+0000","last_undegraded":"2023-10-10T22:34:39.365464+0000","last_fullsized":"2023-10-10T22:34:39.365464+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:57:18.834083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.342952+0000","last_change":"2023-10-10T22:34:38.347549+0000","last_active":"2023-10-10T22:34:39.342952+0000","last_peered":"2023-10-10T22:34:39.342952+0000","last_clean":"2023-10-10T22:34:39.342952+0000","last_became_active":"2023-10-10T22:34:38.347295+0000","last_became_peered":"2023-10-10T22:34:38.347295+0000","last_unstale":"2023-10-10T22:34:39.342952+0000","last_undegraded":"2023-10-10T22:34:39.342952+0000","last_fullsized":"2023-10-10T22:34:39.342952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:18:33.343928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354970+0000","last_change":"2023-10-10T22:34:39.348743+0000","last_active":"2023-10-10T22:34:39.354970+0000","last_peered":"2023-10-10T22:34:39.354970+0000","last_clean":"2023-10-10T22:34:39.354970+0000","last_became_active":"2023-10-10T22:34:39.348482+0000","last_became_peered":"2023-10-10T22:34:39.348482+0000","last_unstale":"2023-10-10T22:34:39.354970+0000","last_undegraded":"2023-10-10T22:34:39.354970+0000","last_fullsized":"2023-10-10T22:34:39.354970+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:05.835271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.344003+0000","last_change":"2023-10-10T22:34:38.335355+0000","last_active":"2023-10-10T22:34:39.344003+0000","last_peered":"2023-10-10T22:34:39.344003+0000","last_clean":"2023-10-10T22:34:39.344003+0000","last_became_active":"2023-10-10T22:34:38.335103+0000","last_became_peered":"2023-10-10T22:34:38.335103+0000","last_unstale":"2023-10-10T22:34:39.344003+0000","last_undegraded":"2023-10-10T22:34:39.344003+0000","last_fullsized":"2023-10-10T22:34:39.344003+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.350411+0000","last_change":"2023-10-10T22:34:39.344532+0000","last_active":"2023-10-10T22:34:39.350411+0000","last_peered":"2023-10-10T22:34:39.350411+0000","last_clean":"2023-10-10T22:34:39.350411+0000","last_became_active":"2023-10-10T22:34:39.344193+0000","last_became_peered":"2023-10-10T22:34:39.344193+0000","last_unstale":"2023-10-10T22:34:39.350411+0000","last_undegraded":"2023-10-10T22:34:39.350411+0000","last_fullsized":"2023-10-10T22:34:39.350411+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:35:17.534324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341151+0000","last_change":"2023-10-10T22:34:38.340111+0000","last_active":"2023-10-10T22:34:39.341151+0000","last_peered":"2023-10-10T22:34:39.341151+0000","last_clean":"2023-10-10T22:34:39.341151+0000","last_became_active":"2023-10-10T22:34:38.339803+0000","last_became_peered":"2023-10-10T22:34:38.339803+0000","last_unstale":"2023-10-10T22:34:39.341151+0000","last_undegraded":"2023-10-10T22:34:39.341151+0000","last_fullsized":"2023-10-10T22:34:39.341151+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:54:34.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363484+0000","last_change":"2023-10-10T22:34:39.360326+0000","last_active":"2023-10-10T22:34:39.363484+0000","last_peered":"2023-10-10T22:34:39.363484+0000","last_clean":"2023-10-10T22:34:39.363484+0000","last_became_active":"2023-10-10T22:34:39.360073+0000","last_became_peered":"2023-10-10T22:34:39.360073+0000","last_unstale":"2023-10-10T22:34:39.363484+0000","last_undegraded":"2023-10-10T22:34:39.363484+0000","last_fullsized":"2023-10-10T22:34:39.363484+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353042+0000","last_change":"2023-10-10T22:34:38.344691+0000","last_active":"2023-10-10T22:34:39.353042+0000","last_peered":"2023-10-10T22:34:39.353042+0000","last_clean":"2023-10-10T22:34:39.353042+0000","last_became_active":"2023-10-10T22:34:38.344440+0000","last_became_peered":"2023-10-10T22:34:38.344440+0000","last_unstale":"2023-10-10T22:34:39.353042+0000","last_undegraded":"2023-10-10T22:34:39.353042+0000","last_fullsized":"2023-10-10T22:34:39.353042+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:35:50.647239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365891+0000","last_change":"2023-10-10T22:34:39.356578+0000","last_active":"2023-10-10T22:34:39.365891+0000","last_peered":"2023-10-10T22:34:39.365891+0000","last_clean":"2023-10-10T22:34:39.365891+0000","last_became_active":"2023-10-10T22:34:39.356270+0000","last_became_peered":"2023-10-10T22:34:39.356270+0000","last_unstale":"2023-10-10T22:34:39.365891+0000","last_undegraded":"2023-10-10T22:34:39.365891+0000","last_fullsized":"2023-10-10T22:34:39.365891+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:48:08.525393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.342644+0000","last_change":"2023-10-10T22:34:38.340216+0000","last_active":"2023-10-10T22:34:39.342644+0000","last_peered":"2023-10-10T22:34:39.342644+0000","last_clean":"2023-10-10T22:34:39.342644+0000","last_became_active":"2023-10-10T22:34:38.339475+0000","last_became_peered":"2023-10-10T22:34:38.339475+0000","last_unstale":"2023-10-10T22:34:39.342644+0000","last_undegraded":"2023-10-10T22:34:39.342644+0000","last_fullsized":"2023-10-10T22:34:39.342644+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:19.851014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364424+0000","last_change":"2023-10-10T22:34:39.359593+0000","last_active":"2023-10-10T22:34:39.364424+0000","last_peered":"2023-10-10T22:34:39.364424+0000","last_clean":"2023-10-10T22:34:39.364424+0000","last_became_active":"2023-10-10T22:34:39.359168+0000","last_became_peered":"2023-10-10T22:34:39.359168+0000","last_unstale":"2023-10-10T22:34:39.364424+0000","last_undegraded":"2023-10-10T22:34:39.364424+0000","last_fullsized":"2023-10-10T22:34:39.364424+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:58.046132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.343500+0000","last_change":"2023-10-10T22:34:38.340647+0000","last_active":"2023-10-10T22:34:39.343500+0000","last_peered":"2023-10-10T22:34:39.343500+0000","last_clean":"2023-10-10T22:34:39.343500+0000","last_became_active":"2023-10-10T22:34:38.340347+0000","last_became_peered":"2023-10-10T22:34:38.340347+0000","last_unstale":"2023-10-10T22:34:39.343500+0000","last_undegraded":"2023-10-10T22:34:39.343500+0000","last_fullsized":"2023-10-10T22:34:39.343500+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:23:02.934919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"182'326","reported_seq":1055,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.348642+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:34:39.348642+0000","last_peered":"2023-10-10T22:34:39.348642+0000","last_clean":"2023-10-10T22:34:39.348642+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:34:39.348642+0000","last_undegraded":"2023-10-10T22:34:39.348642+0000","last_fullsized":"2023-10-10T22:34:39.348642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543244,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312532,"kb_used_data":2956,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059308,"statfs":{"total":96636764160,"available":96316731392,"internally_reserved":0,"allocated":3026944,"data_stored":1800844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.57099999999999995,"5min":0.44500000000000001,"15min":0.36699999999999999},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.026},"last":0.628},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.35399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.081},"last":0.60799999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.60199999999999998,"5min":0.47699999999999998,"15min":0.44700000000000001},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.46600000000000003},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":1.095},"last":0.65800000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.66000000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92700000000000005,"5min":0.96699999999999997,"15min":1},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.44400000000000001},"max":{"1min":0.91300000000000003,"5min":0.95899999999999996,"15min":0.97599999999999998},"last":0.754}]},{"osd":3,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.63800000000000001,"5min":0.47699999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":0.99099999999999999,"15min":1.0009999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.625,"5min":0.502,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.97399999999999998},"last":0.82699999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.079,"15min":1.079},"last":0.72699999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":1.125,"15min":1.125},"last":0.83899999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543243,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316032,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055808,"statfs":{"total":96636764160,"available":96313147392,"internally_reserved":0,"allocated":2416640,"data_stored":1208802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":0.96699999999999997,"15min":1.006},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.39700000000000002},"max":{"1min":0.90100000000000002,"5min":0.997,"15min":0.997},"last":0.44900000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.63600000000000001,"5min":0.48499999999999999,"15min":0.371},"max":{"1min":0.90600000000000003,"5min":0.94499999999999995,"15min":1.01},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":1.014,"15min":1.0349999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.44800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.038},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.42299999999999999},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.93600000000000005},"last":0.70499999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.51700000000000002,"15min":0.48099999999999998},"max":{"1min":0.81499999999999995,"5min":0.97899999999999998,"15min":1.0569999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.64800000000000002,"5min":0.55700000000000005,"15min":0.48499999999999999},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":1.0289999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.95799999999999996,"15min":0.98699999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":0.91200000000000003,"15min":1.01},"last":0.65400000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.53300000000000003,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.95299999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.435},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":1.032},"last":0.746}]},{"osd":7,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.41799999999999998},"max":{"1min":0.89500000000000002,"5min":0.98999999999999999,"15min":1},"last":0.622},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.76600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129543243,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307836,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064004,"statfs":{"total":96636764160,"available":96321540096,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.96299999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82999999999999996,"5min":0.88,"15min":1.179},"last":0.69199999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.82099999999999995,"5min":0.878,"15min":1.0820000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.0489999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.82499999999999996,"15min":1.2150000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.123},"last":0.51700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81299999999999994,"15min":0.81399999999999995},"min":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.54700000000000004},"max":{"1min":1.0329999999999999,"5min":1.0489999999999999,"15min":1.29},"last":1.038},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":1.095,"15min":1.258},"last":0.86499999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1599999999999999,"15min":1.2609999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82299999999999995,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.61599999999999999,"15min":0.56999999999999995},"max":{"1min":1.026,"5min":1.1279999999999999,"15min":1.258},"last":0.95799999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.628,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":1.0940000000000001,"5min":1.1279999999999999,"15min":1.2869999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.877,"15min":0.871},"min":{"1min":0.70299999999999996,"5min":0.69199999999999995,"15min":0.628},"max":{"1min":1.069,"5min":1.175,"15min":1.3100000000000001},"last":0.99399999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.155,"15min":1.2450000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84899999999999998,"15min":0.84799999999999998},"min":{"1min":0.66900000000000004,"5min":0.621,"15min":0.53900000000000003},"max":{"1min":1.024,"5min":1.1120000000000001,"15min":1.226},"last":0.88600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543245,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308412,"kb_used_data":2932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063428,"statfs":{"total":96636764160,"available":96320950272,"internally_reserved":0,"allocated":3002368,"data_stored":1798594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.73699999999999999,"15min":0.85299999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.63600000000000001,"5min":0.73299999999999998,"15min":0.96599999999999997},"last":0.626},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81599999999999995,"15min":1.0249999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.64500000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.41199999999999998},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.89800000000000002},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53300000000000003},"max":{"1min":0.95899999999999996,"5min":1.0860000000000001,"15min":1.3340000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96799999999999997,"5min":1.0600000000000001,"15min":1.165},"last":1.056}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.59599999999999997,"5min":0.59399999999999997,"15min":0.53300000000000003},"max":{"1min":0.98699999999999999,"5min":1.079,"15min":1.214},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.629,"5min":0.627,"15min":0.56899999999999995},"max":{"1min":1.0069999999999999,"5min":1.0609999999999999,"15min":1.3089999999999999},"last":1.01}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.874},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":1.0700000000000001,"15min":1.377},"last":1.165},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.875,"15min":0.88200000000000001},"min":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.55200000000000005},"max":{"1min":1.014,"5min":1.123,"15min":1.427},"last":1.0680000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85099999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.56699999999999995},"max":{"1min":0.92900000000000005,"5min":1.0780000000000001,"15min":1.2689999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.153,"15min":1.1899999999999999},"last":0.97799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129543245,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.65300000000000002,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.442,"5min":0.317,"15min":0.31},"max":{"1min":0.70899999999999996,"5min":0.73799999999999999,"15min":0.89500000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.41299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67800000000000005,"5min":0.79700000000000004,"15min":0.80700000000000005},"last":0.432},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.38700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.52400000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.745,"5min":0.80300000000000005,"15min":0.97599999999999998},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.98499999999999999,"5min":1.1679999999999999,"15min":1.288},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.58399999999999996,"5min":0.47399999999999998,"15min":0.41599999999999998},"max":{"1min":0.96799999999999997,"5min":1.149,"15min":1.325},"last":0.71699999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.57799999999999996,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51500000000000001},"max":{"1min":1.147,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84399999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.67500000000000004,"5min":0.58799999999999997,"15min":0.53700000000000003},"max":{"1min":1.147,"5min":1.147,"15min":1.2689999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.625,"5min":0.60399999999999998,"15min":0.54300000000000004},"max":{"1min":1.167,"5min":1.26,"15min":1.26},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.1279999999999999,"5min":1.218,"15min":1.3129999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.65800000000000003,"5min":0.59199999999999997,"15min":0.54500000000000004},"max":{"1min":1.0700000000000001,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":15,"seq":64424510540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311932,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059908,"statfs":{"total":96636764160,"available":96317345792,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76700000000000002,"15min":0.79800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.435}]},{"osd":1,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.39400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32900000000000001},"max":{"1min":0.79500000000000004,"5min":0.84699999999999998,"15min":0.86899999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.38100000000000001,"15min":0.33800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97999999999999998,"5min":0.99399999999999999,"15min":0.998},"last":0.67100000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.242,"15min":1.2769999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.501},"max":{"1min":1.089,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.65700000000000003,"5min":0.56799999999999995,"15min":0.52900000000000003},"max":{"1min":1.0680000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.79500000000000004},"min":{"1min":0.66700000000000004,"5min":0.54600000000000004,"15min":0.5},"max":{"1min":1.0089999999999999,"5min":1.1379999999999999,"15min":1.383},"last":0.83199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.53000000000000003},"max":{"1min":1.0189999999999999,"5min":1.222,"15min":1.222},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.66800000000000004,"5min":0.58999999999999997,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.212,"15min":1.212},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.63200000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.194},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84299999999999997,"15min":0.84199999999999997},"min":{"1min":0.66800000000000004,"5min":0.629,"15min":0.56699999999999995},"max":{"1min":1.0920000000000001,"5min":1.226,"15min":1.2490000000000001},"last":0.65700000000000003}]}]},{"osd":6,"up_from":14,"seq":60129543243,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44400000000000001},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.56200000000000006,"5min":0.52800000000000002,"15min":0.46300000000000002},"max":{"1min":1.0049999999999999,"5min":1.04,"15min":1.0680000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.627,"5min":0.57999999999999996,"15min":0.47499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0920000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77400000000000002,"15min":0.78900000000000003},"min":{"1min":0.64700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.05,"5min":1.05,"15min":1.129},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.441},"max":{"1min":1.034,"5min":1.034,"15min":1.1200000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.48799999999999999},"max":{"1min":0.98599999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.502,"5min":0.502,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.51500000000000001},"max":{"1min":0.97399999999999998,"5min":1.0249999999999999,"15min":1.071},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":1,"15min":1},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":0.95899999999999996,"15min":0.98999999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.68000000000000005},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.996,"5min":1.006,"15min":1.046},"last":0.872},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95399999999999996,"5min":0.99199999999999999,"15min":1.1479999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.54000000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":1.008},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0880000000000001},"last":0.89900000000000002}]}]},{"osd":4,"up_from":14,"seq":60129543245,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316040,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055800,"statfs":{"total":96636764160,"available":96313139200,"internally_reserved":0,"allocated":2424832,"data_stored":1209832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":0.92400000000000004,"5min":1.0660000000000001,"15min":1.087},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.59699999999999998,"5min":0.47599999999999998,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.64700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.0609999999999999,"15min":1.1220000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46000000000000002},"max":{"1min":0.89000000000000001,"5min":1.018,"15min":1.0509999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58699999999999997,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.996,"5min":1.04,"15min":1.073},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.62,"5min":0.505,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":1.0369999999999999,"15min":1.089},"last":0.53700000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.4079999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74299999999999999,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0229999999999999,"15min":1.282},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73499999999999999,"5min":0.94099999999999995,"15min":1.6539999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":0.84299999999999997,"5min":1.0900000000000001,"15min":1.5169999999999999},"last":0.75}]},{"osd":6,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.143},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.57899999999999996,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":1.0569999999999999,"15min":1.1990000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48599999999999999,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":1.21,"15min":1.21},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.48199999999999998,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.0980000000000001,"15min":1.361},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:34:48.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:34:48.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.731+0000 7f3cb19ff700 1 Processor -- start 2023-10-10T22:34:48.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.731+0000 7f3cb19ff700 1 -- start start 2023-10-10T22:34:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3cb19ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3cac155c10 0x7f3cac155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3cb19ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3cac0ac230 0x7f3cac0ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3cb19ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac0ad930 con 0x7f3cac1568a0 2023-10-10T22:34:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3cb19ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0acd20 con 0x7f3cac0ac230 2023-10-10T22:34:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3cb19ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0ad000 con 0x7f3cac155c10 2023-10-10T22:34:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3caa7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3cac0ac230 0x7f3cac0ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3caa7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3cac0ac230 0x7f3cac0ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60918/0 (socket says 172.21.15.154:60918) 2023-10-10T22:34:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3caa7fc700 1 -- 172.21.15.154:0/3340644136 learned_addr learned my addr 172.21.15.154:0/3340644136 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3caaffd700 1 --2- 172.21.15.154:0/3340644136 >> v2:172.21.15.179:3300/0 conn(0x7f3cac155c10 0x7f3cac155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3caa7fc700 1 -- 172.21.15.154:0/3340644136 >> v2:172.21.15.179:3300/0 conn(0x7f3cac155c10 msgr2=0x7f3cac155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3caa7fc700 1 --2- 172.21.15.154:0/3340644136 >> v2:172.21.15.179:3300/0 conn(0x7f3cac155c10 0x7f3cac155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3caa7fc700 1 -- 172.21.15.154:0/3340644136 >> v1:172.21.15.179:6789/0 conn(0x7f3cac1568a0 legacy=0x7f3cac156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:48.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.733+0000 7f3caa7fc700 1 -- 172.21.15.154:0/3340644136 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac0ad2e0 con 0x7f3cac0ac230 2023-10-10T22:34:48.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.734+0000 7f3caa7fc700 1 --2- 172.21.15.154:0/3340644136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac0ac230 0x7f3cac0ac6d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f3cac063d40 tx=0x7f3ca000b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6b4e1f16007a73 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:48.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.734+0000 7f3ca9ffb700 1 -- 172.21.15.154:0/3340644136 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000dad0 con 0x7f3cac0ac230 2023-10-10T22:34:48.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.734+0000 7f3ca9ffb700 1 -- 172.21.15.154:0/3340644136 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca000dc30 con 0x7f3cac0ac230 2023-10-10T22:34:48.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.734+0000 7f3ca9ffb700 1 -- 172.21.15.154:0/3340644136 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0017410 con 0x7f3cac0ac230 2023-10-10T22:34:48.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.734+0000 7f3cb19ff700 1 -- 172.21.15.154:0/3340644136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac0ac230 msgr2=0x7f3cac0ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:48.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.734+0000 7f3cb19ff700 1 --2- 172.21.15.154:0/3340644136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac0ac230 0x7f3cac0ac6d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f3cac063d40 tx=0x7f3ca000b4e0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.735+0000 7f3cb19ff700 1 -- 172.21.15.154:0/3340644136 shutdown_connections 2023-10-10T22:34:48.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.735+0000 7f3cb19ff700 1 --2- 172.21.15.154:0/3340644136 >> v2:172.21.15.179:3300/0 conn(0x7f3cac155c10 0x7f3cac155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.735+0000 7f3cb19ff700 1 --2- 172.21.15.154:0/3340644136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac0ac230 0x7f3cac0ac6d0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.735+0000 7f3cb19ff700 1 -- 172.21.15.154:0/3340644136 >> 172.21.15.154:0/3340644136 conn(0x7f3cac06a320 msgr2=0x7f3cac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:48.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.735+0000 7f3cb19ff700 1 -- 172.21.15.154:0/3340644136 shutdown_connections 2023-10-10T22:34:48.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.735+0000 7f3cb19ff700 1 -- 172.21.15.154:0/3340644136 wait complete. 2023-10-10T22:34:48.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.736+0000 7f3cb19ff700 1 Processor -- start 2023-10-10T22:34:48.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.736+0000 7f3cb19ff700 1 -- start start 2023-10-10T22:34:48.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.737+0000 7f3cb19ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cac0ac230 0x7f3cac157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:48.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.737+0000 7f3cb19ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac155c10 0x7f3cac142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:48.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.737+0000 7f3cb19ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac1568a0 0x7f3cac15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:48.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.737+0000 7f3cb19ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac157a40 con 0x7f3cac1568a0 2023-10-10T22:34:48.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.737+0000 7f3cb19ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac156ea0 con 0x7f3cac155c10 2023-10-10T22:34:48.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.737+0000 7f3cb19ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac158410 con 0x7f3cac0ac230 2023-10-10T22:34:48.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.737+0000 7f3cab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac1568a0 0x7f3cac15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:48.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.737+0000 7f3cab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac1568a0 0x7f3cac15b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60932/0 (socket says 172.21.15.154:60932) 2023-10-10T22:34:48.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.737+0000 7f3cab7fe700 1 -- 172.21.15.154:0/451009699 learned_addr learned my addr 172.21.15.154:0/451009699 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:48.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3caa7fc700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac155c10 0x7f3cac142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:48.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3caaffd700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cac0ac230 0x7f3cac157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:48.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3cab7fe700 1 -- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cac0ac230 msgr2=0x7f3cac157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:48.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3cab7fe700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cac0ac230 0x7f3cac157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3cab7fe700 1 -- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac155c10 msgr2=0x7f3cac142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:48.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3cab7fe700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac155c10 0x7f3cac142ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3cab7fe700 1 -- 172.21.15.154:0/451009699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca000b780 con 0x7f3cac1568a0 2023-10-10T22:34:48.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3caa7fc700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac155c10 0x7f3cac142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:48.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3caaffd700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cac0ac230 0x7f3cac157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:48.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3cab7fe700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac1568a0 0x7f3cac15b030 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400bc30 tx=0x7f3ca4009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:48.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3c92ffd700 1 -- 172.21.15.154:0/451009699 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400c9b0 con 0x7f3cac1568a0 2023-10-10T22:34:48.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3c92ffd700 1 -- 172.21.15.154:0/451009699 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca400cb50 con 0x7f3cac1568a0 2023-10-10T22:34:48.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3c92ffd700 1 -- 172.21.15.154:0/451009699 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4014410 con 0x7f3cac1568a0 2023-10-10T22:34:48.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.738+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac157110 con 0x7f3cac1568a0 2023-10-10T22:34:48.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.739+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac1576d0 con 0x7f3cac1568a0 2023-10-10T22:34:48.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.739+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac04c3c0 con 0x7f3cac1568a0 2023-10-10T22:34:48.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.740+0000 7f3c92ffd700 1 -- 172.21.15.154:0/451009699 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ca4014800 con 0x7f3cac1568a0 2023-10-10T22:34:48.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.741+0000 7f3c92ffd700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3c98066f30 0x7f3c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.741+0000 7f3c92ffd700 1 -- 172.21.15.154:0/451009699 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f3ca4084870 con 0x7f3cac1568a0 2023-10-10T22:34:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.742+0000 7f3caaffd700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3c98066f30 0x7f3c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.742+0000 7f3caaffd700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3c98066f30 0x7f3c980693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c006fd0 tx=0x7f3c9c008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.745+0000 7f3c92ffd700 1 -- 172.21.15.154:0/451009699 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ca404c5a0 con 0x7f3cac1568a0 2023-10-10T22:34:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.937+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cac157b80 con 0x7f3c98066f30 2023-10-10T22:34:48.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.945+0000 7f3c92ffd700 1 -- 172.21.15.154:0/451009699 <== mgr.8884 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289367 (secure 0 0 0) 0x7f3cac157b80 con 0x7f3c98066f30 2023-10-10T22:34:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:48.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3c98066f30 msgr2=0x7f3c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:48.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3c98066f30 0x7f3c980693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c006fd0 tx=0x7f3c9c008040 comp rx=0 tx=0).stop 2023-10-10T22:34:48.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac1568a0 msgr2=0x7f3cac15b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:48.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac1568a0 0x7f3cac15b030 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400bc30 tx=0x7f3ca4009820 comp rx=0 tx=0).stop 2023-10-10T22:34:48.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 shutdown_connections 2023-10-10T22:34:48.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3c98066f30 0x7f3c980693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cac1568a0 0x7f3cac15b030 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cac0ac230 0x7f3cac157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 --2- 172.21.15.154:0/451009699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac155c10 0x7f3cac142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:48.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.949+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 >> 172.21.15.154:0/451009699 conn(0x7f3cac06a320 msgr2=0x7f3cac153080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:48.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.950+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 shutdown_connections 2023-10-10T22:34:48.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:48.950+0000 7f3cb19ff700 1 -- 172.21.15.154:0/451009699 wait complete. 2023-10-10T22:34:48.955 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:34:48.968 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-10T22:34:47.288142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2504840,"kb_used_data":20040,"kb_used_omap":0,"kb_used_meta":2484736,"kb_avail":752469880,"statfs":{"total":773094113280,"available":770529157120,"internally_reserved":0,"allocated":20520960,"data_stored":10851156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2544369664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001813"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.376861+0000","last_change":"2023-10-10T22:34:39.371536+0000","last_active":"2023-10-10T22:34:39.376861+0000","last_peered":"2023-10-10T22:34:39.376861+0000","last_clean":"2023-10-10T22:34:39.376861+0000","last_became_active":"2023-10-10T22:34:39.371216+0000","last_became_peered":"2023-10-10T22:34:39.371216+0000","last_unstale":"2023-10-10T22:34:39.376861+0000","last_undegraded":"2023-10-10T22:34:39.376861+0000","last_fullsized":"2023-10-10T22:34:39.376861+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:40:24.190436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364010+0000","last_change":"2023-10-10T22:34:39.362613+0000","last_active":"2023-10-10T22:34:39.364010+0000","last_peered":"2023-10-10T22:34:39.364010+0000","last_clean":"2023-10-10T22:34:39.364010+0000","last_became_active":"2023-10-10T22:34:39.362347+0000","last_became_peered":"2023-10-10T22:34:39.362347+0000","last_unstale":"2023-10-10T22:34:39.364010+0000","last_undegraded":"2023-10-10T22:34:39.364010+0000","last_fullsized":"2023-10-10T22:34:39.364010+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:18.718129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365927+0000","last_change":"2023-10-10T22:34:39.356744+0000","last_active":"2023-10-10T22:34:39.365927+0000","last_peered":"2023-10-10T22:34:39.365927+0000","last_clean":"2023-10-10T22:34:39.365927+0000","last_became_active":"2023-10-10T22:34:39.356463+0000","last_became_peered":"2023-10-10T22:34:39.356463+0000","last_unstale":"2023-10-10T22:34:39.365927+0000","last_undegraded":"2023-10-10T22:34:39.365927+0000","last_fullsized":"2023-10-10T22:34:39.365927+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360244+0000","last_change":"2023-10-10T22:34:39.356895+0000","last_active":"2023-10-10T22:34:39.360244+0000","last_peered":"2023-10-10T22:34:39.360244+0000","last_clean":"2023-10-10T22:34:39.360244+0000","last_became_active":"2023-10-10T22:34:39.356597+0000","last_became_peered":"2023-10-10T22:34:39.356597+0000","last_unstale":"2023-10-10T22:34:39.360244+0000","last_undegraded":"2023-10-10T22:34:39.360244+0000","last_fullsized":"2023-10-10T22:34:39.360244+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:26:44.349327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363231+0000","last_change":"2023-10-10T22:34:39.356523+0000","last_active":"2023-10-10T22:34:39.363231+0000","last_peered":"2023-10-10T22:34:39.363231+0000","last_clean":"2023-10-10T22:34:39.363231+0000","last_became_active":"2023-10-10T22:34:39.356258+0000","last_became_peered":"2023-10-10T22:34:39.356258+0000","last_unstale":"2023-10-10T22:34:39.363231+0000","last_undegraded":"2023-10-10T22:34:39.363231+0000","last_fullsized":"2023-10-10T22:34:39.363231+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:59.029344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362547+0000","last_change":"2023-10-10T22:34:39.356644+0000","last_active":"2023-10-10T22:34:39.362547+0000","last_peered":"2023-10-10T22:34:39.362547+0000","last_clean":"2023-10-10T22:34:39.362547+0000","last_became_active":"2023-10-10T22:34:39.356377+0000","last_became_peered":"2023-10-10T22:34:39.356377+0000","last_unstale":"2023-10-10T22:34:39.362547+0000","last_undegraded":"2023-10-10T22:34:39.362547+0000","last_fullsized":"2023-10-10T22:34:39.362547+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:00:05.239388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353594+0000","last_change":"2023-10-10T22:34:39.344550+0000","last_active":"2023-10-10T22:34:39.353594+0000","last_peered":"2023-10-10T22:34:39.353594+0000","last_clean":"2023-10-10T22:34:39.353594+0000","last_became_active":"2023-10-10T22:34:39.344094+0000","last_became_peered":"2023-10-10T22:34:39.344094+0000","last_unstale":"2023-10-10T22:34:39.353594+0000","last_undegraded":"2023-10-10T22:34:39.353594+0000","last_fullsized":"2023-10-10T22:34:39.353594+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:59.777710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361095+0000","last_change":"2023-10-10T22:34:39.355546+0000","last_active":"2023-10-10T22:34:39.361095+0000","last_peered":"2023-10-10T22:34:39.361095+0000","last_clean":"2023-10-10T22:34:39.361095+0000","last_became_active":"2023-10-10T22:34:39.355276+0000","last_became_peered":"2023-10-10T22:34:39.355276+0000","last_unstale":"2023-10-10T22:34:39.361095+0000","last_undegraded":"2023-10-10T22:34:39.361095+0000","last_fullsized":"2023-10-10T22:34:39.361095+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365540+0000","last_change":"2023-10-10T22:34:39.363192+0000","last_active":"2023-10-10T22:34:39.365540+0000","last_peered":"2023-10-10T22:34:39.365540+0000","last_clean":"2023-10-10T22:34:39.365540+0000","last_became_active":"2023-10-10T22:34:39.362823+0000","last_became_peered":"2023-10-10T22:34:39.362823+0000","last_unstale":"2023-10-10T22:34:39.365540+0000","last_undegraded":"2023-10-10T22:34:39.365540+0000","last_fullsized":"2023-10-10T22:34:39.365540+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:48:08.525393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361246+0000","last_change":"2023-10-10T22:34:39.355002+0000","last_active":"2023-10-10T22:34:39.361246+0000","last_peered":"2023-10-10T22:34:39.361246+0000","last_clean":"2023-10-10T22:34:39.361246+0000","last_became_active":"2023-10-10T22:34:39.354741+0000","last_became_peered":"2023-10-10T22:34:39.354741+0000","last_unstale":"2023-10-10T22:34:39.361246+0000","last_undegraded":"2023-10-10T22:34:39.361246+0000","last_fullsized":"2023-10-10T22:34:39.361246+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:28.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364399+0000","last_change":"2023-10-10T22:34:39.361870+0000","last_active":"2023-10-10T22:34:39.364399+0000","last_peered":"2023-10-10T22:34:39.364399+0000","last_clean":"2023-10-10T22:34:39.364399+0000","last_became_active":"2023-10-10T22:34:39.361578+0000","last_became_peered":"2023-10-10T22:34:39.361578+0000","last_unstale":"2023-10-10T22:34:39.364399+0000","last_undegraded":"2023-10-10T22:34:39.364399+0000","last_fullsized":"2023-10-10T22:34:39.364399+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363974+0000","last_change":"2023-10-10T22:34:39.361997+0000","last_active":"2023-10-10T22:34:39.363974+0000","last_peered":"2023-10-10T22:34:39.363974+0000","last_clean":"2023-10-10T22:34:39.363974+0000","last_became_active":"2023-10-10T22:34:39.361723+0000","last_became_peered":"2023-10-10T22:34:39.361723+0000","last_unstale":"2023-10-10T22:34:39.363974+0000","last_undegraded":"2023-10-10T22:34:39.363974+0000","last_fullsized":"2023-10-10T22:34:39.363974+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:00.318138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370237+0000","last_change":"2023-10-10T22:34:39.357855+0000","last_active":"2023-10-10T22:34:39.370237+0000","last_peered":"2023-10-10T22:34:39.370237+0000","last_clean":"2023-10-10T22:34:39.370237+0000","last_became_active":"2023-10-10T22:34:39.356362+0000","last_became_peered":"2023-10-10T22:34:39.356362+0000","last_unstale":"2023-10-10T22:34:39.370237+0000","last_undegraded":"2023-10-10T22:34:39.370237+0000","last_fullsized":"2023-10-10T22:34:39.370237+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368587+0000","last_change":"2023-10-10T22:34:39.357340+0000","last_active":"2023-10-10T22:34:39.368587+0000","last_peered":"2023-10-10T22:34:39.368587+0000","last_clean":"2023-10-10T22:34:39.368587+0000","last_became_active":"2023-10-10T22:34:39.357038+0000","last_became_peered":"2023-10-10T22:34:39.357038+0000","last_unstale":"2023-10-10T22:34:39.368587+0000","last_undegraded":"2023-10-10T22:34:39.368587+0000","last_fullsized":"2023-10-10T22:34:39.368587+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:18.718129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363970+0000","last_change":"2023-10-10T22:34:39.360873+0000","last_active":"2023-10-10T22:34:39.363970+0000","last_peered":"2023-10-10T22:34:39.363970+0000","last_clean":"2023-10-10T22:34:39.363970+0000","last_became_active":"2023-10-10T22:34:39.360580+0000","last_became_peered":"2023-10-10T22:34:39.360580+0000","last_unstale":"2023-10-10T22:34:39.363970+0000","last_undegraded":"2023-10-10T22:34:39.363970+0000","last_fullsized":"2023-10-10T22:34:39.363970+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:27:55.699495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363752+0000","last_change":"2023-10-10T22:34:39.361019+0000","last_active":"2023-10-10T22:34:39.363752+0000","last_peered":"2023-10-10T22:34:39.363752+0000","last_clean":"2023-10-10T22:34:39.363752+0000","last_became_active":"2023-10-10T22:34:39.360680+0000","last_became_peered":"2023-10-10T22:34:39.360680+0000","last_unstale":"2023-10-10T22:34:39.363752+0000","last_undegraded":"2023-10-10T22:34:39.363752+0000","last_fullsized":"2023-10-10T22:34:39.363752+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:59.049929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371642+0000","last_change":"2023-10-10T22:34:39.367948+0000","last_active":"2023-10-10T22:34:39.371642+0000","last_peered":"2023-10-10T22:34:39.371642+0000","last_clean":"2023-10-10T22:34:39.371642+0000","last_became_active":"2023-10-10T22:34:39.367661+0000","last_became_peered":"2023-10-10T22:34:39.367661+0000","last_unstale":"2023-10-10T22:34:39.371642+0000","last_undegraded":"2023-10-10T22:34:39.371642+0000","last_fullsized":"2023-10-10T22:34:39.371642+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:19:56.969395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354986+0000","last_change":"2023-10-10T22:34:39.349734+0000","last_active":"2023-10-10T22:34:39.354986+0000","last_peered":"2023-10-10T22:34:39.354986+0000","last_clean":"2023-10-10T22:34:39.354986+0000","last_became_active":"2023-10-10T22:34:39.349477+0000","last_became_peered":"2023-10-10T22:34:39.349477+0000","last_unstale":"2023-10-10T22:34:39.354986+0000","last_undegraded":"2023-10-10T22:34:39.354986+0000","last_fullsized":"2023-10-10T22:34:39.354986+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:28:23.607097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.362726+0000","last_change":"2023-10-10T22:34:39.356873+0000","last_active":"2023-10-10T22:34:39.362726+0000","last_peered":"2023-10-10T22:34:39.362726+0000","last_clean":"2023-10-10T22:34:39.362726+0000","last_became_active":"2023-10-10T22:34:39.356605+0000","last_became_peered":"2023-10-10T22:34:39.356605+0000","last_unstale":"2023-10-10T22:34:39.362726+0000","last_undegraded":"2023-10-10T22:34:39.362726+0000","last_fullsized":"2023-10-10T22:34:39.362726+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:10:21.161733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370219+0000","last_change":"2023-10-10T22:34:39.362351+0000","last_active":"2023-10-10T22:34:39.370219+0000","last_peered":"2023-10-10T22:34:39.370219+0000","last_clean":"2023-10-10T22:34:39.370219+0000","last_became_active":"2023-10-10T22:34:39.362063+0000","last_became_peered":"2023-10-10T22:34:39.362063+0000","last_unstale":"2023-10-10T22:34:39.370219+0000","last_undegraded":"2023-10-10T22:34:39.370219+0000","last_fullsized":"2023-10-10T22:34:39.370219+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:28.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371750+0000","last_change":"2023-10-10T22:34:39.366653+0000","last_active":"2023-10-10T22:34:39.371750+0000","last_peered":"2023-10-10T22:34:39.371750+0000","last_clean":"2023-10-10T22:34:39.371750+0000","last_became_active":"2023-10-10T22:34:39.366379+0000","last_became_peered":"2023-10-10T22:34:39.366379+0000","last_unstale":"2023-10-10T22:34:39.371750+0000","last_undegraded":"2023-10-10T22:34:39.371750+0000","last_fullsized":"2023-10-10T22:34:39.371750+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:25.485943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363189+0000","last_change":"2023-10-10T22:34:39.357319+0000","last_active":"2023-10-10T22:34:39.363189+0000","last_peered":"2023-10-10T22:34:39.363189+0000","last_clean":"2023-10-10T22:34:39.363189+0000","last_became_active":"2023-10-10T22:34:39.357063+0000","last_became_peered":"2023-10-10T22:34:39.357063+0000","last_unstale":"2023-10-10T22:34:39.363189+0000","last_undegraded":"2023-10-10T22:34:39.363189+0000","last_fullsized":"2023-10-10T22:34:39.363189+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368483+0000","last_change":"2023-10-10T22:34:39.364358+0000","last_active":"2023-10-10T22:34:39.368483+0000","last_peered":"2023-10-10T22:34:39.368483+0000","last_clean":"2023-10-10T22:34:39.368483+0000","last_became_active":"2023-10-10T22:34:39.364086+0000","last_became_peered":"2023-10-10T22:34:39.364086+0000","last_unstale":"2023-10-10T22:34:39.368483+0000","last_undegraded":"2023-10-10T22:34:39.368483+0000","last_fullsized":"2023-10-10T22:34:39.368483+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:14:51.318360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375388+0000","last_change":"2023-10-10T22:34:39.372148+0000","last_active":"2023-10-10T22:34:39.375388+0000","last_peered":"2023-10-10T22:34:39.375388+0000","last_clean":"2023-10-10T22:34:39.375388+0000","last_became_active":"2023-10-10T22:34:39.371878+0000","last_became_peered":"2023-10-10T22:34:39.371878+0000","last_unstale":"2023-10-10T22:34:39.375388+0000","last_undegraded":"2023-10-10T22:34:39.375388+0000","last_fullsized":"2023-10-10T22:34:39.375388+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370013+0000","last_change":"2023-10-10T22:34:39.357985+0000","last_active":"2023-10-10T22:34:39.370013+0000","last_peered":"2023-10-10T22:34:39.370013+0000","last_clean":"2023-10-10T22:34:39.370013+0000","last_became_active":"2023-10-10T22:34:39.357717+0000","last_became_peered":"2023-10-10T22:34:39.357717+0000","last_unstale":"2023-10-10T22:34:39.370013+0000","last_undegraded":"2023-10-10T22:34:39.370013+0000","last_fullsized":"2023-10-10T22:34:39.370013+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:03:00.318138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359634+0000","last_change":"2023-10-10T22:34:39.353087+0000","last_active":"2023-10-10T22:34:39.359634+0000","last_peered":"2023-10-10T22:34:39.359634+0000","last_clean":"2023-10-10T22:34:39.359634+0000","last_became_active":"2023-10-10T22:34:39.352790+0000","last_became_peered":"2023-10-10T22:34:39.352790+0000","last_unstale":"2023-10-10T22:34:39.359634+0000","last_undegraded":"2023-10-10T22:34:39.359634+0000","last_fullsized":"2023-10-10T22:34:39.359634+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:02:42.468245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365899+0000","last_change":"2023-10-10T22:34:39.354335+0000","last_active":"2023-10-10T22:34:39.365899+0000","last_peered":"2023-10-10T22:34:39.365899+0000","last_clean":"2023-10-10T22:34:39.365899+0000","last_became_active":"2023-10-10T22:34:39.353930+0000","last_became_peered":"2023-10-10T22:34:39.353930+0000","last_unstale":"2023-10-10T22:34:39.365899+0000","last_undegraded":"2023-10-10T22:34:39.365899+0000","last_fullsized":"2023-10-10T22:34:39.365899+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:44:41.212329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354084+0000","last_change":"2023-10-10T22:34:39.349571+0000","last_active":"2023-10-10T22:34:39.354084+0000","last_peered":"2023-10-10T22:34:39.354084+0000","last_clean":"2023-10-10T22:34:39.354084+0000","last_became_active":"2023-10-10T22:34:39.349303+0000","last_became_peered":"2023-10-10T22:34:39.349303+0000","last_unstale":"2023-10-10T22:34:39.354084+0000","last_undegraded":"2023-10-10T22:34:39.354084+0000","last_fullsized":"2023-10-10T22:34:39.354084+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:11:21.737863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.369776+0000","last_change":"2023-10-10T22:34:39.357615+0000","last_active":"2023-10-10T22:34:39.369776+0000","last_peered":"2023-10-10T22:34:39.369776+0000","last_clean":"2023-10-10T22:34:39.369776+0000","last_became_active":"2023-10-10T22:34:39.353984+0000","last_became_peered":"2023-10-10T22:34:39.353984+0000","last_unstale":"2023-10-10T22:34:39.369776+0000","last_undegraded":"2023-10-10T22:34:39.369776+0000","last_fullsized":"2023-10-10T22:34:39.369776+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:39:59.029344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361232+0000","last_change":"2023-10-10T22:34:39.357021+0000","last_active":"2023-10-10T22:34:39.361232+0000","last_peered":"2023-10-10T22:34:39.361232+0000","last_clean":"2023-10-10T22:34:39.361232+0000","last_became_active":"2023-10-10T22:34:39.356690+0000","last_became_peered":"2023-10-10T22:34:39.356690+0000","last_unstale":"2023-10-10T22:34:39.361232+0000","last_undegraded":"2023-10-10T22:34:39.361232+0000","last_fullsized":"2023-10-10T22:34:39.361232+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:34:33.940317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.349466+0000","last_change":"2023-10-10T22:34:39.343755+0000","last_active":"2023-10-10T22:34:39.349466+0000","last_peered":"2023-10-10T22:34:39.349466+0000","last_clean":"2023-10-10T22:34:39.349466+0000","last_became_active":"2023-10-10T22:34:39.343439+0000","last_became_peered":"2023-10-10T22:34:39.343439+0000","last_unstale":"2023-10-10T22:34:39.349466+0000","last_undegraded":"2023-10-10T22:34:39.349466+0000","last_fullsized":"2023-10-10T22:34:39.349466+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:08:59.777710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354911+0000","last_change":"2023-10-10T22:34:39.350004+0000","last_active":"2023-10-10T22:34:39.354911+0000","last_peered":"2023-10-10T22:34:39.354911+0000","last_clean":"2023-10-10T22:34:39.354911+0000","last_became_active":"2023-10-10T22:34:39.349724+0000","last_became_peered":"2023-10-10T22:34:39.349724+0000","last_unstale":"2023-10-10T22:34:39.354911+0000","last_undegraded":"2023-10-10T22:34:39.354911+0000","last_fullsized":"2023-10-10T22:34:39.354911+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:53.460636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.359615+0000","last_change":"2023-10-10T22:34:39.352813+0000","last_active":"2023-10-10T22:34:39.359615+0000","last_peered":"2023-10-10T22:34:39.359615+0000","last_clean":"2023-10-10T22:34:39.359615+0000","last_became_active":"2023-10-10T22:34:39.352547+0000","last_became_peered":"2023-10-10T22:34:39.352547+0000","last_unstale":"2023-10-10T22:34:39.359615+0000","last_undegraded":"2023-10-10T22:34:39.359615+0000","last_fullsized":"2023-10-10T22:34:39.359615+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:59.251832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"192'4","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.379232+0000","last_change":"2023-10-10T22:34:38.351568+0000","last_active":"2023-10-10T22:34:39.379232+0000","last_peered":"2023-10-10T22:34:39.379232+0000","last_clean":"2023-10-10T22:34:39.379232+0000","last_became_active":"2023-10-10T22:34:38.351225+0000","last_became_peered":"2023-10-10T22:34:38.351225+0000","last_unstale":"2023-10-10T22:34:39.379232+0000","last_undegraded":"2023-10-10T22:34:39.379232+0000","last_fullsized":"2023-10-10T22:34:39.379232+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:37:15.962665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355748+0000","last_change":"2023-10-10T22:34:39.354214+0000","last_active":"2023-10-10T22:34:39.355748+0000","last_peered":"2023-10-10T22:34:39.355748+0000","last_clean":"2023-10-10T22:34:39.355748+0000","last_became_active":"2023-10-10T22:34:39.353954+0000","last_became_peered":"2023-10-10T22:34:39.353954+0000","last_unstale":"2023-10-10T22:34:39.355748+0000","last_undegraded":"2023-10-10T22:34:39.355748+0000","last_fullsized":"2023-10-10T22:34:39.355748+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:43.202754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.369351+0000","last_change":"2023-10-10T22:34:38.347744+0000","last_active":"2023-10-10T22:34:39.369351+0000","last_peered":"2023-10-10T22:34:39.369351+0000","last_clean":"2023-10-10T22:34:39.369351+0000","last_became_active":"2023-10-10T22:34:38.347475+0000","last_became_peered":"2023-10-10T22:34:38.347475+0000","last_unstale":"2023-10-10T22:34:39.369351+0000","last_undegraded":"2023-10-10T22:34:39.369351+0000","last_fullsized":"2023-10-10T22:34:39.369351+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:00.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365604+0000","last_change":"2023-10-10T22:34:39.362882+0000","last_active":"2023-10-10T22:34:39.365604+0000","last_peered":"2023-10-10T22:34:39.365604+0000","last_clean":"2023-10-10T22:34:39.365604+0000","last_became_active":"2023-10-10T22:34:39.361990+0000","last_became_peered":"2023-10-10T22:34:39.361990+0000","last_unstale":"2023-10-10T22:34:39.365604+0000","last_undegraded":"2023-10-10T22:34:39.365604+0000","last_fullsized":"2023-10-10T22:34:39.365604+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:51:53.148543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371483+0000","last_change":"2023-10-10T22:34:38.347538+0000","last_active":"2023-10-10T22:34:39.371483+0000","last_peered":"2023-10-10T22:34:39.371483+0000","last_clean":"2023-10-10T22:34:39.371483+0000","last_became_active":"2023-10-10T22:34:38.347315+0000","last_became_peered":"2023-10-10T22:34:38.347315+0000","last_unstale":"2023-10-10T22:34:39.371483+0000","last_undegraded":"2023-10-10T22:34:39.371483+0000","last_fullsized":"2023-10-10T22:34:39.371483+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:40:05.186977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370061+0000","last_change":"2023-10-10T22:34:39.361299+0000","last_active":"2023-10-10T22:34:39.370061+0000","last_peered":"2023-10-10T22:34:39.370061+0000","last_clean":"2023-10-10T22:34:39.370061+0000","last_became_active":"2023-10-10T22:34:39.356707+0000","last_became_peered":"2023-10-10T22:34:39.356707+0000","last_unstale":"2023-10-10T22:34:39.370061+0000","last_undegraded":"2023-10-10T22:34:39.370061+0000","last_fullsized":"2023-10-10T22:34:39.370061+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:34.431220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.377096+0000","last_change":"2023-10-10T22:34:38.345977+0000","last_active":"2023-10-10T22:34:39.377096+0000","last_peered":"2023-10-10T22:34:39.377096+0000","last_clean":"2023-10-10T22:34:39.377096+0000","last_became_active":"2023-10-10T22:34:38.345697+0000","last_became_peered":"2023-10-10T22:34:38.345697+0000","last_unstale":"2023-10-10T22:34:39.377096+0000","last_undegraded":"2023-10-10T22:34:39.377096+0000","last_fullsized":"2023-10-10T22:34:39.377096+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:23:33.450441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355599+0000","last_change":"2023-10-10T22:34:39.348763+0000","last_active":"2023-10-10T22:34:39.355599+0000","last_peered":"2023-10-10T22:34:39.355599+0000","last_clean":"2023-10-10T22:34:39.355599+0000","last_became_active":"2023-10-10T22:34:39.348522+0000","last_became_peered":"2023-10-10T22:34:39.348522+0000","last_unstale":"2023-10-10T22:34:39.355599+0000","last_undegraded":"2023-10-10T22:34:39.355599+0000","last_fullsized":"2023-10-10T22:34:39.355599+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:04:16.976709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.374639+0000","last_change":"2023-10-10T22:34:38.342385+0000","last_active":"2023-10-10T22:34:39.374639+0000","last_peered":"2023-10-10T22:34:39.374639+0000","last_clean":"2023-10-10T22:34:39.374639+0000","last_became_active":"2023-10-10T22:34:38.342066+0000","last_became_peered":"2023-10-10T22:34:38.342066+0000","last_unstale":"2023-10-10T22:34:39.374639+0000","last_undegraded":"2023-10-10T22:34:39.374639+0000","last_fullsized":"2023-10-10T22:34:39.374639+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:43:00.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361660+0000","last_change":"2023-10-10T22:34:39.354944+0000","last_active":"2023-10-10T22:34:39.361660+0000","last_peered":"2023-10-10T22:34:39.361660+0000","last_clean":"2023-10-10T22:34:39.361660+0000","last_became_active":"2023-10-10T22:34:39.354688+0000","last_became_peered":"2023-10-10T22:34:39.354688+0000","last_unstale":"2023-10-10T22:34:39.361660+0000","last_undegraded":"2023-10-10T22:34:39.361660+0000","last_fullsized":"2023-10-10T22:34:39.361660+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:39.385854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371725+0000","last_change":"2023-10-10T22:34:38.345988+0000","last_active":"2023-10-10T22:34:39.371725+0000","last_peered":"2023-10-10T22:34:39.371725+0000","last_clean":"2023-10-10T22:34:39.371725+0000","last_became_active":"2023-10-10T22:34:38.345712+0000","last_became_peered":"2023-10-10T22:34:38.345712+0000","last_unstale":"2023-10-10T22:34:39.371725+0000","last_undegraded":"2023-10-10T22:34:39.371725+0000","last_fullsized":"2023-10-10T22:34:39.371725+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:27:24.109366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360699+0000","last_change":"2023-10-10T22:34:39.359133+0000","last_active":"2023-10-10T22:34:39.360699+0000","last_peered":"2023-10-10T22:34:39.360699+0000","last_clean":"2023-10-10T22:34:39.360699+0000","last_became_active":"2023-10-10T22:34:39.358861+0000","last_became_peered":"2023-10-10T22:34:39.358861+0000","last_unstale":"2023-10-10T22:34:39.360699+0000","last_undegraded":"2023-10-10T22:34:39.360699+0000","last_fullsized":"2023-10-10T22:34:39.360699+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:06:08.544990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.345113+0000","last_change":"2023-10-10T22:34:38.343671+0000","last_active":"2023-10-10T22:34:39.345113+0000","last_peered":"2023-10-10T22:34:39.345113+0000","last_clean":"2023-10-10T22:34:39.345113+0000","last_became_active":"2023-10-10T22:34:38.343422+0000","last_became_peered":"2023-10-10T22:34:38.343422+0000","last_unstale":"2023-10-10T22:34:39.345113+0000","last_undegraded":"2023-10-10T22:34:39.345113+0000","last_fullsized":"2023-10-10T22:34:39.345113+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:25:30.755114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363268+0000","last_change":"2023-10-10T22:34:39.358093+0000","last_active":"2023-10-10T22:34:39.363268+0000","last_peered":"2023-10-10T22:34:39.363268+0000","last_clean":"2023-10-10T22:34:39.363268+0000","last_became_active":"2023-10-10T22:34:39.357668+0000","last_became_peered":"2023-10-10T22:34:39.357668+0000","last_unstale":"2023-10-10T22:34:39.363268+0000","last_undegraded":"2023-10-10T22:34:39.363268+0000","last_fullsized":"2023-10-10T22:34:39.363268+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:57:19.780519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.337760+0000","last_change":"2023-10-10T22:34:38.347221+0000","last_active":"2023-10-10T22:34:39.337760+0000","last_peered":"2023-10-10T22:34:39.337760+0000","last_clean":"2023-10-10T22:34:39.337760+0000","last_became_active":"2023-10-10T22:34:38.346540+0000","last_became_peered":"2023-10-10T22:34:38.346540+0000","last_unstale":"2023-10-10T22:34:39.337760+0000","last_undegraded":"2023-10-10T22:34:39.337760+0000","last_fullsized":"2023-10-10T22:34:39.337760+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364110+0000","last_change":"2023-10-10T22:34:39.359054+0000","last_active":"2023-10-10T22:34:39.364110+0000","last_peered":"2023-10-10T22:34:39.364110+0000","last_clean":"2023-10-10T22:34:39.364110+0000","last_became_active":"2023-10-10T22:34:39.358728+0000","last_became_peered":"2023-10-10T22:34:39.358728+0000","last_unstale":"2023-10-10T22:34:39.364110+0000","last_undegraded":"2023-10-10T22:34:39.364110+0000","last_fullsized":"2023-10-10T22:34:39.364110+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:46:24.561755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.344344+0000","last_change":"2023-10-10T22:34:38.351309+0000","last_active":"2023-10-10T22:34:39.344344+0000","last_peered":"2023-10-10T22:34:39.344344+0000","last_clean":"2023-10-10T22:34:39.344344+0000","last_became_active":"2023-10-10T22:34:38.350974+0000","last_became_peered":"2023-10-10T22:34:38.350974+0000","last_unstale":"2023-10-10T22:34:39.344344+0000","last_undegraded":"2023-10-10T22:34:39.344344+0000","last_fullsized":"2023-10-10T22:34:39.344344+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:55:19.823507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364415+0000","last_change":"2023-10-10T22:34:39.359454+0000","last_active":"2023-10-10T22:34:39.364415+0000","last_peered":"2023-10-10T22:34:39.364415+0000","last_clean":"2023-10-10T22:34:39.364415+0000","last_became_active":"2023-10-10T22:34:39.359114+0000","last_became_peered":"2023-10-10T22:34:39.359114+0000","last_unstale":"2023-10-10T22:34:39.364415+0000","last_undegraded":"2023-10-10T22:34:39.364415+0000","last_fullsized":"2023-10-10T22:34:39.364415+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:34:24.445318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"192'3","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375047+0000","last_change":"2023-10-10T22:34:38.343325+0000","last_active":"2023-10-10T22:34:39.375047+0000","last_peered":"2023-10-10T22:34:39.375047+0000","last_clean":"2023-10-10T22:34:39.375047+0000","last_became_active":"2023-10-10T22:34:38.343010+0000","last_became_peered":"2023-10-10T22:34:38.343010+0000","last_unstale":"2023-10-10T22:34:39.375047+0000","last_undegraded":"2023-10-10T22:34:39.375047+0000","last_fullsized":"2023-10-10T22:34:39.375047+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:22:10.998587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.367477+0000","last_change":"2023-10-10T22:34:39.360642+0000","last_active":"2023-10-10T22:34:39.367477+0000","last_peered":"2023-10-10T22:34:39.367477+0000","last_clean":"2023-10-10T22:34:39.367477+0000","last_became_active":"2023-10-10T22:34:39.359917+0000","last_became_peered":"2023-10-10T22:34:39.359917+0000","last_unstale":"2023-10-10T22:34:39.367477+0000","last_undegraded":"2023-10-10T22:34:39.367477+0000","last_fullsized":"2023-10-10T22:34:39.367477+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:04:16.976709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"192'6","reported_seq":16,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.379286+0000","last_change":"2023-10-10T22:34:38.345651+0000","last_active":"2023-10-10T22:34:39.379286+0000","last_peered":"2023-10-10T22:34:39.379286+0000","last_clean":"2023-10-10T22:34:39.379286+0000","last_became_active":"2023-10-10T22:34:38.345375+0000","last_became_peered":"2023-10-10T22:34:38.345375+0000","last_unstale":"2023-10-10T22:34:39.379286+0000","last_undegraded":"2023-10-10T22:34:39.379286+0000","last_fullsized":"2023-10-10T22:34:39.379286+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:46:54.508176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354988+0000","last_change":"2023-10-10T22:34:39.351683+0000","last_active":"2023-10-10T22:34:39.354988+0000","last_peered":"2023-10-10T22:34:39.354988+0000","last_clean":"2023-10-10T22:34:39.354988+0000","last_became_active":"2023-10-10T22:34:39.351408+0000","last_became_peered":"2023-10-10T22:34:39.351408+0000","last_unstale":"2023-10-10T22:34:39.354988+0000","last_undegraded":"2023-10-10T22:34:39.354988+0000","last_fullsized":"2023-10-10T22:34:39.354988+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:52:56.113061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.372204+0000","last_change":"2023-10-10T22:34:38.346608+0000","last_active":"2023-10-10T22:34:39.372204+0000","last_peered":"2023-10-10T22:34:39.372204+0000","last_clean":"2023-10-10T22:34:39.372204+0000","last_became_active":"2023-10-10T22:34:38.346322+0000","last_became_peered":"2023-10-10T22:34:38.346322+0000","last_unstale":"2023-10-10T22:34:39.372204+0000","last_undegraded":"2023-10-10T22:34:39.372204+0000","last_fullsized":"2023-10-10T22:34:39.372204+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:10:32.171397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363254+0000","last_change":"2023-10-10T22:34:39.360965+0000","last_active":"2023-10-10T22:34:39.363254+0000","last_peered":"2023-10-10T22:34:39.363254+0000","last_clean":"2023-10-10T22:34:39.363254+0000","last_became_active":"2023-10-10T22:34:39.360596+0000","last_became_peered":"2023-10-10T22:34:39.360596+0000","last_unstale":"2023-10-10T22:34:39.363254+0000","last_undegraded":"2023-10-10T22:34:39.363254+0000","last_fullsized":"2023-10-10T22:34:39.363254+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:35:17.534324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.343088+0000","last_change":"2023-10-10T22:34:38.342951+0000","last_active":"2023-10-10T22:34:39.343088+0000","last_peered":"2023-10-10T22:34:39.343088+0000","last_clean":"2023-10-10T22:34:39.343088+0000","last_became_active":"2023-10-10T22:34:38.342633+0000","last_became_peered":"2023-10-10T22:34:38.342633+0000","last_unstale":"2023-10-10T22:34:39.343088+0000","last_undegraded":"2023-10-10T22:34:39.343088+0000","last_fullsized":"2023-10-10T22:34:39.343088+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:09:40.630602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368257+0000","last_change":"2023-10-10T22:34:39.363723+0000","last_active":"2023-10-10T22:34:39.368257+0000","last_peered":"2023-10-10T22:34:39.368257+0000","last_clean":"2023-10-10T22:34:39.368257+0000","last_became_active":"2023-10-10T22:34:39.362357+0000","last_became_peered":"2023-10-10T22:34:39.362357+0000","last_unstale":"2023-10-10T22:34:39.368257+0000","last_undegraded":"2023-10-10T22:34:39.368257+0000","last_fullsized":"2023-10-10T22:34:39.368257+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:09:05.154179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341334+0000","last_change":"2023-10-10T22:34:38.348455+0000","last_active":"2023-10-10T22:34:39.341334+0000","last_peered":"2023-10-10T22:34:39.341334+0000","last_clean":"2023-10-10T22:34:39.341334+0000","last_became_active":"2023-10-10T22:34:38.348238+0000","last_became_peered":"2023-10-10T22:34:38.348238+0000","last_unstale":"2023-10-10T22:34:39.341334+0000","last_undegraded":"2023-10-10T22:34:39.341334+0000","last_fullsized":"2023-10-10T22:34:39.341334+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:39.834725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.370251+0000","last_change":"2023-10-10T22:34:39.360344+0000","last_active":"2023-10-10T22:34:39.370251+0000","last_peered":"2023-10-10T22:34:39.370251+0000","last_clean":"2023-10-10T22:34:39.370251+0000","last_became_active":"2023-10-10T22:34:39.358400+0000","last_became_peered":"2023-10-10T22:34:39.358400+0000","last_unstale":"2023-10-10T22:34:39.370251+0000","last_undegraded":"2023-10-10T22:34:39.370251+0000","last_fullsized":"2023-10-10T22:34:39.370251+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:25:59.049929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"192'8","reported_seq":18,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.377912+0000","last_change":"2023-10-10T22:34:38.344325+0000","last_active":"2023-10-10T22:34:39.377912+0000","last_peered":"2023-10-10T22:34:39.377912+0000","last_clean":"2023-10-10T22:34:39.377912+0000","last_became_active":"2023-10-10T22:34:38.344062+0000","last_became_peered":"2023-10-10T22:34:38.344062+0000","last_unstale":"2023-10-10T22:34:39.377912+0000","last_undegraded":"2023-10-10T22:34:39.377912+0000","last_fullsized":"2023-10-10T22:34:39.377912+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:32:11.540091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357821+0000","last_change":"2023-10-10T22:34:39.351873+0000","last_active":"2023-10-10T22:34:39.357821+0000","last_peered":"2023-10-10T22:34:39.357821+0000","last_clean":"2023-10-10T22:34:39.357821+0000","last_became_active":"2023-10-10T22:34:39.351061+0000","last_became_peered":"2023-10-10T22:34:39.351061+0000","last_unstale":"2023-10-10T22:34:39.357821+0000","last_undegraded":"2023-10-10T22:34:39.357821+0000","last_fullsized":"2023-10-10T22:34:39.357821+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:20:04.376717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.375658+0000","last_change":"2023-10-10T22:34:38.349029+0000","last_active":"2023-10-10T22:34:39.375658+0000","last_peered":"2023-10-10T22:34:39.375658+0000","last_clean":"2023-10-10T22:34:39.375658+0000","last_became_active":"2023-10-10T22:34:38.348764+0000","last_became_peered":"2023-10-10T22:34:38.348764+0000","last_unstale":"2023-10-10T22:34:39.375658+0000","last_undegraded":"2023-10-10T22:34:39.375658+0000","last_fullsized":"2023-10-10T22:34:39.375658+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:20:02.879495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354935+0000","last_change":"2023-10-10T22:34:39.351667+0000","last_active":"2023-10-10T22:34:39.354935+0000","last_peered":"2023-10-10T22:34:39.354935+0000","last_clean":"2023-10-10T22:34:39.354935+0000","last_became_active":"2023-10-10T22:34:39.351393+0000","last_became_peered":"2023-10-10T22:34:39.351393+0000","last_unstale":"2023-10-10T22:34:39.354935+0000","last_undegraded":"2023-10-10T22:34:39.354935+0000","last_fullsized":"2023-10-10T22:34:39.354935+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:11:47.675306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.374078+0000","last_change":"2023-10-10T22:34:38.347383+0000","last_active":"2023-10-10T22:34:39.374078+0000","last_peered":"2023-10-10T22:34:39.374078+0000","last_clean":"2023-10-10T22:34:39.374078+0000","last_became_active":"2023-10-10T22:34:38.347124+0000","last_became_peered":"2023-10-10T22:34:38.347124+0000","last_unstale":"2023-10-10T22:34:39.374078+0000","last_undegraded":"2023-10-10T22:34:39.374078+0000","last_fullsized":"2023-10-10T22:34:39.374078+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:46:54.508176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.360151+0000","last_change":"2023-10-10T22:34:39.355355+0000","last_active":"2023-10-10T22:34:39.360151+0000","last_peered":"2023-10-10T22:34:39.360151+0000","last_clean":"2023-10-10T22:34:39.360151+0000","last_became_active":"2023-10-10T22:34:39.354553+0000","last_became_peered":"2023-10-10T22:34:39.354553+0000","last_unstale":"2023-10-10T22:34:39.360151+0000","last_undegraded":"2023-10-10T22:34:39.360151+0000","last_fullsized":"2023-10-10T22:34:39.360151+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:05:43.000916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"192'1","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.376906+0000","last_change":"2023-10-10T22:34:38.339744+0000","last_active":"2023-10-10T22:34:39.376906+0000","last_peered":"2023-10-10T22:34:39.376906+0000","last_clean":"2023-10-10T22:34:39.376906+0000","last_became_active":"2023-10-10T22:34:38.339358+0000","last_became_peered":"2023-10-10T22:34:38.339358+0000","last_unstale":"2023-10-10T22:34:39.376906+0000","last_undegraded":"2023-10-10T22:34:39.376906+0000","last_fullsized":"2023-10-10T22:34:39.376906+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:36:46.689485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355582+0000","last_change":"2023-10-10T22:34:39.350476+0000","last_active":"2023-10-10T22:34:39.355582+0000","last_peered":"2023-10-10T22:34:39.355582+0000","last_clean":"2023-10-10T22:34:39.355582+0000","last_became_active":"2023-10-10T22:34:39.350220+0000","last_became_peered":"2023-10-10T22:34:39.350220+0000","last_unstale":"2023-10-10T22:34:39.355582+0000","last_undegraded":"2023-10-10T22:34:39.355582+0000","last_fullsized":"2023-10-10T22:34:39.355582+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:13:43.202754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.349047+0000","last_change":"2023-10-10T22:34:38.344777+0000","last_active":"2023-10-10T22:34:39.349047+0000","last_peered":"2023-10-10T22:34:39.349047+0000","last_clean":"2023-10-10T22:34:39.349047+0000","last_became_active":"2023-10-10T22:34:38.344520+0000","last_became_peered":"2023-10-10T22:34:38.344520+0000","last_unstale":"2023-10-10T22:34:39.349047+0000","last_undegraded":"2023-10-10T22:34:39.349047+0000","last_fullsized":"2023-10-10T22:34:39.349047+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:30:46.904028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365646+0000","last_change":"2023-10-10T22:34:39.349337+0000","last_active":"2023-10-10T22:34:39.365646+0000","last_peered":"2023-10-10T22:34:39.365646+0000","last_clean":"2023-10-10T22:34:39.365646+0000","last_became_active":"2023-10-10T22:34:39.349064+0000","last_became_peered":"2023-10-10T22:34:39.349064+0000","last_unstale":"2023-10-10T22:34:39.365646+0000","last_undegraded":"2023-10-10T22:34:39.365646+0000","last_fullsized":"2023-10-10T22:34:39.365646+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371650+0000","last_change":"2023-10-10T22:34:38.349149+0000","last_active":"2023-10-10T22:34:39.371650+0000","last_peered":"2023-10-10T22:34:39.371650+0000","last_clean":"2023-10-10T22:34:39.371650+0000","last_became_active":"2023-10-10T22:34:38.348826+0000","last_became_peered":"2023-10-10T22:34:38.348826+0000","last_unstale":"2023-10-10T22:34:39.371650+0000","last_undegraded":"2023-10-10T22:34:39.371650+0000","last_fullsized":"2023-10-10T22:34:39.371650+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:46:04.840202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363236+0000","last_change":"2023-10-10T22:34:39.359963+0000","last_active":"2023-10-10T22:34:39.363236+0000","last_peered":"2023-10-10T22:34:39.363236+0000","last_clean":"2023-10-10T22:34:39.363236+0000","last_became_active":"2023-10-10T22:34:39.359619+0000","last_became_peered":"2023-10-10T22:34:39.359619+0000","last_unstale":"2023-10-10T22:34:39.363236+0000","last_undegraded":"2023-10-10T22:34:39.363236+0000","last_fullsized":"2023-10-10T22:34:39.363236+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:21:53.222053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.347027+0000","last_change":"2023-10-10T22:34:38.346034+0000","last_active":"2023-10-10T22:34:39.347027+0000","last_peered":"2023-10-10T22:34:39.347027+0000","last_clean":"2023-10-10T22:34:39.347027+0000","last_became_active":"2023-10-10T22:34:38.345794+0000","last_became_peered":"2023-10-10T22:34:38.345794+0000","last_unstale":"2023-10-10T22:34:39.347027+0000","last_undegraded":"2023-10-10T22:34:39.347027+0000","last_fullsized":"2023-10-10T22:34:39.347027+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:49:33.159463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361628+0000","last_change":"2023-10-10T22:34:39.359562+0000","last_active":"2023-10-10T22:34:39.361628+0000","last_peered":"2023-10-10T22:34:39.361628+0000","last_clean":"2023-10-10T22:34:39.361628+0000","last_became_active":"2023-10-10T22:34:39.359252+0000","last_became_peered":"2023-10-10T22:34:39.359252+0000","last_unstale":"2023-10-10T22:34:39.361628+0000","last_undegraded":"2023-10-10T22:34:39.361628+0000","last_fullsized":"2023-10-10T22:34:39.361628+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:26:49.254502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341438+0000","last_change":"2023-10-10T22:34:38.351131+0000","last_active":"2023-10-10T22:34:39.341438+0000","last_peered":"2023-10-10T22:34:39.341438+0000","last_clean":"2023-10-10T22:34:39.341438+0000","last_became_active":"2023-10-10T22:34:38.350834+0000","last_became_peered":"2023-10-10T22:34:38.350834+0000","last_unstale":"2023-10-10T22:34:39.341438+0000","last_undegraded":"2023-10-10T22:34:39.341438+0000","last_fullsized":"2023-10-10T22:34:39.341438+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:39:55.430063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.368472+0000","last_change":"2023-10-10T22:34:39.364264+0000","last_active":"2023-10-10T22:34:39.368472+0000","last_peered":"2023-10-10T22:34:39.368472+0000","last_clean":"2023-10-10T22:34:39.368472+0000","last_became_active":"2023-10-10T22:34:39.364001+0000","last_became_peered":"2023-10-10T22:34:39.364001+0000","last_unstale":"2023-10-10T22:34:39.368472+0000","last_undegraded":"2023-10-10T22:34:39.368472+0000","last_fullsized":"2023-10-10T22:34:39.368472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:24:13.516064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.348552+0000","last_change":"2023-10-10T22:34:38.345484+0000","last_active":"2023-10-10T22:34:39.348552+0000","last_peered":"2023-10-10T22:34:39.348552+0000","last_clean":"2023-10-10T22:34:39.348552+0000","last_became_active":"2023-10-10T22:34:38.345163+0000","last_became_peered":"2023-10-10T22:34:38.345163+0000","last_unstale":"2023-10-10T22:34:39.348552+0000","last_undegraded":"2023-10-10T22:34:39.348552+0000","last_fullsized":"2023-10-10T22:34:39.348552+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:28:21.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364340+0000","last_change":"2023-10-10T22:34:39.359432+0000","last_active":"2023-10-10T22:34:39.364340+0000","last_peered":"2023-10-10T22:34:39.364340+0000","last_clean":"2023-10-10T22:34:39.364340+0000","last_became_active":"2023-10-10T22:34:39.358785+0000","last_became_peered":"2023-10-10T22:34:39.358785+0000","last_unstale":"2023-10-10T22:34:39.364340+0000","last_undegraded":"2023-10-10T22:34:39.364340+0000","last_fullsized":"2023-10-10T22:34:39.364340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:12:04.760644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"192'2","reported_seq":12,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.371647+0000","last_change":"2023-10-10T22:34:38.348511+0000","last_active":"2023-10-10T22:34:39.371647+0000","last_peered":"2023-10-10T22:34:39.371647+0000","last_clean":"2023-10-10T22:34:39.371647+0000","last_became_active":"2023-10-10T22:34:38.348207+0000","last_became_peered":"2023-10-10T22:34:38.348207+0000","last_unstale":"2023-10-10T22:34:39.371647+0000","last_undegraded":"2023-10-10T22:34:39.371647+0000","last_fullsized":"2023-10-10T22:34:39.371647+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:58:44.571683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.361003+0000","last_change":"2023-10-10T22:34:39.355266+0000","last_active":"2023-10-10T22:34:39.361003+0000","last_peered":"2023-10-10T22:34:39.361003+0000","last_clean":"2023-10-10T22:34:39.361003+0000","last_became_active":"2023-10-10T22:34:39.355008+0000","last_became_peered":"2023-10-10T22:34:39.355008+0000","last_unstale":"2023-10-10T22:34:39.361003+0000","last_undegraded":"2023-10-10T22:34:39.361003+0000","last_fullsized":"2023-10-10T22:34:39.361003+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:06:51.883518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.340569+0000","last_change":"2023-10-10T22:34:38.346683+0000","last_active":"2023-10-10T22:34:39.340569+0000","last_peered":"2023-10-10T22:34:39.340569+0000","last_clean":"2023-10-10T22:34:39.340569+0000","last_became_active":"2023-10-10T22:34:38.346422+0000","last_became_peered":"2023-10-10T22:34:38.346422+0000","last_unstale":"2023-10-10T22:34:39.340569+0000","last_undegraded":"2023-10-10T22:34:39.340569+0000","last_fullsized":"2023-10-10T22:34:39.340569+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:32:11.540091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.357626+0000","last_change":"2023-10-10T22:34:39.352912+0000","last_active":"2023-10-10T22:34:39.357626+0000","last_peered":"2023-10-10T22:34:39.357626+0000","last_clean":"2023-10-10T22:34:39.357626+0000","last_became_active":"2023-10-10T22:34:39.352659+0000","last_became_peered":"2023-10-10T22:34:39.352659+0000","last_unstale":"2023-10-10T22:34:39.357626+0000","last_undegraded":"2023-10-10T22:34:39.357626+0000","last_fullsized":"2023-10-10T22:34:39.357626+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:28:55.854343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.355884+0000","last_change":"2023-10-10T22:34:38.343062+0000","last_active":"2023-10-10T22:34:39.355884+0000","last_peered":"2023-10-10T22:34:39.355884+0000","last_clean":"2023-10-10T22:34:39.355884+0000","last_became_active":"2023-10-10T22:34:38.342785+0000","last_became_peered":"2023-10-10T22:34:38.342785+0000","last_unstale":"2023-10-10T22:34:39.355884+0000","last_undegraded":"2023-10-10T22:34:39.355884+0000","last_fullsized":"2023-10-10T22:34:39.355884+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:37:29.658776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365464+0000","last_change":"2023-10-10T22:34:39.362657+0000","last_active":"2023-10-10T22:34:39.365464+0000","last_peered":"2023-10-10T22:34:39.365464+0000","last_clean":"2023-10-10T22:34:39.365464+0000","last_became_active":"2023-10-10T22:34:39.362380+0000","last_became_peered":"2023-10-10T22:34:39.362380+0000","last_unstale":"2023-10-10T22:34:39.365464+0000","last_undegraded":"2023-10-10T22:34:39.365464+0000","last_fullsized":"2023-10-10T22:34:39.365464+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:57:18.834083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.342952+0000","last_change":"2023-10-10T22:34:38.347549+0000","last_active":"2023-10-10T22:34:39.342952+0000","last_peered":"2023-10-10T22:34:39.342952+0000","last_clean":"2023-10-10T22:34:39.342952+0000","last_became_active":"2023-10-10T22:34:38.347295+0000","last_became_peered":"2023-10-10T22:34:38.347295+0000","last_unstale":"2023-10-10T22:34:39.342952+0000","last_undegraded":"2023-10-10T22:34:39.342952+0000","last_fullsized":"2023-10-10T22:34:39.342952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:18:33.343928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.354970+0000","last_change":"2023-10-10T22:34:39.348743+0000","last_active":"2023-10-10T22:34:39.354970+0000","last_peered":"2023-10-10T22:34:39.354970+0000","last_clean":"2023-10-10T22:34:39.354970+0000","last_became_active":"2023-10-10T22:34:39.348482+0000","last_became_peered":"2023-10-10T22:34:39.348482+0000","last_unstale":"2023-10-10T22:34:39.354970+0000","last_undegraded":"2023-10-10T22:34:39.354970+0000","last_fullsized":"2023-10-10T22:34:39.354970+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:17:05.835271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.344003+0000","last_change":"2023-10-10T22:34:38.335355+0000","last_active":"2023-10-10T22:34:39.344003+0000","last_peered":"2023-10-10T22:34:39.344003+0000","last_clean":"2023-10-10T22:34:39.344003+0000","last_became_active":"2023-10-10T22:34:38.335103+0000","last_became_peered":"2023-10-10T22:34:38.335103+0000","last_unstale":"2023-10-10T22:34:39.344003+0000","last_undegraded":"2023-10-10T22:34:39.344003+0000","last_fullsized":"2023-10-10T22:34:39.344003+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:20:44.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.350411+0000","last_change":"2023-10-10T22:34:39.344532+0000","last_active":"2023-10-10T22:34:39.350411+0000","last_peered":"2023-10-10T22:34:39.350411+0000","last_clean":"2023-10-10T22:34:39.350411+0000","last_became_active":"2023-10-10T22:34:39.344193+0000","last_became_peered":"2023-10-10T22:34:39.344193+0000","last_unstale":"2023-10-10T22:34:39.350411+0000","last_undegraded":"2023-10-10T22:34:39.350411+0000","last_fullsized":"2023-10-10T22:34:39.350411+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:35:17.534324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.341151+0000","last_change":"2023-10-10T22:34:38.340111+0000","last_active":"2023-10-10T22:34:39.341151+0000","last_peered":"2023-10-10T22:34:39.341151+0000","last_clean":"2023-10-10T22:34:39.341151+0000","last_became_active":"2023-10-10T22:34:38.339803+0000","last_became_peered":"2023-10-10T22:34:38.339803+0000","last_unstale":"2023-10-10T22:34:39.341151+0000","last_undegraded":"2023-10-10T22:34:39.341151+0000","last_fullsized":"2023-10-10T22:34:39.341151+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:54:34.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.363484+0000","last_change":"2023-10-10T22:34:39.360326+0000","last_active":"2023-10-10T22:34:39.363484+0000","last_peered":"2023-10-10T22:34:39.363484+0000","last_clean":"2023-10-10T22:34:39.363484+0000","last_became_active":"2023-10-10T22:34:39.360073+0000","last_became_peered":"2023-10-10T22:34:39.360073+0000","last_unstale":"2023-10-10T22:34:39.363484+0000","last_undegraded":"2023-10-10T22:34:39.363484+0000","last_fullsized":"2023-10-10T22:34:39.363484+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:47.202171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.353042+0000","last_change":"2023-10-10T22:34:38.344691+0000","last_active":"2023-10-10T22:34:39.353042+0000","last_peered":"2023-10-10T22:34:39.353042+0000","last_clean":"2023-10-10T22:34:39.353042+0000","last_became_active":"2023-10-10T22:34:38.344440+0000","last_became_peered":"2023-10-10T22:34:38.344440+0000","last_unstale":"2023-10-10T22:34:39.353042+0000","last_undegraded":"2023-10-10T22:34:39.353042+0000","last_fullsized":"2023-10-10T22:34:39.353042+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:35:50.647239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.365891+0000","last_change":"2023-10-10T22:34:39.356578+0000","last_active":"2023-10-10T22:34:39.365891+0000","last_peered":"2023-10-10T22:34:39.365891+0000","last_clean":"2023-10-10T22:34:39.365891+0000","last_became_active":"2023-10-10T22:34:39.356270+0000","last_became_peered":"2023-10-10T22:34:39.356270+0000","last_unstale":"2023-10-10T22:34:39.365891+0000","last_undegraded":"2023-10-10T22:34:39.365891+0000","last_fullsized":"2023-10-10T22:34:39.365891+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:48:08.525393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.342644+0000","last_change":"2023-10-10T22:34:38.340216+0000","last_active":"2023-10-10T22:34:39.342644+0000","last_peered":"2023-10-10T22:34:39.342644+0000","last_clean":"2023-10-10T22:34:39.342644+0000","last_became_active":"2023-10-10T22:34:38.339475+0000","last_became_peered":"2023-10-10T22:34:38.339475+0000","last_unstale":"2023-10-10T22:34:39.342644+0000","last_undegraded":"2023-10-10T22:34:39.342644+0000","last_fullsized":"2023-10-10T22:34:39.342644+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:19.851014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.364424+0000","last_change":"2023-10-10T22:34:39.359593+0000","last_active":"2023-10-10T22:34:39.364424+0000","last_peered":"2023-10-10T22:34:39.364424+0000","last_clean":"2023-10-10T22:34:39.364424+0000","last_became_active":"2023-10-10T22:34:39.359168+0000","last_became_peered":"2023-10-10T22:34:39.359168+0000","last_unstale":"2023-10-10T22:34:39.364424+0000","last_undegraded":"2023-10-10T22:34:39.364424+0000","last_fullsized":"2023-10-10T22:34:39.364424+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:38.319548+0000","last_clean_scrub_stamp":"2023-10-10T22:34:38.319548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:54:58.046132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.343500+0000","last_change":"2023-10-10T22:34:38.340647+0000","last_active":"2023-10-10T22:34:39.343500+0000","last_peered":"2023-10-10T22:34:39.343500+0000","last_clean":"2023-10-10T22:34:39.343500+0000","last_became_active":"2023-10-10T22:34:38.340347+0000","last_became_peered":"2023-10-10T22:34:38.340347+0000","last_unstale":"2023-10-10T22:34:39.343500+0000","last_undegraded":"2023-10-10T22:34:39.343500+0000","last_fullsized":"2023-10-10T22:34:39.343500+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:34:37.311358+0000","last_clean_scrub_stamp":"2023-10-10T22:34:37.311358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:23:02.934919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"182'326","reported_seq":1055,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-10T22:34:39.348642+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:34:39.348642+0000","last_peered":"2023-10-10T22:34:39.348642+0000","last_clean":"2023-10-10T22:34:39.348642+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:34:39.348642+0000","last_undegraded":"2023-10-10T22:34:39.348642+0000","last_fullsized":"2023-10-10T22:34:39.348642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543244,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312532,"kb_used_data":2956,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059308,"statfs":{"total":96636764160,"available":96316731392,"internally_reserved":0,"allocated":3026944,"data_stored":1800844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.57099999999999995,"5min":0.44500000000000001,"15min":0.36699999999999999},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.026},"last":0.628},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.35399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.081},"last":0.60799999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.60199999999999998,"5min":0.47699999999999998,"15min":0.44700000000000001},"max":{"1min":0.84099999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.46600000000000003},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":1.095},"last":0.65800000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.66000000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92700000000000005,"5min":0.96699999999999997,"15min":1},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.44400000000000001},"max":{"1min":0.91300000000000003,"5min":0.95899999999999996,"15min":0.97599999999999998},"last":0.754}]},{"osd":3,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.63800000000000001,"5min":0.47699999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":0.99099999999999999,"15min":1.0009999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.625,"5min":0.502,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.372},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.97399999999999998},"last":0.82699999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.079,"15min":1.079},"last":0.72699999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":1.125,"15min":1.125},"last":0.83899999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543243,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316032,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055808,"statfs":{"total":96636764160,"available":96313147392,"internally_reserved":0,"allocated":2416640,"data_stored":1208802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":0.96699999999999997,"15min":1.006},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.39700000000000002},"max":{"1min":0.90100000000000002,"5min":0.997,"15min":0.997},"last":0.44900000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.63600000000000001,"5min":0.48499999999999999,"15min":0.371},"max":{"1min":0.90600000000000003,"5min":0.94499999999999995,"15min":1.01},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":1.014,"15min":1.0349999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.44800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.038},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.42299999999999999},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.93600000000000005},"last":0.70499999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.51700000000000002,"15min":0.48099999999999998},"max":{"1min":0.81499999999999995,"5min":0.97899999999999998,"15min":1.0569999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.64800000000000002,"5min":0.55700000000000005,"15min":0.48499999999999999},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":1.0289999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.95799999999999996,"15min":0.98699999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":0.91200000000000003,"15min":1.01},"last":0.65400000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.53300000000000003,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.95299999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.435},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":1.032},"last":0.746}]},{"osd":7,"last update":"Tue Oct 10 22:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.41799999999999998},"max":{"1min":0.89500000000000002,"5min":0.98999999999999999,"15min":1},"last":0.622},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46300000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.76600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129543243,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307836,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064004,"statfs":{"total":96636764160,"available":96321540096,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.96299999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82999999999999996,"5min":0.88,"15min":1.179},"last":0.69199999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.82099999999999995,"5min":0.878,"15min":1.0820000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.0489999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.82499999999999996,"15min":1.2150000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.622},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.123},"last":0.51700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81299999999999994,"15min":0.81399999999999995},"min":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.54700000000000004},"max":{"1min":1.0329999999999999,"5min":1.0489999999999999,"15min":1.29},"last":1.038},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":1.095,"15min":1.258},"last":0.86499999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1599999999999999,"15min":1.2609999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82299999999999995,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.61599999999999999,"15min":0.56999999999999995},"max":{"1min":1.026,"5min":1.1279999999999999,"15min":1.258},"last":0.95799999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.628,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":1.0940000000000001,"5min":1.1279999999999999,"15min":1.2869999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.877,"15min":0.871},"min":{"1min":0.70299999999999996,"5min":0.69199999999999995,"15min":0.628},"max":{"1min":1.069,"5min":1.175,"15min":1.3100000000000001},"last":0.99399999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.155,"15min":1.2450000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84899999999999998,"15min":0.84799999999999998},"min":{"1min":0.66900000000000004,"5min":0.621,"15min":0.53900000000000003},"max":{"1min":1.024,"5min":1.1120000000000001,"15min":1.226},"last":0.88600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543245,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308412,"kb_used_data":2932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063428,"statfs":{"total":96636764160,"available":96320950272,"internally_reserved":0,"allocated":3002368,"data_stored":1798594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.312},"max":{"1min":0.64200000000000002,"5min":0.73699999999999999,"15min":0.85299999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.81699999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.63600000000000001,"5min":0.73299999999999998,"15min":0.96599999999999997},"last":0.626},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81399999999999995,"5min":0.81599999999999995,"15min":1.0249999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.35899999999999999},"max":{"1min":0.64500000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.41199999999999998},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.89800000000000002},"last":0.72299999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53300000000000003},"max":{"1min":0.95899999999999996,"5min":1.0860000000000001,"15min":1.3340000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96799999999999997,"5min":1.0600000000000001,"15min":1.165},"last":1.056}]},{"osd":5,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80300000000000005,"15min":0.82399999999999995},"min":{"1min":0.59599999999999997,"5min":0.59399999999999997,"15min":0.53300000000000003},"max":{"1min":0.98699999999999999,"5min":1.079,"15min":1.214},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.629,"5min":0.627,"15min":0.56899999999999995},"max":{"1min":1.0069999999999999,"5min":1.0609999999999999,"15min":1.3089999999999999},"last":1.01}]},{"osd":6,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.874},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.54500000000000004},"max":{"1min":0.96699999999999997,"5min":1.0700000000000001,"15min":1.377},"last":1.165},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.875,"15min":0.88200000000000001},"min":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.55200000000000005},"max":{"1min":1.014,"5min":1.123,"15min":1.427},"last":1.0680000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85099999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.56699999999999995},"max":{"1min":0.92900000000000005,"5min":1.0780000000000001,"15min":1.2689999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.153,"15min":1.1899999999999999},"last":0.97799999999999998}]}]},{"osd":2,"up_from":14,"seq":60129543245,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.34599999999999997,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.65300000000000002,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.442,"5min":0.317,"15min":0.31},"max":{"1min":0.70899999999999996,"5min":0.73799999999999999,"15min":0.89500000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.41299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67800000000000005,"5min":0.79700000000000004,"15min":0.80700000000000005},"last":0.432},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.38700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.52400000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.745,"5min":0.80300000000000005,"15min":0.97599999999999998},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.98499999999999999,"5min":1.1679999999999999,"15min":1.288},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.58399999999999996,"5min":0.47399999999999998,"15min":0.41599999999999998},"max":{"1min":0.96799999999999997,"5min":1.149,"15min":1.325},"last":0.71699999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.57799999999999996,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51500000000000001},"max":{"1min":1.147,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84399999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.67500000000000004,"5min":0.58799999999999997,"15min":0.53700000000000003},"max":{"1min":1.147,"5min":1.147,"15min":1.2689999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.625,"5min":0.60399999999999998,"15min":0.54300000000000004},"max":{"1min":1.167,"5min":1.26,"15min":1.26},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.1279999999999999,"5min":1.218,"15min":1.3129999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.65800000000000003,"5min":0.59199999999999997,"15min":0.54500000000000004},"max":{"1min":1.0700000000000001,"5min":1.2270000000000001,"15min":1.2609999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":15,"seq":64424510540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311932,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059908,"statfs":{"total":96636764160,"available":96317345792,"internally_reserved":0,"allocated":2412544,"data_stored":1208260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76700000000000002,"15min":0.79800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.435}]},{"osd":1,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.39400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32900000000000001},"max":{"1min":0.79500000000000004,"5min":0.84699999999999998,"15min":0.86899999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.38100000000000001,"15min":0.33800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97999999999999998,"5min":0.99399999999999999,"15min":0.998},"last":0.67100000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.242,"15min":1.2769999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.501},"max":{"1min":1.089,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.65700000000000003,"5min":0.56799999999999995,"15min":0.52900000000000003},"max":{"1min":1.0680000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.79500000000000004},"min":{"1min":0.66700000000000004,"5min":0.54600000000000004,"15min":0.5},"max":{"1min":1.0089999999999999,"5min":1.1379999999999999,"15min":1.383},"last":0.83199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.53000000000000003},"max":{"1min":1.0189999999999999,"5min":1.222,"15min":1.222},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.66800000000000004,"5min":0.58999999999999997,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.212,"15min":1.212},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Oct 10 22:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.63200000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.194},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84299999999999997,"15min":0.84199999999999997},"min":{"1min":0.66800000000000004,"5min":0.629,"15min":0.56699999999999995},"max":{"1min":1.0920000000000001,"5min":1.226,"15min":1.2490000000000001},"last":0.65700000000000003}]}]},{"osd":6,"up_from":14,"seq":60129543243,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2412544,"data_stored":1208248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44400000000000001},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.56200000000000006,"5min":0.52800000000000002,"15min":0.46300000000000002},"max":{"1min":1.0049999999999999,"5min":1.04,"15min":1.0680000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.627,"5min":0.57999999999999996,"15min":0.47499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0920000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77400000000000002,"15min":0.78900000000000003},"min":{"1min":0.64700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.05,"5min":1.05,"15min":1.129},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.441},"max":{"1min":1.034,"5min":1.034,"15min":1.1200000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.48799999999999999},"max":{"1min":0.98599999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.502,"5min":0.502,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.51500000000000001},"max":{"1min":0.97399999999999998,"5min":1.0249999999999999,"15min":1.071},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":1,"15min":1},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":0.95899999999999996,"15min":0.98999999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.68000000000000005},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.996,"5min":1.006,"15min":1.046},"last":0.872},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95399999999999996,"5min":0.99199999999999999,"15min":1.1479999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.54000000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":1.008},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0880000000000001},"last":0.89900000000000002}]}]},{"osd":4,"up_from":14,"seq":60129543245,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316040,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055800,"statfs":{"total":96636764160,"available":96313139200,"internally_reserved":0,"allocated":2424832,"data_stored":1209832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":0.92400000000000004,"5min":1.0660000000000001,"15min":1.087},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.59699999999999998,"5min":0.47599999999999998,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0620000000000001},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.64700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.0609999999999999,"15min":1.1220000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46000000000000002},"max":{"1min":0.89000000000000001,"5min":1.018,"15min":1.0509999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.58699999999999997,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.996,"5min":1.04,"15min":1.073},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.62,"5min":0.505,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":1.0369999999999999,"15min":1.089},"last":0.53700000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.4079999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74299999999999999,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0229999999999999,"15min":1.282},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73499999999999999,"5min":0.94099999999999995,"15min":1.6539999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":0.84299999999999997,"5min":1.0900000000000001,"15min":1.5169999999999999},"last":0.75}]},{"osd":6,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.143},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.57899999999999996,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":1.0569999999999999,"15min":1.1990000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48599999999999999,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":1.21,"15min":1.21},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.48199999999999998,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":1.0980000000000001,"15min":1.361},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:34:48.975 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T22:34:48.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T22:34:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.197+0000 7f8a4ffff700 1 Processor -- start 2023-10-10T22:34:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.197+0000 7f8a4ffff700 1 -- start start 2023-10-10T22:34:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.198+0000 7f8a4ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a50153bc0 0x7f8a500c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.198+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a500c80d0 0x7f8a50160f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.198+0000 7f8a4ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a500c9e30 con 0x7f8a50069f80 2023-10-10T22:34:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.198+0000 7f8a4ffff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a50159be0 con 0x7f8a50153bc0 2023-10-10T22:34:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.198+0000 7f8a4ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5015aa00 con 0x7f8a500c80d0 2023-10-10T22:34:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.198+0000 7f8a4effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a50153bc0 0x7f8a500c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.198+0000 7f8a4effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a50153bc0 0x7f8a500c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60944/0 (socket says 172.21.15.154:60944) 2023-10-10T22:34:49.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.198+0000 7f8a4effd700 1 -- 172.21.15.154:0/283607298 learned_addr learned my addr 172.21.15.154:0/283607298 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:49.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.199+0000 7f8a4f7fe700 1 --2- 172.21.15.154:0/283607298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a500c80d0 0x7f8a50160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.199+0000 7f8a4effd700 1 -- 172.21.15.154:0/283607298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a500c80d0 msgr2=0x7f8a50160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:49.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.199+0000 7f8a4effd700 1 --2- 172.21.15.154:0/283607298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a500c80d0 0x7f8a50160f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.199+0000 7f8a4effd700 1 -- 172.21.15.154:0/283607298 >> v1:172.21.15.179:6789/0 conn(0x7f8a50069f80 legacy=0x7f8a500c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.199+0000 7f8a4effd700 1 -- 172.21.15.154:0/283607298 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5006f680 con 0x7f8a50153bc0 2023-10-10T22:34:49.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.199+0000 7f8a4effd700 1 --2- 172.21.15.154:0/283607298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a50153bc0 0x7f8a500c9080 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000bc50 tx=0x7f8a4000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c4a0ef7333dc65 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:49.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.199+0000 7f8a4dffb700 1 -- 172.21.15.154:0/283607298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000dbf0 con 0x7f8a50153bc0 2023-10-10T22:34:49.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.199+0000 7f8a4dffb700 1 -- 172.21.15.154:0/283607298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4000dd50 con 0x7f8a50153bc0 2023-10-10T22:34:49.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.199+0000 7f8a4dffb700 1 -- 172.21.15.154:0/283607298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400196b0 con 0x7f8a50153bc0 2023-10-10T22:34:49.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.200+0000 7f8a4ffff700 1 -- 172.21.15.154:0/283607298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a50153bc0 msgr2=0x7f8a500c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.200+0000 7f8a4ffff700 1 --2- 172.21.15.154:0/283607298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a50153bc0 0x7f8a500c9080 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000bc50 tx=0x7f8a4000b4f0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.200+0000 7f8a4ffff700 1 -- 172.21.15.154:0/283607298 shutdown_connections 2023-10-10T22:34:49.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.200+0000 7f8a4ffff700 1 --2- 172.21.15.154:0/283607298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a500c80d0 0x7f8a50160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.200+0000 7f8a4ffff700 1 --2- 172.21.15.154:0/283607298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a50153bc0 0x7f8a500c9080 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.200+0000 7f8a4ffff700 1 -- 172.21.15.154:0/283607298 >> 172.21.15.154:0/283607298 conn(0x7f8a50068e00 msgr2=0x7f8a50069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:49.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.200+0000 7f8a4ffff700 1 -- 172.21.15.154:0/283607298 shutdown_connections 2023-10-10T22:34:49.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.200+0000 7f8a4ffff700 1 -- 172.21.15.154:0/283607298 wait complete. 2023-10-10T22:34:49.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.201+0000 7f8a4ffff700 1 Processor -- start 2023-10-10T22:34:49.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.202+0000 7f8a4ffff700 1 -- start start 2023-10-10T22:34:49.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50069f80 0x7f8a5014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a500c80d0 0x7f8a500afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a50153bc0 0x7f8a500b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b0ed0 con 0x7f8a500c80d0 2023-10-10T22:34:49.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b10e0 con 0x7f8a50153bc0 2023-10-10T22:34:49.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b13c0 con 0x7f8a50069f80 2023-10-10T22:34:49.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a500c80d0 0x7f8a500afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a500c80d0 0x7f8a500afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60956/0 (socket says 172.21.15.154:60956) 2023-10-10T22:34:49.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4e7fc700 1 -- 172.21.15.154:0/581843859 learned_addr learned my addr 172.21.15.154:0/581843859 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:49.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4effd700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50069f80 0x7f8a5014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4f7fe700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a50153bc0 0x7f8a500b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4e7fc700 1 -- 172.21.15.154:0/581843859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50069f80 msgr2=0x7f8a5014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4e7fc700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50069f80 0x7f8a5014cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4e7fc700 1 -- 172.21.15.154:0/581843859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a50153bc0 msgr2=0x7f8a500b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4e7fc700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a50153bc0 0x7f8a500b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.203+0000 7f8a4e7fc700 1 -- 172.21.15.154:0/581843859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4000b790 con 0x7f8a500c80d0 2023-10-10T22:34:49.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.204+0000 7f8a4e7fc700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a500c80d0 0x7f8a500afb10 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400c590 tx=0x7f8a4400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:49.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.204+0000 7f8a36ffd700 1 -- 172.21.15.154:0/581843859 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44011590 con 0x7f8a500c80d0 2023-10-10T22:34:49.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.204+0000 7f8a36ffd700 1 -- 172.21.15.154:0/581843859 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a440116f0 con 0x7f8a500c80d0 2023-10-10T22:34:49.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.204+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a500b16a0 con 0x7f8a500c80d0 2023-10-10T22:34:49.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.204+0000 7f8a36ffd700 1 -- 172.21.15.154:0/581843859 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44011ab0 con 0x7f8a500c80d0 2023-10-10T22:34:49.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.204+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a500c4070 con 0x7f8a500c80d0 2023-10-10T22:34:49.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.205+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5004c3c0 con 0x7f8a500c80d0 2023-10-10T22:34:49.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.206+0000 7f8a36ffd700 1 -- 172.21.15.154:0/581843859 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a4401b3b0 con 0x7f8a500c80d0 2023-10-10T22:34:49.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.207+0000 7f8a36ffd700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a3c066f30 0x7f8a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.207+0000 7f8a36ffd700 1 -- 172.21.15.154:0/581843859 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f8a44083d20 con 0x7f8a500c80d0 2023-10-10T22:34:49.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.207+0000 7f8a4effd700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a3c066f30 0x7f8a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.208+0000 7f8a4effd700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a3c066f30 0x7f8a3c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000bc50 tx=0x7f8a4001b000 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:49.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.211+0000 7f8a36ffd700 1 -- 172.21.15.154:0/581843859 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a44050d00 con 0x7f8a500c80d0 2023-10-10T22:34:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.480+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8a500c7eb0 con 0x7f8a500c80d0 2023-10-10T22:34:49.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.484+0000 7f8a36ffd700 1 -- 172.21.15.154:0/581843859 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v51) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8a44017020 con 0x7f8a500c80d0 2023-10-10T22:34:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.486+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a3c066f30 msgr2=0x7f8a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.486+0000 7f8a4ffff700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a3c066f30 0x7f8a3c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000bc50 tx=0x7f8a4001b000 comp rx=0 tx=0).stop 2023-10-10T22:34:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.486+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a500c80d0 msgr2=0x7f8a500afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.486+0000 7f8a4ffff700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a500c80d0 0x7f8a500afb10 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400c590 tx=0x7f8a4400c950 comp rx=0 tx=0).stop 2023-10-10T22:34:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.487+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 shutdown_connections 2023-10-10T22:34:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.487+0000 7f8a4ffff700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8a3c066f30 0x7f8a3c0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.487+0000 7f8a4ffff700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a50153bc0 0x7f8a500b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.487+0000 7f8a4ffff700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50069f80 0x7f8a5014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.487+0000 7f8a4ffff700 1 --2- 172.21.15.154:0/581843859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a500c80d0 0x7f8a500afb10 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.487+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 >> 172.21.15.154:0/581843859 conn(0x7f8a50068e00 msgr2=0x7f8a500c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:49.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.487+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 shutdown_connections 2023-10-10T22:34:49.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.487+0000 7f8a4ffff700 1 -- 172.21.15.154:0/581843859 wait complete. 2023-10-10T22:34:49.491 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T22:34:49.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:34:49.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.687+0000 7fb04ad9d700 1 Processor -- start 2023-10-10T22:34:49.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.687+0000 7fb04ad9d700 1 -- start start 2023-10-10T22:34:49.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.688+0000 7fb04ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0441597f0 0x7fb0440b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.688+0000 7fb04ad9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0440b11d0 con 0x7fb044159420 2023-10-10T22:34:49.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.688+0000 7fb04ad9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0440b14b0 con 0x7fb04415d230 2023-10-10T22:34:49.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.688+0000 7fb04ad9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0440b1790 con 0x7fb0441597f0 2023-10-10T22:34:49.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.688+0000 7fb04959a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0441597f0 0x7fb0440b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.688+0000 7fb049d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb044159420 0x7fb0440b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44798/0 (socket says 172.21.15.154:44798) 2023-10-10T22:34:49.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.688+0000 7fb049d9b700 1 -- 172.21.15.154:0/3038650768 learned_addr learned my addr 172.21.15.154:0/3038650768 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:49.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.689+0000 7fb04959a700 1 -- 172.21.15.154:0/3038650768 >> v1:172.21.15.179:6789/0 conn(0x7fb04415d230 legacy=0x7fb04415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:49.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.689+0000 7fb04959a700 1 -- 172.21.15.154:0/3038650768 >> v1:172.21.15.154:6789/0 conn(0x7fb044159420 legacy=0x7fb0440b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.689+0000 7fb04959a700 1 -- 172.21.15.154:0/3038650768 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440b1a70 con 0x7fb0441597f0 2023-10-10T22:34:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.689+0000 7fb048d99700 1 -- 172.21.15.154:0/3038650768 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898221074 0 0) 0x7fb0440b11d0 con 0x7fb044159420 2023-10-10T22:34:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.689+0000 7fb04959a700 1 --2- 172.21.15.154:0/3038650768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 0x7fb0440b2270 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb0340098e0 tx=0x7fb0340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e7bd2cd6cd1944 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.689+0000 7fb048d99700 1 -- 172.21.15.154:0/3038650768 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034009e80 con 0x7fb0441597f0 2023-10-10T22:34:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.689+0000 7fb048d99700 1 -- 172.21.15.154:0/3038650768 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03400b820 con 0x7fb0441597f0 2023-10-10T22:34:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.690+0000 7fb048d99700 1 -- 172.21.15.154:0/3038650768 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03400bba0 con 0x7fb0441597f0 2023-10-10T22:34:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.690+0000 7fb04ad9d700 1 -- 172.21.15.154:0/3038650768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 msgr2=0x7fb0440b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.690+0000 7fb04ad9d700 1 --2- 172.21.15.154:0/3038650768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 0x7fb0440b2270 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb0340098e0 tx=0x7fb0340091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.690+0000 7fb04ad9d700 1 -- 172.21.15.154:0/3038650768 shutdown_connections 2023-10-10T22:34:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.690+0000 7fb04ad9d700 1 --2- 172.21.15.154:0/3038650768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 0x7fb0440b2270 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.690+0000 7fb04ad9d700 1 -- 172.21.15.154:0/3038650768 >> 172.21.15.154:0/3038650768 conn(0x7fb0440d0660 msgr2=0x7fb0440d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.690+0000 7fb04ad9d700 1 -- 172.21.15.154:0/3038650768 shutdown_connections 2023-10-10T22:34:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.690+0000 7fb04ad9d700 1 -- 172.21.15.154:0/3038650768 wait complete. 2023-10-10T22:34:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.692+0000 7fb04ad9d700 1 Processor -- start 2023-10-10T22:34:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.692+0000 7fb04ad9d700 1 -- start start 2023-10-10T22:34:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04ad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb044159420 0x7fb0441541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 0x7fb0440c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04ad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04415d230 0x7fb04415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04ad9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440c93f0 con 0x7fb0441597f0 2023-10-10T22:34:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04ad9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440c74a0 con 0x7fb04415d230 2023-10-10T22:34:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04ad9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04415bcd0 con 0x7fb044159420 2023-10-10T22:34:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04959a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 0x7fb0440c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04959a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 0x7fb0440c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60984/0 (socket says 172.21.15.154:60984) 2023-10-10T22:34:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04959a700 1 -- 172.21.15.154:0/2226450792 learned_addr learned my addr 172.21.15.154:0/2226450792 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb049d9b700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb044159420 0x7fb0441541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04a59c700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04415d230 0x7fb04415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04959a700 1 -- 172.21.15.154:0/2226450792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb044159420 msgr2=0x7fb0441541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04959a700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb044159420 0x7fb0441541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04959a700 1 -- 172.21.15.154:0/2226450792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04415d230 msgr2=0x7fb04415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04959a700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04415d230 0x7fb04415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04959a700 1 -- 172.21.15.154:0/2226450792 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034009420 con 0x7fb0441597f0 2023-10-10T22:34:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.693+0000 7fb04a59c700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04415d230 0x7fb04415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:49.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.694+0000 7fb04959a700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 0x7fb0440c98e0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fb0340030c0 tx=0x7fb034016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:49.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.694+0000 7fb039ffb700 1 -- 172.21.15.154:0/2226450792 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03400ba10 con 0x7fb0441597f0 2023-10-10T22:34:49.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.694+0000 7fb039ffb700 1 -- 172.21.15.154:0/2226450792 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb034020070 con 0x7fb0441597f0 2023-10-10T22:34:49.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.694+0000 7fb039ffb700 1 -- 172.21.15.154:0/2226450792 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03401b6a0 con 0x7fb0441597f0 2023-10-10T22:34:49.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.694+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04415b710 con 0x7fb0441597f0 2023-10-10T22:34:49.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.694+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0440c7130 con 0x7fb0441597f0 2023-10-10T22:34:49.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.695+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0440c7630 con 0x7fb0441597f0 2023-10-10T22:34:49.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.696+0000 7fb039ffb700 1 -- 172.21.15.154:0/2226450792 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb034022030 con 0x7fb0441597f0 2023-10-10T22:34:49.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.697+0000 7fb039ffb700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb028066f30 0x7fb0280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:49.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.697+0000 7fb039ffb700 1 -- 172.21.15.154:0/2226450792 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fb034086880 con 0x7fb0441597f0 2023-10-10T22:34:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.697+0000 7fb049d9b700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb028066f30 0x7fb0280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.698+0000 7fb049d9b700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb028066f30 0x7fb0280693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0400011e0 tx=0x7fb040009040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.701+0000 7fb039ffb700 1 -- 172.21.15.154:0/2226450792 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb034053860 con 0x7fb0441597f0 2023-10-10T22:34:49.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.933+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0440c75e0 con 0x7fb0441597f0 2023-10-10T22:34:49.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.933+0000 7fb039ffb700 1 -- 172.21.15.154:0/2226450792 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fb034056e80 con 0x7fb0441597f0 2023-10-10T22:34:49.935 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:34:49.936 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/331320161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":331320161},{"type":"v1","addr":"172.21.15.154:6833","nonce":331320161}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/595493420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":595493420},{"type":"v1","addr":"172.21.15.179:6835","nonce":595493420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1656759292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1656759292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1656759292}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:34:38.799966+0000","modified":"2023-10-10T22:34:42.366478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/3472664042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3472664042},{"type":"v1","addr":"172.21.15.179:6834","nonce":3472664042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-10T22:34:49.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb028066f30 msgr2=0x7fb0280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb028066f30 0x7fb0280693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0400011e0 tx=0x7fb040009040 comp rx=0 tx=0).stop 2023-10-10T22:34:49.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 msgr2=0x7fb0440c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:49.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 0x7fb0440c98e0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fb0340030c0 tx=0x7fb034016000 comp rx=0 tx=0).stop 2023-10-10T22:34:49.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 shutdown_connections 2023-10-10T22:34:49.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb028066f30 0x7fb0280693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04415d230 0x7fb04415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb044159420 0x7fb0441541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 --2- 172.21.15.154:0/2226450792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0441597f0 0x7fb0440c98e0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:49.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 >> 172.21.15.154:0/2226450792 conn(0x7fb0440d0660 msgr2=0x7fb044158220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:49.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 shutdown_connections 2023-10-10T22:34:49.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:49.936+0000 7fb04ad9d700 1 -- 172.21.15.154:0/2226450792 wait complete. 2023-10-10T22:34:49.940 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 86 2023-10-10T22:34:50.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T22:34:38.799966+0000', 'modified': '2023-10-10T22:34:42.366478+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9711}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9711': {'gid': 9711, 'name': 'b', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6834/3472664042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 3472664042}, {'type': 'v1', 'addr': '172.21.15.179:6834', 'nonce': 3472664042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T22:34:50.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T22:34:50.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-10T22:34:50.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.544+0000 7fe4ff5ff700 1 Processor -- start 2023-10-10T22:34:50.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.545+0000 7fe4ff5ff700 1 -- start start 2023-10-10T22:34:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4ff5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe4f81578b0 0x7fe4f8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4ff5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe4f80af2f0 0x7fe4f80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4ff5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f80ad930 con 0x7fe4f8155c10 2023-10-10T22:34:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4ff5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f80b0c80 con 0x7fe4f80af2f0 2023-10-10T22:34:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4ff5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f80acd20 con 0x7fe4f81578b0 2023-10-10T22:34:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4fd39b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe4f8155c10 0x7fe4f80ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44806/0 (socket says 172.21.15.154:44806) 2023-10-10T22:34:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4fd39b700 1 -- 172.21.15.154:0/2013953028 learned_addr learned my addr 172.21.15.154:0/2013953028 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/2013953028 >> v2:172.21.15.154:3300/0 conn(0x7fe4f80af2f0 0x7fe4f80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/2013953028 >> v2:172.21.15.179:3300/0 conn(0x7fe4f81578b0 0x7fe4f8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.546+0000 7fe4effff700 1 -- 172.21.15.154:0/2013953028 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855607965 0 0) 0x7fe4f80ad930 con 0x7fe4f8155c10 2023-10-10T22:34:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4effff700 1 -- 172.21.15.154:0/2013953028 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e4003490 con 0x7fe4f8155c10 2023-10-10T22:34:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/2013953028 >> v2:172.21.15.179:3300/0 conn(0x7fe4f81578b0 msgr2=0x7fe4f8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/2013953028 >> v2:172.21.15.179:3300/0 conn(0x7fe4f81578b0 0x7fe4f8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/2013953028 >> v1:172.21.15.154:6789/0 conn(0x7fe4f8155c10 legacy=0x7fe4f80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4effff700 1 -- 172.21.15.154:0/2013953028 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 753426934 0 0) 0x7fe4e4003490 con 0x7fe4f8155c10 2023-10-10T22:34:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/2013953028 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80ad000 con 0x7fe4f80af2f0 2023-10-10T22:34:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/2013953028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f80af2f0 0x7fe4f80af730 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80c8c60 tx=0x7fe4f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d5b22dd3f51f80 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4effff700 1 -- 172.21.15.154:0/2013953028 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000e070 con 0x7fe4f80af2f0 2023-10-10T22:34:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4effff700 1 -- 172.21.15.154:0/2013953028 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f000b7a0 con 0x7fe4f80af2f0 2023-10-10T22:34:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.547+0000 7fe4effff700 1 -- 172.21.15.154:0/2013953028 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4001470 con 0x7fe4f80af2f0 2023-10-10T22:34:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.548+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2013953028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f80af2f0 msgr2=0x7fe4f80af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.548+0000 7fe4ff5ff700 1 --2- 172.21.15.154:0/2013953028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f80af2f0 0x7fe4f80af730 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80c8c60 tx=0x7fe4f0009780 comp rx=0 tx=0).stop 2023-10-10T22:34:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.548+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2013953028 shutdown_connections 2023-10-10T22:34:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.548+0000 7fe4ff5ff700 1 --2- 172.21.15.154:0/2013953028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f80af2f0 0x7fe4f80af730 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.548+0000 7fe4ff5ff700 1 --2- 172.21.15.154:0/2013953028 >> v2:172.21.15.179:3300/0 conn(0x7fe4f81578b0 0x7fe4f8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.548+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2013953028 >> 172.21.15.154:0/2013953028 conn(0x7fe4f806a320 msgr2=0x7fe4f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.548+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2013953028 shutdown_connections 2023-10-10T22:34:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.548+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2013953028 wait complete. 2023-10-10T22:34:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.549+0000 7fe4ff5ff700 1 Processor -- start 2023-10-10T22:34:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.550+0000 7fe4ff5ff700 1 -- start start 2023-10-10T22:34:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.550+0000 7fe4ff5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4f80af2f0 0x7fe4f8151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.550+0000 7fe4ff5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4f8155c10 0x7fe4f80c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.550+0000 7fe4ff5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f81578b0 0x7fe4f816af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.550+0000 7fe4ff5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80a9c20 con 0x7fe4f81578b0 2023-10-10T22:34:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.550+0000 7fe4ff5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f8151ad0 con 0x7fe4f80af2f0 2023-10-10T22:34:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4ff5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80a98d0 con 0x7fe4f8155c10 2023-10-10T22:34:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fdb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f81578b0 0x7fe4f816af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fdb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f81578b0 0x7fe4f816af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60994/0 (socket says 172.21.15.154:60994) 2023-10-10T22:34:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/2210036128 learned_addr learned my addr 172.21.15.154:0/2210036128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4f80af2f0 0x7fe4f8151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4f8155c10 0x7fe4f80c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/2210036128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4f8155c10 msgr2=0x7fe4f80c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4f8155c10 0x7fe4f80c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/2210036128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4f80af2f0 msgr2=0x7fe4f8151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4f80af2f0 0x7fe4f8151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/2210036128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f0009a20 con 0x7fe4f81578b0 2023-10-10T22:34:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.551+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f81578b0 0x7fe4f816af30 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000b610 tx=0x7fe4f0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.552+0000 7fe4ed7fa700 1 -- 172.21.15.154:0/2210036128 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0012bb0 con 0x7fe4f81578b0 2023-10-10T22:34:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.552+0000 7fe4ed7fa700 1 -- 172.21.15.154:0/2210036128 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f0012d30 con 0x7fe4f81578b0 2023-10-10T22:34:50.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.552+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2210036128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f80ca2b0 con 0x7fe4f81578b0 2023-10-10T22:34:50.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.552+0000 7fe4ed7fa700 1 -- 172.21.15.154:0/2210036128 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0012ea0 con 0x7fe4f81578b0 2023-10-10T22:34:50.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.552+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2210036128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f80ca870 con 0x7fe4f81578b0 2023-10-10T22:34:50.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.554+0000 7fe4ed7fa700 1 -- 172.21.15.154:0/2210036128 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4f0024070 con 0x7fe4f81578b0 2023-10-10T22:34:50.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.555+0000 7fe4ed7fa700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe4dc066f30 0x7fe4dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.555+0000 7fe4ed7fa700 1 -- 172.21.15.154:0/2210036128 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fe4f0086e10 con 0x7fe4f81578b0 2023-10-10T22:34:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.555+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe4dc066f30 0x7fe4dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.556+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe4dc066f30 0x7fe4dc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40011e0 tx=0x7fe4f4001aa0 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.557+0000 7fe50dce7b80 1 Processor -- start 2023-10-10T22:34:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.557+0000 7fe50dce7b80 1 -- start start 2023-10-10T22:34:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c32dee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c3307a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 0x55f2c32dacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c3235a70 con 0x55f2c3328d00 2023-10-10T22:34:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c3233270 con 0x55f2c32dea50 2023-10-10T22:34:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2c322f060 con 0x55f2c3307f60 2023-10-10T22:34:50.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fcb9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c3307a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fcb9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c3307a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32776/0 (socket says 172.21.15.154:32776) 2023-10-10T22:34:50.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fcb9a700 1 -- 172.21.15.154:0/1503907602 learned_addr learned my addr 172.21.15.154:0/1503907602 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:50.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c32dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 0x55f2c32dacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fcb9a700 1 -- 172.21.15.154:0/1503907602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 msgr2=0x55f2c32dacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 0x55f2c32dacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fcb9a700 1 -- 172.21.15.154:0/1503907602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 msgr2=0x55f2c32dee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c32dee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fcb9a700 1 -- 172.21.15.154:0/1503907602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2c30c9270 con 0x55f2c3328d00 2023-10-10T22:34:50.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.558+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c32dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:50.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c3307a20 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009ba0 tx=0x7fe4e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf3f7e2165fa2dc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe4e27fc700 1 -- 172.21.15.154:0/1503907602 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80118d0 con 0x55f2c3328d00 2023-10-10T22:34:50.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe4e27fc700 1 -- 172.21.15.154:0/1503907602 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e8011a30 con 0x55f2c3328d00 2023-10-10T22:34:50.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe4e27fc700 1 -- 172.21.15.154:0/1503907602 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8011db0 con 0x55f2c3328d00 2023-10-10T22:34:50.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1503907602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 msgr2=0x55f2c3307a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c3307a20 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009ba0 tx=0x7fe4e8008040 comp rx=0 tx=0).stop 2023-10-10T22:34:50.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1503907602 shutdown_connections 2023-10-10T22:34:50.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 0x55f2c32dacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c32dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1503907602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c3307a20 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.559+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1503907602 >> 172.21.15.154:0/1503907602 conn(0x55f2c32e0370 msgr2=0x55f2c32e0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:50.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.560+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1503907602 shutdown_connections 2023-10-10T22:34:50.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.560+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1503907602 wait complete. 2023-10-10T22:34:50.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.560+0000 7fe50dce7b80 1 -- start start 2023-10-10T22:34:50.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.560+0000 7fe50dce7b80 1 Processor -- start 2023-10-10T22:34:50.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.561+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3334e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.561+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 0x55f2c331ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.561+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c331f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.561+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c31da890 con 0x55f2c3328d00 2023-10-10T22:34:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.561+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c31f5ea0 con 0x55f2c32dea50 2023-10-10T22:34:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.561+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2c30b1e30 con 0x55f2c3307f60 2023-10-10T22:34:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.561+0000 7fe50dce7b80 10 client.0 _ll_register_callbacks cb 0x55f2c32a2110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T22:34:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fdb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c331f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fdb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c331f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32784/0 (socket says 172.21.15.154:32784) 2023-10-10T22:34:50.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/1298618958 learned_addr learned my addr 172.21.15.154:0/1298618958 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:50.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 0x55f2c331ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3334e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 msgr2=0x55f2c331ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 0x55f2c331ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 msgr2=0x55f2c3334e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3334e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/1298618958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e80097f0 con 0x55f2c3328d00 2023-10-10T22:34:50.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 0x55f2c331ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:50.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3334e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:50.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c331f3b0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000b020 tx=0x7fe4f0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbf610433f81963 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T22:34:50.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4d77fe700 1 -- 172.21.15.154:0/1298618958 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000e050 con 0x55f2c3328d00 2023-10-10T22:34:50.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe4d77fe700 1 -- 172.21.15.154:0/1298618958 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fe4f0057d10 con 0x55f2c3328d00 2023-10-10T22:34:50.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.562+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1298618958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2c32d3b70 con 0x55f2c3328d00 2023-10-10T22:34:50.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe4d77fe700 1 -- 172.21.15.154:0/1298618958 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4f0056fa0 con 0x55f2c3328d00 2023-10-10T22:34:50.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe50dce7b80 10 client.9870 fetch_fsmap learned FSMap version 86 2023-10-10T22:34:50.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1298618958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55f2c306bfe0 con 0x55f2c3328d00 2023-10-10T22:34:50.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe4d77fe700 1 -- 172.21.15.154:0/1298618958 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2c32d3b70 con 0x55f2c3328d00 2023-10-10T22:34:50.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe4d77fe700 1 -- 172.21.15.154:0/1298618958 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe4f005e5c0 con 0x55f2c3328d00 2023-10-10T22:34:50.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe50dce7b80 10 client.9870 fetch_fsmap finished waiting for FSMap version 86 2023-10-10T22:34:50.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe50dce7b80 10 client.9870 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-10T22:34:50.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe50dce7b80 20 client.9870 populate_metadata read hostname 'smithi154' 2023-10-10T22:34:50.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] conn(0x55f2c3328080 0x55f2c3328450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe50dce7b80 4 client.9870 mds_command: new command op to 9711 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T22:34:50.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1298618958 --> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2c32b0aa0 con 0x55f2c3328080 2023-10-10T22:34:50.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.563+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] conn(0x55f2c3328080 0x55f2c3328450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.564+0000 7fe4d77fe700 10 client.9870 ms_handle_connect on v2:172.21.15.179:6832/3472664042 2023-10-10T22:34:50.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.564+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] conn(0x55f2c3328080 0x55f2c3328450 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89ccfe8abb84cc6d server_cookie=d901cedc27641053 in_seq=0 out_seq=0 2023-10-10T22:34:50.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe4d77fe700 1 -- 172.21.15.154:0/1298618958 <== mds.0 v2:172.21.15.179:6832/3472664042 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f2c32b0aa0 con 0x55f2c3328080 2023-10-10T22:34:50.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe4d77fe700 10 client.9870 handle_command_reply: tid=0 2023-10-10T22:34:50.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 client.9870 shutdown 2023-10-10T22:34:50.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1298618958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 msgr2=0x55f2c331f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c331f3b0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000b020 tx=0x7fe4f0020040 comp rx=0 tx=0).stop 2023-10-10T22:34:50.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1298618958 shutdown_connections 2023-10-10T22:34:50.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c331f3b0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3334e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] conn(0x55f2c3328080 0x55f2c3328450 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1298618958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3307f60 0x55f2c331ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe4d77fe700 0 client.9870 ms_handle_reset on v2:172.21.15.179:6832/3472664042 2023-10-10T22:34:50.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1298618958 >> 172.21.15.154:0/1298618958 conn(0x55f2c32e0370 msgr2=0x55f2c32db980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:50.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1298618958 shutdown_connections 2023-10-10T22:34:50.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1298618958 wait complete. 2023-10-10T22:34:50.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.565+0000 7fe50dce7b80 20 client.9870 trim_cache size 0 max 16384 2023-10-10T22:34:50.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.583+0000 7fe50dce7b80 1 Processor -- start 2023-10-10T22:34:50.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.583+0000 7fe50dce7b80 1 -- start start 2023-10-10T22:34:50.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c32dea50 0x55f2c330e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c33249a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c32df680 con 0x55f2c3328d00 2023-10-10T22:34:50.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c32e19c0 con 0x55f2c3307f60 2023-10-10T22:34:50.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2c32e11a0 con 0x55f2c32dea50 2023-10-10T22:34:50.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fdb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c33249a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fdb9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c33249a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32798/0 (socket says 172.21.15.154:32798) 2023-10-10T22:34:50.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/1410805884 learned_addr learned my addr 172.21.15.154:0/1410805884 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:50.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/1410805884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c32dea50 0x55f2c330e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/1410805884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/1410805884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c32dea50 msgr2=0x55f2c330e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/1410805884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c32dea50 0x55f2c330e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/1410805884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c3307f60 msgr2=0x55f2c3324460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/1410805884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.584+0000 7fe4fdb9c700 1 -- 172.21.15.154:0/1410805884 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2c31fd780 con 0x55f2c3328d00 2023-10-10T22:34:50.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/1410805884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c33249a0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00094d0 tx=0x7fe4f006f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53588b9a6709c640 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe4e2ffd700 1 -- 172.21.15.154:0/1410805884 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000e040 con 0x55f2c3328d00 2023-10-10T22:34:50.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe4e2ffd700 1 -- 172.21.15.154:0/1410805884 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f0057880 con 0x55f2c3328d00 2023-10-10T22:34:50.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe4e2ffd700 1 -- 172.21.15.154:0/1410805884 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0057d10 con 0x55f2c3328d00 2023-10-10T22:34:50.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1410805884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 msgr2=0x55f2c33249a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1410805884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c33249a0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00094d0 tx=0x7fe4f006f000 comp rx=0 tx=0).stop 2023-10-10T22:34:50.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1410805884 shutdown_connections 2023-10-10T22:34:50.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1410805884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3328d00 0x55f2c33249a0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1410805884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c32dea50 0x55f2c330e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/1410805884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1410805884 >> 172.21.15.154:0/1410805884 conn(0x55f2c32e0370 msgr2=0x55f2c32e0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:50.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1410805884 shutdown_connections 2023-10-10T22:34:50.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.585+0000 7fe50dce7b80 1 -- 172.21.15.154:0/1410805884 wait complete. 2023-10-10T22:34:50.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.586+0000 7fe50dce7b80 1 -- start start 2023-10-10T22:34:50.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.586+0000 7fe50dce7b80 1 Processor -- start 2023-10-10T22:34:50.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3384a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe50dce7b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3328d00 0x55f2c33249a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c32da470 con 0x55f2c3307f60 2023-10-10T22:34:50.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c32d79e0 con 0x55f2c32dea50 2023-10-10T22:34:50.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe50dce7b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2c338ade0 con 0x55f2c3328d00 2023-10-10T22:34:50.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe50dce7b80 10 client.0 _ll_register_callbacks cb 0x55f2c32a2110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T22:34:50.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe4fcb9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe4fcb9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32806/0 (socket says 172.21.15.154:32806) 2023-10-10T22:34:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.587+0000 7fe4fcb9a700 1 -- 172.21.15.154:0/2052981835 learned_addr learned my addr 172.21.15.154:0/2052981835 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3384a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3328d00 0x55f2c33249a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fcb9a700 1 -- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3328d00 msgr2=0x55f2c33249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3328d00 0x55f2c33249a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fcb9a700 1 -- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 msgr2=0x55f2c3384a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3384a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fcb9a700 1 -- 172.21.15.154:0/2052981835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2c306bfe0 con 0x55f2c3307f60 2023-10-10T22:34:50.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3384a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:50.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fdb9c700 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3328d00 0x55f2c33249a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:34:50.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4fcb9a700 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80115f0 tx=0x7fe4e801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e8b359950e70c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T22:34:50.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4d77fe700 1 -- 172.21.15.154:0/2052981835 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8025070 con 0x55f2c3307f60 2023-10-10T22:34:50.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe50dce7b80 1 -- 172.21.15.154:0/2052981835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe4f80a9d60 con 0x55f2c3307f60 2023-10-10T22:34:50.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4d77fe700 1 -- 172.21.15.154:0/2052981835 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fe4e8005a00 con 0x55f2c3307f60 2023-10-10T22:34:50.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe4d77fe700 1 -- 172.21.15.154:0/2052981835 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4e8005dd0 con 0x55f2c3307f60 2023-10-10T22:34:50.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe50dce7b80 10 client.9876 fetch_fsmap learned FSMap version 86 2023-10-10T22:34:50.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.588+0000 7fe50dce7b80 1 -- 172.21.15.154:0/2052981835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55f2c31e4470 con 0x55f2c3307f60 2023-10-10T22:34:50.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.589+0000 7fe4d77fe700 1 -- 172.21.15.154:0/2052981835 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f80a9d60 con 0x55f2c3307f60 2023-10-10T22:34:50.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.589+0000 7fe4d77fe700 1 -- 172.21.15.154:0/2052981835 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe4e8015880 con 0x55f2c3307f60 2023-10-10T22:34:50.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.589+0000 7fe50dce7b80 10 client.9876 fetch_fsmap finished waiting for FSMap version 86 2023-10-10T22:34:50.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.589+0000 7fe50dce7b80 10 client.9876 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-10T22:34:50.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.589+0000 7fe50dce7b80 20 client.9876 populate_metadata read hostname 'smithi154' 2023-10-10T22:34:50.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.589+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] conn(0x55f2c331b9b0 0x55f2c331bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.589+0000 7fe50dce7b80 4 client.9876 mds_command: new command op to 9711 tid=0[{"prefix": "status"}] 2023-10-10T22:34:50.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.589+0000 7fe50dce7b80 1 -- 172.21.15.154:0/2052981835 --> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fe4e8011a30 con 0x55f2c331b9b0 2023-10-10T22:34:50.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.589+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] conn(0x55f2c331b9b0 0x55f2c331bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe4d77fe700 10 client.9876 ms_handle_connect on v2:172.21.15.179:6832/3472664042 2023-10-10T22:34:50.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe4fd39b700 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] conn(0x55f2c331b9b0 0x55f2c331bd80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e96caa6b14a1c580 server_cookie=40b31feddd1f0c1d in_seq=0 out_seq=0 2023-10-10T22:34:50.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe4d77fe700 1 -- 172.21.15.154:0/2052981835 <== mds.0 v2:172.21.15.179:6832/3472664042 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x7fe4e8011a30 con 0x55f2c331b9b0 2023-10-10T22:34:50.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe4d77fe700 10 client.9876 handle_command_reply: tid=0 2023-10-10T22:34:50.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 client.9876 shutdown 2023-10-10T22:34:50.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 -- 172.21.15.154:0/2052981835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3307f60 msgr2=0x55f2c3324460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80115f0 tx=0x7fe4e801c000 comp rx=0 tx=0).stop 2023-10-10T22:34:50.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 -- 172.21.15.154:0/2052981835 shutdown_connections 2023-10-10T22:34:50.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:6832/3472664042,v1:172.21.15.179:6834/3472664042] conn(0x55f2c331b9b0 0x55f2c331bd80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f2c3328d00 0x55f2c33249a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f2c32dea50 0x55f2c3384a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 --2- 172.21.15.154:0/2052981835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f2c3307f60 0x55f2c3324460 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe4d77fe700 0 client.9876 ms_handle_reset on v2:172.21.15.179:6832/3472664042 2023-10-10T22:34:50.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 -- 172.21.15.154:0/2052981835 >> 172.21.15.154:0/2052981835 conn(0x55f2c32e0370 msgr2=0x55f2c32e0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:50.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 -- 172.21.15.154:0/2052981835 shutdown_connections 2023-10-10T22:34:50.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 1 -- 172.21.15.154:0/2052981835 wait complete. 2023-10-10T22:34:50.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.590+0000 7fe50dce7b80 20 client.9876 trim_cache size 0 max 16384 2023-10-10T22:34:50.609 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:34:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T22:34:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T22:34:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 9711, 2023-10-10T22:34:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T22:34:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T22:34:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T22:34:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.241830295, 2023-10-10T22:34:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 86, 2023-10-10T22:34:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 193, 2023-10-10T22:34:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 193, 2023-10-10T22:34:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.03572153 2023-10-10T22:34:50.612 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe4dc066f30 msgr2=0x7fe4dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe4dc066f30 0x7fe4dc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40011e0 tx=0x7fe4f4001aa0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f81578b0 msgr2=0x7fe4f816af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f81578b0 0x7fe4f816af30 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000b610 tx=0x7fe4f0018000 comp rx=0 tx=0).stop 2023-10-10T22:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2210036128 shutdown_connections 2023-10-10T22:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe4dc066f30 0x7fe4dc0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f81578b0 0x7fe4f816af30 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4f80af2f0 0x7fe4f8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 --2- 172.21.15.154:0/2210036128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4f8155c10 0x7fe4f80c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2210036128 >> 172.21.15.154:0/2210036128 conn(0x7fe4f806a320 msgr2=0x7fe4f8153340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2210036128 shutdown_connections 2023-10-10T22:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.591+0000 7fe4ff5ff700 1 -- 172.21.15.154:0/2210036128 wait complete. 2023-10-10T22:34:50.616 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T22:34:50.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.798+0000 7fb92d3ff700 1 Processor -- start 2023-10-10T22:34:50.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.798+0000 7fb92d3ff700 1 -- start start 2023-10-10T22:34:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.799+0000 7fb92d3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb9280cbf30 0x7fb9280ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb92d3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9280b1420 0x7fb9280c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb92d3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9280cc300 con 0x7fb9280ccf90 2023-10-10T22:34:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb92d3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb928156bf0 con 0x7fb9280b1420 2023-10-10T22:34:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb92d3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9280ae950 con 0x7fb9280cbf30 2023-10-10T22:34:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb9277fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9280b1420 0x7fb9280c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb9277fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9280b1420 0x7fb9280c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32814/0 (socket says 172.21.15.154:32814) 2023-10-10T22:34:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb9277fe700 1 -- 172.21.15.154:0/3437455487 learned_addr learned my addr 172.21.15.154:0/3437455487 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb926ffd700 1 --2- 172.21.15.154:0/3437455487 >> v2:172.21.15.179:3300/0 conn(0x7fb9280cbf30 0x7fb9280ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb9277fe700 1 -- 172.21.15.154:0/3437455487 >> v2:172.21.15.179:3300/0 conn(0x7fb9280cbf30 msgr2=0x7fb9280ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb9277fe700 1 --2- 172.21.15.154:0/3437455487 >> v2:172.21.15.179:3300/0 conn(0x7fb9280cbf30 0x7fb9280ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb9277fe700 1 -- 172.21.15.154:0/3437455487 >> v1:172.21.15.179:6789/0 conn(0x7fb9280ccf90 legacy=0x7fb9280b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb9277fe700 1 -- 172.21.15.154:0/3437455487 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280ad370 con 0x7fb9280b1420 2023-10-10T22:34:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.800+0000 7fb926ffd700 1 --2- 172.21.15.154:0/3437455487 >> v2:172.21.15.179:3300/0 conn(0x7fb9280cbf30 0x7fb9280ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:34:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb9277fe700 1 --2- 172.21.15.154:0/3437455487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 0x7fb9280c9740 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fb928063d40 tx=0x7fb920009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1993cc7406afc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb9267fc700 1 -- 172.21.15.154:0/3437455487 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000e070 con 0x7fb9280b1420 2023-10-10T22:34:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb9267fc700 1 -- 172.21.15.154:0/3437455487 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92000ba00 con 0x7fb9280b1420 2023-10-10T22:34:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb9267fc700 1 -- 172.21.15.154:0/3437455487 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200092e0 con 0x7fb9280b1420 2023-10-10T22:34:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb92d3ff700 1 -- 172.21.15.154:0/3437455487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 msgr2=0x7fb9280c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb92d3ff700 1 --2- 172.21.15.154:0/3437455487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 0x7fb9280c9740 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fb928063d40 tx=0x7fb920009840 comp rx=0 tx=0).stop 2023-10-10T22:34:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb92d3ff700 1 -- 172.21.15.154:0/3437455487 shutdown_connections 2023-10-10T22:34:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb92d3ff700 1 --2- 172.21.15.154:0/3437455487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 0x7fb9280c9740 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb92d3ff700 1 --2- 172.21.15.154:0/3437455487 >> v2:172.21.15.179:3300/0 conn(0x7fb9280cbf30 0x7fb9280ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.801+0000 7fb92d3ff700 1 -- 172.21.15.154:0/3437455487 >> 172.21.15.154:0/3437455487 conn(0x7fb92806a320 msgr2=0x7fb9280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.802+0000 7fb92d3ff700 1 -- 172.21.15.154:0/3437455487 shutdown_connections 2023-10-10T22:34:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.802+0000 7fb92d3ff700 1 -- 172.21.15.154:0/3437455487 wait complete. 2023-10-10T22:34:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.803+0000 7fb92d3ff700 1 Processor -- start 2023-10-10T22:34:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.803+0000 7fb92d3ff700 1 -- start start 2023-10-10T22:34:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb92d3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 0x7fb9280a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb92d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9280cbf30 0x7fb9280ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb92d3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9280ccf90 0x7fb9280a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb92d3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb928141aa0 con 0x7fb9280b1420 2023-10-10T22:34:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb92d3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280ab140 con 0x7fb9280ccf90 2023-10-10T22:34:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb92d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280ab3e0 con 0x7fb9280cbf30 2023-10-10T22:34:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb926ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 0x7fb9280a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb926ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 0x7fb9280a6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32830/0 (socket says 172.21.15.154:32830) 2023-10-10T22:34:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb926ffd700 1 -- 172.21.15.154:0/1018038906 learned_addr learned my addr 172.21.15.154:0/1018038906 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb9277fe700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9280ccf90 0x7fb9280a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.804+0000 7fb91ffff700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9280cbf30 0x7fb9280ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb926ffd700 1 -- 172.21.15.154:0/1018038906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9280cbf30 msgr2=0x7fb9280ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb926ffd700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9280cbf30 0x7fb9280ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb926ffd700 1 -- 172.21.15.154:0/1018038906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9280ccf90 msgr2=0x7fb9280a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb926ffd700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9280ccf90 0x7fb9280a6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb926ffd700 1 -- 172.21.15.154:0/1018038906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb920009ae0 con 0x7fb9280b1420 2023-10-10T22:34:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb926ffd700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 0x7fb9280a6180 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c830 tx=0x7fb918008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb91effd700 1 -- 172.21.15.154:0/1018038906 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918011600 con 0x7fb9280b1420 2023-10-10T22:34:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb91effd700 1 -- 172.21.15.154:0/1018038906 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918011760 con 0x7fb9280b1420 2023-10-10T22:34:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9280ab6c0 con 0x7fb9280b1420 2023-10-10T22:34:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb91effd700 1 -- 172.21.15.154:0/1018038906 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918011b20 con 0x7fb9280b1420 2023-10-10T22:34:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.805+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9280aba50 con 0x7fb9280b1420 2023-10-10T22:34:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.806+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9280a6d30 con 0x7fb9280b1420 2023-10-10T22:34:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.807+0000 7fb91effd700 1 -- 172.21.15.154:0/1018038906 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9180193b0 con 0x7fb9280b1420 2023-10-10T22:34:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.808+0000 7fb91effd700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb908066f30 0x7fb9080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.808+0000 7fb91effd700 1 -- 172.21.15.154:0/1018038906 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fb9180846c0 con 0x7fb9280b1420 2023-10-10T22:34:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.808+0000 7fb91ffff700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb908066f30 0x7fb9080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.809+0000 7fb91ffff700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb908066f30 0x7fb9080693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb910006fd0 tx=0x7fb910008040 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:50.812+0000 7fb91effd700 1 -- 172.21.15.154:0/1018038906 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb918051740 con 0x7fb9280b1420 2023-10-10T22:34:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.047+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb92804c3c0 con 0x7fb9280b1420 2023-10-10T22:34:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.048+0000 7fb91effd700 1 -- 172.21.15.154:0/1018038906 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb918054d60 con 0x7fb9280b1420 2023-10-10T22:34:51.050 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T22:34:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb908066f30 msgr2=0x7fb9080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb908066f30 0x7fb9080693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb910006fd0 tx=0x7fb910008040 comp rx=0 tx=0).stop 2023-10-10T22:34:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 msgr2=0x7fb9280a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 0x7fb9280a6180 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c830 tx=0x7fb918008040 comp rx=0 tx=0).stop 2023-10-10T22:34:51.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 shutdown_connections 2023-10-10T22:34:51.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb908066f30 0x7fb9080693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:51.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9280ccf90 0x7fb9280a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:51.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9280b1420 0x7fb9280a6180 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:51.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 --2- 172.21.15.154:0/1018038906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9280cbf30 0x7fb9280ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:51.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 >> 172.21.15.154:0/1018038906 conn(0x7fb92806a320 msgr2=0x7fb9280ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:51.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 shutdown_connections 2023-10-10T22:34:51.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:51.050+0000 7fb92d3ff700 1 -- 172.21.15.154:0/1018038906 wait complete. 2023-10-10T22:34:51.069 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T22:34:51.070 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T22:34:51.070 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T22:34:51.070 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T22:34:51.071 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T22:34:51.071 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T22:34:51.071 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T22:34:51.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T22:34:51.072 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:34:51.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:34:51.073 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T22:34:51.111 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T22:34:51.111 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T22:34:51.111 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T22:34:51.111 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:34:51.112 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T22:34:51.112 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:34:51.112 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:34:51.112 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:34:51.113 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T22:34:51.113 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:34:51.113 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:34:51.113 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T22:34:51.113 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:34:51.114 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:34:51.114 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T22:34:51.114 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:34:51.114 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T22:34:51.114 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 36723sec preferred_lft 36723sec 2023-10-10T22:34:51.115 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T22:34:51.115 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:34:51.115 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T22:34:51.116 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:34:51.116 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T22:34:51.116 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:34:51.116 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T22:34:51.116 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:34:51.117 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T22:34:51.117 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T22:34:51.117 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T22:34:51.117 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:34:51.117 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T22:34:51.117 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T22:34:51.118 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T22:34:51.118 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:34:51.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:34:51.119 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T22:34:51.211 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T22:34:51.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:34:51.215 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T22:34:51.253 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T22:34:51.254 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T22:34:51.254 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T22:34:51.254 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T22:34:51.254 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T22:34:51.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:34:51.256 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T22:34:51.256 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T22:34:51.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T22:34:51.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T22:34:51.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T22:34:51.258 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T22:34:51.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:34:51.453 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T22:34:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T22:34:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T22:34:51.490 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:34:51.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:34:51.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T22:34:51.592 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T22:34:51.593 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T22:34:51.630 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:34:51.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T22:34:51.630 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T22:34:51.706 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T22:34:51.706 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T22:34:51.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:34:51.837 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:34:51.837 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:34:51.838 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:34:51.854 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:34:51.854 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:34:51.854 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:34:51.855 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T22:34:51.855 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T22:34:51.876 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:34:51.876 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:34:51.876 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:34:51.876 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T22:34:51.877 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T22:34:51.877 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T22:34:51.877 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T22:34:51.877 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T22:34:51.881 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T22:34:51.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:34:51.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T22:34:51.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T22:34:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.128+0000 7f58309ff700 1 Processor -- start 2023-10-10T22:34:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.128+0000 7f58309ff700 1 -- start start 2023-10-10T22:34:52.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f58309ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f582c0ccc40 0x7f582c155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f58309ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f582c0cd010 0x7f582c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f58309ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0ad930 con 0x7f582c156150 2023-10-10T22:34:52.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f58309ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0acd20 con 0x7f582c0ccc40 2023-10-10T22:34:52.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f58309ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0ad000 con 0x7f582c0cd010 2023-10-10T22:34:52.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f582a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f582c0ccc40 0x7f582c155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f582a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f582c0ccc40 0x7f582c155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32842/0 (socket says 172.21.15.154:32842) 2023-10-10T22:34:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f582a59c700 1 -- 172.21.15.154:0/809546767 learned_addr learned my addr 172.21.15.154:0/809546767 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f582ad9d700 1 --2- 172.21.15.154:0/809546767 >> v2:172.21.15.179:3300/0 conn(0x7f582c0cd010 0x7f582c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f582a59c700 1 -- 172.21.15.154:0/809546767 >> v2:172.21.15.179:3300/0 conn(0x7f582c0cd010 msgr2=0x7f582c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f582a59c700 1 --2- 172.21.15.154:0/809546767 >> v2:172.21.15.179:3300/0 conn(0x7f582c0cd010 0x7f582c0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f582a59c700 1 -- 172.21.15.154:0/809546767 >> v1:172.21.15.179:6789/0 conn(0x7f582c156150 legacy=0x7f582c0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.130+0000 7f582a59c700 1 -- 172.21.15.154:0/809546767 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0ad2e0 con 0x7f582c0ccc40 2023-10-10T22:34:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f582a59c700 1 --2- 172.21.15.154:0/809546767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 0x7f582c155c10 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f582c0ae0c0 tx=0x7f581c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408ec501b815ffc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f5829d9b700 1 -- 172.21.15.154:0/809546767 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c00dc50 con 0x7f582c0ccc40 2023-10-10T22:34:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f5829d9b700 1 -- 172.21.15.154:0/809546767 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c00ddb0 con 0x7f582c0ccc40 2023-10-10T22:34:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f5829d9b700 1 -- 172.21.15.154:0/809546767 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0196d0 con 0x7f582c0ccc40 2023-10-10T22:34:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f58309ff700 1 -- 172.21.15.154:0/809546767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 msgr2=0x7f582c155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f58309ff700 1 --2- 172.21.15.154:0/809546767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 0x7f582c155c10 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f582c0ae0c0 tx=0x7f581c00b4f0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f58309ff700 1 -- 172.21.15.154:0/809546767 shutdown_connections 2023-10-10T22:34:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f58309ff700 1 --2- 172.21.15.154:0/809546767 >> v2:172.21.15.179:3300/0 conn(0x7f582c0cd010 0x7f582c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f58309ff700 1 --2- 172.21.15.154:0/809546767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 0x7f582c155c10 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.131+0000 7f58309ff700 1 -- 172.21.15.154:0/809546767 >> 172.21.15.154:0/809546767 conn(0x7f582c06a320 msgr2=0x7f582c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.132+0000 7f58309ff700 1 -- 172.21.15.154:0/809546767 shutdown_connections 2023-10-10T22:34:52.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.132+0000 7f58309ff700 1 -- 172.21.15.154:0/809546767 wait complete. 2023-10-10T22:34:52.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.133+0000 7f58309ff700 1 Processor -- start 2023-10-10T22:34:52.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.133+0000 7f58309ff700 1 -- start start 2023-10-10T22:34:52.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f58309ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 0x7f582c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f58309ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0cd010 0x7f582c143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f58309ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c156150 0x7f582c14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f58309ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0cb9d0 con 0x7f582c0ccc40 2023-10-10T22:34:52.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f58309ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c93a0 con 0x7f582c0cd010 2023-10-10T22:34:52.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f58309ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c9680 con 0x7f582c156150 2023-10-10T22:34:52.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f582a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 0x7f582c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f582a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 0x7f582c0cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32852/0 (socket says 172.21.15.154:32852) 2023-10-10T22:34:52.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f582a59c700 1 -- 172.21.15.154:0/3101324005 learned_addr learned my addr 172.21.15.154:0/3101324005 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:52.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f5823fff700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0cd010 0x7f582c143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.134+0000 7f582ad9d700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c156150 0x7f582c14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f582a59c700 1 -- 172.21.15.154:0/3101324005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c156150 msgr2=0x7f582c14f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f582a59c700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c156150 0x7f582c14f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f582a59c700 1 -- 172.21.15.154:0/3101324005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0cd010 msgr2=0x7f582c143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f582a59c700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0cd010 0x7f582c143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f582a59c700 1 -- 172.21.15.154:0/3101324005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c00b790 con 0x7f582c0ccc40 2023-10-10T22:34:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f582a59c700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 0x7f582c0cb490 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f581c00b760 tx=0x7f581c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f58227fc700 1 -- 172.21.15.154:0/3101324005 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c010470 con 0x7f582c0ccc40 2023-10-10T22:34:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f58227fc700 1 -- 172.21.15.154:0/3101324005 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0105d0 con 0x7f582c0ccc40 2023-10-10T22:34:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c0c9960 con 0x7f582c0ccc40 2023-10-10T22:34:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f58227fc700 1 -- 172.21.15.154:0/3101324005 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c010990 con 0x7f582c0ccc40 2023-10-10T22:34:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.135+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c0c9f20 con 0x7f582c0ccc40 2023-10-10T22:34:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.136+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c0ca110 con 0x7f582c0ccc40 2023-10-10T22:34:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.137+0000 7f58227fc700 1 -- 172.21.15.154:0/3101324005 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f581c022070 con 0x7f582c0ccc40 2023-10-10T22:34:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.138+0000 7f58227fc700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f580c066f30 0x7f580c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.138+0000 7f58227fc700 1 -- 172.21.15.154:0/3101324005 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f581c014070 con 0x7f582c0ccc40 2023-10-10T22:34:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.138+0000 7f5823fff700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f580c066f30 0x7f580c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.139+0000 7f5823fff700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f580c066f30 0x7f580c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f582c0cabf0 tx=0x7f5814007ec0 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.142+0000 7f58227fc700 1 -- 172.21.15.154:0/3101324005 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f581c055280 con 0x7f582c0ccc40 2023-10-10T22:34:52.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.361+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f582c04c3c0 con 0x7f580c066f30 2023-10-10T22:34:52.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.362+0000 7f58227fc700 1 -- 172.21.15.154:0/3101324005 <== mgr.8884 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f582c04c3c0 con 0x7f580c066f30 2023-10-10T22:34:52.364 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T22:34:52.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:34:52.364 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T22:34:52.364 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:34:52.364 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T22:34:52.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f580c066f30 msgr2=0x7f580c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f580c066f30 0x7f580c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f582c0cabf0 tx=0x7f5814007ec0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 msgr2=0x7f582c0cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 0x7f582c0cb490 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f581c00b760 tx=0x7f581c01b000 comp rx=0 tx=0).stop 2023-10-10T22:34:52.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 shutdown_connections 2023-10-10T22:34:52.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f580c066f30 0x7f580c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c156150 0x7f582c14f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f582c0ccc40 0x7f582c0cb490 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 --2- 172.21.15.154:0/3101324005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0cd010 0x7f582c143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 >> 172.21.15.154:0/3101324005 conn(0x7f582c06a320 msgr2=0x7f582c06dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 shutdown_connections 2023-10-10T22:34:52.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.365+0000 7f58309ff700 1 -- 172.21.15.154:0/3101324005 wait complete. 2023-10-10T22:34:52.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T22:34:52.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.567+0000 7fbbf03ff700 1 Processor -- start 2023-10-10T22:34:52.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.567+0000 7fbbf03ff700 1 -- start start 2023-10-10T22:34:52.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.568+0000 7fbbf03ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbbe80c70b0 0x7fbbe8069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.568+0000 7fbbf03ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbbe8069cb0 0x7fbbe80ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.568+0000 7fbbf03ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe806e950 con 0x7fbbe8155eb0 2023-10-10T22:34:52.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.568+0000 7fbbf03ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe806a130 con 0x7fbbe80c70b0 2023-10-10T22:34:52.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.568+0000 7fbbf03ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe806eb90 con 0x7fbbe8069cb0 2023-10-10T22:34:52.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.569+0000 7fbbed99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbbe80c70b0 0x7fbbe8069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.569+0000 7fbbed99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbbe80c70b0 0x7fbbe8069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32858/0 (socket says 172.21.15.154:32858) 2023-10-10T22:34:52.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.569+0000 7fbbed99a700 1 -- 172.21.15.154:0/4257020313 learned_addr learned my addr 172.21.15.154:0/4257020313 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:52.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.569+0000 7fbbee99c700 1 --2- 172.21.15.154:0/4257020313 >> v2:172.21.15.179:3300/0 conn(0x7fbbe8069cb0 0x7fbbe80ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.569+0000 7fbbed99a700 1 -- 172.21.15.154:0/4257020313 >> v2:172.21.15.179:3300/0 conn(0x7fbbe8069cb0 msgr2=0x7fbbe80ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:52.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.569+0000 7fbbed99a700 1 --2- 172.21.15.154:0/4257020313 >> v2:172.21.15.179:3300/0 conn(0x7fbbe8069cb0 0x7fbbe80ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.569+0000 7fbbed99a700 1 -- 172.21.15.154:0/4257020313 >> v1:172.21.15.179:6789/0 conn(0x7fbbe8155eb0 legacy=0x7fbbe806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.569+0000 7fbbed99a700 1 -- 172.21.15.154:0/4257020313 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe806ee70 con 0x7fbbe80c70b0 2023-10-10T22:34:52.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.569+0000 7fbbed199700 1 -- 172.21.15.154:0/4257020313 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405012141 0 0) 0x7fbbe4001110 con 0x7fbbe8155eb0 2023-10-10T22:34:52.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbed99a700 1 --2- 172.21.15.154:0/4257020313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe80c70b0 0x7fbbe8069770 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80cc450 tx=0x7fbbd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb88a8b1a3fde34 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:52.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbed199700 1 -- 172.21.15.154:0/4257020313 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8009e70 con 0x7fbbe80c70b0 2023-10-10T22:34:52.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbed199700 1 -- 172.21.15.154:0/4257020313 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd800b860 con 0x7fbbe80c70b0 2023-10-10T22:34:52.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbed199700 1 -- 172.21.15.154:0/4257020313 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800bc00 con 0x7fbbe80c70b0 2023-10-10T22:34:52.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbf03ff700 1 -- 172.21.15.154:0/4257020313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe80c70b0 msgr2=0x7fbbe8069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbf03ff700 1 --2- 172.21.15.154:0/4257020313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe80c70b0 0x7fbbe8069770 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80cc450 tx=0x7fbbd8009250 comp rx=0 tx=0).stop 2023-10-10T22:34:52.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbf03ff700 1 -- 172.21.15.154:0/4257020313 shutdown_connections 2023-10-10T22:34:52.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbf03ff700 1 --2- 172.21.15.154:0/4257020313 >> v2:172.21.15.179:3300/0 conn(0x7fbbe8069cb0 0x7fbbe80ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbf03ff700 1 --2- 172.21.15.154:0/4257020313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe80c70b0 0x7fbbe8069770 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbf03ff700 1 -- 172.21.15.154:0/4257020313 >> 172.21.15.154:0/4257020313 conn(0x7fbbe8068e10 msgr2=0x7fbbe80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:52.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.570+0000 7fbbf03ff700 1 -- 172.21.15.154:0/4257020313 shutdown_connections 2023-10-10T22:34:52.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.571+0000 7fbbf03ff700 1 -- 172.21.15.154:0/4257020313 wait complete. 2023-10-10T22:34:52.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.572+0000 7fbbf03ff700 1 Processor -- start 2023-10-10T22:34:52.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.572+0000 7fbbf03ff700 1 -- start start 2023-10-10T22:34:52.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbf03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe8069cb0 0x7fbbe8169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbf03ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe80c70b0 0x7fbbe816dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbf03ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe8155eb0 0x7fbbe815ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbf03ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe816d850 con 0x7fbbe8155eb0 2023-10-10T22:34:52.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbf03ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe816d550 con 0x7fbbe80c70b0 2023-10-10T22:34:52.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbf03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe816a750 con 0x7fbbe8069cb0 2023-10-10T22:34:52.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbee99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe8155eb0 0x7fbbe815ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbee99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe8155eb0 0x7fbbe815ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32872/0 (socket says 172.21.15.154:32872) 2023-10-10T22:34:52.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbee19b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe8069cb0 0x7fbbe8169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbee99c700 1 -- 172.21.15.154:0/2374002464 learned_addr learned my addr 172.21.15.154:0/2374002464 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:52.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.573+0000 7fbbed99a700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe80c70b0 0x7fbbe816dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbee99c700 1 -- 172.21.15.154:0/2374002464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe8069cb0 msgr2=0x7fbbe8169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbee99c700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe8069cb0 0x7fbbe8169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbee99c700 1 -- 172.21.15.154:0/2374002464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe80c70b0 msgr2=0x7fbbe816dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:52.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbee99c700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe80c70b0 0x7fbbe816dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:52.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbee99c700 1 -- 172.21.15.154:0/2374002464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80094f0 con 0x7fbbe8155eb0 2023-10-10T22:34:52.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbee99c700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe8155eb0 0x7fbbe815ca00 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009ec0 tx=0x7fbbe000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:52.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbde7fc700 1 -- 172.21.15.154:0/2374002464 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe000cb70 con 0x7fbbe8155eb0 2023-10-10T22:34:52.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbde7fc700 1 -- 172.21.15.154:0/2374002464 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe000f040 con 0x7fbbe8155eb0 2023-10-10T22:34:52.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbde7fc700 1 -- 172.21.15.154:0/2374002464 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0014480 con 0x7fbbe8155eb0 2023-10-10T22:34:52.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe816aa30 con 0x7fbbe8155eb0 2023-10-10T22:34:52.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.574+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe816a3b0 con 0x7fbbe8155eb0 2023-10-10T22:34:52.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.575+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe816da00 con 0x7fbbe8155eb0 2023-10-10T22:34:52.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.576+0000 7fbbde7fc700 1 -- 172.21.15.154:0/2374002464 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbe0014830 con 0x7fbbe8155eb0 2023-10-10T22:34:52.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.577+0000 7fbbde7fc700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbbcc066f30 0x7fbbcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:52.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.577+0000 7fbbde7fc700 1 -- 172.21.15.154:0/2374002464 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fbbe0085060 con 0x7fbbe8155eb0 2023-10-10T22:34:52.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.577+0000 7fbbee19b700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbbcc066f30 0x7fbbcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:52.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.578+0000 7fbbee19b700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbbcc066f30 0x7fbbcc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40039b0 tx=0x7fbbe4007ec0 comp rx=0 tx=0).ready entity=mgr.8884 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:52.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.581+0000 7fbbde7fc700 1 -- 172.21.15.154:0/2374002464 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbe816da00 con 0x7fbbe8155eb0 2023-10-10T22:34:52.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:52.826+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fbbe816da00 con 0x7fbbe8155eb0 2023-10-10T22:34:53.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.409+0000 7fbbde7fc700 1 -- 172.21.15.154:0/2374002464 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 100) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fbbe0052410 con 0x7fbbe8155eb0 2023-10-10T22:34:53.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.411+0000 7fbbde7fc700 1 -- 172.21.15.154:0/2374002464 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v100) v1 ==== 92+0+0 (secure 0 0 0) 0x7fbbe0055ad0 con 0x7fbbe8155eb0 2023-10-10T22:34:53.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbbcc066f30 msgr2=0x7fbbcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:53.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbbcc066f30 0x7fbbcc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40039b0 tx=0x7fbbe4007ec0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe8155eb0 msgr2=0x7fbbe815ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:53.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe8155eb0 0x7fbbe815ca00 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009ec0 tx=0x7fbbe000b040 comp rx=0 tx=0).stop 2023-10-10T22:34:53.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 shutdown_connections 2023-10-10T22:34:53.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbbcc066f30 0x7fbbcc0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbe8155eb0 0x7fbbe815ca00 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe8069cb0 0x7fbbe8169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 --2- 172.21.15.154:0/2374002464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe80c70b0 0x7fbbe816dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 >> 172.21.15.154:0/2374002464 conn(0x7fbbe8068e10 msgr2=0x7fbbe8154be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:53.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 shutdown_connections 2023-10-10T22:34:53.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.413+0000 7fbbf03ff700 1 -- 172.21.15.154:0/2374002464 wait complete. 2023-10-10T22:34:53.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T22:34:53.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.626+0000 7f97f7fff700 1 Processor -- start 2023-10-10T22:34:53.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.626+0000 7f97f7fff700 1 -- start start 2023-10-10T22:34:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.627+0000 7f97f7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f97f80b4e70 0x7f97f80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.627+0000 7f97f7fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f80cfb00 con 0x7f97f80b1b40 2023-10-10T22:34:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.627+0000 7f97f7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f815e060 con 0x7f97f80b16d0 2023-10-10T22:34:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.627+0000 7f97f7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80b5c40 con 0x7f97f80b4e70 2023-10-10T22:34:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.627+0000 7f97f77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f97f80b1b40 0x7f97f815d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44816/0 (socket says 172.21.15.154:44816) 2023-10-10T22:34:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.627+0000 7f97f77fe700 1 -- 172.21.15.154:0/1454095849 learned_addr learned my addr 172.21.15.154:0/1454095849 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.627+0000 7f97f6ffd700 1 --2- 172.21.15.154:0/1454095849 >> v2:172.21.15.179:3300/0 conn(0x7f97f80b4e70 0x7f97f80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.628+0000 7f97f5ffb700 1 -- 172.21.15.154:0/1454095849 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554334572 0 0) 0x7f97f80cfb00 con 0x7f97f80b1b40 2023-10-10T22:34:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.628+0000 7f97f5ffb700 1 -- 172.21.15.154:0/1454095849 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e0003570 con 0x7f97f80b1b40 2023-10-10T22:34:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.628+0000 7f97f5ffb700 1 -- 172.21.15.154:0/1454095849 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324441558 0 0) 0x7f97f815e060 con 0x7f97f80b16d0 2023-10-10T22:34:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.628+0000 7f97f5ffb700 1 -- 172.21.15.154:0/1454095849 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f80cfb00 con 0x7f97f80b16d0 2023-10-10T22:34:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.628+0000 7f97f6ffd700 1 -- 172.21.15.154:0/1454095849 >> v1:172.21.15.179:6789/0 conn(0x7f97f80b16d0 legacy=0x7f97f815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.628+0000 7f97f6ffd700 1 -- 172.21.15.154:0/1454095849 >> v1:172.21.15.154:6789/0 conn(0x7f97f80b1b40 legacy=0x7f97f815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:53.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.628+0000 7f97f6ffd700 1 -- 172.21.15.154:0/1454095849 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80b5f20 con 0x7f97f80b4e70 2023-10-10T22:34:53.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.628+0000 7f97f6ffd700 1 --2- 172.21.15.154:0/1454095849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f80b4e70 0x7f97f80ccff0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f97e80098e0 tx=0x7f97e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2b8e8a3a882a475 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:53.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.628+0000 7f97f5ffb700 1 -- 172.21.15.154:0/1454095849 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8011630 con 0x7f97f80b4e70 2023-10-10T22:34:53.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.629+0000 7f97f5ffb700 1 -- 172.21.15.154:0/1454095849 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e8011790 con 0x7f97f80b4e70 2023-10-10T22:34:53.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.629+0000 7f97f5ffb700 1 -- 172.21.15.154:0/1454095849 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8011b30 con 0x7f97f80b4e70 2023-10-10T22:34:53.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.629+0000 7f97f7fff700 1 -- 172.21.15.154:0/1454095849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f80b4e70 msgr2=0x7f97f80ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:53.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.629+0000 7f97f7fff700 1 --2- 172.21.15.154:0/1454095849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f80b4e70 0x7f97f80ccff0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f97e80098e0 tx=0x7f97e80091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.629+0000 7f97f7fff700 1 -- 172.21.15.154:0/1454095849 shutdown_connections 2023-10-10T22:34:53.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.629+0000 7f97f7fff700 1 --2- 172.21.15.154:0/1454095849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f80b4e70 0x7f97f80ccff0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.629+0000 7f97f7fff700 1 -- 172.21.15.154:0/1454095849 >> 172.21.15.154:0/1454095849 conn(0x7f97f80d10c0 msgr2=0x7f97f80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:53.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.629+0000 7f97f7fff700 1 -- 172.21.15.154:0/1454095849 shutdown_connections 2023-10-10T22:34:53.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.629+0000 7f97f7fff700 1 -- 172.21.15.154:0/1454095849 wait complete. 2023-10-10T22:34:53.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.631+0000 7f97f7fff700 1 Processor -- start 2023-10-10T22:34:53.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.631+0000 7f97f7fff700 1 -- start start 2023-10-10T22:34:53.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97f80b16d0 0x7f97f80af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:53.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f80b1b40 0x7f97f80c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:53.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f80b4e70 0x7f97f80c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:53.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f7fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80c7830 con 0x7f97f80b16d0 2023-10-10T22:34:53.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80c7b10 con 0x7f97f80b1b40 2023-10-10T22:34:53.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80c9140 con 0x7f97f80b4e70 2023-10-10T22:34:53.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97f80b16d0 0x7f97f80af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:53.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97f80b16d0 0x7f97f80af400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32890/0 (socket says 172.21.15.154:32890) 2023-10-10T22:34:53.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f6ffd700 1 -- 172.21.15.154:0/326472395 learned_addr learned my addr 172.21.15.154:0/326472395 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:53.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f67fc700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f80b1b40 0x7f97f80c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:53.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f77fe700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f80b4e70 0x7f97f80c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:53.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f6ffd700 1 -- 172.21.15.154:0/326472395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f80b4e70 msgr2=0x7f97f80c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:53.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f6ffd700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f80b4e70 0x7f97f80c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f6ffd700 1 -- 172.21.15.154:0/326472395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f80b1b40 msgr2=0x7f97f80c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:53.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f6ffd700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f80b1b40 0x7f97f80c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.632+0000 7f97f6ffd700 1 -- 172.21.15.154:0/326472395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e8009420 con 0x7f97f80b16d0 2023-10-10T22:34:53.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.633+0000 7f97f6ffd700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97f80b16d0 0x7f97f80af400 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f97f8070dd0 tx=0x7f97e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:53.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.633+0000 7f97deffd700 1 -- 172.21.15.154:0/326472395 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e801f070 con 0x7f97f80b16d0 2023-10-10T22:34:53.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.633+0000 7f97deffd700 1 -- 172.21.15.154:0/326472395 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e8011900 con 0x7f97f80b16d0 2023-10-10T22:34:53.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.633+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f80c9420 con 0x7f97f80b16d0 2023-10-10T22:34:53.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.633+0000 7f97deffd700 1 -- 172.21.15.154:0/326472395 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8023410 con 0x7f97f80b16d0 2023-10-10T22:34:53.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.633+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f8157e80 con 0x7f97f80b16d0 2023-10-10T22:34:53.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.634+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f8088990 con 0x7f97f80b16d0 2023-10-10T22:34:53.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.635+0000 7f97deffd700 1 -- 172.21.15.154:0/326472395 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 100) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f97e802c3b0 con 0x7f97f80b16d0 2023-10-10T22:34:53.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.637+0000 7f97deffd700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f97e4066f80 0x7f97e4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:53.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.637+0000 7f97f67fc700 1 -- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f97e4066f80 msgr2=0x7f97e4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:53.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.637+0000 7f97deffd700 1 -- 172.21.15.154:0/326472395 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f97e80858d0 con 0x7f97f80b16d0 2023-10-10T22:34:53.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.637+0000 7f97f67fc700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f97e4066f80 0x7f97e4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:53.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.641+0000 7f97deffd700 1 -- 172.21.15.154:0/326472395 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97e8052950 con 0x7f97f80b16d0 2023-10-10T22:34:53.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.838+0000 7f97f67fc700 1 -- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f97e4066f80 msgr2=0x7f97e4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:53.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.838+0000 7f97f67fc700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f97e4066f80 0x7f97e4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:53.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.842+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f97f804bb80 con 0x7f97f80b16d0 2023-10-10T22:34:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.846+0000 7f97deffd700 1 -- 172.21.15.154:0/326472395 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f97e8055f70 con 0x7f97f80b16d0 2023-10-10T22:34:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f97e4066f80 msgr2=0x7f97e4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f97e4066f80 0x7f97e4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97f80b16d0 msgr2=0x7f97f80af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97f80b16d0 0x7f97f80af400 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f97f8070dd0 tx=0x7f97e8017000 comp rx=0 tx=0).stop 2023-10-10T22:34:53.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 shutdown_connections 2023-10-10T22:34:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f97e4066f80 0x7f97e4069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f80b4e70 0x7f97f80c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97f80b16d0 0x7f97f80af400 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 --2- 172.21.15.154:0/326472395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f80b1b40 0x7f97f80c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:53.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 >> 172.21.15.154:0/326472395 conn(0x7f97f80d10c0 msgr2=0x7f97f8159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:53.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 shutdown_connections 2023-10-10T22:34:53.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:53.848+0000 7f97f7fff700 1 -- 172.21.15.154:0/326472395 wait complete. 2023-10-10T22:34:53.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T22:34:54.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.056+0000 7fca4239d700 1 Processor -- start 2023-10-10T22:34:54.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.056+0000 7fca4239d700 1 -- start start 2023-10-10T22:34:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.058+0000 7fca4239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c0aef00 0x7fca3c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.058+0000 7fca4239d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c0aea70 con 0x7fca3c15a3b0 2023-10-10T22:34:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.058+0000 7fca4239d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c0ae480 con 0x7fca3c06e470 2023-10-10T22:34:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.058+0000 7fca4239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c15dd30 con 0x7fca3c0aef00 2023-10-10T22:34:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.058+0000 7fca4139b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fca3c15a3b0 0x7fca3c15a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44822/0 (socket says 172.21.15.154:44822) 2023-10-10T22:34:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.058+0000 7fca4139b700 1 -- 172.21.15.154:0/725988305 learned_addr learned my addr 172.21.15.154:0/725988305 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:34:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.058+0000 7fca40b9a700 1 --2- 172.21.15.154:0/725988305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c0aef00 0x7fca3c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:54.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.058+0000 7fca33fff700 1 -- 172.21.15.154:0/725988305 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434153530 0 0) 0x7fca3c0aea70 con 0x7fca3c15a3b0 2023-10-10T22:34:54.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca33fff700 1 -- 172.21.15.154:0/725988305 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca28003570 con 0x7fca3c15a3b0 2023-10-10T22:34:54.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca33fff700 1 -- 172.21.15.154:0/725988305 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964181123 0 0) 0x7fca3c0ae480 con 0x7fca3c06e470 2023-10-10T22:34:54.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca33fff700 1 -- 172.21.15.154:0/725988305 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca3c0aea70 con 0x7fca3c06e470 2023-10-10T22:34:54.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca40b9a700 1 -- 172.21.15.154:0/725988305 >> v1:172.21.15.179:6789/0 conn(0x7fca3c06e470 legacy=0x7fca3c0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca40b9a700 1 -- 172.21.15.154:0/725988305 >> v1:172.21.15.154:6789/0 conn(0x7fca3c15a3b0 legacy=0x7fca3c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca40b9a700 1 -- 172.21.15.154:0/725988305 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c15e010 con 0x7fca3c0aef00 2023-10-10T22:34:54.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca40b9a700 1 --2- 172.21.15.154:0/725988305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c0aef00 0x7fca3c15d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009910 tx=0x7fca2c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9755ad7f968ecc21 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:54.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca33fff700 1 -- 172.21.15.154:0/725988305 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c011630 con 0x7fca3c0aef00 2023-10-10T22:34:54.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca33fff700 1 -- 172.21.15.154:0/725988305 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c011790 con 0x7fca3c0aef00 2023-10-10T22:34:54.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.059+0000 7fca33fff700 1 -- 172.21.15.154:0/725988305 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c011b30 con 0x7fca3c0aef00 2023-10-10T22:34:54.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.060+0000 7fca4239d700 1 -- 172.21.15.154:0/725988305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c0aef00 msgr2=0x7fca3c15d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.060+0000 7fca4239d700 1 --2- 172.21.15.154:0/725988305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c0aef00 0x7fca3c15d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009910 tx=0x7fca2c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.060+0000 7fca4239d700 1 -- 172.21.15.154:0/725988305 shutdown_connections 2023-10-10T22:34:54.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.060+0000 7fca4239d700 1 --2- 172.21.15.154:0/725988305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c0aef00 0x7fca3c15d3c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.060+0000 7fca4239d700 1 -- 172.21.15.154:0/725988305 >> 172.21.15.154:0/725988305 conn(0x7fca3c0c9f70 msgr2=0x7fca3c06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:54.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.060+0000 7fca4239d700 1 -- 172.21.15.154:0/725988305 shutdown_connections 2023-10-10T22:34:54.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.060+0000 7fca4239d700 1 -- 172.21.15.154:0/725988305 wait complete. 2023-10-10T22:34:54.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.062+0000 7fca4239d700 1 Processor -- start 2023-10-10T22:34:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.062+0000 7fca4239d700 1 -- start start 2023-10-10T22:34:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca4239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c06e470 0x7fca3c0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca4239d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c0aef00 0x7fca3c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca4239d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c15a3b0 0x7fca3c151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca4239d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c146dd0 con 0x7fca3c15a3b0 2023-10-10T22:34:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca4239d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0c67d0 con 0x7fca3c0aef00 2023-10-10T22:34:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca4239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c1550c0 con 0x7fca3c06e470 2023-10-10T22:34:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca4139b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c06e470 0x7fca3c0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca40b9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c0aef00 0x7fca3c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca41b9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c15a3b0 0x7fca3c151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:54.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca40b9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c0aef00 0x7fca3c154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:43998/0 (socket says 172.21.15.154:43998) 2023-10-10T22:34:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca4139b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c06e470 0x7fca3c0c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:44580/0 (socket says 172.21.15.154:44580) 2023-10-10T22:34:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca40b9a700 1 -- 172.21.15.154:0/1140048705 learned_addr learned my addr 172.21.15.154:0/1140048705 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca40b9a700 1 -- 172.21.15.154:0/1140048705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c06e470 msgr2=0x7fca3c0c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca40b9a700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c06e470 0x7fca3c0c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca40b9a700 1 -- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c15a3b0 msgr2=0x7fca3c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca40b9a700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c15a3b0 0x7fca3c151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca40b9a700 1 -- 172.21.15.154:0/1140048705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c009420 con 0x7fca3c0aef00 2023-10-10T22:34:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca4139b700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c06e470 0x7fca3c0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.063+0000 7fca41b9c700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c15a3b0 0x7fca3c151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.064+0000 7fca40b9a700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c0aef00 0x7fca3c154b80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009fd0 tx=0x7fca2c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:54.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.064+0000 7fca317fa700 1 -- 172.21.15.154:0/1140048705 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c01f070 con 0x7fca3c0aef00 2023-10-10T22:34:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.064+0000 7fca317fa700 1 -- 172.21.15.154:0/1140048705 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c002f70 con 0x7fca3c0aef00 2023-10-10T22:34:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.064+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3c0c5bc0 con 0x7fca3c0aef00 2023-10-10T22:34:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.064+0000 7fca317fa700 1 -- 172.21.15.154:0/1140048705 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c011900 con 0x7fca3c0aef00 2023-10-10T22:34:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.064+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c0c6180 con 0x7fca3c0aef00 2023-10-10T22:34:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.065+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c06cfa0 con 0x7fca3c0aef00 2023-10-10T22:34:54.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.066+0000 7fca317fa700 1 -- 172.21.15.154:0/1140048705 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 100) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fca2c023070 con 0x7fca3c0aef00 2023-10-10T22:34:54.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.067+0000 7fca317fa700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fca20066f80 0x7fca20069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.067+0000 7fca317fa700 1 -- 172.21.15.154:0/1140048705 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fca2c085ae0 con 0x7fca3c0aef00 2023-10-10T22:34:54.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.067+0000 7fca4139b700 1 -- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fca20066f80 msgr2=0x7fca20069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:54.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.067+0000 7fca4139b700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fca20066f80 0x7fca20069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:54.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.071+0000 7fca317fa700 1 -- 172.21.15.154:0/1140048705 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca2c052ac0 con 0x7fca3c0aef00 2023-10-10T22:34:54.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.268+0000 7fca4139b700 1 -- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fca20066f80 msgr2=0x7fca20069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:54.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.268+0000 7fca4139b700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fca20066f80 0x7fca20069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:54.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.272+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fca3c06edb0 con 0x7fca3c0aef00 2023-10-10T22:34:54.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.277+0000 7fca317fa700 1 -- 172.21.15.154:0/1140048705 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7fca2c02a0c0 con 0x7fca3c0aef00 2023-10-10T22:34:54.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.279+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fca20066f80 msgr2=0x7fca20069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:54.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.279+0000 7fca4239d700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fca20066f80 0x7fca20069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.279+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c0aef00 msgr2=0x7fca3c154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.279+0000 7fca4239d700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c0aef00 0x7fca3c154b80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009fd0 tx=0x7fca2c017000 comp rx=0 tx=0).stop 2023-10-10T22:34:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.280+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 shutdown_connections 2023-10-10T22:34:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.280+0000 7fca4239d700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fca20066f80 0x7fca20069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.280+0000 7fca4239d700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca3c15a3b0 0x7fca3c151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.280+0000 7fca4239d700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca3c06e470 0x7fca3c0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.280+0000 7fca4239d700 1 --2- 172.21.15.154:0/1140048705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c0aef00 0x7fca3c154b80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.280+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 >> 172.21.15.154:0/1140048705 conn(0x7fca3c0c9f70 msgr2=0x7fca3c152720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:54.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.280+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 shutdown_connections 2023-10-10T22:34:54.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.280+0000 7fca4239d700 1 -- 172.21.15.154:0/1140048705 wait complete. 2023-10-10T22:34:54.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:34:54.299 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-10T22:34:54.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-10T22:34:54.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.572+0000 7f2cbad9d700 1 Processor -- start 2023-10-10T22:34:54.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.572+0000 7f2cbad9d700 1 -- start start 2023-10-10T22:34:54.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.573+0000 7f2cbad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb40afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.573+0000 7f2cbad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2cb406f0b0 0x7f2cb415d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.573+0000 7f2cbad9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb406e510 con 0x7f2cb40ac0e0 2023-10-10T22:34:54.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.573+0000 7f2cbad9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb4069180 con 0x7f2cb406f0b0 2023-10-10T22:34:54.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.573+0000 7f2cbad9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb406dec0 con 0x7f2cb41597d0 2023-10-10T22:34:54.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cba59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2cb406f0b0 0x7f2cb415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:54.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cb9d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb40afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:54.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cb9d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb40afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:44596/0 (socket says 172.21.15.154:44596) 2023-10-10T22:34:54.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cba59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2cb406f0b0 0x7f2cb415d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:44008/0 (socket says 172.21.15.154:44008) 2023-10-10T22:34:54.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cb959a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2cb40ac0e0 0x7f2cb406e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:39668/0 (socket says 172.21.15.154:39668) 2023-10-10T22:34:54.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cb9d9b700 1 -- 172.21.15.154:0/2506036307 learned_addr learned my addr 172.21.15.154:0/2506036307 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:54.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cba59c700 1 -- 172.21.15.154:0/2506036307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 msgr2=0x7f2cb40afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:34:54.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cba59c700 1 --2- 172.21.15.154:0/2506036307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb40afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cba59c700 1 -- 172.21.15.154:0/2506036307 >> v1:172.21.15.179:6789/0 conn(0x7f2cb40ac0e0 legacy=0x7f2cb406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cba59c700 1 -- 172.21.15.154:0/2506036307 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb406e1a0 con 0x7f2cb406f0b0 2023-10-10T22:34:54.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cb9d9b700 1 --2- 172.21.15.154:0/2506036307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb40afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:34:54.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.574+0000 7f2cb8d99700 1 -- 172.21.15.154:0/2506036307 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641777593 0 0) 0x7f2cb406e510 con 0x7f2cb40ac0e0 2023-10-10T22:34:54.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.575+0000 7f2cba59c700 1 --2- 172.21.15.154:0/2506036307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 0x7f2cb415d440 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e60 tx=0x7f2cac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290da2db5847d1b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:54.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.575+0000 7f2cb8d99700 1 -- 172.21.15.154:0/2506036307 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00e070 con 0x7f2cb406f0b0 2023-10-10T22:34:54.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.575+0000 7f2cb8d99700 1 -- 172.21.15.154:0/2506036307 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac00bb60 con 0x7f2cb406f0b0 2023-10-10T22:34:54.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.575+0000 7f2cb8d99700 1 -- 172.21.15.154:0/2506036307 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac012430 con 0x7f2cb406f0b0 2023-10-10T22:34:54.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.575+0000 7f2cbad9d700 1 -- 172.21.15.154:0/2506036307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 msgr2=0x7f2cb415d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.575+0000 7f2cbad9d700 1 --2- 172.21.15.154:0/2506036307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 0x7f2cb415d440 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e60 tx=0x7f2cac009780 comp rx=0 tx=0).stop 2023-10-10T22:34:54.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.576+0000 7f2cbad9d700 1 -- 172.21.15.154:0/2506036307 shutdown_connections 2023-10-10T22:34:54.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.576+0000 7f2cbad9d700 1 --2- 172.21.15.154:0/2506036307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 0x7f2cb415d440 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.576+0000 7f2cbad9d700 1 --2- 172.21.15.154:0/2506036307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb40afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.576+0000 7f2cbad9d700 1 -- 172.21.15.154:0/2506036307 >> 172.21.15.154:0/2506036307 conn(0x7f2cb406adf0 msgr2=0x7f2cb40ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:34:54.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.576+0000 7f2cbad9d700 1 -- 172.21.15.154:0/2506036307 shutdown_connections 2023-10-10T22:34:54.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.576+0000 7f2cbad9d700 1 -- 172.21.15.154:0/2506036307 wait complete. 2023-10-10T22:34:54.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.577+0000 7f2cbad9d700 1 Processor -- start 2023-10-10T22:34:54.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.577+0000 7f2cbad9d700 1 -- start start 2023-10-10T22:34:54.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.578+0000 7f2cbad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 0x7f2cb40ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.578+0000 7f2cbad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb4156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.578+0000 7f2cbad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40c19c0 0x7f2cb41699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.578+0000 7f2cbad9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40c2ae0 con 0x7f2cb40c19c0 2023-10-10T22:34:54.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.578+0000 7f2cbad9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40ad8b0 con 0x7f2cb406f0b0 2023-10-10T22:34:54.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.578+0000 7f2cbad9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40acca0 con 0x7f2cb41597d0 2023-10-10T22:34:54.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.578+0000 7f2cba59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40c19c0 0x7f2cb41699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:54.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cb9d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 0x7f2cb40ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:54.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cba59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40c19c0 0x7f2cb41699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32914/0 (socket says 172.21.15.154:32914) 2023-10-10T22:34:54.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cba59c700 1 -- 172.21.15.154:0/3109970282 learned_addr learned my addr 172.21.15.154:0/3109970282 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:34:54.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cb959a700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:34:54.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cb9d9b700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 msgr2=0x7f2cb4156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cb9d9b700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb4156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cb9d9b700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40c19c0 msgr2=0x7f2cb41699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:34:54.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cb9d9b700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40c19c0 0x7f2cb41699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:54.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cb9d9b700 1 -- 172.21.15.154:0/3109970282 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00094f0 con 0x7f2cb406f0b0 2023-10-10T22:34:54.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2cb9d9b700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 0x7f2cb40ac650 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0006fd0 tx=0x7f2cb0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:34:54.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.579+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000c6a0 con 0x7f2cb406f0b0 2023-10-10T22:34:54.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.580+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb000c800 con 0x7f2cb406f0b0 2023-10-10T22:34:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.580+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000cb80 con 0x7f2cb406f0b0 2023-10-10T22:34:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.580+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac009a20 con 0x7f2cb406f0b0 2023-10-10T22:34:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.580+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb40ad260 con 0x7f2cb406f0b0 2023-10-10T22:34:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.581+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb404c3c0 con 0x7f2cb406f0b0 2023-10-10T22:34:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.582+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 100) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f2cb0013470 con 0x7f2cb406f0b0 2023-10-10T22:34:54.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.583+0000 7f2ca9ffb700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c98069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:34:54.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.583+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f2cb00848f0 con 0x7f2cb406f0b0 2023-10-10T22:34:54.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.583+0000 7f2cb959a700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 msgr2=0x7f2c98069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:54.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.583+0000 7f2cb959a700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c98069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:34:54.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.591+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cb00518d0 con 0x7f2cb406f0b0 2023-10-10T22:34:54.692 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:54.691+0000 7fa5a6364180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:34:54.745 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:54.744+0000 7f30ce925180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:34:54.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.784+0000 7f2cb959a700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 msgr2=0x7f2c98069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:54.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.784+0000 7f2cb959a700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c98069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:34:54.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:54.816+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cb40ad9f0 con 0x7f2c98066f80 2023-10-10T22:34:54.856 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:54.855+0000 7fa5a6364180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:34:54.912 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:54.911+0000 7f30ce925180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:34:54.941 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:54.941+0000 7fa5a6364180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:34:54.998 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:54.997+0000 7f30ce925180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:34:55.163 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:55.162+0000 7fa5a6364180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:34:55.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:55.185+0000 7f2cb959a700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 msgr2=0x7f2c98069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:55.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:55.185+0000 7f2cb959a700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c98069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T22:34:55.223 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:55.222+0000 7f30ce925180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:34:55.339 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:55.339+0000 7fa5a6364180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:34:55.404 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:55.403+0000 7f30ce925180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:34:55.435 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:55.434+0000 7fa5a6364180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:34:55.496 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:55.495+0000 7f30ce925180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:34:55.597 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:55.596+0000 7fa5a6364180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:34:55.658 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:55.657+0000 7f30ce925180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:34:55.697 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:55.696+0000 7fa5a6364180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:34:55.759 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:55.757+0000 7f30ce925180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:34:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:55.986+0000 7f2cb959a700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 msgr2=0x7f2c98069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:55.986+0000 7f2cb959a700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c98069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T22:34:56.182 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:56.182+0000 7fa5a6364180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:34:56.243 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:56.242+0000 7f30ce925180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:34:56.278 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:56.277+0000 7fa5a6364180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:34:56.336 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:56.335+0000 7f30ce925180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:34:56.367 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:56.366+0000 7fa5a6364180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:34:56.426 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:56.425+0000 7f30ce925180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:34:56.987 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:56.986+0000 7fa5a6364180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:34:57.049 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:57.048+0000 7f30ce925180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:34:57.157 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:57.156+0000 7fa5a6364180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:34:57.223 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:57.221+0000 7f30ce925180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:34:57.254 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:57.253+0000 7fa5a6364180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:34:57.319 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:57.318+0000 7f30ce925180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:34:57.548 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:57.547+0000 7fa5a6364180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:34:57.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:57.588+0000 7f2cb959a700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 msgr2=0x7f2c98069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:34:57.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:57.588+0000 7f2cb959a700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c98069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T22:34:57.616 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:57.615+0000 7f30ce925180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:34:57.645 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:57.644+0000 7fa5a6364180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:34:57.712 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:57.711+0000 7f30ce925180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:34:58.348 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:58.347+0000 7fa5a6364180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:34:58.417 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:58.414+0000 7f30ce925180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:34:58.638 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:58.635+0000 7fa5a6364180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:34:58.704 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:58.702+0000 7f30ce925180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:34:58.729 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:58.728+0000 7fa5a6364180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:34:58.799 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:58.796+0000 7f30ce925180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:34:58.883 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:58.882+0000 7fa5a6364180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:34:58.952 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:58.950+0000 7f30ce925180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:34:58.989 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:58.988+0000 7fa5a6364180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:34:59.058 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.055+0000 7f30ce925180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:34:59.179 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:59.179+0000 7fa5a6364180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:34:59.249 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.245+0000 7f30ce925180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:34:59.273 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:59.272+0000 7fa5a6364180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:34:59.340 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.337+0000 7f30ce925180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:34:59.365 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:59.364+0000 7fa5a6364180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:34:59.432 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.430+0000 7f30ce925180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:34:59.459 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:34:59.458+0000 7fa5a6364180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:34:59.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:59.518+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mgrmap(e 101) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f2cb0051ca0 con 0x7f2cb406f0b0 2023-10-10T22:34:59.529 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.527+0000 7f30ce925180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:34:59.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:59.541+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mon.1 v2:172.21.15.179:3300/0 8 ==== mgrmap(e 102) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f2cb0060560 con 0x7f2cb406f0b0 2023-10-10T22:34:59.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:59.541+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 msgr2=0x7f2c98069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:34:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:34:59.541+0000 7f2ca9ffb700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c98069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:34:59.654 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.652+0000 7f3040470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:34:59.657 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.652+0000 7f3040470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:34:59.657 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.652+0000 7f3040470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:34:59.658 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.652+0000 7f3040470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:34:59.658 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.652+0000 7f3040470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:34:59.659 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.653+0000 7f3043c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:34:59.659 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.653+0000 7f3043c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:34:59.659 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.653+0000 7f3043c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:34:59.659 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.653+0000 7f3043c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:34:59.660 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:34:59.653+0000 7f3043c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:35:00.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.543+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mon.1 v2:172.21.15.179:3300/0 9 ==== mgrmap(e 103) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f2cb00115e0 con 0x7f2cb406f0b0 2023-10-10T22:35:00.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.544+0000 7f2ca9ffb700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c980693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:00.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.544+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c98033140 con 0x7f2c98066f80 2023-10-10T22:35:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.546+0000 7f2cb959a700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c980693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:00.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.552+0000 7f2cb959a700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c980693b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2cb415ad40 tx=0x7f2ca4007d50 comp rx=0 tx=0).ready entity=mgr.9220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:35:00.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.620+0000 7f2ca9ffb700 1 -- 172.21.15.154:0/3109970282 <== mgr.9220 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2c98033140 con 0x7f2c98066f80 2023-10-10T22:35:00.623 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path snap_test_dir1 2023-10-10T22:35:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 msgr2=0x7f2c980693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:00.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c980693b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2cb415ad40 tx=0x7f2ca4007d50 comp rx=0 tx=0).stop 2023-10-10T22:35:00.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 msgr2=0x7f2cb40ac650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:00.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 0x7f2cb40ac650 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0006fd0 tx=0x7f2cb0009250 comp rx=0 tx=0).stop 2023-10-10T22:35:00.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 shutdown_connections 2023-10-10T22:35:00.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c98066f80 0x7f2c980693b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:00.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40c19c0 0x7f2cb41699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:00.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cb406f0b0 0x7f2cb40ac650 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:00.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 --2- 172.21.15.154:0/3109970282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cb41597d0 0x7f2cb4156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:00.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 >> 172.21.15.154:0/3109970282 conn(0x7f2cb406adf0 msgr2=0x7f2cb4158400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:35:00.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 shutdown_connections 2023-10-10T22:35:00.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.623+0000 7f2cbad9d700 1 -- 172.21.15.154:0/3109970282 wait complete. 2023-10-10T22:35:00.645 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-10T22:35:00.646 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-10T22:35:00.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.834+0000 7f84cc9fe700 1 Processor -- start 2023-10-10T22:35:00.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.835+0000 7f84cc9fe700 1 -- start start 2023-10-10T22:35:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.836+0000 7f84cc9fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c815a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.836+0000 7f84cc9fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f84c8155860 0x7f84c8155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.836+0000 7f84cc9fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c806e510 con 0x7f84c80c7840 2023-10-10T22:35:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.836+0000 7f84cc9fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c80c7220 con 0x7f84c8155860 2023-10-10T22:35:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.836+0000 7f84cc9fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c806df20 con 0x7f84c80c7c10 2023-10-10T22:35:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.836+0000 7f84c659c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.837+0000 7f84c659c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c815a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:38398/0 (socket says 172.21.15.154:38398) 2023-10-10T22:35:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.837+0000 7f84c659c700 1 -- 172.21.15.154:0/1410618060 learned_addr learned my addr 172.21.15.154:0/1410618060 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:35:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.837+0000 7f84c759e700 1 --2- 172.21.15.154:0/1410618060 >> v2:172.21.15.179:3300/0 conn(0x7f84c8155860 0x7f84c8155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:00.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.837+0000 7f84c659c700 1 -- 172.21.15.154:0/1410618060 >> v2:172.21.15.179:3300/0 conn(0x7f84c8155860 msgr2=0x7f84c8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:35:00.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.837+0000 7f84c659c700 1 --2- 172.21.15.154:0/1410618060 >> v2:172.21.15.179:3300/0 conn(0x7f84c8155860 0x7f84c8155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:00.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.837+0000 7f84c659c700 1 -- 172.21.15.154:0/1410618060 >> v1:172.21.15.179:6789/0 conn(0x7f84c80c7840 legacy=0x7f84c8159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:00.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.837+0000 7f84c659c700 1 -- 172.21.15.154:0/1410618060 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8157040 con 0x7f84c80c7c10 2023-10-10T22:35:00.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.837+0000 7f84c659c700 1 --2- 172.21.15.154:0/1410618060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c815a030 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0099b0 tx=0x7f84bc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76422e8d0cf55d4e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:35:00.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.837+0000 7f84c5d9b700 1 -- 172.21.15.154:0/1410618060 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc009e40 con 0x7f84c80c7c10 2023-10-10T22:35:00.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84c5d9b700 1 -- 172.21.15.154:0/1410618060 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc00b8f0 con 0x7f84c80c7c10 2023-10-10T22:35:00.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84c5d9b700 1 -- 172.21.15.154:0/1410618060 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00bc90 con 0x7f84c80c7c10 2023-10-10T22:35:00.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84cc9fe700 1 -- 172.21.15.154:0/1410618060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 msgr2=0x7f84c815a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:00.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84cc9fe700 1 --2- 172.21.15.154:0/1410618060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c815a030 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0099b0 tx=0x7f84bc009250 comp rx=0 tx=0).stop 2023-10-10T22:35:00.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84cc9fe700 1 -- 172.21.15.154:0/1410618060 shutdown_connections 2023-10-10T22:35:00.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84cc9fe700 1 --2- 172.21.15.154:0/1410618060 >> v2:172.21.15.179:3300/0 conn(0x7f84c8155860 0x7f84c8155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:00.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84cc9fe700 1 --2- 172.21.15.154:0/1410618060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c815a030 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:00.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84cc9fe700 1 -- 172.21.15.154:0/1410618060 >> 172.21.15.154:0/1410618060 conn(0x7f84c8068e20 msgr2=0x7f84c80cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:35:00.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84cc9fe700 1 -- 172.21.15.154:0/1410618060 shutdown_connections 2023-10-10T22:35:00.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.838+0000 7f84cc9fe700 1 -- 172.21.15.154:0/1410618060 wait complete. 2023-10-10T22:35:00.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.840+0000 7f84cc9fe700 1 Processor -- start 2023-10-10T22:35:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.840+0000 7f84cc9fe700 1 -- start start 2023-10-10T22:35:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84cc9fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c80c7840 0x7f84c80c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84cc9fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c814d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84cc9fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84c8155860 0x7f84c80b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84cc9fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80afde0 con 0x7f84c80c7840 2023-10-10T22:35:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84cc9fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80ad8a0 con 0x7f84c8155860 2023-10-10T22:35:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84cc9fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80acf70 con 0x7f84c80c7c10 2023-10-10T22:35:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84c6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c80c7840 0x7f84c80c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84c659c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84c6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c80c7840 0x7f84c80c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36558/0 (socket says 172.21.15.154:36558) 2023-10-10T22:35:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84c6d9d700 1 -- 172.21.15.154:0/449300984 learned_addr learned my addr 172.21.15.154:0/449300984 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:35:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.841+0000 7f84c759e700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84c8155860 0x7f84c80b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84c6d9d700 1 -- 172.21.15.154:0/449300984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 msgr2=0x7f84c814d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84c6d9d700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c814d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:00.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84c6d9d700 1 -- 172.21.15.154:0/449300984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84c8155860 msgr2=0x7f84c80b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84c6d9d700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84c8155860 0x7f84c80b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84c6d9d700 1 -- 172.21.15.154:0/449300984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0094f0 con 0x7f84c80c7840 2023-10-10T22:35:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84c6d9d700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c80c7840 0x7f84c80c8b90 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c590 tx=0x7f84b800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:35:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84aeffd700 1 -- 172.21.15.154:0/449300984 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011590 con 0x7f84c80c7840 2023-10-10T22:35:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84aeffd700 1 -- 172.21.15.154:0/449300984 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8011710 con 0x7f84c80c7840 2023-10-10T22:35:00.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84aeffd700 1 -- 172.21.15.154:0/449300984 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011ad0 con 0x7f84c80c7840 2023-10-10T22:35:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c80ad250 con 0x7f84c80c7840 2023-10-10T22:35:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.842+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c814d6c0 con 0x7f84c80c7840 2023-10-10T22:35:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.843+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c80accc0 con 0x7f84c80c7840 2023-10-10T22:35:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.844+0000 7f84aeffd700 1 -- 172.21.15.154:0/449300984 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 103) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f84b801b3b0 con 0x7f84c80c7840 2023-10-10T22:35:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.845+0000 7f84aeffd700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f84b4066dd0 0x7f84b4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:00.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.845+0000 7f84aeffd700 1 -- 172.21.15.154:0/449300984 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6455+0+0 (secure 0 0 0) 0x7f84b80839a0 con 0x7f84c80c7840 2023-10-10T22:35:00.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.846+0000 7f84c659c700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f84b4066dd0 0x7f84b4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:00.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.846+0000 7f84c659c700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f84b4066dd0 0x7f84b4069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0099b0 tx=0x7f84bc019000 comp rx=0 tx=0).ready entity=mgr.9220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:35:00.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:00.850+0000 7f84aeffd700 1 -- 172.21.15.154:0/449300984 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84b8050bd0 con 0x7f84c80c7840 2023-10-10T22:35:01.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.063+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f84c804c3c0 con 0x7f84b4066dd0 2023-10-10T22:35:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.127+0000 7f84aeffd700 1 -- 172.21.15.154:0/449300984 <== mgr.9220 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f84c804c3c0 con 0x7f84b4066dd0 2023-10-10T22:35:01.129 INFO:teuthology.orchestra.run.smithi154.stdout:Retention added to path snap_test_dir1 2023-10-10T22:35:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.129+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f84b4066dd0 msgr2=0x7f84b4069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.129+0000 7f84cc9fe700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f84b4066dd0 0x7f84b4069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0099b0 tx=0x7f84bc019000 comp rx=0 tx=0).stop 2023-10-10T22:35:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.129+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c80c7840 msgr2=0x7f84c80c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.129+0000 7f84cc9fe700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c80c7840 0x7f84c80c8b90 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c590 tx=0x7f84b800c8a0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.130+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 shutdown_connections 2023-10-10T22:35:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.130+0000 7f84cc9fe700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f84b4066dd0 0x7f84b4069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.130+0000 7f84cc9fe700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84c8155860 0x7f84c80b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.130+0000 7f84cc9fe700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c80c7840 0x7f84c80c8b90 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.130+0000 7f84cc9fe700 1 --2- 172.21.15.154:0/449300984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84c80c7c10 0x7f84c814d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.130+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 >> 172.21.15.154:0/449300984 conn(0x7f84c8068e20 msgr2=0x7f84c80c2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:35:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.130+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 shutdown_connections 2023-10-10T22:35:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.130+0000 7f84cc9fe700 1 -- 172.21.15.154:0/449300984 wait complete. 2023-10-10T22:35:01.149 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-10T22:35:01.149 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-10-22_36_00 in ~59s... 2023-10-10T22:35:01.150 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-10T22:35:01.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-10T22:35:01.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.336+0000 7f277f3ff700 1 Processor -- start 2023-10-10T22:35:01.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.337+0000 7f277f3ff700 1 -- start start 2023-10-10T22:35:01.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.338+0000 7f277f3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2778157740 0x7f27780adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:01.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.338+0000 7f277f3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2778068aa0 0x7f277806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:01.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.338+0000 7f277f3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277806dc20 con 0x7f27780b2100 2023-10-10T22:35:01.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.338+0000 7f277f3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27780acc00 con 0x7f2778157740 2023-10-10T22:35:01.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.338+0000 7f277f3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277806d6a0 con 0x7f2778068aa0 2023-10-10T22:35:01.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.338+0000 7f277d19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2778157740 0x7f27780adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:01.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.338+0000 7f277d19b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2778157740 0x7f27780adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36572/0 (socket says 172.21.15.154:36572) 2023-10-10T22:35:01.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.338+0000 7f277d19b700 1 -- 172.21.15.154:0/1728053052 learned_addr learned my addr 172.21.15.154:0/1728053052 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:35:01.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.338+0000 7f277d99c700 1 --2- 172.21.15.154:0/1728053052 >> v2:172.21.15.179:3300/0 conn(0x7f2778068aa0 0x7f277806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:01.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f277d99c700 1 -- 172.21.15.154:0/1728053052 >> v2:172.21.15.154:3300/0 conn(0x7f2778157740 msgr2=0x7f27780adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:35:01.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f277d99c700 1 --2- 172.21.15.154:0/1728053052 >> v2:172.21.15.154:3300/0 conn(0x7f2778157740 0x7f27780adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f277d99c700 1 -- 172.21.15.154:0/1728053052 >> v1:172.21.15.179:6789/0 conn(0x7f27780b2100 legacy=0x7f2778068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:01.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f277d99c700 1 -- 172.21.15.154:0/1728053052 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780ae910 con 0x7f2778068aa0 2023-10-10T22:35:01.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f277d19b700 1 --2- 172.21.15.154:0/1728053052 >> v2:172.21.15.154:3300/0 conn(0x7f2778157740 0x7f27780adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:35:01.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f276ffff700 1 -- 172.21.15.154:0/1728053052 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032556349 0 0) 0x7f277806dc20 con 0x7f27780b2100 2023-10-10T22:35:01.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f277d99c700 1 --2- 172.21.15.154:0/1728053052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2778068aa0 0x7f277806e0b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f27780c6a50 tx=0x7f2770009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3187c9624d4e5414 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:35:01.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f276ffff700 1 -- 172.21.15.154:0/1728053052 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000e070 con 0x7f2778068aa0 2023-10-10T22:35:01.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f276ffff700 1 -- 172.21.15.154:0/1728053052 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000bb60 con 0x7f2778068aa0 2023-10-10T22:35:01.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.339+0000 7f276ffff700 1 -- 172.21.15.154:0/1728053052 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770012430 con 0x7f2778068aa0 2023-10-10T22:35:01.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.340+0000 7f277f3ff700 1 -- 172.21.15.154:0/1728053052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2778068aa0 msgr2=0x7f277806e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:01.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.340+0000 7f277f3ff700 1 --2- 172.21.15.154:0/1728053052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2778068aa0 0x7f277806e0b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f27780c6a50 tx=0x7f2770009780 comp rx=0 tx=0).stop 2023-10-10T22:35:01.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.340+0000 7f277f3ff700 1 -- 172.21.15.154:0/1728053052 shutdown_connections 2023-10-10T22:35:01.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.340+0000 7f277f3ff700 1 --2- 172.21.15.154:0/1728053052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2778068aa0 0x7f277806e0b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.340+0000 7f277f3ff700 1 --2- 172.21.15.154:0/1728053052 >> v2:172.21.15.154:3300/0 conn(0x7f2778157740 0x7f27780adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.340+0000 7f277f3ff700 1 -- 172.21.15.154:0/1728053052 >> 172.21.15.154:0/1728053052 conn(0x7f27780c8f90 msgr2=0x7f27780c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:35:01.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.340+0000 7f277f3ff700 1 -- 172.21.15.154:0/1728053052 shutdown_connections 2023-10-10T22:35:01.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.340+0000 7f277f3ff700 1 -- 172.21.15.154:0/1728053052 wait complete. 2023-10-10T22:35:01.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.341+0000 7f277f3ff700 1 Processor -- start 2023-10-10T22:35:01.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.341+0000 7f277f3ff700 1 -- start start 2023-10-10T22:35:01.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.342+0000 7f277f3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2778068aa0 0x7f27780b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:01.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.342+0000 7f277f3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27780b2100 0x7f27781467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:01.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.342+0000 7f277f3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2778157740 0x7f27780cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:01.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.342+0000 7f277f3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780b03c0 con 0x7f27780b2100 2023-10-10T22:35:01.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.342+0000 7f277f3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780af740 con 0x7f2778068aa0 2023-10-10T22:35:01.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.342+0000 7f277f3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780afa20 con 0x7f2778157740 2023-10-10T22:35:01.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.342+0000 7f277c99a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27780b2100 0x7f27781467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:01.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.342+0000 7f277c99a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27780b2100 0x7f27781467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36586/0 (socket says 172.21.15.154:36586) 2023-10-10T22:35:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.342+0000 7f277c99a700 1 -- 172.21.15.154:0/3372660195 learned_addr learned my addr 172.21.15.154:0/3372660195 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:35:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277d99c700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2778157740 0x7f27780cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277d19b700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2778068aa0 0x7f27780b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277c99a700 1 -- 172.21.15.154:0/3372660195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2778157740 msgr2=0x7f27780cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277c99a700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2778157740 0x7f27780cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277c99a700 1 -- 172.21.15.154:0/3372660195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2778068aa0 msgr2=0x7f27780b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277c99a700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2778068aa0 0x7f27780b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277c99a700 1 -- 172.21.15.154:0/3372660195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27740094f0 con 0x7f27780b2100 2023-10-10T22:35:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277c99a700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27780b2100 0x7f27781467a0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f276800c7e0 tx=0x7f2768007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:35:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f276d7fa700 1 -- 172.21.15.154:0/3372660195 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27680105c0 con 0x7f27780b2100 2023-10-10T22:35:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f276d7fa700 1 -- 172.21.15.154:0/3372660195 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2768010740 con 0x7f27780b2100 2023-10-10T22:35:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2770009a20 con 0x7f27780b2100 2023-10-10T22:35:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f276d7fa700 1 -- 172.21.15.154:0/3372660195 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768010b00 con 0x7f27780b2100 2023-10-10T22:35:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.343+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27780affe0 con 0x7f27780b2100 2023-10-10T22:35:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.344+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27780b0500 con 0x7f27780b2100 2023-10-10T22:35:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.345+0000 7f276d7fa700 1 -- 172.21.15.154:0/3372660195 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 103) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f276801b3b0 con 0x7f27780b2100 2023-10-10T22:35:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.347+0000 7f276d7fa700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f275c066dd0 0x7f275c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:35:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.347+0000 7f276d7fa700 1 -- 172.21.15.154:0/3372660195 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6455+0+0 (secure 0 0 0) 0x7f2768083ae0 con 0x7f27780b2100 2023-10-10T22:35:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.347+0000 7f277d19b700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f275c066dd0 0x7f275c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:35:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.347+0000 7f277d19b700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f275c066dd0 0x7f275c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2774006d20 tx=0x7f2774009250 comp rx=0 tx=0).ready entity=mgr.9220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:35:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.351+0000 7f276d7fa700 1 -- 172.21.15.154:0/3372660195 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27780b0500 con 0x7f27780b2100 2023-10-10T22:35:01.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.573+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27780b0500 con 0x7f275c066dd0 2023-10-10T22:35:01.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.583+0000 7f276d7fa700 1 -- 172.21.15.154:0/3372660195 <== mgr.9220 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f27780b0500 con 0x7f275c066dd0 2023-10-10T22:35:01.584 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:35:01.584 INFO:teuthology.orchestra.run.smithi154.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-10T22:35:01.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f275c066dd0 msgr2=0x7f275c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:01.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f275c066dd0 0x7f275c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2774006d20 tx=0x7f2774009250 comp rx=0 tx=0).stop 2023-10-10T22:35:01.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27780b2100 msgr2=0x7f27781467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:35:01.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27780b2100 0x7f27781467a0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f276800c7e0 tx=0x7f2768007df0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 shutdown_connections 2023-10-10T22:35:01.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f275c066dd0 0x7f275c069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2778157740 0x7f27780cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2778068aa0 0x7f27780b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 --2- 172.21.15.154:0/3372660195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27780b2100 0x7f27781467a0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:35:01.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 >> 172.21.15.154:0/3372660195 conn(0x7f27780c8f90 msgr2=0x7f2778156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:35:01.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.585+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 shutdown_connections 2023-10-10T22:35:01.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:35:01.586+0000 7f277f3ff700 1 -- 172.21.15.154:0/3372660195 wait complete. 2023-10-10T22:35:01.605 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-10T22:35:01.605 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-10T22:35:01.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:01.606 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:01.646 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:01.647 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:01.647 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:02.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:02.649 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:02.693 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:02.693 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:02.693 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:03.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:03.695 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:03.739 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:03.739 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:03.739 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:04.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:04.741 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:04.785 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:04.785 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:04.785 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:05.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:05.787 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:05.831 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:05.832 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:05.832 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:06.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:06.834 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:06.878 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:06.878 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:06.879 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:07.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:07.880 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:07.924 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:07.924 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:07.925 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:08.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:08.927 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:08.970 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:08.971 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:08.971 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:09.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:09.973 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:10.016 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:10.017 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:10.017 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:11.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:11.018 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:11.061 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:11.062 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:11.062 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:12.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:12.064 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:12.107 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:12.107 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:12.108 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:13.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:13.110 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:13.153 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:13.153 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:13.154 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:14.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:14.155 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:14.198 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:14.199 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:14.199 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:14.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:35:14.420 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:35:15.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:15.201 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:15.244 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:15.245 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:15.245 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:16.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:16.247 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:16.291 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:16.292 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:16.292 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:17.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:17.294 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:17.337 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:17.337 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:17.338 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:18.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:18.339 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:18.384 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:18.384 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:18.385 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:19.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:19.387 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:19.430 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:19.430 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:19.431 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:20.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:20.432 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:20.475 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:20.476 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:20.476 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:21.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:21.478 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:21.521 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:21.522 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:21.522 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:22.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:22.523 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:22.567 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:22.568 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:22.568 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:23.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:23.569 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:23.613 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:23.614 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:23.614 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:24.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:24.616 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:24.660 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:24.661 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:24.661 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:25.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:25.663 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:25.707 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:25.708 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:25.708 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:26.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:26.710 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:26.755 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:26.755 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:26.756 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:27.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:27.758 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:27.802 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:27.802 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:27.803 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:28.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:28.804 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:28.848 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:28.849 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:28.849 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:29.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:29.851 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:29.895 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:29.895 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:29.895 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:30.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:30.897 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:30.941 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:30.942 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:30.942 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:31.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:31.944 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:31.989 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:31.989 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:31.989 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:32.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:32.991 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:33.035 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:33.035 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:33.036 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:34.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:34.037 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:34.080 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:34.081 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:34.081 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:35.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:35.083 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:35.126 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:35.127 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:35.127 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:36.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:36.130 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:36.173 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:36.173 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:36.173 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:37.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:37.175 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:37.219 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:37.220 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:37.220 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:38.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:38.222 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:38.265 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:38.266 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:38.266 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:39.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:39.268 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:39.312 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:39.313 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:39.313 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:40.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:40.315 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:40.359 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:40.359 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:40.360 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:41.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:41.362 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:41.406 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:41.406 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:41.407 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:42.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:42.408 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:42.452 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:42.452 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:42.453 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:43.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:43.454 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:43.498 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:43.499 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:43.499 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:44.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:44.501 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:44.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:35:44.545 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:44.545 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:44.546 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:44.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:35:45.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:45.548 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:45.594 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:45.595 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:45.595 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:46.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:46.597 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:46.641 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:46.641 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:46.642 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:47.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:47.643 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:47.687 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:47.687 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:47.688 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:48.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:48.689 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:48.732 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:48.733 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:48.733 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:49.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:49.735 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:49.779 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:49.779 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:49.779 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:50.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:50.780 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:50.824 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:50.825 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:50.825 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:51.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:51.827 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:51.871 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:51.872 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:51.872 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:52.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:52.874 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:52.917 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:52.918 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:52.918 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:53.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:53.920 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:53.963 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:53.963 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:53.964 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:54.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:54.965 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:55.009 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:55.009 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:55.010 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:56.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:56.012 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:56.055 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:56.056 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:56.056 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:57.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:57.058 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:57.101 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:57.102 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:57.102 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:58.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:58.104 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:58.148 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:58.148 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:58.149 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:35:59.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:35:59.154 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:35:59.198 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-10T22:35:59.199 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:35:59.199 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:00.142 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:36:00.141+0000 7f3032c55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:36:00.143 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:36:00.141+0000 7f3032c55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:36:00.143 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:36:00.141+0000 7f3032c55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:36:00.143 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:36:00.141+0000 7f3032c55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:36:00.143 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:36:00.141+0000 7f3032c55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:36:00.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:00.201 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:00.243 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:00.244 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:00.244 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:00.245 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:00.245 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-10-22_36_00_UTC'] 2023-10-10T22:36:00.245 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696977301.1498144, now = 1696977360.245872, timo = 59 2023-10-10T22:36:01.247 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-10-10-22_36_00 in ~119s... 2023-10-10T22:36:01.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:01.248 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:01.290 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:01.291 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:01.292 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:01.292 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:02.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:02.294 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:02.336 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:02.338 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:02.338 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:02.338 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:03.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:03.340 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:03.383 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:03.384 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:03.384 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:03.385 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:04.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:04.387 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:04.429 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:04.430 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:04.431 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:04.431 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:05.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:05.433 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:05.474 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:05.475 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:05.476 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:05.476 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:06.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:06.477 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:06.520 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:06.521 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:06.522 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:06.522 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:07.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:07.524 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:07.566 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:07.567 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:07.569 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:07.569 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:08.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:08.571 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:08.613 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:08.615 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:08.615 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:08.615 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:09.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:09.617 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:09.662 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:09.664 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:09.664 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:09.664 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:10.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:10.666 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:10.709 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:10.710 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:10.710 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:10.711 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:11.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:11.713 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:11.755 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:11.756 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:11.757 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:11.757 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:12.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:12.759 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:12.801 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:12.802 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:12.802 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:12.803 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:13.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:13.804 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:13.849 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:13.849 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:13.849 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:13.850 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:14.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:36:14.776 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:36:14.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:14.852 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:14.890 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:14.891 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:14.892 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:14.892 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:15.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:15.894 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:15.937 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:15.938 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:15.938 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:15.938 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:16.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:16.940 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:16.982 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:16.984 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:16.984 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:16.984 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:17.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:17.986 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:18.028 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:18.030 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:18.031 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:18.031 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:19.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:19.033 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:19.076 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:19.077 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:19.078 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:19.078 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:20.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:20.080 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:20.122 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:20.123 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:20.123 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:20.124 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:21.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:21.125 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:21.168 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:21.169 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:21.169 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:21.169 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:22.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:22.171 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:22.213 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:22.215 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:22.215 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:22.215 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:23.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:23.217 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:23.259 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:23.260 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:23.261 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:23.261 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:24.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:24.263 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:24.305 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:24.306 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:24.307 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:24.307 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:25.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:25.309 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:25.352 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:25.353 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:25.353 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:25.354 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:26.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:26.355 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:26.398 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:26.399 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:26.399 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:26.400 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:27.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:27.401 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:27.444 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:27.445 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:27.446 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:27.446 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:28.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:28.448 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:28.490 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:28.491 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:28.492 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:28.492 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:29.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:29.494 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:29.536 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:29.537 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:29.538 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:29.538 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:30.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:30.542 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:30.586 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:30.587 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:30.588 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:30.588 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:31.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:31.590 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:31.634 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:31.634 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:31.635 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:32.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:32.637 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:32.679 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:32.680 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:32.681 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:32.681 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:33.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:33.683 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:33.726 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:33.727 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:33.727 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:33.728 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:34.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:34.729 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:34.771 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:34.773 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:34.773 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:34.773 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:35.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:35.775 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:35.817 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:35.819 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:35.819 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:35.819 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:36.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:36.821 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:36.864 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:36.865 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:36.865 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:36.866 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:37.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:37.867 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:37.910 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:37.911 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:37.912 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:37.912 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:38.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:38.914 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:38.956 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:38.958 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:38.958 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:38.958 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:39.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:39.960 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:40.003 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:40.004 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:40.005 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:40.005 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:41.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:41.006 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:41.049 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:41.050 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:41.050 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:41.051 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:42.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:42.053 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:42.096 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:42.097 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:42.097 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:42.098 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:43.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:43.100 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:43.146 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:43.147 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:43.147 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:43.148 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:44.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:44.150 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:44.194 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:44.195 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:44.196 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:44.196 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:44.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:36:44.956 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:36:45.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:45.197 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:45.238 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:45.239 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:45.239 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:45.239 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:46.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:46.241 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:46.284 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:46.286 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:46.286 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:46.286 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:47.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:47.288 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:47.331 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:47.332 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:47.332 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:47.333 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:48.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:48.334 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:48.377 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:48.379 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:48.379 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:48.380 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:49.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:49.381 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:49.424 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:49.426 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:49.426 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:49.427 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:50.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:50.428 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:50.471 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:50.472 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:50.472 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:50.473 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:51.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:51.474 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:51.518 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:51.522 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:51.523 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:51.523 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:52.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:52.525 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:52.568 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:52.569 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:52.570 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:52.570 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:53.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:53.572 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:53.613 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:53.614 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:53.615 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:53.615 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:54.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:54.617 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:54.660 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:54.661 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:54.661 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:54.662 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:55.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:55.664 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:55.707 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:55.708 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:55.708 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:55.709 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:56.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:56.710 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:56.753 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:56.754 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:56.754 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:56.755 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:57.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:57.756 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:57.798 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:57.799 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:57.799 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:57.800 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:58.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:58.801 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:58.843 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:58.845 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:58.845 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:58.845 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:36:59.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:36:59.847 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:36:59.889 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_36_00_UTC 2023-10-10T22:36:59.891 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:36:59.891 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-10T22:36:59.891 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-10T22:37:00.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:37:00.893 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:37:00.936 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_37_00_UTC 2023-10-10T22:37:00.937 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-10-22_37_00_UTC'} 2023-10-10T22:37:00.937 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-10-22_37_00_UTC'} 2023-10-10T22:37:00.938 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-10-10-22_36_00_UTC'} 2023-10-10T22:37:00.938 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-10-10-22_36_00_UTC'] 2023-10-10T22:37:00.938 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696977301.1498144, now = 1696977420.9387918, timo = 119 2023-10-10T22:37:01.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-10T22:37:02.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.135+0000 7fcfc47ff700 1 Processor -- start 2023-10-10T22:37:02.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.135+0000 7fcfc47ff700 1 -- start start 2023-10-10T22:37:02.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.136+0000 7fcfc47ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcfbc069a50 0x7fcfbc0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.136+0000 7fcfc47ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc0c8490 0x7fcfbc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.136+0000 7fcfc47ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcfbc069e20 0x7fcfbc06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.136+0000 7fcfc47ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc0ac030 con 0x7fcfbc069a50 2023-10-10T22:37:02.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.136+0000 7fcfc47ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc0ab820 con 0x7fcfbc069e20 2023-10-10T22:37:02.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.136+0000 7fcfc47ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc06dbb0 con 0x7fcfbc0c8490 2023-10-10T22:37:02.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc259b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcfbc069a50 0x7fcfbc0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc259b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcfbc069a50 0x7fcfbc0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48626/0 (socket says 172.21.15.154:48626) 2023-10-10T22:37:02.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc259b700 1 -- 172.21.15.154:0/3390614200 learned_addr learned my addr 172.21.15.154:0/3390614200 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:02.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc2d9c700 1 --2- 172.21.15.154:0/3390614200 >> v2:172.21.15.179:3300/0 conn(0x7fcfbc069e20 0x7fcfbc06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc1d9a700 1 --2- 172.21.15.154:0/3390614200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc0c8490 0x7fcfbc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc259b700 1 -- 172.21.15.154:0/3390614200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc0c8490 msgr2=0x7fcfbc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:02.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc259b700 1 --2- 172.21.15.154:0/3390614200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc0c8490 0x7fcfbc15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc259b700 1 -- 172.21.15.154:0/3390614200 >> v2:172.21.15.179:3300/0 conn(0x7fcfbc069e20 msgr2=0x7fcfbc06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:02.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc259b700 1 --2- 172.21.15.154:0/3390614200 >> v2:172.21.15.179:3300/0 conn(0x7fcfbc069e20 0x7fcfbc06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc259b700 1 -- 172.21.15.154:0/3390614200 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc15a9d0 con 0x7fcfbc069a50 2023-10-10T22:37:02.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.137+0000 7fcfc259b700 1 --2- 172.21.15.154:0/3390614200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc069a50 0x7fcfbc0c6ac0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80099b0 tx=0x7fcfb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c0bf69f5ab4e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:02.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc1599700 1 -- 172.21.15.154:0/3390614200 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb800b820 con 0x7fcfbc069a50 2023-10-10T22:37:02.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc1599700 1 -- 172.21.15.154:0/3390614200 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb800b980 con 0x7fcfbc069a50 2023-10-10T22:37:02.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc1599700 1 -- 172.21.15.154:0/3390614200 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb800bd20 con 0x7fcfbc069a50 2023-10-10T22:37:02.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3390614200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc069a50 msgr2=0x7fcfbc0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:02.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3390614200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc069a50 0x7fcfbc0c6ac0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80099b0 tx=0x7fcfb8009250 comp rx=0 tx=0).stop 2023-10-10T22:37:02.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3390614200 shutdown_connections 2023-10-10T22:37:02.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3390614200 >> v2:172.21.15.179:3300/0 conn(0x7fcfbc069e20 0x7fcfbc06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3390614200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc069a50 0x7fcfbc0c6ac0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3390614200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc0c8490 0x7fcfbc15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3390614200 >> 172.21.15.154:0/3390614200 conn(0x7fcfbc0c8f90 msgr2=0x7fcfbc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:02.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3390614200 shutdown_connections 2023-10-10T22:37:02.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.138+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3390614200 wait complete. 2023-10-10T22:37:02.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.140+0000 7fcfc47ff700 1 Processor -- start 2023-10-10T22:37:02.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.140+0000 7fcfc47ff700 1 -- start start 2023-10-10T22:37:02.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc47ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc069a50 0x7fcfbc154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc47ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc069e20 0x7fcfbc0c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc47ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc0c8490 0x7fcfbc156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc47ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc1682b0 con 0x7fcfbc0c8490 2023-10-10T22:37:02.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc47ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0bfad0 con 0x7fcfbc069a50 2023-10-10T22:37:02.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc47ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc1564f0 con 0x7fcfbc069e20 2023-10-10T22:37:02.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc2d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc0c8490 0x7fcfbc156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc2d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc0c8490 0x7fcfbc156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48636/0 (socket says 172.21.15.154:48636) 2023-10-10T22:37:02.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc2d9c700 1 -- 172.21.15.154:0/3163165356 learned_addr learned my addr 172.21.15.154:0/3163165356 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:02.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc259b700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc069a50 0x7fcfbc154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.141+0000 7fcfc1d9a700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc069e20 0x7fcfbc0c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc2d9c700 1 -- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc069e20 msgr2=0x7fcfbc0c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:02.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc2d9c700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc069e20 0x7fcfbc0c2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc2d9c700 1 -- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc069a50 msgr2=0x7fcfbc154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:02.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc2d9c700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc069a50 0x7fcfbc154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc2d9c700 1 -- 172.21.15.154:0/3163165356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80094f0 con 0x7fcfbc0c8490 2023-10-10T22:37:02.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc1d9a700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc069e20 0x7fcfbc0c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:02.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc259b700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc069a50 0x7fcfbc154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:02.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc2d9c700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc0c8490 0x7fcfbc156e10 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009fa0 tx=0x7fcfb4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:02.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfb27fc700 1 -- 172.21.15.154:0/3163165356 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb400ed20 con 0x7fcfbc0c8490 2023-10-10T22:37:02.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfb27fc700 1 -- 172.21.15.154:0/3163165356 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb400ee80 con 0x7fcfbc0c8490 2023-10-10T22:37:02.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfb27fc700 1 -- 172.21.15.154:0/3163165356 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4014670 con 0x7fcfbc0c8490 2023-10-10T22:37:02.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc1567d0 con 0x7fcfbc0c8490 2023-10-10T22:37:02.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.142+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc0c0000 con 0x7fcfbc0c8490 2023-10-10T22:37:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.143+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc0c0220 con 0x7fcfbc0c8490 2023-10-10T22:37:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.144+0000 7fcfb27fc700 1 -- 172.21.15.154:0/3163165356 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 106) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fcfb40149e0 con 0x7fcfbc0c8490 2023-10-10T22:37:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.145+0000 7fcfb27fc700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcfa00670a0 0x7fcfa0069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.145+0000 7fcfb27fc700 1 -- 172.21.15.154:0/3163165356 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6455+0+0 (secure 0 0 0) 0x7fcfb4085190 con 0x7fcfbc0c8490 2023-10-10T22:37:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.145+0000 7fcfc259b700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcfa00670a0 0x7fcfa0069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.146+0000 7fcfc259b700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcfa00670a0 0x7fcfa0069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80099b0 tx=0x7fcfb8017000 comp rx=0 tx=0).ready entity=mgr.9220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:02.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.150+0000 7fcfb27fc700 1 -- 172.21.15.154:0/3163165356 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfb4051f60 con 0x7fcfbc0c8490 2023-10-10T22:37:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.368+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfbc0718b0 con 0x7fcfa00670a0 2023-10-10T22:37:02.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.447+0000 7fcfb27fc700 1 -- 172.21.15.154:0/3163165356 <== mgr.9220 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcfbc0718b0 con 0x7fcfa00670a0 2023-10-10T22:37:02.449 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path snap_test_dir1 2023-10-10T22:37:02.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.449+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcfa00670a0 msgr2=0x7fcfa0069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:02.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.449+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcfa00670a0 0x7fcfa0069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80099b0 tx=0x7fcfb8017000 comp rx=0 tx=0).stop 2023-10-10T22:37:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.449+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc0c8490 msgr2=0x7fcfbc156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.449+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc0c8490 0x7fcfbc156e10 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009fa0 tx=0x7fcfb4009900 comp rx=0 tx=0).stop 2023-10-10T22:37:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.449+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 shutdown_connections 2023-10-10T22:37:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.449+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fcfa00670a0 0x7fcfa0069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.449+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfbc0c8490 0x7fcfbc156e10 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.449+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc069a50 0x7fcfbc154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.449+0000 7fcfc47ff700 1 --2- 172.21.15.154:0/3163165356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfbc069e20 0x7fcfbc0c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.450+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 >> 172.21.15.154:0/3163165356 conn(0x7fcfbc0c8f90 msgr2=0x7fcfbc0cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.450+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 shutdown_connections 2023-10-10T22:37:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.450+0000 7fcfc47ff700 1 -- 172.21.15.154:0/3163165356 wait complete. 2023-10-10T22:37:02.468 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-10T22:37:02.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:37:02.470 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:37:02.508 INFO:teuthology.orchestra.run.smithi154.stdout:scheduled-2023-10-10-22_37_00_UTC 2023-10-10T22:37:02.509 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-10-22_37_00_UTC 2023-10-10T22:37:02.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:37:02.510 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-10-22_37_00_UTC) 2023-10-10T22:37:02.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:37:02.593 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-10T22:37:02.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T22:37:02.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.896+0000 7f8ec6d9d700 1 Processor -- start 2023-10-10T22:37:02.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.897+0000 7f8ec6d9d700 1 -- start start 2023-10-10T22:37:02.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.898+0000 7f8ec6d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec0153900 0x7f8ec00c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.898+0000 7f8ec6d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ec00c9db0 0x7f8ec006a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.898+0000 7f8ec6d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec006e150 con 0x7f8ec0157130 2023-10-10T22:37:02.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.898+0000 7f8ec6d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec00c7800 con 0x7f8ec00c9db0 2023-10-10T22:37:02.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.898+0000 7f8ec6d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00c7ae0 con 0x7f8ec0153900 2023-10-10T22:37:02.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.898+0000 7f8ec659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8ec0157130 0x7f8ec0159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50520/0 (socket says 172.21.15.154:50520) 2023-10-10T22:37:02.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.898+0000 7f8ec659c700 1 -- 172.21.15.154:0/405596746 learned_addr learned my addr 172.21.15.154:0/405596746 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:02.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec559a700 1 --2- 172.21.15.154:0/405596746 >> v2:172.21.15.179:3300/0 conn(0x7f8ec00c9db0 0x7f8ec006a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec5d9b700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec0153900 0x7f8ec00c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609882660 0 0) 0x7f8ec006e150 con 0x7f8ec0157130 2023-10-10T22:37:02.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eac003570 con 0x7f8ec0157130 2023-10-10T22:37:02.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 309044682 0 0) 0x7f8eac003570 con 0x7f8ec0157130 2023-10-10T22:37:02.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec0153900 msgr2=0x7f8ec00c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:02.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec0153900 0x7f8ec00c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 >> v2:172.21.15.179:3300/0 conn(0x7f8ec00c9db0 msgr2=0x7f8ec006a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:02.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 --2- 172.21.15.154:0/405596746 >> v2:172.21.15.179:3300/0 conn(0x7f8ec00c9db0 0x7f8ec006a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec00c7dc0 con 0x7f8ec0157130 2023-10-10T22:37:02.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f8eb80017f0 con 0x7f8ec0157130 2023-10-10T22:37:02.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec559a700 1 --2- 172.21.15.154:0/405596746 >> v2:172.21.15.179:3300/0 conn(0x7f8ec00c9db0 0x7f8ec006a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:02.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 >> v1:172.21.15.154:6789/0 conn(0x7f8ec0157130 legacy=0x7f8ec0159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:02.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eac003a60 0x7f8eac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8eac004810 0x7f8eac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8eac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00c7800 con 0x7f8eac0051c0 2023-10-10T22:37:02.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00c7ae0 con 0x7f8eac003a60 2023-10-10T22:37:02.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac00e1b0 con 0x7f8eac004810 2023-10-10T22:37:02.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.899+0000 7f8ec5d9b700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec0153900 0x7f8ec00c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:02.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.900+0000 7f8ec659c700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8eac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.900+0000 7f8ec559a700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8eac004810 0x7f8eac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.900+0000 7f8ec5d9b700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eac003a60 0x7f8eac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.900+0000 7f8ec659c700 1 -- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8eac004810 msgr2=0x7f8eac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:02.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.900+0000 7f8ec659c700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8eac004810 0x7f8eac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.900+0000 7f8ec659c700 1 -- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eac003a60 msgr2=0x7f8eac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:02.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.900+0000 7f8ec659c700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eac003a60 0x7f8eac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.900+0000 7f8ec659c700 1 -- 172.21.15.154:0/405596746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac003570 con 0x7f8eac0051c0 2023-10-10T22:37:02.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.900+0000 7f8ec659c700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8eac00ba60 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800a940 tx=0x7f8eb8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636f8495cf1681f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:02.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8012440 con 0x7f8eac0051c0 2023-10-10T22:37:02.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb80125c0 con 0x7f8eac0051c0 2023-10-10T22:37:02.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec4d99700 1 -- 172.21.15.154:0/405596746 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8012980 con 0x7f8eac0051c0 2023-10-10T22:37:02.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/405596746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 msgr2=0x7f8eac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:02.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec6d9d700 1 --2- 172.21.15.154:0/405596746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8eac00ba60 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800a940 tx=0x7f8eb8002210 comp rx=0 tx=0).stop 2023-10-10T22:37:02.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec659c700 1 -- 172.21.15.154:0/405596746 reap_dead start 2023-10-10T22:37:02.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/405596746 shutdown_connections 2023-10-10T22:37:02.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/405596746 >> 172.21.15.154:0/405596746 conn(0x7f8ec00cc1e0 msgr2=0x7f8ec00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:02.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/405596746 shutdown_connections 2023-10-10T22:37:02.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.901+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/405596746 wait complete. 2023-10-10T22:37:02.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.903+0000 7f8ec6d9d700 1 Processor -- start 2023-10-10T22:37:02.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.903+0000 7f8ec6d9d700 1 -- start start 2023-10-10T22:37:02.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8ec014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec6d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec00aef80 0x7f8ec00cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ec00af3f0 0x7f8ec00cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec6d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0158970 con 0x7f8eac0051c0 2023-10-10T22:37:02.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec6d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0157d60 con 0x7f8ec00af3f0 2023-10-10T22:37:02.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec6d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0158040 con 0x7f8ec00aef80 2023-10-10T22:37:02.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8ec014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8ec014e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48660/0 (socket says 172.21.15.154:48660) 2023-10-10T22:37:02.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec5d9b700 1 -- 172.21.15.154:0/2404575821 learned_addr learned my addr 172.21.15.154:0/2404575821 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:02.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec559a700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec00aef80 0x7f8ec00cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec659c700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ec00af3f0 0x7f8ec00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec5d9b700 1 -- 172.21.15.154:0/2404575821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec00aef80 msgr2=0x7f8ec00cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:02.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec5d9b700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec00aef80 0x7f8ec00cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec5d9b700 1 -- 172.21.15.154:0/2404575821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ec00af3f0 msgr2=0x7f8ec00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:02.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec5d9b700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ec00af3f0 0x7f8ec00cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:02.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec5d9b700 1 -- 172.21.15.154:0/2404575821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0158320 con 0x7f8eac0051c0 2023-10-10T22:37:02.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.904+0000 7f8ec659c700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ec00af3f0 0x7f8ec00cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:02.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.905+0000 7f8ec5d9b700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8ec014e890 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc011d20 tx=0x7f8ebc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:02.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.905+0000 7f8eb5ffb700 1 -- 172.21.15.154:0/2404575821 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00fac0 con 0x7f8eac0051c0 2023-10-10T22:37:02.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.905+0000 7f8eb5ffb700 1 -- 172.21.15.154:0/2404575821 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc00fc20 con 0x7f8eac0051c0 2023-10-10T22:37:02.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.905+0000 7f8eb5ffb700 1 -- 172.21.15.154:0/2404575821 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc01d480 con 0x7f8eac0051c0 2023-10-10T22:37:02.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.905+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec0158600 con 0x7f8eac0051c0 2023-10-10T22:37:02.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.905+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec0158e00 con 0x7f8eac0051c0 2023-10-10T22:37:02.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.906+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec006c450 con 0x7f8eac0051c0 2023-10-10T22:37:02.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.907+0000 7f8eb5ffb700 1 -- 172.21.15.154:0/2404575821 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 106) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f8ebc014440 con 0x7f8eac0051c0 2023-10-10T22:37:02.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.908+0000 7f8eb5ffb700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8ea40670a0 0x7f8ea4069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:02.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.908+0000 7f8eb5ffb700 1 -- 172.21.15.154:0/2404575821 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6455+0+0 (secure 0 0 0) 0x7f8ebc018070 con 0x7f8eac0051c0 2023-10-10T22:37:02.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.908+0000 7f8ec559a700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8ea40670a0 0x7f8ea4069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:02.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.908+0000 7f8ec559a700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8ea40670a0 0x7f8ea4069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006b90 tx=0x7f8eb0008040 comp rx=0 tx=0).ready entity=mgr.9220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:02.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:02.912+0000 7f8eb5ffb700 1 -- 172.21.15.154:0/2404575821 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ebc0527c0 con 0x7f8eac0051c0 2023-10-10T22:37:03.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.153+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f8ec006dd20 con 0x7f8eac0051c0 2023-10-10T22:37:03.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.504+0000 7f8eb5ffb700 1 -- 172.21.15.154:0/2404575821 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f8ebc052b90 con 0x7f8eac0051c0 2023-10-10T22:37:03.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.505+0000 7f8eb5ffb700 1 -- 172.21.15.154:0/2404575821 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v107) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8ebc083750 con 0x7f8eac0051c0 2023-10-10T22:37:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.507+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8ea40670a0 msgr2=0x7f8ea4069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.507+0000 7f8ec6d9d700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8ea40670a0 0x7f8ea4069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006b90 tx=0x7f8eb0008040 comp rx=0 tx=0).stop 2023-10-10T22:37:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.507+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 msgr2=0x7f8ec014e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.507+0000 7f8ec6d9d700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8ec014e890 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc011d20 tx=0x7f8ebc0091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.507+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 shutdown_connections 2023-10-10T22:37:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.507+0000 7f8ec6d9d700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8ea40670a0 0x7f8ea4069550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.507+0000 7f8ec6d9d700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ec00af3f0 0x7f8ec00cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.508+0000 7f8ec6d9d700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac0051c0 0x7f8ec014e890 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.508+0000 7f8ec6d9d700 1 --2- 172.21.15.154:0/2404575821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ec00aef80 0x7f8ec00cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.508+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 >> 172.21.15.154:0/2404575821 conn(0x7f8ec00cc1e0 msgr2=0x7f8ec0151bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.508+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 shutdown_connections 2023-10-10T22:37:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:03.508+0000 7f8ec6d9d700 1 -- 172.21.15.154:0/2404575821 wait complete. 2023-10-10T22:37:03.529 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T22:37:03.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:37:03.625 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:37:03.707 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T22:37:03.708 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T22:37:03.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:37:03.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T22:37:03.796 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:37:03.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:03.797 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T22:37:03.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:04.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.061+0000 7f5a5299d700 1 Processor -- start 2023-10-10T22:37:04.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.061+0000 7f5a5299d700 1 -- start start 2023-10-10T22:37:04.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.062+0000 7f5a5299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c159420 0x7f5a4c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.062+0000 7f5a5299d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a4c15d230 0x7f5a4c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5299d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c15dbd0 con 0x7f5a4c1597f0 2023-10-10T22:37:04.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5299d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c0b2980 con 0x7f5a4c15d230 2023-10-10T22:37:04.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0b11d0 con 0x7f5a4c159420 2023-10-10T22:37:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5219c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a4c15d230 0x7f5a4c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5219c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a4c15d230 0x7f5a4c15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48686/0 (socket says 172.21.15.154:48686) 2023-10-10T22:37:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5219c700 1 -- 172.21.15.154:0/928573218 learned_addr learned my addr 172.21.15.154:0/928573218 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5199b700 1 --2- 172.21.15.154:0/928573218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c159420 0x7f5a4c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5219c700 1 -- 172.21.15.154:0/928573218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c159420 msgr2=0x7f5a4c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5219c700 1 --2- 172.21.15.154:0/928573218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c159420 0x7f5a4c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5219c700 1 -- 172.21.15.154:0/928573218 >> v1:172.21.15.179:6789/0 conn(0x7f5a4c1597f0 legacy=0x7f5a4c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a5219c700 1 -- 172.21.15.154:0/928573218 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0b14b0 con 0x7f5a4c15d230 2023-10-10T22:37:04.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.063+0000 7f5a50999700 1 -- 172.21.15.154:0/928573218 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135303896 0 0) 0x7f5a3c001110 con 0x7f5a4c1597f0 2023-10-10T22:37:04.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.064+0000 7f5a5219c700 1 --2- 172.21.15.154:0/928573218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c15d230 0x7f5a4c15d690 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009f20 tx=0x7f5a44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643523c0a8a9862d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:04.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.064+0000 7f5a50999700 1 -- 172.21.15.154:0/928573218 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4400e070 con 0x7f5a4c15d230 2023-10-10T22:37:04.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.064+0000 7f5a50999700 1 -- 172.21.15.154:0/928573218 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4400b9d0 con 0x7f5a4c15d230 2023-10-10T22:37:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.064+0000 7f5a50999700 1 -- 172.21.15.154:0/928573218 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a440092e0 con 0x7f5a4c15d230 2023-10-10T22:37:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.064+0000 7f5a5299d700 1 -- 172.21.15.154:0/928573218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c15d230 msgr2=0x7f5a4c15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.064+0000 7f5a5299d700 1 --2- 172.21.15.154:0/928573218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c15d230 0x7f5a4c15d690 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009f20 tx=0x7f5a44009840 comp rx=0 tx=0).stop 2023-10-10T22:37:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.065+0000 7f5a5299d700 1 -- 172.21.15.154:0/928573218 shutdown_connections 2023-10-10T22:37:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.065+0000 7f5a5299d700 1 --2- 172.21.15.154:0/928573218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c15d230 0x7f5a4c15d690 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.065+0000 7f5a5299d700 1 --2- 172.21.15.154:0/928573218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c159420 0x7f5a4c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.065+0000 7f5a5299d700 1 -- 172.21.15.154:0/928573218 >> 172.21.15.154:0/928573218 conn(0x7f5a4c0d0660 msgr2=0x7f5a4c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:04.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.065+0000 7f5a5299d700 1 -- 172.21.15.154:0/928573218 shutdown_connections 2023-10-10T22:37:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.065+0000 7f5a5299d700 1 -- 172.21.15.154:0/928573218 wait complete. 2023-10-10T22:37:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.066+0000 7f5a5299d700 1 Processor -- start 2023-10-10T22:37:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.066+0000 7f5a5299d700 1 -- start start 2023-10-10T22:37:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5299d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c159420 0x7f5a4c16a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4c1597f0 0x7f5a4c16c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c15d230 0x7f5a4c15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5299d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c15ba00 con 0x7f5a4c159420 2023-10-10T22:37:04.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c15ab30 con 0x7f5a4c1597f0 2023-10-10T22:37:04.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c159fb0 con 0x7f5a4c15d230 2023-10-10T22:37:04.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c159420 0x7f5a4c16a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c159420 0x7f5a4c16a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48702/0 (socket says 172.21.15.154:48702) 2023-10-10T22:37:04.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5199b700 1 -- 172.21.15.154:0/648009347 learned_addr learned my addr 172.21.15.154:0/648009347 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:04.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5219c700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c15d230 0x7f5a4c15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.067+0000 7f5a5119a700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4c1597f0 0x7f5a4c16c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a5199b700 1 -- 172.21.15.154:0/648009347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c15d230 msgr2=0x7f5a4c15c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a5199b700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c15d230 0x7f5a4c15c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a5199b700 1 -- 172.21.15.154:0/648009347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4c1597f0 msgr2=0x7f5a4c16c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a5199b700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4c1597f0 0x7f5a4c16c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a5199b700 1 -- 172.21.15.154:0/648009347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a44009ae0 con 0x7f5a4c159420 2023-10-10T22:37:04.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a5119a700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4c1597f0 0x7f5a4c16c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:04.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a5199b700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c159420 0x7f5a4c16a9b0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800ec80 tx=0x7f5a480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:04.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a41ffb700 1 -- 172.21.15.154:0/648009347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800c850 con 0x7f5a4c159420 2023-10-10T22:37:04.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a41ffb700 1 -- 172.21.15.154:0/648009347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4800c9b0 con 0x7f5a4c159420 2023-10-10T22:37:04.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c15a290 con 0x7f5a4c159420 2023-10-10T22:37:04.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a41ffb700 1 -- 172.21.15.154:0/648009347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800cd50 con 0x7f5a4c159420 2023-10-10T22:37:04.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.068+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c15a850 con 0x7f5a4c159420 2023-10-10T22:37:04.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.069+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c169980 con 0x7f5a4c159420 2023-10-10T22:37:04.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.070+0000 7f5a41ffb700 1 -- 172.21.15.154:0/648009347 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f5a48013680 con 0x7f5a4c159420 2023-10-10T22:37:04.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.071+0000 7f5a41ffb700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5a30067050 0x7f5a30069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.071+0000 7f5a41ffb700 1 -- 172.21.15.154:0/648009347 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6455+0+0 (secure 0 0 0) 0x7f5a48084d00 con 0x7f5a4c159420 2023-10-10T22:37:04.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.071+0000 7f5a5119a700 1 -- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5a30067050 msgr2=0x7f5a30069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:04.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.071+0000 7f5a5119a700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5a30067050 0x7f5a30069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:04.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.075+0000 7f5a41ffb700 1 -- 172.21.15.154:0/648009347 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a48051ad0 con 0x7f5a4c159420 2023-10-10T22:37:04.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.272+0000 7f5a5119a700 1 -- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5a30067050 msgr2=0x7f5a30069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:04.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.272+0000 7f5a5119a700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5a30067050 0x7f5a30069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:04.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.318+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a4c04c3c0 con 0x7f5a4c159420 2023-10-10T22:37:04.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.319+0000 7f5a41ffb700 1 -- 172.21.15.154:0/648009347 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f5a480550f0 con 0x7f5a4c159420 2023-10-10T22:37:04.321 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:04.321 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/331320161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":331320161},{"type":"v1","addr":"172.21.15.154:6833","nonce":331320161}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/595493420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":595493420},{"type":"v1","addr":"172.21.15.179:6835","nonce":595493420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1656759292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1656759292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1656759292}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:34:38.799966+0000","modified":"2023-10-10T22:34:42.366478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/3472664042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3472664042},{"type":"v1","addr":"172.21.15.179:6834","nonce":3472664042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-10T22:37:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5a30067050 msgr2=0x7f5a30069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5a30067050 0x7f5a30069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c159420 msgr2=0x7f5a4c16a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c159420 0x7f5a4c16a9b0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800ec80 tx=0x7f5a480091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 shutdown_connections 2023-10-10T22:37:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5a30067050 0x7f5a30069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4c15d230 0x7f5a4c15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c159420 0x7f5a4c16a9b0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 --2- 172.21.15.154:0/648009347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4c1597f0 0x7f5a4c16c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 >> 172.21.15.154:0/648009347 conn(0x7f5a4c0d0660 msgr2=0x7f5a4c1553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 shutdown_connections 2023-10-10T22:37:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.322+0000 7f5a5299d700 1 -- 172.21.15.154:0/648009347 wait complete. 2023-10-10T22:37:04.327 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 86 2023-10-10T22:37:04.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:04.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.532+0000 7f31cb59e700 1 Processor -- start 2023-10-10T22:37:04.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.532+0000 7f31cb59e700 1 -- start start 2023-10-10T22:37:04.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31cb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31cb59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31cc0ae710 0x7f31cc0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31cb59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc0ca860 con 0x7f31cc1566e0 2023-10-10T22:37:04.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31cb59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc0cab40 con 0x7f31cc0ae710 2023-10-10T22:37:04.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31cb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc0cae20 con 0x7f31cc156310 2023-10-10T22:37:04.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31ca59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31cad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31cc0ae710 0x7f31cc0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31ca59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:46018/0 (socket says 172.21.15.154:46018) 2023-10-10T22:37:04.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31cad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31cc0ae710 0x7f31cc0c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:57684/0 (socket says 172.21.15.154:57684) 2023-10-10T22:37:04.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31ca59c700 1 -- 172.21.15.154:0/960146925 learned_addr learned my addr 172.21.15.154:0/960146925 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:04.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.534+0000 7f31c9d9b700 1 --1- 172.21.15.154:0/960146925 >> v1:172.21.15.179:6789/0 conn(0x7f31cc1566e0 0x7f31cc0ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:42846/0 (socket says 172.21.15.154:42846) 2023-10-10T22:37:04.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.535+0000 7f31ca59c700 1 -- 172.21.15.154:0/960146925 >> v2:172.21.15.179:3300/0 conn(0x7f31cc0ae710 msgr2=0x7f31cc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:04.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.535+0000 7f31ca59c700 1 --2- 172.21.15.154:0/960146925 >> v2:172.21.15.179:3300/0 conn(0x7f31cc0ae710 0x7f31cc0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.535+0000 7f31ca59c700 1 -- 172.21.15.154:0/960146925 >> v1:172.21.15.179:6789/0 conn(0x7f31cc1566e0 legacy=0x7f31cc0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.535+0000 7f31ca59c700 1 -- 172.21.15.154:0/960146925 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0cb100 con 0x7f31cc156310 2023-10-10T22:37:04.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.535+0000 7f31cad9d700 1 --2- 172.21.15.154:0/960146925 >> v2:172.21.15.179:3300/0 conn(0x7f31cc0ae710 0x7f31cc0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:04.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.535+0000 7f31ca59c700 1 --2- 172.21.15.154:0/960146925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0c9dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0099b0 tx=0x7f31bc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4cba75f99879a75 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:04.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.535+0000 7f31c959a700 1 -- 172.21.15.154:0/960146925 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009ea0 con 0x7f31cc156310 2023-10-10T22:37:04.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.535+0000 7f31c959a700 1 -- 172.21.15.154:0/960146925 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00b860 con 0x7f31cc156310 2023-10-10T22:37:04.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.535+0000 7f31c959a700 1 -- 172.21.15.154:0/960146925 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00bc00 con 0x7f31cc156310 2023-10-10T22:37:04.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.536+0000 7f31cb59e700 1 -- 172.21.15.154:0/960146925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 msgr2=0x7f31cc0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.536+0000 7f31cb59e700 1 --2- 172.21.15.154:0/960146925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0c9dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0099b0 tx=0x7f31bc009250 comp rx=0 tx=0).stop 2023-10-10T22:37:04.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.536+0000 7f31cb59e700 1 -- 172.21.15.154:0/960146925 shutdown_connections 2023-10-10T22:37:04.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.536+0000 7f31cb59e700 1 --2- 172.21.15.154:0/960146925 >> v2:172.21.15.179:3300/0 conn(0x7f31cc0ae710 0x7f31cc0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.536+0000 7f31cb59e700 1 --2- 172.21.15.154:0/960146925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0c9dc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.536+0000 7f31cb59e700 1 -- 172.21.15.154:0/960146925 >> 172.21.15.154:0/960146925 conn(0x7f31cc0cc1f0 msgr2=0x7f31cc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:04.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.536+0000 7f31cb59e700 1 -- 172.21.15.154:0/960146925 shutdown_connections 2023-10-10T22:37:04.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.536+0000 7f31cb59e700 1 -- 172.21.15.154:0/960146925 wait complete. 2023-10-10T22:37:04.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.538+0000 7f31cb59e700 1 Processor -- start 2023-10-10T22:37:04.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.538+0000 7f31cb59e700 1 -- start start 2023-10-10T22:37:04.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31cb59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0ae710 0x7f31cc0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31cb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31cb59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31cc1566e0 0x7f31cc0c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31cb59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc13d7b0 con 0x7f31cc0ae710 2023-10-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31cb59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc157c10 con 0x7f31cc1566e0 2023-10-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31cb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc156ed0 con 0x7f31cc156310 2023-10-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31ca59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0ae710 0x7f31cc0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31ca59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0ae710 0x7f31cc0afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48716/0 (socket says 172.21.15.154:48716) 2023-10-10T22:37:04.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31ca59c700 1 -- 172.21.15.154:0/608377645 learned_addr learned my addr 172.21.15.154:0/608377645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:04.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31cad9d700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31cc1566e0 0x7f31cc0c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31c9d9b700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31ca59c700 1 -- 172.21.15.154:0/608377645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 msgr2=0x7f31cc0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31ca59c700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31ca59c700 1 -- 172.21.15.154:0/608377645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31cc1566e0 msgr2=0x7f31cc0c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31ca59c700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31cc1566e0 0x7f31cc0c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.539+0000 7f31ca59c700 1 -- 172.21.15.154:0/608377645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c400bc30 con 0x7f31cc0ae710 2023-10-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.540+0000 7f31ca59c700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0ae710 0x7f31cc0afc40 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0caf60 tx=0x7f31bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.540+0000 7f31ba7fc700 1 -- 172.21.15.154:0/608377645 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00bbe0 con 0x7f31cc0ae710 2023-10-10T22:37:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.540+0000 7f31ba7fc700 1 -- 172.21.15.154:0/608377645 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc011420 con 0x7f31cc0ae710 2023-10-10T22:37:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.540+0000 7f31ba7fc700 1 -- 172.21.15.154:0/608377645 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0117c0 con 0x7f31cc0ae710 2023-10-10T22:37:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.540+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc0094f0 con 0x7f31cc0ae710 2023-10-10T22:37:04.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.540+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc0b0a90 con 0x7f31cc0ae710 2023-10-10T22:37:04.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.541+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc04c3c0 con 0x7f31cc0ae710 2023-10-10T22:37:04.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.542+0000 7f31ba7fc700 1 -- 172.21.15.154:0/608377645 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f31bc011bf0 con 0x7f31cc0ae710 2023-10-10T22:37:04.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.543+0000 7f31ba7fc700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f31ac067050 0x7f31ac069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.543+0000 7f31ba7fc700 1 -- 172.21.15.154:0/608377645 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6543+0+0 (secure 0 0 0) 0x7f31bc0863a0 con 0x7f31cc0ae710 2023-10-10T22:37:04.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.543+0000 7f31c9d9b700 1 -- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f31ac067050 msgr2=0x7f31ac069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:04.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.543+0000 7f31c9d9b700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f31ac067050 0x7f31ac069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:04.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.547+0000 7f31ba7fc700 1 -- 172.21.15.154:0/608377645 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31bc0531e0 con 0x7f31cc0ae710 2023-10-10T22:37:04.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.744+0000 7f31c9d9b700 1 -- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f31ac067050 msgr2=0x7f31ac069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:04.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.744+0000 7f31c9d9b700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f31ac067050 0x7f31ac069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:04.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.755+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31cc0c9d40 con 0x7f31cc0ae710 2023-10-10T22:37:04.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.756+0000 7f31ba7fc700 1 -- 172.21.15.154:0/608377645 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+16702 (secure 0 0 0) 0x7f31bc056800 con 0x7f31cc0ae710 2023-10-10T22:37:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:04.758 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":195,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:04.500399+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:34:36.953199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-10T22:34:37.789582+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":195,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3779863535":"2023-10-11T22:34:59.532181+0000","172.21.15.154:0/3535334064":"2023-10-11T22:34:59.532181+0000","172.21.15.154:6837/132976":"2023-10-11T22:34:59.532181+0000","172.21.15.154:6836/132976":"2023-10-11T22:34:59.532181+0000","172.21.15.154:0/1651687972":"2023-10-11T22:34:59.532181+0000","172.21.15.154:0/4179903520":"2023-10-11T22:34:59.532181+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:04.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f31ac067050 msgr2=0x7f31ac069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f31ac067050 0x7f31ac069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0ae710 msgr2=0x7f31cc0afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0ae710 0x7f31cc0afc40 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0caf60 tx=0x7f31bc017000 comp rx=0 tx=0).stop 2023-10-10T22:37:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 shutdown_connections 2023-10-10T22:37:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f31ac067050 0x7f31ac069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31cc1566e0 0x7f31cc0c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0ae710 0x7f31cc0afc40 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 --2- 172.21.15.154:0/608377645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31cc156310 0x7f31cc0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 >> 172.21.15.154:0/608377645 conn(0x7f31cc0cc1f0 msgr2=0x7f31cc0c2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 shutdown_connections 2023-10-10T22:37:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.759+0000 7f31cb59e700 1 -- 172.21.15.154:0/608377645 wait complete. 2023-10-10T22:37:04.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T22:34:36.953199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T22:34:37.789582+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 195, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T22:37:04.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T22:37:04.788 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:04.788+0000 7feabcfa8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:37:04.858 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:04.857+0000 7f38b15fe180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:37:04.949 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:04.948+0000 7feabcfa8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.970+0000 7f624df9d700 1 Processor -- start 2023-10-10T22:37:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.970+0000 7f624df9d700 1 -- start start 2023-10-10T22:37:04.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.972+0000 7f624df9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62480c9db0 0x7f624806a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.972+0000 7f624df9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6248157130 0x7f624806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.972+0000 7f624df9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624806e150 con 0x7f6248153900 2023-10-10T22:37:04.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.972+0000 7f624df9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62480c7610 con 0x7f62480c9db0 2023-10-10T22:37:04.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.972+0000 7f624df9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62480c7800 con 0x7f6248157130 2023-10-10T22:37:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.972+0000 7f6247fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62480c9db0 0x7f624806a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.972+0000 7f6247fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62480c9db0 0x7f624806a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48726/0 (socket says 172.21.15.154:48726) 2023-10-10T22:37:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.972+0000 7f6247fff700 1 -- 172.21.15.154:0/2239792954 learned_addr learned my addr 172.21.15.154:0/2239792954 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.972+0000 7f624d79c700 1 --2- 172.21.15.154:0/2239792954 >> v2:172.21.15.179:3300/0 conn(0x7f6248157130 0x7f624806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.973+0000 7f6247fff700 1 -- 172.21.15.154:0/2239792954 >> v2:172.21.15.179:3300/0 conn(0x7f6248157130 msgr2=0x7f624806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.973+0000 7f6247fff700 1 --2- 172.21.15.154:0/2239792954 >> v2:172.21.15.179:3300/0 conn(0x7f6248157130 0x7f624806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.973+0000 7f6247fff700 1 -- 172.21.15.154:0/2239792954 >> v1:172.21.15.154:6789/0 conn(0x7f6248153900 legacy=0x7f62480c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.973+0000 7f6247fff700 1 -- 172.21.15.154:0/2239792954 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62480c7ae0 con 0x7f62480c9db0 2023-10-10T22:37:04.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.973+0000 7f6247fff700 1 --2- 172.21.15.154:0/2239792954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 0x7f624806a000 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f62480cd2d0 tx=0x7f6234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416d668f651c1c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:04.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.973+0000 7f62477fe700 1 -- 172.21.15.154:0/2239792954 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234009e70 con 0x7f62480c9db0 2023-10-10T22:37:04.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.973+0000 7f62477fe700 1 -- 172.21.15.154:0/2239792954 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623400b860 con 0x7f62480c9db0 2023-10-10T22:37:04.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.973+0000 7f62477fe700 1 -- 172.21.15.154:0/2239792954 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400bc00 con 0x7f62480c9db0 2023-10-10T22:37:04.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.974+0000 7f624df9d700 1 -- 172.21.15.154:0/2239792954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 msgr2=0x7f624806a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.974+0000 7f624df9d700 1 --2- 172.21.15.154:0/2239792954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 0x7f624806a000 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f62480cd2d0 tx=0x7f6234009250 comp rx=0 tx=0).stop 2023-10-10T22:37:04.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.974+0000 7f624df9d700 1 -- 172.21.15.154:0/2239792954 shutdown_connections 2023-10-10T22:37:04.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.974+0000 7f624df9d700 1 --2- 172.21.15.154:0/2239792954 >> v2:172.21.15.179:3300/0 conn(0x7f6248157130 0x7f624806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.974+0000 7f624df9d700 1 --2- 172.21.15.154:0/2239792954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 0x7f624806a000 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.974+0000 7f624df9d700 1 -- 172.21.15.154:0/2239792954 >> 172.21.15.154:0/2239792954 conn(0x7f62480cc1e0 msgr2=0x7f62480cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:04.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.974+0000 7f624df9d700 1 -- 172.21.15.154:0/2239792954 shutdown_connections 2023-10-10T22:37:04.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.974+0000 7f624df9d700 1 -- 172.21.15.154:0/2239792954 wait complete. 2023-10-10T22:37:04.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.975+0000 7f624df9d700 1 Processor -- start 2023-10-10T22:37:04.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.976+0000 7f624df9d700 1 -- start start 2023-10-10T22:37:04.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.976+0000 7f624df9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 0x7f62481524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.976+0000 7f624df9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6248153900 0x7f62480ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624df9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6248157130 0x7f624814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624df9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62480ae170 con 0x7f62480c9db0 2023-10-10T22:37:04.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624df9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62480ad560 con 0x7f6248153900 2023-10-10T22:37:04.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624df9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62480ad840 con 0x7f6248157130 2023-10-10T22:37:04.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624cf9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 0x7f62481524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624cf9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 0x7f62481524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48730/0 (socket says 172.21.15.154:48730) 2023-10-10T22:37:04.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624cf9b700 1 -- 172.21.15.154:0/2364985119 learned_addr learned my addr 172.21.15.154:0/2364985119 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:04.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f6247fff700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6248153900 0x7f62480ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624d79c700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6248157130 0x7f624814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:04.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624cf9b700 1 -- 172.21.15.154:0/2364985119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6248157130 msgr2=0x7f624814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624cf9b700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6248157130 0x7f624814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624cf9b700 1 -- 172.21.15.154:0/2364985119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6248153900 msgr2=0x7f62480ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:04.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624cf9b700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6248153900 0x7f62480ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:04.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624cf9b700 1 -- 172.21.15.154:0/2364985119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62340094f0 con 0x7f62480c9db0 2023-10-10T22:37:04.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624d79c700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6248157130 0x7f624814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:04.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.977+0000 7f624cf9b700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 0x7f62481524c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f623c00c590 tx=0x7f623c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:04.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.978+0000 7f6244ff9700 1 -- 172.21.15.154:0/2364985119 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c011590 con 0x7f62480c9db0 2023-10-10T22:37:04.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.978+0000 7f6244ff9700 1 -- 172.21.15.154:0/2364985119 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c011710 con 0x7f62480c9db0 2023-10-10T22:37:04.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.978+0000 7f6244ff9700 1 -- 172.21.15.154:0/2364985119 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c011ad0 con 0x7f62480c9db0 2023-10-10T22:37:04.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.978+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62480adb20 con 0x7f62480c9db0 2023-10-10T22:37:04.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.978+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62480ad180 con 0x7f62480c9db0 2023-10-10T22:37:04.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.979+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624806c450 con 0x7f62480c9db0 2023-10-10T22:37:04.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.980+0000 7f6244ff9700 1 -- 172.21.15.154:0/2364985119 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f623c01b3b0 con 0x7f62480c9db0 2023-10-10T22:37:04.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.981+0000 7f6244ff9700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f622c067080 0x7f622c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:04.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.981+0000 7f6244ff9700 1 -- 172.21.15.154:0/2364985119 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6543+0+0 (secure 0 0 0) 0x7f623c083eb0 con 0x7f62480c9db0 2023-10-10T22:37:04.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.981+0000 7f6247fff700 1 -- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f622c067080 msgr2=0x7f622c069530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:04.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.981+0000 7f6247fff700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f622c067080 0x7f622c069530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:04.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:04.985+0000 7f6244ff9700 1 -- 172.21.15.154:0/2364985119 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f623c050c30 con 0x7f62480c9db0 2023-10-10T22:37:05.030 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:05.029+0000 7f38b15fe180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:05.036 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:05.036+0000 7feabcfa8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:37:05.118 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:05.117+0000 7f38b15fe180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:37:05.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.182+0000 7f6247fff700 1 -- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f622c067080 msgr2=0x7f622c069530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:05.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.182+0000 7f6247fff700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f622c067080 0x7f622c069530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:05.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.184+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62480c7dc0 con 0x7f62480c9db0 2023-10-10T22:37:05.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.184+0000 7f6244ff9700 1 -- 172.21.15.154:0/2364985119 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v195) v1 ==== 93+0+10 (secure 0 0 0) 0x7f623c017070 con 0x7f62480c9db0 2023-10-10T22:37:05.186 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T22:37:05.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.186+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f622c067080 msgr2=0x7f622c069530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:05.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.186+0000 7f624df9d700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f622c067080 0x7f622c069530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.186+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 msgr2=0x7f62481524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.187+0000 7f624df9d700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 0x7f62481524c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f623c00c590 tx=0x7f623c00c8a0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.187+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 shutdown_connections 2023-10-10T22:37:05.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.187+0000 7f624df9d700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f622c067080 0x7f622c069530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.187+0000 7f624df9d700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6248157130 0x7f624814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.187+0000 7f624df9d700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62480c9db0 0x7f62481524c0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.187+0000 7f624df9d700 1 --2- 172.21.15.154:0/2364985119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6248153900 0x7f62480ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.187+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 >> 172.21.15.154:0/2364985119 conn(0x7f62480cc1e0 msgr2=0x7f62480cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:05.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.187+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 shutdown_connections 2023-10-10T22:37:05.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.187+0000 7f624df9d700 1 -- 172.21.15.154:0/2364985119 wait complete. 2023-10-10T22:37:05.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T22:37:05.258 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:05.257+0000 7feabcfa8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:05.354 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:05.352+0000 7f38b15fe180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:05.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.396+0000 7f069939d700 1 Processor -- start 2023-10-10T22:37:05.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.396+0000 7f069939d700 1 -- start start 2023-10-10T22:37:05.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.398+0000 7f069939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b4e70 0x7f06940ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.398+0000 7f069939d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06940b1b40 0x7f069415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.398+0000 7f069939d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940cfb00 con 0x7f06940b16d0 2023-10-10T22:37:05.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.398+0000 7f069939d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06940b5c40 con 0x7f06940b1b40 2023-10-10T22:37:05.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.398+0000 7f069939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06940b5f20 con 0x7f06940b4e70 2023-10-10T22:37:05.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.398+0000 7f0698b9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06940b1b40 0x7f069415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.398+0000 7f0693fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b4e70 0x7f06940ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.398+0000 7f0698b9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06940b1b40 0x7f069415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:57714/0 (socket says 172.21.15.154:57714) 2023-10-10T22:37:05.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.398+0000 7f0698b9c700 1 -- 172.21.15.154:0/793376724 learned_addr learned my addr 172.21.15.154:0/793376724 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:05.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.399+0000 7f0693fff700 1 -- 172.21.15.154:0/793376724 >> v2:172.21.15.179:3300/0 conn(0x7f06940b1b40 msgr2=0x7f069415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:05.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.399+0000 7f0693fff700 1 --2- 172.21.15.154:0/793376724 >> v2:172.21.15.179:3300/0 conn(0x7f06940b1b40 0x7f069415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.399+0000 7f0693fff700 1 -- 172.21.15.154:0/793376724 >> v1:172.21.15.179:6789/0 conn(0x7f06940b16d0 legacy=0x7f069415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.399+0000 7f0693fff700 1 -- 172.21.15.154:0/793376724 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940b6200 con 0x7f06940b4e70 2023-10-10T22:37:05.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.399+0000 7f0698b9c700 1 --2- 172.21.15.154:0/793376724 >> v2:172.21.15.179:3300/0 conn(0x7f06940b1b40 0x7f069415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:05.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.399+0000 7f0693fff700 1 --2- 172.21.15.154:0/793376724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b4e70 0x7f06940ccff0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f06840098e0 tx=0x7f06840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae03aaa7ad65ca9a server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:05.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.399+0000 7f0692ffd700 1 -- 172.21.15.154:0/793376724 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068400b640 con 0x7f06940b4e70 2023-10-10T22:37:05.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.399+0000 7f0692ffd700 1 -- 172.21.15.154:0/793376724 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068400b7a0 con 0x7f06940b4e70 2023-10-10T22:37:05.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.399+0000 7f0692ffd700 1 -- 172.21.15.154:0/793376724 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068400bb40 con 0x7f06940b4e70 2023-10-10T22:37:05.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.400+0000 7f069939d700 1 -- 172.21.15.154:0/793376724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b4e70 msgr2=0x7f06940ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.400+0000 7f069939d700 1 --2- 172.21.15.154:0/793376724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b4e70 0x7f06940ccff0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f06840098e0 tx=0x7f06840091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.400+0000 7f069939d700 1 -- 172.21.15.154:0/793376724 shutdown_connections 2023-10-10T22:37:05.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.400+0000 7f069939d700 1 --2- 172.21.15.154:0/793376724 >> v2:172.21.15.179:3300/0 conn(0x7f06940b1b40 0x7f069415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.400+0000 7f069939d700 1 --2- 172.21.15.154:0/793376724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b4e70 0x7f06940ccff0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.400+0000 7f069939d700 1 -- 172.21.15.154:0/793376724 >> 172.21.15.154:0/793376724 conn(0x7f06940d10c0 msgr2=0x7f06940affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:05.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.400+0000 7f069939d700 1 -- 172.21.15.154:0/793376724 shutdown_connections 2023-10-10T22:37:05.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.400+0000 7f069939d700 1 -- 172.21.15.154:0/793376724 wait complete. 2023-10-10T22:37:05.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.401+0000 7f069939d700 1 Processor -- start 2023-10-10T22:37:05.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.401+0000 7f069939d700 1 -- start start 2023-10-10T22:37:05.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.402+0000 7f069939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b16d0 0x7f06940c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.402+0000 7f069939d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06940b1b40 0x7f069416a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.402+0000 7f069939d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06940b4e70 0x7f06940af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.402+0000 7f069939d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069416aee0 con 0x7f06940b1b40 2023-10-10T22:37:05.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.402+0000 7f069939d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940c7bc0 con 0x7f06940b4e70 2023-10-10T22:37:05.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.402+0000 7f069939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06940c7ea0 con 0x7f06940b16d0 2023-10-10T22:37:05.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f06937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06940b1b40 0x7f069416a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f0693fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b16d0 0x7f06940c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f0698b9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06940b4e70 0x7f06940af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f06937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06940b1b40 0x7f069416a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48742/0 (socket says 172.21.15.154:48742) 2023-10-10T22:37:05.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f06937fe700 1 -- 172.21.15.154:0/868559706 learned_addr learned my addr 172.21.15.154:0/868559706 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:05.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f0698b9c700 1 -- 172.21.15.154:0/868559706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b16d0 msgr2=0x7f06940c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f0698b9c700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b16d0 0x7f06940c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f0698b9c700 1 -- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06940b1b40 msgr2=0x7f069416a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f0698b9c700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06940b1b40 0x7f069416a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f0698b9c700 1 -- 172.21.15.154:0/868559706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c009ae0 con 0x7f06940b4e70 2023-10-10T22:37:05.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f06937fe700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06940b1b40 0x7f069416a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:05.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.403+0000 7f0693fff700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b16d0 0x7f06940c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:05.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.404+0000 7f0698b9c700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06940b4e70 0x7f06940af340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f068c009f10 tx=0x7f068c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:05.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.404+0000 7f067bfff700 1 -- 172.21.15.154:0/868559706 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c018070 con 0x7f06940b4e70 2023-10-10T22:37:05.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.404+0000 7f067bfff700 1 -- 172.21.15.154:0/868559706 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00f040 con 0x7f06940b4e70 2023-10-10T22:37:05.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.404+0000 7f067bfff700 1 -- 172.21.15.154:0/868559706 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00cb90 con 0x7f06940b4e70 2023-10-10T22:37:05.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.404+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0684009420 con 0x7f06940b4e70 2023-10-10T22:37:05.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.404+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06940c8460 con 0x7f06940b4e70 2023-10-10T22:37:05.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.405+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0694088990 con 0x7f06940b4e70 2023-10-10T22:37:05.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.406+0000 7f067bfff700 1 -- 172.21.15.154:0/868559706 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f068c003020 con 0x7f06940b4e70 2023-10-10T22:37:05.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.407+0000 7f067bfff700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0680067050 0x7f0680069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.407+0000 7f0693fff700 1 -- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0680067050 msgr2=0x7f0680069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:05.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.407+0000 7f067bfff700 1 -- 172.21.15.154:0/868559706 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6543+0+0 (secure 0 0 0) 0x7f068c084980 con 0x7f06940b4e70 2023-10-10T22:37:05.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.407+0000 7f0693fff700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0680067050 0x7f0680069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:05.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.411+0000 7f067bfff700 1 -- 172.21.15.154:0/868559706 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f068c04d5a0 con 0x7f06940b4e70 2023-10-10T22:37:05.434 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:05.433+0000 7feabcfa8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:37:05.530 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:05.529+0000 7feabcfa8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:37:05.542 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:05.541+0000 7f38b15fe180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:37:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.608+0000 7f0693fff700 1 -- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0680067050 msgr2=0x7f0680069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.608+0000 7f0693fff700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0680067050 0x7f0680069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:05.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.618+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f069404bb80 con 0x7f06940b4e70 2023-10-10T22:37:05.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.619+0000 7f067bfff700 1 -- 172.21.15.154:0/868559706 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v196) v1 ==== 104+0+11 (secure 0 0 0) 0x7f068c0515f0 con 0x7f06940b4e70 2023-10-10T22:37:05.622 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T22:37:05.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0680067050 msgr2=0x7f0680069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:05.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0680067050 0x7f0680069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06940b4e70 msgr2=0x7f06940af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06940b4e70 0x7f06940af340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f068c009f10 tx=0x7f068c00b040 comp rx=0 tx=0).stop 2023-10-10T22:37:05.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 shutdown_connections 2023-10-10T22:37:05.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0680067050 0x7f0680069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06940b4e70 0x7f06940af340 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06940b16d0 0x7f06940c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 --2- 172.21.15.154:0/868559706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06940b1b40 0x7f069416a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 >> 172.21.15.154:0/868559706 conn(0x7f06940d10c0 msgr2=0x7f0694068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:05.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 shutdown_connections 2023-10-10T22:37:05.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.623+0000 7f069939d700 1 -- 172.21.15.154:0/868559706 wait complete. 2023-10-10T22:37:05.650 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T22:37:05.658 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:05.652+0000 7f38b15fe180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:37:05.698 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:05.697+0000 7feabcfa8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:37:05.798 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:05.797+0000 7feabcfa8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:05.825 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:05.824+0000 7f38b15fe180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:37:05.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.844+0000 7ff95ffff700 1 Processor -- start 2023-10-10T22:37:05.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.844+0000 7ff95ffff700 1 -- start start 2023-10-10T22:37:05.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9600cb1a0 0x7ff96015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff96015a8a0 0x7ff96006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96006ebd0 con 0x7ff96006f5a0 2023-10-10T22:37:05.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95ffff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96015b2e0 con 0x7ff96015a8a0 2023-10-10T22:37:05.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96015ad20 con 0x7ff9600cb1a0 2023-10-10T22:37:05.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95e7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff96015a8a0 0x7ff96006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95effd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9600cb1a0 0x7ff96015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95f7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff96006f5a0 0x7ff9600ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:42870/0 (socket says 172.21.15.154:42870) 2023-10-10T22:37:05.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95f7fe700 1 -- 172.21.15.154:0/175730382 learned_addr learned my addr 172.21.15.154:0/175730382 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:05.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.846+0000 7ff95effd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9600cb1a0 0x7ff96015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:46074/0 (socket says 172.21.15.154:46074) 2023-10-10T22:37:05.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.847+0000 7ff95dffb700 1 -- 172.21.15.154:0/175730382 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536952917 0 0) 0x7ff96006ebd0 con 0x7ff96006f5a0 2023-10-10T22:37:05.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.847+0000 7ff95effd700 1 -- 172.21.15.154:0/175730382 >> v2:172.21.15.154:3300/0 conn(0x7ff96015a8a0 msgr2=0x7ff96006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:05.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.847+0000 7ff95effd700 1 --2- 172.21.15.154:0/175730382 >> v2:172.21.15.154:3300/0 conn(0x7ff96015a8a0 0x7ff96006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.847+0000 7ff95effd700 1 -- 172.21.15.154:0/175730382 >> v1:172.21.15.179:6789/0 conn(0x7ff96006f5a0 legacy=0x7ff9600ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.847+0000 7ff95effd700 1 -- 172.21.15.154:0/175730382 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96015b000 con 0x7ff9600cb1a0 2023-10-10T22:37:05.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.847+0000 7ff95effd700 1 --2- 172.21.15.154:0/175730382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9600cb1a0 0x7ff96015a360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff95000bb90 tx=0x7ff95000b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c47173f4d73fe94 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:05.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.847+0000 7ff95dffb700 1 -- 172.21.15.154:0/175730382 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95000dbd0 con 0x7ff9600cb1a0 2023-10-10T22:37:05.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.847+0000 7ff95dffb700 1 -- 172.21.15.154:0/175730382 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95000dd30 con 0x7ff9600cb1a0 2023-10-10T22:37:05.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.847+0000 7ff95dffb700 1 -- 172.21.15.154:0/175730382 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95000dea0 con 0x7ff9600cb1a0 2023-10-10T22:37:05.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.848+0000 7ff95ffff700 1 -- 172.21.15.154:0/175730382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9600cb1a0 msgr2=0x7ff96015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.848+0000 7ff95ffff700 1 --2- 172.21.15.154:0/175730382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9600cb1a0 0x7ff96015a360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff95000bb90 tx=0x7ff95000b430 comp rx=0 tx=0).stop 2023-10-10T22:37:05.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.848+0000 7ff95ffff700 1 -- 172.21.15.154:0/175730382 shutdown_connections 2023-10-10T22:37:05.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.848+0000 7ff95ffff700 1 --2- 172.21.15.154:0/175730382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9600cb1a0 0x7ff96015a360 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.848+0000 7ff95ffff700 1 --2- 172.21.15.154:0/175730382 >> v2:172.21.15.154:3300/0 conn(0x7ff96015a8a0 0x7ff96006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.848+0000 7ff95ffff700 1 -- 172.21.15.154:0/175730382 >> 172.21.15.154:0/175730382 conn(0x7ff9600cc1e0 msgr2=0x7ff9600cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:05.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.848+0000 7ff95ffff700 1 -- 172.21.15.154:0/175730382 shutdown_connections 2023-10-10T22:37:05.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.848+0000 7ff95ffff700 1 -- 172.21.15.154:0/175730382 wait complete. 2023-10-10T22:37:05.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.851+0000 7ff95ffff700 1 Processor -- start 2023-10-10T22:37:05.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.851+0000 7ff95ffff700 1 -- start start 2023-10-10T22:37:05.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.852+0000 7ff95ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff96006f5a0 0x7ff9600c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.852+0000 7ff95ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9600cb1a0 0x7ff96013d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.852+0000 7ff95ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff960157c70 0x7ff96013df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.852+0000 7ff95ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600c37d0 con 0x7ff9600cb1a0 2023-10-10T22:37:05.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.852+0000 7ff95ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff960158d50 con 0x7ff960157c70 2023-10-10T22:37:05.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.852+0000 7ff95ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9601508e0 con 0x7ff96006f5a0 2023-10-10T22:37:05.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9600cb1a0 0x7ff96013d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95effd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff96006f5a0 0x7ff9600c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9600cb1a0 0x7ff96013d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48760/0 (socket says 172.21.15.154:48760) 2023-10-10T22:37:05.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95e7fc700 1 -- 172.21.15.154:0/857609677 learned_addr learned my addr 172.21.15.154:0/857609677 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:05.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95f7fe700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff960157c70 0x7ff96013df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:05.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95effd700 1 -- 172.21.15.154:0/857609677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff960157c70 msgr2=0x7ff96013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95effd700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff960157c70 0x7ff96013df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95effd700 1 -- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9600cb1a0 msgr2=0x7ff96013d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:05.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95effd700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9600cb1a0 0x7ff96013d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:05.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95effd700 1 -- 172.21.15.154:0/857609677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95000b6d0 con 0x7ff96006f5a0 2023-10-10T22:37:05.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95e7fc700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9600cb1a0 0x7ff96013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:05.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.853+0000 7ff95effd700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff96006f5a0 0x7ff9600c3290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff950018000 tx=0x7ff95001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:05.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.854+0000 7ff946ffd700 1 -- 172.21.15.154:0/857609677 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950010750 con 0x7ff96006f5a0 2023-10-10T22:37:05.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.854+0000 7ff946ffd700 1 -- 172.21.15.154:0/857609677 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9500108d0 con 0x7ff96006f5a0 2023-10-10T22:37:05.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.854+0000 7ff946ffd700 1 -- 172.21.15.154:0/857609677 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950010c90 con 0x7ff96006f5a0 2023-10-10T22:37:05.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.854+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff960158140 con 0x7ff96006f5a0 2023-10-10T22:37:05.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.854+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff960158700 con 0x7ff96006f5a0 2023-10-10T22:37:05.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.855+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96006c450 con 0x7ff96006f5a0 2023-10-10T22:37:05.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.856+0000 7ff946ffd700 1 -- 172.21.15.154:0/857609677 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff950023070 con 0x7ff96006f5a0 2023-10-10T22:37:05.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.857+0000 7ff946ffd700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff94c067050 0x7ff94c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:05.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.857+0000 7ff946ffd700 1 -- 172.21.15.154:0/857609677 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6527+0+0 (secure 0 0 0) 0x7ff950014070 con 0x7ff96006f5a0 2023-10-10T22:37:05.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.857+0000 7ff95e7fc700 1 -- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff94c067050 msgr2=0x7ff94c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:05.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.857+0000 7ff95e7fc700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff94c067050 0x7ff94c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:05.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:05.861+0000 7ff946ffd700 1 -- 172.21.15.154:0/857609677 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff950055760 con 0x7ff96006f5a0 2023-10-10T22:37:05.934 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:05.933+0000 7f38b15fe180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:06.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.058+0000 7ff95e7fc700 1 -- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff94c067050 msgr2=0x7ff94c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:06.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.058+0000 7ff95e7fc700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff94c067050 0x7ff94c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:06.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.060+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff96006e860 con 0x7ff96006f5a0 2023-10-10T22:37:06.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.061+0000 7ff946ffd700 1 -- 172.21.15.154:0/857609677 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v196) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff950058d80 con 0x7ff96006f5a0 2023-10-10T22:37:06.063 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T22:37:06.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff94c067050 msgr2=0x7ff94c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:06.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff94c067050 0x7ff94c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff96006f5a0 msgr2=0x7ff9600c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff96006f5a0 0x7ff9600c3290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff950018000 tx=0x7ff95001b000 comp rx=0 tx=0).stop 2023-10-10T22:37:06.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 shutdown_connections 2023-10-10T22:37:06.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff94c067050 0x7ff94c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff960157c70 0x7ff96013df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff96006f5a0 0x7ff9600c3290 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 --2- 172.21.15.154:0/857609677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9600cb1a0 0x7ff96013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.063+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 >> 172.21.15.154:0/857609677 conn(0x7ff9600cc1e0 msgr2=0x7ff9601523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:06.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.064+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 shutdown_connections 2023-10-10T22:37:06.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.064+0000 7ff95ffff700 1 -- 172.21.15.154:0/857609677 wait complete. 2023-10-10T22:37:06.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.271+0000 7f88b759e700 1 Processor -- start 2023-10-10T22:37:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.272+0000 7f88b759e700 1 -- start start 2023-10-10T22:37:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.273+0000 7f88b759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88b8142ea0 0x7f88b80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.273+0000 7f88b759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b80ad870 0x7f88b806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.273+0000 7f88b759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b80b40f0 con 0x7f88b80b3b70 2023-10-10T22:37:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.273+0000 7f88b759e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b8069640 con 0x7f88b8142ea0 2023-10-10T22:37:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.273+0000 7f88b759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8069920 con 0x7f88b80ad870 2023-10-10T22:37:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.273+0000 7f88b659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88b8142ea0 0x7f88b80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.273+0000 7f88b659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88b8142ea0 0x7f88b80b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35742/0 (socket says 172.21.15.154:35742) 2023-10-10T22:37:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.273+0000 7f88b659c700 1 -- 172.21.15.154:0/2216698724 learned_addr learned my addr 172.21.15.154:0/2216698724 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.273+0000 7f88b5d9b700 1 --2- 172.21.15.154:0/2216698724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b80ad870 0x7f88b806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.274+0000 7f88b659c700 1 -- 172.21.15.154:0/2216698724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b80ad870 msgr2=0x7f88b806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.274+0000 7f88b659c700 1 --2- 172.21.15.154:0/2216698724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b80ad870 0x7f88b806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.274+0000 7f88b659c700 1 -- 172.21.15.154:0/2216698724 >> v1:172.21.15.179:6789/0 conn(0x7f88b80b3b70 legacy=0x7f88b806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.274+0000 7f88b559a700 1 -- 172.21.15.154:0/2216698724 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720319603 0 0) 0x7f88b80b40f0 con 0x7f88b80b3b70 2023-10-10T22:37:06.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.274+0000 7f88b659c700 1 -- 172.21.15.154:0/2216698724 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8069c00 con 0x7f88b8142ea0 2023-10-10T22:37:06.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.274+0000 7f88b659c700 1 --2- 172.21.15.154:0/2216698724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b8142ea0 0x7f88b80b3630 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f88a80099b0 tx=0x7f88a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50423dca98c5d4f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:06.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.274+0000 7f88b559a700 1 -- 172.21.15.154:0/2216698724 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8009ea0 con 0x7f88b8142ea0 2023-10-10T22:37:06.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.274+0000 7f88b559a700 1 -- 172.21.15.154:0/2216698724 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a800b860 con 0x7f88b8142ea0 2023-10-10T22:37:06.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.274+0000 7f88b559a700 1 -- 172.21.15.154:0/2216698724 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800bc00 con 0x7f88b8142ea0 2023-10-10T22:37:06.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.275+0000 7f88b759e700 1 -- 172.21.15.154:0/2216698724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b8142ea0 msgr2=0x7f88b80b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.275+0000 7f88b759e700 1 --2- 172.21.15.154:0/2216698724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b8142ea0 0x7f88b80b3630 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f88a80099b0 tx=0x7f88a8009250 comp rx=0 tx=0).stop 2023-10-10T22:37:06.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.275+0000 7f88b759e700 1 -- 172.21.15.154:0/2216698724 shutdown_connections 2023-10-10T22:37:06.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.275+0000 7f88b759e700 1 --2- 172.21.15.154:0/2216698724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b8142ea0 0x7f88b80b3630 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.275+0000 7f88b759e700 1 --2- 172.21.15.154:0/2216698724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b80ad870 0x7f88b806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.275+0000 7f88b759e700 1 -- 172.21.15.154:0/2216698724 >> 172.21.15.154:0/2216698724 conn(0x7f88b80ce430 msgr2=0x7f88b80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:06.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.275+0000 7f88b759e700 1 -- 172.21.15.154:0/2216698724 shutdown_connections 2023-10-10T22:37:06.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.275+0000 7f88b759e700 1 -- 172.21.15.154:0/2216698724 wait complete. 2023-10-10T22:37:06.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.277+0000 7f88b759e700 1 Processor -- start 2023-10-10T22:37:06.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.277+0000 7f88b759e700 1 -- start start 2023-10-10T22:37:06.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b759e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b80b3b70 0x7f88b8169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b8142ea0 0x7f88b80c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88b8159100 0x7f88b815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b759e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b816ab40 con 0x7f88b80b3b70 2023-10-10T22:37:06.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80ca4f0 con 0x7f88b8159100 2023-10-10T22:37:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b816d3d0 con 0x7f88b8142ea0 2023-10-10T22:37:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b80b3b70 0x7f88b8169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b80b3b70 0x7f88b8169ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35748/0 (socket says 172.21.15.154:35748) 2023-10-10T22:37:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b659c700 1 -- 172.21.15.154:0/479445492 learned_addr learned my addr 172.21.15.154:0/479445492 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b5d9b700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b8142ea0 0x7f88b80c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b6d9d700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88b8159100 0x7f88b815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b659c700 1 -- 172.21.15.154:0/479445492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b8142ea0 msgr2=0x7f88b80c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b659c700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b8142ea0 0x7f88b80c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b659c700 1 -- 172.21.15.154:0/479445492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88b8159100 msgr2=0x7f88b815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b659c700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88b8159100 0x7f88b815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.278+0000 7f88b659c700 1 -- 172.21.15.154:0/479445492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80094f0 con 0x7f88b80b3b70 2023-10-10T22:37:06.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.279+0000 7f88b659c700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b80b3b70 0x7f88b8169ba0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006fd0 tx=0x7f88a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:06.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.279+0000 7f88a67fc700 1 -- 172.21.15.154:0/479445492 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8000d10 con 0x7f88b80b3b70 2023-10-10T22:37:06.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.279+0000 7f88a67fc700 1 -- 172.21.15.154:0/479445492 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a800bbe0 con 0x7f88b80b3b70 2023-10-10T22:37:06.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.279+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b816a2a0 con 0x7f88b80b3b70 2023-10-10T22:37:06.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.279+0000 7f88a67fc700 1 -- 172.21.15.154:0/479445492 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8011670 con 0x7f88b80b3b70 2023-10-10T22:37:06.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.279+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b816a860 con 0x7f88b80b3b70 2023-10-10T22:37:06.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.280+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b816d1a0 con 0x7f88b80b3b70 2023-10-10T22:37:06.289 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:06.285+0000 7feabcfa8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:37:06.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.282+0000 7f88a67fc700 1 -- 172.21.15.154:0/479445492 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f88a8011a60 con 0x7f88b80b3b70 2023-10-10T22:37:06.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.283+0000 7f88a67fc700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8898067050 0x7f8898069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.283+0000 7f88a67fc700 1 -- 172.21.15.154:0/479445492 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f88a8086230 con 0x7f88b80b3b70 2023-10-10T22:37:06.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.283+0000 7f88b5d9b700 1 -- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8898067050 msgr2=0x7f8898069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:06.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.283+0000 7f88b5d9b700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8898067050 0x7f8898069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:06.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.291+0000 7f88a67fc700 1 -- 172.21.15.154:0/479445492 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88b816d1a0 con 0x7f88b80b3b70 2023-10-10T22:37:06.380 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:06.380+0000 7feabcfa8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:37:06.442 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:06.441+0000 7f38b15fe180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:37:06.471 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:06.470+0000 7feabcfa8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:37:06.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.484+0000 7f88b5d9b700 1 -- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8898067050 msgr2=0x7f8898069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:06.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.484+0000 7f88b5d9b700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8898067050 0x7f8898069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:06.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.534+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88b804c3c0 con 0x7f88b80b3b70 2023-10-10T22:37:06.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.535+0000 7f88a67fc700 1 -- 172.21.15.154:0/479445492 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f88a8053060 con 0x7f88b80b3b70 2023-10-10T22:37:06.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:06.538 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/331320161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":331320161},{"type":"v1","addr":"172.21.15.154:6833","nonce":331320161}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/595493420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":595493420},{"type":"v1","addr":"172.21.15.179:6835","nonce":595493420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1656759292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1656759292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1656759292}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:34:38.799966+0000","modified":"2023-10-10T22:34:42.366478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/3472664042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3472664042},{"type":"v1","addr":"172.21.15.179:6834","nonce":3472664042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-10T22:37:06.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8898067050 msgr2=0x7f8898069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:06.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8898067050 0x7f8898069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b80b3b70 msgr2=0x7f88b8169ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b80b3b70 0x7f88b8169ba0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006fd0 tx=0x7f88a8017000 comp rx=0 tx=0).stop 2023-10-10T22:37:06.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 shutdown_connections 2023-10-10T22:37:06.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8898067050 0x7f8898069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88b8159100 0x7f88b815cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88b80b3b70 0x7f88b8169ba0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 --2- 172.21.15.154:0/479445492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b8142ea0 0x7f88b80c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.537+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 >> 172.21.15.154:0/479445492 conn(0x7f88b80ce430 msgr2=0x7f88b80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.538+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 shutdown_connections 2023-10-10T22:37:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.538+0000 7f88b759e700 1 -- 172.21.15.154:0/479445492 wait complete. 2023-10-10T22:37:06.542 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:06.538+0000 7f38b15fe180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:37:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 86 2023-10-10T22:37:06.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:06.637 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:06.635+0000 7f38b15fe180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:37:06.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.743+0000 7f6f9579d700 1 Processor -- start 2023-10-10T22:37:06.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.743+0000 7f6f9579d700 1 -- start start 2023-10-10T22:37:06.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.744+0000 7f6f9579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006d950 0x7f6f900c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.744+0000 7f6f9579d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f9006a0a0 0x7f6f900c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.744+0000 7f6f9579d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f9006dd20 0x7f6f900c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.744+0000 7f6f9579d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9006ae70 con 0x7f6f9006a0a0 2023-10-10T22:37:06.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f9579d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9006a540 con 0x7f6f9006dd20 2023-10-10T22:37:06.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f9579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9006a820 con 0x7f6f9006d950 2023-10-10T22:37:06.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f8f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f9006a0a0 0x7f6f900c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f8f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f9006a0a0 0x7f6f900c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35762/0 (socket says 172.21.15.154:35762) 2023-10-10T22:37:06.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/1981566090 learned_addr learned my addr 172.21.15.154:0/1981566090 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:06.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f94f9c700 1 --2- 172.21.15.154:0/1981566090 >> v2:172.21.15.179:3300/0 conn(0x7f6f9006dd20 0x7f6f900c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f8ffff700 1 --2- 172.21.15.154:0/1981566090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006d950 0x7f6f900c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/1981566090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006d950 msgr2=0x7f6f900c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:06.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/1981566090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006d950 0x7f6f900c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/1981566090 >> v2:172.21.15.179:3300/0 conn(0x7f6f9006dd20 msgr2=0x7f6f900c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:06.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/1981566090 >> v2:172.21.15.179:3300/0 conn(0x7f6f9006dd20 0x7f6f900c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.745+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/1981566090 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9006ab00 con 0x7f6f9006a0a0 2023-10-10T22:37:06.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.746+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/1981566090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 0x7f6f900c6c10 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f6f9006ade0 tx=0x7f6f84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f154719dfa3239 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:06.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.746+0000 7f6f8effd700 1 -- 172.21.15.154:0/1981566090 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400b640 con 0x7f6f9006a0a0 2023-10-10T22:37:06.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.746+0000 7f6f8effd700 1 -- 172.21.15.154:0/1981566090 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8400b7a0 con 0x7f6f9006a0a0 2023-10-10T22:37:06.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.746+0000 7f6f8effd700 1 -- 172.21.15.154:0/1981566090 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400bb60 con 0x7f6f9006a0a0 2023-10-10T22:37:06.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.747+0000 7f6f9579d700 1 -- 172.21.15.154:0/1981566090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 msgr2=0x7f6f900c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.747+0000 7f6f9579d700 1 --2- 172.21.15.154:0/1981566090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 0x7f6f900c6c10 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f6f9006ade0 tx=0x7f6f84009250 comp rx=0 tx=0).stop 2023-10-10T22:37:06.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.747+0000 7f6f9579d700 1 -- 172.21.15.154:0/1981566090 shutdown_connections 2023-10-10T22:37:06.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.747+0000 7f6f9579d700 1 --2- 172.21.15.154:0/1981566090 >> v2:172.21.15.179:3300/0 conn(0x7f6f9006dd20 0x7f6f900c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.747+0000 7f6f9579d700 1 --2- 172.21.15.154:0/1981566090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006d950 0x7f6f900c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.747+0000 7f6f9579d700 1 --2- 172.21.15.154:0/1981566090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 0x7f6f900c6c10 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.747+0000 7f6f9579d700 1 -- 172.21.15.154:0/1981566090 >> 172.21.15.154:0/1981566090 conn(0x7f6f900cc1f0 msgr2=0x7f6f900cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.747+0000 7f6f9579d700 1 -- 172.21.15.154:0/1981566090 shutdown_connections 2023-10-10T22:37:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.747+0000 7f6f9579d700 1 -- 172.21.15.154:0/1981566090 wait complete. 2023-10-10T22:37:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.748+0000 7f6f9579d700 1 Processor -- start 2023-10-10T22:37:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.748+0000 7f6f9579d700 1 -- start start 2023-10-10T22:37:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.749+0000 7f6f9579d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 0x7f6f901590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.749+0000 7f6f9579d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9006d950 0x7f6f900c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.749+0000 7f6f9579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006dd20 0x7f6f90152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.749+0000 7f6f9579d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900c4cb0 con 0x7f6f9006a0a0 2023-10-10T22:37:06.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.749+0000 7f6f9579d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900c4f90 con 0x7f6f9006d950 2023-10-10T22:37:06.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.749+0000 7f6f9579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900c5270 con 0x7f6f9006dd20 2023-10-10T22:37:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.749+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 0x7f6f901590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.749+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 0x7f6f901590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35764/0 (socket says 172.21.15.154:35764) 2023-10-10T22:37:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.749+0000 7f6f8ffff700 1 -- 172.21.15.154:0/692199390 learned_addr learned my addr 172.21.15.154:0/692199390 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9006d950 0x7f6f900c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f94f9c700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006dd20 0x7f6f90152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f8ffff700 1 -- 172.21.15.154:0/692199390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006dd20 msgr2=0x7f6f90152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f8ffff700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006dd20 0x7f6f90152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f8ffff700 1 -- 172.21.15.154:0/692199390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9006d950 msgr2=0x7f6f900c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f8ffff700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9006d950 0x7f6f900c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f8ffff700 1 -- 172.21.15.154:0/692199390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840094f0 con 0x7f6f9006a0a0 2023-10-10T22:37:06.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f8ffff700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 0x7f6f901590b0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000ec80 tx=0x7f6f800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:06.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f77fff700 1 -- 172.21.15.154:0/692199390 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000c850 con 0x7f6f9006a0a0 2023-10-10T22:37:06.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f77fff700 1 -- 172.21.15.154:0/692199390 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8000c9d0 con 0x7f6f9006a0a0 2023-10-10T22:37:06.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f900c5550 con 0x7f6f9006a0a0 2023-10-10T22:37:06.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.750+0000 7f6f77fff700 1 -- 172.21.15.154:0/692199390 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000cd90 con 0x7f6f9006a0a0 2023-10-10T22:37:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.751+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f900c4910 con 0x7f6f9006a0a0 2023-10-10T22:37:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.752+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9004c3c0 con 0x7f6f9006a0a0 2023-10-10T22:37:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.752+0000 7f6f77fff700 1 -- 172.21.15.154:0/692199390 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6f80013680 con 0x7f6f9006a0a0 2023-10-10T22:37:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.754+0000 7f6f77fff700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f7c067050 0x7f6f7c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.754+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f7c067050 msgr2=0x7f6f7c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.754+0000 7f6f77fff700 1 -- 172.21.15.154:0/692199390 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f6f80084c70 con 0x7f6f9006a0a0 2023-10-10T22:37:06.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.754+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f7c067050 0x7f6f7c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:06.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.758+0000 7f6f77fff700 1 -- 172.21.15.154:0/692199390 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f80051aa0 con 0x7f6f9006a0a0 2023-10-10T22:37:06.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.954+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f900c1410 con 0x7f6f9006a0a0 2023-10-10T22:37:06.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.955+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f7c067050 msgr2=0x7f6f7c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:06.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.955+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f7c067050 0x7f6f7c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:06.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.955+0000 7f6f77fff700 1 -- 172.21.15.154:0/692199390 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16679 (secure 0 0 0) 0x7f6f800550c0 con 0x7f6f9006a0a0 2023-10-10T22:37:06.958 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:06.958 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":196,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:05.506286+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:34:36.953199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-10T22:34:37.789582+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":196,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3779863535":"2023-10-11T22:34:59.532181+0000","172.21.15.154:0/3535334064":"2023-10-11T22:34:59.532181+0000","172.21.15.154:6837/132976":"2023-10-11T22:34:59.532181+0000","172.21.15.154:6836/132976":"2023-10-11T22:34:59.532181+0000","172.21.15.154:0/1651687972":"2023-10-11T22:34:59.532181+0000","172.21.15.154:0/4179903520":"2023-10-11T22:34:59.532181+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f7c067050 msgr2=0x7f6f7c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f7c067050 0x7f6f7c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 msgr2=0x7f6f901590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 0x7f6f901590b0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000ec80 tx=0x7f6f800091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 shutdown_connections 2023-10-10T22:37:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6f7c067050 0x7f6f7c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9006dd20 0x7f6f90152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9006a0a0 0x7f6f901590b0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 --2- 172.21.15.154:0/692199390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9006d950 0x7f6f900c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:06.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 >> 172.21.15.154:0/692199390 conn(0x7f6f900cc1f0 msgr2=0x7f6f900c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:06.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 shutdown_connections 2023-10-10T22:37:06.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:06.958+0000 7f6f9579d700 1 -- 172.21.15.154:0/692199390 wait complete. 2023-10-10T22:37:06.978 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T22:37:06.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:07.093 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:07.092+0000 7feabcfa8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:37:07.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.176+0000 7f78c959d700 1 Processor -- start 2023-10-10T22:37:07.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.176+0000 7f78c959d700 1 -- start start 2023-10-10T22:37:07.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.178+0000 7f78c959d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78c415daa0 0x7f78c406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.178+0000 7f78c959d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c406e8c0 con 0x7f78c40696c0 2023-10-10T22:37:07.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.178+0000 7f78c959d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c40ca740 con 0x7f78c415de70 2023-10-10T22:37:07.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.178+0000 7f78c959d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c406e5e0 con 0x7f78c415daa0 2023-10-10T22:37:07.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.179+0000 7f78c8d9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f78c40696c0 0x7f78c406ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45994/0 (socket says 172.21.15.154:45994) 2023-10-10T22:37:07.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.179+0000 7f78c8d9c700 1 -- 172.21.15.154:0/3357708012 learned_addr learned my addr 172.21.15.154:0/3357708012 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:07.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.179+0000 7f78c3fff700 1 --2- 172.21.15.154:0/3357708012 >> v2:172.21.15.154:3300/0 conn(0x7f78c415daa0 0x7f78c406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:07.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.180+0000 7f78c2ffd700 1 -- 172.21.15.154:0/3357708012 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706249118 0 0) 0x7f78c406e8c0 con 0x7f78c40696c0 2023-10-10T22:37:07.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.180+0000 7f78c2ffd700 1 -- 172.21.15.154:0/3357708012 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b0003570 con 0x7f78c40696c0 2023-10-10T22:37:07.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.180+0000 7f78c3fff700 1 -- 172.21.15.154:0/3357708012 >> v1:172.21.15.179:6789/0 conn(0x7f78c415de70 legacy=0x7f78c40c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.180+0000 7f78c3fff700 1 -- 172.21.15.154:0/3357708012 >> v1:172.21.15.154:6789/0 conn(0x7f78c40696c0 legacy=0x7f78c406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.180+0000 7f78c3fff700 1 -- 172.21.15.154:0/3357708012 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c40ca0f0 con 0x7f78c415daa0 2023-10-10T22:37:07.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.180+0000 7f78c3fff700 1 --2- 172.21.15.154:0/3357708012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415daa0 0x7f78c406e000 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0098e0 tx=0x7f78bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3ef34e2cb4914d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:07.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.181+0000 7f78c2ffd700 1 -- 172.21.15.154:0/3357708012 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc00b640 con 0x7f78c415daa0 2023-10-10T22:37:07.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.181+0000 7f78c2ffd700 1 -- 172.21.15.154:0/3357708012 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc00b7a0 con 0x7f78c415daa0 2023-10-10T22:37:07.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.182+0000 7f78c959d700 1 -- 172.21.15.154:0/3357708012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415daa0 msgr2=0x7f78c406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.182+0000 7f78c959d700 1 --2- 172.21.15.154:0/3357708012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415daa0 0x7f78c406e000 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0098e0 tx=0x7f78bc0091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.182+0000 7f78c959d700 1 -- 172.21.15.154:0/3357708012 shutdown_connections 2023-10-10T22:37:07.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.182+0000 7f78c959d700 1 --2- 172.21.15.154:0/3357708012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415daa0 0x7f78c406e000 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.182+0000 7f78c959d700 1 -- 172.21.15.154:0/3357708012 >> 172.21.15.154:0/3357708012 conn(0x7f78c40cc1f0 msgr2=0x7f78c40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:07.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.182+0000 7f78c959d700 1 -- 172.21.15.154:0/3357708012 shutdown_connections 2023-10-10T22:37:07.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.182+0000 7f78c959d700 1 -- 172.21.15.154:0/3357708012 wait complete. 2023-10-10T22:37:07.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.184+0000 7f78c959d700 1 Processor -- start 2023-10-10T22:37:07.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.185+0000 7f78c959d700 1 -- start start 2023-10-10T22:37:07.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78c40696c0 0x7f78c40c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c959d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415de70 0x7f78c4148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c959d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78c40c5e90 0x7f78c40c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c959d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c40afb60 con 0x7f78c415de70 2023-10-10T22:37:07.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c959d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c40aef90 con 0x7f78c40c5e90 2023-10-10T22:37:07.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c40c35d0 con 0x7f78c40696c0 2023-10-10T22:37:07.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c8d9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78c40c5e90 0x7f78c40c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:07.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78c40696c0 0x7f78c40c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:07.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c8d9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78c40c5e90 0x7f78c40c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:53616/0 (socket says 172.21.15.154:53616) 2023-10-10T22:37:07.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.186+0000 7f78c8d9c700 1 -- 172.21.15.154:0/4198045429 learned_addr learned my addr 172.21.15.154:0/4198045429 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:07.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.187+0000 7f78c8d9c700 1 -- 172.21.15.154:0/4198045429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78c40696c0 msgr2=0x7f78c40c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.187+0000 7f78c8d9c700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78c40696c0 0x7f78c40c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.187+0000 7f78c8d9c700 1 -- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415de70 msgr2=0x7f78c4148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.187+0000 7f78c37fe700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415de70 0x7f78c4148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:07.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.187+0000 7f78c8d9c700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415de70 0x7f78c4148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.187+0000 7f78c8d9c700 1 -- 172.21.15.154:0/4198045429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc009420 con 0x7f78c40c5e90 2023-10-10T22:37:07.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.187+0000 7f78c37fe700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415de70 0x7f78c4148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:07.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.187+0000 7f78c8d9c700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78c40c5e90 0x7f78c40c4250 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c580 tx=0x7f78ac007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:07.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.187+0000 7f78bbfff700 1 -- 172.21.15.154:0/4198045429 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac005c00 con 0x7f78c40c5e90 2023-10-10T22:37:07.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.188+0000 7f78bbfff700 1 -- 172.21.15.154:0/4198045429 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac005d60 con 0x7f78c40c5e90 2023-10-10T22:37:07.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.188+0000 7f78bbfff700 1 -- 172.21.15.154:0/4198045429 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac007320 con 0x7f78c40c5e90 2023-10-10T22:37:07.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.188+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c40af230 con 0x7f78c40c5e90 2023-10-10T22:37:07.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.188+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c40af7f0 con 0x7f78c40c5e90 2023-10-10T22:37:07.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.189+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c404c3c0 con 0x7f78c40c5e90 2023-10-10T22:37:07.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.191+0000 7f78bbfff700 1 -- 172.21.15.154:0/4198045429 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f78ac007690 con 0x7f78c40c5e90 2023-10-10T22:37:07.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.192+0000 7f78bbfff700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f78a4067050 0x7f78a4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.192+0000 7f78bbfff700 1 -- 172.21.15.154:0/4198045429 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f78ac083ec0 con 0x7f78c40c5e90 2023-10-10T22:37:07.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.192+0000 7f78c3fff700 1 -- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f78a4067050 msgr2=0x7f78a4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:07.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.193+0000 7f78c3fff700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f78a4067050 0x7f78a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:07.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.196+0000 7f78bbfff700 1 -- 172.21.15.154:0/4198045429 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78ac050cf0 con 0x7f78c40c5e90 2023-10-10T22:37:07.266 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:07.265+0000 7feabcfa8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:07.283 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:07.282+0000 7f38b15fe180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:37:07.362 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:07.362+0000 7feabcfa8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:37:07.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.394+0000 7f78c3fff700 1 -- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f78a4067050 msgr2=0x7f78a4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:07.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.394+0000 7f78c3fff700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f78a4067050 0x7f78a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:07.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.452+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78c40afca0 con 0x7f78c40c5e90 2023-10-10T22:37:07.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.453+0000 7f78bbfff700 1 -- 172.21.15.154:0/4198045429 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f78ac017020 con 0x7f78c40c5e90 2023-10-10T22:37:07.455 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:07.455 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/331320161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":331320161},{"type":"v1","addr":"172.21.15.154:6833","nonce":331320161}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/595493420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":595493420},{"type":"v1","addr":"172.21.15.179:6835","nonce":595493420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1656759292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1656759292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1656759292}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:34:38.799966+0000","modified":"2023-10-10T22:34:42.366478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/3472664042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3472664042},{"type":"v1","addr":"172.21.15.179:6834","nonce":3472664042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-10T22:37:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f78a4067050 msgr2=0x7f78a4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f78a4067050 0x7f78a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78c40c5e90 msgr2=0x7f78c40c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78c40c5e90 0x7f78c40c4250 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c580 tx=0x7f78ac007d50 comp rx=0 tx=0).stop 2023-10-10T22:37:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 shutdown_connections 2023-10-10T22:37:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f78a4067050 0x7f78a4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78c40c5e90 0x7f78c40c4250 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78c40696c0 0x7f78c40c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 --2- 172.21.15.154:0/4198045429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c415de70 0x7f78c4148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.455+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 >> 172.21.15.154:0/4198045429 conn(0x7f78c40cc1f0 msgr2=0x7f78c40c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.456+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 shutdown_connections 2023-10-10T22:37:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.456+0000 7f78c959d700 1 -- 172.21.15.154:0/4198045429 wait complete. 2023-10-10T22:37:07.460 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 86 2023-10-10T22:37:07.461 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:07.459+0000 7f38b15fe180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:07.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:07.564 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:07.562+0000 7f38b15fe180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:37:07.659 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:07.659+0000 7feabcfa8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:37:07.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.662+0000 7fc73f59d700 1 Processor -- start 2023-10-10T22:37:07.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.662+0000 7fc73f59d700 1 -- start start 2023-10-10T22:37:07.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73f59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc7380b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73f59d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc73815d230 0x7fc73815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73f59d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73815dbd0 con 0x7fc7381597f0 2023-10-10T22:37:07.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73f59d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7380b2980 con 0x7fc73815d230 2023-10-10T22:37:07.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73f59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7380b11d0 con 0x7fc738159420 2023-10-10T22:37:07.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73ed9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc73815d230 0x7fc73815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:07.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73ed9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc73815d230 0x7fc73815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35788/0 (socket says 172.21.15.154:35788) 2023-10-10T22:37:07.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73ed9c700 1 -- 172.21.15.154:0/1722110410 learned_addr learned my addr 172.21.15.154:0/1722110410 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:07.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73e59b700 1 --2- 172.21.15.154:0/1722110410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc7380b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:07.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.664+0000 7fc73ed9c700 1 -- 172.21.15.154:0/1722110410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 msgr2=0x7fc7380b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:07.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.665+0000 7fc73ed9c700 1 --2- 172.21.15.154:0/1722110410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc7380b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.665+0000 7fc73ed9c700 1 -- 172.21.15.154:0/1722110410 >> v1:172.21.15.154:6789/0 conn(0x7fc7381597f0 legacy=0x7fc7380b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.665+0000 7fc73ed9c700 1 -- 172.21.15.154:0/1722110410 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7380b14b0 con 0x7fc73815d230 2023-10-10T22:37:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.665+0000 7fc73d599700 1 -- 172.21.15.154:0/1722110410 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317396997 0 0) 0x7fc728001110 con 0x7fc7381597f0 2023-10-10T22:37:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.665+0000 7fc73e59b700 1 --2- 172.21.15.154:0/1722110410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc7380b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.665+0000 7fc73ed9c700 1 --2- 172.21.15.154:0/1722110410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73815d230 0x7fc73815d690 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fc730009f20 tx=0x7fc730009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1071c2ecf7cf55d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.665+0000 7fc73d599700 1 -- 172.21.15.154:0/1722110410 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73000e070 con 0x7fc73815d230 2023-10-10T22:37:07.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.665+0000 7fc73d599700 1 -- 172.21.15.154:0/1722110410 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73000b9d0 con 0x7fc73815d230 2023-10-10T22:37:07.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.665+0000 7fc73d599700 1 -- 172.21.15.154:0/1722110410 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300092e0 con 0x7fc73815d230 2023-10-10T22:37:07.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.666+0000 7fc73f59d700 1 -- 172.21.15.154:0/1722110410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73815d230 msgr2=0x7fc73815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.666+0000 7fc73f59d700 1 --2- 172.21.15.154:0/1722110410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73815d230 0x7fc73815d690 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fc730009f20 tx=0x7fc730009840 comp rx=0 tx=0).stop 2023-10-10T22:37:07.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.666+0000 7fc73f59d700 1 -- 172.21.15.154:0/1722110410 shutdown_connections 2023-10-10T22:37:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.666+0000 7fc73f59d700 1 --2- 172.21.15.154:0/1722110410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc73815d230 0x7fc73815d690 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.666+0000 7fc73f59d700 1 --2- 172.21.15.154:0/1722110410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc7380b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.666+0000 7fc73f59d700 1 -- 172.21.15.154:0/1722110410 >> 172.21.15.154:0/1722110410 conn(0x7fc7380d0660 msgr2=0x7fc7380d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.666+0000 7fc73f59d700 1 -- 172.21.15.154:0/1722110410 shutdown_connections 2023-10-10T22:37:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.666+0000 7fc73f59d700 1 -- 172.21.15.154:0/1722110410 wait complete. 2023-10-10T22:37:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.668+0000 7fc73f59d700 1 Processor -- start 2023-10-10T22:37:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.668+0000 7fc73f59d700 1 -- start start 2023-10-10T22:37:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73f59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc73815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73f59d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7381597f0 0x7fc7381532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73f59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc73815d230 0x7fc7380d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73f59d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73815c6c0 con 0x7fc7381597f0 2023-10-10T22:37:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73f59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73815bab0 con 0x7fc73815d230 2023-10-10T22:37:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73f59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73815bd90 con 0x7fc738159420 2023-10-10T22:37:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73e59b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc73815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73dd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7381597f0 0x7fc7381532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73e59b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc73815cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:48310/0 (socket says 172.21.15.154:48310) 2023-10-10T22:37:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73e59b700 1 -- 172.21.15.154:0/1342169250 learned_addr learned my addr 172.21.15.154:0/1342169250 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73ed9c700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc73815d230 0x7fc7380d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73e59b700 1 -- 172.21.15.154:0/1342169250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc73815d230 msgr2=0x7fc7380d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73e59b700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc73815d230 0x7fc7380d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73e59b700 1 -- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7381597f0 msgr2=0x7fc7381532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73e59b700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7381597f0 0x7fc7381532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.669+0000 7fc73e59b700 1 -- 172.21.15.154:0/1342169250 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc734009420 con 0x7fc738159420 2023-10-10T22:37:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.670+0000 7fc73e59b700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc73815cb50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc73400ec80 tx=0x7fc7340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.670+0000 7fc72e7fc700 1 -- 172.21.15.154:0/1342169250 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400c920 con 0x7fc738159420 2023-10-10T22:37:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.670+0000 7fc72e7fc700 1 -- 172.21.15.154:0/1342169250 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73400ca80 con 0x7fc738159420 2023-10-10T22:37:07.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.670+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc730009ae0 con 0x7fc738159420 2023-10-10T22:37:07.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.670+0000 7fc72e7fc700 1 -- 172.21.15.154:0/1342169250 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400ce00 con 0x7fc738159420 2023-10-10T22:37:07.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.670+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73815c350 con 0x7fc738159420 2023-10-10T22:37:07.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.671+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73815c9a0 con 0x7fc738159420 2023-10-10T22:37:07.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.672+0000 7fc72e7fc700 1 -- 172.21.15.154:0/1342169250 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fc734013680 con 0x7fc738159420 2023-10-10T22:37:07.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.673+0000 7fc72e7fc700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc71c067050 0x7fc71c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:07.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.673+0000 7fc72e7fc700 1 -- 172.21.15.154:0/1342169250 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fc7340851c0 con 0x7fc738159420 2023-10-10T22:37:07.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.673+0000 7fc73dd9a700 1 -- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc71c067050 msgr2=0x7fc71c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:07.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.673+0000 7fc73dd9a700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc71c067050 0x7fc71c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:07.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.677+0000 7fc72e7fc700 1 -- 172.21.15.154:0/1342169250 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc734051f50 con 0x7fc738159420 2023-10-10T22:37:07.756 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:07.755+0000 7feabcfa8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:37:07.872 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:07.871+0000 7f38b15fe180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:37:07.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.874+0000 7fc73dd9a700 1 -- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc71c067050 msgr2=0x7fc71c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:07.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.874+0000 7fc73dd9a700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc71c067050 0x7fc71c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:07.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.922+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc73804c3c0 con 0x7fc738159420 2023-10-10T22:37:07.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.923+0000 7fc72e7fc700 1 -- 172.21.15.154:0/1342169250 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fc734055570 con 0x7fc738159420 2023-10-10T22:37:07.924 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:07.925 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/331320161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":331320161},{"type":"v1","addr":"172.21.15.154:6833","nonce":331320161}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/595493420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":595493420},{"type":"v1","addr":"172.21.15.179:6835","nonce":595493420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1656759292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1656759292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1656759292}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:34:38.799966+0000","modified":"2023-10-10T22:34:42.366478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/3472664042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3472664042},{"type":"v1","addr":"172.21.15.179:6834","nonce":3472664042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-10T22:37:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc71c067050 msgr2=0x7fc71c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc71c067050 0x7fc71c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 msgr2=0x7fc73815cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:07.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc73815cb50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc73400ec80 tx=0x7fc7340091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 shutdown_connections 2023-10-10T22:37:07.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc71c067050 0x7fc71c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc73815d230 0x7fc7380d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc738159420 0x7fc73815cb50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 --2- 172.21.15.154:0/1342169250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7381597f0 0x7fc7381532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:07.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 >> 172.21.15.154:0/1342169250 conn(0x7fc7380d0660 msgr2=0x7fc738154230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:07.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 shutdown_connections 2023-10-10T22:37:07.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:07.925+0000 7fc73f59d700 1 -- 172.21.15.154:0/1342169250 wait complete. 2023-10-10T22:37:07.930 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 86 2023-10-10T22:37:07.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:07.975 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:07.973+0000 7f38b15fe180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.133+0000 7fb840f9d700 1 Processor -- start 2023-10-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.133+0000 7fb840f9d700 1 -- start start 2023-10-10T22:37:08.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb840f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c142ea0 0x7fb83c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb840f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb83c06c0f0 0x7fb83c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb840f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c0b40f0 con 0x7fb83c0ad870 2023-10-10T22:37:08.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb840f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83c069640 con 0x7fb83c06c0f0 2023-10-10T22:37:08.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb840f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c069920 con 0x7fb83c142ea0 2023-10-10T22:37:08.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb83affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb83c0ad870 0x7fb83c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46006/0 (socket says 172.21.15.154:46006) 2023-10-10T22:37:08.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb83affd700 1 -- 172.21.15.154:0/2491734030 learned_addr learned my addr 172.21.15.154:0/2491734030 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:08.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb83b7fe700 1 --2- 172.21.15.154:0/2491734030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c142ea0 0x7fb83c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb83bfff700 1 --2- 172.21.15.154:0/2491734030 >> v2:172.21.15.179:3300/0 conn(0x7fb83c06c0f0 0x7fb83c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.135+0000 7fb83a7fc700 1 -- 172.21.15.154:0/2491734030 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204002344 0 0) 0x7fb83c0b40f0 con 0x7fb83c0ad870 2023-10-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.136+0000 7fb83bfff700 1 -- 172.21.15.154:0/2491734030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c142ea0 msgr2=0x7fb83c0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.136+0000 7fb83bfff700 1 --2- 172.21.15.154:0/2491734030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c142ea0 0x7fb83c0b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.136+0000 7fb83bfff700 1 -- 172.21.15.154:0/2491734030 >> v1:172.21.15.154:6789/0 conn(0x7fb83c0ad870 legacy=0x7fb83c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.136+0000 7fb83bfff700 1 -- 172.21.15.154:0/2491734030 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c069c00 con 0x7fb83c06c0f0 2023-10-10T22:37:08.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.136+0000 7fb83b7fe700 1 --2- 172.21.15.154:0/2491734030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c142ea0 0x7fb83c0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:08.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.136+0000 7fb83bfff700 1 --2- 172.21.15.154:0/2491734030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c06c0f0 0x7fb83c06a120 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb834009e60 tx=0x7fb834009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e443f43ec1ad8d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:08.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.136+0000 7fb83a7fc700 1 -- 172.21.15.154:0/2491734030 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400e070 con 0x7fb83c06c0f0 2023-10-10T22:37:08.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.136+0000 7fb83a7fc700 1 -- 172.21.15.154:0/2491734030 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83400bb60 con 0x7fb83c06c0f0 2023-10-10T22:37:08.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.136+0000 7fb83a7fc700 1 -- 172.21.15.154:0/2491734030 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834012430 con 0x7fb83c06c0f0 2023-10-10T22:37:08.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.137+0000 7fb840f9d700 1 -- 172.21.15.154:0/2491734030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c06c0f0 msgr2=0x7fb83c06a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.137+0000 7fb840f9d700 1 --2- 172.21.15.154:0/2491734030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c06c0f0 0x7fb83c06a120 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb834009e60 tx=0x7fb834009780 comp rx=0 tx=0).stop 2023-10-10T22:37:08.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.137+0000 7fb840f9d700 1 -- 172.21.15.154:0/2491734030 shutdown_connections 2023-10-10T22:37:08.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.137+0000 7fb840f9d700 1 --2- 172.21.15.154:0/2491734030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c06c0f0 0x7fb83c06a120 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.137+0000 7fb840f9d700 1 --2- 172.21.15.154:0/2491734030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c142ea0 0x7fb83c0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.137+0000 7fb840f9d700 1 -- 172.21.15.154:0/2491734030 >> 172.21.15.154:0/2491734030 conn(0x7fb83c0ce430 msgr2=0x7fb83c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.137+0000 7fb840f9d700 1 -- 172.21.15.154:0/2491734030 shutdown_connections 2023-10-10T22:37:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.137+0000 7fb840f9d700 1 -- 172.21.15.154:0/2491734030 wait complete. 2023-10-10T22:37:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.138+0000 7fb840f9d700 1 Processor -- start 2023-10-10T22:37:08.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.138+0000 7fb840f9d700 1 -- start start 2023-10-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.139+0000 7fb840f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c06c0f0 0x7fb83c16a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.139+0000 7fb840f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb83c142ea0 0x7fb83c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.139+0000 7fb840f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c16ccd0 0x7fb83c15e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.139+0000 7fb840f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c1696a0 con 0x7fb83c142ea0 2023-10-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.139+0000 7fb840f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c16d190 con 0x7fb83c16ccd0 2023-10-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.139+0000 7fb840f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c16d470 con 0x7fb83c06c0f0 2023-10-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.139+0000 7fb83affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb83c142ea0 0x7fb83c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb83c142ea0 0x7fb83c15c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35802/0 (socket says 172.21.15.154:35802) 2023-10-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83affd700 1 -- 172.21.15.154:0/1111614876 learned_addr learned my addr 172.21.15.154:0/1111614876 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83bfff700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c16ccd0 0x7fb83c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83b7fe700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c06c0f0 0x7fb83c16a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83bfff700 1 -- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c06c0f0 msgr2=0x7fb83c16a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83bfff700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c06c0f0 0x7fb83c16a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83bfff700 1 -- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb83c142ea0 msgr2=0x7fb83c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83bfff700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb83c142ea0 0x7fb83c15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83bfff700 1 -- 172.21.15.154:0/1111614876 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c009420 con 0x7fb83c16ccd0 2023-10-10T22:37:08.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83b7fe700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c06c0f0 0x7fb83c16a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:08.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.140+0000 7fb83bfff700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c16ccd0 0x7fb83c15e520 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb83c06f1a0 tx=0x7fb834019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:08.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.141+0000 7fb8237fe700 1 -- 172.21.15.154:0/1111614876 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834012e60 con 0x7fb83c16ccd0 2023-10-10T22:37:08.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.141+0000 7fb8237fe700 1 -- 172.21.15.154:0/1111614876 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb834027470 con 0x7fb83c16ccd0 2023-10-10T22:37:08.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.141+0000 7fb8237fe700 1 -- 172.21.15.154:0/1111614876 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834027830 con 0x7fb83c16ccd0 2023-10-10T22:37:08.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.141+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb834009a20 con 0x7fb83c16ccd0 2023-10-10T22:37:08.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.141+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c16da30 con 0x7fb83c16ccd0 2023-10-10T22:37:08.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.142+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c16dc20 con 0x7fb83c16ccd0 2023-10-10T22:37:08.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.143+0000 7fb8237fe700 1 -- 172.21.15.154:0/1111614876 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fb834024070 con 0x7fb83c16ccd0 2023-10-10T22:37:08.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.143+0000 7fb8237fe700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb828067050 0x7fb828069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.144+0000 7fb8237fe700 1 -- 172.21.15.154:0/1111614876 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fb8340870d0 con 0x7fb83c16ccd0 2023-10-10T22:37:08.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.144+0000 7fb83b7fe700 1 -- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb828067050 msgr2=0x7fb828069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:08.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.144+0000 7fb83b7fe700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb828067050 0x7fb828069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:08.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.148+0000 7fb8237fe700 1 -- 172.21.15.154:0/1111614876 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb834053e60 con 0x7fb83c16ccd0 2023-10-10T22:37:08.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.345+0000 7fb83b7fe700 1 -- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb828067050 msgr2=0x7fb828069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:08.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.345+0000 7fb83b7fe700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb828067050 0x7fb828069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:08.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.350+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb83c04c3c0 con 0x7fb83c16ccd0 2023-10-10T22:37:08.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.351+0000 7fb8237fe700 1 -- 172.21.15.154:0/1111614876 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16679 (secure 0 0 0) 0x7fb834057480 con 0x7fb83c16ccd0 2023-10-10T22:37:08.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:08.355 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":196,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:05.506286+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:34:36.953199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-10T22:34:37.789582+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":196,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3779863535":"2023-10-11T22:34:59.532181+0000","172.21.15.154:0/3535334064":"2023-10-11T22:34:59.532181+0000","172.21.15.154:6837/132976":"2023-10-11T22:34:59.532181+0000","172.21.15.154:6836/132976":"2023-10-11T22:34:59.532181+0000","172.21.15.154:0/1651687972":"2023-10-11T22:34:59.532181+0000","172.21.15.154:0/4179903520":"2023-10-11T22:34:59.532181+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb828067050 msgr2=0x7fb828069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb828067050 0x7fb828069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c16ccd0 msgr2=0x7fb83c15e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c16ccd0 0x7fb83c15e520 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb83c06f1a0 tx=0x7fb834019000 comp rx=0 tx=0).stop 2023-10-10T22:37:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 shutdown_connections 2023-10-10T22:37:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb828067050 0x7fb828069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb83c16ccd0 0x7fb83c15e520 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb83c06c0f0 0x7fb83c16a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 --2- 172.21.15.154:0/1111614876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb83c142ea0 0x7fb83c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 >> 172.21.15.154:0/1111614876 conn(0x7fb83c0ce430 msgr2=0x7fb83c141ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 shutdown_connections 2023-10-10T22:37:08.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.354+0000 7fb840f9d700 1 -- 172.21.15.154:0/1111614876 wait complete. 2023-10-10T22:37:08.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T22:37:08.462 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:08.462+0000 7feabcfa8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:37:08.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.604+0000 7fc8f9fff700 1 Processor -- start 2023-10-10T22:37:08.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.604+0000 7fc8f9fff700 1 -- start start 2023-10-10T22:37:08.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.605+0000 7fc8f9fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8f40cbf30 0x7fc8f40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f9fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 0x7fc8f40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f9fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f40cc300 con 0x7fc8f40ccf90 2023-10-10T22:37:08.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f9fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f4156bf0 con 0x7fc8f40cbf30 2023-10-10T22:37:08.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f9fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40ae950 con 0x7fc8f40b1420 2023-10-10T22:37:08.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8f40cbf30 0x7fc8f40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8f40cbf30 0x7fc8f40ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35810/0 (socket says 172.21.15.154:35810) 2023-10-10T22:37:08.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f37fe700 1 -- 172.21.15.154:0/143131949 learned_addr learned my addr 172.21.15.154:0/143131949 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:08.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f3fff700 1 --2- 172.21.15.154:0/143131949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 0x7fc8f40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f37fe700 1 -- 172.21.15.154:0/143131949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 msgr2=0x7fc8f40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:08.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f37fe700 1 --2- 172.21.15.154:0/143131949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 0x7fc8f40c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f37fe700 1 -- 172.21.15.154:0/143131949 >> v1:172.21.15.179:6789/0 conn(0x7fc8f40ccf90 legacy=0x7fc8f40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.606+0000 7fc8f37fe700 1 -- 172.21.15.154:0/143131949 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40ad370 con 0x7fc8f40cbf30 2023-10-10T22:37:08.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f37fe700 1 --2- 172.21.15.154:0/143131949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40cbf30 0x7fc8f40ae410 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40099e0 tx=0x7fc8e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71954d123bd2630 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f27fc700 1 -- 172.21.15.154:0/143131949 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400b820 con 0x7fc8f40cbf30 2023-10-10T22:37:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f27fc700 1 -- 172.21.15.154:0/143131949 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400b980 con 0x7fc8f40cbf30 2023-10-10T22:37:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f27fc700 1 -- 172.21.15.154:0/143131949 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400bd20 con 0x7fc8f40cbf30 2023-10-10T22:37:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f9fff700 1 -- 172.21.15.154:0/143131949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40cbf30 msgr2=0x7fc8f40ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f9fff700 1 --2- 172.21.15.154:0/143131949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40cbf30 0x7fc8f40ae410 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40099e0 tx=0x7fc8e4009250 comp rx=0 tx=0).stop 2023-10-10T22:37:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f9fff700 1 -- 172.21.15.154:0/143131949 shutdown_connections 2023-10-10T22:37:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f9fff700 1 --2- 172.21.15.154:0/143131949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 0x7fc8f40c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f9fff700 1 --2- 172.21.15.154:0/143131949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40cbf30 0x7fc8f40ae410 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.607+0000 7fc8f9fff700 1 -- 172.21.15.154:0/143131949 >> 172.21.15.154:0/143131949 conn(0x7fc8f406a320 msgr2=0x7fc8f40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.608+0000 7fc8f9fff700 1 -- 172.21.15.154:0/143131949 shutdown_connections 2023-10-10T22:37:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.608+0000 7fc8f9fff700 1 -- 172.21.15.154:0/143131949 wait complete. 2023-10-10T22:37:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.609+0000 7fc8f9fff700 1 Processor -- start 2023-10-10T22:37:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.609+0000 7fc8f9fff700 1 -- start start 2023-10-10T22:37:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f9fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 0x7fc8f4150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f9fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40cbf30 0x7fc8f4150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f9fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40ccf90 0x7fc8f406e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f9fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40c5af0 con 0x7fc8f40ccf90 2023-10-10T22:37:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f9fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4150970 con 0x7fc8f40cbf30 2023-10-10T22:37:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f9fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4157c40 con 0x7fc8f40b1420 2023-10-10T22:37:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40ccf90 0x7fc8f406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40ccf90 0x7fc8f406e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35826/0 (socket says 172.21.15.154:35826) 2023-10-10T22:37:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f3fff700 1 -- 172.21.15.154:0/3998772521 learned_addr learned my addr 172.21.15.154:0/3998772521 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f37fe700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 0x7fc8f4150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.610+0000 7fc8f2ffd700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40cbf30 0x7fc8f4150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8f3fff700 1 -- 172.21.15.154:0/3998772521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 msgr2=0x7fc8f4150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8f3fff700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 0x7fc8f4150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8f3fff700 1 -- 172.21.15.154:0/3998772521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40cbf30 msgr2=0x7fc8f4150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8f3fff700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40cbf30 0x7fc8f4150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8f3fff700 1 -- 172.21.15.154:0/3998772521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e40094f0 con 0x7fc8f40ccf90 2023-10-10T22:37:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8f2ffd700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40cbf30 0x7fc8f4150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8f3fff700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40ccf90 0x7fc8f406e860 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec007f30 tx=0x7fc8ec0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8db7fe700 1 -- 172.21.15.154:0/3998772521 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00ec40 con 0x7fc8f40ccf90 2023-10-10T22:37:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8db7fe700 1 -- 172.21.15.154:0/3998772521 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec00eda0 con 0x7fc8f40ccf90 2023-10-10T22:37:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8db7fe700 1 -- 172.21.15.154:0/3998772521 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec014670 con 0x7fc8f40ccf90 2023-10-10T22:37:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f4157f20 con 0x7fc8f40ccf90 2023-10-10T22:37:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.611+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f40c5780 con 0x7fc8f40ccf90 2023-10-10T22:37:08.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.613+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f40c5c60 con 0x7fc8f40ccf90 2023-10-10T22:37:08.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.613+0000 7fc8db7fe700 1 -- 172.21.15.154:0/3998772521 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fc8ec014a20 con 0x7fc8f40ccf90 2023-10-10T22:37:08.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.614+0000 7fc8db7fe700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc8e0067050 0x7fc8e0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:08.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.614+0000 7fc8db7fe700 1 -- 172.21.15.154:0/3998772521 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fc8ec085140 con 0x7fc8f40ccf90 2023-10-10T22:37:08.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.614+0000 7fc8f37fe700 1 -- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc8e0067050 msgr2=0x7fc8e0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:08.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.614+0000 7fc8f37fe700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc8e0067050 0x7fc8e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:08.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.618+0000 7fc8db7fe700 1 -- 172.21.15.154:0/3998772521 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8ec051ed0 con 0x7fc8f40ccf90 2023-10-10T22:37:08.720 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:08.719+0000 7f38b15fe180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:37:08.749 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:08.748+0000 7feabcfa8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:37:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.815+0000 7fc8f37fe700 1 -- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc8e0067050 msgr2=0x7fc8e0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.815+0000 7fc8f37fe700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc8e0067050 0x7fc8e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:08.840 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:08.840+0000 7feabcfa8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:37:08.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.866+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc8f404c3c0 con 0x7fc8f40ccf90 2023-10-10T22:37:08.868 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T22:37:08.866+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T22:37:08.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.871+0000 7fc8db7fe700 1 -- 172.21.15.154:0/3998772521 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc8ec009a20 con 0x7fc8f40ccf90 2023-10-10T22:37:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc8e0067050 msgr2=0x7fc8e0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc8e0067050 0x7fc8e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40ccf90 msgr2=0x7fc8f406e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40ccf90 0x7fc8f406e860 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec007f30 tx=0x7fc8ec0098e0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 shutdown_connections 2023-10-10T22:37:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc8e0067050 0x7fc8e0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8f40ccf90 0x7fc8f406e860 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f40b1420 0x7fc8f4150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 --2- 172.21.15.154:0/3998772521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40cbf30 0x7fc8f4150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 >> 172.21.15.154:0/3998772521 conn(0x7fc8f406a320 msgr2=0x7fc8f40cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 shutdown_connections 2023-10-10T22:37:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:08.874+0000 7fc8f9fff700 1 -- 172.21.15.154:0/3998772521 wait complete. 2023-10-10T22:37:08.878 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T22:37:08.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T22:37:08.931 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T22:37:09.001 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:09.000+0000 7feabcfa8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:37:09.024 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:09.023+0000 7f38b15fe180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:37:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.085+0000 7f1948d9d700 1 Processor -- start 2023-10-10T22:37:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.086+0000 7f1948d9d700 1 -- start start 2023-10-10T22:37:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.087+0000 7f1948d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19440b16d0 0x7f19440b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.087+0000 7f1948d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19440b2080 con 0x7f19440b33b0 2023-10-10T22:37:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.087+0000 7f1948d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19440cfb00 con 0x7f19440b4e70 2023-10-10T22:37:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.087+0000 7f1948d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19440b5c40 con 0x7f19440b16d0 2023-10-10T22:37:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.087+0000 7f1943fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f19440b33b0 0x7f19440b37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46010/0 (socket says 172.21.15.154:46010) 2023-10-10T22:37:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.087+0000 7f1943fff700 1 -- 172.21.15.154:0/801367975 learned_addr learned my addr 172.21.15.154:0/801367975 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.087+0000 7f1942ffd700 1 --2- 172.21.15.154:0/801367975 >> v2:172.21.15.179:3300/0 conn(0x7f19440b16d0 0x7f19440b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:09.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.088+0000 7f1942ffd700 1 -- 172.21.15.154:0/801367975 >> v1:172.21.15.179:6789/0 conn(0x7f19440b4e70 legacy=0x7f19440ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.088+0000 7f1942ffd700 1 -- 172.21.15.154:0/801367975 >> v1:172.21.15.154:6789/0 conn(0x7f19440b33b0 legacy=0x7f19440b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.088+0000 7f1942ffd700 1 -- 172.21.15.154:0/801367975 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440b5f20 con 0x7f19440b16d0 2023-10-10T22:37:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.088+0000 7f19427fc700 1 -- 172.21.15.154:0/801367975 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857656785 0 0) 0x7f19440b2080 con 0x7f19440b33b0 2023-10-10T22:37:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.088+0000 7f1942ffd700 1 --2- 172.21.15.154:0/801367975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b16d0 0x7f19440b1b40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f19380098e0 tx=0x7f19380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=618cdec2c8b79807 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.088+0000 7f19427fc700 1 -- 172.21.15.154:0/801367975 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938009e80 con 0x7f19440b16d0 2023-10-10T22:37:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.088+0000 7f19427fc700 1 -- 172.21.15.154:0/801367975 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193800b860 con 0x7f19440b16d0 2023-10-10T22:37:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.088+0000 7f19427fc700 1 -- 172.21.15.154:0/801367975 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800bbe0 con 0x7f19440b16d0 2023-10-10T22:37:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.089+0000 7f1948d9d700 1 -- 172.21.15.154:0/801367975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b16d0 msgr2=0x7f19440b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.089+0000 7f1948d9d700 1 --2- 172.21.15.154:0/801367975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b16d0 0x7f19440b1b40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f19380098e0 tx=0x7f19380091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.089+0000 7f1948d9d700 1 -- 172.21.15.154:0/801367975 shutdown_connections 2023-10-10T22:37:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.089+0000 7f1948d9d700 1 --2- 172.21.15.154:0/801367975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b16d0 0x7f19440b1b40 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.089+0000 7f1948d9d700 1 -- 172.21.15.154:0/801367975 >> 172.21.15.154:0/801367975 conn(0x7f19440d10c0 msgr2=0x7f19440affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.089+0000 7f1948d9d700 1 -- 172.21.15.154:0/801367975 shutdown_connections 2023-10-10T22:37:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.089+0000 7f1948d9d700 1 -- 172.21.15.154:0/801367975 wait complete. 2023-10-10T22:37:09.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.091+0000 7f1948d9d700 1 Processor -- start 2023-10-10T22:37:09.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.091+0000 7f1948d9d700 1 -- start start 2023-10-10T22:37:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1948d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19440b16d0 0x7f194416a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1948d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b33b0 0x7f19440a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1948d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19440b4e70 0x7f19440a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1948d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194416d320 con 0x7f19440b4e70 2023-10-10T22:37:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1948d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19440c8880 con 0x7f19440b33b0 2023-10-10T22:37:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1948d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1944147e60 con 0x7f19440b16d0 2023-10-10T22:37:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1943fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19440b4e70 0x7f19440a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1942ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b33b0 0x7f19440a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1943fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19440b4e70 0x7f19440a7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35838/0 (socket says 172.21.15.154:35838) 2023-10-10T22:37:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1943fff700 1 -- 172.21.15.154:0/992059343 learned_addr learned my addr 172.21.15.154:0/992059343 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f19437fe700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19440b16d0 0x7f194416a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1942ffd700 1 -- 172.21.15.154:0/992059343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19440b16d0 msgr2=0x7f194416a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1942ffd700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19440b16d0 0x7f194416a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1942ffd700 1 -- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19440b4e70 msgr2=0x7f19440a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1942ffd700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19440b4e70 0x7f19440a7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1942ffd700 1 -- 172.21.15.154:0/992059343 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1938009420 con 0x7f19440b33b0 2023-10-10T22:37:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.092+0000 7f1943fff700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19440b4e70 0x7f19440a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.093+0000 7f1942ffd700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b33b0 0x7f19440a6f00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1938016000 tx=0x7f1938017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.093+0000 7f192b7fe700 1 -- 172.21.15.154:0/992059343 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800bbe0 con 0x7f19440b33b0 2023-10-10T22:37:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.093+0000 7f192b7fe700 1 -- 172.21.15.154:0/992059343 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938000d10 con 0x7f19440b33b0 2023-10-10T22:37:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.093+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19440c7c70 con 0x7f19440b33b0 2023-10-10T22:37:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.093+0000 7f192b7fe700 1 -- 172.21.15.154:0/992059343 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938011650 con 0x7f19440b33b0 2023-10-10T22:37:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.093+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19440c8230 con 0x7f19440b33b0 2023-10-10T22:37:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.094+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1944088990 con 0x7f19440b33b0 2023-10-10T22:37:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.095+0000 7f192b7fe700 1 -- 172.21.15.154:0/992059343 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f1938011a00 con 0x7f19440b33b0 2023-10-10T22:37:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.096+0000 7f192b7fe700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 0x7f1930069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.096+0000 7f192b7fe700 1 -- 172.21.15.154:0/992059343 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6569+0+0 (secure 0 0 0) 0x7f1938086290 con 0x7f19440b33b0 2023-10-10T22:37:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.096+0000 7f19437fe700 1 -- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 msgr2=0x7f1930069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.096+0000 7f19437fe700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 0x7f1930069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.100+0000 7f192b7fe700 1 -- 172.21.15.154:0/992059343 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1938052ff0 con 0x7f19440b33b0 2023-10-10T22:37:09.104 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:09.103+0000 7feabcfa8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:37:09.122 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:09.121+0000 7f38b15fe180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:37:09.283 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:09.281+0000 7f38b15fe180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:37:09.291 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:09.290+0000 7feabcfa8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:37:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.297+0000 7f19437fe700 1 -- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 msgr2=0x7f1930069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.297+0000 7f19437fe700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 0x7f1930069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:09.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.343+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f194404bb80 con 0x7f19440b33b0 2023-10-10T22:37:09.381 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:09.380+0000 7feabcfa8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:37:09.391 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:09.390+0000 7f38b15fe180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:37:09.472 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:09.471+0000 7feabcfa8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:37:09.566 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:09.565+0000 7feabcfa8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:37:09.586 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:09.583+0000 7f38b15fe180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:37:09.681 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:09.680+0000 7f38b15fe180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:37:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.698+0000 7f19437fe700 1 -- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 msgr2=0x7f1930069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.698+0000 7f19437fe700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 0x7f1930069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T22:37:09.775 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:09.774+0000 7f38b15fe180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:37:09.869 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:09.868+0000 7f38b15fe180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:37:09.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.873+0000 7f192b7fe700 1 -- 172.21.15.154:0/992059343 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1938011cb0 con 0x7f19440b33b0 2023-10-10T22:37:09.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 msgr2=0x7f1930069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:09.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 0x7f1930069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:09.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b33b0 msgr2=0x7f19440a6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:09.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b33b0 0x7f19440a6f00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1938016000 tx=0x7f1938017000 comp rx=0 tx=0).stop 2023-10-10T22:37:09.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 shutdown_connections 2023-10-10T22:37:09.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1930067050 0x7f1930069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:09.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19440b4e70 0x7f19440a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:09.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19440b16d0 0x7f194416a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:09.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 --2- 172.21.15.154:0/992059343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19440b33b0 0x7f19440a6f00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:09.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 >> 172.21.15.154:0/992059343 conn(0x7f19440d10c0 msgr2=0x7f1944159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:09.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 shutdown_connections 2023-10-10T22:37:09.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:09.876+0000 7f1948d9d700 1 -- 172.21.15.154:0/992059343 wait complete. 2023-10-10T22:37:09.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T22:37:10.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.096+0000 7f58387ff700 1 Processor -- start 2023-10-10T22:37:10.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.096+0000 7f58387ff700 1 -- start start 2023-10-10T22:37:10.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.097+0000 7f58387ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58301563b0 0x7f5830156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.097+0000 7f58387ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 0x7f58300acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.097+0000 7f58387ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5830068890 0x7f58300c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.097+0000 7f58387ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583015a9b0 con 0x7f5830068890 2023-10-10T22:37:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.097+0000 7f58387ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583015ac90 con 0x7f58301563b0 2023-10-10T22:37:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.097+0000 7f58387ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583015af70 con 0x7f583015a440 2023-10-10T22:37:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5836d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5830068890 0x7f58300c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5836d9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5830068890 0x7f58300c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35940/0 (socket says 172.21.15.154:35940) 2023-10-10T22:37:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5836d9c700 1 -- 172.21.15.154:0/1240689066 learned_addr learned my addr 172.21.15.154:0/1240689066 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5835d9a700 1 --2- 172.21.15.154:0/1240689066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 0x7f58300acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f583659b700 1 --2- 172.21.15.154:0/1240689066 >> v2:172.21.15.179:3300/0 conn(0x7f58301563b0 0x7f5830156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5836d9c700 1 -- 172.21.15.154:0/1240689066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 msgr2=0x7f58300acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5836d9c700 1 --2- 172.21.15.154:0/1240689066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 0x7f58300acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5836d9c700 1 -- 172.21.15.154:0/1240689066 >> v2:172.21.15.179:3300/0 conn(0x7f58301563b0 msgr2=0x7f5830156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5836d9c700 1 --2- 172.21.15.154:0/1240689066 >> v2:172.21.15.179:3300/0 conn(0x7f58301563b0 0x7f5830156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5836d9c700 1 -- 172.21.15.154:0/1240689066 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583015b250 con 0x7f5830068890 2023-10-10T22:37:10.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.098+0000 7f5836d9c700 1 --2- 172.21.15.154:0/1240689066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830068890 0x7f58300c8230 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f583006a9f0 tx=0x7f5828009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51703fa87b06fa57 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f5835599700 1 -- 172.21.15.154:0/1240689066 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582800e070 con 0x7f5830068890 2023-10-10T22:37:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f5835599700 1 -- 172.21.15.154:0/1240689066 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582800ba50 con 0x7f5830068890 2023-10-10T22:37:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f5835599700 1 -- 172.21.15.154:0/1240689066 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280092e0 con 0x7f5830068890 2023-10-10T22:37:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f58387ff700 1 -- 172.21.15.154:0/1240689066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830068890 msgr2=0x7f58300c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f58387ff700 1 --2- 172.21.15.154:0/1240689066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830068890 0x7f58300c8230 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f583006a9f0 tx=0x7f5828009840 comp rx=0 tx=0).stop 2023-10-10T22:37:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f58387ff700 1 -- 172.21.15.154:0/1240689066 shutdown_connections 2023-10-10T22:37:10.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f58387ff700 1 --2- 172.21.15.154:0/1240689066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830068890 0x7f58300c8230 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f58387ff700 1 --2- 172.21.15.154:0/1240689066 >> v2:172.21.15.179:3300/0 conn(0x7f58301563b0 0x7f5830156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f58387ff700 1 --2- 172.21.15.154:0/1240689066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 0x7f58300acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f58387ff700 1 -- 172.21.15.154:0/1240689066 >> 172.21.15.154:0/1240689066 conn(0x7f58300c8f90 msgr2=0x7f58300c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:10.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f58387ff700 1 -- 172.21.15.154:0/1240689066 shutdown_connections 2023-10-10T22:37:10.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.099+0000 7f58387ff700 1 -- 172.21.15.154:0/1240689066 wait complete. 2023-10-10T22:37:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.101+0000 7f58387ff700 1 Processor -- start 2023-10-10T22:37:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.101+0000 7f58387ff700 1 -- start start 2023-10-10T22:37:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f58387ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5830068890 0x7f5830149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f58387ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58301563b0 0x7f58300adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f58387ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 0x7f58300ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:10.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f58387ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58300c02e0 con 0x7f58301563b0 2023-10-10T22:37:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f58387ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58300c26e0 con 0x7f5830068890 2023-10-10T22:37:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f58387ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58300c29c0 con 0x7f583015a440 2023-10-10T22:37:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f5835d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58301563b0 0x7f58300adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f5835d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58301563b0 0x7f58300adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35942/0 (socket says 172.21.15.154:35942) 2023-10-10T22:37:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f5835d9a700 1 -- 172.21.15.154:0/4182383762 learned_addr learned my addr 172.21.15.154:0/4182383762 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:10.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f583659b700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5830068890 0x7f5830149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.102+0000 7f5836d9c700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 0x7f58300ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f5835d9a700 1 -- 172.21.15.154:0/4182383762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 msgr2=0x7f58300ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f5835d9a700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 0x7f58300ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f5835d9a700 1 -- 172.21.15.154:0/4182383762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5830068890 msgr2=0x7f5830149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:10.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f5835d9a700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5830068890 0x7f5830149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f5835d9a700 1 -- 172.21.15.154:0/4182383762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828009ae0 con 0x7f58301563b0 2023-10-10T22:37:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f5835d9a700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58301563b0 0x7f58300adef0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f582000d860 tx=0x7f5820008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f58267fc700 1 -- 172.21.15.154:0/4182383762 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200125f0 con 0x7f58301563b0 2023-10-10T22:37:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f58267fc700 1 -- 172.21.15.154:0/4182383762 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820012770 con 0x7f58301563b0 2023-10-10T22:37:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58300c2ca0 con 0x7f58301563b0 2023-10-10T22:37:10.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f58267fc700 1 -- 172.21.15.154:0/4182383762 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820012b30 con 0x7f58301563b0 2023-10-10T22:37:10.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.103+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5830149ff0 con 0x7f58301563b0 2023-10-10T22:37:10.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.104+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58300718b0 con 0x7f58301563b0 2023-10-10T22:37:10.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.105+0000 7f58267fc700 1 -- 172.21.15.154:0/4182383762 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 108) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f5820013480 con 0x7f58301563b0 2023-10-10T22:37:10.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.106+0000 7f58267fc700 1 -- 172.21.15.154:0/4182383762 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6827+0+0 (secure 0 0 0) 0x7f5820084920 con 0x7f58301563b0 2023-10-10T22:37:10.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.110+0000 7f58267fc700 1 -- 172.21.15.154:0/4182383762 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5820051a00 con 0x7f58301563b0 2023-10-10T22:37:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.299+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f583006d6a0 con 0x7f58301563b0 2023-10-10T22:37:10.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.886+0000 7f58267fc700 1 -- 172.21.15.154:0/4182383762 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 109) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f58200514b0 con 0x7f58301563b0 2023-10-10T22:37:10.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.886+0000 7f58267fc700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f581406cb60 0x7f581406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:10.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.888+0000 7f583659b700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f581406cb60 0x7f581406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:10.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.890+0000 7f583659b700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f581406cb60 0x7f581406ef40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f582c006fd0 tx=0x7f582c008040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:10.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.898+0000 7f58267fc700 1 -- 172.21.15.154:0/4182383762 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v199) v1 ==== 181+0+0 (secure 0 0 0) 0x7f58200704a0 con 0x7f58301563b0 2023-10-10T22:37:10.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f581406cb60 msgr2=0x7f581406ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:10.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f581406cb60 0x7f581406ef40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f582c006fd0 tx=0x7f582c008040 comp rx=0 tx=0).stop 2023-10-10T22:37:10.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58301563b0 msgr2=0x7f58300adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:10.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58301563b0 0x7f58300adef0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f582000d860 tx=0x7f5820008040 comp rx=0 tx=0).stop 2023-10-10T22:37:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 shutdown_connections 2023-10-10T22:37:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f581406cb60 0x7f581406ef40 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583015a440 0x7f58300ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5830068890 0x7f5830149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 --2- 172.21.15.154:0/4182383762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58301563b0 0x7f58300adef0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:10.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 >> 172.21.15.154:0/4182383762 conn(0x7f58300c8f90 msgr2=0x7f583006dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:10.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 shutdown_connections 2023-10-10T22:37:10.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:10.901+0000 7f58387ff700 1 -- 172.21.15.154:0/4182383762 wait complete. 2023-10-10T22:37:10.905 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T22:37:10.921 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T22:37:11.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.105+0000 7f1e0bdff700 1 Processor -- start 2023-10-10T22:37:11.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.105+0000 7f1e0bdff700 1 -- start start 2023-10-10T22:37:11.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.106+0000 7f1e0bdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1e040c8490 0x7f1e040c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:11.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.106+0000 7f1e0bdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e04069e20 0x7f1e041569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:11.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.106+0000 7f1e0bdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e040ac030 con 0x7f1e04069a50 2023-10-10T22:37:11.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.106+0000 7f1e0bdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e040ab820 con 0x7f1e04069e20 2023-10-10T22:37:11.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.106+0000 7f1e0bdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0406dbb0 con 0x7f1e040c8490 2023-10-10T22:37:11.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e09b9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1e04069a50 0x7f1e0415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46016/0 (socket says 172.21.15.154:46016) 2023-10-10T22:37:11.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e09b9b700 1 -- 172.21.15.154:0/2704016317 learned_addr learned my addr 172.21.15.154:0/2704016317 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:11.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e0a39c700 1 --2- 172.21.15.154:0/2704016317 >> v2:172.21.15.154:3300/0 conn(0x7f1e04069e20 0x7f1e041569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:11.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e0939a700 1 --2- 172.21.15.154:0/2704016317 >> v2:172.21.15.179:3300/0 conn(0x7f1e040c8490 0x7f1e040c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:11.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e08b99700 1 -- 172.21.15.154:0/2704016317 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212490437 0 0) 0x7f1e00001110 con 0x7f1e04069a50 2023-10-10T22:37:11.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e08b99700 1 -- 172.21.15.154:0/2704016317 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df0003570 con 0x7f1e04069a50 2023-10-10T22:37:11.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e0a39c700 1 -- 172.21.15.154:0/2704016317 >> v2:172.21.15.179:3300/0 conn(0x7f1e040c8490 msgr2=0x7f1e040c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:11.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e0a39c700 1 --2- 172.21.15.154:0/2704016317 >> v2:172.21.15.179:3300/0 conn(0x7f1e040c8490 0x7f1e040c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:11.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e0a39c700 1 -- 172.21.15.154:0/2704016317 >> v1:172.21.15.154:6789/0 conn(0x7f1e04069a50 legacy=0x7f1e0415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:11.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e0a39c700 1 -- 172.21.15.154:0/2704016317 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040aba70 con 0x7f1e04069e20 2023-10-10T22:37:11.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.107+0000 7f1e0a39c700 1 --2- 172.21.15.154:0/2704016317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 0x7f1e041569b0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f1e0406b920 tx=0x7f1dfc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7847cce2029aa2f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:11.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e08b99700 1 -- 172.21.15.154:0/2704016317 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc00e070 con 0x7f1e04069e20 2023-10-10T22:37:11.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e08b99700 1 -- 172.21.15.154:0/2704016317 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc00bb60 con 0x7f1e04069e20 2023-10-10T22:37:11.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e08b99700 1 -- 172.21.15.154:0/2704016317 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc012430 con 0x7f1e04069e20 2023-10-10T22:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e0bdff700 1 -- 172.21.15.154:0/2704016317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 msgr2=0x7f1e041569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e0bdff700 1 --2- 172.21.15.154:0/2704016317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 0x7f1e041569b0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f1e0406b920 tx=0x7f1dfc009780 comp rx=0 tx=0).stop 2023-10-10T22:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e0bdff700 1 -- 172.21.15.154:0/2704016317 shutdown_connections 2023-10-10T22:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e0bdff700 1 --2- 172.21.15.154:0/2704016317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 0x7f1e041569b0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e0bdff700 1 --2- 172.21.15.154:0/2704016317 >> v2:172.21.15.179:3300/0 conn(0x7f1e040c8490 0x7f1e040c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:11.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e0bdff700 1 -- 172.21.15.154:0/2704016317 >> 172.21.15.154:0/2704016317 conn(0x7f1e040c8f90 msgr2=0x7f1e040c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:11.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e0bdff700 1 -- 172.21.15.154:0/2704016317 shutdown_connections 2023-10-10T22:37:11.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.108+0000 7f1e0bdff700 1 -- 172.21.15.154:0/2704016317 wait complete. 2023-10-10T22:37:11.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.110+0000 7f1e0bdff700 1 Processor -- start 2023-10-10T22:37:11.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.110+0000 7f1e0bdff700 1 -- start start 2023-10-10T22:37:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0bdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04069a50 0x7f1e0414f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0bdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 0x7f1e04148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e040c8490 0x7f1e0414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0bdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0414fe10 con 0x7f1e04069e20 2023-10-10T22:37:11.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0bdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e041499a0 con 0x7f1e04069a50 2023-10-10T22:37:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0414a140 con 0x7f1e040c8490 2023-10-10T22:37:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0939a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 0x7f1e04148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0939a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 0x7f1e04148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35958/0 (socket says 172.21.15.154:35958) 2023-10-10T22:37:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0939a700 1 -- 172.21.15.154:0/248578883 learned_addr learned my addr 172.21.15.154:0/248578883 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:11.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e09b9b700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04069a50 0x7f1e0414f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.111+0000 7f1e0a39c700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e040c8490 0x7f1e0414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1e0939a700 1 -- 172.21.15.154:0/248578883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e040c8490 msgr2=0x7f1e0414b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1e0939a700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e040c8490 0x7f1e0414b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1e0939a700 1 -- 172.21.15.154:0/248578883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04069a50 msgr2=0x7f1e0414f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:11.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1e0939a700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04069a50 0x7f1e0414f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1e0939a700 1 -- 172.21.15.154:0/248578883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc009a20 con 0x7f1e04069e20 2023-10-10T22:37:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1e0939a700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 0x7f1e04148db0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f1df400d890 tx=0x7f1df4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1df9ffb700 1 -- 172.21.15.154:0/248578883 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df40125f0 con 0x7f1e04069e20 2023-10-10T22:37:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1df9ffb700 1 -- 172.21.15.154:0/248578883 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df4012750 con 0x7f1e04069e20 2023-10-10T22:37:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0414a420 con 0x7f1e04069e20 2023-10-10T22:37:11.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1df9ffb700 1 -- 172.21.15.154:0/248578883 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4012ad0 con 0x7f1e04069e20 2023-10-10T22:37:11.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.112+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0414a9e0 con 0x7f1e04069e20 2023-10-10T22:37:11.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.113+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e040718b0 con 0x7f1e04069e20 2023-10-10T22:37:11.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.114+0000 7f1df9ffb700 1 -- 172.21.15.154:0/248578883 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 109) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f1df401e460 con 0x7f1e04069e20 2023-10-10T22:37:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.115+0000 7f1df9ffb700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1de8066d80 0x7f1de8069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.115+0000 7f1df9ffb700 1 -- 172.21.15.154:0/248578883 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f1df4084b70 con 0x7f1e04069e20 2023-10-10T22:37:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.115+0000 7f1e09b9b700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1de8066d80 0x7f1de8069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.116+0000 7f1e09b9b700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1de8066d80 0x7f1de8069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1e00007fd0 tx=0x7f1e00007bf0 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.119+0000 7f1df9ffb700 1 -- 172.21.15.154:0/248578883 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1df4051d10 con 0x7f1e04069e20 2023-10-10T22:37:11.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:11.310+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e040c3100 con 0x7f1e04069e20 2023-10-10T22:37:12.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.260+0000 7f1df9ffb700 1 -- 172.21.15.154:0/248578883 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v200) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1df4055330 con 0x7f1e04069e20 2023-10-10T22:37:12.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.264+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1de8066d80 msgr2=0x7f1de8069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.264+0000 7f1e0bdff700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1de8066d80 0x7f1de8069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1e00007fd0 tx=0x7f1e00007bf0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.264+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 msgr2=0x7f1e04148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.264+0000 7f1e0bdff700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 0x7f1e04148db0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f1df400d890 tx=0x7f1df4008040 comp rx=0 tx=0).stop 2023-10-10T22:37:12.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.265+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 shutdown_connections 2023-10-10T22:37:12.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.265+0000 7f1e0bdff700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1de8066d80 0x7f1de8069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.265+0000 7f1e0bdff700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e040c8490 0x7f1e0414b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.265+0000 7f1e0bdff700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e04069a50 0x7f1e0414f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.265+0000 7f1e0bdff700 1 --2- 172.21.15.154:0/248578883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e04069e20 0x7f1e04148db0 secure :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f1df400d890 tx=0x7f1df4008040 comp rx=0 tx=0).stop 2023-10-10T22:37:12.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.265+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 >> 172.21.15.154:0/248578883 conn(0x7f1e040c8f90 msgr2=0x7f1e040cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:12.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.265+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 shutdown_connections 2023-10-10T22:37:12.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.265+0000 7f1e0bdff700 1 -- 172.21.15.154:0/248578883 wait complete. 2023-10-10T22:37:12.272 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T22:37:12.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T22:37:12.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.476+0000 7f1f06d9d700 1 Processor -- start 2023-10-10T22:37:12.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.476+0000 7f1f06d9d700 1 -- start start 2023-10-10T22:37:12.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.477+0000 7f1f06d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 0x7f1f00069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.477+0000 7f1f06d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f000c9f30 con 0x7f1f0006a020 2023-10-10T22:37:12.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.477+0000 7f1f06d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f000ca470 con 0x7f1f00159a60 2023-10-10T22:37:12.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.477+0000 7f1f06d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0006dfc0 con 0x7f1f000ccc00 2023-10-10T22:37:12.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.477+0000 7f1f0659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1f0006a020 0x7f1f000cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46026/0 (socket says 172.21.15.154:46026) 2023-10-10T22:37:12.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f0659c700 1 -- 172.21.15.154:0/510395999 learned_addr learned my addr 172.21.15.154:0/510395999 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f0559a700 1 --2- 172.21.15.154:0/510395999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 0x7f1f00069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f04d99700 1 -- 172.21.15.154:0/510395999 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248375779 0 0) 0x7f1f000c9f30 con 0x7f1f0006a020 2023-10-10T22:37:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f04d99700 1 -- 172.21.15.154:0/510395999 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eec003570 con 0x7f1f0006a020 2023-10-10T22:37:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f04d99700 1 -- 172.21.15.154:0/510395999 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262720379 0 0) 0x7f1f000ca470 con 0x7f1f00159a60 2023-10-10T22:37:12.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f04d99700 1 -- 172.21.15.154:0/510395999 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f000c9f30 con 0x7f1f00159a60 2023-10-10T22:37:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f0559a700 1 -- 172.21.15.154:0/510395999 >> v1:172.21.15.179:6789/0 conn(0x7f1f00159a60 legacy=0x7f1f000c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f0559a700 1 -- 172.21.15.154:0/510395999 >> v1:172.21.15.154:6789/0 conn(0x7f1f0006a020 legacy=0x7f1f000cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f04d99700 1 -- 172.21.15.154:0/510395999 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3698945192 0 0) 0x7f1eec003570 con 0x7f1f0006a020 2023-10-10T22:37:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.478+0000 7f1f0559a700 1 -- 172.21.15.154:0/510395999 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f000ca750 con 0x7f1f000ccc00 2023-10-10T22:37:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.479+0000 7f1f0559a700 1 --2- 172.21.15.154:0/510395999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 0x7f1f00069ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009910 tx=0x7f1ef00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74b201f6d277b658 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.479+0000 7f1f04d99700 1 -- 172.21.15.154:0/510395999 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef80017f0 con 0x7f1f000ccc00 2023-10-10T22:37:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.479+0000 7f1f04d99700 1 -- 172.21.15.154:0/510395999 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef0011420 con 0x7f1f000ccc00 2023-10-10T22:37:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.479+0000 7f1f04d99700 1 -- 172.21.15.154:0/510395999 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef00117c0 con 0x7f1f000ccc00 2023-10-10T22:37:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.479+0000 7f1f06d9d700 1 -- 172.21.15.154:0/510395999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 msgr2=0x7f1f00069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.479+0000 7f1f06d9d700 1 --2- 172.21.15.154:0/510395999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 0x7f1f00069ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009910 tx=0x7f1ef00091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.479+0000 7f1f06d9d700 1 -- 172.21.15.154:0/510395999 shutdown_connections 2023-10-10T22:37:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.479+0000 7f1f06d9d700 1 --2- 172.21.15.154:0/510395999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 0x7f1f00069ae0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.479+0000 7f1f06d9d700 1 -- 172.21.15.154:0/510395999 >> 172.21.15.154:0/510395999 conn(0x7f1f0006baa0 msgr2=0x7f1f0006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.480+0000 7f1f06d9d700 1 -- 172.21.15.154:0/510395999 shutdown_connections 2023-10-10T22:37:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.480+0000 7f1f06d9d700 1 -- 172.21.15.154:0/510395999 wait complete. 2023-10-10T22:37:12.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.481+0000 7f1f06d9d700 1 Processor -- start 2023-10-10T22:37:12.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.481+0000 7f1f06d9d700 1 -- start start 2023-10-10T22:37:12.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f06d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f0006a020 0x7f1f00157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f06d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 0x7f1f000c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f06d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f00159a60 0x7f1f00147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f06d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000c58e0 con 0x7f1f0006a020 2023-10-10T22:37:12.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f06d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000c5bc0 con 0x7f1f00159a60 2023-10-10T22:37:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f06d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000c5ea0 con 0x7f1f000ccc00 2023-10-10T22:37:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f05d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f0006a020 0x7f1f00157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f05d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f0006a020 0x7f1f00157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35964/0 (socket says 172.21.15.154:35964) 2023-10-10T22:37:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f0559a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 0x7f1f000c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f05d9b700 1 -- 172.21.15.154:0/1964331130 learned_addr learned my addr 172.21.15.154:0/1964331130 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.482+0000 7f1f0659c700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f00159a60 0x7f1f00147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1f05d9b700 1 -- 172.21.15.154:0/1964331130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 msgr2=0x7f1f000c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1f05d9b700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 0x7f1f000c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1f05d9b700 1 -- 172.21.15.154:0/1964331130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f00159a60 msgr2=0x7f1f00147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1f05d9b700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f00159a60 0x7f1f00147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1f05d9b700 1 -- 172.21.15.154:0/1964331130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef0009420 con 0x7f1f0006a020 2023-10-10T22:37:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1f05d9b700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f0006a020 0x7f1f00157270 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00c580 tx=0x7f1efc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1ef5ffb700 1 -- 172.21.15.154:0/1964331130 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc010510 con 0x7f1f0006a020 2023-10-10T22:37:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1ef5ffb700 1 -- 172.21.15.154:0/1964331130 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc010690 con 0x7f1f0006a020 2023-10-10T22:37:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1ef5ffb700 1 -- 172.21.15.154:0/1964331130 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc010a50 con 0x7f1f0006a020 2023-10-10T22:37:12.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f000c6180 con 0x7f1f0006a020 2023-10-10T22:37:12.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.483+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f001577b0 con 0x7f1f0006a020 2023-10-10T22:37:12.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.484+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0006eba0 con 0x7f1f0006a020 2023-10-10T22:37:12.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.485+0000 7f1ef5ffb700 1 -- 172.21.15.154:0/1964331130 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1efc01b400 con 0x7f1f0006a020 2023-10-10T22:37:12.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.486+0000 7f1ef5ffb700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1ee4066f30 0x7f1ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.486+0000 7f1ef5ffb700 1 -- 172.21.15.154:0/1964331130 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f1efc084190 con 0x7f1f0006a020 2023-10-10T22:37:12.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.486+0000 7f1f0559a700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1ee4066f30 0x7f1ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.487+0000 7f1f0559a700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1ee4066f30 0x7f1ee40693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00030c0 tx=0x7f1ef0016000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:12.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.491+0000 7f1ef5ffb700 1 -- 172.21.15.154:0/1964331130 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1efc051250 con 0x7f1f0006a020 2023-10-10T22:37:12.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.683+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1f000caa30 con 0x7f1f0006a020 2023-10-10T22:37:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.687+0000 7f1ef5ffb700 1 -- 172.21.15.154:0/1964331130 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1efc054870 con 0x7f1f0006a020 2023-10-10T22:37:12.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1ee4066f30 msgr2=0x7f1ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1ee4066f30 0x7f1ee40693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00030c0 tx=0x7f1ef0016000 comp rx=0 tx=0).stop 2023-10-10T22:37:12.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f0006a020 msgr2=0x7f1f00157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f0006a020 0x7f1f00157270 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00c580 tx=0x7f1efc007e10 comp rx=0 tx=0).stop 2023-10-10T22:37:12.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 shutdown_connections 2023-10-10T22:37:12.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1ee4066f30 0x7f1ee40693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f00159a60 0x7f1f00147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f0006a020 0x7f1f00157270 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 --2- 172.21.15.154:0/1964331130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f000ccc00 0x7f1f000c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 >> 172.21.15.154:0/1964331130 conn(0x7f1f0006baa0 msgr2=0x7f1f00159e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:12.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 shutdown_connections 2023-10-10T22:37:12.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.690+0000 7f1f06d9d700 1 -- 172.21.15.154:0/1964331130 wait complete. 2023-10-10T22:37:12.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T22:37:12.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.891+0000 7f7d95dff700 1 Processor -- start 2023-10-10T22:37:12.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.891+0000 7f7d95dff700 1 -- start start 2023-10-10T22:37:12.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.892+0000 7f7d95dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900c83f0 0x7f7d900c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.892+0000 7f7d95dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7d901568e0 0x7f7d900ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.892+0000 7f7d95dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9015b0d0 con 0x7f7d900ccee0 2023-10-10T22:37:12.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.892+0000 7f7d95dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d900c7a60 con 0x7f7d901568e0 2023-10-10T22:37:12.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.892+0000 7f7d95dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9015a4c0 con 0x7f7d900c83f0 2023-10-10T22:37:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.893+0000 7f7d8ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7d901568e0 0x7f7d900ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.893+0000 7f7d8f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900c83f0 0x7f7d900c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.893+0000 7f7d8f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900c83f0 0x7f7d900c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:48536/0 (socket says 172.21.15.154:48536) 2023-10-10T22:37:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.893+0000 7f7d8f7fe700 1 -- 172.21.15.154:0/3039227161 learned_addr learned my addr 172.21.15.154:0/3039227161 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.893+0000 7f7d8e7fc700 1 -- 172.21.15.154:0/3039227161 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208680124 0 0) 0x7f7d9015b0d0 con 0x7f7d900ccee0 2023-10-10T22:37:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.893+0000 7f7d8e7fc700 1 -- 172.21.15.154:0/3039227161 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d78003570 con 0x7f7d900ccee0 2023-10-10T22:37:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.894+0000 7f7d8ffff700 1 -- 172.21.15.154:0/3039227161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900c83f0 msgr2=0x7f7d900c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.894+0000 7f7d8ffff700 1 --2- 172.21.15.154:0/3039227161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900c83f0 0x7f7d900c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.894+0000 7f7d8ffff700 1 -- 172.21.15.154:0/3039227161 >> v1:172.21.15.179:6789/0 conn(0x7f7d900ccee0 legacy=0x7f7d901561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.894+0000 7f7d8ffff700 1 -- 172.21.15.154:0/3039227161 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9015a7a0 con 0x7f7d901568e0 2023-10-10T22:37:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.894+0000 7f7d8f7fe700 1 --2- 172.21.15.154:0/3039227161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900c83f0 0x7f7d900c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.894+0000 7f7d8ffff700 1 --2- 172.21.15.154:0/3039227161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d901568e0 0x7f7d900ca1e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009e60 tx=0x7f7d88009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f9e65ed31f367d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:12.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.894+0000 7f7d8e7fc700 1 -- 172.21.15.154:0/3039227161 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800e070 con 0x7f7d901568e0 2023-10-10T22:37:12.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.894+0000 7f7d8e7fc700 1 -- 172.21.15.154:0/3039227161 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8800bab0 con 0x7f7d901568e0 2023-10-10T22:37:12.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.894+0000 7f7d8e7fc700 1 -- 172.21.15.154:0/3039227161 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800be70 con 0x7f7d901568e0 2023-10-10T22:37:12.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.895+0000 7f7d95dff700 1 -- 172.21.15.154:0/3039227161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d901568e0 msgr2=0x7f7d900ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.895+0000 7f7d95dff700 1 --2- 172.21.15.154:0/3039227161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d901568e0 0x7f7d900ca1e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009e60 tx=0x7f7d88009780 comp rx=0 tx=0).stop 2023-10-10T22:37:12.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.895+0000 7f7d95dff700 1 -- 172.21.15.154:0/3039227161 shutdown_connections 2023-10-10T22:37:12.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.895+0000 7f7d95dff700 1 --2- 172.21.15.154:0/3039227161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d901568e0 0x7f7d900ca1e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.895+0000 7f7d95dff700 1 --2- 172.21.15.154:0/3039227161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900c83f0 0x7f7d900c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.895+0000 7f7d95dff700 1 -- 172.21.15.154:0/3039227161 >> 172.21.15.154:0/3039227161 conn(0x7f7d90068e10 msgr2=0x7f7d900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:12.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.895+0000 7f7d95dff700 1 -- 172.21.15.154:0/3039227161 shutdown_connections 2023-10-10T22:37:12.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.895+0000 7f7d95dff700 1 -- 172.21.15.154:0/3039227161 wait complete. 2023-10-10T22:37:12.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.896+0000 7f7d95dff700 1 Processor -- start 2023-10-10T22:37:12.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.897+0000 7f7d95dff700 1 -- start start 2023-10-10T22:37:12.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d95dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d900c83f0 0x7f7d9014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d95dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900ccee0 0x7f7d900c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d95dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d901568e0 0x7f7d900c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d95dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900c6950 con 0x7f7d900c83f0 2023-10-10T22:37:12.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d95dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d901576c0 con 0x7f7d900ccee0 2023-10-10T22:37:12.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d95dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9016b410 con 0x7f7d901568e0 2023-10-10T22:37:12.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d8f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d900c83f0 0x7f7d9014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d8f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d900c83f0 0x7f7d9014ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35970/0 (socket says 172.21.15.154:35970) 2023-10-10T22:37:12.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d8f7fe700 1 -- 172.21.15.154:0/2456801303 learned_addr learned my addr 172.21.15.154:0/2456801303 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:12.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d8ffff700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d901568e0 0x7f7d900c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.898+0000 7f7d8effd700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900ccee0 0x7f7d900c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d8f7fe700 1 -- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d901568e0 msgr2=0x7f7d900c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d8f7fe700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d901568e0 0x7f7d900c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d8f7fe700 1 -- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900ccee0 msgr2=0x7f7d900c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:12.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d8f7fe700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900ccee0 0x7f7d900c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:12.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d8f7fe700 1 -- 172.21.15.154:0/2456801303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d800094f0 con 0x7f7d900c83f0 2023-10-10T22:37:12.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d8ffff700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d901568e0 0x7f7d900c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:12.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d8effd700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900ccee0 0x7f7d900c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:12.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d8f7fe700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d900c83f0 0x7f7d9014ded0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000ec50 tx=0x7f7d80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:12.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d777fe700 1 -- 172.21.15.154:0/2456801303 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000c970 con 0x7f7d900c83f0 2023-10-10T22:37:12.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d777fe700 1 -- 172.21.15.154:0/2456801303 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8000cad0 con 0x7f7d900c83f0 2023-10-10T22:37:12.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d777fe700 1 -- 172.21.15.154:0/2456801303 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000ce50 con 0x7f7d900c83f0 2023-10-10T22:37:12.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d88009a20 con 0x7f7d900c83f0 2023-10-10T22:37:12.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.899+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d90157070 con 0x7f7d900c83f0 2023-10-10T22:37:12.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.900+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9004c3c0 con 0x7f7d900c83f0 2023-10-10T22:37:12.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.901+0000 7f7d777fe700 1 -- 172.21.15.154:0/2456801303 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d80013680 con 0x7f7d900c83f0 2023-10-10T22:37:12.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.902+0000 7f7d777fe700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7d7c066f30 0x7f7d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:12.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.902+0000 7f7d777fe700 1 -- 172.21.15.154:0/2456801303 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f7d80084e00 con 0x7f7d900c83f0 2023-10-10T22:37:12.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.902+0000 7f7d8effd700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7d7c066f30 0x7f7d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:12.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.903+0000 7f7d8effd700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7d7c066f30 0x7f7d7c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7d900aef30 tx=0x7f7d84009040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:12.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:12.906+0000 7f7d777fe700 1 -- 172.21.15.154:0/2456801303 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d80051ec0 con 0x7f7d900c83f0 2023-10-10T22:37:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.095+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f7d9015aa80 con 0x7f7d900c83f0 2023-10-10T22:37:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.100+0000 7f7d777fe700 1 -- 172.21.15.154:0/2456801303 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v68) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7d800554e0 con 0x7f7d900c83f0 2023-10-10T22:37:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7d7c066f30 msgr2=0x7f7d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7d7c066f30 0x7f7d7c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7d900aef30 tx=0x7f7d84009040 comp rx=0 tx=0).stop 2023-10-10T22:37:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d900c83f0 msgr2=0x7f7d9014ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d900c83f0 0x7f7d9014ded0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000ec50 tx=0x7f7d80009250 comp rx=0 tx=0).stop 2023-10-10T22:37:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 shutdown_connections 2023-10-10T22:37:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7d7c066f30 0x7f7d7c0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d901568e0 0x7f7d900c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d900c83f0 0x7f7d9014ded0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 --2- 172.21.15.154:0/2456801303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900ccee0 0x7f7d900c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 >> 172.21.15.154:0/2456801303 conn(0x7f7d90068e10 msgr2=0x7f7d90151690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.102+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 shutdown_connections 2023-10-10T22:37:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.103+0000 7f7d95dff700 1 -- 172.21.15.154:0/2456801303 wait complete. 2023-10-10T22:37:13.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T22:37:13.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.314+0000 7f50683ff700 1 Processor -- start 2023-10-10T22:37:13.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.314+0000 7f50683ff700 1 -- start start 2023-10-10T22:37:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.316+0000 7f50683ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50600c83f0 0x7f50600c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.316+0000 7f50683ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506015b0d0 con 0x7f50600ccee0 2023-10-10T22:37:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.316+0000 7f50683ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50600c7a60 con 0x7f50601568e0 2023-10-10T22:37:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.316+0000 7f50683ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506015a4c0 con 0x7f50600c83f0 2023-10-10T22:37:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.316+0000 7f506599a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f50600ccee0 0x7f50601561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46042/0 (socket says 172.21.15.154:46042) 2023-10-10T22:37:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.316+0000 7f506599a700 1 -- 172.21.15.154:0/3770064885 learned_addr learned my addr 172.21.15.154:0/3770064885 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.316+0000 7f506619b700 1 --2- 172.21.15.154:0/3770064885 >> v2:172.21.15.179:3300/0 conn(0x7f50600c83f0 0x7f50600c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.316+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364590350 0 0) 0x7f506015b0d0 con 0x7f50600ccee0 2023-10-10T22:37:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.316+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f504c003570 con 0x7f50600ccee0 2023-10-10T22:37:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3987737428 0 0) 0x7f504c003570 con 0x7f50600ccee0 2023-10-10T22:37:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 >> v2:172.21.15.179:3300/0 conn(0x7f50600c83f0 msgr2=0x7f50600c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 --2- 172.21.15.154:0/3770064885 >> v2:172.21.15.179:3300/0 conn(0x7f50600c83f0 0x7f50600c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 >> v1:172.21.15.179:6789/0 conn(0x7f50601568e0 legacy=0x7f50600ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506015a7a0 con 0x7f50600ccee0 2023-10-10T22:37:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f5050001470 con 0x7f50600ccee0 2023-10-10T22:37:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 >> v1:172.21.15.154:6789/0 conn(0x7f50600ccee0 legacy=0x7f50601561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c003a60 0x7f504c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504c004810 0x7f504c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f504c0051c0 0x7f504c00dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506015a4c0 con 0x7f504c004810 2023-10-10T22:37:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c00e2e0 con 0x7f504c003a60 2023-10-10T22:37:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c00e4a0 con 0x7f504c0051c0 2023-10-10T22:37:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f506599a700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504c004810 0x7f504c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f506619b700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c003a60 0x7f504c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.317+0000 7f506699c700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f504c0051c0 0x7f504c00dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f506599a700 1 -- 172.21.15.154:0/3770064885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f504c0051c0 msgr2=0x7f504c00dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f506599a700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f504c0051c0 0x7f504c00dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f506599a700 1 -- 172.21.15.154:0/3770064885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c003a60 msgr2=0x7f504c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f506599a700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c003a60 0x7f504c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f506599a700 1 -- 172.21.15.154:0/3770064885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c003570 con 0x7f504c004810 2023-10-10T22:37:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f506619b700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c003a60 0x7f504c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f506699c700 1 -- 172.21.15.154:0/3770064885 reap_dead start 2023-10-10T22:37:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f506599a700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504c004810 0x7f504c004c80 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f505000c3c0 tx=0x7f5050001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3c6ad76a23d871 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505000cc90 con 0x7f504c004810 2023-10-10T22:37:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505000cdf0 con 0x7f504c004810 2023-10-10T22:37:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.318+0000 7f5065199700 1 -- 172.21.15.154:0/3770064885 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5050005b50 con 0x7f504c004810 2023-10-10T22:37:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.319+0000 7f50683ff700 1 -- 172.21.15.154:0/3770064885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504c004810 msgr2=0x7f504c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.319+0000 7f50683ff700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504c004810 0x7f504c004c80 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f505000c3c0 tx=0x7f5050001e50 comp rx=0 tx=0).stop 2023-10-10T22:37:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.319+0000 7f50683ff700 1 -- 172.21.15.154:0/3770064885 shutdown_connections 2023-10-10T22:37:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.319+0000 7f50683ff700 1 --2- 172.21.15.154:0/3770064885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504c004810 0x7f504c004c80 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.319+0000 7f50683ff700 1 -- 172.21.15.154:0/3770064885 >> 172.21.15.154:0/3770064885 conn(0x7f5060068e10 msgr2=0x7f50600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.319+0000 7f50683ff700 1 -- 172.21.15.154:0/3770064885 shutdown_connections 2023-10-10T22:37:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.319+0000 7f50683ff700 1 -- 172.21.15.154:0/3770064885 wait complete. 2023-10-10T22:37:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.320+0000 7f50683ff700 1 Processor -- start 2023-10-10T22:37:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.320+0000 7f50683ff700 1 -- start start 2023-10-10T22:37:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f50683ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c004810 0x7f5060154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f50683ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50600c3690 0x7f5060152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f50683ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5060152d90 0x7f5060153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f50683ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060150850 con 0x7f5060152d90 2023-10-10T22:37:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f50683ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060154760 con 0x7f504c004810 2023-10-10T22:37:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f50683ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600c3c00 con 0x7f50600c3690 2023-10-10T22:37:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f506699c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5060152d90 0x7f5060153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f506699c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5060152d90 0x7f5060153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35978/0 (socket says 172.21.15.154:35978) 2023-10-10T22:37:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f506699c700 1 -- 172.21.15.154:0/1225252540 learned_addr learned my addr 172.21.15.154:0/1225252540 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f506619b700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c004810 0x7f5060154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.321+0000 7f506599a700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50600c3690 0x7f5060152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f506699c700 1 -- 172.21.15.154:0/1225252540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50600c3690 msgr2=0x7f5060152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f506699c700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50600c3690 0x7f5060152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f506699c700 1 -- 172.21.15.154:0/1225252540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c004810 msgr2=0x7f5060154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f506699c700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c004810 0x7f5060154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f506699c700 1 -- 172.21.15.154:0/1225252540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50600c3ee0 con 0x7f5060152d90 2023-10-10T22:37:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f506699c700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5060152d90 0x7f5060153200 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f50600c6b00 tx=0x7f5058001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f50567fc700 1 -- 172.21.15.154:0/1225252540 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058006ba0 con 0x7f5060152d90 2023-10-10T22:37:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f50567fc700 1 -- 172.21.15.154:0/1225252540 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5058006d00 con 0x7f5060152d90 2023-10-10T22:37:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50600c41c0 con 0x7f5060152d90 2023-10-10T22:37:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f50567fc700 1 -- 172.21.15.154:0/1225252540 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800c7f0 con 0x7f5060152d90 2023-10-10T22:37:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.322+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50600c4780 con 0x7f5060152d90 2023-10-10T22:37:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.323+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506004c3c0 con 0x7f5060152d90 2023-10-10T22:37:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.324+0000 7f50567fc700 1 -- 172.21.15.154:0/1225252540 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f505800cb60 con 0x7f5060152d90 2023-10-10T22:37:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.325+0000 7f50567fc700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.325+0000 7f50567fc700 1 -- 172.21.15.154:0/1225252540 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f5058084550 con 0x7f5060152d90 2023-10-10T22:37:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.325+0000 7f506619b700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.326+0000 7f506619b700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5044066f30 0x7f50440693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f505c009720 tx=0x7f505c0091a0 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.329+0000 7f50567fc700 1 -- 172.21.15.154:0/1225252540 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5058051610 con 0x7f5060152d90 2023-10-10T22:37:13.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.520+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f506015aa80 con 0x7f5060152d90 2023-10-10T22:37:13.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.525+0000 7f50567fc700 1 -- 172.21.15.154:0/1225252540 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v69) v1 ==== 120+0+0 (secure 0 0 0) 0x7f5058054c30 con 0x7f5060152d90 2023-10-10T22:37:13.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5044066f30 msgr2=0x7f50440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5044066f30 0x7f50440693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f505c009720 tx=0x7f505c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5060152d90 msgr2=0x7f5060153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5060152d90 0x7f5060153200 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f50600c6b00 tx=0x7f5058001640 comp rx=0 tx=0).stop 2023-10-10T22:37:13.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 shutdown_connections 2023-10-10T22:37:13.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5044066f30 0x7f50440693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5060152d90 0x7f5060153200 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504c004810 0x7f5060154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 --2- 172.21.15.154:0/1225252540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50600c3690 0x7f5060152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.527+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 >> 172.21.15.154:0/1225252540 conn(0x7f5060068e10 msgr2=0x7f5060069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.528+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 shutdown_connections 2023-10-10T22:37:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.528+0000 7f50683ff700 1 -- 172.21.15.154:0/1225252540 wait complete. 2023-10-10T22:37:13.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-10T22:37:13.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.728+0000 7fc317bff700 1 Processor -- start 2023-10-10T22:37:13.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.729+0000 7fc317bff700 1 -- start start 2023-10-10T22:37:13.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc317bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc317bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc3101579f0 0x7fc3100abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc317bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3100cb300 con 0x7fc3100ae680 2023-10-10T22:37:13.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc317bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31006fc30 con 0x7fc3101579f0 2023-10-10T22:37:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc317bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100cc260 con 0x7fc3100b1850 2023-10-10T22:37:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc31599b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc31619c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc3101579f0 0x7fc3100abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc31599b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:48580/0 (socket says 172.21.15.154:48580) 2023-10-10T22:37:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc31599b700 1 -- 172.21.15.154:0/2050537514 learned_addr learned my addr 172.21.15.154:0/2050537514 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.730+0000 7fc31519a700 1 --1- 172.21.15.154:0/2050537514 >> v1:172.21.15.179:6789/0 conn(0x7fc3100ae680 0x7fc3101572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:37494/0 (socket says 172.21.15.154:37494) 2023-10-10T22:37:13.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.731+0000 7fc31599b700 1 -- 172.21.15.154:0/2050537514 >> v2:172.21.15.179:3300/0 conn(0x7fc3101579f0 msgr2=0x7fc3100abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:13.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.731+0000 7fc31599b700 1 --2- 172.21.15.154:0/2050537514 >> v2:172.21.15.179:3300/0 conn(0x7fc3101579f0 0x7fc3100abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.731+0000 7fc31599b700 1 -- 172.21.15.154:0/2050537514 >> v1:172.21.15.179:6789/0 conn(0x7fc3100ae680 legacy=0x7fc3101572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.731+0000 7fc31599b700 1 -- 172.21.15.154:0/2050537514 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100cb5e0 con 0x7fc3100b1850 2023-10-10T22:37:13.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.731+0000 7fc31619c700 1 --2- 172.21.15.154:0/2050537514 >> v2:172.21.15.179:3300/0 conn(0x7fc3101579f0 0x7fc3100abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:13.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.731+0000 7fc31599b700 1 --2- 172.21.15.154:0/2050537514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100b1c20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0099b0 tx=0x7fc30c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600bbd064520607f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:13.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.731+0000 7fc314999700 1 -- 172.21.15.154:0/2050537514 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c009ea0 con 0x7fc3100b1850 2023-10-10T22:37:13.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.731+0000 7fc314999700 1 -- 172.21.15.154:0/2050537514 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c00b860 con 0x7fc3100b1850 2023-10-10T22:37:13.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.731+0000 7fc314999700 1 -- 172.21.15.154:0/2050537514 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00bc00 con 0x7fc3100b1850 2023-10-10T22:37:13.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.732+0000 7fc317bff700 1 -- 172.21.15.154:0/2050537514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 msgr2=0x7fc3100b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.732+0000 7fc317bff700 1 --2- 172.21.15.154:0/2050537514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100b1c20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0099b0 tx=0x7fc30c009250 comp rx=0 tx=0).stop 2023-10-10T22:37:13.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.732+0000 7fc317bff700 1 -- 172.21.15.154:0/2050537514 shutdown_connections 2023-10-10T22:37:13.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.732+0000 7fc317bff700 1 --2- 172.21.15.154:0/2050537514 >> v2:172.21.15.179:3300/0 conn(0x7fc3101579f0 0x7fc3100abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.732+0000 7fc317bff700 1 --2- 172.21.15.154:0/2050537514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100b1c20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.732+0000 7fc317bff700 1 -- 172.21.15.154:0/2050537514 >> 172.21.15.154:0/2050537514 conn(0x7fc31006a320 msgr2=0x7fc3100cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:13.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.732+0000 7fc317bff700 1 -- 172.21.15.154:0/2050537514 shutdown_connections 2023-10-10T22:37:13.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.732+0000 7fc317bff700 1 -- 172.21.15.154:0/2050537514 wait complete. 2023-10-10T22:37:13.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.733+0000 7fc317bff700 1 Processor -- start 2023-10-10T22:37:13.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.734+0000 7fc317bff700 1 -- start start 2023-10-10T22:37:13.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.734+0000 7fc317bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100ae680 0x7fc31016bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.734+0000 7fc317bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc317bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3101579f0 0x7fc31013fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc317bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100aac20 con 0x7fc3101579f0 2023-10-10T22:37:13.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc317bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100aa010 con 0x7fc3100ae680 2023-10-10T22:37:13.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc317bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100aa2f0 con 0x7fc3100b1850 2023-10-10T22:37:13.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31619c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3101579f0 0x7fc31013fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31619c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3101579f0 0x7fc31013fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35984/0 (socket says 172.21.15.154:35984) 2023-10-10T22:37:13.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31619c700 1 -- 172.21.15.154:0/1443445084 learned_addr learned my addr 172.21.15.154:0/1443445084 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:13.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31599b700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100ae680 0x7fc31016bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31519a700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31619c700 1 -- 172.21.15.154:0/1443445084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 msgr2=0x7fc3100a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31619c700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31619c700 1 -- 172.21.15.154:0/1443445084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100ae680 msgr2=0x7fc31016bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:13.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31619c700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100ae680 0x7fc31016bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:13.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.735+0000 7fc31619c700 1 -- 172.21.15.154:0/1443445084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308009a20 con 0x7fc3101579f0 2023-10-10T22:37:13.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.736+0000 7fc31619c700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3101579f0 0x7fc31013fe60 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fc308009f20 tx=0x7fc30800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:13.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.736+0000 7fc305ffb700 1 -- 172.21.15.154:0/1443445084 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800cb70 con 0x7fc3101579f0 2023-10-10T22:37:13.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.736+0000 7fc305ffb700 1 -- 172.21.15.154:0/1443445084 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30800f040 con 0x7fc3101579f0 2023-10-10T22:37:13.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.736+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c0094f0 con 0x7fc3101579f0 2023-10-10T22:37:13.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.736+0000 7fc305ffb700 1 -- 172.21.15.154:0/1443445084 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308014480 con 0x7fc3101579f0 2023-10-10T22:37:13.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.736+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3100aa8b0 con 0x7fc3101579f0 2023-10-10T22:37:13.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.737+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3100aad90 con 0x7fc3101579f0 2023-10-10T22:37:13.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.738+0000 7fc305ffb700 1 -- 172.21.15.154:0/1443445084 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc308003020 con 0x7fc3101579f0 2023-10-10T22:37:13.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.738+0000 7fc305ffb700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc2f4066f30 0x7fc2f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:13.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.739+0000 7fc305ffb700 1 -- 172.21.15.154:0/1443445084 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5975+0+0 (secure 0 0 0) 0x7fc308084f40 con 0x7fc3101579f0 2023-10-10T22:37:13.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.739+0000 7fc31599b700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc2f4066f30 0x7fc2f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:13.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.739+0000 7fc31599b700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc2f4066f30 0x7fc2f40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0099b0 tx=0x7fc30c017000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:13.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:13.742+0000 7fc305ffb700 1 -- 172.21.15.154:0/1443445084 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc308052000 con 0x7fc3101579f0 2023-10-10T22:37:14.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.006+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fc31004c3c0 con 0x7fc3101579f0 2023-10-10T22:37:14.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.264+0000 7fc305ffb700 1 -- 172.21.15.154:0/1443445084 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3063) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc308055620 con 0x7fc3101579f0 2023-10-10T22:37:14.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.266+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc2f4066f30 msgr2=0x7fc2f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:14.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.266+0000 7fc317bff700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc2f4066f30 0x7fc2f40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0099b0 tx=0x7fc30c017000 comp rx=0 tx=0).stop 2023-10-10T22:37:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.266+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3101579f0 msgr2=0x7fc31013fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.266+0000 7fc317bff700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3101579f0 0x7fc31013fe60 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fc308009f20 tx=0x7fc30800b040 comp rx=0 tx=0).stop 2023-10-10T22:37:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.267+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 shutdown_connections 2023-10-10T22:37:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.267+0000 7fc317bff700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc2f4066f30 0x7fc2f40693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.267+0000 7fc317bff700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3101579f0 0x7fc31013fe60 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.267+0000 7fc317bff700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100ae680 0x7fc31016bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.267+0000 7fc317bff700 1 --2- 172.21.15.154:0/1443445084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100b1850 0x7fc3100a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.267+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 >> 172.21.15.154:0/1443445084 conn(0x7fc31006a320 msgr2=0x7fc3100abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.267+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 shutdown_connections 2023-10-10T22:37:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.267+0000 7fc317bff700 1 -- 172.21.15.154:0/1443445084 wait complete. 2023-10-10T22:37:14.286 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-10-10T22:37:14.286 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-10-10T22:37:14.287 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-10-10T22:37:14.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-10T22:37:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.469+0000 7ff9f3fff700 1 Processor -- start 2023-10-10T22:37:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.469+0000 7ff9f3fff700 1 -- start start 2023-10-10T22:37:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.470+0000 7ff9f3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9f4150180 0x7ff9f4157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.470+0000 7ff9f3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 0x7ff9f40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.470+0000 7ff9f3fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f406e2a0 con 0x7ff9f40c7240 2023-10-10T22:37:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.470+0000 7ff9f3fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f40c76c0 con 0x7ff9f4150180 2023-10-10T22:37:14.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.470+0000 7ff9f3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f406b2e0 con 0x7ff9f4150550 2023-10-10T22:37:14.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9f4150180 0x7ff9f4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:14.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f37fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff9f40c7240 0x7ff9f4069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46046/0 (socket says 172.21.15.154:46046) 2023-10-10T22:37:14.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f37fe700 1 -- 172.21.15.154:0/285953432 learned_addr learned my addr 172.21.15.154:0/285953432 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:14.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f27fc700 1 --2- 172.21.15.154:0/285953432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 0x7ff9f40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:14.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f2ffd700 1 -- 172.21.15.154:0/285953432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 msgr2=0x7ff9f40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f2ffd700 1 --2- 172.21.15.154:0/285953432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 0x7ff9f40c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f2ffd700 1 -- 172.21.15.154:0/285953432 >> v1:172.21.15.154:6789/0 conn(0x7ff9f40c7240 legacy=0x7ff9f4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f2ffd700 1 -- 172.21.15.154:0/285953432 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f40c78e0 con 0x7ff9f4150180 2023-10-10T22:37:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f1ffb700 1 -- 172.21.15.154:0/285953432 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832855171 0 0) 0x7ff9f406e2a0 con 0x7ff9f40c7240 2023-10-10T22:37:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.471+0000 7ff9f2ffd700 1 --2- 172.21.15.154:0/285953432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f4150180 0x7ff9f4157770 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009940 tx=0x7ff9e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a118c2983f7b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f1ffb700 1 -- 172.21.15.154:0/285953432 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400b7e0 con 0x7ff9f4150180 2023-10-10T22:37:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f1ffb700 1 -- 172.21.15.154:0/285953432 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e400b940 con 0x7ff9f4150180 2023-10-10T22:37:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f1ffb700 1 -- 172.21.15.154:0/285953432 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400bce0 con 0x7ff9f4150180 2023-10-10T22:37:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f3fff700 1 -- 172.21.15.154:0/285953432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f4150180 msgr2=0x7ff9f4157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f3fff700 1 --2- 172.21.15.154:0/285953432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f4150180 0x7ff9f4157770 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009940 tx=0x7ff9e40091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f3fff700 1 -- 172.21.15.154:0/285953432 shutdown_connections 2023-10-10T22:37:14.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f3fff700 1 --2- 172.21.15.154:0/285953432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f4150180 0x7ff9f4157770 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f3fff700 1 --2- 172.21.15.154:0/285953432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 0x7ff9f40c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f3fff700 1 -- 172.21.15.154:0/285953432 >> 172.21.15.154:0/285953432 conn(0x7ff9f40cc1f0 msgr2=0x7ff9f40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:14.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f3fff700 1 -- 172.21.15.154:0/285953432 shutdown_connections 2023-10-10T22:37:14.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.472+0000 7ff9f3fff700 1 -- 172.21.15.154:0/285953432 wait complete. 2023-10-10T22:37:14.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.474+0000 7ff9f3fff700 1 Processor -- start 2023-10-10T22:37:14.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.474+0000 7ff9f3fff700 1 -- start start 2023-10-10T22:37:14.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40c7240 0x7ff9f406a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:14.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f4150180 0x7ff9f414ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:14.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 0x7ff9f4154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:14.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f3fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f416ae60 con 0x7ff9f40c7240 2023-10-10T22:37:14.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f414ba40 con 0x7ff9f4150180 2023-10-10T22:37:14.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f414b220 con 0x7ff9f4150550 2023-10-10T22:37:14.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40c7240 0x7ff9f406a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:14.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40c7240 0x7ff9f406a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36006/0 (socket says 172.21.15.154:36006) 2023-10-10T22:37:14.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f2ffd700 1 -- 172.21.15.154:0/2296077709 learned_addr learned my addr 172.21.15.154:0/2296077709 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:14.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f2ffd700 1 -- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 msgr2=0x7ff9f4154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:14.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f37fe700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 0x7ff9f4154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:14.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f27fc700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f4150180 0x7ff9f414ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:14.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f2ffd700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 0x7ff9f4154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f2ffd700 1 -- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f4150180 msgr2=0x7ff9f414ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:14.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f2ffd700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f4150180 0x7ff9f414ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:14.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f2ffd700 1 -- 172.21.15.154:0/2296077709 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e4009420 con 0x7ff9f40c7240 2023-10-10T22:37:14.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f37fe700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 0x7ff9f4154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:14.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.475+0000 7ff9f27fc700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f4150180 0x7ff9f414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:14.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.476+0000 7ff9f2ffd700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40c7240 0x7ff9f406a450 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7ff9f406fe40 tx=0x7ff9e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:14.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.476+0000 7ff9daffd700 1 -- 172.21.15.154:0/2296077709 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e401a420 con 0x7ff9f40c7240 2023-10-10T22:37:14.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.476+0000 7ff9daffd700 1 -- 172.21.15.154:0/2296077709 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e401a580 con 0x7ff9f40c7240 2023-10-10T22:37:14.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.476+0000 7ff9daffd700 1 -- 172.21.15.154:0/2296077709 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e401a940 con 0x7ff9f40c7240 2023-10-10T22:37:14.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.476+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f416a250 con 0x7ff9f40c7240 2023-10-10T22:37:14.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.476+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f416a810 con 0x7ff9f40c7240 2023-10-10T22:37:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.477+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f404c3c0 con 0x7ff9f40c7240 2023-10-10T22:37:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.478+0000 7ff9daffd700 1 -- 172.21.15.154:0/2296077709 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9e40253f0 con 0x7ff9f40c7240 2023-10-10T22:37:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.480+0000 7ff9daffd700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff9e0066f30 0x7ff9e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.480+0000 7ff9daffd700 1 -- 172.21.15.154:0/2296077709 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5975+0+0 (secure 0 0 0) 0x7ff9e4086100 con 0x7ff9f40c7240 2023-10-10T22:37:14.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.480+0000 7ff9f27fc700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff9e0066f30 0x7ff9e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:14.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.480+0000 7ff9f27fc700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff9e0066f30 0x7ff9e00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff9f414f740 tx=0x7ff9e8008040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:14.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.484+0000 7ff9daffd700 1 -- 172.21.15.154:0/2296077709 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9e4053260 con 0x7ff9f40c7240 2023-10-10T22:37:14.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:14.753+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7ff9f40c6780 con 0x7ff9f40c7240 2023-10-10T22:37:15.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:37:15.136 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:37:15.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.266+0000 7ff9daffd700 1 -- 172.21.15.154:0/2296077709 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3064) v1 ==== 158+0+0 (secure 0 0 0) 0x7ff9e4056880 con 0x7ff9f40c7240 2023-10-10T22:37:15.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff9e0066f30 msgr2=0x7ff9e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff9e0066f30 0x7ff9e00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff9f414f740 tx=0x7ff9e8008040 comp rx=0 tx=0).stop 2023-10-10T22:37:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40c7240 msgr2=0x7ff9f406a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40c7240 0x7ff9f406a450 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7ff9f406fe40 tx=0x7ff9e4017000 comp rx=0 tx=0).stop 2023-10-10T22:37:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 shutdown_connections 2023-10-10T22:37:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7ff9e0066f30 0x7ff9e00693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9f4150550 0x7ff9f4154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40c7240 0x7ff9f406a450 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 --2- 172.21.15.154:0/2296077709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f4150180 0x7ff9f414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 >> 172.21.15.154:0/2296077709 conn(0x7ff9f40cc1f0 msgr2=0x7ff9f40c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 shutdown_connections 2023-10-10T22:37:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.268+0000 7ff9f3fff700 1 -- 172.21.15.154:0/2296077709 wait complete. 2023-10-10T22:37:15.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-10T22:37:15.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.473+0000 7f416d3ff700 1 Processor -- start 2023-10-10T22:37:15.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.473+0000 7f416d3ff700 1 -- start start 2023-10-10T22:37:15.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f416d3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f41680699c0 0x7f416806f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:15.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f416d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4168159de0 0x7f41680ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:15.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f416d3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416806de10 con 0x7f416806f750 2023-10-10T22:37:15.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f416d3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416806e0f0 con 0x7f41680699c0 2023-10-10T22:37:15.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f416d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416806e3d0 con 0x7f4168159de0 2023-10-10T22:37:15.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f4166ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f41680699c0 0x7f416806f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:15.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f4166ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f41680699c0 0x7f416806f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36010/0 (socket says 172.21.15.154:36010) 2023-10-10T22:37:15.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f4166ffd700 1 -- 172.21.15.154:0/3005731296 learned_addr learned my addr 172.21.15.154:0/3005731296 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:15.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f41677fe700 1 --2- 172.21.15.154:0/3005731296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4168159de0 0x7f41680ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:15.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f4166ffd700 1 -- 172.21.15.154:0/3005731296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4168159de0 msgr2=0x7f41680ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:15.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f4166ffd700 1 --2- 172.21.15.154:0/3005731296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4168159de0 0x7f41680ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f4166ffd700 1 -- 172.21.15.154:0/3005731296 >> v1:172.21.15.179:6789/0 conn(0x7f416806f750 legacy=0x7f41681596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:15.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f4166ffd700 1 -- 172.21.15.154:0/3005731296 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416806e6b0 con 0x7f41680699c0 2023-10-10T22:37:15.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.475+0000 7f41677fe700 1 --2- 172.21.15.154:0/3005731296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4168159de0 0x7f41680ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:15.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.476+0000 7f4166ffd700 1 --2- 172.21.15.154:0/3005731296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41680699c0 0x7f416806f210 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f41580099b0 tx=0x7f4158009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98c3beec5382023 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:15.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.476+0000 7f4165ffb700 1 -- 172.21.15.154:0/3005731296 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415800b820 con 0x7f41680699c0 2023-10-10T22:37:15.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.476+0000 7f4165ffb700 1 -- 172.21.15.154:0/3005731296 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415800b980 con 0x7f41680699c0 2023-10-10T22:37:15.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.476+0000 7f4165ffb700 1 -- 172.21.15.154:0/3005731296 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415800bd20 con 0x7f41680699c0 2023-10-10T22:37:15.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.476+0000 7f416d3ff700 1 -- 172.21.15.154:0/3005731296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41680699c0 msgr2=0x7f416806f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:15.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.476+0000 7f416d3ff700 1 --2- 172.21.15.154:0/3005731296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41680699c0 0x7f416806f210 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f41580099b0 tx=0x7f4158009250 comp rx=0 tx=0).stop 2023-10-10T22:37:15.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.477+0000 7f416d3ff700 1 -- 172.21.15.154:0/3005731296 shutdown_connections 2023-10-10T22:37:15.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.477+0000 7f416d3ff700 1 --2- 172.21.15.154:0/3005731296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4168159de0 0x7f41680ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.477+0000 7f416d3ff700 1 --2- 172.21.15.154:0/3005731296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41680699c0 0x7f416806f210 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.477+0000 7f416d3ff700 1 -- 172.21.15.154:0/3005731296 >> 172.21.15.154:0/3005731296 conn(0x7f4168068e10 msgr2=0x7f41680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:15.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.477+0000 7f416d3ff700 1 -- 172.21.15.154:0/3005731296 shutdown_connections 2023-10-10T22:37:15.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.477+0000 7f416d3ff700 1 -- 172.21.15.154:0/3005731296 wait complete. 2023-10-10T22:37:15.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.478+0000 7f416d3ff700 1 Processor -- start 2023-10-10T22:37:15.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.478+0000 7f416d3ff700 1 -- start start 2023-10-10T22:37:15.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.479+0000 7f416d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41680699c0 0x7f416815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:15.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.479+0000 7f416d3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f416806f750 0x7f41681525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:15.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.479+0000 7f416d3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4168159de0 0x7f416815d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:15.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.479+0000 7f416d3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4168152ae0 con 0x7f4168159de0 2023-10-10T22:37:15.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.479+0000 7f416d3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416815b550 con 0x7f416806f750 2023-10-10T22:37:15.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.479+0000 7f416d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416815d7c0 con 0x7f41680699c0 2023-10-10T22:37:15.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.479+0000 7f41677fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4168159de0 0x7f416815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:15.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f41677fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4168159de0 0x7f416815d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36018/0 (socket says 172.21.15.154:36018) 2023-10-10T22:37:15.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f41677fe700 1 -- 172.21.15.154:0/694396355 learned_addr learned my addr 172.21.15.154:0/694396355 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:15.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f4166ffd700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41680699c0 0x7f416815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f41667fc700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f416806f750 0x7f41681525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f41677fe700 1 -- 172.21.15.154:0/694396355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41680699c0 msgr2=0x7f416815a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f41677fe700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41680699c0 0x7f416815a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f41677fe700 1 -- 172.21.15.154:0/694396355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f416806f750 msgr2=0x7f41681525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f41677fe700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f416806f750 0x7f41681525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f41677fe700 1 -- 172.21.15.154:0/694396355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41580094f0 con 0x7f4168159de0 2023-10-10T22:37:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f41677fe700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4168159de0 0x7f416815d280 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f416000cf20 tx=0x7f4160007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f414effd700 1 -- 172.21.15.154:0/694396355 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416000ace0 con 0x7f4168159de0 2023-10-10T22:37:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f414effd700 1 -- 172.21.15.154:0/694396355 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416000ae60 con 0x7f4168159de0 2023-10-10T22:37:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.480+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416815b9e0 con 0x7f4168159de0 2023-10-10T22:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.481+0000 7f414effd700 1 -- 172.21.15.154:0/694396355 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160016670 con 0x7f4168159de0 2023-10-10T22:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.481+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416815ac20 con 0x7f4168159de0 2023-10-10T22:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.482+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416815b700 con 0x7f4168159de0 2023-10-10T22:37:15.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.482+0000 7f414effd700 1 -- 172.21.15.154:0/694396355 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4160016a60 con 0x7f4168159de0 2023-10-10T22:37:15.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.483+0000 7f414effd700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4154066f30 0x7f41540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:15.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.483+0000 7f414effd700 1 -- 172.21.15.154:0/694396355 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f4160012070 con 0x7f4168159de0 2023-10-10T22:37:15.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.484+0000 7f4166ffd700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4154066f30 0x7f41540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:15.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.484+0000 7f4166ffd700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4154066f30 0x7f41540693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f41580099b0 tx=0x7f4158016000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:15.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.487+0000 7f414effd700 1 -- 172.21.15.154:0/694396355 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f416004e5a0 con 0x7f4168159de0 2023-10-10T22:37:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.677+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f416804c3c0 con 0x7f4168159de0 2023-10-10T22:37:15.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.682+0000 7f414effd700 1 -- 172.21.15.154:0/694396355 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v70)=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f416815b700 con 0x7f4168159de0 2023-10-10T22:37:15.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4154066f30 msgr2=0x7f41540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:15.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4154066f30 0x7f41540693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f41580099b0 tx=0x7f4158016000 comp rx=0 tx=0).stop 2023-10-10T22:37:15.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4168159de0 msgr2=0x7f416815d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:15.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4168159de0 0x7f416815d280 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f416000cf20 tx=0x7f4160007860 comp rx=0 tx=0).stop 2023-10-10T22:37:15.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 shutdown_connections 2023-10-10T22:37:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4154066f30 0x7f41540693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4168159de0 0x7f416815d280 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41680699c0 0x7f416815a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 --2- 172.21.15.154:0/694396355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f416806f750 0x7f41681525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 >> 172.21.15.154:0/694396355 conn(0x7f4168068e10 msgr2=0x7f41680c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 shutdown_connections 2023-10-10T22:37:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:15.684+0000 7f416d3ff700 1 -- 172.21.15.154:0/694396355 wait complete. 2023-10-10T22:37:15.703 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T22:37:15.703 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:37:15.786 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:37:15.871 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T22:37:15.871 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-10T22:37:15.872 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:16.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.053+0000 7f7ed01ff700 1 Processor -- start 2023-10-10T22:37:16.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.053+0000 7f7ed01ff700 1 -- start start 2023-10-10T22:37:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.054+0000 7f7ed01ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ec8155c10 0x7f7ec8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.054+0000 7f7ed01ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ec80ac230 0x7f7ec80ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.054+0000 7f7ed01ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec81568a0 0x7f7ec8156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ed01ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec80ad930 con 0x7f7ec8155c10 2023-10-10T22:37:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ed01ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec80acd20 con 0x7f7ec80ac230 2023-10-10T22:37:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ed01ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec80ad000 con 0x7f7ec81568a0 2023-10-10T22:37:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecdf9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ec8155c10 0x7f7ec8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecdf9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ec8155c10 0x7f7ec8155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40968/0 (socket says 172.21.15.154:40968) 2023-10-10T22:37:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecdf9b700 1 -- 172.21.15.154:0/1499850764 learned_addr learned my addr 172.21.15.154:0/1499850764 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecd79a700 1 --2- 172.21.15.154:0/1499850764 >> v2:172.21.15.179:3300/0 conn(0x7f7ec80ac230 0x7f7ec80ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ece79c700 1 --2- 172.21.15.154:0/1499850764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec81568a0 0x7f7ec8156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecdf9b700 1 -- 172.21.15.154:0/1499850764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec81568a0 msgr2=0x7f7ec8156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecdf9b700 1 --2- 172.21.15.154:0/1499850764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec81568a0 0x7f7ec8156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecdf9b700 1 -- 172.21.15.154:0/1499850764 >> v2:172.21.15.179:3300/0 conn(0x7f7ec80ac230 msgr2=0x7f7ec80ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecdf9b700 1 --2- 172.21.15.154:0/1499850764 >> v2:172.21.15.179:3300/0 conn(0x7f7ec80ac230 0x7f7ec80ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecdf9b700 1 -- 172.21.15.154:0/1499850764 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec80ad2e0 con 0x7f7ec8155c10 2023-10-10T22:37:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.055+0000 7f7ecd79a700 1 --2- 172.21.15.154:0/1499850764 >> v2:172.21.15.179:3300/0 conn(0x7f7ec80ac230 0x7f7ec80ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7ecdf9b700 1 --2- 172.21.15.154:0/1499850764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec8155c10 0x7f7ec8155fe0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8065bb0 tx=0x7f7ec4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b5f23243899802 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7eccf99700 1 -- 172.21.15.154:0/1499850764 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec400b860 con 0x7f7ec8155c10 2023-10-10T22:37:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7eccf99700 1 -- 172.21.15.154:0/1499850764 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec400b9c0 con 0x7f7ec8155c10 2023-10-10T22:37:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7eccf99700 1 -- 172.21.15.154:0/1499850764 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec400bd60 con 0x7f7ec8155c10 2023-10-10T22:37:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7ed01ff700 1 -- 172.21.15.154:0/1499850764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec8155c10 msgr2=0x7f7ec8155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/1499850764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec8155c10 0x7f7ec8155fe0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8065bb0 tx=0x7f7ec4009250 comp rx=0 tx=0).stop 2023-10-10T22:37:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7ed01ff700 1 -- 172.21.15.154:0/1499850764 shutdown_connections 2023-10-10T22:37:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/1499850764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec81568a0 0x7f7ec8156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/1499850764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec8155c10 0x7f7ec8155fe0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/1499850764 >> v2:172.21.15.179:3300/0 conn(0x7f7ec80ac230 0x7f7ec80ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.056+0000 7f7ed01ff700 1 -- 172.21.15.154:0/1499850764 >> 172.21.15.154:0/1499850764 conn(0x7f7ec806a320 msgr2=0x7f7ec80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.057+0000 7f7ed01ff700 1 -- 172.21.15.154:0/1499850764 shutdown_connections 2023-10-10T22:37:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.057+0000 7f7ed01ff700 1 -- 172.21.15.154:0/1499850764 wait complete. 2023-10-10T22:37:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.058+0000 7f7ed01ff700 1 Processor -- start 2023-10-10T22:37:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.058+0000 7f7ed01ff700 1 -- start start 2023-10-10T22:37:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ed01ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80ac230 0x7f7ec80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ed01ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8155c10 0x7f7ec80cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ed01ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec81568a0 0x7f7ec80cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ed01ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec80cce20 con 0x7f7ec81568a0 2023-10-10T22:37:16.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ed01ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec80cc990 con 0x7f7ec80ac230 2023-10-10T22:37:16.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ed01ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec80a5760 con 0x7f7ec8155c10 2023-10-10T22:37:16.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ece79c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec81568a0 0x7f7ec80cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ece79c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec81568a0 0x7f7ec80cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40984/0 (socket says 172.21.15.154:40984) 2023-10-10T22:37:16.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ece79c700 1 -- 172.21.15.154:0/2309195239 learned_addr learned my addr 172.21.15.154:0/2309195239 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:16.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ecd79a700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8155c10 0x7f7ec80cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.059+0000 7f7ecdf9b700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80ac230 0x7f7ec80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ece79c700 1 -- 172.21.15.154:0/2309195239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8155c10 msgr2=0x7f7ec80cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:16.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ece79c700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8155c10 0x7f7ec80cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ece79c700 1 -- 172.21.15.154:0/2309195239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80ac230 msgr2=0x7f7ec80aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:16.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ece79c700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80ac230 0x7f7ec80aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ece79c700 1 -- 172.21.15.154:0/2309195239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40094f0 con 0x7f7ec81568a0 2023-10-10T22:37:16.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ece79c700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec81568a0 0x7f7ec80cb700 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0007f20 tx=0x7f7ec0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:16.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ebdffb700 1 -- 172.21.15.154:0/2309195239 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000eb90 con 0x7f7ec81568a0 2023-10-10T22:37:16.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ebdffb700 1 -- 172.21.15.154:0/2309195239 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec000ed10 con 0x7f7ec81568a0 2023-10-10T22:37:16.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec80cbd80 con 0x7f7ec81568a0 2023-10-10T22:37:16.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ebdffb700 1 -- 172.21.15.154:0/2309195239 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0014670 con 0x7f7ec81568a0 2023-10-10T22:37:16.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.060+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec80cc340 con 0x7f7ec81568a0 2023-10-10T22:37:16.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.061+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec80ccb40 con 0x7f7ec81568a0 2023-10-10T22:37:16.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.062+0000 7f7ebdffb700 1 -- 172.21.15.154:0/2309195239 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ec00149e0 con 0x7f7ec81568a0 2023-10-10T22:37:16.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.064+0000 7f7ebdffb700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7eac066f30 0x7f7eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.064+0000 7f7ebdffb700 1 -- 172.21.15.154:0/2309195239 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f7ec0084cb0 con 0x7f7ec81568a0 2023-10-10T22:37:16.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.064+0000 7f7ecdf9b700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7eac066f30 0x7f7eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.064+0000 7f7ecdf9b700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7eac066f30 0x7f7eac0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8065bb0 tx=0x7f7ec4017000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:16.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.068+0000 7f7ebdffb700 1 -- 172.21.15.154:0/2309195239 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ec80ccb40 con 0x7f7ec81568a0 2023-10-10T22:37:16.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.305+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ec80ccb00 con 0x7f7ec81568a0 2023-10-10T22:37:16.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.305+0000 7f7ebdffb700 1 -- 172.21.15.154:0/2309195239 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f7ec0051d70 con 0x7f7ec81568a0 2023-10-10T22:37:16.307 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:16.308 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":88,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/331320161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":331320161},{"type":"v1","addr":"172.21.15.154:6833","nonce":331320161}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7916,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/595493420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":595493420},{"type":"v1","addr":"172.21.15.179:6835","nonce":595493420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8198,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2481564750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2481564750},{"type":"v1","addr":"172.21.15.179:6834","nonce":2481564750}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1656759292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1656759292},{"type":"v1","addr":"172.21.15.154:6835","nonce":1656759292}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[]} 2023-10-10T22:37:16.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7eac066f30 msgr2=0x7f7eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:16.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7eac066f30 0x7f7eac0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8065bb0 tx=0x7f7ec4017000 comp rx=0 tx=0).stop 2023-10-10T22:37:16.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec81568a0 msgr2=0x7f7ec80cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:16.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec81568a0 0x7f7ec80cb700 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0007f20 tx=0x7f7ec0009860 comp rx=0 tx=0).stop 2023-10-10T22:37:16.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 shutdown_connections 2023-10-10T22:37:16.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7eac066f30 0x7f7eac0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec81568a0 0x7f7ec80cb700 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ec80ac230 0x7f7ec80aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 --2- 172.21.15.154:0/2309195239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ec8155c10 0x7f7ec80cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 >> 172.21.15.154:0/2309195239 conn(0x7f7ec806a320 msgr2=0x7f7ec806e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:16.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 shutdown_connections 2023-10-10T22:37:16.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.308+0000 7f7ed01ff700 1 -- 172.21.15.154:0/2309195239 wait complete. 2023-10-10T22:37:16.312 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 88 2023-10-10T22:37:16.328 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-10T22:37:16.328 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-10T22:37:16.328 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T22:37:16.329 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:37:16.329 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-10T22:37:16.329 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-10T22:37:16.329 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T22:37:16.330 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:37:16.330 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-10T22:37:16.330 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-10T22:37:16.331 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T22:37:16.331 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:37:16.331 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-10T22:37:16.331 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-10T22:37:16.332 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T22:37:16.332 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:37:16.341 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T22:37:16.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-10T22:37:16.343 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T22:37:16.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-10T22:37:16.353 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T22:37:16.354 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-10T22:37:16.356 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T22:37:16.356 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-10T22:37:16.387 INFO:tasks.ceph.mds.a:Started 2023-10-10T22:37:16.388 DEBUG:teuthology.parallel:result is None 2023-10-10T22:37:16.391 INFO:tasks.ceph.mds.c:Started 2023-10-10T22:37:16.391 DEBUG:teuthology.parallel:result is None 2023-10-10T22:37:16.396 INFO:tasks.ceph.mds.b:Started 2023-10-10T22:37:16.396 DEBUG:teuthology.parallel:result is None 2023-10-10T22:37:16.398 INFO:tasks.ceph.mds.d:Started 2023-10-10T22:37:16.399 DEBUG:teuthology.parallel:result is None 2023-10-10T22:37:16.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-10T22:37:16.524 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-10-10T22:37:16.524 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-10-10T22:37:16.533 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-10T22:37:16.534 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T22:37:16.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.595+0000 7f38d5bff700 1 Processor -- start 2023-10-10T22:37:16.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.595+0000 7f38d5bff700 1 -- start start 2023-10-10T22:37:16.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.597+0000 7f38d5bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38d00b1420 0x7f38d00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.597+0000 7f38d5bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00cc300 con 0x7f38d00cbf30 2023-10-10T22:37:16.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.597+0000 7f38d5bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00ad370 con 0x7f38d00ccf90 2023-10-10T22:37:16.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.597+0000 7f38d5bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d0156bf0 con 0x7f38d00b1420 2023-10-10T22:37:16.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.597+0000 7f38ceffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38d00b1420 0x7f38d00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.597+0000 7f38cf7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f38d00cbf30 0x7f38d00b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50320/0 (socket says 172.21.15.154:50320) 2023-10-10T22:37:16.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.597+0000 7f38ceffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38d00b1420 0x7f38d00ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41028/0 (socket says 172.21.15.154:41028) 2023-10-10T22:37:16.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.597+0000 7f38cf7fe700 1 -- 172.21.15.154:0/1274925827 learned_addr learned my addr 172.21.15.154:0/1274925827 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:16.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.597+0000 7f38ceffd700 1 -- 172.21.15.154:0/1274925827 >> v1:172.21.15.179:6789/0 conn(0x7f38d00ccf90 legacy=0x7f38d00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:16.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.598+0000 7f38ceffd700 1 -- 172.21.15.154:0/1274925827 >> v1:172.21.15.154:6789/0 conn(0x7f38d00cbf30 legacy=0x7f38d00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:16.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.598+0000 7f38ceffd700 1 -- 172.21.15.154:0/1274925827 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00ad650 con 0x7f38d00b1420 2023-10-10T22:37:16.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.598+0000 7f38ce7fc700 1 -- 172.21.15.154:0/1274925827 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162377424 0 0) 0x7f38d00cc300 con 0x7f38d00cbf30 2023-10-10T22:37:16.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.598+0000 7f38ceffd700 1 --2- 172.21.15.154:0/1274925827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00b1420 0x7f38d00ae410 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f38c40098e0 tx=0x7f38c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01c892da2754533 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:16.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.598+0000 7f38ce7fc700 1 -- 172.21.15.154:0/1274925827 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4009e80 con 0x7f38d00b1420 2023-10-10T22:37:16.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.598+0000 7f38ce7fc700 1 -- 172.21.15.154:0/1274925827 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c400b820 con 0x7f38d00b1420 2023-10-10T22:37:16.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.598+0000 7f38ce7fc700 1 -- 172.21.15.154:0/1274925827 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c400bba0 con 0x7f38d00b1420 2023-10-10T22:37:16.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.599+0000 7f38d5bff700 1 -- 172.21.15.154:0/1274925827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00b1420 msgr2=0x7f38d00ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:16.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.599+0000 7f38d5bff700 1 --2- 172.21.15.154:0/1274925827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00b1420 0x7f38d00ae410 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f38c40098e0 tx=0x7f38c40091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.599+0000 7f38d5bff700 1 -- 172.21.15.154:0/1274925827 shutdown_connections 2023-10-10T22:37:16.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.599+0000 7f38d5bff700 1 --2- 172.21.15.154:0/1274925827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00b1420 0x7f38d00ae410 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.599+0000 7f38d5bff700 1 -- 172.21.15.154:0/1274925827 >> 172.21.15.154:0/1274925827 conn(0x7f38d006a320 msgr2=0x7f38d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:16.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.599+0000 7f38d5bff700 1 -- 172.21.15.154:0/1274925827 shutdown_connections 2023-10-10T22:37:16.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.599+0000 7f38d5bff700 1 -- 172.21.15.154:0/1274925827 wait complete. 2023-10-10T22:37:16.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.600+0000 7f38d5bff700 1 Processor -- start 2023-10-10T22:37:16.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.600+0000 7f38d5bff700 1 -- start start 2023-10-10T22:37:16.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.601+0000 7f38d5bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d00b1420 0x7f38d0155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.601+0000 7f38d5bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00cbf30 0x7f38d00c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.601+0000 7f38d5bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d00ccf90 0x7f38d00c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.601+0000 7f38d5bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00a8e60 con 0x7f38d00cbf30 2023-10-10T22:37:16.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.601+0000 7f38d5bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00a96a0 con 0x7f38d00ccf90 2023-10-10T22:37:16.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.601+0000 7f38d5bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00c1760 con 0x7f38d00b1420 2023-10-10T22:37:16.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.601+0000 7f38ceffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00cbf30 0x7f38d00c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.601+0000 7f38ceffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00cbf30 0x7f38d00c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41038/0 (socket says 172.21.15.154:41038) 2023-10-10T22:37:16.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.601+0000 7f38ceffd700 1 -- 172.21.15.154:0/1040791472 learned_addr learned my addr 172.21.15.154:0/1040791472 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:16.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38cf7fe700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d00b1420 0x7f38d0155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38cffff700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d00ccf90 0x7f38d00c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38ceffd700 1 -- 172.21.15.154:0/1040791472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d00b1420 msgr2=0x7f38d0155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:16.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38ceffd700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d00b1420 0x7f38d0155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38ceffd700 1 -- 172.21.15.154:0/1040791472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d00ccf90 msgr2=0x7f38d00c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:16.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38ceffd700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d00ccf90 0x7f38d00c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:16.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38ceffd700 1 -- 172.21.15.154:0/1040791472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c4009420 con 0x7f38d00cbf30 2023-10-10T22:37:16.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38ceffd700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00cbf30 0x7f38d00c1c90 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f38c40030c0 tx=0x7f38c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:16.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38b77fe700 1 -- 172.21.15.154:0/1040791472 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c400ba60 con 0x7f38d00cbf30 2023-10-10T22:37:16.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38b77fe700 1 -- 172.21.15.154:0/1040791472 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4020070 con 0x7f38d00cbf30 2023-10-10T22:37:16.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d00a9050 con 0x7f38d00cbf30 2023-10-10T22:37:16.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.602+0000 7f38b77fe700 1 -- 172.21.15.154:0/1040791472 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c401b6a0 con 0x7f38d00cbf30 2023-10-10T22:37:16.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.603+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d0155eb0 con 0x7f38d00cbf30 2023-10-10T22:37:16.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.603+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d00a9830 con 0x7f38d00cbf30 2023-10-10T22:37:16.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.604+0000 7f38b77fe700 1 -- 172.21.15.154:0/1040791472 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38c4022030 con 0x7f38d00cbf30 2023-10-10T22:37:16.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.605+0000 7f38b77fe700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f38bc066f30 0x7f38bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:16.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.605+0000 7f38b77fe700 1 -- 172.21.15.154:0/1040791472 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f38c4086610 con 0x7f38d00cbf30 2023-10-10T22:37:16.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.605+0000 7f38cf7fe700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f38bc066f30 0x7f38bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:16.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.606+0000 7f38cf7fe700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f38bc066f30 0x7f38bc0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f38c0007fd0 tx=0x7f38c0007d30 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:16.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.610+0000 7f38b77fe700 1 -- 172.21.15.154:0/1040791472 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38c40536d0 con 0x7f38d00cbf30 2023-10-10T22:37:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:16.816+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f38d00a9830 con 0x7f38d00cbf30 2023-10-10T22:37:17.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.697+0000 7f38b77fe700 1 -- 172.21.15.154:0/1040791472 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v205) v1 ==== 97+0+0 (secure 0 0 0) 0x7f38c4056cf0 con 0x7f38d00cbf30 2023-10-10T22:37:17.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.700+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f38bc066f30 msgr2=0x7f38bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.700+0000 7f38d5bff700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f38bc066f30 0x7f38bc0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f38c0007fd0 tx=0x7f38c0007d30 comp rx=0 tx=0).stop 2023-10-10T22:37:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.700+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00cbf30 msgr2=0x7f38d00c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.700+0000 7f38d5bff700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00cbf30 0x7f38d00c1c90 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f38c40030c0 tx=0x7f38c4016000 comp rx=0 tx=0).stop 2023-10-10T22:37:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.701+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 shutdown_connections 2023-10-10T22:37:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.701+0000 7f38d5bff700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f38bc066f30 0x7f38bc0693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.701+0000 7f38d5bff700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d00ccf90 0x7f38d00c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.701+0000 7f38d5bff700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d00b1420 0x7f38d0155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.701+0000 7f38d5bff700 1 --2- 172.21.15.154:0/1040791472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d00cbf30 0x7f38d00c1c90 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.701+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 >> 172.21.15.154:0/1040791472 conn(0x7f38d006a320 msgr2=0x7f38d00afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:17.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.701+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 shutdown_connections 2023-10-10T22:37:17.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.701+0000 7f38d5bff700 1 -- 172.21.15.154:0/1040791472 wait complete. 2023-10-10T22:37:17.705 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-10-10T22:37:17.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-10T22:37:17.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.908+0000 7fb54d1ff700 1 Processor -- start 2023-10-10T22:37:17.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.908+0000 7fb54d1ff700 1 -- start start 2023-10-10T22:37:17.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb54d1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb5480b1850 0x7fb5480b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:17.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb54d1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5481579f0 0x7fb5480abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:17.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb54d1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5480cb300 con 0x7fb5480ae680 2023-10-10T22:37:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb54d1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54806fc30 con 0x7fb5480b1850 2023-10-10T22:37:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb54d1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5480cc260 con 0x7fb5481579f0 2023-10-10T22:37:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb54659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb5480ae680 0x7fb5481572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50332/0 (socket says 172.21.15.154:50332) 2023-10-10T22:37:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb54659c700 1 -- 172.21.15.154:0/365802373 learned_addr learned my addr 172.21.15.154:0/365802373 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:17.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb546d9d700 1 --2- 172.21.15.154:0/365802373 >> v2:172.21.15.179:3300/0 conn(0x7fb5480b1850 0x7fb5480b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:17.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb54759e700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5481579f0 0x7fb5480abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:17.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379992867 0 0) 0x7fb5480cb300 con 0x7fb5480ae680 2023-10-10T22:37:17.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.910+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb530003570 con 0x7fb5480ae680 2023-10-10T22:37:17.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620420621 0 0) 0x7fb530003570 con 0x7fb5480ae680 2023-10-10T22:37:17.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5481579f0 msgr2=0x7fb5480abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:17.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5481579f0 0x7fb5480abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 >> v2:172.21.15.179:3300/0 conn(0x7fb5480b1850 msgr2=0x7fb5480b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:17.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 --2- 172.21.15.154:0/365802373 >> v2:172.21.15.179:3300/0 conn(0x7fb5480b1850 0x7fb5480b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5480cb5e0 con 0x7fb5480ae680 2023-10-10T22:37:17.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fb53c001470 con 0x7fb5480ae680 2023-10-10T22:37:17.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 >> v1:172.21.15.154:6789/0 conn(0x7fb5480ae680 legacy=0x7fb5481572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:17.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb530003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:17.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb530004810 0x7fb530004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:17.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5481579f0 0x7fb5300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:17.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54806fc30 con 0x7fb530003a90 2023-10-10T22:37:17.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5480cc260 con 0x7fb530004810 2023-10-10T22:37:17.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53000ba60 con 0x7fb5481579f0 2023-10-10T22:37:17.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb546d9d700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb530003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:17.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb54659c700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb530004810 0x7fb530004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:17.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb54759e700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5481579f0 0x7fb5300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:17.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb546d9d700 1 -- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5481579f0 msgr2=0x7fb5300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:17.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb546d9d700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5481579f0 0x7fb5300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb546d9d700 1 -- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb530004810 msgr2=0x7fb530004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:17.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb546d9d700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb530004810 0x7fb530004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.911+0000 7fb546d9d700 1 -- 172.21.15.154:0/365802373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb530003570 con 0x7fb530003a90 2023-10-10T22:37:17.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.912+0000 7fb546d9d700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb530003ea0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fb538009c30 tx=0x7fb5380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eddae37bc3d20a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:17.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.912+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800e710 con 0x7fb530003a90 2023-10-10T22:37:17.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.912+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53800e870 con 0x7fb530003a90 2023-10-10T22:37:17.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.912+0000 7fb545d9b700 1 -- 172.21.15.154:0/365802373 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800ec30 con 0x7fb530003a90 2023-10-10T22:37:17.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.912+0000 7fb54d1ff700 1 -- 172.21.15.154:0/365802373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 msgr2=0x7fb530003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:17.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.912+0000 7fb54d1ff700 1 --2- 172.21.15.154:0/365802373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb530003ea0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fb538009c30 tx=0x7fb5380091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.912+0000 7fb54759e700 1 -- 172.21.15.154:0/365802373 reap_dead start 2023-10-10T22:37:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.912+0000 7fb54d1ff700 1 -- 172.21.15.154:0/365802373 shutdown_connections 2023-10-10T22:37:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.913+0000 7fb54d1ff700 1 -- 172.21.15.154:0/365802373 >> 172.21.15.154:0/365802373 conn(0x7fb54806a320 msgr2=0x7fb5480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.913+0000 7fb54d1ff700 1 -- 172.21.15.154:0/365802373 shutdown_connections 2023-10-10T22:37:17.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.913+0000 7fb54d1ff700 1 -- 172.21.15.154:0/365802373 wait complete. 2023-10-10T22:37:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.914+0000 7fb54d1ff700 1 Processor -- start 2023-10-10T22:37:17.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.914+0000 7fb54d1ff700 1 -- start start 2023-10-10T22:37:17.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb54d1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb548153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:17.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb54d1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb54815e460 0x7fb54815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:17.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb54d1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480b04f0 0x7fb5480b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:17.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb54d1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb548153ab0 con 0x7fb530003a90 2023-10-10T22:37:17.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb54d1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5480af490 con 0x7fb54815e460 2023-10-10T22:37:17.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb54d1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5480af730 con 0x7fb5480b04f0 2023-10-10T22:37:17.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb546d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb548153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:17.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb546d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb548153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41058/0 (socket says 172.21.15.154:41058) 2023-10-10T22:37:17.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb546d9d700 1 -- 172.21.15.154:0/2431694774 learned_addr learned my addr 172.21.15.154:0/2431694774 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:17.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb54659c700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb54815e460 0x7fb54815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:17.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.915+0000 7fb54759e700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480b04f0 0x7fb5480b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:17.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb546d9d700 1 -- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480b04f0 msgr2=0x7fb5480b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:17.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb546d9d700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480b04f0 0x7fb5480b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb546d9d700 1 -- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb54815e460 msgr2=0x7fb54815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:17.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb546d9d700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb54815e460 0x7fb54815ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:17.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb546d9d700 1 -- 172.21.15.154:0/2431694774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5480afa10 con 0x7fb530003a90 2023-10-10T22:37:17.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb54659c700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb54815e460 0x7fb54815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:17.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb54759e700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480b04f0 0x7fb5480b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:17.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb546d9d700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb548153570 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fb53800e4b0 tx=0x7fb53801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:17.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb52effd700 1 -- 172.21.15.154:0/2431694774 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538023070 con 0x7fb530003a90 2023-10-10T22:37:17.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb52effd700 1 -- 172.21.15.154:0/2431694774 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53800e9e0 con 0x7fb530003a90 2023-10-10T22:37:17.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5480afcf0 con 0x7fb530003a90 2023-10-10T22:37:17.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb52effd700 1 -- 172.21.15.154:0/2431694774 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53801e030 con 0x7fb530003a90 2023-10-10T22:37:17.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.916+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54815d230 con 0x7fb530003a90 2023-10-10T22:37:17.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.917+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5480a9960 con 0x7fb530003a90 2023-10-10T22:37:17.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.918+0000 7fb52effd700 1 -- 172.21.15.154:0/2431694774 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb538013470 con 0x7fb530003a90 2023-10-10T22:37:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.919+0000 7fb52effd700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb534066f30 0x7fb5340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.919+0000 7fb52effd700 1 -- 172.21.15.154:0/2431694774 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 5373+0+0 (secure 0 0 0) 0x7fb538085ae0 con 0x7fb530003a90 2023-10-10T22:37:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.919+0000 7fb54659c700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb534066f30 0x7fb5340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.920+0000 7fb54659c700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb534066f30 0x7fb5340693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb53c001120 tx=0x7fb53c009040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:17.924+0000 7fb52effd700 1 -- 172.21.15.154:0/2431694774 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb538052e80 con 0x7fb530003a90 2023-10-10T22:37:18.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.192+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb5480ae4c0 con 0x7fb530003a90 2023-10-10T22:37:18.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.193+0000 7fb52effd700 1 -- 172.21.15.154:0/2431694774 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v51) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb538017020 con 0x7fb530003a90 2023-10-10T22:37:18.195 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:18.195 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:37:18.195 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-10-10T22:37:18.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.195 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-10-10T22:37:18.196 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlsMAeIxAA+LDdc+Ck1n713sZP7w7CgQ==", 2023-10-10T22:37:18.196 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.196 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:37:18.196 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:37:18.196 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:37:18.197 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.197 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.197 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-10-10T22:37:18.197 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlwGnzNxAAxp9pbCdv7GLidL9YUl6qDg==", 2023-10-10T22:37:18.198 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.198 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:37:18.198 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:37:18.198 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:37:18.198 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.199 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-10-10T22:37:18.199 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlVr1jLRAAJDUFdWC18k9MEdZkcQ2h6A==", 2023-10-10T22:37:18.201 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.201 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:37:18.201 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:37:18.201 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:37:18.202 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.202 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-10-10T22:37:18.203 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlZ7PzBhAAoAhbRg2yqcqn1oT3KJQV+A==", 2023-10-10T22:37:18.203 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.203 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:37:18.203 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:37:18.203 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:37:18.204 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.204 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.204 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-10-10T22:37:18.204 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCiuyVlke8MOxAAAoZn59kuTWkGW+tA8tTMBA==", 2023-10-10T22:37:18.205 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.205 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:37:18.205 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:37:18.205 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.205 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.206 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-10-10T22:37:18.206 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCmuyVlho6NAhAANMCU1M7d6Nn1VY6h3OUKUw==", 2023-10-10T22:37:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:37:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:37:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-10-10T22:37:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCpuyVlFzdtBBAASwV1adtwd/ZxCep0p/goYw==", 2023-10-10T22:37:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:37:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:37:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-10-10T22:37:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCsuyVldWREBhAAnFzGsf39JMb7dNCXAF18Dw==", 2023-10-10T22:37:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:37:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:37:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-10-10T22:37:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCyuyVlZoU3FRAAAZQ/4o0Ri1CbaT3Y2I9t1A==", 2023-10-10T22:37:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:37:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:37:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-10-10T22:37:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC1uyVlX5ulFxAAVRswwgx15QmhFl7GUzQn1Q==", 2023-10-10T22:37:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:37:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:37:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-10-10T22:37:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC4uyVlAzp3GRAAjaJ42DtIODeC+Skb/XJH5g==", 2023-10-10T22:37:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:37:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:37:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-10-10T22:37:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQC7uyVlWXkNHBAAMabp4JpZKc63DlO2KMjyiw==", 2023-10-10T22:37:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-10-10T22:37:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-10-10T22:37:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-10-10T22:37:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlFDVtEBAAewkOOP9gUIQpcCozug7nnw==", 2023-10-10T22:37:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:37:18.225 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2023-10-10T22:37:18.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-10T22:37:18.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-10-10T22:37:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVlftUkHhAAScxDSPp7ftMcy4zZWdOwJQ==", 2023-10-10T22:37:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:37:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:37:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:37:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:37:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-10-10T22:37:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl7h9KFxAAmtLoPK9ev+Q8y4q329uYcw==", 2023-10-10T22:37:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:37:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:37:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:37:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:37:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-10-10T22:37:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCfuyVl4/wCJRAAvFqOCa+iadN45eb1ZkaJQQ==", 2023-10-10T22:37:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-10-10T22:37:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-10-10T22:37:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-10-10T22:37:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-10-10T22:37:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-10-10T22:37:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCduyVlU3EsLBAA3d6W8uT3teH4tlj95C2+/g==", 2023-10-10T22:37:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:37:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-10-10T22:37:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-10-10T22:37:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-10-10T22:37:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVlmBgdHBAA4UkkbnOerEGheazcwFH9kw==", 2023-10-10T22:37:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:37:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T22:37:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-10-10T22:37:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-10-10T22:37:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQCeuyVl50ZiFBAAflf+0j0LpbgA9Kos0F0DkA==", 2023-10-10T22:37:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-10-10T22:37:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-10-10T22:37:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-10-10T22:37:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-10-10T22:37:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-10-10T22:37:18.238 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:37:18.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb534066f30 msgr2=0x7fb5340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb534066f30 0x7fb5340693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb53c001120 tx=0x7fb53c009040 comp rx=0 tx=0).stop 2023-10-10T22:37:18.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 msgr2=0x7fb548153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb548153570 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fb53800e4b0 tx=0x7fb53801a000 comp rx=0 tx=0).stop 2023-10-10T22:37:18.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 shutdown_connections 2023-10-10T22:37:18.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb534066f30 0x7fb5340693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5480b04f0 0x7fb5480b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb530003a90 0x7fb548153570 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 --2- 172.21.15.154:0/2431694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb54815e460 0x7fb54815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.195+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 >> 172.21.15.154:0/2431694774 conn(0x7fb54806a320 msgr2=0x7fb548156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:18.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.196+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 shutdown_connections 2023-10-10T22:37:18.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.196+0000 7fb54d1ff700 1 -- 172.21.15.154:0/2431694774 wait complete. 2023-10-10T22:37:18.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.428+0000 7f438edff700 1 Processor -- start 2023-10-10T22:37:18.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.428+0000 7f438edff700 1 -- start start 2023-10-10T22:37:18.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.429+0000 7f438edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43880caa90 0x7f43880c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.429+0000 7f438edff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438815d7e0 con 0x7f438806c0a0 2023-10-10T22:37:18.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.429+0000 7f438edff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438815dac0 con 0x7f438806bcd0 2023-10-10T22:37:18.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.429+0000 7f438edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43880caf30 con 0x7f43880caa90 2023-10-10T22:37:18.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f4387fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f438806c0a0 0x7f438815df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50334/0 (socket says 172.21.15.154:50334) 2023-10-10T22:37:18.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f4387fff700 1 -- 172.21.15.154:0/1276115439 learned_addr learned my addr 172.21.15.154:0/1276115439 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:18.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889451535 0 0) 0x7f438815d7e0 con 0x7f438806c0a0 2023-10-10T22:37:18.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4378003570 con 0x7f438806c0a0 2023-10-10T22:37:18.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f438d39c700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43880caa90 0x7f43880c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1063852659 0 0) 0x7f4378003570 con 0x7f438806c0a0 2023-10-10T22:37:18.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43880caa90 msgr2=0x7f43880c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:18.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f43877fe700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43880caa90 0x7f43880c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 >> v1:172.21.15.179:6789/0 conn(0x7f438806bcd0 legacy=0x7f438815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438815aa30 con 0x7f438806c0a0 2023-10-10T22:37:18.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f4374001470 con 0x7f438806c0a0 2023-10-10T22:37:18.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f438d39c700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43880caa90 0x7f43880c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:18.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.430+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 >> v1:172.21.15.154:6789/0 conn(0x7f438806c0a0 legacy=0x7f438815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f43877fe700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43880caa90 0x7f4378003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f43877fe700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43780040d0 0x7f4378004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f43877fe700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4378004da0 0x7f4378005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43880caf30 con 0x7f4378004da0 2023-10-10T22:37:18.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437800bd40 con 0x7f43780040d0 2023-10-10T22:37:18.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437800bf00 con 0x7f43880caa90 2023-10-10T22:37:18.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f438d39c700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4378004da0 0x7f4378005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f438cb9b700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43880caa90 0x7f4378003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f4387fff700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43780040d0 0x7f4378004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f438d39c700 1 -- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43880caa90 msgr2=0x7f4378003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:18.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f438d39c700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43880caa90 0x7f4378003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f438d39c700 1 -- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43780040d0 msgr2=0x7f4378004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:18.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f438d39c700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43780040d0 0x7f4378004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f438d39c700 1 -- 172.21.15.154:0/1276115439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4378003570 con 0x7f4378004da0 2023-10-10T22:37:18.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.431+0000 7f438d39c700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4378004da0 0x7f4378005210 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f4380007550 tx=0x7f43800097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da71f976779d3050 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:18.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380009ae0 con 0x7f4378004da0 2023-10-10T22:37:18.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4380007da0 con 0x7f4378004da0 2023-10-10T22:37:18.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f43877fe700 1 -- 172.21.15.154:0/1276115439 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380014630 con 0x7f4378004da0 2023-10-10T22:37:18.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f438edff700 1 -- 172.21.15.154:0/1276115439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4378004da0 msgr2=0x7f4378005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f438edff700 1 --2- 172.21.15.154:0/1276115439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4378004da0 0x7f4378005210 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f4380007550 tx=0x7f43800097d0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f438d39c700 1 -- 172.21.15.154:0/1276115439 reap_dead start 2023-10-10T22:37:18.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f438edff700 1 -- 172.21.15.154:0/1276115439 shutdown_connections 2023-10-10T22:37:18.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f438edff700 1 -- 172.21.15.154:0/1276115439 >> 172.21.15.154:0/1276115439 conn(0x7f43880ce600 msgr2=0x7f43880cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:18.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f438edff700 1 -- 172.21.15.154:0/1276115439 shutdown_connections 2023-10-10T22:37:18.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.432+0000 7f438edff700 1 -- 172.21.15.154:0/1276115439 wait complete. 2023-10-10T22:37:18.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.434+0000 7f438edff700 1 Processor -- start 2023-10-10T22:37:18.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.434+0000 7f438edff700 1 -- start start 2023-10-10T22:37:18.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438edff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43881531f0 0x7f43881535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4388155a80 0x7f4388153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4388069ee0 0x7f438806a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438edff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438806a890 con 0x7f43881531f0 2023-10-10T22:37:18.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438edff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4388155ef0 con 0x7f4388069ee0 2023-10-10T22:37:18.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43880b15b0 con 0x7f4388155a80 2023-10-10T22:37:18.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43881531f0 0x7f43881535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43881531f0 0x7f43881535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41080/0 (socket says 172.21.15.154:41080) 2023-10-10T22:37:18.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438cb9b700 1 -- 172.21.15.154:0/2002401007 learned_addr learned my addr 172.21.15.154:0/2002401007 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:18.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438d39c700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4388069ee0 0x7f438806a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f4387fff700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4388155a80 0x7f4388153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438cb9b700 1 -- 172.21.15.154:0/2002401007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4388155a80 msgr2=0x7f4388153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438cb9b700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4388155a80 0x7f4388153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438cb9b700 1 -- 172.21.15.154:0/2002401007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4388069ee0 msgr2=0x7f438806a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438cb9b700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4388069ee0 0x7f438806a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438cb9b700 1 -- 172.21.15.154:0/2002401007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43881542b0 con 0x7f43881531f0 2023-10-10T22:37:18.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.435+0000 7f438cb9b700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43881531f0 0x7f43881535c0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f437c0029a0 tx=0x7f437c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:18.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.436+0000 7f4384ff9700 1 -- 172.21.15.154:0/2002401007 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c00f8d0 con 0x7f43881531f0 2023-10-10T22:37:18.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.436+0000 7f4384ff9700 1 -- 172.21.15.154:0/2002401007 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c00fa30 con 0x7f43881531f0 2023-10-10T22:37:18.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.436+0000 7f4384ff9700 1 -- 172.21.15.154:0/2002401007 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c00fdf0 con 0x7f43881531f0 2023-10-10T22:37:18.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.436+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4388154510 con 0x7f43881531f0 2023-10-10T22:37:18.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.436+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4388154ad0 con 0x7f43881531f0 2023-10-10T22:37:18.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.437+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4388154cf0 con 0x7f43881531f0 2023-10-10T22:37:18.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.438+0000 7f4384ff9700 1 -- 172.21.15.154:0/2002401007 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f437c006a30 con 0x7f43881531f0 2023-10-10T22:37:18.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.439+0000 7f4384ff9700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f60 0x7f436c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.439+0000 7f4384ff9700 1 -- 172.21.15.154:0/2002401007 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 5373+0+0 (secure 0 0 0) 0x7f437c084670 con 0x7f43881531f0 2023-10-10T22:37:18.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.439+0000 7f4387fff700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f60 0x7f436c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.440+0000 7f4387fff700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f60 0x7f436c069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4374001e90 tx=0x7f4374009040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:18.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.443+0000 7f4384ff9700 1 -- 172.21.15.154:0/2002401007 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f437c051a40 con 0x7f43881531f0 2023-10-10T22:37:18.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.634+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43880b13a0 con 0x7f43881531f0 2023-10-10T22:37:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.635+0000 7f4384ff9700 1 -- 172.21.15.154:0/2002401007 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) v1 ==== 74+0+12994 (secure 0 0 0) 0x7f437c055060 con 0x7f43881531f0 2023-10-10T22:37:18.637 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:18.637 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":205,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:17.693244+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:18.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.637+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f60 msgr2=0x7f436c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.637+0000 7f438edff700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f60 0x7f436c069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4374001e90 tx=0x7f4374009040 comp rx=0 tx=0).stop 2023-10-10T22:37:18.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.637+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43881531f0 msgr2=0x7f43881535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.637+0000 7f438edff700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43881531f0 0x7f43881535c0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f437c0029a0 tx=0x7f437c007d30 comp rx=0 tx=0).stop 2023-10-10T22:37:18.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.637+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 shutdown_connections 2023-10-10T22:37:18.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.637+0000 7f438edff700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f60 0x7f436c069410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.637+0000 7f438edff700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4388069ee0 0x7f438806a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.637+0000 7f438edff700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43881531f0 0x7f43881535c0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.637+0000 7f438edff700 1 --2- 172.21.15.154:0/2002401007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4388155a80 0x7f4388153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.638+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 >> 172.21.15.154:0/2002401007 conn(0x7f43880ce600 msgr2=0x7f438806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:18.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.638+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 shutdown_connections 2023-10-10T22:37:18.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.638+0000 7f438edff700 1 -- 172.21.15.154:0/2002401007 wait complete. 2023-10-10T22:37:18.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-10T22:37:18.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T22:37:18.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.843+0000 7f724fdff700 1 Processor -- start 2023-10-10T22:37:18.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.843+0000 7f724fdff700 1 -- start start 2023-10-10T22:37:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724fdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f724815ac80 0x7f7248069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724fdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f724815b050 0x7f7248069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724fdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72480af2f0 con 0x7f72480afa60 2023-10-10T22:37:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724fdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72480af5d0 con 0x7f724815ac80 2023-10-10T22:37:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724fdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72480c8660 con 0x7f724815b050 2023-10-10T22:37:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724db9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f724815ac80 0x7f7248069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724db9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f724815ac80 0x7f7248069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41084/0 (socket says 172.21.15.154:41084) 2023-10-10T22:37:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724db9b700 1 -- 172.21.15.154:0/3241720298 learned_addr learned my addr 172.21.15.154:0/3241720298 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724d39a700 1 --2- 172.21.15.154:0/3241720298 >> v2:172.21.15.179:3300/0 conn(0x7f724815b050 0x7f7248069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724db9b700 1 -- 172.21.15.154:0/3241720298 >> v2:172.21.15.179:3300/0 conn(0x7f724815b050 msgr2=0x7f7248069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724db9b700 1 --2- 172.21.15.154:0/3241720298 >> v2:172.21.15.179:3300/0 conn(0x7f724815b050 0x7f7248069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724db9b700 1 -- 172.21.15.154:0/3241720298 >> v1:172.21.15.154:6789/0 conn(0x7f72480afa60 legacy=0x7f72480afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.845+0000 7f724db9b700 1 -- 172.21.15.154:0/3241720298 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480c8940 con 0x7f724815ac80 2023-10-10T22:37:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.846+0000 7f724db9b700 1 --2- 172.21.15.154:0/3241720298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815ac80 0x7f7248069770 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f72480c9fd0 tx=0x7f7244009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d578ff449fb2085 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:18.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.846+0000 7f724cb99700 1 -- 172.21.15.154:0/3241720298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724400b860 con 0x7f724815ac80 2023-10-10T22:37:18.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.846+0000 7f724cb99700 1 -- 172.21.15.154:0/3241720298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724400b9c0 con 0x7f724815ac80 2023-10-10T22:37:18.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.846+0000 7f724cb99700 1 -- 172.21.15.154:0/3241720298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724400bd60 con 0x7f724815ac80 2023-10-10T22:37:18.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.846+0000 7f724fdff700 1 -- 172.21.15.154:0/3241720298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815ac80 msgr2=0x7f7248069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.847+0000 7f724fdff700 1 --2- 172.21.15.154:0/3241720298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815ac80 0x7f7248069770 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f72480c9fd0 tx=0x7f7244009250 comp rx=0 tx=0).stop 2023-10-10T22:37:18.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.847+0000 7f724fdff700 1 -- 172.21.15.154:0/3241720298 shutdown_connections 2023-10-10T22:37:18.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.847+0000 7f724fdff700 1 --2- 172.21.15.154:0/3241720298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815ac80 0x7f7248069770 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.847+0000 7f724fdff700 1 --2- 172.21.15.154:0/3241720298 >> v2:172.21.15.179:3300/0 conn(0x7f724815b050 0x7f7248069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.847+0000 7f724fdff700 1 -- 172.21.15.154:0/3241720298 >> 172.21.15.154:0/3241720298 conn(0x7f7248068e10 msgr2=0x7f72480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:18.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.847+0000 7f724fdff700 1 -- 172.21.15.154:0/3241720298 shutdown_connections 2023-10-10T22:37:18.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.847+0000 7f724fdff700 1 -- 172.21.15.154:0/3241720298 wait complete. 2023-10-10T22:37:18.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.848+0000 7f724fdff700 1 Processor -- start 2023-10-10T22:37:18.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.848+0000 7f724fdff700 1 -- start start 2023-10-10T22:37:18.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.849+0000 7f724fdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72480afa60 0x7f72480c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.849+0000 7f724fdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f724815ac80 0x7f72480c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.849+0000 7f724fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f724815b050 0x7f7248155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.849+0000 7f724fdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72480c75c0 con 0x7f72480afa60 2023-10-10T22:37:18.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.849+0000 7f724fdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7248168da0 con 0x7f724815ac80 2023-10-10T22:37:18.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.849+0000 7f724fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72480c6d20 con 0x7f724815b050 2023-10-10T22:37:18.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.849+0000 7f724db9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72480afa60 0x7f72480c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.849+0000 7f724db9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72480afa60 0x7f72480c4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41100/0 (socket says 172.21.15.154:41100) 2023-10-10T22:37:18.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.849+0000 7f724db9b700 1 -- 172.21.15.154:0/2082314321 learned_addr learned my addr 172.21.15.154:0/2082314321 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:18.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f724db9b700 1 -- 172.21.15.154:0/2082314321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f724815b050 msgr2=0x7f7248155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f724db9b700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f724815b050 0x7f7248155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f724db9b700 1 -- 172.21.15.154:0/2082314321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f724815ac80 msgr2=0x7f72480c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:18.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f724db9b700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f724815ac80 0x7f72480c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:18.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f724db9b700 1 -- 172.21.15.154:0/2082314321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440094f0 con 0x7f72480afa60 2023-10-10T22:37:18.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f724db9b700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72480afa60 0x7f72480c4110 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f7248063d40 tx=0x7f7244017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:18.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f723dffb700 1 -- 172.21.15.154:0/2082314321 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244011e60 con 0x7f72480afa60 2023-10-10T22:37:18.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f723dffb700 1 -- 172.21.15.154:0/2082314321 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724401a630 con 0x7f72480afa60 2023-10-10T22:37:18.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f723dffb700 1 -- 172.21.15.154:0/2082314321 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724401a9f0 con 0x7f72480afa60 2023-10-10T22:37:18.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.850+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72480c7000 con 0x7f72480afa60 2023-10-10T22:37:18.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.851+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72480c6a10 con 0x7f72480afa60 2023-10-10T22:37:18.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.852+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7248168c00 con 0x7f72480afa60 2023-10-10T22:37:18.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.852+0000 7f723dffb700 1 -- 172.21.15.154:0/2082314321 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f724402d440 con 0x7f72480afa60 2023-10-10T22:37:18.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.853+0000 7f723dffb700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f722c066f30 0x7f722c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:18.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.853+0000 7f723dffb700 1 -- 172.21.15.154:0/2082314321 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 5373+0+0 (secure 0 0 0) 0x7f7244085fb0 con 0x7f72480afa60 2023-10-10T22:37:18.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.853+0000 7f724d39a700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f722c066f30 0x7f722c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:18.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.854+0000 7f724d39a700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f722c066f30 0x7f722c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7248157a80 tx=0x7f7238008040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:18.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:18.857+0000 7f723dffb700 1 -- 172.21.15.154:0/2082314321 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7248168c00 con 0x7f72480afa60 2023-10-10T22:37:19.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.046+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7248168c00 con 0x7f72480afa60 2023-10-10T22:37:19.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.047+0000 7f723dffb700 1 -- 172.21.15.154:0/2082314321 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v205) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7248168c00 con 0x7f72480afa60 2023-10-10T22:37:19.049 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T22:37:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f722c066f30 msgr2=0x7f722c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f722c066f30 0x7f722c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7248157a80 tx=0x7f7238008040 comp rx=0 tx=0).stop 2023-10-10T22:37:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72480afa60 msgr2=0x7f72480c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72480afa60 0x7f72480c4110 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f7248063d40 tx=0x7f7244017000 comp rx=0 tx=0).stop 2023-10-10T22:37:19.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 shutdown_connections 2023-10-10T22:37:19.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f722c066f30 0x7f722c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f724815b050 0x7f7248155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72480afa60 0x7f72480c4110 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 --2- 172.21.15.154:0/2082314321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f724815ac80 0x7f72480c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.049+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 >> 172.21.15.154:0/2082314321 conn(0x7f7248068e10 msgr2=0x7f72480c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.050+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 shutdown_connections 2023-10-10T22:37:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.050+0000 7f724fdff700 1 -- 172.21.15.154:0/2082314321 wait complete. 2023-10-10T22:37:19.069 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-10T22:37:19.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.249+0000 7fd458dff700 1 Processor -- start 2023-10-10T22:37:19.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.249+0000 7fd458dff700 1 -- start start 2023-10-10T22:37:19.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.250+0000 7fd458dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd454159720 0x7fd454159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.250+0000 7fd458dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd4540ab4e0 0x7fd4540a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.250+0000 7fd458dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4540a9e10 0x7fd4540ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.250+0000 7fd458dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4540ab950 con 0x7fd4540a9e10 2023-10-10T22:37:19.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.250+0000 7fd458dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4540ac020 con 0x7fd4540ab4e0 2023-10-10T22:37:19.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.250+0000 7fd458dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540aa440 con 0x7fd454159720 2023-10-10T22:37:19.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd452d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4540a9e10 0x7fd4540ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd452d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4540a9e10 0x7fd4540ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41114/0 (socket says 172.21.15.154:41114) 2023-10-10T22:37:19.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd452d9d700 1 -- 172.21.15.154:0/2183285873 learned_addr learned my addr 172.21.15.154:0/2183285873 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:19.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd45259c700 1 --2- 172.21.15.154:0/2183285873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd454159720 0x7fd454159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd451d9b700 1 --2- 172.21.15.154:0/2183285873 >> v2:172.21.15.179:3300/0 conn(0x7fd4540ab4e0 0x7fd4540a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd452d9d700 1 -- 172.21.15.154:0/2183285873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd454159720 msgr2=0x7fd454159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:19.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd452d9d700 1 --2- 172.21.15.154:0/2183285873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd454159720 0x7fd454159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd452d9d700 1 -- 172.21.15.154:0/2183285873 >> v2:172.21.15.179:3300/0 conn(0x7fd4540ab4e0 msgr2=0x7fd4540a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:19.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd452d9d700 1 --2- 172.21.15.154:0/2183285873 >> v2:172.21.15.179:3300/0 conn(0x7fd4540ab4e0 0x7fd4540a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.251+0000 7fd452d9d700 1 -- 172.21.15.154:0/2183285873 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540aa720 con 0x7fd4540a9e10 2023-10-10T22:37:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd452d9d700 1 --2- 172.21.15.154:0/2183285873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540a9e10 0x7fd4540ad250 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fd454064210 tx=0x7fd44c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997e7c6e983eec6e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd45159a700 1 -- 172.21.15.154:0/2183285873 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c00e070 con 0x7fd4540a9e10 2023-10-10T22:37:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd45159a700 1 -- 172.21.15.154:0/2183285873 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c00b970 con 0x7fd4540a9e10 2023-10-10T22:37:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd45159a700 1 -- 172.21.15.154:0/2183285873 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0092e0 con 0x7fd4540a9e10 2023-10-10T22:37:19.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd458dff700 1 -- 172.21.15.154:0/2183285873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540a9e10 msgr2=0x7fd4540ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd458dff700 1 --2- 172.21.15.154:0/2183285873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540a9e10 0x7fd4540ad250 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fd454064210 tx=0x7fd44c009840 comp rx=0 tx=0).stop 2023-10-10T22:37:19.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd458dff700 1 -- 172.21.15.154:0/2183285873 shutdown_connections 2023-10-10T22:37:19.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd458dff700 1 --2- 172.21.15.154:0/2183285873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540a9e10 0x7fd4540ad250 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd458dff700 1 --2- 172.21.15.154:0/2183285873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd454159720 0x7fd454159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd458dff700 1 --2- 172.21.15.154:0/2183285873 >> v2:172.21.15.179:3300/0 conn(0x7fd4540ab4e0 0x7fd4540a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.252+0000 7fd458dff700 1 -- 172.21.15.154:0/2183285873 >> 172.21.15.154:0/2183285873 conn(0x7fd45406a320 msgr2=0x7fd4540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.253+0000 7fd458dff700 1 -- 172.21.15.154:0/2183285873 shutdown_connections 2023-10-10T22:37:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.253+0000 7fd458dff700 1 -- 172.21.15.154:0/2183285873 wait complete. 2023-10-10T22:37:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.254+0000 7fd458dff700 1 Processor -- start 2023-10-10T22:37:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.254+0000 7fd458dff700 1 -- start start 2023-10-10T22:37:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd458dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4540a9e10 0x7fd45415fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd458dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540ab4e0 0x7fd45415e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd458dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd454159720 0x7fd4540b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd458dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd454160150 con 0x7fd4540ab4e0 2023-10-10T22:37:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd458dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45415e8d0 con 0x7fd454159720 2023-10-10T22:37:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd458dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45415eb70 con 0x7fd4540a9e10 2023-10-10T22:37:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd451d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540ab4e0 0x7fd45415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd45259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4540a9e10 0x7fd45415fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd45259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4540a9e10 0x7fd45415fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:50108/0 (socket says 172.21.15.154:50108) 2023-10-10T22:37:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd45259c700 1 -- 172.21.15.154:0/4200426855 learned_addr learned my addr 172.21.15.154:0/4200426855 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.255+0000 7fd451d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540ab4e0 0x7fd45415e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41128/0 (socket says 172.21.15.154:41128) 2023-10-10T22:37:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd452d9d700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd454159720 0x7fd4540b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd451d9b700 1 -- 172.21.15.154:0/4200426855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4540a9e10 msgr2=0x7fd45415fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd451d9b700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4540a9e10 0x7fd45415fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd451d9b700 1 -- 172.21.15.154:0/4200426855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd454159720 msgr2=0x7fd4540b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd451d9b700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd454159720 0x7fd4540b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd451d9b700 1 -- 172.21.15.154:0/4200426855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c009ae0 con 0x7fd4540ab4e0 2023-10-10T22:37:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd452d9d700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd454159720 0x7fd4540b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd451d9b700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540ab4e0 0x7fd45415e390 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fd44800ea50 tx=0x7fd4480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd4427fc700 1 -- 172.21.15.154:0/4200426855 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800c7f0 con 0x7fd4540ab4e0 2023-10-10T22:37:19.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd4427fc700 1 -- 172.21.15.154:0/4200426855 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800c970 con 0x7fd4540ab4e0 2023-10-10T22:37:19.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd4427fc700 1 -- 172.21.15.154:0/4200426855 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800cd30 con 0x7fd4540ab4e0 2023-10-10T22:37:19.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45415ee50 con 0x7fd4540ab4e0 2023-10-10T22:37:19.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.256+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45415f490 con 0x7fd4540ab4e0 2023-10-10T22:37:19.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.257+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45415efe0 con 0x7fd4540ab4e0 2023-10-10T22:37:19.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.258+0000 7fd4427fc700 1 -- 172.21.15.154:0/4200426855 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd448013680 con 0x7fd4540ab4e0 2023-10-10T22:37:19.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.259+0000 7fd4427fc700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd434066f30 0x7fd4340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.259+0000 7fd4427fc700 1 -- 172.21.15.154:0/4200426855 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 5373+0+0 (secure 0 0 0) 0x7fd4480846b0 con 0x7fd4540ab4e0 2023-10-10T22:37:19.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.260+0000 7fd45259c700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd434066f30 0x7fd4340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.260+0000 7fd45259c700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd434066f30 0x7fd4340693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd444009e70 tx=0x7fd4440091a0 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:19.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.263+0000 7fd4427fc700 1 -- 172.21.15.154:0/4200426855 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4480519d0 con 0x7fd4540ab4e0 2023-10-10T22:37:19.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.458+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd45404c3c0 con 0x7fd4540ab4e0 2023-10-10T22:37:19.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.458+0000 7fd4427fc700 1 -- 172.21.15.154:0/4200426855 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v205) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd448054ff0 con 0x7fd4540ab4e0 2023-10-10T22:37:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:19.460 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T22:37:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-10-10T22:37:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-10-10T22:37:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:19.461 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T22:37:19.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.460+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd434066f30 msgr2=0x7fd4340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.460+0000 7fd458dff700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd434066f30 0x7fd4340693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd444009e70 tx=0x7fd4440091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.460+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540ab4e0 msgr2=0x7fd45415e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.460+0000 7fd458dff700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540ab4e0 0x7fd45415e390 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fd44800ea50 tx=0x7fd4480091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.461+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 shutdown_connections 2023-10-10T22:37:19.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.461+0000 7fd458dff700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd434066f30 0x7fd4340693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.461+0000 7fd458dff700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd454159720 0x7fd4540b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.461+0000 7fd458dff700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4540a9e10 0x7fd45415fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.461+0000 7fd458dff700 1 --2- 172.21.15.154:0/4200426855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4540ab4e0 0x7fd45415e390 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.461+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 >> 172.21.15.154:0/4200426855 conn(0x7fd45406a320 msgr2=0x7fd4540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:19.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.461+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 shutdown_connections 2023-10-10T22:37:19.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.461+0000 7fd458dff700 1 -- 172.21.15.154:0/4200426855 wait complete. 2023-10-10T22:37:19.480 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-10T22:37:19.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-10T22:37:19.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.665+0000 7f262d3ff700 1 Processor -- start 2023-10-10T22:37:19.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.665+0000 7f262d3ff700 1 -- start start 2023-10-10T22:37:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.666+0000 7f262d3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2628069a50 0x7f26280c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f262d3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26280ac030 con 0x7f26280c8490 2023-10-10T22:37:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f262d3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26280ab820 con 0x7f2628069e20 2023-10-10T22:37:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f262d3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262806dbb0 con 0x7f2628069a50 2023-10-10T22:37:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f2626ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2628069a50 0x7f26280c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f26267fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f26280c8490 0x7f262815a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50344/0 (socket says 172.21.15.154:50344) 2023-10-10T22:37:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f2626ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2628069a50 0x7f26280c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41136/0 (socket says 172.21.15.154:41136) 2023-10-10T22:37:19.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f26267fc700 1 -- 172.21.15.154:0/301250462 learned_addr learned my addr 172.21.15.154:0/301250462 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:19.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f2626ffd700 1 -- 172.21.15.154:0/301250462 >> v1:172.21.15.179:6789/0 conn(0x7f2628069e20 legacy=0x7f26281569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:19.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f2626ffd700 1 -- 172.21.15.154:0/301250462 >> v1:172.21.15.154:6789/0 conn(0x7f26280c8490 legacy=0x7f262815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f2625ffb700 1 -- 172.21.15.154:0/301250462 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490579515 0 0) 0x7f261c001110 con 0x7f26280c8490 2023-10-10T22:37:19.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.667+0000 7f2626ffd700 1 -- 172.21.15.154:0/301250462 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280aba70 con 0x7f2628069a50 2023-10-10T22:37:19.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.668+0000 7f2626ffd700 1 --2- 172.21.15.154:0/301250462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069a50 0x7f26280c6ac0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f261800bb90 tx=0x7f261800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362dbb6e90227450 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:19.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.668+0000 7f2625ffb700 1 -- 172.21.15.154:0/301250462 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800db60 con 0x7f2628069a50 2023-10-10T22:37:19.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.668+0000 7f2625ffb700 1 -- 172.21.15.154:0/301250462 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800dcc0 con 0x7f2628069a50 2023-10-10T22:37:19.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.668+0000 7f2625ffb700 1 -- 172.21.15.154:0/301250462 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26180106a0 con 0x7f2628069a50 2023-10-10T22:37:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.668+0000 7f262d3ff700 1 -- 172.21.15.154:0/301250462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069a50 msgr2=0x7f26280c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.668+0000 7f262d3ff700 1 --2- 172.21.15.154:0/301250462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069a50 0x7f26280c6ac0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f261800bb90 tx=0x7f261800b430 comp rx=0 tx=0).stop 2023-10-10T22:37:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.668+0000 7f262d3ff700 1 -- 172.21.15.154:0/301250462 shutdown_connections 2023-10-10T22:37:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.668+0000 7f262d3ff700 1 --2- 172.21.15.154:0/301250462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069a50 0x7f26280c6ac0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.668+0000 7f262d3ff700 1 -- 172.21.15.154:0/301250462 >> 172.21.15.154:0/301250462 conn(0x7f26280c8f90 msgr2=0x7f26280c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.669+0000 7f262d3ff700 1 -- 172.21.15.154:0/301250462 shutdown_connections 2023-10-10T22:37:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.669+0000 7f262d3ff700 1 -- 172.21.15.154:0/301250462 wait complete. 2023-10-10T22:37:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.670+0000 7f262d3ff700 1 Processor -- start 2023-10-10T22:37:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.670+0000 7f262d3ff700 1 -- start start 2023-10-10T22:37:19.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f262d3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2628069a50 0x7f26280b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f262d3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069e20 0x7f26280add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f262d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280c8490 0x7f2628143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f262d3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280b0450 con 0x7f2628069e20 2023-10-10T22:37:19.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f262d3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280af840 con 0x7f2628069a50 2023-10-10T22:37:19.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f262d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280afb20 con 0x7f26280c8490 2023-10-10T22:37:19.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f26267fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069e20 0x7f26280add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f26267fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069e20 0x7f26280add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41138/0 (socket says 172.21.15.154:41138) 2023-10-10T22:37:19.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f26267fc700 1 -- 172.21.15.154:0/4058104093 learned_addr learned my addr 172.21.15.154:0/4058104093 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:19.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f2626ffd700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2628069a50 0x7f26280b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.671+0000 7f26277fe700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280c8490 0x7f2628143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f26267fc700 1 -- 172.21.15.154:0/4058104093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280c8490 msgr2=0x7f2628143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f26267fc700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280c8490 0x7f2628143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f26267fc700 1 -- 172.21.15.154:0/4058104093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2628069a50 msgr2=0x7f26280b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:19.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f26267fc700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2628069a50 0x7f26280b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:19.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f26267fc700 1 -- 172.21.15.154:0/4058104093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261800b6d0 con 0x7f2628069e20 2023-10-10T22:37:19.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f26267fc700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069e20 0x7f26280add30 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c810 tx=0x7f261c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:19.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f260effd700 1 -- 172.21.15.154:0/4058104093 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c005b30 con 0x7f2628069e20 2023-10-10T22:37:19.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f260effd700 1 -- 172.21.15.154:0/4058104093 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c005c90 con 0x7f2628069e20 2023-10-10T22:37:19.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26280afe00 con 0x7f2628069e20 2023-10-10T22:37:19.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f260effd700 1 -- 172.21.15.154:0/4058104093 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c007300 con 0x7f2628069e20 2023-10-10T22:37:19.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.672+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280b0e20 con 0x7f2628069e20 2023-10-10T22:37:19.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.673+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26280b05c0 con 0x7f2628069e20 2023-10-10T22:37:19.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.674+0000 7f260effd700 1 -- 172.21.15.154:0/4058104093 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f261c01b3b0 con 0x7f2628069e20 2023-10-10T22:37:19.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.675+0000 7f260effd700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2614066fb0 0x7f2614069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:19.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.675+0000 7f260effd700 1 -- 172.21.15.154:0/4058104093 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 5373+0+0 (secure 0 0 0) 0x7f261c083850 con 0x7f2628069e20 2023-10-10T22:37:19.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.675+0000 7f2626ffd700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2614066fb0 0x7f2614069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:19.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.676+0000 7f2626ffd700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2614066fb0 0x7f2614069460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f261800b470 tx=0x7f261801a000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:19.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.679+0000 7f260effd700 1 -- 172.21.15.154:0/4058104093 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f261c050b70 con 0x7f2628069e20 2023-10-10T22:37:19.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:19.869+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f26280ac030 con 0x7f2628069e20 2023-10-10T22:37:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.286+0000 7f260effd700 1 -- 172.21.15.154:0/4058104093 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v206) v1 ==== 138+0+0 (secure 0 0 0) 0x7f26280ac030 con 0x7f2628069e20 2023-10-10T22:37:20.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2614066fb0 msgr2=0x7f2614069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:20.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2614066fb0 0x7f2614069460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f261800b470 tx=0x7f261801a000 comp rx=0 tx=0).stop 2023-10-10T22:37:20.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069e20 msgr2=0x7f26280add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:20.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069e20 0x7f26280add30 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c810 tx=0x7f261c007c50 comp rx=0 tx=0).stop 2023-10-10T22:37:20.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 shutdown_connections 2023-10-10T22:37:20.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2614066fb0 0x7f2614069460 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:20.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280c8490 0x7f2628143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:20.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2628069a50 0x7f26280b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 --2- 172.21.15.154:0/4058104093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2628069e20 0x7f26280add30 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.291+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 >> 172.21.15.154:0/4058104093 conn(0x7f26280c8f90 msgr2=0x7f26280cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.292+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 shutdown_connections 2023-10-10T22:37:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.292+0000 7f262d3ff700 1 -- 172.21.15.154:0/4058104093 wait complete. 2023-10-10T22:37:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-10-10T22:37:20.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-10T22:37:20.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.502+0000 7fd8d5fff700 1 Processor -- start 2023-10-10T22:37:20.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.502+0000 7fd8d5fff700 1 -- start start 2023-10-10T22:37:20.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.503+0000 7fd8d5fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8d01569f0 0x7fd8d00c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:20.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.503+0000 7fd8d5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d0068390 0x7fd8d0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:20.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.503+0000 7fd8d5fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d015a6f0 con 0x7fd8d0156620 2023-10-10T22:37:20.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.503+0000 7fd8d5fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d00c8d30 con 0x7fd8d01569f0 2023-10-10T22:37:20.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.503+0000 7fd8d5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0068d70 con 0x7fd8d0068390 2023-10-10T22:37:20.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8c7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8d01569f0 0x7fd8d00c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:20.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8c7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8d01569f0 0x7fd8d00c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41152/0 (socket says 172.21.15.154:41152) 2023-10-10T22:37:20.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8c7fff700 1 -- 172.21.15.154:0/3936590968 learned_addr learned my addr 172.21.15.154:0/3936590968 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:20.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8cf7fe700 1 --1- 172.21.15.154:0/3936590968 >> v1:172.21.15.154:6789/0 conn(0x7fd8d0156620 0x7fd8d00ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50356/0 (socket says 172.21.15.154:50356) 2023-10-10T22:37:20.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8cffff700 1 --2- 172.21.15.154:0/3936590968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d0068390 0x7fd8d0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:20.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8c7fff700 1 -- 172.21.15.154:0/3936590968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d0068390 msgr2=0x7fd8d0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:20.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8c7fff700 1 --2- 172.21.15.154:0/3936590968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d0068390 0x7fd8d0068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:20.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8c7fff700 1 -- 172.21.15.154:0/3936590968 >> v1:172.21.15.154:6789/0 conn(0x7fd8d0156620 legacy=0x7fd8d00ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:20.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8c7fff700 1 -- 172.21.15.154:0/3936590968 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d015a9d0 con 0x7fd8d01569f0 2023-10-10T22:37:20.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.504+0000 7fd8c7fff700 1 --2- 172.21.15.154:0/3936590968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d01569f0 0x7fd8d00c87f0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80099b0 tx=0x7fd8b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596121c10a5ae711 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:20.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8ceffd700 1 -- 172.21.15.154:0/3936590968 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800b860 con 0x7fd8d01569f0 2023-10-10T22:37:20.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8ceffd700 1 -- 172.21.15.154:0/3936590968 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b800b9c0 con 0x7fd8d01569f0 2023-10-10T22:37:20.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8ceffd700 1 -- 172.21.15.154:0/3936590968 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800bd60 con 0x7fd8d01569f0 2023-10-10T22:37:20.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3936590968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d01569f0 msgr2=0x7fd8d00c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:20.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8d5fff700 1 --2- 172.21.15.154:0/3936590968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d01569f0 0x7fd8d00c87f0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80099b0 tx=0x7fd8b8009250 comp rx=0 tx=0).stop 2023-10-10T22:37:20.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3936590968 shutdown_connections 2023-10-10T22:37:20.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8d5fff700 1 --2- 172.21.15.154:0/3936590968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d0068390 0x7fd8d0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:20.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8d5fff700 1 --2- 172.21.15.154:0/3936590968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d01569f0 0x7fd8d00c87f0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:20.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3936590968 >> 172.21.15.154:0/3936590968 conn(0x7fd8d00cc540 msgr2=0x7fd8d00cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:20.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3936590968 shutdown_connections 2023-10-10T22:37:20.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.505+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3936590968 wait complete. 2023-10-10T22:37:20.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.507+0000 7fd8d5fff700 1 Processor -- start 2023-10-10T22:37:20.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.507+0000 7fd8d5fff700 1 -- start start 2023-10-10T22:37:20.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8d5fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8d0068390 0x7fd8d0153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:20.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8d5fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d0156620 0x7fd8d00c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:20.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8d5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d01569f0 0x7fd8d01537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:20.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8d5fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0153580 con 0x7fd8d0156620 2023-10-10T22:37:20.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8d5fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0157ef0 con 0x7fd8d0068390 2023-10-10T22:37:20.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8d5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00b0370 con 0x7fd8d01569f0 2023-10-10T22:37:20.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d0156620 0x7fd8d00c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:20.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d0156620 0x7fd8d00c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41164/0 (socket says 172.21.15.154:41164) 2023-10-10T22:37:20.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8c7fff700 1 -- 172.21.15.154:0/3657758326 learned_addr learned my addr 172.21.15.154:0/3657758326 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:20.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8cf7fe700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8d0068390 0x7fd8d0153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:20.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8cffff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d01569f0 0x7fd8d01537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:20.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.508+0000 7fd8c7fff700 1 -- 172.21.15.154:0/3657758326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d01569f0 msgr2=0x7fd8d01537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:20.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8c7fff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d01569f0 0x7fd8d01537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:20.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8c7fff700 1 -- 172.21.15.154:0/3657758326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8d0068390 msgr2=0x7fd8d0153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:20.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8c7fff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8d0068390 0x7fd8d0153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:20.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8c7fff700 1 -- 172.21.15.154:0/3657758326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80094f0 con 0x7fd8d0156620 2023-10-10T22:37:20.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8c7fff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d0156620 0x7fd8d00c7450 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009290 tx=0x7fd8b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:20.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8c77fe700 1 -- 172.21.15.154:0/3657758326 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b801e070 con 0x7fd8d0156620 2023-10-10T22:37:20.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8c77fe700 1 -- 172.21.15.154:0/3657758326 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b8010470 con 0x7fd8d0156620 2023-10-10T22:37:20.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d0157130 con 0x7fd8d0156620 2023-10-10T22:37:20.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8c77fe700 1 -- 172.21.15.154:0/3657758326 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8010830 con 0x7fd8d0156620 2023-10-10T22:37:20.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.509+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d00c7990 con 0x7fd8d0156620 2023-10-10T22:37:20.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.510+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d0069270 con 0x7fd8d0156620 2023-10-10T22:37:20.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.511+0000 7fd8c77fe700 1 -- 172.21.15.154:0/3657758326 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8b8022410 con 0x7fd8d0156620 2023-10-10T22:37:20.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.512+0000 7fd8c77fe700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd8b0066f30 0x7fd8b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:20.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.512+0000 7fd8c77fe700 1 -- 172.21.15.154:0/3657758326 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 5743+0+0 (secure 0 0 0) 0x7fd8b8014070 con 0x7fd8d0156620 2023-10-10T22:37:20.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.512+0000 7fd8cf7fe700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd8b0066f30 0x7fd8b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:20.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.513+0000 7fd8cf7fe700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd8b0066f30 0x7fd8b00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0007fd0 tx=0x7fd8c0007d70 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:20.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.516+0000 7fd8c77fe700 1 -- 172.21.15.154:0/3657758326 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8b8054c90 con 0x7fd8d0156620 2023-10-10T22:37:20.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:20.707+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd8d00c7990 con 0x7fd8d0156620 2023-10-10T22:37:21.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.291+0000 7fd8c77fe700 1 -- 172.21.15.154:0/3657758326 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v207) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd8d00c7990 con 0x7fd8d0156620 2023-10-10T22:37:21.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.297+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd8b0066f30 msgr2=0x7fd8b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:21.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.297+0000 7fd8d5fff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd8b0066f30 0x7fd8b00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0007fd0 tx=0x7fd8c0007d70 comp rx=0 tx=0).stop 2023-10-10T22:37:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.297+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d0156620 msgr2=0x7fd8d00c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.297+0000 7fd8d5fff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d0156620 0x7fd8d00c7450 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009290 tx=0x7fd8b8019000 comp rx=0 tx=0).stop 2023-10-10T22:37:21.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.303+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 shutdown_connections 2023-10-10T22:37:21.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.303+0000 7fd8d5fff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd8b0066f30 0x7fd8b00693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:21.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.303+0000 7fd8d5fff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8d01569f0 0x7fd8d01537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:21.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.303+0000 7fd8d5fff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8d0068390 0x7fd8d0153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:21.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.303+0000 7fd8d5fff700 1 --2- 172.21.15.154:0/3657758326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d0156620 0x7fd8d00c7450 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:21.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.303+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 >> 172.21.15.154:0/3657758326 conn(0x7fd8d00cc540 msgr2=0x7fd8d0155940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:21.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.303+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 shutdown_connections 2023-10-10T22:37:21.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.304+0000 7fd8d5fff700 1 -- 172.21.15.154:0/3657758326 wait complete. 2023-10-10T22:37:21.309 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-10-10T22:37:21.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-10T22:37:21.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.513+0000 7fd29a3ff700 1 Processor -- start 2023-10-10T22:37:21.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.513+0000 7fd29a3ff700 1 -- start start 2023-10-10T22:37:21.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.514+0000 7fd29a3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2940c83f0 0x7fd2940c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:21.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.514+0000 7fd29a3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29415b0d0 con 0x7fd2941568e0 2023-10-10T22:37:21.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.514+0000 7fd29a3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2940c7a60 con 0x7fd2940ccee0 2023-10-10T22:37:21.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.514+0000 7fd29a3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29415a4c0 con 0x7fd2940c83f0 2023-10-10T22:37:21.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd29899c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd2941568e0 0x7fd2940ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50368/0 (socket says 172.21.15.154:50368) 2023-10-10T22:37:21.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd29899c700 1 -- 172.21.15.154:0/2823363340 learned_addr learned my addr 172.21.15.154:0/2823363340 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:21.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd293fff700 1 --2- 172.21.15.154:0/2823363340 >> v2:172.21.15.179:3300/0 conn(0x7fd2940c83f0 0x7fd2940c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd292ffd700 1 -- 172.21.15.154:0/2823363340 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693384223 0 0) 0x7fd29415b0d0 con 0x7fd2941568e0 2023-10-10T22:37:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd292ffd700 1 -- 172.21.15.154:0/2823363340 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c003570 con 0x7fd2941568e0 2023-10-10T22:37:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd292ffd700 1 -- 172.21.15.154:0/2823363340 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013262833 0 0) 0x7fd2940c7a60 con 0x7fd2940ccee0 2023-10-10T22:37:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd292ffd700 1 -- 172.21.15.154:0/2823363340 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd29415b0d0 con 0x7fd2940ccee0 2023-10-10T22:37:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd293fff700 1 -- 172.21.15.154:0/2823363340 >> v1:172.21.15.179:6789/0 conn(0x7fd2940ccee0 legacy=0x7fd2941561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:21.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd293fff700 1 -- 172.21.15.154:0/2823363340 >> v1:172.21.15.154:6789/0 conn(0x7fd2941568e0 legacy=0x7fd2940ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:21.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.515+0000 7fd293fff700 1 -- 172.21.15.154:0/2823363340 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29415a7a0 con 0x7fd2940c83f0 2023-10-10T22:37:21.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.516+0000 7fd293fff700 1 --2- 172.21.15.154:0/2823363340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2940c83f0 0x7fd2940c7520 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd2840098e0 tx=0x7fd2840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fc3b6b75517b78 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:21.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.516+0000 7fd292ffd700 1 -- 172.21.15.154:0/2823363340 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284011630 con 0x7fd2940c83f0 2023-10-10T22:37:21.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.516+0000 7fd292ffd700 1 -- 172.21.15.154:0/2823363340 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd284011790 con 0x7fd2940c83f0 2023-10-10T22:37:21.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.516+0000 7fd292ffd700 1 -- 172.21.15.154:0/2823363340 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284011b30 con 0x7fd2940c83f0 2023-10-10T22:37:21.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.516+0000 7fd29a3ff700 1 -- 172.21.15.154:0/2823363340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2940c83f0 msgr2=0x7fd2940c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:21.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.516+0000 7fd29a3ff700 1 --2- 172.21.15.154:0/2823363340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2940c83f0 0x7fd2940c7520 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd2840098e0 tx=0x7fd2840091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:21.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.516+0000 7fd29a3ff700 1 -- 172.21.15.154:0/2823363340 shutdown_connections 2023-10-10T22:37:21.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.516+0000 7fd29a3ff700 1 --2- 172.21.15.154:0/2823363340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2940c83f0 0x7fd2940c7520 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:21.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.517+0000 7fd29a3ff700 1 -- 172.21.15.154:0/2823363340 >> 172.21.15.154:0/2823363340 conn(0x7fd294068e10 msgr2=0x7fd2940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:21.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.517+0000 7fd29a3ff700 1 -- 172.21.15.154:0/2823363340 shutdown_connections 2023-10-10T22:37:21.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.517+0000 7fd29a3ff700 1 -- 172.21.15.154:0/2823363340 wait complete. 2023-10-10T22:37:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.518+0000 7fd29a3ff700 1 Processor -- start 2023-10-10T22:37:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.518+0000 7fd29a3ff700 1 -- start start 2023-10-10T22:37:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.519+0000 7fd29a3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2940c83f0 0x7fd2940b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.519+0000 7fd29a3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940ccee0 0x7fd29416b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.519+0000 7fd29a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2941568e0 0x7fd2941515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.519+0000 7fd29a3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29414d250 con 0x7fd2940ccee0 2023-10-10T22:37:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.519+0000 7fd29a3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29414d530 con 0x7fd2940c83f0 2023-10-10T22:37:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.519+0000 7fd29a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29414d810 con 0x7fd2941568e0 2023-10-10T22:37:21.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.519+0000 7fd2937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940ccee0 0x7fd29416b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:21.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.519+0000 7fd2937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940ccee0 0x7fd29416b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41172/0 (socket says 172.21.15.154:41172) 2023-10-10T22:37:21.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.519+0000 7fd2937fe700 1 -- 172.21.15.154:0/1991853753 learned_addr learned my addr 172.21.15.154:0/1991853753 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:21.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd293fff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2940c83f0 0x7fd2940b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:21.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd29899c700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2941568e0 0x7fd2941515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:21.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd2937fe700 1 -- 172.21.15.154:0/1991853753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2941568e0 msgr2=0x7fd2941515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:21.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd2937fe700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2941568e0 0x7fd2941515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:21.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd2937fe700 1 -- 172.21.15.154:0/1991853753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2940c83f0 msgr2=0x7fd2940b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:21.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd2937fe700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2940c83f0 0x7fd2940b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:21.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd2937fe700 1 -- 172.21.15.154:0/1991853753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009420 con 0x7fd2940ccee0 2023-10-10T22:37:21.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd2937fe700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940ccee0 0x7fd29416b610 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c790 tx=0x7fd288007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:21.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd27bfff700 1 -- 172.21.15.154:0/1991853753 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288010510 con 0x7fd2940ccee0 2023-10-10T22:37:21.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd27bfff700 1 -- 172.21.15.154:0/1991853753 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288010670 con 0x7fd2940ccee0 2023-10-10T22:37:21.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29414daf0 con 0x7fd2940ccee0 2023-10-10T22:37:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.520+0000 7fd27bfff700 1 -- 172.21.15.154:0/1991853753 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288010a10 con 0x7fd2940ccee0 2023-10-10T22:37:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.521+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2940b1650 con 0x7fd2940ccee0 2023-10-10T22:37:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.522+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29404c3c0 con 0x7fd2940ccee0 2023-10-10T22:37:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.523+0000 7fd27bfff700 1 -- 172.21.15.154:0/1991853753 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd28801b3b0 con 0x7fd2940ccee0 2023-10-10T22:37:21.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.524+0000 7fd27bfff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd280066f30 0x7fd2800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:21.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.524+0000 7fd27bfff700 1 -- 172.21.15.154:0/1991853753 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fd288083ff0 con 0x7fd2940ccee0 2023-10-10T22:37:21.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.524+0000 7fd293fff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd280066f30 0x7fd2800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:21.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.524+0000 7fd293fff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd280066f30 0x7fd2800693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd2840093f0 tx=0x7fd284017000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:21.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.529+0000 7fd27bfff700 1 -- 172.21.15.154:0/1991853753 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd288051040 con 0x7fd2940ccee0 2023-10-10T22:37:21.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:21.761+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd29415aa80 con 0x7fd2940ccee0 2023-10-10T22:37:22.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.323+0000 7fd27bfff700 1 -- 172.21.15.154:0/1991853753 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v90) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd288017020 con 0x7fd2940ccee0 2023-10-10T22:37:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.333+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd280066f30 msgr2=0x7fd2800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.333+0000 7fd29a3ff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd280066f30 0x7fd2800693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd2840093f0 tx=0x7fd284017000 comp rx=0 tx=0).stop 2023-10-10T22:37:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.333+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940ccee0 msgr2=0x7fd29416b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.333+0000 7fd29a3ff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940ccee0 0x7fd29416b610 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c790 tx=0x7fd288007e10 comp rx=0 tx=0).stop 2023-10-10T22:37:22.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.334+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 shutdown_connections 2023-10-10T22:37:22.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.334+0000 7fd29a3ff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd280066f30 0x7fd2800693e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd2840093f0 tx=0x7fd284017000 comp rx=0 tx=0).stop 2023-10-10T22:37:22.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.334+0000 7fd29a3ff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2941568e0 0x7fd2941515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.334+0000 7fd29a3ff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2940c83f0 0x7fd2940b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.334+0000 7fd29a3ff700 1 --2- 172.21.15.154:0/1991853753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940ccee0 0x7fd29416b610 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.334+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 >> 172.21.15.154:0/1991853753 conn(0x7fd294068e10 msgr2=0x7fd2940cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.338+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 shutdown_connections 2023-10-10T22:37:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.338+0000 7fd29a3ff700 1 -- 172.21.15.154:0/1991853753 wait complete. 2023-10-10T22:37:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 24 and data pool 25 2023-10-10T22:37:22.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:22.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.542+0000 7f04ef3ff700 1 Processor -- start 2023-10-10T22:37:22.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.542+0000 7f04ef3ff700 1 -- start start 2023-10-10T22:37:22.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ef3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80b1850 0x7f04e80b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ef3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04e81579f0 0x7f04e80abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ef3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e80cb300 con 0x7f04e80ae680 2023-10-10T22:37:22.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ef3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e806fc30 con 0x7f04e81579f0 2023-10-10T22:37:22.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ef3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80cc260 con 0x7f04e80b1850 2023-10-10T22:37:22.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ed99c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04e81579f0 0x7f04e80abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ed19b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80b1850 0x7f04e80b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ed19b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80b1850 0x7f04e80b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:50172/0 (socket says 172.21.15.154:50172) 2023-10-10T22:37:22.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ed19b700 1 -- 172.21.15.154:0/896015654 learned_addr learned my addr 172.21.15.154:0/896015654 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:22.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ed99c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04e81579f0 0x7f04e80abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:42882/0 (socket says 172.21.15.154:42882) 2023-10-10T22:37:22.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.544+0000 7f04ec99a700 1 --1- 172.21.15.154:0/896015654 >> v1:172.21.15.179:6789/0 conn(0x7f04e80ae680 0x7f04e81572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:50738/0 (socket says 172.21.15.154:50738) 2023-10-10T22:37:22.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.545+0000 7f04ed19b700 1 -- 172.21.15.154:0/896015654 >> v2:172.21.15.179:3300/0 conn(0x7f04e81579f0 msgr2=0x7f04e80abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:22.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.545+0000 7f04ed19b700 1 --2- 172.21.15.154:0/896015654 >> v2:172.21.15.179:3300/0 conn(0x7f04e81579f0 0x7f04e80abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.545+0000 7f04ed19b700 1 -- 172.21.15.154:0/896015654 >> v1:172.21.15.179:6789/0 conn(0x7f04e80ae680 legacy=0x7f04e81572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.545+0000 7f04ed19b700 1 -- 172.21.15.154:0/896015654 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e80cb5e0 con 0x7f04e80b1850 2023-10-10T22:37:22.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.545+0000 7f04ed99c700 1 --2- 172.21.15.154:0/896015654 >> v2:172.21.15.179:3300/0 conn(0x7f04e81579f0 0x7f04e80abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:22.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.545+0000 7f04ed19b700 1 --2- 172.21.15.154:0/896015654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80b1850 0x7f04e80b1c20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f04e40099b0 tx=0x7f04e4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d295c7af88752e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:22.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.545+0000 7f04dffff700 1 -- 172.21.15.154:0/896015654 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4009ea0 con 0x7f04e80b1850 2023-10-10T22:37:22.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.545+0000 7f04dffff700 1 -- 172.21.15.154:0/896015654 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e400b860 con 0x7f04e80b1850 2023-10-10T22:37:22.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.545+0000 7f04dffff700 1 -- 172.21.15.154:0/896015654 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e400bc00 con 0x7f04e80b1850 2023-10-10T22:37:22.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.546+0000 7f04ef3ff700 1 -- 172.21.15.154:0/896015654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80b1850 msgr2=0x7f04e80b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.546+0000 7f04ef3ff700 1 --2- 172.21.15.154:0/896015654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80b1850 0x7f04e80b1c20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f04e40099b0 tx=0x7f04e4009250 comp rx=0 tx=0).stop 2023-10-10T22:37:22.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.546+0000 7f04ef3ff700 1 -- 172.21.15.154:0/896015654 shutdown_connections 2023-10-10T22:37:22.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.546+0000 7f04ef3ff700 1 --2- 172.21.15.154:0/896015654 >> v2:172.21.15.179:3300/0 conn(0x7f04e81579f0 0x7f04e80abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.546+0000 7f04ef3ff700 1 --2- 172.21.15.154:0/896015654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80b1850 0x7f04e80b1c20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.546+0000 7f04ef3ff700 1 -- 172.21.15.154:0/896015654 >> 172.21.15.154:0/896015654 conn(0x7f04e806a320 msgr2=0x7f04e80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:22.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.546+0000 7f04ef3ff700 1 -- 172.21.15.154:0/896015654 shutdown_connections 2023-10-10T22:37:22.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.546+0000 7f04ef3ff700 1 -- 172.21.15.154:0/896015654 wait complete. 2023-10-10T22:37:22.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.547+0000 7f04ef3ff700 1 Processor -- start 2023-10-10T22:37:22.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.547+0000 7f04ef3ff700 1 -- start start 2023-10-10T22:37:22.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.548+0000 7f04ef3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e80ae680 0x7f04e8158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.548+0000 7f04ef3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80b1850 0x7f04e81593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.548+0000 7f04ef3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81579f0 0x7f04e8167d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.548+0000 7f04ef3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e815a760 con 0x7f04e80b1850 2023-10-10T22:37:22.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.548+0000 7f04ef3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e81598e0 con 0x7f04e80ae680 2023-10-10T22:37:22.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.548+0000 7f04ef3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e8159b50 con 0x7f04e81579f0 2023-10-10T22:37:22.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ec99a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80b1850 0x7f04e81593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ec99a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80b1850 0x7f04e81593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41184/0 (socket says 172.21.15.154:41184) 2023-10-10T22:37:22.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ec99a700 1 -- 172.21.15.154:0/808334732 learned_addr learned my addr 172.21.15.154:0/808334732 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:22.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ed19b700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e80ae680 0x7f04e8158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ed99c700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81579f0 0x7f04e8167d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ec99a700 1 -- 172.21.15.154:0/808334732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81579f0 msgr2=0x7f04e8167d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ec99a700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81579f0 0x7f04e8167d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ec99a700 1 -- 172.21.15.154:0/808334732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e80ae680 msgr2=0x7f04e8158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ec99a700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e80ae680 0x7f04e8158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ec99a700 1 -- 172.21.15.154:0/808334732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0009a20 con 0x7f04e80b1850 2023-10-10T22:37:22.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ed99c700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81579f0 0x7f04e8167d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:22.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04ec99a700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80b1850 0x7f04e81593a0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c7f0 tx=0x7f04d8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:22.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.549+0000 7f04dd7fa700 1 -- 172.21.15.154:0/808334732 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8005a70 con 0x7f04e80b1850 2023-10-10T22:37:22.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.550+0000 7f04dd7fa700 1 -- 172.21.15.154:0/808334732 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d8005bf0 con 0x7f04e80b1850 2023-10-10T22:37:22.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.550+0000 7f04dd7fa700 1 -- 172.21.15.154:0/808334732 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d80070f0 con 0x7f04e80b1850 2023-10-10T22:37:22.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.550+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e40094f0 con 0x7f04e80b1850 2023-10-10T22:37:22.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.550+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e815a110 con 0x7f04e80b1850 2023-10-10T22:37:22.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.551+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e804c3c0 con 0x7f04e80b1850 2023-10-10T22:37:22.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.551+0000 7f04dd7fa700 1 -- 172.21.15.154:0/808334732 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04d80074a0 con 0x7f04e80b1850 2023-10-10T22:37:22.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.552+0000 7f04dd7fa700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04cc066f30 0x7f04cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.552+0000 7f04dd7fa700 1 -- 172.21.15.154:0/808334732 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f04d8084120 con 0x7f04e80b1850 2023-10-10T22:37:22.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.553+0000 7f04ed19b700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04cc066f30 0x7f04cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.553+0000 7f04ed19b700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04cc066f30 0x7f04cc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f04e40099b0 tx=0x7f04e4017000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:22.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.556+0000 7f04dd7fa700 1 -- 172.21.15.154:0/808334732 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04d8051200 con 0x7f04e80b1850 2023-10-10T22:37:22.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.748+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04e80cb8c0 con 0x7f04e80b1850 2023-10-10T22:37:22.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.749+0000 7f04dd7fa700 1 -- 172.21.15.154:0/808334732 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v208) v1 ==== 74+0+16227 (secure 0 0 0) 0x7f04d8054820 con 0x7f04e80b1850 2023-10-10T22:37:22.751 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:22.751 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":208,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:21.762499+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:37:19.912253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-10T22:37:20.749030+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:22.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04cc066f30 msgr2=0x7f04cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04cc066f30 0x7f04cc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f04e40099b0 tx=0x7f04e4017000 comp rx=0 tx=0).stop 2023-10-10T22:37:22.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80b1850 msgr2=0x7f04e81593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80b1850 0x7f04e81593a0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c7f0 tx=0x7f04d8007f70 comp rx=0 tx=0).stop 2023-10-10T22:37:22.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 shutdown_connections 2023-10-10T22:37:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04cc066f30 0x7f04cc0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81579f0 0x7f04e8167d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e80ae680 0x7f04e8158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 --2- 172.21.15.154:0/808334732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80b1850 0x7f04e81593a0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 >> 172.21.15.154:0/808334732 conn(0x7f04e806a320 msgr2=0x7f04e8152ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 shutdown_connections 2023-10-10T22:37:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.752+0000 7f04ef3ff700 1 -- 172.21.15.154:0/808334732 wait complete. 2023-10-10T22:37:22.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:22.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.951+0000 7fc155bff700 1 Processor -- start 2023-10-10T22:37:22.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.952+0000 7fc155bff700 1 -- start start 2023-10-10T22:37:22.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.953+0000 7fc155bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1500cbf30 0x7fc1500ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.953+0000 7fc155bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1500cc300 con 0x7fc1500b1420 2023-10-10T22:37:22.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.953+0000 7fc155bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1500ad370 con 0x7fc1500ccf90 2023-10-10T22:37:22.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.953+0000 7fc155bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc150156bf0 con 0x7fc1500cbf30 2023-10-10T22:37:22.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.953+0000 7fc14f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1500cbf30 0x7fc1500ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.953+0000 7fc14ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc1500b1420 0x7fc1500c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50384/0 (socket says 172.21.15.154:50384) 2023-10-10T22:37:22.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.953+0000 7fc14f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1500cbf30 0x7fc1500ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41188/0 (socket says 172.21.15.154:41188) 2023-10-10T22:37:22.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.953+0000 7fc14ffff700 1 -- 172.21.15.154:0/4201649553 learned_addr learned my addr 172.21.15.154:0/4201649553 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.954+0000 7fc14f7fe700 1 -- 172.21.15.154:0/4201649553 >> v1:172.21.15.179:6789/0 conn(0x7fc1500ccf90 legacy=0x7fc1500b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.954+0000 7fc14f7fe700 1 -- 172.21.15.154:0/4201649553 >> v1:172.21.15.154:6789/0 conn(0x7fc1500b1420 legacy=0x7fc1500c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.954+0000 7fc14f7fe700 1 -- 172.21.15.154:0/4201649553 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1500ad650 con 0x7fc1500cbf30 2023-10-10T22:37:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.954+0000 7fc14effd700 1 -- 172.21.15.154:0/4201649553 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115711175 0 0) 0x7fc1500cc300 con 0x7fc1500b1420 2023-10-10T22:37:22.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.954+0000 7fc14f7fe700 1 --2- 172.21.15.154:0/4201649553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 0x7fc1500ae410 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fc1400098e0 tx=0x7fc1400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8bb9c17e730ea0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.954+0000 7fc14effd700 1 -- 172.21.15.154:0/4201649553 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140009e80 con 0x7fc1500cbf30 2023-10-10T22:37:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.954+0000 7fc14effd700 1 -- 172.21.15.154:0/4201649553 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14000b820 con 0x7fc1500cbf30 2023-10-10T22:37:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.954+0000 7fc14effd700 1 -- 172.21.15.154:0/4201649553 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14000bba0 con 0x7fc1500cbf30 2023-10-10T22:37:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.955+0000 7fc155bff700 1 -- 172.21.15.154:0/4201649553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 msgr2=0x7fc1500ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.955+0000 7fc155bff700 1 --2- 172.21.15.154:0/4201649553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 0x7fc1500ae410 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fc1400098e0 tx=0x7fc1400091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.955+0000 7fc155bff700 1 -- 172.21.15.154:0/4201649553 shutdown_connections 2023-10-10T22:37:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.955+0000 7fc155bff700 1 --2- 172.21.15.154:0/4201649553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 0x7fc1500ae410 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.955+0000 7fc155bff700 1 -- 172.21.15.154:0/4201649553 >> 172.21.15.154:0/4201649553 conn(0x7fc15006a320 msgr2=0x7fc1500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.955+0000 7fc155bff700 1 -- 172.21.15.154:0/4201649553 shutdown_connections 2023-10-10T22:37:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.955+0000 7fc155bff700 1 -- 172.21.15.154:0/4201649553 wait complete. 2023-10-10T22:37:22.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.956+0000 7fc155bff700 1 Processor -- start 2023-10-10T22:37:22.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.957+0000 7fc155bff700 1 -- start start 2023-10-10T22:37:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.957+0000 7fc155bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1500b1420 0x7fc150145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.957+0000 7fc155bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 0x7fc1500abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.957+0000 7fc155bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1500ccf90 0x7fc15015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.957+0000 7fc155bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc150145590 con 0x7fc1500cbf30 2023-10-10T22:37:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.957+0000 7fc155bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500a6600 con 0x7fc1500ccf90 2023-10-10T22:37:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.957+0000 7fc155bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500a5560 con 0x7fc1500b1420 2023-10-10T22:37:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc147fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 0x7fc1500abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc147fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 0x7fc1500abb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41204/0 (socket says 172.21.15.154:41204) 2023-10-10T22:37:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc147fff700 1 -- 172.21.15.154:0/4248509438 learned_addr learned my addr 172.21.15.154:0/4248509438 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc14ffff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1500ccf90 0x7fc15015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc14f7fe700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1500b1420 0x7fc150145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc147fff700 1 -- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1500b1420 msgr2=0x7fc150145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc147fff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1500b1420 0x7fc150145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc147fff700 1 -- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1500ccf90 msgr2=0x7fc15015dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc147fff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1500ccf90 0x7fc15015dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc147fff700 1 -- 172.21.15.154:0/4248509438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140009420 con 0x7fc1500cbf30 2023-10-10T22:37:22.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc14ffff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1500ccf90 0x7fc15015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:22.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc14f7fe700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1500b1420 0x7fc150145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:22.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.958+0000 7fc147fff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 0x7fc1500abb70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c5d0 tx=0x7fc138007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:22.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.959+0000 7fc1477fe700 1 -- 172.21.15.154:0/4248509438 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138011590 con 0x7fc1500cbf30 2023-10-10T22:37:22.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.959+0000 7fc1477fe700 1 -- 172.21.15.154:0/4248509438 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138011710 con 0x7fc1500cbf30 2023-10-10T22:37:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.959+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1500a5840 con 0x7fc1500cbf30 2023-10-10T22:37:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.959+0000 7fc1477fe700 1 -- 172.21.15.154:0/4248509438 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138011ad0 con 0x7fc1500cbf30 2023-10-10T22:37:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.959+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1500a5e80 con 0x7fc1500cbf30 2023-10-10T22:37:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.960+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15004c3c0 con 0x7fc1500cbf30 2023-10-10T22:37:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.961+0000 7fc1477fe700 1 -- 172.21.15.154:0/4248509438 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc13801c460 con 0x7fc1500cbf30 2023-10-10T22:37:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.961+0000 7fc1477fe700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc130066f30 0x7fc1300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.962+0000 7fc1477fe700 1 -- 172.21.15.154:0/4248509438 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fc1380844e0 con 0x7fc1500cbf30 2023-10-10T22:37:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.962+0000 7fc14f7fe700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc130066f30 0x7fc1300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.962+0000 7fc14f7fe700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc130066f30 0x7fc1300693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1400030c0 tx=0x7fc140016000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:22.966+0000 7fc1477fe700 1 -- 172.21.15.154:0/4248509438 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc138051540 con 0x7fc1500cbf30 2023-10-10T22:37:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.157+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc150156140 con 0x7fc1500cbf30 2023-10-10T22:37:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.158+0000 7fc1477fe700 1 -- 172.21.15.154:0/4248509438 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v208) v1 ==== 74+0+16227 (secure 0 0 0) 0x7fc138054b60 con 0x7fc1500cbf30 2023-10-10T22:37:23.159 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:23.160 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":208,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:21.762499+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:37:19.912253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-10T22:37:20.749030+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:23.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc130066f30 msgr2=0x7fc1300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:23.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc130066f30 0x7fc1300693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1400030c0 tx=0x7fc140016000 comp rx=0 tx=0).stop 2023-10-10T22:37:23.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 msgr2=0x7fc1500abb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:23.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 0x7fc1500abb70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c5d0 tx=0x7fc138007f60 comp rx=0 tx=0).stop 2023-10-10T22:37:23.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 shutdown_connections 2023-10-10T22:37:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc130066f30 0x7fc1300693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1500ccf90 0x7fc15015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1500b1420 0x7fc150145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 --2- 172.21.15.154:0/4248509438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1500cbf30 0x7fc1500abb70 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 >> 172.21.15.154:0/4248509438 conn(0x7fc15006a320 msgr2=0x7fc1500ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:23.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 shutdown_connections 2023-10-10T22:37:23.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.160+0000 7fc155bff700 1 -- 172.21.15.154:0/4248509438 wait complete. 2023-10-10T22:37:23.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-10T22:37:23.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.368+0000 7fee8739d700 1 Processor -- start 2023-10-10T22:37:23.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.368+0000 7fee8739d700 1 -- start start 2023-10-10T22:37:23.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee8739d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee8015a3b0 0x7fee8015a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:23.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee8739d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee800aef00 0x7fee8015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:23.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee8739d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800aea70 con 0x7fee8006e470 2023-10-10T22:37:23.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee8739d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee800ae480 con 0x7fee800aef00 2023-10-10T22:37:23.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee8739d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8015acc0 con 0x7fee8015a3b0 2023-10-10T22:37:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee85b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee800aef00 0x7fee8015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee85b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee800aef00 0x7fee8015d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41214/0 (socket says 172.21.15.154:41214) 2023-10-10T22:37:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee85b9a700 1 -- 172.21.15.154:0/469651580 learned_addr learned my addr 172.21.15.154:0/469651580 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee8639b700 1 --2- 172.21.15.154:0/469651580 >> v2:172.21.15.179:3300/0 conn(0x7fee8015a3b0 0x7fee8015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:23.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee85b9a700 1 -- 172.21.15.154:0/469651580 >> v2:172.21.15.179:3300/0 conn(0x7fee8015a3b0 msgr2=0x7fee8015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:23.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.370+0000 7fee85b9a700 1 --2- 172.21.15.154:0/469651580 >> v2:172.21.15.179:3300/0 conn(0x7fee8015a3b0 0x7fee8015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:23.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.371+0000 7fee85b9a700 1 -- 172.21.15.154:0/469651580 >> v1:172.21.15.179:6789/0 conn(0x7fee8006e470 legacy=0x7fee800c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:23.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.371+0000 7fee85b9a700 1 -- 172.21.15.154:0/469651580 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8015dd30 con 0x7fee800aef00 2023-10-10T22:37:23.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.371+0000 7fee85b9a700 1 --2- 172.21.15.154:0/469651580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 0x7fee8015d3c0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fee80063350 tx=0x7fee70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fca047cd0df2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:23.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.371+0000 7fee85399700 1 -- 172.21.15.154:0/469651580 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70009e70 con 0x7fee800aef00 2023-10-10T22:37:23.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.371+0000 7fee85399700 1 -- 172.21.15.154:0/469651580 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000b860 con 0x7fee800aef00 2023-10-10T22:37:23.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.371+0000 7fee85399700 1 -- 172.21.15.154:0/469651580 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000bc00 con 0x7fee800aef00 2023-10-10T22:37:23.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.372+0000 7fee8739d700 1 -- 172.21.15.154:0/469651580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 msgr2=0x7fee8015d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:23.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.372+0000 7fee8739d700 1 --2- 172.21.15.154:0/469651580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 0x7fee8015d3c0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fee80063350 tx=0x7fee70009250 comp rx=0 tx=0).stop 2023-10-10T22:37:23.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.372+0000 7fee8739d700 1 -- 172.21.15.154:0/469651580 shutdown_connections 2023-10-10T22:37:23.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.372+0000 7fee8739d700 1 --2- 172.21.15.154:0/469651580 >> v2:172.21.15.179:3300/0 conn(0x7fee8015a3b0 0x7fee8015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:23.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.372+0000 7fee8739d700 1 --2- 172.21.15.154:0/469651580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 0x7fee8015d3c0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:23.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.372+0000 7fee8739d700 1 -- 172.21.15.154:0/469651580 >> 172.21.15.154:0/469651580 conn(0x7fee800c9f70 msgr2=0x7fee8006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:23.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.372+0000 7fee8739d700 1 -- 172.21.15.154:0/469651580 shutdown_connections 2023-10-10T22:37:23.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.372+0000 7fee8739d700 1 -- 172.21.15.154:0/469651580 wait complete. 2023-10-10T22:37:23.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.373+0000 7fee8739d700 1 Processor -- start 2023-10-10T22:37:23.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.373+0000 7fee8739d700 1 -- start start 2023-10-10T22:37:23.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.374+0000 7fee8739d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8006e470 0x7fee800c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:23.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.374+0000 7fee8739d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 0x7fee800c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:23.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.374+0000 7fee8739d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8015a3b0 0x7fee80154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:23.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.374+0000 7fee8739d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800c4ab0 con 0x7fee800aef00 2023-10-10T22:37:23.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.374+0000 7fee8739d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800c44a0 con 0x7fee8006e470 2023-10-10T22:37:23.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.374+0000 7fee8739d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee800c6ab0 con 0x7fee8015a3b0 2023-10-10T22:37:23.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.374+0000 7fee85b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 0x7fee800c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:23.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee85b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 0x7fee800c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41224/0 (socket says 172.21.15.154:41224) 2023-10-10T22:37:23.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee85b9a700 1 -- 172.21.15.154:0/1341873467 learned_addr learned my addr 172.21.15.154:0/1341873467 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:23.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee8639b700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8006e470 0x7fee800c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:23.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee86b9c700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8015a3b0 0x7fee80154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:23.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee85b9a700 1 -- 172.21.15.154:0/1341873467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8015a3b0 msgr2=0x7fee80154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:23.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee85b9a700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8015a3b0 0x7fee80154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:23.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee85b9a700 1 -- 172.21.15.154:0/1341873467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8006e470 msgr2=0x7fee800c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:23.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee85b9a700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8006e470 0x7fee800c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee85b9a700 1 -- 172.21.15.154:0/1341873467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700094f0 con 0x7fee800aef00 2023-10-10T22:37:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee85b9a700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 0x7fee800c4f40 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fee80064280 tx=0x7fee70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee767fc700 1 -- 172.21.15.154:0/1341873467 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000bbe0 con 0x7fee800aef00 2023-10-10T22:37:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee767fc700 1 -- 172.21.15.154:0/1341873467 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee70011420 con 0x7fee800aef00 2023-10-10T22:37:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.375+0000 7fee767fc700 1 -- 172.21.15.154:0/1341873467 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee700117e0 con 0x7fee800aef00 2023-10-10T22:37:23.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.376+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee801533a0 con 0x7fee800aef00 2023-10-10T22:37:23.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.376+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee800c6060 con 0x7fee800aef00 2023-10-10T22:37:23.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.376+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee800c34c0 con 0x7fee800aef00 2023-10-10T22:37:23.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.377+0000 7fee767fc700 1 -- 172.21.15.154:0/1341873467 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee70011c10 con 0x7fee800aef00 2023-10-10T22:37:23.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.378+0000 7fee767fc700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fee64066f30 0x7fee640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:23.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.378+0000 7fee767fc700 1 -- 172.21.15.154:0/1341873467 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fee70085ff0 con 0x7fee800aef00 2023-10-10T22:37:23.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.379+0000 7fee8639b700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fee64066f30 0x7fee640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:23.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.379+0000 7fee8639b700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fee64066f30 0x7fee640693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee800c6e80 tx=0x7fee7c0091a0 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:23.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.383+0000 7fee767fc700 1 -- 172.21.15.154:0/1341873467 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee700b75a0 con 0x7fee800aef00 2023-10-10T22:37:23.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:23.620+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fee800c4bf0 con 0x7fee800aef00 2023-10-10T22:37:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.333+0000 7fee767fc700 1 -- 172.21.15.154:0/1341873467 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v93) v1 ==== 118+0+0 (secure 0 0 0) 0x7fee70052ff0 con 0x7fee800aef00 2023-10-10T22:37:24.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fee64066f30 msgr2=0x7fee640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:24.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fee64066f30 0x7fee640693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee800c6e80 tx=0x7fee7c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 msgr2=0x7fee800c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:24.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 0x7fee800c4f40 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fee80064280 tx=0x7fee70017000 comp rx=0 tx=0).stop 2023-10-10T22:37:24.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 shutdown_connections 2023-10-10T22:37:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fee64066f30 0x7fee640693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8015a3b0 0x7fee80154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee8006e470 0x7fee800c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 --2- 172.21.15.154:0/1341873467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee800aef00 0x7fee800c4f40 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 >> 172.21.15.154:0/1341873467 conn(0x7fee800c9f70 msgr2=0x7fee800cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 shutdown_connections 2023-10-10T22:37:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.336+0000 7fee8739d700 1 -- 172.21.15.154:0/1341873467 wait complete. 2023-10-10T22:37:24.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-10T22:37:24.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.542+0000 7fa47279d700 1 Processor -- start 2023-10-10T22:37:24.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.542+0000 7fa47279d700 1 -- start start 2023-10-10T22:37:24.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.543+0000 7fa47279d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa46c0b1b40 0x7fa46c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:24.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.543+0000 7fa47279d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c0cfb00 con 0x7fa46c0b4e70 2023-10-10T22:37:24.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.543+0000 7fa47279d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c0b5c40 con 0x7fa46c0b16d0 2023-10-10T22:37:24.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.543+0000 7fa47279d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c0b5f20 con 0x7fa46c0b1b40 2023-10-10T22:37:24.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa47179b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa46c0b4e70 0x7fa46c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50386/0 (socket says 172.21.15.154:50386) 2023-10-10T22:37:24.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa47179b700 1 -- 172.21.15.154:0/1151124471 learned_addr learned my addr 172.21.15.154:0/1151124471 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:24.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222949933 0 0) 0x7fa46c0cfb00 con 0x7fa46c0b4e70 2023-10-10T22:37:24.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa458003570 con 0x7fa46c0b4e70 2023-10-10T22:37:24.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa471f9c700 1 --2- 172.21.15.154:0/1151124471 >> v2:172.21.15.179:3300/0 conn(0x7fa46c0b1b40 0x7fa46c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:24.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1113965827 0 0) 0x7fa458003570 con 0x7fa46c0b4e70 2023-10-10T22:37:24.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 >> v2:172.21.15.179:3300/0 conn(0x7fa46c0b1b40 msgr2=0x7fa46c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:24.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 --2- 172.21.15.154:0/1151124471 >> v2:172.21.15.179:3300/0 conn(0x7fa46c0b1b40 0x7fa46c0b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 >> v1:172.21.15.179:6789/0 conn(0x7fa46c0b16d0 legacy=0x7fa46c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:24.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0b6200 con 0x7fa46c0b4e70 2023-10-10T22:37:24.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fa468001470 con 0x7fa46c0b4e70 2023-10-10T22:37:24.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 >> v1:172.21.15.154:6789/0 conn(0x7fa46c0b4e70 legacy=0x7fa46c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:24.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa458003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:24.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.544+0000 7fa463fff700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa458004810 0x7fa458004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:24.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa463fff700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa458005310 0x7fa45800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:24.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0b5f20 con 0x7fa458003b30 2023-10-10T22:37:24.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45800c2d0 con 0x7fa458005310 2023-10-10T22:37:24.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45800c490 con 0x7fa458004810 2023-10-10T22:37:24.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa47179b700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa458003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:24.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa470f9a700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa458004810 0x7fa458004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:24.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa471f9c700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa458005310 0x7fa45800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:24.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa47179b700 1 -- 172.21.15.154:0/1151124471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa458004810 msgr2=0x7fa458004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:24.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa47179b700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa458004810 0x7fa458004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa47179b700 1 -- 172.21.15.154:0/1151124471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa458005310 msgr2=0x7fa45800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:24.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa47179b700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa458005310 0x7fa45800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa47179b700 1 -- 172.21.15.154:0/1151124471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458003570 con 0x7fa458003b30 2023-10-10T22:37:24.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa471f9c700 1 -- 172.21.15.154:0/1151124471 reap_dead start 2023-10-10T22:37:24.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa47179b700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa458003f40 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fa46800c2d0 tx=0x7fa468001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5a72e484f0e5c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:24.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.545+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800cb60 con 0x7fa458003b30 2023-10-10T22:37:24.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.546+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800cce0 con 0x7fa458003b30 2023-10-10T22:37:24.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.546+0000 7fa463fff700 1 -- 172.21.15.154:0/1151124471 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468005b70 con 0x7fa458003b30 2023-10-10T22:37:24.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.546+0000 7fa47279d700 1 -- 172.21.15.154:0/1151124471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 msgr2=0x7fa458003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:24.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.546+0000 7fa47279d700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa458003f40 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fa46800c2d0 tx=0x7fa468001d80 comp rx=0 tx=0).stop 2023-10-10T22:37:24.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.546+0000 7fa47279d700 1 -- 172.21.15.154:0/1151124471 shutdown_connections 2023-10-10T22:37:24.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.546+0000 7fa47279d700 1 --2- 172.21.15.154:0/1151124471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa458003f40 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.546+0000 7fa47279d700 1 -- 172.21.15.154:0/1151124471 >> 172.21.15.154:0/1151124471 conn(0x7fa46c0d10c0 msgr2=0x7fa46c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:24.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.546+0000 7fa47279d700 1 -- 172.21.15.154:0/1151124471 shutdown_connections 2023-10-10T22:37:24.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.546+0000 7fa47279d700 1 -- 172.21.15.154:0/1151124471 wait complete. 2023-10-10T22:37:24.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.548+0000 7fa47279d700 1 Processor -- start 2023-10-10T22:37:24.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.548+0000 7fa47279d700 1 -- start start 2023-10-10T22:37:24.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47279d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa46c0a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:24.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47279d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa46c0a7440 0x7fa46c0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:24.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47279d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46c0c7a20 0x7fa46c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:24.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47279d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0a78b0 con 0x7fa458003b30 2023-10-10T22:37:24.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47279d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0c8db0 con 0x7fa46c0a7440 2023-10-10T22:37:24.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47279d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0c81a0 con 0x7fa46c0c7a20 2023-10-10T22:37:24.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47179b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa46c0a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:24.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47179b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa46c0a6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41234/0 (socket says 172.21.15.154:41234) 2023-10-10T22:37:24.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47179b700 1 -- 172.21.15.154:0/2090946842 learned_addr learned my addr 172.21.15.154:0/2090946842 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:24.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa471f9c700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46c0c7a20 0x7fa46c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:24.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa470f9a700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa46c0a7440 0x7fa46c0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:24.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47179b700 1 -- 172.21.15.154:0/2090946842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46c0c7a20 msgr2=0x7fa46c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:24.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47179b700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46c0c7a20 0x7fa46c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47179b700 1 -- 172.21.15.154:0/2090946842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa46c0a7440 msgr2=0x7fa46c0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:24.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47179b700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa46c0a7440 0x7fa46c0c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:24.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.549+0000 7fa47179b700 1 -- 172.21.15.154:0/2090946842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0c8480 con 0x7fa458003b30 2023-10-10T22:37:24.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.550+0000 7fa47179b700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa46c0a6f00 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c2a0 tx=0x7fa468015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:24.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.550+0000 7fa4617fa700 1 -- 172.21.15.154:0/2090946842 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468022070 con 0x7fa458003b30 2023-10-10T22:37:24.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.550+0000 7fa4617fa700 1 -- 172.21.15.154:0/2090946842 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800cb60 con 0x7fa458003b30 2023-10-10T22:37:24.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.550+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c0c8760 con 0x7fa458003b30 2023-10-10T22:37:24.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.550+0000 7fa4617fa700 1 -- 172.21.15.154:0/2090946842 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468007510 con 0x7fa458003b30 2023-10-10T22:37:24.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.550+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c0c7e70 con 0x7fa458003b30 2023-10-10T22:37:24.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.551+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c0c9e70 con 0x7fa458003b30 2023-10-10T22:37:24.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.552+0000 7fa4617fa700 1 -- 172.21.15.154:0/2090946842 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa46801e430 con 0x7fa458003b30 2023-10-10T22:37:24.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.553+0000 7fa4617fa700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa450066f30 0x7fa4500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:24.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.553+0000 7fa4617fa700 1 -- 172.21.15.154:0/2090946842 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fa4680857f0 con 0x7fa458003b30 2023-10-10T22:37:24.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.553+0000 7fa470f9a700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa450066f30 0x7fa4500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:24.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.553+0000 7fa470f9a700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa450066f30 0x7fa4500693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0cbeb0 tx=0x7fa45c009040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:24.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.557+0000 7fa4617fa700 1 -- 172.21.15.154:0/2090946842 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4680527b0 con 0x7fa458003b30 2023-10-10T22:37:24.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:24.788+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa46c04bb80 con 0x7fa458003b30 2023-10-10T22:37:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.339+0000 7fa4617fa700 1 -- 172.21.15.154:0/2090946842 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v94) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa468001aa0 con 0x7fa458003b30 2023-10-10T22:37:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa450066f30 msgr2=0x7fa4500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa450066f30 0x7fa4500693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0cbeb0 tx=0x7fa45c009040 comp rx=0 tx=0).stop 2023-10-10T22:37:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 msgr2=0x7fa46c0a6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa46c0a6f00 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c2a0 tx=0x7fa468015000 comp rx=0 tx=0).stop 2023-10-10T22:37:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 shutdown_connections 2023-10-10T22:37:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa450066f30 0x7fa4500693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46c0c7a20 0x7fa46c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa458003b30 0x7fa46c0a6f00 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 --2- 172.21.15.154:0/2090946842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa46c0a7440 0x7fa46c0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.341+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 >> 172.21.15.154:0/2090946842 conn(0x7fa46c0d10c0 msgr2=0x7fa46c0b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.342+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 shutdown_connections 2023-10-10T22:37:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.342+0000 7fa47279d700 1 -- 172.21.15.154:0/2090946842 wait complete. 2023-10-10T22:37:25.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:25.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.541+0000 7f690ef9d700 1 Processor -- start 2023-10-10T22:37:25.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.542+0000 7f690ef9d700 1 -- start start 2023-10-10T22:37:25.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.543+0000 7f690ef9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f69081566e0 0x7f69080ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:25.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.543+0000 7f690ef9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69080cb900 0x7f69080ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:25.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.543+0000 7f690ef9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69080ca860 con 0x7f6908156310 2023-10-10T22:37:25.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.543+0000 7f690ef9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69080cab40 con 0x7f69080cb900 2023-10-10T22:37:25.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.543+0000 7f690ef9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69080cae20 con 0x7f69081566e0 2023-10-10T22:37:25.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.543+0000 7f690e79c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69080cb900 0x7f69080ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:25.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.543+0000 7f690df9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6908156310 0x7f69080c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50398/0 (socket says 172.21.15.154:50398) 2023-10-10T22:37:25.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.543+0000 7f690e79c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69080cb900 0x7f69080ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41246/0 (socket says 172.21.15.154:41246) 2023-10-10T22:37:25.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.543+0000 7f690df9b700 1 -- 172.21.15.154:0/636217332 learned_addr learned my addr 172.21.15.154:0/636217332 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:25.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690d79a700 1 --2- 172.21.15.154:0/636217332 >> v2:172.21.15.179:3300/0 conn(0x7f69081566e0 0x7f69080ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:25.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690e79c700 1 -- 172.21.15.154:0/636217332 >> v2:172.21.15.179:3300/0 conn(0x7f69081566e0 msgr2=0x7f69080ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:25.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690e79c700 1 --2- 172.21.15.154:0/636217332 >> v2:172.21.15.179:3300/0 conn(0x7f69081566e0 0x7f69080ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690e79c700 1 -- 172.21.15.154:0/636217332 >> v1:172.21.15.154:6789/0 conn(0x7f6908156310 legacy=0x7f69080c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:25.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690e79c700 1 -- 172.21.15.154:0/636217332 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69080cb100 con 0x7f69080cb900 2023-10-10T22:37:25.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690d79a700 1 --2- 172.21.15.154:0/636217332 >> v2:172.21.15.179:3300/0 conn(0x7f69081566e0 0x7f69080ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:25.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690cf99700 1 -- 172.21.15.154:0/636217332 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101773890 0 0) 0x7f69080ca860 con 0x7f6908156310 2023-10-10T22:37:25.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690e79c700 1 --2- 172.21.15.154:0/636217332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69080cb900 0x7f69080ae540 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f690806c000 tx=0x7f690000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80294b08ad5758f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:25.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690cf99700 1 -- 172.21.15.154:0/636217332 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900010070 con 0x7f69080cb900 2023-10-10T22:37:25.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690cf99700 1 -- 172.21.15.154:0/636217332 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690000ddc0 con 0x7f69080cb900 2023-10-10T22:37:25.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.544+0000 7f690cf99700 1 -- 172.21.15.154:0/636217332 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000b320 con 0x7f69080cb900 2023-10-10T22:37:25.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.545+0000 7f690ef9d700 1 -- 172.21.15.154:0/636217332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69080cb900 msgr2=0x7f69080ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:25.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.545+0000 7f690ef9d700 1 --2- 172.21.15.154:0/636217332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69080cb900 0x7f69080ae540 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f690806c000 tx=0x7f690000b990 comp rx=0 tx=0).stop 2023-10-10T22:37:25.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.545+0000 7f690ef9d700 1 -- 172.21.15.154:0/636217332 shutdown_connections 2023-10-10T22:37:25.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.545+0000 7f690ef9d700 1 --2- 172.21.15.154:0/636217332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69080cb900 0x7f69080ae540 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.545+0000 7f690ef9d700 1 --2- 172.21.15.154:0/636217332 >> v2:172.21.15.179:3300/0 conn(0x7f69081566e0 0x7f69080ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.545+0000 7f690ef9d700 1 -- 172.21.15.154:0/636217332 >> 172.21.15.154:0/636217332 conn(0x7f69080cc1f0 msgr2=0x7f69080cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:25.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.545+0000 7f690ef9d700 1 -- 172.21.15.154:0/636217332 shutdown_connections 2023-10-10T22:37:25.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.545+0000 7f690ef9d700 1 -- 172.21.15.154:0/636217332 wait complete. 2023-10-10T22:37:25.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.546+0000 7f690ef9d700 1 Processor -- start 2023-10-10T22:37:25.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.547+0000 7f690ef9d700 1 -- start start 2023-10-10T22:37:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.547+0000 7f690ef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080cb900 0x7f690814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.547+0000 7f690ef9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6908156310 0x7f690815d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.547+0000 7f690ef9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69081566e0 0x7f69080b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.547+0000 7f690ef9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69080afd40 con 0x7f69081566e0 2023-10-10T22:37:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.547+0000 7f690ef9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69080af130 con 0x7f6908156310 2023-10-10T22:37:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.547+0000 7f690ef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69080af410 con 0x7f69080cb900 2023-10-10T22:37:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690e79c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69081566e0 0x7f69080b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690e79c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69081566e0 0x7f69080b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41258/0 (socket says 172.21.15.154:41258) 2023-10-10T22:37:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690e79c700 1 -- 172.21.15.154:0/1188524638 learned_addr learned my addr 172.21.15.154:0/1188524638 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690d79a700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6908156310 0x7f690815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690e79c700 1 -- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080cb900 msgr2=0x7f690814f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:25.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690df9b700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080cb900 0x7f690814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:25.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690e79c700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080cb900 0x7f690814f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690e79c700 1 -- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6908156310 msgr2=0x7f690815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:25.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690e79c700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6908156310 0x7f690815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690e79c700 1 -- 172.21.15.154:0/1188524638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690000bc30 con 0x7f69081566e0 2023-10-10T22:37:25.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690d79a700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6908156310 0x7f690815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690df9b700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080cb900 0x7f690814f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.548+0000 7f690e79c700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69081566e0 0x7f69080b01d0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f690000b9d0 tx=0x7f690001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.549+0000 7f68fdffb700 1 -- 172.21.15.154:0/1188524638 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69000032f0 con 0x7f69081566e0 2023-10-10T22:37:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.549+0000 7f68fdffb700 1 -- 172.21.15.154:0/1188524638 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690000ae00 con 0x7f69081566e0 2023-10-10T22:37:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.549+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69080af6f0 con 0x7f69081566e0 2023-10-10T22:37:25.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.549+0000 7f68fdffb700 1 -- 172.21.15.154:0/1188524638 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690001d890 con 0x7f69081566e0 2023-10-10T22:37:25.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.549+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690814fe30 con 0x7f69081566e0 2023-10-10T22:37:25.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.550+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69080afef0 con 0x7f69081566e0 2023-10-10T22:37:25.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.551+0000 7f68fdffb700 1 -- 172.21.15.154:0/1188524638 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6900003040 con 0x7f69081566e0 2023-10-10T22:37:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.551+0000 7f68fdffb700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f68ec066f30 0x7f68ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.552+0000 7f68fdffb700 1 -- 172.21.15.154:0/1188524638 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f6900086260 con 0x7f69081566e0 2023-10-10T22:37:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.552+0000 7f690df9b700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f68ec066f30 0x7f68ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.552+0000 7f690df9b700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f68ec066f30 0x7f68ec0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f69040018d0 tx=0x7f6904009040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.556+0000 7f68fdffb700 1 -- 172.21.15.154:0/1188524638 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69080afef0 con 0x7f69081566e0 2023-10-10T22:37:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.792+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f690804c3c0 con 0x7f69081566e0 2023-10-10T22:37:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.792+0000 7f68fdffb700 1 -- 172.21.15.154:0/1188524638 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f6900053220 con 0x7f69081566e0 2023-10-10T22:37:25.794 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:25.795 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1468165521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1468165521},{"type":"v1","addr":"172.21.15.179:6834","nonce":1468165521}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1270073932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1270073932},{"type":"v1","addr":"172.21.15.154:6834","nonce":1270073932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2994571754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2994571754},{"type":"v1","addr":"172.21.15.154:6835","nonce":2994571754}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:37:21.762982+0000","modified":"2023-10-10T22:37:25.332647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10182":{"gid":10182,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1275463629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1275463629},{"type":"v1","addr":"172.21.15.179:6835","nonce":1275463629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-10T22:37:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f68ec066f30 msgr2=0x7f68ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f68ec066f30 0x7f68ec0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f69040018d0 tx=0x7f6904009040 comp rx=0 tx=0).stop 2023-10-10T22:37:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69081566e0 msgr2=0x7f69080b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69081566e0 0x7f69080b01d0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f690000b9d0 tx=0x7f690001a000 comp rx=0 tx=0).stop 2023-10-10T22:37:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 shutdown_connections 2023-10-10T22:37:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f68ec066f30 0x7f68ec0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69081566e0 0x7f69080b01d0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080cb900 0x7f690814f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 --2- 172.21.15.154:0/1188524638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6908156310 0x7f690815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 >> 172.21.15.154:0/1188524638 conn(0x7f69080cc1f0 msgr2=0x7f6908151740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 shutdown_connections 2023-10-10T22:37:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.795+0000 7f690ef9d700 1 -- 172.21.15.154:0/1188524638 wait complete. 2023-10-10T22:37:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 94 2023-10-10T22:37:25.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.997+0000 7f18bfbff700 1 Processor -- start 2023-10-10T22:37:25.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.997+0000 7f18bfbff700 1 -- start start 2023-10-10T22:37:26.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.998+0000 7f18bfbff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18b806c0a0 0x7f18b80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.998+0000 7f18bfbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b815d7e0 con 0x7f18b815df50 2023-10-10T22:37:26.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.998+0000 7f18bfbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b815dac0 con 0x7f18b806bcd0 2023-10-10T22:37:26.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.998+0000 7f18bfbff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b815aa30 con 0x7f18b806c0a0 2023-10-10T22:37:26.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.998+0000 7f18bd19a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18b806c0a0 0x7f18b80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.999+0000 7f18bd19a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18b806c0a0 0x7f18b80caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33100/0 (socket says 172.21.15.154:33100) 2023-10-10T22:37:26.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.999+0000 7f18bd19a700 1 -- 172.21.15.154:0/1370489046 learned_addr learned my addr 172.21.15.154:0/1370489046 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.999+0000 7f18be19c700 1 --1- 172.21.15.154:0/1370489046 >> v1:172.21.15.154:6789/0 conn(0x7f18b815df50 0x7f18b80c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41084/0 (socket says 172.21.15.154:41084) 2023-10-10T22:37:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.999+0000 7f18bd19a700 1 -- 172.21.15.154:0/1370489046 >> v1:172.21.15.179:6789/0 conn(0x7f18b806bcd0 legacy=0x7f18b815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.999+0000 7f18bd19a700 1 -- 172.21.15.154:0/1370489046 >> v1:172.21.15.154:6789/0 conn(0x7f18b815df50 legacy=0x7f18b80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.999+0000 7f18bd19a700 1 -- 172.21.15.154:0/1370489046 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b815ad10 con 0x7f18b806c0a0 2023-10-10T22:37:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.999+0000 7f18bc999700 1 -- 172.21.15.154:0/1370489046 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533589099 0 0) 0x7f18b815d7e0 con 0x7f18b815df50 2023-10-10T22:37:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.999+0000 7f18bd19a700 1 --2- 172.21.15.154:0/1370489046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806c0a0 0x7f18b80caa90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f18a80099b0 tx=0x7f18a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b1542f01570fa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:25.999+0000 7f18bc999700 1 -- 172.21.15.154:0/1370489046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800b820 con 0x7f18b806c0a0 2023-10-10T22:37:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.000+0000 7f18bc999700 1 -- 172.21.15.154:0/1370489046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a800b980 con 0x7f18b806c0a0 2023-10-10T22:37:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.000+0000 7f18bc999700 1 -- 172.21.15.154:0/1370489046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800bd40 con 0x7f18b806c0a0 2023-10-10T22:37:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.000+0000 7f18bfbff700 1 -- 172.21.15.154:0/1370489046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806c0a0 msgr2=0x7f18b80caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.000+0000 7f18bfbff700 1 --2- 172.21.15.154:0/1370489046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806c0a0 0x7f18b80caa90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f18a80099b0 tx=0x7f18a8009250 comp rx=0 tx=0).stop 2023-10-10T22:37:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.000+0000 7f18bfbff700 1 -- 172.21.15.154:0/1370489046 shutdown_connections 2023-10-10T22:37:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.000+0000 7f18bfbff700 1 --2- 172.21.15.154:0/1370489046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806c0a0 0x7f18b80caa90 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.000+0000 7f18bfbff700 1 -- 172.21.15.154:0/1370489046 >> 172.21.15.154:0/1370489046 conn(0x7f18b80ce600 msgr2=0x7f18b80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.000+0000 7f18bfbff700 1 -- 172.21.15.154:0/1370489046 shutdown_connections 2023-10-10T22:37:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.000+0000 7f18bfbff700 1 -- 172.21.15.154:0/1370489046 wait complete. 2023-10-10T22:37:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.002+0000 7f18bfbff700 1 Processor -- start 2023-10-10T22:37:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.002+0000 7f18bfbff700 1 -- start start 2023-10-10T22:37:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bfbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806bcd0 0x7f18b8153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bfbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b806c0a0 0x7f18b816a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bfbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b815df50 0x7f18b816a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bfbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b3ca0 con 0x7f18b806bcd0 2023-10-10T22:37:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bfbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8154650 con 0x7f18b806c0a0 2023-10-10T22:37:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bfbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8153a40 con 0x7f18b815df50 2023-10-10T22:37:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bd99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806bcd0 0x7f18b8153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bd99b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806bcd0 0x7f18b8153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33104/0 (socket says 172.21.15.154:33104) 2023-10-10T22:37:26.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bd99b700 1 -- 172.21.15.154:0/1361422557 learned_addr learned my addr 172.21.15.154:0/1361422557 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bd19a700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b806c0a0 0x7f18b816a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18be19c700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b815df50 0x7f18b816a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bd99b700 1 -- 172.21.15.154:0/1361422557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b815df50 msgr2=0x7f18b816a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bd99b700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b815df50 0x7f18b816a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bd99b700 1 -- 172.21.15.154:0/1361422557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b806c0a0 msgr2=0x7f18b816a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bd99b700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b806c0a0 0x7f18b816a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18bd99b700 1 -- 172.21.15.154:0/1361422557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80094f0 con 0x7f18b806bcd0 2023-10-10T22:37:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.003+0000 7f18be19c700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b815df50 0x7f18b816a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.004+0000 7f18bd99b700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806bcd0 0x7f18b8153060 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f18b400b5e0 tx=0x7f18b4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:26.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.004+0000 7f18adffb700 1 -- 172.21.15.154:0/1361422557 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b400f510 con 0x7f18b806bcd0 2023-10-10T22:37:26.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.004+0000 7f18adffb700 1 -- 172.21.15.154:0/1361422557 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b400f670 con 0x7f18b806bcd0 2023-10-10T22:37:26.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.004+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b8153d20 con 0x7f18b806bcd0 2023-10-10T22:37:26.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.004+0000 7f18adffb700 1 -- 172.21.15.154:0/1361422557 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b400fa30 con 0x7f18b806bcd0 2023-10-10T22:37:26.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.004+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b81542e0 con 0x7f18b806bcd0 2023-10-10T22:37:26.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.005+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b804c3c0 con 0x7f18b806bcd0 2023-10-10T22:37:26.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.006+0000 7f18adffb700 1 -- 172.21.15.154:0/1361422557 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18b401a400 con 0x7f18b806bcd0 2023-10-10T22:37:26.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.007+0000 7f18adffb700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f189c066f30 0x7f189c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.007+0000 7f18adffb700 1 -- 172.21.15.154:0/1361422557 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f18b40843b0 con 0x7f18b806bcd0 2023-10-10T22:37:26.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.007+0000 7f18bd19a700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f189c066f30 0x7f189c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.007+0000 7f18bd19a700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f189c066f30 0x7f189c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18a80099b0 tx=0x7f18a8016000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:26.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.011+0000 7f18adffb700 1 -- 172.21.15.154:0/1361422557 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18b40513f0 con 0x7f18b806bcd0 2023-10-10T22:37:26.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.200+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b8154930 con 0x7f18b806bcd0 2023-10-10T22:37:26.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.201+0000 7f18adffb700 1 -- 172.21.15.154:0/1361422557 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+16214 (secure 0 0 0) 0x7f18b4054a10 con 0x7f18b806bcd0 2023-10-10T22:37:26.203 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:26.204 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":209,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:23.319941+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:37:19.912253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-10T22:37:20.749030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f189c066f30 msgr2=0x7f189c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f189c066f30 0x7f189c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18a80099b0 tx=0x7f18a8016000 comp rx=0 tx=0).stop 2023-10-10T22:37:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806bcd0 msgr2=0x7f18b8153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806bcd0 0x7f18b8153060 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f18b400b5e0 tx=0x7f18b4009120 comp rx=0 tx=0).stop 2023-10-10T22:37:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 shutdown_connections 2023-10-10T22:37:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f189c066f30 0x7f189c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b815df50 0x7f18b816a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18b806bcd0 0x7f18b8153060 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 --2- 172.21.15.154:0/1361422557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b806c0a0 0x7f18b816a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 >> 172.21.15.154:0/1361422557 conn(0x7f18b80ce600 msgr2=0x7f18b8155e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 shutdown_connections 2023-10-10T22:37:26.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.203+0000 7f18bfbff700 1 -- 172.21.15.154:0/1361422557 wait complete. 2023-10-10T22:37:26.224 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-10T22:37:26.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:37:26.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.406+0000 7f90c61ff700 1 Processor -- start 2023-10-10T22:37:26.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.406+0000 7f90c61ff700 1 -- start start 2023-10-10T22:37:26.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.407+0000 7f90c61ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 0x7f90c00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.407+0000 7f90c61ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90c00ccf90 0x7f90c00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.407+0000 7f90c61ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c00cc300 con 0x7f90c015a270 2023-10-10T22:37:26.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.407+0000 7f90c61ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c0156bf0 con 0x7f90c00ccf90 2023-10-10T22:37:26.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.407+0000 7f90c61ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00ae950 con 0x7f90c00cbf30 2023-10-10T22:37:26.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.407+0000 7f90b7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90c00ccf90 0x7f90c00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90b7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90c00ccf90 0x7f90c00b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33118/0 (socket says 172.21.15.154:33118) 2023-10-10T22:37:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90b7fff700 1 -- 172.21.15.154:0/3437508505 learned_addr learned my addr 172.21.15.154:0/3437508505 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90bffff700 1 --1- 172.21.15.154:0/3437508505 >> v1:172.21.15.154:6789/0 conn(0x7f90c015a270 0x7f90c00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41098/0 (socket says 172.21.15.154:41098) 2023-10-10T22:37:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90bf7fe700 1 --2- 172.21.15.154:0/3437508505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 0x7f90c00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90b7fff700 1 -- 172.21.15.154:0/3437508505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 msgr2=0x7f90c00ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:26.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90b7fff700 1 --2- 172.21.15.154:0/3437508505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 0x7f90c00ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90b7fff700 1 -- 172.21.15.154:0/3437508505 >> v1:172.21.15.154:6789/0 conn(0x7f90c015a270 legacy=0x7f90c00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90b7fff700 1 -- 172.21.15.154:0/3437508505 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00ad370 con 0x7f90c00ccf90 2023-10-10T22:37:26.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90beffd700 1 -- 172.21.15.154:0/3437508505 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589826262 0 0) 0x7f90c00cc300 con 0x7f90c015a270 2023-10-10T22:37:26.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.408+0000 7f90b7fff700 1 --2- 172.21.15.154:0/3437508505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c00ccf90 0x7f90c00b0d10 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f90a80099e0 tx=0x7f90a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd0e0dc81723579 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90beffd700 1 -- 172.21.15.154:0/3437508505 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a800b820 con 0x7f90c00ccf90 2023-10-10T22:37:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90beffd700 1 -- 172.21.15.154:0/3437508505 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a800b980 con 0x7f90c00ccf90 2023-10-10T22:37:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90beffd700 1 -- 172.21.15.154:0/3437508505 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a800bd20 con 0x7f90c00ccf90 2023-10-10T22:37:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90c61ff700 1 -- 172.21.15.154:0/3437508505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c00ccf90 msgr2=0x7f90c00b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90c61ff700 1 --2- 172.21.15.154:0/3437508505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c00ccf90 0x7f90c00b0d10 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f90a80099e0 tx=0x7f90a8009250 comp rx=0 tx=0).stop 2023-10-10T22:37:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90c61ff700 1 -- 172.21.15.154:0/3437508505 shutdown_connections 2023-10-10T22:37:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90c61ff700 1 --2- 172.21.15.154:0/3437508505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 0x7f90c00ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90c61ff700 1 --2- 172.21.15.154:0/3437508505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c00ccf90 0x7f90c00b0d10 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90c61ff700 1 -- 172.21.15.154:0/3437508505 >> 172.21.15.154:0/3437508505 conn(0x7f90c006a320 msgr2=0x7f90c00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90c61ff700 1 -- 172.21.15.154:0/3437508505 shutdown_connections 2023-10-10T22:37:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.409+0000 7f90c61ff700 1 -- 172.21.15.154:0/3437508505 wait complete. 2023-10-10T22:37:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.411+0000 7f90c61ff700 1 Processor -- start 2023-10-10T22:37:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.411+0000 7f90c61ff700 1 -- start start 2023-10-10T22:37:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90c61ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 0x7f90c0154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90c61ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c00ccf90 0x7f90c0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90c61ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c015a270 0x7f90c01596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90c61ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c01579e0 con 0x7f90c015a270 2023-10-10T22:37:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90c61ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00a6510 con 0x7f90c00ccf90 2023-10-10T22:37:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90c61ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c0156dd0 con 0x7f90c00cbf30 2023-10-10T22:37:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90bffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c015a270 0x7f90c01596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90bffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c015a270 0x7f90c01596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33128/0 (socket says 172.21.15.154:33128) 2023-10-10T22:37:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90bffff700 1 -- 172.21.15.154:0/2581009107 learned_addr learned my addr 172.21.15.154:0/2581009107 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90b7fff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c00ccf90 0x7f90c0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90bf7fe700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 0x7f90c0154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90bffff700 1 -- 172.21.15.154:0/2581009107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 msgr2=0x7f90c0154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90bffff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 0x7f90c0154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90bffff700 1 -- 172.21.15.154:0/2581009107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c00ccf90 msgr2=0x7f90c0157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90bffff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c00ccf90 0x7f90c0157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.412+0000 7f90bffff700 1 -- 172.21.15.154:0/2581009107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80094f0 con 0x7f90c015a270 2023-10-10T22:37:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.413+0000 7f90bffff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c015a270 0x7f90c01596f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f90b800ccc0 tx=0x7f90b8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.413+0000 7f90b77fe700 1 -- 172.21.15.154:0/2581009107 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8005df0 con 0x7f90c015a270 2023-10-10T22:37:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.413+0000 7f90b77fe700 1 -- 172.21.15.154:0/2581009107 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b800a600 con 0x7f90c015a270 2023-10-10T22:37:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.413+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c01570b0 con 0x7f90c015a270 2023-10-10T22:37:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.413+0000 7f90b77fe700 1 -- 172.21.15.154:0/2581009107 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800a9c0 con 0x7f90c015a270 2023-10-10T22:37:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.413+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c0157670 con 0x7f90c015a270 2023-10-10T22:37:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.414+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c01569a0 con 0x7f90c015a270 2023-10-10T22:37:26.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.415+0000 7f90b77fe700 1 -- 172.21.15.154:0/2581009107 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90b80070f0 con 0x7f90c015a270 2023-10-10T22:37:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.416+0000 7f90b77fe700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f90a0066f30 0x7f90a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.416+0000 7f90b77fe700 1 -- 172.21.15.154:0/2581009107 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f90b8084810 con 0x7f90c015a270 2023-10-10T22:37:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.416+0000 7f90bf7fe700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f90a0066f30 0x7f90a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.416+0000 7f90bf7fe700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f90a0066f30 0x7f90a00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009db0 tx=0x7f90b00091a0 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.420+0000 7f90b77fe700 1 -- 172.21.15.154:0/2581009107 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90b8051900 con 0x7f90c015a270 2023-10-10T22:37:26.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.608+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90c004c3c0 con 0x7f90a0066f30 2023-10-10T22:37:26.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.619+0000 7f90b77fe700 1 -- 172.21.15.154:0/2581009107 <== mgr.9999 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288056 (secure 0 0 0) 0x7f90c004c3c0 con 0x7f90a0066f30 2023-10-10T22:37:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:26.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f90a0066f30 msgr2=0x7f90a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f90a0066f30 0x7f90a00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009db0 tx=0x7f90b00091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c015a270 msgr2=0x7f90c01596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c015a270 0x7f90c01596f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f90b800ccc0 tx=0x7f90b8001a70 comp rx=0 tx=0).stop 2023-10-10T22:37:26.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 shutdown_connections 2023-10-10T22:37:26.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f90a0066f30 0x7f90a00693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90c015a270 0x7f90c01596f0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c00cbf30 0x7f90c0154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 --2- 172.21.15.154:0/2581009107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c00ccf90 0x7f90c0157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 >> 172.21.15.154:0/2581009107 conn(0x7f90c006a320 msgr2=0x7f90c0156160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.623+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 shutdown_connections 2023-10-10T22:37:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.624+0000 7f90c61ff700 1 -- 172.21.15.154:0/2581009107 wait complete. 2023-10-10T22:37:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:37:26.644 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:37:25.898457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":620,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":384,"ondisk_log_size":384,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461336,"kb_used_data":21592,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752513384,"statfs":{"total":773094113280,"available":770573705216,"internally_reserved":0,"allocated":22110208,"data_stored":11679773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.612642"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343085+0000","last_change":"2023-10-10T22:37:22.336242+0000","last_active":"2023-10-10T22:37:22.343085+0000","last_peered":"2023-10-10T22:37:22.343085+0000","last_clean":"2023-10-10T22:37:22.343085+0000","last_became_active":"2023-10-10T22:37:22.335965+0000","last_became_peered":"2023-10-10T22:37:22.335965+0000","last_unstale":"2023-10-10T22:37:22.343085+0000","last_undegraded":"2023-10-10T22:37:22.343085+0000","last_fullsized":"2023-10-10T22:37:22.343085+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:32:15.779372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330213+0000","last_change":"2023-10-10T22:37:22.323947+0000","last_active":"2023-10-10T22:37:22.330213+0000","last_peered":"2023-10-10T22:37:22.330213+0000","last_clean":"2023-10-10T22:37:22.330213+0000","last_became_active":"2023-10-10T22:37:22.323685+0000","last_became_peered":"2023-10-10T22:37:22.323685+0000","last_unstale":"2023-10-10T22:37:22.330213+0000","last_undegraded":"2023-10-10T22:37:22.330213+0000","last_fullsized":"2023-10-10T22:37:22.330213+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:54:16.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331732+0000","last_change":"2023-10-10T22:37:22.329074+0000","last_active":"2023-10-10T22:37:22.331732+0000","last_peered":"2023-10-10T22:37:22.331732+0000","last_clean":"2023-10-10T22:37:22.331732+0000","last_became_active":"2023-10-10T22:37:22.328756+0000","last_became_peered":"2023-10-10T22:37:22.328756+0000","last_unstale":"2023-10-10T22:37:22.331732+0000","last_undegraded":"2023-10-10T22:37:22.331732+0000","last_fullsized":"2023-10-10T22:37:22.331732+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:55:55.816244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345969+0000","last_change":"2023-10-10T22:37:22.341498+0000","last_active":"2023-10-10T22:37:22.345969+0000","last_peered":"2023-10-10T22:37:22.345969+0000","last_clean":"2023-10-10T22:37:22.345969+0000","last_became_active":"2023-10-10T22:37:22.341255+0000","last_became_peered":"2023-10-10T22:37:22.341255+0000","last_unstale":"2023-10-10T22:37:22.345969+0000","last_undegraded":"2023-10-10T22:37:22.345969+0000","last_fullsized":"2023-10-10T22:37:22.345969+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:32:00.612130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338966+0000","last_change":"2023-10-10T22:37:22.328393+0000","last_active":"2023-10-10T22:37:22.338966+0000","last_peered":"2023-10-10T22:37:22.338966+0000","last_clean":"2023-10-10T22:37:22.338966+0000","last_became_active":"2023-10-10T22:37:22.328101+0000","last_became_peered":"2023-10-10T22:37:22.328101+0000","last_unstale":"2023-10-10T22:37:22.338966+0000","last_undegraded":"2023-10-10T22:37:22.338966+0000","last_fullsized":"2023-10-10T22:37:22.338966+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:35:42.499747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336008+0000","last_change":"2023-10-10T22:37:22.331181+0000","last_active":"2023-10-10T22:37:22.336008+0000","last_peered":"2023-10-10T22:37:22.336008+0000","last_clean":"2023-10-10T22:37:22.336008+0000","last_became_active":"2023-10-10T22:37:22.330824+0000","last_became_peered":"2023-10-10T22:37:22.330824+0000","last_unstale":"2023-10-10T22:37:22.336008+0000","last_undegraded":"2023-10-10T22:37:22.336008+0000","last_fullsized":"2023-10-10T22:37:22.336008+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:29.396879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338211+0000","last_change":"2023-10-10T22:37:22.331320+0000","last_active":"2023-10-10T22:37:22.338211+0000","last_peered":"2023-10-10T22:37:22.338211+0000","last_clean":"2023-10-10T22:37:22.338211+0000","last_became_active":"2023-10-10T22:37:22.331052+0000","last_became_peered":"2023-10-10T22:37:22.331052+0000","last_unstale":"2023-10-10T22:37:22.338211+0000","last_undegraded":"2023-10-10T22:37:22.338211+0000","last_fullsized":"2023-10-10T22:37:22.338211+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325713+0000","last_change":"2023-10-10T22:37:22.325204+0000","last_active":"2023-10-10T22:37:22.325713+0000","last_peered":"2023-10-10T22:37:22.325713+0000","last_clean":"2023-10-10T22:37:22.325713+0000","last_became_active":"2023-10-10T22:37:22.321688+0000","last_became_peered":"2023-10-10T22:37:22.321688+0000","last_unstale":"2023-10-10T22:37:22.325713+0000","last_undegraded":"2023-10-10T22:37:22.325713+0000","last_fullsized":"2023-10-10T22:37:22.325713+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344561+0000","last_change":"2023-10-10T22:37:22.342230+0000","last_active":"2023-10-10T22:37:22.344561+0000","last_peered":"2023-10-10T22:37:22.344561+0000","last_clean":"2023-10-10T22:37:22.344561+0000","last_became_active":"2023-10-10T22:37:22.341026+0000","last_became_peered":"2023-10-10T22:37:22.341026+0000","last_unstale":"2023-10-10T22:37:22.344561+0000","last_undegraded":"2023-10-10T22:37:22.344561+0000","last_fullsized":"2023-10-10T22:37:22.344561+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:10.388326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343351+0000","last_change":"2023-10-10T22:37:22.331950+0000","last_active":"2023-10-10T22:37:22.343351+0000","last_peered":"2023-10-10T22:37:22.343351+0000","last_clean":"2023-10-10T22:37:22.343351+0000","last_became_active":"2023-10-10T22:37:22.327964+0000","last_became_peered":"2023-10-10T22:37:22.327964+0000","last_unstale":"2023-10-10T22:37:22.343351+0000","last_undegraded":"2023-10-10T22:37:22.343351+0000","last_fullsized":"2023-10-10T22:37:22.343351+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:29.862257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343867+0000","last_change":"2023-10-10T22:37:22.341039+0000","last_active":"2023-10-10T22:37:22.343867+0000","last_peered":"2023-10-10T22:37:22.343867+0000","last_clean":"2023-10-10T22:37:22.343867+0000","last_became_active":"2023-10-10T22:37:22.340752+0000","last_became_peered":"2023-10-10T22:37:22.340752+0000","last_unstale":"2023-10-10T22:37:22.343867+0000","last_undegraded":"2023-10-10T22:37:22.343867+0000","last_fullsized":"2023-10-10T22:37:22.343867+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:31:20.851558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332530+0000","last_change":"2023-10-10T22:37:22.330693+0000","last_active":"2023-10-10T22:37:22.332530+0000","last_peered":"2023-10-10T22:37:22.332530+0000","last_clean":"2023-10-10T22:37:22.332530+0000","last_became_active":"2023-10-10T22:37:22.330422+0000","last_became_peered":"2023-10-10T22:37:22.330422+0000","last_unstale":"2023-10-10T22:37:22.332530+0000","last_undegraded":"2023-10-10T22:37:22.332530+0000","last_fullsized":"2023-10-10T22:37:22.332530+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:15.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347291+0000","last_change":"2023-10-10T22:37:22.344903+0000","last_active":"2023-10-10T22:37:22.347291+0000","last_peered":"2023-10-10T22:37:22.347291+0000","last_clean":"2023-10-10T22:37:22.347291+0000","last_became_active":"2023-10-10T22:37:22.344568+0000","last_became_peered":"2023-10-10T22:37:22.344568+0000","last_unstale":"2023-10-10T22:37:22.347291+0000","last_undegraded":"2023-10-10T22:37:22.347291+0000","last_fullsized":"2023-10-10T22:37:22.347291+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:29:17.224764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331152+0000","last_change":"2023-10-10T22:37:22.327814+0000","last_active":"2023-10-10T22:37:22.331152+0000","last_peered":"2023-10-10T22:37:22.331152+0000","last_clean":"2023-10-10T22:37:22.331152+0000","last_became_active":"2023-10-10T22:37:22.327483+0000","last_became_peered":"2023-10-10T22:37:22.327483+0000","last_unstale":"2023-10-10T22:37:22.331152+0000","last_undegraded":"2023-10-10T22:37:22.331152+0000","last_fullsized":"2023-10-10T22:37:22.331152+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335425+0000","last_change":"2023-10-10T22:37:22.331782+0000","last_active":"2023-10-10T22:37:22.335425+0000","last_peered":"2023-10-10T22:37:22.335425+0000","last_clean":"2023-10-10T22:37:22.335425+0000","last_became_active":"2023-10-10T22:37:22.331529+0000","last_became_peered":"2023-10-10T22:37:22.331529+0000","last_unstale":"2023-10-10T22:37:22.335425+0000","last_undegraded":"2023-10-10T22:37:22.335425+0000","last_fullsized":"2023-10-10T22:37:22.335425+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:51.371588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330940+0000","last_change":"2023-10-10T22:37:22.327219+0000","last_active":"2023-10-10T22:37:22.330940+0000","last_peered":"2023-10-10T22:37:22.330940+0000","last_clean":"2023-10-10T22:37:22.330940+0000","last_became_active":"2023-10-10T22:37:22.326966+0000","last_became_peered":"2023-10-10T22:37:22.326966+0000","last_unstale":"2023-10-10T22:37:22.330940+0000","last_undegraded":"2023-10-10T22:37:22.330940+0000","last_fullsized":"2023-10-10T22:37:22.330940+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:43:29.646719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331376+0000","last_change":"2023-10-10T22:37:22.327933+0000","last_active":"2023-10-10T22:37:22.331376+0000","last_peered":"2023-10-10T22:37:22.331376+0000","last_clean":"2023-10-10T22:37:22.331376+0000","last_became_active":"2023-10-10T22:37:22.327538+0000","last_became_peered":"2023-10-10T22:37:22.327538+0000","last_unstale":"2023-10-10T22:37:22.331376+0000","last_undegraded":"2023-10-10T22:37:22.331376+0000","last_fullsized":"2023-10-10T22:37:22.331376+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:17.366872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329720+0000","last_change":"2023-10-10T22:37:22.328638+0000","last_active":"2023-10-10T22:37:22.329720+0000","last_peered":"2023-10-10T22:37:22.329720+0000","last_clean":"2023-10-10T22:37:22.329720+0000","last_became_active":"2023-10-10T22:37:22.328375+0000","last_became_peered":"2023-10-10T22:37:22.328375+0000","last_unstale":"2023-10-10T22:37:22.329720+0000","last_undegraded":"2023-10-10T22:37:22.329720+0000","last_fullsized":"2023-10-10T22:37:22.329720+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:56.447417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336027+0000","last_change":"2023-10-10T22:37:22.332011+0000","last_active":"2023-10-10T22:37:22.336027+0000","last_peered":"2023-10-10T22:37:22.336027+0000","last_clean":"2023-10-10T22:37:22.336027+0000","last_became_active":"2023-10-10T22:37:22.331741+0000","last_became_peered":"2023-10-10T22:37:22.331741+0000","last_unstale":"2023-10-10T22:37:22.336027+0000","last_undegraded":"2023-10-10T22:37:22.336027+0000","last_fullsized":"2023-10-10T22:37:22.336027+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:27.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338828+0000","last_change":"2023-10-10T22:37:22.333229+0000","last_active":"2023-10-10T22:37:22.338828+0000","last_peered":"2023-10-10T22:37:22.338828+0000","last_clean":"2023-10-10T22:37:22.338828+0000","last_became_active":"2023-10-10T22:37:22.332677+0000","last_became_peered":"2023-10-10T22:37:22.332677+0000","last_unstale":"2023-10-10T22:37:22.338828+0000","last_undegraded":"2023-10-10T22:37:22.338828+0000","last_fullsized":"2023-10-10T22:37:22.338828+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:43:41.226417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345995+0000","last_change":"2023-10-10T22:37:22.342096+0000","last_active":"2023-10-10T22:37:22.345995+0000","last_peered":"2023-10-10T22:37:22.345995+0000","last_clean":"2023-10-10T22:37:22.345995+0000","last_became_active":"2023-10-10T22:37:22.341851+0000","last_became_peered":"2023-10-10T22:37:22.341851+0000","last_unstale":"2023-10-10T22:37:22.345995+0000","last_undegraded":"2023-10-10T22:37:22.345995+0000","last_fullsized":"2023-10-10T22:37:22.345995+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:28:15.665680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332513+0000","last_change":"2023-10-10T22:37:22.329649+0000","last_active":"2023-10-10T22:37:22.332513+0000","last_peered":"2023-10-10T22:37:22.332513+0000","last_clean":"2023-10-10T22:37:22.332513+0000","last_became_active":"2023-10-10T22:37:22.329396+0000","last_became_peered":"2023-10-10T22:37:22.329396+0000","last_unstale":"2023-10-10T22:37:22.332513+0000","last_undegraded":"2023-10-10T22:37:22.332513+0000","last_fullsized":"2023-10-10T22:37:22.332513+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:13:12.738082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343386+0000","last_change":"2023-10-10T22:37:22.336423+0000","last_active":"2023-10-10T22:37:22.343386+0000","last_peered":"2023-10-10T22:37:22.343386+0000","last_clean":"2023-10-10T22:37:22.343386+0000","last_became_active":"2023-10-10T22:37:22.336115+0000","last_became_peered":"2023-10-10T22:37:22.336115+0000","last_unstale":"2023-10-10T22:37:22.343386+0000","last_undegraded":"2023-10-10T22:37:22.343386+0000","last_fullsized":"2023-10-10T22:37:22.343386+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329138+0000","last_change":"2023-10-10T22:37:22.326865+0000","last_active":"2023-10-10T22:37:22.329138+0000","last_peered":"2023-10-10T22:37:22.329138+0000","last_clean":"2023-10-10T22:37:22.329138+0000","last_became_active":"2023-10-10T22:37:22.326560+0000","last_became_peered":"2023-10-10T22:37:22.326560+0000","last_unstale":"2023-10-10T22:37:22.329138+0000","last_undegraded":"2023-10-10T22:37:22.329138+0000","last_fullsized":"2023-10-10T22:37:22.329138+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:16.097777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332570+0000","last_change":"2023-10-10T22:37:22.331211+0000","last_active":"2023-10-10T22:37:22.332570+0000","last_peered":"2023-10-10T22:37:22.332570+0000","last_clean":"2023-10-10T22:37:22.332570+0000","last_became_active":"2023-10-10T22:37:22.330969+0000","last_became_peered":"2023-10-10T22:37:22.330969+0000","last_unstale":"2023-10-10T22:37:22.332570+0000","last_undegraded":"2023-10-10T22:37:22.332570+0000","last_fullsized":"2023-10-10T22:37:22.332570+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:13.075740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343255+0000","last_change":"2023-10-10T22:37:22.340035+0000","last_active":"2023-10-10T22:37:22.343255+0000","last_peered":"2023-10-10T22:37:22.343255+0000","last_clean":"2023-10-10T22:37:22.343255+0000","last_became_active":"2023-10-10T22:37:22.339704+0000","last_became_peered":"2023-10-10T22:37:22.339704+0000","last_unstale":"2023-10-10T22:37:22.343255+0000","last_undegraded":"2023-10-10T22:37:22.343255+0000","last_fullsized":"2023-10-10T22:37:22.343255+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:57.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"208'4","reported_seq":14,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345983+0000","last_change":"2023-10-10T22:37:21.300780+0000","last_active":"2023-10-10T22:37:22.345983+0000","last_peered":"2023-10-10T22:37:22.345983+0000","last_clean":"2023-10-10T22:37:22.345983+0000","last_became_active":"2023-10-10T22:37:21.300530+0000","last_became_peered":"2023-10-10T22:37:21.300530+0000","last_unstale":"2023-10-10T22:37:22.345983+0000","last_undegraded":"2023-10-10T22:37:22.345983+0000","last_fullsized":"2023-10-10T22:37:22.345983+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:17.662491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325583+0000","last_change":"2023-10-10T22:37:22.324305+0000","last_active":"2023-10-10T22:37:22.325583+0000","last_peered":"2023-10-10T22:37:22.325583+0000","last_clean":"2023-10-10T22:37:22.325583+0000","last_became_active":"2023-10-10T22:37:22.324056+0000","last_became_peered":"2023-10-10T22:37:22.324056+0000","last_unstale":"2023-10-10T22:37:22.325583+0000","last_undegraded":"2023-10-10T22:37:22.325583+0000","last_fullsized":"2023-10-10T22:37:22.325583+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347552+0000","last_change":"2023-10-10T22:37:21.308912+0000","last_active":"2023-10-10T22:37:22.347552+0000","last_peered":"2023-10-10T22:37:22.347552+0000","last_clean":"2023-10-10T22:37:22.347552+0000","last_became_active":"2023-10-10T22:37:21.308582+0000","last_became_peered":"2023-10-10T22:37:21.308582+0000","last_unstale":"2023-10-10T22:37:22.347552+0000","last_undegraded":"2023-10-10T22:37:22.347552+0000","last_fullsized":"2023-10-10T22:37:22.347552+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:09.380526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338697+0000","last_change":"2023-10-10T22:37:22.332552+0000","last_active":"2023-10-10T22:37:22.338697+0000","last_peered":"2023-10-10T22:37:22.338697+0000","last_clean":"2023-10-10T22:37:22.338697+0000","last_became_active":"2023-10-10T22:37:22.332000+0000","last_became_peered":"2023-10-10T22:37:22.332000+0000","last_unstale":"2023-10-10T22:37:22.338697+0000","last_undegraded":"2023-10-10T22:37:22.338697+0000","last_fullsized":"2023-10-10T22:37:22.338697+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:45.352813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344219+0000","last_change":"2023-10-10T22:37:21.310535+0000","last_active":"2023-10-10T22:37:22.344219+0000","last_peered":"2023-10-10T22:37:22.344219+0000","last_clean":"2023-10-10T22:37:22.344219+0000","last_became_active":"2023-10-10T22:37:21.310298+0000","last_became_peered":"2023-10-10T22:37:21.310298+0000","last_unstale":"2023-10-10T22:37:22.344219+0000","last_undegraded":"2023-10-10T22:37:22.344219+0000","last_fullsized":"2023-10-10T22:37:22.344219+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:45.311116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338523+0000","last_change":"2023-10-10T22:37:22.330595+0000","last_active":"2023-10-10T22:37:22.338523+0000","last_peered":"2023-10-10T22:37:22.338523+0000","last_clean":"2023-10-10T22:37:22.338523+0000","last_became_active":"2023-10-10T22:37:22.330019+0000","last_became_peered":"2023-10-10T22:37:22.330019+0000","last_unstale":"2023-10-10T22:37:22.338523+0000","last_undegraded":"2023-10-10T22:37:22.338523+0000","last_fullsized":"2023-10-10T22:37:22.338523+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:37:20.275583+0000","last_change":"2023-10-10T22:37:20.290717+0000","last_active":"2023-10-10T22:37:20.275583+0000","last_peered":"2023-10-10T22:37:20.275583+0000","last_clean":"2023-10-10T22:37:20.275583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:20.275583+0000","last_undegraded":"2023-10-10T22:37:20.275583+0000","last_fullsized":"2023-10-10T22:37:20.275583+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:59.336943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.328680+0000","last_change":"2023-10-10T22:37:22.327712+0000","last_active":"2023-10-10T22:37:22.328680+0000","last_peered":"2023-10-10T22:37:22.328680+0000","last_clean":"2023-10-10T22:37:22.328680+0000","last_became_active":"2023-10-10T22:37:22.327084+0000","last_became_peered":"2023-10-10T22:37:22.327084+0000","last_unstale":"2023-10-10T22:37:22.328680+0000","last_undegraded":"2023-10-10T22:37:22.328680+0000","last_fullsized":"2023-10-10T22:37:22.328680+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:48:53.679083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344271+0000","last_change":"2023-10-10T22:37:21.306550+0000","last_active":"2023-10-10T22:37:22.344271+0000","last_peered":"2023-10-10T22:37:22.344271+0000","last_clean":"2023-10-10T22:37:22.344271+0000","last_became_active":"2023-10-10T22:37:21.306315+0000","last_became_peered":"2023-10-10T22:37:21.306315+0000","last_unstale":"2023-10-10T22:37:22.344271+0000","last_undegraded":"2023-10-10T22:37:22.344271+0000","last_fullsized":"2023-10-10T22:37:22.344271+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:41.427780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343229+0000","last_change":"2023-10-10T22:37:22.339383+0000","last_active":"2023-10-10T22:37:22.343229+0000","last_peered":"2023-10-10T22:37:22.343229+0000","last_clean":"2023-10-10T22:37:22.343229+0000","last_became_active":"2023-10-10T22:37:22.339121+0000","last_became_peered":"2023-10-10T22:37:22.339121+0000","last_unstale":"2023-10-10T22:37:22.343229+0000","last_undegraded":"2023-10-10T22:37:22.343229+0000","last_fullsized":"2023-10-10T22:37:22.343229+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:23.304666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346268+0000","last_change":"2023-10-10T22:37:21.311535+0000","last_active":"2023-10-10T22:37:22.346268+0000","last_peered":"2023-10-10T22:37:22.346268+0000","last_clean":"2023-10-10T22:37:22.346268+0000","last_became_active":"2023-10-10T22:37:21.311272+0000","last_became_peered":"2023-10-10T22:37:21.311272+0000","last_unstale":"2023-10-10T22:37:22.346268+0000","last_undegraded":"2023-10-10T22:37:22.346268+0000","last_fullsized":"2023-10-10T22:37:22.346268+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:56.463951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343480+0000","last_change":"2023-10-10T22:37:22.340669+0000","last_active":"2023-10-10T22:37:22.343480+0000","last_peered":"2023-10-10T22:37:22.343480+0000","last_clean":"2023-10-10T22:37:22.343480+0000","last_became_active":"2023-10-10T22:37:22.340417+0000","last_became_peered":"2023-10-10T22:37:22.340417+0000","last_unstale":"2023-10-10T22:37:22.343480+0000","last_undegraded":"2023-10-10T22:37:22.343480+0000","last_fullsized":"2023-10-10T22:37:22.343480+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:13.429335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323936+0000","last_change":"2023-10-10T22:37:21.311884+0000","last_active":"2023-10-10T22:37:22.323936+0000","last_peered":"2023-10-10T22:37:22.323936+0000","last_clean":"2023-10-10T22:37:22.323936+0000","last_became_active":"2023-10-10T22:37:21.311253+0000","last_became_peered":"2023-10-10T22:37:21.311253+0000","last_unstale":"2023-10-10T22:37:22.323936+0000","last_undegraded":"2023-10-10T22:37:22.323936+0000","last_fullsized":"2023-10-10T22:37:22.323936+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:32.308434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329066+0000","last_change":"2023-10-10T22:37:22.327563+0000","last_active":"2023-10-10T22:37:22.329066+0000","last_peered":"2023-10-10T22:37:22.329066+0000","last_clean":"2023-10-10T22:37:22.329066+0000","last_became_active":"2023-10-10T22:37:22.327285+0000","last_became_peered":"2023-10-10T22:37:22.327285+0000","last_unstale":"2023-10-10T22:37:22.329066+0000","last_undegraded":"2023-10-10T22:37:22.329066+0000","last_fullsized":"2023-10-10T22:37:22.329066+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:10.265065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322635+0000","last_change":"2023-10-10T22:37:21.304131+0000","last_active":"2023-10-10T22:37:22.322635+0000","last_peered":"2023-10-10T22:37:22.322635+0000","last_clean":"2023-10-10T22:37:22.322635+0000","last_became_active":"2023-10-10T22:37:21.303862+0000","last_became_peered":"2023-10-10T22:37:21.303862+0000","last_unstale":"2023-10-10T22:37:22.322635+0000","last_undegraded":"2023-10-10T22:37:22.322635+0000","last_fullsized":"2023-10-10T22:37:22.322635+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:11.264533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.334236+0000","last_change":"2023-10-10T22:37:22.326514+0000","last_active":"2023-10-10T22:37:22.334236+0000","last_peered":"2023-10-10T22:37:22.334236+0000","last_clean":"2023-10-10T22:37:22.334236+0000","last_became_active":"2023-10-10T22:37:22.326241+0000","last_became_peered":"2023-10-10T22:37:22.326241+0000","last_unstale":"2023-10-10T22:37:22.334236+0000","last_undegraded":"2023-10-10T22:37:22.334236+0000","last_fullsized":"2023-10-10T22:37:22.334236+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.317579+0000","last_change":"2023-10-10T22:37:21.307712+0000","last_active":"2023-10-10T22:37:22.317579+0000","last_peered":"2023-10-10T22:37:22.317579+0000","last_clean":"2023-10-10T22:37:22.317579+0000","last_became_active":"2023-10-10T22:37:21.307419+0000","last_became_peered":"2023-10-10T22:37:21.307419+0000","last_unstale":"2023-10-10T22:37:22.317579+0000","last_undegraded":"2023-10-10T22:37:22.317579+0000","last_fullsized":"2023-10-10T22:37:22.317579+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:09:38.945874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332403+0000","last_change":"2023-10-10T22:37:22.327109+0000","last_active":"2023-10-10T22:37:22.332403+0000","last_peered":"2023-10-10T22:37:22.332403+0000","last_clean":"2023-10-10T22:37:22.332403+0000","last_became_active":"2023-10-10T22:37:22.326801+0000","last_became_peered":"2023-10-10T22:37:22.326801+0000","last_unstale":"2023-10-10T22:37:22.332403+0000","last_undegraded":"2023-10-10T22:37:22.332403+0000","last_fullsized":"2023-10-10T22:37:22.332403+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:38.738632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"208'3","reported_seq":13,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344456+0000","last_change":"2023-10-10T22:37:21.304909+0000","last_active":"2023-10-10T22:37:22.344456+0000","last_peered":"2023-10-10T22:37:22.344456+0000","last_clean":"2023-10-10T22:37:22.344456+0000","last_became_active":"2023-10-10T22:37:21.304642+0000","last_became_peered":"2023-10-10T22:37:21.304642+0000","last_unstale":"2023-10-10T22:37:22.344456+0000","last_undegraded":"2023-10-10T22:37:22.344456+0000","last_fullsized":"2023-10-10T22:37:22.344456+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:28:25.674622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341955+0000","last_change":"2023-10-10T22:37:22.332831+0000","last_active":"2023-10-10T22:37:22.341955+0000","last_peered":"2023-10-10T22:37:22.341955+0000","last_clean":"2023-10-10T22:37:22.341955+0000","last_became_active":"2023-10-10T22:37:22.332577+0000","last_became_peered":"2023-10-10T22:37:22.332577+0000","last_unstale":"2023-10-10T22:37:22.341955+0000","last_undegraded":"2023-10-10T22:37:22.341955+0000","last_fullsized":"2023-10-10T22:37:22.341955+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:49.337687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"208'6","reported_seq":16,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348666+0000","last_change":"2023-10-10T22:37:21.302443+0000","last_active":"2023-10-10T22:37:22.348666+0000","last_peered":"2023-10-10T22:37:22.348666+0000","last_clean":"2023-10-10T22:37:22.348666+0000","last_became_active":"2023-10-10T22:37:21.302148+0000","last_became_peered":"2023-10-10T22:37:21.302148+0000","last_unstale":"2023-10-10T22:37:22.348666+0000","last_undegraded":"2023-10-10T22:37:22.348666+0000","last_fullsized":"2023-10-10T22:37:22.348666+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:52:34.012755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329179+0000","last_change":"2023-10-10T22:37:22.327958+0000","last_active":"2023-10-10T22:37:22.329179+0000","last_peered":"2023-10-10T22:37:22.329179+0000","last_clean":"2023-10-10T22:37:22.329179+0000","last_became_active":"2023-10-10T22:37:22.327720+0000","last_became_peered":"2023-10-10T22:37:22.327720+0000","last_unstale":"2023-10-10T22:37:22.329179+0000","last_undegraded":"2023-10-10T22:37:22.329179+0000","last_fullsized":"2023-10-10T22:37:22.329179+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:12.272333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351731+0000","last_change":"2023-10-10T22:37:21.311578+0000","last_active":"2023-10-10T22:37:22.351731+0000","last_peered":"2023-10-10T22:37:22.351731+0000","last_clean":"2023-10-10T22:37:22.351731+0000","last_became_active":"2023-10-10T22:37:21.311276+0000","last_became_peered":"2023-10-10T22:37:21.311276+0000","last_unstale":"2023-10-10T22:37:22.351731+0000","last_undegraded":"2023-10-10T22:37:22.351731+0000","last_fullsized":"2023-10-10T22:37:22.351731+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:10:25.362844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332363+0000","last_change":"2023-10-10T22:37:22.327787+0000","last_active":"2023-10-10T22:37:22.332363+0000","last_peered":"2023-10-10T22:37:22.332363+0000","last_clean":"2023-10-10T22:37:22.332363+0000","last_became_active":"2023-10-10T22:37:22.327459+0000","last_became_peered":"2023-10-10T22:37:22.327459+0000","last_unstale":"2023-10-10T22:37:22.332363+0000","last_undegraded":"2023-10-10T22:37:22.332363+0000","last_fullsized":"2023-10-10T22:37:22.332363+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313273+0000","last_change":"2023-10-10T22:37:21.309120+0000","last_active":"2023-10-10T22:37:22.313273+0000","last_peered":"2023-10-10T22:37:22.313273+0000","last_clean":"2023-10-10T22:37:22.313273+0000","last_became_active":"2023-10-10T22:37:21.308861+0000","last_became_peered":"2023-10-10T22:37:21.308861+0000","last_unstale":"2023-10-10T22:37:22.313273+0000","last_undegraded":"2023-10-10T22:37:22.313273+0000","last_fullsized":"2023-10-10T22:37:22.313273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:13:59.242392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338319+0000","last_change":"2023-10-10T22:37:22.330901+0000","last_active":"2023-10-10T22:37:22.338319+0000","last_peered":"2023-10-10T22:37:22.338319+0000","last_clean":"2023-10-10T22:37:22.338319+0000","last_became_active":"2023-10-10T22:37:22.327027+0000","last_became_peered":"2023-10-10T22:37:22.327027+0000","last_unstale":"2023-10-10T22:37:22.338319+0000","last_undegraded":"2023-10-10T22:37:22.338319+0000","last_fullsized":"2023-10-10T22:37:22.338319+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323309+0000","last_change":"2023-10-10T22:37:21.313404+0000","last_active":"2023-10-10T22:37:22.323309+0000","last_peered":"2023-10-10T22:37:22.323309+0000","last_clean":"2023-10-10T22:37:22.323309+0000","last_became_active":"2023-10-10T22:37:21.313147+0000","last_became_peered":"2023-10-10T22:37:21.313147+0000","last_unstale":"2023-10-10T22:37:22.323309+0000","last_undegraded":"2023-10-10T22:37:22.323309+0000","last_fullsized":"2023-10-10T22:37:22.323309+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:59.610628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341852+0000","last_change":"2023-10-10T22:37:22.331938+0000","last_active":"2023-10-10T22:37:22.341852+0000","last_peered":"2023-10-10T22:37:22.341852+0000","last_clean":"2023-10-10T22:37:22.341852+0000","last_became_active":"2023-10-10T22:37:22.331427+0000","last_became_peered":"2023-10-10T22:37:22.331427+0000","last_unstale":"2023-10-10T22:37:22.341852+0000","last_undegraded":"2023-10-10T22:37:22.341852+0000","last_fullsized":"2023-10-10T22:37:22.341852+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"208'8","reported_seq":18,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351735+0000","last_change":"2023-10-10T22:37:21.312079+0000","last_active":"2023-10-10T22:37:22.351735+0000","last_peered":"2023-10-10T22:37:22.351735+0000","last_clean":"2023-10-10T22:37:22.351735+0000","last_became_active":"2023-10-10T22:37:21.311201+0000","last_became_peered":"2023-10-10T22:37:21.311201+0000","last_unstale":"2023-10-10T22:37:22.351735+0000","last_undegraded":"2023-10-10T22:37:22.351735+0000","last_fullsized":"2023-10-10T22:37:22.351735+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:46.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335508+0000","last_change":"2023-10-10T22:37:22.329719+0000","last_active":"2023-10-10T22:37:22.335508+0000","last_peered":"2023-10-10T22:37:22.335508+0000","last_clean":"2023-10-10T22:37:22.335508+0000","last_became_active":"2023-10-10T22:37:22.329479+0000","last_became_peered":"2023-10-10T22:37:22.329479+0000","last_unstale":"2023-10-10T22:37:22.335508+0000","last_undegraded":"2023-10-10T22:37:22.335508+0000","last_fullsized":"2023-10-10T22:37:22.335508+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344267+0000","last_change":"2023-10-10T22:37:21.307317+0000","last_active":"2023-10-10T22:37:22.344267+0000","last_peered":"2023-10-10T22:37:22.344267+0000","last_clean":"2023-10-10T22:37:22.344267+0000","last_became_active":"2023-10-10T22:37:21.307063+0000","last_became_peered":"2023-10-10T22:37:21.307063+0000","last_unstale":"2023-10-10T22:37:22.344267+0000","last_undegraded":"2023-10-10T22:37:22.344267+0000","last_fullsized":"2023-10-10T22:37:22.344267+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:44:04.204820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338262+0000","last_change":"2023-10-10T22:37:22.331546+0000","last_active":"2023-10-10T22:37:22.338262+0000","last_peered":"2023-10-10T22:37:22.338262+0000","last_clean":"2023-10-10T22:37:22.338262+0000","last_became_active":"2023-10-10T22:37:22.327510+0000","last_became_peered":"2023-10-10T22:37:22.327510+0000","last_unstale":"2023-10-10T22:37:22.338262+0000","last_undegraded":"2023-10-10T22:37:22.338262+0000","last_fullsized":"2023-10-10T22:37:22.338262+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346273+0000","last_change":"2023-10-10T22:37:21.315652+0000","last_active":"2023-10-10T22:37:22.346273+0000","last_peered":"2023-10-10T22:37:22.346273+0000","last_clean":"2023-10-10T22:37:22.346273+0000","last_became_active":"2023-10-10T22:37:21.315368+0000","last_became_peered":"2023-10-10T22:37:21.315368+0000","last_unstale":"2023-10-10T22:37:22.346273+0000","last_undegraded":"2023-10-10T22:37:22.346273+0000","last_fullsized":"2023-10-10T22:37:22.346273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:00:52.565481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343258+0000","last_change":"2023-10-10T22:37:22.334001+0000","last_active":"2023-10-10T22:37:22.343258+0000","last_peered":"2023-10-10T22:37:22.343258+0000","last_clean":"2023-10-10T22:37:22.343258+0000","last_became_active":"2023-10-10T22:37:22.333748+0000","last_became_peered":"2023-10-10T22:37:22.333748+0000","last_unstale":"2023-10-10T22:37:22.343258+0000","last_undegraded":"2023-10-10T22:37:22.343258+0000","last_fullsized":"2023-10-10T22:37:22.343258+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:33.316234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351642+0000","last_change":"2023-10-10T22:37:21.311600+0000","last_active":"2023-10-10T22:37:22.351642+0000","last_peered":"2023-10-10T22:37:22.351642+0000","last_clean":"2023-10-10T22:37:22.351642+0000","last_became_active":"2023-10-10T22:37:21.311310+0000","last_became_peered":"2023-10-10T22:37:21.311310+0000","last_unstale":"2023-10-10T22:37:22.351642+0000","last_undegraded":"2023-10-10T22:37:22.351642+0000","last_fullsized":"2023-10-10T22:37:22.351642+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:28.854458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325907+0000","last_change":"2023-10-10T22:37:21.308409+0000","last_active":"2023-10-10T22:37:22.325907+0000","last_peered":"2023-10-10T22:37:22.325907+0000","last_clean":"2023-10-10T22:37:22.325907+0000","last_became_active":"2023-10-10T22:37:21.308069+0000","last_became_peered":"2023-10-10T22:37:21.308069+0000","last_unstale":"2023-10-10T22:37:22.325907+0000","last_undegraded":"2023-10-10T22:37:22.325907+0000","last_fullsized":"2023-10-10T22:37:22.325907+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:55.439618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324866+0000","last_change":"2023-10-10T22:37:22.322788+0000","last_active":"2023-10-10T22:37:22.324866+0000","last_peered":"2023-10-10T22:37:22.324866+0000","last_clean":"2023-10-10T22:37:22.324866+0000","last_became_active":"2023-10-10T22:37:22.322526+0000","last_became_peered":"2023-10-10T22:37:22.322526+0000","last_unstale":"2023-10-10T22:37:22.324866+0000","last_undegraded":"2023-10-10T22:37:22.324866+0000","last_fullsized":"2023-10-10T22:37:22.324866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346717+0000","last_change":"2023-10-10T22:37:21.314705+0000","last_active":"2023-10-10T22:37:22.346717+0000","last_peered":"2023-10-10T22:37:22.346717+0000","last_clean":"2023-10-10T22:37:22.346717+0000","last_became_active":"2023-10-10T22:37:21.314394+0000","last_became_peered":"2023-10-10T22:37:21.314394+0000","last_unstale":"2023-10-10T22:37:22.346717+0000","last_undegraded":"2023-10-10T22:37:22.346717+0000","last_fullsized":"2023-10-10T22:37:22.346717+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:49.346015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.339779+0000","last_change":"2023-10-10T22:37:22.334339+0000","last_active":"2023-10-10T22:37:22.339779+0000","last_peered":"2023-10-10T22:37:22.339779+0000","last_clean":"2023-10-10T22:37:22.339779+0000","last_became_active":"2023-10-10T22:37:22.334070+0000","last_became_peered":"2023-10-10T22:37:22.334070+0000","last_unstale":"2023-10-10T22:37:22.339779+0000","last_undegraded":"2023-10-10T22:37:22.339779+0000","last_fullsized":"2023-10-10T22:37:22.339779+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316614+0000","last_change":"2023-10-10T22:37:21.308062+0000","last_active":"2023-10-10T22:37:22.316614+0000","last_peered":"2023-10-10T22:37:22.316614+0000","last_clean":"2023-10-10T22:37:22.316614+0000","last_became_active":"2023-10-10T22:37:21.307766+0000","last_became_peered":"2023-10-10T22:37:21.307766+0000","last_unstale":"2023-10-10T22:37:22.316614+0000","last_undegraded":"2023-10-10T22:37:22.316614+0000","last_fullsized":"2023-10-10T22:37:22.316614+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:17.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316751+0000","last_change":"2023-10-10T22:37:21.309163+0000","last_active":"2023-10-10T22:37:22.316751+0000","last_peered":"2023-10-10T22:37:22.316751+0000","last_clean":"2023-10-10T22:37:22.316751+0000","last_became_active":"2023-10-10T22:37:21.308910+0000","last_became_peered":"2023-10-10T22:37:21.308910+0000","last_unstale":"2023-10-10T22:37:22.316751+0000","last_undegraded":"2023-10-10T22:37:22.316751+0000","last_fullsized":"2023-10-10T22:37:22.316751+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:15:42.499573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322365+0000","last_change":"2023-10-10T22:37:22.321715+0000","last_active":"2023-10-10T22:37:22.322365+0000","last_peered":"2023-10-10T22:37:22.322365+0000","last_clean":"2023-10-10T22:37:22.322365+0000","last_became_active":"2023-10-10T22:37:22.321465+0000","last_became_peered":"2023-10-10T22:37:22.321465+0000","last_unstale":"2023-10-10T22:37:22.322365+0000","last_undegraded":"2023-10-10T22:37:22.322365+0000","last_fullsized":"2023-10-10T22:37:22.322365+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:03:49.499590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314924+0000","last_change":"2023-10-10T22:37:21.305255+0000","last_active":"2023-10-10T22:37:22.314924+0000","last_peered":"2023-10-10T22:37:22.314924+0000","last_clean":"2023-10-10T22:37:22.314924+0000","last_became_active":"2023-10-10T22:37:21.304967+0000","last_became_peered":"2023-10-10T22:37:21.304967+0000","last_unstale":"2023-10-10T22:37:22.314924+0000","last_undegraded":"2023-10-10T22:37:22.314924+0000","last_fullsized":"2023-10-10T22:37:22.314924+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:37.730832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.326134+0000","last_change":"2023-10-10T22:37:22.321857+0000","last_active":"2023-10-10T22:37:22.326134+0000","last_peered":"2023-10-10T22:37:22.326134+0000","last_clean":"2023-10-10T22:37:22.326134+0000","last_became_active":"2023-10-10T22:37:22.321606+0000","last_became_peered":"2023-10-10T22:37:22.321606+0000","last_unstale":"2023-10-10T22:37:22.326134+0000","last_undegraded":"2023-10-10T22:37:22.326134+0000","last_fullsized":"2023-10-10T22:37:22.326134+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:23.523345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348933+0000","last_change":"2023-10-10T22:37:21.313185+0000","last_active":"2023-10-10T22:37:22.348933+0000","last_peered":"2023-10-10T22:37:22.348933+0000","last_clean":"2023-10-10T22:37:22.348933+0000","last_became_active":"2023-10-10T22:37:21.313009+0000","last_became_peered":"2023-10-10T22:37:21.313009+0000","last_unstale":"2023-10-10T22:37:22.348933+0000","last_undegraded":"2023-10-10T22:37:22.348933+0000","last_fullsized":"2023-10-10T22:37:22.348933+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:42:23.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341866+0000","last_change":"2023-10-10T22:37:22.332898+0000","last_active":"2023-10-10T22:37:22.341866+0000","last_peered":"2023-10-10T22:37:22.341866+0000","last_clean":"2023-10-10T22:37:22.341866+0000","last_became_active":"2023-10-10T22:37:22.332640+0000","last_became_peered":"2023-10-10T22:37:22.332640+0000","last_unstale":"2023-10-10T22:37:22.341866+0000","last_undegraded":"2023-10-10T22:37:22.341866+0000","last_fullsized":"2023-10-10T22:37:22.341866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.312873+0000","last_change":"2023-10-10T22:37:21.305064+0000","last_active":"2023-10-10T22:37:22.312873+0000","last_peered":"2023-10-10T22:37:22.312873+0000","last_clean":"2023-10-10T22:37:22.312873+0000","last_became_active":"2023-10-10T22:37:21.304822+0000","last_became_peered":"2023-10-10T22:37:21.304822+0000","last_unstale":"2023-10-10T22:37:22.312873+0000","last_undegraded":"2023-10-10T22:37:22.312873+0000","last_fullsized":"2023-10-10T22:37:22.312873+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:53:36.582199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338517+0000","last_change":"2023-10-10T22:37:22.336111+0000","last_active":"2023-10-10T22:37:22.338517+0000","last_peered":"2023-10-10T22:37:22.338517+0000","last_clean":"2023-10-10T22:37:22.338517+0000","last_became_active":"2023-10-10T22:37:22.335816+0000","last_became_peered":"2023-10-10T22:37:22.335816+0000","last_unstale":"2023-10-10T22:37:22.338517+0000","last_undegraded":"2023-10-10T22:37:22.338517+0000","last_fullsized":"2023-10-10T22:37:22.338517+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:49:21.033563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313016+0000","last_change":"2023-10-10T22:37:21.305679+0000","last_active":"2023-10-10T22:37:22.313016+0000","last_peered":"2023-10-10T22:37:22.313016+0000","last_clean":"2023-10-10T22:37:22.313016+0000","last_became_active":"2023-10-10T22:37:21.305426+0000","last_became_peered":"2023-10-10T22:37:21.305426+0000","last_unstale":"2023-10-10T22:37:22.313016+0000","last_undegraded":"2023-10-10T22:37:22.313016+0000","last_fullsized":"2023-10-10T22:37:22.313016+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:09.257265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343285+0000","last_change":"2023-10-10T22:37:22.340538+0000","last_active":"2023-10-10T22:37:22.343285+0000","last_peered":"2023-10-10T22:37:22.343285+0000","last_clean":"2023-10-10T22:37:22.343285+0000","last_became_active":"2023-10-10T22:37:22.340297+0000","last_became_peered":"2023-10-10T22:37:22.340297+0000","last_unstale":"2023-10-10T22:37:22.343285+0000","last_undegraded":"2023-10-10T22:37:22.343285+0000","last_fullsized":"2023-10-10T22:37:22.343285+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:15:40.123577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323634+0000","last_change":"2023-10-10T22:37:21.315894+0000","last_active":"2023-10-10T22:37:22.323634+0000","last_peered":"2023-10-10T22:37:22.323634+0000","last_clean":"2023-10-10T22:37:22.323634+0000","last_became_active":"2023-10-10T22:37:21.315627+0000","last_became_peered":"2023-10-10T22:37:21.315627+0000","last_unstale":"2023-10-10T22:37:22.323634+0000","last_undegraded":"2023-10-10T22:37:22.323634+0000","last_fullsized":"2023-10-10T22:37:22.323634+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:57.625726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343203+0000","last_change":"2023-10-10T22:37:22.337620+0000","last_active":"2023-10-10T22:37:22.343203+0000","last_peered":"2023-10-10T22:37:22.343203+0000","last_clean":"2023-10-10T22:37:22.343203+0000","last_became_active":"2023-10-10T22:37:22.337376+0000","last_became_peered":"2023-10-10T22:37:22.337376+0000","last_unstale":"2023-10-10T22:37:22.343203+0000","last_undegraded":"2023-10-10T22:37:22.343203+0000","last_fullsized":"2023-10-10T22:37:22.343203+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:02:20.851800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316514+0000","last_change":"2023-10-10T22:37:21.306687+0000","last_active":"2023-10-10T22:37:22.316514+0000","last_peered":"2023-10-10T22:37:22.316514+0000","last_clean":"2023-10-10T22:37:22.316514+0000","last_became_active":"2023-10-10T22:37:21.306312+0000","last_became_peered":"2023-10-10T22:37:21.306312+0000","last_unstale":"2023-10-10T22:37:22.316514+0000","last_undegraded":"2023-10-10T22:37:22.316514+0000","last_fullsized":"2023-10-10T22:37:22.316514+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:12.421535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345813+0000","last_change":"2023-10-10T22:37:22.340754+0000","last_active":"2023-10-10T22:37:22.345813+0000","last_peered":"2023-10-10T22:37:22.345813+0000","last_clean":"2023-10-10T22:37:22.345813+0000","last_became_active":"2023-10-10T22:37:22.340438+0000","last_became_peered":"2023-10-10T22:37:22.340438+0000","last_unstale":"2023-10-10T22:37:22.345813+0000","last_undegraded":"2023-10-10T22:37:22.345813+0000","last_fullsized":"2023-10-10T22:37:22.345813+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:44:45.896568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314997+0000","last_change":"2023-10-10T22:37:21.305173+0000","last_active":"2023-10-10T22:37:22.314997+0000","last_peered":"2023-10-10T22:37:22.314997+0000","last_clean":"2023-10-10T22:37:22.314997+0000","last_became_active":"2023-10-10T22:37:21.304872+0000","last_became_peered":"2023-10-10T22:37:21.304872+0000","last_unstale":"2023-10-10T22:37:22.314997+0000","last_undegraded":"2023-10-10T22:37:22.314997+0000","last_fullsized":"2023-10-10T22:37:22.314997+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:44.345013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:37:20.275583+0000","last_change":"2023-10-10T22:37:20.290722+0000","last_active":"2023-10-10T22:37:20.275583+0000","last_peered":"2023-10-10T22:37:20.275583+0000","last_clean":"2023-10-10T22:37:20.275583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:20.275583+0000","last_undegraded":"2023-10-10T22:37:20.275583+0000","last_fullsized":"2023-10-10T22:37:20.275583+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:54:55.230815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335239+0000","last_change":"2023-10-10T22:37:22.332348+0000","last_active":"2023-10-10T22:37:22.335239+0000","last_peered":"2023-10-10T22:37:22.335239+0000","last_clean":"2023-10-10T22:37:22.335239+0000","last_became_active":"2023-10-10T22:37:22.332119+0000","last_became_peered":"2023-10-10T22:37:22.332119+0000","last_unstale":"2023-10-10T22:37:22.335239+0000","last_undegraded":"2023-10-10T22:37:22.335239+0000","last_fullsized":"2023-10-10T22:37:22.335239+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:56.404086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.315755+0000","last_change":"2023-10-10T22:37:21.308580+0000","last_active":"2023-10-10T22:37:22.315755+0000","last_peered":"2023-10-10T22:37:22.315755+0000","last_clean":"2023-10-10T22:37:22.315755+0000","last_became_active":"2023-10-10T22:37:21.308346+0000","last_became_peered":"2023-10-10T22:37:21.308346+0000","last_unstale":"2023-10-10T22:37:22.315755+0000","last_undegraded":"2023-10-10T22:37:22.315755+0000","last_fullsized":"2023-10-10T22:37:22.315755+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:22.763388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330445+0000","last_change":"2023-10-10T22:37:22.326456+0000","last_active":"2023-10-10T22:37:22.330445+0000","last_peered":"2023-10-10T22:37:22.330445+0000","last_clean":"2023-10-10T22:37:22.330445+0000","last_became_active":"2023-10-10T22:37:22.326179+0000","last_became_peered":"2023-10-10T22:37:22.326179+0000","last_unstale":"2023-10-10T22:37:22.330445+0000","last_undegraded":"2023-10-10T22:37:22.330445+0000","last_fullsized":"2023-10-10T22:37:22.330445+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:34:29.226879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324236+0000","last_change":"2023-10-10T22:37:21.309121+0000","last_active":"2023-10-10T22:37:22.324236+0000","last_peered":"2023-10-10T22:37:22.324236+0000","last_clean":"2023-10-10T22:37:22.324236+0000","last_became_active":"2023-10-10T22:37:21.308062+0000","last_became_peered":"2023-10-10T22:37:21.308062+0000","last_unstale":"2023-10-10T22:37:22.324236+0000","last_undegraded":"2023-10-10T22:37:22.324236+0000","last_fullsized":"2023-10-10T22:37:22.324236+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:34.472180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1145,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324105+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:37:22.324105+0000","last_peered":"2023-10-10T22:37:22.324105+0000","last_clean":"2023-10-10T22:37:22.324105+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:37:22.324105+0000","last_undegraded":"2023-10-10T22:37:22.324105+0000","last_fullsized":"2023-10-10T22:37:22.324105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543275,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312716,"kb_used_data":3140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059124,"statfs":{"total":96636764160,"available":96316542976,"internally_reserved":0,"allocated":3215360,"data_stored":1905675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.026},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":1.073,"15min":1.081},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":1.145,"15min":1.145},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":1.0700000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.59899999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":1.0009999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.503,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.878}]},{"osd":4,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":0.82299999999999995,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":1.012},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.91800000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.024},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":0.999,"15min":1.079},"last":0.78700000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.042},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.86199999999999999,"5min":1.046,"15min":1.125},"last":0.95399999999999996}]}]},{"osd":6,"up_from":14,"seq":60129543273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299792,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072048,"statfs":{"total":96636764160,"available":96329777152,"internally_reserved":0,"allocated":2564096,"data_stored":1288004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":1.0289999999999999,"15min":1.1080000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.751},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.0920000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.64500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94299999999999995,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.034,"15min":1.1200000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.0660000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.621,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91200000000000003,"5min":0.97399999999999998,"15min":1.071},"last":0.80500000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":1.778,"15min":1.778},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.86899999999999999,"5min":0.996,"15min":1.046},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97299999999999998,"5min":1.827,"15min":1.827},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.754}]}]},{"osd":1,"up_from":14,"seq":60129543274,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1316739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.379},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.82999999999999996,"15min":0.88},"last":0.435}]},{"osd":2,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.878,"15min":0.90800000000000003},"last":0.504},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.88800000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.74399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.995,"5min":1.0269999999999999,"15min":1.177},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.008,"5min":1.089,"15min":1.1419999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.2450000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.64300000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.081,"5min":1.1200000000000001,"15min":1.2729999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.155},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.68600000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.2230000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308616,"kb_used_data":3136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063224,"statfs":{"total":96636764160,"available":96320741376,"internally_reserved":0,"allocated":3211264,"data_stored":1905593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.71399999999999997,"15min":0.753},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.433}]},{"osd":2,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.76000000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.85299999999999998},"last":0.501}]},{"osd":3,"last update":"Tue Oct 10 22:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.81100000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0469999999999999,"5min":1.1180000000000001,"15min":1.3340000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.1479999999999999,"15min":1.198},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56899999999999995},"max":{"1min":1.0449999999999999,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.625,"5min":0.54800000000000004,"15min":0.54500000000000004},"max":{"1min":1.1439999999999999,"5min":1.3320000000000001,"15min":1.377},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0449999999999999,"5min":1.274,"15min":1.427},"last":0.81999999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.198,"5min":1.224,"15min":1.2689999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.081,"5min":1.153,"15min":1.153},"last":0.83999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316236,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055604,"statfs":{"total":96636764160,"available":96312938496,"internally_reserved":0,"allocated":2625536,"data_stored":1315869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.317},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.89500000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.85699999999999998,"15min":0.85799999999999998},"last":0.438},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.101,"15min":1.288},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98599999999999999,"5min":1.1220000000000001,"15min":1.325},"last":0.77300000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.147,"15min":1.1970000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82199999999999995,"15min":0.84099999999999997},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.054,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.26},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.093,"5min":1.165,"15min":1.3129999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80600000000000005,"15min":0.83199999999999996},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.181,"15min":1.2609999999999999},"last":0.871}]}]},{"osd":3,"up_from":15,"seq":64424510571,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1315397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.877,"15min":0.877},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.70599999999999996,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":0.99399999999999999},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.04,"5min":1.133,"15min":1.242},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.202,"15min":1.2629999999999999},"last":0.96499999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.125,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":1.1040000000000001,"15min":1.222},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.099,"5min":1.1539999999999999,"15min":1.212},"last":0.89900000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.54200000000000004},"max":{"1min":0.98899999999999999,"5min":1.274,"15min":1.274},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":0.83499999999999996},"min":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56699999999999995},"max":{"1min":1.097,"5min":1.149,"15min":1.2370000000000001},"last":0.69699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129543276,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1317293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.087},"last":0.435},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.752},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.437},"max":{"1min":0.94099999999999995,"5min":0.95199999999999996,"15min":1.1220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88500000000000001,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.998,"15min":1.073},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.089},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.45200000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.4079999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":1.282},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.94099999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.94099999999999995,"15min":1.0900000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.42199999999999999},"max":{"1min":0.82099999999999995,"5min":0.89600000000000002,"15min":1.0649999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.92100000000000004,"5min":0.96999999999999997,"15min":1.21},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.436},"max":{"1min":0.97399999999999998,"5min":0.97999999999999998,"15min":1.147},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543274,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1315203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":1.006},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.48199999999999998,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.997},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65500000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.98999999999999999,"15min":1.04},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.02},"last":0.76000000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.37},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.01,"5min":1.01,"15min":1.032},"last":0.749}]},{"osd":7,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.623},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.02},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:37:26.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:37:26.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.865+0000 7f43849fe700 1 Processor -- start 2023-10-10T22:37:26.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.865+0000 7f43849fe700 1 -- start start 2023-10-10T22:37:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.866+0000 7f43849fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4380150550 0x7f4380157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.866+0000 7f43849fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800c7410 0x7f4380069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.866+0000 7f43849fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438006e2a0 con 0x7f4380150180 2023-10-10T22:37:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.866+0000 7f43849fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438006b2e0 con 0x7f4380150550 2023-10-10T22:37:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.866+0000 7f43849fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800c78e0 con 0x7f43800c7410 2023-10-10T22:37:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.866+0000 7f437e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4380150550 0x7f4380157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.867+0000 7f437e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4380150550 0x7f4380157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33144/0 (socket says 172.21.15.154:33144) 2023-10-10T22:37:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.867+0000 7f437e59c700 1 -- 172.21.15.154:0/657576980 learned_addr learned my addr 172.21.15.154:0/657576980 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.867+0000 7f437f59e700 1 --2- 172.21.15.154:0/657576980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800c7410 0x7f4380069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.867+0000 7f437e59c700 1 -- 172.21.15.154:0/657576980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800c7410 msgr2=0x7f4380069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.867+0000 7f437e59c700 1 --2- 172.21.15.154:0/657576980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800c7410 0x7f4380069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.867+0000 7f437e59c700 1 -- 172.21.15.154:0/657576980 >> v1:172.21.15.179:6789/0 conn(0x7f4380150180 legacy=0x7f43800c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.867+0000 7f437e59c700 1 -- 172.21.15.154:0/657576980 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800c7bc0 con 0x7f4380150550 2023-10-10T22:37:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.867+0000 7f437e59c700 1 --2- 172.21.15.154:0/657576980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4380150550 0x7f4380157770 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f43740099b0 tx=0x7f4374009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338da4ede2582efa server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.867+0000 7f437dd9b700 1 -- 172.21.15.154:0/657576980 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400b860 con 0x7f4380150550 2023-10-10T22:37:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f437dd9b700 1 -- 172.21.15.154:0/657576980 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437400b9c0 con 0x7f4380150550 2023-10-10T22:37:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f437dd9b700 1 -- 172.21.15.154:0/657576980 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400bd60 con 0x7f4380150550 2023-10-10T22:37:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f43849fe700 1 -- 172.21.15.154:0/657576980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4380150550 msgr2=0x7f4380157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f43849fe700 1 --2- 172.21.15.154:0/657576980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4380150550 0x7f4380157770 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f43740099b0 tx=0x7f4374009250 comp rx=0 tx=0).stop 2023-10-10T22:37:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f43849fe700 1 -- 172.21.15.154:0/657576980 shutdown_connections 2023-10-10T22:37:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f43849fe700 1 --2- 172.21.15.154:0/657576980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800c7410 0x7f4380069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f43849fe700 1 --2- 172.21.15.154:0/657576980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4380150550 0x7f4380157770 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f43849fe700 1 -- 172.21.15.154:0/657576980 >> 172.21.15.154:0/657576980 conn(0x7f43800cc1f0 msgr2=0x7f43800cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f43849fe700 1 -- 172.21.15.154:0/657576980 shutdown_connections 2023-10-10T22:37:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.868+0000 7f43849fe700 1 -- 172.21.15.154:0/657576980 wait complete. 2023-10-10T22:37:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.870+0000 7f43849fe700 1 Processor -- start 2023-10-10T22:37:26.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.870+0000 7f43849fe700 1 -- start start 2023-10-10T22:37:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f43849fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43800c7410 0x7f4380147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f43849fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4380150180 0x7f4380149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f43849fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4380150550 0x7f4380149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f43849fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800ac840 con 0x7f43800c7410 2023-10-10T22:37:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f43849fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4380148280 con 0x7f4380150550 2023-10-10T22:37:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f43849fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800abc30 con 0x7f4380150180 2023-10-10T22:37:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f437ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43800c7410 0x7f4380147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f437ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43800c7410 0x7f4380147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33150/0 (socket says 172.21.15.154:33150) 2023-10-10T22:37:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f437ed9d700 1 -- 172.21.15.154:0/563633743 learned_addr learned my addr 172.21.15.154:0/563633743 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f437ed9d700 1 -- 172.21.15.154:0/563633743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4380150180 msgr2=0x7f4380149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f437ed9d700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4380150180 0x7f4380149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f437ed9d700 1 -- 172.21.15.154:0/563633743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4380150550 msgr2=0x7f4380149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:26.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f437ed9d700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4380150550 0x7f4380149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:26.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.871+0000 7f437ed9d700 1 -- 172.21.15.154:0/563633743 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740094f0 con 0x7f43800c7410 2023-10-10T22:37:26.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.872+0000 7f437ed9d700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43800c7410 0x7f4380147d40 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f437000c590 tx=0x7f437000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:26.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.872+0000 7f4366ffd700 1 -- 172.21.15.154:0/563633743 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370011590 con 0x7f43800c7410 2023-10-10T22:37:26.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.872+0000 7f4366ffd700 1 -- 172.21.15.154:0/563633743 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43700116f0 con 0x7f43800c7410 2023-10-10T22:37:26.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.872+0000 7f4366ffd700 1 -- 172.21.15.154:0/563633743 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370011ab0 con 0x7f43800c7410 2023-10-10T22:37:26.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.872+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43800abf10 con 0x7f43800c7410 2023-10-10T22:37:26.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.872+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43800ac4d0 con 0x7f43800c7410 2023-10-10T22:37:26.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.873+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43800ab9a0 con 0x7f43800c7410 2023-10-10T22:37:26.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.874+0000 7f4366ffd700 1 -- 172.21.15.154:0/563633743 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f437001b3b0 con 0x7f43800c7410 2023-10-10T22:37:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.875+0000 7f4366ffd700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f30 0x7f436c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.875+0000 7f4366ffd700 1 -- 172.21.15.154:0/563633743 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f4370083c70 con 0x7f43800c7410 2023-10-10T22:37:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.876+0000 7f437e59c700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f30 0x7f436c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.876+0000 7f437e59c700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f30 0x7f436c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43740099b0 tx=0x7f4374018000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:26.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:26.879+0000 7f4366ffd700 1 -- 172.21.15.154:0/563633743 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4370050cd0 con 0x7f43800c7410 2023-10-10T22:37:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.067+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43800ac980 con 0x7f436c066f30 2023-10-10T22:37:27.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.076+0000 7f4366ffd700 1 -- 172.21.15.154:0/563633743 <== mgr.9999 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288056 (secure 0 0 0) 0x7f4374000cd0 con 0x7f436c066f30 2023-10-10T22:37:27.082 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f30 msgr2=0x7f436c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f30 0x7f436c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43740099b0 tx=0x7f4374018000 comp rx=0 tx=0).stop 2023-10-10T22:37:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43800c7410 msgr2=0x7f4380147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43800c7410 0x7f4380147d40 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f437000c590 tx=0x7f437000c950 comp rx=0 tx=0).stop 2023-10-10T22:37:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 shutdown_connections 2023-10-10T22:37:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f436c066f30 0x7f436c0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4380150550 0x7f4380149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43800c7410 0x7f4380147d40 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 --2- 172.21.15.154:0/563633743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4380150180 0x7f4380149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 >> 172.21.15.154:0/563633743 conn(0x7f43800cc1f0 msgr2=0x7f438014f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:27.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 shutdown_connections 2023-10-10T22:37:27.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.080+0000 7f43849fe700 1 -- 172.21.15.154:0/563633743 wait complete. 2023-10-10T22:37:27.087 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:37:27.100 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:37:25.898457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":620,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":384,"ondisk_log_size":384,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461336,"kb_used_data":21592,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752513384,"statfs":{"total":773094113280,"available":770573705216,"internally_reserved":0,"allocated":22110208,"data_stored":11679773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.612642"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343085+0000","last_change":"2023-10-10T22:37:22.336242+0000","last_active":"2023-10-10T22:37:22.343085+0000","last_peered":"2023-10-10T22:37:22.343085+0000","last_clean":"2023-10-10T22:37:22.343085+0000","last_became_active":"2023-10-10T22:37:22.335965+0000","last_became_peered":"2023-10-10T22:37:22.335965+0000","last_unstale":"2023-10-10T22:37:22.343085+0000","last_undegraded":"2023-10-10T22:37:22.343085+0000","last_fullsized":"2023-10-10T22:37:22.343085+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:32:15.779372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330213+0000","last_change":"2023-10-10T22:37:22.323947+0000","last_active":"2023-10-10T22:37:22.330213+0000","last_peered":"2023-10-10T22:37:22.330213+0000","last_clean":"2023-10-10T22:37:22.330213+0000","last_became_active":"2023-10-10T22:37:22.323685+0000","last_became_peered":"2023-10-10T22:37:22.323685+0000","last_unstale":"2023-10-10T22:37:22.330213+0000","last_undegraded":"2023-10-10T22:37:22.330213+0000","last_fullsized":"2023-10-10T22:37:22.330213+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:54:16.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331732+0000","last_change":"2023-10-10T22:37:22.329074+0000","last_active":"2023-10-10T22:37:22.331732+0000","last_peered":"2023-10-10T22:37:22.331732+0000","last_clean":"2023-10-10T22:37:22.331732+0000","last_became_active":"2023-10-10T22:37:22.328756+0000","last_became_peered":"2023-10-10T22:37:22.328756+0000","last_unstale":"2023-10-10T22:37:22.331732+0000","last_undegraded":"2023-10-10T22:37:22.331732+0000","last_fullsized":"2023-10-10T22:37:22.331732+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:55:55.816244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345969+0000","last_change":"2023-10-10T22:37:22.341498+0000","last_active":"2023-10-10T22:37:22.345969+0000","last_peered":"2023-10-10T22:37:22.345969+0000","last_clean":"2023-10-10T22:37:22.345969+0000","last_became_active":"2023-10-10T22:37:22.341255+0000","last_became_peered":"2023-10-10T22:37:22.341255+0000","last_unstale":"2023-10-10T22:37:22.345969+0000","last_undegraded":"2023-10-10T22:37:22.345969+0000","last_fullsized":"2023-10-10T22:37:22.345969+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:32:00.612130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338966+0000","last_change":"2023-10-10T22:37:22.328393+0000","last_active":"2023-10-10T22:37:22.338966+0000","last_peered":"2023-10-10T22:37:22.338966+0000","last_clean":"2023-10-10T22:37:22.338966+0000","last_became_active":"2023-10-10T22:37:22.328101+0000","last_became_peered":"2023-10-10T22:37:22.328101+0000","last_unstale":"2023-10-10T22:37:22.338966+0000","last_undegraded":"2023-10-10T22:37:22.338966+0000","last_fullsized":"2023-10-10T22:37:22.338966+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:35:42.499747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336008+0000","last_change":"2023-10-10T22:37:22.331181+0000","last_active":"2023-10-10T22:37:22.336008+0000","last_peered":"2023-10-10T22:37:22.336008+0000","last_clean":"2023-10-10T22:37:22.336008+0000","last_became_active":"2023-10-10T22:37:22.330824+0000","last_became_peered":"2023-10-10T22:37:22.330824+0000","last_unstale":"2023-10-10T22:37:22.336008+0000","last_undegraded":"2023-10-10T22:37:22.336008+0000","last_fullsized":"2023-10-10T22:37:22.336008+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:29.396879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338211+0000","last_change":"2023-10-10T22:37:22.331320+0000","last_active":"2023-10-10T22:37:22.338211+0000","last_peered":"2023-10-10T22:37:22.338211+0000","last_clean":"2023-10-10T22:37:22.338211+0000","last_became_active":"2023-10-10T22:37:22.331052+0000","last_became_peered":"2023-10-10T22:37:22.331052+0000","last_unstale":"2023-10-10T22:37:22.338211+0000","last_undegraded":"2023-10-10T22:37:22.338211+0000","last_fullsized":"2023-10-10T22:37:22.338211+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325713+0000","last_change":"2023-10-10T22:37:22.325204+0000","last_active":"2023-10-10T22:37:22.325713+0000","last_peered":"2023-10-10T22:37:22.325713+0000","last_clean":"2023-10-10T22:37:22.325713+0000","last_became_active":"2023-10-10T22:37:22.321688+0000","last_became_peered":"2023-10-10T22:37:22.321688+0000","last_unstale":"2023-10-10T22:37:22.325713+0000","last_undegraded":"2023-10-10T22:37:22.325713+0000","last_fullsized":"2023-10-10T22:37:22.325713+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344561+0000","last_change":"2023-10-10T22:37:22.342230+0000","last_active":"2023-10-10T22:37:22.344561+0000","last_peered":"2023-10-10T22:37:22.344561+0000","last_clean":"2023-10-10T22:37:22.344561+0000","last_became_active":"2023-10-10T22:37:22.341026+0000","last_became_peered":"2023-10-10T22:37:22.341026+0000","last_unstale":"2023-10-10T22:37:22.344561+0000","last_undegraded":"2023-10-10T22:37:22.344561+0000","last_fullsized":"2023-10-10T22:37:22.344561+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:10.388326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343351+0000","last_change":"2023-10-10T22:37:22.331950+0000","last_active":"2023-10-10T22:37:22.343351+0000","last_peered":"2023-10-10T22:37:22.343351+0000","last_clean":"2023-10-10T22:37:22.343351+0000","last_became_active":"2023-10-10T22:37:22.327964+0000","last_became_peered":"2023-10-10T22:37:22.327964+0000","last_unstale":"2023-10-10T22:37:22.343351+0000","last_undegraded":"2023-10-10T22:37:22.343351+0000","last_fullsized":"2023-10-10T22:37:22.343351+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:29.862257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343867+0000","last_change":"2023-10-10T22:37:22.341039+0000","last_active":"2023-10-10T22:37:22.343867+0000","last_peered":"2023-10-10T22:37:22.343867+0000","last_clean":"2023-10-10T22:37:22.343867+0000","last_became_active":"2023-10-10T22:37:22.340752+0000","last_became_peered":"2023-10-10T22:37:22.340752+0000","last_unstale":"2023-10-10T22:37:22.343867+0000","last_undegraded":"2023-10-10T22:37:22.343867+0000","last_fullsized":"2023-10-10T22:37:22.343867+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:31:20.851558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332530+0000","last_change":"2023-10-10T22:37:22.330693+0000","last_active":"2023-10-10T22:37:22.332530+0000","last_peered":"2023-10-10T22:37:22.332530+0000","last_clean":"2023-10-10T22:37:22.332530+0000","last_became_active":"2023-10-10T22:37:22.330422+0000","last_became_peered":"2023-10-10T22:37:22.330422+0000","last_unstale":"2023-10-10T22:37:22.332530+0000","last_undegraded":"2023-10-10T22:37:22.332530+0000","last_fullsized":"2023-10-10T22:37:22.332530+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:15.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347291+0000","last_change":"2023-10-10T22:37:22.344903+0000","last_active":"2023-10-10T22:37:22.347291+0000","last_peered":"2023-10-10T22:37:22.347291+0000","last_clean":"2023-10-10T22:37:22.347291+0000","last_became_active":"2023-10-10T22:37:22.344568+0000","last_became_peered":"2023-10-10T22:37:22.344568+0000","last_unstale":"2023-10-10T22:37:22.347291+0000","last_undegraded":"2023-10-10T22:37:22.347291+0000","last_fullsized":"2023-10-10T22:37:22.347291+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:29:17.224764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331152+0000","last_change":"2023-10-10T22:37:22.327814+0000","last_active":"2023-10-10T22:37:22.331152+0000","last_peered":"2023-10-10T22:37:22.331152+0000","last_clean":"2023-10-10T22:37:22.331152+0000","last_became_active":"2023-10-10T22:37:22.327483+0000","last_became_peered":"2023-10-10T22:37:22.327483+0000","last_unstale":"2023-10-10T22:37:22.331152+0000","last_undegraded":"2023-10-10T22:37:22.331152+0000","last_fullsized":"2023-10-10T22:37:22.331152+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335425+0000","last_change":"2023-10-10T22:37:22.331782+0000","last_active":"2023-10-10T22:37:22.335425+0000","last_peered":"2023-10-10T22:37:22.335425+0000","last_clean":"2023-10-10T22:37:22.335425+0000","last_became_active":"2023-10-10T22:37:22.331529+0000","last_became_peered":"2023-10-10T22:37:22.331529+0000","last_unstale":"2023-10-10T22:37:22.335425+0000","last_undegraded":"2023-10-10T22:37:22.335425+0000","last_fullsized":"2023-10-10T22:37:22.335425+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:51.371588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330940+0000","last_change":"2023-10-10T22:37:22.327219+0000","last_active":"2023-10-10T22:37:22.330940+0000","last_peered":"2023-10-10T22:37:22.330940+0000","last_clean":"2023-10-10T22:37:22.330940+0000","last_became_active":"2023-10-10T22:37:22.326966+0000","last_became_peered":"2023-10-10T22:37:22.326966+0000","last_unstale":"2023-10-10T22:37:22.330940+0000","last_undegraded":"2023-10-10T22:37:22.330940+0000","last_fullsized":"2023-10-10T22:37:22.330940+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:43:29.646719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331376+0000","last_change":"2023-10-10T22:37:22.327933+0000","last_active":"2023-10-10T22:37:22.331376+0000","last_peered":"2023-10-10T22:37:22.331376+0000","last_clean":"2023-10-10T22:37:22.331376+0000","last_became_active":"2023-10-10T22:37:22.327538+0000","last_became_peered":"2023-10-10T22:37:22.327538+0000","last_unstale":"2023-10-10T22:37:22.331376+0000","last_undegraded":"2023-10-10T22:37:22.331376+0000","last_fullsized":"2023-10-10T22:37:22.331376+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:17.366872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329720+0000","last_change":"2023-10-10T22:37:22.328638+0000","last_active":"2023-10-10T22:37:22.329720+0000","last_peered":"2023-10-10T22:37:22.329720+0000","last_clean":"2023-10-10T22:37:22.329720+0000","last_became_active":"2023-10-10T22:37:22.328375+0000","last_became_peered":"2023-10-10T22:37:22.328375+0000","last_unstale":"2023-10-10T22:37:22.329720+0000","last_undegraded":"2023-10-10T22:37:22.329720+0000","last_fullsized":"2023-10-10T22:37:22.329720+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:56.447417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336027+0000","last_change":"2023-10-10T22:37:22.332011+0000","last_active":"2023-10-10T22:37:22.336027+0000","last_peered":"2023-10-10T22:37:22.336027+0000","last_clean":"2023-10-10T22:37:22.336027+0000","last_became_active":"2023-10-10T22:37:22.331741+0000","last_became_peered":"2023-10-10T22:37:22.331741+0000","last_unstale":"2023-10-10T22:37:22.336027+0000","last_undegraded":"2023-10-10T22:37:22.336027+0000","last_fullsized":"2023-10-10T22:37:22.336027+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:27.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338828+0000","last_change":"2023-10-10T22:37:22.333229+0000","last_active":"2023-10-10T22:37:22.338828+0000","last_peered":"2023-10-10T22:37:22.338828+0000","last_clean":"2023-10-10T22:37:22.338828+0000","last_became_active":"2023-10-10T22:37:22.332677+0000","last_became_peered":"2023-10-10T22:37:22.332677+0000","last_unstale":"2023-10-10T22:37:22.338828+0000","last_undegraded":"2023-10-10T22:37:22.338828+0000","last_fullsized":"2023-10-10T22:37:22.338828+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:43:41.226417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345995+0000","last_change":"2023-10-10T22:37:22.342096+0000","last_active":"2023-10-10T22:37:22.345995+0000","last_peered":"2023-10-10T22:37:22.345995+0000","last_clean":"2023-10-10T22:37:22.345995+0000","last_became_active":"2023-10-10T22:37:22.341851+0000","last_became_peered":"2023-10-10T22:37:22.341851+0000","last_unstale":"2023-10-10T22:37:22.345995+0000","last_undegraded":"2023-10-10T22:37:22.345995+0000","last_fullsized":"2023-10-10T22:37:22.345995+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:28:15.665680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332513+0000","last_change":"2023-10-10T22:37:22.329649+0000","last_active":"2023-10-10T22:37:22.332513+0000","last_peered":"2023-10-10T22:37:22.332513+0000","last_clean":"2023-10-10T22:37:22.332513+0000","last_became_active":"2023-10-10T22:37:22.329396+0000","last_became_peered":"2023-10-10T22:37:22.329396+0000","last_unstale":"2023-10-10T22:37:22.332513+0000","last_undegraded":"2023-10-10T22:37:22.332513+0000","last_fullsized":"2023-10-10T22:37:22.332513+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:13:12.738082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343386+0000","last_change":"2023-10-10T22:37:22.336423+0000","last_active":"2023-10-10T22:37:22.343386+0000","last_peered":"2023-10-10T22:37:22.343386+0000","last_clean":"2023-10-10T22:37:22.343386+0000","last_became_active":"2023-10-10T22:37:22.336115+0000","last_became_peered":"2023-10-10T22:37:22.336115+0000","last_unstale":"2023-10-10T22:37:22.343386+0000","last_undegraded":"2023-10-10T22:37:22.343386+0000","last_fullsized":"2023-10-10T22:37:22.343386+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329138+0000","last_change":"2023-10-10T22:37:22.326865+0000","last_active":"2023-10-10T22:37:22.329138+0000","last_peered":"2023-10-10T22:37:22.329138+0000","last_clean":"2023-10-10T22:37:22.329138+0000","last_became_active":"2023-10-10T22:37:22.326560+0000","last_became_peered":"2023-10-10T22:37:22.326560+0000","last_unstale":"2023-10-10T22:37:22.329138+0000","last_undegraded":"2023-10-10T22:37:22.329138+0000","last_fullsized":"2023-10-10T22:37:22.329138+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:16.097777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332570+0000","last_change":"2023-10-10T22:37:22.331211+0000","last_active":"2023-10-10T22:37:22.332570+0000","last_peered":"2023-10-10T22:37:22.332570+0000","last_clean":"2023-10-10T22:37:22.332570+0000","last_became_active":"2023-10-10T22:37:22.330969+0000","last_became_peered":"2023-10-10T22:37:22.330969+0000","last_unstale":"2023-10-10T22:37:22.332570+0000","last_undegraded":"2023-10-10T22:37:22.332570+0000","last_fullsized":"2023-10-10T22:37:22.332570+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:13.075740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343255+0000","last_change":"2023-10-10T22:37:22.340035+0000","last_active":"2023-10-10T22:37:22.343255+0000","last_peered":"2023-10-10T22:37:22.343255+0000","last_clean":"2023-10-10T22:37:22.343255+0000","last_became_active":"2023-10-10T22:37:22.339704+0000","last_became_peered":"2023-10-10T22:37:22.339704+0000","last_unstale":"2023-10-10T22:37:22.343255+0000","last_undegraded":"2023-10-10T22:37:22.343255+0000","last_fullsized":"2023-10-10T22:37:22.343255+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:57.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"208'4","reported_seq":14,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345983+0000","last_change":"2023-10-10T22:37:21.300780+0000","last_active":"2023-10-10T22:37:22.345983+0000","last_peered":"2023-10-10T22:37:22.345983+0000","last_clean":"2023-10-10T22:37:22.345983+0000","last_became_active":"2023-10-10T22:37:21.300530+0000","last_became_peered":"2023-10-10T22:37:21.300530+0000","last_unstale":"2023-10-10T22:37:22.345983+0000","last_undegraded":"2023-10-10T22:37:22.345983+0000","last_fullsized":"2023-10-10T22:37:22.345983+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:17.662491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325583+0000","last_change":"2023-10-10T22:37:22.324305+0000","last_active":"2023-10-10T22:37:22.325583+0000","last_peered":"2023-10-10T22:37:22.325583+0000","last_clean":"2023-10-10T22:37:22.325583+0000","last_became_active":"2023-10-10T22:37:22.324056+0000","last_became_peered":"2023-10-10T22:37:22.324056+0000","last_unstale":"2023-10-10T22:37:22.325583+0000","last_undegraded":"2023-10-10T22:37:22.325583+0000","last_fullsized":"2023-10-10T22:37:22.325583+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347552+0000","last_change":"2023-10-10T22:37:21.308912+0000","last_active":"2023-10-10T22:37:22.347552+0000","last_peered":"2023-10-10T22:37:22.347552+0000","last_clean":"2023-10-10T22:37:22.347552+0000","last_became_active":"2023-10-10T22:37:21.308582+0000","last_became_peered":"2023-10-10T22:37:21.308582+0000","last_unstale":"2023-10-10T22:37:22.347552+0000","last_undegraded":"2023-10-10T22:37:22.347552+0000","last_fullsized":"2023-10-10T22:37:22.347552+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:09.380526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338697+0000","last_change":"2023-10-10T22:37:22.332552+0000","last_active":"2023-10-10T22:37:22.338697+0000","last_peered":"2023-10-10T22:37:22.338697+0000","last_clean":"2023-10-10T22:37:22.338697+0000","last_became_active":"2023-10-10T22:37:22.332000+0000","last_became_peered":"2023-10-10T22:37:22.332000+0000","last_unstale":"2023-10-10T22:37:22.338697+0000","last_undegraded":"2023-10-10T22:37:22.338697+0000","last_fullsized":"2023-10-10T22:37:22.338697+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:45.352813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344219+0000","last_change":"2023-10-10T22:37:21.310535+0000","last_active":"2023-10-10T22:37:22.344219+0000","last_peered":"2023-10-10T22:37:22.344219+0000","last_clean":"2023-10-10T22:37:22.344219+0000","last_became_active":"2023-10-10T22:37:21.310298+0000","last_became_peered":"2023-10-10T22:37:21.310298+0000","last_unstale":"2023-10-10T22:37:22.344219+0000","last_undegraded":"2023-10-10T22:37:22.344219+0000","last_fullsized":"2023-10-10T22:37:22.344219+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:45.311116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338523+0000","last_change":"2023-10-10T22:37:22.330595+0000","last_active":"2023-10-10T22:37:22.338523+0000","last_peered":"2023-10-10T22:37:22.338523+0000","last_clean":"2023-10-10T22:37:22.338523+0000","last_became_active":"2023-10-10T22:37:22.330019+0000","last_became_peered":"2023-10-10T22:37:22.330019+0000","last_unstale":"2023-10-10T22:37:22.338523+0000","last_undegraded":"2023-10-10T22:37:22.338523+0000","last_fullsized":"2023-10-10T22:37:22.338523+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:37:20.275583+0000","last_change":"2023-10-10T22:37:20.290717+0000","last_active":"2023-10-10T22:37:20.275583+0000","last_peered":"2023-10-10T22:37:20.275583+0000","last_clean":"2023-10-10T22:37:20.275583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:20.275583+0000","last_undegraded":"2023-10-10T22:37:20.275583+0000","last_fullsized":"2023-10-10T22:37:20.275583+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:59.336943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.328680+0000","last_change":"2023-10-10T22:37:22.327712+0000","last_active":"2023-10-10T22:37:22.328680+0000","last_peered":"2023-10-10T22:37:22.328680+0000","last_clean":"2023-10-10T22:37:22.328680+0000","last_became_active":"2023-10-10T22:37:22.327084+0000","last_became_peered":"2023-10-10T22:37:22.327084+0000","last_unstale":"2023-10-10T22:37:22.328680+0000","last_undegraded":"2023-10-10T22:37:22.328680+0000","last_fullsized":"2023-10-10T22:37:22.328680+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:48:53.679083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344271+0000","last_change":"2023-10-10T22:37:21.306550+0000","last_active":"2023-10-10T22:37:22.344271+0000","last_peered":"2023-10-10T22:37:22.344271+0000","last_clean":"2023-10-10T22:37:22.344271+0000","last_became_active":"2023-10-10T22:37:21.306315+0000","last_became_peered":"2023-10-10T22:37:21.306315+0000","last_unstale":"2023-10-10T22:37:22.344271+0000","last_undegraded":"2023-10-10T22:37:22.344271+0000","last_fullsized":"2023-10-10T22:37:22.344271+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:41.427780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343229+0000","last_change":"2023-10-10T22:37:22.339383+0000","last_active":"2023-10-10T22:37:22.343229+0000","last_peered":"2023-10-10T22:37:22.343229+0000","last_clean":"2023-10-10T22:37:22.343229+0000","last_became_active":"2023-10-10T22:37:22.339121+0000","last_became_peered":"2023-10-10T22:37:22.339121+0000","last_unstale":"2023-10-10T22:37:22.343229+0000","last_undegraded":"2023-10-10T22:37:22.343229+0000","last_fullsized":"2023-10-10T22:37:22.343229+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:23.304666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346268+0000","last_change":"2023-10-10T22:37:21.311535+0000","last_active":"2023-10-10T22:37:22.346268+0000","last_peered":"2023-10-10T22:37:22.346268+0000","last_clean":"2023-10-10T22:37:22.346268+0000","last_became_active":"2023-10-10T22:37:21.311272+0000","last_became_peered":"2023-10-10T22:37:21.311272+0000","last_unstale":"2023-10-10T22:37:22.346268+0000","last_undegraded":"2023-10-10T22:37:22.346268+0000","last_fullsized":"2023-10-10T22:37:22.346268+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:56.463951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343480+0000","last_change":"2023-10-10T22:37:22.340669+0000","last_active":"2023-10-10T22:37:22.343480+0000","last_peered":"2023-10-10T22:37:22.343480+0000","last_clean":"2023-10-10T22:37:22.343480+0000","last_became_active":"2023-10-10T22:37:22.340417+0000","last_became_peered":"2023-10-10T22:37:22.340417+0000","last_unstale":"2023-10-10T22:37:22.343480+0000","last_undegraded":"2023-10-10T22:37:22.343480+0000","last_fullsized":"2023-10-10T22:37:22.343480+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:13.429335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323936+0000","last_change":"2023-10-10T22:37:21.311884+0000","last_active":"2023-10-10T22:37:22.323936+0000","last_peered":"2023-10-10T22:37:22.323936+0000","last_clean":"2023-10-10T22:37:22.323936+0000","last_became_active":"2023-10-10T22:37:21.311253+0000","last_became_peered":"2023-10-10T22:37:21.311253+0000","last_unstale":"2023-10-10T22:37:22.323936+0000","last_undegraded":"2023-10-10T22:37:22.323936+0000","last_fullsized":"2023-10-10T22:37:22.323936+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:32.308434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329066+0000","last_change":"2023-10-10T22:37:22.327563+0000","last_active":"2023-10-10T22:37:22.329066+0000","last_peered":"2023-10-10T22:37:22.329066+0000","last_clean":"2023-10-10T22:37:22.329066+0000","last_became_active":"2023-10-10T22:37:22.327285+0000","last_became_peered":"2023-10-10T22:37:22.327285+0000","last_unstale":"2023-10-10T22:37:22.329066+0000","last_undegraded":"2023-10-10T22:37:22.329066+0000","last_fullsized":"2023-10-10T22:37:22.329066+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:10.265065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322635+0000","last_change":"2023-10-10T22:37:21.304131+0000","last_active":"2023-10-10T22:37:22.322635+0000","last_peered":"2023-10-10T22:37:22.322635+0000","last_clean":"2023-10-10T22:37:22.322635+0000","last_became_active":"2023-10-10T22:37:21.303862+0000","last_became_peered":"2023-10-10T22:37:21.303862+0000","last_unstale":"2023-10-10T22:37:22.322635+0000","last_undegraded":"2023-10-10T22:37:22.322635+0000","last_fullsized":"2023-10-10T22:37:22.322635+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:11.264533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.334236+0000","last_change":"2023-10-10T22:37:22.326514+0000","last_active":"2023-10-10T22:37:22.334236+0000","last_peered":"2023-10-10T22:37:22.334236+0000","last_clean":"2023-10-10T22:37:22.334236+0000","last_became_active":"2023-10-10T22:37:22.326241+0000","last_became_peered":"2023-10-10T22:37:22.326241+0000","last_unstale":"2023-10-10T22:37:22.334236+0000","last_undegraded":"2023-10-10T22:37:22.334236+0000","last_fullsized":"2023-10-10T22:37:22.334236+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.317579+0000","last_change":"2023-10-10T22:37:21.307712+0000","last_active":"2023-10-10T22:37:22.317579+0000","last_peered":"2023-10-10T22:37:22.317579+0000","last_clean":"2023-10-10T22:37:22.317579+0000","last_became_active":"2023-10-10T22:37:21.307419+0000","last_became_peered":"2023-10-10T22:37:21.307419+0000","last_unstale":"2023-10-10T22:37:22.317579+0000","last_undegraded":"2023-10-10T22:37:22.317579+0000","last_fullsized":"2023-10-10T22:37:22.317579+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:09:38.945874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332403+0000","last_change":"2023-10-10T22:37:22.327109+0000","last_active":"2023-10-10T22:37:22.332403+0000","last_peered":"2023-10-10T22:37:22.332403+0000","last_clean":"2023-10-10T22:37:22.332403+0000","last_became_active":"2023-10-10T22:37:22.326801+0000","last_became_peered":"2023-10-10T22:37:22.326801+0000","last_unstale":"2023-10-10T22:37:22.332403+0000","last_undegraded":"2023-10-10T22:37:22.332403+0000","last_fullsized":"2023-10-10T22:37:22.332403+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:38.738632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"208'3","reported_seq":13,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344456+0000","last_change":"2023-10-10T22:37:21.304909+0000","last_active":"2023-10-10T22:37:22.344456+0000","last_peered":"2023-10-10T22:37:22.344456+0000","last_clean":"2023-10-10T22:37:22.344456+0000","last_became_active":"2023-10-10T22:37:21.304642+0000","last_became_peered":"2023-10-10T22:37:21.304642+0000","last_unstale":"2023-10-10T22:37:22.344456+0000","last_undegraded":"2023-10-10T22:37:22.344456+0000","last_fullsized":"2023-10-10T22:37:22.344456+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:28:25.674622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341955+0000","last_change":"2023-10-10T22:37:22.332831+0000","last_active":"2023-10-10T22:37:22.341955+0000","last_peered":"2023-10-10T22:37:22.341955+0000","last_clean":"2023-10-10T22:37:22.341955+0000","last_became_active":"2023-10-10T22:37:22.332577+0000","last_became_peered":"2023-10-10T22:37:22.332577+0000","last_unstale":"2023-10-10T22:37:22.341955+0000","last_undegraded":"2023-10-10T22:37:22.341955+0000","last_fullsized":"2023-10-10T22:37:22.341955+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:49.337687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"208'6","reported_seq":16,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348666+0000","last_change":"2023-10-10T22:37:21.302443+0000","last_active":"2023-10-10T22:37:22.348666+0000","last_peered":"2023-10-10T22:37:22.348666+0000","last_clean":"2023-10-10T22:37:22.348666+0000","last_became_active":"2023-10-10T22:37:21.302148+0000","last_became_peered":"2023-10-10T22:37:21.302148+0000","last_unstale":"2023-10-10T22:37:22.348666+0000","last_undegraded":"2023-10-10T22:37:22.348666+0000","last_fullsized":"2023-10-10T22:37:22.348666+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:52:34.012755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329179+0000","last_change":"2023-10-10T22:37:22.327958+0000","last_active":"2023-10-10T22:37:22.329179+0000","last_peered":"2023-10-10T22:37:22.329179+0000","last_clean":"2023-10-10T22:37:22.329179+0000","last_became_active":"2023-10-10T22:37:22.327720+0000","last_became_peered":"2023-10-10T22:37:22.327720+0000","last_unstale":"2023-10-10T22:37:22.329179+0000","last_undegraded":"2023-10-10T22:37:22.329179+0000","last_fullsized":"2023-10-10T22:37:22.329179+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:12.272333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351731+0000","last_change":"2023-10-10T22:37:21.311578+0000","last_active":"2023-10-10T22:37:22.351731+0000","last_peered":"2023-10-10T22:37:22.351731+0000","last_clean":"2023-10-10T22:37:22.351731+0000","last_became_active":"2023-10-10T22:37:21.311276+0000","last_became_peered":"2023-10-10T22:37:21.311276+0000","last_unstale":"2023-10-10T22:37:22.351731+0000","last_undegraded":"2023-10-10T22:37:22.351731+0000","last_fullsized":"2023-10-10T22:37:22.351731+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:10:25.362844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332363+0000","last_change":"2023-10-10T22:37:22.327787+0000","last_active":"2023-10-10T22:37:22.332363+0000","last_peered":"2023-10-10T22:37:22.332363+0000","last_clean":"2023-10-10T22:37:22.332363+0000","last_became_active":"2023-10-10T22:37:22.327459+0000","last_became_peered":"2023-10-10T22:37:22.327459+0000","last_unstale":"2023-10-10T22:37:22.332363+0000","last_undegraded":"2023-10-10T22:37:22.332363+0000","last_fullsized":"2023-10-10T22:37:22.332363+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313273+0000","last_change":"2023-10-10T22:37:21.309120+0000","last_active":"2023-10-10T22:37:22.313273+0000","last_peered":"2023-10-10T22:37:22.313273+0000","last_clean":"2023-10-10T22:37:22.313273+0000","last_became_active":"2023-10-10T22:37:21.308861+0000","last_became_peered":"2023-10-10T22:37:21.308861+0000","last_unstale":"2023-10-10T22:37:22.313273+0000","last_undegraded":"2023-10-10T22:37:22.313273+0000","last_fullsized":"2023-10-10T22:37:22.313273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:13:59.242392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338319+0000","last_change":"2023-10-10T22:37:22.330901+0000","last_active":"2023-10-10T22:37:22.338319+0000","last_peered":"2023-10-10T22:37:22.338319+0000","last_clean":"2023-10-10T22:37:22.338319+0000","last_became_active":"2023-10-10T22:37:22.327027+0000","last_became_peered":"2023-10-10T22:37:22.327027+0000","last_unstale":"2023-10-10T22:37:22.338319+0000","last_undegraded":"2023-10-10T22:37:22.338319+0000","last_fullsized":"2023-10-10T22:37:22.338319+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323309+0000","last_change":"2023-10-10T22:37:21.313404+0000","last_active":"2023-10-10T22:37:22.323309+0000","last_peered":"2023-10-10T22:37:22.323309+0000","last_clean":"2023-10-10T22:37:22.323309+0000","last_became_active":"2023-10-10T22:37:21.313147+0000","last_became_peered":"2023-10-10T22:37:21.313147+0000","last_unstale":"2023-10-10T22:37:22.323309+0000","last_undegraded":"2023-10-10T22:37:22.323309+0000","last_fullsized":"2023-10-10T22:37:22.323309+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:59.610628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341852+0000","last_change":"2023-10-10T22:37:22.331938+0000","last_active":"2023-10-10T22:37:22.341852+0000","last_peered":"2023-10-10T22:37:22.341852+0000","last_clean":"2023-10-10T22:37:22.341852+0000","last_became_active":"2023-10-10T22:37:22.331427+0000","last_became_peered":"2023-10-10T22:37:22.331427+0000","last_unstale":"2023-10-10T22:37:22.341852+0000","last_undegraded":"2023-10-10T22:37:22.341852+0000","last_fullsized":"2023-10-10T22:37:22.341852+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"208'8","reported_seq":18,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351735+0000","last_change":"2023-10-10T22:37:21.312079+0000","last_active":"2023-10-10T22:37:22.351735+0000","last_peered":"2023-10-10T22:37:22.351735+0000","last_clean":"2023-10-10T22:37:22.351735+0000","last_became_active":"2023-10-10T22:37:21.311201+0000","last_became_peered":"2023-10-10T22:37:21.311201+0000","last_unstale":"2023-10-10T22:37:22.351735+0000","last_undegraded":"2023-10-10T22:37:22.351735+0000","last_fullsized":"2023-10-10T22:37:22.351735+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:46.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335508+0000","last_change":"2023-10-10T22:37:22.329719+0000","last_active":"2023-10-10T22:37:22.335508+0000","last_peered":"2023-10-10T22:37:22.335508+0000","last_clean":"2023-10-10T22:37:22.335508+0000","last_became_active":"2023-10-10T22:37:22.329479+0000","last_became_peered":"2023-10-10T22:37:22.329479+0000","last_unstale":"2023-10-10T22:37:22.335508+0000","last_undegraded":"2023-10-10T22:37:22.335508+0000","last_fullsized":"2023-10-10T22:37:22.335508+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344267+0000","last_change":"2023-10-10T22:37:21.307317+0000","last_active":"2023-10-10T22:37:22.344267+0000","last_peered":"2023-10-10T22:37:22.344267+0000","last_clean":"2023-10-10T22:37:22.344267+0000","last_became_active":"2023-10-10T22:37:21.307063+0000","last_became_peered":"2023-10-10T22:37:21.307063+0000","last_unstale":"2023-10-10T22:37:22.344267+0000","last_undegraded":"2023-10-10T22:37:22.344267+0000","last_fullsized":"2023-10-10T22:37:22.344267+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:44:04.204820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338262+0000","last_change":"2023-10-10T22:37:22.331546+0000","last_active":"2023-10-10T22:37:22.338262+0000","last_peered":"2023-10-10T22:37:22.338262+0000","last_clean":"2023-10-10T22:37:22.338262+0000","last_became_active":"2023-10-10T22:37:22.327510+0000","last_became_peered":"2023-10-10T22:37:22.327510+0000","last_unstale":"2023-10-10T22:37:22.338262+0000","last_undegraded":"2023-10-10T22:37:22.338262+0000","last_fullsized":"2023-10-10T22:37:22.338262+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346273+0000","last_change":"2023-10-10T22:37:21.315652+0000","last_active":"2023-10-10T22:37:22.346273+0000","last_peered":"2023-10-10T22:37:22.346273+0000","last_clean":"2023-10-10T22:37:22.346273+0000","last_became_active":"2023-10-10T22:37:21.315368+0000","last_became_peered":"2023-10-10T22:37:21.315368+0000","last_unstale":"2023-10-10T22:37:22.346273+0000","last_undegraded":"2023-10-10T22:37:22.346273+0000","last_fullsized":"2023-10-10T22:37:22.346273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:00:52.565481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343258+0000","last_change":"2023-10-10T22:37:22.334001+0000","last_active":"2023-10-10T22:37:22.343258+0000","last_peered":"2023-10-10T22:37:22.343258+0000","last_clean":"2023-10-10T22:37:22.343258+0000","last_became_active":"2023-10-10T22:37:22.333748+0000","last_became_peered":"2023-10-10T22:37:22.333748+0000","last_unstale":"2023-10-10T22:37:22.343258+0000","last_undegraded":"2023-10-10T22:37:22.343258+0000","last_fullsized":"2023-10-10T22:37:22.343258+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:33.316234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351642+0000","last_change":"2023-10-10T22:37:21.311600+0000","last_active":"2023-10-10T22:37:22.351642+0000","last_peered":"2023-10-10T22:37:22.351642+0000","last_clean":"2023-10-10T22:37:22.351642+0000","last_became_active":"2023-10-10T22:37:21.311310+0000","last_became_peered":"2023-10-10T22:37:21.311310+0000","last_unstale":"2023-10-10T22:37:22.351642+0000","last_undegraded":"2023-10-10T22:37:22.351642+0000","last_fullsized":"2023-10-10T22:37:22.351642+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:28.854458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325907+0000","last_change":"2023-10-10T22:37:21.308409+0000","last_active":"2023-10-10T22:37:22.325907+0000","last_peered":"2023-10-10T22:37:22.325907+0000","last_clean":"2023-10-10T22:37:22.325907+0000","last_became_active":"2023-10-10T22:37:21.308069+0000","last_became_peered":"2023-10-10T22:37:21.308069+0000","last_unstale":"2023-10-10T22:37:22.325907+0000","last_undegraded":"2023-10-10T22:37:22.325907+0000","last_fullsized":"2023-10-10T22:37:22.325907+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:55.439618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324866+0000","last_change":"2023-10-10T22:37:22.322788+0000","last_active":"2023-10-10T22:37:22.324866+0000","last_peered":"2023-10-10T22:37:22.324866+0000","last_clean":"2023-10-10T22:37:22.324866+0000","last_became_active":"2023-10-10T22:37:22.322526+0000","last_became_peered":"2023-10-10T22:37:22.322526+0000","last_unstale":"2023-10-10T22:37:22.324866+0000","last_undegraded":"2023-10-10T22:37:22.324866+0000","last_fullsized":"2023-10-10T22:37:22.324866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346717+0000","last_change":"2023-10-10T22:37:21.314705+0000","last_active":"2023-10-10T22:37:22.346717+0000","last_peered":"2023-10-10T22:37:22.346717+0000","last_clean":"2023-10-10T22:37:22.346717+0000","last_became_active":"2023-10-10T22:37:21.314394+0000","last_became_peered":"2023-10-10T22:37:21.314394+0000","last_unstale":"2023-10-10T22:37:22.346717+0000","last_undegraded":"2023-10-10T22:37:22.346717+0000","last_fullsized":"2023-10-10T22:37:22.346717+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:49.346015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.339779+0000","last_change":"2023-10-10T22:37:22.334339+0000","last_active":"2023-10-10T22:37:22.339779+0000","last_peered":"2023-10-10T22:37:22.339779+0000","last_clean":"2023-10-10T22:37:22.339779+0000","last_became_active":"2023-10-10T22:37:22.334070+0000","last_became_peered":"2023-10-10T22:37:22.334070+0000","last_unstale":"2023-10-10T22:37:22.339779+0000","last_undegraded":"2023-10-10T22:37:22.339779+0000","last_fullsized":"2023-10-10T22:37:22.339779+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316614+0000","last_change":"2023-10-10T22:37:21.308062+0000","last_active":"2023-10-10T22:37:22.316614+0000","last_peered":"2023-10-10T22:37:22.316614+0000","last_clean":"2023-10-10T22:37:22.316614+0000","last_became_active":"2023-10-10T22:37:21.307766+0000","last_became_peered":"2023-10-10T22:37:21.307766+0000","last_unstale":"2023-10-10T22:37:22.316614+0000","last_undegraded":"2023-10-10T22:37:22.316614+0000","last_fullsized":"2023-10-10T22:37:22.316614+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:17.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316751+0000","last_change":"2023-10-10T22:37:21.309163+0000","last_active":"2023-10-10T22:37:22.316751+0000","last_peered":"2023-10-10T22:37:22.316751+0000","last_clean":"2023-10-10T22:37:22.316751+0000","last_became_active":"2023-10-10T22:37:21.308910+0000","last_became_peered":"2023-10-10T22:37:21.308910+0000","last_unstale":"2023-10-10T22:37:22.316751+0000","last_undegraded":"2023-10-10T22:37:22.316751+0000","last_fullsized":"2023-10-10T22:37:22.316751+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:15:42.499573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322365+0000","last_change":"2023-10-10T22:37:22.321715+0000","last_active":"2023-10-10T22:37:22.322365+0000","last_peered":"2023-10-10T22:37:22.322365+0000","last_clean":"2023-10-10T22:37:22.322365+0000","last_became_active":"2023-10-10T22:37:22.321465+0000","last_became_peered":"2023-10-10T22:37:22.321465+0000","last_unstale":"2023-10-10T22:37:22.322365+0000","last_undegraded":"2023-10-10T22:37:22.322365+0000","last_fullsized":"2023-10-10T22:37:22.322365+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:03:49.499590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314924+0000","last_change":"2023-10-10T22:37:21.305255+0000","last_active":"2023-10-10T22:37:22.314924+0000","last_peered":"2023-10-10T22:37:22.314924+0000","last_clean":"2023-10-10T22:37:22.314924+0000","last_became_active":"2023-10-10T22:37:21.304967+0000","last_became_peered":"2023-10-10T22:37:21.304967+0000","last_unstale":"2023-10-10T22:37:22.314924+0000","last_undegraded":"2023-10-10T22:37:22.314924+0000","last_fullsized":"2023-10-10T22:37:22.314924+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:37.730832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.326134+0000","last_change":"2023-10-10T22:37:22.321857+0000","last_active":"2023-10-10T22:37:22.326134+0000","last_peered":"2023-10-10T22:37:22.326134+0000","last_clean":"2023-10-10T22:37:22.326134+0000","last_became_active":"2023-10-10T22:37:22.321606+0000","last_became_peered":"2023-10-10T22:37:22.321606+0000","last_unstale":"2023-10-10T22:37:22.326134+0000","last_undegraded":"2023-10-10T22:37:22.326134+0000","last_fullsized":"2023-10-10T22:37:22.326134+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:23.523345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348933+0000","last_change":"2023-10-10T22:37:21.313185+0000","last_active":"2023-10-10T22:37:22.348933+0000","last_peered":"2023-10-10T22:37:22.348933+0000","last_clean":"2023-10-10T22:37:22.348933+0000","last_became_active":"2023-10-10T22:37:21.313009+0000","last_became_peered":"2023-10-10T22:37:21.313009+0000","last_unstale":"2023-10-10T22:37:22.348933+0000","last_undegraded":"2023-10-10T22:37:22.348933+0000","last_fullsized":"2023-10-10T22:37:22.348933+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:42:23.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341866+0000","last_change":"2023-10-10T22:37:22.332898+0000","last_active":"2023-10-10T22:37:22.341866+0000","last_peered":"2023-10-10T22:37:22.341866+0000","last_clean":"2023-10-10T22:37:22.341866+0000","last_became_active":"2023-10-10T22:37:22.332640+0000","last_became_peered":"2023-10-10T22:37:22.332640+0000","last_unstale":"2023-10-10T22:37:22.341866+0000","last_undegraded":"2023-10-10T22:37:22.341866+0000","last_fullsized":"2023-10-10T22:37:22.341866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.312873+0000","last_change":"2023-10-10T22:37:21.305064+0000","last_active":"2023-10-10T22:37:22.312873+0000","last_peered":"2023-10-10T22:37:22.312873+0000","last_clean":"2023-10-10T22:37:22.312873+0000","last_became_active":"2023-10-10T22:37:21.304822+0000","last_became_peered":"2023-10-10T22:37:21.304822+0000","last_unstale":"2023-10-10T22:37:22.312873+0000","last_undegraded":"2023-10-10T22:37:22.312873+0000","last_fullsized":"2023-10-10T22:37:22.312873+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:53:36.582199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338517+0000","last_change":"2023-10-10T22:37:22.336111+0000","last_active":"2023-10-10T22:37:22.338517+0000","last_peered":"2023-10-10T22:37:22.338517+0000","last_clean":"2023-10-10T22:37:22.338517+0000","last_became_active":"2023-10-10T22:37:22.335816+0000","last_became_peered":"2023-10-10T22:37:22.335816+0000","last_unstale":"2023-10-10T22:37:22.338517+0000","last_undegraded":"2023-10-10T22:37:22.338517+0000","last_fullsized":"2023-10-10T22:37:22.338517+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:49:21.033563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313016+0000","last_change":"2023-10-10T22:37:21.305679+0000","last_active":"2023-10-10T22:37:22.313016+0000","last_peered":"2023-10-10T22:37:22.313016+0000","last_clean":"2023-10-10T22:37:22.313016+0000","last_became_active":"2023-10-10T22:37:21.305426+0000","last_became_peered":"2023-10-10T22:37:21.305426+0000","last_unstale":"2023-10-10T22:37:22.313016+0000","last_undegraded":"2023-10-10T22:37:22.313016+0000","last_fullsized":"2023-10-10T22:37:22.313016+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:09.257265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343285+0000","last_change":"2023-10-10T22:37:22.340538+0000","last_active":"2023-10-10T22:37:22.343285+0000","last_peered":"2023-10-10T22:37:22.343285+0000","last_clean":"2023-10-10T22:37:22.343285+0000","last_became_active":"2023-10-10T22:37:22.340297+0000","last_became_peered":"2023-10-10T22:37:22.340297+0000","last_unstale":"2023-10-10T22:37:22.343285+0000","last_undegraded":"2023-10-10T22:37:22.343285+0000","last_fullsized":"2023-10-10T22:37:22.343285+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:15:40.123577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323634+0000","last_change":"2023-10-10T22:37:21.315894+0000","last_active":"2023-10-10T22:37:22.323634+0000","last_peered":"2023-10-10T22:37:22.323634+0000","last_clean":"2023-10-10T22:37:22.323634+0000","last_became_active":"2023-10-10T22:37:21.315627+0000","last_became_peered":"2023-10-10T22:37:21.315627+0000","last_unstale":"2023-10-10T22:37:22.323634+0000","last_undegraded":"2023-10-10T22:37:22.323634+0000","last_fullsized":"2023-10-10T22:37:22.323634+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:57.625726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343203+0000","last_change":"2023-10-10T22:37:22.337620+0000","last_active":"2023-10-10T22:37:22.343203+0000","last_peered":"2023-10-10T22:37:22.343203+0000","last_clean":"2023-10-10T22:37:22.343203+0000","last_became_active":"2023-10-10T22:37:22.337376+0000","last_became_peered":"2023-10-10T22:37:22.337376+0000","last_unstale":"2023-10-10T22:37:22.343203+0000","last_undegraded":"2023-10-10T22:37:22.343203+0000","last_fullsized":"2023-10-10T22:37:22.343203+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:02:20.851800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316514+0000","last_change":"2023-10-10T22:37:21.306687+0000","last_active":"2023-10-10T22:37:22.316514+0000","last_peered":"2023-10-10T22:37:22.316514+0000","last_clean":"2023-10-10T22:37:22.316514+0000","last_became_active":"2023-10-10T22:37:21.306312+0000","last_became_peered":"2023-10-10T22:37:21.306312+0000","last_unstale":"2023-10-10T22:37:22.316514+0000","last_undegraded":"2023-10-10T22:37:22.316514+0000","last_fullsized":"2023-10-10T22:37:22.316514+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:12.421535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345813+0000","last_change":"2023-10-10T22:37:22.340754+0000","last_active":"2023-10-10T22:37:22.345813+0000","last_peered":"2023-10-10T22:37:22.345813+0000","last_clean":"2023-10-10T22:37:22.345813+0000","last_became_active":"2023-10-10T22:37:22.340438+0000","last_became_peered":"2023-10-10T22:37:22.340438+0000","last_unstale":"2023-10-10T22:37:22.345813+0000","last_undegraded":"2023-10-10T22:37:22.345813+0000","last_fullsized":"2023-10-10T22:37:22.345813+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:44:45.896568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314997+0000","last_change":"2023-10-10T22:37:21.305173+0000","last_active":"2023-10-10T22:37:22.314997+0000","last_peered":"2023-10-10T22:37:22.314997+0000","last_clean":"2023-10-10T22:37:22.314997+0000","last_became_active":"2023-10-10T22:37:21.304872+0000","last_became_peered":"2023-10-10T22:37:21.304872+0000","last_unstale":"2023-10-10T22:37:22.314997+0000","last_undegraded":"2023-10-10T22:37:22.314997+0000","last_fullsized":"2023-10-10T22:37:22.314997+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:44.345013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:37:20.275583+0000","last_change":"2023-10-10T22:37:20.290722+0000","last_active":"2023-10-10T22:37:20.275583+0000","last_peered":"2023-10-10T22:37:20.275583+0000","last_clean":"2023-10-10T22:37:20.275583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:20.275583+0000","last_undegraded":"2023-10-10T22:37:20.275583+0000","last_fullsized":"2023-10-10T22:37:20.275583+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:54:55.230815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335239+0000","last_change":"2023-10-10T22:37:22.332348+0000","last_active":"2023-10-10T22:37:22.335239+0000","last_peered":"2023-10-10T22:37:22.335239+0000","last_clean":"2023-10-10T22:37:22.335239+0000","last_became_active":"2023-10-10T22:37:22.332119+0000","last_became_peered":"2023-10-10T22:37:22.332119+0000","last_unstale":"2023-10-10T22:37:22.335239+0000","last_undegraded":"2023-10-10T22:37:22.335239+0000","last_fullsized":"2023-10-10T22:37:22.335239+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:56.404086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.315755+0000","last_change":"2023-10-10T22:37:21.308580+0000","last_active":"2023-10-10T22:37:22.315755+0000","last_peered":"2023-10-10T22:37:22.315755+0000","last_clean":"2023-10-10T22:37:22.315755+0000","last_became_active":"2023-10-10T22:37:21.308346+0000","last_became_peered":"2023-10-10T22:37:21.308346+0000","last_unstale":"2023-10-10T22:37:22.315755+0000","last_undegraded":"2023-10-10T22:37:22.315755+0000","last_fullsized":"2023-10-10T22:37:22.315755+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:22.763388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330445+0000","last_change":"2023-10-10T22:37:22.326456+0000","last_active":"2023-10-10T22:37:22.330445+0000","last_peered":"2023-10-10T22:37:22.330445+0000","last_clean":"2023-10-10T22:37:22.330445+0000","last_became_active":"2023-10-10T22:37:22.326179+0000","last_became_peered":"2023-10-10T22:37:22.326179+0000","last_unstale":"2023-10-10T22:37:22.330445+0000","last_undegraded":"2023-10-10T22:37:22.330445+0000","last_fullsized":"2023-10-10T22:37:22.330445+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:34:29.226879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324236+0000","last_change":"2023-10-10T22:37:21.309121+0000","last_active":"2023-10-10T22:37:22.324236+0000","last_peered":"2023-10-10T22:37:22.324236+0000","last_clean":"2023-10-10T22:37:22.324236+0000","last_became_active":"2023-10-10T22:37:21.308062+0000","last_became_peered":"2023-10-10T22:37:21.308062+0000","last_unstale":"2023-10-10T22:37:22.324236+0000","last_undegraded":"2023-10-10T22:37:22.324236+0000","last_fullsized":"2023-10-10T22:37:22.324236+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:34.472180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1145,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324105+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:37:22.324105+0000","last_peered":"2023-10-10T22:37:22.324105+0000","last_clean":"2023-10-10T22:37:22.324105+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:37:22.324105+0000","last_undegraded":"2023-10-10T22:37:22.324105+0000","last_fullsized":"2023-10-10T22:37:22.324105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543275,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312716,"kb_used_data":3140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059124,"statfs":{"total":96636764160,"available":96316542976,"internally_reserved":0,"allocated":3215360,"data_stored":1905675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.026},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":1.073,"15min":1.081},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":1.145,"15min":1.145},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":1.0700000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.59899999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":1.0009999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.503,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.878}]},{"osd":4,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":0.82299999999999995,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":1.012},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.91800000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.024},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":0.999,"15min":1.079},"last":0.78700000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.042},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.86199999999999999,"5min":1.046,"15min":1.125},"last":0.95399999999999996}]}]},{"osd":6,"up_from":14,"seq":60129543273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299792,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072048,"statfs":{"total":96636764160,"available":96329777152,"internally_reserved":0,"allocated":2564096,"data_stored":1288004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":1.0289999999999999,"15min":1.1080000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.751},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.0920000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.64500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94299999999999995,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.034,"15min":1.1200000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.0660000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.621,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91200000000000003,"5min":0.97399999999999998,"15min":1.071},"last":0.80500000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":1.778,"15min":1.778},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.86899999999999999,"5min":0.996,"15min":1.046},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97299999999999998,"5min":1.827,"15min":1.827},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.754}]}]},{"osd":1,"up_from":14,"seq":60129543274,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1316739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.379},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.82999999999999996,"15min":0.88},"last":0.435}]},{"osd":2,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.878,"15min":0.90800000000000003},"last":0.504},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.88800000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.74399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.995,"5min":1.0269999999999999,"15min":1.177},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.008,"5min":1.089,"15min":1.1419999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.2450000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.64300000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.081,"5min":1.1200000000000001,"15min":1.2729999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.155},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.68600000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.2230000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308616,"kb_used_data":3136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063224,"statfs":{"total":96636764160,"available":96320741376,"internally_reserved":0,"allocated":3211264,"data_stored":1905593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.71399999999999997,"15min":0.753},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.433}]},{"osd":2,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.76000000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.85299999999999998},"last":0.501}]},{"osd":3,"last update":"Tue Oct 10 22:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.81100000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0469999999999999,"5min":1.1180000000000001,"15min":1.3340000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.1479999999999999,"15min":1.198},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56899999999999995},"max":{"1min":1.0449999999999999,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.625,"5min":0.54800000000000004,"15min":0.54500000000000004},"max":{"1min":1.1439999999999999,"5min":1.3320000000000001,"15min":1.377},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0449999999999999,"5min":1.274,"15min":1.427},"last":0.81999999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.198,"5min":1.224,"15min":1.2689999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.081,"5min":1.153,"15min":1.153},"last":0.83999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316236,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055604,"statfs":{"total":96636764160,"available":96312938496,"internally_reserved":0,"allocated":2625536,"data_stored":1315869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.317},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.89500000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.85699999999999998,"15min":0.85799999999999998},"last":0.438},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.101,"15min":1.288},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98599999999999999,"5min":1.1220000000000001,"15min":1.325},"last":0.77300000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.147,"15min":1.1970000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82199999999999995,"15min":0.84099999999999997},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.054,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.26},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.093,"5min":1.165,"15min":1.3129999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80600000000000005,"15min":0.83199999999999996},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.181,"15min":1.2609999999999999},"last":0.871}]}]},{"osd":3,"up_from":15,"seq":64424510571,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1315397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.877,"15min":0.877},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.70599999999999996,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":0.99399999999999999},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.04,"5min":1.133,"15min":1.242},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.202,"15min":1.2629999999999999},"last":0.96499999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.125,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":1.1040000000000001,"15min":1.222},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.099,"5min":1.1539999999999999,"15min":1.212},"last":0.89900000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.54200000000000004},"max":{"1min":0.98899999999999999,"5min":1.274,"15min":1.274},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":0.83499999999999996},"min":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56699999999999995},"max":{"1min":1.097,"5min":1.149,"15min":1.2370000000000001},"last":0.69699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129543276,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1317293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.087},"last":0.435},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.752},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.437},"max":{"1min":0.94099999999999995,"5min":0.95199999999999996,"15min":1.1220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88500000000000001,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.998,"15min":1.073},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.089},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.45200000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.4079999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":1.282},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.94099999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.94099999999999995,"15min":1.0900000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.42199999999999999},"max":{"1min":0.82099999999999995,"5min":0.89600000000000002,"15min":1.0649999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.92100000000000004,"5min":0.96999999999999997,"15min":1.21},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.436},"max":{"1min":0.97399999999999998,"5min":0.97999999999999998,"15min":1.147},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543274,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1315203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":1.006},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.48199999999999998,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.997},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65500000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.98999999999999999,"15min":1.04},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.02},"last":0.76000000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.37},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.01,"5min":1.01,"15min":1.032},"last":0.749}]},{"osd":7,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.623},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.02},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:37:27.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:37:27.280 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-10-10T22:37:27.278+0000 7fba7a9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T22:37:27.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.321+0000 7efd449fe700 1 Processor -- start 2023-10-10T22:37:27.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.321+0000 7efd449fe700 1 -- start start 2023-10-10T22:37:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.322+0000 7efd449fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efd40159420 0x7efd400b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.322+0000 7efd449fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd401597f0 0x7efd400b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.322+0000 7efd449fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd400b11d0 con 0x7efd4015d230 2023-10-10T22:37:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.322+0000 7efd449fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd400b14b0 con 0x7efd401597f0 2023-10-10T22:37:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.322+0000 7efd449fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd400b1790 con 0x7efd40159420 2023-10-10T22:37:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.322+0000 7efd3e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd401597f0 0x7efd400b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.322+0000 7efd3e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd401597f0 0x7efd400b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33164/0 (socket says 172.21.15.154:33164) 2023-10-10T22:37:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.322+0000 7efd3e59c700 1 -- 172.21.15.154:0/3168827264 learned_addr learned my addr 172.21.15.154:0/3168827264 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.322+0000 7efd3f59e700 1 --1- 172.21.15.154:0/3168827264 >> v1:172.21.15.154:6789/0 conn(0x7efd4015d230 0x7efd4015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41108/0 (socket says 172.21.15.154:41108) 2023-10-10T22:37:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3ed9d700 1 --2- 172.21.15.154:0/3168827264 >> v2:172.21.15.179:3300/0 conn(0x7efd40159420 0x7efd400b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3e59c700 1 -- 172.21.15.154:0/3168827264 >> v2:172.21.15.179:3300/0 conn(0x7efd40159420 msgr2=0x7efd400b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3e59c700 1 --2- 172.21.15.154:0/3168827264 >> v2:172.21.15.179:3300/0 conn(0x7efd40159420 0x7efd400b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3e59c700 1 -- 172.21.15.154:0/3168827264 >> v1:172.21.15.154:6789/0 conn(0x7efd4015d230 legacy=0x7efd4015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3e59c700 1 -- 172.21.15.154:0/3168827264 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd400b1a70 con 0x7efd401597f0 2023-10-10T22:37:27.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3dd9b700 1 -- 172.21.15.154:0/3168827264 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128564772 0 0) 0x7efd400b11d0 con 0x7efd4015d230 2023-10-10T22:37:27.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3e59c700 1 --2- 172.21.15.154:0/3168827264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd401597f0 0x7efd400b2270 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7efd400b2f20 tx=0x7efd34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b614166369462b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:27.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3dd9b700 1 -- 172.21.15.154:0/3168827264 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3400b860 con 0x7efd401597f0 2023-10-10T22:37:27.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3dd9b700 1 -- 172.21.15.154:0/3168827264 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3400b9c0 con 0x7efd401597f0 2023-10-10T22:37:27.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.323+0000 7efd3dd9b700 1 -- 172.21.15.154:0/3168827264 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3400bd60 con 0x7efd401597f0 2023-10-10T22:37:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.324+0000 7efd449fe700 1 -- 172.21.15.154:0/3168827264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd401597f0 msgr2=0x7efd400b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.324+0000 7efd449fe700 1 --2- 172.21.15.154:0/3168827264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd401597f0 0x7efd400b2270 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7efd400b2f20 tx=0x7efd34009250 comp rx=0 tx=0).stop 2023-10-10T22:37:27.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.324+0000 7efd449fe700 1 -- 172.21.15.154:0/3168827264 shutdown_connections 2023-10-10T22:37:27.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.324+0000 7efd449fe700 1 --2- 172.21.15.154:0/3168827264 >> v2:172.21.15.179:3300/0 conn(0x7efd40159420 0x7efd400b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.324+0000 7efd449fe700 1 --2- 172.21.15.154:0/3168827264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd401597f0 0x7efd400b2270 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.324+0000 7efd449fe700 1 -- 172.21.15.154:0/3168827264 >> 172.21.15.154:0/3168827264 conn(0x7efd400d0660 msgr2=0x7efd400d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:27.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.324+0000 7efd449fe700 1 -- 172.21.15.154:0/3168827264 shutdown_connections 2023-10-10T22:37:27.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.324+0000 7efd449fe700 1 -- 172.21.15.154:0/3168827264 wait complete. 2023-10-10T22:37:27.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.325+0000 7efd449fe700 1 Processor -- start 2023-10-10T22:37:27.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.326+0000 7efd449fe700 1 -- start start 2023-10-10T22:37:27.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.326+0000 7efd449fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40159420 0x7efd40154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.326+0000 7efd449fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd401597f0 0x7efd4015c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.326+0000 7efd449fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4015d230 0x7efd40155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.326+0000 7efd449fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c61b0 con 0x7efd4015d230 2023-10-10T22:37:27.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.326+0000 7efd449fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c55a0 con 0x7efd401597f0 2023-10-10T22:37:27.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.326+0000 7efd449fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c5880 con 0x7efd40159420 2023-10-10T22:37:27.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4015d230 0x7efd40155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4015d230 0x7efd40155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33170/0 (socket says 172.21.15.154:33170) 2023-10-10T22:37:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3f59e700 1 -- 172.21.15.154:0/3324888752 learned_addr learned my addr 172.21.15.154:0/3324888752 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3e59c700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd401597f0 0x7efd4015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3ed9d700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40159420 0x7efd40154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3f59e700 1 -- 172.21.15.154:0/3324888752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40159420 msgr2=0x7efd40154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3f59e700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40159420 0x7efd40154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3f59e700 1 -- 172.21.15.154:0/3324888752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd401597f0 msgr2=0x7efd4015c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3f59e700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd401597f0 0x7efd4015c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.327+0000 7efd3f59e700 1 -- 172.21.15.154:0/3324888752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340094f0 con 0x7efd4015d230 2023-10-10T22:37:27.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.328+0000 7efd3f59e700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4015d230 0x7efd40155c30 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7efd3800ccc0 tx=0x7efd38001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.328+0000 7efd26ffd700 1 -- 172.21.15.154:0/3324888752 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38005df0 con 0x7efd4015d230 2023-10-10T22:37:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.328+0000 7efd26ffd700 1 -- 172.21.15.154:0/3324888752 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3800a920 con 0x7efd4015d230 2023-10-10T22:37:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.328+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd400c5b60 con 0x7efd4015d230 2023-10-10T22:37:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.328+0000 7efd26ffd700 1 -- 172.21.15.154:0/3324888752 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3800ace0 con 0x7efd4015d230 2023-10-10T22:37:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.328+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd40154780 con 0x7efd4015d230 2023-10-10T22:37:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.329+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd400c6320 con 0x7efd4015d230 2023-10-10T22:37:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.330+0000 7efd26ffd700 1 -- 172.21.15.154:0/3324888752 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd38007300 con 0x7efd4015d230 2023-10-10T22:37:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.331+0000 7efd26ffd700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7efd2c066f30 0x7efd2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.331+0000 7efd26ffd700 1 -- 172.21.15.154:0/3324888752 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7efd38084880 con 0x7efd4015d230 2023-10-10T22:37:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.331+0000 7efd3ed9d700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7efd2c066f30 0x7efd2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.332+0000 7efd3ed9d700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7efd2c066f30 0x7efd2c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd30006fd0 tx=0x7efd30008040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.335+0000 7efd26ffd700 1 -- 172.21.15.154:0/3324888752 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd38051960 con 0x7efd4015d230 2023-10-10T22:37:27.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.527+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd4004c3c0 con 0x7efd2c066f30 2023-10-10T22:37:27.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.536+0000 7efd26ffd700 1 -- 172.21.15.154:0/3324888752 <== mgr.9999 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288056 (secure 0 0 0) 0x7efd4004c3c0 con 0x7efd2c066f30 2023-10-10T22:37:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:27.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.540+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7efd2c066f30 msgr2=0x7efd2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.540+0000 7efd449fe700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7efd2c066f30 0x7efd2c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd30006fd0 tx=0x7efd30008040 comp rx=0 tx=0).stop 2023-10-10T22:37:27.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.540+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4015d230 msgr2=0x7efd40155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.540+0000 7efd449fe700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4015d230 0x7efd40155c30 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7efd3800ccc0 tx=0x7efd38001a40 comp rx=0 tx=0).stop 2023-10-10T22:37:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.540+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 shutdown_connections 2023-10-10T22:37:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.540+0000 7efd449fe700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7efd2c066f30 0x7efd2c0693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.540+0000 7efd449fe700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4015d230 0x7efd40155c30 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.540+0000 7efd449fe700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40159420 0x7efd40154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.540+0000 7efd449fe700 1 --2- 172.21.15.154:0/3324888752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd401597f0 0x7efd4015c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.541+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 >> 172.21.15.154:0/3324888752 conn(0x7efd400d0660 msgr2=0x7efd40069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:27.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.541+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 shutdown_connections 2023-10-10T22:37:27.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.541+0000 7efd449fe700 1 -- 172.21.15.154:0/3324888752 wait complete. 2023-10-10T22:37:27.549 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:37:27.561 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:37:25.898457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":620,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":384,"ondisk_log_size":384,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461336,"kb_used_data":21592,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752513384,"statfs":{"total":773094113280,"available":770573705216,"internally_reserved":0,"allocated":22110208,"data_stored":11679773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.612642"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343085+0000","last_change":"2023-10-10T22:37:22.336242+0000","last_active":"2023-10-10T22:37:22.343085+0000","last_peered":"2023-10-10T22:37:22.343085+0000","last_clean":"2023-10-10T22:37:22.343085+0000","last_became_active":"2023-10-10T22:37:22.335965+0000","last_became_peered":"2023-10-10T22:37:22.335965+0000","last_unstale":"2023-10-10T22:37:22.343085+0000","last_undegraded":"2023-10-10T22:37:22.343085+0000","last_fullsized":"2023-10-10T22:37:22.343085+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:32:15.779372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330213+0000","last_change":"2023-10-10T22:37:22.323947+0000","last_active":"2023-10-10T22:37:22.330213+0000","last_peered":"2023-10-10T22:37:22.330213+0000","last_clean":"2023-10-10T22:37:22.330213+0000","last_became_active":"2023-10-10T22:37:22.323685+0000","last_became_peered":"2023-10-10T22:37:22.323685+0000","last_unstale":"2023-10-10T22:37:22.330213+0000","last_undegraded":"2023-10-10T22:37:22.330213+0000","last_fullsized":"2023-10-10T22:37:22.330213+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:54:16.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331732+0000","last_change":"2023-10-10T22:37:22.329074+0000","last_active":"2023-10-10T22:37:22.331732+0000","last_peered":"2023-10-10T22:37:22.331732+0000","last_clean":"2023-10-10T22:37:22.331732+0000","last_became_active":"2023-10-10T22:37:22.328756+0000","last_became_peered":"2023-10-10T22:37:22.328756+0000","last_unstale":"2023-10-10T22:37:22.331732+0000","last_undegraded":"2023-10-10T22:37:22.331732+0000","last_fullsized":"2023-10-10T22:37:22.331732+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:55:55.816244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345969+0000","last_change":"2023-10-10T22:37:22.341498+0000","last_active":"2023-10-10T22:37:22.345969+0000","last_peered":"2023-10-10T22:37:22.345969+0000","last_clean":"2023-10-10T22:37:22.345969+0000","last_became_active":"2023-10-10T22:37:22.341255+0000","last_became_peered":"2023-10-10T22:37:22.341255+0000","last_unstale":"2023-10-10T22:37:22.345969+0000","last_undegraded":"2023-10-10T22:37:22.345969+0000","last_fullsized":"2023-10-10T22:37:22.345969+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:32:00.612130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338966+0000","last_change":"2023-10-10T22:37:22.328393+0000","last_active":"2023-10-10T22:37:22.338966+0000","last_peered":"2023-10-10T22:37:22.338966+0000","last_clean":"2023-10-10T22:37:22.338966+0000","last_became_active":"2023-10-10T22:37:22.328101+0000","last_became_peered":"2023-10-10T22:37:22.328101+0000","last_unstale":"2023-10-10T22:37:22.338966+0000","last_undegraded":"2023-10-10T22:37:22.338966+0000","last_fullsized":"2023-10-10T22:37:22.338966+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:35:42.499747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336008+0000","last_change":"2023-10-10T22:37:22.331181+0000","last_active":"2023-10-10T22:37:22.336008+0000","last_peered":"2023-10-10T22:37:22.336008+0000","last_clean":"2023-10-10T22:37:22.336008+0000","last_became_active":"2023-10-10T22:37:22.330824+0000","last_became_peered":"2023-10-10T22:37:22.330824+0000","last_unstale":"2023-10-10T22:37:22.336008+0000","last_undegraded":"2023-10-10T22:37:22.336008+0000","last_fullsized":"2023-10-10T22:37:22.336008+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:29.396879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338211+0000","last_change":"2023-10-10T22:37:22.331320+0000","last_active":"2023-10-10T22:37:22.338211+0000","last_peered":"2023-10-10T22:37:22.338211+0000","last_clean":"2023-10-10T22:37:22.338211+0000","last_became_active":"2023-10-10T22:37:22.331052+0000","last_became_peered":"2023-10-10T22:37:22.331052+0000","last_unstale":"2023-10-10T22:37:22.338211+0000","last_undegraded":"2023-10-10T22:37:22.338211+0000","last_fullsized":"2023-10-10T22:37:22.338211+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325713+0000","last_change":"2023-10-10T22:37:22.325204+0000","last_active":"2023-10-10T22:37:22.325713+0000","last_peered":"2023-10-10T22:37:22.325713+0000","last_clean":"2023-10-10T22:37:22.325713+0000","last_became_active":"2023-10-10T22:37:22.321688+0000","last_became_peered":"2023-10-10T22:37:22.321688+0000","last_unstale":"2023-10-10T22:37:22.325713+0000","last_undegraded":"2023-10-10T22:37:22.325713+0000","last_fullsized":"2023-10-10T22:37:22.325713+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344561+0000","last_change":"2023-10-10T22:37:22.342230+0000","last_active":"2023-10-10T22:37:22.344561+0000","last_peered":"2023-10-10T22:37:22.344561+0000","last_clean":"2023-10-10T22:37:22.344561+0000","last_became_active":"2023-10-10T22:37:22.341026+0000","last_became_peered":"2023-10-10T22:37:22.341026+0000","last_unstale":"2023-10-10T22:37:22.344561+0000","last_undegraded":"2023-10-10T22:37:22.344561+0000","last_fullsized":"2023-10-10T22:37:22.344561+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:10.388326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343351+0000","last_change":"2023-10-10T22:37:22.331950+0000","last_active":"2023-10-10T22:37:22.343351+0000","last_peered":"2023-10-10T22:37:22.343351+0000","last_clean":"2023-10-10T22:37:22.343351+0000","last_became_active":"2023-10-10T22:37:22.327964+0000","last_became_peered":"2023-10-10T22:37:22.327964+0000","last_unstale":"2023-10-10T22:37:22.343351+0000","last_undegraded":"2023-10-10T22:37:22.343351+0000","last_fullsized":"2023-10-10T22:37:22.343351+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:29.862257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343867+0000","last_change":"2023-10-10T22:37:22.341039+0000","last_active":"2023-10-10T22:37:22.343867+0000","last_peered":"2023-10-10T22:37:22.343867+0000","last_clean":"2023-10-10T22:37:22.343867+0000","last_became_active":"2023-10-10T22:37:22.340752+0000","last_became_peered":"2023-10-10T22:37:22.340752+0000","last_unstale":"2023-10-10T22:37:22.343867+0000","last_undegraded":"2023-10-10T22:37:22.343867+0000","last_fullsized":"2023-10-10T22:37:22.343867+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:31:20.851558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332530+0000","last_change":"2023-10-10T22:37:22.330693+0000","last_active":"2023-10-10T22:37:22.332530+0000","last_peered":"2023-10-10T22:37:22.332530+0000","last_clean":"2023-10-10T22:37:22.332530+0000","last_became_active":"2023-10-10T22:37:22.330422+0000","last_became_peered":"2023-10-10T22:37:22.330422+0000","last_unstale":"2023-10-10T22:37:22.332530+0000","last_undegraded":"2023-10-10T22:37:22.332530+0000","last_fullsized":"2023-10-10T22:37:22.332530+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:15.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347291+0000","last_change":"2023-10-10T22:37:22.344903+0000","last_active":"2023-10-10T22:37:22.347291+0000","last_peered":"2023-10-10T22:37:22.347291+0000","last_clean":"2023-10-10T22:37:22.347291+0000","last_became_active":"2023-10-10T22:37:22.344568+0000","last_became_peered":"2023-10-10T22:37:22.344568+0000","last_unstale":"2023-10-10T22:37:22.347291+0000","last_undegraded":"2023-10-10T22:37:22.347291+0000","last_fullsized":"2023-10-10T22:37:22.347291+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:29:17.224764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331152+0000","last_change":"2023-10-10T22:37:22.327814+0000","last_active":"2023-10-10T22:37:22.331152+0000","last_peered":"2023-10-10T22:37:22.331152+0000","last_clean":"2023-10-10T22:37:22.331152+0000","last_became_active":"2023-10-10T22:37:22.327483+0000","last_became_peered":"2023-10-10T22:37:22.327483+0000","last_unstale":"2023-10-10T22:37:22.331152+0000","last_undegraded":"2023-10-10T22:37:22.331152+0000","last_fullsized":"2023-10-10T22:37:22.331152+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335425+0000","last_change":"2023-10-10T22:37:22.331782+0000","last_active":"2023-10-10T22:37:22.335425+0000","last_peered":"2023-10-10T22:37:22.335425+0000","last_clean":"2023-10-10T22:37:22.335425+0000","last_became_active":"2023-10-10T22:37:22.331529+0000","last_became_peered":"2023-10-10T22:37:22.331529+0000","last_unstale":"2023-10-10T22:37:22.335425+0000","last_undegraded":"2023-10-10T22:37:22.335425+0000","last_fullsized":"2023-10-10T22:37:22.335425+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:51.371588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330940+0000","last_change":"2023-10-10T22:37:22.327219+0000","last_active":"2023-10-10T22:37:22.330940+0000","last_peered":"2023-10-10T22:37:22.330940+0000","last_clean":"2023-10-10T22:37:22.330940+0000","last_became_active":"2023-10-10T22:37:22.326966+0000","last_became_peered":"2023-10-10T22:37:22.326966+0000","last_unstale":"2023-10-10T22:37:22.330940+0000","last_undegraded":"2023-10-10T22:37:22.330940+0000","last_fullsized":"2023-10-10T22:37:22.330940+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:43:29.646719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331376+0000","last_change":"2023-10-10T22:37:22.327933+0000","last_active":"2023-10-10T22:37:22.331376+0000","last_peered":"2023-10-10T22:37:22.331376+0000","last_clean":"2023-10-10T22:37:22.331376+0000","last_became_active":"2023-10-10T22:37:22.327538+0000","last_became_peered":"2023-10-10T22:37:22.327538+0000","last_unstale":"2023-10-10T22:37:22.331376+0000","last_undegraded":"2023-10-10T22:37:22.331376+0000","last_fullsized":"2023-10-10T22:37:22.331376+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:17.366872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329720+0000","last_change":"2023-10-10T22:37:22.328638+0000","last_active":"2023-10-10T22:37:22.329720+0000","last_peered":"2023-10-10T22:37:22.329720+0000","last_clean":"2023-10-10T22:37:22.329720+0000","last_became_active":"2023-10-10T22:37:22.328375+0000","last_became_peered":"2023-10-10T22:37:22.328375+0000","last_unstale":"2023-10-10T22:37:22.329720+0000","last_undegraded":"2023-10-10T22:37:22.329720+0000","last_fullsized":"2023-10-10T22:37:22.329720+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:56.447417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336027+0000","last_change":"2023-10-10T22:37:22.332011+0000","last_active":"2023-10-10T22:37:22.336027+0000","last_peered":"2023-10-10T22:37:22.336027+0000","last_clean":"2023-10-10T22:37:22.336027+0000","last_became_active":"2023-10-10T22:37:22.331741+0000","last_became_peered":"2023-10-10T22:37:22.331741+0000","last_unstale":"2023-10-10T22:37:22.336027+0000","last_undegraded":"2023-10-10T22:37:22.336027+0000","last_fullsized":"2023-10-10T22:37:22.336027+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:27.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338828+0000","last_change":"2023-10-10T22:37:22.333229+0000","last_active":"2023-10-10T22:37:22.338828+0000","last_peered":"2023-10-10T22:37:22.338828+0000","last_clean":"2023-10-10T22:37:22.338828+0000","last_became_active":"2023-10-10T22:37:22.332677+0000","last_became_peered":"2023-10-10T22:37:22.332677+0000","last_unstale":"2023-10-10T22:37:22.338828+0000","last_undegraded":"2023-10-10T22:37:22.338828+0000","last_fullsized":"2023-10-10T22:37:22.338828+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:43:41.226417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345995+0000","last_change":"2023-10-10T22:37:22.342096+0000","last_active":"2023-10-10T22:37:22.345995+0000","last_peered":"2023-10-10T22:37:22.345995+0000","last_clean":"2023-10-10T22:37:22.345995+0000","last_became_active":"2023-10-10T22:37:22.341851+0000","last_became_peered":"2023-10-10T22:37:22.341851+0000","last_unstale":"2023-10-10T22:37:22.345995+0000","last_undegraded":"2023-10-10T22:37:22.345995+0000","last_fullsized":"2023-10-10T22:37:22.345995+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:28:15.665680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332513+0000","last_change":"2023-10-10T22:37:22.329649+0000","last_active":"2023-10-10T22:37:22.332513+0000","last_peered":"2023-10-10T22:37:22.332513+0000","last_clean":"2023-10-10T22:37:22.332513+0000","last_became_active":"2023-10-10T22:37:22.329396+0000","last_became_peered":"2023-10-10T22:37:22.329396+0000","last_unstale":"2023-10-10T22:37:22.332513+0000","last_undegraded":"2023-10-10T22:37:22.332513+0000","last_fullsized":"2023-10-10T22:37:22.332513+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:13:12.738082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343386+0000","last_change":"2023-10-10T22:37:22.336423+0000","last_active":"2023-10-10T22:37:22.343386+0000","last_peered":"2023-10-10T22:37:22.343386+0000","last_clean":"2023-10-10T22:37:22.343386+0000","last_became_active":"2023-10-10T22:37:22.336115+0000","last_became_peered":"2023-10-10T22:37:22.336115+0000","last_unstale":"2023-10-10T22:37:22.343386+0000","last_undegraded":"2023-10-10T22:37:22.343386+0000","last_fullsized":"2023-10-10T22:37:22.343386+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329138+0000","last_change":"2023-10-10T22:37:22.326865+0000","last_active":"2023-10-10T22:37:22.329138+0000","last_peered":"2023-10-10T22:37:22.329138+0000","last_clean":"2023-10-10T22:37:22.329138+0000","last_became_active":"2023-10-10T22:37:22.326560+0000","last_became_peered":"2023-10-10T22:37:22.326560+0000","last_unstale":"2023-10-10T22:37:22.329138+0000","last_undegraded":"2023-10-10T22:37:22.329138+0000","last_fullsized":"2023-10-10T22:37:22.329138+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:16.097777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332570+0000","last_change":"2023-10-10T22:37:22.331211+0000","last_active":"2023-10-10T22:37:22.332570+0000","last_peered":"2023-10-10T22:37:22.332570+0000","last_clean":"2023-10-10T22:37:22.332570+0000","last_became_active":"2023-10-10T22:37:22.330969+0000","last_became_peered":"2023-10-10T22:37:22.330969+0000","last_unstale":"2023-10-10T22:37:22.332570+0000","last_undegraded":"2023-10-10T22:37:22.332570+0000","last_fullsized":"2023-10-10T22:37:22.332570+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:13.075740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343255+0000","last_change":"2023-10-10T22:37:22.340035+0000","last_active":"2023-10-10T22:37:22.343255+0000","last_peered":"2023-10-10T22:37:22.343255+0000","last_clean":"2023-10-10T22:37:22.343255+0000","last_became_active":"2023-10-10T22:37:22.339704+0000","last_became_peered":"2023-10-10T22:37:22.339704+0000","last_unstale":"2023-10-10T22:37:22.343255+0000","last_undegraded":"2023-10-10T22:37:22.343255+0000","last_fullsized":"2023-10-10T22:37:22.343255+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:57.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"208'4","reported_seq":14,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345983+0000","last_change":"2023-10-10T22:37:21.300780+0000","last_active":"2023-10-10T22:37:22.345983+0000","last_peered":"2023-10-10T22:37:22.345983+0000","last_clean":"2023-10-10T22:37:22.345983+0000","last_became_active":"2023-10-10T22:37:21.300530+0000","last_became_peered":"2023-10-10T22:37:21.300530+0000","last_unstale":"2023-10-10T22:37:22.345983+0000","last_undegraded":"2023-10-10T22:37:22.345983+0000","last_fullsized":"2023-10-10T22:37:22.345983+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:17.662491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325583+0000","last_change":"2023-10-10T22:37:22.324305+0000","last_active":"2023-10-10T22:37:22.325583+0000","last_peered":"2023-10-10T22:37:22.325583+0000","last_clean":"2023-10-10T22:37:22.325583+0000","last_became_active":"2023-10-10T22:37:22.324056+0000","last_became_peered":"2023-10-10T22:37:22.324056+0000","last_unstale":"2023-10-10T22:37:22.325583+0000","last_undegraded":"2023-10-10T22:37:22.325583+0000","last_fullsized":"2023-10-10T22:37:22.325583+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347552+0000","last_change":"2023-10-10T22:37:21.308912+0000","last_active":"2023-10-10T22:37:22.347552+0000","last_peered":"2023-10-10T22:37:22.347552+0000","last_clean":"2023-10-10T22:37:22.347552+0000","last_became_active":"2023-10-10T22:37:21.308582+0000","last_became_peered":"2023-10-10T22:37:21.308582+0000","last_unstale":"2023-10-10T22:37:22.347552+0000","last_undegraded":"2023-10-10T22:37:22.347552+0000","last_fullsized":"2023-10-10T22:37:22.347552+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:09.380526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338697+0000","last_change":"2023-10-10T22:37:22.332552+0000","last_active":"2023-10-10T22:37:22.338697+0000","last_peered":"2023-10-10T22:37:22.338697+0000","last_clean":"2023-10-10T22:37:22.338697+0000","last_became_active":"2023-10-10T22:37:22.332000+0000","last_became_peered":"2023-10-10T22:37:22.332000+0000","last_unstale":"2023-10-10T22:37:22.338697+0000","last_undegraded":"2023-10-10T22:37:22.338697+0000","last_fullsized":"2023-10-10T22:37:22.338697+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:45.352813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344219+0000","last_change":"2023-10-10T22:37:21.310535+0000","last_active":"2023-10-10T22:37:22.344219+0000","last_peered":"2023-10-10T22:37:22.344219+0000","last_clean":"2023-10-10T22:37:22.344219+0000","last_became_active":"2023-10-10T22:37:21.310298+0000","last_became_peered":"2023-10-10T22:37:21.310298+0000","last_unstale":"2023-10-10T22:37:22.344219+0000","last_undegraded":"2023-10-10T22:37:22.344219+0000","last_fullsized":"2023-10-10T22:37:22.344219+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:45.311116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338523+0000","last_change":"2023-10-10T22:37:22.330595+0000","last_active":"2023-10-10T22:37:22.338523+0000","last_peered":"2023-10-10T22:37:22.338523+0000","last_clean":"2023-10-10T22:37:22.338523+0000","last_became_active":"2023-10-10T22:37:22.330019+0000","last_became_peered":"2023-10-10T22:37:22.330019+0000","last_unstale":"2023-10-10T22:37:22.338523+0000","last_undegraded":"2023-10-10T22:37:22.338523+0000","last_fullsized":"2023-10-10T22:37:22.338523+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:37:20.275583+0000","last_change":"2023-10-10T22:37:20.290717+0000","last_active":"2023-10-10T22:37:20.275583+0000","last_peered":"2023-10-10T22:37:20.275583+0000","last_clean":"2023-10-10T22:37:20.275583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:20.275583+0000","last_undegraded":"2023-10-10T22:37:20.275583+0000","last_fullsized":"2023-10-10T22:37:20.275583+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:21:59.336943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.328680+0000","last_change":"2023-10-10T22:37:22.327712+0000","last_active":"2023-10-10T22:37:22.328680+0000","last_peered":"2023-10-10T22:37:22.328680+0000","last_clean":"2023-10-10T22:37:22.328680+0000","last_became_active":"2023-10-10T22:37:22.327084+0000","last_became_peered":"2023-10-10T22:37:22.327084+0000","last_unstale":"2023-10-10T22:37:22.328680+0000","last_undegraded":"2023-10-10T22:37:22.328680+0000","last_fullsized":"2023-10-10T22:37:22.328680+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:48:53.679083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344271+0000","last_change":"2023-10-10T22:37:21.306550+0000","last_active":"2023-10-10T22:37:22.344271+0000","last_peered":"2023-10-10T22:37:22.344271+0000","last_clean":"2023-10-10T22:37:22.344271+0000","last_became_active":"2023-10-10T22:37:21.306315+0000","last_became_peered":"2023-10-10T22:37:21.306315+0000","last_unstale":"2023-10-10T22:37:22.344271+0000","last_undegraded":"2023-10-10T22:37:22.344271+0000","last_fullsized":"2023-10-10T22:37:22.344271+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:41.427780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343229+0000","last_change":"2023-10-10T22:37:22.339383+0000","last_active":"2023-10-10T22:37:22.343229+0000","last_peered":"2023-10-10T22:37:22.343229+0000","last_clean":"2023-10-10T22:37:22.343229+0000","last_became_active":"2023-10-10T22:37:22.339121+0000","last_became_peered":"2023-10-10T22:37:22.339121+0000","last_unstale":"2023-10-10T22:37:22.343229+0000","last_undegraded":"2023-10-10T22:37:22.343229+0000","last_fullsized":"2023-10-10T22:37:22.343229+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:23.304666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346268+0000","last_change":"2023-10-10T22:37:21.311535+0000","last_active":"2023-10-10T22:37:22.346268+0000","last_peered":"2023-10-10T22:37:22.346268+0000","last_clean":"2023-10-10T22:37:22.346268+0000","last_became_active":"2023-10-10T22:37:21.311272+0000","last_became_peered":"2023-10-10T22:37:21.311272+0000","last_unstale":"2023-10-10T22:37:22.346268+0000","last_undegraded":"2023-10-10T22:37:22.346268+0000","last_fullsized":"2023-10-10T22:37:22.346268+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:56.463951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343480+0000","last_change":"2023-10-10T22:37:22.340669+0000","last_active":"2023-10-10T22:37:22.343480+0000","last_peered":"2023-10-10T22:37:22.343480+0000","last_clean":"2023-10-10T22:37:22.343480+0000","last_became_active":"2023-10-10T22:37:22.340417+0000","last_became_peered":"2023-10-10T22:37:22.340417+0000","last_unstale":"2023-10-10T22:37:22.343480+0000","last_undegraded":"2023-10-10T22:37:22.343480+0000","last_fullsized":"2023-10-10T22:37:22.343480+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:13.429335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323936+0000","last_change":"2023-10-10T22:37:21.311884+0000","last_active":"2023-10-10T22:37:22.323936+0000","last_peered":"2023-10-10T22:37:22.323936+0000","last_clean":"2023-10-10T22:37:22.323936+0000","last_became_active":"2023-10-10T22:37:21.311253+0000","last_became_peered":"2023-10-10T22:37:21.311253+0000","last_unstale":"2023-10-10T22:37:22.323936+0000","last_undegraded":"2023-10-10T22:37:22.323936+0000","last_fullsized":"2023-10-10T22:37:22.323936+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:32.308434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329066+0000","last_change":"2023-10-10T22:37:22.327563+0000","last_active":"2023-10-10T22:37:22.329066+0000","last_peered":"2023-10-10T22:37:22.329066+0000","last_clean":"2023-10-10T22:37:22.329066+0000","last_became_active":"2023-10-10T22:37:22.327285+0000","last_became_peered":"2023-10-10T22:37:22.327285+0000","last_unstale":"2023-10-10T22:37:22.329066+0000","last_undegraded":"2023-10-10T22:37:22.329066+0000","last_fullsized":"2023-10-10T22:37:22.329066+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:10.265065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322635+0000","last_change":"2023-10-10T22:37:21.304131+0000","last_active":"2023-10-10T22:37:22.322635+0000","last_peered":"2023-10-10T22:37:22.322635+0000","last_clean":"2023-10-10T22:37:22.322635+0000","last_became_active":"2023-10-10T22:37:21.303862+0000","last_became_peered":"2023-10-10T22:37:21.303862+0000","last_unstale":"2023-10-10T22:37:22.322635+0000","last_undegraded":"2023-10-10T22:37:22.322635+0000","last_fullsized":"2023-10-10T22:37:22.322635+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:11.264533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.334236+0000","last_change":"2023-10-10T22:37:22.326514+0000","last_active":"2023-10-10T22:37:22.334236+0000","last_peered":"2023-10-10T22:37:22.334236+0000","last_clean":"2023-10-10T22:37:22.334236+0000","last_became_active":"2023-10-10T22:37:22.326241+0000","last_became_peered":"2023-10-10T22:37:22.326241+0000","last_unstale":"2023-10-10T22:37:22.334236+0000","last_undegraded":"2023-10-10T22:37:22.334236+0000","last_fullsized":"2023-10-10T22:37:22.334236+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.317579+0000","last_change":"2023-10-10T22:37:21.307712+0000","last_active":"2023-10-10T22:37:22.317579+0000","last_peered":"2023-10-10T22:37:22.317579+0000","last_clean":"2023-10-10T22:37:22.317579+0000","last_became_active":"2023-10-10T22:37:21.307419+0000","last_became_peered":"2023-10-10T22:37:21.307419+0000","last_unstale":"2023-10-10T22:37:22.317579+0000","last_undegraded":"2023-10-10T22:37:22.317579+0000","last_fullsized":"2023-10-10T22:37:22.317579+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:09:38.945874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332403+0000","last_change":"2023-10-10T22:37:22.327109+0000","last_active":"2023-10-10T22:37:22.332403+0000","last_peered":"2023-10-10T22:37:22.332403+0000","last_clean":"2023-10-10T22:37:22.332403+0000","last_became_active":"2023-10-10T22:37:22.326801+0000","last_became_peered":"2023-10-10T22:37:22.326801+0000","last_unstale":"2023-10-10T22:37:22.332403+0000","last_undegraded":"2023-10-10T22:37:22.332403+0000","last_fullsized":"2023-10-10T22:37:22.332403+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:38.738632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"208'3","reported_seq":13,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344456+0000","last_change":"2023-10-10T22:37:21.304909+0000","last_active":"2023-10-10T22:37:22.344456+0000","last_peered":"2023-10-10T22:37:22.344456+0000","last_clean":"2023-10-10T22:37:22.344456+0000","last_became_active":"2023-10-10T22:37:21.304642+0000","last_became_peered":"2023-10-10T22:37:21.304642+0000","last_unstale":"2023-10-10T22:37:22.344456+0000","last_undegraded":"2023-10-10T22:37:22.344456+0000","last_fullsized":"2023-10-10T22:37:22.344456+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:28:25.674622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341955+0000","last_change":"2023-10-10T22:37:22.332831+0000","last_active":"2023-10-10T22:37:22.341955+0000","last_peered":"2023-10-10T22:37:22.341955+0000","last_clean":"2023-10-10T22:37:22.341955+0000","last_became_active":"2023-10-10T22:37:22.332577+0000","last_became_peered":"2023-10-10T22:37:22.332577+0000","last_unstale":"2023-10-10T22:37:22.341955+0000","last_undegraded":"2023-10-10T22:37:22.341955+0000","last_fullsized":"2023-10-10T22:37:22.341955+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:49.337687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"208'6","reported_seq":16,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348666+0000","last_change":"2023-10-10T22:37:21.302443+0000","last_active":"2023-10-10T22:37:22.348666+0000","last_peered":"2023-10-10T22:37:22.348666+0000","last_clean":"2023-10-10T22:37:22.348666+0000","last_became_active":"2023-10-10T22:37:21.302148+0000","last_became_peered":"2023-10-10T22:37:21.302148+0000","last_unstale":"2023-10-10T22:37:22.348666+0000","last_undegraded":"2023-10-10T22:37:22.348666+0000","last_fullsized":"2023-10-10T22:37:22.348666+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:52:34.012755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329179+0000","last_change":"2023-10-10T22:37:22.327958+0000","last_active":"2023-10-10T22:37:22.329179+0000","last_peered":"2023-10-10T22:37:22.329179+0000","last_clean":"2023-10-10T22:37:22.329179+0000","last_became_active":"2023-10-10T22:37:22.327720+0000","last_became_peered":"2023-10-10T22:37:22.327720+0000","last_unstale":"2023-10-10T22:37:22.329179+0000","last_undegraded":"2023-10-10T22:37:22.329179+0000","last_fullsized":"2023-10-10T22:37:22.329179+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:12.272333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351731+0000","last_change":"2023-10-10T22:37:21.311578+0000","last_active":"2023-10-10T22:37:22.351731+0000","last_peered":"2023-10-10T22:37:22.351731+0000","last_clean":"2023-10-10T22:37:22.351731+0000","last_became_active":"2023-10-10T22:37:21.311276+0000","last_became_peered":"2023-10-10T22:37:21.311276+0000","last_unstale":"2023-10-10T22:37:22.351731+0000","last_undegraded":"2023-10-10T22:37:22.351731+0000","last_fullsized":"2023-10-10T22:37:22.351731+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:10:25.362844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332363+0000","last_change":"2023-10-10T22:37:22.327787+0000","last_active":"2023-10-10T22:37:22.332363+0000","last_peered":"2023-10-10T22:37:22.332363+0000","last_clean":"2023-10-10T22:37:22.332363+0000","last_became_active":"2023-10-10T22:37:22.327459+0000","last_became_peered":"2023-10-10T22:37:22.327459+0000","last_unstale":"2023-10-10T22:37:22.332363+0000","last_undegraded":"2023-10-10T22:37:22.332363+0000","last_fullsized":"2023-10-10T22:37:22.332363+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313273+0000","last_change":"2023-10-10T22:37:21.309120+0000","last_active":"2023-10-10T22:37:22.313273+0000","last_peered":"2023-10-10T22:37:22.313273+0000","last_clean":"2023-10-10T22:37:22.313273+0000","last_became_active":"2023-10-10T22:37:21.308861+0000","last_became_peered":"2023-10-10T22:37:21.308861+0000","last_unstale":"2023-10-10T22:37:22.313273+0000","last_undegraded":"2023-10-10T22:37:22.313273+0000","last_fullsized":"2023-10-10T22:37:22.313273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:13:59.242392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338319+0000","last_change":"2023-10-10T22:37:22.330901+0000","last_active":"2023-10-10T22:37:22.338319+0000","last_peered":"2023-10-10T22:37:22.338319+0000","last_clean":"2023-10-10T22:37:22.338319+0000","last_became_active":"2023-10-10T22:37:22.327027+0000","last_became_peered":"2023-10-10T22:37:22.327027+0000","last_unstale":"2023-10-10T22:37:22.338319+0000","last_undegraded":"2023-10-10T22:37:22.338319+0000","last_fullsized":"2023-10-10T22:37:22.338319+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323309+0000","last_change":"2023-10-10T22:37:21.313404+0000","last_active":"2023-10-10T22:37:22.323309+0000","last_peered":"2023-10-10T22:37:22.323309+0000","last_clean":"2023-10-10T22:37:22.323309+0000","last_became_active":"2023-10-10T22:37:21.313147+0000","last_became_peered":"2023-10-10T22:37:21.313147+0000","last_unstale":"2023-10-10T22:37:22.323309+0000","last_undegraded":"2023-10-10T22:37:22.323309+0000","last_fullsized":"2023-10-10T22:37:22.323309+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:59.610628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341852+0000","last_change":"2023-10-10T22:37:22.331938+0000","last_active":"2023-10-10T22:37:22.341852+0000","last_peered":"2023-10-10T22:37:22.341852+0000","last_clean":"2023-10-10T22:37:22.341852+0000","last_became_active":"2023-10-10T22:37:22.331427+0000","last_became_peered":"2023-10-10T22:37:22.331427+0000","last_unstale":"2023-10-10T22:37:22.341852+0000","last_undegraded":"2023-10-10T22:37:22.341852+0000","last_fullsized":"2023-10-10T22:37:22.341852+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"208'8","reported_seq":18,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351735+0000","last_change":"2023-10-10T22:37:21.312079+0000","last_active":"2023-10-10T22:37:22.351735+0000","last_peered":"2023-10-10T22:37:22.351735+0000","last_clean":"2023-10-10T22:37:22.351735+0000","last_became_active":"2023-10-10T22:37:21.311201+0000","last_became_peered":"2023-10-10T22:37:21.311201+0000","last_unstale":"2023-10-10T22:37:22.351735+0000","last_undegraded":"2023-10-10T22:37:22.351735+0000","last_fullsized":"2023-10-10T22:37:22.351735+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:46.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335508+0000","last_change":"2023-10-10T22:37:22.329719+0000","last_active":"2023-10-10T22:37:22.335508+0000","last_peered":"2023-10-10T22:37:22.335508+0000","last_clean":"2023-10-10T22:37:22.335508+0000","last_became_active":"2023-10-10T22:37:22.329479+0000","last_became_peered":"2023-10-10T22:37:22.329479+0000","last_unstale":"2023-10-10T22:37:22.335508+0000","last_undegraded":"2023-10-10T22:37:22.335508+0000","last_fullsized":"2023-10-10T22:37:22.335508+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344267+0000","last_change":"2023-10-10T22:37:21.307317+0000","last_active":"2023-10-10T22:37:22.344267+0000","last_peered":"2023-10-10T22:37:22.344267+0000","last_clean":"2023-10-10T22:37:22.344267+0000","last_became_active":"2023-10-10T22:37:21.307063+0000","last_became_peered":"2023-10-10T22:37:21.307063+0000","last_unstale":"2023-10-10T22:37:22.344267+0000","last_undegraded":"2023-10-10T22:37:22.344267+0000","last_fullsized":"2023-10-10T22:37:22.344267+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:44:04.204820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338262+0000","last_change":"2023-10-10T22:37:22.331546+0000","last_active":"2023-10-10T22:37:22.338262+0000","last_peered":"2023-10-10T22:37:22.338262+0000","last_clean":"2023-10-10T22:37:22.338262+0000","last_became_active":"2023-10-10T22:37:22.327510+0000","last_became_peered":"2023-10-10T22:37:22.327510+0000","last_unstale":"2023-10-10T22:37:22.338262+0000","last_undegraded":"2023-10-10T22:37:22.338262+0000","last_fullsized":"2023-10-10T22:37:22.338262+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346273+0000","last_change":"2023-10-10T22:37:21.315652+0000","last_active":"2023-10-10T22:37:22.346273+0000","last_peered":"2023-10-10T22:37:22.346273+0000","last_clean":"2023-10-10T22:37:22.346273+0000","last_became_active":"2023-10-10T22:37:21.315368+0000","last_became_peered":"2023-10-10T22:37:21.315368+0000","last_unstale":"2023-10-10T22:37:22.346273+0000","last_undegraded":"2023-10-10T22:37:22.346273+0000","last_fullsized":"2023-10-10T22:37:22.346273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:00:52.565481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343258+0000","last_change":"2023-10-10T22:37:22.334001+0000","last_active":"2023-10-10T22:37:22.343258+0000","last_peered":"2023-10-10T22:37:22.343258+0000","last_clean":"2023-10-10T22:37:22.343258+0000","last_became_active":"2023-10-10T22:37:22.333748+0000","last_became_peered":"2023-10-10T22:37:22.333748+0000","last_unstale":"2023-10-10T22:37:22.343258+0000","last_undegraded":"2023-10-10T22:37:22.343258+0000","last_fullsized":"2023-10-10T22:37:22.343258+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:33.316234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351642+0000","last_change":"2023-10-10T22:37:21.311600+0000","last_active":"2023-10-10T22:37:22.351642+0000","last_peered":"2023-10-10T22:37:22.351642+0000","last_clean":"2023-10-10T22:37:22.351642+0000","last_became_active":"2023-10-10T22:37:21.311310+0000","last_became_peered":"2023-10-10T22:37:21.311310+0000","last_unstale":"2023-10-10T22:37:22.351642+0000","last_undegraded":"2023-10-10T22:37:22.351642+0000","last_fullsized":"2023-10-10T22:37:22.351642+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:28.854458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325907+0000","last_change":"2023-10-10T22:37:21.308409+0000","last_active":"2023-10-10T22:37:22.325907+0000","last_peered":"2023-10-10T22:37:22.325907+0000","last_clean":"2023-10-10T22:37:22.325907+0000","last_became_active":"2023-10-10T22:37:21.308069+0000","last_became_peered":"2023-10-10T22:37:21.308069+0000","last_unstale":"2023-10-10T22:37:22.325907+0000","last_undegraded":"2023-10-10T22:37:22.325907+0000","last_fullsized":"2023-10-10T22:37:22.325907+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:55.439618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324866+0000","last_change":"2023-10-10T22:37:22.322788+0000","last_active":"2023-10-10T22:37:22.324866+0000","last_peered":"2023-10-10T22:37:22.324866+0000","last_clean":"2023-10-10T22:37:22.324866+0000","last_became_active":"2023-10-10T22:37:22.322526+0000","last_became_peered":"2023-10-10T22:37:22.322526+0000","last_unstale":"2023-10-10T22:37:22.324866+0000","last_undegraded":"2023-10-10T22:37:22.324866+0000","last_fullsized":"2023-10-10T22:37:22.324866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346717+0000","last_change":"2023-10-10T22:37:21.314705+0000","last_active":"2023-10-10T22:37:22.346717+0000","last_peered":"2023-10-10T22:37:22.346717+0000","last_clean":"2023-10-10T22:37:22.346717+0000","last_became_active":"2023-10-10T22:37:21.314394+0000","last_became_peered":"2023-10-10T22:37:21.314394+0000","last_unstale":"2023-10-10T22:37:22.346717+0000","last_undegraded":"2023-10-10T22:37:22.346717+0000","last_fullsized":"2023-10-10T22:37:22.346717+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:49.346015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.339779+0000","last_change":"2023-10-10T22:37:22.334339+0000","last_active":"2023-10-10T22:37:22.339779+0000","last_peered":"2023-10-10T22:37:22.339779+0000","last_clean":"2023-10-10T22:37:22.339779+0000","last_became_active":"2023-10-10T22:37:22.334070+0000","last_became_peered":"2023-10-10T22:37:22.334070+0000","last_unstale":"2023-10-10T22:37:22.339779+0000","last_undegraded":"2023-10-10T22:37:22.339779+0000","last_fullsized":"2023-10-10T22:37:22.339779+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316614+0000","last_change":"2023-10-10T22:37:21.308062+0000","last_active":"2023-10-10T22:37:22.316614+0000","last_peered":"2023-10-10T22:37:22.316614+0000","last_clean":"2023-10-10T22:37:22.316614+0000","last_became_active":"2023-10-10T22:37:21.307766+0000","last_became_peered":"2023-10-10T22:37:21.307766+0000","last_unstale":"2023-10-10T22:37:22.316614+0000","last_undegraded":"2023-10-10T22:37:22.316614+0000","last_fullsized":"2023-10-10T22:37:22.316614+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:17.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316751+0000","last_change":"2023-10-10T22:37:21.309163+0000","last_active":"2023-10-10T22:37:22.316751+0000","last_peered":"2023-10-10T22:37:22.316751+0000","last_clean":"2023-10-10T22:37:22.316751+0000","last_became_active":"2023-10-10T22:37:21.308910+0000","last_became_peered":"2023-10-10T22:37:21.308910+0000","last_unstale":"2023-10-10T22:37:22.316751+0000","last_undegraded":"2023-10-10T22:37:22.316751+0000","last_fullsized":"2023-10-10T22:37:22.316751+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:15:42.499573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322365+0000","last_change":"2023-10-10T22:37:22.321715+0000","last_active":"2023-10-10T22:37:22.322365+0000","last_peered":"2023-10-10T22:37:22.322365+0000","last_clean":"2023-10-10T22:37:22.322365+0000","last_became_active":"2023-10-10T22:37:22.321465+0000","last_became_peered":"2023-10-10T22:37:22.321465+0000","last_unstale":"2023-10-10T22:37:22.322365+0000","last_undegraded":"2023-10-10T22:37:22.322365+0000","last_fullsized":"2023-10-10T22:37:22.322365+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:03:49.499590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314924+0000","last_change":"2023-10-10T22:37:21.305255+0000","last_active":"2023-10-10T22:37:22.314924+0000","last_peered":"2023-10-10T22:37:22.314924+0000","last_clean":"2023-10-10T22:37:22.314924+0000","last_became_active":"2023-10-10T22:37:21.304967+0000","last_became_peered":"2023-10-10T22:37:21.304967+0000","last_unstale":"2023-10-10T22:37:22.314924+0000","last_undegraded":"2023-10-10T22:37:22.314924+0000","last_fullsized":"2023-10-10T22:37:22.314924+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:37.730832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.326134+0000","last_change":"2023-10-10T22:37:22.321857+0000","last_active":"2023-10-10T22:37:22.326134+0000","last_peered":"2023-10-10T22:37:22.326134+0000","last_clean":"2023-10-10T22:37:22.326134+0000","last_became_active":"2023-10-10T22:37:22.321606+0000","last_became_peered":"2023-10-10T22:37:22.321606+0000","last_unstale":"2023-10-10T22:37:22.326134+0000","last_undegraded":"2023-10-10T22:37:22.326134+0000","last_fullsized":"2023-10-10T22:37:22.326134+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:23.523345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348933+0000","last_change":"2023-10-10T22:37:21.313185+0000","last_active":"2023-10-10T22:37:22.348933+0000","last_peered":"2023-10-10T22:37:22.348933+0000","last_clean":"2023-10-10T22:37:22.348933+0000","last_became_active":"2023-10-10T22:37:21.313009+0000","last_became_peered":"2023-10-10T22:37:21.313009+0000","last_unstale":"2023-10-10T22:37:22.348933+0000","last_undegraded":"2023-10-10T22:37:22.348933+0000","last_fullsized":"2023-10-10T22:37:22.348933+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:42:23.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341866+0000","last_change":"2023-10-10T22:37:22.332898+0000","last_active":"2023-10-10T22:37:22.341866+0000","last_peered":"2023-10-10T22:37:22.341866+0000","last_clean":"2023-10-10T22:37:22.341866+0000","last_became_active":"2023-10-10T22:37:22.332640+0000","last_became_peered":"2023-10-10T22:37:22.332640+0000","last_unstale":"2023-10-10T22:37:22.341866+0000","last_undegraded":"2023-10-10T22:37:22.341866+0000","last_fullsized":"2023-10-10T22:37:22.341866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.312873+0000","last_change":"2023-10-10T22:37:21.305064+0000","last_active":"2023-10-10T22:37:22.312873+0000","last_peered":"2023-10-10T22:37:22.312873+0000","last_clean":"2023-10-10T22:37:22.312873+0000","last_became_active":"2023-10-10T22:37:21.304822+0000","last_became_peered":"2023-10-10T22:37:21.304822+0000","last_unstale":"2023-10-10T22:37:22.312873+0000","last_undegraded":"2023-10-10T22:37:22.312873+0000","last_fullsized":"2023-10-10T22:37:22.312873+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:53:36.582199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338517+0000","last_change":"2023-10-10T22:37:22.336111+0000","last_active":"2023-10-10T22:37:22.338517+0000","last_peered":"2023-10-10T22:37:22.338517+0000","last_clean":"2023-10-10T22:37:22.338517+0000","last_became_active":"2023-10-10T22:37:22.335816+0000","last_became_peered":"2023-10-10T22:37:22.335816+0000","last_unstale":"2023-10-10T22:37:22.338517+0000","last_undegraded":"2023-10-10T22:37:22.338517+0000","last_fullsized":"2023-10-10T22:37:22.338517+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:49:21.033563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313016+0000","last_change":"2023-10-10T22:37:21.305679+0000","last_active":"2023-10-10T22:37:22.313016+0000","last_peered":"2023-10-10T22:37:22.313016+0000","last_clean":"2023-10-10T22:37:22.313016+0000","last_became_active":"2023-10-10T22:37:21.305426+0000","last_became_peered":"2023-10-10T22:37:21.305426+0000","last_unstale":"2023-10-10T22:37:22.313016+0000","last_undegraded":"2023-10-10T22:37:22.313016+0000","last_fullsized":"2023-10-10T22:37:22.313016+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:09.257265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343285+0000","last_change":"2023-10-10T22:37:22.340538+0000","last_active":"2023-10-10T22:37:22.343285+0000","last_peered":"2023-10-10T22:37:22.343285+0000","last_clean":"2023-10-10T22:37:22.343285+0000","last_became_active":"2023-10-10T22:37:22.340297+0000","last_became_peered":"2023-10-10T22:37:22.340297+0000","last_unstale":"2023-10-10T22:37:22.343285+0000","last_undegraded":"2023-10-10T22:37:22.343285+0000","last_fullsized":"2023-10-10T22:37:22.343285+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:15:40.123577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323634+0000","last_change":"2023-10-10T22:37:21.315894+0000","last_active":"2023-10-10T22:37:22.323634+0000","last_peered":"2023-10-10T22:37:22.323634+0000","last_clean":"2023-10-10T22:37:22.323634+0000","last_became_active":"2023-10-10T22:37:21.315627+0000","last_became_peered":"2023-10-10T22:37:21.315627+0000","last_unstale":"2023-10-10T22:37:22.323634+0000","last_undegraded":"2023-10-10T22:37:22.323634+0000","last_fullsized":"2023-10-10T22:37:22.323634+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:57.625726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343203+0000","last_change":"2023-10-10T22:37:22.337620+0000","last_active":"2023-10-10T22:37:22.343203+0000","last_peered":"2023-10-10T22:37:22.343203+0000","last_clean":"2023-10-10T22:37:22.343203+0000","last_became_active":"2023-10-10T22:37:22.337376+0000","last_became_peered":"2023-10-10T22:37:22.337376+0000","last_unstale":"2023-10-10T22:37:22.343203+0000","last_undegraded":"2023-10-10T22:37:22.343203+0000","last_fullsized":"2023-10-10T22:37:22.343203+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:02:20.851800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316514+0000","last_change":"2023-10-10T22:37:21.306687+0000","last_active":"2023-10-10T22:37:22.316514+0000","last_peered":"2023-10-10T22:37:22.316514+0000","last_clean":"2023-10-10T22:37:22.316514+0000","last_became_active":"2023-10-10T22:37:21.306312+0000","last_became_peered":"2023-10-10T22:37:21.306312+0000","last_unstale":"2023-10-10T22:37:22.316514+0000","last_undegraded":"2023-10-10T22:37:22.316514+0000","last_fullsized":"2023-10-10T22:37:22.316514+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:12.421535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345813+0000","last_change":"2023-10-10T22:37:22.340754+0000","last_active":"2023-10-10T22:37:22.345813+0000","last_peered":"2023-10-10T22:37:22.345813+0000","last_clean":"2023-10-10T22:37:22.345813+0000","last_became_active":"2023-10-10T22:37:22.340438+0000","last_became_peered":"2023-10-10T22:37:22.340438+0000","last_unstale":"2023-10-10T22:37:22.345813+0000","last_undegraded":"2023-10-10T22:37:22.345813+0000","last_fullsized":"2023-10-10T22:37:22.345813+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:44:45.896568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314997+0000","last_change":"2023-10-10T22:37:21.305173+0000","last_active":"2023-10-10T22:37:22.314997+0000","last_peered":"2023-10-10T22:37:22.314997+0000","last_clean":"2023-10-10T22:37:22.314997+0000","last_became_active":"2023-10-10T22:37:21.304872+0000","last_became_peered":"2023-10-10T22:37:21.304872+0000","last_unstale":"2023-10-10T22:37:22.314997+0000","last_undegraded":"2023-10-10T22:37:22.314997+0000","last_fullsized":"2023-10-10T22:37:22.314997+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:44.345013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-10T22:37:21.283383+0000","last_change":"2023-10-10T22:37:21.283383+0000","last_active":"2023-10-10T22:37:21.283383+0000","last_peered":"2023-10-10T22:37:21.283383+0000","last_clean":"2023-10-10T22:37:21.283383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:21.283383+0000","last_undegraded":"2023-10-10T22:37:21.283383+0000","last_fullsized":"2023-10-10T22:37:21.283383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-10T22:37:20.275583+0000","last_change":"2023-10-10T22:37:20.290722+0000","last_active":"2023-10-10T22:37:20.275583+0000","last_peered":"2023-10-10T22:37:20.275583+0000","last_clean":"2023-10-10T22:37:20.275583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-10T22:37:20.275583+0000","last_undegraded":"2023-10-10T22:37:20.275583+0000","last_fullsized":"2023-10-10T22:37:20.275583+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:54:55.230815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335239+0000","last_change":"2023-10-10T22:37:22.332348+0000","last_active":"2023-10-10T22:37:22.335239+0000","last_peered":"2023-10-10T22:37:22.335239+0000","last_clean":"2023-10-10T22:37:22.335239+0000","last_became_active":"2023-10-10T22:37:22.332119+0000","last_became_peered":"2023-10-10T22:37:22.332119+0000","last_unstale":"2023-10-10T22:37:22.335239+0000","last_undegraded":"2023-10-10T22:37:22.335239+0000","last_fullsized":"2023-10-10T22:37:22.335239+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:56.404086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.315755+0000","last_change":"2023-10-10T22:37:21.308580+0000","last_active":"2023-10-10T22:37:22.315755+0000","last_peered":"2023-10-10T22:37:22.315755+0000","last_clean":"2023-10-10T22:37:22.315755+0000","last_became_active":"2023-10-10T22:37:21.308346+0000","last_became_peered":"2023-10-10T22:37:21.308346+0000","last_unstale":"2023-10-10T22:37:22.315755+0000","last_undegraded":"2023-10-10T22:37:22.315755+0000","last_fullsized":"2023-10-10T22:37:22.315755+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:22.763388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330445+0000","last_change":"2023-10-10T22:37:22.326456+0000","last_active":"2023-10-10T22:37:22.330445+0000","last_peered":"2023-10-10T22:37:22.330445+0000","last_clean":"2023-10-10T22:37:22.330445+0000","last_became_active":"2023-10-10T22:37:22.326179+0000","last_became_peered":"2023-10-10T22:37:22.326179+0000","last_unstale":"2023-10-10T22:37:22.330445+0000","last_undegraded":"2023-10-10T22:37:22.330445+0000","last_fullsized":"2023-10-10T22:37:22.330445+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:34:29.226879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324236+0000","last_change":"2023-10-10T22:37:21.309121+0000","last_active":"2023-10-10T22:37:22.324236+0000","last_peered":"2023-10-10T22:37:22.324236+0000","last_clean":"2023-10-10T22:37:22.324236+0000","last_became_active":"2023-10-10T22:37:21.308062+0000","last_became_peered":"2023-10-10T22:37:21.308062+0000","last_unstale":"2023-10-10T22:37:22.324236+0000","last_undegraded":"2023-10-10T22:37:22.324236+0000","last_fullsized":"2023-10-10T22:37:22.324236+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:34.472180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1145,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324105+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:37:22.324105+0000","last_peered":"2023-10-10T22:37:22.324105+0000","last_clean":"2023-10-10T22:37:22.324105+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:37:22.324105+0000","last_undegraded":"2023-10-10T22:37:22.324105+0000","last_fullsized":"2023-10-10T22:37:22.324105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543275,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312716,"kb_used_data":3140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059124,"statfs":{"total":96636764160,"available":96316542976,"internally_reserved":0,"allocated":3215360,"data_stored":1905675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.026},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":1.073,"15min":1.081},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":1.145,"15min":1.145},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":1.0700000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.59899999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":1.0009999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.503,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.878}]},{"osd":4,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":0.82299999999999995,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":1.012},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.91800000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.024},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":0.999,"15min":1.079},"last":0.78700000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.042},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.86199999999999999,"5min":1.046,"15min":1.125},"last":0.95399999999999996}]}]},{"osd":6,"up_from":14,"seq":60129543273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299792,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072048,"statfs":{"total":96636764160,"available":96329777152,"internally_reserved":0,"allocated":2564096,"data_stored":1288004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":1.0289999999999999,"15min":1.1080000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.751},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.0920000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.64500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94299999999999995,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.034,"15min":1.1200000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.0660000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.621,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91200000000000003,"5min":0.97399999999999998,"15min":1.071},"last":0.80500000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":1.778,"15min":1.778},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.86899999999999999,"5min":0.996,"15min":1.046},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97299999999999998,"5min":1.827,"15min":1.827},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.754}]}]},{"osd":1,"up_from":14,"seq":60129543274,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1316739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.379},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.82999999999999996,"15min":0.88},"last":0.435}]},{"osd":2,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.878,"15min":0.90800000000000003},"last":0.504},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.88800000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.74399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.995,"5min":1.0269999999999999,"15min":1.177},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.008,"5min":1.089,"15min":1.1419999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.2450000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.64300000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.081,"5min":1.1200000000000001,"15min":1.2729999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.155},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.68600000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.2230000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308616,"kb_used_data":3136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063224,"statfs":{"total":96636764160,"available":96320741376,"internally_reserved":0,"allocated":3211264,"data_stored":1905593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.71399999999999997,"15min":0.753},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.433}]},{"osd":2,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.76000000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.85299999999999998},"last":0.501}]},{"osd":3,"last update":"Tue Oct 10 22:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.81100000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0469999999999999,"5min":1.1180000000000001,"15min":1.3340000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.1479999999999999,"15min":1.198},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56899999999999995},"max":{"1min":1.0449999999999999,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.625,"5min":0.54800000000000004,"15min":0.54500000000000004},"max":{"1min":1.1439999999999999,"5min":1.3320000000000001,"15min":1.377},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0449999999999999,"5min":1.274,"15min":1.427},"last":0.81999999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.198,"5min":1.224,"15min":1.2689999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.081,"5min":1.153,"15min":1.153},"last":0.83999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316236,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055604,"statfs":{"total":96636764160,"available":96312938496,"internally_reserved":0,"allocated":2625536,"data_stored":1315869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.317},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.89500000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.85699999999999998,"15min":0.85799999999999998},"last":0.438},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.101,"15min":1.288},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98599999999999999,"5min":1.1220000000000001,"15min":1.325},"last":0.77300000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.147,"15min":1.1970000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82199999999999995,"15min":0.84099999999999997},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.054,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.26},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.093,"5min":1.165,"15min":1.3129999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80600000000000005,"15min":0.83199999999999996},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.181,"15min":1.2609999999999999},"last":0.871}]}]},{"osd":3,"up_from":15,"seq":64424510571,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1315397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.877,"15min":0.877},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.70599999999999996,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":0.99399999999999999},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.04,"5min":1.133,"15min":1.242},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.202,"15min":1.2629999999999999},"last":0.96499999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.125,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":1.1040000000000001,"15min":1.222},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.099,"5min":1.1539999999999999,"15min":1.212},"last":0.89900000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.54200000000000004},"max":{"1min":0.98899999999999999,"5min":1.274,"15min":1.274},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":0.83499999999999996},"min":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56699999999999995},"max":{"1min":1.097,"5min":1.149,"15min":1.2370000000000001},"last":0.69699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129543276,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1317293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.087},"last":0.435},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.752},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.437},"max":{"1min":0.94099999999999995,"5min":0.95199999999999996,"15min":1.1220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88500000000000001,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.998,"15min":1.073},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.089},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.45200000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.4079999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":1.282},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.94099999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.94099999999999995,"15min":1.0900000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.42199999999999999},"max":{"1min":0.82099999999999995,"5min":0.89600000000000002,"15min":1.0649999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.92100000000000004,"5min":0.96999999999999997,"15min":1.21},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.436},"max":{"1min":0.97399999999999998,"5min":0.97999999999999998,"15min":1.147},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543274,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1315203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":1.006},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.48199999999999998,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.997},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65500000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.98999999999999999,"15min":1.04},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.02},"last":0.76000000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.37},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.01,"5min":1.01,"15min":1.032},"last":0.749}]},{"osd":7,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.623},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.02},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:37:27.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2023-10-10T22:37:27.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2023-10-10T22:37:27.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2023-10-10T22:37:27.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2023-10-10T22:37:27.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2023-10-10T22:37:27.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2023-10-10T22:37:27.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2023-10-10T22:37:27.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-10-10T22:37:27.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:37:20.275583+0000', 'last_change': '2023-10-10T22:37:20.290717+0000', 'last_active': '2023-10-10T22:37:20.275583+0000', 'last_peered': '2023-10-10T22:37:20.275583+0000', 'last_clean': '2023-10-10T22:37:20.275583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:20.275583+0000', 'last_undegraded': '2023-10-10T22:37:20.275583+0000', 'last_fullsized': '2023-10-10T22:37:20.275583+0000', 'mapping_epoch': 206, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 206, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:20.275583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:20.275583+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:20.275583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-12T05:21:59.336943+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T22:37:27.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2023-10-10T22:37:27.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2023-10-10T22:37:27.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2023-10-10T22:37:27.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-10T22:37:21.283383+0000', 'last_change': '2023-10-10T22:37:21.283383+0000', 'last_active': '2023-10-10T22:37:21.283383+0000', 'last_peered': '2023-10-10T22:37:21.283383+0000', 'last_clean': '2023-10-10T22:37:21.283383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:21.283383+0000', 'last_undegraded': '2023-10-10T22:37:21.283383+0000', 'last_fullsized': '2023-10-10T22:37:21.283383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:21.283383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-10T22:37:27.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-10-10T22:37:27.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-10T22:37:20.275583+0000', 'last_change': '2023-10-10T22:37:20.290722+0000', 'last_active': '2023-10-10T22:37:20.275583+0000', 'last_peered': '2023-10-10T22:37:20.275583+0000', 'last_clean': '2023-10-10T22:37:20.275583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-10T22:37:20.275583+0000', 'last_undegraded': '2023-10-10T22:37:20.275583+0000', 'last_fullsized': '2023-10-10T22:37:20.275583+0000', 'mapping_epoch': 206, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 206, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-10T22:37:20.275583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-10T22:37:20.275583+0000', 'last_clean_scrub_stamp': '2023-10-10T22:37:20.275583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T22:54:55.230815+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-10T22:37:27.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-10T22:37:27.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.781+0000 7f400cfff700 1 Processor -- start 2023-10-10T22:37:27.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.781+0000 7f400cfff700 1 -- start start 2023-10-10T22:37:27.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400cfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4008156770 0x7f40080b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400cfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f40080ad9b0 0x7f40080b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400cfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 0x7f40080ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400cfff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40080c9680 con 0x7f4008156770 2023-10-10T22:37:27.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400cfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40080c9810 con 0x7f40080ad9b0 2023-10-10T22:37:27.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400cfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40080adf80 con 0x7f40080c9ca0 2023-10-10T22:37:27.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4008156770 0x7f40080b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4008156770 0x7f40080b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33178/0 (socket says 172.21.15.154:33178) 2023-10-10T22:37:27.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400659c700 1 -- 172.21.15.154:0/289124245 learned_addr learned my addr 172.21.15.154:0/289124245 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:27.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f3ffffff700 1 --2- 172.21.15.154:0/289124245 >> v2:172.21.15.179:3300/0 conn(0x7f40080ad9b0 0x7f40080b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f4006d9d700 1 --2- 172.21.15.154:0/289124245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 0x7f40080ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400659c700 1 -- 172.21.15.154:0/289124245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 msgr2=0x7f40080ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:27.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400659c700 1 --2- 172.21.15.154:0/289124245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 0x7f40080ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400659c700 1 -- 172.21.15.154:0/289124245 >> v2:172.21.15.179:3300/0 conn(0x7f40080ad9b0 msgr2=0x7f40080b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:27.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400659c700 1 --2- 172.21.15.154:0/289124245 >> v2:172.21.15.179:3300/0 conn(0x7f40080ad9b0 0x7f40080b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.783+0000 7f400659c700 1 -- 172.21.15.154:0/289124245 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080ae260 con 0x7f4008156770 2023-10-10T22:37:27.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.784+0000 7f400659c700 1 --2- 172.21.15.154:0/289124245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 0x7f40080b0bd0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f400806d2a0 tx=0x7f3ff8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd35fcd351ff2581 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:27.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.784+0000 7f4005d9b700 1 -- 172.21.15.154:0/289124245 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800b860 con 0x7f4008156770 2023-10-10T22:37:27.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.784+0000 7f4005d9b700 1 -- 172.21.15.154:0/289124245 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800b9c0 con 0x7f4008156770 2023-10-10T22:37:27.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.784+0000 7f4005d9b700 1 -- 172.21.15.154:0/289124245 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800bd60 con 0x7f4008156770 2023-10-10T22:37:27.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.784+0000 7f400cfff700 1 -- 172.21.15.154:0/289124245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 msgr2=0x7f40080b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.784+0000 7f400cfff700 1 --2- 172.21.15.154:0/289124245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 0x7f40080b0bd0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f400806d2a0 tx=0x7f3ff8009250 comp rx=0 tx=0).stop 2023-10-10T22:37:27.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.785+0000 7f400cfff700 1 -- 172.21.15.154:0/289124245 shutdown_connections 2023-10-10T22:37:27.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.785+0000 7f400cfff700 1 --2- 172.21.15.154:0/289124245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 0x7f40080ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.785+0000 7f400cfff700 1 --2- 172.21.15.154:0/289124245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 0x7f40080b0bd0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.785+0000 7f400cfff700 1 --2- 172.21.15.154:0/289124245 >> v2:172.21.15.179:3300/0 conn(0x7f40080ad9b0 0x7f40080b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.785+0000 7f400cfff700 1 -- 172.21.15.154:0/289124245 >> 172.21.15.154:0/289124245 conn(0x7f400806a310 msgr2=0x7f40080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:27.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.785+0000 7f400cfff700 1 -- 172.21.15.154:0/289124245 shutdown_connections 2023-10-10T22:37:27.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.785+0000 7f400cfff700 1 -- 172.21.15.154:0/289124245 wait complete. 2023-10-10T22:37:27.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.786+0000 7f400cfff700 1 Processor -- start 2023-10-10T22:37:27.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.786+0000 7f400cfff700 1 -- start start 2023-10-10T22:37:27.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f400cfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40080ad9b0 0x7f400816cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f400cfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 0x7f4008159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f400cfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 0x7f4008154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f400cfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008159710 con 0x7f4008156770 2023-10-10T22:37:27.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f400cfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008158b00 con 0x7f40080ad9b0 2023-10-10T22:37:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f400cfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4008158de0 con 0x7f40080c9ca0 2023-10-10T22:37:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f4006d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 0x7f4008154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f4006d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 0x7f4008154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33184/0 (socket says 172.21.15.154:33184) 2023-10-10T22:37:27.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f4006d9d700 1 -- 172.21.15.154:0/3691838384 learned_addr learned my addr 172.21.15.154:0/3691838384 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:27.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f3ffffff700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 0x7f4008159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.787+0000 7f400659c700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40080ad9b0 0x7f400816cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f4006d9d700 1 -- 172.21.15.154:0/3691838384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 msgr2=0x7f4008159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f4006d9d700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 0x7f4008159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f4006d9d700 1 -- 172.21.15.154:0/3691838384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40080ad9b0 msgr2=0x7f400816cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f4006d9d700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40080ad9b0 0x7f400816cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f4006d9d700 1 -- 172.21.15.154:0/3691838384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80094f0 con 0x7f4008156770 2023-10-10T22:37:27.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f4006d9d700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 0x7f4008154d60 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f4000009fa0 tx=0x7f4000009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:27.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f3ffe7fc700 1 -- 172.21.15.154:0/3691838384 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000ed20 con 0x7f4008156770 2023-10-10T22:37:27.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f3ffe7fc700 1 -- 172.21.15.154:0/3691838384 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000ee80 con 0x7f4008156770 2023-10-10T22:37:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f3ffe7fc700 1 -- 172.21.15.154:0/3691838384 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000014670 con 0x7f4008156770 2023-10-10T22:37:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40081590c0 con 0x7f4008156770 2023-10-10T22:37:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.788+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400815a520 con 0x7f4008156770 2023-10-10T22:37:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.789+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4008159880 con 0x7f4008156770 2023-10-10T22:37:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.790+0000 7f3ffe7fc700 1 -- 172.21.15.154:0/3691838384 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40000149e0 con 0x7f4008156770 2023-10-10T22:37:27.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.791+0000 7f3ffe7fc700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fe8066f30 0x7f3fe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:27.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.791+0000 7f3ffe7fc700 1 -- 172.21.15.154:0/3691838384 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f4000084f60 con 0x7f4008156770 2023-10-10T22:37:27.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.791+0000 7f400659c700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fe8066f30 0x7f3fe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:27.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.792+0000 7f400659c700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fe8066f30 0x7f3fe80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f400806d2a0 tx=0x7f3ff8017000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:27.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:27.795+0000 7f3ffe7fc700 1 -- 172.21.15.154:0/3691838384 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4000051f20 con 0x7f4008156770 2023-10-10T22:37:28.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.061+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f400804c3c0 con 0x7f4008156770 2023-10-10T22:37:28.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.062+0000 7f3ffe7fc700 1 -- 172.21.15.154:0/3691838384 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1183 (secure 0 0 0) 0x7f4000055540 con 0x7f4008156770 2023-10-10T22:37:28.067 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:28.067 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5732,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":209,"num_osds":8,"num_up_osds":8,"osd_up_since":1696971727,"num_in_osds":8,"osd_in_since":1696971718,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"unknown","count":10},{"state_name":"creating+peering","count":2}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592674,"bytes_used":2520408064,"bytes_avail":770573705216,"bytes_total":773094113280,"unknown_pgs_ratio":0.10309278219938278,"inactive_pgs_ratio":0.020618556067347527,"write_bytes_sec":2371,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":94,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"b","status":"up:active","gid":10182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-10T22:36:01.565821+0000","services":{}},"progress_events":{}} 2023-10-10T22:37:28.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fe8066f30 msgr2=0x7f3fe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:28.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fe8066f30 0x7f3fe80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f400806d2a0 tx=0x7f3ff8017000 comp rx=0 tx=0).stop 2023-10-10T22:37:28.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 msgr2=0x7f4008154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:28.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 0x7f4008154d60 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f4000009fa0 tx=0x7f4000009900 comp rx=0 tx=0).stop 2023-10-10T22:37:28.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 shutdown_connections 2023-10-10T22:37:28.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f3fe8066f30 0x7f3fe80693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4008156770 0x7f4008154d60 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40080ad9b0 0x7f400816cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 --2- 172.21.15.154:0/3691838384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40080c9ca0 0x7f4008159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 >> 172.21.15.154:0/3691838384 conn(0x7f400806a310 msgr2=0x7f40080c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:28.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 shutdown_connections 2023-10-10T22:37:28.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.064+0000 7f400cfff700 1 -- 172.21.15.154:0/3691838384 wait complete. 2023-10-10T22:37:28.084 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-10T22:37:28.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:37:28.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.263+0000 7f803ef9d700 1 Processor -- start 2023-10-10T22:37:28.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803ef9d700 1 -- start start 2023-10-10T22:37:28.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803ef9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8038150180 0x7f8038157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:28.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803ef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380c7410 0x7f8038069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:28.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803ef9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803806e2a0 con 0x7f8038150550 2023-10-10T22:37:28.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803ef9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803806b2e0 con 0x7f8038150180 2023-10-10T22:37:28.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803ef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80380c78e0 con 0x7f80380c7410 2023-10-10T22:37:28.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803df9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8038150180 0x7f8038157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:28.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803e79c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380c7410 0x7f8038069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:28.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803d79a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8038150550 0x7f80380c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:37202/0 (socket says 172.21.15.154:37202) 2023-10-10T22:37:28.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803df9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8038150180 0x7f8038157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:46984/0 (socket says 172.21.15.154:46984) 2023-10-10T22:37:28.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.265+0000 7f803d79a700 1 -- 172.21.15.154:0/2382818892 learned_addr learned my addr 172.21.15.154:0/2382818892 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:28.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.266+0000 7f803df9b700 1 -- 172.21.15.154:0/2382818892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380c7410 msgr2=0x7f8038069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:28.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.266+0000 7f803df9b700 1 --2- 172.21.15.154:0/2382818892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380c7410 0x7f8038069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.266+0000 7f803df9b700 1 -- 172.21.15.154:0/2382818892 >> v1:172.21.15.179:6789/0 conn(0x7f8038150550 legacy=0x7f80380c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.266+0000 7f803df9b700 1 -- 172.21.15.154:0/2382818892 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380c7bc0 con 0x7f8038150180 2023-10-10T22:37:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.266+0000 7f803e79c700 1 --2- 172.21.15.154:0/2382818892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380c7410 0x7f8038069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.266+0000 7f803df9b700 1 --2- 172.21.15.154:0/2382818892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8038150180 0x7f8038157770 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f80340098e0 tx=0x7f80340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0687d73d66a1635 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.266+0000 7f803cf99700 1 -- 172.21.15.154:0/2382818892 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803400b640 con 0x7f8038150180 2023-10-10T22:37:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803cf99700 1 -- 172.21.15.154:0/2382818892 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803400b7a0 con 0x7f8038150180 2023-10-10T22:37:28.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803cf99700 1 -- 172.21.15.154:0/2382818892 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803400bb40 con 0x7f8038150180 2023-10-10T22:37:28.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803ef9d700 1 -- 172.21.15.154:0/2382818892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8038150180 msgr2=0x7f8038157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:28.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803ef9d700 1 --2- 172.21.15.154:0/2382818892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8038150180 0x7f8038157770 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f80340098e0 tx=0x7f80340091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803ef9d700 1 -- 172.21.15.154:0/2382818892 shutdown_connections 2023-10-10T22:37:28.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803ef9d700 1 --2- 172.21.15.154:0/2382818892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380c7410 0x7f8038069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803ef9d700 1 --2- 172.21.15.154:0/2382818892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8038150180 0x7f8038157770 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803ef9d700 1 -- 172.21.15.154:0/2382818892 >> 172.21.15.154:0/2382818892 conn(0x7f80380cc1f0 msgr2=0x7f80380cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:28.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803ef9d700 1 -- 172.21.15.154:0/2382818892 shutdown_connections 2023-10-10T22:37:28.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.267+0000 7f803ef9d700 1 -- 172.21.15.154:0/2382818892 wait complete. 2023-10-10T22:37:28.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.268+0000 7f803ef9d700 1 Processor -- start 2023-10-10T22:37:28.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.269+0000 7f803ef9d700 1 -- start start 2023-10-10T22:37:28.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803ef9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80380c7410 0x7f8038169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803ef9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8038150180 0x7f803814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803ef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8038150550 0x7f80380b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803ef9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803814bdd0 con 0x7f80380c7410 2023-10-10T22:37:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803ef9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803816a220 con 0x7f8038150180 2023-10-10T22:37:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803ef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803816a500 con 0x7f8038150550 2023-10-10T22:37:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803df9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80380c7410 0x7f8038169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803df9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80380c7410 0x7f8038169bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33198/0 (socket says 172.21.15.154:33198) 2023-10-10T22:37:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803df9b700 1 -- 172.21.15.154:0/2814091659 learned_addr learned my addr 172.21.15.154:0/2814091659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803d79a700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8038150180 0x7f803814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803e79c700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8038150550 0x7f80380b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803df9b700 1 -- 172.21.15.154:0/2814091659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8038150550 msgr2=0x7f80380b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803df9b700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8038150550 0x7f80380b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803df9b700 1 -- 172.21.15.154:0/2814091659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8038150180 msgr2=0x7f803814b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803df9b700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8038150180 0x7f803814b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803df9b700 1 -- 172.21.15.154:0/2814091659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803000ab30 con 0x7f80380c7410 2023-10-10T22:37:28.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803df9b700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80380c7410 0x7f8038169bf0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f803806fe40 tx=0x7f8034017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:28.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f802dffb700 1 -- 172.21.15.154:0/2814091659 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803401bda0 con 0x7f80380c7410 2023-10-10T22:37:28.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f802dffb700 1 -- 172.21.15.154:0/2814091659 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034011420 con 0x7f80380c7410 2023-10-10T22:37:28.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8034009420 con 0x7f80380c7410 2023-10-10T22:37:28.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f802dffb700 1 -- 172.21.15.154:0/2814091659 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340117e0 con 0x7f80380c7410 2023-10-10T22:37:28.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.271+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803816aac0 con 0x7f80380c7410 2023-10-10T22:37:28.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.272+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803804c3c0 con 0x7f80380c7410 2023-10-10T22:37:28.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.273+0000 7f802dffb700 1 -- 172.21.15.154:0/2814091659 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8034011b90 con 0x7f80380c7410 2023-10-10T22:37:28.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.274+0000 7f802dffb700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f801c066f30 0x7f801c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:28.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.274+0000 7f802dffb700 1 -- 172.21.15.154:0/2814091659 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f8034085ed0 con 0x7f80380c7410 2023-10-10T22:37:28.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.274+0000 7f803d79a700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f801c066f30 0x7f801c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:28.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.274+0000 7f803d79a700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f801c066f30 0x7f801c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f803814f820 tx=0x7f8028009040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:28.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.278+0000 7f802dffb700 1 -- 172.21.15.154:0/2814091659 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8034052e90 con 0x7f80380c7410 2023-10-10T22:37:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.468+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80380c65a0 con 0x7f801c066f30 2023-10-10T22:37:28.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.476+0000 7f802dffb700 1 -- 172.21.15.154:0/2814091659 <== mgr.9999 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289575 (secure 0 0 0) 0x7f80380c65a0 con 0x7f801c066f30 2023-10-10T22:37:28.483 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:28.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f801c066f30 msgr2=0x7f801c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:28.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f801c066f30 0x7f801c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f803814f820 tx=0x7f8028009040 comp rx=0 tx=0).stop 2023-10-10T22:37:28.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80380c7410 msgr2=0x7f8038169bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:28.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80380c7410 0x7f8038169bf0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f803806fe40 tx=0x7f8034017000 comp rx=0 tx=0).stop 2023-10-10T22:37:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 shutdown_connections 2023-10-10T22:37:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f801c066f30 0x7f801c0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8038150550 0x7f80380b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80380c7410 0x7f8038169bf0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 --2- 172.21.15.154:0/2814091659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8038150180 0x7f803814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 >> 172.21.15.154:0/2814091659 conn(0x7f80380cc1f0 msgr2=0x7f80380696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 shutdown_connections 2023-10-10T22:37:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:28.481+0000 7f803ef9d700 1 -- 172.21.15.154:0/2814091659 wait complete. 2023-10-10T22:37:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:37:28.500 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-10T22:37:27.898915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":623,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461384,"kb_used_data":21640,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752513336,"statfs":{"total":773094113280,"available":770573656064,"internally_reserved":0,"allocated":22159360,"data_stored":11706972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.609101"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343085+0000","last_change":"2023-10-10T22:37:22.336242+0000","last_active":"2023-10-10T22:37:22.343085+0000","last_peered":"2023-10-10T22:37:22.343085+0000","last_clean":"2023-10-10T22:37:22.343085+0000","last_became_active":"2023-10-10T22:37:22.335965+0000","last_became_peered":"2023-10-10T22:37:22.335965+0000","last_unstale":"2023-10-10T22:37:22.343085+0000","last_undegraded":"2023-10-10T22:37:22.343085+0000","last_fullsized":"2023-10-10T22:37:22.343085+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:32:15.779372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343606+0000","last_change":"2023-10-10T22:37:22.338780+0000","last_active":"2023-10-10T22:37:22.343606+0000","last_peered":"2023-10-10T22:37:22.343606+0000","last_clean":"2023-10-10T22:37:22.343606+0000","last_became_active":"2023-10-10T22:37:22.338514+0000","last_became_peered":"2023-10-10T22:37:22.338514+0000","last_unstale":"2023-10-10T22:37:22.343606+0000","last_undegraded":"2023-10-10T22:37:22.343606+0000","last_fullsized":"2023-10-10T22:37:22.343606+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:42:24.305184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330213+0000","last_change":"2023-10-10T22:37:22.323947+0000","last_active":"2023-10-10T22:37:22.330213+0000","last_peered":"2023-10-10T22:37:22.330213+0000","last_clean":"2023-10-10T22:37:22.330213+0000","last_became_active":"2023-10-10T22:37:22.323685+0000","last_became_peered":"2023-10-10T22:37:22.323685+0000","last_unstale":"2023-10-10T22:37:22.330213+0000","last_undegraded":"2023-10-10T22:37:22.330213+0000","last_fullsized":"2023-10-10T22:37:22.330213+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:54:16.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.328709+0000","last_change":"2023-10-10T22:37:22.327145+0000","last_active":"2023-10-10T22:37:22.328709+0000","last_peered":"2023-10-10T22:37:22.328709+0000","last_clean":"2023-10-10T22:37:22.328709+0000","last_became_active":"2023-10-10T22:37:22.326863+0000","last_became_peered":"2023-10-10T22:37:22.326863+0000","last_unstale":"2023-10-10T22:37:22.328709+0000","last_undegraded":"2023-10-10T22:37:22.328709+0000","last_fullsized":"2023-10-10T22:37:22.328709+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:22:05.026292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331732+0000","last_change":"2023-10-10T22:37:22.329074+0000","last_active":"2023-10-10T22:37:22.331732+0000","last_peered":"2023-10-10T22:37:22.331732+0000","last_clean":"2023-10-10T22:37:22.331732+0000","last_became_active":"2023-10-10T22:37:22.328756+0000","last_became_peered":"2023-10-10T22:37:22.328756+0000","last_unstale":"2023-10-10T22:37:22.331732+0000","last_undegraded":"2023-10-10T22:37:22.331732+0000","last_fullsized":"2023-10-10T22:37:22.331732+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:55:55.816244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345969+0000","last_change":"2023-10-10T22:37:22.341498+0000","last_active":"2023-10-10T22:37:22.345969+0000","last_peered":"2023-10-10T22:37:22.345969+0000","last_clean":"2023-10-10T22:37:22.345969+0000","last_became_active":"2023-10-10T22:37:22.341255+0000","last_became_peered":"2023-10-10T22:37:22.341255+0000","last_unstale":"2023-10-10T22:37:22.345969+0000","last_undegraded":"2023-10-10T22:37:22.345969+0000","last_fullsized":"2023-10-10T22:37:22.345969+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:32:00.612130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338966+0000","last_change":"2023-10-10T22:37:22.328393+0000","last_active":"2023-10-10T22:37:22.338966+0000","last_peered":"2023-10-10T22:37:22.338966+0000","last_clean":"2023-10-10T22:37:22.338966+0000","last_became_active":"2023-10-10T22:37:22.328101+0000","last_became_peered":"2023-10-10T22:37:22.328101+0000","last_unstale":"2023-10-10T22:37:22.338966+0000","last_undegraded":"2023-10-10T22:37:22.338966+0000","last_fullsized":"2023-10-10T22:37:22.338966+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:35:42.499747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336008+0000","last_change":"2023-10-10T22:37:22.331181+0000","last_active":"2023-10-10T22:37:22.336008+0000","last_peered":"2023-10-10T22:37:22.336008+0000","last_clean":"2023-10-10T22:37:22.336008+0000","last_became_active":"2023-10-10T22:37:22.330824+0000","last_became_peered":"2023-10-10T22:37:22.330824+0000","last_unstale":"2023-10-10T22:37:22.336008+0000","last_undegraded":"2023-10-10T22:37:22.336008+0000","last_fullsized":"2023-10-10T22:37:22.336008+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:29.396879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338211+0000","last_change":"2023-10-10T22:37:22.331320+0000","last_active":"2023-10-10T22:37:22.338211+0000","last_peered":"2023-10-10T22:37:22.338211+0000","last_clean":"2023-10-10T22:37:22.338211+0000","last_became_active":"2023-10-10T22:37:22.331052+0000","last_became_peered":"2023-10-10T22:37:22.331052+0000","last_unstale":"2023-10-10T22:37:22.338211+0000","last_undegraded":"2023-10-10T22:37:22.338211+0000","last_fullsized":"2023-10-10T22:37:22.338211+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325713+0000","last_change":"2023-10-10T22:37:22.325204+0000","last_active":"2023-10-10T22:37:22.325713+0000","last_peered":"2023-10-10T22:37:22.325713+0000","last_clean":"2023-10-10T22:37:22.325713+0000","last_became_active":"2023-10-10T22:37:22.321688+0000","last_became_peered":"2023-10-10T22:37:22.321688+0000","last_unstale":"2023-10-10T22:37:22.325713+0000","last_undegraded":"2023-10-10T22:37:22.325713+0000","last_fullsized":"2023-10-10T22:37:22.325713+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344561+0000","last_change":"2023-10-10T22:37:22.342230+0000","last_active":"2023-10-10T22:37:22.344561+0000","last_peered":"2023-10-10T22:37:22.344561+0000","last_clean":"2023-10-10T22:37:22.344561+0000","last_became_active":"2023-10-10T22:37:22.341026+0000","last_became_peered":"2023-10-10T22:37:22.341026+0000","last_unstale":"2023-10-10T22:37:22.344561+0000","last_undegraded":"2023-10-10T22:37:22.344561+0000","last_fullsized":"2023-10-10T22:37:22.344561+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:10.388326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.334760+0000","last_change":"2023-10-10T22:37:22.332723+0000","last_active":"2023-10-10T22:37:22.334760+0000","last_peered":"2023-10-10T22:37:22.334760+0000","last_clean":"2023-10-10T22:37:22.334760+0000","last_became_active":"2023-10-10T22:37:22.332430+0000","last_became_peered":"2023-10-10T22:37:22.332430+0000","last_unstale":"2023-10-10T22:37:22.334760+0000","last_undegraded":"2023-10-10T22:37:22.334760+0000","last_fullsized":"2023-10-10T22:37:22.334760+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:33.316234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331786+0000","last_change":"2023-10-10T22:37:22.330030+0000","last_active":"2023-10-10T22:37:22.331786+0000","last_peered":"2023-10-10T22:37:22.331786+0000","last_clean":"2023-10-10T22:37:22.331786+0000","last_became_active":"2023-10-10T22:37:22.329676+0000","last_became_peered":"2023-10-10T22:37:22.329676+0000","last_unstale":"2023-10-10T22:37:22.331786+0000","last_undegraded":"2023-10-10T22:37:22.331786+0000","last_fullsized":"2023-10-10T22:37:22.331786+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:48:53.679083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343351+0000","last_change":"2023-10-10T22:37:22.331950+0000","last_active":"2023-10-10T22:37:22.343351+0000","last_peered":"2023-10-10T22:37:22.343351+0000","last_clean":"2023-10-10T22:37:22.343351+0000","last_became_active":"2023-10-10T22:37:22.327964+0000","last_became_peered":"2023-10-10T22:37:22.327964+0000","last_unstale":"2023-10-10T22:37:22.343351+0000","last_undegraded":"2023-10-10T22:37:22.343351+0000","last_fullsized":"2023-10-10T22:37:22.343351+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:29.862257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341256+0000","last_change":"2023-10-10T22:37:22.337671+0000","last_active":"2023-10-10T22:37:22.341256+0000","last_peered":"2023-10-10T22:37:22.341256+0000","last_clean":"2023-10-10T22:37:22.341256+0000","last_became_active":"2023-10-10T22:37:22.337359+0000","last_became_peered":"2023-10-10T22:37:22.337359+0000","last_unstale":"2023-10-10T22:37:22.341256+0000","last_undegraded":"2023-10-10T22:37:22.341256+0000","last_fullsized":"2023-10-10T22:37:22.341256+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343867+0000","last_change":"2023-10-10T22:37:22.341039+0000","last_active":"2023-10-10T22:37:22.343867+0000","last_peered":"2023-10-10T22:37:22.343867+0000","last_clean":"2023-10-10T22:37:22.343867+0000","last_became_active":"2023-10-10T22:37:22.340752+0000","last_became_peered":"2023-10-10T22:37:22.340752+0000","last_unstale":"2023-10-10T22:37:22.343867+0000","last_undegraded":"2023-10-10T22:37:22.343867+0000","last_fullsized":"2023-10-10T22:37:22.343867+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:31:20.851558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332530+0000","last_change":"2023-10-10T22:37:22.330693+0000","last_active":"2023-10-10T22:37:22.332530+0000","last_peered":"2023-10-10T22:37:22.332530+0000","last_clean":"2023-10-10T22:37:22.332530+0000","last_became_active":"2023-10-10T22:37:22.330422+0000","last_became_peered":"2023-10-10T22:37:22.330422+0000","last_unstale":"2023-10-10T22:37:22.332530+0000","last_undegraded":"2023-10-10T22:37:22.332530+0000","last_fullsized":"2023-10-10T22:37:22.332530+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:15.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347291+0000","last_change":"2023-10-10T22:37:22.344903+0000","last_active":"2023-10-10T22:37:22.347291+0000","last_peered":"2023-10-10T22:37:22.347291+0000","last_clean":"2023-10-10T22:37:22.347291+0000","last_became_active":"2023-10-10T22:37:22.344568+0000","last_became_peered":"2023-10-10T22:37:22.344568+0000","last_unstale":"2023-10-10T22:37:22.347291+0000","last_undegraded":"2023-10-10T22:37:22.347291+0000","last_fullsized":"2023-10-10T22:37:22.347291+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:29:17.224764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331152+0000","last_change":"2023-10-10T22:37:22.327814+0000","last_active":"2023-10-10T22:37:22.331152+0000","last_peered":"2023-10-10T22:37:22.331152+0000","last_clean":"2023-10-10T22:37:22.331152+0000","last_became_active":"2023-10-10T22:37:22.327483+0000","last_became_peered":"2023-10-10T22:37:22.327483+0000","last_unstale":"2023-10-10T22:37:22.331152+0000","last_undegraded":"2023-10-10T22:37:22.331152+0000","last_fullsized":"2023-10-10T22:37:22.331152+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335425+0000","last_change":"2023-10-10T22:37:22.331782+0000","last_active":"2023-10-10T22:37:22.335425+0000","last_peered":"2023-10-10T22:37:22.335425+0000","last_clean":"2023-10-10T22:37:22.335425+0000","last_became_active":"2023-10-10T22:37:22.331529+0000","last_became_peered":"2023-10-10T22:37:22.331529+0000","last_unstale":"2023-10-10T22:37:22.335425+0000","last_undegraded":"2023-10-10T22:37:22.335425+0000","last_fullsized":"2023-10-10T22:37:22.335425+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:51.371588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330940+0000","last_change":"2023-10-10T22:37:22.327219+0000","last_active":"2023-10-10T22:37:22.330940+0000","last_peered":"2023-10-10T22:37:22.330940+0000","last_clean":"2023-10-10T22:37:22.330940+0000","last_became_active":"2023-10-10T22:37:22.326966+0000","last_became_peered":"2023-10-10T22:37:22.326966+0000","last_unstale":"2023-10-10T22:37:22.330940+0000","last_undegraded":"2023-10-10T22:37:22.330940+0000","last_fullsized":"2023-10-10T22:37:22.330940+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:43:29.646719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331376+0000","last_change":"2023-10-10T22:37:22.327933+0000","last_active":"2023-10-10T22:37:22.331376+0000","last_peered":"2023-10-10T22:37:22.331376+0000","last_clean":"2023-10-10T22:37:22.331376+0000","last_became_active":"2023-10-10T22:37:22.327538+0000","last_became_peered":"2023-10-10T22:37:22.327538+0000","last_unstale":"2023-10-10T22:37:22.331376+0000","last_undegraded":"2023-10-10T22:37:22.331376+0000","last_fullsized":"2023-10-10T22:37:22.331376+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:17.366872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329720+0000","last_change":"2023-10-10T22:37:22.328638+0000","last_active":"2023-10-10T22:37:22.329720+0000","last_peered":"2023-10-10T22:37:22.329720+0000","last_clean":"2023-10-10T22:37:22.329720+0000","last_became_active":"2023-10-10T22:37:22.328375+0000","last_became_peered":"2023-10-10T22:37:22.328375+0000","last_unstale":"2023-10-10T22:37:22.329720+0000","last_undegraded":"2023-10-10T22:37:22.329720+0000","last_fullsized":"2023-10-10T22:37:22.329720+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:56.447417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336027+0000","last_change":"2023-10-10T22:37:22.332011+0000","last_active":"2023-10-10T22:37:22.336027+0000","last_peered":"2023-10-10T22:37:22.336027+0000","last_clean":"2023-10-10T22:37:22.336027+0000","last_became_active":"2023-10-10T22:37:22.331741+0000","last_became_peered":"2023-10-10T22:37:22.331741+0000","last_unstale":"2023-10-10T22:37:22.336027+0000","last_undegraded":"2023-10-10T22:37:22.336027+0000","last_fullsized":"2023-10-10T22:37:22.336027+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:27.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330594+0000","last_change":"2023-10-10T22:37:22.329122+0000","last_active":"2023-10-10T22:37:22.330594+0000","last_peered":"2023-10-10T22:37:22.330594+0000","last_clean":"2023-10-10T22:37:22.330594+0000","last_became_active":"2023-10-10T22:37:22.328864+0000","last_became_peered":"2023-10-10T22:37:22.328864+0000","last_unstale":"2023-10-10T22:37:22.330594+0000","last_undegraded":"2023-10-10T22:37:22.330594+0000","last_fullsized":"2023-10-10T22:37:22.330594+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338828+0000","last_change":"2023-10-10T22:37:22.333229+0000","last_active":"2023-10-10T22:37:22.338828+0000","last_peered":"2023-10-10T22:37:22.338828+0000","last_clean":"2023-10-10T22:37:22.338828+0000","last_became_active":"2023-10-10T22:37:22.332677+0000","last_became_peered":"2023-10-10T22:37:22.332677+0000","last_unstale":"2023-10-10T22:37:22.338828+0000","last_undegraded":"2023-10-10T22:37:22.338828+0000","last_fullsized":"2023-10-10T22:37:22.338828+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:43:41.226417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345995+0000","last_change":"2023-10-10T22:37:22.342096+0000","last_active":"2023-10-10T22:37:22.345995+0000","last_peered":"2023-10-10T22:37:22.345995+0000","last_clean":"2023-10-10T22:37:22.345995+0000","last_became_active":"2023-10-10T22:37:22.341851+0000","last_became_peered":"2023-10-10T22:37:22.341851+0000","last_unstale":"2023-10-10T22:37:22.345995+0000","last_undegraded":"2023-10-10T22:37:22.345995+0000","last_fullsized":"2023-10-10T22:37:22.345995+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:28:15.665680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332513+0000","last_change":"2023-10-10T22:37:22.329649+0000","last_active":"2023-10-10T22:37:22.332513+0000","last_peered":"2023-10-10T22:37:22.332513+0000","last_clean":"2023-10-10T22:37:22.332513+0000","last_became_active":"2023-10-10T22:37:22.329396+0000","last_became_peered":"2023-10-10T22:37:22.329396+0000","last_unstale":"2023-10-10T22:37:22.332513+0000","last_undegraded":"2023-10-10T22:37:22.332513+0000","last_fullsized":"2023-10-10T22:37:22.332513+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:13:12.738082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343485+0000","last_change":"2023-10-10T22:37:22.339262+0000","last_active":"2023-10-10T22:37:22.343485+0000","last_peered":"2023-10-10T22:37:22.343485+0000","last_clean":"2023-10-10T22:37:22.343485+0000","last_became_active":"2023-10-10T22:37:22.338998+0000","last_became_peered":"2023-10-10T22:37:22.338998+0000","last_unstale":"2023-10-10T22:37:22.343485+0000","last_undegraded":"2023-10-10T22:37:22.343485+0000","last_fullsized":"2023-10-10T22:37:22.343485+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:29.862257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343386+0000","last_change":"2023-10-10T22:37:22.336423+0000","last_active":"2023-10-10T22:37:22.343386+0000","last_peered":"2023-10-10T22:37:22.343386+0000","last_clean":"2023-10-10T22:37:22.343386+0000","last_became_active":"2023-10-10T22:37:22.336115+0000","last_became_peered":"2023-10-10T22:37:22.336115+0000","last_unstale":"2023-10-10T22:37:22.343386+0000","last_undegraded":"2023-10-10T22:37:22.343386+0000","last_fullsized":"2023-10-10T22:37:22.343386+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329138+0000","last_change":"2023-10-10T22:37:22.326865+0000","last_active":"2023-10-10T22:37:22.329138+0000","last_peered":"2023-10-10T22:37:22.329138+0000","last_clean":"2023-10-10T22:37:22.329138+0000","last_became_active":"2023-10-10T22:37:22.326560+0000","last_became_peered":"2023-10-10T22:37:22.326560+0000","last_unstale":"2023-10-10T22:37:22.329138+0000","last_undegraded":"2023-10-10T22:37:22.329138+0000","last_fullsized":"2023-10-10T22:37:22.329138+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:16.097777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332570+0000","last_change":"2023-10-10T22:37:22.331211+0000","last_active":"2023-10-10T22:37:22.332570+0000","last_peered":"2023-10-10T22:37:22.332570+0000","last_clean":"2023-10-10T22:37:22.332570+0000","last_became_active":"2023-10-10T22:37:22.330969+0000","last_became_peered":"2023-10-10T22:37:22.330969+0000","last_unstale":"2023-10-10T22:37:22.332570+0000","last_undegraded":"2023-10-10T22:37:22.332570+0000","last_fullsized":"2023-10-10T22:37:22.332570+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:13.075740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343255+0000","last_change":"2023-10-10T22:37:22.340035+0000","last_active":"2023-10-10T22:37:22.343255+0000","last_peered":"2023-10-10T22:37:22.343255+0000","last_clean":"2023-10-10T22:37:22.343255+0000","last_became_active":"2023-10-10T22:37:22.339704+0000","last_became_peered":"2023-10-10T22:37:22.339704+0000","last_unstale":"2023-10-10T22:37:22.343255+0000","last_undegraded":"2023-10-10T22:37:22.343255+0000","last_fullsized":"2023-10-10T22:37:22.343255+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:57.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"208'4","reported_seq":14,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345983+0000","last_change":"2023-10-10T22:37:21.300780+0000","last_active":"2023-10-10T22:37:22.345983+0000","last_peered":"2023-10-10T22:37:22.345983+0000","last_clean":"2023-10-10T22:37:22.345983+0000","last_became_active":"2023-10-10T22:37:21.300530+0000","last_became_peered":"2023-10-10T22:37:21.300530+0000","last_unstale":"2023-10-10T22:37:22.345983+0000","last_undegraded":"2023-10-10T22:37:22.345983+0000","last_fullsized":"2023-10-10T22:37:22.345983+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:17.662491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325583+0000","last_change":"2023-10-10T22:37:22.324305+0000","last_active":"2023-10-10T22:37:22.325583+0000","last_peered":"2023-10-10T22:37:22.325583+0000","last_clean":"2023-10-10T22:37:22.325583+0000","last_became_active":"2023-10-10T22:37:22.324056+0000","last_became_peered":"2023-10-10T22:37:22.324056+0000","last_unstale":"2023-10-10T22:37:22.325583+0000","last_undegraded":"2023-10-10T22:37:22.325583+0000","last_fullsized":"2023-10-10T22:37:22.325583+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347552+0000","last_change":"2023-10-10T22:37:21.308912+0000","last_active":"2023-10-10T22:37:22.347552+0000","last_peered":"2023-10-10T22:37:22.347552+0000","last_clean":"2023-10-10T22:37:22.347552+0000","last_became_active":"2023-10-10T22:37:21.308582+0000","last_became_peered":"2023-10-10T22:37:21.308582+0000","last_unstale":"2023-10-10T22:37:22.347552+0000","last_undegraded":"2023-10-10T22:37:22.347552+0000","last_fullsized":"2023-10-10T22:37:22.347552+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:09.380526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338697+0000","last_change":"2023-10-10T22:37:22.332552+0000","last_active":"2023-10-10T22:37:22.338697+0000","last_peered":"2023-10-10T22:37:22.338697+0000","last_clean":"2023-10-10T22:37:22.338697+0000","last_became_active":"2023-10-10T22:37:22.332000+0000","last_became_peered":"2023-10-10T22:37:22.332000+0000","last_unstale":"2023-10-10T22:37:22.338697+0000","last_undegraded":"2023-10-10T22:37:22.338697+0000","last_fullsized":"2023-10-10T22:37:22.338697+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:45.352813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344219+0000","last_change":"2023-10-10T22:37:21.310535+0000","last_active":"2023-10-10T22:37:22.344219+0000","last_peered":"2023-10-10T22:37:22.344219+0000","last_clean":"2023-10-10T22:37:22.344219+0000","last_became_active":"2023-10-10T22:37:21.310298+0000","last_became_peered":"2023-10-10T22:37:21.310298+0000","last_unstale":"2023-10-10T22:37:22.344219+0000","last_undegraded":"2023-10-10T22:37:22.344219+0000","last_fullsized":"2023-10-10T22:37:22.344219+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:45.311116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338523+0000","last_change":"2023-10-10T22:37:22.330595+0000","last_active":"2023-10-10T22:37:22.338523+0000","last_peered":"2023-10-10T22:37:22.338523+0000","last_clean":"2023-10-10T22:37:22.338523+0000","last_became_active":"2023-10-10T22:37:22.330019+0000","last_became_peered":"2023-10-10T22:37:22.330019+0000","last_unstale":"2023-10-10T22:37:22.338523+0000","last_undegraded":"2023-10-10T22:37:22.338523+0000","last_fullsized":"2023-10-10T22:37:22.338523+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345772+0000","last_change":"2023-10-10T22:37:21.305904+0000","last_active":"2023-10-10T22:37:22.345772+0000","last_peered":"2023-10-10T22:37:22.345772+0000","last_clean":"2023-10-10T22:37:22.345772+0000","last_became_active":"2023-10-10T22:37:21.305625+0000","last_became_peered":"2023-10-10T22:37:21.305625+0000","last_unstale":"2023-10-10T22:37:22.345772+0000","last_undegraded":"2023-10-10T22:37:22.345772+0000","last_fullsized":"2023-10-10T22:37:22.345772+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:44.345013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.328680+0000","last_change":"2023-10-10T22:37:22.327712+0000","last_active":"2023-10-10T22:37:22.328680+0000","last_peered":"2023-10-10T22:37:22.328680+0000","last_clean":"2023-10-10T22:37:22.328680+0000","last_became_active":"2023-10-10T22:37:22.327084+0000","last_became_peered":"2023-10-10T22:37:22.327084+0000","last_unstale":"2023-10-10T22:37:22.328680+0000","last_undegraded":"2023-10-10T22:37:22.328680+0000","last_fullsized":"2023-10-10T22:37:22.328680+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:48:53.679083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344271+0000","last_change":"2023-10-10T22:37:21.306550+0000","last_active":"2023-10-10T22:37:22.344271+0000","last_peered":"2023-10-10T22:37:22.344271+0000","last_clean":"2023-10-10T22:37:22.344271+0000","last_became_active":"2023-10-10T22:37:21.306315+0000","last_became_peered":"2023-10-10T22:37:21.306315+0000","last_unstale":"2023-10-10T22:37:22.344271+0000","last_undegraded":"2023-10-10T22:37:22.344271+0000","last_fullsized":"2023-10-10T22:37:22.344271+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:41.427780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343229+0000","last_change":"2023-10-10T22:37:22.339383+0000","last_active":"2023-10-10T22:37:22.343229+0000","last_peered":"2023-10-10T22:37:22.343229+0000","last_clean":"2023-10-10T22:37:22.343229+0000","last_became_active":"2023-10-10T22:37:22.339121+0000","last_became_peered":"2023-10-10T22:37:22.339121+0000","last_unstale":"2023-10-10T22:37:22.343229+0000","last_undegraded":"2023-10-10T22:37:22.343229+0000","last_fullsized":"2023-10-10T22:37:22.343229+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:23.304666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346268+0000","last_change":"2023-10-10T22:37:21.311535+0000","last_active":"2023-10-10T22:37:22.346268+0000","last_peered":"2023-10-10T22:37:22.346268+0000","last_clean":"2023-10-10T22:37:22.346268+0000","last_became_active":"2023-10-10T22:37:21.311272+0000","last_became_peered":"2023-10-10T22:37:21.311272+0000","last_unstale":"2023-10-10T22:37:22.346268+0000","last_undegraded":"2023-10-10T22:37:22.346268+0000","last_fullsized":"2023-10-10T22:37:22.346268+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:56.463951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343480+0000","last_change":"2023-10-10T22:37:22.340669+0000","last_active":"2023-10-10T22:37:22.343480+0000","last_peered":"2023-10-10T22:37:22.343480+0000","last_clean":"2023-10-10T22:37:22.343480+0000","last_became_active":"2023-10-10T22:37:22.340417+0000","last_became_peered":"2023-10-10T22:37:22.340417+0000","last_unstale":"2023-10-10T22:37:22.343480+0000","last_undegraded":"2023-10-10T22:37:22.343480+0000","last_fullsized":"2023-10-10T22:37:22.343480+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:13.429335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323936+0000","last_change":"2023-10-10T22:37:21.311884+0000","last_active":"2023-10-10T22:37:22.323936+0000","last_peered":"2023-10-10T22:37:22.323936+0000","last_clean":"2023-10-10T22:37:22.323936+0000","last_became_active":"2023-10-10T22:37:21.311253+0000","last_became_peered":"2023-10-10T22:37:21.311253+0000","last_unstale":"2023-10-10T22:37:22.323936+0000","last_undegraded":"2023-10-10T22:37:22.323936+0000","last_fullsized":"2023-10-10T22:37:22.323936+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:32.308434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329066+0000","last_change":"2023-10-10T22:37:22.327563+0000","last_active":"2023-10-10T22:37:22.329066+0000","last_peered":"2023-10-10T22:37:22.329066+0000","last_clean":"2023-10-10T22:37:22.329066+0000","last_became_active":"2023-10-10T22:37:22.327285+0000","last_became_peered":"2023-10-10T22:37:22.327285+0000","last_unstale":"2023-10-10T22:37:22.329066+0000","last_undegraded":"2023-10-10T22:37:22.329066+0000","last_fullsized":"2023-10-10T22:37:22.329066+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:10.265065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322635+0000","last_change":"2023-10-10T22:37:21.304131+0000","last_active":"2023-10-10T22:37:22.322635+0000","last_peered":"2023-10-10T22:37:22.322635+0000","last_clean":"2023-10-10T22:37:22.322635+0000","last_became_active":"2023-10-10T22:37:21.303862+0000","last_became_peered":"2023-10-10T22:37:21.303862+0000","last_unstale":"2023-10-10T22:37:22.322635+0000","last_undegraded":"2023-10-10T22:37:22.322635+0000","last_fullsized":"2023-10-10T22:37:22.322635+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:11.264533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.334236+0000","last_change":"2023-10-10T22:37:22.326514+0000","last_active":"2023-10-10T22:37:22.334236+0000","last_peered":"2023-10-10T22:37:22.334236+0000","last_clean":"2023-10-10T22:37:22.334236+0000","last_became_active":"2023-10-10T22:37:22.326241+0000","last_became_peered":"2023-10-10T22:37:22.326241+0000","last_unstale":"2023-10-10T22:37:22.334236+0000","last_undegraded":"2023-10-10T22:37:22.334236+0000","last_fullsized":"2023-10-10T22:37:22.334236+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.317579+0000","last_change":"2023-10-10T22:37:21.307712+0000","last_active":"2023-10-10T22:37:22.317579+0000","last_peered":"2023-10-10T22:37:22.317579+0000","last_clean":"2023-10-10T22:37:22.317579+0000","last_became_active":"2023-10-10T22:37:21.307419+0000","last_became_peered":"2023-10-10T22:37:21.307419+0000","last_unstale":"2023-10-10T22:37:22.317579+0000","last_undegraded":"2023-10-10T22:37:22.317579+0000","last_fullsized":"2023-10-10T22:37:22.317579+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:09:38.945874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332403+0000","last_change":"2023-10-10T22:37:22.327109+0000","last_active":"2023-10-10T22:37:22.332403+0000","last_peered":"2023-10-10T22:37:22.332403+0000","last_clean":"2023-10-10T22:37:22.332403+0000","last_became_active":"2023-10-10T22:37:22.326801+0000","last_became_peered":"2023-10-10T22:37:22.326801+0000","last_unstale":"2023-10-10T22:37:22.332403+0000","last_undegraded":"2023-10-10T22:37:22.332403+0000","last_fullsized":"2023-10-10T22:37:22.332403+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:38.738632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"208'3","reported_seq":13,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344456+0000","last_change":"2023-10-10T22:37:21.304909+0000","last_active":"2023-10-10T22:37:22.344456+0000","last_peered":"2023-10-10T22:37:22.344456+0000","last_clean":"2023-10-10T22:37:22.344456+0000","last_became_active":"2023-10-10T22:37:21.304642+0000","last_became_peered":"2023-10-10T22:37:21.304642+0000","last_unstale":"2023-10-10T22:37:22.344456+0000","last_undegraded":"2023-10-10T22:37:22.344456+0000","last_fullsized":"2023-10-10T22:37:22.344456+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:28:25.674622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341955+0000","last_change":"2023-10-10T22:37:22.332831+0000","last_active":"2023-10-10T22:37:22.341955+0000","last_peered":"2023-10-10T22:37:22.341955+0000","last_clean":"2023-10-10T22:37:22.341955+0000","last_became_active":"2023-10-10T22:37:22.332577+0000","last_became_peered":"2023-10-10T22:37:22.332577+0000","last_unstale":"2023-10-10T22:37:22.341955+0000","last_undegraded":"2023-10-10T22:37:22.341955+0000","last_fullsized":"2023-10-10T22:37:22.341955+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:49.337687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"208'6","reported_seq":16,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348666+0000","last_change":"2023-10-10T22:37:21.302443+0000","last_active":"2023-10-10T22:37:22.348666+0000","last_peered":"2023-10-10T22:37:22.348666+0000","last_clean":"2023-10-10T22:37:22.348666+0000","last_became_active":"2023-10-10T22:37:21.302148+0000","last_became_peered":"2023-10-10T22:37:21.302148+0000","last_unstale":"2023-10-10T22:37:22.348666+0000","last_undegraded":"2023-10-10T22:37:22.348666+0000","last_fullsized":"2023-10-10T22:37:22.348666+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:52:34.012755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329179+0000","last_change":"2023-10-10T22:37:22.327958+0000","last_active":"2023-10-10T22:37:22.329179+0000","last_peered":"2023-10-10T22:37:22.329179+0000","last_clean":"2023-10-10T22:37:22.329179+0000","last_became_active":"2023-10-10T22:37:22.327720+0000","last_became_peered":"2023-10-10T22:37:22.327720+0000","last_unstale":"2023-10-10T22:37:22.329179+0000","last_undegraded":"2023-10-10T22:37:22.329179+0000","last_fullsized":"2023-10-10T22:37:22.329179+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:12.272333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351731+0000","last_change":"2023-10-10T22:37:21.311578+0000","last_active":"2023-10-10T22:37:22.351731+0000","last_peered":"2023-10-10T22:37:22.351731+0000","last_clean":"2023-10-10T22:37:22.351731+0000","last_became_active":"2023-10-10T22:37:21.311276+0000","last_became_peered":"2023-10-10T22:37:21.311276+0000","last_unstale":"2023-10-10T22:37:22.351731+0000","last_undegraded":"2023-10-10T22:37:22.351731+0000","last_fullsized":"2023-10-10T22:37:22.351731+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:10:25.362844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332363+0000","last_change":"2023-10-10T22:37:22.327787+0000","last_active":"2023-10-10T22:37:22.332363+0000","last_peered":"2023-10-10T22:37:22.332363+0000","last_clean":"2023-10-10T22:37:22.332363+0000","last_became_active":"2023-10-10T22:37:22.327459+0000","last_became_peered":"2023-10-10T22:37:22.327459+0000","last_unstale":"2023-10-10T22:37:22.332363+0000","last_undegraded":"2023-10-10T22:37:22.332363+0000","last_fullsized":"2023-10-10T22:37:22.332363+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313273+0000","last_change":"2023-10-10T22:37:21.309120+0000","last_active":"2023-10-10T22:37:22.313273+0000","last_peered":"2023-10-10T22:37:22.313273+0000","last_clean":"2023-10-10T22:37:22.313273+0000","last_became_active":"2023-10-10T22:37:21.308861+0000","last_became_peered":"2023-10-10T22:37:21.308861+0000","last_unstale":"2023-10-10T22:37:22.313273+0000","last_undegraded":"2023-10-10T22:37:22.313273+0000","last_fullsized":"2023-10-10T22:37:22.313273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:13:59.242392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338319+0000","last_change":"2023-10-10T22:37:22.330901+0000","last_active":"2023-10-10T22:37:22.338319+0000","last_peered":"2023-10-10T22:37:22.338319+0000","last_clean":"2023-10-10T22:37:22.338319+0000","last_became_active":"2023-10-10T22:37:22.327027+0000","last_became_peered":"2023-10-10T22:37:22.327027+0000","last_unstale":"2023-10-10T22:37:22.338319+0000","last_undegraded":"2023-10-10T22:37:22.338319+0000","last_fullsized":"2023-10-10T22:37:22.338319+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323309+0000","last_change":"2023-10-10T22:37:21.313404+0000","last_active":"2023-10-10T22:37:22.323309+0000","last_peered":"2023-10-10T22:37:22.323309+0000","last_clean":"2023-10-10T22:37:22.323309+0000","last_became_active":"2023-10-10T22:37:21.313147+0000","last_became_peered":"2023-10-10T22:37:21.313147+0000","last_unstale":"2023-10-10T22:37:22.323309+0000","last_undegraded":"2023-10-10T22:37:22.323309+0000","last_fullsized":"2023-10-10T22:37:22.323309+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:59.610628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341852+0000","last_change":"2023-10-10T22:37:22.331938+0000","last_active":"2023-10-10T22:37:22.341852+0000","last_peered":"2023-10-10T22:37:22.341852+0000","last_clean":"2023-10-10T22:37:22.341852+0000","last_became_active":"2023-10-10T22:37:22.331427+0000","last_became_peered":"2023-10-10T22:37:22.331427+0000","last_unstale":"2023-10-10T22:37:22.341852+0000","last_undegraded":"2023-10-10T22:37:22.341852+0000","last_fullsized":"2023-10-10T22:37:22.341852+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"208'8","reported_seq":18,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351735+0000","last_change":"2023-10-10T22:37:21.312079+0000","last_active":"2023-10-10T22:37:22.351735+0000","last_peered":"2023-10-10T22:37:22.351735+0000","last_clean":"2023-10-10T22:37:22.351735+0000","last_became_active":"2023-10-10T22:37:21.311201+0000","last_became_peered":"2023-10-10T22:37:21.311201+0000","last_unstale":"2023-10-10T22:37:22.351735+0000","last_undegraded":"2023-10-10T22:37:22.351735+0000","last_fullsized":"2023-10-10T22:37:22.351735+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:46.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335508+0000","last_change":"2023-10-10T22:37:22.329719+0000","last_active":"2023-10-10T22:37:22.335508+0000","last_peered":"2023-10-10T22:37:22.335508+0000","last_clean":"2023-10-10T22:37:22.335508+0000","last_became_active":"2023-10-10T22:37:22.329479+0000","last_became_peered":"2023-10-10T22:37:22.329479+0000","last_unstale":"2023-10-10T22:37:22.335508+0000","last_undegraded":"2023-10-10T22:37:22.335508+0000","last_fullsized":"2023-10-10T22:37:22.335508+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344267+0000","last_change":"2023-10-10T22:37:21.307317+0000","last_active":"2023-10-10T22:37:22.344267+0000","last_peered":"2023-10-10T22:37:22.344267+0000","last_clean":"2023-10-10T22:37:22.344267+0000","last_became_active":"2023-10-10T22:37:21.307063+0000","last_became_peered":"2023-10-10T22:37:21.307063+0000","last_unstale":"2023-10-10T22:37:22.344267+0000","last_undegraded":"2023-10-10T22:37:22.344267+0000","last_fullsized":"2023-10-10T22:37:22.344267+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:44:04.204820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338262+0000","last_change":"2023-10-10T22:37:22.331546+0000","last_active":"2023-10-10T22:37:22.338262+0000","last_peered":"2023-10-10T22:37:22.338262+0000","last_clean":"2023-10-10T22:37:22.338262+0000","last_became_active":"2023-10-10T22:37:22.327510+0000","last_became_peered":"2023-10-10T22:37:22.327510+0000","last_unstale":"2023-10-10T22:37:22.338262+0000","last_undegraded":"2023-10-10T22:37:22.338262+0000","last_fullsized":"2023-10-10T22:37:22.338262+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346273+0000","last_change":"2023-10-10T22:37:21.315652+0000","last_active":"2023-10-10T22:37:22.346273+0000","last_peered":"2023-10-10T22:37:22.346273+0000","last_clean":"2023-10-10T22:37:22.346273+0000","last_became_active":"2023-10-10T22:37:21.315368+0000","last_became_peered":"2023-10-10T22:37:21.315368+0000","last_unstale":"2023-10-10T22:37:22.346273+0000","last_undegraded":"2023-10-10T22:37:22.346273+0000","last_fullsized":"2023-10-10T22:37:22.346273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:00:52.565481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343258+0000","last_change":"2023-10-10T22:37:22.334001+0000","last_active":"2023-10-10T22:37:22.343258+0000","last_peered":"2023-10-10T22:37:22.343258+0000","last_clean":"2023-10-10T22:37:22.343258+0000","last_became_active":"2023-10-10T22:37:22.333748+0000","last_became_peered":"2023-10-10T22:37:22.333748+0000","last_unstale":"2023-10-10T22:37:22.343258+0000","last_undegraded":"2023-10-10T22:37:22.343258+0000","last_fullsized":"2023-10-10T22:37:22.343258+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:33.316234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351642+0000","last_change":"2023-10-10T22:37:21.311600+0000","last_active":"2023-10-10T22:37:22.351642+0000","last_peered":"2023-10-10T22:37:22.351642+0000","last_clean":"2023-10-10T22:37:22.351642+0000","last_became_active":"2023-10-10T22:37:21.311310+0000","last_became_peered":"2023-10-10T22:37:21.311310+0000","last_unstale":"2023-10-10T22:37:22.351642+0000","last_undegraded":"2023-10-10T22:37:22.351642+0000","last_fullsized":"2023-10-10T22:37:22.351642+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:28.854458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338327+0000","last_change":"2023-10-10T22:37:22.335829+0000","last_active":"2023-10-10T22:37:22.338327+0000","last_peered":"2023-10-10T22:37:22.338327+0000","last_clean":"2023-10-10T22:37:22.338327+0000","last_became_active":"2023-10-10T22:37:22.335582+0000","last_became_peered":"2023-10-10T22:37:22.335582+0000","last_unstale":"2023-10-10T22:37:22.338327+0000","last_undegraded":"2023-10-10T22:37:22.338327+0000","last_fullsized":"2023-10-10T22:37:22.338327+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:10:26.370643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325907+0000","last_change":"2023-10-10T22:37:21.308409+0000","last_active":"2023-10-10T22:37:22.325907+0000","last_peered":"2023-10-10T22:37:22.325907+0000","last_clean":"2023-10-10T22:37:22.325907+0000","last_became_active":"2023-10-10T22:37:21.308069+0000","last_became_peered":"2023-10-10T22:37:21.308069+0000","last_unstale":"2023-10-10T22:37:22.325907+0000","last_undegraded":"2023-10-10T22:37:22.325907+0000","last_fullsized":"2023-10-10T22:37:22.325907+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:55.439618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324866+0000","last_change":"2023-10-10T22:37:22.322788+0000","last_active":"2023-10-10T22:37:22.324866+0000","last_peered":"2023-10-10T22:37:22.324866+0000","last_clean":"2023-10-10T22:37:22.324866+0000","last_became_active":"2023-10-10T22:37:22.322526+0000","last_became_peered":"2023-10-10T22:37:22.322526+0000","last_unstale":"2023-10-10T22:37:22.324866+0000","last_undegraded":"2023-10-10T22:37:22.324866+0000","last_fullsized":"2023-10-10T22:37:22.324866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346717+0000","last_change":"2023-10-10T22:37:21.314705+0000","last_active":"2023-10-10T22:37:22.346717+0000","last_peered":"2023-10-10T22:37:22.346717+0000","last_clean":"2023-10-10T22:37:22.346717+0000","last_became_active":"2023-10-10T22:37:21.314394+0000","last_became_peered":"2023-10-10T22:37:21.314394+0000","last_unstale":"2023-10-10T22:37:22.346717+0000","last_undegraded":"2023-10-10T22:37:22.346717+0000","last_fullsized":"2023-10-10T22:37:22.346717+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:49.346015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.339779+0000","last_change":"2023-10-10T22:37:22.334339+0000","last_active":"2023-10-10T22:37:22.339779+0000","last_peered":"2023-10-10T22:37:22.339779+0000","last_clean":"2023-10-10T22:37:22.339779+0000","last_became_active":"2023-10-10T22:37:22.334070+0000","last_became_peered":"2023-10-10T22:37:22.334070+0000","last_unstale":"2023-10-10T22:37:22.339779+0000","last_undegraded":"2023-10-10T22:37:22.339779+0000","last_fullsized":"2023-10-10T22:37:22.339779+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316614+0000","last_change":"2023-10-10T22:37:21.308062+0000","last_active":"2023-10-10T22:37:22.316614+0000","last_peered":"2023-10-10T22:37:22.316614+0000","last_clean":"2023-10-10T22:37:22.316614+0000","last_became_active":"2023-10-10T22:37:21.307766+0000","last_became_peered":"2023-10-10T22:37:21.307766+0000","last_unstale":"2023-10-10T22:37:22.316614+0000","last_undegraded":"2023-10-10T22:37:22.316614+0000","last_fullsized":"2023-10-10T22:37:22.316614+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:17.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.334706+0000","last_change":"2023-10-10T22:37:22.333100+0000","last_active":"2023-10-10T22:37:22.334706+0000","last_peered":"2023-10-10T22:37:22.334706+0000","last_clean":"2023-10-10T22:37:22.334706+0000","last_became_active":"2023-10-10T22:37:22.332807+0000","last_became_peered":"2023-10-10T22:37:22.332807+0000","last_unstale":"2023-10-10T22:37:22.334706+0000","last_undegraded":"2023-10-10T22:37:22.334706+0000","last_fullsized":"2023-10-10T22:37:22.334706+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316751+0000","last_change":"2023-10-10T22:37:21.309163+0000","last_active":"2023-10-10T22:37:22.316751+0000","last_peered":"2023-10-10T22:37:22.316751+0000","last_clean":"2023-10-10T22:37:22.316751+0000","last_became_active":"2023-10-10T22:37:21.308910+0000","last_became_peered":"2023-10-10T22:37:21.308910+0000","last_unstale":"2023-10-10T22:37:22.316751+0000","last_undegraded":"2023-10-10T22:37:22.316751+0000","last_fullsized":"2023-10-10T22:37:22.316751+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:15:42.499573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322365+0000","last_change":"2023-10-10T22:37:22.321715+0000","last_active":"2023-10-10T22:37:22.322365+0000","last_peered":"2023-10-10T22:37:22.322365+0000","last_clean":"2023-10-10T22:37:22.322365+0000","last_became_active":"2023-10-10T22:37:22.321465+0000","last_became_peered":"2023-10-10T22:37:22.321465+0000","last_unstale":"2023-10-10T22:37:22.322365+0000","last_undegraded":"2023-10-10T22:37:22.322365+0000","last_fullsized":"2023-10-10T22:37:22.322365+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:03:49.499590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314924+0000","last_change":"2023-10-10T22:37:21.305255+0000","last_active":"2023-10-10T22:37:22.314924+0000","last_peered":"2023-10-10T22:37:22.314924+0000","last_clean":"2023-10-10T22:37:22.314924+0000","last_became_active":"2023-10-10T22:37:21.304967+0000","last_became_peered":"2023-10-10T22:37:21.304967+0000","last_unstale":"2023-10-10T22:37:22.314924+0000","last_undegraded":"2023-10-10T22:37:22.314924+0000","last_fullsized":"2023-10-10T22:37:22.314924+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:37.730832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.326134+0000","last_change":"2023-10-10T22:37:22.321857+0000","last_active":"2023-10-10T22:37:22.326134+0000","last_peered":"2023-10-10T22:37:22.326134+0000","last_clean":"2023-10-10T22:37:22.326134+0000","last_became_active":"2023-10-10T22:37:22.321606+0000","last_became_peered":"2023-10-10T22:37:22.321606+0000","last_unstale":"2023-10-10T22:37:22.326134+0000","last_undegraded":"2023-10-10T22:37:22.326134+0000","last_fullsized":"2023-10-10T22:37:22.326134+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:23.523345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348933+0000","last_change":"2023-10-10T22:37:21.313185+0000","last_active":"2023-10-10T22:37:22.348933+0000","last_peered":"2023-10-10T22:37:22.348933+0000","last_clean":"2023-10-10T22:37:22.348933+0000","last_became_active":"2023-10-10T22:37:21.313009+0000","last_became_peered":"2023-10-10T22:37:21.313009+0000","last_unstale":"2023-10-10T22:37:22.348933+0000","last_undegraded":"2023-10-10T22:37:22.348933+0000","last_fullsized":"2023-10-10T22:37:22.348933+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:42:23.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341866+0000","last_change":"2023-10-10T22:37:22.332898+0000","last_active":"2023-10-10T22:37:22.341866+0000","last_peered":"2023-10-10T22:37:22.341866+0000","last_clean":"2023-10-10T22:37:22.341866+0000","last_became_active":"2023-10-10T22:37:22.332640+0000","last_became_peered":"2023-10-10T22:37:22.332640+0000","last_unstale":"2023-10-10T22:37:22.341866+0000","last_undegraded":"2023-10-10T22:37:22.341866+0000","last_fullsized":"2023-10-10T22:37:22.341866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.312873+0000","last_change":"2023-10-10T22:37:21.305064+0000","last_active":"2023-10-10T22:37:22.312873+0000","last_peered":"2023-10-10T22:37:22.312873+0000","last_clean":"2023-10-10T22:37:22.312873+0000","last_became_active":"2023-10-10T22:37:21.304822+0000","last_became_peered":"2023-10-10T22:37:21.304822+0000","last_unstale":"2023-10-10T22:37:22.312873+0000","last_undegraded":"2023-10-10T22:37:22.312873+0000","last_fullsized":"2023-10-10T22:37:22.312873+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:53:36.582199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338517+0000","last_change":"2023-10-10T22:37:22.336111+0000","last_active":"2023-10-10T22:37:22.338517+0000","last_peered":"2023-10-10T22:37:22.338517+0000","last_clean":"2023-10-10T22:37:22.338517+0000","last_became_active":"2023-10-10T22:37:22.335816+0000","last_became_peered":"2023-10-10T22:37:22.335816+0000","last_unstale":"2023-10-10T22:37:22.338517+0000","last_undegraded":"2023-10-10T22:37:22.338517+0000","last_fullsized":"2023-10-10T22:37:22.338517+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:49:21.033563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313016+0000","last_change":"2023-10-10T22:37:21.305679+0000","last_active":"2023-10-10T22:37:22.313016+0000","last_peered":"2023-10-10T22:37:22.313016+0000","last_clean":"2023-10-10T22:37:22.313016+0000","last_became_active":"2023-10-10T22:37:21.305426+0000","last_became_peered":"2023-10-10T22:37:21.305426+0000","last_unstale":"2023-10-10T22:37:22.313016+0000","last_undegraded":"2023-10-10T22:37:22.313016+0000","last_fullsized":"2023-10-10T22:37:22.313016+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:09.257265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343285+0000","last_change":"2023-10-10T22:37:22.340538+0000","last_active":"2023-10-10T22:37:22.343285+0000","last_peered":"2023-10-10T22:37:22.343285+0000","last_clean":"2023-10-10T22:37:22.343285+0000","last_became_active":"2023-10-10T22:37:22.340297+0000","last_became_peered":"2023-10-10T22:37:22.340297+0000","last_unstale":"2023-10-10T22:37:22.343285+0000","last_undegraded":"2023-10-10T22:37:22.343285+0000","last_fullsized":"2023-10-10T22:37:22.343285+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:15:40.123577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323634+0000","last_change":"2023-10-10T22:37:21.315894+0000","last_active":"2023-10-10T22:37:22.323634+0000","last_peered":"2023-10-10T22:37:22.323634+0000","last_clean":"2023-10-10T22:37:22.323634+0000","last_became_active":"2023-10-10T22:37:21.315627+0000","last_became_peered":"2023-10-10T22:37:21.315627+0000","last_unstale":"2023-10-10T22:37:22.323634+0000","last_undegraded":"2023-10-10T22:37:22.323634+0000","last_fullsized":"2023-10-10T22:37:22.323634+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:57.625726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343203+0000","last_change":"2023-10-10T22:37:22.337620+0000","last_active":"2023-10-10T22:37:22.343203+0000","last_peered":"2023-10-10T22:37:22.343203+0000","last_clean":"2023-10-10T22:37:22.343203+0000","last_became_active":"2023-10-10T22:37:22.337376+0000","last_became_peered":"2023-10-10T22:37:22.337376+0000","last_unstale":"2023-10-10T22:37:22.343203+0000","last_undegraded":"2023-10-10T22:37:22.343203+0000","last_fullsized":"2023-10-10T22:37:22.343203+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:02:20.851800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316514+0000","last_change":"2023-10-10T22:37:21.306687+0000","last_active":"2023-10-10T22:37:22.316514+0000","last_peered":"2023-10-10T22:37:22.316514+0000","last_clean":"2023-10-10T22:37:22.316514+0000","last_became_active":"2023-10-10T22:37:21.306312+0000","last_became_peered":"2023-10-10T22:37:21.306312+0000","last_unstale":"2023-10-10T22:37:22.316514+0000","last_undegraded":"2023-10-10T22:37:22.316514+0000","last_fullsized":"2023-10-10T22:37:22.316514+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:12.421535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345813+0000","last_change":"2023-10-10T22:37:22.340754+0000","last_active":"2023-10-10T22:37:22.345813+0000","last_peered":"2023-10-10T22:37:22.345813+0000","last_clean":"2023-10-10T22:37:22.345813+0000","last_became_active":"2023-10-10T22:37:22.340438+0000","last_became_peered":"2023-10-10T22:37:22.340438+0000","last_unstale":"2023-10-10T22:37:22.345813+0000","last_undegraded":"2023-10-10T22:37:22.345813+0000","last_fullsized":"2023-10-10T22:37:22.345813+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:44:45.896568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314997+0000","last_change":"2023-10-10T22:37:21.305173+0000","last_active":"2023-10-10T22:37:22.314997+0000","last_peered":"2023-10-10T22:37:22.314997+0000","last_clean":"2023-10-10T22:37:22.314997+0000","last_became_active":"2023-10-10T22:37:21.304872+0000","last_became_peered":"2023-10-10T22:37:21.304872+0000","last_unstale":"2023-10-10T22:37:22.314997+0000","last_undegraded":"2023-10-10T22:37:22.314997+0000","last_fullsized":"2023-10-10T22:37:22.314997+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:44.345013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.327874+0000","last_change":"2023-10-10T22:37:22.325426+0000","last_active":"2023-10-10T22:37:22.327874+0000","last_peered":"2023-10-10T22:37:22.327874+0000","last_clean":"2023-10-10T22:37:22.327874+0000","last_became_active":"2023-10-10T22:37:22.324867+0000","last_became_peered":"2023-10-10T22:37:22.324867+0000","last_unstale":"2023-10-10T22:37:22.327874+0000","last_undegraded":"2023-10-10T22:37:22.327874+0000","last_fullsized":"2023-10-10T22:37:22.327874+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.318611+0000","last_change":"2023-10-10T22:37:21.301087+0000","last_active":"2023-10-10T22:37:22.318611+0000","last_peered":"2023-10-10T22:37:22.318611+0000","last_clean":"2023-10-10T22:37:22.318611+0000","last_became_active":"2023-10-10T22:37:21.300837+0000","last_became_peered":"2023-10-10T22:37:21.300837+0000","last_unstale":"2023-10-10T22:37:22.318611+0000","last_undegraded":"2023-10-10T22:37:22.318611+0000","last_fullsized":"2023-10-10T22:37:22.318611+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:58.684383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335239+0000","last_change":"2023-10-10T22:37:22.332348+0000","last_active":"2023-10-10T22:37:22.335239+0000","last_peered":"2023-10-10T22:37:22.335239+0000","last_clean":"2023-10-10T22:37:22.335239+0000","last_became_active":"2023-10-10T22:37:22.332119+0000","last_became_peered":"2023-10-10T22:37:22.332119+0000","last_unstale":"2023-10-10T22:37:22.335239+0000","last_undegraded":"2023-10-10T22:37:22.335239+0000","last_fullsized":"2023-10-10T22:37:22.335239+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:56.404086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.315755+0000","last_change":"2023-10-10T22:37:21.308580+0000","last_active":"2023-10-10T22:37:22.315755+0000","last_peered":"2023-10-10T22:37:22.315755+0000","last_clean":"2023-10-10T22:37:22.315755+0000","last_became_active":"2023-10-10T22:37:21.308346+0000","last_became_peered":"2023-10-10T22:37:21.308346+0000","last_unstale":"2023-10-10T22:37:22.315755+0000","last_undegraded":"2023-10-10T22:37:22.315755+0000","last_fullsized":"2023-10-10T22:37:22.315755+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:22.763388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330445+0000","last_change":"2023-10-10T22:37:22.326456+0000","last_active":"2023-10-10T22:37:22.330445+0000","last_peered":"2023-10-10T22:37:22.330445+0000","last_clean":"2023-10-10T22:37:22.330445+0000","last_became_active":"2023-10-10T22:37:22.326179+0000","last_became_peered":"2023-10-10T22:37:22.326179+0000","last_unstale":"2023-10-10T22:37:22.330445+0000","last_undegraded":"2023-10-10T22:37:22.330445+0000","last_fullsized":"2023-10-10T22:37:22.330445+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:34:29.226879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324236+0000","last_change":"2023-10-10T22:37:21.309121+0000","last_active":"2023-10-10T22:37:22.324236+0000","last_peered":"2023-10-10T22:37:22.324236+0000","last_clean":"2023-10-10T22:37:22.324236+0000","last_became_active":"2023-10-10T22:37:21.308062+0000","last_became_peered":"2023-10-10T22:37:21.308062+0000","last_unstale":"2023-10-10T22:37:22.324236+0000","last_undegraded":"2023-10-10T22:37:22.324236+0000","last_fullsized":"2023-10-10T22:37:22.324236+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:34.472180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1145,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324105+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:37:22.324105+0000","last_peered":"2023-10-10T22:37:22.324105+0000","last_clean":"2023-10-10T22:37:22.324105+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:37:22.324105+0000","last_undegraded":"2023-10-10T22:37:22.324105+0000","last_fullsized":"2023-10-10T22:37:22.324105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543275,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312716,"kb_used_data":3140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059124,"statfs":{"total":96636764160,"available":96316542976,"internally_reserved":0,"allocated":3215360,"data_stored":1905675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.026},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":1.073,"15min":1.081},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":1.145,"15min":1.145},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":1.0700000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.59899999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":1.0009999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.503,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.878}]},{"osd":4,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":0.82299999999999995,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":1.012},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.91800000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.024},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":0.999,"15min":1.079},"last":0.78700000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.042},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.86199999999999999,"5min":1.046,"15min":1.125},"last":0.95399999999999996}]}]},{"osd":6,"up_from":14,"seq":60129543274,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1315203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":1.0289999999999999,"15min":1.1080000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.751},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.52900000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.0920000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.64500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94299999999999995,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.034,"15min":1.1200000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.0660000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.621,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91200000000000003,"5min":0.97399999999999998,"15min":1.071},"last":0.67100000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":1.778,"15min":1.778},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.42899999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.86899999999999999,"5min":0.996,"15min":1.046},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97299999999999998,"5min":1.827,"15min":1.827},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.63300000000000001}]}]},{"osd":1,"up_from":14,"seq":60129543274,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1316739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.379},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.82999999999999996,"15min":0.88},"last":0.435}]},{"osd":2,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.878,"15min":0.90800000000000003},"last":0.504},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.88800000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.74399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.995,"5min":1.0269999999999999,"15min":1.177},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.008,"5min":1.089,"15min":1.1419999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.2450000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.64300000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.081,"5min":1.1200000000000001,"15min":1.2729999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.155},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.68600000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.2230000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308616,"kb_used_data":3136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063224,"statfs":{"total":96636764160,"available":96320741376,"internally_reserved":0,"allocated":3211264,"data_stored":1905593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.71399999999999997,"15min":0.753},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.433}]},{"osd":2,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.76000000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.85299999999999998},"last":0.501}]},{"osd":3,"last update":"Tue Oct 10 22:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.81100000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0469999999999999,"5min":1.1180000000000001,"15min":1.3340000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.1479999999999999,"15min":1.198},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56899999999999995},"max":{"1min":1.0449999999999999,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.625,"5min":0.54800000000000004,"15min":0.54500000000000004},"max":{"1min":1.1439999999999999,"5min":1.3320000000000001,"15min":1.377},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0449999999999999,"5min":1.274,"15min":1.427},"last":0.81999999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.198,"5min":1.224,"15min":1.2689999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.081,"5min":1.153,"15min":1.153},"last":0.83999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316236,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055604,"statfs":{"total":96636764160,"available":96312938496,"internally_reserved":0,"allocated":2625536,"data_stored":1315869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.317},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.89500000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.85699999999999998,"15min":0.85799999999999998},"last":0.438},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.101,"15min":1.288},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98599999999999999,"5min":1.1220000000000001,"15min":1.325},"last":0.77300000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.147,"15min":1.1970000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82199999999999995,"15min":0.84099999999999997},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.054,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.26},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.093,"5min":1.165,"15min":1.3129999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80600000000000005,"15min":0.83199999999999996},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.181,"15min":1.2609999999999999},"last":0.871}]}]},{"osd":3,"up_from":15,"seq":64424510571,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1315397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.877,"15min":0.877},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.70599999999999996,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":0.99399999999999999},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.04,"5min":1.133,"15min":1.242},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.202,"15min":1.2629999999999999},"last":0.96499999999999997}]},{"osd":5,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.125,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":1.1040000000000001,"15min":1.222},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.099,"5min":1.1539999999999999,"15min":1.212},"last":0.89900000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.54200000000000004},"max":{"1min":0.98899999999999999,"5min":1.274,"15min":1.274},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":0.83499999999999996},"min":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56699999999999995},"max":{"1min":1.097,"5min":1.149,"15min":1.2370000000000001},"last":0.69699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129543276,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1317293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.087},"last":0.435},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.752},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.437},"max":{"1min":0.94099999999999995,"5min":0.95199999999999996,"15min":1.1220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88500000000000001,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.998,"15min":1.073},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.089},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.45200000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.4079999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":1.282},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.94099999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.94099999999999995,"15min":1.0900000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.42199999999999999},"max":{"1min":0.82099999999999995,"5min":0.89600000000000002,"15min":1.0649999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.92100000000000004,"5min":0.96999999999999997,"15min":1.21},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.436},"max":{"1min":0.97399999999999998,"5min":0.97999999999999998,"15min":1.147},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543274,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1315203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":1.006},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.48199999999999998,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.997},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65500000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.98999999999999999,"15min":1.04},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.02},"last":0.76000000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.37},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.01,"5min":1.01,"15min":1.032},"last":0.749}]},{"osd":7,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.623},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.02},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:37:31.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:37:31.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.704+0000 7f34075ff700 1 Processor -- start 2023-10-10T22:37:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.704+0000 7f34075ff700 1 -- start start 2023-10-10T22:37:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.705+0000 7f34075ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3400068550 0x7f3400068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.705+0000 7f34075ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340006ec70 con 0x7f340006f810 2023-10-10T22:37:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.705+0000 7f34075ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000b2e70 con 0x7f340015e010 2023-10-10T22:37:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.705+0000 7f34075ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000b3430 con 0x7f3400068550 2023-10-10T22:37:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f3405b9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f340006f810 0x7f3400159510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41120/0 (socket says 172.21.15.154:41120) 2023-10-10T22:37:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f3405b9c700 1 -- 172.21.15.154:0/2284132291 learned_addr learned my addr 172.21.15.154:0/2284132291 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f340539b700 1 --2- 172.21.15.154:0/2284132291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3400068550 0x7f3400068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f33f7fff700 1 -- 172.21.15.154:0/2284132291 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131001111 0 0) 0x7f340006ec70 con 0x7f340006f810 2023-10-10T22:37:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f33f7fff700 1 -- 172.21.15.154:0/2284132291 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33ec003570 con 0x7f340006f810 2023-10-10T22:37:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f33f7fff700 1 -- 172.21.15.154:0/2284132291 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292800030 0 0) 0x7f34000b2e70 con 0x7f340015e010 2023-10-10T22:37:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f33f7fff700 1 -- 172.21.15.154:0/2284132291 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f340006ec70 con 0x7f340015e010 2023-10-10T22:37:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f340539b700 1 -- 172.21.15.154:0/2284132291 >> v1:172.21.15.179:6789/0 conn(0x7f340015e010 legacy=0x7f340006f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f340539b700 1 -- 172.21.15.154:0/2284132291 >> v1:172.21.15.154:6789/0 conn(0x7f340006f810 legacy=0x7f3400159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.706+0000 7f340539b700 1 -- 172.21.15.154:0/2284132291 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000b3150 con 0x7f3400068550 2023-10-10T22:37:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.707+0000 7f340539b700 1 --2- 172.21.15.154:0/2284132291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3400068550 0x7f3400068920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009910 tx=0x7f33fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d05fde094a6fc78 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.707+0000 7f33f7fff700 1 -- 172.21.15.154:0/2284132291 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc011630 con 0x7f3400068550 2023-10-10T22:37:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.707+0000 7f33f7fff700 1 -- 172.21.15.154:0/2284132291 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc011790 con 0x7f3400068550 2023-10-10T22:37:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.707+0000 7f33f7fff700 1 -- 172.21.15.154:0/2284132291 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc011b30 con 0x7f3400068550 2023-10-10T22:37:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.708+0000 7f34075ff700 1 -- 172.21.15.154:0/2284132291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3400068550 msgr2=0x7f3400068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.708+0000 7f34075ff700 1 --2- 172.21.15.154:0/2284132291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3400068550 0x7f3400068920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009910 tx=0x7f33fc0091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.708+0000 7f34075ff700 1 -- 172.21.15.154:0/2284132291 shutdown_connections 2023-10-10T22:37:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.708+0000 7f34075ff700 1 --2- 172.21.15.154:0/2284132291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3400068550 0x7f3400068920 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.708+0000 7f34075ff700 1 -- 172.21.15.154:0/2284132291 >> 172.21.15.154:0/2284132291 conn(0x7f34000cd480 msgr2=0x7f34000cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.708+0000 7f34075ff700 1 -- 172.21.15.154:0/2284132291 shutdown_connections 2023-10-10T22:37:31.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.708+0000 7f34075ff700 1 -- 172.21.15.154:0/2284132291 wait complete. 2023-10-10T22:37:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.709+0000 7f34075ff700 1 Processor -- start 2023-10-10T22:37:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.709+0000 7f34075ff700 1 -- start start 2023-10-10T22:37:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f34075ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3400068550 0x7f340016a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f34075ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340006f810 0x7f34000ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f34075ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f340015e010 0x7f340016da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f34075ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000ac8f0 con 0x7f340006f810 2023-10-10T22:37:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f34075ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340014dda0 con 0x7f3400068550 2023-10-10T22:37:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f34075ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340014e080 con 0x7f340015e010 2023-10-10T22:37:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f3404b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340006f810 0x7f34000ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f3404b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340006f810 0x7f34000ac3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33204/0 (socket says 172.21.15.154:33204) 2023-10-10T22:37:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f3404b9a700 1 -- 172.21.15.154:0/2407503491 learned_addr learned my addr 172.21.15.154:0/2407503491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.710+0000 7f340539b700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3400068550 0x7f340016a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f3405b9c700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f340015e010 0x7f340016da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f3404b9a700 1 -- 172.21.15.154:0/2407503491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f340015e010 msgr2=0x7f340016da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f3404b9a700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f340015e010 0x7f340016da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f3404b9a700 1 -- 172.21.15.154:0/2407503491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3400068550 msgr2=0x7f340016a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f3404b9a700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3400068550 0x7f340016a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f3404b9a700 1 -- 172.21.15.154:0/2407503491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc009420 con 0x7f340006f810 2023-10-10T22:37:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f340539b700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3400068550 0x7f340016a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f3404b9a700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340006f810 0x7f34000ac3b0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c790 tx=0x7f33f0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f33f57fa700 1 -- 172.21.15.154:0/2407503491 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0010510 con 0x7f340006f810 2023-10-10T22:37:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f33f57fa700 1 -- 172.21.15.154:0/2407503491 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0010670 con 0x7f340006f810 2023-10-10T22:37:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340014e360 con 0x7f340006f810 2023-10-10T22:37:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f33f57fa700 1 -- 172.21.15.154:0/2407503491 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0010a30 con 0x7f340006f810 2023-10-10T22:37:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.711+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340014e920 con 0x7f340006f810 2023-10-10T22:37:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.712+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340004c3c0 con 0x7f340006f810 2023-10-10T22:37:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.713+0000 7f33f57fa700 1 -- 172.21.15.154:0/2407503491 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33f001b3b0 con 0x7f340006f810 2023-10-10T22:37:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.714+0000 7f33f57fa700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f33e4066f30 0x7f33e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.714+0000 7f33f57fa700 1 -- 172.21.15.154:0/2407503491 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f33f00840b0 con 0x7f340006f810 2023-10-10T22:37:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.714+0000 7f340539b700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f33e4066f30 0x7f33e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.715+0000 7f340539b700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f33e4066f30 0x7f33e40693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009860 tx=0x7f33fc017000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.719+0000 7f33f57fa700 1 -- 172.21.15.154:0/2407503491 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33f0051070 con 0x7f340006f810 2023-10-10T22:37:31.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.907+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f340006f5c0 con 0x7f33e4066f30 2023-10-10T22:37:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.915+0000 7f33f57fa700 1 -- 172.21.15.154:0/2407503491 <== mgr.9999 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289564 (secure 0 0 0) 0x7f340006f5c0 con 0x7f33e4066f30 2023-10-10T22:37:31.920 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:31.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.919+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f33e4066f30 msgr2=0x7f33e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:31.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.919+0000 7f34075ff700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f33e4066f30 0x7f33e40693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009860 tx=0x7f33fc017000 comp rx=0 tx=0).stop 2023-10-10T22:37:31.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.919+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340006f810 msgr2=0x7f34000ac3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:31.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.919+0000 7f34075ff700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340006f810 0x7f34000ac3b0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c790 tx=0x7f33f0007e10 comp rx=0 tx=0).stop 2023-10-10T22:37:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.919+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 shutdown_connections 2023-10-10T22:37:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.919+0000 7f34075ff700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f33e4066f30 0x7f33e40693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.919+0000 7f34075ff700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f340015e010 0x7f340016da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.920+0000 7f34075ff700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3400068550 0x7f340016a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.920+0000 7f34075ff700 1 --2- 172.21.15.154:0/2407503491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340006f810 0x7f34000ac3b0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:31.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.920+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 >> 172.21.15.154:0/2407503491 conn(0x7f34000cd480 msgr2=0x7f34000af590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:31.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.920+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 shutdown_connections 2023-10-10T22:37:31.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:31.920+0000 7f34075ff700 1 -- 172.21.15.154:0/2407503491 wait complete. 2023-10-10T22:37:31.925 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:37:31.939 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-10T22:37:31.899709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":624,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461384,"kb_used_data":21640,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752513336,"statfs":{"total":773094113280,"available":770573656064,"internally_reserved":0,"allocated":22159360,"data_stored":11706972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.588866"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343085+0000","last_change":"2023-10-10T22:37:22.336242+0000","last_active":"2023-10-10T22:37:22.343085+0000","last_peered":"2023-10-10T22:37:22.343085+0000","last_clean":"2023-10-10T22:37:22.343085+0000","last_became_active":"2023-10-10T22:37:22.335965+0000","last_became_peered":"2023-10-10T22:37:22.335965+0000","last_unstale":"2023-10-10T22:37:22.343085+0000","last_undegraded":"2023-10-10T22:37:22.343085+0000","last_fullsized":"2023-10-10T22:37:22.343085+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:32:15.779372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343606+0000","last_change":"2023-10-10T22:37:22.338780+0000","last_active":"2023-10-10T22:37:22.343606+0000","last_peered":"2023-10-10T22:37:22.343606+0000","last_clean":"2023-10-10T22:37:22.343606+0000","last_became_active":"2023-10-10T22:37:22.338514+0000","last_became_peered":"2023-10-10T22:37:22.338514+0000","last_unstale":"2023-10-10T22:37:22.343606+0000","last_undegraded":"2023-10-10T22:37:22.343606+0000","last_fullsized":"2023-10-10T22:37:22.343606+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:42:24.305184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330213+0000","last_change":"2023-10-10T22:37:22.323947+0000","last_active":"2023-10-10T22:37:22.330213+0000","last_peered":"2023-10-10T22:37:22.330213+0000","last_clean":"2023-10-10T22:37:22.330213+0000","last_became_active":"2023-10-10T22:37:22.323685+0000","last_became_peered":"2023-10-10T22:37:22.323685+0000","last_unstale":"2023-10-10T22:37:22.330213+0000","last_undegraded":"2023-10-10T22:37:22.330213+0000","last_fullsized":"2023-10-10T22:37:22.330213+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:54:16.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.328709+0000","last_change":"2023-10-10T22:37:22.327145+0000","last_active":"2023-10-10T22:37:22.328709+0000","last_peered":"2023-10-10T22:37:22.328709+0000","last_clean":"2023-10-10T22:37:22.328709+0000","last_became_active":"2023-10-10T22:37:22.326863+0000","last_became_peered":"2023-10-10T22:37:22.326863+0000","last_unstale":"2023-10-10T22:37:22.328709+0000","last_undegraded":"2023-10-10T22:37:22.328709+0000","last_fullsized":"2023-10-10T22:37:22.328709+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:22:05.026292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331732+0000","last_change":"2023-10-10T22:37:22.329074+0000","last_active":"2023-10-10T22:37:22.331732+0000","last_peered":"2023-10-10T22:37:22.331732+0000","last_clean":"2023-10-10T22:37:22.331732+0000","last_became_active":"2023-10-10T22:37:22.328756+0000","last_became_peered":"2023-10-10T22:37:22.328756+0000","last_unstale":"2023-10-10T22:37:22.331732+0000","last_undegraded":"2023-10-10T22:37:22.331732+0000","last_fullsized":"2023-10-10T22:37:22.331732+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:55:55.816244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345969+0000","last_change":"2023-10-10T22:37:22.341498+0000","last_active":"2023-10-10T22:37:22.345969+0000","last_peered":"2023-10-10T22:37:22.345969+0000","last_clean":"2023-10-10T22:37:22.345969+0000","last_became_active":"2023-10-10T22:37:22.341255+0000","last_became_peered":"2023-10-10T22:37:22.341255+0000","last_unstale":"2023-10-10T22:37:22.345969+0000","last_undegraded":"2023-10-10T22:37:22.345969+0000","last_fullsized":"2023-10-10T22:37:22.345969+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:32:00.612130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338966+0000","last_change":"2023-10-10T22:37:22.328393+0000","last_active":"2023-10-10T22:37:22.338966+0000","last_peered":"2023-10-10T22:37:22.338966+0000","last_clean":"2023-10-10T22:37:22.338966+0000","last_became_active":"2023-10-10T22:37:22.328101+0000","last_became_peered":"2023-10-10T22:37:22.328101+0000","last_unstale":"2023-10-10T22:37:22.338966+0000","last_undegraded":"2023-10-10T22:37:22.338966+0000","last_fullsized":"2023-10-10T22:37:22.338966+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:35:42.499747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336008+0000","last_change":"2023-10-10T22:37:22.331181+0000","last_active":"2023-10-10T22:37:22.336008+0000","last_peered":"2023-10-10T22:37:22.336008+0000","last_clean":"2023-10-10T22:37:22.336008+0000","last_became_active":"2023-10-10T22:37:22.330824+0000","last_became_peered":"2023-10-10T22:37:22.330824+0000","last_unstale":"2023-10-10T22:37:22.336008+0000","last_undegraded":"2023-10-10T22:37:22.336008+0000","last_fullsized":"2023-10-10T22:37:22.336008+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:55:29.396879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338211+0000","last_change":"2023-10-10T22:37:22.331320+0000","last_active":"2023-10-10T22:37:22.338211+0000","last_peered":"2023-10-10T22:37:22.338211+0000","last_clean":"2023-10-10T22:37:22.338211+0000","last_became_active":"2023-10-10T22:37:22.331052+0000","last_became_peered":"2023-10-10T22:37:22.331052+0000","last_unstale":"2023-10-10T22:37:22.338211+0000","last_undegraded":"2023-10-10T22:37:22.338211+0000","last_fullsized":"2023-10-10T22:37:22.338211+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325713+0000","last_change":"2023-10-10T22:37:22.325204+0000","last_active":"2023-10-10T22:37:22.325713+0000","last_peered":"2023-10-10T22:37:22.325713+0000","last_clean":"2023-10-10T22:37:22.325713+0000","last_became_active":"2023-10-10T22:37:22.321688+0000","last_became_peered":"2023-10-10T22:37:22.321688+0000","last_unstale":"2023-10-10T22:37:22.325713+0000","last_undegraded":"2023-10-10T22:37:22.325713+0000","last_fullsized":"2023-10-10T22:37:22.325713+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344561+0000","last_change":"2023-10-10T22:37:22.342230+0000","last_active":"2023-10-10T22:37:22.344561+0000","last_peered":"2023-10-10T22:37:22.344561+0000","last_clean":"2023-10-10T22:37:22.344561+0000","last_became_active":"2023-10-10T22:37:22.341026+0000","last_became_peered":"2023-10-10T22:37:22.341026+0000","last_unstale":"2023-10-10T22:37:22.344561+0000","last_undegraded":"2023-10-10T22:37:22.344561+0000","last_fullsized":"2023-10-10T22:37:22.344561+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:10.388326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.334760+0000","last_change":"2023-10-10T22:37:22.332723+0000","last_active":"2023-10-10T22:37:22.334760+0000","last_peered":"2023-10-10T22:37:22.334760+0000","last_clean":"2023-10-10T22:37:22.334760+0000","last_became_active":"2023-10-10T22:37:22.332430+0000","last_became_peered":"2023-10-10T22:37:22.332430+0000","last_unstale":"2023-10-10T22:37:22.334760+0000","last_undegraded":"2023-10-10T22:37:22.334760+0000","last_fullsized":"2023-10-10T22:37:22.334760+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:33.316234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331786+0000","last_change":"2023-10-10T22:37:22.330030+0000","last_active":"2023-10-10T22:37:22.331786+0000","last_peered":"2023-10-10T22:37:22.331786+0000","last_clean":"2023-10-10T22:37:22.331786+0000","last_became_active":"2023-10-10T22:37:22.329676+0000","last_became_peered":"2023-10-10T22:37:22.329676+0000","last_unstale":"2023-10-10T22:37:22.331786+0000","last_undegraded":"2023-10-10T22:37:22.331786+0000","last_fullsized":"2023-10-10T22:37:22.331786+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:48:53.679083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343351+0000","last_change":"2023-10-10T22:37:22.331950+0000","last_active":"2023-10-10T22:37:22.343351+0000","last_peered":"2023-10-10T22:37:22.343351+0000","last_clean":"2023-10-10T22:37:22.343351+0000","last_became_active":"2023-10-10T22:37:22.327964+0000","last_became_peered":"2023-10-10T22:37:22.327964+0000","last_unstale":"2023-10-10T22:37:22.343351+0000","last_undegraded":"2023-10-10T22:37:22.343351+0000","last_fullsized":"2023-10-10T22:37:22.343351+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:29.862257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341256+0000","last_change":"2023-10-10T22:37:22.337671+0000","last_active":"2023-10-10T22:37:22.341256+0000","last_peered":"2023-10-10T22:37:22.341256+0000","last_clean":"2023-10-10T22:37:22.341256+0000","last_became_active":"2023-10-10T22:37:22.337359+0000","last_became_peered":"2023-10-10T22:37:22.337359+0000","last_unstale":"2023-10-10T22:37:22.341256+0000","last_undegraded":"2023-10-10T22:37:22.341256+0000","last_fullsized":"2023-10-10T22:37:22.341256+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:58:51.912078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343867+0000","last_change":"2023-10-10T22:37:22.341039+0000","last_active":"2023-10-10T22:37:22.343867+0000","last_peered":"2023-10-10T22:37:22.343867+0000","last_clean":"2023-10-10T22:37:22.343867+0000","last_became_active":"2023-10-10T22:37:22.340752+0000","last_became_peered":"2023-10-10T22:37:22.340752+0000","last_unstale":"2023-10-10T22:37:22.343867+0000","last_undegraded":"2023-10-10T22:37:22.343867+0000","last_fullsized":"2023-10-10T22:37:22.343867+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:31:20.851558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332530+0000","last_change":"2023-10-10T22:37:22.330693+0000","last_active":"2023-10-10T22:37:22.332530+0000","last_peered":"2023-10-10T22:37:22.332530+0000","last_clean":"2023-10-10T22:37:22.332530+0000","last_became_active":"2023-10-10T22:37:22.330422+0000","last_became_peered":"2023-10-10T22:37:22.330422+0000","last_unstale":"2023-10-10T22:37:22.332530+0000","last_undegraded":"2023-10-10T22:37:22.332530+0000","last_fullsized":"2023-10-10T22:37:22.332530+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:12:15.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347291+0000","last_change":"2023-10-10T22:37:22.344903+0000","last_active":"2023-10-10T22:37:22.347291+0000","last_peered":"2023-10-10T22:37:22.347291+0000","last_clean":"2023-10-10T22:37:22.347291+0000","last_became_active":"2023-10-10T22:37:22.344568+0000","last_became_peered":"2023-10-10T22:37:22.344568+0000","last_unstale":"2023-10-10T22:37:22.347291+0000","last_undegraded":"2023-10-10T22:37:22.347291+0000","last_fullsized":"2023-10-10T22:37:22.347291+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:29:17.224764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331152+0000","last_change":"2023-10-10T22:37:22.327814+0000","last_active":"2023-10-10T22:37:22.331152+0000","last_peered":"2023-10-10T22:37:22.331152+0000","last_clean":"2023-10-10T22:37:22.331152+0000","last_became_active":"2023-10-10T22:37:22.327483+0000","last_became_peered":"2023-10-10T22:37:22.327483+0000","last_unstale":"2023-10-10T22:37:22.331152+0000","last_undegraded":"2023-10-10T22:37:22.331152+0000","last_fullsized":"2023-10-10T22:37:22.331152+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335425+0000","last_change":"2023-10-10T22:37:22.331782+0000","last_active":"2023-10-10T22:37:22.335425+0000","last_peered":"2023-10-10T22:37:22.335425+0000","last_clean":"2023-10-10T22:37:22.335425+0000","last_became_active":"2023-10-10T22:37:22.331529+0000","last_became_peered":"2023-10-10T22:37:22.331529+0000","last_unstale":"2023-10-10T22:37:22.335425+0000","last_undegraded":"2023-10-10T22:37:22.335425+0000","last_fullsized":"2023-10-10T22:37:22.335425+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:41:51.371588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330940+0000","last_change":"2023-10-10T22:37:22.327219+0000","last_active":"2023-10-10T22:37:22.330940+0000","last_peered":"2023-10-10T22:37:22.330940+0000","last_clean":"2023-10-10T22:37:22.330940+0000","last_became_active":"2023-10-10T22:37:22.326966+0000","last_became_peered":"2023-10-10T22:37:22.326966+0000","last_unstale":"2023-10-10T22:37:22.330940+0000","last_undegraded":"2023-10-10T22:37:22.330940+0000","last_fullsized":"2023-10-10T22:37:22.330940+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:43:29.646719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.331376+0000","last_change":"2023-10-10T22:37:22.327933+0000","last_active":"2023-10-10T22:37:22.331376+0000","last_peered":"2023-10-10T22:37:22.331376+0000","last_clean":"2023-10-10T22:37:22.331376+0000","last_became_active":"2023-10-10T22:37:22.327538+0000","last_became_peered":"2023-10-10T22:37:22.327538+0000","last_unstale":"2023-10-10T22:37:22.331376+0000","last_undegraded":"2023-10-10T22:37:22.331376+0000","last_fullsized":"2023-10-10T22:37:22.331376+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:33:17.366872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329720+0000","last_change":"2023-10-10T22:37:22.328638+0000","last_active":"2023-10-10T22:37:22.329720+0000","last_peered":"2023-10-10T22:37:22.329720+0000","last_clean":"2023-10-10T22:37:22.329720+0000","last_became_active":"2023-10-10T22:37:22.328375+0000","last_became_peered":"2023-10-10T22:37:22.328375+0000","last_unstale":"2023-10-10T22:37:22.329720+0000","last_undegraded":"2023-10-10T22:37:22.329720+0000","last_fullsized":"2023-10-10T22:37:22.329720+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:56.447417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.336027+0000","last_change":"2023-10-10T22:37:22.332011+0000","last_active":"2023-10-10T22:37:22.336027+0000","last_peered":"2023-10-10T22:37:22.336027+0000","last_clean":"2023-10-10T22:37:22.336027+0000","last_became_active":"2023-10-10T22:37:22.331741+0000","last_became_peered":"2023-10-10T22:37:22.331741+0000","last_unstale":"2023-10-10T22:37:22.336027+0000","last_undegraded":"2023-10-10T22:37:22.336027+0000","last_fullsized":"2023-10-10T22:37:22.336027+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:08:27.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330594+0000","last_change":"2023-10-10T22:37:22.329122+0000","last_active":"2023-10-10T22:37:22.330594+0000","last_peered":"2023-10-10T22:37:22.330594+0000","last_clean":"2023-10-10T22:37:22.330594+0000","last_became_active":"2023-10-10T22:37:22.328864+0000","last_became_peered":"2023-10-10T22:37:22.328864+0000","last_unstale":"2023-10-10T22:37:22.330594+0000","last_undegraded":"2023-10-10T22:37:22.330594+0000","last_fullsized":"2023-10-10T22:37:22.330594+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338828+0000","last_change":"2023-10-10T22:37:22.333229+0000","last_active":"2023-10-10T22:37:22.338828+0000","last_peered":"2023-10-10T22:37:22.338828+0000","last_clean":"2023-10-10T22:37:22.338828+0000","last_became_active":"2023-10-10T22:37:22.332677+0000","last_became_peered":"2023-10-10T22:37:22.332677+0000","last_unstale":"2023-10-10T22:37:22.338828+0000","last_undegraded":"2023-10-10T22:37:22.338828+0000","last_fullsized":"2023-10-10T22:37:22.338828+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:43:41.226417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345995+0000","last_change":"2023-10-10T22:37:22.342096+0000","last_active":"2023-10-10T22:37:22.345995+0000","last_peered":"2023-10-10T22:37:22.345995+0000","last_clean":"2023-10-10T22:37:22.345995+0000","last_became_active":"2023-10-10T22:37:22.341851+0000","last_became_peered":"2023-10-10T22:37:22.341851+0000","last_unstale":"2023-10-10T22:37:22.345995+0000","last_undegraded":"2023-10-10T22:37:22.345995+0000","last_fullsized":"2023-10-10T22:37:22.345995+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:28:15.665680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332513+0000","last_change":"2023-10-10T22:37:22.329649+0000","last_active":"2023-10-10T22:37:22.332513+0000","last_peered":"2023-10-10T22:37:22.332513+0000","last_clean":"2023-10-10T22:37:22.332513+0000","last_became_active":"2023-10-10T22:37:22.329396+0000","last_became_peered":"2023-10-10T22:37:22.329396+0000","last_unstale":"2023-10-10T22:37:22.332513+0000","last_undegraded":"2023-10-10T22:37:22.332513+0000","last_fullsized":"2023-10-10T22:37:22.332513+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T09:13:12.738082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343485+0000","last_change":"2023-10-10T22:37:22.339262+0000","last_active":"2023-10-10T22:37:22.343485+0000","last_peered":"2023-10-10T22:37:22.343485+0000","last_clean":"2023-10-10T22:37:22.343485+0000","last_became_active":"2023-10-10T22:37:22.338998+0000","last_became_peered":"2023-10-10T22:37:22.338998+0000","last_unstale":"2023-10-10T22:37:22.343485+0000","last_undegraded":"2023-10-10T22:37:22.343485+0000","last_fullsized":"2023-10-10T22:37:22.343485+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:29.862257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343386+0000","last_change":"2023-10-10T22:37:22.336423+0000","last_active":"2023-10-10T22:37:22.343386+0000","last_peered":"2023-10-10T22:37:22.343386+0000","last_clean":"2023-10-10T22:37:22.343386+0000","last_became_active":"2023-10-10T22:37:22.336115+0000","last_became_peered":"2023-10-10T22:37:22.336115+0000","last_unstale":"2023-10-10T22:37:22.343386+0000","last_undegraded":"2023-10-10T22:37:22.343386+0000","last_fullsized":"2023-10-10T22:37:22.343386+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329138+0000","last_change":"2023-10-10T22:37:22.326865+0000","last_active":"2023-10-10T22:37:22.329138+0000","last_peered":"2023-10-10T22:37:22.329138+0000","last_clean":"2023-10-10T22:37:22.329138+0000","last_became_active":"2023-10-10T22:37:22.326560+0000","last_became_peered":"2023-10-10T22:37:22.326560+0000","last_unstale":"2023-10-10T22:37:22.329138+0000","last_undegraded":"2023-10-10T22:37:22.329138+0000","last_fullsized":"2023-10-10T22:37:22.329138+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:31:16.097777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332570+0000","last_change":"2023-10-10T22:37:22.331211+0000","last_active":"2023-10-10T22:37:22.332570+0000","last_peered":"2023-10-10T22:37:22.332570+0000","last_clean":"2023-10-10T22:37:22.332570+0000","last_became_active":"2023-10-10T22:37:22.330969+0000","last_became_peered":"2023-10-10T22:37:22.330969+0000","last_unstale":"2023-10-10T22:37:22.332570+0000","last_undegraded":"2023-10-10T22:37:22.332570+0000","last_fullsized":"2023-10-10T22:37:22.332570+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:23:13.075740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343255+0000","last_change":"2023-10-10T22:37:22.340035+0000","last_active":"2023-10-10T22:37:22.343255+0000","last_peered":"2023-10-10T22:37:22.343255+0000","last_clean":"2023-10-10T22:37:22.343255+0000","last_became_active":"2023-10-10T22:37:22.339704+0000","last_became_peered":"2023-10-10T22:37:22.339704+0000","last_unstale":"2023-10-10T22:37:22.343255+0000","last_undegraded":"2023-10-10T22:37:22.343255+0000","last_fullsized":"2023-10-10T22:37:22.343255+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:12:57.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"208'4","reported_seq":14,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345983+0000","last_change":"2023-10-10T22:37:21.300780+0000","last_active":"2023-10-10T22:37:22.345983+0000","last_peered":"2023-10-10T22:37:22.345983+0000","last_clean":"2023-10-10T22:37:22.345983+0000","last_became_active":"2023-10-10T22:37:21.300530+0000","last_became_peered":"2023-10-10T22:37:21.300530+0000","last_unstale":"2023-10-10T22:37:22.345983+0000","last_undegraded":"2023-10-10T22:37:22.345983+0000","last_fullsized":"2023-10-10T22:37:22.345983+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:45:17.662491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325583+0000","last_change":"2023-10-10T22:37:22.324305+0000","last_active":"2023-10-10T22:37:22.325583+0000","last_peered":"2023-10-10T22:37:22.325583+0000","last_clean":"2023-10-10T22:37:22.325583+0000","last_became_active":"2023-10-10T22:37:22.324056+0000","last_became_peered":"2023-10-10T22:37:22.324056+0000","last_unstale":"2023-10-10T22:37:22.325583+0000","last_undegraded":"2023-10-10T22:37:22.325583+0000","last_fullsized":"2023-10-10T22:37:22.325583+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.347552+0000","last_change":"2023-10-10T22:37:21.308912+0000","last_active":"2023-10-10T22:37:22.347552+0000","last_peered":"2023-10-10T22:37:22.347552+0000","last_clean":"2023-10-10T22:37:22.347552+0000","last_became_active":"2023-10-10T22:37:21.308582+0000","last_became_peered":"2023-10-10T22:37:21.308582+0000","last_unstale":"2023-10-10T22:37:22.347552+0000","last_undegraded":"2023-10-10T22:37:22.347552+0000","last_fullsized":"2023-10-10T22:37:22.347552+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:15:09.380526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338697+0000","last_change":"2023-10-10T22:37:22.332552+0000","last_active":"2023-10-10T22:37:22.338697+0000","last_peered":"2023-10-10T22:37:22.338697+0000","last_clean":"2023-10-10T22:37:22.338697+0000","last_became_active":"2023-10-10T22:37:22.332000+0000","last_became_peered":"2023-10-10T22:37:22.332000+0000","last_unstale":"2023-10-10T22:37:22.338697+0000","last_undegraded":"2023-10-10T22:37:22.338697+0000","last_fullsized":"2023-10-10T22:37:22.338697+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:45.352813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344219+0000","last_change":"2023-10-10T22:37:21.310535+0000","last_active":"2023-10-10T22:37:22.344219+0000","last_peered":"2023-10-10T22:37:22.344219+0000","last_clean":"2023-10-10T22:37:22.344219+0000","last_became_active":"2023-10-10T22:37:21.310298+0000","last_became_peered":"2023-10-10T22:37:21.310298+0000","last_unstale":"2023-10-10T22:37:22.344219+0000","last_undegraded":"2023-10-10T22:37:22.344219+0000","last_fullsized":"2023-10-10T22:37:22.344219+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:01:45.311116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338523+0000","last_change":"2023-10-10T22:37:22.330595+0000","last_active":"2023-10-10T22:37:22.338523+0000","last_peered":"2023-10-10T22:37:22.338523+0000","last_clean":"2023-10-10T22:37:22.338523+0000","last_became_active":"2023-10-10T22:37:22.330019+0000","last_became_peered":"2023-10-10T22:37:22.330019+0000","last_unstale":"2023-10-10T22:37:22.338523+0000","last_undegraded":"2023-10-10T22:37:22.338523+0000","last_fullsized":"2023-10-10T22:37:22.338523+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:14:22.971942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345772+0000","last_change":"2023-10-10T22:37:21.305904+0000","last_active":"2023-10-10T22:37:22.345772+0000","last_peered":"2023-10-10T22:37:22.345772+0000","last_clean":"2023-10-10T22:37:22.345772+0000","last_became_active":"2023-10-10T22:37:21.305625+0000","last_became_peered":"2023-10-10T22:37:21.305625+0000","last_unstale":"2023-10-10T22:37:22.345772+0000","last_undegraded":"2023-10-10T22:37:22.345772+0000","last_fullsized":"2023-10-10T22:37:22.345772+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:44.345013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.328680+0000","last_change":"2023-10-10T22:37:22.327712+0000","last_active":"2023-10-10T22:37:22.328680+0000","last_peered":"2023-10-10T22:37:22.328680+0000","last_clean":"2023-10-10T22:37:22.328680+0000","last_became_active":"2023-10-10T22:37:22.327084+0000","last_became_peered":"2023-10-10T22:37:22.327084+0000","last_unstale":"2023-10-10T22:37:22.328680+0000","last_undegraded":"2023-10-10T22:37:22.328680+0000","last_fullsized":"2023-10-10T22:37:22.328680+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:48:53.679083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344271+0000","last_change":"2023-10-10T22:37:21.306550+0000","last_active":"2023-10-10T22:37:22.344271+0000","last_peered":"2023-10-10T22:37:22.344271+0000","last_clean":"2023-10-10T22:37:22.344271+0000","last_became_active":"2023-10-10T22:37:21.306315+0000","last_became_peered":"2023-10-10T22:37:21.306315+0000","last_unstale":"2023-10-10T22:37:22.344271+0000","last_undegraded":"2023-10-10T22:37:22.344271+0000","last_fullsized":"2023-10-10T22:37:22.344271+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:14:41.427780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343229+0000","last_change":"2023-10-10T22:37:22.339383+0000","last_active":"2023-10-10T22:37:22.343229+0000","last_peered":"2023-10-10T22:37:22.343229+0000","last_clean":"2023-10-10T22:37:22.343229+0000","last_became_active":"2023-10-10T22:37:22.339121+0000","last_became_peered":"2023-10-10T22:37:22.339121+0000","last_unstale":"2023-10-10T22:37:22.343229+0000","last_undegraded":"2023-10-10T22:37:22.343229+0000","last_fullsized":"2023-10-10T22:37:22.343229+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:14:23.304666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346268+0000","last_change":"2023-10-10T22:37:21.311535+0000","last_active":"2023-10-10T22:37:22.346268+0000","last_peered":"2023-10-10T22:37:22.346268+0000","last_clean":"2023-10-10T22:37:22.346268+0000","last_became_active":"2023-10-10T22:37:21.311272+0000","last_became_peered":"2023-10-10T22:37:21.311272+0000","last_unstale":"2023-10-10T22:37:22.346268+0000","last_undegraded":"2023-10-10T22:37:22.346268+0000","last_fullsized":"2023-10-10T22:37:22.346268+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:01:56.463951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343480+0000","last_change":"2023-10-10T22:37:22.340669+0000","last_active":"2023-10-10T22:37:22.343480+0000","last_peered":"2023-10-10T22:37:22.343480+0000","last_clean":"2023-10-10T22:37:22.343480+0000","last_became_active":"2023-10-10T22:37:22.340417+0000","last_became_peered":"2023-10-10T22:37:22.340417+0000","last_unstale":"2023-10-10T22:37:22.343480+0000","last_undegraded":"2023-10-10T22:37:22.343480+0000","last_fullsized":"2023-10-10T22:37:22.343480+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:13.429335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323936+0000","last_change":"2023-10-10T22:37:21.311884+0000","last_active":"2023-10-10T22:37:22.323936+0000","last_peered":"2023-10-10T22:37:22.323936+0000","last_clean":"2023-10-10T22:37:22.323936+0000","last_became_active":"2023-10-10T22:37:21.311253+0000","last_became_peered":"2023-10-10T22:37:21.311253+0000","last_unstale":"2023-10-10T22:37:22.323936+0000","last_undegraded":"2023-10-10T22:37:22.323936+0000","last_fullsized":"2023-10-10T22:37:22.323936+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:32.308434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329066+0000","last_change":"2023-10-10T22:37:22.327563+0000","last_active":"2023-10-10T22:37:22.329066+0000","last_peered":"2023-10-10T22:37:22.329066+0000","last_clean":"2023-10-10T22:37:22.329066+0000","last_became_active":"2023-10-10T22:37:22.327285+0000","last_became_peered":"2023-10-10T22:37:22.327285+0000","last_unstale":"2023-10-10T22:37:22.329066+0000","last_undegraded":"2023-10-10T22:37:22.329066+0000","last_fullsized":"2023-10-10T22:37:22.329066+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:10.265065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322635+0000","last_change":"2023-10-10T22:37:21.304131+0000","last_active":"2023-10-10T22:37:22.322635+0000","last_peered":"2023-10-10T22:37:22.322635+0000","last_clean":"2023-10-10T22:37:22.322635+0000","last_became_active":"2023-10-10T22:37:21.303862+0000","last_became_peered":"2023-10-10T22:37:21.303862+0000","last_unstale":"2023-10-10T22:37:22.322635+0000","last_undegraded":"2023-10-10T22:37:22.322635+0000","last_fullsized":"2023-10-10T22:37:22.322635+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:11.264533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.334236+0000","last_change":"2023-10-10T22:37:22.326514+0000","last_active":"2023-10-10T22:37:22.334236+0000","last_peered":"2023-10-10T22:37:22.334236+0000","last_clean":"2023-10-10T22:37:22.334236+0000","last_became_active":"2023-10-10T22:37:22.326241+0000","last_became_peered":"2023-10-10T22:37:22.326241+0000","last_unstale":"2023-10-10T22:37:22.334236+0000","last_undegraded":"2023-10-10T22:37:22.334236+0000","last_fullsized":"2023-10-10T22:37:22.334236+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:57:05.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.317579+0000","last_change":"2023-10-10T22:37:21.307712+0000","last_active":"2023-10-10T22:37:22.317579+0000","last_peered":"2023-10-10T22:37:22.317579+0000","last_clean":"2023-10-10T22:37:22.317579+0000","last_became_active":"2023-10-10T22:37:21.307419+0000","last_became_peered":"2023-10-10T22:37:21.307419+0000","last_unstale":"2023-10-10T22:37:22.317579+0000","last_undegraded":"2023-10-10T22:37:22.317579+0000","last_fullsized":"2023-10-10T22:37:22.317579+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:09:38.945874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332403+0000","last_change":"2023-10-10T22:37:22.327109+0000","last_active":"2023-10-10T22:37:22.332403+0000","last_peered":"2023-10-10T22:37:22.332403+0000","last_clean":"2023-10-10T22:37:22.332403+0000","last_became_active":"2023-10-10T22:37:22.326801+0000","last_became_peered":"2023-10-10T22:37:22.326801+0000","last_unstale":"2023-10-10T22:37:22.332403+0000","last_undegraded":"2023-10-10T22:37:22.332403+0000","last_fullsized":"2023-10-10T22:37:22.332403+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:38.738632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"208'3","reported_seq":13,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344456+0000","last_change":"2023-10-10T22:37:21.304909+0000","last_active":"2023-10-10T22:37:22.344456+0000","last_peered":"2023-10-10T22:37:22.344456+0000","last_clean":"2023-10-10T22:37:22.344456+0000","last_became_active":"2023-10-10T22:37:21.304642+0000","last_became_peered":"2023-10-10T22:37:21.304642+0000","last_unstale":"2023-10-10T22:37:22.344456+0000","last_undegraded":"2023-10-10T22:37:22.344456+0000","last_fullsized":"2023-10-10T22:37:22.344456+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:28:25.674622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341955+0000","last_change":"2023-10-10T22:37:22.332831+0000","last_active":"2023-10-10T22:37:22.341955+0000","last_peered":"2023-10-10T22:37:22.341955+0000","last_clean":"2023-10-10T22:37:22.341955+0000","last_became_active":"2023-10-10T22:37:22.332577+0000","last_became_peered":"2023-10-10T22:37:22.332577+0000","last_unstale":"2023-10-10T22:37:22.341955+0000","last_undegraded":"2023-10-10T22:37:22.341955+0000","last_fullsized":"2023-10-10T22:37:22.341955+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:32:49.337687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"208'6","reported_seq":16,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348666+0000","last_change":"2023-10-10T22:37:21.302443+0000","last_active":"2023-10-10T22:37:22.348666+0000","last_peered":"2023-10-10T22:37:22.348666+0000","last_clean":"2023-10-10T22:37:22.348666+0000","last_became_active":"2023-10-10T22:37:21.302148+0000","last_became_peered":"2023-10-10T22:37:21.302148+0000","last_unstale":"2023-10-10T22:37:22.348666+0000","last_undegraded":"2023-10-10T22:37:22.348666+0000","last_fullsized":"2023-10-10T22:37:22.348666+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:52:34.012755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.329179+0000","last_change":"2023-10-10T22:37:22.327958+0000","last_active":"2023-10-10T22:37:22.329179+0000","last_peered":"2023-10-10T22:37:22.329179+0000","last_clean":"2023-10-10T22:37:22.329179+0000","last_became_active":"2023-10-10T22:37:22.327720+0000","last_became_peered":"2023-10-10T22:37:22.327720+0000","last_unstale":"2023-10-10T22:37:22.329179+0000","last_undegraded":"2023-10-10T22:37:22.329179+0000","last_fullsized":"2023-10-10T22:37:22.329179+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:18:12.272333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351731+0000","last_change":"2023-10-10T22:37:21.311578+0000","last_active":"2023-10-10T22:37:22.351731+0000","last_peered":"2023-10-10T22:37:22.351731+0000","last_clean":"2023-10-10T22:37:22.351731+0000","last_became_active":"2023-10-10T22:37:21.311276+0000","last_became_peered":"2023-10-10T22:37:21.311276+0000","last_unstale":"2023-10-10T22:37:22.351731+0000","last_undegraded":"2023-10-10T22:37:22.351731+0000","last_fullsized":"2023-10-10T22:37:22.351731+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:10:25.362844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.332363+0000","last_change":"2023-10-10T22:37:22.327787+0000","last_active":"2023-10-10T22:37:22.332363+0000","last_peered":"2023-10-10T22:37:22.332363+0000","last_clean":"2023-10-10T22:37:22.332363+0000","last_became_active":"2023-10-10T22:37:22.327459+0000","last_became_peered":"2023-10-10T22:37:22.327459+0000","last_unstale":"2023-10-10T22:37:22.332363+0000","last_undegraded":"2023-10-10T22:37:22.332363+0000","last_fullsized":"2023-10-10T22:37:22.332363+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313273+0000","last_change":"2023-10-10T22:37:21.309120+0000","last_active":"2023-10-10T22:37:22.313273+0000","last_peered":"2023-10-10T22:37:22.313273+0000","last_clean":"2023-10-10T22:37:22.313273+0000","last_became_active":"2023-10-10T22:37:21.308861+0000","last_became_peered":"2023-10-10T22:37:21.308861+0000","last_unstale":"2023-10-10T22:37:22.313273+0000","last_undegraded":"2023-10-10T22:37:22.313273+0000","last_fullsized":"2023-10-10T22:37:22.313273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:13:59.242392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338319+0000","last_change":"2023-10-10T22:37:22.330901+0000","last_active":"2023-10-10T22:37:22.338319+0000","last_peered":"2023-10-10T22:37:22.338319+0000","last_clean":"2023-10-10T22:37:22.338319+0000","last_became_active":"2023-10-10T22:37:22.327027+0000","last_became_peered":"2023-10-10T22:37:22.327027+0000","last_unstale":"2023-10-10T22:37:22.338319+0000","last_undegraded":"2023-10-10T22:37:22.338319+0000","last_fullsized":"2023-10-10T22:37:22.338319+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323309+0000","last_change":"2023-10-10T22:37:21.313404+0000","last_active":"2023-10-10T22:37:22.323309+0000","last_peered":"2023-10-10T22:37:22.323309+0000","last_clean":"2023-10-10T22:37:22.323309+0000","last_became_active":"2023-10-10T22:37:21.313147+0000","last_became_peered":"2023-10-10T22:37:21.313147+0000","last_unstale":"2023-10-10T22:37:22.323309+0000","last_undegraded":"2023-10-10T22:37:22.323309+0000","last_fullsized":"2023-10-10T22:37:22.323309+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:41:59.610628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341852+0000","last_change":"2023-10-10T22:37:22.331938+0000","last_active":"2023-10-10T22:37:22.341852+0000","last_peered":"2023-10-10T22:37:22.341852+0000","last_clean":"2023-10-10T22:37:22.341852+0000","last_became_active":"2023-10-10T22:37:22.331427+0000","last_became_peered":"2023-10-10T22:37:22.331427+0000","last_unstale":"2023-10-10T22:37:22.341852+0000","last_undegraded":"2023-10-10T22:37:22.341852+0000","last_fullsized":"2023-10-10T22:37:22.341852+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:53:32.612316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"208'8","reported_seq":18,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351735+0000","last_change":"2023-10-10T22:37:21.312079+0000","last_active":"2023-10-10T22:37:22.351735+0000","last_peered":"2023-10-10T22:37:22.351735+0000","last_clean":"2023-10-10T22:37:22.351735+0000","last_became_active":"2023-10-10T22:37:21.311201+0000","last_became_peered":"2023-10-10T22:37:21.311201+0000","last_unstale":"2023-10-10T22:37:22.351735+0000","last_undegraded":"2023-10-10T22:37:22.351735+0000","last_fullsized":"2023-10-10T22:37:22.351735+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:46.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335508+0000","last_change":"2023-10-10T22:37:22.329719+0000","last_active":"2023-10-10T22:37:22.335508+0000","last_peered":"2023-10-10T22:37:22.335508+0000","last_clean":"2023-10-10T22:37:22.335508+0000","last_became_active":"2023-10-10T22:37:22.329479+0000","last_became_peered":"2023-10-10T22:37:22.329479+0000","last_unstale":"2023-10-10T22:37:22.335508+0000","last_undegraded":"2023-10-10T22:37:22.335508+0000","last_fullsized":"2023-10-10T22:37:22.335508+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.344267+0000","last_change":"2023-10-10T22:37:21.307317+0000","last_active":"2023-10-10T22:37:22.344267+0000","last_peered":"2023-10-10T22:37:22.344267+0000","last_clean":"2023-10-10T22:37:22.344267+0000","last_became_active":"2023-10-10T22:37:21.307063+0000","last_became_peered":"2023-10-10T22:37:21.307063+0000","last_unstale":"2023-10-10T22:37:22.344267+0000","last_undegraded":"2023-10-10T22:37:22.344267+0000","last_fullsized":"2023-10-10T22:37:22.344267+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:44:04.204820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338262+0000","last_change":"2023-10-10T22:37:22.331546+0000","last_active":"2023-10-10T22:37:22.338262+0000","last_peered":"2023-10-10T22:37:22.338262+0000","last_clean":"2023-10-10T22:37:22.338262+0000","last_became_active":"2023-10-10T22:37:22.327510+0000","last_became_peered":"2023-10-10T22:37:22.327510+0000","last_unstale":"2023-10-10T22:37:22.338262+0000","last_undegraded":"2023-10-10T22:37:22.338262+0000","last_fullsized":"2023-10-10T22:37:22.338262+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346273+0000","last_change":"2023-10-10T22:37:21.315652+0000","last_active":"2023-10-10T22:37:22.346273+0000","last_peered":"2023-10-10T22:37:22.346273+0000","last_clean":"2023-10-10T22:37:22.346273+0000","last_became_active":"2023-10-10T22:37:21.315368+0000","last_became_peered":"2023-10-10T22:37:21.315368+0000","last_unstale":"2023-10-10T22:37:22.346273+0000","last_undegraded":"2023-10-10T22:37:22.346273+0000","last_fullsized":"2023-10-10T22:37:22.346273+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:00:52.565481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343258+0000","last_change":"2023-10-10T22:37:22.334001+0000","last_active":"2023-10-10T22:37:22.343258+0000","last_peered":"2023-10-10T22:37:22.343258+0000","last_clean":"2023-10-10T22:37:22.343258+0000","last_became_active":"2023-10-10T22:37:22.333748+0000","last_became_peered":"2023-10-10T22:37:22.333748+0000","last_unstale":"2023-10-10T22:37:22.343258+0000","last_undegraded":"2023-10-10T22:37:22.343258+0000","last_fullsized":"2023-10-10T22:37:22.343258+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:01:33.316234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"208'1","reported_seq":11,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.351642+0000","last_change":"2023-10-10T22:37:21.311600+0000","last_active":"2023-10-10T22:37:22.351642+0000","last_peered":"2023-10-10T22:37:22.351642+0000","last_clean":"2023-10-10T22:37:22.351642+0000","last_became_active":"2023-10-10T22:37:21.311310+0000","last_became_peered":"2023-10-10T22:37:21.311310+0000","last_unstale":"2023-10-10T22:37:22.351642+0000","last_undegraded":"2023-10-10T22:37:22.351642+0000","last_fullsized":"2023-10-10T22:37:22.351642+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:53:28.854458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338327+0000","last_change":"2023-10-10T22:37:22.335829+0000","last_active":"2023-10-10T22:37:22.338327+0000","last_peered":"2023-10-10T22:37:22.338327+0000","last_clean":"2023-10-10T22:37:22.338327+0000","last_became_active":"2023-10-10T22:37:22.335582+0000","last_became_peered":"2023-10-10T22:37:22.335582+0000","last_unstale":"2023-10-10T22:37:22.338327+0000","last_undegraded":"2023-10-10T22:37:22.338327+0000","last_fullsized":"2023-10-10T22:37:22.338327+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:10:26.370643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.325907+0000","last_change":"2023-10-10T22:37:21.308409+0000","last_active":"2023-10-10T22:37:22.325907+0000","last_peered":"2023-10-10T22:37:22.325907+0000","last_clean":"2023-10-10T22:37:22.325907+0000","last_became_active":"2023-10-10T22:37:21.308069+0000","last_became_peered":"2023-10-10T22:37:21.308069+0000","last_unstale":"2023-10-10T22:37:22.325907+0000","last_undegraded":"2023-10-10T22:37:22.325907+0000","last_fullsized":"2023-10-10T22:37:22.325907+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T10:05:55.439618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324866+0000","last_change":"2023-10-10T22:37:22.322788+0000","last_active":"2023-10-10T22:37:22.324866+0000","last_peered":"2023-10-10T22:37:22.324866+0000","last_clean":"2023-10-10T22:37:22.324866+0000","last_became_active":"2023-10-10T22:37:22.322526+0000","last_became_peered":"2023-10-10T22:37:22.322526+0000","last_unstale":"2023-10-10T22:37:22.324866+0000","last_undegraded":"2023-10-10T22:37:22.324866+0000","last_fullsized":"2023-10-10T22:37:22.324866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.346717+0000","last_change":"2023-10-10T22:37:21.314705+0000","last_active":"2023-10-10T22:37:22.346717+0000","last_peered":"2023-10-10T22:37:22.346717+0000","last_clean":"2023-10-10T22:37:22.346717+0000","last_became_active":"2023-10-10T22:37:21.314394+0000","last_became_peered":"2023-10-10T22:37:21.314394+0000","last_unstale":"2023-10-10T22:37:22.346717+0000","last_undegraded":"2023-10-10T22:37:22.346717+0000","last_fullsized":"2023-10-10T22:37:22.346717+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:25:49.346015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.339779+0000","last_change":"2023-10-10T22:37:22.334339+0000","last_active":"2023-10-10T22:37:22.339779+0000","last_peered":"2023-10-10T22:37:22.339779+0000","last_clean":"2023-10-10T22:37:22.339779+0000","last_became_active":"2023-10-10T22:37:22.334070+0000","last_became_peered":"2023-10-10T22:37:22.334070+0000","last_unstale":"2023-10-10T22:37:22.339779+0000","last_undegraded":"2023-10-10T22:37:22.339779+0000","last_fullsized":"2023-10-10T22:37:22.339779+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:36:08.067076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316614+0000","last_change":"2023-10-10T22:37:21.308062+0000","last_active":"2023-10-10T22:37:22.316614+0000","last_peered":"2023-10-10T22:37:22.316614+0000","last_clean":"2023-10-10T22:37:22.316614+0000","last_became_active":"2023-10-10T22:37:21.307766+0000","last_became_peered":"2023-10-10T22:37:21.307766+0000","last_unstale":"2023-10-10T22:37:22.316614+0000","last_undegraded":"2023-10-10T22:37:22.316614+0000","last_fullsized":"2023-10-10T22:37:22.316614+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:35:17.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.334706+0000","last_change":"2023-10-10T22:37:22.333100+0000","last_active":"2023-10-10T22:37:22.334706+0000","last_peered":"2023-10-10T22:37:22.334706+0000","last_clean":"2023-10-10T22:37:22.334706+0000","last_became_active":"2023-10-10T22:37:22.332807+0000","last_became_peered":"2023-10-10T22:37:22.332807+0000","last_unstale":"2023-10-10T22:37:22.334706+0000","last_undegraded":"2023-10-10T22:37:22.334706+0000","last_fullsized":"2023-10-10T22:37:22.334706+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:15:47.041916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316751+0000","last_change":"2023-10-10T22:37:21.309163+0000","last_active":"2023-10-10T22:37:22.316751+0000","last_peered":"2023-10-10T22:37:22.316751+0000","last_clean":"2023-10-10T22:37:22.316751+0000","last_became_active":"2023-10-10T22:37:21.308910+0000","last_became_peered":"2023-10-10T22:37:21.308910+0000","last_unstale":"2023-10-10T22:37:22.316751+0000","last_undegraded":"2023-10-10T22:37:22.316751+0000","last_fullsized":"2023-10-10T22:37:22.316751+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:15:42.499573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.322365+0000","last_change":"2023-10-10T22:37:22.321715+0000","last_active":"2023-10-10T22:37:22.322365+0000","last_peered":"2023-10-10T22:37:22.322365+0000","last_clean":"2023-10-10T22:37:22.322365+0000","last_became_active":"2023-10-10T22:37:22.321465+0000","last_became_peered":"2023-10-10T22:37:22.321465+0000","last_unstale":"2023-10-10T22:37:22.322365+0000","last_undegraded":"2023-10-10T22:37:22.322365+0000","last_fullsized":"2023-10-10T22:37:22.322365+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:03:49.499590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314924+0000","last_change":"2023-10-10T22:37:21.305255+0000","last_active":"2023-10-10T22:37:22.314924+0000","last_peered":"2023-10-10T22:37:22.314924+0000","last_clean":"2023-10-10T22:37:22.314924+0000","last_became_active":"2023-10-10T22:37:21.304967+0000","last_became_peered":"2023-10-10T22:37:21.304967+0000","last_unstale":"2023-10-10T22:37:22.314924+0000","last_undegraded":"2023-10-10T22:37:22.314924+0000","last_fullsized":"2023-10-10T22:37:22.314924+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:56:37.730832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.326134+0000","last_change":"2023-10-10T22:37:22.321857+0000","last_active":"2023-10-10T22:37:22.326134+0000","last_peered":"2023-10-10T22:37:22.326134+0000","last_clean":"2023-10-10T22:37:22.326134+0000","last_became_active":"2023-10-10T22:37:22.321606+0000","last_became_peered":"2023-10-10T22:37:22.321606+0000","last_unstale":"2023-10-10T22:37:22.326134+0000","last_undegraded":"2023-10-10T22:37:22.326134+0000","last_fullsized":"2023-10-10T22:37:22.326134+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:23.523345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"208'2","reported_seq":12,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.348933+0000","last_change":"2023-10-10T22:37:21.313185+0000","last_active":"2023-10-10T22:37:22.348933+0000","last_peered":"2023-10-10T22:37:22.348933+0000","last_clean":"2023-10-10T22:37:22.348933+0000","last_became_active":"2023-10-10T22:37:21.313009+0000","last_became_peered":"2023-10-10T22:37:21.313009+0000","last_unstale":"2023-10-10T22:37:22.348933+0000","last_undegraded":"2023-10-10T22:37:22.348933+0000","last_fullsized":"2023-10-10T22:37:22.348933+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T23:42:23.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.341866+0000","last_change":"2023-10-10T22:37:22.332898+0000","last_active":"2023-10-10T22:37:22.341866+0000","last_peered":"2023-10-10T22:37:22.341866+0000","last_clean":"2023-10-10T22:37:22.341866+0000","last_became_active":"2023-10-10T22:37:22.332640+0000","last_became_peered":"2023-10-10T22:37:22.332640+0000","last_unstale":"2023-10-10T22:37:22.341866+0000","last_undegraded":"2023-10-10T22:37:22.341866+0000","last_fullsized":"2023-10-10T22:37:22.341866+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:07:38.501839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-10T22:37:24.872301+0000","last_change":"2023-10-10T22:37:21.305064+0000","last_active":"2023-10-10T22:37:24.872301+0000","last_peered":"2023-10-10T22:37:24.872301+0000","last_clean":"2023-10-10T22:37:24.872301+0000","last_became_active":"2023-10-10T22:37:21.304822+0000","last_became_peered":"2023-10-10T22:37:21.304822+0000","last_unstale":"2023-10-10T22:37:24.872301+0000","last_undegraded":"2023-10-10T22:37:24.872301+0000","last_fullsized":"2023-10-10T22:37:24.872301+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T03:53:36.582199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.338517+0000","last_change":"2023-10-10T22:37:22.336111+0000","last_active":"2023-10-10T22:37:22.338517+0000","last_peered":"2023-10-10T22:37:22.338517+0000","last_clean":"2023-10-10T22:37:22.338517+0000","last_became_active":"2023-10-10T22:37:22.335816+0000","last_became_peered":"2023-10-10T22:37:22.335816+0000","last_unstale":"2023-10-10T22:37:22.338517+0000","last_undegraded":"2023-10-10T22:37:22.338517+0000","last_fullsized":"2023-10-10T22:37:22.338517+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:49:21.033563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.313016+0000","last_change":"2023-10-10T22:37:21.305679+0000","last_active":"2023-10-10T22:37:22.313016+0000","last_peered":"2023-10-10T22:37:22.313016+0000","last_clean":"2023-10-10T22:37:22.313016+0000","last_became_active":"2023-10-10T22:37:21.305426+0000","last_became_peered":"2023-10-10T22:37:21.305426+0000","last_unstale":"2023-10-10T22:37:22.313016+0000","last_undegraded":"2023-10-10T22:37:22.313016+0000","last_fullsized":"2023-10-10T22:37:22.313016+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:00:09.257265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343285+0000","last_change":"2023-10-10T22:37:22.340538+0000","last_active":"2023-10-10T22:37:22.343285+0000","last_peered":"2023-10-10T22:37:22.343285+0000","last_clean":"2023-10-10T22:37:22.343285+0000","last_became_active":"2023-10-10T22:37:22.340297+0000","last_became_peered":"2023-10-10T22:37:22.340297+0000","last_unstale":"2023-10-10T22:37:22.343285+0000","last_undegraded":"2023-10-10T22:37:22.343285+0000","last_fullsized":"2023-10-10T22:37:22.343285+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T01:15:40.123577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.323634+0000","last_change":"2023-10-10T22:37:21.315894+0000","last_active":"2023-10-10T22:37:22.323634+0000","last_peered":"2023-10-10T22:37:22.323634+0000","last_clean":"2023-10-10T22:37:22.323634+0000","last_became_active":"2023-10-10T22:37:21.315627+0000","last_became_peered":"2023-10-10T22:37:21.315627+0000","last_unstale":"2023-10-10T22:37:22.323634+0000","last_undegraded":"2023-10-10T22:37:22.323634+0000","last_fullsized":"2023-10-10T22:37:22.323634+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T02:37:57.625726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.343203+0000","last_change":"2023-10-10T22:37:22.337620+0000","last_active":"2023-10-10T22:37:22.343203+0000","last_peered":"2023-10-10T22:37:22.343203+0000","last_clean":"2023-10-10T22:37:22.343203+0000","last_became_active":"2023-10-10T22:37:22.337376+0000","last_became_peered":"2023-10-10T22:37:22.337376+0000","last_unstale":"2023-10-10T22:37:22.343203+0000","last_undegraded":"2023-10-10T22:37:22.343203+0000","last_fullsized":"2023-10-10T22:37:22.343203+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:02:20.851800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.316514+0000","last_change":"2023-10-10T22:37:21.306687+0000","last_active":"2023-10-10T22:37:22.316514+0000","last_peered":"2023-10-10T22:37:22.316514+0000","last_clean":"2023-10-10T22:37:22.316514+0000","last_became_active":"2023-10-10T22:37:21.306312+0000","last_became_peered":"2023-10-10T22:37:21.306312+0000","last_unstale":"2023-10-10T22:37:22.316514+0000","last_undegraded":"2023-10-10T22:37:22.316514+0000","last_fullsized":"2023-10-10T22:37:22.316514+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T05:47:12.421535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.345813+0000","last_change":"2023-10-10T22:37:22.340754+0000","last_active":"2023-10-10T22:37:22.345813+0000","last_peered":"2023-10-10T22:37:22.345813+0000","last_clean":"2023-10-10T22:37:22.345813+0000","last_became_active":"2023-10-10T22:37:22.340438+0000","last_became_peered":"2023-10-10T22:37:22.340438+0000","last_unstale":"2023-10-10T22:37:22.345813+0000","last_undegraded":"2023-10-10T22:37:22.345813+0000","last_fullsized":"2023-10-10T22:37:22.345813+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:44:45.896568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.314997+0000","last_change":"2023-10-10T22:37:21.305173+0000","last_active":"2023-10-10T22:37:22.314997+0000","last_peered":"2023-10-10T22:37:22.314997+0000","last_clean":"2023-10-10T22:37:22.314997+0000","last_became_active":"2023-10-10T22:37:21.304872+0000","last_became_peered":"2023-10-10T22:37:21.304872+0000","last_unstale":"2023-10-10T22:37:22.314997+0000","last_undegraded":"2023-10-10T22:37:22.314997+0000","last_fullsized":"2023-10-10T22:37:22.314997+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:50:44.345013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.327874+0000","last_change":"2023-10-10T22:37:22.325426+0000","last_active":"2023-10-10T22:37:22.327874+0000","last_peered":"2023-10-10T22:37:22.327874+0000","last_clean":"2023-10-10T22:37:22.327874+0000","last_became_active":"2023-10-10T22:37:22.324867+0000","last_became_peered":"2023-10-10T22:37:22.324867+0000","last_unstale":"2023-10-10T22:37:22.327874+0000","last_undegraded":"2023-10-10T22:37:22.327874+0000","last_fullsized":"2023-10-10T22:37:22.327874+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:35.479980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.318611+0000","last_change":"2023-10-10T22:37:21.301087+0000","last_active":"2023-10-10T22:37:22.318611+0000","last_peered":"2023-10-10T22:37:22.318611+0000","last_clean":"2023-10-10T22:37:22.318611+0000","last_became_active":"2023-10-10T22:37:21.300837+0000","last_became_peered":"2023-10-10T22:37:21.300837+0000","last_unstale":"2023-10-10T22:37:22.318611+0000","last_undegraded":"2023-10-10T22:37:22.318611+0000","last_fullsized":"2023-10-10T22:37:22.318611+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T07:31:58.684383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.335239+0000","last_change":"2023-10-10T22:37:22.332348+0000","last_active":"2023-10-10T22:37:22.335239+0000","last_peered":"2023-10-10T22:37:22.335239+0000","last_clean":"2023-10-10T22:37:22.335239+0000","last_became_active":"2023-10-10T22:37:22.332119+0000","last_became_peered":"2023-10-10T22:37:22.332119+0000","last_unstale":"2023-10-10T22:37:22.335239+0000","last_undegraded":"2023-10-10T22:37:22.335239+0000","last_fullsized":"2023-10-10T22:37:22.335239+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:56:56.404086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.315755+0000","last_change":"2023-10-10T22:37:21.308580+0000","last_active":"2023-10-10T22:37:22.315755+0000","last_peered":"2023-10-10T22:37:22.315755+0000","last_clean":"2023-10-10T22:37:22.315755+0000","last_became_active":"2023-10-10T22:37:21.308346+0000","last_became_peered":"2023-10-10T22:37:21.308346+0000","last_unstale":"2023-10-10T22:37:22.315755+0000","last_undegraded":"2023-10-10T22:37:22.315755+0000","last_fullsized":"2023-10-10T22:37:22.315755+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T08:24:22.763388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.330445+0000","last_change":"2023-10-10T22:37:22.326456+0000","last_active":"2023-10-10T22:37:22.330445+0000","last_peered":"2023-10-10T22:37:22.330445+0000","last_clean":"2023-10-10T22:37:22.330445+0000","last_became_active":"2023-10-10T22:37:22.326179+0000","last_became_peered":"2023-10-10T22:37:22.326179+0000","last_unstale":"2023-10-10T22:37:22.330445+0000","last_undegraded":"2023-10-10T22:37:22.330445+0000","last_fullsized":"2023-10-10T22:37:22.330445+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:21.283383+0000","last_clean_scrub_stamp":"2023-10-10T22:37:21.283383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T00:34:29.226879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324236+0000","last_change":"2023-10-10T22:37:21.309121+0000","last_active":"2023-10-10T22:37:22.324236+0000","last_peered":"2023-10-10T22:37:22.324236+0000","last_clean":"2023-10-10T22:37:22.324236+0000","last_became_active":"2023-10-10T22:37:21.308062+0000","last_became_peered":"2023-10-10T22:37:21.308062+0000","last_unstale":"2023-10-10T22:37:22.324236+0000","last_undegraded":"2023-10-10T22:37:22.324236+0000","last_fullsized":"2023-10-10T22:37:22.324236+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":206,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T22:37:20.275583+0000","last_clean_scrub_stamp":"2023-10-10T22:37:20.275583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T04:02:34.472180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"198'348","reported_seq":1145,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-10T22:37:22.324105+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:37:22.324105+0000","last_peered":"2023-10-10T22:37:22.324105+0000","last_clean":"2023-10-10T22:37:22.324105+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:37:22.324105+0000","last_undegraded":"2023-10-10T22:37:22.324105+0000","last_fullsized":"2023-10-10T22:37:22.324105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543276,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312716,"kb_used_data":3140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059124,"statfs":{"total":96636764160,"available":96316542976,"internally_reserved":0,"allocated":3215360,"data_stored":1905675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.026},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":1.073,"15min":1.081},"last":0.77500000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":1.145,"15min":1.145},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":1.0700000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":1.0009999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.503,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.88900000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":0.82299999999999995,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.024},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":0.999,"15min":1.079},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.86199999999999999,"5min":1.046,"15min":1.125},"last":0.71899999999999997}]}]},{"osd":6,"up_from":14,"seq":60129543275,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1315203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":1.0289999999999999,"15min":1.1080000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.751},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.66200000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.0920000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.64500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94299999999999995,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.034,"15min":1.1200000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.0660000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.621,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91200000000000003,"5min":0.97399999999999998,"15min":1.071},"last":0.84399999999999997}]},{"osd":4,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":1.778,"15min":1.778},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.86899999999999999,"5min":0.996,"15min":1.046},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.91900000000000004}]},{"osd":7,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97299999999999998,"5min":1.827,"15min":1.827},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":1.077}]}]},{"osd":1,"up_from":14,"seq":60129543275,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1316739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.82999999999999996,"15min":0.88},"last":0.35599999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.878,"15min":0.90800000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.88800000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.74399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.995,"5min":1.0269999999999999,"15min":1.177},"last":0.94499999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.008,"5min":1.089,"15min":1.1419999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.2450000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.64300000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.081,"5min":1.1200000000000001,"15min":1.2729999999999999},"last":1.004}]},{"osd":7,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.155},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.68600000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.2230000000000001},"last":0.96499999999999997}]}]},{"osd":0,"up_from":14,"seq":60129543277,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308616,"kb_used_data":3136,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063224,"statfs":{"total":96636764160,"available":96320741376,"internally_reserved":0,"allocated":3211264,"data_stored":1905593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.71399999999999997,"15min":0.753},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.39100000000000001}]},{"osd":2,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.76000000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.85299999999999998},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.81100000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.52900000000000003}]},{"osd":4,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0469999999999999,"5min":1.1180000000000001,"15min":1.3340000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.88500000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.1479999999999999,"15min":1.198},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56899999999999995},"max":{"1min":1.0449999999999999,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.83999999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.625,"5min":0.54800000000000004,"15min":0.54500000000000004},"max":{"1min":1.1439999999999999,"5min":1.3320000000000001,"15min":1.377},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0449999999999999,"5min":1.274,"15min":1.427},"last":0.79500000000000004}]},{"osd":7,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.198,"5min":1.224,"15min":1.2689999999999999},"last":0.752},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.081,"5min":1.153,"15min":1.153},"last":0.82999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543277,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316236,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055604,"statfs":{"total":96636764160,"available":96312938496,"internally_reserved":0,"allocated":2625536,"data_stored":1315869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.317},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.89500000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.85699999999999998,"15min":0.85799999999999998},"last":0.438},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.101,"15min":1.288},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98599999999999999,"5min":1.1220000000000001,"15min":1.325},"last":0.77300000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.147,"15min":1.1970000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82199999999999995,"15min":0.84099999999999997},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.054,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.26},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.093,"5min":1.165,"15min":1.3129999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80600000000000005,"15min":0.83199999999999996},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.181,"15min":1.2609999999999999},"last":0.871}]}]},{"osd":3,"up_from":15,"seq":64424510572,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312140,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059700,"statfs":{"total":96636764160,"available":96317132800,"internally_reserved":0,"allocated":2625536,"data_stored":1315397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.501}]},{"osd":1,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.877,"15min":0.877},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.36199999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.70599999999999996,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":0.99399999999999999},"last":0.42699999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.04,"5min":1.133,"15min":1.242},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.202,"15min":1.2629999999999999},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.125,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.76000000000000001}]},{"osd":6,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":1.1040000000000001,"15min":1.222},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.099,"5min":1.1539999999999999,"15min":1.212},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.54200000000000004},"max":{"1min":0.98899999999999999,"5min":1.274,"15min":1.274},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":0.83499999999999996},"min":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56699999999999995},"max":{"1min":1.097,"5min":1.149,"15min":1.2370000000000001},"last":0.70699999999999996}]}]},{"osd":4,"up_from":14,"seq":60129543277,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1317293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.087},"last":0.435},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.752},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.437},"max":{"1min":0.94099999999999995,"5min":0.95199999999999996,"15min":1.1220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88500000000000001,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.998,"15min":1.073},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.089},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.45200000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.4079999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":1.282},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.94099999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.94099999999999995,"15min":1.0900000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.42199999999999999},"max":{"1min":0.82099999999999995,"5min":0.89600000000000002,"15min":1.0649999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.92100000000000004,"5min":0.96999999999999997,"15min":1.21},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.436},"max":{"1min":0.97399999999999998,"5min":0.97999999999999998,"15min":1.147},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543275,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299840,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072000,"statfs":{"total":96636764160,"available":96329728000,"internally_reserved":0,"allocated":2613248,"data_stored":1315203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":1.006},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.48199999999999998,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.997},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.98999999999999999,"15min":1.04},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.02},"last":0.84799999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.50700000000000001}]},{"osd":6,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.37},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.01,"5min":1.01,"15min":1.032},"last":0.73999999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.02},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:37:31.945 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-10T22:37:31.946 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-10T22:37:32.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.166+0000 7f04ed9ff700 1 Processor -- start 2023-10-10T22:37:32.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.166+0000 7f04ed9ff700 1 -- start start 2023-10-10T22:37:32.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.167+0000 7f04ed9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04e8156620 0x7f04e80c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.167+0000 7f04ed9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e815a6f0 con 0x7f04e81569f0 2023-10-10T22:37:32.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.167+0000 7f04ed9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e815a9d0 con 0x7f04e8068390 2023-10-10T22:37:32.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.167+0000 7f04ed9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80c8d30 con 0x7f04e8156620 2023-10-10T22:37:32.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.168+0000 7f04e6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04e8156620 0x7f04e80c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.168+0000 7f04e6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04e8156620 0x7f04e80c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33220/0 (socket says 172.21.15.154:33220) 2023-10-10T22:37:32.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.168+0000 7f04e6ffd700 1 -- 172.21.15.154:0/271198695 learned_addr learned my addr 172.21.15.154:0/271198695 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:32.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.168+0000 7f04dffff700 1 --1- 172.21.15.154:0/271198695 >> v1:172.21.15.154:6789/0 conn(0x7f04e81569f0 0x7f04e80ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41124/0 (socket says 172.21.15.154:41124) 2023-10-10T22:37:32.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.168+0000 7f04e6ffd700 1 -- 172.21.15.154:0/271198695 >> v1:172.21.15.179:6789/0 conn(0x7f04e8068390 legacy=0x7f04e806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.168+0000 7f04e6ffd700 1 -- 172.21.15.154:0/271198695 >> v1:172.21.15.154:6789/0 conn(0x7f04e81569f0 legacy=0x7f04e80ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.168+0000 7f04e6ffd700 1 -- 172.21.15.154:0/271198695 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e815acb0 con 0x7f04e8156620 2023-10-10T22:37:32.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.168+0000 7f04e6ffd700 1 --2- 172.21.15.154:0/271198695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 0x7f04e80c87f0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f4546873d4471e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:32.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.168+0000 7f04e67fc700 1 -- 172.21.15.154:0/271198695 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800b860 con 0x7f04e8156620 2023-10-10T22:37:32.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.169+0000 7f04e67fc700 1 -- 172.21.15.154:0/271198695 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d800b9c0 con 0x7f04e8156620 2023-10-10T22:37:32.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.169+0000 7f04e67fc700 1 -- 172.21.15.154:0/271198695 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800bd60 con 0x7f04e8156620 2023-10-10T22:37:32.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.169+0000 7f04ed9ff700 1 -- 172.21.15.154:0/271198695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 msgr2=0x7f04e80c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.169+0000 7f04ed9ff700 1 --2- 172.21.15.154:0/271198695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 0x7f04e80c87f0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8009250 comp rx=0 tx=0).stop 2023-10-10T22:37:32.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.169+0000 7f04ed9ff700 1 -- 172.21.15.154:0/271198695 shutdown_connections 2023-10-10T22:37:32.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.169+0000 7f04ed9ff700 1 --2- 172.21.15.154:0/271198695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 0x7f04e80c87f0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.169+0000 7f04ed9ff700 1 -- 172.21.15.154:0/271198695 >> 172.21.15.154:0/271198695 conn(0x7f04e80cc540 msgr2=0x7f04e80cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:32.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.169+0000 7f04ed9ff700 1 -- 172.21.15.154:0/271198695 shutdown_connections 2023-10-10T22:37:32.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.169+0000 7f04ed9ff700 1 -- 172.21.15.154:0/271198695 wait complete. 2023-10-10T22:37:32.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.171+0000 7f04ed9ff700 1 Processor -- start 2023-10-10T22:37:32.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.171+0000 7f04ed9ff700 1 -- start start 2023-10-10T22:37:32.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04ed9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e8068390 0x7f04e8159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04ed9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 0x7f04e80c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04ed9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81569f0 0x7f04e80c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04ed9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e816ae70 con 0x7f04e8156620 2023-10-10T22:37:32.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04ed9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e8159a90 con 0x7f04e8068390 2023-10-10T22:37:32.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04ed9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e816a260 con 0x7f04e81569f0 2023-10-10T22:37:32.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04dffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 0x7f04e80c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04dffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 0x7f04e80c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33222/0 (socket says 172.21.15.154:33222) 2023-10-10T22:37:32.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04dffff700 1 -- 172.21.15.154:0/3202925391 learned_addr learned my addr 172.21.15.154:0/3202925391 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:32.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04e6ffd700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e8068390 0x7f04e8159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04e77fe700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81569f0 0x7f04e80c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04dffff700 1 -- 172.21.15.154:0/3202925391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81569f0 msgr2=0x7f04e80c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04dffff700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81569f0 0x7f04e80c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04dffff700 1 -- 172.21.15.154:0/3202925391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e8068390 msgr2=0x7f04e8159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.172+0000 7f04dffff700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e8068390 0x7f04e8159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.173+0000 7f04dffff700 1 -- 172.21.15.154:0/3202925391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d80094f0 con 0x7f04e8156620 2023-10-10T22:37:32.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.173+0000 7f04dffff700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 0x7f04e80c7190 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f04d000c7c0 tx=0x7f04d0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:32.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.173+0000 7f04deffd700 1 -- 172.21.15.154:0/3202925391 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0005a70 con 0x7f04e8156620 2023-10-10T22:37:32.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.173+0000 7f04deffd700 1 -- 172.21.15.154:0/3202925391 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0005bd0 con 0x7f04e8156620 2023-10-10T22:37:32.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.173+0000 7f04deffd700 1 -- 172.21.15.154:0/3202925391 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00070d0 con 0x7f04e8156620 2023-10-10T22:37:32.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.173+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e816a540 con 0x7f04e8156620 2023-10-10T22:37:32.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.173+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e816ab00 con 0x7f04e8156620 2023-10-10T22:37:32.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.174+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e80718b0 con 0x7f04e8156620 2023-10-10T22:37:32.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.175+0000 7f04deffd700 1 -- 172.21.15.154:0/3202925391 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04d0007480 con 0x7f04e8156620 2023-10-10T22:37:32.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.176+0000 7f04deffd700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04c8066f30 0x7f04c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.176+0000 7f04deffd700 1 -- 172.21.15.154:0/3202925391 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f04d0083bd0 con 0x7f04e8156620 2023-10-10T22:37:32.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.176+0000 7f04e6ffd700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04c8066f30 0x7f04c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.177+0000 7f04e6ffd700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04c8066f30 0x7f04c80693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8017000 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:32.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.180+0000 7f04deffd700 1 -- 172.21.15.154:0/3202925391 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04d0050b90 con 0x7f04e8156620 2023-10-10T22:37:32.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.447+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f04e816afb0 con 0x7f04e8156620 2023-10-10T22:37:32.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.451+0000 7f04deffd700 1 -- 172.21.15.154:0/3202925391 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v52) v1 ==== 190+0+0 (secure 0 0 0) 0x7f04d0017020 con 0x7f04e8156620 2023-10-10T22:37:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04c8066f30 msgr2=0x7f04c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04c8066f30 0x7f04c80693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8017000 comp rx=0 tx=0).stop 2023-10-10T22:37:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 msgr2=0x7f04e80c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 0x7f04e80c7190 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f04d000c7c0 tx=0x7f04d0007f70 comp rx=0 tx=0).stop 2023-10-10T22:37:32.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 shutdown_connections 2023-10-10T22:37:32.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f04c8066f30 0x7f04c80693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e81569f0 0x7f04e80c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e8068390 0x7f04e8159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 --2- 172.21.15.154:0/3202925391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e8156620 0x7f04e80c7190 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 >> 172.21.15.154:0/3202925391 conn(0x7f04e80cc540 msgr2=0x7f04e814d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:32.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 shutdown_connections 2023-10-10T22:37:32.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.454+0000 7f04ed9ff700 1 -- 172.21.15.154:0/3202925391 wait complete. 2023-10-10T22:37:32.458 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-10-10T22:37:32.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:32.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.655+0000 7f6090f9d700 1 Processor -- start 2023-10-10T22:37:32.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.655+0000 7f6090f9d700 1 -- start start 2023-10-10T22:37:32.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.656+0000 7f6090f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 0x7f608c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.656+0000 7f6090f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f608c0c7410 0x7f608c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.656+0000 7f6090f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c06e2a0 con 0x7f608c150180 2023-10-10T22:37:32.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.656+0000 7f6090f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c06b2e0 con 0x7f608c0c7410 2023-10-10T22:37:32.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.656+0000 7f6090f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0c78e0 con 0x7f608c150550 2023-10-10T22:37:32.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 0x7f608c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.656+0000 7f608bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f608c0c7410 0x7f608c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f608c0c7410 0x7f608c069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:47012/0 (socket says 172.21.15.154:47012) 2023-10-10T22:37:32.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608bfff700 1 -- 172.21.15.154:0/3452326305 learned_addr learned my addr 172.21.15.154:0/3452326305 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:32.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608b7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f608c150180 0x7f608c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:37224/0 (socket says 172.21.15.154:37224) 2023-10-10T22:37:32.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608bfff700 1 -- 172.21.15.154:0/3452326305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 msgr2=0x7f608c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:32.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608bfff700 1 --2- 172.21.15.154:0/3452326305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 0x7f608c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608bfff700 1 -- 172.21.15.154:0/3452326305 >> v1:172.21.15.179:6789/0 conn(0x7f608c150180 legacy=0x7f608c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608bfff700 1 -- 172.21.15.154:0/3452326305 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0c7bc0 con 0x7f608c0c7410 2023-10-10T22:37:32.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608a7fc700 1 -- 172.21.15.154:0/3452326305 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565692129 0 0) 0x7f608c06e2a0 con 0x7f608c150180 2023-10-10T22:37:32.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.657+0000 7f608bfff700 1 --2- 172.21.15.154:0/3452326305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f608c0c7410 0x7f608c069f50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f608400b040 tx=0x7f608400c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f029da80d6f9024 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:32.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f608a7fc700 1 -- 172.21.15.154:0/3452326305 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608400a2e0 con 0x7f608c0c7410 2023-10-10T22:37:32.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f608a7fc700 1 -- 172.21.15.154:0/3452326305 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608400ba60 con 0x7f608c0c7410 2023-10-10T22:37:32.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f608a7fc700 1 -- 172.21.15.154:0/3452326305 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608400be00 con 0x7f608c0c7410 2023-10-10T22:37:32.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f6090f9d700 1 -- 172.21.15.154:0/3452326305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f608c0c7410 msgr2=0x7f608c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f6090f9d700 1 --2- 172.21.15.154:0/3452326305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f608c0c7410 0x7f608c069f50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f608400b040 tx=0x7f608400c040 comp rx=0 tx=0).stop 2023-10-10T22:37:32.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f6090f9d700 1 -- 172.21.15.154:0/3452326305 shutdown_connections 2023-10-10T22:37:32.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f6090f9d700 1 --2- 172.21.15.154:0/3452326305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f608c0c7410 0x7f608c069f50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f6090f9d700 1 --2- 172.21.15.154:0/3452326305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 0x7f608c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f6090f9d700 1 -- 172.21.15.154:0/3452326305 >> 172.21.15.154:0/3452326305 conn(0x7f608c0cc1f0 msgr2=0x7f608c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:32.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f6090f9d700 1 -- 172.21.15.154:0/3452326305 shutdown_connections 2023-10-10T22:37:32.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.658+0000 7f6090f9d700 1 -- 172.21.15.154:0/3452326305 wait complete. 2023-10-10T22:37:32.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.660+0000 7f6090f9d700 1 Processor -- start 2023-10-10T22:37:32.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.660+0000 7f6090f9d700 1 -- start start 2023-10-10T22:37:32.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f6090f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f608c0c7410 0x7f608c16d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f6090f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c150180 0x7f608c0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f6090f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 0x7f608c14aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f6090f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c16d940 con 0x7f608c150180 2023-10-10T22:37:32.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f6090f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0af1a0 con 0x7f608c0c7410 2023-10-10T22:37:32.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f6090f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0b0490 con 0x7f608c150550 2023-10-10T22:37:32.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f608affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c150180 0x7f608c0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f608affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c150180 0x7f608c0cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33236/0 (socket says 172.21.15.154:33236) 2023-10-10T22:37:32.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f608affd700 1 -- 172.21.15.154:0/1551935540 learned_addr learned my addr 172.21.15.154:0/1551935540 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f608b7fe700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f608c0c7410 0x7f608c16d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.661+0000 7f608bfff700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 0x7f608c14aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f608affd700 1 -- 172.21.15.154:0/1551935540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 msgr2=0x7f608c14aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f608affd700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 0x7f608c14aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f608affd700 1 -- 172.21.15.154:0/1551935540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f608c0c7410 msgr2=0x7f608c16d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f608affd700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f608c0c7410 0x7f608c16d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f608affd700 1 -- 172.21.15.154:0/1551935540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608400aaf0 con 0x7f608c150180 2023-10-10T22:37:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f608affd700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c150180 0x7f608c0cb4c0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f608000ede0 tx=0x7f608000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f60737fe700 1 -- 172.21.15.154:0/1551935540 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608000eee0 con 0x7f608c150180 2023-10-10T22:37:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f60737fe700 1 -- 172.21.15.154:0/1551935540 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608000dd30 con 0x7f608c150180 2023-10-10T22:37:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c0af3f0 con 0x7f608c150180 2023-10-10T22:37:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f60737fe700 1 -- 172.21.15.154:0/1551935540 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608000dea0 con 0x7f608c150180 2023-10-10T22:37:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.662+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c0af9b0 con 0x7f608c150180 2023-10-10T22:37:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.663+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c04c3c0 con 0x7f608c150180 2023-10-10T22:37:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.664+0000 7f60737fe700 1 -- 172.21.15.154:0/1551935540 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60800108a0 con 0x7f608c150180 2023-10-10T22:37:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.665+0000 7f60737fe700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6078066f30 0x7f60780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:32.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.665+0000 7f60737fe700 1 -- 172.21.15.154:0/1551935540 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f6080084a80 con 0x7f608c150180 2023-10-10T22:37:32.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.665+0000 7f608b7fe700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6078066f30 0x7f60780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:32.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.666+0000 7f608b7fe700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6078066f30 0x7f60780693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f607c007fd0 tx=0x7f607c007d50 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:32.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.669+0000 7f60737fe700 1 -- 172.21.15.154:0/1551935540 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6080051a40 con 0x7f608c150180 2023-10-10T22:37:32.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.902+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f608c06ada0 con 0x7f608c150180 2023-10-10T22:37:32.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.902+0000 7f60737fe700 1 -- 172.21.15.154:0/1551935540 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f608001d090 con 0x7f608c150180 2023-10-10T22:37:32.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:32.905 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1468165521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1468165521},{"type":"v1","addr":"172.21.15.179:6834","nonce":1468165521}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1270073932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1270073932},{"type":"v1","addr":"172.21.15.154:6834","nonce":1270073932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2994571754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2994571754},{"type":"v1","addr":"172.21.15.154:6835","nonce":2994571754}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:37:21.762982+0000","modified":"2023-10-10T22:37:25.332647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10182":{"gid":10182,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1275463629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1275463629},{"type":"v1","addr":"172.21.15.179:6835","nonce":1275463629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-10T22:37:32.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6078066f30 msgr2=0x7f60780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6078066f30 0x7f60780693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f607c007fd0 tx=0x7f607c007d50 comp rx=0 tx=0).stop 2023-10-10T22:37:32.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c150180 msgr2=0x7f608c0cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:32.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c150180 0x7f608c0cb4c0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f608000ede0 tx=0x7f608000b430 comp rx=0 tx=0).stop 2023-10-10T22:37:32.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 shutdown_connections 2023-10-10T22:37:32.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6078066f30 0x7f60780693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f608c150550 0x7f608c14aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f608c0c7410 0x7f608c16d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 --2- 172.21.15.154:0/1551935540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f608c150180 0x7f608c0cb4c0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:32.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 >> 172.21.15.154:0/1551935540 conn(0x7f608c0cc1f0 msgr2=0x7f608c158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:32.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 shutdown_connections 2023-10-10T22:37:32.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:32.905+0000 7f6090f9d700 1 -- 172.21.15.154:0/1551935540 wait complete. 2023-10-10T22:37:32.910 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 94 2023-10-10T22:37:33.326 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 94, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-10T22:37:21.762982+0000', 'modified': '2023-10-10T22:37:25.332647+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10182}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10182': {'gid': 10182, 'name': 'b', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/1275463629', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6833', 'nonce': 1275463629}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 1275463629}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-10T22:37:33.327 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-10T22:37:33.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-10T22:37:33.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.510+0000 7f161f7ff700 1 Processor -- start 2023-10-10T22:37:33.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.510+0000 7f161f7ff700 1 -- start start 2023-10-10T22:37:33.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.511+0000 7f161f7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f161806c0a0 0x7f16180caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.511+0000 7f161f7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161815df50 0x7f161815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.511+0000 7f161f7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161815d7e0 con 0x7f161806bcd0 2023-10-10T22:37:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.511+0000 7f161f7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161815dac0 con 0x7f161806c0a0 2023-10-10T22:37:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.511+0000 7f161f7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161815aa30 con 0x7f161815df50 2023-10-10T22:37:33.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.511+0000 7f161d59b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f161806bcd0 0x7f161815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41132/0 (socket says 172.21.15.154:41132) 2023-10-10T22:37:33.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.511+0000 7f161d59b700 1 -- 172.21.15.154:0/653576608 learned_addr learned my addr 172.21.15.154:0/653576608 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:33.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f161cd9a700 1 --2- 172.21.15.154:0/653576608 >> v2:172.21.15.179:3300/0 conn(0x7f161806c0a0 0x7f16180caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f161dd9c700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161815df50 0x7f161815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464601570 0 0) 0x7f161815d7e0 con 0x7f161806bcd0 2023-10-10T22:37:33.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1604003570 con 0x7f161806bcd0 2023-10-10T22:37:33.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641715088 0 0) 0x7f1604003570 con 0x7f161806bcd0 2023-10-10T22:37:33.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161815df50 msgr2=0x7f161815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161815df50 0x7f161815e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 >> v2:172.21.15.179:3300/0 conn(0x7f161806c0a0 msgr2=0x7f16180caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 --2- 172.21.15.154:0/653576608 >> v2:172.21.15.179:3300/0 conn(0x7f161806c0a0 0x7f16180caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161815ad10 con 0x7f161806bcd0 2023-10-10T22:37:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f1614001470 con 0x7f161806bcd0 2023-10-10T22:37:33.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 >> v1:172.21.15.154:6789/0 conn(0x7f161806bcd0 legacy=0x7f161815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161815df50 0x7f1604003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1604003fe0 0x7f1604004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1604004d50 0x7f16040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161815dac0 con 0x7f1604004d50 2023-10-10T22:37:33.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161815aa30 con 0x7f1604003fe0 2023-10-10T22:37:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.512+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160400bb40 con 0x7f161815df50 2023-10-10T22:37:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f161dd9c700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1604004d50 0x7f16040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f161cd9a700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1604003fe0 0x7f1604004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f161d59b700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161815df50 0x7f1604003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f161dd9c700 1 -- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161815df50 msgr2=0x7f1604003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f161dd9c700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f161815df50 0x7f1604003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f161dd9c700 1 -- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1604003fe0 msgr2=0x7f1604004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f161dd9c700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1604003fe0 0x7f1604004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f161dd9c700 1 -- 172.21.15.154:0/653576608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1604003570 con 0x7f1604004d50 2023-10-10T22:37:33.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f161dd9c700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1604004d50 0x7f16040051c0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f16100094d0 tx=0x7f161000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161f0a99c76636dc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000ea90 con 0x7f1604004d50 2023-10-10T22:37:33.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000f040 con 0x7f1604004d50 2023-10-10T22:37:33.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.513+0000 7f160ffff700 1 -- 172.21.15.154:0/653576608 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000ee20 con 0x7f1604004d50 2023-10-10T22:37:33.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.514+0000 7f161f7ff700 1 -- 172.21.15.154:0/653576608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1604004d50 msgr2=0x7f16040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.514+0000 7f161f7ff700 1 --2- 172.21.15.154:0/653576608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1604004d50 0x7f16040051c0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f16100094d0 tx=0x7f161000b040 comp rx=0 tx=0).stop 2023-10-10T22:37:33.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.514+0000 7f161dd9c700 1 -- 172.21.15.154:0/653576608 reap_dead start 2023-10-10T22:37:33.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.514+0000 7f161f7ff700 1 -- 172.21.15.154:0/653576608 shutdown_connections 2023-10-10T22:37:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.514+0000 7f161f7ff700 1 -- 172.21.15.154:0/653576608 >> 172.21.15.154:0/653576608 conn(0x7f16180ce600 msgr2=0x7f16180cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.514+0000 7f161f7ff700 1 -- 172.21.15.154:0/653576608 shutdown_connections 2023-10-10T22:37:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.514+0000 7f161f7ff700 1 -- 172.21.15.154:0/653576608 wait complete. 2023-10-10T22:37:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.516+0000 7f161f7ff700 1 Processor -- start 2023-10-10T22:37:33.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.516+0000 7f161f7ff700 1 -- start start 2023-10-10T22:37:33.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161f7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1604004d50 0x7f1618142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161f7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161816c8c0 0x7f161816ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161f7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161816cd30 0x7f1618158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161f7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161815a3f0 con 0x7f161816cd30 2023-10-10T22:37:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161f7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161816b820 con 0x7f161816c8c0 2023-10-10T22:37:33.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161f7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161816bb00 con 0x7f1604004d50 2023-10-10T22:37:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161dd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161816cd30 0x7f1618158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161dd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161816cd30 0x7f1618158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33254/0 (socket says 172.21.15.154:33254) 2023-10-10T22:37:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161dd9c700 1 -- 172.21.15.154:0/429842404 learned_addr learned my addr 172.21.15.154:0/429842404 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:33.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161cd9a700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161816c8c0 0x7f161816ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161d59b700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1604004d50 0x7f1618142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161dd9c700 1 -- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1604004d50 msgr2=0x7f1618142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161dd9c700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1604004d50 0x7f1618142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161dd9c700 1 -- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161816c8c0 msgr2=0x7f161816ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161dd9c700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161816c8c0 0x7f161816ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161dd9c700 1 -- 172.21.15.154:0/429842404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161816bde0 con 0x7f161816cd30 2023-10-10T22:37:33.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161cd9a700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161816c8c0 0x7f161816ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.517+0000 7f161d59b700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1604004d50 0x7f1618142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.518+0000 7f161dd9c700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161816cd30 0x7f1618158dd0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f160400ba90 tx=0x7f161001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.518+0000 7f160d7fa700 1 -- 172.21.15.154:0/429842404 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161001e640 con 0x7f161816cd30 2023-10-10T22:37:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.518+0000 7f160d7fa700 1 -- 172.21.15.154:0/429842404 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161001e7c0 con 0x7f161816cd30 2023-10-10T22:37:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.518+0000 7f161f7ff700 1 -- 172.21.15.154:0/429842404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161816c0c0 con 0x7f161816cd30 2023-10-10T22:37:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.518+0000 7f160d7fa700 1 -- 172.21.15.154:0/429842404 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161001ebc0 con 0x7f161816cd30 2023-10-10T22:37:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.518+0000 7f161f7ff700 1 -- 172.21.15.154:0/429842404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1618143400 con 0x7f161816cd30 2023-10-10T22:37:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.520+0000 7f160d7fa700 1 -- 172.21.15.154:0/429842404 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1610003040 con 0x7f161816cd30 2023-10-10T22:37:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.521+0000 7f160d7fa700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f15fc066f30 0x7f15fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.521+0000 7f160d7fa700 1 -- 172.21.15.154:0/429842404 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f1610086800 con 0x7f161816cd30 2023-10-10T22:37:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.521+0000 7f161d59b700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f15fc066f30 0x7f15fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.521+0000 7f161d59b700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f15fc066f30 0x7f15fc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f16140079e0 tx=0x7f1614009040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.523+0000 7f162de56b80 1 Processor -- start 2023-10-10T22:37:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.523+0000 7f162de56b80 1 -- start start 2023-10-10T22:37:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f162de56b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 0x559f001ece20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f162de56b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f00215a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f162de56b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f00215f60 0x559f001e8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f162de56b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f00143a70 con 0x559f00236d00 2023-10-10T22:37:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f162de56b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f00141270 con 0x559f001eca50 2023-10-10T22:37:33.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f162de56b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f0013d060 con 0x559f00215f60 2023-10-10T22:37:33.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f161cd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f00215a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f161cd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f00215a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33260/0 (socket says 172.21.15.154:33260) 2023-10-10T22:37:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f161cd9a700 1 -- 172.21.15.154:0/159562964 learned_addr learned my addr 172.21.15.154:0/159562964 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f161cd9a700 1 -- 172.21.15.154:0/159562964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f00215f60 msgr2=0x559f001e8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f161cd9a700 1 --2- 172.21.15.154:0/159562964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f00215f60 0x559f001e8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f161cd9a700 1 -- 172.21.15.154:0/159562964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 msgr2=0x559f001ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f161cd9a700 1 --2- 172.21.15.154:0/159562964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 0x559f001ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f161cd9a700 1 -- 172.21.15.154:0/159562964 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559efffd7270 con 0x559f00236d00 2023-10-10T22:37:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.524+0000 7f161cd9a700 1 --2- 172.21.15.154:0/159562964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f00215a20 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f1608009c30 tx=0x7f1608008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ed068b68defbb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f16027fc700 1 -- 172.21.15.154:0/159562964 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608013bc0 con 0x559f00236d00 2023-10-10T22:37:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f16027fc700 1 -- 172.21.15.154:0/159562964 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608013d20 con 0x559f00236d00 2023-10-10T22:37:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f16027fc700 1 -- 172.21.15.154:0/159562964 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608016670 con 0x559f00236d00 2023-10-10T22:37:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f162de56b80 1 -- 172.21.15.154:0/159562964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 msgr2=0x559f00215a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f162de56b80 1 --2- 172.21.15.154:0/159562964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f00215a20 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f1608009c30 tx=0x7f1608008040 comp rx=0 tx=0).stop 2023-10-10T22:37:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f162de56b80 1 -- 172.21.15.154:0/159562964 shutdown_connections 2023-10-10T22:37:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f162de56b80 1 --2- 172.21.15.154:0/159562964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f00215f60 0x559f001e8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f162de56b80 1 --2- 172.21.15.154:0/159562964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 0x559f001ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f162de56b80 1 --2- 172.21.15.154:0/159562964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f00215a20 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f162de56b80 1 -- 172.21.15.154:0/159562964 >> 172.21.15.154:0/159562964 conn(0x559f001ee370 msgr2=0x559f001ee740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f162de56b80 1 -- 172.21.15.154:0/159562964 shutdown_connections 2023-10-10T22:37:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.525+0000 7f162de56b80 1 -- 172.21.15.154:0/159562964 wait complete. 2023-10-10T22:37:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.526+0000 7f162de56b80 1 -- start start 2023-10-10T22:37:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.526+0000 7f162de56b80 1 Processor -- start 2023-10-10T22:37:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.527+0000 7f162de56b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 0x559f00236680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.527+0000 7f162de56b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0021c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.527+0000 7f162de56b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00236d00 0x559f0022fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.527+0000 7f162de56b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f000e8890 con 0x559f00215f60 2023-10-10T22:37:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.527+0000 7f162de56b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f00103ea0 con 0x559f00236d00 2023-10-10T22:37:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.527+0000 7f162de56b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559efffbfe30 con 0x559f001eca50 2023-10-10T22:37:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f162de56b80 10 client.0 _ll_register_callbacks cb 0x559f001b0110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T22:37:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161cd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0021c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161cd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0021c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33270/0 (socket says 172.21.15.154:33270) 2023-10-10T22:37:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161cd9a700 1 -- 172.21.15.154:0/1600520 learned_addr learned my addr 172.21.15.154:0/1600520 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161dd9c700 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00236d00 0x559f0022fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161d59b700 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 0x559f00236680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161cd9a700 1 -- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 msgr2=0x559f00236680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161cd9a700 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 0x559f00236680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161cd9a700 1 -- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00236d00 msgr2=0x559f0022fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161cd9a700 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00236d00 0x559f0022fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161cd9a700 1 -- 172.21.15.154:0/1600520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1608009900 con 0x559f00215f60 2023-10-10T22:37:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161dd9c700 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00236d00 0x559f0022fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:33.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161d59b700 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 0x559f00236680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:33.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f161cd9a700 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0021c820 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f160801a000 tx=0x7f160801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df479081a9a5c119 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.528+0000 7f15f77fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T22:37:33.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f15f77fe700 1 -- 172.21.15.154:0/1600520 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608016dc0 con 0x559f00215f60 2023-10-10T22:37:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f15f77fe700 1 -- 172.21.15.154:0/1600520 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f160801a030 con 0x559f00215f60 2023-10-10T22:37:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f162de56b80 1 -- 172.21.15.154:0/1600520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f001e1b70 con 0x559f00215f60 2023-10-10T22:37:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f15f77fe700 1 -- 172.21.15.154:0/1600520 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f160801f640 con 0x559f00215f60 2023-10-10T22:37:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f162de56b80 10 client.10347 fetch_fsmap learned FSMap version 94 2023-10-10T22:37:33.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f162de56b80 1 -- 172.21.15.154:0/1600520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x559efff79fe0 con 0x559f00215f60 2023-10-10T22:37:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f15f77fe700 1 -- 172.21.15.154:0/1600520 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f001e1b70 con 0x559f00215f60 2023-10-10T22:37:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f15f77fe700 1 -- 172.21.15.154:0/1600520 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 94) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f160801f7a0 con 0x559f00215f60 2023-10-10T22:37:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f162de56b80 10 client.10347 fetch_fsmap finished waiting for FSMap version 94 2023-10-10T22:37:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f162de56b80 10 client.10347 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-10T22:37:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f162de56b80 20 client.10347 populate_metadata read hostname 'smithi154' 2023-10-10T22:37:33.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f162de56b80 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] conn(0x559f0022cfc0 0x559f0022d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f162de56b80 4 client.10347 mds_command: new command op to 10182 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-10T22:37:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.529+0000 7f162de56b80 1 -- 172.21.15.154:0/1600520 --> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f001beaa0 con 0x559f0022cfc0 2023-10-10T22:37:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.530+0000 7f161d59b700 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] conn(0x559f0022cfc0 0x559f0022d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.530+0000 7f15f77fe700 10 client.10347 ms_handle_connect on v2:172.21.15.179:6833/1275463629 2023-10-10T22:37:33.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.530+0000 7f161d59b700 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] conn(0x559f0022cfc0 0x559f0022d390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f1924c33b16c7b1 server_cookie=cede7d7ea68b66c0 in_seq=0 out_seq=0 2023-10-10T22:37:33.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.531+0000 7f15f77fe700 1 -- 172.21.15.154:0/1600520 <== mds.0 v2:172.21.15.179:6833/1275463629 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559f001beaa0 con 0x559f0022cfc0 2023-10-10T22:37:33.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.531+0000 7f15f77fe700 10 client.10347 handle_command_reply: tid=0 2023-10-10T22:37:33.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.531+0000 7f162de56b80 1 client.10347 shutdown 2023-10-10T22:37:33.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 -- 172.21.15.154:0/1600520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 msgr2=0x559f0021c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0021c820 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f160801a000 tx=0x7f160801e000 comp rx=0 tx=0).stop 2023-10-10T22:37:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 -- 172.21.15.154:0/1600520 shutdown_connections 2023-10-10T22:37:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] conn(0x559f0022cfc0 0x559f0022d390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00236d00 0x559f0022fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 0x559f00236680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 --2- 172.21.15.154:0/1600520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0021c820 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f15f77fe700 0 client.10347 ms_handle_reset on v2:172.21.15.179:6833/1275463629 2023-10-10T22:37:33.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 -- 172.21.15.154:0/1600520 >> 172.21.15.154:0/1600520 conn(0x559f001ee370 msgr2=0x559f001e9850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:33.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 -- 172.21.15.154:0/1600520 shutdown_connections 2023-10-10T22:37:33.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 1 -- 172.21.15.154:0/1600520 wait complete. 2023-10-10T22:37:33.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.532+0000 7f162de56b80 20 client.10347 trim_cache size 0 max 16384 2023-10-10T22:37:33.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.549+0000 7f162de56b80 1 Processor -- start 2023-10-10T22:37:33.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.549+0000 7f162de56b80 1 -- start start 2023-10-10T22:37:33.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f162de56b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 0x559f001ef130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f162de56b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0022d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f162de56b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f00236d00 0x559f00242530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f162de56b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f001ea200 con 0x559f00215f60 2023-10-10T22:37:33.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f162de56b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f001e75a0 con 0x559f001eca50 2023-10-10T22:37:33.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f162de56b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f001eadb0 con 0x559f00236d00 2023-10-10T22:37:33.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161cd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0022d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161cd9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0022d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33280/0 (socket says 172.21.15.154:33280) 2023-10-10T22:37:33.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161cd9a700 1 -- 172.21.15.154:0/4121169199 learned_addr learned my addr 172.21.15.154:0/4121169199 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:33.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161d59b700 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 0x559f001ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161dd9c700 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f00236d00 0x559f00242530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161cd9a700 1 -- 172.21.15.154:0/4121169199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f00236d00 msgr2=0x559f00242530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161cd9a700 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f00236d00 0x559f00242530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161cd9a700 1 -- 172.21.15.154:0/4121169199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 msgr2=0x559f001ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161cd9a700 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 0x559f001ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161cd9a700 1 -- 172.21.15.154:0/4121169199 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f0010b780 con 0x559f00215f60 2023-10-10T22:37:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.550+0000 7f161d59b700 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 0x559f001ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:33.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f161cd9a700 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0022d390 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f1608006c80 tx=0x7f1608022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39097c11d73bd102 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f1602ffd700 1 -- 172.21.15.154:0/4121169199 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160801fe70 con 0x559f00215f60 2023-10-10T22:37:33.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f1602ffd700 1 -- 172.21.15.154:0/4121169199 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160801fc60 con 0x559f00215f60 2023-10-10T22:37:33.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f1602ffd700 1 -- 172.21.15.154:0/4121169199 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160801f640 con 0x559f00215f60 2023-10-10T22:37:33.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f162de56b80 1 -- 172.21.15.154:0/4121169199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 msgr2=0x559f0022d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f162de56b80 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0022d390 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f1608006c80 tx=0x7f1608022040 comp rx=0 tx=0).stop 2023-10-10T22:37:33.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f162de56b80 1 -- 172.21.15.154:0/4121169199 shutdown_connections 2023-10-10T22:37:33.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f162de56b80 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f00236d00 0x559f00242530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f162de56b80 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f001eca50 0x559f001ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f162de56b80 1 --2- 172.21.15.154:0/4121169199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00215f60 0x559f0022d390 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.551+0000 7f162de56b80 1 -- 172.21.15.154:0/4121169199 >> 172.21.15.154:0/4121169199 conn(0x559f001ee370 msgr2=0x559f001ee740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:33.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.552+0000 7f162de56b80 1 -- 172.21.15.154:0/4121169199 shutdown_connections 2023-10-10T22:37:33.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.552+0000 7f162de56b80 1 -- 172.21.15.154:0/4121169199 wait complete. 2023-10-10T22:37:33.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.552+0000 7f162de56b80 1 -- start start 2023-10-10T22:37:33.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.552+0000 7f162de56b80 1 Processor -- start 2023-10-10T22:37:33.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.553+0000 7f162de56b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 0x559f002308c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.553+0000 7f162de56b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00215f60 0x559f00230e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.553+0000 7f162de56b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f0022e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.553+0000 7f162de56b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f001e9e20 con 0x559f00236d00 2023-10-10T22:37:33.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.553+0000 7f162de56b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f00255a90 con 0x559f00215f60 2023-10-10T22:37:33.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.553+0000 7f162de56b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f001e59c0 con 0x559f001eca50 2023-10-10T22:37:33.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.553+0000 7f162de56b80 10 client.0 _ll_register_callbacks cb 0x559f001b0110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-10T22:37:33.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161dd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f0022e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161dd9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f0022e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33286/0 (socket says 172.21.15.154:33286) 2023-10-10T22:37:33.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161dd9c700 1 -- 172.21.15.154:0/255515050 learned_addr learned my addr 172.21.15.154:0/255515050 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:33.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161cd9a700 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00215f60 0x559f00230e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161d59b700 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 0x559f002308c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161dd9c700 1 -- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 msgr2=0x559f002308c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161dd9c700 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 0x559f002308c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161dd9c700 1 -- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00215f60 msgr2=0x559f00230e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161dd9c700 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00215f60 0x559f00230e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161dd9c700 1 -- 172.21.15.154:0/255515050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559efff79fe0 con 0x559f00236d00 2023-10-10T22:37:33.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f161dd9c700 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f0022e140 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f16100099f0 tx=0x7f161000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fcd17d7049248d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f15f77fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-10-10T22:37:33.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f15f77fe700 1 -- 172.21.15.154:0/255515050 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610057480 con 0x559f00236d00 2023-10-10T22:37:33.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f15f77fe700 1 -- 172.21.15.154:0/255515050 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f161005a6d0 con 0x559f00236d00 2023-10-10T22:37:33.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.554+0000 7f162de56b80 1 -- 172.21.15.154:0/255515050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1618169bf0 con 0x559f00236d00 2023-10-10T22:37:33.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f15f77fe700 1 -- 172.21.15.154:0/255515050 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f161005e420 con 0x559f00236d00 2023-10-10T22:37:33.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f162de56b80 10 client.10353 fetch_fsmap learned FSMap version 94 2023-10-10T22:37:33.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f162de56b80 1 -- 172.21.15.154:0/255515050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x559f000f2470 con 0x559f00236d00 2023-10-10T22:37:33.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f15f77fe700 1 -- 172.21.15.154:0/255515050 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618169bf0 con 0x559f00236d00 2023-10-10T22:37:33.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f15f77fe700 1 -- 172.21.15.154:0/255515050 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 94) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f161005df90 con 0x559f00236d00 2023-10-10T22:37:33.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f162de56b80 10 client.10353 fetch_fsmap finished waiting for FSMap version 94 2023-10-10T22:37:33.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f162de56b80 10 client.10353 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-10T22:37:33.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f162de56b80 20 client.10353 populate_metadata read hostname 'smithi154' 2023-10-10T22:37:33.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f162de56b80 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] conn(0x559f002336c0 0x559f0022e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f162de56b80 4 client.10353 mds_command: new command op to 10182 tid=0[{"prefix": "status"}] 2023-10-10T22:37:33.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.555+0000 7f162de56b80 1 -- 172.21.15.154:0/255515050 --> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f1608013d20 con 0x559f002336c0 2023-10-10T22:37:33.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.556+0000 7f161d59b700 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] conn(0x559f002336c0 0x559f0022e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.556+0000 7f161d59b700 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] conn(0x559f002336c0 0x559f0022e680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=970b3d02697a50b3 server_cookie=fc3cf6049b878151 in_seq=0 out_seq=0 2023-10-10T22:37:33.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.556+0000 7f15f77fe700 10 client.10353 ms_handle_connect on v2:172.21.15.179:6833/1275463629 2023-10-10T22:37:33.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.556+0000 7f15f77fe700 1 -- 172.21.15.154:0/255515050 <== mds.0 v2:172.21.15.179:6833/1275463629 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x7f1608013d20 con 0x559f002336c0 2023-10-10T22:37:33.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.556+0000 7f15f77fe700 10 client.10353 handle_command_reply: tid=0 2023-10-10T22:37:33.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 client.10353 shutdown 2023-10-10T22:37:33.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 -- 172.21.15.154:0/255515050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 msgr2=0x559f0022e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f0022e140 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f16100099f0 tx=0x7f161000c040 comp rx=0 tx=0).stop 2023-10-10T22:37:33.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 -- 172.21.15.154:0/255515050 shutdown_connections 2023-10-10T22:37:33.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f00236d00 0x559f0022e140 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559f001eca50 0x559f002308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:6833/1275463629,v1:172.21.15.179:6835/1275463629] conn(0x559f002336c0 0x559f0022e680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 --2- 172.21.15.154:0/255515050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f00215f60 0x559f00230e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 -- 172.21.15.154:0/255515050 >> 172.21.15.154:0/255515050 conn(0x559f001ee370 msgr2=0x559f0022fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:33.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f15f77fe700 0 client.10353 ms_handle_reset on v2:172.21.15.179:6833/1275463629 2023-10-10T22:37:33.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 -- 172.21.15.154:0/255515050 shutdown_connections 2023-10-10T22:37:33.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 1 -- 172.21.15.154:0/255515050 wait complete. 2023-10-10T22:37:33.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.557+0000 7f162de56b80 20 client.10353 trim_cache size 0 max 16384 2023-10-10T22:37:33.591 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:37:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "8fc592ed-075f-4c05-97bb-c4c6e0f43dd7", 2023-10-10T22:37:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-10-10T22:37:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 10182, 2023-10-10T22:37:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-10-10T22:37:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-10-10T22:37:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-10-10T22:37:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.236045522, 2023-10-10T22:37:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 94, 2023-10-10T22:37:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 209, 2023-10-10T22:37:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 209, 2023-10-10T22:37:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.019299486000001 2023-10-10T22:37:33.594 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:37:33.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 -- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f15fc066f30 msgr2=0x7f15fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f15fc066f30 0x7f15fc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f16140079e0 tx=0x7f1614009040 comp rx=0 tx=0).stop 2023-10-10T22:37:33.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 -- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161816cd30 msgr2=0x7f1618158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161816cd30 0x7f1618158dd0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f160400ba90 tx=0x7f161001a000 comp rx=0 tx=0).stop 2023-10-10T22:37:33.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 -- 172.21.15.154:0/429842404 shutdown_connections 2023-10-10T22:37:33.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f15fc066f30 0x7f15fc0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f161816cd30 0x7f1618158dd0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1604004d50 0x7f1618142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 --2- 172.21.15.154:0/429842404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f161816c8c0 0x7f161816ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 -- 172.21.15.154:0/429842404 >> 172.21.15.154:0/429842404 conn(0x7f16180ce600 msgr2=0x7f161815bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:33.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 -- 172.21.15.154:0/429842404 shutdown_connections 2023-10-10T22:37:33.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.558+0000 7f161f7ff700 1 -- 172.21.15.154:0/429842404 wait complete. 2023-10-10T22:37:33.598 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-10T22:37:33.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.779+0000 7f84015ff700 1 Processor -- start 2023-10-10T22:37:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.779+0000 7f84015ff700 1 -- start start 2023-10-10T22:37:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.780+0000 7f84015ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83fc155c10 0x7f83fc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.780+0000 7f84015ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83fc0ac6d0 0x7f83fc0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.780+0000 7f84015ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83fc0acac0 con 0x7f83fc0ac230 2023-10-10T22:37:33.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.780+0000 7f84015ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc0ad930 con 0x7f83fc0ac6d0 2023-10-10T22:37:33.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f84015ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc0acd20 con 0x7f83fc155c10 2023-10-10T22:37:33.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83fb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83fc0ac6d0 0x7f83fc0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83fb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83fc0ac6d0 0x7f83fc0b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33296/0 (socket says 172.21.15.154:33296) 2023-10-10T22:37:33.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83fa7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f83fc0ac230 0x7f83fc1568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41148/0 (socket says 172.21.15.154:41148) 2023-10-10T22:37:33.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83fb7fe700 1 -- 172.21.15.154:0/41068925 learned_addr learned my addr 172.21.15.154:0/41068925 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:33.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83faffd700 1 --2- 172.21.15.154:0/41068925 >> v2:172.21.15.179:3300/0 conn(0x7f83fc155c10 0x7f83fc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83fb7fe700 1 -- 172.21.15.154:0/41068925 >> v2:172.21.15.179:3300/0 conn(0x7f83fc155c10 msgr2=0x7f83fc155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:33.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83fb7fe700 1 --2- 172.21.15.154:0/41068925 >> v2:172.21.15.179:3300/0 conn(0x7f83fc155c10 0x7f83fc155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83fb7fe700 1 -- 172.21.15.154:0/41068925 >> v1:172.21.15.154:6789/0 conn(0x7f83fc0ac230 legacy=0x7f83fc1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83fb7fe700 1 -- 172.21.15.154:0/41068925 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc0ad000 con 0x7f83fc0ac6d0 2023-10-10T22:37:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.781+0000 7f83f9ffb700 1 -- 172.21.15.154:0/41068925 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205917001 0 0) 0x7f83fc0acac0 con 0x7f83fc0ac230 2023-10-10T22:37:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f83fb7fe700 1 --2- 172.21.15.154:0/41068925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac6d0 0x7f83fc0b0300 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f83fc063d40 tx=0x7f83f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338dce63f79b8d16 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f83f9ffb700 1 -- 172.21.15.154:0/41068925 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f400e070 con 0x7f83fc0ac6d0 2023-10-10T22:37:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f83f9ffb700 1 -- 172.21.15.154:0/41068925 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f400ba20 con 0x7f83fc0ac6d0 2023-10-10T22:37:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f83f9ffb700 1 -- 172.21.15.154:0/41068925 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40092e0 con 0x7f83fc0ac6d0 2023-10-10T22:37:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f84015ff700 1 -- 172.21.15.154:0/41068925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac6d0 msgr2=0x7f83fc0b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f84015ff700 1 --2- 172.21.15.154:0/41068925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac6d0 0x7f83fc0b0300 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f83fc063d40 tx=0x7f83f4009840 comp rx=0 tx=0).stop 2023-10-10T22:37:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f84015ff700 1 -- 172.21.15.154:0/41068925 shutdown_connections 2023-10-10T22:37:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f84015ff700 1 --2- 172.21.15.154:0/41068925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac6d0 0x7f83fc0b0300 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f84015ff700 1 --2- 172.21.15.154:0/41068925 >> v2:172.21.15.179:3300/0 conn(0x7f83fc155c10 0x7f83fc155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f84015ff700 1 -- 172.21.15.154:0/41068925 >> 172.21.15.154:0/41068925 conn(0x7f83fc06a320 msgr2=0x7f83fc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f84015ff700 1 -- 172.21.15.154:0/41068925 shutdown_connections 2023-10-10T22:37:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.782+0000 7f84015ff700 1 -- 172.21.15.154:0/41068925 wait complete. 2023-10-10T22:37:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.784+0000 7f84015ff700 1 Processor -- start 2023-10-10T22:37:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.784+0000 7f84015ff700 1 -- start start 2023-10-10T22:37:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f84015ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac230 0x7f83fc0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f84015ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83fc0ac6d0 0x7f83fc13fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f84015ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83fc155c10 0x7f83fc13e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f84015ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc13ff50 con 0x7f83fc0ac230 2023-10-10T22:37:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f84015ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc140a20 con 0x7f83fc155c10 2023-10-10T22:37:33.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f84015ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0c91f0 con 0x7f83fc0ac6d0 2023-10-10T22:37:33.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f83faffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac230 0x7f83fc0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f83faffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac230 0x7f83fc0cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33312/0 (socket says 172.21.15.154:33312) 2023-10-10T22:37:33.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f83faffd700 1 -- 172.21.15.154:0/1564128629 learned_addr learned my addr 172.21.15.154:0/1564128629 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:33.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f83fb7fe700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83fc155c10 0x7f83fc13e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f83fa7fc700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83fc0ac6d0 0x7f83fc13fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f83faffd700 1 -- 172.21.15.154:0/1564128629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83fc0ac6d0 msgr2=0x7f83fc13fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.785+0000 7f83faffd700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83fc0ac6d0 0x7f83fc13fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f83faffd700 1 -- 172.21.15.154:0/1564128629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83fc155c10 msgr2=0x7f83fc13e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:33.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f83faffd700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83fc155c10 0x7f83fc13e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f83faffd700 1 -- 172.21.15.154:0/1564128629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4009ae0 con 0x7f83fc0ac230 2023-10-10T22:37:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f83fa7fc700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83fc0ac6d0 0x7f83fc13fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f83faffd700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac230 0x7f83fc0cce30 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00e960 tx=0x7f83ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f83e2ffd700 1 -- 172.21.15.154:0/1564128629 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00c850 con 0x7f83fc0ac230 2023-10-10T22:37:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f83e2ffd700 1 -- 172.21.15.154:0/1564128629 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00c9b0 con 0x7f83fc0ac230 2023-10-10T22:37:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f83e2ffd700 1 -- 172.21.15.154:0/1564128629 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00cd50 con 0x7f83fc0ac230 2023-10-10T22:37:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc140180 con 0x7f83fc0ac230 2023-10-10T22:37:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.786+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc140740 con 0x7f83fc0ac230 2023-10-10T22:37:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.787+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc04c3c0 con 0x7f83fc0ac230 2023-10-10T22:37:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.788+0000 7f83e2ffd700 1 -- 172.21.15.154:0/1564128629 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83ec013680 con 0x7f83fc0ac230 2023-10-10T22:37:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.789+0000 7f83e2ffd700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f83e8066f30 0x7f83e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.789+0000 7f83e2ffd700 1 -- 172.21.15.154:0/1564128629 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f83ec0849c0 con 0x7f83fc0ac230 2023-10-10T22:37:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.789+0000 7f83fa7fc700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f83e8066f30 0x7f83e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.790+0000 7f83fa7fc700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f83e8066f30 0x7f83e80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83fc141fa0 tx=0x7f83f0009040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:33.793+0000 7f83e2ffd700 1 -- 172.21.15.154:0/1564128629 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83ec051980 con 0x7f83fc0ac230 2023-10-10T22:37:34.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.026+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f83fc0ad2e0 con 0x7f83fc0ac230 2023-10-10T22:37:34.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.027+0000 7f83e2ffd700 1 -- 172.21.15.154:0/1564128629 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v94) v1 ==== 53+0+73 (secure 0 0 0) 0x7f83ec054fa0 con 0x7f83fc0ac230 2023-10-10T22:37:34.136 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-10T22:37:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f83e8066f30 msgr2=0x7f83e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:34.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f83e8066f30 0x7f83e80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83fc141fa0 tx=0x7f83f0009040 comp rx=0 tx=0).stop 2023-10-10T22:37:34.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac230 msgr2=0x7f83fc0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:34.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac230 0x7f83fc0cce30 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00e960 tx=0x7f83ec0091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:34.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 shutdown_connections 2023-10-10T22:37:34.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f83e8066f30 0x7f83e80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:34.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83fc155c10 0x7f83fc13e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83fc0ac230 0x7f83fc0cce30 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 --2- 172.21.15.154:0/1564128629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83fc0ac6d0 0x7f83fc13fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 >> 172.21.15.154:0/1564128629 conn(0x7f83fc06a320 msgr2=0x7f83fc0ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 shutdown_connections 2023-10-10T22:37:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:34.029+0000 7f84015ff700 1 -- 172.21.15.154:0/1564128629 wait complete. 2023-10-10T22:37:34.142 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-10T22:37:34.142 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-10T22:37:34.143 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-10-10T22:37:34.143 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-10T22:37:34.143 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-10T22:37:34.144 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-10T22:37:34.144 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-10T22:37:34.144 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-10T22:37:34.145 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:37:34.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:34.146 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-10-10T22:37:34.184 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-10T22:37:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-10T22:37:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-10-10T22:37:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:37:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-10-10T22:37:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:37:34.186 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:37:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:37:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-10-10T22:37:34.186 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:37:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:37:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-10-10T22:37:34.187 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-10T22:37:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:37:34.187 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-10T22:37:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:37:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-10T22:37:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 36559sec preferred_lft 36559sec 2023-10-10T22:37:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-10-10T22:37:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:37:34.189 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-10T22:37:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff 2023-10-10T22:37:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-10T22:37:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:37:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::7405:16ff:fea0:c407/64 scope link 2023-10-10T22:37:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:37:34.190 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T22:37:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 42:27:4b:fe:f2:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T22:37:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::4027:4bff:fefe:f262/64 scope link 2023-10-10T22:37:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:37:34.191 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-10T22:37:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 9e:bb:37:20:d5:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T22:37:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::9cbb:37ff:fe20:d5ce/64 scope link 2023-10-10T22:37:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-10-10T22:37:34.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:34.192 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-10T22:37:34.285 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-10-10T22:37:34.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:34.289 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-10-10T22:37:34.327 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-10-10T22:37:34.328 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-10T22:37:34.328 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-10T22:37:34.328 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-10T22:37:34.328 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-10T22:37:34.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:34.330 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-10-10T22:37:34.330 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-10-10T22:37:34.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-10T22:37:34.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-10T22:37:34.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-10T22:37:34.332 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-10-10T22:37:34.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:34.528 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T22:37:34.565 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T22:37:34.565 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T22:37:34.566 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:37:34.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:34.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-10-10T22:37:34.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T22:37:34.668 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-10T22:37:34.705 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-10T22:37:34.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-10T22:37:34.706 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-10T22:37:34.782 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-10T22:37:34.782 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-10T22:37:34.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:37:34.913 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:37:34.914 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:37:34.914 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:37:34.931 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:37:34.931 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:37:34.931 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:37:34.932 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T22:37:34.932 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T22:37:34.952 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-10T22:37:34.952 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-10T22:37:34.952 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-10-10T22:37:34.952 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-10T22:37:34.953 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-10T22:37:34.953 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790" 2023-10-10T22:37:34.953 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.154:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2023-10-10T22:37:34.953 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8fc592ed-075f-4c05-97bb-c4c6e0f43dd7" will pass to kernel 2023-10-10T22:37:34.957 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-10T22:37:34.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:34.958 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-10T22:37:35.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-10T22:37:35.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.204+0000 7f25257ff700 1 Processor -- start 2023-10-10T22:37:35.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.204+0000 7f25257ff700 1 -- start start 2023-10-10T22:37:35.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.205+0000 7f25257ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f252006bcd0 0x7f25200caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.205+0000 7f25257ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252006c0a0 0x7f252015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.205+0000 7f25257ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252015d7e0 con 0x7f252015df50 2023-10-10T22:37:35.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.205+0000 7f25257ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252015dac0 con 0x7f252006bcd0 2023-10-10T22:37:35.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f25257ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252015aa30 con 0x7f252006c0a0 2023-10-10T22:37:35.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f251e7fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252006c0a0 0x7f252015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f251e7fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252006c0a0 0x7f252015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:56098/0 (socket says 172.21.15.154:56098) 2023-10-10T22:37:35.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f251e7fc700 1 -- 172.21.15.154:0/395185061 learned_addr learned my addr 172.21.15.154:0/395185061 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:35.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f251effd700 1 --2- 172.21.15.154:0/395185061 >> v2:172.21.15.179:3300/0 conn(0x7f252006bcd0 0x7f25200caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f251e7fc700 1 -- 172.21.15.154:0/395185061 >> v2:172.21.15.179:3300/0 conn(0x7f252006bcd0 msgr2=0x7f25200caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f251e7fc700 1 --2- 172.21.15.154:0/395185061 >> v2:172.21.15.179:3300/0 conn(0x7f252006bcd0 0x7f25200caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f251e7fc700 1 -- 172.21.15.154:0/395185061 >> v1:172.21.15.179:6789/0 conn(0x7f252015df50 legacy=0x7f25200c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f251e7fc700 1 -- 172.21.15.154:0/395185061 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252015ad10 con 0x7f252006c0a0 2023-10-10T22:37:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.206+0000 7f251dffb700 1 -- 172.21.15.154:0/395185061 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600570063 0 0) 0x7f252015d7e0 con 0x7f252015df50 2023-10-10T22:37:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.207+0000 7f251e7fc700 1 --2- 172.21.15.154:0/395185061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252006c0a0 0x7f252015a1e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f25140099b0 tx=0x7f2514009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5948b7f60560d56 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.207+0000 7f251dffb700 1 -- 172.21.15.154:0/395185061 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514009ea0 con 0x7f252006c0a0 2023-10-10T22:37:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.207+0000 7f251dffb700 1 -- 172.21.15.154:0/395185061 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400b860 con 0x7f252006c0a0 2023-10-10T22:37:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.207+0000 7f251dffb700 1 -- 172.21.15.154:0/395185061 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400bc20 con 0x7f252006c0a0 2023-10-10T22:37:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.208+0000 7f25257ff700 1 -- 172.21.15.154:0/395185061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252006c0a0 msgr2=0x7f252015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.208+0000 7f25257ff700 1 --2- 172.21.15.154:0/395185061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252006c0a0 0x7f252015a1e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f25140099b0 tx=0x7f2514009250 comp rx=0 tx=0).stop 2023-10-10T22:37:35.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.208+0000 7f25257ff700 1 -- 172.21.15.154:0/395185061 shutdown_connections 2023-10-10T22:37:35.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.208+0000 7f25257ff700 1 --2- 172.21.15.154:0/395185061 >> v2:172.21.15.179:3300/0 conn(0x7f252006bcd0 0x7f25200caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.208+0000 7f25257ff700 1 --2- 172.21.15.154:0/395185061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252006c0a0 0x7f252015a1e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.208+0000 7f25257ff700 1 -- 172.21.15.154:0/395185061 >> 172.21.15.154:0/395185061 conn(0x7f25200ce600 msgr2=0x7f25200cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:35.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.208+0000 7f25257ff700 1 -- 172.21.15.154:0/395185061 shutdown_connections 2023-10-10T22:37:35.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.208+0000 7f25257ff700 1 -- 172.21.15.154:0/395185061 wait complete. 2023-10-10T22:37:35.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.209+0000 7f25257ff700 1 Processor -- start 2023-10-10T22:37:35.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.209+0000 7f25257ff700 1 -- start start 2023-10-10T22:37:35.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.210+0000 7f25257ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252006bcd0 0x7f2520144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.210+0000 7f25257ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252006c0a0 0x7f25200c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.210+0000 7f25257ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252015df50 0x7f25200c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.210+0000 7f25257ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200b3010 con 0x7f252006c0a0 2023-10-10T22:37:35.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.210+0000 7f25257ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25201448d0 con 0x7f252006bcd0 2023-10-10T22:37:35.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.210+0000 7f25257ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200b2400 con 0x7f252015df50 2023-10-10T22:37:35.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252006c0a0 0x7f25200c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252006c0a0 0x7f25200c33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33324/0 (socket says 172.21.15.154:33324) 2023-10-10T22:37:35.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251e7fc700 1 -- 172.21.15.154:0/1166343386 learned_addr learned my addr 172.21.15.154:0/1166343386 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:35.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251effd700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252006bcd0 0x7f2520144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251f7fe700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252015df50 0x7f25200c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251e7fc700 1 -- 172.21.15.154:0/1166343386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252015df50 msgr2=0x7f25200c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:35.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251e7fc700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252015df50 0x7f25200c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251e7fc700 1 -- 172.21.15.154:0/1166343386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252006bcd0 msgr2=0x7f2520144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:35.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251e7fc700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252006bcd0 0x7f2520144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251e7fc700 1 -- 172.21.15.154:0/1166343386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140094f0 con 0x7f252006c0a0 2023-10-10T22:37:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.211+0000 7f251e7fc700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252006c0a0 0x7f25200c33a0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f252015ab70 tx=0x7f2514017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.212+0000 7f2506ffd700 1 -- 172.21.15.154:0/1166343386 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251401f070 con 0x7f252006c0a0 2023-10-10T22:37:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.212+0000 7f2506ffd700 1 -- 172.21.15.154:0/1166343386 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400b9d0 con 0x7f252006c0a0 2023-10-10T22:37:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.212+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25200b26e0 con 0x7f252006c0a0 2023-10-10T22:37:35.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.212+0000 7f2506ffd700 1 -- 172.21.15.154:0/1166343386 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514011420 con 0x7f252006c0a0 2023-10-10T22:37:35.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.212+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25200b2ca0 con 0x7f252006c0a0 2023-10-10T22:37:35.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.213+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25200b31c0 con 0x7f252006c0a0 2023-10-10T22:37:35.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.214+0000 7f2506ffd700 1 -- 172.21.15.154:0/1166343386 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25140117f0 con 0x7f252006c0a0 2023-10-10T22:37:35.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.215+0000 7f2506ffd700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f250c066f30 0x7f250c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.215+0000 7f2506ffd700 1 -- 172.21.15.154:0/1166343386 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f2514085b10 con 0x7f252006c0a0 2023-10-10T22:37:35.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.215+0000 7f251effd700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f250c066f30 0x7f250c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.216+0000 7f251effd700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f250c066f30 0x7f250c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2510009d10 tx=0x7f25100091a0 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:35.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.219+0000 7f2506ffd700 1 -- 172.21.15.154:0/1166343386 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25200b31c0 con 0x7f252006c0a0 2023-10-10T22:37:35.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.440+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f25200b31c0 con 0x7f250c066f30 2023-10-10T22:37:35.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.442+0000 7f2506ffd700 1 -- 172.21.15.154:0/1166343386 <== mgr.9999 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f25200b31c0 con 0x7f250c066f30 2023-10-10T22:37:35.443 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-10-10T22:37:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-10-10T22:37:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "name": "cephfs" 2023-10-10T22:37:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-10-10T22:37:35.444 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-10-10T22:37:35.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f250c066f30 msgr2=0x7f250c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:35.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f250c066f30 0x7f250c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2510009d10 tx=0x7f25100091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252006c0a0 msgr2=0x7f25200c33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:35.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252006c0a0 0x7f25200c33a0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f252015ab70 tx=0x7f2514017000 comp rx=0 tx=0).stop 2023-10-10T22:37:35.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 shutdown_connections 2023-10-10T22:37:35.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f250c066f30 0x7f250c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252015df50 0x7f25200c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252006bcd0 0x7f2520144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 --2- 172.21.15.154:0/1166343386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252006c0a0 0x7f25200c33a0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 >> 172.21.15.154:0/1166343386 conn(0x7f25200ce600 msgr2=0x7f252015c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:35.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 shutdown_connections 2023-10-10T22:37:35.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.444+0000 7f25257ff700 1 -- 172.21.15.154:0/1166343386 wait complete. 2023-10-10T22:37:35.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-10T22:37:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.647+0000 7f8cce19d700 1 Processor -- start 2023-10-10T22:37:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.648+0000 7f8cce19d700 1 -- start start 2023-10-10T22:37:35.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8cce19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc80c9db0 0x7f8cc8153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8cce19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8cc8157130 0x7f8cc80c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8cce19d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8cc8159ad0 0x7f8cc8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8cce19d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc806e150 con 0x7f8cc8159ad0 2023-10-10T22:37:35.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8cce19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc8153e40 con 0x7f8cc8157130 2023-10-10T22:37:35.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8cce19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80c7800 con 0x7f8cc80c9db0 2023-10-10T22:37:35.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8ccd99c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8cc8159ad0 0x7f8cc8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8ccd99c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8cc8159ad0 0x7f8cc8159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33326/0 (socket says 172.21.15.154:33326) 2023-10-10T22:37:35.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8ccd99c700 1 -- 172.21.15.154:0/1290399375 learned_addr learned my addr 172.21.15.154:0/1290399375 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:35.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8ccd19b700 1 --2- 172.21.15.154:0/1290399375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc80c9db0 0x7f8cc8153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.649+0000 7f8ccc99a700 1 --2- 172.21.15.154:0/1290399375 >> v2:172.21.15.179:3300/0 conn(0x7f8cc8157130 0x7f8cc80c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.650+0000 7f8ccd99c700 1 -- 172.21.15.154:0/1290399375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc80c9db0 msgr2=0x7f8cc8153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:35.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.650+0000 7f8ccd99c700 1 --2- 172.21.15.154:0/1290399375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc80c9db0 0x7f8cc8153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.650+0000 7f8ccd99c700 1 -- 172.21.15.154:0/1290399375 >> v2:172.21.15.179:3300/0 conn(0x7f8cc8157130 msgr2=0x7f8cc80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:35.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.650+0000 7f8ccd99c700 1 --2- 172.21.15.154:0/1290399375 >> v2:172.21.15.179:3300/0 conn(0x7f8cc8157130 0x7f8cc80c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.650+0000 7f8ccd99c700 1 -- 172.21.15.154:0/1290399375 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc80c7ae0 con 0x7f8cc8159ad0 2023-10-10T22:37:35.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.650+0000 7f8ccd99c700 1 --2- 172.21.15.154:0/1290399375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 0x7f8cc8159f50 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8070d60 tx=0x7f8cc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21c6760651eb539 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:35.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.650+0000 7f8cbffff700 1 -- 172.21.15.154:0/1290399375 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000e070 con 0x7f8cc8159ad0 2023-10-10T22:37:35.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.650+0000 7f8cbffff700 1 -- 172.21.15.154:0/1290399375 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000b970 con 0x7f8cc8159ad0 2023-10-10T22:37:35.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.650+0000 7f8cbffff700 1 -- 172.21.15.154:0/1290399375 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00092e0 con 0x7f8cc8159ad0 2023-10-10T22:37:35.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.651+0000 7f8cce19d700 1 -- 172.21.15.154:0/1290399375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 msgr2=0x7f8cc8159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:35.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.651+0000 7f8cce19d700 1 --2- 172.21.15.154:0/1290399375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 0x7f8cc8159f50 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8070d60 tx=0x7f8cc0009840 comp rx=0 tx=0).stop 2023-10-10T22:37:35.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.651+0000 7f8cce19d700 1 -- 172.21.15.154:0/1290399375 shutdown_connections 2023-10-10T22:37:35.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.651+0000 7f8cce19d700 1 --2- 172.21.15.154:0/1290399375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 0x7f8cc8159f50 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.651+0000 7f8cce19d700 1 --2- 172.21.15.154:0/1290399375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc80c9db0 0x7f8cc8153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.651+0000 7f8cce19d700 1 --2- 172.21.15.154:0/1290399375 >> v2:172.21.15.179:3300/0 conn(0x7f8cc8157130 0x7f8cc80c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.651+0000 7f8cce19d700 1 -- 172.21.15.154:0/1290399375 >> 172.21.15.154:0/1290399375 conn(0x7f8cc80cc1e0 msgr2=0x7f8cc80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:35.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.651+0000 7f8cce19d700 1 -- 172.21.15.154:0/1290399375 shutdown_connections 2023-10-10T22:37:35.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.651+0000 7f8cce19d700 1 -- 172.21.15.154:0/1290399375 wait complete. 2023-10-10T22:37:35.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.652+0000 7f8cce19d700 1 Processor -- start 2023-10-10T22:37:35.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.653+0000 7f8cce19d700 1 -- start start 2023-10-10T22:37:35.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.653+0000 7f8cce19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc80c9db0 0x7f8cc8157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8cce19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc8157130 0x7f8cc8146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8cce19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 0x7f8cc80c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8cce19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc8158a40 con 0x7f8cc8159ad0 2023-10-10T22:37:35.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8cce19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc8157e30 con 0x7f8cc80c9db0 2023-10-10T22:37:35.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8cce19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc8158110 con 0x7f8cc8157130 2023-10-10T22:37:35.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 0x7f8cc80c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 0x7f8cc80c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33332/0 (socket says 172.21.15.154:33332) 2023-10-10T22:37:35.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd99c700 1 -- 172.21.15.154:0/2138751693 learned_addr learned my addr 172.21.15.154:0/2138751693 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:35.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccc99a700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc8157130 0x7f8cc8146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd19b700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc80c9db0 0x7f8cc8157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd99c700 1 -- 172.21.15.154:0/2138751693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc8157130 msgr2=0x7f8cc8146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:35.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd99c700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc8157130 0x7f8cc8146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd99c700 1 -- 172.21.15.154:0/2138751693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc80c9db0 msgr2=0x7f8cc8157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:35.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd99c700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc80c9db0 0x7f8cc8157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:35.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd99c700 1 -- 172.21.15.154:0/2138751693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0009ae0 con 0x7f8cc8159ad0 2023-10-10T22:37:35.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.654+0000 7f8ccd19b700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc80c9db0 0x7f8cc8157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:35.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.655+0000 7f8ccd99c700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 0x7f8cc80c1f50 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f8cc806ce80 tx=0x7f8cc0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:35.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.655+0000 7f8cbd7fa700 1 -- 172.21.15.154:0/2138751693 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0008b80 con 0x7f8cc8159ad0 2023-10-10T22:37:35.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.655+0000 7f8cbd7fa700 1 -- 172.21.15.154:0/2138751693 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc0008d00 con 0x7f8cc8159ad0 2023-10-10T22:37:35.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.655+0000 7f8cbd7fa700 1 -- 172.21.15.154:0/2138751693 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00266b0 con 0x7f8cc8159ad0 2023-10-10T22:37:35.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.655+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc81583f0 con 0x7f8cc8159ad0 2023-10-10T22:37:35.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.655+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc8157b40 con 0x7f8cc8159ad0 2023-10-10T22:37:35.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.656+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc806f660 con 0x7f8cc8159ad0 2023-10-10T22:37:35.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.657+0000 7f8cbd7fa700 1 -- 172.21.15.154:0/2138751693 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cc0003040 con 0x7f8cc8159ad0 2023-10-10T22:37:35.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.658+0000 7f8cbd7fa700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8cac066f30 0x7f8cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:35.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.658+0000 7f8cbd7fa700 1 -- 172.21.15.154:0/2138751693 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f8cc0086370 con 0x7f8cc8159ad0 2023-10-10T22:37:35.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.658+0000 7f8ccd19b700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8cac066f30 0x7f8cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:35.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.658+0000 7f8ccd19b700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8cac066f30 0x7f8cac0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009ce0 tx=0x7f8cc4008040 comp rx=0 tx=0).ready entity=mgr.9999 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:35.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.662+0000 7f8cbd7fa700 1 -- 172.21.15.154:0/2138751693 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cc0053330 con 0x7f8cc8159ad0 2023-10-10T22:37:35.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:35.911+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f8cc806be40 con 0x7f8cc8159ad0 2023-10-10T22:37:36.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.381+0000 7f8cbd7fa700 1 -- 172.21.15.154:0/2138751693 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 111) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f8cc0053700 con 0x7f8cc8159ad0 2023-10-10T22:37:36.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.382+0000 7f8cbd7fa700 1 -- 172.21.15.154:0/2138751693 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v111) v1 ==== 92+0+0 (secure 0 0 0) 0x7f8cc0026aa0 con 0x7f8cc8159ad0 2023-10-10T22:37:36.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8cac066f30 msgr2=0x7f8cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:36.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8cac066f30 0x7f8cac0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009ce0 tx=0x7f8cc4008040 comp rx=0 tx=0).stop 2023-10-10T22:37:36.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 msgr2=0x7f8cc80c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:36.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 0x7f8cc80c1f50 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f8cc806ce80 tx=0x7f8cc0018000 comp rx=0 tx=0).stop 2023-10-10T22:37:36.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 shutdown_connections 2023-10-10T22:37:36.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f8cac066f30 0x7f8cac0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cc8159ad0 0x7f8cc80c1f50 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc80c9db0 0x7f8cc8157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 --2- 172.21.15.154:0/2138751693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cc8157130 0x7f8cc8146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 >> 172.21.15.154:0/2138751693 conn(0x7f8cc80cc1e0 msgr2=0x7f8cc806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:36.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 shutdown_connections 2023-10-10T22:37:36.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.385+0000 7f8cce19d700 1 -- 172.21.15.154:0/2138751693 wait complete. 2023-10-10T22:37:36.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-10T22:37:36.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.598+0000 7fd35759d700 1 Processor -- start 2023-10-10T22:37:36.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.598+0000 7fd35759d700 1 -- start start 2023-10-10T22:37:36.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.600+0000 7fd35759d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd350159a70 0x7fd3500c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:36.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.600+0000 7fd35759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 0x7fd3500c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:36.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.600+0000 7fd35759d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3500ca920 con 0x7fd35006bfa0 2023-10-10T22:37:36.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.600+0000 7fd35759d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35006af00 con 0x7fd350159a70 2023-10-10T22:37:36.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.600+0000 7fd35759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35006b1e0 con 0x7fd350068aa0 2023-10-10T22:37:36.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.600+0000 7fd35659b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd350159a70 0x7fd3500c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:36.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.600+0000 7fd355d9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd35006bfa0 0x7fd350068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56500/0 (socket says 172.21.15.154:56500) 2023-10-10T22:37:36.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.600+0000 7fd355d9a700 1 -- 172.21.15.154:0/2742490760 learned_addr learned my addr 172.21.15.154:0/2742490760 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:36.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.600+0000 7fd356d9c700 1 --2- 172.21.15.154:0/2742490760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 0x7fd3500c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:36.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.601+0000 7fd35659b700 1 -- 172.21.15.154:0/2742490760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 msgr2=0x7fd3500c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:36.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.601+0000 7fd35659b700 1 --2- 172.21.15.154:0/2742490760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 0x7fd3500c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.601+0000 7fd35659b700 1 -- 172.21.15.154:0/2742490760 >> v1:172.21.15.154:6789/0 conn(0x7fd35006bfa0 legacy=0x7fd350068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:36.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.601+0000 7fd35659b700 1 -- 172.21.15.154:0/2742490760 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35006b4c0 con 0x7fd350159a70 2023-10-10T22:37:36.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.601+0000 7fd35659b700 1 --2- 172.21.15.154:0/2742490760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd350159a70 0x7fd3500c82f0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0098e0 tx=0x7fd34c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910379b5324b2d9c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:36.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.601+0000 7fd355599700 1 -- 172.21.15.154:0/2742490760 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c00b640 con 0x7fd350159a70 2023-10-10T22:37:36.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.601+0000 7fd355599700 1 -- 172.21.15.154:0/2742490760 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c00b7a0 con 0x7fd350159a70 2023-10-10T22:37:36.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.601+0000 7fd355599700 1 -- 172.21.15.154:0/2742490760 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c00bb40 con 0x7fd350159a70 2023-10-10T22:37:36.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.602+0000 7fd35759d700 1 -- 172.21.15.154:0/2742490760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd350159a70 msgr2=0x7fd3500c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:36.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.602+0000 7fd35759d700 1 --2- 172.21.15.154:0/2742490760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd350159a70 0x7fd3500c82f0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0098e0 tx=0x7fd34c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.602+0000 7fd35759d700 1 -- 172.21.15.154:0/2742490760 shutdown_connections 2023-10-10T22:37:36.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.602+0000 7fd35759d700 1 --2- 172.21.15.154:0/2742490760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 0x7fd3500c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.602+0000 7fd35759d700 1 --2- 172.21.15.154:0/2742490760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd350159a70 0x7fd3500c82f0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.602+0000 7fd35759d700 1 -- 172.21.15.154:0/2742490760 >> 172.21.15.154:0/2742490760 conn(0x7fd3500cddc0 msgr2=0x7fd3500c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:36.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.602+0000 7fd35759d700 1 -- 172.21.15.154:0/2742490760 shutdown_connections 2023-10-10T22:37:36.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.602+0000 7fd35759d700 1 -- 172.21.15.154:0/2742490760 wait complete. 2023-10-10T22:37:36.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.603+0000 7fd35759d700 1 Processor -- start 2023-10-10T22:37:36.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.604+0000 7fd35759d700 1 -- start start 2023-10-10T22:37:36.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.604+0000 7fd35759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 0x7fd3501520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:36.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.604+0000 7fd35759d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd35006bfa0 0x7fd350157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:36.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.604+0000 7fd35759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd350159a70 0x7fd3500cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:36.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.604+0000 7fd35759d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3501587e0 con 0x7fd35006bfa0 2023-10-10T22:37:36.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.604+0000 7fd35759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35015eeb0 con 0x7fd350159a70 2023-10-10T22:37:36.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.604+0000 7fd35759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500c6ad0 con 0x7fd350068aa0 2023-10-10T22:37:36.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd355d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd35006bfa0 0x7fd350157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:36.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd355d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd35006bfa0 0x7fd350157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38676/0 (socket says 172.21.15.154:38676) 2023-10-10T22:37:36.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd355d9a700 1 -- 172.21.15.154:0/2752771170 learned_addr learned my addr 172.21.15.154:0/2752771170 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:36.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd35659b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 0x7fd3501520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:36.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd356d9c700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd350159a70 0x7fd3500cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:36.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd355d9a700 1 -- 172.21.15.154:0/2752771170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 msgr2=0x7fd3501520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:36.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd355d9a700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 0x7fd3501520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd355d9a700 1 -- 172.21.15.154:0/2752771170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd350159a70 msgr2=0x7fd3500cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:36.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd355d9a700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd350159a70 0x7fd3500cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd355d9a700 1 -- 172.21.15.154:0/2752771170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c009420 con 0x7fd35006bfa0 2023-10-10T22:37:36.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd35659b700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 0x7fd3501520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:36.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.605+0000 7fd355d9a700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd35006bfa0 0x7fd350157760 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c590 tx=0x7fd340007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:36.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.606+0000 7fd3467fc700 1 -- 172.21.15.154:0/2752771170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340001160 con 0x7fd35006bfa0 2023-10-10T22:37:36.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.606+0000 7fd3467fc700 1 -- 172.21.15.154:0/2752771170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3400072e0 con 0x7fd35006bfa0 2023-10-10T22:37:36.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.606+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd350152630 con 0x7fd35006bfa0 2023-10-10T22:37:36.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.606+0000 7fd3467fc700 1 -- 172.21.15.154:0/2752771170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400057f0 con 0x7fd35006bfa0 2023-10-10T22:37:36.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.606+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3500c61a0 con 0x7fd35006bfa0 2023-10-10T22:37:36.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.607+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35006d560 con 0x7fd35006bfa0 2023-10-10T22:37:36.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.608+0000 7fd3467fc700 1 -- 172.21.15.154:0/2752771170 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 111) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fd340005c20 con 0x7fd35006bfa0 2023-10-10T22:37:36.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.609+0000 7fd3467fc700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd334066f80 0x7fd334069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:36.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.609+0000 7fd3467fc700 1 -- 172.21.15.154:0/2752771170 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fd340083bd0 con 0x7fd35006bfa0 2023-10-10T22:37:36.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.609+0000 7fd35659b700 1 -- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd334066f80 msgr2=0x7fd334069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:36.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.609+0000 7fd35659b700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd334066f80 0x7fd334069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:36.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.613+0000 7fd3467fc700 1 -- 172.21.15.154:0/2752771170 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd340050b90 con 0x7fd35006bfa0 2023-10-10T22:37:36.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.810+0000 7fd35659b700 1 -- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd334066f80 msgr2=0x7fd334069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:36.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.810+0000 7fd35659b700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd334066f80 0x7fd334069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:36.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.833+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fd350159230 con 0x7fd35006bfa0 2023-10-10T22:37:36.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.839+0000 7fd3467fc700 1 -- 172.21.15.154:0/2752771170 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v71)=0 v71) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd340017070 con 0x7fd35006bfa0 2023-10-10T22:37:36.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd334066f80 msgr2=0x7fd334069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:36.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd334066f80 0x7fd334069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd35006bfa0 msgr2=0x7fd350157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:36.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd35006bfa0 0x7fd350157760 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c590 tx=0x7fd340007e40 comp rx=0 tx=0).stop 2023-10-10T22:37:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 shutdown_connections 2023-10-10T22:37:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd334066f80 0x7fd334069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd350159a70 0x7fd3500cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd350068aa0 0x7fd3501520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 --2- 172.21.15.154:0/2752771170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd35006bfa0 0x7fd350157760 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:36.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 >> 172.21.15.154:0/2752771170 conn(0x7fd3500cddc0 msgr2=0x7fd3500b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:36.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 shutdown_connections 2023-10-10T22:37:36.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:36.841+0000 7fd35759d700 1 -- 172.21.15.154:0/2752771170 wait complete. 2023-10-10T22:37:36.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-10T22:37:37.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.051+0000 7f957499d700 1 Processor -- start 2023-10-10T22:37:37.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.051+0000 7f957499d700 1 -- start start 2023-10-10T22:37:37.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.052+0000 7f957499d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95700cc9d0 0x7f957015d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.052+0000 7f957499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cd0f0 0x7f957015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.052+0000 7f957499d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9570150b50 con 0x7f95700cc600 2023-10-10T22:37:37.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.052+0000 7f957499d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95700cede0 con 0x7f95700cc9d0 2023-10-10T22:37:37.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.052+0000 7f957499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95700b2260 con 0x7f95700cd0f0 2023-10-10T22:37:37.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.052+0000 7f956f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f95700cc600 0x7f95700b1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56508/0 (socket says 172.21.15.154:56508) 2023-10-10T22:37:37.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.052+0000 7f956f7fe700 1 -- 172.21.15.154:0/2810883278 learned_addr learned my addr 172.21.15.154:0/2810883278 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:37.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.053+0000 7f956effd700 1 --2- 172.21.15.154:0/2810883278 >> v2:172.21.15.154:3300/0 conn(0x7f95700cc9d0 0x7f957015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.053+0000 7f956ffff700 1 --2- 172.21.15.154:0/2810883278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cd0f0 0x7f957015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.053+0000 7f956e7fc700 1 -- 172.21.15.154:0/2810883278 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687901128 0 0) 0x7f9570150b50 con 0x7f95700cc600 2023-10-10T22:37:37.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.053+0000 7f956e7fc700 1 -- 172.21.15.154:0/2810883278 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9558003570 con 0x7f95700cc600 2023-10-10T22:37:37.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.053+0000 7f956ffff700 1 -- 172.21.15.154:0/2810883278 >> v2:172.21.15.154:3300/0 conn(0x7f95700cc9d0 msgr2=0x7f957015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:37.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.053+0000 7f956ffff700 1 --2- 172.21.15.154:0/2810883278 >> v2:172.21.15.154:3300/0 conn(0x7f95700cc9d0 0x7f957015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.053+0000 7f956ffff700 1 -- 172.21.15.154:0/2810883278 >> v1:172.21.15.154:6789/0 conn(0x7f95700cc600 legacy=0x7f95700b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:37.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.053+0000 7f956ffff700 1 -- 172.21.15.154:0/2810883278 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700b2540 con 0x7f95700cd0f0 2023-10-10T22:37:37.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.053+0000 7f956ffff700 1 --2- 172.21.15.154:0/2810883278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cd0f0 0x7f957015d7c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9568009e60 tx=0x7f9568009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c30b3f6f22bb88e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:37.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f956e7fc700 1 -- 172.21.15.154:0/2810883278 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800e070 con 0x7f95700cd0f0 2023-10-10T22:37:37.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f956e7fc700 1 -- 172.21.15.154:0/2810883278 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956800bab0 con 0x7f95700cd0f0 2023-10-10T22:37:37.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f956e7fc700 1 -- 172.21.15.154:0/2810883278 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800be30 con 0x7f95700cd0f0 2023-10-10T22:37:37.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f957499d700 1 -- 172.21.15.154:0/2810883278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cd0f0 msgr2=0x7f957015d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:37.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f957499d700 1 --2- 172.21.15.154:0/2810883278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cd0f0 0x7f957015d7c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9568009e60 tx=0x7f9568009780 comp rx=0 tx=0).stop 2023-10-10T22:37:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f957499d700 1 -- 172.21.15.154:0/2810883278 shutdown_connections 2023-10-10T22:37:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f957499d700 1 --2- 172.21.15.154:0/2810883278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cd0f0 0x7f957015d7c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f957499d700 1 --2- 172.21.15.154:0/2810883278 >> v2:172.21.15.154:3300/0 conn(0x7f95700cc9d0 0x7f957015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f957499d700 1 -- 172.21.15.154:0/2810883278 >> 172.21.15.154:0/2810883278 conn(0x7f95700d0630 msgr2=0x7f95700d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f957499d700 1 -- 172.21.15.154:0/2810883278 shutdown_connections 2023-10-10T22:37:37.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.054+0000 7f957499d700 1 -- 172.21.15.154:0/2810883278 wait complete. 2023-10-10T22:37:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.056+0000 7f957499d700 1 Processor -- start 2023-10-10T22:37:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.056+0000 7f957499d700 1 -- start start 2023-10-10T22:37:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f957499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cc600 0x7f9570150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f957499d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700cc9d0 0x7f9570143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f957499d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95700cd0f0 0x7f95700afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f957499d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570151150 con 0x7f95700cc9d0 2023-10-10T22:37:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f957499d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570153030 con 0x7f95700cd0f0 2023-10-10T22:37:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f957499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9570153240 con 0x7f95700cc600 2023-10-10T22:37:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700cc9d0 0x7f9570143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700cc9d0 0x7f9570143ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38698/0 (socket says 172.21.15.154:38698) 2023-10-10T22:37:37.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956effd700 1 -- 172.21.15.154:0/1318904164 learned_addr learned my addr 172.21.15.154:0/1318904164 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:37.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956f7fe700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cc600 0x7f9570150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956ffff700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95700cd0f0 0x7f95700afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956effd700 1 -- 172.21.15.154:0/1318904164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cc600 msgr2=0x7f9570150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:37.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956effd700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cc600 0x7f9570150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956effd700 1 -- 172.21.15.154:0/1318904164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95700cd0f0 msgr2=0x7f95700afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:37.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956effd700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95700cd0f0 0x7f95700afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.057+0000 7f956effd700 1 -- 172.21.15.154:0/1318904164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568009a20 con 0x7f95700cc9d0 2023-10-10T22:37:37.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.058+0000 7f956effd700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700cc9d0 0x7f9570143ed0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f956400ec80 tx=0x7f95640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:37.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.058+0000 7f95577fe700 1 -- 172.21.15.154:0/1318904164 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564009690 con 0x7f95700cc9d0 2023-10-10T22:37:37.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.058+0000 7f95577fe700 1 -- 172.21.15.154:0/1318904164 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956400c850 con 0x7f95700cc9d0 2023-10-10T22:37:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.058+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9570153520 con 0x7f95700cc9d0 2023-10-10T22:37:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.058+0000 7f95577fe700 1 -- 172.21.15.154:0/1318904164 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956400cc10 con 0x7f95700cc9d0 2023-10-10T22:37:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.058+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9570153ae0 con 0x7f95700cc9d0 2023-10-10T22:37:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.059+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9570153cd0 con 0x7f95700cc9d0 2023-10-10T22:37:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.060+0000 7f95577fe700 1 -- 172.21.15.154:0/1318904164 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 111) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f9564013470 con 0x7f95700cc9d0 2023-10-10T22:37:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.061+0000 7f95577fe700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f955c066f80 0x7f955c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.061+0000 7f95577fe700 1 -- 172.21.15.154:0/1318904164 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f9564084980 con 0x7f95700cc9d0 2023-10-10T22:37:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.061+0000 7f956f7fe700 1 -- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f955c066f80 msgr2=0x7f955c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.061+0000 7f956f7fe700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f955c066f80 0x7f955c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:37.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.065+0000 7f95577fe700 1 -- 172.21.15.154:0/1318904164 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9564051940 con 0x7f95700cc9d0 2023-10-10T22:37:37.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.262+0000 7f956f7fe700 1 -- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f955c066f80 msgr2=0x7f955c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:37.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.262+0000 7f956f7fe700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f955c066f80 0x7f955c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:37.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.264+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f95700b2820 con 0x7f95700cc9d0 2023-10-10T22:37:37.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.268+0000 7f95577fe700 1 -- 172.21.15.154:0/1318904164 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v72)=0 v72) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9564054f60 con 0x7f95700cc9d0 2023-10-10T22:37:37.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.270+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f955c066f80 msgr2=0x7f955c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:37.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.270+0000 7f957499d700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f955c066f80 0x7f955c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.270+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700cc9d0 msgr2=0x7f9570143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:37.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.270+0000 7f957499d700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700cc9d0 0x7f9570143ed0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f956400ec80 tx=0x7f95640091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.271+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 shutdown_connections 2023-10-10T22:37:37.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.271+0000 7f957499d700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f955c066f80 0x7f955c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.271+0000 7f957499d700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95700cd0f0 0x7f95700afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.271+0000 7f957499d700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95700cc600 0x7f9570150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.271+0000 7f957499d700 1 --2- 172.21.15.154:0/1318904164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700cc9d0 0x7f9570143ed0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.271+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 >> 172.21.15.154:0/1318904164 conn(0x7f95700d0630 msgr2=0x7f9570069b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:37.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.271+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 shutdown_connections 2023-10-10T22:37:37.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.271+0000 7f957499d700 1 -- 172.21.15.154:0/1318904164 wait complete. 2023-10-10T22:37:37.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:37:37.291 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-10T22:37:37.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-10T22:37:37.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.573+0000 7f10a6b9d700 1 Processor -- start 2023-10-10T22:37:37.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.573+0000 7f10a6b9d700 1 -- start start 2023-10-10T22:37:37.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.574+0000 7f10a6b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f10a00b0790 0x7f10a00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.574+0000 7f10a6b9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10a01591e0 0x7f10a0159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.574+0000 7f10a6b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00cfa00 con 0x7f10a00b03c0 2023-10-10T22:37:37.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.574+0000 7f10a6b9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00cb580 con 0x7f10a01591e0 2023-10-10T22:37:37.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.574+0000 7f10a6b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00cf160 con 0x7f10a00b0790 2023-10-10T22:37:37.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.575+0000 7f10a639c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10a01591e0 0x7f10a0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.575+0000 7f10a639c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10a01591e0 0x7f10a0159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38700/0 (socket says 172.21.15.154:38700) 2023-10-10T22:37:37.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.575+0000 7f10a639c700 1 -- 172.21.15.154:0/2484722043 learned_addr learned my addr 172.21.15.154:0/2484722043 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:37.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.575+0000 7f10a539a700 1 --2- 172.21.15.154:0/2484722043 >> v2:172.21.15.179:3300/0 conn(0x7f10a00b0790 0x7f10a00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.575+0000 7f10a639c700 1 -- 172.21.15.154:0/2484722043 >> v2:172.21.15.179:3300/0 conn(0x7f10a00b0790 msgr2=0x7f10a00cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:37.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.575+0000 7f10a639c700 1 --2- 172.21.15.154:0/2484722043 >> v2:172.21.15.179:3300/0 conn(0x7f10a00b0790 0x7f10a00cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.575+0000 7f10a639c700 1 -- 172.21.15.154:0/2484722043 >> v1:172.21.15.179:6789/0 conn(0x7f10a00b03c0 legacy=0x7f10a00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:37.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.575+0000 7f10a639c700 1 -- 172.21.15.154:0/2484722043 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00cf440 con 0x7f10a01591e0 2023-10-10T22:37:37.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.575+0000 7f10a639c700 1 --2- 172.21.15.154:0/2484722043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a01591e0 0x7f10a0159600 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f1098009f20 tx=0x7f1098009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7014253b34e1af43 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:37.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a4b99700 1 -- 172.21.15.154:0/2484722043 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109800e070 con 0x7f10a01591e0 2023-10-10T22:37:37.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a4b99700 1 -- 172.21.15.154:0/2484722043 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109800b990 con 0x7f10a01591e0 2023-10-10T22:37:37.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a4b99700 1 -- 172.21.15.154:0/2484722043 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10980092e0 con 0x7f10a01591e0 2023-10-10T22:37:37.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a6b9d700 1 -- 172.21.15.154:0/2484722043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a01591e0 msgr2=0x7f10a0159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:37.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a6b9d700 1 --2- 172.21.15.154:0/2484722043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a01591e0 0x7f10a0159600 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f1098009f20 tx=0x7f1098009840 comp rx=0 tx=0).stop 2023-10-10T22:37:37.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a6b9d700 1 -- 172.21.15.154:0/2484722043 shutdown_connections 2023-10-10T22:37:37.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a6b9d700 1 --2- 172.21.15.154:0/2484722043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a01591e0 0x7f10a0159600 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a6b9d700 1 --2- 172.21.15.154:0/2484722043 >> v2:172.21.15.179:3300/0 conn(0x7f10a00b0790 0x7f10a00cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a6b9d700 1 -- 172.21.15.154:0/2484722043 >> 172.21.15.154:0/2484722043 conn(0x7f10a0063230 msgr2=0x7f10a0063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:37.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a6b9d700 1 -- 172.21.15.154:0/2484722043 shutdown_connections 2023-10-10T22:37:37.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.576+0000 7f10a6b9d700 1 -- 172.21.15.154:0/2484722043 wait complete. 2023-10-10T22:37:37.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.578+0000 7f10a6b9d700 1 Processor -- start 2023-10-10T22:37:37.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.578+0000 7f10a6b9d700 1 -- start start 2023-10-10T22:37:37.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a6b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00b03c0 0x7f10a015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a6b9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a00b0790 0x7f10a00c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a6b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a01591e0 0x7f10a016d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a6b9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a016db40 con 0x7f10a00b0790 2023-10-10T22:37:37.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a6b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00c9570 con 0x7f10a01591e0 2023-10-10T22:37:37.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a6b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00c8500 con 0x7f10a00b03c0 2023-10-10T22:37:37.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a539a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a00b0790 0x7f10a00c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a539a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a00b0790 0x7f10a00c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38714/0 (socket says 172.21.15.154:38714) 2023-10-10T22:37:37.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a539a700 1 -- 172.21.15.154:0/1286987475 learned_addr learned my addr 172.21.15.154:0/1286987475 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:37.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a5b9b700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00b03c0 0x7f10a015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.579+0000 7f10a639c700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a01591e0 0x7f10a016d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:37.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f10a539a700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00b03c0 msgr2=0x7f10a015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:37.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f10a539a700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00b03c0 0x7f10a015b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f10a539a700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a01591e0 msgr2=0x7f10a016d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:37.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f10a539a700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a01591e0 0x7f10a016d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:37.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f10a539a700 1 -- 172.21.15.154:0/1286987475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1098009ae0 con 0x7f10a00b0790 2023-10-10T22:37:37.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f10a539a700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a00b0790 0x7f10a00c7e20 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f109000ec80 tx=0x7f10900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:37.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000c850 con 0x7f10a00b0790 2023-10-10T22:37:37.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109000c9b0 con 0x7f10a00b0790 2023-10-10T22:37:37.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000cd50 con 0x7f10a00b0790 2023-10-10T22:37:37.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a00c87e0 con 0x7f10a00b0790 2023-10-10T22:37:37.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.580+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a00c8da0 con 0x7f10a00b0790 2023-10-10T22:37:37.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.581+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a00c9730 con 0x7f10a00b0790 2023-10-10T22:37:37.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.582+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 111) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f1090013680 con 0x7f10a00b0790 2023-10-10T22:37:37.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.584+0000 7f1095ffb700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f1084069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:37.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.584+0000 7f10a5b9b700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 msgr2=0x7f1084069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:37.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.584+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f1090085200 con 0x7f10a00b0790 2023-10-10T22:37:37.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.584+0000 7f10a5b9b700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f1084069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:37.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.586+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1090052240 con 0x7f10a00b0790 2023-10-10T22:37:37.662 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:37.660+0000 7f5a54a6f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:37:37.751 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:37.750+0000 7fc7d1068180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:37:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.785+0000 7f10a5b9b700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 msgr2=0x7f1084069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.785+0000 7f10a5b9b700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f1084069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:37.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:37.813+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f10a004c3c0 con 0x7f1084066f80 2023-10-10T22:37:37.823 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:37.821+0000 7f5a54a6f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:37.908 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:37.907+0000 7f5a54a6f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:37:37.918 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:37.917+0000 7fc7d1068180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:38.004 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:38.003+0000 7fc7d1068180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:37:38.134 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:38.131+0000 7f5a54a6f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:38.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:38.186+0000 7f10a5b9b700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 msgr2=0x7f1084069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:38.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:38.186+0000 7f10a5b9b700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f1084069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T22:37:38.230 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:38.229+0000 7fc7d1068180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:38.310 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:38.308+0000 7f5a54a6f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:37:38.405 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:38.404+0000 7f5a54a6f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:37:38.411 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:38.410+0000 7fc7d1068180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:37:38.504 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:38.503+0000 7fc7d1068180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:37:38.568 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:38.566+0000 7f5a54a6f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:37:38.666 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:38.664+0000 7fc7d1068180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:37:38.667 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:38.666+0000 7f5a54a6f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:38.767 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:38.766+0000 7fc7d1068180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:38.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:38.987+0000 7f10a5b9b700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 msgr2=0x7f1084069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:38.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:38.987+0000 7f10a5b9b700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f1084069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-10T22:37:39.152 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:39.150+0000 7f5a54a6f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:37:39.246 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:39.244+0000 7f5a54a6f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:37:39.253 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:39.252+0000 7fc7d1068180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:37:39.335 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:39.333+0000 7f5a54a6f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:37:39.348 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:39.346+0000 7fc7d1068180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:37:39.437 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:39.436+0000 7fc7d1068180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:37:39.955 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:39.953+0000 7f5a54a6f180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:37:40.064 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:40.062+0000 7fc7d1068180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:37:40.129 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:40.127+0000 7f5a54a6f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:40.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:40.223+0000 7f5a54a6f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:37:40.239 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:40.237+0000 7fc7d1068180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:40.336 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:40.335+0000 7fc7d1068180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:37:40.519 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:40.517+0000 7f5a54a6f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:37:40.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:40.589+0000 7f10a5b9b700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 msgr2=0x7f1084069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:40.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:40.589+0000 7f10a5b9b700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f1084069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-10T22:37:40.616 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:40.614+0000 7f5a54a6f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:37:40.632 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:40.631+0000 7fc7d1068180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:37:40.729 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:40.727+0000 7fc7d1068180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:37:41.316 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:41.314+0000 7f5a54a6f180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:37:41.434 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:41.433+0000 7fc7d1068180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:37:41.602 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:41.600+0000 7f5a54a6f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:37:41.696 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:41.694+0000 7f5a54a6f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:37:41.721 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:41.720+0000 7fc7d1068180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:37:41.815 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:41.814+0000 7fc7d1068180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:37:41.848 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:41.846+0000 7f5a54a6f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:37:41.952 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:41.950+0000 7f5a54a6f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:37:41.971 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:41.970+0000 7fc7d1068180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:37:42.078 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.076+0000 7fc7d1068180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:37:42.140 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:42.138+0000 7f5a54a6f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:37:42.232 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:42.230+0000 7f5a54a6f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:37:42.269 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.268+0000 7fc7d1068180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:37:42.324 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:42.322+0000 7f5a54a6f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:37:42.363 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.362+0000 7fc7d1068180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:37:42.417 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:42.416+0000 7f5a54a6f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:37:42.457 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.455+0000 7fc7d1068180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:37:42.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:42.476+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 112) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f1090052610 con 0x7f10a00b0790 2023-10-10T22:37:42.557 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.555+0000 7fc7d1068180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:37:42.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:42.566+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mgrmap(e 113) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f10900553f0 con 0x7f10a00b0790 2023-10-10T22:37:42.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:42.566+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 msgr2=0x7f1084069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:42.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:42.566+0000 7f1095ffb700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f1084069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:42.691 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.690+0000 7fc743331700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:42.692 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.690+0000 7fc743331700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:42.692 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.690+0000 7fc743331700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:42.692 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.690+0000 7fc743331700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:42.692 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.690+0000 7fc743331700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:42.693 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.691+0000 7fc746337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:42.693 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.691+0000 7fc746337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:42.694 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.691+0000 7fc746337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:42.694 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.691+0000 7fc746337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:42.694 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:42.691+0000 7fc746337700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-10T22:37:43.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.571+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mon.0 v2:172.21.15.154:3300/0 9 ==== mgrmap(e 114) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f1090052ee0 con 0x7f10a00b0790 2023-10-10T22:37:43.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.572+0000 7f1095ffb700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f10840693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:43.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.572+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f10a004c3c0 con 0x7f1084066f80 2023-10-10T22:37:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.574+0000 7f10a5b9b700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f10840693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:43.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.580+0000 7f10a5b9b700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f10840693b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f109c001200 tx=0x7f109c007ec0 comp rx=0 tx=0).ready entity=mgr.10383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:43.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.640+0000 7f1095ffb700 1 -- 172.21.15.154:0/1286987475 <== mgr.10383 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f10a004c3c0 con 0x7f1084066f80 2023-10-10T22:37:43.642 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule set for path snap_test_dir1 2023-10-10T22:37:43.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 msgr2=0x7f10840693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:43.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f10840693b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f109c001200 tx=0x7f109c007ec0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a00b0790 msgr2=0x7f10a00c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:43.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a00b0790 0x7f10a00c7e20 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f109000ec80 tx=0x7f10900091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 shutdown_connections 2023-10-10T22:37:43.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1084066f80 0x7f10840693b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a01591e0 0x7f10a016d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10a00b03c0 0x7f10a015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 --2- 172.21.15.154:0/1286987475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a00b0790 0x7f10a00c7e20 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 >> 172.21.15.154:0/1286987475 conn(0x7f10a0063230 msgr2=0x7f10a0068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:43.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 shutdown_connections 2023-10-10T22:37:43.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.643+0000 7f10a6b9d700 1 -- 172.21.15.154:0/1286987475 wait complete. 2023-10-10T22:37:43.663 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-10T22:37:43.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-10T22:37:43.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.853+0000 7fb9c8bff700 1 Processor -- start 2023-10-10T22:37:43.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.853+0000 7fb9c8bff700 1 -- start start 2023-10-10T22:37:43.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.854+0000 7fb9c8bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9c40c85c0 0x7fb9c406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:43.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.854+0000 7fb9c8bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb9c4156ee0 0x7fb9c4069890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:43.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.854+0000 7fb9c8bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c40c7bf0 con 0x7fb9c4069dd0 2023-10-10T22:37:43.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.854+0000 7fb9c8bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c4068aa0 con 0x7fb9c40c85c0 2023-10-10T22:37:43.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.854+0000 7fb9c8bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c4156340 con 0x7fb9c4156ee0 2023-10-10T22:37:43.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.855+0000 7fb9c259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9c40c85c0 0x7fb9c406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:43.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.855+0000 7fb9c259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9c40c85c0 0x7fb9c406d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38890/0 (socket says 172.21.15.154:38890) 2023-10-10T22:37:43.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.855+0000 7fb9c259c700 1 -- 172.21.15.154:0/2642568109 learned_addr learned my addr 172.21.15.154:0/2642568109 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:43.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.855+0000 7fb9c1d9b700 1 --2- 172.21.15.154:0/2642568109 >> v2:172.21.15.179:3300/0 conn(0x7fb9c4156ee0 0x7fb9c4069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:43.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.855+0000 7fb9c259c700 1 -- 172.21.15.154:0/2642568109 >> v2:172.21.15.179:3300/0 conn(0x7fb9c4156ee0 msgr2=0x7fb9c4069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:43.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.855+0000 7fb9c259c700 1 --2- 172.21.15.154:0/2642568109 >> v2:172.21.15.179:3300/0 conn(0x7fb9c4156ee0 0x7fb9c4069890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.855+0000 7fb9c259c700 1 -- 172.21.15.154:0/2642568109 >> v1:172.21.15.179:6789/0 conn(0x7fb9c4069dd0 legacy=0x7fb9c4068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:43.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.855+0000 7fb9c259c700 1 -- 172.21.15.154:0/2642568109 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c40c8990 con 0x7fb9c40c85c0 2023-10-10T22:37:43.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.855+0000 7fb9c259c700 1 --2- 172.21.15.154:0/2642568109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40c85c0 0x7fb9c406d6c0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fb9c41599f0 tx=0x7fb9b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6314c911c6e7c16f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:43.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c159a700 1 -- 172.21.15.154:0/2642568109 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400b820 con 0x7fb9c40c85c0 2023-10-10T22:37:43.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c159a700 1 -- 172.21.15.154:0/2642568109 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b400b980 con 0x7fb9c40c85c0 2023-10-10T22:37:43.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c159a700 1 -- 172.21.15.154:0/2642568109 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400bd20 con 0x7fb9c40c85c0 2023-10-10T22:37:43.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c8bff700 1 -- 172.21.15.154:0/2642568109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40c85c0 msgr2=0x7fb9c406d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:43.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c8bff700 1 --2- 172.21.15.154:0/2642568109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40c85c0 0x7fb9c406d6c0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fb9c41599f0 tx=0x7fb9b4009250 comp rx=0 tx=0).stop 2023-10-10T22:37:43.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c8bff700 1 -- 172.21.15.154:0/2642568109 shutdown_connections 2023-10-10T22:37:43.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c8bff700 1 --2- 172.21.15.154:0/2642568109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40c85c0 0x7fb9c406d6c0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c8bff700 1 --2- 172.21.15.154:0/2642568109 >> v2:172.21.15.179:3300/0 conn(0x7fb9c4156ee0 0x7fb9c4069890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c8bff700 1 -- 172.21.15.154:0/2642568109 >> 172.21.15.154:0/2642568109 conn(0x7fb9c40cc540 msgr2=0x7fb9c40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:43.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c8bff700 1 -- 172.21.15.154:0/2642568109 shutdown_connections 2023-10-10T22:37:43.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.856+0000 7fb9c8bff700 1 -- 172.21.15.154:0/2642568109 wait complete. 2023-10-10T22:37:43.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.858+0000 7fb9c8bff700 1 Processor -- start 2023-10-10T22:37:43.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.858+0000 7fb9c8bff700 1 -- start start 2023-10-10T22:37:43.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c8bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c4069dd0 0x7fb9c40ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:43.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c40c85c0 0x7fb9c40a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:43.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4156ee0 0x7fb9c416a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:43.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c8bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c416b450 con 0x7fb9c4069dd0 2023-10-10T22:37:43.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40c2350 con 0x7fb9c4156ee0 2023-10-10T22:37:43.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c416ae90 con 0x7fb9c40c85c0 2023-10-10T22:37:43.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c4069dd0 0x7fb9c40ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:43.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c4069dd0 0x7fb9c40ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38898/0 (socket says 172.21.15.154:38898) 2023-10-10T22:37:43.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c259c700 1 -- 172.21.15.154:0/287821726 learned_addr learned my addr 172.21.15.154:0/287821726 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:43.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c2d9d700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4156ee0 0x7fb9c416a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:43.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c259c700 1 -- 172.21.15.154:0/287821726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c40c85c0 msgr2=0x7fb9c40a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c259c700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c40c85c0 0x7fb9c40a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c259c700 1 -- 172.21.15.154:0/287821726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4156ee0 msgr2=0x7fb9c416a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c259c700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4156ee0 0x7fb9c416a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c259c700 1 -- 172.21.15.154:0/287821726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b40094f0 con 0x7fb9c4069dd0 2023-10-10T22:37:43.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.859+0000 7fb9c2d9d700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4156ee0 0x7fb9c416a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:43.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.860+0000 7fb9c259c700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c4069dd0 0x7fb9c40ab2e0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009290 tx=0x7fb9b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:43.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.860+0000 7fb9b27fc700 1 -- 172.21.15.154:0/287821726 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4011e20 con 0x7fb9c4069dd0 2023-10-10T22:37:43.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.860+0000 7fb9b27fc700 1 -- 172.21.15.154:0/287821726 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b4020070 con 0x7fb9c4069dd0 2023-10-10T22:37:43.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.860+0000 7fb9b27fc700 1 -- 172.21.15.154:0/287821726 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b401b6a0 con 0x7fb9c4069dd0 2023-10-10T22:37:43.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.860+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c416b170 con 0x7fb9c4069dd0 2023-10-10T22:37:43.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.860+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c40a5a10 con 0x7fb9c4069dd0 2023-10-10T22:37:43.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.861+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c40c1e40 con 0x7fb9c4069dd0 2023-10-10T22:37:43.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.862+0000 7fb9b27fc700 1 -- 172.21.15.154:0/287821726 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 114) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fb9b4022030 con 0x7fb9c4069dd0 2023-10-10T22:37:43.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.863+0000 7fb9b27fc700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb9a4066dd0 0x7fb9a4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:43.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.863+0000 7fb9b27fc700 1 -- 172.21.15.154:0/287821726 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fb9b40865c0 con 0x7fb9c4069dd0 2023-10-10T22:37:43.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.863+0000 7fb9c1d9b700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb9a4066dd0 0x7fb9a4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:43.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.863+0000 7fb9c1d9b700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb9a4066dd0 0x7fb9a4069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9c416da10 tx=0x7fb9b8008040 comp rx=0 tx=0).ready entity=mgr.10383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:43.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:43.867+0000 7fb9b27fc700 1 -- 172.21.15.154:0/287821726 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9c40c1e40 con 0x7fb9c4069dd0 2023-10-10T22:37:44.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.084+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9c40c1e40 con 0x7fb9a4066dd0 2023-10-10T22:37:44.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.132+0000 7fb9b27fc700 1 -- 172.21.15.154:0/287821726 <== mgr.10383 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fb9c40c1e40 con 0x7fb9a4066dd0 2023-10-10T22:37:44.134 INFO:teuthology.orchestra.run.smithi154.stdout:Retention added to path snap_test_dir1 2023-10-10T22:37:44.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.134+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb9a4066dd0 msgr2=0x7fb9a4069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.134+0000 7fb9c8bff700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb9a4066dd0 0x7fb9a4069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9c416da10 tx=0x7fb9b8008040 comp rx=0 tx=0).stop 2023-10-10T22:37:44.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.134+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c4069dd0 msgr2=0x7fb9c40ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.134+0000 7fb9c8bff700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c4069dd0 0x7fb9c40ab2e0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009290 tx=0x7fb9b4016000 comp rx=0 tx=0).stop 2023-10-10T22:37:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.135+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 shutdown_connections 2023-10-10T22:37:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.135+0000 7fb9c8bff700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fb9a4066dd0 0x7fb9a4069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.135+0000 7fb9c8bff700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4156ee0 0x7fb9c416a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.135+0000 7fb9c8bff700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c4069dd0 0x7fb9c40ab2e0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.135+0000 7fb9c8bff700 1 --2- 172.21.15.154:0/287821726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c40c85c0 0x7fb9c40a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.135+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 >> 172.21.15.154:0/287821726 conn(0x7fb9c40cc540 msgr2=0x7fb9c41556f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:44.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.135+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 shutdown_connections 2023-10-10T22:37:44.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.135+0000 7fb9c8bff700 1 -- 172.21.15.154:0/287821726 wait complete. 2023-10-10T22:37:44.154 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-10T22:37:44.158 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-10-22_38_00 in ~16s... 2023-10-10T22:37:44.159 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-10T22:37:44.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-10T22:37:44.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.343+0000 7f1258f9d700 1 Processor -- start 2023-10-10T22:37:44.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.344+0000 7f1258f9d700 1 -- start start 2023-10-10T22:37:44.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.345+0000 7f1258f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f125415b050 0x7f12540ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.345+0000 7f1258f9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12540cc8d0 0x7f125415b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.345+0000 7f1258f9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1254157a50 con 0x7f125415b960 2023-10-10T22:37:44.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.345+0000 7f1258f9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12541591b0 con 0x7f12540cc8d0 2023-10-10T22:37:44.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.345+0000 7f1258f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540ca9e0 con 0x7f125415b050 2023-10-10T22:37:44.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.345+0000 7f1252ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12540cc8d0 0x7f125415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.345+0000 7f1252ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12540cc8d0 0x7f125415b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38908/0 (socket says 172.21.15.154:38908) 2023-10-10T22:37:44.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.345+0000 7f1252ffd700 1 -- 172.21.15.154:0/3336472867 learned_addr learned my addr 172.21.15.154:0/3336472867 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:44.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.345+0000 7f12537fe700 1 --2- 172.21.15.154:0/3336472867 >> v2:172.21.15.179:3300/0 conn(0x7f125415b050 0x7f12540ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.346+0000 7f1252ffd700 1 -- 172.21.15.154:0/3336472867 >> v2:172.21.15.179:3300/0 conn(0x7f125415b050 msgr2=0x7f12540ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:44.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.346+0000 7f1252ffd700 1 --2- 172.21.15.154:0/3336472867 >> v2:172.21.15.179:3300/0 conn(0x7f125415b050 0x7f12540ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.346+0000 7f1252ffd700 1 -- 172.21.15.154:0/3336472867 >> v1:172.21.15.154:6789/0 conn(0x7f125415b960 legacy=0x7f1254157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.346+0000 7f1252ffd700 1 -- 172.21.15.154:0/3336472867 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540cacc0 con 0x7f12540cc8d0 2023-10-10T22:37:44.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.346+0000 7f1252ffd700 1 --2- 172.21.15.154:0/3336472867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12540cc8d0 0x7f125415b420 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f1254064f60 tx=0x7f1248009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1001c22486db1e1f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:44.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.346+0000 7f12527fc700 1 -- 172.21.15.154:0/3336472867 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248009e70 con 0x7f12540cc8d0 2023-10-10T22:37:44.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.346+0000 7f12527fc700 1 -- 172.21.15.154:0/3336472867 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124800b860 con 0x7f12540cc8d0 2023-10-10T22:37:44.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.346+0000 7f12527fc700 1 -- 172.21.15.154:0/3336472867 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124800bc00 con 0x7f12540cc8d0 2023-10-10T22:37:44.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.347+0000 7f1258f9d700 1 -- 172.21.15.154:0/3336472867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12540cc8d0 msgr2=0x7f125415b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.347+0000 7f1258f9d700 1 --2- 172.21.15.154:0/3336472867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12540cc8d0 0x7f125415b420 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f1254064f60 tx=0x7f1248009250 comp rx=0 tx=0).stop 2023-10-10T22:37:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.347+0000 7f1258f9d700 1 -- 172.21.15.154:0/3336472867 shutdown_connections 2023-10-10T22:37:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.347+0000 7f1258f9d700 1 --2- 172.21.15.154:0/3336472867 >> v2:172.21.15.179:3300/0 conn(0x7f125415b050 0x7f12540ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.347+0000 7f1258f9d700 1 --2- 172.21.15.154:0/3336472867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12540cc8d0 0x7f125415b420 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.347+0000 7f1258f9d700 1 -- 172.21.15.154:0/3336472867 >> 172.21.15.154:0/3336472867 conn(0x7f1254068e20 msgr2=0x7f12540cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:44.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.347+0000 7f1258f9d700 1 -- 172.21.15.154:0/3336472867 shutdown_connections 2023-10-10T22:37:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.347+0000 7f1258f9d700 1 -- 172.21.15.154:0/3336472867 wait complete. 2023-10-10T22:37:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.348+0000 7f1258f9d700 1 Processor -- start 2023-10-10T22:37:44.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.349+0000 7f1258f9d700 1 -- start start 2023-10-10T22:37:44.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.349+0000 7f1258f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12540cc8d0 0x7f1254142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.349+0000 7f1258f9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125415b050 0x7f12540a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.349+0000 7f1258f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f125415b960 0x7f12540a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.349+0000 7f1258f9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b0da0 con 0x7f125415b050 2023-10-10T22:37:44.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1258f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b1080 con 0x7f12540cc8d0 2023-10-10T22:37:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1258f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b1360 con 0x7f125415b960 2023-10-10T22:37:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1252ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125415b050 0x7f12540a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1252ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125415b050 0x7f12540a54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38912/0 (socket says 172.21.15.154:38912) 2023-10-10T22:37:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1252ffd700 1 -- 172.21.15.154:0/281082670 learned_addr learned my addr 172.21.15.154:0/281082670 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f12537fe700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12540cc8d0 0x7f1254142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1253fff700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f125415b960 0x7f12540a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1252ffd700 1 -- 172.21.15.154:0/281082670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f125415b960 msgr2=0x7f12540a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1252ffd700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f125415b960 0x7f12540a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1252ffd700 1 -- 172.21.15.154:0/281082670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12540cc8d0 msgr2=0x7f1254142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1252ffd700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12540cc8d0 0x7f1254142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1252ffd700 1 -- 172.21.15.154:0/281082670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12480094f0 con 0x7f125415b050 2023-10-10T22:37:44.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.350+0000 7f1252ffd700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125415b050 0x7f12540a54c0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f12540714a0 tx=0x7f1248017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:44.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.351+0000 7f123b7fe700 1 -- 172.21.15.154:0/281082670 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248011420 con 0x7f125415b050 2023-10-10T22:37:44.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.351+0000 7f123b7fe700 1 -- 172.21.15.154:0/281082670 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1248011580 con 0x7f125415b050 2023-10-10T22:37:44.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.351+0000 7f123b7fe700 1 -- 172.21.15.154:0/281082670 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248011940 con 0x7f125415b050 2023-10-10T22:37:44.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.351+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12540b1640 con 0x7f125415b050 2023-10-10T22:37:44.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.351+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12541428b0 con 0x7f125415b050 2023-10-10T22:37:44.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.352+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125416afb0 con 0x7f125415b050 2023-10-10T22:37:44.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.353+0000 7f123b7fe700 1 -- 172.21.15.154:0/281082670 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 114) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f124802c3b0 con 0x7f125415b050 2023-10-10T22:37:44.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.353+0000 7f123b7fe700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1240066dd0 0x7f1240069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.353+0000 7f123b7fe700 1 -- 172.21.15.154:0/281082670 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f1248085c00 con 0x7f125415b050 2023-10-10T22:37:44.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.354+0000 7f12537fe700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1240066dd0 0x7f1240069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.354+0000 7f12537fe700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1240066dd0 0x7f1240069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1244009d40 tx=0x7f1244008040 comp rx=0 tx=0).ready entity=mgr.10383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:44.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.358+0000 7f123b7fe700 1 -- 172.21.15.154:0/281082670 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f125416afb0 con 0x7f125415b050 2023-10-10T22:37:44.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.573+0000 7f123b7fe700 1 -- 172.21.15.154:0/281082670 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 115) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f1248053110 con 0x7f125415b050 2023-10-10T22:37:44.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.580+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12540b11f0 con 0x7f1240066dd0 2023-10-10T22:37:44.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.587+0000 7f123b7fe700 1 -- 172.21.15.154:0/281082670 <== mgr.10383 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f12540b11f0 con 0x7f1240066dd0 2023-10-10T22:37:44.588 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:44.589 INFO:teuthology.orchestra.run.smithi154.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-10T22:37:44.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1240066dd0 msgr2=0x7f1240069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1240066dd0 0x7f1240069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1244009d40 tx=0x7f1244008040 comp rx=0 tx=0).stop 2023-10-10T22:37:44.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125415b050 msgr2=0x7f12540a54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125415b050 0x7f12540a54c0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f12540714a0 tx=0x7f1248017000 comp rx=0 tx=0).stop 2023-10-10T22:37:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 shutdown_connections 2023-10-10T22:37:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f1240066dd0 0x7f1240069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f125415b960 0x7f12540a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12540cc8d0 0x7f1254142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 --2- 172.21.15.154:0/281082670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f125415b050 0x7f12540a54c0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.589+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 >> 172.21.15.154:0/281082670 conn(0x7f1254068e20 msgr2=0x7f1254156cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:44.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.590+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 shutdown_connections 2023-10-10T22:37:44.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.590+0000 7f1258f9d700 1 -- 172.21.15.154:0/281082670 wait complete. 2023-10-10T22:37:44.609 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-10T22:37:44.609 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-10T22:37:44.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-10T22:37:44.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.794+0000 7fa03ffff700 1 Processor -- start 2023-10-10T22:37:44.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.795+0000 7fa03ffff700 1 -- start start 2023-10-10T22:37:44.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.796+0000 7fa03ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400cc8d0 0x7fa04015b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.796+0000 7fa03ffff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa040157a50 con 0x7fa04015b050 2023-10-10T22:37:44.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.796+0000 7fa03ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa040158f10 con 0x7fa04015b960 2023-10-10T22:37:44.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.796+0000 7fa03ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401591b0 con 0x7fa0400cc8d0 2023-10-10T22:37:44.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.796+0000 7fa03effd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa04015b050 0x7fa0400ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56540/0 (socket says 172.21.15.154:56540) 2023-10-10T22:37:44.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.796+0000 7fa03effd700 1 -- 172.21.15.154:0/517726507 learned_addr learned my addr 172.21.15.154:0/517726507 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:44.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.796+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579527895 0 0) 0x7fa040157a50 con 0x7fa04015b050 2023-10-10T22:37:44.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa02c003570 con 0x7fa04015b050 2023-10-10T22:37:44.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa037fff700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400cc8d0 0x7fa04015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1503897360 0 0) 0x7fa02c003570 con 0x7fa04015b050 2023-10-10T22:37:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400cc8d0 msgr2=0x7fa04015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400cc8d0 0x7fa04015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 >> v1:172.21.15.179:6789/0 conn(0x7fa04015b960 legacy=0x7fa0400ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0400ca9e0 con 0x7fa04015b050 2023-10-10T22:37:44.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fa030001470 con 0x7fa04015b050 2023-10-10T22:37:44.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 >> v1:172.21.15.154:6789/0 conn(0x7fa04015b050 legacy=0x7fa0400ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c003a90 0x7fa02c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400cc8d0 0x7fa02c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa02c004e70 0x7fa02c0052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401591b0 con 0x7fa02c004e70 2023-10-10T22:37:44.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c00bc70 con 0x7fa02c003a90 2023-10-10T22:37:44.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c00be30 con 0x7fa0400cc8d0 2023-10-10T22:37:44.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03f7fe700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa02c004e70 0x7fa02c0052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa03effd700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c003a90 0x7fa02c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.797+0000 7fa037fff700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400cc8d0 0x7fa02c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03f7fe700 1 -- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400cc8d0 msgr2=0x7fa02c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:44.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03f7fe700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400cc8d0 0x7fa02c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03f7fe700 1 -- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c003a90 msgr2=0x7fa02c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:44.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03f7fe700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c003a90 0x7fa02c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03f7fe700 1 -- 172.21.15.154:0/517726507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c003570 con 0x7fa02c004e70 2023-10-10T22:37:44.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03effd700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c003a90 0x7fa02c003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:44.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03f7fe700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa02c004e70 0x7fa02c0052e0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fa038001f90 tx=0x7fa038001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0f626cefd1912d server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:44.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038001950 con 0x7fa02c004e70 2023-10-10T22:37:44.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03800c8b0 con 0x7fa02c004e70 2023-10-10T22:37:44.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.798+0000 7fa03e7fc700 1 -- 172.21.15.154:0/517726507 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800cc70 con 0x7fa02c004e70 2023-10-10T22:37:44.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.799+0000 7fa03ffff700 1 -- 172.21.15.154:0/517726507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa02c004e70 msgr2=0x7fa02c0052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.799+0000 7fa03ffff700 1 --2- 172.21.15.154:0/517726507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa02c004e70 0x7fa02c0052e0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fa038001f90 tx=0x7fa038001640 comp rx=0 tx=0).stop 2023-10-10T22:37:44.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.799+0000 7fa03f7fe700 1 -- 172.21.15.154:0/517726507 reap_dead start 2023-10-10T22:37:44.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.799+0000 7fa03ffff700 1 -- 172.21.15.154:0/517726507 shutdown_connections 2023-10-10T22:37:44.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.799+0000 7fa03ffff700 1 -- 172.21.15.154:0/517726507 >> 172.21.15.154:0/517726507 conn(0x7fa040068e20 msgr2=0x7fa0400cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:44.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.799+0000 7fa03ffff700 1 -- 172.21.15.154:0/517726507 shutdown_connections 2023-10-10T22:37:44.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.799+0000 7fa03ffff700 1 -- 172.21.15.154:0/517726507 wait complete. 2023-10-10T22:37:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.800+0000 7fa03ffff700 1 Processor -- start 2023-10-10T22:37:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.800+0000 7fa03ffff700 1 -- start start 2023-10-10T22:37:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.801+0000 7fa03ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c004e70 0x7fa0400c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.801+0000 7fa03ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0400a5760 0x7fa0400c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.801+0000 7fa03ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040156910 0x7fa040156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.801+0000 7fa03ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401572f0 con 0x7fa0400a5760 2023-10-10T22:37:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.801+0000 7fa03ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400c7370 con 0x7fa040156910 2023-10-10T22:37:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.801+0000 7fa03ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400c6760 con 0x7fa02c004e70 2023-10-10T22:37:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa037fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0400a5760 0x7fa0400c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa037fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0400a5760 0x7fa0400c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38930/0 (socket says 172.21.15.154:38930) 2023-10-10T22:37:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa037fff700 1 -- 172.21.15.154:0/3477706929 learned_addr learned my addr 172.21.15.154:0/3477706929 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa03effd700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c004e70 0x7fa0400c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa03f7fe700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040156910 0x7fa040156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa037fff700 1 -- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c004e70 msgr2=0x7fa0400c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa037fff700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c004e70 0x7fa0400c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa037fff700 1 -- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040156910 msgr2=0x7fa040156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:44.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa037fff700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040156910 0x7fa040156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa037fff700 1 -- 172.21.15.154:0/3477706929 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0400c6a40 con 0x7fa0400a5760 2023-10-10T22:37:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa03f7fe700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040156910 0x7fa040156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa03effd700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c004e70 0x7fa0400c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa037fff700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0400a5760 0x7fa0400c7800 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fa028010aa0 tx=0x7fa028008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa036ffd700 1 -- 172.21.15.154:0/3477706929 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800e9a0 con 0x7fa0400a5760 2023-10-10T22:37:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa036ffd700 1 -- 172.21.15.154:0/3477706929 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800eb00 con 0x7fa0400a5760 2023-10-10T22:37:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0400c6d20 con 0x7fa0400a5760 2023-10-10T22:37:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.802+0000 7fa036ffd700 1 -- 172.21.15.154:0/3477706929 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800eea0 con 0x7fa0400a5760 2023-10-10T22:37:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.803+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0400a5bd0 con 0x7fa0400a5760 2023-10-10T22:37:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.803+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04004c3c0 con 0x7fa0400a5760 2023-10-10T22:37:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.805+0000 7fa036ffd700 1 -- 172.21.15.154:0/3477706929 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 115) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fa028014640 con 0x7fa0400a5760 2023-10-10T22:37:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.805+0000 7fa036ffd700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa020067130 0x7fa0200695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.805+0000 7fa036ffd700 1 -- 172.21.15.154:0/3477706929 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fa0280853d0 con 0x7fa0400a5760 2023-10-10T22:37:44.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.806+0000 7fa03effd700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa020067130 0x7fa0200695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:44.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.806+0000 7fa03effd700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa020067130 0x7fa0200695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa030000e10 tx=0x7fa030009040 comp rx=0 tx=0).ready entity=mgr.10383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:44.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:44.810+0000 7fa036ffd700 1 -- 172.21.15.154:0/3477706929 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0280520b0 con 0x7fa0400a5760 2023-10-10T22:37:45.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.026+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0400c74b0 con 0x7fa020067130 2023-10-10T22:37:45.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.091+0000 7fa036ffd700 1 -- 172.21.15.154:0/3477706929 <== mgr.10383 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa0400c74b0 con 0x7fa020067130 2023-10-10T22:37:45.094 INFO:teuthology.orchestra.run.smithi154.stdout:Schedule removed for path snap_test_dir1 2023-10-10T22:37:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa020067130 msgr2=0x7fa0200695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa020067130 0x7fa0200695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa030000e10 tx=0x7fa030009040 comp rx=0 tx=0).stop 2023-10-10T22:37:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0400a5760 msgr2=0x7fa0400c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0400a5760 0x7fa0400c7800 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fa028010aa0 tx=0x7fa028008040 comp rx=0 tx=0).stop 2023-10-10T22:37:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 shutdown_connections 2023-10-10T22:37:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa020067130 0x7fa0200695e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:45.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040156910 0x7fa040156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:45.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c004e70 0x7fa0400c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:45.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 --2- 172.21.15.154:0/3477706929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0400a5760 0x7fa0400c7800 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:45.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 >> 172.21.15.154:0/3477706929 conn(0x7fa040068e20 msgr2=0x7fa0400af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:45.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 shutdown_connections 2023-10-10T22:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.094+0000 7fa03ffff700 1 -- 172.21.15.154:0/3477706929 wait complete. 2023-10-10T22:37:45.113 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-10T22:37:45.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:37:45.114 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-10T22:37:45.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:37:45.154 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-10T22:37:45.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-10T22:37:45.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:37:45.323 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:37:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.461+0000 7fe4265ff700 1 Processor -- start 2023-10-10T22:37:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.461+0000 7fe4265ff700 1 -- start start 2023-10-10T22:37:45.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe4265ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe4200c83f0 0x7fe4200c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:45.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe4265ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4201561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:45.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe4265ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42015b0d0 con 0x7fe4200c87c0 2023-10-10T22:37:45.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe4265ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4200c7a60 con 0x7fe4200c83f0 2023-10-10T22:37:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe4265ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42015a4c0 con 0x7fe4200ccee0 2023-10-10T22:37:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe41ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe4200c83f0 0x7fe4200c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe41ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe4200c83f0 0x7fe4200c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38946/0 (socket says 172.21.15.154:38946) 2023-10-10T22:37:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe41ffff700 1 -- 172.21.15.154:0/2115105359 learned_addr learned my addr 172.21.15.154:0/2115105359 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe424b9c700 1 --1- 172.21.15.154:0/2115105359 >> v1:172.21.15.154:6789/0 conn(0x7fe4200c87c0 0x7fe42006eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56552/0 (socket says 172.21.15.154:56552) 2023-10-10T22:37:45.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe41f7fe700 1 --2- 172.21.15.154:0/2115105359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4201561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:45.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe41ffff700 1 -- 172.21.15.154:0/2115105359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 msgr2=0x7fe4201561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:45.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe41ffff700 1 --2- 172.21.15.154:0/2115105359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4201561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:45.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe41ffff700 1 -- 172.21.15.154:0/2115105359 >> v1:172.21.15.154:6789/0 conn(0x7fe4200c87c0 legacy=0x7fe42006eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:45.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.463+0000 7fe41ffff700 1 -- 172.21.15.154:0/2115105359 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42015a7a0 con 0x7fe4200c83f0 2023-10-10T22:37:45.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.464+0000 7fe41f7fe700 1 --2- 172.21.15.154:0/2115105359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4201561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:45.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.464+0000 7fe41ffff700 1 --2- 172.21.15.154:0/2115105359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 0x7fe4200c7520 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fe4100099b0 tx=0x7fe410009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626c7d96f7a23fda server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:45.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.464+0000 7fe41effd700 1 -- 172.21.15.154:0/2115105359 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000b860 con 0x7fe4200c83f0 2023-10-10T22:37:45.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.464+0000 7fe41effd700 1 -- 172.21.15.154:0/2115105359 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41000b9c0 con 0x7fe4200c83f0 2023-10-10T22:37:45.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.464+0000 7fe41effd700 1 -- 172.21.15.154:0/2115105359 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000bd60 con 0x7fe4200c83f0 2023-10-10T22:37:45.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.464+0000 7fe4265ff700 1 -- 172.21.15.154:0/2115105359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 msgr2=0x7fe4200c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:45.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.464+0000 7fe4265ff700 1 --2- 172.21.15.154:0/2115105359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 0x7fe4200c7520 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fe4100099b0 tx=0x7fe410009250 comp rx=0 tx=0).stop 2023-10-10T22:37:45.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.465+0000 7fe4265ff700 1 -- 172.21.15.154:0/2115105359 shutdown_connections 2023-10-10T22:37:45.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.465+0000 7fe4265ff700 1 --2- 172.21.15.154:0/2115105359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 0x7fe4200c7520 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:45.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.465+0000 7fe4265ff700 1 --2- 172.21.15.154:0/2115105359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4201561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:45.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.465+0000 7fe4265ff700 1 -- 172.21.15.154:0/2115105359 >> 172.21.15.154:0/2115105359 conn(0x7fe420068e10 msgr2=0x7fe4200cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:45.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.465+0000 7fe4265ff700 1 -- 172.21.15.154:0/2115105359 shutdown_connections 2023-10-10T22:37:45.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.465+0000 7fe4265ff700 1 -- 172.21.15.154:0/2115105359 wait complete. 2023-10-10T22:37:45.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.466+0000 7fe4265ff700 1 Processor -- start 2023-10-10T22:37:45.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.466+0000 7fe4265ff700 1 -- start start 2023-10-10T22:37:45.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.467+0000 7fe4265ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 0x7fe420155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:45.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.467+0000 7fe4265ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4200c87c0 0x7fe420146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:45.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.467+0000 7fe4265ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4200c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:45.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.467+0000 7fe4265ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200c4da0 con 0x7fe4200c83f0 2023-10-10T22:37:45.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.467+0000 7fe4265ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420161b70 con 0x7fe4200c87c0 2023-10-10T22:37:45.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.467+0000 7fe4265ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200c4750 con 0x7fe4200ccee0 2023-10-10T22:37:45.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.467+0000 7fe41ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 0x7fe420155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:45.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.467+0000 7fe41ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 0x7fe420155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38952/0 (socket says 172.21.15.154:38952) 2023-10-10T22:37:45.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.467+0000 7fe41ffff700 1 -- 172.21.15.154:0/3667007009 learned_addr learned my addr 172.21.15.154:0/3667007009 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:45.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe41f7fe700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4200c87c0 0x7fe420146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe424b9c700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4200c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe41ffff700 1 -- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 msgr2=0x7fe4200c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe41ffff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4200c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:45.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe41ffff700 1 -- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4200c87c0 msgr2=0x7fe420146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:45.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe41ffff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4200c87c0 0x7fe420146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:45.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe41ffff700 1 -- 172.21.15.154:0/3667007009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100094f0 con 0x7fe4200c83f0 2023-10-10T22:37:45.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe41f7fe700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4200c87c0 0x7fe420146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:45.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe424b9c700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4200c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:45.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe41ffff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 0x7fe420155fa0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fe410009290 tx=0x7fe410017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:45.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe407fff700 1 -- 172.21.15.154:0/3667007009 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410024440 con 0x7fe4200c83f0 2023-10-10T22:37:45.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe407fff700 1 -- 172.21.15.154:0/3667007009 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4100245a0 con 0x7fe4200c83f0 2023-10-10T22:37:45.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe407fff700 1 -- 172.21.15.154:0/3667007009 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410024940 con 0x7fe4200c83f0 2023-10-10T22:37:45.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.468+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4200c4a30 con 0x7fe4200c83f0 2023-10-10T22:37:45.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.469+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe420147050 con 0x7fe4200c83f0 2023-10-10T22:37:45.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.470+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4200c5080 con 0x7fe4200c83f0 2023-10-10T22:37:45.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.470+0000 7fe407fff700 1 -- 172.21.15.154:0/3667007009 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 115) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fe41001a420 con 0x7fe4200c83f0 2023-10-10T22:37:45.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.471+0000 7fe407fff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe40c067130 0x7fe40c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:45.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.471+0000 7fe407fff700 1 -- 172.21.15.154:0/3667007009 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fe410086a80 con 0x7fe4200c83f0 2023-10-10T22:37:45.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.472+0000 7fe41f7fe700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe40c067130 0x7fe40c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:45.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.472+0000 7fe41f7fe700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe40c067130 0x7fe40c0695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe414006fd0 tx=0x7fe414008040 comp rx=0 tx=0).ready entity=mgr.10383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:45.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.476+0000 7fe407fff700 1 -- 172.21.15.154:0/3667007009 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4100536c0 con 0x7fe4200c83f0 2023-10-10T22:37:45.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:45.724+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe4200c45b0 con 0x7fe4200c83f0 2023-10-10T22:37:46.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.592+0000 7fe407fff700 1 -- 172.21.15.154:0/3667007009 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fe410053a90 con 0x7fe4200c83f0 2023-10-10T22:37:46.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.593+0000 7fe407fff700 1 -- 172.21.15.154:0/3667007009 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v116) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe410057150 con 0x7fe4200c83f0 2023-10-10T22:37:46.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe40c067130 msgr2=0x7fe40c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:46.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe40c067130 0x7fe40c0695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe414006fd0 tx=0x7fe414008040 comp rx=0 tx=0).stop 2023-10-10T22:37:46.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 msgr2=0x7fe420155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:46.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 0x7fe420155fa0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fe410009290 tx=0x7fe410017000 comp rx=0 tx=0).stop 2023-10-10T22:37:46.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 shutdown_connections 2023-10-10T22:37:46.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe40c067130 0x7fe40c0695e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:46.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4200ccee0 0x7fe4200c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:46.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4200c83f0 0x7fe420155fa0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:46.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 --2- 172.21.15.154:0/3667007009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4200c87c0 0x7fe420146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:46.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 >> 172.21.15.154:0/3667007009 conn(0x7fe420068e10 msgr2=0x7fe4200b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:46.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 shutdown_connections 2023-10-10T22:37:46.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:46.596+0000 7fe4265ff700 1 -- 172.21.15.154:0/3667007009 wait complete. 2023-10-10T22:37:46.616 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-10T22:37:46.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:37:46.708 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-10T22:37:46.792 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-10T22:37:46.793 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-10T22:37:46.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-10T22:37:46.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-10T22:37:46.874 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:37:46.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:46.875 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-10T22:37:46.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:47.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.149+0000 7f632d39d700 1 Processor -- start 2023-10-10T22:37:47.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.149+0000 7f632d39d700 1 -- start start 2023-10-10T22:37:47.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.150+0000 7f632d39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63281597f0 0x7f63280b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.150+0000 7f632d39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f632815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.150+0000 7f632d39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632815dbb0 con 0x7f6328159420 2023-10-10T22:37:47.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.150+0000 7f632d39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63280b11d0 con 0x7f63281597f0 2023-10-10T22:37:47.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.150+0000 7f632d39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63280b14b0 con 0x7f632815d230 2023-10-10T22:37:47.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f63277fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63281597f0 0x7f63280b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:47.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f632cb9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f632815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:47.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f632cb9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f632815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:55588/0 (socket says 172.21.15.154:55588) 2023-10-10T22:37:47.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f63277fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63281597f0 0x7f63280b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:54572/0 (socket says 172.21.15.154:54572) 2023-10-10T22:37:47.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f632cb9c700 1 -- 172.21.15.154:0/2206008293 learned_addr learned my addr 172.21.15.154:0/2206008293 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:47.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f63277fe700 1 -- 172.21.15.154:0/2206008293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 msgr2=0x7f632815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:47.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f63277fe700 1 --2- 172.21.15.154:0/2206008293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f632815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f63277fe700 1 -- 172.21.15.154:0/2206008293 >> v1:172.21.15.179:6789/0 conn(0x7f6328159420 legacy=0x7f63280b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f63277fe700 1 -- 172.21.15.154:0/2206008293 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280b1790 con 0x7f63281597f0 2023-10-10T22:37:47.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.151+0000 7f632cb9c700 1 --2- 172.21.15.154:0/2206008293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f632815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:47.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f63277fe700 1 --2- 172.21.15.154:0/2206008293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63281597f0 0x7f63280b2270 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f631c0098e0 tx=0x7f631c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e56071d7a825ec36 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:47.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f6326ffd700 1 -- 172.21.15.154:0/2206008293 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00b640 con 0x7f63281597f0 2023-10-10T22:37:47.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f6326ffd700 1 -- 172.21.15.154:0/2206008293 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00b7a0 con 0x7f63281597f0 2023-10-10T22:37:47.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f6326ffd700 1 -- 172.21.15.154:0/2206008293 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00bb40 con 0x7f63281597f0 2023-10-10T22:37:47.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f632d39d700 1 -- 172.21.15.154:0/2206008293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63281597f0 msgr2=0x7f63280b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f632d39d700 1 --2- 172.21.15.154:0/2206008293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63281597f0 0x7f63280b2270 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f631c0098e0 tx=0x7f631c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f632d39d700 1 -- 172.21.15.154:0/2206008293 shutdown_connections 2023-10-10T22:37:47.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f632d39d700 1 --2- 172.21.15.154:0/2206008293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f632815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f632d39d700 1 --2- 172.21.15.154:0/2206008293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63281597f0 0x7f63280b2270 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.152+0000 7f632d39d700 1 -- 172.21.15.154:0/2206008293 >> 172.21.15.154:0/2206008293 conn(0x7f63280d0660 msgr2=0x7f63280d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:47.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.153+0000 7f632d39d700 1 -- 172.21.15.154:0/2206008293 shutdown_connections 2023-10-10T22:37:47.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.153+0000 7f632d39d700 1 -- 172.21.15.154:0/2206008293 wait complete. 2023-10-10T22:37:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.154+0000 7f632d39d700 1 Processor -- start 2023-10-10T22:37:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.154+0000 7f632d39d700 1 -- start start 2023-10-10T22:37:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f632d39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6328159420 0x7f63280ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f632d39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63281597f0 0x7f63280c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f632d39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f6328169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f632d39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c7b90 con 0x7f63281597f0 2023-10-10T22:37:47.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f632d39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632816a360 con 0x7f6328159420 2023-10-10T22:37:47.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f632d39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632816a640 con 0x7f632815d230 2023-10-10T22:37:47.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f63277fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63281597f0 0x7f63280c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:47.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f63277fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63281597f0 0x7f63280c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52276/0 (socket says 172.21.15.154:52276) 2023-10-10T22:37:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f63277fe700 1 -- 172.21.15.154:0/1043611813 learned_addr learned my addr 172.21.15.154:0/1043611813 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f632cb9c700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f6328169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.155+0000 7f6327fff700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6328159420 0x7f63280ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f63277fe700 1 -- 172.21.15.154:0/1043611813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 msgr2=0x7f6328169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f63277fe700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f6328169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f63277fe700 1 -- 172.21.15.154:0/1043611813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6328159420 msgr2=0x7f63280ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f63277fe700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6328159420 0x7f63280ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f63277fe700 1 -- 172.21.15.154:0/1043611813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320009ae0 con 0x7f63281597f0 2023-10-10T22:37:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f63277fe700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63281597f0 0x7f63280c7150 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f631c013000 tx=0x7f631c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f630ffff700 1 -- 172.21.15.154:0/1043611813 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c01bb70 con 0x7f63281597f0 2023-10-10T22:37:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f630ffff700 1 -- 172.21.15.154:0/1043611813 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c01bcd0 con 0x7f63281597f0 2023-10-10T22:37:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c009420 con 0x7f63281597f0 2023-10-10T22:37:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.156+0000 7f630ffff700 1 -- 172.21.15.154:0/1043611813 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c011670 con 0x7f63281597f0 2023-10-10T22:37:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.157+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632816a020 con 0x7f63281597f0 2023-10-10T22:37:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.158+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63280c8020 con 0x7f63281597f0 2023-10-10T22:37:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.159+0000 7f630ffff700 1 -- 172.21.15.154:0/1043611813 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f631c011a20 con 0x7f63281597f0 2023-10-10T22:37:47.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.160+0000 7f630ffff700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6314067110 0x7f63140695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.160+0000 7f630ffff700 1 -- 172.21.15.154:0/1043611813 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f631c085f10 con 0x7f63281597f0 2023-10-10T22:37:47.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.160+0000 7f6327fff700 1 -- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6314067110 msgr2=0x7f63140695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:47.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.160+0000 7f6327fff700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6314067110 0x7f63140695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:47.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.164+0000 7f630ffff700 1 -- 172.21.15.154:0/1043611813 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63280c8020 con 0x7f63281597f0 2023-10-10T22:37:47.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.361+0000 7f6327fff700 1 -- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6314067110 msgr2=0x7f63140695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:47.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.361+0000 7f6327fff700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6314067110 0x7f63140695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:47.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.406+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63280c8020 con 0x7f63281597f0 2023-10-10T22:37:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.407+0000 7f630ffff700 1 -- 172.21.15.154:0/1043611813 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f63280c8020 con 0x7f63281597f0 2023-10-10T22:37:47.408 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:47.409 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1468165521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1468165521},{"type":"v1","addr":"172.21.15.179:6834","nonce":1468165521}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1270073932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1270073932},{"type":"v1","addr":"172.21.15.154:6834","nonce":1270073932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2994571754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2994571754},{"type":"v1","addr":"172.21.15.154:6835","nonce":2994571754}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:37:21.762982+0000","modified":"2023-10-10T22:37:25.332647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10182":{"gid":10182,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1275463629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1275463629},{"type":"v1","addr":"172.21.15.179:6835","nonce":1275463629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-10T22:37:47.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.409+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6314067110 msgr2=0x7f63140695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:47.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.409+0000 7f632d39d700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6314067110 0x7f63140695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.409+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63281597f0 msgr2=0x7f63280c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.409+0000 7f632d39d700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63281597f0 0x7f63280c7150 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f631c013000 tx=0x7f631c017000 comp rx=0 tx=0).stop 2023-10-10T22:37:47.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.410+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 shutdown_connections 2023-10-10T22:37:47.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.410+0000 7f632d39d700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6314067110 0x7f63140695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.410+0000 7f632d39d700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f632815d230 0x7f6328169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.410+0000 7f632d39d700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6328159420 0x7f63280ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.410+0000 7f632d39d700 1 --2- 172.21.15.154:0/1043611813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63281597f0 0x7f63280c7150 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.410+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 >> 172.21.15.154:0/1043611813 conn(0x7f63280d0660 msgr2=0x7f63280b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:47.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.410+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 shutdown_connections 2023-10-10T22:37:47.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.410+0000 7f632d39d700 1 -- 172.21.15.154:0/1043611813 wait complete. 2023-10-10T22:37:47.414 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 94 2023-10-10T22:37:47.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:47.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.618+0000 7f0b0119d700 1 Processor -- start 2023-10-10T22:37:47.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.618+0000 7f0b0119d700 1 -- start start 2023-10-10T22:37:47.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.620+0000 7f0b0119d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0afc0b1e50 0x7f0afc159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.620+0000 7f0b0119d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0cfe20 con 0x7f0afc0ceaa0 2023-10-10T22:37:47.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.620+0000 7f0b0119d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0cf210 con 0x7f0afc1593b0 2023-10-10T22:37:47.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.620+0000 7f0b0119d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc0cf4f0 con 0x7f0afc0b1e50 2023-10-10T22:37:47.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.621+0000 7f0b0099c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0afc0ceaa0 0x7f0afc0b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56158/0 (socket says 172.21.15.154:56158) 2023-10-10T22:37:47.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.621+0000 7f0b0099c700 1 -- 172.21.15.154:0/1001784751 learned_addr learned my addr 172.21.15.154:0/1001784751 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:47.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.621+0000 7f0afb7fe700 1 --2- 172.21.15.154:0/1001784751 >> v2:172.21.15.179:3300/0 conn(0x7f0afc0b1e50 0x7f0afc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:47.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.621+0000 7f0afaffd700 1 -- 172.21.15.154:0/1001784751 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209880914 0 0) 0x7f0afc0cfe20 con 0x7f0afc0ceaa0 2023-10-10T22:37:47.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.621+0000 7f0afaffd700 1 -- 172.21.15.154:0/1001784751 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae4003570 con 0x7f0afc0ceaa0 2023-10-10T22:37:47.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.621+0000 7f0afb7fe700 1 -- 172.21.15.154:0/1001784751 >> v1:172.21.15.179:6789/0 conn(0x7f0afc1593b0 legacy=0x7f0afc0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.621+0000 7f0afb7fe700 1 -- 172.21.15.154:0/1001784751 >> v1:172.21.15.154:6789/0 conn(0x7f0afc0ceaa0 legacy=0x7f0afc0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.621+0000 7f0afb7fe700 1 -- 172.21.15.154:0/1001784751 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc0cf7d0 con 0x7f0afc0b1e50 2023-10-10T22:37:47.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.621+0000 7f0afb7fe700 1 --2- 172.21.15.154:0/1001784751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0b1e50 0x7f0afc159780 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0af00098e0 tx=0x7f0af00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dfa1cfa2721f6e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:47.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.622+0000 7f0afaffd700 1 -- 172.21.15.154:0/1001784751 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000b640 con 0x7f0afc0b1e50 2023-10-10T22:37:47.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.622+0000 7f0afaffd700 1 -- 172.21.15.154:0/1001784751 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000b7a0 con 0x7f0afc0b1e50 2023-10-10T22:37:47.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.622+0000 7f0afaffd700 1 -- 172.21.15.154:0/1001784751 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000bb40 con 0x7f0afc0b1e50 2023-10-10T22:37:47.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.622+0000 7f0b0119d700 1 -- 172.21.15.154:0/1001784751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0b1e50 msgr2=0x7f0afc159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.622+0000 7f0b0119d700 1 --2- 172.21.15.154:0/1001784751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0b1e50 0x7f0afc159780 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0af00098e0 tx=0x7f0af00091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.623+0000 7f0b0119d700 1 -- 172.21.15.154:0/1001784751 shutdown_connections 2023-10-10T22:37:47.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.623+0000 7f0b0119d700 1 --2- 172.21.15.154:0/1001784751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0b1e50 0x7f0afc159780 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.623+0000 7f0b0119d700 1 -- 172.21.15.154:0/1001784751 >> 172.21.15.154:0/1001784751 conn(0x7f0afc0d1130 msgr2=0x7f0afc0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:47.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.623+0000 7f0b0119d700 1 -- 172.21.15.154:0/1001784751 shutdown_connections 2023-10-10T22:37:47.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.623+0000 7f0b0119d700 1 -- 172.21.15.154:0/1001784751 wait complete. 2023-10-10T22:37:47.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.625+0000 7f0b0119d700 1 Processor -- start 2023-10-10T22:37:47.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.625+0000 7f0b0119d700 1 -- start start 2023-10-10T22:37:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0b0119d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0afc0b1e50 0x7f0afc14e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0b0119d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0ceaa0 0x7f0afc15bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0b0119d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0afc1593b0 0x7f0afc0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0b0119d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc16a650 con 0x7f0afc0b1e50 2023-10-10T22:37:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0b0119d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc14e860 con 0x7f0afc0ceaa0 2023-10-10T22:37:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0b0119d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc169d20 con 0x7f0afc1593b0 2023-10-10T22:37:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0afc0b1e50 0x7f0afc14e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0afc0b1e50 0x7f0afc14e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52290/0 (socket says 172.21.15.154:52290) 2023-10-10T22:37:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afbfff700 1 -- 172.21.15.154:0/33917795 learned_addr learned my addr 172.21.15.154:0/33917795 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afb7fe700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0ceaa0 0x7f0afc15bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:47.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0b0099c700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0afc1593b0 0x7f0afc0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:47.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afbfff700 1 -- 172.21.15.154:0/33917795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0afc1593b0 msgr2=0x7f0afc0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afbfff700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0afc1593b0 0x7f0afc0b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afbfff700 1 -- 172.21.15.154:0/33917795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0ceaa0 msgr2=0x7f0afc15bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afbfff700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0ceaa0 0x7f0afc15bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afbfff700 1 -- 172.21.15.154:0/33917795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af0009420 con 0x7f0afc0b1e50 2023-10-10T22:37:47.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.627+0000 7f0afb7fe700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0ceaa0 0x7f0afc15bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:47.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.628+0000 7f0afbfff700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0afc0b1e50 0x7f0afc14e030 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00c4e0 tx=0x7f0aec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:47.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.628+0000 7f0ae3fff700 1 -- 172.21.15.154:0/33917795 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec011590 con 0x7f0afc0b1e50 2023-10-10T22:37:47.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.628+0000 7f0ae3fff700 1 -- 172.21.15.154:0/33917795 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec011710 con 0x7f0afc0b1e50 2023-10-10T22:37:47.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.628+0000 7f0ae3fff700 1 -- 172.21.15.154:0/33917795 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec011ad0 con 0x7f0afc0b1e50 2023-10-10T22:37:47.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.628+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc16a000 con 0x7f0afc0b1e50 2023-10-10T22:37:47.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.628+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc1699f0 con 0x7f0afc0b1e50 2023-10-10T22:37:47.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.629+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc04c3c0 con 0x7f0afc0b1e50 2023-10-10T22:37:47.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.630+0000 7f0ae3fff700 1 -- 172.21.15.154:0/33917795 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0aec01b3b0 con 0x7f0afc0b1e50 2023-10-10T22:37:47.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.631+0000 7f0ae3fff700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ae80670e0 0x7f0ae8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:47.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.631+0000 7f0ae3fff700 1 -- 172.21.15.154:0/33917795 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f0aec083f20 con 0x7f0afc0b1e50 2023-10-10T22:37:47.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.631+0000 7f0afb7fe700 1 -- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ae80670e0 msgr2=0x7f0ae8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:47.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.631+0000 7f0afb7fe700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ae80670e0 0x7f0ae8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:47.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.635+0000 7f0ae3fff700 1 -- 172.21.15.154:0/33917795 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0aec050c00 con 0x7f0afc0b1e50 2023-10-10T22:37:47.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.832+0000 7f0afb7fe700 1 -- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ae80670e0 msgr2=0x7f0ae8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:47.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.832+0000 7f0afb7fe700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ae80670e0 0x7f0ae8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:47.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.837+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0afc0cfab0 con 0x7f0afc0b1e50 2023-10-10T22:37:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.838+0000 7f0ae3fff700 1 -- 172.21.15.154:0/33917795 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v210) v1 ==== 74+0+16589 (secure 0 0 0) 0x7f0aec017070 con 0x7f0afc0b1e50 2023-10-10T22:37:47.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:47.842 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":210,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:42.558280+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:37:19.912253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-10T22:37:20.749030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3458335740":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/3394882299":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/1691610567":"2023-10-11T22:37:42.558235+0000","172.21.15.154:6837/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:6836/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/4135556396":"2023-10-11T22:37:42.558235+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ae80670e0 msgr2=0x7f0ae8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ae80670e0 0x7f0ae8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0afc0b1e50 msgr2=0x7f0afc14e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0afc0b1e50 0x7f0afc14e030 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00c4e0 tx=0x7f0aec00c7f0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 shutdown_connections 2023-10-10T22:37:47.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ae80670e0 0x7f0ae8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0afc1593b0 0x7f0afc0b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0afc0b1e50 0x7f0afc14e030 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 --2- 172.21.15.154:0/33917795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0afc0ceaa0 0x7f0afc15bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 >> 172.21.15.154:0/33917795 conn(0x7f0afc0d1130 msgr2=0x7f0afc15e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 shutdown_connections 2023-10-10T22:37:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:47.840+0000 7f0b0119d700 1 -- 172.21.15.154:0/33917795 wait complete. 2023-10-10T22:37:47.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-10T21:02:07.905514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-10T22:37:19.912253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '208', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-10-10T22:37:20.749030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '209', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-10T22:37:47.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-10T22:37:47.878 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:47.877+0000 7f7198074180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:37:47.964 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:47.962+0000 7ff84736b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-10T22:37:48.041 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:48.041+0000 7f7198074180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:48.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.054+0000 7f449d39d700 1 Processor -- start 2023-10-10T22:37:48.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.054+0000 7f449d39d700 1 -- start start 2023-10-10T22:37:48.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.055+0000 7f449d39d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44980b4e70 0x7f44980ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.055+0000 7f449d39d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44980cfb00 con 0x7f44980b16d0 2023-10-10T22:37:48.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.055+0000 7f449d39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449815e060 con 0x7f44980b1b40 2023-10-10T22:37:48.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.055+0000 7f449d39d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44980b5c40 con 0x7f44980b4e70 2023-10-10T22:37:48.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.056+0000 7f4497fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44980b4e70 0x7f44980ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.056+0000 7f44977fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f44980b16d0 0x7f449815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56172/0 (socket says 172.21.15.154:56172) 2023-10-10T22:37:48.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.056+0000 7f44977fe700 1 -- 172.21.15.154:0/3450356468 learned_addr learned my addr 172.21.15.154:0/3450356468 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:48.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.056+0000 7f4497fff700 1 -- 172.21.15.154:0/3450356468 >> v1:172.21.15.179:6789/0 conn(0x7f44980b1b40 legacy=0x7f449815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.056+0000 7f4497fff700 1 -- 172.21.15.154:0/3450356468 >> v1:172.21.15.154:6789/0 conn(0x7f44980b16d0 legacy=0x7f449815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.056+0000 7f4497fff700 1 -- 172.21.15.154:0/3450356468 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44980b5f20 con 0x7f44980b4e70 2023-10-10T22:37:48.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.056+0000 7f4496ffd700 1 -- 172.21.15.154:0/3450356468 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691040466 0 0) 0x7f44980cfb00 con 0x7f44980b16d0 2023-10-10T22:37:48.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.056+0000 7f4497fff700 1 --2- 172.21.15.154:0/3450356468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 0x7f44980ccff0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f44880098e0 tx=0x7f44880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe8f9fed1492677 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:48.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.057+0000 7f4496ffd700 1 -- 172.21.15.154:0/3450356468 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488009e80 con 0x7f44980b4e70 2023-10-10T22:37:48.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.057+0000 7f4496ffd700 1 -- 172.21.15.154:0/3450356468 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448800b860 con 0x7f44980b4e70 2023-10-10T22:37:48.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.057+0000 7f4496ffd700 1 -- 172.21.15.154:0/3450356468 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800bbe0 con 0x7f44980b4e70 2023-10-10T22:37:48.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.057+0000 7f449d39d700 1 -- 172.21.15.154:0/3450356468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 msgr2=0x7f44980ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.057+0000 7f449d39d700 1 --2- 172.21.15.154:0/3450356468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 0x7f44980ccff0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f44880098e0 tx=0x7f44880091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.057+0000 7f449d39d700 1 -- 172.21.15.154:0/3450356468 shutdown_connections 2023-10-10T22:37:48.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.057+0000 7f449d39d700 1 --2- 172.21.15.154:0/3450356468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b4e70 0x7f44980ccff0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.057+0000 7f449d39d700 1 -- 172.21.15.154:0/3450356468 >> 172.21.15.154:0/3450356468 conn(0x7f44980d10c0 msgr2=0x7f44980affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:48.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.057+0000 7f449d39d700 1 -- 172.21.15.154:0/3450356468 shutdown_connections 2023-10-10T22:37:48.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.058+0000 7f449d39d700 1 -- 172.21.15.154:0/3450356468 wait complete. 2023-10-10T22:37:48.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.059+0000 7f449d39d700 1 Processor -- start 2023-10-10T22:37:48.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.059+0000 7f449d39d700 1 -- start start 2023-10-10T22:37:48.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.060+0000 7f449d39d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 0x7f4498169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.060+0000 7f449d39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b1b40 0x7f449816ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.060+0000 7f449d39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b4e70 0x7f44980c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.060+0000 7f449d39d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44980c8030 con 0x7f44980b16d0 2023-10-10T22:37:48.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.060+0000 7f449d39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44980c6d00 con 0x7f44980b4e70 2023-10-10T22:37:48.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.060+0000 7f449d39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44980c7700 con 0x7f44980b1b40 2023-10-10T22:37:48.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.060+0000 7f4497fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 0x7f4498169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f4497fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 0x7f4498169ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52318/0 (socket says 172.21.15.154:52318) 2023-10-10T22:37:48.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f4497fff700 1 -- 172.21.15.154:0/3009955180 learned_addr learned my addr 172.21.15.154:0/3009955180 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:48.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f44977fe700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b1b40 0x7f449816ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f449cb9c700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b4e70 0x7f44980c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f4497fff700 1 -- 172.21.15.154:0/3009955180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b1b40 msgr2=0x7f449816ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f4497fff700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b1b40 0x7f449816ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f4497fff700 1 -- 172.21.15.154:0/3009955180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b4e70 msgr2=0x7f44980c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f4497fff700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b4e70 0x7f44980c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f4497fff700 1 -- 172.21.15.154:0/3009955180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488009420 con 0x7f44980b16d0 2023-10-10T22:37:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f44977fe700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b1b40 0x7f449816ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.061+0000 7f4497fff700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 0x7f4498169ff0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f4498070dd0 tx=0x7f4488017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:48.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.062+0000 7f447ffff700 1 -- 172.21.15.154:0/3009955180 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448801f070 con 0x7f44980b16d0 2023-10-10T22:37:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.062+0000 7f447ffff700 1 -- 172.21.15.154:0/3009955180 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488000c90 con 0x7f44980b16d0 2023-10-10T22:37:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.062+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44980c79e0 con 0x7f44980b16d0 2023-10-10T22:37:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.062+0000 7f447ffff700 1 -- 172.21.15.154:0/3009955180 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800bbe0 con 0x7f44980b16d0 2023-10-10T22:37:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.062+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44980c5550 con 0x7f44980b16d0 2023-10-10T22:37:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.063+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4498088990 con 0x7f44980b16d0 2023-10-10T22:37:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.064+0000 7f447ffff700 1 -- 172.21.15.154:0/3009955180 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f4488011880 con 0x7f44980b16d0 2023-10-10T22:37:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.065+0000 7f447ffff700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.065+0000 7f447ffff700 1 -- 172.21.15.154:0/3009955180 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f4488086330 con 0x7f44980b16d0 2023-10-10T22:37:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.065+0000 7f44977fe700 1 -- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44840670e0 msgr2=0x7f4484069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.065+0000 7f44977fe700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.068+0000 7f447ffff700 1 -- 172.21.15.154:0/3009955180 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4488053140 con 0x7f44980b16d0 2023-10-10T22:37:48.129 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:48.128+0000 7f7198074180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:37:48.137 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:48.136+0000 7ff84736b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:48.225 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:48.224+0000 7ff84736b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-10T22:37:48.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.266+0000 7f44977fe700 1 -- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44840670e0 msgr2=0x7f4484069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:48.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.266+0000 7f44977fe700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:48.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.268+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44980cc4a0 con 0x7f44980b16d0 2023-10-10T22:37:48.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.268+0000 7f447ffff700 1 -- 172.21.15.154:0/3009955180 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v210) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4488032020 con 0x7f44980b16d0 2023-10-10T22:37:48.270 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-10-10T22:37:48.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44840670e0 msgr2=0x7f4484069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:48.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 msgr2=0x7f4498169ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 0x7f4498169ff0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f4498070dd0 tx=0x7f4488017000 comp rx=0 tx=0).stop 2023-10-10T22:37:48.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 shutdown_connections 2023-10-10T22:37:48.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f44840670e0 0x7f4484069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44980b4e70 0x7f44980c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44980b16d0 0x7f4498169ff0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 --2- 172.21.15.154:0/3009955180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44980b1b40 0x7f449816ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 >> 172.21.15.154:0/3009955180 conn(0x7f44980d10c0 msgr2=0x7f4498159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:48.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 shutdown_connections 2023-10-10T22:37:48.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.271+0000 7f449d39d700 1 -- 172.21.15.154:0/3009955180 wait complete. 2023-10-10T22:37:48.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-10T22:37:48.356 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:48.355+0000 7f7198074180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:48.463 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:48.462+0000 7ff84736b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:48.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.484+0000 7f76af59e700 1 Processor -- start 2023-10-10T22:37:48.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.484+0000 7f76af59e700 1 -- start start 2023-10-10T22:37:48.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.485+0000 7f76af59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.485+0000 7f76af59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b00aea70 con 0x7f76b00aef00 2023-10-10T22:37:48.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.485+0000 7f76af59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b015dad0 con 0x7f76b015a3b0 2023-10-10T22:37:48.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.485+0000 7f76af59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b006ee30 con 0x7f76b006e470 2023-10-10T22:37:48.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76add9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f76b00aef00 0x7f76b015d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56180/0 (socket says 172.21.15.154:56180) 2023-10-10T22:37:48.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76add9b700 1 -- 172.21.15.154:0/181121220 learned_addr learned my addr 172.21.15.154:0/181121220 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76aed9d700 1 --2- 172.21.15.154:0/181121220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76ad59a700 1 -- 172.21.15.154:0/181121220 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878604895 0 0) 0x7f76b00aea70 con 0x7f76b00aef00 2023-10-10T22:37:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76ad59a700 1 -- 172.21.15.154:0/181121220 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7698003570 con 0x7f76b00aef00 2023-10-10T22:37:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76ad59a700 1 -- 172.21.15.154:0/181121220 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816090396 0 0) 0x7f76b015dad0 con 0x7f76b015a3b0 2023-10-10T22:37:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76ad59a700 1 -- 172.21.15.154:0/181121220 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b00aea70 con 0x7f76b015a3b0 2023-10-10T22:37:48.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76aed9d700 1 -- 172.21.15.154:0/181121220 >> v1:172.21.15.179:6789/0 conn(0x7f76b015a3b0 legacy=0x7f76b015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76aed9d700 1 -- 172.21.15.154:0/181121220 >> v1:172.21.15.154:6789/0 conn(0x7f76b00aef00 legacy=0x7f76b015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.486+0000 7f76aed9d700 1 -- 172.21.15.154:0/181121220 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00ae480 con 0x7f76b006e470 2023-10-10T22:37:48.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.487+0000 7f76aed9d700 1 --2- 172.21.15.154:0/181121220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b006e8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f76b015dc60 tx=0x7f76a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cb5c82251f5e093 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.487+0000 7f76ad59a700 1 -- 172.21.15.154:0/181121220 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8016070 con 0x7f76b006e470 2023-10-10T22:37:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.487+0000 7f76ad59a700 1 -- 172.21.15.154:0/181121220 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a800bab0 con 0x7f76b006e470 2023-10-10T22:37:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.487+0000 7f76ad59a700 1 -- 172.21.15.154:0/181121220 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a800e070 con 0x7f76b006e470 2023-10-10T22:37:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.487+0000 7f76af59e700 1 -- 172.21.15.154:0/181121220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 msgr2=0x7f76b006e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.487+0000 7f76af59e700 1 --2- 172.21.15.154:0/181121220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b006e8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f76b015dc60 tx=0x7f76a8009780 comp rx=0 tx=0).stop 2023-10-10T22:37:48.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.487+0000 7f76af59e700 1 -- 172.21.15.154:0/181121220 shutdown_connections 2023-10-10T22:37:48.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.487+0000 7f76af59e700 1 --2- 172.21.15.154:0/181121220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b006e8f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.487+0000 7f76af59e700 1 -- 172.21.15.154:0/181121220 >> 172.21.15.154:0/181121220 conn(0x7f76b00c9f70 msgr2=0x7f76b006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:48.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.488+0000 7f76af59e700 1 -- 172.21.15.154:0/181121220 shutdown_connections 2023-10-10T22:37:48.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.488+0000 7f76af59e700 1 -- 172.21.15.154:0/181121220 wait complete. 2023-10-10T22:37:48.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.489+0000 7f76af59e700 1 Processor -- start 2023-10-10T22:37:48.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.489+0000 7f76af59e700 1 -- start start 2023-10-10T22:37:48.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76af59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b0152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76af59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b00aef00 0x7f76b00cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76af59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76b015a3b0 0x7f76b00cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76af59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00c4750 con 0x7f76b015a3b0 2023-10-10T22:37:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76af59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00c3b80 con 0x7f76b00aef00 2023-10-10T22:37:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76af59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00c3e20 con 0x7f76b006e470 2023-10-10T22:37:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76aed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76b015a3b0 0x7f76b00cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76add9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b00aef00 0x7f76b00cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76ae59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b0152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76add9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b00aef00 0x7f76b00cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:54618/0 (socket says 172.21.15.154:54618) 2023-10-10T22:37:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.490+0000 7f76add9b700 1 -- 172.21.15.154:0/560118640 learned_addr learned my addr 172.21.15.154:0/560118640 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f76add9b700 1 -- 172.21.15.154:0/560118640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 msgr2=0x7f76b0152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f76add9b700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b0152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f76add9b700 1 -- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76b015a3b0 msgr2=0x7f76b00cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f76add9b700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76b015a3b0 0x7f76b00cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f76add9b700 1 -- 172.21.15.154:0/560118640 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8009a20 con 0x7f76b00aef00 2023-10-10T22:37:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f76ae59c700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b0152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f76aed9d700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76b015a3b0 0x7f76b00cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f76add9b700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b00aef00 0x7f76b00cb8e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f76a400c790 tx=0x7f76a4007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f769e7fc700 1 -- 172.21.15.154:0/560118640 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4005b30 con 0x7f76b00aef00 2023-10-10T22:37:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f769e7fc700 1 -- 172.21.15.154:0/560118640 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a4005cd0 con 0x7f76b00aef00 2023-10-10T22:37:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f769e7fc700 1 -- 172.21.15.154:0/560118640 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4007320 con 0x7f76b00aef00 2023-10-10T22:37:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.491+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b00c4100 con 0x7f76b00aef00 2023-10-10T22:37:48.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.492+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b01528d0 con 0x7f76b00aef00 2023-10-10T22:37:48.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.492+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b00c48c0 con 0x7f76b00aef00 2023-10-10T22:37:48.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.493+0000 7f769e7fc700 1 -- 172.21.15.154:0/560118640 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f76a4012400 con 0x7f76b00aef00 2023-10-10T22:37:48.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.495+0000 7f769e7fc700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f76900670e0 0x7f7690069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.495+0000 7f769e7fc700 1 -- 172.21.15.154:0/560118640 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f76a4083fc0 con 0x7f76b00aef00 2023-10-10T22:37:48.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.495+0000 7f76ae59c700 1 -- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f76900670e0 msgr2=0x7f7690069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:48.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.495+0000 7f76ae59c700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f76900670e0 0x7f7690069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:48.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.499+0000 7f769e7fc700 1 -- 172.21.15.154:0/560118640 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76a404b5a0 con 0x7f76b00aef00 2023-10-10T22:37:48.534 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:48.533+0000 7f7198074180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:37:48.627 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:48.626+0000 7f7198074180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:37:48.652 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:48.651+0000 7ff84736b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-10T22:37:48.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.696+0000 7f76ae59c700 1 -- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f76900670e0 msgr2=0x7f7690069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:48.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.696+0000 7f76ae59c700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f76900670e0 0x7f7690069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:48.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.700+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76b015dd30 con 0x7f76b00aef00 2023-10-10T22:37:48.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.700+0000 7f769e7fc700 1 -- 172.21.15.154:0/560118640 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v210) v1 ==== 104+0+11 (secure 0 0 0) 0x7f76a4017020 con 0x7f76b00aef00 2023-10-10T22:37:48.702 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-10-10T22:37:48.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f76900670e0 msgr2=0x7f7690069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:48.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f76900670e0 0x7f7690069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b00aef00 msgr2=0x7f76b00cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b00aef00 0x7f76b00cb8e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f76a400c790 tx=0x7f76a4007e80 comp rx=0 tx=0).stop 2023-10-10T22:37:48.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 shutdown_connections 2023-10-10T22:37:48.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f76900670e0 0x7f7690069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76b015a3b0 0x7f76b00cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b006e470 0x7f76b0152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 --2- 172.21.15.154:0/560118640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b00aef00 0x7f76b00cb8e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 >> 172.21.15.154:0/560118640 conn(0x7f76b00c9f70 msgr2=0x7f76b00c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:48.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 shutdown_connections 2023-10-10T22:37:48.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.703+0000 7f76af59e700 1 -- 172.21.15.154:0/560118640 wait complete. 2023-10-10T22:37:48.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-10T22:37:48.751 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:48.750+0000 7ff84736b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-10T22:37:48.791 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:48.790+0000 7f7198074180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:37:48.892 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:48.892+0000 7f7198074180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:48.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.917+0000 7fa4c299d700 1 Processor -- start 2023-10-10T22:37:48.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.917+0000 7fa4c299d700 1 -- start start 2023-10-10T22:37:48.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.918+0000 7fa4c299d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa4bc0cb1a0 0x7fa4bc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.918+0000 7fa4c299d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc06ebd0 con 0x7fa4bc15a8a0 2023-10-10T22:37:48.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.918+0000 7fa4c299d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc15ad20 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.918+0000 7fa4c299d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc15b2e0 con 0x7fa4bc0cb1a0 2023-10-10T22:37:48.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.918+0000 7fa4c119a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa4bc15a8a0 0x7fa4bc06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56188/0 (socket says 172.21.15.154:56188) 2023-10-10T22:37:48.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.918+0000 7fa4c119a700 1 -- 172.21.15.154:0/2130557117 learned_addr learned my addr 172.21.15.154:0/2130557117 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:48.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.919+0000 7fa4c199b700 1 --2- 172.21.15.154:0/2130557117 >> v2:172.21.15.179:3300/0 conn(0x7fa4bc0cb1a0 0x7fa4bc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.919+0000 7fa4c0999700 1 -- 172.21.15.154:0/2130557117 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966118346 0 0) 0x7fa4bc06ebd0 con 0x7fa4bc15a8a0 2023-10-10T22:37:48.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.919+0000 7fa4c0999700 1 -- 172.21.15.154:0/2130557117 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a8003570 con 0x7fa4bc15a8a0 2023-10-10T22:37:48.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.919+0000 7fa4c199b700 1 -- 172.21.15.154:0/2130557117 >> v1:172.21.15.179:6789/0 conn(0x7fa4bc0ae0d0 legacy=0x7fa4bc0ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.919+0000 7fa4c0999700 1 -- 172.21.15.154:0/2130557117 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338278080 0 0) 0x7fa4bc15ad20 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.919+0000 7fa4c199b700 1 -- 172.21.15.154:0/2130557117 >> v1:172.21.15.154:6789/0 conn(0x7fa4bc15a8a0 legacy=0x7fa4bc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.919+0000 7fa4c199b700 1 -- 172.21.15.154:0/2130557117 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc15b000 con 0x7fa4bc0cb1a0 2023-10-10T22:37:48.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.919+0000 7fa4c199b700 1 --2- 172.21.15.154:0/2130557117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4bc0cb1a0 0x7fa4bc15a360 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80098e0 tx=0x7fa4b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca5e6d30d150dce server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:48.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c0999700 1 -- 172.21.15.154:0/2130557117 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800b6d0 con 0x7fa4bc0cb1a0 2023-10-10T22:37:48.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c0999700 1 -- 172.21.15.154:0/2130557117 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b800b830 con 0x7fa4bc0cb1a0 2023-10-10T22:37:48.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c0999700 1 -- 172.21.15.154:0/2130557117 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800bbd0 con 0x7fa4bc0cb1a0 2023-10-10T22:37:48.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c299d700 1 -- 172.21.15.154:0/2130557117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4bc0cb1a0 msgr2=0x7fa4bc15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c299d700 1 --2- 172.21.15.154:0/2130557117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4bc0cb1a0 0x7fa4bc15a360 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80098e0 tx=0x7fa4b80091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c299d700 1 -- 172.21.15.154:0/2130557117 shutdown_connections 2023-10-10T22:37:48.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c299d700 1 --2- 172.21.15.154:0/2130557117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4bc0cb1a0 0x7fa4bc15a360 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c299d700 1 -- 172.21.15.154:0/2130557117 >> 172.21.15.154:0/2130557117 conn(0x7fa4bc0cc1e0 msgr2=0x7fa4bc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:48.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c299d700 1 -- 172.21.15.154:0/2130557117 shutdown_connections 2023-10-10T22:37:48.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.920+0000 7fa4c299d700 1 -- 172.21.15.154:0/2130557117 wait complete. 2023-10-10T22:37:48.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.922+0000 7fa4c299d700 1 Processor -- start 2023-10-10T22:37:48.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.922+0000 7fa4c299d700 1 -- start start 2023-10-10T22:37:48.927 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:48.923+0000 7ff84736b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-10T22:37:48.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c299d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4bc0ae0d0 0x7fa4bc156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4bc0cb1a0 0x7fa4bc15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4bc160890 0x7fa4bc0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c299d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15e040 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15c390 con 0x7fa4bc160890 2023-10-10T22:37:48.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc156560 con 0x7fa4bc0cb1a0 2023-10-10T22:37:48.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4bc0ae0d0 0x7fa4bc156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4bc0ae0d0 0x7fa4bc156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52338/0 (socket says 172.21.15.154:52338) 2023-10-10T22:37:48.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c199b700 1 -- 172.21.15.154:0/2769508483 learned_addr learned my addr 172.21.15.154:0/2769508483 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:48.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c119a700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4bc0cb1a0 0x7fa4bc15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.923+0000 7fa4c219c700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4bc160890 0x7fa4bc0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:48.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4c199b700 1 -- 172.21.15.154:0/2769508483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4bc0cb1a0 msgr2=0x7fa4bc15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4c199b700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4bc0cb1a0 0x7fa4bc15eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4c199b700 1 -- 172.21.15.154:0/2769508483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4bc160890 msgr2=0x7fa4bc0c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:48.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4c199b700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4bc160890 0x7fa4bc0c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:48.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4c199b700 1 -- 172.21.15.154:0/2769508483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8009420 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4c199b700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4bc0ae0d0 0x7fa4bc156020 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80093f0 tx=0x7fa4b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:48.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4b1ffb700 1 -- 172.21.15.154:0/2769508483 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b801f070 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4b1ffb700 1 -- 172.21.15.154:0/2769508483 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8000bc0 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc15b4a0 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4b1ffb700 1 -- 172.21.15.154:0/2769508483 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800bbd0 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.924+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc15ba60 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.926+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc06c450 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.927+0000 7fa4b1ffb700 1 -- 172.21.15.154:0/2769508483 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa4b8023070 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.927+0000 7fa4b1ffb700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa4a00670e0 0x7fa4a0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:48.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.928+0000 7fa4b1ffb700 1 -- 172.21.15.154:0/2769508483 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fa4b8085d70 con 0x7fa4bc0ae0d0 2023-10-10T22:37:48.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.928+0000 7fa4c119a700 1 -- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa4a00670e0 msgr2=0x7fa4a0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:48.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.928+0000 7fa4c119a700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa4a00670e0 0x7fa4a0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:48.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:48.932+0000 7fa4b1ffb700 1 -- 172.21.15.154:0/2769508483 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4b8052a50 con 0x7fa4bc0ae0d0 2023-10-10T22:37:49.046 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:49.045+0000 7ff84736b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-10T22:37:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.129+0000 7fa4c119a700 1 -- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa4a00670e0 msgr2=0x7fa4a0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.129+0000 7fa4c119a700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa4a00670e0 0x7fa4a0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:49.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.152+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4bc06e860 con 0x7fa4bc0ae0d0 2023-10-10T22:37:49.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.153+0000 7fa4b1ffb700 1 -- 172.21.15.154:0/2769508483 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v210) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4b8006cb0 con 0x7fa4bc0ae0d0 2023-10-10T22:37:49.155 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-10-10T22:37:49.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa4a00670e0 msgr2=0x7fa4a0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:49.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa4a00670e0 0x7fa4a0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4bc0ae0d0 msgr2=0x7fa4bc156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4bc0ae0d0 0x7fa4bc156020 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80093f0 tx=0x7fa4b8017000 comp rx=0 tx=0).stop 2023-10-10T22:37:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 shutdown_connections 2023-10-10T22:37:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fa4a00670e0 0x7fa4a0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4bc160890 0x7fa4bc0c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4bc0ae0d0 0x7fa4bc156020 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 --2- 172.21.15.154:0/2769508483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4bc0cb1a0 0x7fa4bc15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 >> 172.21.15.154:0/2769508483 conn(0x7fa4bc0cc1e0 msgr2=0x7fa4bc0af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 shutdown_connections 2023-10-10T22:37:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.155+0000 7fa4c299d700 1 -- 172.21.15.154:0/2769508483 wait complete. 2023-10-10T22:37:49.177 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:49.375 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:49.374+0000 7f7198074180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:37:49.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.408+0000 7fad41d9d700 1 Processor -- start 2023-10-10T22:37:49.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.408+0000 7fad41d9d700 1 -- start start 2023-10-10T22:37:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.409+0000 7fad41d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c0c6c60 0x7fad3c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.409+0000 7fad41d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3c0b1410 con 0x7fad3c06e8c0 2023-10-10T22:37:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.409+0000 7fad41d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3c063230 con 0x7fad3c1595a0 2023-10-10T22:37:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.409+0000 7fad41d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0b2b90 con 0x7fad3c0c6c60 2023-10-10T22:37:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad4159c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fad3c06e8c0 0x7fad3c159970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56190/0 (socket says 172.21.15.154:56190) 2023-10-10T22:37:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad4159c700 1 -- 172.21.15.154:0/1234817421 learned_addr learned my addr 172.21.15.154:0/1234817421 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad3bfff700 1 --2- 172.21.15.154:0/1234817421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c0c6c60 0x7fad3c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:49.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad3b7fe700 1 -- 172.21.15.154:0/1234817421 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267344036 0 0) 0x7fad3c0b1410 con 0x7fad3c06e8c0 2023-10-10T22:37:49.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad3b7fe700 1 -- 172.21.15.154:0/1234817421 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2c003570 con 0x7fad3c06e8c0 2023-10-10T22:37:49.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad3b7fe700 1 -- 172.21.15.154:0/1234817421 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153268280 0 0) 0x7fad3c063230 con 0x7fad3c1595a0 2023-10-10T22:37:49.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad3b7fe700 1 -- 172.21.15.154:0/1234817421 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c0b1410 con 0x7fad3c1595a0 2023-10-10T22:37:49.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad3bfff700 1 -- 172.21.15.154:0/1234817421 >> v1:172.21.15.179:6789/0 conn(0x7fad3c1595a0 legacy=0x7fad3c0b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad3bfff700 1 -- 172.21.15.154:0/1234817421 >> v1:172.21.15.154:6789/0 conn(0x7fad3c06e8c0 legacy=0x7fad3c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.410+0000 7fad3bfff700 1 -- 172.21.15.154:0/1234817421 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0634f0 con 0x7fad3c0c6c60 2023-10-10T22:37:49.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.411+0000 7fad3bfff700 1 --2- 172.21.15.154:0/1234817421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c0c6c60 0x7fad3c0c8120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fad28009910 tx=0x7fad280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6caf8e0fc072b6b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:49.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.411+0000 7fad3b7fe700 1 -- 172.21.15.154:0/1234817421 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28011630 con 0x7fad3c0c6c60 2023-10-10T22:37:49.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.411+0000 7fad3b7fe700 1 -- 172.21.15.154:0/1234817421 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad28011790 con 0x7fad3c0c6c60 2023-10-10T22:37:49.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.411+0000 7fad3b7fe700 1 -- 172.21.15.154:0/1234817421 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28011b30 con 0x7fad3c0c6c60 2023-10-10T22:37:49.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.411+0000 7fad41d9d700 1 -- 172.21.15.154:0/1234817421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c0c6c60 msgr2=0x7fad3c0c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.411+0000 7fad41d9d700 1 --2- 172.21.15.154:0/1234817421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c0c6c60 0x7fad3c0c8120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fad28009910 tx=0x7fad280091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.411+0000 7fad41d9d700 1 -- 172.21.15.154:0/1234817421 shutdown_connections 2023-10-10T22:37:49.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.411+0000 7fad41d9d700 1 --2- 172.21.15.154:0/1234817421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c0c6c60 0x7fad3c0c8120 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.411+0000 7fad41d9d700 1 -- 172.21.15.154:0/1234817421 >> 172.21.15.154:0/1234817421 conn(0x7fad3c06ddb0 msgr2=0x7fad3c06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:49.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.412+0000 7fad41d9d700 1 -- 172.21.15.154:0/1234817421 shutdown_connections 2023-10-10T22:37:49.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.412+0000 7fad41d9d700 1 -- 172.21.15.154:0/1234817421 wait complete. 2023-10-10T22:37:49.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.413+0000 7fad41d9d700 1 Processor -- start 2023-10-10T22:37:49.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.413+0000 7fad41d9d700 1 -- start start 2023-10-10T22:37:49.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad41d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c06e8c0 0x7fad3c15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad41d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad3c0c6c60 0x7fad3c169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad41d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad3c1595a0 0x7fad3c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad41d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0c5910 con 0x7fad3c1595a0 2023-10-10T22:37:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad41d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c15bb70 con 0x7fad3c0c6c60 2023-10-10T22:37:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad41d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c152500 con 0x7fad3c06e8c0 2023-10-10T22:37:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad4159c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad3c1595a0 0x7fad3c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad3bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad3c0c6c60 0x7fad3c169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad4159c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad3c1595a0 0x7fad3c151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52340/0 (socket says 172.21.15.154:52340) 2023-10-10T22:37:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad4159c700 1 -- 172.21.15.154:0/1959933512 learned_addr learned my addr 172.21.15.154:0/1959933512 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.414+0000 7fad40d9b700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c06e8c0 0x7fad3c15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad4159c700 1 -- 172.21.15.154:0/1959933512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c06e8c0 msgr2=0x7fad3c15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad4159c700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c06e8c0 0x7fad3c15a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad4159c700 1 -- 172.21.15.154:0/1959933512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad3c0c6c60 msgr2=0x7fad3c169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad4159c700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad3c0c6c60 0x7fad3c169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad4159c700 1 -- 172.21.15.154:0/1959933512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad28009420 con 0x7fad3c1595a0 2023-10-10T22:37:49.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad4159c700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad3c1595a0 0x7fad3c151fc0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fad3400cd00 tx=0x7fad34001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:49.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad38ff9700 1 -- 172.21.15.154:0/1959933512 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3400ce00 con 0x7fad3c1595a0 2023-10-10T22:37:49.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad38ff9700 1 -- 172.21.15.154:0/1959933512 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3400aac0 con 0x7fad3c1595a0 2023-10-10T22:37:49.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad38ff9700 1 -- 172.21.15.154:0/1959933512 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3400ae80 con 0x7fad3c1595a0 2023-10-10T22:37:49.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3c16a360 con 0x7fad3c1595a0 2023-10-10T22:37:49.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.415+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3c16a920 con 0x7fad3c1595a0 2023-10-10T22:37:49.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.416+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3c0c56e0 con 0x7fad3c1595a0 2023-10-10T22:37:49.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.417+0000 7fad38ff9700 1 -- 172.21.15.154:0/1959933512 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fad34007300 con 0x7fad3c1595a0 2023-10-10T22:37:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.419+0000 7fad38ff9700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fad200670e0 0x7fad20069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.419+0000 7fad40d9b700 1 -- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fad200670e0 msgr2=0x7fad20069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.419+0000 7fad38ff9700 1 -- 172.21.15.154:0/1959933512 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fad34084f30 con 0x7fad3c1595a0 2023-10-10T22:37:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.419+0000 7fad40d9b700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fad200670e0 0x7fad20069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.423+0000 7fad38ff9700 1 -- 172.21.15.154:0/1959933512 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad3c0c56e0 con 0x7fad3c1595a0 2023-10-10T22:37:49.470 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:49.470+0000 7f7198074180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:37:49.560 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:49.559+0000 7f7198074180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:37:49.560 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:49.558+0000 7ff84736b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-10T22:37:49.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.620+0000 7fad40d9b700 1 -- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fad200670e0 msgr2=0x7fad20069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:49.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.620+0000 7fad40d9b700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fad200670e0 0x7fad20069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:49.659 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:49.658+0000 7ff84736b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-10T22:37:49.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.671+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad3c0c56e0 con 0x7fad3c1595a0 2023-10-10T22:37:49.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.671+0000 7fad38ff9700 1 -- 172.21.15.154:0/1959933512 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4618 (secure 0 0 0) 0x7fad3c0c56e0 con 0x7fad3c1595a0 2023-10-10T22:37:49.673 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:49.673 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1468165521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1468165521},{"type":"v1","addr":"172.21.15.179:6834","nonce":1468165521}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1270073932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1270073932},{"type":"v1","addr":"172.21.15.154:6834","nonce":1270073932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2994571754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2994571754},{"type":"v1","addr":"172.21.15.154:6835","nonce":2994571754}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:37:21.762982+0000","modified":"2023-10-10T22:37:25.332647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10182":{"gid":10182,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1275463629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1275463629},{"type":"v1","addr":"172.21.15.179:6835","nonce":1275463629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-10T22:37:49.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fad200670e0 msgr2=0x7fad20069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:49.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fad200670e0 0x7fad20069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad3c1595a0 msgr2=0x7fad3c151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad3c1595a0 0x7fad3c151fc0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fad3400cd00 tx=0x7fad34001ac0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 shutdown_connections 2023-10-10T22:37:49.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fad200670e0 0x7fad20069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad3c1595a0 0x7fad3c151fc0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3c06e8c0 0x7fad3c15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 --2- 172.21.15.154:0/1959933512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad3c0c6c60 0x7fad3c169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 >> 172.21.15.154:0/1959933512 conn(0x7fad3c06ddb0 msgr2=0x7fad3c153dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:49.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 shutdown_connections 2023-10-10T22:37:49.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.674+0000 7fad41d9d700 1 -- 172.21.15.154:0/1959933512 wait complete. 2023-10-10T22:37:49.678 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 94 2023-10-10T22:37:49.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:49.756 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:49.755+0000 7ff84736b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.880+0000 7f59ac9fe700 1 Processor -- start 2023-10-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.880+0000 7f59ac9fe700 1 -- start start 2023-10-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.881+0000 7f59ac9fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f59a81597f0 0x7f59a80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.881+0000 7f59ac9fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59a815d230 0x7f59a815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.881+0000 7f59ac9fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a815db70 con 0x7f59a8159420 2023-10-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.881+0000 7f59ac9fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a80b11d0 con 0x7f59a81597f0 2023-10-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.881+0000 7f59ac9fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a80b14b0 con 0x7f59a815d230 2023-10-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.882+0000 7f59a659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f59a81597f0 0x7f59a80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.882+0000 7f59a659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f59a81597f0 0x7f59a80b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52342/0 (socket says 172.21.15.154:52342) 2023-10-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.882+0000 7f59a759e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59a815d230 0x7f59a815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.882+0000 7f59a659c700 1 -- 172.21.15.154:0/203746405 learned_addr learned my addr 172.21.15.154:0/203746405 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.882+0000 7f59a659c700 1 -- 172.21.15.154:0/203746405 >> v2:172.21.15.179:3300/0 conn(0x7f59a815d230 msgr2=0x7f59a815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.882+0000 7f59a659c700 1 --2- 172.21.15.154:0/203746405 >> v2:172.21.15.179:3300/0 conn(0x7f59a815d230 0x7f59a815d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.882+0000 7f59a659c700 1 -- 172.21.15.154:0/203746405 >> v1:172.21.15.179:6789/0 conn(0x7f59a8159420 legacy=0x7f59a80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.882+0000 7f59a659c700 1 -- 172.21.15.154:0/203746405 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80b1790 con 0x7f59a81597f0 2023-10-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.882+0000 7f59a659c700 1 --2- 172.21.15.154:0/203746405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 0x7f59a80b2270 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f59a815d170 tx=0x7f599c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3b9557f0a59313 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59a5d9b700 1 -- 172.21.15.154:0/203746405 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c009e70 con 0x7f59a81597f0 2023-10-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59a5d9b700 1 -- 172.21.15.154:0/203746405 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c00b860 con 0x7f59a81597f0 2023-10-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59a5d9b700 1 -- 172.21.15.154:0/203746405 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00bc00 con 0x7f59a81597f0 2023-10-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59ac9fe700 1 -- 172.21.15.154:0/203746405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 msgr2=0x7f59a80b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59ac9fe700 1 --2- 172.21.15.154:0/203746405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 0x7f59a80b2270 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f59a815d170 tx=0x7f599c009250 comp rx=0 tx=0).stop 2023-10-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59ac9fe700 1 -- 172.21.15.154:0/203746405 shutdown_connections 2023-10-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59ac9fe700 1 --2- 172.21.15.154:0/203746405 >> v2:172.21.15.179:3300/0 conn(0x7f59a815d230 0x7f59a815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59ac9fe700 1 --2- 172.21.15.154:0/203746405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 0x7f59a80b2270 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59ac9fe700 1 -- 172.21.15.154:0/203746405 >> 172.21.15.154:0/203746405 conn(0x7f59a80d0660 msgr2=0x7f59a80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59ac9fe700 1 -- 172.21.15.154:0/203746405 shutdown_connections 2023-10-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.883+0000 7f59ac9fe700 1 -- 172.21.15.154:0/203746405 wait complete. 2023-10-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.885+0000 7f59ac9fe700 1 Processor -- start 2023-10-10T22:37:49.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.885+0000 7f59ac9fe700 1 -- start start 2023-10-10T22:37:49.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59ac9fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a8159420 0x7f59a8148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59ac9fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 0x7f59a80c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59ac9fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a815d230 0x7f59a80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59ac9fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a815d010 con 0x7f59a81597f0 2023-10-10T22:37:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59ac9fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a8148640 con 0x7f59a8159420 2023-10-10T22:37:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59ac9fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a815c400 con 0x7f59a815d230 2023-10-10T22:37:49.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59a659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 0x7f59a80c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:49.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59a659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 0x7f59a80c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52350/0 (socket says 172.21.15.154:52350) 2023-10-10T22:37:49.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59a659c700 1 -- 172.21.15.154:0/945003429 learned_addr learned my addr 172.21.15.154:0/945003429 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:49.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59a6d9d700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a8159420 0x7f59a8148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:49.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.886+0000 7f59a759e700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a815d230 0x7f59a80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f59a659c700 1 -- 172.21.15.154:0/945003429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a815d230 msgr2=0x7f59a80b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f59a659c700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a815d230 0x7f59a80b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f59a659c700 1 -- 172.21.15.154:0/945003429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a8159420 msgr2=0x7f59a8148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f59a659c700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a8159420 0x7f59a8148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f59a659c700 1 -- 172.21.15.154:0/945003429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c0094f0 con 0x7f59a81597f0 2023-10-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f59a659c700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 0x7f59a80c5c80 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f59a8089340 tx=0x7f599c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f598effd700 1 -- 172.21.15.154:0/945003429 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00bbe0 con 0x7f59a81597f0 2023-10-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f598effd700 1 -- 172.21.15.154:0/945003429 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c011420 con 0x7f59a81597f0 2023-10-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f598effd700 1 -- 172.21.15.154:0/945003429 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0117c0 con 0x7f59a81597f0 2023-10-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a815c6e0 con 0x7f59a81597f0 2023-10-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.887+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a815cca0 con 0x7f59a81597f0 2023-10-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.888+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a804c3c0 con 0x7f59a81597f0 2023-10-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.889+0000 7f598effd700 1 -- 172.21.15.154:0/945003429 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f599c011bf0 con 0x7f59a81597f0 2023-10-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.890+0000 7f598effd700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59940670e0 0x7f5994069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.890+0000 7f598effd700 1 -- 172.21.15.154:0/945003429 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f599c0860b0 con 0x7f59a81597f0 2023-10-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.890+0000 7f59a6d9d700 1 -- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59940670e0 msgr2=0x7f5994069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.890+0000 7f59a6d9d700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59940670e0 0x7f5994069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:49.895+0000 7f598effd700 1 -- 172.21.15.154:0/945003429 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f599c052cf0 con 0x7f59a81597f0 2023-10-10T22:37:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.091+0000 7f59a6d9d700 1 -- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59940670e0 msgr2=0x7f5994069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.091+0000 7f59a6d9d700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59940670e0 0x7f5994069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:50.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.096+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59a80b1a70 con 0x7f59a81597f0 2023-10-10T22:37:50.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.097+0000 7f598effd700 1 -- 172.21.15.154:0/945003429 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v210) v1 ==== 74+0+16589 (secure 0 0 0) 0x7f599c056310 con 0x7f59a81597f0 2023-10-10T22:37:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:50.099 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":210,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:42.558280+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:37:19.912253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-10T22:37:20.749030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3458335740":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/3394882299":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/1691610567":"2023-10-11T22:37:42.558235+0000","172.21.15.154:6837/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:6836/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/4135556396":"2023-10-11T22:37:42.558235+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:50.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59940670e0 msgr2=0x7f5994069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:50.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59940670e0 0x7f5994069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 msgr2=0x7f59a80c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 0x7f59a80c5c80 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f59a8089340 tx=0x7f599c017000 comp rx=0 tx=0).stop 2023-10-10T22:37:50.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 shutdown_connections 2023-10-10T22:37:50.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59940670e0 0x7f5994069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a815d230 0x7f59a80b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a8159420 0x7f59a8148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 --2- 172.21.15.154:0/945003429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59a81597f0 0x7f59a80c5c80 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 >> 172.21.15.154:0/945003429 conn(0x7f59a80d0660 msgr2=0x7f59a8069830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:50.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 shutdown_connections 2023-10-10T22:37:50.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.099+0000 7f59ac9fe700 1 -- 172.21.15.154:0/945003429 wait complete. 2023-10-10T22:37:50.119 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T22:37:50.120 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:50.187 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:50.186+0000 7f7198074180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:37:50.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.328+0000 7f465ffff700 1 Processor -- start 2023-10-10T22:37:50.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.329+0000 7f465ffff700 1 -- start start 2023-10-10T22:37:50.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.331+0000 7f465ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f466015daa0 0x7f466006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.331+0000 7f465ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f466015de70 0x7f46600c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.331+0000 7f465ffff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466006e8c0 con 0x7f46600696c0 2023-10-10T22:37:50.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.331+0000 7f465ffff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46600ca740 con 0x7f466015de70 2023-10-10T22:37:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.331+0000 7f465ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466006e5e0 con 0x7f466015daa0 2023-10-10T22:37:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.331+0000 7f465effd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f466015daa0 0x7f466006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.331+0000 7f465effd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f466015daa0 0x7f466006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:55686/0 (socket says 172.21.15.154:55686) 2023-10-10T22:37:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.331+0000 7f465effd700 1 -- 172.21.15.154:0/3626343555 learned_addr learned my addr 172.21.15.154:0/3626343555 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.332+0000 7f465effd700 1 -- 172.21.15.154:0/3626343555 >> v2:172.21.15.154:3300/0 conn(0x7f466015de70 msgr2=0x7f46600c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.332+0000 7f465effd700 1 --2- 172.21.15.154:0/3626343555 >> v2:172.21.15.154:3300/0 conn(0x7f466015de70 0x7f46600c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.332+0000 7f465effd700 1 -- 172.21.15.154:0/3626343555 >> v1:172.21.15.154:6789/0 conn(0x7f46600696c0 legacy=0x7f466006ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.332+0000 7f465effd700 1 -- 172.21.15.154:0/3626343555 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600ca0f0 con 0x7f466015daa0 2023-10-10T22:37:50.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.332+0000 7f465effd700 1 --2- 172.21.15.154:0/3626343555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f466015daa0 0x7f466006e000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f46580099b0 tx=0x7f4658009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4642a1dde818b2d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:50.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.332+0000 7f465dffb700 1 -- 172.21.15.154:0/3626343555 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465800b860 con 0x7f466015daa0 2023-10-10T22:37:50.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.333+0000 7f465dffb700 1 -- 172.21.15.154:0/3626343555 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465800b9c0 con 0x7f466015daa0 2023-10-10T22:37:50.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.333+0000 7f465dffb700 1 -- 172.21.15.154:0/3626343555 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465800bd60 con 0x7f466015daa0 2023-10-10T22:37:50.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.333+0000 7f465ffff700 1 -- 172.21.15.154:0/3626343555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f466015daa0 msgr2=0x7f466006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.333+0000 7f465ffff700 1 --2- 172.21.15.154:0/3626343555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f466015daa0 0x7f466006e000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f46580099b0 tx=0x7f4658009250 comp rx=0 tx=0).stop 2023-10-10T22:37:50.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.333+0000 7f465ffff700 1 -- 172.21.15.154:0/3626343555 shutdown_connections 2023-10-10T22:37:50.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.333+0000 7f465ffff700 1 --2- 172.21.15.154:0/3626343555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f466015daa0 0x7f466006e000 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.333+0000 7f465ffff700 1 --2- 172.21.15.154:0/3626343555 >> v2:172.21.15.154:3300/0 conn(0x7f466015de70 0x7f46600c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.333+0000 7f465ffff700 1 -- 172.21.15.154:0/3626343555 >> 172.21.15.154:0/3626343555 conn(0x7f46600cc1f0 msgr2=0x7f46600cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:50.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.334+0000 7f465ffff700 1 -- 172.21.15.154:0/3626343555 shutdown_connections 2023-10-10T22:37:50.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.334+0000 7f465ffff700 1 -- 172.21.15.154:0/3626343555 wait complete. 2023-10-10T22:37:50.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.336+0000 7f465ffff700 1 Processor -- start 2023-10-10T22:37:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.337+0000 7f465ffff700 1 -- start start 2023-10-10T22:37:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.338+0000 7f465ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600696c0 0x7f466015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.338+0000 7f465ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f466015daa0 0x7f466013d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.338+0000 7f465ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466015de70 0x7f466013e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.339+0000 7f465effd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600696c0 0x7f466015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.339+0000 7f465effd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600696c0 0x7f466015ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:55696/0 (socket says 172.21.15.154:55696) 2023-10-10T22:37:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.339+0000 7f465e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f466015daa0 0x7f466013d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.339+0000 7f465e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f466015daa0 0x7f466013d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52378/0 (socket says 172.21.15.154:52378) 2023-10-10T22:37:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.339+0000 7f465effd700 1 -- 172.21.15.154:0/3671346593 learned_addr learned my addr 172.21.15.154:0/3671346593 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.339+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466013cc90 con 0x7f466015daa0 2023-10-10T22:37:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.339+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466013c080 con 0x7f466015de70 2023-10-10T22:37:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.339+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466013c360 con 0x7f46600696c0 2023-10-10T22:37:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.340+0000 7f465f7fe700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466015de70 0x7f466013e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.340+0000 7f465effd700 1 -- 172.21.15.154:0/3671346593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466015de70 msgr2=0x7f466013e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.340+0000 7f465effd700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466015de70 0x7f466013e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.340+0000 7f465effd700 1 -- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f466015daa0 msgr2=0x7f466013d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.340+0000 7f465effd700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f466015daa0 0x7f466013d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.340+0000 7f465effd700 1 -- 172.21.15.154:0/3671346593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46580094f0 con 0x7f46600696c0 2023-10-10T22:37:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.340+0000 7f465f7fe700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466015de70 0x7f466013e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.340+0000 7f465effd700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600696c0 0x7f466015ced0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4658009fd0 tx=0x7f4658017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.341+0000 7f4656ffd700 1 -- 172.21.15.154:0/3671346593 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658011e20 con 0x7f46600696c0 2023-10-10T22:37:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.341+0000 7f4656ffd700 1 -- 172.21.15.154:0/3671346593 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465801f070 con 0x7f46600696c0 2023-10-10T22:37:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.341+0000 7f4656ffd700 1 -- 172.21.15.154:0/3671346593 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580266d0 con 0x7f46600696c0 2023-10-10T22:37:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.341+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466013c640 con 0x7f46600696c0 2023-10-10T22:37:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.341+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466013d660 con 0x7f46600696c0 2023-10-10T22:37:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.343+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466004c3c0 con 0x7f46600696c0 2023-10-10T22:37:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.344+0000 7f4656ffd700 1 -- 172.21.15.154:0/3671346593 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f465801a430 con 0x7f46600696c0 2023-10-10T22:37:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.346+0000 7f4656ffd700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4640067230 0x7f46400696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.346+0000 7f4656ffd700 1 -- 172.21.15.154:0/3671346593 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f4658021070 con 0x7f46600696c0 2023-10-10T22:37:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.346+0000 7f465e7fc700 1 -- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4640067230 msgr2=0x7f46400696e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:50.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.346+0000 7f465e7fc700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4640067230 0x7f46400696e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:50.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.350+0000 7f4656ffd700 1 -- 172.21.15.154:0/3671346593 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4658053510 con 0x7f46600696c0 2023-10-10T22:37:50.361 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:50.361+0000 7f7198074180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:50.415 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:50.414+0000 7ff84736b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-10T22:37:50.457 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:50.456+0000 7f7198074180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:37:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.547+0000 7f465e7fc700 1 -- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4640067230 msgr2=0x7f46400696e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.547+0000 7f465e7fc700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4640067230 0x7f46400696e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:50.595 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:50.594+0000 7ff84736b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-10T22:37:50.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.596+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46600ca3d0 con 0x7f46600696c0 2023-10-10T22:37:50.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.596+0000 7f4656ffd700 1 -- 172.21.15.154:0/3671346593 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f4658056b30 con 0x7f46600696c0 2023-10-10T22:37:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:50.598 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1468165521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1468165521},{"type":"v1","addr":"172.21.15.179:6834","nonce":1468165521}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1270073932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1270073932},{"type":"v1","addr":"172.21.15.154:6834","nonce":1270073932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2994571754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2994571754},{"type":"v1","addr":"172.21.15.154:6835","nonce":2994571754}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:37:21.762982+0000","modified":"2023-10-10T22:37:25.332647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10182":{"gid":10182,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1275463629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1275463629},{"type":"v1","addr":"172.21.15.179:6835","nonce":1275463629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-10T22:37:50.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4640067230 msgr2=0x7f46400696e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4640067230 0x7f46400696e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600696c0 msgr2=0x7f466015ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600696c0 0x7f466015ced0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4658009fd0 tx=0x7f4658017000 comp rx=0 tx=0).stop 2023-10-10T22:37:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 shutdown_connections 2023-10-10T22:37:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4640067230 0x7f46400696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466015de70 0x7f466013e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46600696c0 0x7f466015ced0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 --2- 172.21.15.154:0/3671346593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f466015daa0 0x7f466013d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 >> 172.21.15.154:0/3671346593 conn(0x7f46600cc1f0 msgr2=0x7f4660069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:50.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 shutdown_connections 2023-10-10T22:37:50.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.599+0000 7f465ffff700 1 -- 172.21.15.154:0/3671346593 wait complete. 2023-10-10T22:37:50.603 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 94 2023-10-10T22:37:50.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:37:50.698 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:50.697+0000 7ff84736b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-10T22:37:50.751 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:50.750+0000 7f7198074180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:37:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.806+0000 7f018519d700 1 Processor -- start 2023-10-10T22:37:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.806+0000 7f018519d700 1 -- start start 2023-10-10T22:37:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.808+0000 7f018519d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01801597f0 0x7f01800b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.808+0000 7f018519d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01800b11d0 con 0x7f018015d230 2023-10-10T22:37:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.808+0000 7f018519d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01800b14b0 con 0x7f0180159420 2023-10-10T22:37:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.808+0000 7f018519d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800b1790 con 0x7f01801597f0 2023-10-10T22:37:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.808+0000 7f018499c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f018015d230 0x7f018015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56204/0 (socket says 172.21.15.154:56204) 2023-10-10T22:37:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.808+0000 7f018499c700 1 -- 172.21.15.154:0/3960834976 learned_addr learned my addr 172.21.15.154:0/3960834976 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.808+0000 7f017f7fe700 1 --2- 172.21.15.154:0/3960834976 >> v2:172.21.15.179:3300/0 conn(0x7f01801597f0 0x7f01800b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.808+0000 7f017effd700 1 -- 172.21.15.154:0/3960834976 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516935888 0 0) 0x7f01800b11d0 con 0x7f018015d230 2023-10-10T22:37:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.808+0000 7f017effd700 1 -- 172.21.15.154:0/3960834976 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0168003570 con 0x7f018015d230 2023-10-10T22:37:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.809+0000 7f017f7fe700 1 -- 172.21.15.154:0/3960834976 >> v1:172.21.15.179:6789/0 conn(0x7f0180159420 legacy=0x7f01800b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.809+0000 7f017f7fe700 1 -- 172.21.15.154:0/3960834976 >> v1:172.21.15.154:6789/0 conn(0x7f018015d230 legacy=0x7f018015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.809+0000 7f017f7fe700 1 -- 172.21.15.154:0/3960834976 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800b1a70 con 0x7f01801597f0 2023-10-10T22:37:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.809+0000 7f017f7fe700 1 --2- 172.21.15.154:0/3960834976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 0x7f01800b2270 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f01740098e0 tx=0x7f01740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5672f56650cfc267 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.809+0000 7f017effd700 1 -- 172.21.15.154:0/3960834976 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017400b640 con 0x7f01801597f0 2023-10-10T22:37:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.809+0000 7f017effd700 1 -- 172.21.15.154:0/3960834976 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017400b7a0 con 0x7f01801597f0 2023-10-10T22:37:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.809+0000 7f017effd700 1 -- 172.21.15.154:0/3960834976 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017400bb40 con 0x7f01801597f0 2023-10-10T22:37:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.810+0000 7f018519d700 1 -- 172.21.15.154:0/3960834976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 msgr2=0x7f01800b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.810+0000 7f018519d700 1 --2- 172.21.15.154:0/3960834976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 0x7f01800b2270 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f01740098e0 tx=0x7f01740091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.810+0000 7f018519d700 1 -- 172.21.15.154:0/3960834976 shutdown_connections 2023-10-10T22:37:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.810+0000 7f018519d700 1 --2- 172.21.15.154:0/3960834976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 0x7f01800b2270 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.810+0000 7f018519d700 1 -- 172.21.15.154:0/3960834976 >> 172.21.15.154:0/3960834976 conn(0x7f01800d0660 msgr2=0x7f01800d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.810+0000 7f018519d700 1 -- 172.21.15.154:0/3960834976 shutdown_connections 2023-10-10T22:37:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.810+0000 7f018519d700 1 -- 172.21.15.154:0/3960834976 wait complete. 2023-10-10T22:37:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.811+0000 7f018519d700 1 Processor -- start 2023-10-10T22:37:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.812+0000 7f018519d700 1 -- start start 2023-10-10T22:37:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.812+0000 7f018519d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0180159420 0x7f01801544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.812+0000 7f018519d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 0x7f0180155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.812+0000 7f018519d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018015d230 0x7f0180156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.812+0000 7f018519d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800cadf0 con 0x7f018015d230 2023-10-10T22:37:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.812+0000 7f018519d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800cb0d0 con 0x7f01801597f0 2023-10-10T22:37:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.812+0000 7f018519d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01800cb3b0 con 0x7f0180159420 2023-10-10T22:37:50.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f018499c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018015d230 0x7f0180156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:50.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f018499c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018015d230 0x7f0180156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52392/0 (socket says 172.21.15.154:52392) 2023-10-10T22:37:50.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f018499c700 1 -- 172.21.15.154:0/415966559 learned_addr learned my addr 172.21.15.154:0/415966559 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:50.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f017ffff700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0180159420 0x7f01801544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:50.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f017f7fe700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 0x7f0180155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f017f7fe700 1 -- 172.21.15.154:0/415966559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0180159420 msgr2=0x7f01801544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f017f7fe700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0180159420 0x7f01801544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f017f7fe700 1 -- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018015d230 msgr2=0x7f0180156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f017f7fe700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018015d230 0x7f0180156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f017f7fe700 1 -- 172.21.15.154:0/415966559 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0174009420 con 0x7f01801597f0 2023-10-10T22:37:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.813+0000 7f018499c700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018015d230 0x7f0180156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.814+0000 7f017f7fe700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 0x7f0180155cf0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0174016000 tx=0x7f0174017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.814+0000 7f0167fff700 1 -- 172.21.15.154:0/415966559 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017400bb20 con 0x7f01801597f0 2023-10-10T22:37:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.814+0000 7f0167fff700 1 -- 172.21.15.154:0/415966559 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0174000c90 con 0x7f01801597f0 2023-10-10T22:37:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.814+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01800cb690 con 0x7f01801597f0 2023-10-10T22:37:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.814+0000 7f0167fff700 1 -- 172.21.15.154:0/415966559 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174011630 con 0x7f01801597f0 2023-10-10T22:37:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.814+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01800ca090 con 0x7f01801597f0 2023-10-10T22:37:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.815+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01800cb4f0 con 0x7f01801597f0 2023-10-10T22:37:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.816+0000 7f0167fff700 1 -- 172.21.15.154:0/415966559 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0174011a60 con 0x7f01801597f0 2023-10-10T22:37:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.817+0000 7f0167fff700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f016c0670e0 0x7f016c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.817+0000 7f0167fff700 1 -- 172.21.15.154:0/415966559 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f01740863d0 con 0x7f01801597f0 2023-10-10T22:37:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.817+0000 7f017ffff700 1 -- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f016c0670e0 msgr2=0x7f016c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.817+0000 7f017ffff700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f016c0670e0 0x7f016c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:50.821+0000 7f0167fff700 1 -- 172.21.15.154:0/415966559 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01800cb4f0 con 0x7f01801597f0 2023-10-10T22:37:50.847 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:50.847+0000 7f7198074180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:37:51.007 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:51.005+0000 7ff84736b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-10T22:37:51.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.018+0000 7f017ffff700 1 -- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f016c0670e0 msgr2=0x7f016c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:51.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.018+0000 7f017ffff700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f016c0670e0 0x7f016c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:51.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.067+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01800cb4f0 con 0x7f01801597f0 2023-10-10T22:37:51.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.068+0000 7f0167fff700 1 -- 172.21.15.154:0/415966559 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f01800cb4f0 con 0x7f01801597f0 2023-10-10T22:37:51.070 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:51.070 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1468165521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1468165521},{"type":"v1","addr":"172.21.15.179:6834","nonce":1468165521}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1270073932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1270073932},{"type":"v1","addr":"172.21.15.154:6834","nonce":1270073932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2994571754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2994571754},{"type":"v1","addr":"172.21.15.154:6835","nonce":2994571754}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-10T22:37:21.762982+0000","modified":"2023-10-10T22:37:25.332647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10182":{"gid":10182,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/1275463629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1275463629},{"type":"v1","addr":"172.21.15.179:6835","nonce":1275463629}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-10T22:37:51.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f016c0670e0 msgr2=0x7f016c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:51.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f016c0670e0 0x7f016c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 msgr2=0x7f0180155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 0x7f0180155cf0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0174016000 tx=0x7f0174017000 comp rx=0 tx=0).stop 2023-10-10T22:37:51.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 shutdown_connections 2023-10-10T22:37:51.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f016c0670e0 0x7f016c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f018015d230 0x7f0180156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0180159420 0x7f01801544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 --2- 172.21.15.154:0/415966559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01801597f0 0x7f0180155cf0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 >> 172.21.15.154:0/415966559 conn(0x7f01800d0660 msgr2=0x7f0180158660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:51.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 shutdown_connections 2023-10-10T22:37:51.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.071+0000 7f018519d700 1 -- 172.21.15.154:0/415966559 wait complete. 2023-10-10T22:37:51.075 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 94 2023-10-10T22:37:51.091 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:51.108 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:51.107+0000 7ff84736b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-10T22:37:51.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.278+0000 7f59ed99d700 1 Processor -- start 2023-10-10T22:37:51.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.278+0000 7f59ed99d700 1 -- start start 2023-10-10T22:37:51.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.279+0000 7f59ed99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59e806d950 0x7f59e80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.279+0000 7f59ed99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e806ae70 con 0x7f59e806a0a0 2023-10-10T22:37:51.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.279+0000 7f59ed99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e80c7a30 con 0x7f59e806dd20 2023-10-10T22:37:51.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.279+0000 7f59ed99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e806a540 con 0x7f59e806d950 2023-10-10T22:37:51.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.280+0000 7f59e7fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f59e806a0a0 0x7f59e80c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56214/0 (socket says 172.21.15.154:56214) 2023-10-10T22:37:51.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.280+0000 7f59e7fff700 1 -- 172.21.15.154:0/3211186585 learned_addr learned my addr 172.21.15.154:0/3211186585 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:51.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.280+0000 7f59ec99b700 1 --2- 172.21.15.154:0/3211186585 >> v2:172.21.15.179:3300/0 conn(0x7f59e806d950 0x7f59e80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.280+0000 7f59e77fe700 1 -- 172.21.15.154:0/3211186585 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581317364 0 0) 0x7f59e806ae70 con 0x7f59e806a0a0 2023-10-10T22:37:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.280+0000 7f59e77fe700 1 -- 172.21.15.154:0/3211186585 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d8003570 con 0x7f59e806a0a0 2023-10-10T22:37:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.280+0000 7f59ec99b700 1 -- 172.21.15.154:0/3211186585 >> v1:172.21.15.179:6789/0 conn(0x7f59e806dd20 legacy=0x7f59e80c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.280+0000 7f59ec99b700 1 -- 172.21.15.154:0/3211186585 >> v1:172.21.15.154:6789/0 conn(0x7f59e806a0a0 legacy=0x7f59e80c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.280+0000 7f59ec99b700 1 -- 172.21.15.154:0/3211186585 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e806a820 con 0x7f59e806d950 2023-10-10T22:37:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.281+0000 7f59ec99b700 1 --2- 172.21.15.154:0/3211186585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806d950 0x7f59e80c8350 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0098e0 tx=0x7f59dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=966a5029e1c30ff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.281+0000 7f59e77fe700 1 -- 172.21.15.154:0/3211186585 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00b640 con 0x7f59e806d950 2023-10-10T22:37:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.281+0000 7f59e77fe700 1 -- 172.21.15.154:0/3211186585 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc00b7a0 con 0x7f59e806d950 2023-10-10T22:37:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.281+0000 7f59e77fe700 1 -- 172.21.15.154:0/3211186585 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00bb40 con 0x7f59e806d950 2023-10-10T22:37:51.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.282+0000 7f59ed99d700 1 -- 172.21.15.154:0/3211186585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806d950 msgr2=0x7f59e80c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.282+0000 7f59ed99d700 1 --2- 172.21.15.154:0/3211186585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806d950 0x7f59e80c8350 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0098e0 tx=0x7f59dc0091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.282+0000 7f59ed99d700 1 -- 172.21.15.154:0/3211186585 shutdown_connections 2023-10-10T22:37:51.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.282+0000 7f59ed99d700 1 --2- 172.21.15.154:0/3211186585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806d950 0x7f59e80c8350 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.282+0000 7f59ed99d700 1 -- 172.21.15.154:0/3211186585 >> 172.21.15.154:0/3211186585 conn(0x7f59e80cc1f0 msgr2=0x7f59e80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:51.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.282+0000 7f59ed99d700 1 -- 172.21.15.154:0/3211186585 shutdown_connections 2023-10-10T22:37:51.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.282+0000 7f59ed99d700 1 -- 172.21.15.154:0/3211186585 wait complete. 2023-10-10T22:37:51.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.283+0000 7f59ed99d700 1 Processor -- start 2023-10-10T22:37:51.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.284+0000 7f59ed99d700 1 -- start start 2023-10-10T22:37:51.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.284+0000 7f59ed99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806a0a0 0x7f59e80b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.284+0000 7f59ed99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59e806d950 0x7f59e815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.284+0000 7f59ed99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59e806dd20 0x7f59e80c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.284+0000 7f59ed99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e815add0 con 0x7f59e806dd20 2023-10-10T22:37:51.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.284+0000 7f59ed99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80afa80 con 0x7f59e806a0a0 2023-10-10T22:37:51.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.284+0000 7f59ed99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80b11c0 con 0x7f59e806d950 2023-10-10T22:37:51.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ed19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59e806dd20 0x7f59e80c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:51.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ec99b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806a0a0 0x7f59e80b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:51.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ed19c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59e806dd20 0x7f59e80c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52408/0 (socket says 172.21.15.154:52408) 2023-10-10T22:37:51.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ed19c700 1 -- 172.21.15.154:0/1355578075 learned_addr learned my addr 172.21.15.154:0/1355578075 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:51.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59e7fff700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59e806d950 0x7f59e815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:51.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ec99b700 1 -- 172.21.15.154:0/1355578075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59e806d950 msgr2=0x7f59e815a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ec99b700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59e806d950 0x7f59e815a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ec99b700 1 -- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59e806dd20 msgr2=0x7f59e80c23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ec99b700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59e806dd20 0x7f59e80c23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ec99b700 1 -- 172.21.15.154:0/1355578075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc009420 con 0x7f59e806a0a0 2023-10-10T22:37:51.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ed19c700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59e806dd20 0x7f59e80c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:51.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.285+0000 7f59ec99b700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806a0a0 0x7f59e80b1a50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f59e806b0c0 tx=0x7f59dc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:51.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.286+0000 7f59e4ff9700 1 -- 172.21.15.154:0/1355578075 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00bb20 con 0x7f59e806a0a0 2023-10-10T22:37:51.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.286+0000 7f59e4ff9700 1 -- 172.21.15.154:0/1355578075 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc000c90 con 0x7f59e806a0a0 2023-10-10T22:37:51.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.286+0000 7f59e4ff9700 1 -- 172.21.15.154:0/1355578075 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc011630 con 0x7f59e806a0a0 2023-10-10T22:37:51.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.286+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e815aaf0 con 0x7f59e806a0a0 2023-10-10T22:37:51.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.286+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e80af710 con 0x7f59e806a0a0 2023-10-10T22:37:51.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.287+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e80af270 con 0x7f59e806a0a0 2023-10-10T22:37:51.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.288+0000 7f59e4ff9700 1 -- 172.21.15.154:0/1355578075 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f59dc0119a0 con 0x7f59e806a0a0 2023-10-10T22:37:51.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.289+0000 7f59e4ff9700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59cc0670e0 0x7f59cc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.289+0000 7f59e4ff9700 1 -- 172.21.15.154:0/1355578075 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f59dc085e10 con 0x7f59e806a0a0 2023-10-10T22:37:51.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.289+0000 7f59e7fff700 1 -- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59cc0670e0 msgr2=0x7f59cc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:51.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.289+0000 7f59e7fff700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59cc0670e0 0x7f59cc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:51.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.293+0000 7f59e4ff9700 1 -- 172.21.15.154:0/1355578075 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59dc089030 con 0x7f59e806a0a0 2023-10-10T22:37:51.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.490+0000 7f59e7fff700 1 -- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59cc0670e0 msgr2=0x7f59cc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:51.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.490+0000 7f59e7fff700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59cc0670e0 0x7f59cc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:51.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.495+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59e804c3c0 con 0x7f59e806a0a0 2023-10-10T22:37:51.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.496+0000 7f59e4ff9700 1 -- 172.21.15.154:0/1355578075 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v210) v1 ==== 74+0+16589 (secure 0 0 0) 0x7f59dc052ad0 con 0x7f59e806a0a0 2023-10-10T22:37:51.498 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:51.498 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":210,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:42.558280+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-10T22:37:19.912253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"208","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-10T22:37:20.749030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3458335740":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/3394882299":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/1691610567":"2023-10-11T22:37:42.558235+0000","172.21.15.154:6837/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:6836/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/4135556396":"2023-10-11T22:37:42.558235+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:51.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59cc0670e0 msgr2=0x7f59cc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:51.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59cc0670e0 0x7f59cc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806a0a0 msgr2=0x7f59e80b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806a0a0 0x7f59e80b1a50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f59e806b0c0 tx=0x7f59dc017000 comp rx=0 tx=0).stop 2023-10-10T22:37:51.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 shutdown_connections 2023-10-10T22:37:51.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f59cc0670e0 0x7f59cc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59e806dd20 0x7f59e80c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59e806a0a0 0x7f59e80b1a50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 --2- 172.21.15.154:0/1355578075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59e806d950 0x7f59e815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 >> 172.21.15.154:0/1355578075 conn(0x7f59e80cc1f0 msgr2=0x7f59e8156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:51.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 shutdown_connections 2023-10-10T22:37:51.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.499+0000 7f59ed99d700 1 -- 172.21.15.154:0/1355578075 wait complete. 2023-10-10T22:37:51.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-10T22:37:51.558 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:51.557+0000 7f7198074180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:37:51.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.746+0000 7f35a959d700 1 Processor -- start 2023-10-10T22:37:51.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.746+0000 7f35a959d700 1 -- start start 2023-10-10T22:37:51.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a4156310 0x7f35a40c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a959d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35a41566e0 0x7f35a40ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a959d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40ca860 con 0x7f35a40ca300 2023-10-10T22:37:51.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a959d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40cab40 con 0x7f35a41566e0 2023-10-10T22:37:51.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40cae20 con 0x7f35a4156310 2023-10-10T22:37:51.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a4156310 0x7f35a40c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:51.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a37fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35a41566e0 0x7f35a40ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:51.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a8d9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f35a40ca300 0x7f35a40c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:43562/0 (socket says 172.21.15.154:43562) 2023-10-10T22:37:51.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a37fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35a41566e0 0x7f35a40ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:54712/0 (socket says 172.21.15.154:54712) 2023-10-10T22:37:51.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a4156310 0x7f35a40c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:55722/0 (socket says 172.21.15.154:55722) 2023-10-10T22:37:51.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.748+0000 7f35a8d9c700 1 -- 172.21.15.154:0/1584033745 learned_addr learned my addr 172.21.15.154:0/1584033745 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:51.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a2ffd700 1 -- 172.21.15.154:0/1584033745 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871860400 0 0) 0x7f35a40ca860 con 0x7f35a40ca300 2023-10-10T22:37:51.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a2ffd700 1 -- 172.21.15.154:0/1584033745 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f358c003570 con 0x7f35a40ca300 2023-10-10T22:37:51.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a37fe700 1 -- 172.21.15.154:0/1584033745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a4156310 msgr2=0x7f35a40c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:51.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a37fe700 1 --2- 172.21.15.154:0/1584033745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a4156310 0x7f35a40c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a37fe700 1 -- 172.21.15.154:0/1584033745 >> v1:172.21.15.179:6789/0 conn(0x7f35a40ca300 legacy=0x7f35a40c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a37fe700 1 -- 172.21.15.154:0/1584033745 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40cb100 con 0x7f35a41566e0 2023-10-10T22:37:51.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a3fff700 1 --2- 172.21.15.154:0/1584033745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a4156310 0x7f35a40c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:51.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a37fe700 1 --2- 172.21.15.154:0/1584033745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a41566e0 0x7f35a40ae000 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f35980098e0 tx=0x7f35980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3573fcd54de91058 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:51.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a2ffd700 1 -- 172.21.15.154:0/1584033745 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598011630 con 0x7f35a41566e0 2023-10-10T22:37:51.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a2ffd700 1 -- 172.21.15.154:0/1584033745 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598011790 con 0x7f35a41566e0 2023-10-10T22:37:51.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.749+0000 7f35a2ffd700 1 -- 172.21.15.154:0/1584033745 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598011b30 con 0x7f35a41566e0 2023-10-10T22:37:51.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.750+0000 7f35a959d700 1 -- 172.21.15.154:0/1584033745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a41566e0 msgr2=0x7f35a40ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.750+0000 7f35a959d700 1 --2- 172.21.15.154:0/1584033745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a41566e0 0x7f35a40ae000 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f35980098e0 tx=0x7f35980091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.750+0000 7f35a959d700 1 -- 172.21.15.154:0/1584033745 shutdown_connections 2023-10-10T22:37:51.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.750+0000 7f35a959d700 1 --2- 172.21.15.154:0/1584033745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a4156310 0x7f35a40c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.750+0000 7f35a959d700 1 --2- 172.21.15.154:0/1584033745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a41566e0 0x7f35a40ae000 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.750+0000 7f35a959d700 1 -- 172.21.15.154:0/1584033745 >> 172.21.15.154:0/1584033745 conn(0x7f35a40cc1f0 msgr2=0x7f35a40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:51.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.750+0000 7f35a959d700 1 -- 172.21.15.154:0/1584033745 shutdown_connections 2023-10-10T22:37:51.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.750+0000 7f35a959d700 1 -- 172.21.15.154:0/1584033745 wait complete. 2023-10-10T22:37:51.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.751+0000 7f35a959d700 1 Processor -- start 2023-10-10T22:37:51.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.752+0000 7f35a959d700 1 -- start start 2023-10-10T22:37:51.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.752+0000 7f35a959d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a40ca300 0x7f35a414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.752+0000 7f35a959d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a4156310 0x7f35a414c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.752+0000 7f35a959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a41566e0 0x7f35a4155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.752+0000 7f35a959d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a416b0b0 con 0x7f35a40ca300 2023-10-10T22:37:51.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.752+0000 7f35a959d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a416a4a0 con 0x7f35a4156310 2023-10-10T22:37:51.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a416a780 con 0x7f35a41566e0 2023-10-10T22:37:51.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a40ca300 0x7f35a414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:51.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a40ca300 0x7f35a414ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52410/0 (socket says 172.21.15.154:52410) 2023-10-10T22:37:51.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a3fff700 1 -- 172.21.15.154:0/792629988 learned_addr learned my addr 172.21.15.154:0/792629988 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:51.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a37fe700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a4156310 0x7f35a414c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:51.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a8d9c700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a41566e0 0x7f35a4155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:51.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a3fff700 1 -- 172.21.15.154:0/792629988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a41566e0 msgr2=0x7f35a4155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a3fff700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a41566e0 0x7f35a4155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a3fff700 1 -- 172.21.15.154:0/792629988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a4156310 msgr2=0x7f35a414c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:51.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a3fff700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a4156310 0x7f35a414c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:51.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a3fff700 1 -- 172.21.15.154:0/792629988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359400b6d0 con 0x7f35a40ca300 2023-10-10T22:37:51.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.753+0000 7f35a37fe700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a4156310 0x7f35a414c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:51.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.754+0000 7f35a3fff700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a40ca300 0x7f35a414ab20 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f359400ede0 tx=0x7f359400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:51.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.754+0000 7f358bfff700 1 -- 172.21.15.154:0/792629988 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400eee0 con 0x7f35a40ca300 2023-10-10T22:37:51.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.754+0000 7f358bfff700 1 -- 172.21.15.154:0/792629988 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400dd30 con 0x7f35a40ca300 2023-10-10T22:37:51.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.754+0000 7f358bfff700 1 -- 172.21.15.154:0/792629988 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400dea0 con 0x7f35a40ca300 2023-10-10T22:37:51.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.754+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3598009420 con 0x7f35a40ca300 2023-10-10T22:37:51.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.754+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a416ad40 con 0x7f35a40ca300 2023-10-10T22:37:51.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.755+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a416d880 con 0x7f35a40ca300 2023-10-10T22:37:51.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.756+0000 7f358bfff700 1 -- 172.21.15.154:0/792629988 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f35940108a0 con 0x7f35a40ca300 2023-10-10T22:37:51.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.757+0000 7f358bfff700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35900670e0 0x7f3590069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:51.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.757+0000 7f358bfff700 1 -- 172.21.15.154:0/792629988 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f3594084fd0 con 0x7f35a40ca300 2023-10-10T22:37:51.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.757+0000 7f35a37fe700 1 -- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35900670e0 msgr2=0x7f3590069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:51.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.757+0000 7f35a37fe700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35900670e0 0x7f3590069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:51.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.761+0000 7f358bfff700 1 -- 172.21.15.154:0/792629988 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3594051ba0 con 0x7f35a40ca300 2023-10-10T22:37:51.848 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:51.847+0000 7f7198074180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:37:51.858 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:51.857+0000 7ff84736b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-10T22:37:51.940 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:51.940+0000 7f7198074180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:37:51.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.958+0000 7f35a37fe700 1 -- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35900670e0 msgr2=0x7f3590069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:51.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:51.958+0000 7f35a37fe700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35900670e0 0x7f3590069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:52.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.008+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f35a404c3c0 con 0x7f35a40ca300 2023-10-10T22:37:52.009 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-10-10T22:37:52.008+0000 7f71237f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-10T22:37:52.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.013+0000 7f358bfff700 1 -- 172.21.15.154:0/792629988 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) v1 ==== 161+0+0 (secure 0 0 0) 0x7f35940551c0 con 0x7f35a40ca300 2023-10-10T22:37:52.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35900670e0 msgr2=0x7f3590069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:52.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35900670e0 0x7f3590069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a40ca300 msgr2=0x7f35a414ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:52.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a40ca300 0x7f35a414ab20 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f359400ede0 tx=0x7f359400b430 comp rx=0 tx=0).stop 2023-10-10T22:37:52.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 shutdown_connections 2023-10-10T22:37:52.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f35900670e0 0x7f3590069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a41566e0 0x7f35a4155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35a40ca300 0x7f35a414ab20 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 --2- 172.21.15.154:0/792629988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a4156310 0x7f35a414c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 >> 172.21.15.154:0/792629988 conn(0x7f35a40cc1f0 msgr2=0x7f35a406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:52.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 shutdown_connections 2023-10-10T22:37:52.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.016+0000 7f35a959d700 1 -- 172.21.15.154:0/792629988 wait complete. 2023-10-10T22:37:52.021 INFO:tasks.ceph.mds.b.smithi179.stderr: -2529> 2023-10-10T22:37:27.278+0000 7fba7a9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-10T22:37:52.021 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-10T22:37:52.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-10T22:37:52.062 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-10T22:37:52.100 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:52.100+0000 7f7198074180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:37:52.160 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:52.159+0000 7ff84736b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-10T22:37:52.205 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:52.204+0000 7f7198074180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:37:52.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.227+0000 7fc49cb9d700 1 Processor -- start 2023-10-10T22:37:52.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.227+0000 7fc49cb9d700 1 -- start start 2023-10-10T22:37:52.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.228+0000 7fc49cb9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4980b4e70 0x7fc4980ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:52.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.228+0000 7fc49cb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b1b40 0x7fc49815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:52.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc49cb9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4980cfb00 con 0x7fc4980b16d0 2023-10-10T22:37:52.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc49cb9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4980b5c40 con 0x7fc4980b4e70 2023-10-10T22:37:52.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc49cb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980b5f20 con 0x7fc4980b1b40 2023-10-10T22:37:52.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc4977fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4980b4e70 0x7fc4980ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:52.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc4977fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4980b4e70 0x7fc4980ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52414/0 (socket says 172.21.15.154:52414) 2023-10-10T22:37:52.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc4977fe700 1 -- 172.21.15.154:0/3270158423 learned_addr learned my addr 172.21.15.154:0/3270158423 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:52.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc497fff700 1 --2- 172.21.15.154:0/3270158423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b1b40 0x7fc49815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:52.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc4977fe700 1 -- 172.21.15.154:0/3270158423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b1b40 msgr2=0x7fc49815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:52.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc4977fe700 1 --2- 172.21.15.154:0/3270158423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b1b40 0x7fc49815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc4977fe700 1 -- 172.21.15.154:0/3270158423 >> v1:172.21.15.154:6789/0 conn(0x7fc4980b16d0 legacy=0x7fc49815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:52.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.229+0000 7fc4977fe700 1 -- 172.21.15.154:0/3270158423 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4980b6200 con 0x7fc4980b4e70 2023-10-10T22:37:52.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.230+0000 7fc4977fe700 1 --2- 172.21.15.154:0/3270158423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 0x7fc4980ccff0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fc4880099b0 tx=0x7fc488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20bb6b3f5e4b672 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:52.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.230+0000 7fc4967fc700 1 -- 172.21.15.154:0/3270158423 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488009ea0 con 0x7fc4980b4e70 2023-10-10T22:37:52.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.230+0000 7fc4967fc700 1 -- 172.21.15.154:0/3270158423 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48800b860 con 0x7fc4980b4e70 2023-10-10T22:37:52.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.230+0000 7fc4967fc700 1 -- 172.21.15.154:0/3270158423 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800bc00 con 0x7fc4980b4e70 2023-10-10T22:37:52.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.231+0000 7fc49cb9d700 1 -- 172.21.15.154:0/3270158423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 msgr2=0x7fc4980ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:52.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.231+0000 7fc49cb9d700 1 --2- 172.21.15.154:0/3270158423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 0x7fc4980ccff0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fc4880099b0 tx=0x7fc488009250 comp rx=0 tx=0).stop 2023-10-10T22:37:52.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.231+0000 7fc49cb9d700 1 -- 172.21.15.154:0/3270158423 shutdown_connections 2023-10-10T22:37:52.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.231+0000 7fc49cb9d700 1 --2- 172.21.15.154:0/3270158423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b1b40 0x7fc49815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.231+0000 7fc49cb9d700 1 --2- 172.21.15.154:0/3270158423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 0x7fc4980ccff0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.231+0000 7fc49cb9d700 1 -- 172.21.15.154:0/3270158423 >> 172.21.15.154:0/3270158423 conn(0x7fc4980d10c0 msgr2=0x7fc4980affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:52.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.231+0000 7fc49cb9d700 1 -- 172.21.15.154:0/3270158423 shutdown_connections 2023-10-10T22:37:52.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.231+0000 7fc49cb9d700 1 -- 172.21.15.154:0/3270158423 wait complete. 2023-10-10T22:37:52.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.232+0000 7fc49cb9d700 1 Processor -- start 2023-10-10T22:37:52.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.232+0000 7fc49cb9d700 1 -- start start 2023-10-10T22:37:52.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.233+0000 7fc49cb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b16d0 0x7fc498157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:52.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.233+0000 7fc49cb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4980b1b40 0x7fc4980c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:52.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.233+0000 7fc49cb9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 0x7fc498068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:52.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.233+0000 7fc49cb9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc498157c40 con 0x7fc4980b4e70 2023-10-10T22:37:52.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.233+0000 7fc49cb9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49816a240 con 0x7fc4980b1b40 2023-10-10T22:37:52.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.233+0000 7fc49cb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980ca620 con 0x7fc4980b16d0 2023-10-10T22:37:52.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc497fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 0x7fc498068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:52.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc497fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 0x7fc498068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52416/0 (socket says 172.21.15.154:52416) 2023-10-10T22:37:52.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc497fff700 1 -- 172.21.15.154:0/1085847038 learned_addr learned my addr 172.21.15.154:0/1085847038 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:52.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc4977fe700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b16d0 0x7fc498157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:52.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc496ffd700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4980b1b40 0x7fc4980c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:52.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc497fff700 1 -- 172.21.15.154:0/1085847038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b16d0 msgr2=0x7fc498157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:52.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc497fff700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b16d0 0x7fc498157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc497fff700 1 -- 172.21.15.154:0/1085847038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4980b1b40 msgr2=0x7fc4980c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:52.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc497fff700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4980b1b40 0x7fc4980c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc497fff700 1 -- 172.21.15.154:0/1085847038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4880094f0 con 0x7fc4980b4e70 2023-10-10T22:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc497fff700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 0x7fc498068390 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fc490009e90 tx=0x7fc49000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.234+0000 7fc47f7fe700 1 -- 172.21.15.154:0/1085847038 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49000cb70 con 0x7fc4980b4e70 2023-10-10T22:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.235+0000 7fc47f7fe700 1 -- 172.21.15.154:0/1085847038 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49000f040 con 0x7fc4980b4e70 2023-10-10T22:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.235+0000 7fc47f7fe700 1 -- 172.21.15.154:0/1085847038 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490014480 con 0x7fc4980b4e70 2023-10-10T22:37:52.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.235+0000 7fc49cb9d700 1 -- 172.21.15.154:0/1085847038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4980ca900 con 0x7fc4980b4e70 2023-10-10T22:37:52.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.235+0000 7fc49cb9d700 1 -- 172.21.15.154:0/1085847038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc498169ed0 con 0x7fc4980b4e70 2023-10-10T22:37:52.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.236+0000 7fc49cb9d700 1 -- 172.21.15.154:0/1085847038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49816a3d0 con 0x7fc4980b4e70 2023-10-10T22:37:52.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.237+0000 7fc47f7fe700 1 -- 172.21.15.154:0/1085847038 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc490014830 con 0x7fc4980b4e70 2023-10-10T22:37:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.237+0000 7fc47f7fe700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 0x7fc484069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.237+0000 7fc47f7fe700 1 -- 172.21.15.154:0/1085847038 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6569+0+0 (secure 0 0 0) 0x7fc4900856f0 con 0x7fc4980b4e70 2023-10-10T22:37:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.237+0000 7fc4977fe700 1 -- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 msgr2=0x7fc484069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.238+0000 7fc4977fe700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 0x7fc484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-10T22:37:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.241+0000 7fc47f7fe700 1 -- 172.21.15.154:0/1085847038 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc490052270 con 0x7fc4980b4e70 2023-10-10T22:37:52.259 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:52.258+0000 7ff84736b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-10T22:37:52.397 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:52.397+0000 7f7198074180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:37:52.421 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:52.419+0000 7ff84736b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-10T22:37:52.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.439+0000 7fc4977fe700 1 -- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 msgr2=0x7fc484069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:52.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.439+0000 7fc4977fe700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 0x7fc484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-10T22:37:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.486+0000 7fc49cb9d700 1 -- 172.21.15.154:0/1085847038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc49804bb80 con 0x7fc4980b4e70 2023-10-10T22:37:52.491 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:52.490+0000 7f7198074180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:37:52.530 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:52.528+0000 7ff84736b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-10T22:37:52.583 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:52.582+0000 7f7198074180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:37:52.680 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-10T22:37:52.679+0000 7f7198074180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:37:52.724 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:52.723+0000 7ff84736b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-10T22:37:52.818 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:52.817+0000 7ff84736b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-10T22:37:52.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.840+0000 7fc4977fe700 1 -- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 msgr2=0x7fc484069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6836/132976 2023-10-10T22:37:52.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:52.840+0000 7fc4977fe700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 0x7fc484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-10T22:37:52.912 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:52.911+0000 7ff84736b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-10T22:37:53.009 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-10-10T22:37:53.008+0000 7ff84736b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-10T22:37:53.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.017+0000 7fc47f7fe700 1 -- 172.21.15.154:0/1085847038 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 117) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fc490052640 con 0x7fc4980b4e70 2023-10-10T22:37:53.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.017+0000 7fc47f7fe700 1 -- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 msgr2=0x7fc484069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-10T22:37:53.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.017+0000 7fc47f7fe700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 0x7fc484069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.022+0000 7fc47f7fe700 1 -- 172.21.15.154:0/1085847038 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v96) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc4900707c0 con 0x7fc4980b4e70 2023-10-10T22:37:53.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 -- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 msgr2=0x7fc498068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:53.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 0x7fc498068390 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fc490009e90 tx=0x7fc49000b040 comp rx=0 tx=0).stop 2023-10-10T22:37:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 -- 172.21.15.154:0/1085847038 shutdown_connections 2023-10-10T22:37:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc4840670e0 0x7fc484069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4980b4e70 0x7fc498068390 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4980b16d0 0x7fc498157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 --2- 172.21.15.154:0/1085847038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4980b1b40 0x7fc4980c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 -- 172.21.15.154:0/1085847038 >> 172.21.15.154:0/1085847038 conn(0x7fc4980d10c0 msgr2=0x7fc49815ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:53.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 -- 172.21.15.154:0/1085847038 shutdown_connections 2023-10-10T22:37:53.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.026+0000 7fc49cb9d700 1 -- 172.21.15.154:0/1085847038 wait complete. 2023-10-10T22:37:53.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-10T22:37:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.247+0000 7f58509ff700 1 Processor -- start 2023-10-10T22:37:53.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.247+0000 7f58509ff700 1 -- start start 2023-10-10T22:37:53.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.248+0000 7f58509ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 0x7f584c0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:53.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.248+0000 7f58509ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f584c0b2100 0x7f584c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.248+0000 7f58509ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c06dc20 con 0x7f584c0688d0 2023-10-10T22:37:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.248+0000 7f58509ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c0acc00 con 0x7f584c0b2100 2023-10-10T22:37:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.248+0000 7f58509ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c06d6a0 con 0x7f584c157740 2023-10-10T22:37:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.248+0000 7f5843fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f584c0b2100 0x7f584c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:53.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.248+0000 7f5843fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f584c0b2100 0x7f584c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52496/0 (socket says 172.21.15.154:52496) 2023-10-10T22:37:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.248+0000 7f5843fff700 1 -- 172.21.15.154:0/2856664593 learned_addr learned my addr 172.21.15.154:0/2856664593 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.248+0000 7f584a59c700 1 --2- 172.21.15.154:0/2856664593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 0x7f584c0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.249+0000 7f5843fff700 1 -- 172.21.15.154:0/2856664593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 msgr2=0x7f584c0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.249+0000 7f5843fff700 1 --2- 172.21.15.154:0/2856664593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 0x7f584c0adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.249+0000 7f5843fff700 1 -- 172.21.15.154:0/2856664593 >> v1:172.21.15.179:6789/0 conn(0x7f584c0688d0 legacy=0x7f584c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.249+0000 7f5843fff700 1 -- 172.21.15.154:0/2856664593 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0ae910 con 0x7f584c0b2100 2023-10-10T22:37:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.249+0000 7f5849d9b700 1 -- 172.21.15.154:0/2856664593 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286952175 0 0) 0x7f584c06dc20 con 0x7f584c0688d0 2023-10-10T22:37:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.249+0000 7f5843fff700 1 --2- 172.21.15.154:0/2856664593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 0x7f584c068390 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f58340099b0 tx=0x7f5834009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f153fa7a3b76e097 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.249+0000 7f5849d9b700 1 -- 172.21.15.154:0/2856664593 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834009ea0 con 0x7f584c0b2100 2023-10-10T22:37:53.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.249+0000 7f5849d9b700 1 -- 172.21.15.154:0/2856664593 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583400b860 con 0x7f584c0b2100 2023-10-10T22:37:53.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.249+0000 7f5849d9b700 1 -- 172.21.15.154:0/2856664593 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583400bc00 con 0x7f584c0b2100 2023-10-10T22:37:53.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.250+0000 7f58509ff700 1 -- 172.21.15.154:0/2856664593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 msgr2=0x7f584c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:53.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.250+0000 7f58509ff700 1 --2- 172.21.15.154:0/2856664593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 0x7f584c068390 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f58340099b0 tx=0x7f5834009250 comp rx=0 tx=0).stop 2023-10-10T22:37:53.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.250+0000 7f58509ff700 1 -- 172.21.15.154:0/2856664593 shutdown_connections 2023-10-10T22:37:53.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.250+0000 7f58509ff700 1 --2- 172.21.15.154:0/2856664593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 0x7f584c0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.250+0000 7f58509ff700 1 --2- 172.21.15.154:0/2856664593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 0x7f584c068390 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.250+0000 7f58509ff700 1 -- 172.21.15.154:0/2856664593 >> 172.21.15.154:0/2856664593 conn(0x7f584c0c8f90 msgr2=0x7f584c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.250+0000 7f58509ff700 1 -- 172.21.15.154:0/2856664593 shutdown_connections 2023-10-10T22:37:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.250+0000 7f58509ff700 1 -- 172.21.15.154:0/2856664593 wait complete. 2023-10-10T22:37:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.251+0000 7f58509ff700 1 Processor -- start 2023-10-10T22:37:53.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.251+0000 7f58509ff700 1 -- start start 2023-10-10T22:37:53.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.252+0000 7f58509ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c0688d0 0x7f584c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:53.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.252+0000 7f58509ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 0x7f584c15bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:53.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.252+0000 7f58509ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 0x7f584c15c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:53.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.252+0000 7f58509ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c16dee0 con 0x7f584c0b2100 2023-10-10T22:37:53.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.252+0000 7f58509ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c16d310 con 0x7f584c0688d0 2023-10-10T22:37:53.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.252+0000 7f58509ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c16d5b0 con 0x7f584c157740 2023-10-10T22:37:53.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.252+0000 7f5843fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 0x7f584c15bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:53.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f5843fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 0x7f584c15bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52502/0 (socket says 172.21.15.154:52502) 2023-10-10T22:37:53.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f5843fff700 1 -- 172.21.15.154:0/1949209084 learned_addr learned my addr 172.21.15.154:0/1949209084 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:53.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f584ad9d700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 0x7f584c15c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f584a59c700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c0688d0 0x7f584c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f5843fff700 1 -- 172.21.15.154:0/1949209084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 msgr2=0x7f584c15c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f5843fff700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 0x7f584c15c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f5843fff700 1 -- 172.21.15.154:0/1949209084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c0688d0 msgr2=0x7f584c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f5843fff700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c0688d0 0x7f584c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:53.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f5843fff700 1 -- 172.21.15.154:0/1949209084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58340094f0 con 0x7f584c0b2100 2023-10-10T22:37:53.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f584a59c700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c0688d0 0x7f584c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:37:53.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f5843fff700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 0x7f584c15bf20 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f584c06b890 tx=0x7f5834017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:53.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f58427fc700 1 -- 172.21.15.154:0/1949209084 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583400bbe0 con 0x7f584c0b2100 2023-10-10T22:37:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.253+0000 7f58427fc700 1 -- 172.21.15.154:0/1949209084 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834011420 con 0x7f584c0b2100 2023-10-10T22:37:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.254+0000 7f58427fc700 1 -- 172.21.15.154:0/1949209084 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340117e0 con 0x7f584c0b2100 2023-10-10T22:37:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.254+0000 7f58509ff700 1 -- 172.21.15.154:0/1949209084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c16d890 con 0x7f584c0b2100 2023-10-10T22:37:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.254+0000 7f58509ff700 1 -- 172.21.15.154:0/1949209084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c154ff0 con 0x7f584c0b2100 2023-10-10T22:37:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.255+0000 7f58509ff700 1 -- 172.21.15.154:0/1949209084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c0cb480 con 0x7f584c0b2100 2023-10-10T22:37:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.256+0000 7f58427fc700 1 -- 172.21.15.154:0/1949209084 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 117) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f5834011c10 con 0x7f584c0b2100 2023-10-10T22:37:53.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.256+0000 7f58427fc700 1 -- 172.21.15.154:0/1949209084 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6870+0+0 (secure 0 0 0) 0x7f5834085e20 con 0x7f584c0b2100 2023-10-10T22:37:53.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.261+0000 7f58427fc700 1 -- 172.21.15.154:0/1949209084 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5834052fc0 con 0x7f584c0b2100 2023-10-10T22:37:53.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:53.457+0000 7f58509ff700 1 -- 172.21.15.154:0/1949209084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f584c0718b0 con 0x7f584c0b2100 2023-10-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.025+0000 7f58427fc700 1 -- 172.21.15.154:0/1949209084 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v213) v1 ==== 181+0+0 (secure 0 0 0) 0x7f58340150d0 con 0x7f584c0b2100 2023-10-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.029+0000 7f58509ff700 1 -- 172.21.15.154:0/1949209084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 msgr2=0x7f584c15bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.029+0000 7f58509ff700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 0x7f584c15bf20 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f584c06b890 tx=0x7f5834017000 comp rx=0 tx=0).stop 2023-10-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.029+0000 7f58509ff700 1 -- 172.21.15.154:0/1949209084 shutdown_connections 2023-10-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.029+0000 7f58509ff700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c157740 0x7f584c15c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.029+0000 7f58509ff700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c0688d0 0x7f584c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.029+0000 7f58509ff700 1 --2- 172.21.15.154:0/1949209084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584c0b2100 0x7f584c15bf20 secure :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f584c06b890 tx=0x7f5834017000 comp rx=0 tx=0).stop 2023-10-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.029+0000 7f58509ff700 1 -- 172.21.15.154:0/1949209084 >> 172.21.15.154:0/1949209084 conn(0x7f584c0c8f90 msgr2=0x7f584c156980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.029+0000 7f58509ff700 1 -- 172.21.15.154:0/1949209084 shutdown_connections 2023-10-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.029+0000 7f58509ff700 1 -- 172.21.15.154:0/1949209084 wait complete. 2023-10-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-10-10T22:37:54.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.243+0000 7f010e9ff700 1 Processor -- start 2023-10-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.243+0000 7f010e9ff700 1 -- start start 2023-10-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.244+0000 7f010e9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f01081563b0 0x7f0108156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.244+0000 7f010e9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0108068890 0x7f01080c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.244+0000 7f010e9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010815a9b0 con 0x7f010815a440 2023-10-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.244+0000 7f010e9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010815ac90 con 0x7f01081563b0 2023-10-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.244+0000 7f010e9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010815af70 con 0x7f0108068890 2023-10-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f01077fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f010815a440 0x7f01080acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56222/0 (socket says 172.21.15.154:56222) 2023-10-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f0107fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f01081563b0 0x7f0108156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f01077fe700 1 -- 172.21.15.154:0/776800345 learned_addr learned my addr 172.21.15.154:0/776800345 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f010cf9c700 1 --2- 172.21.15.154:0/776800345 >> v2:172.21.15.179:3300/0 conn(0x7f0108068890 0x7f01080c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f0106ffd700 1 -- 172.21.15.154:0/776800345 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032139128 0 0) 0x7f010815a9b0 con 0x7f010815a440 2023-10-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f0106ffd700 1 -- 172.21.15.154:0/776800345 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f0003570 con 0x7f010815a440 2023-10-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f0107fff700 1 -- 172.21.15.154:0/776800345 >> v2:172.21.15.179:3300/0 conn(0x7f0108068890 msgr2=0x7f01080c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f0107fff700 1 --2- 172.21.15.154:0/776800345 >> v2:172.21.15.179:3300/0 conn(0x7f0108068890 0x7f01080c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f0107fff700 1 -- 172.21.15.154:0/776800345 >> v1:172.21.15.154:6789/0 conn(0x7f010815a440 legacy=0x7f01080acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f0107fff700 1 -- 172.21.15.154:0/776800345 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010815b250 con 0x7f01081563b0 2023-10-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.245+0000 7f010cf9c700 1 --2- 172.21.15.154:0/776800345 >> v2:172.21.15.179:3300/0 conn(0x7f0108068890 0x7f01080c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f0107fff700 1 --2- 172.21.15.154:0/776800345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 0x7f0108156780 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f01080bff20 tx=0x7f00f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1e67d45bef939f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f0106ffd700 1 -- 172.21.15.154:0/776800345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011630 con 0x7f01081563b0 2023-10-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f0106ffd700 1 -- 172.21.15.154:0/776800345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f8011790 con 0x7f01081563b0 2023-10-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f0106ffd700 1 -- 172.21.15.154:0/776800345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011b30 con 0x7f01081563b0 2023-10-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f010e9ff700 1 -- 172.21.15.154:0/776800345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 msgr2=0x7f0108156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f010e9ff700 1 --2- 172.21.15.154:0/776800345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 0x7f0108156780 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f01080bff20 tx=0x7f00f80091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f010e9ff700 1 -- 172.21.15.154:0/776800345 shutdown_connections 2023-10-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f010e9ff700 1 --2- 172.21.15.154:0/776800345 >> v2:172.21.15.179:3300/0 conn(0x7f0108068890 0x7f01080c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f010e9ff700 1 --2- 172.21.15.154:0/776800345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 0x7f0108156780 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f010e9ff700 1 -- 172.21.15.154:0/776800345 >> 172.21.15.154:0/776800345 conn(0x7f01080c8f90 msgr2=0x7f01080c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f010e9ff700 1 -- 172.21.15.154:0/776800345 shutdown_connections 2023-10-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.246+0000 7f010e9ff700 1 -- 172.21.15.154:0/776800345 wait complete. 2023-10-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.248+0000 7f010e9ff700 1 Processor -- start 2023-10-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.248+0000 7f010e9ff700 1 -- start start 2023-10-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f010e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0108068890 0x7f01081579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f010e9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 0x7f0108165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f010e9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010815a440 0x7f0108166520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f010e9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01081595f0 con 0x7f01081563b0 2023-10-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f010e9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108159a10 con 0x7f010815a440 2023-10-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f010e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0108158970 con 0x7f0108068890 2023-10-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f01077fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 0x7f0108165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f01077fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 0x7f0108165fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52512/0 (socket says 172.21.15.154:52512) 2023-10-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f01077fe700 1 -- 172.21.15.154:0/2597022088 learned_addr learned my addr 172.21.15.154:0/2597022088 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f0107fff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0108068890 0x7f01081579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.249+0000 7f010cf9c700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010815a440 0x7f0108166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f01077fe700 1 -- 172.21.15.154:0/2597022088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0108068890 msgr2=0x7f01081579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f01077fe700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0108068890 0x7f01081579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f01077fe700 1 -- 172.21.15.154:0/2597022088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010815a440 msgr2=0x7f0108166520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f01077fe700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010815a440 0x7f0108166520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f01077fe700 1 -- 172.21.15.154:0/2597022088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8009420 con 0x7f01081563b0 2023-10-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f01077fe700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 0x7f0108165fe0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c590 tx=0x7f00fc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f00effff700 1 -- 172.21.15.154:0/2597022088 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc005cd0 con 0x7f01081563b0 2023-10-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f00effff700 1 -- 172.21.15.154:0/2597022088 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc005e50 con 0x7f01081563b0 2023-10-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0108158c50 con 0x7f01081563b0 2023-10-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f00effff700 1 -- 172.21.15.154:0/2597022088 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc007320 con 0x7f01081563b0 2023-10-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.250+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0108159210 con 0x7f01081563b0 2023-10-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.251+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0108159730 con 0x7f01081563b0 2023-10-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.252+0000 7f00effff700 1 -- 172.21.15.154:0/2597022088 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 118) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f00fc01b3b0 con 0x7f01081563b0 2023-10-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.254+0000 7f00effff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f00f4066d80 0x7f00f4069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.254+0000 7f00effff700 1 -- 172.21.15.154:0/2597022088 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6432+0+0 (secure 0 0 0) 0x7f00fc083bc0 con 0x7f01081563b0 2023-10-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.254+0000 7f0107fff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f00f4066d80 0x7f00f4069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.254+0000 7f0107fff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f00f4066d80 0x7f00f4069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f00f80093f0 tx=0x7f00f8017000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.258+0000 7f00effff700 1 -- 172.21.15.154:0/2597022088 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0108159730 con 0x7f01081563b0 2023-10-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:54.457+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0108159730 con 0x7f01081563b0 2023-10-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.044+0000 7f00effff700 1 -- 172.21.15.154:0/2597022088 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00fc051130 con 0x7f01081563b0 2023-10-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.045+0000 7f00effff700 1 -- 172.21.15.154:0/2597022088 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v214) v1 ==== 169+0+0 (secure 0 0 0) 0x7f00fc049250 con 0x7f01081563b0 2023-10-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f00f4066d80 msgr2=0x7f00f4069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f00f4066d80 0x7f00f4069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f00f80093f0 tx=0x7f00f8017000 comp rx=0 tx=0).stop 2023-10-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 msgr2=0x7f0108165fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 0x7f0108165fe0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c590 tx=0x7f00fc007e00 comp rx=0 tx=0).stop 2023-10-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 shutdown_connections 2023-10-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f00f4066d80 0x7f00f4069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010815a440 0x7f0108166520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0108068890 0x7f01081579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 --2- 172.21.15.154:0/2597022088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01081563b0 0x7f0108165fe0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 >> 172.21.15.154:0/2597022088 conn(0x7f01080c8f90 msgr2=0x7f01081521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 shutdown_connections 2023-10-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.049+0000 7f010e9ff700 1 -- 172.21.15.154:0/2597022088 wait complete. 2023-10-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-10-10T22:37:55.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.253+0000 7f0ebe9ff700 1 Processor -- start 2023-10-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.253+0000 7f0ebe9ff700 1 -- start start 2023-10-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.254+0000 7f0ebe9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80c83f0 0x7f0eb80c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.254+0000 7f0ebe9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0eb81568e0 0x7f0eb80ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.254+0000 7f0ebe9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb815b0d0 con 0x7f0eb80ccee0 2023-10-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.254+0000 7f0ebe9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80c7a60 con 0x7f0eb81568e0 2023-10-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.254+0000 7f0ebe9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815a4c0 con 0x7f0eb80c83f0 2023-10-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0eb80ccee0 0x7f0eb81561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56224/0 (socket says 172.21.15.154:56224) 2023-10-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb77fe700 1 -- 172.21.15.154:0/2146723458 learned_addr learned my addr 172.21.15.154:0/2146723458 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb7fff700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80c83f0 0x7f0eb80c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016549758 0 0) 0x7f0eb815b0d0 con 0x7f0eb80ccee0 2023-10-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea0003570 con 0x7f0eb80ccee0 2023-10-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0ebcf9c700 1 --2- 172.21.15.154:0/2146723458 >> v2:172.21.15.179:3300/0 conn(0x7f0eb81568e0 0x7f0eb80ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279734297 0 0) 0x7f0ea0003570 con 0x7f0eb80ccee0 2023-10-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80c83f0 msgr2=0x7f0eb80c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb6ffd700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80c83f0 0x7f0eb80c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 >> v2:172.21.15.179:3300/0 conn(0x7f0eb81568e0 msgr2=0x7f0eb80ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb6ffd700 1 --2- 172.21.15.154:0/2146723458 >> v2:172.21.15.179:3300/0 conn(0x7f0eb81568e0 0x7f0eb80ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb815a7a0 con 0x7f0eb80ccee0 2023-10-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.255+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f0eac001470 con 0x7f0eb80ccee0 2023-10-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 >> v1:172.21.15.154:6789/0 conn(0x7f0eb80ccee0 legacy=0x7f0eb81561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb6ffd700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80c83f0 0x7f0ea0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb6ffd700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0ea0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb6ffd700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ea0004d50 0x7f0ea00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80c7a60 con 0x7f0ea0003fe0 2023-10-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815a4c0 con 0x7f0ea0004d50 2023-10-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea000dd50 con 0x7f0eb80c83f0 2023-10-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0ebcf9c700 1 --2- 172.21.15.154:0/2146723458 >> v2:172.21.15.179:3300/0 conn(0x7f0eb81568e0 0x7f0eb80ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb77fe700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0ea0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb7fff700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80c83f0 0x7f0ea0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0ebcf9c700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ea0004d50 0x7f0ea00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb77fe700 1 -- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80c83f0 msgr2=0x7f0ea0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb77fe700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80c83f0 0x7f0ea0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb77fe700 1 -- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ea0004d50 msgr2=0x7f0ea00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb77fe700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ea0004d50 0x7f0ea00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.256+0000 7f0eb77fe700 1 -- 172.21.15.154:0/2146723458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0003570 con 0x7f0ea0003fe0 2023-10-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0eb77fe700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0ea0004810 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00c390 tx=0x7f0eb806e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba336a95a26a5d8c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac00cc60 con 0x7f0ea0003fe0 2023-10-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac00ce00 con 0x7f0ea0003fe0 2023-10-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0eb6ffd700 1 -- 172.21.15.154:0/2146723458 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac005b70 con 0x7f0ea0003fe0 2023-10-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/2146723458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 msgr2=0x7f0ea0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0ebe9ff700 1 --2- 172.21.15.154:0/2146723458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0ea0004810 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00c390 tx=0x7f0eb806e870 comp rx=0 tx=0).stop 2023-10-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0ebcf9c700 1 -- 172.21.15.154:0/2146723458 reap_dead start 2023-10-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/2146723458 shutdown_connections 2023-10-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/2146723458 >> 172.21.15.154:0/2146723458 conn(0x7f0eb8068e10 msgr2=0x7f0eb80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/2146723458 shutdown_connections 2023-10-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.257+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/2146723458 wait complete. 2023-10-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.259+0000 7f0ebe9ff700 1 Processor -- start 2023-10-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.259+0000 7f0ebe9ff700 1 -- start start 2023-10-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0ebe9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0eb814f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0ebe9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8150200 0x7f0eb814d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0ebe9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b12e0 0x7f0eb80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0ebe9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b1c90 con 0x7f0ea0003fe0 2023-10-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0ebe9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb816e200 con 0x7f0eb8150200 2023-10-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0ebe9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb816d5f0 con 0x7f0eb80b12e0 2023-10-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0eb7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0eb814f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0eb7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0eb814f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52534/0 (socket says 172.21.15.154:52534) 2023-10-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0eb7fff700 1 -- 172.21.15.154:0/4034928328 learned_addr learned my addr 172.21.15.154:0/4034928328 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0eb77fe700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8150200 0x7f0eb814d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0ebcf9c700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b12e0 0x7f0eb80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0eb7fff700 1 -- 172.21.15.154:0/4034928328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b12e0 msgr2=0x7f0eb80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.260+0000 7f0eb7fff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b12e0 0x7f0eb80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0eb7fff700 1 -- 172.21.15.154:0/4034928328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8150200 msgr2=0x7f0eb814d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0eb7fff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8150200 0x7f0eb814d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0eb7fff700 1 -- 172.21.15.154:0/4034928328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb816d8d0 con 0x7f0ea0003fe0 2023-10-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0eb77fe700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8150200 0x7f0eb814d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0eb7fff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0eb814f450 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8011d40 tx=0x7f0ea80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0e9ffff700 1 -- 172.21.15.154:0/4034928328 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea800fac0 con 0x7f0ea0003fe0 2023-10-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0e9ffff700 1 -- 172.21.15.154:0/4034928328 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea800fc20 con 0x7f0ea0003fe0 2023-10-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0e9ffff700 1 -- 172.21.15.154:0/4034928328 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8014440 con 0x7f0ea0003fe0 2023-10-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb816dbb0 con 0x7f0ea0003fe0 2023-10-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.261+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb814d840 con 0x7f0ea0003fe0 2023-10-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.262+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb816d3c0 con 0x7f0ea0003fe0 2023-10-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.263+0000 7f0e9ffff700 1 -- 172.21.15.154:0/4034928328 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ea8014870 con 0x7f0ea0003fe0 2023-10-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.264+0000 7f0e9ffff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ea4066f30 0x7f0ea40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.264+0000 7f0e9ffff700 1 -- 172.21.15.154:0/4034928328 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f0ea8018030 con 0x7f0ea0003fe0 2023-10-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.264+0000 7f0eb77fe700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ea4066f30 0x7f0ea40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.265+0000 7f0eb77fe700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ea4066f30 0x7f0ea40693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00c390 tx=0x7f0eac015000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.268+0000 7f0e9ffff700 1 -- 172.21.15.154:0/4034928328 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ea80521c0 con 0x7f0ea0003fe0 2023-10-10T22:37:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.460+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0eb804c3c0 con 0x7f0ea0003fe0 2023-10-10T22:37:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.464+0000 7f0e9ffff700 1 -- 172.21.15.154:0/4034928328 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0ea80557e0 con 0x7f0ea0003fe0 2023-10-10T22:37:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ea4066f30 msgr2=0x7f0ea40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ea4066f30 0x7f0ea40693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00c390 tx=0x7f0eac015000 comp rx=0 tx=0).stop 2023-10-10T22:37:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 msgr2=0x7f0eb814f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0eb814f450 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8011d40 tx=0x7f0ea80091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 shutdown_connections 2023-10-10T22:37:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0ea4066f30 0x7f0ea40693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b12e0 0x7f0eb80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea0003fe0 0x7f0eb814f450 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 --2- 172.21.15.154:0/4034928328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8150200 0x7f0eb814d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 >> 172.21.15.154:0/4034928328 conn(0x7f0eb8068e10 msgr2=0x7f0eb8151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:55.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 shutdown_connections 2023-10-10T22:37:55.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.467+0000 7f0ebe9ff700 1 -- 172.21.15.154:0/4034928328 wait complete. 2023-10-10T22:37:55.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-10T22:37:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.668+0000 7f7bd93ff700 1 Processor -- start 2023-10-10T22:37:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.668+0000 7f7bd93ff700 1 -- start start 2023-10-10T22:37:55.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c83f0 0x7f7bd40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd93ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7bd40ccee0 0x7f7bd41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd93ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd415b0d0 con 0x7f7bd40c87c0 2023-10-10T22:37:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd93ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd40c7a60 con 0x7f7bd40ccee0 2023-10-10T22:37:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd415a4c0 con 0x7f7bd40c83f0 2023-10-10T22:37:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd37fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7bd40c87c0 0x7f7bd406eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56228/0 (socket says 172.21.15.154:56228) 2023-10-10T22:37:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd37fe700 1 -- 172.21.15.154:0/473697379 learned_addr learned my addr 172.21.15.154:0/473697379 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd2ffd700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c83f0 0x7f7bd40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225361334 0 0) 0x7f7bd415b0d0 con 0x7f7bd40c87c0 2023-10-10T22:37:55.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd27fc700 1 --2- 172.21.15.154:0/473697379 >> v2:172.21.15.179:3300/0 conn(0x7f7bd40ccee0 0x7f7bd41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.670+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bbc003570 con 0x7f7bd40c87c0 2023-10-10T22:37:55.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1087952098 0 0) 0x7f7bbc003570 con 0x7f7bd40c87c0 2023-10-10T22:37:55.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c83f0 msgr2=0x7f7bd40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:55.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c83f0 0x7f7bd40c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 >> v2:172.21.15.179:3300/0 conn(0x7f7bd40ccee0 msgr2=0x7f7bd41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:55.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 --2- 172.21.15.154:0/473697379 >> v2:172.21.15.179:3300/0 conn(0x7f7bd40ccee0 0x7f7bd41561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd415a7a0 con 0x7f7bd40c87c0 2023-10-10T22:37:55.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7f7bcc0017f0 con 0x7f7bd40c87c0 2023-10-10T22:37:55.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 >> v1:172.21.15.154:6789/0 conn(0x7f7bd40c87c0 legacy=0x7f7bd406eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c83f0 0x7f7bbc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bbc003fa0 0x7f7bbc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bbc004d50 0x7f7bbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c7a60 con 0x7f7bbc004d50 2023-10-10T22:37:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd415a4c0 con 0x7f7bbc003fa0 2023-10-10T22:37:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc00ba60 con 0x7f7bd40c83f0 2023-10-10T22:37:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd37fe700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bbc004d50 0x7f7bbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd2ffd700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c83f0 0x7f7bbc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.671+0000 7f7bd27fc700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bbc003fa0 0x7f7bbc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.672+0000 7f7bd37fe700 1 -- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c83f0 msgr2=0x7f7bbc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:55.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.672+0000 7f7bd37fe700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c83f0 0x7f7bbc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.672+0000 7f7bd37fe700 1 -- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bbc003fa0 msgr2=0x7f7bbc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:55.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.672+0000 7f7bd37fe700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bbc003fa0 0x7f7bbc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.672+0000 7f7bd37fe700 1 -- 172.21.15.154:0/473697379 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc003570 con 0x7f7bbc004d50 2023-10-10T22:37:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.672+0000 7f7bd37fe700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bbc004d50 0x7f7bbc0051c0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc005c30 tx=0x7f7bcc005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3833a23aaaf1d301 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.672+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc005570 con 0x7f7bbc004d50 2023-10-10T22:37:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.672+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc00d960 con 0x7f7bbc004d50 2023-10-10T22:37:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.672+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/473697379 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00dd00 con 0x7f7bbc004d50 2023-10-10T22:37:55.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.673+0000 7f7bd93ff700 1 -- 172.21.15.154:0/473697379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bbc004d50 msgr2=0x7f7bbc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.673+0000 7f7bd93ff700 1 --2- 172.21.15.154:0/473697379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bbc004d50 0x7f7bbc0051c0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc005c30 tx=0x7f7bcc005240 comp rx=0 tx=0).stop 2023-10-10T22:37:55.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.673+0000 7f7bd37fe700 1 -- 172.21.15.154:0/473697379 reap_dead start 2023-10-10T22:37:55.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.673+0000 7f7bd93ff700 1 -- 172.21.15.154:0/473697379 shutdown_connections 2023-10-10T22:37:55.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.673+0000 7f7bd93ff700 1 -- 172.21.15.154:0/473697379 >> 172.21.15.154:0/473697379 conn(0x7f7bd4068e10 msgr2=0x7f7bd40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:55.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.673+0000 7f7bd93ff700 1 -- 172.21.15.154:0/473697379 shutdown_connections 2023-10-10T22:37:55.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.673+0000 7f7bd93ff700 1 -- 172.21.15.154:0/473697379 wait complete. 2023-10-10T22:37:55.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.674+0000 7f7bd93ff700 1 Processor -- start 2023-10-10T22:37:55.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.674+0000 7f7bd93ff700 1 -- start start 2023-10-10T22:37:55.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.675+0000 7f7bd93ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bbc004d50 0x7f7bd40ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.675+0000 7f7bd93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c4960 0x7f7bd416d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.675+0000 7f7bd93ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd416dc50 0x7f7bd4145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.675+0000 7f7bd93ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd416e0d0 con 0x7f7bd416dc50 2023-10-10T22:37:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.675+0000 7f7bd93ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40aede0 con 0x7f7bbc004d50 2023-10-10T22:37:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.675+0000 7f7bd93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c35e0 con 0x7f7bd40c4960 2023-10-10T22:37:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.675+0000 7f7bd37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd416dc50 0x7f7bd4145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.675+0000 7f7bd37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd416dc50 0x7f7bd4145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52556/0 (socket says 172.21.15.154:52556) 2023-10-10T22:37:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.675+0000 7f7bd37fe700 1 -- 172.21.15.154:0/2514761597 learned_addr learned my addr 172.21.15.154:0/2514761597 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bd2ffd700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bbc004d50 0x7f7bd40ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bd27fc700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c4960 0x7f7bd416d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bd37fe700 1 -- 172.21.15.154:0/2514761597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c4960 msgr2=0x7f7bd416d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bd37fe700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c4960 0x7f7bd416d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bd37fe700 1 -- 172.21.15.154:0/2514761597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bbc004d50 msgr2=0x7f7bd40ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bd37fe700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bbc004d50 0x7f7bd40ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bd37fe700 1 -- 172.21.15.154:0/2514761597 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40c38c0 con 0x7f7bd416dc50 2023-10-10T22:37:55.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bd37fe700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd416dc50 0x7f7bd4145700 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc011000 tx=0x7f7bcc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:55.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bbaffd700 1 -- 172.21.15.154:0/2514761597 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc005570 con 0x7f7bd416dc50 2023-10-10T22:37:55.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bbaffd700 1 -- 172.21.15.154:0/2514761597 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc00ded0 con 0x7f7bd416dc50 2023-10-10T22:37:55.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd40c3ba0 con 0x7f7bd416dc50 2023-10-10T22:37:55.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.676+0000 7f7bbaffd700 1 -- 172.21.15.154:0/2514761597 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc005020 con 0x7f7bd416dc50 2023-10-10T22:37:55.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.677+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd40c4160 con 0x7f7bd416dc50 2023-10-10T22:37:55.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.677+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd404c3c0 con 0x7f7bd416dc50 2023-10-10T22:37:55.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.678+0000 7f7bbaffd700 1 -- 172.21.15.154:0/2514761597 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bcc01c070 con 0x7f7bd416dc50 2023-10-10T22:37:55.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.679+0000 7f7bbaffd700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7bc0066f30 0x7f7bc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:55.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.679+0000 7f7bbaffd700 1 -- 172.21.15.154:0/2514761597 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f7bcc086b20 con 0x7f7bd416dc50 2023-10-10T22:37:55.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.680+0000 7f7bd2ffd700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7bc0066f30 0x7f7bc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:55.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.680+0000 7f7bd2ffd700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7bc0066f30 0x7f7bc00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bd406a3d0 tx=0x7f7bc40091a0 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.684+0000 7f7bbaffd700 1 -- 172.21.15.154:0/2514761597 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bcc053bb0 con 0x7f7bd416dc50 2023-10-10T22:37:55.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.885+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f7bd404c3c0 con 0x7f7bd416dc50 2023-10-10T22:37:55.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.890+0000 7f7bbaffd700 1 -- 172.21.15.154:0/2514761597 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v74) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7bcc0017b0 con 0x7f7bd416dc50 2023-10-10T22:37:55.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7bc0066f30 msgr2=0x7f7bc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7bc0066f30 0x7f7bc00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bd406a3d0 tx=0x7f7bc40091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd416dc50 msgr2=0x7f7bd4145700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:55.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd416dc50 0x7f7bd4145700 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc011000 tx=0x7f7bcc016000 comp rx=0 tx=0).stop 2023-10-10T22:37:55.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 shutdown_connections 2023-10-10T22:37:55.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f7bc0066f30 0x7f7bc00693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd416dc50 0x7f7bd4145700 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bbc004d50 0x7f7bd40ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 --2- 172.21.15.154:0/2514761597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bd40c4960 0x7f7bd416d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:55.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.892+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 >> 172.21.15.154:0/2514761597 conn(0x7f7bd4068e10 msgr2=0x7f7bd414b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:55.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.893+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 shutdown_connections 2023-10-10T22:37:55.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:55.893+0000 7f7bd93ff700 1 -- 172.21.15.154:0/2514761597 wait complete. 2023-10-10T22:37:55.912 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-10T22:37:56.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.098+0000 7f2c1d5ff700 1 Processor -- start 2023-10-10T22:37:56.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.098+0000 7f2c1d5ff700 1 -- start start 2023-10-10T22:37:56.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.099+0000 7f2c1d5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2c180c70b0 0x7f2c18155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.099+0000 7f2c1d5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c180cd0b0 0x7f2c18069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.099+0000 7f2c1d5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1806e950 con 0x7f2c180ccc40 2023-10-10T22:37:56.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.099+0000 7f2c1d5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c181563f0 con 0x7f2c180cd0b0 2023-10-10T22:37:56.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.099+0000 7f2c1d5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1806eb90 con 0x7f2c180c70b0 2023-10-10T22:37:56.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c177fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c180cd0b0 0x7f2c18069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:56.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c167fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2c180ccc40 0x7f2c1806e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34014/0 (socket says 172.21.15.154:34014) 2023-10-10T22:37:56.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c167fc700 1 -- 172.21.15.154:0/698969437 learned_addr learned my addr 172.21.15.154:0/698969437 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:56.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c16ffd700 1 --2- 172.21.15.154:0/698969437 >> v2:172.21.15.179:3300/0 conn(0x7f2c180c70b0 0x7f2c18155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:56.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c15ffb700 1 -- 172.21.15.154:0/698969437 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839045009 0 0) 0x7f2c0c001110 con 0x7f2c180ccc40 2023-10-10T22:37:56.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c15ffb700 1 -- 172.21.15.154:0/698969437 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c00003570 con 0x7f2c180ccc40 2023-10-10T22:37:56.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c177fe700 1 -- 172.21.15.154:0/698969437 >> v2:172.21.15.179:3300/0 conn(0x7f2c180c70b0 msgr2=0x7f2c18155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:56.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c177fe700 1 --2- 172.21.15.154:0/698969437 >> v2:172.21.15.179:3300/0 conn(0x7f2c180c70b0 0x7f2c18155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c177fe700 1 -- 172.21.15.154:0/698969437 >> v1:172.21.15.154:6789/0 conn(0x7f2c180ccc40 legacy=0x7f2c1806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c177fe700 1 -- 172.21.15.154:0/698969437 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1806ee70 con 0x7f2c180cd0b0 2023-10-10T22:37:56.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.100+0000 7f2c177fe700 1 --2- 172.21.15.154:0/698969437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180cd0b0 0x7f2c18069770 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f2c18065160 tx=0x7f2c1000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeefb0adb8b49b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:56.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c15ffb700 1 -- 172.21.15.154:0/698969437 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10010070 con 0x7f2c180cd0b0 2023-10-10T22:37:56.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c15ffb700 1 -- 172.21.15.154:0/698969437 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1000b2e0 con 0x7f2c180cd0b0 2023-10-10T22:37:56.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c15ffb700 1 -- 172.21.15.154:0/698969437 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000dca0 con 0x7f2c180cd0b0 2023-10-10T22:37:56.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/698969437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180cd0b0 msgr2=0x7f2c18069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c1d5ff700 1 --2- 172.21.15.154:0/698969437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180cd0b0 0x7f2c18069770 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f2c18065160 tx=0x7f2c1000b990 comp rx=0 tx=0).stop 2023-10-10T22:37:56.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/698969437 shutdown_connections 2023-10-10T22:37:56.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c1d5ff700 1 --2- 172.21.15.154:0/698969437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180cd0b0 0x7f2c18069770 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c1d5ff700 1 --2- 172.21.15.154:0/698969437 >> v2:172.21.15.179:3300/0 conn(0x7f2c180c70b0 0x7f2c18155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/698969437 >> 172.21.15.154:0/698969437 conn(0x7f2c18068e10 msgr2=0x7f2c180cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:56.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/698969437 shutdown_connections 2023-10-10T22:37:56.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.101+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/698969437 wait complete. 2023-10-10T22:37:56.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.103+0000 7f2c1d5ff700 1 Processor -- start 2023-10-10T22:37:56.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.103+0000 7f2c1d5ff700 1 -- start start 2023-10-10T22:37:56.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c1d5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180c70b0 0x7f2c18147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c1d5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c180ccc40 0x7f2c180ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c1d5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c180cd0b0 0x7f2c180a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c1d5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180a6410 con 0x7f2c180c70b0 2023-10-10T22:37:56.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c1d5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180ad730 con 0x7f2c180cd0b0 2023-10-10T22:37:56.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c1d5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180a6600 con 0x7f2c180ccc40 2023-10-10T22:37:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180c70b0 0x7f2c18147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180c70b0 0x7f2c18147130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59174/0 (socket says 172.21.15.154:59174) 2023-10-10T22:37:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c16ffd700 1 -- 172.21.15.154:0/2298648181 learned_addr learned my addr 172.21.15.154:0/2298648181 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c16ffd700 1 -- 172.21.15.154:0/2298648181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c180ccc40 msgr2=0x7f2c180ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c16ffd700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c180ccc40 0x7f2c180ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c16ffd700 1 -- 172.21.15.154:0/2298648181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c180cd0b0 msgr2=0x7f2c180a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c16ffd700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c180cd0b0 0x7f2c180a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.104+0000 7f2c16ffd700 1 -- 172.21.15.154:0/2298648181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1000bc30 con 0x7f2c180c70b0 2023-10-10T22:37:56.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.105+0000 7f2c16ffd700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180c70b0 0x7f2c18147130 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800ec80 tx=0x7f2c080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:56.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.105+0000 7f2bfeffd700 1 -- 172.21.15.154:0/2298648181 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800c9d0 con 0x7f2c180c70b0 2023-10-10T22:37:56.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.105+0000 7f2bfeffd700 1 -- 172.21.15.154:0/2298648181 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800cb30 con 0x7f2c180c70b0 2023-10-10T22:37:56.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.105+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c180ace00 con 0x7f2c180c70b0 2023-10-10T22:37:56.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.105+0000 7f2bfeffd700 1 -- 172.21.15.154:0/2298648181 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08013470 con 0x7f2c180c70b0 2023-10-10T22:37:56.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.105+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c180ad3c0 con 0x7f2c180c70b0 2023-10-10T22:37:56.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.106+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1804c3c0 con 0x7f2c180c70b0 2023-10-10T22:37:56.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.107+0000 7f2bfeffd700 1 -- 172.21.15.154:0/2298648181 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c08013820 con 0x7f2c180c70b0 2023-10-10T22:37:56.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.108+0000 7f2bfeffd700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c04066f30 0x7f2c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.108+0000 7f2bfeffd700 1 -- 172.21.15.154:0/2298648181 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f2c08084b20 con 0x7f2c180c70b0 2023-10-10T22:37:56.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.108+0000 7f2c167fc700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c04066f30 0x7f2c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:56.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.109+0000 7f2c167fc700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c04066f30 0x7f2c040693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007fd0 tx=0x7f2c0c0011a0 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:56.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.112+0000 7f2bfeffd700 1 -- 172.21.15.154:0/2298648181 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c08051bb0 con 0x7f2c180c70b0 2023-10-10T22:37:56.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.304+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f2c180aee60 con 0x7f2c180c70b0 2023-10-10T22:37:56.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.310+0000 7f2bfeffd700 1 -- 172.21.15.154:0/2298648181 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v75) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2c080551d0 con 0x7f2c180c70b0 2023-10-10T22:37:56.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c04066f30 msgr2=0x7f2c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c04066f30 0x7f2c040693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007fd0 tx=0x7f2c0c0011a0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180c70b0 msgr2=0x7f2c18147130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180c70b0 0x7f2c18147130 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800ec80 tx=0x7f2c080091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 shutdown_connections 2023-10-10T22:37:56.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f2c04066f30 0x7f2c040693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c180cd0b0 0x7f2c180a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c180c70b0 0x7f2c18147130 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 --2- 172.21.15.154:0/2298648181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c180ccc40 0x7f2c180ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.313+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 >> 172.21.15.154:0/2298648181 conn(0x7f2c18068e10 msgr2=0x7f2c180c7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:56.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.314+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 shutdown_connections 2023-10-10T22:37:56.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.314+0000 7f2c1d5ff700 1 -- 172.21.15.154:0/2298648181 wait complete. 2023-10-10T22:37:56.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-10T22:37:56.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.518+0000 7fe46e99d700 1 Processor -- start 2023-10-10T22:37:56.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.518+0000 7fe46e99d700 1 -- start start 2023-10-10T22:37:56.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.519+0000 7fe46e99d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe46806a660 0x7fe468157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.519+0000 7fe46e99d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46806e2a0 con 0x7fe468150180 2023-10-10T22:37:56.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.519+0000 7fe46e99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46806b2e0 con 0x7fe468150550 2023-10-10T22:37:56.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.519+0000 7fe46e99d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680c78e0 con 0x7fe46806a660 2023-10-10T22:37:56.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.519+0000 7fe46e19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe46806a660 0x7fe468157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:56.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.519+0000 7fe46e19c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe46806a660 0x7fe468157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59188/0 (socket says 172.21.15.154:59188) 2023-10-10T22:37:56.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.519+0000 7fe46e19c700 1 -- 172.21.15.154:0/3541763204 learned_addr learned my addr 172.21.15.154:0/3541763204 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:56.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.519+0000 7fe46d99b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe468150180 0x7fe4680c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34028/0 (socket says 172.21.15.154:34028) 2023-10-10T22:37:56.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.520+0000 7fe46e19c700 1 -- 172.21.15.154:0/3541763204 >> v1:172.21.15.179:6789/0 conn(0x7fe468150550 legacy=0x7fe468069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.520+0000 7fe46e19c700 1 -- 172.21.15.154:0/3541763204 >> v1:172.21.15.154:6789/0 conn(0x7fe468150180 legacy=0x7fe4680c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.520+0000 7fe46e19c700 1 -- 172.21.15.154:0/3541763204 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4680c7bc0 con 0x7fe46806a660 2023-10-10T22:37:56.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.520+0000 7fe46c999700 1 -- 172.21.15.154:0/3541763204 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046168480 0 0) 0x7fe46806e2a0 con 0x7fe468150180 2023-10-10T22:37:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.520+0000 7fe46e19c700 1 --2- 172.21.15.154:0/3541763204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46806a660 0x7fe468157770 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fe460009f50 tx=0x7fe460009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ea92690abbcc7f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.520+0000 7fe46c999700 1 -- 172.21.15.154:0/3541763204 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000e070 con 0x7fe46806a660 2023-10-10T22:37:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.520+0000 7fe46c999700 1 -- 172.21.15.154:0/3541763204 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46000ba70 con 0x7fe46806a660 2023-10-10T22:37:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.520+0000 7fe46c999700 1 -- 172.21.15.154:0/3541763204 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600092e0 con 0x7fe46806a660 2023-10-10T22:37:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.521+0000 7fe46e99d700 1 -- 172.21.15.154:0/3541763204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46806a660 msgr2=0x7fe468157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.521+0000 7fe46e99d700 1 --2- 172.21.15.154:0/3541763204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46806a660 0x7fe468157770 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fe460009f50 tx=0x7fe460009840 comp rx=0 tx=0).stop 2023-10-10T22:37:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.521+0000 7fe46e99d700 1 -- 172.21.15.154:0/3541763204 shutdown_connections 2023-10-10T22:37:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.521+0000 7fe46e99d700 1 --2- 172.21.15.154:0/3541763204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46806a660 0x7fe468157770 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.521+0000 7fe46e99d700 1 -- 172.21.15.154:0/3541763204 >> 172.21.15.154:0/3541763204 conn(0x7fe4680cc1f0 msgr2=0x7fe4680cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.521+0000 7fe46e99d700 1 -- 172.21.15.154:0/3541763204 shutdown_connections 2023-10-10T22:37:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.521+0000 7fe46e99d700 1 -- 172.21.15.154:0/3541763204 wait complete. 2023-10-10T22:37:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.522+0000 7fe46e99d700 1 Processor -- start 2023-10-10T22:37:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.522+0000 7fe46e99d700 1 -- start start 2023-10-10T22:37:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.523+0000 7fe46e99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe46806a660 0x7fe4680c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.523+0000 7fe46e99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe468150180 0x7fe46816d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.523+0000 7fe46e99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe468150550 0x7fe468168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.523+0000 7fe46e99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680ab0b0 con 0x7fe468150180 2023-10-10T22:37:56.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.523+0000 7fe46e99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680aa4a0 con 0x7fe468150550 2023-10-10T22:37:56.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.523+0000 7fe46e99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680aa780 con 0x7fe46806a660 2023-10-10T22:37:56.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d19a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe468150180 0x7fe46816d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:56.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d19a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe468150180 0x7fe46816d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59196/0 (socket says 172.21.15.154:59196) 2023-10-10T22:37:56.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d19a700 1 -- 172.21.15.154:0/3804577749 learned_addr learned my addr 172.21.15.154:0/3804577749 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:56.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46e19c700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe468150550 0x7fe468168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:56.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d99b700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe46806a660 0x7fe4680c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:56.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d19a700 1 -- 172.21.15.154:0/3804577749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe46806a660 msgr2=0x7fe4680c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d19a700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe46806a660 0x7fe4680c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d19a700 1 -- 172.21.15.154:0/3804577749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe468150550 msgr2=0x7fe468168e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:56.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d19a700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe468150550 0x7fe468168e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d19a700 1 -- 172.21.15.154:0/3804577749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009ae0 con 0x7fe468150180 2023-10-10T22:37:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe46d19a700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe468150180 0x7fe46816d170 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c4e0 tx=0x7fe45800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.524+0000 7fe45dffb700 1 -- 172.21.15.154:0/3804577749 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458011590 con 0x7fe468150180 2023-10-10T22:37:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.525+0000 7fe45dffb700 1 -- 172.21.15.154:0/3804577749 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe458011710 con 0x7fe468150180 2023-10-10T22:37:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.525+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4680aaa60 con 0x7fe468150180 2023-10-10T22:37:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.525+0000 7fe45dffb700 1 -- 172.21.15.154:0/3804577749 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458011ad0 con 0x7fe468150180 2023-10-10T22:37:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.525+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4680c1d00 con 0x7fe468150180 2023-10-10T22:37:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.526+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe468157420 con 0x7fe468150180 2023-10-10T22:37:56.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.526+0000 7fe45dffb700 1 -- 172.21.15.154:0/3804577749 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe458001020 con 0x7fe468150180 2023-10-10T22:37:56.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.527+0000 7fe45dffb700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe44c066f30 0x7fe44c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:56.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.527+0000 7fe45dffb700 1 -- 172.21.15.154:0/3804577749 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fe4580839b0 con 0x7fe468150180 2023-10-10T22:37:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.528+0000 7fe46d99b700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe44c066f30 0x7fe44c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.528+0000 7fe46d99b700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe44c066f30 0x7fe44c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe464007fd0 tx=0x7fe464007d30 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.531+0000 7fe45dffb700 1 -- 172.21.15.154:0/3804577749 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe458050a40 con 0x7fe468150180 2023-10-10T22:37:56.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:56.796+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fe46804c3c0 con 0x7fe468150180 2023-10-10T22:37:57.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.275+0000 7fe45dffb700 1 -- 172.21.15.154:0/3804577749 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3099) v1 ==== 155+0+0 (secure 0 0 0) 0x7fe458017070 con 0x7fe468150180 2023-10-10T22:37:57.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe44c066f30 msgr2=0x7fe44c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:57.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe44c066f30 0x7fe44c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe464007fd0 tx=0x7fe464007d30 comp rx=0 tx=0).stop 2023-10-10T22:37:57.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe468150180 msgr2=0x7fe46816d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:57.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe468150180 0x7fe46816d170 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c4e0 tx=0x7fe45800c7f0 comp rx=0 tx=0).stop 2023-10-10T22:37:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 shutdown_connections 2023-10-10T22:37:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe44c066f30 0x7fe44c0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe468150550 0x7fe468168e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:57.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe46806a660 0x7fe4680c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:57.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 --2- 172.21.15.154:0/3804577749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe468150180 0x7fe46816d170 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:57.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 >> 172.21.15.154:0/3804577749 conn(0x7fe4680cc1f0 msgr2=0x7fe4680cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:57.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 shutdown_connections 2023-10-10T22:37:57.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:57.278+0000 7fe46e99d700 1 -- 172.21.15.154:0/3804577749 wait complete. 2023-10-10T22:37:57.299 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-10-10T22:37:57.300 INFO:tasks.cephfs_test_runner: 2023-10-10T22:37:57.300 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-10T22:37:57.301 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5703.008s 2023-10-10T22:37:57.302 INFO:tasks.cephfs_test_runner: 2023-10-10T22:37:57.302 INFO:tasks.cephfs_test_runner:OK 2023-10-10T22:37:57.303 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-10T22:37:57.354 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-10T22:37:57.372 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-10T22:37:57.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:57.372 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T22:37:57.413 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-10T22:37:57.414 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-10T22:37:57.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:57.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-10T22:37:57.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:57.518 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-10T22:37:57.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:57.586 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-10-10T22:37:57.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:57.716 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-10-10T22:37:57.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:57.755 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-10-10T22:37:57.863 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2023-10-10T22:37:57.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T22:37:57.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:57.867 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-10T22:37:57.908 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-10T22:37:57.908 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-10T22:37:57.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:57.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-10T22:37:58.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:58.015 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-10T22:37:58.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:58.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-10T22:37:58.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:58.216 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-10T22:37:58.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-10T22:37:58.255 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-10T22:37:58.361 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-10-10T22:37:58.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T22:37:58.364 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-10T22:37:58.379 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-10T22:37:58.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:37:58.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.566+0000 7f738db9d700 1 Processor -- start 2023-10-10T22:37:58.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.566+0000 7f738db9d700 1 -- start start 2023-10-10T22:37:58.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.567+0000 7f738db9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7388150180 0x7f7388157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.567+0000 7f738db9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 0x7f73880c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.567+0000 7f738db9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738806e2a0 con 0x7f73880c7240 2023-10-10T22:37:58.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.567+0000 7f738db9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73880c76c0 con 0x7f7388150180 2023-10-10T22:37:58.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.567+0000 7f738db9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738806b2e0 con 0x7f7388150550 2023-10-10T22:37:58.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f738cb9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7388150180 0x7f7388157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f738cb9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7388150180 0x7f7388157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59202/0 (socket says 172.21.15.154:59202) 2023-10-10T22:37:58.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f738d39c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f73880c7240 0x7f738806e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34032/0 (socket says 172.21.15.154:34032) 2023-10-10T22:37:58.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f738cb9b700 1 -- 172.21.15.154:0/4260269737 learned_addr learned my addr 172.21.15.154:0/4260269737 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:58.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f7387fff700 1 --2- 172.21.15.154:0/4260269737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 0x7f73880c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f738cb9b700 1 -- 172.21.15.154:0/4260269737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 msgr2=0x7f73880c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:58.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f738cb9b700 1 --2- 172.21.15.154:0/4260269737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 0x7f73880c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f738cb9b700 1 -- 172.21.15.154:0/4260269737 >> v1:172.21.15.154:6789/0 conn(0x7f73880c7240 legacy=0x7f738806e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f738cb9b700 1 -- 172.21.15.154:0/4260269737 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73880c78e0 con 0x7f7388150180 2023-10-10T22:37:58.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f73877fe700 1 -- 172.21.15.154:0/4260269737 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746327067 0 0) 0x7f738806e2a0 con 0x7f73880c7240 2023-10-10T22:37:58.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.568+0000 7f738cb9b700 1 --2- 172.21.15.154:0/4260269737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7388150180 0x7f7388157770 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f737c0099e0 tx=0x7f737c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701df9d03f81615f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:58.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f73877fe700 1 -- 172.21.15.154:0/4260269737 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c00b820 con 0x7f7388150180 2023-10-10T22:37:58.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f73877fe700 1 -- 172.21.15.154:0/4260269737 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c00b980 con 0x7f7388150180 2023-10-10T22:37:58.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f73877fe700 1 -- 172.21.15.154:0/4260269737 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c00bd20 con 0x7f7388150180 2023-10-10T22:37:58.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f738db9d700 1 -- 172.21.15.154:0/4260269737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7388150180 msgr2=0x7f7388157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f738db9d700 1 --2- 172.21.15.154:0/4260269737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7388150180 0x7f7388157770 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f737c0099e0 tx=0x7f737c009250 comp rx=0 tx=0).stop 2023-10-10T22:37:58.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f738db9d700 1 -- 172.21.15.154:0/4260269737 shutdown_connections 2023-10-10T22:37:58.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f738db9d700 1 --2- 172.21.15.154:0/4260269737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7388150180 0x7f7388157770 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f738db9d700 1 --2- 172.21.15.154:0/4260269737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 0x7f73880c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f738db9d700 1 -- 172.21.15.154:0/4260269737 >> 172.21.15.154:0/4260269737 conn(0x7f73880cc1f0 msgr2=0x7f73880cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:58.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f738db9d700 1 -- 172.21.15.154:0/4260269737 shutdown_connections 2023-10-10T22:37:58.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.569+0000 7f738db9d700 1 -- 172.21.15.154:0/4260269737 wait complete. 2023-10-10T22:37:58.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.571+0000 7f738db9d700 1 Processor -- start 2023-10-10T22:37:58.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.571+0000 7f738db9d700 1 -- start start 2023-10-10T22:37:58.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738db9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73880c7240 0x7f73880c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738db9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7388150180 0x7f73880c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738db9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 0x7f73880c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738db9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73880c2ea0 con 0x7f73880c7240 2023-10-10T22:37:58.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738db9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73880c5ff0 con 0x7f7388150180 2023-10-10T22:37:58.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738db9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7388168bc0 con 0x7f7388150550 2023-10-10T22:37:58.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73880c7240 0x7f73880c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738cb9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73880c7240 0x7f73880c2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59204/0 (socket says 172.21.15.154:59204) 2023-10-10T22:37:58.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738cb9b700 1 -- 172.21.15.154:0/2569186309 learned_addr learned my addr 172.21.15.154:0/2569186309 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:58.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f738d39c700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 0x7f73880c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.572+0000 7f7387fff700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7388150180 0x7f73880c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f738cb9b700 1 -- 172.21.15.154:0/2569186309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 msgr2=0x7f73880c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f738cb9b700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 0x7f73880c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f738cb9b700 1 -- 172.21.15.154:0/2569186309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7388150180 msgr2=0x7f73880c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f738cb9b700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7388150180 0x7f73880c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f738cb9b700 1 -- 172.21.15.154:0/2569186309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0094f0 con 0x7f73880c7240 2023-10-10T22:37:58.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f738cb9b700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73880c7240 0x7f73880c2960 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f737c006fd0 tx=0x7f737c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:58.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f7384ff9700 1 -- 172.21.15.154:0/2569186309 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c011d70 con 0x7f73880c7240 2023-10-10T22:37:58.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f7384ff9700 1 -- 172.21.15.154:0/2569186309 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c024440 con 0x7f73880c7240 2023-10-10T22:37:58.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f7384ff9700 1 -- 172.21.15.154:0/2569186309 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c0247e0 con 0x7f73880c7240 2023-10-10T22:37:58.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7388168ea0 con 0x7f73880c7240 2023-10-10T22:37:58.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.573+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7388169460 con 0x7f73880c7240 2023-10-10T22:37:58.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.574+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738804c3c0 con 0x7f73880c7240 2023-10-10T22:37:58.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.575+0000 7f7384ff9700 1 -- 172.21.15.154:0/2569186309 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f737c01a420 con 0x7f73880c7240 2023-10-10T22:37:58.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.576+0000 7f7384ff9700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f736c066f30 0x7f736c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.576+0000 7f7384ff9700 1 -- 172.21.15.154:0/2569186309 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f737c0864e0 con 0x7f73880c7240 2023-10-10T22:37:58.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.576+0000 7f7387fff700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f736c066f30 0x7f736c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.577+0000 7f7387fff700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f736c066f30 0x7f736c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7388156f70 tx=0x7f737400b430 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:58.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.580+0000 7f7384ff9700 1 -- 172.21.15.154:0/2569186309 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f737c053570 con 0x7f73880c7240 2023-10-10T22:37:58.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.774+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73880b1dc0 con 0x7f73880c7240 2023-10-10T22:37:58.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.775+0000 7f7384ff9700 1 -- 172.21.15.154:0/2569186309 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v214) v1 ==== 74+0+13942 (secure 0 0 0) 0x7f737c056b90 con 0x7f73880c7240 2023-10-10T22:37:58.776 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:58.776 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":214,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:55.033426+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2173690594":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/3079321288":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/3605067162":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/1114916960":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/4026722393":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/2656510021":"2023-10-11T22:37:53.011021+0000","172.21.15.179:6835/1275463629":"2023-10-11T22:37:52.009377+0000","172.21.15.179:6833/1275463629":"2023-10-11T22:37:52.009377+0000","172.21.15.154:0/3458335740":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/3394882299":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/1691610567":"2023-10-11T22:37:42.558235+0000","172.21.15.154:6837/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/2976821250":"2023-10-11T22:37:53.011021+0000","172.21.15.154:6836/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/4135556396":"2023-10-11T22:37:42.558235+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:37:58.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f736c066f30 msgr2=0x7f736c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f736c066f30 0x7f736c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7388156f70 tx=0x7f737400b430 comp rx=0 tx=0).stop 2023-10-10T22:37:58.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73880c7240 msgr2=0x7f73880c2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73880c7240 0x7f73880c2960 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f737c006fd0 tx=0x7f737c017000 comp rx=0 tx=0).stop 2023-10-10T22:37:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 shutdown_connections 2023-10-10T22:37:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f736c066f30 0x7f736c0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7388150550 0x7f73880c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73880c7240 0x7f73880c2960 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 --2- 172.21.15.154:0/2569186309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7388150180 0x7f73880c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 >> 172.21.15.154:0/2569186309 conn(0x7f73880cc1f0 msgr2=0x7f7388069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:58.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 shutdown_connections 2023-10-10T22:37:58.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.777+0000 7f738db9d700 1 -- 172.21.15.154:0/2569186309 wait complete. 2023-10-10T22:37:58.797 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-10T22:37:58.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:37:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.978+0000 7f74161ff700 1 Processor -- start 2023-10-10T22:37:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.978+0000 7f74161ff700 1 -- start start 2023-10-10T22:37:58.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.979+0000 7f74161ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7410069ac0 0x7f741006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.979+0000 7f74161ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74100c96a0 con 0x7f74101599e0 2023-10-10T22:37:58.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.979+0000 7f74161ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74100cb9e0 con 0x7f7410159db0 2023-10-10T22:37:58.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.979+0000 7f74161ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74100cab60 con 0x7f7410069ac0 2023-10-10T22:37:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.980+0000 7f740ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7410069ac0 0x7f741006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.980+0000 7f740ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7410069ac0 0x7f741006a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59210/0 (socket says 172.21.15.154:59210) 2023-10-10T22:37:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.980+0000 7f740f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f74101599e0 0x7f7410069080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34034/0 (socket says 172.21.15.154:34034) 2023-10-10T22:37:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.980+0000 7f740ffff700 1 -- 172.21.15.154:0/653249006 learned_addr learned my addr 172.21.15.154:0/653249006 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:58.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.980+0000 7f740ffff700 1 -- 172.21.15.154:0/653249006 >> v1:172.21.15.179:6789/0 conn(0x7f7410159db0 legacy=0x7f741006a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:58.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.980+0000 7f740ffff700 1 -- 172.21.15.154:0/653249006 >> v1:172.21.15.154:6789/0 conn(0x7f74101599e0 legacy=0x7f7410069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.980+0000 7f740ffff700 1 -- 172.21.15.154:0/653249006 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100cb420 con 0x7f7410069ac0 2023-10-10T22:37:58.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.980+0000 7f740e7fc700 1 -- 172.21.15.154:0/653249006 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517138968 0 0) 0x7f74100c96a0 con 0x7f74101599e0 2023-10-10T22:37:58.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.980+0000 7f740ffff700 1 --2- 172.21.15.154:0/653249006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7410069ac0 0x7f741006a9c0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f7408009f20 tx=0x7f7408009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46ab273402c7cbc server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:58.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f740e7fc700 1 -- 172.21.15.154:0/653249006 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800e070 con 0x7f7410069ac0 2023-10-10T22:37:58.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f740e7fc700 1 -- 172.21.15.154:0/653249006 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740800ba40 con 0x7f7410069ac0 2023-10-10T22:37:58.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f740e7fc700 1 -- 172.21.15.154:0/653249006 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080092e0 con 0x7f7410069ac0 2023-10-10T22:37:58.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f74161ff700 1 -- 172.21.15.154:0/653249006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7410069ac0 msgr2=0x7f741006a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f74161ff700 1 --2- 172.21.15.154:0/653249006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7410069ac0 0x7f741006a9c0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f7408009f20 tx=0x7f7408009840 comp rx=0 tx=0).stop 2023-10-10T22:37:58.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f74161ff700 1 -- 172.21.15.154:0/653249006 shutdown_connections 2023-10-10T22:37:58.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f74161ff700 1 --2- 172.21.15.154:0/653249006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7410069ac0 0x7f741006a9c0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f74161ff700 1 -- 172.21.15.154:0/653249006 >> 172.21.15.154:0/653249006 conn(0x7f74100c9860 msgr2=0x7f74100c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:58.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f74161ff700 1 -- 172.21.15.154:0/653249006 shutdown_connections 2023-10-10T22:37:58.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.981+0000 7f74161ff700 1 -- 172.21.15.154:0/653249006 wait complete. 2023-10-10T22:37:58.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.983+0000 7f74161ff700 1 Processor -- start 2023-10-10T22:37:58.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.983+0000 7f74161ff700 1 -- start start 2023-10-10T22:37:58.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f74161ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7410069ac0 0x7f74100b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f74161ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74101599e0 0x7f741016d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f74161ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7410159db0 0x7f7410147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f74161ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741016dc60 con 0x7f74101599e0 2023-10-10T22:37:58.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f74161ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100b2440 con 0x7f7410069ac0 2023-10-10T22:37:58.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f74161ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74100afd60 con 0x7f7410159db0 2023-10-10T22:37:58.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f740effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74101599e0 0x7f741016d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7410069ac0 0x7f74100b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7410069ac0 0x7f74100b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:36802/0 (socket says 172.21.15.154:36802) 2023-10-10T22:37:58.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f740f7fe700 1 -- 172.21.15.154:0/1781006995 learned_addr learned my addr 172.21.15.154:0/1781006995 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:58.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f740effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74101599e0 0x7f741016d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59220/0 (socket says 172.21.15.154:59220) 2023-10-10T22:37:58.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.984+0000 7f740ffff700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7410159db0 0x7f7410147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f740effd700 1 -- 172.21.15.154:0/1781006995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7410159db0 msgr2=0x7f7410147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f740effd700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7410159db0 0x7f7410147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f740effd700 1 -- 172.21.15.154:0/1781006995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7410069ac0 msgr2=0x7f74100b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:58.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f740effd700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7410069ac0 0x7f74100b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:58.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f740effd700 1 -- 172.21.15.154:0/1781006995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408009ae0 con 0x7f74101599e0 2023-10-10T22:37:58.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f740effd700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74101599e0 0x7f741016d720 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f740400b490 tx=0x7f7404009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:58.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f73f77fe700 1 -- 172.21.15.154:0/1781006995 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400be40 con 0x7f74101599e0 2023-10-10T22:37:58.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f73f77fe700 1 -- 172.21.15.154:0/1781006995 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400f510 con 0x7f74101599e0 2023-10-10T22:37:58.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74100b0000 con 0x7f74101599e0 2023-10-10T22:37:58.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f73f77fe700 1 -- 172.21.15.154:0/1781006995 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400f8d0 con 0x7f74101599e0 2023-10-10T22:37:58.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.985+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7410147d70 con 0x7f74101599e0 2023-10-10T22:37:58.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.986+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74100b2230 con 0x7f74101599e0 2023-10-10T22:37:58.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.987+0000 7f73f77fe700 1 -- 172.21.15.154:0/1781006995 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f740400fcc0 con 0x7f74101599e0 2023-10-10T22:37:58.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.988+0000 7f73f77fe700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f73fc066f30 0x7f73fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:58.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.988+0000 7f73f77fe700 1 -- 172.21.15.154:0/1781006995 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f7404083fb0 con 0x7f74101599e0 2023-10-10T22:37:58.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.988+0000 7f740f7fe700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f73fc066f30 0x7f73fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:58.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.989+0000 7f740f7fe700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f73fc066f30 0x7f73fc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7400007fd0 tx=0x7f7400007e10 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:58.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:58.992+0000 7f73f77fe700 1 -- 172.21.15.154:0/1781006995 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74040510c0 con 0x7f74101599e0 2023-10-10T22:37:59.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.180+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f741004c3c0 con 0x7f73fc066f30 2023-10-10T22:37:59.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.182+0000 7f73f77fe700 1 -- 172.21.15.154:0/1781006995 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50651 (secure 0 0 0) 0x7f741004c3c0 con 0x7f73fc066f30 2023-10-10T22:37:59.185 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:59.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f73fc066f30 msgr2=0x7f73fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f73fc066f30 0x7f73fc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7400007fd0 tx=0x7f7400007e10 comp rx=0 tx=0).stop 2023-10-10T22:37:59.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74101599e0 msgr2=0x7f741016d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74101599e0 0x7f741016d720 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f740400b490 tx=0x7f7404009060 comp rx=0 tx=0).stop 2023-10-10T22:37:59.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 shutdown_connections 2023-10-10T22:37:59.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f73fc066f30 0x7f73fc0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7410159db0 0x7f7410147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7410069ac0 0x7f74100b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 --2- 172.21.15.154:0/1781006995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74101599e0 0x7f741016d720 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 >> 172.21.15.154:0/1781006995 conn(0x7f74100c9860 msgr2=0x7f74100c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:59.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 shutdown_connections 2023-10-10T22:37:59.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.185+0000 7f74161ff700 1 -- 172.21.15.154:0/1781006995 wait complete. 2023-10-10T22:37:59.189 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:37:59.203 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-10T22:37:59.030389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2467044,"kb_used_data":23204,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752507676,"statfs":{"total":773094113280,"available":770567860224,"internally_reserved":0,"allocated":23760896,"data_stored":13187355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.981929"},"pg_stats":[{"pgid":"1.0","version":"212'370","reported_seq":1226,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-10T22:37:53.103993+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:37:53.103993+0000","last_peered":"2023-10-10T22:37:53.103993+0000","last_clean":"2023-10-10T22:37:53.103993+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:37:53.103993+0000","last_undegraded":"2023-10-10T22:37:53.103993+0000","last_fullsized":"2023-10-10T22:37:53.103993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543279,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313076,"kb_used_data":3500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94058764,"statfs":{"total":96636764160,"available":96316174336,"internally_reserved":0,"allocated":3584000,"data_stored":2255136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.026},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":1.073,"15min":1.081},"last":0.747}]},{"osd":1,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":1.145,"15min":1.145},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":1.0700000000000001},"last":0.58799999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":1.0009999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.503,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":0.82299999999999995,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.024},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":0.999,"15min":1.079},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.86199999999999999,"5min":1.046,"15min":1.125},"last":0.56799999999999995}]}]},{"osd":6,"up_from":14,"seq":60129543278,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299868,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071972,"statfs":{"total":96636764160,"available":96329699328,"internally_reserved":0,"allocated":2641920,"data_stored":1329084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":1.0289999999999999,"15min":1.1080000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.751},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.0920000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.64500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94299999999999995,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.68200000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.034,"15min":1.1200000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.0660000000000001},"last":0.441}]},{"osd":3,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.621,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91200000000000003,"5min":0.97399999999999998,"15min":1.071},"last":0.621}]},{"osd":4,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":1.778,"15min":1.778},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.86899999999999999,"5min":0.996,"15min":1.046},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.51000000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97299999999999998,"5min":1.827,"15min":1.827},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.64700000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543278,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312504,"kb_used_data":2928,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059336,"statfs":{"total":96636764160,"available":96316760064,"internally_reserved":0,"allocated":2998272,"data_stored":1676084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.82999999999999996,"15min":0.88},"last":0.442}]},{"osd":2,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.878,"15min":0.90800000000000003},"last":0.629},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.88800000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.74399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.995,"5min":1.0269999999999999,"15min":1.177},"last":0.57099999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.008,"5min":1.089,"15min":1.1419999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.2450000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.64300000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.081,"5min":1.1200000000000001,"15min":1.2729999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.155},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.68600000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.2230000000000001},"last":0.753}]}]},{"osd":0,"up_from":14,"seq":60129543280,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308972,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062868,"statfs":{"total":96636764160,"available":96320376832,"internally_reserved":0,"allocated":3575808,"data_stored":2254502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.71399999999999997,"15min":0.753},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.76000000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.85299999999999998},"last":0.441}]},{"osd":3,"last update":"Tue Oct 10 22:37:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.81100000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.625,"15min":0.625},"min":{"1min":0.502,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.54300000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0469999999999999,"5min":1.1180000000000001,"15min":1.3340000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.1479999999999999,"15min":1.198},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56899999999999995},"max":{"1min":1.0449999999999999,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.625,"5min":0.54800000000000004,"15min":0.54500000000000004},"max":{"1min":1.1439999999999999,"5min":1.3320000000000001,"15min":1.377},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0449999999999999,"5min":1.274,"15min":1.427},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.198,"5min":1.224,"15min":1.2689999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.081,"5min":1.153,"15min":1.153},"last":0.83799999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543280,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316260,"kb_used_data":2588,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055580,"statfs":{"total":96636764160,"available":96312913920,"internally_reserved":0,"allocated":2650112,"data_stored":1329649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.317},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.89500000000000002},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65200000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.85699999999999998,"15min":0.85799999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.101,"15min":1.288},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98599999999999999,"5min":1.1220000000000001,"15min":1.325},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.147,"15min":1.1970000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82199999999999995,"15min":0.84099999999999997},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.054,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.26},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.093,"5min":1.165,"15min":1.3129999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80600000000000005,"15min":0.83199999999999996},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.181,"15min":1.2609999999999999},"last":0.52400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424510575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316584,"kb_used_data":2912,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055256,"statfs":{"total":96636764160,"available":96312582144,"internally_reserved":0,"allocated":2981888,"data_stored":1657409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.38200000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.877,"15min":0.877},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.70599999999999996,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":0.99399999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.04,"5min":1.133,"15min":1.242},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.202,"15min":1.2629999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.125,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":1.1040000000000001,"15min":1.222},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.099,"5min":1.1539999999999999,"15min":1.212},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.54200000000000004},"max":{"1min":0.98899999999999999,"5min":1.274,"15min":1.274},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":0.83499999999999996},"min":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56699999999999995},"max":{"1min":1.097,"5min":1.149,"15min":1.2370000000000001},"last":0.74299999999999999}]}]},{"osd":4,"up_from":14,"seq":60129543280,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299900,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071940,"statfs":{"total":96636764160,"available":96329666560,"internally_reserved":0,"allocated":2674688,"data_stored":1348958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.087},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.752},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.437},"max":{"1min":0.94099999999999995,"5min":0.95199999999999996,"15min":1.1220000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88500000000000001,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.998,"15min":1.073},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.089},"last":0.64500000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.45200000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.4079999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":1.282},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.94099999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.94099999999999995,"15min":1.0900000000000001},"last":0.83699999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.42199999999999999},"max":{"1min":0.82099999999999995,"5min":0.89600000000000002,"15min":1.0649999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.0629999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.92100000000000004,"5min":0.96999999999999997,"15min":1.21},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.436},"max":{"1min":0.97399999999999998,"5min":0.97999999999999998,"15min":1.147},"last":0.85599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129543278,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299880,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071960,"statfs":{"total":96636764160,"available":96329687040,"internally_reserved":0,"allocated":2654208,"data_stored":1336533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":1.006},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.48199999999999998,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.997},"last":0.53900000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.98999999999999999,"15min":1.04},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.02},"last":0.434}]},{"osd":4,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.37},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.01,"5min":1.01,"15min":1.032},"last":0.59699999999999998}]},{"osd":7,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.02},"last":0.51900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:37:59.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:37:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.392+0000 7fe7aa99d700 1 Processor -- start 2023-10-10T22:37:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.392+0000 7fe7aa99d700 1 -- start start 2023-10-10T22:37:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.394+0000 7fe7aa99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7a4150180 0x7fe7a4157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.394+0000 7fe7aa99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a4150550 0x7fe7a40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.394+0000 7fe7aa99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a406e2a0 con 0x7fe7a40c7240 2023-10-10T22:37:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.394+0000 7fe7aa99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a40c76c0 con 0x7fe7a4150180 2023-10-10T22:37:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.394+0000 7fe7aa99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a406b2e0 con 0x7fe7a4150550 2023-10-10T22:37:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.394+0000 7fe7a999b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7a4150180 0x7fe7a4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.394+0000 7fe7a919a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a4150550 0x7fe7a40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.394+0000 7fe7aa19c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe7a40c7240 0x7fe7a4069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44326/0 (socket says 172.21.15.154:44326) 2023-10-10T22:37:59.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.394+0000 7fe7aa19c700 1 -- 172.21.15.154:0/591314999 learned_addr learned my addr 172.21.15.154:0/591314999 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:37:59.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.395+0000 7fe7a8999700 1 -- 172.21.15.154:0/591314999 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401473442 0 0) 0x7fe7a406e2a0 con 0x7fe7a40c7240 2023-10-10T22:37:59.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.395+0000 7fe7a999b700 1 -- 172.21.15.154:0/591314999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a4150550 msgr2=0x7fe7a40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:59.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.395+0000 7fe7a999b700 1 --2- 172.21.15.154:0/591314999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a4150550 0x7fe7a40c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.395+0000 7fe7a999b700 1 -- 172.21.15.154:0/591314999 >> v1:172.21.15.179:6789/0 conn(0x7fe7a40c7240 legacy=0x7fe7a4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.395+0000 7fe7a999b700 1 -- 172.21.15.154:0/591314999 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a40c78e0 con 0x7fe7a4150180 2023-10-10T22:37:59.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.395+0000 7fe7a919a700 1 --2- 172.21.15.154:0/591314999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a4150550 0x7fe7a40c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:37:59.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.395+0000 7fe7a999b700 1 --2- 172.21.15.154:0/591314999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150180 0x7fe7a4157770 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009910 tx=0x7fe7a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1af75b585f69a01 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:59.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.395+0000 7fe7a8999700 1 -- 172.21.15.154:0/591314999 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000b640 con 0x7fe7a4150180 2023-10-10T22:37:59.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7a8999700 1 -- 172.21.15.154:0/591314999 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a000b7a0 con 0x7fe7a4150180 2023-10-10T22:37:59.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7a8999700 1 -- 172.21.15.154:0/591314999 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000bb60 con 0x7fe7a4150180 2023-10-10T22:37:59.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7aa99d700 1 -- 172.21.15.154:0/591314999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150180 msgr2=0x7fe7a4157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7aa99d700 1 --2- 172.21.15.154:0/591314999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150180 0x7fe7a4157770 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009910 tx=0x7fe7a00091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7aa99d700 1 -- 172.21.15.154:0/591314999 shutdown_connections 2023-10-10T22:37:59.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7aa99d700 1 --2- 172.21.15.154:0/591314999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150180 0x7fe7a4157770 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7aa99d700 1 --2- 172.21.15.154:0/591314999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a4150550 0x7fe7a40c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7aa99d700 1 -- 172.21.15.154:0/591314999 >> 172.21.15.154:0/591314999 conn(0x7fe7a40cc1f0 msgr2=0x7fe7a40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:59.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7aa99d700 1 -- 172.21.15.154:0/591314999 shutdown_connections 2023-10-10T22:37:59.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.396+0000 7fe7aa99d700 1 -- 172.21.15.154:0/591314999 wait complete. 2023-10-10T22:37:59.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.398+0000 7fe7aa99d700 1 Processor -- start 2023-10-10T22:37:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.398+0000 7fe7aa99d700 1 -- start start 2023-10-10T22:37:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7aa99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a40c7240 0x7fe7a40ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7aa99d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7a4150180 0x7fe7a40c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7aa99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150550 0x7fe7a41408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7aa99d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40ad7c0 con 0x7fe7a4150180 2023-10-10T22:37:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7aa99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40adaa0 con 0x7fe7a4150550 2023-10-10T22:37:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7aa99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40add80 con 0x7fe7a40c7240 2023-10-10T22:37:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a919a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7a4150180 0x7fe7a40c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a919a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7a4150180 0x7fe7a40c2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59222/0 (socket says 172.21.15.154:59222) 2023-10-10T22:37:59.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a919a700 1 -- 172.21.15.154:0/2156225883 learned_addr learned my addr 172.21.15.154:0/2156225883 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a999b700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a40c7240 0x7fe7a40ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7aa19c700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150550 0x7fe7a41408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a919a700 1 -- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a40c7240 msgr2=0x7fe7a40ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a919a700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a40c7240 0x7fe7a40ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a919a700 1 -- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150550 msgr2=0x7fe7a41408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a919a700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150550 0x7fe7a41408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a919a700 1 -- 172.21.15.154:0/2156225883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009420 con 0x7fe7a4150180 2023-10-10T22:37:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7aa19c700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150550 0x7fe7a41408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.399+0000 7fe7a999b700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a40c7240 0x7fe7a40ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:37:59.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.400+0000 7fe7a919a700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7a4150180 0x7fe7a40c2120 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fe79400ec80 tx=0x7fe7940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.400+0000 7fe799ffb700 1 -- 172.21.15.154:0/2156225883 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400c9d0 con 0x7fe7a4150180 2023-10-10T22:37:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.400+0000 7fe799ffb700 1 -- 172.21.15.154:0/2156225883 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400cb30 con 0x7fe7a4150180 2023-10-10T22:37:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.400+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a0009420 con 0x7fe7a4150180 2023-10-10T22:37:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.400+0000 7fe799ffb700 1 -- 172.21.15.154:0/2156225883 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400ceb0 con 0x7fe7a4150180 2023-10-10T22:37:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.400+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a40af4b0 con 0x7fe7a4150180 2023-10-10T22:37:59.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.401+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a40ae220 con 0x7fe7a4150180 2023-10-10T22:37:59.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.402+0000 7fe799ffb700 1 -- 172.21.15.154:0/2156225883 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe794013680 con 0x7fe7a4150180 2023-10-10T22:37:59.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.403+0000 7fe799ffb700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe788066f00 0x7fe7880693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.403+0000 7fe799ffb700 1 -- 172.21.15.154:0/2156225883 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fe794084b00 con 0x7fe7a4150180 2023-10-10T22:37:59.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.403+0000 7fe7a999b700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe788066f00 0x7fe7880693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.404+0000 7fe7a999b700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe788066f00 0x7fe7880693b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00091e0 tx=0x7fe7a0017000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:59.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.407+0000 7fe799ffb700 1 -- 172.21.15.154:0/2156225883 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe794086e60 con 0x7fe7a4150180 2023-10-10T22:37:59.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.594+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7a404c3c0 con 0x7fe788066f00 2023-10-10T22:37:59.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.596+0000 7fe799ffb700 1 -- 172.21.15.154:0/2156225883 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50651 (secure 0 0 0) 0x7fe7a404c3c0 con 0x7fe788066f00 2023-10-10T22:37:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:37:59.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe788066f00 msgr2=0x7fe7880693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe788066f00 0x7fe7880693b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00091e0 tx=0x7fe7a0017000 comp rx=0 tx=0).stop 2023-10-10T22:37:59.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7a4150180 msgr2=0x7fe7a40c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7a4150180 0x7fe7a40c2120 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fe79400ec80 tx=0x7fe7940091a0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 shutdown_connections 2023-10-10T22:37:59.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe788066f00 0x7fe7880693b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a4150550 0x7fe7a41408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a40c7240 0x7fe7a40ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 --2- 172.21.15.154:0/2156225883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7a4150180 0x7fe7a40c2120 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 >> 172.21.15.154:0/2156225883 conn(0x7fe7a40cc1f0 msgr2=0x7fe7a4157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:59.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 shutdown_connections 2023-10-10T22:37:59.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.599+0000 7fe7aa99d700 1 -- 172.21.15.154:0/2156225883 wait complete. 2023-10-10T22:37:59.604 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:37:59.618 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-10T22:37:59.030389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2467044,"kb_used_data":23204,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752507676,"statfs":{"total":773094113280,"available":770567860224,"internally_reserved":0,"allocated":23760896,"data_stored":13187355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.981929"},"pg_stats":[{"pgid":"1.0","version":"212'370","reported_seq":1226,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-10T22:37:53.103993+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:37:53.103993+0000","last_peered":"2023-10-10T22:37:53.103993+0000","last_clean":"2023-10-10T22:37:53.103993+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:37:53.103993+0000","last_undegraded":"2023-10-10T22:37:53.103993+0000","last_fullsized":"2023-10-10T22:37:53.103993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543279,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313076,"kb_used_data":3500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94058764,"statfs":{"total":96636764160,"available":96316174336,"internally_reserved":0,"allocated":3584000,"data_stored":2255136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.026},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":1.073,"15min":1.081},"last":0.747}]},{"osd":1,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":1.145,"15min":1.145},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":1.0700000000000001},"last":0.58799999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":1.0009999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.503,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":0.82299999999999995,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.024},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":0.999,"15min":1.079},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.86199999999999999,"5min":1.046,"15min":1.125},"last":0.56799999999999995}]}]},{"osd":6,"up_from":14,"seq":60129543278,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299868,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071972,"statfs":{"total":96636764160,"available":96329699328,"internally_reserved":0,"allocated":2641920,"data_stored":1329084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":1.0289999999999999,"15min":1.1080000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.751},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.0920000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.64500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94299999999999995,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.68200000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.034,"15min":1.1200000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.0660000000000001},"last":0.441}]},{"osd":3,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.621,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91200000000000003,"5min":0.97399999999999998,"15min":1.071},"last":0.621}]},{"osd":4,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":1.778,"15min":1.778},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.86899999999999999,"5min":0.996,"15min":1.046},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.51000000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97299999999999998,"5min":1.827,"15min":1.827},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.64700000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543278,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312504,"kb_used_data":2928,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059336,"statfs":{"total":96636764160,"available":96316760064,"internally_reserved":0,"allocated":2998272,"data_stored":1676084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.82999999999999996,"15min":0.88},"last":0.442}]},{"osd":2,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.878,"15min":0.90800000000000003},"last":0.629},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.88800000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.74399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.995,"5min":1.0269999999999999,"15min":1.177},"last":0.57099999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.008,"5min":1.089,"15min":1.1419999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.2450000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.64300000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.081,"5min":1.1200000000000001,"15min":1.2729999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.155},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.68600000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.2230000000000001},"last":0.753}]}]},{"osd":0,"up_from":14,"seq":60129543280,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308972,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062868,"statfs":{"total":96636764160,"available":96320376832,"internally_reserved":0,"allocated":3575808,"data_stored":2254502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.71399999999999997,"15min":0.753},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.76000000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.85299999999999998},"last":0.441}]},{"osd":3,"last update":"Tue Oct 10 22:37:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.81100000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.625,"15min":0.625},"min":{"1min":0.502,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.54300000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0469999999999999,"5min":1.1180000000000001,"15min":1.3340000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.1479999999999999,"15min":1.198},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56899999999999995},"max":{"1min":1.0449999999999999,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.625,"5min":0.54800000000000004,"15min":0.54500000000000004},"max":{"1min":1.1439999999999999,"5min":1.3320000000000001,"15min":1.377},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0449999999999999,"5min":1.274,"15min":1.427},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.198,"5min":1.224,"15min":1.2689999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.081,"5min":1.153,"15min":1.153},"last":0.83799999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543280,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316260,"kb_used_data":2588,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055580,"statfs":{"total":96636764160,"available":96312913920,"internally_reserved":0,"allocated":2650112,"data_stored":1329649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.317},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.89500000000000002},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65200000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.85699999999999998,"15min":0.85799999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.101,"15min":1.288},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98599999999999999,"5min":1.1220000000000001,"15min":1.325},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.147,"15min":1.1970000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82199999999999995,"15min":0.84099999999999997},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.054,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.26},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.093,"5min":1.165,"15min":1.3129999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80600000000000005,"15min":0.83199999999999996},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.181,"15min":1.2609999999999999},"last":0.52400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424510575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316584,"kb_used_data":2912,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055256,"statfs":{"total":96636764160,"available":96312582144,"internally_reserved":0,"allocated":2981888,"data_stored":1657409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.38200000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.877,"15min":0.877},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.70599999999999996,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":0.99399999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.04,"5min":1.133,"15min":1.242},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.202,"15min":1.2629999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.125,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":1.1040000000000001,"15min":1.222},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.099,"5min":1.1539999999999999,"15min":1.212},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.54200000000000004},"max":{"1min":0.98899999999999999,"5min":1.274,"15min":1.274},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":0.83499999999999996},"min":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56699999999999995},"max":{"1min":1.097,"5min":1.149,"15min":1.2370000000000001},"last":0.74299999999999999}]}]},{"osd":4,"up_from":14,"seq":60129543280,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299900,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071940,"statfs":{"total":96636764160,"available":96329666560,"internally_reserved":0,"allocated":2674688,"data_stored":1348958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.087},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.752},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.437},"max":{"1min":0.94099999999999995,"5min":0.95199999999999996,"15min":1.1220000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88500000000000001,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.998,"15min":1.073},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.089},"last":0.64500000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.45200000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.4079999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":1.282},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.94099999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.94099999999999995,"15min":1.0900000000000001},"last":0.83699999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.42199999999999999},"max":{"1min":0.82099999999999995,"5min":0.89600000000000002,"15min":1.0649999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.0629999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.92100000000000004,"5min":0.96999999999999997,"15min":1.21},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.436},"max":{"1min":0.97399999999999998,"5min":0.97999999999999998,"15min":1.147},"last":0.85599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129543278,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299880,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071960,"statfs":{"total":96636764160,"available":96329687040,"internally_reserved":0,"allocated":2654208,"data_stored":1336533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":1.006},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.48199999999999998,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.997},"last":0.53900000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.98999999999999999,"15min":1.04},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.02},"last":0.434}]},{"osd":4,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.37},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.01,"5min":1.01,"15min":1.032},"last":0.59699999999999998}]},{"osd":7,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.02},"last":0.51900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:37:59.620 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-10T22:37:59.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:37:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.802+0000 7f0d3abff700 1 Processor -- start 2023-10-10T22:37:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.802+0000 7f0d3abff700 1 -- start start 2023-10-10T22:37:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3abff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d34155c10 0x7f0d34155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3abff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0d340ac230 0x7f0d340ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3abff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340ad930 con 0x7f0d341568a0 2023-10-10T22:37:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3abff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d340acd20 con 0x7f0d34155c10 2023-10-10T22:37:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3abff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d340ad000 con 0x7f0d340ac230 2023-10-10T22:37:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3899b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d34155c10 0x7f0d34155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3899b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d34155c10 0x7f0d34155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59226/0 (socket says 172.21.15.154:59226) 2023-10-10T22:37:59.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3899b700 1 -- 172.21.15.154:0/2503788968 learned_addr learned my addr 172.21.15.154:0/2503788968 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:59.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d33fff700 1 --2- 172.21.15.154:0/2503788968 >> v2:172.21.15.179:3300/0 conn(0x7f0d340ac230 0x7f0d340ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3899b700 1 -- 172.21.15.154:0/2503788968 >> v2:172.21.15.179:3300/0 conn(0x7f0d340ac230 msgr2=0x7f0d340ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:59.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3899b700 1 --2- 172.21.15.154:0/2503788968 >> v2:172.21.15.179:3300/0 conn(0x7f0d340ac230 0x7f0d340ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.804+0000 7f0d3899b700 1 -- 172.21.15.154:0/2503788968 >> v1:172.21.15.179:6789/0 conn(0x7f0d341568a0 legacy=0x7f0d34156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:37:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.805+0000 7f0d3899b700 1 -- 172.21.15.154:0/2503788968 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340ad2e0 con 0x7f0d34155c10 2023-10-10T22:37:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.805+0000 7f0d3899b700 1 --2- 172.21.15.154:0/2503788968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34155c10 0x7f0d34155fe0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f0d34065bb0 tx=0x7f0d2800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af43a66247b605f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.805+0000 7f0d337fe700 1 -- 172.21.15.154:0/2503788968 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2800ca40 con 0x7f0d34155c10 2023-10-10T22:37:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.805+0000 7f0d337fe700 1 -- 172.21.15.154:0/2503788968 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2800cba0 con 0x7f0d34155c10 2023-10-10T22:37:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.805+0000 7f0d337fe700 1 -- 172.21.15.154:0/2503788968 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28018400 con 0x7f0d34155c10 2023-10-10T22:37:59.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.805+0000 7f0d3abff700 1 -- 172.21.15.154:0/2503788968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34155c10 msgr2=0x7f0d34155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.805+0000 7f0d3abff700 1 --2- 172.21.15.154:0/2503788968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34155c10 0x7f0d34155fe0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f0d34065bb0 tx=0x7f0d2800a3f0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.806+0000 7f0d3abff700 1 -- 172.21.15.154:0/2503788968 shutdown_connections 2023-10-10T22:37:59.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.806+0000 7f0d3abff700 1 --2- 172.21.15.154:0/2503788968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34155c10 0x7f0d34155fe0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.806+0000 7f0d3abff700 1 --2- 172.21.15.154:0/2503788968 >> v2:172.21.15.179:3300/0 conn(0x7f0d340ac230 0x7f0d340ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.806+0000 7f0d3abff700 1 -- 172.21.15.154:0/2503788968 >> 172.21.15.154:0/2503788968 conn(0x7f0d3406a320 msgr2=0x7f0d340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:37:59.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.806+0000 7f0d3abff700 1 -- 172.21.15.154:0/2503788968 shutdown_connections 2023-10-10T22:37:59.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.806+0000 7f0d3abff700 1 -- 172.21.15.154:0/2503788968 wait complete. 2023-10-10T22:37:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.807+0000 7f0d3abff700 1 Processor -- start 2023-10-10T22:37:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.807+0000 7f0d3abff700 1 -- start start 2023-10-10T22:37:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.808+0000 7f0d3abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d340ac230 0x7f0d340a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.808+0000 7f0d3abff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d34155c10 0x7f0d3415a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.808+0000 7f0d3abff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d341568a0 0x7f0d3415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.808+0000 7f0d3abff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34151c60 con 0x7f0d341568a0 2023-10-10T22:37:59.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.808+0000 7f0d3abff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d341595a0 con 0x7f0d34155c10 2023-10-10T22:37:59.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.808+0000 7f0d3abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34159e40 con 0x7f0d340ac230 2023-10-10T22:37:59.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.808+0000 7f0d3919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d341568a0 0x7f0d3415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.808+0000 7f0d3919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d341568a0 0x7f0d3415a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59236/0 (socket says 172.21.15.154:59236) 2023-10-10T22:37:59.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.808+0000 7f0d3919c700 1 -- 172.21.15.154:0/2878439420 learned_addr learned my addr 172.21.15.154:0/2878439420 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:37:59.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d3919c700 1 -- 172.21.15.154:0/2878439420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d340ac230 msgr2=0x7f0d340a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d3919c700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d340ac230 0x7f0d340a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d3919c700 1 -- 172.21.15.154:0/2878439420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d34155c10 msgr2=0x7f0d3415a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:37:59.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d3919c700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d34155c10 0x7f0d3415a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:37:59.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d3919c700 1 -- 172.21.15.154:0/2878439420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2800a690 con 0x7f0d341568a0 2023-10-10T22:37:59.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d3919c700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d341568a0 0x7f0d3415a810 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c870 tx=0x7f0d2c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:59.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d30ff9700 1 -- 172.21.15.154:0/2878439420 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c012630 con 0x7f0d341568a0 2023-10-10T22:37:59.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d30ff9700 1 -- 172.21.15.154:0/2878439420 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0127b0 con 0x7f0d341568a0 2023-10-10T22:37:59.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d30ff9700 1 -- 172.21.15.154:0/2878439420 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c012b70 con 0x7f0d341568a0 2023-10-10T22:37:59.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3415ad50 con 0x7f0d341568a0 2023-10-10T22:37:59.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.809+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d341597f0 con 0x7f0d341568a0 2023-10-10T22:37:59.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.810+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3404c3c0 con 0x7f0d341568a0 2023-10-10T22:37:59.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.811+0000 7f0d30ff9700 1 -- 172.21.15.154:0/2878439420 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d2c003030 con 0x7f0d341568a0 2023-10-10T22:37:59.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.812+0000 7f0d30ff9700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0d18066f30 0x7f0d180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:37:59.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.812+0000 7f0d30ff9700 1 -- 172.21.15.154:0/2878439420 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f0d2c0845f0 con 0x7f0d341568a0 2023-10-10T22:37:59.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.812+0000 7f0d3899b700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0d18066f30 0x7f0d180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:37:59.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.813+0000 7f0d3899b700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0d18066f30 0x7f0d180693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d34065bb0 tx=0x7f0d28018000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:37:59.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:37:59.816+0000 7f0d30ff9700 1 -- 172.21.15.154:0/2878439420 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d2c051720 con 0x7f0d341568a0 2023-10-10T22:38:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.004+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d34159f80 con 0x7f0d18066f30 2023-10-10T22:38:00.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.006+0000 7f0d30ff9700 1 -- 172.21.15.154:0/2878439420 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50651 (secure 0 0 0) 0x7f0d34159f80 con 0x7f0d18066f30 2023-10-10T22:38:00.009 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:38:00.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0d18066f30 msgr2=0x7f0d180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0d18066f30 0x7f0d180693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d34065bb0 tx=0x7f0d28018000 comp rx=0 tx=0).stop 2023-10-10T22:38:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d341568a0 msgr2=0x7f0d3415a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d341568a0 0x7f0d3415a810 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c870 tx=0x7f0d2c001670 comp rx=0 tx=0).stop 2023-10-10T22:38:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 shutdown_connections 2023-10-10T22:38:00.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0d18066f30 0x7f0d180693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d341568a0 0x7f0d3415a810 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d340ac230 0x7f0d340a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 --2- 172.21.15.154:0/2878439420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d34155c10 0x7f0d3415a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 >> 172.21.15.154:0/2878439420 conn(0x7f0d3406a320 msgr2=0x7f0d34152460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 shutdown_connections 2023-10-10T22:38:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.009+0000 7f0d3abff700 1 -- 172.21.15.154:0/2878439420 wait complete. 2023-10-10T22:38:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:38:00.028 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-10T22:37:59.030389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2467044,"kb_used_data":23204,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752507676,"statfs":{"total":773094113280,"available":770567860224,"internally_reserved":0,"allocated":23760896,"data_stored":13187355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.981929"},"pg_stats":[{"pgid":"1.0","version":"212'370","reported_seq":1226,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-10T22:37:53.103993+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:37:53.103993+0000","last_peered":"2023-10-10T22:37:53.103993+0000","last_clean":"2023-10-10T22:37:53.103993+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:37:53.103993+0000","last_undegraded":"2023-10-10T22:37:53.103993+0000","last_fullsized":"2023-10-10T22:37:53.103993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543279,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313076,"kb_used_data":3500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94058764,"statfs":{"total":96636764160,"available":96316174336,"internally_reserved":0,"allocated":3584000,"data_stored":2255136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.026},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":1.073,"15min":1.081},"last":0.747}]},{"osd":1,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":1.145,"15min":1.145},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":1.0700000000000001},"last":0.58799999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":1.0009999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.503,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":0.82299999999999995,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.024},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":0.999,"15min":1.079},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.86199999999999999,"5min":1.046,"15min":1.125},"last":0.56799999999999995}]}]},{"osd":6,"up_from":14,"seq":60129543278,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299868,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071972,"statfs":{"total":96636764160,"available":96329699328,"internally_reserved":0,"allocated":2641920,"data_stored":1329084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":1.0289999999999999,"15min":1.1080000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.751},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.0920000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.64500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94299999999999995,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.68200000000000005}]},{"osd":2,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.034,"15min":1.1200000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.0660000000000001},"last":0.441}]},{"osd":3,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.621,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91200000000000003,"5min":0.97399999999999998,"15min":1.071},"last":0.621}]},{"osd":4,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":1.778,"15min":1.778},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.86899999999999999,"5min":0.996,"15min":1.046},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.51000000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97299999999999998,"5min":1.827,"15min":1.827},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.64700000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543278,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312504,"kb_used_data":2928,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059336,"statfs":{"total":96636764160,"available":96316760064,"internally_reserved":0,"allocated":2998272,"data_stored":1676084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.82999999999999996,"15min":0.88},"last":0.442}]},{"osd":2,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.878,"15min":0.90800000000000003},"last":0.629},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.88800000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.74399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.995,"5min":1.0269999999999999,"15min":1.177},"last":0.57099999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.008,"5min":1.089,"15min":1.1419999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.2450000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.64300000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.081,"5min":1.1200000000000001,"15min":1.2729999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.155},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.68600000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.2230000000000001},"last":0.753}]}]},{"osd":0,"up_from":14,"seq":60129543280,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308972,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062868,"statfs":{"total":96636764160,"available":96320376832,"internally_reserved":0,"allocated":3575808,"data_stored":2254502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.71399999999999997,"15min":0.753},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.76000000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.85299999999999998},"last":0.441}]},{"osd":3,"last update":"Tue Oct 10 22:37:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.81100000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.625,"15min":0.625},"min":{"1min":0.502,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.54300000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0469999999999999,"5min":1.1180000000000001,"15min":1.3340000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.1479999999999999,"15min":1.198},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56899999999999995},"max":{"1min":1.0449999999999999,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.625,"5min":0.54800000000000004,"15min":0.54500000000000004},"max":{"1min":1.1439999999999999,"5min":1.3320000000000001,"15min":1.377},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0449999999999999,"5min":1.274,"15min":1.427},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.198,"5min":1.224,"15min":1.2689999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.081,"5min":1.153,"15min":1.153},"last":0.83799999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543280,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316260,"kb_used_data":2588,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055580,"statfs":{"total":96636764160,"available":96312913920,"internally_reserved":0,"allocated":2650112,"data_stored":1329649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.317},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.89500000000000002},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65200000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.85699999999999998,"15min":0.85799999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.101,"15min":1.288},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98599999999999999,"5min":1.1220000000000001,"15min":1.325},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.147,"15min":1.1970000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82199999999999995,"15min":0.84099999999999997},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.054,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.26},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.093,"5min":1.165,"15min":1.3129999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80600000000000005,"15min":0.83199999999999996},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.181,"15min":1.2609999999999999},"last":0.52400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424510575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316584,"kb_used_data":2912,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055256,"statfs":{"total":96636764160,"available":96312582144,"internally_reserved":0,"allocated":2981888,"data_stored":1657409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.38200000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.877,"15min":0.877},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.70599999999999996,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":0.99399999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.04,"5min":1.133,"15min":1.242},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.202,"15min":1.2629999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.125,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":1.1040000000000001,"15min":1.222},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.099,"5min":1.1539999999999999,"15min":1.212},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.54200000000000004},"max":{"1min":0.98899999999999999,"5min":1.274,"15min":1.274},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":0.83499999999999996},"min":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56699999999999995},"max":{"1min":1.097,"5min":1.149,"15min":1.2370000000000001},"last":0.74299999999999999}]}]},{"osd":4,"up_from":14,"seq":60129543280,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299900,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071940,"statfs":{"total":96636764160,"available":96329666560,"internally_reserved":0,"allocated":2674688,"data_stored":1348958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.087},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.752},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.437},"max":{"1min":0.94099999999999995,"5min":0.95199999999999996,"15min":1.1220000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88500000000000001,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.998,"15min":1.073},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.089},"last":0.64500000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.45200000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.4079999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91100000000000003,"5min":0.94299999999999995,"15min":1.282},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.79500000000000004,"15min":0.94099999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.94099999999999995,"15min":1.0900000000000001},"last":0.83699999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.42199999999999999},"max":{"1min":0.82099999999999995,"5min":0.89600000000000002,"15min":1.0649999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.0629999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.92100000000000004,"5min":0.96999999999999997,"15min":1.21},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.436},"max":{"1min":0.97399999999999998,"5min":0.97999999999999998,"15min":1.147},"last":0.85599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129543278,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299880,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071960,"statfs":{"total":96636764160,"available":96329687040,"internally_reserved":0,"allocated":2654208,"data_stored":1336533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":1.006},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.48199999999999998,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.997},"last":0.53900000000000003}]},{"osd":1,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.98999999999999999,"15min":1.04},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.02},"last":0.434}]},{"osd":4,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.37},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.01,"5min":1.01,"15min":1.032},"last":0.59699999999999998}]},{"osd":7,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.02},"last":0.51900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:38:00.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-10T22:38:00.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.212+0000 7f5fc1d9d700 1 Processor -- start 2023-10-10T22:38:00.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.212+0000 7f5fc1d9d700 1 -- start start 2023-10-10T22:38:00.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fc1d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5fbc06a660 0x7f5fbc157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:00.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fc1d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fbc06e2a0 con 0x7f5fbc150550 2023-10-10T22:38:00.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fc1d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fbc06b2e0 con 0x7f5fbc150180 2023-10-10T22:38:00.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fc1d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c78e0 con 0x7f5fbc06a660 2023-10-10T22:38:00.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fbbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5fbc150550 0x7f5fbc069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34042/0 (socket says 172.21.15.154:34042) 2023-10-10T22:38:00.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fbbfff700 1 -- 172.21.15.154:0/2072948157 learned_addr learned my addr 172.21.15.154:0/2072948157 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:00.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fc159c700 1 --2- 172.21.15.154:0/2072948157 >> v2:172.21.15.179:3300/0 conn(0x7f5fbc06a660 0x7f5fbc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:00.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fbb7fe700 1 -- 172.21.15.154:0/2072948157 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691288926 0 0) 0x7f5fbc06e2a0 con 0x7f5fbc150550 2023-10-10T22:38:00.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fbb7fe700 1 -- 172.21.15.154:0/2072948157 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fac004680 con 0x7f5fbc150550 2023-10-10T22:38:00.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.214+0000 7f5fc159c700 1 -- 172.21.15.154:0/2072948157 >> v1:172.21.15.179:6789/0 conn(0x7f5fbc150180 legacy=0x7f5fbc0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:00.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.215+0000 7f5fc159c700 1 -- 172.21.15.154:0/2072948157 >> v1:172.21.15.154:6789/0 conn(0x7f5fbc150550 legacy=0x7f5fbc069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:00.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.215+0000 7f5fc159c700 1 -- 172.21.15.154:0/2072948157 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0c7bc0 con 0x7f5fbc06a660 2023-10-10T22:38:00.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.215+0000 7f5fc159c700 1 --2- 172.21.15.154:0/2072948157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fbc06a660 0x7f5fbc157770 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009e90 tx=0x7f5fb4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b410ec7eb643d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:00.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.215+0000 7f5fbb7fe700 1 -- 172.21.15.154:0/2072948157 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400e070 con 0x7f5fbc06a660 2023-10-10T22:38:00.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.215+0000 7f5fbb7fe700 1 -- 172.21.15.154:0/2072948157 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb400bc40 con 0x7f5fbc06a660 2023-10-10T22:38:00.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.215+0000 7f5fbb7fe700 1 -- 172.21.15.154:0/2072948157 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4012430 con 0x7f5fbc06a660 2023-10-10T22:38:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.216+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/2072948157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fbc06a660 msgr2=0x7f5fbc157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.216+0000 7f5fc1d9d700 1 --2- 172.21.15.154:0/2072948157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fbc06a660 0x7f5fbc157770 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009e90 tx=0x7f5fb4009780 comp rx=0 tx=0).stop 2023-10-10T22:38:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.216+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/2072948157 shutdown_connections 2023-10-10T22:38:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.216+0000 7f5fc1d9d700 1 --2- 172.21.15.154:0/2072948157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fbc06a660 0x7f5fbc157770 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.216+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/2072948157 >> 172.21.15.154:0/2072948157 conn(0x7f5fbc0cc1f0 msgr2=0x7f5fbc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:00.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.216+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/2072948157 shutdown_connections 2023-10-10T22:38:00.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.216+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/2072948157 wait complete. 2023-10-10T22:38:00.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.217+0000 7f5fc1d9d700 1 Processor -- start 2023-10-10T22:38:00.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.217+0000 7f5fc1d9d700 1 -- start start 2023-10-10T22:38:00.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.218+0000 7f5fc1d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fbc06a660 0x7f5fbc15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:00.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.218+0000 7f5fc1d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fbc150180 0x7f5fbc0abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:00.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.218+0000 7f5fc1d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc150550 0x7f5fbc158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:00.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.218+0000 7f5fc1d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc146630 con 0x7f5fbc150550 2023-10-10T22:38:00.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.218+0000 7f5fc1d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0abff0 con 0x7f5fbc150180 2023-10-10T22:38:00.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.218+0000 7f5fc1d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0ac290 con 0x7f5fbc06a660 2023-10-10T22:38:00.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.218+0000 7f5fc159c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc150550 0x7f5fbc158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:00.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fc159c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc150550 0x7f5fbc158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59252/0 (socket says 172.21.15.154:59252) 2023-10-10T22:38:00.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fc159c700 1 -- 172.21.15.154:0/1186215591 learned_addr learned my addr 172.21.15.154:0/1186215591 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:00.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fbbfff700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fbc150180 0x7f5fbc0abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:00.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fc0d9b700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fbc06a660 0x7f5fbc15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:00.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fc159c700 1 -- 172.21.15.154:0/1186215591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fbc06a660 msgr2=0x7f5fbc15a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:00.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fc159c700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fbc06a660 0x7f5fbc15a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fc159c700 1 -- 172.21.15.154:0/1186215591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fbc150180 msgr2=0x7f5fbc0abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:00.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fc159c700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fbc150180 0x7f5fbc0abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fc159c700 1 -- 172.21.15.154:0/1186215591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb4009a20 con 0x7f5fbc150550 2023-10-10T22:38:00.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.219+0000 7f5fc159c700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc150550 0x7f5fbc158b50 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4013000 tx=0x7f5fb4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.220+0000 7f5fb8ff9700 1 -- 172.21.15.154:0/1186215591 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4026480 con 0x7f5fbc150550 2023-10-10T22:38:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.220+0000 7f5fb8ff9700 1 -- 172.21.15.154:0/1186215591 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb40265e0 con 0x7f5fbc150550 2023-10-10T22:38:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.220+0000 7f5fb8ff9700 1 -- 172.21.15.154:0/1186215591 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb40269a0 con 0x7f5fbc150550 2023-10-10T22:38:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.220+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc0ac570 con 0x7f5fbc150550 2023-10-10T22:38:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.220+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc0acb30 con 0x7f5fbc150550 2023-10-10T22:38:00.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.221+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fbc04c3c0 con 0x7f5fbc150550 2023-10-10T22:38:00.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.221+0000 7f5fb8ff9700 1 -- 172.21.15.154:0/1186215591 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fb401c400 con 0x7f5fbc150550 2023-10-10T22:38:00.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.222+0000 7f5fb8ff9700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5fa0066f30 0x7f5fa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:00.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.222+0000 7f5fb8ff9700 1 -- 172.21.15.154:0/1186215591 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f5fb40866f0 con 0x7f5fbc150550 2023-10-10T22:38:00.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.223+0000 7f5fc0d9b700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5fa0066f30 0x7f5fa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:00.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.223+0000 7f5fc0d9b700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5fa0066f30 0x7f5fa00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0003a80 tx=0x7f5fb0007ec0 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:00.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.227+0000 7f5fb8ff9700 1 -- 172.21.15.154:0/1186215591 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fb4053780 con 0x7f5fbc150550 2023-10-10T22:38:00.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.423+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fbc06ada0 con 0x7f5fbc150550 2023-10-10T22:38:00.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.424+0000 7f5fb8ff9700 1 -- 172.21.15.154:0/1186215591 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v214) v1 ==== 74+0+13942 (secure 0 0 0) 0x7f5fb4056da0 con 0x7f5fbc150550 2023-10-10T22:38:00.425 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:38:00.425 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":214,"fsid":"8fc592ed-075f-4c05-97bb-c4c6e0f43dd7","created":"2023-10-10T21:01:55.068890+0000","modified":"2023-10-10T22:37:55.033426+0000","last_up_change":"2023-10-10T21:02:07.541808+0000","last_in_change":"2023-10-10T21:01:58.394649+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-10T21:02:07.905514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e2acaf55-f1fa-471d-8227-582419ad91df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":85772},{"type":"v1","addr":"172.21.15.154:6807","nonce":85772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":85772},{"type":"v1","addr":"172.21.15.154:6811","nonce":85772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":85772},{"type":"v1","addr":"172.21.15.154:6816","nonce":85772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":85772},{"type":"v1","addr":"172.21.15.154:6813","nonce":85772}]},"public_addr":"172.21.15.154:6807/85772","cluster_addr":"172.21.15.154:6811/85772","heartbeat_back_addr":"172.21.15.154:6816/85772","heartbeat_front_addr":"172.21.15.154:6813/85772","state":["exists","up"]},{"osd":1,"uuid":"024f6abe-9ee6-4fd7-8213-1af957686e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":85771},{"type":"v1","addr":"172.21.15.154:6801","nonce":85771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":85771},{"type":"v1","addr":"172.21.15.154:6803","nonce":85771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":85771},{"type":"v1","addr":"172.21.15.154:6810","nonce":85771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":85771},{"type":"v1","addr":"172.21.15.154:6806","nonce":85771}]},"public_addr":"172.21.15.154:6801/85771","cluster_addr":"172.21.15.154:6803/85771","heartbeat_back_addr":"172.21.15.154:6810/85771","heartbeat_front_addr":"172.21.15.154:6806/85771","state":["exists","up"]},{"osd":2,"uuid":"2e823ec8-0f2e-4099-8c99-4d90399790b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":85769},{"type":"v1","addr":"172.21.15.154:6817","nonce":85769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85769},{"type":"v1","addr":"172.21.15.154:6819","nonce":85769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6825","nonce":85769},{"type":"v1","addr":"172.21.15.154:6827","nonce":85769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":85769},{"type":"v1","addr":"172.21.15.154:6823","nonce":85769}]},"public_addr":"172.21.15.154:6817/85769","cluster_addr":"172.21.15.154:6819/85769","heartbeat_back_addr":"172.21.15.154:6827/85769","heartbeat_front_addr":"172.21.15.154:6823/85769","state":["exists","up"]},{"osd":3,"uuid":"58da5027-bdf3-4989-bd4d-2ab0590dd86f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":85774},{"type":"v1","addr":"172.21.15.154:6822","nonce":85774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":85774},{"type":"v1","addr":"172.21.15.154:6826","nonce":85774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85774},{"type":"v1","addr":"172.21.15.154:6831","nonce":85774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":85774},{"type":"v1","addr":"172.21.15.154:6829","nonce":85774}]},"public_addr":"172.21.15.154:6822/85774","cluster_addr":"172.21.15.154:6826/85774","heartbeat_back_addr":"172.21.15.154:6831/85774","heartbeat_front_addr":"172.21.15.154:6829/85774","state":["exists","up"]},{"osd":4,"uuid":"9274498e-7703-4287-96af-33e83969398b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":88317},{"type":"v1","addr":"172.21.15.179:6801","nonce":88317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":88317},{"type":"v1","addr":"172.21.15.179:6803","nonce":88317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":88317},{"type":"v1","addr":"172.21.15.179:6807","nonce":88317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":88317},{"type":"v1","addr":"172.21.15.179:6805","nonce":88317}]},"public_addr":"172.21.15.179:6801/88317","cluster_addr":"172.21.15.179:6803/88317","heartbeat_back_addr":"172.21.15.179:6807/88317","heartbeat_front_addr":"172.21.15.179:6805/88317","state":["exists","up"]},{"osd":5,"uuid":"25b896f8-55e6-4116-8c5b-8cc345651dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":88318},{"type":"v1","addr":"172.21.15.179:6809","nonce":88318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":88318},{"type":"v1","addr":"172.21.15.179:6811","nonce":88318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":88318},{"type":"v1","addr":"172.21.15.179:6815","nonce":88318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":88318},{"type":"v1","addr":"172.21.15.179:6813","nonce":88318}]},"public_addr":"172.21.15.179:6809/88318","cluster_addr":"172.21.15.179:6811/88318","heartbeat_back_addr":"172.21.15.179:6815/88318","heartbeat_front_addr":"172.21.15.179:6813/88318","state":["exists","up"]},{"osd":6,"uuid":"f1d1fc4f-c437-434b-ae1b-3371a27944ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":88346},{"type":"v1","addr":"172.21.15.179:6817","nonce":88346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":88346},{"type":"v1","addr":"172.21.15.179:6819","nonce":88346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":88346},{"type":"v1","addr":"172.21.15.179:6825","nonce":88346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":88346},{"type":"v1","addr":"172.21.15.179:6821","nonce":88346}]},"public_addr":"172.21.15.179:6817/88346","cluster_addr":"172.21.15.179:6819/88346","heartbeat_back_addr":"172.21.15.179:6825/88346","heartbeat_front_addr":"172.21.15.179:6821/88346","state":["exists","up"]},{"osd":7,"uuid":"31f6e4cf-5d75-4e3e-9d39-401ccc6af034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":88349},{"type":"v1","addr":"172.21.15.179:6824","nonce":88349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":88349},{"type":"v1","addr":"172.21.15.179:6827","nonce":88349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":88349},{"type":"v1","addr":"172.21.15.179:6831","nonce":88349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":88349},{"type":"v1","addr":"172.21.15.179:6829","nonce":88349}]},"public_addr":"172.21.15.179:6824/88349","cluster_addr":"172.21.15.179:6827/88349","heartbeat_back_addr":"172.21.15.179:6831/88349","heartbeat_front_addr":"172.21.15.179:6829/88349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.726832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.692859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.916613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.991172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.690414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.763267+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.827101+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-10T21:02:03.759787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2173690594":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/3079321288":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/3605067162":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/1114916960":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/4026722393":"2023-10-11T22:37:53.011021+0000","172.21.15.154:0/2656510021":"2023-10-11T22:37:53.011021+0000","172.21.15.179:6835/1275463629":"2023-10-11T22:37:52.009377+0000","172.21.15.179:6833/1275463629":"2023-10-11T22:37:52.009377+0000","172.21.15.154:0/3458335740":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/3394882299":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/1691610567":"2023-10-11T22:37:42.558235+0000","172.21.15.154:6837/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/2976821250":"2023-10-11T22:37:53.011021+0000","172.21.15.154:6836/132976":"2023-10-11T22:37:42.558235+0000","172.21.15.154:0/4135556396":"2023-10-11T22:37:42.558235+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":29,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":61,"length":2},{"begin":67,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":89,"length":1},{"begin":95,"length":1},{"begin":100,"length":1},{"begin":106,"length":2},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-10T22:38:00.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5fa0066f30 msgr2=0x7f5fa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5fa0066f30 0x7f5fa00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0003a80 tx=0x7f5fb0007ec0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc150550 msgr2=0x7f5fbc158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc150550 0x7f5fbc158b50 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4013000 tx=0x7f5fb4019000 comp rx=0 tx=0).stop 2023-10-10T22:38:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 shutdown_connections 2023-10-10T22:38:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5fa0066f30 0x7f5fa00693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fbc150550 0x7f5fbc158b50 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fbc06a660 0x7f5fbc15a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 --2- 172.21.15.154:0/1186215591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fbc150180 0x7f5fbc0abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 >> 172.21.15.154:0/1186215591 conn(0x7f5fbc0cc1f0 msgr2=0x7f5fbc069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 shutdown_connections 2023-10-10T22:38:00.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:00.426+0000 7f5fc1d9d700 1 -- 172.21.15.154:0/1186215591 wait complete. 2023-10-10T22:38:01.446 INFO:tasks.ceph:Scrubbing osd.0 2023-10-10T22:38:01.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-10T22:38:01.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.641+0000 7fd092fff700 1 Processor -- start 2023-10-10T22:38:01.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.642+0000 7fd092fff700 1 -- start start 2023-10-10T22:38:01.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd092fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08c157740 0x7fd08c0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd092fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd08c068aa0 0x7fd08c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd092fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c06dc20 con 0x7fd08c0b2100 2023-10-10T22:38:01.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd092fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c0acc00 con 0x7fd08c157740 2023-10-10T22:38:01.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd092fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c06d6a0 con 0x7fd08c068aa0 2023-10-10T22:38:01.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd090d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08c157740 0x7fd08c0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd090d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08c157740 0x7fd08c0adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59262/0 (socket says 172.21.15.154:59262) 2023-10-10T22:38:01.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd090d9b700 1 -- 172.21.15.154:0/4129784458 learned_addr learned my addr 172.21.15.154:0/4129784458 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:01.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd08bfff700 1 --1- 172.21.15.154:0/4129784458 >> v1:172.21.15.154:6789/0 conn(0x7fd08c0b2100 0x7fd08c068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34048/0 (socket says 172.21.15.154:34048) 2023-10-10T22:38:01.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.643+0000 7fd09159c700 1 --2- 172.21.15.154:0/4129784458 >> v2:172.21.15.179:3300/0 conn(0x7fd08c068aa0 0x7fd08c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd090d9b700 1 -- 172.21.15.154:0/4129784458 >> v2:172.21.15.179:3300/0 conn(0x7fd08c068aa0 msgr2=0x7fd08c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:01.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd090d9b700 1 --2- 172.21.15.154:0/4129784458 >> v2:172.21.15.179:3300/0 conn(0x7fd08c068aa0 0x7fd08c06e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd090d9b700 1 -- 172.21.15.154:0/4129784458 >> v1:172.21.15.154:6789/0 conn(0x7fd08c0b2100 legacy=0x7fd08c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd090d9b700 1 -- 172.21.15.154:0/4129784458 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0ae910 con 0x7fd08c157740 2023-10-10T22:38:01.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd09159c700 1 --2- 172.21.15.154:0/4129784458 >> v2:172.21.15.179:3300/0 conn(0x7fd08c068aa0 0x7fd08c06e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:01.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd08b7fe700 1 -- 172.21.15.154:0/4129784458 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297724420 0 0) 0x7fd08c06dc20 con 0x7fd08c0b2100 2023-10-10T22:38:01.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd090d9b700 1 --2- 172.21.15.154:0/4129784458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c157740 0x7fd08c0adfc0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0c6a50 tx=0x7fd080009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686cf303efdafe84 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:01.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd08b7fe700 1 -- 172.21.15.154:0/4129784458 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000b860 con 0x7fd08c157740 2023-10-10T22:38:01.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd08b7fe700 1 -- 172.21.15.154:0/4129784458 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08000b9c0 con 0x7fd08c157740 2023-10-10T22:38:01.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.644+0000 7fd08b7fe700 1 -- 172.21.15.154:0/4129784458 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000bd60 con 0x7fd08c157740 2023-10-10T22:38:01.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.645+0000 7fd092fff700 1 -- 172.21.15.154:0/4129784458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c157740 msgr2=0x7fd08c0adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.645+0000 7fd092fff700 1 --2- 172.21.15.154:0/4129784458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c157740 0x7fd08c0adfc0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0c6a50 tx=0x7fd080009250 comp rx=0 tx=0).stop 2023-10-10T22:38:01.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.645+0000 7fd092fff700 1 -- 172.21.15.154:0/4129784458 shutdown_connections 2023-10-10T22:38:01.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.645+0000 7fd092fff700 1 --2- 172.21.15.154:0/4129784458 >> v2:172.21.15.179:3300/0 conn(0x7fd08c068aa0 0x7fd08c06e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.645+0000 7fd092fff700 1 --2- 172.21.15.154:0/4129784458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c157740 0x7fd08c0adfc0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.645+0000 7fd092fff700 1 -- 172.21.15.154:0/4129784458 >> 172.21.15.154:0/4129784458 conn(0x7fd08c0c8f90 msgr2=0x7fd08c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:01.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.645+0000 7fd092fff700 1 -- 172.21.15.154:0/4129784458 shutdown_connections 2023-10-10T22:38:01.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.645+0000 7fd092fff700 1 -- 172.21.15.154:0/4129784458 wait complete. 2023-10-10T22:38:01.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.646+0000 7fd092fff700 1 Processor -- start 2023-10-10T22:38:01.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.646+0000 7fd092fff700 1 -- start start 2023-10-10T22:38:01.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.647+0000 7fd092fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd08c068aa0 0x7fd08c14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.647+0000 7fd092fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c0b2100 0x7fd08c16a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.647+0000 7fd092fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c157740 0x7fd08c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.647+0000 7fd092fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c16aad0 con 0x7fd08c0b2100 2023-10-10T22:38:01.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.647+0000 7fd092fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0c6e80 con 0x7fd08c157740 2023-10-10T22:38:01.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.647+0000 7fd092fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0c7160 con 0x7fd08c068aa0 2023-10-10T22:38:01.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.647+0000 7fd08bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c0b2100 0x7fd08c16a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd08bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c0b2100 0x7fd08c16a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59278/0 (socket says 172.21.15.154:59278) 2023-10-10T22:38:01.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd08bfff700 1 -- 172.21.15.154:0/1918659632 learned_addr learned my addr 172.21.15.154:0/1918659632 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:01.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd09159c700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c157740 0x7fd08c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd090d9b700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd08c068aa0 0x7fd08c14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd08bfff700 1 -- 172.21.15.154:0/1918659632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd08c068aa0 msgr2=0x7fd08c14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd08bfff700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd08c068aa0 0x7fd08c14dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd08bfff700 1 -- 172.21.15.154:0/1918659632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c157740 msgr2=0x7fd08c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd08bfff700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c157740 0x7fd08c06e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd08bfff700 1 -- 172.21.15.154:0/1918659632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800094f0 con 0x7fd08c0b2100 2023-10-10T22:38:01.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd08bfff700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c0b2100 0x7fd08c16a590 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fd0780011e0 tx=0x7fd078007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:01.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd088ff9700 1 -- 172.21.15.154:0/1918659632 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078005a70 con 0x7fd08c0b2100 2023-10-10T22:38:01.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd088ff9700 1 -- 172.21.15.154:0/1918659632 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078005bd0 con 0x7fd08c0b2100 2023-10-10T22:38:01.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd088ff9700 1 -- 172.21.15.154:0/1918659632 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0780070d0 con 0x7fd08c0b2100 2023-10-10T22:38:01.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.648+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c0c7440 con 0x7fd08c0b2100 2023-10-10T22:38:01.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.649+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c0c7a00 con 0x7fd08c0b2100 2023-10-10T22:38:01.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.649+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd08c0718b0 con 0x7fd08c0b2100 2023-10-10T22:38:01.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.650+0000 7fd088ff9700 1 -- 172.21.15.154:0/1918659632 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd078007480 con 0x7fd08c0b2100 2023-10-10T22:38:01.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.651+0000 7fd088ff9700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd070066f30 0x7fd0700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.651+0000 7fd088ff9700 1 -- 172.21.15.154:0/1918659632 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fd078083bc0 con 0x7fd08c0b2100 2023-10-10T22:38:01.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.651+0000 7fd090d9b700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd070066f30 0x7fd0700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.651+0000 7fd088ff9700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7fd07006d6d0 0x7fd07006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.651+0000 7fd088ff9700 1 -- 172.21.15.154:0/1918659632 --> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd070070170 con 0x7fd07006d6d0 2023-10-10T22:38:01.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.651+0000 7fd088ff9700 1 -- 172.21.15.154:0/1918659632 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd078088220 con 0x7fd08c0b2100 2023-10-10T22:38:01.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.652+0000 7fd09159c700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7fd07006d6d0 0x7fd07006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.652+0000 7fd090d9b700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd070066f30 0x7fd0700693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0c6a50 tx=0x7fd080017000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:01.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.652+0000 7fd09159c700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7fd07006d6d0 0x7fd07006fb40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:01.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.653+0000 7fd088ff9700 1 -- 172.21.15.154:0/1918659632 <== osd.0 v2:172.21.15.154:6805/85772 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd070070170 con 0x7fd07006d6d0 2023-10-10T22:38:01.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.667+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 --> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd08c0aebf0 con 0x7fd07006d6d0 2023-10-10T22:38:01.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd088ff9700 1 -- 172.21.15.154:0/1918659632 <== osd.0 v2:172.21.15.154:6805/85772 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd08c0aebf0 con 0x7fd07006d6d0 2023-10-10T22:38:01.669 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:38:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-10T22:38:01.670 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:38:01.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7fd07006d6d0 msgr2=0x7fd07006fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6805/85772,v1:172.21.15.154:6807/85772] conn(0x7fd07006d6d0 0x7fd07006fb40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd070066f30 msgr2=0x7fd0700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd070066f30 0x7fd0700693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0c6a50 tx=0x7fd080017000 comp rx=0 tx=0).stop 2023-10-10T22:38:01.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c0b2100 msgr2=0x7fd08c16a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 --2- 172.21.15.154:0/1918659632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08c0b2100 0x7fd08c16a590 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fd0780011e0 tx=0x7fd078007e10 comp rx=0 tx=0).stop 2023-10-10T22:38:01.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd09159c700 1 -- 172.21.15.154:0/1918659632 reap_dead start 2023-10-10T22:38:01.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 shutdown_connections 2023-10-10T22:38:01.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 >> 172.21.15.154:0/1918659632 conn(0x7fd08c0c8f90 msgr2=0x7fd08c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:01.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 shutdown_connections 2023-10-10T22:38:01.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.668+0000 7fd092fff700 1 -- 172.21.15.154:0/1918659632 wait complete. 2023-10-10T22:38:01.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-10T22:38:01.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.868+0000 7f0913fff700 1 Processor -- start 2023-10-10T22:38:01.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.868+0000 7f0913fff700 1 -- start start 2023-10-10T22:38:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.869+0000 7f0913fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f09141595a0 0x7f09140b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.869+0000 7f0913fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140b1410 con 0x7f09140c8830 2023-10-10T22:38:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.869+0000 7f0913fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0914063230 con 0x7f09140c6c60 2023-10-10T22:38:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.869+0000 7f0913fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09140b2b90 con 0x7f09141595a0 2023-10-10T22:38:01.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.869+0000 7f09137fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f09140c8830 0x7f0914159970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34056/0 (socket says 172.21.15.154:34056) 2023-10-10T22:38:01.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.869+0000 7f09137fe700 1 -- 172.21.15.154:0/1377844966 learned_addr learned my addr 172.21.15.154:0/1377844966 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:01.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.870+0000 7f0912ffd700 1 --2- 172.21.15.154:0/1377844966 >> v2:172.21.15.179:3300/0 conn(0x7f09141595a0 0x7f09140b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.870+0000 7f0911ffb700 1 -- 172.21.15.154:0/1377844966 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372801705 0 0) 0x7f09140b1410 con 0x7f09140c8830 2023-10-10T22:38:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.870+0000 7f0911ffb700 1 -- 172.21.15.154:0/1377844966 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc003570 con 0x7f09140c8830 2023-10-10T22:38:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.870+0000 7f0911ffb700 1 -- 172.21.15.154:0/1377844966 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384724080 0 0) 0x7f0914063230 con 0x7f09140c6c60 2023-10-10T22:38:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.870+0000 7f0911ffb700 1 -- 172.21.15.154:0/1377844966 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09140b1410 con 0x7f09140c6c60 2023-10-10T22:38:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.870+0000 7f0912ffd700 1 -- 172.21.15.154:0/1377844966 >> v1:172.21.15.179:6789/0 conn(0x7f09140c6c60 legacy=0x7f09140c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.870+0000 7f0912ffd700 1 -- 172.21.15.154:0/1377844966 >> v1:172.21.15.154:6789/0 conn(0x7f09140c8830 legacy=0x7f0914159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.870+0000 7f0912ffd700 1 -- 172.21.15.154:0/1377844966 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140634f0 con 0x7f09141595a0 2023-10-10T22:38:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.870+0000 7f0912ffd700 1 --2- 172.21.15.154:0/1377844966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09141595a0 0x7f09140b18a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f09040098e0 tx=0x7f09040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1c3ba442ae7fae6 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0911ffb700 1 -- 172.21.15.154:0/1377844966 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904011630 con 0x7f09141595a0 2023-10-10T22:38:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0911ffb700 1 -- 172.21.15.154:0/1377844966 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904011790 con 0x7f09141595a0 2023-10-10T22:38:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0911ffb700 1 -- 172.21.15.154:0/1377844966 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904011b10 con 0x7f09141595a0 2023-10-10T22:38:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0913fff700 1 -- 172.21.15.154:0/1377844966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09141595a0 msgr2=0x7f09140b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0913fff700 1 --2- 172.21.15.154:0/1377844966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09141595a0 0x7f09140b18a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f09040098e0 tx=0x7f09040091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0913fff700 1 -- 172.21.15.154:0/1377844966 shutdown_connections 2023-10-10T22:38:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0913fff700 1 --2- 172.21.15.154:0/1377844966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09141595a0 0x7f09140b18a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0913fff700 1 -- 172.21.15.154:0/1377844966 >> 172.21.15.154:0/1377844966 conn(0x7f091406ddb0 msgr2=0x7f091406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0913fff700 1 -- 172.21.15.154:0/1377844966 shutdown_connections 2023-10-10T22:38:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.871+0000 7f0913fff700 1 -- 172.21.15.154:0/1377844966 wait complete. 2023-10-10T22:38:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.873+0000 7f0913fff700 1 Processor -- start 2023-10-10T22:38:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.873+0000 7f0913fff700 1 -- start start 2023-10-10T22:38:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0913fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c6c60 0x7f091413d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0913fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09140c8830 0x7f09140c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0913fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09141595a0 0x7f09140c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0913fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091415a7b0 con 0x7f09140c6c60 2023-10-10T22:38:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0913fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914159be0 con 0x7f09141595a0 2023-10-10T22:38:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0913fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0914159e80 con 0x7f09140c8830 2023-10-10T22:38:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0912ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c6c60 0x7f091413d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0912ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c6c60 0x7f091413d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59288/0 (socket says 172.21.15.154:59288) 2023-10-10T22:38:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0912ffd700 1 -- 172.21.15.154:0/338392019 learned_addr learned my addr 172.21.15.154:0/338392019 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f09137fe700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09141595a0 0x7f09140c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f09127fc700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09140c8830 0x7f09140c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0912ffd700 1 -- 172.21.15.154:0/338392019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09140c8830 msgr2=0x7f09140c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0912ffd700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09140c8830 0x7f09140c1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0912ffd700 1 -- 172.21.15.154:0/338392019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09141595a0 msgr2=0x7f09140c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:01.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0912ffd700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09141595a0 0x7f09140c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:01.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f0912ffd700 1 -- 172.21.15.154:0/338392019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904009420 con 0x7f09140c6c60 2023-10-10T22:38:01.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.874+0000 7f09127fc700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09140c8830 0x7f09140c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:01.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.875+0000 7f0912ffd700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c6c60 0x7f091413d6a0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f0914064340 tx=0x7f0904017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:01.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.875+0000 7f08faffd700 1 -- 172.21.15.154:0/338392019 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904011900 con 0x7f09140c6c60 2023-10-10T22:38:01.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.875+0000 7f08faffd700 1 -- 172.21.15.154:0/338392019 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904011a80 con 0x7f09140c6c60 2023-10-10T22:38:01.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.875+0000 7f08faffd700 1 -- 172.21.15.154:0/338392019 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090401a680 con 0x7f09140c6c60 2023-10-10T22:38:01.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.875+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091415a160 con 0x7f09140c6c60 2023-10-10T22:38:01.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.875+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091413dbe0 con 0x7f09140c6c60 2023-10-10T22:38:01.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.876+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091404c3c0 con 0x7f09140c6c60 2023-10-10T22:38:01.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.877+0000 7f08faffd700 1 -- 172.21.15.154:0/338392019 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f090401a9f0 con 0x7f09140c6c60 2023-10-10T22:38:01.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.878+0000 7f08faffd700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0900066f30 0x7f09000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:01.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.878+0000 7f08faffd700 1 -- 172.21.15.154:0/338392019 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f0904086220 con 0x7f09140c6c60 2023-10-10T22:38:01.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.878+0000 7f09127fc700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0900066f30 0x7f09000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:01.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.879+0000 7f09127fc700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0900066f30 0x7f09000693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f09140c2540 tx=0x7f0908009040 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:01.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:01.882+0000 7f08faffd700 1 -- 172.21.15.154:0/338392019 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09040532b0 con 0x7f09140c6c60 2023-10-10T22:38:02.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.075+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f091415a8f0 con 0x7f0900066f30 2023-10-10T22:38:02.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.075+0000 7f08faffd700 1 -- 172.21.15.154:0/338392019 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0908007dc0 con 0x7f0900066f30 2023-10-10T22:38:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0900066f30 msgr2=0x7f09000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0900066f30 0x7f09000693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f09140c2540 tx=0x7f0908009040 comp rx=0 tx=0).stop 2023-10-10T22:38:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c6c60 msgr2=0x7f091413d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c6c60 0x7f091413d6a0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f0914064340 tx=0x7f0904017000 comp rx=0 tx=0).stop 2023-10-10T22:38:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 shutdown_connections 2023-10-10T22:38:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f0900066f30 0x7f09000693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09141595a0 0x7f09140c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c6c60 0x7f091413d6a0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 --2- 172.21.15.154:0/338392019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09140c8830 0x7f09140c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.077+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 >> 172.21.15.154:0/338392019 conn(0x7f091406ddb0 msgr2=0x7f0914153da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.078+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 shutdown_connections 2023-10-10T22:38:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.078+0000 7f0913fff700 1 -- 172.21.15.154:0/338392019 wait complete. 2023-10-10T22:38:02.082 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 0 to deep-scrub 2023-10-10T22:38:02.096 INFO:tasks.ceph:Scrubbing osd.1 2023-10-10T22:38:02.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-10T22:38:02.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.282+0000 7f5f035ff700 1 Processor -- start 2023-10-10T22:38:02.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.283+0000 7f5f035ff700 1 -- start start 2023-10-10T22:38:02.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.284+0000 7f5f035ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5efc1563b0 0x7f5efc156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.284+0000 7f5f035ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5efc068890 0x7f5efc0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.284+0000 7f5f035ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc15a9b0 con 0x7f5efc15a440 2023-10-10T22:38:02.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.284+0000 7f5f035ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc15ac90 con 0x7f5efc068890 2023-10-10T22:38:02.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.284+0000 7f5f035ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc15af70 con 0x7f5efc1563b0 2023-10-10T22:38:02.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.284+0000 7f5f01b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5efc068890 0x7f5efc0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.284+0000 7f5f01b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5efc068890 0x7f5efc0c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59292/0 (socket says 172.21.15.154:59292) 2023-10-10T22:38:02.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.284+0000 7f5f01b9c700 1 -- 172.21.15.154:0/1513152080 learned_addr learned my addr 172.21.15.154:0/1513152080 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:02.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.284+0000 7f5f0139b700 1 --2- 172.21.15.154:0/1513152080 >> v2:172.21.15.179:3300/0 conn(0x7f5efc1563b0 0x7f5efc156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.285+0000 7f5f01b9c700 1 -- 172.21.15.154:0/1513152080 >> v2:172.21.15.179:3300/0 conn(0x7f5efc1563b0 msgr2=0x7f5efc156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:02.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.285+0000 7f5f01b9c700 1 --2- 172.21.15.154:0/1513152080 >> v2:172.21.15.179:3300/0 conn(0x7f5efc1563b0 0x7f5efc156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.285+0000 7f5f01b9c700 1 -- 172.21.15.154:0/1513152080 >> v1:172.21.15.179:6789/0 conn(0x7f5efc15a440 legacy=0x7f5efc0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.285+0000 7f5f01b9c700 1 -- 172.21.15.154:0/1513152080 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc15b250 con 0x7f5efc068890 2023-10-10T22:38:02.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.285+0000 7f5f01b9c700 1 --2- 172.21.15.154:0/1513152080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc068890 0x7f5efc0c8230 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f5efc06a9f0 tx=0x7f5ef4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca5ab450e897839 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.285+0000 7f5ef3fff700 1 -- 172.21.15.154:0/1513152080 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400e070 con 0x7f5efc068890 2023-10-10T22:38:02.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.285+0000 7f5ef3fff700 1 -- 172.21.15.154:0/1513152080 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400ba20 con 0x7f5efc068890 2023-10-10T22:38:02.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.285+0000 7f5ef3fff700 1 -- 172.21.15.154:0/1513152080 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40092e0 con 0x7f5efc068890 2023-10-10T22:38:02.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.286+0000 7f5f035ff700 1 -- 172.21.15.154:0/1513152080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc068890 msgr2=0x7f5efc0c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.286+0000 7f5f035ff700 1 --2- 172.21.15.154:0/1513152080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc068890 0x7f5efc0c8230 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f5efc06a9f0 tx=0x7f5ef4009840 comp rx=0 tx=0).stop 2023-10-10T22:38:02.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.286+0000 7f5f035ff700 1 -- 172.21.15.154:0/1513152080 shutdown_connections 2023-10-10T22:38:02.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.286+0000 7f5f035ff700 1 --2- 172.21.15.154:0/1513152080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc068890 0x7f5efc0c8230 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.286+0000 7f5f035ff700 1 --2- 172.21.15.154:0/1513152080 >> v2:172.21.15.179:3300/0 conn(0x7f5efc1563b0 0x7f5efc156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.286+0000 7f5f035ff700 1 -- 172.21.15.154:0/1513152080 >> 172.21.15.154:0/1513152080 conn(0x7f5efc0c8f90 msgr2=0x7f5efc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:02.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.286+0000 7f5f035ff700 1 -- 172.21.15.154:0/1513152080 shutdown_connections 2023-10-10T22:38:02.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.286+0000 7f5f035ff700 1 -- 172.21.15.154:0/1513152080 wait complete. 2023-10-10T22:38:02.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.287+0000 7f5f035ff700 1 Processor -- start 2023-10-10T22:38:02.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.287+0000 7f5f035ff700 1 -- start start 2023-10-10T22:38:02.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.288+0000 7f5f035ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5efc068890 0x7f5efc0af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.288+0000 7f5f035ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc1563b0 0x7f5efc153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.288+0000 7f5f035ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5efc15a440 0x7f5efc1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.288+0000 7f5f035ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0ae480 con 0x7f5efc1563b0 2023-10-10T22:38:02.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.288+0000 7f5f035ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc151730 con 0x7f5efc15a440 2023-10-10T22:38:02.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.288+0000 7f5f035ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0ad870 con 0x7f5efc068890 2023-10-10T22:38:02.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.288+0000 7f5f00b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc1563b0 0x7f5efc153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.288+0000 7f5f00b9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc1563b0 0x7f5efc153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59308/0 (socket says 172.21.15.154:59308) 2023-10-10T22:38:02.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.288+0000 7f5f00b9a700 1 -- 172.21.15.154:0/3589881265 learned_addr learned my addr 172.21.15.154:0/3589881265 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:02.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f0139b700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5efc068890 0x7f5efc0af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f01b9c700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5efc15a440 0x7f5efc1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f00b9a700 1 -- 172.21.15.154:0/3589881265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5efc068890 msgr2=0x7f5efc0af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f00b9a700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5efc068890 0x7f5efc0af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f00b9a700 1 -- 172.21.15.154:0/3589881265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5efc15a440 msgr2=0x7f5efc1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f00b9a700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5efc15a440 0x7f5efc1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f00b9a700 1 -- 172.21.15.154:0/3589881265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4009ae0 con 0x7f5efc1563b0 2023-10-10T22:38:02.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f00b9a700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc1563b0 0x7f5efc153b80 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c4e0 tx=0x7f5eec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5ef17fa700 1 -- 172.21.15.154:0/3589881265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec011590 con 0x7f5efc1563b0 2023-10-10T22:38:02.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5ef17fa700 1 -- 172.21.15.154:0/3589881265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec011710 con 0x7f5efc1563b0 2023-10-10T22:38:02.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5ef17fa700 1 -- 172.21.15.154:0/3589881265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec011ad0 con 0x7f5efc1563b0 2023-10-10T22:38:02.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc0adb50 con 0x7f5efc1563b0 2023-10-10T22:38:02.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.289+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc0ae110 con 0x7f5efc1563b0 2023-10-10T22:38:02.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.290+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5efc0718b0 con 0x7f5efc1563b0 2023-10-10T22:38:02.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.291+0000 7f5ef17fa700 1 -- 172.21.15.154:0/3589881265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5eec001020 con 0x7f5efc1563b0 2023-10-10T22:38:02.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.292+0000 7f5ef17fa700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ee0066f30 0x7f5ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.292+0000 7f5ef17fa700 1 -- 172.21.15.154:0/3589881265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f5eec0839b0 con 0x7f5efc1563b0 2023-10-10T22:38:02.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.292+0000 7f5f0139b700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ee0066f30 0x7f5ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.293+0000 7f5ef17fa700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f5ee006d6d0 0x7f5ee006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.293+0000 7f5ef17fa700 1 -- 172.21.15.154:0/3589881265 --> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ee0070170 con 0x7f5ee006d6d0 2023-10-10T22:38:02.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.293+0000 7f5ef17fa700 1 -- 172.21.15.154:0/3589881265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eec088220 con 0x7f5efc1563b0 2023-10-10T22:38:02.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.293+0000 7f5f01b9c700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f5ee006d6d0 0x7f5ee006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.293+0000 7f5f0139b700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ee0066f30 0x7f5ee00693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009db0 tx=0x7f5ef80091a0 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.293+0000 7f5f01b9c700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f5ee006d6d0 0x7f5ee006fb40 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.294+0000 7f5ef17fa700 1 -- 172.21.15.154:0/3589881265 <== osd.1 v2:172.21.15.154:6800/85771 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5ee0070170 con 0x7f5ee006d6d0 2023-10-10T22:38:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.308+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 --> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5efc06d6a0 con 0x7f5ee006d6d0 2023-10-10T22:38:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5ef17fa700 1 -- 172.21.15.154:0/3589881265 <== osd.1 v2:172.21.15.154:6800/85771 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5efc06d6a0 con 0x7f5ee006d6d0 2023-10-10T22:38:02.310 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:38:02.311 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-10T22:38:02.311 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:38:02.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f5ee006d6d0 msgr2=0x7f5ee006fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6800/85771,v1:172.21.15.154:6801/85771] conn(0x7f5ee006d6d0 0x7f5ee006fb40 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ee0066f30 msgr2=0x7f5ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f5ee0066f30 0x7f5ee00693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009db0 tx=0x7f5ef80091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc1563b0 msgr2=0x7f5efc153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 --2- 172.21.15.154:0/3589881265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5efc1563b0 0x7f5efc153b80 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c4e0 tx=0x7f5eec00c7f0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f01b9c700 1 -- 172.21.15.154:0/3589881265 reap_dead start 2023-10-10T22:38:02.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 shutdown_connections 2023-10-10T22:38:02.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 >> 172.21.15.154:0/3589881265 conn(0x7f5efc0c8f90 msgr2=0x7f5efc14d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 shutdown_connections 2023-10-10T22:38:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.309+0000 7f5f035ff700 1 -- 172.21.15.154:0/3589881265 wait complete. 2023-10-10T22:38:02.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-10T22:38:02.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.511+0000 7fe1499ff700 1 Processor -- start 2023-10-10T22:38:02.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.511+0000 7fe1499ff700 1 -- start start 2023-10-10T22:38:02.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.512+0000 7fe1499ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1440ccf90 0x7fe1440ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.512+0000 7fe1499ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440cc300 con 0x7fe1440cbf30 2023-10-10T22:38:02.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe1499ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440ad370 con 0x7fe1440b1420 2023-10-10T22:38:02.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe1499ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe144156bf0 con 0x7fe1440ccf90 2023-10-10T22:38:02.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe142ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe1440cbf30 0x7fe1440b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34072/0 (socket says 172.21.15.154:34072) 2023-10-10T22:38:02.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe142ffd700 1 -- 172.21.15.154:0/1982200636 learned_addr learned my addr 172.21.15.154:0/1982200636 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:02.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe1437fe700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1440ccf90 0x7fe1440ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587237332 0 0) 0x7fe1440cc300 con 0x7fe1440cbf30 2023-10-10T22:38:02.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe12c003570 con 0x7fe1440cbf30 2023-10-10T22:38:02.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357856357 0 0) 0x7fe1440ad370 con 0x7fe1440b1420 2023-10-10T22:38:02.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1440cc300 con 0x7fe1440b1420 2023-10-10T22:38:02.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3172542872 0 0) 0x7fe12c003570 con 0x7fe1440cbf30 2023-10-10T22:38:02.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1440ccf90 msgr2=0x7fe1440ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:02.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1440ccf90 0x7fe1440ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 >> v1:172.21.15.179:6789/0 conn(0x7fe1440b1420 legacy=0x7fe1440c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1440ad650 con 0x7fe1440cbf30 2023-10-10T22:38:02.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fe134001470 con 0x7fe1440cbf30 2023-10-10T22:38:02.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.513+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 >> v1:172.21.15.154:6789/0 conn(0x7fe1440cbf30 legacy=0x7fe1440b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe141ffb700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe12c003c20 0x7fe12c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe141ffb700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe12c004810 0x7fe12c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe141ffb700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe12c0051c0 0x7fe12c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144156bf0 con 0x7fe12c003c20 2023-10-10T22:38:02.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c00e360 con 0x7fe12c004810 2023-10-10T22:38:02.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c00e520 con 0x7fe12c0051c0 2023-10-10T22:38:02.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe1437fe700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1440ccf90 0x7fe1440ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:38:02.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe142ffd700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe12c003c20 0x7fe12c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe1427fc700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe12c004810 0x7fe12c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe1437fe700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe12c0051c0 0x7fe12c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe142ffd700 1 -- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe12c0051c0 msgr2=0x7fe12c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:02.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe142ffd700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe12c0051c0 0x7fe12c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe142ffd700 1 -- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe12c004810 msgr2=0x7fe12c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:02.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe142ffd700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe12c004810 0x7fe12c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe142ffd700 1 -- 172.21.15.154:0/1982200636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c003570 con 0x7fe12c003c20 2023-10-10T22:38:02.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.514+0000 7fe142ffd700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe12c003c20 0x7fe12c004010 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fe13400c210 tx=0x7fe134001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b4a31b63b1af6e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13400cc10 con 0x7fe12c003c20 2023-10-10T22:38:02.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13400cd70 con 0x7fe12c003c20 2023-10-10T22:38:02.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe141ffb700 1 -- 172.21.15.154:0/1982200636 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134005b70 con 0x7fe12c003c20 2023-10-10T22:38:02.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe1499ff700 1 -- 172.21.15.154:0/1982200636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe12c003c20 msgr2=0x7fe12c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe1499ff700 1 --2- 172.21.15.154:0/1982200636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe12c003c20 0x7fe12c004010 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fe13400c210 tx=0x7fe134001d40 comp rx=0 tx=0).stop 2023-10-10T22:38:02.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe1437fe700 1 -- 172.21.15.154:0/1982200636 reap_dead start 2023-10-10T22:38:02.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe1499ff700 1 -- 172.21.15.154:0/1982200636 shutdown_connections 2023-10-10T22:38:02.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe1499ff700 1 -- 172.21.15.154:0/1982200636 >> 172.21.15.154:0/1982200636 conn(0x7fe14406a320 msgr2=0x7fe1440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:02.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe1499ff700 1 -- 172.21.15.154:0/1982200636 shutdown_connections 2023-10-10T22:38:02.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.515+0000 7fe1499ff700 1 -- 172.21.15.154:0/1982200636 wait complete. 2023-10-10T22:38:02.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.517+0000 7fe1499ff700 1 Processor -- start 2023-10-10T22:38:02.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.517+0000 7fe1499ff700 1 -- start start 2023-10-10T22:38:02.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1499ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe12c003c20 0x7fe1441412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1499ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1441573c0 0x7fe144157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1499ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe144159820 0x7fe144159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1499ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1441508b0 con 0x7fe144159820 2023-10-10T22:38:02.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1499ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144157d70 con 0x7fe12c003c20 2023-10-10T22:38:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1499ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe144150e30 con 0x7fe1441573c0 2023-10-10T22:38:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe144159820 0x7fe144159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe144159820 0x7fe144159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59326/0 (socket says 172.21.15.154:59326) 2023-10-10T22:38:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1437fe700 1 -- 172.21.15.154:0/1522070140 learned_addr learned my addr 172.21.15.154:0/1522070140 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1427fc700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1441573c0 0x7fe144157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe142ffd700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe12c003c20 0x7fe1441412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1437fe700 1 -- 172.21.15.154:0/1522070140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1441573c0 msgr2=0x7fe144157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1437fe700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1441573c0 0x7fe144157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1437fe700 1 -- 172.21.15.154:0/1522070140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe12c003c20 msgr2=0x7fe1441412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1437fe700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe12c003c20 0x7fe1441412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.518+0000 7fe1437fe700 1 -- 172.21.15.154:0/1522070140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14415a5e0 con 0x7fe144159820 2023-10-10T22:38:02.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.519+0000 7fe1437fe700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe144159820 0x7fe144159ca0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fe14406d670 tx=0x7fe13c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.519+0000 7fe12affd700 1 -- 172.21.15.154:0/1522070140 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00e070 con 0x7fe144159820 2023-10-10T22:38:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.519+0000 7fe12affd700 1 -- 172.21.15.154:0/1522070140 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c011c50 con 0x7fe144159820 2023-10-10T22:38:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.519+0000 7fe12affd700 1 -- 172.21.15.154:0/1522070140 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c016470 con 0x7fe144159820 2023-10-10T22:38:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.519+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14415a8c0 con 0x7fe144159820 2023-10-10T22:38:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.519+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe144141820 con 0x7fe144159820 2023-10-10T22:38:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.520+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe144150fe0 con 0x7fe144159820 2023-10-10T22:38:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.521+0000 7fe12affd700 1 -- 172.21.15.154:0/1522070140 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe13c016840 con 0x7fe144159820 2023-10-10T22:38:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.522+0000 7fe12affd700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe130066f30 0x7fe1300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.522+0000 7fe12affd700 1 -- 172.21.15.154:0/1522070140 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fe13c085320 con 0x7fe144159820 2023-10-10T22:38:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.522+0000 7fe142ffd700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe130066f30 0x7fe1300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.523+0000 7fe142ffd700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe130066f30 0x7fe1300693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe14406f0d0 tx=0x7fe134015000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.526+0000 7fe12affd700 1 -- 172.21.15.154:0/1522070140 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe144150fe0 con 0x7fe144159820 2023-10-10T22:38:02.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.718+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe14415aab0 con 0x7fe130066f30 2023-10-10T22:38:02.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.719+0000 7fe12affd700 1 -- 172.21.15.154:0/1522070140 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe14415aab0 con 0x7fe130066f30 2023-10-10T22:38:02.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe130066f30 msgr2=0x7fe1300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe130066f30 0x7fe1300693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe14406f0d0 tx=0x7fe134015000 comp rx=0 tx=0).stop 2023-10-10T22:38:02.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe144159820 msgr2=0x7fe144159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe144159820 0x7fe144159ca0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fe14406d670 tx=0x7fe13c00b040 comp rx=0 tx=0).stop 2023-10-10T22:38:02.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 shutdown_connections 2023-10-10T22:38:02.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe130066f30 0x7fe1300693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe144159820 0x7fe144159ca0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe12c003c20 0x7fe1441412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 --2- 172.21.15.154:0/1522070140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1441573c0 0x7fe144157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 >> 172.21.15.154:0/1522070140 conn(0x7fe14406a320 msgr2=0x7fe1440c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 shutdown_connections 2023-10-10T22:38:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.721+0000 7fe1499ff700 1 -- 172.21.15.154:0/1522070140 wait complete. 2023-10-10T22:38:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 1 to deep-scrub 2023-10-10T22:38:02.741 INFO:tasks.ceph:Scrubbing osd.2 2023-10-10T22:38:02.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-10T22:38:02.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.927+0000 7fbd031ff700 1 Processor -- start 2023-10-10T22:38:02.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.928+0000 7fbd031ff700 1 -- start start 2023-10-10T22:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbd031ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbcfc1563b0 0x7fbcfc156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbd031ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 0x7fbcfc0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbd031ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcfc15a9b0 con 0x7fbcfc068890 2023-10-10T22:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbd031ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc15ac90 con 0x7fbcfc1563b0 2023-10-10T22:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbd031ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc15af70 con 0x7fbcfc15a440 2023-10-10T22:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbcfbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 0x7fbcfc0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbd00f9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbcfc1563b0 0x7fbcfc156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbd0179c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbcfc068890 0x7fbcfc0c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:44380/0 (socket says 172.21.15.154:44380) 2023-10-10T22:38:02.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbcfbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 0x7fbcfc0acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58302/0 (socket says 172.21.15.154:58302) 2023-10-10T22:38:02.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbd0179c700 1 -- 172.21.15.154:0/1035686403 learned_addr learned my addr 172.21.15.154:0/1035686403 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:02.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.929+0000 7fbd00f9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbcfc1563b0 0x7fbcfc156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:36952/0 (socket says 172.21.15.154:36952) 2023-10-10T22:38:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbcfb7fe700 1 -- 172.21.15.154:0/1035686403 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419457311 0 0) 0x7fbcfc15a9b0 con 0x7fbcfc068890 2023-10-10T22:38:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbcfbfff700 1 -- 172.21.15.154:0/1035686403 >> v2:172.21.15.179:3300/0 conn(0x7fbcfc1563b0 msgr2=0x7fbcfc156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbcfbfff700 1 --2- 172.21.15.154:0/1035686403 >> v2:172.21.15.179:3300/0 conn(0x7fbcfc1563b0 0x7fbcfc156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbcfbfff700 1 -- 172.21.15.154:0/1035686403 >> v1:172.21.15.179:6789/0 conn(0x7fbcfc068890 legacy=0x7fbcfc0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbcfbfff700 1 -- 172.21.15.154:0/1035686403 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc15b250 con 0x7fbcfc15a440 2023-10-10T22:38:02.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbd00f9b700 1 --2- 172.21.15.154:0/1035686403 >> v2:172.21.15.179:3300/0 conn(0x7fbcfc1563b0 0x7fbcfc156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:38:02.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbcfbfff700 1 --2- 172.21.15.154:0/1035686403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 0x7fbcfc0acf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbce80098e0 tx=0x7fbce80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e260d054fdc89e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbcfb7fe700 1 -- 172.21.15.154:0/1035686403 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800b640 con 0x7fbcfc15a440 2023-10-10T22:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbcfb7fe700 1 -- 172.21.15.154:0/1035686403 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce800b7a0 con 0x7fbcfc15a440 2023-10-10T22:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.930+0000 7fbcfb7fe700 1 -- 172.21.15.154:0/1035686403 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800bb40 con 0x7fbcfc15a440 2023-10-10T22:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.931+0000 7fbd031ff700 1 -- 172.21.15.154:0/1035686403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 msgr2=0x7fbcfc0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.931+0000 7fbd031ff700 1 --2- 172.21.15.154:0/1035686403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 0x7fbcfc0acf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbce80098e0 tx=0x7fbce80091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.931+0000 7fbd031ff700 1 -- 172.21.15.154:0/1035686403 shutdown_connections 2023-10-10T22:38:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.931+0000 7fbd031ff700 1 --2- 172.21.15.154:0/1035686403 >> v2:172.21.15.179:3300/0 conn(0x7fbcfc1563b0 0x7fbcfc156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.931+0000 7fbd031ff700 1 --2- 172.21.15.154:0/1035686403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 0x7fbcfc0acf30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.931+0000 7fbd031ff700 1 -- 172.21.15.154:0/1035686403 >> 172.21.15.154:0/1035686403 conn(0x7fbcfc0c8f90 msgr2=0x7fbcfc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.931+0000 7fbd031ff700 1 -- 172.21.15.154:0/1035686403 shutdown_connections 2023-10-10T22:38:02.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.931+0000 7fbd031ff700 1 -- 172.21.15.154:0/1035686403 wait complete. 2023-10-10T22:38:02.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.932+0000 7fbd031ff700 1 Processor -- start 2023-10-10T22:38:02.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.933+0000 7fbd031ff700 1 -- start start 2023-10-10T22:38:02.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.933+0000 7fbd031ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcfc068890 0x7fbcfc148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.933+0000 7fbd031ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcfc1563b0 0x7fbcfc0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.933+0000 7fbd031ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 0x7fbcfc0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.933+0000 7fbd031ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc0af2d0 con 0x7fbcfc068890 2023-10-10T22:38:02.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.933+0000 7fbd031ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc0af520 con 0x7fbcfc1563b0 2023-10-10T22:38:02.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.933+0000 7fbd031ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc0af800 con 0x7fbcfc15a440 2023-10-10T22:38:02.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd00f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcfc068890 0x7fbcfc148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd00f9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcfc068890 0x7fbcfc148d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59328/0 (socket says 172.21.15.154:59328) 2023-10-10T22:38:02.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd00f9b700 1 -- 172.21.15.154:0/2054608061 learned_addr learned my addr 172.21.15.154:0/2054608061 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:02.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd0179c700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 0x7fbcfc0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbcfbfff700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcfc1563b0 0x7fbcfc0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd00f9b700 1 -- 172.21.15.154:0/2054608061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 msgr2=0x7fbcfc0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd00f9b700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc15a440 0x7fbcfc0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd00f9b700 1 -- 172.21.15.154:0/2054608061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcfc1563b0 msgr2=0x7fbcfc0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd00f9b700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcfc1563b0 0x7fbcfc0cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd00f9b700 1 -- 172.21.15.154:0/2054608061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0009420 con 0x7fbcfc068890 2023-10-10T22:38:02.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbcfbfff700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcfc1563b0 0x7fbcfc0cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:38:02.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.934+0000 7fbd00f9b700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcfc068890 0x7fbcfc148d20 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000ec80 tx=0x7fbcf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.935+0000 7fbcf8ff9700 1 -- 172.21.15.154:0/2054608061 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000c920 con 0x7fbcfc068890 2023-10-10T22:38:02.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.935+0000 7fbcf8ff9700 1 -- 172.21.15.154:0/2054608061 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf000ca80 con 0x7fbcfc068890 2023-10-10T22:38:02.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.935+0000 7fbcf8ff9700 1 -- 172.21.15.154:0/2054608061 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000ce00 con 0x7fbcfc068890 2023-10-10T22:38:02.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.935+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce8009420 con 0x7fbcfc068890 2023-10-10T22:38:02.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.935+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc0afdc0 con 0x7fbcfc068890 2023-10-10T22:38:02.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.936+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbcfc159da0 con 0x7fbcfc068890 2023-10-10T22:38:02.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.937+0000 7fbcf8ff9700 1 -- 172.21.15.154:0/2054608061 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbcf0013680 con 0x7fbcfc068890 2023-10-10T22:38:02.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.937+0000 7fbcf8ff9700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbce0066f30 0x7fbce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.938+0000 7fbcf8ff9700 1 -- 172.21.15.154:0/2054608061 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fbcf0084a00 con 0x7fbcfc068890 2023-10-10T22:38:02.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.938+0000 7fbcfbfff700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbce0066f30 0x7fbce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.938+0000 7fbcf8ff9700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7fbce006d6d0 0x7fbce006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:02.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.938+0000 7fbcf8ff9700 1 -- 172.21.15.154:0/2054608061 --> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbce0070170 con 0x7fbce006d6d0 2023-10-10T22:38:02.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.938+0000 7fbcf8ff9700 1 -- 172.21.15.154:0/2054608061 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcf0089240 con 0x7fbcfc068890 2023-10-10T22:38:02.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.938+0000 7fbd0179c700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7fbce006d6d0 0x7fbce006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:02.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.938+0000 7fbcfbfff700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbce0066f30 0x7fbce00693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbce80091e0 tx=0x7fbce8017000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.939+0000 7fbd0179c700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7fbce006d6d0 0x7fbce006fb40 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:02.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.939+0000 7fbcf8ff9700 1 -- 172.21.15.154:0/2054608061 <== osd.2 v2:172.21.15.154:6815/85769 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbce0070170 con 0x7fbce006d6d0 2023-10-10T22:38:02.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.954+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 --> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbcfc0718b0 con 0x7fbce006d6d0 2023-10-10T22:38:02.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.954+0000 7fbcf8ff9700 1 -- 172.21.15.154:0/2054608061 <== osd.2 v2:172.21.15.154:6815/85769 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbcfc0718b0 con 0x7fbce006d6d0 2023-10-10T22:38:02.957 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:38:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-10T22:38:02.958 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:38:02.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.954+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7fbce006d6d0 msgr2=0x7fbce006fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.954+0000 7fbd031ff700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6815/85769,v1:172.21.15.154:6817/85769] conn(0x7fbce006d6d0 0x7fbce006fb40 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.955+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbce0066f30 msgr2=0x7fbce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.955+0000 7fbd031ff700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbce0066f30 0x7fbce00693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbce80091e0 tx=0x7fbce8017000 comp rx=0 tx=0).stop 2023-10-10T22:38:02.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.955+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcfc068890 msgr2=0x7fbcfc148d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:02.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.955+0000 7fbd031ff700 1 --2- 172.21.15.154:0/2054608061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcfc068890 0x7fbcfc148d20 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000ec80 tx=0x7fbcf00091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:02.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.955+0000 7fbd0179c700 1 -- 172.21.15.154:0/2054608061 reap_dead start 2023-10-10T22:38:02.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.955+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 shutdown_connections 2023-10-10T22:38:02.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.955+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 >> 172.21.15.154:0/2054608061 conn(0x7fbcfc0c8f90 msgr2=0x7fbcfc0ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:02.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.955+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 shutdown_connections 2023-10-10T22:38:02.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:02.955+0000 7fbd031ff700 1 -- 172.21.15.154:0/2054608061 wait complete. 2023-10-10T22:38:02.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-10T22:38:03.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.154+0000 7f9c9179d700 1 Processor -- start 2023-10-10T22:38:03.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.155+0000 7f9c9179d700 1 -- start start 2023-10-10T22:38:03.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.156+0000 7f9c9179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c156310 0x7f9c8c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.156+0000 7f9c9179d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c8c0ae710 0x7f9c8c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.156+0000 7f9c9179d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c0ca860 con 0x7f9c8c1566e0 2023-10-10T22:38:03.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.156+0000 7f9c9179d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c0cab40 con 0x7f9c8c0ae710 2023-10-10T22:38:03.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.156+0000 7f9c9179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0cae20 con 0x7f9c8c156310 2023-10-10T22:38:03.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.156+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c156310 0x7f9c8c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.156+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c156310 0x7f9c8c0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.154:58324/0 (socket says 172.21.15.154:58324) 2023-10-10T22:38:03.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.156+0000 7f9c90f9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c8c0ae710 0x7f9c8c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.156+0000 7f9c8bfff700 1 -- 172.21.15.154:0/2860346127 learned_addr learned my addr 172.21.15.154:0/2860346127 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:03.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.157+0000 7f9c8bfff700 1 -- 172.21.15.154:0/2860346127 >> v2:172.21.15.179:3300/0 conn(0x7f9c8c0ae710 msgr2=0x7f9c8c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:03.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.157+0000 7f9c8bfff700 1 --2- 172.21.15.154:0/2860346127 >> v2:172.21.15.179:3300/0 conn(0x7f9c8c0ae710 0x7f9c8c0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.157+0000 7f9c8bfff700 1 -- 172.21.15.154:0/2860346127 >> v1:172.21.15.179:6789/0 conn(0x7f9c8c1566e0 legacy=0x7f9c8c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.157+0000 7f9c8bfff700 1 -- 172.21.15.154:0/2860346127 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c0cb100 con 0x7f9c8c156310 2023-10-10T22:38:03.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.157+0000 7f9c8bfff700 1 --2- 172.21.15.154:0/2860346127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c156310 0x7f9c8c0c9dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0099b0 tx=0x7f9c7c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e97d461e9ac44c server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.157+0000 7f9c8affd700 1 -- 172.21.15.154:0/2860346127 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c009ea0 con 0x7f9c8c156310 2023-10-10T22:38:03.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.157+0000 7f9c8affd700 1 -- 172.21.15.154:0/2860346127 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c00b860 con 0x7f9c8c156310 2023-10-10T22:38:03.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.157+0000 7f9c8affd700 1 -- 172.21.15.154:0/2860346127 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00bc00 con 0x7f9c8c156310 2023-10-10T22:38:03.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.158+0000 7f9c9179d700 1 -- 172.21.15.154:0/2860346127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c156310 msgr2=0x7f9c8c0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.158+0000 7f9c9179d700 1 --2- 172.21.15.154:0/2860346127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c156310 0x7f9c8c0c9dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0099b0 tx=0x7f9c7c009250 comp rx=0 tx=0).stop 2023-10-10T22:38:03.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.158+0000 7f9c9179d700 1 -- 172.21.15.154:0/2860346127 shutdown_connections 2023-10-10T22:38:03.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.158+0000 7f9c9179d700 1 --2- 172.21.15.154:0/2860346127 >> v2:172.21.15.179:3300/0 conn(0x7f9c8c0ae710 0x7f9c8c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.158+0000 7f9c9179d700 1 --2- 172.21.15.154:0/2860346127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c156310 0x7f9c8c0c9dc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.158+0000 7f9c9179d700 1 -- 172.21.15.154:0/2860346127 >> 172.21.15.154:0/2860346127 conn(0x7f9c8c0cc1f0 msgr2=0x7f9c8c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:03.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.158+0000 7f9c9179d700 1 -- 172.21.15.154:0/2860346127 shutdown_connections 2023-10-10T22:38:03.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.158+0000 7f9c9179d700 1 -- 172.21.15.154:0/2860346127 wait complete. 2023-10-10T22:38:03.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.159+0000 7f9c9179d700 1 Processor -- start 2023-10-10T22:38:03.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.159+0000 7f9c9179d700 1 -- start start 2023-10-10T22:38:03.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.160+0000 7f9c9179d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c8c0ae710 0x7f9c8c16aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.160+0000 7f9c9179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8c156310 0x7f9c8c0c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.160+0000 7f9c9179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c1566e0 0x7f9c8c14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.160+0000 7f9c9179d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c1594a0 con 0x7f9c8c0ae710 2023-10-10T22:38:03.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.160+0000 7f9c9179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c154290 con 0x7f9c8c156310 2023-10-10T22:38:03.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.160+0000 7f9c9179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c154570 con 0x7f9c8c1566e0 2023-10-10T22:38:03.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c8c0ae710 0x7f9c8c16aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c8c0ae710 0x7f9c8c16aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59342/0 (socket says 172.21.15.154:59342) 2023-10-10T22:38:03.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c8bfff700 1 -- 172.21.15.154:0/2493617256 learned_addr learned my addr 172.21.15.154:0/2493617256 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:03.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c90f9c700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c1566e0 0x7f9c8c14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c8b7fe700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8c156310 0x7f9c8c0c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c90f9c700 1 -- 172.21.15.154:0/2493617256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8c156310 msgr2=0x7f9c8c0c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c90f9c700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8c156310 0x7f9c8c0c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c90f9c700 1 -- 172.21.15.154:0/2493617256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c8c0ae710 msgr2=0x7f9c8c16aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c90f9c700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c8c0ae710 0x7f9c8c16aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c90f9c700 1 -- 172.21.15.154:0/2493617256 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c0094f0 con 0x7f9c8c1566e0 2023-10-10T22:38:03.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.161+0000 7f9c90f9c700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c1566e0 0x7f9c8c14fda0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009e20 tx=0x7f9c8400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.162+0000 7f9c73fff700 1 -- 172.21.15.154:0/2493617256 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400caa0 con 0x7f9c8c1566e0 2023-10-10T22:38:03.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.162+0000 7f9c73fff700 1 -- 172.21.15.154:0/2493617256 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8400f040 con 0x7f9c8c1566e0 2023-10-10T22:38:03.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.162+0000 7f9c73fff700 1 -- 172.21.15.154:0/2493617256 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400ce50 con 0x7f9c8c1566e0 2023-10-10T22:38:03.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.162+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c154850 con 0x7f9c8c1566e0 2023-10-10T22:38:03.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.162+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c1577b0 con 0x7f9c8c1566e0 2023-10-10T22:38:03.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.163+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c0ad910 con 0x7f9c8c1566e0 2023-10-10T22:38:03.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.164+0000 7f9c73fff700 1 -- 172.21.15.154:0/2493617256 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c84014690 con 0x7f9c8c1566e0 2023-10-10T22:38:03.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.164+0000 7f9c73fff700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c78066f30 0x7f9c780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.165+0000 7f9c73fff700 1 -- 172.21.15.154:0/2493617256 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f9c84085230 con 0x7f9c8c1566e0 2023-10-10T22:38:03.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.165+0000 7f9c8bfff700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c78066f30 0x7f9c780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.165+0000 7f9c8bfff700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c78066f30 0x7f9c780693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00c010 tx=0x7f9c7c017000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.174+0000 7f9c73fff700 1 -- 172.21.15.154:0/2493617256 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c84055d50 con 0x7f9c8c1566e0 2023-10-10T22:38:03.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.362+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c8c154cf0 con 0x7f9c78066f30 2023-10-10T22:38:03.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.362+0000 7f9c73fff700 1 -- 172.21.15.154:0/2493617256 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9c8c154cf0 con 0x7f9c78066f30 2023-10-10T22:38:03.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.364+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c78066f30 msgr2=0x7f9c780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.364+0000 7f9c9179d700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c78066f30 0x7f9c780693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00c010 tx=0x7f9c7c017000 comp rx=0 tx=0).stop 2023-10-10T22:38:03.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.364+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c1566e0 msgr2=0x7f9c8c14fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.364+0000 7f9c9179d700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c1566e0 0x7f9c8c14fda0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009e20 tx=0x7f9c8400b040 comp rx=0 tx=0).stop 2023-10-10T22:38:03.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.365+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 shutdown_connections 2023-10-10T22:38:03.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.365+0000 7f9c9179d700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f9c78066f30 0x7f9c780693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.365+0000 7f9c9179d700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8c1566e0 0x7f9c8c14fda0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.365+0000 7f9c9179d700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c8c0ae710 0x7f9c8c16aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.365+0000 7f9c9179d700 1 --2- 172.21.15.154:0/2493617256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8c156310 0x7f9c8c0c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.365+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 >> 172.21.15.154:0/2493617256 conn(0x7f9c8c0cc1f0 msgr2=0x7f9c8c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:03.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.365+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 shutdown_connections 2023-10-10T22:38:03.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.365+0000 7f9c9179d700 1 -- 172.21.15.154:0/2493617256 wait complete. 2023-10-10T22:38:03.370 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 2 to deep-scrub 2023-10-10T22:38:03.384 INFO:tasks.ceph:Scrubbing osd.3 2023-10-10T22:38:03.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-10T22:38:03.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.570+0000 7fd3697ff700 1 Processor -- start 2023-10-10T22:38:03.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.570+0000 7fd3697ff700 1 -- start start 2023-10-10T22:38:03.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.571+0000 7fd3697ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3640c8490 0x7fd3640c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.571+0000 7fd3697ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3640ac030 con 0x7fd364069e20 2023-10-10T22:38:03.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.571+0000 7fd3697ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3640ab820 con 0x7fd364069a50 2023-10-10T22:38:03.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.571+0000 7fd3697ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36406dbb0 con 0x7fd3640c8490 2023-10-10T22:38:03.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.571+0000 7fd3627fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3640c8490 0x7fd3640c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.571+0000 7fd3637fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd364069e20 0x7fd3641569b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34074/0 (socket says 172.21.15.154:34074) 2023-10-10T22:38:03.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.571+0000 7fd3637fe700 1 -- 172.21.15.154:0/3685062203 learned_addr learned my addr 172.21.15.154:0/3685062203 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:03.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.572+0000 7fd3627fc700 1 -- 172.21.15.154:0/3685062203 >> v1:172.21.15.179:6789/0 conn(0x7fd364069a50 legacy=0x7fd36415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.572+0000 7fd3627fc700 1 -- 172.21.15.154:0/3685062203 >> v1:172.21.15.154:6789/0 conn(0x7fd364069e20 legacy=0x7fd3641569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.572+0000 7fd3627fc700 1 -- 172.21.15.154:0/3685062203 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3640aba70 con 0x7fd3640c8490 2023-10-10T22:38:03.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.572+0000 7fd361ffb700 1 -- 172.21.15.154:0/3685062203 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252086572 0 0) 0x7fd3640ab820 con 0x7fd364069a50 2023-10-10T22:38:03.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.572+0000 7fd3627fc700 1 --2- 172.21.15.154:0/3685062203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 0x7fd3640c6ac0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098e0 tx=0x7fd3580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b25007ec80ff63 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.572+0000 7fd361ffb700 1 -- 172.21.15.154:0/3685062203 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358009e80 con 0x7fd3640c8490 2023-10-10T22:38:03.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.572+0000 7fd361ffb700 1 -- 172.21.15.154:0/3685062203 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35800b760 con 0x7fd3640c8490 2023-10-10T22:38:03.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.572+0000 7fd361ffb700 1 -- 172.21.15.154:0/3685062203 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800bae0 con 0x7fd3640c8490 2023-10-10T22:38:03.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.573+0000 7fd3697ff700 1 -- 172.21.15.154:0/3685062203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 msgr2=0x7fd3640c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.573+0000 7fd3697ff700 1 --2- 172.21.15.154:0/3685062203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 0x7fd3640c6ac0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098e0 tx=0x7fd3580091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.573+0000 7fd3697ff700 1 -- 172.21.15.154:0/3685062203 shutdown_connections 2023-10-10T22:38:03.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.573+0000 7fd3697ff700 1 --2- 172.21.15.154:0/3685062203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 0x7fd3640c6ac0 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.573+0000 7fd3697ff700 1 -- 172.21.15.154:0/3685062203 >> 172.21.15.154:0/3685062203 conn(0x7fd3640c8f90 msgr2=0x7fd3640c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:03.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.573+0000 7fd3697ff700 1 -- 172.21.15.154:0/3685062203 shutdown_connections 2023-10-10T22:38:03.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.573+0000 7fd3697ff700 1 -- 172.21.15.154:0/3685062203 wait complete. 2023-10-10T22:38:03.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.574+0000 7fd3697ff700 1 Processor -- start 2023-10-10T22:38:03.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.575+0000 7fd3697ff700 1 -- start start 2023-10-10T22:38:03.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.575+0000 7fd3697ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd364069a50 0x7fd36414a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.575+0000 7fd3697ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd364069e20 0x7fd3640ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.575+0000 7fd3697ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 0x7fd3640adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.575+0000 7fd3697ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3641474f0 con 0x7fd3640c8490 2023-10-10T22:38:03.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.575+0000 7fd3697ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364148170 con 0x7fd364069a50 2023-10-10T22:38:03.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.575+0000 7fd3697ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3640c6c90 con 0x7fd364069e20 2023-10-10T22:38:03.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 0x7fd3640adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 0x7fd3640adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59360/0 (socket says 172.21.15.154:59360) 2023-10-10T22:38:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3637fe700 1 -- 172.21.15.154:0/2494756156 learned_addr learned my addr 172.21.15.154:0/2494756156 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd362ffd700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd364069a50 0x7fd36414a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3627fc700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd364069e20 0x7fd3640ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3637fe700 1 -- 172.21.15.154:0/2494756156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd364069e20 msgr2=0x7fd3640ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3637fe700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd364069e20 0x7fd3640ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3637fe700 1 -- 172.21.15.154:0/2494756156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd364069a50 msgr2=0x7fd36414a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3637fe700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd364069a50 0x7fd36414a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3637fe700 1 -- 172.21.15.154:0/2494756156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358009420 con 0x7fd3640c8490 2023-10-10T22:38:03.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.576+0000 7fd3637fe700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 0x7fd3640adb90 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00cf90 tx=0x7fd35c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.577+0000 7fd34affd700 1 -- 172.21.15.154:0/2494756156 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c00ab70 con 0x7fd3640c8490 2023-10-10T22:38:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.577+0000 7fd34affd700 1 -- 172.21.15.154:0/2494756156 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c00acf0 con 0x7fd3640c8490 2023-10-10T22:38:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.577+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364147840 con 0x7fd3640c8490 2023-10-10T22:38:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.577+0000 7fd34affd700 1 -- 172.21.15.154:0/2494756156 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c007340 con 0x7fd3640c8490 2023-10-10T22:38:03.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.577+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd364147e00 con 0x7fd3640c8490 2023-10-10T22:38:03.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.578+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3640718b0 con 0x7fd3640c8490 2023-10-10T22:38:03.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.579+0000 7fd34affd700 1 -- 172.21.15.154:0/2494756156 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd35c007770 con 0x7fd3640c8490 2023-10-10T22:38:03.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.579+0000 7fd34affd700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd350066f30 0x7fd3500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.579+0000 7fd34affd700 1 -- 172.21.15.154:0/2494756156 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fd35c084b10 con 0x7fd3640c8490 2023-10-10T22:38:03.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.580+0000 7fd362ffd700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd350066f30 0x7fd3500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.580+0000 7fd34affd700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fd35006d6d0 0x7fd35006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.580+0000 7fd34affd700 1 -- 172.21.15.154:0/2494756156 --> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd350070170 con 0x7fd35006d6d0 2023-10-10T22:38:03.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.580+0000 7fd34affd700 1 -- 172.21.15.154:0/2494756156 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd35c089220 con 0x7fd3640c8490 2023-10-10T22:38:03.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.580+0000 7fd3627fc700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fd35006d6d0 0x7fd35006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.580+0000 7fd362ffd700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd350066f30 0x7fd3500693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd354003a40 tx=0x7fd354007ec0 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.580+0000 7fd3627fc700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fd35006d6d0 0x7fd35006fb40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.581+0000 7fd34affd700 1 -- 172.21.15.154:0/2494756156 <== osd.3 v2:172.21.15.154:6820/85774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd350070170 con 0x7fd35006d6d0 2023-10-10T22:38:03.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.595+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 --> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd3640ac030 con 0x7fd35006d6d0 2023-10-10T22:38:03.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.596+0000 7fd34affd700 1 -- 172.21.15.154:0/2494756156 <== osd.3 v2:172.21.15.154:6820/85774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd3640ac030 con 0x7fd35006d6d0 2023-10-10T22:38:03.599 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:38:03.599 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-10T22:38:03.599 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:38:03.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.596+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fd35006d6d0 msgr2=0x7fd35006fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.596+0000 7fd3697ff700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6820/85774,v1:172.21.15.154:6822/85774] conn(0x7fd35006d6d0 0x7fd35006fb40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.596+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd350066f30 msgr2=0x7fd3500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.596+0000 7fd3697ff700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd350066f30 0x7fd3500693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd354003a40 tx=0x7fd354007ec0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.596+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 msgr2=0x7fd3640adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.596+0000 7fd3697ff700 1 --2- 172.21.15.154:0/2494756156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3640c8490 0x7fd3640adb90 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00cf90 tx=0x7fd35c001cb0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.596+0000 7fd3637fe700 1 -- 172.21.15.154:0/2494756156 reap_dead start 2023-10-10T22:38:03.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.597+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 shutdown_connections 2023-10-10T22:38:03.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.597+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 >> 172.21.15.154:0/2494756156 conn(0x7fd3640c8f90 msgr2=0x7fd36406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:03.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.597+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 shutdown_connections 2023-10-10T22:38:03.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.597+0000 7fd3697ff700 1 -- 172.21.15.154:0/2494756156 wait complete. 2023-10-10T22:38:03.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-10T22:38:03.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.797+0000 7f26a51ff700 1 Processor -- start 2023-10-10T22:38:03.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.797+0000 7f26a51ff700 1 -- start start 2023-10-10T22:38:03.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.798+0000 7f26a51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159890 0x7f26a015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.798+0000 7f26a51ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f26a0069560 0x7f26a00699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.798+0000 7f26a51ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a015a160 con 0x7f26a0159c60 2023-10-10T22:38:03.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.798+0000 7f26a51ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a0069f20 con 0x7f26a0069560 2023-10-10T22:38:03.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.798+0000 7f26a51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00d13a0 con 0x7f26a0159890 2023-10-10T22:38:03.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.798+0000 7f269e59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f26a0159c60 0x7f26a015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34088/0 (socket says 172.21.15.154:34088) 2023-10-10T22:38:03.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.798+0000 7f269e59c700 1 -- 172.21.15.154:0/198297156 learned_addr learned my addr 172.21.15.154:0/198297156 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:03.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269f59e700 1 --2- 172.21.15.154:0/198297156 >> v2:172.21.15.179:3300/0 conn(0x7f26a0069560 0x7f26a00699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269ed9d700 1 --2- 172.21.15.154:0/198297156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159890 0x7f26a015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269dd9b700 1 -- 172.21.15.154:0/198297156 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830104426 0 0) 0x7f26a015a160 con 0x7f26a0159c60 2023-10-10T22:38:03.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269dd9b700 1 -- 172.21.15.154:0/198297156 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2688003570 con 0x7f26a0159c60 2023-10-10T22:38:03.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269f59e700 1 -- 172.21.15.154:0/198297156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159890 msgr2=0x7f26a015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:03.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269f59e700 1 --2- 172.21.15.154:0/198297156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159890 0x7f26a015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269f59e700 1 -- 172.21.15.154:0/198297156 >> v1:172.21.15.154:6789/0 conn(0x7f26a0159c60 legacy=0x7f26a015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269f59e700 1 -- 172.21.15.154:0/198297156 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a015e140 con 0x7f26a0069560 2023-10-10T22:38:03.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269ed9d700 1 --2- 172.21.15.154:0/198297156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159890 0x7f26a015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-10T22:38:03.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.799+0000 7f269f59e700 1 --2- 172.21.15.154:0/198297156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0069560 0x7f26a00699e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2698009e60 tx=0x7f2698009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be1f653a05e2c0f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f269dd9b700 1 -- 172.21.15.154:0/198297156 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800e070 con 0x7f26a0069560 2023-10-10T22:38:03.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f269dd9b700 1 -- 172.21.15.154:0/198297156 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269800bab0 con 0x7f26a0069560 2023-10-10T22:38:03.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f269dd9b700 1 -- 172.21.15.154:0/198297156 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800be70 con 0x7f26a0069560 2023-10-10T22:38:03.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f26a51ff700 1 -- 172.21.15.154:0/198297156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0069560 msgr2=0x7f26a00699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f26a51ff700 1 --2- 172.21.15.154:0/198297156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0069560 0x7f26a00699e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2698009e60 tx=0x7f2698009780 comp rx=0 tx=0).stop 2023-10-10T22:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f26a51ff700 1 -- 172.21.15.154:0/198297156 shutdown_connections 2023-10-10T22:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f26a51ff700 1 --2- 172.21.15.154:0/198297156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0069560 0x7f26a00699e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f26a51ff700 1 --2- 172.21.15.154:0/198297156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159890 0x7f26a015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f26a51ff700 1 -- 172.21.15.154:0/198297156 >> 172.21.15.154:0/198297156 conn(0x7f26a0068e20 msgr2=0x7f26a00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f26a51ff700 1 -- 172.21.15.154:0/198297156 shutdown_connections 2023-10-10T22:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.800+0000 7f26a51ff700 1 -- 172.21.15.154:0/198297156 wait complete. 2023-10-10T22:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.802+0000 7f26a51ff700 1 Processor -- start 2023-10-10T22:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.802+0000 7f26a51ff700 1 -- start start 2023-10-10T22:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f26a51ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0069560 0x7f26a00cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f26a51ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26a0159890 0x7f26a015be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f26a51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159c60 0x7f26a014d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f26a51ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00ce570 con 0x7f26a0159890 2023-10-10T22:38:03.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f26a51ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a015c3d0 con 0x7f26a0069560 2023-10-10T22:38:03.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f26a51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00cea00 con 0x7f26a0159c60 2023-10-10T22:38:03.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26a0159890 0x7f26a015be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26a0159890 0x7f26a015be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59368/0 (socket says 172.21.15.154:59368) 2023-10-10T22:38:03.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269e59c700 1 -- 172.21.15.154:0/1490640226 learned_addr learned my addr 172.21.15.154:0/1490640226 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:03.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269ed9d700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0069560 0x7f26a00cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269f59e700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159c60 0x7f26a014d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269e59c700 1 -- 172.21.15.154:0/1490640226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159c60 msgr2=0x7f26a014d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269e59c700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159c60 0x7f26a014d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269e59c700 1 -- 172.21.15.154:0/1490640226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0069560 msgr2=0x7f26a00cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:03.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269e59c700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0069560 0x7f26a00cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:03.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.803+0000 7f269e59c700 1 -- 172.21.15.154:0/1490640226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2690009420 con 0x7f26a0159890 2023-10-10T22:38:03.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.804+0000 7f269e59c700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26a0159890 0x7f26a015be90 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f269400c590 tx=0x7f2694007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.804+0000 7f2686ffd700 1 -- 172.21.15.154:0/1490640226 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694005b30 con 0x7f26a0159890 2023-10-10T22:38:03.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.804+0000 7f2686ffd700 1 -- 172.21.15.154:0/1490640226 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2694005c90 con 0x7f26a0159890 2023-10-10T22:38:03.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.804+0000 7f2686ffd700 1 -- 172.21.15.154:0/1490640226 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694007300 con 0x7f26a0159890 2023-10-10T22:38:03.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.804+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2698009a20 con 0x7f26a0159890 2023-10-10T22:38:03.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.804+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a00cdc40 con 0x7f26a0159890 2023-10-10T22:38:03.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.805+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a00ce720 con 0x7f26a0159890 2023-10-10T22:38:03.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.806+0000 7f2686ffd700 1 -- 172.21.15.154:0/1490640226 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f269401b3b0 con 0x7f26a0159890 2023-10-10T22:38:03.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.807+0000 7f2686ffd700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f268c066f30 0x7f268c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:03.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.807+0000 7f2686ffd700 1 -- 172.21.15.154:0/1490640226 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f2694083b90 con 0x7f26a0159890 2023-10-10T22:38:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.807+0000 7f269ed9d700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f268c066f30 0x7f268c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.808+0000 7f269ed9d700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f268c066f30 0x7f268c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2690009f40 tx=0x7f26900091a0 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:03.811+0000 7f2686ffd700 1 -- 172.21.15.154:0/1490640226 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26a00ce720 con 0x7f26a0159890 2023-10-10T22:38:04.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.003+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f26a00ce720 con 0x7f268c066f30 2023-10-10T22:38:04.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.004+0000 7f2686ffd700 1 -- 172.21.15.154:0/1490640226 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f26a00ce720 con 0x7f268c066f30 2023-10-10T22:38:04.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f268c066f30 msgr2=0x7f268c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f268c066f30 0x7f268c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2690009f40 tx=0x7f26900091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26a0159890 msgr2=0x7f26a015be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26a0159890 0x7f26a015be90 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f269400c590 tx=0x7f2694007dd0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 shutdown_connections 2023-10-10T22:38:04.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f268c066f30 0x7f268c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26a0159c60 0x7f26a014d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0069560 0x7f26a00cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 --2- 172.21.15.154:0/1490640226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26a0159890 0x7f26a015be90 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.006+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 >> 172.21.15.154:0/1490640226 conn(0x7f26a0068e20 msgr2=0x7f26a00d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:04.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.007+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 shutdown_connections 2023-10-10T22:38:04.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.007+0000 7f26a51ff700 1 -- 172.21.15.154:0/1490640226 wait complete. 2023-10-10T22:38:04.012 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 3 to deep-scrub 2023-10-10T22:38:04.027 INFO:tasks.ceph:Scrubbing osd.4 2023-10-10T22:38:04.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-10T22:38:04.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.214+0000 7f99769ff700 1 Processor -- start 2023-10-10T22:38:04.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.214+0000 7f99769ff700 1 -- start start 2023-10-10T22:38:04.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.215+0000 7f99769ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f99701563b0 0x7f9970156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.215+0000 7f99769ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997015a9b0 con 0x7f9970068890 2023-10-10T22:38:04.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f99769ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997015ac90 con 0x7f997015a440 2023-10-10T22:38:04.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f99769ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997015af70 con 0x7f99701563b0 2023-10-10T22:38:04.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f9974f9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9970068890 0x7f99700c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34102/0 (socket says 172.21.15.154:34102) 2023-10-10T22:38:04.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f9974f9c700 1 -- 172.21.15.154:0/805362445 learned_addr learned my addr 172.21.15.154:0/805362445 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:04.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f996ffff700 1 --2- 172.21.15.154:0/805362445 >> v2:172.21.15.179:3300/0 conn(0x7f99701563b0 0x7f9970156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f996effd700 1 -- 172.21.15.154:0/805362445 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643421774 0 0) 0x7f997015a9b0 con 0x7f9970068890 2023-10-10T22:38:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f996effd700 1 -- 172.21.15.154:0/805362445 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9958003570 con 0x7f9970068890 2023-10-10T22:38:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f996effd700 1 -- 172.21.15.154:0/805362445 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819319280 0 0) 0x7f997015ac90 con 0x7f997015a440 2023-10-10T22:38:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f996effd700 1 -- 172.21.15.154:0/805362445 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f997015a9b0 con 0x7f997015a440 2023-10-10T22:38:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f996ffff700 1 -- 172.21.15.154:0/805362445 >> v1:172.21.15.179:6789/0 conn(0x7f997015a440 legacy=0x7f99700acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f996ffff700 1 -- 172.21.15.154:0/805362445 >> v1:172.21.15.154:6789/0 conn(0x7f9970068890 legacy=0x7f99700c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.216+0000 7f996ffff700 1 -- 172.21.15.154:0/805362445 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997015b250 con 0x7f99701563b0 2023-10-10T22:38:04.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.217+0000 7f996ffff700 1 --2- 172.21.15.154:0/805362445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99701563b0 0x7f9970156780 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f99600098e0 tx=0x7f99600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7a6c7866e5249f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.217+0000 7f996effd700 1 -- 172.21.15.154:0/805362445 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960011630 con 0x7f99701563b0 2023-10-10T22:38:04.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.217+0000 7f996effd700 1 -- 172.21.15.154:0/805362445 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9960011790 con 0x7f99701563b0 2023-10-10T22:38:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.217+0000 7f996effd700 1 -- 172.21.15.154:0/805362445 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960011b30 con 0x7f99701563b0 2023-10-10T22:38:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.217+0000 7f99769ff700 1 -- 172.21.15.154:0/805362445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99701563b0 msgr2=0x7f9970156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.217+0000 7f99769ff700 1 --2- 172.21.15.154:0/805362445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99701563b0 0x7f9970156780 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f99600098e0 tx=0x7f99600091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.218+0000 7f99769ff700 1 -- 172.21.15.154:0/805362445 shutdown_connections 2023-10-10T22:38:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.218+0000 7f99769ff700 1 --2- 172.21.15.154:0/805362445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99701563b0 0x7f9970156780 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.218+0000 7f99769ff700 1 -- 172.21.15.154:0/805362445 >> 172.21.15.154:0/805362445 conn(0x7f99700c8f90 msgr2=0x7f99700c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.218+0000 7f99769ff700 1 -- 172.21.15.154:0/805362445 shutdown_connections 2023-10-10T22:38:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.218+0000 7f99769ff700 1 -- 172.21.15.154:0/805362445 wait complete. 2023-10-10T22:38:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.219+0000 7f99769ff700 1 Processor -- start 2023-10-10T22:38:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.219+0000 7f99769ff700 1 -- start start 2023-10-10T22:38:04.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f99769ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9970068890 0x7f99700caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f99769ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99701563b0 0x7f99700b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f99769ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f997015a440 0x7f9970153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f99769ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99700cafe0 con 0x7f9970068890 2023-10-10T22:38:04.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f99769ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99700b18d0 con 0x7f997015a440 2023-10-10T22:38:04.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f99769ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99700b0a90 con 0x7f99701563b0 2023-10-10T22:38:04.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f996ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9970068890 0x7f99700caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f996ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9970068890 0x7f99700caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59370/0 (socket says 172.21.15.154:59370) 2023-10-10T22:38:04.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f996ffff700 1 -- 172.21.15.154:0/1873949220 learned_addr learned my addr 172.21.15.154:0/1873949220 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:04.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f9974f9c700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f997015a440 0x7f9970153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.220+0000 7f996f7fe700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99701563b0 0x7f99700b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f996ffff700 1 -- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99701563b0 msgr2=0x7f99700b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f996ffff700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99701563b0 0x7f99700b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f996ffff700 1 -- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f997015a440 msgr2=0x7f9970153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f996ffff700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f997015a440 0x7f9970153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f996ffff700 1 -- 172.21.15.154:0/1873949220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960009420 con 0x7f9970068890 2023-10-10T22:38:04.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f996ffff700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9970068890 0x7f99700caaa0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f99700ad6d0 tx=0x7f9960017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f9957fff700 1 -- 172.21.15.154:0/1873949220 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996001f070 con 0x7f9970068890 2023-10-10T22:38:04.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99700b0d50 con 0x7f9970068890 2023-10-10T22:38:04.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f9957fff700 1 -- 172.21.15.154:0/1873949220 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9960011900 con 0x7f9970068890 2023-10-10T22:38:04.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f9957fff700 1 -- 172.21.15.154:0/1873949220 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960023410 con 0x7f9970068890 2023-10-10T22:38:04.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.221+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99700b1310 con 0x7f9970068890 2023-10-10T22:38:04.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.222+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99700718b0 con 0x7f9970068890 2023-10-10T22:38:04.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.223+0000 7f9957fff700 1 -- 172.21.15.154:0/1873949220 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f996002c3b0 con 0x7f9970068890 2023-10-10T22:38:04.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.224+0000 7f9957fff700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f995c066f30 0x7f995c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.224+0000 7f9957fff700 1 -- 172.21.15.154:0/1873949220 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f9960085930 con 0x7f9970068890 2023-10-10T22:38:04.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.224+0000 7f996f7fe700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f995c066f30 0x7f995c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.224+0000 7f9957fff700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7f995c06d6d0 0x7f995c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.224+0000 7f9957fff700 1 -- 172.21.15.154:0/1873949220 --> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f995c070170 con 0x7f995c06d6d0 2023-10-10T22:38:04.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.224+0000 7f9957fff700 1 -- 172.21.15.154:0/1873949220 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) v2 ==== 24+0+0 (secure 0 0 0) 0x7f996008a220 con 0x7f9970068890 2023-10-10T22:38:04.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.225+0000 7f996f7fe700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f995c066f30 0x7f995c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99700c7940 tx=0x7f9964007d50 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.225+0000 7f9974f9c700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7f995c06d6d0 0x7f995c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.225+0000 7f9974f9c700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7f995c06d6d0 0x7f995c06fb40 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.226+0000 7f9957fff700 1 -- 172.21.15.154:0/1873949220 <== osd.4 v2:172.21.15.179:6800/88317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f995c070170 con 0x7f995c06d6d0 2023-10-10T22:38:04.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.240+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 --> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f997006d6a0 con 0x7f995c06d6d0 2023-10-10T22:38:04.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.241+0000 7f9957fff700 1 -- 172.21.15.154:0/1873949220 <== osd.4 v2:172.21.15.179:6800/88317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f997006d6a0 con 0x7f995c06d6d0 2023-10-10T22:38:04.244 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:38:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-10T22:38:04.244 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:38:04.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7f995c06d6d0 msgr2=0x7f995c06fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.179:6800/88317,v1:172.21.15.179:6801/88317] conn(0x7f995c06d6d0 0x7f995c06fb40 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f995c066f30 msgr2=0x7f995c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f995c066f30 0x7f995c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99700c7940 tx=0x7f9964007d50 comp rx=0 tx=0).stop 2023-10-10T22:38:04.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9970068890 msgr2=0x7f99700caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 --2- 172.21.15.154:0/1873949220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9970068890 0x7f99700caaa0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f99700ad6d0 tx=0x7f9960017000 comp rx=0 tx=0).stop 2023-10-10T22:38:04.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f9974f9c700 1 -- 172.21.15.154:0/1873949220 reap_dead start 2023-10-10T22:38:04.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 shutdown_connections 2023-10-10T22:38:04.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 >> 172.21.15.154:0/1873949220 conn(0x7f99700c8f90 msgr2=0x7f997006e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:04.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 shutdown_connections 2023-10-10T22:38:04.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.242+0000 7f99769ff700 1 -- 172.21.15.154:0/1873949220 wait complete. 2023-10-10T22:38:04.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-10T22:38:04.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.444+0000 7f496659d700 1 Processor -- start 2023-10-10T22:38:04.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.444+0000 7f496659d700 1 -- start start 2023-10-10T22:38:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.445+0000 7f496659d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4960068aa0 0x7f49600b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.445+0000 7f496659d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496015a980 con 0x7f4960157270 2023-10-10T22:38:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.445+0000 7f496659d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496015a050 con 0x7f49600b0a00 2023-10-10T22:38:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.445+0000 7f496659d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496015a330 con 0x7f4960068aa0 2023-10-10T22:38:04.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f496559b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4960157270 0x7f4960068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34112/0 (socket says 172.21.15.154:34112) 2023-10-10T22:38:04.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f496559b700 1 -- 172.21.15.154:0/1263351316 learned_addr learned my addr 172.21.15.154:0/1263351316 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:04.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f4964d9a700 1 --2- 172.21.15.154:0/1263351316 >> v2:172.21.15.179:3300/0 conn(0x7f4960068aa0 0x7f49600b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f4957fff700 1 -- 172.21.15.154:0/1263351316 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271361002 0 0) 0x7f496015a980 con 0x7f4960157270 2023-10-10T22:38:04.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f4957fff700 1 -- 172.21.15.154:0/1263351316 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f494c003570 con 0x7f4960157270 2023-10-10T22:38:04.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f4957fff700 1 -- 172.21.15.154:0/1263351316 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368196958 0 0) 0x7f496015a050 con 0x7f49600b0a00 2023-10-10T22:38:04.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f4957fff700 1 -- 172.21.15.154:0/1263351316 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f496015a980 con 0x7f49600b0a00 2023-10-10T22:38:04.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f4964d9a700 1 -- 172.21.15.154:0/1263351316 >> v1:172.21.15.179:6789/0 conn(0x7f49600b0a00 legacy=0x7f496015d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f4957fff700 1 -- 172.21.15.154:0/1263351316 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384290448 0 0) 0x7f494c003570 con 0x7f4960157270 2023-10-10T22:38:04.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f4964d9a700 1 -- 172.21.15.154:0/1263351316 >> v1:172.21.15.154:6789/0 conn(0x7f4960157270 legacy=0x7f4960068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.446+0000 7f4964d9a700 1 -- 172.21.15.154:0/1263351316 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496015a610 con 0x7f4960068aa0 2023-10-10T22:38:04.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.447+0000 7f4964d9a700 1 --2- 172.21.15.154:0/1263351316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4960068aa0 0x7f49600b04c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f49500098e0 tx=0x7f49500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ece18067ddfff48 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.447+0000 7f4957fff700 1 -- 172.21.15.154:0/1263351316 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c001470 con 0x7f4960068aa0 2023-10-10T22:38:04.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.447+0000 7f4957fff700 1 -- 172.21.15.154:0/1263351316 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4950011420 con 0x7f4960068aa0 2023-10-10T22:38:04.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.447+0000 7f4957fff700 1 -- 172.21.15.154:0/1263351316 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49500117a0 con 0x7f4960068aa0 2023-10-10T22:38:04.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.448+0000 7f496659d700 1 -- 172.21.15.154:0/1263351316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4960068aa0 msgr2=0x7f49600b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.448+0000 7f496659d700 1 --2- 172.21.15.154:0/1263351316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4960068aa0 0x7f49600b04c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f49500098e0 tx=0x7f49500091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.448+0000 7f496659d700 1 -- 172.21.15.154:0/1263351316 shutdown_connections 2023-10-10T22:38:04.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.448+0000 7f496659d700 1 --2- 172.21.15.154:0/1263351316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4960068aa0 0x7f49600b04c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.448+0000 7f496659d700 1 -- 172.21.15.154:0/1263351316 >> 172.21.15.154:0/1263351316 conn(0x7f49600cd310 msgr2=0x7f49600cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.448+0000 7f496659d700 1 -- 172.21.15.154:0/1263351316 shutdown_connections 2023-10-10T22:38:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.448+0000 7f496659d700 1 -- 172.21.15.154:0/1263351316 wait complete. 2023-10-10T22:38:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.449+0000 7f496659d700 1 Processor -- start 2023-10-10T22:38:04.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.449+0000 7f496659d700 1 -- start start 2023-10-10T22:38:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f496659d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4960068aa0 0x7f49600ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f496659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49600b0a00 0x7f4960141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f496659d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4960157270 0x7f4960158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f496659d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49600ac1f0 con 0x7f4960157270 2023-10-10T22:38:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f496659d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496016b0f0 con 0x7f4960068aa0 2023-10-10T22:38:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f496659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49600ab6a0 con 0x7f49600b0a00 2023-10-10T22:38:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f4965d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4960157270 0x7f4960158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f496559b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4960068aa0 0x7f49600ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f4965d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4960157270 0x7f4960158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59378/0 (socket says 172.21.15.154:59378) 2023-10-10T22:38:04.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f4965d9c700 1 -- 172.21.15.154:0/3421424059 learned_addr learned my addr 172.21.15.154:0/3421424059 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.450+0000 7f4964d9a700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49600b0a00 0x7f4960141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f4965d9c700 1 -- 172.21.15.154:0/3421424059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49600b0a00 msgr2=0x7f4960141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f4965d9c700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49600b0a00 0x7f4960141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f4965d9c700 1 -- 172.21.15.154:0/3421424059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4960068aa0 msgr2=0x7f49600ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f4965d9c700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4960068aa0 0x7f49600ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f4965d9c700 1 -- 172.21.15.154:0/3421424059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950009420 con 0x7f4960157270 2023-10-10T22:38:04.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f4965d9c700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4960157270 0x7f4960158f30 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f495800c940 tx=0x7f49580027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f49557fa700 1 -- 172.21.15.154:0/3421424059 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958012630 con 0x7f4960157270 2023-10-10T22:38:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f49557fa700 1 -- 172.21.15.154:0/3421424059 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49580127b0 con 0x7f4960157270 2023-10-10T22:38:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49600ab950 con 0x7f4960157270 2023-10-10T22:38:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f49557fa700 1 -- 172.21.15.154:0/3421424059 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958012b70 con 0x7f4960157270 2023-10-10T22:38:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.451+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49600abf10 con 0x7f4960157270 2023-10-10T22:38:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.452+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496016aea0 con 0x7f4960157270 2023-10-10T22:38:04.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.453+0000 7f49557fa700 1 -- 172.21.15.154:0/3421424059 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f495801b400 con 0x7f4960157270 2023-10-10T22:38:04.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.455+0000 7f49557fa700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4944066fb0 0x7f4944069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.455+0000 7f49557fa700 1 -- 172.21.15.154:0/3421424059 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f49580849e0 con 0x7f4960157270 2023-10-10T22:38:04.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.455+0000 7f496559b700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4944066fb0 0x7f4944069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.455+0000 7f496559b700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4944066fb0 0x7f4944069460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49600ac950 tx=0x7f495c001960 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.459+0000 7f49557fa700 1 -- 172.21.15.154:0/3421424059 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4958051b30 con 0x7f4960157270 2023-10-10T22:38:04.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.650+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f496004c3c0 con 0x7f4944066fb0 2023-10-10T22:38:04.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.651+0000 7f49557fa700 1 -- 172.21.15.154:0/3421424059 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f496004c3c0 con 0x7f4944066fb0 2023-10-10T22:38:04.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4944066fb0 msgr2=0x7f4944069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4944066fb0 0x7f4944069460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49600ac950 tx=0x7f495c001960 comp rx=0 tx=0).stop 2023-10-10T22:38:04.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4960157270 msgr2=0x7f4960158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4960157270 0x7f4960158f30 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f495800c940 tx=0x7f49580027a0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 shutdown_connections 2023-10-10T22:38:04.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f4944066fb0 0x7f4944069460 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4960157270 0x7f4960158f30 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4960068aa0 0x7f49600ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 --2- 172.21.15.154:0/3421424059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49600b0a00 0x7f4960141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.653+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 >> 172.21.15.154:0/3421424059 conn(0x7f49600cd310 msgr2=0x7f4960155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:04.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.654+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 shutdown_connections 2023-10-10T22:38:04.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.654+0000 7f496659d700 1 -- 172.21.15.154:0/3421424059 wait complete. 2023-10-10T22:38:04.659 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 4 to deep-scrub 2023-10-10T22:38:04.673 INFO:tasks.ceph:Scrubbing osd.5 2023-10-10T22:38:04.674 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-10T22:38:04.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.858+0000 7fe2d3fff700 1 Processor -- start 2023-10-10T22:38:04.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.858+0000 7fe2d3fff700 1 -- start start 2023-10-10T22:38:04.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.859+0000 7fe2d3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2cc0c8490 0x7fe2cc0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.859+0000 7fe2d3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2cc15a490 0x7fe2cc068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.859+0000 7fe2d3fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc0ac030 con 0x7fe2cc069a50 2023-10-10T22:38:04.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d3fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc0ab820 con 0x7fe2cc0c8490 2023-10-10T22:38:04.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc06dbb0 con 0x7fe2cc15a490 2023-10-10T22:38:04.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2cc0c8490 0x7fe2cc0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2cc0c8490 0x7fe2cc0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59382/0 (socket says 172.21.15.154:59382) 2023-10-10T22:38:04.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d1d9b700 1 -- 172.21.15.154:0/4072319761 learned_addr learned my addr 172.21.15.154:0/4072319761 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:04.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d159a700 1 --2- 172.21.15.154:0/4072319761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2cc15a490 0x7fe2cc068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d1d9b700 1 -- 172.21.15.154:0/4072319761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2cc15a490 msgr2=0x7fe2cc068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:04.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d1d9b700 1 --2- 172.21.15.154:0/4072319761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2cc15a490 0x7fe2cc068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d1d9b700 1 -- 172.21.15.154:0/4072319761 >> v1:172.21.15.179:6789/0 conn(0x7fe2cc069a50 legacy=0x7fe2cc156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.860+0000 7fe2d1d9b700 1 -- 172.21.15.154:0/4072319761 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0aba70 con 0x7fe2cc0c8490 2023-10-10T22:38:04.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.861+0000 7fe2d1d9b700 1 --2- 172.21.15.154:0/4072319761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc0c8490 0x7fe2cc0c6ac0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800bc50 tx=0x7fe2c800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b46fc42559ca902 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.861+0000 7fe2d0d99700 1 -- 172.21.15.154:0/4072319761 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c800dbf0 con 0x7fe2cc0c8490 2023-10-10T22:38:04.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.861+0000 7fe2d0d99700 1 -- 172.21.15.154:0/4072319761 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c800dd50 con 0x7fe2cc0c8490 2023-10-10T22:38:04.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.861+0000 7fe2d0d99700 1 -- 172.21.15.154:0/4072319761 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c80196b0 con 0x7fe2cc0c8490 2023-10-10T22:38:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.861+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4072319761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc0c8490 msgr2=0x7fe2cc0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.861+0000 7fe2d3fff700 1 --2- 172.21.15.154:0/4072319761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc0c8490 0x7fe2cc0c6ac0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800bc50 tx=0x7fe2c800b4f0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.862+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4072319761 shutdown_connections 2023-10-10T22:38:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.862+0000 7fe2d3fff700 1 --2- 172.21.15.154:0/4072319761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc0c8490 0x7fe2cc0c6ac0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.862+0000 7fe2d3fff700 1 --2- 172.21.15.154:0/4072319761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2cc15a490 0x7fe2cc068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.862+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4072319761 >> 172.21.15.154:0/4072319761 conn(0x7fe2cc0c8f90 msgr2=0x7fe2cc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.862+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4072319761 shutdown_connections 2023-10-10T22:38:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.862+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4072319761 wait complete. 2023-10-10T22:38:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.863+0000 7fe2d3fff700 1 Processor -- start 2023-10-10T22:38:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.863+0000 7fe2d3fff700 1 -- start start 2023-10-10T22:38:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.864+0000 7fe2d3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2cc069a50 0x7fe2cc0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.864+0000 7fe2d3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2cc0c8490 0x7fe2cc154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.864+0000 7fe2d3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc15a490 0x7fe2cc154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.864+0000 7fe2d3fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc154e90 con 0x7fe2cc15a490 2023-10-10T22:38:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.864+0000 7fe2d3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0b10b0 con 0x7fe2cc0c8490 2023-10-10T22:38:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.864+0000 7fe2d3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0b1390 con 0x7fe2cc069a50 2023-10-10T22:38:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.864+0000 7fe2d259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc15a490 0x7fe2cc154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.864+0000 7fe2d259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc15a490 0x7fe2cc154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59384/0 (socket says 172.21.15.154:59384) 2023-10-10T22:38:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.864+0000 7fe2d259c700 1 -- 172.21.15.154:0/4156340054 learned_addr learned my addr 172.21.15.154:0/4156340054 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d1d9b700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2cc069a50 0x7fe2cc0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d159a700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2cc0c8490 0x7fe2cc154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d259c700 1 -- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2cc069a50 msgr2=0x7fe2cc0c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d259c700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2cc069a50 0x7fe2cc0c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d259c700 1 -- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2cc0c8490 msgr2=0x7fe2cc154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d259c700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2cc0c8490 0x7fe2cc154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d259c700 1 -- 172.21.15.154:0/4156340054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c800b790 con 0x7fe2cc15a490 2023-10-10T22:38:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d259c700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc15a490 0x7fe2cc154950 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c8e0 tx=0x7fe2c4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2c1ffb700 1 -- 172.21.15.154:0/4156340054 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400ce80 con 0x7fe2cc15a490 2023-10-10T22:38:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2c1ffb700 1 -- 172.21.15.154:0/4156340054 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c400a7e0 con 0x7fe2cc15a490 2023-10-10T22:38:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2c1ffb700 1 -- 172.21.15.154:0/4156340054 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400ab80 con 0x7fe2cc15a490 2023-10-10T22:38:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc0b1670 con 0x7fe2cc15a490 2023-10-10T22:38:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.865+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc0b1c30 con 0x7fe2cc15a490 2023-10-10T22:38:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.866+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2cc0718b0 con 0x7fe2cc15a490 2023-10-10T22:38:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.867+0000 7fe2c1ffb700 1 -- 172.21.15.154:0/4156340054 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2c4012420 con 0x7fe2cc15a490 2023-10-10T22:38:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.868+0000 7fe2c1ffb700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe2b0066f30 0x7fe2b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.868+0000 7fe2c1ffb700 1 -- 172.21.15.154:0/4156340054 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fe2c4084880 con 0x7fe2cc15a490 2023-10-10T22:38:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.868+0000 7fe2c1ffb700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fe2b006d6d0 0x7fe2b006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.868+0000 7fe2d1d9b700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe2b0066f30 0x7fe2b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.868+0000 7fe2c1ffb700 1 -- 172.21.15.154:0/4156340054 --> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2b0070170 con 0x7fe2b006d6d0 2023-10-10T22:38:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.868+0000 7fe2c1ffb700 1 -- 172.21.15.154:0/4156340054 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2c4086de0 con 0x7fe2cc15a490 2023-10-10T22:38:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.869+0000 7fe2d159a700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fe2b006d6d0 0x7fe2b006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.869+0000 7fe2d1d9b700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe2b0066f30 0x7fe2b00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800bc50 tx=0x7fe2c801b000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.869+0000 7fe2d159a700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fe2b006d6d0 0x7fe2b006fb40 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:04.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.870+0000 7fe2c1ffb700 1 -- 172.21.15.154:0/4156340054 <== osd.5 v2:172.21.15.179:6808/88318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe2b0070170 con 0x7fe2b006d6d0 2023-10-10T22:38:04.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.884+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 --> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe2cc0ac030 con 0x7fe2b006d6d0 2023-10-10T22:38:04.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.885+0000 7fe2c1ffb700 1 -- 172.21.15.154:0/4156340054 <== osd.5 v2:172.21.15.179:6808/88318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe2cc0ac030 con 0x7fe2b006d6d0 2023-10-10T22:38:04.888 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:38:04.888 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-10T22:38:04.888 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:38:04.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fe2b006d6d0 msgr2=0x7fe2b006fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.179:6808/88318,v1:172.21.15.179:6809/88318] conn(0x7fe2b006d6d0 0x7fe2b006fb40 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe2b0066f30 msgr2=0x7fe2b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe2b0066f30 0x7fe2b00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800bc50 tx=0x7fe2c801b000 comp rx=0 tx=0).stop 2023-10-10T22:38:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc15a490 msgr2=0x7fe2cc154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 --2- 172.21.15.154:0/4156340054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc15a490 0x7fe2cc154950 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c8e0 tx=0x7fe2c4001710 comp rx=0 tx=0).stop 2023-10-10T22:38:04.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d259c700 1 -- 172.21.15.154:0/4156340054 reap_dead start 2023-10-10T22:38:04.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 shutdown_connections 2023-10-10T22:38:04.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 >> 172.21.15.154:0/4156340054 conn(0x7fe2cc0c8f90 msgr2=0x7fe2cc0a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:04.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 shutdown_connections 2023-10-10T22:38:04.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:04.886+0000 7fe2d3fff700 1 -- 172.21.15.154:0/4156340054 wait complete. 2023-10-10T22:38:04.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-10T22:38:05.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.088+0000 7fd348dff700 1 Processor -- start 2023-10-10T22:38:05.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.088+0000 7fd348dff700 1 -- start start 2023-10-10T22:38:05.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.088+0000 7fd348dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd344155c10 0x7fd344155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.088+0000 7fd348dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3440ac6a0 0x7fd3440b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.088+0000 7fd348dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3440acac0 con 0x7fd3440ac230 2023-10-10T22:38:05.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.088+0000 7fd348dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3440ad930 con 0x7fd3440ac6a0 2023-10-10T22:38:05.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.088+0000 7fd348dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3440acd20 con 0x7fd344155c10 2023-10-10T22:38:05.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.088+0000 7fd341d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3440ac230 0x7fd3441568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34128/0 (socket says 172.21.15.154:34128) 2023-10-10T22:38:05.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.088+0000 7fd341d9b700 1 -- 172.21.15.154:0/2381782344 learned_addr learned my addr 172.21.15.154:0/2381782344 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:05.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.089+0000 7fd34259c700 1 --2- 172.21.15.154:0/2381782344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd344155c10 0x7fd344155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.089+0000 7fd342d9d700 1 --2- 172.21.15.154:0/2381782344 >> v2:172.21.15.179:3300/0 conn(0x7fd3440ac6a0 0x7fd3440b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.089+0000 7fd34159a700 1 -- 172.21.15.154:0/2381782344 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904831001 0 0) 0x7fd3440acac0 con 0x7fd3440ac230 2023-10-10T22:38:05.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.089+0000 7fd34159a700 1 -- 172.21.15.154:0/2381782344 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd32c004680 con 0x7fd3440ac230 2023-10-10T22:38:05.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.089+0000 7fd34259c700 1 -- 172.21.15.154:0/2381782344 >> v2:172.21.15.179:3300/0 conn(0x7fd3440ac6a0 msgr2=0x7fd3440b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:05.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.089+0000 7fd34259c700 1 --2- 172.21.15.154:0/2381782344 >> v2:172.21.15.179:3300/0 conn(0x7fd3440ac6a0 0x7fd3440b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.089+0000 7fd34259c700 1 -- 172.21.15.154:0/2381782344 >> v1:172.21.15.154:6789/0 conn(0x7fd3440ac230 legacy=0x7fd3441568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.089+0000 7fd34259c700 1 -- 172.21.15.154:0/2381782344 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3440ad000 con 0x7fd344155c10 2023-10-10T22:38:05.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.089+0000 7fd34259c700 1 --2- 172.21.15.154:0/2381782344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd344155c10 0x7fd344155fe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd3340098e0 tx=0x7fd3340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e87bbe3e863b587 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd34159a700 1 -- 172.21.15.154:0/2381782344 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334011630 con 0x7fd344155c10 2023-10-10T22:38:05.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd34159a700 1 -- 172.21.15.154:0/2381782344 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334011790 con 0x7fd344155c10 2023-10-10T22:38:05.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd34159a700 1 -- 172.21.15.154:0/2381782344 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334011b30 con 0x7fd344155c10 2023-10-10T22:38:05.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd348dff700 1 -- 172.21.15.154:0/2381782344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd344155c10 msgr2=0x7fd344155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd348dff700 1 --2- 172.21.15.154:0/2381782344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd344155c10 0x7fd344155fe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd3340098e0 tx=0x7fd3340091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd348dff700 1 -- 172.21.15.154:0/2381782344 shutdown_connections 2023-10-10T22:38:05.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd348dff700 1 --2- 172.21.15.154:0/2381782344 >> v2:172.21.15.179:3300/0 conn(0x7fd3440ac6a0 0x7fd3440b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd348dff700 1 --2- 172.21.15.154:0/2381782344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd344155c10 0x7fd344155fe0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd348dff700 1 -- 172.21.15.154:0/2381782344 >> 172.21.15.154:0/2381782344 conn(0x7fd34406a320 msgr2=0x7fd3440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:05.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd348dff700 1 -- 172.21.15.154:0/2381782344 shutdown_connections 2023-10-10T22:38:05.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.090+0000 7fd348dff700 1 -- 172.21.15.154:0/2381782344 wait complete. 2023-10-10T22:38:05.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.092+0000 7fd348dff700 1 Processor -- start 2023-10-10T22:38:05.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.092+0000 7fd348dff700 1 -- start start 2023-10-10T22:38:05.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd348dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3440ac230 0x7fd344151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd348dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3440ac6a0 0x7fd34406e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd348dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344155c10 0x7fd34406e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd348dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd344151f60 con 0x7fd344155c10 2023-10-10T22:38:05.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd348dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34416a2d0 con 0x7fd3440ac230 2023-10-10T22:38:05.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd348dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd344169450 con 0x7fd3440ac6a0 2023-10-10T22:38:05.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd342d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344155c10 0x7fd34406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd342d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344155c10 0x7fd34406e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59386/0 (socket says 172.21.15.154:59386) 2023-10-10T22:38:05.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd342d9d700 1 -- 172.21.15.154:0/268226981 learned_addr learned my addr 172.21.15.154:0/268226981 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:05.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd34259c700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3440ac230 0x7fd344151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd341d9b700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3440ac6a0 0x7fd34406e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd342d9d700 1 -- 172.21.15.154:0/268226981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3440ac6a0 msgr2=0x7fd34406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.093+0000 7fd342d9d700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3440ac6a0 0x7fd34406e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd342d9d700 1 -- 172.21.15.154:0/268226981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3440ac230 msgr2=0x7fd344151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd342d9d700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3440ac230 0x7fd344151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd342d9d700 1 -- 172.21.15.154:0/268226981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334009420 con 0x7fd344155c10 2023-10-10T22:38:05.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd341d9b700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3440ac6a0 0x7fd34406e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:05.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd342d9d700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344155c10 0x7fd34406e970 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009e90 tx=0x7fd33c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd3327fc700 1 -- 172.21.15.154:0/268226981 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00cc20 con 0x7fd344155c10 2023-10-10T22:38:05.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd3327fc700 1 -- 172.21.15.154:0/268226981 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c00f040 con 0x7fd344155c10 2023-10-10T22:38:05.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd3327fc700 1 -- 172.21.15.154:0/268226981 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c014480 con 0x7fd344155c10 2023-10-10T22:38:05.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3441696c0 con 0x7fd344155c10 2023-10-10T22:38:05.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.094+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd344169c80 con 0x7fd344155c10 2023-10-10T22:38:05.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.095+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34404c3c0 con 0x7fd344155c10 2023-10-10T22:38:05.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.096+0000 7fd3327fc700 1 -- 172.21.15.154:0/268226981 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd33c014830 con 0x7fd344155c10 2023-10-10T22:38:05.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.097+0000 7fd3327fc700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd324066f30 0x7fd3240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.097+0000 7fd3327fc700 1 -- 172.21.15.154:0/268226981 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fd33c085440 con 0x7fd344155c10 2023-10-10T22:38:05.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.097+0000 7fd34259c700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd324066f30 0x7fd3240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.098+0000 7fd34259c700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd324066f30 0x7fd3240693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3340091e0 tx=0x7fd334017000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.101+0000 7fd3327fc700 1 -- 172.21.15.154:0/268226981 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd33c055f60 con 0x7fd344155c10 2023-10-10T22:38:05.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.291+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3440ad2e0 con 0x7fd324066f30 2023-10-10T22:38:05.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.292+0000 7fd3327fc700 1 -- 172.21.15.154:0/268226981 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3440ad2e0 con 0x7fd324066f30 2023-10-10T22:38:05.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd324066f30 msgr2=0x7fd3240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd324066f30 0x7fd3240693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3340091e0 tx=0x7fd334017000 comp rx=0 tx=0).stop 2023-10-10T22:38:05.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344155c10 msgr2=0x7fd34406e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344155c10 0x7fd34406e970 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009e90 tx=0x7fd33c00b040 comp rx=0 tx=0).stop 2023-10-10T22:38:05.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 shutdown_connections 2023-10-10T22:38:05.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fd324066f30 0x7fd3240693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd344155c10 0x7fd34406e970 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3440ac230 0x7fd344151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 --2- 172.21.15.154:0/268226981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3440ac6a0 0x7fd34406e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 >> 172.21.15.154:0/268226981 conn(0x7fd34406a320 msgr2=0x7fd34415f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:05.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 shutdown_connections 2023-10-10T22:38:05.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.295+0000 7fd348dff700 1 -- 172.21.15.154:0/268226981 wait complete. 2023-10-10T22:38:05.299 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 5 to deep-scrub 2023-10-10T22:38:05.316 INFO:tasks.ceph:Scrubbing osd.6 2023-10-10T22:38:05.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-10T22:38:05.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.501+0000 7fe81abff700 1 Processor -- start 2023-10-10T22:38:05.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.501+0000 7fe81abff700 1 -- start start 2023-10-10T22:38:05.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe81abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81415a440 0x7fe8140acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe81abff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe814068890 0x7fe8140c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe81abff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81415a9b0 con 0x7fe8141563b0 2023-10-10T22:38:05.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe81abff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81415ac90 con 0x7fe814068890 2023-10-10T22:38:05.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe81abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81415af70 con 0x7fe81415a440 2023-10-10T22:38:05.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe81899b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe8141563b0 0x7fe814156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34144/0 (socket says 172.21.15.154:34144) 2023-10-10T22:38:05.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe81899b700 1 -- 172.21.15.154:0/4011069063 learned_addr learned my addr 172.21.15.154:0/4011069063 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:05.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe81919c700 1 --2- 172.21.15.154:0/4011069063 >> v2:172.21.15.179:3300/0 conn(0x7fe814068890 0x7fe8140c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe813fff700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81415a440 0x7fe8140acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578154088 0 0) 0x7fe81415a9b0 con 0x7fe8141563b0 2023-10-10T22:38:05.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.503+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe804003570 con 0x7fe8141563b0 2023-10-10T22:38:05.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2017709216 0 0) 0x7fe804003570 con 0x7fe8141563b0 2023-10-10T22:38:05.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81415a440 msgr2=0x7fe8140acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:05.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81415a440 0x7fe8140acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 >> v2:172.21.15.179:3300/0 conn(0x7fe814068890 msgr2=0x7fe8140c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:05.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 --2- 172.21.15.154:0/4011069063 >> v2:172.21.15.179:3300/0 conn(0x7fe814068890 0x7fe8140c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81415b250 con 0x7fe8141563b0 2023-10-10T22:38:05.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fe808001470 con 0x7fe8141563b0 2023-10-10T22:38:05.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 >> v1:172.21.15.154:6789/0 conn(0x7fe8141563b0 legacy=0x7fe814156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe804003ae0 0x7fe804003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81415a440 0x7fe804004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804004d50 0x7fe8040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81415ac90 con 0x7fe804003ae0 2023-10-10T22:38:05.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81415af70 con 0x7fe804004d50 2023-10-10T22:38:05.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80400bb10 con 0x7fe81415a440 2023-10-10T22:38:05.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe81899b700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe804003ae0 0x7fe804003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe81919c700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804004d50 0x7fe8040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe813fff700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81415a440 0x7fe804004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe81899b700 1 -- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81415a440 msgr2=0x7fe804004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:05.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe81899b700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81415a440 0x7fe804004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe81899b700 1 -- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804004d50 msgr2=0x7fe8040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:05.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe81899b700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804004d50 0x7fe8040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe81899b700 1 -- 172.21.15.154:0/4011069063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804003570 con 0x7fe804003ae0 2023-10-10T22:38:05.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.504+0000 7fe81919c700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804004d50 0x7fe8040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:05.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.505+0000 7fe81899b700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe804003ae0 0x7fe804003ef0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fe808007c30 tx=0x7fe808001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f76c5937f99114 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.505+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80800cb60 con 0x7fe804003ae0 2023-10-10T22:38:05.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.505+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80800ccc0 con 0x7fe804003ae0 2023-10-10T22:38:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.505+0000 7fe8137fe700 1 -- 172.21.15.154:0/4011069063 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808005b70 con 0x7fe804003ae0 2023-10-10T22:38:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.505+0000 7fe81abff700 1 -- 172.21.15.154:0/4011069063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe804003ae0 msgr2=0x7fe804003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.505+0000 7fe81abff700 1 --2- 172.21.15.154:0/4011069063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe804003ae0 0x7fe804003ef0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fe808007c30 tx=0x7fe808001dc0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.505+0000 7fe81919c700 1 -- 172.21.15.154:0/4011069063 reap_dead start 2023-10-10T22:38:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.505+0000 7fe81abff700 1 -- 172.21.15.154:0/4011069063 shutdown_connections 2023-10-10T22:38:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.506+0000 7fe81abff700 1 -- 172.21.15.154:0/4011069063 >> 172.21.15.154:0/4011069063 conn(0x7fe8140c8f90 msgr2=0x7fe8140c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.506+0000 7fe81abff700 1 -- 172.21.15.154:0/4011069063 shutdown_connections 2023-10-10T22:38:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.506+0000 7fe81abff700 1 -- 172.21.15.154:0/4011069063 wait complete. 2023-10-10T22:38:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.507+0000 7fe81abff700 1 Processor -- start 2023-10-10T22:38:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.507+0000 7fe81abff700 1 -- start start 2023-10-10T22:38:05.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.508+0000 7fe81abff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804003ae0 0x7fe8140afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.508+0000 7fe81abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8140b18d0 0x7fe81416d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.508+0000 7fe81abff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe81416dd40 0x7fe81406daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.508+0000 7fe81abff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8140affb0 con 0x7fe81416dd40 2023-10-10T22:38:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.508+0000 7fe81abff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe814157260 con 0x7fe804003ae0 2023-10-10T22:38:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.508+0000 7fe81abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81416e1b0 con 0x7fe8140b18d0 2023-10-10T22:38:05.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.508+0000 7fe81919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe81416dd40 0x7fe81406daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.508+0000 7fe81919c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe81416dd40 0x7fe81406daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59400/0 (socket says 172.21.15.154:59400) 2023-10-10T22:38:05.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.508+0000 7fe81919c700 1 -- 172.21.15.154:0/1395440145 learned_addr learned my addr 172.21.15.154:0/1395440145 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:05.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe81899b700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804003ae0 0x7fe8140afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe813fff700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8140b18d0 0x7fe81416d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe81919c700 1 -- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8140b18d0 msgr2=0x7fe81416d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe81919c700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8140b18d0 0x7fe81416d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe81919c700 1 -- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804003ae0 msgr2=0x7fe8140afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe81919c700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804003ae0 0x7fe8140afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe81919c700 1 -- 172.21.15.154:0/1395440145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8140a9f90 con 0x7fe81416dd40 2023-10-10T22:38:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe813fff700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8140b18d0 0x7fe81416d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe81899b700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe804003ae0 0x7fe8140afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe81919c700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe81416dd40 0x7fe81406daa0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fe81415a8c0 tx=0x7fe80c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe810ff9700 1 -- 172.21.15.154:0/1395440145 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c01b070 con 0x7fe81416dd40 2023-10-10T22:38:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe810ff9700 1 -- 172.21.15.154:0/1395440145 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c00f040 con 0x7fe81416dd40 2023-10-10T22:38:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8140a9980 con 0x7fe81416dd40 2023-10-10T22:38:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.509+0000 7fe810ff9700 1 -- 172.21.15.154:0/1395440145 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c00e050 con 0x7fe81416dd40 2023-10-10T22:38:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.510+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8140a9c20 con 0x7fe81416dd40 2023-10-10T22:38:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.510+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8140718b0 con 0x7fe81416dd40 2023-10-10T22:38:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.511+0000 7fe810ff9700 1 -- 172.21.15.154:0/1395440145 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe80c003020 con 0x7fe81416dd40 2023-10-10T22:38:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.512+0000 7fe810ff9700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe7f8066f30 0x7fe7f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.512+0000 7fe810ff9700 1 -- 172.21.15.154:0/1395440145 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fe80c084be0 con 0x7fe81416dd40 2023-10-10T22:38:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.512+0000 7fe81899b700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe7f8066f30 0x7fe7f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.512+0000 7fe810ff9700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7fe7f806d6d0 0x7fe7f806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.512+0000 7fe810ff9700 1 -- 172.21.15.154:0/1395440145 --> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7f8070170 con 0x7fe7f806d6d0 2023-10-10T22:38:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.512+0000 7fe810ff9700 1 -- 172.21.15.154:0/1395440145 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe80c089220 con 0x7fe81416dd40 2023-10-10T22:38:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.513+0000 7fe81899b700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe7f8066f30 0x7fe7f80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe808007bb0 tx=0x7fe808014000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.513+0000 7fe813fff700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7fe7f806d6d0 0x7fe7f806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.514+0000 7fe813fff700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7fe7f806d6d0 0x7fe7f806fb40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.515+0000 7fe810ff9700 1 -- 172.21.15.154:0/1395440145 <== osd.6 v2:172.21.15.179:6816/88346 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe7f8070170 con 0x7fe7f806d6d0 2023-10-10T22:38:05.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.529+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 --> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe81406d6a0 con 0x7fe7f806d6d0 2023-10-10T22:38:05.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe810ff9700 1 -- 172.21.15.154:0/1395440145 <== osd.6 v2:172.21.15.179:6816/88346 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe81406d6a0 con 0x7fe7f806d6d0 2023-10-10T22:38:05.532 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:38:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-10T22:38:05.533 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:38:05.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7fe7f806d6d0 msgr2=0x7fe7f806fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.179:6816/88346,v1:172.21.15.179:6817/88346] conn(0x7fe7f806d6d0 0x7fe7f806fb40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe7f8066f30 msgr2=0x7fe7f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fe7f8066f30 0x7fe7f80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe808007bb0 tx=0x7fe808014000 comp rx=0 tx=0).stop 2023-10-10T22:38:05.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe81416dd40 msgr2=0x7fe81406daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 --2- 172.21.15.154:0/1395440145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe81416dd40 0x7fe81406daa0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fe81415a8c0 tx=0x7fe80c00b040 comp rx=0 tx=0).stop 2023-10-10T22:38:05.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81919c700 1 -- 172.21.15.154:0/1395440145 reap_dead start 2023-10-10T22:38:05.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 shutdown_connections 2023-10-10T22:38:05.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 >> 172.21.15.154:0/1395440145 conn(0x7fe8140c8f90 msgr2=0x7fe8140cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:05.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 shutdown_connections 2023-10-10T22:38:05.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.530+0000 7fe81abff700 1 -- 172.21.15.154:0/1395440145 wait complete. 2023-10-10T22:38:05.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-10T22:38:05.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.730+0000 7f6eb95ff700 1 Processor -- start 2023-10-10T22:38:05.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.730+0000 7f6eb95ff700 1 -- start start 2023-10-10T22:38:05.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb95ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb4155c10 0x7f6eb4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb95ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40acac0 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb95ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40ad930 con 0x7f6eb40ac230 2023-10-10T22:38:05.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb95ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40acd20 con 0x7f6eb4155c10 2023-10-10T22:38:05.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb37fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6eb40ac6a0 0x7f6eb40b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34148/0 (socket says 172.21.15.154:34148) 2023-10-10T22:38:05.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb37fe700 1 -- 172.21.15.154:0/731102321 learned_addr learned my addr 172.21.15.154:0/731102321 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:05.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb2ffd700 1 --2- 172.21.15.154:0/731102321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb4155c10 0x7f6eb4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb1ffb700 1 -- 172.21.15.154:0/731102321 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377644046 0 0) 0x7f6eb40acac0 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb1ffb700 1 -- 172.21.15.154:0/731102321 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e9c003570 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb1ffb700 1 -- 172.21.15.154:0/731102321 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035597239 0 0) 0x7f6eb40ad930 con 0x7f6eb40ac230 2023-10-10T22:38:05.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb1ffb700 1 -- 172.21.15.154:0/731102321 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb40acac0 con 0x7f6eb40ac230 2023-10-10T22:38:05.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb1ffb700 1 -- 172.21.15.154:0/731102321 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2491269290 0 0) 0x7f6e9c003570 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb2ffd700 1 -- 172.21.15.154:0/731102321 >> v1:172.21.15.179:6789/0 conn(0x7f6eb40ac230 legacy=0x7f6eb41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb2ffd700 1 -- 172.21.15.154:0/731102321 >> v1:172.21.15.154:6789/0 conn(0x7f6eb40ac6a0 legacy=0x7f6eb40b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb2ffd700 1 -- 172.21.15.154:0/731102321 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40ad000 con 0x7f6eb4155c10 2023-10-10T22:38:05.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb2ffd700 1 --2- 172.21.15.154:0/731102321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb4155c10 0x7f6eb4155fe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009e90 tx=0x7f6ea4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a9e956fd87b35f server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb1ffb700 1 -- 172.21.15.154:0/731102321 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac001470 con 0x7f6eb4155c10 2023-10-10T22:38:05.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb1ffb700 1 -- 172.21.15.154:0/731102321 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea400b870 con 0x7f6eb4155c10 2023-10-10T22:38:05.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.733+0000 7f6eb1ffb700 1 -- 172.21.15.154:0/731102321 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400bbf0 con 0x7f6eb4155c10 2023-10-10T22:38:05.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.734+0000 7f6eb95ff700 1 -- 172.21.15.154:0/731102321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb4155c10 msgr2=0x7f6eb4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.734+0000 7f6eb95ff700 1 --2- 172.21.15.154:0/731102321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb4155c10 0x7f6eb4155fe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009e90 tx=0x7f6ea4009780 comp rx=0 tx=0).stop 2023-10-10T22:38:05.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.734+0000 7f6eb95ff700 1 -- 172.21.15.154:0/731102321 shutdown_connections 2023-10-10T22:38:05.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.734+0000 7f6eb95ff700 1 --2- 172.21.15.154:0/731102321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb4155c10 0x7f6eb4155fe0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.734+0000 7f6eb95ff700 1 -- 172.21.15.154:0/731102321 >> 172.21.15.154:0/731102321 conn(0x7f6eb406a320 msgr2=0x7f6eb40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:05.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.734+0000 7f6eb95ff700 1 -- 172.21.15.154:0/731102321 shutdown_connections 2023-10-10T22:38:05.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.734+0000 7f6eb95ff700 1 -- 172.21.15.154:0/731102321 wait complete. 2023-10-10T22:38:05.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.735+0000 7f6eb95ff700 1 Processor -- start 2023-10-10T22:38:05.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.735+0000 7f6eb95ff700 1 -- start start 2023-10-10T22:38:05.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.736+0000 7f6eb95ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40ac230 0x7f6eb415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.736+0000 7f6eb95ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb40ac6a0 0x7f6eb406e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.736+0000 7f6eb95ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb4155c10 0x7f6eb406ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.736+0000 7f6eb95ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4151db0 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.736+0000 7f6eb95ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4158bd0 con 0x7f6eb4155c10 2023-10-10T22:38:05.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.736+0000 7f6eb95ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4159010 con 0x7f6eb40ac230 2023-10-10T22:38:05.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb40ac6a0 0x7f6eb406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb40ac6a0 0x7f6eb406e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59408/0 (socket says 172.21.15.154:59408) 2023-10-10T22:38:05.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb27fc700 1 -- 172.21.15.154:0/656122747 learned_addr learned my addr 172.21.15.154:0/656122747 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:05.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb37fe700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb4155c10 0x7f6eb406ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb2ffd700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40ac230 0x7f6eb415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb27fc700 1 -- 172.21.15.154:0/656122747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40ac230 msgr2=0x7f6eb415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb27fc700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40ac230 0x7f6eb415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb27fc700 1 -- 172.21.15.154:0/656122747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb4155c10 msgr2=0x7f6eb406ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb27fc700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb4155c10 0x7f6eb406ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb27fc700 1 -- 172.21.15.154:0/656122747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4009a20 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb37fe700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb4155c10 0x7f6eb406ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:05.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.737+0000 7f6eb27fc700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb40ac6a0 0x7f6eb406e680 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c790 tx=0x7f6ea8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.738+0000 7f6e9affd700 1 -- 172.21.15.154:0/656122747 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8010510 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.738+0000 7f6e9affd700 1 -- 172.21.15.154:0/656122747 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8010670 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.738+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb41592f0 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.738+0000 7f6e9affd700 1 -- 172.21.15.154:0/656122747 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8010a10 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.738+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb41598b0 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.739+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb4159ad0 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.740+0000 7f6e9affd700 1 -- 172.21.15.154:0/656122747 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ea801b400 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.741+0000 7f6e9affd700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6ea0066f30 0x7f6ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:05.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.741+0000 7f6e9affd700 1 -- 172.21.15.154:0/656122747 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f6ea8084560 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.741+0000 7f6eb2ffd700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6ea0066f30 0x7f6ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:05.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.742+0000 7f6eb2ffd700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6ea0066f30 0x7f6ea00693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009de0 tx=0x7f6ea4018000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:05.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.745+0000 7f6e9affd700 1 -- 172.21.15.154:0/656122747 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ea80515f0 con 0x7f6eb40ac6a0 2023-10-10T22:38:05.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.937+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6eb404c3c0 con 0x7f6ea0066f30 2023-10-10T22:38:05.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.937+0000 7f6e9affd700 1 -- 172.21.15.154:0/656122747 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6eb404c3c0 con 0x7f6ea0066f30 2023-10-10T22:38:05.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6ea0066f30 msgr2=0x7f6ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6ea0066f30 0x7f6ea00693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009de0 tx=0x7f6ea4018000 comp rx=0 tx=0).stop 2023-10-10T22:38:05.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb40ac6a0 msgr2=0x7f6eb406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb40ac6a0 0x7f6eb406e680 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c790 tx=0x7f6ea8007e10 comp rx=0 tx=0).stop 2023-10-10T22:38:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 shutdown_connections 2023-10-10T22:38:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6ea0066f30 0x7f6ea00693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb4155c10 0x7f6eb406ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb40ac230 0x7f6eb415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 --2- 172.21.15.154:0/656122747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb40ac6a0 0x7f6eb406e680 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:05.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 >> 172.21.15.154:0/656122747 conn(0x7f6eb406a320 msgr2=0x7f6eb415f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:05.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.940+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 shutdown_connections 2023-10-10T22:38:05.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:05.941+0000 7f6eb95ff700 1 -- 172.21.15.154:0/656122747 wait complete. 2023-10-10T22:38:05.945 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 6 to deep-scrub 2023-10-10T22:38:05.959 INFO:tasks.ceph:Scrubbing osd.7 2023-10-10T22:38:05.959 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-10T22:38:06.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.145+0000 7fbdad3ff700 1 Processor -- start 2023-10-10T22:38:06.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.145+0000 7fbdad3ff700 1 -- start start 2023-10-10T22:38:06.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.146+0000 7fbdad3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbda8153f50 0x7fbda80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.146+0000 7fbdad3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda80b4570 con 0x7fbda8154320 2023-10-10T22:38:06.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.146+0000 7fbdad3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda815a730 con 0x7fbda806d840 2023-10-10T22:38:06.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.146+0000 7fbdad3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda815aa10 con 0x7fbda8153f50 2023-10-10T22:38:06.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda67fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbda8154320 0x7fbda806d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40400/0 (socket says 172.21.15.154:40400) 2023-10-10T22:38:06.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda67fc700 1 -- 172.21.15.154:0/247278100 learned_addr learned my addr 172.21.15.154:0/247278100 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:06.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/247278100 >> v2:172.21.15.179:3300/0 conn(0x7fbda8153f50 0x7fbda80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449726919 0 0) 0x7fbda80b4570 con 0x7fbda8154320 2023-10-10T22:38:06.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd90003570 con 0x7fbda8154320 2023-10-10T22:38:06.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159906533 0 0) 0x7fbda815a730 con 0x7fbda806d840 2023-10-10T22:38:06.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda80b4570 con 0x7fbda806d840 2023-10-10T22:38:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548807813 0 0) 0x7fbd90003570 con 0x7fbda8154320 2023-10-10T22:38:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 >> v2:172.21.15.179:3300/0 conn(0x7fbda8153f50 msgr2=0x7fbda80b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 --2- 172.21.15.154:0/247278100 >> v2:172.21.15.179:3300/0 conn(0x7fbda8153f50 0x7fbda80b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 >> v1:172.21.15.179:6789/0 conn(0x7fbda806d840 legacy=0x7fbda8069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda815acf0 con 0x7fbda8154320 2023-10-10T22:38:06.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3226685813 0 0) 0x7fbd9c001470 con 0x7fbda8154320 2023-10-10T22:38:06.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.147+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 >> v1:172.21.15.154:6789/0 conn(0x7fbda8154320 legacy=0x7fbda806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda5ffb700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd90003c40 0x7fbd90004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda5ffb700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd90004810 0x7fbd90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda5ffb700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd90005210 0x7fbd9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda815aa10 con 0x7fbd90005210 2023-10-10T22:38:06.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9000c130 con 0x7fbd90004810 2023-10-10T22:38:06.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9000c2c0 con 0x7fbd90003c40 2023-10-10T22:38:06.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda77fe700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd90005210 0x7fbd9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda67fc700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd90004810 0x7fbd90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd90003c40 0x7fbd90004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda77fe700 1 -- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd90003c40 msgr2=0x7fbd90004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:06.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda77fe700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd90003c40 0x7fbd90004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda77fe700 1 -- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd90004810 msgr2=0x7fbd90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:06.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda77fe700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd90004810 0x7fbd90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda77fe700 1 -- 172.21.15.154:0/247278100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd90003570 con 0x7fbd90005210 2023-10-10T22:38:06.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda67fc700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd90004810 0x7fbd90004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:06.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd90003c40 0x7fbd90004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:06.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda77fe700 1 -- 172.21.15.154:0/247278100 reap_dead start 2023-10-10T22:38:06.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.148+0000 7fbda77fe700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd90005210 0x7fbd9000ba60 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fbda0002120 tx=0x7fbda00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871201da42296d1b server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda000c940 con 0x7fbd90005210 2023-10-10T22:38:06.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda000caa0 con 0x7fbd90005210 2023-10-10T22:38:06.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbda5ffb700 1 -- 172.21.15.154:0/247278100 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda000ce40 con 0x7fbd90005210 2023-10-10T22:38:06.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbdad3ff700 1 -- 172.21.15.154:0/247278100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd90005210 msgr2=0x7fbd9000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd90005210 0x7fbd9000ba60 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fbda0002120 tx=0x7fbda00017a0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbdad3ff700 1 -- 172.21.15.154:0/247278100 shutdown_connections 2023-10-10T22:38:06.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/247278100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd90005210 0x7fbd9000ba60 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbdad3ff700 1 -- 172.21.15.154:0/247278100 >> 172.21.15.154:0/247278100 conn(0x7fbda806baf0 msgr2=0x7fbda806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:06.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbdad3ff700 1 -- 172.21.15.154:0/247278100 shutdown_connections 2023-10-10T22:38:06.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.149+0000 7fbdad3ff700 1 -- 172.21.15.154:0/247278100 wait complete. 2023-10-10T22:38:06.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.151+0000 7fbdad3ff700 1 Processor -- start 2023-10-10T22:38:06.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.151+0000 7fbdad3ff700 1 -- start start 2023-10-10T22:38:06.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbdad3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd90005210 0x7fbda80cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbdad3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cd5e0 0x7fbda81513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbdad3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80c7ef0 0x7fbda80c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbdad3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80cc6f0 con 0x7fbda80c7ef0 2023-10-10T22:38:06.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbdad3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80c8880 con 0x7fbda80cd5e0 2023-10-10T22:38:06.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbdad3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80cbae0 con 0x7fbd90005210 2023-10-10T22:38:06.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbda77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80c7ef0 0x7fbda80c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbda77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80c7ef0 0x7fbda80c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48088/0 (socket says 172.21.15.154:48088) 2023-10-10T22:38:06.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbda77fe700 1 -- 172.21.15.154:0/3579147275 learned_addr learned my addr 172.21.15.154:0/3579147275 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:06.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbda67fc700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cd5e0 0x7fbda81513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.152+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd90005210 0x7fbda80cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbda77fe700 1 -- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd90005210 msgr2=0x7fbda80cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbda77fe700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd90005210 0x7fbda80cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbda77fe700 1 -- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cd5e0 msgr2=0x7fbda81513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbda77fe700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbda80cd5e0 0x7fbda81513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbda77fe700 1 -- 172.21.15.154:0/3579147275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80cbdc0 con 0x7fbda80c7ef0 2023-10-10T22:38:06.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbda77fe700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80c7ef0 0x7fbda80c8340 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fbda000c6a0 tx=0x7fbda0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbd8effd700 1 -- 172.21.15.154:0/3579147275 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda000c940 con 0x7fbda80c7ef0 2023-10-10T22:38:06.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbd8effd700 1 -- 172.21.15.154:0/3579147275 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda0012e60 con 0x7fbda80c7ef0 2023-10-10T22:38:06.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbd8effd700 1 -- 172.21.15.154:0/3579147275 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda001e400 con 0x7fbda80c7ef0 2023-10-10T22:38:06.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda80cc0a0 con 0x7fbda80c7ef0 2023-10-10T22:38:06.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.153+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda8151930 con 0x7fbda80c7ef0 2023-10-10T22:38:06.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.154+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbda80718b0 con 0x7fbda80c7ef0 2023-10-10T22:38:06.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.155+0000 7fbd8effd700 1 -- 172.21.15.154:0/3579147275 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbda0019070 con 0x7fbda80c7ef0 2023-10-10T22:38:06.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.156+0000 7fbd8effd700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbd94066f30 0x7fbd940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.156+0000 7fbd8effd700 1 -- 172.21.15.154:0/3579147275 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fbda0085620 con 0x7fbda80c7ef0 2023-10-10T22:38:06.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.157+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbd94066f30 0x7fbd940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.156+0000 7fbd8effd700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7fbd9406d6d0 0x7fbd9406fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.157+0000 7fbd8effd700 1 -- 172.21.15.154:0/3579147275 --> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd94070170 con 0x7fbd9406d6d0 2023-10-10T22:38:06.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.157+0000 7fbd8effd700 1 -- 172.21.15.154:0/3579147275 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbda0087b80 con 0x7fbda80c7ef0 2023-10-10T22:38:06.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.157+0000 7fbda6ffd700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbd94066f30 0x7fbd940693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009170 tx=0x7fbd98008040 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.157+0000 7fbda67fc700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7fbd9406d6d0 0x7fbd9406fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.158+0000 7fbda67fc700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7fbd9406d6d0 0x7fbd9406fb40 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.159+0000 7fbd8effd700 1 -- 172.21.15.154:0/3579147275 <== osd.7 v2:172.21.15.179:6822/88349 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbd94070170 con 0x7fbd9406d6d0 2023-10-10T22:38:06.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.173+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 --> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbda815afd0 con 0x7fbd9406d6d0 2023-10-10T22:38:06.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.173+0000 7fbd8effd700 1 -- 172.21.15.154:0/3579147275 <== osd.7 v2:172.21.15.179:6822/88349 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbda815afd0 con 0x7fbd9406d6d0 2023-10-10T22:38:06.175 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-10-10T22:38:06.175 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-10T22:38:06.175 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-10-10T22:38:06.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7fbd9406d6d0 msgr2=0x7fbd9406fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.179:6822/88349,v1:172.21.15.179:6824/88349] conn(0x7fbd9406d6d0 0x7fbd9406fb40 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbd94066f30 msgr2=0x7fbd940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fbd94066f30 0x7fbd940693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009170 tx=0x7fbd98008040 comp rx=0 tx=0).stop 2023-10-10T22:38:06.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80c7ef0 msgr2=0x7fbda80c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 --2- 172.21.15.154:0/3579147275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbda80c7ef0 0x7fbda80c8340 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fbda000c6a0 tx=0x7fbda0015000 comp rx=0 tx=0).stop 2023-10-10T22:38:06.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbda77fe700 1 -- 172.21.15.154:0/3579147275 reap_dead start 2023-10-10T22:38:06.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 shutdown_connections 2023-10-10T22:38:06.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 >> 172.21.15.154:0/3579147275 conn(0x7fbda806baf0 msgr2=0x7fbda81532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:06.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 shutdown_connections 2023-10-10T22:38:06.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.174+0000 7fbdad3ff700 1 -- 172.21.15.154:0/3579147275 wait complete. 2023-10-10T22:38:06.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-10T22:38:06.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.376+0000 7f22c0bff700 1 Processor -- start 2023-10-10T22:38:06.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.376+0000 7f22c0bff700 1 -- start start 2023-10-10T22:38:06.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.377+0000 7f22c0bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22bc0ccc40 0x7f22bc155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22c0bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22bc0cd010 0x7f22bc0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22c0bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0ad930 con 0x7f22bc156150 2023-10-10T22:38:06.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22c0bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0acd20 con 0x7f22bc0ccc40 2023-10-10T22:38:06.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22c0bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0ad000 con 0x7f22bc0cd010 2023-10-10T22:38:06.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22ba59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22bc0ccc40 0x7f22bc155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22b9d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f22bc156150 0x7f22bc0ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40416/0 (socket says 172.21.15.154:40416) 2023-10-10T22:38:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22b9d9b700 1 -- 172.21.15.154:0/3661590529 learned_addr learned my addr 172.21.15.154:0/3661590529 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22bad9d700 1 --2- 172.21.15.154:0/3661590529 >> v2:172.21.15.179:3300/0 conn(0x7f22bc0cd010 0x7f22bc0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22ba59c700 1 -- 172.21.15.154:0/3661590529 >> v2:172.21.15.179:3300/0 conn(0x7f22bc0cd010 msgr2=0x7f22bc0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22ba59c700 1 --2- 172.21.15.154:0/3661590529 >> v2:172.21.15.179:3300/0 conn(0x7f22bc0cd010 0x7f22bc0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22ba59c700 1 -- 172.21.15.154:0/3661590529 >> v1:172.21.15.154:6789/0 conn(0x7f22bc156150 legacy=0x7f22bc0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22ba59c700 1 -- 172.21.15.154:0/3661590529 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0ad2e0 con 0x7f22bc0ccc40 2023-10-10T22:38:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.378+0000 7f22bad9d700 1 --2- 172.21.15.154:0/3661590529 >> v2:172.21.15.179:3300/0 conn(0x7f22bc0cd010 0x7f22bc0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:38:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22ba59c700 1 --2- 172.21.15.154:0/3661590529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 0x7f22bc155c10 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0ae0c0 tx=0x7f22ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafdd0c12f34cd8e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22b959a700 1 -- 172.21.15.154:0/3661590529 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00b6b0 con 0x7f22bc0ccc40 2023-10-10T22:38:06.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22b959a700 1 -- 172.21.15.154:0/3661590529 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac00b810 con 0x7f22bc0ccc40 2023-10-10T22:38:06.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22b959a700 1 -- 172.21.15.154:0/3661590529 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00bbb0 con 0x7f22bc0ccc40 2023-10-10T22:38:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22c0bff700 1 -- 172.21.15.154:0/3661590529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 msgr2=0x7f22bc155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22c0bff700 1 --2- 172.21.15.154:0/3661590529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 0x7f22bc155c10 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0ae0c0 tx=0x7f22ac0091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22c0bff700 1 -- 172.21.15.154:0/3661590529 shutdown_connections 2023-10-10T22:38:06.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22c0bff700 1 --2- 172.21.15.154:0/3661590529 >> v2:172.21.15.179:3300/0 conn(0x7f22bc0cd010 0x7f22bc0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22c0bff700 1 --2- 172.21.15.154:0/3661590529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 0x7f22bc155c10 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.379+0000 7f22c0bff700 1 -- 172.21.15.154:0/3661590529 >> 172.21.15.154:0/3661590529 conn(0x7f22bc06a320 msgr2=0x7f22bc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:06.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.380+0000 7f22c0bff700 1 -- 172.21.15.154:0/3661590529 shutdown_connections 2023-10-10T22:38:06.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.380+0000 7f22c0bff700 1 -- 172.21.15.154:0/3661590529 wait complete. 2023-10-10T22:38:06.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.381+0000 7f22c0bff700 1 Processor -- start 2023-10-10T22:38:06.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.381+0000 7f22c0bff700 1 -- start start 2023-10-10T22:38:06.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22c0bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 0x7f22bc150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22c0bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0cd010 0x7f22bc13df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22c0bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc156150 0x7f22bc151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22c0bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc150460 con 0x7f22bc0ccc40 2023-10-10T22:38:06.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22c0bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc150a20 con 0x7f22bc156150 2023-10-10T22:38:06.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22c0bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1513f0 con 0x7f22bc0cd010 2023-10-10T22:38:06.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22ba59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 0x7f22bc150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22ba59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 0x7f22bc150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48094/0 (socket says 172.21.15.154:48094) 2023-10-10T22:38:06.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22ba59c700 1 -- 172.21.15.154:0/4080469147 learned_addr learned my addr 172.21.15.154:0/4080469147 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:06.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22bad9d700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc156150 0x7f22bc151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.382+0000 7f22b9d9b700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0cd010 0x7f22bc13df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22ba59c700 1 -- 172.21.15.154:0/4080469147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0cd010 msgr2=0x7f22bc13df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22ba59c700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0cd010 0x7f22bc13df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22ba59c700 1 -- 172.21.15.154:0/4080469147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc156150 msgr2=0x7f22bc151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22ba59c700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc156150 0x7f22bc151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22ba59c700 1 -- 172.21.15.154:0/4080469147 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009420 con 0x7f22bc0ccc40 2023-10-10T22:38:06.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22ba59c700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 0x7f22bc150eb0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f22bc064290 tx=0x7f22ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22aa7fc700 1 -- 172.21.15.154:0/4080469147 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00bb90 con 0x7f22bc0ccc40 2023-10-10T22:38:06.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22aa7fc700 1 -- 172.21.15.154:0/4080469147 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac011420 con 0x7f22bc0ccc40 2023-10-10T22:38:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22aa7fc700 1 -- 172.21.15.154:0/4080469147 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0117a0 con 0x7f22bc0ccc40 2023-10-10T22:38:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.383+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc13e4b0 con 0x7f22bc0ccc40 2023-10-10T22:38:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.384+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc1522b0 con 0x7f22bc0ccc40 2023-10-10T22:38:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.385+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc04c3c0 con 0x7f22bc0ccc40 2023-10-10T22:38:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.385+0000 7f22aa7fc700 1 -- 172.21.15.154:0/4080469147 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22ac011b90 con 0x7f22bc0ccc40 2023-10-10T22:38:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.386+0000 7f22aa7fc700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f229c066f30 0x7f229c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.386+0000 7f22aa7fc700 1 -- 172.21.15.154:0/4080469147 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f22ac085d70 con 0x7f22bc0ccc40 2023-10-10T22:38:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.386+0000 7f22b9d9b700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f229c066f30 0x7f229c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.387+0000 7f22b9d9b700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f229c066f30 0x7f229c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22bc16afb0 tx=0x7f22b0009040 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.391+0000 7f22aa7fc700 1 -- 172.21.15.154:0/4080469147 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22ac052e00 con 0x7f22bc0ccc40 2023-10-10T22:38:06.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.583+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f22bc0ad5c0 con 0x7f229c066f30 2023-10-10T22:38:06.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.584+0000 7f22aa7fc700 1 -- 172.21.15.154:0/4080469147 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f22bc0ad5c0 con 0x7f229c066f30 2023-10-10T22:38:06.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f229c066f30 msgr2=0x7f229c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f229c066f30 0x7f229c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22bc16afb0 tx=0x7f22b0009040 comp rx=0 tx=0).stop 2023-10-10T22:38:06.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 msgr2=0x7f22bc150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 0x7f22bc150eb0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f22bc064290 tx=0x7f22ac017000 comp rx=0 tx=0).stop 2023-10-10T22:38:06.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 shutdown_connections 2023-10-10T22:38:06.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f229c066f30 0x7f229c0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc156150 0x7f22bc151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0ccc40 0x7f22bc150eb0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 --2- 172.21.15.154:0/4080469147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0cd010 0x7f22bc13df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 >> 172.21.15.154:0/4080469147 conn(0x7f22bc06a320 msgr2=0x7f22bc0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:06.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 shutdown_connections 2023-10-10T22:38:06.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.586+0000 7f22c0bff700 1 -- 172.21.15.154:0/4080469147 wait complete. 2023-10-10T22:38:06.591 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 7 to deep-scrub 2023-10-10T22:38:06.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:38:06.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.787+0000 7fc2a6bff700 1 Processor -- start 2023-10-10T22:38:06.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.787+0000 7fc2a6bff700 1 -- start start 2023-10-10T22:38:06.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.788+0000 7fc2a6bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 0x7fc2a0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.788+0000 7fc2a6bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc2a00ac230 0x7fc2a00ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.788+0000 7fc2a6bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a00ad930 con 0x7fc2a00ccc40 2023-10-10T22:38:06.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.788+0000 7fc2a6bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a00acd20 con 0x7fc2a00ac230 2023-10-10T22:38:06.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.788+0000 7fc2a6bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00ad000 con 0x7fc2a0155c10 2023-10-10T22:38:06.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc29ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc2a00ac230 0x7fc2a00ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc2a499b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 0x7fc2a0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc29ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc2a00ac230 0x7fc2a00ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.154:40728/0 (socket says 172.21.15.154:40728) 2023-10-10T22:38:06.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc29ffff700 1 -- 172.21.15.154:0/2840103085 learned_addr learned my addr 172.21.15.154:0/2840103085 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:06.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc2a519c700 1 --1- 172.21.15.154:0/2840103085 >> v1:172.21.15.179:6789/0 conn(0x7fc2a00ccc40 0x7fc2a00af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.154:55588/0 (socket says 172.21.15.154:55588) 2023-10-10T22:38:06.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc29ffff700 1 -- 172.21.15.154:0/2840103085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 msgr2=0x7fc2a0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:06.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc29ffff700 1 --2- 172.21.15.154:0/2840103085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 0x7fc2a0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc29ffff700 1 -- 172.21.15.154:0/2840103085 >> v1:172.21.15.179:6789/0 conn(0x7fc2a00ccc40 legacy=0x7fc2a00af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc29ffff700 1 -- 172.21.15.154:0/2840103085 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a00ad2e0 con 0x7fc2a00ac230 2023-10-10T22:38:06.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.789+0000 7fc29f7fe700 1 -- 172.21.15.154:0/2840103085 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515819268 0 0) 0x7fc2a00ad930 con 0x7fc2a00ccc40 2023-10-10T22:38:06.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc29ffff700 1 --2- 172.21.15.154:0/2840103085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a00ac230 0x7fc2a00ac6a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0099b0 tx=0x7fc28c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5374a845d1d5d270 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc29f7fe700 1 -- 172.21.15.154:0/2840103085 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c009ea0 con 0x7fc2a00ac230 2023-10-10T22:38:06.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc29f7fe700 1 -- 172.21.15.154:0/2840103085 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c00b860 con 0x7fc2a00ac230 2023-10-10T22:38:06.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc29f7fe700 1 -- 172.21.15.154:0/2840103085 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00bc00 con 0x7fc2a00ac230 2023-10-10T22:38:06.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc2a6bff700 1 -- 172.21.15.154:0/2840103085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a00ac230 msgr2=0x7fc2a00ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc2a6bff700 1 --2- 172.21.15.154:0/2840103085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a00ac230 0x7fc2a00ac6a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0099b0 tx=0x7fc28c009250 comp rx=0 tx=0).stop 2023-10-10T22:38:06.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc2a6bff700 1 -- 172.21.15.154:0/2840103085 shutdown_connections 2023-10-10T22:38:06.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc2a6bff700 1 --2- 172.21.15.154:0/2840103085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 0x7fc2a0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc2a6bff700 1 --2- 172.21.15.154:0/2840103085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a00ac230 0x7fc2a00ac6a0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc2a6bff700 1 -- 172.21.15.154:0/2840103085 >> 172.21.15.154:0/2840103085 conn(0x7fc2a006a320 msgr2=0x7fc2a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:06.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc2a6bff700 1 -- 172.21.15.154:0/2840103085 shutdown_connections 2023-10-10T22:38:06.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.790+0000 7fc2a6bff700 1 -- 172.21.15.154:0/2840103085 wait complete. 2023-10-10T22:38:06.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.792+0000 7fc2a6bff700 1 Processor -- start 2023-10-10T22:38:06.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.792+0000 7fc2a6bff700 1 -- start start 2023-10-10T22:38:06.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a6bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a00ac230 0x7fc2a0154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a6bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a00ccc40 0x7fc2a0167500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a6bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 0x7fc2a014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a6bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0154570 con 0x7fc2a00ac230 2023-10-10T22:38:06.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a6bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01568a0 con 0x7fc2a00ccc40 2023-10-10T22:38:06.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a6bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0156b80 con 0x7fc2a0155c10 2023-10-10T22:38:06.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a499b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a00ac230 0x7fc2a0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a499b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a00ac230 0x7fc2a0154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48106/0 (socket says 172.21.15.154:48106) 2023-10-10T22:38:06.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a499b700 1 -- 172.21.15.154:0/160848479 learned_addr learned my addr 172.21.15.154:0/160848479 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:06.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc29ffff700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a00ccc40 0x7fc2a0167500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.793+0000 7fc2a519c700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 0x7fc2a014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc2a499b700 1 -- 172.21.15.154:0/160848479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 msgr2=0x7fc2a014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc2a499b700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 0x7fc2a014d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc2a499b700 1 -- 172.21.15.154:0/160848479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a00ccc40 msgr2=0x7fc2a0167500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc2a499b700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a00ccc40 0x7fc2a0167500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc2a499b700 1 -- 172.21.15.154:0/160848479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0094f0 con 0x7fc2a00ac230 2023-10-10T22:38:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc2a499b700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a00ac230 0x7fc2a0154030 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fc29400e930 tx=0x7fc2940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc29cff9700 1 -- 172.21.15.154:0/160848479 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294013680 con 0x7fc2a00ac230 2023-10-10T22:38:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc29cff9700 1 -- 172.21.15.154:0/160848479 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2940137e0 con 0x7fc2a00ac230 2023-10-10T22:38:06.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc29cff9700 1 -- 172.21.15.154:0/160848479 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294013b80 con 0x7fc2a00ac230 2023-10-10T22:38:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a0167d30 con 0x7fc2a00ac230 2023-10-10T22:38:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.794+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a01682f0 con 0x7fc2a00ac230 2023-10-10T22:38:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.795+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a004c3c0 con 0x7fc2a00ac230 2023-10-10T22:38:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.796+0000 7fc29cff9700 1 -- 172.21.15.154:0/160848479 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc29400c3e0 con 0x7fc2a00ac230 2023-10-10T22:38:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.797+0000 7fc29cff9700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc284066f30 0x7fc2840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.797+0000 7fc29cff9700 1 -- 172.21.15.154:0/160848479 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fc2940847c0 con 0x7fc2a00ac230 2023-10-10T22:38:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.797+0000 7fc29ffff700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc284066f30 0x7fc2840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.798+0000 7fc29ffff700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc284066f30 0x7fc2840693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0099b0 tx=0x7fc28c017000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.801+0000 7fc29cff9700 1 -- 172.21.15.154:0/160848479 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc294051850 con 0x7fc2a00ac230 2023-10-10T22:38:06.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.990+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2a0156e60 con 0x7fc284066f30 2023-10-10T22:38:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.993+0000 7fc29cff9700 1 -- 172.21.15.154:0/160848479 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50535 (secure 0 0 0) 0x7fc2a0156e60 con 0x7fc284066f30 2023-10-10T22:38:06.995 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:38:06.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc284066f30 msgr2=0x7fc2840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc284066f30 0x7fc2840693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0099b0 tx=0x7fc28c017000 comp rx=0 tx=0).stop 2023-10-10T22:38:06.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a00ac230 msgr2=0x7fc2a0154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:06.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a00ac230 0x7fc2a0154030 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fc29400e930 tx=0x7fc2940091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 shutdown_connections 2023-10-10T22:38:06.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fc284066f30 0x7fc2840693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2a0155c10 0x7fc2a014d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a00ac230 0x7fc2a0154030 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 --2- 172.21.15.154:0/160848479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a00ccc40 0x7fc2a0167500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.995+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 >> 172.21.15.154:0/160848479 conn(0x7fc2a006a320 msgr2=0x7fc2a0150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.996+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 shutdown_connections 2023-10-10T22:38:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:06.996+0000 7fc2a6bff700 1 -- 172.21.15.154:0/160848479 wait complete. 2023-10-10T22:38:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:38:07.015 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-10-10T22:38:05.031378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2465960,"kb_used_data":22120,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752508760,"statfs":{"total":773094113280,"available":770568970240,"internally_reserved":0,"allocated":22650880,"data_stored":11981808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001624"},"pg_stats":[{"pgid":"1.0","version":"212'370","reported_seq":1227,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-10T22:37:53.106185+0000","last_change":"2023-10-10T21:02:09.754027+0000","last_active":"2023-10-10T22:37:53.106185+0000","last_peered":"2023-10-10T22:37:53.106185+0000","last_clean":"2023-10-10T22:37:53.106185+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:37:53.106185+0000","last_undegraded":"2023-10-10T22:37:53.106185+0000","last_fullsized":"2023-10-10T22:37:53.106185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-10T21:02:08.544054+0000","last_clean_scrub_stamp":"2023-10-10T21:02:08.544054+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T06:08:23.420954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543281,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312776,"kb_used_data":3200,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059064,"statfs":{"total":96636764160,"available":96316481536,"internally_reserved":0,"allocated":3276800,"data_stored":1940502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.026},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":1.073,"15min":1.081},"last":0.59099999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":1.145,"15min":1.145},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":1.0700000000000001},"last":0.624}]},{"osd":2,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":1.0009999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.503,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":0.82299999999999995,"5min":0.92000000000000004,"15min":0.97799999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.46200000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.024},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89900000000000002,"5min":0.999,"15min":1.079},"last":0.58299999999999996}]},{"osd":6,"last update":"Tue Oct 10 22:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77100000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.86199999999999999,"5min":1.046,"15min":1.125},"last":0.61499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129543280,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299908,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071932,"statfs":{"total":96636764160,"available":96329658368,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":1.0289999999999999,"15min":1.1080000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.751},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91900000000000004,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.0920000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.64500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94299999999999995,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95099999999999996,"5min":1.034,"15min":1.1200000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.0660000000000001},"last":0.505}]},{"osd":3,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.96299999999999997,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.621,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91200000000000003,"5min":0.97399999999999998,"15min":1.071},"last":0.54400000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89600000000000002,"5min":1.778,"15min":1.778},"last":0.627},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.86899999999999999,"5min":0.996,"15min":1.046},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97299999999999998,"5min":1.827,"15min":1.827},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66500000000000004}]}]},{"osd":1,"up_from":14,"seq":60129543280,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312196,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059644,"statfs":{"total":96636764160,"available":96317075456,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.371},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.82999999999999996,"15min":0.88},"last":0.46899999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.878,"15min":0.90800000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.88800000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.74399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.502}]},{"osd":4,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.995,"5min":1.0269999999999999,"15min":1.177},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0269999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.008,"5min":1.089,"15min":1.1419999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.2450000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.64300000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.081,"5min":1.1200000000000001,"15min":1.2729999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Tue Oct 10 22:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.155},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.68600000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":1.1120000000000001,"15min":1.2230000000000001},"last":0.81299999999999994}]}]},{"osd":0,"up_from":14,"seq":60129543282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308680,"kb_used_data":3200,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063160,"statfs":{"total":96636764160,"available":96320675840,"internally_reserved":0,"allocated":3276800,"data_stored":1940502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.71399999999999997,"15min":0.753},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.76000000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.81599999999999995,"15min":0.85299999999999998},"last":0.504}]},{"osd":3,"last update":"Tue Oct 10 22:37:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.81100000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.625,"15min":0.625},"min":{"1min":0.502,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0469999999999999,"5min":1.1180000000000001,"15min":1.3340000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98299999999999998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.1479999999999999,"15min":1.198},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56899999999999995},"max":{"1min":1.0449999999999999,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.84799999999999998,"15min":0.874},"min":{"1min":0.625,"5min":0.54800000000000004,"15min":0.54500000000000004},"max":{"1min":1.1439999999999999,"5min":1.3320000000000001,"15min":1.377},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0449999999999999,"5min":1.274,"15min":1.427},"last":0.73399999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.198,"5min":1.224,"15min":1.2689999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.081,"5min":1.153,"15min":1.153},"last":0.65100000000000002}]}]},{"osd":2,"up_from":14,"seq":60129543282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":316292,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055548,"statfs":{"total":96636764160,"available":96312881152,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.78600000000000003,"15min":0.80200000000000005},"last":0.505},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.317},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.89500000000000002},"last":0.44500000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.64400000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.84099999999999997,"5min":0.85699999999999998,"15min":0.85799999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.57599999999999996}]},{"osd":4,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.101,"15min":1.288},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77300000000000002,"15min":0.80200000000000005},"min":{"1min":0.63500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98599999999999999,"5min":1.1220000000000001,"15min":1.325},"last":0.52800000000000002}]},{"osd":5,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.147,"15min":1.1970000000000001},"last":0.626}]},{"osd":6,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82199999999999995,"15min":0.84099999999999997},"min":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.054,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.26},"last":0.66800000000000004}]},{"osd":7,"last update":"Tue Oct 10 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.624,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.093,"5min":1.165,"15min":1.3129999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80600000000000005,"15min":0.83199999999999996},"min":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.181,"15min":1.2609999999999999},"last":0.65700000000000003}]}]},{"osd":3,"up_from":15,"seq":64424510577,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":316292,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055548,"statfs":{"total":96636764160,"available":96312881152,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.432},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.46200000000000002}]},{"osd":1,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.877,"15min":0.877},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38100000000000001},"max":{"1min":0.70599999999999996,"5min":0.86799999999999999,"15min":0.88900000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":0.99399999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.04,"5min":1.133,"15min":1.242},"last":0.499},{"interface":"front","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.202,"15min":1.2629999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.54300000000000004},"max":{"1min":1.125,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":0.95599999999999996,"5min":1.1040000000000001,"15min":1.222},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.099,"5min":1.1539999999999999,"15min":1.212},"last":0.71199999999999997}]},{"osd":7,"last update":"Tue Oct 10 22:37:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.54200000000000004},"max":{"1min":0.98899999999999999,"5min":1.274,"15min":1.274},"last":0.628},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":0.83499999999999996},"min":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56699999999999995},"max":{"1min":1.097,"5min":1.149,"15min":1.2370000000000001},"last":0.72899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129543282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299908,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071932,"statfs":{"total":96636764160,"available":96329658368,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68300000000000005,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.871,"5min":0.95899999999999996,"15min":1.087},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84499999999999997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.43099999999999999}]},{"osd":1,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.755},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.1220000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.51700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.879,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.51700000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.73899999999999999,"15min":0.76100000000000001},"min":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.073},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97099999999999997,"5min":1.01,"15min":1.089},"last":0.46999999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.45200000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.101},"last":0.497},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.52100000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93700000000000006,"5min":0.94299999999999995,"15min":1.054},"last":0.68999999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72199999999999998,"5min":0.78000000000000003,"15min":0.94099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0900000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.55100000000000005,"5min":0.45900000000000002,"15min":0.42199999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":1.0649999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44700000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0629999999999999},"last":0.55900000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.21},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.46100000000000002,"5min":0.442,"15min":0.436},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.66700000000000004}]}]},{"osd":5,"up_from":14,"seq":60129543280,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299908,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071932,"statfs":{"total":96636764160,"available":96329658368,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":1.006},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.48199999999999998,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.997},"last":0.71599999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58999999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.98999999999999999,"15min":1.04},"last":0.624},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.48899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.02},"last":0.67000000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.38200000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.64500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.37},"max":{"1min":0.90900000000000003,"5min":0.91900000000000004,"15min":0.95299999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.01,"5min":1.01,"15min":1.032},"last":0.73899999999999999}]},{"osd":7,"last update":"Tue Oct 10 22:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.753},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.02},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:38:07.018 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-10T21:02:08.544054+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=10, tm_hour=21, tm_min=2, tm_sec=8, tm_wday=1, tm_yday=283, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=10, tm_hour=22, tm_min=38, tm_sec=0, tm_wday=1, tm_yday=283, tm_isdst=0) 2023-10-10T22:38:07.019 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-10T22:38:15.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:38:15.425 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:38:27.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-10T22:38:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.213+0000 7fae6f19d700 1 Processor -- start 2023-10-10T22:38:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.213+0000 7fae6f19d700 1 -- start start 2023-10-10T22:38:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.214+0000 7fae6f19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae68159420 0x7fae680b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.214+0000 7fae6f19d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae681597f0 0x7fae680b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.214+0000 7fae6f19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae680b11d0 con 0x7fae6815d230 2023-10-10T22:38:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.214+0000 7fae6f19d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae680b14b0 con 0x7fae681597f0 2023-10-10T22:38:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.214+0000 7fae6f19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae680b1790 con 0x7fae68159420 2023-10-10T22:38:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.214+0000 7fae6d99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae681597f0 0x7fae680b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.215+0000 7fae6d99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae681597f0 0x7fae680b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32980/0 (socket says 172.21.15.154:32980) 2023-10-10T22:38:27.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.215+0000 7fae6d99a700 1 -- 172.21.15.154:0/12018319 learned_addr learned my addr 172.21.15.154:0/12018319 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:27.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.215+0000 7fae6e19b700 1 --2- 172.21.15.154:0/12018319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae68159420 0x7fae680b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.215+0000 7fae6d99a700 1 -- 172.21.15.154:0/12018319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae68159420 msgr2=0x7fae680b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-10T22:38:27.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.215+0000 7fae6d99a700 1 --2- 172.21.15.154:0/12018319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae68159420 0x7fae680b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.215+0000 7fae6d99a700 1 -- 172.21.15.154:0/12018319 >> v1:172.21.15.179:6789/0 conn(0x7fae6815d230 legacy=0x7fae680b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.215+0000 7fae6d99a700 1 -- 172.21.15.154:0/12018319 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680b1a70 con 0x7fae681597f0 2023-10-10T22:38:27.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.215+0000 7fae6d99a700 1 --2- 172.21.15.154:0/12018319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae681597f0 0x7fae680b2270 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fae580099b0 tx=0x7fae58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f52e99f9ba9c7e server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.215+0000 7fae6d199700 1 -- 172.21.15.154:0/12018319 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58009ea0 con 0x7fae681597f0 2023-10-10T22:38:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6d199700 1 -- 172.21.15.154:0/12018319 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5800b860 con 0x7fae681597f0 2023-10-10T22:38:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6d199700 1 -- 172.21.15.154:0/12018319 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800bc00 con 0x7fae681597f0 2023-10-10T22:38:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6f19d700 1 -- 172.21.15.154:0/12018319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae681597f0 msgr2=0x7fae680b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6f19d700 1 --2- 172.21.15.154:0/12018319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae681597f0 0x7fae680b2270 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fae580099b0 tx=0x7fae58009250 comp rx=0 tx=0).stop 2023-10-10T22:38:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6f19d700 1 -- 172.21.15.154:0/12018319 shutdown_connections 2023-10-10T22:38:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6f19d700 1 --2- 172.21.15.154:0/12018319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae68159420 0x7fae680b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6f19d700 1 --2- 172.21.15.154:0/12018319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae681597f0 0x7fae680b2270 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6f19d700 1 -- 172.21.15.154:0/12018319 >> 172.21.15.154:0/12018319 conn(0x7fae680d0660 msgr2=0x7fae680d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6f19d700 1 -- 172.21.15.154:0/12018319 shutdown_connections 2023-10-10T22:38:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.216+0000 7fae6f19d700 1 -- 172.21.15.154:0/12018319 wait complete. 2023-10-10T22:38:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.218+0000 7fae6f19d700 1 Processor -- start 2023-10-10T22:38:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.218+0000 7fae6f19d700 1 -- start start 2023-10-10T22:38:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6f19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae68159420 0x7fae680c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6f19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae681597f0 0x7fae680b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6f19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae6815d230 0x7fae6816a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6f19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae68156480 con 0x7fae68159420 2023-10-10T22:38:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6f19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680ca8e0 con 0x7fae681597f0 2023-10-10T22:38:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6f19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae680aec40 con 0x7fae6815d230 2023-10-10T22:38:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae68159420 0x7fae680c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e19b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae68159420 0x7fae680c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32990/0 (socket says 172.21.15.154:32990) 2023-10-10T22:38:27.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e19b700 1 -- 172.21.15.154:0/2147032227 learned_addr learned my addr 172.21.15.154:0/2147032227 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:27.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6d99a700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae681597f0 0x7fae680b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e99c700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae6815d230 0x7fae6816a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e19b700 1 -- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae6815d230 msgr2=0x7fae6816a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e19b700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae6815d230 0x7fae6816a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e19b700 1 -- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae681597f0 msgr2=0x7fae680b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e19b700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae681597f0 0x7fae680b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e19b700 1 -- 172.21.15.154:0/2147032227 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae580094f0 con 0x7fae68159420 2023-10-10T22:38:27.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6e99c700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae6815d230 0x7fae6816a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:27.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.219+0000 7fae6d99a700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae681597f0 0x7fae680b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.220+0000 7fae6e19b700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae68159420 0x7fae680c7420 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fae6400ecb0 tx=0x7fae640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.220+0000 7fae5e7fc700 1 -- 172.21.15.154:0/2147032227 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6400c9d0 con 0x7fae68159420 2023-10-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.220+0000 7fae5e7fc700 1 -- 172.21.15.154:0/2147032227 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6400cb30 con 0x7fae68159420 2023-10-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.220+0000 7fae5e7fc700 1 -- 172.21.15.154:0/2147032227 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6400ced0 con 0x7fae68159420 2023-10-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.220+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae68169f30 con 0x7fae68159420 2023-10-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.220+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae680ca320 con 0x7fae68159420 2023-10-10T22:38:27.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.221+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae68169d00 con 0x7fae68159420 2023-10-10T22:38:27.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.222+0000 7fae5e7fc700 1 -- 172.21.15.154:0/2147032227 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae64013680 con 0x7fae68159420 2023-10-10T22:38:27.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.223+0000 7fae5e7fc700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fae4c066fb0 0x7fae4c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.223+0000 7fae5e7fc700 1 -- 172.21.15.154:0/2147032227 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fae64084ad0 con 0x7fae68159420 2023-10-10T22:38:27.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.223+0000 7fae6d99a700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fae4c066fb0 0x7fae4c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.224+0000 7fae6d99a700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fae4c066fb0 0x7fae4c069460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae580099b0 tx=0x7fae58017000 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:27.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.228+0000 7fae5e7fc700 1 -- 172.21.15.154:0/2147032227 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae68169d00 con 0x7fae68159420 2023-10-10T22:38:27.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.415+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 --> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae6816a210 con 0x7fae4c066fb0 2023-10-10T22:38:27.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.418+0000 7fae5e7fc700 1 -- 172.21.15.154:0/2147032227 <== mgr.10491 v2:172.21.15.154:6836/132976 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50268 (secure 0 0 0) 0x7fae6816a210 con 0x7fae4c066fb0 2023-10-10T22:38:27.420 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:38:27.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fae4c066fb0 msgr2=0x7fae4c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fae4c066fb0 0x7fae4c069460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae580099b0 tx=0x7fae58017000 comp rx=0 tx=0).stop 2023-10-10T22:38:27.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae68159420 msgr2=0x7fae680c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae68159420 0x7fae680c7420 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fae6400ecb0 tx=0x7fae640091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 shutdown_connections 2023-10-10T22:38:27.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7fae4c066fb0 0x7fae4c069460 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae6815d230 0x7fae6816a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae68159420 0x7fae680c7420 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 --2- 172.21.15.154:0/2147032227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae681597f0 0x7fae680b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.420+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 >> 172.21.15.154:0/2147032227 conn(0x7fae680d0660 msgr2=0x7fae680b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:27.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.421+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 shutdown_connections 2023-10-10T22:38:27.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.421+0000 7fae6f19d700 1 -- 172.21.15.154:0/2147032227 wait complete. 2023-10-10T22:38:27.425 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-10-10T22:38:27.440 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-10T22:38:27.036179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2465960,"kb_used_data":22120,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752508760,"statfs":{"total":773094113280,"available":770568970240,"internally_reserved":0,"allocated":22650880,"data_stored":11981808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002718"},"pg_stats":[{"pgid":"1.0","version":"214'371","reported_seq":1239,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-10T22:38:08.092560+0000","last_change":"2023-10-10T22:38:08.092524+0000","last_active":"2023-10-10T22:38:08.092560+0000","last_peered":"2023-10-10T22:38:08.092560+0000","last_clean":"2023-10-10T22:38:08.092560+0000","last_became_active":"2023-10-10T21:02:09.752779+0000","last_became_peered":"2023-10-10T21:02:09.752779+0000","last_unstale":"2023-10-10T22:38:08.092560+0000","last_undegraded":"2023-10-10T22:38:08.092560+0000","last_fullsized":"2023-10-10T22:38:08.092560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"214'371","last_scrub_stamp":"2023-10-10T22:38:08.092425+0000","last_deep_scrub":"214'371","last_deep_scrub_stamp":"2023-10-10T22:38:08.092425+0000","last_clean_scrub_stamp":"2023-10-10T22:38:08.092425+0000","objects_scrubbed":2,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T22:52:28.760540+0000","scrub_duration":0.0060919110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543285,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312776,"kb_used_data":3200,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059064,"statfs":{"total":96636764160,"available":96316481536,"internally_reserved":0,"allocated":3276800,"data_stored":1940502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.50700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96099999999999997,"5min":1.0209999999999999,"15min":1.026},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":1.073,"15min":1.081},"last":0.63500000000000001}]},{"osd":1,"last update":"Tue Oct 10 22:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.006,"5min":1.145,"15min":1.145},"last":0.753},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89400000000000002,"5min":0.94599999999999995,"15min":1.028},"last":0.76800000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.47799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.94899999999999995,"15min":1},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.53900000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.042,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78400000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79000000000000004,"5min":0.97999999999999998,"15min":1},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.749},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":1.0189999999999999},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Oct 10 22:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.63400000000000001,"15min":0.60999999999999999},"min":{"1min":0.437,"5min":0.41699999999999998,"15min":0.40600000000000003},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.234,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.65900000000000003}]},{"osd":5,"last update":"Tue Oct 10 22:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.68200000000000005,"15min":0.66900000000000004},"min":{"1min":0.52500000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 10 22:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.72399999999999998,"15min":0.70499999999999996},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.68100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129543284,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299908,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071932,"statfs":{"total":96636764160,"available":96329658368,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.68500000000000005,"15min":0.72699999999999998},"min":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.46600000000000003},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":1.1080000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81299999999999994,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.71299999999999997}]},{"osd":1,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82999999999999996,"5min":1.018,"15min":1.0920000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.54200000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93500000000000005,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.80000000000000004}]},{"osd":2,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.71899999999999997,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91400000000000003,"5min":1.034,"15min":1.1200000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92500000000000004,"5min":1.054,"15min":1.0660000000000001},"last":0.77500000000000002}]},{"osd":3,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72999999999999998,"15min":0.74299999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.87,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":1.071},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.621},"min":{"1min":0.437,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88800000000000001,"5min":1.778,"15min":1.778},"last":0.44},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64400000000000002,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.96899999999999997,"15min":0.98999999999999999},"last":0.49199999999999999}]},{"osd":5,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.67700000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95899999999999996,"5min":0.996,"15min":1.046},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.03,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70399999999999996,"15min":0.68799999999999994},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96599999999999997,"5min":1.827,"15min":1.827},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.49099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.077,"5min":1.089,"15min":1.089},"last":0.57299999999999995}]}]},{"osd":1,"up_from":14,"seq":60129543284,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312196,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059644,"statfs":{"total":96636764160,"available":96317075456,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47999999999999998,"15min":0.48399999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.29799999999999999},"max":{"1min":0.69099999999999995,"5min":0.77500000000000002,"15min":0.94499999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.88},"last":0.83799999999999997}]},{"osd":2,"last update":"Tue Oct 10 22:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79900000000000004,"5min":0.82099999999999995,"15min":0.90800000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54200000000000004,"15min":0.56000000000000005},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88800000000000001},"last":0.69299999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58099999999999996,"15min":0.59399999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39900000000000002},"max":{"1min":0.82599999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.93000000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0009999999999999,"5min":1.0589999999999999,"15min":1.179},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.72199999999999998,"15min":0.76200000000000001},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.94499999999999995,"5min":0.995,"15min":1.177},"last":0.82099999999999995}]},{"osd":5,"last update":"Tue Oct 10 22:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.58499999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92200000000000004,"5min":1.0629999999999999,"15min":1.1599999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.75900000000000001,"15min":0.79800000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":1.026,"15min":1.1419999999999999},"last":0.89200000000000002}]},{"osd":6,"last update":"Tue Oct 10 22:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.751,"15min":0.79400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83999999999999997,"5min":1.0940000000000001,"15min":1.2450000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80600000000000005,"15min":0.84699999999999998},"min":{"1min":0.60699999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.004,"5min":1.081,"15min":1.2729999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Tue Oct 10 22:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.755,"15min":0.79000000000000004},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89100000000000001,"5min":1.135,"15min":1.155},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.82699999999999996},"min":{"1min":0.52200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96499999999999997,"5min":1.0429999999999999,"15min":1.2230000000000001},"last":0.86499999999999999}]}]},{"osd":0,"up_from":14,"seq":60129543286,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308680,"kb_used_data":3200,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063160,"statfs":{"total":96636764160,"available":96320675840,"internally_reserved":0,"allocated":3276800,"data_stored":1940502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 10 22:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46100000000000002,"15min":0.48099999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66300000000000003,"5min":0.71399999999999997,"15min":0.753},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.753,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue Oct 10 22:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52300000000000002,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64700000000000002,"5min":0.68600000000000005,"15min":0.76000000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.38500000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59199999999999997}]},{"osd":3,"last update":"Tue Oct 10 22:37:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.81100000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.625,"15min":0.625},"min":{"1min":0.502,"5min":0.45300000000000001,"15min":0.41199999999999998},"max":{"1min":0.86199999999999999,"5min":0.89000000000000001,"15min":0.89800000000000002},"last":0.54000000000000004}]},{"osd":4,"last update":"Tue Oct 10 22:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76600000000000001,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.3340000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76700000000000002,"15min":0.78600000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.151,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Tue Oct 10 22:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77700000000000002,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.117,"5min":1.1479999999999999,"15min":1.198},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.052,"5min":1.1739999999999999,"15min":1.3089999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Tue Oct 10 22:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.83099999999999996,"15min":0.86499999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.099,"5min":1.3320000000000001,"15min":1.377},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.86299999999999999},"min":{"1min":0.61599999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.347,"5min":1.347,"15min":1.427},"last":0.94599999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.167,"5min":1.224,"15min":1.2689999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80000000000000004,"15min":0.83699999999999997},"min":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.82799999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":316292,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055548,"statfs":{"total":96636764160,"available":96312881152,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.80200000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.497,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.69799999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53300000000000003}]},{"osd":3,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":0.84099999999999997,"15min":0.85799999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.75700000000000001,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53400000000000003,"5min":0.47599999999999998,"15min":0.438},"max":{"1min":1.046,"5min":1.101,"15min":1.288},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76000000000000001,"15min":0.79800000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.47399999999999998},"max":{"1min":0.94699999999999995,"5min":1.1220000000000001,"15min":1.325},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76900000000000002,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84799999999999998,"5min":1.1200000000000001,"15min":1.1990000000000001},"last":1.006},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.78600000000000003,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.51700000000000002},"max":{"1min":0.97699999999999998,"5min":1.147,"15min":1.1970000000000001},"last":0.78500000000000003}]},{"osd":6,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80600000000000005,"15min":0.83099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.026,"5min":1.1990000000000001,"15min":1.2689999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.622,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0069999999999999,"5min":1.167,"15min":1.26},"last":0.73199999999999998}]},{"osd":7,"last update":"Tue Oct 10 22:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.65200000000000002,"5min":0.57099999999999995,"15min":0.55500000000000005},"max":{"1min":1.048,"5min":1.165,"15min":1.3129999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.78700000000000003,"15min":0.82499999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89800000000000002,"5min":1.181,"15min":1.2609999999999999},"last":1.0429999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":316292,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055548,"statfs":{"total":96636764160,"available":96312881152,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.27800000000000002},"max":{"1min":0.67400000000000004,"5min":0.73599999999999999,"15min":0.77800000000000002},"last":0.625},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Oct 10 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.505},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61599999999999999,"5min":0.877,"15min":0.877},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.51400000000000001}]},{"osd":2,"last update":"Tue Oct 10 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.747},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59299999999999997,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Tue Oct 10 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.745,"15min":0.76300000000000001},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.113,"5min":1.133,"15min":1.242},"last":1.038},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.79700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.1000000000000001}]},{"osd":5,"last update":"Tue Oct 10 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.129,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.745,"5min":0.78300000000000003,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2130000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.171}]},{"osd":6,"last update":"Tue Oct 10 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53000000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.81100000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.212},"last":1.022}]},{"osd":7,"last update":"Tue Oct 10 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1499999999999999,"5min":1.274,"15min":1.274},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81699999999999995,"15min":0.82999999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.0629999999999999}]}]},{"osd":4,"up_from":14,"seq":60129543286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299908,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071932,"statfs":{"total":96636764160,"available":96329658368,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68300000000000005,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.871,"5min":0.95899999999999996,"15min":1.087},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84499999999999997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.72599999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.755},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.1220000000000001},"last":0.879},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.51700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.879,"5min":0.98399999999999999,"15min":1.0509999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.73899999999999999,"15min":0.76100000000000001},"min":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.073},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97099999999999997,"5min":1.01,"15min":1.089},"last":0.80400000000000005}]},{"osd":3,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.45200000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.101},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.52100000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93700000000000006,"5min":0.94299999999999995,"15min":1.054},"last":0.752}]},{"osd":5,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72199999999999998,"5min":0.78000000000000003,"15min":0.94099999999999995},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0900000000000001},"last":0.84099999999999997}]},{"osd":6,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.55100000000000005,"5min":0.45900000000000002,"15min":0.42199999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":1.0649999999999999},"last":0.62},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44700000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0629999999999999},"last":0.82299999999999995}]},{"osd":7,"last update":"Tue Oct 10 22:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.21},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.46100000000000002,"5min":0.442,"15min":0.436},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.68200000000000005}]}]},{"osd":5,"up_from":14,"seq":60129543284,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299908,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071932,"statfs":{"total":96636764160,"available":96329658368,"internally_reserved":0,"allocated":2682880,"data_stored":1350134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 10 22:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.42599999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81100000000000005,"5min":0.95899999999999996,"15min":1.006},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.71599999999999997,"15min":0.73399999999999999},"min":{"1min":0.46899999999999997,"5min":0.44900000000000001,"15min":0.41399999999999998},"max":{"1min":0.93899999999999995,"5min":0.97599999999999998,"15min":0.997},"last":0.84999999999999998}]},{"osd":1,"last update":"Tue Oct 10 22:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.44800000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.86699999999999999,"5min":0.97399999999999998,"15min":0.999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.73299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90000000000000002,"5min":0.94899999999999995,"15min":1.0349999999999999},"last":0.90800000000000003}]},{"osd":2,"last update":"Tue Oct 10 22:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88700000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.81399999999999995}]},{"osd":3,"last update":"Tue Oct 10 22:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.55900000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86299999999999999,"5min":0.98999999999999999,"15min":1.04},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.76200000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.008,"5min":1.008,"15min":1.02},"last":0.89300000000000002}]},{"osd":4,"last update":"Tue Oct 10 22:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57999999999999996,"15min":0.58799999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.84099999999999997,"5min":0.98499999999999999,"15min":0.98699999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.41899999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75}]},{"osd":6,"last update":"Tue Oct 10 22:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.37},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.54500000000000004,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":0.96099999999999997,"5min":1.01,"15min":1.032},"last":0.876}]},{"osd":7,"last update":"Tue Oct 10 22:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.53600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.51900000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-10T22:38:27.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-10T22:38:27.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.619+0000 7f26455ff700 1 Processor -- start 2023-10-10T22:38:27.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.619+0000 7f26455ff700 1 -- start start 2023-10-10T22:38:27.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.620+0000 7f26455ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26401568e0 0x7f26401616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.620+0000 7f26455ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264015b0d0 con 0x7f26400ccee0 2023-10-10T22:38:27.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.620+0000 7f26455ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264015a4c0 con 0x7f26400c83f0 2023-10-10T22:38:27.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.620+0000 7f26455ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264015a7a0 con 0x7f26401568e0 2023-10-10T22:38:27.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.621+0000 7f263f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26401568e0 0x7f26401616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.621+0000 7f263f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26401568e0 0x7f26401616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32996/0 (socket says 172.21.15.154:32996) 2023-10-10T22:38:27.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.621+0000 7f263e7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f26400ccee0 0x7f26401561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56354/0 (socket says 172.21.15.154:56354) 2023-10-10T22:38:27.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.621+0000 7f263f7fe700 1 -- 172.21.15.154:0/267426870 learned_addr learned my addr 172.21.15.154:0/267426870 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:27.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.621+0000 7f263f7fe700 1 -- 172.21.15.154:0/267426870 >> v1:172.21.15.179:6789/0 conn(0x7f26400c83f0 legacy=0x7f26400c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.621+0000 7f263f7fe700 1 -- 172.21.15.154:0/267426870 >> v1:172.21.15.154:6789/0 conn(0x7f26400ccee0 legacy=0x7f26401561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.621+0000 7f263f7fe700 1 -- 172.21.15.154:0/267426870 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264015aa80 con 0x7f26401568e0 2023-10-10T22:38:27.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.621+0000 7f263dffb700 1 -- 172.21.15.154:0/267426870 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454946427 0 0) 0x7f264015b0d0 con 0x7f26400ccee0 2023-10-10T22:38:27.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.621+0000 7f263f7fe700 1 --2- 172.21.15.154:0/267426870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 0x7f26401616c0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f2638009f20 tx=0x7f2638009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3363657fb7ac8f03 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:27.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f263dffb700 1 -- 172.21.15.154:0/267426870 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800e070 con 0x7f26401568e0 2023-10-10T22:38:27.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f263dffb700 1 -- 172.21.15.154:0/267426870 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800ba80 con 0x7f26401568e0 2023-10-10T22:38:27.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f263dffb700 1 -- 172.21.15.154:0/267426870 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26380092e0 con 0x7f26401568e0 2023-10-10T22:38:27.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f26455ff700 1 -- 172.21.15.154:0/267426870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 msgr2=0x7f26401616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f26455ff700 1 --2- 172.21.15.154:0/267426870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 0x7f26401616c0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f2638009f20 tx=0x7f2638009840 comp rx=0 tx=0).stop 2023-10-10T22:38:27.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f26455ff700 1 -- 172.21.15.154:0/267426870 shutdown_connections 2023-10-10T22:38:27.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f26455ff700 1 --2- 172.21.15.154:0/267426870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 0x7f26401616c0 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f26455ff700 1 -- 172.21.15.154:0/267426870 >> 172.21.15.154:0/267426870 conn(0x7f2640068e10 msgr2=0x7f26400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:27.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f26455ff700 1 -- 172.21.15.154:0/267426870 shutdown_connections 2023-10-10T22:38:27.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.622+0000 7f26455ff700 1 -- 172.21.15.154:0/267426870 wait complete. 2023-10-10T22:38:27.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.624+0000 7f26455ff700 1 Processor -- start 2023-10-10T22:38:27.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.624+0000 7f26455ff700 1 -- start start 2023-10-10T22:38:27.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f26455ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26400c83f0 0x7f2640151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f26455ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26400ccee0 0x7f26400c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f26455ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 0x7f26400c1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f26455ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640157d20 con 0x7f26401568e0 2023-10-10T22:38:27.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f26455ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400c3dd0 con 0x7f26400c83f0 2023-10-10T22:38:27.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f26455ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26401666e0 con 0x7f26400ccee0 2023-10-10T22:38:27.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 0x7f26400c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 0x7f26400c1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33012/0 (socket says 172.21.15.154:33012) 2023-10-10T22:38:27.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263f7fe700 1 -- 172.21.15.154:0/3107602287 learned_addr learned my addr 172.21.15.154:0/3107602287 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:27.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263e7fc700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26400ccee0 0x7f26400c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263effd700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26400c83f0 0x7f2640151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263f7fe700 1 -- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26400ccee0 msgr2=0x7f26400c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263f7fe700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26400ccee0 0x7f26400c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263f7fe700 1 -- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26400c83f0 msgr2=0x7f2640151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263f7fe700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26400c83f0 0x7f2640151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263f7fe700 1 -- 172.21.15.154:0/3107602287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2638009ae0 con 0x7f26401568e0 2023-10-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263effd700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26400c83f0 0x7f2640151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.625+0000 7f263e7fc700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26400ccee0 0x7f26400c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.626+0000 7f263f7fe700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 0x7f26400c1810 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f2640063d40 tx=0x7f2638018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:27.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.626+0000 7f2626ffd700 1 -- 172.21.15.154:0/3107602287 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638007e30 con 0x7f26401568e0 2023-10-10T22:38:27.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.626+0000 7f2626ffd700 1 -- 172.21.15.154:0/3107602287 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263801c410 con 0x7f26401568e0 2023-10-10T22:38:27.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.626+0000 7f2626ffd700 1 -- 172.21.15.154:0/3107602287 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263801c7d0 con 0x7f26401568e0 2023-10-10T22:38:27.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.626+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2640157a40 con 0x7f26401568e0 2023-10-10T22:38:27.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.626+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26400c3a60 con 0x7f26401568e0 2023-10-10T22:38:27.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.627+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26400c35e0 con 0x7f26401568e0 2023-10-10T22:38:27.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.628+0000 7f2626ffd700 1 -- 172.21.15.154:0/3107602287 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f263801cb80 con 0x7f26401568e0 2023-10-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.630+0000 7f2626ffd700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f262c066f30 0x7f262c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.630+0000 7f2626ffd700 1 -- 172.21.15.154:0/3107602287 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f2638086170 con 0x7f26401568e0 2023-10-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.630+0000 7f263effd700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f262c066f30 0x7f262c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.631+0000 7f263effd700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f262c066f30 0x7f262c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f26400b1b50 tx=0x7f2630009040 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:27.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.634+0000 7f2626ffd700 1 -- 172.21.15.154:0/3107602287 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26400c35e0 con 0x7f26401568e0 2023-10-10T22:38:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.825+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f26400c35e0 con 0x7f26401568e0 2023-10-10T22:38:27.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.830+0000 7f2626ffd700 1 -- 172.21.15.154:0/3107602287 <== mon.0 v2:172.21.15.154:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2638053200 con 0x7f26401568e0 2023-10-10T22:38:27.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.830+0000 7f2626ffd700 1 -- 172.21.15.154:0/3107602287 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v76)=0 v76) v1 ==== 123+0+0 (secure 0 0 0) 0x7f26400c35e0 con 0x7f26401568e0 2023-10-10T22:38:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.833+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f262c066f30 msgr2=0x7f262c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.833+0000 7f26455ff700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f262c066f30 0x7f262c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f26400b1b50 tx=0x7f2630009040 comp rx=0 tx=0).stop 2023-10-10T22:38:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.833+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 msgr2=0x7f26400c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.833+0000 7f26455ff700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 0x7f26400c1810 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f2640063d40 tx=0x7f2638018000 comp rx=0 tx=0).stop 2023-10-10T22:38:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.834+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 shutdown_connections 2023-10-10T22:38:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.834+0000 7f26455ff700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f262c066f30 0x7f262c0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.834+0000 7f26455ff700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26401568e0 0x7f26400c1810 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.834+0000 7f26455ff700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26400c83f0 0x7f2640151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.834+0000 7f26455ff700 1 --2- 172.21.15.154:0/3107602287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26400ccee0 0x7f26400c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.834+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 >> 172.21.15.154:0/3107602287 conn(0x7f2640068e10 msgr2=0x7f26400c7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.834+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 shutdown_connections 2023-10-10T22:38:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:27.834+0000 7f26455ff700 1 -- 172.21.15.154:0/3107602287 wait complete. 2023-10-10T22:38:27.853 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-10T22:38:27.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-10T22:38:28.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.035+0000 7f6c909fe700 1 Processor -- start 2023-10-10T22:38:28.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.035+0000 7f6c909fe700 1 -- start start 2023-10-10T22:38:28.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.036+0000 7f6c909fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c8c06d950 0x7f6c8c0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:28.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.036+0000 7f6c909fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c06ae70 con 0x7f6c8c06dd20 2023-10-10T22:38:28.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.036+0000 7f6c909fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c0c7a30 con 0x7f6c8c06a0a0 2023-10-10T22:38:28.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.036+0000 7f6c909fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c06a540 con 0x7f6c8c06d950 2023-10-10T22:38:28.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.036+0000 7f6c8b59e700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6c8c06dd20 0x7f6c8c0c7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56370/0 (socket says 172.21.15.154:56370) 2023-10-10T22:38:28.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.036+0000 7f6c8b59e700 1 -- 172.21.15.154:0/3013676296 learned_addr learned my addr 172.21.15.154:0/3013676296 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-10-10T22:38:28.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c8ad9d700 1 --2- 172.21.15.154:0/3013676296 >> v2:172.21.15.179:3300/0 conn(0x7f6c8c06d950 0x7f6c8c0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:28.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c89d9b700 1 -- 172.21.15.154:0/3013676296 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226336038 0 0) 0x7f6c8c06ae70 con 0x7f6c8c06dd20 2023-10-10T22:38:28.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c89d9b700 1 -- 172.21.15.154:0/3013676296 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c74003570 con 0x7f6c8c06dd20 2023-10-10T22:38:28.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c89d9b700 1 -- 172.21.15.154:0/3013676296 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976479708 0 0) 0x7f6c8c0c7a30 con 0x7f6c8c06a0a0 2023-10-10T22:38:28.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c89d9b700 1 -- 172.21.15.154:0/3013676296 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c8c06ae70 con 0x7f6c8c06a0a0 2023-10-10T22:38:28.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c89d9b700 1 -- 172.21.15.154:0/3013676296 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3968351328 0 0) 0x7f6c74003570 con 0x7f6c8c06dd20 2023-10-10T22:38:28.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c8ad9d700 1 -- 172.21.15.154:0/3013676296 >> v1:172.21.15.179:6789/0 conn(0x7f6c8c06a0a0 legacy=0x7f6c8c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:28.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c8ad9d700 1 -- 172.21.15.154:0/3013676296 >> v1:172.21.15.154:6789/0 conn(0x7f6c8c06dd20 legacy=0x7f6c8c0c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:28.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c8ad9d700 1 -- 172.21.15.154:0/3013676296 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c06a820 con 0x7f6c8c06d950 2023-10-10T22:38:28.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.037+0000 7f6c8ad9d700 1 --2- 172.21.15.154:0/3013676296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c06d950 0x7f6c8c0c8350 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0098e0 tx=0x7f6c7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62f975b5c35994bb server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:28.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.038+0000 7f6c89d9b700 1 -- 172.21.15.154:0/3013676296 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c840017f0 con 0x7f6c8c06d950 2023-10-10T22:38:28.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.038+0000 7f6c89d9b700 1 -- 172.21.15.154:0/3013676296 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6c7c011420 con 0x7f6c8c06d950 2023-10-10T22:38:28.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.038+0000 7f6c89d9b700 1 -- 172.21.15.154:0/3013676296 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0117e0 con 0x7f6c8c06d950 2023-10-10T22:38:28.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.038+0000 7f6c909fe700 1 -- 172.21.15.154:0/3013676296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c06d950 msgr2=0x7f6c8c0c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:28.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.038+0000 7f6c909fe700 1 --2- 172.21.15.154:0/3013676296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c06d950 0x7f6c8c0c8350 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0098e0 tx=0x7f6c7c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:28.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.038+0000 7f6c909fe700 1 -- 172.21.15.154:0/3013676296 shutdown_connections 2023-10-10T22:38:28.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.038+0000 7f6c909fe700 1 --2- 172.21.15.154:0/3013676296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c06d950 0x7f6c8c0c8350 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:28.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.038+0000 7f6c909fe700 1 -- 172.21.15.154:0/3013676296 >> 172.21.15.154:0/3013676296 conn(0x7f6c8c0cc1f0 msgr2=0x7f6c8c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:28.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.038+0000 7f6c909fe700 1 -- 172.21.15.154:0/3013676296 shutdown_connections 2023-10-10T22:38:28.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.039+0000 7f6c909fe700 1 -- 172.21.15.154:0/3013676296 wait complete. 2023-10-10T22:38:28.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.040+0000 7f6c909fe700 1 Processor -- start 2023-10-10T22:38:28.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.040+0000 7f6c909fe700 1 -- start start 2023-10-10T22:38:28.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c909fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c06a0a0 0x7f6c8c0af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:28.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c909fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c8c06d950 0x7f6c8c0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:28.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c909fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c06dd20 0x7f6c8c0c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:28.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c909fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0c3650 con 0x7f6c8c06d950 2023-10-10T22:38:28.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c909fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0b0810 con 0x7f6c8c06a0a0 2023-10-10T22:38:28.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c909fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0afc00 con 0x7f6c8c06dd20 2023-10-10T22:38:28.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c8a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c8c06d950 0x7f6c8c0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:28.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c8a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c8c06d950 0x7f6c8c0c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33016/0 (socket says 172.21.15.154:33016) 2023-10-10T22:38:28.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c8a59c700 1 -- 172.21.15.154:0/636802988 learned_addr learned my addr 172.21.15.154:0/636802988 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-10-10T22:38:28.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c8ad9d700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c06a0a0 0x7f6c8c0af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:28.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.041+0000 7f6c8b59e700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c06dd20 0x7f6c8c0c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:28.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c8a59c700 1 -- 172.21.15.154:0/636802988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c06dd20 msgr2=0x7f6c8c0c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:28.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c8a59c700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c06dd20 0x7f6c8c0c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:28.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c8a59c700 1 -- 172.21.15.154:0/636802988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c06a0a0 msgr2=0x7f6c8c0af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:28.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c8a59c700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c06a0a0 0x7f6c8c0af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:28.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c8a59c700 1 -- 172.21.15.154:0/636802988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c009420 con 0x7f6c8c06d950 2023-10-10T22:38:28.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c8a59c700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c8c06d950 0x7f6c8c0c4a10 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c580 tx=0x7f6c80007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:28.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c72ffd700 1 -- 172.21.15.154:0/636802988 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80010510 con 0x7f6c8c06d950 2023-10-10T22:38:28.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c72ffd700 1 -- 172.21.15.154:0/636802988 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6c80010670 con 0x7f6c8c06d950 2023-10-10T22:38:28.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c72ffd700 1 -- 172.21.15.154:0/636802988 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80010a50 con 0x7f6c8c06d950 2023-10-10T22:38:28.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c0afee0 con 0x7f6c8c06d950 2023-10-10T22:38:28.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.042+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c0b04a0 con 0x7f6c8c06d950 2023-10-10T22:38:28.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.043+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c04c3c0 con 0x7f6c8c06d950 2023-10-10T22:38:28.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.044+0000 7f6c72ffd700 1 -- 172.21.15.154:0/636802988 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c8001b400 con 0x7f6c8c06d950 2023-10-10T22:38:28.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.045+0000 7f6c72ffd700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6c78066fb0 0x7f6c78069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-10T22:38:28.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.045+0000 7f6c72ffd700 1 -- 172.21.15.154:0/636802988 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f6c80084280 con 0x7f6c8c06d950 2023-10-10T22:38:28.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.045+0000 7f6c8ad9d700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6c78066fb0 0x7f6c78069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-10T22:38:28.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.046+0000 7f6c8ad9d700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6c78066fb0 0x7f6c78069460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0093f0 tx=0x7f6c7c0091a0 comp rx=0 tx=0).ready entity=mgr.10491 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-10T22:38:28.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.049+0000 7f6c72ffd700 1 -- 172.21.15.154:0/636802988 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c80051390 con 0x7f6c8c06d950 2023-10-10T22:38:28.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.283+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c8c0c78a0 con 0x7f6c8c06d950 2023-10-10T22:38:28.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.283+0000 7f6c72ffd700 1 -- 172.21.15.154:0/636802988 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+3543 (secure 0 0 0) 0x7f6c800549b0 con 0x7f6c8c06d950 2023-10-10T22:38:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-10-10T22:38:28.285 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":96,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1468165521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1468165521},{"type":"v1","addr":"172.21.15.179:6834","nonce":1468165521}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":9841,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3586852984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3586852984},{"type":"v1","addr":"172.21.15.179:6835","nonce":3586852984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":10164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1270073932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1270073932},{"type":"v1","addr":"172.21.15.154:6834","nonce":1270073932}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10167,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2994571754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2994571754},{"type":"v1","addr":"172.21.15.154:6835","nonce":2994571754}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[]} 2023-10-10T22:38:28.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6c78066fb0 msgr2=0x7f6c78069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:28.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6c78066fb0 0x7f6c78069460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0093f0 tx=0x7f6c7c0091a0 comp rx=0 tx=0).stop 2023-10-10T22:38:28.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c8c06d950 msgr2=0x7f6c8c0c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-10T22:38:28.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c8c06d950 0x7f6c8c0c4a10 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c580 tx=0x7f6c80007e10 comp rx=0 tx=0).stop 2023-10-10T22:38:28.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 shutdown_connections 2023-10-10T22:38:28.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:6836/132976,v1:172.21.15.154:6837/132976] conn(0x7f6c78066fb0 0x7f6c78069460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:28.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c06dd20 0x7f6c8c0c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c06a0a0 0x7f6c8c0af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 --2- 172.21.15.154:0/636802988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c8c06d950 0x7f6c8c0c4a10 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-10T22:38:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 >> 172.21.15.154:0/636802988 conn(0x7f6c8c0cc1f0 msgr2=0x7f6c8c1527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-10T22:38:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 shutdown_connections 2023-10-10T22:38:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-10-10T22:38:28.286+0000 7f6c909fe700 1 -- 172.21.15.154:0/636802988 wait complete. 2023-10-10T22:38:28.290 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 96 2023-10-10T22:38:28.305 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-10T22:38:28.305 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-10T22:38:28.306 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-10T22:38:28.306 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.318 INFO:tasks.ceph.mds.a:Stopped 2023-10-10T22:38:28.319 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-10T22:38:28.319 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.372 INFO:tasks.ceph.mds.c:Stopped 2023-10-10T22:38:28.372 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-10T22:38:28.372 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.388 INFO:tasks.ceph.mds.b:Stopped 2023-10-10T22:38:28.389 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-10T22:38:28.389 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.444 INFO:tasks.ceph.mds.d:Stopped 2023-10-10T22:38:28.444 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-10T22:38:28.445 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-10T22:38:28.445 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.490 INFO:tasks.ceph.osd.0:Stopped 2023-10-10T22:38:28.491 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-10T22:38:28.491 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.541 INFO:tasks.ceph.osd.1:Stopped 2023-10-10T22:38:28.541 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-10T22:38:28.542 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.590 INFO:tasks.ceph.osd.2:Stopped 2023-10-10T22:38:28.591 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-10T22:38:28.591 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.644 INFO:tasks.ceph.osd.3:Stopped 2023-10-10T22:38:28.645 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-10T22:38:28.645 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.701 INFO:tasks.ceph.osd.4:Stopped 2023-10-10T22:38:28.702 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-10T22:38:28.702 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.755 INFO:tasks.ceph.osd.5:Stopped 2023-10-10T22:38:28.756 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-10T22:38:28.756 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.808 INFO:tasks.ceph.osd.6:Stopped 2023-10-10T22:38:28.809 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-10T22:38:28.810 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.858 INFO:tasks.ceph.osd.7:Stopped 2023-10-10T22:38:28.859 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-10T22:38:28.859 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-10T22:38:28.860 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.927 INFO:tasks.ceph.mgr.y:Stopped 2023-10-10T22:38:28.928 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-10T22:38:28.929 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:28.989 INFO:tasks.ceph.mgr.x:Stopped 2023-10-10T22:38:28.990 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-10T22:38:28.990 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-10T22:38:28.991 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:29.023 INFO:tasks.ceph.mon.a:Stopped 2023-10-10T22:38:29.023 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-10T22:38:29.024 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:29.047 INFO:tasks.ceph.mon.b:Stopped 2023-10-10T22:38:29.048 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-10T22:38:29.048 INFO:teuthology.orchestra.run:waiting for 300 2023-10-10T22:38:29.112 INFO:tasks.ceph.mon.c:Stopped 2023-10-10T22:38:29.112 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-10T22:38:29.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-10T22:38:29.185 INFO:teuthology.orchestra.run.smithi154.stdout:1696972590.160446 mon.a (mon.0) 623 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-10T22:38:29.186 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-10T22:38:29.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-10T22:38:29.260 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-10T22:38:29.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-10T22:38:29.404 INFO:teuthology.orchestra.run.smithi154.stdout:1696972590.160446 mon.a (mon.0) 623 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-10T22:38:29.405 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:38:29.405 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-10T22:38:29.737 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:38:29.738 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-10T22:38:29.943 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:38:29.944 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-10T22:38:30.155 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:38:30.156 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-10T22:38:30.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T22:38:30.351 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-10T22:38:30.759 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T22:38:30.759 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-10T22:38:30.944 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T22:38:30.944 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-10T22:38:31.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T22:38:31.170 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-10T22:38:31.353 INFO:tasks.ceph:Archiving mon data... 2023-10-10T22:38:31.355 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/data/mon.a.tgz 2023-10-10T22:38:31.355 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-10-10T22:38:31.397 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.OI9wahCass 2023-10-10T22:38:31.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OI9wahCass 2023-10-10T22:38:31.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.OI9wahCass 2023-10-10T22:38:31.991 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.OI9wahCass is 3MB 2023-10-10T22:38:32.128 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.OI9wahCass 2023-10-10T22:38:32.165 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/data/mon.b.tgz 2023-10-10T22:38:32.166 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-10-10T22:38:32.204 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.9tbOMmmyYh 2023-10-10T22:38:32.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9tbOMmmyYh 2023-10-10T22:38:32.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.9tbOMmmyYh 2023-10-10T22:38:32.805 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.9tbOMmmyYh is 3MB 2023-10-10T22:38:32.926 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.9tbOMmmyYh 2023-10-10T22:38:32.963 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/data/mon.c.tgz 2023-10-10T22:38:32.963 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-10-10T22:38:33.038 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.WJVNDi3iHg 2023-10-10T22:38:33.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.WJVNDi3iHg 2023-10-10T22:38:33.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.WJVNDi3iHg 2023-10-10T22:38:33.633 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.WJVNDi3iHg is 3MB 2023-10-10T22:38:33.756 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.WJVNDi3iHg 2023-10-10T22:38:33.792 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-10T22:38:33.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-10T22:38:33.798 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-10T22:38:33.892 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-10T22:38:33.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-10T22:38:33.898 DEBUG:teuthology.orchestra.run.smithi179:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-10T22:38:33.966 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-10T22:38:33.969 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-10T22:38:33.985 INFO:tasks.ceph:Archiving crash dumps... 2023-10-10T22:38:33.987 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/remote/smithi154/crash 2023-10-10T22:38:33.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-10T22:38:34.048 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/remote/smithi179/crash 2023-10-10T22:38:34.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-10T22:38:34.108 INFO:tasks.ceph:Shutting down logrotate 2023-10-10T22:38:34.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:38:34.114 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-10T22:38:34.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-10T22:38:34.264 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-10T22:38:34.325 INFO:tasks.ceph:Compressing logs... 2023-10-10T22:38:34.326 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-10T22:38:34.331 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-10T22:38:34.387 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95085.log 2023-10-10T22:38:34.388 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134837.log 2023-10-10T22:38:34.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95085.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95085.log.gz 2023-10-10T22:38:34.389 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127052.log 2023-10-10T22:38:34.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108239.log 2023-10-10T22:38:34.390 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134837.log.gz 2023-10-10T22:38:34.391 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94471.log 2023-10-10T22:38:34.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127052.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127052.log.gz 2023-10-10T22:38:34.392 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108323.log 2023-10-10T22:38:34.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103128.log 2023-10-10T22:38:34.393 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108239.log.gz 2023-10-10T22:38:34.405 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88047.log 2023-10-10T22:38:34.406 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.94471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94471.log.gz 2023-10-10T22:38:34.406 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87920.log 2023-10-10T22:38:34.406 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.88047.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88047.log.gz 2023-10-10T22:38:34.406 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-10T22:38:34.407 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.87920.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87920.log.gz 2023-10-10T22:38:34.407 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88092.log 2023-10-10T22:38:34.407 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-10T22:38:34.407 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.88092.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88092.log.gz 2023-10-10T22:38:34.407 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88216.log 2023-10-10T22:38:34.408 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-10T22:38:34.408 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.88216.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88216.log.gz 2023-10-10T22:38:34.408 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87961.log 2023-10-10T22:38:34.409 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-10T22:38:34.409 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.87961.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87961.log.gz 2023-10-10T22:38:34.409 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-10T22:38:34.409 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-10T22:38:34.410 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88176.log 2023-10-10T22:38:34.419 INFO:teuthology.orchestra.run.smithi179.stderr: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-10T22:38:34.419 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-10T22:38:34.419 INFO:teuthology.orchestra.run.smithi179.stderr: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-10T22:38:34.420 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.88176.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88176.log.gz 2023-10-10T22:38:34.420 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94833.log 2023-10-10T22:38:34.420 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88004.log 2023-10-10T22:38:34.420 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.3.94833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.94833.log.gz 2023-10-10T22:38:34.421 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-10T22:38:34.421 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.88004.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88004.log.gz 2023-10-10T22:38:34.421 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94829.log 2023-10-10T22:38:34.421 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-10T22:38:34.421 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.3.94829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.94829.log.gz 2023-10-10T22:38:34.422 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-10T22:38:34.422 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88134.log 2023-10-10T22:38:34.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128405.log 2023-10-10T22:38:34.428 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.108323.log.gz 2023-10-10T22:38:34.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103128.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103128.log.gz 2023-10-10T22:38:34.428 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129613.log 2023-10-10T22:38:34.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128405.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128405.log.gz 2023-10-10T22:38:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90698.log 2023-10-10T22:38:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129613.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.129613.log.gz 2023-10-10T22:38:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136097.log 2023-10-10T22:38:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90698.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90698.log.gz 2023-10-10T22:38:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135568.log 2023-10-10T22:38:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118423.log 2023-10-10T22:38:34.430 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.136097.log.gz 2023-10-10T22:38:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135568.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.135568.log.gz 2023-10-10T22:38:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130985.log 2023-10-10T22:38:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118423.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118423.log.gz 2023-10-10T22:38:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143265.log 2023-10-10T22:38:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130985.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130985.log.gz 2023-10-10T22:38:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140391.log 2023-10-10T22:38:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143265.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143265.log.gz 2023-10-10T22:38:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110377.log 2023-10-10T22:38:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140391.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140391.log.gz 2023-10-10T22:38:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111304.log 2023-10-10T22:38:34.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110377.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110377.log.gz 2023-10-10T22:38:34.433 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121173.log 2023-10-10T22:38:34.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111304.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111304.log.gz 2023-10-10T22:38:34.433 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97886.log 2023-10-10T22:38:34.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121173.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121173.log.gz 2023-10-10T22:38:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128555.log 2023-10-10T22:38:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97886.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97886.log.gz 2023-10-10T22:38:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98294.log 2023-10-10T22:38:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128555.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128555.log.gz 2023-10-10T22:38:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95379.log 2023-10-10T22:38:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98294.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98294.log.gz 2023-10-10T22:38:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95421.log 2023-10-10T22:38:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95379.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95379.log.gz 2023-10-10T22:38:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108407.log 2023-10-10T22:38:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95421.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95421.log.gz 2023-10-10T22:38:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127262.log 2023-10-10T22:38:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108407.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108407.log.gz 2023-10-10T22:38:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141941.log 2023-10-10T22:38:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127262.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127262.log.gz 2023-10-10T22:38:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143602.log 2023-10-10T22:38:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141941.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141941.log.gz 2023-10-10T22:38:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94111.log 2023-10-10T22:38:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143602.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143602.log.gz 2023-10-10T22:38:34.437 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143854.log 2023-10-10T22:38:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94111.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94111.log.gz 2023-10-10T22:38:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90996.log 2023-10-10T22:38:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143854.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143854.log.gz 2023-10-10T22:38:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139546.log 2023-10-10T22:38:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90996.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90996.log.gz 2023-10-10T22:38:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96704.log 2023-10-10T22:38:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139546.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139546.log.gz 2023-10-10T22:38:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140521.log 2023-10-10T22:38:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96704.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96704.log.gz 2023-10-10T22:38:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140265.log 2023-10-10T22:38:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140521.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140521.log.gz 2023-10-10T22:38:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91332.log 2023-10-10T22:38:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140265.log: gzip -5 --verbose -- 89.4%/var/log/ceph/ceph-client.admin.104621.log -- replaced with /var/log/ceph/ceph-client.admin.140265.log.gz 2023-10-10T22:38:34.441 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:34.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91332.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91332.log.gz 2023-10-10T22:38:34.441 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130163.log 2023-10-10T22:38:34.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104621.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104621.log.gz 2023-10-10T22:38:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120284.log 2023-10-10T22:38:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130163.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130163.log.gz 2023-10-10T22:38:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99369.log 2023-10-10T22:38:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120284.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120284.log.gz 2023-10-10T22:38:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143938.log 2023-10-10T22:38:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99369.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99369.log.gz 2023-10-10T22:38:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139127.log 2023-10-10T22:38:34.445 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-10T22:38:34.446 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.88134.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88134.log.gz 2023-10-10T22:38:34.450 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94440.log 2023-10-10T22:38:34.456 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-10T22:38:34.465 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.94440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94440.log.gz 2023-10-10T22:38:34.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143938.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143938.log.gz 2023-10-10T22:38:34.470 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129027.log 2023-10-10T22:38:34.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139127.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139127.log.gz 2023-10-10T22:38:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111820.log 2023-10-10T22:38:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129027.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129027.log.gz 2023-10-10T22:38:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139311.log 2023-10-10T22:38:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111820.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111820.log.gz 2023-10-10T22:38:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104495.log 2023-10-10T22:38:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139311.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139311.log.gz 2023-10-10T22:38:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101451.log 2023-10-10T22:38:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104495.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104495.log.gz 2023-10-10T22:38:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94451.log 2023-10-10T22:38:34.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101451.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101451.log.gz 2023-10-10T22:38:34.473 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95875.log 2023-10-10T22:38:34.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94451.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94451.log.gz 2023-10-10T22:38:34.474 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127346.log 2023-10-10T22:38:34.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95875.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.95875.log.gz 2023-10-10T22:38:34.474 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109239.log 2023-10-10T22:38:34.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127346.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127346.log.gz 2023-10-10T22:38:34.474 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90647.log 2023-10-10T22:38:34.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109239.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109239.log.gz 2023-10-10T22:38:34.475 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90868.log 2023-10-10T22:38:34.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90647.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90647.log.gz 2023-10-10T22:38:34.475 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104705.log 2023-10-10T22:38:34.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90868.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90868.log.gz 2023-10-10T22:38:34.476 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141218.log 2023-10-10T22:38:34.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104705.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104705.log.gz 2023-10-10T22:38:34.476 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107401.log 2023-10-10T22:38:34.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141218.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141218.log.gz 2023-10-10T22:38:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134090.log 2023-10-10T22:38:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107401.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107401.log.gz 2023-10-10T22:38:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113496.log 2023-10-10T22:38:34.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134090.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.134090.log.gz 2023-10-10T22:38:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98337.log 2023-10-10T22:38:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113496.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113496.log.gz 2023-10-10T22:38:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93012.log 2023-10-10T22:38:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98337.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98337.log.gz 2023-10-10T22:38:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91868.log 2023-10-10T22:38:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.93012.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93012.log.gz 2023-10-10T22:38:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114829.log 2023-10-10T22:38:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91868.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91868.log.gz 2023-10-10T22:38:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104957.log 2023-10-10T22:38:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114829.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114829.log.gz 2023-10-10T22:38:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120049.log 2023-10-10T22:38:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100201.log 2023-10-10T22:38:34.481 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.104957.log.gz 2023-10-10T22:38:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120049.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120049.log.gz 2023-10-10T22:38:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98380.log 2023-10-10T22:38:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100201.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100201.log.gz 2023-10-10T22:38:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115101.log 2023-10-10T22:38:34.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98380.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98380.log.gz 2023-10-10T22:38:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91871.log 2023-10-10T22:38:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115101.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115101.log.gz 2023-10-10T22:38:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107804.log 2023-10-10T22:38:34.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91871.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91871.log.gz 2023-10-10T22:38:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91164.log 2023-10-10T22:38:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107804.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107804.log.gz 2023-10-10T22:38:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111178.log 2023-10-10T22:38:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91164.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91164.log.gz 2023-10-10T22:38:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99537.log 2023-10-10T22:38:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111178.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111178.log.gz 2023-10-10T22:38:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135610.log 2023-10-10T22:38:34.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99537.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99537.log.gz 2023-10-10T22:38:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105233.log 2023-10-10T22:38:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135610.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135610.log.gz 2023-10-10T22:38:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111992.log 2023-10-10T22:38:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.105233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105233.log.gz 2023-10-10T22:38:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109323.log 2023-10-10T22:38:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111992.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111992.log.gz 2023-10-10T22:38:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112454.log 2023-10-10T22:38:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109323.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109323.log.gz 2023-10-10T22:38:34.488 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122265.log 2023-10-10T22:38:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112454.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112454.log.gz 2023-10-10T22:38:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135104.log 2023-10-10T22:38:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122265.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122265.log.gz 2023-10-10T22:38:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120573.log 2023-10-10T22:38:34.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135104.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.135104.log.gz 2023-10-10T22:38:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131575.log 2023-10-10T22:38:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120573.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120573.log.gz 2023-10-10T22:38:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-10T22:38:34.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114617.log 2023-10-10T22:38:34.491 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.131575.log.gz 2023-10-10T22:38:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134711.log 2023-10-10T22:38:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114617.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114617.log.gz 2023-10-10T22:38:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134319.log 2023-10-10T22:38:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134711.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134711.log.gz 2023-10-10T22:38:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142336.log 2023-10-10T22:38:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134319.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134319.log.gz 2023-10-10T22:38:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126612.log 2023-10-10T22:38:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142336.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142336.log.gz 2023-10-10T22:38:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102988.log 2023-10-10T22:38:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126612.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126612.log.gz 2023-10-10T22:38:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117820.log 2023-10-10T22:38:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102988.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102988.log.gz 2023-10-10T22:38:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102451.log 2023-10-10T22:38:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117820.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117820.log.gz 2023-10-10T22:38:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96127.log 2023-10-10T22:38:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102451.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102451.log.gz 2023-10-10T22:38:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129475.log 2023-10-10T22:38:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96127.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96127.log.gz 2023-10-10T22:38:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120139.log 2023-10-10T22:38:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129475.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129475.log.gz 2023-10-10T22:38:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101701.log 2023-10-10T22:38:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120139.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120139.log.gz 2023-10-10T22:38:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90824.log 2023-10-10T22:38:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101701.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101701.log.gz 2023-10-10T22:38:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130935.log 2023-10-10T22:38:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90824.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90824.log.gz 2023-10-10T22:38:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100101.log 2023-10-10T22:38:34.525 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130935.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.130935.log.gzgzip 2023-10-10T22:38:34.525 INFO:teuthology.orchestra.run.smithi154.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.116951.log 2023-10-10T22:38:34.526 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100101.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100101.log.gz 2023-10-10T22:38:34.527 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98063.log 2023-10-10T22:38:34.527 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116951.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116951.log.gz 2023-10-10T22:38:34.527 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109113.log 2023-10-10T22:38:34.528 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98063.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98063.log.gz 2023-10-10T22:38:34.528 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109617.log 2023-10-10T22:38:34.528 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109113.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109113.log.gz 2023-10-10T22:38:34.529 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104873.log 2023-10-10T22:38:34.529 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118465.log 2023-10-10T22:38:34.529 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.109617.log.gz 2023-10-10T22:38:34.530 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104873.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104873.log.gz 2023-10-10T22:38:34.530 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119253.log 2023-10-10T22:38:34.530 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118465.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118465.log.gz 2023-10-10T22:38:34.530 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121877.log 2023-10-10T22:38:34.531 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119253.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119253.log.gz 2023-10-10T22:38:34.531 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115370.log 2023-10-10T22:38:34.531 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121877.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121877.log.gz 2023-10-10T22:38:34.531 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127610.log 2023-10-10T22:38:34.531 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115370.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115370.log.gz 2023-10-10T22:38:34.531 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122378.log 2023-10-10T22:38:34.532 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127610.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127610.log.gz 2023-10-10T22:38:34.532 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131239.log 2023-10-10T22:38:34.532 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127408.log 2023-10-10T22:38:34.532 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122378.log.gz 2023-10-10T22:38:34.532 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131239.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131239.log.gz 2023-10-10T22:38:34.533 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104915.log 2023-10-10T22:38:34.533 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127408.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127408.log.gz 2023-10-10T22:38:34.533 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100701.log 2023-10-10T22:38:34.533 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85903.log 2023-10-10T22:38:34.533 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104915.log.gz 2023-10-10T22:38:34.534 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100701.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100701.log.gz 2023-10-10T22:38:34.534 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111430.log 2023-10-10T22:38:34.534 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.85903.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85903.log.gz 2023-10-10T22:38:34.534 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136055.log 2023-10-10T22:38:34.534 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111430.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111430.log.gz 2023-10-10T22:38:34.535 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122708.log 2023-10-10T22:38:34.535 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136055.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136055.log.gz 2023-10-10T22:38:34.535 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103629.log 2023-10-10T22:38:34.535 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122708.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122708.log.gz 2023-10-10T22:38:34.535 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135736.log 2023-10-10T22:38:34.535 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103629.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103629.log.gz 2023-10-10T22:38:34.536 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120845.log 2023-10-10T22:38:34.536 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135736.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135736.log.gz 2023-10-10T22:38:34.536 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116410.log 2023-10-10T22:38:34.536 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120845.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120845.log.gz 2023-10-10T22:38:34.536 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113869.log 2023-10-10T22:38:34.537 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116410.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116410.log.gz 2023-10-10T22:38:34.537 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143307.log 2023-10-10T22:38:34.537 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113869.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113869.log.gz 2023-10-10T22:38:34.537 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127975.log 2023-10-10T22:38:34.537 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143307.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143307.log.gz 2023-10-10T22:38:34.538 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129813.log 2023-10-10T22:38:34.538 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127975.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127975.log.gz 2023-10-10T22:38:34.538 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121005.log 2023-10-10T22:38:34.538 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129813.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129813.log.gz 2023-10-10T22:38:34.539 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95749.log 2023-10-10T22:38:34.539 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121005.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121005.log.gz 2023-10-10T22:38:34.539 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118255.log 2023-10-10T22:38:34.539 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95749.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95749.log.gz 2023-10-10T22:38:34.539 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98165.log 2023-10-10T22:38:34.540 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113541.log 2023-10-10T22:38:34.540 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118255.log.gz 2023-10-10T22:38:34.540 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98165.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98165.log.gz 2023-10-10T22:38:34.540 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96662.log 2023-10-10T22:38:34.542 INFO:teuthology.orchestra.run.smithi179.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-10T22:38:34.554 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113541.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113541.log.gz 2023-10-10T22:38:34.554 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102201.log 2023-10-10T22:38:34.554 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96662.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96662.log.gz 2023-10-10T22:38:34.554 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117246.log 2023-10-10T22:38:34.554 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102201.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102201.log.gz 2023-10-10T22:38:34.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96452.log 2023-10-10T22:38:34.555 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117246.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.117246.log.gz 2023-10-10T22:38:34.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134964.log 2023-10-10T22:38:34.555 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96452.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96452.log.gz 2023-10-10T22:38:34.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142582.log 2023-10-10T22:38:34.556 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134964.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.134964.log.gz 2023-10-10T22:38:34.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132934.log 2023-10-10T22:38:34.556 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142582.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142582.log.gz 2023-10-10T22:38:34.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113680.log 2023-10-10T22:38:34.556 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.132934.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132934.log.gz 2023-10-10T22:38:34.557 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129295.log 2023-10-10T22:38:34.557 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113680.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113680.log.gz 2023-10-10T22:38:34.557 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126757.log 2023-10-10T22:38:34.557 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129295.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.129295.log.gz 2023-10-10T22:38:34.557 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130331.log 2023-10-10T22:38:34.558 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126757.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126757.log.gz 2023-10-10T22:38:34.558 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108281.log 2023-10-10T22:38:34.558 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130331.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130331.log.gz 2023-10-10T22:38:34.558 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118507.log 2023-10-10T22:38:34.558 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108281.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108281.log.gz 2023-10-10T22:38:34.558 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120923.log 2023-10-10T22:38:34.559 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128489.log 2023-10-10T22:38:34.559 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.118507.log.gz 2023-10-10T22:38:34.559 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120923.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120923.log.gz 2023-10-10T22:38:34.559 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114101.log 2023-10-10T22:38:34.559 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134464.log 2023-10-10T22:38:34.560 INFO:teuthology.orchestra.run.smithi154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.128489.log.gz 2023-10-10T22:38:34.560 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114101.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114101.log.gz 2023-10-10T22:38:34.560 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104061.log 2023-10-10T22:38:34.560 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134464.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134464.log.gz 2023-10-10T22:38:34.560 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121328.log 2023-10-10T22:38:34.561 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104061.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104061.log.gz 2023-10-10T22:38:34.561 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142717.log 2023-10-10T22:38:34.561 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121328.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121328.log.gz 2023-10-10T22:38:34.561 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122182.log 2023-10-10T22:38:34.561 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142717.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142717.log.gz 2023-10-10T22:38:34.561 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143728.log 2023-10-10T22:38:34.562 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.122182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.122182.log.gz 2023-10-10T22:38:34.562 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128313.log 2023-10-10T22:38:34.562 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143728.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143728.log.gz 2023-10-10T22:38:34.562 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99411.log 2023-10-10T22:38:34.562 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128313.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128313.log.gz 2023-10-10T22:38:34.563 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108491.log 2023-10-10T22:38:34.563 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99411.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.99411.log.gz 2023-10-10T22:38:34.563 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120004.log 2023-10-10T22:38:34.563 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108491.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108491.log.gz 2023-10-10T22:38:34.563 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127933.log 2023-10-10T22:38:34.564 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120004.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120004.log.gz 2023-10-10T22:38:34.564 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95001.log 2023-10-10T22:38:34.564 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127933.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127933.log.gz 2023-10-10T22:38:34.564 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92424.log 2023-10-10T22:38:34.564 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95001.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95001.log.gz 2023-10-10T22:38:34.564 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103316.log 2023-10-10T22:38:34.565 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92424.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92424.log.gz 2023-10-10T22:38:34.565 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95917.log 2023-10-10T22:38:34.565 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103316.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103316.log.gzgzip 2023-10-10T22:38:34.565 INFO:teuthology.orchestra.run.smithi154.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.135820.log 2023-10-10T22:38:34.565 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95917.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95917.log.gz 2023-10-10T22:38:34.566 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113039.log 2023-10-10T22:38:34.566 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135820.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135820.log.gz 2023-10-10T22:38:34.566 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.94006.log 2023-10-10T22:38:34.566 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113039.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113039.log.gz 2023-10-10T22:38:34.566 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132354.log 2023-10-10T22:38:34.567 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.2.94006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.94006.log.gz 2023-10-10T22:38:34.567 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113727.log 2023-10-10T22:38:34.567 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.132354.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132354.log.gz 2023-10-10T22:38:34.567 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143812.log 2023-10-10T22:38:34.575 INFO:teuthology.orchestra.run.smithi179.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-10T22:38:34.576 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113727.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113727.log.gz 2023-10-10T22:38:34.576 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139816.log 2023-10-10T22:38:34.576 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143812.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143812.log.gz 2023-10-10T22:38:34.576 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99243.log 2023-10-10T22:38:34.577 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139816.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139816.log.gz 2023-10-10T22:38:34.577 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99495.log 2023-10-10T22:38:34.577 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99243.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99243.log.gz 2023-10-10T22:38:34.577 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92221.log 2023-10-10T22:38:34.577 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99495.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99495.log.gz 2023-10-10T22:38:34.578 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92802.log 2023-10-10T22:38:34.578 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92221.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92221.log.gz 2023-10-10T22:38:34.578 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110695.log 2023-10-10T22:38:34.578 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92802.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92802.log.gz 2023-10-10T22:38:34.578 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118966.log 2023-10-10T22:38:34.579 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110695.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110695.log.gz 2023-10-10T22:38:34.579 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114311.log 2023-10-10T22:38:34.579 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118966.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118966.log.gz 2023-10-10T22:38:34.579 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119028.log 2023-10-10T22:38:34.579 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114311.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114311.log.gz 2023-10-10T22:38:34.580 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98208.log 2023-10-10T22:38:34.580 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119028.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.119028.log.gz 2023-10-10T22:38:34.580 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109407.log 2023-10-10T22:38:34.580 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98208.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98208.log.gz 2023-10-10T22:38:34.580 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128963.log 2023-10-10T22:38:34.580 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109407.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109407.log.gz 2023-10-10T22:38:34.581 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111736.log 2023-10-10T22:38:34.581 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128963.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128963.log.gz 2023-10-10T22:38:34.581 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133874.log 2023-10-10T22:38:34.581 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111736.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111736.log.gzgzip 2023-10-10T22:38:34.581 INFO:teuthology.orchestra.run.smithi154.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.139358.log 2023-10-10T22:38:34.582 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.133874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121624.log 2023-10-10T22:38:34.582 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.133874.log.gz 2023-10-10T22:38:34.582 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139358.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.139358.log.gz 2023-10-10T22:38:34.582 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91874.log 2023-10-10T22:38:34.582 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121624.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121624.log.gz 2023-10-10T22:38:34.583 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130373.log 2023-10-10T22:38:34.583 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91874.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91874.log.gz 2023-10-10T22:38:34.583 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143980.log 2023-10-10T22:38:34.583 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130373.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.130373.log.gz 2023-10-10T22:38:34.583 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99869.log 2023-10-10T22:38:34.583 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143980.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143980.log.gz 2023-10-10T22:38:34.584 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94871.log 2023-10-10T22:38:34.584 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99869.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99869.log.gz 2023-10-10T22:38:34.584 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117456.log 2023-10-10T22:38:34.588 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94871.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94871.log.gz 2023-10-10T22:38:34.588 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133544.log 2023-10-10T22:38:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117456.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117456.log.gz 2023-10-10T22:38:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.131838.log 2023-10-10T22:38:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.133544.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133544.log.gz 2023-10-10T22:38:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107618.log 2023-10-10T22:38:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.131838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.131838.log.gz 2023-10-10T22:38:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98004.log 2023-10-10T22:38:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107618.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107618.log.gz 2023-10-10T22:38:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117947.log 2023-10-10T22:38:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98004.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98004.log.gz 2023-10-10T22:38:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91538.log 2023-10-10T22:38:34.591 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99453.log 2023-10-10T22:38:34.591 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117947.log.gz 2023-10-10T22:38:34.591 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91538.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91538.log.gz 2023-10-10T22:38:34.591 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115412.log 2023-10-10T22:38:34.591 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96171.log 2023-10-10T22:38:34.592 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99453.log.gz 2023-10-10T22:38:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115412.log: gzip 89.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.115412.log.gz-- /var/log/ceph/ceph-client.admin.134045.log 2023-10-10T22:38:34.592 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131987.log 2023-10-10T22:38:34.592 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96171.log.gz 2023-10-10T22:38:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134045.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.134045.log.gz 2023-10-10T22:38:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90954.log 2023-10-10T22:38:34.595 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131987.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131987.log.gz 2023-10-10T22:38:34.595 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94577.log 2023-10-10T22:38:34.595 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90954.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90954.log.gz 2023-10-10T22:38:34.596 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128794.log 2023-10-10T22:38:34.596 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94577.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94577.log.gz 2023-10-10T22:38:34.596 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139942.log 2023-10-10T22:38:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128794.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128794.log.gz 2023-10-10T22:38:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118853.log 2023-10-10T22:38:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139942.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139942.log.gz 2023-10-10T22:38:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-10T22:38:34.597 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118853.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118853.log.gz 2023-10-10T22:38:34.598 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130415.log 2023-10-10T22:38:34.598 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99927.log 2023-10-10T22:38:34.600 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130415.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130415.log.gz 2023-10-10T22:38:34.600 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131027.log 2023-10-10T22:38:34.600 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99927.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99927.log.gz 2023-10-10T22:38:34.600 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140105.log 2023-10-10T22:38:34.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131027.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.131027.log.gz 2023-10-10T22:38:34.601 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130205.log 2023-10-10T22:38:34.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140105.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140105.log.gz 2023-10-10T22:38:34.601 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140183.log 2023-10-10T22:38:34.603 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130205.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130205.log.gz 2023-10-10T22:38:34.603 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132034.log 2023-10-10T22:38:34.603 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140183.log: 88.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-10T22:38:34.603 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140183.log.gz 2023-10-10T22:38:34.603 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142672.log 2023-10-10T22:38:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.132034.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132034.log.gz 2023-10-10T22:38:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135879.log 2023-10-10T22:38:34.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142672.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142672.log.gz 2023-10-10T22:38:34.605 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108756.log 2023-10-10T22:38:34.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135879.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135879.log.gz 2023-10-10T22:38:34.605 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115604.log 2023-10-10T22:38:34.606 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108756.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108756.log.gz 2023-10-10T22:38:34.606 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111950.log 2023-10-10T22:38:34.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115604.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115604.log.gz 2023-10-10T22:38:34.607 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118169.log 2023-10-10T22:38:34.608 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114659.log 2023-10-10T22:38:34.608 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111950.log.gz 2023-10-10T22:38:34.609 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118169.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118169.log.gz 2023-10-10T22:38:34.609 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108943.log 2023-10-10T22:38:34.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114659.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114659.log.gz 2023-10-10T22:38:34.610 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116995.log 2023-10-10T22:38:34.611 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108943.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108943.log.gz 2023-10-10T22:38:34.611 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114227.log 2023-10-10T22:38:34.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116995.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116995.log.gz 2023-10-10T22:38:34.612 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96830.log 2023-10-10T22:38:34.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114227.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114227.log.gz 2023-10-10T22:38:34.613 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110639.log 2023-10-10T22:38:34.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119910.log 2023-10-10T22:38:34.614 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96830.log.gz 2023-10-10T22:38:34.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110639.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110639.log.gz 2023-10-10T22:38:34.615 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96872.log 2023-10-10T22:38:34.616 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119910.log.gz 2023-10-10T22:38:34.616 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105278.log 2023-10-10T22:38:34.617 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129253.log 2023-10-10T22:38:34.617 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.96872.log.gz 2023-10-10T22:38:34.618 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108365.log 2023-10-10T22:38:34.618 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105278.log.gz 2023-10-10T22:38:34.619 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129253.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129253.log.gz 2023-10-10T22:38:34.619 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139172.log 2023-10-10T22:38:34.620 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108365.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108365.log.gz 2023-10-10T22:38:34.620 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144022.log 2023-10-10T22:38:34.621 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139172.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139172.log.gz 2023-10-10T22:38:34.621 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133444.log 2023-10-10T22:38:34.622 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94199.log 2023-10-10T22:38:34.622 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144022.log.gz 2023-10-10T22:38:34.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.133444.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.133444.log.gz 2023-10-10T22:38:34.623 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90740.log 2023-10-10T22:38:34.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94199.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94199.log.gz 2023-10-10T22:38:34.624 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92886.log 2023-10-10T22:38:34.625 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90740.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90740.log.gz 2023-10-10T22:38:34.625 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95707.log 2023-10-10T22:38:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92886.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92886.log.gz 2023-10-10T22:38:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140857.log 2023-10-10T22:38:34.627 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95707.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95707.log.gz 2023-10-10T22:38:34.627 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134418.log 2023-10-10T22:38:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140857.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140857.log.gz 2023-10-10T22:38:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139858.log 2023-10-10T22:38:34.629 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134418.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134418.log.gz 2023-10-10T22:38:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120489.log 2023-10-10T22:38:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139858.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139858.log.gz 2023-10-10T22:38:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122315.log 2023-10-10T22:38:34.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120489.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120489.log.gz 2023-10-10T22:38:34.631 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114873.log 2023-10-10T22:38:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122315.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122315.log.gz 2023-10-10T22:38:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122665.log 2023-10-10T22:38:34.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114873.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114873.log.gz 2023-10-10T22:38:34.634 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135778.log 2023-10-10T22:38:34.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122665.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122665.log.gz 2023-10-10T22:38:34.635 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142858.log 2023-10-10T22:38:34.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135778.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135778.log.gz 2023-10-10T22:38:34.636 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98509.log 2023-10-10T22:38:34.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98122.log 2023-10-10T22:38:34.637 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142858.log.gz 2023-10-10T22:38:34.638 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140563.log 2023-10-10T22:38:34.638 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98509.log.gz 2023-10-10T22:38:34.639 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111262.log 2023-10-10T22:38:34.639 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98122.log.gz 2023-10-10T22:38:34.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134669.log 2023-10-10T22:38:34.640 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140563.log.gz 2023-10-10T22:38:34.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111262.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111262.log.gz 2023-10-10T22:38:34.641 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121835.log 2023-10-10T22:38:34.643 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134669.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134669.log.gz 2023-10-10T22:38:34.643 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139900.log 2023-10-10T22:38:34.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121835.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121835.log.gz 2023-10-10T22:38:34.644 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112839.log 2023-10-10T22:38:34.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139900.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139900.log.gz 2023-10-10T22:38:34.648 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114185.log 2023-10-10T22:38:34.648 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.112839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112839.log.gz 2023-10-10T22:38:34.649 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97131.log 2023-10-10T22:38:34.649 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114185.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114185.log.gz 2023-10-10T22:38:34.649 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144167.log 2023-10-10T22:38:34.650 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.97131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97131.log.gz 2023-10-10T22:38:34.650 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103901.log 2023-10-10T22:38:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144167.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.144167.log.gz 2023-10-10T22:38:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107526.log 2023-10-10T22:38:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103901.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103901.log.gz 2023-10-10T22:38:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144064.log 2023-10-10T22:38:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107526.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107526.log.gz 2023-10-10T22:38:34.654 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140605.log 2023-10-10T22:38:34.654 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144064.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144064.log.gz 2023-10-10T22:38:34.654 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108553.log 2023-10-10T22:38:34.654 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140605.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140605.log.gz 2023-10-10T22:38:34.654 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128447.log 2023-10-10T22:38:34.656 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108553.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108553.log.gz 2023-10-10T22:38:34.657 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109533.log 2023-10-10T22:38:34.657 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128447.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128447.log.gz 2023-10-10T22:38:34.657 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103797.log 2023-10-10T22:38:34.658 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109533.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109533.log.gz 2023-10-10T22:38:34.658 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143686.log 2023-10-10T22:38:34.658 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103797.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103797.log.gz 2023-10-10T22:38:34.659 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91038.log 2023-10-10T22:38:34.664 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143686.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143686.log.gz 2023-10-10T22:38:34.664 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98423.log 2023-10-10T22:38:34.665 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91038.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91038.log.gz 2023-10-10T22:38:34.665 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103755.log 2023-10-10T22:38:34.666 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98423.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98423.log.gz 2023-10-10T22:38:34.666 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99695.log 2023-10-10T22:38:34.666 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103755.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103755.log.gz 2023-10-10T22:38:34.667 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140477.log 2023-10-10T22:38:34.667 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99695.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99695.log.gz 2023-10-10T22:38:34.667 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120783.log 2023-10-10T22:38:34.667 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140477.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140477.log.gz 2023-10-10T22:38:34.667 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134527.log 2023-10-10T22:38:34.668 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120783.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.120783.log.gz 2023-10-10T22:38:34.668 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105372.log 2023-10-10T22:38:34.670 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134527.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134527.log.gz 2023-10-10T22:38:34.670 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115842.log 2023-10-10T22:38:34.671 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105372.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105372.log.gz 2023-10-10T22:38:34.671 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116896.log 2023-10-10T22:38:34.671 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115842.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115842.log.gz 2023-10-10T22:38:34.671 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130847.log 2023-10-10T22:38:34.671 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116896.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116896.log.gz 2023-10-10T22:38:34.672 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114269.log 2023-10-10T22:38:34.672 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130847.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.130847.log.gz-5 2023-10-10T22:38:34.672 INFO:teuthology.orchestra.run.smithi154.stderr:--verbose -- /var/log/ceph/ceph-client.admin.143349.log 2023-10-10T22:38:34.672 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114269.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114269.log.gz 2023-10-10T22:38:34.672 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129868.log 2023-10-10T22:38:34.674 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143349.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143349.log.gz 2023-10-10T22:38:34.674 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108798.log 2023-10-10T22:38:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129868.log: gzip 89.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.129868.log.gz 2023-10-10T22:38:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:--verbose -- /var/log/ceph/ceph-client.admin.140307.log 2023-10-10T22:38:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108798.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108798.log.gz 2023-10-10T22:38:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94409.log 2023-10-10T22:38:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140307.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140307.log.gz 2023-10-10T22:38:34.677 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128061.log 2023-10-10T22:38:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94409.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94409.log.gz 2023-10-10T22:38:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91541.log 2023-10-10T22:38:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128061.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128061.log.gz 2023-10-10T22:38:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114353.log 2023-10-10T22:38:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91541.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91541.log.gz 2023-10-10T22:38:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118339.log 2023-10-10T22:38:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114353.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114353.log.gz 2023-10-10T22:38:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109575.log 2023-10-10T22:38:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118339.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118339.log.gz 2023-10-10T22:38:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135026.log 2023-10-10T22:38:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109575.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109575.log.gz 2023-10-10T22:38:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102833.log 2023-10-10T22:38:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135026.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135026.log.gz 2023-10-10T22:38:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110025.log 2023-10-10T22:38:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102833.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102833.log.gz 2023-10-10T22:38:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117288.log 2023-10-10T22:38:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110025.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110025.log.gz 2023-10-10T22:38:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120615.log 2023-10-10T22:38:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117288.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117288.log.gz 2023-10-10T22:38:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94493.log 2023-10-10T22:38:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120615.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120615.log.gz 2023-10-10T22:38:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127797.log 2023-10-10T22:38:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94493.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94493.log.gz 2023-10-10T22:38:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-10T22:38:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127797.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127797.log.gz 2023-10-10T22:38:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143434.log 2023-10-10T22:38:34.703 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94703.log 2023-10-10T22:38:34.703 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143434.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143434.log.gz 2023-10-10T22:38:34.703 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115997.log 2023-10-10T22:38:34.704 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94703.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94703.log.gz 2023-10-10T22:38:34.704 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119956.log 2023-10-10T22:38:34.704 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115997.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115997.log.gz 2023-10-10T22:38:34.704 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96351.log 2023-10-10T22:38:34.704 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-10T22:38:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119956.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119956.log.gz 2023-10-10T22:38:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117041.log 2023-10-10T22:38:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96351.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96351.log.gz 2023-10-10T22:38:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114143.log 2023-10-10T22:38:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117041.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117041.log.gz 2023-10-10T22:38:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121666.log 2023-10-10T22:38:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114143.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114143.log.gz 2023-10-10T22:38:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109365.log 2023-10-10T22:38:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121666.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121666.log.gz 2023-10-10T22:38:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127486.log 2023-10-10T22:38:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109365.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109365.log.gz 2023-10-10T22:38:34.707 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126847.log 2023-10-10T22:38:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127486.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127486.log.gz 2023-10-10T22:38:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104831.log 2023-10-10T22:38:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126847.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126847.log.gz 2023-10-10T22:38:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113587.log 2023-10-10T22:38:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104831.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104831.log.gz 2023-10-10T22:38:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97827.log 2023-10-10T22:38:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113587.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113587.log.gz 2023-10-10T22:38:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107712.log 2023-10-10T22:38:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97827.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97827.log.gz 2023-10-10T22:38:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119865.log 2023-10-10T22:38:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107712.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107712.log.gz 2023-10-10T22:38:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112646.log 2023-10-10T22:38:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119865.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119865.log.gz 2023-10-10T22:38:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116452.log 2023-10-10T22:38:34.713 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112646.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112646.log.gz 2023-10-10T22:38:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108055.log 2023-10-10T22:38:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116452.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116452.log.gz 2023-10-10T22:38:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115797.log 2023-10-10T22:38:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108055.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108055.log.gz 2023-10-10T22:38:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136496.log 2023-10-10T22:38:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.115797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115797.log.gz 2023-10-10T22:38:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140433.log 2023-10-10T22:38:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136496.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136496.log.gz 2023-10-10T22:38:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96043.log 2023-10-10T22:38:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140433.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140433.log.gz 2023-10-10T22:38:34.715 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139401.log 2023-10-10T22:38:34.718 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96043.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96043.log.gz 2023-10-10T22:38:34.718 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130289.log 2023-10-10T22:38:34.718 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139401.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139401.log.gz 2023-10-10T22:38:34.718 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134795.log 2023-10-10T22:38:34.719 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100951.log 2023-10-10T22:38:34.719 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.130289.log.gz 2023-10-10T22:38:34.719 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134795.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134795.log.gz 2023-10-10T22:38:34.719 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92218.log 2023-10-10T22:38:34.719 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100951.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100951.log.gz 2023-10-10T22:38:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141152.log 2023-10-10T22:38:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92218.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92218.log.gz 2023-10-10T22:38:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95547.log 2023-10-10T22:38:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139774.log 2023-10-10T22:38:34.720 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.141152.log.gz 2023-10-10T22:38:34.722 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95547.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95547.log.gz 2023-10-10T22:38:34.722 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96085.log 2023-10-10T22:38:34.722 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139774.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139774.log.gz 2023-10-10T22:38:34.723 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99201.log 2023-10-10T22:38:34.723 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96085.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96085.log.gz 2023-10-10T22:38:34.723 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141456.log 2023-10-10T22:38:34.723 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99201.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99201.log.gz 2023-10-10T22:38:34.723 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113770.log 2023-10-10T22:38:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141456.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141456.log.gz 2023-10-10T22:38:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140815.log 2023-10-10T22:38:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113770.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113770.log.gz 2023-10-10T22:38:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101951.log 2023-10-10T22:38:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140815.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140815.log.gz 2023-10-10T22:38:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126473.log 2023-10-10T22:38:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101951.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.101951.log.gz 2023-10-10T22:38:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91547.log 2023-10-10T22:38:34.727 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126473.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126473.log.gz 2023-10-10T22:38:34.727 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92592.log 2023-10-10T22:38:34.728 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97135.log 2023-10-10T22:38:34.728 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91547.log.gz 2023-10-10T22:38:34.729 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92592.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92592.log.gz 2023-10-10T22:38:34.729 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94619.log 2023-10-10T22:38:34.729 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.97135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97135.log.gz 2023-10-10T22:38:34.730 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96938.log 2023-10-10T22:38:34.731 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94619.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94619.log.gz 2023-10-10T22:38:34.731 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97218.log 2023-10-10T22:38:34.732 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96938.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96938.log.gz 2023-10-10T22:38:34.732 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116042.log 2023-10-10T22:38:34.733 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97218.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97218.log.gz 2023-10-10T22:38:34.733 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-10T22:38:34.733 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116042.log: gzip -5 --verbose 89.1%-- /var/log/ceph/ceph-client.admin.132891.log -- replaced with /var/log/ceph/ceph-client.admin.116042.log.gz 2023-10-10T22:38:34.734 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:34.734 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91542.log 2023-10-10T22:38:34.735 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.132891.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.132891.log.gz 2023-10-10T22:38:34.736 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114395.log 2023-10-10T22:38:34.737 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91542.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91542.log.gz 2023-10-10T22:38:34.737 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109155.log 2023-10-10T22:38:34.738 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114395.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114395.log.gz 2023-10-10T22:38:34.738 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135442.log 2023-10-10T22:38:34.739 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109155.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109155.log.gz 2023-10-10T22:38:34.739 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140773.log 2023-10-10T22:38:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135442.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135442.log.gz 2023-10-10T22:38:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141673.log 2023-10-10T22:38:34.741 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140773.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140773.log.gz 2023-10-10T22:38:34.742 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107902.log 2023-10-10T22:38:34.742 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141673.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.141673.log.gz 2023-10-10T22:38:34.743 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121217.log 2023-10-10T22:38:34.743 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107902.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107902.log.gz 2023-10-10T22:38:34.744 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92634.log 2023-10-10T22:38:34.745 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121217.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121217.log.gz 2023-10-10T22:38:34.745 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104145.log 2023-10-10T22:38:34.746 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92634.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92634.log.gz 2023-10-10T22:38:34.746 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141898.log 2023-10-10T22:38:34.747 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104145.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104145.log.gz 2023-10-10T22:38:34.747 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120239.log 2023-10-10T22:38:34.748 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104273.log 2023-10-10T22:38:34.748 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141898.log.gz 2023-10-10T22:38:34.749 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120239.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120239.log.gz 2023-10-10T22:38:34.749 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103380.log 2023-10-10T22:38:34.751 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104273.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104273.log.gz 2023-10-10T22:38:34.751 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95043.log 2023-10-10T22:38:34.752 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103380.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103380.log.gz 2023-10-10T22:38:34.752 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96001.log 2023-10-10T22:38:34.753 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95043.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95043.log.gz 2023-10-10T22:38:34.753 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92466.log 2023-10-10T22:38:34.754 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96001.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96001.log.gz 2023-10-10T22:38:34.754 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91374.log 2023-10-10T22:38:34.755 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92466.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92466.log.gz 2023-10-10T22:38:34.755 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104367.log 2023-10-10T22:38:34.756 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91374.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91374.log.gz 2023-10-10T22:38:34.756 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104103.log 2023-10-10T22:38:34.757 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104367.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104367.log.gz 2023-10-10T22:38:34.758 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97945.log 2023-10-10T22:38:34.759 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104103.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104103.log.gz 2023-10-10T22:38:34.759 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139500.log 2023-10-10T22:38:34.760 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97945.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97945.log.gz 2023-10-10T22:38:34.760 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131449.log 2023-10-10T22:38:34.761 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139500.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139500.log.gz 2023-10-10T22:38:34.761 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95463.log 2023-10-10T22:38:34.762 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131449.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131449.log.gz 2023-10-10T22:38:34.762 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109071.log 2023-10-10T22:38:34.763 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95463.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95463.log.gz 2023-10-10T22:38:34.763 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138957.log 2023-10-10T22:38:34.764 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109071.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109071.log.gz 2023-10-10T22:38:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134184.log 2023-10-10T22:38:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138957.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.138957.log.gz 2023-10-10T22:38:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134276.log 2023-10-10T22:38:34.767 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134184.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134184.log.gz 2023-10-10T22:38:34.767 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95505.log 2023-10-10T22:38:34.768 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134276.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134276.log.gz 2023-10-10T22:38:34.768 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135354.log 2023-10-10T22:38:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95505.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95505.log.gz 2023-10-10T22:38:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91080.log 2023-10-10T22:38:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135354.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135354.log.gz 2023-10-10T22:38:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96215.log 2023-10-10T22:38:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91080.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91080.log.gz 2023-10-10T22:38:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143223.log 2023-10-10T22:38:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96215.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96215.log.gz 2023-10-10T22:38:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116761.log 2023-10-10T22:38:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143223.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143223.log.gz 2023-10-10T22:38:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120096.log 2023-10-10T22:38:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116761.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116761.log.gz 2023-10-10T22:38:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108987.log 2023-10-10T22:38:34.776 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120096.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120096.log.gz 2023-10-10T22:38:34.776 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95169.log 2023-10-10T22:38:34.777 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108987.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108987.log.gz 2023-10-10T22:38:34.777 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112286.log 2023-10-10T22:38:34.778 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95169.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95169.log.gz 2023-10-10T22:38:34.779 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95295.log 2023-10-10T22:38:34.780 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112286.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112286.log.gz 2023-10-10T22:38:34.780 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136557.log 2023-10-10T22:38:34.781 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95295.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95295.log.gz 2023-10-10T22:38:34.781 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128145.log 2023-10-10T22:38:34.782 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136557.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136557.log.gz 2023-10-10T22:38:34.782 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135694.log 2023-10-10T22:38:34.783 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128145.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128145.log.gz 2023-10-10T22:38:34.783 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118766.log 2023-10-10T22:38:34.784 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135694.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135694.log.gz 2023-10-10T22:38:34.784 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121278.log 2023-10-10T22:38:34.785 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.118766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118766.log.gz 2023-10-10T22:38:34.785 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93588.log 2023-10-10T22:38:34.787 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121278.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121278.log.gz 2023-10-10T22:38:34.787 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141552.log 2023-10-10T22:38:34.787 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.93588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93588.log.gz 2023-10-10T22:38:34.788 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92216.log 2023-10-10T22:38:34.789 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141552.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141552.log.gz 2023-10-10T22:38:34.789 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112034.log 2023-10-10T22:38:34.790 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92216.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92216.log.gz 2023-10-10T22:38:34.790 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104451.log 2023-10-10T22:38:34.791 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112034.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112034.log.gz 2023-10-10T22:38:34.791 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92128.log 2023-10-10T22:38:34.792 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104451.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104451.log.gz 2023-10-10T22:38:34.792 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105494.log 2023-10-10T22:38:34.793 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92128.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92128.log.gz 2023-10-10T22:38:34.794 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141411.log 2023-10-10T22:38:34.795 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105494.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.105494.log.gz 2023-10-10T22:38:34.795 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128906.log 2023-10-10T22:38:34.796 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.141411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.141411.log.gz 2023-10-10T22:38:34.796 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127694.log 2023-10-10T22:38:34.797 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128906.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128906.log.gz 2023-10-10T22:38:34.798 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128103.log 2023-10-10T22:38:34.798 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127694.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127694.log.gz 2023-10-10T22:38:34.799 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99637.log 2023-10-10T22:38:34.800 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128103.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128103.log.gz 2023-10-10T22:38:34.800 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126428.log 2023-10-10T22:38:34.801 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99637.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99637.log.gz 2023-10-10T22:38:34.801 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115538.log 2023-10-10T22:38:34.802 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126428.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126428.log.gz 2023-10-10T22:38:34.802 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114701.log 2023-10-10T22:38:34.803 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143068.log 2023-10-10T22:38:34.803 INFO:teuthology.orchestra.run.smithi154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.115538.log.gz 2023-10-10T22:38:34.804 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114701.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114701.log.gz 2023-10-10T22:38:34.804 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113825.log 2023-10-10T22:38:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143068.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143068.log.gz 2023-10-10T22:38:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130805.log 2023-10-10T22:38:34.806 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113825.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113825.log.gz 2023-10-10T22:38:34.807 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109197.log 2023-10-10T22:38:34.807 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130805.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130805.log.gz 2023-10-10T22:38:34.808 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131407.log 2023-10-10T22:38:34.809 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109197.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109197.log.gz 2023-10-10T22:38:34.809 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115143.log 2023-10-10T22:38:34.810 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131407.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131407.log.gz 2023-10-10T22:38:34.810 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102897.log 2023-10-10T22:38:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115143.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115143.log.gz 2023-10-10T22:38:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103587.log 2023-10-10T22:38:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102897.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102897.log.gz 2023-10-10T22:38:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139266.log 2023-10-10T22:38:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103587.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103587.log.gz 2023-10-10T22:38:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136887.log 2023-10-10T22:38:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139266.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139266.log.gz 2023-10-10T22:38:34.815 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118085.log 2023-10-10T22:38:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136887.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136887.log.gz 2023-10-10T22:38:34.816 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-10T22:38:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110138.log 2023-10-10T22:38:34.817 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118085.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118085.log.gz 2023-10-10T22:38:34.817 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121919.log 2023-10-10T22:38:34.818 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110138.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110138.log.gz 2023-10-10T22:38:34.819 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113635.log 2023-10-10T22:38:34.820 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144249.log 2023-10-10T22:38:34.820 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.121919.log.gz 2023-10-10T22:38:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113635.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113635.log.gz 2023-10-10T22:38:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134921.log 2023-10-10T22:38:34.822 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144249.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144249.log.gz 2023-10-10T22:38:34.822 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92970.log 2023-10-10T22:38:34.823 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134921.log: 88.9%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.134921.log.gz--verbose 2023-10-10T22:38:34.823 INFO:teuthology.orchestra.run.smithi154.stderr:-- /var/log/ceph/ceph-client.admin.143560.log 2023-10-10T22:38:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92970.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92970.log.gz 2023-10-10T22:38:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115454.log 2023-10-10T22:38:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143560.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143560.log.gz 2023-10-10T22:38:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142384.log 2023-10-10T22:38:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115454.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115454.log.gz 2023-10-10T22:38:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111388.log 2023-10-10T22:38:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142384.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142384.log.gz 2023-10-10T22:38:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126257.log 2023-10-10T22:38:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111388.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111388.log.gz 2023-10-10T22:38:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129913.log 2023-10-10T22:38:34.829 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126257.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.126257.log.gz 2023-10-10T22:38:34.829 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95337.log 2023-10-10T22:38:34.830 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129913.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129913.log.gz 2023-10-10T22:38:34.830 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121131.log 2023-10-10T22:38:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95337.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95337.log.gz 2023-10-10T22:38:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92220.log 2023-10-10T22:38:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121131.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121131.log.gz 2023-10-10T22:38:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130679.log 2023-10-10T22:38:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92220.log: gzip -5 88.8%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.92220.log.gz/var/log/ceph/ceph-client.admin.110593.log 2023-10-10T22:38:34.833 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130679.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130679.log.gz 2023-10-10T22:38:34.834 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143518.log 2023-10-10T22:38:34.834 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110593.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110593.log.gz 2023-10-10T22:38:34.835 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111534.log 2023-10-10T22:38:34.835 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143518.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143518.log.gz 2023-10-10T22:38:34.836 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90330.log 2023-10-10T22:38:34.836 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111534.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111534.log.gz 2023-10-10T22:38:34.837 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128229.log 2023-10-10T22:38:34.837 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90330.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90330.log.gz 2023-10-10T22:38:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132129.log 2023-10-10T22:38:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128229.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.128229.log.gz 2023-10-10T22:38:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99285.log 2023-10-10T22:38:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.132129.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.132129.log.gz 2023-10-10T22:38:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136013.log 2023-10-10T22:38:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99285.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99285.log.gz 2023-10-10T22:38:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117697.log 2023-10-10T22:38:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136013.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136013.log.gz 2023-10-10T22:38:34.842 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110501.log 2023-10-10T22:38:34.842 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117697.log.gz 2023-10-10T22:38:34.843 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91534.log 2023-10-10T22:38:34.843 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110501.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110501.log.gz 2023-10-10T22:38:34.844 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117372.log 2023-10-10T22:38:34.844 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91534.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91534.log.gz 2023-10-10T22:38:34.845 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142527.log 2023-10-10T22:38:34.845 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117372.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117372.log.gz 2023-10-10T22:38:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99579.log 2023-10-10T22:38:34.846 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142527.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142527.log.gz 2023-10-10T22:38:34.847 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112328.log 2023-10-10T22:38:34.847 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99579.log: gzip -5 --verbose 88.4%-- /var/log/ceph/ceph-client.admin.112580.log -- replaced with /var/log/ceph/ceph-client.admin.99579.log.gz 2023-10-10T22:38:34.848 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:34.848 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112328.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112328.log.gz 2023-10-10T22:38:34.849 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143476.log 2023-10-10T22:38:34.850 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112580.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.112580.log.gz 2023-10-10T22:38:34.850 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94661.log 2023-10-10T22:38:34.851 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143476.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143476.log.gz 2023-10-10T22:38:34.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120347.log 2023-10-10T22:38:34.852 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94661.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94661.log.gz 2023-10-10T22:38:34.852 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112412.log 2023-10-10T22:38:34.853 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120347.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.120347.log.gz 2023-10-10T22:38:34.853 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110992.log 2023-10-10T22:38:34.854 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112412.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112412.log.gz 2023-10-10T22:38:34.854 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91290.log 2023-10-10T22:38:34.855 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110992.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110992.log.gz 2023-10-10T22:38:34.855 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104409.log 2023-10-10T22:38:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91290.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91290.log.gz 2023-10-10T22:38:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119605.log 2023-10-10T22:38:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104409.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104409.log.gz 2023-10-10T22:38:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116853.log 2023-10-10T22:38:34.858 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119605.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119605.log.gzgzip 2023-10-10T22:38:34.858 INFO:teuthology.orchestra.run.smithi154.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.100159.log 2023-10-10T22:38:34.859 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116853.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116853.log.gz 2023-10-10T22:38:34.859 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114965.log 2023-10-10T22:38:34.860 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100159.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100159.log.gz 2023-10-10T22:38:34.860 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91530.log 2023-10-10T22:38:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114965.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114965.log.gz 2023-10-10T22:38:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126659.log 2023-10-10T22:38:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91530.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91530.log.gz 2023-10-10T22:38:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142626.log 2023-10-10T22:38:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126659.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126659.log.gz 2023-10-10T22:38:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91549.log 2023-10-10T22:38:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142626.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142626.log.gz 2023-10-10T22:38:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141110.log 2023-10-10T22:38:34.865 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91549.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91549.log.gz 2023-10-10T22:38:34.865 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96746.log 2023-10-10T22:38:34.866 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141110.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141110.log.gz 2023-10-10T22:38:34.866 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135228.log 2023-10-10T22:38:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96746.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96746.log.gz 2023-10-10T22:38:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134879.log 2023-10-10T22:38:34.868 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135228.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135228.log.gz 2023-10-10T22:38:34.868 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131323.log 2023-10-10T22:38:34.869 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134879.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134879.log.gz 2023-10-10T22:38:34.869 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135526.log 2023-10-10T22:38:34.870 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125303.log 2023-10-10T22:38:34.870 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131323.log.gz 2023-10-10T22:38:34.871 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135526.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135526.log.gz 2023-10-10T22:38:34.871 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115946.log 2023-10-10T22:38:34.872 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125303.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125303.log.gz 2023-10-10T22:38:34.872 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118770.log 2023-10-10T22:38:34.873 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115946.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115946.log.gz 2023-10-10T22:38:34.873 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116622.log 2023-10-10T22:38:34.874 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.118770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118770.log.gz 2023-10-10T22:38:34.874 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139732.log 2023-10-10T22:38:34.874 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116622.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116622.log.gz 2023-10-10T22:38:34.875 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-10T22:38:34.876 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139732.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139732.log.gz 2023-10-10T22:38:34.876 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121792.log 2023-10-10T22:38:34.877 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127220.log 2023-10-10T22:38:34.878 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121792.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121792.log.gz 2023-10-10T22:38:34.878 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113085.log 2023-10-10T22:38:34.879 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117104.log 2023-10-10T22:38:34.879 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127220.log.gz 2023-10-10T22:38:34.880 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113085.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113085.log.gz 2023-10-10T22:38:34.880 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136163.log 2023-10-10T22:38:34.881 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117104.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117104.log.gz 2023-10-10T22:38:34.881 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127178.log 2023-10-10T22:38:34.882 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136163.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136163.log.gz 2023-10-10T22:38:34.882 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97331.log 2023-10-10T22:38:34.883 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127178.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127178.log.gz 2023-10-10T22:38:34.884 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110076.log 2023-10-10T22:38:34.885 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97331.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97331.log.gz 2023-10-10T22:38:34.885 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111862.log 2023-10-10T22:38:34.886 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110076.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110076.log.gz 2023-10-10T22:38:34.886 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-10T22:38:34.887 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111862.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111862.log.gz 2023-10-10T22:38:34.887 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117414.log 2023-10-10T22:38:34.888 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128838.log 2023-10-10T22:38:34.889 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117414.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117414.log.gz 2023-10-10T22:38:34.889 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111694.log 2023-10-10T22:38:34.890 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128838.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128838.log.gz 2023-10-10T22:38:34.891 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141068.log 2023-10-10T22:38:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111694.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111694.log.gz 2023-10-10T22:38:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141498.log 2023-10-10T22:38:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141068.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141068.log.gz 2023-10-10T22:38:34.894 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102942.log 2023-10-10T22:38:34.895 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141498.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141498.log.gz 2023-10-10T22:38:34.895 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128271.log 2023-10-10T22:38:34.896 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102942.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102942.log.gz 2023-10-10T22:38:34.897 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112843.log 2023-10-10T22:38:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128271.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128271.log.gz 2023-10-10T22:38:34.898 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107757.log 2023-10-10T22:38:34.899 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.112843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112843.log.gz 2023-10-10T22:38:34.900 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91884.log 2023-10-10T22:38:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107757.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107757.log.gz 2023-10-10T22:38:34.901 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117330.log 2023-10-10T22:38:34.907 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91884.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91884.log.gz 2023-10-10T22:38:34.907 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109963.log 2023-10-10T22:38:34.907 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117330.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117330.log.gz 2023-10-10T22:38:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104187.log 2023-10-10T22:38:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109963.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109963.log.gz 2023-10-10T22:38:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131921.log 2023-10-10T22:38:34.908 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104187.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104187.log.gz 2023-10-10T22:38:34.909 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127841.log 2023-10-10T22:38:34.909 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131921.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131921.log.gz 2023-10-10T22:38:34.910 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97409.log 2023-10-10T22:38:34.910 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127841.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127841.log.gz 2023-10-10T22:38:34.910 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105763.log 2023-10-10T22:38:34.911 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97409.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97409.log.gz 2023-10-10T22:38:34.912 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135270.log 2023-10-10T22:38:34.913 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111472.log 2023-10-10T22:38:34.913 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105763.log.gz 2023-10-10T22:38:34.914 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135270.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135270.log.gz 2023-10-10T22:38:34.915 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129706.log 2023-10-10T22:38:34.915 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111472.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111472.log.gz 2023-10-10T22:38:34.916 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125261.log 2023-10-10T22:38:34.917 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129706.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129706.log.gz 2023-10-10T22:38:34.918 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122223.log 2023-10-10T22:38:34.918 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125261.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125261.log.gz 2023-10-10T22:38:34.919 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109491.log 2023-10-10T22:38:34.920 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126801.log 2023-10-10T22:38:34.921 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122223.log.gz 2023-10-10T22:38:34.921 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109491.log.gz 2023-10-10T22:38:34.922 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90782.log 2023-10-10T22:38:34.923 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126801.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126801.log.gz 2023-10-10T22:38:34.923 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116367.log 2023-10-10T22:38:34.924 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90782.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90782.log.gz 2023-10-10T22:38:34.925 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108840.log 2023-10-10T22:38:34.926 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116367.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116367.log.gz 2023-10-10T22:38:34.927 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134373.log 2023-10-10T22:38:34.927 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108840.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108840.log.gz 2023-10-10T22:38:34.928 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128753.log 2023-10-10T22:38:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134373.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134373.log.gz 2023-10-10T22:38:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92676.log 2023-10-10T22:38:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.128753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.128753.log.gz 2023-10-10T22:38:34.931 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103081.log 2023-10-10T22:38:34.932 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92676.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.92676.log.gz 2023-10-10T22:38:34.932 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134136.log 2023-10-10T22:38:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103081.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103081.log.gz 2023-10-10T22:38:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107664.log 2023-10-10T22:38:34.935 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134136.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134136.log.gz 2023-10-10T22:38:34.936 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141025.log 2023-10-10T22:38:34.936 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107664.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107664.log.gz 2023-10-10T22:38:34.937 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129958.log 2023-10-10T22:38:34.938 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141025.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141025.log.gz 2023-10-10T22:38:34.939 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136402.log 2023-10-10T22:38:34.940 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113449.log 2023-10-10T22:38:34.940 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.129958.log.gz 2023-10-10T22:38:34.941 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136402.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136402.log.gz 2023-10-10T22:38:34.941 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121047.log 2023-10-10T22:38:34.942 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113449.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113449.log.gz 2023-10-10T22:38:34.942 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96307.log 2023-10-10T22:38:34.943 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121047.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121047.log.gz 2023-10-10T22:38:34.944 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-10T22:38:34.945 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96307.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96307.log.gz 2023-10-10T22:38:34.945 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130763.log 2023-10-10T22:38:34.947 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130247.log 2023-10-10T22:38:34.948 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130763.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130763.log.gz 2023-10-10T22:38:34.949 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94829.log 2023-10-10T22:38:34.950 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130247.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130247.log.gz 2023-10-10T22:38:34.950 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115328.log 2023-10-10T22:38:34.952 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94829.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94829.log.gz 2023-10-10T22:38:34.952 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95959.log 2023-10-10T22:38:34.954 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115328.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115328.log.gz 2023-10-10T22:38:34.954 INFO:teuthology.orchestra.run.smithi154.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.135186.log 2023-10-10T22:38:34.955 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95959.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95959.log.gz 2023-10-10T22:38:34.955 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135398.log 2023-10-10T22:38:34.957 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135186.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135186.log.gz 2023-10-10T22:38:34.957 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121750.log 2023-10-10T22:38:34.959 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135398.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135398.log.gz 2023-10-10T22:38:34.959 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142245.log 2023-10-10T22:38:34.960 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121750.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121750.log.gz 2023-10-10T22:38:34.960 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114535.log 2023-10-10T22:38:34.962 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142245.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142245.log.gz 2023-10-10T22:38:34.962 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96536.log 2023-10-10T22:38:34.963 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114535.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114535.log.gz 2023-10-10T22:38:34.964 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93643.log 2023-10-10T22:38:34.965 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96536.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96536.log.gz 2023-10-10T22:38:34.965 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105433.log 2023-10-10T22:38:34.966 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.93643.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.93643.log.gz 2023-10-10T22:38:34.967 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103979.log 2023-10-10T22:38:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105433.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105433.log.gz 2023-10-10T22:38:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99327.log 2023-10-10T22:38:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103979.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103979.log.gz 2023-10-10T22:38:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91206.log 2023-10-10T22:38:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99327.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99327.log.gz 2023-10-10T22:38:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116667.log 2023-10-10T22:38:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91206.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91206.log.gz 2023-10-10T22:38:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121370.log 2023-10-10T22:38:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116667.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126567.log 2023-10-10T22:38:34.975 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.116667.log.gz 2023-10-10T22:38:34.976 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121370.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121370.log.gz 2023-10-10T22:38:34.976 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103036.log 2023-10-10T22:38:34.977 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126567.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126567.log.gz 2023-10-10T22:38:34.978 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104663.log 2023-10-10T22:38:34.979 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103036.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103036.log.gz 2023-10-10T22:38:34.980 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96788.log 2023-10-10T22:38:34.981 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104663.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104663.log.gz 2023-10-10T22:38:34.981 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127891.log 2023-10-10T22:38:34.982 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96788.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96788.log.gz 2023-10-10T22:38:34.983 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99753.log 2023-10-10T22:38:34.984 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127891.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127891.log.gz 2023-10-10T22:38:34.984 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91883.log 2023-10-10T22:38:34.986 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99753.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99753.log.gz 2023-10-10T22:38:34.986 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130022.log 2023-10-10T22:38:34.988 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91883.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91883.log.gz 2023-10-10T22:38:34.988 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105023.log 2023-10-10T22:38:34.989 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130022.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130022.log.gz 2023-10-10T22:38:34.990 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135312.log 2023-10-10T22:38:34.992 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105023.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105023.log.gz 2023-10-10T22:38:34.992 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139218.log 2023-10-10T22:38:34.993 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135312.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135312.log.gz 2023-10-10T22:38:34.994 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139456.log 2023-10-10T22:38:34.995 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139218.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139218.log.gz 2023-10-10T22:38:34.995 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91876.log 2023-10-10T22:38:34.996 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139456.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139456.log.gz 2023-10-10T22:38:34.997 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112118.log 2023-10-10T22:38:34.998 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91876.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91876.log.gz 2023-10-10T22:38:34.998 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109876.log 2023-10-10T22:38:35.000 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112118.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111037.log 2023-10-10T22:38:35.000 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112118.log.gz 2023-10-10T22:38:35.001 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.109876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109876.log.gz 2023-10-10T22:38:35.001 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112496.log 2023-10-10T22:38:35.002 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111037.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111037.log.gz 2023-10-10T22:38:35.003 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96494.log 2023-10-10T22:38:35.004 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112496.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112496.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112076.log 2023-10-10T22:38:35.005 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96494.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96494.log.gz 2023-10-10T22:38:35.007 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136444.log 2023-10-10T22:38:35.007 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112076.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112076.log.gz 2023-10-10T22:38:35.008 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110548.log 2023-10-10T22:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136444.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136444.log.gz 2023-10-10T22:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120531.log 2023-10-10T22:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110548.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110548.log.gz 2023-10-10T22:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115801.log 2023-10-10T22:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120531.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120531.log.gz 2023-10-10T22:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102709.log 2023-10-10T22:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.115801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115801.log.gz 2023-10-10T22:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114457.log 2023-10-10T22:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102709.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102709.log.gz 2023-10-10T22:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92550.log 2023-10-10T22:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114457.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114457.log.gz 2023-10-10T22:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109921.log 2023-10-10T22:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92550.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92550.log.gz 2023-10-10T22:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92760.log 2023-10-10T22:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109921.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109921.log.gz 2023-10-10T22:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97709.log 2023-10-10T22:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92760.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92760.log.gz 2023-10-10T22:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128187.log 2023-10-10T22:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97709.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97709.log.gz 2023-10-10T22:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142437.log 2023-10-10T22:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128187.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128187.log.gz 2023-10-10T22:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108197.log 2023-10-10T22:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142437.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142437.log.gz 2023-10-10T22:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104317.log 2023-10-10T22:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108197.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108197.log.gz 2023-10-10T22:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134229.log 2023-10-10T22:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104317.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104317.log.gz 2023-10-10T22:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107573.log 2023-10-10T22:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134229.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134229.log.gz 2023-10-10T22:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140349.log 2023-10-10T22:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107573.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107573.log.gz 2023-10-10T22:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142290.log 2023-10-10T22:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140349.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140349.log.gz 2023-10-10T22:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91885.log 2023-10-10T22:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142290.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142290.log.gz 2023-10-10T22:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130597.log 2023-10-10T22:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91885.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91885.log.gz 2023-10-10T22:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136844.log 2023-10-10T22:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130597.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.130597.log.gz 2023-10-10T22:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94787.log 2023-10-10T22:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136844.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136844.log.gz 2023-10-10T22:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122440.log 2023-10-10T22:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94787.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94787.log.gz 2023-10-10T22:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130721.log 2023-10-10T22:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122440.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122440.log.gz 2023-10-10T22:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138867.log 2023-10-10T22:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130721.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130721.log.gz 2023-10-10T22:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115185.log 2023-10-10T22:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138867.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138867.log.gz 2023-10-10T22:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117619.log 2023-10-10T22:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115185.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115185.log.gz 2023-10-10T22:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131533.log 2023-10-10T22:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117619.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117619.log.gz 2023-10-10T22:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96410.log 2023-10-10T22:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131533.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131533.log.gz 2023-10-10T22:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103671.log 2023-10-10T22:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96410.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96410.log.gz 2023-10-10T22:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126910.log 2023-10-10T22:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103671.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103671.log.gz 2023-10-10T22:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136360.log 2023-10-10T22:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126910.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126910.log.gz 2023-10-10T22:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98552.log 2023-10-10T22:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.136360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.136360.log.gz 2023-10-10T22:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105237.log 2023-10-10T22:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98552.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98552.log.gz 2023-10-10T22:38:35.062 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111778.log 2023-10-10T22:38:35.062 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.105237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105237.log.gz 2023-10-10T22:38:35.063 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142198.log 2023-10-10T22:38:35.065 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111778.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111778.log.gz 2023-10-10T22:38:35.065 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118381.log 2023-10-10T22:38:35.066 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142198.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142198.log.gz 2023-10-10T22:38:35.066 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144207.log 2023-10-10T22:38:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118381.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118381.log.gz 2023-10-10T22:38:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118213.log 2023-10-10T22:38:35.070 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144207.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144207.log.gz 2023-10-10T22:38:35.070 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133998.log 2023-10-10T22:38:35.071 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118213.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118213.log.gz 2023-10-10T22:38:35.071 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115496.log 2023-10-10T22:38:35.073 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.133998.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.133998.log.gz 2023-10-10T22:38:35.073 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121089.log 2023-10-10T22:38:35.075 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115496.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115496.log.gz 2023-10-10T22:38:35.075 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142942.log 2023-10-10T22:38:35.076 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121089.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121089.log.gz 2023-10-10T22:38:35.076 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94283.log 2023-10-10T22:38:35.078 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142942.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142942.log.gz 2023-10-10T22:38:35.078 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94745.log 2023-10-10T22:38:35.079 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94283.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94283.log.gz 2023-10-10T22:38:35.080 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99811.log 2023-10-10T22:38:35.081 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94745.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.94745.log.gz 2023-10-10T22:38:35.081 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116806.log 2023-10-10T22:38:35.082 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99811.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99811.log.gz 2023-10-10T22:38:35.082 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117778.log 2023-10-10T22:38:35.085 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116806.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116806.log.gz 2023-10-10T22:38:35.085 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144106.log 2023-10-10T22:38:35.085 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117778.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117778.log.gz 2023-10-10T22:38:35.086 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103173.log 2023-10-10T22:38:35.087 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144106.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144106.log.gz 2023-10-10T22:38:35.088 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129567.log 2023-10-10T22:38:35.089 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103173.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103173.log.gz 2023-10-10T22:38:35.089 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142984.log 2023-10-10T22:38:35.090 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129567.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129567.log.gz 2023-10-10T22:38:35.091 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112202.log 2023-10-10T22:38:35.093 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142984.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142984.log.gz 2023-10-10T22:38:35.093 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140899.log 2023-10-10T22:38:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112202.log.gz 2023-10-10T22:38:35.095 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118811.log 2023-10-10T22:38:35.095 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140899.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140899.log.gz 2023-10-10T22:38:35.096 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136356.log 2023-10-10T22:38:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118811.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118811.log.gz 2023-10-10T22:38:35.099 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95833.log 2023-10-10T22:38:35.099 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.136356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.136356.log.gz 2023-10-10T22:38:35.099 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107295.log 2023-10-10T22:38:35.101 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95833.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95833.log.gz 2023-10-10T22:38:35.101 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127304.log 2023-10-10T22:38:35.102 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107295.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107295.log.gz 2023-10-10T22:38:35.102 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96620.log 2023-10-10T22:38:35.106 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105720.log 2023-10-10T22:38:35.106 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127304.log.gz 2023-10-10T22:38:35.106 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96620.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96620.log.gz 2023-10-10T22:38:35.106 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92219.log 2023-10-10T22:38:35.107 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105720.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105720.log.gz 2023-10-10T22:38:35.107 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94241.log 2023-10-10T22:38:35.108 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92219.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92219.log.gz 2023-10-10T22:38:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94156.log 2023-10-10T22:38:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94241.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94241.log.gz 2023-10-10T22:38:35.111 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100043.log 2023-10-10T22:38:35.111 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94156.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94156.log.gz 2023-10-10T22:38:35.112 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128749.log 2023-10-10T22:38:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100043.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100043.log.gz 2023-10-10T22:38:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91122.log 2023-10-10T22:38:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.128749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.128749.log.gz 2023-10-10T22:38:35.115 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133502.log 2023-10-10T22:38:35.116 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91122.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91122.log.gz 2023-10-10T22:38:35.117 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93188.log 2023-10-10T22:38:35.118 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.133502.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.133502.log.gz 2023-10-10T22:38:35.119 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110885.log 2023-10-10T22:38:35.120 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.93188.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93188.log.gz 2023-10-10T22:38:35.121 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108449.log 2023-10-10T22:38:35.122 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110885.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110885.log.gz 2023-10-10T22:38:35.122 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127094.log 2023-10-10T22:38:35.124 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108449.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108449.log.gz 2023-10-10T22:38:35.124 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129753.log 2023-10-10T22:38:35.126 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127094.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.127094.log.gz 2023-10-10T22:38:35.126 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91248.log 2023-10-10T22:38:35.126 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129753.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129753.log.gz 2023-10-10T22:38:35.127 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100451.log 2023-10-10T22:38:35.128 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91248.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91248.log.gz 2023-10-10T22:38:35.129 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101201.log 2023-10-10T22:38:35.130 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100451.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.100451.log.gz 2023-10-10T22:38:35.131 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98466.log 2023-10-10T22:38:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101201.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101201.log.gz 2023-10-10T22:38:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98251.log 2023-10-10T22:38:35.134 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98466.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98466.log.gz 2023-10-10T22:38:35.134 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97284.log 2023-10-10T22:38:35.135 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98251.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98251.log.gz 2023-10-10T22:38:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-10T22:38:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97284.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97284.log.gz 2023-10-10T22:38:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104789.log 2023-10-10T22:38:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105320.log 2023-10-10T22:38:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104789.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104789.log.gz 2023-10-10T22:38:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104747.log 2023-10-10T22:38:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105320.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105320.log.gz 2023-10-10T22:38:35.142 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95253.log 2023-10-10T22:38:35.144 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104747.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104747.log.gz 2023-10-10T22:38:35.144 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121456.log 2023-10-10T22:38:35.145 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95253.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95253.log.gz 2023-10-10T22:38:35.145 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115227.log 2023-10-10T22:38:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121456.log: gzip -5 --verbose -- 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121456.log.gz 2023-10-10T22:38:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90912.log 2023-10-10T22:38:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115227.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115227.log.gz 2023-10-10T22:38:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111346.log 2023-10-10T22:38:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90912.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.90912.log.gz 2023-10-10T22:38:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130519.log 2023-10-10T22:38:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111346.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111346.log.gz 2023-10-10T22:38:35.153 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112976.log 2023-10-10T22:38:35.155 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130519.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130519.log.gz 2023-10-10T22:38:35.155 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109281.log 2023-10-10T22:38:35.156 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112976.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112976.log.gz 2023-10-10T22:38:35.156 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140983.log 2023-10-10T22:38:35.158 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109281.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109281.log.gz 2023-10-10T22:38:35.158 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95127.log 2023-10-10T22:38:35.159 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140983.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140983.log.gz 2023-10-10T22:38:35.160 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118915.log 2023-10-10T22:38:35.161 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95127.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95127.log.gz 2023-10-10T22:38:35.162 INFO:teuthology.orchestra.run.smithi154.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.94367.log 2023-10-10T22:38:35.162 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118915.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118915.log.gz 2023-10-10T22:38:35.163 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92207.log 2023-10-10T22:38:35.164 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94367.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94367.log.gz 2023-10-10T22:38:35.165 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142900.log 2023-10-10T22:38:35.166 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92207.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92207.log.gz 2023-10-10T22:38:35.166 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116713.log 2023-10-10T22:38:35.168 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142900.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142900.log.gz 2023-10-10T22:38:35.169 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143770.log 2023-10-10T22:38:35.169 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116713.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116713.log.gz 2023-10-10T22:38:35.170 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85494.log 2023-10-10T22:38:35.172 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143770.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.143770.log.gz 2023-10-10T22:38:35.172 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141983.log 2023-10-10T22:38:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.85494.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.85494.log.gz 2023-10-10T22:38:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112160.log 2023-10-10T22:38:35.175 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141983.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141983.log.gz 2023-10-10T22:38:35.175 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111220.log 2023-10-10T22:38:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112160.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112160.log.gz 2023-10-10T22:38:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108631.log 2023-10-10T22:38:35.179 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111220.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111220.log.gz 2023-10-10T22:38:35.179 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131879.log 2023-10-10T22:38:35.180 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108631.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108631.log.gz 2023-10-10T22:38:35.180 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117863.log 2023-10-10T22:38:35.182 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131879.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131879.log.gz 2023-10-10T22:38:35.182 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120741.log 2023-10-10T22:38:35.183 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117863.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.117863.log.gz 2023-10-10T22:38:35.183 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135652.log 2023-10-10T22:38:35.185 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120741.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120741.log.gz 2023-10-10T22:38:35.186 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.94002.log 2023-10-10T22:38:35.186 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135652.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135652.log.gz 2023-10-10T22:38:35.187 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109029.log 2023-10-10T22:38:35.188 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.2.94002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.94002.log.gz 2023-10-10T22:38:35.189 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113325.log 2023-10-10T22:38:35.190 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109029.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109029.log.gz 2023-10-10T22:38:35.190 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112370.log 2023-10-10T22:38:35.192 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113325.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113325.log.gz 2023-10-10T22:38:35.192 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92718.log 2023-10-10T22:38:35.193 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112370.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112370.log.gz 2023-10-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131155.log 2023-10-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92718.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92718.log.gz 2023-10-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103713.log 2023-10-10T22:38:35.197 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131155.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131155.log.gz 2023-10-10T22:38:35.198 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110830.log 2023-10-10T22:38:35.198 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103713.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103713.log.gz 2023-10-10T22:38:35.199 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140941.log 2023-10-10T22:38:35.200 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110830.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110830.log.gz 2023-10-10T22:38:35.202 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126519.log 2023-10-10T22:38:35.202 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140941.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.140941.log.gz 2023-10-10T22:38:35.203 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129522.log 2023-10-10T22:38:35.204 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126519.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126519.log.gz 2023-10-10T22:38:35.205 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143026.log 2023-10-10T22:38:35.207 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129522.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129522.log.gz 2023-10-10T22:38:35.207 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107947.log 2023-10-10T22:38:35.208 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143026.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143026.log.gz 2023-10-10T22:38:35.208 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103271.log 2023-10-10T22:38:35.209 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107947.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107947.log.gz 2023-10-10T22:38:35.211 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-10T22:38:35.211 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103271.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.103271.log.gz 2023-10-10T22:38:35.211 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127136.log 2023-10-10T22:38:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114923.log 2023-10-10T22:38:35.215 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127136.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127136.log.gz 2023-10-10T22:38:35.215 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120657.log 2023-10-10T22:38:35.216 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108899.log 2023-10-10T22:38:35.217 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114923.log.gz 2023-10-10T22:38:35.219 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120657.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107992.log 2023-10-10T22:38:35.219 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120657.log.gz/var/log/ceph/ceph-client.admin.108899.log: 2023-10-10T22:38:35.220 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108899.log.gz 2023-10-10T22:38:35.221 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131281.log 2023-10-10T22:38:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96265.log 2023-10-10T22:38:35.224 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131281.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107992.log.gz 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131281.log.gz 2023-10-10T22:38:35.225 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:35.226 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117540.log 2023-10-10T22:38:35.227 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96265.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.96265.log.gz 2023-10-10T22:38:35.227 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96578.log 2023-10-10T22:38:35.229 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129352.log 2023-10-10T22:38:35.229 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117540.log.gz 2023-10-10T22:38:35.231 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141611.log 2023-10-10T22:38:35.232 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129352.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96578.log.gz 2023-10-10T22:38:35.232 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.129352.log.gz 2023-10-10T22:38:35.234 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131113.log 2023-10-10T22:38:35.235 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141611.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141611.log.gz 2023-10-10T22:38:35.235 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117905.log 2023-10-10T22:38:35.237 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142484.log 2023-10-10T22:38:35.238 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117905.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131113.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117905.log.gz 2023-10-10T22:38:35.239 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:35.240 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135484.log 2023-10-10T22:38:35.241 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142484.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142484.log.gz 2023-10-10T22:38:35.242 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121582.log 2023-10-10T22:38:35.243 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104229.log 2023-10-10T22:38:35.244 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121582.log: 89.0% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121582.log.gz 2023-10-10T22:38:35.245 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135484.log.gz 2023-10-10T22:38:35.246 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141415.log 2023-10-10T22:38:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104229.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104229.log.gz 2023-10-10T22:38:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104537.log 2023-10-10T22:38:35.250 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.141415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110787.log 2023-10-10T22:38:35.251 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.141415.log.gz 2023-10-10T22:38:35.251 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104537.log.gz 2023-10-10T22:38:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92928.log 2023-10-10T22:38:35.254 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120699.log 2023-10-10T22:38:35.255 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92928.log: 88.5% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.110787.log.gz -- replaced with /var/log/ceph/ceph-client.admin.92928.log.gz 2023-10-10T22:38:35.255 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:35.257 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122178.log 2023-10-10T22:38:35.258 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120699.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120699.log.gz 2023-10-10T22:38:35.258 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115051.log 2023-10-10T22:38:35.260 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.122178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111906.log 2023-10-10T22:38:35.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.122178.log.gz 2023-10-10T22:38:35.261 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115051.log.gz 2023-10-10T22:38:35.263 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127568.log 2023-10-10T22:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112884.log 2023-10-10T22:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111906.log.gz 2023-10-10T22:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127568.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127568.log.gz 2023-10-10T22:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110740.log 2023-10-10T22:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112884.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112884.log.gz 2023-10-10T22:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126381.log 2023-10-10T22:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117498.log 2023-10-10T22:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126381.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.126381.log.gz 2023-10-10T22:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110740.log.gz 2023-10-10T22:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114743.log 2023-10-10T22:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117498.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117498.log.gz 2023-10-10T22:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95791.log 2023-10-10T22:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90596.log 2023-10-10T22:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95791.log: 88.3% 89.6% -- replaced with /var/log/ceph/ceph-client.admin.95791.log.gz 2023-10-10T22:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114743.log.gz 2023-10-10T22:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90422.log 2023-10-10T22:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90596.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90596.log.gz 2023-10-10T22:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139080.log 2023-10-10T22:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116575.log 2023-10-10T22:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139080.log: 87.9% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139080.log.gz 2023-10-10T22:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90422.log.gz 2023-10-10T22:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119695.log 2023-10-10T22:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116575.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116575.log.gz 2023-10-10T22:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109880.log 2023-10-10T22:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97650.log 2023-10-10T22:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119695.log.gz 2023-10-10T22:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.109880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109880.log.gz 2023-10-10T22:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109683.log 2023-10-10T22:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97650.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97650.log.gz 2023-10-10T22:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115884.log 2023-10-10T22:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109683.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109683.log.gz 2023-10-10T22:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128019.log 2023-10-10T22:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115884.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115884.log.gz 2023-10-10T22:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131069.log 2023-10-10T22:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116268.log 2023-10-10T22:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131069.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128019.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.131069.log.gz 2023-10-10T22:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97176.log 2023-10-10T22:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.116268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116268.log.gz 2023-10-10T22:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140731.log 2023-10-10T22:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121540.log 2023-10-10T22:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140731.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97176.log.gz 2023-10-10T22:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140731.log.gz 2023-10-10T22:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142066.log 2023-10-10T22:38:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139984.log 2023-10-10T22:38:35.311 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142066.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121540.log.gz 2023-10-10T22:38:35.312 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142066.log.gz 2023-10-10T22:38:35.312 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112926.log 2023-10-10T22:38:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139984.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139984.log.gz 2023-10-10T22:38:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127652.log 2023-10-10T22:38:35.315 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91548.log 2023-10-10T22:38:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127652.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127652.log.gz 2023-10-10T22:38:35.316 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112926.log.gz 2023-10-10T22:38:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131641.log 2023-10-10T22:38:35.318 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91548.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91548.log.gz 2023-10-10T22:38:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103839.log 2023-10-10T22:38:35.321 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140647.log 2023-10-10T22:38:35.322 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103839.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103839.log.gz 2023-10-10T22:38:35.322 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131641.log.gz 2023-10-10T22:38:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103545.log 2023-10-10T22:38:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140647.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140647.log.gz 2023-10-10T22:38:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130457.log 2023-10-10T22:38:35.327 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103545.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79505.log 2023-10-10T22:38:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130457.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103545.log.gz 89.5% -- replaced with /var/log/ceph/ceph-client.admin.130457.log.gz 2023-10-10T22:38:35.329 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:35.330 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121985.log 2023-10-10T22:38:35.331 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.tmp-client.admin.79505.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79505.log.gz 2023-10-10T22:38:35.331 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131491.log 2023-10-10T22:38:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140689.log 2023-10-10T22:38:35.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131491.log: 89.7% 87.2% -- replaced with /var/log/ceph/ceph-client.admin.131491.log.gz 2023-10-10T22:38:35.335 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.121985.log.gz 2023-10-10T22:38:35.336 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121412.log 2023-10-10T22:38:35.337 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140689.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140689.log.gz 2023-10-10T22:38:35.338 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129661.log 2023-10-10T22:38:35.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140043.log 2023-10-10T22:38:35.341 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129661.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121412.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129661.log.gz 2023-10-10T22:38:35.341 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:35.342 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127753.log 2023-10-10T22:38:35.343 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140043.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140043.log.gz 2023-10-10T22:38:35.344 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135921.log 2023-10-10T22:38:35.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127753.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127753.log.gz 2023-10-10T22:38:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103226.log 2023-10-10T22:38:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118297.log 2023-10-10T22:38:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103226.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135921.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103226.log.gz 2023-10-10T22:38:35.349 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:35.350 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126702.log 2023-10-10T22:38:35.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85773.log 2023-10-10T22:38:35.352 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118297.log.gz 2023-10-10T22:38:35.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121498.log 2023-10-10T22:38:35.355 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4%/var/log/ceph/ceph-client.admin.85773.log: -- replaced with /var/log/ceph/ceph-client.admin.126702.log.gz 2023-10-10T22:38:35.355 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85773.log.gz 2023-10-10T22:38:35.356 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143644.log 2023-10-10T22:38:35.358 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109449.log 2023-10-10T22:38:35.359 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143644.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121498.log.gz 2023-10-10T22:38:35.359 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143644.log.gz 2023-10-10T22:38:35.361 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143896.log 2023-10-10T22:38:35.362 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109449.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109449.log.gz 2023-10-10T22:38:35.363 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119818.log 2023-10-10T22:38:35.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111612.log 2023-10-10T22:38:35.365 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143896.log.gz 2023-10-10T22:38:35.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108714.log 2023-10-10T22:38:35.367 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111612.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119818.log.gz 2023-10-10T22:38:35.367 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111612.log.gz 2023-10-10T22:38:35.369 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130891.log 2023-10-10T22:38:35.370 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136619.log 2023-10-10T22:38:35.371 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108714.log.gz 2023-10-10T22:38:35.373 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.131834.log 2023-10-10T22:38:35.373 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136619.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130891.log.gz 2023-10-10T22:38:35.374 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.136619.log.gz 2023-10-10T22:38:35.375 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95211.log 2023-10-10T22:38:35.376 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.131834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92508.log 2023-10-10T22:38:35.377 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.131834.log.gz 2023-10-10T22:38:35.378 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.95211.log.gz 2023-10-10T22:38:35.378 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104579.log 2023-10-10T22:38:35.380 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134753.log 2023-10-10T22:38:35.381 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104579.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92508.log.gz 2023-10-10T22:38:35.382 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104579.log.gz 2023-10-10T22:38:35.382 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131365.log 2023-10-10T22:38:35.384 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.134753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115007.log 2023-10-10T22:38:35.386 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131365.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134753.log.gz 87.8% 2023-10-10T22:38:35.386 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131365.log.gz 2023-10-10T22:38:35.387 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118035.log 2023-10-10T22:38:35.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115007.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115007.log.gz 2023-10-10T22:38:35.389 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113960.log 2023-10-10T22:38:35.391 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94535.log 2023-10-10T22:38:35.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113960.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118035.log.gz 2023-10-10T22:38:35.392 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.113960.log.gz 2023-10-10T22:38:35.394 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128363.log 2023-10-10T22:38:35.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94535.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94535.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135963.log 2023-10-10T22:38:35.395 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:35.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97768.log 2023-10-10T22:38:35.398 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135963.log: 88.1% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135963.log.gz 2023-10-10T22:38:35.398 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128363.log.gz 2023-10-10T22:38:35.400 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90515.log 2023-10-10T22:38:35.401 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97768.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97768.log.gz 2023-10-10T22:38:35.401 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143391.log 2023-10-10T22:38:35.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.90515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112538.log 2023-10-10T22:38:35.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143391.log: 87.8% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143391.log.gz 2023-10-10T22:38:35.404 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90515.log.gz 2023-10-10T22:38:35.406 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121708.log 2023-10-10T22:38:35.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112538.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112538.log.gz 2023-10-10T22:38:35.407 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107847.log 2023-10-10T22:38:35.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115269.log 2023-10-10T22:38:35.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107847.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121708.log.gz 2023-10-10T22:38:35.410 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107847.log.gz 2023-10-10T22:38:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92844.log 2023-10-10T22:38:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.115269.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115269.log.gz 2023-10-10T22:38:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120194.log 2023-10-10T22:38:35.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92208.log 2023-10-10T22:38:35.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120194.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92844.log.gz 2023-10-10T22:38:35.416 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120194.log.gz 2023-10-10T22:38:35.418 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99985.log 2023-10-10T22:38:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92208.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92208.log.gz 2023-10-10T22:38:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94325.log 2023-10-10T22:38:35.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131197.log 2023-10-10T22:38:35.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94325.log: 87.3% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94325.log.gz 2023-10-10T22:38:35.423 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99985.log.gz 2023-10-10T22:38:35.424 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118573.log 2023-10-10T22:38:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131197.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131197.log.gz 2023-10-10T22:38:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94047.log 2023-10-10T22:38:35.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118573.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-10T22:38:35.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94047.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118573.log.gz 2023-10-10T22:38:35.428 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94047.log.gz 2023-10-10T22:38:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112244.log 2023-10-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117991.log 2023-10-10T22:38:35.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112244.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112244.log.gz 2023-10-10T22:38:35.435 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93602.log 2023-10-10T22:38:35.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.117991.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117991.log.gz 2023-10-10T22:38:35.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93054.log 2023-10-10T22:38:35.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.93602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93602.log.gz 2023-10-10T22:38:35.442 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139591.log 2023-10-10T22:38:35.444 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.93054.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.93054.log.gz 2023-10-10T22:38:35.446 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118127.log 2023-10-10T22:38:35.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139591.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139591.log.gz 2023-10-10T22:38:35.450 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113915.log 2023-10-10T22:38:35.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118127.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118127.log.gz 2023-10-10T22:38:35.454 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95625.log 2023-10-10T22:38:35.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113915.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113915.log.gz 2023-10-10T22:38:35.457 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91882.log 2023-10-10T22:38:35.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95625.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95625.log.gz 2023-10-10T22:38:35.461 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114785.log 2023-10-10T22:38:35.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91882.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91882.log.gz 2023-10-10T22:38:35.465 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110929.log 2023-10-10T22:38:35.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.114785.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114785.log.gz 2023-10-10T22:38:35.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110929.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110929.log.gz 2023-10-10T22:38:35.598 INFO:teuthology.orchestra.run.smithi179.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-10T22:38:36.006 INFO:teuthology.orchestra.run.smithi179.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-10T22:38:36.097 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-10T22:38:36.856 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-10T22:38:37.055 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-10T22:38:37.075 INFO:teuthology.orchestra.run.smithi179.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-10T22:38:37.319 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-10T22:38:37.496 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-10T22:38:37.500 INFO:teuthology.orchestra.run.smithi179.stderr: 2023-10-10T22:38:37.500 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m3.136s 2023-10-10T22:38:37.500 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m13.304s 2023-10-10T22:38:37.501 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m1.179s 2023-10-10T22:38:37.539 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-10T22:38:38.243 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-10T22:38:38.306 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-10T22:38:38.533 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-10T22:38:39.129 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-10T22:38:39.133 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-10-10T22:38:39.133 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m4.773s 2023-10-10T22:38:39.133 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m18.555s 2023-10-10T22:38:39.133 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m3.395s 2023-10-10T22:38:39.134 INFO:tasks.ceph:Archiving logs... 2023-10-10T22:38:39.135 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/remote/smithi154/log 2023-10-10T22:38:39.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-10T22:38:42.254 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/remote/smithi179/log 2023-10-10T22:38:42.255 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-10T22:38:44.032 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-10T22:38:44.044 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-10T22:38:44.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-10T22:38:44.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-10T22:38:44.168 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-10T22:38:44.180 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-10T22:38:44.180 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-10T22:38:44.186 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-10T22:38:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:bash: ntpq: command not found 2023-10-10T22:38:44.220 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2023-10-10T22:38:44.222 INFO:teuthology.orchestra.run.smithi154.stdout:210 Number of sources = 4 2023-10-10T22:38:44.222 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-10T22:38:44.223 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2023-10-10T22:38:44.223 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 39 -784us[ -784us] +/- 66ms 2023-10-10T22:38:44.223 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv02.front.sepia.ceph.com 3 7 377 40 +47us[ +126us] +/- 61ms 2023-10-10T22:38:44.223 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +620us[ +620us] +/- 98ms 2023-10-10T22:38:44.223 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T22:38:44.226 INFO:teuthology.orchestra.run.smithi179.stdout:210 Number of sources = 4 2023-10-10T22:38:44.226 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-10T22:38:44.226 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2023-10-10T22:38:44.226 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 37 -638us[ -638us] +/- 66ms 2023-10-10T22:38:44.227 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv02.front.sepia.ceph.com 3 8 377 161 +187us[ +238us] +/- 60ms 2023-10-10T22:38:44.227 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +730us[ +730us] +/- 98ms 2023-10-10T22:38:44.227 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-10T22:38:44.228 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-10T22:38:44.239 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-10T22:38:44.240 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-10T22:38:44.252 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-10T22:38:44.368 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-10T22:38:44.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-10T22:38:44.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T22:38:44.595 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-10T22:38:44.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T22:38:44.665 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-10T22:38:44.676 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-10T22:38:44.688 INFO:teuthology.task.internal:Duration was 6671.608133 seconds 2023-10-10T22:38:44.688 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-10T22:38:44.699 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-10T22:38:44.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-10T22:38:44.704 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-10T22:38:44.809 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-10T22:38:44.814 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-10T22:38:45.169 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-10T22:38:45.170 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2023-10-10T22:38:45.170 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-10T22:38:45.221 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2023-10-10T22:38:45.221 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-10T22:38:45.272 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-10T22:38:45.272 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-10T22:38:45.277 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-10T22:38:45.359 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-10T22:38:45.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-10T22:38:45.365 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-10T22:38:45.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-10T22:38:45.515 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-10T22:38:45.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-10T22:38:45.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-10T22:38:45.640 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-10T22:38:45.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-10T22:38:45.656 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-10T22:38:45.712 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2023-10-10T22:38:45.716 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2023-10-10T22:38:45.751 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-10T22:38:45.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T22:38:45.787 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-10T22:38:45.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-10T22:38:45.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-10T22:38:45.833 INFO:teuthology.task.internal:Transferring archived files... 2023-10-10T22:38:45.834 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/remote/smithi154 2023-10-10T22:38:45.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-10T22:38:45.904 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506/remote/smithi179 2023-10-10T22:38:45.905 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-10T22:38:45.978 INFO:teuthology.task.internal:Removing archive directory... 2023-10-10T22:38:45.978 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-10T22:38:45.984 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-10T22:38:46.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-10T22:38:46.032 INFO:teuthology.task.internal:Not uploading archives. 2023-10-10T22:38:46.033 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-10T22:38:46.053 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-10T22:38:46.053 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-10T22:38:46.060 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-10T22:38:46.092 INFO:teuthology.orchestra.run.smithi154.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 10 22:38 /home/ubuntu/cephtest 2023-10-10T22:38:46.096 INFO:teuthology.orchestra.run.smithi179.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 10 22:38 /home/ubuntu/cephtest 2023-10-10T22:38:46.099 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-10T22:38:46.112 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-10T22:38:46.138 INFO:teuthology.nuke:Checking targets against current locks 2023-10-10T22:38:46.165 DEBUG:teuthology.nuke:shortname: smithi154 2023-10-10T22:38:46.166 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T22:38:46.191 DEBUG:teuthology.nuke:shortname: smithi179 2023-10-10T22:38:46.192 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T22:38:46.195 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 20:37:50.283033', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNAa0MyBX2SU4fh7sucJJWCW69Q9CDdzir7pJcHcQDH8NGhcNSLzbBDzXXohkDW3rbYVuMgCDjVnwTEySKowwPA='} 2023-10-10T22:38:46.220 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_18:16:52-fs-wip-yuri3-testing-2023-10-10-0720-quincy-distro-default-smithi/7420506', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 20:37:50.284628', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN7S5515JYyPdNib3a3l7tnFLiIwt94OcfgmTLunS2XukTJ83ie3YP/0+lZiRm1skvf9eMKCQG33cCv81WblGTo='} 2023-10-10T22:38:46.245 INFO:teuthology.orchestra.console.smithi154:Power off 2023-10-10T22:38:46.246 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T22:38:46.267 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-10-10T22:38:46.267 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T22:38:46.283 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-10T22:38:46.284 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T22:38:46.293 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-10-10T22:38:46.305 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-10T22:38:46.305 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T22:38:46.329 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-10T22:38:50.294 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T22:38:50.330 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T22:38:50.405 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-10-10T22:38:50.439 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-10T22:38:54.409 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T22:38:54.441 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T22:38:54.520 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-10-10T22:38:54.551 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-10T22:38:54.621 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-10-10T22:38:58.554 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T22:38:58.664 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-10T22:38:58.765 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-10T22:38:58.870 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6671.608132600784 failure_reason: '"1696972590.160446 mon.a (mon.0) 623 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-10T22:38:58.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T22:38:58.973 INFO:teuthology.run:FAIL